-- Logs begin at Mon 2022-10-17 12:50:42 UTC, end at Mon 2022-10-17 15:16:39 UTC. -- Oct 17 13:22:27.568001 n-d-854247-14 systemd[1]: Starting Devstack devstack@n-api.service... Oct 17 13:22:27.577177 n-d-854247-14 devstack@n-api.service[104516]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 17 13:22:27.579394 n-d-854247-14 devstack@n-api.service[104516]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 17 13:22:27 2022] *** Oct 17 13:22:27.579394 n-d-854247-14 devstack@n-api.service[104516]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 17 13:22:27.579394 n-d-854247-14 devstack@n-api.service[104516]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 17 13:22:27.579394 n-d-854247-14 devstack@n-api.service[104516]: nodename: n-d-854247-14 Oct 17 13:22:27.579394 n-d-854247-14 devstack@n-api.service[104516]: machine: x86_64 Oct 17 13:22:27.579394 n-d-854247-14 devstack@n-api.service[104516]: clock source: unix Oct 17 13:22:27.579394 n-d-854247-14 devstack@n-api.service[104516]: pcre jit disabled Oct 17 13:22:27.579394 n-d-854247-14 devstack@n-api.service[104516]: detected number of CPU cores: 4 Oct 17 13:22:27.579394 n-d-854247-14 devstack@n-api.service[104516]: current working directory: / Oct 17 13:22:27.579394 n-d-854247-14 devstack@n-api.service[104516]: detected binary path: /usr/bin/uwsgi-core Oct 17 13:22:27.580084 n-d-854247-14 devstack@n-api.service[104516]: your processes number limit is 47680 Oct 17 13:22:27.580084 n-d-854247-14 devstack@n-api.service[104516]: your memory page size is 4096 bytes Oct 17 13:22:27.580084 n-d-854247-14 devstack@n-api.service[104516]: detected max file descriptor number: 2048 Oct 17 13:22:27.580084 n-d-854247-14 devstack@n-api.service[104516]: lock engine: pthread robust mutexes Oct 17 13:22:27.580084 n-d-854247-14 devstack@n-api.service[104516]: thunder lock: enabled Oct 17 13:22:27.580084 n-d-854247-14 devstack@n-api.service[104516]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 17 13:22:27.580084 n-d-854247-14 devstack@n-api.service[104516]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 17 13:22:27.618980 n-d-854247-14 devstack@n-api.service[104516]: Python main interpreter initialized at 0x55aeb82779c0 Oct 17 13:22:27.618980 n-d-854247-14 devstack@n-api.service[104516]: python threads support enabled Oct 17 13:22:27.618980 n-d-854247-14 devstack@n-api.service[104516]: your server socket listen backlog is limited to 100 connections Oct 17 13:22:27.618980 n-d-854247-14 devstack@n-api.service[104516]: your mercy for graceful operations on workers is 90 seconds Oct 17 13:22:27.619374 n-d-854247-14 devstack@n-api.service[104516]: mapped 403077 bytes (393 KB) for 2 cores Oct 17 13:22:27.619374 n-d-854247-14 devstack@n-api.service[104516]: *** Operational MODE: preforking *** Oct 17 13:22:27.619664 n-d-854247-14 devstack@n-api.service[104516]: *** uWSGI is running in multiple interpreter mode *** Oct 17 13:22:27.619664 n-d-854247-14 devstack@n-api.service[104516]: spawned uWSGI master process (pid: 104516) Oct 17 13:22:27.619875 n-d-854247-14 systemd[1]: Started Devstack devstack@n-api.service. Oct 17 13:22:27.620491 n-d-854247-14 devstack@n-api.service[104516]: spawned uWSGI worker 1 (pid: 104517, cores: 1) Oct 17 13:22:27.620714 n-d-854247-14 devstack@n-api.service[104516]: spawned uWSGI worker 2 (pid: 104518, cores: 1) Oct 17 13:22:27.620870 n-d-854247-14 devstack@n-api.service[104516]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 17 13:22:28.268577 n-d-854247-14 devstack@n-api.service[104517]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 17 13:22:28.274516 n-d-854247-14 devstack@n-api.service[104518]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 17 13:22:29.334514 n-d-854247-14 devstack@n-api.service[104517]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 13:22:29.334514 n-d-854247-14 devstack@n-api.service[104517]: from cryptography.utils import int_from_bytes Oct 17 13:22:29.335182 n-d-854247-14 devstack@n-api.service[104517]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 13:22:29.335182 n-d-854247-14 devstack@n-api.service[104517]: from cryptography.utils import int_from_bytes Oct 17 13:22:29.345466 n-d-854247-14 devstack@n-api.service[104518]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 13:22:29.345466 n-d-854247-14 devstack@n-api.service[104518]: from cryptography.utils import int_from_bytes Oct 17 13:22:29.345952 n-d-854247-14 devstack@n-api.service[104518]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 13:22:29.345952 n-d-854247-14 devstack@n-api.service[104518]: from cryptography.utils import int_from_bytes Oct 17 13:22:31.818041 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 17 13:22:31.818633 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 17 13:22:31.818719 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 17 13:22:31.819046 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 17 13:22:31.819142 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 17 13:22:31.819232 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 17 13:22:31.819436 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 17 13:22:31.819532 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 17 13:22:31.819776 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 17 13:22:31.819909 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.819992 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 17 13:22:31.820059 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.820402 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.820554 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.820698 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.820790 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.821026 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.821191 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.821282 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.821375 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.821628 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.821772 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.821919 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.822009 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.822251 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.822398 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.822487 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.822567 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.822771 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.822877 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.823115 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.823298 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-854247-14 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.823429 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.823539 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.823759 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.823903 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-854247-14 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.824042 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.824148 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.824373 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.824519 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.824649 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.824759 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.824988 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.825121 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.825287 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.825441 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.825577 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.825786 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.825948 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.827266 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.827598 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.827955 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.828201 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.828469 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.828768 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.828943 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.829110 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.829230 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.829382 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.829572 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.829730 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.829906 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.830126 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.830312 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.830476 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.830651 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.830861 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.831053 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.831239 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.831416 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-854247-14 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.831691 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.831920 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.832070 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-854247-14 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.832220 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.832342 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.832499 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.832632 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.832755 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.832909 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.833054 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.833187 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.833318 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.833442 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.833589 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.833710 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.833844 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.833967 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.834087 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.834215 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.834337 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.834457 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.834590 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.834713 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.834865 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.834989 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.835110 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.835275 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.835409 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.835532 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.835652 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.835773 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.835893 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.836023 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.836146 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.836273 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.836403 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.836403 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.836651 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.836786 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.836908 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.837037 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.837159 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.837280 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.837411 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.837411 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.837704 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.837827 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.837948 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.837948 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.838200 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.838323 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.838446 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.838575 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.838700 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.838833 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.838969 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.839093 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.839246 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.839371 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.839492 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.839626 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.839749 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.839877 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.839999 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.840118 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.840247 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.840370 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.840491 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.840612 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.840747 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.840884 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.841024 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.841146 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.841267 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.841395 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.841524 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.841646 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.841857 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.841983 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.842104 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.842232 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.842354 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.842354 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.842610 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.79 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.842610 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.79 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.842892 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.843015 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.843143 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.79 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.843281 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.843418 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.79 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.843542 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.843673 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.843796 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.843796 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.844038 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.844160 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.844295 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.844417 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.844549 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.844671 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.844806 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.844929 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.845049 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.845176 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.845301 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.845422 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.845551 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.845673 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.845801 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.845931 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.846054 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.846175 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.846304 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.846433 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.846543 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.846673 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.846794 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.846925 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.847055 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.847240 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.847368 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.847490 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.847625 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.847834 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.847959 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.848086 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.848207 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.848339 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.848460 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.848589 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.848721 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.848924 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.849106 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.849240 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.849371 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.849512 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.849636 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.849742 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.849924 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.850090 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.850205 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.850327 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.850465 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.850589 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.850803 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.850995 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.851145 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.851302 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.851447 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.851573 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.851695 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.851831 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.852046 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.852185 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.852311 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.852433 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.852554 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.852684 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.852892 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.853025 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.853158 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.853280 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.853432 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.853558 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.853749 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.854198 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.854377 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.854502 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.854687 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.854811 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.855097 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.855291 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.855416 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.855538 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.855678 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.855810 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.855942 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.856072 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.856204 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.856328 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.856471 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.856596 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.856769 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.856895 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.857066 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.857198 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.857363 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.857497 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.857661 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.857794 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.857957 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.858084 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.858382 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.858579 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.858709 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.858821 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.859016 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.859222 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.859374 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.859510 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.859634 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.859763 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.859937 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.860062 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.860243 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.860378 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.860545 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.860672 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.860871 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.860996 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.861184 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.861321 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.861518 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.861652 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.861855 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.861989 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.862176 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.862300 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.862484 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:22:31.862611 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.862810 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.862935 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.863141 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.863317 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.863476 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.863612 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.863784 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.863910 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.864093 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.864220 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.864414 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.864547 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.864721 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.864854 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.865029 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.865182 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.865380 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.865507 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.865629 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.865769 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.865933 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.866059 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.866252 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.866398 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.866563 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.866706 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.866873 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.866999 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.867203 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.867332 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.867516 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.867656 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.867834 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.867967 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.868149 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.868273 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.868466 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.868681 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.868807 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.868931 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.869082 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.869209 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.869412 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.869548 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.869723 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.869848 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.870040 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.870163 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.870350 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.870475 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.870656 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.870782 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.870963 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.871088 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.871291 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.871420 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.871626 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.871759 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.871933 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.872060 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.872240 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.872367 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.872551 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.872677 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.872858 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.872982 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.873173 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.873307 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.873486 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.873618 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.873816 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.874013 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.874144 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.874266 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.874398 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.874521 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.874702 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.874838 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.875028 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.875153 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.875429 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.875562 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.875686 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.875822 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.875969 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.876095 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.876270 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.876394 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.876582 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.876723 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.876887 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.877012 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.877192 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.877320 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.877496 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.877632 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.877795 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.877931 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.878094 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.878227 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.878392 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.878519 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.878693 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.878828 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.878993 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.879117 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.879309 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.879437 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.879612 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.879738 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.879920 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.880046 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.880224 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.880351 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.880531 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.880655 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.880838 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.880973 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.881143 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.881270 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.881448 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.881577 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.881748 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.881898 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.882054 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.882179 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.882360 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.882486 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.882661 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.882803 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.882963 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.883087 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.883295 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.883421 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.883599 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.883739 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.883902 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.884026 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.884203 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.884332 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.884504 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.884641 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.884811 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.884943 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.885117 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.885243 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.885420 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.885623 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.885751 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.885873 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.886016 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.886150 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.886323 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.886448 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.886628 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.886754 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.886932 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.887059 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.887264 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.887391 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.887592 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.887719 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.887891 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.888028 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.888198 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.888323 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.888515 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.888640 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.888827 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.888968 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.889129 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.889255 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.889477 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.889608 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.889782 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.889990 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.890122 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.890244 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.890366 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.890497 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.890655 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.890799 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.890956 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.891082 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.891280 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.891408 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.891578 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.891719 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.891877 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.892004 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.892177 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.892312 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.892478 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.892603 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.892780 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.892904 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.893079 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.893204 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.893374 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.893511 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.893671 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.893796 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.893984 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.894109 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.894290 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.894416 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.894597 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.894722 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.894902 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.895028 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.895259 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.895388 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.895568 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.895769 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.895895 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.896031 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.896156 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.896278 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.896447 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.896573 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.896757 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.896962 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.897086 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.897201 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.897355 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.897468 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.897670 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.897805 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.897974 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.898107 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.898287 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.898412 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.898592 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.898726 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.898915 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.899048 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.899239 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.899380 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.899555 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.899690 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.899852 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.899976 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.900163 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.900293 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.900469 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.900593 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.900786 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.900910 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.901089 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.901213 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.901402 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.901529 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.901712 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.901836 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.902023 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.902149 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.902331 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.902466 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.902639 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.902765 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.902946 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.903082 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.903273 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.903397 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.903582 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.903706 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.903892 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.904025 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.904203 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.904336 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.904516 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.904641 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.904835 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.904968 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.905189 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.905385 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.905588 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.905775 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.905978 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.906116 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.906241 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.906364 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.906485 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.906607 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.906729 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.906861 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.906984 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.907104 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.907311 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.907435 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.907613 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.907746 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.907921 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.908048 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.908230 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.908360 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.908535 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.908669 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.908838 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.908966 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.909139 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.909264 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.909443 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.909572 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.909750 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.909876 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.910055 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.910181 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.910358 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.910484 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.910660 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.910795 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.910970 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.911099 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.911296 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.911432 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.911599 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.911724 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.911899 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.912040 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.912205 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.912339 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.912514 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.912638 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.912818 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.912953 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.913123 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.913247 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.913433 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.913559 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.913730 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.913863 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.914032 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.914157 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.914348 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.914474 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.914652 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.914790 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.914940 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.915067 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.915261 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.915403 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.915563 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.915690 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.915888 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.916119 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.916244 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.916364 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.916500 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.916624 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.916774 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.916899 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.917089 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.917214 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.917396 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.917523 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.917703 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.917790 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.918006 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.918093 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.918313 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.918400 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.918622 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.918708 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.918934 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.919032 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.919267 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.919366 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.919576 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.919662 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.919885 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.919990 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.920189 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.920285 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.920494 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.920590 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.920878 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.921025 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.921338 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.921432 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.921647 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.921734 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.921956 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.922053 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.922259 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.922347 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.922567 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.922653 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.922882 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.922969 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.923209 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.923481 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.923570 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.923811 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.923912 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.924120 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.924207 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.924437 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.924691 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.924777 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.925028 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.925134 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.925351 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.925438 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.925674 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.925760 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.925992 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.926104 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.926296 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.926405 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.926598 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.926686 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.926900 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.926986 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.927223 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.927320 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.927534 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.927639 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.927844 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.927939 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.928145 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.928233 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.928445 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.928532 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.928752 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.928839 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.929057 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.929153 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.929356 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.929437 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.929658 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.929754 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.929957 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.930043 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.930262 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.930346 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.930558 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.930651 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.930861 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.930946 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.931160 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.931307 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.931498 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.931598 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.931802 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.931897 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.932104 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.932198 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.932404 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.932499 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.932704 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.932790 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.933019 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.933103 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.933327 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.933414 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.933629 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.933714 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.933935 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.934021 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.934278 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.934377 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.934578 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.934663 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.934880 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.934966 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.935223 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.935315 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.935529 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.935615 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.935833 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.935940 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.936134 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.936220 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.936558 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.936655 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.936867 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.936963 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.937175 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.937261 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.937481 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.937567 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.937800 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.937953 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.938103 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.938236 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.938404 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.938531 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.938701 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.938834 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.939010 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.939137 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.939342 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.939481 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.939650 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.939784 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.939954 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.940077 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.940241 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.940346 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.940539 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.940666 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.940831 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.940954 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.941136 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.941262 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.941437 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.941574 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.941741 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.941866 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.942038 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.942162 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.942344 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.942468 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.942642 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.942766 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.942940 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.943065 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.943261 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.943402 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.943568 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.943702 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.943873 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.944006 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.944170 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.944302 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.944472 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.944604 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.944783 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.944917 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.945084 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.945209 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.945382 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.945515 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.945685 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.945820 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.945985 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.946121 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.946282 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.946407 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.946615 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.946750 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.946875 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.946997 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.947182 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.947311 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.947498 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.947626 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.947805 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.948009 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.948136 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.948258 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.948389 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.948520 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.948682 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.948809 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.948991 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.949116 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.949312 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.949438 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.949567 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.949692 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.949855 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.949981 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.950154 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.950281 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.950456 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.950579 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.950755 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.950888 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.951061 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.951221 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.951385 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.951502 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.951686 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.951827 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.952008 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.952135 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.952343 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.952499 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.952622 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.952755 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.952947 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.953071 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.953226 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.953351 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.953564 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.953703 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.953871 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.953994 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.954174 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.954298 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.954500 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.954626 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.954798 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.954925 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.955100 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.955265 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.955437 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.955573 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.955744 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.955870 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.956053 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.956178 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.956355 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.956482 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.956690 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.956824 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.956947 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.957067 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.957260 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.957394 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.957562 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.957687 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.957862 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.958009 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.958200 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.958323 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.958483 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.958607 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.958780 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.958916 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.959089 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.959261 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.959419 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.959546 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.959897 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.960050 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.960186 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.960310 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.960432 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.960553 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.960675 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.960811 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.960942 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.961064 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.961236 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.961374 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.961542 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.961678 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.961849 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.961975 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.962154 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.962289 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.962462 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.962589 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.962767 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.962894 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.963070 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.963217 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.963402 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.963528 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.963706 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.963830 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.964005 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.964131 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.964308 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.964434 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.964607 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.964730 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.964919 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.965055 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.965221 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.965348 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.965525 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.965657 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.965831 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.965965 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.966140 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.966265 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.966445 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.966571 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.966799 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.966947 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.967100 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.967244 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.967450 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.967648 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.967809 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.967967 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.968130 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.968296 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.968444 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.968569 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.968761 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.968889 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.969075 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.969199 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.969380 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.969505 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.969678 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.969812 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.969977 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.970118 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.970282 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.970408 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.970600 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.970728 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.970903 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.971028 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.971228 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.971360 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.971524 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.971653 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.971842 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.971968 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.972142 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.972281 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.972459 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.972588 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.972760 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.972884 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.973082 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.973216 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.973387 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.973512 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.973712 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.973838 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.974130 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.974268 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.974437 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.974561 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.974744 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.974870 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.975061 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.975232 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.975406 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.975543 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.975731 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.975859 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.976044 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.976170 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.976355 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.976489 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.976679 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.976815 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.977017 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.977143 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.977294 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.977429 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.977602 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.977726 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.977902 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.978026 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.978220 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.978355 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.978535 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.978667 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.979153 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.979323 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.979484 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.979609 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.979810 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.979937 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.980133 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.980258 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.980447 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.980574 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.980777 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.980931 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.981096 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.981230 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.981400 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.981534 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.981703 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.981889 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.982014 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.982147 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.982300 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.982426 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.982600 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.982725 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.982920 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.983054 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.983401 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.983542 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.983790 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.983917 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.984058 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.984193 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.984319 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.984451 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.984582 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.984705 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.984835 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.984959 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.985137 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.985274 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.985437 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.985563 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.985759 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.985887 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.986066 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.986192 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.986381 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.986507 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.986690 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.986816 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.987068 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.987288 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.987417 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.987553 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.987687 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.987811 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.987935 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.988064 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.988188 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.988355 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.988477 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.988601 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.988806 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.988933 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.989112 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.989247 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.989422 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.989549 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.989727 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.989853 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.990058 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.990191 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.990359 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.990483 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.990682 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.990809 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.991001 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.991134 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.991343 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.991471 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.991652 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.991779 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.991966 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.992094 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.992284 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.992410 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.992585 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.992712 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.992882 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.993009 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.993186 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.993320 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.993485 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.993620 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.993785 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.993912 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.994081 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.994215 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.994385 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.994513 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.994684 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.994812 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.994982 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.995122 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.995304 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.995520 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.995654 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.995779 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.995909 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.996038 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.996190 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.996325 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.996488 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.996620 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.996791 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.996917 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.997089 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.997303 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.997430 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.997553 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.997702 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.997826 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.997999 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.998134 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.998301 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.998418 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.998605 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.998731 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.999083 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.999250 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.999378 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.999498 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.999620 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.999755 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:31.999928 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.000052 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.000432 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.000558 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.000663 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.000777 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.000910 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.001035 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.001158 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.001280 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.001469 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.001596 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.001783 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.001911 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.002095 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.002228 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.002406 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.002607 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.002744 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.002923 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.003050 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.003268 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.003398 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.003583 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.003713 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.003894 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.004163 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.004290 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.004492 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.004628 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.004798 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.004931 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.005105 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.005232 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.005413 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.005552 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.005719 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.005846 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.006024 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.006151 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.006336 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.006462 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.006649 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.006775 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.006962 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.007088 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.007303 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.007427 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.007621 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.007720 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.007932 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.008029 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.008241 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.008340 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.008550 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.008661 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.008885 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.009000 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.009202 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.009299 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.009502 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.009597 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.009809 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.009914 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.010115 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.010215 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.010425 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.010520 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.010733 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.010831 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.011037 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.011132 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.011381 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.011488 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.011691 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.011786 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.011996 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.012108 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.012301 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.012409 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.012604 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.012692 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.012912 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.012998 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.013223 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.013319 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.013534 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.013622 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.013845 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.013932 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.014151 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.014248 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.014485 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.014572 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.014823 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.014916 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.015144 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.015422 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.015510 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.015736 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.015835 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.016069 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.016167 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.016392 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.016588 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.016712 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.016911 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.017025 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.017247 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.017338 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.017579 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.017673 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.017906 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.017992 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.018223 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.018311 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.018526 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.018609 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.018834 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.018938 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.019140 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.019255 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.019473 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.019558 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.019778 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.019957 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.020080 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.020217 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.020391 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.020477 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.020693 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.020794 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.021009 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.021224 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.021313 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.021569 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.021657 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.021881 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.021970 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.022203 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.022436 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.022536 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.022782 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.022869 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.023098 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.023205 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.023458 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.023545 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.023761 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.023848 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.024065 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.024154 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.024378 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.024465 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.024688 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.024777 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.024989 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.025085 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.025290 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.025378 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.025596 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.025685 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.025905 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.025992 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.026207 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.026302 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.026510 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.026596 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.026809 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.026893 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.027116 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.027243 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.027445 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.027532 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.027747 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.027833 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.028049 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.028143 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.028354 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.028446 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.028655 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.028737 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.028956 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.029052 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.029260 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.029346 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.029558 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.029643 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.029863 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.029950 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.030287 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.030441 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.030586 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.030732 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.030867 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.030964 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.031103 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.031314 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.031494 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.031625 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.031793 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.031939 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.032089 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.032247 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.032433 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.032561 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.032717 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.032919 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.033007 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.033231 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.033318 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.033538 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.033626 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.033865 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.033952 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.034173 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.034260 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.034479 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.034576 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.034802 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.034888 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.035115 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.035252 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.035467 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.035690 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.035784 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.036022 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.036109 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.036341 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.036438 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.036677 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.036764 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.037006 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.037232 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.037328 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.037565 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.037652 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.037888 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.037975 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.038205 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.038304 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.038511 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.038598 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.038824 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.038912 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.039129 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.039247 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.039460 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.039547 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.039771 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.039857 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.040082 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.040169 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.040390 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.040477 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.040698 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.040783 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.041003 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.041098 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.041311 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.041406 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.041613 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.041698 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.041921 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.042018 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.042228 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.042314 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.042532 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.042614 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.042842 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.042937 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.043151 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.043259 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.043489 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.043589 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.043803 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.043898 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.044114 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.044199 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.044425 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.044519 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.044727 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.044813 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.045034 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.045122 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.045344 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.045439 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.045649 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.045743 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.046009 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.046097 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.046335 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.046424 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.046646 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.046755 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.046948 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.047070 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.047406 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.047664 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.047763 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.047988 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.048074 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.048313 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.048411 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.048630 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.048715 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.048942 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.049272 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.049368 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.049597 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.049692 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.049911 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.049999 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.050235 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.050338 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.050545 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.050634 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.050870 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.050967 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.051216 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.051323 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.051538 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.051625 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.051857 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.051945 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.052164 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.052253 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.052469 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.052556 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.052776 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.052883 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.053083 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.053173 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.053398 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.053486 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.053706 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.053794 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.054011 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.054106 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.054312 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.054399 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.054618 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.054713 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.054920 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.055006 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.055253 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.055342 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.055556 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.055655 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.055857 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.055951 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.056159 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.056253 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.056460 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.056556 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.056761 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.056854 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.057056 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.057141 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.057355 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.057451 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.057655 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.057749 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.057953 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.058041 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.058252 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.058338 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.058549 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.058635 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.058849 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.058934 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.059151 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.059260 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.059474 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.059560 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.059773 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.059871 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.060074 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.060161 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.060381 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.060468 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.060684 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.060778 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.060986 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.061083 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.061306 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.061426 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.061692 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.061873 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.062000 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.062218 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.062305 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.062540 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.062626 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.062870 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.062977 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.063208 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.063338 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.063531 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.063623 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.063848 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.063937 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.064155 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.064240 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.064463 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.064550 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.064771 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.064859 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.065078 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.065166 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.065387 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.065482 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.065707 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.065793 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.066020 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.066109 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.066321 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.066417 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.066627 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.066714 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.066936 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.067023 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.067269 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.067375 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.067583 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.067669 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.067891 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.067984 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.068258 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.068352 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.068515 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.068601 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.068820 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.068907 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.069134 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.069230 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.069441 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.069528 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.069749 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.069837 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.070062 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.070150 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.070368 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.070456 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.070676 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.070770 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.070986 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.071072 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.071322 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.071427 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.071635 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.071731 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.071950 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.072039 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.072254 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.072340 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.072561 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.072655 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.072882 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.072990 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.073200 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.073298 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.073516 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.073618 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.073840 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.073930 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.074149 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.074241 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.074464 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.074554 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.074773 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.074864 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.075075 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.075187 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.075340 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 17 13:22:32.075444 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.075780 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.076109 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.076423 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.076736 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.077068 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:22:32.077415 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 17 13:22:32.228308 n-d-854247-14 devstack@n-api.service[104517]: INFO dbcounter [None req-43e0383b-f969-4a5c-a19c-03139c549c69 None None] Registered counter for database nova_api Oct 17 13:22:32.230322 n-d-854247-14 devstack@n-api.service[104518]: INFO dbcounter [None req-05e0d4bf-d46d-4eba-9ac8-e8ad91ee0ffd None None] Registered counter for database nova_api Oct 17 13:22:32.249782 n-d-854247-14 devstack@n-api.service[104517]: DEBUG oslo_db.sqlalchemy.engines [None req-43e0383b-f969-4a5c-a19c-03139c549c69 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104517) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 13:22:32.251521 n-d-854247-14 devstack@n-api.service[104518]: DEBUG oslo_db.sqlalchemy.engines [None req-05e0d4bf-d46d-4eba-9ac8-e8ad91ee0ffd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104518) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 13:22:32.257171 n-d-854247-14 devstack@n-api.service[104517]: DEBUG dbcounter [-] [104517] Writer thread running {{(pid=104517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 13:22:32.258199 n-d-854247-14 devstack@n-api.service[104518]: DEBUG dbcounter [-] [104518] Writer thread running {{(pid=104518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 13:22:32.312832 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.context [None req-43e0383b-f969-4a5c-a19c-03139c549c69 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),23debefa-f967-4de1-8ea3-1fa7cc16392a(cell1) {{(pid=104517) load_cells /opt/stack/nova/nova/context.py:464}} Oct 17 13:22:32.314276 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.context [None req-05e0d4bf-d46d-4eba-9ac8-e8ad91ee0ffd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),23debefa-f967-4de1-8ea3-1fa7cc16392a(cell1) {{(pid=104518) load_cells /opt/stack/nova/nova/context.py:464}} Oct 17 13:22:32.316722 n-d-854247-14 devstack@n-api.service[104517]: DEBUG oslo_concurrency.lockutils [None req-43e0383b-f969-4a5c-a19c-03139c549c69 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:32.317213 n-d-854247-14 devstack@n-api.service[104517]: DEBUG oslo_concurrency.lockutils [None req-43e0383b-f969-4a5c-a19c-03139c549c69 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:32.318144 n-d-854247-14 devstack@n-api.service[104518]: DEBUG oslo_concurrency.lockutils [None req-05e0d4bf-d46d-4eba-9ac8-e8ad91ee0ffd None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:32.318682 n-d-854247-14 devstack@n-api.service[104518]: DEBUG oslo_concurrency.lockutils [None req-05e0d4bf-d46d-4eba-9ac8-e8ad91ee0ffd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:32.318826 n-d-854247-14 devstack@n-api.service[104517]: DEBUG oslo_concurrency.lockutils [None req-43e0383b-f969-4a5c-a19c-03139c549c69 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:32.319495 n-d-854247-14 devstack@n-api.service[104517]: DEBUG oslo_concurrency.lockutils [None req-43e0383b-f969-4a5c-a19c-03139c549c69 None None] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:32.319928 n-d-854247-14 devstack@n-api.service[104517]: DEBUG oslo_concurrency.lockutils [None req-43e0383b-f969-4a5c-a19c-03139c549c69 None None] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:32.320219 n-d-854247-14 devstack@n-api.service[104518]: DEBUG oslo_concurrency.lockutils [None req-05e0d4bf-d46d-4eba-9ac8-e8ad91ee0ffd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:32.320941 n-d-854247-14 devstack@n-api.service[104518]: DEBUG oslo_concurrency.lockutils [None req-05e0d4bf-d46d-4eba-9ac8-e8ad91ee0ffd None None] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:32.321384 n-d-854247-14 devstack@n-api.service[104518]: DEBUG oslo_concurrency.lockutils [None req-05e0d4bf-d46d-4eba-9ac8-e8ad91ee0ffd None None] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:32.321899 n-d-854247-14 devstack@n-api.service[104517]: DEBUG oslo_concurrency.lockutils [None req-43e0383b-f969-4a5c-a19c-03139c549c69 None None] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:32.323401 n-d-854247-14 devstack@n-api.service[104518]: DEBUG oslo_concurrency.lockutils [None req-05e0d4bf-d46d-4eba-9ac8-e8ad91ee0ffd None None] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:32.323941 n-d-854247-14 devstack@n-api.service[104517]: INFO dbcounter [None req-43e0383b-f969-4a5c-a19c-03139c549c69 None None] Registered counter for database nova_cell0 Oct 17 13:22:32.325424 n-d-854247-14 devstack@n-api.service[104518]: INFO dbcounter [None req-05e0d4bf-d46d-4eba-9ac8-e8ad91ee0ffd None None] Registered counter for database nova_cell0 Oct 17 13:22:32.328047 n-d-854247-14 devstack@n-api.service[104517]: INFO dbcounter [None req-43e0383b-f969-4a5c-a19c-03139c549c69 None None] Registered counter for database nova_cell1 Oct 17 13:22:32.329453 n-d-854247-14 devstack@n-api.service[104518]: INFO dbcounter [None req-05e0d4bf-d46d-4eba-9ac8-e8ad91ee0ffd None None] Registered counter for database nova_cell1 Oct 17 13:22:32.335423 n-d-854247-14 devstack@n-api.service[104517]: DEBUG oslo_db.sqlalchemy.engines [None req-43e0383b-f969-4a5c-a19c-03139c549c69 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104517) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 13:22:32.338087 n-d-854247-14 devstack@n-api.service[104518]: DEBUG oslo_db.sqlalchemy.engines [None req-05e0d4bf-d46d-4eba-9ac8-e8ad91ee0ffd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104518) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 13:22:32.339266 n-d-854247-14 devstack@n-api.service[104518]: DEBUG oslo_db.sqlalchemy.engines [None req-05e0d4bf-d46d-4eba-9ac8-e8ad91ee0ffd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104518) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 13:22:32.340916 n-d-854247-14 devstack@n-api.service[104517]: DEBUG dbcounter [-] [104517] Writer thread running {{(pid=104517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 13:22:32.341546 n-d-854247-14 devstack@n-api.service[104517]: DEBUG oslo_db.sqlalchemy.engines [None req-43e0383b-f969-4a5c-a19c-03139c549c69 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104517) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 13:22:32.345950 n-d-854247-14 devstack@n-api.service[104518]: DEBUG dbcounter [-] [104518] Writer thread running {{(pid=104518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 13:22:32.347416 n-d-854247-14 devstack@n-api.service[104518]: DEBUG dbcounter [-] [104518] Writer thread running {{(pid=104518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 13:22:32.478099 n-d-854247-14 devstack@n-api.service[104517]: DEBUG dbcounter [-] [104517] Writer thread running {{(pid=104517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 13:22:32.488146 n-d-854247-14 devstack@n-api.service[104517]: INFO dbcounter [None req-43e0383b-f969-4a5c-a19c-03139c549c69 None None] Registered counter for database nova_cell0 Oct 17 13:22:32.489957 n-d-854247-14 devstack@n-api.service[104518]: INFO dbcounter [None req-05e0d4bf-d46d-4eba-9ac8-e8ad91ee0ffd None None] Registered counter for database nova_cell0 Oct 17 13:22:32.496303 n-d-854247-14 devstack@n-api.service[104517]: DEBUG oslo_db.sqlalchemy.engines [None req-43e0383b-f969-4a5c-a19c-03139c549c69 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104517) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 13:22:32.498656 n-d-854247-14 devstack@n-api.service[104518]: DEBUG oslo_db.sqlalchemy.engines [None req-05e0d4bf-d46d-4eba-9ac8-e8ad91ee0ffd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104518) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 13:22:32.501809 n-d-854247-14 devstack@n-api.service[104517]: DEBUG dbcounter [-] [104517] Writer thread running {{(pid=104517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 13:22:32.504045 n-d-854247-14 devstack@n-api.service[104518]: DEBUG dbcounter [-] [104518] Writer thread running {{(pid=104518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 13:22:32.846274 n-d-854247-14 devstack@n-api.service[104517]: WARNING keystonemiddleware.auth_token [None req-43e0383b-f969-4a5c-a19c-03139c549c69 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 13:22:32.846861 n-d-854247-14 devstack@n-api.service[104518]: WARNING keystonemiddleware.auth_token [None req-05e0d4bf-d46d-4eba-9ac8-e8ad91ee0ffd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 13:22:32.854403 n-d-854247-14 devstack@n-api.service[104517]: WARNING keystonemiddleware.auth_token [None req-43e0383b-f969-4a5c-a19c-03139c549c69 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 13:22:32.854537 n-d-854247-14 devstack@n-api.service[104518]: WARNING keystonemiddleware.auth_token [None req-05e0d4bf-d46d-4eba-9ac8-e8ad91ee0ffd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 13:22:33.201645 n-d-854247-14 devstack@n-api.service[104518]: WARNING keystonemiddleware.auth_token [None req-05e0d4bf-d46d-4eba-9ac8-e8ad91ee0ffd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 13:22:33.205441 n-d-854247-14 devstack@n-api.service[104517]: WARNING keystonemiddleware.auth_token [None req-43e0383b-f969-4a5c-a19c-03139c549c69 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 13:22:33.207942 n-d-854247-14 devstack@n-api.service[104518]: WARNING keystonemiddleware.auth_token [None req-05e0d4bf-d46d-4eba-9ac8-e8ad91ee0ffd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 13:22:33.211425 n-d-854247-14 devstack@n-api.service[104517]: WARNING keystonemiddleware.auth_token [None req-43e0383b-f969-4a5c-a19c-03139c549c69 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 13:22:33.213217 n-d-854247-14 devstack@n-api.service[104518]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55aeb82779c0 pid: 104518 (default app) Oct 17 13:22:33.215303 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi [None req-05e0d4bf-d46d-4eba-9ac8-e8ad91ee0ffd None None] Calling method '>' {{(pid=104518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:33.216539 n-d-854247-14 devstack@n-api.service[104518]: INFO nova.api.openstack.requestlog [None req-05e0d4bf-d46d-4eba-9ac8-e8ad91ee0ffd None None] 10.222.0.79 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001779 Oct 17 13:22:33.216749 n-d-854247-14 devstack@n-api.service[104517]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55aeb82779c0 pid: 104517 (default app) Oct 17 13:22:33.217124 n-d-854247-14 devstack@n-api.service[104518]: [pid: 104518|app: 0|req: 1/1] 10.222.0.79 () {50 vars in 788 bytes} [Mon Oct 17 13:22:33 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:23:55.307231 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-43e0383b-f969-4a5c-a19c-03139c549c69 None None] Calling method '>' {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:55.308473 n-d-854247-14 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-43e0383b-f969-4a5c-a19c-03139c549c69 None None] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002007 Oct 17 13:23:55.308854 n-d-854247-14 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 1/2] 10.222.0.79 () {54 vars in 931 bytes} [Mon Oct 17 13:23:55 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:23:55.320405 n-d-854247-14 devstack@n-api.service[104518]: DEBUG dbcounter [-] [104518] Writing DB stats nova_api:SELECT=3 {{(pid=104518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:23:55.321513 n-d-854247-14 devstack@n-api.service[104518]: DEBUG dbcounter [-] [104518] Writing DB stats nova_cell0:SELECT=3 {{(pid=104518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:23:55.324225 n-d-854247-14 devstack@n-api.service[104518]: DEBUG dbcounter [-] [104518] Writing DB stats nova_cell1:SELECT=3 {{(pid=104518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:23:55.325400 n-d-854247-14 devstack@n-api.service[104518]: DEBUG dbcounter [-] [104518] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:23:56.209327 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi [None req-9a381434-01a2-4185-9563-5a85c3cf3524 admin admin] Calling method '>' {{(pid=104518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:56.242898 n-d-854247-14 devstack@n-api.service[104518]: INFO nova.api.openstack.requestlog [None req-9a381434-01a2-4185-9563-5a85c3cf3524 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.927938 Oct 17 13:23:56.243908 n-d-854247-14 devstack@n-api.service[104518]: [pid: 104518|app: 0|req: 2/3] 10.222.0.79 () {60 vars in 1292 bytes} [Mon Oct 17 13:23:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:58.869078 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-43e0383b-f969-4a5c-a19c-03139c549c69 None None] Calling method '>' {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:58.870241 n-d-854247-14 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-43e0383b-f969-4a5c-a19c-03139c549c69 None None] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Oct 17 13:23:58.870820 n-d-854247-14 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 2/4] 10.222.0.79 () {54 vars in 931 bytes} [Mon Oct 17 13:23:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:23:59.350066 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi [None req-75029c7f-ae4e-4bf4-a90a-1125b155c896 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "id": "c1", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "disk": 1}} {{(pid=104518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:59.399502 n-d-854247-14 devstack@n-api.service[104518]: INFO nova.api.openstack.requestlog [None req-75029c7f-ae4e-4bf4-a90a-1125b155c896 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.521747 Oct 17 13:23:59.400311 n-d-854247-14 devstack@n-api.service[104518]: [pid: 104518|app: 0|req: 3/5] 10.222.0.79 () {64 vars in 1283 bytes} [Mon Oct 17 13:23:58 2022] POST /compute/v2.1/flavors => generated 407 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:23:59.414008 n-d-854247-14 devstack@n-api.service[104517]: DEBUG dbcounter [-] [104517] Writing DB stats nova_api:SELECT=3 {{(pid=104517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:23:59.415661 n-d-854247-14 devstack@n-api.service[104517]: DEBUG dbcounter [-] [104517] Writing DB stats nova_cell1:SELECT=3 {{(pid=104517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:23:59.417267 n-d-854247-14 devstack@n-api.service[104517]: DEBUG dbcounter [-] [104517] Writing DB stats nova_cell0:SELECT=3 {{(pid=104517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:23:59.418255 n-d-854247-14 devstack@n-api.service[104517]: DEBUG dbcounter [-] [104517] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:23:59.625014 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-153a2ca1-346a-4fd8-ac98-38c44913d896 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:59.695098 n-d-854247-14 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-153a2ca1-346a-4fd8-ac98-38c44913d896 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.286592 Oct 17 13:23:59.695978 n-d-854247-14 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 3/6] 10.222.0.79 () {64 vars in 1336 bytes} [Mon Oct 17 13:23:59 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:24:02.422685 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi [None req-75029c7f-ae4e-4bf4-a90a-1125b155c896 admin admin] Calling method '>' {{(pid=104518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:02.424265 n-d-854247-14 devstack@n-api.service[104518]: INFO nova.api.openstack.requestlog [None req-75029c7f-ae4e-4bf4-a90a-1125b155c896 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002043 Oct 17 13:24:02.424830 n-d-854247-14 devstack@n-api.service[104518]: [pid: 104518|app: 0|req: 4/7] 10.222.0.79 () {54 vars in 931 bytes} [Mon Oct 17 13:24:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:24:03.316699 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-31172628-dfd3-4cd5-877e-ce0b88d559fa admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d1", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 5, "vcpus": 1, "swap": 0, "name": "ds512M"}} {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:24:03.379474 n-d-854247-14 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-31172628-dfd3-4cd5-877e-ce0b88d559fa admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.947493 Oct 17 13:24:03.380630 n-d-854247-14 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 4/8] 10.222.0.79 () {64 vars in 1283 bytes} [Mon Oct 17 13:24:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:24:03.393199 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi [None req-c641df82-96d0-4866-b0f8-066fbd75dcb9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:24:03.450238 n-d-854247-14 devstack@n-api.service[104518]: INFO nova.api.openstack.requestlog [None req-c641df82-96d0-4866-b0f8-066fbd75dcb9 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.059639 Oct 17 13:24:03.461708 n-d-854247-14 devstack@n-api.service[104518]: [pid: 104518|app: 0|req: 5/9] 10.222.0.79 () {64 vars in 1336 bytes} [Mon Oct 17 13:24:03 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:06.901226 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-31172628-dfd3-4cd5-877e-ce0b88d559fa admin admin] Calling method '>' {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:06.902350 n-d-854247-14 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-31172628-dfd3-4cd5-877e-ce0b88d559fa admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001859 Oct 17 13:24:06.903018 n-d-854247-14 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 5/10] 10.222.0.79 () {54 vars in 931 bytes} [Mon Oct 17 13:24:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:24:07.349771 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi [None req-448084c8-02ab-448a-9e11-2d624894fa04 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "name": "ds1G", "os-flavor-access:is_public": true, "ram": 1024, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "id": "d2"}} {{(pid=104518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:24:07.373621 n-d-854247-14 devstack@n-api.service[104518]: INFO nova.api.openstack.requestlog [None req-448084c8-02ab-448a-9e11-2d624894fa04 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.464698 Oct 17 13:24:07.374457 n-d-854247-14 devstack@n-api.service[104518]: [pid: 104518|app: 0|req: 6/11] 10.222.0.79 () {64 vars in 1283 bytes} [Mon Oct 17 13:24:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:24:07.386900 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-10b440e8-2dd8-48f9-af82-e441b6f46071 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:24:07.416007 n-d-854247-14 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-10b440e8-2dd8-48f9-af82-e441b6f46071 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032904 Oct 17 13:24:07.416921 n-d-854247-14 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 6/12] 10.222.0.79 () {64 vars in 1336 bytes} [Mon Oct 17 13:24:07 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:10.062253 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi [None req-448084c8-02ab-448a-9e11-2d624894fa04 admin admin] Calling method '>' {{(pid=104518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:10.063913 n-d-854247-14 devstack@n-api.service[104518]: INFO nova.api.openstack.requestlog [None req-448084c8-02ab-448a-9e11-2d624894fa04 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002119 Oct 17 13:24:10.064488 n-d-854247-14 devstack@n-api.service[104518]: [pid: 104518|app: 0|req: 7/13] 10.222.0.79 () {54 vars in 931 bytes} [Mon Oct 17 13:24:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:24:10.565121 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-809b8a12-101d-4f1c-977a-aa3e04aa0f33 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "vcpus": 2, "name": "ds2G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "rxtx_factor": 1.0, "disk": 10, "os-flavor-access:is_public": true}} {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:24:10.588102 n-d-854247-14 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-809b8a12-101d-4f1c-977a-aa3e04aa0f33 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.517153 Oct 17 13:24:10.588949 n-d-854247-14 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 7/14] 10.222.0.79 () {64 vars in 1283 bytes} [Mon Oct 17 13:24:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 13:24:10.601486 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi [None req-d34e1e46-a2f2-4b46-83d1-3e543c9870f6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:24:10.635845 n-d-854247-14 devstack@n-api.service[104518]: INFO nova.api.openstack.requestlog [None req-d34e1e46-a2f2-4b46-83d1-3e543c9870f6 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038135 Oct 17 13:24:10.643894 n-d-854247-14 devstack@n-api.service[104518]: [pid: 104518|app: 0|req: 8/15] 10.222.0.79 () {64 vars in 1336 bytes} [Mon Oct 17 13:24:10 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:24:13.402250 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-809b8a12-101d-4f1c-977a-aa3e04aa0f33 admin admin] Calling method '>' {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:13.403455 n-d-854247-14 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-809b8a12-101d-4f1c-977a-aa3e04aa0f33 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001600 Oct 17 13:24:13.404380 n-d-854247-14 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 8/16] 10.222.0.79 () {54 vars in 931 bytes} [Mon Oct 17 13:24:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:24:13.894777 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi [None req-a78c9354-ef48-4eaf-95e8-3fcf00ff5189 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 20, "id": "d4", "os-flavor-access:is_public": true, "ram": 4096, "swap": 0, "vcpus": 4}} {{(pid=104518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:24:13.921311 n-d-854247-14 devstack@n-api.service[104518]: INFO nova.api.openstack.requestlog [None req-a78c9354-ef48-4eaf-95e8-3fcf00ff5189 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.507543 Oct 17 13:24:13.935541 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-1118207a-f69a-4adf-8723-756dd56cc07a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:24:13.942143 n-d-854247-14 devstack@n-api.service[104518]: [pid: 104518|app: 0|req: 9/17] 10.222.0.79 () {64 vars in 1283 bytes} [Mon Oct 17 13:24:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 13:24:13.967415 n-d-854247-14 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-1118207a-f69a-4adf-8723-756dd56cc07a admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035521 Oct 17 13:24:13.985787 n-d-854247-14 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 9/18] 10.222.0.79 () {64 vars in 1336 bytes} [Mon Oct 17 13:24:13 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:16.699016 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi [None req-a78c9354-ef48-4eaf-95e8-3fcf00ff5189 admin admin] Calling method '>' {{(pid=104518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:16.700080 n-d-854247-14 devstack@n-api.service[104518]: INFO nova.api.openstack.requestlog [None req-a78c9354-ef48-4eaf-95e8-3fcf00ff5189 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001623 Oct 17 13:24:16.700543 n-d-854247-14 devstack@n-api.service[104518]: [pid: 104518|app: 0|req: 10/19] 10.222.0.79 () {54 vars in 931 bytes} [Mon Oct 17 13:24:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:24:17.153476 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-f9014fbb-d250-46dc-af69-a015197e2c53 admin admin] Calling method '>' {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:17.184590 n-d-854247-14 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-f9014fbb-d250-46dc-af69-a015197e2c53 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.477384 Oct 17 13:24:17.185282 n-d-854247-14 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 10/20] 10.222.0.79 () {60 vars in 1292 bytes} [Mon Oct 17 13:24:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:24:19.807091 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi [None req-a78c9354-ef48-4eaf-95e8-3fcf00ff5189 admin admin] Calling method '>' {{(pid=104518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:19.808503 n-d-854247-14 devstack@n-api.service[104518]: INFO nova.api.openstack.requestlog [None req-a78c9354-ef48-4eaf-95e8-3fcf00ff5189 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002228 Oct 17 13:24:19.809040 n-d-854247-14 devstack@n-api.service[104518]: [pid: 104518|app: 0|req: 11/21] 10.222.0.79 () {54 vars in 931 bytes} [Mon Oct 17 13:24:19 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:24:20.251304 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-6947c8fc-464f-4a69-ac62-9557b6ebf51c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "vcpus": 1, "disk": 1, "swap": 0, "os-flavor-access:is_public": true, "id": "1", "rxtx_factor": 1.0}} {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:24:20.275020 n-d-854247-14 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-6947c8fc-464f-4a69-ac62-9557b6ebf51c admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.459380 Oct 17 13:24:20.275624 n-d-854247-14 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 11/22] 10.222.0.79 () {64 vars in 1283 bytes} [Mon Oct 17 13:24:19 2022] POST /compute/v2.1/flavors => generated 402 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:24:20.289272 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi [None req-fd866cab-4efb-4462-bd17-9d60cc25609c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:24:20.324497 n-d-854247-14 devstack@n-api.service[104518]: INFO nova.api.openstack.requestlog [None req-fd866cab-4efb-4462-bd17-9d60cc25609c admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039891 Oct 17 13:24:20.325233 n-d-854247-14 devstack@n-api.service[104518]: [pid: 104518|app: 0|req: 12/23] 10.222.0.79 () {64 vars in 1333 bytes} [Mon Oct 17 13:24:20 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:22.931653 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-6947c8fc-464f-4a69-ac62-9557b6ebf51c admin admin] Calling method '>' {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:22.932702 n-d-854247-14 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-6947c8fc-464f-4a69-ac62-9557b6ebf51c admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001550 Oct 17 13:24:22.933070 n-d-854247-14 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 12/24] 10.222.0.79 () {54 vars in 931 bytes} [Mon Oct 17 13:24:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:24:23.338455 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi [None req-721cf000-df10-43dc-aa79-1889886c6022 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "rxtx_factor": 1.0, "vcpus": 1, "ram": 2048, "id": "2", "name": "m1.small", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=104518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:24:23.359245 n-d-854247-14 devstack@n-api.service[104518]: INFO nova.api.openstack.requestlog [None req-721cf000-df10-43dc-aa79-1889886c6022 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.420019 Oct 17 13:24:23.365113 n-d-854247-14 devstack@n-api.service[104518]: [pid: 104518|app: 0|req: 13/25] 10.222.0.79 () {64 vars in 1283 bytes} [Mon Oct 17 13:24:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:24:23.374068 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-3de239d9-63bb-41f7-88b1-d6578a00597d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:24:23.399443 n-d-854247-14 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-3de239d9-63bb-41f7-88b1-d6578a00597d admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029180 Oct 17 13:24:23.400178 n-d-854247-14 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 13/26] 10.222.0.79 () {64 vars in 1333 bytes} [Mon Oct 17 13:24:23 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:24:25.969004 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi [None req-721cf000-df10-43dc-aa79-1889886c6022 admin admin] Calling method '>' {{(pid=104518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:25.970029 n-d-854247-14 devstack@n-api.service[104518]: INFO nova.api.openstack.requestlog [None req-721cf000-df10-43dc-aa79-1889886c6022 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Oct 17 13:24:25.970461 n-d-854247-14 devstack@n-api.service[104518]: [pid: 104518|app: 0|req: 14/27] 10.222.0.79 () {54 vars in 931 bytes} [Mon Oct 17 13:24:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:24:26.348957 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-e5a8cccd-3175-4133-9072-236463a6ddd5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "ram": 4096, "disk": 40, "rxtx_factor": 1.0, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "3", "swap": 0}} {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:24:26.371915 n-d-854247-14 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-e5a8cccd-3175-4133-9072-236463a6ddd5 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.395171 Oct 17 13:24:26.372718 n-d-854247-14 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 14/28] 10.222.0.79 () {64 vars in 1283 bytes} [Mon Oct 17 13:24:25 2022] POST /compute/v2.1/flavors => generated 406 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:24:26.384827 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi [None req-a6f9a421-586b-483a-9650-467de86836d9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:24:26.390075 n-d-854247-14 devstack@n-api.service[104518]: DEBUG dbcounter [-] [104518] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=104518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:24:26.418066 n-d-854247-14 devstack@n-api.service[104518]: INFO nova.api.openstack.requestlog [None req-a6f9a421-586b-483a-9650-467de86836d9 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036837 Oct 17 13:24:26.418662 n-d-854247-14 devstack@n-api.service[104518]: [pid: 104518|app: 0|req: 15/29] 10.222.0.79 () {64 vars in 1333 bytes} [Mon Oct 17 13:24:26 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:29.098394 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-e5a8cccd-3175-4133-9072-236463a6ddd5 admin admin] Calling method '>' {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:29.100069 n-d-854247-14 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-e5a8cccd-3175-4133-9072-236463a6ddd5 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002127 Oct 17 13:24:29.103500 n-d-854247-14 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 15/30] 10.222.0.79 () {54 vars in 931 bytes} [Mon Oct 17 13:24:29 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:24:29.546730 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi [None req-a118cdbc-5679-4f10-87d0-913a411f3abe admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 80, "ram": 8192, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.large", "rxtx_factor": 1.0, "vcpus": 4}} {{(pid=104518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:24:29.568701 n-d-854247-14 devstack@n-api.service[104518]: INFO nova.api.openstack.requestlog [None req-a118cdbc-5679-4f10-87d0-913a411f3abe admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.461671 Oct 17 13:24:29.569469 n-d-854247-14 devstack@n-api.service[104518]: [pid: 104518|app: 0|req: 16/31] 10.222.0.79 () {64 vars in 1283 bytes} [Mon Oct 17 13:24:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:24:29.581820 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-1ffdcadf-edde-4f17-a899-4b8f096337af admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:24:29.608036 n-d-854247-14 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-1ffdcadf-edde-4f17-a899-4b8f096337af admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030088 Oct 17 13:24:29.609025 n-d-854247-14 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 16/32] 10.222.0.79 () {64 vars in 1333 bytes} [Mon Oct 17 13:24:29 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:32.221904 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi [None req-a118cdbc-5679-4f10-87d0-913a411f3abe admin admin] Calling method '>' {{(pid=104518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:32.222918 n-d-854247-14 devstack@n-api.service[104518]: INFO nova.api.openstack.requestlog [None req-a118cdbc-5679-4f10-87d0-913a411f3abe admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Oct 17 13:24:32.223640 n-d-854247-14 devstack@n-api.service[104518]: [pid: 104518|app: 0|req: 17/33] 10.222.0.79 () {54 vars in 931 bytes} [Mon Oct 17 13:24:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:24:32.682794 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-c315935f-6aaf-445e-82de-caffc0b015c2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "rxtx_factor": 1.0, "disk": 160, "os-flavor-access:is_public": true, "vcpus": 8, "swap": 0}} {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:24:32.691516 n-d-854247-14 devstack@n-api.service[104517]: DEBUG dbcounter [-] [104517] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=104517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:24:32.706386 n-d-854247-14 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-c315935f-6aaf-445e-82de-caffc0b015c2 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.476724 Oct 17 13:24:32.706943 n-d-854247-14 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 17/34] 10.222.0.79 () {64 vars in 1283 bytes} [Mon Oct 17 13:24:32 2022] POST /compute/v2.1/flavors => generated 408 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 13:24:32.719258 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi [None req-1bd32a1d-5ff6-4059-9bc9-26764176af4b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:24:32.752381 n-d-854247-14 devstack@n-api.service[104518]: INFO nova.api.openstack.requestlog [None req-1bd32a1d-5ff6-4059-9bc9-26764176af4b admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036975 Oct 17 13:24:32.753582 n-d-854247-14 devstack@n-api.service[104518]: [pid: 104518|app: 0|req: 18/35] 10.222.0.79 () {64 vars in 1333 bytes} [Mon Oct 17 13:24:32 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:53.752107 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-c315935f-6aaf-445e-82de-caffc0b015c2 admin admin] Calling method '>' {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:53.753752 n-d-854247-14 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-c315935f-6aaf-445e-82de-caffc0b015c2 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002403 Oct 17 13:24:53.754381 n-d-854247-14 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 18/36] 10.222.0.79 () {54 vars in 931 bytes} [Mon Oct 17 13:24:53 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:24:53.769241 n-d-854247-14 devstack@n-api.service[104518]: DEBUG dbcounter [-] [104518] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=104518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:24:54.194623 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi [None req-b4ac79a2-05ec-4925-b87b-1d854e87f6fc admin admin] Calling method '>' {{(pid=104518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:54.213392 n-d-854247-14 devstack@n-api.service[104518]: INFO nova.api.openstack.requestlog [None req-b4ac79a2-05ec-4925-b87b-1d854e87f6fc admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.450103 Oct 17 13:24:54.213932 n-d-854247-14 devstack@n-api.service[104518]: [pid: 104518|app: 0|req: 19/37] 10.222.0.79 () {60 vars in 1292 bytes} [Mon Oct 17 13:24:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:24:55.565098 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-c315935f-6aaf-445e-82de-caffc0b015c2 admin admin] Calling method '>' {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:55.566112 n-d-854247-14 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-c315935f-6aaf-445e-82de-caffc0b015c2 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Oct 17 13:24:55.566503 n-d-854247-14 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 19/38] 10.222.0.79 () {56 vars in 1074 bytes} [Mon Oct 17 13:24:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:24:56.220034 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi [None req-6adf7150-a1ae-4382-bcfe-33e4b027b57f admin admin] Calling method '>' {{(pid=104518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:56.225616 n-d-854247-14 devstack@n-api.service[104518]: INFO nova.api.openstack.wsgi [None req-6adf7150-a1ae-4382-bcfe-33e4b027b57f admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 17 13:24:56.228885 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi [None req-6adf7150-a1ae-4382-bcfe-33e4b027b57f admin admin] Request method failure captured: Oct 17 13:24:56.228885 n-d-854247-14 devstack@n-api.service[104518]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 17 13:24:56.228885 n-d-854247-14 devstack@n-api.service[104518]: Accept: application/json Oct 17 13:24:56.228885 n-d-854247-14 devstack@n-api.service[104518]: Accept-Encoding: gzip, deflate Oct 17 13:24:56.228885 n-d-854247-14 devstack@n-api.service[104518]: Connection: keep-alive Oct 17 13:24:56.228885 n-d-854247-14 devstack@n-api.service[104518]: Content-Length: 0 Oct 17 13:24:56.228885 n-d-854247-14 devstack@n-api.service[104518]: Host: 10.222.0.79 Oct 17 13:24:56.228885 n-d-854247-14 devstack@n-api.service[104518]: Openstack-Api-Version: compute 2.92 Oct 17 13:24:56.228885 n-d-854247-14 devstack@n-api.service[104518]: Openstack-System-Scope: None Oct 17 13:24:56.228885 n-d-854247-14 devstack@n-api.service[104518]: User-Agent: python-novaclient Oct 17 13:24:56.228885 n-d-854247-14 devstack@n-api.service[104518]: X-Auth-Token: gAAAAABjTVenbvt5w9M_FfsEcKvkZYyR4RCo5CrANosAAHHI2Mt8XEB3XqGWbpbCv1KEDE6LKTishiWRnx2BGtRRJrmltwVJgE2EwpBP4pF6EASRCwJkaalvuKkoraI4FFkPHnFWfBfLWAnZ1YMmZXWkz2H4etF1hDeR5zxxuu37WQ2WpZujn30 Oct 17 13:24:56.228885 n-d-854247-14 devstack@n-api.service[104518]: X-Domain-Id: None Oct 17 13:24:56.228885 n-d-854247-14 devstack@n-api.service[104518]: X-Domain-Name: None Oct 17 13:24:56.228885 n-d-854247-14 devstack@n-api.service[104518]: X-Identity-Status: Confirmed Oct 17 13:24:56.228885 n-d-854247-14 devstack@n-api.service[104518]: X-Is-Admin-Project: True Oct 17 13:24:56.228885 n-d-854247-14 devstack@n-api.service[104518]: X-Openstack-Nova-Api-Version: 2.92 Oct 17 13:24:56.228885 n-d-854247-14 devstack@n-api.service[104518]: X-Project-Domain-Id: default Oct 17 13:24:56.228885 n-d-854247-14 devstack@n-api.service[104518]: X-Project-Domain-Name: Default Oct 17 13:24:56.228885 n-d-854247-14 devstack@n-api.service[104518]: X-Project-Id: b6c723866cc34052810a32ca138bdecf Oct 17 13:24:56.228885 n-d-854247-14 devstack@n-api.service[104518]: X-Project-Name: admin Oct 17 13:24:56.228885 n-d-854247-14 devstack@n-api.service[104518]: X-Role: reader,member,admin Oct 17 13:24:56.228885 n-d-854247-14 devstack@n-api.service[104518]: X-Roles: reader,member,admin Oct 17 13:24:56.230617 n-d-854247-14 devstack@n-api.service[104518]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b6c723866cc34052810a32ca138bdecf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b6c723866cc34052810a32ca138bdecf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b6c723866cc34052810a32ca138bdecf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b6c723866cc34052810a32ca138bdecf", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:24:56.230617 n-d-854247-14 devstack@n-api.service[104518]: X-Tenant: admin Oct 17 13:24:56.230617 n-d-854247-14 devstack@n-api.service[104518]: X-Tenant-Id: b6c723866cc34052810a32ca138bdecf Oct 17 13:24:56.230617 n-d-854247-14 devstack@n-api.service[104518]: X-Tenant-Name: admin Oct 17 13:24:56.230617 n-d-854247-14 devstack@n-api.service[104518]: X-User: admin Oct 17 13:24:56.230617 n-d-854247-14 devstack@n-api.service[104518]: X-User-Domain-Id: default Oct 17 13:24:56.230617 n-d-854247-14 devstack@n-api.service[104518]: X-User-Domain-Name: Default Oct 17 13:24:56.230617 n-d-854247-14 devstack@n-api.service[104518]: X-User-Id: 64cde1f9e30149b1b9b43f3e4d81adcf Oct 17 13:24:56.230617 n-d-854247-14 devstack@n-api.service[104518]: X-User-Name: admin Oct 17 13:24:56.230617 n-d-854247-14 devstack@n-api.service[104518]: method: > Oct 17 13:24:56.230617 n-d-854247-14 devstack@n-api.service[104518]: exception: Flavor 42 could not be found. Oct 17 13:24:56.230617 n-d-854247-14 devstack@n-api.service[104518]: action_args: {'id': '42'} Oct 17 13:24:56.230617 n-d-854247-14 devstack@n-api.service[104518]: {{(pid=104518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:24:56.230617 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:56.231559 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 17 13:24:56.231559 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 17 13:24:56.231559 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 13:24:56.231559 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 13:24:56.231559 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:24:56.231559 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:24:56.231559 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 13:24:56.231559 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 13:24:56.231559 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 13:24:56.231559 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:24:56.231559 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 13:24:56.231559 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 13:24:56.231559 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 17 13:24:56.231559 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi Oct 17 13:24:56.231559 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:24:56.231559 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi Oct 17 13:24:56.231559 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:56.231559 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:24:56.231559 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:24:56.232672 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:24:56.232672 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:24:56.232672 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:24:56.232672 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:24:56.232672 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 17 13:24:56.232672 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:24:56.232672 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 17 13:24:56.232672 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi Oct 17 13:24:56.232672 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:24:56.232672 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi Oct 17 13:24:56.232672 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:56.232672 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:24:56.232672 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:24:56.232672 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:24:56.232672 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:24:56.232672 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 17 13:24:56.232672 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi Oct 17 13:24:56.232672 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi [None req-6adf7150-a1ae-4382-bcfe-33e4b027b57f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:24:56.233814 n-d-854247-14 devstack@n-api.service[104518]: INFO nova.api.openstack.requestlog [None req-6adf7150-a1ae-4382-bcfe-33e4b027b57f admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.460311 Oct 17 13:24:56.233814 n-d-854247-14 devstack@n-api.service[104518]: [pid: 104518|app: 0|req: 20/39] 10.222.0.79 () {60 vars in 1190 bytes} [Mon Oct 17 13:24:55 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 461 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 17 13:24:56.243008 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-f0ab2bfd-8554-45c8-a5c8-64d4b23f2d6a admin admin] Calling method '>' {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:56.268406 n-d-854247-14 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-f0ab2bfd-8554-45c8-a5c8-64d4b23f2d6a admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.031531 Oct 17 13:24:56.268959 n-d-854247-14 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 20/40] 10.222.0.79 () {60 vars in 1210 bytes} [Mon Oct 17 13:24:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:24:56.299626 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi [None req-194e1c4b-ad68-4b93-9feb-5f0a0704dc68 admin admin] Calling method '>' {{(pid=104518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:56.327795 n-d-854247-14 devstack@n-api.service[104518]: INFO nova.api.openstack.requestlog [None req-194e1c4b-ad68-4b93-9feb-5f0a0704dc68 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.035702 Oct 17 13:24:56.328364 n-d-854247-14 devstack@n-api.service[104518]: [pid: 104518|app: 0|req: 21/41] 10.222.0.79 () {60 vars in 1210 bytes} [Mon Oct 17 13:24:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:24:56.338165 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-75bcdfd5-40b9-4cb1-83b9-0691ffcc72c7 admin admin] Calling method '>' {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:56.343835 n-d-854247-14 devstack@n-api.service[104517]: INFO nova.api.openstack.wsgi [None req-75bcdfd5-40b9-4cb1-83b9-0691ffcc72c7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 17 13:24:56.347372 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-75bcdfd5-40b9-4cb1-83b9-0691ffcc72c7 admin admin] Request method failure captured: Oct 17 13:24:56.347372 n-d-854247-14 devstack@n-api.service[104517]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 17 13:24:56.347372 n-d-854247-14 devstack@n-api.service[104517]: Accept: application/json Oct 17 13:24:56.347372 n-d-854247-14 devstack@n-api.service[104517]: Accept-Encoding: gzip, deflate Oct 17 13:24:56.347372 n-d-854247-14 devstack@n-api.service[104517]: Connection: keep-alive Oct 17 13:24:56.347372 n-d-854247-14 devstack@n-api.service[104517]: Content-Length: 0 Oct 17 13:24:56.347372 n-d-854247-14 devstack@n-api.service[104517]: Host: 10.222.0.79 Oct 17 13:24:56.347372 n-d-854247-14 devstack@n-api.service[104517]: Openstack-Api-Version: compute 2.92 Oct 17 13:24:56.347372 n-d-854247-14 devstack@n-api.service[104517]: Openstack-System-Scope: None Oct 17 13:24:56.347372 n-d-854247-14 devstack@n-api.service[104517]: User-Agent: python-novaclient Oct 17 13:24:56.347372 n-d-854247-14 devstack@n-api.service[104517]: X-Auth-Token: gAAAAABjTVenbvt5w9M_FfsEcKvkZYyR4RCo5CrANosAAHHI2Mt8XEB3XqGWbpbCv1KEDE6LKTishiWRnx2BGtRRJrmltwVJgE2EwpBP4pF6EASRCwJkaalvuKkoraI4FFkPHnFWfBfLWAnZ1YMmZXWkz2H4etF1hDeR5zxxuu37WQ2WpZujn30 Oct 17 13:24:56.347372 n-d-854247-14 devstack@n-api.service[104517]: X-Domain-Id: None Oct 17 13:24:56.347372 n-d-854247-14 devstack@n-api.service[104517]: X-Domain-Name: None Oct 17 13:24:56.347372 n-d-854247-14 devstack@n-api.service[104517]: X-Identity-Status: Confirmed Oct 17 13:24:56.347372 n-d-854247-14 devstack@n-api.service[104517]: X-Is-Admin-Project: True Oct 17 13:24:56.347372 n-d-854247-14 devstack@n-api.service[104517]: X-Openstack-Nova-Api-Version: 2.92 Oct 17 13:24:56.347372 n-d-854247-14 devstack@n-api.service[104517]: X-Project-Domain-Id: default Oct 17 13:24:56.347372 n-d-854247-14 devstack@n-api.service[104517]: X-Project-Domain-Name: Default Oct 17 13:24:56.347372 n-d-854247-14 devstack@n-api.service[104517]: X-Project-Id: b6c723866cc34052810a32ca138bdecf Oct 17 13:24:56.347372 n-d-854247-14 devstack@n-api.service[104517]: X-Project-Name: admin Oct 17 13:24:56.347372 n-d-854247-14 devstack@n-api.service[104517]: X-Role: reader,member,admin Oct 17 13:24:56.347372 n-d-854247-14 devstack@n-api.service[104517]: X-Roles: reader,member,admin Oct 17 13:24:56.348674 n-d-854247-14 devstack@n-api.service[104517]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b6c723866cc34052810a32ca138bdecf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b6c723866cc34052810a32ca138bdecf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b6c723866cc34052810a32ca138bdecf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b6c723866cc34052810a32ca138bdecf", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:24:56.348674 n-d-854247-14 devstack@n-api.service[104517]: X-Tenant: admin Oct 17 13:24:56.348674 n-d-854247-14 devstack@n-api.service[104517]: X-Tenant-Id: b6c723866cc34052810a32ca138bdecf Oct 17 13:24:56.348674 n-d-854247-14 devstack@n-api.service[104517]: X-Tenant-Name: admin Oct 17 13:24:56.348674 n-d-854247-14 devstack@n-api.service[104517]: X-User: admin Oct 17 13:24:56.348674 n-d-854247-14 devstack@n-api.service[104517]: X-User-Domain-Id: default Oct 17 13:24:56.348674 n-d-854247-14 devstack@n-api.service[104517]: X-User-Domain-Name: Default Oct 17 13:24:56.348674 n-d-854247-14 devstack@n-api.service[104517]: X-User-Id: 64cde1f9e30149b1b9b43f3e4d81adcf Oct 17 13:24:56.348674 n-d-854247-14 devstack@n-api.service[104517]: X-User-Name: admin Oct 17 13:24:56.348674 n-d-854247-14 devstack@n-api.service[104517]: method: > Oct 17 13:24:56.348674 n-d-854247-14 devstack@n-api.service[104517]: exception: Flavor 42 could not be found. Oct 17 13:24:56.348674 n-d-854247-14 devstack@n-api.service[104517]: action_args: {'id': '42'} Oct 17 13:24:56.348674 n-d-854247-14 devstack@n-api.service[104517]: {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:24:56.348674 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:56.349464 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 17 13:24:56.349464 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 17 13:24:56.349464 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 13:24:56.349464 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 13:24:56.349464 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:24:56.349464 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:24:56.349464 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 13:24:56.349464 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 13:24:56.349464 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 13:24:56.349464 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:24:56.349464 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 13:24:56.349464 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 13:24:56.349464 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 17 13:24:56.349464 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi Oct 17 13:24:56.349464 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:24:56.349464 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi Oct 17 13:24:56.349464 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:56.349464 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:24:56.349464 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:24:56.350504 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:24:56.350504 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:24:56.350504 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:24:56.350504 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:24:56.350504 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 17 13:24:56.350504 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:24:56.350504 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 17 13:24:56.350504 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi Oct 17 13:24:56.350504 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:24:56.350504 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi Oct 17 13:24:56.350504 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:56.350504 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:24:56.350504 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:24:56.350504 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:24:56.350504 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:24:56.350504 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 17 13:24:56.350504 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi Oct 17 13:24:56.350504 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-75bcdfd5-40b9-4cb1-83b9-0691ffcc72c7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:24:56.351671 n-d-854247-14 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-75bcdfd5-40b9-4cb1-83b9-0691ffcc72c7 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014324 Oct 17 13:24:56.351671 n-d-854247-14 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 21/42] 10.222.0.79 () {60 vars in 1190 bytes} [Mon Oct 17 13:24:56 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 17 13:24:57.578316 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi [None req-194e1c4b-ad68-4b93-9feb-5f0a0704dc68 admin admin] Calling method '>' {{(pid=104518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:57.579594 n-d-854247-14 devstack@n-api.service[104518]: INFO nova.api.openstack.requestlog [None req-194e1c4b-ad68-4b93-9feb-5f0a0704dc68 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001718 Oct 17 13:24:57.579985 n-d-854247-14 devstack@n-api.service[104518]: [pid: 104518|app: 0|req: 22/43] 10.222.0.79 () {56 vars in 1074 bytes} [Mon Oct 17 13:24:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:24:58.147542 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-daa84a6c-fc72-4236-9e00-dc7d573f4ee4 admin admin] Calling method '>' {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:58.152713 n-d-854247-14 devstack@n-api.service[104517]: INFO nova.api.openstack.wsgi [None req-daa84a6c-fc72-4236-9e00-dc7d573f4ee4 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 17 13:24:58.154246 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-daa84a6c-fc72-4236-9e00-dc7d573f4ee4 admin admin] Request method failure captured: Oct 17 13:24:58.154246 n-d-854247-14 devstack@n-api.service[104517]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 17 13:24:58.154246 n-d-854247-14 devstack@n-api.service[104517]: Accept: application/json Oct 17 13:24:58.154246 n-d-854247-14 devstack@n-api.service[104517]: Accept-Encoding: gzip, deflate Oct 17 13:24:58.154246 n-d-854247-14 devstack@n-api.service[104517]: Connection: keep-alive Oct 17 13:24:58.154246 n-d-854247-14 devstack@n-api.service[104517]: Content-Length: 0 Oct 17 13:24:58.154246 n-d-854247-14 devstack@n-api.service[104517]: Host: 10.222.0.79 Oct 17 13:24:58.154246 n-d-854247-14 devstack@n-api.service[104517]: Openstack-Api-Version: compute 2.92 Oct 17 13:24:58.154246 n-d-854247-14 devstack@n-api.service[104517]: Openstack-System-Scope: None Oct 17 13:24:58.154246 n-d-854247-14 devstack@n-api.service[104517]: User-Agent: python-novaclient Oct 17 13:24:58.154246 n-d-854247-14 devstack@n-api.service[104517]: X-Auth-Token: gAAAAABjTVepoIATQWyHg19Vx6VJIYS--AS2ME4nBZ1upr7OoCE1AS0ow5GXrcPBh63a_je1T55sIoHH-KCfqSvgmu287QBLCxLxHvuQAtBFsXP3G0CLbs8zX4nzVA_LcakS1W-9zkzjMyVj8FbK3CB1FjZbKCgucd-bw6wB4QKY92Zi6sRCUUo Oct 17 13:24:58.154246 n-d-854247-14 devstack@n-api.service[104517]: X-Domain-Id: None Oct 17 13:24:58.154246 n-d-854247-14 devstack@n-api.service[104517]: X-Domain-Name: None Oct 17 13:24:58.154246 n-d-854247-14 devstack@n-api.service[104517]: X-Identity-Status: Confirmed Oct 17 13:24:58.154246 n-d-854247-14 devstack@n-api.service[104517]: X-Is-Admin-Project: True Oct 17 13:24:58.154246 n-d-854247-14 devstack@n-api.service[104517]: X-Openstack-Nova-Api-Version: 2.92 Oct 17 13:24:58.154246 n-d-854247-14 devstack@n-api.service[104517]: X-Project-Domain-Id: default Oct 17 13:24:58.154246 n-d-854247-14 devstack@n-api.service[104517]: X-Project-Domain-Name: Default Oct 17 13:24:58.154246 n-d-854247-14 devstack@n-api.service[104517]: X-Project-Id: b6c723866cc34052810a32ca138bdecf Oct 17 13:24:58.154246 n-d-854247-14 devstack@n-api.service[104517]: X-Project-Name: admin Oct 17 13:24:58.154246 n-d-854247-14 devstack@n-api.service[104517]: X-Role: reader,member,admin Oct 17 13:24:58.154246 n-d-854247-14 devstack@n-api.service[104517]: X-Roles: reader,member,admin Oct 17 13:24:58.155794 n-d-854247-14 devstack@n-api.service[104517]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b6c723866cc34052810a32ca138bdecf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b6c723866cc34052810a32ca138bdecf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b6c723866cc34052810a32ca138bdecf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b6c723866cc34052810a32ca138bdecf", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:24:58.155794 n-d-854247-14 devstack@n-api.service[104517]: X-Tenant: admin Oct 17 13:24:58.155794 n-d-854247-14 devstack@n-api.service[104517]: X-Tenant-Id: b6c723866cc34052810a32ca138bdecf Oct 17 13:24:58.155794 n-d-854247-14 devstack@n-api.service[104517]: X-Tenant-Name: admin Oct 17 13:24:58.155794 n-d-854247-14 devstack@n-api.service[104517]: X-User: admin Oct 17 13:24:58.155794 n-d-854247-14 devstack@n-api.service[104517]: X-User-Domain-Id: default Oct 17 13:24:58.155794 n-d-854247-14 devstack@n-api.service[104517]: X-User-Domain-Name: Default Oct 17 13:24:58.155794 n-d-854247-14 devstack@n-api.service[104517]: X-User-Id: 64cde1f9e30149b1b9b43f3e4d81adcf Oct 17 13:24:58.155794 n-d-854247-14 devstack@n-api.service[104517]: X-User-Name: admin Oct 17 13:24:58.155794 n-d-854247-14 devstack@n-api.service[104517]: method: > Oct 17 13:24:58.155794 n-d-854247-14 devstack@n-api.service[104517]: exception: Flavor 84 could not be found. Oct 17 13:24:58.155794 n-d-854247-14 devstack@n-api.service[104517]: action_args: {'id': '84'} Oct 17 13:24:58.155794 n-d-854247-14 devstack@n-api.service[104517]: {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:24:58.155794 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:58.156848 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 17 13:24:58.156848 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 17 13:24:58.156848 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 13:24:58.156848 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 13:24:58.156848 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:24:58.156848 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:24:58.156848 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 13:24:58.156848 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 13:24:58.156848 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 13:24:58.156848 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:24:58.156848 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 13:24:58.156848 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 13:24:58.156848 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 17 13:24:58.156848 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi Oct 17 13:24:58.156848 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:24:58.156848 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi Oct 17 13:24:58.156848 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:58.156848 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:24:58.156848 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:24:58.158227 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:24:58.158227 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:24:58.158227 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:24:58.158227 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:24:58.158227 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 17 13:24:58.158227 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:24:58.158227 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 17 13:24:58.158227 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi Oct 17 13:24:58.158227 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:24:58.158227 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi Oct 17 13:24:58.158227 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:58.158227 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:24:58.158227 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:24:58.158227 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:24:58.158227 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:24:58.158227 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 17 13:24:58.158227 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi Oct 17 13:24:58.158227 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-daa84a6c-fc72-4236-9e00-dc7d573f4ee4 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:24:58.159468 n-d-854247-14 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-daa84a6c-fc72-4236-9e00-dc7d573f4ee4 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.438801 Oct 17 13:24:58.159468 n-d-854247-14 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 22/44] 10.222.0.79 () {60 vars in 1190 bytes} [Mon Oct 17 13:24:57 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 440 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 17 13:24:58.166269 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi [None req-533518c6-4f78-4d34-a98d-541e8a140977 admin admin] Calling method '>' {{(pid=104518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:58.181457 n-d-854247-14 devstack@n-api.service[104518]: INFO nova.api.openstack.requestlog [None req-533518c6-4f78-4d34-a98d-541e8a140977 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019139 Oct 17 13:24:58.181988 n-d-854247-14 devstack@n-api.service[104518]: [pid: 104518|app: 0|req: 23/45] 10.222.0.79 () {60 vars in 1210 bytes} [Mon Oct 17 13:24:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:24:58.191760 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-4b3e3dd3-0914-433a-91cc-8f315e93bf75 admin admin] Calling method '>' {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:58.208302 n-d-854247-14 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-4b3e3dd3-0914-433a-91cc-8f315e93bf75 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020176 Oct 17 13:24:58.208815 n-d-854247-14 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 23/46] 10.222.0.79 () {60 vars in 1210 bytes} [Mon Oct 17 13:24:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:24:58.218210 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi [None req-b37bac2d-d9e0-4660-9533-36299ce127c7 admin admin] Calling method '>' {{(pid=104518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:58.223403 n-d-854247-14 devstack@n-api.service[104518]: INFO nova.api.openstack.wsgi [None req-b37bac2d-d9e0-4660-9533-36299ce127c7 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 17 13:24:58.224921 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi [None req-b37bac2d-d9e0-4660-9533-36299ce127c7 admin admin] Request method failure captured: Oct 17 13:24:58.224921 n-d-854247-14 devstack@n-api.service[104518]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 17 13:24:58.224921 n-d-854247-14 devstack@n-api.service[104518]: Accept: application/json Oct 17 13:24:58.224921 n-d-854247-14 devstack@n-api.service[104518]: Accept-Encoding: gzip, deflate Oct 17 13:24:58.224921 n-d-854247-14 devstack@n-api.service[104518]: Connection: keep-alive Oct 17 13:24:58.224921 n-d-854247-14 devstack@n-api.service[104518]: Content-Length: 0 Oct 17 13:24:58.224921 n-d-854247-14 devstack@n-api.service[104518]: Host: 10.222.0.79 Oct 17 13:24:58.224921 n-d-854247-14 devstack@n-api.service[104518]: Openstack-Api-Version: compute 2.92 Oct 17 13:24:58.224921 n-d-854247-14 devstack@n-api.service[104518]: Openstack-System-Scope: None Oct 17 13:24:58.224921 n-d-854247-14 devstack@n-api.service[104518]: User-Agent: python-novaclient Oct 17 13:24:58.224921 n-d-854247-14 devstack@n-api.service[104518]: X-Auth-Token: gAAAAABjTVepoIATQWyHg19Vx6VJIYS--AS2ME4nBZ1upr7OoCE1AS0ow5GXrcPBh63a_je1T55sIoHH-KCfqSvgmu287QBLCxLxHvuQAtBFsXP3G0CLbs8zX4nzVA_LcakS1W-9zkzjMyVj8FbK3CB1FjZbKCgucd-bw6wB4QKY92Zi6sRCUUo Oct 17 13:24:58.224921 n-d-854247-14 devstack@n-api.service[104518]: X-Domain-Id: None Oct 17 13:24:58.224921 n-d-854247-14 devstack@n-api.service[104518]: X-Domain-Name: None Oct 17 13:24:58.224921 n-d-854247-14 devstack@n-api.service[104518]: X-Identity-Status: Confirmed Oct 17 13:24:58.224921 n-d-854247-14 devstack@n-api.service[104518]: X-Is-Admin-Project: True Oct 17 13:24:58.224921 n-d-854247-14 devstack@n-api.service[104518]: X-Openstack-Nova-Api-Version: 2.92 Oct 17 13:24:58.224921 n-d-854247-14 devstack@n-api.service[104518]: X-Project-Domain-Id: default Oct 17 13:24:58.224921 n-d-854247-14 devstack@n-api.service[104518]: X-Project-Domain-Name: Default Oct 17 13:24:58.224921 n-d-854247-14 devstack@n-api.service[104518]: X-Project-Id: b6c723866cc34052810a32ca138bdecf Oct 17 13:24:58.224921 n-d-854247-14 devstack@n-api.service[104518]: X-Project-Name: admin Oct 17 13:24:58.224921 n-d-854247-14 devstack@n-api.service[104518]: X-Role: reader,member,admin Oct 17 13:24:58.224921 n-d-854247-14 devstack@n-api.service[104518]: X-Roles: reader,member,admin Oct 17 13:24:58.226366 n-d-854247-14 devstack@n-api.service[104518]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b6c723866cc34052810a32ca138bdecf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b6c723866cc34052810a32ca138bdecf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b6c723866cc34052810a32ca138bdecf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b6c723866cc34052810a32ca138bdecf", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:24:58.226366 n-d-854247-14 devstack@n-api.service[104518]: X-Tenant: admin Oct 17 13:24:58.226366 n-d-854247-14 devstack@n-api.service[104518]: X-Tenant-Id: b6c723866cc34052810a32ca138bdecf Oct 17 13:24:58.226366 n-d-854247-14 devstack@n-api.service[104518]: X-Tenant-Name: admin Oct 17 13:24:58.226366 n-d-854247-14 devstack@n-api.service[104518]: X-User: admin Oct 17 13:24:58.226366 n-d-854247-14 devstack@n-api.service[104518]: X-User-Domain-Id: default Oct 17 13:24:58.226366 n-d-854247-14 devstack@n-api.service[104518]: X-User-Domain-Name: Default Oct 17 13:24:58.226366 n-d-854247-14 devstack@n-api.service[104518]: X-User-Id: 64cde1f9e30149b1b9b43f3e4d81adcf Oct 17 13:24:58.226366 n-d-854247-14 devstack@n-api.service[104518]: X-User-Name: admin Oct 17 13:24:58.226366 n-d-854247-14 devstack@n-api.service[104518]: method: > Oct 17 13:24:58.226366 n-d-854247-14 devstack@n-api.service[104518]: exception: Flavor 84 could not be found. Oct 17 13:24:58.226366 n-d-854247-14 devstack@n-api.service[104518]: action_args: {'id': '84'} Oct 17 13:24:58.226366 n-d-854247-14 devstack@n-api.service[104518]: {{(pid=104518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:24:58.226366 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:58.227282 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 17 13:24:58.227282 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 17 13:24:58.227282 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 13:24:58.227282 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 13:24:58.227282 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:24:58.227282 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:24:58.227282 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 13:24:58.227282 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 13:24:58.227282 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 13:24:58.227282 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:24:58.227282 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 13:24:58.227282 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 13:24:58.227282 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 17 13:24:58.227282 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi Oct 17 13:24:58.227282 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:24:58.227282 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi Oct 17 13:24:58.227282 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:58.227282 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:24:58.227282 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:24:58.228345 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:24:58.228345 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:24:58.228345 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:24:58.228345 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:24:58.228345 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 17 13:24:58.228345 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:24:58.228345 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 17 13:24:58.228345 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi Oct 17 13:24:58.228345 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:24:58.228345 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi Oct 17 13:24:58.228345 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:58.228345 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:24:58.228345 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:24:58.228345 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:24:58.228345 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:24:58.228345 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 17 13:24:58.228345 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi Oct 17 13:24:58.228345 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi [None req-b37bac2d-d9e0-4660-9533-36299ce127c7 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:24:58.229347 n-d-854247-14 devstack@n-api.service[104518]: INFO nova.api.openstack.requestlog [None req-b37bac2d-d9e0-4660-9533-36299ce127c7 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011645 Oct 17 13:24:58.229347 n-d-854247-14 devstack@n-api.service[104518]: [pid: 104518|app: 0|req: 24/47] 10.222.0.79 () {60 vars in 1190 bytes} [Mon Oct 17 13:24:58 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 17 13:24:59.472762 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-4b3e3dd3-0914-433a-91cc-8f315e93bf75 admin admin] Calling method '>' {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:59.473782 n-d-854247-14 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-4b3e3dd3-0914-433a-91cc-8f315e93bf75 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Oct 17 13:24:59.474177 n-d-854247-14 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 24/48] 10.222.0.79 () {56 vars in 1074 bytes} [Mon Oct 17 13:24:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:25:00.054937 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi [None req-c5369e5d-8d72-4ce4-a3db-f9a292b3eabe admin admin] Calling method '>' {{(pid=104518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:00.061551 n-d-854247-14 devstack@n-api.service[104518]: INFO nova.api.openstack.wsgi [None req-c5369e5d-8d72-4ce4-a3db-f9a292b3eabe admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 17 13:25:00.063248 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi [None req-c5369e5d-8d72-4ce4-a3db-f9a292b3eabe admin admin] Request method failure captured: Oct 17 13:25:00.063248 n-d-854247-14 devstack@n-api.service[104518]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 17 13:25:00.063248 n-d-854247-14 devstack@n-api.service[104518]: Accept: application/json Oct 17 13:25:00.063248 n-d-854247-14 devstack@n-api.service[104518]: Accept-Encoding: gzip, deflate Oct 17 13:25:00.063248 n-d-854247-14 devstack@n-api.service[104518]: Connection: keep-alive Oct 17 13:25:00.063248 n-d-854247-14 devstack@n-api.service[104518]: Content-Length: 0 Oct 17 13:25:00.063248 n-d-854247-14 devstack@n-api.service[104518]: Host: 10.222.0.79 Oct 17 13:25:00.063248 n-d-854247-14 devstack@n-api.service[104518]: Openstack-Api-Version: compute 2.92 Oct 17 13:25:00.063248 n-d-854247-14 devstack@n-api.service[104518]: Openstack-System-Scope: None Oct 17 13:25:00.063248 n-d-854247-14 devstack@n-api.service[104518]: User-Agent: python-novaclient Oct 17 13:25:00.063248 n-d-854247-14 devstack@n-api.service[104518]: X-Auth-Token: gAAAAABjTVertxE0x5bnabzCKqm8jmalTOpmoJ3hw8x0EG6NWEeSBLSuxEM9ZY72k3V4I1SFdHaPe84jncaOPY9gS4YTGaHSHu-kEEAYwgtMQOCPAdqnaMKDdG1PCeEq6WDNCXVBu9jqLcs4CYEUKe60oD-qiarKvaLeGHTkzOTrd8JlhoxqIYY Oct 17 13:25:00.063248 n-d-854247-14 devstack@n-api.service[104518]: X-Domain-Id: None Oct 17 13:25:00.063248 n-d-854247-14 devstack@n-api.service[104518]: X-Domain-Name: None Oct 17 13:25:00.063248 n-d-854247-14 devstack@n-api.service[104518]: X-Identity-Status: Confirmed Oct 17 13:25:00.063248 n-d-854247-14 devstack@n-api.service[104518]: X-Is-Admin-Project: True Oct 17 13:25:00.063248 n-d-854247-14 devstack@n-api.service[104518]: X-Openstack-Nova-Api-Version: 2.92 Oct 17 13:25:00.063248 n-d-854247-14 devstack@n-api.service[104518]: X-Project-Domain-Id: default Oct 17 13:25:00.063248 n-d-854247-14 devstack@n-api.service[104518]: X-Project-Domain-Name: Default Oct 17 13:25:00.063248 n-d-854247-14 devstack@n-api.service[104518]: X-Project-Id: b6c723866cc34052810a32ca138bdecf Oct 17 13:25:00.063248 n-d-854247-14 devstack@n-api.service[104518]: X-Project-Name: admin Oct 17 13:25:00.063248 n-d-854247-14 devstack@n-api.service[104518]: X-Role: reader,member,admin Oct 17 13:25:00.063248 n-d-854247-14 devstack@n-api.service[104518]: X-Roles: reader,member,admin Oct 17 13:25:00.064926 n-d-854247-14 devstack@n-api.service[104518]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b6c723866cc34052810a32ca138bdecf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b6c723866cc34052810a32ca138bdecf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b6c723866cc34052810a32ca138bdecf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b6c723866cc34052810a32ca138bdecf", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:25:00.064926 n-d-854247-14 devstack@n-api.service[104518]: X-Tenant: admin Oct 17 13:25:00.064926 n-d-854247-14 devstack@n-api.service[104518]: X-Tenant-Id: b6c723866cc34052810a32ca138bdecf Oct 17 13:25:00.064926 n-d-854247-14 devstack@n-api.service[104518]: X-Tenant-Name: admin Oct 17 13:25:00.064926 n-d-854247-14 devstack@n-api.service[104518]: X-User: admin Oct 17 13:25:00.064926 n-d-854247-14 devstack@n-api.service[104518]: X-User-Domain-Id: default Oct 17 13:25:00.064926 n-d-854247-14 devstack@n-api.service[104518]: X-User-Domain-Name: Default Oct 17 13:25:00.064926 n-d-854247-14 devstack@n-api.service[104518]: X-User-Id: 64cde1f9e30149b1b9b43f3e4d81adcf Oct 17 13:25:00.064926 n-d-854247-14 devstack@n-api.service[104518]: X-User-Name: admin Oct 17 13:25:00.064926 n-d-854247-14 devstack@n-api.service[104518]: method: > Oct 17 13:25:00.064926 n-d-854247-14 devstack@n-api.service[104518]: exception: Flavor 451 could not be found. Oct 17 13:25:00.064926 n-d-854247-14 devstack@n-api.service[104518]: action_args: {'id': '451'} Oct 17 13:25:00.064926 n-d-854247-14 devstack@n-api.service[104518]: {{(pid=104518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:25:00.064926 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:00.065799 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 17 13:25:00.065799 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 17 13:25:00.065799 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 13:25:00.065799 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 13:25:00.065799 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:25:00.065799 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:25:00.065799 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 13:25:00.065799 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 13:25:00.065799 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 13:25:00.065799 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:25:00.065799 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 13:25:00.065799 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 13:25:00.065799 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 17 13:25:00.065799 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi Oct 17 13:25:00.065799 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:25:00.065799 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi Oct 17 13:25:00.065799 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:00.065799 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:25:00.065799 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:25:00.067329 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:25:00.067329 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:25:00.067329 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:25:00.067329 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:25:00.067329 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 17 13:25:00.067329 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:25:00.067329 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 17 13:25:00.067329 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi Oct 17 13:25:00.067329 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:25:00.067329 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi Oct 17 13:25:00.067329 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:00.067329 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:25:00.067329 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:25:00.067329 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:25:00.067329 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:25:00.067329 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 17 13:25:00.067329 n-d-854247-14 devstack@n-api.service[104518]: ERROR nova.api.openstack.wsgi Oct 17 13:25:00.067329 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi [None req-c5369e5d-8d72-4ce4-a3db-f9a292b3eabe admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:25:00.068898 n-d-854247-14 devstack@n-api.service[104518]: INFO nova.api.openstack.requestlog [None req-c5369e5d-8d72-4ce4-a3db-f9a292b3eabe admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.449282 Oct 17 13:25:00.068898 n-d-854247-14 devstack@n-api.service[104518]: [pid: 104518|app: 0|req: 25/49] 10.222.0.79 () {60 vars in 1193 bytes} [Mon Oct 17 13:24:59 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 451 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 17 13:25:00.075544 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-0b54fd54-675b-4919-a585-c93f6f5d4aaa admin admin] Calling method '>' {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:00.091479 n-d-854247-14 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-0b54fd54-675b-4919-a585-c93f6f5d4aaa admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019572 Oct 17 13:25:00.092021 n-d-854247-14 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 25/50] 10.222.0.79 () {60 vars in 1210 bytes} [Mon Oct 17 13:25:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:25:00.103874 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi [None req-79788b12-b6a3-410f-bf3b-9b54ceb61e7b admin admin] Calling method '>' {{(pid=104518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:00.121066 n-d-854247-14 devstack@n-api.service[104518]: INFO nova.api.openstack.requestlog [None req-79788b12-b6a3-410f-bf3b-9b54ceb61e7b admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.021162 Oct 17 13:25:00.121663 n-d-854247-14 devstack@n-api.service[104518]: [pid: 104518|app: 0|req: 26/51] 10.222.0.79 () {60 vars in 1210 bytes} [Mon Oct 17 13:25:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:25:00.135126 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-e17995dc-391b-4e7d-8fb9-2612f044b150 admin admin] Calling method '>' {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:00.143387 n-d-854247-14 devstack@n-api.service[104517]: INFO nova.api.openstack.wsgi [None req-e17995dc-391b-4e7d-8fb9-2612f044b150 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 17 13:25:00.145775 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-e17995dc-391b-4e7d-8fb9-2612f044b150 admin admin] Request method failure captured: Oct 17 13:25:00.145775 n-d-854247-14 devstack@n-api.service[104517]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 17 13:25:00.145775 n-d-854247-14 devstack@n-api.service[104517]: Accept: application/json Oct 17 13:25:00.145775 n-d-854247-14 devstack@n-api.service[104517]: Accept-Encoding: gzip, deflate Oct 17 13:25:00.145775 n-d-854247-14 devstack@n-api.service[104517]: Connection: keep-alive Oct 17 13:25:00.145775 n-d-854247-14 devstack@n-api.service[104517]: Content-Length: 0 Oct 17 13:25:00.145775 n-d-854247-14 devstack@n-api.service[104517]: Host: 10.222.0.79 Oct 17 13:25:00.145775 n-d-854247-14 devstack@n-api.service[104517]: Openstack-Api-Version: compute 2.92 Oct 17 13:25:00.145775 n-d-854247-14 devstack@n-api.service[104517]: Openstack-System-Scope: None Oct 17 13:25:00.145775 n-d-854247-14 devstack@n-api.service[104517]: User-Agent: python-novaclient Oct 17 13:25:00.145775 n-d-854247-14 devstack@n-api.service[104517]: X-Auth-Token: gAAAAABjTVertxE0x5bnabzCKqm8jmalTOpmoJ3hw8x0EG6NWEeSBLSuxEM9ZY72k3V4I1SFdHaPe84jncaOPY9gS4YTGaHSHu-kEEAYwgtMQOCPAdqnaMKDdG1PCeEq6WDNCXVBu9jqLcs4CYEUKe60oD-qiarKvaLeGHTkzOTrd8JlhoxqIYY Oct 17 13:25:00.145775 n-d-854247-14 devstack@n-api.service[104517]: X-Domain-Id: None Oct 17 13:25:00.145775 n-d-854247-14 devstack@n-api.service[104517]: X-Domain-Name: None Oct 17 13:25:00.145775 n-d-854247-14 devstack@n-api.service[104517]: X-Identity-Status: Confirmed Oct 17 13:25:00.145775 n-d-854247-14 devstack@n-api.service[104517]: X-Is-Admin-Project: True Oct 17 13:25:00.145775 n-d-854247-14 devstack@n-api.service[104517]: X-Openstack-Nova-Api-Version: 2.92 Oct 17 13:25:00.145775 n-d-854247-14 devstack@n-api.service[104517]: X-Project-Domain-Id: default Oct 17 13:25:00.145775 n-d-854247-14 devstack@n-api.service[104517]: X-Project-Domain-Name: Default Oct 17 13:25:00.145775 n-d-854247-14 devstack@n-api.service[104517]: X-Project-Id: b6c723866cc34052810a32ca138bdecf Oct 17 13:25:00.145775 n-d-854247-14 devstack@n-api.service[104517]: X-Project-Name: admin Oct 17 13:25:00.145775 n-d-854247-14 devstack@n-api.service[104517]: X-Role: reader,member,admin Oct 17 13:25:00.145775 n-d-854247-14 devstack@n-api.service[104517]: X-Roles: reader,member,admin Oct 17 13:25:00.147288 n-d-854247-14 devstack@n-api.service[104517]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b6c723866cc34052810a32ca138bdecf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b6c723866cc34052810a32ca138bdecf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b6c723866cc34052810a32ca138bdecf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b6c723866cc34052810a32ca138bdecf", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:25:00.147288 n-d-854247-14 devstack@n-api.service[104517]: X-Tenant: admin Oct 17 13:25:00.147288 n-d-854247-14 devstack@n-api.service[104517]: X-Tenant-Id: b6c723866cc34052810a32ca138bdecf Oct 17 13:25:00.147288 n-d-854247-14 devstack@n-api.service[104517]: X-Tenant-Name: admin Oct 17 13:25:00.147288 n-d-854247-14 devstack@n-api.service[104517]: X-User: admin Oct 17 13:25:00.147288 n-d-854247-14 devstack@n-api.service[104517]: X-User-Domain-Id: default Oct 17 13:25:00.147288 n-d-854247-14 devstack@n-api.service[104517]: X-User-Domain-Name: Default Oct 17 13:25:00.147288 n-d-854247-14 devstack@n-api.service[104517]: X-User-Id: 64cde1f9e30149b1b9b43f3e4d81adcf Oct 17 13:25:00.147288 n-d-854247-14 devstack@n-api.service[104517]: X-User-Name: admin Oct 17 13:25:00.147288 n-d-854247-14 devstack@n-api.service[104517]: method: > Oct 17 13:25:00.147288 n-d-854247-14 devstack@n-api.service[104517]: exception: Flavor 451 could not be found. Oct 17 13:25:00.147288 n-d-854247-14 devstack@n-api.service[104517]: action_args: {'id': '451'} Oct 17 13:25:00.147288 n-d-854247-14 devstack@n-api.service[104517]: {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:25:00.147288 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:00.148118 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 17 13:25:00.148118 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 17 13:25:00.148118 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 13:25:00.148118 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 13:25:00.148118 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:25:00.148118 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:25:00.148118 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 13:25:00.148118 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 13:25:00.148118 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 13:25:00.148118 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:25:00.148118 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 13:25:00.148118 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 13:25:00.148118 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 17 13:25:00.148118 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi Oct 17 13:25:00.148118 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:25:00.148118 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi Oct 17 13:25:00.148118 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:00.148118 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:25:00.148118 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:25:00.149587 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:25:00.149587 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:25:00.149587 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:25:00.149587 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:25:00.149587 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 17 13:25:00.149587 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:25:00.149587 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 17 13:25:00.149587 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi Oct 17 13:25:00.149587 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:25:00.149587 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi Oct 17 13:25:00.149587 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:00.149587 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:25:00.149587 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:25:00.149587 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:25:00.149587 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:25:00.149587 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 17 13:25:00.149587 n-d-854247-14 devstack@n-api.service[104517]: ERROR nova.api.openstack.wsgi Oct 17 13:25:00.149587 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-e17995dc-391b-4e7d-8fb9-2612f044b150 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:25:00.150973 n-d-854247-14 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-e17995dc-391b-4e7d-8fb9-2612f044b150 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.018276 Oct 17 13:25:00.150973 n-d-854247-14 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 26/52] 10.222.0.79 () {60 vars in 1193 bytes} [Mon Oct 17 13:25:00 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 17 13:25:01.390052 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi [None req-79788b12-b6a3-410f-bf3b-9b54ceb61e7b admin admin] Calling method '>' {{(pid=104518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:01.391107 n-d-854247-14 devstack@n-api.service[104518]: INFO nova.api.openstack.requestlog [None req-79788b12-b6a3-410f-bf3b-9b54ceb61e7b admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Oct 17 13:25:01.391618 n-d-854247-14 devstack@n-api.service[104518]: [pid: 104518|app: 0|req: 27/53] 10.222.0.79 () {56 vars in 1074 bytes} [Mon Oct 17 13:25:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:25:01.973408 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-1bcc40b4-c41e-4a1c-8702-4bf6c99c8daa admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:01.995975 n-d-854247-14 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-1bcc40b4-c41e-4a1c-8702-4bf6c99c8daa admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.468621 Oct 17 13:25:01.996525 n-d-854247-14 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 27/54] 10.222.0.79 () {64 vars in 1235 bytes} [Mon Oct 17 13:25:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:25:03.261829 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi [None req-79788b12-b6a3-410f-bf3b-9b54ceb61e7b admin admin] Calling method '>' {{(pid=104518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:03.263093 n-d-854247-14 devstack@n-api.service[104518]: INFO nova.api.openstack.requestlog [None req-79788b12-b6a3-410f-bf3b-9b54ceb61e7b admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001912 Oct 17 13:25:03.263642 n-d-854247-14 devstack@n-api.service[104518]: [pid: 104518|app: 0|req: 28/55] 10.222.0.79 () {56 vars in 1074 bytes} [Mon Oct 17 13:25:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:25:03.858931 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-6ce16c21-7974-4427-b1c3-f7d4f3139ddf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:03.881242 n-d-854247-14 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-6ce16c21-7974-4427-b1c3-f7d4f3139ddf admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.479243 Oct 17 13:25:03.881841 n-d-854247-14 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 28/56] 10.222.0.79 () {64 vars in 1235 bytes} [Mon Oct 17 13:25:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:25:05.139932 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi [None req-79788b12-b6a3-410f-bf3b-9b54ceb61e7b admin admin] Calling method '>' {{(pid=104518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:05.141155 n-d-854247-14 devstack@n-api.service[104518]: INFO nova.api.openstack.requestlog [None req-79788b12-b6a3-410f-bf3b-9b54ceb61e7b admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001673 Oct 17 13:25:05.141549 n-d-854247-14 devstack@n-api.service[104518]: [pid: 104518|app: 0|req: 29/57] 10.222.0.79 () {56 vars in 1074 bytes} [Mon Oct 17 13:25:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:25:05.718113 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-a327ee8d-77a2-42f1-af14-68e38820ba6f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:05.741476 n-d-854247-14 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-a327ee8d-77a2-42f1-af14-68e38820ba6f admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.458282 Oct 17 13:25:05.742012 n-d-854247-14 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 29/58] 10.222.0.79 () {64 vars in 1235 bytes} [Mon Oct 17 13:25:05 2022] POST /compute/v2.1/flavors => generated 407 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:25:07.032034 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi [None req-79788b12-b6a3-410f-bf3b-9b54ceb61e7b admin admin] Calling method '>' {{(pid=104518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:07.033098 n-d-854247-14 devstack@n-api.service[104518]: INFO nova.api.openstack.requestlog [None req-79788b12-b6a3-410f-bf3b-9b54ceb61e7b admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001767 Oct 17 13:25:07.033465 n-d-854247-14 devstack@n-api.service[104518]: [pid: 104518|app: 0|req: 30/59] 10.222.0.79 () {56 vars in 1074 bytes} [Mon Oct 17 13:25:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:25:07.636269 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-0c3e678a-b10f-4392-b1b4-a0a0c100f10e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:07.660047 n-d-854247-14 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-0c3e678a-b10f-4392-b1b4-a0a0c100f10e admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.474971 Oct 17 13:25:07.660528 n-d-854247-14 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 30/60] 10.222.0.79 () {64 vars in 1235 bytes} [Mon Oct 17 13:25:07 2022] POST /compute/v2.1/flavors => generated 409 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:25:08.891089 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi [None req-79788b12-b6a3-410f-bf3b-9b54ceb61e7b admin admin] Calling method '>' {{(pid=104518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:08.892150 n-d-854247-14 devstack@n-api.service[104518]: INFO nova.api.openstack.requestlog [None req-79788b12-b6a3-410f-bf3b-9b54ceb61e7b admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001773 Oct 17 13:25:08.892567 n-d-854247-14 devstack@n-api.service[104518]: [pid: 104518|app: 0|req: 31/61] 10.222.0.79 () {56 vars in 1074 bytes} [Mon Oct 17 13:25:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:25:09.445501 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-10707617-a0c0-463e-b7d5-e999d7687e9a admin admin] Calling method '>' {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:09.465982 n-d-854247-14 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-10707617-a0c0-463e-b7d5-e999d7687e9a admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.436423 Oct 17 13:25:09.466527 n-d-854247-14 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 31/62] 10.222.0.79 () {60 vars in 1202 bytes} [Mon Oct 17 13:25:09 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:26:06.947231 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi [None req-79788b12-b6a3-410f-bf3b-9b54ceb61e7b admin admin] Calling method '>' {{(pid=104518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:06.948568 n-d-854247-14 devstack@n-api.service[104518]: INFO nova.api.openstack.requestlog [None req-79788b12-b6a3-410f-bf3b-9b54ceb61e7b admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002232 Oct 17 13:26:06.949182 n-d-854247-14 devstack@n-api.service[104518]: [pid: 104518|app: 0|req: 32/63] 10.222.0.79 () {54 vars in 931 bytes} [Mon Oct 17 13:26:06 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:26:06.965188 n-d-854247-14 devstack@n-api.service[104517]: DEBUG dbcounter [-] [104517] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=104517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:26:07.390556 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-839e2c23-d93a-4194-9275-f999f3bdbf9d admin admin] Calling method '>' {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:07.411493 n-d-854247-14 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-839e2c23-d93a-4194-9275-f999f3bdbf9d admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.452021 Oct 17 13:26:07.412038 n-d-854247-14 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 32/64] 10.222.0.79 () {60 vars in 1292 bytes} [Mon Oct 17 13:26:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:26:07.434173 n-d-854247-14 devstack@n-api.service[104518]: DEBUG dbcounter [-] [104518] Writing DB stats nova_api:SELECT=14 {{(pid=104518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:26:07.439369 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi [None req-b15b6fa2-1858-424c-a2ef-e46828cd9e4f admin admin] Calling method '>' {{(pid=104518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:07.449013 n-d-854247-14 devstack@n-api.service[104518]: INFO nova.api.openstack.requestlog [None req-b15b6fa2-1858-424c-a2ef-e46828cd9e4f admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.016907 Oct 17 13:26:07.449544 n-d-854247-14 devstack@n-api.service[104518]: [pid: 104518|app: 0|req: 33/65] 10.222.0.79 () {60 vars in 1283 bytes} [Mon Oct 17 13:26:07 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:07.461438 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-f2f4b094-2d8c-4761-870e-af6ccfc7e5fa admin admin] Calling method '>' {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:07.470278 n-d-854247-14 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-f2f4b094-2d8c-4761-870e-af6ccfc7e5fa admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012521 Oct 17 13:26:07.470832 n-d-854247-14 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 33/66] 10.222.0.79 () {60 vars in 1286 bytes} [Mon Oct 17 13:26:07 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:07.482920 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi [None req-2a8fd95e-3655-4b45-86f9-ef68b7e1e70c admin admin] Calling method '>' {{(pid=104518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:07.490543 n-d-854247-14 devstack@n-api.service[104518]: INFO nova.api.openstack.requestlog [None req-2a8fd95e-3655-4b45-86f9-ef68b7e1e70c admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011275 Oct 17 13:26:07.491059 n-d-854247-14 devstack@n-api.service[104518]: [pid: 104518|app: 0|req: 34/67] 10.222.0.79 () {60 vars in 1286 bytes} [Mon Oct 17 13:26:07 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:07.502657 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-e6bd9a5f-a5f0-4384-9d93-50c8b3dcedd3 admin admin] Calling method '>' {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:07.510780 n-d-854247-14 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-e6bd9a5f-a5f0-4384-9d93-50c8b3dcedd3 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011783 Oct 17 13:26:07.511317 n-d-854247-14 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 34/68] 10.222.0.79 () {60 vars in 1283 bytes} [Mon Oct 17 13:26:07 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:54.270925 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi [None req-2a8fd95e-3655-4b45-86f9-ef68b7e1e70c admin admin] Calling method '>' {{(pid=104518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:54.272059 n-d-854247-14 devstack@n-api.service[104518]: INFO nova.api.openstack.requestlog [None req-2a8fd95e-3655-4b45-86f9-ef68b7e1e70c admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001615 Oct 17 13:31:54.272675 n-d-854247-14 devstack@n-api.service[104518]: [pid: 104518|app: 0|req: 35/69] 10.222.0.79 () {56 vars in 1074 bytes} [Mon Oct 17 13:31:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:31:54.414924 n-d-854247-14 devstack@n-api.service[104517]: DEBUG dbcounter [-] [104517] Writing DB stats nova_api:SELECT=6 {{(pid=104517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:31:54.564822 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-befd4ca3-1c3d-47aa-b729-db471b901c7a admin admin] Calling method '>' {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:54.569618 n-d-854247-14 devstack@n-api.service[104517]: DEBUG oslo_concurrency.lockutils [None req-befd4ca3-1c3d-47aa-b729-db471b901c7a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:54.570084 n-d-854247-14 devstack@n-api.service[104517]: DEBUG oslo_concurrency.lockutils [None req-befd4ca3-1c3d-47aa-b729-db471b901c7a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:54.570510 n-d-854247-14 devstack@n-api.service[104517]: DEBUG oslo_concurrency.lockutils [None req-befd4ca3-1c3d-47aa-b729-db471b901c7a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:54.571204 n-d-854247-14 devstack@n-api.service[104517]: DEBUG oslo_concurrency.lockutils [None req-befd4ca3-1c3d-47aa-b729-db471b901c7a admin admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:54.571668 n-d-854247-14 devstack@n-api.service[104517]: DEBUG oslo_concurrency.lockutils [None req-befd4ca3-1c3d-47aa-b729-db471b901c7a admin admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:54.572074 n-d-854247-14 devstack@n-api.service[104517]: DEBUG oslo_concurrency.lockutils [None req-befd4ca3-1c3d-47aa-b729-db471b901c7a admin admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:54.609902 n-d-854247-14 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-befd4ca3-1c3d-47aa-b729-db471b901c7a admin admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.92 time: 0.197073 Oct 17 13:31:54.610462 n-d-854247-14 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 35/70] 10.222.0.79 () {60 vars in 1193 bytes} [Mon Oct 17 13:31:54 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:31:55.692375 n-d-854247-14 devstack@n-api.service[104518]: DEBUG nova.api.openstack.wsgi [None req-2a8fd95e-3655-4b45-86f9-ef68b7e1e70c admin admin] Calling method '>' {{(pid=104518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:55.693422 n-d-854247-14 devstack@n-api.service[104518]: INFO nova.api.openstack.requestlog [None req-2a8fd95e-3655-4b45-86f9-ef68b7e1e70c admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Oct 17 13:31:55.693821 n-d-854247-14 devstack@n-api.service[104518]: [pid: 104518|app: 0|req: 36/71] 10.222.0.79 () {56 vars in 1074 bytes} [Mon Oct 17 13:31:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:31:55.898168 n-d-854247-14 devstack@n-api.service[104517]: DEBUG nova.api.openstack.wsgi [None req-7f9f8bc8-37c1-4b8a-8e0e-9d58be56a895 admin admin] Calling method '>' {{(pid=104517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:55.901882 n-d-854247-14 devstack@n-api.service[104517]: DEBUG oslo_concurrency.lockutils [None req-7f9f8bc8-37c1-4b8a-8e0e-9d58be56a895 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:55.902379 n-d-854247-14 devstack@n-api.service[104517]: DEBUG oslo_concurrency.lockutils [None req-7f9f8bc8-37c1-4b8a-8e0e-9d58be56a895 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:55.902808 n-d-854247-14 devstack@n-api.service[104517]: DEBUG oslo_concurrency.lockutils [None req-7f9f8bc8-37c1-4b8a-8e0e-9d58be56a895 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:55.903557 n-d-854247-14 devstack@n-api.service[104517]: DEBUG oslo_concurrency.lockutils [None req-7f9f8bc8-37c1-4b8a-8e0e-9d58be56a895 admin admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:55.903996 n-d-854247-14 devstack@n-api.service[104517]: DEBUG oslo_concurrency.lockutils [None req-7f9f8bc8-37c1-4b8a-8e0e-9d58be56a895 admin admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:55.904414 n-d-854247-14 devstack@n-api.service[104517]: DEBUG oslo_concurrency.lockutils [None req-7f9f8bc8-37c1-4b8a-8e0e-9d58be56a895 admin admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:55.928020 n-d-854247-14 devstack@n-api.service[104517]: INFO nova.api.openstack.requestlog [None req-7f9f8bc8-37c1-4b8a-8e0e-9d58be56a895 admin admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.92 time: 0.092418 Oct 17 13:31:55.928566 n-d-854247-14 devstack@n-api.service[104517]: [pid: 104517|app: 0|req: 36/72] 10.222.0.79 () {60 vars in 1193 bytes} [Mon Oct 17 13:31:55 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:32:40.201249 n-d-854247-14 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 17 13:32:40.202102 n-d-854247-14 devstack@n-api.service[104516]: Mon Oct 17 13:32:40 2022 - graceful shutdown triggered... Oct 17 13:32:40.202588 n-d-854247-14 devstack@n-api.service[104518]: Gracefully killing worker 2 (pid: 104518)... Oct 17 13:32:40.202961 n-d-854247-14 devstack@n-api.service[104517]: Gracefully killing worker 1 (pid: 104517)... Oct 17 13:32:40.334055 n-d-854247-14 devstack@n-api.service[104518]: DEBUG dbcounter [-] [104518] Writing DB stats nova_api:SELECT=4 {{(pid=104518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:32:41.202185 n-d-854247-14 devstack@n-api.service[104516]: worker 1 buried after 1 seconds Oct 17 13:32:41.202185 n-d-854247-14 devstack@n-api.service[104516]: worker 2 buried after 1 seconds Oct 17 13:32:41.202185 n-d-854247-14 devstack@n-api.service[104516]: goodbye to uWSGI. Oct 17 13:32:41.204435 n-d-854247-14 systemd[1]: devstack@n-api.service: Succeeded. Oct 17 13:32:41.205373 n-d-854247-14 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 17 13:32:41.209710 n-d-854247-14 systemd[1]: Starting Devstack devstack@n-api.service... Oct 17 13:32:41.229228 n-d-854247-14 devstack@n-api.service[127007]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 17 13:32:41.249160 n-d-854247-14 devstack@n-api.service[127007]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 17 13:32:41 2022] *** Oct 17 13:32:41.249160 n-d-854247-14 devstack@n-api.service[127007]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 17 13:32:41.249160 n-d-854247-14 devstack@n-api.service[127007]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 17 13:32:41.249160 n-d-854247-14 devstack@n-api.service[127007]: nodename: n-d-854247-14 Oct 17 13:32:41.249160 n-d-854247-14 devstack@n-api.service[127007]: machine: x86_64 Oct 17 13:32:41.249160 n-d-854247-14 devstack@n-api.service[127007]: clock source: unix Oct 17 13:32:41.249160 n-d-854247-14 devstack@n-api.service[127007]: pcre jit disabled Oct 17 13:32:41.249160 n-d-854247-14 devstack@n-api.service[127007]: detected number of CPU cores: 4 Oct 17 13:32:41.249160 n-d-854247-14 devstack@n-api.service[127007]: current working directory: / Oct 17 13:32:41.249160 n-d-854247-14 devstack@n-api.service[127007]: detected binary path: /usr/bin/uwsgi-core Oct 17 13:32:41.249160 n-d-854247-14 devstack@n-api.service[127007]: your processes number limit is 47680 Oct 17 13:32:41.249160 n-d-854247-14 devstack@n-api.service[127007]: your memory page size is 4096 bytes Oct 17 13:32:41.249160 n-d-854247-14 devstack@n-api.service[127007]: detected max file descriptor number: 2048 Oct 17 13:32:41.249160 n-d-854247-14 devstack@n-api.service[127007]: lock engine: pthread robust mutexes Oct 17 13:32:41.250169 n-d-854247-14 devstack@n-api.service[127007]: thunder lock: enabled Oct 17 13:32:41.250169 n-d-854247-14 devstack@n-api.service[127007]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 17 13:32:41.250169 n-d-854247-14 devstack@n-api.service[127007]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 17 13:32:41.289001 n-d-854247-14 devstack@n-api.service[127007]: Python main interpreter initialized at 0x55e3949df9c0 Oct 17 13:32:41.289001 n-d-854247-14 devstack@n-api.service[127007]: python threads support enabled Oct 17 13:32:41.289001 n-d-854247-14 devstack@n-api.service[127007]: your server socket listen backlog is limited to 100 connections Oct 17 13:32:41.289001 n-d-854247-14 devstack@n-api.service[127007]: your mercy for graceful operations on workers is 90 seconds Oct 17 13:32:41.289461 n-d-854247-14 devstack@n-api.service[127007]: mapped 403077 bytes (393 KB) for 2 cores Oct 17 13:32:41.289461 n-d-854247-14 devstack@n-api.service[127007]: *** Operational MODE: preforking *** Oct 17 13:32:41.289722 n-d-854247-14 devstack@n-api.service[127007]: *** uWSGI is running in multiple interpreter mode *** Oct 17 13:32:41.289722 n-d-854247-14 devstack@n-api.service[127007]: spawned uWSGI master process (pid: 127007) Oct 17 13:32:41.289955 n-d-854247-14 systemd[1]: Started Devstack devstack@n-api.service. Oct 17 13:32:41.290738 n-d-854247-14 devstack@n-api.service[127007]: spawned uWSGI worker 1 (pid: 127016, cores: 1) Oct 17 13:32:41.292766 n-d-854247-14 devstack@n-api.service[127007]: spawned uWSGI worker 2 (pid: 127017, cores: 1) Oct 17 13:32:41.292766 n-d-854247-14 devstack@n-api.service[127007]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 17 13:32:41.950229 n-d-854247-14 devstack@n-api.service[127016]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 17 13:32:41.957160 n-d-854247-14 devstack@n-api.service[127017]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 17 13:32:43.113550 n-d-854247-14 devstack@n-api.service[127016]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 13:32:43.113550 n-d-854247-14 devstack@n-api.service[127016]: from cryptography.utils import int_from_bytes Oct 17 13:32:43.114163 n-d-854247-14 devstack@n-api.service[127016]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 13:32:43.114163 n-d-854247-14 devstack@n-api.service[127016]: from cryptography.utils import int_from_bytes Oct 17 13:32:43.118576 n-d-854247-14 devstack@n-api.service[127017]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 13:32:43.118576 n-d-854247-14 devstack@n-api.service[127017]: from cryptography.utils import int_from_bytes Oct 17 13:32:43.119045 n-d-854247-14 devstack@n-api.service[127017]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 13:32:43.119045 n-d-854247-14 devstack@n-api.service[127017]: from cryptography.utils import int_from_bytes Oct 17 13:32:45.512943 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 17 13:32:45.513582 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 17 13:32:45.513809 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 17 13:32:45.514237 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 17 13:32:45.514401 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 17 13:32:45.514790 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.515113 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.515640 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.516128 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.516635 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.517135 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.517620 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.518117 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.518605 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.518877 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.519224 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.519752 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-854247-14 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.520080 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.520401 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.520724 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.521053 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.521363 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.521695 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.522044 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.522590 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.523027 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.523417 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.523723 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.524069 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.524390 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.524713 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.525040 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.525354 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.525756 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.526073 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.526489 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-854247-14 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.526810 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.527130 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.527481 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.527913 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.528230 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.528545 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.528870 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.529199 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.529511 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.529842 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.530167 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.530491 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.530814 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.531120 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.531459 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.531772 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.532096 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.532407 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.532716 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.532966 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.533277 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.533602 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.533927 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.534251 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.534506 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.534761 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.535082 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.535431 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.535745 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.536057 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.536367 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.536676 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.536984 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.537290 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.537598 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.537907 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.538231 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.538547 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.538874 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.539208 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.539536 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.539944 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.79 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.540199 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.79 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.540508 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.540851 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.541271 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.541588 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.541907 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.542232 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.542543 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.542854 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.543183 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.543513 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.544918 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.544918 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.545062 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 17 13:32:45.545459 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.545533 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 17 13:32:45.545611 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.545700 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 17 13:32:45.545779 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.545779 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.545911 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 17 13:32:45.545911 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 17 13:32:45.546050 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.546050 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.546184 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.546260 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.546336 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.546460 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.546593 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.546772 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.546880 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.547084 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.547244 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.547420 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.547603 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.547756 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.547911 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.548062 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.548211 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.548706 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.548870 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.549030 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.549179 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.549280 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.549394 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.549490 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.549490 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.549652 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-854247-14 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.549790 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.549883 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.550110 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.550210 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.550420 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.550509 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.550730 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.550821 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.551035 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.551132 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.551370 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.551471 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.551693 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.551783 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.552002 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.552204 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.552315 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.552519 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.552613 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.552827 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.552922 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.553141 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.553244 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.553480 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.553575 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.553797 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.553942 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.554104 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.554203 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.554423 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.554523 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.554731 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.554829 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.555041 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.555142 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.555387 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.555644 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.555735 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.555991 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.556296 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.556475 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-854247-14 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.556603 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.556824 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.556926 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.557230 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.557365 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.557587 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.557962 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.558240 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.558330 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.558581 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.558670 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.558909 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.559044 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.559249 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.559395 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.559564 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.559708 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.559876 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.559984 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.560201 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.560294 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.560548 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.560641 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.560868 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.560967 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.561189 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.561287 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.561513 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.561615 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.561818 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.561908 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.562126 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.562215 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.562435 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.562527 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.562756 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.562846 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.563062 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.563565 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.563736 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.563832 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.563985 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.564083 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.564294 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.564393 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.564614 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.564712 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.564938 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.565036 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.565260 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.565368 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.565512 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.565627 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.565761 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.565950 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.566081 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.566272 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.566402 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.566597 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.566695 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.566912 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.567024 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.567262 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.567393 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.567597 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.567698 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.567926 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.568028 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.568241 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.568342 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.568583 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.568682 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.568887 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.568978 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.569205 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.569302 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.569524 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.569649 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.569847 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.569979 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.570153 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.570251 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.570471 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.570569 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.570788 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.570879 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.79 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.571099 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.79 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.571223 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.571433 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.571524 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.571773 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.571872 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.572093 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.572185 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.572500 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.572660 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.572855 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.573026 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.573165 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.573374 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.573511 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.573684 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.573787 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.573994 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.574083 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.574304 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.574393 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.574627 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.574717 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.574963 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.575053 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.575294 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.575391 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.575546 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.575647 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.575846 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.575946 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.576151 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.576252 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.576469 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.576567 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.576774 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.576865 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.577078 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.577180 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.577384 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.577483 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.577685 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.577775 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.577990 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.578099 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.578298 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.578399 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.578603 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.578694 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.578908 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.579007 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.579236 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.579387 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.579545 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.579679 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.579850 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.580000 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.580153 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.580254 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.580458 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.580560 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.580760 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.580883 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.581079 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.581196 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.581397 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.581494 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.581702 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.581805 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.582010 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.582102 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.582317 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.582421 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.582619 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.582711 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.582940 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.583030 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.583268 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.583375 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.583576 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.583667 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.583888 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.584009 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.584190 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.584282 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.584495 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.584593 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.584810 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.584899 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.585116 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.585207 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.585423 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.585522 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.585733 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.585823 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.586033 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.586131 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.586339 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.586430 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.586654 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.586757 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.586961 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.587064 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.587290 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.587401 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.587593 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.587756 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.587896 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.588059 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.588309 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.588503 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.588814 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.588916 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.589125 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.589215 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.589434 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.589532 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.589735 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.589875 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.590040 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.590178 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.590351 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.590444 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.590666 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.590764 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.590974 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.591073 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.591300 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.591407 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.591612 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.591710 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:32:45.591922 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.592014 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.592231 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.592334 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.592557 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.592649 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.592871 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.592963 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.593181 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.593279 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.593492 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.593583 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.593798 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.593889 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.594143 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.594247 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.594455 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.594545 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.594779 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.594867 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.595091 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.595228 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.595429 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.595534 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.595741 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.595842 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.596060 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.596162 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.596382 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.596473 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.596693 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.596783 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.597011 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.597114 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.597325 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.597415 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.597636 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.597725 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.597944 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.598035 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.598263 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.598359 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.598588 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.598678 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.598905 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.599003 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.599256 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.599362 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.599620 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.599716 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.599947 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.600036 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.600257 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.600392 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.600580 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.600674 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.600899 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.600996 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.601214 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.601311 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.601526 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.601634 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.601839 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.601939 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.602164 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.602261 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.602481 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.602593 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.602791 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.602889 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.603106 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.603362 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.603451 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.603548 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.603847 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.603938 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.604221 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.604319 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.604535 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.604639 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.604853 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.604943 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.605166 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.605266 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.605477 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.605568 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.605793 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.605882 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.606115 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.606206 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.606425 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.606524 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.606739 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.606829 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.607052 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.607149 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.607399 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.607495 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.607713 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.607811 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.608027 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.608116 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.608335 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.608432 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.608643 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.608741 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.608947 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.609046 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.609254 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.609345 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.609563 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.609691 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.609865 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.610000 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.610176 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.610297 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.610496 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.610624 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.610800 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.610900 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.611110 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.611230 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.611447 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.611552 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.611760 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.611859 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.612072 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.612163 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.612379 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.612467 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.612682 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.612783 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.612993 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.613091 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.613303 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.613394 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.613612 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.613712 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.613934 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.614023 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.614241 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.614331 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.614547 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.614688 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.614853 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.614951 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.615158 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.615288 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.615486 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.615587 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.615798 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.615896 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.616106 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.616196 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.616413 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.616504 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.616722 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.616812 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.617032 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.617207 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.617347 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.617436 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.617654 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.617745 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.617969 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.618069 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.618279 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.618369 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.618596 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.618723 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.618909 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.619014 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.619279 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.619400 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.619613 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.619851 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.619944 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.620187 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.620269 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.620495 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.620575 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.620806 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.620896 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.621113 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.621194 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.621420 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.621520 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.621726 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.621829 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.622037 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.622129 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.622340 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.622430 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.622649 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.622758 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.622952 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.623049 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.623281 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.623374 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.623591 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.623722 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.623916 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.624178 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.624270 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.624515 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.624614 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.624818 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.624916 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.625120 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.625210 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.625461 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.625566 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.625767 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.625868 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.626106 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.626205 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.626437 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.626527 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.626754 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.626852 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.627065 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.627156 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.627402 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.627505 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.627710 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.627799 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.628019 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.628119 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.628329 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.628426 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.628635 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.628735 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.628943 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.629043 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.629252 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.629350 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.629562 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.629658 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.629866 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.630014 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.630174 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.630308 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.630482 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.630577 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.630791 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.630918 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.631109 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.631312 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.631439 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.631545 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.631754 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.631844 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.632059 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.632148 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.632386 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.632487 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.632700 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.632799 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.633011 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.633101 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.633316 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.633417 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.633624 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.633715 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.633931 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.634021 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.634243 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.634347 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.634554 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.634651 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.634953 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.635046 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.635450 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.635567 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.635694 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.635791 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.636007 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.636107 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.636328 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.636427 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.636634 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.636733 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.636943 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.637042 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.637252 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.637345 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.637552 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.637642 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.637863 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.637956 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.638172 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.638264 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.638488 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.638587 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.638803 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.638903 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.639112 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.639239 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.639452 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.639550 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.639759 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.639864 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.640065 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.640178 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.640370 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.640451 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.640674 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.640799 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.640979 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.641079 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.641285 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.641383 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.641594 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.641700 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.641899 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.641989 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.642206 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.642304 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.642506 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.642596 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.642817 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.642908 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.643122 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.643247 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.643451 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.643543 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.643757 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.643857 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.644066 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.644156 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.644374 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.644465 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.644680 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.644778 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.644992 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.645132 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.645298 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.645423 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.645600 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.645721 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.645905 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.646031 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.646217 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.646310 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.646522 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.646620 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.646826 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.646927 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.647129 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.647291 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.647460 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.647550 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.647770 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.647939 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.648096 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.648188 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.648397 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.648487 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.648709 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.648807 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.649021 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.649111 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.649327 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.649416 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.649634 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.649733 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.649940 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.650077 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.650245 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.650334 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.650571 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.650776 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.650958 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.651147 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.651293 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.651487 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.651591 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.651794 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.651895 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.652119 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.652212 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.652432 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.652524 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.652738 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.652839 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.653046 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.653144 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.653351 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.653444 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.653660 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.653758 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.653974 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.654072 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.654279 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.654372 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.654588 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.654678 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.654906 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.654998 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.655287 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.655511 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.655615 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.655849 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.655941 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.656171 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.656263 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.656493 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.656584 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.656808 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.656897 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.657125 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.657226 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.657439 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.657538 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.657745 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.657844 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.658054 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.658152 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.658380 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.658480 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.658692 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.658783 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.659000 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.659099 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.659330 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.659435 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.659644 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.659743 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.659952 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.660080 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.660257 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.660371 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.660560 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.660693 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.660869 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.660949 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.661174 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.661286 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.661479 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.661620 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.661784 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.661876 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.662092 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.662192 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.662404 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.662508 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.662709 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.662799 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.663047 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.663144 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.663382 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.663487 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.663706 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.663806 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.664017 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.664110 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.664330 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.664434 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.664634 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.664725 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.664945 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.665073 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.665289 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.665389 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.665592 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.665681 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.665907 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.665997 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.666322 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.666423 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.666698 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.666937 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.667120 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.667325 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.667598 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.667690 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.667919 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.668026 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.668236 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.668335 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.668543 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.668641 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.668852 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.668955 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.669164 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.669255 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.669475 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.669575 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.669780 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.669872 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.670088 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.670221 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.670396 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.670514 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.670706 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.670830 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.671016 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.671146 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.671346 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.671469 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.671657 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.671780 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.671961 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.672090 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.672279 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.672405 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.672590 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.672736 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.672898 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.673047 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.673204 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.673361 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.673517 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.673654 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.673824 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.673984 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.674127 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.674294 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.674438 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.674625 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.674725 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.675044 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.675188 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.675388 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.675479 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.675692 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.675790 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.675997 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.676116 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.676307 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.676434 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.676616 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.676747 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.676924 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.677107 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.677235 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.677387 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.677546 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.677717 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.677851 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.678028 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.678155 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.678349 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.678463 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.678666 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.678772 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.679000 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.679099 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.679362 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.679467 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.679683 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.679783 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.679999 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.680090 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.680304 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.680445 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.680612 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.680713 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.680917 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.681010 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.681221 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.681311 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.681524 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.681616 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.681883 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.682056 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.682391 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.682482 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.682710 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.682809 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.683020 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.683118 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.683354 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.683456 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.683662 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.683755 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.683986 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.684084 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.684298 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.684389 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.684607 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.684713 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.684914 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.685014 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.685220 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.685326 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.685536 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.685634 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.685853 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.685952 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.686171 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.686271 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.686485 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.686577 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.686816 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.686915 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.687129 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.687255 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.687484 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.687585 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.687793 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.687890 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.688452 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.688568 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.688763 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.688855 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.689082 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.689180 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.689394 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.689499 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.689705 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.689803 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.690009 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.690106 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.690314 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.690453 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.690635 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.690733 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.690946 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.691070 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.691287 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.691365 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.691591 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.691687 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.691917 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.692047 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.692237 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.692328 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.692544 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.692643 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.692852 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.692952 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.693163 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.693263 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.693469 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.693560 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.693782 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.693875 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.694092 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.694182 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.694404 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.694503 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.694715 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.694816 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.695025 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.695124 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.695416 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.695520 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.695683 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.695776 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.695992 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.696091 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.696305 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.696416 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.696616 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.696709 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.696931 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.697024 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.697242 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.697381 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.697648 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.697747 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.697961 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.698244 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.698410 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.698641 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.698767 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.698954 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.699079 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.699294 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.699452 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.699604 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.699770 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.700045 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.700144 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.700362 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.700462 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.700676 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.700822 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.700983 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.701107 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.701295 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.701431 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.701608 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.701710 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.701923 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.702014 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.702239 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.702343 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.702546 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.702646 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.702884 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.702974 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.703232 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.703343 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.703557 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.703649 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.703878 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.703968 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.704194 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.704285 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.704503 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.704593 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.704817 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.704906 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.705139 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.705240 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.705445 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.705535 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.705753 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.705851 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.706060 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.706303 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.706402 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.706642 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.706735 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.706966 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.707066 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.707320 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.707436 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.707643 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.707735 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.707965 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.708058 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.708284 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.708452 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.708602 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.708767 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.708922 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.709080 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.709239 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.709405 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.709557 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.709731 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.709891 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.710059 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.710218 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.710366 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.710552 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.710683 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.710898 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.710992 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.711246 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.711345 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.711571 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.711677 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.711894 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.711986 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.712217 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.712311 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.712543 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.712644 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.712869 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.713135 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.713275 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.713375 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.713600 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.713811 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.713923 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.714144 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.714237 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.714556 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.714707 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.714872 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.714971 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.715200 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.715293 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.715522 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.715623 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.715839 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.715931 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.716151 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.716241 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.716462 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.716554 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.716776 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.716875 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.717089 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.717180 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.717399 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.717490 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.717727 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.717818 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.718036 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.718126 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.718352 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.718450 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.718663 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.718752 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.718974 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.719208 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.719316 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.719532 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.719624 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.719871 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.719971 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.720203 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.720302 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.720528 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.720624 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.720846 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.720936 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.721166 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.721306 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.721486 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.721617 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.721793 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.721885 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.722103 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.722227 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.722414 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.722537 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.722721 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.722821 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.723026 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.723118 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.723361 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.723466 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.723678 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.723777 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.723988 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.724087 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.724309 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.724398 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.724741 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.724853 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.724947 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.725151 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.725243 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.725506 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.725596 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.725825 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.725916 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.726153 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.726246 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.726483 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.726583 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.726805 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.726905 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.727115 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.727239 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.727450 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.727554 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.727755 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.727853 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.728066 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.728165 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.728372 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.728472 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.728760 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.728854 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.729139 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.729229 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.729453 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.729725 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.729825 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.730040 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.730139 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.730352 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.730458 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.730660 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.730791 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.730966 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.731089 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.731308 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.731446 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.731619 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.731753 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.731930 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.732020 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.732234 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.732371 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.732542 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.732667 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.732848 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.732940 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.733155 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.733254 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.733467 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.733558 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.733775 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.733866 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.734093 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.734192 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.734404 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.734495 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.734735 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.734826 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.735055 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.735155 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.735401 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.735510 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.735721 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.735821 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.736039 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.736131 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.736360 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.736450 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.736679 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.736770 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.736996 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.737087 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.737302 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.737399 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.737616 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.737715 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.737929 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.738019 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.738257 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.738460 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.738576 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.738793 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.738893 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.739109 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.739273 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.739456 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.739549 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.739770 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.740084 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.740176 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.740399 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.740491 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.740713 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.740850 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.741026 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.741119 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.741339 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.741447 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.741654 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.741751 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.741969 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.742059 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.742280 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.742379 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.742608 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.742702 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.742924 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.743018 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.743273 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.743403 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.743585 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.743673 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.743891 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.743982 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.744251 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.744358 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.744759 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.744851 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.745082 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.745241 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.745400 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.745555 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.745717 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.745873 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.746033 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.746193 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.746350 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.746514 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.746666 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.746835 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.746981 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.747149 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.747323 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.747488 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.747646 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.747804 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.747992 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.748118 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.748316 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.748415 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.748643 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.748735 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.748966 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.749071 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.749287 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.749387 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.749604 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.749703 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.749919 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.750020 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.750286 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.750395 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.750547 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.750647 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.750868 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.750970 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.751221 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.751421 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.751545 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.751739 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.751845 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.752074 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.752271 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.752403 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.752590 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.752728 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.752914 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.753047 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.753241 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.753368 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.753560 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.753699 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.753887 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.754011 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.754215 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.754315 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.754537 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.754630 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.754860 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.754959 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.755185 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.755279 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.755537 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.755640 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.755846 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.755936 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.756153 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.756255 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.756474 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.756575 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.756790 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.756889 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.757112 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.757327 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.757426 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.757681 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.757773 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.758000 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.758097 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.758327 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.758437 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.758636 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.758726 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.758948 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.759077 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.759276 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.759383 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.759592 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.759690 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.759989 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.760083 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.760305 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.760411 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.760617 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.760717 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.760933 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.761065 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.761242 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.761350 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.761550 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.761652 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.762411 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.762524 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.762632 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.762761 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.762853 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.762938 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.763060 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.763150 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.763312 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.763400 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.763485 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.763577 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.763662 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.763753 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.763977 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.764078 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.764287 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.764388 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.764602 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.764692 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.764909 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.765001 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.765216 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.765316 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.765525 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.765627 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.765830 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.765935 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.766146 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.766238 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.766452 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.766556 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.766806 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.766910 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.767137 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.767314 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.767473 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.767579 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.767802 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.767893 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.768120 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.768221 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.768426 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.768526 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.768753 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.768846 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.769060 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.769151 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.769367 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.769459 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.769678 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.769777 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.769987 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.770085 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.770297 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.770389 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.770613 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.770702 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.770931 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.771031 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.771265 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.771359 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.771598 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.771692 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.771922 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.772138 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.772242 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.772474 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.772573 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.772797 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.772929 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.773132 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.773274 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.773465 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.773556 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.773775 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.773868 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.774083 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.774174 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.774390 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.774481 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.774709 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.774809 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.775021 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.775119 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.775358 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.775478 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.775724 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.775834 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.776047 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.776286 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.776385 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.776606 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.776698 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.776925 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.777018 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.777240 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.777340 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.777556 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.777648 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.777869 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.777969 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.778180 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.778271 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.778493 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.778598 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.778808 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.778907 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.779119 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.779275 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.779456 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.779563 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.779774 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.779866 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.780115 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.780216 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.780371 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 17 13:32:45.780470 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.780742 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.781058 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.781374 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.781688 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.781998 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.782309 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.782619 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.782937 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.783291 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.783608 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.783917 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.784338 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.784652 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.784972 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.785294 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.785606 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.785928 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.786253 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.786566 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.786893 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.787228 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.787564 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.787905 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.788237 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.788565 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.788875 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.789182 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.789490 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.789799 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.790119 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.790432 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.790740 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.791043 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.791591 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.792054 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.792368 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.792677 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.792986 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.793298 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.793606 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.793912 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.794226 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.794531 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.794837 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.795143 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.795476 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.795793 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.796109 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.796412 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.796764 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.797075 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.797453 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.797800 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.798128 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.798454 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.798771 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.799094 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.799436 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.799800 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.800130 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.800453 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.800767 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.801100 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.801411 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.801722 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.802042 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.802352 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.802663 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.802972 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.803325 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.803654 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.803961 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.804288 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.804606 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.804927 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.805242 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.805551 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.805879 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.806190 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.806502 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.806950 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.807338 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.807704 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.808026 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.808338 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.808653 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.808973 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.809288 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.809616 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.809942 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.810252 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.810579 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.810908 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.811280 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.811594 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.811941 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.812268 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.812584 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.812895 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.813549 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:32:45.813791 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 17 13:32:45.842189 n-d-854247-14 devstack@n-api.service[127016]: INFO dbcounter [None req-a4d2420b-43e8-4c39-afdd-0abd1a12e30b None None] Registered counter for database nova_api Oct 17 13:32:45.862867 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_db.sqlalchemy.engines [None req-a4d2420b-43e8-4c39-afdd-0abd1a12e30b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127016) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 13:32:45.869631 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writer thread running {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 13:32:45.877150 n-d-854247-14 devstack@n-api.service[127017]: INFO dbcounter [None req-27d008b5-ff0f-42a8-be17-55f0646874f4 None None] Registered counter for database nova_api Oct 17 13:32:45.898134 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_db.sqlalchemy.engines [None req-27d008b5-ff0f-42a8-be17-55f0646874f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127017) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 13:32:45.905525 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writer thread running {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 13:32:45.926754 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.context [None req-a4d2420b-43e8-4c39-afdd-0abd1a12e30b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),23debefa-f967-4de1-8ea3-1fa7cc16392a(cell1) {{(pid=127016) load_cells /opt/stack/nova/nova/context.py:464}} Oct 17 13:32:45.930617 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a4d2420b-43e8-4c39-afdd-0abd1a12e30b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:45.931094 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a4d2420b-43e8-4c39-afdd-0abd1a12e30b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:45.932875 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a4d2420b-43e8-4c39-afdd-0abd1a12e30b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:45.933622 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a4d2420b-43e8-4c39-afdd-0abd1a12e30b None None] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:45.934104 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a4d2420b-43e8-4c39-afdd-0abd1a12e30b None None] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:45.936181 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a4d2420b-43e8-4c39-afdd-0abd1a12e30b None None] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:45.938561 n-d-854247-14 devstack@n-api.service[127016]: INFO dbcounter [None req-a4d2420b-43e8-4c39-afdd-0abd1a12e30b None None] Registered counter for database nova_cell0 Oct 17 13:32:45.942669 n-d-854247-14 devstack@n-api.service[127016]: INFO dbcounter [None req-a4d2420b-43e8-4c39-afdd-0abd1a12e30b None None] Registered counter for database nova_cell1 Oct 17 13:32:45.951971 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_db.sqlalchemy.engines [None req-a4d2420b-43e8-4c39-afdd-0abd1a12e30b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127016) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 13:32:45.953206 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_db.sqlalchemy.engines [None req-a4d2420b-43e8-4c39-afdd-0abd1a12e30b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127016) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 13:32:45.960931 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writer thread running {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 13:32:45.963775 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writer thread running {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 13:32:45.964447 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.context [None req-27d008b5-ff0f-42a8-be17-55f0646874f4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),23debefa-f967-4de1-8ea3-1fa7cc16392a(cell1) {{(pid=127017) load_cells /opt/stack/nova/nova/context.py:464}} Oct 17 13:32:45.968545 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-27d008b5-ff0f-42a8-be17-55f0646874f4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:45.969020 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-27d008b5-ff0f-42a8-be17-55f0646874f4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:45.970595 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-27d008b5-ff0f-42a8-be17-55f0646874f4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:45.971370 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-27d008b5-ff0f-42a8-be17-55f0646874f4 None None] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:45.971817 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-27d008b5-ff0f-42a8-be17-55f0646874f4 None None] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:45.973831 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-27d008b5-ff0f-42a8-be17-55f0646874f4 None None] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:45.975880 n-d-854247-14 devstack@n-api.service[127017]: INFO dbcounter [None req-27d008b5-ff0f-42a8-be17-55f0646874f4 None None] Registered counter for database nova_cell0 Oct 17 13:32:45.980315 n-d-854247-14 devstack@n-api.service[127017]: INFO dbcounter [None req-27d008b5-ff0f-42a8-be17-55f0646874f4 None None] Registered counter for database nova_cell1 Oct 17 13:32:45.987800 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_db.sqlalchemy.engines [None req-27d008b5-ff0f-42a8-be17-55f0646874f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127017) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 13:32:45.993142 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writer thread running {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 13:32:45.994657 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_db.sqlalchemy.engines [None req-27d008b5-ff0f-42a8-be17-55f0646874f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127017) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 13:32:46.117601 n-d-854247-14 devstack@n-api.service[127016]: INFO dbcounter [None req-a4d2420b-43e8-4c39-afdd-0abd1a12e30b None None] Registered counter for database nova_cell0 Oct 17 13:32:46.125011 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_db.sqlalchemy.engines [None req-a4d2420b-43e8-4c39-afdd-0abd1a12e30b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127016) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 13:32:46.130013 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writer thread running {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 13:32:46.141160 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writer thread running {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 13:32:46.150723 n-d-854247-14 devstack@n-api.service[127017]: INFO dbcounter [None req-27d008b5-ff0f-42a8-be17-55f0646874f4 None None] Registered counter for database nova_cell0 Oct 17 13:32:46.158455 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_db.sqlalchemy.engines [None req-27d008b5-ff0f-42a8-be17-55f0646874f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127017) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 13:32:46.163365 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writer thread running {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 13:32:46.450103 n-d-854247-14 devstack@n-api.service[127016]: WARNING keystonemiddleware.auth_token [None req-a4d2420b-43e8-4c39-afdd-0abd1a12e30b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 13:32:46.457721 n-d-854247-14 devstack@n-api.service[127016]: WARNING keystonemiddleware.auth_token [None req-a4d2420b-43e8-4c39-afdd-0abd1a12e30b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 13:32:46.487914 n-d-854247-14 devstack@n-api.service[127017]: WARNING keystonemiddleware.auth_token [None req-27d008b5-ff0f-42a8-be17-55f0646874f4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 13:32:46.495609 n-d-854247-14 devstack@n-api.service[127017]: WARNING keystonemiddleware.auth_token [None req-27d008b5-ff0f-42a8-be17-55f0646874f4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 13:32:46.808604 n-d-854247-14 devstack@n-api.service[127016]: WARNING keystonemiddleware.auth_token [None req-a4d2420b-43e8-4c39-afdd-0abd1a12e30b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 13:32:46.814957 n-d-854247-14 devstack@n-api.service[127016]: WARNING keystonemiddleware.auth_token [None req-a4d2420b-43e8-4c39-afdd-0abd1a12e30b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 13:32:46.820331 n-d-854247-14 devstack@n-api.service[127016]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e3949df9c0 pid: 127016 (default app) Oct 17 13:32:46.848860 n-d-854247-14 devstack@n-api.service[127017]: WARNING keystonemiddleware.auth_token [None req-27d008b5-ff0f-42a8-be17-55f0646874f4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 13:32:46.855157 n-d-854247-14 devstack@n-api.service[127017]: WARNING keystonemiddleware.auth_token [None req-27d008b5-ff0f-42a8-be17-55f0646874f4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 13:32:46.860493 n-d-854247-14 devstack@n-api.service[127017]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e3949df9c0 pid: 127017 (default app) Oct 17 13:33:27.234449 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=3 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:33:27.235769 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=3 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:33:27.236611 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=3 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:33:27.237438 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=3 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:33:28.513972 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-682b4838-67e7-4b0e-80f5-9351f8bc67ef tempest-AggregatesAdminTestV241-126403670 tempest-AggregatesAdminTestV241-126403670-project-admin] Calling method '.version_select at 0x7f7cd714e700>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:28.524939 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-682b4838-67e7-4b0e-80f5-9351f8bc67ef tempest-AggregatesAdminTestV241-126403670 tempest-AggregatesAdminTestV241-126403670-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),23debefa-f967-4de1-8ea3-1fa7cc16392a(cell1) {{(pid=127016) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 17 13:33:28.525775 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-682b4838-67e7-4b0e-80f5-9351f8bc67ef tempest-AggregatesAdminTestV241-126403670 tempest-AggregatesAdminTestV241-126403670-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:28.526337 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-682b4838-67e7-4b0e-80f5-9351f8bc67ef tempest-AggregatesAdminTestV241-126403670 tempest-AggregatesAdminTestV241-126403670-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:28.527549 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-682b4838-67e7-4b0e-80f5-9351f8bc67ef tempest-AggregatesAdminTestV241-126403670 tempest-AggregatesAdminTestV241-126403670-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:28.555054 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-682b4838-67e7-4b0e-80f5-9351f8bc67ef tempest-AggregatesAdminTestV241-126403670 tempest-AggregatesAdminTestV241-126403670-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:28.555569 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-682b4838-67e7-4b0e-80f5-9351f8bc67ef tempest-AggregatesAdminTestV241-126403670 tempest-AggregatesAdminTestV241-126403670-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:28.556376 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-682b4838-67e7-4b0e-80f5-9351f8bc67ef tempest-AggregatesAdminTestV241-126403670 tempest-AggregatesAdminTestV241-126403670-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:28.570212 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-682b4838-67e7-4b0e-80f5-9351f8bc67ef tempest-AggregatesAdminTestV241-126403670 tempest-AggregatesAdminTestV241-126403670-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:28.574750 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-682b4838-67e7-4b0e-80f5-9351f8bc67ef tempest-AggregatesAdminTestV241-126403670 tempest-AggregatesAdminTestV241-126403670-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:28.574750 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-682b4838-67e7-4b0e-80f5-9351f8bc67ef tempest-AggregatesAdminTestV241-126403670 tempest-AggregatesAdminTestV241-126403670-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:28.578710 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-682b4838-67e7-4b0e-80f5-9351f8bc67ef tempest-AggregatesAdminTestV241-126403670 tempest-AggregatesAdminTestV241-126403670-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1427 microversion: 2.41 time: 1.350113 Oct 17 13:33:28.579346 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1/1] 10.222.0.79 () {60 vars in 1208 bytes} [Mon Oct 17 13:33:27 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1427 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:33:28.605144 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=3 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:33:28.606846 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=3 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:33:28.607774 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=3 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:33:28.608883 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=3 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:33:28.828962 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e1eb0834-d11f-4566-b8cc-e420b69d8311 tempest-AggregatesAdminTestV241-126403670 tempest-AggregatesAdminTestV241-126403670-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-91883094"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:28.848906 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.aggregate [None req-e1eb0834-d11f-4566-b8cc-e420b69d8311 tempest-AggregatesAdminTestV241-126403670 tempest-AggregatesAdminTestV241-126403670-project-admin] Generated uuid 6e0d3f51-1d43-443e-8f96-d19ef982b2b3 for aggregate {{(pid=127017) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 13:33:28.932048 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e1eb0834-d11f-4566-b8cc-e420b69d8311 tempest-AggregatesAdminTestV241-126403670 tempest-AggregatesAdminTestV241-126403670-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 244 microversion: 2.41 time: 0.333165 Oct 17 13:33:28.940323 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1/2] 10.222.0.79 () {62 vars in 1205 bytes} [Mon Oct 17 13:33:28 2022] POST /compute/v2.1/os-aggregates => generated 244 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 13:33:28.946944 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1ef50693-3d5a-4041-93c6-476c7cb01aa3 tempest-AggregatesAdminTestV241-126403670 tempest-AggregatesAdminTestV241-126403670-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1166297500"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:29.138583 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1ef50693-3d5a-4041-93c6-476c7cb01aa3 tempest-AggregatesAdminTestV241-126403670 tempest-AggregatesAdminTestV241-126403670-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 299 microversion: 2.41 time: 0.195961 Oct 17 13:33:29.140396 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2/3] 10.222.0.79 () {62 vars in 1210 bytes} [Mon Oct 17 13:33:28 2022] PUT /compute/v2.1/os-aggregates/1 => generated 299 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:33:29.151799 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1ce62f74-e1b8-451c-9e2f-47a9b77a60a8 tempest-AggregatesAdminTestV241-126403670 tempest-AggregatesAdminTestV241-126403670-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:29.163436 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1ce62f74-e1b8-451c-9e2f-47a9b77a60a8 tempest-AggregatesAdminTestV241-126403670 tempest-AggregatesAdminTestV241-126403670-project-admin] 10.222.0.79 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 299 microversion: 2.41 time: 0.015405 Oct 17 13:33:29.164647 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3/4] 10.222.0.79 () {60 vars in 1190 bytes} [Mon Oct 17 13:33:29 2022] GET /compute/v2.1/os-aggregates/1 => generated 299 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:33:29.182425 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f8a88d6c-dfed-4526-be29-3ead5d9d67d3 tempest-AggregatesAdminTestV241-126403670 tempest-AggregatesAdminTestV241-126403670-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854247-14"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:29.196506 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f8a88d6c-dfed-4526-be29-3ead5d9d67d3 tempest-AggregatesAdminTestV241-126403670 tempest-AggregatesAdminTestV241-126403670-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:29.197098 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f8a88d6c-dfed-4526-be29-3ead5d9d67d3 tempest-AggregatesAdminTestV241-126403670 tempest-AggregatesAdminTestV241-126403670-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:29.198063 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f8a88d6c-dfed-4526-be29-3ead5d9d67d3 tempest-AggregatesAdminTestV241-126403670 tempest-AggregatesAdminTestV241-126403670-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:30.154547 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f46ad5b0-67da-43d0-8b63-e5cd0db945d5 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Calling method '.version_select at 0x7f7cd7062dc0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:30.161451 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f46ad5b0-67da-43d0-8b63-e5cd0db945d5 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),23debefa-f967-4de1-8ea3-1fa7cc16392a(cell1) {{(pid=127017) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 17 13:33:30.162725 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f46ad5b0-67da-43d0-8b63-e5cd0db945d5 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:30.163446 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f46ad5b0-67da-43d0-8b63-e5cd0db945d5 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:30.164067 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f46ad5b0-67da-43d0-8b63-e5cd0db945d5 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:30.195468 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f46ad5b0-67da-43d0-8b63-e5cd0db945d5 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:30.195965 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f46ad5b0-67da-43d0-8b63-e5cd0db945d5 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:30.196422 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f46ad5b0-67da-43d0-8b63-e5cd0db945d5 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:30.209999 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f8a88d6c-dfed-4526-be29-3ead5d9d67d3 tempest-AggregatesAdminTestV241-126403670 tempest-AggregatesAdminTestV241-126403670-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 315 microversion: 2.41 time: 1.033440 Oct 17 13:33:30.211732 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 4/5] 10.222.0.79 () {62 vars in 1232 bytes} [Mon Oct 17 13:33:29 2022] POST /compute/v2.1/os-aggregates/1/action => generated 315 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:33:30.219967 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f46ad5b0-67da-43d0-8b63-e5cd0db945d5 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:30.220693 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f46ad5b0-67da-43d0-8b63-e5cd0db945d5 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:30.221132 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f46ad5b0-67da-43d0-8b63-e5cd0db945d5 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:30.227390 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f46ad5b0-67da-43d0-8b63-e5cd0db945d5 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 1.128743 Oct 17 13:33:30.227961 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2/6] 10.222.0.79 () {58 vars in 1167 bytes} [Mon Oct 17 13:33:29 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:30.468916 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a929178d-96ba-46b3-a79b-fa98a78b67e6 tempest-FlavorsExtraSpecsNegativeTestJSON-483912067 tempest-FlavorsExtraSpecsNegativeTestJSON-483912067-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-2037309630", "ram": 512, "vcpus": 1, "disk": 10, "id": 1908172817, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:30.470229 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2b984369-226b-4912-af7e-3c6866fd84b7 tempest-FlavorMetadataValidation-1463111421 tempest-FlavorMetadataValidation-1463111421-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1077674779", "id": 533003696, "os-flavor-access:is_public": "True"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:30.507685 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2b984369-226b-4912-af7e-3c6866fd84b7 tempest-FlavorMetadataValidation-1463111421 tempest-FlavorMetadataValidation-1463111421-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.86 time: 0.278092 Oct 17 13:33:30.508621 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3/7] 10.222.0.79 () {62 vars in 1188 bytes} [Mon Oct 17 13:33:30 2022] POST /compute/v2.1/flavors => generated 468 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:33:30.529627 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a929178d-96ba-46b3-a79b-fa98a78b67e6 tempest-FlavorsExtraSpecsNegativeTestJSON-483912067 tempest-FlavorsExtraSpecsNegativeTestJSON-483912067-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.316299 Oct 17 13:33:30.530912 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 5/8] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:33:30 2022] POST /compute/v2.1/flavors => generated 416 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:33:30.669223 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0c94a6b4-d29a-4bde-9862-0f69bcb548cc tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:30.673307 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0c94a6b4-d29a-4bde-9862-0f69bcb548cc tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:30.673890 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0c94a6b4-d29a-4bde-9862-0f69bcb548cc tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:30.674496 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0c94a6b4-d29a-4bde-9862-0f69bcb548cc tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:30.675215 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0c94a6b4-d29a-4bde-9862-0f69bcb548cc tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:30.675659 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0c94a6b4-d29a-4bde-9862-0f69bcb548cc tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:30.676071 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0c94a6b4-d29a-4bde-9862-0f69bcb548cc tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:30.684841 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-95d134aa-c8b2-4670-b5f5-e3d8258f4964 tempest-AZAdminNegativeTestJSON-525095252 tempest-AZAdminNegativeTestJSON-525095252-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:30.686283 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-95d134aa-c8b2-4670-b5f5-e3d8258f4964 tempest-AZAdminNegativeTestJSON-525095252 tempest-AZAdminNegativeTestJSON-525095252-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'c74095f255724c0691a58a781381903a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e7ccb77a13c4242bff28e35647db504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:30.690532 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-95d134aa-c8b2-4670-b5f5-e3d8258f4964 tempest-AZAdminNegativeTestJSON-525095252 tempest-AZAdminNegativeTestJSON-525095252-project] Request method failure captured: Oct 17 13:33:30.690532 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 17 13:33:30.690532 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:33:30.690532 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:33:30.690532 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:33:30.690532 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:33:30.690532 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:33:30.690532 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:33:30.690532 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:33:30.690532 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:30.690532 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVmnZ870PmZq4eGLKpX-fa9gWyals6xdLMS_KJxHBzh1FoGX8NJQOWahjxsgYAyxTjMQnqWdTpjF9BAVSWOWxXC_SuNGeUakmHZveuHhean-kus-jgxGsvemKxIfNCzVxraj7OOsPvMxB57z02wfPWhLtd8rsZAzYogmYsoOVtartBA Oct 17 13:33:30.690532 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:33:30.690532 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:33:30.690532 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:33:30.690532 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:33:30.690532 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:33:30.690532 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:33:30.690532 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 4e7ccb77a13c4242bff28e35647db504 Oct 17 13:33:30.690532 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-AZAdminNegativeTestJSON-525095252 Oct 17 13:33:30.690532 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:33:30.690532 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:33:30.691676 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4e7ccb77a13c4242bff28e35647db504"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4e7ccb77a13c4242bff28e35647db504"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4e7ccb77a13c4242bff28e35647db504"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4e7ccb77a13c4242bff28e35647db504", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:33:30.691676 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-AZAdminNegativeTestJSON-525095252 Oct 17 13:33:30.691676 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 4e7ccb77a13c4242bff28e35647db504 Oct 17 13:33:30.691676 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-525095252 Oct 17 13:33:30.691676 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-AZAdminNegativeTestJSON-525095252-project Oct 17 13:33:30.691676 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:33:30.691676 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:33:30.691676 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: c74095f255724c0691a58a781381903a Oct 17 13:33:30.691676 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-AZAdminNegativeTestJSON-525095252-project Oct 17 13:33:30.691676 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:33:30.691676 n-d-854247-14 devstack@n-api.service[127016]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 17 13:33:30.691676 n-d-854247-14 devstack@n-api.service[127016]: action_args: {} Oct 17 13:33:30.692216 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:30.692216 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:30.692216 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:30.692216 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:30.692216 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:30.692216 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:30.692216 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:30.692216 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:30.692216 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 17 13:33:30.692216 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 17 13:33:30.692216 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:33:30.692216 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:33:30.692216 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:33:30.692216 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:33:30.692216 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:33:30.692216 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:33:30.692216 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:33:30.692216 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:33:30.692216 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:33:30.693233 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:33:30.693233 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:33:30.693233 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:33:30.693233 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:33:30.693233 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:33:30.693233 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 17 13:33:30.693233 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:30.693233 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:30.693233 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:30.693233 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:30.693233 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:30.693233 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:30.693233 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:33:30.693233 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:33:30.693233 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 17 13:33:30.693233 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:30.695435 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-95d134aa-c8b2-4670-b5f5-e3d8258f4964 tempest-AZAdminNegativeTestJSON-525095252 tempest-AZAdminNegativeTestJSON-525095252-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:30.696704 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-95d134aa-c8b2-4670-b5f5-e3d8258f4964 tempest-AZAdminNegativeTestJSON-525095252 tempest-AZAdminNegativeTestJSON-525095252-project] 10.222.0.79 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.164324 Oct 17 13:33:30.707142 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 6/9] 10.222.0.79 () {58 vars in 1185 bytes} [Mon Oct 17 13:33:30 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 175 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:33:30.712858 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7967863a-b4a2-445a-826f-c4ed881c451a tempest-AggregatesAdminTestV241-126403670 tempest-AggregatesAdminTestV241-126403670-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854247-14"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:30.720030 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0c94a6b4-d29a-4bde-9862-0f69bcb548cc tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.208872 Oct 17 13:33:30.728156 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 4/10] 10.222.0.79 () {58 vars in 1176 bytes} [Mon Oct 17 13:33:30 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:33:30.730738 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7967863a-b4a2-445a-826f-c4ed881c451a tempest-AggregatesAdminTestV241-126403670 tempest-AggregatesAdminTestV241-126403670-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:30.731750 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7967863a-b4a2-445a-826f-c4ed881c451a tempest-AggregatesAdminTestV241-126403670 tempest-AggregatesAdminTestV241-126403670-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:30.732389 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7967863a-b4a2-445a-826f-c4ed881c451a tempest-AggregatesAdminTestV241-126403670 tempest-AggregatesAdminTestV241-126403670-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:30.734186 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ae20cf1a-0d36-4595-85fc-2c63dfdd69aa tempest-FlavorMetadataValidation-1463111421 tempest-FlavorMetadataValidation-1463111421-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:30.889214 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7967863a-b4a2-445a-826f-c4ed881c451a tempest-AggregatesAdminTestV241-126403670 tempest-AggregatesAdminTestV241-126403670-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 299 microversion: 2.41 time: 0.180634 Oct 17 13:33:30.895817 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 7/11] 10.222.0.79 () {62 vars in 1232 bytes} [Mon Oct 17 13:33:30 2022] POST /compute/v2.1/os-aggregates/1/action => generated 299 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:33:30.923944 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ae20cf1a-0d36-4595-85fc-2c63dfdd69aa tempest-FlavorMetadataValidation-1463111421 tempest-FlavorMetadataValidation-1463111421-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors/533003696/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.193708 Oct 17 13:33:30.924851 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 5/12] 10.222.0.79 () {62 vars in 1262 bytes} [Mon Oct 17 13:33:30 2022] POST /compute/v2.1/flavors/533003696/os-extra_specs => generated 62 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:30.930427 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e516f70b-61c3-4e37-acae-709c109c9bf5 tempest-AggregatesAdminTestV241-126403670 tempest-AggregatesAdminTestV241-126403670-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:30.963128 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e516f70b-61c3-4e37-acae-709c109c9bf5 tempest-AggregatesAdminTestV241-126403670 tempest-AggregatesAdminTestV241-126403670-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.036624 Oct 17 13:33:30.964214 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 6/13] 10.222.0.79 () {60 vars in 1193 bytes} [Mon Oct 17 13:33:30 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:33:30.972620 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b449f5e4-092b-4771-bea4-b04f35d81633 tempest-FlavorMetadataValidation-1463111421 tempest-FlavorMetadataValidation-1463111421-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:31.003416 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b449f5e4-092b-4771-bea4-b04f35d81633 tempest-FlavorMetadataValidation-1463111421 tempest-FlavorMetadataValidation-1463111421-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/533003696" status: 202 len: 0 microversion: 2.86 time: 0.037483 Oct 17 13:33:31.004545 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 7/14] 10.222.0.79 () {60 vars in 1199 bytes} [Mon Oct 17 13:33:30 2022] DELETE /compute/v2.1/flavors/533003696 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:33:31.012735 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a8c5fc2b-ec81-498d-a06b-c00e61f6bca5 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-767448914", "name": "tempest-test_aggregate-1047378945"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:31.036353 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.aggregate [None req-a8c5fc2b-ec81-498d-a06b-c00e61f6bca5 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Generated uuid c46c9803-8348-4387-87ce-2d6b52e6a6ec for aggregate {{(pid=127017) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 13:33:31.062863 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a8c5fc2b-ec81-498d-a06b-c00e61f6bca5 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.054109 Oct 17 13:33:31.064138 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 8/15] 10.222.0.79 () {60 vars in 1165 bytes} [Mon Oct 17 13:33:31 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:33:31.068482 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6e1d1d68-c1fd-4ce8-84ba-c903bd14bed3 tempest-FlavorMetadataValidation-1463111421 tempest-FlavorMetadataValidation-1463111421-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:31.111690 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6e1d1d68-c1fd-4ce8-84ba-c903bd14bed3 tempest-FlavorMetadataValidation-1463111421 tempest-FlavorMetadataValidation-1463111421-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 6223 microversion: 2.86 time: 0.046396 Oct 17 13:33:31.112269 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 9/16] 10.222.0.79 () {60 vars in 1187 bytes} [Mon Oct 17 13:33:31 2022] GET /compute/v2.1/flavors/detail => generated 6223 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:33:31.256633 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-bb9f20d8-264f-440e-8a2a-a921815ae025 tempest-FlavorsExtraSpecsNegativeTestJSON-75615188 tempest-FlavorsExtraSpecsNegativeTestJSON-75615188-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:31.278898 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-bb9f20d8-264f-440e-8a2a-a921815ae025 tempest-FlavorsExtraSpecsNegativeTestJSON-75615188 tempest-FlavorsExtraSpecsNegativeTestJSON-75615188-project] HTTP exception thrown: Flavor 1908172817 has no extra specs with key hw:cpu_thread_policy. Oct 17 13:33:31.280793 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-bb9f20d8-264f-440e-8a2a-a921815ae025 tempest-FlavorsExtraSpecsNegativeTestJSON-75615188 tempest-FlavorsExtraSpecsNegativeTestJSON-75615188-project] Request method failure captured: Oct 17 13:33:31.280793 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/flavors/1908172817/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 17 13:33:31.280793 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:33:31.280793 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:33:31.280793 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:33:31.280793 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:33:31.280793 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:33:31.280793 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:33:31.280793 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:33:31.280793 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:31.280793 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVmm9EhHMFajPzUJAKgeOavyj27emLAj75kiSx8sVPw8bdhHU915TyuLtKS3Rbf_Eh4u0EtpZSqRfB0ytoklTM33zg4NWUdlIv1uasmFTvzBB_ZaYmDKQrO6kAurvEP8EVhz_HRg3LTgRxcfh0FKPZZSdJsD9JSSLKDtdJFNW7GumhY Oct 17 13:33:31.280793 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:33:31.280793 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:33:31.280793 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:33:31.280793 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:33:31.280793 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:33:31.280793 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:33:31.280793 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: d34c03bc98a74c3fb5b730e618233cbd Oct 17 13:33:31.280793 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-75615188 Oct 17 13:33:31.280793 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:33:31.280793 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:33:31.281780 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d34c03bc98a74c3fb5b730e618233cbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d34c03bc98a74c3fb5b730e618233cbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d34c03bc98a74c3fb5b730e618233cbd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d34c03bc98a74c3fb5b730e618233cbd", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:33:31.281780 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-75615188 Oct 17 13:33:31.281780 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: d34c03bc98a74c3fb5b730e618233cbd Oct 17 13:33:31.281780 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-75615188 Oct 17 13:33:31.281780 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-75615188-project Oct 17 13:33:31.281780 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:33:31.281780 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:33:31.281780 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: e975278dd001489e9e6823809a958630 Oct 17 13:33:31.281780 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-75615188-project Oct 17 13:33:31.281780 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:33:31.281780 n-d-854247-14 devstack@n-api.service[127016]: exception: Flavor 1908172817 has no extra specs with key hw:cpu_thread_policy. Oct 17 13:33:31.282301 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'flavor_id': '1908172817', 'id': 'hw:cpu_thread_policy'} Oct 17 13:33:31.282301 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:31.282301 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:31.282301 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 17 13:33:31.282301 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 17 13:33:31.282301 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 17 13:33:31.282301 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:31.282301 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:31.282301 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:31.282301 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:31.282301 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:31.282301 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:31.282301 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:31.282301 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:31.282301 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:31.282301 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:31.282301 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 17 13:33:31.282301 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 17 13:33:31.282301 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1908172817 has no extra specs with key hw:cpu_thread_policy. Oct 17 13:33:31.282301 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:31.282301 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:31.282301 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:31.283324 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:31.283324 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:31.283324 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:31.283324 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:33:31.283324 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:33:31.283324 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1908172817 has no extra specs with key hw:cpu_thread_policy. Oct 17 13:33:31.283324 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:31.285186 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-bb9f20d8-264f-440e-8a2a-a921815ae025 tempest-FlavorsExtraSpecsNegativeTestJSON-75615188 tempest-FlavorsExtraSpecsNegativeTestJSON-75615188-project] Returning 404 to user: Flavor 1908172817 has no extra specs with key hw:cpu_thread_policy. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:31.286198 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-bb9f20d8-264f-440e-8a2a-a921815ae025 tempest-FlavorsExtraSpecsNegativeTestJSON-75615188 tempest-FlavorsExtraSpecsNegativeTestJSON-75615188-project] 10.222.0.79 "GET /compute/v2.1/flavors/1908172817/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.392782 Oct 17 13:33:31.286977 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 8/17] 10.222.0.79 () {58 vars in 1266 bytes} [Mon Oct 17 13:33:30 2022] GET /compute/v2.1/flavors/1908172817/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:33:31.292175 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-69a3c91a-4988-49d3-ad15-ed0040f9b8d0 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:31.305377 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-69a3c91a-4988-49d3-ad15-ed0040f9b8d0 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] 10.222.0.79 "GET /compute/v2.1/os-aggregates" status: 200 len: 301 microversion: 2.1 time: 0.017051 Oct 17 13:33:31.305945 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 9/18] 10.222.0.79 () {58 vars in 1143 bytes} [Mon Oct 17 13:33:31 2022] GET /compute/v2.1/os-aggregates => generated 301 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:33:31.311484 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-82984a01-b9f0-410a-adb1-05ad1e2c6d3e tempest-FlavorsExtraSpecsNegativeTestJSON-75615188 tempest-FlavorsExtraSpecsNegativeTestJSON-75615188-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:31.316502 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-82984a01-b9f0-410a-adb1-05ad1e2c6d3e tempest-FlavorsExtraSpecsNegativeTestJSON-75615188 tempest-FlavorsExtraSpecsNegativeTestJSON-75615188-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'e975278dd001489e9e6823809a958630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34c03bc98a74c3fb5b730e618233cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:31.318537 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-82984a01-b9f0-410a-adb1-05ad1e2c6d3e tempest-FlavorsExtraSpecsNegativeTestJSON-75615188 tempest-FlavorsExtraSpecsNegativeTestJSON-75615188-project] Request method failure captured: Oct 17 13:33:31.318537 n-d-854247-14 devstack@n-api.service[127016]: request: POST /compute/v2.1/flavors/1908172817/os-extra_specs HTTP/1.1 Oct 17 13:33:31.318537 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:33:31.318537 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:33:31.318537 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:33:31.318537 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 66 Oct 17 13:33:31.318537 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:33:31.318537 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:33:31.318537 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:33:31.318537 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:31.318537 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVmm9EhHMFajPzUJAKgeOavyj27emLAj75kiSx8sVPw8bdhHU915TyuLtKS3Rbf_Eh4u0EtpZSqRfB0ytoklTM33zg4NWUdlIv1uasmFTvzBB_ZaYmDKQrO6kAurvEP8EVhz_HRg3LTgRxcfh0FKPZZSdJsD9JSSLKDtdJFNW7GumhY Oct 17 13:33:31.318537 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:33:31.318537 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:33:31.318537 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:33:31.318537 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:33:31.318537 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:33:31.318537 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:33:31.318537 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: d34c03bc98a74c3fb5b730e618233cbd Oct 17 13:33:31.318537 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-75615188 Oct 17 13:33:31.318537 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:33:31.318537 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:33:31.319721 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d34c03bc98a74c3fb5b730e618233cbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d34c03bc98a74c3fb5b730e618233cbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d34c03bc98a74c3fb5b730e618233cbd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d34c03bc98a74c3fb5b730e618233cbd", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:33:31.319721 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-75615188 Oct 17 13:33:31.319721 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: d34c03bc98a74c3fb5b730e618233cbd Oct 17 13:33:31.319721 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-75615188 Oct 17 13:33:31.319721 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-75615188-project Oct 17 13:33:31.319721 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:33:31.319721 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:33:31.319721 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: e975278dd001489e9e6823809a958630 Oct 17 13:33:31.319721 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-75615188-project Oct 17 13:33:31.319721 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:33:31.319721 n-d-854247-14 devstack@n-api.service[127016]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 17 13:33:31.319721 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:33:31.320269 n-d-854247-14 devstack@n-api.service[127016]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 17 13:33:31.320269 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'flavor_id': '1908172817', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 17 13:33:31.320269 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:31.320269 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:31.320269 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:31.320269 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:31.320269 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:31.320269 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:31.320269 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:31.320269 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:31.320269 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:33:31.320269 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:33:31.320269 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 17 13:33:31.320269 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 17 13:33:31.320269 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:33:31.320269 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:33:31.320269 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:33:31.320269 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:33:31.320269 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:33:31.321166 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:33:31.321166 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:33:31.321166 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:33:31.321166 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:33:31.321166 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:33:31.321166 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:33:31.321166 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:33:31.321166 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:33:31.321166 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:33:31.321166 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 17 13:33:31.321166 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:31.321166 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:31.321166 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:31.321166 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:31.321166 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:31.321166 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:31.321166 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:33:31.321166 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:33:31.321166 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 17 13:33:31.321166 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:31.326582 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-82984a01-b9f0-410a-adb1-05ad1e2c6d3e tempest-FlavorsExtraSpecsNegativeTestJSON-75615188 tempest-FlavorsExtraSpecsNegativeTestJSON-75615188-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:31.326582 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-82984a01-b9f0-410a-adb1-05ad1e2c6d3e tempest-FlavorsExtraSpecsNegativeTestJSON-75615188 tempest-FlavorsExtraSpecsNegativeTestJSON-75615188-project] 10.222.0.79 "POST /compute/v2.1/flavors/1908172817/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.013857 Oct 17 13:33:31.326582 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 10/19] 10.222.0.79 () {60 vars in 1224 bytes} [Mon Oct 17 13:33:31 2022] POST /compute/v2.1/flavors/1908172817/os-extra_specs => generated 124 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:33:31.328959 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a770bf17-c667-4aa4-9d6c-b1bf23151bb4 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854247-14"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:31.340259 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a770bf17-c667-4aa4-9d6c-b1bf23151bb4 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:31.341069 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a770bf17-c667-4aa4-9d6c-b1bf23151bb4 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:31.341521 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a770bf17-c667-4aa4-9d6c-b1bf23151bb4 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:31.506247 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a770bf17-c667-4aa4-9d6c-b1bf23151bb4 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 314 microversion: 2.1 time: 0.182969 Oct 17 13:33:31.507110 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 11/20] 10.222.0.79 () {60 vars in 1191 bytes} [Mon Oct 17 13:33:31 2022] POST /compute/v2.1/os-aggregates/2/action => generated 314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:33:31.520032 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a33aa3c4-e5ab-4144-b9e2-e0560f65efdf tempest-FlavorsExtraSpecsNegativeTestJSON-483912067 tempest-FlavorsExtraSpecsNegativeTestJSON-483912067-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:31.569278 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a33aa3c4-e5ab-4144-b9e2-e0560f65efdf tempest-FlavorsExtraSpecsNegativeTestJSON-483912067 tempest-FlavorsExtraSpecsNegativeTestJSON-483912067-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors/1908172817/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.060840 Oct 17 13:33:31.570863 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 12/21] 10.222.0.79 () {60 vars in 1224 bytes} [Mon Oct 17 13:33:31 2022] POST /compute/v2.1/flavors/1908172817/os-extra_specs => generated 66 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:33:31.582910 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b85c4de5-69a5-4106-9e47-2ad855e75077 tempest-FlavorsExtraSpecsNegativeTestJSON-75615188 tempest-FlavorsExtraSpecsNegativeTestJSON-75615188-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:31.586154 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b85c4de5-69a5-4106-9e47-2ad855e75077 tempest-FlavorsExtraSpecsNegativeTestJSON-75615188 tempest-FlavorsExtraSpecsNegativeTestJSON-75615188-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'e975278dd001489e9e6823809a958630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34c03bc98a74c3fb5b730e618233cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:31.589646 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b85c4de5-69a5-4106-9e47-2ad855e75077 tempest-FlavorsExtraSpecsNegativeTestJSON-75615188 tempest-FlavorsExtraSpecsNegativeTestJSON-75615188-project] Request method failure captured: Oct 17 13:33:31.589646 n-d-854247-14 devstack@n-api.service[127016]: request: DELETE /compute/v2.1/flavors/1908172817/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 17 13:33:31.589646 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:33:31.589646 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:33:31.589646 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:33:31.589646 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:33:31.589646 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:33:31.589646 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:33:31.589646 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:33:31.589646 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:31.589646 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVmm9EhHMFajPzUJAKgeOavyj27emLAj75kiSx8sVPw8bdhHU915TyuLtKS3Rbf_Eh4u0EtpZSqRfB0ytoklTM33zg4NWUdlIv1uasmFTvzBB_ZaYmDKQrO6kAurvEP8EVhz_HRg3LTgRxcfh0FKPZZSdJsD9JSSLKDtdJFNW7GumhY Oct 17 13:33:31.589646 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:33:31.589646 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:33:31.589646 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:33:31.589646 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:33:31.589646 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:33:31.589646 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:33:31.589646 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: d34c03bc98a74c3fb5b730e618233cbd Oct 17 13:33:31.589646 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-75615188 Oct 17 13:33:31.589646 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:33:31.589646 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:33:31.591473 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d34c03bc98a74c3fb5b730e618233cbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d34c03bc98a74c3fb5b730e618233cbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d34c03bc98a74c3fb5b730e618233cbd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d34c03bc98a74c3fb5b730e618233cbd", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:33:31.591473 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-75615188 Oct 17 13:33:31.591473 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: d34c03bc98a74c3fb5b730e618233cbd Oct 17 13:33:31.591473 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-75615188 Oct 17 13:33:31.591473 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-75615188-project Oct 17 13:33:31.591473 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:33:31.591473 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:33:31.591473 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: e975278dd001489e9e6823809a958630 Oct 17 13:33:31.591473 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-75615188-project Oct 17 13:33:31.591473 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:33:31.591473 n-d-854247-14 devstack@n-api.service[127016]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 17 13:33:31.592403 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'flavor_id': '1908172817', 'id': 'hw:numa_nodes'} Oct 17 13:33:31.592403 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:31.592403 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:31.592403 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:31.592403 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:31.592403 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:31.592403 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:31.592403 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:31.592403 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:31.592403 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 17 13:33:31.592403 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 17 13:33:31.592403 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:33:31.592403 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:33:31.592403 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:33:31.592403 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:33:31.592403 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:33:31.592403 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:33:31.592403 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:33:31.592403 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:33:31.592403 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:33:31.593903 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:33:31.593903 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:33:31.593903 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:33:31.593903 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:33:31.593903 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:33:31.593903 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 17 13:33:31.593903 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:31.593903 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:31.593903 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:31.593903 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:31.593903 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:31.593903 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:31.593903 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:33:31.593903 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:33:31.593903 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 17 13:33:31.593903 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:31.593903 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b85c4de5-69a5-4106-9e47-2ad855e75077 tempest-FlavorsExtraSpecsNegativeTestJSON-75615188 tempest-FlavorsExtraSpecsNegativeTestJSON-75615188-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:31.601143 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b85c4de5-69a5-4106-9e47-2ad855e75077 tempest-FlavorsExtraSpecsNegativeTestJSON-75615188 tempest-FlavorsExtraSpecsNegativeTestJSON-75615188-project] 10.222.0.79 "DELETE /compute/v2.1/flavors/1908172817/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.015195 Oct 17 13:33:31.601143 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 13/22] 10.222.0.79 () {58 vars in 1248 bytes} [Mon Oct 17 13:33:31 2022] DELETE /compute/v2.1/flavors/1908172817/os-extra_specs/hw:numa_nodes => generated 124 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:33:31.607546 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a482dd79-5fa2-4407-a4d2-95ba62d1740a tempest-FlavorsExtraSpecsNegativeTestJSON-483912067 tempest-FlavorsExtraSpecsNegativeTestJSON-483912067-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:31.636906 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a482dd79-5fa2-4407-a4d2-95ba62d1740a tempest-FlavorsExtraSpecsNegativeTestJSON-483912067 tempest-FlavorsExtraSpecsNegativeTestJSON-483912067-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors/1908172817/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.036458 Oct 17 13:33:31.643240 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 14/23] 10.222.0.79 () {60 vars in 1224 bytes} [Mon Oct 17 13:33:31 2022] POST /compute/v2.1/flavors/1908172817/os-extra_specs => generated 66 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:33:31.648723 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-26fb0eeb-1e35-4589-8671-54e710e41d49 tempest-FlavorsExtraSpecsNegativeTestJSON-75615188 tempest-FlavorsExtraSpecsNegativeTestJSON-75615188-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:31.654892 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-26fb0eeb-1e35-4589-8671-54e710e41d49 tempest-FlavorsExtraSpecsNegativeTestJSON-75615188 tempest-FlavorsExtraSpecsNegativeTestJSON-75615188-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'e975278dd001489e9e6823809a958630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34c03bc98a74c3fb5b730e618233cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:31.657013 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-26fb0eeb-1e35-4589-8671-54e710e41d49 tempest-FlavorsExtraSpecsNegativeTestJSON-75615188 tempest-FlavorsExtraSpecsNegativeTestJSON-75615188-project] Request method failure captured: Oct 17 13:33:31.657013 n-d-854247-14 devstack@n-api.service[127016]: request: PUT /compute/v2.1/flavors/1908172817/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 17 13:33:31.657013 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:33:31.657013 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:33:31.657013 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:33:31.657013 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 22 Oct 17 13:33:31.657013 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:33:31.657013 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:33:31.657013 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:33:31.657013 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:31.657013 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVmm9EhHMFajPzUJAKgeOavyj27emLAj75kiSx8sVPw8bdhHU915TyuLtKS3Rbf_Eh4u0EtpZSqRfB0ytoklTM33zg4NWUdlIv1uasmFTvzBB_ZaYmDKQrO6kAurvEP8EVhz_HRg3LTgRxcfh0FKPZZSdJsD9JSSLKDtdJFNW7GumhY Oct 17 13:33:31.657013 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:33:31.657013 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:33:31.657013 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:33:31.657013 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:33:31.657013 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:33:31.657013 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:33:31.657013 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: d34c03bc98a74c3fb5b730e618233cbd Oct 17 13:33:31.657013 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-75615188 Oct 17 13:33:31.657013 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:33:31.657013 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:33:31.658232 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d34c03bc98a74c3fb5b730e618233cbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d34c03bc98a74c3fb5b730e618233cbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d34c03bc98a74c3fb5b730e618233cbd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d34c03bc98a74c3fb5b730e618233cbd", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:33:31.658232 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-75615188 Oct 17 13:33:31.658232 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: d34c03bc98a74c3fb5b730e618233cbd Oct 17 13:33:31.658232 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-75615188 Oct 17 13:33:31.658232 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-75615188-project Oct 17 13:33:31.658232 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:33:31.658232 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:33:31.658232 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: e975278dd001489e9e6823809a958630 Oct 17 13:33:31.658232 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-75615188-project Oct 17 13:33:31.658232 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:33:31.658232 n-d-854247-14 devstack@n-api.service[127016]: {"hw:numa_nodes": "1"} Oct 17 13:33:31.658232 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:33:31.658232 n-d-854247-14 devstack@n-api.service[127016]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 17 13:33:31.659212 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'flavor_id': '1908172817', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 17 13:33:31.659212 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:31.659212 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:31.659212 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:31.659212 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:31.659212 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:31.659212 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:31.659212 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:31.659212 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:31.659212 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:33:31.659212 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:33:31.659212 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 17 13:33:31.659212 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 17 13:33:31.659212 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:33:31.659212 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:33:31.659212 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:33:31.659212 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:33:31.659212 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:33:31.659212 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:33:31.660611 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:33:31.660611 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:33:31.660611 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:33:31.660611 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:33:31.660611 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:33:31.660611 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:33:31.660611 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:33:31.660611 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:33:31.660611 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 17 13:33:31.660611 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:31.660611 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:31.660611 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:31.660611 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:31.660611 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:31.660611 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:31.660611 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:33:31.660611 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:33:31.660611 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 17 13:33:31.660611 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:31.661959 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-26fb0eeb-1e35-4589-8671-54e710e41d49 tempest-FlavorsExtraSpecsNegativeTestJSON-75615188 tempest-FlavorsExtraSpecsNegativeTestJSON-75615188-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:31.662967 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-26fb0eeb-1e35-4589-8671-54e710e41d49 tempest-FlavorsExtraSpecsNegativeTestJSON-75615188 tempest-FlavorsExtraSpecsNegativeTestJSON-75615188-project] 10.222.0.79 "PUT /compute/v2.1/flavors/1908172817/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.018466 Oct 17 13:33:31.667708 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 15/24] 10.222.0.79 () {60 vars in 1265 bytes} [Mon Oct 17 13:33:31 2022] PUT /compute/v2.1/flavors/1908172817/os-extra_specs/hw:numa_nodes => generated 124 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:33:31.673871 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8077fc2d-a64a-4bd4-b2f8-533acbe8d830 tempest-FlavorsExtraSpecsNegativeTestJSON-483912067 tempest-FlavorsExtraSpecsNegativeTestJSON-483912067-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:31.683255 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7424ec77-3261-461c-86b8-bf00f8065295 tempest-FlavorsAccessNegativeTestJSON-1316508689 tempest-FlavorsAccessNegativeTestJSON-1316508689-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1858769596", "id": 110342979, "os-flavor-access:is_public": "False"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:31.696255 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-8077fc2d-a64a-4bd4-b2f8-533acbe8d830 tempest-FlavorsExtraSpecsNegativeTestJSON-483912067 tempest-FlavorsExtraSpecsNegativeTestJSON-483912067-project-admin] HTTP exception thrown: Flavor 1908172817 has no extra specs with key hw:cpu_thread_policy. Oct 17 13:33:31.699888 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8077fc2d-a64a-4bd4-b2f8-533acbe8d830 tempest-FlavorsExtraSpecsNegativeTestJSON-483912067 tempest-FlavorsExtraSpecsNegativeTestJSON-483912067-project-admin] Request method failure captured: Oct 17 13:33:31.699888 n-d-854247-14 devstack@n-api.service[127016]: request: DELETE /compute/v2.1/flavors/1908172817/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 17 13:33:31.699888 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:33:31.699888 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:33:31.699888 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:33:31.699888 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:33:31.699888 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:33:31.699888 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:33:31.699888 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:33:31.699888 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:31.699888 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVmpssN3NNfSFnAbLcxvUXfBeY9wvPjmL4R1sgmidF8BufN6ssj_L8Mn4tmcR6ASWBiXXBJXYhBp1V3gFV_5tMmU88UINBFb86Bnro9pVC466AO4B6ldwYN3ae5OySM9NEdHY40kRWIHF2QQSQaVoxD-y20uTHwrvUgm3y2NbYcYsWI Oct 17 13:33:31.699888 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:33:31.699888 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:33:31.699888 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:33:31.699888 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:33:31.699888 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:33:31.699888 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:33:31.699888 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 844f37fe708c42a0b7ab03c7a7a39bd4 Oct 17 13:33:31.699888 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-483912067 Oct 17 13:33:31.699888 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member,admin Oct 17 13:33:31.699888 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member,admin Oct 17 13:33:31.701202 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/844f37fe708c42a0b7ab03c7a7a39bd4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/844f37fe708c42a0b7ab03c7a7a39bd4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/844f37fe708c42a0b7ab03c7a7a39bd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_844f37fe708c42a0b7ab03c7a7a39bd4", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:33:31.701202 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-483912067 Oct 17 13:33:31.701202 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 844f37fe708c42a0b7ab03c7a7a39bd4 Oct 17 13:33:31.701202 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-483912067 Oct 17 13:33:31.701202 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-483912067-project-admin Oct 17 13:33:31.701202 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:33:31.701202 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:33:31.701202 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 2821a6981d1f438389033d5a704e6d2a Oct 17 13:33:31.701202 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-483912067-project-admin Oct 17 13:33:31.701202 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:33:31.701202 n-d-854247-14 devstack@n-api.service[127016]: exception: Flavor 1908172817 has no extra specs with key hw:cpu_thread_policy. Oct 17 13:33:31.701840 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'flavor_id': '1908172817', 'id': 'hw:cpu_thread_policy'} Oct 17 13:33:31.701840 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:31.701840 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:31.701840 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 17 13:33:31.701840 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 17 13:33:31.701840 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 17 13:33:31.701840 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:31.701840 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:31.701840 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:31.701840 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:31.701840 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:31.701840 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:31.701840 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:31.701840 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:31.701840 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:31.701840 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:31.701840 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 17 13:33:31.701840 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 17 13:33:31.701840 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1908172817 has no extra specs with key hw:cpu_thread_policy. Oct 17 13:33:31.701840 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:31.701840 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:31.701840 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:31.703254 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:31.703254 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:31.703254 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:31.703254 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:33:31.703254 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:33:31.703254 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1908172817 has no extra specs with key hw:cpu_thread_policy. Oct 17 13:33:31.703254 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:31.703254 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8077fc2d-a64a-4bd4-b2f8-533acbe8d830 tempest-FlavorsExtraSpecsNegativeTestJSON-483912067 tempest-FlavorsExtraSpecsNegativeTestJSON-483912067-project-admin] Returning 404 to user: Flavor 1908172817 has no extra specs with key hw:cpu_thread_policy. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:31.703254 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8077fc2d-a64a-4bd4-b2f8-533acbe8d830 tempest-FlavorsExtraSpecsNegativeTestJSON-483912067 tempest-FlavorsExtraSpecsNegativeTestJSON-483912067-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/1908172817/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.031387 Oct 17 13:33:31.703254 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 16/25] 10.222.0.79 () {58 vars in 1269 bytes} [Mon Oct 17 13:33:31 2022] DELETE /compute/v2.1/flavors/1908172817/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:33:31.718739 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-98dbc13e-d188-4717-9876-8bd36a94623c tempest-FlavorsExtraSpecsNegativeTestJSON-483912067 tempest-FlavorsExtraSpecsNegativeTestJSON-483912067-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:31.722448 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-98dbc13e-d188-4717-9876-8bd36a94623c tempest-FlavorsExtraSpecsNegativeTestJSON-483912067 tempest-FlavorsExtraSpecsNegativeTestJSON-483912067-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 17 13:33:31.723843 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-98dbc13e-d188-4717-9876-8bd36a94623c tempest-FlavorsExtraSpecsNegativeTestJSON-483912067 tempest-FlavorsExtraSpecsNegativeTestJSON-483912067-project-admin] Request method failure captured: Oct 17 13:33:31.723843 n-d-854247-14 devstack@n-api.service[127016]: request: PUT /compute/v2.1/flavors/1908172817/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 17 13:33:31.723843 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:33:31.723843 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:33:31.723843 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:33:31.723843 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 27 Oct 17 13:33:31.723843 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:33:31.723843 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:33:31.723843 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:33:31.723843 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:31.723843 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVmpssN3NNfSFnAbLcxvUXfBeY9wvPjmL4R1sgmidF8BufN6ssj_L8Mn4tmcR6ASWBiXXBJXYhBp1V3gFV_5tMmU88UINBFb86Bnro9pVC466AO4B6ldwYN3ae5OySM9NEdHY40kRWIHF2QQSQaVoxD-y20uTHwrvUgm3y2NbYcYsWI Oct 17 13:33:31.723843 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:33:31.723843 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:33:31.723843 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:33:31.723843 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:33:31.723843 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:33:31.723843 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:33:31.723843 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 844f37fe708c42a0b7ab03c7a7a39bd4 Oct 17 13:33:31.723843 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-483912067 Oct 17 13:33:31.723843 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member,admin Oct 17 13:33:31.723843 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member,admin Oct 17 13:33:31.725188 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/844f37fe708c42a0b7ab03c7a7a39bd4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/844f37fe708c42a0b7ab03c7a7a39bd4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/844f37fe708c42a0b7ab03c7a7a39bd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_844f37fe708c42a0b7ab03c7a7a39bd4", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:33:31.725188 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-483912067 Oct 17 13:33:31.725188 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 844f37fe708c42a0b7ab03c7a7a39bd4 Oct 17 13:33:31.725188 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-483912067 Oct 17 13:33:31.725188 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-483912067-project-admin Oct 17 13:33:31.725188 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:33:31.725188 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:33:31.725188 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 2821a6981d1f438389033d5a704e6d2a Oct 17 13:33:31.725188 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-483912067-project-admin Oct 17 13:33:31.725188 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:33:31.725188 n-d-854247-14 devstack@n-api.service[127016]: {"hw:cpu_policy": "shared"} Oct 17 13:33:31.725188 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:33:31.725188 n-d-854247-14 devstack@n-api.service[127016]: exception: Request body and URI mismatch Oct 17 13:33:31.725966 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'flavor_id': '1908172817', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 17 13:33:31.725966 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:31.725966 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:31.725966 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:31.725966 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:31.725966 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:31.725966 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:31.725966 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:31.725966 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:31.725966 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:33:31.725966 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:33:31.725966 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 17 13:33:31.725966 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 17 13:33:31.725966 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 17 13:33:31.725966 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:31.725966 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:31.725966 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:31.725966 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:31.725966 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:31.725966 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:31.727111 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:33:31.727111 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:33:31.727111 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 17 13:33:31.727111 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:31.727111 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-98dbc13e-d188-4717-9876-8bd36a94623c tempest-FlavorsExtraSpecsNegativeTestJSON-483912067 tempest-FlavorsExtraSpecsNegativeTestJSON-483912067-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:31.727111 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-98dbc13e-d188-4717-9876-8bd36a94623c tempest-FlavorsExtraSpecsNegativeTestJSON-483912067 tempest-FlavorsExtraSpecsNegativeTestJSON-483912067-project-admin] 10.222.0.79 "PUT /compute/v2.1/flavors/1908172817/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.015909 Oct 17 13:33:31.730047 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 17/26] 10.222.0.79 () {60 vars in 1265 bytes} [Mon Oct 17 13:33:31 2022] PUT /compute/v2.1/flavors/1908172817/os-extra_specs/hw:numa_nodes => generated 73 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 17 13:33:31.744885 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a44e555b-e34d-48ef-9628-812e87203f1b tempest-FlavorsExtraSpecsNegativeTestJSON-483912067 tempest-FlavorsExtraSpecsNegativeTestJSON-483912067-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:31.751007 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7424ec77-3261-461c-86b8-bf00f8065295 tempest-FlavorsAccessNegativeTestJSON-1316508689 tempest-FlavorsAccessNegativeTestJSON-1316508689-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.622658 Oct 17 13:33:31.754297 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 10/27] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:33:31 2022] POST /compute/v2.1/flavors => generated 436 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:33:31.761072 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a44e555b-e34d-48ef-9628-812e87203f1b tempest-FlavorsExtraSpecsNegativeTestJSON-483912067 tempest-FlavorsExtraSpecsNegativeTestJSON-483912067-project-admin] Request method failure captured: Oct 17 13:33:31.761072 n-d-854247-14 devstack@n-api.service[127016]: request: PUT /compute/v2.1/flavors/1908172817/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 17 13:33:31.761072 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:33:31.761072 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:33:31.761072 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:33:31.761072 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 49 Oct 17 13:33:31.761072 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:33:31.761072 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:33:31.761072 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:33:31.761072 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:31.761072 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVmpssN3NNfSFnAbLcxvUXfBeY9wvPjmL4R1sgmidF8BufN6ssj_L8Mn4tmcR6ASWBiXXBJXYhBp1V3gFV_5tMmU88UINBFb86Bnro9pVC466AO4B6ldwYN3ae5OySM9NEdHY40kRWIHF2QQSQaVoxD-y20uTHwrvUgm3y2NbYcYsWI Oct 17 13:33:31.761072 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:33:31.761072 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:33:31.761072 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:33:31.761072 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:33:31.761072 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:33:31.761072 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:33:31.761072 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 844f37fe708c42a0b7ab03c7a7a39bd4 Oct 17 13:33:31.761072 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-483912067 Oct 17 13:33:31.761072 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member,admin Oct 17 13:33:31.761072 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member,admin Oct 17 13:33:31.762347 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/844f37fe708c42a0b7ab03c7a7a39bd4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/844f37fe708c42a0b7ab03c7a7a39bd4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/844f37fe708c42a0b7ab03c7a7a39bd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_844f37fe708c42a0b7ab03c7a7a39bd4", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:33:31.762347 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-483912067 Oct 17 13:33:31.762347 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 844f37fe708c42a0b7ab03c7a7a39bd4 Oct 17 13:33:31.762347 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-483912067 Oct 17 13:33:31.762347 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-483912067-project-admin Oct 17 13:33:31.762347 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:33:31.762347 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:33:31.762347 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 2821a6981d1f438389033d5a704e6d2a Oct 17 13:33:31.762347 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-483912067-project-admin Oct 17 13:33:31.762347 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:33:31.762347 n-d-854247-14 devstack@n-api.service[127016]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 17 13:33:31.762347 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:33:31.762967 n-d-854247-14 devstack@n-api.service[127016]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 17 13:33:31.762967 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'flavor_id': '1908172817', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 17 13:33:31.762967 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:31.762967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:31.762967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:33:31.762967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:33:31.762967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:33:31.762967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:33:31.762967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 17 13:33:31.762967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:31.762967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 17 13:33:31.762967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 17 13:33:31.762967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 17 13:33:31.762967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 17 13:33:31.762967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 17 13:33:31.762967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 17 13:33:31.762967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 17 13:33:31.762967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 17 13:33:31.762967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:31.762967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi On instance: Oct 17 13:33:31.762967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 17 13:33:31.762967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:31.764234 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:31.764234 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:31.764234 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:31.764234 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:31.764234 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:31.764234 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:31.764234 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:31.764234 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:31.764234 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:31.764234 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:33:31.764234 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:33:31.764234 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:33:31.764234 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:33:31.764234 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:33:31.764234 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:33:31.764234 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 17 13:33:31.764234 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:31.764234 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:31.764234 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:31.764234 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:31.765592 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:31.765592 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:31.765592 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:33:31.765592 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:33:31.765592 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 17 13:33:31.765592 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:31.765592 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a44e555b-e34d-48ef-9628-812e87203f1b tempest-FlavorsExtraSpecsNegativeTestJSON-483912067 tempest-FlavorsExtraSpecsNegativeTestJSON-483912067-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:31.765592 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a44e555b-e34d-48ef-9628-812e87203f1b tempest-FlavorsExtraSpecsNegativeTestJSON-483912067 tempest-FlavorsExtraSpecsNegativeTestJSON-483912067-project-admin] 10.222.0.79 "PUT /compute/v2.1/flavors/1908172817/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.028455 Oct 17 13:33:31.765592 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 18/28] 10.222.0.79 () {60 vars in 1265 bytes} [Mon Oct 17 13:33:31 2022] PUT /compute/v2.1/flavors/1908172817/os-extra_specs/hw:numa_nodes => generated 117 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:33:31.768464 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a1702efe-3c50-4f11-bed8-1e8e67185169 tempest-FlavorsAccessNegativeTestJSON-1316508689 tempest-FlavorsAccessNegativeTestJSON-1316508689-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "fff96d958a774627ba4291f7ab7b992f"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:31.781269 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a1224c73-908e-4230-a069-79a7c2589a29 tempest-FlavorsExtraSpecsNegativeTestJSON-483912067 tempest-FlavorsExtraSpecsNegativeTestJSON-483912067-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:31.816973 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a1224c73-908e-4230-a069-79a7c2589a29 tempest-FlavorsExtraSpecsNegativeTestJSON-483912067 tempest-FlavorsExtraSpecsNegativeTestJSON-483912067-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/1908172817" status: 202 len: 0 microversion: 2.1 time: 0.039298 Oct 17 13:33:31.819057 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 19/29] 10.222.0.79 () {58 vars in 1161 bytes} [Mon Oct 17 13:33:31 2022] DELETE /compute/v2.1/flavors/1908172817 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:33:31.827869 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-22d00617-5234-4a87-9f9b-c937b9716cdf tempest-FlavorsExtraSpecsNegativeTestJSON-483912067 tempest-FlavorsExtraSpecsNegativeTestJSON-483912067-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:31.862327 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-22d00617-5234-4a87-9f9b-c937b9716cdf tempest-FlavorsExtraSpecsNegativeTestJSON-483912067 tempest-FlavorsExtraSpecsNegativeTestJSON-483912067-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.039402 Oct 17 13:33:31.863242 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 20/30] 10.222.0.79 () {58 vars in 1146 bytes} [Mon Oct 17 13:33:31 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:32.333113 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a1702efe-3c50-4f11-bed8-1e8e67185169 tempest-FlavorsAccessNegativeTestJSON-1316508689 tempest-FlavorsAccessNegativeTestJSON-1316508689-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors/110342979/action" status: 200 len: 96 microversion: 2.1 time: 0.570783 Oct 17 13:33:32.334790 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 11/31] 10.222.0.79 () {60 vars in 1197 bytes} [Mon Oct 17 13:33:31 2022] POST /compute/v2.1/flavors/110342979/action => generated 96 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 17 13:33:32.354016 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-dce60099-f2db-4c5e-98db-1b723efe1ac5 tempest-FlavorsAccessNegativeTestJSON-1316508689 tempest-FlavorsAccessNegativeTestJSON-1316508689-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "fff96d958a774627ba4291f7ab7b992f"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:32.429953 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6aa4886b-59a7-4bbe-9b91-f611a242ff6b tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1697361016", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "availability_zone": "tempest-test_az-767448914"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:32.443695 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6aa4886b-59a7-4bbe-9b91-f611a242ff6b tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:32.444376 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6aa4886b-59a7-4bbe-9b91-f611a242ff6b tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:32.444837 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6aa4886b-59a7-4bbe-9b91-f611a242ff6b tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:32.445514 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6aa4886b-59a7-4bbe-9b91-f611a242ff6b tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:32.446199 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6aa4886b-59a7-4bbe-9b91-f611a242ff6b tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:32.446786 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6aa4886b-59a7-4bbe-9b91-f611a242ff6b tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:33.224058 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-dce60099-f2db-4c5e-98db-1b723efe1ac5 tempest-FlavorsAccessNegativeTestJSON-1316508689 tempest-FlavorsAccessNegativeTestJSON-1316508689-project-admin] HTTP exception thrown: Flavor access already exists for flavor 17 and project fff96d958a774627ba4291f7ab7b992f combination. Oct 17 13:33:33.250192 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-dce60099-f2db-4c5e-98db-1b723efe1ac5 tempest-FlavorsAccessNegativeTestJSON-1316508689 tempest-FlavorsAccessNegativeTestJSON-1316508689-project-admin] Request method failure captured: Oct 17 13:33:33.250192 n-d-854247-14 devstack@n-api.service[127017]: request: POST /compute/v2.1/flavors/110342979/action HTTP/1.1 Oct 17 13:33:33.250192 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:33:33.250192 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:33:33.250192 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:33:33.250192 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 67 Oct 17 13:33:33.250192 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:33:33.250192 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:33:33.250192 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:33:33.250192 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:33.250192 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVmpgo990Aih2Ayx4gKjYmzxVkoHwIUhRy7mETAgXpQmIzzTXzfcKHGbHkYakl0k0XL8oc4Be7PstiAqyXDM_NSE7vM9YOXW_bixI9X2wxfypSG1_uIA01xxem_10mogNwMAn3zJwiR3JFvQCDmdBZ_AHKzczKB8KwoGmy8e74iiR-A Oct 17 13:33:33.250192 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:33:33.250192 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:33:33.250192 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:33:33.250192 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:33:33.250192 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:33:33.250192 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:33:33.250192 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: d988595506ce4a428349cb5563c54ac4 Oct 17 13:33:33.250192 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1316508689 Oct 17 13:33:33.250192 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member,admin Oct 17 13:33:33.250192 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member,admin Oct 17 13:33:33.251541 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d988595506ce4a428349cb5563c54ac4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d988595506ce4a428349cb5563c54ac4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d988595506ce4a428349cb5563c54ac4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d988595506ce4a428349cb5563c54ac4", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:33:33.251541 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1316508689 Oct 17 13:33:33.251541 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: d988595506ce4a428349cb5563c54ac4 Oct 17 13:33:33.251541 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1316508689 Oct 17 13:33:33.251541 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-FlavorsAccessNegativeTestJSON-1316508689-project-admin Oct 17 13:33:33.251541 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:33:33.251541 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:33:33.251541 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 010575b0b45b4ccaba55311f62151d98 Oct 17 13:33:33.251541 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1316508689-project-admin Oct 17 13:33:33.251541 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 13:33:33.251541 n-d-854247-14 devstack@n-api.service[127017]: {"addTenantAccess": {"tenant": "fff96d958a774627ba4291f7ab7b992f"}} Oct 17 13:33:33.251541 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:33:33.252277 n-d-854247-14 devstack@n-api.service[127017]: exception: Flavor access already exists for flavor 17 and project fff96d958a774627ba4291f7ab7b992f combination. Oct 17 13:33:33.252277 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '110342979', 'body': {'addTenantAccess': {'tenant': 'fff96d958a774627ba4291f7ab7b992f'}}} Oct 17 13:33:33.252277 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:33.252277 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:33.252277 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 17 13:33:33.252277 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 17 13:33:33.252277 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 17 13:33:33.252277 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 17 13:33:33.252277 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 17 13:33:33.252277 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 17 13:33:33.252277 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 17 13:33:33.252277 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 17 13:33:33.252277 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 17 13:33:33.252277 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 17 13:33:33.252277 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 17 13:33:33.252277 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi result.read() Oct 17 13:33:33.252277 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 17 13:33:33.252277 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 17 13:33:33.253386 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 17 13:33:33.253386 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 17 13:33:33.253386 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 17 13:33:33.253386 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 17 13:33:33.253386 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 17 13:33:33.253386 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 17 13:33:33.253386 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '17-fff96d958a774627ba4291f7ab7b992f' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 17 13:33:33.253386 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:33:33.253386 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 17 13:33:33.253386 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:33:33.253386 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:33.253386 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 17 13:33:33.253386 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 17 13:33:33.253386 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 17 13:33:33.253386 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi session.flush() Oct 17 13:33:33.253386 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 17 13:33:33.253386 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 17 13:33:33.253386 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 17 13:33:33.253386 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 17 13:33:33.254486 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 17 13:33:33.254486 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 17 13:33:33.254486 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 17 13:33:33.254486 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception Oct 17 13:33:33.254486 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 17 13:33:33.254486 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 17 13:33:33.254486 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 17 13:33:33.254486 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 17 13:33:33.254486 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 17 13:33:33.254486 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 17 13:33:33.254486 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 17 13:33:33.254486 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 17 13:33:33.254486 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 17 13:33:33.254486 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 17 13:33:33.254486 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 17 13:33:33.254486 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 17 13:33:33.254486 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 17 13:33:33.254486 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 17 13:33:33.255566 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 17 13:33:33.255566 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 17 13:33:33.255566 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 17 13:33:33.255566 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 17 13:33:33.255566 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 17 13:33:33.255566 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 17 13:33:33.255566 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 17 13:33:33.255566 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception Oct 17 13:33:33.255566 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 17 13:33:33.255566 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 17 13:33:33.255566 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 17 13:33:33.255566 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 17 13:33:33.255566 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 17 13:33:33.255566 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 17 13:33:33.255566 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 17 13:33:33.255566 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 17 13:33:33.255566 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 17 13:33:33.255566 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 17 13:33:33.256582 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 17 13:33:33.256582 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi result.read() Oct 17 13:33:33.256582 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 17 13:33:33.256582 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 17 13:33:33.256582 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 17 13:33:33.256582 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 17 13:33:33.256582 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 17 13:33:33.256582 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 17 13:33:33.256582 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 17 13:33:33.256582 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 17 13:33:33.256582 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '17-fff96d958a774627ba4291f7ab7b992f' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 17 13:33:33.256582 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 17 13:33:33.256582 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 17, 13, 33, 33, 217243), 'updated_at': None, 'flavor_id': 17, 'project_id': 'fff96d958a774627ba4291f7ab7b992f'}] Oct 17 13:33:33.256582 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 17 13:33:33.256582 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:33:33.256582 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:33.256582 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:33:33.257545 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:33.257545 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 17 13:33:33.257545 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 17 13:33:33.257545 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 17 13:33:33.257545 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 17 13:33:33.257545 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 17 13:33:33.257545 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 17 13:33:33.257545 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 17 13:33:33.257545 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 17 13:33:33.257545 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 17 13:33:33.257545 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 17 13:33:33.257545 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 13:33:33.257545 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 13:33:33.257545 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 17 13:33:33.257545 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 17 13:33:33.257545 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 17 and project fff96d958a774627ba4291f7ab7b992f combination. Oct 17 13:33:33.257545 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:33:33.257545 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:33.257545 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:33:33.259741 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:33.259741 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:33.259741 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:33.259741 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:33.259741 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:33.259741 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:33.259741 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:33.259741 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:33:33.259741 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:33:33.259741 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 17 13:33:33.259741 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 17 13:33:33.259741 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 17 and project fff96d958a774627ba4291f7ab7b992f combination. Oct 17 13:33:33.259741 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:33:33.259741 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:33.259741 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:33:33.259741 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:33.259741 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:33.259741 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:33.259741 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:33:33.259741 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:33:33.262060 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 17 and project fff96d958a774627ba4291f7ab7b992f combination. Oct 17 13:33:33.262060 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:33:33.262060 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-dce60099-f2db-4c5e-98db-1b723efe1ac5 tempest-FlavorsAccessNegativeTestJSON-1316508689 tempest-FlavorsAccessNegativeTestJSON-1316508689-project-admin] Returning 409 to user: Flavor access already exists for flavor 17 and project fff96d958a774627ba4291f7ab7b992f combination. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:33.262060 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-dce60099-f2db-4c5e-98db-1b723efe1ac5 tempest-FlavorsAccessNegativeTestJSON-1316508689 tempest-FlavorsAccessNegativeTestJSON-1316508689-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors/110342979/action" status: 409 len: 152 microversion: 2.1 time: 0.905359 Oct 17 13:33:33.262060 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 12/32] 10.222.0.79 () {60 vars in 1197 bytes} [Mon Oct 17 13:33:32 2022] POST /compute/v2.1/flavors/110342979/action => generated 152 bytes in 909 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:33:33.274150 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b1cbc8fc-de34-4826-a46a-29ce5416bd20 tempest-FlavorsAccessNegativeTestJSON-1316508689 tempest-FlavorsAccessNegativeTestJSON-1316508689-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "fff96d958a774627ba4291f7ab7b992f"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:33.743127 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-6aa4886b-59a7-4bbe-9b91-f611a242ff6b tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] validate_networks() for None {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:33:34.096028 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-6aa4886b-59a7-4bbe-9b91-f611a242ff6b tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:33:34.096648 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-6aa4886b-59a7-4bbe-9b91-f611a242ff6b tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:33:34.097090 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-6aa4886b-59a7-4bbe-9b91-f611a242ff6b tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:33:34.097498 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-6aa4886b-59a7-4bbe-9b91-f611a242ff6b tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:33:34.097951 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-6aa4886b-59a7-4bbe-9b91-f611a242ff6b tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:33:34.110970 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b1cbc8fc-de34-4826-a46a-29ce5416bd20 tempest-FlavorsAccessNegativeTestJSON-1316508689 tempest-FlavorsAccessNegativeTestJSON-1316508689-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors/110342979/action" status: 200 len: 21 microversion: 2.1 time: 0.845501 Oct 17 13:33:34.113280 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 13/33] 10.222.0.79 () {60 vars in 1197 bytes} [Mon Oct 17 13:33:33 2022] POST /compute/v2.1/flavors/110342979/action => generated 21 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:33:34.114750 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6aa4886b-59a7-4bbe-9b91-f611a242ff6b tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:34.115428 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6aa4886b-59a7-4bbe-9b91-f611a242ff6b tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:34.116000 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6aa4886b-59a7-4bbe-9b91-f611a242ff6b tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:34.116894 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6aa4886b-59a7-4bbe-9b91-f611a242ff6b tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:34.117552 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6aa4886b-59a7-4bbe-9b91-f611a242ff6b tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:34.118231 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6aa4886b-59a7-4bbe-9b91-f611a242ff6b tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:34.130547 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e3e7c870-6bbe-471d-94bb-facf80d1d65b tempest-FlavorsAccessNegativeTestJSON-1316508689 tempest-FlavorsAccessNegativeTestJSON-1316508689-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:34.160051 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-6aa4886b-59a7-4bbe-9b91-f611a242ff6b tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Getting quotas for project 9e76de886880490ba8373e0d86056c7b. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:33:34.160234 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e3e7c870-6bbe-471d-94bb-facf80d1d65b tempest-FlavorsAccessNegativeTestJSON-1316508689 tempest-FlavorsAccessNegativeTestJSON-1316508689-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/110342979" status: 202 len: 0 microversion: 2.1 time: 0.040366 Oct 17 13:33:34.160973 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 14/34] 10.222.0.79 () {58 vars in 1158 bytes} [Mon Oct 17 13:33:34 2022] DELETE /compute/v2.1/flavors/110342979 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:33:34.171365 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0064fe98-0f7a-49fc-b7c6-0ad0dd6f1b4c tempest-FlavorsAccessNegativeTestJSON-1316508689 tempest-FlavorsAccessNegativeTestJSON-1316508689-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:34.172024 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-6aa4886b-59a7-4bbe-9b91-f611a242ff6b tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Getting quotas for user 4552e3fbd4de4d2997d5db7ec500de65 and project 9e76de886880490ba8373e0d86056c7b. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:33:34.189661 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6aa4886b-59a7-4bbe-9b91-f611a242ff6b tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:33:34.193927 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6aa4886b-59a7-4bbe-9b91-f611a242ff6b tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] [instance: eb4474f8-de59-4187-8b15-ba0ec266bfa6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:33:34.204782 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0064fe98-0f7a-49fc-b7c6-0ad0dd6f1b4c tempest-FlavorsAccessNegativeTestJSON-1316508689 tempest-FlavorsAccessNegativeTestJSON-1316508689-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038325 Oct 17 13:33:34.211756 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 15/35] 10.222.0.79 () {58 vars in 1146 bytes} [Mon Oct 17 13:33:34 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:34.230968 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-853c3a32-dc0d-4ab9-85b3-d74f273e5fde tempest-FlavorsAccessNegativeTestJSON-1316508689 tempest-FlavorsAccessNegativeTestJSON-1316508689-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-419375770", "id": 1230960040, "os-flavor-access:is_public": "True"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:34.233903 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:INSERT=8,nova_api:DELETE=4,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:33:34.289502 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6aa4886b-59a7-4bbe-9b91-f611a242ff6b tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.393276 Oct 17 13:33:34.292261 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 21/36] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:33:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2397 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:33:34.296170 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-853c3a32-dc0d-4ab9-85b3-d74f273e5fde tempest-FlavorsAccessNegativeTestJSON-1316508689 tempest-FlavorsAccessNegativeTestJSON-1316508689-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.066890 Oct 17 13:33:34.298664 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 16/37] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:33:34 2022] POST /compute/v2.1/flavors => generated 437 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:33:34.311478 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-23504b90-b357-49ce-a89f-26ae3e7b6f50 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:34.312107 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-23504b90-b357-49ce-a89f-26ae3e7b6f50 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] [instance: eb4474f8-de59-4187-8b15-ba0ec266bfa6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:34.312228 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8cb6c438-ca08-4a1d-9a6c-a4792b26d4b5 tempest-FlavorsAccessNegativeTestJSON-1316508689 tempest-FlavorsAccessNegativeTestJSON-1316508689-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:34.329519 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-8cb6c438-ca08-4a1d-9a6c-a4792b26d4b5 tempest-FlavorsAccessNegativeTestJSON-1316508689 tempest-FlavorsAccessNegativeTestJSON-1316508689-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 17 13:33:34.333410 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8cb6c438-ca08-4a1d-9a6c-a4792b26d4b5 tempest-FlavorsAccessNegativeTestJSON-1316508689 tempest-FlavorsAccessNegativeTestJSON-1316508689-project-admin] Request method failure captured: Oct 17 13:33:34.333410 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/flavors/1230960040/os-flavor-access HTTP/1.1 Oct 17 13:33:34.333410 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:33:34.333410 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:33:34.333410 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:33:34.333410 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:33:34.333410 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:33:34.333410 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:33:34.333410 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:33:34.333410 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:34.333410 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVmpgo990Aih2Ayx4gKjYmzxVkoHwIUhRy7mETAgXpQmIzzTXzfcKHGbHkYakl0k0XL8oc4Be7PstiAqyXDM_NSE7vM9YOXW_bixI9X2wxfypSG1_uIA01xxem_10mogNwMAn3zJwiR3JFvQCDmdBZ_AHKzczKB8KwoGmy8e74iiR-A Oct 17 13:33:34.333410 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:33:34.333410 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:33:34.333410 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:33:34.333410 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:33:34.333410 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:33:34.333410 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:33:34.333410 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: d988595506ce4a428349cb5563c54ac4 Oct 17 13:33:34.333410 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1316508689 Oct 17 13:33:34.333410 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member,admin Oct 17 13:33:34.333410 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member,admin Oct 17 13:33:34.334453 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d988595506ce4a428349cb5563c54ac4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d988595506ce4a428349cb5563c54ac4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d988595506ce4a428349cb5563c54ac4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d988595506ce4a428349cb5563c54ac4", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:33:34.334453 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1316508689 Oct 17 13:33:34.334453 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: d988595506ce4a428349cb5563c54ac4 Oct 17 13:33:34.334453 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1316508689 Oct 17 13:33:34.334453 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-FlavorsAccessNegativeTestJSON-1316508689-project-admin Oct 17 13:33:34.334453 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:33:34.334453 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:33:34.334453 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 010575b0b45b4ccaba55311f62151d98 Oct 17 13:33:34.334453 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1316508689-project-admin Oct 17 13:33:34.334453 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:33:34.334453 n-d-854247-14 devstack@n-api.service[127017]: exception: Access list not available for public flavors. Oct 17 13:33:34.334453 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'flavor_id': '1230960040'} Oct 17 13:33:34.335037 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:34.335037 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:34.335037 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:34.335037 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:34.335037 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:34.335037 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:34.335037 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:34.335037 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:34.335037 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 17 13:33:34.335037 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 13:33:34.335037 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 17 13:33:34.335037 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:33:34.335037 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:34.335037 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:33:34.335037 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:34.335037 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:34.335037 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:34.335037 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:33:34.335037 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:33:34.335037 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 17 13:33:34.335037 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:33:34.338756 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8cb6c438-ca08-4a1d-9a6c-a4792b26d4b5 tempest-FlavorsAccessNegativeTestJSON-1316508689 tempest-FlavorsAccessNegativeTestJSON-1316508689-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:34.343395 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8cb6c438-ca08-4a1d-9a6c-a4792b26d4b5 tempest-FlavorsAccessNegativeTestJSON-1316508689 tempest-FlavorsAccessNegativeTestJSON-1316508689-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/1230960040/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.035598 Oct 17 13:33:34.347707 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 17/38] 10.222.0.79 () {58 vars in 1209 bytes} [Mon Oct 17 13:33:34 2022] GET /compute/v2.1/flavors/1230960040/os-flavor-access => generated 91 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:33:34.357077 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c55e91ad-009d-4008-aa5c-b6d8d1259bfb tempest-FlavorsAccessNegativeTestJSON-1316508689 tempest-FlavorsAccessNegativeTestJSON-1316508689-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:34.383736 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c55e91ad-009d-4008-aa5c-b6d8d1259bfb tempest-FlavorsAccessNegativeTestJSON-1316508689 tempest-FlavorsAccessNegativeTestJSON-1316508689-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/1230960040" status: 202 len: 0 microversion: 2.1 time: 0.034621 Oct 17 13:33:34.384529 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 18/39] 10.222.0.79 () {58 vars in 1161 bytes} [Mon Oct 17 13:33:34 2022] DELETE /compute/v2.1/flavors/1230960040 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:33:34.395880 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-dd6f82af-78a7-4b20-b914-2ac250a68b25 tempest-FlavorsAccessNegativeTestJSON-1316508689 tempest-FlavorsAccessNegativeTestJSON-1316508689-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:34.438580 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-dd6f82af-78a7-4b20-b914-2ac250a68b25 tempest-FlavorsAccessNegativeTestJSON-1316508689 tempest-FlavorsAccessNegativeTestJSON-1316508689-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.048618 Oct 17 13:33:34.442208 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 19/40] 10.222.0.79 () {58 vars in 1146 bytes} [Mon Oct 17 13:33:34 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:34.460903 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-23504b90-b357-49ce-a89f-26ae3e7b6f50 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4552e3fbd4de4d2997d5db7ec500de65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e76de886880490ba8373e0d86056c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:34.474725 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-81123191-769f-490d-8193-f51822dc1317 tempest-FlavorsAccessNegativeTestJSON-1316508689 tempest-FlavorsAccessNegativeTestJSON-1316508689-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1319207347", "id": 1923979384, "os-flavor-access:is_public": "False"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:34.495858 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=11,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=12 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:33:34.499037 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-81123191-769f-490d-8193-f51822dc1317 tempest-FlavorsAccessNegativeTestJSON-1316508689 tempest-FlavorsAccessNegativeTestJSON-1316508689-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.029504 Oct 17 13:33:34.500217 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 20/41] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:33:34 2022] POST /compute/v2.1/flavors => generated 439 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:33:34.503382 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-23504b90-b357-49ce-a89f-26ae3e7b6f50 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] 10.222.0.79 "GET /compute/v2.1/servers/eb4474f8-de59-4187-8b15-ba0ec266bfa6" status: 200 len: 1242 microversion: 2.1 time: 0.203527 Oct 17 13:33:34.505677 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 22/42] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:34 2022] GET /compute/v2.1/servers/eb4474f8-de59-4187-8b15-ba0ec266bfa6 => generated 1242 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:33:34.817341 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f2d7af03-7400-4efc-847f-c0d1435e1342 tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1305394394", "id": 1566047865, "os-flavor-access:is_public": "True"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:34.839098 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f2d7af03-7400-4efc-847f-c0d1435e1342 tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.321730 Oct 17 13:33:34.839714 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 21/43] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:33:34 2022] POST /compute/v2.1/flavors => generated 430 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:33:34.854807 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8630f2f8-2d9d-44f2-bc4b-49c9ec0e9761 tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:34.857158 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-84c411de-4d29-45e3-ab36-bfeaa15437e2 tempest-FlavorsAccessNegativeTestJSON-1761218914 tempest-FlavorsAccessNegativeTestJSON-1761218914-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "fff96d958a774627ba4291f7ab7b992f"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:34.862582 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-84c411de-4d29-45e3-ab36-bfeaa15437e2 tempest-FlavorsAccessNegativeTestJSON-1761218914 tempest-FlavorsAccessNegativeTestJSON-1761218914-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'fccf08d4d00a4583899b387f8e2eb0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff96d958a774627ba4291f7ab7b992f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:34.865383 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-84c411de-4d29-45e3-ab36-bfeaa15437e2 tempest-FlavorsAccessNegativeTestJSON-1761218914 tempest-FlavorsAccessNegativeTestJSON-1761218914-project] Request method failure captured: Oct 17 13:33:34.865383 n-d-854247-14 devstack@n-api.service[127016]: request: POST /compute/v2.1/flavors/1923979384/action HTTP/1.1 Oct 17 13:33:34.865383 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:33:34.865383 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:33:34.865383 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:33:34.865383 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 67 Oct 17 13:33:34.865383 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:33:34.865383 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:33:34.865383 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:33:34.865383 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:34.865383 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVmnwh0bc3R-z_mwctUcrbW6W70oDhVqe9GTD9uugDEVlxkZgertMqv3KNFb03I7v86I5MPuOI2OnKM1h47O1p2mX3OtUdP_iORuEPU6KIDMGoR5tViTZ55VIo882ldOx7tTkWUh_lmxBYxJt0kOBYY8LH6ikeNnmavpmKz0MAx4WDc Oct 17 13:33:34.865383 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:33:34.865383 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:33:34.865383 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:33:34.865383 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:33:34.865383 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:33:34.865383 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:33:34.865383 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: fff96d958a774627ba4291f7ab7b992f Oct 17 13:33:34.865383 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1761218914 Oct 17 13:33:34.865383 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:33:34.865383 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:33:34.866518 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/fff96d958a774627ba4291f7ab7b992f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/fff96d958a774627ba4291f7ab7b992f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/fff96d958a774627ba4291f7ab7b992f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_fff96d958a774627ba4291f7ab7b992f", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:33:34.866518 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1761218914 Oct 17 13:33:34.866518 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: fff96d958a774627ba4291f7ab7b992f Oct 17 13:33:34.866518 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1761218914 Oct 17 13:33:34.866518 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-FlavorsAccessNegativeTestJSON-1761218914-project Oct 17 13:33:34.866518 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:33:34.866518 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:33:34.866518 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: fccf08d4d00a4583899b387f8e2eb0e4 Oct 17 13:33:34.866518 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1761218914-project Oct 17 13:33:34.866518 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:33:34.866518 n-d-854247-14 devstack@n-api.service[127016]: {"addTenantAccess": {"tenant": "fff96d958a774627ba4291f7ab7b992f"}} Oct 17 13:33:34.866518 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:33:34.867231 n-d-854247-14 devstack@n-api.service[127016]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 17 13:33:34.867231 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '1923979384', 'body': {'addTenantAccess': {'tenant': 'fff96d958a774627ba4291f7ab7b992f'}}} Oct 17 13:33:34.867231 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:34.867231 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:34.867231 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:34.867231 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:34.867231 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:34.867231 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:34.867231 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:34.867231 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:34.867231 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:33:34.867231 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:33:34.867231 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 17 13:33:34.867231 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 17 13:33:34.867231 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:33:34.867231 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:33:34.867231 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:33:34.867231 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:33:34.867231 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:33:34.868273 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:33:34.868273 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:33:34.868273 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:33:34.868273 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:33:34.868273 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:33:34.868273 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:33:34.868273 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:33:34.868273 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:33:34.868273 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:33:34.868273 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 17 13:33:34.868273 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:34.868273 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:34.868273 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:34.868273 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:34.868273 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:34.868273 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:34.868273 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:33:34.868273 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:33:34.868273 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 17 13:33:34.868273 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:34.869181 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-84c411de-4d29-45e3-ab36-bfeaa15437e2 tempest-FlavorsAccessNegativeTestJSON-1761218914 tempest-FlavorsAccessNegativeTestJSON-1761218914-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:34.869181 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-84c411de-4d29-45e3-ab36-bfeaa15437e2 tempest-FlavorsAccessNegativeTestJSON-1761218914 tempest-FlavorsAccessNegativeTestJSON-1761218914-project] 10.222.0.79 "POST /compute/v2.1/flavors/1923979384/action" status: 403 len: 130 microversion: 2.1 time: 0.342425 Oct 17 13:33:34.869181 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 23/44] 10.222.0.79 () {60 vars in 1200 bytes} [Mon Oct 17 13:33:34 2022] POST /compute/v2.1/flavors/1923979384/action => generated 130 bytes in 343 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:33:34.878412 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-38007bc2-e674-4d20-9b7b-629d6b8918a9 tempest-FlavorsAccessNegativeTestJSON-1316508689 tempest-FlavorsAccessNegativeTestJSON-1316508689-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:34.882555 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8630f2f8-2d9d-44f2-bc4b-49c9ec0e9761 tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/1566047865" status: 202 len: 0 microversion: 2.1 time: 0.032196 Oct 17 13:33:34.883144 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 22/45] 10.222.0.79 () {58 vars in 1161 bytes} [Mon Oct 17 13:33:34 2022] DELETE /compute/v2.1/flavors/1566047865 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:33:34.891422 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-dd5859c0-c2a2-4dc3-81e7-a311326aa943 tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:34.906035 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-38007bc2-e674-4d20-9b7b-629d6b8918a9 tempest-FlavorsAccessNegativeTestJSON-1316508689 tempest-FlavorsAccessNegativeTestJSON-1316508689-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/1923979384" status: 202 len: 0 microversion: 2.1 time: 0.031959 Oct 17 13:33:34.911370 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 24/46] 10.222.0.79 () {58 vars in 1161 bytes} [Mon Oct 17 13:33:34 2022] DELETE /compute/v2.1/flavors/1923979384 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:33:34.918580 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-66fe0399-eeb6-43dc-a357-1b4d3c9db181 tempest-FlavorsAccessNegativeTestJSON-1316508689 tempest-FlavorsAccessNegativeTestJSON-1316508689-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:34.924270 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-dd5859c0-c2a2-4dc3-81e7-a311326aa943 tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036545 Oct 17 13:33:34.924944 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 23/47] 10.222.0.79 () {58 vars in 1146 bytes} [Mon Oct 17 13:33:34 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:33:34.942929 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-66fe0399-eeb6-43dc-a357-1b4d3c9db181 tempest-FlavorsAccessNegativeTestJSON-1316508689 tempest-FlavorsAccessNegativeTestJSON-1316508689-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030178 Oct 17 13:33:34.943545 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 25/48] 10.222.0.79 () {58 vars in 1146 bytes} [Mon Oct 17 13:33:34 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:34.945959 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-adcb9512-32b8-4ac4-b672-3165c188103c tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-708573070", "id": 334340888, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:34.970119 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-adcb9512-32b8-4ac4-b672-3165c188103c tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.029221 Oct 17 13:33:34.970974 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 24/49] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:33:34 2022] POST /compute/v2.1/flavors => generated 413 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:33:34.972492 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4c79e36e-ff36-4512-90a9-4a2b0d884863 tempest-FlavorsAccessNegativeTestJSON-1316508689 tempest-FlavorsAccessNegativeTestJSON-1316508689-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2020691642", "id": 1161152602, "os-flavor-access:is_public": "False"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:34.983095 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a35029d0-a355-42b1-adb4-a42faf053ab6 tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:35.003142 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4c79e36e-ff36-4512-90a9-4a2b0d884863 tempest-FlavorsAccessNegativeTestJSON-1316508689 tempest-FlavorsAccessNegativeTestJSON-1316508689-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.037592 Oct 17 13:33:35.004300 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 26/50] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:33:34 2022] POST /compute/v2.1/flavors => generated 439 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:33:35.008009 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a35029d0-a355-42b1-adb4-a42faf053ab6 tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.028589 Oct 17 13:33:35.008641 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 25/51] 10.222.0.79 () {58 vars in 1146 bytes} [Mon Oct 17 13:33:34 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:35.022466 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-acbd408f-09a3-4612-95ea-54f78bad485f tempest-FlavorsAccessNegativeTestJSON-1316508689 tempest-FlavorsAccessNegativeTestJSON-1316508689-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "fff96d958a774627ba4291f7ab7b992f"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:35.028367 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3a09c19c-a2f2-46ac-a1c8-fa77ef973c5d tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:35.048321 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3a09c19c-a2f2-46ac-a1c8-fa77ef973c5d tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/334340888" status: 202 len: 0 microversion: 2.1 time: 0.024288 Oct 17 13:33:35.048877 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 26/52] 10.222.0.79 () {58 vars in 1158 bytes} [Mon Oct 17 13:33:35 2022] DELETE /compute/v2.1/flavors/334340888 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:33:35.056981 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7419e2e8-ecb2-4fd1-a584-066b1206dc99 tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:35.079726 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7419e2e8-ecb2-4fd1-a584-066b1206dc99 tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026267 Oct 17 13:33:35.080319 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 27/53] 10.222.0.79 () {58 vars in 1146 bytes} [Mon Oct 17 13:33:35 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:35.100420 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6bbe97b1-57d0-40f9-a1b1-cb232b9c6a07 tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1727225144", "id": 141964455, "os-flavor-access:is_public": "True"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:35.122745 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6bbe97b1-57d0-40f9-a1b1-cb232b9c6a07 tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.026387 Oct 17 13:33:35.123683 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 28/54] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:33:35 2022] POST /compute/v2.1/flavors => generated 426 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:33:35.137268 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f0d31c14-a743-4d62-9b12-be40031a3e60 tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:35.159580 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f0d31c14-a743-4d62-9b12-be40031a3e60 tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/141964455" status: 202 len: 0 microversion: 2.1 time: 0.026651 Oct 17 13:33:35.164506 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 29/55] 10.222.0.79 () {58 vars in 1158 bytes} [Mon Oct 17 13:33:35 2022] DELETE /compute/v2.1/flavors/141964455 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:33:35.170452 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1ca27cce-e11d-498c-a02e-395bc4faee67 tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:35.190211 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1ca27cce-e11d-498c-a02e-395bc4faee67 tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023452 Oct 17 13:33:35.190778 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 30/56] 10.222.0.79 () {58 vars in 1146 bytes} [Mon Oct 17 13:33:35 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:35.212240 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ad7acf8b-ace5-4527-ac9c-f8e5b5a32a53 tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-164902222", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:35.232240 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ad7acf8b-ace5-4527-ac9c-f8e5b5a32a53 tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.024316 Oct 17 13:33:35.232830 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 31/57] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:33:35 2022] POST /compute/v2.1/flavors => generated 506 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:33:35.247515 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-cc48cdb8-8d03-4b0d-b616-9489bdc7accd tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:35.272700 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-cc48cdb8-8d03-4b0d-b616-9489bdc7accd tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/0ecf79bd-8d44-49f6-bae9-f59b76a20861" status: 202 len: 0 microversion: 2.1 time: 0.030035 Oct 17 13:33:35.273461 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 32/58] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:33:35 2022] DELETE /compute/v2.1/flavors/0ecf79bd-8d44-49f6-bae9-f59b76a20861 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:33:35.283874 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a836f808-00b5-4aa8-ab7a-d8e97e5136be tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:35.308758 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a836f808-00b5-4aa8-ab7a-d8e97e5136be tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029761 Oct 17 13:33:35.311291 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 33/59] 10.222.0.79 () {58 vars in 1146 bytes} [Mon Oct 17 13:33:35 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:35.330893 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-fadd2f77-4db4-401d-989a-c88a979c14db tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-298221372", "id": "f20f77a4-977d-4053-86be-31bf9a36e648", "os-flavor-access:is_public": "True"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:35.355577 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-fadd2f77-4db4-401d-989a-c88a979c14db tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.028900 Oct 17 13:33:35.356170 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 34/60] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:33:35 2022] POST /compute/v2.1/flavors => generated 506 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:33:35.369119 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5012206e-8f28-45a1-bfc0-bd337fa47334 tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:35.388999 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5012206e-8f28-45a1-bfc0-bd337fa47334 tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/f20f77a4-977d-4053-86be-31bf9a36e648" status: 202 len: 0 microversion: 2.1 time: 0.024086 Oct 17 13:33:35.389910 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 35/61] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:33:35 2022] DELETE /compute/v2.1/flavors/f20f77a4-977d-4053-86be-31bf9a36e648 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:33:35.405316 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-45f7955d-a412-40dc-a146-670aa9ce88a8 tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:35.426263 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-45f7955d-a412-40dc-a146-670aa9ce88a8 tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026411 Oct 17 13:33:35.441129 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 36/62] 10.222.0.79 () {58 vars in 1146 bytes} [Mon Oct 17 13:33:35 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:35.448051 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5f7c8dbe-a519-4d9a-acc4-88e725ea3e2d tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2066524679", "id": 1992637714, "os-flavor-access:is_public": "True"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:35.470220 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5f7c8dbe-a519-4d9a-acc4-88e725ea3e2d tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.026388 Oct 17 13:33:35.475329 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 37/63] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:33:35 2022] POST /compute/v2.1/flavors => generated 414 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:33:35.483471 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a09ef6e5-5a1d-405d-8f0a-355be1d57753 tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:35.490646 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a09ef6e5-5a1d-405d-8f0a-355be1d57753 tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/1992637714" status: 200 len: 414 microversion: 2.1 time: 0.011207 Oct 17 13:33:35.491533 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 38/64] 10.222.0.79 () {58 vars in 1158 bytes} [Mon Oct 17 13:33:35 2022] GET /compute/v2.1/flavors/1992637714 => generated 414 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:33:35.620196 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-acbd408f-09a3-4612-95ea-54f78bad485f tempest-FlavorsAccessNegativeTestJSON-1316508689 tempest-FlavorsAccessNegativeTestJSON-1316508689-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors/1161152602/action" status: 200 len: 97 microversion: 2.1 time: 0.602773 Oct 17 13:33:35.621171 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 27/65] 10.222.0.79 () {60 vars in 1200 bytes} [Mon Oct 17 13:33:35 2022] POST /compute/v2.1/flavors/1161152602/action => generated 97 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 17 13:33:35.633275 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-afb3088d-5e7e-49c0-a165-28174f011dd2 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:35.634088 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-afb3088d-5e7e-49c0-a165-28174f011dd2 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] [instance: eb4474f8-de59-4187-8b15-ba0ec266bfa6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:35.698016 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-afb3088d-5e7e-49c0-a165-28174f011dd2 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4552e3fbd4de4d2997d5db7ec500de65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e76de886880490ba8373e0d86056c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:35.706714 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-afb3088d-5e7e-49c0-a165-28174f011dd2 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] 10.222.0.79 "GET /compute/v2.1/servers/eb4474f8-de59-4187-8b15-ba0ec266bfa6" status: 200 len: 1242 microversion: 2.1 time: 0.083420 Oct 17 13:33:35.706813 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 28/66] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:35 2022] GET /compute/v2.1/servers/eb4474f8-de59-4187-8b15-ba0ec266bfa6 => generated 1242 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:35.712131 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7eaf47b0-2059-444f-9cbb-67857ce4161d tempest-FlavorsAccessNegativeTestJSON-1761218914 tempest-FlavorsAccessNegativeTestJSON-1761218914-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "fff96d958a774627ba4291f7ab7b992f"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:35.718410 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7eaf47b0-2059-444f-9cbb-67857ce4161d tempest-FlavorsAccessNegativeTestJSON-1761218914 tempest-FlavorsAccessNegativeTestJSON-1761218914-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'fccf08d4d00a4583899b387f8e2eb0e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff96d958a774627ba4291f7ab7b992f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:35.720265 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7eaf47b0-2059-444f-9cbb-67857ce4161d tempest-FlavorsAccessNegativeTestJSON-1761218914 tempest-FlavorsAccessNegativeTestJSON-1761218914-project] Request method failure captured: Oct 17 13:33:35.720265 n-d-854247-14 devstack@n-api.service[127016]: request: POST /compute/v2.1/flavors/1161152602/action HTTP/1.1 Oct 17 13:33:35.720265 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:33:35.720265 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:33:35.720265 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:33:35.720265 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 70 Oct 17 13:33:35.720265 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:33:35.720265 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:33:35.720265 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:33:35.720265 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:35.720265 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVmnwh0bc3R-z_mwctUcrbW6W70oDhVqe9GTD9uugDEVlxkZgertMqv3KNFb03I7v86I5MPuOI2OnKM1h47O1p2mX3OtUdP_iORuEPU6KIDMGoR5tViTZ55VIo882ldOx7tTkWUh_lmxBYxJt0kOBYY8LH6ikeNnmavpmKz0MAx4WDc Oct 17 13:33:35.720265 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:33:35.720265 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:33:35.720265 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:33:35.720265 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:33:35.720265 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:33:35.720265 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:33:35.720265 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: fff96d958a774627ba4291f7ab7b992f Oct 17 13:33:35.720265 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1761218914 Oct 17 13:33:35.720265 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:33:35.720265 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:33:35.721323 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/fff96d958a774627ba4291f7ab7b992f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/fff96d958a774627ba4291f7ab7b992f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/fff96d958a774627ba4291f7ab7b992f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_fff96d958a774627ba4291f7ab7b992f", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:33:35.721323 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1761218914 Oct 17 13:33:35.721323 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: fff96d958a774627ba4291f7ab7b992f Oct 17 13:33:35.721323 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1761218914 Oct 17 13:33:35.721323 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-FlavorsAccessNegativeTestJSON-1761218914-project Oct 17 13:33:35.721323 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:33:35.721323 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:33:35.721323 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: fccf08d4d00a4583899b387f8e2eb0e4 Oct 17 13:33:35.721323 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1761218914-project Oct 17 13:33:35.721323 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:33:35.721323 n-d-854247-14 devstack@n-api.service[127016]: {"removeTenantAccess": {"tenant": "fff96d958a774627ba4291f7ab7b992f"}} Oct 17 13:33:35.721323 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:33:35.721997 n-d-854247-14 devstack@n-api.service[127016]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 17 13:33:35.721997 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '1161152602', 'body': {'removeTenantAccess': {'tenant': 'fff96d958a774627ba4291f7ab7b992f'}}} Oct 17 13:33:35.721997 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:35.721997 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:35.721997 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:35.721997 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:35.721997 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:35.721997 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:35.721997 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:35.721997 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:35.721997 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:33:35.721997 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:33:35.721997 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 17 13:33:35.721997 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi context.can( Oct 17 13:33:35.721997 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:33:35.721997 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:33:35.721997 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:33:35.721997 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:33:35.721997 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:33:35.721997 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:33:35.722919 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:33:35.722919 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:33:35.722919 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:33:35.722919 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:33:35.722919 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:33:35.722919 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:33:35.722919 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:33:35.722919 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:33:35.722919 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 17 13:33:35.722919 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:35.722919 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:35.722919 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:35.722919 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:35.722919 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:35.722919 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:35.722919 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:33:35.722919 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:33:35.722919 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 17 13:33:35.722919 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:35.723925 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7eaf47b0-2059-444f-9cbb-67857ce4161d tempest-FlavorsAccessNegativeTestJSON-1761218914 tempest-FlavorsAccessNegativeTestJSON-1761218914-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:35.723925 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7eaf47b0-2059-444f-9cbb-67857ce4161d tempest-FlavorsAccessNegativeTestJSON-1761218914 tempest-FlavorsAccessNegativeTestJSON-1761218914-project] 10.222.0.79 "POST /compute/v2.1/flavors/1161152602/action" status: 403 len: 133 microversion: 2.1 time: 0.013436 Oct 17 13:33:35.725681 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 29/67] 10.222.0.79 () {60 vars in 1200 bytes} [Mon Oct 17 13:33:35 2022] POST /compute/v2.1/flavors/1161152602/action => generated 133 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:33:35.730958 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-945186bf-4b20-4cf5-a920-8ebbffde3d81 tempest-FlavorsAccessNegativeTestJSON-1316508689 tempest-FlavorsAccessNegativeTestJSON-1316508689-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "fff96d958a774627ba4291f7ab7b992f"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:35.834508 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f1ca181b-8dc9-48d0-9719-b256c515ac93 tempest-FlavorsAdminTestJSON-686564099 tempest-FlavorsAdminTestJSON-686564099-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:35.879758 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f1ca181b-8dc9-48d0-9719-b256c515ac93 tempest-FlavorsAdminTestJSON-686564099 tempest-FlavorsAdminTestJSON-686564099-project] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.379745 Oct 17 13:33:35.880811 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 39/68] 10.222.0.79 () {58 vars in 1146 bytes} [Mon Oct 17 13:33:35 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:35.899290 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bff4450e-2ef9-4310-af50-fca627654238 tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:35.921201 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-bff4450e-2ef9-4310-af50-fca627654238 tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/1992637714" status: 202 len: 0 microversion: 2.1 time: 0.025880 Oct 17 13:33:35.922316 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 40/69] 10.222.0.79 () {58 vars in 1161 bytes} [Mon Oct 17 13:33:35 2022] DELETE /compute/v2.1/flavors/1992637714 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:33:35.930620 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6699a3ee-1651-49c2-b080-405f35e995ef tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:35.955535 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6699a3ee-1651-49c2-b080-405f35e995ef tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028876 Oct 17 13:33:35.964700 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 41/70] 10.222.0.79 () {58 vars in 1146 bytes} [Mon Oct 17 13:33:35 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:35.976367 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6a2457de-d1f7-42a9-b6e3-829d6e3a5afa tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1150054660", "id": 274365965, "os-flavor-access:is_public": "False"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:36.000333 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6a2457de-d1f7-42a9-b6e3-829d6e3a5afa tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.027605 Oct 17 13:33:36.008075 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 42/71] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:33:35 2022] POST /compute/v2.1/flavors => generated 427 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:33:36.017063 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-13489dd9-9df7-4cc4-823d-13c5780d2412 tempest-FlavorsAdminTestJSON-686564099 tempest-FlavorsAdminTestJSON-686564099-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "274365965"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:36.039453 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-13489dd9-9df7-4cc4-823d-13c5780d2412 tempest-FlavorsAdminTestJSON-686564099 tempest-FlavorsAdminTestJSON-686564099-project] HTTP exception thrown: Flavor 274365965 could not be found. Oct 17 13:33:36.042676 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-13489dd9-9df7-4cc4-823d-13c5780d2412 tempest-FlavorsAdminTestJSON-686564099 tempest-FlavorsAdminTestJSON-686564099-project] Request method failure captured: Oct 17 13:33:36.042676 n-d-854247-14 devstack@n-api.service[127017]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:33:36.042676 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:33:36.042676 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:33:36.042676 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:33:36.042676 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 106 Oct 17 13:33:36.042676 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:33:36.042676 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:33:36.042676 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:33:36.042676 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:36.042676 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVmrkzGVJP_TmfR_H4KX2SJ1Iy_09SbgspI8QBqt6crwG3tn9GLZC_t5T9KSbG7YVyvBjy9WQboe1qXYWiY4o9YlBqMNQQn2Fm8yZLVyp6nVAjZO09_j5_ff7L1LhpoLHddkpGxsRDN5QWSwPkY7-l-IX_odwLUl-okaU37hivwkEwk Oct 17 13:33:36.042676 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:33:36.042676 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:33:36.042676 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:33:36.042676 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:33:36.042676 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:33:36.042676 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:33:36.042676 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: d5d03c9c628948e6bbd19a97b125d29a Oct 17 13:33:36.042676 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-FlavorsAdminTestJSON-686564099 Oct 17 13:33:36.042676 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:33:36.042676 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:33:36.044668 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d5d03c9c628948e6bbd19a97b125d29a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d5d03c9c628948e6bbd19a97b125d29a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d5d03c9c628948e6bbd19a97b125d29a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d5d03c9c628948e6bbd19a97b125d29a", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:33:36.044668 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-FlavorsAdminTestJSON-686564099 Oct 17 13:33:36.044668 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: d5d03c9c628948e6bbd19a97b125d29a Oct 17 13:33:36.044668 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-686564099 Oct 17 13:33:36.044668 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-FlavorsAdminTestJSON-686564099-project Oct 17 13:33:36.044668 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:33:36.044668 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:33:36.044668 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: ed93601ef1ae46d6979739c5d1994d3e Oct 17 13:33:36.044668 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-FlavorsAdminTestJSON-686564099-project Oct 17 13:33:36.044668 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 13:33:36.044668 n-d-854247-14 devstack@n-api.service[127017]: {"server": {"name": "test", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "274365965"}} Oct 17 13:33:36.044668 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:33:36.044668 n-d-854247-14 devstack@n-api.service[127017]: exception: Flavor 274365965 could not be found. Oct 17 13:33:36.045758 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '0743b21b-a6ff-4d02-897c-eabb68c3ba07', 'flavorRef': '274365965'}}} Oct 17 13:33:36.045758 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:36.045758 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:36.045758 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 17 13:33:36.045758 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 17 13:33:36.045758 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 13:33:36.045758 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 13:33:36.045758 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:33:36.045758 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:33:36.045758 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 13:33:36.045758 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 13:33:36.045758 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 13:33:36.045758 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:36.045758 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 13:33:36.045758 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 13:33:36.045758 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 274365965 could not be found. Oct 17 13:33:36.045758 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:33:36.045758 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:36.045758 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:33:36.045758 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:36.047155 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:36.047155 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:36.047155 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:36.047155 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:36.047155 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:36.047155 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:36.047155 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:33:36.047155 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:33:36.047155 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:33:36.047155 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:33:36.047155 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:33:36.047155 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:33:36.047155 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 17 13:33:36.047155 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 17 13:33:36.047155 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 17 13:33:36.047155 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 274365965 could not be found. Oct 17 13:33:36.047155 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:33:36.047155 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:36.047155 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:33:36.047155 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:36.047155 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:36.048507 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:36.048507 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:33:36.048507 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:33:36.048507 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 274365965 could not be found. Oct 17 13:33:36.048507 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:33:36.048507 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-13489dd9-9df7-4cc4-823d-13c5780d2412 tempest-FlavorsAdminTestJSON-686564099 tempest-FlavorsAdminTestJSON-686564099-project] Returning 400 to user: Flavor 274365965 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:36.048507 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-13489dd9-9df7-4cc4-823d-13c5780d2412 tempest-FlavorsAdminTestJSON-686564099 tempest-FlavorsAdminTestJSON-686564099-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.033952 Oct 17 13:33:36.048507 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 43/72] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:33:36 2022] POST /compute/v2.1/servers => generated 80 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 17 13:33:36.053720 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6f6788c1-b9d7-46c5-a588-202b18ba4b44 tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:36.073573 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6f6788c1-b9d7-46c5-a588-202b18ba4b44 tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/274365965" status: 202 len: 0 microversion: 2.1 time: 0.023075 Oct 17 13:33:36.074653 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 44/73] 10.222.0.79 () {58 vars in 1158 bytes} [Mon Oct 17 13:33:36 2022] DELETE /compute/v2.1/flavors/274365965 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:33:36.083186 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-41c08d13-e58e-4e8f-91b6-253bee140c5d tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:36.091787 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=7,nova_api:DELETE=21 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:33:36.111237 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-41c08d13-e58e-4e8f-91b6-253bee140c5d tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029024 Oct 17 13:33:36.111237 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 45/74] 10.222.0.79 () {58 vars in 1146 bytes} [Mon Oct 17 13:33:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:36.131721 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e38fed14-b5ea-457d-8588-5858defa3287 tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-441582935", "id": 407887545, "os-flavor-access:is_public": "False"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:36.156495 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e38fed14-b5ea-457d-8588-5858defa3287 tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.029532 Oct 17 13:33:36.157527 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 46/75] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:33:36 2022] POST /compute/v2.1/flavors => generated 411 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:33:36.169977 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f2c5c007-8dee-4334-836e-a74164f66592 tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1852409371", "id": 1826110081, "os-flavor-access:is_public": "True"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:36.194271 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f2c5c007-8dee-4334-836e-a74164f66592 tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.028527 Oct 17 13:33:36.195050 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 47/76] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:33:36 2022] POST /compute/v2.1/flavors => generated 414 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:33:36.208672 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c97f1153-0658-4ab8-b018-8fc437d529e5 tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:36.229067 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c97f1153-0658-4ab8-b018-8fc437d529e5 tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 843 microversion: 2.1 time: 0.025135 Oct 17 13:33:36.230262 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 48/77] 10.222.0.79 () {58 vars in 1169 bytes} [Mon Oct 17 13:33:36 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 843 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:33:36.245455 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0634b214-820b-4573-b08c-1ccf614603a0 tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:36.264324 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0634b214-820b-4573-b08c-1ccf614603a0 tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 843 microversion: 2.1 time: 0.024078 Oct 17 13:33:36.265903 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 49/78] 10.222.0.79 () {58 vars in 1177 bytes} [Mon Oct 17 13:33:36 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 843 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:33:36.278753 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a2805468-07f4-47bb-b173-b0b764e1653b tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:36.290912 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a2805468-07f4-47bb-b173-b0b764e1653b tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 843 microversion: 2.1 time: 0.016004 Oct 17 13:33:36.291752 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 50/79] 10.222.0.79 () {58 vars in 1171 bytes} [Mon Oct 17 13:33:36 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 843 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:33:36.306373 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0cf6dd85-bf7c-46b6-b0b0-080438d1f7da tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:36.318124 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0cf6dd85-bf7c-46b6-b0b0-080438d1f7da tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 843 microversion: 2.1 time: 0.016071 Oct 17 13:33:36.318939 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 51/80] 10.222.0.79 () {58 vars in 1169 bytes} [Mon Oct 17 13:33:36 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 843 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:33:36.334720 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-450ca50a-b54e-4584-ba03-5682616ecc38 tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:36.356752 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-450ca50a-b54e-4584-ba03-5682616ecc38 tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5395 microversion: 2.1 time: 0.026210 Oct 17 13:33:36.357684 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 52/81] 10.222.0.79 () {58 vars in 1169 bytes} [Mon Oct 17 13:33:36 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5395 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:36.377309 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-fc45d590-f636-4473-951a-bf1aaff34171 tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:36.403998 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-fc45d590-f636-4473-951a-bf1aaff34171 tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5395 microversion: 2.1 time: 0.031166 Oct 17 13:33:36.404777 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 53/82] 10.222.0.79 () {58 vars in 1175 bytes} [Mon Oct 17 13:33:36 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5395 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:33:36.426047 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5f1c8171-25fa-402b-8606-aa2a5741ec9e tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:36.452573 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5f1c8171-25fa-402b-8606-aa2a5741ec9e tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5395 microversion: 2.1 time: 0.031761 Oct 17 13:33:36.453266 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 54/83] 10.222.0.79 () {58 vars in 1173 bytes} [Mon Oct 17 13:33:36 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5395 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:33:36.457665 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-945186bf-4b20-4cf5-a920-8ebbffde3d81 tempest-FlavorsAccessNegativeTestJSON-1316508689 tempest-FlavorsAccessNegativeTestJSON-1316508689-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors/1161152602/action" status: 200 len: 21 microversion: 2.1 time: 0.730685 Oct 17 13:33:36.458612 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 30/84] 10.222.0.79 () {60 vars in 1200 bytes} [Mon Oct 17 13:33:35 2022] POST /compute/v2.1/flavors/1161152602/action => generated 21 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:33:36.471748 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-45aca33b-ccb7-45f6-9a33-c0069a1f346b tempest-FlavorsAccessNegativeTestJSON-1316508689 tempest-FlavorsAccessNegativeTestJSON-1316508689-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:36.478857 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a17bf002-238a-4373-b4c0-ff9c3970c069 tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:36.495625 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-45aca33b-ccb7-45f6-9a33-c0069a1f346b tempest-FlavorsAccessNegativeTestJSON-1316508689 tempest-FlavorsAccessNegativeTestJSON-1316508689-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/1161152602" status: 202 len: 0 microversion: 2.1 time: 0.030821 Oct 17 13:33:36.496686 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 55/85] 10.222.0.79 () {58 vars in 1161 bytes} [Mon Oct 17 13:33:36 2022] DELETE /compute/v2.1/flavors/1161152602 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:33:36.512368 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1635c1d0-0fa9-4c4a-99c5-c746f6ac05a9 tempest-FlavorsAccessNegativeTestJSON-1316508689 tempest-FlavorsAccessNegativeTestJSON-1316508689-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:36.518038 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a17bf002-238a-4373-b4c0-ff9c3970c069 tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5395 microversion: 2.1 time: 0.045686 Oct 17 13:33:36.519243 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 31/86] 10.222.0.79 () {58 vars in 1169 bytes} [Mon Oct 17 13:33:36 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5395 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:36.538013 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2909fc9f-5a23-4965-83cf-204626994b72 tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:36.551427 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1635c1d0-0fa9-4c4a-99c5-c746f6ac05a9 tempest-FlavorsAccessNegativeTestJSON-1316508689 tempest-FlavorsAccessNegativeTestJSON-1316508689-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.050043 Oct 17 13:33:36.552583 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 56/87] 10.222.0.79 () {58 vars in 1146 bytes} [Mon Oct 17 13:33:36 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:36.569501 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2909fc9f-5a23-4965-83cf-204626994b72 tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/1826110081" status: 202 len: 0 microversion: 2.1 time: 0.035884 Oct 17 13:33:36.570743 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 32/88] 10.222.0.79 () {58 vars in 1161 bytes} [Mon Oct 17 13:33:36 2022] DELETE /compute/v2.1/flavors/1826110081 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:33:36.585191 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-05bef5fc-063d-4442-bbfc-41937cbae6f6 tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:36.604664 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-22f7cc8b-2f4c-432e-895d-88b28552225d tempest-FlavorsAccessNegativeTestJSON-1316508689 tempest-FlavorsAccessNegativeTestJSON-1316508689-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-935792767", "id": 1870500750, "os-flavor-access:is_public": "False"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:36.624661 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-05bef5fc-063d-4442-bbfc-41937cbae6f6 tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.048684 Oct 17 13:33:36.625904 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 57/89] 10.222.0.79 () {58 vars in 1146 bytes} [Mon Oct 17 13:33:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:36.647841 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-22f7cc8b-2f4c-432e-895d-88b28552225d tempest-FlavorsAccessNegativeTestJSON-1316508689 tempest-FlavorsAccessNegativeTestJSON-1316508689-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.052988 Oct 17 13:33:36.649401 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-46f3d566-8558-416e-b695-b05f045cc7f8 tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:36.650595 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 33/90] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:33:36 2022] POST /compute/v2.1/flavors => generated 438 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:33:36.662985 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b44e09ac-4b6a-4563-896b-6548a02cf0af tempest-FlavorsAccessNegativeTestJSON-1316508689 tempest-FlavorsAccessNegativeTestJSON-1316508689-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "ef3ee5d8d72348449a78aea290fe268f"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:36.670378 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-46f3d566-8558-416e-b695-b05f045cc7f8 tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/407887545" status: 202 len: 0 microversion: 2.1 time: 0.025777 Oct 17 13:33:36.671252 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 58/91] 10.222.0.79 () {58 vars in 1158 bytes} [Mon Oct 17 13:33:36 2022] DELETE /compute/v2.1/flavors/407887545 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:33:36.680822 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7b4c7a8f-afb8-44ef-bc04-a671a2126e18 tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:36.718012 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7b4c7a8f-afb8-44ef-bc04-a671a2126e18 tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.042609 Oct 17 13:33:36.731276 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 59/92] 10.222.0.79 () {58 vars in 1146 bytes} [Mon Oct 17 13:33:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:33:36.739526 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a7a92a11-d7d1-45b5-8f29-52e0388a048b tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:36.741504 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a7a92a11-d7d1-45b5-8f29-52e0388a048b tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] [instance: eb4474f8-de59-4187-8b15-ba0ec266bfa6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:36.757044 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a7a92a11-d7d1-45b5-8f29-52e0388a048b tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:36.757540 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a7a92a11-d7d1-45b5-8f29-52e0388a048b tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:36.757981 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a7a92a11-d7d1-45b5-8f29-52e0388a048b tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:36.758686 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a7a92a11-d7d1-45b5-8f29-52e0388a048b tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:36.759138 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a7a92a11-d7d1-45b5-8f29-52e0388a048b tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:36.759633 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a7a92a11-d7d1-45b5-8f29-52e0388a048b tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:37.296655 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-b44e09ac-4b6a-4563-896b-6548a02cf0af tempest-FlavorsAccessNegativeTestJSON-1316508689 tempest-FlavorsAccessNegativeTestJSON-1316508689-project-admin] HTTP exception thrown: Flavor access not found for 30 / ef3ee5d8d72348449a78aea290fe268f combination. Oct 17 13:33:37.299913 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b44e09ac-4b6a-4563-896b-6548a02cf0af tempest-FlavorsAccessNegativeTestJSON-1316508689 tempest-FlavorsAccessNegativeTestJSON-1316508689-project-admin] Request method failure captured: Oct 17 13:33:37.299913 n-d-854247-14 devstack@n-api.service[127016]: request: POST /compute/v2.1/flavors/1870500750/action HTTP/1.1 Oct 17 13:33:37.299913 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:33:37.299913 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:33:37.299913 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:33:37.299913 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 70 Oct 17 13:33:37.299913 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:33:37.299913 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:33:37.299913 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:33:37.299913 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:37.299913 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVmpgo990Aih2Ayx4gKjYmzxVkoHwIUhRy7mETAgXpQmIzzTXzfcKHGbHkYakl0k0XL8oc4Be7PstiAqyXDM_NSE7vM9YOXW_bixI9X2wxfypSG1_uIA01xxem_10mogNwMAn3zJwiR3JFvQCDmdBZ_AHKzczKB8KwoGmy8e74iiR-A Oct 17 13:33:37.299913 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:33:37.299913 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:33:37.299913 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:33:37.299913 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:33:37.299913 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:33:37.299913 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:33:37.299913 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: d988595506ce4a428349cb5563c54ac4 Oct 17 13:33:37.299913 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1316508689 Oct 17 13:33:37.299913 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member,admin Oct 17 13:33:37.299913 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member,admin Oct 17 13:33:37.301221 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d988595506ce4a428349cb5563c54ac4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d988595506ce4a428349cb5563c54ac4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d988595506ce4a428349cb5563c54ac4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d988595506ce4a428349cb5563c54ac4", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:33:37.301221 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1316508689 Oct 17 13:33:37.301221 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: d988595506ce4a428349cb5563c54ac4 Oct 17 13:33:37.301221 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1316508689 Oct 17 13:33:37.301221 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-FlavorsAccessNegativeTestJSON-1316508689-project-admin Oct 17 13:33:37.301221 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:33:37.301221 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:33:37.301221 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 010575b0b45b4ccaba55311f62151d98 Oct 17 13:33:37.301221 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1316508689-project-admin Oct 17 13:33:37.301221 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:33:37.301221 n-d-854247-14 devstack@n-api.service[127016]: {"removeTenantAccess": {"tenant": "ef3ee5d8d72348449a78aea290fe268f"}} Oct 17 13:33:37.301221 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:33:37.301922 n-d-854247-14 devstack@n-api.service[127016]: exception: Flavor access not found for 30 / ef3ee5d8d72348449a78aea290fe268f combination. Oct 17 13:33:37.301922 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '1870500750', 'body': {'removeTenantAccess': {'tenant': 'ef3ee5d8d72348449a78aea290fe268f'}}} Oct 17 13:33:37.301922 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:37.301922 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:37.301922 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 17 13:33:37.301922 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 17 13:33:37.301922 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 17 13:33:37.301922 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 17 13:33:37.301922 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 17 13:33:37.301922 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 17 13:33:37.301922 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 17 13:33:37.301922 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 17 13:33:37.301922 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 17 13:33:37.301922 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 17 13:33:37.301922 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 13:33:37.301922 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 13:33:37.301922 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 17 13:33:37.301922 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 17 13:33:37.303312 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 30 / ef3ee5d8d72348449a78aea290fe268f combination. Oct 17 13:33:37.303312 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:37.303312 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:37.303312 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:37.303312 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:37.303312 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:37.303312 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:37.303312 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:37.303312 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:37.303312 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:37.303312 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:37.303312 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:33:37.303312 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:33:37.303312 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 17 13:33:37.303312 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:33:37.303312 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 30 / ef3ee5d8d72348449a78aea290fe268f combination. Oct 17 13:33:37.303312 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:37.303312 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:37.303312 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:37.303312 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:37.304544 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:37.304544 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:37.304544 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:33:37.304544 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:33:37.304544 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 30 / ef3ee5d8d72348449a78aea290fe268f combination. Oct 17 13:33:37.304544 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:37.305814 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b44e09ac-4b6a-4563-896b-6548a02cf0af tempest-FlavorsAccessNegativeTestJSON-1316508689 tempest-FlavorsAccessNegativeTestJSON-1316508689-project-admin] Returning 404 to user: Flavor access not found for 30 / ef3ee5d8d72348449a78aea290fe268f combination. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:37.306840 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b44e09ac-4b6a-4563-896b-6548a02cf0af tempest-FlavorsAccessNegativeTestJSON-1316508689 tempest-FlavorsAccessNegativeTestJSON-1316508689-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors/1870500750/action" status: 404 len: 124 microversion: 2.1 time: 0.647745 Oct 17 13:33:37.307624 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 34/93] 10.222.0.79 () {60 vars in 1200 bytes} [Mon Oct 17 13:33:36 2022] POST /compute/v2.1/flavors/1870500750/action => generated 124 bytes in 649 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:33:37.320394 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-51a1b00f-2799-401f-99ab-2c017a67f904 tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1778490906", "id": 281926380, "os-flavor-access:is_public": "False"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:37.351591 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-51a1b00f-2799-401f-99ab-2c017a67f904 tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.034954 Oct 17 13:33:37.363977 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 35/94] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:33:37 2022] POST /compute/v2.1/flavors => generated 412 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:33:37.368804 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f16ae2e2-f7c7-4d31-9b9c-83d11ddf7e0a tempest-FlavorsAccessNegativeTestJSON-1316508689 tempest-FlavorsAccessNegativeTestJSON-1316508689-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:37.397255 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f16ae2e2-f7c7-4d31-9b9c-83d11ddf7e0a tempest-FlavorsAccessNegativeTestJSON-1316508689 tempest-FlavorsAccessNegativeTestJSON-1316508689-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/1870500750" status: 202 len: 0 microversion: 2.1 time: 0.031949 Oct 17 13:33:37.397842 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 36/95] 10.222.0.79 () {58 vars in 1161 bytes} [Mon Oct 17 13:33:37 2022] DELETE /compute/v2.1/flavors/1870500750 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:33:37.408341 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-86402f2b-0ac5-4827-aa5b-29183ce46cfe tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:37.434759 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-86402f2b-0ac5-4827-aa5b-29183ce46cfe tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035697 Oct 17 13:33:37.435765 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 37/96] 10.222.0.79 () {58 vars in 1146 bytes} [Mon Oct 17 13:33:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:37.441102 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-15807c5b-ade2-4bf2-883e-ea3cd12cc2d5 tempest-FlavorsAccessNegativeTestJSON-1316508689 tempest-FlavorsAccessNegativeTestJSON-1316508689-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:37.466163 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-15807c5b-ade2-4bf2-883e-ea3cd12cc2d5 tempest-FlavorsAccessNegativeTestJSON-1316508689 tempest-FlavorsAccessNegativeTestJSON-1316508689-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029018 Oct 17 13:33:37.468593 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 38/97] 10.222.0.79 () {58 vars in 1146 bytes} [Mon Oct 17 13:33:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:37.473413 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2f2f74b0-a511-4d21-8656-fbf726528a7f tempest-FlavorsAdminTestJSON-686564099 tempest-FlavorsAdminTestJSON-686564099-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:37.506852 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2f2f74b0-a511-4d21-8656-fbf726528a7f tempest-FlavorsAdminTestJSON-686564099 tempest-FlavorsAdminTestJSON-686564099-project] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036894 Oct 17 13:33:37.507914 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 39/98] 10.222.0.79 () {58 vars in 1146 bytes} [Mon Oct 17 13:33:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:37.525362 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-508b3136-8d65-4810-9171-10889b3f03b2 tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:37.544820 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-508b3136-8d65-4810-9171-10889b3f03b2 tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/281926380" status: 202 len: 0 microversion: 2.1 time: 0.022981 Oct 17 13:33:37.547796 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 40/99] 10.222.0.79 () {58 vars in 1158 bytes} [Mon Oct 17 13:33:37 2022] DELETE /compute/v2.1/flavors/281926380 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:33:37.558575 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-dc1175d2-019b-4c0f-b1fc-6963e8a4a058 tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:37.587846 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-dc1175d2-019b-4c0f-b1fc-6963e8a4a058 tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036990 Oct 17 13:33:37.589499 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 41/100] 10.222.0.79 () {58 vars in 1146 bytes} [Mon Oct 17 13:33:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:37.626039 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2e73ab34-c1a4-48b9-b936-e0d6ad9d1c70 tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1409314792", "id": 301887845, "os-flavor-access:is_public": "True"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:37.669714 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2e73ab34-c1a4-48b9-b936-e0d6ad9d1c70 tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.055594 Oct 17 13:33:37.670762 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 42/101] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:33:37 2022] POST /compute/v2.1/flavors => generated 411 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:33:37.693213 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4a7e4f18-4419-47c6-8215-496c1ccc9c69 tempest-FlavorsAdminTestJSON-686564099 tempest-FlavorsAdminTestJSON-686564099-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:37.715230 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4a7e4f18-4419-47c6-8215-496c1ccc9c69 tempest-FlavorsAdminTestJSON-686564099 tempest-FlavorsAdminTestJSON-686564099-project] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.036202 Oct 17 13:33:37.728207 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 43/102] 10.222.0.79 () {58 vars in 1146 bytes} [Mon Oct 17 13:33:37 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:37.736159 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8f3fa235-aa33-4f5c-97e7-4e39dbb60f2a tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:37.778596 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8f3fa235-aa33-4f5c-97e7-4e39dbb60f2a tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/301887845" status: 202 len: 0 microversion: 2.1 time: 0.046602 Oct 17 13:33:37.784846 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 44/103] 10.222.0.79 () {58 vars in 1158 bytes} [Mon Oct 17 13:33:37 2022] DELETE /compute/v2.1/flavors/301887845 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:33:37.798582 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-789724fc-a21c-40d4-8628-efd92467a8e2 tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:37.859601 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-789724fc-a21c-40d4-8628-efd92467a8e2 tempest-FlavorsAdminTestJSON-1948535766 tempest-FlavorsAdminTestJSON-1948535766-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.073479 Oct 17 13:33:37.860987 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 45/104] 10.222.0.79 () {58 vars in 1146 bytes} [Mon Oct 17 13:33:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:38.481921 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a7a92a11-d7d1-45b5-8f29-52e0388a048b tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4552e3fbd4de4d2997d5db7ec500de65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e76de886880490ba8373e0d86056c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:38.508754 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a7a92a11-d7d1-45b5-8f29-52e0388a048b tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] 10.222.0.79 "GET /compute/v2.1/servers/eb4474f8-de59-4187-8b15-ba0ec266bfa6" status: 200 len: 1290 microversion: 2.1 time: 1.779508 Oct 17 13:33:38.509518 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 60/105] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:36 2022] GET /compute/v2.1/servers/eb4474f8-de59-4187-8b15-ba0ec266bfa6 => generated 1290 bytes in 1781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:39.097358 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8049f468-6cdb-4715-b7e7-e685e0220fac tempest-FlavorsAccessTestJSON-661821375 tempest-FlavorsAccessTestJSON-661821375-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1322422024", "id": 240469815, "os-flavor-access:is_public": "False"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:39.146274 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8049f468-6cdb-4715-b7e7-e685e0220fac tempest-FlavorsAccessTestJSON-661821375 tempest-FlavorsAccessTestJSON-661821375-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.646509 Oct 17 13:33:39.147730 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 46/106] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:33:38 2022] POST /compute/v2.1/flavors => generated 428 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:33:39.167409 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-548db08c-ec88-4339-a55e-6f33b467b1ce tempest-FlavorsAccessTestJSON-661821375 tempest-FlavorsAccessTestJSON-661821375-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "bb9903f123c3426399b0ade21444e21d"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:39.532208 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2b2cb903-3741-4ecf-8bb9-a0800b66886f tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:39.532829 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2b2cb903-3741-4ecf-8bb9-a0800b66886f tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] [instance: eb4474f8-de59-4187-8b15-ba0ec266bfa6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:39.554276 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2b2cb903-3741-4ecf-8bb9-a0800b66886f tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:39.554874 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2b2cb903-3741-4ecf-8bb9-a0800b66886f tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:39.555364 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2b2cb903-3741-4ecf-8bb9-a0800b66886f tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:39.556105 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2b2cb903-3741-4ecf-8bb9-a0800b66886f tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:39.564785 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2b2cb903-3741-4ecf-8bb9-a0800b66886f tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:39.565238 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2b2cb903-3741-4ecf-8bb9-a0800b66886f tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:40.685491 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:33:40.851906 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2b2cb903-3741-4ecf-8bb9-a0800b66886f tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4552e3fbd4de4d2997d5db7ec500de65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e76de886880490ba8373e0d86056c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:40.884572 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2b2cb903-3741-4ecf-8bb9-a0800b66886f tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] 10.222.0.79 "GET /compute/v2.1/servers/eb4474f8-de59-4187-8b15-ba0ec266bfa6" status: 200 len: 1338 microversion: 2.1 time: 1.356219 Oct 17 13:33:40.888875 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 47/107] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:39 2022] GET /compute/v2.1/servers/eb4474f8-de59-4187-8b15-ba0ec266bfa6 => generated 1338 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:33:40.891022 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2b2cb903-3741-4ecf-8bb9-a0800b66886f tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:40.892580 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2b2cb903-3741-4ecf-8bb9-a0800b66886f tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] 10.222.0.79 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001437 Oct 17 13:33:40.893357 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 48/108] 10.222.0.79 () {56 vars in 886 bytes} [Mon Oct 17 13:33:40 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 17 13:33:41.090690 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-548db08c-ec88-4339-a55e-6f33b467b1ce tempest-FlavorsAccessTestJSON-661821375 tempest-FlavorsAccessTestJSON-661821375-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors/240469815/action" status: 200 len: 96 microversion: 2.1 time: 1.929094 Oct 17 13:33:41.120463 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 61/109] 10.222.0.79 () {60 vars in 1197 bytes} [Mon Oct 17 13:33:39 2022] POST /compute/v2.1/flavors/240469815/action => generated 96 bytes in 1960 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:33:42.217364 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-41ce7909-a26a-48ba-aa3b-da11a46618de tempest-FlavorsAccessTestJSON-2096827496 tempest-FlavorsAccessTestJSON-2096827496-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:42.282536 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-41ce7909-a26a-48ba-aa3b-da11a46618de tempest-FlavorsAccessTestJSON-2096827496 tempest-FlavorsAccessTestJSON-2096827496-project] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5409 microversion: 2.1 time: 1.166690 Oct 17 13:33:42.283999 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 49/110] 10.222.0.79 () {58 vars in 1146 bytes} [Mon Oct 17 13:33:41 2022] GET /compute/v2.1/flavors/detail => generated 5409 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:42.297695 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e75865b1-5184-496c-b005-03ed5be9ef3b tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:42.298722 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e75865b1-5184-496c-b005-03ed5be9ef3b tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] [instance: eb4474f8-de59-4187-8b15-ba0ec266bfa6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:42.305867 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=17,nova_api:INSERT=6 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:33:42.316030 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e75865b1-5184-496c-b005-03ed5be9ef3b tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:42.319328 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e75865b1-5184-496c-b005-03ed5be9ef3b tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:42.320219 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e75865b1-5184-496c-b005-03ed5be9ef3b tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:42.321987 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e75865b1-5184-496c-b005-03ed5be9ef3b tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:42.323423 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e75865b1-5184-496c-b005-03ed5be9ef3b tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:42.325614 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e75865b1-5184-496c-b005-03ed5be9ef3b tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:42.690705 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-44717688-5bb8-4a4d-b58c-e29489d3fba0 tempest-FlavorsV261TestJSON-529518138 tempest-FlavorsV261TestJSON-529518138-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-156824568", "id": 956917269, "os-flavor-access:is_public": "True"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:42.759462 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-44717688-5bb8-4a4d-b58c-e29489d3fba0 tempest-FlavorsV261TestJSON-529518138 tempest-FlavorsV261TestJSON-529518138-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 464 microversion: 2.61 time: 1.569096 Oct 17 13:33:42.764586 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 62/111] 10.222.0.79 () {62 vars in 1188 bytes} [Mon Oct 17 13:33:41 2022] POST /compute/v2.1/flavors => generated 464 bytes in 1583 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 13:33:42.784970 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b14f9f1e-c03c-4e65-85ae-5d84d5d6e96f tempest-FlavorsAccessTestJSON-661821375 tempest-FlavorsAccessTestJSON-661821375-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "bb9903f123c3426399b0ade21444e21d"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:43.431852 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e75865b1-5184-496c-b005-03ed5be9ef3b tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4552e3fbd4de4d2997d5db7ec500de65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e76de886880490ba8373e0d86056c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:43.458533 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e75865b1-5184-496c-b005-03ed5be9ef3b tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] 10.222.0.79 "GET /compute/v2.1/servers/eb4474f8-de59-4187-8b15-ba0ec266bfa6" status: 200 len: 1338 microversion: 2.1 time: 1.171815 Oct 17 13:33:43.461853 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 50/112] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:42 2022] GET /compute/v2.1/servers/eb4474f8-de59-4187-8b15-ba0ec266bfa6 => generated 1338 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:43.636451 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b14f9f1e-c03c-4e65-85ae-5d84d5d6e96f tempest-FlavorsAccessTestJSON-661821375 tempest-FlavorsAccessTestJSON-661821375-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors/240469815/action" status: 200 len: 21 microversion: 2.1 time: 0.869549 Oct 17 13:33:43.638591 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 63/113] 10.222.0.79 () {60 vars in 1197 bytes} [Mon Oct 17 13:33:42 2022] POST /compute/v2.1/flavors/240469815/action => generated 21 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:33:43.663414 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7ec7d542-ce76-4311-888c-6309d1339c4a tempest-FlavorsAccessTestJSON-2096827496 tempest-FlavorsAccessTestJSON-2096827496-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:43.747396 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7ec7d542-ce76-4311-888c-6309d1339c4a tempest-FlavorsAccessTestJSON-2096827496 tempest-FlavorsAccessTestJSON-2096827496-project] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5405 microversion: 2.1 time: 0.094556 Oct 17 13:33:43.749630 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 64/114] 10.222.0.79 () {58 vars in 1146 bytes} [Mon Oct 17 13:33:43 2022] GET /compute/v2.1/flavors/detail => generated 5405 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:43.772149 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-393c98a1-cf6d-44d5-9429-8ab566efe693 tempest-FlavorsAccessTestJSON-661821375 tempest-FlavorsAccessTestJSON-661821375-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:43.811977 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-393c98a1-cf6d-44d5-9429-8ab566efe693 tempest-FlavorsAccessTestJSON-661821375 tempest-FlavorsAccessTestJSON-661821375-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/240469815" status: 202 len: 0 microversion: 2.1 time: 0.044889 Oct 17 13:33:43.815658 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 65/115] 10.222.0.79 () {58 vars in 1158 bytes} [Mon Oct 17 13:33:43 2022] DELETE /compute/v2.1/flavors/240469815 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:33:43.845629 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5ef291cb-8a71-4f78-8dc9-21fa67db7693 tempest-FlavorsAccessTestJSON-661821375 tempest-FlavorsAccessTestJSON-661821375-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:43.938727 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5ef291cb-8a71-4f78-8dc9-21fa67db7693 tempest-FlavorsAccessTestJSON-661821375 tempest-FlavorsAccessTestJSON-661821375-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5405 microversion: 2.1 time: 0.113199 Oct 17 13:33:43.939893 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 66/116] 10.222.0.79 () {58 vars in 1146 bytes} [Mon Oct 17 13:33:43 2022] GET /compute/v2.1/flavors/detail => generated 5405 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:43.980961 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a8e53972-f31c-437e-809f-615875bf9c8b tempest-FlavorsAccessTestJSON-661821375 tempest-FlavorsAccessTestJSON-661821375-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1272360114", "id": 1600268931, "os-flavor-access:is_public": "False"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:43.986942 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7b5feba4-0b10-4747-9635-057edef9f8e5 tempest-FlavorsV261TestJSON-185712853 tempest-FlavorsV261TestJSON-185712853-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:44.021481 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7b5feba4-0b10-4747-9635-057edef9f8e5 tempest-FlavorsV261TestJSON-185712853 tempest-FlavorsV261TestJSON-185712853-project] 10.222.0.79 "GET /compute/v2.1/flavors/956917269" status: 200 len: 464 microversion: 2.61 time: 0.555281 Oct 17 13:33:44.028442 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a8e53972-f31c-437e-809f-615875bf9c8b tempest-FlavorsAccessTestJSON-661821375 tempest-FlavorsAccessTestJSON-661821375-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.051882 Oct 17 13:33:44.035002 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 51/117] 10.222.0.79 () {60 vars in 1196 bytes} [Mon Oct 17 13:33:43 2022] GET /compute/v2.1/flavors/956917269 => generated 464 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:33:44.038651 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 67/118] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:33:43 2022] POST /compute/v2.1/flavors => generated 431 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:33:44.049205 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9bda15a5-aa3f-4141-b875-f3af1f126185 tempest-FlavorsAccessTestJSON-661821375 tempest-FlavorsAccessTestJSON-661821375-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:44.057695 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a977fcda-e795-42e5-b779-c93cac5b6923 tempest-FlavorsV261TestJSON-529518138 tempest-FlavorsV261TestJSON-529518138-project-admin] Action: 'update', calling method: .version_select at 0x7f7cd750ad30>, body: {"flavor": {"description": "new"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:44.093006 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9bda15a5-aa3f-4141-b875-f3af1f126185 tempest-FlavorsAccessTestJSON-661821375 tempest-FlavorsAccessTestJSON-661821375-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/1600268931/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.050638 Oct 17 13:33:44.094535 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 68/119] 10.222.0.79 () {58 vars in 1209 bytes} [Mon Oct 17 13:33:44 2022] GET /compute/v2.1/flavors/1600268931/os-flavor-access => generated 21 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:33:44.112169 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4e5cfc1e-06f4-44e8-a051-20151d063ae3 tempest-FlavorsAccessTestJSON-661821375 tempest-FlavorsAccessTestJSON-661821375-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:44.130563 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=4 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:33:44.142003 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4e5cfc1e-06f4-44e8-a051-20151d063ae3 tempest-FlavorsAccessTestJSON-661821375 tempest-FlavorsAccessTestJSON-661821375-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/1600268931" status: 202 len: 0 microversion: 2.1 time: 0.036369 Oct 17 13:33:44.148104 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 69/120] 10.222.0.79 () {58 vars in 1161 bytes} [Mon Oct 17 13:33:44 2022] DELETE /compute/v2.1/flavors/1600268931 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:33:44.158982 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3e561500-7550-4c42-be20-ee9a339a986e tempest-FlavorsAccessTestJSON-661821375 tempest-FlavorsAccessTestJSON-661821375-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:44.161928 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a977fcda-e795-42e5-b779-c93cac5b6923 tempest-FlavorsV261TestJSON-529518138 tempest-FlavorsV261TestJSON-529518138-project-admin] 10.222.0.79 "PUT /compute/v2.1/flavors/956917269" status: 200 len: 465 microversion: 2.61 time: 0.125353 Oct 17 13:33:44.165486 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 52/121] 10.222.0.79 () {62 vars in 1216 bytes} [Mon Oct 17 13:33:44 2022] PUT /compute/v2.1/flavors/956917269 => generated 465 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:33:44.181906 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-75acc1f6-314a-486f-a89d-5233525a5dcb tempest-FlavorsV261TestJSON-185712853 tempest-FlavorsV261TestJSON-185712853-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:44.222015 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3e561500-7550-4c42-be20-ee9a339a986e tempest-FlavorsAccessTestJSON-661821375 tempest-FlavorsAccessTestJSON-661821375-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5405 microversion: 2.1 time: 0.053530 Oct 17 13:33:44.224920 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 70/122] 10.222.0.79 () {58 vars in 1146 bytes} [Mon Oct 17 13:33:44 2022] GET /compute/v2.1/flavors/detail => generated 5405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:44.261392 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-75acc1f6-314a-486f-a89d-5233525a5dcb tempest-FlavorsV261TestJSON-185712853 tempest-FlavorsV261TestJSON-185712853-project] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 6246 microversion: 2.61 time: 0.085025 Oct 17 13:33:44.268962 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 53/123] 10.222.0.79 () {60 vars in 1187 bytes} [Mon Oct 17 13:33:44 2022] GET /compute/v2.1/flavors/detail => generated 6246 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:33:44.300057 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d906f39b-8876-4f26-bd76-cc0cf3b9b1c8 tempest-FlavorsV261TestJSON-185712853 tempest-FlavorsV261TestJSON-185712853-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:44.413526 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d906f39b-8876-4f26-bd76-cc0cf3b9b1c8 tempest-FlavorsV261TestJSON-185712853 tempest-FlavorsV261TestJSON-185712853-project] 10.222.0.79 "GET /compute/v2.1/flavors" status: 200 len: 3153 microversion: 2.61 time: 0.118828 Oct 17 13:33:44.417355 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 71/124] 10.222.0.79 () {60 vars in 1166 bytes} [Mon Oct 17 13:33:44 2022] GET /compute/v2.1/flavors => generated 3153 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:33:44.437756 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b7ac103d-96a5-46a7-966c-a8aa774391cb tempest-FlavorsV261TestJSON-529518138 tempest-FlavorsV261TestJSON-529518138-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:44.471954 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b7ac103d-96a5-46a7-966c-a8aa774391cb tempest-FlavorsV261TestJSON-529518138 tempest-FlavorsV261TestJSON-529518138-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/956917269" status: 202 len: 0 microversion: 2.61 time: 0.038254 Oct 17 13:33:44.472954 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 54/125] 10.222.0.79 () {60 vars in 1199 bytes} [Mon Oct 17 13:33:44 2022] DELETE /compute/v2.1/flavors/956917269 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:33:44.482050 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ca64f8fa-a47e-4203-b59e-c3278c2c5dde tempest-FlavorsV261TestJSON-529518138 tempest-FlavorsV261TestJSON-529518138-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:44.501384 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-64449d34-8b3c-422b-b635-43e2cca3972e tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:44.503054 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-64449d34-8b3c-422b-b635-43e2cca3972e tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] [instance: eb4474f8-de59-4187-8b15-ba0ec266bfa6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:44.534263 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-64449d34-8b3c-422b-b635-43e2cca3972e tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:44.537241 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-64449d34-8b3c-422b-b635-43e2cca3972e tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:44.537798 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-64449d34-8b3c-422b-b635-43e2cca3972e tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:44.538635 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-64449d34-8b3c-422b-b635-43e2cca3972e tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:44.541736 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-64449d34-8b3c-422b-b635-43e2cca3972e tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:44.546111 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-64449d34-8b3c-422b-b635-43e2cca3972e tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:44.565412 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ca64f8fa-a47e-4203-b59e-c3278c2c5dde tempest-FlavorsV261TestJSON-529518138 tempest-FlavorsV261TestJSON-529518138-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.088086 Oct 17 13:33:44.569613 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 72/126] 10.222.0.79 () {60 vars in 1187 bytes} [Mon Oct 17 13:33:44 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:33:45.222898 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-64449d34-8b3c-422b-b635-43e2cca3972e tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4552e3fbd4de4d2997d5db7ec500de65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e76de886880490ba8373e0d86056c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:45.232895 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-64449d34-8b3c-422b-b635-43e2cca3972e tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] 10.222.0.79 "GET /compute/v2.1/servers/eb4474f8-de59-4187-8b15-ba0ec266bfa6" status: 200 len: 1338 microversion: 2.1 time: 0.747196 Oct 17 13:33:45.236016 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 55/127] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:44 2022] GET /compute/v2.1/servers/eb4474f8-de59-4187-8b15-ba0ec266bfa6 => generated 1338 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:46.263464 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f41cdbce-dda8-42d4-81b9-4c53bb6da8d4 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:46.279616 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f41cdbce-dda8-42d4-81b9-4c53bb6da8d4 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] [instance: eb4474f8-de59-4187-8b15-ba0ec266bfa6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:46.288621 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f41cdbce-dda8-42d4-81b9-4c53bb6da8d4 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:46.291578 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f41cdbce-dda8-42d4-81b9-4c53bb6da8d4 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:46.292840 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f41cdbce-dda8-42d4-81b9-4c53bb6da8d4 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:46.293796 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f41cdbce-dda8-42d4-81b9-4c53bb6da8d4 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:46.303217 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f41cdbce-dda8-42d4-81b9-4c53bb6da8d4 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:46.304039 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f41cdbce-dda8-42d4-81b9-4c53bb6da8d4 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:46.621696 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=10 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:33:47.001036 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f41cdbce-dda8-42d4-81b9-4c53bb6da8d4 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4552e3fbd4de4d2997d5db7ec500de65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e76de886880490ba8373e0d86056c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:47.009840 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f41cdbce-dda8-42d4-81b9-4c53bb6da8d4 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] 10.222.0.79 "GET /compute/v2.1/servers/eb4474f8-de59-4187-8b15-ba0ec266bfa6" status: 200 len: 1338 microversion: 2.1 time: 0.752312 Oct 17 13:33:47.024331 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 73/128] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:46 2022] GET /compute/v2.1/servers/eb4474f8-de59-4187-8b15-ba0ec266bfa6 => generated 1338 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:47.201152 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-0989c394-ae25-46ad-a795-b3cfe0c51e5d req-a14fe584-d564-4117-b3a1-3c37a2f63f5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb4474f8-de59-4187-8b15-ba0ec266bfa6", "tag": "61661e1e-c655-419f-8f05-7f4bc97a8b4b"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:47.246554 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-0989c394-ae25-46ad-a795-b3cfe0c51e5d req-a14fe584-d564-4117-b3a1-3c37a2f63f5b service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:47.247663 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-0989c394-ae25-46ad-a795-b3cfe0c51e5d req-a14fe584-d564-4117-b3a1-3c37a2f63f5b service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:47.250522 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-0989c394-ae25-46ad-a795-b3cfe0c51e5d req-a14fe584-d564-4117-b3a1-3c37a2f63f5b service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:47.309219 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-0989c394-ae25-46ad-a795-b3cfe0c51e5d req-a14fe584-d564-4117-b3a1-3c37a2f63f5b service nova] Creating event network-changed:61661e1e-c655-419f-8f05-7f4bc97a8b4b for instance eb4474f8-de59-4187-8b15-ba0ec266bfa6 on n-h2-854247-14 Oct 17 13:33:47.317831 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-0989c394-ae25-46ad-a795-b3cfe0c51e5d req-a14fe584-d564-4117-b3a1-3c37a2f63f5b service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127016) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 17 13:33:47.319470 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-0989c394-ae25-46ad-a795-b3cfe0c51e5d req-a14fe584-d564-4117-b3a1-3c37a2f63f5b service nova] Acquired lock "compute-rpcapi-router" {{(pid=127016) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 17 13:33:47.321713 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e8316a44-c678-4670-a39f-4260344460a9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:47.323969 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e8316a44-c678-4670-a39f-4260344460a9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:47.326279 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e8316a44-c678-4670-a39f-4260344460a9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:47.327761 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e8316a44-c678-4670-a39f-4260344460a9 None None] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:47.330341 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e8316a44-c678-4670-a39f-4260344460a9 None None] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:47.330719 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e8316a44-c678-4670-a39f-4260344460a9 None None] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:47.360571 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.compute.rpcapi [None req-e8316a44-c678-4670-a39f-4260344460a9 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 17 13:33:47.361477 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e8316a44-c678-4670-a39f-4260344460a9 None None] Releasing lock "compute-rpcapi-router" {{(pid=127016) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 17 13:33:47.404438 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e8316a44-c678-4670-a39f-4260344460a9 None None] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.788118 Oct 17 13:33:47.408619 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 56/129] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:33:48.050408 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-43471e1f-d2f7-49a4-bbb3-7cc16b346afe tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:48.051301 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-43471e1f-d2f7-49a4-bbb3-7cc16b346afe tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] [instance: eb4474f8-de59-4187-8b15-ba0ec266bfa6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:48.058868 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-43471e1f-d2f7-49a4-bbb3-7cc16b346afe tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:48.059399 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-43471e1f-d2f7-49a4-bbb3-7cc16b346afe tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:48.059842 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-43471e1f-d2f7-49a4-bbb3-7cc16b346afe tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:48.060544 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-43471e1f-d2f7-49a4-bbb3-7cc16b346afe tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:48.060996 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-43471e1f-d2f7-49a4-bbb3-7cc16b346afe tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:48.061414 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-43471e1f-d2f7-49a4-bbb3-7cc16b346afe tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:48.924754 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-43471e1f-d2f7-49a4-bbb3-7cc16b346afe tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4552e3fbd4de4d2997d5db7ec500de65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e76de886880490ba8373e0d86056c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:48.937316 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-43471e1f-d2f7-49a4-bbb3-7cc16b346afe tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] 10.222.0.79 "GET /compute/v2.1/servers/eb4474f8-de59-4187-8b15-ba0ec266bfa6" status: 200 len: 1338 microversion: 2.1 time: 0.894855 Oct 17 13:33:48.951935 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 74/130] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:48 2022] GET /compute/v2.1/servers/eb4474f8-de59-4187-8b15-ba0ec266bfa6 => generated 1338 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:49.965137 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-eed4eafb-473c-42f0-952b-fa0a87368bad tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:49.965994 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-eed4eafb-473c-42f0-952b-fa0a87368bad tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] [instance: eb4474f8-de59-4187-8b15-ba0ec266bfa6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:49.976799 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eed4eafb-473c-42f0-952b-fa0a87368bad tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:49.984625 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eed4eafb-473c-42f0-952b-fa0a87368bad tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:49.988074 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eed4eafb-473c-42f0-952b-fa0a87368bad tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:49.991151 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eed4eafb-473c-42f0-952b-fa0a87368bad tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:49.993062 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eed4eafb-473c-42f0-952b-fa0a87368bad tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:49.996697 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eed4eafb-473c-42f0-952b-fa0a87368bad tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:50.707063 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-eed4eafb-473c-42f0-952b-fa0a87368bad tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4552e3fbd4de4d2997d5db7ec500de65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e76de886880490ba8373e0d86056c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:50.721040 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-eed4eafb-473c-42f0-952b-fa0a87368bad tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] 10.222.0.79 "GET /compute/v2.1/servers/eb4474f8-de59-4187-8b15-ba0ec266bfa6" status: 200 len: 1338 microversion: 2.1 time: 0.761566 Oct 17 13:33:50.724596 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 57/131] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:49 2022] GET /compute/v2.1/servers/eb4474f8-de59-4187-8b15-ba0ec266bfa6 => generated 1338 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:51.746338 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8ae06b24-a512-474d-bcc2-7f4a2e7f3f32 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:51.747011 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8ae06b24-a512-474d-bcc2-7f4a2e7f3f32 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] [instance: eb4474f8-de59-4187-8b15-ba0ec266bfa6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:51.767609 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8ae06b24-a512-474d-bcc2-7f4a2e7f3f32 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:51.768162 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8ae06b24-a512-474d-bcc2-7f4a2e7f3f32 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:51.768773 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8ae06b24-a512-474d-bcc2-7f4a2e7f3f32 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:51.769606 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8ae06b24-a512-474d-bcc2-7f4a2e7f3f32 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:51.770059 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8ae06b24-a512-474d-bcc2-7f4a2e7f3f32 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:51.770478 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8ae06b24-a512-474d-bcc2-7f4a2e7f3f32 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:52.281757 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8ae06b24-a512-474d-bcc2-7f4a2e7f3f32 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4552e3fbd4de4d2997d5db7ec500de65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e76de886880490ba8373e0d86056c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:52.291785 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8ae06b24-a512-474d-bcc2-7f4a2e7f3f32 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] 10.222.0.79 "GET /compute/v2.1/servers/eb4474f8-de59-4187-8b15-ba0ec266bfa6" status: 200 len: 1338 microversion: 2.1 time: 0.549486 Oct 17 13:33:52.292369 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 75/132] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:51 2022] GET /compute/v2.1/servers/eb4474f8-de59-4187-8b15-ba0ec266bfa6 => generated 1338 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:53.319704 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f55a5591-79e7-4b0d-a6de-8f2ba1c84450 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:53.320322 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f55a5591-79e7-4b0d-a6de-8f2ba1c84450 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] [instance: eb4474f8-de59-4187-8b15-ba0ec266bfa6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:53.330587 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f55a5591-79e7-4b0d-a6de-8f2ba1c84450 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:53.341967 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f55a5591-79e7-4b0d-a6de-8f2ba1c84450 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:53.342518 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f55a5591-79e7-4b0d-a6de-8f2ba1c84450 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:53.343315 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f55a5591-79e7-4b0d-a6de-8f2ba1c84450 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:53.345490 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f55a5591-79e7-4b0d-a6de-8f2ba1c84450 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:53.345998 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f55a5591-79e7-4b0d-a6de-8f2ba1c84450 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:53.710640 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f55a5591-79e7-4b0d-a6de-8f2ba1c84450 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4552e3fbd4de4d2997d5db7ec500de65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e76de886880490ba8373e0d86056c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:53.722111 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f55a5591-79e7-4b0d-a6de-8f2ba1c84450 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] 10.222.0.79 "GET /compute/v2.1/servers/eb4474f8-de59-4187-8b15-ba0ec266bfa6" status: 200 len: 1338 microversion: 2.1 time: 0.406008 Oct 17 13:33:53.723350 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 58/133] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:53 2022] GET /compute/v2.1/servers/eb4474f8-de59-4187-8b15-ba0ec266bfa6 => generated 1338 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:54.165344 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b5a8ca5b-a80d-44de-91a8-560df258c734 tempest-FlavorsV255TestJSON-665975249 tempest-FlavorsV255TestJSON-665975249-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-904984843", "id": 329480897, "os-flavor-access:is_public": "True"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:54.177161 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=6,nova_api:DELETE=13 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:33:54.218695 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b5a8ca5b-a80d-44de-91a8-560df258c734 tempest-FlavorsV255TestJSON-665975249 tempest-FlavorsV255TestJSON-665975249-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 445 microversion: 2.55 time: 0.692718 Oct 17 13:33:54.221676 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 76/134] 10.222.0.79 () {62 vars in 1188 bytes} [Mon Oct 17 13:33:53 2022] POST /compute/v2.1/flavors => generated 445 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 13:33:54.747311 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1f13bda1-02ac-4cd1-b9b5-491087b0b9a8 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:54.748251 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1f13bda1-02ac-4cd1-b9b5-491087b0b9a8 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] [instance: eb4474f8-de59-4187-8b15-ba0ec266bfa6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:54.767770 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1f13bda1-02ac-4cd1-b9b5-491087b0b9a8 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:54.768617 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1f13bda1-02ac-4cd1-b9b5-491087b0b9a8 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:54.769227 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1f13bda1-02ac-4cd1-b9b5-491087b0b9a8 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:54.770442 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1f13bda1-02ac-4cd1-b9b5-491087b0b9a8 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:54.771053 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1f13bda1-02ac-4cd1-b9b5-491087b0b9a8 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:54.772274 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1f13bda1-02ac-4cd1-b9b5-491087b0b9a8 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:54.980304 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e0f1f20f-d4f7-482f-a04e-5c50ed5e1c3d tempest-FlavorsV255TestJSON-1264356730 tempest-FlavorsV255TestJSON-1264356730-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:55.026533 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e0f1f20f-d4f7-482f-a04e-5c50ed5e1c3d tempest-FlavorsV255TestJSON-1264356730 tempest-FlavorsV255TestJSON-1264356730-project] 10.222.0.79 "GET /compute/v2.1/flavors/329480897" status: 200 len: 445 microversion: 2.55 time: 0.796374 Oct 17 13:33:55.061066 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 59/135] 10.222.0.79 () {60 vars in 1196 bytes} [Mon Oct 17 13:33:54 2022] GET /compute/v2.1/flavors/329480897 => generated 445 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:33:55.062883 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1f13bda1-02ac-4cd1-b9b5-491087b0b9a8 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4552e3fbd4de4d2997d5db7ec500de65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e76de886880490ba8373e0d86056c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:55.079555 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1f13bda1-02ac-4cd1-b9b5-491087b0b9a8 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] 10.222.0.79 "GET /compute/v2.1/servers/eb4474f8-de59-4187-8b15-ba0ec266bfa6" status: 200 len: 1338 microversion: 2.1 time: 0.337978 Oct 17 13:33:55.083773 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 77/136] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:54 2022] GET /compute/v2.1/servers/eb4474f8-de59-4187-8b15-ba0ec266bfa6 => generated 1338 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:55.087860 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d5c003e1-a8b4-4319-bebb-cd57be16efab tempest-FlavorsV255TestJSON-665975249 tempest-FlavorsV255TestJSON-665975249-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:55.167009 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d5c003e1-a8b4-4319-bebb-cd57be16efab tempest-FlavorsV255TestJSON-665975249 tempest-FlavorsV255TestJSON-665975249-project-admin] 10.222.0.79 "PUT /compute/v2.1/flavors/329480897" status: 200 len: 446 microversion: 2.55 time: 0.104342 Oct 17 13:33:55.175935 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 60/137] 10.222.0.79 () {62 vars in 1216 bytes} [Mon Oct 17 13:33:55 2022] PUT /compute/v2.1/flavors/329480897 => generated 446 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:33:55.184667 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-523e3c09-be1b-4bb3-b5b0-9f0ccb53b7f1 tempest-FlavorsV255TestJSON-1264356730 tempest-FlavorsV255TestJSON-1264356730-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:55.239606 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-523e3c09-be1b-4bb3-b5b0-9f0ccb53b7f1 tempest-FlavorsV255TestJSON-1264356730 tempest-FlavorsV255TestJSON-1264356730-project] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5721 microversion: 2.55 time: 0.060381 Oct 17 13:33:55.241226 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 78/138] 10.222.0.79 () {60 vars in 1187 bytes} [Mon Oct 17 13:33:55 2022] GET /compute/v2.1/flavors/detail => generated 5721 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:33:55.268152 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8e599256-21a4-430b-9ef7-24a298dd6505 tempest-FlavorsV255TestJSON-1264356730 tempest-FlavorsV255TestJSON-1264356730-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:55.294800 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8e599256-21a4-430b-9ef7-24a298dd6505 tempest-FlavorsV255TestJSON-1264356730 tempest-FlavorsV255TestJSON-1264356730-project] 10.222.0.79 "GET /compute/v2.1/flavors" status: 200 len: 3153 microversion: 2.55 time: 0.036004 Oct 17 13:33:55.305410 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 61/139] 10.222.0.79 () {60 vars in 1166 bytes} [Mon Oct 17 13:33:55 2022] GET /compute/v2.1/flavors => generated 3153 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:33:55.314008 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-877abf13-4044-431a-9920-4ba36fb079c7 tempest-FlavorsV255TestJSON-665975249 tempest-FlavorsV255TestJSON-665975249-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:55.342604 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-877abf13-4044-431a-9920-4ba36fb079c7 tempest-FlavorsV255TestJSON-665975249 tempest-FlavorsV255TestJSON-665975249-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/329480897" status: 202 len: 0 microversion: 2.55 time: 0.032469 Oct 17 13:33:55.347288 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 79/140] 10.222.0.79 () {60 vars in 1199 bytes} [Mon Oct 17 13:33:55 2022] DELETE /compute/v2.1/flavors/329480897 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:33:55.365120 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8371ae99-26e9-41de-8f76-ec9065d0eaa5 tempest-FlavorsV255TestJSON-665975249 tempest-FlavorsV255TestJSON-665975249-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:55.413602 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8371ae99-26e9-41de-8f76-ec9065d0eaa5 tempest-FlavorsV255TestJSON-665975249 tempest-FlavorsV255TestJSON-665975249-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.062592 Oct 17 13:33:55.415058 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 62/141] 10.222.0.79 () {60 vars in 1187 bytes} [Mon Oct 17 13:33:55 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:33:56.492707 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ca38b75b-40a5-4c69-8fc3-13e5589e68b0 tempest-HostsAdminNegativeTestJSON-1591604348 tempest-HostsAdminNegativeTestJSON-1591604348-project-admin] Calling method '.version_select at 0x7f7cd633c1f0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:56.497563 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-74e753ab-f575-42f6-8327-41ba1ababa18 tempest-HypervisorAdminV228Test-354344305 tempest-HypervisorAdminV228Test-354344305-project-admin] Calling method '.version_select at 0x7f7cd641fdc0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:56.499296 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ca38b75b-40a5-4c69-8fc3-13e5589e68b0 tempest-HostsAdminNegativeTestJSON-1591604348 tempest-HostsAdminNegativeTestJSON-1591604348-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:56.499502 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-74e753ab-f575-42f6-8327-41ba1ababa18 tempest-HypervisorAdminV228Test-354344305 tempest-HypervisorAdminV228Test-354344305-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:56.499999 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-74e753ab-f575-42f6-8327-41ba1ababa18 tempest-HypervisorAdminV228Test-354344305 tempest-HypervisorAdminV228Test-354344305-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:56.500533 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-74e753ab-f575-42f6-8327-41ba1ababa18 tempest-HypervisorAdminV228Test-354344305 tempest-HypervisorAdminV228Test-354344305-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:56.501106 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ca38b75b-40a5-4c69-8fc3-13e5589e68b0 tempest-HostsAdminNegativeTestJSON-1591604348 tempest-HostsAdminNegativeTestJSON-1591604348-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:56.502312 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ca38b75b-40a5-4c69-8fc3-13e5589e68b0 tempest-HostsAdminNegativeTestJSON-1591604348 tempest-HostsAdminNegativeTestJSON-1591604348-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:56.503696 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ca38b75b-40a5-4c69-8fc3-13e5589e68b0 tempest-HostsAdminNegativeTestJSON-1591604348 tempest-HostsAdminNegativeTestJSON-1591604348-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:56.506668 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ca38b75b-40a5-4c69-8fc3-13e5589e68b0 tempest-HostsAdminNegativeTestJSON-1591604348 tempest-HostsAdminNegativeTestJSON-1591604348-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:56.507444 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ca38b75b-40a5-4c69-8fc3-13e5589e68b0 tempest-HostsAdminNegativeTestJSON-1591604348 tempest-HostsAdminNegativeTestJSON-1591604348-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:56.536454 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-74e753ab-f575-42f6-8327-41ba1ababa18 tempest-HypervisorAdminV228Test-354344305 tempest-HypervisorAdminV228Test-354344305-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:56.537011 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-74e753ab-f575-42f6-8327-41ba1ababa18 tempest-HypervisorAdminV228Test-354344305 tempest-HypervisorAdminV228Test-354344305-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:56.537615 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-74e753ab-f575-42f6-8327-41ba1ababa18 tempest-HypervisorAdminV228Test-354344305 tempest-HypervisorAdminV228Test-354344305-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:56.559051 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-74e753ab-f575-42f6-8327-41ba1ababa18 tempest-HypervisorAdminV228Test-354344305 tempest-HypervisorAdminV228Test-354344305-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:56.560024 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-74e753ab-f575-42f6-8327-41ba1ababa18 tempest-HypervisorAdminV228Test-354344305 tempest-HypervisorAdminV228Test-354344305-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:56.560657 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-74e753ab-f575-42f6-8327-41ba1ababa18 tempest-HypervisorAdminV228Test-354344305 tempest-HypervisorAdminV228Test-354344305-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:56.572437 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-74e753ab-f575-42f6-8327-41ba1ababa18 tempest-HypervisorAdminV228Test-354344305 tempest-HypervisorAdminV228Test-354344305-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.28 time: 0.778867 Oct 17 13:33:56.580026 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 63/142] 10.222.0.79 () {60 vars in 1187 bytes} [Mon Oct 17 13:33:55 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:33:56.594085 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ca38b75b-40a5-4c69-8fc3-13e5589e68b0 tempest-HostsAdminNegativeTestJSON-1591604348 tempest-HostsAdminNegativeTestJSON-1591604348-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hosts" status: 200 len: 402 microversion: 2.1 time: 0.908598 Oct 17 13:33:56.594980 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 80/143] 10.222.0.79 () {58 vars in 1128 bytes} [Mon Oct 17 13:33:55 2022] GET /compute/v2.1/os-hosts => generated 402 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:33:56.606283 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e9b4fded-ff6d-4476-bf8d-c42e11520e73 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:56.611522 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e9b4fded-ff6d-4476-bf8d-c42e11520e73 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] [instance: eb4474f8-de59-4187-8b15-ba0ec266bfa6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:56.641322 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e9b4fded-ff6d-4476-bf8d-c42e11520e73 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:56.643675 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e9b4fded-ff6d-4476-bf8d-c42e11520e73 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:56.644232 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e9b4fded-ff6d-4476-bf8d-c42e11520e73 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:56.644983 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e9b4fded-ff6d-4476-bf8d-c42e11520e73 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:56.648451 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e9b4fded-ff6d-4476-bf8d-c42e11520e73 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:56.649061 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e9b4fded-ff6d-4476-bf8d-c42e11520e73 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:56.931630 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-89bfdeb4-6f51-4e1e-ab02-55f2a866e0e9 tempest-FlavorsExtraSpecsTestJSON-895300539 tempest-FlavorsExtraSpecsTestJSON-895300539-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-423049174", "ram": 512, "vcpus": 1, "disk": 10, "id": 187068791, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:56.932720 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e9b4fded-ff6d-4476-bf8d-c42e11520e73 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4552e3fbd4de4d2997d5db7ec500de65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e76de886880490ba8373e0d86056c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:56.945566 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e9b4fded-ff6d-4476-bf8d-c42e11520e73 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] 10.222.0.79 "GET /compute/v2.1/servers/eb4474f8-de59-4187-8b15-ba0ec266bfa6" status: 200 len: 1338 microversion: 2.1 time: 0.349106 Oct 17 13:33:56.965024 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 81/144] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:56 2022] GET /compute/v2.1/servers/eb4474f8-de59-4187-8b15-ba0ec266bfa6 => generated 1338 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:56.981419 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-01482823-5782-4587-81c3-89a6d93eb867 tempest-HypervisorAdminV228Test-354344305 tempest-HypervisorAdminV228Test-354344305-project-admin] Calling method '.version_select at 0x7f7cd632f040>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:56.985996 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-01482823-5782-4587-81c3-89a6d93eb867 tempest-HypervisorAdminV228Test-354344305 tempest-HypervisorAdminV228Test-354344305-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:56.986484 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-01482823-5782-4587-81c3-89a6d93eb867 tempest-HypervisorAdminV228Test-354344305 tempest-HypervisorAdminV228Test-354344305-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:56.990397 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-01482823-5782-4587-81c3-89a6d93eb867 tempest-HypervisorAdminV228Test-354344305 tempest-HypervisorAdminV228Test-354344305-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:56.995901 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-89bfdeb4-6f51-4e1e-ab02-55f2a866e0e9 tempest-FlavorsExtraSpecsTestJSON-895300539 tempest-FlavorsExtraSpecsTestJSON-895300539-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.414147 Oct 17 13:33:57.006597 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 64/145] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:33:56 2022] POST /compute/v2.1/flavors => generated 412 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:33:57.033338 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-01482823-5782-4587-81c3-89a6d93eb867 tempest-HypervisorAdminV228Test-354344305 tempest-HypervisorAdminV228Test-354344305-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:57.034262 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-01482823-5782-4587-81c3-89a6d93eb867 tempest-HypervisorAdminV228Test-354344305 tempest-HypervisorAdminV228Test-354344305-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:57.035042 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-01482823-5782-4587-81c3-89a6d93eb867 tempest-HypervisorAdminV228Test-354344305 tempest-HypervisorAdminV228Test-354344305-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:57.051251 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-01482823-5782-4587-81c3-89a6d93eb867 tempest-HypervisorAdminV228Test-354344305 tempest-HypervisorAdminV228Test-354344305-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 720 microversion: 2.28 time: 0.082821 Oct 17 13:33:57.066057 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 82/146] 10.222.0.79 () {60 vars in 1193 bytes} [Mon Oct 17 13:33:56 2022] GET /compute/v2.1/os-hypervisors/1 => generated 720 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:33:57.068217 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1bc1c1cb-d7d5-4aa0-b1f6-1f73bd86d8f2 tempest-FlavorsExtraSpecsTestJSON-895300539 tempest-FlavorsExtraSpecsTestJSON-895300539-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:57.145457 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1bc1c1cb-d7d5-4aa0-b1f6-1f73bd86d8f2 tempest-FlavorsExtraSpecsTestJSON-895300539 tempest-FlavorsExtraSpecsTestJSON-895300539-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors/187068791/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.089153 Oct 17 13:33:57.151459 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 83/147] 10.222.0.79 () {60 vars in 1221 bytes} [Mon Oct 17 13:33:57 2022] POST /compute/v2.1/flavors/187068791/os-extra_specs => generated 66 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:33:57.358348 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:33:57.386399 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-dd4c1456-43a7-4e53-b44b-917d49a6ee37 tempest-HostsAdminNegativeTestJSON-552357086 tempest-HostsAdminNegativeTestJSON-552357086-project] Calling method '.version_select at 0x7f7cd64079d0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:57.391052 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-dd4c1456-43a7-4e53-b44b-917d49a6ee37 tempest-HostsAdminNegativeTestJSON-552357086 tempest-HostsAdminNegativeTestJSON-552357086-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '199473072ddc4190b18902cd1dfec440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338918f7613c4ee3b3417d15d4bb040f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:57.398463 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-dd4c1456-43a7-4e53-b44b-917d49a6ee37 tempest-HostsAdminNegativeTestJSON-552357086 tempest-HostsAdminNegativeTestJSON-552357086-project] Request method failure captured: Oct 17 13:33:57.398463 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 17 13:33:57.398463 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:33:57.398463 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:33:57.398463 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:33:57.398463 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:33:57.398463 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:33:57.398463 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:33:57.398463 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:33:57.398463 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:57.398463 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVnACJ7F7hEyrrAf_YJd_shMx8ZwFNEttb0uNo0LaO-2ZkhWekyaFseZ0fiT6LgIO0wPJA8rJOx9domAJIjCRa6mpxixG3RnCswl7v_BVFtUotuL9t9VC3v79VWfUvjk8VQ_v8ozjCQ2sJJplL1W-o1PvMi2ckOw66yFoYNVBKfvULo Oct 17 13:33:57.398463 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:33:57.398463 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:33:57.398463 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:33:57.398463 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:33:57.398463 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:33:57.398463 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:33:57.398463 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 338918f7613c4ee3b3417d15d4bb040f Oct 17 13:33:57.398463 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-552357086 Oct 17 13:33:57.398463 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:33:57.398463 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:33:57.400003 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/338918f7613c4ee3b3417d15d4bb040f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/338918f7613c4ee3b3417d15d4bb040f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/338918f7613c4ee3b3417d15d4bb040f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_338918f7613c4ee3b3417d15d4bb040f", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:33:57.400003 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-HostsAdminNegativeTestJSON-552357086 Oct 17 13:33:57.400003 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 338918f7613c4ee3b3417d15d4bb040f Oct 17 13:33:57.400003 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-552357086 Oct 17 13:33:57.400003 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-HostsAdminNegativeTestJSON-552357086-project Oct 17 13:33:57.400003 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:33:57.400003 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:33:57.400003 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 199473072ddc4190b18902cd1dfec440 Oct 17 13:33:57.400003 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-HostsAdminNegativeTestJSON-552357086-project Oct 17 13:33:57.400003 n-d-854247-14 devstack@n-api.service[127016]: method: Oct 17 13:33:57.400003 n-d-854247-14 devstack@n-api.service[127016]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 17 13:33:57.400003 n-d-854247-14 devstack@n-api.service[127016]: action_args: {} Oct 17 13:33:57.400003 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:57.401246 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:57.401246 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:57.401246 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:57.401246 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:57.401246 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:57.401246 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:33:57.401246 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:33:57.401246 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 13:33:57.401246 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:33:57.401246 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:57.401246 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:57.401246 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 17 13:33:57.401246 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 17 13:33:57.401246 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:33:57.401246 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:33:57.401246 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:33:57.401246 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:33:57.401246 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:33:57.401246 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:33:57.403607 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:33:57.403607 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:33:57.403607 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:33:57.403607 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:33:57.403607 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:33:57.403607 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:33:57.403607 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:33:57.403607 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:33:57.403607 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 17 13:33:57.403607 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:57.403607 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:57.403607 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:57.403607 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:57.403607 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:57.403607 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:57.403607 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:33:57.403607 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:33:57.403607 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 17 13:33:57.403607 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:57.410814 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-dd4c1456-43a7-4e53-b44b-917d49a6ee37 tempest-HostsAdminNegativeTestJSON-552357086 tempest-HostsAdminNegativeTestJSON-552357086-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:57.413665 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-dd4c1456-43a7-4e53-b44b-917d49a6ee37 tempest-HostsAdminNegativeTestJSON-552357086 tempest-HostsAdminNegativeTestJSON-552357086-project] 10.222.0.79 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.404474 Oct 17 13:33:57.417719 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 65/148] 10.222.0.79 () {58 vars in 1128 bytes} [Mon Oct 17 13:33:57 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 411 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:33:57.578666 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-92bc5b6e-c5d2-43c5-af2c-0e050d745b7f tempest-FlavorsExtraSpecsTestJSON-1212094954 tempest-FlavorsExtraSpecsTestJSON-1212094954-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:57.606251 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-92bc5b6e-c5d2-43c5-af2c-0e050d745b7f tempest-FlavorsExtraSpecsTestJSON-1212094954 tempest-FlavorsExtraSpecsTestJSON-1212094954-project] 10.222.0.79 "GET /compute/v2.1/flavors/187068791/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.450750 Oct 17 13:33:57.607882 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 84/149] 10.222.0.79 () {58 vars in 1200 bytes} [Mon Oct 17 13:33:57 2022] GET /compute/v2.1/flavors/187068791/os-extra_specs => generated 66 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:33:57.613094 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-db6ed456-ef6b-4067-a2e0-7ae7c075d6d5 tempest-HostsAdminNegativeTestJSON-552357086 tempest-HostsAdminNegativeTestJSON-552357086-project] Calling method '.version_select at 0x7f7cd632f0d0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:57.615557 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-db6ed456-ef6b-4067-a2e0-7ae7c075d6d5 tempest-HostsAdminNegativeTestJSON-552357086 tempest-HostsAdminNegativeTestJSON-552357086-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '199473072ddc4190b18902cd1dfec440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338918f7613c4ee3b3417d15d4bb040f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:57.622032 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-db6ed456-ef6b-4067-a2e0-7ae7c075d6d5 tempest-HostsAdminNegativeTestJSON-552357086 tempest-HostsAdminNegativeTestJSON-552357086-project] Request method failure captured: Oct 17 13:33:57.622032 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/os-hosts/n-d-854247-14/reboot HTTP/1.1 Oct 17 13:33:57.622032 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:33:57.622032 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:33:57.622032 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:33:57.622032 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:33:57.622032 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:33:57.622032 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:33:57.622032 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:33:57.622032 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:57.622032 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVnACJ7F7hEyrrAf_YJd_shMx8ZwFNEttb0uNo0LaO-2ZkhWekyaFseZ0fiT6LgIO0wPJA8rJOx9domAJIjCRa6mpxixG3RnCswl7v_BVFtUotuL9t9VC3v79VWfUvjk8VQ_v8ozjCQ2sJJplL1W-o1PvMi2ckOw66yFoYNVBKfvULo Oct 17 13:33:57.622032 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:33:57.622032 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:33:57.622032 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:33:57.622032 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:33:57.622032 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:33:57.622032 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:33:57.622032 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 338918f7613c4ee3b3417d15d4bb040f Oct 17 13:33:57.622032 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-552357086 Oct 17 13:33:57.622032 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:33:57.622032 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:33:57.623440 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/338918f7613c4ee3b3417d15d4bb040f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/338918f7613c4ee3b3417d15d4bb040f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/338918f7613c4ee3b3417d15d4bb040f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_338918f7613c4ee3b3417d15d4bb040f", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:33:57.623440 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-HostsAdminNegativeTestJSON-552357086 Oct 17 13:33:57.623440 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 338918f7613c4ee3b3417d15d4bb040f Oct 17 13:33:57.623440 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-552357086 Oct 17 13:33:57.623440 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-HostsAdminNegativeTestJSON-552357086-project Oct 17 13:33:57.623440 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:33:57.623440 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:33:57.623440 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 199473072ddc4190b18902cd1dfec440 Oct 17 13:33:57.623440 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-HostsAdminNegativeTestJSON-552357086-project Oct 17 13:33:57.623440 n-d-854247-14 devstack@n-api.service[127017]: method: Oct 17 13:33:57.623440 n-d-854247-14 devstack@n-api.service[127017]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 17 13:33:57.623440 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'n-d-854247-14'} Oct 17 13:33:57.623440 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:57.624219 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:57.624219 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:57.624219 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:57.624219 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:57.624219 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:57.624219 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:33:57.624219 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:33:57.624219 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:57.624219 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:57.624219 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 17 13:33:57.624219 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 17 13:33:57.624219 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:33:57.624219 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:33:57.624219 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:33:57.624219 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:33:57.624219 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:33:57.624219 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:33:57.624219 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:33:57.624219 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:33:57.625449 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:33:57.625449 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:33:57.625449 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:33:57.625449 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:33:57.625449 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:33:57.625449 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:33:57.625449 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 17 13:33:57.625449 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:33:57.625449 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:57.625449 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:33:57.625449 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:57.625449 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:57.625449 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:57.625449 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:33:57.625449 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:33:57.625449 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 17 13:33:57.625449 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:33:57.628890 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-db6ed456-ef6b-4067-a2e0-7ae7c075d6d5 tempest-HostsAdminNegativeTestJSON-552357086 tempest-HostsAdminNegativeTestJSON-552357086-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:57.629867 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-db6ed456-ef6b-4067-a2e0-7ae7c075d6d5 tempest-HostsAdminNegativeTestJSON-552357086 tempest-HostsAdminNegativeTestJSON-552357086-project] 10.222.0.79 "GET /compute/v2.1/os-hosts/n-d-854247-14/reboot" status: 403 len: 111 microversion: 2.1 time: 0.020712 Oct 17 13:33:57.631135 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 85/150] 10.222.0.79 () {58 vars in 1191 bytes} [Mon Oct 17 13:33:57 2022] GET /compute/v2.1/os-hosts/n-d-854247-14/reboot => generated 111 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:33:57.637073 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7ca1989c-6814-47aa-8adf-cf582e498c67 tempest-FlavorsExtraSpecsTestJSON-895300539 tempest-FlavorsExtraSpecsTestJSON-895300539-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:57.653775 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fe400176-c6c4-4e8b-939e-9b02b1778065 tempest-HostsAdminTestJSON-2102957320 tempest-HostsAdminTestJSON-2102957320-project-admin] Calling method '.version_select at 0x7f7cd79769d0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:57.658708 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe400176-c6c4-4e8b-939e-9b02b1778065 tempest-HostsAdminTestJSON-2102957320 tempest-HostsAdminTestJSON-2102957320-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:57.660942 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe400176-c6c4-4e8b-939e-9b02b1778065 tempest-HostsAdminTestJSON-2102957320 tempest-HostsAdminTestJSON-2102957320-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:57.661504 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe400176-c6c4-4e8b-939e-9b02b1778065 tempest-HostsAdminTestJSON-2102957320 tempest-HostsAdminTestJSON-2102957320-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:57.662273 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe400176-c6c4-4e8b-939e-9b02b1778065 tempest-HostsAdminTestJSON-2102957320 tempest-HostsAdminTestJSON-2102957320-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:57.664987 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe400176-c6c4-4e8b-939e-9b02b1778065 tempest-HostsAdminTestJSON-2102957320 tempest-HostsAdminTestJSON-2102957320-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:57.665436 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe400176-c6c4-4e8b-939e-9b02b1778065 tempest-HostsAdminTestJSON-2102957320 tempest-HostsAdminTestJSON-2102957320-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:57.674072 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7ca1989c-6814-47aa-8adf-cf582e498c67 tempest-FlavorsExtraSpecsTestJSON-895300539 tempest-FlavorsExtraSpecsTestJSON-895300539-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors/187068791/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.041307 Oct 17 13:33:57.688121 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 86/151] 10.222.0.79 () {60 vars in 1221 bytes} [Mon Oct 17 13:33:57 2022] POST /compute/v2.1/flavors/187068791/os-extra_specs => generated 66 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:33:57.693449 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5fc97ea6-5546-44ad-8e3b-9171f02b9cd0 tempest-HostsAdminNegativeTestJSON-1591604348 tempest-HostsAdminNegativeTestJSON-1591604348-project-admin] Calling method '.version_select at 0x7f7cd62dcca0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:57.694138 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=63 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:33:57.708842 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-5fc97ea6-5546-44ad-8e3b-9171f02b9cd0 tempest-HostsAdminNegativeTestJSON-1591604348 tempest-HostsAdminNegativeTestJSON-1591604348-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 13:33:57.714991 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5fc97ea6-5546-44ad-8e3b-9171f02b9cd0 tempest-HostsAdminNegativeTestJSON-1591604348 tempest-HostsAdminNegativeTestJSON-1591604348-project-admin] Request method failure captured: Oct 17 13:33:57.714991 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 17 13:33:57.714991 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:33:57.714991 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:33:57.714991 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:33:57.714991 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:33:57.714991 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:33:57.714991 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:33:57.714991 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:33:57.714991 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:57.714991 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVnDag3TA1I7h3FRA6L5Lcb8GJH-kgbKOe8ATinhIu3EYZ-DgfBQDye1kSZGF6stlFIeCsbFnire4DzeOv83ODCdr3Hwqanq2TCAFMH1_Zx4_a2px1OLRHWBLy9UOjpSguwxfs7yc41am10jDetDSYCU1UAZxmzJkECW2X4x_UZUIkk Oct 17 13:33:57.714991 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:33:57.714991 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:33:57.714991 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:33:57.714991 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:33:57.714991 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:33:57.714991 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:33:57.714991 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: f5b060cf049e4c7e87cdd4f43e3b83e8 Oct 17 13:33:57.714991 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1591604348 Oct 17 13:33:57.714991 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member,admin Oct 17 13:33:57.714991 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member,admin Oct 17 13:33:57.716418 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f5b060cf049e4c7e87cdd4f43e3b83e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f5b060cf049e4c7e87cdd4f43e3b83e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f5b060cf049e4c7e87cdd4f43e3b83e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f5b060cf049e4c7e87cdd4f43e3b83e8", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:33:57.716418 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1591604348 Oct 17 13:33:57.716418 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: f5b060cf049e4c7e87cdd4f43e3b83e8 Oct 17 13:33:57.716418 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1591604348 Oct 17 13:33:57.716418 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-HostsAdminNegativeTestJSON-1591604348-project-admin Oct 17 13:33:57.716418 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:33:57.716418 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:33:57.716418 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: f8338c65ea674400b1d60aa3442adfa5 Oct 17 13:33:57.716418 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1591604348-project-admin Oct 17 13:33:57.716418 n-d-854247-14 devstack@n-api.service[127017]: method: Oct 17 13:33:57.716418 n-d-854247-14 devstack@n-api.service[127017]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 13:33:57.716418 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'nonexistent_hostname'} Oct 17 13:33:57.716418 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:57.717229 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:57.717229 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 17 13:33:57.717229 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 17 13:33:57.717229 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 17 13:33:57.717229 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 17 13:33:57.717229 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:33:57.717229 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:33:57.717229 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:33:57.717229 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:33:57.717229 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 17 13:33:57.717229 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 17 13:33:57.717229 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 17 13:33:57.717229 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 17 13:33:57.717229 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:33:57.717229 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:33:57.717229 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 17 13:33:57.717229 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 17 13:33:57.717229 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 13:33:57.717229 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 13:33:57.718401 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 17 13:33:57.718401 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 17 13:33:57.718401 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 13:33:57.718401 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:33:57.718401 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:57.718401 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:33:57.718401 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:57.718401 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:57.718401 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:57.718401 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:57.718401 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:57.718401 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:33:57.718401 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:33:57.718401 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:57.718401 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:57.718401 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 17 13:33:57.718401 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 17 13:33:57.718401 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 17 13:33:57.718401 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:33:57.719603 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 13:33:57.719603 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:33:57.719603 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:57.719603 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:33:57.719603 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:57.719603 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:57.719603 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:57.719603 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:33:57.719603 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:33:57.719603 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 13:33:57.719603 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:33:57.723697 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5fc97ea6-5546-44ad-8e3b-9171f02b9cd0 tempest-HostsAdminNegativeTestJSON-1591604348 tempest-HostsAdminNegativeTestJSON-1591604348-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:57.724960 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fe400176-c6c4-4e8b-939e-9b02b1778065 tempest-HostsAdminTestJSON-2102957320 tempest-HostsAdminTestJSON-2102957320-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hosts" status: 200 len: 402 microversion: 2.1 time: 0.300607 Oct 17 13:33:57.725881 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 66/152] 10.222.0.79 () {58 vars in 1128 bytes} [Mon Oct 17 13:33:57 2022] GET /compute/v2.1/os-hosts => generated 402 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:33:57.733482 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-db63bd9f-6d82-4552-acc8-c6572f771bd9 tempest-FlavorsExtraSpecsTestJSON-1212094954 tempest-FlavorsExtraSpecsTestJSON-1212094954-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:57.734044 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5fc97ea6-5546-44ad-8e3b-9171f02b9cd0 tempest-HostsAdminNegativeTestJSON-1591604348 tempest-HostsAdminNegativeTestJSON-1591604348-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.036357 Oct 17 13:33:57.738758 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 87/153] 10.222.0.79 () {58 vars in 1212 bytes} [Mon Oct 17 13:33:57 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:33:57.741401 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b6220dee-875d-45ab-a446-129bfb61eae4 tempest-HostsAdminTestJSON-2102957320 tempest-HostsAdminTestJSON-2102957320-project-admin] Calling method '.version_select at 0x7f7cd61d9160>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:57.745538 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b6220dee-875d-45ab-a446-129bfb61eae4 tempest-HostsAdminTestJSON-2102957320 tempest-HostsAdminTestJSON-2102957320-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:57.746096 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b6220dee-875d-45ab-a446-129bfb61eae4 tempest-HostsAdminTestJSON-2102957320 tempest-HostsAdminTestJSON-2102957320-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:57.746591 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b6220dee-875d-45ab-a446-129bfb61eae4 tempest-HostsAdminTestJSON-2102957320 tempest-HostsAdminTestJSON-2102957320-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:57.747858 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b6220dee-875d-45ab-a446-129bfb61eae4 tempest-HostsAdminTestJSON-2102957320 tempest-HostsAdminTestJSON-2102957320-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:57.748373 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b6220dee-875d-45ab-a446-129bfb61eae4 tempest-HostsAdminTestJSON-2102957320 tempest-HostsAdminTestJSON-2102957320-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:57.748922 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b6220dee-875d-45ab-a446-129bfb61eae4 tempest-HostsAdminTestJSON-2102957320 tempest-HostsAdminTestJSON-2102957320-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:57.752569 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-db63bd9f-6d82-4552-acc8-c6572f771bd9 tempest-FlavorsExtraSpecsTestJSON-1212094954 tempest-FlavorsExtraSpecsTestJSON-1212094954-project] 10.222.0.79 "GET /compute/v2.1/flavors/187068791/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.025440 Oct 17 13:33:57.753697 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 67/154] 10.222.0.79 () {58 vars in 1242 bytes} [Mon Oct 17 13:33:57 2022] GET /compute/v2.1/flavors/187068791/os-extra_specs/hw:numa_nodes => generated 22 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:33:57.759658 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-95271c89-eadc-4d50-919a-804f10e5dbb6 tempest-HostsAdminNegativeTestJSON-552357086 tempest-HostsAdminNegativeTestJSON-552357086-project] Calling method '.version_select at 0x7f7cd6407af0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:57.764989 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-95271c89-eadc-4d50-919a-804f10e5dbb6 tempest-HostsAdminNegativeTestJSON-552357086 tempest-HostsAdminNegativeTestJSON-552357086-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '199473072ddc4190b18902cd1dfec440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338918f7613c4ee3b3417d15d4bb040f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:57.771970 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-95271c89-eadc-4d50-919a-804f10e5dbb6 tempest-HostsAdminNegativeTestJSON-552357086 tempest-HostsAdminNegativeTestJSON-552357086-project] Request method failure captured: Oct 17 13:33:57.771970 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/os-hosts/n-d-854247-14 HTTP/1.1 Oct 17 13:33:57.771970 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:33:57.771970 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:33:57.771970 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:33:57.771970 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:33:57.771970 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:33:57.771970 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:33:57.771970 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:33:57.771970 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:57.771970 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVnACJ7F7hEyrrAf_YJd_shMx8ZwFNEttb0uNo0LaO-2ZkhWekyaFseZ0fiT6LgIO0wPJA8rJOx9domAJIjCRa6mpxixG3RnCswl7v_BVFtUotuL9t9VC3v79VWfUvjk8VQ_v8ozjCQ2sJJplL1W-o1PvMi2ckOw66yFoYNVBKfvULo Oct 17 13:33:57.771970 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:33:57.771970 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:33:57.771970 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:33:57.771970 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:33:57.771970 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:33:57.771970 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:33:57.771970 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 338918f7613c4ee3b3417d15d4bb040f Oct 17 13:33:57.771970 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-552357086 Oct 17 13:33:57.771970 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:33:57.771970 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:33:57.773138 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/338918f7613c4ee3b3417d15d4bb040f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/338918f7613c4ee3b3417d15d4bb040f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/338918f7613c4ee3b3417d15d4bb040f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_338918f7613c4ee3b3417d15d4bb040f", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:33:57.773138 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-HostsAdminNegativeTestJSON-552357086 Oct 17 13:33:57.773138 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 338918f7613c4ee3b3417d15d4bb040f Oct 17 13:33:57.773138 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-552357086 Oct 17 13:33:57.773138 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-HostsAdminNegativeTestJSON-552357086-project Oct 17 13:33:57.773138 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:33:57.773138 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:33:57.773138 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 199473072ddc4190b18902cd1dfec440 Oct 17 13:33:57.773138 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-HostsAdminNegativeTestJSON-552357086-project Oct 17 13:33:57.773138 n-d-854247-14 devstack@n-api.service[127016]: method: Oct 17 13:33:57.773138 n-d-854247-14 devstack@n-api.service[127016]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 17 13:33:57.773138 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'n-d-854247-14'} Oct 17 13:33:57.773138 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:57.773838 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:57.773838 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:57.773838 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:57.773838 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:57.773838 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:57.773838 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:33:57.773838 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:33:57.773838 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:57.773838 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:57.773838 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 17 13:33:57.773838 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 17 13:33:57.773838 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:33:57.773838 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:33:57.773838 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:33:57.773838 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:33:57.773838 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:33:57.773838 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:33:57.773838 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:33:57.773838 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:33:57.774821 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:33:57.774821 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:33:57.774821 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:33:57.774821 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:33:57.774821 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:33:57.774821 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:33:57.774821 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 17 13:33:57.774821 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:57.774821 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:57.774821 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:57.774821 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:57.774821 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:57.774821 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:57.774821 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:33:57.774821 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:33:57.774821 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 17 13:33:57.774821 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:57.778689 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-95271c89-eadc-4d50-919a-804f10e5dbb6 tempest-HostsAdminNegativeTestJSON-552357086 tempest-HostsAdminNegativeTestJSON-552357086-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:57.780020 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-95271c89-eadc-4d50-919a-804f10e5dbb6 tempest-HostsAdminNegativeTestJSON-552357086 tempest-HostsAdminNegativeTestJSON-552357086-project] 10.222.0.79 "GET /compute/v2.1/os-hosts/n-d-854247-14" status: 403 len: 109 microversion: 2.1 time: 0.024050 Oct 17 13:33:57.782593 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b6220dee-875d-45ab-a446-129bfb61eae4 tempest-HostsAdminTestJSON-2102957320 tempest-HostsAdminTestJSON-2102957320-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 402 microversion: 2.1 time: 0.045185 Oct 17 13:33:57.789069 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 68/155] 10.222.0.79 () {58 vars in 1170 bytes} [Mon Oct 17 13:33:57 2022] GET /compute/v2.1/os-hosts/n-d-854247-14 => generated 109 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:33:57.790322 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 88/156] 10.222.0.79 () {58 vars in 1139 bytes} [Mon Oct 17 13:33:57 2022] GET /compute/v2.1/os-hosts?zone= => generated 402 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:33:57.795213 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a503416c-a1c8-4bd2-9c9e-a1a14816a9f8 tempest-HostsAdminNegativeTestJSON-1591604348 tempest-HostsAdminNegativeTestJSON-1591604348-project-admin] Calling method '.version_select at 0x7f7cd71b01f0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:57.797019 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-db548052-41b0-4fec-8bf3-78f380a3f198 tempest-FlavorsExtraSpecsTestJSON-895300539 tempest-FlavorsExtraSpecsTestJSON-895300539-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:57.812039 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-a503416c-a1c8-4bd2-9c9e-a1a14816a9f8 tempest-HostsAdminNegativeTestJSON-1591604348 tempest-HostsAdminNegativeTestJSON-1591604348-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 13:33:57.815122 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a503416c-a1c8-4bd2-9c9e-a1a14816a9f8 tempest-HostsAdminNegativeTestJSON-1591604348 tempest-HostsAdminNegativeTestJSON-1591604348-project-admin] Request method failure captured: Oct 17 13:33:57.815122 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 17 13:33:57.815122 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:33:57.815122 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:33:57.815122 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:33:57.815122 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:33:57.815122 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:33:57.815122 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:33:57.815122 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:33:57.815122 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:57.815122 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVnDag3TA1I7h3FRA6L5Lcb8GJH-kgbKOe8ATinhIu3EYZ-DgfBQDye1kSZGF6stlFIeCsbFnire4DzeOv83ODCdr3Hwqanq2TCAFMH1_Zx4_a2px1OLRHWBLy9UOjpSguwxfs7yc41am10jDetDSYCU1UAZxmzJkECW2X4x_UZUIkk Oct 17 13:33:57.815122 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:33:57.815122 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:33:57.815122 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:33:57.815122 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:33:57.815122 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:33:57.815122 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:33:57.815122 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: f5b060cf049e4c7e87cdd4f43e3b83e8 Oct 17 13:33:57.815122 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1591604348 Oct 17 13:33:57.815122 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member,admin Oct 17 13:33:57.815122 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member,admin Oct 17 13:33:57.816266 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f5b060cf049e4c7e87cdd4f43e3b83e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f5b060cf049e4c7e87cdd4f43e3b83e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f5b060cf049e4c7e87cdd4f43e3b83e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f5b060cf049e4c7e87cdd4f43e3b83e8", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:33:57.816266 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1591604348 Oct 17 13:33:57.816266 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: f5b060cf049e4c7e87cdd4f43e3b83e8 Oct 17 13:33:57.816266 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1591604348 Oct 17 13:33:57.816266 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-HostsAdminNegativeTestJSON-1591604348-project-admin Oct 17 13:33:57.816266 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:33:57.816266 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:33:57.816266 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: f8338c65ea674400b1d60aa3442adfa5 Oct 17 13:33:57.816266 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1591604348-project-admin Oct 17 13:33:57.816266 n-d-854247-14 devstack@n-api.service[127017]: method: Oct 17 13:33:57.816266 n-d-854247-14 devstack@n-api.service[127017]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 13:33:57.816266 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'nonexistent_hostname'} Oct 17 13:33:57.816266 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:57.816997 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:57.816997 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 17 13:33:57.816997 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 17 13:33:57.816997 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:33:57.816997 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:33:57.816997 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 17 13:33:57.816997 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 17 13:33:57.816997 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 13:33:57.816997 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 13:33:57.816997 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 17 13:33:57.816997 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 17 13:33:57.816997 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 13:33:57.816997 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:33:57.816997 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:57.816997 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:33:57.816997 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:57.816997 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:57.816997 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:57.816997 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:57.818738 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:57.818738 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:33:57.818738 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:33:57.818738 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:57.818738 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:57.818738 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 17 13:33:57.818738 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:33:57.818738 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 13:33:57.818738 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:33:57.818738 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:57.818738 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:33:57.818738 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:57.818738 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:57.818738 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:57.818738 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:33:57.818738 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:33:57.818738 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 13:33:57.818738 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:33:57.823662 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a503416c-a1c8-4bd2-9c9e-a1a14816a9f8 tempest-HostsAdminNegativeTestJSON-1591604348 tempest-HostsAdminNegativeTestJSON-1591604348-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:57.825697 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a503416c-a1c8-4bd2-9c9e-a1a14816a9f8 tempest-HostsAdminNegativeTestJSON-1591604348 tempest-HostsAdminNegativeTestJSON-1591604348-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.034101 Oct 17 13:33:57.826858 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 89/157] 10.222.0.79 () {58 vars in 1191 bytes} [Mon Oct 17 13:33:57 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:33:57.834959 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-fc83ca2f-39ba-47cb-88f1-d53f885039ed tempest-HostsAdminTestJSON-2102957320 tempest-HostsAdminTestJSON-2102957320-project-admin] Calling method '.version_select at 0x7f7cd61d9b80>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:57.846817 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-db548052-41b0-4fec-8bf3-78f380a3f198 tempest-FlavorsExtraSpecsTestJSON-895300539 tempest-FlavorsExtraSpecsTestJSON-895300539-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors/187068791/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.056095 Oct 17 13:33:57.847123 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fc83ca2f-39ba-47cb-88f1-d53f885039ed tempest-HostsAdminTestJSON-2102957320 tempest-HostsAdminTestJSON-2102957320-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:57.848147 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fc83ca2f-39ba-47cb-88f1-d53f885039ed tempest-HostsAdminTestJSON-2102957320 tempest-HostsAdminTestJSON-2102957320-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:57.848307 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 69/158] 10.222.0.79 () {60 vars in 1221 bytes} [Mon Oct 17 13:33:57 2022] POST /compute/v2.1/flavors/187068791/os-extra_specs => generated 66 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:33:57.849593 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fc83ca2f-39ba-47cb-88f1-d53f885039ed tempest-HostsAdminTestJSON-2102957320 tempest-HostsAdminTestJSON-2102957320-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:57.851499 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fc83ca2f-39ba-47cb-88f1-d53f885039ed tempest-HostsAdminTestJSON-2102957320 tempest-HostsAdminTestJSON-2102957320-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:57.852817 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fc83ca2f-39ba-47cb-88f1-d53f885039ed tempest-HostsAdminTestJSON-2102957320 tempest-HostsAdminTestJSON-2102957320-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:57.853895 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fc83ca2f-39ba-47cb-88f1-d53f885039ed tempest-HostsAdminTestJSON-2102957320 tempest-HostsAdminTestJSON-2102957320-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:57.859664 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2f1faf15-5eac-4950-9624-9f7db95eb06d tempest-HostsAdminNegativeTestJSON-552357086 tempest-HostsAdminNegativeTestJSON-552357086-project] Calling method '.version_select at 0x7f7cd643ddc0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:57.865072 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2f1faf15-5eac-4950-9624-9f7db95eb06d tempest-HostsAdminNegativeTestJSON-552357086 tempest-HostsAdminNegativeTestJSON-552357086-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '199473072ddc4190b18902cd1dfec440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338918f7613c4ee3b3417d15d4bb040f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:57.868766 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2f1faf15-5eac-4950-9624-9f7db95eb06d tempest-HostsAdminNegativeTestJSON-552357086 tempest-HostsAdminNegativeTestJSON-552357086-project] Request method failure captured: Oct 17 13:33:57.868766 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/os-hosts/n-d-854247-14/shutdown HTTP/1.1 Oct 17 13:33:57.868766 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:33:57.868766 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:33:57.868766 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:33:57.868766 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:33:57.868766 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:33:57.868766 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:33:57.868766 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:33:57.868766 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:57.868766 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVnACJ7F7hEyrrAf_YJd_shMx8ZwFNEttb0uNo0LaO-2ZkhWekyaFseZ0fiT6LgIO0wPJA8rJOx9domAJIjCRa6mpxixG3RnCswl7v_BVFtUotuL9t9VC3v79VWfUvjk8VQ_v8ozjCQ2sJJplL1W-o1PvMi2ckOw66yFoYNVBKfvULo Oct 17 13:33:57.868766 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:33:57.868766 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:33:57.868766 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:33:57.868766 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:33:57.868766 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:33:57.868766 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:33:57.868766 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 338918f7613c4ee3b3417d15d4bb040f Oct 17 13:33:57.868766 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-552357086 Oct 17 13:33:57.868766 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:33:57.868766 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:33:57.871518 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/338918f7613c4ee3b3417d15d4bb040f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/338918f7613c4ee3b3417d15d4bb040f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/338918f7613c4ee3b3417d15d4bb040f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_338918f7613c4ee3b3417d15d4bb040f", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:33:57.871518 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-HostsAdminNegativeTestJSON-552357086 Oct 17 13:33:57.871518 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 338918f7613c4ee3b3417d15d4bb040f Oct 17 13:33:57.871518 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-552357086 Oct 17 13:33:57.871518 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-HostsAdminNegativeTestJSON-552357086-project Oct 17 13:33:57.871518 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:33:57.871518 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:33:57.871518 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 199473072ddc4190b18902cd1dfec440 Oct 17 13:33:57.871518 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-HostsAdminNegativeTestJSON-552357086-project Oct 17 13:33:57.871518 n-d-854247-14 devstack@n-api.service[127016]: method: Oct 17 13:33:57.871518 n-d-854247-14 devstack@n-api.service[127016]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 17 13:33:57.871518 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'n-d-854247-14'} Oct 17 13:33:57.871518 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:57.872798 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:57.872798 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:57.872798 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:57.872798 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:57.872798 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:57.872798 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:33:57.872798 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:33:57.872798 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:57.872798 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:57.872798 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 17 13:33:57.872798 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 17 13:33:57.872798 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:33:57.872798 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:33:57.872798 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:33:57.872798 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:33:57.872798 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:33:57.872798 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:33:57.872798 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:33:57.872798 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:33:57.883055 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:33:57.883055 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:33:57.883055 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:33:57.883055 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:33:57.883055 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:33:57.883055 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:33:57.883055 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 17 13:33:57.883055 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:57.883055 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:57.883055 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:57.883055 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:57.883055 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:57.883055 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:57.883055 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:33:57.883055 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:33:57.883055 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 17 13:33:57.883055 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:57.887816 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2f1faf15-5eac-4950-9624-9f7db95eb06d tempest-HostsAdminNegativeTestJSON-552357086 tempest-HostsAdminNegativeTestJSON-552357086-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:57.887816 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2f1faf15-5eac-4950-9624-9f7db95eb06d tempest-HostsAdminNegativeTestJSON-552357086 tempest-HostsAdminNegativeTestJSON-552357086-project] 10.222.0.79 "GET /compute/v2.1/os-hosts/n-d-854247-14/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.023522 Oct 17 13:33:57.887816 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 70/159] 10.222.0.79 () {58 vars in 1197 bytes} [Mon Oct 17 13:33:57 2022] GET /compute/v2.1/os-hosts/n-d-854247-14/shutdown => generated 113 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:33:57.887816 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5bedcb68-fb8c-4fb6-9f01-7b3718227406 tempest-FlavorsExtraSpecsTestJSON-895300539 tempest-FlavorsExtraSpecsTestJSON-895300539-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:57.899345 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-fc83ca2f-39ba-47cb-88f1-d53f885039ed tempest-HostsAdminTestJSON-2102957320 tempest-HostsAdminTestJSON-2102957320-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.070542 Oct 17 13:33:57.903329 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 90/160] 10.222.0.79 () {58 vars in 1145 bytes} [Mon Oct 17 13:33:57 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:33:57.912173 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0126a7e1-7e14-4ea8-9ae3-bef05ec967f8 tempest-HostsAdminNegativeTestJSON-1591604348 tempest-HostsAdminNegativeTestJSON-1591604348-project-admin] Calling method '.version_select at 0x7f7cd62dc0d0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:57.924614 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5bedcb68-fb8c-4fb6-9f01-7b3718227406 tempest-FlavorsExtraSpecsTestJSON-895300539 tempest-FlavorsExtraSpecsTestJSON-895300539-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/187068791/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.047390 Oct 17 13:33:57.926223 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 71/161] 10.222.0.79 () {58 vars in 1200 bytes} [Mon Oct 17 13:33:57 2022] GET /compute/v2.1/flavors/187068791/os-extra_specs => generated 66 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:33:57.948228 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-0126a7e1-7e14-4ea8-9ae3-bef05ec967f8 tempest-HostsAdminNegativeTestJSON-1591604348 tempest-HostsAdminNegativeTestJSON-1591604348-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 13:33:57.948379 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-14be67cc-9bdf-42a6-9c84-309db6f51ff1 tempest-FlavorsExtraSpecsTestJSON-895300539 tempest-FlavorsExtraSpecsTestJSON-895300539-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:57.948525 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0126a7e1-7e14-4ea8-9ae3-bef05ec967f8 tempest-HostsAdminNegativeTestJSON-1591604348 tempest-HostsAdminNegativeTestJSON-1591604348-project-admin] Request method failure captured: Oct 17 13:33:57.948525 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 17 13:33:57.948525 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:33:57.948525 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:33:57.948525 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:33:57.948525 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:33:57.948525 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:33:57.948525 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:33:57.948525 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:33:57.948525 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:57.948525 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVnDag3TA1I7h3FRA6L5Lcb8GJH-kgbKOe8ATinhIu3EYZ-DgfBQDye1kSZGF6stlFIeCsbFnire4DzeOv83ODCdr3Hwqanq2TCAFMH1_Zx4_a2px1OLRHWBLy9UOjpSguwxfs7yc41am10jDetDSYCU1UAZxmzJkECW2X4x_UZUIkk Oct 17 13:33:57.948525 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:33:57.948525 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:33:57.948525 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:33:57.948525 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:33:57.948525 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:33:57.948525 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:33:57.948525 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: f5b060cf049e4c7e87cdd4f43e3b83e8 Oct 17 13:33:57.948525 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1591604348 Oct 17 13:33:57.948525 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member,admin Oct 17 13:33:57.948525 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member,admin Oct 17 13:33:57.950538 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f5b060cf049e4c7e87cdd4f43e3b83e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f5b060cf049e4c7e87cdd4f43e3b83e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f5b060cf049e4c7e87cdd4f43e3b83e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f5b060cf049e4c7e87cdd4f43e3b83e8", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:33:57.950538 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1591604348 Oct 17 13:33:57.950538 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: f5b060cf049e4c7e87cdd4f43e3b83e8 Oct 17 13:33:57.950538 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1591604348 Oct 17 13:33:57.950538 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-HostsAdminNegativeTestJSON-1591604348-project-admin Oct 17 13:33:57.950538 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:33:57.950538 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:33:57.950538 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: f8338c65ea674400b1d60aa3442adfa5 Oct 17 13:33:57.950538 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1591604348-project-admin Oct 17 13:33:57.950538 n-d-854247-14 devstack@n-api.service[127017]: method: Oct 17 13:33:57.950538 n-d-854247-14 devstack@n-api.service[127017]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 13:33:57.950538 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'nonexistent_hostname'} Oct 17 13:33:57.950538 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:57.959451 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:57.959451 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 17 13:33:57.959451 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 17 13:33:57.959451 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 17 13:33:57.959451 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 17 13:33:57.959451 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:33:57.959451 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:33:57.959451 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:33:57.959451 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:33:57.959451 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 17 13:33:57.959451 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 17 13:33:57.959451 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 17 13:33:57.959451 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 17 13:33:57.959451 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:33:57.959451 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:33:57.959451 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 17 13:33:57.959451 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 17 13:33:57.959451 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 13:33:57.959451 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 13:33:57.964391 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 17 13:33:57.964391 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 17 13:33:57.964391 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 13:33:57.964391 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:33:57.964391 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:57.964391 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:33:57.964391 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:57.964391 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:57.964391 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:57.964391 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:57.964391 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:57.964391 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:33:57.964391 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:33:57.964391 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:57.964391 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:57.964391 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 17 13:33:57.964391 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 17 13:33:57.964391 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 17 13:33:57.964391 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:33:57.967818 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 13:33:57.967818 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:33:57.967818 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:57.967818 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:33:57.967818 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:57.967818 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:57.967818 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:57.967818 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:33:57.967818 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:33:57.967818 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 13:33:57.967818 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:33:57.967818 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0126a7e1-7e14-4ea8-9ae3-bef05ec967f8 tempest-HostsAdminNegativeTestJSON-1591604348 tempest-HostsAdminNegativeTestJSON-1591604348-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:57.967818 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0126a7e1-7e14-4ea8-9ae3-bef05ec967f8 tempest-HostsAdminNegativeTestJSON-1591604348 tempest-HostsAdminNegativeTestJSON-1591604348-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.045419 Oct 17 13:33:57.967818 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 91/162] 10.222.0.79 () {58 vars in 1218 bytes} [Mon Oct 17 13:33:57 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:33:57.995781 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-14be67cc-9bdf-42a6-9c84-309db6f51ff1 tempest-FlavorsExtraSpecsTestJSON-895300539 tempest-FlavorsExtraSpecsTestJSON-895300539-project-admin] 10.222.0.79 "PUT /compute/v2.1/flavors/187068791/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.063772 Oct 17 13:33:58.000459 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 72/163] 10.222.0.79 () {60 vars in 1262 bytes} [Mon Oct 17 13:33:57 2022] PUT /compute/v2.1/flavors/187068791/os-extra_specs/hw:numa_nodes => generated 22 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 17 13:33:58.003471 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e8be3970-eb67-4c57-9214-db4ab79a7a8f tempest-HostsAdminNegativeTestJSON-552357086 tempest-HostsAdminNegativeTestJSON-552357086-project] Calling method '.version_select at 0x7f7cd6407790>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:58.005201 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e8be3970-eb67-4c57-9214-db4ab79a7a8f tempest-HostsAdminNegativeTestJSON-552357086 tempest-HostsAdminNegativeTestJSON-552357086-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '199473072ddc4190b18902cd1dfec440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338918f7613c4ee3b3417d15d4bb040f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:58.006728 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e8be3970-eb67-4c57-9214-db4ab79a7a8f tempest-HostsAdminNegativeTestJSON-552357086 tempest-HostsAdminNegativeTestJSON-552357086-project] Request method failure captured: Oct 17 13:33:58.006728 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/os-hosts/n-d-854247-14/startup HTTP/1.1 Oct 17 13:33:58.006728 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:33:58.006728 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:33:58.006728 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:33:58.006728 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:33:58.006728 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:33:58.006728 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:33:58.006728 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:33:58.006728 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:58.006728 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVnACJ7F7hEyrrAf_YJd_shMx8ZwFNEttb0uNo0LaO-2ZkhWekyaFseZ0fiT6LgIO0wPJA8rJOx9domAJIjCRa6mpxixG3RnCswl7v_BVFtUotuL9t9VC3v79VWfUvjk8VQ_v8ozjCQ2sJJplL1W-o1PvMi2ckOw66yFoYNVBKfvULo Oct 17 13:33:58.006728 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:33:58.006728 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:33:58.006728 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:33:58.006728 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:33:58.006728 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:33:58.006728 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:33:58.006728 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 338918f7613c4ee3b3417d15d4bb040f Oct 17 13:33:58.006728 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-552357086 Oct 17 13:33:58.006728 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:33:58.006728 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:33:58.008040 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/338918f7613c4ee3b3417d15d4bb040f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/338918f7613c4ee3b3417d15d4bb040f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/338918f7613c4ee3b3417d15d4bb040f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_338918f7613c4ee3b3417d15d4bb040f", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:33:58.008040 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-HostsAdminNegativeTestJSON-552357086 Oct 17 13:33:58.008040 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 338918f7613c4ee3b3417d15d4bb040f Oct 17 13:33:58.008040 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-552357086 Oct 17 13:33:58.008040 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-HostsAdminNegativeTestJSON-552357086-project Oct 17 13:33:58.008040 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:33:58.008040 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:33:58.008040 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 199473072ddc4190b18902cd1dfec440 Oct 17 13:33:58.008040 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-HostsAdminNegativeTestJSON-552357086-project Oct 17 13:33:58.008040 n-d-854247-14 devstack@n-api.service[127016]: method: Oct 17 13:33:58.008040 n-d-854247-14 devstack@n-api.service[127016]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 17 13:33:58.008040 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'n-d-854247-14'} Oct 17 13:33:58.008040 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:58.008683 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:58.008683 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:58.008683 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:58.008683 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:58.008683 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:58.008683 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:33:58.008683 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:33:58.008683 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:58.008683 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:58.008683 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 17 13:33:58.008683 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 17 13:33:58.008683 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:33:58.008683 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:33:58.008683 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:33:58.008683 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:33:58.008683 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:33:58.008683 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:33:58.008683 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:33:58.008683 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:33:58.009658 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:33:58.009658 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:33:58.009658 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:33:58.009658 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:33:58.009658 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:33:58.009658 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:33:58.009658 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 17 13:33:58.009658 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:58.009658 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:58.009658 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:58.009658 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:58.009658 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:58.009658 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:58.009658 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:33:58.009658 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:33:58.009658 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 17 13:33:58.009658 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:58.011395 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e8be3970-eb67-4c57-9214-db4ab79a7a8f tempest-HostsAdminNegativeTestJSON-552357086 tempest-HostsAdminNegativeTestJSON-552357086-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:58.011395 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e8be3970-eb67-4c57-9214-db4ab79a7a8f tempest-HostsAdminNegativeTestJSON-552357086 tempest-HostsAdminNegativeTestJSON-552357086-project] 10.222.0.79 "GET /compute/v2.1/os-hosts/n-d-854247-14/startup" status: 403 len: 110 microversion: 2.1 time: 0.010355 Oct 17 13:33:58.011395 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 73/164] 10.222.0.79 () {58 vars in 1194 bytes} [Mon Oct 17 13:33:57 2022] GET /compute/v2.1/os-hosts/n-d-854247-14/startup => generated 110 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:33:58.013833 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-af6f8394-6873-4565-a80b-921b99e031d9 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:58.014844 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-af6f8394-6873-4565-a80b-921b99e031d9 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] [instance: eb4474f8-de59-4187-8b15-ba0ec266bfa6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:58.021871 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af6f8394-6873-4565-a80b-921b99e031d9 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:58.022675 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af6f8394-6873-4565-a80b-921b99e031d9 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:58.023429 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af6f8394-6873-4565-a80b-921b99e031d9 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:58.024102 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af6f8394-6873-4565-a80b-921b99e031d9 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:58.024547 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af6f8394-6873-4565-a80b-921b99e031d9 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:58.025145 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af6f8394-6873-4565-a80b-921b99e031d9 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:58.228732 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-af6f8394-6873-4565-a80b-921b99e031d9 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4552e3fbd4de4d2997d5db7ec500de65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e76de886880490ba8373e0d86056c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:58.237700 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-af6f8394-6873-4565-a80b-921b99e031d9 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] 10.222.0.79 "GET /compute/v2.1/servers/eb4474f8-de59-4187-8b15-ba0ec266bfa6" status: 200 len: 1338 microversion: 2.1 time: 0.227282 Oct 17 13:33:58.238321 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 74/165] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:58 2022] GET /compute/v2.1/servers/eb4474f8-de59-4187-8b15-ba0ec266bfa6 => generated 1338 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:58.254171 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4f2bdb34-1cd8-45fb-b09e-a82336903ad0 tempest-FlavorsExtraSpecsTestJSON-895300539 tempest-FlavorsExtraSpecsTestJSON-895300539-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:58.265385 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4f2bdb34-1cd8-45fb-b09e-a82336903ad0 tempest-FlavorsExtraSpecsTestJSON-895300539 tempest-FlavorsExtraSpecsTestJSON-895300539-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/187068791/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.017558 Oct 17 13:33:58.266503 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 75/166] 10.222.0.79 () {58 vars in 1200 bytes} [Mon Oct 17 13:33:58 2022] GET /compute/v2.1/flavors/187068791/os-extra_specs => generated 66 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:33:58.275638 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9481a363-f5c4-4192-b3e3-87d75ef6a6c3 tempest-HostsAdminNegativeTestJSON-1591604348 tempest-HostsAdminNegativeTestJSON-1591604348-project-admin] Calling method '.version_select at 0x7f7cd641f280>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:58.288742 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-9481a363-f5c4-4192-b3e3-87d75ef6a6c3 tempest-HostsAdminNegativeTestJSON-1591604348 tempest-HostsAdminNegativeTestJSON-1591604348-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 13:33:58.296880 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9481a363-f5c4-4192-b3e3-87d75ef6a6c3 tempest-HostsAdminNegativeTestJSON-1591604348 tempest-HostsAdminNegativeTestJSON-1591604348-project-admin] Request method failure captured: Oct 17 13:33:58.296880 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 17 13:33:58.296880 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:33:58.296880 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:33:58.296880 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:33:58.296880 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:33:58.296880 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:33:58.296880 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:33:58.296880 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:33:58.296880 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:58.296880 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVnDag3TA1I7h3FRA6L5Lcb8GJH-kgbKOe8ATinhIu3EYZ-DgfBQDye1kSZGF6stlFIeCsbFnire4DzeOv83ODCdr3Hwqanq2TCAFMH1_Zx4_a2px1OLRHWBLy9UOjpSguwxfs7yc41am10jDetDSYCU1UAZxmzJkECW2X4x_UZUIkk Oct 17 13:33:58.296880 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:33:58.296880 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:33:58.296880 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:33:58.296880 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:33:58.296880 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:33:58.296880 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:33:58.296880 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: f5b060cf049e4c7e87cdd4f43e3b83e8 Oct 17 13:33:58.296880 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1591604348 Oct 17 13:33:58.296880 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member,admin Oct 17 13:33:58.296880 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member,admin Oct 17 13:33:58.298050 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f5b060cf049e4c7e87cdd4f43e3b83e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f5b060cf049e4c7e87cdd4f43e3b83e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f5b060cf049e4c7e87cdd4f43e3b83e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f5b060cf049e4c7e87cdd4f43e3b83e8", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:33:58.298050 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1591604348 Oct 17 13:33:58.298050 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: f5b060cf049e4c7e87cdd4f43e3b83e8 Oct 17 13:33:58.298050 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1591604348 Oct 17 13:33:58.298050 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-HostsAdminNegativeTestJSON-1591604348-project-admin Oct 17 13:33:58.298050 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:33:58.298050 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:33:58.298050 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: f8338c65ea674400b1d60aa3442adfa5 Oct 17 13:33:58.298050 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1591604348-project-admin Oct 17 13:33:58.298050 n-d-854247-14 devstack@n-api.service[127016]: method: Oct 17 13:33:58.298050 n-d-854247-14 devstack@n-api.service[127016]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 13:33:58.298050 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'nonexistent_hostname'} Oct 17 13:33:58.298050 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:58.298695 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:58.298695 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 17 13:33:58.298695 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 17 13:33:58.298695 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 17 13:33:58.298695 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 17 13:33:58.298695 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:33:58.298695 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:33:58.298695 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:33:58.298695 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:33:58.298695 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 17 13:33:58.298695 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 17 13:33:58.298695 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 17 13:33:58.298695 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 17 13:33:58.298695 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:33:58.298695 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:33:58.298695 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 17 13:33:58.298695 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 17 13:33:58.298695 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 13:33:58.298695 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 13:33:58.299686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 17 13:33:58.299686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 17 13:33:58.299686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 13:33:58.299686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:58.299686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:58.299686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:58.299686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:58.299686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:58.299686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:58.299686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:58.299686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:58.299686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:33:58.299686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:33:58.299686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:58.299686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:58.299686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 17 13:33:58.299686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 17 13:33:58.299686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 17 13:33:58.299686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:33:58.300592 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 13:33:58.300592 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:58.300592 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:58.300592 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:58.300592 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:58.300592 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:58.300592 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:58.300592 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:33:58.300592 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:33:58.300592 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 13:33:58.300592 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:58.303630 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9481a363-f5c4-4192-b3e3-87d75ef6a6c3 tempest-HostsAdminNegativeTestJSON-1591604348 tempest-HostsAdminNegativeTestJSON-1591604348-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:58.307432 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9481a363-f5c4-4192-b3e3-87d75ef6a6c3 tempest-HostsAdminNegativeTestJSON-1591604348 tempest-HostsAdminNegativeTestJSON-1591604348-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.038063 Oct 17 13:33:58.309281 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 76/167] 10.222.0.79 () {58 vars in 1215 bytes} [Mon Oct 17 13:33:58 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:33:58.327688 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-29aea65b-ea50-45f8-87d9-17be1516b24e tempest-FlavorsExtraSpecsTestJSON-895300539 tempest-FlavorsExtraSpecsTestJSON-895300539-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:58.374253 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-29aea65b-ea50-45f8-87d9-17be1516b24e tempest-FlavorsExtraSpecsTestJSON-895300539 tempest-FlavorsExtraSpecsTestJSON-895300539-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/187068791/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.055042 Oct 17 13:33:58.375642 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 77/168] 10.222.0.79 () {58 vars in 1245 bytes} [Mon Oct 17 13:33:58 2022] DELETE /compute/v2.1/flavors/187068791/os-extra_specs/hw:numa_nodes => generated 0 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 13:33:58.386080 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5253766f-cd61-45ef-914a-4d0357cd8152 tempest-HostsAdminNegativeTestJSON-1591604348 tempest-HostsAdminNegativeTestJSON-1591604348-project-admin] Action: 'update', calling method: .version_select at 0x7f7cd6407af0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:58.390134 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-67f9242a-f85b-4c73-8bc8-0480e545fe07 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:58.406976 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5253766f-cd61-45ef-914a-4d0357cd8152 tempest-HostsAdminNegativeTestJSON-1591604348 tempest-HostsAdminNegativeTestJSON-1591604348-project-admin] Request method failure captured: Oct 17 13:33:58.406976 n-d-854247-14 devstack@n-api.service[127016]: request: PUT /compute/v2.1/os-hosts/n-d-854247-14 HTTP/1.1 Oct 17 13:33:58.406976 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:33:58.406976 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:33:58.406976 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:33:58.406976 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 51 Oct 17 13:33:58.406976 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:33:58.406976 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:33:58.406976 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:33:58.406976 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:58.406976 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVnDag3TA1I7h3FRA6L5Lcb8GJH-kgbKOe8ATinhIu3EYZ-DgfBQDye1kSZGF6stlFIeCsbFnire4DzeOv83ODCdr3Hwqanq2TCAFMH1_Zx4_a2px1OLRHWBLy9UOjpSguwxfs7yc41am10jDetDSYCU1UAZxmzJkECW2X4x_UZUIkk Oct 17 13:33:58.406976 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:33:58.406976 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:33:58.406976 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:33:58.406976 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:33:58.406976 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:33:58.406976 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:33:58.406976 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: f5b060cf049e4c7e87cdd4f43e3b83e8 Oct 17 13:33:58.406976 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1591604348 Oct 17 13:33:58.406976 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member,admin Oct 17 13:33:58.406976 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member,admin Oct 17 13:33:58.408234 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f5b060cf049e4c7e87cdd4f43e3b83e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f5b060cf049e4c7e87cdd4f43e3b83e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f5b060cf049e4c7e87cdd4f43e3b83e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f5b060cf049e4c7e87cdd4f43e3b83e8", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:33:58.408234 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1591604348 Oct 17 13:33:58.408234 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: f5b060cf049e4c7e87cdd4f43e3b83e8 Oct 17 13:33:58.408234 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1591604348 Oct 17 13:33:58.408234 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-HostsAdminNegativeTestJSON-1591604348-project-admin Oct 17 13:33:58.408234 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:33:58.408234 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:33:58.408234 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: f8338c65ea674400b1d60aa3442adfa5 Oct 17 13:33:58.408234 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1591604348-project-admin Oct 17 13:33:58.408234 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:33:58.408234 n-d-854247-14 devstack@n-api.service[127016]: {"status": "enable", "maintenance_mode": "invalid"} Oct 17 13:33:58.408234 n-d-854247-14 devstack@n-api.service[127016]: method: Oct 17 13:33:58.408234 n-d-854247-14 devstack@n-api.service[127016]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 17 13:33:58.408930 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'n-d-854247-14', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 17 13:33:58.408930 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:58.408930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:58.408930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:33:58.408930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:33:58.408930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:33:58.408930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:33:58.408930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 17 13:33:58.408930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:58.408930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 17 13:33:58.408930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 17 13:33:58.408930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi 'disable', Oct 17 13:33:58.408930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi 'Enable', Oct 17 13:33:58.408930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi 'Disable', Oct 17 13:33:58.408930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 17 13:33:58.408930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 17 13:33:58.408930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 17 13:33:58.408930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:58.408930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi On instance: Oct 17 13:33:58.408930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi 'invalid' Oct 17 13:33:58.408930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:58.408930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:58.408930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:58.408930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:58.408930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:58.410361 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:58.410361 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:58.410361 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:58.410361 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:33:58.410361 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:33:58.410361 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:58.410361 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:58.410361 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:33:58.410361 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:33:58.410361 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:33:58.410361 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:33:58.410361 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:33:58.410361 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:33:58.410361 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 17 13:33:58.410361 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:58.410361 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:58.410361 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:58.410361 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:58.410361 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:58.411386 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:58.411386 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:33:58.411386 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:33:58.411386 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 17 13:33:58.411386 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:58.411661 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-67f9242a-f85b-4c73-8bc8-0480e545fe07 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] 10.222.0.79 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.453826 Oct 17 13:33:58.412735 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5253766f-cd61-45ef-914a-4d0357cd8152 tempest-HostsAdminNegativeTestJSON-1591604348 tempest-HostsAdminNegativeTestJSON-1591604348-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:58.414155 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5253766f-cd61-45ef-914a-4d0357cd8152 tempest-HostsAdminNegativeTestJSON-1591604348 tempest-HostsAdminNegativeTestJSON-1591604348-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-hosts/n-d-854247-14" status: 400 len: 199 microversion: 2.1 time: 0.036731 Oct 17 13:33:58.418664 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 78/169] 10.222.0.79 () {60 vars in 1190 bytes} [Mon Oct 17 13:33:58 2022] PUT /compute/v2.1/os-hosts/n-d-854247-14 => generated 199 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:33:58.418887 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 92/170] 10.222.0.79 () {58 vars in 1137 bytes} [Mon Oct 17 13:33:57 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:33:58.424278 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fbe51d62-dc2b-42e6-b431-a6ab2525e943 tempest-FlavorsExtraSpecsTestJSON-895300539 tempest-FlavorsExtraSpecsTestJSON-895300539-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:58.463604 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fbe51d62-dc2b-42e6-b431-a6ab2525e943 tempest-FlavorsExtraSpecsTestJSON-895300539 tempest-FlavorsExtraSpecsTestJSON-895300539-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/187068791/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.047719 Oct 17 13:33:58.464377 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 79/171] 10.222.0.79 () {58 vars in 1245 bytes} [Mon Oct 17 13:33:58 2022] DELETE /compute/v2.1/flavors/187068791/os-extra_specs/hw:cpu_policy => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 13:33:58.478677 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-39f7dd6c-0571-4035-bfd5-3773ccc2fbcd tempest-HostsAdminNegativeTestJSON-1591604348 tempest-HostsAdminNegativeTestJSON-1591604348-project-admin] Action: 'update', calling method: .version_select at 0x7f7cd641f040>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:58.484603 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-39f7dd6c-0571-4035-bfd5-3773ccc2fbcd tempest-HostsAdminNegativeTestJSON-1591604348 tempest-HostsAdminNegativeTestJSON-1591604348-project-admin] Request method failure captured: Oct 17 13:33:58.484603 n-d-854247-14 devstack@n-api.service[127016]: request: PUT /compute/v2.1/os-hosts/n-d-854247-14 HTTP/1.1 Oct 17 13:33:58.484603 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:33:58.484603 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:33:58.484603 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:33:58.484603 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 51 Oct 17 13:33:58.484603 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:33:58.484603 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:33:58.484603 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:33:58.484603 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:58.484603 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVnDag3TA1I7h3FRA6L5Lcb8GJH-kgbKOe8ATinhIu3EYZ-DgfBQDye1kSZGF6stlFIeCsbFnire4DzeOv83ODCdr3Hwqanq2TCAFMH1_Zx4_a2px1OLRHWBLy9UOjpSguwxfs7yc41am10jDetDSYCU1UAZxmzJkECW2X4x_UZUIkk Oct 17 13:33:58.484603 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:33:58.484603 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:33:58.484603 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:33:58.484603 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:33:58.484603 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:33:58.484603 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:33:58.484603 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: f5b060cf049e4c7e87cdd4f43e3b83e8 Oct 17 13:33:58.484603 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1591604348 Oct 17 13:33:58.484603 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member,admin Oct 17 13:33:58.484603 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member,admin Oct 17 13:33:58.486035 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f5b060cf049e4c7e87cdd4f43e3b83e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f5b060cf049e4c7e87cdd4f43e3b83e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f5b060cf049e4c7e87cdd4f43e3b83e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f5b060cf049e4c7e87cdd4f43e3b83e8", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:33:58.486035 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1591604348 Oct 17 13:33:58.486035 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: f5b060cf049e4c7e87cdd4f43e3b83e8 Oct 17 13:33:58.486035 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1591604348 Oct 17 13:33:58.486035 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-HostsAdminNegativeTestJSON-1591604348-project-admin Oct 17 13:33:58.486035 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:33:58.486035 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:33:58.486035 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: f8338c65ea674400b1d60aa3442adfa5 Oct 17 13:33:58.486035 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1591604348-project-admin Oct 17 13:33:58.486035 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:33:58.486035 n-d-854247-14 devstack@n-api.service[127016]: {"status": "invalid", "maintenance_mode": "enable"} Oct 17 13:33:58.486035 n-d-854247-14 devstack@n-api.service[127016]: method: Oct 17 13:33:58.486035 n-d-854247-14 devstack@n-api.service[127016]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 17 13:33:58.486903 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'n-d-854247-14', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 17 13:33:58.486903 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:58.486903 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:58.486903 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:33:58.486903 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:33:58.486903 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:33:58.486903 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:33:58.486903 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 17 13:33:58.486903 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:58.486903 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 17 13:33:58.486903 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 17 13:33:58.486903 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi 'disable', Oct 17 13:33:58.486903 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi 'Enable', Oct 17 13:33:58.486903 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi 'Disable', Oct 17 13:33:58.486903 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 17 13:33:58.486903 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 17 13:33:58.486903 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 17 13:33:58.486903 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:58.486903 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi On instance: Oct 17 13:33:58.486903 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi 'invalid' Oct 17 13:33:58.486903 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:58.486903 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:58.486903 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:58.486903 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:58.486903 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:58.488959 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:58.488959 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:58.488959 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:58.488959 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:33:58.488959 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:33:58.488959 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:58.488959 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:58.488959 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:33:58.488959 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:33:58.488959 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:33:58.488959 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:33:58.488959 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:33:58.488959 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:33:58.488959 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 17 13:33:58.488959 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:58.488959 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:58.488959 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:58.488959 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:58.488959 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:58.490157 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:58.490157 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:33:58.490157 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:33:58.490157 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 17 13:33:58.490157 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:58.491463 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-39f7dd6c-0571-4035-bfd5-3773ccc2fbcd tempest-HostsAdminNegativeTestJSON-1591604348 tempest-HostsAdminNegativeTestJSON-1591604348-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:58.495778 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-39f7dd6c-0571-4035-bfd5-3773ccc2fbcd tempest-HostsAdminNegativeTestJSON-1591604348 tempest-HostsAdminNegativeTestJSON-1591604348-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-hosts/n-d-854247-14" status: 400 len: 189 microversion: 2.1 time: 0.024940 Oct 17 13:33:58.498891 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 80/172] 10.222.0.79 () {60 vars in 1190 bytes} [Mon Oct 17 13:33:58 2022] PUT /compute/v2.1/os-hosts/n-d-854247-14 => generated 189 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:33:58.505086 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a9448c37-262d-4e67-bf68-986033463893 tempest-FlavorsExtraSpecsTestJSON-895300539 tempest-FlavorsExtraSpecsTestJSON-895300539-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:58.513965 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=3,nova_api:DELETE=5,nova_api:INSERT=1,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:33:58.518150 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a9448c37-262d-4e67-bf68-986033463893 tempest-FlavorsExtraSpecsTestJSON-895300539 tempest-FlavorsExtraSpecsTestJSON-895300539-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/187068791/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.017897 Oct 17 13:33:58.518959 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 81/173] 10.222.0.79 () {58 vars in 1200 bytes} [Mon Oct 17 13:33:58 2022] GET /compute/v2.1/flavors/187068791/os-extra_specs => generated 19 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:33:58.530447 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4ad412b9-3340-4952-83a7-3c687dffcc33 tempest-HostsAdminNegativeTestJSON-552357086 tempest-HostsAdminNegativeTestJSON-552357086-project] Action: 'update', calling method: .version_select at 0x7f7cd643da60>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:58.534329 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4ad412b9-3340-4952-83a7-3c687dffcc33 tempest-HostsAdminNegativeTestJSON-552357086 tempest-HostsAdminNegativeTestJSON-552357086-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '199473072ddc4190b18902cd1dfec440', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338918f7613c4ee3b3417d15d4bb040f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:58.536302 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4ad412b9-3340-4952-83a7-3c687dffcc33 tempest-HostsAdminNegativeTestJSON-552357086 tempest-HostsAdminNegativeTestJSON-552357086-project] Request method failure captured: Oct 17 13:33:58.536302 n-d-854247-14 devstack@n-api.service[127016]: request: PUT /compute/v2.1/os-hosts/n-d-854247-14 HTTP/1.1 Oct 17 13:33:58.536302 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:33:58.536302 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:33:58.536302 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:33:58.536302 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 50 Oct 17 13:33:58.536302 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:33:58.536302 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:33:58.536302 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:33:58.536302 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:58.536302 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVnACJ7F7hEyrrAf_YJd_shMx8ZwFNEttb0uNo0LaO-2ZkhWekyaFseZ0fiT6LgIO0wPJA8rJOx9domAJIjCRa6mpxixG3RnCswl7v_BVFtUotuL9t9VC3v79VWfUvjk8VQ_v8ozjCQ2sJJplL1W-o1PvMi2ckOw66yFoYNVBKfvULo Oct 17 13:33:58.536302 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:33:58.536302 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:33:58.536302 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:33:58.536302 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:33:58.536302 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:33:58.536302 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:33:58.536302 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 338918f7613c4ee3b3417d15d4bb040f Oct 17 13:33:58.536302 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-552357086 Oct 17 13:33:58.536302 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:33:58.536302 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:33:58.537395 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/338918f7613c4ee3b3417d15d4bb040f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/338918f7613c4ee3b3417d15d4bb040f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/338918f7613c4ee3b3417d15d4bb040f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_338918f7613c4ee3b3417d15d4bb040f", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:33:58.537395 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-HostsAdminNegativeTestJSON-552357086 Oct 17 13:33:58.537395 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 338918f7613c4ee3b3417d15d4bb040f Oct 17 13:33:58.537395 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-552357086 Oct 17 13:33:58.537395 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-HostsAdminNegativeTestJSON-552357086-project Oct 17 13:33:58.537395 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:33:58.537395 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:33:58.537395 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 199473072ddc4190b18902cd1dfec440 Oct 17 13:33:58.537395 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-HostsAdminNegativeTestJSON-552357086-project Oct 17 13:33:58.537395 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:33:58.537395 n-d-854247-14 devstack@n-api.service[127016]: {"status": "enable", "maintenance_mode": "enable"} Oct 17 13:33:58.537395 n-d-854247-14 devstack@n-api.service[127016]: method: Oct 17 13:33:58.537395 n-d-854247-14 devstack@n-api.service[127016]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 17 13:33:58.537395 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'n-d-854247-14', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 17 13:33:58.538119 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:58.538119 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:58.538119 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:58.538119 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:58.538119 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:58.538119 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:58.538119 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:33:58.538119 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:33:58.538119 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:58.538119 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:58.538119 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:33:58.538119 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:33:58.538119 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 17 13:33:58.538119 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 17 13:33:58.538119 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:33:58.538119 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:33:58.538119 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:33:58.538119 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:33:58.538119 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:33:58.538119 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:33:58.539095 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:33:58.539095 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:33:58.539095 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:33:58.539095 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:33:58.539095 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:33:58.539095 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:33:58.539095 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:33:58.539095 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:33:58.539095 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 17 13:33:58.539095 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:58.539095 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:58.539095 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:58.539095 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:58.539095 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:58.539095 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:58.539095 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:33:58.539095 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:33:58.539095 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 17 13:33:58.539095 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:58.541597 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4ad412b9-3340-4952-83a7-3c687dffcc33 tempest-HostsAdminNegativeTestJSON-552357086 tempest-HostsAdminNegativeTestJSON-552357086-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:58.546535 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4ad412b9-3340-4952-83a7-3c687dffcc33 tempest-HostsAdminNegativeTestJSON-552357086 tempest-HostsAdminNegativeTestJSON-552357086-project] 10.222.0.79 "PUT /compute/v2.1/os-hosts/n-d-854247-14" status: 403 len: 111 microversion: 2.1 time: 0.019537 Oct 17 13:33:58.547400 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 82/174] 10.222.0.79 () {60 vars in 1190 bytes} [Mon Oct 17 13:33:58 2022] PUT /compute/v2.1/os-hosts/n-d-854247-14 => generated 111 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:33:58.555709 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1d82394c-a2b6-47d8-aedf-9daadf428ca7 tempest-FlavorsExtraSpecsTestJSON-895300539 tempest-FlavorsExtraSpecsTestJSON-895300539-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:58.592607 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1d82394c-a2b6-47d8-aedf-9daadf428ca7 tempest-FlavorsExtraSpecsTestJSON-895300539 tempest-FlavorsExtraSpecsTestJSON-895300539-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/187068791" status: 202 len: 0 microversion: 2.1 time: 0.041146 Oct 17 13:33:58.596791 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 83/175] 10.222.0.79 () {58 vars in 1158 bytes} [Mon Oct 17 13:33:58 2022] DELETE /compute/v2.1/flavors/187068791 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:33:58.602571 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-87110646-d11e-4338-9cc2-633cae648e2a tempest-HostsAdminNegativeTestJSON-1591604348 tempest-HostsAdminNegativeTestJSON-1591604348-project-admin] Action: 'update', calling method: .version_select at 0x7f7cd62cedc0>, body: {"status": null, "maintenance_mode": null} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:58.607656 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-87110646-d11e-4338-9cc2-633cae648e2a tempest-HostsAdminNegativeTestJSON-1591604348 tempest-HostsAdminNegativeTestJSON-1591604348-project-admin] Request method failure captured: Oct 17 13:33:58.607656 n-d-854247-14 devstack@n-api.service[127016]: request: PUT /compute/v2.1/os-hosts/n-d-854247-14 HTTP/1.1 Oct 17 13:33:58.607656 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:33:58.607656 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:33:58.607656 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:33:58.607656 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 42 Oct 17 13:33:58.607656 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:33:58.607656 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:33:58.607656 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:33:58.607656 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:58.607656 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVnDag3TA1I7h3FRA6L5Lcb8GJH-kgbKOe8ATinhIu3EYZ-DgfBQDye1kSZGF6stlFIeCsbFnire4DzeOv83ODCdr3Hwqanq2TCAFMH1_Zx4_a2px1OLRHWBLy9UOjpSguwxfs7yc41am10jDetDSYCU1UAZxmzJkECW2X4x_UZUIkk Oct 17 13:33:58.607656 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:33:58.607656 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:33:58.607656 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:33:58.607656 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:33:58.607656 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:33:58.607656 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:33:58.607656 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: f5b060cf049e4c7e87cdd4f43e3b83e8 Oct 17 13:33:58.607656 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1591604348 Oct 17 13:33:58.607656 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member,admin Oct 17 13:33:58.607656 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member,admin Oct 17 13:33:58.608938 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f5b060cf049e4c7e87cdd4f43e3b83e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f5b060cf049e4c7e87cdd4f43e3b83e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f5b060cf049e4c7e87cdd4f43e3b83e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f5b060cf049e4c7e87cdd4f43e3b83e8", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:33:58.608938 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1591604348 Oct 17 13:33:58.608938 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: f5b060cf049e4c7e87cdd4f43e3b83e8 Oct 17 13:33:58.608938 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1591604348 Oct 17 13:33:58.608938 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-HostsAdminNegativeTestJSON-1591604348-project-admin Oct 17 13:33:58.608938 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:33:58.608938 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:33:58.608938 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: f8338c65ea674400b1d60aa3442adfa5 Oct 17 13:33:58.608938 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1591604348-project-admin Oct 17 13:33:58.608938 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:33:58.608938 n-d-854247-14 devstack@n-api.service[127016]: {"status": null, "maintenance_mode": null} Oct 17 13:33:58.608938 n-d-854247-14 devstack@n-api.service[127016]: method: Oct 17 13:33:58.608938 n-d-854247-14 devstack@n-api.service[127016]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 17 13:33:58.608938 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'n-d-854247-14', 'body': {'status': None, 'maintenance_mode': None}} Oct 17 13:33:58.609667 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:58.609667 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:58.609667 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:33:58.609667 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:33:58.609667 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:33:58.609667 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:33:58.609667 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 17 13:33:58.609667 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:58.609667 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 17 13:33:58.609667 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 17 13:33:58.609667 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi 'disable', Oct 17 13:33:58.609667 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi 'Enable', Oct 17 13:33:58.609667 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi 'Disable', Oct 17 13:33:58.609667 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 17 13:33:58.609667 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 17 13:33:58.609667 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 17 13:33:58.609667 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:58.609667 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi On instance: Oct 17 13:33:58.609667 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi None Oct 17 13:33:58.609667 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:58.609667 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:58.609667 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:58.609667 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:58.609667 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:58.609667 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:58.610908 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:58.610908 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:58.610908 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:33:58.610908 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:33:58.610908 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:58.610908 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:58.610908 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:33:58.610908 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:33:58.610908 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:33:58.610908 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:33:58.610908 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:33:58.610908 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:33:58.610908 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 17 13:33:58.610908 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:58.610908 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:58.610908 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:58.610908 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:58.610908 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:58.610908 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:58.611865 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:33:58.611865 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:33:58.611865 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 17 13:33:58.611865 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:58.613419 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-87110646-d11e-4338-9cc2-633cae648e2a tempest-HostsAdminNegativeTestJSON-1591604348 tempest-HostsAdminNegativeTestJSON-1591604348-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:58.614434 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-87110646-d11e-4338-9cc2-633cae648e2a tempest-HostsAdminNegativeTestJSON-1591604348 tempest-HostsAdminNegativeTestJSON-1591604348-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-hosts/n-d-854247-14" status: 400 len: 127 microversion: 2.1 time: 0.016264 Oct 17 13:33:58.616064 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 84/176] 10.222.0.79 () {60 vars in 1190 bytes} [Mon Oct 17 13:33:58 2022] PUT /compute/v2.1/os-hosts/n-d-854247-14 => generated 127 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:33:58.621875 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fb0708c0-da9e-4603-a19a-bf956952746c tempest-FlavorsExtraSpecsTestJSON-895300539 tempest-FlavorsExtraSpecsTestJSON-895300539-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:58.649892 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fb0708c0-da9e-4603-a19a-bf956952746c tempest-FlavorsExtraSpecsTestJSON-895300539 tempest-FlavorsExtraSpecsTestJSON-895300539-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032338 Oct 17 13:33:58.665867 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 85/177] 10.222.0.79 () {58 vars in 1146 bytes} [Mon Oct 17 13:33:58 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:58.692213 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-23d784db-881d-461a-a004-1fee22ec24bd tempest-HostsAdminNegativeTestJSON-1591604348 tempest-HostsAdminNegativeTestJSON-1591604348-project-admin] Action: 'update', calling method: .version_select at 0x7f7cd6666550>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:58.702926 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.hosts [None req-23d784db-881d-461a-a004-1fee22ec24bd tempest-HostsAdminNegativeTestJSON-1591604348 tempest-HostsAdminNegativeTestJSON-1591604348-project-admin] Enabling host nonexistent_hostname. Oct 17 13:33:58.724206 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-23d784db-881d-461a-a004-1fee22ec24bd tempest-HostsAdminNegativeTestJSON-1591604348 tempest-HostsAdminNegativeTestJSON-1591604348-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 13:33:58.727017 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-23d784db-881d-461a-a004-1fee22ec24bd tempest-HostsAdminNegativeTestJSON-1591604348 tempest-HostsAdminNegativeTestJSON-1591604348-project-admin] Request method failure captured: Oct 17 13:33:58.727017 n-d-854247-14 devstack@n-api.service[127016]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 17 13:33:58.727017 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:33:58.727017 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:33:58.727017 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:33:58.727017 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 50 Oct 17 13:33:58.727017 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:33:58.727017 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:33:58.727017 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:33:58.727017 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:58.727017 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVnDag3TA1I7h3FRA6L5Lcb8GJH-kgbKOe8ATinhIu3EYZ-DgfBQDye1kSZGF6stlFIeCsbFnire4DzeOv83ODCdr3Hwqanq2TCAFMH1_Zx4_a2px1OLRHWBLy9UOjpSguwxfs7yc41am10jDetDSYCU1UAZxmzJkECW2X4x_UZUIkk Oct 17 13:33:58.727017 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:33:58.727017 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:33:58.727017 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:33:58.727017 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:33:58.727017 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:33:58.727017 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:33:58.727017 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: f5b060cf049e4c7e87cdd4f43e3b83e8 Oct 17 13:33:58.727017 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1591604348 Oct 17 13:33:58.727017 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member,admin Oct 17 13:33:58.727017 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member,admin Oct 17 13:33:58.728217 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f5b060cf049e4c7e87cdd4f43e3b83e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f5b060cf049e4c7e87cdd4f43e3b83e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f5b060cf049e4c7e87cdd4f43e3b83e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f5b060cf049e4c7e87cdd4f43e3b83e8", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:33:58.728217 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1591604348 Oct 17 13:33:58.728217 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: f5b060cf049e4c7e87cdd4f43e3b83e8 Oct 17 13:33:58.728217 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1591604348 Oct 17 13:33:58.728217 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-HostsAdminNegativeTestJSON-1591604348-project-admin Oct 17 13:33:58.728217 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:33:58.728217 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:33:58.728217 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: f8338c65ea674400b1d60aa3442adfa5 Oct 17 13:33:58.728217 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1591604348-project-admin Oct 17 13:33:58.728217 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:33:58.728217 n-d-854247-14 devstack@n-api.service[127016]: {"status": "enable", "maintenance_mode": "enable"} Oct 17 13:33:58.728217 n-d-854247-14 devstack@n-api.service[127016]: method: Oct 17 13:33:58.728217 n-d-854247-14 devstack@n-api.service[127016]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 13:33:58.728217 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 17 13:33:58.729102 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:58.729102 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:58.729102 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 17 13:33:58.729102 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 17 13:33:58.729102 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 17 13:33:58.729102 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 17 13:33:58.729102 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:33:58.729102 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:33:58.729102 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:33:58.729102 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:33:58.729102 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 17 13:33:58.729102 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 17 13:33:58.729102 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 17 13:33:58.729102 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 17 13:33:58.729102 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:33:58.729102 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:33:58.729102 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 17 13:33:58.729102 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 17 13:33:58.730168 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 13:33:58.730168 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 13:33:58.730168 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 17 13:33:58.730168 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 17 13:33:58.730168 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 13:33:58.730168 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:58.730168 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:58.730168 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:58.730168 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:58.730168 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:58.730168 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:58.730168 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:58.730168 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:58.730168 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:33:58.730168 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:33:58.730168 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:58.730168 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:58.730168 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:33:58.730168 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:33:58.730168 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 17 13:33:58.731393 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 17 13:33:58.731393 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 17 13:33:58.731393 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:33:58.731393 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 13:33:58.731393 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:58.731393 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:58.731393 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:58.731393 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:58.731393 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:58.731393 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:58.731393 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:33:58.731393 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:33:58.731393 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 13:33:58.731393 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:33:58.736900 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-23d784db-881d-461a-a004-1fee22ec24bd tempest-HostsAdminNegativeTestJSON-1591604348 tempest-HostsAdminNegativeTestJSON-1591604348-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:58.739888 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-23d784db-881d-461a-a004-1fee22ec24bd tempest-HostsAdminNegativeTestJSON-1591604348 tempest-HostsAdminNegativeTestJSON-1591604348-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.070150 Oct 17 13:33:58.740679 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 86/178] 10.222.0.79 () {60 vars in 1211 bytes} [Mon Oct 17 13:33:58 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:33:58.827059 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1ff8ca68-3219-42a9-a90b-49c623122d49 tempest-ServersWithSpecificFlavorTestJSON-438742261 tempest-ServersWithSpecificFlavorTestJSON-438742261-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1349262585", "id": 2093214170, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:58.890479 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1ff8ca68-3219-42a9-a90b-49c623122d49 tempest-ServersWithSpecificFlavorTestJSON-438742261 tempest-ServersWithSpecificFlavorTestJSON-438742261-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.469432 Oct 17 13:33:58.891662 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 93/179] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:33:58 2022] POST /compute/v2.1/flavors => generated 425 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:33:58.905543 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2c1c740a-3c24-449e-93d3-1957702a37eb tempest-ServersWithSpecificFlavorTestJSON-438742261 tempest-ServersWithSpecificFlavorTestJSON-438742261-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:58.917764 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2c1c740a-3c24-449e-93d3-1957702a37eb tempest-ServersWithSpecificFlavorTestJSON-438742261 tempest-ServersWithSpecificFlavorTestJSON-438742261-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.017999 Oct 17 13:33:58.918859 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 87/180] 10.222.0.79 () {58 vars in 1182 bytes} [Mon Oct 17 13:33:58 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 17 13:33:58.928782 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9b6af574-f094-44aa-a015-649bbdd685ea tempest-ServersWithSpecificFlavorTestJSON-438742261 tempest-ServersWithSpecificFlavorTestJSON-438742261-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-688619471", "id": 1121781423, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:58.955972 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9b6af574-f094-44aa-a015-649bbdd685ea tempest-ServersWithSpecificFlavorTestJSON-438742261 tempest-ServersWithSpecificFlavorTestJSON-438742261-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.030935 Oct 17 13:33:58.957297 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 94/181] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:33:58 2022] POST /compute/v2.1/flavors => generated 424 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:33:58.969665 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b59e21e7-6c54-4caf-9c22-ce6157917d72 tempest-ServersWithSpecificFlavorTestJSON-438742261 tempest-ServersWithSpecificFlavorTestJSON-438742261-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:58.978117 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b59e21e7-6c54-4caf-9c22-ce6157917d72 tempest-ServersWithSpecificFlavorTestJSON-438742261 tempest-ServersWithSpecificFlavorTestJSON-438742261-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.012500 Oct 17 13:33:58.987392 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 88/182] 10.222.0.79 () {58 vars in 1182 bytes} [Mon Oct 17 13:33:58 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:33:58.992072 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d5f9aa28-68eb-463c-92cf-9f6f9ecc7a51 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Action: 'create', calling method: .version_select at 0x7f7cd61dfca0>, body: {"keypair": {"name": "tempest-keypair-467217040", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJTBmWkkgYC3ZA17I4Pg6xIXNmv0IWuy/WdRTYiivhJamoi8XuSjQ1RhvuMlvro/sWlgefifbkx5XkDaPwxqKqW4/Uk8T87JAWbGGsQ4+63zrzv9+P09rhQKd9CavPDWMA=="}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:59.041547 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-d5f9aa28-68eb-463c-92cf-9f6f9ecc7a51 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Getting quotas for project 550b2bda88024756abc4134365842d17. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:33:59.052325 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-d5f9aa28-68eb-463c-92cf-9f6f9ecc7a51 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Getting quotas for user 8e836340278b49f593350249132b9cfc and project 550b2bda88024756abc4134365842d17. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:33:59.104464 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d5f9aa28-68eb-463c-92cf-9f6f9ecc7a51 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.116170 Oct 17 13:33:59.106002 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 95/183] 10.222.0.79 () {60 vars in 1159 bytes} [Mon Oct 17 13:33:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:33:59.263989 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b2084a90-86e7-4f50-a809-cf04d88f85c5 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:59.265103 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b2084a90-86e7-4f50-a809-cf04d88f85c5 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] [instance: eb4474f8-de59-4187-8b15-ba0ec266bfa6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:59.276321 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b2084a90-86e7-4f50-a809-cf04d88f85c5 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:59.276837 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b2084a90-86e7-4f50-a809-cf04d88f85c5 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:59.277274 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b2084a90-86e7-4f50-a809-cf04d88f85c5 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:59.277999 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b2084a90-86e7-4f50-a809-cf04d88f85c5 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:59.278634 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b2084a90-86e7-4f50-a809-cf04d88f85c5 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:59.279060 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b2084a90-86e7-4f50-a809-cf04d88f85c5 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:59.517005 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b2084a90-86e7-4f50-a809-cf04d88f85c5 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4552e3fbd4de4d2997d5db7ec500de65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e76de886880490ba8373e0d86056c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:59.526353 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b2084a90-86e7-4f50-a809-cf04d88f85c5 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] 10.222.0.79 "GET /compute/v2.1/servers/eb4474f8-de59-4187-8b15-ba0ec266bfa6" status: 200 len: 1338 microversion: 2.1 time: 0.267978 Oct 17 13:33:59.527521 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 89/184] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:59 2022] GET /compute/v2.1/servers/eb4474f8-de59-4187-8b15-ba0ec266bfa6 => generated 1338 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:00.153344 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-46923ed8-3640-4edf-8946-2abd827ce373 req-8ab7701c-756a-487c-8970-adfbb11a25a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb4474f8-de59-4187-8b15-ba0ec266bfa6", "name": "network-vif-plugged", "status": "completed", "tag": "61661e1e-c655-419f-8f05-7f4bc97a8b4b"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:00.196787 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-46923ed8-3640-4edf-8946-2abd827ce373 req-8ab7701c-756a-487c-8970-adfbb11a25a4 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:00.197279 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-46923ed8-3640-4edf-8946-2abd827ce373 req-8ab7701c-756a-487c-8970-adfbb11a25a4 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:00.197767 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-46923ed8-3640-4edf-8946-2abd827ce373 req-8ab7701c-756a-487c-8970-adfbb11a25a4 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:00.216624 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=55 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:34:00.225599 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-46923ed8-3640-4edf-8946-2abd827ce373 req-8ab7701c-756a-487c-8970-adfbb11a25a4 service nova] Creating event network-vif-plugged:61661e1e-c655-419f-8f05-7f4bc97a8b4b for instance eb4474f8-de59-4187-8b15-ba0ec266bfa6 on n-h2-854247-14 Oct 17 13:34:00.226146 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-46923ed8-3640-4edf-8946-2abd827ce373 req-8ab7701c-756a-487c-8970-adfbb11a25a4 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127017) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 17 13:34:00.226718 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-46923ed8-3640-4edf-8946-2abd827ce373 req-8ab7701c-756a-487c-8970-adfbb11a25a4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127017) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 17 13:34:00.228572 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9a47def4-b803-4669-8d6c-4c2af1a79a0e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:00.229228 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9a47def4-b803-4669-8d6c-4c2af1a79a0e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:00.229776 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9a47def4-b803-4669-8d6c-4c2af1a79a0e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:00.230786 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9a47def4-b803-4669-8d6c-4c2af1a79a0e None None] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:00.231578 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9a47def4-b803-4669-8d6c-4c2af1a79a0e None None] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:00.232162 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9a47def4-b803-4669-8d6c-4c2af1a79a0e None None] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:00.243264 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.compute.rpcapi [None req-9a47def4-b803-4669-8d6c-4c2af1a79a0e None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 17 13:34:00.244188 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9a47def4-b803-4669-8d6c-4c2af1a79a0e None None] Releasing lock "compute-rpcapi-router" {{(pid=127017) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 17 13:34:00.264418 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9a47def4-b803-4669-8d6c-4c2af1a79a0e None None] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.318242 Oct 17 13:34:00.265767 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 96/185] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:33:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:00.559508 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3d2948fa-904b-4896-86fb-62136d20e5a6 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:00.561744 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3d2948fa-904b-4896-86fb-62136d20e5a6 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] [instance: eb4474f8-de59-4187-8b15-ba0ec266bfa6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:00.581921 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3d2948fa-904b-4896-86fb-62136d20e5a6 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:00.582444 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3d2948fa-904b-4896-86fb-62136d20e5a6 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:00.584885 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3d2948fa-904b-4896-86fb-62136d20e5a6 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:00.588533 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3d2948fa-904b-4896-86fb-62136d20e5a6 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:00.591354 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3d2948fa-904b-4896-86fb-62136d20e5a6 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:00.594021 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3d2948fa-904b-4896-86fb-62136d20e5a6 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:00.859814 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3d2948fa-904b-4896-86fb-62136d20e5a6 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4552e3fbd4de4d2997d5db7ec500de65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e76de886880490ba8373e0d86056c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:00.877331 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3d2948fa-904b-4896-86fb-62136d20e5a6 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] 10.222.0.79 "GET /compute/v2.1/servers/eb4474f8-de59-4187-8b15-ba0ec266bfa6" status: 200 len: 1338 microversion: 2.1 time: 0.332346 Oct 17 13:34:00.893378 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 90/186] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:00 2022] GET /compute/v2.1/servers/eb4474f8-de59-4187-8b15-ba0ec266bfa6 => generated 1338 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:01.905289 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-18fdb7ac-6da5-4f84-918f-a0855c4d878f tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:01.906777 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-18fdb7ac-6da5-4f84-918f-a0855c4d878f tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] [instance: eb4474f8-de59-4187-8b15-ba0ec266bfa6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:01.921073 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-18fdb7ac-6da5-4f84-918f-a0855c4d878f tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:01.921831 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-18fdb7ac-6da5-4f84-918f-a0855c4d878f tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:01.923847 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-18fdb7ac-6da5-4f84-918f-a0855c4d878f tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:01.924750 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-18fdb7ac-6da5-4f84-918f-a0855c4d878f tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:01.927240 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-18fdb7ac-6da5-4f84-918f-a0855c4d878f tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:01.928011 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-18fdb7ac-6da5-4f84-918f-a0855c4d878f tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:02.155216 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-18fdb7ac-6da5-4f84-918f-a0855c4d878f tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4552e3fbd4de4d2997d5db7ec500de65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e76de886880490ba8373e0d86056c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:02.166997 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-18fdb7ac-6da5-4f84-918f-a0855c4d878f tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] 10.222.0.79 "GET /compute/v2.1/servers/eb4474f8-de59-4187-8b15-ba0ec266bfa6" status: 200 len: 1338 microversion: 2.1 time: 0.266360 Oct 17 13:34:02.179189 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 97/187] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:01 2022] GET /compute/v2.1/servers/eb4474f8-de59-4187-8b15-ba0ec266bfa6 => generated 1338 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:02.356228 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6783b8a5-7a27-4280-bdda-f87e53cc95fd tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1561461267", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "1121781423", "adminPass": "***", "networks": [{"uuid": "055d2ab9-c493-46f8-a4f8-8c543bddf8af"}], "security_groups": [{"name": "tempest-securitygroup--403449206"}], "key_name": "tempest-keypair-467217040", "user_data": "}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:02.521433 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-6783b8a5-7a27-4280-bdda-f87e53cc95fd tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] validate_networks() for [('055d2ab9-c493-46f8-a4f8-8c543bddf8af', None, None, None, None, None)] {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:34:03.449773 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b038be4a-ae3d-4c0f-bbfd-1befe8abcf72 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-2083777185", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:03.552815 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-b038be4a-ae3d-4c0f-bbfd-1befe8abcf72 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] validate_networks() for None {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:34:03.791586 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-6783b8a5-7a27-4280-bdda-f87e53cc95fd tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:34:03.792681 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-6783b8a5-7a27-4280-bdda-f87e53cc95fd tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:34:03.793304 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-6783b8a5-7a27-4280-bdda-f87e53cc95fd tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:34:03.793856 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-6783b8a5-7a27-4280-bdda-f87e53cc95fd tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:34:03.794979 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-6783b8a5-7a27-4280-bdda-f87e53cc95fd tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:34:03.820972 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6783b8a5-7a27-4280-bdda-f87e53cc95fd tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:03.821691 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6783b8a5-7a27-4280-bdda-f87e53cc95fd tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:03.822313 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6783b8a5-7a27-4280-bdda-f87e53cc95fd tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:03.823303 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6783b8a5-7a27-4280-bdda-f87e53cc95fd tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:03.824450 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6783b8a5-7a27-4280-bdda-f87e53cc95fd tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:03.825174 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6783b8a5-7a27-4280-bdda-f87e53cc95fd tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:03.845704 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-6783b8a5-7a27-4280-bdda-f87e53cc95fd tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Getting quotas for project 550b2bda88024756abc4134365842d17. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:34:03.850625 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-6783b8a5-7a27-4280-bdda-f87e53cc95fd tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Getting quotas for user 8e836340278b49f593350249132b9cfc and project 550b2bda88024756abc4134365842d17. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:34:03.859699 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-b038be4a-ae3d-4c0f-bbfd-1befe8abcf72 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:34:03.860129 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-b038be4a-ae3d-4c0f-bbfd-1befe8abcf72 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:34:03.860588 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-b038be4a-ae3d-4c0f-bbfd-1befe8abcf72 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:34:03.861379 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-b038be4a-ae3d-4c0f-bbfd-1befe8abcf72 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:34:03.861379 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-b038be4a-ae3d-4c0f-bbfd-1befe8abcf72 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:34:03.868609 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6783b8a5-7a27-4280-bdda-f87e53cc95fd tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:34:03.877604 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6783b8a5-7a27-4280-bdda-f87e53cc95fd tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] [instance: 12e5e9fe-b998-450c-94b0-492a92bb6027] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:34:03.887934 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b038be4a-ae3d-4c0f-bbfd-1befe8abcf72 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:03.888460 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b038be4a-ae3d-4c0f-bbfd-1befe8abcf72 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:03.888903 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b038be4a-ae3d-4c0f-bbfd-1befe8abcf72 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:03.889716 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b038be4a-ae3d-4c0f-bbfd-1befe8abcf72 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:03.890167 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b038be4a-ae3d-4c0f-bbfd-1befe8abcf72 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:03.890594 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b038be4a-ae3d-4c0f-bbfd-1befe8abcf72 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:03.935996 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-b038be4a-ae3d-4c0f-bbfd-1befe8abcf72 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Getting quotas for project a3a297ddf04b4b18ae7591e107e84d36. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:34:03.941189 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-b038be4a-ae3d-4c0f-bbfd-1befe8abcf72 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Getting quotas for user 44ca1489f0084089a47d0cfc2ad37940 and project a3a297ddf04b4b18ae7591e107e84d36. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:34:03.954044 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b038be4a-ae3d-4c0f-bbfd-1befe8abcf72 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:34:03.954917 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6783b8a5-7a27-4280-bdda-f87e53cc95fd tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.604286 Oct 17 13:34:03.957510 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b038be4a-ae3d-4c0f-bbfd-1befe8abcf72 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] [instance: 00b0dfe0-2c88-4037-830f-4144190da935] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:34:03.959788 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 91/188] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:34:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 1610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:34:03.972143 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-72c43fcc-87f2-4539-8869-9bda182d9df0 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:03.973268 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-72c43fcc-87f2-4539-8869-9bda182d9df0 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] [instance: eb4474f8-de59-4187-8b15-ba0ec266bfa6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:03.982410 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-72c43fcc-87f2-4539-8869-9bda182d9df0 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:03.983425 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-72c43fcc-87f2-4539-8869-9bda182d9df0 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:03.984005 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-72c43fcc-87f2-4539-8869-9bda182d9df0 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:03.984570 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=3,nova_api:SAVEPOINT=4,nova_api:INSERT=7,nova_api:RELEASE=4 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:34:03.985362 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-72c43fcc-87f2-4539-8869-9bda182d9df0 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:03.986128 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-72c43fcc-87f2-4539-8869-9bda182d9df0 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:03.986734 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-72c43fcc-87f2-4539-8869-9bda182d9df0 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:04.017978 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b038be4a-ae3d-4c0f-bbfd-1befe8abcf72 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.897531 Oct 17 13:34:04.019709 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 98/189] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:34:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 900 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:34:04.026694 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-658a3f27-529b-4fb8-af06-f7627b037025 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:04.027761 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-658a3f27-529b-4fb8-af06-f7627b037025 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] [instance: 12e5e9fe-b998-450c-94b0-492a92bb6027] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:04.229303 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-658a3f27-529b-4fb8-af06-f7627b037025 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e836340278b49f593350249132b9cfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550b2bda88024756abc4134365842d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:04.256803 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-658a3f27-529b-4fb8-af06-f7627b037025 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] 10.222.0.79 "GET /compute/v2.1/servers/12e5e9fe-b998-450c-94b0-492a92bb6027" status: 200 len: 1264 microversion: 2.1 time: 0.235860 Oct 17 13:34:04.261480 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 99/190] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:04 2022] GET /compute/v2.1/servers/12e5e9fe-b998-450c-94b0-492a92bb6027 => generated 1264 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:04.284001 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-047167c2-eebc-4b68-8e86-c40fa0f0820f tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:04.286177 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-047167c2-eebc-4b68-8e86-c40fa0f0820f tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] [instance: 00b0dfe0-2c88-4037-830f-4144190da935] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:04.306924 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-72c43fcc-87f2-4539-8869-9bda182d9df0 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4552e3fbd4de4d2997d5db7ec500de65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e76de886880490ba8373e0d86056c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:04.320991 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-72c43fcc-87f2-4539-8869-9bda182d9df0 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] 10.222.0.79 "GET /compute/v2.1/servers/eb4474f8-de59-4187-8b15-ba0ec266bfa6" status: 200 len: 1488 microversion: 2.1 time: 0.358896 Oct 17 13:34:04.323213 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 92/191] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:03 2022] GET /compute/v2.1/servers/eb4474f8-de59-4187-8b15-ba0ec266bfa6 => generated 1488 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:04.360337 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-df9bf14f-fe49-4fc1-9a92-7bb241fbdcc3 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:04.361178 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-df9bf14f-fe49-4fc1-9a92-7bb241fbdcc3 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] [instance: eb4474f8-de59-4187-8b15-ba0ec266bfa6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:04.381520 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df9bf14f-fe49-4fc1-9a92-7bb241fbdcc3 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:04.382014 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df9bf14f-fe49-4fc1-9a92-7bb241fbdcc3 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:04.386324 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df9bf14f-fe49-4fc1-9a92-7bb241fbdcc3 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:04.387315 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df9bf14f-fe49-4fc1-9a92-7bb241fbdcc3 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:04.390167 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df9bf14f-fe49-4fc1-9a92-7bb241fbdcc3 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:04.390608 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df9bf14f-fe49-4fc1-9a92-7bb241fbdcc3 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:04.447511 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-047167c2-eebc-4b68-8e86-c40fa0f0820f tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ca1489f0084089a47d0cfc2ad37940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a297ddf04b4b18ae7591e107e84d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:04.457206 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-047167c2-eebc-4b68-8e86-c40fa0f0820f tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] 10.222.0.79 "GET /compute/v2.1/servers/00b0dfe0-2c88-4037-830f-4144190da935" status: 200 len: 1219 microversion: 2.1 time: 0.193268 Oct 17 13:34:04.458127 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 100/192] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:04 2022] GET /compute/v2.1/servers/00b0dfe0-2c88-4037-830f-4144190da935 => generated 1219 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:04.791795 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-df9bf14f-fe49-4fc1-9a92-7bb241fbdcc3 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/eb4474f8-de59-4187-8b15-ba0ec266bfa6" status: 200 len: 1641 microversion: 2.1 time: 0.446768 Oct 17 13:34:04.799075 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 93/193] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:04 2022] GET /compute/v2.1/servers/eb4474f8-de59-4187-8b15-ba0ec266bfa6 => generated 1641 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:34:04.826316 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-103a7835-df59-4f06-afbe-58412ab86b22 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:04.827765 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-103a7835-df59-4f06-afbe-58412ab86b22 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] [instance: eb4474f8-de59-4187-8b15-ba0ec266bfa6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:04.840691 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-103a7835-df59-4f06-afbe-58412ab86b22 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:04.840691 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-103a7835-df59-4f06-afbe-58412ab86b22 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:04.840691 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-103a7835-df59-4f06-afbe-58412ab86b22 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:04.841451 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-103a7835-df59-4f06-afbe-58412ab86b22 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:04.842111 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-103a7835-df59-4f06-afbe-58412ab86b22 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:04.842947 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-103a7835-df59-4f06-afbe-58412ab86b22 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:04.890968 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-103a7835-df59-4f06-afbe-58412ab86b22 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] [instance: eb4474f8-de59-4187-8b15-ba0ec266bfa6] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:34:05.083220 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-103a7835-df59-4f06-afbe-58412ab86b22 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] 10.222.0.79 "DELETE /compute/v2.1/servers/eb4474f8-de59-4187-8b15-ba0ec266bfa6" status: 204 len: 0 microversion: 2.1 time: 0.263621 Oct 17 13:34:05.084165 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 101/194] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:34:04 2022] DELETE /compute/v2.1/servers/eb4474f8-de59-4187-8b15-ba0ec266bfa6 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:34:05.093311 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d6dd3125-ca37-4b12-abbc-2fb00553612d tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:05.094143 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d6dd3125-ca37-4b12-abbc-2fb00553612d tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] [instance: eb4474f8-de59-4187-8b15-ba0ec266bfa6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:05.105164 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d6dd3125-ca37-4b12-abbc-2fb00553612d tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:05.105712 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d6dd3125-ca37-4b12-abbc-2fb00553612d tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:05.106141 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d6dd3125-ca37-4b12-abbc-2fb00553612d tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:05.111619 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d6dd3125-ca37-4b12-abbc-2fb00553612d tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:05.112293 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d6dd3125-ca37-4b12-abbc-2fb00553612d tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:05.112723 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d6dd3125-ca37-4b12-abbc-2fb00553612d tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:05.282200 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d6dd3125-ca37-4b12-abbc-2fb00553612d tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4552e3fbd4de4d2997d5db7ec500de65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e76de886880490ba8373e0d86056c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:05.292022 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d6dd3125-ca37-4b12-abbc-2fb00553612d tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] 10.222.0.79 "GET /compute/v2.1/servers/eb4474f8-de59-4187-8b15-ba0ec266bfa6" status: 200 len: 1494 microversion: 2.1 time: 0.202832 Oct 17 13:34:05.293074 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 94/195] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:05 2022] GET /compute/v2.1/servers/eb4474f8-de59-4187-8b15-ba0ec266bfa6 => generated 1494 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:34:05.298863 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ebf3ee02-7f85-4c82-8bd7-72908a23f326 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:05.299716 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ebf3ee02-7f85-4c82-8bd7-72908a23f326 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] [instance: 12e5e9fe-b998-450c-94b0-492a92bb6027] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:05.306739 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ebf3ee02-7f85-4c82-8bd7-72908a23f326 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:05.307699 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ebf3ee02-7f85-4c82-8bd7-72908a23f326 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:05.308422 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ebf3ee02-7f85-4c82-8bd7-72908a23f326 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:05.309669 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ebf3ee02-7f85-4c82-8bd7-72908a23f326 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:05.310452 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ebf3ee02-7f85-4c82-8bd7-72908a23f326 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:05.311490 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ebf3ee02-7f85-4c82-8bd7-72908a23f326 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:05.396779 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ebf3ee02-7f85-4c82-8bd7-72908a23f326 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e836340278b49f593350249132b9cfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550b2bda88024756abc4134365842d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:05.407608 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ebf3ee02-7f85-4c82-8bd7-72908a23f326 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] 10.222.0.79 "GET /compute/v2.1/servers/12e5e9fe-b998-450c-94b0-492a92bb6027" status: 200 len: 1268 microversion: 2.1 time: 0.112567 Oct 17 13:34:05.408487 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 95/196] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:05 2022] GET /compute/v2.1/servers/12e5e9fe-b998-450c-94b0-492a92bb6027 => generated 1268 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:05.615065 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d1c6fc99-99df-4fd6-bf33-006d1430fc9b tempest-KeyPairsV210TestJSON-238006189 tempest-KeyPairsV210TestJSON-238006189-project-admin] Action: 'create', calling method: .version_select at 0x7f7cd61d9ee0>, body: {"keypair": {"name": "tempest-keypair-1421100250", "type": "ssh", "user_id": "faa378cee04c46fbb92035f6f829e896", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjdoqzcc0Evo47q266NWF4UvgpvYuOXWSGKhwDw4PmtqdW0oaCHCCktPQ57z1Z9IHL4Z+5V+5o+ShofiMZYMputiVHCrP5KEpTMxsb8AamkjC10mChKk/eJ0gH0ah15Dg=="}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:05.615938 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d146be57-1f81-43cf-b9f3-181ea31b1d70 tempest-InstanceUsageAuditLogTestJSON-57387450 tempest-InstanceUsageAuditLogTestJSON-57387450-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:05.635816 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-d1c6fc99-99df-4fd6-bf33-006d1430fc9b tempest-KeyPairsV210TestJSON-238006189 tempest-KeyPairsV210TestJSON-238006189-project-admin] Getting quotas for project 87e493e8506a43b494dc731fb4492ab9. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:34:05.639060 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d146be57-1f81-43cf-b9f3-181ea31b1d70 tempest-InstanceUsageAuditLogTestJSON-57387450 tempest-InstanceUsageAuditLogTestJSON-57387450-project-admin] 10.222.0.79 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-17 13:34:05" status: 200 len: 318 microversion: 2.1 time: 0.228334 Oct 17 13:34:05.640631 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-d1c6fc99-99df-4fd6-bf33-006d1430fc9b tempest-KeyPairsV210TestJSON-238006189 tempest-KeyPairsV210TestJSON-238006189-project-admin] Getting quotas for user 75339a75df084693ad2874e8382a8f86 and project 87e493e8506a43b494dc731fb4492ab9. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:34:05.648846 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 96/197] 10.222.0.79 () {58 vars in 1251 bytes} [Mon Oct 17 13:34:05 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-17%2013%3A34%3A05 => generated 318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:05.654031 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ceeb1594-a4c7-4846-bcc8-fa79649685a8 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:05.654647 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ceeb1594-a4c7-4846-bcc8-fa79649685a8 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] [instance: 00b0dfe0-2c88-4037-830f-4144190da935] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:05.669062 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d1c6fc99-99df-4fd6-bf33-006d1430fc9b tempest-KeyPairsV210TestJSON-238006189 tempest-KeyPairsV210TestJSON-238006189-project-admin] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.447236 Oct 17 13:34:05.670504 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 102/198] 10.222.0.79 () {62 vars in 1200 bytes} [Mon Oct 17 13:34:05 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 449 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 17 13:34:05.677295 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-49398c61-6b0b-4200-af51-479f9a795efb tempest-InstanceUsageAuditLogTestJSON-57387450 tempest-InstanceUsageAuditLogTestJSON-57387450-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:05.703216 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-49398c61-6b0b-4200-af51-479f9a795efb tempest-InstanceUsageAuditLogTestJSON-57387450 tempest-InstanceUsageAuditLogTestJSON-57387450-project-admin] 10.222.0.79 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.031164 Oct 17 13:34:05.704388 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 103/199] 10.222.0.79 () {58 vars in 1185 bytes} [Mon Oct 17 13:34:05 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:05.710361 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-12df886e-d87f-485c-a629-f3121a3fc12d tempest-KeyPairsV210TestJSON-238006189 tempest-KeyPairsV210TestJSON-238006189-project-admin] Action: 'create', calling method: .version_select at 0x7f7cd60c34c0>, body: {"keypair": {"name": "tempest-keypair-1128527638", "type": "ssh", "user_id": "faa378cee04c46fbb92035f6f829e896", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMyzf9OEupcLRUyIYPn9/vCdgqQvhXG5g057mTdgqYz9h+KI2qvrJ1NaHEPfAqI9A0lfaD3h6Ncn8XiUjdOegJslzErQFatRgV27BlGScLFZBgV84Oey1zE1W6qU3XAEfg=="}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:05.716183 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ceeb1594-a4c7-4846-bcc8-fa79649685a8 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ca1489f0084089a47d0cfc2ad37940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a297ddf04b4b18ae7591e107e84d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:05.726459 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ceeb1594-a4c7-4846-bcc8-fa79649685a8 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] 10.222.0.79 "GET /compute/v2.1/servers/00b0dfe0-2c88-4037-830f-4144190da935" status: 200 len: 1219 microversion: 2.1 time: 0.075326 Oct 17 13:34:05.728491 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-12df886e-d87f-485c-a629-f3121a3fc12d tempest-KeyPairsV210TestJSON-238006189 tempest-KeyPairsV210TestJSON-238006189-project-admin] Getting quotas for project 87e493e8506a43b494dc731fb4492ab9. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:34:05.729247 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 97/200] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:05 2022] GET /compute/v2.1/servers/00b0dfe0-2c88-4037-830f-4144190da935 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:05.734343 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-12df886e-d87f-485c-a629-f3121a3fc12d tempest-KeyPairsV210TestJSON-238006189 tempest-KeyPairsV210TestJSON-238006189-project-admin] Getting quotas for user 75339a75df084693ad2874e8382a8f86 and project 87e493e8506a43b494dc731fb4492ab9. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:34:05.763754 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-12df886e-d87f-485c-a629-f3121a3fc12d tempest-KeyPairsV210TestJSON-238006189 tempest-KeyPairsV210TestJSON-238006189-project-admin] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.057831 Oct 17 13:34:05.765532 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 104/201] 10.222.0.79 () {62 vars in 1200 bytes} [Mon Oct 17 13:34:05 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 60 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 17 13:34:05.779189 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-05a83880-a91c-445a-8269-2847836eaab1 tempest-KeyPairsV210TestJSON-238006189 tempest-KeyPairsV210TestJSON-238006189-project-admin] Calling method '.version_select at 0x7f7cd604b310>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:05.794297 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-05a83880-a91c-445a-8269-2847836eaab1 tempest-KeyPairsV210TestJSON-238006189 tempest-KeyPairsV210TestJSON-238006189-project-admin] 10.222.0.79 "GET /compute/v2.1/os-keypairs/tempest-keypair-1421100250?user_id=faa378cee04c46fbb92035f6f829e896" status: 200 len: 512 microversion: 2.10 time: 0.021617 Oct 17 13:34:05.795361 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 105/202] 10.222.0.79 () {60 vars in 1340 bytes} [Mon Oct 17 13:34:05 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1421100250?user_id=faa378cee04c46fbb92035f6f829e896 => generated 512 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:34:05.811056 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-697472a0-1be2-4e42-a165-d2f2dea55552 tempest-KeyPairsV210TestJSON-238006189 tempest-KeyPairsV210TestJSON-238006189-project-admin] Action: 'create', calling method: .version_select at 0x7f7cd604b3a0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-833694189", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBjpdS+mSFXpZ8BdoIBlOaH75G3gr5BFn8YYQwL3CBdfrsTAH46qlJDuWd8zgQB9dA/jgSi1KB+EC6Nnyf45MttoD/JGsQsXgTbmR35hJzRPS1TyKBD52/X/gfbIrvlXxQ=="}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:05.828512 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-697472a0-1be2-4e42-a165-d2f2dea55552 tempest-KeyPairsV210TestJSON-238006189 tempest-KeyPairsV210TestJSON-238006189-project-admin] Getting quotas for project 87e493e8506a43b494dc731fb4492ab9. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:34:05.833250 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-697472a0-1be2-4e42-a165-d2f2dea55552 tempest-KeyPairsV210TestJSON-238006189 tempest-KeyPairsV210TestJSON-238006189-project-admin] Getting quotas for user 75339a75df084693ad2874e8382a8f86 and project 87e493e8506a43b494dc731fb4492ab9. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:34:05.841881 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d1186d32-b953-4394-9663-f8d56bd96193 tempest-InstanceUsageAuditLogNegativeTestJSON-194024081 tempest-InstanceUsageAuditLogNegativeTestJSON-194024081-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:05.843506 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-d1186d32-b953-4394-9663-f8d56bd96193 tempest-InstanceUsageAuditLogNegativeTestJSON-194024081 tempest-InstanceUsageAuditLogNegativeTestJSON-194024081-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 17 13:34:05.855667 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d1186d32-b953-4394-9663-f8d56bd96193 tempest-InstanceUsageAuditLogNegativeTestJSON-194024081 tempest-InstanceUsageAuditLogNegativeTestJSON-194024081-project-admin] Request method failure captured: Oct 17 13:34:05.855667 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 17 13:34:05.855667 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:34:05.855667 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:34:05.855667 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:34:05.855667 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:34:05.855667 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:34:05.855667 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:34:05.855667 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:34:05.855667 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:34:05.855667 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVnN7yvkgnoFY6etYgujfiENX8l_a3YmldaRlZco21sCM-1xH4k4VfBO3GU4ndhdDrqeDHEIE96qCS8tiejnP8HwZPSqkbpOnfFTSFK2Hoauy9K5rgtcve_P_dVyONBBeLy4oARNWQNfu8tcH25IczZwZx_yEdg-WmZs8a3amoS908c Oct 17 13:34:05.855667 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:34:05.855667 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:34:05.855667 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:34:05.855667 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:34:05.855667 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:34:05.855667 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:34:05.855667 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 4402c5228341468992b708d6e7b756c7 Oct 17 13:34:05.855667 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-194024081 Oct 17 13:34:05.855667 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member,admin Oct 17 13:34:05.855667 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member,admin Oct 17 13:34:05.857194 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4402c5228341468992b708d6e7b756c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4402c5228341468992b708d6e7b756c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4402c5228341468992b708d6e7b756c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4402c5228341468992b708d6e7b756c7", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:34:05.857194 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-194024081 Oct 17 13:34:05.857194 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 4402c5228341468992b708d6e7b756c7 Oct 17 13:34:05.857194 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-194024081 Oct 17 13:34:05.857194 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-194024081-project-admin Oct 17 13:34:05.857194 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:34:05.857194 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:34:05.857194 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: e2d562ab92e847bc810a39d85f008fee Oct 17 13:34:05.857194 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-194024081-project-admin Oct 17 13:34:05.857194 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:34:05.857194 n-d-854247-14 devstack@n-api.service[127016]: exception: Invalid timestamp for date invalid_time Oct 17 13:34:05.857920 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'invalid_time'} Oct 17 13:34:05.857920 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:34:05.857920 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:05.857920 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 17 13:34:05.857920 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 17 13:34:05.857920 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 17 13:34:05.857920 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 17 13:34:05.857920 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 17 13:34:05.857920 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 17 13:34:05.857920 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 17 13:34:05.857920 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:05.857920 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:05.857920 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:05.857920 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:05.857920 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:05.857920 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:05.857920 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:34:05.857920 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:34:05.857920 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:34:05.857920 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:34:05.859570 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 17 13:34:05.859570 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 17 13:34:05.859570 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 17 13:34:05.859570 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:05.859570 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:05.859570 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:05.859570 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:05.859570 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:05.859570 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:05.859570 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:34:05.859570 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:34:05.859570 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 17 13:34:05.859570 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:05.859570 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d1186d32-b953-4394-9663-f8d56bd96193 tempest-InstanceUsageAuditLogNegativeTestJSON-194024081 tempest-InstanceUsageAuditLogNegativeTestJSON-194024081-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:34:05.859570 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d1186d32-b953-4394-9663-f8d56bd96193 tempest-InstanceUsageAuditLogNegativeTestJSON-194024081 tempest-InstanceUsageAuditLogNegativeTestJSON-194024081-project-admin] 10.222.0.79 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.104422 Oct 17 13:34:05.876213 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 98/203] 10.222.0.79 () {58 vars in 1224 bytes} [Mon Oct 17 13:34:05 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 124 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 17 13:34:05.878960 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-697472a0-1be2-4e42-a165-d2f2dea55552 tempest-KeyPairsV210TestJSON-238006189 tempest-KeyPairsV210TestJSON-238006189-project-admin] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.072130 Oct 17 13:34:05.879896 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 106/204] 10.222.0.79 () {62 vars in 1200 bytes} [Mon Oct 17 13:34:05 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 74 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 17 13:34:05.892804 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bd52711a-3f17-4230-84bb-710292b3fd80 tempest-KeyPairsV210TestJSON-238006189 tempest-KeyPairsV210TestJSON-238006189-project-admin] Calling method '.version_select at 0x7f7cd61e3e50>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:05.901777 n-d-854247-14 devstack@n-api.service[127017]: WARNING oslo_db.sqlalchemy.utils [None req-bd52711a-3f17-4230-84bb-710292b3fd80 tempest-KeyPairsV210TestJSON-238006189 tempest-KeyPairsV210TestJSON-238006189-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 17 13:34:05.911473 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-bd52711a-3f17-4230-84bb-710292b3fd80 tempest-KeyPairsV210TestJSON-238006189 tempest-KeyPairsV210TestJSON-238006189-project-admin] 10.222.0.79 "GET /compute/v2.1/os-keypairs?user_id=faa378cee04c46fbb92035f6f829e896" status: 200 len: 726 microversion: 2.10 time: 0.023926 Oct 17 13:34:05.912971 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 107/205] 10.222.0.79 () {60 vars in 1259 bytes} [Mon Oct 17 13:34:05 2022] GET /compute/v2.1/os-keypairs?user_id=faa378cee04c46fbb92035f6f829e896 => generated 726 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:34:05.924722 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2ec1e12d-a622-4104-8afe-7a91a14020b3 tempest-KeyPairsV210TestJSON-238006189 tempest-KeyPairsV210TestJSON-238006189-project-admin] Calling method '.version_select at 0x7f7cd60540d0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:05.947015 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2ec1e12d-a622-4104-8afe-7a91a14020b3 tempest-KeyPairsV210TestJSON-238006189 tempest-KeyPairsV210TestJSON-238006189-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-833694189" status: 204 len: 0 microversion: 2.10 time: 0.025971 Oct 17 13:34:05.948269 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 108/206] 10.222.0.79 () {60 vars in 1322 bytes} [Mon Oct 17 13:34:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-833694189 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:34:05.957441 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e3fb9193-ebba-456f-9ba7-48575a0c94b0 tempest-KeyPairsV210TestJSON-238006189 tempest-KeyPairsV210TestJSON-238006189-project-admin] Calling method '.version_select at 0x7f7cd605fee0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:06.004168 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e3fb9193-ebba-456f-9ba7-48575a0c94b0 tempest-KeyPairsV210TestJSON-238006189 tempest-KeyPairsV210TestJSON-238006189-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1128527638?user_id=faa378cee04c46fbb92035f6f829e896" status: 204 len: 0 microversion: 2.10 time: 0.050716 Oct 17 13:34:06.005244 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 109/207] 10.222.0.79 () {60 vars in 1343 bytes} [Mon Oct 17 13:34:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1128527638?user_id=faa378cee04c46fbb92035f6f829e896 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:34:06.018126 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-eee9bcec-6802-4823-a4a0-d3180d37580b tempest-KeyPairsV210TestJSON-238006189 tempest-KeyPairsV210TestJSON-238006189-project-admin] Calling method '.version_select at 0x7f7cd60544c0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:06.065648 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-eee9bcec-6802-4823-a4a0-d3180d37580b tempest-KeyPairsV210TestJSON-238006189 tempest-KeyPairsV210TestJSON-238006189-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1421100250?user_id=faa378cee04c46fbb92035f6f829e896" status: 204 len: 0 microversion: 2.10 time: 0.050992 Oct 17 13:34:06.074033 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 110/208] 10.222.0.79 () {60 vars in 1343 bytes} [Mon Oct 17 13:34:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1421100250?user_id=faa378cee04c46fbb92035f6f829e896 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:34:06.085283 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-846c3ae8-ccdc-42f2-9f51-5117317a2545 tempest-InstanceUsageAuditLogNegativeTestJSON-673529571 tempest-InstanceUsageAuditLogNegativeTestJSON-673529571-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:06.088380 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-846c3ae8-ccdc-42f2-9f51-5117317a2545 tempest-InstanceUsageAuditLogNegativeTestJSON-673529571 tempest-InstanceUsageAuditLogNegativeTestJSON-673529571-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '29b359ce89874e6a829f404a1523831e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ebe4b6a97941c48874d9be70a3402d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:06.090118 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-846c3ae8-ccdc-42f2-9f51-5117317a2545 tempest-InstanceUsageAuditLogNegativeTestJSON-673529571 tempest-InstanceUsageAuditLogNegativeTestJSON-673529571-project] Request method failure captured: Oct 17 13:34:06.090118 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 17 13:34:06.090118 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:34:06.090118 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:34:06.090118 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:34:06.090118 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:34:06.090118 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:34:06.090118 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:34:06.090118 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:34:06.090118 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:34:06.090118 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVnL-tv6Cp1oa3xhAkpV85hlLHrRdG7C9YJo8bLd9wRPuYXMEdm-56I_WZzorJyMRu-0lCtzbMMwF_Q2ehvIYzyhFaZEYaMjVvxDyCmRPxPCV1BcwWf1gSR70BG9OH5KLNDlsciExXAgyxumsjs9Lbr7090uRd7SM1ZH3xHbxXLYTzk Oct 17 13:34:06.090118 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:34:06.090118 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:34:06.090118 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:34:06.090118 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:34:06.090118 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:34:06.090118 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:34:06.090118 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 31ebe4b6a97941c48874d9be70a3402d Oct 17 13:34:06.090118 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-673529571 Oct 17 13:34:06.090118 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:34:06.090118 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:34:06.091295 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/31ebe4b6a97941c48874d9be70a3402d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/31ebe4b6a97941c48874d9be70a3402d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/31ebe4b6a97941c48874d9be70a3402d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_31ebe4b6a97941c48874d9be70a3402d", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:34:06.091295 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-673529571 Oct 17 13:34:06.091295 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 31ebe4b6a97941c48874d9be70a3402d Oct 17 13:34:06.091295 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-673529571 Oct 17 13:34:06.091295 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-673529571-project Oct 17 13:34:06.091295 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:34:06.091295 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:34:06.091295 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 29b359ce89874e6a829f404a1523831e Oct 17 13:34:06.091295 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-673529571-project Oct 17 13:34:06.091295 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:34:06.091919 n-d-854247-14 devstack@n-api.service[127016]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 17 13:34:06.091919 n-d-854247-14 devstack@n-api.service[127016]: action_args: {} Oct 17 13:34:06.091919 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:34:06.091919 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:06.091919 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:06.091919 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:06.091919 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:34:06.091919 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:34:06.091919 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:34:06.091919 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:34:06.091919 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 17 13:34:06.091919 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 17 13:34:06.091919 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:34:06.091919 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:34:06.091919 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:34:06.091919 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:34:06.091919 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:34:06.091919 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:34:06.091919 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:34:06.091919 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:34:06.092967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:34:06.092967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:34:06.092967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:34:06.092967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:34:06.092967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:34:06.092967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:34:06.092967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 17 13:34:06.092967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:06.092967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:06.092967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:06.092967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:06.092967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:06.092967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:06.092967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:34:06.092967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:34:06.092967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 17 13:34:06.092967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:06.093840 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-846c3ae8-ccdc-42f2-9f51-5117317a2545 tempest-InstanceUsageAuditLogNegativeTestJSON-673529571 tempest-InstanceUsageAuditLogNegativeTestJSON-673529571-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:34:06.093840 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-846c3ae8-ccdc-42f2-9f51-5117317a2545 tempest-InstanceUsageAuditLogNegativeTestJSON-673529571 tempest-InstanceUsageAuditLogNegativeTestJSON-673529571-project] 10.222.0.79 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.212356 Oct 17 13:34:06.093840 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 99/209] 10.222.0.79 () {58 vars in 1185 bytes} [Mon Oct 17 13:34:05 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 215 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:34:06.109892 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6be0b37f-9f07-4c7f-98c8-828671b017f0 tempest-InstanceUsageAuditLogNegativeTestJSON-673529571 tempest-InstanceUsageAuditLogNegativeTestJSON-673529571-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:06.111762 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6be0b37f-9f07-4c7f-98c8-828671b017f0 tempest-InstanceUsageAuditLogNegativeTestJSON-673529571 tempest-InstanceUsageAuditLogNegativeTestJSON-673529571-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '29b359ce89874e6a829f404a1523831e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ebe4b6a97941c48874d9be70a3402d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:06.113931 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6be0b37f-9f07-4c7f-98c8-828671b017f0 tempest-InstanceUsageAuditLogNegativeTestJSON-673529571 tempest-InstanceUsageAuditLogNegativeTestJSON-673529571-project] Request method failure captured: Oct 17 13:34:06.113931 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-17%2013:34:06 HTTP/1.1 Oct 17 13:34:06.113931 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:34:06.113931 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:34:06.113931 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:34:06.113931 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:34:06.113931 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:34:06.113931 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:34:06.113931 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:34:06.113931 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:34:06.113931 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVnL-tv6Cp1oa3xhAkpV85hlLHrRdG7C9YJo8bLd9wRPuYXMEdm-56I_WZzorJyMRu-0lCtzbMMwF_Q2ehvIYzyhFaZEYaMjVvxDyCmRPxPCV1BcwWf1gSR70BG9OH5KLNDlsciExXAgyxumsjs9Lbr7090uRd7SM1ZH3xHbxXLYTzk Oct 17 13:34:06.113931 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:34:06.113931 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:34:06.113931 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:34:06.113931 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:34:06.113931 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:34:06.113931 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:34:06.113931 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 31ebe4b6a97941c48874d9be70a3402d Oct 17 13:34:06.113931 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-673529571 Oct 17 13:34:06.113931 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:34:06.113931 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:34:06.115121 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/31ebe4b6a97941c48874d9be70a3402d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/31ebe4b6a97941c48874d9be70a3402d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/31ebe4b6a97941c48874d9be70a3402d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_31ebe4b6a97941c48874d9be70a3402d", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:34:06.115121 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-673529571 Oct 17 13:34:06.115121 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 31ebe4b6a97941c48874d9be70a3402d Oct 17 13:34:06.115121 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-673529571 Oct 17 13:34:06.115121 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-673529571-project Oct 17 13:34:06.115121 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:34:06.115121 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:34:06.115121 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 29b359ce89874e6a829f404a1523831e Oct 17 13:34:06.115121 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-673529571-project Oct 17 13:34:06.115121 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:34:06.115727 n-d-854247-14 devstack@n-api.service[127017]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 17 13:34:06.115727 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '2022-10-17 13:34:06'} Oct 17 13:34:06.115727 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:34:06.115727 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:06.115727 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:06.115727 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:06.115727 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:34:06.115727 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:34:06.115727 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:34:06.115727 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:34:06.115727 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 17 13:34:06.115727 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 17 13:34:06.115727 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:34:06.115727 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:34:06.115727 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:34:06.115727 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:34:06.115727 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:34:06.115727 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:34:06.115727 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:34:06.115727 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:34:06.116746 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:34:06.116746 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:34:06.116746 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:34:06.116746 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:34:06.116746 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:34:06.116746 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:34:06.116746 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 17 13:34:06.116746 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:06.116746 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:06.116746 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:06.116746 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:06.116746 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:06.116746 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:06.116746 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:34:06.116746 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:34:06.116746 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 17 13:34:06.116746 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:06.117634 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6be0b37f-9f07-4c7f-98c8-828671b017f0 tempest-InstanceUsageAuditLogNegativeTestJSON-673529571 tempest-InstanceUsageAuditLogNegativeTestJSON-673529571-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:34:06.117634 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6be0b37f-9f07-4c7f-98c8-828671b017f0 tempest-InstanceUsageAuditLogNegativeTestJSON-673529571 tempest-InstanceUsageAuditLogNegativeTestJSON-673529571-project] 10.222.0.79 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-17 13:34:06" status: 403 len: 128 microversion: 2.1 time: 0.018561 Oct 17 13:34:06.120955 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 111/210] 10.222.0.79 () {58 vars in 1251 bytes} [Mon Oct 17 13:34:06 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-17%2013%3A34%3A06 => generated 128 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:34:06.318619 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-21adbea7-108a-4596-b5c1-4e645969e2a0 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:06.319667 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-21adbea7-108a-4596-b5c1-4e645969e2a0 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] [instance: eb4474f8-de59-4187-8b15-ba0ec266bfa6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:06.331679 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-21adbea7-108a-4596-b5c1-4e645969e2a0 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:06.332582 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-21adbea7-108a-4596-b5c1-4e645969e2a0 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:06.333193 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-21adbea7-108a-4596-b5c1-4e645969e2a0 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:06.334204 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-21adbea7-108a-4596-b5c1-4e645969e2a0 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:06.334950 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-21adbea7-108a-4596-b5c1-4e645969e2a0 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:06.335569 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-21adbea7-108a-4596-b5c1-4e645969e2a0 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:06.430737 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-46545dfd-eef0-4d8e-85d8-30575076e9f5 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:06.431837 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-46545dfd-eef0-4d8e-85d8-30575076e9f5 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] [instance: 12e5e9fe-b998-450c-94b0-492a92bb6027] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:06.445468 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-46545dfd-eef0-4d8e-85d8-30575076e9f5 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:06.446169 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-46545dfd-eef0-4d8e-85d8-30575076e9f5 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:06.446782 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-46545dfd-eef0-4d8e-85d8-30575076e9f5 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:06.447743 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-46545dfd-eef0-4d8e-85d8-30575076e9f5 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:06.448342 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-46545dfd-eef0-4d8e-85d8-30575076e9f5 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:06.448912 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-46545dfd-eef0-4d8e-85d8-30575076e9f5 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:06.842840 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-46545dfd-eef0-4d8e-85d8-30575076e9f5 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e836340278b49f593350249132b9cfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550b2bda88024756abc4134365842d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:06.858535 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-46545dfd-eef0-4d8e-85d8-30575076e9f5 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] 10.222.0.79 "GET /compute/v2.1/servers/12e5e9fe-b998-450c-94b0-492a92bb6027" status: 200 len: 1322 microversion: 2.1 time: 0.432290 Oct 17 13:34:06.860708 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 112/211] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:06 2022] GET /compute/v2.1/servers/12e5e9fe-b998-450c-94b0-492a92bb6027 => generated 1322 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:06.866399 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b89c7e48-63bd-4199-adad-e0a3a322170f tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:06.867891 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b89c7e48-63bd-4199-adad-e0a3a322170f tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] [instance: 00b0dfe0-2c88-4037-830f-4144190da935] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:06.875545 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b89c7e48-63bd-4199-adad-e0a3a322170f tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:06.876273 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b89c7e48-63bd-4199-adad-e0a3a322170f tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:06.877078 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b89c7e48-63bd-4199-adad-e0a3a322170f tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:06.878239 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b89c7e48-63bd-4199-adad-e0a3a322170f tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:06.879141 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b89c7e48-63bd-4199-adad-e0a3a322170f tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:06.880077 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b89c7e48-63bd-4199-adad-e0a3a322170f tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:07.028062 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b89c7e48-63bd-4199-adad-e0a3a322170f tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ca1489f0084089a47d0cfc2ad37940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a297ddf04b4b18ae7591e107e84d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:07.037811 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b89c7e48-63bd-4199-adad-e0a3a322170f tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] 10.222.0.79 "GET /compute/v2.1/servers/00b0dfe0-2c88-4037-830f-4144190da935" status: 200 len: 1271 microversion: 2.1 time: 0.175691 Oct 17 13:34:07.043241 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 113/212] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:06 2022] GET /compute/v2.1/servers/00b0dfe0-2c88-4037-830f-4144190da935 => generated 1271 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:07.145326 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-21adbea7-108a-4596-b5c1-4e645969e2a0 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4552e3fbd4de4d2997d5db7ec500de65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e76de886880490ba8373e0d86056c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:07.167427 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-21adbea7-108a-4596-b5c1-4e645969e2a0 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] 10.222.0.79 "GET /compute/v2.1/servers/eb4474f8-de59-4187-8b15-ba0ec266bfa6" status: 200 len: 1494 microversion: 2.1 time: 0.845281 Oct 17 13:34:07.183367 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 100/213] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:06 2022] GET /compute/v2.1/servers/eb4474f8-de59-4187-8b15-ba0ec266bfa6 => generated 1494 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:07.885210 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-346ef9e7-d388-4941-89c3-de0227eb88ca tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:07.886215 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-346ef9e7-d388-4941-89c3-de0227eb88ca tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] [instance: 12e5e9fe-b998-450c-94b0-492a92bb6027] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:07.899772 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-346ef9e7-d388-4941-89c3-de0227eb88ca tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:07.900261 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-346ef9e7-d388-4941-89c3-de0227eb88ca tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:07.900882 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-346ef9e7-d388-4941-89c3-de0227eb88ca tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:07.912555 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-346ef9e7-d388-4941-89c3-de0227eb88ca tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:07.917141 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-346ef9e7-d388-4941-89c3-de0227eb88ca tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:07.929566 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-346ef9e7-d388-4941-89c3-de0227eb88ca tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:08.062006 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-def3e4df-061c-459c-afa0-cffbb94b86bb tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:08.062930 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-def3e4df-061c-459c-afa0-cffbb94b86bb tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] [instance: 00b0dfe0-2c88-4037-830f-4144190da935] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:08.081634 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-def3e4df-061c-459c-afa0-cffbb94b86bb tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:08.084249 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-def3e4df-061c-459c-afa0-cffbb94b86bb tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:08.085324 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-def3e4df-061c-459c-afa0-cffbb94b86bb tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:08.088297 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-def3e4df-061c-459c-afa0-cffbb94b86bb tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:08.095356 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-def3e4df-061c-459c-afa0-cffbb94b86bb tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:08.097748 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-def3e4df-061c-459c-afa0-cffbb94b86bb tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:08.324552 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-def3e4df-061c-459c-afa0-cffbb94b86bb tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ca1489f0084089a47d0cfc2ad37940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a297ddf04b4b18ae7591e107e84d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:08.351396 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-def3e4df-061c-459c-afa0-cffbb94b86bb tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] 10.222.0.79 "GET /compute/v2.1/servers/00b0dfe0-2c88-4037-830f-4144190da935" status: 200 len: 1271 microversion: 2.1 time: 0.293342 Oct 17 13:34:08.357004 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 101/214] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:08 2022] GET /compute/v2.1/servers/00b0dfe0-2c88-4037-830f-4144190da935 => generated 1271 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:08.375682 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-69533fe6-09ff-4e9b-bc88-dc83896ae53b req-a36e680a-98d0-45af-948d-e78c13c0a2cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb4474f8-de59-4187-8b15-ba0ec266bfa6", "name": "network-vif-deleted", "tag": "61661e1e-c655-419f-8f05-7f4bc97a8b4b"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:08.405039 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-69533fe6-09ff-4e9b-bc88-dc83896ae53b req-a36e680a-98d0-45af-948d-e78c13c0a2cc service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:08.405562 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-69533fe6-09ff-4e9b-bc88-dc83896ae53b req-a36e680a-98d0-45af-948d-e78c13c0a2cc service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:08.406468 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-69533fe6-09ff-4e9b-bc88-dc83896ae53b req-a36e680a-98d0-45af-948d-e78c13c0a2cc service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:08.437806 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-69533fe6-09ff-4e9b-bc88-dc83896ae53b req-a36e680a-98d0-45af-948d-e78c13c0a2cc service nova] Creating event network-vif-deleted:61661e1e-c655-419f-8f05-7f4bc97a8b4b for instance eb4474f8-de59-4187-8b15-ba0ec266bfa6 on n-h2-854247-14 Oct 17 13:34:08.449961 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-69533fe6-09ff-4e9b-bc88-dc83896ae53b req-a36e680a-98d0-45af-948d-e78c13c0a2cc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090916 Oct 17 13:34:08.451256 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 102/215] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:08.454800 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-346ef9e7-d388-4941-89c3-de0227eb88ca tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e836340278b49f593350249132b9cfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550b2bda88024756abc4134365842d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:08.465364 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-708817c0-d0de-4160-ba3d-e254d11cc5ae tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:08.465721 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-346ef9e7-d388-4941-89c3-de0227eb88ca tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] 10.222.0.79 "GET /compute/v2.1/servers/12e5e9fe-b998-450c-94b0-492a92bb6027" status: 200 len: 1389 microversion: 2.1 time: 0.585523 Oct 17 13:34:08.466126 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-708817c0-d0de-4160-ba3d-e254d11cc5ae tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] [instance: eb4474f8-de59-4187-8b15-ba0ec266bfa6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:08.466305 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 114/216] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:07 2022] GET /compute/v2.1/servers/12e5e9fe-b998-450c-94b0-492a92bb6027 => generated 1389 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:34:08.490060 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-708817c0-d0de-4160-ba3d-e254d11cc5ae tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:08.490828 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-708817c0-d0de-4160-ba3d-e254d11cc5ae tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:08.491441 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-708817c0-d0de-4160-ba3d-e254d11cc5ae tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:08.493343 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-708817c0-d0de-4160-ba3d-e254d11cc5ae tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:08.493808 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-708817c0-d0de-4160-ba3d-e254d11cc5ae tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:08.494529 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-708817c0-d0de-4160-ba3d-e254d11cc5ae tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:08.538623 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-708817c0-d0de-4160-ba3d-e254d11cc5ae tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:08.542608 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-708817c0-d0de-4160-ba3d-e254d11cc5ae tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:08.543140 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-708817c0-d0de-4160-ba3d-e254d11cc5ae tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:08.543711 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-708817c0-d0de-4160-ba3d-e254d11cc5ae tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lazy-loading 'fault' on Instance uuid eb4474f8-de59-4187-8b15-ba0ec266bfa6 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:34:08.595150 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-708817c0-d0de-4160-ba3d-e254d11cc5ae tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4552e3fbd4de4d2997d5db7ec500de65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e76de886880490ba8373e0d86056c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:08.611590 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-708817c0-d0de-4160-ba3d-e254d11cc5ae tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] 10.222.0.79 "GET /compute/v2.1/servers/eb4474f8-de59-4187-8b15-ba0ec266bfa6" status: 200 len: 1328 microversion: 2.1 time: 0.158120 Oct 17 13:34:08.612481 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 103/217] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:08 2022] GET /compute/v2.1/servers/eb4474f8-de59-4187-8b15-ba0ec266bfa6 => generated 1328 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:09.378566 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7ae6420f-df71-4fc0-a4a9-87976e129113 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:09.382028 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7ae6420f-df71-4fc0-a4a9-87976e129113 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] [instance: 00b0dfe0-2c88-4037-830f-4144190da935] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:09.389964 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7ae6420f-df71-4fc0-a4a9-87976e129113 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:09.390895 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7ae6420f-df71-4fc0-a4a9-87976e129113 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:09.391617 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7ae6420f-df71-4fc0-a4a9-87976e129113 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:09.392385 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7ae6420f-df71-4fc0-a4a9-87976e129113 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:09.393167 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7ae6420f-df71-4fc0-a4a9-87976e129113 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:09.393592 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7ae6420f-df71-4fc0-a4a9-87976e129113 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:09.494994 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-aa229eb3-7f20-4042-b23e-a9c9d9a82bd5 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:09.496653 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-aa229eb3-7f20-4042-b23e-a9c9d9a82bd5 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] [instance: 12e5e9fe-b998-450c-94b0-492a92bb6027] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:09.505997 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aa229eb3-7f20-4042-b23e-a9c9d9a82bd5 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:09.507395 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aa229eb3-7f20-4042-b23e-a9c9d9a82bd5 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:09.508218 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aa229eb3-7f20-4042-b23e-a9c9d9a82bd5 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:09.509170 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aa229eb3-7f20-4042-b23e-a9c9d9a82bd5 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:09.510200 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aa229eb3-7f20-4042-b23e-a9c9d9a82bd5 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:09.510899 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aa229eb3-7f20-4042-b23e-a9c9d9a82bd5 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:09.650546 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7ae6420f-df71-4fc0-a4a9-87976e129113 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ca1489f0084089a47d0cfc2ad37940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a297ddf04b4b18ae7591e107e84d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:09.663950 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7ae6420f-df71-4fc0-a4a9-87976e129113 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] 10.222.0.79 "GET /compute/v2.1/servers/00b0dfe0-2c88-4037-830f-4144190da935" status: 200 len: 1271 microversion: 2.1 time: 0.289926 Oct 17 13:34:09.664864 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 115/218] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:09 2022] GET /compute/v2.1/servers/00b0dfe0-2c88-4037-830f-4144190da935 => generated 1271 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:09.670303 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-68864f78-b11f-4c02-b556-08c128c3633a tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:09.671761 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-68864f78-b11f-4c02-b556-08c128c3633a tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] [instance: eb4474f8-de59-4187-8b15-ba0ec266bfa6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:09.679383 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-68864f78-b11f-4c02-b556-08c128c3633a tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:09.680257 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-68864f78-b11f-4c02-b556-08c128c3633a tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:09.680880 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-68864f78-b11f-4c02-b556-08c128c3633a tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:09.682020 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-68864f78-b11f-4c02-b556-08c128c3633a tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:09.682699 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-68864f78-b11f-4c02-b556-08c128c3633a tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:09.683277 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-68864f78-b11f-4c02-b556-08c128c3633a tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:09.701007 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-68864f78-b11f-4c02-b556-08c128c3633a tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] HTTP exception thrown: Instance eb4474f8-de59-4187-8b15-ba0ec266bfa6 could not be found. Oct 17 13:34:09.704148 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-68864f78-b11f-4c02-b556-08c128c3633a tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Request method failure captured: Oct 17 13:34:09.704148 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/eb4474f8-de59-4187-8b15-ba0ec266bfa6 HTTP/1.1 Oct 17 13:34:09.704148 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:34:09.704148 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:34:09.704148 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:34:09.704148 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:34:09.704148 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:34:09.704148 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:34:09.704148 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:34:09.704148 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:34:09.704148 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVmmL55Z5bByWA0V2R9Iz0esDwWV3AMk8y27-EubVlYWTrNIiyCUZCnqJz0JUX-zcaaQdzmExOZDHu-iSuQDKjY7s9ONoGjDm94vEJREXlekyGeZ1418GZJATKJL80erVRqfqZSsXCAynRHg5ryL9-DjapFSVL5eQIDm1WHUljhNiiY Oct 17 13:34:09.704148 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:34:09.704148 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:34:09.704148 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:34:09.704148 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:34:09.704148 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:34:09.704148 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:34:09.704148 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 9e76de886880490ba8373e0d86056c7b Oct 17 13:34:09.704148 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-AggregatesAdminTestJSON-821890302 Oct 17 13:34:09.704148 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:34:09.704148 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:34:09.705688 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9e76de886880490ba8373e0d86056c7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/9e76de886880490ba8373e0d86056c7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9e76de886880490ba8373e0d86056c7b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_9e76de886880490ba8373e0d86056c7b", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:34:09.705688 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-AggregatesAdminTestJSON-821890302 Oct 17 13:34:09.705688 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 9e76de886880490ba8373e0d86056c7b Oct 17 13:34:09.705688 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-821890302 Oct 17 13:34:09.705688 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-AggregatesAdminTestJSON-821890302-project Oct 17 13:34:09.705688 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:34:09.705688 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:34:09.705688 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 4552e3fbd4de4d2997d5db7ec500de65 Oct 17 13:34:09.705688 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-AggregatesAdminTestJSON-821890302-project Oct 17 13:34:09.705688 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:34:09.705688 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance eb4474f8-de59-4187-8b15-ba0ec266bfa6 could not be found. Oct 17 13:34:09.705688 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'eb4474f8-de59-4187-8b15-ba0ec266bfa6'} Oct 17 13:34:09.706503 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:34:09.706503 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:09.706503 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:34:09.706503 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:34:09.706503 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:34:09.706503 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:34:09.706503 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:34:09.706503 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:34:09.706503 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:34:09.706503 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:34:09.706503 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb4474f8-de59-4187-8b15-ba0ec266bfa6 could not be found. Oct 17 13:34:09.706503 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:09.706503 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:09.706503 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:09.706503 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:09.706503 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:09.706503 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:09.706503 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:34:09.706503 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:34:09.706503 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:34:09.709279 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:34:09.709279 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:34:09.709279 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:34:09.709279 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:34:09.709279 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:34:09.709279 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:34:09.709279 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:34:09.709279 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb4474f8-de59-4187-8b15-ba0ec266bfa6 could not be found. Oct 17 13:34:09.709279 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:09.709279 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:09.709279 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:09.709279 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:09.709279 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:09.709279 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:09.709279 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:34:09.709279 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:34:09.709279 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb4474f8-de59-4187-8b15-ba0ec266bfa6 could not be found. Oct 17 13:34:09.709279 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:09.710335 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-68864f78-b11f-4c02-b556-08c128c3633a tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Returning 404 to user: Instance eb4474f8-de59-4187-8b15-ba0ec266bfa6 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:34:09.710335 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-68864f78-b11f-4c02-b556-08c128c3633a tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] 10.222.0.79 "GET /compute/v2.1/servers/eb4474f8-de59-4187-8b15-ba0ec266bfa6" status: 404 len: 111 microversion: 2.1 time: 0.041515 Oct 17 13:34:09.710335 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 116/219] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:09 2022] GET /compute/v2.1/servers/eb4474f8-de59-4187-8b15-ba0ec266bfa6 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:34:09.718575 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-320e0f41-a6e8-4995-8004-a0d5852a09d1 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854247-14"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:09.733533 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-320e0f41-a6e8-4995-8004-a0d5852a09d1 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:09.733720 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-aa229eb3-7f20-4042-b23e-a9c9d9a82bd5 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e836340278b49f593350249132b9cfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550b2bda88024756abc4134365842d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:09.734643 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-320e0f41-a6e8-4995-8004-a0d5852a09d1 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:09.735090 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-320e0f41-a6e8-4995-8004-a0d5852a09d1 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:09.744896 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-aa229eb3-7f20-4042-b23e-a9c9d9a82bd5 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] 10.222.0.79 "GET /compute/v2.1/servers/12e5e9fe-b998-450c-94b0-492a92bb6027" status: 200 len: 1389 microversion: 2.1 time: 0.258981 Oct 17 13:34:09.751217 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 104/220] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:09 2022] GET /compute/v2.1/servers/12e5e9fe-b998-450c-94b0-492a92bb6027 => generated 1389 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:34:10.424350 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-320e0f41-a6e8-4995-8004-a0d5852a09d1 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 298 microversion: 2.1 time: 0.710040 Oct 17 13:34:10.424970 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 117/221] 10.222.0.79 () {60 vars in 1191 bytes} [Mon Oct 17 13:34:09 2022] POST /compute/v2.1/os-aggregates/2/action => generated 298 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:10.437786 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b853b067-0b32-4ce9-8fa5-ec331a9c5197 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:10.467357 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b853b067-0b32-4ce9-8fa5-ec331a9c5197 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.034036 Oct 17 13:34:10.468454 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 105/222] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Oct 17 13:34:10 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 17 13:34:10.483146 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2e499026-d8d4-4884-9d4d-49b9ad6f3efa tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-40823285"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:10.486751 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.aggregate [None req-2e499026-d8d4-4884-9d4d-49b9ad6f3efa tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Generated uuid 1e8018f2-909f-484a-98f8-493b3fd8e033 for aggregate {{(pid=127017) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 13:34:10.511198 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2e499026-d8d4-4884-9d4d-49b9ad6f3efa tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 196 microversion: 2.1 time: 0.032855 Oct 17 13:34:10.513486 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 118/223] 10.222.0.79 () {60 vars in 1164 bytes} [Mon Oct 17 13:34:10 2022] POST /compute/v2.1/os-aggregates => generated 196 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:10.523956 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-64a14c67-08d9-426e-922d-b3c8853c0fea tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854247-14"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:10.535779 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-64a14c67-08d9-426e-922d-b3c8853c0fea tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:10.536257 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-64a14c67-08d9-426e-922d-b3c8853c0fea tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:10.536859 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-64a14c67-08d9-426e-922d-b3c8853c0fea tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:10.688864 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-00dc6f8d-c4b7-4275-8836-ad450c7603b8 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:10.689449 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-00dc6f8d-c4b7-4275-8836-ad450c7603b8 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] [instance: 00b0dfe0-2c88-4037-830f-4144190da935] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:10.702349 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-64a14c67-08d9-426e-922d-b3c8853c0fea tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 241 microversion: 2.1 time: 0.181973 Oct 17 13:34:10.703647 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 106/224] 10.222.0.79 () {60 vars in 1191 bytes} [Mon Oct 17 13:34:10 2022] POST /compute/v2.1/os-aggregates/3/action => generated 241 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:34:10.704260 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-00dc6f8d-c4b7-4275-8836-ad450c7603b8 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:10.704807 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-00dc6f8d-c4b7-4275-8836-ad450c7603b8 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:10.705247 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-00dc6f8d-c4b7-4275-8836-ad450c7603b8 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:10.706294 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-00dc6f8d-c4b7-4275-8836-ad450c7603b8 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:10.707486 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-00dc6f8d-c4b7-4275-8836-ad450c7603b8 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:10.708082 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-00dc6f8d-c4b7-4275-8836-ad450c7603b8 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:10.715257 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c7f22b36-8740-4cad-bf1c-6fb8f1241fd1 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:10.724763 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c7f22b36-8740-4cad-bf1c-6fb8f1241fd1 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] 10.222.0.79 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 241 microversion: 2.1 time: 0.013540 Oct 17 13:34:10.725812 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 107/225] 10.222.0.79 () {58 vars in 1149 bytes} [Mon Oct 17 13:34:10 2022] GET /compute/v2.1/os-aggregates/3 => generated 241 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:34:10.737856 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d2ac0bd4-95bd-4fdf-b7cd-18c64885e190 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854247-14"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:10.749848 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d2ac0bd4-95bd-4fdf-b7cd-18c64885e190 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:10.750821 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d2ac0bd4-95bd-4fdf-b7cd-18c64885e190 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:10.751528 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d2ac0bd4-95bd-4fdf-b7cd-18c64885e190 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:10.796267 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-00dc6f8d-c4b7-4275-8836-ad450c7603b8 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ca1489f0084089a47d0cfc2ad37940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a297ddf04b4b18ae7591e107e84d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:10.813000 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-00dc6f8d-c4b7-4275-8836-ad450c7603b8 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] 10.222.0.79 "GET /compute/v2.1/servers/00b0dfe0-2c88-4037-830f-4144190da935" status: 200 len: 1271 microversion: 2.1 time: 0.128928 Oct 17 13:34:10.823574 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 119/226] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:10 2022] GET /compute/v2.1/servers/00b0dfe0-2c88-4037-830f-4144190da935 => generated 1271 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:34:10.839083 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-862f7800-f8e3-429b-aace-a08ff2ae7490 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:10.840477 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-862f7800-f8e3-429b-aace-a08ff2ae7490 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] [instance: 12e5e9fe-b998-450c-94b0-492a92bb6027] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:10.857679 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-862f7800-f8e3-429b-aace-a08ff2ae7490 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:10.860257 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-862f7800-f8e3-429b-aace-a08ff2ae7490 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:10.861043 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-862f7800-f8e3-429b-aace-a08ff2ae7490 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:10.861778 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-862f7800-f8e3-429b-aace-a08ff2ae7490 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:10.862955 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-862f7800-f8e3-429b-aace-a08ff2ae7490 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:10.863443 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-862f7800-f8e3-429b-aace-a08ff2ae7490 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:10.969436 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d2ac0bd4-95bd-4fdf-b7cd-18c64885e190 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 225 microversion: 2.1 time: 0.235753 Oct 17 13:34:10.971053 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 108/227] 10.222.0.79 () {60 vars in 1191 bytes} [Mon Oct 17 13:34:10 2022] POST /compute/v2.1/os-aggregates/3/action => generated 225 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:10.984985 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fbc3eb0f-29d3-4500-94a0-d91e31711cbb tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:11.018507 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fbc3eb0f-29d3-4500-94a0-d91e31711cbb tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.039125 Oct 17 13:34:11.019909 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 109/228] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Oct 17 13:34:10 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 17 13:34:11.031753 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c3919e09-8617-4cca-8613-f9ed7127ac89 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-193893563"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:11.036633 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.aggregate [None req-c3919e09-8617-4cca-8613-f9ed7127ac89 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Generated uuid dd4b2801-a9fa-44e1-b0a5-ef2705f6ff34 for aggregate {{(pid=127016) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 13:34:11.103768 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-862f7800-f8e3-429b-aace-a08ff2ae7490 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e836340278b49f593350249132b9cfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550b2bda88024756abc4134365842d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:11.117460 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-862f7800-f8e3-429b-aace-a08ff2ae7490 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] 10.222.0.79 "GET /compute/v2.1/servers/12e5e9fe-b998-450c-94b0-492a92bb6027" status: 200 len: 1389 microversion: 2.1 time: 0.288459 Oct 17 13:34:11.120014 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 120/229] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:10 2022] GET /compute/v2.1/servers/12e5e9fe-b998-450c-94b0-492a92bb6027 => generated 1389 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:11.332152 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c3919e09-8617-4cca-8613-f9ed7127ac89 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.303881 Oct 17 13:34:11.334444 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 110/230] 10.222.0.79 () {60 vars in 1164 bytes} [Mon Oct 17 13:34:11 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:34:11.373590 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b875b92e-c8bd-4e5c-b3d6-f83cdaeffd0d tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854247-14"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:11.413487 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b875b92e-c8bd-4e5c-b3d6-f83cdaeffd0d tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:11.413983 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b875b92e-c8bd-4e5c-b3d6-f83cdaeffd0d tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:11.414420 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b875b92e-c8bd-4e5c-b3d6-f83cdaeffd0d tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:11.433174 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:DELETE=4 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:34:11.577411 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b875b92e-c8bd-4e5c-b3d6-f83cdaeffd0d tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 242 microversion: 2.1 time: 0.231720 Oct 17 13:34:11.578169 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 121/231] 10.222.0.79 () {60 vars in 1191 bytes} [Mon Oct 17 13:34:11 2022] POST /compute/v2.1/os-aggregates/4/action => generated 242 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:11.590727 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-129bbc8a-a307-435f-a342-71774b30f0f1 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:11.598991 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-129bbc8a-a307-435f-a342-71774b30f0f1 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] 10.222.0.79 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.011737 Oct 17 13:34:11.600534 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 111/232] 10.222.0.79 () {58 vars in 1143 bytes} [Mon Oct 17 13:34:11 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:11.614155 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-07528896-92e4-4db1-bf2c-1396755682df tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854247-14"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:11.636668 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-07528896-92e4-4db1-bf2c-1396755682df tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:11.637327 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-07528896-92e4-4db1-bf2c-1396755682df tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:11.638042 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-07528896-92e4-4db1-bf2c-1396755682df tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:11.849322 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d3fee7ed-284b-47be-a2de-7114e313af8d tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:11.849974 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d3fee7ed-284b-47be-a2de-7114e313af8d tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] [instance: 00b0dfe0-2c88-4037-830f-4144190da935] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:11.866209 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-07528896-92e4-4db1-bf2c-1396755682df tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 226 microversion: 2.1 time: 0.254315 Oct 17 13:34:11.873216 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 122/233] 10.222.0.79 () {60 vars in 1191 bytes} [Mon Oct 17 13:34:11 2022] POST /compute/v2.1/os-aggregates/4/action => generated 226 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:11.873396 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d3fee7ed-284b-47be-a2de-7114e313af8d tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:11.873396 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d3fee7ed-284b-47be-a2de-7114e313af8d tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:11.873396 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d3fee7ed-284b-47be-a2de-7114e313af8d tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:11.873396 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d3fee7ed-284b-47be-a2de-7114e313af8d tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:11.873701 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d3fee7ed-284b-47be-a2de-7114e313af8d tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:11.873701 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d3fee7ed-284b-47be-a2de-7114e313af8d tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:11.878829 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4bf7141e-7c4b-41b5-81b7-fc47831e16cc tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:11.950061 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4bf7141e-7c4b-41b5-81b7-fc47831e16cc tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.074083 Oct 17 13:34:11.956019 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 123/234] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Oct 17 13:34:11 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 13:34:11.961764 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f5be6519-dc99-4f3e-88a9-6826d0d0d7f0 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1852705667"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:11.976746 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.aggregate [None req-f5be6519-dc99-4f3e-88a9-6826d0d0d7f0 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Generated uuid c24b66ce-b65e-4668-9dcf-676ab791db22 for aggregate {{(pid=127017) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 13:34:12.018635 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f5be6519-dc99-4f3e-88a9-6826d0d0d7f0 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.056677 Oct 17 13:34:12.020562 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 124/235] 10.222.0.79 () {60 vars in 1164 bytes} [Mon Oct 17 13:34:11 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:12.038610 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-46d19c45-a37f-4a0f-bf40-434af5892304 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854247-14"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:12.044006 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d3fee7ed-284b-47be-a2de-7114e313af8d tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ca1489f0084089a47d0cfc2ad37940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a297ddf04b4b18ae7591e107e84d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:12.056393 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d3fee7ed-284b-47be-a2de-7114e313af8d tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] 10.222.0.79 "GET /compute/v2.1/servers/00b0dfe0-2c88-4037-830f-4144190da935" status: 200 len: 1279 microversion: 2.1 time: 0.211915 Oct 17 13:34:12.057976 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 112/236] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:11 2022] GET /compute/v2.1/servers/00b0dfe0-2c88-4037-830f-4144190da935 => generated 1279 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:34:12.077904 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-46d19c45-a37f-4a0f-bf40-434af5892304 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:12.079128 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-46d19c45-a37f-4a0f-bf40-434af5892304 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:12.079612 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-46d19c45-a37f-4a0f-bf40-434af5892304 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:12.283731 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-46d19c45-a37f-4a0f-bf40-434af5892304 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 243 microversion: 2.1 time: 0.253867 Oct 17 13:34:12.284770 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 125/237] 10.222.0.79 () {60 vars in 1191 bytes} [Mon Oct 17 13:34:12 2022] POST /compute/v2.1/os-aggregates/5/action => generated 243 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:12.290063 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2f886d05-763f-4f8c-8f50-54b27b90089a tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:12.290873 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2f886d05-763f-4f8c-8f50-54b27b90089a tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] [instance: 12e5e9fe-b998-450c-94b0-492a92bb6027] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:12.298635 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2f886d05-763f-4f8c-8f50-54b27b90089a tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:12.299227 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2f886d05-763f-4f8c-8f50-54b27b90089a tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:12.299665 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2f886d05-763f-4f8c-8f50-54b27b90089a tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:12.300374 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2f886d05-763f-4f8c-8f50-54b27b90089a tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:12.300817 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2f886d05-763f-4f8c-8f50-54b27b90089a tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:12.301399 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2f886d05-763f-4f8c-8f50-54b27b90089a tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:12.341525 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-041d0c91-d070-411b-814a-a55e5209b0d8 tempest-QuotasAdminTestV236-3161224 tempest-QuotasAdminTestV236-3161224-project-admin] Action: 'update', calling method: .version_select at 0x7f7cd6271d30>, body: {"quota_set": {"ram": "5120"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:12.414814 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-041d0c91-d070-411b-814a-a55e5209b0d8 tempest-QuotasAdminTestV236-3161224 tempest-QuotasAdminTestV236-3161224-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:12.415427 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-041d0c91-d070-411b-814a-a55e5209b0d8 tempest-QuotasAdminTestV236-3161224 tempest-QuotasAdminTestV236-3161224-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:12.416399 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-041d0c91-d070-411b-814a-a55e5209b0d8 tempest-QuotasAdminTestV236-3161224 tempest-QuotasAdminTestV236-3161224-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:12.417434 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-041d0c91-d070-411b-814a-a55e5209b0d8 tempest-QuotasAdminTestV236-3161224 tempest-QuotasAdminTestV236-3161224-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:12.418424 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-041d0c91-d070-411b-814a-a55e5209b0d8 tempest-QuotasAdminTestV236-3161224 tempest-QuotasAdminTestV236-3161224-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:12.419058 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-041d0c91-d070-411b-814a-a55e5209b0d8 tempest-QuotasAdminTestV236-3161224 tempest-QuotasAdminTestV236-3161224-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:12.433772 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=8,nova_api:INSERT=5 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:34:12.492216 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-041d0c91-d070-411b-814a-a55e5209b0d8 tempest-QuotasAdminTestV236-3161224 tempest-QuotasAdminTestV236-3161224-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-sets/f3b5a8f09a424f638e04bef9a8c00e9d" status: 200 len: 240 microversion: 2.36 time: 0.371542 Oct 17 13:34:12.497715 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 113/238] 10.222.0.79 () {62 vars in 1303 bytes} [Mon Oct 17 13:34:12 2022] PUT /compute/v2.1/os-quota-sets/f3b5a8f09a424f638e04bef9a8c00e9d => generated 240 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:34:12.504989 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0f3fcc71-3729-4a23-a124-8b935c45de77 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854247-14"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:12.517460 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0f3fcc71-3729-4a23-a124-8b935c45de77 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:12.517930 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0f3fcc71-3729-4a23-a124-8b935c45de77 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:12.518348 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0f3fcc71-3729-4a23-a124-8b935c45de77 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:12.648134 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0f3fcc71-3729-4a23-a124-8b935c45de77 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 227 microversion: 2.1 time: 0.147155 Oct 17 13:34:12.657201 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 114/239] 10.222.0.79 () {60 vars in 1191 bytes} [Mon Oct 17 13:34:12 2022] POST /compute/v2.1/os-aggregates/5/action => generated 227 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:12.662350 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-25f7c3a6-1974-40d8-a7ad-af433953bd86 tempest-QuotasAdminTestV236-3161224 tempest-QuotasAdminTestV236-3161224-project-admin] Calling method '.version_select at 0x7f7cd63c9c10>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:12.733582 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-25f7c3a6-1974-40d8-a7ad-af433953bd86 tempest-QuotasAdminTestV236-3161224 tempest-QuotasAdminTestV236-3161224-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:12.734467 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-25f7c3a6-1974-40d8-a7ad-af433953bd86 tempest-QuotasAdminTestV236-3161224 tempest-QuotasAdminTestV236-3161224-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:12.735148 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-25f7c3a6-1974-40d8-a7ad-af433953bd86 tempest-QuotasAdminTestV236-3161224 tempest-QuotasAdminTestV236-3161224-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:12.736509 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-25f7c3a6-1974-40d8-a7ad-af433953bd86 tempest-QuotasAdminTestV236-3161224 tempest-QuotasAdminTestV236-3161224-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:12.737369 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-25f7c3a6-1974-40d8-a7ad-af433953bd86 tempest-QuotasAdminTestV236-3161224 tempest-QuotasAdminTestV236-3161224-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:12.738064 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-25f7c3a6-1974-40d8-a7ad-af433953bd86 tempest-QuotasAdminTestV236-3161224 tempest-QuotasAdminTestV236-3161224-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:12.768584 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-25f7c3a6-1974-40d8-a7ad-af433953bd86 tempest-QuotasAdminTestV236-3161224 tempest-QuotasAdminTestV236-3161224-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/f3b5a8f09a424f638e04bef9a8c00e9d/detail" status: 200 len: 672 microversion: 2.36 time: 0.109924 Oct 17 13:34:12.771361 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 115/240] 10.222.0.79 () {60 vars in 1304 bytes} [Mon Oct 17 13:34:12 2022] GET /compute/v2.1/os-quota-sets/f3b5a8f09a424f638e04bef9a8c00e9d/detail => generated 672 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:34:12.774827 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7889686d-d2a3-47ec-bb4e-7c66e749ed20 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:12.813917 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7889686d-d2a3-47ec-bb4e-7c66e749ed20 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.042793 Oct 17 13:34:12.819464 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 116/241] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Oct 17 13:34:12 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 13:34:12.827573 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-41b04101-b5c6-42f0-af81-c4709fd83b22 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-734533484"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:12.832453 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.aggregate [None req-41b04101-b5c6-42f0-af81-c4709fd83b22 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Generated uuid 6f5f611e-2bcd-4ee8-be23-8df6da67ce21 for aggregate {{(pid=127016) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 13:34:12.844361 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2f886d05-763f-4f8c-8f50-54b27b90089a tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e836340278b49f593350249132b9cfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550b2bda88024756abc4134365842d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:12.857426 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2f886d05-763f-4f8c-8f50-54b27b90089a tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] 10.222.0.79 "GET /compute/v2.1/servers/12e5e9fe-b998-450c-94b0-492a92bb6027" status: 200 len: 1389 microversion: 2.1 time: 0.571480 Oct 17 13:34:12.857997 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 126/242] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:12 2022] GET /compute/v2.1/servers/12e5e9fe-b998-450c-94b0-492a92bb6027 => generated 1389 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:12.874599 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-41b04101-b5c6-42f0-af81-c4709fd83b22 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.050300 Oct 17 13:34:12.876843 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c78eaee9-7e9c-427b-9c5c-2f7b3970083d tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2076176890"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:12.879478 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 117/243] 10.222.0.79 () {60 vars in 1164 bytes} [Mon Oct 17 13:34:12 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:12.882581 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.aggregate [None req-c78eaee9-7e9c-427b-9c5c-2f7b3970083d tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Generated uuid db3779ab-d06d-4ba8-a4aa-cb50588c1f22 for aggregate {{(pid=127017) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 13:34:12.889880 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2da3f754-7fa4-4d26-ae80-ee8d1ee78850 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:12.924346 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2da3f754-7fa4-4d26-ae80-ee8d1ee78850 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.040772 Oct 17 13:34:12.927500 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 118/244] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Oct 17 13:34:12 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 13:34:12.946062 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-365e3a29-3076-4e0b-a847-e3819cbb76b8 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:12.949029 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c78eaee9-7e9c-427b-9c5c-2f7b3970083d tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.075504 Oct 17 13:34:12.949815 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 127/245] 10.222.0.79 () {60 vars in 1164 bytes} [Mon Oct 17 13:34:12 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:12.965495 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-25f7c344-1f17-44cc-aac8-27fcafb9feea tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854247-14"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:12.968088 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-365e3a29-3076-4e0b-a847-e3819cbb76b8 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Oct 17 13:34:12.970416 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-365e3a29-3076-4e0b-a847-e3819cbb76b8 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Request method failure captured: Oct 17 13:34:12.970416 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/os-aggregates/6 HTTP/1.1 Oct 17 13:34:12.970416 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:34:12.970416 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:34:12.970416 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:34:12.970416 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:34:12.970416 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:34:12.970416 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:34:12.970416 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:34:12.970416 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:34:12.970416 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVmoR_TGvbdvkcfrBp_zc08IA0Flbz5TRjFR3E_DOe_fx9GSw5iI6JQjrylGr9CxuoFiXNyGR3gTSJ5j1ZfL0Vq7HdWIdJP8HxQ79IaRr2y1TKcq5yCVLg57QCeQ4ynfLCXZxUcK3ri-E-H-j-aywVfLFLIhjSTrvNcEdWWgcLmba8o Oct 17 13:34:12.970416 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:34:12.970416 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:34:12.970416 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:34:12.970416 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:34:12.970416 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:34:12.970416 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:34:12.970416 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: b5d12cc1aeb146ec8e09b712911d6218 Oct 17 13:34:12.970416 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-AggregatesAdminTestJSON-712919916 Oct 17 13:34:12.970416 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member,admin Oct 17 13:34:12.970416 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member,admin Oct 17 13:34:12.971572 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b5d12cc1aeb146ec8e09b712911d6218"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b5d12cc1aeb146ec8e09b712911d6218"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b5d12cc1aeb146ec8e09b712911d6218"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b5d12cc1aeb146ec8e09b712911d6218", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:34:12.971572 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-AggregatesAdminTestJSON-712919916 Oct 17 13:34:12.971572 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: b5d12cc1aeb146ec8e09b712911d6218 Oct 17 13:34:12.971572 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-712919916 Oct 17 13:34:12.971572 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-AggregatesAdminTestJSON-712919916-project-admin Oct 17 13:34:12.971572 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:34:12.971572 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:34:12.971572 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 4853b66d091a483e9616df3d66cbda6d Oct 17 13:34:12.971572 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-AggregatesAdminTestJSON-712919916-project-admin Oct 17 13:34:12.971572 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:34:12.971572 n-d-854247-14 devstack@n-api.service[127016]: exception: Aggregate 6 could not be found. Oct 17 13:34:12.971572 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '6'} Oct 17 13:34:12.971572 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:34:12.972273 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:12.972273 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 17 13:34:12.972273 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 17 13:34:12.972273 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 17 13:34:12.972273 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 17 13:34:12.972273 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:34:12.972273 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:34:12.972273 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 17 13:34:12.972273 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 17 13:34:12.972273 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 13:34:12.972273 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 13:34:12.972273 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 17 13:34:12.972273 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 17 13:34:12.972273 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Oct 17 13:34:12.972273 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:12.972273 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:12.972273 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:12.972273 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:12.972273 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:12.977227 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:12.977227 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:34:12.977227 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:34:12.977227 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:34:12.977227 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:34:12.977227 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 17 13:34:12.977227 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:34:12.977227 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Oct 17 13:34:12.977227 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:12.977227 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:12.977227 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:12.977227 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:12.977227 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:12.977227 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:12.977227 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:34:12.977227 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:34:12.977227 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Oct 17 13:34:12.977227 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:12.977227 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-365e3a29-3076-4e0b-a847-e3819cbb76b8 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:34:12.978374 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-365e3a29-3076-4e0b-a847-e3819cbb76b8 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] 10.222.0.79 "GET /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.038460 Oct 17 13:34:12.978374 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 119/246] 10.222.0.79 () {58 vars in 1149 bytes} [Mon Oct 17 13:34:12 2022] GET /compute/v2.1/os-aggregates/6 => generated 77 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 17 13:34:12.983898 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c0064764-6e78-4646-a9f6-8e98fc4b4913 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:12.987944 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-25f7c344-1f17-44cc-aac8-27fcafb9feea tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:12.990832 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-25f7c344-1f17-44cc-aac8-27fcafb9feea tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:12.991977 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-25f7c344-1f17-44cc-aac8-27fcafb9feea tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:12.996234 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-c0064764-6e78-4646-a9f6-8e98fc4b4913 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Oct 17 13:34:12.998110 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c0064764-6e78-4646-a9f6-8e98fc4b4913 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Request method failure captured: Oct 17 13:34:12.998110 n-d-854247-14 devstack@n-api.service[127016]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Oct 17 13:34:12.998110 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:34:12.998110 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:34:12.998110 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:34:12.998110 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:34:12.998110 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:34:12.998110 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:34:12.998110 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:34:12.998110 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:34:12.998110 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVmoR_TGvbdvkcfrBp_zc08IA0Flbz5TRjFR3E_DOe_fx9GSw5iI6JQjrylGr9CxuoFiXNyGR3gTSJ5j1ZfL0Vq7HdWIdJP8HxQ79IaRr2y1TKcq5yCVLg57QCeQ4ynfLCXZxUcK3ri-E-H-j-aywVfLFLIhjSTrvNcEdWWgcLmba8o Oct 17 13:34:12.998110 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:34:12.998110 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:34:12.998110 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:34:12.998110 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:34:12.998110 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:34:12.998110 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:34:12.998110 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: b5d12cc1aeb146ec8e09b712911d6218 Oct 17 13:34:12.998110 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-AggregatesAdminTestJSON-712919916 Oct 17 13:34:12.998110 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member,admin Oct 17 13:34:12.998110 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member,admin Oct 17 13:34:12.999500 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b5d12cc1aeb146ec8e09b712911d6218"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b5d12cc1aeb146ec8e09b712911d6218"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b5d12cc1aeb146ec8e09b712911d6218"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b5d12cc1aeb146ec8e09b712911d6218", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:34:12.999500 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-AggregatesAdminTestJSON-712919916 Oct 17 13:34:12.999500 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: b5d12cc1aeb146ec8e09b712911d6218 Oct 17 13:34:12.999500 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-712919916 Oct 17 13:34:12.999500 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-AggregatesAdminTestJSON-712919916-project-admin Oct 17 13:34:12.999500 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:34:12.999500 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:34:12.999500 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 4853b66d091a483e9616df3d66cbda6d Oct 17 13:34:12.999500 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-AggregatesAdminTestJSON-712919916-project-admin Oct 17 13:34:12.999500 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:34:12.999500 n-d-854247-14 devstack@n-api.service[127016]: exception: Aggregate 6 could not be found. Oct 17 13:34:12.999500 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '6'} Oct 17 13:34:12.999500 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:34:13.000340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:13.000340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 17 13:34:13.000340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 17 13:34:13.000340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 17 13:34:13.000340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 17 13:34:13.000340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:34:13.000340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:34:13.000340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:34:13.000340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:34:13.000340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 17 13:34:13.000340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 17 13:34:13.000340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 17 13:34:13.000340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 17 13:34:13.000340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:34:13.000340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:34:13.000340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 17 13:34:13.000340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 17 13:34:13.000340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 13:34:13.000340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 13:34:13.001588 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 17 13:34:13.001588 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 17 13:34:13.001588 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Oct 17 13:34:13.001588 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:13.001588 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:13.001588 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:13.001588 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:13.001588 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:13.001588 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:13.001588 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:34:13.001588 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:34:13.001588 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:34:13.001588 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:34:13.001588 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 17 13:34:13.001588 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:34:13.001588 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Oct 17 13:34:13.001588 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:13.001588 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:13.001588 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:13.001588 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:13.001588 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:13.003055 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:13.003055 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:34:13.003055 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:34:13.003055 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Oct 17 13:34:13.003055 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:13.004509 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c0064764-6e78-4646-a9f6-8e98fc4b4913 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:34:13.005503 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c0064764-6e78-4646-a9f6-8e98fc4b4913 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.026077 Oct 17 13:34:13.006497 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 120/247] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Oct 17 13:34:12 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 77 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:34:13.017356 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5ed94289-83d9-4cd1-a3ad-58842de8822a tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-483965947", "name": "tempest-test_aggregate-381539436"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:13.047260 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.aggregate [None req-5ed94289-83d9-4cd1-a3ad-58842de8822a tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Generated uuid c6516feb-d66f-4d2d-b985-ece19cd2c9b7 for aggregate {{(pid=127016) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 13:34:13.078978 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5ed94289-83d9-4cd1-a3ad-58842de8822a tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.063442 Oct 17 13:34:13.079947 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 121/248] 10.222.0.79 () {60 vars in 1165 bytes} [Mon Oct 17 13:34:13 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:13.089501 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-706bf6f6-1285-4003-ae2d-9f71468615b1 tempest-QuotasAdminTestV236-3161224 tempest-QuotasAdminTestV236-3161224-project-admin] Action: 'update', calling method: .version_select at 0x7f7cd641fb80>, body: {"quota_set": {"ram": "2048"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:13.205181 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-706bf6f6-1285-4003-ae2d-9f71468615b1 tempest-QuotasAdminTestV236-3161224 tempest-QuotasAdminTestV236-3161224-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:13.205952 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-706bf6f6-1285-4003-ae2d-9f71468615b1 tempest-QuotasAdminTestV236-3161224 tempest-QuotasAdminTestV236-3161224-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:13.206667 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-706bf6f6-1285-4003-ae2d-9f71468615b1 tempest-QuotasAdminTestV236-3161224 tempest-QuotasAdminTestV236-3161224-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:13.207561 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-706bf6f6-1285-4003-ae2d-9f71468615b1 tempest-QuotasAdminTestV236-3161224 tempest-QuotasAdminTestV236-3161224-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:13.208151 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-706bf6f6-1285-4003-ae2d-9f71468615b1 tempest-QuotasAdminTestV236-3161224 tempest-QuotasAdminTestV236-3161224-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:13.208730 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-706bf6f6-1285-4003-ae2d-9f71468615b1 tempest-QuotasAdminTestV236-3161224 tempest-QuotasAdminTestV236-3161224-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:13.244403 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-25f7c344-1f17-44cc-aac8-27fcafb9feea tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 243 microversion: 2.1 time: 0.287024 Oct 17 13:34:13.254163 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 128/249] 10.222.0.79 () {60 vars in 1191 bytes} [Mon Oct 17 13:34:12 2022] POST /compute/v2.1/os-aggregates/7/action => generated 243 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:34:13.259663 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-706bf6f6-1285-4003-ae2d-9f71468615b1 tempest-QuotasAdminTestV236-3161224 tempest-QuotasAdminTestV236-3161224-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:13.260444 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-706bf6f6-1285-4003-ae2d-9f71468615b1 tempest-QuotasAdminTestV236-3161224 tempest-QuotasAdminTestV236-3161224-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:13.260791 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-877beb70-0f6a-4c24-890f-627ab5d7bbf1 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:13.260897 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-706bf6f6-1285-4003-ae2d-9f71468615b1 tempest-QuotasAdminTestV236-3161224 tempest-QuotasAdminTestV236-3161224-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:13.261695 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-877beb70-0f6a-4c24-890f-627ab5d7bbf1 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] [instance: 00b0dfe0-2c88-4037-830f-4144190da935] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:13.263703 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-706bf6f6-1285-4003-ae2d-9f71468615b1 tempest-QuotasAdminTestV236-3161224 tempest-QuotasAdminTestV236-3161224-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:13.264166 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-706bf6f6-1285-4003-ae2d-9f71468615b1 tempest-QuotasAdminTestV236-3161224 tempest-QuotasAdminTestV236-3161224-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:13.264603 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-706bf6f6-1285-4003-ae2d-9f71468615b1 tempest-QuotasAdminTestV236-3161224 tempest-QuotasAdminTestV236-3161224-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:13.271452 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-877beb70-0f6a-4c24-890f-627ab5d7bbf1 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:13.272226 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-877beb70-0f6a-4c24-890f-627ab5d7bbf1 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:13.273575 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-877beb70-0f6a-4c24-890f-627ab5d7bbf1 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:13.274767 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-877beb70-0f6a-4c24-890f-627ab5d7bbf1 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:13.275987 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-877beb70-0f6a-4c24-890f-627ab5d7bbf1 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:13.276903 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-877beb70-0f6a-4c24-890f-627ab5d7bbf1 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:13.290148 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=100 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:34:13.370757 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-706bf6f6-1285-4003-ae2d-9f71468615b1 tempest-QuotasAdminTestV236-3161224 tempest-QuotasAdminTestV236-3161224-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-sets/f3b5a8f09a424f638e04bef9a8c00e9d?user_id=75843953d1094d8782860df626182116" status: 200 len: 240 microversion: 2.36 time: 0.289406 Oct 17 13:34:13.371796 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 122/250] 10.222.0.79 () {62 vars in 1384 bytes} [Mon Oct 17 13:34:13 2022] PUT /compute/v2.1/os-quota-sets/f3b5a8f09a424f638e04bef9a8c00e9d?user_id=75843953d1094d8782860df626182116 => generated 240 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:34:13.385163 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d59cbcc0-ecc8-44fb-8002-b87a3459257f tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:13.436363 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d59cbcc0-ecc8-44fb-8002-b87a3459257f tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.061863 Oct 17 13:34:13.437011 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 123/251] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Oct 17 13:34:13 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 13:34:13.447041 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4fdde1e5-f1ff-4220-8559-957bbfe8c715 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854247-14"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:13.489264 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4fdde1e5-f1ff-4220-8559-957bbfe8c715 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:13.489482 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4fdde1e5-f1ff-4220-8559-957bbfe8c715 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:13.490648 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4fdde1e5-f1ff-4220-8559-957bbfe8c715 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:13.547414 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-4fdde1e5-f1ff-4220-8559-957bbfe8c715 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] HTTP exception thrown: Aggregate 7 already has host n-h2-854247-14. Oct 17 13:34:13.581854 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4fdde1e5-f1ff-4220-8559-957bbfe8c715 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Request method failure captured: Oct 17 13:34:13.581854 n-d-854247-14 devstack@n-api.service[127016]: request: POST /compute/v2.1/os-aggregates/7/action HTTP/1.1 Oct 17 13:34:13.581854 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:34:13.581854 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:34:13.581854 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:34:13.581854 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 40 Oct 17 13:34:13.581854 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:34:13.581854 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:34:13.581854 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:34:13.581854 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:34:13.581854 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVmpOcaxB2C_X-J-QaGcT1kGbE6_rPhSSyJXo7vQLgJBR2DTnRLCVqeQ3yYb8G9k4U2JuWx0jI3baLWlVWB1ZRa_tHm47Rjh5OUf_jvUzaZAroalGRWh5gJopjE82xJt1K6ThvbgKjqesKUuji0oJRUMY6RqY3PC9LCizgDNFY50x6o Oct 17 13:34:13.581854 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:34:13.581854 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:34:13.581854 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:34:13.581854 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:34:13.581854 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:34:13.581854 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:34:13.581854 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 4eca0f2aedd747539ab3d83379e7a80c Oct 17 13:34:13.581854 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-246963748 Oct 17 13:34:13.581854 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member,admin Oct 17 13:34:13.581854 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member,admin Oct 17 13:34:13.583315 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4eca0f2aedd747539ab3d83379e7a80c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4eca0f2aedd747539ab3d83379e7a80c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4eca0f2aedd747539ab3d83379e7a80c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4eca0f2aedd747539ab3d83379e7a80c", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:34:13.583315 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-246963748 Oct 17 13:34:13.583315 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 4eca0f2aedd747539ab3d83379e7a80c Oct 17 13:34:13.583315 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-246963748 Oct 17 13:34:13.583315 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin Oct 17 13:34:13.583315 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:34:13.583315 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:34:13.583315 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 0fe0ad5bb1fd42e9b68cb6aaf4213181 Oct 17 13:34:13.583315 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin Oct 17 13:34:13.583315 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:34:13.583315 n-d-854247-14 devstack@n-api.service[127016]: {"add_host": {"host": "n-h2-854247-14"}} Oct 17 13:34:13.583315 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:34:13.583315 n-d-854247-14 devstack@n-api.service[127016]: exception: Aggregate 7 already has host n-h2-854247-14. Oct 17 13:34:13.588538 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '7', 'body': {'add_host': {'host': 'n-h2-854247-14'}}} Oct 17 13:34:13.588538 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:34:13.588538 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:13.588538 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 17 13:34:13.588538 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 17 13:34:13.588538 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 17 13:34:13.588538 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 17 13:34:13.588538 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 17 13:34:13.588538 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 17 13:34:13.588538 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 17 13:34:13.588538 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 17 13:34:13.588538 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 17 13:34:13.588538 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 17 13:34:13.588538 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 17 13:34:13.588538 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result.read() Oct 17 13:34:13.588538 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 17 13:34:13.588538 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 17 13:34:13.588538 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 17 13:34:13.588538 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 17 13:34:13.589958 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 17 13:34:13.589958 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 17 13:34:13.589958 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 17 13:34:13.589958 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 17 13:34:13.589958 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-854247-14-7' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 17 13:34:13.589958 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:13.589958 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 17 13:34:13.589958 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:13.589958 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:13.589958 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 17 13:34:13.589958 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 17 13:34:13.589958 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 17 13:34:13.589958 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi session.flush() Oct 17 13:34:13.589958 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 17 13:34:13.589958 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 17 13:34:13.589958 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 17 13:34:13.589958 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 17 13:34:13.589958 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 17 13:34:13.589958 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 17 13:34:13.591183 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 17 13:34:13.591183 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception Oct 17 13:34:13.591183 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 17 13:34:13.591183 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 17 13:34:13.591183 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 17 13:34:13.591183 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 17 13:34:13.591183 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 17 13:34:13.591183 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 17 13:34:13.591183 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 17 13:34:13.591183 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 17 13:34:13.591183 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 17 13:34:13.591183 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 17 13:34:13.591183 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 17 13:34:13.591183 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 17 13:34:13.591183 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 17 13:34:13.591183 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 17 13:34:13.591183 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 17 13:34:13.591183 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 17 13:34:13.592396 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 17 13:34:13.592396 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 17 13:34:13.592396 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 17 13:34:13.592396 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 17 13:34:13.592396 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 17 13:34:13.592396 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception Oct 17 13:34:13.592396 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 17 13:34:13.592396 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 17 13:34:13.592396 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 17 13:34:13.592396 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 17 13:34:13.592396 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 17 13:34:13.592396 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 17 13:34:13.592396 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 17 13:34:13.592396 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 17 13:34:13.592396 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 17 13:34:13.592396 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 17 13:34:13.592396 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 17 13:34:13.592396 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result.read() Oct 17 13:34:13.593517 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 17 13:34:13.593517 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 17 13:34:13.593517 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 17 13:34:13.593517 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 17 13:34:13.593517 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 17 13:34:13.593517 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 17 13:34:13.593517 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 17 13:34:13.593517 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 17 13:34:13.593517 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-854247-14-7' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 17 13:34:13.593517 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 17 13:34:13.593517 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 17, 13, 34, 13, 538245), 'updated_at': None, 'host': 'n-h2-854247-14', 'aggregate_id': 7}] Oct 17 13:34:13.593517 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 17 13:34:13.593517 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:13.593517 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:13.593517 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:13.593517 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:13.593517 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 17 13:34:13.594664 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 17 13:34:13.594664 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 17 13:34:13.594664 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 17 13:34:13.594664 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:34:13.594664 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:34:13.594664 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:34:13.594664 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:34:13.594664 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 17 13:34:13.594664 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 17 13:34:13.594664 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Oct 17 13:34:13.594664 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 17 13:34:13.594664 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 17 13:34:13.594664 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 17 13:34:13.594664 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 17 13:34:13.594664 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 17 13:34:13.594664 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 17 13:34:13.594664 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 17 13:34:13.594664 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 7 already has host n-h2-854247-14. Oct 17 13:34:13.594664 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:13.594664 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:13.596089 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:13.596089 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:13.596089 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:13.596089 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:13.596089 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:34:13.596089 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:34:13.596089 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:34:13.596089 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:34:13.596089 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:34:13.596089 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:34:13.596089 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 17 13:34:13.596089 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 17 13:34:13.596089 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 7 already has host n-h2-854247-14. Oct 17 13:34:13.596089 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:13.596089 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:13.596089 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:13.596089 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:13.596089 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:13.596089 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:13.596089 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:34:13.596089 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:34:13.597335 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 already has host n-h2-854247-14. Oct 17 13:34:13.597335 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:13.597335 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4fdde1e5-f1ff-4220-8559-957bbfe8c715 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Returning 409 to user: Aggregate 7 already has host n-h2-854247-14. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:34:13.597335 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4fdde1e5-f1ff-4220-8559-957bbfe8c715 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/7/action" status: 409 len: 96 microversion: 2.1 time: 0.143486 Oct 17 13:34:13.597335 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 124/252] 10.222.0.79 () {60 vars in 1191 bytes} [Mon Oct 17 13:34:13 2022] POST /compute/v2.1/os-aggregates/7/action => generated 96 bytes in 146 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 17 13:34:13.600896 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-49f7d5dd-394f-4ed8-9fd1-e99ec25aa68f tempest-QuotasAdminTestV236-3161224 tempest-QuotasAdminTestV236-3161224-project-admin] Calling method '.version_select at 0x7f7cd5fc5160>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:13.610125 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-877beb70-0f6a-4c24-890f-627ab5d7bbf1 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ca1489f0084089a47d0cfc2ad37940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a297ddf04b4b18ae7591e107e84d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:13.622996 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-877beb70-0f6a-4c24-890f-627ab5d7bbf1 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] 10.222.0.79 "GET /compute/v2.1/servers/00b0dfe0-2c88-4037-830f-4144190da935" status: 200 len: 1319 microversion: 2.1 time: 0.365550 Oct 17 13:34:13.624324 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 129/253] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:13 2022] GET /compute/v2.1/servers/00b0dfe0-2c88-4037-830f-4144190da935 => generated 1319 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:13.631947 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-a9546918-3a24-4213-a784-50bd5c155bdd req-c9fbc65d-2f6c-429b-a3c0-521f35c877c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12e5e9fe-b998-450c-94b0-492a92bb6027", "tag": "413fff83-bb2f-4562-8868-2061337233c1"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:13.647823 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-a9546918-3a24-4213-a784-50bd5c155bdd req-c9fbc65d-2f6c-429b-a3c0-521f35c877c2 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:13.648610 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-a9546918-3a24-4213-a784-50bd5c155bdd req-c9fbc65d-2f6c-429b-a3c0-521f35c877c2 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:13.649191 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-a9546918-3a24-4213-a784-50bd5c155bdd req-c9fbc65d-2f6c-429b-a3c0-521f35c877c2 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:13.668060 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-a9546918-3a24-4213-a784-50bd5c155bdd req-c9fbc65d-2f6c-429b-a3c0-521f35c877c2 service nova] Creating event network-changed:413fff83-bb2f-4562-8868-2061337233c1 for instance 12e5e9fe-b998-450c-94b0-492a92bb6027 on n-h1-854247-14 Oct 17 13:34:13.673359 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-a9546918-3a24-4213-a784-50bd5c155bdd req-c9fbc65d-2f6c-429b-a3c0-521f35c877c2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047169 Oct 17 13:34:13.674375 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 130/254] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:13.680729 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4d28ed3d-d48b-4a3b-b2bb-85fead067831 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:13.699055 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-4d28ed3d-d48b-4a3b-b2bb-85fead067831 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] HTTP exception thrown: Aggregate 8 could not be found. Oct 17 13:34:13.704717 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4d28ed3d-d48b-4a3b-b2bb-85fead067831 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Request method failure captured: Oct 17 13:34:13.704717 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 Oct 17 13:34:13.704717 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:34:13.704717 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:34:13.704717 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:34:13.704717 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:34:13.704717 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:34:13.704717 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:34:13.704717 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:34:13.704717 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:34:13.704717 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVmoR_TGvbdvkcfrBp_zc08IA0Flbz5TRjFR3E_DOe_fx9GSw5iI6JQjrylGr9CxuoFiXNyGR3gTSJ5j1ZfL0Vq7HdWIdJP8HxQ79IaRr2y1TKcq5yCVLg57QCeQ4ynfLCXZxUcK3ri-E-H-j-aywVfLFLIhjSTrvNcEdWWgcLmba8o Oct 17 13:34:13.704717 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:34:13.704717 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:34:13.704717 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:34:13.704717 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:34:13.704717 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:34:13.704717 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:34:13.704717 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: b5d12cc1aeb146ec8e09b712911d6218 Oct 17 13:34:13.704717 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-AggregatesAdminTestJSON-712919916 Oct 17 13:34:13.704717 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member,admin Oct 17 13:34:13.704717 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member,admin Oct 17 13:34:13.706178 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b5d12cc1aeb146ec8e09b712911d6218"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b5d12cc1aeb146ec8e09b712911d6218"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b5d12cc1aeb146ec8e09b712911d6218"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b5d12cc1aeb146ec8e09b712911d6218", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:34:13.706178 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-AggregatesAdminTestJSON-712919916 Oct 17 13:34:13.706178 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: b5d12cc1aeb146ec8e09b712911d6218 Oct 17 13:34:13.706178 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-712919916 Oct 17 13:34:13.706178 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-AggregatesAdminTestJSON-712919916-project-admin Oct 17 13:34:13.706178 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:34:13.706178 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:34:13.706178 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 4853b66d091a483e9616df3d66cbda6d Oct 17 13:34:13.706178 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-AggregatesAdminTestJSON-712919916-project-admin Oct 17 13:34:13.706178 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:34:13.706178 n-d-854247-14 devstack@n-api.service[127017]: exception: Aggregate 8 could not be found. Oct 17 13:34:13.706178 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '8'} Oct 17 13:34:13.706178 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:34:13.707001 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:13.707001 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 17 13:34:13.707001 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 17 13:34:13.707001 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 17 13:34:13.707001 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 17 13:34:13.707001 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:34:13.707001 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:34:13.707001 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 17 13:34:13.707001 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 17 13:34:13.707001 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 13:34:13.707001 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 13:34:13.707001 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 17 13:34:13.707001 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 17 13:34:13.707001 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 8 could not be found. Oct 17 13:34:13.707001 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:13.707001 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:13.707001 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:13.707001 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:13.707001 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:13.708210 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:13.708210 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:34:13.708210 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:34:13.708210 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:34:13.708210 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:34:13.708210 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 17 13:34:13.708210 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:34:13.708210 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 8 could not be found. Oct 17 13:34:13.708210 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:13.708210 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:13.708210 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:13.708210 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:13.708210 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:13.708210 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:13.708210 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:34:13.708210 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:34:13.708210 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 8 could not be found. Oct 17 13:34:13.708210 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:13.714681 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4d28ed3d-d48b-4a3b-b2bb-85fead067831 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Returning 404 to user: Aggregate 8 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:34:13.715841 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4d28ed3d-d48b-4a3b-b2bb-85fead067831 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] 10.222.0.79 "GET /compute/v2.1/os-aggregates/8" status: 404 len: 77 microversion: 2.1 time: 0.039951 Oct 17 13:34:13.716563 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 131/255] 10.222.0.79 () {58 vars in 1149 bytes} [Mon Oct 17 13:34:13 2022] GET /compute/v2.1/os-aggregates/8 => generated 77 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:34:13.729651 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c266b0f7-c9f8-4828-8fbe-45313ae8432b tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854247-14"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:13.737010 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-49f7d5dd-394f-4ed8-9fd1-e99ec25aa68f tempest-QuotasAdminTestV236-3161224 tempest-QuotasAdminTestV236-3161224-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/f3b5a8f09a424f638e04bef9a8c00e9d?user_id=75843953d1094d8782860df626182116" status: 200 len: 282 microversion: 2.36 time: 0.142811 Oct 17 13:34:13.747299 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 125/256] 10.222.0.79 () {60 vars in 1364 bytes} [Mon Oct 17 13:34:13 2022] GET /compute/v2.1/os-quota-sets/f3b5a8f09a424f638e04bef9a8c00e9d?user_id=75843953d1094d8782860df626182116 => generated 282 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:34:13.758632 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-adf1d6a5-f31a-4ae1-bd1e-6d3907ea774c tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:13.769016 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c266b0f7-c9f8-4828-8fbe-45313ae8432b tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:13.769880 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c266b0f7-c9f8-4828-8fbe-45313ae8432b tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:13.772558 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c266b0f7-c9f8-4828-8fbe-45313ae8432b tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:13.783319 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:34:13.790469 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-adf1d6a5-f31a-4ae1-bd1e-6d3907ea774c tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] HTTP exception thrown: Aggregate 8 could not be found. Oct 17 13:34:13.792241 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-adf1d6a5-f31a-4ae1-bd1e-6d3907ea774c tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Request method failure captured: Oct 17 13:34:13.792241 n-d-854247-14 devstack@n-api.service[127016]: request: DELETE /compute/v2.1/os-aggregates/8 HTTP/1.1 Oct 17 13:34:13.792241 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:34:13.792241 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:34:13.792241 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:34:13.792241 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:34:13.792241 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:34:13.792241 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:34:13.792241 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:34:13.792241 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:34:13.792241 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVmoR_TGvbdvkcfrBp_zc08IA0Flbz5TRjFR3E_DOe_fx9GSw5iI6JQjrylGr9CxuoFiXNyGR3gTSJ5j1ZfL0Vq7HdWIdJP8HxQ79IaRr2y1TKcq5yCVLg57QCeQ4ynfLCXZxUcK3ri-E-H-j-aywVfLFLIhjSTrvNcEdWWgcLmba8o Oct 17 13:34:13.792241 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:34:13.792241 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:34:13.792241 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:34:13.792241 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:34:13.792241 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:34:13.792241 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:34:13.792241 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: b5d12cc1aeb146ec8e09b712911d6218 Oct 17 13:34:13.792241 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-AggregatesAdminTestJSON-712919916 Oct 17 13:34:13.792241 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member,admin Oct 17 13:34:13.792241 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member,admin Oct 17 13:34:13.793600 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b5d12cc1aeb146ec8e09b712911d6218"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b5d12cc1aeb146ec8e09b712911d6218"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b5d12cc1aeb146ec8e09b712911d6218"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b5d12cc1aeb146ec8e09b712911d6218", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:34:13.793600 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-AggregatesAdminTestJSON-712919916 Oct 17 13:34:13.793600 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: b5d12cc1aeb146ec8e09b712911d6218 Oct 17 13:34:13.793600 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-712919916 Oct 17 13:34:13.793600 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-AggregatesAdminTestJSON-712919916-project-admin Oct 17 13:34:13.793600 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:34:13.793600 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:34:13.793600 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 4853b66d091a483e9616df3d66cbda6d Oct 17 13:34:13.793600 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-AggregatesAdminTestJSON-712919916-project-admin Oct 17 13:34:13.793600 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:34:13.793600 n-d-854247-14 devstack@n-api.service[127016]: exception: Aggregate 8 could not be found. Oct 17 13:34:13.793600 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '8'} Oct 17 13:34:13.793600 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:34:13.794458 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:13.794458 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 17 13:34:13.794458 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 17 13:34:13.794458 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 17 13:34:13.794458 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 17 13:34:13.794458 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:34:13.794458 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:34:13.794458 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:34:13.794458 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:34:13.794458 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 17 13:34:13.794458 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 17 13:34:13.794458 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 17 13:34:13.794458 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 17 13:34:13.794458 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:34:13.794458 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:34:13.794458 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 17 13:34:13.794458 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 17 13:34:13.794458 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 13:34:13.794458 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 13:34:13.795721 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 17 13:34:13.795721 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 17 13:34:13.795721 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 8 could not be found. Oct 17 13:34:13.795721 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:13.795721 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:13.795721 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:13.795721 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:13.795721 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:13.795721 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:13.795721 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:34:13.795721 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:34:13.795721 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:34:13.795721 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:34:13.795721 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 17 13:34:13.795721 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:34:13.795721 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 8 could not be found. Oct 17 13:34:13.795721 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:13.795721 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:13.795721 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:13.795721 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:13.795721 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:13.798806 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:13.798806 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:34:13.798806 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:34:13.798806 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 8 could not be found. Oct 17 13:34:13.798806 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:13.798806 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-adf1d6a5-f31a-4ae1-bd1e-6d3907ea774c tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Returning 404 to user: Aggregate 8 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:34:13.798806 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-adf1d6a5-f31a-4ae1-bd1e-6d3907ea774c tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/8" status: 404 len: 77 microversion: 2.1 time: 0.045317 Oct 17 13:34:13.798806 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 126/257] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Oct 17 13:34:13 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 77 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:34:13.814426 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-eace33c4-958d-42fd-bc82-727f93f7af5a tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1653658432"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:13.824881 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.aggregate [None req-eace33c4-958d-42fd-bc82-727f93f7af5a tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Generated uuid 820724fd-79ee-4c05-8224-2aeb7af70585 for aggregate {{(pid=127016) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 13:34:13.863558 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-eace33c4-958d-42fd-bc82-727f93f7af5a tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.059566 Oct 17 13:34:13.864722 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 127/258] 10.222.0.79 () {60 vars in 1164 bytes} [Mon Oct 17 13:34:13 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:13.910759 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7a5a2f73-462c-4e63-8d8f-05538468d41b tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:13.914825 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=10 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:34:13.919873 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=7,nova_api:DELETE=7 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:34:13.937522 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7a5a2f73-462c-4e63-8d8f-05538468d41b tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] 10.222.0.79 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 227 microversion: 2.1 time: 0.064780 Oct 17 13:34:13.942050 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 128/259] 10.222.0.79 () {58 vars in 1149 bytes} [Mon Oct 17 13:34:13 2022] GET /compute/v2.1/os-aggregates/9 => generated 227 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:13.952775 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6e580527-695e-4c9a-a639-2afce82f8b75 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:13.955105 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6e580527-695e-4c9a-a639-2afce82f8b75 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] [instance: 12e5e9fe-b998-450c-94b0-492a92bb6027] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:13.975578 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6e580527-695e-4c9a-a639-2afce82f8b75 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:13.978052 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6e580527-695e-4c9a-a639-2afce82f8b75 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:13.978713 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6e580527-695e-4c9a-a639-2afce82f8b75 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:13.979608 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6e580527-695e-4c9a-a639-2afce82f8b75 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:13.980070 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6e580527-695e-4c9a-a639-2afce82f8b75 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:13.980487 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6e580527-695e-4c9a-a639-2afce82f8b75 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:14.039381 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c266b0f7-c9f8-4828-8fbe-45313ae8432b tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 227 microversion: 2.1 time: 0.319910 Oct 17 13:34:14.040490 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 132/260] 10.222.0.79 () {60 vars in 1191 bytes} [Mon Oct 17 13:34:13 2022] POST /compute/v2.1/os-aggregates/7/action => generated 227 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:14.051399 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-37964777-d50c-4b92-9c0f-0bec8eb9d6b8 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:14.133615 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-37964777-d50c-4b92-9c0f-0bec8eb9d6b8 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 265 microversion: 2.1 time: 0.091571 Oct 17 13:34:14.134819 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 133/261] 10.222.0.79 () {60 vars in 1191 bytes} [Mon Oct 17 13:34:14 2022] POST /compute/v2.1/os-aggregates/9/action => generated 265 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:14.140361 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-98fee294-7852-48b9-82f7-269c54ec2749 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:14.194480 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-98fee294-7852-48b9-82f7-269c54ec2749 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.058354 Oct 17 13:34:14.195465 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 134/262] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Oct 17 13:34:14 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 13:34:14.203973 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3a89959d-acbc-4351-b44f-2afae260b09c tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:14.236043 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3a89959d-acbc-4351-b44f-2afae260b09c tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] 10.222.0.79 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 241 microversion: 2.1 time: 0.029602 Oct 17 13:34:14.237096 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 135/263] 10.222.0.79 () {58 vars in 1149 bytes} [Mon Oct 17 13:34:14 2022] GET /compute/v2.1/os-aggregates/9 => generated 241 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:14.246638 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b4d1b892-2589-4f18-a571-1f2535f6c6c9 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2071563235"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:14.259560 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.aggregate [None req-b4d1b892-2589-4f18-a571-1f2535f6c6c9 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Generated uuid b4d36f1d-8b21-40dd-8d82-4b14d26f3c7a for aggregate {{(pid=127017) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 13:34:14.295937 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b4d1b892-2589-4f18-a571-1f2535f6c6c9 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.055979 Oct 17 13:34:14.299151 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 136/264] 10.222.0.79 () {60 vars in 1164 bytes} [Mon Oct 17 13:34:14 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:14.316175 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-25a2e11f-35af-4b15-8c6a-020bd7cc9604 tempest-HostsAdminTestJSON-2102957320 tempest-HostsAdminTestJSON-2102957320-project-admin] Calling method '.version_select at 0x7f7cd6054700>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:14.326318 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-25a2e11f-35af-4b15-8c6a-020bd7cc9604 tempest-HostsAdminTestJSON-2102957320 tempest-HostsAdminTestJSON-2102957320-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:14.326963 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-25a2e11f-35af-4b15-8c6a-020bd7cc9604 tempest-HostsAdminTestJSON-2102957320 tempest-HostsAdminTestJSON-2102957320-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:14.328140 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-25a2e11f-35af-4b15-8c6a-020bd7cc9604 tempest-HostsAdminTestJSON-2102957320 tempest-HostsAdminTestJSON-2102957320-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:14.328948 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-25a2e11f-35af-4b15-8c6a-020bd7cc9604 tempest-HostsAdminTestJSON-2102957320 tempest-HostsAdminTestJSON-2102957320-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:14.330303 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-25a2e11f-35af-4b15-8c6a-020bd7cc9604 tempest-HostsAdminTestJSON-2102957320 tempest-HostsAdminTestJSON-2102957320-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:14.330744 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-25a2e11f-35af-4b15-8c6a-020bd7cc9604 tempest-HostsAdminTestJSON-2102957320 tempest-HostsAdminTestJSON-2102957320-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:14.386363 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-25a2e11f-35af-4b15-8c6a-020bd7cc9604 tempest-HostsAdminTestJSON-2102957320 tempest-HostsAdminTestJSON-2102957320-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.085582 Oct 17 13:34:14.392416 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 137/265] 10.222.0.79 () {58 vars in 1128 bytes} [Mon Oct 17 13:34:14 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:14.404470 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d247a434-5ceb-4c3b-b3ae-ea8206d30efe tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:14.439731 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6e580527-695e-4c9a-a639-2afce82f8b75 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e836340278b49f593350249132b9cfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550b2bda88024756abc4134365842d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:14.455039 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d247a434-5ceb-4c3b-b3ae-ea8206d30efe tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.061315 Oct 17 13:34:14.462615 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 138/266] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Oct 17 13:34:14 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 13:34:14.469215 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6e580527-695e-4c9a-a639-2afce82f8b75 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] 10.222.0.79 "GET /compute/v2.1/servers/12e5e9fe-b998-450c-94b0-492a92bb6027" status: 200 len: 1389 microversion: 2.1 time: 0.526009 Oct 17 13:34:14.470166 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 129/267] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:13 2022] GET /compute/v2.1/servers/12e5e9fe-b998-450c-94b0-492a92bb6027 => generated 1389 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:14.475438 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-792152ed-a870-4149-8e85-11c4b65eb9d1 tempest-HostsAdminTestJSON-2102957320 tempest-HostsAdminTestJSON-2102957320-project-admin] Calling method '.version_select at 0x7f7cd5fc5280>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:14.496887 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-792152ed-a870-4149-8e85-11c4b65eb9d1 tempest-HostsAdminTestJSON-2102957320 tempest-HostsAdminTestJSON-2102957320-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:14.497220 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-792152ed-a870-4149-8e85-11c4b65eb9d1 tempest-HostsAdminTestJSON-2102957320 tempest-HostsAdminTestJSON-2102957320-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:14.497978 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-792152ed-a870-4149-8e85-11c4b65eb9d1 tempest-HostsAdminTestJSON-2102957320 tempest-HostsAdminTestJSON-2102957320-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:14.498357 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-792152ed-a870-4149-8e85-11c4b65eb9d1 tempest-HostsAdminTestJSON-2102957320 tempest-HostsAdminTestJSON-2102957320-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:14.506533 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-792152ed-a870-4149-8e85-11c4b65eb9d1 tempest-HostsAdminTestJSON-2102957320 tempest-HostsAdminTestJSON-2102957320-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:14.507064 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-792152ed-a870-4149-8e85-11c4b65eb9d1 tempest-HostsAdminTestJSON-2102957320 tempest-HostsAdminTestJSON-2102957320-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:14.562833 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-792152ed-a870-4149-8e85-11c4b65eb9d1 tempest-HostsAdminTestJSON-2102957320 tempest-HostsAdminTestJSON-2102957320-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.091432 Oct 17 13:34:14.564378 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 130/268] 10.222.0.79 () {58 vars in 1155 bytes} [Mon Oct 17 13:34:14 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:14.568421 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-683f2427-9896-4cf3-835e-6468f81a16d5 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-928330892", "availability_zone": "tempest-test_az-661978631"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:14.572085 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.aggregate [None req-683f2427-9896-4cf3-835e-6468f81a16d5 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Generated uuid 6627264e-44ce-4232-9f40-98c3be49b8a5 for aggregate {{(pid=127016) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 13:34:14.611497 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-683f2427-9896-4cf3-835e-6468f81a16d5 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.046571 Oct 17 13:34:14.612381 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 131/269] 10.222.0.79 () {60 vars in 1165 bytes} [Mon Oct 17 13:34:14 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:14.784279 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3dd84d0a-b6dc-4698-af49-364eec28f773 tempest-AggregatesAdminNegativeTestJSON-1071893825 tempest-AggregatesAdminNegativeTestJSON-1071893825-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854247-14"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:14.788272 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3dd84d0a-b6dc-4698-af49-364eec28f773 tempest-AggregatesAdminNegativeTestJSON-1071893825 tempest-AggregatesAdminNegativeTestJSON-1071893825-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'f0986bf719ce434f9af4893118a6a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3caf1effcfc4208ad69dab794c96820', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:14.790722 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3dd84d0a-b6dc-4698-af49-364eec28f773 tempest-AggregatesAdminNegativeTestJSON-1071893825 tempest-AggregatesAdminNegativeTestJSON-1071893825-project] Request method failure captured: Oct 17 13:34:14.790722 n-d-854247-14 devstack@n-api.service[127017]: request: POST /compute/v2.1/os-aggregates/10/action HTTP/1.1 Oct 17 13:34:14.790722 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:34:14.790722 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:34:14.790722 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:34:14.790722 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 40 Oct 17 13:34:14.790722 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:34:14.790722 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:34:14.790722 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:34:14.790722 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:34:14.790722 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVmn22KSCBWon5A064uLU0MT4o1xPp1uuz1NLyXlapDx5DHh0SYU0bs-aE5aUHJIG1IxKS97eNOkVwAZwQAharo9KVi0f5oT4FMsZ1kIB5EzQK_I23hcdqAT6CWSScod6bDm9jVbDZLwow2w03a8FsVG1H6JyqlBB90XZJj5vSEQDBM Oct 17 13:34:14.790722 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:34:14.790722 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:34:14.790722 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:34:14.790722 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:34:14.790722 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:34:14.790722 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:34:14.790722 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: b3caf1effcfc4208ad69dab794c96820 Oct 17 13:34:14.790722 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1071893825 Oct 17 13:34:14.790722 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:34:14.790722 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:34:14.792301 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b3caf1effcfc4208ad69dab794c96820"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b3caf1effcfc4208ad69dab794c96820"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b3caf1effcfc4208ad69dab794c96820"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b3caf1effcfc4208ad69dab794c96820", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:34:14.792301 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1071893825 Oct 17 13:34:14.792301 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: b3caf1effcfc4208ad69dab794c96820 Oct 17 13:34:14.792301 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1071893825 Oct 17 13:34:14.792301 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-AggregatesAdminNegativeTestJSON-1071893825-project Oct 17 13:34:14.792301 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:34:14.792301 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:34:14.792301 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: f0986bf719ce434f9af4893118a6a504 Oct 17 13:34:14.792301 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1071893825-project Oct 17 13:34:14.792301 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 13:34:14.792301 n-d-854247-14 devstack@n-api.service[127017]: {"add_host": {"host": "n-h2-854247-14"}} Oct 17 13:34:14.792301 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:34:14.792301 n-d-854247-14 devstack@n-api.service[127017]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 17 13:34:14.793163 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '10', 'body': {'add_host': {'host': 'n-h2-854247-14'}}} Oct 17 13:34:14.793163 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:34:14.793163 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:14.793163 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:14.793163 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:14.793163 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:34:14.793163 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:34:14.793163 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:34:14.793163 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:34:14.793163 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:34:14.793163 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:34:14.793163 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 17 13:34:14.793163 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 17 13:34:14.793163 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:34:14.793163 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:34:14.793163 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:34:14.793163 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:34:14.793163 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:34:14.793163 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:34:14.794397 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:34:14.794397 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:34:14.794397 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:34:14.794397 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:34:14.794397 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:34:14.794397 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:34:14.794397 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:34:14.794397 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:34:14.794397 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 17 13:34:14.794397 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:14.794397 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:14.794397 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:14.794397 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:14.794397 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:14.794397 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:14.794397 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:34:14.794397 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:34:14.794397 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 17 13:34:14.794397 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:14.796432 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3dd84d0a-b6dc-4698-af49-364eec28f773 tempest-AggregatesAdminNegativeTestJSON-1071893825 tempest-AggregatesAdminNegativeTestJSON-1071893825-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:34:14.797430 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3dd84d0a-b6dc-4698-af49-364eec28f773 tempest-AggregatesAdminNegativeTestJSON-1071893825 tempest-AggregatesAdminNegativeTestJSON-1071893825-project] 10.222.0.79 "POST /compute/v2.1/os-aggregates/10/action" status: 403 len: 118 microversion: 2.1 time: 0.336084 Oct 17 13:34:14.799606 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 139/270] 10.222.0.79 () {60 vars in 1194 bytes} [Mon Oct 17 13:34:14 2022] POST /compute/v2.1/os-aggregates/10/action => generated 118 bytes in 338 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:34:14.806008 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-817ea6e3-16e0-4774-b47f-8cb389d7930d tempest-HostsAdminTestJSON-2102957320 tempest-HostsAdminTestJSON-2102957320-project-admin] Calling method '.version_select at 0x7f7cd75b49d0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:14.811282 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-817ea6e3-16e0-4774-b47f-8cb389d7930d tempest-HostsAdminTestJSON-2102957320 tempest-HostsAdminTestJSON-2102957320-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:14.812082 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-817ea6e3-16e0-4774-b47f-8cb389d7930d tempest-HostsAdminTestJSON-2102957320 tempest-HostsAdminTestJSON-2102957320-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:14.812659 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-817ea6e3-16e0-4774-b47f-8cb389d7930d tempest-HostsAdminTestJSON-2102957320 tempest-HostsAdminTestJSON-2102957320-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:14.814060 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-817ea6e3-16e0-4774-b47f-8cb389d7930d tempest-HostsAdminTestJSON-2102957320 tempest-HostsAdminTestJSON-2102957320-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:14.814654 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-817ea6e3-16e0-4774-b47f-8cb389d7930d tempest-HostsAdminTestJSON-2102957320 tempest-HostsAdminTestJSON-2102957320-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:14.815339 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-817ea6e3-16e0-4774-b47f-8cb389d7930d tempest-HostsAdminTestJSON-2102957320 tempest-HostsAdminTestJSON-2102957320-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:14.851379 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-817ea6e3-16e0-4774-b47f-8cb389d7930d tempest-HostsAdminTestJSON-2102957320 tempest-HostsAdminTestJSON-2102957320-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.050264 Oct 17 13:34:14.860515 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 140/271] 10.222.0.79 () {58 vars in 1128 bytes} [Mon Oct 17 13:34:14 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:14.871747 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7e8e028e-cd70-461a-9b29-666d7fa88674 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-928330892_new", "availability_zone": "tempest-test_az-661978631_new"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:14.962218 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-055f198a-cd8a-4be8-8af0-7da93e49dd87 tempest-QuotaClassesAdmin257Test-1682250940 tempest-QuotaClassesAdmin257Test-1682250940-project-admin] Calling method '.version_select at 0x7f7cd5fc93a0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:14.989609 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-055f198a-cd8a-4be8-8af0-7da93e49dd87 tempest-QuotaClassesAdmin257Test-1682250940 tempest-QuotaClassesAdmin257Test-1682250940-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.369053 Oct 17 13:34:14.990338 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 132/272] 10.222.0.79 () {60 vars in 1226 bytes} [Mon Oct 17 13:34:14 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:34:15.002011 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3cbb91f5-70eb-4684-bb7b-a4067fb32757 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:15.002912 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3cbb91f5-70eb-4684-bb7b-a4067fb32757 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] [instance: 00b0dfe0-2c88-4037-830f-4144190da935] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:15.010875 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3cbb91f5-70eb-4684-bb7b-a4067fb32757 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:15.011628 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3cbb91f5-70eb-4684-bb7b-a4067fb32757 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:15.012198 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3cbb91f5-70eb-4684-bb7b-a4067fb32757 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:15.013807 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3cbb91f5-70eb-4684-bb7b-a4067fb32757 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:15.014425 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3cbb91f5-70eb-4684-bb7b-a4067fb32757 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:15.015301 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3cbb91f5-70eb-4684-bb7b-a4067fb32757 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:15.050080 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7e8e028e-cd70-461a-9b29-666d7fa88674 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:15.050565 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7e8e028e-cd70-461a-9b29-666d7fa88674 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:15.050915 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7e8e028e-cd70-461a-9b29-666d7fa88674 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:15.159016 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7e8e028e-cd70-461a-9b29-666d7fa88674 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-aggregates/11" status: 200 len: 334 microversion: 2.1 time: 0.290922 Oct 17 13:34:15.159865 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 141/273] 10.222.0.79 () {60 vars in 1173 bytes} [Mon Oct 17 13:34:14 2022] PUT /compute/v2.1/os-aggregates/11 => generated 334 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:15.172591 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4895ec27-70ab-48db-a284-c07670b65328 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:15.207088 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=7,nova_api:DELETE=9,nova_api:UPDATE=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:34:15.241625 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4895ec27-70ab-48db-a284-c07670b65328 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.074545 Oct 17 13:34:15.242948 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3cbb91f5-70eb-4684-bb7b-a4067fb32757 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ca1489f0084089a47d0cfc2ad37940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a297ddf04b4b18ae7591e107e84d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:15.243072 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 142/274] 10.222.0.79 () {58 vars in 1155 bytes} [Mon Oct 17 13:34:15 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 13:34:15.252061 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5601feb7-d8e3-48e4-8ce8-df01662ab448 tempest-HostsAdminTestJSON-2102957320 tempest-HostsAdminTestJSON-2102957320-project-admin] Calling method '.version_select at 0x7f7cd66b7280>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:15.256213 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3cbb91f5-70eb-4684-bb7b-a4067fb32757 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] 10.222.0.79 "GET /compute/v2.1/servers/00b0dfe0-2c88-4037-830f-4144190da935" status: 200 len: 1319 microversion: 2.1 time: 0.264572 Oct 17 13:34:15.263264 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 133/275] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:14 2022] GET /compute/v2.1/servers/00b0dfe0-2c88-4037-830f-4144190da935 => generated 1319 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:15.270301 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0cd55dea-f8e9-4c04-9cf3-2be3dcea94fa tempest-QuotaClassesAdmin257Test-1682250940 tempest-QuotaClassesAdmin257Test-1682250940-project-admin] Action: 'update', calling method: .version_select at 0x7f7cd5fc9d30>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:15.290838 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5601feb7-d8e3-48e4-8ce8-df01662ab448 tempest-HostsAdminTestJSON-2102957320 tempest-HostsAdminTestJSON-2102957320-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:15.291684 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5601feb7-d8e3-48e4-8ce8-df01662ab448 tempest-HostsAdminTestJSON-2102957320 tempest-HostsAdminTestJSON-2102957320-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:15.295060 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5601feb7-d8e3-48e4-8ce8-df01662ab448 tempest-HostsAdminTestJSON-2102957320 tempest-HostsAdminTestJSON-2102957320-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:15.351125 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5601feb7-d8e3-48e4-8ce8-df01662ab448 tempest-HostsAdminTestJSON-2102957320 tempest-HostsAdminTestJSON-2102957320-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:15.352705 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5601feb7-d8e3-48e4-8ce8-df01662ab448 tempest-HostsAdminTestJSON-2102957320 tempest-HostsAdminTestJSON-2102957320-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:15.353150 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5601feb7-d8e3-48e4-8ce8-df01662ab448 tempest-HostsAdminTestJSON-2102957320 tempest-HostsAdminTestJSON-2102957320-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:15.400961 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5601feb7-d8e3-48e4-8ce8-df01662ab448 tempest-HostsAdminTestJSON-2102957320 tempest-HostsAdminTestJSON-2102957320-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hosts/n-h2-854247-14" status: 200 len: 335 microversion: 2.1 time: 0.153294 Oct 17 13:34:15.406238 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 143/276] 10.222.0.79 () {58 vars in 1173 bytes} [Mon Oct 17 13:34:15 2022] GET /compute/v2.1/os-hosts/n-h2-854247-14 => generated 335 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:15.410202 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-377cf783-c1dc-43c9-9b4f-28d338d29ca4 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:15.423114 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-377cf783-c1dc-43c9-9b4f-28d338d29ca4 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] 10.222.0.79 "GET /compute/v2.1/os-aggregates" status: 200 len: 337 microversion: 2.1 time: 0.020071 Oct 17 13:34:15.424148 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 144/277] 10.222.0.79 () {58 vars in 1143 bytes} [Mon Oct 17 13:34:15 2022] GET /compute/v2.1/os-aggregates => generated 337 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:15.443988 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c21dd89e-5ad4-4d50-baaf-f2fee0e9cc47 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1681559006"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:15.455571 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.aggregate [None req-c21dd89e-5ad4-4d50-baaf-f2fee0e9cc47 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Generated uuid 7711a808-02cc-4ac2-9acf-ac396bf41e0d for aggregate {{(pid=127017) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 13:34:15.505480 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c21dd89e-5ad4-4d50-baaf-f2fee0e9cc47 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.078358 Oct 17 13:34:15.506111 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 145/278] 10.222.0.79 () {60 vars in 1164 bytes} [Mon Oct 17 13:34:15 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:15.511945 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8229a956-004f-4798-88ea-e06b1c83f8b8 tempest-HostsAdminTestJSON-2102957320 tempest-HostsAdminTestJSON-2102957320-project-admin] Calling method '.version_select at 0x7f7cd6054af0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:15.522166 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8229a956-004f-4798-88ea-e06b1c83f8b8 tempest-HostsAdminTestJSON-2102957320 tempest-HostsAdminTestJSON-2102957320-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:15.523112 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8229a956-004f-4798-88ea-e06b1c83f8b8 tempest-HostsAdminTestJSON-2102957320 tempest-HostsAdminTestJSON-2102957320-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:15.523741 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8229a956-004f-4798-88ea-e06b1c83f8b8 tempest-HostsAdminTestJSON-2102957320 tempest-HostsAdminTestJSON-2102957320-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:15.543862 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8229a956-004f-4798-88ea-e06b1c83f8b8 tempest-HostsAdminTestJSON-2102957320 tempest-HostsAdminTestJSON-2102957320-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:15.544351 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8229a956-004f-4798-88ea-e06b1c83f8b8 tempest-HostsAdminTestJSON-2102957320 tempest-HostsAdminTestJSON-2102957320-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:15.544779 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8229a956-004f-4798-88ea-e06b1c83f8b8 tempest-HostsAdminTestJSON-2102957320 tempest-HostsAdminTestJSON-2102957320-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:15.572189 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8229a956-004f-4798-88ea-e06b1c83f8b8 tempest-HostsAdminTestJSON-2102957320 tempest-HostsAdminTestJSON-2102957320-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hosts/n-h1-854247-14" status: 200 len: 603 microversion: 2.1 time: 0.064206 Oct 17 13:34:15.573173 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 146/279] 10.222.0.79 () {58 vars in 1173 bytes} [Mon Oct 17 13:34:15 2022] GET /compute/v2.1/os-hosts/n-h1-854247-14 => generated 603 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:15.585554 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0b861539-8fd3-42d6-865f-313185e6f2e7 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:15.622148 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0b861539-8fd3-42d6-865f-313185e6f2e7 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.041593 Oct 17 13:34:15.628927 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 147/280] 10.222.0.79 () {58 vars in 1155 bytes} [Mon Oct 17 13:34:15 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 13:34:15.638508 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f4058cbe-98d3-46cb-9128-163467002fe9 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:15.639283 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f4058cbe-98d3-46cb-9128-163467002fe9 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] [instance: 12e5e9fe-b998-450c-94b0-492a92bb6027] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:15.674109 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f4058cbe-98d3-46cb-9128-163467002fe9 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:15.678121 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f4058cbe-98d3-46cb-9128-163467002fe9 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:15.679366 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f4058cbe-98d3-46cb-9128-163467002fe9 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:15.680223 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f4058cbe-98d3-46cb-9128-163467002fe9 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:15.680680 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f4058cbe-98d3-46cb-9128-163467002fe9 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:15.681107 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f4058cbe-98d3-46cb-9128-163467002fe9 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:15.696644 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0cd55dea-f8e9-4c04-9cf3-2be3dcea94fa tempest-QuotaClassesAdmin257Test-1682250940 tempest-QuotaClassesAdmin257Test-1682250940-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.428643 Oct 17 13:34:15.699334 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 134/281] 10.222.0.79 () {62 vars in 1247 bytes} [Mon Oct 17 13:34:15 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:34:15.715675 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1feeeb1c-836c-448c-8a8c-1d7dbf75be3c tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-18152929"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:15.745303 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1feeeb1c-836c-448c-8a8c-1d7dbf75be3c tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:15.746673 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1feeeb1c-836c-448c-8a8c-1d7dbf75be3c tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:15.748950 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1feeeb1c-836c-448c-8a8c-1d7dbf75be3c tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:15.761049 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1feeeb1c-836c-448c-8a8c-1d7dbf75be3c tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:15.761982 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1feeeb1c-836c-448c-8a8c-1d7dbf75be3c tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:15.766478 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1feeeb1c-836c-448c-8a8c-1d7dbf75be3c tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:15.778488 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-1feeeb1c-836c-448c-8a8c-1d7dbf75be3c tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-18152929 could not be found. Oct 17 13:34:15.781126 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1feeeb1c-836c-448c-8a8c-1d7dbf75be3c tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Request method failure captured: Oct 17 13:34:15.781126 n-d-854247-14 devstack@n-api.service[127016]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Oct 17 13:34:15.781126 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:34:15.781126 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:34:15.781126 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:34:15.781126 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 56 Oct 17 13:34:15.781126 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:34:15.781126 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:34:15.781126 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:34:15.781126 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:34:15.781126 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVmpOcaxB2C_X-J-QaGcT1kGbE6_rPhSSyJXo7vQLgJBR2DTnRLCVqeQ3yYb8G9k4U2JuWx0jI3baLWlVWB1ZRa_tHm47Rjh5OUf_jvUzaZAroalGRWh5gJopjE82xJt1K6ThvbgKjqesKUuji0oJRUMY6RqY3PC9LCizgDNFY50x6o Oct 17 13:34:15.781126 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:34:15.781126 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:34:15.781126 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:34:15.781126 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:34:15.781126 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:34:15.781126 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:34:15.781126 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 4eca0f2aedd747539ab3d83379e7a80c Oct 17 13:34:15.781126 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-246963748 Oct 17 13:34:15.781126 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member,admin Oct 17 13:34:15.781126 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member,admin Oct 17 13:34:15.782337 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4eca0f2aedd747539ab3d83379e7a80c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4eca0f2aedd747539ab3d83379e7a80c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4eca0f2aedd747539ab3d83379e7a80c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4eca0f2aedd747539ab3d83379e7a80c", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:34:15.782337 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-246963748 Oct 17 13:34:15.782337 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 4eca0f2aedd747539ab3d83379e7a80c Oct 17 13:34:15.782337 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-246963748 Oct 17 13:34:15.782337 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin Oct 17 13:34:15.782337 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:34:15.782337 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:34:15.782337 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 0fe0ad5bb1fd42e9b68cb6aaf4213181 Oct 17 13:34:15.782337 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin Oct 17 13:34:15.782337 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:34:15.782337 n-d-854247-14 devstack@n-api.service[127016]: {"add_host": {"host": "tempest-nonexist_host-18152929"}} Oct 17 13:34:15.782337 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:34:15.782337 n-d-854247-14 devstack@n-api.service[127016]: exception: Compute host tempest-nonexist_host-18152929 could not be found. Oct 17 13:34:15.783082 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '12', 'body': {'add_host': {'host': 'tempest-nonexist_host-18152929'}}} Oct 17 13:34:15.783082 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:34:15.783082 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:15.783082 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 17 13:34:15.783082 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 17 13:34:15.783082 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:34:15.783082 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:34:15.783082 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 17 13:34:15.783082 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 17 13:34:15.783082 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 13:34:15.783082 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 13:34:15.783082 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 17 13:34:15.783082 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 17 13:34:15.783082 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-18152929' is not mapped to any cell Oct 17 13:34:15.783082 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:15.783082 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:15.783082 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:15.783082 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:15.783082 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 17 13:34:15.784354 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 17 13:34:15.784354 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 17 13:34:15.784354 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 17 13:34:15.784354 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 17 13:34:15.784354 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:15.784354 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:15.784354 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:15.784354 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:15.784354 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 17 13:34:15.784354 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 17 13:34:15.784354 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 17 13:34:15.784354 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 17 13:34:15.784354 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:34:15.784354 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:34:15.784354 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:34:15.784354 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:34:15.784354 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 17 13:34:15.784354 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 17 13:34:15.784354 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Oct 17 13:34:15.784354 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 17 13:34:15.785520 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 17 13:34:15.785520 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 17 13:34:15.785520 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-18152929 could not be found. Oct 17 13:34:15.785520 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:15.785520 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:15.785520 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:15.785520 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:15.785520 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:15.785520 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:15.785520 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:34:15.785520 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:34:15.785520 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:34:15.785520 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:34:15.785520 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:34:15.785520 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:34:15.785520 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 17 13:34:15.785520 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:34:15.785520 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-18152929 could not be found. Oct 17 13:34:15.785520 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:15.785520 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:15.785520 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:15.786809 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:15.786809 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:15.786809 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:15.786809 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:34:15.786809 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:34:15.786809 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-18152929 could not be found. Oct 17 13:34:15.786809 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:15.797542 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1feeeb1c-836c-448c-8a8c-1d7dbf75be3c tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-18152929 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:34:15.805959 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1feeeb1c-836c-448c-8a8c-1d7dbf75be3c tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/12/action" status: 404 len: 109 microversion: 2.1 time: 0.105103 Oct 17 13:34:15.811193 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 135/282] 10.222.0.79 () {60 vars in 1194 bytes} [Mon Oct 17 13:34:15 2022] POST /compute/v2.1/os-aggregates/12/action => generated 109 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:34:15.832673 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f18b6765-a66a-4e7e-a707-19f29137bf7b tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1888614066"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:15.843055 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.aggregate [None req-f18b6765-a66a-4e7e-a707-19f29137bf7b tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Generated uuid 014df329-850e-4fd2-832e-b47f3be27942 for aggregate {{(pid=127016) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 13:34:15.856154 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=30 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:34:15.893446 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f18b6765-a66a-4e7e-a707-19f29137bf7b tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.080810 Oct 17 13:34:15.894631 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 136/283] 10.222.0.79 () {60 vars in 1164 bytes} [Mon Oct 17 13:34:15 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:15.905570 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-df3518ef-122c-42da-9302-75b86b4e17f6 tempest-QuotaClassesAdmin257Test-1682250940 tempest-QuotaClassesAdmin257Test-1682250940-project-admin] Calling method '.version_select at 0x7f7cd5fc5af0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:15.929414 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-df3518ef-122c-42da-9302-75b86b4e17f6 tempest-QuotaClassesAdmin257Test-1682250940 tempest-QuotaClassesAdmin257Test-1682250940-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.033512 Oct 17 13:34:15.933930 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 137/284] 10.222.0.79 () {60 vars in 1226 bytes} [Mon Oct 17 13:34:15 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:34:15.950038 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5bcb99e1-1881-40a4-88b7-a3e1fb5eb5b0 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:15.992907 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5bcb99e1-1881-40a4-88b7-a3e1fb5eb5b0 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.057612 Oct 17 13:34:15.997748 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 138/285] 10.222.0.79 () {58 vars in 1155 bytes} [Mon Oct 17 13:34:15 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 13:34:16.006570 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-bd25556e-1010-4e39-9ed4-d17258cc3378 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:16.030243 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-bd25556e-1010-4e39-9ed4-d17258cc3378 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] 10.222.0.79 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.034649 Oct 17 13:34:16.040234 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 139/286] 10.222.0.79 () {58 vars in 1143 bytes} [Mon Oct 17 13:34:15 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:16.367364 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-96979cf7-2a83-45ef-a692-30a7beaea3ba req-bdbcd2d6-cfe1-414c-8a6a-2b784ece019e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00b0dfe0-2c88-4037-830f-4144190da935", "tag": "29478579-1d21-4c52-a447-0234ccc5dbd4"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:16.377743 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f4058cbe-98d3-46cb-9128-163467002fe9 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e836340278b49f593350249132b9cfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550b2bda88024756abc4134365842d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:16.387794 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f4058cbe-98d3-46cb-9128-163467002fe9 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] 10.222.0.79 "GET /compute/v2.1/servers/12e5e9fe-b998-450c-94b0-492a92bb6027" status: 200 len: 1389 microversion: 2.1 time: 0.754606 Oct 17 13:34:16.390128 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-96979cf7-2a83-45ef-a692-30a7beaea3ba req-bdbcd2d6-cfe1-414c-8a6a-2b784ece019e service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:16.394210 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-96979cf7-2a83-45ef-a692-30a7beaea3ba req-bdbcd2d6-cfe1-414c-8a6a-2b784ece019e service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:16.394722 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 148/287] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:15 2022] GET /compute/v2.1/servers/12e5e9fe-b998-450c-94b0-492a92bb6027 => generated 1389 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:16.394837 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-96979cf7-2a83-45ef-a692-30a7beaea3ba req-bdbcd2d6-cfe1-414c-8a6a-2b784ece019e service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:16.399812 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6d36ed8b-4506-4255-8c8e-dcf6565f7f0a tempest-QuotaClassesAdmin257Test-1682250940 tempest-QuotaClassesAdmin257Test-1682250940-project-admin] Action: 'update', calling method: .version_select at 0x7f7cd7363c10>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:16.424505 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-96979cf7-2a83-45ef-a692-30a7beaea3ba req-bdbcd2d6-cfe1-414c-8a6a-2b784ece019e service nova] Creating event network-changed:29478579-1d21-4c52-a447-0234ccc5dbd4 for instance 00b0dfe0-2c88-4037-830f-4144190da935 on n-h1-854247-14 Oct 17 13:34:16.431858 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-96979cf7-2a83-45ef-a692-30a7beaea3ba req-bdbcd2d6-cfe1-414c-8a6a-2b784ece019e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.396254 Oct 17 13:34:16.432714 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 140/288] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:16.439718 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-400eeada-0098-4855-b0a8-ff0bd144370f tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:16.444412 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-400eeada-0098-4855-b0a8-ff0bd144370f tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Request method failure captured: Oct 17 13:34:16.444412 n-d-854247-14 devstack@n-api.service[127016]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 17 13:34:16.444412 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:34:16.444412 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:34:16.444412 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:34:16.444412 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 283 Oct 17 13:34:16.444412 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:34:16.444412 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:34:16.444412 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:34:16.444412 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:34:16.444412 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVmpOcaxB2C_X-J-QaGcT1kGbE6_rPhSSyJXo7vQLgJBR2DTnRLCVqeQ3yYb8G9k4U2JuWx0jI3baLWlVWB1ZRa_tHm47Rjh5OUf_jvUzaZAroalGRWh5gJopjE82xJt1K6ThvbgKjqesKUuji0oJRUMY6RqY3PC9LCizgDNFY50x6o Oct 17 13:34:16.444412 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:34:16.444412 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:34:16.444412 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:34:16.444412 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:34:16.444412 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:34:16.444412 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:34:16.444412 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 4eca0f2aedd747539ab3d83379e7a80c Oct 17 13:34:16.444412 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-246963748 Oct 17 13:34:16.444412 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member,admin Oct 17 13:34:16.444412 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member,admin Oct 17 13:34:16.445840 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4eca0f2aedd747539ab3d83379e7a80c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4eca0f2aedd747539ab3d83379e7a80c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4eca0f2aedd747539ab3d83379e7a80c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4eca0f2aedd747539ab3d83379e7a80c", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:34:16.445840 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-246963748 Oct 17 13:34:16.445840 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 4eca0f2aedd747539ab3d83379e7a80c Oct 17 13:34:16.445840 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-246963748 Oct 17 13:34:16.445840 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin Oct 17 13:34:16.445840 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:34:16.445840 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:34:16.445840 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 0fe0ad5bb1fd42e9b68cb6aaf4213181 Oct 17 13:34:16.445840 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin Oct 17 13:34:16.445840 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:34:16.446369 n-d-854247-14 devstack@n-api.service[127016]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 17 13:34:16.446369 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:34:16.446369 n-d-854247-14 devstack@n-api.service[127016]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 17 13:34:16.446369 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 17 13:34:16.446369 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:34:16.446369 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:16.446369 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:34:16.446369 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:34:16.446369 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:34:16.446369 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:34:16.446949 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 17 13:34:16.446949 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:16.446949 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 17 13:34:16.446949 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 17 13:34:16.446949 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:16.446949 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 17 13:34:16.446949 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 17 13:34:16.446949 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:16.446949 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:16.446949 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:16.446949 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:16.446949 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:16.446949 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:16.446949 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:34:16.446949 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:34:16.446949 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:34:16.446949 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:34:16.448002 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:34:16.448002 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:34:16.448002 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:34:16.448002 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:34:16.448002 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:34:16.448002 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:34:16.448002 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:34:16.448002 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:34:16.448002 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 17 13:34:16.448002 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:16.448002 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:16.448002 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:16.448002 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:16.448002 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:16.448002 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:16.448865 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:34:16.448865 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:34:16.448865 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 17 13:34:16.448865 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:16.448865 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-400eeada-0098-4855-b0a8-ff0bd144370f tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:34:16.449196 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-400eeada-0098-4855-b0a8-ff0bd144370f tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.010635 Oct 17 13:34:16.459248 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 141/289] 10.222.0.79 () {60 vars in 1165 bytes} [Mon Oct 17 13:34:16 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:34:16.464614 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-06916e17-53f7-4b03-beeb-80a36d4537e1 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:16.517433 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-06916e17-53f7-4b03-beeb-80a36d4537e1 tempest-AggregatesAdminTestJSON-712919916 tempest-AggregatesAdminTestJSON-712919916-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.055670 Oct 17 13:34:16.519033 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 142/290] 10.222.0.79 () {58 vars in 1155 bytes} [Mon Oct 17 13:34:16 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 13:34:16.533522 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-98619ec6-ea09-4a3d-b394-ad7a34c22d5e tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:16.535925 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-98619ec6-ea09-4a3d-b394-ad7a34c22d5e tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] [instance: 00b0dfe0-2c88-4037-830f-4144190da935] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:16.555537 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-98619ec6-ea09-4a3d-b394-ad7a34c22d5e tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:16.558137 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-98619ec6-ea09-4a3d-b394-ad7a34c22d5e tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:16.558593 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-98619ec6-ea09-4a3d-b394-ad7a34c22d5e tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:16.559353 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-98619ec6-ea09-4a3d-b394-ad7a34c22d5e tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:16.561873 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-98619ec6-ea09-4a3d-b394-ad7a34c22d5e tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:16.562345 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-98619ec6-ea09-4a3d-b394-ad7a34c22d5e tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:16.564049 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6d36ed8b-4506-4255-8c8e-dcf6565f7f0a tempest-QuotaClassesAdmin257Test-1682250940 tempest-QuotaClassesAdmin257Test-1682250940-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.167905 Oct 17 13:34:16.564643 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 149/291] 10.222.0.79 () {62 vars in 1247 bytes} [Mon Oct 17 13:34:16 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:34:16.592478 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bef502d6-990a-48d3-8de7-74d3f4fd0564 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:16.612269 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bef502d6-990a-48d3-8de7-74d3f4fd0564 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Request method failure captured: Oct 17 13:34:16.612269 n-d-854247-14 devstack@n-api.service[127017]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 17 13:34:16.612269 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:34:16.612269 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:34:16.612269 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:34:16.612269 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 27 Oct 17 13:34:16.612269 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:34:16.612269 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:34:16.612269 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:34:16.612269 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:34:16.612269 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVmpOcaxB2C_X-J-QaGcT1kGbE6_rPhSSyJXo7vQLgJBR2DTnRLCVqeQ3yYb8G9k4U2JuWx0jI3baLWlVWB1ZRa_tHm47Rjh5OUf_jvUzaZAroalGRWh5gJopjE82xJt1K6ThvbgKjqesKUuji0oJRUMY6RqY3PC9LCizgDNFY50x6o Oct 17 13:34:16.612269 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:34:16.612269 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:34:16.612269 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:34:16.612269 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:34:16.612269 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:34:16.612269 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:34:16.612269 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 4eca0f2aedd747539ab3d83379e7a80c Oct 17 13:34:16.612269 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-246963748 Oct 17 13:34:16.612269 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member,admin Oct 17 13:34:16.612269 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member,admin Oct 17 13:34:16.613775 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4eca0f2aedd747539ab3d83379e7a80c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4eca0f2aedd747539ab3d83379e7a80c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4eca0f2aedd747539ab3d83379e7a80c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4eca0f2aedd747539ab3d83379e7a80c", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:34:16.613775 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-246963748 Oct 17 13:34:16.613775 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 4eca0f2aedd747539ab3d83379e7a80c Oct 17 13:34:16.613775 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-246963748 Oct 17 13:34:16.613775 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin Oct 17 13:34:16.613775 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:34:16.613775 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:34:16.613775 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 0fe0ad5bb1fd42e9b68cb6aaf4213181 Oct 17 13:34:16.613775 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin Oct 17 13:34:16.613775 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 13:34:16.613775 n-d-854247-14 devstack@n-api.service[127017]: {"aggregate": {"name": ""}} Oct 17 13:34:16.613775 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:34:16.613775 n-d-854247-14 devstack@n-api.service[127017]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 17 13:34:16.614577 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 17 13:34:16.614577 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:34:16.614577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:16.614577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:34:16.614577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:34:16.614577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:34:16.614577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:34:16.614577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 17 13:34:16.614577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:16.614577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 17 13:34:16.614577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 17 13:34:16.614577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:16.614577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 17 13:34:16.614577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi '' Oct 17 13:34:16.614577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:16.614577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:16.614577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:16.614577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:16.614577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:16.614577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:16.614577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:34:16.614577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:34:16.614577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:34:16.615779 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:34:16.615779 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:34:16.615779 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:34:16.615779 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:34:16.615779 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:34:16.615779 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:34:16.615779 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:34:16.615779 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:34:16.615779 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:34:16.615779 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 17 13:34:16.615779 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:16.615779 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:16.615779 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:16.615779 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:16.615779 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:16.615779 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:16.615779 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:34:16.615779 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:34:16.615779 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 17 13:34:16.615779 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:16.619227 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bef502d6-990a-48d3-8de7-74d3f4fd0564 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:34:16.622315 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-bef502d6-990a-48d3-8de7-74d3f4fd0564 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.052730 Oct 17 13:34:16.624200 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 150/292] 10.222.0.79 () {60 vars in 1164 bytes} [Mon Oct 17 13:34:16 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 57 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:34:16.641234 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-15faf9c5-febd-4eaf-9e13-af881ba187c6 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:16.642006 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-15faf9c5-febd-4eaf-9e13-af881ba187c6 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] [instance: eb4474f8-de59-4187-8b15-ba0ec266bfa6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:16.674169 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-15faf9c5-febd-4eaf-9e13-af881ba187c6 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:16.683133 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-15faf9c5-febd-4eaf-9e13-af881ba187c6 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:16.684055 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-15faf9c5-febd-4eaf-9e13-af881ba187c6 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:16.686658 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-15faf9c5-febd-4eaf-9e13-af881ba187c6 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:16.687862 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-15faf9c5-febd-4eaf-9e13-af881ba187c6 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:16.692088 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-15faf9c5-febd-4eaf-9e13-af881ba187c6 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:16.722851 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-15faf9c5-febd-4eaf-9e13-af881ba187c6 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] HTTP exception thrown: Instance eb4474f8-de59-4187-8b15-ba0ec266bfa6 could not be found. Oct 17 13:34:16.725522 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-15faf9c5-febd-4eaf-9e13-af881ba187c6 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Request method failure captured: Oct 17 13:34:16.725522 n-d-854247-14 devstack@n-api.service[127017]: request: DELETE /compute/v2.1/servers/eb4474f8-de59-4187-8b15-ba0ec266bfa6 HTTP/1.1 Oct 17 13:34:16.725522 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:34:16.725522 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:34:16.725522 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:34:16.725522 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:34:16.725522 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:34:16.725522 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:34:16.725522 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:34:16.725522 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:34:16.725522 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVmmL55Z5bByWA0V2R9Iz0esDwWV3AMk8y27-EubVlYWTrNIiyCUZCnqJz0JUX-zcaaQdzmExOZDHu-iSuQDKjY7s9ONoGjDm94vEJREXlekyGeZ1418GZJATKJL80erVRqfqZSsXCAynRHg5ryL9-DjapFSVL5eQIDm1WHUljhNiiY Oct 17 13:34:16.725522 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:34:16.725522 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:34:16.725522 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:34:16.725522 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:34:16.725522 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:34:16.725522 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:34:16.725522 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 9e76de886880490ba8373e0d86056c7b Oct 17 13:34:16.725522 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-AggregatesAdminTestJSON-821890302 Oct 17 13:34:16.725522 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:34:16.725522 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:34:16.726767 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9e76de886880490ba8373e0d86056c7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/9e76de886880490ba8373e0d86056c7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9e76de886880490ba8373e0d86056c7b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_9e76de886880490ba8373e0d86056c7b", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:34:16.726767 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-AggregatesAdminTestJSON-821890302 Oct 17 13:34:16.726767 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 9e76de886880490ba8373e0d86056c7b Oct 17 13:34:16.726767 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-821890302 Oct 17 13:34:16.726767 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-AggregatesAdminTestJSON-821890302-project Oct 17 13:34:16.726767 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:34:16.726767 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:34:16.726767 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 4552e3fbd4de4d2997d5db7ec500de65 Oct 17 13:34:16.726767 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-AggregatesAdminTestJSON-821890302-project Oct 17 13:34:16.726767 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:34:16.726767 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance eb4474f8-de59-4187-8b15-ba0ec266bfa6 could not be found. Oct 17 13:34:16.726767 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'eb4474f8-de59-4187-8b15-ba0ec266bfa6'} Oct 17 13:34:16.728178 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:34:16.728178 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:16.728178 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:34:16.728178 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:34:16.728178 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:34:16.728178 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:34:16.728178 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:34:16.728178 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:34:16.728178 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:34:16.728178 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:34:16.728178 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb4474f8-de59-4187-8b15-ba0ec266bfa6 could not be found. Oct 17 13:34:16.728178 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:16.728178 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:16.728178 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:16.728178 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:16.728178 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:16.728178 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:16.728178 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:34:16.728178 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:34:16.728178 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:34:16.729759 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:34:16.729759 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:34:16.729759 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:34:16.729759 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:34:16.729759 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:34:16.729759 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:34:16.729759 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:34:16.729759 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:34:16.729759 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:34:16.729759 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb4474f8-de59-4187-8b15-ba0ec266bfa6 could not be found. Oct 17 13:34:16.729759 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:16.729759 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:16.729759 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:16.729759 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:16.729759 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:16.729759 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:16.729759 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:34:16.729759 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:34:16.729759 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb4474f8-de59-4187-8b15-ba0ec266bfa6 could not be found. Oct 17 13:34:16.729759 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:16.731917 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-15faf9c5-febd-4eaf-9e13-af881ba187c6 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Returning 404 to user: Instance eb4474f8-de59-4187-8b15-ba0ec266bfa6 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:34:16.733781 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-15faf9c5-febd-4eaf-9e13-af881ba187c6 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] 10.222.0.79 "DELETE /compute/v2.1/servers/eb4474f8-de59-4187-8b15-ba0ec266bfa6" status: 404 len: 111 microversion: 2.1 time: 0.106884 Oct 17 13:34:16.734544 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 151/293] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:34:16 2022] DELETE /compute/v2.1/servers/eb4474f8-de59-4187-8b15-ba0ec266bfa6 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:34:16.757020 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-755432a6-f766-44c3-a54b-ca09959cdee9 tempest-AggregatesAdminNegativeTestJSON-1071893825 tempest-AggregatesAdminNegativeTestJSON-1071893825-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-904771923"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:16.777648 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-755432a6-f766-44c3-a54b-ca09959cdee9 tempest-AggregatesAdminNegativeTestJSON-1071893825 tempest-AggregatesAdminNegativeTestJSON-1071893825-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'f0986bf719ce434f9af4893118a6a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3caf1effcfc4208ad69dab794c96820', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:16.781191 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-755432a6-f766-44c3-a54b-ca09959cdee9 tempest-AggregatesAdminNegativeTestJSON-1071893825 tempest-AggregatesAdminNegativeTestJSON-1071893825-project] Request method failure captured: Oct 17 13:34:16.781191 n-d-854247-14 devstack@n-api.service[127017]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 17 13:34:16.781191 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:34:16.781191 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:34:16.781191 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:34:16.781191 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 59 Oct 17 13:34:16.781191 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:34:16.781191 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:34:16.781191 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:34:16.781191 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:34:16.781191 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVmn22KSCBWon5A064uLU0MT4o1xPp1uuz1NLyXlapDx5DHh0SYU0bs-aE5aUHJIG1IxKS97eNOkVwAZwQAharo9KVi0f5oT4FMsZ1kIB5EzQK_I23hcdqAT6CWSScod6bDm9jVbDZLwow2w03a8FsVG1H6JyqlBB90XZJj5vSEQDBM Oct 17 13:34:16.781191 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:34:16.781191 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:34:16.781191 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:34:16.781191 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:34:16.781191 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:34:16.781191 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:34:16.781191 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: b3caf1effcfc4208ad69dab794c96820 Oct 17 13:34:16.781191 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1071893825 Oct 17 13:34:16.781191 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:34:16.781191 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:34:16.782805 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b3caf1effcfc4208ad69dab794c96820"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b3caf1effcfc4208ad69dab794c96820"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b3caf1effcfc4208ad69dab794c96820"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b3caf1effcfc4208ad69dab794c96820", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:34:16.782805 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1071893825 Oct 17 13:34:16.782805 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: b3caf1effcfc4208ad69dab794c96820 Oct 17 13:34:16.782805 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1071893825 Oct 17 13:34:16.782805 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-AggregatesAdminNegativeTestJSON-1071893825-project Oct 17 13:34:16.782805 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:34:16.782805 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:34:16.782805 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: f0986bf719ce434f9af4893118a6a504 Oct 17 13:34:16.782805 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1071893825-project Oct 17 13:34:16.782805 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 13:34:16.782805 n-d-854247-14 devstack@n-api.service[127017]: {"aggregate": {"name": "tempest-test_aggregate-904771923"}} Oct 17 13:34:16.782805 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:34:16.782805 n-d-854247-14 devstack@n-api.service[127017]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 17 13:34:16.783907 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-904771923'}}} Oct 17 13:34:16.783907 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:34:16.783907 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:16.783907 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:16.783907 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:16.783907 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:34:16.783907 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:34:16.783907 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:34:16.783907 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:34:16.783907 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:34:16.783907 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:34:16.783907 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:34:16.783907 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:34:16.783907 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 17 13:34:16.783907 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 17 13:34:16.783907 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:34:16.783907 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:34:16.783907 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:34:16.783907 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:34:16.785003 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:34:16.785003 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:34:16.785003 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:34:16.785003 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:34:16.785003 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:34:16.785003 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:34:16.785003 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:34:16.785003 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:34:16.785003 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:34:16.785003 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:34:16.785003 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 17 13:34:16.785003 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:16.785003 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:16.785003 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:16.785003 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:16.785003 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:16.785003 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:16.785003 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:34:16.785003 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:34:16.785003 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 17 13:34:16.786432 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:16.788014 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-755432a6-f766-44c3-a54b-ca09959cdee9 tempest-AggregatesAdminNegativeTestJSON-1071893825 tempest-AggregatesAdminNegativeTestJSON-1071893825-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:34:16.792752 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-755432a6-f766-44c3-a54b-ca09959cdee9 tempest-AggregatesAdminNegativeTestJSON-1071893825 tempest-AggregatesAdminNegativeTestJSON-1071893825-project] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.045184 Oct 17 13:34:16.797586 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 152/294] 10.222.0.79 () {60 vars in 1164 bytes} [Mon Oct 17 13:34:16 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 58 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:34:16.802536 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-360f5296-3ff4-4357-86da-25c6bf608b04 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:16.803594 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-360f5296-3ff4-4357-86da-25c6bf608b04 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] [instance: eb4474f8-de59-4187-8b15-ba0ec266bfa6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:16.831460 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-360f5296-3ff4-4357-86da-25c6bf608b04 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:16.833097 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-360f5296-3ff4-4357-86da-25c6bf608b04 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:16.834641 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-360f5296-3ff4-4357-86da-25c6bf608b04 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:16.835927 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-360f5296-3ff4-4357-86da-25c6bf608b04 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:16.837107 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-360f5296-3ff4-4357-86da-25c6bf608b04 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:16.837727 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-360f5296-3ff4-4357-86da-25c6bf608b04 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:16.921339 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-360f5296-3ff4-4357-86da-25c6bf608b04 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] HTTP exception thrown: Instance eb4474f8-de59-4187-8b15-ba0ec266bfa6 could not be found. Oct 17 13:34:16.933216 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-360f5296-3ff4-4357-86da-25c6bf608b04 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Request method failure captured: Oct 17 13:34:16.933216 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/eb4474f8-de59-4187-8b15-ba0ec266bfa6 HTTP/1.1 Oct 17 13:34:16.933216 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:34:16.933216 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:34:16.933216 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:34:16.933216 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:34:16.933216 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:34:16.933216 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:34:16.933216 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:34:16.933216 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:34:16.933216 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVmmL55Z5bByWA0V2R9Iz0esDwWV3AMk8y27-EubVlYWTrNIiyCUZCnqJz0JUX-zcaaQdzmExOZDHu-iSuQDKjY7s9ONoGjDm94vEJREXlekyGeZ1418GZJATKJL80erVRqfqZSsXCAynRHg5ryL9-DjapFSVL5eQIDm1WHUljhNiiY Oct 17 13:34:16.933216 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:34:16.933216 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:34:16.933216 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:34:16.933216 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:34:16.933216 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:34:16.933216 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:34:16.933216 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 9e76de886880490ba8373e0d86056c7b Oct 17 13:34:16.933216 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-AggregatesAdminTestJSON-821890302 Oct 17 13:34:16.933216 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:34:16.933216 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:34:16.934378 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9e76de886880490ba8373e0d86056c7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/9e76de886880490ba8373e0d86056c7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9e76de886880490ba8373e0d86056c7b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_9e76de886880490ba8373e0d86056c7b", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:34:16.934378 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-AggregatesAdminTestJSON-821890302 Oct 17 13:34:16.934378 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 9e76de886880490ba8373e0d86056c7b Oct 17 13:34:16.934378 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-821890302 Oct 17 13:34:16.934378 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-AggregatesAdminTestJSON-821890302-project Oct 17 13:34:16.934378 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:34:16.934378 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:34:16.934378 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 4552e3fbd4de4d2997d5db7ec500de65 Oct 17 13:34:16.934378 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-AggregatesAdminTestJSON-821890302-project Oct 17 13:34:16.934378 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:34:16.934378 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance eb4474f8-de59-4187-8b15-ba0ec266bfa6 could not be found. Oct 17 13:34:16.934378 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'eb4474f8-de59-4187-8b15-ba0ec266bfa6'} Oct 17 13:34:16.935003 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:34:16.935003 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:16.935003 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:34:16.935003 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:34:16.935003 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:34:16.935003 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:34:16.935003 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:34:16.935003 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:34:16.935003 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:34:16.935003 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:34:16.935003 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb4474f8-de59-4187-8b15-ba0ec266bfa6 could not be found. Oct 17 13:34:16.935003 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:16.935003 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:16.935003 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:16.935003 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:16.935003 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:16.935003 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:16.935003 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:34:16.935003 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:34:16.935003 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:34:16.936476 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:34:16.936476 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:34:16.936476 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:34:16.936476 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:34:16.936476 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:34:16.936476 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:34:16.936476 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:34:16.936476 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb4474f8-de59-4187-8b15-ba0ec266bfa6 could not be found. Oct 17 13:34:16.936476 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:16.936476 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:16.936476 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:16.936476 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:16.936476 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:16.936476 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:16.936476 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:34:16.936476 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:34:16.936476 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb4474f8-de59-4187-8b15-ba0ec266bfa6 could not be found. Oct 17 13:34:16.936476 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:16.940071 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-360f5296-3ff4-4357-86da-25c6bf608b04 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] Returning 404 to user: Instance eb4474f8-de59-4187-8b15-ba0ec266bfa6 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:34:16.942162 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-360f5296-3ff4-4357-86da-25c6bf608b04 tempest-AggregatesAdminTestJSON-821890302 tempest-AggregatesAdminTestJSON-821890302-project] 10.222.0.79 "GET /compute/v2.1/servers/eb4474f8-de59-4187-8b15-ba0ec266bfa6" status: 404 len: 111 microversion: 2.1 time: 0.145849 Oct 17 13:34:16.943631 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 153/295] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:16 2022] GET /compute/v2.1/servers/eb4474f8-de59-4187-8b15-ba0ec266bfa6 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:34:16.967418 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c3f3cbcd-3ae2-421f-9da1-399a83cf6097 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1922806720"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:16.989361 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.aggregate [None req-c3f3cbcd-3ae2-421f-9da1-399a83cf6097 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Generated uuid 59aa1104-d45a-4d50-9e44-fe4656e6b19e for aggregate {{(pid=127017) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 13:34:17.044784 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c3f3cbcd-3ae2-421f-9da1-399a83cf6097 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.099700 Oct 17 13:34:17.046393 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 154/296] 10.222.0.79 () {60 vars in 1164 bytes} [Mon Oct 17 13:34:16 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:17.068124 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-11d9710e-1c8b-4ee4-9195-5fa649989883 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1922806720"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:17.077753 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.aggregate [None req-11d9710e-1c8b-4ee4-9195-5fa649989883 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Generated uuid 2a84247a-64d6-4a74-84d8-33ef781bd030 for aggregate {{(pid=127017) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 13:34:17.099248 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-11d9710e-1c8b-4ee4-9195-5fa649989883 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1922806720 already exists. Oct 17 13:34:17.102317 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-11d9710e-1c8b-4ee4-9195-5fa649989883 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Request method failure captured: Oct 17 13:34:17.102317 n-d-854247-14 devstack@n-api.service[127017]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 17 13:34:17.102317 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:34:17.102317 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:34:17.102317 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:34:17.102317 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 60 Oct 17 13:34:17.102317 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:34:17.102317 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:34:17.102317 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:34:17.102317 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:34:17.102317 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVmpOcaxB2C_X-J-QaGcT1kGbE6_rPhSSyJXo7vQLgJBR2DTnRLCVqeQ3yYb8G9k4U2JuWx0jI3baLWlVWB1ZRa_tHm47Rjh5OUf_jvUzaZAroalGRWh5gJopjE82xJt1K6ThvbgKjqesKUuji0oJRUMY6RqY3PC9LCizgDNFY50x6o Oct 17 13:34:17.102317 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:34:17.102317 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:34:17.102317 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:34:17.102317 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:34:17.102317 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:34:17.102317 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:34:17.102317 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 4eca0f2aedd747539ab3d83379e7a80c Oct 17 13:34:17.102317 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-246963748 Oct 17 13:34:17.102317 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member,admin Oct 17 13:34:17.102317 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member,admin Oct 17 13:34:17.103619 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4eca0f2aedd747539ab3d83379e7a80c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4eca0f2aedd747539ab3d83379e7a80c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4eca0f2aedd747539ab3d83379e7a80c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4eca0f2aedd747539ab3d83379e7a80c", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:34:17.103619 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-246963748 Oct 17 13:34:17.103619 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 4eca0f2aedd747539ab3d83379e7a80c Oct 17 13:34:17.103619 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-246963748 Oct 17 13:34:17.103619 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin Oct 17 13:34:17.103619 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:34:17.103619 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:34:17.103619 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 0fe0ad5bb1fd42e9b68cb6aaf4213181 Oct 17 13:34:17.103619 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin Oct 17 13:34:17.103619 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 13:34:17.103619 n-d-854247-14 devstack@n-api.service[127017]: {"aggregate": {"name": "tempest-test_aggregate-1922806720"}} Oct 17 13:34:17.103619 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:34:17.103619 n-d-854247-14 devstack@n-api.service[127017]: exception: Aggregate tempest-test_aggregate-1922806720 already exists. Oct 17 13:34:17.104336 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1922806720'}}} Oct 17 13:34:17.104336 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:34:17.104336 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:17.104336 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 17 13:34:17.104336 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 17 13:34:17.104336 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 17 13:34:17.104336 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 17 13:34:17.104336 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:34:17.104336 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:34:17.104336 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:34:17.104336 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:34:17.104336 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 17 13:34:17.104336 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 17 13:34:17.104336 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Oct 17 13:34:17.104336 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 17 13:34:17.104336 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 17 13:34:17.104336 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 17 13:34:17.104336 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 17 13:34:17.104336 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 17 13:34:17.105409 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 13:34:17.105409 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 13:34:17.105409 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 17 13:34:17.105409 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 17 13:34:17.105409 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1922806720 already exists. Oct 17 13:34:17.105409 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:17.105409 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:17.105409 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:17.105409 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:17.105409 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:17.105409 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:17.105409 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:34:17.105409 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:34:17.105409 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:34:17.105409 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:34:17.105409 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:34:17.105409 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:34:17.105409 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:34:17.105409 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:34:17.105409 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 17 13:34:17.106633 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 17 13:34:17.106633 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1922806720 already exists. Oct 17 13:34:17.106633 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:17.106633 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:17.106633 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:17.106633 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:17.106633 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:17.106633 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:17.106633 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:34:17.106633 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:34:17.106633 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1922806720 already exists. Oct 17 13:34:17.106633 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:17.114744 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-11d9710e-1c8b-4ee4-9195-5fa649989883 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1922806720 already exists. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:34:17.118566 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-11d9710e-1c8b-4ee4-9195-5fa649989883 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.061956 Oct 17 13:34:17.126924 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 155/297] 10.222.0.79 () {60 vars in 1164 bytes} [Mon Oct 17 13:34:17 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 72 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:34:17.140294 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0fb41fa5-f5c6-4fb7-a37b-a67964b9409b tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:17.183230 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0fb41fa5-f5c6-4fb7-a37b-a67964b9409b tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.050343 Oct 17 13:34:17.186726 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 156/298] 10.222.0.79 () {58 vars in 1155 bytes} [Mon Oct 17 13:34:17 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 13:34:17.213165 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-98619ec6-ea09-4a3d-b394-ad7a34c22d5e tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ca1489f0084089a47d0cfc2ad37940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a297ddf04b4b18ae7591e107e84d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:17.221726 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-98619ec6-ea09-4a3d-b394-ad7a34c22d5e tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] 10.222.0.79 "GET /compute/v2.1/servers/00b0dfe0-2c88-4037-830f-4144190da935" status: 200 len: 1319 microversion: 2.1 time: 0.701443 Oct 17 13:34:17.222312 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 143/299] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:16 2022] GET /compute/v2.1/servers/00b0dfe0-2c88-4037-830f-4144190da935 => generated 1319 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:17.224401 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d6679f0d-ff27-4972-a362-ea1a5d861728 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1559697030"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:17.233600 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.aggregate [None req-d6679f0d-ff27-4972-a362-ea1a5d861728 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Generated uuid 0e8caf78-0ddf-4fb2-bf9f-95fc91c6791f for aggregate {{(pid=127017) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 13:34:17.293422 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d6679f0d-ff27-4972-a362-ea1a5d861728 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.091968 Oct 17 13:34:17.307991 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-60493fcc-8845-4426-92fa-652c9c5dad66 tempest-AggregatesAdminNegativeTestJSON-1071893825 tempest-AggregatesAdminNegativeTestJSON-1071893825-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:17.309506 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-60493fcc-8845-4426-92fa-652c9c5dad66 tempest-AggregatesAdminNegativeTestJSON-1071893825 tempest-AggregatesAdminNegativeTestJSON-1071893825-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'f0986bf719ce434f9af4893118a6a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3caf1effcfc4208ad69dab794c96820', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:17.311592 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 157/300] 10.222.0.79 () {60 vars in 1164 bytes} [Mon Oct 17 13:34:17 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:17.314639 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-60493fcc-8845-4426-92fa-652c9c5dad66 tempest-AggregatesAdminNegativeTestJSON-1071893825 tempest-AggregatesAdminNegativeTestJSON-1071893825-project] Request method failure captured: Oct 17 13:34:17.314639 n-d-854247-14 devstack@n-api.service[127016]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Oct 17 13:34:17.314639 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:34:17.314639 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:34:17.314639 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:34:17.314639 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:34:17.314639 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:34:17.314639 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:34:17.314639 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:34:17.314639 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:34:17.314639 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVmn22KSCBWon5A064uLU0MT4o1xPp1uuz1NLyXlapDx5DHh0SYU0bs-aE5aUHJIG1IxKS97eNOkVwAZwQAharo9KVi0f5oT4FMsZ1kIB5EzQK_I23hcdqAT6CWSScod6bDm9jVbDZLwow2w03a8FsVG1H6JyqlBB90XZJj5vSEQDBM Oct 17 13:34:17.314639 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:34:17.314639 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:34:17.314639 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:34:17.314639 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:34:17.314639 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:34:17.314639 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:34:17.314639 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: b3caf1effcfc4208ad69dab794c96820 Oct 17 13:34:17.314639 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1071893825 Oct 17 13:34:17.314639 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:34:17.314639 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:34:17.316231 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b3caf1effcfc4208ad69dab794c96820"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b3caf1effcfc4208ad69dab794c96820"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b3caf1effcfc4208ad69dab794c96820"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b3caf1effcfc4208ad69dab794c96820", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:34:17.316231 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1071893825 Oct 17 13:34:17.316231 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: b3caf1effcfc4208ad69dab794c96820 Oct 17 13:34:17.316231 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1071893825 Oct 17 13:34:17.316231 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-AggregatesAdminNegativeTestJSON-1071893825-project Oct 17 13:34:17.316231 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:34:17.316231 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:34:17.316231 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: f0986bf719ce434f9af4893118a6a504 Oct 17 13:34:17.316231 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1071893825-project Oct 17 13:34:17.316231 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:34:17.316231 n-d-854247-14 devstack@n-api.service[127016]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 17 13:34:17.316231 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '15'} Oct 17 13:34:17.316988 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:34:17.316988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:17.316988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:17.316988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:17.316988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:34:17.316988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:34:17.316988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:34:17.316988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:34:17.316988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 17 13:34:17.316988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 17 13:34:17.316988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:34:17.316988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:34:17.316988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:34:17.316988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:34:17.316988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:34:17.316988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:34:17.316988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:34:17.316988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:34:17.316988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:34:17.318075 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:34:17.318075 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:34:17.318075 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:34:17.318075 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:34:17.318075 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:34:17.318075 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 17 13:34:17.318075 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:17.318075 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:17.318075 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:17.318075 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:17.318075 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:17.318075 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:17.318075 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:34:17.318075 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:34:17.318075 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 17 13:34:17.318075 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:17.318075 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-60493fcc-8845-4426-92fa-652c9c5dad66 tempest-AggregatesAdminNegativeTestJSON-1071893825 tempest-AggregatesAdminNegativeTestJSON-1071893825-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:34:17.318993 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-60493fcc-8845-4426-92fa-652c9c5dad66 tempest-AggregatesAdminNegativeTestJSON-1071893825 tempest-AggregatesAdminNegativeTestJSON-1071893825-project] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.015364 Oct 17 13:34:17.324353 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 144/301] 10.222.0.79 () {58 vars in 1155 bytes} [Mon Oct 17 13:34:17 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:34:17.335605 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3580187f-5c83-444a-a6c1-ce00c08d3784 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:17.377054 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3580187f-5c83-444a-a6c1-ce00c08d3784 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.045523 Oct 17 13:34:17.382052 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 158/302] 10.222.0.79 () {58 vars in 1155 bytes} [Mon Oct 17 13:34:17 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 13:34:17.387521 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-31291eb8-391e-402c-879c-c79473a82be0 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:17.414212 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-31291eb8-391e-402c-879c-c79473a82be0 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 17 13:34:17.418618 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-31291eb8-391e-402c-879c-c79473a82be0 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Request method failure captured: Oct 17 13:34:17.418618 n-d-854247-14 devstack@n-api.service[127016]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 17 13:34:17.418618 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:34:17.418618 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:34:17.418618 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:34:17.418618 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:34:17.418618 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:34:17.418618 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:34:17.418618 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:34:17.418618 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:34:17.418618 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVmpOcaxB2C_X-J-QaGcT1kGbE6_rPhSSyJXo7vQLgJBR2DTnRLCVqeQ3yYb8G9k4U2JuWx0jI3baLWlVWB1ZRa_tHm47Rjh5OUf_jvUzaZAroalGRWh5gJopjE82xJt1K6ThvbgKjqesKUuji0oJRUMY6RqY3PC9LCizgDNFY50x6o Oct 17 13:34:17.418618 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:34:17.418618 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:34:17.418618 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:34:17.418618 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:34:17.418618 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:34:17.418618 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:34:17.418618 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 4eca0f2aedd747539ab3d83379e7a80c Oct 17 13:34:17.418618 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-246963748 Oct 17 13:34:17.418618 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member,admin Oct 17 13:34:17.418618 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member,admin Oct 17 13:34:17.419943 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4eca0f2aedd747539ab3d83379e7a80c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4eca0f2aedd747539ab3d83379e7a80c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4eca0f2aedd747539ab3d83379e7a80c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4eca0f2aedd747539ab3d83379e7a80c", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:34:17.419943 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-246963748 Oct 17 13:34:17.419943 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 4eca0f2aedd747539ab3d83379e7a80c Oct 17 13:34:17.419943 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-246963748 Oct 17 13:34:17.419943 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin Oct 17 13:34:17.419943 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:34:17.419943 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:34:17.419943 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 0fe0ad5bb1fd42e9b68cb6aaf4213181 Oct 17 13:34:17.419943 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin Oct 17 13:34:17.419943 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:34:17.419943 n-d-854247-14 devstack@n-api.service[127016]: exception: Aggregate -1 could not be found. Oct 17 13:34:17.419943 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '-1'} Oct 17 13:34:17.420632 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:34:17.420632 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:17.420632 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 17 13:34:17.420632 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 17 13:34:17.420632 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 17 13:34:17.420632 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 17 13:34:17.420632 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:34:17.420632 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:34:17.420632 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:34:17.420632 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:34:17.420632 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 17 13:34:17.420632 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 17 13:34:17.420632 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 17 13:34:17.420632 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 17 13:34:17.420632 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:34:17.420632 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:34:17.420632 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 17 13:34:17.420632 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 17 13:34:17.420632 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 13:34:17.421615 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 13:34:17.421615 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 17 13:34:17.421615 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 17 13:34:17.421615 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 17 13:34:17.421615 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:17.421615 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:17.421615 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:17.421615 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:17.421615 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:17.421615 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:17.421615 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:34:17.421615 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:34:17.421615 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:34:17.421615 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:34:17.421615 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 17 13:34:17.421615 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:34:17.421615 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 17 13:34:17.421615 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:17.421615 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:17.421615 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:17.421615 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:17.423842 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:17.423842 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:17.423842 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:34:17.423842 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:34:17.423842 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 17 13:34:17.423842 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:17.425684 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6dd9827e-8a8f-4217-8cb3-d8c868114eca tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:17.425816 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-31291eb8-391e-402c-879c-c79473a82be0 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:34:17.425938 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6dd9827e-8a8f-4217-8cb3-d8c868114eca tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] [instance: 12e5e9fe-b998-450c-94b0-492a92bb6027] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:17.426059 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-31291eb8-391e-402c-879c-c79473a82be0 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.036129 Oct 17 13:34:17.428297 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 145/303] 10.222.0.79 () {58 vars in 1155 bytes} [Mon Oct 17 13:34:17 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:34:17.446059 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e9d07770-3d58-464a-868b-0bad6b029219 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-862319150"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:17.452713 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6dd9827e-8a8f-4217-8cb3-d8c868114eca tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:17.453259 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6dd9827e-8a8f-4217-8cb3-d8c868114eca tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:17.453716 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6dd9827e-8a8f-4217-8cb3-d8c868114eca tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:17.456928 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6dd9827e-8a8f-4217-8cb3-d8c868114eca tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:17.457533 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6dd9827e-8a8f-4217-8cb3-d8c868114eca tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:17.458017 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6dd9827e-8a8f-4217-8cb3-d8c868114eca tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:17.467850 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.aggregate [None req-e9d07770-3d58-464a-868b-0bad6b029219 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Generated uuid 80c3cca6-ab7f-4631-9c86-45030ae7593e for aggregate {{(pid=127016) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 13:34:17.512585 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e9d07770-3d58-464a-868b-0bad6b029219 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.083061 Oct 17 13:34:17.515997 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 146/304] 10.222.0.79 () {60 vars in 1164 bytes} [Mon Oct 17 13:34:17 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:17.535967 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b31421d8-8f6d-4890-8d63-9961a84b90ac tempest-AggregatesAdminNegativeTestJSON-1071893825 tempest-AggregatesAdminNegativeTestJSON-1071893825-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:17.538920 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b31421d8-8f6d-4890-8d63-9961a84b90ac tempest-AggregatesAdminNegativeTestJSON-1071893825 tempest-AggregatesAdminNegativeTestJSON-1071893825-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'f0986bf719ce434f9af4893118a6a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3caf1effcfc4208ad69dab794c96820', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:17.542365 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b31421d8-8f6d-4890-8d63-9961a84b90ac tempest-AggregatesAdminNegativeTestJSON-1071893825 tempest-AggregatesAdminNegativeTestJSON-1071893825-project] Request method failure captured: Oct 17 13:34:17.542365 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Oct 17 13:34:17.542365 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:34:17.542365 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:34:17.542365 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:34:17.542365 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:34:17.542365 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:34:17.542365 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:34:17.542365 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:34:17.542365 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:34:17.542365 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVmn22KSCBWon5A064uLU0MT4o1xPp1uuz1NLyXlapDx5DHh0SYU0bs-aE5aUHJIG1IxKS97eNOkVwAZwQAharo9KVi0f5oT4FMsZ1kIB5EzQK_I23hcdqAT6CWSScod6bDm9jVbDZLwow2w03a8FsVG1H6JyqlBB90XZJj5vSEQDBM Oct 17 13:34:17.542365 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:34:17.542365 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:34:17.542365 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:34:17.542365 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:34:17.542365 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:34:17.542365 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:34:17.542365 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: b3caf1effcfc4208ad69dab794c96820 Oct 17 13:34:17.542365 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1071893825 Oct 17 13:34:17.542365 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:34:17.542365 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:34:17.543913 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b3caf1effcfc4208ad69dab794c96820"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b3caf1effcfc4208ad69dab794c96820"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b3caf1effcfc4208ad69dab794c96820"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b3caf1effcfc4208ad69dab794c96820", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:34:17.543913 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1071893825 Oct 17 13:34:17.543913 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: b3caf1effcfc4208ad69dab794c96820 Oct 17 13:34:17.543913 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1071893825 Oct 17 13:34:17.543913 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-AggregatesAdminNegativeTestJSON-1071893825-project Oct 17 13:34:17.543913 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:34:17.543913 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:34:17.543913 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: f0986bf719ce434f9af4893118a6a504 Oct 17 13:34:17.543913 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1071893825-project Oct 17 13:34:17.543913 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:34:17.543913 n-d-854247-14 devstack@n-api.service[127016]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 17 13:34:17.543913 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '16'} Oct 17 13:34:17.544556 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:34:17.544556 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:17.544556 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:17.544556 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:17.544556 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:34:17.544556 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:34:17.544556 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:34:17.544556 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:34:17.544556 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 17 13:34:17.544556 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 17 13:34:17.544556 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:34:17.544556 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:34:17.544556 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:34:17.544556 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:34:17.544556 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:34:17.544556 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:34:17.544556 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:34:17.544556 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:34:17.544556 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:34:17.545692 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:34:17.545692 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:34:17.545692 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:34:17.545692 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:34:17.545692 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:34:17.545692 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 17 13:34:17.545692 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:17.545692 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:17.545692 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:17.545692 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:17.545692 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:17.545692 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:17.545692 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:34:17.545692 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:34:17.545692 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 17 13:34:17.545692 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:17.550026 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b31421d8-8f6d-4890-8d63-9961a84b90ac tempest-AggregatesAdminNegativeTestJSON-1071893825 tempest-AggregatesAdminNegativeTestJSON-1071893825-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:34:17.551522 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b31421d8-8f6d-4890-8d63-9961a84b90ac tempest-AggregatesAdminNegativeTestJSON-1071893825 tempest-AggregatesAdminNegativeTestJSON-1071893825-project] 10.222.0.79 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.024685 Oct 17 13:34:17.552228 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 147/305] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Oct 17 13:34:17 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:34:17.563297 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4add048c-5276-426e-a747-014e6d6a4b6b tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:17.595882 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4add048c-5276-426e-a747-014e6d6a4b6b tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.037847 Oct 17 13:34:17.597307 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 148/306] 10.222.0.79 () {58 vars in 1155 bytes} [Mon Oct 17 13:34:17 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 17 13:34:17.608629 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d5f1d560-a8b5-43a5-9ffb-1bd9ea6ad1ed tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:17.621672 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-d5f1d560-a8b5-43a5-9ffb-1bd9ea6ad1ed tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 17 13:34:17.624825 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d5f1d560-a8b5-43a5-9ffb-1bd9ea6ad1ed tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Request method failure captured: Oct 17 13:34:17.624825 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 17 13:34:17.624825 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:34:17.624825 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:34:17.624825 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:34:17.624825 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:34:17.624825 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:34:17.624825 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:34:17.624825 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:34:17.624825 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:34:17.624825 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVmpOcaxB2C_X-J-QaGcT1kGbE6_rPhSSyJXo7vQLgJBR2DTnRLCVqeQ3yYb8G9k4U2JuWx0jI3baLWlVWB1ZRa_tHm47Rjh5OUf_jvUzaZAroalGRWh5gJopjE82xJt1K6ThvbgKjqesKUuji0oJRUMY6RqY3PC9LCizgDNFY50x6o Oct 17 13:34:17.624825 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:34:17.624825 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:34:17.624825 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:34:17.624825 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:34:17.624825 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:34:17.624825 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:34:17.624825 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 4eca0f2aedd747539ab3d83379e7a80c Oct 17 13:34:17.624825 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-246963748 Oct 17 13:34:17.624825 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member,admin Oct 17 13:34:17.624825 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member,admin Oct 17 13:34:17.626353 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4eca0f2aedd747539ab3d83379e7a80c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4eca0f2aedd747539ab3d83379e7a80c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4eca0f2aedd747539ab3d83379e7a80c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4eca0f2aedd747539ab3d83379e7a80c", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:34:17.626353 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-246963748 Oct 17 13:34:17.626353 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 4eca0f2aedd747539ab3d83379e7a80c Oct 17 13:34:17.626353 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-246963748 Oct 17 13:34:17.626353 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin Oct 17 13:34:17.626353 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:34:17.626353 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:34:17.626353 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 0fe0ad5bb1fd42e9b68cb6aaf4213181 Oct 17 13:34:17.626353 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin Oct 17 13:34:17.626353 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:34:17.626353 n-d-854247-14 devstack@n-api.service[127016]: exception: Aggregate -1 could not be found. Oct 17 13:34:17.626353 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '-1'} Oct 17 13:34:17.627146 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:34:17.627146 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:17.627146 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 17 13:34:17.627146 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 17 13:34:17.627146 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 17 13:34:17.627146 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 17 13:34:17.627146 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:34:17.627146 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:34:17.627146 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 17 13:34:17.627146 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 17 13:34:17.627146 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 13:34:17.627146 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 13:34:17.627146 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 17 13:34:17.627146 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 17 13:34:17.627146 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 17 13:34:17.627146 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:17.627146 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:17.627146 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:17.627146 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:17.627146 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:17.628393 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:17.628393 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:34:17.628393 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:34:17.628393 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:34:17.628393 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:34:17.628393 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 17 13:34:17.628393 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:34:17.628393 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 17 13:34:17.628393 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:17.628393 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:17.628393 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:17.628393 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:17.628393 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:17.628393 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:17.628393 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:34:17.628393 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:34:17.628393 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 17 13:34:17.628393 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:17.633986 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d5f1d560-a8b5-43a5-9ffb-1bd9ea6ad1ed tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:34:17.636295 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d5f1d560-a8b5-43a5-9ffb-1bd9ea6ad1ed tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] 10.222.0.79 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.032316 Oct 17 13:34:17.638170 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 149/307] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Oct 17 13:34:17 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:34:17.651828 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f49b0134-4595-41a4-95e1-c413343fb1bd tempest-AggregatesAdminNegativeTestJSON-1071893825 tempest-AggregatesAdminNegativeTestJSON-1071893825-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:17.656758 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f49b0134-4595-41a4-95e1-c413343fb1bd tempest-AggregatesAdminNegativeTestJSON-1071893825 tempest-AggregatesAdminNegativeTestJSON-1071893825-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'f0986bf719ce434f9af4893118a6a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3caf1effcfc4208ad69dab794c96820', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:17.658386 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f49b0134-4595-41a4-95e1-c413343fb1bd tempest-AggregatesAdminNegativeTestJSON-1071893825 tempest-AggregatesAdminNegativeTestJSON-1071893825-project] Request method failure captured: Oct 17 13:34:17.658386 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 17 13:34:17.658386 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:34:17.658386 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:34:17.658386 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:34:17.658386 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:34:17.658386 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:34:17.658386 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:34:17.658386 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:34:17.658386 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:34:17.658386 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVmn22KSCBWon5A064uLU0MT4o1xPp1uuz1NLyXlapDx5DHh0SYU0bs-aE5aUHJIG1IxKS97eNOkVwAZwQAharo9KVi0f5oT4FMsZ1kIB5EzQK_I23hcdqAT6CWSScod6bDm9jVbDZLwow2w03a8FsVG1H6JyqlBB90XZJj5vSEQDBM Oct 17 13:34:17.658386 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:34:17.658386 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:34:17.658386 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:34:17.658386 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:34:17.658386 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:34:17.658386 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:34:17.658386 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: b3caf1effcfc4208ad69dab794c96820 Oct 17 13:34:17.658386 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1071893825 Oct 17 13:34:17.658386 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:34:17.658386 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:34:17.659848 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b3caf1effcfc4208ad69dab794c96820"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b3caf1effcfc4208ad69dab794c96820"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b3caf1effcfc4208ad69dab794c96820"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b3caf1effcfc4208ad69dab794c96820", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:34:17.659848 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1071893825 Oct 17 13:34:17.659848 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: b3caf1effcfc4208ad69dab794c96820 Oct 17 13:34:17.659848 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1071893825 Oct 17 13:34:17.659848 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-AggregatesAdminNegativeTestJSON-1071893825-project Oct 17 13:34:17.659848 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:34:17.659848 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:34:17.659848 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: f0986bf719ce434f9af4893118a6a504 Oct 17 13:34:17.659848 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1071893825-project Oct 17 13:34:17.659848 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:34:17.659848 n-d-854247-14 devstack@n-api.service[127016]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 17 13:34:17.659848 n-d-854247-14 devstack@n-api.service[127016]: action_args: {} Oct 17 13:34:17.660666 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:34:17.660666 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:17.660666 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:17.660666 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:17.660666 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:34:17.660666 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:34:17.660666 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:34:17.660666 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:34:17.660666 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 17 13:34:17.660666 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 17 13:34:17.660666 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:34:17.660666 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:34:17.660666 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:34:17.660666 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:34:17.660666 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:34:17.660666 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:34:17.660666 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:34:17.660666 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:34:17.660666 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:34:17.661642 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:34:17.661642 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:34:17.661642 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:34:17.661642 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:34:17.661642 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:34:17.661642 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 17 13:34:17.661642 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:17.661642 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:17.661642 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:17.661642 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:17.661642 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:17.661642 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:17.661642 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:34:17.661642 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:34:17.661642 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 17 13:34:17.661642 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:17.661642 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f49b0134-4595-41a4-95e1-c413343fb1bd tempest-AggregatesAdminNegativeTestJSON-1071893825 tempest-AggregatesAdminNegativeTestJSON-1071893825-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:34:17.663035 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f49b0134-4595-41a4-95e1-c413343fb1bd tempest-AggregatesAdminNegativeTestJSON-1071893825 tempest-AggregatesAdminNegativeTestJSON-1071893825-project] 10.222.0.79 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.014482 Oct 17 13:34:17.663035 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 150/308] 10.222.0.79 () {58 vars in 1143 bytes} [Mon Oct 17 13:34:17 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:34:17.672386 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7cd2699e-8ab0-430a-8025-30128652a02a tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1955669835"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:17.676441 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.aggregate [None req-7cd2699e-8ab0-430a-8025-30128652a02a tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Generated uuid 454f72e4-cb32-40bd-be74-c1fdd82dc3df for aggregate {{(pid=127016) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 13:34:17.688855 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=12,nova_api:UPDATE=7,nova_api:DELETE=6 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:34:17.706433 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7cd2699e-8ab0-430a-8025-30128652a02a tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.038385 Oct 17 13:34:17.714050 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 151/309] 10.222.0.79 () {60 vars in 1164 bytes} [Mon Oct 17 13:34:17 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:17.721793 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b8ee8a6d-838e-4469-8035-d9ea5eb70201 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854247-14"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:17.749055 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b8ee8a6d-838e-4469-8035-d9ea5eb70201 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:17.751741 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b8ee8a6d-838e-4469-8035-d9ea5eb70201 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:17.751741 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b8ee8a6d-838e-4469-8035-d9ea5eb70201 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:17.924752 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6dd9827e-8a8f-4217-8cb3-d8c868114eca tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e836340278b49f593350249132b9cfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550b2bda88024756abc4134365842d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:17.935245 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6dd9827e-8a8f-4217-8cb3-d8c868114eca tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] 10.222.0.79 "GET /compute/v2.1/servers/12e5e9fe-b998-450c-94b0-492a92bb6027" status: 200 len: 1389 microversion: 2.1 time: 0.522440 Oct 17 13:34:17.941433 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 159/310] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:17 2022] GET /compute/v2.1/servers/12e5e9fe-b998-450c-94b0-492a92bb6027 => generated 1389 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:18.038767 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b8ee8a6d-838e-4469-8035-d9ea5eb70201 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 244 microversion: 2.1 time: 0.321623 Oct 17 13:34:18.047352 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 152/311] 10.222.0.79 () {60 vars in 1194 bytes} [Mon Oct 17 13:34:17 2022] POST /compute/v2.1/os-aggregates/17/action => generated 244 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:18.051886 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-101288d1-545a-4880-a435-df772003abd3 tempest-AggregatesAdminNegativeTestJSON-1071893825 tempest-AggregatesAdminNegativeTestJSON-1071893825-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854247-14"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:18.055998 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-101288d1-545a-4880-a435-df772003abd3 tempest-AggregatesAdminNegativeTestJSON-1071893825 tempest-AggregatesAdminNegativeTestJSON-1071893825-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'f0986bf719ce434f9af4893118a6a504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3caf1effcfc4208ad69dab794c96820', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:18.057207 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-101288d1-545a-4880-a435-df772003abd3 tempest-AggregatesAdminNegativeTestJSON-1071893825 tempest-AggregatesAdminNegativeTestJSON-1071893825-project] Request method failure captured: Oct 17 13:34:18.057207 n-d-854247-14 devstack@n-api.service[127017]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Oct 17 13:34:18.057207 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:34:18.057207 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:34:18.057207 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:34:18.057207 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 43 Oct 17 13:34:18.057207 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:34:18.057207 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:34:18.057207 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:34:18.057207 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:34:18.057207 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVmn22KSCBWon5A064uLU0MT4o1xPp1uuz1NLyXlapDx5DHh0SYU0bs-aE5aUHJIG1IxKS97eNOkVwAZwQAharo9KVi0f5oT4FMsZ1kIB5EzQK_I23hcdqAT6CWSScod6bDm9jVbDZLwow2w03a8FsVG1H6JyqlBB90XZJj5vSEQDBM Oct 17 13:34:18.057207 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:34:18.057207 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:34:18.057207 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:34:18.057207 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:34:18.057207 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:34:18.057207 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:34:18.057207 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: b3caf1effcfc4208ad69dab794c96820 Oct 17 13:34:18.057207 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1071893825 Oct 17 13:34:18.057207 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:34:18.057207 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:34:18.058637 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b3caf1effcfc4208ad69dab794c96820"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b3caf1effcfc4208ad69dab794c96820"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b3caf1effcfc4208ad69dab794c96820"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b3caf1effcfc4208ad69dab794c96820", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:34:18.058637 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1071893825 Oct 17 13:34:18.058637 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: b3caf1effcfc4208ad69dab794c96820 Oct 17 13:34:18.058637 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1071893825 Oct 17 13:34:18.058637 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-AggregatesAdminNegativeTestJSON-1071893825-project Oct 17 13:34:18.058637 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:34:18.058637 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:34:18.058637 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: f0986bf719ce434f9af4893118a6a504 Oct 17 13:34:18.058637 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1071893825-project Oct 17 13:34:18.058637 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 13:34:18.058637 n-d-854247-14 devstack@n-api.service[127017]: {"remove_host": {"host": "n-h2-854247-14"}} Oct 17 13:34:18.058637 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:34:18.058637 n-d-854247-14 devstack@n-api.service[127017]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 17 13:34:18.059864 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h2-854247-14'}}} Oct 17 13:34:18.059864 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:34:18.059864 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:18.059864 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:18.059864 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:18.059864 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:34:18.059864 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:34:18.059864 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:34:18.059864 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:34:18.059864 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:34:18.059864 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:34:18.059864 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 17 13:34:18.059864 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 17 13:34:18.059864 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:34:18.059864 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:34:18.059864 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:34:18.059864 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:34:18.059864 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:34:18.059864 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:34:18.061577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:34:18.061577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:34:18.061577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:34:18.061577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:34:18.061577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:34:18.061577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:34:18.061577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:34:18.061577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:34:18.061577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 17 13:34:18.061577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:18.061577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:18.061577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:18.061577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:18.061577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:18.061577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:18.061577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:34:18.061577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:34:18.061577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 17 13:34:18.061577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:18.067730 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-101288d1-545a-4880-a435-df772003abd3 tempest-AggregatesAdminNegativeTestJSON-1071893825 tempest-AggregatesAdminNegativeTestJSON-1071893825-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:34:18.067730 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-101288d1-545a-4880-a435-df772003abd3 tempest-AggregatesAdminNegativeTestJSON-1071893825 tempest-AggregatesAdminNegativeTestJSON-1071893825-project] 10.222.0.79 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.010588 Oct 17 13:34:18.067730 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 160/312] 10.222.0.79 () {60 vars in 1194 bytes} [Mon Oct 17 13:34:18 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:34:18.080406 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ad05a103-a136-4437-a6af-b0c012b6fc79 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854247-14"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:18.108805 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ad05a103-a136-4437-a6af-b0c012b6fc79 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:18.109306 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ad05a103-a136-4437-a6af-b0c012b6fc79 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:18.109801 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ad05a103-a136-4437-a6af-b0c012b6fc79 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:18.249019 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6096011e-311b-4ff3-a455-f8332c1c8bfb tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:18.252417 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6096011e-311b-4ff3-a455-f8332c1c8bfb tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] [instance: 00b0dfe0-2c88-4037-830f-4144190da935] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:18.266854 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6096011e-311b-4ff3-a455-f8332c1c8bfb tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:18.267504 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6096011e-311b-4ff3-a455-f8332c1c8bfb tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:18.268178 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6096011e-311b-4ff3-a455-f8332c1c8bfb tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:18.269153 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6096011e-311b-4ff3-a455-f8332c1c8bfb tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:18.269807 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6096011e-311b-4ff3-a455-f8332c1c8bfb tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:18.270465 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6096011e-311b-4ff3-a455-f8332c1c8bfb tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:18.351272 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ad05a103-a136-4437-a6af-b0c012b6fc79 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 228 microversion: 2.1 time: 0.280538 Oct 17 13:34:18.355526 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 153/313] 10.222.0.79 () {60 vars in 1194 bytes} [Mon Oct 17 13:34:18 2022] POST /compute/v2.1/os-aggregates/17/action => generated 228 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:18.367514 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-20d9b265-85a7-4351-bb27-c8981ff99114 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:18.406886 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-20d9b265-85a7-4351-bb27-c8981ff99114 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.042205 Oct 17 13:34:18.408861 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 154/314] 10.222.0.79 () {58 vars in 1155 bytes} [Mon Oct 17 13:34:18 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 13:34:18.418732 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fe2ac613-788d-4e29-af16-b76abb547758 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1153124001"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:18.427778 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.aggregate [None req-fe2ac613-788d-4e29-af16-b76abb547758 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Generated uuid 9e293e82-3f8a-4007-8f3c-7e57c0c90858 for aggregate {{(pid=127016) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 13:34:18.470630 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fe2ac613-788d-4e29-af16-b76abb547758 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.056144 Oct 17 13:34:18.471902 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 155/315] 10.222.0.79 () {60 vars in 1164 bytes} [Mon Oct 17 13:34:18 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:34:18.483774 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-913647d2-8edd-4b01-bc5d-0abef2c63a07 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:18.505248 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-913647d2-8edd-4b01-bc5d-0abef2c63a07 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:18.509413 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-913647d2-8edd-4b01-bc5d-0abef2c63a07 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:18.510717 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-913647d2-8edd-4b01-bc5d-0abef2c63a07 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:18.528634 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-913647d2-8edd-4b01-bc5d-0abef2c63a07 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:18.529217 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-913647d2-8edd-4b01-bc5d-0abef2c63a07 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:18.529714 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-913647d2-8edd-4b01-bc5d-0abef2c63a07 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:18.538873 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.compute.aggregates [None req-913647d2-8edd-4b01-bc5d-0abef2c63a07 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 17 13:34:18.539516 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-913647d2-8edd-4b01-bc5d-0abef2c63a07 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Oct 17 13:34:18.541594 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-913647d2-8edd-4b01-bc5d-0abef2c63a07 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Request method failure captured: Oct 17 13:34:18.541594 n-d-854247-14 devstack@n-api.service[127016]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Oct 17 13:34:18.541594 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:34:18.541594 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:34:18.541594 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:34:18.541594 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 42 Oct 17 13:34:18.541594 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:34:18.541594 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:34:18.541594 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:34:18.541594 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:34:18.541594 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVmpOcaxB2C_X-J-QaGcT1kGbE6_rPhSSyJXo7vQLgJBR2DTnRLCVqeQ3yYb8G9k4U2JuWx0jI3baLWlVWB1ZRa_tHm47Rjh5OUf_jvUzaZAroalGRWh5gJopjE82xJt1K6ThvbgKjqesKUuji0oJRUMY6RqY3PC9LCizgDNFY50x6o Oct 17 13:34:18.541594 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:34:18.541594 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:34:18.541594 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:34:18.541594 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:34:18.541594 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:34:18.541594 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:34:18.541594 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 4eca0f2aedd747539ab3d83379e7a80c Oct 17 13:34:18.541594 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-246963748 Oct 17 13:34:18.541594 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member,admin Oct 17 13:34:18.541594 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member,admin Oct 17 13:34:18.542859 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4eca0f2aedd747539ab3d83379e7a80c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4eca0f2aedd747539ab3d83379e7a80c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4eca0f2aedd747539ab3d83379e7a80c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4eca0f2aedd747539ab3d83379e7a80c", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:34:18.542859 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-246963748 Oct 17 13:34:18.542859 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 4eca0f2aedd747539ab3d83379e7a80c Oct 17 13:34:18.542859 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-246963748 Oct 17 13:34:18.542859 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin Oct 17 13:34:18.542859 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:34:18.542859 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:34:18.542859 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 0fe0ad5bb1fd42e9b68cb6aaf4213181 Oct 17 13:34:18.542859 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin Oct 17 13:34:18.542859 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:34:18.542859 n-d-854247-14 devstack@n-api.service[127016]: {"remove_host": {"host": "nonexist_host"}} Oct 17 13:34:18.542859 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:34:18.542859 n-d-854247-14 devstack@n-api.service[127016]: exception: Cannot remove host nonexist_host in aggregate 18 Oct 17 13:34:18.543626 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 17 13:34:18.543626 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:34:18.543626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:18.543626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 17 13:34:18.543626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 17 13:34:18.543626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:34:18.543626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:34:18.543626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 17 13:34:18.543626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 17 13:34:18.543626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 13:34:18.543626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 13:34:18.543626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 17 13:34:18.543626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 17 13:34:18.543626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 17 13:34:18.543626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:18.543626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:18.543626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:18.543626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:18.543626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 17 13:34:18.543626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 17 13:34:18.548239 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 17 13:34:18.548239 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 17 13:34:18.548239 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 17 13:34:18.548239 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:18.548239 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:18.548239 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:18.548239 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:18.548239 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 17 13:34:18.548239 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 17 13:34:18.548239 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 17 13:34:18.548239 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 17 13:34:18.548239 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:34:18.548239 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:34:18.548239 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:34:18.548239 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:34:18.548239 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 17 13:34:18.548239 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 17 13:34:18.548239 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Oct 17 13:34:18.548239 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 17 13:34:18.548239 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 17 13:34:18.550004 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 17 13:34:18.550004 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 17 13:34:18.550004 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:18.550004 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:18.550004 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:18.550004 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:18.550004 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:18.550004 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:18.550004 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:34:18.550004 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:34:18.550004 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:34:18.550004 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:34:18.550004 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:34:18.550004 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:34:18.550004 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 17 13:34:18.550004 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 17 13:34:18.550004 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Oct 17 13:34:18.550004 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:18.550004 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:18.550004 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:18.550004 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:18.552266 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:18.552266 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:18.552266 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:34:18.552266 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:34:18.552266 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Oct 17 13:34:18.552266 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:18.552266 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-913647d2-8edd-4b01-bc5d-0abef2c63a07 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:34:18.552266 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-913647d2-8edd-4b01-bc5d-0abef2c63a07 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.063453 Oct 17 13:34:18.552266 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 156/316] 10.222.0.79 () {60 vars in 1194 bytes} [Mon Oct 17 13:34:18 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 17 13:34:18.555521 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-605acbe4-c94f-47d4-a6f7-a4f77165c626 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:18.587547 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-605acbe4-c94f-47d4-a6f7-a4f77165c626 tempest-AggregatesAdminNegativeTestJSON-246963748 tempest-AggregatesAdminNegativeTestJSON-246963748-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.038641 Oct 17 13:34:18.591214 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 157/317] 10.222.0.79 () {58 vars in 1155 bytes} [Mon Oct 17 13:34:18 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 13:34:18.952578 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6096011e-311b-4ff3-a455-f8332c1c8bfb tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ca1489f0084089a47d0cfc2ad37940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a297ddf04b4b18ae7591e107e84d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:18.963641 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e314f3f2-c4e9-433f-83a0-5603c800a09a tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:18.964253 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e314f3f2-c4e9-433f-83a0-5603c800a09a tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] [instance: 12e5e9fe-b998-450c-94b0-492a92bb6027] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:18.976807 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6096011e-311b-4ff3-a455-f8332c1c8bfb tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] 10.222.0.79 "GET /compute/v2.1/servers/00b0dfe0-2c88-4037-830f-4144190da935" status: 200 len: 1319 microversion: 2.1 time: 0.731638 Oct 17 13:34:18.977424 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 161/318] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:18 2022] GET /compute/v2.1/servers/00b0dfe0-2c88-4037-830f-4144190da935 => generated 1319 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:34:18.986981 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e314f3f2-c4e9-433f-83a0-5603c800a09a tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:18.987568 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e314f3f2-c4e9-433f-83a0-5603c800a09a tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:18.988012 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e314f3f2-c4e9-433f-83a0-5603c800a09a tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:18.988756 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e314f3f2-c4e9-433f-83a0-5603c800a09a tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:18.989221 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e314f3f2-c4e9-433f-83a0-5603c800a09a tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:18.989625 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e314f3f2-c4e9-433f-83a0-5603c800a09a tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:19.931330 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e314f3f2-c4e9-433f-83a0-5603c800a09a tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e836340278b49f593350249132b9cfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550b2bda88024756abc4134365842d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:19.940060 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e314f3f2-c4e9-433f-83a0-5603c800a09a tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] 10.222.0.79 "GET /compute/v2.1/servers/12e5e9fe-b998-450c-94b0-492a92bb6027" status: 200 len: 1389 microversion: 2.1 time: 0.980894 Oct 17 13:34:19.961534 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 158/319] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:18 2022] GET /compute/v2.1/servers/12e5e9fe-b998-450c-94b0-492a92bb6027 => generated 1389 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:34:20.002543 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f57e68e4-0874-4f83-a24a-296a6efa04b4 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:20.003348 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f57e68e4-0874-4f83-a24a-296a6efa04b4 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] [instance: 00b0dfe0-2c88-4037-830f-4144190da935] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:20.012013 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f57e68e4-0874-4f83-a24a-296a6efa04b4 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:20.015121 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f57e68e4-0874-4f83-a24a-296a6efa04b4 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:20.015717 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f57e68e4-0874-4f83-a24a-296a6efa04b4 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:20.016540 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f57e68e4-0874-4f83-a24a-296a6efa04b4 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:20.018402 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f57e68e4-0874-4f83-a24a-296a6efa04b4 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:20.018948 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f57e68e4-0874-4f83-a24a-296a6efa04b4 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:20.559143 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f57e68e4-0874-4f83-a24a-296a6efa04b4 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ca1489f0084089a47d0cfc2ad37940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a297ddf04b4b18ae7591e107e84d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:20.574125 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f57e68e4-0874-4f83-a24a-296a6efa04b4 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] 10.222.0.79 "GET /compute/v2.1/servers/00b0dfe0-2c88-4037-830f-4144190da935" status: 200 len: 1319 microversion: 2.1 time: 0.576305 Oct 17 13:34:20.575762 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 162/320] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:19 2022] GET /compute/v2.1/servers/00b0dfe0-2c88-4037-830f-4144190da935 => generated 1319 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:20.968929 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e89df89b-419f-4d93-b157-61521ee9a1cc tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:20.970315 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e89df89b-419f-4d93-b157-61521ee9a1cc tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] [instance: 12e5e9fe-b998-450c-94b0-492a92bb6027] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:20.993142 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e89df89b-419f-4d93-b157-61521ee9a1cc tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:20.993142 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e89df89b-419f-4d93-b157-61521ee9a1cc tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:20.993581 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e89df89b-419f-4d93-b157-61521ee9a1cc tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:20.994377 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e89df89b-419f-4d93-b157-61521ee9a1cc tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:20.994864 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e89df89b-419f-4d93-b157-61521ee9a1cc tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:20.995294 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e89df89b-419f-4d93-b157-61521ee9a1cc tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:21.277189 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e89df89b-419f-4d93-b157-61521ee9a1cc tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e836340278b49f593350249132b9cfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550b2bda88024756abc4134365842d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:21.288242 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e89df89b-419f-4d93-b157-61521ee9a1cc tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] 10.222.0.79 "GET /compute/v2.1/servers/12e5e9fe-b998-450c-94b0-492a92bb6027" status: 200 len: 1389 microversion: 2.1 time: 0.323422 Oct 17 13:34:21.305368 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 159/321] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:20 2022] GET /compute/v2.1/servers/12e5e9fe-b998-450c-94b0-492a92bb6027 => generated 1389 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:21.610518 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6e2f2faf-ce2a-490a-9957-390580d1833d tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:21.615506 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6e2f2faf-ce2a-490a-9957-390580d1833d tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] [instance: 00b0dfe0-2c88-4037-830f-4144190da935] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:21.649781 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6e2f2faf-ce2a-490a-9957-390580d1833d tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:21.653648 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6e2f2faf-ce2a-490a-9957-390580d1833d tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:21.657256 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6e2f2faf-ce2a-490a-9957-390580d1833d tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:21.659807 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6e2f2faf-ce2a-490a-9957-390580d1833d tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:21.662395 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6e2f2faf-ce2a-490a-9957-390580d1833d tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:21.663145 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6e2f2faf-ce2a-490a-9957-390580d1833d tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:21.759551 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-220e77cd-5d1a-4fcb-b6f5-522ca8b681d8 req-0080f8bd-9f5a-49b2-8fc5-cd2bad89ddb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12e5e9fe-b998-450c-94b0-492a92bb6027", "name": "network-vif-plugged", "status": "completed", "tag": "413fff83-bb2f-4562-8868-2061337233c1"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:21.823807 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-220e77cd-5d1a-4fcb-b6f5-522ca8b681d8 req-0080f8bd-9f5a-49b2-8fc5-cd2bad89ddb4 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:21.825243 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-220e77cd-5d1a-4fcb-b6f5-522ca8b681d8 req-0080f8bd-9f5a-49b2-8fc5-cd2bad89ddb4 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:21.825976 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-220e77cd-5d1a-4fcb-b6f5-522ca8b681d8 req-0080f8bd-9f5a-49b2-8fc5-cd2bad89ddb4 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:21.873970 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-220e77cd-5d1a-4fcb-b6f5-522ca8b681d8 req-0080f8bd-9f5a-49b2-8fc5-cd2bad89ddb4 service nova] Creating event network-vif-plugged:413fff83-bb2f-4562-8868-2061337233c1 for instance 12e5e9fe-b998-450c-94b0-492a92bb6027 on n-h1-854247-14 Oct 17 13:34:21.898723 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-220e77cd-5d1a-4fcb-b6f5-522ca8b681d8 req-0080f8bd-9f5a-49b2-8fc5-cd2bad89ddb4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148730 Oct 17 13:34:21.903373 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 160/322] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:22.313523 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-91059e4f-08cc-4039-8a50-2421b985b3c4 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:22.314228 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-91059e4f-08cc-4039-8a50-2421b985b3c4 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] [instance: 12e5e9fe-b998-450c-94b0-492a92bb6027] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:22.326265 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-91059e4f-08cc-4039-8a50-2421b985b3c4 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:22.327334 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-91059e4f-08cc-4039-8a50-2421b985b3c4 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:22.328661 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-91059e4f-08cc-4039-8a50-2421b985b3c4 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:22.331005 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-91059e4f-08cc-4039-8a50-2421b985b3c4 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:22.337660 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-91059e4f-08cc-4039-8a50-2421b985b3c4 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:22.341701 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-91059e4f-08cc-4039-8a50-2421b985b3c4 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:22.858944 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6e2f2faf-ce2a-490a-9957-390580d1833d tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ca1489f0084089a47d0cfc2ad37940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a297ddf04b4b18ae7591e107e84d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:22.870152 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6e2f2faf-ce2a-490a-9957-390580d1833d tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] 10.222.0.79 "GET /compute/v2.1/servers/00b0dfe0-2c88-4037-830f-4144190da935" status: 200 len: 1319 microversion: 2.1 time: 1.274753 Oct 17 13:34:22.873688 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 163/323] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:21 2022] GET /compute/v2.1/servers/00b0dfe0-2c88-4037-830f-4144190da935 => generated 1319 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:23.023689 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-91059e4f-08cc-4039-8a50-2421b985b3c4 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e836340278b49f593350249132b9cfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550b2bda88024756abc4134365842d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:23.033680 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-91059e4f-08cc-4039-8a50-2421b985b3c4 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] 10.222.0.79 "GET /compute/v2.1/servers/12e5e9fe-b998-450c-94b0-492a92bb6027" status: 200 len: 1389 microversion: 2.1 time: 0.725830 Oct 17 13:34:23.043754 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 161/324] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:22 2022] GET /compute/v2.1/servers/12e5e9fe-b998-450c-94b0-492a92bb6027 => generated 1389 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:34:23.898610 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-43481295-7e92-438e-957c-b491a5b0f527 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:23.900320 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-43481295-7e92-438e-957c-b491a5b0f527 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] [instance: 00b0dfe0-2c88-4037-830f-4144190da935] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:23.908091 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-43481295-7e92-438e-957c-b491a5b0f527 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:23.908836 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-43481295-7e92-438e-957c-b491a5b0f527 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:23.909494 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-43481295-7e92-438e-957c-b491a5b0f527 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:23.910529 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-43481295-7e92-438e-957c-b491a5b0f527 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:23.910989 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-43481295-7e92-438e-957c-b491a5b0f527 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:23.911467 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-43481295-7e92-438e-957c-b491a5b0f527 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:23.932790 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-e4334fa2-6e95-4378-bb89-59b3c08e4170 req-079961a1-65f3-4877-9db4-95461b945b69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00b0dfe0-2c88-4037-830f-4144190da935", "name": "network-vif-plugged", "status": "completed", "tag": "29478579-1d21-4c52-a447-0234ccc5dbd4"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:23.951461 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-e4334fa2-6e95-4378-bb89-59b3c08e4170 req-079961a1-65f3-4877-9db4-95461b945b69 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:23.952446 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-e4334fa2-6e95-4378-bb89-59b3c08e4170 req-079961a1-65f3-4877-9db4-95461b945b69 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:23.955027 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-e4334fa2-6e95-4378-bb89-59b3c08e4170 req-079961a1-65f3-4877-9db4-95461b945b69 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:23.976559 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-e4334fa2-6e95-4378-bb89-59b3c08e4170 req-079961a1-65f3-4877-9db4-95461b945b69 service nova] Creating event network-vif-plugged:29478579-1d21-4c52-a447-0234ccc5dbd4 for instance 00b0dfe0-2c88-4037-830f-4144190da935 on n-h1-854247-14 Oct 17 13:34:23.994483 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-e4334fa2-6e95-4378-bb89-59b3c08e4170 req-079961a1-65f3-4877-9db4-95461b945b69 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063931 Oct 17 13:34:23.995644 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 162/325] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:34:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:24.061648 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5a0c283e-bc1f-4bb7-a735-1641165a212e tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:24.062356 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5a0c283e-bc1f-4bb7-a735-1641165a212e tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] [instance: 12e5e9fe-b998-450c-94b0-492a92bb6027] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:24.078443 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5a0c283e-bc1f-4bb7-a735-1641165a212e tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:24.078939 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5a0c283e-bc1f-4bb7-a735-1641165a212e tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:24.079410 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5a0c283e-bc1f-4bb7-a735-1641165a212e tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:24.085239 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5a0c283e-bc1f-4bb7-a735-1641165a212e tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:24.088114 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5a0c283e-bc1f-4bb7-a735-1641165a212e tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:24.088991 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5a0c283e-bc1f-4bb7-a735-1641165a212e tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:24.204891 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-43481295-7e92-438e-957c-b491a5b0f527 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ca1489f0084089a47d0cfc2ad37940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a297ddf04b4b18ae7591e107e84d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:24.214703 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-43481295-7e92-438e-957c-b491a5b0f527 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] 10.222.0.79 "GET /compute/v2.1/servers/00b0dfe0-2c88-4037-830f-4144190da935" status: 200 len: 1319 microversion: 2.1 time: 0.320646 Oct 17 13:34:24.215336 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 164/326] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:23 2022] GET /compute/v2.1/servers/00b0dfe0-2c88-4037-830f-4144190da935 => generated 1319 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:24.340743 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5a0c283e-bc1f-4bb7-a735-1641165a212e tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e836340278b49f593350249132b9cfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550b2bda88024756abc4134365842d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:24.349949 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5a0c283e-bc1f-4bb7-a735-1641165a212e tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] 10.222.0.79 "GET /compute/v2.1/servers/12e5e9fe-b998-450c-94b0-492a92bb6027" status: 200 len: 1389 microversion: 2.1 time: 0.293859 Oct 17 13:34:24.350839 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 163/327] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:24 2022] GET /compute/v2.1/servers/12e5e9fe-b998-450c-94b0-492a92bb6027 => generated 1389 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:34:24.952681 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=4 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:34:25.237876 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fe812e2c-63e8-485a-9402-f50f9b5c966a tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:25.238481 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-fe812e2c-63e8-485a-9402-f50f9b5c966a tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] [instance: 00b0dfe0-2c88-4037-830f-4144190da935] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:25.249865 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe812e2c-63e8-485a-9402-f50f9b5c966a tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:25.250384 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe812e2c-63e8-485a-9402-f50f9b5c966a tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:25.250796 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe812e2c-63e8-485a-9402-f50f9b5c966a tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:25.251635 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe812e2c-63e8-485a-9402-f50f9b5c966a tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:25.252172 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe812e2c-63e8-485a-9402-f50f9b5c966a tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:25.252809 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe812e2c-63e8-485a-9402-f50f9b5c966a tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:25.571428 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fe812e2c-63e8-485a-9402-f50f9b5c966a tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ca1489f0084089a47d0cfc2ad37940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a297ddf04b4b18ae7591e107e84d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:25.585696 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fe812e2c-63e8-485a-9402-f50f9b5c966a tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] 10.222.0.79 "GET /compute/v2.1/servers/00b0dfe0-2c88-4037-830f-4144190da935" status: 200 len: 1319 microversion: 2.1 time: 0.351386 Oct 17 13:34:25.586915 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 164/328] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:25 2022] GET /compute/v2.1/servers/00b0dfe0-2c88-4037-830f-4144190da935 => generated 1319 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:25.610373 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d6de7755-6ac2-40cd-b298-2fe61aebb9ca tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:25.611442 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d6de7755-6ac2-40cd-b298-2fe61aebb9ca tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] [instance: 12e5e9fe-b998-450c-94b0-492a92bb6027] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:25.621042 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d6de7755-6ac2-40cd-b298-2fe61aebb9ca tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:25.621774 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d6de7755-6ac2-40cd-b298-2fe61aebb9ca tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:25.622389 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d6de7755-6ac2-40cd-b298-2fe61aebb9ca tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:25.625500 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d6de7755-6ac2-40cd-b298-2fe61aebb9ca tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:25.626793 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d6de7755-6ac2-40cd-b298-2fe61aebb9ca tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:25.627499 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d6de7755-6ac2-40cd-b298-2fe61aebb9ca tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:25.652752 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-76c31d42-55c3-4651-b4ab-7ebc92006139 tempest-HypervisorAdminV253TestBase-108715193 tempest-HypervisorAdminV253TestBase-108715193-project-admin] Calling method '.version_select at 0x7f7cd66d4670>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:25.657478 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-76c31d42-55c3-4651-b4ab-7ebc92006139 tempest-HypervisorAdminV253TestBase-108715193 tempest-HypervisorAdminV253TestBase-108715193-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:25.662555 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-76c31d42-55c3-4651-b4ab-7ebc92006139 tempest-HypervisorAdminV253TestBase-108715193 tempest-HypervisorAdminV253TestBase-108715193-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:25.665584 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-76c31d42-55c3-4651-b4ab-7ebc92006139 tempest-HypervisorAdminV253TestBase-108715193 tempest-HypervisorAdminV253TestBase-108715193-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:25.715781 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-76c31d42-55c3-4651-b4ab-7ebc92006139 tempest-HypervisorAdminV253TestBase-108715193 tempest-HypervisorAdminV253TestBase-108715193-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:25.716273 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-76c31d42-55c3-4651-b4ab-7ebc92006139 tempest-HypervisorAdminV253TestBase-108715193 tempest-HypervisorAdminV253TestBase-108715193-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:25.718364 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-76c31d42-55c3-4651-b4ab-7ebc92006139 tempest-HypervisorAdminV253TestBase-108715193 tempest-HypervisorAdminV253TestBase-108715193-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:25.744388 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-76c31d42-55c3-4651-b4ab-7ebc92006139 tempest-HypervisorAdminV253TestBase-108715193 tempest-HypervisorAdminV253TestBase-108715193-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:25.745359 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-76c31d42-55c3-4651-b4ab-7ebc92006139 tempest-HypervisorAdminV253TestBase-108715193 tempest-HypervisorAdminV253TestBase-108715193-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:25.745947 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-76c31d42-55c3-4651-b4ab-7ebc92006139 tempest-HypervisorAdminV253TestBase-108715193 tempest-HypervisorAdminV253TestBase-108715193-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:25.766881 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-76c31d42-55c3-4651-b4ab-7ebc92006139 tempest-HypervisorAdminV253TestBase-108715193 tempest-HypervisorAdminV253TestBase-108715193-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:25.768072 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-76c31d42-55c3-4651-b4ab-7ebc92006139 tempest-HypervisorAdminV253TestBase-108715193 tempest-HypervisorAdminV253TestBase-108715193-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:25.768877 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-76c31d42-55c3-4651-b4ab-7ebc92006139 tempest-HypervisorAdminV253TestBase-108715193 tempest-HypervisorAdminV253TestBase-108715193-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:25.807669 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-76c31d42-55c3-4651-b4ab-7ebc92006139 tempest-HypervisorAdminV253TestBase-108715193 tempest-HypervisorAdminV253TestBase-108715193-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:25.809381 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-76c31d42-55c3-4651-b4ab-7ebc92006139 tempest-HypervisorAdminV253TestBase-108715193 tempest-HypervisorAdminV253TestBase-108715193-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:25.810024 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-76c31d42-55c3-4651-b4ab-7ebc92006139 tempest-HypervisorAdminV253TestBase-108715193 tempest-HypervisorAdminV253TestBase-108715193-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:25.825581 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-76c31d42-55c3-4651-b4ab-7ebc92006139 tempest-HypervisorAdminV253TestBase-108715193 tempest-HypervisorAdminV253TestBase-108715193-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1747 microversion: 2.53 time: 0.890967 Oct 17 13:34:25.829189 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 165/329] 10.222.0.79 () {60 vars in 1243 bytes} [Mon Oct 17 13:34:24 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1747 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:34:25.847576 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a78ef8e7-4959-4a4c-9c6e-5eab668e8de2 tempest-HypervisorAdminV253TestBase-108715193 tempest-HypervisorAdminV253TestBase-108715193-project-admin] Calling method '.version_select at 0x7f7cd605f430>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:25.856790 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a78ef8e7-4959-4a4c-9c6e-5eab668e8de2 tempest-HypervisorAdminV253TestBase-108715193 tempest-HypervisorAdminV253TestBase-108715193-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:25.859047 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a78ef8e7-4959-4a4c-9c6e-5eab668e8de2 tempest-HypervisorAdminV253TestBase-108715193 tempest-HypervisorAdminV253TestBase-108715193-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:25.859675 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a78ef8e7-4959-4a4c-9c6e-5eab668e8de2 tempest-HypervisorAdminV253TestBase-108715193 tempest-HypervisorAdminV253TestBase-108715193-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:25.879757 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d6de7755-6ac2-40cd-b298-2fe61aebb9ca tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e836340278b49f593350249132b9cfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550b2bda88024756abc4134365842d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:25.888943 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d6de7755-6ac2-40cd-b298-2fe61aebb9ca tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] 10.222.0.79 "GET /compute/v2.1/servers/12e5e9fe-b998-450c-94b0-492a92bb6027" status: 200 len: 1588 microversion: 2.1 time: 0.298277 Oct 17 13:34:25.889969 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 165/330] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:25 2022] GET /compute/v2.1/servers/12e5e9fe-b998-450c-94b0-492a92bb6027 => generated 1588 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:25.894887 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a78ef8e7-4959-4a4c-9c6e-5eab668e8de2 tempest-HypervisorAdminV253TestBase-108715193 tempest-HypervisorAdminV253TestBase-108715193-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:25.898213 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a78ef8e7-4959-4a4c-9c6e-5eab668e8de2 tempest-HypervisorAdminV253TestBase-108715193 tempest-HypervisorAdminV253TestBase-108715193-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:25.898877 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a78ef8e7-4959-4a4c-9c6e-5eab668e8de2 tempest-HypervisorAdminV253TestBase-108715193 tempest-HypervisorAdminV253TestBase-108715193-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:25.913925 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8731c7bf-0551-44b9-9cb8-ad4d8b290da2 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:25.914780 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8731c7bf-0551-44b9-9cb8-ad4d8b290da2 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] [instance: 12e5e9fe-b998-450c-94b0-492a92bb6027] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:25.925246 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8731c7bf-0551-44b9-9cb8-ad4d8b290da2 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:25.927728 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8731c7bf-0551-44b9-9cb8-ad4d8b290da2 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:25.928628 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a78ef8e7-4959-4a4c-9c6e-5eab668e8de2 tempest-HypervisorAdminV253TestBase-108715193 tempest-HypervisorAdminV253TestBase-108715193-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:25.929507 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8731c7bf-0551-44b9-9cb8-ad4d8b290da2 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:25.930859 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a78ef8e7-4959-4a4c-9c6e-5eab668e8de2 tempest-HypervisorAdminV253TestBase-108715193 tempest-HypervisorAdminV253TestBase-108715193-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:25.931463 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8731c7bf-0551-44b9-9cb8-ad4d8b290da2 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:25.932132 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a78ef8e7-4959-4a4c-9c6e-5eab668e8de2 tempest-HypervisorAdminV253TestBase-108715193 tempest-HypervisorAdminV253TestBase-108715193-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:25.935333 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8731c7bf-0551-44b9-9cb8-ad4d8b290da2 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:25.936101 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8731c7bf-0551-44b9-9cb8-ad4d8b290da2 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:25.936919 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=65,nova_cell0:UPDATE=7 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:34:25.957890 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a78ef8e7-4959-4a4c-9c6e-5eab668e8de2 tempest-HypervisorAdminV253TestBase-108715193 tempest-HypervisorAdminV253TestBase-108715193-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:25.960934 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a78ef8e7-4959-4a4c-9c6e-5eab668e8de2 tempest-HypervisorAdminV253TestBase-108715193 tempest-HypervisorAdminV253TestBase-108715193-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:25.961544 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a78ef8e7-4959-4a4c-9c6e-5eab668e8de2 tempest-HypervisorAdminV253TestBase-108715193 tempest-HypervisorAdminV253TestBase-108715193-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:26.010392 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a78ef8e7-4959-4a4c-9c6e-5eab668e8de2 tempest-HypervisorAdminV253TestBase-108715193 tempest-HypervisorAdminV253TestBase-108715193-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:26.010986 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a78ef8e7-4959-4a4c-9c6e-5eab668e8de2 tempest-HypervisorAdminV253TestBase-108715193 tempest-HypervisorAdminV253TestBase-108715193-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:26.013044 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a78ef8e7-4959-4a4c-9c6e-5eab668e8de2 tempest-HypervisorAdminV253TestBase-108715193 tempest-HypervisorAdminV253TestBase-108715193-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:26.026688 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a78ef8e7-4959-4a4c-9c6e-5eab668e8de2 tempest-HypervisorAdminV253TestBase-108715193 tempest-HypervisorAdminV253TestBase-108715193-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 438 microversion: 2.53 time: 0.185075 Oct 17 13:34:26.027488 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 166/331] 10.222.0.79 () {60 vars in 1222 bytes} [Mon Oct 17 13:34:25 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 438 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 13:34:26.040401 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d9455c19-3ab9-4e44-8d0c-ab751870edd0 tempest-HypervisorAdminV253TestBase-108715193 tempest-HypervisorAdminV253TestBase-108715193-project-admin] Calling method '.version_select at 0x7f7cd6064550>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:26.045427 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d9455c19-3ab9-4e44-8d0c-ab751870edd0 tempest-HypervisorAdminV253TestBase-108715193 tempest-HypervisorAdminV253TestBase-108715193-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:26.046227 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d9455c19-3ab9-4e44-8d0c-ab751870edd0 tempest-HypervisorAdminV253TestBase-108715193 tempest-HypervisorAdminV253TestBase-108715193-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:26.046935 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d9455c19-3ab9-4e44-8d0c-ab751870edd0 tempest-HypervisorAdminV253TestBase-108715193 tempest-HypervisorAdminV253TestBase-108715193-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:26.085220 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d9455c19-3ab9-4e44-8d0c-ab751870edd0 tempest-HypervisorAdminV253TestBase-108715193 tempest-HypervisorAdminV253TestBase-108715193-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:26.086212 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d9455c19-3ab9-4e44-8d0c-ab751870edd0 tempest-HypervisorAdminV253TestBase-108715193 tempest-HypervisorAdminV253TestBase-108715193-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:26.086835 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d9455c19-3ab9-4e44-8d0c-ab751870edd0 tempest-HypervisorAdminV253TestBase-108715193 tempest-HypervisorAdminV253TestBase-108715193-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:26.100084 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d9455c19-3ab9-4e44-8d0c-ab751870edd0 tempest-HypervisorAdminV253TestBase-108715193 tempest-HypervisorAdminV253TestBase-108715193-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/d050eef5-88dc-4b42-9c43-3f4c10f8e871" status: 200 len: 793 microversion: 2.53 time: 0.064133 Oct 17 13:34:26.116626 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 167/332] 10.222.0.79 () {60 vars in 1298 bytes} [Mon Oct 17 13:34:26 2022] GET /compute/v2.1/os-hypervisors/d050eef5-88dc-4b42-9c43-3f4c10f8e871 => generated 793 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:34:26.210706 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8731c7bf-0551-44b9-9cb8-ad4d8b290da2 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] 10.222.0.79 "GET /compute/v2.1/servers/12e5e9fe-b998-450c-94b0-492a92bb6027/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.301011 Oct 17 13:34:26.211570 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 166/333] 10.222.0.79 () {58 vars in 1275 bytes} [Mon Oct 17 13:34:25 2022] GET /compute/v2.1/servers/12e5e9fe-b998-450c-94b0-492a92bb6027/os-interface => generated 285 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:34:26.609592 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b4113884-8dba-4fbb-b221-071481f9902b tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:26.610217 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b4113884-8dba-4fbb-b221-071481f9902b tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] [instance: 00b0dfe0-2c88-4037-830f-4144190da935] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:26.617366 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:34:26.619076 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b4113884-8dba-4fbb-b221-071481f9902b tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:26.619599 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b4113884-8dba-4fbb-b221-071481f9902b tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:26.628834 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b4113884-8dba-4fbb-b221-071481f9902b tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:26.630021 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b4113884-8dba-4fbb-b221-071481f9902b tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:26.632979 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b4113884-8dba-4fbb-b221-071481f9902b tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:26.633900 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b4113884-8dba-4fbb-b221-071481f9902b tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:27.329814 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b4113884-8dba-4fbb-b221-071481f9902b tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ca1489f0084089a47d0cfc2ad37940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a297ddf04b4b18ae7591e107e84d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:27.340866 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b4113884-8dba-4fbb-b221-071481f9902b tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] 10.222.0.79 "GET /compute/v2.1/servers/00b0dfe0-2c88-4037-830f-4144190da935" status: 200 len: 1469 microversion: 2.1 time: 0.735631 Oct 17 13:34:27.342097 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 168/334] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:26 2022] GET /compute/v2.1/servers/00b0dfe0-2c88-4037-830f-4144190da935 => generated 1469 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:28.168414 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cc59fc8f-e94e-41ae-9d9a-38a35224d05a tempest-LiveMigrationNegativeTest-1945319370 tempest-LiveMigrationNegativeTest-1945319370-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-522009967", "block_migration": true, "disk_over_commit": false}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:28.171612 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cc59fc8f-e94e-41ae-9d9a-38a35224d05a tempest-LiveMigrationNegativeTest-1945319370 tempest-LiveMigrationNegativeTest-1945319370-project-admin] [instance: 00b0dfe0-2c88-4037-830f-4144190da935] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:28.188955 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cc59fc8f-e94e-41ae-9d9a-38a35224d05a tempest-LiveMigrationNegativeTest-1945319370 tempest-LiveMigrationNegativeTest-1945319370-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:28.191323 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cc59fc8f-e94e-41ae-9d9a-38a35224d05a tempest-LiveMigrationNegativeTest-1945319370 tempest-LiveMigrationNegativeTest-1945319370-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:28.192680 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cc59fc8f-e94e-41ae-9d9a-38a35224d05a tempest-LiveMigrationNegativeTest-1945319370 tempest-LiveMigrationNegativeTest-1945319370-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:28.193667 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cc59fc8f-e94e-41ae-9d9a-38a35224d05a tempest-LiveMigrationNegativeTest-1945319370 tempest-LiveMigrationNegativeTest-1945319370-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:28.195221 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cc59fc8f-e94e-41ae-9d9a-38a35224d05a tempest-LiveMigrationNegativeTest-1945319370 tempest-LiveMigrationNegativeTest-1945319370-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:28.195727 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cc59fc8f-e94e-41ae-9d9a-38a35224d05a tempest-LiveMigrationNegativeTest-1945319370 tempest-LiveMigrationNegativeTest-1945319370-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:28.320164 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-cc59fc8f-e94e-41ae-9d9a-38a35224d05a tempest-LiveMigrationNegativeTest-1945319370 tempest-LiveMigrationNegativeTest-1945319370-project-admin] Lazy-loading 'flavor' on Instance uuid 00b0dfe0-2c88-4037-830f-4144190da935 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:34:28.378241 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cc59fc8f-e94e-41ae-9d9a-38a35224d05a tempest-LiveMigrationNegativeTest-1945319370 tempest-LiveMigrationNegativeTest-1945319370-project-admin] [instance: 00b0dfe0-2c88-4037-830f-4144190da935] Going to try to live migrate instance to tempest-host-522009967 {{(pid=127016) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 17 13:34:28.387668 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-cc59fc8f-e94e-41ae-9d9a-38a35224d05a tempest-LiveMigrationNegativeTest-1945319370 tempest-LiveMigrationNegativeTest-1945319370-project-admin] HTTP exception thrown: Compute host tempest-host-522009967 could not be found. Oct 17 13:34:28.392310 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cc59fc8f-e94e-41ae-9d9a-38a35224d05a tempest-LiveMigrationNegativeTest-1945319370 tempest-LiveMigrationNegativeTest-1945319370-project-admin] Request method failure captured: Oct 17 13:34:28.392310 n-d-854247-14 devstack@n-api.service[127016]: request: POST /compute/v2.1/servers/00b0dfe0-2c88-4037-830f-4144190da935/action HTTP/1.1 Oct 17 13:34:28.392310 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:34:28.392310 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:34:28.392310 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:34:28.392310 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 106 Oct 17 13:34:28.392310 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:34:28.392310 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:34:28.392310 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:34:28.392310 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:34:28.392310 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVnKAqFGZiyIvavH5YennIf8z1RcHY7tR7vO_BT1YdOopOREMPZcyL5nCgNv53xdZuvwWsUdeNoYWLZtMCf07w8IINfTYzeIS36JoWgV72d3g1KWgAATPiA4r7Ubi8PlRPSDEMjKnxLKAnxRPBFSks9eduowV_Y1Gb206RxTsEebSNA Oct 17 13:34:28.392310 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:34:28.392310 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:34:28.392310 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:34:28.392310 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:34:28.392310 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:34:28.392310 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:34:28.392310 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 9559b28086774d9c8a7cde45d41d7a64 Oct 17 13:34:28.392310 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-LiveMigrationNegativeTest-1945319370 Oct 17 13:34:28.392310 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member,admin Oct 17 13:34:28.392310 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member,admin Oct 17 13:34:28.393591 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9559b28086774d9c8a7cde45d41d7a64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/9559b28086774d9c8a7cde45d41d7a64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9559b28086774d9c8a7cde45d41d7a64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_9559b28086774d9c8a7cde45d41d7a64", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:34:28.393591 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-LiveMigrationNegativeTest-1945319370 Oct 17 13:34:28.393591 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 9559b28086774d9c8a7cde45d41d7a64 Oct 17 13:34:28.393591 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1945319370 Oct 17 13:34:28.393591 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-LiveMigrationNegativeTest-1945319370-project-admin Oct 17 13:34:28.393591 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:34:28.393591 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:34:28.393591 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 54fdea8daa80456e89ed049c76437543 Oct 17 13:34:28.393591 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-LiveMigrationNegativeTest-1945319370-project-admin Oct 17 13:34:28.393591 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:34:28.393591 n-d-854247-14 devstack@n-api.service[127016]: {"os-migrateLive": {"host": "tempest-host-522009967", "block_migration": true, "disk_over_commit": false}} Oct 17 13:34:28.393591 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:34:28.394304 n-d-854247-14 devstack@n-api.service[127016]: exception: Compute host tempest-host-522009967 could not be found. Oct 17 13:34:28.394304 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '00b0dfe0-2c88-4037-830f-4144190da935', 'body': {'os-migrateLive': {'host': 'tempest-host-522009967', 'block_migration': True, 'disk_over_commit': False}}} Oct 17 13:34:28.394304 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:34:28.394304 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:28.394304 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 17 13:34:28.394304 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 17 13:34:28.394304 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 17 13:34:28.394304 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:34:28.394304 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 17 13:34:28.394304 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 13:34:28.394304 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 17 13:34:28.394304 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 13:34:28.394304 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 17 13:34:28.394304 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 13:34:28.394304 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 17 13:34:28.394304 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 13:34:28.394304 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 17 13:34:28.394304 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 13:34:28.394304 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 13:34:28.396012 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:34:28.396012 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 17 13:34:28.396012 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 13:34:28.396012 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Oct 17 13:34:28.396012 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 17 13:34:28.396012 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:34:28.396012 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:34:28.396012 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 17 13:34:28.396012 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 17 13:34:28.396012 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 17 13:34:28.396012 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:34:28.396012 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 17 13:34:28.396012 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 17 13:34:28.396012 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 17 13:34:28.396012 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 17 13:34:28.396012 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 17 13:34:28.396012 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 17 13:34:28.396012 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-522009967 could not be found. Oct 17 13:34:28.396012 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:28.397085 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:28.397085 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:28.397085 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:28.397085 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:28.397085 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:28.397085 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:34:28.397085 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:34:28.397085 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:34:28.397085 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:34:28.397085 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:34:28.397085 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:34:28.397085 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:34:28.397085 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:34:28.397085 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:34:28.397085 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:34:28.397085 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 17 13:34:28.397085 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 17 13:34:28.397085 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 17 13:34:28.397085 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-522009967 could not be found. Oct 17 13:34:28.397085 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:28.398192 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:28.398192 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:28.398192 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:28.398192 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:28.398192 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:28.398192 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:34:28.398192 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:34:28.398192 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-522009967 could not be found. Oct 17 13:34:28.398192 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:28.400353 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cc59fc8f-e94e-41ae-9d9a-38a35224d05a tempest-LiveMigrationNegativeTest-1945319370 tempest-LiveMigrationNegativeTest-1945319370-project-admin] Returning 400 to user: Compute host tempest-host-522009967 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:34:28.401662 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cc59fc8f-e94e-41ae-9d9a-38a35224d05a tempest-LiveMigrationNegativeTest-1945319370 tempest-LiveMigrationNegativeTest-1945319370-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/00b0dfe0-2c88-4037-830f-4144190da935/action" status: 400 len: 99 microversion: 2.1 time: 1.037243 Oct 17 13:34:28.406690 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 167/335] 10.222.0.79 () {60 vars in 1279 bytes} [Mon Oct 17 13:34:27 2022] POST /compute/v2.1/servers/00b0dfe0-2c88-4037-830f-4144190da935/action => generated 99 bytes in 1043 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 17 13:34:28.412442 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b20edfcb-b9c9-4eb0-9532-96581730f1e4 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-730864790", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:28.518527 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-b20edfcb-b9c9-4eb0-9532-96581730f1e4 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] validate_networks() for None {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:34:28.521969 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=19 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:34:28.825148 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-bfcc4dc5-b369-490d-8048-9e18aace08cb tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1815082131", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:28.907975 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-bfcc4dc5-b369-490d-8048-9e18aace08cb tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] validate_networks() for None {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:34:29.235759 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-b20edfcb-b9c9-4eb0-9532-96581730f1e4 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:34:29.236307 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-b20edfcb-b9c9-4eb0-9532-96581730f1e4 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:34:29.236842 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-b20edfcb-b9c9-4eb0-9532-96581730f1e4 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:34:29.237580 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-b20edfcb-b9c9-4eb0-9532-96581730f1e4 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:34:29.238319 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-b20edfcb-b9c9-4eb0-9532-96581730f1e4 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:34:29.256219 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b20edfcb-b9c9-4eb0-9532-96581730f1e4 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:29.256954 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b20edfcb-b9c9-4eb0-9532-96581730f1e4 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:29.257698 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b20edfcb-b9c9-4eb0-9532-96581730f1e4 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:29.259198 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b20edfcb-b9c9-4eb0-9532-96581730f1e4 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:29.259933 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b20edfcb-b9c9-4eb0-9532-96581730f1e4 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:29.260359 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b20edfcb-b9c9-4eb0-9532-96581730f1e4 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:29.279367 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:DELETE=7,nova_api:SELECT=83,nova_api:INSERT=3,nova_api:UPDATE=7 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:34:29.293454 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-b20edfcb-b9c9-4eb0-9532-96581730f1e4 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Getting quotas for project 0bb83705372f45308cce206fb991c011. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:34:29.311412 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-b20edfcb-b9c9-4eb0-9532-96581730f1e4 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Getting quotas for user 0af22b1e15d34b558227dee66ffe5f40 and project 0bb83705372f45308cce206fb991c011. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:34:29.332981 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b20edfcb-b9c9-4eb0-9532-96581730f1e4 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:34:29.336535 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b20edfcb-b9c9-4eb0-9532-96581730f1e4 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] [instance: 9c273b0a-71a1-4d2a-9fd8-07f96dd506f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:34:29.416006 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b20edfcb-b9c9-4eb0-9532-96581730f1e4 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.782691 Oct 17 13:34:29.422691 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 169/336] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:34:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:34:29.422691 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f917a72e-0be0-4d29-a438-da540e43a694 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:29.423527 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f917a72e-0be0-4d29-a438-da540e43a694 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] [instance: 00b0dfe0-2c88-4037-830f-4144190da935] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:29.430026 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f917a72e-0be0-4d29-a438-da540e43a694 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:29.431199 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f917a72e-0be0-4d29-a438-da540e43a694 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:29.432326 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f917a72e-0be0-4d29-a438-da540e43a694 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:29.433443 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f917a72e-0be0-4d29-a438-da540e43a694 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:29.435723 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f917a72e-0be0-4d29-a438-da540e43a694 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:29.438519 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f917a72e-0be0-4d29-a438-da540e43a694 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:29.904001 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-bfcc4dc5-b369-490d-8048-9e18aace08cb tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:34:29.904989 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-bfcc4dc5-b369-490d-8048-9e18aace08cb tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:34:29.905617 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-bfcc4dc5-b369-490d-8048-9e18aace08cb tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:34:29.906484 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-bfcc4dc5-b369-490d-8048-9e18aace08cb tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:34:29.907151 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-bfcc4dc5-b369-490d-8048-9e18aace08cb tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:34:29.933824 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bfcc4dc5-b369-490d-8048-9e18aace08cb tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:29.934183 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bfcc4dc5-b369-490d-8048-9e18aace08cb tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:29.934608 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bfcc4dc5-b369-490d-8048-9e18aace08cb tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:29.935359 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bfcc4dc5-b369-490d-8048-9e18aace08cb tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:29.935807 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bfcc4dc5-b369-490d-8048-9e18aace08cb tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:29.936220 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bfcc4dc5-b369-490d-8048-9e18aace08cb tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:29.973815 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-bfcc4dc5-b369-490d-8048-9e18aace08cb tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Getting quotas for project 0b6aa32dd3904f6aaae1e63fcc67b0f7. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:34:29.984021 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-bfcc4dc5-b369-490d-8048-9e18aace08cb tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Getting quotas for user cf50aa8e899648418eace99975616e93 and project 0b6aa32dd3904f6aaae1e63fcc67b0f7. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:34:30.001312 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-bfcc4dc5-b369-490d-8048-9e18aace08cb tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:34:30.004105 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-bfcc4dc5-b369-490d-8048-9e18aace08cb tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] [instance: 0b3dc4f1-f80f-427f-908e-9272cd17af3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:34:30.117476 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-bfcc4dc5-b369-490d-8048-9e18aace08cb tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.709148 Oct 17 13:34:30.125455 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 168/337] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:34:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:34:30.295129 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f917a72e-0be0-4d29-a438-da540e43a694 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ca1489f0084089a47d0cfc2ad37940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a297ddf04b4b18ae7591e107e84d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:30.303343 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=100 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:34:30.309674 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f917a72e-0be0-4d29-a438-da540e43a694 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] 10.222.0.79 "GET /compute/v2.1/servers/00b0dfe0-2c88-4037-830f-4144190da935" status: 200 len: 1469 microversion: 2.1 time: 0.891169 Oct 17 13:34:30.316335 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 170/338] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:29 2022] GET /compute/v2.1/servers/00b0dfe0-2c88-4037-830f-4144190da935 => generated 1469 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:30.724684 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-38c6c02f-7aa3-40f2-ac1b-eb13bf4f9d8a tempest-AZAdminV2TestJSON-585973340 tempest-AZAdminV2TestJSON-585973340-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:30.727413 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-38c6c02f-7aa3-40f2-ac1b-eb13bf4f9d8a tempest-AZAdminV2TestJSON-585973340 tempest-AZAdminV2TestJSON-585973340-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:30.728335 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-38c6c02f-7aa3-40f2-ac1b-eb13bf4f9d8a tempest-AZAdminV2TestJSON-585973340 tempest-AZAdminV2TestJSON-585973340-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:30.729324 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-38c6c02f-7aa3-40f2-ac1b-eb13bf4f9d8a tempest-AZAdminV2TestJSON-585973340 tempest-AZAdminV2TestJSON-585973340-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:30.730275 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-38c6c02f-7aa3-40f2-ac1b-eb13bf4f9d8a tempest-AZAdminV2TestJSON-585973340 tempest-AZAdminV2TestJSON-585973340-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:30.731006 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-38c6c02f-7aa3-40f2-ac1b-eb13bf4f9d8a tempest-AZAdminV2TestJSON-585973340 tempest-AZAdminV2TestJSON-585973340-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:30.731649 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-38c6c02f-7aa3-40f2-ac1b-eb13bf4f9d8a tempest-AZAdminV2TestJSON-585973340 tempest-AZAdminV2TestJSON-585973340-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:30.779101 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-97d80d2a-b221-4373-8dab-901e0814f953 tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] Calling method '.version_select at 0x7f7cd6064550>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:30.779610 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-38c6c02f-7aa3-40f2-ac1b-eb13bf4f9d8a tempest-AZAdminV2TestJSON-585973340 tempest-AZAdminV2TestJSON-585973340-project-admin] 10.222.0.79 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.652822 Oct 17 13:34:30.780553 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 169/339] 10.222.0.79 () {58 vars in 1164 bytes} [Mon Oct 17 13:34:30 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:34:30.790069 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3f985ef7-a204-4819-a750-a18859325cae tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:30.793679 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3f985ef7-a204-4819-a750-a18859325cae tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] [instance: 9c273b0a-71a1-4d2a-9fd8-07f96dd506f7] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:30.809628 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3f985ef7-a204-4819-a750-a18859325cae tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:30.810379 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3f985ef7-a204-4819-a750-a18859325cae tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:30.812971 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3f985ef7-a204-4819-a750-a18859325cae tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:30.814088 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3f985ef7-a204-4819-a750-a18859325cae tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:30.815276 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3f985ef7-a204-4819-a750-a18859325cae tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:30.818712 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3f985ef7-a204-4819-a750-a18859325cae tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:31.031966 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3f985ef7-a204-4819-a750-a18859325cae tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af22b1e15d34b558227dee66ffe5f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb83705372f45308cce206fb991c011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:31.043967 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-97d80d2a-b221-4373-8dab-901e0814f953 tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/c42448d9b3844b278dacc22d4d7e0ab8" status: 200 len: 371 microversion: 2.1 time: 0.719412 Oct 17 13:34:31.045367 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3f985ef7-a204-4819-a750-a18859325cae tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] 10.222.0.79 "GET /compute/v2.1/servers/9c273b0a-71a1-4d2a-9fd8-07f96dd506f7" status: 200 len: 1265 microversion: 2.1 time: 0.263571 Oct 17 13:34:31.046342 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 171/340] 10.222.0.79 () {58 vars in 1242 bytes} [Mon Oct 17 13:34:30 2022] GET /compute/v2.1/os-quota-sets/c42448d9b3844b278dacc22d4d7e0ab8 => generated 371 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:31.048423 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 170/341] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:30 2022] GET /compute/v2.1/servers/9c273b0a-71a1-4d2a-9fd8-07f96dd506f7 => generated 1265 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:31.055379 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-70c05600-29ef-434c-a1d8-6a20919a008b tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:31.058557 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-82080499-9951-4edb-88c2-e177adf32a02 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:31.059480 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-82080499-9951-4edb-88c2-e177adf32a02 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] [instance: 0b3dc4f1-f80f-427f-908e-9272cd17af3b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:31.062943 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-70c05600-29ef-434c-a1d8-6a20919a008b tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] [instance: 12e5e9fe-b998-450c-94b0-492a92bb6027] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:31.078605 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-70c05600-29ef-434c-a1d8-6a20919a008b tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:31.079709 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-70c05600-29ef-434c-a1d8-6a20919a008b tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:31.081465 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-70c05600-29ef-434c-a1d8-6a20919a008b tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:31.083267 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-70c05600-29ef-434c-a1d8-6a20919a008b tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:31.085305 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-70c05600-29ef-434c-a1d8-6a20919a008b tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:31.085965 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-70c05600-29ef-434c-a1d8-6a20919a008b tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:31.110448 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=100 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:34:31.213075 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-82080499-9951-4edb-88c2-e177adf32a02 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf50aa8e899648418eace99975616e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6aa32dd3904f6aaae1e63fcc67b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:31.234620 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-82080499-9951-4edb-88c2-e177adf32a02 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] 10.222.0.79 "GET /compute/v2.1/servers/0b3dc4f1-f80f-427f-908e-9272cd17af3b" status: 200 len: 1220 microversion: 2.1 time: 0.187103 Oct 17 13:34:31.247207 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 172/342] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:31 2022] GET /compute/v2.1/servers/0b3dc4f1-f80f-427f-908e-9272cd17af3b => generated 1220 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:31.254399 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-78bfd29a-4213-4067-be03-64dfd263200d req-f26188a8-817f-42e8-a1ad-1bb2f942bbd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12e5e9fe-b998-450c-94b0-492a92bb6027", "tag": "413fff83-bb2f-4562-8868-2061337233c1"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:31.280789 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-78bfd29a-4213-4067-be03-64dfd263200d req-f26188a8-817f-42e8-a1ad-1bb2f942bbd2 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:31.283063 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-78bfd29a-4213-4067-be03-64dfd263200d req-f26188a8-817f-42e8-a1ad-1bb2f942bbd2 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:31.285333 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-78bfd29a-4213-4067-be03-64dfd263200d req-f26188a8-817f-42e8-a1ad-1bb2f942bbd2 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:31.317728 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-78bfd29a-4213-4067-be03-64dfd263200d req-f26188a8-817f-42e8-a1ad-1bb2f942bbd2 service nova] Creating event network-changed:413fff83-bb2f-4562-8868-2061337233c1 for instance 12e5e9fe-b998-450c-94b0-492a92bb6027 on n-h1-854247-14 Oct 17 13:34:31.329656 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-78bfd29a-4213-4067-be03-64dfd263200d req-f26188a8-817f-42e8-a1ad-1bb2f942bbd2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088967 Oct 17 13:34:31.331024 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 173/343] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:34:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:31.343604 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-030373bd-d778-4fab-9082-5ab2df9df9c8 tempest-AZAdminV2TestJSON-585973340 tempest-AZAdminV2TestJSON-585973340-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:31.352538 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-030373bd-d778-4fab-9082-5ab2df9df9c8 tempest-AZAdminV2TestJSON-585973340 tempest-AZAdminV2TestJSON-585973340-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:31.353384 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-030373bd-d778-4fab-9082-5ab2df9df9c8 tempest-AZAdminV2TestJSON-585973340 tempest-AZAdminV2TestJSON-585973340-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:31.354173 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-030373bd-d778-4fab-9082-5ab2df9df9c8 tempest-AZAdminV2TestJSON-585973340 tempest-AZAdminV2TestJSON-585973340-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:31.355365 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-030373bd-d778-4fab-9082-5ab2df9df9c8 tempest-AZAdminV2TestJSON-585973340 tempest-AZAdminV2TestJSON-585973340-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:31.359439 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-030373bd-d778-4fab-9082-5ab2df9df9c8 tempest-AZAdminV2TestJSON-585973340 tempest-AZAdminV2TestJSON-585973340-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:31.360069 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-030373bd-d778-4fab-9082-5ab2df9df9c8 tempest-AZAdminV2TestJSON-585973340 tempest-AZAdminV2TestJSON-585973340-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:31.415899 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-030373bd-d778-4fab-9082-5ab2df9df9c8 tempest-AZAdminV2TestJSON-585973340 tempest-AZAdminV2TestJSON-585973340-project-admin] 10.222.0.79 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.080749 Oct 17 13:34:31.417751 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 174/344] 10.222.0.79 () {58 vars in 1185 bytes} [Mon Oct 17 13:34:31 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:31.423417 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a245a0c1-5016-49e0-a466-a9aa7d247052 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1277827822", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:31.518124 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-a245a0c1-5016-49e0-a466-a9aa7d247052 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] validate_networks() for None {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:34:31.741818 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-70c05600-29ef-434c-a1d8-6a20919a008b tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e836340278b49f593350249132b9cfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550b2bda88024756abc4134365842d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:31.765202 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-70c05600-29ef-434c-a1d8-6a20919a008b tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] 10.222.0.79 "GET /compute/v2.1/servers/12e5e9fe-b998-450c-94b0-492a92bb6027" status: 200 len: 1588 microversion: 2.1 time: 0.715629 Oct 17 13:34:31.786111 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 171/345] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:31 2022] GET /compute/v2.1/servers/12e5e9fe-b998-450c-94b0-492a92bb6027 => generated 1588 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:31.802818 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-96d4e52e-9f0f-41ff-80e3-6159798f8b64 tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] Action: 'update', calling method: .version_select at 0x7f7cd5e1b040>, body: {"quota_set": {"ram": "5120"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:32.576975 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-96d4e52e-9f0f-41ff-80e3-6159798f8b64 tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:32.578366 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-96d4e52e-9f0f-41ff-80e3-6159798f8b64 tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:32.580136 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-96d4e52e-9f0f-41ff-80e3-6159798f8b64 tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:32.581110 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-96d4e52e-9f0f-41ff-80e3-6159798f8b64 tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:32.581849 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-96d4e52e-9f0f-41ff-80e3-6159798f8b64 tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:32.582527 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-96d4e52e-9f0f-41ff-80e3-6159798f8b64 tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:32.654127 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-96d4e52e-9f0f-41ff-80e3-6159798f8b64 tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-sets/c42448d9b3844b278dacc22d4d7e0ab8" status: 200 len: 328 microversion: 2.1 time: 0.860047 Oct 17 13:34:32.673114 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 172/346] 10.222.0.79 () {60 vars in 1262 bytes} [Mon Oct 17 13:34:31 2022] PUT /compute/v2.1/os-quota-sets/c42448d9b3844b278dacc22d4d7e0ab8 => generated 328 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:32.681018 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f79bc02d-8943-4643-9e1e-2db77ca2f90e tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:32.682561 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f79bc02d-8943-4643-9e1e-2db77ca2f90e tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] [instance: 9c273b0a-71a1-4d2a-9fd8-07f96dd506f7] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:32.691409 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f79bc02d-8943-4643-9e1e-2db77ca2f90e tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:32.692641 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f79bc02d-8943-4643-9e1e-2db77ca2f90e tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:32.693251 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f79bc02d-8943-4643-9e1e-2db77ca2f90e tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:32.694119 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f79bc02d-8943-4643-9e1e-2db77ca2f90e tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:32.694733 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f79bc02d-8943-4643-9e1e-2db77ca2f90e tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:32.695378 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f79bc02d-8943-4643-9e1e-2db77ca2f90e tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:32.713505 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-a245a0c1-5016-49e0-a466-a9aa7d247052 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:34:32.715594 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-a245a0c1-5016-49e0-a466-a9aa7d247052 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:34:32.716266 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-a245a0c1-5016-49e0-a466-a9aa7d247052 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:34:32.716825 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-a245a0c1-5016-49e0-a466-a9aa7d247052 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:34:32.717392 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-a245a0c1-5016-49e0-a466-a9aa7d247052 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:34:32.737536 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a245a0c1-5016-49e0-a466-a9aa7d247052 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:32.739620 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a245a0c1-5016-49e0-a466-a9aa7d247052 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:32.743355 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a245a0c1-5016-49e0-a466-a9aa7d247052 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:32.745146 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a245a0c1-5016-49e0-a466-a9aa7d247052 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:32.746653 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a245a0c1-5016-49e0-a466-a9aa7d247052 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:32.747347 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a245a0c1-5016-49e0-a466-a9aa7d247052 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:32.792204 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-a245a0c1-5016-49e0-a466-a9aa7d247052 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Getting quotas for project a3a297ddf04b4b18ae7591e107e84d36. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:34:32.803145 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-a245a0c1-5016-49e0-a466-a9aa7d247052 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Getting quotas for user 44ca1489f0084089a47d0cfc2ad37940 and project a3a297ddf04b4b18ae7591e107e84d36. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:34:32.830412 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a245a0c1-5016-49e0-a466-a9aa7d247052 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:34:32.835852 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a245a0c1-5016-49e0-a466-a9aa7d247052 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] [instance: b88e31f9-509c-4944-9622-350312d2bac1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:34:32.923075 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a245a0c1-5016-49e0-a466-a9aa7d247052 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.503373 Oct 17 13:34:32.924685 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 175/347] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:34:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1506 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:34:32.935797 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-93086012-30f9-43c2-91b9-9b21cff42ea1 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:32.936417 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-93086012-30f9-43c2-91b9-9b21cff42ea1 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] [instance: 0b3dc4f1-f80f-427f-908e-9272cd17af3b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:32.944300 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-93086012-30f9-43c2-91b9-9b21cff42ea1 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:32.945630 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-93086012-30f9-43c2-91b9-9b21cff42ea1 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:32.946069 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-93086012-30f9-43c2-91b9-9b21cff42ea1 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:32.947139 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-93086012-30f9-43c2-91b9-9b21cff42ea1 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:32.947621 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-93086012-30f9-43c2-91b9-9b21cff42ea1 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:32.948095 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-93086012-30f9-43c2-91b9-9b21cff42ea1 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:33.282046 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f79bc02d-8943-4643-9e1e-2db77ca2f90e tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af22b1e15d34b558227dee66ffe5f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb83705372f45308cce206fb991c011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:33.294700 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f79bc02d-8943-4643-9e1e-2db77ca2f90e tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] 10.222.0.79 "GET /compute/v2.1/servers/9c273b0a-71a1-4d2a-9fd8-07f96dd506f7" status: 200 len: 1271 microversion: 2.1 time: 0.619174 Oct 17 13:34:33.311264 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 173/348] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:32 2022] GET /compute/v2.1/servers/9c273b0a-71a1-4d2a-9fd8-07f96dd506f7 => generated 1271 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:33.402824 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-93086012-30f9-43c2-91b9-9b21cff42ea1 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf50aa8e899648418eace99975616e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6aa32dd3904f6aaae1e63fcc67b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:33.432035 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-93086012-30f9-43c2-91b9-9b21cff42ea1 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] 10.222.0.79 "GET /compute/v2.1/servers/0b3dc4f1-f80f-427f-908e-9272cd17af3b" status: 200 len: 1278 microversion: 2.1 time: 0.504452 Oct 17 13:34:33.434619 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 176/349] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:32 2022] GET /compute/v2.1/servers/0b3dc4f1-f80f-427f-908e-9272cd17af3b => generated 1278 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:33.475255 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-cef8fe48-51ca-4ac3-9336-fa6a296436a4 tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:33.514212 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-cef8fe48-51ca-4ac3-9336-fa6a296436a4 tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-quota-sets/c42448d9b3844b278dacc22d4d7e0ab8" status: 202 len: 0 microversion: 2.1 time: 0.076226 Oct 17 13:34:33.516062 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 177/350] 10.222.0.79 () {58 vars in 1245 bytes} [Mon Oct 17 13:34:33 2022] DELETE /compute/v2.1/os-quota-sets/c42448d9b3844b278dacc22d4d7e0ab8 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:34:33.522719 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a009b3d7-c386-4f89-aa22-bd025181ab95 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:33.524042 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a009b3d7-c386-4f89-aa22-bd025181ab95 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] [instance: b88e31f9-509c-4944-9622-350312d2bac1] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:33.620855 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3f7f54d8-5649-4ffd-bb37-8119d46cbffe tempest-HypervisorAdminNegativeTestJSON-514381794 tempest-HypervisorAdminNegativeTestJSON-514381794-project] Calling method '.version_select at 0x7f7cd5e2a670>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:33.623791 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3f7f54d8-5649-4ffd-bb37-8119d46cbffe tempest-HypervisorAdminNegativeTestJSON-514381794 tempest-HypervisorAdminNegativeTestJSON-514381794-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '0fae69e2662b4c0980bf10c310bc7088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26ba68bf59a4f19aea4238797a47c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:33.628906 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3f7f54d8-5649-4ffd-bb37-8119d46cbffe tempest-HypervisorAdminNegativeTestJSON-514381794 tempest-HypervisorAdminNegativeTestJSON-514381794-project] Request method failure captured: Oct 17 13:34:33.628906 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 17 13:34:33.628906 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:34:33.628906 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:34:33.628906 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:34:33.628906 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:34:33.628906 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:34:33.628906 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:34:33.628906 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:34:33.628906 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:34:33.628906 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVnnVti5U8Vxe69sqD1SfqpbYiRMfvjqzH8DxOZdc1mL8zJTez16_EkckfrTMf_HBo6lt8y13qKE782lmGMUpjLeVE7UdJljtacG_bPi68MAvosnUgxpU3qWlKmhVZjYAc7c9Hys-F5naR_G6C-YYaKJt2fonMHyl2gMrAfSqm90O90 Oct 17 13:34:33.628906 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:34:33.628906 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:34:33.628906 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:34:33.628906 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:34:33.628906 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:34:33.628906 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:34:33.628906 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: d26ba68bf59a4f19aea4238797a47c22 Oct 17 13:34:33.628906 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-514381794 Oct 17 13:34:33.628906 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:34:33.628906 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:34:33.630195 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d26ba68bf59a4f19aea4238797a47c22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d26ba68bf59a4f19aea4238797a47c22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d26ba68bf59a4f19aea4238797a47c22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d26ba68bf59a4f19aea4238797a47c22", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:34:33.630195 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-514381794 Oct 17 13:34:33.630195 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: d26ba68bf59a4f19aea4238797a47c22 Oct 17 13:34:33.630195 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-514381794 Oct 17 13:34:33.630195 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-HypervisorAdminNegativeTestJSON-514381794-project Oct 17 13:34:33.630195 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:34:33.630195 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:34:33.630195 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 0fae69e2662b4c0980bf10c310bc7088 Oct 17 13:34:33.630195 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-514381794-project Oct 17 13:34:33.630195 n-d-854247-14 devstack@n-api.service[127016]: method: Oct 17 13:34:33.630195 n-d-854247-14 devstack@n-api.service[127016]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 17 13:34:33.630195 n-d-854247-14 devstack@n-api.service[127016]: action_args: {} Oct 17 13:34:33.630195 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:34:33.630967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:33.630967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:33.630967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:33.630967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:34:33.630967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:34:33.630967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:34:33.630967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:34:33.630967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:34:33.630967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:34:33.630967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 17 13:34:33.630967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 17 13:34:33.630967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 17 13:34:33.630967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 17 13:34:33.630967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:34:33.630967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:34:33.630967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:34:33.630967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:34:33.630967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:34:33.630967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:34:33.632592 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:34:33.632592 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:34:33.632592 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:34:33.632592 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:34:33.632592 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:34:33.632592 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:34:33.632592 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:34:33.632592 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:34:33.632592 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 17 13:34:33.632592 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:33.632592 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:33.632592 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:33.632592 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:33.632592 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:33.632592 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:33.632592 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:34:33.632592 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:34:33.632592 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 17 13:34:33.632592 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:33.636157 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3f7f54d8-5649-4ffd-bb37-8119d46cbffe tempest-HypervisorAdminNegativeTestJSON-514381794 tempest-HypervisorAdminNegativeTestJSON-514381794-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:34:33.637256 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3f7f54d8-5649-4ffd-bb37-8119d46cbffe tempest-HypervisorAdminNegativeTestJSON-514381794 tempest-HypervisorAdminNegativeTestJSON-514381794-project] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.335311 Oct 17 13:34:33.641395 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 174/351] 10.222.0.79 () {58 vars in 1167 bytes} [Mon Oct 17 13:34:33 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 340 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:34:33.651444 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-59a395d7-4c1d-4757-bdb0-0663da663fec tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] Calling method '.version_select at 0x7f7cd5eb4820>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:34.079079 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a009b3d7-c386-4f89-aa22-bd025181ab95 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ca1489f0084089a47d0cfc2ad37940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a297ddf04b4b18ae7591e107e84d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:34.088148 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a009b3d7-c386-4f89-aa22-bd025181ab95 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] 10.222.0.79 "GET /compute/v2.1/servers/b88e31f9-509c-4944-9622-350312d2bac1" status: 200 len: 1219 microversion: 2.1 time: 0.569355 Oct 17 13:34:34.104163 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 178/352] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:33 2022] GET /compute/v2.1/servers/b88e31f9-509c-4944-9622-350312d2bac1 => generated 1219 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:34.118086 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-51059823-5761-4ee0-941d-fe041d279742 tempest-HypervisorAdminNegativeTestJSON-514381794 tempest-HypervisorAdminNegativeTestJSON-514381794-project] Calling method '.version_select at 0x7f7cd5f19430>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:34.124824 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-51059823-5761-4ee0-941d-fe041d279742 tempest-HypervisorAdminNegativeTestJSON-514381794 tempest-HypervisorAdminNegativeTestJSON-514381794-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '0fae69e2662b4c0980bf10c310bc7088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26ba68bf59a4f19aea4238797a47c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:34.130784 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-51059823-5761-4ee0-941d-fe041d279742 tempest-HypervisorAdminNegativeTestJSON-514381794 tempest-HypervisorAdminNegativeTestJSON-514381794-project] Request method failure captured: Oct 17 13:34:34.130784 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 17 13:34:34.130784 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:34:34.130784 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:34:34.130784 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:34:34.130784 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:34:34.130784 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:34:34.130784 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:34:34.130784 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:34:34.130784 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:34:34.130784 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVnnVti5U8Vxe69sqD1SfqpbYiRMfvjqzH8DxOZdc1mL8zJTez16_EkckfrTMf_HBo6lt8y13qKE782lmGMUpjLeVE7UdJljtacG_bPi68MAvosnUgxpU3qWlKmhVZjYAc7c9Hys-F5naR_G6C-YYaKJt2fonMHyl2gMrAfSqm90O90 Oct 17 13:34:34.130784 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:34:34.130784 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:34:34.130784 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:34:34.130784 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:34:34.130784 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:34:34.130784 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:34:34.130784 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: d26ba68bf59a4f19aea4238797a47c22 Oct 17 13:34:34.130784 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-514381794 Oct 17 13:34:34.130784 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:34:34.130784 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:34:34.131961 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d26ba68bf59a4f19aea4238797a47c22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d26ba68bf59a4f19aea4238797a47c22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d26ba68bf59a4f19aea4238797a47c22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d26ba68bf59a4f19aea4238797a47c22", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:34:34.131961 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-514381794 Oct 17 13:34:34.131961 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: d26ba68bf59a4f19aea4238797a47c22 Oct 17 13:34:34.131961 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-514381794 Oct 17 13:34:34.131961 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-HypervisorAdminNegativeTestJSON-514381794-project Oct 17 13:34:34.131961 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:34:34.131961 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:34:34.131961 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 0fae69e2662b4c0980bf10c310bc7088 Oct 17 13:34:34.131961 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-514381794-project Oct 17 13:34:34.131961 n-d-854247-14 devstack@n-api.service[127017]: method: Oct 17 13:34:34.131961 n-d-854247-14 devstack@n-api.service[127017]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 17 13:34:34.131961 n-d-854247-14 devstack@n-api.service[127017]: action_args: {} Oct 17 13:34:34.131961 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:34:34.132664 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:34.132664 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:34.132664 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:34.132664 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:34:34.132664 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:34:34.132664 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:34:34.132664 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:34:34.132664 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:34:34.132664 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:34:34.132664 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 17 13:34:34.132664 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 17 13:34:34.132664 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 17 13:34:34.132664 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 17 13:34:34.132664 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:34:34.132664 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:34:34.132664 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:34:34.132664 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:34:34.132664 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:34:34.132664 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:34:34.133666 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:34:34.133666 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:34:34.133666 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:34:34.133666 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:34:34.133666 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:34:34.133666 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:34:34.133666 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:34:34.133666 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:34:34.133666 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 17 13:34:34.133666 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:34.133666 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:34.133666 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:34.133666 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:34.133666 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:34.133666 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:34.133666 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:34:34.133666 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:34:34.133666 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 17 13:34:34.133666 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:34.139393 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-51059823-5761-4ee0-941d-fe041d279742 tempest-HypervisorAdminNegativeTestJSON-514381794 tempest-HypervisorAdminNegativeTestJSON-514381794-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:34:34.140571 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-51059823-5761-4ee0-941d-fe041d279742 tempest-HypervisorAdminNegativeTestJSON-514381794 tempest-HypervisorAdminNegativeTestJSON-514381794-project] 10.222.0.79 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.032059 Oct 17 13:34:34.146168 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 179/353] 10.222.0.79 () {58 vars in 1146 bytes} [Mon Oct 17 13:34:34 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 41 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:34:34.160037 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-686a0fd6-c86e-4fec-af48-f4e468f24041 tempest-HypervisorAdminNegativeTestJSON-514381794 tempest-HypervisorAdminNegativeTestJSON-514381794-project] Calling method '.version_select at 0x7f7cd61e3ee0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:34.165969 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-686a0fd6-c86e-4fec-af48-f4e468f24041 tempest-HypervisorAdminNegativeTestJSON-514381794 tempest-HypervisorAdminNegativeTestJSON-514381794-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '0fae69e2662b4c0980bf10c310bc7088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26ba68bf59a4f19aea4238797a47c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:34.170385 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-686a0fd6-c86e-4fec-af48-f4e468f24041 tempest-HypervisorAdminNegativeTestJSON-514381794 tempest-HypervisorAdminNegativeTestJSON-514381794-project] Request method failure captured: Oct 17 13:34:34.170385 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 17 13:34:34.170385 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:34:34.170385 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:34:34.170385 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:34:34.170385 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:34:34.170385 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:34:34.170385 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:34:34.170385 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:34:34.170385 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:34:34.170385 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVnnVti5U8Vxe69sqD1SfqpbYiRMfvjqzH8DxOZdc1mL8zJTez16_EkckfrTMf_HBo6lt8y13qKE782lmGMUpjLeVE7UdJljtacG_bPi68MAvosnUgxpU3qWlKmhVZjYAc7c9Hys-F5naR_G6C-YYaKJt2fonMHyl2gMrAfSqm90O90 Oct 17 13:34:34.170385 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:34:34.170385 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:34:34.170385 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:34:34.170385 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:34:34.170385 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:34:34.170385 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:34:34.170385 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: d26ba68bf59a4f19aea4238797a47c22 Oct 17 13:34:34.170385 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-514381794 Oct 17 13:34:34.170385 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:34:34.170385 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:34:34.171794 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d26ba68bf59a4f19aea4238797a47c22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d26ba68bf59a4f19aea4238797a47c22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d26ba68bf59a4f19aea4238797a47c22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d26ba68bf59a4f19aea4238797a47c22", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:34:34.171794 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-514381794 Oct 17 13:34:34.171794 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: d26ba68bf59a4f19aea4238797a47c22 Oct 17 13:34:34.171794 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-514381794 Oct 17 13:34:34.171794 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-HypervisorAdminNegativeTestJSON-514381794-project Oct 17 13:34:34.171794 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:34:34.171794 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:34:34.171794 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 0fae69e2662b4c0980bf10c310bc7088 Oct 17 13:34:34.171794 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-514381794-project Oct 17 13:34:34.171794 n-d-854247-14 devstack@n-api.service[127017]: method: Oct 17 13:34:34.171794 n-d-854247-14 devstack@n-api.service[127017]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 17 13:34:34.171794 n-d-854247-14 devstack@n-api.service[127017]: action_args: {} Oct 17 13:34:34.171794 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:34:34.172634 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:34.172634 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:34.172634 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:34.172634 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:34:34.172634 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:34:34.172634 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:34:34.172634 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:34:34.172634 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:34:34.172634 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:34:34.172634 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 17 13:34:34.172634 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 17 13:34:34.172634 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:34:34.172634 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:34:34.172634 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:34:34.172634 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:34:34.172634 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:34:34.172634 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:34:34.172634 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:34:34.172634 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:34:34.173882 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:34:34.173882 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:34:34.173882 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:34:34.173882 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:34:34.173882 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:34:34.173882 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:34:34.173882 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 17 13:34:34.173882 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:34.173882 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:34.173882 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:34.173882 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:34.173882 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:34.173882 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:34.173882 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:34:34.173882 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:34:34.173882 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 17 13:34:34.173882 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:34.177720 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-686a0fd6-c86e-4fec-af48-f4e468f24041 tempest-HypervisorAdminNegativeTestJSON-514381794 tempest-HypervisorAdminNegativeTestJSON-514381794-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:34:34.183911 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-686a0fd6-c86e-4fec-af48-f4e468f24041 tempest-HypervisorAdminNegativeTestJSON-514381794 tempest-HypervisorAdminNegativeTestJSON-514381794-project] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.036105 Oct 17 13:34:34.188724 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 180/354] 10.222.0.79 () {58 vars in 1179 bytes} [Mon Oct 17 13:34:34 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:34:34.210338 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-59a395d7-4c1d-4757-bdb0-0663da663fec tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/c42448d9b3844b278dacc22d4d7e0ab8" status: 200 len: 371 microversion: 2.1 time: 0.567612 Oct 17 13:34:34.213133 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 175/355] 10.222.0.79 () {58 vars in 1242 bytes} [Mon Oct 17 13:34:33 2022] GET /compute/v2.1/os-quota-sets/c42448d9b3844b278dacc22d4d7e0ab8 => generated 371 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:34.328715 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ffadc6b7-fd69-4802-84da-68cee5a85125 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:34.329610 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ffadc6b7-fd69-4802-84da-68cee5a85125 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] [instance: 9c273b0a-71a1-4d2a-9fd8-07f96dd506f7] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:34.345904 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ffadc6b7-fd69-4802-84da-68cee5a85125 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:34.346426 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ffadc6b7-fd69-4802-84da-68cee5a85125 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:34.346872 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ffadc6b7-fd69-4802-84da-68cee5a85125 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:34.356932 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ffadc6b7-fd69-4802-84da-68cee5a85125 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:34.357483 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ffadc6b7-fd69-4802-84da-68cee5a85125 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:34.357910 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ffadc6b7-fd69-4802-84da-68cee5a85125 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:34.703835 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d92ac190-7ec5-47bb-95c6-b5eaef026b10 tempest-HypervisorAdminNegativeTestJSON-2029870853 tempest-HypervisorAdminNegativeTestJSON-2029870853-project-admin] Calling method '.version_select at 0x7f7cd604b940>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:34.705664 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d92ac190-7ec5-47bb-95c6-b5eaef026b10 tempest-HypervisorAdminNegativeTestJSON-2029870853 tempest-HypervisorAdminNegativeTestJSON-2029870853-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:34.706147 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d92ac190-7ec5-47bb-95c6-b5eaef026b10 tempest-HypervisorAdminNegativeTestJSON-2029870853 tempest-HypervisorAdminNegativeTestJSON-2029870853-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:34.706572 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d92ac190-7ec5-47bb-95c6-b5eaef026b10 tempest-HypervisorAdminNegativeTestJSON-2029870853 tempest-HypervisorAdminNegativeTestJSON-2029870853-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:34.724150 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d92ac190-7ec5-47bb-95c6-b5eaef026b10 tempest-HypervisorAdminNegativeTestJSON-2029870853 tempest-HypervisorAdminNegativeTestJSON-2029870853-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:34.724566 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d92ac190-7ec5-47bb-95c6-b5eaef026b10 tempest-HypervisorAdminNegativeTestJSON-2029870853 tempest-HypervisorAdminNegativeTestJSON-2029870853-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:34.725394 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d92ac190-7ec5-47bb-95c6-b5eaef026b10 tempest-HypervisorAdminNegativeTestJSON-2029870853 tempest-HypervisorAdminNegativeTestJSON-2029870853-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:34.738176 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d92ac190-7ec5-47bb-95c6-b5eaef026b10 tempest-HypervisorAdminNegativeTestJSON-2029870853 tempest-HypervisorAdminNegativeTestJSON-2029870853-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:34.739473 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d92ac190-7ec5-47bb-95c6-b5eaef026b10 tempest-HypervisorAdminNegativeTestJSON-2029870853 tempest-HypervisorAdminNegativeTestJSON-2029870853-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:34.740829 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d92ac190-7ec5-47bb-95c6-b5eaef026b10 tempest-HypervisorAdminNegativeTestJSON-2029870853 tempest-HypervisorAdminNegativeTestJSON-2029870853-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:34.762822 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d92ac190-7ec5-47bb-95c6-b5eaef026b10 tempest-HypervisorAdminNegativeTestJSON-2029870853 tempest-HypervisorAdminNegativeTestJSON-2029870853-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.572313 Oct 17 13:34:34.763573 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 181/356] 10.222.0.79 () {58 vars in 1146 bytes} [Mon Oct 17 13:34:34 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:34:34.773356 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9af0cfa7-d8ec-4f6b-91c0-ab6e681134a2 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:34.773964 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9af0cfa7-d8ec-4f6b-91c0-ab6e681134a2 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] [instance: 0b3dc4f1-f80f-427f-908e-9272cd17af3b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:34.798106 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9af0cfa7-d8ec-4f6b-91c0-ab6e681134a2 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:34.800021 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9af0cfa7-d8ec-4f6b-91c0-ab6e681134a2 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:34.800627 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9af0cfa7-d8ec-4f6b-91c0-ab6e681134a2 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:34.801762 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9af0cfa7-d8ec-4f6b-91c0-ab6e681134a2 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:34.803499 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9af0cfa7-d8ec-4f6b-91c0-ab6e681134a2 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:34.804482 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9af0cfa7-d8ec-4f6b-91c0-ab6e681134a2 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:35.049394 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9af0cfa7-d8ec-4f6b-91c0-ab6e681134a2 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf50aa8e899648418eace99975616e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6aa32dd3904f6aaae1e63fcc67b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:35.074498 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9af0cfa7-d8ec-4f6b-91c0-ab6e681134a2 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] 10.222.0.79 "GET /compute/v2.1/servers/0b3dc4f1-f80f-427f-908e-9272cd17af3b" status: 200 len: 1278 microversion: 2.1 time: 0.309742 Oct 17 13:34:35.076905 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 182/357] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:34 2022] GET /compute/v2.1/servers/0b3dc4f1-f80f-427f-908e-9272cd17af3b => generated 1278 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:35.097101 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-16814970-9267-4396-b332-4299d2aa1327 tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] Calling method '.version_select at 0x7f7cd604b4c0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:35.294674 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ffadc6b7-fd69-4802-84da-68cee5a85125 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af22b1e15d34b558227dee66ffe5f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb83705372f45308cce206fb991c011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:35.305912 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ffadc6b7-fd69-4802-84da-68cee5a85125 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] 10.222.0.79 "GET /compute/v2.1/servers/9c273b0a-71a1-4d2a-9fd8-07f96dd506f7" status: 200 len: 1313 microversion: 2.1 time: 0.982944 Oct 17 13:34:35.328535 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 176/358] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:34 2022] GET /compute/v2.1/servers/9c273b0a-71a1-4d2a-9fd8-07f96dd506f7 => generated 1313 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:35.337747 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-af27fcb3-28da-4d8a-8820-82ec3e460af3 tempest-HypervisorAdminNegativeTestJSON-514381794 tempest-HypervisorAdminNegativeTestJSON-514381794-project] Calling method '.version_select at 0x7f7cd5e2ae50>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:35.345256 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-af27fcb3-28da-4d8a-8820-82ec3e460af3 tempest-HypervisorAdminNegativeTestJSON-514381794 tempest-HypervisorAdminNegativeTestJSON-514381794-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '0fae69e2662b4c0980bf10c310bc7088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26ba68bf59a4f19aea4238797a47c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:35.352460 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-af27fcb3-28da-4d8a-8820-82ec3e460af3 tempest-HypervisorAdminNegativeTestJSON-514381794 tempest-HypervisorAdminNegativeTestJSON-514381794-project] Request method failure captured: Oct 17 13:34:35.352460 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 17 13:34:35.352460 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:34:35.352460 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:34:35.352460 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:34:35.352460 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:34:35.352460 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:34:35.352460 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:34:35.352460 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:34:35.352460 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:34:35.352460 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVnnVti5U8Vxe69sqD1SfqpbYiRMfvjqzH8DxOZdc1mL8zJTez16_EkckfrTMf_HBo6lt8y13qKE782lmGMUpjLeVE7UdJljtacG_bPi68MAvosnUgxpU3qWlKmhVZjYAc7c9Hys-F5naR_G6C-YYaKJt2fonMHyl2gMrAfSqm90O90 Oct 17 13:34:35.352460 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:34:35.352460 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:34:35.352460 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:34:35.352460 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:34:35.352460 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:34:35.352460 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:34:35.352460 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: d26ba68bf59a4f19aea4238797a47c22 Oct 17 13:34:35.352460 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-514381794 Oct 17 13:34:35.352460 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:34:35.352460 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:34:35.353907 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d26ba68bf59a4f19aea4238797a47c22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d26ba68bf59a4f19aea4238797a47c22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d26ba68bf59a4f19aea4238797a47c22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d26ba68bf59a4f19aea4238797a47c22", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:34:35.353907 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-514381794 Oct 17 13:34:35.353907 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: d26ba68bf59a4f19aea4238797a47c22 Oct 17 13:34:35.353907 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-514381794 Oct 17 13:34:35.353907 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-HypervisorAdminNegativeTestJSON-514381794-project Oct 17 13:34:35.353907 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:34:35.353907 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:34:35.353907 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 0fae69e2662b4c0980bf10c310bc7088 Oct 17 13:34:35.353907 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-514381794-project Oct 17 13:34:35.353907 n-d-854247-14 devstack@n-api.service[127016]: method: Oct 17 13:34:35.353907 n-d-854247-14 devstack@n-api.service[127016]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 17 13:34:35.353907 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '1'} Oct 17 13:34:35.353907 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:34:35.354816 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:35.354816 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:35.354816 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:35.354816 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:34:35.354816 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:34:35.354816 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:34:35.354816 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:34:35.354816 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:34:35.354816 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:34:35.354816 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 17 13:34:35.354816 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 17 13:34:35.354816 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:34:35.354816 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:34:35.354816 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:34:35.354816 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:34:35.354816 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:34:35.354816 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:34:35.354816 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:34:35.354816 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:34:35.356686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:34:35.356686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:34:35.356686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:34:35.356686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:34:35.356686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:34:35.356686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:34:35.356686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 17 13:34:35.356686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:35.356686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:35.356686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:35.356686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:35.356686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:35.356686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:35.356686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:34:35.356686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:34:35.356686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 17 13:34:35.356686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:35.359388 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-af27fcb3-28da-4d8a-8820-82ec3e460af3 tempest-HypervisorAdminNegativeTestJSON-514381794 tempest-HypervisorAdminNegativeTestJSON-514381794-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:34:35.364100 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-af27fcb3-28da-4d8a-8820-82ec3e460af3 tempest-HypervisorAdminNegativeTestJSON-514381794 tempest-HypervisorAdminNegativeTestJSON-514381794-project] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.032599 Oct 17 13:34:35.371759 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 177/359] 10.222.0.79 () {58 vars in 1173 bytes} [Mon Oct 17 13:34:35 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 42 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:34:35.387415 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-af9d4e6b-2307-424f-8e3d-ec9a1f92b678 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:35.388446 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-af9d4e6b-2307-424f-8e3d-ec9a1f92b678 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] [instance: b88e31f9-509c-4944-9622-350312d2bac1] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:35.406272 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af9d4e6b-2307-424f-8e3d-ec9a1f92b678 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:35.409308 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af9d4e6b-2307-424f-8e3d-ec9a1f92b678 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:35.411877 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af9d4e6b-2307-424f-8e3d-ec9a1f92b678 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:35.414377 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af9d4e6b-2307-424f-8e3d-ec9a1f92b678 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:35.416724 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af9d4e6b-2307-424f-8e3d-ec9a1f92b678 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:35.418919 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af9d4e6b-2307-424f-8e3d-ec9a1f92b678 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:35.527332 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-16814970-9267-4396-b332-4299d2aa1327 tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/8200b27993d7455a8a9a5095b03f1f4d/defaults" status: 200 len: 371 microversion: 2.1 time: 0.444157 Oct 17 13:34:35.528191 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 183/360] 10.222.0.79 () {58 vars in 1269 bytes} [Mon Oct 17 13:34:35 2022] GET /compute/v2.1/os-quota-sets/8200b27993d7455a8a9a5095b03f1f4d/defaults => generated 371 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:35.535740 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-15b4a22c-e160-4ea4-976c-19eda115db09 tempest-HypervisorAdminNegativeTestJSON-2029870853 tempest-HypervisorAdminNegativeTestJSON-2029870853-project-admin] Calling method '.version_select at 0x7f7cd5f19940>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:35.545981 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-15b4a22c-e160-4ea4-976c-19eda115db09 tempest-HypervisorAdminNegativeTestJSON-2029870853 tempest-HypervisorAdminNegativeTestJSON-2029870853-project-admin] HTTP exception thrown: Hypervisor with ID '2963d610-a9ba-4e76-a508-d79ef5332aad' could not be found. Oct 17 13:34:35.558280 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-15b4a22c-e160-4ea4-976c-19eda115db09 tempest-HypervisorAdminNegativeTestJSON-2029870853 tempest-HypervisorAdminNegativeTestJSON-2029870853-project-admin] Request method failure captured: Oct 17 13:34:35.558280 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/os-hypervisors/2963d610-a9ba-4e76-a508-d79ef5332aad/uptime HTTP/1.1 Oct 17 13:34:35.558280 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:34:35.558280 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:34:35.558280 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:34:35.558280 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:34:35.558280 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:34:35.558280 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:34:35.558280 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:34:35.558280 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:34:35.558280 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVno_gDFnnXWkaQLZQHeiMgn2OudyKsXZuv3NiuiKjQWXjKSDbr4Q4d_XFCLUCVY7JrZp10cUfz_4X-xAM6JKKaZ_E63ehIrgRMllHAfAWN5FTVE0C6GfK0ZWkxBBUEMyFf5TJARB7mOf9pib6X9d27_BQ5us9koDAu7wDoTGpJS-dQ Oct 17 13:34:35.558280 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:34:35.558280 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:34:35.558280 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:34:35.558280 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:34:35.558280 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:34:35.558280 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:34:35.558280 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: da419d42b2ca41c787b8916d9ca37510 Oct 17 13:34:35.558280 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2029870853 Oct 17 13:34:35.558280 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member,admin Oct 17 13:34:35.558280 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member,admin Oct 17 13:34:35.562191 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/da419d42b2ca41c787b8916d9ca37510"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/da419d42b2ca41c787b8916d9ca37510"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/da419d42b2ca41c787b8916d9ca37510"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_da419d42b2ca41c787b8916d9ca37510", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:34:35.562191 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2029870853 Oct 17 13:34:35.562191 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: da419d42b2ca41c787b8916d9ca37510 Oct 17 13:34:35.562191 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2029870853 Oct 17 13:34:35.562191 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-HypervisorAdminNegativeTestJSON-2029870853-project-admin Oct 17 13:34:35.562191 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:34:35.562191 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:34:35.562191 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 8793814241b94ada80cda087acbd29bc Oct 17 13:34:35.562191 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2029870853-project-admin Oct 17 13:34:35.562191 n-d-854247-14 devstack@n-api.service[127017]: method: Oct 17 13:34:35.562191 n-d-854247-14 devstack@n-api.service[127017]: exception: Hypervisor with ID '2963d610-a9ba-4e76-a508-d79ef5332aad' could not be found. Oct 17 13:34:35.562191 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '2963d610-a9ba-4e76-a508-d79ef5332aad'} Oct 17 13:34:35.563527 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:34:35.563527 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:35.563527 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 17 13:34:35.563527 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 17 13:34:35.563527 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '2963d610-a9ba-4e76-a508-d79ef5332aad' Oct 17 13:34:35.563527 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:35.563527 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:35.563527 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:35.563527 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:35.563527 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 17 13:34:35.563527 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 17 13:34:35.563527 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 17 13:34:35.563527 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 17 13:34:35.563527 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 17 13:34:35.563527 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:35.563527 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:35.563527 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:35.563527 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:35.563527 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 17 13:34:35.563527 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 17 13:34:35.563527 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 17 13:34:35.563527 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 17 13:34:35.565213 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 17 13:34:35.565213 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:35.565213 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:35.565213 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:35.565213 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:35.565213 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:35.565213 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:35.565213 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:34:35.565213 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:34:35.565213 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:34:35.565213 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:34:35.565213 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:34:35.565213 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:34:35.565213 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 17 13:34:35.565213 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 17 13:34:35.565213 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 17 13:34:35.565213 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 17 13:34:35.565213 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '2963d610-a9ba-4e76-a508-d79ef5332aad' could not be found. Oct 17 13:34:35.565213 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:35.565213 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:35.565213 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:35.566574 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:35.566574 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:35.566574 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:35.566574 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:34:35.566574 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:34:35.566574 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '2963d610-a9ba-4e76-a508-d79ef5332aad' could not be found. Oct 17 13:34:35.566574 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:35.566574 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-15b4a22c-e160-4ea4-976c-19eda115db09 tempest-HypervisorAdminNegativeTestJSON-2029870853 tempest-HypervisorAdminNegativeTestJSON-2029870853-project-admin] Returning 404 to user: Hypervisor with ID '2963d610-a9ba-4e76-a508-d79ef5332aad' could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:34:35.566574 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-15b4a22c-e160-4ea4-976c-19eda115db09 tempest-HypervisorAdminNegativeTestJSON-2029870853 tempest-HypervisorAdminNegativeTestJSON-2029870853-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/2963d610-a9ba-4e76-a508-d79ef5332aad/uptime" status: 404 len: 123 microversion: 2.1 time: 0.031802 Oct 17 13:34:35.568026 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 184/361] 10.222.0.79 () {58 vars in 1278 bytes} [Mon Oct 17 13:34:35 2022] GET /compute/v2.1/os-hypervisors/2963d610-a9ba-4e76-a508-d79ef5332aad/uptime => generated 123 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:34:35.578129 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e1733d12-0bbb-4419-a95a-faa715893082 tempest-HypervisorAdminNegativeTestJSON-2029870853 tempest-HypervisorAdminNegativeTestJSON-2029870853-project-admin] Calling method '.version_select at 0x7f7cd5ec0940>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:35.580353 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e1733d12-0bbb-4419-a95a-faa715893082 tempest-HypervisorAdminNegativeTestJSON-2029870853 tempest-HypervisorAdminNegativeTestJSON-2029870853-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:35.580781 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e1733d12-0bbb-4419-a95a-faa715893082 tempest-HypervisorAdminNegativeTestJSON-2029870853 tempest-HypervisorAdminNegativeTestJSON-2029870853-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:35.581449 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e1733d12-0bbb-4419-a95a-faa715893082 tempest-HypervisorAdminNegativeTestJSON-2029870853 tempest-HypervisorAdminNegativeTestJSON-2029870853-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:35.609442 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e1733d12-0bbb-4419-a95a-faa715893082 tempest-HypervisorAdminNegativeTestJSON-2029870853 tempest-HypervisorAdminNegativeTestJSON-2029870853-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:35.610149 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e1733d12-0bbb-4419-a95a-faa715893082 tempest-HypervisorAdminNegativeTestJSON-2029870853 tempest-HypervisorAdminNegativeTestJSON-2029870853-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:35.612580 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e1733d12-0bbb-4419-a95a-faa715893082 tempest-HypervisorAdminNegativeTestJSON-2029870853 tempest-HypervisorAdminNegativeTestJSON-2029870853-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:35.631371 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e1733d12-0bbb-4419-a95a-faa715893082 tempest-HypervisorAdminNegativeTestJSON-2029870853 tempest-HypervisorAdminNegativeTestJSON-2029870853-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:35.634415 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e1733d12-0bbb-4419-a95a-faa715893082 tempest-HypervisorAdminNegativeTestJSON-2029870853 tempest-HypervisorAdminNegativeTestJSON-2029870853-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:35.635450 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e1733d12-0bbb-4419-a95a-faa715893082 tempest-HypervisorAdminNegativeTestJSON-2029870853 tempest-HypervisorAdminNegativeTestJSON-2029870853-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:35.645494 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e1733d12-0bbb-4419-a95a-faa715893082 tempest-HypervisorAdminNegativeTestJSON-2029870853 tempest-HypervisorAdminNegativeTestJSON-2029870853-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.071481 Oct 17 13:34:35.648354 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-af9d4e6b-2307-424f-8e3d-ec9a1f92b678 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ca1489f0084089a47d0cfc2ad37940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a297ddf04b4b18ae7591e107e84d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:35.653468 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 185/362] 10.222.0.79 () {58 vars in 1146 bytes} [Mon Oct 17 13:34:35 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:35.658564 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-af9d4e6b-2307-424f-8e3d-ec9a1f92b678 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] 10.222.0.79 "GET /compute/v2.1/servers/b88e31f9-509c-4944-9622-350312d2bac1" status: 200 len: 1277 microversion: 2.1 time: 0.285017 Oct 17 13:34:35.660216 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ff9634b2-322a-4fb0-8e38-5cb5fc1a37ea tempest-HypervisorAdminNegativeTestJSON-514381794 tempest-HypervisorAdminNegativeTestJSON-514381794-project] Calling method '.version_select at 0x7f7cd61e3ee0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:35.663542 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ff9634b2-322a-4fb0-8e38-5cb5fc1a37ea tempest-HypervisorAdminNegativeTestJSON-514381794 tempest-HypervisorAdminNegativeTestJSON-514381794-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '0fae69e2662b4c0980bf10c310bc7088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26ba68bf59a4f19aea4238797a47c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:35.664976 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 178/363] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:35 2022] GET /compute/v2.1/servers/b88e31f9-509c-4944-9622-350312d2bac1 => generated 1277 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:35.666530 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ff9634b2-322a-4fb0-8e38-5cb5fc1a37ea tempest-HypervisorAdminNegativeTestJSON-514381794 tempest-HypervisorAdminNegativeTestJSON-514381794-project] Request method failure captured: Oct 17 13:34:35.666530 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 17 13:34:35.666530 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:34:35.666530 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:34:35.666530 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:34:35.666530 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:34:35.666530 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:34:35.666530 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:34:35.666530 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:34:35.666530 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:34:35.666530 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVnnVti5U8Vxe69sqD1SfqpbYiRMfvjqzH8DxOZdc1mL8zJTez16_EkckfrTMf_HBo6lt8y13qKE782lmGMUpjLeVE7UdJljtacG_bPi68MAvosnUgxpU3qWlKmhVZjYAc7c9Hys-F5naR_G6C-YYaKJt2fonMHyl2gMrAfSqm90O90 Oct 17 13:34:35.666530 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:34:35.666530 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:34:35.666530 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:34:35.666530 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:34:35.666530 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:34:35.666530 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:34:35.666530 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: d26ba68bf59a4f19aea4238797a47c22 Oct 17 13:34:35.666530 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-514381794 Oct 17 13:34:35.666530 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:34:35.666530 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:34:35.667729 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d26ba68bf59a4f19aea4238797a47c22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d26ba68bf59a4f19aea4238797a47c22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d26ba68bf59a4f19aea4238797a47c22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d26ba68bf59a4f19aea4238797a47c22", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:34:35.667729 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-514381794 Oct 17 13:34:35.667729 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: d26ba68bf59a4f19aea4238797a47c22 Oct 17 13:34:35.667729 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-514381794 Oct 17 13:34:35.667729 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-HypervisorAdminNegativeTestJSON-514381794-project Oct 17 13:34:35.667729 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:34:35.667729 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:34:35.667729 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 0fae69e2662b4c0980bf10c310bc7088 Oct 17 13:34:35.667729 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-514381794-project Oct 17 13:34:35.667729 n-d-854247-14 devstack@n-api.service[127017]: method: Oct 17 13:34:35.667729 n-d-854247-14 devstack@n-api.service[127017]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 17 13:34:35.667729 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '1'} Oct 17 13:34:35.667729 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:34:35.668461 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:35.668461 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:35.668461 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:35.668461 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:34:35.668461 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:34:35.668461 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:34:35.668461 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:34:35.668461 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:34:35.668461 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:34:35.668461 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 17 13:34:35.668461 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 17 13:34:35.668461 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 17 13:34:35.668461 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 17 13:34:35.668461 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:34:35.668461 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:34:35.668461 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:34:35.668461 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:34:35.668461 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:34:35.668461 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:34:35.669465 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:34:35.669465 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:34:35.669465 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:34:35.669465 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:34:35.669465 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:34:35.669465 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:34:35.669465 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:34:35.669465 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:34:35.669465 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 17 13:34:35.669465 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:35.669465 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:35.669465 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:35.669465 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:35.669465 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:35.669465 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:35.669465 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:34:35.669465 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:34:35.669465 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 17 13:34:35.669465 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:35.676214 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ff9634b2-322a-4fb0-8e38-5cb5fc1a37ea tempest-HypervisorAdminNegativeTestJSON-514381794 tempest-HypervisorAdminNegativeTestJSON-514381794-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:34:35.678766 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ff9634b2-322a-4fb0-8e38-5cb5fc1a37ea tempest-HypervisorAdminNegativeTestJSON-514381794 tempest-HypervisorAdminNegativeTestJSON-514381794-project] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.023726 Oct 17 13:34:35.679796 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 186/364] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Oct 17 13:34:35 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:34:35.692394 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-17a24594-210e-4e22-92ea-41e0de220078 tempest-HypervisorAdminNegativeTestJSON-2029870853 tempest-HypervisorAdminNegativeTestJSON-2029870853-project-admin] Calling method '.version_select at 0x7f7cd5df6b80>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:35.694052 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-17a24594-210e-4e22-92ea-41e0de220078 tempest-HypervisorAdminNegativeTestJSON-2029870853 tempest-HypervisorAdminNegativeTestJSON-2029870853-project-admin] HTTP exception thrown: Hypervisor with ID '37b131a6-d064-459d-9c65-a5da1b58deb9' could not be found. Oct 17 13:34:35.696708 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-17a24594-210e-4e22-92ea-41e0de220078 tempest-HypervisorAdminNegativeTestJSON-2029870853 tempest-HypervisorAdminNegativeTestJSON-2029870853-project-admin] Request method failure captured: Oct 17 13:34:35.696708 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/os-hypervisors/37b131a6-d064-459d-9c65-a5da1b58deb9 HTTP/1.1 Oct 17 13:34:35.696708 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:34:35.696708 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:34:35.696708 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:34:35.696708 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:34:35.696708 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:34:35.696708 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:34:35.696708 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:34:35.696708 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:34:35.696708 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVno_gDFnnXWkaQLZQHeiMgn2OudyKsXZuv3NiuiKjQWXjKSDbr4Q4d_XFCLUCVY7JrZp10cUfz_4X-xAM6JKKaZ_E63ehIrgRMllHAfAWN5FTVE0C6GfK0ZWkxBBUEMyFf5TJARB7mOf9pib6X9d27_BQ5us9koDAu7wDoTGpJS-dQ Oct 17 13:34:35.696708 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:34:35.696708 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:34:35.696708 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:34:35.696708 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:34:35.696708 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:34:35.696708 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:34:35.696708 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: da419d42b2ca41c787b8916d9ca37510 Oct 17 13:34:35.696708 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2029870853 Oct 17 13:34:35.696708 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member,admin Oct 17 13:34:35.696708 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member,admin Oct 17 13:34:35.698061 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/da419d42b2ca41c787b8916d9ca37510"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/da419d42b2ca41c787b8916d9ca37510"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/da419d42b2ca41c787b8916d9ca37510"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_da419d42b2ca41c787b8916d9ca37510", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:34:35.698061 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2029870853 Oct 17 13:34:35.698061 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: da419d42b2ca41c787b8916d9ca37510 Oct 17 13:34:35.698061 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2029870853 Oct 17 13:34:35.698061 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-HypervisorAdminNegativeTestJSON-2029870853-project-admin Oct 17 13:34:35.698061 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:34:35.698061 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:34:35.698061 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 8793814241b94ada80cda087acbd29bc Oct 17 13:34:35.698061 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2029870853-project-admin Oct 17 13:34:35.698061 n-d-854247-14 devstack@n-api.service[127016]: method: Oct 17 13:34:35.698061 n-d-854247-14 devstack@n-api.service[127016]: exception: Hypervisor with ID '37b131a6-d064-459d-9c65-a5da1b58deb9' could not be found. Oct 17 13:34:35.698061 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '37b131a6-d064-459d-9c65-a5da1b58deb9'} Oct 17 13:34:35.698785 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:34:35.698785 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:35.698785 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 17 13:34:35.698785 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 17 13:34:35.698785 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '37b131a6-d064-459d-9c65-a5da1b58deb9' Oct 17 13:34:35.698785 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:35.698785 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:35.698785 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:35.698785 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:35.698785 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 17 13:34:35.698785 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 17 13:34:35.698785 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 17 13:34:35.698785 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 17 13:34:35.698785 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 17 13:34:35.698785 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:35.698785 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:35.698785 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:35.698785 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:35.698785 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 17 13:34:35.698785 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 17 13:34:35.698785 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 17 13:34:35.698785 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 17 13:34:35.704944 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 17 13:34:35.704944 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:35.704944 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:35.704944 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:35.704944 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:35.704944 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:35.704944 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:35.704944 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:34:35.704944 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:34:35.704944 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:34:35.704944 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:34:35.704944 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:34:35.704944 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:34:35.704944 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 17 13:34:35.704944 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 17 13:34:35.704944 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 17 13:34:35.704944 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 17 13:34:35.704944 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 17 13:34:35.704944 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 17 13:34:35.704944 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '37b131a6-d064-459d-9c65-a5da1b58deb9' could not be found. Oct 17 13:34:35.706389 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:35.706389 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:35.706389 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:35.706389 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:35.706389 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:35.706389 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:35.706389 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:34:35.706389 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:34:35.706389 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '37b131a6-d064-459d-9c65-a5da1b58deb9' could not be found. Oct 17 13:34:35.706389 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:35.706389 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-17a24594-210e-4e22-92ea-41e0de220078 tempest-HypervisorAdminNegativeTestJSON-2029870853 tempest-HypervisorAdminNegativeTestJSON-2029870853-project-admin] Returning 404 to user: Hypervisor with ID '37b131a6-d064-459d-9c65-a5da1b58deb9' could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:34:35.706389 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-17a24594-210e-4e22-92ea-41e0de220078 tempest-HypervisorAdminNegativeTestJSON-2029870853 tempest-HypervisorAdminNegativeTestJSON-2029870853-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/37b131a6-d064-459d-9c65-a5da1b58deb9" status: 404 len: 123 microversion: 2.1 time: 0.011640 Oct 17 13:34:35.711372 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 179/365] 10.222.0.79 () {58 vars in 1257 bytes} [Mon Oct 17 13:34:35 2022] GET /compute/v2.1/os-hypervisors/37b131a6-d064-459d-9c65-a5da1b58deb9 => generated 123 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:34:36.117314 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5c72fbba-6471-48e4-bfbb-470a4a056eef tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:36.117945 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5c72fbba-6471-48e4-bfbb-470a4a056eef tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] [instance: 0b3dc4f1-f80f-427f-908e-9272cd17af3b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:36.129230 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e0283410-435e-4073-b092-3abf5762ed93 tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] Action: 'update', calling method: .version_select at 0x7f7cd5e1b160>, body: {"quota_set": {"ram": "5120"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:36.156070 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5c72fbba-6471-48e4-bfbb-470a4a056eef tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:36.168420 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5c72fbba-6471-48e4-bfbb-470a4a056eef tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:36.169764 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5c72fbba-6471-48e4-bfbb-470a4a056eef tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:36.174971 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5c72fbba-6471-48e4-bfbb-470a4a056eef tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:36.175673 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5c72fbba-6471-48e4-bfbb-470a4a056eef tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:36.177747 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5c72fbba-6471-48e4-bfbb-470a4a056eef tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:36.582287 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5c72fbba-6471-48e4-bfbb-470a4a056eef tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf50aa8e899648418eace99975616e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6aa32dd3904f6aaae1e63fcc67b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:36.592967 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5c72fbba-6471-48e4-bfbb-470a4a056eef tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] 10.222.0.79 "GET /compute/v2.1/servers/0b3dc4f1-f80f-427f-908e-9272cd17af3b" status: 200 len: 1320 microversion: 2.1 time: 0.490669 Oct 17 13:34:36.594664 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 187/366] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:36 2022] GET /compute/v2.1/servers/0b3dc4f1-f80f-427f-908e-9272cd17af3b => generated 1320 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:36.607851 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7ca1e694-5edf-4995-8f80-88086c2b7907 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:36.612210 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7ca1e694-5edf-4995-8f80-88086c2b7907 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] [instance: 9c273b0a-71a1-4d2a-9fd8-07f96dd506f7] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:36.621616 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7ca1e694-5edf-4995-8f80-88086c2b7907 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:36.628428 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7ca1e694-5edf-4995-8f80-88086c2b7907 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:36.629003 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7ca1e694-5edf-4995-8f80-88086c2b7907 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:36.631289 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7ca1e694-5edf-4995-8f80-88086c2b7907 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:36.632573 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7ca1e694-5edf-4995-8f80-88086c2b7907 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:36.633392 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7ca1e694-5edf-4995-8f80-88086c2b7907 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:36.976727 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6,nova_api:DELETE=5 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:34:36.989714 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e0283410-435e-4073-b092-3abf5762ed93 tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:36.991821 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e0283410-435e-4073-b092-3abf5762ed93 tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:36.994188 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e0283410-435e-4073-b092-3abf5762ed93 tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:36.995939 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e0283410-435e-4073-b092-3abf5762ed93 tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:36.996920 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e0283410-435e-4073-b092-3abf5762ed93 tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:36.997969 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e0283410-435e-4073-b092-3abf5762ed93 tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:37.057487 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7ca1e694-5edf-4995-8f80-88086c2b7907 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af22b1e15d34b558227dee66ffe5f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb83705372f45308cce206fb991c011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:37.069279 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7ca1e694-5edf-4995-8f80-88086c2b7907 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] 10.222.0.79 "GET /compute/v2.1/servers/9c273b0a-71a1-4d2a-9fd8-07f96dd506f7" status: 200 len: 1313 microversion: 2.1 time: 0.470654 Oct 17 13:34:37.070274 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 188/367] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:36 2022] GET /compute/v2.1/servers/9c273b0a-71a1-4d2a-9fd8-07f96dd506f7 => generated 1313 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:37.103383 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e0283410-435e-4073-b092-3abf5762ed93 tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-sets/825940b64a0e4930a21472ea84323d3a" status: 200 len: 328 microversion: 2.1 time: 0.979028 Oct 17 13:34:37.112096 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 180/368] 10.222.0.79 () {60 vars in 1262 bytes} [Mon Oct 17 13:34:36 2022] PUT /compute/v2.1/os-quota-sets/825940b64a0e4930a21472ea84323d3a => generated 328 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:37.122159 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-32a2f1b0-a7e9-461a-9070-cc926282e423 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:37.126034 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-32a2f1b0-a7e9-461a-9070-cc926282e423 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] [instance: b88e31f9-509c-4944-9622-350312d2bac1] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:37.140101 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-32a2f1b0-a7e9-461a-9070-cc926282e423 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:37.142793 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-32a2f1b0-a7e9-461a-9070-cc926282e423 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:37.143454 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-32a2f1b0-a7e9-461a-9070-cc926282e423 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:37.145258 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-32a2f1b0-a7e9-461a-9070-cc926282e423 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:37.147501 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-32a2f1b0-a7e9-461a-9070-cc926282e423 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:37.152902 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-32a2f1b0-a7e9-461a-9070-cc926282e423 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:37.456866 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-01b97844-ff79-4b4d-9cac-883662e55eca tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-2027090438", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "0f6c7a6d-566d-4e1c-9b41-17525dda1910"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:37.578049 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-01b97844-ff79-4b4d-9cac-883662e55eca tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] validate_networks() for [('0f6c7a6d-566d-4e1c-9b41-17525dda1910', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:34:38.076524 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-32a2f1b0-a7e9-461a-9070-cc926282e423 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ca1489f0084089a47d0cfc2ad37940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a297ddf04b4b18ae7591e107e84d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:38.114499 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-32a2f1b0-a7e9-461a-9070-cc926282e423 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] 10.222.0.79 "GET /compute/v2.1/servers/b88e31f9-509c-4944-9622-350312d2bac1" status: 200 len: 1319 microversion: 2.1 time: 1.000012 Oct 17 13:34:38.131348 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 181/369] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:37 2022] GET /compute/v2.1/servers/b88e31f9-509c-4944-9622-350312d2bac1 => generated 1319 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:38.136278 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-bcce6256-465f-48ea-bcfc-cdbae2c2cf11 tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] Calling method '.version_select at 0x7f7cd641f9d0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:38.608298 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bcce6256-465f-48ea-bcfc-cdbae2c2cf11 tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:38.610329 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bcce6256-465f-48ea-bcfc-cdbae2c2cf11 tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:38.611013 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bcce6256-465f-48ea-bcfc-cdbae2c2cf11 tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:38.612945 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bcce6256-465f-48ea-bcfc-cdbae2c2cf11 tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:38.615574 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bcce6256-465f-48ea-bcfc-cdbae2c2cf11 tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:38.616350 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bcce6256-465f-48ea-bcfc-cdbae2c2cf11 tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:38.670714 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-bcce6256-465f-48ea-bcfc-cdbae2c2cf11 tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/825940b64a0e4930a21472ea84323d3a/detail" status: 200 len: 916 microversion: 2.1 time: 0.538201 Oct 17 13:34:38.672221 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 182/370] 10.222.0.79 () {58 vars in 1263 bytes} [Mon Oct 17 13:34:38 2022] GET /compute/v2.1/os-quota-sets/825940b64a0e4930a21472ea84323d3a/detail => generated 916 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:38.687990 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-2d838a65-f6e2-4236-a113-870bbe0e48b0 req-25b72e93-3db0-4465-b50e-cfa1d001638e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c273b0a-71a1-4d2a-9fd8-07f96dd506f7", "tag": "9fc2f948-434c-4d68-b59b-66b02bd7568a"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:38.727882 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-2d838a65-f6e2-4236-a113-870bbe0e48b0 req-25b72e93-3db0-4465-b50e-cfa1d001638e service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:38.729156 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-2d838a65-f6e2-4236-a113-870bbe0e48b0 req-25b72e93-3db0-4465-b50e-cfa1d001638e service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:38.729817 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-2d838a65-f6e2-4236-a113-870bbe0e48b0 req-25b72e93-3db0-4465-b50e-cfa1d001638e service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:38.749559 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-2d838a65-f6e2-4236-a113-870bbe0e48b0 req-25b72e93-3db0-4465-b50e-cfa1d001638e service nova] Creating event network-changed:9fc2f948-434c-4d68-b59b-66b02bd7568a for instance 9c273b0a-71a1-4d2a-9fd8-07f96dd506f7 on n-h2-854247-14 Oct 17 13:34:38.759244 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-2d838a65-f6e2-4236-a113-870bbe0e48b0 req-25b72e93-3db0-4465-b50e-cfa1d001638e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085470 Oct 17 13:34:38.763086 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 183/371] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:34:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:38.779852 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e7399c40-87dc-4e33-97e4-24a181ce44c1 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:38.780639 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e7399c40-87dc-4e33-97e4-24a181ce44c1 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] [instance: 0b3dc4f1-f80f-427f-908e-9272cd17af3b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:38.792751 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7399c40-87dc-4e33-97e4-24a181ce44c1 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:38.793242 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7399c40-87dc-4e33-97e4-24a181ce44c1 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:38.793677 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7399c40-87dc-4e33-97e4-24a181ce44c1 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:38.794388 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7399c40-87dc-4e33-97e4-24a181ce44c1 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:38.794819 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7399c40-87dc-4e33-97e4-24a181ce44c1 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:38.799077 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7399c40-87dc-4e33-97e4-24a181ce44c1 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:39.467529 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e7399c40-87dc-4e33-97e4-24a181ce44c1 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf50aa8e899648418eace99975616e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6aa32dd3904f6aaae1e63fcc67b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:39.475271 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e7399c40-87dc-4e33-97e4-24a181ce44c1 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] 10.222.0.79 "GET /compute/v2.1/servers/0b3dc4f1-f80f-427f-908e-9272cd17af3b" status: 200 len: 1320 microversion: 2.1 time: 0.710662 Oct 17 13:34:39.476185 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 184/372] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:38 2022] GET /compute/v2.1/servers/0b3dc4f1-f80f-427f-908e-9272cd17af3b => generated 1320 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:39.597793 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-01b97844-ff79-4b4d-9cac-883662e55eca tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:34:39.598204 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-01b97844-ff79-4b4d-9cac-883662e55eca tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:34:39.598678 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-01b97844-ff79-4b4d-9cac-883662e55eca tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:34:39.599085 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-01b97844-ff79-4b4d-9cac-883662e55eca tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:34:39.599580 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-01b97844-ff79-4b4d-9cac-883662e55eca tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:34:39.610000 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-01b97844-ff79-4b4d-9cac-883662e55eca tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:39.610918 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-01b97844-ff79-4b4d-9cac-883662e55eca tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:39.611688 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-01b97844-ff79-4b4d-9cac-883662e55eca tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:39.612873 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-01b97844-ff79-4b4d-9cac-883662e55eca tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:39.613692 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-01b97844-ff79-4b4d-9cac-883662e55eca tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:39.614559 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-01b97844-ff79-4b4d-9cac-883662e55eca tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:39.636698 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-01b97844-ff79-4b4d-9cac-883662e55eca tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Getting quotas for project ccf0569de787477e964f570378d6459a. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:34:39.642956 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-01b97844-ff79-4b4d-9cac-883662e55eca tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Getting quotas for user 62cc720667f44772988d7890c227b217 and project ccf0569de787477e964f570378d6459a. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:34:39.667782 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-01b97844-ff79-4b4d-9cac-883662e55eca tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:34:39.670920 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-01b97844-ff79-4b4d-9cac-883662e55eca tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: 85444f54-9792-4b13-90dc-d698bc57b60b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:34:39.738669 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-01b97844-ff79-4b4d-9cac-883662e55eca tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.666621 Oct 17 13:34:39.739335 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 189/373] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:34:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:34:39.746996 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0aeddc9a-97b8-48a5-b58f-f598e64c7e17 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:39.748073 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0aeddc9a-97b8-48a5-b58f-f598e64c7e17 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] [instance: 9c273b0a-71a1-4d2a-9fd8-07f96dd506f7] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:39.755601 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0aeddc9a-97b8-48a5-b58f-f598e64c7e17 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:39.756380 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0aeddc9a-97b8-48a5-b58f-f598e64c7e17 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:39.756999 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0aeddc9a-97b8-48a5-b58f-f598e64c7e17 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:39.757892 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0aeddc9a-97b8-48a5-b58f-f598e64c7e17 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:39.758524 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0aeddc9a-97b8-48a5-b58f-f598e64c7e17 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:39.760094 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0aeddc9a-97b8-48a5-b58f-f598e64c7e17 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:39.828694 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0dd2aa41-e42c-47ed-8e5b-df8e8050464f tempest-HypervisorAdminUnderV252Test-1595420117 tempest-HypervisorAdminUnderV252Test-1595420117-project-admin] Calling method '.version_select at 0x7f7cd5f97dc0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:39.833962 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0dd2aa41-e42c-47ed-8e5b-df8e8050464f tempest-HypervisorAdminUnderV252Test-1595420117 tempest-HypervisorAdminUnderV252Test-1595420117-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:39.834720 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0dd2aa41-e42c-47ed-8e5b-df8e8050464f tempest-HypervisorAdminUnderV252Test-1595420117 tempest-HypervisorAdminUnderV252Test-1595420117-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:39.835438 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0dd2aa41-e42c-47ed-8e5b-df8e8050464f tempest-HypervisorAdminUnderV252Test-1595420117 tempest-HypervisorAdminUnderV252Test-1595420117-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:39.859339 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0dd2aa41-e42c-47ed-8e5b-df8e8050464f tempest-HypervisorAdminUnderV252Test-1595420117 tempest-HypervisorAdminUnderV252Test-1595420117-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:39.860043 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0dd2aa41-e42c-47ed-8e5b-df8e8050464f tempest-HypervisorAdminUnderV252Test-1595420117 tempest-HypervisorAdminUnderV252Test-1595420117-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:39.861924 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0dd2aa41-e42c-47ed-8e5b-df8e8050464f tempest-HypervisorAdminUnderV252Test-1595420117 tempest-HypervisorAdminUnderV252Test-1595420117-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:39.893721 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0dd2aa41-e42c-47ed-8e5b-df8e8050464f tempest-HypervisorAdminUnderV252Test-1595420117 tempest-HypervisorAdminUnderV252Test-1595420117-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:39.894295 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0dd2aa41-e42c-47ed-8e5b-df8e8050464f tempest-HypervisorAdminUnderV252Test-1595420117 tempest-HypervisorAdminUnderV252Test-1595420117-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:39.894798 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0dd2aa41-e42c-47ed-8e5b-df8e8050464f tempest-HypervisorAdminUnderV252Test-1595420117 tempest-HypervisorAdminUnderV252Test-1595420117-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:39.913805 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0dd2aa41-e42c-47ed-8e5b-df8e8050464f tempest-HypervisorAdminUnderV252Test-1595420117 tempest-HypervisorAdminUnderV252Test-1595420117-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.435648 Oct 17 13:34:39.914416 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 185/374] 10.222.0.79 () {58 vars in 1146 bytes} [Mon Oct 17 13:34:39 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:39.930378 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4767ad97-6248-4d1a-acf7-ce28f0174b23 tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] Action: 'update', calling method: .version_select at 0x7f7cd5df6790>, body: {"quota_set": {"ram": "2048"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:39.996181 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0aeddc9a-97b8-48a5-b58f-f598e64c7e17 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af22b1e15d34b558227dee66ffe5f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb83705372f45308cce206fb991c011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:40.006944 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0aeddc9a-97b8-48a5-b58f-f598e64c7e17 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] 10.222.0.79 "GET /compute/v2.1/servers/9c273b0a-71a1-4d2a-9fd8-07f96dd506f7" status: 200 len: 1313 microversion: 2.1 time: 0.264505 Oct 17 13:34:40.007941 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 190/375] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:39 2022] GET /compute/v2.1/servers/9c273b0a-71a1-4d2a-9fd8-07f96dd506f7 => generated 1313 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:40.014100 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-05ebcbdb-76fe-4b7f-a92a-1a9afed2ac86 req-485bee1b-0cf6-43f7-ac13-dc5e5eb121c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b88e31f9-509c-4944-9622-350312d2bac1", "tag": "895061f7-fd31-46e5-b994-381eedb0afad"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:40.042359 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-05ebcbdb-76fe-4b7f-a92a-1a9afed2ac86 req-485bee1b-0cf6-43f7-ac13-dc5e5eb121c2 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:40.042859 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-05ebcbdb-76fe-4b7f-a92a-1a9afed2ac86 req-485bee1b-0cf6-43f7-ac13-dc5e5eb121c2 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:40.043325 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-05ebcbdb-76fe-4b7f-a92a-1a9afed2ac86 req-485bee1b-0cf6-43f7-ac13-dc5e5eb121c2 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:40.068264 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-05ebcbdb-76fe-4b7f-a92a-1a9afed2ac86 req-485bee1b-0cf6-43f7-ac13-dc5e5eb121c2 service nova] Creating event network-changed:895061f7-fd31-46e5-b994-381eedb0afad for instance b88e31f9-509c-4944-9622-350312d2bac1 on n-h2-854247-14 Oct 17 13:34:40.075155 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-05ebcbdb-76fe-4b7f-a92a-1a9afed2ac86 req-485bee1b-0cf6-43f7-ac13-dc5e5eb121c2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065306 Oct 17 13:34:40.076415 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 191/376] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:34:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:40.083963 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-af0fc9f4-4cea-4bf2-b1e2-d9ed5359a919 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:40.085484 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-af0fc9f4-4cea-4bf2-b1e2-d9ed5359a919 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] [instance: b88e31f9-509c-4944-9622-350312d2bac1] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:40.097005 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-af0fc9f4-4cea-4bf2-b1e2-d9ed5359a919 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:40.097571 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-af0fc9f4-4cea-4bf2-b1e2-d9ed5359a919 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:40.105942 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-af0fc9f4-4cea-4bf2-b1e2-d9ed5359a919 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:40.107507 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-af0fc9f4-4cea-4bf2-b1e2-d9ed5359a919 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:40.107986 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-af0fc9f4-4cea-4bf2-b1e2-d9ed5359a919 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:40.108414 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-af0fc9f4-4cea-4bf2-b1e2-d9ed5359a919 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:40.352399 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4767ad97-6248-4d1a-acf7-ce28f0174b23 tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:40.353852 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4767ad97-6248-4d1a-acf7-ce28f0174b23 tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:40.355903 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4767ad97-6248-4d1a-acf7-ce28f0174b23 tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:40.358623 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4767ad97-6248-4d1a-acf7-ce28f0174b23 tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:40.360136 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4767ad97-6248-4d1a-acf7-ce28f0174b23 tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:40.361627 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4767ad97-6248-4d1a-acf7-ce28f0174b23 tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:40.470313 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4767ad97-6248-4d1a-acf7-ce28f0174b23 tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:40.471058 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4767ad97-6248-4d1a-acf7-ce28f0174b23 tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:40.471244 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4767ad97-6248-4d1a-acf7-ce28f0174b23 tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:40.474160 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4767ad97-6248-4d1a-acf7-ce28f0174b23 tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:40.475736 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4767ad97-6248-4d1a-acf7-ce28f0174b23 tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:40.477064 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4767ad97-6248-4d1a-acf7-ce28f0174b23 tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:40.622373 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4767ad97-6248-4d1a-acf7-ce28f0174b23 tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-sets/825940b64a0e4930a21472ea84323d3a?user_id=b0ee6e0b7f884c5bb7b6197002c10748" status: 200 len: 328 microversion: 2.1 time: 0.706845 Oct 17 13:34:40.641001 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 186/377] 10.222.0.79 () {60 vars in 1343 bytes} [Mon Oct 17 13:34:39 2022] PUT /compute/v2.1/os-quota-sets/825940b64a0e4930a21472ea84323d3a?user_id=b0ee6e0b7f884c5bb7b6197002c10748 => generated 328 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:40.646072 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ed6f8602-0123-4f80-ab07-6fde23f462eb tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:40.647004 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ed6f8602-0123-4f80-ab07-6fde23f462eb tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: 85444f54-9792-4b13-90dc-d698bc57b60b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:40.667201 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ed6f8602-0123-4f80-ab07-6fde23f462eb tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:40.669763 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ed6f8602-0123-4f80-ab07-6fde23f462eb tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:40.670232 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ed6f8602-0123-4f80-ab07-6fde23f462eb tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:40.670976 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ed6f8602-0123-4f80-ab07-6fde23f462eb tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:40.675496 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ed6f8602-0123-4f80-ab07-6fde23f462eb tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:40.676064 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ed6f8602-0123-4f80-ab07-6fde23f462eb tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:40.893779 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ed6f8602-0123-4f80-ab07-6fde23f462eb tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:40.902630 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-af0fc9f4-4cea-4bf2-b1e2-d9ed5359a919 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ca1489f0084089a47d0cfc2ad37940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a297ddf04b4b18ae7591e107e84d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:40.913854 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ed6f8602-0123-4f80-ab07-6fde23f462eb tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/85444f54-9792-4b13-90dc-d698bc57b60b" status: 200 len: 1215 microversion: 2.1 time: 0.270896 Oct 17 13:34:40.914251 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-af0fc9f4-4cea-4bf2-b1e2-d9ed5359a919 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] 10.222.0.79 "GET /compute/v2.1/servers/b88e31f9-509c-4944-9622-350312d2bac1" status: 200 len: 1319 microversion: 2.1 time: 0.835888 Oct 17 13:34:40.915579 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 187/378] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:40 2022] GET /compute/v2.1/servers/85444f54-9792-4b13-90dc-d698bc57b60b => generated 1215 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:40.935281 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 192/379] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:40 2022] GET /compute/v2.1/servers/b88e31f9-509c-4944-9622-350312d2bac1 => generated 1319 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:40.947141 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4455e85e-125a-4c34-b23c-8c6e87b6c157 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:40.947778 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4455e85e-125a-4c34-b23c-8c6e87b6c157 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] [instance: 0b3dc4f1-f80f-427f-908e-9272cd17af3b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:40.950796 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-af0ea287-9a9a-4d77-8cb3-5194b34e38c9 tempest-HypervisorAdminUnderV252Test-1595420117 tempest-HypervisorAdminUnderV252Test-1595420117-project-admin] Calling method '.version_select at 0x7f7cd5df6af0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:40.956487 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af0ea287-9a9a-4d77-8cb3-5194b34e38c9 tempest-HypervisorAdminUnderV252Test-1595420117 tempest-HypervisorAdminUnderV252Test-1595420117-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:40.956985 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af0ea287-9a9a-4d77-8cb3-5194b34e38c9 tempest-HypervisorAdminUnderV252Test-1595420117 tempest-HypervisorAdminUnderV252Test-1595420117-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:40.957438 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af0ea287-9a9a-4d77-8cb3-5194b34e38c9 tempest-HypervisorAdminUnderV252Test-1595420117 tempest-HypervisorAdminUnderV252Test-1595420117-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:40.961501 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4455e85e-125a-4c34-b23c-8c6e87b6c157 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:40.962363 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4455e85e-125a-4c34-b23c-8c6e87b6c157 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:40.963023 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4455e85e-125a-4c34-b23c-8c6e87b6c157 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:40.963920 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4455e85e-125a-4c34-b23c-8c6e87b6c157 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:40.964527 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4455e85e-125a-4c34-b23c-8c6e87b6c157 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:40.964950 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4455e85e-125a-4c34-b23c-8c6e87b6c157 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:41.003921 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af0ea287-9a9a-4d77-8cb3-5194b34e38c9 tempest-HypervisorAdminUnderV252Test-1595420117 tempest-HypervisorAdminUnderV252Test-1595420117-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:41.004398 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af0ea287-9a9a-4d77-8cb3-5194b34e38c9 tempest-HypervisorAdminUnderV252Test-1595420117 tempest-HypervisorAdminUnderV252Test-1595420117-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:41.004820 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af0ea287-9a9a-4d77-8cb3-5194b34e38c9 tempest-HypervisorAdminUnderV252Test-1595420117 tempest-HypervisorAdminUnderV252Test-1595420117-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:41.068928 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af0ea287-9a9a-4d77-8cb3-5194b34e38c9 tempest-HypervisorAdminUnderV252Test-1595420117 tempest-HypervisorAdminUnderV252Test-1595420117-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:41.069419 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af0ea287-9a9a-4d77-8cb3-5194b34e38c9 tempest-HypervisorAdminUnderV252Test-1595420117 tempest-HypervisorAdminUnderV252Test-1595420117-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:41.069845 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af0ea287-9a9a-4d77-8cb3-5194b34e38c9 tempest-HypervisorAdminUnderV252Test-1595420117 tempest-HypervisorAdminUnderV252Test-1595420117-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:41.083463 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-af0ea287-9a9a-4d77-8cb3-5194b34e38c9 tempest-HypervisorAdminUnderV252Test-1595420117 tempest-HypervisorAdminUnderV252Test-1595420117-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/n-h2-854247-14/servers" status: 200 len: 355 microversion: 2.1 time: 0.166059 Oct 17 13:34:41.095662 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 188/380] 10.222.0.79 () {58 vars in 1215 bytes} [Mon Oct 17 13:34:40 2022] GET /compute/v2.1/os-hypervisors/n-h2-854247-14/servers => generated 355 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:41.103745 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-417bba41-5b36-4a6a-a7d3-ec156ef4268a tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] Calling method '.version_select at 0x7f7cd5eb4c10>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:41.132720 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4455e85e-125a-4c34-b23c-8c6e87b6c157 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf50aa8e899648418eace99975616e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6aa32dd3904f6aaae1e63fcc67b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:41.140843 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4455e85e-125a-4c34-b23c-8c6e87b6c157 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] 10.222.0.79 "GET /compute/v2.1/servers/0b3dc4f1-f80f-427f-908e-9272cd17af3b" status: 200 len: 1320 microversion: 2.1 time: 0.203765 Oct 17 13:34:41.141398 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 193/381] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:40 2022] GET /compute/v2.1/servers/0b3dc4f1-f80f-427f-908e-9272cd17af3b => generated 1320 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:41.154638 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-ce51a7e4-9cec-42bf-aba2-baffbf01c0be req-52c18e8c-ed31-408e-a9e6-83d5b2eb4802 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b3dc4f1-f80f-427f-908e-9272cd17af3b", "tag": "b618db86-0537-40b4-b45c-64ecdbf98205"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:41.171949 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-ce51a7e4-9cec-42bf-aba2-baffbf01c0be req-52c18e8c-ed31-408e-a9e6-83d5b2eb4802 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:41.172633 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-ce51a7e4-9cec-42bf-aba2-baffbf01c0be req-52c18e8c-ed31-408e-a9e6-83d5b2eb4802 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:41.173297 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-ce51a7e4-9cec-42bf-aba2-baffbf01c0be req-52c18e8c-ed31-408e-a9e6-83d5b2eb4802 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:41.186924 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-ce51a7e4-9cec-42bf-aba2-baffbf01c0be req-52c18e8c-ed31-408e-a9e6-83d5b2eb4802 service nova] Creating event network-changed:b618db86-0537-40b4-b45c-64ecdbf98205 for instance 0b3dc4f1-f80f-427f-908e-9272cd17af3b on n-h2-854247-14 Oct 17 13:34:41.193643 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-ce51a7e4-9cec-42bf-aba2-baffbf01c0be req-52c18e8c-ed31-408e-a9e6-83d5b2eb4802 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050899 Oct 17 13:34:41.194817 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 194/382] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:41.201643 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d6fc1d20-c035-4e41-a9ef-ed51a5fae2d8 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:41.202439 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d6fc1d20-c035-4e41-a9ef-ed51a5fae2d8 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] [instance: 9c273b0a-71a1-4d2a-9fd8-07f96dd506f7] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:41.209579 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d6fc1d20-c035-4e41-a9ef-ed51a5fae2d8 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:41.210151 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d6fc1d20-c035-4e41-a9ef-ed51a5fae2d8 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:41.210593 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d6fc1d20-c035-4e41-a9ef-ed51a5fae2d8 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:41.211330 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d6fc1d20-c035-4e41-a9ef-ed51a5fae2d8 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:41.211945 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d6fc1d20-c035-4e41-a9ef-ed51a5fae2d8 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:41.212404 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d6fc1d20-c035-4e41-a9ef-ed51a5fae2d8 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:41.358771 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d6fc1d20-c035-4e41-a9ef-ed51a5fae2d8 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af22b1e15d34b558227dee66ffe5f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb83705372f45308cce206fb991c011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:41.367613 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d6fc1d20-c035-4e41-a9ef-ed51a5fae2d8 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] 10.222.0.79 "GET /compute/v2.1/servers/9c273b0a-71a1-4d2a-9fd8-07f96dd506f7" status: 200 len: 1313 microversion: 2.1 time: 0.171430 Oct 17 13:34:41.368595 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 195/383] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:41 2022] GET /compute/v2.1/servers/9c273b0a-71a1-4d2a-9fd8-07f96dd506f7 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:41.394570 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9f2c3724-33f3-491b-9595-767e9dc9e746 tempest-HypervisorAdminUnderV252Test-1595420117 tempest-HypervisorAdminUnderV252Test-1595420117-project-admin] Calling method '.version_select at 0x7f7cd5ec0310>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:41.397410 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f2c3724-33f3-491b-9595-767e9dc9e746 tempest-HypervisorAdminUnderV252Test-1595420117 tempest-HypervisorAdminUnderV252Test-1595420117-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:41.397913 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f2c3724-33f3-491b-9595-767e9dc9e746 tempest-HypervisorAdminUnderV252Test-1595420117 tempest-HypervisorAdminUnderV252Test-1595420117-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:41.398330 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f2c3724-33f3-491b-9595-767e9dc9e746 tempest-HypervisorAdminUnderV252Test-1595420117 tempest-HypervisorAdminUnderV252Test-1595420117-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:41.424227 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f2c3724-33f3-491b-9595-767e9dc9e746 tempest-HypervisorAdminUnderV252Test-1595420117 tempest-HypervisorAdminUnderV252Test-1595420117-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:41.425003 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f2c3724-33f3-491b-9595-767e9dc9e746 tempest-HypervisorAdminUnderV252Test-1595420117 tempest-HypervisorAdminUnderV252Test-1595420117-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:41.425592 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f2c3724-33f3-491b-9595-767e9dc9e746 tempest-HypervisorAdminUnderV252Test-1595420117 tempest-HypervisorAdminUnderV252Test-1595420117-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:41.435707 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-417bba41-5b36-4a6a-a7d3-ec156ef4268a tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/825940b64a0e4930a21472ea84323d3a?user_id=b0ee6e0b7f884c5bb7b6197002c10748" status: 200 len: 370 microversion: 2.1 time: 0.338231 Oct 17 13:34:41.438059 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=9,nova_api:DELETE=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:34:41.439972 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f2c3724-33f3-491b-9595-767e9dc9e746 tempest-HypervisorAdminUnderV252Test-1595420117 tempest-HypervisorAdminUnderV252Test-1595420117-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:41.440736 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f2c3724-33f3-491b-9595-767e9dc9e746 tempest-HypervisorAdminUnderV252Test-1595420117 tempest-HypervisorAdminUnderV252Test-1595420117-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:41.441493 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f2c3724-33f3-491b-9595-767e9dc9e746 tempest-HypervisorAdminUnderV252Test-1595420117 tempest-HypervisorAdminUnderV252Test-1595420117-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:41.445550 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 189/384] 10.222.0.79 () {58 vars in 1323 bytes} [Mon Oct 17 13:34:41 2022] GET /compute/v2.1/os-quota-sets/825940b64a0e4930a21472ea84323d3a?user_id=b0ee6e0b7f884c5bb7b6197002c10748 => generated 370 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:41.449796 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9f2c3724-33f3-491b-9595-767e9dc9e746 tempest-HypervisorAdminUnderV252Test-1595420117 tempest-HypervisorAdminUnderV252Test-1595420117-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.059099 Oct 17 13:34:41.450775 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 196/385] 10.222.0.79 () {58 vars in 1146 bytes} [Mon Oct 17 13:34:41 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:41.465123 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a9c04ada-b4b3-439d-9b69-5a889eadcd01 tempest-HypervisorAdminUnderV252Test-1595420117 tempest-HypervisorAdminUnderV252Test-1595420117-project-admin] Calling method '.version_select at 0x7f7cd5dcc3a0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:41.468877 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a9c04ada-b4b3-439d-9b69-5a889eadcd01 tempest-HypervisorAdminUnderV252Test-1595420117 tempest-HypervisorAdminUnderV252Test-1595420117-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:41.472443 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a9c04ada-b4b3-439d-9b69-5a889eadcd01 tempest-HypervisorAdminUnderV252Test-1595420117 tempest-HypervisorAdminUnderV252Test-1595420117-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:41.475460 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a9c04ada-b4b3-439d-9b69-5a889eadcd01 tempest-HypervisorAdminUnderV252Test-1595420117 tempest-HypervisorAdminUnderV252Test-1595420117-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:41.498384 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a9c04ada-b4b3-439d-9b69-5a889eadcd01 tempest-HypervisorAdminUnderV252Test-1595420117 tempest-HypervisorAdminUnderV252Test-1595420117-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:41.500045 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a9c04ada-b4b3-439d-9b69-5a889eadcd01 tempest-HypervisorAdminUnderV252Test-1595420117 tempest-HypervisorAdminUnderV252Test-1595420117-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:41.500942 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a9c04ada-b4b3-439d-9b69-5a889eadcd01 tempest-HypervisorAdminUnderV252Test-1595420117 tempest-HypervisorAdminUnderV252Test-1595420117-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:41.507997 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a9c04ada-b4b3-439d-9b69-5a889eadcd01 tempest-HypervisorAdminUnderV252Test-1595420117 tempest-HypervisorAdminUnderV252Test-1595420117-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/n-h2-854247-14/search" status: 200 len: 105 microversion: 2.1 time: 0.049225 Oct 17 13:34:41.509610 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 190/386] 10.222.0.79 () {58 vars in 1212 bytes} [Mon Oct 17 13:34:41 2022] GET /compute/v2.1/os-hypervisors/n-h2-854247-14/search => generated 105 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:41.939264 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-88874473-6a1f-4c41-8647-5b0b3775e93c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:41.939924 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-88874473-6a1f-4c41-8647-5b0b3775e93c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: 85444f54-9792-4b13-90dc-d698bc57b60b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:41.951663 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-88874473-6a1f-4c41-8647-5b0b3775e93c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:41.952153 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-88874473-6a1f-4c41-8647-5b0b3775e93c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:41.955843 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-88874473-6a1f-4c41-8647-5b0b3775e93c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:41.956806 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-88874473-6a1f-4c41-8647-5b0b3775e93c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:41.957358 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-88874473-6a1f-4c41-8647-5b0b3775e93c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:41.957848 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-88874473-6a1f-4c41-8647-5b0b3775e93c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:41.959076 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-10855e3f-a6b0-42e9-bbbc-f6623aeac63e tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:41.959890 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-10855e3f-a6b0-42e9-bbbc-f6623aeac63e tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] [instance: b88e31f9-509c-4944-9622-350312d2bac1] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:41.973540 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-10855e3f-a6b0-42e9-bbbc-f6623aeac63e tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:41.974336 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-10855e3f-a6b0-42e9-bbbc-f6623aeac63e tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:41.977614 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-10855e3f-a6b0-42e9-bbbc-f6623aeac63e tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:41.979427 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-10855e3f-a6b0-42e9-bbbc-f6623aeac63e tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:41.980234 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-10855e3f-a6b0-42e9-bbbc-f6623aeac63e tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:41.981899 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-10855e3f-a6b0-42e9-bbbc-f6623aeac63e tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:42.046614 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-88874473-6a1f-4c41-8647-5b0b3775e93c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:42.056864 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-88874473-6a1f-4c41-8647-5b0b3775e93c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/85444f54-9792-4b13-90dc-d698bc57b60b" status: 200 len: 1269 microversion: 2.1 time: 0.121881 Oct 17 13:34:42.063602 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 197/387] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:41 2022] GET /compute/v2.1/servers/85444f54-9792-4b13-90dc-d698bc57b60b => generated 1269 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:42.069007 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a2bff68b-2007-42e7-aa0d-2760972bd648 tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] Calling method '.version_select at 0x7f7cd6751e50>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:42.368994 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a2bff68b-2007-42e7-aa0d-2760972bd648 tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/8200b27993d7455a8a9a5095b03f1f4d/defaults" status: 200 len: 371 microversion: 2.1 time: 0.303928 Oct 17 13:34:42.370594 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 198/388] 10.222.0.79 () {58 vars in 1269 bytes} [Mon Oct 17 13:34:42 2022] GET /compute/v2.1/os-quota-sets/8200b27993d7455a8a9a5095b03f1f4d/defaults => generated 371 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:42.519510 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f160a367-3c60-41ca-adc4-aabff9f2d069 tempest-NetworksTest-396988860 tempest-NetworksTest-396988860-project-admin] Calling method '.version_select at 0x7f7cd5f19a60>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:42.695730 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-10855e3f-a6b0-42e9-bbbc-f6623aeac63e tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ca1489f0084089a47d0cfc2ad37940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a297ddf04b4b18ae7591e107e84d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:42.707336 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-10855e3f-a6b0-42e9-bbbc-f6623aeac63e tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] 10.222.0.79 "GET /compute/v2.1/servers/b88e31f9-509c-4944-9622-350312d2bac1" status: 200 len: 1319 microversion: 2.1 time: 0.752642 Oct 17 13:34:42.708040 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 191/389] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:41 2022] GET /compute/v2.1/servers/b88e31f9-509c-4944-9622-350312d2bac1 => generated 1319 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:42.713734 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-88bea751-c85c-4c36-8deb-822e69d2f6ce tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:42.714854 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-88bea751-c85c-4c36-8deb-822e69d2f6ce tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] [instance: 0b3dc4f1-f80f-427f-908e-9272cd17af3b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:42.727902 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-88bea751-c85c-4c36-8deb-822e69d2f6ce tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:42.728879 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-88bea751-c85c-4c36-8deb-822e69d2f6ce tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:42.729394 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-88bea751-c85c-4c36-8deb-822e69d2f6ce tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:42.730110 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-88bea751-c85c-4c36-8deb-822e69d2f6ce tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:42.730559 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-88bea751-c85c-4c36-8deb-822e69d2f6ce tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:42.730943 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-88bea751-c85c-4c36-8deb-822e69d2f6ce tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:43.031231 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f160a367-3c60-41ca-adc4-aabff9f2d069 tempest-NetworksTest-396988860 tempest-NetworksTest-396988860-project-admin] 10.222.0.79 "GET /compute/v2.1/os-networks" status: 200 len: 4681 microversion: 2.1 time: 0.659302 Oct 17 13:34:43.031877 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 199/390] 10.222.0.79 () {58 vars in 1137 bytes} [Mon Oct 17 13:34:42 2022] GET /compute/v2.1/os-networks => generated 4681 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:43.036805 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0c4ef5f4-b12a-42b3-898d-43d4e8985980 tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] Action: 'update', calling method: .version_select at 0x7f7cd604b3a0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:43.296956 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-88bea751-c85c-4c36-8deb-822e69d2f6ce tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf50aa8e899648418eace99975616e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6aa32dd3904f6aaae1e63fcc67b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:43.311869 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-88bea751-c85c-4c36-8deb-822e69d2f6ce tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] 10.222.0.79 "GET /compute/v2.1/servers/0b3dc4f1-f80f-427f-908e-9272cd17af3b" status: 200 len: 1320 microversion: 2.1 time: 0.601957 Oct 17 13:34:43.316150 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 192/391] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:42 2022] GET /compute/v2.1/servers/0b3dc4f1-f80f-427f-908e-9272cd17af3b => generated 1320 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:43.325211 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-07f7f714-a611-4ae8-92eb-9ae504d07220 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:43.326551 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-07f7f714-a611-4ae8-92eb-9ae504d07220 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] [instance: 9c273b0a-71a1-4d2a-9fd8-07f96dd506f7] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:43.339034 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-07f7f714-a611-4ae8-92eb-9ae504d07220 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:43.339776 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-07f7f714-a611-4ae8-92eb-9ae504d07220 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:43.341903 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-07f7f714-a611-4ae8-92eb-9ae504d07220 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:43.343764 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-07f7f714-a611-4ae8-92eb-9ae504d07220 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:43.346726 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-07f7f714-a611-4ae8-92eb-9ae504d07220 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:43.347567 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-07f7f714-a611-4ae8-92eb-9ae504d07220 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:43.489551 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0c4ef5f4-b12a-42b3-898d-43d4e8985980 tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:43.490040 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0c4ef5f4-b12a-42b3-898d-43d4e8985980 tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:43.490542 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0c4ef5f4-b12a-42b3-898d-43d4e8985980 tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:43.491358 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0c4ef5f4-b12a-42b3-898d-43d4e8985980 tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:43.492126 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0c4ef5f4-b12a-42b3-898d-43d4e8985980 tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:43.492851 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0c4ef5f4-b12a-42b3-898d-43d4e8985980 tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:43.808344 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0c4ef5f4-b12a-42b3-898d-43d4e8985980 tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-sets/8200b27993d7455a8a9a5095b03f1f4d" status: 200 len: 329 microversion: 2.1 time: 0.775281 Oct 17 13:34:43.810206 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 200/392] 10.222.0.79 () {60 vars in 1263 bytes} [Mon Oct 17 13:34:43 2022] PUT /compute/v2.1/os-quota-sets/8200b27993d7455a8a9a5095b03f1f4d => generated 329 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:43.816898 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ab09955b-16d8-4412-be6a-940053af6a78 tempest-NetworksTest-396988860 tempest-NetworksTest-396988860-project-admin] Calling method '.version_select at 0x7f7cd5f19820>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:43.950860 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-07f7f714-a611-4ae8-92eb-9ae504d07220 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af22b1e15d34b558227dee66ffe5f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb83705372f45308cce206fb991c011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:43.959726 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-07f7f714-a611-4ae8-92eb-9ae504d07220 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] 10.222.0.79 "GET /compute/v2.1/servers/9c273b0a-71a1-4d2a-9fd8-07f96dd506f7" status: 200 len: 1313 microversion: 2.1 time: 0.641208 Oct 17 13:34:43.960412 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 193/393] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:43 2022] GET /compute/v2.1/servers/9c273b0a-71a1-4d2a-9fd8-07f96dd506f7 => generated 1313 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:43.981514 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-787d83b9-c3f7-47a2-8ebf-0c989e00e2f2 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:43.982101 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-787d83b9-c3f7-47a2-8ebf-0c989e00e2f2 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: 85444f54-9792-4b13-90dc-d698bc57b60b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:43.989244 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-787d83b9-c3f7-47a2-8ebf-0c989e00e2f2 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:43.989910 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-787d83b9-c3f7-47a2-8ebf-0c989e00e2f2 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:43.990343 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-787d83b9-c3f7-47a2-8ebf-0c989e00e2f2 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:43.991043 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-787d83b9-c3f7-47a2-8ebf-0c989e00e2f2 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:43.991564 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-787d83b9-c3f7-47a2-8ebf-0c989e00e2f2 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:43.991971 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-787d83b9-c3f7-47a2-8ebf-0c989e00e2f2 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:44.057368 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ab09955b-16d8-4412-be6a-940053af6a78 tempest-NetworksTest-396988860 tempest-NetworksTest-396988860-project-admin] 10.222.0.79 "GET /compute/v2.1/os-networks/21df306d-9b14-4323-a3b6-31e46566b626" status: 200 len: 652 microversion: 2.1 time: 0.245738 Oct 17 13:34:44.058458 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 201/394] 10.222.0.79 () {58 vars in 1248 bytes} [Mon Oct 17 13:34:43 2022] GET /compute/v2.1/os-networks/21df306d-9b14-4323-a3b6-31e46566b626 => generated 652 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:44.067793 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-42ff0a61-6f3d-464e-8f92-9a6b995c47c9 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:44.068459 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-42ff0a61-6f3d-464e-8f92-9a6b995c47c9 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] [instance: b88e31f9-509c-4944-9622-350312d2bac1] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:44.076729 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-42ff0a61-6f3d-464e-8f92-9a6b995c47c9 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:44.077514 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-42ff0a61-6f3d-464e-8f92-9a6b995c47c9 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:44.078147 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-42ff0a61-6f3d-464e-8f92-9a6b995c47c9 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:44.080054 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-42ff0a61-6f3d-464e-8f92-9a6b995c47c9 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:44.080702 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-42ff0a61-6f3d-464e-8f92-9a6b995c47c9 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:44.081298 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-42ff0a61-6f3d-464e-8f92-9a6b995c47c9 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:44.534768 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-787d83b9-c3f7-47a2-8ebf-0c989e00e2f2 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:44.544904 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-787d83b9-c3f7-47a2-8ebf-0c989e00e2f2 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/85444f54-9792-4b13-90dc-d698bc57b60b" status: 200 len: 1311 microversion: 2.1 time: 0.572001 Oct 17 13:34:44.546047 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 194/395] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:43 2022] GET /compute/v2.1/servers/85444f54-9792-4b13-90dc-d698bc57b60b => generated 1311 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:44.550633 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3a953c5b-38fe-4eb0-a967-7b635a2a0820 tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] Action: 'update', calling method: .version_select at 0x7f7cd5dcc3a0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:44.560924 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-42ff0a61-6f3d-464e-8f92-9a6b995c47c9 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ca1489f0084089a47d0cfc2ad37940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a297ddf04b4b18ae7591e107e84d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:44.571148 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-42ff0a61-6f3d-464e-8f92-9a6b995c47c9 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] 10.222.0.79 "GET /compute/v2.1/servers/b88e31f9-509c-4944-9622-350312d2bac1" status: 200 len: 1319 microversion: 2.1 time: 0.507221 Oct 17 13:34:44.572332 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 202/396] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:44 2022] GET /compute/v2.1/servers/b88e31f9-509c-4944-9622-350312d2bac1 => generated 1319 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:44.577038 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2da8ef27-4394-47bd-9303-c60761f51e6d tempest-NetworksTest-396988860 tempest-NetworksTest-396988860-project-admin] Calling method '.version_select at 0x7f7cd5e38d30>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:44.784165 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2da8ef27-4394-47bd-9303-c60761f51e6d tempest-NetworksTest-396988860 tempest-NetworksTest-396988860-project-admin] 10.222.0.79 "GET /compute/v2.1/os-networks" status: 200 len: 4681 microversion: 2.1 time: 0.210155 Oct 17 13:34:44.793893 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 203/397] 10.222.0.79 () {58 vars in 1137 bytes} [Mon Oct 17 13:34:44 2022] GET /compute/v2.1/os-networks => generated 4681 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:44.800845 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9efabc1c-7f5f-40af-a225-7e49f32dc4e5 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:44.801676 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9efabc1c-7f5f-40af-a225-7e49f32dc4e5 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] [instance: 0b3dc4f1-f80f-427f-908e-9272cd17af3b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:44.818353 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9efabc1c-7f5f-40af-a225-7e49f32dc4e5 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:44.818849 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9efabc1c-7f5f-40af-a225-7e49f32dc4e5 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:44.819306 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9efabc1c-7f5f-40af-a225-7e49f32dc4e5 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:44.820182 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9efabc1c-7f5f-40af-a225-7e49f32dc4e5 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:44.820621 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9efabc1c-7f5f-40af-a225-7e49f32dc4e5 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:44.821033 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9efabc1c-7f5f-40af-a225-7e49f32dc4e5 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:44.920374 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3a953c5b-38fe-4eb0-a967-7b635a2a0820 tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:44.920848 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3a953c5b-38fe-4eb0-a967-7b635a2a0820 tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:44.927985 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3a953c5b-38fe-4eb0-a967-7b635a2a0820 tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:44.933491 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3a953c5b-38fe-4eb0-a967-7b635a2a0820 tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:44.935431 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3a953c5b-38fe-4eb0-a967-7b635a2a0820 tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:44.939463 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3a953c5b-38fe-4eb0-a967-7b635a2a0820 tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:45.131819 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=7,nova_api:UPDATE=4 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:34:45.146480 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9efabc1c-7f5f-40af-a225-7e49f32dc4e5 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf50aa8e899648418eace99975616e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6aa32dd3904f6aaae1e63fcc67b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:45.159253 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9efabc1c-7f5f-40af-a225-7e49f32dc4e5 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] 10.222.0.79 "GET /compute/v2.1/servers/0b3dc4f1-f80f-427f-908e-9272cd17af3b" status: 200 len: 1320 microversion: 2.1 time: 0.363482 Oct 17 13:34:45.163230 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 204/398] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:44 2022] GET /compute/v2.1/servers/0b3dc4f1-f80f-427f-908e-9272cd17af3b => generated 1320 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:45.171040 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-61e0a441-2df4-4ae3-839a-ea7fa351c8ce tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:45.176159 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-61e0a441-2df4-4ae3-839a-ea7fa351c8ce tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] [instance: 9c273b0a-71a1-4d2a-9fd8-07f96dd506f7] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:45.190975 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-61e0a441-2df4-4ae3-839a-ea7fa351c8ce tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:45.191451 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-61e0a441-2df4-4ae3-839a-ea7fa351c8ce tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:45.192106 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-61e0a441-2df4-4ae3-839a-ea7fa351c8ce tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:45.192865 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-61e0a441-2df4-4ae3-839a-ea7fa351c8ce tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:45.193332 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-61e0a441-2df4-4ae3-839a-ea7fa351c8ce tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:45.193732 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-61e0a441-2df4-4ae3-839a-ea7fa351c8ce tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:45.196616 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=100 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:34:45.550941 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3a953c5b-38fe-4eb0-a967-7b635a2a0820 tempest-QuotasAdminTestJSON-1628626824 tempest-QuotasAdminTestJSON-1628626824-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-sets/8200b27993d7455a8a9a5095b03f1f4d" status: 200 len: 329 microversion: 2.1 time: 1.002105 Oct 17 13:34:45.559311 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 195/399] 10.222.0.79 () {60 vars in 1263 bytes} [Mon Oct 17 13:34:44 2022] PUT /compute/v2.1/os-quota-sets/8200b27993d7455a8a9a5095b03f1f4d => generated 329 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:45.570507 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-48d597a7-6f4d-4606-8d09-293c997f00a7 req-9f045600-7dcb-4262-acf8-6b23018b8981 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c273b0a-71a1-4d2a-9fd8-07f96dd506f7", "name": "network-vif-plugged", "status": "completed", "tag": "9fc2f948-434c-4d68-b59b-66b02bd7568a"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:45.596753 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-48d597a7-6f4d-4606-8d09-293c997f00a7 req-9f045600-7dcb-4262-acf8-6b23018b8981 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:45.597797 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-48d597a7-6f4d-4606-8d09-293c997f00a7 req-9f045600-7dcb-4262-acf8-6b23018b8981 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:45.599675 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-48d597a7-6f4d-4606-8d09-293c997f00a7 req-9f045600-7dcb-4262-acf8-6b23018b8981 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:45.614168 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-61e0a441-2df4-4ae3-839a-ea7fa351c8ce tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af22b1e15d34b558227dee66ffe5f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb83705372f45308cce206fb991c011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:45.626762 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-61e0a441-2df4-4ae3-839a-ea7fa351c8ce tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] 10.222.0.79 "GET /compute/v2.1/servers/9c273b0a-71a1-4d2a-9fd8-07f96dd506f7" status: 200 len: 1313 microversion: 2.1 time: 0.462224 Oct 17 13:34:45.626981 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-48d597a7-6f4d-4606-8d09-293c997f00a7 req-9f045600-7dcb-4262-acf8-6b23018b8981 service nova] Creating event network-vif-plugged:9fc2f948-434c-4d68-b59b-66b02bd7568a for instance 9c273b0a-71a1-4d2a-9fd8-07f96dd506f7 on n-h2-854247-14 Oct 17 13:34:45.630953 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 205/400] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:45 2022] GET /compute/v2.1/servers/9c273b0a-71a1-4d2a-9fd8-07f96dd506f7 => generated 1313 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:45.638620 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-a24ac0fe-0534-48de-b5b1-e4823f764750 req-08a11f08-a1c4-4d8e-afea-e5a1207475ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85444f54-9792-4b13-90dc-d698bc57b60b", "tag": "48dfe136-d328-4b93-bfb8-302d0ec30369"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:45.652878 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-48d597a7-6f4d-4606-8d09-293c997f00a7 req-9f045600-7dcb-4262-acf8-6b23018b8981 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100034 Oct 17 13:34:45.657611 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 196/401] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:45.664715 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d3c6f6d8-3c13-4152-87dc-73a99aef7247 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:45.665662 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d3c6f6d8-3c13-4152-87dc-73a99aef7247 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: 85444f54-9792-4b13-90dc-d698bc57b60b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:45.667484 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-a24ac0fe-0534-48de-b5b1-e4823f764750 req-08a11f08-a1c4-4d8e-afea-e5a1207475ba service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:45.672680 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-a24ac0fe-0534-48de-b5b1-e4823f764750 req-08a11f08-a1c4-4d8e-afea-e5a1207475ba service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:45.673061 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d3c6f6d8-3c13-4152-87dc-73a99aef7247 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:45.673530 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d3c6f6d8-3c13-4152-87dc-73a99aef7247 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:45.673954 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d3c6f6d8-3c13-4152-87dc-73a99aef7247 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:45.674664 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-a24ac0fe-0534-48de-b5b1-e4823f764750 req-08a11f08-a1c4-4d8e-afea-e5a1207475ba service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:45.674802 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d3c6f6d8-3c13-4152-87dc-73a99aef7247 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:45.675208 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d3c6f6d8-3c13-4152-87dc-73a99aef7247 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:45.675621 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d3c6f6d8-3c13-4152-87dc-73a99aef7247 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:45.700362 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=100 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:34:45.721797 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-a24ac0fe-0534-48de-b5b1-e4823f764750 req-08a11f08-a1c4-4d8e-afea-e5a1207475ba service nova] Creating event network-changed:48dfe136-d328-4b93-bfb8-302d0ec30369 for instance 85444f54-9792-4b13-90dc-d698bc57b60b on n-h1-854247-14 Oct 17 13:34:45.734445 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-a24ac0fe-0534-48de-b5b1-e4823f764750 req-08a11f08-a1c4-4d8e-afea-e5a1207475ba service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100525 Oct 17 13:34:45.736135 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 206/402] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:45.751243 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6375aa82-4132-4488-9560-1fb745ead497 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:45.753371 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6375aa82-4132-4488-9560-1fb745ead497 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] [instance: b88e31f9-509c-4944-9622-350312d2bac1] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:45.766837 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6375aa82-4132-4488-9560-1fb745ead497 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:45.767907 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6375aa82-4132-4488-9560-1fb745ead497 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:45.768680 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6375aa82-4132-4488-9560-1fb745ead497 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:45.770118 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6375aa82-4132-4488-9560-1fb745ead497 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:45.770811 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6375aa82-4132-4488-9560-1fb745ead497 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:45.771600 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6375aa82-4132-4488-9560-1fb745ead497 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:46.197748 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6375aa82-4132-4488-9560-1fb745ead497 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ca1489f0084089a47d0cfc2ad37940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a297ddf04b4b18ae7591e107e84d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:46.212932 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6375aa82-4132-4488-9560-1fb745ead497 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] 10.222.0.79 "GET /compute/v2.1/servers/b88e31f9-509c-4944-9622-350312d2bac1" status: 200 len: 1319 microversion: 2.1 time: 0.475227 Oct 17 13:34:46.234272 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 207/403] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:45 2022] GET /compute/v2.1/servers/b88e31f9-509c-4944-9622-350312d2bac1 => generated 1319 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:46.244009 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d3c6f6d8-3c13-4152-87dc-73a99aef7247 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:46.256557 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d3c6f6d8-3c13-4152-87dc-73a99aef7247 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/85444f54-9792-4b13-90dc-d698bc57b60b" status: 200 len: 1311 microversion: 2.1 time: 0.597233 Oct 17 13:34:46.272979 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 197/404] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:45 2022] GET /compute/v2.1/servers/85444f54-9792-4b13-90dc-d698bc57b60b => generated 1311 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:46.283840 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a3c67de7-5a72-41e7-8869-95bbde8654e6 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:46.286014 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a3c67de7-5a72-41e7-8869-95bbde8654e6 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] [instance: 0b3dc4f1-f80f-427f-908e-9272cd17af3b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:46.294046 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a3c67de7-5a72-41e7-8869-95bbde8654e6 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:46.295011 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a3c67de7-5a72-41e7-8869-95bbde8654e6 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:46.295704 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a3c67de7-5a72-41e7-8869-95bbde8654e6 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:46.297197 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a3c67de7-5a72-41e7-8869-95bbde8654e6 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:46.298457 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a3c67de7-5a72-41e7-8869-95bbde8654e6 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:46.299069 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a3c67de7-5a72-41e7-8869-95bbde8654e6 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:46.486333 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a3c67de7-5a72-41e7-8869-95bbde8654e6 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf50aa8e899648418eace99975616e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6aa32dd3904f6aaae1e63fcc67b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:46.494515 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a3c67de7-5a72-41e7-8869-95bbde8654e6 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] 10.222.0.79 "GET /compute/v2.1/servers/0b3dc4f1-f80f-427f-908e-9272cd17af3b" status: 200 len: 1320 microversion: 2.1 time: 0.219688 Oct 17 13:34:46.496123 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 198/405] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:46 2022] GET /compute/v2.1/servers/0b3dc4f1-f80f-427f-908e-9272cd17af3b => generated 1320 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:46.529800 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f00d9dca-79ca-46c1-a112-441ffe032abe tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1174408534", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:46.586657 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-f00d9dca-79ca-46c1-a112-441ffe032abe tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] validate_networks() for None {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:34:46.658550 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0fa1451f-afa2-4726-ae17-6aa3758a6aeb tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:46.659242 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0fa1451f-afa2-4726-ae17-6aa3758a6aeb tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] [instance: 9c273b0a-71a1-4d2a-9fd8-07f96dd506f7] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:46.665611 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0fa1451f-afa2-4726-ae17-6aa3758a6aeb tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:46.666425 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0fa1451f-afa2-4726-ae17-6aa3758a6aeb tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:46.666873 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0fa1451f-afa2-4726-ae17-6aa3758a6aeb tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:46.667638 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0fa1451f-afa2-4726-ae17-6aa3758a6aeb tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:46.668086 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0fa1451f-afa2-4726-ae17-6aa3758a6aeb tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:46.668502 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0fa1451f-afa2-4726-ae17-6aa3758a6aeb tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:47.008415 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0fa1451f-afa2-4726-ae17-6aa3758a6aeb tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af22b1e15d34b558227dee66ffe5f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb83705372f45308cce206fb991c011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:47.019616 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0fa1451f-afa2-4726-ae17-6aa3758a6aeb tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] 10.222.0.79 "GET /compute/v2.1/servers/9c273b0a-71a1-4d2a-9fd8-07f96dd506f7" status: 200 len: 1313 microversion: 2.1 time: 0.365219 Oct 17 13:34:47.021612 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 199/406] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:46 2022] GET /compute/v2.1/servers/9c273b0a-71a1-4d2a-9fd8-07f96dd506f7 => generated 1313 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:34:47.037599 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-f00d9dca-79ca-46c1-a112-441ffe032abe tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:34:47.038048 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-f00d9dca-79ca-46c1-a112-441ffe032abe tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:34:47.038509 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-f00d9dca-79ca-46c1-a112-441ffe032abe tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:34:47.038916 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-f00d9dca-79ca-46c1-a112-441ffe032abe tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:34:47.039958 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-f00d9dca-79ca-46c1-a112-441ffe032abe tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:34:47.055987 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f00d9dca-79ca-46c1-a112-441ffe032abe tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:47.056484 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f00d9dca-79ca-46c1-a112-441ffe032abe tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:47.056935 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f00d9dca-79ca-46c1-a112-441ffe032abe tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:47.057631 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f00d9dca-79ca-46c1-a112-441ffe032abe tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:47.063969 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f00d9dca-79ca-46c1-a112-441ffe032abe tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:47.064326 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f00d9dca-79ca-46c1-a112-441ffe032abe tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:47.125746 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-f00d9dca-79ca-46c1-a112-441ffe032abe tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Getting quotas for project fa1db260a96a4c6aa69cd6437baab6f7. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:34:47.139142 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-f00d9dca-79ca-46c1-a112-441ffe032abe tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Getting quotas for user 7a7e082035084338966a1c56b30c7093 and project fa1db260a96a4c6aa69cd6437baab6f7. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:34:47.175574 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f00d9dca-79ca-46c1-a112-441ffe032abe tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:34:47.179091 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f00d9dca-79ca-46c1-a112-441ffe032abe tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 32728e12-4f3f-4f72-902c-10349708549f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:34:47.248193 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a367ace1-6e97-48ba-acbc-ce1c73d2b171 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:47.250459 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a367ace1-6e97-48ba-acbc-ce1c73d2b171 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] [instance: b88e31f9-509c-4944-9622-350312d2bac1] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:47.270931 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f00d9dca-79ca-46c1-a112-441ffe032abe tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.032246 Oct 17 13:34:47.279345 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 208/407] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:34:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1040 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:34:47.282053 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a367ace1-6e97-48ba-acbc-ce1c73d2b171 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:47.290314 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-cb46c611-35ea-4277-bff2-42af5612b257 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:47.291360 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a367ace1-6e97-48ba-acbc-ce1c73d2b171 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:47.291846 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a367ace1-6e97-48ba-acbc-ce1c73d2b171 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:47.292417 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-cb46c611-35ea-4277-bff2-42af5612b257 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: 85444f54-9792-4b13-90dc-d698bc57b60b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:47.301271 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cb46c611-35ea-4277-bff2-42af5612b257 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:47.302719 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cb46c611-35ea-4277-bff2-42af5612b257 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:47.303946 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cb46c611-35ea-4277-bff2-42af5612b257 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:47.305095 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cb46c611-35ea-4277-bff2-42af5612b257 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:47.305777 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cb46c611-35ea-4277-bff2-42af5612b257 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:47.306872 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cb46c611-35ea-4277-bff2-42af5612b257 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:47.319610 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a367ace1-6e97-48ba-acbc-ce1c73d2b171 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:47.320238 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a367ace1-6e97-48ba-acbc-ce1c73d2b171 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:47.320698 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a367ace1-6e97-48ba-acbc-ce1c73d2b171 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:47.771320 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a367ace1-6e97-48ba-acbc-ce1c73d2b171 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ca1489f0084089a47d0cfc2ad37940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a297ddf04b4b18ae7591e107e84d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:47.794698 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a367ace1-6e97-48ba-acbc-ce1c73d2b171 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] 10.222.0.79 "GET /compute/v2.1/servers/b88e31f9-509c-4944-9622-350312d2bac1" status: 200 len: 1319 microversion: 2.1 time: 0.554901 Oct 17 13:34:47.798037 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 200/408] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:47 2022] GET /compute/v2.1/servers/b88e31f9-509c-4944-9622-350312d2bac1 => generated 1319 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:47.818269 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-cb46c611-35ea-4277-bff2-42af5612b257 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:47.820758 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a76c8c36-e385-4390-9dff-500fff510882 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:47.821620 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a76c8c36-e385-4390-9dff-500fff510882 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 32728e12-4f3f-4f72-902c-10349708549f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:47.831210 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-cb46c611-35ea-4277-bff2-42af5612b257 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/85444f54-9792-4b13-90dc-d698bc57b60b" status: 200 len: 1311 microversion: 2.1 time: 0.550940 Oct 17 13:34:47.849319 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 209/409] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:47 2022] GET /compute/v2.1/servers/85444f54-9792-4b13-90dc-d698bc57b60b => generated 1311 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:34:47.858505 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3716aafa-e40b-4836-8bea-f8223df0e9a2 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:47.859430 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3716aafa-e40b-4836-8bea-f8223df0e9a2 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] [instance: 0b3dc4f1-f80f-427f-908e-9272cd17af3b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:47.865665 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3716aafa-e40b-4836-8bea-f8223df0e9a2 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:47.870337 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3716aafa-e40b-4836-8bea-f8223df0e9a2 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:47.870852 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3716aafa-e40b-4836-8bea-f8223df0e9a2 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:47.872468 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3716aafa-e40b-4836-8bea-f8223df0e9a2 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:47.874812 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3716aafa-e40b-4836-8bea-f8223df0e9a2 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:47.875365 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3716aafa-e40b-4836-8bea-f8223df0e9a2 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:48.084200 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a76c8c36-e385-4390-9dff-500fff510882 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:48.108331 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a76c8c36-e385-4390-9dff-500fff510882 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/32728e12-4f3f-4f72-902c-10349708549f" status: 200 len: 1217 microversion: 2.1 time: 0.307386 Oct 17 13:34:48.109143 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 201/410] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:47 2022] GET /compute/v2.1/servers/32728e12-4f3f-4f72-902c-10349708549f => generated 1217 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:48.115376 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-0cea2ba7-b78c-416a-ac6c-f3236509e2d3 req-cb64ad0d-dd05-4e3e-aed8-2f955cdabbd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b88e31f9-509c-4944-9622-350312d2bac1", "name": "network-vif-plugged", "status": "completed", "tag": "895061f7-fd31-46e5-b994-381eedb0afad"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:48.133591 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-0cea2ba7-b78c-416a-ac6c-f3236509e2d3 req-cb64ad0d-dd05-4e3e-aed8-2f955cdabbd5 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:48.135329 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-0cea2ba7-b78c-416a-ac6c-f3236509e2d3 req-cb64ad0d-dd05-4e3e-aed8-2f955cdabbd5 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:48.137173 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-0cea2ba7-b78c-416a-ac6c-f3236509e2d3 req-cb64ad0d-dd05-4e3e-aed8-2f955cdabbd5 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:48.150877 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-0cea2ba7-b78c-416a-ac6c-f3236509e2d3 req-cb64ad0d-dd05-4e3e-aed8-2f955cdabbd5 service nova] Creating event network-vif-plugged:895061f7-fd31-46e5-b994-381eedb0afad for instance b88e31f9-509c-4944-9622-350312d2bac1 on n-h2-854247-14 Oct 17 13:34:48.156975 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-0cea2ba7-b78c-416a-ac6c-f3236509e2d3 req-cb64ad0d-dd05-4e3e-aed8-2f955cdabbd5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046453 Oct 17 13:34:48.162723 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 202/411] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:48.170695 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-842c91d2-725e-4257-a6a5-6212df8e4b99 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:48.171435 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3716aafa-e40b-4836-8bea-f8223df0e9a2 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf50aa8e899648418eace99975616e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6aa32dd3904f6aaae1e63fcc67b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:48.171948 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-842c91d2-725e-4257-a6a5-6212df8e4b99 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] [instance: 9c273b0a-71a1-4d2a-9fd8-07f96dd506f7] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:48.182562 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-842c91d2-725e-4257-a6a5-6212df8e4b99 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:48.183690 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-842c91d2-725e-4257-a6a5-6212df8e4b99 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:48.183824 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3716aafa-e40b-4836-8bea-f8223df0e9a2 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] 10.222.0.79 "GET /compute/v2.1/servers/0b3dc4f1-f80f-427f-908e-9272cd17af3b" status: 200 len: 1320 microversion: 2.1 time: 0.328850 Oct 17 13:34:48.184759 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-842c91d2-725e-4257-a6a5-6212df8e4b99 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:48.185058 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 210/412] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:47 2022] GET /compute/v2.1/servers/0b3dc4f1-f80f-427f-908e-9272cd17af3b => generated 1320 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:48.187991 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-842c91d2-725e-4257-a6a5-6212df8e4b99 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:48.188472 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-842c91d2-725e-4257-a6a5-6212df8e4b99 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:48.188907 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-842c91d2-725e-4257-a6a5-6212df8e4b99 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:48.585346 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-842c91d2-725e-4257-a6a5-6212df8e4b99 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af22b1e15d34b558227dee66ffe5f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb83705372f45308cce206fb991c011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:48.594657 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-842c91d2-725e-4257-a6a5-6212df8e4b99 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] 10.222.0.79 "GET /compute/v2.1/servers/9c273b0a-71a1-4d2a-9fd8-07f96dd506f7" status: 200 len: 1463 microversion: 2.1 time: 0.430109 Oct 17 13:34:48.595368 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 203/413] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:48 2022] GET /compute/v2.1/servers/9c273b0a-71a1-4d2a-9fd8-07f96dd506f7 => generated 1463 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:48.829693 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9cc9c11c-038e-4610-9a50-86774cd6a8f2 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:48.830301 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9cc9c11c-038e-4610-9a50-86774cd6a8f2 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] [instance: b88e31f9-509c-4944-9622-350312d2bac1] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:48.837919 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9cc9c11c-038e-4610-9a50-86774cd6a8f2 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:48.839301 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9cc9c11c-038e-4610-9a50-86774cd6a8f2 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:48.839802 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9cc9c11c-038e-4610-9a50-86774cd6a8f2 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:48.840640 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9cc9c11c-038e-4610-9a50-86774cd6a8f2 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:48.841271 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9cc9c11c-038e-4610-9a50-86774cd6a8f2 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:48.841673 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9cc9c11c-038e-4610-9a50-86774cd6a8f2 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:48.891374 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b2645ef6-0120-4821-981b-0d8acb9d696f tempest-TenantUsagesTestJSON-1307906495 tempest-TenantUsagesTestJSON-1307906495-project-admin] Calling method '.version_select at 0x7f7cd5ec03a0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:48.911560 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b2645ef6-0120-4821-981b-0d8acb9d696f tempest-TenantUsagesTestJSON-1307906495 tempest-TenantUsagesTestJSON-1307906495-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:48.912044 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b2645ef6-0120-4821-981b-0d8acb9d696f tempest-TenantUsagesTestJSON-1307906495 tempest-TenantUsagesTestJSON-1307906495-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:48.912480 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b2645ef6-0120-4821-981b-0d8acb9d696f tempest-TenantUsagesTestJSON-1307906495 tempest-TenantUsagesTestJSON-1307906495-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:48.952233 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b2645ef6-0120-4821-981b-0d8acb9d696f tempest-TenantUsagesTestJSON-1307906495 tempest-TenantUsagesTestJSON-1307906495-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:48.952721 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b2645ef6-0120-4821-981b-0d8acb9d696f tempest-TenantUsagesTestJSON-1307906495 tempest-TenantUsagesTestJSON-1307906495-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:48.953556 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b2645ef6-0120-4821-981b-0d8acb9d696f tempest-TenantUsagesTestJSON-1307906495 tempest-TenantUsagesTestJSON-1307906495-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:48.974759 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b2645ef6-0120-4821-981b-0d8acb9d696f tempest-TenantUsagesTestJSON-1307906495 tempest-TenantUsagesTestJSON-1307906495-project-admin] 10.222.0.79 "GET /compute/v2.1/os-simple-tenant-usage/0bb83705372f45308cce206fb991c011?start=2022-10-16T13%3A34%3A48.611238&end=2022-10-18T13%3A34%3A48.611238" status: 200 len: 694 microversion: 2.1 time: 0.359447 Oct 17 13:34:48.976007 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 211/414] 10.222.0.79 () {58 vars in 1412 bytes} [Mon Oct 17 13:34:48 2022] GET /compute/v2.1/os-simple-tenant-usage/0bb83705372f45308cce206fb991c011?start=2022-10-16T13%3A34%3A48.611238&end=2022-10-18T13%3A34%3A48.611238 => generated 694 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:48.992657 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c4c048d0-4feb-4010-872b-66979f557718 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:48.993611 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c4c048d0-4feb-4010-872b-66979f557718 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: 85444f54-9792-4b13-90dc-d698bc57b60b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:49.002578 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c4c048d0-4feb-4010-872b-66979f557718 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:49.008178 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c4c048d0-4feb-4010-872b-66979f557718 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:49.008950 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c4c048d0-4feb-4010-872b-66979f557718 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:49.009470 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c4c048d0-4feb-4010-872b-66979f557718 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:49.010125 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c4c048d0-4feb-4010-872b-66979f557718 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:49.013172 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c4c048d0-4feb-4010-872b-66979f557718 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:49.042776 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9cc9c11c-038e-4610-9a50-86774cd6a8f2 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ca1489f0084089a47d0cfc2ad37940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a297ddf04b4b18ae7591e107e84d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:49.056319 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9cc9c11c-038e-4610-9a50-86774cd6a8f2 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] 10.222.0.79 "GET /compute/v2.1/servers/b88e31f9-509c-4944-9622-350312d2bac1" status: 200 len: 1319 microversion: 2.1 time: 0.230908 Oct 17 13:34:49.057001 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 204/415] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:48 2022] GET /compute/v2.1/servers/b88e31f9-509c-4944-9622-350312d2bac1 => generated 1319 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:34:49.064063 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1da3aa0c-31c9-4177-89db-cb357fa7ddce tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Calling method '.version_select at 0x7f7cd5d57dc0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:49.100549 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1da3aa0c-31c9-4177-89db-cb357fa7ddce tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:49.102808 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1da3aa0c-31c9-4177-89db-cb357fa7ddce tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:49.104339 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1da3aa0c-31c9-4177-89db-cb357fa7ddce tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:49.146518 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1da3aa0c-31c9-4177-89db-cb357fa7ddce tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:49.147288 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1da3aa0c-31c9-4177-89db-cb357fa7ddce tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:49.147788 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1da3aa0c-31c9-4177-89db-cb357fa7ddce tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:49.172052 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1da3aa0c-31c9-4177-89db-cb357fa7ddce tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] 10.222.0.79 "GET /compute/v2.1/os-simple-tenant-usage/0bb83705372f45308cce206fb991c011?start=2022-10-16T13%3A34%3A48.611238&end=2022-10-18T13%3A34%3A48.611238" status: 200 len: 694 microversion: 2.1 time: 0.112367 Oct 17 13:34:49.173002 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 205/416] 10.222.0.79 () {58 vars in 1412 bytes} [Mon Oct 17 13:34:49 2022] GET /compute/v2.1/os-simple-tenant-usage/0bb83705372f45308cce206fb991c011?start=2022-10-16T13%3A34%3A48.611238&end=2022-10-18T13%3A34%3A48.611238 => generated 694 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:49.178271 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-78ef0e80-c4d2-48dc-9a81-f62446c10dd9 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:49.179300 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-78ef0e80-c4d2-48dc-9a81-f62446c10dd9 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 32728e12-4f3f-4f72-902c-10349708549f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:49.189476 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-78ef0e80-c4d2-48dc-9a81-f62446c10dd9 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:49.190398 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-78ef0e80-c4d2-48dc-9a81-f62446c10dd9 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:49.191213 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-78ef0e80-c4d2-48dc-9a81-f62446c10dd9 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:49.192145 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-78ef0e80-c4d2-48dc-9a81-f62446c10dd9 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:49.192942 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-78ef0e80-c4d2-48dc-9a81-f62446c10dd9 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:49.193674 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-78ef0e80-c4d2-48dc-9a81-f62446c10dd9 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:49.258977 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c4c048d0-4feb-4010-872b-66979f557718 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:49.273271 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c4c048d0-4feb-4010-872b-66979f557718 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/85444f54-9792-4b13-90dc-d698bc57b60b" status: 200 len: 1311 microversion: 2.1 time: 0.293674 Oct 17 13:34:49.275190 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 212/417] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:48 2022] GET /compute/v2.1/servers/85444f54-9792-4b13-90dc-d698bc57b60b => generated 1311 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:49.279835 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2b43b6e2-d8e9-42f7-a098-63791500b9c1 tempest-TenantUsagesTestJSON-1307906495 tempest-TenantUsagesTestJSON-1307906495-project-admin] Calling method '.version_select at 0x7f7cd5e381f0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:49.308849 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2b43b6e2-d8e9-42f7-a098-63791500b9c1 tempest-TenantUsagesTestJSON-1307906495 tempest-TenantUsagesTestJSON-1307906495-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:49.310866 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2b43b6e2-d8e9-42f7-a098-63791500b9c1 tempest-TenantUsagesTestJSON-1307906495 tempest-TenantUsagesTestJSON-1307906495-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:49.311839 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2b43b6e2-d8e9-42f7-a098-63791500b9c1 tempest-TenantUsagesTestJSON-1307906495 tempest-TenantUsagesTestJSON-1307906495-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:49.316658 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-78ef0e80-c4d2-48dc-9a81-f62446c10dd9 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:49.331293 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-78ef0e80-c4d2-48dc-9a81-f62446c10dd9 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/32728e12-4f3f-4f72-902c-10349708549f" status: 200 len: 1269 microversion: 2.1 time: 0.157015 Oct 17 13:34:49.332348 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 206/418] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:49 2022] GET /compute/v2.1/servers/32728e12-4f3f-4f72-902c-10349708549f => generated 1269 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:49.337778 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-279e0787-358d-4766-ac9f-16a94959d789 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:49.338893 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-279e0787-358d-4766-ac9f-16a94959d789 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] [instance: 0b3dc4f1-f80f-427f-908e-9272cd17af3b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:49.346898 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-279e0787-358d-4766-ac9f-16a94959d789 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:49.347714 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-279e0787-358d-4766-ac9f-16a94959d789 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:49.348519 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-279e0787-358d-4766-ac9f-16a94959d789 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:49.350145 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-279e0787-358d-4766-ac9f-16a94959d789 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:49.351485 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-279e0787-358d-4766-ac9f-16a94959d789 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:49.351617 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2b43b6e2-d8e9-42f7-a098-63791500b9c1 tempest-TenantUsagesTestJSON-1307906495 tempest-TenantUsagesTestJSON-1307906495-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:49.352023 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2b43b6e2-d8e9-42f7-a098-63791500b9c1 tempest-TenantUsagesTestJSON-1307906495 tempest-TenantUsagesTestJSON-1307906495-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:49.352592 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-279e0787-358d-4766-ac9f-16a94959d789 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:49.366083 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2b43b6e2-d8e9-42f7-a098-63791500b9c1 tempest-TenantUsagesTestJSON-1307906495 tempest-TenantUsagesTestJSON-1307906495-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:49.404786 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2b43b6e2-d8e9-42f7-a098-63791500b9c1 tempest-TenantUsagesTestJSON-1307906495 tempest-TenantUsagesTestJSON-1307906495-project-admin] 10.222.0.79 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-16T13%3A34%3A48.611238&end=2022-10-18T13%3A34%3A48.611238&detailed=1" status: 200 len: 2816 microversion: 2.1 time: 0.128318 Oct 17 13:34:49.405432 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 213/419] 10.222.0.79 () {58 vars in 1335 bytes} [Mon Oct 17 13:34:49 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-16T13%3A34%3A48.611238&end=2022-10-18T13%3A34%3A48.611238&detailed=1 => generated 2816 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:49.429016 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a094d2de-a540-4025-a7ea-7da594414ce3 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:49.429518 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a094d2de-a540-4025-a7ea-7da594414ce3 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] [instance: 9c273b0a-71a1-4d2a-9fd8-07f96dd506f7] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:49.439426 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a094d2de-a540-4025-a7ea-7da594414ce3 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:49.440171 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a094d2de-a540-4025-a7ea-7da594414ce3 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:49.441037 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a094d2de-a540-4025-a7ea-7da594414ce3 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:49.445933 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a094d2de-a540-4025-a7ea-7da594414ce3 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:49.447494 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a094d2de-a540-4025-a7ea-7da594414ce3 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:49.448341 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a094d2de-a540-4025-a7ea-7da594414ce3 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:49.507024 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a094d2de-a540-4025-a7ea-7da594414ce3 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] [instance: 9c273b0a-71a1-4d2a-9fd8-07f96dd506f7] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:34:49.637189 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-279e0787-358d-4766-ac9f-16a94959d789 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf50aa8e899648418eace99975616e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6aa32dd3904f6aaae1e63fcc67b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:49.645612 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-279e0787-358d-4766-ac9f-16a94959d789 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] 10.222.0.79 "GET /compute/v2.1/servers/0b3dc4f1-f80f-427f-908e-9272cd17af3b" status: 200 len: 1320 microversion: 2.1 time: 0.311781 Oct 17 13:34:49.653138 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 207/420] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:49 2022] GET /compute/v2.1/servers/0b3dc4f1-f80f-427f-908e-9272cd17af3b => generated 1320 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:49.660396 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a094d2de-a540-4025-a7ea-7da594414ce3 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] 10.222.0.79 "DELETE /compute/v2.1/servers/9c273b0a-71a1-4d2a-9fd8-07f96dd506f7" status: 204 len: 0 microversion: 2.1 time: 0.234942 Oct 17 13:34:49.665154 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 214/421] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:34:49 2022] DELETE /compute/v2.1/servers/9c273b0a-71a1-4d2a-9fd8-07f96dd506f7 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:34:49.673177 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b6ce94f2-5372-46c4-80e8-68da852c38d9 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:49.673797 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b6ce94f2-5372-46c4-80e8-68da852c38d9 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] [instance: 9c273b0a-71a1-4d2a-9fd8-07f96dd506f7] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:49.684405 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b6ce94f2-5372-46c4-80e8-68da852c38d9 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:49.685582 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b6ce94f2-5372-46c4-80e8-68da852c38d9 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:49.686362 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b6ce94f2-5372-46c4-80e8-68da852c38d9 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:49.687695 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b6ce94f2-5372-46c4-80e8-68da852c38d9 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:49.688322 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b6ce94f2-5372-46c4-80e8-68da852c38d9 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:49.689093 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b6ce94f2-5372-46c4-80e8-68da852c38d9 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:49.864643 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b6ce94f2-5372-46c4-80e8-68da852c38d9 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af22b1e15d34b558227dee66ffe5f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb83705372f45308cce206fb991c011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:49.874248 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b6ce94f2-5372-46c4-80e8-68da852c38d9 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] 10.222.0.79 "GET /compute/v2.1/servers/9c273b0a-71a1-4d2a-9fd8-07f96dd506f7" status: 200 len: 1469 microversion: 2.1 time: 0.207030 Oct 17 13:34:49.879205 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 208/422] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:49 2022] GET /compute/v2.1/servers/9c273b0a-71a1-4d2a-9fd8-07f96dd506f7 => generated 1469 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:50.081274 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2d6a4760-72fc-4b58-aa0c-04cd479d422e tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:50.081890 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2d6a4760-72fc-4b58-aa0c-04cd479d422e tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] [instance: b88e31f9-509c-4944-9622-350312d2bac1] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:50.089717 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2d6a4760-72fc-4b58-aa0c-04cd479d422e tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:50.090267 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2d6a4760-72fc-4b58-aa0c-04cd479d422e tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:50.090705 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2d6a4760-72fc-4b58-aa0c-04cd479d422e tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:50.091440 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2d6a4760-72fc-4b58-aa0c-04cd479d422e tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:50.092007 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2d6a4760-72fc-4b58-aa0c-04cd479d422e tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:50.092424 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2d6a4760-72fc-4b58-aa0c-04cd479d422e tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:50.101616 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8304f195-3cc3-49ec-b7d0-71751960a0eb tempest-QuotasAdminTestV257-795041839 tempest-QuotasAdminTestV257-795041839-project-admin] Action: 'update', calling method: .version_select at 0x7f7cd5ec0820>, body: {"quota_set": {"ram": "5120"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:50.242069 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2d6a4760-72fc-4b58-aa0c-04cd479d422e tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ca1489f0084089a47d0cfc2ad37940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a297ddf04b4b18ae7591e107e84d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:50.252968 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2d6a4760-72fc-4b58-aa0c-04cd479d422e tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] 10.222.0.79 "GET /compute/v2.1/servers/b88e31f9-509c-4944-9622-350312d2bac1" status: 200 len: 1469 microversion: 2.1 time: 0.176168 Oct 17 13:34:50.253696 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 209/423] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:50 2022] GET /compute/v2.1/servers/b88e31f9-509c-4944-9622-350312d2bac1 => generated 1469 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:34:50.259238 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-55554b04-e9a6-4e99-bc8f-99472cba4032 req-d12ad423-1dc4-4aed-a60a-eff6e09fee8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b3dc4f1-f80f-427f-908e-9272cd17af3b", "name": "network-vif-plugged", "status": "completed", "tag": "b618db86-0537-40b4-b45c-64ecdbf98205"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:50.271090 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-55554b04-e9a6-4e99-bc8f-99472cba4032 req-d12ad423-1dc4-4aed-a60a-eff6e09fee8b service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:50.271859 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-55554b04-e9a6-4e99-bc8f-99472cba4032 req-d12ad423-1dc4-4aed-a60a-eff6e09fee8b service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:50.272431 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-55554b04-e9a6-4e99-bc8f-99472cba4032 req-d12ad423-1dc4-4aed-a60a-eff6e09fee8b service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:50.285171 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-55554b04-e9a6-4e99-bc8f-99472cba4032 req-d12ad423-1dc4-4aed-a60a-eff6e09fee8b service nova] Creating event network-vif-plugged:b618db86-0537-40b4-b45c-64ecdbf98205 for instance 0b3dc4f1-f80f-427f-908e-9272cd17af3b on n-h2-854247-14 Oct 17 13:34:50.290470 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-55554b04-e9a6-4e99-bc8f-99472cba4032 req-d12ad423-1dc4-4aed-a60a-eff6e09fee8b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035206 Oct 17 13:34:50.291356 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 210/424] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:50.296923 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-07df399a-d018-4b51-9720-e1aa5b9570e1 tempest-LiveMigrationNegativeTest-1945319370 tempest-LiveMigrationNegativeTest-1945319370-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:50.297541 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-07df399a-d018-4b51-9720-e1aa5b9570e1 tempest-LiveMigrationNegativeTest-1945319370 tempest-LiveMigrationNegativeTest-1945319370-project-admin] [instance: b88e31f9-509c-4944-9622-350312d2bac1] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:50.304161 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-07df399a-d018-4b51-9720-e1aa5b9570e1 tempest-LiveMigrationNegativeTest-1945319370 tempest-LiveMigrationNegativeTest-1945319370-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:50.304724 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-07df399a-d018-4b51-9720-e1aa5b9570e1 tempest-LiveMigrationNegativeTest-1945319370 tempest-LiveMigrationNegativeTest-1945319370-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:50.305154 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-07df399a-d018-4b51-9720-e1aa5b9570e1 tempest-LiveMigrationNegativeTest-1945319370 tempest-LiveMigrationNegativeTest-1945319370-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:50.306376 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-07df399a-d018-4b51-9720-e1aa5b9570e1 tempest-LiveMigrationNegativeTest-1945319370 tempest-LiveMigrationNegativeTest-1945319370-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:50.306524 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-07df399a-d018-4b51-9720-e1aa5b9570e1 tempest-LiveMigrationNegativeTest-1945319370 tempest-LiveMigrationNegativeTest-1945319370-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:50.306947 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-07df399a-d018-4b51-9720-e1aa5b9570e1 tempest-LiveMigrationNegativeTest-1945319370 tempest-LiveMigrationNegativeTest-1945319370-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:50.372503 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-07df399a-d018-4b51-9720-e1aa5b9570e1 tempest-LiveMigrationNegativeTest-1945319370 tempest-LiveMigrationNegativeTest-1945319370-project-admin] Lazy-loading 'flavor' on Instance uuid b88e31f9-509c-4944-9622-350312d2bac1 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:34:50.405500 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8304f195-3cc3-49ec-b7d0-71751960a0eb tempest-QuotasAdminTestV257-795041839 tempest-QuotasAdminTestV257-795041839-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:50.405983 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8304f195-3cc3-49ec-b7d0-71751960a0eb tempest-QuotasAdminTestV257-795041839 tempest-QuotasAdminTestV257-795041839-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:50.406723 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8304f195-3cc3-49ec-b7d0-71751960a0eb tempest-QuotasAdminTestV257-795041839 tempest-QuotasAdminTestV257-795041839-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:50.407605 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8304f195-3cc3-49ec-b7d0-71751960a0eb tempest-QuotasAdminTestV257-795041839 tempest-QuotasAdminTestV257-795041839-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:50.408060 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8304f195-3cc3-49ec-b7d0-71751960a0eb tempest-QuotasAdminTestV257-795041839 tempest-QuotasAdminTestV257-795041839-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:50.408479 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8304f195-3cc3-49ec-b7d0-71751960a0eb tempest-QuotasAdminTestV257-795041839 tempest-QuotasAdminTestV257-795041839-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:50.451563 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-07df399a-d018-4b51-9720-e1aa5b9570e1 tempest-LiveMigrationNegativeTest-1945319370 tempest-LiveMigrationNegativeTest-1945319370-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/b88e31f9-509c-4944-9622-350312d2bac1/action" status: 202 len: 0 microversion: 2.1 time: 0.158502 Oct 17 13:34:50.452611 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 211/425] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:34:50 2022] POST /compute/v2.1/servers/b88e31f9-509c-4944-9622-350312d2bac1/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:34:50.457815 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e2794796-286b-4665-8f9f-2510a133b162 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:50.458576 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e2794796-286b-4665-8f9f-2510a133b162 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: 85444f54-9792-4b13-90dc-d698bc57b60b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:50.464680 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=18,nova_api:UPDATE=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:34:50.465708 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e2794796-286b-4665-8f9f-2510a133b162 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:50.465835 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e2794796-286b-4665-8f9f-2510a133b162 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:50.466270 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e2794796-286b-4665-8f9f-2510a133b162 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:50.467058 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e2794796-286b-4665-8f9f-2510a133b162 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:50.467548 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e2794796-286b-4665-8f9f-2510a133b162 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:50.468026 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e2794796-286b-4665-8f9f-2510a133b162 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:50.477706 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8304f195-3cc3-49ec-b7d0-71751960a0eb tempest-QuotasAdminTestV257-795041839 tempest-QuotasAdminTestV257-795041839-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-sets/b228cd508f6c4d87b0b2855652c6c099" status: 200 len: 148 microversion: 2.57 time: 0.502000 Oct 17 13:34:50.478450 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 215/426] 10.222.0.79 () {62 vars in 1303 bytes} [Mon Oct 17 13:34:49 2022] PUT /compute/v2.1/os-quota-sets/b228cd508f6c4d87b0b2855652c6c099 => generated 148 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:34:50.490049 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1fdaef03-6864-4335-ada7-10675722db9f tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:50.490786 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1fdaef03-6864-4335-ada7-10675722db9f tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 32728e12-4f3f-4f72-902c-10349708549f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:50.499759 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1fdaef03-6864-4335-ada7-10675722db9f tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:50.499759 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1fdaef03-6864-4335-ada7-10675722db9f tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:50.499759 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1fdaef03-6864-4335-ada7-10675722db9f tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:50.499759 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1fdaef03-6864-4335-ada7-10675722db9f tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:50.503634 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1fdaef03-6864-4335-ada7-10675722db9f tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:50.504111 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1fdaef03-6864-4335-ada7-10675722db9f tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:50.584514 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1fdaef03-6864-4335-ada7-10675722db9f tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:50.592444 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1fdaef03-6864-4335-ada7-10675722db9f tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/32728e12-4f3f-4f72-902c-10349708549f" status: 200 len: 1275 microversion: 2.1 time: 0.108081 Oct 17 13:34:50.593054 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 216/427] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:50 2022] GET /compute/v2.1/servers/32728e12-4f3f-4f72-902c-10349708549f => generated 1275 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:50.597940 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-826eca80-72da-4066-8f58-a81cd956ef71 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:50.598579 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-826eca80-72da-4066-8f58-a81cd956ef71 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] [instance: b88e31f9-509c-4944-9622-350312d2bac1] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:50.605203 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-826eca80-72da-4066-8f58-a81cd956ef71 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:50.605689 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-826eca80-72da-4066-8f58-a81cd956ef71 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:50.606116 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-826eca80-72da-4066-8f58-a81cd956ef71 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:50.606812 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-826eca80-72da-4066-8f58-a81cd956ef71 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:50.607284 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-826eca80-72da-4066-8f58-a81cd956ef71 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:50.607770 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-826eca80-72da-4066-8f58-a81cd956ef71 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:50.624066 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e2794796-286b-4665-8f9f-2510a133b162 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:50.632132 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e2794796-286b-4665-8f9f-2510a133b162 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/85444f54-9792-4b13-90dc-d698bc57b60b" status: 200 len: 1311 microversion: 2.1 time: 0.178390 Oct 17 13:34:50.632696 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 212/428] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:50 2022] GET /compute/v2.1/servers/85444f54-9792-4b13-90dc-d698bc57b60b => generated 1311 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:50.637317 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5a048b14-58f6-482f-acc7-d4d74e4bed0b tempest-QuotasAdminTestV257-795041839 tempest-QuotasAdminTestV257-795041839-project-admin] Calling method '.version_select at 0x7f7cd5f97dc0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:50.765638 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-826eca80-72da-4066-8f58-a81cd956ef71 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ca1489f0084089a47d0cfc2ad37940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a297ddf04b4b18ae7591e107e84d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:50.779339 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-826eca80-72da-4066-8f58-a81cd956ef71 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] 10.222.0.79 "GET /compute/v2.1/servers/b88e31f9-509c-4944-9622-350312d2bac1" status: 200 len: 1477 microversion: 2.1 time: 0.183017 Oct 17 13:34:50.781418 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 217/429] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:50 2022] GET /compute/v2.1/servers/b88e31f9-509c-4944-9622-350312d2bac1 => generated 1477 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:50.783541 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5a048b14-58f6-482f-acc7-d4d74e4bed0b tempest-QuotasAdminTestV257-795041839 tempest-QuotasAdminTestV257-795041839-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:50.784793 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5a048b14-58f6-482f-acc7-d4d74e4bed0b tempest-QuotasAdminTestV257-795041839 tempest-QuotasAdminTestV257-795041839-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:50.785375 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5a048b14-58f6-482f-acc7-d4d74e4bed0b tempest-QuotasAdminTestV257-795041839 tempest-QuotasAdminTestV257-795041839-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:50.786178 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5a048b14-58f6-482f-acc7-d4d74e4bed0b tempest-QuotasAdminTestV257-795041839 tempest-QuotasAdminTestV257-795041839-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:50.786662 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5a048b14-58f6-482f-acc7-d4d74e4bed0b tempest-QuotasAdminTestV257-795041839 tempest-QuotasAdminTestV257-795041839-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:50.787107 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5a048b14-58f6-482f-acc7-d4d74e4bed0b tempest-QuotasAdminTestV257-795041839 tempest-QuotasAdminTestV257-795041839-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:50.811901 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5a048b14-58f6-482f-acc7-d4d74e4bed0b tempest-QuotasAdminTestV257-795041839 tempest-QuotasAdminTestV257-795041839-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/b228cd508f6c4d87b0b2855652c6c099/detail" status: 200 len: 463 microversion: 2.57 time: 0.177871 Oct 17 13:34:50.813240 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 213/430] 10.222.0.79 () {60 vars in 1304 bytes} [Mon Oct 17 13:34:50 2022] GET /compute/v2.1/os-quota-sets/b228cd508f6c4d87b0b2855652c6c099/detail => generated 463 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:34:50.820561 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-15b6be38-9623-4585-8e19-204e0c343680 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:50.822037 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-15b6be38-9623-4585-8e19-204e0c343680 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] [instance: 0b3dc4f1-f80f-427f-908e-9272cd17af3b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:50.831321 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-15b6be38-9623-4585-8e19-204e0c343680 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:50.832629 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-15b6be38-9623-4585-8e19-204e0c343680 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:50.833063 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-15b6be38-9623-4585-8e19-204e0c343680 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:50.834561 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-15b6be38-9623-4585-8e19-204e0c343680 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:50.835018 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-15b6be38-9623-4585-8e19-204e0c343680 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:50.835633 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-15b6be38-9623-4585-8e19-204e0c343680 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:50.903730 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5f35390e-9919-4e66-bb90-9e98caf605c8 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-704546498", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:50.969315 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-5f35390e-9919-4e66-bb90-9e98caf605c8 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] validate_networks() for None {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:34:51.395387 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-15b6be38-9623-4585-8e19-204e0c343680 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf50aa8e899648418eace99975616e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6aa32dd3904f6aaae1e63fcc67b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:51.425473 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-15b6be38-9623-4585-8e19-204e0c343680 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] 10.222.0.79 "GET /compute/v2.1/servers/0b3dc4f1-f80f-427f-908e-9272cd17af3b" status: 200 len: 1320 microversion: 2.1 time: 0.608179 Oct 17 13:34:51.439896 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 214/431] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:50 2022] GET /compute/v2.1/servers/0b3dc4f1-f80f-427f-908e-9272cd17af3b => generated 1320 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:51.446036 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c150dbfd-1317-4647-81ea-ed981b96ad16 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:51.446803 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c150dbfd-1317-4647-81ea-ed981b96ad16 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] [instance: 9c273b0a-71a1-4d2a-9fd8-07f96dd506f7] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:51.455015 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c150dbfd-1317-4647-81ea-ed981b96ad16 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:51.455616 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c150dbfd-1317-4647-81ea-ed981b96ad16 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:51.456074 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c150dbfd-1317-4647-81ea-ed981b96ad16 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:51.456794 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c150dbfd-1317-4647-81ea-ed981b96ad16 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:51.457505 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c150dbfd-1317-4647-81ea-ed981b96ad16 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:51.458065 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c150dbfd-1317-4647-81ea-ed981b96ad16 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:51.731121 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-5f35390e-9919-4e66-bb90-9e98caf605c8 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:34:51.731693 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-5f35390e-9919-4e66-bb90-9e98caf605c8 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:34:51.732188 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-5f35390e-9919-4e66-bb90-9e98caf605c8 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:34:51.732588 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-5f35390e-9919-4e66-bb90-9e98caf605c8 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:34:51.733145 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-5f35390e-9919-4e66-bb90-9e98caf605c8 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:34:51.742673 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5f35390e-9919-4e66-bb90-9e98caf605c8 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:51.743791 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5f35390e-9919-4e66-bb90-9e98caf605c8 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:51.744336 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5f35390e-9919-4e66-bb90-9e98caf605c8 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:51.745230 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5f35390e-9919-4e66-bb90-9e98caf605c8 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:51.745713 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5f35390e-9919-4e66-bb90-9e98caf605c8 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:51.746148 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5f35390e-9919-4e66-bb90-9e98caf605c8 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:51.767224 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-5f35390e-9919-4e66-bb90-9e98caf605c8 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Getting quotas for project aa06a29e779e413484cdfcb27e902525. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:34:51.774426 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-5f35390e-9919-4e66-bb90-9e98caf605c8 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Getting quotas for user 4a685773acdb415591f62ccee7157b6a and project aa06a29e779e413484cdfcb27e902525. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:34:51.789219 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5f35390e-9919-4e66-bb90-9e98caf605c8 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:34:51.791456 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c150dbfd-1317-4647-81ea-ed981b96ad16 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af22b1e15d34b558227dee66ffe5f40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb83705372f45308cce206fb991c011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:51.792652 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5f35390e-9919-4e66-bb90-9e98caf605c8 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] [instance: f0067ca2-1063-4f5b-901d-d766e56afa39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:34:51.799120 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:34:51.817332 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c150dbfd-1317-4647-81ea-ed981b96ad16 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] 10.222.0.79 "GET /compute/v2.1/servers/9c273b0a-71a1-4d2a-9fd8-07f96dd506f7" status: 200 len: 1469 microversion: 2.1 time: 0.379137 Oct 17 13:34:51.821270 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 215/432] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:51 2022] GET /compute/v2.1/servers/9c273b0a-71a1-4d2a-9fd8-07f96dd506f7 => generated 1469 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:51.834408 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6f7f010e-74a8-4599-a8d9-e11c3607d53c tempest-QuotasAdminTestV257-795041839 tempest-QuotasAdminTestV257-795041839-project-admin] Action: 'update', calling method: .version_select at 0x7f7cd5e2a550>, body: {"quota_set": {"ram": "2048"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:51.874897 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5f35390e-9919-4e66-bb90-9e98caf605c8 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.078503 Oct 17 13:34:51.877966 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 218/433] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:34:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1096 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:34:51.883426 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3c60f384-2ad2-4690-88c0-d63a686ac2b3 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:51.890756 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3c60f384-2ad2-4690-88c0-d63a686ac2b3 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 32728e12-4f3f-4f72-902c-10349708549f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:51.901864 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3c60f384-2ad2-4690-88c0-d63a686ac2b3 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:51.902534 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3c60f384-2ad2-4690-88c0-d63a686ac2b3 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:51.903640 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3c60f384-2ad2-4690-88c0-d63a686ac2b3 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:51.904355 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3c60f384-2ad2-4690-88c0-d63a686ac2b3 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:51.904805 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3c60f384-2ad2-4690-88c0-d63a686ac2b3 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:51.905227 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3c60f384-2ad2-4690-88c0-d63a686ac2b3 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:51.938808 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6f7f010e-74a8-4599-a8d9-e11c3607d53c tempest-QuotasAdminTestV257-795041839 tempest-QuotasAdminTestV257-795041839-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:51.939809 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6f7f010e-74a8-4599-a8d9-e11c3607d53c tempest-QuotasAdminTestV257-795041839 tempest-QuotasAdminTestV257-795041839-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:51.940319 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6f7f010e-74a8-4599-a8d9-e11c3607d53c tempest-QuotasAdminTestV257-795041839 tempest-QuotasAdminTestV257-795041839-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:51.941258 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6f7f010e-74a8-4599-a8d9-e11c3607d53c tempest-QuotasAdminTestV257-795041839 tempest-QuotasAdminTestV257-795041839-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:51.941801 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6f7f010e-74a8-4599-a8d9-e11c3607d53c tempest-QuotasAdminTestV257-795041839 tempest-QuotasAdminTestV257-795041839-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:51.942283 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6f7f010e-74a8-4599-a8d9-e11c3607d53c tempest-QuotasAdminTestV257-795041839 tempest-QuotasAdminTestV257-795041839-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:51.982187 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6f7f010e-74a8-4599-a8d9-e11c3607d53c tempest-QuotasAdminTestV257-795041839 tempest-QuotasAdminTestV257-795041839-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:51.982671 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6f7f010e-74a8-4599-a8d9-e11c3607d53c tempest-QuotasAdminTestV257-795041839 tempest-QuotasAdminTestV257-795041839-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:51.983105 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6f7f010e-74a8-4599-a8d9-e11c3607d53c tempest-QuotasAdminTestV257-795041839 tempest-QuotasAdminTestV257-795041839-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:51.983873 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6f7f010e-74a8-4599-a8d9-e11c3607d53c tempest-QuotasAdminTestV257-795041839 tempest-QuotasAdminTestV257-795041839-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:51.984322 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6f7f010e-74a8-4599-a8d9-e11c3607d53c tempest-QuotasAdminTestV257-795041839 tempest-QuotasAdminTestV257-795041839-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:51.984740 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6f7f010e-74a8-4599-a8d9-e11c3607d53c tempest-QuotasAdminTestV257-795041839 tempest-QuotasAdminTestV257-795041839-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:52.023341 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=10,nova_api:INSERT=9 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:34:52.025520 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3c60f384-2ad2-4690-88c0-d63a686ac2b3 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:52.037313 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3c60f384-2ad2-4690-88c0-d63a686ac2b3 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/32728e12-4f3f-4f72-902c-10349708549f" status: 200 len: 1275 microversion: 2.1 time: 0.155603 Oct 17 13:34:52.052125 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 219/434] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:51 2022] GET /compute/v2.1/servers/32728e12-4f3f-4f72-902c-10349708549f => generated 1275 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:52.062717 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1f25642c-364d-4eb9-b1e7-3a402254d3c3 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:52.064107 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1f25642c-364d-4eb9-b1e7-3a402254d3c3 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: 85444f54-9792-4b13-90dc-d698bc57b60b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:52.071221 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1f25642c-364d-4eb9-b1e7-3a402254d3c3 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:52.073198 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1f25642c-364d-4eb9-b1e7-3a402254d3c3 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:52.073933 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1f25642c-364d-4eb9-b1e7-3a402254d3c3 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:52.075004 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1f25642c-364d-4eb9-b1e7-3a402254d3c3 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:52.075852 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1f25642c-364d-4eb9-b1e7-3a402254d3c3 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:52.076427 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1f25642c-364d-4eb9-b1e7-3a402254d3c3 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:52.102320 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6f7f010e-74a8-4599-a8d9-e11c3607d53c tempest-QuotasAdminTestV257-795041839 tempest-QuotasAdminTestV257-795041839-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-sets/b228cd508f6c4d87b0b2855652c6c099?user_id=78062878fd4b4f8697e3a4a50362c907" status: 200 len: 148 microversion: 2.57 time: 0.279409 Oct 17 13:34:52.104400 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 216/435] 10.222.0.79 () {62 vars in 1384 bytes} [Mon Oct 17 13:34:51 2022] PUT /compute/v2.1/os-quota-sets/b228cd508f6c4d87b0b2855652c6c099?user_id=78062878fd4b4f8697e3a4a50362c907 => generated 148 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:34:52.119279 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-09083cc6-30c6-4862-8219-51d2987095ed tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:52.119969 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-09083cc6-30c6-4862-8219-51d2987095ed tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] [instance: b88e31f9-509c-4944-9622-350312d2bac1] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:52.132781 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-09083cc6-30c6-4862-8219-51d2987095ed tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:52.133268 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-09083cc6-30c6-4862-8219-51d2987095ed tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:52.133694 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-09083cc6-30c6-4862-8219-51d2987095ed tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:52.134625 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-09083cc6-30c6-4862-8219-51d2987095ed tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:52.141484 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-09083cc6-30c6-4862-8219-51d2987095ed tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:52.142418 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-09083cc6-30c6-4862-8219-51d2987095ed tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:52.481349 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-09083cc6-30c6-4862-8219-51d2987095ed tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ca1489f0084089a47d0cfc2ad37940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a297ddf04b4b18ae7591e107e84d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:52.493469 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-09083cc6-30c6-4862-8219-51d2987095ed tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] 10.222.0.79 "GET /compute/v2.1/servers/b88e31f9-509c-4944-9622-350312d2bac1" status: 200 len: 1460 microversion: 2.1 time: 0.388165 Oct 17 13:34:52.514538 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 217/436] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:52 2022] GET /compute/v2.1/servers/b88e31f9-509c-4944-9622-350312d2bac1 => generated 1460 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:52.522801 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-211d7311-aff4-440f-bc59-a1ccd1226d2a tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:52.523559 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-211d7311-aff4-440f-bc59-a1ccd1226d2a tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] [instance: f0067ca2-1063-4f5b-901d-d766e56afa39] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:52.573863 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1f25642c-364d-4eb9-b1e7-3a402254d3c3 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:52.581942 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1f25642c-364d-4eb9-b1e7-3a402254d3c3 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/85444f54-9792-4b13-90dc-d698bc57b60b" status: 200 len: 1311 microversion: 2.1 time: 0.528354 Oct 17 13:34:52.582619 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 220/437] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:52 2022] GET /compute/v2.1/servers/85444f54-9792-4b13-90dc-d698bc57b60b => generated 1311 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:52.587474 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a5cadbc7-913c-4856-83e0-794f815edbd3 tempest-QuotasAdminTestV257-795041839 tempest-QuotasAdminTestV257-795041839-project-admin] Calling method '.version_select at 0x7f7cd5e70c10>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:52.650768 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-211d7311-aff4-440f-bc59-a1ccd1226d2a tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a685773acdb415591f62ccee7157b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa06a29e779e413484cdfcb27e902525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:52.672969 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-211d7311-aff4-440f-bc59-a1ccd1226d2a tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] 10.222.0.79 "GET /compute/v2.1/servers/f0067ca2-1063-4f5b-901d-d766e56afa39" status: 200 len: 1221 microversion: 2.1 time: 0.156719 Oct 17 13:34:52.674072 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 218/438] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:52 2022] GET /compute/v2.1/servers/f0067ca2-1063-4f5b-901d-d766e56afa39 => generated 1221 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:52.692617 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-343716b2-3950-4f73-860b-c7c2b4b63406 req-5ef9bf1e-e78c-43b3-8b71-57bda26aefdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c273b0a-71a1-4d2a-9fd8-07f96dd506f7", "name": "network-vif-deleted", "tag": "9fc2f948-434c-4d68-b59b-66b02bd7568a"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:52.712476 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-343716b2-3950-4f73-860b-c7c2b4b63406 req-5ef9bf1e-e78c-43b3-8b71-57bda26aefdd service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:52.713242 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-343716b2-3950-4f73-860b-c7c2b4b63406 req-5ef9bf1e-e78c-43b3-8b71-57bda26aefdd service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:52.713673 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-343716b2-3950-4f73-860b-c7c2b4b63406 req-5ef9bf1e-e78c-43b3-8b71-57bda26aefdd service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:52.725984 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-343716b2-3950-4f73-860b-c7c2b4b63406 req-5ef9bf1e-e78c-43b3-8b71-57bda26aefdd service nova] Creating event network-vif-deleted:9fc2f948-434c-4d68-b59b-66b02bd7568a for instance 9c273b0a-71a1-4d2a-9fd8-07f96dd506f7 on n-h2-854247-14 Oct 17 13:34:52.731463 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-343716b2-3950-4f73-860b-c7c2b4b63406 req-5ef9bf1e-e78c-43b3-8b71-57bda26aefdd service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056189 Oct 17 13:34:52.732353 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 219/439] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:52.738444 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a5cadbc7-913c-4856-83e0-794f815edbd3 tempest-QuotasAdminTestV257-795041839 tempest-QuotasAdminTestV257-795041839-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/b228cd508f6c4d87b0b2855652c6c099?user_id=78062878fd4b4f8697e3a4a50362c907" status: 200 len: 190 microversion: 2.57 time: 0.154619 Oct 17 13:34:52.739136 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 221/440] 10.222.0.79 () {60 vars in 1364 bytes} [Mon Oct 17 13:34:52 2022] GET /compute/v2.1/os-quota-sets/b228cd508f6c4d87b0b2855652c6c099?user_id=78062878fd4b4f8697e3a4a50362c907 => generated 190 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:34:52.740334 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-2fd81b28-86f0-4cd1-9d68-c73e2710d04b req-d1d38b5b-383d-45ee-bc19-e27ac8e2470e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85444f54-9792-4b13-90dc-d698bc57b60b", "name": "network-vif-plugged", "status": "completed", "tag": "48dfe136-d328-4b93-bfb8-302d0ec30369"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:52.744229 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ea89b826-541e-4c0e-806e-9d26b0c84add tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:52.745038 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ea89b826-541e-4c0e-806e-9d26b0c84add tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] [instance: 0b3dc4f1-f80f-427f-908e-9272cd17af3b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:52.751233 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ea89b826-541e-4c0e-806e-9d26b0c84add tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:52.751727 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ea89b826-541e-4c0e-806e-9d26b0c84add tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:52.752164 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ea89b826-541e-4c0e-806e-9d26b0c84add tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:52.753053 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ea89b826-541e-4c0e-806e-9d26b0c84add tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:52.753497 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ea89b826-541e-4c0e-806e-9d26b0c84add tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:52.754401 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ea89b826-541e-4c0e-806e-9d26b0c84add tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:52.764182 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-2fd81b28-86f0-4cd1-9d68-c73e2710d04b req-d1d38b5b-383d-45ee-bc19-e27ac8e2470e service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:52.764849 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-2fd81b28-86f0-4cd1-9d68-c73e2710d04b req-d1d38b5b-383d-45ee-bc19-e27ac8e2470e service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:52.765619 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-2fd81b28-86f0-4cd1-9d68-c73e2710d04b req-d1d38b5b-383d-45ee-bc19-e27ac8e2470e service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:52.778412 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-2fd81b28-86f0-4cd1-9d68-c73e2710d04b req-d1d38b5b-383d-45ee-bc19-e27ac8e2470e service nova] Creating event network-vif-plugged:48dfe136-d328-4b93-bfb8-302d0ec30369 for instance 85444f54-9792-4b13-90dc-d698bc57b60b on n-h1-854247-14 Oct 17 13:34:52.784225 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-2fd81b28-86f0-4cd1-9d68-c73e2710d04b req-d1d38b5b-383d-45ee-bc19-e27ac8e2470e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050276 Oct 17 13:34:52.785305 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 220/441] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:52.790935 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-93ecb388-95ae-4dc5-8d8f-872d96a845ad tempest-LiveMigrationNegativeTest-1945319370 tempest-LiveMigrationNegativeTest-1945319370-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:52.791810 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-93ecb388-95ae-4dc5-8d8f-872d96a845ad tempest-LiveMigrationNegativeTest-1945319370 tempest-LiveMigrationNegativeTest-1945319370-project-admin] [instance: b88e31f9-509c-4944-9622-350312d2bac1] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:52.798824 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-93ecb388-95ae-4dc5-8d8f-872d96a845ad tempest-LiveMigrationNegativeTest-1945319370 tempest-LiveMigrationNegativeTest-1945319370-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:52.799355 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-93ecb388-95ae-4dc5-8d8f-872d96a845ad tempest-LiveMigrationNegativeTest-1945319370 tempest-LiveMigrationNegativeTest-1945319370-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:52.799974 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-93ecb388-95ae-4dc5-8d8f-872d96a845ad tempest-LiveMigrationNegativeTest-1945319370 tempest-LiveMigrationNegativeTest-1945319370-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:52.800924 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-93ecb388-95ae-4dc5-8d8f-872d96a845ad tempest-LiveMigrationNegativeTest-1945319370 tempest-LiveMigrationNegativeTest-1945319370-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:52.801615 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-93ecb388-95ae-4dc5-8d8f-872d96a845ad tempest-LiveMigrationNegativeTest-1945319370 tempest-LiveMigrationNegativeTest-1945319370-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:52.802217 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-93ecb388-95ae-4dc5-8d8f-872d96a845ad tempest-LiveMigrationNegativeTest-1945319370 tempest-LiveMigrationNegativeTest-1945319370-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:53.129205 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ea89b826-541e-4c0e-806e-9d26b0c84add tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf50aa8e899648418eace99975616e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6aa32dd3904f6aaae1e63fcc67b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:53.139612 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ea89b826-541e-4c0e-806e-9d26b0c84add tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] 10.222.0.79 "GET /compute/v2.1/servers/0b3dc4f1-f80f-427f-908e-9272cd17af3b" status: 200 len: 1469 microversion: 2.1 time: 0.399176 Oct 17 13:34:53.140658 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 222/442] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:52 2022] GET /compute/v2.1/servers/0b3dc4f1-f80f-427f-908e-9272cd17af3b => generated 1469 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:53.145444 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-24b0c069-31dd-4291-933b-214ea20315b8 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:53.146140 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-24b0c069-31dd-4291-933b-214ea20315b8 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] [instance: 9c273b0a-71a1-4d2a-9fd8-07f96dd506f7] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:53.152680 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-24b0c069-31dd-4291-933b-214ea20315b8 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:53.153376 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-24b0c069-31dd-4291-933b-214ea20315b8 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:53.154047 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-24b0c069-31dd-4291-933b-214ea20315b8 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:53.154841 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-24b0c069-31dd-4291-933b-214ea20315b8 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:53.155396 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-24b0c069-31dd-4291-933b-214ea20315b8 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:53.156026 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-24b0c069-31dd-4291-933b-214ea20315b8 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:53.170796 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-24b0c069-31dd-4291-933b-214ea20315b8 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] HTTP exception thrown: Instance 9c273b0a-71a1-4d2a-9fd8-07f96dd506f7 could not be found. Oct 17 13:34:53.173155 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-24b0c069-31dd-4291-933b-214ea20315b8 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Request method failure captured: Oct 17 13:34:53.173155 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/9c273b0a-71a1-4d2a-9fd8-07f96dd506f7 HTTP/1.1 Oct 17 13:34:53.173155 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:34:53.173155 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:34:53.173155 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:34:53.173155 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:34:53.173155 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:34:53.173155 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:34:53.173155 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:34:53.173155 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:34:53.173155 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVngNklBmIDXYdGA_KyThmswr2cJGMja0tXqQYxbrFWHql1axxoZneRQa_C1jJ0Mz8bk7VEQCWGmb6S45jbRMxfaCYTknF2-7LKuWcQvJVXYAwa7FbDEnAQqOGhGchKH5hgb48gj018oK-gp0L4H-zZFoaF-dErihUW5wdr3g6gzoLA Oct 17 13:34:53.173155 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:34:53.173155 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:34:53.173155 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:34:53.173155 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:34:53.173155 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:34:53.173155 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:34:53.173155 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 0bb83705372f45308cce206fb991c011 Oct 17 13:34:53.173155 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-TenantUsagesTestJSON-1686762187 Oct 17 13:34:53.173155 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:34:53.173155 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:34:53.174660 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0bb83705372f45308cce206fb991c011"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0bb83705372f45308cce206fb991c011"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0bb83705372f45308cce206fb991c011"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0bb83705372f45308cce206fb991c011", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:34:53.174660 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-TenantUsagesTestJSON-1686762187 Oct 17 13:34:53.174660 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 0bb83705372f45308cce206fb991c011 Oct 17 13:34:53.174660 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1686762187 Oct 17 13:34:53.174660 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-TenantUsagesTestJSON-1686762187-project Oct 17 13:34:53.174660 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:34:53.174660 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:34:53.174660 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 0af22b1e15d34b558227dee66ffe5f40 Oct 17 13:34:53.174660 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-TenantUsagesTestJSON-1686762187-project Oct 17 13:34:53.174660 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:34:53.174660 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 9c273b0a-71a1-4d2a-9fd8-07f96dd506f7 could not be found. Oct 17 13:34:53.174660 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '9c273b0a-71a1-4d2a-9fd8-07f96dd506f7'} Oct 17 13:34:53.175444 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:34:53.175444 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:53.175444 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:34:53.175444 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:34:53.175444 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:34:53.175444 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:34:53.175444 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:34:53.175444 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:34:53.175444 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:34:53.175444 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:34:53.175444 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c273b0a-71a1-4d2a-9fd8-07f96dd506f7 could not be found. Oct 17 13:34:53.175444 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:53.175444 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:53.175444 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:53.175444 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:53.175444 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:53.175444 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:53.175444 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:34:53.175444 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:34:53.175444 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:34:53.176655 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:34:53.176655 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:34:53.176655 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:34:53.176655 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:34:53.176655 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:34:53.176655 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:34:53.176655 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:34:53.176655 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c273b0a-71a1-4d2a-9fd8-07f96dd506f7 could not be found. Oct 17 13:34:53.176655 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:53.176655 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:53.176655 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:53.176655 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:53.176655 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:53.176655 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:53.176655 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:34:53.176655 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:34:53.176655 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c273b0a-71a1-4d2a-9fd8-07f96dd506f7 could not be found. Oct 17 13:34:53.176655 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:34:53.177693 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-24b0c069-31dd-4291-933b-214ea20315b8 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] Returning 404 to user: Instance 9c273b0a-71a1-4d2a-9fd8-07f96dd506f7 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:34:53.178340 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-24b0c069-31dd-4291-933b-214ea20315b8 tempest-TenantUsagesTestJSON-1686762187 tempest-TenantUsagesTestJSON-1686762187-project] 10.222.0.79 "GET /compute/v2.1/servers/9c273b0a-71a1-4d2a-9fd8-07f96dd506f7" status: 404 len: 111 microversion: 2.1 time: 0.036155 Oct 17 13:34:53.178961 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 223/443] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:53 2022] GET /compute/v2.1/servers/9c273b0a-71a1-4d2a-9fd8-07f96dd506f7 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:34:53.185434 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6bbfd5ab-8c94-4b72-8790-7cc98fc00ab5 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:53.185967 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6bbfd5ab-8c94-4b72-8790-7cc98fc00ab5 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 32728e12-4f3f-4f72-902c-10349708549f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:53.195625 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6bbfd5ab-8c94-4b72-8790-7cc98fc00ab5 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:53.195625 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6bbfd5ab-8c94-4b72-8790-7cc98fc00ab5 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:53.196000 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6bbfd5ab-8c94-4b72-8790-7cc98fc00ab5 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:53.197052 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6bbfd5ab-8c94-4b72-8790-7cc98fc00ab5 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:53.197397 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6bbfd5ab-8c94-4b72-8790-7cc98fc00ab5 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:53.197815 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6bbfd5ab-8c94-4b72-8790-7cc98fc00ab5 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:53.542297 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-93ecb388-95ae-4dc5-8d8f-872d96a845ad tempest-LiveMigrationNegativeTest-1945319370 tempest-LiveMigrationNegativeTest-1945319370-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/b88e31f9-509c-4944-9622-350312d2bac1" status: 200 len: 1613 microversion: 2.1 time: 0.755525 Oct 17 13:34:53.559943 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6bbfd5ab-8c94-4b72-8790-7cc98fc00ab5 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:53.561657 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 221/444] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:52 2022] GET /compute/v2.1/servers/b88e31f9-509c-4944-9622-350312d2bac1 => generated 1613 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:53.568797 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6bbfd5ab-8c94-4b72-8790-7cc98fc00ab5 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/32728e12-4f3f-4f72-902c-10349708549f" status: 200 len: 1317 microversion: 2.1 time: 0.388728 Oct 17 13:34:53.569364 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 224/445] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:53 2022] GET /compute/v2.1/servers/32728e12-4f3f-4f72-902c-10349708549f => generated 1317 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:53.581172 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f5eed540-da07-4a79-9d66-b4650d048642 tempest-LiveMigrationNegativeTest-1945319370 tempest-LiveMigrationNegativeTest-1945319370-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:53.591455 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f5eed540-da07-4a79-9d66-b4650d048642 tempest-LiveMigrationNegativeTest-1945319370 tempest-LiveMigrationNegativeTest-1945319370-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:53.592041 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f5eed540-da07-4a79-9d66-b4650d048642 tempest-LiveMigrationNegativeTest-1945319370 tempest-LiveMigrationNegativeTest-1945319370-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:53.593111 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f5eed540-da07-4a79-9d66-b4650d048642 tempest-LiveMigrationNegativeTest-1945319370 tempest-LiveMigrationNegativeTest-1945319370-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:53.593918 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f5eed540-da07-4a79-9d66-b4650d048642 tempest-LiveMigrationNegativeTest-1945319370 tempest-LiveMigrationNegativeTest-1945319370-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:53.595038 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f5eed540-da07-4a79-9d66-b4650d048642 tempest-LiveMigrationNegativeTest-1945319370 tempest-LiveMigrationNegativeTest-1945319370-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:53.595552 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f5eed540-da07-4a79-9d66-b4650d048642 tempest-LiveMigrationNegativeTest-1945319370 tempest-LiveMigrationNegativeTest-1945319370-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:53.650299 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f5eed540-da07-4a79-9d66-b4650d048642 tempest-LiveMigrationNegativeTest-1945319370 tempest-LiveMigrationNegativeTest-1945319370-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.078278 Oct 17 13:34:53.659884 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 225/446] 10.222.0.79 () {58 vars in 1176 bytes} [Mon Oct 17 13:34:53 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:53.664920 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-93b7e515-e805-4c6f-89bd-e69a8ae34d35 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:53.668444 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-93b7e515-e805-4c6f-89bd-e69a8ae34d35 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: 85444f54-9792-4b13-90dc-d698bc57b60b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:53.677510 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-93b7e515-e805-4c6f-89bd-e69a8ae34d35 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:53.678339 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-93b7e515-e805-4c6f-89bd-e69a8ae34d35 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:53.679005 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-93b7e515-e805-4c6f-89bd-e69a8ae34d35 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:53.679931 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-93b7e515-e805-4c6f-89bd-e69a8ae34d35 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:53.680385 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-93b7e515-e805-4c6f-89bd-e69a8ae34d35 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:53.680835 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-93b7e515-e805-4c6f-89bd-e69a8ae34d35 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:53.696971 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:34:53.870109 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-37b574f9-f452-491a-a565-0a9931d091ee tempest-DeleteServersAdminTestJSON-704160048 tempest-DeleteServersAdminTestJSON-704160048-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:53.870632 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-37b574f9-f452-491a-a565-0a9931d091ee tempest-DeleteServersAdminTestJSON-704160048 tempest-DeleteServersAdminTestJSON-704160048-project-admin] [instance: 0b3dc4f1-f80f-427f-908e-9272cd17af3b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:53.878117 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-37b574f9-f452-491a-a565-0a9931d091ee tempest-DeleteServersAdminTestJSON-704160048 tempest-DeleteServersAdminTestJSON-704160048-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:53.878870 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-37b574f9-f452-491a-a565-0a9931d091ee tempest-DeleteServersAdminTestJSON-704160048 tempest-DeleteServersAdminTestJSON-704160048-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:53.879563 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-37b574f9-f452-491a-a565-0a9931d091ee tempest-DeleteServersAdminTestJSON-704160048 tempest-DeleteServersAdminTestJSON-704160048-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:53.880316 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-37b574f9-f452-491a-a565-0a9931d091ee tempest-DeleteServersAdminTestJSON-704160048 tempest-DeleteServersAdminTestJSON-704160048-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:53.880827 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-37b574f9-f452-491a-a565-0a9931d091ee tempest-DeleteServersAdminTestJSON-704160048 tempest-DeleteServersAdminTestJSON-704160048-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:53.881568 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-37b574f9-f452-491a-a565-0a9931d091ee tempest-DeleteServersAdminTestJSON-704160048 tempest-DeleteServersAdminTestJSON-704160048-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:53.917838 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-37b574f9-f452-491a-a565-0a9931d091ee tempest-DeleteServersAdminTestJSON-704160048 tempest-DeleteServersAdminTestJSON-704160048-project-admin] [instance: 0b3dc4f1-f80f-427f-908e-9272cd17af3b] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:34:54.021797 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-37b574f9-f452-491a-a565-0a9931d091ee tempest-DeleteServersAdminTestJSON-704160048 tempest-DeleteServersAdminTestJSON-704160048-project-admin] 10.222.0.79 "DELETE /compute/v2.1/servers/0b3dc4f1-f80f-427f-908e-9272cd17af3b" status: 204 len: 0 microversion: 2.1 time: 0.458135 Oct 17 13:34:54.022335 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 222/447] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:34:53 2022] DELETE /compute/v2.1/servers/0b3dc4f1-f80f-427f-908e-9272cd17af3b => generated 0 bytes in 460 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:34:54.030173 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ca69e56e-924d-4143-9024-eea0c4a86132 tempest-LiveMigrationNegativeTest-1945319370 tempest-LiveMigrationNegativeTest-1945319370-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-854247-14", "block_migration": true, "disk_over_commit": false}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:54.033384 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ca69e56e-924d-4143-9024-eea0c4a86132 tempest-LiveMigrationNegativeTest-1945319370 tempest-LiveMigrationNegativeTest-1945319370-project-admin] [instance: b88e31f9-509c-4944-9622-350312d2bac1] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:54.040228 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ca69e56e-924d-4143-9024-eea0c4a86132 tempest-LiveMigrationNegativeTest-1945319370 tempest-LiveMigrationNegativeTest-1945319370-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:54.040720 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ca69e56e-924d-4143-9024-eea0c4a86132 tempest-LiveMigrationNegativeTest-1945319370 tempest-LiveMigrationNegativeTest-1945319370-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:54.041148 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ca69e56e-924d-4143-9024-eea0c4a86132 tempest-LiveMigrationNegativeTest-1945319370 tempest-LiveMigrationNegativeTest-1945319370-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:54.041851 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ca69e56e-924d-4143-9024-eea0c4a86132 tempest-LiveMigrationNegativeTest-1945319370 tempest-LiveMigrationNegativeTest-1945319370-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:54.042487 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ca69e56e-924d-4143-9024-eea0c4a86132 tempest-LiveMigrationNegativeTest-1945319370 tempest-LiveMigrationNegativeTest-1945319370-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:54.042914 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ca69e56e-924d-4143-9024-eea0c4a86132 tempest-LiveMigrationNegativeTest-1945319370 tempest-LiveMigrationNegativeTest-1945319370-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:54.069772 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-ca69e56e-924d-4143-9024-eea0c4a86132 tempest-LiveMigrationNegativeTest-1945319370 tempest-LiveMigrationNegativeTest-1945319370-project-admin] Lazy-loading 'flavor' on Instance uuid b88e31f9-509c-4944-9622-350312d2bac1 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:34:54.083011 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-ca69e56e-924d-4143-9024-eea0c4a86132 tempest-LiveMigrationNegativeTest-1945319370 tempest-LiveMigrationNegativeTest-1945319370-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance b88e31f9-509c-4944-9622-350312d2bac1 while it is in vm_state suspended Oct 17 13:34:54.085680 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ca69e56e-924d-4143-9024-eea0c4a86132 tempest-LiveMigrationNegativeTest-1945319370 tempest-LiveMigrationNegativeTest-1945319370-project-admin] Request method failure captured: Oct 17 13:34:54.085680 n-d-854247-14 devstack@n-api.service[127016]: request: POST /compute/v2.1/servers/b88e31f9-509c-4944-9622-350312d2bac1/action HTTP/1.1 Oct 17 13:34:54.085680 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:34:54.085680 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:34:54.085680 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:34:54.085680 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 98 Oct 17 13:34:54.085680 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:34:54.085680 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:34:54.085680 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:34:54.085680 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:34:54.085680 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVnKAqFGZiyIvavH5YennIf8z1RcHY7tR7vO_BT1YdOopOREMPZcyL5nCgNv53xdZuvwWsUdeNoYWLZtMCf07w8IINfTYzeIS36JoWgV72d3g1KWgAATPiA4r7Ubi8PlRPSDEMjKnxLKAnxRPBFSks9eduowV_Y1Gb206RxTsEebSNA Oct 17 13:34:54.085680 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:34:54.085680 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:34:54.085680 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:34:54.085680 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:34:54.085680 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:34:54.085680 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:34:54.085680 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 9559b28086774d9c8a7cde45d41d7a64 Oct 17 13:34:54.085680 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-LiveMigrationNegativeTest-1945319370 Oct 17 13:34:54.085680 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member,admin Oct 17 13:34:54.085680 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member,admin Oct 17 13:34:54.086890 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9559b28086774d9c8a7cde45d41d7a64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/9559b28086774d9c8a7cde45d41d7a64"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9559b28086774d9c8a7cde45d41d7a64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_9559b28086774d9c8a7cde45d41d7a64", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:34:54.086890 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-LiveMigrationNegativeTest-1945319370 Oct 17 13:34:54.086890 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 9559b28086774d9c8a7cde45d41d7a64 Oct 17 13:34:54.086890 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1945319370 Oct 17 13:34:54.086890 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-LiveMigrationNegativeTest-1945319370-project-admin Oct 17 13:34:54.086890 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:34:54.086890 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:34:54.086890 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 54fdea8daa80456e89ed049c76437543 Oct 17 13:34:54.086890 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-LiveMigrationNegativeTest-1945319370-project-admin Oct 17 13:34:54.086890 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:34:54.086890 n-d-854247-14 devstack@n-api.service[127016]: {"os-migrateLive": {"host": "n-h1-854247-14", "block_migration": true, "disk_over_commit": false}} Oct 17 13:34:54.086890 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:34:54.088348 n-d-854247-14 devstack@n-api.service[127016]: exception: Cannot 'os-migrateLive' instance b88e31f9-509c-4944-9622-350312d2bac1 while it is in vm_state suspended Oct 17 13:34:54.088348 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'b88e31f9-509c-4944-9622-350312d2bac1', 'body': {'os-migrateLive': {'host': 'n-h1-854247-14', 'block_migration': True, 'disk_over_commit': False}}} Oct 17 13:34:54.088348 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:34:54.088348 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:54.088348 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 17 13:34:54.088348 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 17 13:34:54.088348 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 17 13:34:54.088348 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:34:54.088348 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 17 13:34:54.088348 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 13:34:54.088348 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 17 13:34:54.088348 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 13:34:54.088348 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 17 13:34:54.088348 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 13:34:54.088348 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 17 13:34:54.088348 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 13:34:54.088348 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 17 13:34:54.088348 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 13:34:54.094776 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 13:34:54.094776 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:34:54.094776 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 13:34:54.094776 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 13:34:54.094776 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b88e31f9-509c-4944-9622-350312d2bac1 in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 17 13:34:54.094776 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:54.094776 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:54.094776 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:54.094776 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:54.094776 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:54.094776 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:54.094776 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:34:54.094776 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:34:54.094776 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:34:54.094776 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:34:54.094776 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:34:54.094776 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:34:54.094776 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:34:54.094776 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:34:54.094776 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:34:54.097579 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:34:54.097579 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 17 13:34:54.097579 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 17 13:34:54.097579 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 17 13:34:54.097579 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 13:34:54.097579 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 13:34:54.097579 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance b88e31f9-509c-4944-9622-350312d2bac1 while it is in vm_state suspended Oct 17 13:34:54.097579 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:54.097579 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:54.097579 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:54.097579 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:54.097579 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:54.097579 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:54.097579 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:34:54.097579 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:34:54.097579 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance b88e31f9-509c-4944-9622-350312d2bac1 while it is in vm_state suspended Oct 17 13:34:54.097579 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:34:54.099591 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ca69e56e-924d-4143-9024-eea0c4a86132 tempest-LiveMigrationNegativeTest-1945319370 tempest-LiveMigrationNegativeTest-1945319370-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance b88e31f9-509c-4944-9622-350312d2bac1 while it is in vm_state suspended {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:34:54.099715 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-93b7e515-e805-4c6f-89bd-e69a8ae34d35 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:54.100180 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ca69e56e-924d-4143-9024-eea0c4a86132 tempest-LiveMigrationNegativeTest-1945319370 tempest-LiveMigrationNegativeTest-1945319370-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/b88e31f9-509c-4944-9622-350312d2bac1/action" status: 409 len: 155 microversion: 2.1 time: 0.063311 Oct 17 13:34:54.100180 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 223/448] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:34:54 2022] POST /compute/v2.1/servers/b88e31f9-509c-4944-9622-350312d2bac1/action => generated 155 bytes in 70 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:34:54.102985 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-476e56bc-3d1b-40a6-ae9b-499330353d53 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:54.102985 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-476e56bc-3d1b-40a6-ae9b-499330353d53 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] [instance: f0067ca2-1063-4f5b-901d-d766e56afa39] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:54.110144 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-476e56bc-3d1b-40a6-ae9b-499330353d53 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:54.110698 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-476e56bc-3d1b-40a6-ae9b-499330353d53 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:54.111247 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-476e56bc-3d1b-40a6-ae9b-499330353d53 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:54.111932 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-476e56bc-3d1b-40a6-ae9b-499330353d53 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:54.112613 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-476e56bc-3d1b-40a6-ae9b-499330353d53 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:54.113240 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-476e56bc-3d1b-40a6-ae9b-499330353d53 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:54.119426 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-93b7e515-e805-4c6f-89bd-e69a8ae34d35 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/85444f54-9792-4b13-90dc-d698bc57b60b" status: 200 len: 1311 microversion: 2.1 time: 0.456031 Oct 17 13:34:54.120471 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 226/449] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:53 2022] GET /compute/v2.1/servers/85444f54-9792-4b13-90dc-d698bc57b60b => generated 1311 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:54.126291 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-d462fc7a-a6d2-42e7-8296-2e4e12e03e0f req-4c0d538c-0aa8-4094-8b39-2f10f26bc146 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32728e12-4f3f-4f72-902c-10349708549f", "tag": "9e4bbd4c-aa1e-4e34-b511-617ea8517bf3"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:54.137205 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-d462fc7a-a6d2-42e7-8296-2e4e12e03e0f req-4c0d538c-0aa8-4094-8b39-2f10f26bc146 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:54.137683 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-d462fc7a-a6d2-42e7-8296-2e4e12e03e0f req-4c0d538c-0aa8-4094-8b39-2f10f26bc146 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:54.138118 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-d462fc7a-a6d2-42e7-8296-2e4e12e03e0f req-4c0d538c-0aa8-4094-8b39-2f10f26bc146 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:54.150789 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-d462fc7a-a6d2-42e7-8296-2e4e12e03e0f req-4c0d538c-0aa8-4094-8b39-2f10f26bc146 service nova] Creating event network-changed:9e4bbd4c-aa1e-4e34-b511-617ea8517bf3 for instance 32728e12-4f3f-4f72-902c-10349708549f on n-h2-854247-14 Oct 17 13:34:54.159359 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-d462fc7a-a6d2-42e7-8296-2e4e12e03e0f req-4c0d538c-0aa8-4094-8b39-2f10f26bc146 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037307 Oct 17 13:34:54.160135 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 227/450] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:54.165674 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7fdb7c07-7c8b-4467-bd2a-76b70d2a271d tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:54.166828 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7fdb7c07-7c8b-4467-bd2a-76b70d2a271d tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] [instance: 0b3dc4f1-f80f-427f-908e-9272cd17af3b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:54.173497 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7fdb7c07-7c8b-4467-bd2a-76b70d2a271d tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:54.174202 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7fdb7c07-7c8b-4467-bd2a-76b70d2a271d tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:54.174821 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7fdb7c07-7c8b-4467-bd2a-76b70d2a271d tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:54.175709 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7fdb7c07-7c8b-4467-bd2a-76b70d2a271d tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:54.176308 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7fdb7c07-7c8b-4467-bd2a-76b70d2a271d tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:54.177021 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7fdb7c07-7c8b-4467-bd2a-76b70d2a271d tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:54.278515 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-476e56bc-3d1b-40a6-ae9b-499330353d53 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a685773acdb415591f62ccee7157b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa06a29e779e413484cdfcb27e902525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:54.304206 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-476e56bc-3d1b-40a6-ae9b-499330353d53 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] 10.222.0.79 "GET /compute/v2.1/servers/f0067ca2-1063-4f5b-901d-d766e56afa39" status: 200 len: 1291 microversion: 2.1 time: 0.197290 Oct 17 13:34:54.304965 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 224/451] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:54 2022] GET /compute/v2.1/servers/f0067ca2-1063-4f5b-901d-d766e56afa39 => generated 1291 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:54.310223 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-64c623fc-3a22-4cfc-be8d-0ebbd39b0280 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:54.310723 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-64c623fc-3a22-4cfc-be8d-0ebbd39b0280 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] [instance: b88e31f9-509c-4944-9622-350312d2bac1] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:54.327214 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-64c623fc-3a22-4cfc-be8d-0ebbd39b0280 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:54.327716 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-64c623fc-3a22-4cfc-be8d-0ebbd39b0280 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:54.328151 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-64c623fc-3a22-4cfc-be8d-0ebbd39b0280 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:54.328866 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-64c623fc-3a22-4cfc-be8d-0ebbd39b0280 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:54.329314 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-64c623fc-3a22-4cfc-be8d-0ebbd39b0280 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:54.329828 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-64c623fc-3a22-4cfc-be8d-0ebbd39b0280 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:54.374941 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-64c623fc-3a22-4cfc-be8d-0ebbd39b0280 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] [instance: b88e31f9-509c-4944-9622-350312d2bac1] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:34:54.481923 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7fdb7c07-7c8b-4467-bd2a-76b70d2a271d tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf50aa8e899648418eace99975616e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6aa32dd3904f6aaae1e63fcc67b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:54.496963 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7fdb7c07-7c8b-4467-bd2a-76b70d2a271d tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] 10.222.0.79 "GET /compute/v2.1/servers/0b3dc4f1-f80f-427f-908e-9272cd17af3b" status: 200 len: 1475 microversion: 2.1 time: 0.334290 Oct 17 13:34:54.497665 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 228/452] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:54 2022] GET /compute/v2.1/servers/0b3dc4f1-f80f-427f-908e-9272cd17af3b => generated 1475 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:54.506572 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-64c623fc-3a22-4cfc-be8d-0ebbd39b0280 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] 10.222.0.79 "DELETE /compute/v2.1/servers/b88e31f9-509c-4944-9622-350312d2bac1" status: 204 len: 0 microversion: 2.1 time: 0.200365 Oct 17 13:34:54.510589 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 225/453] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:34:54 2022] DELETE /compute/v2.1/servers/b88e31f9-509c-4944-9622-350312d2bac1 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:34:54.520106 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-923065dc-9b96-4f51-a931-03923371fe4c tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:54.521060 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-923065dc-9b96-4f51-a931-03923371fe4c tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] [instance: b88e31f9-509c-4944-9622-350312d2bac1] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:54.527992 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-923065dc-9b96-4f51-a931-03923371fe4c tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:54.528536 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-923065dc-9b96-4f51-a931-03923371fe4c tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:54.529156 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-923065dc-9b96-4f51-a931-03923371fe4c tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:54.529794 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-923065dc-9b96-4f51-a931-03923371fe4c tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:54.530299 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-923065dc-9b96-4f51-a931-03923371fe4c tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:54.530780 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-923065dc-9b96-4f51-a931-03923371fe4c tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:54.598221 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-13cb43e8-830d-4ae8-b6e4-2d23a9381fe2 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:54.599753 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-13cb43e8-830d-4ae8-b6e4-2d23a9381fe2 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 32728e12-4f3f-4f72-902c-10349708549f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:54.608559 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-13cb43e8-830d-4ae8-b6e4-2d23a9381fe2 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:54.609053 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-13cb43e8-830d-4ae8-b6e4-2d23a9381fe2 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:54.610541 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-13cb43e8-830d-4ae8-b6e4-2d23a9381fe2 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:54.611269 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-13cb43e8-830d-4ae8-b6e4-2d23a9381fe2 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:54.611951 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-13cb43e8-830d-4ae8-b6e4-2d23a9381fe2 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:54.612504 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-13cb43e8-830d-4ae8-b6e4-2d23a9381fe2 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:54.784534 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-923065dc-9b96-4f51-a931-03923371fe4c tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ca1489f0084089a47d0cfc2ad37940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a297ddf04b4b18ae7591e107e84d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:54.801360 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-923065dc-9b96-4f51-a931-03923371fe4c tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] 10.222.0.79 "GET /compute/v2.1/servers/b88e31f9-509c-4944-9622-350312d2bac1" status: 200 len: 1466 microversion: 2.1 time: 0.285868 Oct 17 13:34:54.804281 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 229/454] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:54 2022] GET /compute/v2.1/servers/b88e31f9-509c-4944-9622-350312d2bac1 => generated 1466 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:54.892483 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-13cb43e8-830d-4ae8-b6e4-2d23a9381fe2 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:54.903712 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-13cb43e8-830d-4ae8-b6e4-2d23a9381fe2 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/32728e12-4f3f-4f72-902c-10349708549f" status: 200 len: 1317 microversion: 2.1 time: 0.312692 Oct 17 13:34:54.916259 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 226/455] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:54 2022] GET /compute/v2.1/servers/32728e12-4f3f-4f72-902c-10349708549f => generated 1317 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:34:55.144452 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b76de75b-6588-4c94-9f3c-99d8455147c1 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:55.145722 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b76de75b-6588-4c94-9f3c-99d8455147c1 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: 85444f54-9792-4b13-90dc-d698bc57b60b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:55.152968 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b76de75b-6588-4c94-9f3c-99d8455147c1 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:55.153669 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b76de75b-6588-4c94-9f3c-99d8455147c1 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:55.154267 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b76de75b-6588-4c94-9f3c-99d8455147c1 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:55.155331 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b76de75b-6588-4c94-9f3c-99d8455147c1 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:55.155970 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b76de75b-6588-4c94-9f3c-99d8455147c1 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:55.156538 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b76de75b-6588-4c94-9f3c-99d8455147c1 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:55.331678 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2b907f64-7869-4597-9eee-4a72c22288c2 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:55.333553 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2b907f64-7869-4597-9eee-4a72c22288c2 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] [instance: f0067ca2-1063-4f5b-901d-d766e56afa39] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:55.345628 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2b907f64-7869-4597-9eee-4a72c22288c2 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:55.346380 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2b907f64-7869-4597-9eee-4a72c22288c2 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:55.346977 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2b907f64-7869-4597-9eee-4a72c22288c2 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:55.348144 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2b907f64-7869-4597-9eee-4a72c22288c2 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:55.348754 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2b907f64-7869-4597-9eee-4a72c22288c2 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:55.352915 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2b907f64-7869-4597-9eee-4a72c22288c2 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:55.439461 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b76de75b-6588-4c94-9f3c-99d8455147c1 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:55.441511 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2b907f64-7869-4597-9eee-4a72c22288c2 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a685773acdb415591f62ccee7157b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa06a29e779e413484cdfcb27e902525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:55.450290 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2b907f64-7869-4597-9eee-4a72c22288c2 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] 10.222.0.79 "GET /compute/v2.1/servers/f0067ca2-1063-4f5b-901d-d766e56afa39" status: 200 len: 1279 microversion: 2.1 time: 0.124292 Oct 17 13:34:55.451354 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b76de75b-6588-4c94-9f3c-99d8455147c1 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/85444f54-9792-4b13-90dc-d698bc57b60b" status: 200 len: 1493 microversion: 2.1 time: 0.311138 Oct 17 13:34:55.464259 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 230/456] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:55 2022] GET /compute/v2.1/servers/85444f54-9792-4b13-90dc-d698bc57b60b => generated 1493 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:34:55.468045 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 227/457] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:55 2022] GET /compute/v2.1/servers/f0067ca2-1063-4f5b-901d-d766e56afa39 => generated 1279 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:55.521481 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ab137e50-221d-40af-8555-1b5f93abe622 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:55.522512 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ab137e50-221d-40af-8555-1b5f93abe622 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] [instance: 0b3dc4f1-f80f-427f-908e-9272cd17af3b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:55.528881 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ab137e50-221d-40af-8555-1b5f93abe622 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:55.529658 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ab137e50-221d-40af-8555-1b5f93abe622 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:55.530286 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ab137e50-221d-40af-8555-1b5f93abe622 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:55.531348 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ab137e50-221d-40af-8555-1b5f93abe622 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:55.532001 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ab137e50-221d-40af-8555-1b5f93abe622 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:55.532681 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ab137e50-221d-40af-8555-1b5f93abe622 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:55.806643 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ab137e50-221d-40af-8555-1b5f93abe622 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf50aa8e899648418eace99975616e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6aa32dd3904f6aaae1e63fcc67b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:55.817629 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ab137e50-221d-40af-8555-1b5f93abe622 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] 10.222.0.79 "GET /compute/v2.1/servers/0b3dc4f1-f80f-427f-908e-9272cd17af3b" status: 200 len: 1475 microversion: 2.1 time: 0.299544 Oct 17 13:34:55.819252 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 228/458] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:55 2022] GET /compute/v2.1/servers/0b3dc4f1-f80f-427f-908e-9272cd17af3b => generated 1475 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:55.830272 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6e427f56-10b7-40a5-b1c6-0500717f46e2 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:55.834548 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6e427f56-10b7-40a5-b1c6-0500717f46e2 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] [instance: b88e31f9-509c-4944-9622-350312d2bac1] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:55.843226 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6e427f56-10b7-40a5-b1c6-0500717f46e2 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:55.844979 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6e427f56-10b7-40a5-b1c6-0500717f46e2 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:55.845614 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6e427f56-10b7-40a5-b1c6-0500717f46e2 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:55.846465 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6e427f56-10b7-40a5-b1c6-0500717f46e2 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:55.846917 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6e427f56-10b7-40a5-b1c6-0500717f46e2 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:55.847364 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6e427f56-10b7-40a5-b1c6-0500717f46e2 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:55.959374 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-077978c3-9d77-4051-81b9-9e0c49531870 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:55.960292 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-077978c3-9d77-4051-81b9-9e0c49531870 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] [instance: 85444f54-9792-4b13-90dc-d698bc57b60b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:55.969097 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-077978c3-9d77-4051-81b9-9e0c49531870 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:55.969718 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-077978c3-9d77-4051-81b9-9e0c49531870 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:55.970320 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-077978c3-9d77-4051-81b9-9e0c49531870 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:55.971907 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-077978c3-9d77-4051-81b9-9e0c49531870 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:55.973594 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-077978c3-9d77-4051-81b9-9e0c49531870 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:55.974177 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-077978c3-9d77-4051-81b9-9e0c49531870 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:56.143728 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6e427f56-10b7-40a5-b1c6-0500717f46e2 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ca1489f0084089a47d0cfc2ad37940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a297ddf04b4b18ae7591e107e84d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:56.154110 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6e427f56-10b7-40a5-b1c6-0500717f46e2 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] 10.222.0.79 "GET /compute/v2.1/servers/b88e31f9-509c-4944-9622-350312d2bac1" status: 200 len: 1466 microversion: 2.1 time: 0.327698 Oct 17 13:34:56.155323 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 229/459] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:55 2022] GET /compute/v2.1/servers/b88e31f9-509c-4944-9622-350312d2bac1 => generated 1466 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:56.161204 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c5da2483-e705-417b-bf52-6701f8c50591 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:56.162211 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c5da2483-e705-417b-bf52-6701f8c50591 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 32728e12-4f3f-4f72-902c-10349708549f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:56.174544 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c5da2483-e705-417b-bf52-6701f8c50591 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:56.175915 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c5da2483-e705-417b-bf52-6701f8c50591 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:56.177309 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c5da2483-e705-417b-bf52-6701f8c50591 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:56.178393 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c5da2483-e705-417b-bf52-6701f8c50591 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:56.178894 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c5da2483-e705-417b-bf52-6701f8c50591 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:56.179498 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c5da2483-e705-417b-bf52-6701f8c50591 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:56.654981 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-077978c3-9d77-4051-81b9-9e0c49531870 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/85444f54-9792-4b13-90dc-d698bc57b60b" status: 200 len: 1646 microversion: 2.1 time: 1.183475 Oct 17 13:34:56.660720 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 231/460] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:55 2022] GET /compute/v2.1/servers/85444f54-9792-4b13-90dc-d698bc57b60b => generated 1646 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:34:56.666194 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-db838cf6-a98d-4287-a80a-66bd95824d03 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:56.666806 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-db838cf6-a98d-4287-a80a-66bd95824d03 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] [instance: f0067ca2-1063-4f5b-901d-d766e56afa39] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:56.686914 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db838cf6-a98d-4287-a80a-66bd95824d03 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:56.687772 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db838cf6-a98d-4287-a80a-66bd95824d03 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:56.688194 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db838cf6-a98d-4287-a80a-66bd95824d03 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:56.689127 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db838cf6-a98d-4287-a80a-66bd95824d03 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:56.689580 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db838cf6-a98d-4287-a80a-66bd95824d03 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:56.689993 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db838cf6-a98d-4287-a80a-66bd95824d03 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:56.988224 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c5da2483-e705-417b-bf52-6701f8c50591 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:57.009604 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c5da2483-e705-417b-bf52-6701f8c50591 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/32728e12-4f3f-4f72-902c-10349708549f" status: 200 len: 1317 microversion: 2.1 time: 0.852332 Oct 17 13:34:57.013013 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 230/461] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:56 2022] GET /compute/v2.1/servers/32728e12-4f3f-4f72-902c-10349708549f => generated 1317 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:57.023714 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c8f76d4c-0765-42fa-985d-3bf3aa13b679 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:57.024909 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c8f76d4c-0765-42fa-985d-3bf3aa13b679 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] [instance: 85444f54-9792-4b13-90dc-d698bc57b60b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:57.038668 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c8f76d4c-0765-42fa-985d-3bf3aa13b679 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:57.039366 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c8f76d4c-0765-42fa-985d-3bf3aa13b679 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:57.048427 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c8f76d4c-0765-42fa-985d-3bf3aa13b679 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:57.050758 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c8f76d4c-0765-42fa-985d-3bf3aa13b679 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:57.053635 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c8f76d4c-0765-42fa-985d-3bf3aa13b679 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:57.057057 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c8f76d4c-0765-42fa-985d-3bf3aa13b679 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:57.106938 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:34:57.303624 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-db838cf6-a98d-4287-a80a-66bd95824d03 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a685773acdb415591f62ccee7157b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa06a29e779e413484cdfcb27e902525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:57.317393 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-db838cf6-a98d-4287-a80a-66bd95824d03 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] 10.222.0.79 "GET /compute/v2.1/servers/f0067ca2-1063-4f5b-901d-d766e56afa39" status: 200 len: 1321 microversion: 2.1 time: 0.654227 Oct 17 13:34:57.321067 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 232/462] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:56 2022] GET /compute/v2.1/servers/f0067ca2-1063-4f5b-901d-d766e56afa39 => generated 1321 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:57.330135 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1acbb917-ee58-474f-8fe1-7b88472ac18d tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:57.334293 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1acbb917-ee58-474f-8fe1-7b88472ac18d tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] [instance: 0b3dc4f1-f80f-427f-908e-9272cd17af3b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:57.355365 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1acbb917-ee58-474f-8fe1-7b88472ac18d tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:57.357425 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1acbb917-ee58-474f-8fe1-7b88472ac18d tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:57.358896 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1acbb917-ee58-474f-8fe1-7b88472ac18d tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:57.360959 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1acbb917-ee58-474f-8fe1-7b88472ac18d tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:57.361465 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1acbb917-ee58-474f-8fe1-7b88472ac18d tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:57.362875 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1acbb917-ee58-474f-8fe1-7b88472ac18d tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:57.423760 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1acbb917-ee58-474f-8fe1-7b88472ac18d tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:57.424194 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1acbb917-ee58-474f-8fe1-7b88472ac18d tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:57.424626 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1acbb917-ee58-474f-8fe1-7b88472ac18d tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:57.425086 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-1acbb917-ee58-474f-8fe1-7b88472ac18d tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lazy-loading 'fault' on Instance uuid 0b3dc4f1-f80f-427f-908e-9272cd17af3b {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:34:57.579245 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c8f76d4c-0765-42fa-985d-3bf3aa13b679 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/85444f54-9792-4b13-90dc-d698bc57b60b" status: 200 len: 1646 microversion: 2.1 time: 0.564909 Oct 17 13:34:57.581964 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1acbb917-ee58-474f-8fe1-7b88472ac18d tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf50aa8e899648418eace99975616e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6aa32dd3904f6aaae1e63fcc67b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:57.584472 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 231/463] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:57 2022] GET /compute/v2.1/servers/85444f54-9792-4b13-90dc-d698bc57b60b => generated 1646 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:57.597536 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-43d97f94-2676-4389-87e1-b5716ee89279 req-389229cf-929d-4de7-8467-bf000e2f6813 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b3dc4f1-f80f-427f-908e-9272cd17af3b", "name": "network-vif-deleted", "tag": "b618db86-0537-40b4-b45c-64ecdbf98205"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:57.601555 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1acbb917-ee58-474f-8fe1-7b88472ac18d tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] 10.222.0.79 "GET /compute/v2.1/servers/0b3dc4f1-f80f-427f-908e-9272cd17af3b" status: 200 len: 1310 microversion: 2.1 time: 0.278949 Oct 17 13:34:57.602372 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 233/464] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:57 2022] GET /compute/v2.1/servers/0b3dc4f1-f80f-427f-908e-9272cd17af3b => generated 1310 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:57.612660 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ddd5358c-5369-47fd-aa80-0d4f1ace89c1 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:57.614115 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ddd5358c-5369-47fd-aa80-0d4f1ace89c1 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] [instance: b88e31f9-509c-4944-9622-350312d2bac1] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:57.626494 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-43d97f94-2676-4389-87e1-b5716ee89279 req-389229cf-929d-4de7-8467-bf000e2f6813 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:57.626971 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-43d97f94-2676-4389-87e1-b5716ee89279 req-389229cf-929d-4de7-8467-bf000e2f6813 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:57.627620 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-43d97f94-2676-4389-87e1-b5716ee89279 req-389229cf-929d-4de7-8467-bf000e2f6813 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:57.651136 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ddd5358c-5369-47fd-aa80-0d4f1ace89c1 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:57.651870 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ddd5358c-5369-47fd-aa80-0d4f1ace89c1 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:57.654473 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-43d97f94-2676-4389-87e1-b5716ee89279 req-389229cf-929d-4de7-8467-bf000e2f6813 service nova] Creating event network-vif-deleted:b618db86-0537-40b4-b45c-64ecdbf98205 for instance 0b3dc4f1-f80f-427f-908e-9272cd17af3b on n-h2-854247-14 Oct 17 13:34:57.655144 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ddd5358c-5369-47fd-aa80-0d4f1ace89c1 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:57.656412 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ddd5358c-5369-47fd-aa80-0d4f1ace89c1 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:57.657538 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ddd5358c-5369-47fd-aa80-0d4f1ace89c1 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:57.658141 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ddd5358c-5369-47fd-aa80-0d4f1ace89c1 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:57.666415 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-43d97f94-2676-4389-87e1-b5716ee89279 req-389229cf-929d-4de7-8467-bf000e2f6813 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079391 Oct 17 13:34:57.667094 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 232/465] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:57.674060 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8c64078b-7e0a-4401-a72f-c15efe71126b tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:57.678293 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8c64078b-7e0a-4401-a72f-c15efe71126b tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:57.678947 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8c64078b-7e0a-4401-a72f-c15efe71126b tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:57.679567 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8c64078b-7e0a-4401-a72f-c15efe71126b tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:57.680588 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8c64078b-7e0a-4401-a72f-c15efe71126b tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:57.681902 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8c64078b-7e0a-4401-a72f-c15efe71126b tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:57.682525 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8c64078b-7e0a-4401-a72f-c15efe71126b tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:57.710975 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8c64078b-7e0a-4401-a72f-c15efe71126b tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.041566 Oct 17 13:34:57.720618 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 233/466] 10.222.0.79 () {58 vars in 1176 bytes} [Mon Oct 17 13:34:57 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:57.725971 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-be7d4e83-b14a-456f-bf89-6fc2593d8493 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854247-14", "block_migration": true, "disk_over_commit": false}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:57.729854 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-be7d4e83-b14a-456f-bf89-6fc2593d8493 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] [instance: 85444f54-9792-4b13-90dc-d698bc57b60b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:57.738784 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be7d4e83-b14a-456f-bf89-6fc2593d8493 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:57.739595 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be7d4e83-b14a-456f-bf89-6fc2593d8493 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:57.740245 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be7d4e83-b14a-456f-bf89-6fc2593d8493 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:57.741321 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be7d4e83-b14a-456f-bf89-6fc2593d8493 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:57.741983 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be7d4e83-b14a-456f-bf89-6fc2593d8493 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:57.743401 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be7d4e83-b14a-456f-bf89-6fc2593d8493 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:57.774199 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-be7d4e83-b14a-456f-bf89-6fc2593d8493 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lazy-loading 'flavor' on Instance uuid 85444f54-9792-4b13-90dc-d698bc57b60b {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:34:57.787692 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-be7d4e83-b14a-456f-bf89-6fc2593d8493 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] [instance: 85444f54-9792-4b13-90dc-d698bc57b60b] Going to try to live migrate instance to n-h2-854247-14 {{(pid=127016) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 17 13:34:58.054940 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ddd5358c-5369-47fd-aa80-0d4f1ace89c1 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ca1489f0084089a47d0cfc2ad37940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a297ddf04b4b18ae7591e107e84d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:58.070983 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ddd5358c-5369-47fd-aa80-0d4f1ace89c1 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] 10.222.0.79 "GET /compute/v2.1/servers/b88e31f9-509c-4944-9622-350312d2bac1" status: 200 len: 1466 microversion: 2.1 time: 0.466575 Oct 17 13:34:58.071754 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 234/467] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:57 2022] GET /compute/v2.1/servers/b88e31f9-509c-4944-9622-350312d2bac1 => generated 1466 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:58.106003 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-dbf4e9ab-edaf-4885-91e6-e46994123e0e tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:58.106632 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-dbf4e9ab-edaf-4885-91e6-e46994123e0e tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 32728e12-4f3f-4f72-902c-10349708549f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:58.136152 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dbf4e9ab-edaf-4885-91e6-e46994123e0e tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:58.138385 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dbf4e9ab-edaf-4885-91e6-e46994123e0e tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:58.139140 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dbf4e9ab-edaf-4885-91e6-e46994123e0e tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:58.140233 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dbf4e9ab-edaf-4885-91e6-e46994123e0e tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:58.144532 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dbf4e9ab-edaf-4885-91e6-e46994123e0e tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:58.145207 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dbf4e9ab-edaf-4885-91e6-e46994123e0e tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:59.333815 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-dbf4e9ab-edaf-4885-91e6-e46994123e0e tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:59.373546 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-dbf4e9ab-edaf-4885-91e6-e46994123e0e tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/32728e12-4f3f-4f72-902c-10349708549f" status: 200 len: 1317 microversion: 2.1 time: 1.282697 Oct 17 13:34:59.374373 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 235/468] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:58 2022] GET /compute/v2.1/servers/32728e12-4f3f-4f72-902c-10349708549f => generated 1317 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:59.387241 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f9b6c0b9-e248-40e2-9960-e809bd55898d tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:59.416132 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f9b6c0b9-e248-40e2-9960-e809bd55898d tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] [instance: f0067ca2-1063-4f5b-901d-d766e56afa39] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:59.436624 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f9b6c0b9-e248-40e2-9960-e809bd55898d tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:59.437111 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f9b6c0b9-e248-40e2-9960-e809bd55898d tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:59.437851 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f9b6c0b9-e248-40e2-9960-e809bd55898d tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:59.439453 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f9b6c0b9-e248-40e2-9960-e809bd55898d tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:59.440564 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f9b6c0b9-e248-40e2-9960-e809bd55898d tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:59.441148 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f9b6c0b9-e248-40e2-9960-e809bd55898d tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:59.986910 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f9b6c0b9-e248-40e2-9960-e809bd55898d tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a685773acdb415591f62ccee7157b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa06a29e779e413484cdfcb27e902525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:59.997184 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f9b6c0b9-e248-40e2-9960-e809bd55898d tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] 10.222.0.79 "GET /compute/v2.1/servers/f0067ca2-1063-4f5b-901d-d766e56afa39" status: 200 len: 1321 microversion: 2.1 time: 0.620077 Oct 17 13:34:59.998393 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 236/469] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:59 2022] GET /compute/v2.1/servers/f0067ca2-1063-4f5b-901d-d766e56afa39 => generated 1321 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:00.007422 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-41c38c0d-4d09-4f60-933b-d2815a56072e tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:00.008313 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-41c38c0d-4d09-4f60-933b-d2815a56072e tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] [instance: 0b3dc4f1-f80f-427f-908e-9272cd17af3b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:00.016493 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-41c38c0d-4d09-4f60-933b-d2815a56072e tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:00.017332 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-41c38c0d-4d09-4f60-933b-d2815a56072e tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:00.017967 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-41c38c0d-4d09-4f60-933b-d2815a56072e tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:00.019112 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-41c38c0d-4d09-4f60-933b-d2815a56072e tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:00.020524 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-41c38c0d-4d09-4f60-933b-d2815a56072e tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:00.021614 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-41c38c0d-4d09-4f60-933b-d2815a56072e tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:00.047338 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-41c38c0d-4d09-4f60-933b-d2815a56072e tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] HTTP exception thrown: Instance 0b3dc4f1-f80f-427f-908e-9272cd17af3b could not be found. Oct 17 13:35:00.052065 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-41c38c0d-4d09-4f60-933b-d2815a56072e tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Request method failure captured: Oct 17 13:35:00.052065 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/0b3dc4f1-f80f-427f-908e-9272cd17af3b HTTP/1.1 Oct 17 13:35:00.052065 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:35:00.052065 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:35:00.052065 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:35:00.052065 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:35:00.052065 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:35:00.052065 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:35:00.052065 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:35:00.052065 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:35:00.052065 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVnghhr8Va4xfgEZF__nnHmc8eWfYu1T4LLgc3_J06nt1Vov6CS-XB4_ijby1AvbmiTZnaJVgA5q8XRgEqKqUbjRJ-4m9UXmcg9fq6lr4ZLGK1L_MS-5Jsy38KdGH6BBO5wLGibfmcOoOM0zuHhbF6OfAg1uNza4aWRGquuw0kPBXOA Oct 17 13:35:00.052065 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:35:00.052065 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:35:00.052065 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:35:00.052065 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:35:00.052065 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:35:00.052065 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:35:00.052065 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 0b6aa32dd3904f6aaae1e63fcc67b0f7 Oct 17 13:35:00.052065 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-DeleteServersAdminTestJSON-777083312 Oct 17 13:35:00.052065 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:35:00.052065 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:35:00.054374 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0b6aa32dd3904f6aaae1e63fcc67b0f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0b6aa32dd3904f6aaae1e63fcc67b0f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0b6aa32dd3904f6aaae1e63fcc67b0f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0b6aa32dd3904f6aaae1e63fcc67b0f7", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:35:00.054374 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-DeleteServersAdminTestJSON-777083312 Oct 17 13:35:00.054374 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 0b6aa32dd3904f6aaae1e63fcc67b0f7 Oct 17 13:35:00.054374 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-777083312 Oct 17 13:35:00.054374 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-DeleteServersAdminTestJSON-777083312-project Oct 17 13:35:00.054374 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:35:00.054374 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:35:00.054374 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: cf50aa8e899648418eace99975616e93 Oct 17 13:35:00.054374 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-DeleteServersAdminTestJSON-777083312-project Oct 17 13:35:00.054374 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:35:00.054374 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 0b3dc4f1-f80f-427f-908e-9272cd17af3b could not be found. Oct 17 13:35:00.054374 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '0b3dc4f1-f80f-427f-908e-9272cd17af3b'} Oct 17 13:35:00.055119 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:35:00.055119 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:00.055119 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:35:00.055119 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:35:00.055119 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:35:00.055119 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:35:00.055119 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:35:00.055119 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:35:00.055119 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:35:00.055119 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:35:00.055119 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b3dc4f1-f80f-427f-908e-9272cd17af3b could not be found. Oct 17 13:35:00.055119 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:00.055119 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:35:00.055119 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:00.055119 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:00.055119 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:35:00.055119 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:35:00.055119 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:35:00.055119 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:35:00.055119 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:35:00.056589 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:35:00.056589 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:35:00.056589 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:35:00.056589 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:35:00.056589 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:35:00.056589 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:35:00.056589 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:35:00.056589 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b3dc4f1-f80f-427f-908e-9272cd17af3b could not be found. Oct 17 13:35:00.056589 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:00.056589 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:35:00.056589 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:00.056589 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:00.056589 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:35:00.056589 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:35:00.056589 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:35:00.056589 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:35:00.056589 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b3dc4f1-f80f-427f-908e-9272cd17af3b could not be found. Oct 17 13:35:00.056589 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:00.060409 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-41c38c0d-4d09-4f60-933b-d2815a56072e tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Returning 404 to user: Instance 0b3dc4f1-f80f-427f-908e-9272cd17af3b could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:35:00.062908 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-41c38c0d-4d09-4f60-933b-d2815a56072e tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] 10.222.0.79 "GET /compute/v2.1/servers/0b3dc4f1-f80f-427f-908e-9272cd17af3b" status: 404 len: 111 microversion: 2.1 time: 0.063230 Oct 17 13:35:00.064814 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 237/470] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:59 2022] GET /compute/v2.1/servers/0b3dc4f1-f80f-427f-908e-9272cd17af3b => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:35:00.071280 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-97e95338-acd3-4d88-87e4-5af66864fae8 req-3bec6e43-ac83-4d5f-bf5f-4355998795da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b88e31f9-509c-4944-9622-350312d2bac1", "name": "network-vif-deleted", "tag": "895061f7-fd31-46e5-b994-381eedb0afad"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:00.102281 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-97e95338-acd3-4d88-87e4-5af66864fae8 req-3bec6e43-ac83-4d5f-bf5f-4355998795da service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:00.102955 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-97e95338-acd3-4d88-87e4-5af66864fae8 req-3bec6e43-ac83-4d5f-bf5f-4355998795da service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:00.105406 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-97e95338-acd3-4d88-87e4-5af66864fae8 req-3bec6e43-ac83-4d5f-bf5f-4355998795da service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:00.130622 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-97e95338-acd3-4d88-87e4-5af66864fae8 req-3bec6e43-ac83-4d5f-bf5f-4355998795da service nova] Creating event network-vif-deleted:895061f7-fd31-46e5-b994-381eedb0afad for instance b88e31f9-509c-4944-9622-350312d2bac1 on n-h2-854247-14 Oct 17 13:35:00.143306 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-97e95338-acd3-4d88-87e4-5af66864fae8 req-3bec6e43-ac83-4d5f-bf5f-4355998795da service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075434 Oct 17 13:35:00.145511 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 238/471] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:00.155835 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7dd1526c-6a8e-4da8-9c24-ae6781ad5082 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:00.159278 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7dd1526c-6a8e-4da8-9c24-ae6781ad5082 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] [instance: b88e31f9-509c-4944-9622-350312d2bac1] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:00.172518 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7dd1526c-6a8e-4da8-9c24-ae6781ad5082 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:00.175302 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7dd1526c-6a8e-4da8-9c24-ae6781ad5082 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:00.176434 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7dd1526c-6a8e-4da8-9c24-ae6781ad5082 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:00.178425 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7dd1526c-6a8e-4da8-9c24-ae6781ad5082 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:00.179733 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7dd1526c-6a8e-4da8-9c24-ae6781ad5082 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:00.181250 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7dd1526c-6a8e-4da8-9c24-ae6781ad5082 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:00.229437 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-7dd1526c-6a8e-4da8-9c24-ae6781ad5082 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] HTTP exception thrown: Instance b88e31f9-509c-4944-9622-350312d2bac1 could not be found. Oct 17 13:35:00.231158 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7dd1526c-6a8e-4da8-9c24-ae6781ad5082 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Request method failure captured: Oct 17 13:35:00.231158 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/b88e31f9-509c-4944-9622-350312d2bac1 HTTP/1.1 Oct 17 13:35:00.231158 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:35:00.231158 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:35:00.231158 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:35:00.231158 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:35:00.231158 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:35:00.231158 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:35:00.231158 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:35:00.231158 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:35:00.231158 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVnI9ZkUi5bz9xFhAzYfWxOKCAOo4qS7iUuO0gbpYOC8qpve7j2dHq3MCh4ve5wzFgK3s6qpvKFZw-vRBCSfoK1YYpAf6zdoas523ElL78zlEsATNwD9rb21E3cxpIKHMdZ0qKhS2y1y_iHibklNINRazI21gMUNlt_hIt0TWyAPiTs Oct 17 13:35:00.231158 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:35:00.231158 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:35:00.231158 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:35:00.231158 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:35:00.231158 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:35:00.231158 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:35:00.231158 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: a3a297ddf04b4b18ae7591e107e84d36 Oct 17 13:35:00.231158 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-LiveMigrationNegativeTest-1271561492 Oct 17 13:35:00.231158 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:35:00.231158 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:35:00.232384 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a3a297ddf04b4b18ae7591e107e84d36"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a3a297ddf04b4b18ae7591e107e84d36"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a3a297ddf04b4b18ae7591e107e84d36"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a3a297ddf04b4b18ae7591e107e84d36", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:35:00.232384 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-LiveMigrationNegativeTest-1271561492 Oct 17 13:35:00.232384 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: a3a297ddf04b4b18ae7591e107e84d36 Oct 17 13:35:00.232384 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1271561492 Oct 17 13:35:00.232384 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-LiveMigrationNegativeTest-1271561492-project Oct 17 13:35:00.232384 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:35:00.232384 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:35:00.232384 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 44ca1489f0084089a47d0cfc2ad37940 Oct 17 13:35:00.232384 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-LiveMigrationNegativeTest-1271561492-project Oct 17 13:35:00.232384 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:35:00.232384 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance b88e31f9-509c-4944-9622-350312d2bac1 could not be found. Oct 17 13:35:00.232384 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'b88e31f9-509c-4944-9622-350312d2bac1'} Oct 17 13:35:00.233046 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:35:00.233046 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:00.233046 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:35:00.233046 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:35:00.233046 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:35:00.233046 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:35:00.233046 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:35:00.233046 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:35:00.233046 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:35:00.233046 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:35:00.233046 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b88e31f9-509c-4944-9622-350312d2bac1 could not be found. Oct 17 13:35:00.233046 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:00.233046 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:35:00.233046 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:00.233046 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:00.233046 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:35:00.233046 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:35:00.233046 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:35:00.233046 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:35:00.233046 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:35:00.234146 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:35:00.234146 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:35:00.234146 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:35:00.234146 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:35:00.234146 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:35:00.234146 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:35:00.234146 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:35:00.234146 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b88e31f9-509c-4944-9622-350312d2bac1 could not be found. Oct 17 13:35:00.234146 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:00.234146 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:35:00.234146 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:00.234146 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:00.234146 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:35:00.234146 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:35:00.234146 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:35:00.234146 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:35:00.234146 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b88e31f9-509c-4944-9622-350312d2bac1 could not be found. Oct 17 13:35:00.234146 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:00.239764 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7dd1526c-6a8e-4da8-9c24-ae6781ad5082 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Returning 404 to user: Instance b88e31f9-509c-4944-9622-350312d2bac1 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:35:00.239764 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7dd1526c-6a8e-4da8-9c24-ae6781ad5082 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] 10.222.0.79 "GET /compute/v2.1/servers/b88e31f9-509c-4944-9622-350312d2bac1" status: 404 len: 111 microversion: 2.1 time: 0.085826 Oct 17 13:35:00.239764 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 239/472] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:00 2022] GET /compute/v2.1/servers/b88e31f9-509c-4944-9622-350312d2bac1 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:35:00.248833 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-445ae9f9-49d3-4e82-95fa-c98bde29d4bb tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:00.249342 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-445ae9f9-49d3-4e82-95fa-c98bde29d4bb tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] [instance: 00b0dfe0-2c88-4037-830f-4144190da935] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:00.262196 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-445ae9f9-49d3-4e82-95fa-c98bde29d4bb tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:00.262833 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-445ae9f9-49d3-4e82-95fa-c98bde29d4bb tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:00.263299 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-445ae9f9-49d3-4e82-95fa-c98bde29d4bb tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:00.264003 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-445ae9f9-49d3-4e82-95fa-c98bde29d4bb tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:00.264621 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-445ae9f9-49d3-4e82-95fa-c98bde29d4bb tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:00.269409 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-445ae9f9-49d3-4e82-95fa-c98bde29d4bb tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:00.304298 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-445ae9f9-49d3-4e82-95fa-c98bde29d4bb tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] [instance: 00b0dfe0-2c88-4037-830f-4144190da935] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:35:00.437499 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-445ae9f9-49d3-4e82-95fa-c98bde29d4bb tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] 10.222.0.79 "DELETE /compute/v2.1/servers/00b0dfe0-2c88-4037-830f-4144190da935" status: 204 len: 0 microversion: 2.1 time: 0.191115 Oct 17 13:35:00.439216 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 240/473] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:35:00 2022] DELETE /compute/v2.1/servers/00b0dfe0-2c88-4037-830f-4144190da935 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:35:00.447340 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5799fa82-0ad7-45cd-89e4-cf82cc91d60f tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-542425597", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:00.533810 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-5799fa82-0ad7-45cd-89e4-cf82cc91d60f tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] validate_networks() for None {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:35:00.660211 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-be7d4e83-b14a-456f-bf89-6fc2593d8493 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/85444f54-9792-4b13-90dc-d698bc57b60b/action" status: 202 len: 0 microversion: 2.1 time: 2.938118 Oct 17 13:35:00.661489 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 234/474] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:34:57 2022] POST /compute/v2.1/servers/85444f54-9792-4b13-90dc-d698bc57b60b/action => generated 0 bytes in 2940 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:35:00.668805 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-91bfd3e1-3e91-4885-80b9-845735dcc06e tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:00.669640 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-91bfd3e1-3e91-4885-80b9-845735dcc06e tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 32728e12-4f3f-4f72-902c-10349708549f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:00.679821 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-91bfd3e1-3e91-4885-80b9-845735dcc06e tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:00.680559 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-91bfd3e1-3e91-4885-80b9-845735dcc06e tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:00.681071 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-91bfd3e1-3e91-4885-80b9-845735dcc06e tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:00.682275 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-91bfd3e1-3e91-4885-80b9-845735dcc06e tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:00.683153 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-91bfd3e1-3e91-4885-80b9-845735dcc06e tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:00.683619 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-91bfd3e1-3e91-4885-80b9-845735dcc06e tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:01.024285 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-91bfd3e1-3e91-4885-80b9-845735dcc06e tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:01.033837 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-91bfd3e1-3e91-4885-80b9-845735dcc06e tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/32728e12-4f3f-4f72-902c-10349708549f" status: 200 len: 1317 microversion: 2.1 time: 0.371007 Oct 17 13:35:01.035221 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 235/475] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:00 2022] GET /compute/v2.1/servers/32728e12-4f3f-4f72-902c-10349708549f => generated 1317 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:01.040366 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4e66773d-d14b-4633-a1f1-720cdd250086 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:01.041291 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4e66773d-d14b-4633-a1f1-720cdd250086 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] [instance: 00b0dfe0-2c88-4037-830f-4144190da935] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:01.048665 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4e66773d-d14b-4633-a1f1-720cdd250086 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:01.049369 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4e66773d-d14b-4633-a1f1-720cdd250086 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:01.050141 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4e66773d-d14b-4633-a1f1-720cdd250086 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:01.050979 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4e66773d-d14b-4633-a1f1-720cdd250086 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:01.051587 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4e66773d-d14b-4633-a1f1-720cdd250086 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:01.052139 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4e66773d-d14b-4633-a1f1-720cdd250086 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:01.143835 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-5799fa82-0ad7-45cd-89e4-cf82cc91d60f tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:35:01.156041 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-5799fa82-0ad7-45cd-89e4-cf82cc91d60f tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:35:01.157622 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-5799fa82-0ad7-45cd-89e4-cf82cc91d60f tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:35:01.159885 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-5799fa82-0ad7-45cd-89e4-cf82cc91d60f tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:35:01.163652 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-5799fa82-0ad7-45cd-89e4-cf82cc91d60f tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:35:01.178327 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=83 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:01.198257 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5799fa82-0ad7-45cd-89e4-cf82cc91d60f tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:01.199137 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5799fa82-0ad7-45cd-89e4-cf82cc91d60f tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:01.200465 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5799fa82-0ad7-45cd-89e4-cf82cc91d60f tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:01.201434 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5799fa82-0ad7-45cd-89e4-cf82cc91d60f tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:01.202731 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5799fa82-0ad7-45cd-89e4-cf82cc91d60f tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:01.203529 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5799fa82-0ad7-45cd-89e4-cf82cc91d60f tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:01.229228 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=23 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:01.243795 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-5799fa82-0ad7-45cd-89e4-cf82cc91d60f tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Getting quotas for project 0b6aa32dd3904f6aaae1e63fcc67b0f7. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:35:01.249778 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-5799fa82-0ad7-45cd-89e4-cf82cc91d60f tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Getting quotas for user cf50aa8e899648418eace99975616e93 and project 0b6aa32dd3904f6aaae1e63fcc67b0f7. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:35:01.269838 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5799fa82-0ad7-45cd-89e4-cf82cc91d60f tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:35:01.272312 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5799fa82-0ad7-45cd-89e4-cf82cc91d60f tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] [instance: c47e40d5-8a51-45cc-93e5-1142c8988e5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:35:01.333780 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5799fa82-0ad7-45cd-89e4-cf82cc91d60f tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.892795 Oct 17 13:35:01.334476 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 241/476] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:35:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 895 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:35:01.359444 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2be12814-586d-4c43-9edb-0dc27cfa191c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:01.360321 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2be12814-586d-4c43-9edb-0dc27cfa191c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: 85444f54-9792-4b13-90dc-d698bc57b60b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:01.368111 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2be12814-586d-4c43-9edb-0dc27cfa191c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:01.368789 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2be12814-586d-4c43-9edb-0dc27cfa191c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:01.369491 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2be12814-586d-4c43-9edb-0dc27cfa191c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:01.370354 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2be12814-586d-4c43-9edb-0dc27cfa191c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:01.370976 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2be12814-586d-4c43-9edb-0dc27cfa191c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:01.372352 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2be12814-586d-4c43-9edb-0dc27cfa191c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:01.435971 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4e66773d-d14b-4633-a1f1-720cdd250086 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ca1489f0084089a47d0cfc2ad37940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a297ddf04b4b18ae7591e107e84d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:01.445421 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4e66773d-d14b-4633-a1f1-720cdd250086 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] 10.222.0.79 "GET /compute/v2.1/servers/00b0dfe0-2c88-4037-830f-4144190da935" status: 200 len: 1475 microversion: 2.1 time: 0.408666 Oct 17 13:35:01.455887 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 236/477] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:01 2022] GET /compute/v2.1/servers/00b0dfe0-2c88-4037-830f-4144190da935 => generated 1475 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:01.468511 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9692b392-d347-4c1f-aa1b-4196f2e55884 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:01.469118 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9692b392-d347-4c1f-aa1b-4196f2e55884 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] [instance: f0067ca2-1063-4f5b-901d-d766e56afa39] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:01.476214 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9692b392-d347-4c1f-aa1b-4196f2e55884 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:01.477199 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9692b392-d347-4c1f-aa1b-4196f2e55884 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:01.477772 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9692b392-d347-4c1f-aa1b-4196f2e55884 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:01.478621 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9692b392-d347-4c1f-aa1b-4196f2e55884 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:01.479060 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9692b392-d347-4c1f-aa1b-4196f2e55884 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:01.479502 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9692b392-d347-4c1f-aa1b-4196f2e55884 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:02.202875 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2be12814-586d-4c43-9edb-0dc27cfa191c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:02.212742 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2be12814-586d-4c43-9edb-0dc27cfa191c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/85444f54-9792-4b13-90dc-d698bc57b60b" status: 200 len: 1503 microversion: 2.1 time: 0.869133 Oct 17 13:35:02.216164 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9692b392-d347-4c1f-aa1b-4196f2e55884 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a685773acdb415591f62ccee7157b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa06a29e779e413484cdfcb27e902525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:02.224490 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 242/478] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:01 2022] GET /compute/v2.1/servers/85444f54-9792-4b13-90dc-d698bc57b60b => generated 1503 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:02.244122 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9692b392-d347-4c1f-aa1b-4196f2e55884 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] 10.222.0.79 "GET /compute/v2.1/servers/f0067ca2-1063-4f5b-901d-d766e56afa39" status: 200 len: 1321 microversion: 2.1 time: 0.779549 Oct 17 13:35:02.262422 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 237/479] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:01 2022] GET /compute/v2.1/servers/f0067ca2-1063-4f5b-901d-d766e56afa39 => generated 1321 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:02.263914 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8bd5352f-d682-46d9-b8b5-03bcc3d56700 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:02.264532 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8bd5352f-d682-46d9-b8b5-03bcc3d56700 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] [instance: c47e40d5-8a51-45cc-93e5-1142c8988e5c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:02.267515 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:02.286350 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8bd5352f-d682-46d9-b8b5-03bcc3d56700 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:02.286850 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8bd5352f-d682-46d9-b8b5-03bcc3d56700 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:02.287306 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8bd5352f-d682-46d9-b8b5-03bcc3d56700 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:02.288467 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8bd5352f-d682-46d9-b8b5-03bcc3d56700 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:02.288918 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8bd5352f-d682-46d9-b8b5-03bcc3d56700 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:02.289337 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8bd5352f-d682-46d9-b8b5-03bcc3d56700 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:02.413742 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8bd5352f-d682-46d9-b8b5-03bcc3d56700 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf50aa8e899648418eace99975616e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6aa32dd3904f6aaae1e63fcc67b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:02.424787 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8bd5352f-d682-46d9-b8b5-03bcc3d56700 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] 10.222.0.79 "GET /compute/v2.1/servers/c47e40d5-8a51-45cc-93e5-1142c8988e5c" status: 200 len: 1271 microversion: 2.1 time: 0.179322 Oct 17 13:35:02.425896 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 243/480] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:02 2022] GET /compute/v2.1/servers/c47e40d5-8a51-45cc-93e5-1142c8988e5c => generated 1271 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:02.435377 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f083968d-a167-4054-b227-073641dbc82e tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:02.436254 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f083968d-a167-4054-b227-073641dbc82e tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 32728e12-4f3f-4f72-902c-10349708549f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:02.443865 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f083968d-a167-4054-b227-073641dbc82e tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:02.444862 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f083968d-a167-4054-b227-073641dbc82e tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:02.445949 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f083968d-a167-4054-b227-073641dbc82e tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:02.446911 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f083968d-a167-4054-b227-073641dbc82e tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:02.448161 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f083968d-a167-4054-b227-073641dbc82e tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:02.449013 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f083968d-a167-4054-b227-073641dbc82e tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:02.467932 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:02.510730 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-245c9a5c-166e-49d7-b403-6fa56f2d9819 tempest-SecurityGroupsTestAdminJSON-366864463 tempest-SecurityGroupsTestAdminJSON-366864463-project] Action: 'create', calling method: .version_select at 0x7f7cd5d574c0>, body: {"security_group": {"name": "tempest-securitygroup-1595116213", "description": "tempest-description-541199200"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:02.661372 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=94 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:02.822908 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f083968d-a167-4054-b227-073641dbc82e tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:02.831427 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f083968d-a167-4054-b227-073641dbc82e tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/32728e12-4f3f-4f72-902c-10349708549f" status: 200 len: 1317 microversion: 2.1 time: 0.404261 Oct 17 13:35:02.831996 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 244/481] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:02 2022] GET /compute/v2.1/servers/32728e12-4f3f-4f72-902c-10349708549f => generated 1317 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:02.837228 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-7f5788b8-b8e3-433c-b2ec-45b029a2d0ac req-d557b113-a240-4210-bcbe-1795ae9de28c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0067ca2-1063-4f5b-901d-d766e56afa39", "tag": "dcea5002-bfa7-4323-bfce-fa27565f133c"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:02.848254 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-7f5788b8-b8e3-433c-b2ec-45b029a2d0ac req-d557b113-a240-4210-bcbe-1795ae9de28c service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:02.849089 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-7f5788b8-b8e3-433c-b2ec-45b029a2d0ac req-d557b113-a240-4210-bcbe-1795ae9de28c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:02.849635 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-7f5788b8-b8e3-433c-b2ec-45b029a2d0ac req-d557b113-a240-4210-bcbe-1795ae9de28c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:02.863705 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-7f5788b8-b8e3-433c-b2ec-45b029a2d0ac req-d557b113-a240-4210-bcbe-1795ae9de28c service nova] Creating event network-changed:dcea5002-bfa7-4323-bfce-fa27565f133c for instance f0067ca2-1063-4f5b-901d-d766e56afa39 on n-h1-854247-14 Oct 17 13:35:02.870261 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-7f5788b8-b8e3-433c-b2ec-45b029a2d0ac req-d557b113-a240-4210-bcbe-1795ae9de28c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036750 Oct 17 13:35:02.870892 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 245/482] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:35:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:02.877992 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-cd29e0b7-9bb9-420f-b5e1-bbbe0cbaf37c tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:02.878748 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-cd29e0b7-9bb9-420f-b5e1-bbbe0cbaf37c tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] [instance: 00b0dfe0-2c88-4037-830f-4144190da935] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:02.887066 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cd29e0b7-9bb9-420f-b5e1-bbbe0cbaf37c tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:02.887724 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cd29e0b7-9bb9-420f-b5e1-bbbe0cbaf37c tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:02.888141 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cd29e0b7-9bb9-420f-b5e1-bbbe0cbaf37c tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:02.888845 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cd29e0b7-9bb9-420f-b5e1-bbbe0cbaf37c tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:02.889281 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cd29e0b7-9bb9-420f-b5e1-bbbe0cbaf37c tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:02.889903 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cd29e0b7-9bb9-420f-b5e1-bbbe0cbaf37c tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:03.454546 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-cd29e0b7-9bb9-420f-b5e1-bbbe0cbaf37c tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ca1489f0084089a47d0cfc2ad37940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a297ddf04b4b18ae7591e107e84d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:03.463682 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-cd29e0b7-9bb9-420f-b5e1-bbbe0cbaf37c tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] 10.222.0.79 "GET /compute/v2.1/servers/00b0dfe0-2c88-4037-830f-4144190da935" status: 200 len: 1475 microversion: 2.1 time: 0.590561 Oct 17 13:35:03.464522 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 246/483] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:02 2022] GET /compute/v2.1/servers/00b0dfe0-2c88-4037-830f-4144190da935 => generated 1475 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:03.471218 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-9449b4e1-4546-477a-96e7-30beb9111456 req-c7bcf8c8-a0e7-4bfa-a6c2-dfd26849d2df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32728e12-4f3f-4f72-902c-10349708549f", "name": "network-vif-plugged", "status": "completed", "tag": "9e4bbd4c-aa1e-4e34-b511-617ea8517bf3"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:03.482392 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-9449b4e1-4546-477a-96e7-30beb9111456 req-c7bcf8c8-a0e7-4bfa-a6c2-dfd26849d2df service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:03.482957 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-9449b4e1-4546-477a-96e7-30beb9111456 req-c7bcf8c8-a0e7-4bfa-a6c2-dfd26849d2df service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:03.483722 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-9449b4e1-4546-477a-96e7-30beb9111456 req-c7bcf8c8-a0e7-4bfa-a6c2-dfd26849d2df service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:03.501110 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-9449b4e1-4546-477a-96e7-30beb9111456 req-c7bcf8c8-a0e7-4bfa-a6c2-dfd26849d2df service nova] Creating event network-vif-plugged:9e4bbd4c-aa1e-4e34-b511-617ea8517bf3 for instance 32728e12-4f3f-4f72-902c-10349708549f on n-h2-854247-14 Oct 17 13:35:03.506083 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-9449b4e1-4546-477a-96e7-30beb9111456 req-c7bcf8c8-a0e7-4bfa-a6c2-dfd26849d2df service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039576 Oct 17 13:35:03.506765 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 247/484] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:35:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:03.515992 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-914a12b4-1ab2-4c63-a7c3-f81e38d30e43 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:03.516713 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-914a12b4-1ab2-4c63-a7c3-f81e38d30e43 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: 85444f54-9792-4b13-90dc-d698bc57b60b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:03.523312 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-914a12b4-1ab2-4c63-a7c3-f81e38d30e43 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:03.523792 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-914a12b4-1ab2-4c63-a7c3-f81e38d30e43 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:03.524218 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-914a12b4-1ab2-4c63-a7c3-f81e38d30e43 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:03.525038 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-914a12b4-1ab2-4c63-a7c3-f81e38d30e43 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:03.525639 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-914a12b4-1ab2-4c63-a7c3-f81e38d30e43 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:03.526239 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-914a12b4-1ab2-4c63-a7c3-f81e38d30e43 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:04.072368 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-245c9a5c-166e-49d7-b403-6fa56f2d9819 tempest-SecurityGroupsTestAdminJSON-366864463 tempest-SecurityGroupsTestAdminJSON-366864463-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.810891 Oct 17 13:35:04.075233 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 238/485] 10.222.0.79 () {60 vars in 1180 bytes} [Mon Oct 17 13:35:02 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1814 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:04.085240 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-993565be-50b2-48ad-8053-3b135edcb819 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:04.086839 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-993565be-50b2-48ad-8053-3b135edcb819 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] [instance: f0067ca2-1063-4f5b-901d-d766e56afa39] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:04.107245 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-993565be-50b2-48ad-8053-3b135edcb819 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:04.107964 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-993565be-50b2-48ad-8053-3b135edcb819 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:04.110511 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-993565be-50b2-48ad-8053-3b135edcb819 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:04.111594 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-993565be-50b2-48ad-8053-3b135edcb819 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:04.113718 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-993565be-50b2-48ad-8053-3b135edcb819 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:04.114359 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-993565be-50b2-48ad-8053-3b135edcb819 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:04.294641 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-914a12b4-1ab2-4c63-a7c3-f81e38d30e43 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:04.303544 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-914a12b4-1ab2-4c63-a7c3-f81e38d30e43 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/85444f54-9792-4b13-90dc-d698bc57b60b" status: 200 len: 1503 microversion: 2.1 time: 0.792413 Oct 17 13:35:04.319879 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 248/486] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:03 2022] GET /compute/v2.1/servers/85444f54-9792-4b13-90dc-d698bc57b60b => generated 1503 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:04.326946 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-203b88b1-2613-4607-958b-63b61ef6f27b tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:04.327913 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-203b88b1-2613-4607-958b-63b61ef6f27b tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] [instance: c47e40d5-8a51-45cc-93e5-1142c8988e5c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:04.334764 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-203b88b1-2613-4607-958b-63b61ef6f27b tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:04.335593 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-203b88b1-2613-4607-958b-63b61ef6f27b tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:04.336273 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-203b88b1-2613-4607-958b-63b61ef6f27b tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:04.337625 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-203b88b1-2613-4607-958b-63b61ef6f27b tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:04.338454 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-203b88b1-2613-4607-958b-63b61ef6f27b tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:04.339091 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-203b88b1-2613-4607-958b-63b61ef6f27b tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:04.547330 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-203b88b1-2613-4607-958b-63b61ef6f27b tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf50aa8e899648418eace99975616e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6aa32dd3904f6aaae1e63fcc67b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:04.558318 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-203b88b1-2613-4607-958b-63b61ef6f27b tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] 10.222.0.79 "GET /compute/v2.1/servers/c47e40d5-8a51-45cc-93e5-1142c8988e5c" status: 200 len: 1277 microversion: 2.1 time: 0.236946 Oct 17 13:35:04.560243 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 249/487] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:04 2022] GET /compute/v2.1/servers/c47e40d5-8a51-45cc-93e5-1142c8988e5c => generated 1277 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:04.579214 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9ebf9661-634d-466c-a88c-f5d9e09fab67 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:04.580091 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9ebf9661-634d-466c-a88c-f5d9e09fab67 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 32728e12-4f3f-4f72-902c-10349708549f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:04.590553 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9ebf9661-634d-466c-a88c-f5d9e09fab67 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:04.591503 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9ebf9661-634d-466c-a88c-f5d9e09fab67 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:04.592126 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9ebf9661-634d-466c-a88c-f5d9e09fab67 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:04.593050 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9ebf9661-634d-466c-a88c-f5d9e09fab67 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:04.593686 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9ebf9661-634d-466c-a88c-f5d9e09fab67 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:04.594319 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9ebf9661-634d-466c-a88c-f5d9e09fab67 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:04.613995 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-993565be-50b2-48ad-8053-3b135edcb819 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a685773acdb415591f62ccee7157b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa06a29e779e413484cdfcb27e902525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:04.628830 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-993565be-50b2-48ad-8053-3b135edcb819 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] 10.222.0.79 "GET /compute/v2.1/servers/f0067ca2-1063-4f5b-901d-d766e56afa39" status: 200 len: 1321 microversion: 2.1 time: 0.551865 Oct 17 13:35:04.629228 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 239/488] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:04 2022] GET /compute/v2.1/servers/f0067ca2-1063-4f5b-901d-d766e56afa39 => generated 1321 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:04.660723 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-81696d5a-438c-40b7-b462-c48bc439acc8 tempest-SecurityGroupsTestAdminJSON-366864463 tempest-SecurityGroupsTestAdminJSON-366864463-project] Action: 'create', calling method: .version_select at 0x7f7cd5ca8040>, body: {"security_group": {"name": "tempest-securitygroup-115260155", "description": "tempest-description-2026983446"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:05.118750 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9ebf9661-634d-466c-a88c-f5d9e09fab67 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:05.127082 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9ebf9661-634d-466c-a88c-f5d9e09fab67 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/32728e12-4f3f-4f72-902c-10349708549f" status: 200 len: 1317 microversion: 2.1 time: 0.565538 Oct 17 13:35:05.131873 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 250/489] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:04 2022] GET /compute/v2.1/servers/32728e12-4f3f-4f72-902c-10349708549f => generated 1317 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:05.158255 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6d3902bc-11da-43b0-86de-767cb3f99bb7 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:05.158870 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6d3902bc-11da-43b0-86de-767cb3f99bb7 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] [instance: 00b0dfe0-2c88-4037-830f-4144190da935] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:05.166823 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6d3902bc-11da-43b0-86de-767cb3f99bb7 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:05.167355 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6d3902bc-11da-43b0-86de-767cb3f99bb7 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:05.167838 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6d3902bc-11da-43b0-86de-767cb3f99bb7 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:05.168597 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6d3902bc-11da-43b0-86de-767cb3f99bb7 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:05.169042 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6d3902bc-11da-43b0-86de-767cb3f99bb7 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:05.169607 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6d3902bc-11da-43b0-86de-767cb3f99bb7 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:05.709011 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-81696d5a-438c-40b7-b462-c48bc439acc8 tempest-SecurityGroupsTestAdminJSON-366864463 tempest-SecurityGroupsTestAdminJSON-366864463-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.064424 Oct 17 13:35:05.711305 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 240/490] 10.222.0.79 () {60 vars in 1180 bytes} [Mon Oct 17 13:35:04 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:05.724942 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d4a71314-83f0-466d-b572-903e9507b16d tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:05.731084 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d4a71314-83f0-466d-b572-903e9507b16d tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] [instance: 12e5e9fe-b998-450c-94b0-492a92bb6027] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:05.749506 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6d3902bc-11da-43b0-86de-767cb3f99bb7 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44ca1489f0084089a47d0cfc2ad37940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a297ddf04b4b18ae7591e107e84d36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:05.763652 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d4a71314-83f0-466d-b572-903e9507b16d tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:05.767011 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d4a71314-83f0-466d-b572-903e9507b16d tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:05.768060 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6d3902bc-11da-43b0-86de-767cb3f99bb7 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] 10.222.0.79 "GET /compute/v2.1/servers/00b0dfe0-2c88-4037-830f-4144190da935" status: 200 len: 1433 microversion: 2.1 time: 0.615179 Oct 17 13:35:05.769161 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 251/491] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:05 2022] GET /compute/v2.1/servers/00b0dfe0-2c88-4037-830f-4144190da935 => generated 1433 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:05.785978 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d4a71314-83f0-466d-b572-903e9507b16d tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:05.787802 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5454d403-b984-426d-be8b-affc46f40f4c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:05.788582 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5454d403-b984-426d-be8b-affc46f40f4c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: 85444f54-9792-4b13-90dc-d698bc57b60b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:05.790884 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d4a71314-83f0-466d-b572-903e9507b16d tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:05.794258 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d4a71314-83f0-466d-b572-903e9507b16d tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:05.794947 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d4a71314-83f0-466d-b572-903e9507b16d tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:05.799434 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5454d403-b984-426d-be8b-affc46f40f4c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:05.800355 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5454d403-b984-426d-be8b-affc46f40f4c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:05.801003 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5454d403-b984-426d-be8b-affc46f40f4c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:05.802619 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5454d403-b984-426d-be8b-affc46f40f4c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:05.805256 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5454d403-b984-426d-be8b-affc46f40f4c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:05.806013 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5454d403-b984-426d-be8b-affc46f40f4c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:05.893645 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d4a71314-83f0-466d-b572-903e9507b16d tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] [instance: 12e5e9fe-b998-450c-94b0-492a92bb6027] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:35:06.057891 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d4a71314-83f0-466d-b572-903e9507b16d tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] 10.222.0.79 "DELETE /compute/v2.1/servers/12e5e9fe-b998-450c-94b0-492a92bb6027" status: 204 len: 0 microversion: 2.1 time: 0.344541 Oct 17 13:35:06.058626 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 241/492] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:35:05 2022] DELETE /compute/v2.1/servers/12e5e9fe-b998-450c-94b0-492a92bb6027 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:35:06.065083 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-ce473b8f-55c9-4d44-bfe4-07963468deca req-acbe29fc-6ae2-412e-8dd7-afd58e6fbac6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00b0dfe0-2c88-4037-830f-4144190da935", "name": "network-vif-deleted", "tag": "29478579-1d21-4c52-a447-0234ccc5dbd4"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:06.076947 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-ce473b8f-55c9-4d44-bfe4-07963468deca req-acbe29fc-6ae2-412e-8dd7-afd58e6fbac6 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:06.077852 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-ce473b8f-55c9-4d44-bfe4-07963468deca req-acbe29fc-6ae2-412e-8dd7-afd58e6fbac6 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:06.078479 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-ce473b8f-55c9-4d44-bfe4-07963468deca req-acbe29fc-6ae2-412e-8dd7-afd58e6fbac6 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:06.093452 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-ce473b8f-55c9-4d44-bfe4-07963468deca req-acbe29fc-6ae2-412e-8dd7-afd58e6fbac6 service nova] Creating event network-vif-deleted:29478579-1d21-4c52-a447-0234ccc5dbd4 for instance 00b0dfe0-2c88-4037-830f-4144190da935 on n-h1-854247-14 Oct 17 13:35:06.106784 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-ce473b8f-55c9-4d44-bfe4-07963468deca req-acbe29fc-6ae2-412e-8dd7-afd58e6fbac6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046723 Oct 17 13:35:06.108199 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 242/493] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:06.119717 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ef69231f-f711-45a6-a602-d7a37c4682c4 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:06.121105 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ef69231f-f711-45a6-a602-d7a37c4682c4 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] [instance: c47e40d5-8a51-45cc-93e5-1142c8988e5c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:06.144171 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ef69231f-f711-45a6-a602-d7a37c4682c4 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:06.144902 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ef69231f-f711-45a6-a602-d7a37c4682c4 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:06.145995 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ef69231f-f711-45a6-a602-d7a37c4682c4 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:06.146934 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ef69231f-f711-45a6-a602-d7a37c4682c4 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:06.147834 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ef69231f-f711-45a6-a602-d7a37c4682c4 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:06.148453 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ef69231f-f711-45a6-a602-d7a37c4682c4 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:06.868498 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5454d403-b984-426d-be8b-affc46f40f4c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:06.886002 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5454d403-b984-426d-be8b-affc46f40f4c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/85444f54-9792-4b13-90dc-d698bc57b60b" status: 200 len: 1503 microversion: 2.1 time: 1.115505 Oct 17 13:35:06.887436 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 252/494] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:05 2022] GET /compute/v2.1/servers/85444f54-9792-4b13-90dc-d698bc57b60b => generated 1503 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:06.894105 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a6dadb2e-f0fe-4c1a-b0b5-cd093feb9cce tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:06.898435 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a6dadb2e-f0fe-4c1a-b0b5-cd093feb9cce tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] [instance: f0067ca2-1063-4f5b-901d-d766e56afa39] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:06.914716 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a6dadb2e-f0fe-4c1a-b0b5-cd093feb9cce tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:06.917681 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a6dadb2e-f0fe-4c1a-b0b5-cd093feb9cce tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:06.918475 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a6dadb2e-f0fe-4c1a-b0b5-cd093feb9cce tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:06.921333 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a6dadb2e-f0fe-4c1a-b0b5-cd093feb9cce tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:06.921983 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a6dadb2e-f0fe-4c1a-b0b5-cd093feb9cce tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:06.922618 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a6dadb2e-f0fe-4c1a-b0b5-cd093feb9cce tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:06.924811 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ef69231f-f711-45a6-a602-d7a37c4682c4 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf50aa8e899648418eace99975616e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6aa32dd3904f6aaae1e63fcc67b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:06.934086 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ef69231f-f711-45a6-a602-d7a37c4682c4 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] 10.222.0.79 "GET /compute/v2.1/servers/c47e40d5-8a51-45cc-93e5-1142c8988e5c" status: 200 len: 1319 microversion: 2.1 time: 0.824412 Oct 17 13:35:06.934672 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 243/495] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:06 2022] GET /compute/v2.1/servers/c47e40d5-8a51-45cc-93e5-1142c8988e5c => generated 1319 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:07.027410 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-082650c1-70ab-4cdc-858b-312d488d9de9 tempest-SecurityGroupsTestAdminJSON-660839262 tempest-SecurityGroupsTestAdminJSON-660839262-project-admin] Action: 'create', calling method: .version_select at 0x7f7cd5ca83a0>, body: {"security_group": {"name": "tempest-securitygroup-1286050955", "description": "tempest-description-1385991053"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:07.515350 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a6dadb2e-f0fe-4c1a-b0b5-cd093feb9cce tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a685773acdb415591f62ccee7157b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa06a29e779e413484cdfcb27e902525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:07.529810 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a6dadb2e-f0fe-4c1a-b0b5-cd093feb9cce tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] 10.222.0.79 "GET /compute/v2.1/servers/f0067ca2-1063-4f5b-901d-d766e56afa39" status: 200 len: 1321 microversion: 2.1 time: 0.639840 Oct 17 13:35:07.530809 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 253/496] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:06 2022] GET /compute/v2.1/servers/f0067ca2-1063-4f5b-901d-d766e56afa39 => generated 1321 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:07.537703 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ca0ae6e5-790b-4be3-a328-20144818e635 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:07.539339 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ca0ae6e5-790b-4be3-a328-20144818e635 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 32728e12-4f3f-4f72-902c-10349708549f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:07.554290 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ca0ae6e5-790b-4be3-a328-20144818e635 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:07.554719 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ca0ae6e5-790b-4be3-a328-20144818e635 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:07.559053 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ca0ae6e5-790b-4be3-a328-20144818e635 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:07.560439 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ca0ae6e5-790b-4be3-a328-20144818e635 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:07.561182 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ca0ae6e5-790b-4be3-a328-20144818e635 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:07.563228 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ca0ae6e5-790b-4be3-a328-20144818e635 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:07.692297 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=28 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:07.886313 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ca0ae6e5-790b-4be3-a328-20144818e635 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:07.897640 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ca0ae6e5-790b-4be3-a328-20144818e635 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/32728e12-4f3f-4f72-902c-10349708549f" status: 200 len: 1467 microversion: 2.1 time: 0.365289 Oct 17 13:35:07.898473 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 254/497] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:07 2022] GET /compute/v2.1/servers/32728e12-4f3f-4f72-902c-10349708549f => generated 1467 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:07.912795 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-04967bfe-b9bc-42aa-8d1b-5f6b4baef579 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1630244605", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "2093214170", "adminPass": "***", "networks": [{"uuid": "055d2ab9-c493-46f8-a4f8-8c543bddf8af"}], "security_groups": [{"name": "tempest-securitygroup--403449206"}], "key_name": "tempest-keypair-467217040", "user_data": "}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:08.110372 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-082650c1-70ab-4cdc-858b-312d488d9de9 tempest-SecurityGroupsTestAdminJSON-660839262 tempest-SecurityGroupsTestAdminJSON-660839262-project-admin] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.156506 Oct 17 13:35:08.111410 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 244/498] 10.222.0.79 () {60 vars in 1180 bytes} [Mon Oct 17 13:35:06 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:08.116171 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b9e135ac-99c5-46f2-8108-51d58078fb51 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:08.116953 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b9e135ac-99c5-46f2-8108-51d58078fb51 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] [instance: 00b0dfe0-2c88-4037-830f-4144190da935] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:08.123644 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b9e135ac-99c5-46f2-8108-51d58078fb51 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:08.124376 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b9e135ac-99c5-46f2-8108-51d58078fb51 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:08.125631 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b9e135ac-99c5-46f2-8108-51d58078fb51 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:08.126511 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b9e135ac-99c5-46f2-8108-51d58078fb51 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:08.127420 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b9e135ac-99c5-46f2-8108-51d58078fb51 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:08.127996 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b9e135ac-99c5-46f2-8108-51d58078fb51 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:08.150125 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-b9e135ac-99c5-46f2-8108-51d58078fb51 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] HTTP exception thrown: Instance 00b0dfe0-2c88-4037-830f-4144190da935 could not be found. Oct 17 13:35:08.153589 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b9e135ac-99c5-46f2-8108-51d58078fb51 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Request method failure captured: Oct 17 13:35:08.153589 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/00b0dfe0-2c88-4037-830f-4144190da935 HTTP/1.1 Oct 17 13:35:08.153589 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:35:08.153589 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:35:08.153589 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:35:08.153589 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:35:08.153589 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:35:08.153589 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:35:08.153589 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:35:08.153589 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:35:08.153589 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVnI9ZkUi5bz9xFhAzYfWxOKCAOo4qS7iUuO0gbpYOC8qpve7j2dHq3MCh4ve5wzFgK3s6qpvKFZw-vRBCSfoK1YYpAf6zdoas523ElL78zlEsATNwD9rb21E3cxpIKHMdZ0qKhS2y1y_iHibklNINRazI21gMUNlt_hIt0TWyAPiTs Oct 17 13:35:08.153589 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:35:08.153589 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:35:08.153589 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:35:08.153589 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:35:08.153589 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:35:08.153589 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:35:08.153589 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: a3a297ddf04b4b18ae7591e107e84d36 Oct 17 13:35:08.153589 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-LiveMigrationNegativeTest-1271561492 Oct 17 13:35:08.153589 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:35:08.153589 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:35:08.155139 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a3a297ddf04b4b18ae7591e107e84d36"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a3a297ddf04b4b18ae7591e107e84d36"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a3a297ddf04b4b18ae7591e107e84d36"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a3a297ddf04b4b18ae7591e107e84d36", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:35:08.155139 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-LiveMigrationNegativeTest-1271561492 Oct 17 13:35:08.155139 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: a3a297ddf04b4b18ae7591e107e84d36 Oct 17 13:35:08.155139 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1271561492 Oct 17 13:35:08.155139 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-LiveMigrationNegativeTest-1271561492-project Oct 17 13:35:08.155139 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:35:08.155139 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:35:08.155139 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 44ca1489f0084089a47d0cfc2ad37940 Oct 17 13:35:08.155139 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-LiveMigrationNegativeTest-1271561492-project Oct 17 13:35:08.155139 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:35:08.155139 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 00b0dfe0-2c88-4037-830f-4144190da935 could not be found. Oct 17 13:35:08.155139 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '00b0dfe0-2c88-4037-830f-4144190da935'} Oct 17 13:35:08.155918 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:35:08.155918 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:08.155918 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:35:08.155918 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:35:08.155918 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:35:08.155918 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:35:08.155918 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:35:08.155918 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:35:08.155918 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:35:08.155918 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:35:08.155918 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00b0dfe0-2c88-4037-830f-4144190da935 could not be found. Oct 17 13:35:08.155918 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:08.155918 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:35:08.155918 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:08.155918 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:08.155918 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:35:08.155918 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:35:08.155918 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:35:08.155918 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:35:08.155918 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:35:08.157297 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:35:08.157297 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:35:08.157297 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:35:08.157297 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:35:08.157297 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:35:08.157297 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:35:08.157297 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:35:08.157297 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00b0dfe0-2c88-4037-830f-4144190da935 could not be found. Oct 17 13:35:08.157297 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:08.157297 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:35:08.157297 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:08.157297 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:08.157297 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:35:08.157297 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:35:08.157297 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:35:08.157297 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:35:08.157297 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00b0dfe0-2c88-4037-830f-4144190da935 could not be found. Oct 17 13:35:08.157297 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:08.160103 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b9e135ac-99c5-46f2-8108-51d58078fb51 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] Returning 404 to user: Instance 00b0dfe0-2c88-4037-830f-4144190da935 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:35:08.161480 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b9e135ac-99c5-46f2-8108-51d58078fb51 tempest-LiveMigrationNegativeTest-1271561492 tempest-LiveMigrationNegativeTest-1271561492-project] 10.222.0.79 "GET /compute/v2.1/servers/00b0dfe0-2c88-4037-830f-4144190da935" status: 404 len: 111 microversion: 2.1 time: 0.048760 Oct 17 13:35:08.162955 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 245/499] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:08 2022] GET /compute/v2.1/servers/00b0dfe0-2c88-4037-830f-4144190da935 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:35:08.173897 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-04967bfe-b9bc-42aa-8d1b-5f6b4baef579 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] validate_networks() for [('055d2ab9-c493-46f8-a4f8-8c543bddf8af', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:35:08.302335 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c45aff92-6364-4adb-8591-47afa3f00ba9 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-400877945", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "95833473-af23-4ef3-b861-8a8f3e383e0c"}]}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:08.371835 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-c45aff92-6364-4adb-8591-47afa3f00ba9 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] validate_networks() for [('95833473-af23-4ef3-b861-8a8f3e383e0c', None, None, None, None, None)] {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:35:09.924695 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-c45aff92-6364-4adb-8591-47afa3f00ba9 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:35:09.927740 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-c45aff92-6364-4adb-8591-47afa3f00ba9 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:35:09.928749 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-c45aff92-6364-4adb-8591-47afa3f00ba9 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:35:09.929363 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-c45aff92-6364-4adb-8591-47afa3f00ba9 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:35:09.929968 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-c45aff92-6364-4adb-8591-47afa3f00ba9 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:35:09.936613 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-04967bfe-b9bc-42aa-8d1b-5f6b4baef579 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:35:09.939143 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-04967bfe-b9bc-42aa-8d1b-5f6b4baef579 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:35:09.939898 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-04967bfe-b9bc-42aa-8d1b-5f6b4baef579 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:35:09.940729 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-04967bfe-b9bc-42aa-8d1b-5f6b4baef579 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:35:09.941324 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-04967bfe-b9bc-42aa-8d1b-5f6b4baef579 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:35:09.967468 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-04967bfe-b9bc-42aa-8d1b-5f6b4baef579 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:09.968261 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-04967bfe-b9bc-42aa-8d1b-5f6b4baef579 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:09.969165 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c45aff92-6364-4adb-8591-47afa3f00ba9 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:09.969624 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-04967bfe-b9bc-42aa-8d1b-5f6b4baef579 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:09.969773 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c45aff92-6364-4adb-8591-47afa3f00ba9 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:09.970285 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c45aff92-6364-4adb-8591-47afa3f00ba9 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:09.970892 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-04967bfe-b9bc-42aa-8d1b-5f6b4baef579 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:09.971557 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c45aff92-6364-4adb-8591-47afa3f00ba9 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:09.971970 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-04967bfe-b9bc-42aa-8d1b-5f6b4baef579 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:09.972190 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c45aff92-6364-4adb-8591-47afa3f00ba9 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:09.972669 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c45aff92-6364-4adb-8591-47afa3f00ba9 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:09.973001 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-04967bfe-b9bc-42aa-8d1b-5f6b4baef579 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:09.994396 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-c45aff92-6364-4adb-8591-47afa3f00ba9 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Getting quotas for project bc31d4fa0cd9418584f52e7c46ade866. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:35:10.000585 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-04967bfe-b9bc-42aa-8d1b-5f6b4baef579 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Getting quotas for project 550b2bda88024756abc4134365842d17. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:35:10.001156 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-c45aff92-6364-4adb-8591-47afa3f00ba9 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Getting quotas for user 2a3dfc7f18ec4a6883b62872ab011cc4 and project bc31d4fa0cd9418584f52e7c46ade866. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:35:10.005971 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-04967bfe-b9bc-42aa-8d1b-5f6b4baef579 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Getting quotas for user 8e836340278b49f593350249132b9cfc and project 550b2bda88024756abc4134365842d17. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:35:10.022763 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c45aff92-6364-4adb-8591-47afa3f00ba9 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:35:10.025955 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c45aff92-6364-4adb-8591-47afa3f00ba9 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] [instance: 3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:35:10.047141 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-04967bfe-b9bc-42aa-8d1b-5f6b4baef579 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:35:10.049095 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=1,nova_api:UPDATE=3 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:10.052138 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-04967bfe-b9bc-42aa-8d1b-5f6b4baef579 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] [instance: dd9a885e-0fb3-411a-b816-eafc93e1c5cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:35:10.125083 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c45aff92-6364-4adb-8591-47afa3f00ba9 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.958036 Oct 17 13:35:10.126079 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 246/500] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:35:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1962 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:35:10.135832 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-4eb43922-02d1-4da8-b97c-4ac9cbf2daaf req-b8aa1c9d-4491-4319-8d3e-722d9216f98c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0067ca2-1063-4f5b-901d-d766e56afa39", "name": "network-vif-plugged", "status": "completed", "tag": "dcea5002-bfa7-4323-bfce-fa27565f133c"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:10.156036 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-04967bfe-b9bc-42aa-8d1b-5f6b4baef579 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.256097 Oct 17 13:35:10.158041 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 255/501] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:35:07 2022] POST /compute/v2.1/servers => generated 401 bytes in 2259 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:35:10.175728 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-4eb43922-02d1-4da8-b97c-4ac9cbf2daaf req-b8aa1c9d-4491-4319-8d3e-722d9216f98c service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:10.178713 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-4eb43922-02d1-4da8-b97c-4ac9cbf2daaf req-b8aa1c9d-4491-4319-8d3e-722d9216f98c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:10.179406 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-4eb43922-02d1-4da8-b97c-4ac9cbf2daaf req-b8aa1c9d-4491-4319-8d3e-722d9216f98c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:10.196895 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c99b3f29-b6ff-45cd-8443-f48034aa8799 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:10.199531 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c99b3f29-b6ff-45cd-8443-f48034aa8799 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: 85444f54-9792-4b13-90dc-d698bc57b60b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:10.200850 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-4eb43922-02d1-4da8-b97c-4ac9cbf2daaf req-b8aa1c9d-4491-4319-8d3e-722d9216f98c service nova] Creating event network-vif-plugged:dcea5002-bfa7-4323-bfce-fa27565f133c for instance f0067ca2-1063-4f5b-901d-d766e56afa39 on n-h1-854247-14 Oct 17 13:35:10.207085 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c99b3f29-b6ff-45cd-8443-f48034aa8799 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:10.207798 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c99b3f29-b6ff-45cd-8443-f48034aa8799 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:10.209379 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c99b3f29-b6ff-45cd-8443-f48034aa8799 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:10.210475 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c99b3f29-b6ff-45cd-8443-f48034aa8799 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:10.211088 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c99b3f29-b6ff-45cd-8443-f48034aa8799 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:10.211547 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c99b3f29-b6ff-45cd-8443-f48034aa8799 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:10.213355 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-4eb43922-02d1-4da8-b97c-4ac9cbf2daaf req-b8aa1c9d-4491-4319-8d3e-722d9216f98c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085776 Oct 17 13:35:10.225964 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 247/502] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:10.685842 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e5378cb2-fdbe-41f7-8529-9a8739f01390 tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:10.686555 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e5378cb2-fdbe-41f7-8529-9a8739f01390 tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] [instance: 32728e12-4f3f-4f72-902c-10349708549f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:10.694479 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e5378cb2-fdbe-41f7-8529-9a8739f01390 tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:10.695188 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e5378cb2-fdbe-41f7-8529-9a8739f01390 tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:10.695581 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e5378cb2-fdbe-41f7-8529-9a8739f01390 tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:10.696718 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e5378cb2-fdbe-41f7-8529-9a8739f01390 tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:10.701841 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e5378cb2-fdbe-41f7-8529-9a8739f01390 tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:10.702397 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e5378cb2-fdbe-41f7-8529-9a8739f01390 tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:11.223302 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c99b3f29-b6ff-45cd-8443-f48034aa8799 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:11.245690 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c99b3f29-b6ff-45cd-8443-f48034aa8799 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/85444f54-9792-4b13-90dc-d698bc57b60b" status: 200 len: 1503 microversion: 2.1 time: 1.061854 Oct 17 13:35:11.246450 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 256/503] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:10 2022] GET /compute/v2.1/servers/85444f54-9792-4b13-90dc-d698bc57b60b => generated 1503 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:11.263296 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0b9b5b99-bd24-4207-92a9-6daa0ac06b6d tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:11.265522 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0b9b5b99-bd24-4207-92a9-6daa0ac06b6d tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] [instance: c47e40d5-8a51-45cc-93e5-1142c8988e5c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:11.301349 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0b9b5b99-bd24-4207-92a9-6daa0ac06b6d tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:11.302022 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0b9b5b99-bd24-4207-92a9-6daa0ac06b6d tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:11.307889 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0b9b5b99-bd24-4207-92a9-6daa0ac06b6d tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:11.309727 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0b9b5b99-bd24-4207-92a9-6daa0ac06b6d tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:11.310368 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0b9b5b99-bd24-4207-92a9-6daa0ac06b6d tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:11.310907 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0b9b5b99-bd24-4207-92a9-6daa0ac06b6d tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:11.569489 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e5378cb2-fdbe-41f7-8529-9a8739f01390 tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/32728e12-4f3f-4f72-902c-10349708549f" status: 200 len: 1620 microversion: 2.1 time: 1.342169 Oct 17 13:35:11.602196 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 248/504] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:10 2022] GET /compute/v2.1/servers/32728e12-4f3f-4f72-902c-10349708549f => generated 1620 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:11.635626 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5c345cad-4eac-46b9-a7af-7f8932ebb267 tempest-SecurityGroupsTestAdminJSON-660839262 tempest-SecurityGroupsTestAdminJSON-660839262-project-admin] Action: 'create', calling method: .version_select at 0x7f7cd5cee3a0>, body: {"security_group": {"name": "tempest-securitygroup-416392771", "description": "tempest-description-1415601499"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:11.998184 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0b9b5b99-bd24-4207-92a9-6daa0ac06b6d tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf50aa8e899648418eace99975616e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6aa32dd3904f6aaae1e63fcc67b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:12.010459 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0b9b5b99-bd24-4207-92a9-6daa0ac06b6d tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] 10.222.0.79 "GET /compute/v2.1/servers/c47e40d5-8a51-45cc-93e5-1142c8988e5c" status: 200 len: 1319 microversion: 2.1 time: 0.761675 Oct 17 13:35:12.015276 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 257/505] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:11 2022] GET /compute/v2.1/servers/c47e40d5-8a51-45cc-93e5-1142c8988e5c => generated 1319 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:12.020006 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-3e781b62-a0bc-41fd-8ce8-73d8a309d2f6 req-654c7dfe-2f56-4ebd-be31-f65bfbe902cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85444f54-9792-4b13-90dc-d698bc57b60b", "name": "network-vif-unplugged", "status": "completed", "tag": "48dfe136-d328-4b93-bfb8-302d0ec30369"}, {"name": "network-changed", "server_uuid": "85444f54-9792-4b13-90dc-d698bc57b60b", "tag": "48dfe136-d328-4b93-bfb8-302d0ec30369"}, {"name": "network-changed", "server_uuid": "c47e40d5-8a51-45cc-93e5-1142c8988e5c", "tag": "3b0ed902-0a43-4b1a-9a6b-16ba3b6d6f28"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:12.039978 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-3e781b62-a0bc-41fd-8ce8-73d8a309d2f6 req-654c7dfe-2f56-4ebd-be31-f65bfbe902cf service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:12.040833 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-3e781b62-a0bc-41fd-8ce8-73d8a309d2f6 req-654c7dfe-2f56-4ebd-be31-f65bfbe902cf service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:12.041666 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-3e781b62-a0bc-41fd-8ce8-73d8a309d2f6 req-654c7dfe-2f56-4ebd-be31-f65bfbe902cf service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:12.064440 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-3e781b62-a0bc-41fd-8ce8-73d8a309d2f6 req-654c7dfe-2f56-4ebd-be31-f65bfbe902cf service nova] Creating event network-vif-unplugged:48dfe136-d328-4b93-bfb8-302d0ec30369 for instance 85444f54-9792-4b13-90dc-d698bc57b60b on n-h1-854247-14 Oct 17 13:35:12.065241 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-3e781b62-a0bc-41fd-8ce8-73d8a309d2f6 req-654c7dfe-2f56-4ebd-be31-f65bfbe902cf service nova] Creating event network-changed:48dfe136-d328-4b93-bfb8-302d0ec30369 for instance 85444f54-9792-4b13-90dc-d698bc57b60b on n-h1-854247-14 Oct 17 13:35:12.065954 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-3e781b62-a0bc-41fd-8ce8-73d8a309d2f6 req-654c7dfe-2f56-4ebd-be31-f65bfbe902cf service nova] Creating event network-changed:3b0ed902-0a43-4b1a-9a6b-16ba3b6d6f28 for instance c47e40d5-8a51-45cc-93e5-1142c8988e5c on n-h2-854247-14 Oct 17 13:35:12.081183 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-3e781b62-a0bc-41fd-8ce8-73d8a309d2f6 req-654c7dfe-2f56-4ebd-be31-f65bfbe902cf service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 519 microversion: 2.1 time: 0.064555 Oct 17 13:35:12.081843 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 258/506] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 519 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:12.087521 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-57c0a452-bfff-4eff-9b2d-8efdaeb3d399 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:12.095343 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-57c0a452-bfff-4eff-9b2d-8efdaeb3d399 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] [instance: f0067ca2-1063-4f5b-901d-d766e56afa39] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:12.102035 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-57c0a452-bfff-4eff-9b2d-8efdaeb3d399 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:12.102833 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-57c0a452-bfff-4eff-9b2d-8efdaeb3d399 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:12.103460 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-57c0a452-bfff-4eff-9b2d-8efdaeb3d399 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:12.104352 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-57c0a452-bfff-4eff-9b2d-8efdaeb3d399 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:12.104954 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-57c0a452-bfff-4eff-9b2d-8efdaeb3d399 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:12.105516 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-57c0a452-bfff-4eff-9b2d-8efdaeb3d399 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:12.498791 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5c345cad-4eac-46b9-a7af-7f8932ebb267 tempest-SecurityGroupsTestAdminJSON-660839262 tempest-SecurityGroupsTestAdminJSON-660839262-project-admin] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.891635 Oct 17 13:35:12.500271 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 249/507] 10.222.0.79 () {60 vars in 1180 bytes} [Mon Oct 17 13:35:11 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:12.505640 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-af03f04b-7634-4c1a-8b9e-7f67813be65a tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:12.506403 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-af03f04b-7634-4c1a-8b9e-7f67813be65a tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] [instance: 3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:12.513769 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af03f04b-7634-4c1a-8b9e-7f67813be65a tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:12.514686 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af03f04b-7634-4c1a-8b9e-7f67813be65a tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:12.515201 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af03f04b-7634-4c1a-8b9e-7f67813be65a tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:12.515970 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af03f04b-7634-4c1a-8b9e-7f67813be65a tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:12.516571 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af03f04b-7634-4c1a-8b9e-7f67813be65a tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:12.517141 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af03f04b-7634-4c1a-8b9e-7f67813be65a tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:12.578038 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-57c0a452-bfff-4eff-9b2d-8efdaeb3d399 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a685773acdb415591f62ccee7157b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa06a29e779e413484cdfcb27e902525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:12.589182 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-57c0a452-bfff-4eff-9b2d-8efdaeb3d399 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] 10.222.0.79 "GET /compute/v2.1/servers/f0067ca2-1063-4f5b-901d-d766e56afa39" status: 200 len: 1471 microversion: 2.1 time: 0.505857 Oct 17 13:35:12.590055 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 259/508] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:12 2022] GET /compute/v2.1/servers/f0067ca2-1063-4f5b-901d-d766e56afa39 => generated 1471 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:12.595133 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b2a9a09c-8f5f-4cb9-9d49-047076e634fb tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:12.595929 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b2a9a09c-8f5f-4cb9-9d49-047076e634fb tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] [instance: dd9a885e-0fb3-411a-b816-eafc93e1c5cb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:12.602237 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b2a9a09c-8f5f-4cb9-9d49-047076e634fb tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:12.603687 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b2a9a09c-8f5f-4cb9-9d49-047076e634fb tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:12.604311 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b2a9a09c-8f5f-4cb9-9d49-047076e634fb tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:12.604968 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b2a9a09c-8f5f-4cb9-9d49-047076e634fb tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:12.606310 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b2a9a09c-8f5f-4cb9-9d49-047076e634fb tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:12.606873 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b2a9a09c-8f5f-4cb9-9d49-047076e634fb tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:12.615485 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-af03f04b-7634-4c1a-8b9e-7f67813be65a tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3dfc7f18ec4a6883b62872ab011cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc31d4fa0cd9418584f52e7c46ade866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:12.626117 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-af03f04b-7634-4c1a-8b9e-7f67813be65a tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] 10.222.0.79 "GET /compute/v2.1/servers/3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5" status: 200 len: 1227 microversion: 2.1 time: 0.124539 Oct 17 13:35:12.652978 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 250/509] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:12 2022] GET /compute/v2.1/servers/3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5 => generated 1227 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:12.659005 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e30627f4-e2f7-4450-ad83-76bcf19bec33 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Action: 'create', calling method: .version_select at 0x7f7cd5cee160>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-675230571", "policies": ["affinity"]}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:12.680289 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-e30627f4-e2f7-4450-ad83-76bcf19bec33 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Getting quotas for project fa1db260a96a4c6aa69cd6437baab6f7. Resources: {'server_groups'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:35:12.686332 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-e30627f4-e2f7-4450-ad83-76bcf19bec33 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Getting quotas for user 7a7e082035084338966a1c56b30c7093 and project fa1db260a96a4c6aa69cd6437baab6f7. Resources: {'server_groups'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:35:12.733564 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b2a9a09c-8f5f-4cb9-9d49-047076e634fb tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e836340278b49f593350249132b9cfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550b2bda88024756abc4134365842d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:12.754037 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-e30627f4-e2f7-4450-ad83-76bcf19bec33 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Getting quotas for project fa1db260a96a4c6aa69cd6437baab6f7. Resources: {'server_groups'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:35:12.758439 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b2a9a09c-8f5f-4cb9-9d49-047076e634fb tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] 10.222.0.79 "GET /compute/v2.1/servers/dd9a885e-0fb3-411a-b816-eafc93e1c5cb" status: 200 len: 1316 microversion: 2.1 time: 0.166882 Oct 17 13:35:12.760065 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 260/510] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:12 2022] GET /compute/v2.1/servers/dd9a885e-0fb3-411a-b816-eafc93e1c5cb => generated 1316 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:12.762035 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-e30627f4-e2f7-4450-ad83-76bcf19bec33 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Getting quotas for user 7a7e082035084338966a1c56b30c7093 and project fa1db260a96a4c6aa69cd6437baab6f7. Resources: {'server_groups'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:35:12.772216 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0a8f51fe-6469-44f7-9654-d03d5dc141a4 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:12.774929 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0a8f51fe-6469-44f7-9654-d03d5dc141a4 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: 85444f54-9792-4b13-90dc-d698bc57b60b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:12.781812 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e30627f4-e2f7-4450-ad83-76bcf19bec33 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.126277 Oct 17 13:35:12.782391 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0a8f51fe-6469-44f7-9654-d03d5dc141a4 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:12.782872 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0a8f51fe-6469-44f7-9654-d03d5dc141a4 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:12.784503 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0a8f51fe-6469-44f7-9654-d03d5dc141a4 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:12.785297 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0a8f51fe-6469-44f7-9654-d03d5dc141a4 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:12.785756 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0a8f51fe-6469-44f7-9654-d03d5dc141a4 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:12.786179 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0a8f51fe-6469-44f7-9654-d03d5dc141a4 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:12.795850 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 251/511] 10.222.0.79 () {60 vars in 1174 bytes} [Mon Oct 17 13:35:12 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:13.018254 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c2efa69e-a18e-46f1-b7b4-412de07cfdbb tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1446305196", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": "none"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:13.126488 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-c2efa69e-a18e-46f1-b7b4-412de07cfdbb tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:35:13.127073 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-c2efa69e-a18e-46f1-b7b4-412de07cfdbb tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:35:13.127573 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-c2efa69e-a18e-46f1-b7b4-412de07cfdbb tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:35:13.127976 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-c2efa69e-a18e-46f1-b7b4-412de07cfdbb tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:35:13.128497 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-c2efa69e-a18e-46f1-b7b4-412de07cfdbb tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:35:13.172128 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c2efa69e-a18e-46f1-b7b4-412de07cfdbb tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:13.173010 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c2efa69e-a18e-46f1-b7b4-412de07cfdbb tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:13.173589 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c2efa69e-a18e-46f1-b7b4-412de07cfdbb tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:13.174948 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c2efa69e-a18e-46f1-b7b4-412de07cfdbb tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:13.175736 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c2efa69e-a18e-46f1-b7b4-412de07cfdbb tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:13.176590 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c2efa69e-a18e-46f1-b7b4-412de07cfdbb tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:13.205777 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-c2efa69e-a18e-46f1-b7b4-412de07cfdbb tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Getting quotas for project 62f1817aaa4248529aa6e3731422c44c. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:35:13.216162 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-c2efa69e-a18e-46f1-b7b4-412de07cfdbb tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Getting quotas for user dbc256ad10b94b558c189cdf9496d63f and project 62f1817aaa4248529aa6e3731422c44c. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:35:13.250833 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c2efa69e-a18e-46f1-b7b4-412de07cfdbb tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:35:13.253727 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c2efa69e-a18e-46f1-b7b4-412de07cfdbb tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] [instance: 51be2144-e969-4e1b-b5da-c43b9a7b7c90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:35:13.264474 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0a8f51fe-6469-44f7-9654-d03d5dc141a4 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:13.272669 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0a8f51fe-6469-44f7-9654-d03d5dc141a4 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/85444f54-9792-4b13-90dc-d698bc57b60b" status: 200 len: 1503 microversion: 2.1 time: 0.510308 Oct 17 13:35:13.273245 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 261/512] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:12 2022] GET /compute/v2.1/servers/85444f54-9792-4b13-90dc-d698bc57b60b => generated 1503 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:13.290486 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-598e0c0f-ebb4-4f30-bed2-f1863160ab14 tempest-SecurityGroupsTestAdminJSON-660839262 tempest-SecurityGroupsTestAdminJSON-660839262-project-admin] Calling method '.version_select at 0x7f7cd5e2ec10>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:13.310839 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c2efa69e-a18e-46f1-b7b4-412de07cfdbb tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.513803 Oct 17 13:35:13.311630 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 252/513] 10.222.0.79 () {62 vars in 1188 bytes} [Mon Oct 17 13:35:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 515 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 13:35:13.514549 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-87b280b0-c8c2-4394-81a0-237c33fe7dd4 tempest-ServersAdminNegativeTestJSON-1416660348 tempest-ServersAdminNegativeTestJSON-1416660348-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:13.516605 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-87b280b0-c8c2-4394-81a0-237c33fe7dd4 tempest-ServersAdminNegativeTestJSON-1416660348 tempest-ServersAdminNegativeTestJSON-1416660348-project-admin] [instance: 8892de6c-551e-48b7-853b-bd431a5d9113] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:13.553954 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-87b280b0-c8c2-4394-81a0-237c33fe7dd4 tempest-ServersAdminNegativeTestJSON-1416660348 tempest-ServersAdminNegativeTestJSON-1416660348-project-admin] HTTP exception thrown: Instance 8892de6c-551e-48b7-853b-bd431a5d9113 could not be found. Oct 17 13:35:13.556363 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-87b280b0-c8c2-4394-81a0-237c33fe7dd4 tempest-ServersAdminNegativeTestJSON-1416660348 tempest-ServersAdminNegativeTestJSON-1416660348-project-admin] Request method failure captured: Oct 17 13:35:13.556363 n-d-854247-14 devstack@n-api.service[127016]: request: POST /compute/v2.1/servers/8892de6c-551e-48b7-853b-bd431a5d9113/action HTTP/1.1 Oct 17 13:35:13.556363 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:35:13.556363 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:35:13.556363 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:35:13.556363 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 15 Oct 17 13:35:13.556363 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:35:13.556363 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:35:13.556363 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:35:13.556363 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:35:13.556363 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVn6VmkhfaVG6VeIKMx3qVbBbEjBRYg29fYxwujK-3t22OgLdjtP82VO2AjHee_Ll_n9i2R0A7olZTb8l9TSCOIGso4lNuC9laxnGDN6EM8f4EFK4BRRDrvRHHNKEChsI1peVOxI6ExJd3UXIN4gEGftMpEuzFdUPEOMJMuHsNUyJwQ Oct 17 13:35:13.556363 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:35:13.556363 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:35:13.556363 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:35:13.556363 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:35:13.556363 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:35:13.556363 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:35:13.556363 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: b8e914392c8f47f29110268677be9df5 Oct 17 13:35:13.556363 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1416660348 Oct 17 13:35:13.556363 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member,admin Oct 17 13:35:13.556363 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member,admin Oct 17 13:35:13.557937 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b8e914392c8f47f29110268677be9df5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b8e914392c8f47f29110268677be9df5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b8e914392c8f47f29110268677be9df5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b8e914392c8f47f29110268677be9df5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:35:13.557937 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1416660348 Oct 17 13:35:13.557937 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: b8e914392c8f47f29110268677be9df5 Oct 17 13:35:13.557937 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1416660348 Oct 17 13:35:13.557937 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServersAdminNegativeTestJSON-1416660348-project-admin Oct 17 13:35:13.557937 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:35:13.557937 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:35:13.557937 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 31fc3abdb9b7402da26811eeb714f9c1 Oct 17 13:35:13.557937 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1416660348-project-admin Oct 17 13:35:13.557937 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:35:13.557937 n-d-854247-14 devstack@n-api.service[127016]: {"migrate": {}} Oct 17 13:35:13.557937 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:35:13.557937 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 8892de6c-551e-48b7-853b-bd431a5d9113 could not be found. Oct 17 13:35:13.558887 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '8892de6c-551e-48b7-853b-bd431a5d9113', 'body': {'migrate': {}}} Oct 17 13:35:13.558887 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:35:13.558887 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:13.558887 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:35:13.558887 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:35:13.558887 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:35:13.558887 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:35:13.558887 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 13:35:13.558887 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 13:35:13.558887 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8892de6c-551e-48b7-853b-bd431a5d9113 could not be found. Oct 17 13:35:13.558887 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:13.558887 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:35:13.558887 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:13.558887 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:13.558887 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:35:13.558887 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:35:13.558887 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:35:13.558887 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:35:13.558887 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:35:13.558887 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:35:13.561732 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:35:13.561732 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:35:13.561732 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 17 13:35:13.561732 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 17 13:35:13.561732 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:35:13.561732 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:35:13.561732 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8892de6c-551e-48b7-853b-bd431a5d9113 could not be found. Oct 17 13:35:13.561732 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:13.561732 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:35:13.561732 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:13.561732 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:13.561732 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:35:13.561732 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:35:13.561732 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:35:13.561732 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:35:13.561732 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8892de6c-551e-48b7-853b-bd431a5d9113 could not be found. Oct 17 13:35:13.561732 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:13.564320 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-87b280b0-c8c2-4394-81a0-237c33fe7dd4 tempest-ServersAdminNegativeTestJSON-1416660348 tempest-ServersAdminNegativeTestJSON-1416660348-project-admin] Returning 404 to user: Instance 8892de6c-551e-48b7-853b-bd431a5d9113 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:35:13.566044 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-87b280b0-c8c2-4394-81a0-237c33fe7dd4 tempest-ServersAdminNegativeTestJSON-1416660348 tempest-ServersAdminNegativeTestJSON-1416660348-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/8892de6c-551e-48b7-853b-bd431a5d9113/action" status: 404 len: 111 microversion: 2.1 time: 0.252961 Oct 17 13:35:13.567745 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 253/514] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:35:13 2022] POST /compute/v2.1/servers/8892de6c-551e-48b7-853b-bd431a5d9113/action => generated 111 bytes in 255 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:35:13.584748 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-bc0ef84e-f931-4dfa-9dd4-c5fd9c0c175b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1969394781", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "aaa461b2-e1eb-4ef4-9a7c-d5ba39a4c4b4"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:13.722002 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-bc0ef84e-f931-4dfa-9dd4-c5fd9c0c175b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] validate_networks() for None {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:35:14.782915 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-bc0ef84e-f931-4dfa-9dd4-c5fd9c0c175b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:35:14.783723 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-bc0ef84e-f931-4dfa-9dd4-c5fd9c0c175b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:35:14.783846 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-bc0ef84e-f931-4dfa-9dd4-c5fd9c0c175b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:35:14.784180 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-bc0ef84e-f931-4dfa-9dd4-c5fd9c0c175b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:35:14.784590 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-bc0ef84e-f931-4dfa-9dd4-c5fd9c0c175b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:35:14.841570 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bc0ef84e-f931-4dfa-9dd4-c5fd9c0c175b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:14.842058 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bc0ef84e-f931-4dfa-9dd4-c5fd9c0c175b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:14.842486 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bc0ef84e-f931-4dfa-9dd4-c5fd9c0c175b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:14.843256 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bc0ef84e-f931-4dfa-9dd4-c5fd9c0c175b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:14.843706 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bc0ef84e-f931-4dfa-9dd4-c5fd9c0c175b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:14.844315 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bc0ef84e-f931-4dfa-9dd4-c5fd9c0c175b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:14.892170 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-bc0ef84e-f931-4dfa-9dd4-c5fd9c0c175b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Getting quotas for project fa1db260a96a4c6aa69cd6437baab6f7. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:35:14.899964 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-bc0ef84e-f931-4dfa-9dd4-c5fd9c0c175b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Getting quotas for user 7a7e082035084338966a1c56b30c7093 and project fa1db260a96a4c6aa69cd6437baab6f7. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:35:14.937934 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-bc0ef84e-f931-4dfa-9dd4-c5fd9c0c175b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Going to run 2 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:35:14.941853 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-bc0ef84e-f931-4dfa-9dd4-c5fd9c0c175b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 07af9912-df9b-4476-92b3-48858617dd29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:35:15.007232 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-bc0ef84e-f931-4dfa-9dd4-c5fd9c0c175b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=127016) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 17 13:35:15.042856 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-bc0ef84e-f931-4dfa-9dd4-c5fd9c0c175b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Getting quotas for project fa1db260a96a4c6aa69cd6437baab6f7. Resources: {'server_group_members'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:35:15.051444 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-bc0ef84e-f931-4dfa-9dd4-c5fd9c0c175b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Getting quotas for user 7a7e082035084338966a1c56b30c7093 and project fa1db260a96a4c6aa69cd6437baab6f7. Resources: {'server_group_members'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:35:15.164618 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-bc0ef84e-f931-4dfa-9dd4-c5fd9c0c175b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Getting quotas for project fa1db260a96a4c6aa69cd6437baab6f7. Resources: {'server_group_members'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:35:15.179299 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-bc0ef84e-f931-4dfa-9dd4-c5fd9c0c175b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Getting quotas for user 7a7e082035084338966a1c56b30c7093 and project fa1db260a96a4c6aa69cd6437baab6f7. Resources: {'server_group_members'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:35:15.206324 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-bc0ef84e-f931-4dfa-9dd4-c5fd9c0c175b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 03e8be7f-09be-488a-95ee-6951b53e35de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=07af9912-df9b-4476-92b3-48858617dd29,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:35:15.228673 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:INSERT=13,nova_api:SELECT=87 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:15.307800 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-bc0ef84e-f931-4dfa-9dd4-c5fd9c0c175b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Getting quotas for project fa1db260a96a4c6aa69cd6437baab6f7. Resources: {'server_group_members'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:35:15.315562 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-bc0ef84e-f931-4dfa-9dd4-c5fd9c0c175b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Getting quotas for user 7a7e082035084338966a1c56b30c7093 and project fa1db260a96a4c6aa69cd6437baab6f7. Resources: {'server_group_members'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:35:15.395992 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-bc0ef84e-f931-4dfa-9dd4-c5fd9c0c175b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Getting quotas for project fa1db260a96a4c6aa69cd6437baab6f7. Resources: {'server_group_members'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:35:15.405418 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-bc0ef84e-f931-4dfa-9dd4-c5fd9c0c175b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Getting quotas for user 7a7e082035084338966a1c56b30c7093 and project fa1db260a96a4c6aa69cd6437baab6f7. Resources: {'server_group_members'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:35:15.496305 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-bc0ef84e-f931-4dfa-9dd4-c5fd9c0c175b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.926984 Oct 17 13:35:15.497072 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 254/515] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:35:13 2022] POST /compute/v2.1/servers => generated 32 bytes in 1929 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 17 13:35:15.503536 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f750c218-fe93-45b3-9903-5b7c6d81a66d tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:15.504768 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f750c218-fe93-45b3-9903-5b7c6d81a66d tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] [instance: c47e40d5-8a51-45cc-93e5-1142c8988e5c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:15.512253 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f750c218-fe93-45b3-9903-5b7c6d81a66d tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:15.513100 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f750c218-fe93-45b3-9903-5b7c6d81a66d tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:15.513539 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f750c218-fe93-45b3-9903-5b7c6d81a66d tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:15.514460 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f750c218-fe93-45b3-9903-5b7c6d81a66d tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:15.522124 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f750c218-fe93-45b3-9903-5b7c6d81a66d tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:15.522766 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f750c218-fe93-45b3-9903-5b7c6d81a66d tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:16.042812 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f750c218-fe93-45b3-9903-5b7c6d81a66d tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf50aa8e899648418eace99975616e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6aa32dd3904f6aaae1e63fcc67b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:16.046728 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:16.061672 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f750c218-fe93-45b3-9903-5b7c6d81a66d tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] 10.222.0.79 "GET /compute/v2.1/servers/c47e40d5-8a51-45cc-93e5-1142c8988e5c" status: 200 len: 1319 microversion: 2.1 time: 0.558090 Oct 17 13:35:16.062671 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 255/516] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:15 2022] GET /compute/v2.1/servers/c47e40d5-8a51-45cc-93e5-1142c8988e5c => generated 1319 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:16.073005 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c2671fa6-6789-47ca-9c0f-d58131b33ffa tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:16.079716 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c2671fa6-6789-47ca-9c0f-d58131b33ffa tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] [instance: 51be2144-e969-4e1b-b5da-c43b9a7b7c90] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:16.097371 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c2671fa6-6789-47ca-9c0f-d58131b33ffa tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:16.108007 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c2671fa6-6789-47ca-9c0f-d58131b33ffa tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:16.108471 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c2671fa6-6789-47ca-9c0f-d58131b33ffa tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:16.111060 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c2671fa6-6789-47ca-9c0f-d58131b33ffa tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:16.111391 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c2671fa6-6789-47ca-9c0f-d58131b33ffa tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:16.111835 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c2671fa6-6789-47ca-9c0f-d58131b33ffa tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:16.523971 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c2671fa6-6789-47ca-9c0f-d58131b33ffa tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:16.534247 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c2671fa6-6789-47ca-9c0f-d58131b33ffa tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:16.535546 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c2671fa6-6789-47ca-9c0f-d58131b33ffa tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:16.543091 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c2671fa6-6789-47ca-9c0f-d58131b33ffa tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] 10.222.0.79 "PUT /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90" status: 200 len: 1417 microversion: 2.75 time: 0.478922 Oct 17 13:35:16.555964 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 256/517] 10.222.0.79 () {62 vars in 1297 bytes} [Mon Oct 17 13:35:16 2022] PUT /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90 => generated 1417 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:35:16.574324 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a0f59d43-58a0-49bd-a91c-182fb5aebdb7 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:16.575429 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a0f59d43-58a0-49bd-a91c-182fb5aebdb7 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] [instance: 3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:16.584482 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a0f59d43-58a0-49bd-a91c-182fb5aebdb7 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:16.585332 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a0f59d43-58a0-49bd-a91c-182fb5aebdb7 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:16.586299 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a0f59d43-58a0-49bd-a91c-182fb5aebdb7 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:16.587384 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a0f59d43-58a0-49bd-a91c-182fb5aebdb7 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:16.587993 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a0f59d43-58a0-49bd-a91c-182fb5aebdb7 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:16.588486 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a0f59d43-58a0-49bd-a91c-182fb5aebdb7 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:16.902469 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a0f59d43-58a0-49bd-a91c-182fb5aebdb7 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3dfc7f18ec4a6883b62872ab011cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc31d4fa0cd9418584f52e7c46ade866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:16.911613 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a0f59d43-58a0-49bd-a91c-182fb5aebdb7 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] 10.222.0.79 "GET /compute/v2.1/servers/3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5" status: 200 len: 1331 microversion: 2.1 time: 0.344348 Oct 17 13:35:16.912316 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 257/518] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:16 2022] GET /compute/v2.1/servers/3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5 => generated 1331 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:16.917332 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c1cc8cf4-592d-467a-a811-25a4a0f436d9 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:16.918156 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c1cc8cf4-592d-467a-a811-25a4a0f436d9 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] [instance: dd9a885e-0fb3-411a-b816-eafc93e1c5cb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:16.930472 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1cc8cf4-592d-467a-a811-25a4a0f436d9 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:16.931002 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1cc8cf4-592d-467a-a811-25a4a0f436d9 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:16.931523 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1cc8cf4-592d-467a-a811-25a4a0f436d9 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:16.932977 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1cc8cf4-592d-467a-a811-25a4a0f436d9 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:16.933156 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1cc8cf4-592d-467a-a811-25a4a0f436d9 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:16.933540 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1cc8cf4-592d-467a-a811-25a4a0f436d9 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:17.287750 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c1cc8cf4-592d-467a-a811-25a4a0f436d9 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e836340278b49f593350249132b9cfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550b2bda88024756abc4134365842d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:17.296138 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c1cc8cf4-592d-467a-a811-25a4a0f436d9 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] 10.222.0.79 "GET /compute/v2.1/servers/dd9a885e-0fb3-411a-b816-eafc93e1c5cb" status: 200 len: 1389 microversion: 2.1 time: 0.382735 Oct 17 13:35:17.296733 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 258/519] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:16 2022] GET /compute/v2.1/servers/dd9a885e-0fb3-411a-b816-eafc93e1c5cb => generated 1389 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:17.301471 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4f1a361e-e234-4dca-b51b-b6407dda1a43 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1052282424", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:17.352991 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-4f1a361e-e234-4dca-b51b-b6407dda1a43 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] validate_networks() for None {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:35:18.268859 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-4f1a361e-e234-4dca-b51b-b6407dda1a43 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:35:18.269611 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-4f1a361e-e234-4dca-b51b-b6407dda1a43 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:35:18.270440 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-4f1a361e-e234-4dca-b51b-b6407dda1a43 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:35:18.272013 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-4f1a361e-e234-4dca-b51b-b6407dda1a43 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:35:18.273313 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-4f1a361e-e234-4dca-b51b-b6407dda1a43 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:35:18.311640 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4f1a361e-e234-4dca-b51b-b6407dda1a43 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:18.312734 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4f1a361e-e234-4dca-b51b-b6407dda1a43 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:18.314439 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4f1a361e-e234-4dca-b51b-b6407dda1a43 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:18.315891 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4f1a361e-e234-4dca-b51b-b6407dda1a43 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:18.316649 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4f1a361e-e234-4dca-b51b-b6407dda1a43 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:18.317373 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4f1a361e-e234-4dca-b51b-b6407dda1a43 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:18.340848 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-4f1a361e-e234-4dca-b51b-b6407dda1a43 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Getting quotas for project aa06a29e779e413484cdfcb27e902525. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:35:18.348314 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-4f1a361e-e234-4dca-b51b-b6407dda1a43 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Getting quotas for user 4a685773acdb415591f62ccee7157b6a and project aa06a29e779e413484cdfcb27e902525. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:35:18.363609 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4f1a361e-e234-4dca-b51b-b6407dda1a43 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:35:18.366030 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4f1a361e-e234-4dca-b51b-b6407dda1a43 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] [instance: 88769e75-3f26-45cf-9857-3fa7fc4b478e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:35:18.428321 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4f1a361e-e234-4dca-b51b-b6407dda1a43 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.130314 Oct 17 13:35:18.429745 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 259/520] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:35:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1132 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:35:18.435961 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-00fe4aec-e872-4c71-8cbd-c4fb7a7d74f1 req-7f3ad232-92cd-4020-8696-6122e141a10d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12e5e9fe-b998-450c-94b0-492a92bb6027", "name": "network-vif-deleted", "tag": "413fff83-bb2f-4562-8868-2061337233c1"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:18.452767 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-00fe4aec-e872-4c71-8cbd-c4fb7a7d74f1 req-7f3ad232-92cd-4020-8696-6122e141a10d service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:18.453725 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-00fe4aec-e872-4c71-8cbd-c4fb7a7d74f1 req-7f3ad232-92cd-4020-8696-6122e141a10d service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:18.454875 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-00fe4aec-e872-4c71-8cbd-c4fb7a7d74f1 req-7f3ad232-92cd-4020-8696-6122e141a10d service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:18.484500 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-00fe4aec-e872-4c71-8cbd-c4fb7a7d74f1 req-7f3ad232-92cd-4020-8696-6122e141a10d service nova] Creating event network-vif-deleted:413fff83-bb2f-4562-8868-2061337233c1 for instance 12e5e9fe-b998-450c-94b0-492a92bb6027 on n-h1-854247-14 Oct 17 13:35:18.506101 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-00fe4aec-e872-4c71-8cbd-c4fb7a7d74f1 req-7f3ad232-92cd-4020-8696-6122e141a10d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071379 Oct 17 13:35:18.507480 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 260/521] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:35:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:18.519408 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-69567402-225c-47a0-9d76-3403c71f9c8b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:18.520721 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-69567402-225c-47a0-9d76-3403c71f9c8b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: 85444f54-9792-4b13-90dc-d698bc57b60b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:18.528430 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-69567402-225c-47a0-9d76-3403c71f9c8b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:18.529935 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-69567402-225c-47a0-9d76-3403c71f9c8b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:18.530719 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-69567402-225c-47a0-9d76-3403c71f9c8b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:18.532358 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-69567402-225c-47a0-9d76-3403c71f9c8b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:18.533030 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-69567402-225c-47a0-9d76-3403c71f9c8b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:18.533802 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-69567402-225c-47a0-9d76-3403c71f9c8b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:19.267341 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-69567402-225c-47a0-9d76-3403c71f9c8b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:19.297755 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-69567402-225c-47a0-9d76-3403c71f9c8b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/85444f54-9792-4b13-90dc-d698bc57b60b" status: 200 len: 1493 microversion: 2.1 time: 0.786739 Oct 17 13:35:19.302583 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 261/522] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:18 2022] GET /compute/v2.1/servers/85444f54-9792-4b13-90dc-d698bc57b60b => generated 1493 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:19.309092 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-16ad9d08-5437-4cfb-b55b-42c787cac140 req-79703c73-425e-4de6-a753-017a13ee3c51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c47e40d5-8a51-45cc-93e5-1142c8988e5c", "name": "network-vif-plugged", "status": "completed", "tag": "3b0ed902-0a43-4b1a-9a6b-16ba3b6d6f28"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:19.341484 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-16ad9d08-5437-4cfb-b55b-42c787cac140 req-79703c73-425e-4de6-a753-017a13ee3c51 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:19.342637 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-16ad9d08-5437-4cfb-b55b-42c787cac140 req-79703c73-425e-4de6-a753-017a13ee3c51 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:19.343233 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-16ad9d08-5437-4cfb-b55b-42c787cac140 req-79703c73-425e-4de6-a753-017a13ee3c51 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:19.359633 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-16ad9d08-5437-4cfb-b55b-42c787cac140 req-79703c73-425e-4de6-a753-017a13ee3c51 service nova] Creating event network-vif-plugged:3b0ed902-0a43-4b1a-9a6b-16ba3b6d6f28 for instance c47e40d5-8a51-45cc-93e5-1142c8988e5c on n-h2-854247-14 Oct 17 13:35:19.365488 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-16ad9d08-5437-4cfb-b55b-42c787cac140 req-79703c73-425e-4de6-a753-017a13ee3c51 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061580 Oct 17 13:35:19.366076 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 262/523] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:35:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:19.371373 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fc32bcdb-1c50-4b71-9c23-f5cff0711071 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:19.377236 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fc32bcdb-1c50-4b71-9c23-f5cff0711071 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:19.378308 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-fc32bcdb-1c50-4b71-9c23-f5cff0711071 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Searching by: {'deleted': False, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7'} {{(pid=127016) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:35:19.385951 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fc32bcdb-1c50-4b71-9c23-f5cff0711071 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:19.386700 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fc32bcdb-1c50-4b71-9c23-f5cff0711071 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:19.387291 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fc32bcdb-1c50-4b71-9c23-f5cff0711071 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:19.388208 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fc32bcdb-1c50-4b71-9c23-f5cff0711071 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:19.389040 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fc32bcdb-1c50-4b71-9c23-f5cff0711071 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:19.389648 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fc32bcdb-1c50-4b71-9c23-f5cff0711071 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:19.561356 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.multi_cell_list [None req-fc32bcdb-1c50-4b71-9c23-f5cff0711071 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127016) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:35:19.699758 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fc32bcdb-1c50-4b71-9c23-f5cff0711071 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers" status: 200 len: 1004 microversion: 2.1 time: 0.332219 Oct 17 13:35:19.700528 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 263/524] 10.222.0.79 () {58 vars in 1125 bytes} [Mon Oct 17 13:35:19 2022] GET /compute/v2.1/servers => generated 1004 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:19.705510 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-e3c4bd91-d8df-416b-8718-fb90088d933d req-60d2d53e-695a-4c99-a7f5-db2412686d26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5", "tag": "bb330b1e-ec56-4fc5-b017-d997716bf0ba"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:19.721118 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-e3c4bd91-d8df-416b-8718-fb90088d933d req-60d2d53e-695a-4c99-a7f5-db2412686d26 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:19.726395 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-e3c4bd91-d8df-416b-8718-fb90088d933d req-60d2d53e-695a-4c99-a7f5-db2412686d26 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:19.726902 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-e3c4bd91-d8df-416b-8718-fb90088d933d req-60d2d53e-695a-4c99-a7f5-db2412686d26 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:19.753419 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-e3c4bd91-d8df-416b-8718-fb90088d933d req-60d2d53e-695a-4c99-a7f5-db2412686d26 service nova] Creating event network-changed:bb330b1e-ec56-4fc5-b017-d997716bf0ba for instance 3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5 on n-h2-854247-14 Oct 17 13:35:19.761575 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-e3c4bd91-d8df-416b-8718-fb90088d933d req-60d2d53e-695a-4c99-a7f5-db2412686d26 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059099 Oct 17 13:35:19.763301 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 264/525] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:35:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:19.773601 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-467e16ab-3456-4830-ae87-331b5d0686ba tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:19.776165 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-467e16ab-3456-4830-ae87-331b5d0686ba tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] [instance: 51be2144-e969-4e1b-b5da-c43b9a7b7c90] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:19.789437 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-467e16ab-3456-4830-ae87-331b5d0686ba tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:19.790482 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-467e16ab-3456-4830-ae87-331b5d0686ba tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:19.791339 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-467e16ab-3456-4830-ae87-331b5d0686ba tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:19.792743 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-467e16ab-3456-4830-ae87-331b5d0686ba tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:19.793624 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-467e16ab-3456-4830-ae87-331b5d0686ba tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:19.794454 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-467e16ab-3456-4830-ae87-331b5d0686ba tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:19.958567 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-467e16ab-3456-4830-ae87-331b5d0686ba tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:19.972278 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-467e16ab-3456-4830-ae87-331b5d0686ba tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:19.977152 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-467e16ab-3456-4830-ae87-331b5d0686ba tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:19.989961 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=3 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:20.003417 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-467e16ab-3456-4830-ae87-331b5d0686ba tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] 10.222.0.79 "GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90" status: 200 len: 1438 microversion: 2.75 time: 0.236884 Oct 17 13:35:20.005866 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 265/526] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:35:19 2022] GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90 => generated 1438 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:35:20.012742 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cc04edfe-3266-4bf3-a6ee-1c908ddc602c tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:20.013582 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=11 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:20.020374 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cc04edfe-3266-4bf3-a6ee-1c908ddc602c tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] [instance: c47e40d5-8a51-45cc-93e5-1142c8988e5c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:20.029565 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cc04edfe-3266-4bf3-a6ee-1c908ddc602c tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:20.030055 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cc04edfe-3266-4bf3-a6ee-1c908ddc602c tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:20.030492 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cc04edfe-3266-4bf3-a6ee-1c908ddc602c tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:20.032971 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cc04edfe-3266-4bf3-a6ee-1c908ddc602c tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:20.032971 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cc04edfe-3266-4bf3-a6ee-1c908ddc602c tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:20.032971 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cc04edfe-3266-4bf3-a6ee-1c908ddc602c tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:20.407621 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cc04edfe-3266-4bf3-a6ee-1c908ddc602c tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf50aa8e899648418eace99975616e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6aa32dd3904f6aaae1e63fcc67b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:20.424020 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cc04edfe-3266-4bf3-a6ee-1c908ddc602c tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] 10.222.0.79 "GET /compute/v2.1/servers/c47e40d5-8a51-45cc-93e5-1142c8988e5c" status: 200 len: 1319 microversion: 2.1 time: 0.407244 Oct 17 13:35:20.425899 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 266/527] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:20 2022] GET /compute/v2.1/servers/c47e40d5-8a51-45cc-93e5-1142c8988e5c => generated 1319 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:20.433531 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-22a1437a-3aba-4791-84ec-495c6d02ad74 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:20.434921 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-22a1437a-3aba-4791-84ec-495c6d02ad74 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] [instance: 3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:20.442920 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-22a1437a-3aba-4791-84ec-495c6d02ad74 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:20.443697 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-22a1437a-3aba-4791-84ec-495c6d02ad74 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:20.444441 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-22a1437a-3aba-4791-84ec-495c6d02ad74 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:20.445688 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-22a1437a-3aba-4791-84ec-495c6d02ad74 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:20.447603 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-22a1437a-3aba-4791-84ec-495c6d02ad74 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:20.448393 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-22a1437a-3aba-4791-84ec-495c6d02ad74 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:20.762384 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-22a1437a-3aba-4791-84ec-495c6d02ad74 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3dfc7f18ec4a6883b62872ab011cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc31d4fa0cd9418584f52e7c46ade866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:20.771159 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-22a1437a-3aba-4791-84ec-495c6d02ad74 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] 10.222.0.79 "GET /compute/v2.1/servers/3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5" status: 200 len: 1331 microversion: 2.1 time: 0.343769 Oct 17 13:35:20.772089 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 267/528] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:20 2022] GET /compute/v2.1/servers/3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5 => generated 1331 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:20.793436 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2d66f261-f7ae-4f9d-b2b2-18e505935a4e tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:20.794049 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2d66f261-f7ae-4f9d-b2b2-18e505935a4e tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] [instance: dd9a885e-0fb3-411a-b816-eafc93e1c5cb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:20.795683 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-598e0c0f-ebb4-4f30-bed2-f1863160ab14 tempest-SecurityGroupsTestAdminJSON-660839262 tempest-SecurityGroupsTestAdminJSON-660839262-project-admin] 10.222.0.79 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 11055 microversion: 2.1 time: 7.521351 Oct 17 13:35:20.796671 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 262/529] 10.222.0.79 () {58 vars in 1191 bytes} [Mon Oct 17 13:35:13 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 11055 bytes in 7523 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:35:20.802337 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-dcc1b96c-b06f-4991-9154-f59a5befcb8c tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:20.803412 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-dcc1b96c-b06f-4991-9154-f59a5befcb8c tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] [instance: 88769e75-3f26-45cf-9857-3fa7fc4b478e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:20.803612 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2d66f261-f7ae-4f9d-b2b2-18e505935a4e tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:20.804110 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2d66f261-f7ae-4f9d-b2b2-18e505935a4e tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:20.804720 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2d66f261-f7ae-4f9d-b2b2-18e505935a4e tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:20.805605 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2d66f261-f7ae-4f9d-b2b2-18e505935a4e tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:20.806080 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2d66f261-f7ae-4f9d-b2b2-18e505935a4e tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:20.806485 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2d66f261-f7ae-4f9d-b2b2-18e505935a4e tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:20.815812 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dcc1b96c-b06f-4991-9154-f59a5befcb8c tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:20.816522 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dcc1b96c-b06f-4991-9154-f59a5befcb8c tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:20.817277 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dcc1b96c-b06f-4991-9154-f59a5befcb8c tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:20.818451 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dcc1b96c-b06f-4991-9154-f59a5befcb8c tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:20.819130 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dcc1b96c-b06f-4991-9154-f59a5befcb8c tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:20.819845 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dcc1b96c-b06f-4991-9154-f59a5befcb8c tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:20.910542 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-dcc1b96c-b06f-4991-9154-f59a5befcb8c tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a685773acdb415591f62ccee7157b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa06a29e779e413484cdfcb27e902525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:20.919381 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-dcc1b96c-b06f-4991-9154-f59a5befcb8c tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] 10.222.0.79 "GET /compute/v2.1/servers/88769e75-3f26-45cf-9857-3fa7fc4b478e" status: 200 len: 1218 microversion: 2.1 time: 0.121153 Oct 17 13:35:20.920009 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 263/530] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:20 2022] GET /compute/v2.1/servers/88769e75-3f26-45cf-9857-3fa7fc4b478e => generated 1218 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:20.925533 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9f24cf03-bed2-482c-b940-c417fdf5d9d7 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Calling method '.version_select at 0x7f7cd5d83dc0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:20.929586 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f24cf03-bed2-482c-b940-c417fdf5d9d7 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:20.930569 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f24cf03-bed2-482c-b940-c417fdf5d9d7 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:20.931193 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f24cf03-bed2-482c-b940-c417fdf5d9d7 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:20.949537 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9f24cf03-bed2-482c-b940-c417fdf5d9d7 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] 10.222.0.79 "GET /compute/v2.1/os-migrations" status: 200 len: 404 microversion: 2.1 time: 0.028048 Oct 17 13:35:20.950073 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 264/531] 10.222.0.79 () {58 vars in 1143 bytes} [Mon Oct 17 13:35:20 2022] GET /compute/v2.1/os-migrations => generated 404 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:20.955447 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-dd71c41c-ff5c-4007-8d4d-ae6d623e1614 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:20.956056 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-dd71c41c-ff5c-4007-8d4d-ae6d623e1614 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 03e8be7f-09be-488a-95ee-6951b53e35de] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:20.961971 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dd71c41c-ff5c-4007-8d4d-ae6d623e1614 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:20.962444 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dd71c41c-ff5c-4007-8d4d-ae6d623e1614 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:20.963064 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dd71c41c-ff5c-4007-8d4d-ae6d623e1614 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:20.963943 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dd71c41c-ff5c-4007-8d4d-ae6d623e1614 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:20.964393 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dd71c41c-ff5c-4007-8d4d-ae6d623e1614 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:20.964813 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dd71c41c-ff5c-4007-8d4d-ae6d623e1614 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:20.981188 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=100 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:20.984665 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2d66f261-f7ae-4f9d-b2b2-18e505935a4e tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e836340278b49f593350249132b9cfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550b2bda88024756abc4134365842d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:20.994198 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2d66f261-f7ae-4f9d-b2b2-18e505935a4e tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] 10.222.0.79 "GET /compute/v2.1/servers/dd9a885e-0fb3-411a-b816-eafc93e1c5cb" status: 200 len: 1389 microversion: 2.1 time: 0.203987 Oct 17 13:35:20.994798 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 268/532] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:20 2022] GET /compute/v2.1/servers/dd9a885e-0fb3-411a-b816-eafc93e1c5cb => generated 1389 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:20.999738 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4fe16fd7-01f2-435f-b855-98ec152f4acc tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:21.003647 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4fe16fd7-01f2-435f-b855-98ec152f4acc tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] [instance: 51be2144-e969-4e1b-b5da-c43b9a7b7c90] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:21.010537 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4fe16fd7-01f2-435f-b855-98ec152f4acc tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:21.011509 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4fe16fd7-01f2-435f-b855-98ec152f4acc tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:21.011735 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4fe16fd7-01f2-435f-b855-98ec152f4acc tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:21.012836 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4fe16fd7-01f2-435f-b855-98ec152f4acc tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:21.013294 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4fe16fd7-01f2-435f-b855-98ec152f4acc tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:21.013714 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4fe16fd7-01f2-435f-b855-98ec152f4acc tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:21.106946 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-4fe16fd7-01f2-435f-b855-98ec152f4acc tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:35:21.107709 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-4fe16fd7-01f2-435f-b855-98ec152f4acc tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:35:21.108510 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-4fe16fd7-01f2-435f-b855-98ec152f4acc tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:35:21.108937 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-4fe16fd7-01f2-435f-b855-98ec152f4acc tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:35:21.109355 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-4fe16fd7-01f2-435f-b855-98ec152f4acc tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:35:21.117294 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-dd71c41c-ff5c-4007-8d4d-ae6d623e1614 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:21.128318 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-dd71c41c-ff5c-4007-8d4d-ae6d623e1614 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/03e8be7f-09be-488a-95ee-6951b53e35de" status: 200 len: 1319 microversion: 2.1 time: 0.177151 Oct 17 13:35:21.129091 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 265/533] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:20 2022] GET /compute/v2.1/servers/03e8be7f-09be-488a-95ee-6951b53e35de => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:21.136181 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-f250b521-542f-4368-9d51-e9c1eb3dba4a req-a717bed7-c003-401d-b7b2-db4fb8291992 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd9a885e-0fb3-411a-b816-eafc93e1c5cb", "tag": "2ff450f2-efdf-4213-8a18-aa178b264642"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:21.149709 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-f250b521-542f-4368-9d51-e9c1eb3dba4a req-a717bed7-c003-401d-b7b2-db4fb8291992 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:21.150509 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-f250b521-542f-4368-9d51-e9c1eb3dba4a req-a717bed7-c003-401d-b7b2-db4fb8291992 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:21.150985 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-f250b521-542f-4368-9d51-e9c1eb3dba4a req-a717bed7-c003-401d-b7b2-db4fb8291992 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:21.163691 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-f250b521-542f-4368-9d51-e9c1eb3dba4a req-a717bed7-c003-401d-b7b2-db4fb8291992 service nova] Creating event network-changed:2ff450f2-efdf-4213-8a18-aa178b264642 for instance dd9a885e-0fb3-411a-b816-eafc93e1c5cb on n-h2-854247-14 Oct 17 13:35:21.169170 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-f250b521-542f-4368-9d51-e9c1eb3dba4a req-a717bed7-c003-401d-b7b2-db4fb8291992 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037646 Oct 17 13:35:21.169780 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 266/534] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:21.175134 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-aea036a6-3510-4a0f-b508-6e15775826e8 tempest-SecurityGroupsTestAdminJSON-366864463 tempest-SecurityGroupsTestAdminJSON-366864463-project] Calling method '.version_select at 0x7f7cd5e709d0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:21.181247 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4fe16fd7-01f2-435f-b855-98ec152f4acc tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] [instance: 51be2144-e969-4e1b-b5da-c43b9a7b7c90] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:21.188577 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4fe16fd7-01f2-435f-b855-98ec152f4acc tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:21.189157 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4fe16fd7-01f2-435f-b855-98ec152f4acc tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:21.189684 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4fe16fd7-01f2-435f-b855-98ec152f4acc tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:21.190630 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4fe16fd7-01f2-435f-b855-98ec152f4acc tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:21.191210 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4fe16fd7-01f2-435f-b855-98ec152f4acc tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:21.191706 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4fe16fd7-01f2-435f-b855-98ec152f4acc tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:21.298100 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4fe16fd7-01f2-435f-b855-98ec152f4acc tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:21.312375 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4fe16fd7-01f2-435f-b855-98ec152f4acc tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:21.314991 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4fe16fd7-01f2-435f-b855-98ec152f4acc tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:21.322182 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4fe16fd7-01f2-435f-b855-98ec152f4acc tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] 10.222.0.79 "POST /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90/action" status: 202 len: 1495 microversion: 2.75 time: 0.326117 Oct 17 13:35:21.323124 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 269/535] 10.222.0.79 () {62 vars in 1319 bytes} [Mon Oct 17 13:35:20 2022] POST /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90/action => generated 1495 bytes in 327 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 17 13:35:21.327793 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-53f5fb1e-3dc5-40fd-b8bd-6850209c79b0 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:21.328449 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-53f5fb1e-3dc5-40fd-b8bd-6850209c79b0 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] [instance: 85444f54-9792-4b13-90dc-d698bc57b60b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:21.334799 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-53f5fb1e-3dc5-40fd-b8bd-6850209c79b0 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:21.335328 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-53f5fb1e-3dc5-40fd-b8bd-6850209c79b0 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:21.335774 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-53f5fb1e-3dc5-40fd-b8bd-6850209c79b0 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:21.336487 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-53f5fb1e-3dc5-40fd-b8bd-6850209c79b0 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:21.337175 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-53f5fb1e-3dc5-40fd-b8bd-6850209c79b0 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:21.337589 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-53f5fb1e-3dc5-40fd-b8bd-6850209c79b0 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:21.472496 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-aea036a6-3510-4a0f-b508-6e15775826e8 tempest-SecurityGroupsTestAdminJSON-366864463 tempest-SecurityGroupsTestAdminJSON-366864463-project] 10.222.0.79 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 0.301406 Oct 17 13:35:21.473138 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 267/536] 10.222.0.79 () {58 vars in 1191 bytes} [Mon Oct 17 13:35:21 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:21.478271 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5d4a3ec0-451b-44f8-917f-0434aafaf7a5 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:21.479484 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5d4a3ec0-451b-44f8-917f-0434aafaf7a5 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] [instance: 51be2144-e969-4e1b-b5da-c43b9a7b7c90] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:21.485982 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5d4a3ec0-451b-44f8-917f-0434aafaf7a5 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:21.486455 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5d4a3ec0-451b-44f8-917f-0434aafaf7a5 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:21.486910 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5d4a3ec0-451b-44f8-917f-0434aafaf7a5 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:21.487646 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5d4a3ec0-451b-44f8-917f-0434aafaf7a5 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:21.488072 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5d4a3ec0-451b-44f8-917f-0434aafaf7a5 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:21.488491 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5d4a3ec0-451b-44f8-917f-0434aafaf7a5 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:21.502838 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-53f5fb1e-3dc5-40fd-b8bd-6850209c79b0 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/85444f54-9792-4b13-90dc-d698bc57b60b" status: 200 len: 1646 microversion: 2.1 time: 0.178796 Oct 17 13:35:21.510830 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 270/537] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:21 2022] GET /compute/v2.1/servers/85444f54-9792-4b13-90dc-d698bc57b60b => generated 1646 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:21.514574 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-78568d6a-9e32-40ad-96fb-47caea55672e tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:21.515261 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-78568d6a-9e32-40ad-96fb-47caea55672e tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] [instance: c47e40d5-8a51-45cc-93e5-1142c8988e5c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:21.533781 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-78568d6a-9e32-40ad-96fb-47caea55672e tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:21.535037 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-78568d6a-9e32-40ad-96fb-47caea55672e tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:21.535587 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-78568d6a-9e32-40ad-96fb-47caea55672e tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:21.537065 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-78568d6a-9e32-40ad-96fb-47caea55672e tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:21.537597 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-78568d6a-9e32-40ad-96fb-47caea55672e tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:21.538080 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-78568d6a-9e32-40ad-96fb-47caea55672e tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:21.910711 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5d4a3ec0-451b-44f8-917f-0434aafaf7a5 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:21.925566 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5d4a3ec0-451b-44f8-917f-0434aafaf7a5 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:21.929089 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5d4a3ec0-451b-44f8-917f-0434aafaf7a5 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:21.948030 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5d4a3ec0-451b-44f8-917f-0434aafaf7a5 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] 10.222.0.79 "GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90" status: 200 len: 1447 microversion: 2.75 time: 0.473843 Oct 17 13:35:21.949181 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 268/538] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:35:21 2022] GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90 => generated 1447 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:35:21.955375 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e57a41a2-bbfc-434f-b253-a802141351f4 tempest-SecurityGroupsTestAdminJSON-660839262 tempest-SecurityGroupsTestAdminJSON-660839262-project-admin] Calling method '.version_select at 0x7f7cd5e384c0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:22.188073 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-78568d6a-9e32-40ad-96fb-47caea55672e tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf50aa8e899648418eace99975616e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6aa32dd3904f6aaae1e63fcc67b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:22.212690 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-78568d6a-9e32-40ad-96fb-47caea55672e tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] 10.222.0.79 "GET /compute/v2.1/servers/c47e40d5-8a51-45cc-93e5-1142c8988e5c" status: 200 len: 1319 microversion: 2.1 time: 0.707377 Oct 17 13:35:22.216221 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 271/539] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:21 2022] GET /compute/v2.1/servers/c47e40d5-8a51-45cc-93e5-1142c8988e5c => generated 1319 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:22.233077 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-973f3830-e87d-4738-91e1-1641335eac0f tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-334433649", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "0f6c7a6d-566d-4e1c-9b41-17525dda1910"}]}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:22.312207 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-973f3830-e87d-4738-91e1-1641335eac0f tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] validate_networks() for [('0f6c7a6d-566d-4e1c-9b41-17525dda1910', None, None, None, None, None)] {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:35:22.716891 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e57a41a2-bbfc-434f-b253-a802141351f4 tempest-SecurityGroupsTestAdminJSON-660839262 tempest-SecurityGroupsTestAdminJSON-660839262-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/e57d4caa-b36d-43ef-a2bc-a96d36ad1023" status: 202 len: 0 microversion: 2.1 time: 0.766287 Oct 17 13:35:22.717470 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 269/540] 10.222.0.79 () {58 vars in 1272 bytes} [Mon Oct 17 13:35:21 2022] DELETE /compute/v2.1/os-security-groups/e57d4caa-b36d-43ef-a2bc-a96d36ad1023 => generated 0 bytes in 768 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:35:22.727758 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-bd88ebe0-afff-49e0-8fb0-724dce15cad5 req-b6b53b09-2e0f-4fce-b5da-44d02afc9bc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03e8be7f-09be-488a-95ee-6951b53e35de", "tag": "c0d55331-8725-4b8f-8583-c7d47cad2300"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:22.738293 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-bd88ebe0-afff-49e0-8fb0-724dce15cad5 req-b6b53b09-2e0f-4fce-b5da-44d02afc9bc6 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:22.738753 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-bd88ebe0-afff-49e0-8fb0-724dce15cad5 req-b6b53b09-2e0f-4fce-b5da-44d02afc9bc6 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:22.739208 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-bd88ebe0-afff-49e0-8fb0-724dce15cad5 req-b6b53b09-2e0f-4fce-b5da-44d02afc9bc6 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:22.750933 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-bd88ebe0-afff-49e0-8fb0-724dce15cad5 req-b6b53b09-2e0f-4fce-b5da-44d02afc9bc6 service nova] Creating event network-changed:c0d55331-8725-4b8f-8583-c7d47cad2300 for instance 03e8be7f-09be-488a-95ee-6951b53e35de on n-h1-854247-14 Oct 17 13:35:22.756916 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-bd88ebe0-afff-49e0-8fb0-724dce15cad5 req-b6b53b09-2e0f-4fce-b5da-44d02afc9bc6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037827 Oct 17 13:35:22.757577 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 270/541] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:35:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:22.762957 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-62ddb5ee-2389-45ba-aff6-5c6fd7da1bbc tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:22.764560 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-62ddb5ee-2389-45ba-aff6-5c6fd7da1bbc tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] [instance: 3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:22.772633 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-62ddb5ee-2389-45ba-aff6-5c6fd7da1bbc tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:22.773489 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-62ddb5ee-2389-45ba-aff6-5c6fd7da1bbc tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:22.773973 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-62ddb5ee-2389-45ba-aff6-5c6fd7da1bbc tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:22.774872 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-62ddb5ee-2389-45ba-aff6-5c6fd7da1bbc tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:22.775349 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-62ddb5ee-2389-45ba-aff6-5c6fd7da1bbc tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:22.776874 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-62ddb5ee-2389-45ba-aff6-5c6fd7da1bbc tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:23.391426 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-62ddb5ee-2389-45ba-aff6-5c6fd7da1bbc tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3dfc7f18ec4a6883b62872ab011cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc31d4fa0cd9418584f52e7c46ade866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:23.402865 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-62ddb5ee-2389-45ba-aff6-5c6fd7da1bbc tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] 10.222.0.79 "GET /compute/v2.1/servers/3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5" status: 200 len: 1331 microversion: 2.1 time: 0.644004 Oct 17 13:35:23.420010 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 271/542] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:22 2022] GET /compute/v2.1/servers/3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5 => generated 1331 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:23.425227 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-44df94bb-27e1-4414-88ad-804ebc726ea1 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:23.426154 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-44df94bb-27e1-4414-88ad-804ebc726ea1 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] [instance: 88769e75-3f26-45cf-9857-3fa7fc4b478e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:23.434923 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-44df94bb-27e1-4414-88ad-804ebc726ea1 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:23.435996 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-44df94bb-27e1-4414-88ad-804ebc726ea1 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:23.435996 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-44df94bb-27e1-4414-88ad-804ebc726ea1 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:23.437437 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-44df94bb-27e1-4414-88ad-804ebc726ea1 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:23.437985 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-44df94bb-27e1-4414-88ad-804ebc726ea1 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:23.438464 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-44df94bb-27e1-4414-88ad-804ebc726ea1 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:23.618260 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-44df94bb-27e1-4414-88ad-804ebc726ea1 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a685773acdb415591f62ccee7157b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa06a29e779e413484cdfcb27e902525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:23.625906 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-973f3830-e87d-4738-91e1-1641335eac0f tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:35:23.626920 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-973f3830-e87d-4738-91e1-1641335eac0f tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:35:23.627624 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-973f3830-e87d-4738-91e1-1641335eac0f tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:35:23.628231 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-973f3830-e87d-4738-91e1-1641335eac0f tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:35:23.628840 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-973f3830-e87d-4738-91e1-1641335eac0f tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:35:23.628972 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-44df94bb-27e1-4414-88ad-804ebc726ea1 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] 10.222.0.79 "GET /compute/v2.1/servers/88769e75-3f26-45cf-9857-3fa7fc4b478e" status: 200 len: 1280 microversion: 2.1 time: 0.209203 Oct 17 13:35:23.635682 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 272/543] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:23 2022] GET /compute/v2.1/servers/88769e75-3f26-45cf-9857-3fa7fc4b478e => generated 1280 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:23.641227 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5216d4b1-39b5-472c-b227-b3036cb20039 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:23.644636 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5216d4b1-39b5-472c-b227-b3036cb20039 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] [instance: dd9a885e-0fb3-411a-b816-eafc93e1c5cb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:23.648747 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-973f3830-e87d-4738-91e1-1641335eac0f tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:23.649828 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-973f3830-e87d-4738-91e1-1641335eac0f tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:23.650257 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-973f3830-e87d-4738-91e1-1641335eac0f tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:23.651402 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-973f3830-e87d-4738-91e1-1641335eac0f tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:23.651633 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5216d4b1-39b5-472c-b227-b3036cb20039 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:23.652117 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5216d4b1-39b5-472c-b227-b3036cb20039 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:23.652548 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5216d4b1-39b5-472c-b227-b3036cb20039 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:23.652769 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-973f3830-e87d-4738-91e1-1641335eac0f tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:23.653293 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5216d4b1-39b5-472c-b227-b3036cb20039 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:23.653739 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5216d4b1-39b5-472c-b227-b3036cb20039 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:23.653869 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-973f3830-e87d-4738-91e1-1641335eac0f tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:23.654472 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5216d4b1-39b5-472c-b227-b3036cb20039 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:23.673809 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-973f3830-e87d-4738-91e1-1641335eac0f tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Getting quotas for project ccf0569de787477e964f570378d6459a. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:35:23.681816 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-973f3830-e87d-4738-91e1-1641335eac0f tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Getting quotas for user 62cc720667f44772988d7890c227b217 and project ccf0569de787477e964f570378d6459a. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:35:23.695483 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-973f3830-e87d-4738-91e1-1641335eac0f tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:35:23.698359 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-973f3830-e87d-4738-91e1-1641335eac0f tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: f869f059-89c3-4462-a309-e27f650d7584] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:35:23.727677 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:23.748474 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-973f3830-e87d-4738-91e1-1641335eac0f tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.530823 Oct 17 13:35:23.749892 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 272/544] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:35:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:35:23.755965 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c6556471-7903-4f4a-9717-f48c8af56dbe tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:23.756978 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c6556471-7903-4f4a-9717-f48c8af56dbe tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 03e8be7f-09be-488a-95ee-6951b53e35de] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:23.763695 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c6556471-7903-4f4a-9717-f48c8af56dbe tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:23.764529 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c6556471-7903-4f4a-9717-f48c8af56dbe tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:23.765166 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c6556471-7903-4f4a-9717-f48c8af56dbe tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:23.766068 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c6556471-7903-4f4a-9717-f48c8af56dbe tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:23.766715 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c6556471-7903-4f4a-9717-f48c8af56dbe tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:23.767344 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c6556471-7903-4f4a-9717-f48c8af56dbe tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:23.778472 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:24.285846 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5216d4b1-39b5-472c-b227-b3036cb20039 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e836340278b49f593350249132b9cfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550b2bda88024756abc4134365842d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:24.309630 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5216d4b1-39b5-472c-b227-b3036cb20039 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] 10.222.0.79 "GET /compute/v2.1/servers/dd9a885e-0fb3-411a-b816-eafc93e1c5cb" status: 200 len: 1389 microversion: 2.1 time: 0.672468 Oct 17 13:35:24.310346 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 273/545] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:23 2022] GET /compute/v2.1/servers/dd9a885e-0fb3-411a-b816-eafc93e1c5cb => generated 1389 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:24.315434 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e53a2851-ae7d-4484-8c62-f836e6af086c tempest-SecurityGroupsTestAdminJSON-660839262 tempest-SecurityGroupsTestAdminJSON-660839262-project-admin] Calling method '.version_select at 0x7f7cd5d4d310>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:24.394662 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c6556471-7903-4f4a-9717-f48c8af56dbe tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:24.404229 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c6556471-7903-4f4a-9717-f48c8af56dbe tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/03e8be7f-09be-488a-95ee-6951b53e35de" status: 200 len: 1319 microversion: 2.1 time: 0.653057 Oct 17 13:35:24.404804 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 273/546] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:23 2022] GET /compute/v2.1/servers/03e8be7f-09be-488a-95ee-6951b53e35de => generated 1319 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:24.409515 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c9740e87-2c08-41d6-95e9-7d4c5972b46a tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:24.410109 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c9740e87-2c08-41d6-95e9-7d4c5972b46a tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] [instance: 51be2144-e969-4e1b-b5da-c43b9a7b7c90] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:24.416706 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c9740e87-2c08-41d6-95e9-7d4c5972b46a tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:24.417485 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c9740e87-2c08-41d6-95e9-7d4c5972b46a tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:24.417914 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c9740e87-2c08-41d6-95e9-7d4c5972b46a tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:24.418772 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c9740e87-2c08-41d6-95e9-7d4c5972b46a tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:24.419392 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c9740e87-2c08-41d6-95e9-7d4c5972b46a tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:24.419812 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c9740e87-2c08-41d6-95e9-7d4c5972b46a tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:24.551922 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c9740e87-2c08-41d6-95e9-7d4c5972b46a tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:24.562364 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c9740e87-2c08-41d6-95e9-7d4c5972b46a tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:24.564003 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c9740e87-2c08-41d6-95e9-7d4c5972b46a tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:24.569828 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c9740e87-2c08-41d6-95e9-7d4c5972b46a tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] 10.222.0.79 "GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90" status: 200 len: 1447 microversion: 2.75 time: 0.164000 Oct 17 13:35:24.585429 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 274/547] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:35:24 2022] GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90 => generated 1447 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:35:24.585429 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-62c475d9-93ef-4995-90e5-2a2c9e9727fa tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:24.585429 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-62c475d9-93ef-4995-90e5-2a2c9e9727fa tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] [instance: c47e40d5-8a51-45cc-93e5-1142c8988e5c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:24.585429 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-62c475d9-93ef-4995-90e5-2a2c9e9727fa tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:24.585838 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-62c475d9-93ef-4995-90e5-2a2c9e9727fa tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:24.585838 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-62c475d9-93ef-4995-90e5-2a2c9e9727fa tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:24.585838 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-62c475d9-93ef-4995-90e5-2a2c9e9727fa tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:24.585838 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-62c475d9-93ef-4995-90e5-2a2c9e9727fa tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:24.586101 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-62c475d9-93ef-4995-90e5-2a2c9e9727fa tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:24.918049 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-62c475d9-93ef-4995-90e5-2a2c9e9727fa tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf50aa8e899648418eace99975616e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6aa32dd3904f6aaae1e63fcc67b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:24.926837 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-62c475d9-93ef-4995-90e5-2a2c9e9727fa tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] 10.222.0.79 "GET /compute/v2.1/servers/c47e40d5-8a51-45cc-93e5-1142c8988e5c" status: 200 len: 1469 microversion: 2.1 time: 0.354727 Oct 17 13:35:24.927538 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 275/548] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:24 2022] GET /compute/v2.1/servers/c47e40d5-8a51-45cc-93e5-1142c8988e5c => generated 1469 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:24.932536 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-9d72d090-f6e2-4ed4-b9e5-d79b47059c76 req-29237827-078e-40b7-9d55-adb5dbfded68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5", "name": "network-vif-plugged", "status": "completed", "tag": "bb330b1e-ec56-4fc5-b017-d997716bf0ba"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:24.942690 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-9d72d090-f6e2-4ed4-b9e5-d79b47059c76 req-29237827-078e-40b7-9d55-adb5dbfded68 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:24.943189 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-9d72d090-f6e2-4ed4-b9e5-d79b47059c76 req-29237827-078e-40b7-9d55-adb5dbfded68 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:24.943853 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-9d72d090-f6e2-4ed4-b9e5-d79b47059c76 req-29237827-078e-40b7-9d55-adb5dbfded68 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:24.957259 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-9d72d090-f6e2-4ed4-b9e5-d79b47059c76 req-29237827-078e-40b7-9d55-adb5dbfded68 service nova] Creating event network-vif-plugged:bb330b1e-ec56-4fc5-b017-d997716bf0ba for instance 3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5 on n-h2-854247-14 Oct 17 13:35:24.963392 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-9d72d090-f6e2-4ed4-b9e5-d79b47059c76 req-29237827-078e-40b7-9d55-adb5dbfded68 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034151 Oct 17 13:35:24.964039 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 276/549] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:35:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:24.969811 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1b7f55a5-5d66-4aaf-aed7-101af31b7c1f tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:24.970535 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-1b7f55a5-5d66-4aaf-aed7-101af31b7c1f tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: f869f059-89c3-4462-a309-e27f650d7584] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:24.977679 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e53a2851-ae7d-4484-8c62-f836e6af086c tempest-SecurityGroupsTestAdminJSON-660839262 tempest-SecurityGroupsTestAdminJSON-660839262-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/ed3be129-c263-4e8c-a32a-850a5ec91b0e" status: 202 len: 0 microversion: 2.1 time: 0.665918 Oct 17 13:35:24.978265 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1b7f55a5-5d66-4aaf-aed7-101af31b7c1f tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:24.978749 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1b7f55a5-5d66-4aaf-aed7-101af31b7c1f tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:24.979268 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1b7f55a5-5d66-4aaf-aed7-101af31b7c1f tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:24.979975 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1b7f55a5-5d66-4aaf-aed7-101af31b7c1f tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:24.980429 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1b7f55a5-5d66-4aaf-aed7-101af31b7c1f tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:24.982026 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 274/550] 10.222.0.79 () {58 vars in 1272 bytes} [Mon Oct 17 13:35:24 2022] DELETE /compute/v2.1/os-security-groups/ed3be129-c263-4e8c-a32a-850a5ec91b0e => generated 0 bytes in 671 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:35:24.988394 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1b7f55a5-5d66-4aaf-aed7-101af31b7c1f tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:24.992674 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-1fd5aaf8-c54d-4c1c-8d1a-392e33594e04 req-37cdb57c-e1b1-4e3b-b18e-e6c163a359cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07af9912-df9b-4476-92b3-48858617dd29", "tag": "388a5339-117b-43e8-8264-a1aceb3ad3f6"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:25.020515 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-1fd5aaf8-c54d-4c1c-8d1a-392e33594e04 req-37cdb57c-e1b1-4e3b-b18e-e6c163a359cc service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:25.020995 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-1fd5aaf8-c54d-4c1c-8d1a-392e33594e04 req-37cdb57c-e1b1-4e3b-b18e-e6c163a359cc service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:25.021427 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-1fd5aaf8-c54d-4c1c-8d1a-392e33594e04 req-37cdb57c-e1b1-4e3b-b18e-e6c163a359cc service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:25.043901 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-1fd5aaf8-c54d-4c1c-8d1a-392e33594e04 req-37cdb57c-e1b1-4e3b-b18e-e6c163a359cc service nova] Creating event network-changed:388a5339-117b-43e8-8264-a1aceb3ad3f6 for instance 07af9912-df9b-4476-92b3-48858617dd29 on n-h1-854247-14 Oct 17 13:35:25.056909 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-1fd5aaf8-c54d-4c1c-8d1a-392e33594e04 req-37cdb57c-e1b1-4e3b-b18e-e6c163a359cc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073525 Oct 17 13:35:25.058993 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 275/551] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:35:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:25.065983 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1aa53db5-18c2-4eb4-90b7-2ffb6b882dfc tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:25.066694 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1aa53db5-18c2-4eb4-90b7-2ffb6b882dfc tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] [instance: 3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:25.077188 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1aa53db5-18c2-4eb4-90b7-2ffb6b882dfc tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:25.077683 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1aa53db5-18c2-4eb4-90b7-2ffb6b882dfc tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:25.078281 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1aa53db5-18c2-4eb4-90b7-2ffb6b882dfc tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:25.078991 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1aa53db5-18c2-4eb4-90b7-2ffb6b882dfc tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:25.079465 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1aa53db5-18c2-4eb4-90b7-2ffb6b882dfc tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:25.079883 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1aa53db5-18c2-4eb4-90b7-2ffb6b882dfc tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:25.225617 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-1b7f55a5-5d66-4aaf-aed7-101af31b7c1f tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:25.235799 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1b7f55a5-5d66-4aaf-aed7-101af31b7c1f tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/f869f059-89c3-4462-a309-e27f650d7584" status: 200 len: 1262 microversion: 2.1 time: 0.270348 Oct 17 13:35:25.239970 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 277/552] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:24 2022] GET /compute/v2.1/servers/f869f059-89c3-4462-a309-e27f650d7584 => generated 1262 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:25.268723 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a7d0fc47-aa9a-4ec4-8f70-5bc1d5f5eb16 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:25.272512 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a7d0fc47-aa9a-4ec4-8f70-5bc1d5f5eb16 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] [instance: 88769e75-3f26-45cf-9857-3fa7fc4b478e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:25.303879 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a7d0fc47-aa9a-4ec4-8f70-5bc1d5f5eb16 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:25.304372 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a7d0fc47-aa9a-4ec4-8f70-5bc1d5f5eb16 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:25.304811 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a7d0fc47-aa9a-4ec4-8f70-5bc1d5f5eb16 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:25.305558 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a7d0fc47-aa9a-4ec4-8f70-5bc1d5f5eb16 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:25.306012 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a7d0fc47-aa9a-4ec4-8f70-5bc1d5f5eb16 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:25.306432 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a7d0fc47-aa9a-4ec4-8f70-5bc1d5f5eb16 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:25.646035 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1aa53db5-18c2-4eb4-90b7-2ffb6b882dfc tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3dfc7f18ec4a6883b62872ab011cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc31d4fa0cd9418584f52e7c46ade866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:25.661765 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1aa53db5-18c2-4eb4-90b7-2ffb6b882dfc tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] 10.222.0.79 "GET /compute/v2.1/servers/3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5" status: 200 len: 1331 microversion: 2.1 time: 0.600880 Oct 17 13:35:25.666523 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 276/553] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:25 2022] GET /compute/v2.1/servers/3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5 => generated 1331 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:25.672627 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4b24116d-817f-48aa-b71c-6e5ba9d9b18c tempest-DeleteServersAdminTestJSON-704160048 tempest-DeleteServersAdminTestJSON-704160048-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:25.676186 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4b24116d-817f-48aa-b71c-6e5ba9d9b18c tempest-DeleteServersAdminTestJSON-704160048 tempest-DeleteServersAdminTestJSON-704160048-project-admin] [instance: c47e40d5-8a51-45cc-93e5-1142c8988e5c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:25.683661 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4b24116d-817f-48aa-b71c-6e5ba9d9b18c tempest-DeleteServersAdminTestJSON-704160048 tempest-DeleteServersAdminTestJSON-704160048-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:25.684900 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4b24116d-817f-48aa-b71c-6e5ba9d9b18c tempest-DeleteServersAdminTestJSON-704160048 tempest-DeleteServersAdminTestJSON-704160048-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:25.685418 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4b24116d-817f-48aa-b71c-6e5ba9d9b18c tempest-DeleteServersAdminTestJSON-704160048 tempest-DeleteServersAdminTestJSON-704160048-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:25.686373 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4b24116d-817f-48aa-b71c-6e5ba9d9b18c tempest-DeleteServersAdminTestJSON-704160048 tempest-DeleteServersAdminTestJSON-704160048-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:25.687142 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4b24116d-817f-48aa-b71c-6e5ba9d9b18c tempest-DeleteServersAdminTestJSON-704160048 tempest-DeleteServersAdminTestJSON-704160048-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:25.687736 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4b24116d-817f-48aa-b71c-6e5ba9d9b18c tempest-DeleteServersAdminTestJSON-704160048 tempest-DeleteServersAdminTestJSON-704160048-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:25.746738 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a7d0fc47-aa9a-4ec4-8f70-5bc1d5f5eb16 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a685773acdb415591f62ccee7157b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa06a29e779e413484cdfcb27e902525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:25.756943 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a7d0fc47-aa9a-4ec4-8f70-5bc1d5f5eb16 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] 10.222.0.79 "GET /compute/v2.1/servers/88769e75-3f26-45cf-9857-3fa7fc4b478e" status: 200 len: 1322 microversion: 2.1 time: 0.503566 Oct 17 13:35:25.758650 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 278/554] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:25 2022] GET /compute/v2.1/servers/88769e75-3f26-45cf-9857-3fa7fc4b478e => generated 1322 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:25.764444 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6884fdb2-6da2-4b98-a31b-7b62aed69ee2 tempest-SecurityGroupsTestAdminJSON-366864463 tempest-SecurityGroupsTestAdminJSON-366864463-project] Calling method '.version_select at 0x7f7cd5a71160>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:25.832995 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4b24116d-817f-48aa-b71c-6e5ba9d9b18c tempest-DeleteServersAdminTestJSON-704160048 tempest-DeleteServersAdminTestJSON-704160048-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/c47e40d5-8a51-45cc-93e5-1142c8988e5c/action" status: 202 len: 0 microversion: 2.1 time: 0.163985 Oct 17 13:35:25.834275 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 277/555] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:35:25 2022] POST /compute/v2.1/servers/c47e40d5-8a51-45cc-93e5-1142c8988e5c/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:35:25.840756 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-65faa8ce-7f8a-4164-bacd-56927cac3db7 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:25.841705 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-65faa8ce-7f8a-4164-bacd-56927cac3db7 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] [instance: dd9a885e-0fb3-411a-b816-eafc93e1c5cb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:25.848481 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-65faa8ce-7f8a-4164-bacd-56927cac3db7 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:25.849204 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-65faa8ce-7f8a-4164-bacd-56927cac3db7 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:25.849614 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-65faa8ce-7f8a-4164-bacd-56927cac3db7 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:25.850697 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-65faa8ce-7f8a-4164-bacd-56927cac3db7 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:25.851186 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-65faa8ce-7f8a-4164-bacd-56927cac3db7 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:25.851608 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-65faa8ce-7f8a-4164-bacd-56927cac3db7 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:26.200516 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-65faa8ce-7f8a-4164-bacd-56927cac3db7 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e836340278b49f593350249132b9cfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550b2bda88024756abc4134365842d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:26.214414 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-65faa8ce-7f8a-4164-bacd-56927cac3db7 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] 10.222.0.79 "GET /compute/v2.1/servers/dd9a885e-0fb3-411a-b816-eafc93e1c5cb" status: 200 len: 1389 microversion: 2.1 time: 0.378804 Oct 17 13:35:26.215823 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 278/556] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:25 2022] GET /compute/v2.1/servers/dd9a885e-0fb3-411a-b816-eafc93e1c5cb => generated 1389 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:26.221990 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8ac20bf2-a65e-4059-a38c-ecde951d15da tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:26.222965 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8ac20bf2-a65e-4059-a38c-ecde951d15da tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 03e8be7f-09be-488a-95ee-6951b53e35de] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:26.229876 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8ac20bf2-a65e-4059-a38c-ecde951d15da tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:26.230793 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8ac20bf2-a65e-4059-a38c-ecde951d15da tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:26.231423 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8ac20bf2-a65e-4059-a38c-ecde951d15da tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:26.232327 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8ac20bf2-a65e-4059-a38c-ecde951d15da tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:26.233598 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8ac20bf2-a65e-4059-a38c-ecde951d15da tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:26.234222 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8ac20bf2-a65e-4059-a38c-ecde951d15da tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:26.391744 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6884fdb2-6da2-4b98-a31b-7b62aed69ee2 tempest-SecurityGroupsTestAdminJSON-366864463 tempest-SecurityGroupsTestAdminJSON-366864463-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/bc318b76-1300-454d-88f3-a7310153882e" status: 202 len: 0 microversion: 2.1 time: 0.631644 Oct 17 13:35:26.396120 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 279/557] 10.222.0.79 () {58 vars in 1272 bytes} [Mon Oct 17 13:35:25 2022] DELETE /compute/v2.1/os-security-groups/bc318b76-1300-454d-88f3-a7310153882e => generated 0 bytes in 633 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:35:26.400441 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-daeea913-87bf-4c7b-8217-0595c6f84edf tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:26.401117 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-daeea913-87bf-4c7b-8217-0595c6f84edf tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] [instance: 51be2144-e969-4e1b-b5da-c43b9a7b7c90] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:26.407965 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-daeea913-87bf-4c7b-8217-0595c6f84edf tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:26.408451 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-daeea913-87bf-4c7b-8217-0595c6f84edf tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:26.408914 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-daeea913-87bf-4c7b-8217-0595c6f84edf tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:26.409620 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-daeea913-87bf-4c7b-8217-0595c6f84edf tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:26.410069 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-daeea913-87bf-4c7b-8217-0595c6f84edf tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:26.410486 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-daeea913-87bf-4c7b-8217-0595c6f84edf tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:26.516952 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-daeea913-87bf-4c7b-8217-0595c6f84edf tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:26.523133 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8ac20bf2-a65e-4059-a38c-ecde951d15da tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:26.529556 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-daeea913-87bf-4c7b-8217-0595c6f84edf tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:26.531039 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-daeea913-87bf-4c7b-8217-0595c6f84edf tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:26.531234 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8ac20bf2-a65e-4059-a38c-ecde951d15da tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/03e8be7f-09be-488a-95ee-6951b53e35de" status: 200 len: 1319 microversion: 2.1 time: 0.314087 Oct 17 13:35:26.542031 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-daeea913-87bf-4c7b-8217-0595c6f84edf tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] 10.222.0.79 "GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90" status: 200 len: 1447 microversion: 2.75 time: 0.148036 Oct 17 13:35:26.542732 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 280/558] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:35:26 2022] GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90 => generated 1447 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:35:26.547821 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 279/559] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:26 2022] GET /compute/v2.1/servers/03e8be7f-09be-488a-95ee-6951b53e35de => generated 1319 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:26.553577 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e91f0207-9bef-4555-8aff-42e733815c76 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:26.554888 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e91f0207-9bef-4555-8aff-42e733815c76 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: f869f059-89c3-4462-a309-e27f650d7584] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:26.562517 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e91f0207-9bef-4555-8aff-42e733815c76 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:26.563357 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e91f0207-9bef-4555-8aff-42e733815c76 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:26.563984 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e91f0207-9bef-4555-8aff-42e733815c76 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:26.564870 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e91f0207-9bef-4555-8aff-42e733815c76 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:26.565505 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e91f0207-9bef-4555-8aff-42e733815c76 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:26.566096 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e91f0207-9bef-4555-8aff-42e733815c76 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:26.572276 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9ec5b59b-24f2-4a02-9b18-53543d26f226 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:26.572902 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9ec5b59b-24f2-4a02-9b18-53543d26f226 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] [instance: c47e40d5-8a51-45cc-93e5-1142c8988e5c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:26.578884 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9ec5b59b-24f2-4a02-9b18-53543d26f226 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:26.579406 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9ec5b59b-24f2-4a02-9b18-53543d26f226 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:26.579837 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9ec5b59b-24f2-4a02-9b18-53543d26f226 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:26.580543 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9ec5b59b-24f2-4a02-9b18-53543d26f226 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:26.580994 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9ec5b59b-24f2-4a02-9b18-53543d26f226 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:26.581415 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9ec5b59b-24f2-4a02-9b18-53543d26f226 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:26.616866 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9ec5b59b-24f2-4a02-9b18-53543d26f226 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:26.617666 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9ec5b59b-24f2-4a02-9b18-53543d26f226 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:26.618548 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9ec5b59b-24f2-4a02-9b18-53543d26f226 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:26.619449 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-9ec5b59b-24f2-4a02-9b18-53543d26f226 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lazy-loading 'fault' on Instance uuid c47e40d5-8a51-45cc-93e5-1142c8988e5c {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:35:26.870869 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e91f0207-9bef-4555-8aff-42e733815c76 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:26.880448 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e91f0207-9bef-4555-8aff-42e733815c76 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/f869f059-89c3-4462-a309-e27f650d7584" status: 200 len: 1310 microversion: 2.1 time: 0.330952 Oct 17 13:35:26.881020 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 280/560] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:26 2022] GET /compute/v2.1/servers/f869f059-89c3-4462-a309-e27f650d7584 => generated 1310 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:26.883771 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9ec5b59b-24f2-4a02-9b18-53543d26f226 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf50aa8e899648418eace99975616e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6aa32dd3904f6aaae1e63fcc67b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:26.887036 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e4490fa0-2bc5-45db-8d57-0bbc9666ae7b tempest-SecurityGroupsTestAdminJSON-366864463 tempest-SecurityGroupsTestAdminJSON-366864463-project] Calling method '.version_select at 0x7f7cd5ca5820>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:26.893034 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9ec5b59b-24f2-4a02-9b18-53543d26f226 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] 10.222.0.79 "GET /compute/v2.1/servers/c47e40d5-8a51-45cc-93e5-1142c8988e5c" status: 200 len: 1452 microversion: 2.1 time: 0.327837 Oct 17 13:35:26.907643 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 281/561] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:26 2022] GET /compute/v2.1/servers/c47e40d5-8a51-45cc-93e5-1142c8988e5c => generated 1452 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:26.917233 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d5b1d115-e5ac-4392-9661-716108e7d902 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:26.918154 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d5b1d115-e5ac-4392-9661-716108e7d902 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] [instance: 3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:26.927033 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d5b1d115-e5ac-4392-9661-716108e7d902 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:26.927616 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d5b1d115-e5ac-4392-9661-716108e7d902 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:26.928108 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d5b1d115-e5ac-4392-9661-716108e7d902 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:26.928887 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d5b1d115-e5ac-4392-9661-716108e7d902 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:26.929412 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d5b1d115-e5ac-4392-9661-716108e7d902 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:26.929883 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d5b1d115-e5ac-4392-9661-716108e7d902 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:27.269969 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d5b1d115-e5ac-4392-9661-716108e7d902 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3dfc7f18ec4a6883b62872ab011cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc31d4fa0cd9418584f52e7c46ade866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:27.279296 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d5b1d115-e5ac-4392-9661-716108e7d902 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] 10.222.0.79 "GET /compute/v2.1/servers/3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5" status: 200 len: 1331 microversion: 2.1 time: 0.370246 Oct 17 13:35:27.279880 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 282/562] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:26 2022] GET /compute/v2.1/servers/3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5 => generated 1331 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:27.285455 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-aeddfacd-7eae-4d6a-a636-116d6121c186 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:27.286165 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-aeddfacd-7eae-4d6a-a636-116d6121c186 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] [instance: 88769e75-3f26-45cf-9857-3fa7fc4b478e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:27.293480 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aeddfacd-7eae-4d6a-a636-116d6121c186 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:27.294218 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aeddfacd-7eae-4d6a-a636-116d6121c186 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:27.294851 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aeddfacd-7eae-4d6a-a636-116d6121c186 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:27.295854 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aeddfacd-7eae-4d6a-a636-116d6121c186 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:27.296530 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aeddfacd-7eae-4d6a-a636-116d6121c186 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:27.296919 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aeddfacd-7eae-4d6a-a636-116d6121c186 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:27.565413 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e4490fa0-2bc5-45db-8d57-0bbc9666ae7b tempest-SecurityGroupsTestAdminJSON-366864463 tempest-SecurityGroupsTestAdminJSON-366864463-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/0ccf0caf-fab9-4813-b897-40196a12ece8" status: 202 len: 0 microversion: 2.1 time: 0.682857 Oct 17 13:35:27.568112 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 281/563] 10.222.0.79 () {58 vars in 1272 bytes} [Mon Oct 17 13:35:26 2022] DELETE /compute/v2.1/os-security-groups/0ccf0caf-fab9-4813-b897-40196a12ece8 => generated 0 bytes in 686 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:35:27.576769 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-39df868e-c4b8-4784-aaf2-08aa02355736 req-55dac316-07e6-454c-a58c-b35fe098f7ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f869f059-89c3-4462-a309-e27f650d7584", "tag": "b4a014a2-f1ca-4513-9531-01b335adbbcb"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:27.587286 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-39df868e-c4b8-4784-aaf2-08aa02355736 req-55dac316-07e6-454c-a58c-b35fe098f7ca service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:27.588138 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-39df868e-c4b8-4784-aaf2-08aa02355736 req-55dac316-07e6-454c-a58c-b35fe098f7ca service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:27.588779 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-39df868e-c4b8-4784-aaf2-08aa02355736 req-55dac316-07e6-454c-a58c-b35fe098f7ca service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:27.601353 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-39df868e-c4b8-4784-aaf2-08aa02355736 req-55dac316-07e6-454c-a58c-b35fe098f7ca service nova] Creating event network-changed:b4a014a2-f1ca-4513-9531-01b335adbbcb for instance f869f059-89c3-4462-a309-e27f650d7584 on n-h1-854247-14 Oct 17 13:35:27.607257 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-39df868e-c4b8-4784-aaf2-08aa02355736 req-55dac316-07e6-454c-a58c-b35fe098f7ca service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037633 Oct 17 13:35:27.608622 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 282/564] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:35:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:27.616170 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-cc494098-3fb1-4bcb-bccc-431b9da21e52 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:27.618035 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-cc494098-3fb1-4bcb-bccc-431b9da21e52 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] [instance: c47e40d5-8a51-45cc-93e5-1142c8988e5c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:27.625071 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cc494098-3fb1-4bcb-bccc-431b9da21e52 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:27.625977 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cc494098-3fb1-4bcb-bccc-431b9da21e52 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:27.626691 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cc494098-3fb1-4bcb-bccc-431b9da21e52 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:27.627659 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cc494098-3fb1-4bcb-bccc-431b9da21e52 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:27.628357 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cc494098-3fb1-4bcb-bccc-431b9da21e52 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:27.629102 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cc494098-3fb1-4bcb-bccc-431b9da21e52 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:27.664369 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-cc494098-3fb1-4bcb-bccc-431b9da21e52 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] [instance: c47e40d5-8a51-45cc-93e5-1142c8988e5c] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:35:27.782703 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-cc494098-3fb1-4bcb-bccc-431b9da21e52 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c47e40d5-8a51-45cc-93e5-1142c8988e5c" status: 204 len: 0 microversion: 2.1 time: 0.170066 Oct 17 13:35:27.784174 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 283/565] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:35:27 2022] DELETE /compute/v2.1/servers/c47e40d5-8a51-45cc-93e5-1142c8988e5c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:35:27.792147 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-447b7485-1305-443a-a708-c809eb225ae0 req-edb8c529-1ae4-4d06-b8fc-6dce7f73cfbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd9a885e-0fb3-411a-b816-eafc93e1c5cb", "name": "network-vif-plugged", "status": "completed", "tag": "2ff450f2-efdf-4213-8a18-aa178b264642"}, {"server_uuid": "03e8be7f-09be-488a-95ee-6951b53e35de", "name": "network-vif-plugged", "status": "completed", "tag": "c0d55331-8725-4b8f-8583-c7d47cad2300"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:27.804970 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-447b7485-1305-443a-a708-c809eb225ae0 req-edb8c529-1ae4-4d06-b8fc-6dce7f73cfbc service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:27.806481 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-447b7485-1305-443a-a708-c809eb225ae0 req-edb8c529-1ae4-4d06-b8fc-6dce7f73cfbc service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:27.807637 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-447b7485-1305-443a-a708-c809eb225ae0 req-edb8c529-1ae4-4d06-b8fc-6dce7f73cfbc service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:27.826089 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-447b7485-1305-443a-a708-c809eb225ae0 req-edb8c529-1ae4-4d06-b8fc-6dce7f73cfbc service nova] Creating event network-vif-plugged:2ff450f2-efdf-4213-8a18-aa178b264642 for instance dd9a885e-0fb3-411a-b816-eafc93e1c5cb on n-h2-854247-14 Oct 17 13:35:27.826982 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-447b7485-1305-443a-a708-c809eb225ae0 req-edb8c529-1ae4-4d06-b8fc-6dce7f73cfbc service nova] Creating event network-vif-plugged:c0d55331-8725-4b8f-8583-c7d47cad2300 for instance 03e8be7f-09be-488a-95ee-6951b53e35de on n-h1-854247-14 Oct 17 13:35:27.838967 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-447b7485-1305-443a-a708-c809eb225ae0 req-edb8c529-1ae4-4d06-b8fc-6dce7f73cfbc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.051892 Oct 17 13:35:27.840961 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 284/566] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:35:27 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:27.847390 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-5232a5a4-c604-4199-9b74-460eaba2d4be req-47eb65c1-1839-4553-8e13-cdc2a59730aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88769e75-3f26-45cf-9857-3fa7fc4b478e", "tag": "9a770d5d-ee5c-4b9d-907c-d0aa8427ba10"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:27.863677 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-5232a5a4-c604-4199-9b74-460eaba2d4be req-47eb65c1-1839-4553-8e13-cdc2a59730aa service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:27.864365 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-5232a5a4-c604-4199-9b74-460eaba2d4be req-47eb65c1-1839-4553-8e13-cdc2a59730aa service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:27.864812 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-5232a5a4-c604-4199-9b74-460eaba2d4be req-47eb65c1-1839-4553-8e13-cdc2a59730aa service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:27.887645 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-5232a5a4-c604-4199-9b74-460eaba2d4be req-47eb65c1-1839-4553-8e13-cdc2a59730aa service nova] Creating event network-changed:9a770d5d-ee5c-4b9d-907c-d0aa8427ba10 for instance 88769e75-3f26-45cf-9857-3fa7fc4b478e on n-h2-854247-14 Oct 17 13:35:27.907408 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-5232a5a4-c604-4199-9b74-460eaba2d4be req-47eb65c1-1839-4553-8e13-cdc2a59730aa service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064286 Oct 17 13:35:27.910180 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 285/567] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:35:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:27.917864 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-fe8b7b13-11b7-4605-8905-b650e8a327a0 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:27.919889 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-fe8b7b13-11b7-4605-8905-b650e8a327a0 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] [instance: dd9a885e-0fb3-411a-b816-eafc93e1c5cb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:27.928143 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-aeddfacd-7eae-4d6a-a636-116d6121c186 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a685773acdb415591f62ccee7157b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa06a29e779e413484cdfcb27e902525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:27.928882 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fe8b7b13-11b7-4605-8905-b650e8a327a0 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:27.929659 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fe8b7b13-11b7-4605-8905-b650e8a327a0 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:27.931038 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fe8b7b13-11b7-4605-8905-b650e8a327a0 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:27.932269 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fe8b7b13-11b7-4605-8905-b650e8a327a0 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:27.933712 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fe8b7b13-11b7-4605-8905-b650e8a327a0 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:27.934330 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fe8b7b13-11b7-4605-8905-b650e8a327a0 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:27.941788 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-aeddfacd-7eae-4d6a-a636-116d6121c186 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] 10.222.0.79 "GET /compute/v2.1/servers/88769e75-3f26-45cf-9857-3fa7fc4b478e" status: 200 len: 1322 microversion: 2.1 time: 0.660388 Oct 17 13:35:27.943825 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 283/568] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:27 2022] GET /compute/v2.1/servers/88769e75-3f26-45cf-9857-3fa7fc4b478e => generated 1322 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:27.967919 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-888fe0fc-83cf-405f-aaa5-b6ca2d5fe6bf tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:27.968865 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-888fe0fc-83cf-405f-aaa5-b6ca2d5fe6bf tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 03e8be7f-09be-488a-95ee-6951b53e35de] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:27.978655 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-888fe0fc-83cf-405f-aaa5-b6ca2d5fe6bf tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:27.980135 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-888fe0fc-83cf-405f-aaa5-b6ca2d5fe6bf tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:27.980988 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-888fe0fc-83cf-405f-aaa5-b6ca2d5fe6bf tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:27.982681 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-888fe0fc-83cf-405f-aaa5-b6ca2d5fe6bf tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:27.983617 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-888fe0fc-83cf-405f-aaa5-b6ca2d5fe6bf tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:27.984206 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-888fe0fc-83cf-405f-aaa5-b6ca2d5fe6bf tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:28.314742 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-888fe0fc-83cf-405f-aaa5-b6ca2d5fe6bf tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:28.323992 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-888fe0fc-83cf-405f-aaa5-b6ca2d5fe6bf tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/03e8be7f-09be-488a-95ee-6951b53e35de" status: 200 len: 1319 microversion: 2.1 time: 0.366252 Oct 17 13:35:28.325097 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-fe8b7b13-11b7-4605-8905-b650e8a327a0 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e836340278b49f593350249132b9cfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550b2bda88024756abc4134365842d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:28.330271 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:28.333183 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 284/569] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:27 2022] GET /compute/v2.1/servers/03e8be7f-09be-488a-95ee-6951b53e35de => generated 1319 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:28.340028 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-88143f95-b4f3-4ab8-a02d-3c65400d4f42 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:28.340849 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-88143f95-b4f3-4ab8-a02d-3c65400d4f42 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] [instance: 51be2144-e969-4e1b-b5da-c43b9a7b7c90] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:28.341228 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-fe8b7b13-11b7-4605-8905-b650e8a327a0 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] 10.222.0.79 "GET /compute/v2.1/servers/dd9a885e-0fb3-411a-b816-eafc93e1c5cb" status: 200 len: 1389 microversion: 2.1 time: 0.427711 Oct 17 13:35:28.347070 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-88143f95-b4f3-4ab8-a02d-3c65400d4f42 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:28.347788 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-88143f95-b4f3-4ab8-a02d-3c65400d4f42 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:28.348364 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-88143f95-b4f3-4ab8-a02d-3c65400d4f42 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:28.349209 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-88143f95-b4f3-4ab8-a02d-3c65400d4f42 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:28.349801 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-88143f95-b4f3-4ab8-a02d-3c65400d4f42 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:28.350372 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-88143f95-b4f3-4ab8-a02d-3c65400d4f42 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:28.351571 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 286/570] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:27 2022] GET /compute/v2.1/servers/dd9a885e-0fb3-411a-b816-eafc93e1c5cb => generated 1389 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:28.364967 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b3712e0f-b5bd-46c3-9f76-9d3af65121cb tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:28.366220 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b3712e0f-b5bd-46c3-9f76-9d3af65121cb tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] [instance: c47e40d5-8a51-45cc-93e5-1142c8988e5c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:28.370729 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:28.377458 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b3712e0f-b5bd-46c3-9f76-9d3af65121cb tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:28.377949 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b3712e0f-b5bd-46c3-9f76-9d3af65121cb tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:28.378382 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b3712e0f-b5bd-46c3-9f76-9d3af65121cb tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:28.379080 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b3712e0f-b5bd-46c3-9f76-9d3af65121cb tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:28.379553 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b3712e0f-b5bd-46c3-9f76-9d3af65121cb tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:28.379982 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b3712e0f-b5bd-46c3-9f76-9d3af65121cb tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:28.420046 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b3712e0f-b5bd-46c3-9f76-9d3af65121cb tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:28.420523 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b3712e0f-b5bd-46c3-9f76-9d3af65121cb tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:28.421015 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b3712e0f-b5bd-46c3-9f76-9d3af65121cb tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:28.421390 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-b3712e0f-b5bd-46c3-9f76-9d3af65121cb tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lazy-loading 'fault' on Instance uuid c47e40d5-8a51-45cc-93e5-1142c8988e5c {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:35:28.435679 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-88143f95-b4f3-4ab8-a02d-3c65400d4f42 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:28.447448 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-88143f95-b4f3-4ab8-a02d-3c65400d4f42 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:28.448898 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-88143f95-b4f3-4ab8-a02d-3c65400d4f42 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:28.454224 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-88143f95-b4f3-4ab8-a02d-3c65400d4f42 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] 10.222.0.79 "GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90" status: 200 len: 1447 microversion: 2.75 time: 0.119626 Oct 17 13:35:28.454794 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 285/571] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:35:28 2022] GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90 => generated 1447 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:35:28.460233 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e66508a7-ca69-44b2-9693-0420c2c60c1d tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:28.460838 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e66508a7-ca69-44b2-9693-0420c2c60c1d tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: f869f059-89c3-4462-a309-e27f650d7584] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:28.468085 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e66508a7-ca69-44b2-9693-0420c2c60c1d tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:28.468618 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e66508a7-ca69-44b2-9693-0420c2c60c1d tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:28.469192 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e66508a7-ca69-44b2-9693-0420c2c60c1d tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:28.470025 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e66508a7-ca69-44b2-9693-0420c2c60c1d tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:28.470676 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e66508a7-ca69-44b2-9693-0420c2c60c1d tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:28.471268 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e66508a7-ca69-44b2-9693-0420c2c60c1d tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:28.591829 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b3712e0f-b5bd-46c3-9f76-9d3af65121cb tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf50aa8e899648418eace99975616e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6aa32dd3904f6aaae1e63fcc67b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:28.600839 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b3712e0f-b5bd-46c3-9f76-9d3af65121cb tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] 10.222.0.79 "GET /compute/v2.1/servers/c47e40d5-8a51-45cc-93e5-1142c8988e5c" status: 200 len: 1458 microversion: 2.1 time: 0.247976 Oct 17 13:35:28.601440 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 287/572] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:28 2022] GET /compute/v2.1/servers/c47e40d5-8a51-45cc-93e5-1142c8988e5c => generated 1458 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:28.606301 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c882a06d-ae89-480c-a3b6-face019b687c tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:28.607152 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c882a06d-ae89-480c-a3b6-face019b687c tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] [instance: 3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:28.613914 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c882a06d-ae89-480c-a3b6-face019b687c tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:28.614393 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c882a06d-ae89-480c-a3b6-face019b687c tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:28.614981 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c882a06d-ae89-480c-a3b6-face019b687c tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:28.615766 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c882a06d-ae89-480c-a3b6-face019b687c tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:28.616413 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c882a06d-ae89-480c-a3b6-face019b687c tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:28.616991 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c882a06d-ae89-480c-a3b6-face019b687c tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:28.638312 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e66508a7-ca69-44b2-9693-0420c2c60c1d tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:28.648220 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e66508a7-ca69-44b2-9693-0420c2c60c1d tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/f869f059-89c3-4462-a309-e27f650d7584" status: 200 len: 1310 microversion: 2.1 time: 0.191848 Oct 17 13:35:28.649008 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 286/573] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:28 2022] GET /compute/v2.1/servers/f869f059-89c3-4462-a309-e27f650d7584 => generated 1310 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:28.795237 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c882a06d-ae89-480c-a3b6-face019b687c tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3dfc7f18ec4a6883b62872ab011cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc31d4fa0cd9418584f52e7c46ade866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:28.803375 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c882a06d-ae89-480c-a3b6-face019b687c tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] 10.222.0.79 "GET /compute/v2.1/servers/3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5" status: 200 len: 1535 microversion: 2.1 time: 0.200735 Oct 17 13:35:28.803931 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 288/574] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:28 2022] GET /compute/v2.1/servers/3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5 => generated 1535 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:28.827083 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-49d5a63d-b93d-4fc8-85bd-c5aec101043d tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Action: 'create', calling method: .version_select at 0x7f7cd5b7b1f0>, body: {"pool": "21df306d-9b14-4323-a3b6-31e46566b626"} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:28.971977 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d537745b-8636-4337-ad96-94b73b7bdbbc tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:28.973318 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d537745b-8636-4337-ad96-94b73b7bdbbc tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] [instance: 88769e75-3f26-45cf-9857-3fa7fc4b478e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:28.981029 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d537745b-8636-4337-ad96-94b73b7bdbbc tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:28.981582 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d537745b-8636-4337-ad96-94b73b7bdbbc tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:28.982151 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d537745b-8636-4337-ad96-94b73b7bdbbc tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:28.982859 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d537745b-8636-4337-ad96-94b73b7bdbbc tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:28.983362 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d537745b-8636-4337-ad96-94b73b7bdbbc tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:28.983769 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d537745b-8636-4337-ad96-94b73b7bdbbc tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:29.331026 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d537745b-8636-4337-ad96-94b73b7bdbbc tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a685773acdb415591f62ccee7157b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa06a29e779e413484cdfcb27e902525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:29.342784 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d537745b-8636-4337-ad96-94b73b7bdbbc tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] 10.222.0.79 "GET /compute/v2.1/servers/88769e75-3f26-45cf-9857-3fa7fc4b478e" status: 200 len: 1322 microversion: 2.1 time: 0.375698 Oct 17 13:35:29.347637 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 289/575] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:28 2022] GET /compute/v2.1/servers/88769e75-3f26-45cf-9857-3fa7fc4b478e => generated 1322 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:35:29.353118 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5d2828c5-9f31-4b65-823c-5a4a32727864 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:29.353928 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5d2828c5-9f31-4b65-823c-5a4a32727864 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 03e8be7f-09be-488a-95ee-6951b53e35de] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:29.362539 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5d2828c5-9f31-4b65-823c-5a4a32727864 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:29.363199 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5d2828c5-9f31-4b65-823c-5a4a32727864 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:29.363816 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5d2828c5-9f31-4b65-823c-5a4a32727864 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:29.364624 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5d2828c5-9f31-4b65-823c-5a4a32727864 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:29.365178 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5d2828c5-9f31-4b65-823c-5a4a32727864 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:29.365660 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5d2828c5-9f31-4b65-823c-5a4a32727864 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:29.732871 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5d2828c5-9f31-4b65-823c-5a4a32727864 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:29.741867 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5d2828c5-9f31-4b65-823c-5a4a32727864 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/03e8be7f-09be-488a-95ee-6951b53e35de" status: 200 len: 1319 microversion: 2.1 time: 0.393053 Oct 17 13:35:29.744427 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 290/576] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:29 2022] GET /compute/v2.1/servers/03e8be7f-09be-488a-95ee-6951b53e35de => generated 1319 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:29.754491 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2a6884b0-2a4f-4e48-8d2f-778b3e2f92e8 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:29.763557 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2a6884b0-2a4f-4e48-8d2f-778b3e2f92e8 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] [instance: dd9a885e-0fb3-411a-b816-eafc93e1c5cb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:29.771158 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2a6884b0-2a4f-4e48-8d2f-778b3e2f92e8 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:29.771677 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2a6884b0-2a4f-4e48-8d2f-778b3e2f92e8 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:29.772105 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2a6884b0-2a4f-4e48-8d2f-778b3e2f92e8 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:29.772805 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2a6884b0-2a4f-4e48-8d2f-778b3e2f92e8 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:29.773273 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2a6884b0-2a4f-4e48-8d2f-778b3e2f92e8 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:29.773687 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2a6884b0-2a4f-4e48-8d2f-778b3e2f92e8 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:30.071301 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2a6884b0-2a4f-4e48-8d2f-778b3e2f92e8 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e836340278b49f593350249132b9cfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550b2bda88024756abc4134365842d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:30.087259 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2a6884b0-2a4f-4e48-8d2f-778b3e2f92e8 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] 10.222.0.79 "GET /compute/v2.1/servers/dd9a885e-0fb3-411a-b816-eafc93e1c5cb" status: 200 len: 1389 microversion: 2.1 time: 0.338479 Oct 17 13:35:30.099320 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 291/577] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:29 2022] GET /compute/v2.1/servers/dd9a885e-0fb3-411a-b816-eafc93e1c5cb => generated 1389 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:30.099320 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-87896a67-f13b-412d-be81-2dba3082a306 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:30.099320 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-87896a67-f13b-412d-be81-2dba3082a306 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] [instance: 51be2144-e969-4e1b-b5da-c43b9a7b7c90] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:30.114282 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-87896a67-f13b-412d-be81-2dba3082a306 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:30.115007 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-87896a67-f13b-412d-be81-2dba3082a306 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:30.115631 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-87896a67-f13b-412d-be81-2dba3082a306 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:30.118685 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-87896a67-f13b-412d-be81-2dba3082a306 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:30.119482 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-87896a67-f13b-412d-be81-2dba3082a306 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:30.121951 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-87896a67-f13b-412d-be81-2dba3082a306 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:30.268815 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-87896a67-f13b-412d-be81-2dba3082a306 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:30.278276 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-87896a67-f13b-412d-be81-2dba3082a306 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:30.280067 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-87896a67-f13b-412d-be81-2dba3082a306 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:30.286250 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-87896a67-f13b-412d-be81-2dba3082a306 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] 10.222.0.79 "GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90" status: 200 len: 1447 microversion: 2.75 time: 0.196950 Oct 17 13:35:30.287483 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 292/578] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:35:30 2022] GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90 => generated 1447 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:35:30.293573 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f8668bba-88bc-49d9-ae84-8e3497eea5bc tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:30.294507 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f8668bba-88bc-49d9-ae84-8e3497eea5bc tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] [instance: c47e40d5-8a51-45cc-93e5-1142c8988e5c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:30.302211 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f8668bba-88bc-49d9-ae84-8e3497eea5bc tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:30.302992 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f8668bba-88bc-49d9-ae84-8e3497eea5bc tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:30.303700 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f8668bba-88bc-49d9-ae84-8e3497eea5bc tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:30.305405 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f8668bba-88bc-49d9-ae84-8e3497eea5bc tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:30.306029 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f8668bba-88bc-49d9-ae84-8e3497eea5bc tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:30.306922 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f8668bba-88bc-49d9-ae84-8e3497eea5bc tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:30.345465 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f8668bba-88bc-49d9-ae84-8e3497eea5bc tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:30.346214 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f8668bba-88bc-49d9-ae84-8e3497eea5bc tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:30.346835 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f8668bba-88bc-49d9-ae84-8e3497eea5bc tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:30.347523 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-f8668bba-88bc-49d9-ae84-8e3497eea5bc tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lazy-loading 'fault' on Instance uuid c47e40d5-8a51-45cc-93e5-1142c8988e5c {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:35:30.449528 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f8668bba-88bc-49d9-ae84-8e3497eea5bc tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf50aa8e899648418eace99975616e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6aa32dd3904f6aaae1e63fcc67b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:30.460023 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f8668bba-88bc-49d9-ae84-8e3497eea5bc tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] 10.222.0.79 "GET /compute/v2.1/servers/c47e40d5-8a51-45cc-93e5-1142c8988e5c" status: 200 len: 1416 microversion: 2.1 time: 0.170921 Oct 17 13:35:30.461442 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 293/579] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:30 2022] GET /compute/v2.1/servers/c47e40d5-8a51-45cc-93e5-1142c8988e5c => generated 1416 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:30.468329 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-dcb860a1-6e7e-4c0f-a71d-e63262de6eb7 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:30.469184 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-dcb860a1-6e7e-4c0f-a71d-e63262de6eb7 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: f869f059-89c3-4462-a309-e27f650d7584] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:30.475723 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dcb860a1-6e7e-4c0f-a71d-e63262de6eb7 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:30.476489 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dcb860a1-6e7e-4c0f-a71d-e63262de6eb7 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:30.477080 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dcb860a1-6e7e-4c0f-a71d-e63262de6eb7 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:30.478012 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dcb860a1-6e7e-4c0f-a71d-e63262de6eb7 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:30.478772 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dcb860a1-6e7e-4c0f-a71d-e63262de6eb7 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:30.479377 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dcb860a1-6e7e-4c0f-a71d-e63262de6eb7 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:31.042474 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-dcb860a1-6e7e-4c0f-a71d-e63262de6eb7 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:31.050757 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-dcb860a1-6e7e-4c0f-a71d-e63262de6eb7 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/f869f059-89c3-4462-a309-e27f650d7584" status: 200 len: 1310 microversion: 2.1 time: 0.588046 Oct 17 13:35:31.051379 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 294/580] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:30 2022] GET /compute/v2.1/servers/f869f059-89c3-4462-a309-e27f650d7584 => generated 1310 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:31.055965 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-c2a248f9-6ec4-44b4-ae53-3f5667d61f04 req-a311a109-8862-4f5e-b3cc-5bf4468add09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c47e40d5-8a51-45cc-93e5-1142c8988e5c", "name": "network-vif-deleted", "tag": "3b0ed902-0a43-4b1a-9a6b-16ba3b6d6f28"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:31.066152 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-c2a248f9-6ec4-44b4-ae53-3f5667d61f04 req-a311a109-8862-4f5e-b3cc-5bf4468add09 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:31.066786 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-c2a248f9-6ec4-44b4-ae53-3f5667d61f04 req-a311a109-8862-4f5e-b3cc-5bf4468add09 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:31.067207 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-c2a248f9-6ec4-44b4-ae53-3f5667d61f04 req-a311a109-8862-4f5e-b3cc-5bf4468add09 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:31.080535 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-c2a248f9-6ec4-44b4-ae53-3f5667d61f04 req-a311a109-8862-4f5e-b3cc-5bf4468add09 service nova] Creating event network-vif-deleted:3b0ed902-0a43-4b1a-9a6b-16ba3b6d6f28 for instance c47e40d5-8a51-45cc-93e5-1142c8988e5c on n-h2-854247-14 Oct 17 13:35:31.086027 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-c2a248f9-6ec4-44b4-ae53-3f5667d61f04 req-a311a109-8862-4f5e-b3cc-5bf4468add09 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033513 Oct 17 13:35:31.086699 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 295/581] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:31.092430 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-67b8eca4-86a8-4b4e-9ccf-6b4a81a7b5be tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:31.093110 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-67b8eca4-86a8-4b4e-9ccf-6b4a81a7b5be tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] [instance: 88769e75-3f26-45cf-9857-3fa7fc4b478e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:31.100031 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-67b8eca4-86a8-4b4e-9ccf-6b4a81a7b5be tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:31.101998 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-67b8eca4-86a8-4b4e-9ccf-6b4a81a7b5be tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:31.101998 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-67b8eca4-86a8-4b4e-9ccf-6b4a81a7b5be tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:31.102337 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-67b8eca4-86a8-4b4e-9ccf-6b4a81a7b5be tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:31.102969 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-67b8eca4-86a8-4b4e-9ccf-6b4a81a7b5be tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:31.103397 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-67b8eca4-86a8-4b4e-9ccf-6b4a81a7b5be tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:31.507351 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-67b8eca4-86a8-4b4e-9ccf-6b4a81a7b5be tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a685773acdb415591f62ccee7157b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa06a29e779e413484cdfcb27e902525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:31.518806 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-67b8eca4-86a8-4b4e-9ccf-6b4a81a7b5be tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] 10.222.0.79 "GET /compute/v2.1/servers/88769e75-3f26-45cf-9857-3fa7fc4b478e" status: 200 len: 1322 microversion: 2.1 time: 0.430848 Oct 17 13:35:31.519552 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 296/582] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:31 2022] GET /compute/v2.1/servers/88769e75-3f26-45cf-9857-3fa7fc4b478e => generated 1322 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:31.606364 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-49d5a63d-b93d-4fc8-85bd-c5aec101043d tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] 10.222.0.79 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.783216 Oct 17 13:35:31.607998 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 287/583] 10.222.0.79 () {60 vars in 1170 bytes} [Mon Oct 17 13:35:28 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2786 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:35:31.614010 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-eaaa14dd-8fbb-481a-8b78-f3f67582717c tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:31.615591 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-eaaa14dd-8fbb-481a-8b78-f3f67582717c tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 03e8be7f-09be-488a-95ee-6951b53e35de] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:31.622581 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eaaa14dd-8fbb-481a-8b78-f3f67582717c tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:31.623068 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eaaa14dd-8fbb-481a-8b78-f3f67582717c tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:31.623537 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eaaa14dd-8fbb-481a-8b78-f3f67582717c tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:31.624242 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eaaa14dd-8fbb-481a-8b78-f3f67582717c tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:31.624692 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eaaa14dd-8fbb-481a-8b78-f3f67582717c tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:31.625111 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eaaa14dd-8fbb-481a-8b78-f3f67582717c tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:31.671088 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-844e2f5d-6eea-49af-a24d-6b3bc8c267be tempest-ServicesAdminNegativeTestJSON-599861909 tempest-ServicesAdminNegativeTestJSON-599861909-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:31.674995 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-844e2f5d-6eea-49af-a24d-6b3bc8c267be tempest-ServicesAdminNegativeTestJSON-599861909 tempest-ServicesAdminNegativeTestJSON-599861909-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:31.675532 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-844e2f5d-6eea-49af-a24d-6b3bc8c267be tempest-ServicesAdminNegativeTestJSON-599861909 tempest-ServicesAdminNegativeTestJSON-599861909-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:31.675967 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-844e2f5d-6eea-49af-a24d-6b3bc8c267be tempest-ServicesAdminNegativeTestJSON-599861909 tempest-ServicesAdminNegativeTestJSON-599861909-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:31.676709 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-844e2f5d-6eea-49af-a24d-6b3bc8c267be tempest-ServicesAdminNegativeTestJSON-599861909 tempest-ServicesAdminNegativeTestJSON-599861909-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:31.677239 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-844e2f5d-6eea-49af-a24d-6b3bc8c267be tempest-ServicesAdminNegativeTestJSON-599861909 tempest-ServicesAdminNegativeTestJSON-599861909-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:31.677690 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-844e2f5d-6eea-49af-a24d-6b3bc8c267be tempest-ServicesAdminNegativeTestJSON-599861909 tempest-ServicesAdminNegativeTestJSON-599861909-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:31.704526 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-844e2f5d-6eea-49af-a24d-6b3bc8c267be tempest-ServicesAdminNegativeTestJSON-599861909 tempest-ServicesAdminNegativeTestJSON-599861909-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.169018 Oct 17 13:35:31.705789 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 297/584] 10.222.0.79 () {58 vars in 1137 bytes} [Mon Oct 17 13:35:31 2022] GET /compute/v2.1/os-services => generated 949 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:31.732599 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-efada724-7b00-447e-a72e-ba196d19170f tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:31.733226 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-efada724-7b00-447e-a72e-ba196d19170f tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] [instance: dd9a885e-0fb3-411a-b816-eafc93e1c5cb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:31.747640 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-efada724-7b00-447e-a72e-ba196d19170f tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:31.748614 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-efada724-7b00-447e-a72e-ba196d19170f tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:31.749273 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-efada724-7b00-447e-a72e-ba196d19170f tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:31.750313 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-efada724-7b00-447e-a72e-ba196d19170f tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:31.751642 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-efada724-7b00-447e-a72e-ba196d19170f tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:31.752254 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-efada724-7b00-447e-a72e-ba196d19170f tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:31.779806 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-eaaa14dd-8fbb-481a-8b78-f3f67582717c tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:31.818754 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-eaaa14dd-8fbb-481a-8b78-f3f67582717c tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/03e8be7f-09be-488a-95ee-6951b53e35de" status: 200 len: 1469 microversion: 2.1 time: 0.209177 Oct 17 13:35:31.819844 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 288/585] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:31 2022] GET /compute/v2.1/servers/03e8be7f-09be-488a-95ee-6951b53e35de => generated 1469 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:31.840945 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6781b466-5c89-41e9-9061-f6c6c1bfad5b tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:31.841592 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6781b466-5c89-41e9-9061-f6c6c1bfad5b tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] [instance: 51be2144-e969-4e1b-b5da-c43b9a7b7c90] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:31.853044 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6781b466-5c89-41e9-9061-f6c6c1bfad5b tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:31.853532 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6781b466-5c89-41e9-9061-f6c6c1bfad5b tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:31.853958 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6781b466-5c89-41e9-9061-f6c6c1bfad5b tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:31.854667 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6781b466-5c89-41e9-9061-f6c6c1bfad5b tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:31.855111 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6781b466-5c89-41e9-9061-f6c6c1bfad5b tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:31.856561 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6781b466-5c89-41e9-9061-f6c6c1bfad5b tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:31.967762 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6781b466-5c89-41e9-9061-f6c6c1bfad5b tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:31.974819 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-efada724-7b00-447e-a72e-ba196d19170f tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e836340278b49f593350249132b9cfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550b2bda88024756abc4134365842d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:31.976795 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6781b466-5c89-41e9-9061-f6c6c1bfad5b tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:31.978901 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6781b466-5c89-41e9-9061-f6c6c1bfad5b tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:31.984422 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6781b466-5c89-41e9-9061-f6c6c1bfad5b tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] 10.222.0.79 "GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90" status: 200 len: 1447 microversion: 2.75 time: 0.158963 Oct 17 13:35:31.985007 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 289/586] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:35:31 2022] GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90 => generated 1447 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:35:31.989863 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-10528640-5a83-4346-a921-ad4cc80b90c1 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:31.990481 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-10528640-5a83-4346-a921-ad4cc80b90c1 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] [instance: c47e40d5-8a51-45cc-93e5-1142c8988e5c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:31.996865 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-10528640-5a83-4346-a921-ad4cc80b90c1 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:31.997368 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-10528640-5a83-4346-a921-ad4cc80b90c1 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:31.997808 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-10528640-5a83-4346-a921-ad4cc80b90c1 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:31.998513 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-10528640-5a83-4346-a921-ad4cc80b90c1 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:31.998964 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-10528640-5a83-4346-a921-ad4cc80b90c1 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:31.999412 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-10528640-5a83-4346-a921-ad4cc80b90c1 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:32.004129 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-efada724-7b00-447e-a72e-ba196d19170f tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] 10.222.0.79 "GET /compute/v2.1/servers/dd9a885e-0fb3-411a-b816-eafc93e1c5cb" status: 200 len: 1389 microversion: 2.1 time: 0.296858 Oct 17 13:35:32.007994 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 298/587] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:31 2022] GET /compute/v2.1/servers/dd9a885e-0fb3-411a-b816-eafc93e1c5cb => generated 1389 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:32.013771 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1c23dce3-3c18-4863-8d25-0a43dd4e5aa7 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Action: 'action', calling method: .version_select at 0x7f7cd73634c0>, body: {"addFloatingIp": {"address": "172.25.0.74"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:32.016491 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1c23dce3-3c18-4863-8d25-0a43dd4e5aa7 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] [instance: 3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:32.024744 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c23dce3-3c18-4863-8d25-0a43dd4e5aa7 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:32.025313 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c23dce3-3c18-4863-8d25-0a43dd4e5aa7 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:32.025761 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c23dce3-3c18-4863-8d25-0a43dd4e5aa7 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:32.026541 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c23dce3-3c18-4863-8d25-0a43dd4e5aa7 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:32.027090 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c23dce3-3c18-4863-8d25-0a43dd4e5aa7 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:32.027586 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c23dce3-3c18-4863-8d25-0a43dd4e5aa7 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:32.056991 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-10528640-5a83-4346-a921-ad4cc80b90c1 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:32.057990 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-10528640-5a83-4346-a921-ad4cc80b90c1 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:32.058502 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-10528640-5a83-4346-a921-ad4cc80b90c1 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:32.059215 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-10528640-5a83-4346-a921-ad4cc80b90c1 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lazy-loading 'fault' on Instance uuid c47e40d5-8a51-45cc-93e5-1142c8988e5c {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:35:32.098049 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c23dce3-3c18-4863-8d25-0a43dd4e5aa7 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Acquiring lock "refresh_cache-3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5" {{(pid=127017) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 17 13:35:32.098506 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c23dce3-3c18-4863-8d25-0a43dd4e5aa7 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Acquired lock "refresh_cache-3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5" {{(pid=127017) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 17 13:35:32.119437 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-10528640-5a83-4346-a921-ad4cc80b90c1 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf50aa8e899648418eace99975616e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6aa32dd3904f6aaae1e63fcc67b0f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:32.131129 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-10528640-5a83-4346-a921-ad4cc80b90c1 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] 10.222.0.79 "GET /compute/v2.1/servers/c47e40d5-8a51-45cc-93e5-1142c8988e5c" status: 200 len: 1309 microversion: 2.1 time: 0.144866 Oct 17 13:35:32.131970 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 290/588] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:31 2022] GET /compute/v2.1/servers/c47e40d5-8a51-45cc-93e5-1142c8988e5c => generated 1309 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:32.152000 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c27d20c0-597b-4346-9ed3-c7b1f9b6a2ec tempest-ServicesAdminNegativeTestJSON-599861909 tempest-ServicesAdminNegativeTestJSON-599861909-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:32.155798 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c27d20c0-597b-4346-9ed3-c7b1f9b6a2ec tempest-ServicesAdminNegativeTestJSON-599861909 tempest-ServicesAdminNegativeTestJSON-599861909-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:32.156269 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c27d20c0-597b-4346-9ed3-c7b1f9b6a2ec tempest-ServicesAdminNegativeTestJSON-599861909 tempest-ServicesAdminNegativeTestJSON-599861909-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:32.156691 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c27d20c0-597b-4346-9ed3-c7b1f9b6a2ec tempest-ServicesAdminNegativeTestJSON-599861909 tempest-ServicesAdminNegativeTestJSON-599861909-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:32.157404 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c27d20c0-597b-4346-9ed3-c7b1f9b6a2ec tempest-ServicesAdminNegativeTestJSON-599861909 tempest-ServicesAdminNegativeTestJSON-599861909-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:32.157843 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c27d20c0-597b-4346-9ed3-c7b1f9b6a2ec tempest-ServicesAdminNegativeTestJSON-599861909 tempest-ServicesAdminNegativeTestJSON-599861909-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:32.158251 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c27d20c0-597b-4346-9ed3-c7b1f9b6a2ec tempest-ServicesAdminNegativeTestJSON-599861909 tempest-ServicesAdminNegativeTestJSON-599861909-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:32.182899 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c27d20c0-597b-4346-9ed3-c7b1f9b6a2ec tempest-ServicesAdminNegativeTestJSON-599861909 tempest-ServicesAdminNegativeTestJSON-599861909-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.037741 Oct 17 13:35:32.183552 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 291/589] 10.222.0.79 () {58 vars in 1170 bytes} [Mon Oct 17 13:35:32 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 949 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:32.188870 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-643d667e-77dc-4d56-8550-fca3cbd45efb req-15ee973c-5e18-4689-b03a-c5f467ff7427 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07af9912-df9b-4476-92b3-48858617dd29", "name": "network-vif-plugged", "status": "completed", "tag": "388a5339-117b-43e8-8264-a1aceb3ad3f6"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:32.201478 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-643d667e-77dc-4d56-8550-fca3cbd45efb req-15ee973c-5e18-4689-b03a-c5f467ff7427 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:32.201970 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-643d667e-77dc-4d56-8550-fca3cbd45efb req-15ee973c-5e18-4689-b03a-c5f467ff7427 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:32.202777 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-643d667e-77dc-4d56-8550-fca3cbd45efb req-15ee973c-5e18-4689-b03a-c5f467ff7427 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:32.216662 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-643d667e-77dc-4d56-8550-fca3cbd45efb req-15ee973c-5e18-4689-b03a-c5f467ff7427 service nova] Creating event network-vif-plugged:388a5339-117b-43e8-8264-a1aceb3ad3f6 for instance 07af9912-df9b-4476-92b3-48858617dd29 on n-h1-854247-14 Oct 17 13:35:32.223051 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-643d667e-77dc-4d56-8550-fca3cbd45efb req-15ee973c-5e18-4689-b03a-c5f467ff7427 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038086 Oct 17 13:35:32.223691 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 292/590] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:32.229414 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-acb6aa1b-a1e1-4b09-bfc7-b26c93447b32 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:32.230121 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-acb6aa1b-a1e1-4b09-bfc7-b26c93447b32 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 07af9912-df9b-4476-92b3-48858617dd29] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:32.243828 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-acb6aa1b-a1e1-4b09-bfc7-b26c93447b32 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:32.244313 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-acb6aa1b-a1e1-4b09-bfc7-b26c93447b32 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:32.244741 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-acb6aa1b-a1e1-4b09-bfc7-b26c93447b32 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:32.245442 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-acb6aa1b-a1e1-4b09-bfc7-b26c93447b32 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:32.245889 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-acb6aa1b-a1e1-4b09-bfc7-b26c93447b32 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:32.246307 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-acb6aa1b-a1e1-4b09-bfc7-b26c93447b32 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:32.251124 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=100 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:32.564351 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-acb6aa1b-a1e1-4b09-bfc7-b26c93447b32 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:32.572541 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-acb6aa1b-a1e1-4b09-bfc7-b26c93447b32 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/07af9912-df9b-4476-92b3-48858617dd29" status: 200 len: 1319 microversion: 2.1 time: 0.347590 Oct 17 13:35:32.573378 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 293/591] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:32 2022] GET /compute/v2.1/servers/07af9912-df9b-4476-92b3-48858617dd29 => generated 1319 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:32.577632 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2c237f37-39a6-43eb-9880-b82c6fbde1ea tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:32.578472 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2c237f37-39a6-43eb-9880-b82c6fbde1ea tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: f869f059-89c3-4462-a309-e27f650d7584] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:32.584493 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2c237f37-39a6-43eb-9880-b82c6fbde1ea tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:32.584972 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2c237f37-39a6-43eb-9880-b82c6fbde1ea tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:32.585574 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2c237f37-39a6-43eb-9880-b82c6fbde1ea tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:32.586455 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2c237f37-39a6-43eb-9880-b82c6fbde1ea tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:32.587153 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2c237f37-39a6-43eb-9880-b82c6fbde1ea tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:32.587704 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2c237f37-39a6-43eb-9880-b82c6fbde1ea tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:32.844402 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2c237f37-39a6-43eb-9880-b82c6fbde1ea tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:32.853337 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2c237f37-39a6-43eb-9880-b82c6fbde1ea tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/f869f059-89c3-4462-a309-e27f650d7584" status: 200 len: 1310 microversion: 2.1 time: 0.279038 Oct 17 13:35:32.853903 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 294/592] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:32 2022] GET /compute/v2.1/servers/f869f059-89c3-4462-a309-e27f650d7584 => generated 1310 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:32.858188 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6b234933-e6c4-45a1-8f78-b7ced6a8bb50 tempest-ServicesAdminNegativeTestJSON-599861909 tempest-ServicesAdminNegativeTestJSON-599861909-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:32.861763 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6b234933-e6c4-45a1-8f78-b7ced6a8bb50 tempest-ServicesAdminNegativeTestJSON-599861909 tempest-ServicesAdminNegativeTestJSON-599861909-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:32.862239 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6b234933-e6c4-45a1-8f78-b7ced6a8bb50 tempest-ServicesAdminNegativeTestJSON-599861909 tempest-ServicesAdminNegativeTestJSON-599861909-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:32.862664 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6b234933-e6c4-45a1-8f78-b7ced6a8bb50 tempest-ServicesAdminNegativeTestJSON-599861909 tempest-ServicesAdminNegativeTestJSON-599861909-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:32.863471 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6b234933-e6c4-45a1-8f78-b7ced6a8bb50 tempest-ServicesAdminNegativeTestJSON-599861909 tempest-ServicesAdminNegativeTestJSON-599861909-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:32.863924 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6b234933-e6c4-45a1-8f78-b7ced6a8bb50 tempest-ServicesAdminNegativeTestJSON-599861909 tempest-ServicesAdminNegativeTestJSON-599861909-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:32.864341 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6b234933-e6c4-45a1-8f78-b7ced6a8bb50 tempest-ServicesAdminNegativeTestJSON-599861909 tempest-ServicesAdminNegativeTestJSON-599861909-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:32.888975 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6b234933-e6c4-45a1-8f78-b7ced6a8bb50 tempest-ServicesAdminNegativeTestJSON-599861909 tempest-ServicesAdminNegativeTestJSON-599861909-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.034021 Oct 17 13:35:32.889553 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 295/593] 10.222.0.79 () {58 vars in 1137 bytes} [Mon Oct 17 13:35:32 2022] GET /compute/v2.1/os-services => generated 949 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:32.894621 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2bfbaa30-9300-4e1c-b633-f169c797d99f tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:32.895317 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2bfbaa30-9300-4e1c-b633-f169c797d99f tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] [instance: 88769e75-3f26-45cf-9857-3fa7fc4b478e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:32.901579 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2bfbaa30-9300-4e1c-b633-f169c797d99f tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:32.902063 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2bfbaa30-9300-4e1c-b633-f169c797d99f tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:32.902488 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2bfbaa30-9300-4e1c-b633-f169c797d99f tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:32.903215 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2bfbaa30-9300-4e1c-b633-f169c797d99f tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:32.903652 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2bfbaa30-9300-4e1c-b633-f169c797d99f tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:32.904063 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2bfbaa30-9300-4e1c-b633-f169c797d99f tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:33.155593 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2bfbaa30-9300-4e1c-b633-f169c797d99f tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a685773acdb415591f62ccee7157b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa06a29e779e413484cdfcb27e902525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:33.164071 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2bfbaa30-9300-4e1c-b633-f169c797d99f tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] 10.222.0.79 "GET /compute/v2.1/servers/88769e75-3f26-45cf-9857-3fa7fc4b478e" status: 200 len: 1322 microversion: 2.1 time: 0.272921 Oct 17 13:35:33.164894 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 296/594] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:32 2022] GET /compute/v2.1/servers/88769e75-3f26-45cf-9857-3fa7fc4b478e => generated 1322 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:33.169536 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fe3a346d-c129-4b10-86b6-1622b597647d tempest-ServicesAdminNegativeTestJSON-599861909 tempest-ServicesAdminNegativeTestJSON-599861909-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:33.173307 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe3a346d-c129-4b10-86b6-1622b597647d tempest-ServicesAdminNegativeTestJSON-599861909 tempest-ServicesAdminNegativeTestJSON-599861909-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:33.173971 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe3a346d-c129-4b10-86b6-1622b597647d tempest-ServicesAdminNegativeTestJSON-599861909 tempest-ServicesAdminNegativeTestJSON-599861909-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:33.174568 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe3a346d-c129-4b10-86b6-1622b597647d tempest-ServicesAdminNegativeTestJSON-599861909 tempest-ServicesAdminNegativeTestJSON-599861909-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:33.175654 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe3a346d-c129-4b10-86b6-1622b597647d tempest-ServicesAdminNegativeTestJSON-599861909 tempest-ServicesAdminNegativeTestJSON-599861909-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:33.176290 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe3a346d-c129-4b10-86b6-1622b597647d tempest-ServicesAdminNegativeTestJSON-599861909 tempest-ServicesAdminNegativeTestJSON-599861909-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:33.176994 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe3a346d-c129-4b10-86b6-1622b597647d tempest-ServicesAdminNegativeTestJSON-599861909 tempest-ServicesAdminNegativeTestJSON-599861909-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:33.201883 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fe3a346d-c129-4b10-86b6-1622b597647d tempest-ServicesAdminNegativeTestJSON-599861909 tempest-ServicesAdminNegativeTestJSON-599861909-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?host=n-d-854247-14&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.035724 Oct 17 13:35:33.202730 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 297/595] 10.222.0.79 () {58 vars in 1196 bytes} [Mon Oct 17 13:35:33 2022] GET /compute/v2.1/os-services?host=n-d-854247-14&binary=xxx => generated 16 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:35:33.216372 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3d0c7ab1-d088-4e69-b276-839fcd44211d tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:33.217056 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3d0c7ab1-d088-4e69-b276-839fcd44211d tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] [instance: 51be2144-e969-4e1b-b5da-c43b9a7b7c90] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:33.223325 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3d0c7ab1-d088-4e69-b276-839fcd44211d tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:33.223895 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3d0c7ab1-d088-4e69-b276-839fcd44211d tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:33.224395 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3d0c7ab1-d088-4e69-b276-839fcd44211d tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:33.225160 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3d0c7ab1-d088-4e69-b276-839fcd44211d tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:33.225751 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3d0c7ab1-d088-4e69-b276-839fcd44211d tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:33.226241 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3d0c7ab1-d088-4e69-b276-839fcd44211d tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:33.333544 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3d0c7ab1-d088-4e69-b276-839fcd44211d tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:33.342612 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3d0c7ab1-d088-4e69-b276-839fcd44211d tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:33.344160 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3d0c7ab1-d088-4e69-b276-839fcd44211d tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:33.349588 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3d0c7ab1-d088-4e69-b276-839fcd44211d tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] 10.222.0.79 "GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90" status: 200 len: 1447 microversion: 2.75 time: 0.141215 Oct 17 13:35:33.359729 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 298/596] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:35:33 2022] GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90 => generated 1447 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:35:33.359729 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1783c9ae-e63b-4779-9597-3465ab40b01b tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:33.359729 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-1783c9ae-e63b-4779-9597-3465ab40b01b tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] [instance: dd9a885e-0fb3-411a-b816-eafc93e1c5cb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:33.367111 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1783c9ae-e63b-4779-9597-3465ab40b01b tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:33.367111 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1783c9ae-e63b-4779-9597-3465ab40b01b tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:33.367111 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1783c9ae-e63b-4779-9597-3465ab40b01b tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:33.367111 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1783c9ae-e63b-4779-9597-3465ab40b01b tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:33.367531 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1783c9ae-e63b-4779-9597-3465ab40b01b tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:33.367531 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1783c9ae-e63b-4779-9597-3465ab40b01b tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:33.600988 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-1783c9ae-e63b-4779-9597-3465ab40b01b tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e836340278b49f593350249132b9cfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550b2bda88024756abc4134365842d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:33.611665 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-1c23dce3-3c18-4863-8d25-0a43dd4e5aa7 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] [instance: 3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5] Building network info cache for instance {{(pid=127017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 17 13:35:33.613653 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1783c9ae-e63b-4779-9597-3465ab40b01b tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] 10.222.0.79 "GET /compute/v2.1/servers/dd9a885e-0fb3-411a-b816-eafc93e1c5cb" status: 200 len: 1587 microversion: 2.1 time: 0.261734 Oct 17 13:35:33.635239 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 299/597] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:33 2022] GET /compute/v2.1/servers/dd9a885e-0fb3-411a-b816-eafc93e1c5cb => generated 1587 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:33.643072 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6795746e-7682-4e6c-8d6f-7d2209b7dd09 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:33.644118 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6795746e-7682-4e6c-8d6f-7d2209b7dd09 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] [instance: c47e40d5-8a51-45cc-93e5-1142c8988e5c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:33.652445 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6795746e-7682-4e6c-8d6f-7d2209b7dd09 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:33.653291 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6795746e-7682-4e6c-8d6f-7d2209b7dd09 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:33.653927 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6795746e-7682-4e6c-8d6f-7d2209b7dd09 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:33.654947 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6795746e-7682-4e6c-8d6f-7d2209b7dd09 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:33.655655 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6795746e-7682-4e6c-8d6f-7d2209b7dd09 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:33.656418 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6795746e-7682-4e6c-8d6f-7d2209b7dd09 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:33.674164 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-6795746e-7682-4e6c-8d6f-7d2209b7dd09 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] HTTP exception thrown: Instance c47e40d5-8a51-45cc-93e5-1142c8988e5c could not be found. Oct 17 13:35:33.676169 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6795746e-7682-4e6c-8d6f-7d2209b7dd09 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Request method failure captured: Oct 17 13:35:33.676169 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/c47e40d5-8a51-45cc-93e5-1142c8988e5c HTTP/1.1 Oct 17 13:35:33.676169 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:35:33.676169 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:35:33.676169 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:35:33.676169 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:35:33.676169 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:35:33.676169 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:35:33.676169 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:35:33.676169 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:35:33.676169 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVnghhr8Va4xfgEZF__nnHmc8eWfYu1T4LLgc3_J06nt1Vov6CS-XB4_ijby1AvbmiTZnaJVgA5q8XRgEqKqUbjRJ-4m9UXmcg9fq6lr4ZLGK1L_MS-5Jsy38KdGH6BBO5wLGibfmcOoOM0zuHhbF6OfAg1uNza4aWRGquuw0kPBXOA Oct 17 13:35:33.676169 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:35:33.676169 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:35:33.676169 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:35:33.676169 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:35:33.676169 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:35:33.676169 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:35:33.676169 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 0b6aa32dd3904f6aaae1e63fcc67b0f7 Oct 17 13:35:33.676169 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-DeleteServersAdminTestJSON-777083312 Oct 17 13:35:33.676169 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:35:33.676169 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:35:33.677514 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0b6aa32dd3904f6aaae1e63fcc67b0f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0b6aa32dd3904f6aaae1e63fcc67b0f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0b6aa32dd3904f6aaae1e63fcc67b0f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0b6aa32dd3904f6aaae1e63fcc67b0f7", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:35:33.677514 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-DeleteServersAdminTestJSON-777083312 Oct 17 13:35:33.677514 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 0b6aa32dd3904f6aaae1e63fcc67b0f7 Oct 17 13:35:33.677514 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-777083312 Oct 17 13:35:33.677514 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-DeleteServersAdminTestJSON-777083312-project Oct 17 13:35:33.677514 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:35:33.677514 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:35:33.677514 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: cf50aa8e899648418eace99975616e93 Oct 17 13:35:33.677514 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-DeleteServersAdminTestJSON-777083312-project Oct 17 13:35:33.677514 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:35:33.677514 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance c47e40d5-8a51-45cc-93e5-1142c8988e5c could not be found. Oct 17 13:35:33.677514 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'c47e40d5-8a51-45cc-93e5-1142c8988e5c'} Oct 17 13:35:33.678333 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:35:33.678333 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:33.678333 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:35:33.678333 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:35:33.678333 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:35:33.678333 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:35:33.678333 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:35:33.678333 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:35:33.678333 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:35:33.678333 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:35:33.678333 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c47e40d5-8a51-45cc-93e5-1142c8988e5c could not be found. Oct 17 13:35:33.678333 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:33.678333 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:35:33.678333 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:33.678333 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:33.678333 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:35:33.678333 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:35:33.678333 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:35:33.678333 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:35:33.678333 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:35:33.679495 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:35:33.679495 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:35:33.679495 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:35:33.679495 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:35:33.679495 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:35:33.679495 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:35:33.679495 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:35:33.679495 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c47e40d5-8a51-45cc-93e5-1142c8988e5c could not be found. Oct 17 13:35:33.679495 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:33.679495 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:35:33.679495 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:33.679495 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:33.679495 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:35:33.679495 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:35:33.679495 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:35:33.679495 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:35:33.679495 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c47e40d5-8a51-45cc-93e5-1142c8988e5c could not be found. Oct 17 13:35:33.679495 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:33.682913 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6795746e-7682-4e6c-8d6f-7d2209b7dd09 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Returning 404 to user: Instance c47e40d5-8a51-45cc-93e5-1142c8988e5c could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:35:33.684097 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6795746e-7682-4e6c-8d6f-7d2209b7dd09 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] 10.222.0.79 "GET /compute/v2.1/servers/c47e40d5-8a51-45cc-93e5-1142c8988e5c" status: 404 len: 111 microversion: 2.1 time: 0.046849 Oct 17 13:35:33.685215 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 300/598] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:33 2022] GET /compute/v2.1/servers/c47e40d5-8a51-45cc-93e5-1142c8988e5c => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:35:33.690482 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0629e330-5d05-40e6-ba40-7e4273d26b92 tempest-ServicesAdminNegativeTestJSON-599861909 tempest-ServicesAdminNegativeTestJSON-599861909-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:33.695990 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0629e330-5d05-40e6-ba40-7e4273d26b92 tempest-ServicesAdminNegativeTestJSON-599861909 tempest-ServicesAdminNegativeTestJSON-599861909-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:33.696701 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0629e330-5d05-40e6-ba40-7e4273d26b92 tempest-ServicesAdminNegativeTestJSON-599861909 tempest-ServicesAdminNegativeTestJSON-599861909-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:33.704914 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0629e330-5d05-40e6-ba40-7e4273d26b92 tempest-ServicesAdminNegativeTestJSON-599861909 tempest-ServicesAdminNegativeTestJSON-599861909-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:33.705696 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0629e330-5d05-40e6-ba40-7e4273d26b92 tempest-ServicesAdminNegativeTestJSON-599861909 tempest-ServicesAdminNegativeTestJSON-599861909-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:33.706161 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0629e330-5d05-40e6-ba40-7e4273d26b92 tempest-ServicesAdminNegativeTestJSON-599861909 tempest-ServicesAdminNegativeTestJSON-599861909-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:33.706576 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0629e330-5d05-40e6-ba40-7e4273d26b92 tempest-ServicesAdminNegativeTestJSON-599861909 tempest-ServicesAdminNegativeTestJSON-599861909-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:33.707040 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=54 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:33.750070 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0629e330-5d05-40e6-ba40-7e4273d26b92 tempest-ServicesAdminNegativeTestJSON-599861909 tempest-ServicesAdminNegativeTestJSON-599861909-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.063444 Oct 17 13:35:33.751159 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 301/599] 10.222.0.79 () {58 vars in 1137 bytes} [Mon Oct 17 13:35:33 2022] GET /compute/v2.1/os-services => generated 949 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:33.760125 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-129a82a5-0034-47a6-8323-2d33079d422a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:33.761256 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-129a82a5-0034-47a6-8323-2d33079d422a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 07af9912-df9b-4476-92b3-48858617dd29] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:33.767783 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-129a82a5-0034-47a6-8323-2d33079d422a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:33.768334 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-129a82a5-0034-47a6-8323-2d33079d422a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:33.768795 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-129a82a5-0034-47a6-8323-2d33079d422a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:33.769448 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-129a82a5-0034-47a6-8323-2d33079d422a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:33.770337 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-129a82a5-0034-47a6-8323-2d33079d422a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:33.770796 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-129a82a5-0034-47a6-8323-2d33079d422a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:33.981656 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-129a82a5-0034-47a6-8323-2d33079d422a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:33.994493 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-129a82a5-0034-47a6-8323-2d33079d422a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/07af9912-df9b-4476-92b3-48858617dd29" status: 200 len: 1319 microversion: 2.1 time: 0.241802 Oct 17 13:35:34.010616 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 302/600] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:33 2022] GET /compute/v2.1/servers/07af9912-df9b-4476-92b3-48858617dd29 => generated 1319 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:34.021842 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-fe7d1def-f815-4f45-95af-51b46ffedf04 req-94fb64e4-4d4e-4f6a-b60c-fb3798c114d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5", "tag": "bb330b1e-ec56-4fc5-b017-d997716bf0ba"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:34.033194 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-fe7d1def-f815-4f45-95af-51b46ffedf04 req-94fb64e4-4d4e-4f6a-b60c-fb3798c114d2 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:34.034219 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-fe7d1def-f815-4f45-95af-51b46ffedf04 req-94fb64e4-4d4e-4f6a-b60c-fb3798c114d2 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:34.034866 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-fe7d1def-f815-4f45-95af-51b46ffedf04 req-94fb64e4-4d4e-4f6a-b60c-fb3798c114d2 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:34.048803 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-fe7d1def-f815-4f45-95af-51b46ffedf04 req-94fb64e4-4d4e-4f6a-b60c-fb3798c114d2 service nova] Creating event network-changed:bb330b1e-ec56-4fc5-b017-d997716bf0ba for instance 3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5 on n-h2-854247-14 Oct 17 13:35:34.055211 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-fe7d1def-f815-4f45-95af-51b46ffedf04 req-94fb64e4-4d4e-4f6a-b60c-fb3798c114d2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042421 Oct 17 13:35:34.056047 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 303/601] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:35:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:34.063047 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b17c486a-fb9b-4b52-8075-0a9be1447fd6 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:34.064238 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b17c486a-fb9b-4b52-8075-0a9be1447fd6 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] [instance: dd9a885e-0fb3-411a-b816-eafc93e1c5cb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:34.073344 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b17c486a-fb9b-4b52-8075-0a9be1447fd6 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:34.073833 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b17c486a-fb9b-4b52-8075-0a9be1447fd6 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:34.074795 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b17c486a-fb9b-4b52-8075-0a9be1447fd6 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:34.075542 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b17c486a-fb9b-4b52-8075-0a9be1447fd6 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:34.075995 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b17c486a-fb9b-4b52-8075-0a9be1447fd6 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:34.077109 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b17c486a-fb9b-4b52-8075-0a9be1447fd6 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:34.226740 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b17c486a-fb9b-4b52-8075-0a9be1447fd6 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] 10.222.0.79 "GET /compute/v2.1/servers/dd9a885e-0fb3-411a-b816-eafc93e1c5cb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.161316 Oct 17 13:35:34.242395 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 304/602] 10.222.0.79 () {58 vars in 1275 bytes} [Mon Oct 17 13:35:34 2022] GET /compute/v2.1/servers/dd9a885e-0fb3-411a-b816-eafc93e1c5cb/os-interface => generated 284 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:34.253124 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-000199ab-a95e-451a-a37d-c3bd5f6c28c0 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:34.253640 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-000199ab-a95e-451a-a37d-c3bd5f6c28c0 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] [instance: c47e40d5-8a51-45cc-93e5-1142c8988e5c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:34.264625 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-000199ab-a95e-451a-a37d-c3bd5f6c28c0 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:34.265116 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-000199ab-a95e-451a-a37d-c3bd5f6c28c0 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:34.266013 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-000199ab-a95e-451a-a37d-c3bd5f6c28c0 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:34.266756 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-000199ab-a95e-451a-a37d-c3bd5f6c28c0 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:34.267230 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-000199ab-a95e-451a-a37d-c3bd5f6c28c0 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:34.267653 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-000199ab-a95e-451a-a37d-c3bd5f6c28c0 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:34.291442 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-000199ab-a95e-451a-a37d-c3bd5f6c28c0 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] HTTP exception thrown: Instance c47e40d5-8a51-45cc-93e5-1142c8988e5c could not be found. Oct 17 13:35:34.294707 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-000199ab-a95e-451a-a37d-c3bd5f6c28c0 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Request method failure captured: Oct 17 13:35:34.294707 n-d-854247-14 devstack@n-api.service[127016]: request: DELETE /compute/v2.1/servers/c47e40d5-8a51-45cc-93e5-1142c8988e5c HTTP/1.1 Oct 17 13:35:34.294707 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:35:34.294707 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:35:34.294707 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:35:34.294707 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:35:34.294707 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:35:34.294707 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:35:34.294707 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:35:34.294707 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:35:34.294707 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVnghhr8Va4xfgEZF__nnHmc8eWfYu1T4LLgc3_J06nt1Vov6CS-XB4_ijby1AvbmiTZnaJVgA5q8XRgEqKqUbjRJ-4m9UXmcg9fq6lr4ZLGK1L_MS-5Jsy38KdGH6BBO5wLGibfmcOoOM0zuHhbF6OfAg1uNza4aWRGquuw0kPBXOA Oct 17 13:35:34.294707 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:35:34.294707 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:35:34.294707 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:35:34.294707 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:35:34.294707 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:35:34.294707 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:35:34.294707 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 0b6aa32dd3904f6aaae1e63fcc67b0f7 Oct 17 13:35:34.294707 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-DeleteServersAdminTestJSON-777083312 Oct 17 13:35:34.294707 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:35:34.294707 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:35:34.296061 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0b6aa32dd3904f6aaae1e63fcc67b0f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0b6aa32dd3904f6aaae1e63fcc67b0f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0b6aa32dd3904f6aaae1e63fcc67b0f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0b6aa32dd3904f6aaae1e63fcc67b0f7", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:35:34.296061 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-DeleteServersAdminTestJSON-777083312 Oct 17 13:35:34.296061 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 0b6aa32dd3904f6aaae1e63fcc67b0f7 Oct 17 13:35:34.296061 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-777083312 Oct 17 13:35:34.296061 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-DeleteServersAdminTestJSON-777083312-project Oct 17 13:35:34.296061 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:35:34.296061 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:35:34.296061 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: cf50aa8e899648418eace99975616e93 Oct 17 13:35:34.296061 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-DeleteServersAdminTestJSON-777083312-project Oct 17 13:35:34.296061 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:35:34.296061 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance c47e40d5-8a51-45cc-93e5-1142c8988e5c could not be found. Oct 17 13:35:34.296061 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'c47e40d5-8a51-45cc-93e5-1142c8988e5c'} Oct 17 13:35:34.296746 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:35:34.296746 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:34.296746 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:35:34.296746 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:35:34.296746 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:35:34.296746 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:35:34.296746 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:35:34.296746 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:35:34.296746 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:35:34.296746 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:35:34.296746 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c47e40d5-8a51-45cc-93e5-1142c8988e5c could not be found. Oct 17 13:35:34.296746 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:34.296746 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:35:34.296746 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:34.296746 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:34.296746 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:35:34.296746 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:35:34.296746 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:35:34.296746 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:35:34.296746 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:35:34.297943 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:35:34.297943 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:35:34.297943 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:35:34.297943 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:35:34.297943 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:35:34.297943 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:35:34.297943 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:35:34.297943 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:35:34.297943 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:35:34.297943 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c47e40d5-8a51-45cc-93e5-1142c8988e5c could not be found. Oct 17 13:35:34.297943 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:34.297943 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:35:34.297943 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:34.297943 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:34.297943 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:35:34.297943 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:35:34.297943 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:35:34.297943 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:35:34.297943 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c47e40d5-8a51-45cc-93e5-1142c8988e5c could not be found. Oct 17 13:35:34.297943 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:34.299211 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-000199ab-a95e-451a-a37d-c3bd5f6c28c0 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Returning 404 to user: Instance c47e40d5-8a51-45cc-93e5-1142c8988e5c could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:35:34.299211 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-000199ab-a95e-451a-a37d-c3bd5f6c28c0 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c47e40d5-8a51-45cc-93e5-1142c8988e5c" status: 404 len: 111 microversion: 2.1 time: 0.050654 Oct 17 13:35:34.299362 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-1c23dce3-3c18-4863-8d25-0a43dd4e5aa7 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] [instance: 3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5] Updating instance_info_cache with network_info: [{"id": "bb330b1e-ec56-4fc5-b017-d997716bf0ba", "address": "fa:16:3e:79:72:88", "network": {"id": "95833473-af23-4ef3-b861-8a8f3e383e0c", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1583976845-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.0.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "bc31d4fa0cd9418584f52e7c46ade866", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapbb330b1e-ec", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 17 13:35:34.310693 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 305/603] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:35:34 2022] DELETE /compute/v2.1/servers/c47e40d5-8a51-45cc-93e5-1142c8988e5c => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:35:34.317135 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1fc096ba-ed16-498e-8d62-b5834667d970 tempest-ServicesAdminNegativeTestJSON-599861909 tempest-ServicesAdminNegativeTestJSON-599861909-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:34.319828 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c23dce3-3c18-4863-8d25-0a43dd4e5aa7 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Releasing lock "refresh_cache-3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5" {{(pid=127017) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 17 13:35:34.321263 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1c23dce3-3c18-4863-8d25-0a43dd4e5aa7 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] 10.222.0.79 "POST /compute/v2.1/servers/3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5/action" status: 202 len: 0 microversion: 2.1 time: 2.312091 Oct 17 13:35:34.322181 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 299/604] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:35:32 2022] POST /compute/v2.1/servers/3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5/action => generated 0 bytes in 2314 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 17 13:35:34.329377 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1fc096ba-ed16-498e-8d62-b5834667d970 tempest-ServicesAdminNegativeTestJSON-599861909 tempest-ServicesAdminNegativeTestJSON-599861909-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:34.329945 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1fc096ba-ed16-498e-8d62-b5834667d970 tempest-ServicesAdminNegativeTestJSON-599861909 tempest-ServicesAdminNegativeTestJSON-599861909-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:34.330514 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1fc096ba-ed16-498e-8d62-b5834667d970 tempest-ServicesAdminNegativeTestJSON-599861909 tempest-ServicesAdminNegativeTestJSON-599861909-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:34.330630 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-257d3456-6b3d-4208-b2f4-9859708bca04 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:34.331191 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-257d3456-6b3d-4208-b2f4-9859708bca04 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: f869f059-89c3-4462-a309-e27f650d7584] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:34.331797 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1fc096ba-ed16-498e-8d62-b5834667d970 tempest-ServicesAdminNegativeTestJSON-599861909 tempest-ServicesAdminNegativeTestJSON-599861909-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:34.333215 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1fc096ba-ed16-498e-8d62-b5834667d970 tempest-ServicesAdminNegativeTestJSON-599861909 tempest-ServicesAdminNegativeTestJSON-599861909-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:34.333215 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1fc096ba-ed16-498e-8d62-b5834667d970 tempest-ServicesAdminNegativeTestJSON-599861909 tempest-ServicesAdminNegativeTestJSON-599861909-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:34.338443 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-257d3456-6b3d-4208-b2f4-9859708bca04 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:34.339144 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-257d3456-6b3d-4208-b2f4-9859708bca04 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:34.340707 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-257d3456-6b3d-4208-b2f4-9859708bca04 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:34.341626 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-257d3456-6b3d-4208-b2f4-9859708bca04 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:34.342235 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-257d3456-6b3d-4208-b2f4-9859708bca04 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:34.343300 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-257d3456-6b3d-4208-b2f4-9859708bca04 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:34.367868 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1fc096ba-ed16-498e-8d62-b5834667d970 tempest-ServicesAdminNegativeTestJSON-599861909 tempest-ServicesAdminNegativeTestJSON-599861909-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.057615 Oct 17 13:35:34.369033 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 306/605] 10.222.0.79 () {58 vars in 1198 bytes} [Mon Oct 17 13:35:34 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:35:34.376205 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4b20c3c4-9515-4eaa-8de9-93448319c4bc tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:34.377237 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4b20c3c4-9515-4eaa-8de9-93448319c4bc tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] [instance: 88769e75-3f26-45cf-9857-3fa7fc4b478e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:34.397387 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4b20c3c4-9515-4eaa-8de9-93448319c4bc tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:34.398887 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4b20c3c4-9515-4eaa-8de9-93448319c4bc tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:34.399687 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4b20c3c4-9515-4eaa-8de9-93448319c4bc tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:34.401457 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4b20c3c4-9515-4eaa-8de9-93448319c4bc tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:34.402073 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4b20c3c4-9515-4eaa-8de9-93448319c4bc tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:34.402706 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4b20c3c4-9515-4eaa-8de9-93448319c4bc tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:34.540799 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-257d3456-6b3d-4208-b2f4-9859708bca04 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:34.550757 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-257d3456-6b3d-4208-b2f4-9859708bca04 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/f869f059-89c3-4462-a309-e27f650d7584" status: 200 len: 1310 microversion: 2.1 time: 0.224036 Oct 17 13:35:34.551412 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 300/606] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:34 2022] GET /compute/v2.1/servers/f869f059-89c3-4462-a309-e27f650d7584 => generated 1310 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:34.571783 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-170eae25-7c67-44c5-81e2-f80c535b7948 req-522c5992-dc3a-4d98-b863-143d9e380866 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f869f059-89c3-4462-a309-e27f650d7584", "name": "network-vif-plugged", "status": "completed", "tag": "b4a014a2-f1ca-4513-9531-01b335adbbcb"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:34.585727 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-170eae25-7c67-44c5-81e2-f80c535b7948 req-522c5992-dc3a-4d98-b863-143d9e380866 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:34.586208 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-170eae25-7c67-44c5-81e2-f80c535b7948 req-522c5992-dc3a-4d98-b863-143d9e380866 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:34.586772 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-170eae25-7c67-44c5-81e2-f80c535b7948 req-522c5992-dc3a-4d98-b863-143d9e380866 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:34.604366 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-170eae25-7c67-44c5-81e2-f80c535b7948 req-522c5992-dc3a-4d98-b863-143d9e380866 service nova] Creating event network-vif-plugged:b4a014a2-f1ca-4513-9531-01b335adbbcb for instance f869f059-89c3-4462-a309-e27f650d7584 on n-h1-854247-14 Oct 17 13:35:34.609556 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-170eae25-7c67-44c5-81e2-f80c535b7948 req-522c5992-dc3a-4d98-b863-143d9e380866 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056704 Oct 17 13:35:34.615094 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 301/607] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:35:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:34.624480 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b2051875-e4af-4a4b-9c12-a9bf58c7d691 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:34.624834 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4b20c3c4-9515-4eaa-8de9-93448319c4bc tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a685773acdb415591f62ccee7157b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa06a29e779e413484cdfcb27e902525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:34.625208 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b2051875-e4af-4a4b-9c12-a9bf58c7d691 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] [instance: c47e40d5-8a51-45cc-93e5-1142c8988e5c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:34.633548 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4b20c3c4-9515-4eaa-8de9-93448319c4bc tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] 10.222.0.79 "GET /compute/v2.1/servers/88769e75-3f26-45cf-9857-3fa7fc4b478e" status: 200 len: 1322 microversion: 2.1 time: 0.263273 Oct 17 13:35:34.634382 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 307/608] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:34 2022] GET /compute/v2.1/servers/88769e75-3f26-45cf-9857-3fa7fc4b478e => generated 1322 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:34.634616 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b2051875-e4af-4a4b-9c12-a9bf58c7d691 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:34.635413 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b2051875-e4af-4a4b-9c12-a9bf58c7d691 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:34.636021 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b2051875-e4af-4a4b-9c12-a9bf58c7d691 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:34.636733 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b2051875-e4af-4a4b-9c12-a9bf58c7d691 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:34.637185 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b2051875-e4af-4a4b-9c12-a9bf58c7d691 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:34.637613 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b2051875-e4af-4a4b-9c12-a9bf58c7d691 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:34.653266 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-b2051875-e4af-4a4b-9c12-a9bf58c7d691 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] HTTP exception thrown: Instance c47e40d5-8a51-45cc-93e5-1142c8988e5c could not be found. Oct 17 13:35:34.654960 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b2051875-e4af-4a4b-9c12-a9bf58c7d691 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Request method failure captured: Oct 17 13:35:34.654960 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/c47e40d5-8a51-45cc-93e5-1142c8988e5c HTTP/1.1 Oct 17 13:35:34.654960 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:35:34.654960 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:35:34.654960 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:35:34.654960 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:35:34.654960 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:35:34.654960 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:35:34.654960 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:35:34.654960 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:35:34.654960 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVnghhr8Va4xfgEZF__nnHmc8eWfYu1T4LLgc3_J06nt1Vov6CS-XB4_ijby1AvbmiTZnaJVgA5q8XRgEqKqUbjRJ-4m9UXmcg9fq6lr4ZLGK1L_MS-5Jsy38KdGH6BBO5wLGibfmcOoOM0zuHhbF6OfAg1uNza4aWRGquuw0kPBXOA Oct 17 13:35:34.654960 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:35:34.654960 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:35:34.654960 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:35:34.654960 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:35:34.654960 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:35:34.654960 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:35:34.654960 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 0b6aa32dd3904f6aaae1e63fcc67b0f7 Oct 17 13:35:34.654960 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-DeleteServersAdminTestJSON-777083312 Oct 17 13:35:34.654960 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:35:34.654960 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:35:34.656352 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0b6aa32dd3904f6aaae1e63fcc67b0f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0b6aa32dd3904f6aaae1e63fcc67b0f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0b6aa32dd3904f6aaae1e63fcc67b0f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0b6aa32dd3904f6aaae1e63fcc67b0f7", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:35:34.656352 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-DeleteServersAdminTestJSON-777083312 Oct 17 13:35:34.656352 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 0b6aa32dd3904f6aaae1e63fcc67b0f7 Oct 17 13:35:34.656352 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-777083312 Oct 17 13:35:34.656352 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-DeleteServersAdminTestJSON-777083312-project Oct 17 13:35:34.656352 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:35:34.656352 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:35:34.656352 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: cf50aa8e899648418eace99975616e93 Oct 17 13:35:34.656352 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-DeleteServersAdminTestJSON-777083312-project Oct 17 13:35:34.656352 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:35:34.656352 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance c47e40d5-8a51-45cc-93e5-1142c8988e5c could not be found. Oct 17 13:35:34.656352 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'c47e40d5-8a51-45cc-93e5-1142c8988e5c'} Oct 17 13:35:34.657102 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:35:34.657102 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:34.657102 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:35:34.657102 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:35:34.657102 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:35:34.657102 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:35:34.657102 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:35:34.657102 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:35:34.657102 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:35:34.657102 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:35:34.657102 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c47e40d5-8a51-45cc-93e5-1142c8988e5c could not be found. Oct 17 13:35:34.657102 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:34.657102 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:35:34.657102 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:34.657102 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:34.657102 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:35:34.657102 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:35:34.657102 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:35:34.657102 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:35:34.657102 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:35:34.658265 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:35:34.658265 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:35:34.658265 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:35:34.658265 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:35:34.658265 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:35:34.658265 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:35:34.658265 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:35:34.658265 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c47e40d5-8a51-45cc-93e5-1142c8988e5c could not be found. Oct 17 13:35:34.658265 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:34.658265 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:35:34.658265 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:34.658265 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:34.658265 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:35:34.658265 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:35:34.658265 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:35:34.658265 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:35:34.658265 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c47e40d5-8a51-45cc-93e5-1142c8988e5c could not be found. Oct 17 13:35:34.658265 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:34.661355 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b2051875-e4af-4a4b-9c12-a9bf58c7d691 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Returning 404 to user: Instance c47e40d5-8a51-45cc-93e5-1142c8988e5c could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:35:34.661355 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b2051875-e4af-4a4b-9c12-a9bf58c7d691 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] 10.222.0.79 "GET /compute/v2.1/servers/c47e40d5-8a51-45cc-93e5-1142c8988e5c" status: 404 len: 111 microversion: 2.1 time: 0.039488 Oct 17 13:35:34.661355 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 302/609] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:34 2022] GET /compute/v2.1/servers/c47e40d5-8a51-45cc-93e5-1142c8988e5c => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:35:34.666817 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-809d26be-941b-4b26-af6f-7c9c2a0b5ea7 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Action: 'create', calling method: .version_select at 0x7f7cd5bcb430>, body: {"pool": "21df306d-9b14-4323-a3b6-31e46566b626"} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:34.669471 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d3e4870c-0b8d-4723-b413-6845701aaa56 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:34.670088 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d3e4870c-0b8d-4723-b413-6845701aaa56 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] [instance: 51be2144-e969-4e1b-b5da-c43b9a7b7c90] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:34.683195 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d3e4870c-0b8d-4723-b413-6845701aaa56 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:34.684368 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d3e4870c-0b8d-4723-b413-6845701aaa56 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:34.684804 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d3e4870c-0b8d-4723-b413-6845701aaa56 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:34.685798 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d3e4870c-0b8d-4723-b413-6845701aaa56 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:34.686255 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d3e4870c-0b8d-4723-b413-6845701aaa56 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:34.686673 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d3e4870c-0b8d-4723-b413-6845701aaa56 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:35.103158 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d3e4870c-0b8d-4723-b413-6845701aaa56 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:35.128003 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d3e4870c-0b8d-4723-b413-6845701aaa56 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:35.131268 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d3e4870c-0b8d-4723-b413-6845701aaa56 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:35.139721 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d3e4870c-0b8d-4723-b413-6845701aaa56 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] 10.222.0.79 "GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90" status: 200 len: 1447 microversion: 2.75 time: 0.474562 Oct 17 13:35:35.148256 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 308/610] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:35:34 2022] GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90 => generated 1447 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:35:35.288049 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-23dc5924-e157-4c22-9c80-99a57d415a2e tempest-ServicesAdminNegativeTestJSON-1063516406 tempest-ServicesAdminNegativeTestJSON-1063516406-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:35.292241 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-23dc5924-e157-4c22-9c80-99a57d415a2e tempest-ServicesAdminNegativeTestJSON-1063516406 tempest-ServicesAdminNegativeTestJSON-1063516406-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '16d5432135944fa3935aa5f97c63fc9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06cf914e4d824d36b8e9f8ce800252e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:35.294432 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-23dc5924-e157-4c22-9c80-99a57d415a2e tempest-ServicesAdminNegativeTestJSON-1063516406 tempest-ServicesAdminNegativeTestJSON-1063516406-project] Request method failure captured: Oct 17 13:35:35.294432 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 17 13:35:35.294432 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:35:35.294432 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:35:35.294432 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:35:35.294432 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:35:35.294432 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:35:35.294432 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:35:35.294432 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:35:35.294432 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:35:35.294432 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVohIZ77oj0JFxmqa_GCLcnJRKzxYNCSSYOKuxL-LFvZiuN2WigF8wWJw7jfudUNC1NToIBkH0YI0WyWs6U9ehEVdn_9utbEiXBD2IXr50ztHOwXk-bxr5QWoJDlXe0EXLZIABlNWyWyvGrSuAbBIP7Zzhsdw_VLslEDHhkDQ9--i7o Oct 17 13:35:35.294432 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:35:35.294432 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:35:35.294432 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:35:35.294432 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:35:35.294432 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:35:35.294432 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:35:35.294432 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 06cf914e4d824d36b8e9f8ce800252e6 Oct 17 13:35:35.294432 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1063516406 Oct 17 13:35:35.294432 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:35:35.294432 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:35:35.295957 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/06cf914e4d824d36b8e9f8ce800252e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/06cf914e4d824d36b8e9f8ce800252e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/06cf914e4d824d36b8e9f8ce800252e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_06cf914e4d824d36b8e9f8ce800252e6", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:35:35.295957 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1063516406 Oct 17 13:35:35.295957 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 06cf914e4d824d36b8e9f8ce800252e6 Oct 17 13:35:35.295957 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1063516406 Oct 17 13:35:35.295957 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServicesAdminNegativeTestJSON-1063516406-project Oct 17 13:35:35.295957 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:35:35.295957 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:35:35.295957 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 16d5432135944fa3935aa5f97c63fc9c Oct 17 13:35:35.295957 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1063516406-project Oct 17 13:35:35.295957 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:35:35.295957 n-d-854247-14 devstack@n-api.service[127016]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 17 13:35:35.295957 n-d-854247-14 devstack@n-api.service[127016]: action_args: {} Oct 17 13:35:35.296815 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:35:35.296815 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:35.296815 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:35:35.296815 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:35:35.296815 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:35:35.296815 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:35:35.296815 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 13:35:35.296815 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:35:35.296815 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 13:35:35.296815 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:35:35.296815 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:35:35.296815 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:35:35.296815 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 17 13:35:35.296815 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 17 13:35:35.296815 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:35:35.296815 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:35:35.296815 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:35:35.296815 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:35:35.296815 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:35:35.298188 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:35:35.298188 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:35:35.298188 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:35:35.298188 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:35:35.298188 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:35:35.298188 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:35:35.298188 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:35:35.298188 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:35:35.298188 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:35:35.298188 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 17 13:35:35.298188 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:35.298188 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:35:35.298188 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:35.298188 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:35.298188 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:35:35.298188 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:35:35.298188 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:35:35.298188 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:35:35.298188 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 17 13:35:35.298188 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:35.300514 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-23dc5924-e157-4c22-9c80-99a57d415a2e tempest-ServicesAdminNegativeTestJSON-1063516406 tempest-ServicesAdminNegativeTestJSON-1063516406-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:35:35.301520 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-23dc5924-e157-4c22-9c80-99a57d415a2e tempest-ServicesAdminNegativeTestJSON-1063516406 tempest-ServicesAdminNegativeTestJSON-1063516406-project] 10.222.0.79 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.152151 Oct 17 13:35:35.302592 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 309/611] 10.222.0.79 () {58 vars in 1137 bytes} [Mon Oct 17 13:35:35 2022] GET /compute/v2.1/os-services => generated 112 bytes in 154 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:35:35.318455 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-dfdb0271-d812-4ead-9031-0fa68a901fc9 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:35.324333 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-dfdb0271-d812-4ead-9031-0fa68a901fc9 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] [instance: 0b3dc4f1-f80f-427f-908e-9272cd17af3b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:35.342933 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dfdb0271-d812-4ead-9031-0fa68a901fc9 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:35.343893 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dfdb0271-d812-4ead-9031-0fa68a901fc9 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:35.344524 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dfdb0271-d812-4ead-9031-0fa68a901fc9 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:35.345450 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dfdb0271-d812-4ead-9031-0fa68a901fc9 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:35.347700 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dfdb0271-d812-4ead-9031-0fa68a901fc9 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:35.348417 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dfdb0271-d812-4ead-9031-0fa68a901fc9 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:35.378042 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-dfdb0271-d812-4ead-9031-0fa68a901fc9 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] HTTP exception thrown: Instance 0b3dc4f1-f80f-427f-908e-9272cd17af3b could not be found. Oct 17 13:35:35.383235 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-dfdb0271-d812-4ead-9031-0fa68a901fc9 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Request method failure captured: Oct 17 13:35:35.383235 n-d-854247-14 devstack@n-api.service[127016]: request: DELETE /compute/v2.1/servers/0b3dc4f1-f80f-427f-908e-9272cd17af3b HTTP/1.1 Oct 17 13:35:35.383235 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:35:35.383235 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:35:35.383235 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:35:35.383235 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:35:35.383235 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:35:35.383235 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:35:35.383235 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:35:35.383235 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:35:35.383235 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVnghhr8Va4xfgEZF__nnHmc8eWfYu1T4LLgc3_J06nt1Vov6CS-XB4_ijby1AvbmiTZnaJVgA5q8XRgEqKqUbjRJ-4m9UXmcg9fq6lr4ZLGK1L_MS-5Jsy38KdGH6BBO5wLGibfmcOoOM0zuHhbF6OfAg1uNza4aWRGquuw0kPBXOA Oct 17 13:35:35.383235 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:35:35.383235 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:35:35.383235 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:35:35.383235 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:35:35.383235 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:35:35.383235 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:35:35.383235 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 0b6aa32dd3904f6aaae1e63fcc67b0f7 Oct 17 13:35:35.383235 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-DeleteServersAdminTestJSON-777083312 Oct 17 13:35:35.383235 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:35:35.383235 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:35:35.385270 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0b6aa32dd3904f6aaae1e63fcc67b0f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0b6aa32dd3904f6aaae1e63fcc67b0f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0b6aa32dd3904f6aaae1e63fcc67b0f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0b6aa32dd3904f6aaae1e63fcc67b0f7", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:35:35.385270 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-DeleteServersAdminTestJSON-777083312 Oct 17 13:35:35.385270 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 0b6aa32dd3904f6aaae1e63fcc67b0f7 Oct 17 13:35:35.385270 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-777083312 Oct 17 13:35:35.385270 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-DeleteServersAdminTestJSON-777083312-project Oct 17 13:35:35.385270 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:35:35.385270 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:35:35.385270 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: cf50aa8e899648418eace99975616e93 Oct 17 13:35:35.385270 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-DeleteServersAdminTestJSON-777083312-project Oct 17 13:35:35.385270 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:35:35.385270 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 0b3dc4f1-f80f-427f-908e-9272cd17af3b could not be found. Oct 17 13:35:35.385270 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '0b3dc4f1-f80f-427f-908e-9272cd17af3b'} Oct 17 13:35:35.386101 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:35:35.386101 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:35.386101 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:35:35.386101 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:35:35.386101 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:35:35.386101 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:35:35.386101 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:35:35.386101 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:35:35.386101 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:35:35.386101 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:35:35.386101 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b3dc4f1-f80f-427f-908e-9272cd17af3b could not be found. Oct 17 13:35:35.386101 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:35.386101 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:35:35.386101 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:35.386101 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:35.386101 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:35:35.386101 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:35:35.386101 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:35:35.386101 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:35:35.386101 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:35:35.387326 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:35:35.387326 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:35:35.387326 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:35:35.387326 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:35:35.387326 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:35:35.387326 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:35:35.387326 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:35:35.387326 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:35:35.387326 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:35:35.387326 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b3dc4f1-f80f-427f-908e-9272cd17af3b could not be found. Oct 17 13:35:35.387326 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:35.387326 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:35:35.387326 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:35.387326 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:35.387326 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:35:35.387326 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:35:35.387326 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:35:35.387326 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:35:35.387326 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b3dc4f1-f80f-427f-908e-9272cd17af3b could not be found. Oct 17 13:35:35.387326 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:35.391872 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-dfdb0271-d812-4ead-9031-0fa68a901fc9 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Returning 404 to user: Instance 0b3dc4f1-f80f-427f-908e-9272cd17af3b could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:35:35.393712 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-dfdb0271-d812-4ead-9031-0fa68a901fc9 tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] 10.222.0.79 "DELETE /compute/v2.1/servers/0b3dc4f1-f80f-427f-908e-9272cd17af3b" status: 404 len: 111 microversion: 2.1 time: 0.089833 Oct 17 13:35:35.395368 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 310/612] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:35:35 2022] DELETE /compute/v2.1/servers/0b3dc4f1-f80f-427f-908e-9272cd17af3b => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:35:35.404874 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a2bad60a-626b-42c8-a7d1-23c2f4dabd56 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:35.406022 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a2bad60a-626b-42c8-a7d1-23c2f4dabd56 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 07af9912-df9b-4476-92b3-48858617dd29] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:35.416263 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a2bad60a-626b-42c8-a7d1-23c2f4dabd56 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:35.417178 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a2bad60a-626b-42c8-a7d1-23c2f4dabd56 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:35.417941 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a2bad60a-626b-42c8-a7d1-23c2f4dabd56 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:35.418809 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a2bad60a-626b-42c8-a7d1-23c2f4dabd56 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:35.420715 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a2bad60a-626b-42c8-a7d1-23c2f4dabd56 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:35.421160 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a2bad60a-626b-42c8-a7d1-23c2f4dabd56 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:35.662973 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a2bad60a-626b-42c8-a7d1-23c2f4dabd56 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:35.672537 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a2bad60a-626b-42c8-a7d1-23c2f4dabd56 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/07af9912-df9b-4476-92b3-48858617dd29" status: 200 len: 1469 microversion: 2.1 time: 0.275746 Oct 17 13:35:35.682897 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 311/613] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:35 2022] GET /compute/v2.1/servers/07af9912-df9b-4476-92b3-48858617dd29 => generated 1469 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:35.682897 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-832e7322-42c3-40e1-b096-f0c7421c1eee tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:35.682897 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-832e7322-42c3-40e1-b096-f0c7421c1eee tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] [instance: 0b3dc4f1-f80f-427f-908e-9272cd17af3b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:35.682897 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=100 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:35.686263 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-832e7322-42c3-40e1-b096-f0c7421c1eee tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:35.687092 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-832e7322-42c3-40e1-b096-f0c7421c1eee tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:35.687951 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-832e7322-42c3-40e1-b096-f0c7421c1eee tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:35.688173 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-832e7322-42c3-40e1-b096-f0c7421c1eee tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:35.688619 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-832e7322-42c3-40e1-b096-f0c7421c1eee tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:35.689037 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-832e7322-42c3-40e1-b096-f0c7421c1eee tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:35.710610 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-832e7322-42c3-40e1-b096-f0c7421c1eee tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] HTTP exception thrown: Instance 0b3dc4f1-f80f-427f-908e-9272cd17af3b could not be found. Oct 17 13:35:35.712772 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-832e7322-42c3-40e1-b096-f0c7421c1eee tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Request method failure captured: Oct 17 13:35:35.712772 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/0b3dc4f1-f80f-427f-908e-9272cd17af3b HTTP/1.1 Oct 17 13:35:35.712772 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:35:35.712772 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:35:35.712772 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:35:35.712772 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:35:35.712772 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:35:35.712772 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:35:35.712772 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:35:35.712772 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:35:35.712772 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVnghhr8Va4xfgEZF__nnHmc8eWfYu1T4LLgc3_J06nt1Vov6CS-XB4_ijby1AvbmiTZnaJVgA5q8XRgEqKqUbjRJ-4m9UXmcg9fq6lr4ZLGK1L_MS-5Jsy38KdGH6BBO5wLGibfmcOoOM0zuHhbF6OfAg1uNza4aWRGquuw0kPBXOA Oct 17 13:35:35.712772 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:35:35.712772 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:35:35.712772 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:35:35.712772 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:35:35.712772 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:35:35.712772 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:35:35.712772 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 0b6aa32dd3904f6aaae1e63fcc67b0f7 Oct 17 13:35:35.712772 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-DeleteServersAdminTestJSON-777083312 Oct 17 13:35:35.712772 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:35:35.712772 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:35:35.714566 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0b6aa32dd3904f6aaae1e63fcc67b0f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0b6aa32dd3904f6aaae1e63fcc67b0f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0b6aa32dd3904f6aaae1e63fcc67b0f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0b6aa32dd3904f6aaae1e63fcc67b0f7", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:35:35.714566 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-DeleteServersAdminTestJSON-777083312 Oct 17 13:35:35.714566 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 0b6aa32dd3904f6aaae1e63fcc67b0f7 Oct 17 13:35:35.714566 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-777083312 Oct 17 13:35:35.714566 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-DeleteServersAdminTestJSON-777083312-project Oct 17 13:35:35.714566 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:35:35.714566 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:35:35.714566 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: cf50aa8e899648418eace99975616e93 Oct 17 13:35:35.714566 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-DeleteServersAdminTestJSON-777083312-project Oct 17 13:35:35.714566 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:35:35.714566 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 0b3dc4f1-f80f-427f-908e-9272cd17af3b could not be found. Oct 17 13:35:35.714566 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '0b3dc4f1-f80f-427f-908e-9272cd17af3b'} Oct 17 13:35:35.715358 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:35:35.715358 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:35.715358 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:35:35.715358 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:35:35.715358 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:35:35.715358 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:35:35.715358 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:35:35.715358 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:35:35.715358 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:35:35.715358 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:35:35.715358 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b3dc4f1-f80f-427f-908e-9272cd17af3b could not be found. Oct 17 13:35:35.715358 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:35.715358 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:35:35.715358 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:35.715358 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:35.715358 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:35:35.715358 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:35:35.715358 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:35:35.715358 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:35:35.715358 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:35:35.716831 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:35:35.716831 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:35:35.716831 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:35:35.716831 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:35:35.716831 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:35:35.716831 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:35:35.716831 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:35:35.716831 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b3dc4f1-f80f-427f-908e-9272cd17af3b could not be found. Oct 17 13:35:35.716831 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:35.716831 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:35:35.716831 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:35.716831 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:35.716831 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:35:35.716831 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:35:35.716831 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:35:35.716831 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:35:35.716831 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b3dc4f1-f80f-427f-908e-9272cd17af3b could not be found. Oct 17 13:35:35.716831 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:35.717853 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-832e7322-42c3-40e1-b096-f0c7421c1eee tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] Returning 404 to user: Instance 0b3dc4f1-f80f-427f-908e-9272cd17af3b could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:35:35.717853 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-832e7322-42c3-40e1-b096-f0c7421c1eee tempest-DeleteServersAdminTestJSON-777083312 tempest-DeleteServersAdminTestJSON-777083312-project] 10.222.0.79 "GET /compute/v2.1/servers/0b3dc4f1-f80f-427f-908e-9272cd17af3b" status: 404 len: 111 microversion: 2.1 time: 0.039749 Oct 17 13:35:35.718771 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 312/614] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:35 2022] GET /compute/v2.1/servers/0b3dc4f1-f80f-427f-908e-9272cd17af3b => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:35:35.723596 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f88ace1e-3cc9-4ba9-9fbd-e47e80d42581 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:35.724197 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f88ace1e-3cc9-4ba9-9fbd-e47e80d42581 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: f869f059-89c3-4462-a309-e27f650d7584] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:35.730794 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f88ace1e-3cc9-4ba9-9fbd-e47e80d42581 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:35.731303 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f88ace1e-3cc9-4ba9-9fbd-e47e80d42581 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:35.731727 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f88ace1e-3cc9-4ba9-9fbd-e47e80d42581 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:35.732422 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f88ace1e-3cc9-4ba9-9fbd-e47e80d42581 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:35.733044 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f88ace1e-3cc9-4ba9-9fbd-e47e80d42581 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:35.733462 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f88ace1e-3cc9-4ba9-9fbd-e47e80d42581 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:36.091712 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f88ace1e-3cc9-4ba9-9fbd-e47e80d42581 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:36.104030 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f88ace1e-3cc9-4ba9-9fbd-e47e80d42581 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/f869f059-89c3-4462-a309-e27f650d7584" status: 200 len: 1310 microversion: 2.1 time: 0.384125 Oct 17 13:35:36.120073 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 313/615] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:35 2022] GET /compute/v2.1/servers/f869f059-89c3-4462-a309-e27f650d7584 => generated 1310 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:36.126444 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ee693674-d9bb-4e58-9908-861a26c201d5 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:36.127522 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ee693674-d9bb-4e58-9908-861a26c201d5 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] [instance: 88769e75-3f26-45cf-9857-3fa7fc4b478e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:36.136925 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ee693674-d9bb-4e58-9908-861a26c201d5 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:36.137588 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ee693674-d9bb-4e58-9908-861a26c201d5 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:36.138193 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ee693674-d9bb-4e58-9908-861a26c201d5 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:36.138920 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ee693674-d9bb-4e58-9908-861a26c201d5 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:36.139415 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ee693674-d9bb-4e58-9908-861a26c201d5 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:36.139836 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ee693674-d9bb-4e58-9908-861a26c201d5 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:36.483706 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ee693674-d9bb-4e58-9908-861a26c201d5 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a685773acdb415591f62ccee7157b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa06a29e779e413484cdfcb27e902525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:36.501808 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ee693674-d9bb-4e58-9908-861a26c201d5 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] 10.222.0.79 "GET /compute/v2.1/servers/88769e75-3f26-45cf-9857-3fa7fc4b478e" status: 200 len: 1322 microversion: 2.1 time: 0.380185 Oct 17 13:35:36.514417 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 314/616] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:36 2022] GET /compute/v2.1/servers/88769e75-3f26-45cf-9857-3fa7fc4b478e => generated 1322 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:36.538833 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ea7ed496-5d3a-470d-8eb0-4fb87eca3a49 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:36.557937 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ea7ed496-5d3a-470d-8eb0-4fb87eca3a49 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:36.560756 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ea7ed496-5d3a-470d-8eb0-4fb87eca3a49 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Searching by: {'reservation_id': 'r-jo72jnv6', 'deleted': False, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7'} {{(pid=127016) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:35:36.568715 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ea7ed496-5d3a-470d-8eb0-4fb87eca3a49 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:36.569898 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ea7ed496-5d3a-470d-8eb0-4fb87eca3a49 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:36.570345 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ea7ed496-5d3a-470d-8eb0-4fb87eca3a49 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:36.572506 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ea7ed496-5d3a-470d-8eb0-4fb87eca3a49 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:36.574446 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ea7ed496-5d3a-470d-8eb0-4fb87eca3a49 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:36.575021 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ea7ed496-5d3a-470d-8eb0-4fb87eca3a49 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:36.754852 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.multi_cell_list [None req-ea7ed496-5d3a-470d-8eb0-4fb87eca3a49 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127016) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:35:36.944874 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-809d26be-941b-4b26-af6f-7c9c2a0b5ea7 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] 10.222.0.79 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.285815 Oct 17 13:35:36.945492 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 303/617] 10.222.0.79 () {60 vars in 1170 bytes} [Mon Oct 17 13:35:34 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:36.959280 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ccbc490a-a280-42b1-a0ff-b5614b3b483d tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:36.959847 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ccbc490a-a280-42b1-a0ff-b5614b3b483d tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] [instance: 51be2144-e969-4e1b-b5da-c43b9a7b7c90] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:36.981491 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ccbc490a-a280-42b1-a0ff-b5614b3b483d tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:36.982979 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ccbc490a-a280-42b1-a0ff-b5614b3b483d tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:36.983641 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ccbc490a-a280-42b1-a0ff-b5614b3b483d tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:36.985058 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ccbc490a-a280-42b1-a0ff-b5614b3b483d tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:36.985683 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ccbc490a-a280-42b1-a0ff-b5614b3b483d tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:36.986419 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ccbc490a-a280-42b1-a0ff-b5614b3b483d tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:37.080752 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ccbc490a-a280-42b1-a0ff-b5614b3b483d tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:37.093079 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ccbc490a-a280-42b1-a0ff-b5614b3b483d tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:37.099455 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ccbc490a-a280-42b1-a0ff-b5614b3b483d tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:37.110278 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ccbc490a-a280-42b1-a0ff-b5614b3b483d tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] 10.222.0.79 "GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90" status: 200 len: 1447 microversion: 2.75 time: 0.156088 Oct 17 13:35:37.111316 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 304/618] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:35:36 2022] GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90 => generated 1447 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:35:37.118732 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5b24fe9c-caff-40e3-8bbb-93d61b6133d3 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:37.120200 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5b24fe9c-caff-40e3-8bbb-93d61b6133d3 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] [instance: dd9a885e-0fb3-411a-b816-eafc93e1c5cb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:37.127684 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5b24fe9c-caff-40e3-8bbb-93d61b6133d3 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:37.128559 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5b24fe9c-caff-40e3-8bbb-93d61b6133d3 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:37.129230 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5b24fe9c-caff-40e3-8bbb-93d61b6133d3 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:37.130125 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5b24fe9c-caff-40e3-8bbb-93d61b6133d3 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:37.130773 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5b24fe9c-caff-40e3-8bbb-93d61b6133d3 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:37.131424 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5b24fe9c-caff-40e3-8bbb-93d61b6133d3 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:37.173362 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ea7ed496-5d3a-470d-8eb0-4fb87eca3a49 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:37.182020 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ea7ed496-5d3a-470d-8eb0-4fb87eca3a49 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:37.182765 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ea7ed496-5d3a-470d-8eb0-4fb87eca3a49 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:37.183453 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ea7ed496-5d3a-470d-8eb0-4fb87eca3a49 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:37.431797 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ea7ed496-5d3a-470d-8eb0-4fb87eca3a49 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/detail?reservation_id=r-jo72jnv6" status: 200 len: 2931 microversion: 2.1 time: 0.915868 Oct 17 13:35:37.447116 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5b24fe9c-caff-40e3-8bbb-93d61b6133d3 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e836340278b49f593350249132b9cfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550b2bda88024756abc4134365842d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:37.448180 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 315/619] 10.222.0.79 () {58 vars in 1197 bytes} [Mon Oct 17 13:35:36 2022] GET /compute/v2.1/servers/detail?reservation_id=r-jo72jnv6 => generated 2931 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:37.451458 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:37.464087 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-31f22e23-6293-4be3-806d-f7404db70ba1 req-c9cff9b6-d6a5-402d-8e4c-be13eefdf654 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd9a885e-0fb3-411a-b816-eafc93e1c5cb", "tag": "2ff450f2-efdf-4213-8a18-aa178b264642"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:37.466288 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5b24fe9c-caff-40e3-8bbb-93d61b6133d3 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] 10.222.0.79 "GET /compute/v2.1/servers/dd9a885e-0fb3-411a-b816-eafc93e1c5cb" status: 200 len: 1587 microversion: 2.1 time: 0.352773 Oct 17 13:35:37.478431 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-31f22e23-6293-4be3-806d-f7404db70ba1 req-c9cff9b6-d6a5-402d-8e4c-be13eefdf654 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:37.479669 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-31f22e23-6293-4be3-806d-f7404db70ba1 req-c9cff9b6-d6a5-402d-8e4c-be13eefdf654 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:37.480193 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 305/620] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:37 2022] GET /compute/v2.1/servers/dd9a885e-0fb3-411a-b816-eafc93e1c5cb => generated 1587 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:37.480517 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-31f22e23-6293-4be3-806d-f7404db70ba1 req-c9cff9b6-d6a5-402d-8e4c-be13eefdf654 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:37.492680 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-6d98d331-097e-4fca-97a6-4a40b017346c req-79500b5d-37f5-4d6f-b9b1-024dca857578 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88769e75-3f26-45cf-9857-3fa7fc4b478e", "name": "network-vif-plugged", "status": "completed", "tag": "9a770d5d-ee5c-4b9d-907c-d0aa8427ba10"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:37.498811 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-31f22e23-6293-4be3-806d-f7404db70ba1 req-c9cff9b6-d6a5-402d-8e4c-be13eefdf654 service nova] Creating event network-changed:2ff450f2-efdf-4213-8a18-aa178b264642 for instance dd9a885e-0fb3-411a-b816-eafc93e1c5cb on n-h2-854247-14 Oct 17 13:35:37.504076 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-6d98d331-097e-4fca-97a6-4a40b017346c req-79500b5d-37f5-4d6f-b9b1-024dca857578 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:37.504855 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-6d98d331-097e-4fca-97a6-4a40b017346c req-79500b5d-37f5-4d6f-b9b1-024dca857578 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:37.505417 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-31f22e23-6293-4be3-806d-f7404db70ba1 req-c9cff9b6-d6a5-402d-8e4c-be13eefdf654 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055684 Oct 17 13:35:37.505670 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-6d98d331-097e-4fca-97a6-4a40b017346c req-79500b5d-37f5-4d6f-b9b1-024dca857578 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:37.507014 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 316/621] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:37.514767 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7af0f5d6-b5c9-4327-b5d1-9d9687ae7359 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Action: 'action', calling method: .version_select at 0x7f7cd7d82b80>, body: {"addFloatingIp": {"address": "172.25.0.174"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:37.517839 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7af0f5d6-b5c9-4327-b5d1-9d9687ae7359 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] [instance: 3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:37.521539 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-6d98d331-097e-4fca-97a6-4a40b017346c req-79500b5d-37f5-4d6f-b9b1-024dca857578 service nova] Creating event network-vif-plugged:9a770d5d-ee5c-4b9d-907c-d0aa8427ba10 for instance 88769e75-3f26-45cf-9857-3fa7fc4b478e on n-h2-854247-14 Oct 17 13:35:37.528959 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-6d98d331-097e-4fca-97a6-4a40b017346c req-79500b5d-37f5-4d6f-b9b1-024dca857578 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047094 Oct 17 13:35:37.529580 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 306/622] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:37.535429 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d35879da-1ded-457a-8cdc-a5526a247b74 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:37.537407 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d35879da-1ded-457a-8cdc-a5526a247b74 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: f869f059-89c3-4462-a309-e27f650d7584] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:37.538446 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7af0f5d6-b5c9-4327-b5d1-9d9687ae7359 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:37.539361 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7af0f5d6-b5c9-4327-b5d1-9d9687ae7359 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:37.539850 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7af0f5d6-b5c9-4327-b5d1-9d9687ae7359 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:37.540730 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7af0f5d6-b5c9-4327-b5d1-9d9687ae7359 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:37.541228 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7af0f5d6-b5c9-4327-b5d1-9d9687ae7359 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:37.542000 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7af0f5d6-b5c9-4327-b5d1-9d9687ae7359 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:37.545239 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d35879da-1ded-457a-8cdc-a5526a247b74 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:37.545897 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d35879da-1ded-457a-8cdc-a5526a247b74 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:37.546504 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d35879da-1ded-457a-8cdc-a5526a247b74 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:37.547433 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d35879da-1ded-457a-8cdc-a5526a247b74 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:37.548049 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d35879da-1ded-457a-8cdc-a5526a247b74 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:37.548613 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d35879da-1ded-457a-8cdc-a5526a247b74 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:37.612482 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=100 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:37.684106 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7af0f5d6-b5c9-4327-b5d1-9d9687ae7359 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Acquiring lock "refresh_cache-3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5" {{(pid=127016) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 17 13:35:37.684703 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7af0f5d6-b5c9-4327-b5d1-9d9687ae7359 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Acquired lock "refresh_cache-3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5" {{(pid=127016) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 17 13:35:37.799029 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d35879da-1ded-457a-8cdc-a5526a247b74 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:37.813512 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d35879da-1ded-457a-8cdc-a5526a247b74 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/f869f059-89c3-4462-a309-e27f650d7584" status: 200 len: 1491 microversion: 2.1 time: 0.282412 Oct 17 13:35:37.825072 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 307/623] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:37 2022] GET /compute/v2.1/servers/f869f059-89c3-4462-a309-e27f650d7584 => generated 1491 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:37.827805 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0f1d1359-12a2-427a-b7c2-eaf65381c71b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:37.871853 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.compute.server_groups [None req-0f1d1359-12a2-427a-b7c2-eaf65381c71b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Querying cell 23debefa-f967-4de1-8ea3-1fa7cc16392a(cell1) for 2 instances {{(pid=127017) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 17 13:35:37.872718 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0f1d1359-12a2-427a-b7c2-eaf65381c71b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:37.874237 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0f1d1359-12a2-427a-b7c2-eaf65381c71b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:37.874709 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0f1d1359-12a2-427a-b7c2-eaf65381c71b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:37.925248 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0f1d1359-12a2-427a-b7c2-eaf65381c71b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/os-server-groups/aaa461b2-e1eb-4ef4-9a7c-d5ba39a4c4b4" status: 200 len: 265 microversion: 2.1 time: 0.107776 Oct 17 13:35:37.926169 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 308/624] 10.222.0.79 () {58 vars in 1263 bytes} [Mon Oct 17 13:35:37 2022] GET /compute/v2.1/os-server-groups/aaa461b2-e1eb-4ef4-9a7c-d5ba39a4c4b4 => generated 265 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:37.932987 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bc7e0474-a661-4348-ab3a-099edaf49b67 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:37.933606 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-bc7e0474-a661-4348-ab3a-099edaf49b67 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] [instance: 88769e75-3f26-45cf-9857-3fa7fc4b478e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:37.940733 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bc7e0474-a661-4348-ab3a-099edaf49b67 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:37.941221 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bc7e0474-a661-4348-ab3a-099edaf49b67 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:37.941663 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bc7e0474-a661-4348-ab3a-099edaf49b67 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:37.942431 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bc7e0474-a661-4348-ab3a-099edaf49b67 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:37.942875 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bc7e0474-a661-4348-ab3a-099edaf49b67 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:37.943489 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bc7e0474-a661-4348-ab3a-099edaf49b67 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:38.251848 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-bc7e0474-a661-4348-ab3a-099edaf49b67 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a685773acdb415591f62ccee7157b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa06a29e779e413484cdfcb27e902525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:38.261798 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-bc7e0474-a661-4348-ab3a-099edaf49b67 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] 10.222.0.79 "GET /compute/v2.1/servers/88769e75-3f26-45cf-9857-3fa7fc4b478e" status: 200 len: 1322 microversion: 2.1 time: 0.334129 Oct 17 13:35:38.263059 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 309/625] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:37 2022] GET /compute/v2.1/servers/88769e75-3f26-45cf-9857-3fa7fc4b478e => generated 1322 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:38.268793 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a554dd67-2693-41e7-b0bc-98806efb5528 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:38.270020 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a554dd67-2693-41e7-b0bc-98806efb5528 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] [instance: f869f059-89c3-4462-a309-e27f650d7584] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:38.277803 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a554dd67-2693-41e7-b0bc-98806efb5528 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:38.278510 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a554dd67-2693-41e7-b0bc-98806efb5528 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:38.279453 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a554dd67-2693-41e7-b0bc-98806efb5528 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:38.280165 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a554dd67-2693-41e7-b0bc-98806efb5528 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:38.280617 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a554dd67-2693-41e7-b0bc-98806efb5528 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:38.281039 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a554dd67-2693-41e7-b0bc-98806efb5528 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:38.465775 n-d-854247-14 devstack@n-api.service[127016]: DEBUG neutronclient.v2_0.client [None req-7af0f5d6-b5c9-4327-b5d1-9d9687ae7359 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.0.174 (83c4ac0d-5e50-4e78-9efe-6af265791847) with port bb330b1e-ec56-4fc5-b017-d997716bf0ba using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 21df306d-9b14-4323-a3b6-31e46566b626.", "detail": ""}} {{(pid=127016) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 13:35:38.466457 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7af0f5d6-b5c9-4327-b5d1-9d9687ae7359 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Releasing lock "refresh_cache-3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5" {{(pid=127016) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 17 13:35:38.467158 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-7af0f5d6-b5c9-4327-b5d1-9d9687ae7359 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] HTTP exception thrown: Cannot associate floating IP 172.25.0.174 (83c4ac0d-5e50-4e78-9efe-6af265791847) with port bb330b1e-ec56-4fc5-b017-d997716bf0ba using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 21df306d-9b14-4323-a3b6-31e46566b626. Oct 17 13:35:38.467158 n-d-854247-14 devstack@n-api.service[127016]: Neutron server returns request_ids: ['req-c7a37b35-de5b-4ad0-b1dd-b33aa76748bd'] Oct 17 13:35:38.480719 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7af0f5d6-b5c9-4327-b5d1-9d9687ae7359 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Request method failure captured: Oct 17 13:35:38.480719 n-d-854247-14 devstack@n-api.service[127016]: request: POST /compute/v2.1/servers/3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5/action HTTP/1.1 Oct 17 13:35:38.480719 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:35:38.480719 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:35:38.480719 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:35:38.480719 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 46 Oct 17 13:35:38.480719 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:35:38.480719 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:35:38.480719 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:35:38.480719 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:35:38.480719 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVoL-gc1d7fZFiDCJTbY6EyTWslON31yViZq5o5alXTLiVmOv7GfYptXi_5XRdsqLJZzGNWMspK70-XN--RkM02dNsShias1lA98nrVsRmmokHgNntV3WxX9irmBdM7lsUuVt2oS8wT0QOXoZPdui-Gwkbw-CpLHksrPqCzcu9FOm44 Oct 17 13:35:38.480719 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:35:38.480719 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:35:38.480719 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:35:38.480719 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:35:38.480719 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:35:38.480719 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:35:38.480719 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: bc31d4fa0cd9418584f52e7c46ade866 Oct 17 13:35:38.480719 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 Oct 17 13:35:38.480719 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:35:38.480719 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:35:38.482372 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/bc31d4fa0cd9418584f52e7c46ade866"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/bc31d4fa0cd9418584f52e7c46ade866"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/bc31d4fa0cd9418584f52e7c46ade866"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_bc31d4fa0cd9418584f52e7c46ade866", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:35:38.482372 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 Oct 17 13:35:38.482372 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: bc31d4fa0cd9418584f52e7c46ade866 Oct 17 13:35:38.482372 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 Oct 17 13:35:38.482372 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project Oct 17 13:35:38.482372 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:35:38.482372 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:35:38.482372 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 2a3dfc7f18ec4a6883b62872ab011cc4 Oct 17 13:35:38.482372 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project Oct 17 13:35:38.482372 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:35:38.482372 n-d-854247-14 devstack@n-api.service[127016]: {"addFloatingIp": {"address": "172.25.0.174"}} Oct 17 13:35:38.482372 n-d-854247-14 devstack@n-api.service[127016]: method: Oct 17 13:35:38.483258 n-d-854247-14 devstack@n-api.service[127016]: exception: Cannot associate floating IP 172.25.0.174 (83c4ac0d-5e50-4e78-9efe-6af265791847) with port bb330b1e-ec56-4fc5-b017-d997716bf0ba using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 21df306d-9b14-4323-a3b6-31e46566b626. Oct 17 13:35:38.483258 n-d-854247-14 devstack@n-api.service[127016]: Neutron server returns request_ids: ['req-c7a37b35-de5b-4ad0-b1dd-b33aa76748bd'] Oct 17 13:35:38.483258 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5', 'body': {'addFloatingIp': {'address': '172.25.0.174'}}} Oct 17 13:35:38.483258 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:35:38.483258 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:38.483258 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 17 13:35:38.483258 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 17 13:35:38.483258 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:35:38.483258 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:35:38.483258 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 17 13:35:38.483258 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 17 13:35:38.483258 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:35:38.483258 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:35:38.483258 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 17 13:35:38.483258 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 17 13:35:38.483258 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:35:38.483258 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:35:38.484525 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 17 13:35:38.484525 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 17 13:35:38.484525 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:35:38.484525 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:35:38.484525 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 13:35:38.484525 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 13:35:38.484525 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:35:38.484525 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:35:38.484525 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 13:35:38.484525 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 13:35:38.484525 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:35:38.484525 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:35:38.484525 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 13:35:38.484525 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 13:35:38.484525 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 13:35:38.484525 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 13:35:38.485805 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.0.174 (83c4ac0d-5e50-4e78-9efe-6af265791847) with port bb330b1e-ec56-4fc5-b017-d997716bf0ba using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 21df306d-9b14-4323-a3b6-31e46566b626. Oct 17 13:35:38.485805 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c7a37b35-de5b-4ad0-b1dd-b33aa76748bd'] Oct 17 13:35:38.485805 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:38.485805 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:35:38.485805 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:38.485805 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:38.485805 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 17 13:35:38.485805 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 17 13:35:38.485805 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 17 13:35:38.485805 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 17 13:35:38.485805 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 17 13:35:38.485805 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 17 13:35:38.485805 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.0.174 (83c4ac0d-5e50-4e78-9efe-6af265791847) with port bb330b1e-ec56-4fc5-b017-d997716bf0ba using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 21df306d-9b14-4323-a3b6-31e46566b626. Oct 17 13:35:38.485805 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c7a37b35-de5b-4ad0-b1dd-b33aa76748bd'] Oct 17 13:35:38.485805 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:38.485805 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:35:38.486935 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:38.486935 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:38.486935 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:35:38.486935 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:35:38.486935 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:35:38.486935 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:35:38.486935 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:35:38.486935 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:35:38.486935 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:35:38.486935 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:35:38.486935 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:35:38.486935 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:35:38.486935 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 17 13:35:38.486935 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 17 13:35:38.486935 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.0.174 (83c4ac0d-5e50-4e78-9efe-6af265791847) with port bb330b1e-ec56-4fc5-b017-d997716bf0ba using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 21df306d-9b14-4323-a3b6-31e46566b626. Oct 17 13:35:38.486935 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c7a37b35-de5b-4ad0-b1dd-b33aa76748bd'] Oct 17 13:35:38.486935 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:38.486935 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:35:38.488114 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:38.488114 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:38.488114 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:35:38.488114 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:35:38.488114 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:35:38.488114 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:35:38.488114 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.0.174 (83c4ac0d-5e50-4e78-9efe-6af265791847) with port bb330b1e-ec56-4fc5-b017-d997716bf0ba using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 21df306d-9b14-4323-a3b6-31e46566b626. Oct 17 13:35:38.488114 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c7a37b35-de5b-4ad0-b1dd-b33aa76748bd'] Oct 17 13:35:38.488114 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:38.488114 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7af0f5d6-b5c9-4327-b5d1-9d9687ae7359 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Returning 400 to user: Cannot associate floating IP 172.25.0.174 (83c4ac0d-5e50-4e78-9efe-6af265791847) with port bb330b1e-ec56-4fc5-b017-d997716bf0ba using fixed IP 172.20.0.6, as that fixed IP already has a floating IP on external network 21df306d-9b14-4323-a3b6-31e46566b626. Oct 17 13:35:38.488114 n-d-854247-14 devstack@n-api.service[127016]: Neutron server returns request_ids: ['req-c7a37b35-de5b-4ad0-b1dd-b33aa76748bd'] {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:35:38.491380 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7af0f5d6-b5c9-4327-b5d1-9d9687ae7359 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] 10.222.0.79 "POST /compute/v2.1/servers/3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5/action" status: 400 len: 381 microversion: 2.1 time: 0.978306 Oct 17 13:35:38.496347 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 317/626] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:35:37 2022] POST /compute/v2.1/servers/3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5/action => generated 381 bytes in 989 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:35:38.502332 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a554dd67-2693-41e7-b0bc-98806efb5528 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/f869f059-89c3-4462-a309-e27f650d7584" status: 200 len: 1644 microversion: 2.1 time: 0.237811 Oct 17 13:35:38.502502 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b396d1f9-8b9e-486b-8a92-e5c8a9837e8e tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:38.515194 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 310/627] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:38 2022] GET /compute/v2.1/servers/f869f059-89c3-4462-a309-e27f650d7584 => generated 1644 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:38.515535 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b396d1f9-8b9e-486b-8a92-e5c8a9837e8e tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] [instance: 03e8be7f-09be-488a-95ee-6951b53e35de] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:38.515636 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d041fd7f-a42f-469b-945f-9eef8b6681e5 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:38.515636 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d041fd7f-a42f-469b-945f-9eef8b6681e5 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] [instance: 51be2144-e969-4e1b-b5da-c43b9a7b7c90] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:38.515797 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b396d1f9-8b9e-486b-8a92-e5c8a9837e8e tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:38.515797 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b396d1f9-8b9e-486b-8a92-e5c8a9837e8e tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:38.515797 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b396d1f9-8b9e-486b-8a92-e5c8a9837e8e tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:38.515797 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b396d1f9-8b9e-486b-8a92-e5c8a9837e8e tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:38.516109 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b396d1f9-8b9e-486b-8a92-e5c8a9837e8e tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:38.516109 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b396d1f9-8b9e-486b-8a92-e5c8a9837e8e tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:38.516285 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d041fd7f-a42f-469b-945f-9eef8b6681e5 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:38.516285 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d041fd7f-a42f-469b-945f-9eef8b6681e5 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:38.516444 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d041fd7f-a42f-469b-945f-9eef8b6681e5 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:38.517041 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d041fd7f-a42f-469b-945f-9eef8b6681e5 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:38.517651 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d041fd7f-a42f-469b-945f-9eef8b6681e5 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:38.518248 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d041fd7f-a42f-469b-945f-9eef8b6681e5 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:38.647473 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d041fd7f-a42f-469b-945f-9eef8b6681e5 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:38.669067 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d041fd7f-a42f-469b-945f-9eef8b6681e5 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:38.671719 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d041fd7f-a42f-469b-945f-9eef8b6681e5 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:38.678591 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d041fd7f-a42f-469b-945f-9eef8b6681e5 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] 10.222.0.79 "GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90" status: 200 len: 1447 microversion: 2.75 time: 0.174073 Oct 17 13:35:38.687211 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 311/628] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:35:38 2022] GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90 => generated 1447 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:35:38.701580 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b396d1f9-8b9e-486b-8a92-e5c8a9837e8e tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/03e8be7f-09be-488a-95ee-6951b53e35de" status: 200 len: 1622 microversion: 2.1 time: 0.203714 Oct 17 13:35:38.705231 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4765d6e1-3509-46d6-b102-0beb8fcca3f9 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Calling method '.version_select at 0x7f7cd5ba2820>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:38.705915 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 318/629] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:38 2022] GET /compute/v2.1/servers/03e8be7f-09be-488a-95ee-6951b53e35de => generated 1622 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:38.719344 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-be93dde6-5d0b-4576-a5bf-e18d9b15aca6 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:38.719344 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-be93dde6-5d0b-4576-a5bf-e18d9b15aca6 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] [instance: f869f059-89c3-4462-a309-e27f650d7584] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:38.721430 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be93dde6-5d0b-4576-a5bf-e18d9b15aca6 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:38.722013 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be93dde6-5d0b-4576-a5bf-e18d9b15aca6 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:38.722541 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be93dde6-5d0b-4576-a5bf-e18d9b15aca6 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:38.723621 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be93dde6-5d0b-4576-a5bf-e18d9b15aca6 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:38.724144 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be93dde6-5d0b-4576-a5bf-e18d9b15aca6 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:38.724975 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be93dde6-5d0b-4576-a5bf-e18d9b15aca6 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:39.029213 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-be93dde6-5d0b-4576-a5bf-e18d9b15aca6 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/f869f059-89c3-4462-a309-e27f650d7584" status: 200 len: 1644 microversion: 2.1 time: 0.322052 Oct 17 13:35:39.030777 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 319/630] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:38 2022] GET /compute/v2.1/servers/f869f059-89c3-4462-a309-e27f650d7584 => generated 1644 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:39.036555 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3a1776a3-dcdc-4181-b2ba-5260f04c0db4 tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:39.037728 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3a1776a3-dcdc-4181-b2ba-5260f04c0db4 tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] [instance: 07af9912-df9b-4476-92b3-48858617dd29] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:39.045432 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3a1776a3-dcdc-4181-b2ba-5260f04c0db4 tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:39.046121 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3a1776a3-dcdc-4181-b2ba-5260f04c0db4 tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:39.050852 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3a1776a3-dcdc-4181-b2ba-5260f04c0db4 tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:39.051821 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3a1776a3-dcdc-4181-b2ba-5260f04c0db4 tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:39.052799 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3a1776a3-dcdc-4181-b2ba-5260f04c0db4 tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:39.053393 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3a1776a3-dcdc-4181-b2ba-5260f04c0db4 tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:39.343631 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3a1776a3-dcdc-4181-b2ba-5260f04c0db4 tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/07af9912-df9b-4476-92b3-48858617dd29" status: 200 len: 1622 microversion: 2.1 time: 0.310986 Oct 17 13:35:39.359189 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 320/631] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:39 2022] GET /compute/v2.1/servers/07af9912-df9b-4476-92b3-48858617dd29 => generated 1622 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:39.368205 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-37f95dfc-fa7c-4bd7-943f-9ca5c3162c7e tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:39.375840 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-37f95dfc-fa7c-4bd7-943f-9ca5c3162c7e tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:39.376582 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-37f95dfc-fa7c-4bd7-943f-9ca5c3162c7e tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:39.377397 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-37f95dfc-fa7c-4bd7-943f-9ca5c3162c7e tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:39.378443 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-37f95dfc-fa7c-4bd7-943f-9ca5c3162c7e tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:39.379080 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-37f95dfc-fa7c-4bd7-943f-9ca5c3162c7e tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:39.379946 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-37f95dfc-fa7c-4bd7-943f-9ca5c3162c7e tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:39.385961 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=25 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:39.410016 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-37f95dfc-fa7c-4bd7-943f-9ca5c3162c7e tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.048517 Oct 17 13:35:39.410628 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 321/632] 10.222.0.79 () {58 vars in 1176 bytes} [Mon Oct 17 13:35:39 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:39.421416 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8b0c98ca-b4c1-44ee-b7b0-6503f8624da3 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:39.422037 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8b0c98ca-b4c1-44ee-b7b0-6503f8624da3 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] [instance: 88769e75-3f26-45cf-9857-3fa7fc4b478e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:39.428324 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8b0c98ca-b4c1-44ee-b7b0-6503f8624da3 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:39.428777 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8b0c98ca-b4c1-44ee-b7b0-6503f8624da3 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:39.429224 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8b0c98ca-b4c1-44ee-b7b0-6503f8624da3 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:39.429930 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8b0c98ca-b4c1-44ee-b7b0-6503f8624da3 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:39.430421 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8b0c98ca-b4c1-44ee-b7b0-6503f8624da3 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:39.430875 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8b0c98ca-b4c1-44ee-b7b0-6503f8624da3 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:39.655662 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8b0c98ca-b4c1-44ee-b7b0-6503f8624da3 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a685773acdb415591f62ccee7157b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa06a29e779e413484cdfcb27e902525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:39.665202 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8b0c98ca-b4c1-44ee-b7b0-6503f8624da3 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] 10.222.0.79 "GET /compute/v2.1/servers/88769e75-3f26-45cf-9857-3fa7fc4b478e" status: 200 len: 1472 microversion: 2.1 time: 0.253047 Oct 17 13:35:39.665852 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 322/633] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:39 2022] GET /compute/v2.1/servers/88769e75-3f26-45cf-9857-3fa7fc4b478e => generated 1472 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:39.671194 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-019da020-5408-44a7-83e2-e259ff7fb36d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Action: 'create', calling method: .version_select at 0x7f7cd5d33ee0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1909083488", "policies": ["anti-affinity"]}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:39.694366 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-019da020-5408-44a7-83e2-e259ff7fb36d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Getting quotas for project fa1db260a96a4c6aa69cd6437baab6f7. Resources: {'server_groups'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:35:39.699580 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-019da020-5408-44a7-83e2-e259ff7fb36d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Getting quotas for user 7a7e082035084338966a1c56b30c7093 and project fa1db260a96a4c6aa69cd6437baab6f7. Resources: {'server_groups'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:35:39.749391 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4765d6e1-3509-46d6-b102-0beb8fcca3f9 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] 10.222.0.79 "DELETE /compute/v2.1/os-floating-ips/83c4ac0d-5e50-4e78-9efe-6af265791847" status: 202 len: 0 microversion: 2.1 time: 1.068608 Oct 17 13:35:39.750054 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 312/634] 10.222.0.79 () {58 vars in 1263 bytes} [Mon Oct 17 13:35:38 2022] DELETE /compute/v2.1/os-floating-ips/83c4ac0d-5e50-4e78-9efe-6af265791847 => generated 0 bytes in 1070 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:35:39.754108 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-019da020-5408-44a7-83e2-e259ff7fb36d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Getting quotas for project fa1db260a96a4c6aa69cd6437baab6f7. Resources: {'server_groups'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:35:39.755686 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-69e3fbf9-f9b2-4913-bdfd-ba14f7f27ed5 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:39.756227 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-69e3fbf9-f9b2-4913-bdfd-ba14f7f27ed5 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] [instance: f869f059-89c3-4462-a309-e27f650d7584] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:39.759748 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-019da020-5408-44a7-83e2-e259ff7fb36d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Getting quotas for user 7a7e082035084338966a1c56b30c7093 and project fa1db260a96a4c6aa69cd6437baab6f7. Resources: {'server_groups'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:35:39.763713 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69e3fbf9-f9b2-4913-bdfd-ba14f7f27ed5 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:39.764224 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69e3fbf9-f9b2-4913-bdfd-ba14f7f27ed5 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:39.764664 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69e3fbf9-f9b2-4913-bdfd-ba14f7f27ed5 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:39.765382 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69e3fbf9-f9b2-4913-bdfd-ba14f7f27ed5 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:39.765842 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69e3fbf9-f9b2-4913-bdfd-ba14f7f27ed5 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:39.766264 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69e3fbf9-f9b2-4913-bdfd-ba14f7f27ed5 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:39.775135 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-019da020-5408-44a7-83e2-e259ff7fb36d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.107826 Oct 17 13:35:39.783548 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 323/635] 10.222.0.79 () {60 vars in 1174 bytes} [Mon Oct 17 13:35:39 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:39.844372 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-69e3fbf9-f9b2-4913-bdfd-ba14f7f27ed5 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/f869f059-89c3-4462-a309-e27f650d7584/action" status: 202 len: 0 microversion: 2.1 time: 0.092846 Oct 17 13:35:39.849076 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 313/636] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:35:39 2022] POST /compute/v2.1/servers/f869f059-89c3-4462-a309-e27f650d7584/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:35:39.858598 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-dcd7042a-6d23-4eda-8756-79345dec01a5 tempest-ServersAdminNegativeTestJSON-1416660348 tempest-ServersAdminNegativeTestJSON-1416660348-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:39.859346 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-dcd7042a-6d23-4eda-8756-79345dec01a5 tempest-ServersAdminNegativeTestJSON-1416660348 tempest-ServersAdminNegativeTestJSON-1416660348-project-admin] [instance: 88769e75-3f26-45cf-9857-3fa7fc4b478e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:39.867138 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dcd7042a-6d23-4eda-8756-79345dec01a5 tempest-ServersAdminNegativeTestJSON-1416660348 tempest-ServersAdminNegativeTestJSON-1416660348-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:39.867888 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dcd7042a-6d23-4eda-8756-79345dec01a5 tempest-ServersAdminNegativeTestJSON-1416660348 tempest-ServersAdminNegativeTestJSON-1416660348-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:39.868415 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dcd7042a-6d23-4eda-8756-79345dec01a5 tempest-ServersAdminNegativeTestJSON-1416660348 tempest-ServersAdminNegativeTestJSON-1416660348-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:39.869248 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dcd7042a-6d23-4eda-8756-79345dec01a5 tempest-ServersAdminNegativeTestJSON-1416660348 tempest-ServersAdminNegativeTestJSON-1416660348-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:39.870223 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dcd7042a-6d23-4eda-8756-79345dec01a5 tempest-ServersAdminNegativeTestJSON-1416660348 tempest-ServersAdminNegativeTestJSON-1416660348-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:39.870881 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dcd7042a-6d23-4eda-8756-79345dec01a5 tempest-ServersAdminNegativeTestJSON-1416660348 tempest-ServersAdminNegativeTestJSON-1416660348-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:39.898359 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-dcd7042a-6d23-4eda-8756-79345dec01a5 tempest-ServersAdminNegativeTestJSON-1416660348 tempest-ServersAdminNegativeTestJSON-1416660348-project-admin] Lazy-loading 'flavor' on Instance uuid 88769e75-3f26-45cf-9857-3fa7fc4b478e {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:35:40.031686 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-dcd7042a-6d23-4eda-8756-79345dec01a5 tempest-ServersAdminNegativeTestJSON-1416660348 tempest-ServersAdminNegativeTestJSON-1416660348-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/88769e75-3f26-45cf-9857-3fa7fc4b478e/action" status: 202 len: 0 microversion: 2.1 time: 0.182566 Oct 17 13:35:40.032617 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 314/637] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:35:39 2022] POST /compute/v2.1/servers/88769e75-3f26-45cf-9857-3fa7fc4b478e/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:35:40.037991 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-cd933828-b536-4be6-bb00-6e4cdcefb680 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:40.038701 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-cd933828-b536-4be6-bb00-6e4cdcefb680 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] [instance: 51be2144-e969-4e1b-b5da-c43b9a7b7c90] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:40.045650 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1c654778-fc0a-4d92-9074-cf12cd1f3510 tempest-HypervisorAdminNegativeUnderV252Test-1520507185 tempest-HypervisorAdminNegativeUnderV252Test-1520507185-project-admin] Calling method '.version_select at 0x7f7cd5b725e0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:40.048224 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1c654778-fc0a-4d92-9074-cf12cd1f3510 tempest-HypervisorAdminNegativeUnderV252Test-1520507185 tempest-HypervisorAdminNegativeUnderV252Test-1520507185-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:40.049049 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1c654778-fc0a-4d92-9074-cf12cd1f3510 tempest-HypervisorAdminNegativeUnderV252Test-1520507185 tempest-HypervisorAdminNegativeUnderV252Test-1520507185-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:40.049947 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1c654778-fc0a-4d92-9074-cf12cd1f3510 tempest-HypervisorAdminNegativeUnderV252Test-1520507185 tempest-HypervisorAdminNegativeUnderV252Test-1520507185-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:40.066144 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cd933828-b536-4be6-bb00-6e4cdcefb680 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:40.066818 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cd933828-b536-4be6-bb00-6e4cdcefb680 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:40.067276 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cd933828-b536-4be6-bb00-6e4cdcefb680 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:40.067984 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cd933828-b536-4be6-bb00-6e4cdcefb680 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:40.068423 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cd933828-b536-4be6-bb00-6e4cdcefb680 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:40.071740 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cd933828-b536-4be6-bb00-6e4cdcefb680 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:40.082373 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1c654778-fc0a-4d92-9074-cf12cd1f3510 tempest-HypervisorAdminNegativeUnderV252Test-1520507185 tempest-HypervisorAdminNegativeUnderV252Test-1520507185-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:40.088004 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1c654778-fc0a-4d92-9074-cf12cd1f3510 tempest-HypervisorAdminNegativeUnderV252Test-1520507185 tempest-HypervisorAdminNegativeUnderV252Test-1520507185-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:40.088680 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1c654778-fc0a-4d92-9074-cf12cd1f3510 tempest-HypervisorAdminNegativeUnderV252Test-1520507185 tempest-HypervisorAdminNegativeUnderV252Test-1520507185-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:40.114255 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1c654778-fc0a-4d92-9074-cf12cd1f3510 tempest-HypervisorAdminNegativeUnderV252Test-1520507185 tempest-HypervisorAdminNegativeUnderV252Test-1520507185-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:40.114942 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1c654778-fc0a-4d92-9074-cf12cd1f3510 tempest-HypervisorAdminNegativeUnderV252Test-1520507185 tempest-HypervisorAdminNegativeUnderV252Test-1520507185-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:40.115701 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1c654778-fc0a-4d92-9074-cf12cd1f3510 tempest-HypervisorAdminNegativeUnderV252Test-1520507185 tempest-HypervisorAdminNegativeUnderV252Test-1520507185-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:40.122992 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1c654778-fc0a-4d92-9074-cf12cd1f3510 tempest-HypervisorAdminNegativeUnderV252Test-1520507185 tempest-HypervisorAdminNegativeUnderV252Test-1520507185-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.336684 Oct 17 13:35:40.123819 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 324/638] 10.222.0.79 () {58 vars in 1146 bytes} [Mon Oct 17 13:35:39 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:40.132461 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6d4e7008-1f48-4c71-849e-1c3ff0a23e33 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Action: 'action', calling method: .version_select at 0x7f7cd7d938b0>, body: {"removeFloatingIp": {"address": "172.25.0.74"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:40.267403 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-cd933828-b536-4be6-bb00-6e4cdcefb680 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:40.276106 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-cd933828-b536-4be6-bb00-6e4cdcefb680 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:40.277645 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-cd933828-b536-4be6-bb00-6e4cdcefb680 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:40.283200 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-cd933828-b536-4be6-bb00-6e4cdcefb680 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] 10.222.0.79 "GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90" status: 200 len: 1447 microversion: 2.75 time: 0.249289 Oct 17 13:35:40.283765 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 315/639] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:35:40 2022] GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90 => generated 1447 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:35:40.295350 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d2acd02d-8d40-4202-a0c1-0717fee239e6 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:40.295350 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d2acd02d-8d40-4202-a0c1-0717fee239e6 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] [instance: f869f059-89c3-4462-a309-e27f650d7584] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:40.295350 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d2acd02d-8d40-4202-a0c1-0717fee239e6 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:40.295350 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d2acd02d-8d40-4202-a0c1-0717fee239e6 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:40.295724 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d2acd02d-8d40-4202-a0c1-0717fee239e6 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:40.296251 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d2acd02d-8d40-4202-a0c1-0717fee239e6 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:40.296926 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d2acd02d-8d40-4202-a0c1-0717fee239e6 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:40.297107 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d2acd02d-8d40-4202-a0c1-0717fee239e6 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:40.685819 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6d4e7008-1f48-4c71-849e-1c3ff0a23e33 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] [instance: 3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:40.692553 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6d4e7008-1f48-4c71-849e-1c3ff0a23e33 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:40.693040 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6d4e7008-1f48-4c71-849e-1c3ff0a23e33 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:40.693482 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6d4e7008-1f48-4c71-849e-1c3ff0a23e33 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:40.694217 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6d4e7008-1f48-4c71-849e-1c3ff0a23e33 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:40.694673 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6d4e7008-1f48-4c71-849e-1c3ff0a23e33 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:40.695091 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6d4e7008-1f48-4c71-849e-1c3ff0a23e33 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:40.850536 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d2acd02d-8d40-4202-a0c1-0717fee239e6 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/f869f059-89c3-4462-a309-e27f650d7584" status: 200 len: 1629 microversion: 2.1 time: 0.565689 Oct 17 13:35:40.851092 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 316/640] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:40 2022] GET /compute/v2.1/servers/f869f059-89c3-4462-a309-e27f650d7584 => generated 1629 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:40.872702 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9a3e3d42-e62f-4b7a-8bb4-e5908bcd5d17 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-127891241", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "8dc84431-0b19-4210-9e52-d66f999b4795"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:40.930072 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-9a3e3d42-e62f-4b7a-8bb4-e5908bcd5d17 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] validate_networks() for None {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:35:41.107931 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6d4e7008-1f48-4c71-849e-1c3ff0a23e33 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Acquiring lock "refresh_cache-3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5" {{(pid=127016) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 17 13:35:41.108335 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6d4e7008-1f48-4c71-849e-1c3ff0a23e33 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Acquired lock "refresh_cache-3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5" {{(pid=127016) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 17 13:35:41.345733 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-9a3e3d42-e62f-4b7a-8bb4-e5908bcd5d17 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:35:41.346545 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-9a3e3d42-e62f-4b7a-8bb4-e5908bcd5d17 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:35:41.349954 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-9a3e3d42-e62f-4b7a-8bb4-e5908bcd5d17 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:35:41.350602 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-9a3e3d42-e62f-4b7a-8bb4-e5908bcd5d17 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:35:41.351250 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-9a3e3d42-e62f-4b7a-8bb4-e5908bcd5d17 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:35:41.369873 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9a3e3d42-e62f-4b7a-8bb4-e5908bcd5d17 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:41.370744 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9a3e3d42-e62f-4b7a-8bb4-e5908bcd5d17 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:41.372436 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9a3e3d42-e62f-4b7a-8bb4-e5908bcd5d17 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:41.373353 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9a3e3d42-e62f-4b7a-8bb4-e5908bcd5d17 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:41.374081 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9a3e3d42-e62f-4b7a-8bb4-e5908bcd5d17 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:41.375334 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9a3e3d42-e62f-4b7a-8bb4-e5908bcd5d17 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:41.410954 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-9a3e3d42-e62f-4b7a-8bb4-e5908bcd5d17 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Getting quotas for project fa1db260a96a4c6aa69cd6437baab6f7. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:35:41.416723 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-9a3e3d42-e62f-4b7a-8bb4-e5908bcd5d17 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Getting quotas for user 7a7e082035084338966a1c56b30c7093 and project fa1db260a96a4c6aa69cd6437baab6f7. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:35:41.432226 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9a3e3d42-e62f-4b7a-8bb4-e5908bcd5d17 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Going to run 2 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:35:41.435695 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9a3e3d42-e62f-4b7a-8bb4-e5908bcd5d17 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: ec948255-c8e9-4450-95d5-42f38b9afe45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:35:41.486919 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-9a3e3d42-e62f-4b7a-8bb4-e5908bcd5d17 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=127017) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 17 13:35:41.517323 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-9a3e3d42-e62f-4b7a-8bb4-e5908bcd5d17 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Getting quotas for project fa1db260a96a4c6aa69cd6437baab6f7. Resources: {'server_group_members'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:35:41.523021 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-9a3e3d42-e62f-4b7a-8bb4-e5908bcd5d17 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Getting quotas for user 7a7e082035084338966a1c56b30c7093 and project fa1db260a96a4c6aa69cd6437baab6f7. Resources: {'server_group_members'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:35:41.535317 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:41.577707 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-9a3e3d42-e62f-4b7a-8bb4-e5908bcd5d17 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Getting quotas for project fa1db260a96a4c6aa69cd6437baab6f7. Resources: {'server_group_members'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:35:41.583227 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-9a3e3d42-e62f-4b7a-8bb4-e5908bcd5d17 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Getting quotas for user 7a7e082035084338966a1c56b30c7093 and project fa1db260a96a4c6aa69cd6437baab6f7. Resources: {'server_group_members'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:35:41.598238 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9a3e3d42-e62f-4b7a-8bb4-e5908bcd5d17 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 4d242145-87ff-473a-bac2-fdd483fb5863] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=ec948255-c8e9-4450-95d5-42f38b9afe45,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:35:41.660030 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-9a3e3d42-e62f-4b7a-8bb4-e5908bcd5d17 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Getting quotas for project fa1db260a96a4c6aa69cd6437baab6f7. Resources: {'server_group_members'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:35:41.666523 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-9a3e3d42-e62f-4b7a-8bb4-e5908bcd5d17 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Getting quotas for user 7a7e082035084338966a1c56b30c7093 and project fa1db260a96a4c6aa69cd6437baab6f7. Resources: {'server_group_members'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:35:41.721763 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-9a3e3d42-e62f-4b7a-8bb4-e5908bcd5d17 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Getting quotas for project fa1db260a96a4c6aa69cd6437baab6f7. Resources: {'server_group_members'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:35:41.728168 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-9a3e3d42-e62f-4b7a-8bb4-e5908bcd5d17 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Getting quotas for user 7a7e082035084338966a1c56b30c7093 and project fa1db260a96a4c6aa69cd6437baab6f7. Resources: {'server_group_members'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:35:41.773161 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9a3e3d42-e62f-4b7a-8bb4-e5908bcd5d17 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.908663 Oct 17 13:35:41.777535 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 317/641] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:35:40 2022] POST /compute/v2.1/servers => generated 32 bytes in 926 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 17 13:35:41.782651 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-504feaff-e09f-42aa-b23e-708a4994a5ee tempest-ServersAdminNegativeTestJSON-1416660348 tempest-ServersAdminNegativeTestJSON-1416660348-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:41.783496 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-504feaff-e09f-42aa-b23e-708a4994a5ee tempest-ServersAdminNegativeTestJSON-1416660348 tempest-ServersAdminNegativeTestJSON-1416660348-project-admin] [instance: 88769e75-3f26-45cf-9857-3fa7fc4b478e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:41.791555 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-504feaff-e09f-42aa-b23e-708a4994a5ee tempest-ServersAdminNegativeTestJSON-1416660348 tempest-ServersAdminNegativeTestJSON-1416660348-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:41.792552 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-504feaff-e09f-42aa-b23e-708a4994a5ee tempest-ServersAdminNegativeTestJSON-1416660348 tempest-ServersAdminNegativeTestJSON-1416660348-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:41.792939 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-504feaff-e09f-42aa-b23e-708a4994a5ee tempest-ServersAdminNegativeTestJSON-1416660348 tempest-ServersAdminNegativeTestJSON-1416660348-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:41.793791 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-504feaff-e09f-42aa-b23e-708a4994a5ee tempest-ServersAdminNegativeTestJSON-1416660348 tempest-ServersAdminNegativeTestJSON-1416660348-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:41.794411 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-504feaff-e09f-42aa-b23e-708a4994a5ee tempest-ServersAdminNegativeTestJSON-1416660348 tempest-ServersAdminNegativeTestJSON-1416660348-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:41.794936 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-504feaff-e09f-42aa-b23e-708a4994a5ee tempest-ServersAdminNegativeTestJSON-1416660348 tempest-ServersAdminNegativeTestJSON-1416660348-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:42.112894 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-6d4e7008-1f48-4c71-849e-1c3ff0a23e33 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] [instance: 3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5] Building network info cache for instance {{(pid=127016) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 17 13:35:42.462887 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-504feaff-e09f-42aa-b23e-708a4994a5ee tempest-ServersAdminNegativeTestJSON-1416660348 tempest-ServersAdminNegativeTestJSON-1416660348-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/88769e75-3f26-45cf-9857-3fa7fc4b478e" status: 200 len: 1616 microversion: 2.1 time: 0.684019 Oct 17 13:35:42.464553 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 318/642] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:41 2022] GET /compute/v2.1/servers/88769e75-3f26-45cf-9857-3fa7fc4b478e => generated 1616 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:42.685183 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-aa14c489-5fcc-4b41-ad34-baa9685c52e9 tempest-HypervisorAdminNegativeUnderV252Test-1743953613 tempest-HypervisorAdminNegativeUnderV252Test-1743953613-project] Calling method '.version_select at 0x7f7cd5bf8040>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:42.687898 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-aa14c489-5fcc-4b41-ad34-baa9685c52e9 tempest-HypervisorAdminNegativeUnderV252Test-1743953613 tempest-HypervisorAdminNegativeUnderV252Test-1743953613-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '8ffc191c424942238bc15e4af32fd187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34ac71ce30f40c5af8c1767f7116c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:42.690329 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-aa14c489-5fcc-4b41-ad34-baa9685c52e9 tempest-HypervisorAdminNegativeUnderV252Test-1743953613 tempest-HypervisorAdminNegativeUnderV252Test-1743953613-project] Request method failure captured: Oct 17 13:35:42.690329 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/os-hypervisors/n-h2-854247-14/search HTTP/1.1 Oct 17 13:35:42.690329 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:35:42.690329 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:35:42.690329 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:35:42.690329 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:35:42.690329 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:35:42.690329 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:35:42.690329 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:35:42.690329 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:35:42.690329 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVoqo4e9dBlFY9xBJkvpXL4JhZJcJK5m6jjDlgMRdmoVfRwmqpOtl-rigsrtv5L7Ok6pPoBihRQVRivI42asRbV9L628jkaar_rqXakZcYjePI0T-PK82xJUDP0ZUtoU_EQWVCFPn-iPBhgVxWW24oJ6ocgszKWAItXeC4vb2sL3qHI Oct 17 13:35:42.690329 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:35:42.690329 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:35:42.690329 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:35:42.690329 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:35:42.690329 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:35:42.690329 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:35:42.690329 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: f34ac71ce30f40c5af8c1767f7116c7f Oct 17 13:35:42.690329 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1743953613 Oct 17 13:35:42.690329 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:35:42.690329 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:35:42.692001 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f34ac71ce30f40c5af8c1767f7116c7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f34ac71ce30f40c5af8c1767f7116c7f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f34ac71ce30f40c5af8c1767f7116c7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f34ac71ce30f40c5af8c1767f7116c7f", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:35:42.692001 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1743953613 Oct 17 13:35:42.692001 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: f34ac71ce30f40c5af8c1767f7116c7f Oct 17 13:35:42.692001 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1743953613 Oct 17 13:35:42.692001 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1743953613-project Oct 17 13:35:42.692001 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:35:42.692001 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:35:42.692001 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 8ffc191c424942238bc15e4af32fd187 Oct 17 13:35:42.692001 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1743953613-project Oct 17 13:35:42.692001 n-d-854247-14 devstack@n-api.service[127017]: method: Oct 17 13:35:42.692001 n-d-854247-14 devstack@n-api.service[127017]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 17 13:35:42.692001 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'n-h2-854247-14'} Oct 17 13:35:42.693203 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:35:42.693203 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:42.693203 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:35:42.693203 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:35:42.693203 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:35:42.693203 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:35:42.693203 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:35:42.693203 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:35:42.693203 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:35:42.693203 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:35:42.693203 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 17 13:35:42.693203 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 17 13:35:42.693203 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:35:42.693203 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:35:42.693203 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:35:42.693203 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:35:42.693203 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:35:42.693203 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:35:42.693203 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:35:42.694656 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:35:42.694656 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:35:42.694656 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:35:42.694656 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:35:42.694656 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:35:42.694656 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:35:42.694656 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:35:42.694656 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 17 13:35:42.694656 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:42.694656 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:35:42.694656 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:42.694656 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:42.694656 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:35:42.694656 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:35:42.694656 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:35:42.694656 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:35:42.694656 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 17 13:35:42.694656 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:42.701550 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-aa14c489-5fcc-4b41-ad34-baa9685c52e9 tempest-HypervisorAdminNegativeUnderV252Test-1743953613 tempest-HypervisorAdminNegativeUnderV252Test-1743953613-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:35:42.702812 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-aa14c489-5fcc-4b41-ad34-baa9685c52e9 tempest-HypervisorAdminNegativeUnderV252Test-1743953613 tempest-HypervisorAdminNegativeUnderV252Test-1743953613-project] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/n-h2-854247-14/search" status: 403 len: 117 microversion: 2.1 time: 0.236763 Oct 17 13:35:42.703632 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 319/643] 10.222.0.79 () {58 vars in 1212 bytes} [Mon Oct 17 13:35:42 2022] GET /compute/v2.1/os-hypervisors/n-h2-854247-14/search => generated 117 bytes in 238 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:35:42.719263 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b3a966b8-0e77-4e83-bd6a-2d402ade516d tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854247-14", "block_migration": true, "disk_over_commit": false}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:42.724997 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b3a966b8-0e77-4e83-bd6a-2d402ade516d tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] [instance: f869f059-89c3-4462-a309-e27f650d7584] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:42.736187 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b3a966b8-0e77-4e83-bd6a-2d402ade516d tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:42.736986 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b3a966b8-0e77-4e83-bd6a-2d402ade516d tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:42.737639 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b3a966b8-0e77-4e83-bd6a-2d402ade516d tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:42.738761 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b3a966b8-0e77-4e83-bd6a-2d402ade516d tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:42.739455 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b3a966b8-0e77-4e83-bd6a-2d402ade516d tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:42.739967 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b3a966b8-0e77-4e83-bd6a-2d402ade516d tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:42.847974 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-b3a966b8-0e77-4e83-bd6a-2d402ade516d tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lazy-loading 'flavor' on Instance uuid f869f059-89c3-4462-a309-e27f650d7584 {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:35:42.863809 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b3a966b8-0e77-4e83-bd6a-2d402ade516d tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] [instance: f869f059-89c3-4462-a309-e27f650d7584] Going to try to live migrate instance to n-h2-854247-14 {{(pid=127017) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 17 13:35:43.259644 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-6d4e7008-1f48-4c71-849e-1c3ff0a23e33 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] [instance: 3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5] Updating instance_info_cache with network_info: [{"id": "bb330b1e-ec56-4fc5-b017-d997716bf0ba", "address": "fa:16:3e:79:72:88", "network": {"id": "95833473-af23-4ef3-b861-8a8f3e383e0c", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1583976845-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "bc31d4fa0cd9418584f52e7c46ade866", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapbb330b1e-ec", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127016) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 17 13:35:43.293595 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6d4e7008-1f48-4c71-849e-1c3ff0a23e33 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Releasing lock "refresh_cache-3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5" {{(pid=127016) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 17 13:35:43.294586 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6d4e7008-1f48-4c71-849e-1c3ff0a23e33 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] 10.222.0.79 "POST /compute/v2.1/servers/3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5/action" status: 202 len: 0 microversion: 2.1 time: 3.166366 Oct 17 13:35:43.296213 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 325/644] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:35:40 2022] POST /compute/v2.1/servers/3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5/action => generated 0 bytes in 3172 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 17 13:35:43.302261 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ac9943dd-6411-45e9-a99e-060c716387e0 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:43.303227 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ac9943dd-6411-45e9-a99e-060c716387e0 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] [instance: 51be2144-e969-4e1b-b5da-c43b9a7b7c90] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:43.310971 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ac9943dd-6411-45e9-a99e-060c716387e0 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:43.312247 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ac9943dd-6411-45e9-a99e-060c716387e0 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:43.312952 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ac9943dd-6411-45e9-a99e-060c716387e0 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:43.314233 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ac9943dd-6411-45e9-a99e-060c716387e0 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:43.315026 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ac9943dd-6411-45e9-a99e-060c716387e0 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:43.316141 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ac9943dd-6411-45e9-a99e-060c716387e0 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:43.427626 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ac9943dd-6411-45e9-a99e-060c716387e0 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:43.441528 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ac9943dd-6411-45e9-a99e-060c716387e0 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:43.443433 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ac9943dd-6411-45e9-a99e-060c716387e0 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:43.457386 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ac9943dd-6411-45e9-a99e-060c716387e0 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] 10.222.0.79 "GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90" status: 200 len: 1447 microversion: 2.75 time: 0.159971 Oct 17 13:35:43.458401 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 326/645] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:35:43 2022] GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90 => generated 1447 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:35:43.464592 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d36e1e18-0f1a-4d22-8a4e-83f5c7072a11 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:43.471116 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d36e1e18-0f1a-4d22-8a4e-83f5c7072a11 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:43.472897 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d36e1e18-0f1a-4d22-8a4e-83f5c7072a11 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Searching by: {'deleted': False, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7'} {{(pid=127016) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:35:43.479699 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d36e1e18-0f1a-4d22-8a4e-83f5c7072a11 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:43.480573 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d36e1e18-0f1a-4d22-8a4e-83f5c7072a11 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:43.481232 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d36e1e18-0f1a-4d22-8a4e-83f5c7072a11 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:43.482687 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d36e1e18-0f1a-4d22-8a4e-83f5c7072a11 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:43.483912 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d36e1e18-0f1a-4d22-8a4e-83f5c7072a11 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:43.484836 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d36e1e18-0f1a-4d22-8a4e-83f5c7072a11 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:43.557179 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.multi_cell_list [None req-d36e1e18-0f1a-4d22-8a4e-83f5c7072a11 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Listed batch of 5 results from cell out of 1000 limit. Returned 5 total so far. {{(pid=127016) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:35:43.630775 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d36e1e18-0f1a-4d22-8a4e-83f5c7072a11 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers" status: 200 len: 1664 microversion: 2.1 time: 0.169116 Oct 17 13:35:43.639222 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 327/646] 10.222.0.79 () {58 vars in 1125 bytes} [Mon Oct 17 13:35:43 2022] GET /compute/v2.1/servers => generated 1664 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:43.644196 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-0b9aee83-52fb-43a6-9e20-e48821d43c09 req-7ead7aaf-462b-49b6-97ca-4bb0ea42da03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5", "tag": "bb330b1e-ec56-4fc5-b017-d997716bf0ba"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:43.664977 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-0b9aee83-52fb-43a6-9e20-e48821d43c09 req-7ead7aaf-462b-49b6-97ca-4bb0ea42da03 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:43.665458 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-0b9aee83-52fb-43a6-9e20-e48821d43c09 req-7ead7aaf-462b-49b6-97ca-4bb0ea42da03 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:43.665883 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-0b9aee83-52fb-43a6-9e20-e48821d43c09 req-7ead7aaf-462b-49b6-97ca-4bb0ea42da03 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:43.691415 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-0b9aee83-52fb-43a6-9e20-e48821d43c09 req-7ead7aaf-462b-49b6-97ca-4bb0ea42da03 service nova] Creating event network-changed:bb330b1e-ec56-4fc5-b017-d997716bf0ba for instance 3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5 on n-h2-854247-14 Oct 17 13:35:43.717651 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-0b9aee83-52fb-43a6-9e20-e48821d43c09 req-7ead7aaf-462b-49b6-97ca-4bb0ea42da03 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079792 Oct 17 13:35:43.720888 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 328/647] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:35:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:43.733928 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0fcc8138-d1bd-4157-a559-9685b4df8119 tempest-ServersAdminNegativeTestJSON-1416660348 tempest-ServersAdminNegativeTestJSON-1416660348-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:43.736294 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0fcc8138-d1bd-4157-a559-9685b4df8119 tempest-ServersAdminNegativeTestJSON-1416660348 tempest-ServersAdminNegativeTestJSON-1416660348-project-admin] [instance: 88769e75-3f26-45cf-9857-3fa7fc4b478e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:43.753294 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0fcc8138-d1bd-4157-a559-9685b4df8119 tempest-ServersAdminNegativeTestJSON-1416660348 tempest-ServersAdminNegativeTestJSON-1416660348-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:43.759757 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0fcc8138-d1bd-4157-a559-9685b4df8119 tempest-ServersAdminNegativeTestJSON-1416660348 tempest-ServersAdminNegativeTestJSON-1416660348-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:43.761160 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0fcc8138-d1bd-4157-a559-9685b4df8119 tempest-ServersAdminNegativeTestJSON-1416660348 tempest-ServersAdminNegativeTestJSON-1416660348-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:43.762033 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0fcc8138-d1bd-4157-a559-9685b4df8119 tempest-ServersAdminNegativeTestJSON-1416660348 tempest-ServersAdminNegativeTestJSON-1416660348-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:43.762592 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0fcc8138-d1bd-4157-a559-9685b4df8119 tempest-ServersAdminNegativeTestJSON-1416660348 tempest-ServersAdminNegativeTestJSON-1416660348-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:43.763118 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0fcc8138-d1bd-4157-a559-9685b4df8119 tempest-ServersAdminNegativeTestJSON-1416660348 tempest-ServersAdminNegativeTestJSON-1416660348-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:43.891236 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-0fcc8138-d1bd-4157-a559-9685b4df8119 tempest-ServersAdminNegativeTestJSON-1416660348 tempest-ServersAdminNegativeTestJSON-1416660348-project-admin] HTTP exception thrown: Cannot 'migrate' instance 88769e75-3f26-45cf-9857-3fa7fc4b478e while it is in vm_state suspended Oct 17 13:35:43.893450 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0fcc8138-d1bd-4157-a559-9685b4df8119 tempest-ServersAdminNegativeTestJSON-1416660348 tempest-ServersAdminNegativeTestJSON-1416660348-project-admin] Request method failure captured: Oct 17 13:35:43.893450 n-d-854247-14 devstack@n-api.service[127016]: request: POST /compute/v2.1/servers/88769e75-3f26-45cf-9857-3fa7fc4b478e/action HTTP/1.1 Oct 17 13:35:43.893450 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:35:43.893450 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:35:43.893450 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:35:43.893450 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 15 Oct 17 13:35:43.893450 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:35:43.893450 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:35:43.893450 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:35:43.893450 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:35:43.893450 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVn6VmkhfaVG6VeIKMx3qVbBbEjBRYg29fYxwujK-3t22OgLdjtP82VO2AjHee_Ll_n9i2R0A7olZTb8l9TSCOIGso4lNuC9laxnGDN6EM8f4EFK4BRRDrvRHHNKEChsI1peVOxI6ExJd3UXIN4gEGftMpEuzFdUPEOMJMuHsNUyJwQ Oct 17 13:35:43.893450 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:35:43.893450 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:35:43.893450 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:35:43.893450 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:35:43.893450 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:35:43.893450 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:35:43.893450 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: b8e914392c8f47f29110268677be9df5 Oct 17 13:35:43.893450 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1416660348 Oct 17 13:35:43.893450 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member,admin Oct 17 13:35:43.893450 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member,admin Oct 17 13:35:43.894836 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b8e914392c8f47f29110268677be9df5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b8e914392c8f47f29110268677be9df5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b8e914392c8f47f29110268677be9df5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b8e914392c8f47f29110268677be9df5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:35:43.894836 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1416660348 Oct 17 13:35:43.894836 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: b8e914392c8f47f29110268677be9df5 Oct 17 13:35:43.894836 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1416660348 Oct 17 13:35:43.894836 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServersAdminNegativeTestJSON-1416660348-project-admin Oct 17 13:35:43.894836 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:35:43.894836 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:35:43.894836 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 31fc3abdb9b7402da26811eeb714f9c1 Oct 17 13:35:43.894836 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1416660348-project-admin Oct 17 13:35:43.894836 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:35:43.894836 n-d-854247-14 devstack@n-api.service[127016]: {"migrate": {}} Oct 17 13:35:43.894836 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:35:43.894836 n-d-854247-14 devstack@n-api.service[127016]: exception: Cannot 'migrate' instance 88769e75-3f26-45cf-9857-3fa7fc4b478e while it is in vm_state suspended Oct 17 13:35:43.895716 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '88769e75-3f26-45cf-9857-3fa7fc4b478e', 'body': {'migrate': {}}} Oct 17 13:35:43.895716 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:35:43.895716 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:43.895716 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 17 13:35:43.895716 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 17 13:35:43.895716 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 17 13:35:43.895716 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:35:43.895716 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 17 13:35:43.895716 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 13:35:43.895716 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 17 13:35:43.895716 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 13:35:43.895716 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 13:35:43.895716 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:35:43.895716 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 13:35:43.895716 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 13:35:43.895716 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 88769e75-3f26-45cf-9857-3fa7fc4b478e in vm_state suspended. Cannot resize while the instance is in this state. Oct 17 13:35:43.895716 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:43.895716 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:35:43.895716 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:43.895716 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:43.896923 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:35:43.896923 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:35:43.896923 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:35:43.896923 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:35:43.896923 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:35:43.896923 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:35:43.896923 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:35:43.896923 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:35:43.896923 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 17 13:35:43.896923 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 17 13:35:43.896923 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 13:35:43.896923 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 13:35:43.896923 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 88769e75-3f26-45cf-9857-3fa7fc4b478e while it is in vm_state suspended Oct 17 13:35:43.896923 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:43.896923 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:35:43.896923 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:43.896923 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:43.896923 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:35:43.896923 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:35:43.898061 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:35:43.898061 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:35:43.898061 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 88769e75-3f26-45cf-9857-3fa7fc4b478e while it is in vm_state suspended Oct 17 13:35:43.898061 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:43.898061 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0fcc8138-d1bd-4157-a559-9685b4df8119 tempest-ServersAdminNegativeTestJSON-1416660348 tempest-ServersAdminNegativeTestJSON-1416660348-project-admin] Returning 409 to user: Cannot 'migrate' instance 88769e75-3f26-45cf-9857-3fa7fc4b478e while it is in vm_state suspended {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:35:43.898061 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0fcc8138-d1bd-4157-a559-9685b4df8119 tempest-ServersAdminNegativeTestJSON-1416660348 tempest-ServersAdminNegativeTestJSON-1416660348-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/88769e75-3f26-45cf-9857-3fa7fc4b478e/action" status: 409 len: 148 microversion: 2.1 time: 0.172343 Oct 17 13:35:43.898061 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 329/648] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:35:43 2022] POST /compute/v2.1/servers/88769e75-3f26-45cf-9857-3fa7fc4b478e/action => generated 148 bytes in 174 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:35:43.899890 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1ec3f7ef-b35c-4ce5-bcb5-874b6180c1bf tempest-HypervisorAdminNegativeUnderV252Test-1520507185 tempest-HypervisorAdminNegativeUnderV252Test-1520507185-project-admin] Calling method '.version_select at 0x7f7cd5b3f430>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:43.902044 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1ec3f7ef-b35c-4ce5-bcb5-874b6180c1bf tempest-HypervisorAdminNegativeUnderV252Test-1520507185 tempest-HypervisorAdminNegativeUnderV252Test-1520507185-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:43.902537 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1ec3f7ef-b35c-4ce5-bcb5-874b6180c1bf tempest-HypervisorAdminNegativeUnderV252Test-1520507185 tempest-HypervisorAdminNegativeUnderV252Test-1520507185-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:43.903107 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1ec3f7ef-b35c-4ce5-bcb5-874b6180c1bf tempest-HypervisorAdminNegativeUnderV252Test-1520507185 tempest-HypervisorAdminNegativeUnderV252Test-1520507185-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:43.909717 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-1ec3f7ef-b35c-4ce5-bcb5-874b6180c1bf tempest-HypervisorAdminNegativeUnderV252Test-1520507185 tempest-HypervisorAdminNegativeUnderV252Test-1520507185-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 17 13:35:43.911102 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1ec3f7ef-b35c-4ce5-bcb5-874b6180c1bf tempest-HypervisorAdminNegativeUnderV252Test-1520507185 tempest-HypervisorAdminNegativeUnderV252Test-1520507185-project-admin] Request method failure captured: Oct 17 13:35:43.911102 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 17 13:35:43.911102 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:35:43.911102 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:35:43.911102 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:35:43.911102 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:35:43.911102 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:35:43.911102 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:35:43.911102 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:35:43.911102 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:35:43.911102 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVorENMKpNfmHFl0XwBCp14CHhwfWA_ScuTCYw2I-v5DqD3HAassIZwlhwmet8oDVuXRy15ct-vL1TXh0Q0n4608Ffrjp-kS8Ccvshre9VrGs_yOmRZPV-zqh1GqgB1QHw7db-H7DbKiIcGbj3bN4NNUKD1YvUGiRAsT5pLTp2jUtQM Oct 17 13:35:43.911102 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:35:43.911102 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:35:43.911102 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:35:43.911102 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:35:43.911102 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:35:43.911102 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:35:43.911102 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 3946e3580a334eb3996057528aa65e00 Oct 17 13:35:43.911102 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1520507185 Oct 17 13:35:43.911102 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member,admin Oct 17 13:35:43.911102 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member,admin Oct 17 13:35:43.912659 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3946e3580a334eb3996057528aa65e00"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/3946e3580a334eb3996057528aa65e00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3946e3580a334eb3996057528aa65e00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_3946e3580a334eb3996057528aa65e00", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:35:43.912659 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1520507185 Oct 17 13:35:43.912659 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 3946e3580a334eb3996057528aa65e00 Oct 17 13:35:43.912659 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1520507185 Oct 17 13:35:43.912659 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1520507185-project-admin Oct 17 13:35:43.912659 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:35:43.912659 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:35:43.912659 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 267de2a2ca03433493c5f1871950f36d Oct 17 13:35:43.912659 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1520507185-project-admin Oct 17 13:35:43.912659 n-d-854247-14 devstack@n-api.service[127016]: method: Oct 17 13:35:43.912659 n-d-854247-14 devstack@n-api.service[127016]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 17 13:35:43.912659 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 17 13:35:43.913707 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:35:43.913707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:43.913707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:35:43.913707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:35:43.913707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:35:43.913707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:35:43.913707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:35:43.913707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:35:43.913707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:35:43.913707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:35:43.913707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 17 13:35:43.913707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 17 13:35:43.913707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 17 13:35:43.913707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 17 13:35:43.913707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 17 13:35:43.913707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:43.913707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:35:43.913707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:43.913707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:43.913707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:35:43.915060 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:35:43.915060 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:35:43.915060 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:35:43.915060 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 17 13:35:43.915060 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:43.916538 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1ec3f7ef-b35c-4ce5-bcb5-874b6180c1bf tempest-HypervisorAdminNegativeUnderV252Test-1520507185 tempest-HypervisorAdminNegativeUnderV252Test-1520507185-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:35:43.917500 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1ec3f7ef-b35c-4ce5-bcb5-874b6180c1bf tempest-HypervisorAdminNegativeUnderV252Test-1520507185 tempest-HypervisorAdminNegativeUnderV252Test-1520507185-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.021158 Oct 17 13:35:43.919293 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 330/649] 10.222.0.79 () {58 vars in 1251 bytes} [Mon Oct 17 13:35:43 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:35:43.928552 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7fbf8ba0-ba8b-45ba-aa39-debc86901a04 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Calling method '.version_select at 0x7f7cd59c8ca0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:45.330919 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b3a966b8-0e77-4e83-bd6a-2d402ade516d tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/f869f059-89c3-4462-a309-e27f650d7584/action" status: 202 len: 0 microversion: 2.1 time: 2.625878 Oct 17 13:35:45.332434 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 320/650] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:35:42 2022] POST /compute/v2.1/servers/f869f059-89c3-4462-a309-e27f650d7584/action => generated 0 bytes in 2628 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:35:45.341629 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-18991bf3-a333-45e4-ae40-0adeb1d20fc9 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:45.343584 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-18991bf3-a333-45e4-ae40-0adeb1d20fc9 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 4d242145-87ff-473a-bac2-fdd483fb5863] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:45.352590 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-18991bf3-a333-45e4-ae40-0adeb1d20fc9 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:45.353451 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-18991bf3-a333-45e4-ae40-0adeb1d20fc9 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:45.355520 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-18991bf3-a333-45e4-ae40-0adeb1d20fc9 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:45.356607 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-18991bf3-a333-45e4-ae40-0adeb1d20fc9 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:45.357147 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-18991bf3-a333-45e4-ae40-0adeb1d20fc9 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:45.357751 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-18991bf3-a333-45e4-ae40-0adeb1d20fc9 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:45.400965 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:45.574191 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-18991bf3-a333-45e4-ae40-0adeb1d20fc9 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:45.583014 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-18991bf3-a333-45e4-ae40-0adeb1d20fc9 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/4d242145-87ff-473a-bac2-fdd483fb5863" status: 200 len: 1276 microversion: 2.1 time: 0.248629 Oct 17 13:35:45.583660 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 321/651] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:45 2022] GET /compute/v2.1/servers/4d242145-87ff-473a-bac2-fdd483fb5863 => generated 1276 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:45.589214 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-614f9a95-c81e-4b05-978b-e5360efd1ccd tempest-ServersAdminNegativeTestJSON-1416660348 tempest-ServersAdminNegativeTestJSON-1416660348-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:45.593136 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-614f9a95-c81e-4b05-978b-e5360efd1ccd tempest-ServersAdminNegativeTestJSON-1416660348 tempest-ServersAdminNegativeTestJSON-1416660348-project-admin] Request method failure captured: Oct 17 13:35:45.593136 n-d-854247-14 devstack@n-api.service[127017]: request: POST /compute/v2.1/servers/f0067ca2-1063-4f5b-901d-d766e56afa39/action HTTP/1.1 Oct 17 13:35:45.593136 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:35:45.593136 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:35:45.593136 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:35:45.593136 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 39 Oct 17 13:35:45.593136 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:35:45.593136 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:35:45.593136 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:35:45.593136 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:35:45.593136 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVn6VmkhfaVG6VeIKMx3qVbBbEjBRYg29fYxwujK-3t22OgLdjtP82VO2AjHee_Ll_n9i2R0A7olZTb8l9TSCOIGso4lNuC9laxnGDN6EM8f4EFK4BRRDrvRHHNKEChsI1peVOxI6ExJd3UXIN4gEGftMpEuzFdUPEOMJMuHsNUyJwQ Oct 17 13:35:45.593136 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:35:45.593136 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:35:45.593136 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:35:45.593136 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:35:45.593136 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:35:45.593136 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:35:45.593136 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: b8e914392c8f47f29110268677be9df5 Oct 17 13:35:45.593136 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1416660348 Oct 17 13:35:45.593136 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member,admin Oct 17 13:35:45.593136 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member,admin Oct 17 13:35:45.594491 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b8e914392c8f47f29110268677be9df5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b8e914392c8f47f29110268677be9df5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b8e914392c8f47f29110268677be9df5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b8e914392c8f47f29110268677be9df5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:35:45.594491 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1416660348 Oct 17 13:35:45.594491 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: b8e914392c8f47f29110268677be9df5 Oct 17 13:35:45.594491 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1416660348 Oct 17 13:35:45.594491 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServersAdminNegativeTestJSON-1416660348-project-admin Oct 17 13:35:45.594491 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:35:45.594491 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:35:45.594491 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 31fc3abdb9b7402da26811eeb714f9c1 Oct 17 13:35:45.594491 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1416660348-project-admin Oct 17 13:35:45.594491 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 13:35:45.594491 n-d-854247-14 devstack@n-api.service[127017]: {"os-resetState": {"state": "invalid"}} Oct 17 13:35:45.594491 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:35:45.595197 n-d-854247-14 devstack@n-api.service[127017]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 17 13:35:45.595197 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'f0067ca2-1063-4f5b-901d-d766e56afa39', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 17 13:35:45.595197 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:35:45.595197 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:45.595197 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:35:45.595197 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:35:45.595197 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:35:45.595197 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:35:45.595197 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 17 13:35:45.595197 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:45.595197 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 17 13:35:45.595197 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 17 13:35:45.595197 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:45.595197 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 17 13:35:45.595197 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi 'invalid' Oct 17 13:35:45.595197 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:45.595197 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:35:45.595197 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:45.595197 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:45.595197 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:35:45.595197 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:35:45.595197 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:35:45.596817 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:35:45.596817 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:35:45.596817 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:35:45.596817 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:35:45.596817 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:35:45.596817 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:35:45.596817 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:35:45.596817 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:35:45.596817 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:35:45.596817 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 17 13:35:45.596817 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:45.596817 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:35:45.596817 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:45.596817 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:45.596817 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:35:45.596817 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:35:45.596817 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:35:45.596817 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:35:45.596817 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 17 13:35:45.597970 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:45.599258 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-614f9a95-c81e-4b05-978b-e5360efd1ccd tempest-ServersAdminNegativeTestJSON-1416660348 tempest-ServersAdminNegativeTestJSON-1416660348-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:35:45.600459 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-614f9a95-c81e-4b05-978b-e5360efd1ccd tempest-ServersAdminNegativeTestJSON-1416660348 tempest-ServersAdminNegativeTestJSON-1416660348-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/f0067ca2-1063-4f5b-901d-d766e56afa39/action" status: 400 len: 144 microversion: 2.1 time: 0.015379 Oct 17 13:35:45.601077 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 322/652] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:35:45 2022] POST /compute/v2.1/servers/f0067ca2-1063-4f5b-901d-d766e56afa39/action => generated 144 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:35:45.609020 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0d7cb7bd-a3e2-4c47-80d4-b54273dae4d1 tempest-HypervisorAdminNegativeUnderV252Test-1520507185 tempest-HypervisorAdminNegativeUnderV252Test-1520507185-project-admin] Calling method '.version_select at 0x7f7cd59ba430>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:45.611378 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0d7cb7bd-a3e2-4c47-80d4-b54273dae4d1 tempest-HypervisorAdminNegativeUnderV252Test-1520507185 tempest-HypervisorAdminNegativeUnderV252Test-1520507185-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:45.612089 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0d7cb7bd-a3e2-4c47-80d4-b54273dae4d1 tempest-HypervisorAdminNegativeUnderV252Test-1520507185 tempest-HypervisorAdminNegativeUnderV252Test-1520507185-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:45.612801 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0d7cb7bd-a3e2-4c47-80d4-b54273dae4d1 tempest-HypervisorAdminNegativeUnderV252Test-1520507185 tempest-HypervisorAdminNegativeUnderV252Test-1520507185-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:45.629349 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0d7cb7bd-a3e2-4c47-80d4-b54273dae4d1 tempest-HypervisorAdminNegativeUnderV252Test-1520507185 tempest-HypervisorAdminNegativeUnderV252Test-1520507185-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:45.630155 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0d7cb7bd-a3e2-4c47-80d4-b54273dae4d1 tempest-HypervisorAdminNegativeUnderV252Test-1520507185 tempest-HypervisorAdminNegativeUnderV252Test-1520507185-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:45.630794 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0d7cb7bd-a3e2-4c47-80d4-b54273dae4d1 tempest-HypervisorAdminNegativeUnderV252Test-1520507185 tempest-HypervisorAdminNegativeUnderV252Test-1520507185-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:45.651258 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0d7cb7bd-a3e2-4c47-80d4-b54273dae4d1 tempest-HypervisorAdminNegativeUnderV252Test-1520507185 tempest-HypervisorAdminNegativeUnderV252Test-1520507185-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:45.652049 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0d7cb7bd-a3e2-4c47-80d4-b54273dae4d1 tempest-HypervisorAdminNegativeUnderV252Test-1520507185 tempest-HypervisorAdminNegativeUnderV252Test-1520507185-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:45.652720 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0d7cb7bd-a3e2-4c47-80d4-b54273dae4d1 tempest-HypervisorAdminNegativeUnderV252Test-1520507185 tempest-HypervisorAdminNegativeUnderV252Test-1520507185-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:45.662093 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0d7cb7bd-a3e2-4c47-80d4-b54273dae4d1 tempest-HypervisorAdminNegativeUnderV252Test-1520507185 tempest-HypervisorAdminNegativeUnderV252Test-1520507185-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.059751 Oct 17 13:35:45.663495 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 323/653] 10.222.0.79 () {58 vars in 1146 bytes} [Mon Oct 17 13:35:45 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:45.675563 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-69bfabaf-504e-4f32-9129-36892fe38f70 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:45.676175 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-69bfabaf-504e-4f32-9129-36892fe38f70 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] [instance: 51be2144-e969-4e1b-b5da-c43b9a7b7c90] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:45.683226 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69bfabaf-504e-4f32-9129-36892fe38f70 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:45.683843 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69bfabaf-504e-4f32-9129-36892fe38f70 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:45.684299 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69bfabaf-504e-4f32-9129-36892fe38f70 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:45.685046 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69bfabaf-504e-4f32-9129-36892fe38f70 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:45.685517 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69bfabaf-504e-4f32-9129-36892fe38f70 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:45.685929 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69bfabaf-504e-4f32-9129-36892fe38f70 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:45.836229 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-69bfabaf-504e-4f32-9129-36892fe38f70 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:45.845877 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-69bfabaf-504e-4f32-9129-36892fe38f70 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:45.847910 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-69bfabaf-504e-4f32-9129-36892fe38f70 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:45.857304 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-69bfabaf-504e-4f32-9129-36892fe38f70 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] 10.222.0.79 "GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90" status: 200 len: 1447 microversion: 2.75 time: 0.192485 Oct 17 13:35:45.867197 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 324/654] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:35:45 2022] GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90 => generated 1447 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:35:45.882246 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3f88f2ad-2fce-4ee3-9ae5-8b3ff021afd5 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:45.882246 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3f88f2ad-2fce-4ee3-9ae5-8b3ff021afd5 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: f869f059-89c3-4462-a309-e27f650d7584] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:45.888928 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f88f2ad-2fce-4ee3-9ae5-8b3ff021afd5 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:45.889421 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f88f2ad-2fce-4ee3-9ae5-8b3ff021afd5 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:45.889851 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f88f2ad-2fce-4ee3-9ae5-8b3ff021afd5 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:45.890553 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f88f2ad-2fce-4ee3-9ae5-8b3ff021afd5 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:45.891002 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f88f2ad-2fce-4ee3-9ae5-8b3ff021afd5 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:45.891456 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f88f2ad-2fce-4ee3-9ae5-8b3ff021afd5 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:46.379721 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3f88f2ad-2fce-4ee3-9ae5-8b3ff021afd5 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:46.388332 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3f88f2ad-2fce-4ee3-9ae5-8b3ff021afd5 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/f869f059-89c3-4462-a309-e27f650d7584" status: 200 len: 1501 microversion: 2.1 time: 0.528884 Oct 17 13:35:46.398026 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 325/655] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:45 2022] GET /compute/v2.1/servers/f869f059-89c3-4462-a309-e27f650d7584 => generated 1501 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:46.403296 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-04874c6a-06a1-44ec-907b-38f0edf570bc tempest-ServersAdminNegativeTestJSON-1416660348 tempest-ServersAdminNegativeTestJSON-1416660348-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:46.406930 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-04874c6a-06a1-44ec-907b-38f0edf570bc tempest-ServersAdminNegativeTestJSON-1416660348 tempest-ServersAdminNegativeTestJSON-1416660348-project-admin] Request method failure captured: Oct 17 13:35:46.406930 n-d-854247-14 devstack@n-api.service[127017]: request: POST /compute/v2.1/servers/f0067ca2-1063-4f5b-901d-d766e56afa39/action HTTP/1.1 Oct 17 13:35:46.406930 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:35:46.406930 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:35:46.406930 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:35:46.406930 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 31 Oct 17 13:35:46.406930 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:35:46.406930 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:35:46.406930 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:35:46.406930 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:35:46.406930 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVn6VmkhfaVG6VeIKMx3qVbBbEjBRYg29fYxwujK-3t22OgLdjtP82VO2AjHee_Ll_n9i2R0A7olZTb8l9TSCOIGso4lNuC9laxnGDN6EM8f4EFK4BRRDrvRHHNKEChsI1peVOxI6ExJd3UXIN4gEGftMpEuzFdUPEOMJMuHsNUyJwQ Oct 17 13:35:46.406930 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:35:46.406930 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:35:46.406930 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:35:46.406930 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:35:46.406930 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:35:46.406930 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:35:46.406930 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: b8e914392c8f47f29110268677be9df5 Oct 17 13:35:46.406930 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1416660348 Oct 17 13:35:46.406930 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member,admin Oct 17 13:35:46.406930 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member,admin Oct 17 13:35:46.408476 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b8e914392c8f47f29110268677be9df5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b8e914392c8f47f29110268677be9df5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b8e914392c8f47f29110268677be9df5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b8e914392c8f47f29110268677be9df5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:35:46.408476 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1416660348 Oct 17 13:35:46.408476 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: b8e914392c8f47f29110268677be9df5 Oct 17 13:35:46.408476 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1416660348 Oct 17 13:35:46.408476 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServersAdminNegativeTestJSON-1416660348-project-admin Oct 17 13:35:46.408476 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:35:46.408476 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:35:46.408476 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 31fc3abdb9b7402da26811eeb714f9c1 Oct 17 13:35:46.408476 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1416660348-project-admin Oct 17 13:35:46.408476 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 13:35:46.408476 n-d-854247-14 devstack@n-api.service[127017]: {"os-resetState": {"state": 1}} Oct 17 13:35:46.408476 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:35:46.408476 n-d-854247-14 devstack@n-api.service[127017]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 17 13:35:46.409295 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'f0067ca2-1063-4f5b-901d-d766e56afa39', 'body': {'os-resetState': {'state': 1}}} Oct 17 13:35:46.409295 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:35:46.409295 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:46.409295 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:35:46.409295 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:35:46.409295 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:35:46.409295 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:35:46.409295 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 17 13:35:46.409295 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:46.409295 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 17 13:35:46.409295 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 17 13:35:46.409295 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:46.409295 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 17 13:35:46.409295 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi 1 Oct 17 13:35:46.409295 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:46.409295 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:35:46.409295 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:46.409295 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:46.409295 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:35:46.409295 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:35:46.409295 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:35:46.409295 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:35:46.410664 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:35:46.410664 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:35:46.410664 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:35:46.410664 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:35:46.410664 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:35:46.410664 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:35:46.410664 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:35:46.410664 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:35:46.410664 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 17 13:35:46.410664 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:46.410664 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:35:46.410664 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:46.410664 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:46.410664 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:35:46.410664 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:35:46.410664 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:35:46.410664 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:35:46.410664 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 17 13:35:46.410664 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:46.412764 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-04874c6a-06a1-44ec-907b-38f0edf570bc tempest-ServersAdminNegativeTestJSON-1416660348 tempest-ServersAdminNegativeTestJSON-1416660348-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:35:46.413777 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-04874c6a-06a1-44ec-907b-38f0edf570bc tempest-ServersAdminNegativeTestJSON-1416660348 tempest-ServersAdminNegativeTestJSON-1416660348-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/f0067ca2-1063-4f5b-901d-d766e56afa39/action" status: 400 len: 120 microversion: 2.1 time: 0.014654 Oct 17 13:35:46.414991 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 326/656] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:35:46 2022] POST /compute/v2.1/servers/f0067ca2-1063-4f5b-901d-d766e56afa39/action => generated 120 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:35:46.422160 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2040ca0e-1abb-4fb8-9866-5d3ea0dfabdd tempest-HypervisorAdminNegativeUnderV252Test-1743953613 tempest-HypervisorAdminNegativeUnderV252Test-1743953613-project] Calling method '.version_select at 0x7f7cd59ba8b0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:46.424357 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2040ca0e-1abb-4fb8-9866-5d3ea0dfabdd tempest-HypervisorAdminNegativeUnderV252Test-1743953613 tempest-HypervisorAdminNegativeUnderV252Test-1743953613-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '8ffc191c424942238bc15e4af32fd187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34ac71ce30f40c5af8c1767f7116c7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:46.426102 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2040ca0e-1abb-4fb8-9866-5d3ea0dfabdd tempest-HypervisorAdminNegativeUnderV252Test-1743953613 tempest-HypervisorAdminNegativeUnderV252Test-1743953613-project] Request method failure captured: Oct 17 13:35:46.426102 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 17 13:35:46.426102 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:35:46.426102 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:35:46.426102 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:35:46.426102 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:35:46.426102 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:35:46.426102 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:35:46.426102 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:35:46.426102 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:35:46.426102 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVoqo4e9dBlFY9xBJkvpXL4JhZJcJK5m6jjDlgMRdmoVfRwmqpOtl-rigsrtv5L7Ok6pPoBihRQVRivI42asRbV9L628jkaar_rqXakZcYjePI0T-PK82xJUDP0ZUtoU_EQWVCFPn-iPBhgVxWW24oJ6ocgszKWAItXeC4vb2sL3qHI Oct 17 13:35:46.426102 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:35:46.426102 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:35:46.426102 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:35:46.426102 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:35:46.426102 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:35:46.426102 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:35:46.426102 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: f34ac71ce30f40c5af8c1767f7116c7f Oct 17 13:35:46.426102 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1743953613 Oct 17 13:35:46.426102 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:35:46.426102 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:35:46.427646 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f34ac71ce30f40c5af8c1767f7116c7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f34ac71ce30f40c5af8c1767f7116c7f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f34ac71ce30f40c5af8c1767f7116c7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f34ac71ce30f40c5af8c1767f7116c7f", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:35:46.427646 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1743953613 Oct 17 13:35:46.427646 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: f34ac71ce30f40c5af8c1767f7116c7f Oct 17 13:35:46.427646 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1743953613 Oct 17 13:35:46.427646 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1743953613-project Oct 17 13:35:46.427646 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:35:46.427646 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:35:46.427646 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 8ffc191c424942238bc15e4af32fd187 Oct 17 13:35:46.427646 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1743953613-project Oct 17 13:35:46.427646 n-d-854247-14 devstack@n-api.service[127017]: method: Oct 17 13:35:46.427646 n-d-854247-14 devstack@n-api.service[127017]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 17 13:35:46.427646 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '1'} Oct 17 13:35:46.428485 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:35:46.428485 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:46.428485 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:35:46.428485 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:35:46.428485 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:35:46.428485 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:35:46.428485 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:35:46.428485 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:35:46.428485 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:35:46.428485 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:35:46.428485 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 17 13:35:46.428485 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 17 13:35:46.428485 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:35:46.428485 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:35:46.428485 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:35:46.428485 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:35:46.428485 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:35:46.428485 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:35:46.428485 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:35:46.429755 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:35:46.429755 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:35:46.429755 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:35:46.429755 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:35:46.429755 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:35:46.429755 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:35:46.429755 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:35:46.429755 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 17 13:35:46.429755 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:46.429755 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:35:46.429755 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:46.429755 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:46.429755 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:35:46.429755 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:35:46.429755 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:35:46.429755 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:35:46.429755 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 17 13:35:46.429755 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:46.434772 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2040ca0e-1abb-4fb8-9866-5d3ea0dfabdd tempest-HypervisorAdminNegativeUnderV252Test-1743953613 tempest-HypervisorAdminNegativeUnderV252Test-1743953613-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:35:46.435866 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2040ca0e-1abb-4fb8-9866-5d3ea0dfabdd tempest-HypervisorAdminNegativeUnderV252Test-1743953613 tempest-HypervisorAdminNegativeUnderV252Test-1743953613-project] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.019679 Oct 17 13:35:46.437011 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 327/657] 10.222.0.79 () {58 vars in 1176 bytes} [Mon Oct 17 13:35:46 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:35:46.446620 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-43741972-1f6d-4f5f-9791-ae6bb96f11f7 tempest-ServersAdminNegativeTestJSON-1416660348 tempest-ServersAdminNegativeTestJSON-1416660348-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:46.449477 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-43741972-1f6d-4f5f-9791-ae6bb96f11f7 tempest-ServersAdminNegativeTestJSON-1416660348 tempest-ServersAdminNegativeTestJSON-1416660348-project-admin] Failed to fetch instance by id 999 {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 17 13:35:46.449998 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-43741972-1f6d-4f5f-9791-ae6bb96f11f7 tempest-ServersAdminNegativeTestJSON-1416660348 tempest-ServersAdminNegativeTestJSON-1416660348-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 17 13:35:46.451775 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-43741972-1f6d-4f5f-9791-ae6bb96f11f7 tempest-ServersAdminNegativeTestJSON-1416660348 tempest-ServersAdminNegativeTestJSON-1416660348-project-admin] Request method failure captured: Oct 17 13:35:46.451775 n-d-854247-14 devstack@n-api.service[127017]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 17 13:35:46.451775 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:35:46.451775 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:35:46.451775 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:35:46.451775 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 37 Oct 17 13:35:46.451775 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:35:46.451775 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:35:46.451775 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:35:46.451775 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:35:46.451775 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVn6VmkhfaVG6VeIKMx3qVbBbEjBRYg29fYxwujK-3t22OgLdjtP82VO2AjHee_Ll_n9i2R0A7olZTb8l9TSCOIGso4lNuC9laxnGDN6EM8f4EFK4BRRDrvRHHNKEChsI1peVOxI6ExJd3UXIN4gEGftMpEuzFdUPEOMJMuHsNUyJwQ Oct 17 13:35:46.451775 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:35:46.451775 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:35:46.451775 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:35:46.451775 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:35:46.451775 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:35:46.451775 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:35:46.451775 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: b8e914392c8f47f29110268677be9df5 Oct 17 13:35:46.451775 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1416660348 Oct 17 13:35:46.451775 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member,admin Oct 17 13:35:46.451775 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member,admin Oct 17 13:35:46.453008 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b8e914392c8f47f29110268677be9df5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b8e914392c8f47f29110268677be9df5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b8e914392c8f47f29110268677be9df5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b8e914392c8f47f29110268677be9df5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:35:46.453008 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1416660348 Oct 17 13:35:46.453008 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: b8e914392c8f47f29110268677be9df5 Oct 17 13:35:46.453008 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1416660348 Oct 17 13:35:46.453008 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServersAdminNegativeTestJSON-1416660348-project-admin Oct 17 13:35:46.453008 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:35:46.453008 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:35:46.453008 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 31fc3abdb9b7402da26811eeb714f9c1 Oct 17 13:35:46.453008 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1416660348-project-admin Oct 17 13:35:46.453008 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 13:35:46.453008 n-d-854247-14 devstack@n-api.service[127017]: {"os-resetState": {"state": "error"}} Oct 17 13:35:46.453008 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:35:46.453008 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 999 could not be found. Oct 17 13:35:46.453760 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 17 13:35:46.453760 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:35:46.453760 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:46.453760 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:35:46.453760 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:35:46.453760 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 17 13:35:46.453760 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 17 13:35:46.453760 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 17 13:35:46.453760 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:46.453760 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:35:46.453760 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:46.453760 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:46.453760 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:35:46.453760 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:35:46.453760 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:35:46.453760 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:35:46.453760 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:35:46.453760 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:35:46.453760 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:35:46.453760 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:35:46.453760 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 17 13:35:46.455090 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 17 13:35:46.455090 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:35:46.455090 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:35:46.455090 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 17 13:35:46.455090 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:46.455090 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:35:46.455090 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:46.455090 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:46.455090 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:35:46.455090 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:35:46.455090 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:35:46.455090 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:35:46.455090 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 17 13:35:46.455090 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:46.455090 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-43741972-1f6d-4f5f-9791-ae6bb96f11f7 tempest-ServersAdminNegativeTestJSON-1416660348 tempest-ServersAdminNegativeTestJSON-1416660348-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:35:46.455090 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-43741972-1f6d-4f5f-9791-ae6bb96f11f7 tempest-ServersAdminNegativeTestJSON-1416660348 tempest-ServersAdminNegativeTestJSON-1416660348-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.015080 Oct 17 13:35:46.460337 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 328/658] 10.222.0.79 () {60 vars in 1179 bytes} [Mon Oct 17 13:35:46 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:35:46.465547 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a2681bae-f8cc-4fdd-b786-386b10488bcd tempest-HypervisorAdminNegativeUnderV252Test-1520507185 tempest-HypervisorAdminNegativeUnderV252Test-1520507185-project-admin] Calling method '.version_select at 0x7f7cd5e70dc0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:46.467341 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a2681bae-f8cc-4fdd-b786-386b10488bcd tempest-HypervisorAdminNegativeUnderV252Test-1520507185 tempest-HypervisorAdminNegativeUnderV252Test-1520507185-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:46.467832 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a2681bae-f8cc-4fdd-b786-386b10488bcd tempest-HypervisorAdminNegativeUnderV252Test-1520507185 tempest-HypervisorAdminNegativeUnderV252Test-1520507185-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:46.468265 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a2681bae-f8cc-4fdd-b786-386b10488bcd tempest-HypervisorAdminNegativeUnderV252Test-1520507185 tempest-HypervisorAdminNegativeUnderV252Test-1520507185-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:46.483731 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-a2681bae-f8cc-4fdd-b786-386b10488bcd tempest-HypervisorAdminNegativeUnderV252Test-1520507185 tempest-HypervisorAdminNegativeUnderV252Test-1520507185-project-admin] HTTP exception thrown: No hypervisor matching '619d65f5-41cc-4249-9e7e-cd0561b2dbc7' could be found. Oct 17 13:35:46.485080 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a2681bae-f8cc-4fdd-b786-386b10488bcd tempest-HypervisorAdminNegativeUnderV252Test-1520507185 tempest-HypervisorAdminNegativeUnderV252Test-1520507185-project-admin] Request method failure captured: Oct 17 13:35:46.485080 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/os-hypervisors/619d65f5-41cc-4249-9e7e-cd0561b2dbc7/servers HTTP/1.1 Oct 17 13:35:46.485080 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:35:46.485080 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:35:46.485080 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:35:46.485080 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:35:46.485080 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:35:46.485080 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:35:46.485080 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:35:46.485080 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:35:46.485080 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVorENMKpNfmHFl0XwBCp14CHhwfWA_ScuTCYw2I-v5DqD3HAassIZwlhwmet8oDVuXRy15ct-vL1TXh0Q0n4608Ffrjp-kS8Ccvshre9VrGs_yOmRZPV-zqh1GqgB1QHw7db-H7DbKiIcGbj3bN4NNUKD1YvUGiRAsT5pLTp2jUtQM Oct 17 13:35:46.485080 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:35:46.485080 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:35:46.485080 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:35:46.485080 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:35:46.485080 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:35:46.485080 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:35:46.485080 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 3946e3580a334eb3996057528aa65e00 Oct 17 13:35:46.485080 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1520507185 Oct 17 13:35:46.485080 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member,admin Oct 17 13:35:46.485080 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member,admin Oct 17 13:35:46.486343 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3946e3580a334eb3996057528aa65e00"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/3946e3580a334eb3996057528aa65e00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3946e3580a334eb3996057528aa65e00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_3946e3580a334eb3996057528aa65e00", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:35:46.486343 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1520507185 Oct 17 13:35:46.486343 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 3946e3580a334eb3996057528aa65e00 Oct 17 13:35:46.486343 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1520507185 Oct 17 13:35:46.486343 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1520507185-project-admin Oct 17 13:35:46.486343 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:35:46.486343 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:35:46.486343 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 267de2a2ca03433493c5f1871950f36d Oct 17 13:35:46.486343 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1520507185-project-admin Oct 17 13:35:46.486343 n-d-854247-14 devstack@n-api.service[127017]: method: Oct 17 13:35:46.486343 n-d-854247-14 devstack@n-api.service[127017]: exception: No hypervisor matching '619d65f5-41cc-4249-9e7e-cd0561b2dbc7' could be found. Oct 17 13:35:46.486343 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '619d65f5-41cc-4249-9e7e-cd0561b2dbc7'} Oct 17 13:35:46.487040 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:35:46.487040 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:46.487040 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:35:46.487040 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:35:46.487040 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:35:46.487040 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:35:46.487040 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:35:46.487040 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:35:46.487040 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:35:46.487040 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:35:46.487040 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 17 13:35:46.487040 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 17 13:35:46.487040 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 17 13:35:46.487040 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 17 13:35:46.487040 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '619d65f5-41cc-4249-9e7e-cd0561b2dbc7' could be found. Oct 17 13:35:46.487040 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:46.487040 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:35:46.487040 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:46.487040 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:46.488175 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:35:46.488175 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:35:46.488175 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:35:46.488175 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:35:46.488175 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '619d65f5-41cc-4249-9e7e-cd0561b2dbc7' could be found. Oct 17 13:35:46.488175 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:46.488175 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a2681bae-f8cc-4fdd-b786-386b10488bcd tempest-HypervisorAdminNegativeUnderV252Test-1520507185 tempest-HypervisorAdminNegativeUnderV252Test-1520507185-project-admin] Returning 404 to user: No hypervisor matching '619d65f5-41cc-4249-9e7e-cd0561b2dbc7' could be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:35:46.488581 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a2681bae-f8cc-4fdd-b786-386b10488bcd tempest-HypervisorAdminNegativeUnderV252Test-1520507185 tempest-HypervisorAdminNegativeUnderV252Test-1520507185-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/619d65f5-41cc-4249-9e7e-cd0561b2dbc7/servers" status: 404 len: 123 microversion: 2.1 time: 0.027069 Oct 17 13:35:46.490356 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 329/659] 10.222.0.79 () {58 vars in 1281 bytes} [Mon Oct 17 13:35:46 2022] GET /compute/v2.1/os-hypervisors/619d65f5-41cc-4249-9e7e-cd0561b2dbc7/servers => generated 123 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:35:46.506798 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-212a808d-6509-473b-88b7-3e0c0641e3b9 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:46.508841 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-212a808d-6509-473b-88b7-3e0c0641e3b9 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] [instance: 88769e75-3f26-45cf-9857-3fa7fc4b478e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:46.524237 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-212a808d-6509-473b-88b7-3e0c0641e3b9 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:46.526894 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-212a808d-6509-473b-88b7-3e0c0641e3b9 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:46.527711 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-212a808d-6509-473b-88b7-3e0c0641e3b9 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:46.530825 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-212a808d-6509-473b-88b7-3e0c0641e3b9 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:46.532757 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-212a808d-6509-473b-88b7-3e0c0641e3b9 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:46.533711 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-212a808d-6509-473b-88b7-3e0c0641e3b9 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:46.588256 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-212a808d-6509-473b-88b7-3e0c0641e3b9 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] [instance: 88769e75-3f26-45cf-9857-3fa7fc4b478e] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:35:46.780523 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-212a808d-6509-473b-88b7-3e0c0641e3b9 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] 10.222.0.79 "DELETE /compute/v2.1/servers/88769e75-3f26-45cf-9857-3fa7fc4b478e" status: 204 len: 0 microversion: 2.1 time: 0.281489 Oct 17 13:35:46.784686 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 330/660] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:35:46 2022] DELETE /compute/v2.1/servers/88769e75-3f26-45cf-9857-3fa7fc4b478e => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:35:46.794906 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5376761f-8eb2-4ae1-8771-674e29bbfcc9 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:46.795662 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5376761f-8eb2-4ae1-8771-674e29bbfcc9 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 4d242145-87ff-473a-bac2-fdd483fb5863] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:46.813221 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5376761f-8eb2-4ae1-8771-674e29bbfcc9 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:46.813734 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5376761f-8eb2-4ae1-8771-674e29bbfcc9 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:46.814179 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5376761f-8eb2-4ae1-8771-674e29bbfcc9 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:46.818942 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5376761f-8eb2-4ae1-8771-674e29bbfcc9 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:46.819621 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5376761f-8eb2-4ae1-8771-674e29bbfcc9 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:46.820091 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5376761f-8eb2-4ae1-8771-674e29bbfcc9 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:47.282079 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5376761f-8eb2-4ae1-8771-674e29bbfcc9 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:47.295996 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5376761f-8eb2-4ae1-8771-674e29bbfcc9 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/4d242145-87ff-473a-bac2-fdd483fb5863" status: 200 len: 1276 microversion: 2.1 time: 0.511427 Oct 17 13:35:47.307679 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 331/661] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:46 2022] GET /compute/v2.1/servers/4d242145-87ff-473a-bac2-fdd483fb5863 => generated 1276 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:47.307679 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e4b302dc-0c00-4776-b7fe-f44e2944b36d tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:47.307679 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e4b302dc-0c00-4776-b7fe-f44e2944b36d tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] [instance: 88769e75-3f26-45cf-9857-3fa7fc4b478e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:47.317028 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e4b302dc-0c00-4776-b7fe-f44e2944b36d tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:47.317551 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e4b302dc-0c00-4776-b7fe-f44e2944b36d tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:47.317991 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e4b302dc-0c00-4776-b7fe-f44e2944b36d tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:47.319638 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e4b302dc-0c00-4776-b7fe-f44e2944b36d tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:47.320122 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e4b302dc-0c00-4776-b7fe-f44e2944b36d tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:47.320570 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e4b302dc-0c00-4776-b7fe-f44e2944b36d tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:47.603980 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7fbf8ba0-ba8b-45ba-aa39-debc86901a04 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] 10.222.0.79 "DELETE /compute/v2.1/os-floating-ips/5ee02426-7042-4e6a-8df7-5211fa976399" status: 202 len: 0 microversion: 2.1 time: 3.683238 Oct 17 13:35:47.605433 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 331/662] 10.222.0.79 () {58 vars in 1263 bytes} [Mon Oct 17 13:35:43 2022] DELETE /compute/v2.1/os-floating-ips/5ee02426-7042-4e6a-8df7-5211fa976399 => generated 0 bytes in 3685 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:35:47.611776 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-dea72e58-0a6e-4b6c-b70c-15a9f7309282 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:47.612450 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-dea72e58-0a6e-4b6c-b70c-15a9f7309282 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] [instance: 51be2144-e969-4e1b-b5da-c43b9a7b7c90] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:47.619032 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dea72e58-0a6e-4b6c-b70c-15a9f7309282 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:47.619556 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dea72e58-0a6e-4b6c-b70c-15a9f7309282 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:47.619985 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dea72e58-0a6e-4b6c-b70c-15a9f7309282 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:47.620675 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dea72e58-0a6e-4b6c-b70c-15a9f7309282 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:47.621152 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dea72e58-0a6e-4b6c-b70c-15a9f7309282 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:47.621560 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dea72e58-0a6e-4b6c-b70c-15a9f7309282 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:47.782333 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-dea72e58-0a6e-4b6c-b70c-15a9f7309282 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:47.791769 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-dea72e58-0a6e-4b6c-b70c-15a9f7309282 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:47.793264 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-dea72e58-0a6e-4b6c-b70c-15a9f7309282 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:47.800207 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-dea72e58-0a6e-4b6c-b70c-15a9f7309282 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] 10.222.0.79 "GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90" status: 200 len: 1447 microversion: 2.75 time: 0.193292 Oct 17 13:35:47.800969 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 332/663] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:35:47 2022] GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90 => generated 1447 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:35:47.805579 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-305e0fd0-79a4-411d-8d9a-22a1d9718327 req-e97da5a5-d7da-4c1c-9881-4f06182909ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f869f059-89c3-4462-a309-e27f650d7584", "name": "network-vif-unplugged", "status": "completed", "tag": "b4a014a2-f1ca-4513-9531-01b335adbbcb"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:47.815381 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-305e0fd0-79a4-411d-8d9a-22a1d9718327 req-e97da5a5-d7da-4c1c-9881-4f06182909ab service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:47.815943 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-305e0fd0-79a4-411d-8d9a-22a1d9718327 req-e97da5a5-d7da-4c1c-9881-4f06182909ab service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:47.816416 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-305e0fd0-79a4-411d-8d9a-22a1d9718327 req-e97da5a5-d7da-4c1c-9881-4f06182909ab service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:47.829972 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e4b302dc-0c00-4776-b7fe-f44e2944b36d tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a685773acdb415591f62ccee7157b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa06a29e779e413484cdfcb27e902525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:47.830890 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-305e0fd0-79a4-411d-8d9a-22a1d9718327 req-e97da5a5-d7da-4c1c-9881-4f06182909ab service nova] Creating event network-vif-unplugged:b4a014a2-f1ca-4513-9531-01b335adbbcb for instance f869f059-89c3-4462-a309-e27f650d7584 on n-h1-854247-14 Oct 17 13:35:47.836287 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-305e0fd0-79a4-411d-8d9a-22a1d9718327 req-e97da5a5-d7da-4c1c-9881-4f06182909ab service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034136 Oct 17 13:35:47.837496 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 333/664] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:35:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:47.838437 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e4b302dc-0c00-4776-b7fe-f44e2944b36d tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] 10.222.0.79 "GET /compute/v2.1/servers/88769e75-3f26-45cf-9857-3fa7fc4b478e" status: 200 len: 1469 microversion: 2.1 time: 0.540260 Oct 17 13:35:47.842875 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5c1ad8a1-48f6-44fd-a972-6935ed9a9183 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:47.843618 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5c1ad8a1-48f6-44fd-a972-6935ed9a9183 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: f869f059-89c3-4462-a309-e27f650d7584] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:47.851245 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5c1ad8a1-48f6-44fd-a972-6935ed9a9183 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:47.851703 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5c1ad8a1-48f6-44fd-a972-6935ed9a9183 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:47.852239 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5c1ad8a1-48f6-44fd-a972-6935ed9a9183 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:47.852952 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5c1ad8a1-48f6-44fd-a972-6935ed9a9183 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:47.853551 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5c1ad8a1-48f6-44fd-a972-6935ed9a9183 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:47.854154 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5c1ad8a1-48f6-44fd-a972-6935ed9a9183 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:47.855448 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 332/665] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:47 2022] GET /compute/v2.1/servers/88769e75-3f26-45cf-9857-3fa7fc4b478e => generated 1469 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:47.860719 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-39be1036-9939-4b8b-b218-ebeb256f06d1 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:47.864687 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-39be1036-9939-4b8b-b218-ebeb256f06d1 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Request method failure captured: Oct 17 13:35:47.864687 n-d-854247-14 devstack@n-api.service[127017]: request: POST /compute/v2.1/servers/3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5/action HTTP/1.1 Oct 17 13:35:47.864687 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:35:47.864687 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:35:47.864687 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:35:47.864687 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 34 Oct 17 13:35:47.864687 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:35:47.864687 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:35:47.864687 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:35:47.864687 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:35:47.864687 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVoL-gc1d7fZFiDCJTbY6EyTWslON31yViZq5o5alXTLiVmOv7GfYptXi_5XRdsqLJZzGNWMspK70-XN--RkM02dNsShias1lA98nrVsRmmokHgNntV3WxX9irmBdM7lsUuVt2oS8wT0QOXoZPdui-Gwkbw-CpLHksrPqCzcu9FOm44 Oct 17 13:35:47.864687 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:35:47.864687 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:35:47.864687 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:35:47.864687 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:35:47.864687 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:35:47.864687 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:35:47.864687 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: bc31d4fa0cd9418584f52e7c46ade866 Oct 17 13:35:47.864687 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 Oct 17 13:35:47.864687 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:35:47.864687 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:35:47.866178 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/bc31d4fa0cd9418584f52e7c46ade866"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/bc31d4fa0cd9418584f52e7c46ade866"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/bc31d4fa0cd9418584f52e7c46ade866"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_bc31d4fa0cd9418584f52e7c46ade866", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:35:47.866178 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 Oct 17 13:35:47.866178 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: bc31d4fa0cd9418584f52e7c46ade866 Oct 17 13:35:47.866178 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 Oct 17 13:35:47.866178 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project Oct 17 13:35:47.866178 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:35:47.866178 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:35:47.866178 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 2a3dfc7f18ec4a6883b62872ab011cc4 Oct 17 13:35:47.866178 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project Oct 17 13:35:47.866178 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 13:35:47.866178 n-d-854247-14 devstack@n-api.service[127017]: {"addFloatingIp": {"address": ""}} Oct 17 13:35:47.866178 n-d-854247-14 devstack@n-api.service[127017]: method: Oct 17 13:35:47.866178 n-d-854247-14 devstack@n-api.service[127017]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 17 13:35:47.867118 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5', 'body': {'addFloatingIp': {'address': ''}}} Oct 17 13:35:47.867118 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:35:47.867118 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:47.867118 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:35:47.867118 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:35:47.867118 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:35:47.867118 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:35:47.867118 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 17 13:35:47.867118 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:47.867118 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 17 13:35:47.867118 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 17 13:35:47.867118 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:47.867118 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 17 13:35:47.867118 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi '' Oct 17 13:35:47.867118 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:47.867118 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:35:47.867118 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:47.867118 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:47.867118 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:35:47.867118 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:35:47.867118 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:35:47.867118 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:35:47.868792 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:35:47.868792 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:35:47.868792 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:35:47.868792 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:35:47.868792 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:35:47.868792 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:35:47.868792 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:35:47.868792 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:35:47.868792 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:35:47.868792 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:35:47.868792 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 17 13:35:47.868792 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:47.868792 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:35:47.868792 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:47.868792 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:47.868792 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:35:47.868792 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:35:47.868792 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:35:47.868792 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:35:47.869881 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 17 13:35:47.869881 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:47.871378 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-39be1036-9939-4b8b-b218-ebeb256f06d1 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:35:47.872686 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-39be1036-9939-4b8b-b218-ebeb256f06d1 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] 10.222.0.79 "POST /compute/v2.1/servers/3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5/action" status: 400 len: 142 microversion: 2.1 time: 0.015780 Oct 17 13:35:47.873271 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 333/666] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:35:47 2022] POST /compute/v2.1/servers/3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5/action => generated 142 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:35:47.884995 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1304b1bd-8cd8-4c7b-841f-11f5a6bc6caa tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:47.887775 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1304b1bd-8cd8-4c7b-841f-11f5a6bc6caa tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] [instance: 3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:47.895468 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1304b1bd-8cd8-4c7b-841f-11f5a6bc6caa tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:47.895961 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1304b1bd-8cd8-4c7b-841f-11f5a6bc6caa tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:47.896393 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1304b1bd-8cd8-4c7b-841f-11f5a6bc6caa tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:47.897099 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1304b1bd-8cd8-4c7b-841f-11f5a6bc6caa tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:47.897561 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1304b1bd-8cd8-4c7b-841f-11f5a6bc6caa tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:47.898391 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1304b1bd-8cd8-4c7b-841f-11f5a6bc6caa tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:47.925854 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1304b1bd-8cd8-4c7b-841f-11f5a6bc6caa tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Acquiring lock "refresh_cache-3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5" {{(pid=127017) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 17 13:35:47.926245 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1304b1bd-8cd8-4c7b-841f-11f5a6bc6caa tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Acquired lock "refresh_cache-3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5" {{(pid=127017) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 17 13:35:48.309593 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1304b1bd-8cd8-4c7b-841f-11f5a6bc6caa tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Releasing lock "refresh_cache-3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5" {{(pid=127017) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 17 13:35:48.311540 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-1304b1bd-8cd8-4c7b-841f-11f5a6bc6caa tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] HTTP exception thrown: floating IP not found Oct 17 13:35:48.316992 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1304b1bd-8cd8-4c7b-841f-11f5a6bc6caa tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Request method failure captured: Oct 17 13:35:48.316992 n-d-854247-14 devstack@n-api.service[127017]: request: POST /compute/v2.1/servers/3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5/action HTTP/1.1 Oct 17 13:35:48.316992 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:35:48.316992 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:35:48.316992 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:35:48.316992 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 41 Oct 17 13:35:48.316992 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:35:48.316992 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:35:48.316992 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:35:48.316992 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:35:48.316992 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVoL-gc1d7fZFiDCJTbY6EyTWslON31yViZq5o5alXTLiVmOv7GfYptXi_5XRdsqLJZzGNWMspK70-XN--RkM02dNsShias1lA98nrVsRmmokHgNntV3WxX9irmBdM7lsUuVt2oS8wT0QOXoZPdui-Gwkbw-CpLHksrPqCzcu9FOm44 Oct 17 13:35:48.316992 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:35:48.316992 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:35:48.316992 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:35:48.316992 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:35:48.316992 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:35:48.316992 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:35:48.316992 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: bc31d4fa0cd9418584f52e7c46ade866 Oct 17 13:35:48.316992 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 Oct 17 13:35:48.316992 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:35:48.316992 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:35:48.318306 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/bc31d4fa0cd9418584f52e7c46ade866"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/bc31d4fa0cd9418584f52e7c46ade866"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/bc31d4fa0cd9418584f52e7c46ade866"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_bc31d4fa0cd9418584f52e7c46ade866", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:35:48.318306 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 Oct 17 13:35:48.318306 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: bc31d4fa0cd9418584f52e7c46ade866 Oct 17 13:35:48.318306 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 Oct 17 13:35:48.318306 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project Oct 17 13:35:48.318306 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:35:48.318306 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:35:48.318306 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 2a3dfc7f18ec4a6883b62872ab011cc4 Oct 17 13:35:48.318306 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project Oct 17 13:35:48.318306 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 13:35:48.318306 n-d-854247-14 devstack@n-api.service[127017]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 17 13:35:48.318306 n-d-854247-14 devstack@n-api.service[127017]: method: Oct 17 13:35:48.318306 n-d-854247-14 devstack@n-api.service[127017]: exception: floating IP not found Oct 17 13:35:48.319153 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 17 13:35:48.319153 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:35:48.319153 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:48.319153 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 17 13:35:48.319153 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 17 13:35:48.319153 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 17 13:35:48.319153 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 17 13:35:48.319153 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 17 13:35:48.319153 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 17 13:35:48.319153 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 17 13:35:48.319153 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 17 13:35:48.319153 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 17 13:35:48.319153 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:48.319153 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:35:48.319153 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:48.319153 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:48.319153 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:35:48.319153 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:35:48.319153 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:35:48.320435 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:35:48.320435 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:35:48.320435 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:35:48.320435 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:35:48.320435 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:35:48.320435 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:35:48.320435 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:35:48.320435 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 17 13:35:48.320435 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 17 13:35:48.320435 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 17 13:35:48.320435 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:48.320435 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:35:48.320435 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:48.320435 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:48.320435 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:35:48.320435 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:35:48.320435 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:35:48.320435 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:35:48.320435 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 17 13:35:48.320435 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:48.321980 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1304b1bd-8cd8-4c7b-841f-11f5a6bc6caa tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Returning 404 to user: floating IP not found {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:35:48.321980 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1304b1bd-8cd8-4c7b-841f-11f5a6bc6caa tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] 10.222.0.79 "POST /compute/v2.1/servers/3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5/action" status: 404 len: 67 microversion: 2.1 time: 0.438473 Oct 17 13:35:48.321980 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 334/667] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:35:47 2022] POST /compute/v2.1/servers/3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5/action => generated 67 bytes in 442 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:35:48.331885 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-886f143e-623b-446e-961d-d19846872207 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:48.332551 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-886f143e-623b-446e-961d-d19846872207 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 4d242145-87ff-473a-bac2-fdd483fb5863] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:48.339553 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-886f143e-623b-446e-961d-d19846872207 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:48.339966 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-886f143e-623b-446e-961d-d19846872207 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:48.340396 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-886f143e-623b-446e-961d-d19846872207 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:48.341415 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-886f143e-623b-446e-961d-d19846872207 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:48.342368 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-886f143e-623b-446e-961d-d19846872207 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:48.342940 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-886f143e-623b-446e-961d-d19846872207 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:48.439640 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5c1ad8a1-48f6-44fd-a972-6935ed9a9183 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:48.452258 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5c1ad8a1-48f6-44fd-a972-6935ed9a9183 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/f869f059-89c3-4462-a309-e27f650d7584" status: 200 len: 1501 microversion: 2.1 time: 0.613375 Oct 17 13:35:48.453669 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 334/668] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:47 2022] GET /compute/v2.1/servers/f869f059-89c3-4462-a309-e27f650d7584 => generated 1501 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:48.460798 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0420f7e2-f34d-476f-932b-0e440ac5953c tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:48.662354 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-0420f7e2-f34d-476f-932b-0e440ac5953c tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 17 13:35:48.667122 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0420f7e2-f34d-476f-932b-0e440ac5953c tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Request method failure captured: Oct 17 13:35:48.667122 n-d-854247-14 devstack@n-api.service[127016]: request: POST /compute/v2.1/servers/3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5/action HTTP/1.1 Oct 17 13:35:48.667122 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:35:48.667122 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:35:48.667122 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:35:48.667122 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 44 Oct 17 13:35:48.667122 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:35:48.667122 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:35:48.667122 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:35:48.667122 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:35:48.667122 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVoL-gc1d7fZFiDCJTbY6EyTWslON31yViZq5o5alXTLiVmOv7GfYptXi_5XRdsqLJZzGNWMspK70-XN--RkM02dNsShias1lA98nrVsRmmokHgNntV3WxX9irmBdM7lsUuVt2oS8wT0QOXoZPdui-Gwkbw-CpLHksrPqCzcu9FOm44 Oct 17 13:35:48.667122 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:35:48.667122 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:35:48.667122 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:35:48.667122 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:35:48.667122 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:35:48.667122 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:35:48.667122 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: bc31d4fa0cd9418584f52e7c46ade866 Oct 17 13:35:48.667122 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 Oct 17 13:35:48.667122 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:35:48.667122 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:35:48.668398 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/bc31d4fa0cd9418584f52e7c46ade866"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/bc31d4fa0cd9418584f52e7c46ade866"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/bc31d4fa0cd9418584f52e7c46ade866"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_bc31d4fa0cd9418584f52e7c46ade866", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:35:48.668398 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 Oct 17 13:35:48.668398 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: bc31d4fa0cd9418584f52e7c46ade866 Oct 17 13:35:48.668398 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 Oct 17 13:35:48.668398 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project Oct 17 13:35:48.668398 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:35:48.668398 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:35:48.668398 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 2a3dfc7f18ec4a6883b62872ab011cc4 Oct 17 13:35:48.668398 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project Oct 17 13:35:48.668398 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:35:48.668398 n-d-854247-14 devstack@n-api.service[127016]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 17 13:35:48.668398 n-d-854247-14 devstack@n-api.service[127016]: method: Oct 17 13:35:48.668398 n-d-854247-14 devstack@n-api.service[127016]: exception: Floating IP not found for address 0.0.0.0. Oct 17 13:35:48.669172 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 17 13:35:48.669172 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:35:48.669172 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:48.669172 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 17 13:35:48.669172 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 17 13:35:48.669172 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 17 13:35:48.669172 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 17 13:35:48.669172 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 17 13:35:48.669172 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 17 13:35:48.669172 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 17 13:35:48.669172 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:48.669172 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:35:48.669172 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:48.669172 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:48.669172 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:35:48.669172 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:35:48.669172 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:35:48.669172 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:35:48.669172 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:35:48.670309 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:35:48.670309 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:35:48.670309 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:35:48.670309 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:35:48.670309 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:35:48.670309 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 17 13:35:48.670309 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 17 13:35:48.670309 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 17 13:35:48.670309 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 17 13:35:48.670309 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 17 13:35:48.670309 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:48.670309 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:35:48.670309 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:48.670309 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:48.670309 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:35:48.670309 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:35:48.670309 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:35:48.670309 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:35:48.670309 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 17 13:35:48.670309 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:48.677014 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0420f7e2-f34d-476f-932b-0e440ac5953c tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:35:48.678269 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0420f7e2-f34d-476f-932b-0e440ac5953c tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] 10.222.0.79 "POST /compute/v2.1/servers/3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5/action" status: 404 len: 88 microversion: 2.1 time: 0.223388 Oct 17 13:35:48.679137 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 335/669] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:35:48 2022] POST /compute/v2.1/servers/3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5/action => generated 88 bytes in 225 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:35:48.691483 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-38e6f388-48a4-4d86-92ee-a0aa7b39f18a tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:48.691953 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-38e6f388-48a4-4d86-92ee-a0aa7b39f18a tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] [instance: 3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:48.701371 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-38e6f388-48a4-4d86-92ee-a0aa7b39f18a tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:48.702194 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-38e6f388-48a4-4d86-92ee-a0aa7b39f18a tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:48.702913 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-38e6f388-48a4-4d86-92ee-a0aa7b39f18a tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:48.703879 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-38e6f388-48a4-4d86-92ee-a0aa7b39f18a tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:48.704613 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-38e6f388-48a4-4d86-92ee-a0aa7b39f18a tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:48.705224 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-38e6f388-48a4-4d86-92ee-a0aa7b39f18a tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:48.736088 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-38e6f388-48a4-4d86-92ee-a0aa7b39f18a tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] [instance: 3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:35:48.869801 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-38e6f388-48a4-4d86-92ee-a0aa7b39f18a tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5" status: 204 len: 0 microversion: 2.1 time: 0.182492 Oct 17 13:35:48.874903 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 336/670] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:35:48 2022] DELETE /compute/v2.1/servers/3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:35:48.883001 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-94cd1aef-ee73-4d4b-8b94-92265dc8189d tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:48.883946 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-94cd1aef-ee73-4d4b-8b94-92265dc8189d tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] [instance: 51be2144-e969-4e1b-b5da-c43b9a7b7c90] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:48.893289 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94cd1aef-ee73-4d4b-8b94-92265dc8189d tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:48.893987 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94cd1aef-ee73-4d4b-8b94-92265dc8189d tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:48.894475 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94cd1aef-ee73-4d4b-8b94-92265dc8189d tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:48.895740 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94cd1aef-ee73-4d4b-8b94-92265dc8189d tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:48.896382 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94cd1aef-ee73-4d4b-8b94-92265dc8189d tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:48.896955 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94cd1aef-ee73-4d4b-8b94-92265dc8189d tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:48.908698 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-886f143e-623b-446e-961d-d19846872207 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:48.919748 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-886f143e-623b-446e-961d-d19846872207 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/4d242145-87ff-473a-bac2-fdd483fb5863" status: 200 len: 1318 microversion: 2.1 time: 0.596557 Oct 17 13:35:48.920085 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:48.924337 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 335/671] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:48 2022] GET /compute/v2.1/servers/4d242145-87ff-473a-bac2-fdd483fb5863 => generated 1318 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:48.934016 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e71e35b7-56c2-4894-9eca-b85c86d4fde4 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:48.934631 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e71e35b7-56c2-4894-9eca-b85c86d4fde4 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] [instance: 88769e75-3f26-45cf-9857-3fa7fc4b478e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:48.954804 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e71e35b7-56c2-4894-9eca-b85c86d4fde4 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:48.955528 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e71e35b7-56c2-4894-9eca-b85c86d4fde4 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:48.956112 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e71e35b7-56c2-4894-9eca-b85c86d4fde4 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:48.963089 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e71e35b7-56c2-4894-9eca-b85c86d4fde4 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:48.963743 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e71e35b7-56c2-4894-9eca-b85c86d4fde4 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:48.964450 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e71e35b7-56c2-4894-9eca-b85c86d4fde4 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:49.082376 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-94cd1aef-ee73-4d4b-8b94-92265dc8189d tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:49.099473 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-94cd1aef-ee73-4d4b-8b94-92265dc8189d tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:49.100956 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-94cd1aef-ee73-4d4b-8b94-92265dc8189d tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:49.111629 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-94cd1aef-ee73-4d4b-8b94-92265dc8189d tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] 10.222.0.79 "GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90" status: 200 len: 1447 microversion: 2.75 time: 0.235059 Oct 17 13:35:49.123281 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 337/672] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:35:48 2022] GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90 => generated 1447 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:35:49.123281 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9d7a330c-22aa-403e-a0e7-eabe64b19d5e tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:49.123281 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9d7a330c-22aa-403e-a0e7-eabe64b19d5e tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] [instance: 3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:49.127801 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9d7a330c-22aa-403e-a0e7-eabe64b19d5e tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:49.128892 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9d7a330c-22aa-403e-a0e7-eabe64b19d5e tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:49.129484 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9d7a330c-22aa-403e-a0e7-eabe64b19d5e tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:49.130358 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9d7a330c-22aa-403e-a0e7-eabe64b19d5e tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:49.131986 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9d7a330c-22aa-403e-a0e7-eabe64b19d5e tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:49.132638 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9d7a330c-22aa-403e-a0e7-eabe64b19d5e tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:49.509216 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e71e35b7-56c2-4894-9eca-b85c86d4fde4 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a685773acdb415591f62ccee7157b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa06a29e779e413484cdfcb27e902525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:49.519079 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e71e35b7-56c2-4894-9eca-b85c86d4fde4 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] 10.222.0.79 "GET /compute/v2.1/servers/88769e75-3f26-45cf-9857-3fa7fc4b478e" status: 200 len: 1469 microversion: 2.1 time: 0.593559 Oct 17 13:35:49.520786 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 336/673] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:48 2022] GET /compute/v2.1/servers/88769e75-3f26-45cf-9857-3fa7fc4b478e => generated 1469 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:49.544411 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-143a6119-ad31-41ca-a4f7-a500dd4d64a0 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:49.559580 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-143a6119-ad31-41ca-a4f7-a500dd4d64a0 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: f869f059-89c3-4462-a309-e27f650d7584] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:49.580024 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-143a6119-ad31-41ca-a4f7-a500dd4d64a0 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:49.580793 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-143a6119-ad31-41ca-a4f7-a500dd4d64a0 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:49.582336 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-143a6119-ad31-41ca-a4f7-a500dd4d64a0 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:49.583799 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-143a6119-ad31-41ca-a4f7-a500dd4d64a0 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:49.585329 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-143a6119-ad31-41ca-a4f7-a500dd4d64a0 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:49.586118 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-143a6119-ad31-41ca-a4f7-a500dd4d64a0 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:49.731875 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9d7a330c-22aa-403e-a0e7-eabe64b19d5e tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3dfc7f18ec4a6883b62872ab011cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc31d4fa0cd9418584f52e7c46ade866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:49.741977 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9d7a330c-22aa-403e-a0e7-eabe64b19d5e tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] 10.222.0.79 "GET /compute/v2.1/servers/3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5" status: 200 len: 1541 microversion: 2.1 time: 0.628368 Oct 17 13:35:49.743538 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 338/674] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:49 2022] GET /compute/v2.1/servers/3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5 => generated 1541 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:49.857749 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-8acee49c-922f-43a8-96f9-353070203302 req-a21deaa7-0ff2-4bcb-b2ec-9000a287fffc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f869f059-89c3-4462-a309-e27f650d7584", "tag": "b4a014a2-f1ca-4513-9531-01b335adbbcb"}, {"server_uuid": "88769e75-3f26-45cf-9857-3fa7fc4b478e", "name": "network-vif-deleted", "tag": "9a770d5d-ee5c-4b9d-907c-d0aa8427ba10"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:49.863131 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=10 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:49.869916 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-8acee49c-922f-43a8-96f9-353070203302 req-a21deaa7-0ff2-4bcb-b2ec-9000a287fffc service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:49.870404 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-8acee49c-922f-43a8-96f9-353070203302 req-a21deaa7-0ff2-4bcb-b2ec-9000a287fffc service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:49.870814 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-8acee49c-922f-43a8-96f9-353070203302 req-a21deaa7-0ff2-4bcb-b2ec-9000a287fffc service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:49.904946 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-8acee49c-922f-43a8-96f9-353070203302 req-a21deaa7-0ff2-4bcb-b2ec-9000a287fffc service nova] Creating event network-changed:b4a014a2-f1ca-4513-9531-01b335adbbcb for instance f869f059-89c3-4462-a309-e27f650d7584 on n-h1-854247-14 Oct 17 13:35:49.905482 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-8acee49c-922f-43a8-96f9-353070203302 req-a21deaa7-0ff2-4bcb-b2ec-9000a287fffc service nova] Creating event network-vif-deleted:9a770d5d-ee5c-4b9d-907c-d0aa8427ba10 for instance 88769e75-3f26-45cf-9857-3fa7fc4b478e on n-h2-854247-14 Oct 17 13:35:49.926412 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-8acee49c-922f-43a8-96f9-353070203302 req-a21deaa7-0ff2-4bcb-b2ec-9000a287fffc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.076034 Oct 17 13:35:49.930319 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 339/675] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:35:49 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:35:49.957756 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-27fda2af-995a-49eb-a2b5-2124bab00518 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:49.959195 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-27fda2af-995a-49eb-a2b5-2124bab00518 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 4d242145-87ff-473a-bac2-fdd483fb5863] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:49.969227 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-27fda2af-995a-49eb-a2b5-2124bab00518 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:49.969784 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-27fda2af-995a-49eb-a2b5-2124bab00518 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:49.970280 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-27fda2af-995a-49eb-a2b5-2124bab00518 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:49.971143 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-27fda2af-995a-49eb-a2b5-2124bab00518 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:49.971979 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-27fda2af-995a-49eb-a2b5-2124bab00518 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:49.972613 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-27fda2af-995a-49eb-a2b5-2124bab00518 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:49.981765 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-143a6119-ad31-41ca-a4f7-a500dd4d64a0 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:49.994422 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-143a6119-ad31-41ca-a4f7-a500dd4d64a0 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/f869f059-89c3-4462-a309-e27f650d7584" status: 200 len: 1501 microversion: 2.1 time: 0.469170 Oct 17 13:35:49.995117 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 337/676] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:49 2022] GET /compute/v2.1/servers/f869f059-89c3-4462-a309-e27f650d7584 => generated 1501 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:50.146218 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-18b05dc7-657e-4447-b548-9fb0f5798a7c tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:50.147700 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-18b05dc7-657e-4447-b548-9fb0f5798a7c tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] [instance: 51be2144-e969-4e1b-b5da-c43b9a7b7c90] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:50.159560 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-18b05dc7-657e-4447-b548-9fb0f5798a7c tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:50.160400 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-18b05dc7-657e-4447-b548-9fb0f5798a7c tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:50.161053 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-18b05dc7-657e-4447-b548-9fb0f5798a7c tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:50.162016 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-18b05dc7-657e-4447-b548-9fb0f5798a7c tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:50.162942 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-18b05dc7-657e-4447-b548-9fb0f5798a7c tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:50.163400 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-18b05dc7-657e-4447-b548-9fb0f5798a7c tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:50.606239 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-18b05dc7-657e-4447-b548-9fb0f5798a7c tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:50.614611 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-18b05dc7-657e-4447-b548-9fb0f5798a7c tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:50.615980 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-18b05dc7-657e-4447-b548-9fb0f5798a7c tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:50.621758 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-18b05dc7-657e-4447-b548-9fb0f5798a7c tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] 10.222.0.79 "GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90" status: 200 len: 1447 microversion: 2.75 time: 0.480872 Oct 17 13:35:50.635952 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 338/677] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:35:50 2022] GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90 => generated 1447 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:35:50.648469 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5816e615-622b-405a-bf5e-0d3a8d13f9b4 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:50.649365 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5816e615-622b-405a-bf5e-0d3a8d13f9b4 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] [instance: 88769e75-3f26-45cf-9857-3fa7fc4b478e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:50.656083 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5816e615-622b-405a-bf5e-0d3a8d13f9b4 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:50.657591 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5816e615-622b-405a-bf5e-0d3a8d13f9b4 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:50.658176 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5816e615-622b-405a-bf5e-0d3a8d13f9b4 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:50.659060 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5816e615-622b-405a-bf5e-0d3a8d13f9b4 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:50.659707 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5816e615-622b-405a-bf5e-0d3a8d13f9b4 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:50.660282 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5816e615-622b-405a-bf5e-0d3a8d13f9b4 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:50.709608 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5816e615-622b-405a-bf5e-0d3a8d13f9b4 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:50.711032 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5816e615-622b-405a-bf5e-0d3a8d13f9b4 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:50.711772 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5816e615-622b-405a-bf5e-0d3a8d13f9b4 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:50.712487 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-5816e615-622b-405a-bf5e-0d3a8d13f9b4 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lazy-loading 'fault' on Instance uuid 88769e75-3f26-45cf-9857-3fa7fc4b478e {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:35:50.833268 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5816e615-622b-405a-bf5e-0d3a8d13f9b4 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a685773acdb415591f62ccee7157b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa06a29e779e413484cdfcb27e902525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:50.845526 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5816e615-622b-405a-bf5e-0d3a8d13f9b4 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] 10.222.0.79 "GET /compute/v2.1/servers/88769e75-3f26-45cf-9857-3fa7fc4b478e" status: 200 len: 1312 microversion: 2.1 time: 0.208226 Oct 17 13:35:50.846591 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 339/678] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:50 2022] GET /compute/v2.1/servers/88769e75-3f26-45cf-9857-3fa7fc4b478e => generated 1312 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:50.863707 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-152470cb-940f-4258-a94e-9ac6c4d82b07 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:50.864983 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-152470cb-940f-4258-a94e-9ac6c4d82b07 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] [instance: 3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:50.876937 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-152470cb-940f-4258-a94e-9ac6c4d82b07 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:50.877524 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-152470cb-940f-4258-a94e-9ac6c4d82b07 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:50.878384 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-152470cb-940f-4258-a94e-9ac6c4d82b07 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:50.879910 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-152470cb-940f-4258-a94e-9ac6c4d82b07 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:50.880428 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-152470cb-940f-4258-a94e-9ac6c4d82b07 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:50.880920 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-152470cb-940f-4258-a94e-9ac6c4d82b07 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:51.095489 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-27fda2af-995a-49eb-a2b5-2124bab00518 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:51.097796 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-152470cb-940f-4258-a94e-9ac6c4d82b07 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3dfc7f18ec4a6883b62872ab011cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc31d4fa0cd9418584f52e7c46ade866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:51.110216 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-27fda2af-995a-49eb-a2b5-2124bab00518 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/4d242145-87ff-473a-bac2-fdd483fb5863" status: 200 len: 1318 microversion: 2.1 time: 1.163645 Oct 17 13:35:51.123211 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 340/679] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:49 2022] GET /compute/v2.1/servers/4d242145-87ff-473a-bac2-fdd483fb5863 => generated 1318 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:51.123211 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-195526af-2813-42ad-ac55-d9f9bd76668e tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:51.123211 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-195526af-2813-42ad-ac55-d9f9bd76668e tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: f869f059-89c3-4462-a309-e27f650d7584] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:51.137875 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-195526af-2813-42ad-ac55-d9f9bd76668e tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:51.138367 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-195526af-2813-42ad-ac55-d9f9bd76668e tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:51.138797 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-195526af-2813-42ad-ac55-d9f9bd76668e tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:51.139239 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-152470cb-940f-4258-a94e-9ac6c4d82b07 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] 10.222.0.79 "GET /compute/v2.1/servers/3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5" status: 200 len: 1499 microversion: 2.1 time: 0.291039 Oct 17 13:35:51.140617 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 340/680] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:50 2022] GET /compute/v2.1/servers/3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5 => generated 1499 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:51.140733 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-195526af-2813-42ad-ac55-d9f9bd76668e tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:51.141122 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-195526af-2813-42ad-ac55-d9f9bd76668e tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:51.141619 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-195526af-2813-42ad-ac55-d9f9bd76668e tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:51.566055 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=4 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:51.664198 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-195526af-2813-42ad-ac55-d9f9bd76668e tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:51.672710 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-195526af-2813-42ad-ac55-d9f9bd76668e tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/f869f059-89c3-4462-a309-e27f650d7584" status: 200 len: 1501 microversion: 2.1 time: 0.560364 Oct 17 13:35:51.673299 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 341/681] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:51 2022] GET /compute/v2.1/servers/f869f059-89c3-4462-a309-e27f650d7584 => generated 1501 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:51.687499 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d68c5e2a-34b7-43c4-8d5c-eb81e9b9ff08 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:51.688121 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d68c5e2a-34b7-43c4-8d5c-eb81e9b9ff08 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] [instance: 51be2144-e969-4e1b-b5da-c43b9a7b7c90] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:51.705652 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d68c5e2a-34b7-43c4-8d5c-eb81e9b9ff08 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:51.706147 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d68c5e2a-34b7-43c4-8d5c-eb81e9b9ff08 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:51.706582 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d68c5e2a-34b7-43c4-8d5c-eb81e9b9ff08 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:51.707325 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d68c5e2a-34b7-43c4-8d5c-eb81e9b9ff08 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:51.707781 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d68c5e2a-34b7-43c4-8d5c-eb81e9b9ff08 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:51.708194 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d68c5e2a-34b7-43c4-8d5c-eb81e9b9ff08 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:51.735957 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=22 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:51.783343 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-51e866d9-4678-4b25-9c0d-b401cc2e29a7 tempest-FloatingIPsNegativeTestJSON-780536323 tempest-FloatingIPsNegativeTestJSON-780536323-project] Calling method '.version_select at 0x7f7cd5906040>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:51.900993 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d68c5e2a-34b7-43c4-8d5c-eb81e9b9ff08 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:51.915642 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d68c5e2a-34b7-43c4-8d5c-eb81e9b9ff08 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:51.917162 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d68c5e2a-34b7-43c4-8d5c-eb81e9b9ff08 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:51.935099 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d68c5e2a-34b7-43c4-8d5c-eb81e9b9ff08 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] 10.222.0.79 "GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90" status: 200 len: 1447 microversion: 2.75 time: 0.256941 Oct 17 13:35:51.937428 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 342/682] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:35:51 2022] GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90 => generated 1447 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:35:51.949890 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b04ffd1c-f162-4d9b-b640-af049c4b66ae tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:51.951301 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b04ffd1c-f162-4d9b-b640-af049c4b66ae tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] [instance: 88769e75-3f26-45cf-9857-3fa7fc4b478e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:51.962448 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:51.965091 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b04ffd1c-f162-4d9b-b640-af049c4b66ae tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:51.965757 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b04ffd1c-f162-4d9b-b640-af049c4b66ae tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:51.966624 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b04ffd1c-f162-4d9b-b640-af049c4b66ae tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:51.967615 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b04ffd1c-f162-4d9b-b640-af049c4b66ae tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:51.968217 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b04ffd1c-f162-4d9b-b640-af049c4b66ae tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:51.968784 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b04ffd1c-f162-4d9b-b640-af049c4b66ae tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:51.982949 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-51e866d9-4678-4b25-9c0d-b401cc2e29a7 tempest-FloatingIPsNegativeTestJSON-780536323 tempest-FloatingIPsNegativeTestJSON-780536323-project] 10.222.0.79 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.421765 Oct 17 13:35:51.990296 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-b04ffd1c-f162-4d9b-b640-af049c4b66ae tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] HTTP exception thrown: Instance 88769e75-3f26-45cf-9857-3fa7fc4b478e could not be found. Oct 17 13:35:51.994644 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 341/683] 10.222.0.79 () {58 vars in 1149 bytes} [Mon Oct 17 13:35:51 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 17 13:35:51.995139 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b04ffd1c-f162-4d9b-b640-af049c4b66ae tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Request method failure captured: Oct 17 13:35:51.995139 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/88769e75-3f26-45cf-9857-3fa7fc4b478e HTTP/1.1 Oct 17 13:35:51.995139 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:35:51.995139 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:35:51.995139 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:35:51.995139 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:35:51.995139 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:35:51.995139 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:35:51.995139 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:35:51.995139 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:35:51.995139 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVn5nuoGUdTT_btPej0PpqQjyPKw7G0oMEOXkyZaupgCj-i-2svlxKzfGszUHkiRIurIgV-YcjAn4w2BhE5EQyST6Zkm_4SaVKY2PlsmJyOffKN9jPOXYZuNgsFsAtut9Xe7xpsgjxj606zivm3UNf67ln4mzlcoG799ANK9R2IHpdE Oct 17 13:35:51.995139 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:35:51.995139 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:35:51.995139 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:35:51.995139 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:35:51.995139 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:35:51.995139 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:35:51.995139 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: aa06a29e779e413484cdfcb27e902525 Oct 17 13:35:51.995139 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1557041198 Oct 17 13:35:51.995139 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:35:51.995139 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:35:51.996718 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/aa06a29e779e413484cdfcb27e902525"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/aa06a29e779e413484cdfcb27e902525"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/aa06a29e779e413484cdfcb27e902525"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_aa06a29e779e413484cdfcb27e902525", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:35:51.996718 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1557041198 Oct 17 13:35:51.996718 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: aa06a29e779e413484cdfcb27e902525 Oct 17 13:35:51.996718 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1557041198 Oct 17 13:35:51.996718 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServersAdminNegativeTestJSON-1557041198-project Oct 17 13:35:51.996718 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:35:51.996718 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:35:51.996718 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 4a685773acdb415591f62ccee7157b6a Oct 17 13:35:51.996718 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1557041198-project Oct 17 13:35:51.996718 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:35:51.996718 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 88769e75-3f26-45cf-9857-3fa7fc4b478e could not be found. Oct 17 13:35:51.996718 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '88769e75-3f26-45cf-9857-3fa7fc4b478e'} Oct 17 13:35:51.997581 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:35:51.997581 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:51.997581 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:35:51.997581 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:35:51.997581 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:35:51.997581 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:35:51.997581 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:35:51.997581 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:35:51.997581 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:35:51.997581 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:35:51.997581 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88769e75-3f26-45cf-9857-3fa7fc4b478e could not be found. Oct 17 13:35:51.997581 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:51.997581 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:35:51.997581 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:51.997581 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:51.997581 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:35:51.997581 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:35:51.997581 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:35:51.997581 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:35:51.997581 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:35:51.998946 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:35:51.998946 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:35:51.998946 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:35:51.998946 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:35:51.998946 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:35:51.998946 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:35:51.998946 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:35:51.998946 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88769e75-3f26-45cf-9857-3fa7fc4b478e could not be found. Oct 17 13:35:51.998946 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:51.998946 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:35:51.998946 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:51.998946 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:51.998946 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:35:51.998946 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:35:51.998946 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:35:51.998946 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:35:51.998946 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88769e75-3f26-45cf-9857-3fa7fc4b478e could not be found. Oct 17 13:35:51.998946 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:52.001497 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b04ffd1c-f162-4d9b-b640-af049c4b66ae tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Returning 404 to user: Instance 88769e75-3f26-45cf-9857-3fa7fc4b478e could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:35:52.002512 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b04ffd1c-f162-4d9b-b640-af049c4b66ae tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] 10.222.0.79 "GET /compute/v2.1/servers/88769e75-3f26-45cf-9857-3fa7fc4b478e" status: 404 len: 111 microversion: 2.1 time: 0.063946 Oct 17 13:35:52.002925 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-59b6747e-cb43-4d20-a247-64d16ebd0424 req-c515e0c7-97a9-4a66-adbf-ea465dcb1a49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5", "name": "network-vif-deleted", "tag": "bb330b1e-ec56-4fc5-b017-d997716bf0ba"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:52.003511 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 343/684] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:51 2022] GET /compute/v2.1/servers/88769e75-3f26-45cf-9857-3fa7fc4b478e => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:35:52.013165 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-794565d7-6382-435c-b5bb-7491ecbfc077 tempest-FloatingIPsNegativeTestJSON-780536323 tempest-FloatingIPsNegativeTestJSON-780536323-project] Action: 'create', calling method: .version_select at 0x7f7cd5b3f0d0>, body: {"pool": "non_exist_pool"} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:52.035343 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-59b6747e-cb43-4d20-a247-64d16ebd0424 req-c515e0c7-97a9-4a66-adbf-ea465dcb1a49 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:52.036856 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-59b6747e-cb43-4d20-a247-64d16ebd0424 req-c515e0c7-97a9-4a66-adbf-ea465dcb1a49 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:52.039295 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-59b6747e-cb43-4d20-a247-64d16ebd0424 req-c515e0c7-97a9-4a66-adbf-ea465dcb1a49 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:52.067587 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-59b6747e-cb43-4d20-a247-64d16ebd0424 req-c515e0c7-97a9-4a66-adbf-ea465dcb1a49 service nova] Creating event network-vif-deleted:bb330b1e-ec56-4fc5-b017-d997716bf0ba for instance 3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5 on n-h2-854247-14 Oct 17 13:35:52.077364 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-59b6747e-cb43-4d20-a247-64d16ebd0424 req-c515e0c7-97a9-4a66-adbf-ea465dcb1a49 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077329 Oct 17 13:35:52.079297 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 342/685] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:35:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:52.088129 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-924bceb2-11e7-4d26-ae81-19f86b6c32ef tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:52.088731 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-924bceb2-11e7-4d26-ae81-19f86b6c32ef tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] [instance: f0067ca2-1063-4f5b-901d-d766e56afa39] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:52.107102 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-924bceb2-11e7-4d26-ae81-19f86b6c32ef tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:52.109926 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-924bceb2-11e7-4d26-ae81-19f86b6c32ef tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:52.110375 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-924bceb2-11e7-4d26-ae81-19f86b6c32ef tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:52.111102 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-924bceb2-11e7-4d26-ae81-19f86b6c32ef tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:52.111586 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-924bceb2-11e7-4d26-ae81-19f86b6c32ef tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:52.112008 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-924bceb2-11e7-4d26-ae81-19f86b6c32ef tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:52.163625 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-924bceb2-11e7-4d26-ae81-19f86b6c32ef tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] [instance: f0067ca2-1063-4f5b-901d-d766e56afa39] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:35:52.168778 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:52.172528 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-794565d7-6382-435c-b5bb-7491ecbfc077 tempest-FloatingIPsNegativeTestJSON-780536323 tempest-FloatingIPsNegativeTestJSON-780536323-project] HTTP exception thrown: Floating IP pool not found. Oct 17 13:35:52.174032 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-794565d7-6382-435c-b5bb-7491ecbfc077 tempest-FloatingIPsNegativeTestJSON-780536323 tempest-FloatingIPsNegativeTestJSON-780536323-project] Request method failure captured: Oct 17 13:35:52.174032 n-d-854247-14 devstack@n-api.service[127016]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 17 13:35:52.174032 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:35:52.174032 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:35:52.174032 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:35:52.174032 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 26 Oct 17 13:35:52.174032 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:35:52.174032 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:35:52.174032 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:35:52.174032 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:35:52.174032 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVo3wV-pDs609Su4_ikvtF405TqjZxpI51FZCImRnRh68EGx2MMh_MntKunQyZ8GZWq-RdTtooUJk2JhgALhg6Alodc0ZRffaXyxSig-Sso3xX5EXaOVFRNtgPjZoslT5Nxsq7sB9UrYcpLor13SK2eWEQ42_Z-oATo1JbWdQF_upOw Oct 17 13:35:52.174032 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:35:52.174032 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:35:52.174032 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:35:52.174032 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:35:52.174032 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:35:52.174032 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:35:52.174032 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 58bb4cfc2a5e4f08862ee2cba40d488f Oct 17 13:35:52.174032 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-780536323 Oct 17 13:35:52.174032 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:35:52.174032 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:35:52.175573 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/58bb4cfc2a5e4f08862ee2cba40d488f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/58bb4cfc2a5e4f08862ee2cba40d488f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/58bb4cfc2a5e4f08862ee2cba40d488f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_58bb4cfc2a5e4f08862ee2cba40d488f", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:35:52.175573 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-780536323 Oct 17 13:35:52.175573 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 58bb4cfc2a5e4f08862ee2cba40d488f Oct 17 13:35:52.175573 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-780536323 Oct 17 13:35:52.175573 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-FloatingIPsNegativeTestJSON-780536323-project Oct 17 13:35:52.175573 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:35:52.175573 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:35:52.175573 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: f7e8780605ab42c59feebf057824fef3 Oct 17 13:35:52.175573 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-780536323-project Oct 17 13:35:52.175573 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:35:52.175573 n-d-854247-14 devstack@n-api.service[127016]: {"pool": "non_exist_pool"} Oct 17 13:35:52.175573 n-d-854247-14 devstack@n-api.service[127016]: method: Oct 17 13:35:52.175573 n-d-854247-14 devstack@n-api.service[127016]: exception: Floating IP pool not found. Oct 17 13:35:52.175573 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 17 13:35:52.175573 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:35:52.176589 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:52.176589 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 17 13:35:52.176589 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 17 13:35:52.176589 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 17 13:35:52.176589 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 17 13:35:52.176589 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 17 13:35:52.176589 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 17 13:35:52.176589 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 17 13:35:52.176589 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:52.176589 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:35:52.176589 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:52.176589 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:52.176589 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:35:52.176589 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:35:52.176589 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:35:52.176589 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:35:52.176589 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:35:52.176589 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:35:52.176589 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:35:52.176589 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:35:52.177968 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 17 13:35:52.177968 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:35:52.177968 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 17 13:35:52.177968 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:52.177968 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:35:52.177968 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:52.177968 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:52.177968 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:35:52.177968 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:35:52.177968 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:35:52.177968 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:35:52.177968 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 17 13:35:52.177968 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:52.177968 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-794565d7-6382-435c-b5bb-7491ecbfc077 tempest-FloatingIPsNegativeTestJSON-780536323 tempest-FloatingIPsNegativeTestJSON-780536323-project] Returning 404 to user: Floating IP pool not found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:35:52.177968 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-794565d7-6382-435c-b5bb-7491ecbfc077 tempest-FloatingIPsNegativeTestJSON-780536323 tempest-FloatingIPsNegativeTestJSON-780536323-project] 10.222.0.79 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.170800 Oct 17 13:35:52.179019 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 344/686] 10.222.0.79 () {60 vars in 1170 bytes} [Mon Oct 17 13:35:52 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:35:52.180645 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-5be49a4e-13af-4be4-b22c-99f4a3b88262 req-0f65cd85-8f5e-4c9c-bf58-3fbf345584b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d242145-87ff-473a-bac2-fdd483fb5863", "tag": "a9ccbd26-cae4-415a-95db-3c249567971a"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:52.210861 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-5be49a4e-13af-4be4-b22c-99f4a3b88262 req-0f65cd85-8f5e-4c9c-bf58-3fbf345584b9 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:52.211433 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-5be49a4e-13af-4be4-b22c-99f4a3b88262 req-0f65cd85-8f5e-4c9c-bf58-3fbf345584b9 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:52.212270 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-5be49a4e-13af-4be4-b22c-99f4a3b88262 req-0f65cd85-8f5e-4c9c-bf58-3fbf345584b9 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:52.232612 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-5be49a4e-13af-4be4-b22c-99f4a3b88262 req-0f65cd85-8f5e-4c9c-bf58-3fbf345584b9 service nova] Creating event network-changed:a9ccbd26-cae4-415a-95db-3c249567971a for instance 4d242145-87ff-473a-bac2-fdd483fb5863 on n-h1-854247-14 Oct 17 13:35:52.247597 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-5be49a4e-13af-4be4-b22c-99f4a3b88262 req-0f65cd85-8f5e-4c9c-bf58-3fbf345584b9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070372 Oct 17 13:35:52.248585 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 345/687] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:52.253951 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a02dafec-ae79-43d7-a098-34531422a858 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:52.261488 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a02dafec-ae79-43d7-a098-34531422a858 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 4d242145-87ff-473a-bac2-fdd483fb5863] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:52.285491 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a02dafec-ae79-43d7-a098-34531422a858 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:52.286242 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a02dafec-ae79-43d7-a098-34531422a858 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:52.289845 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a02dafec-ae79-43d7-a098-34531422a858 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:52.291007 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a02dafec-ae79-43d7-a098-34531422a858 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:52.292142 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a02dafec-ae79-43d7-a098-34531422a858 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:52.292984 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a02dafec-ae79-43d7-a098-34531422a858 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:52.296935 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:UPDATE=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:52.310431 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-924bceb2-11e7-4d26-ae81-19f86b6c32ef tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] 10.222.0.79 "DELETE /compute/v2.1/servers/f0067ca2-1063-4f5b-901d-d766e56afa39" status: 204 len: 0 microversion: 2.1 time: 0.229666 Oct 17 13:35:52.311992 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 343/688] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:35:52 2022] DELETE /compute/v2.1/servers/f0067ca2-1063-4f5b-901d-d766e56afa39 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:35:52.318829 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ddaac23f-ffc7-4cab-9655-fb0305bac689 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:52.319804 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ddaac23f-ffc7-4cab-9655-fb0305bac689 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] [instance: 3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:52.337330 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ddaac23f-ffc7-4cab-9655-fb0305bac689 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:52.338113 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ddaac23f-ffc7-4cab-9655-fb0305bac689 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:52.343647 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ddaac23f-ffc7-4cab-9655-fb0305bac689 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:52.344404 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ddaac23f-ffc7-4cab-9655-fb0305bac689 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:52.344868 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ddaac23f-ffc7-4cab-9655-fb0305bac689 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:52.345443 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ddaac23f-ffc7-4cab-9655-fb0305bac689 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:52.374845 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-ddaac23f-ffc7-4cab-9655-fb0305bac689 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] HTTP exception thrown: Instance 3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5 could not be found. Oct 17 13:35:52.377441 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ddaac23f-ffc7-4cab-9655-fb0305bac689 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Request method failure captured: Oct 17 13:35:52.377441 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5 HTTP/1.1 Oct 17 13:35:52.377441 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:35:52.377441 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:35:52.377441 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:35:52.377441 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:35:52.377441 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:35:52.377441 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:35:52.377441 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:35:52.377441 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:35:52.377441 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVoL-gc1d7fZFiDCJTbY6EyTWslON31yViZq5o5alXTLiVmOv7GfYptXi_5XRdsqLJZzGNWMspK70-XN--RkM02dNsShias1lA98nrVsRmmokHgNntV3WxX9irmBdM7lsUuVt2oS8wT0QOXoZPdui-Gwkbw-CpLHksrPqCzcu9FOm44 Oct 17 13:35:52.377441 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:35:52.377441 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:35:52.377441 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:35:52.377441 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:35:52.377441 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:35:52.377441 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:35:52.377441 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: bc31d4fa0cd9418584f52e7c46ade866 Oct 17 13:35:52.377441 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 Oct 17 13:35:52.377441 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:35:52.377441 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:35:52.379008 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/bc31d4fa0cd9418584f52e7c46ade866"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/bc31d4fa0cd9418584f52e7c46ade866"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/bc31d4fa0cd9418584f52e7c46ade866"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_bc31d4fa0cd9418584f52e7c46ade866", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:35:52.379008 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 Oct 17 13:35:52.379008 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: bc31d4fa0cd9418584f52e7c46ade866 Oct 17 13:35:52.379008 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 Oct 17 13:35:52.379008 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project Oct 17 13:35:52.379008 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:35:52.379008 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:35:52.379008 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 2a3dfc7f18ec4a6883b62872ab011cc4 Oct 17 13:35:52.379008 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project Oct 17 13:35:52.379008 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:35:52.379008 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5 could not be found. Oct 17 13:35:52.379966 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5'} Oct 17 13:35:52.379966 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:35:52.379966 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:52.379966 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:35:52.379966 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:35:52.379966 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:35:52.379966 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:35:52.379966 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:35:52.379966 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:35:52.379966 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:35:52.379966 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:35:52.379966 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5 could not be found. Oct 17 13:35:52.379966 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:52.379966 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:35:52.379966 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:52.379966 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:52.379966 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:35:52.379966 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:35:52.379966 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:35:52.379966 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:35:52.381674 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:35:52.381674 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:35:52.381674 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:35:52.381674 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:35:52.381674 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:35:52.381674 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:35:52.381674 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:35:52.381674 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:35:52.381674 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5 could not be found. Oct 17 13:35:52.381674 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:52.381674 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:35:52.381674 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:52.381674 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:52.381674 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:35:52.381674 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:35:52.381674 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:35:52.381674 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:35:52.381674 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5 could not be found. Oct 17 13:35:52.381674 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:52.385038 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ddaac23f-ffc7-4cab-9655-fb0305bac689 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] Returning 404 to user: Instance 3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:35:52.387239 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ddaac23f-ffc7-4cab-9655-fb0305bac689 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403 tempest-FloatingIPsAssociationNegativeTestJSON-1443356403-project] 10.222.0.79 "GET /compute/v2.1/servers/3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5" status: 404 len: 111 microversion: 2.1 time: 0.072840 Oct 17 13:35:52.388336 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 344/689] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:52 2022] GET /compute/v2.1/servers/3a8aa8c1-ebd0-47a1-aca6-9af41b9dddc5 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:35:52.394817 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f2038c87-31c2-4487-81b8-95bdbc48747a tempest-FloatingIPsNegativeTestJSON-780536323 tempest-FloatingIPsNegativeTestJSON-780536323-project] Calling method '.version_select at 0x7f7cd59ba430>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:52.527032 n-d-854247-14 devstack@n-api.service[127017]: DEBUG neutronclient.v2_0.client [None req-f2038c87-31c2-4487-81b8-95bdbc48747a tempest-FloatingIPsNegativeTestJSON-780536323 tempest-FloatingIPsNegativeTestJSON-780536323-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 6a1d01b1-3614-4373-9db2-9f8861ab53bc could not be found", "detail": ""}} {{(pid=127017) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 13:35:52.529113 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-f2038c87-31c2-4487-81b8-95bdbc48747a tempest-FloatingIPsNegativeTestJSON-780536323 tempest-FloatingIPsNegativeTestJSON-780536323-project] HTTP exception thrown: Floating IP not found for ID 6a1d01b1-3614-4373-9db2-9f8861ab53bc Oct 17 13:35:52.537162 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f2038c87-31c2-4487-81b8-95bdbc48747a tempest-FloatingIPsNegativeTestJSON-780536323 tempest-FloatingIPsNegativeTestJSON-780536323-project] Request method failure captured: Oct 17 13:35:52.537162 n-d-854247-14 devstack@n-api.service[127017]: request: DELETE /compute/v2.1/os-floating-ips/6a1d01b1-3614-4373-9db2-9f8861ab53bc HTTP/1.1 Oct 17 13:35:52.537162 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:35:52.537162 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:35:52.537162 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:35:52.537162 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:35:52.537162 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:35:52.537162 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:35:52.537162 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:35:52.537162 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:35:52.537162 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVo3wV-pDs609Su4_ikvtF405TqjZxpI51FZCImRnRh68EGx2MMh_MntKunQyZ8GZWq-RdTtooUJk2JhgALhg6Alodc0ZRffaXyxSig-Sso3xX5EXaOVFRNtgPjZoslT5Nxsq7sB9UrYcpLor13SK2eWEQ42_Z-oATo1JbWdQF_upOw Oct 17 13:35:52.537162 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:35:52.537162 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:35:52.537162 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:35:52.537162 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:35:52.537162 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:35:52.537162 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:35:52.537162 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 58bb4cfc2a5e4f08862ee2cba40d488f Oct 17 13:35:52.537162 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-780536323 Oct 17 13:35:52.537162 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:35:52.537162 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:35:52.539104 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/58bb4cfc2a5e4f08862ee2cba40d488f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/58bb4cfc2a5e4f08862ee2cba40d488f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/58bb4cfc2a5e4f08862ee2cba40d488f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_58bb4cfc2a5e4f08862ee2cba40d488f", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:35:52.539104 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-780536323 Oct 17 13:35:52.539104 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 58bb4cfc2a5e4f08862ee2cba40d488f Oct 17 13:35:52.539104 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-780536323 Oct 17 13:35:52.539104 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-FloatingIPsNegativeTestJSON-780536323-project Oct 17 13:35:52.539104 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:35:52.539104 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:35:52.539104 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: f7e8780605ab42c59feebf057824fef3 Oct 17 13:35:52.539104 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-780536323-project Oct 17 13:35:52.539104 n-d-854247-14 devstack@n-api.service[127017]: method: Oct 17 13:35:52.539104 n-d-854247-14 devstack@n-api.service[127017]: exception: Floating IP not found for ID 6a1d01b1-3614-4373-9db2-9f8861ab53bc Oct 17 13:35:52.539104 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '6a1d01b1-3614-4373-9db2-9f8861ab53bc'} Oct 17 13:35:52.539104 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:35:52.540113 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:52.540113 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 17 13:35:52.540113 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 17 13:35:52.540113 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:35:52.540113 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:35:52.540113 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 17 13:35:52.540113 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 17 13:35:52.540113 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:35:52.540113 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:35:52.540113 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 13:35:52.540113 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 13:35:52.540113 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:35:52.540113 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:35:52.540113 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 13:35:52.540113 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 13:35:52.540113 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:35:52.540113 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:35:52.540113 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 13:35:52.540113 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 13:35:52.541260 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:35:52.541260 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:35:52.541260 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 13:35:52.541260 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 13:35:52.541260 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 13:35:52.541260 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 13:35:52.541260 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 6a1d01b1-3614-4373-9db2-9f8861ab53bc could not be found Oct 17 13:35:52.541260 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3fd1f605-b790-4480-8cb8-ff3974e3f211'] Oct 17 13:35:52.541260 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:52.541260 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:35:52.541260 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:52.541260 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:52.541260 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 17 13:35:52.541260 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 17 13:35:52.541260 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 17 13:35:52.541260 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 17 13:35:52.541260 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 6a1d01b1-3614-4373-9db2-9f8861ab53bc. Oct 17 13:35:52.541260 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:52.541260 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:35:52.541260 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:52.542423 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:52.542423 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:35:52.542423 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:35:52.542423 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:35:52.542423 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:35:52.542423 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:35:52.542423 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:35:52.542423 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:35:52.542423 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:35:52.542423 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 17 13:35:52.542423 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 17 13:35:52.542423 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 6a1d01b1-3614-4373-9db2-9f8861ab53bc Oct 17 13:35:52.542423 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:52.542423 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:35:52.542423 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:52.542423 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:52.542423 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:35:52.542423 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:35:52.542423 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:35:52.542423 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:35:52.545582 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 6a1d01b1-3614-4373-9db2-9f8861ab53bc Oct 17 13:35:52.545582 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:35:52.547913 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f2038c87-31c2-4487-81b8-95bdbc48747a tempest-FloatingIPsNegativeTestJSON-780536323 tempest-FloatingIPsNegativeTestJSON-780536323-project] Returning 404 to user: Floating IP not found for ID 6a1d01b1-3614-4373-9db2-9f8861ab53bc {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:35:52.549126 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f2038c87-31c2-4487-81b8-95bdbc48747a tempest-FloatingIPsNegativeTestJSON-780536323 tempest-FloatingIPsNegativeTestJSON-780536323-project] 10.222.0.79 "DELETE /compute/v2.1/os-floating-ips/6a1d01b1-3614-4373-9db2-9f8861ab53bc" status: 404 len: 111 microversion: 2.1 time: 0.159550 Oct 17 13:35:52.559536 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 345/690] 10.222.0.79 () {58 vars in 1263 bytes} [Mon Oct 17 13:35:52 2022] DELETE /compute/v2.1/os-floating-ips/6a1d01b1-3614-4373-9db2-9f8861ab53bc => generated 111 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:35:52.568196 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-eb238c89-ef4e-4500-affa-3beabcd78958 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:52.570257 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-eb238c89-ef4e-4500-affa-3beabcd78958 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] [instance: f0067ca2-1063-4f5b-901d-d766e56afa39] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:52.582812 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eb238c89-ef4e-4500-affa-3beabcd78958 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:52.583721 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eb238c89-ef4e-4500-affa-3beabcd78958 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:52.584426 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eb238c89-ef4e-4500-affa-3beabcd78958 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:52.585388 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eb238c89-ef4e-4500-affa-3beabcd78958 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:52.586057 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eb238c89-ef4e-4500-affa-3beabcd78958 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:52.586800 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eb238c89-ef4e-4500-affa-3beabcd78958 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:52.841412 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a02dafec-ae79-43d7-a098-34531422a858 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:52.858447 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a02dafec-ae79-43d7-a098-34531422a858 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/4d242145-87ff-473a-bac2-fdd483fb5863" status: 200 len: 1318 microversion: 2.1 time: 0.608394 Oct 17 13:35:52.860098 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 346/691] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:52 2022] GET /compute/v2.1/servers/4d242145-87ff-473a-bac2-fdd483fb5863 => generated 1318 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:52.865643 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b358b8a1-a72e-4734-9eb5-2a2f43327cf9 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:52.866253 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b358b8a1-a72e-4734-9eb5-2a2f43327cf9 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: f869f059-89c3-4462-a309-e27f650d7584] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:52.878250 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b358b8a1-a72e-4734-9eb5-2a2f43327cf9 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:52.878760 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b358b8a1-a72e-4734-9eb5-2a2f43327cf9 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:52.879161 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b358b8a1-a72e-4734-9eb5-2a2f43327cf9 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:52.879988 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b358b8a1-a72e-4734-9eb5-2a2f43327cf9 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:52.880431 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b358b8a1-a72e-4734-9eb5-2a2f43327cf9 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:52.880843 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b358b8a1-a72e-4734-9eb5-2a2f43327cf9 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:53.502769 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=3 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:53.689910 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-eb238c89-ef4e-4500-affa-3beabcd78958 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a685773acdb415591f62ccee7157b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa06a29e779e413484cdfcb27e902525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:53.706153 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-eb238c89-ef4e-4500-affa-3beabcd78958 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] 10.222.0.79 "GET /compute/v2.1/servers/f0067ca2-1063-4f5b-901d-d766e56afa39" status: 200 len: 1477 microversion: 2.1 time: 1.143346 Oct 17 13:35:53.707658 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 346/692] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:52 2022] GET /compute/v2.1/servers/f0067ca2-1063-4f5b-901d-d766e56afa39 => generated 1477 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:53.726022 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-74ca5c7c-8911-48d4-9a09-d74fd874fa2c tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:53.726953 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-74ca5c7c-8911-48d4-9a09-d74fd874fa2c tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] [instance: 51be2144-e969-4e1b-b5da-c43b9a7b7c90] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:53.733609 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-74ca5c7c-8911-48d4-9a09-d74fd874fa2c tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:53.734368 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-74ca5c7c-8911-48d4-9a09-d74fd874fa2c tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:53.734943 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-74ca5c7c-8911-48d4-9a09-d74fd874fa2c tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:53.735820 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-74ca5c7c-8911-48d4-9a09-d74fd874fa2c tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:53.736409 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-74ca5c7c-8911-48d4-9a09-d74fd874fa2c tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:53.736970 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-74ca5c7c-8911-48d4-9a09-d74fd874fa2c tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:53.768139 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b358b8a1-a72e-4734-9eb5-2a2f43327cf9 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:53.786548 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b358b8a1-a72e-4734-9eb5-2a2f43327cf9 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/f869f059-89c3-4462-a309-e27f650d7584" status: 200 len: 1501 microversion: 2.1 time: 0.920670 Oct 17 13:35:53.802951 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 347/693] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:52 2022] GET /compute/v2.1/servers/f869f059-89c3-4462-a309-e27f650d7584 => generated 1501 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:53.892363 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2350f52b-c032-4d96-8928-1817d7c68ed3 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:53.893240 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2350f52b-c032-4d96-8928-1817d7c68ed3 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 4d242145-87ff-473a-bac2-fdd483fb5863] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:53.903207 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2350f52b-c032-4d96-8928-1817d7c68ed3 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:53.904041 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2350f52b-c032-4d96-8928-1817d7c68ed3 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:53.904712 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2350f52b-c032-4d96-8928-1817d7c68ed3 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:53.905605 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2350f52b-c032-4d96-8928-1817d7c68ed3 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:53.906241 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2350f52b-c032-4d96-8928-1817d7c68ed3 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:53.906833 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2350f52b-c032-4d96-8928-1817d7c68ed3 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:54.064398 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-74ca5c7c-8911-48d4-9a09-d74fd874fa2c tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:54.074732 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-74ca5c7c-8911-48d4-9a09-d74fd874fa2c tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:54.076574 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-74ca5c7c-8911-48d4-9a09-d74fd874fa2c tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:54.084354 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-74ca5c7c-8911-48d4-9a09-d74fd874fa2c tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] 10.222.0.79 "GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90" status: 200 len: 1447 microversion: 2.75 time: 0.373284 Oct 17 13:35:54.111219 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 347/694] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:35:53 2022] GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90 => generated 1447 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:35:54.633454 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2350f52b-c032-4d96-8928-1817d7c68ed3 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:54.648118 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2350f52b-c032-4d96-8928-1817d7c68ed3 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/4d242145-87ff-473a-bac2-fdd483fb5863" status: 200 len: 1318 microversion: 2.1 time: 0.764332 Oct 17 13:35:54.652614 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 348/695] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:53 2022] GET /compute/v2.1/servers/4d242145-87ff-473a-bac2-fdd483fb5863 => generated 1318 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:54.730865 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-15d2cfe1-5f6c-415b-a330-4e992f4d99d4 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:54.731520 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-15d2cfe1-5f6c-415b-a330-4e992f4d99d4 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] [instance: f0067ca2-1063-4f5b-901d-d766e56afa39] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:54.738695 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-1083923d-4d39-4e9d-b9a4-5bfde07f9a79 req-3f5019a2-076a-409d-80ed-a110f6fb4cec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec948255-c8e9-4450-95d5-42f38b9afe45", "tag": "a94b07bc-c09e-4eea-90ac-84ce6048959b"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:54.752555 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-15d2cfe1-5f6c-415b-a330-4e992f4d99d4 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:54.753039 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-15d2cfe1-5f6c-415b-a330-4e992f4d99d4 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:54.755804 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-1083923d-4d39-4e9d-b9a4-5bfde07f9a79 req-3f5019a2-076a-409d-80ed-a110f6fb4cec service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:54.756475 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-15d2cfe1-5f6c-415b-a330-4e992f4d99d4 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:54.757370 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-15d2cfe1-5f6c-415b-a330-4e992f4d99d4 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:54.758022 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-1083923d-4d39-4e9d-b9a4-5bfde07f9a79 req-3f5019a2-076a-409d-80ed-a110f6fb4cec service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:54.758892 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-15d2cfe1-5f6c-415b-a330-4e992f4d99d4 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:54.759696 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-1083923d-4d39-4e9d-b9a4-5bfde07f9a79 req-3f5019a2-076a-409d-80ed-a110f6fb4cec service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:54.760290 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-15d2cfe1-5f6c-415b-a330-4e992f4d99d4 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:54.789008 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-1083923d-4d39-4e9d-b9a4-5bfde07f9a79 req-3f5019a2-076a-409d-80ed-a110f6fb4cec service nova] Creating event network-changed:a94b07bc-c09e-4eea-90ac-84ce6048959b for instance ec948255-c8e9-4450-95d5-42f38b9afe45 on n-h2-854247-14 Oct 17 13:35:54.801137 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-1083923d-4d39-4e9d-b9a4-5bfde07f9a79 req-3f5019a2-076a-409d-80ed-a110f6fb4cec service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066064 Oct 17 13:35:54.805713 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 349/696] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:54.818294 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-51ff2c65-c08d-48e5-ab9f-d4f2805d0abb tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:54.821600 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-51ff2c65-c08d-48e5-ab9f-d4f2805d0abb tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: f869f059-89c3-4462-a309-e27f650d7584] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:54.837422 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-51ff2c65-c08d-48e5-ab9f-d4f2805d0abb tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:54.837950 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-51ff2c65-c08d-48e5-ab9f-d4f2805d0abb tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:54.842586 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-51ff2c65-c08d-48e5-ab9f-d4f2805d0abb tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:54.844320 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-51ff2c65-c08d-48e5-ab9f-d4f2805d0abb tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:54.844805 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-51ff2c65-c08d-48e5-ab9f-d4f2805d0abb tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:54.845237 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-51ff2c65-c08d-48e5-ab9f-d4f2805d0abb tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:55.449606 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-51ff2c65-c08d-48e5-ab9f-d4f2805d0abb tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:55.458837 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-51ff2c65-c08d-48e5-ab9f-d4f2805d0abb tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/f869f059-89c3-4462-a309-e27f650d7584" status: 200 len: 1501 microversion: 2.1 time: 0.649631 Oct 17 13:35:55.464709 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 350/697] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:54 2022] GET /compute/v2.1/servers/f869f059-89c3-4462-a309-e27f650d7584 => generated 1501 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:55.474844 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-71e3b636-7262-43a1-9f88-b0cb439d5637 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:55.478625 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-71e3b636-7262-43a1-9f88-b0cb439d5637 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] [instance: 51be2144-e969-4e1b-b5da-c43b9a7b7c90] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:55.496002 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-71e3b636-7262-43a1-9f88-b0cb439d5637 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:55.496504 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-71e3b636-7262-43a1-9f88-b0cb439d5637 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:55.496936 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-71e3b636-7262-43a1-9f88-b0cb439d5637 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:55.497668 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-71e3b636-7262-43a1-9f88-b0cb439d5637 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:55.498120 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-71e3b636-7262-43a1-9f88-b0cb439d5637 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:55.498538 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-71e3b636-7262-43a1-9f88-b0cb439d5637 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:55.709510 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-71e3b636-7262-43a1-9f88-b0cb439d5637 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:55.723153 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-71e3b636-7262-43a1-9f88-b0cb439d5637 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:55.730301 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-71e3b636-7262-43a1-9f88-b0cb439d5637 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:55.754900 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-71e3b636-7262-43a1-9f88-b0cb439d5637 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] 10.222.0.79 "GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90" status: 200 len: 1453 microversion: 2.75 time: 0.288555 Oct 17 13:35:55.758355 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 351/698] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:35:55 2022] GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90 => generated 1453 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:35:55.772815 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a769401f-0d28-46bf-953f-c5a13358e67f tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:55.775045 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a769401f-0d28-46bf-953f-c5a13358e67f tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 4d242145-87ff-473a-bac2-fdd483fb5863] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:55.783771 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a769401f-0d28-46bf-953f-c5a13358e67f tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:55.784621 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a769401f-0d28-46bf-953f-c5a13358e67f tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:55.786952 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a769401f-0d28-46bf-953f-c5a13358e67f tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:55.790917 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a769401f-0d28-46bf-953f-c5a13358e67f tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:55.798484 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a769401f-0d28-46bf-953f-c5a13358e67f tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:55.799126 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a769401f-0d28-46bf-953f-c5a13358e67f tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:57.043629 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-15d2cfe1-5f6c-415b-a330-4e992f4d99d4 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a685773acdb415591f62ccee7157b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa06a29e779e413484cdfcb27e902525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:57.055293 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-15d2cfe1-5f6c-415b-a330-4e992f4d99d4 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] 10.222.0.79 "GET /compute/v2.1/servers/f0067ca2-1063-4f5b-901d-d766e56afa39" status: 200 len: 1477 microversion: 2.1 time: 2.328879 Oct 17 13:35:57.065594 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 348/699] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:54 2022] GET /compute/v2.1/servers/f0067ca2-1063-4f5b-901d-d766e56afa39 => generated 1477 bytes in 2339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:57.072271 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3a41328f-8f5a-43b3-9fd1-cb28e4a8d655 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:57.073314 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3a41328f-8f5a-43b3-9fd1-cb28e4a8d655 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: f869f059-89c3-4462-a309-e27f650d7584] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:57.102469 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3a41328f-8f5a-43b3-9fd1-cb28e4a8d655 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:57.106574 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3a41328f-8f5a-43b3-9fd1-cb28e4a8d655 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:57.107025 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3a41328f-8f5a-43b3-9fd1-cb28e4a8d655 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:57.116667 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3a41328f-8f5a-43b3-9fd1-cb28e4a8d655 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:57.118350 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3a41328f-8f5a-43b3-9fd1-cb28e4a8d655 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:57.119057 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3a41328f-8f5a-43b3-9fd1-cb28e4a8d655 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:57.211016 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a769401f-0d28-46bf-953f-c5a13358e67f tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:57.231785 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a769401f-0d28-46bf-953f-c5a13358e67f tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/4d242145-87ff-473a-bac2-fdd483fb5863" status: 200 len: 1318 microversion: 2.1 time: 1.469629 Oct 17 13:35:57.234965 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 352/700] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:55 2022] GET /compute/v2.1/servers/4d242145-87ff-473a-bac2-fdd483fb5863 => generated 1318 bytes in 1474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:57.241635 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-a59864de-8f23-401e-af20-97e178d03164 req-1a555ec2-43f2-4d69-bae5-9e49ae01cbb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0067ca2-1063-4f5b-901d-d766e56afa39", "name": "network-vif-deleted", "tag": "dcea5002-bfa7-4323-bfce-fa27565f133c"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:57.266950 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-a59864de-8f23-401e-af20-97e178d03164 req-1a555ec2-43f2-4d69-bae5-9e49ae01cbb1 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:57.267743 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-a59864de-8f23-401e-af20-97e178d03164 req-1a555ec2-43f2-4d69-bae5-9e49ae01cbb1 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:57.268363 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-a59864de-8f23-401e-af20-97e178d03164 req-1a555ec2-43f2-4d69-bae5-9e49ae01cbb1 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:57.282179 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-a59864de-8f23-401e-af20-97e178d03164 req-1a555ec2-43f2-4d69-bae5-9e49ae01cbb1 service nova] Creating event network-vif-deleted:dcea5002-bfa7-4323-bfce-fa27565f133c for instance f0067ca2-1063-4f5b-901d-d766e56afa39 on n-h1-854247-14 Oct 17 13:35:57.292015 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-a59864de-8f23-401e-af20-97e178d03164 req-1a555ec2-43f2-4d69-bae5-9e49ae01cbb1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055295 Oct 17 13:35:57.294010 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 353/701] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:57.302261 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-df44550b-9e8a-4d90-9e55-50d8c06b9a9a tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:57.303794 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-df44550b-9e8a-4d90-9e55-50d8c06b9a9a tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] [instance: 51be2144-e969-4e1b-b5da-c43b9a7b7c90] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:57.329754 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df44550b-9e8a-4d90-9e55-50d8c06b9a9a tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:57.330869 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df44550b-9e8a-4d90-9e55-50d8c06b9a9a tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:57.331589 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df44550b-9e8a-4d90-9e55-50d8c06b9a9a tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:57.332965 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df44550b-9e8a-4d90-9e55-50d8c06b9a9a tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:57.334291 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df44550b-9e8a-4d90-9e55-50d8c06b9a9a tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:57.334969 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df44550b-9e8a-4d90-9e55-50d8c06b9a9a tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:57.669115 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-df44550b-9e8a-4d90-9e55-50d8c06b9a9a tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:57.680530 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-df44550b-9e8a-4d90-9e55-50d8c06b9a9a tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:57.682169 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-df44550b-9e8a-4d90-9e55-50d8c06b9a9a tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:57.693709 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-df44550b-9e8a-4d90-9e55-50d8c06b9a9a tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] 10.222.0.79 "GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90" status: 200 len: 1453 microversion: 2.75 time: 0.398196 Oct 17 13:35:57.710623 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 354/702] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:35:57 2022] GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90 => generated 1453 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:35:57.728349 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3a41328f-8f5a-43b3-9fd1-cb28e4a8d655 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:57.748209 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3a41328f-8f5a-43b3-9fd1-cb28e4a8d655 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/f869f059-89c3-4462-a309-e27f650d7584" status: 200 len: 1501 microversion: 2.1 time: 0.679733 Oct 17 13:35:57.750191 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 349/703] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:57 2022] GET /compute/v2.1/servers/f869f059-89c3-4462-a309-e27f650d7584 => generated 1501 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:58.082975 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-53cf05db-74b9-4d33-8d50-9a2f70a8fd62 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:58.083873 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-53cf05db-74b9-4d33-8d50-9a2f70a8fd62 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] [instance: f0067ca2-1063-4f5b-901d-d766e56afa39] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:58.102453 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-53cf05db-74b9-4d33-8d50-9a2f70a8fd62 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:58.107999 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-53cf05db-74b9-4d33-8d50-9a2f70a8fd62 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:58.111874 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-53cf05db-74b9-4d33-8d50-9a2f70a8fd62 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:58.112737 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-53cf05db-74b9-4d33-8d50-9a2f70a8fd62 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:58.114334 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-53cf05db-74b9-4d33-8d50-9a2f70a8fd62 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:58.115715 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-53cf05db-74b9-4d33-8d50-9a2f70a8fd62 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:58.135309 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-53cf05db-74b9-4d33-8d50-9a2f70a8fd62 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] HTTP exception thrown: Instance f0067ca2-1063-4f5b-901d-d766e56afa39 could not be found. Oct 17 13:35:58.136980 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-53cf05db-74b9-4d33-8d50-9a2f70a8fd62 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Request method failure captured: Oct 17 13:35:58.136980 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/f0067ca2-1063-4f5b-901d-d766e56afa39 HTTP/1.1 Oct 17 13:35:58.136980 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:35:58.136980 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:35:58.136980 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:35:58.136980 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:35:58.136980 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:35:58.136980 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:35:58.136980 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:35:58.136980 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:35:58.136980 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVn5nuoGUdTT_btPej0PpqQjyPKw7G0oMEOXkyZaupgCj-i-2svlxKzfGszUHkiRIurIgV-YcjAn4w2BhE5EQyST6Zkm_4SaVKY2PlsmJyOffKN9jPOXYZuNgsFsAtut9Xe7xpsgjxj606zivm3UNf67ln4mzlcoG799ANK9R2IHpdE Oct 17 13:35:58.136980 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:35:58.136980 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:35:58.136980 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:35:58.136980 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:35:58.136980 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:35:58.136980 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:35:58.136980 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: aa06a29e779e413484cdfcb27e902525 Oct 17 13:35:58.136980 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1557041198 Oct 17 13:35:58.136980 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:35:58.136980 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:35:58.138518 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/aa06a29e779e413484cdfcb27e902525"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/aa06a29e779e413484cdfcb27e902525"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/aa06a29e779e413484cdfcb27e902525"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_aa06a29e779e413484cdfcb27e902525", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:35:58.138518 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1557041198 Oct 17 13:35:58.138518 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: aa06a29e779e413484cdfcb27e902525 Oct 17 13:35:58.138518 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1557041198 Oct 17 13:35:58.138518 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServersAdminNegativeTestJSON-1557041198-project Oct 17 13:35:58.138518 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:35:58.138518 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:35:58.138518 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 4a685773acdb415591f62ccee7157b6a Oct 17 13:35:58.138518 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1557041198-project Oct 17 13:35:58.138518 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:35:58.138518 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance f0067ca2-1063-4f5b-901d-d766e56afa39 could not be found. Oct 17 13:35:58.138518 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'f0067ca2-1063-4f5b-901d-d766e56afa39'} Oct 17 13:35:58.139399 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:35:58.139399 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:58.139399 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:35:58.139399 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:35:58.139399 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:35:58.139399 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:35:58.139399 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:35:58.139399 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:35:58.139399 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:35:58.139399 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:35:58.139399 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0067ca2-1063-4f5b-901d-d766e56afa39 could not be found. Oct 17 13:35:58.139399 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:58.139399 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:35:58.139399 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:58.139399 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:58.139399 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:35:58.139399 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:35:58.139399 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:35:58.139399 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:35:58.139399 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:35:58.140632 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:35:58.140632 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:35:58.140632 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:35:58.140632 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:35:58.140632 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:35:58.140632 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:35:58.140632 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:35:58.140632 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0067ca2-1063-4f5b-901d-d766e56afa39 could not be found. Oct 17 13:35:58.140632 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:58.140632 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:35:58.140632 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:58.140632 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:58.140632 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:35:58.140632 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:35:58.140632 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:35:58.140632 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:35:58.140632 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0067ca2-1063-4f5b-901d-d766e56afa39 could not be found. Oct 17 13:35:58.140632 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:35:58.142987 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-53cf05db-74b9-4d33-8d50-9a2f70a8fd62 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] Returning 404 to user: Instance f0067ca2-1063-4f5b-901d-d766e56afa39 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:35:58.144253 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-53cf05db-74b9-4d33-8d50-9a2f70a8fd62 tempest-ServersAdminNegativeTestJSON-1557041198 tempest-ServersAdminNegativeTestJSON-1557041198-project] 10.222.0.79 "GET /compute/v2.1/servers/f0067ca2-1063-4f5b-901d-d766e56afa39" status: 404 len: 111 microversion: 2.1 time: 0.067675 Oct 17 13:35:58.145397 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 355/704] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:58 2022] GET /compute/v2.1/servers/f0067ca2-1063-4f5b-901d-d766e56afa39 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:35:58.286492 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b9a88707-ced2-4798-abda-57a06d31f482 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:58.290606 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b9a88707-ced2-4798-abda-57a06d31f482 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 4d242145-87ff-473a-bac2-fdd483fb5863] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:58.302185 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b9a88707-ced2-4798-abda-57a06d31f482 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:58.303376 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b9a88707-ced2-4798-abda-57a06d31f482 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:58.304125 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b9a88707-ced2-4798-abda-57a06d31f482 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:58.306988 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b9a88707-ced2-4798-abda-57a06d31f482 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:58.308330 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b9a88707-ced2-4798-abda-57a06d31f482 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:58.310914 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b9a88707-ced2-4798-abda-57a06d31f482 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:58.724679 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-659b7f18-5b42-4b85-8a9c-421bb131be76 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:58.725483 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-659b7f18-5b42-4b85-8a9c-421bb131be76 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] [instance: 51be2144-e969-4e1b-b5da-c43b9a7b7c90] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:58.733959 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-659b7f18-5b42-4b85-8a9c-421bb131be76 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:58.737872 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-659b7f18-5b42-4b85-8a9c-421bb131be76 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:58.738429 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-659b7f18-5b42-4b85-8a9c-421bb131be76 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:58.739288 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-659b7f18-5b42-4b85-8a9c-421bb131be76 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:58.740852 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-659b7f18-5b42-4b85-8a9c-421bb131be76 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:58.744008 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-659b7f18-5b42-4b85-8a9c-421bb131be76 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:58.901864 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-659b7f18-5b42-4b85-8a9c-421bb131be76 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:58.916610 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-659b7f18-5b42-4b85-8a9c-421bb131be76 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:58.918309 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-659b7f18-5b42-4b85-8a9c-421bb131be76 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:58.933867 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-659b7f18-5b42-4b85-8a9c-421bb131be76 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] 10.222.0.79 "GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90" status: 200 len: 1438 microversion: 2.75 time: 0.213667 Oct 17 13:35:58.934975 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 356/705] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:35:58 2022] GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90 => generated 1438 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:35:58.940235 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-67de453b-9a00-4471-9dc6-f5bb098103aa tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:58.940880 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-67de453b-9a00-4471-9dc6-f5bb098103aa tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: f869f059-89c3-4462-a309-e27f650d7584] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:58.957752 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-67de453b-9a00-4471-9dc6-f5bb098103aa tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:58.963703 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-67de453b-9a00-4471-9dc6-f5bb098103aa tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:58.965716 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-67de453b-9a00-4471-9dc6-f5bb098103aa tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:58.969941 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-67de453b-9a00-4471-9dc6-f5bb098103aa tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:58.975503 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-67de453b-9a00-4471-9dc6-f5bb098103aa tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:58.976688 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-67de453b-9a00-4471-9dc6-f5bb098103aa tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:59.171518 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b9a88707-ced2-4798-abda-57a06d31f482 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:59.184196 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b9a88707-ced2-4798-abda-57a06d31f482 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/4d242145-87ff-473a-bac2-fdd483fb5863" status: 200 len: 1318 microversion: 2.1 time: 0.915358 Oct 17 13:35:59.186068 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 350/706] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:58 2022] GET /compute/v2.1/servers/4d242145-87ff-473a-bac2-fdd483fb5863 => generated 1318 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:59.773488 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-67de453b-9a00-4471-9dc6-f5bb098103aa tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:59.795293 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-67de453b-9a00-4471-9dc6-f5bb098103aa tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/f869f059-89c3-4462-a309-e27f650d7584" status: 200 len: 1476 microversion: 2.1 time: 0.858905 Oct 17 13:35:59.795913 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 357/707] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:58 2022] GET /compute/v2.1/servers/f869f059-89c3-4462-a309-e27f650d7584 => generated 1476 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:59.821391 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-eb5b03fd-b94d-4b1f-bcb7-3789eb6c37c9 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Calling method '.version_select at 0x7f7cd5fe6af0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:59.831719 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eb5b03fd-b94d-4b1f-bcb7-3789eb6c37c9 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:59.832205 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eb5b03fd-b94d-4b1f-bcb7-3789eb6c37c9 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:59.832639 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eb5b03fd-b94d-4b1f-bcb7-3789eb6c37c9 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:59.874701 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-cdf4a00d-5a45-456e-9511-359e7010b7a6 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:59.877567 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-cdf4a00d-5a45-456e-9511-359e7010b7a6 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] [instance: 51be2144-e969-4e1b-b5da-c43b9a7b7c90] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:59.898348 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cdf4a00d-5a45-456e-9511-359e7010b7a6 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:59.899219 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cdf4a00d-5a45-456e-9511-359e7010b7a6 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:59.904373 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cdf4a00d-5a45-456e-9511-359e7010b7a6 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:59.905265 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cdf4a00d-5a45-456e-9511-359e7010b7a6 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:59.905746 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cdf4a00d-5a45-456e-9511-359e7010b7a6 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:59.906171 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cdf4a00d-5a45-456e-9511-359e7010b7a6 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:59.912780 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-eb5b03fd-b94d-4b1f-bcb7-3789eb6c37c9 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] 10.222.0.79 "GET /compute/v2.1/os-migrations" status: 200 len: 790 microversion: 2.1 time: 0.095292 Oct 17 13:35:59.913411 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 358/708] 10.222.0.79 () {58 vars in 1143 bytes} [Mon Oct 17 13:35:59 2022] GET /compute/v2.1/os-migrations => generated 790 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:59.936190 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2b8c0177-fb61-4be0-9968-7925e716935c tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:59.936872 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2b8c0177-fb61-4be0-9968-7925e716935c tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] [instance: f869f059-89c3-4462-a309-e27f650d7584] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:59.976859 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2b8c0177-fb61-4be0-9968-7925e716935c tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:59.980985 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2b8c0177-fb61-4be0-9968-7925e716935c tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:59.981460 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2b8c0177-fb61-4be0-9968-7925e716935c tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:59.984631 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2b8c0177-fb61-4be0-9968-7925e716935c tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:59.985506 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2b8c0177-fb61-4be0-9968-7925e716935c tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:59.994239 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2b8c0177-fb61-4be0-9968-7925e716935c tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:00.128440 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-cdf4a00d-5a45-456e-9511-359e7010b7a6 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:36:00.129781 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-cdf4a00d-5a45-456e-9511-359e7010b7a6 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:36:00.130459 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-cdf4a00d-5a45-456e-9511-359e7010b7a6 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:36:00.131013 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-cdf4a00d-5a45-456e-9511-359e7010b7a6 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:36:00.131731 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-cdf4a00d-5a45-456e-9511-359e7010b7a6 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:36:00.309978 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-cdf4a00d-5a45-456e-9511-359e7010b7a6 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] [instance: 51be2144-e969-4e1b-b5da-c43b9a7b7c90] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:00.335285 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cdf4a00d-5a45-456e-9511-359e7010b7a6 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:00.339099 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cdf4a00d-5a45-456e-9511-359e7010b7a6 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:00.356117 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cdf4a00d-5a45-456e-9511-359e7010b7a6 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:00.357112 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cdf4a00d-5a45-456e-9511-359e7010b7a6 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:00.367665 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cdf4a00d-5a45-456e-9511-359e7010b7a6 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:00.369199 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cdf4a00d-5a45-456e-9511-359e7010b7a6 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:01.094964 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-cdf4a00d-5a45-456e-9511-359e7010b7a6 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lazy-loading 'services' on Instance uuid 51be2144-e969-4e1b-b5da-c43b9a7b7c90 {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:36:01.207801 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-cdf4a00d-5a45-456e-9511-359e7010b7a6 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90/action" status: 202 len: 1944 microversion: 2.75 time: 2.019650 Oct 17 13:36:01.209475 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 351/709] 10.222.0.79 () {62 vars in 1319 bytes} [Mon Oct 17 13:35:59 2022] POST /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90/action => generated 1944 bytes in 2023 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 17 13:36:01.215842 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a5332df6-50d2-48b7-85e3-8a8bd19a0cab tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:01.216722 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a5332df6-50d2-48b7-85e3-8a8bd19a0cab tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 4d242145-87ff-473a-bac2-fdd483fb5863] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:01.239695 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a5332df6-50d2-48b7-85e3-8a8bd19a0cab tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:01.240477 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a5332df6-50d2-48b7-85e3-8a8bd19a0cab tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:01.241065 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a5332df6-50d2-48b7-85e3-8a8bd19a0cab tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:01.242918 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a5332df6-50d2-48b7-85e3-8a8bd19a0cab tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:01.243847 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a5332df6-50d2-48b7-85e3-8a8bd19a0cab tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:01.244737 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a5332df6-50d2-48b7-85e3-8a8bd19a0cab tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:01.637021 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=100 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:36:01.644033 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2b8c0177-fb61-4be0-9968-7925e716935c tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/f869f059-89c3-4462-a309-e27f650d7584" status: 200 len: 1629 microversion: 2.1 time: 1.713432 Oct 17 13:36:01.644614 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 359/710] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:59 2022] GET /compute/v2.1/servers/f869f059-89c3-4462-a309-e27f650d7584 => generated 1629 bytes in 1715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:01.676299 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7d7bc61d-d8c4-492e-b07a-ff07d3ca02a7 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:01.679193 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7d7bc61d-d8c4-492e-b07a-ff07d3ca02a7 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] [instance: 51be2144-e969-4e1b-b5da-c43b9a7b7c90] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:01.694019 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7d7bc61d-d8c4-492e-b07a-ff07d3ca02a7 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:01.697112 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7d7bc61d-d8c4-492e-b07a-ff07d3ca02a7 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:01.697879 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7d7bc61d-d8c4-492e-b07a-ff07d3ca02a7 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:01.698845 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7d7bc61d-d8c4-492e-b07a-ff07d3ca02a7 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:01.699593 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7d7bc61d-d8c4-492e-b07a-ff07d3ca02a7 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:01.700510 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7d7bc61d-d8c4-492e-b07a-ff07d3ca02a7 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:02.011009 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-7d7bc61d-d8c4-492e-b07a-ff07d3ca02a7 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lazy-loading 'services' on Instance uuid 51be2144-e969-4e1b-b5da-c43b9a7b7c90 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:36:02.042531 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a5332df6-50d2-48b7-85e3-8a8bd19a0cab tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:02.054830 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a5332df6-50d2-48b7-85e3-8a8bd19a0cab tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/4d242145-87ff-473a-bac2-fdd483fb5863" status: 200 len: 1318 microversion: 2.1 time: 0.843467 Oct 17 13:36:02.078676 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 352/711] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:01 2022] GET /compute/v2.1/servers/4d242145-87ff-473a-bac2-fdd483fb5863 => generated 1318 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:02.086517 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-05c1a628-6c2c-48bd-ab0f-101f74bc96b2 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Action: 'create', calling method: .version_select at 0x7f7cd59ba790>, body: {"keypair": {"name": "tempest-keypair-1144851060", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEztvDprZmFxI3/AQMzWbIpMRYkR2SgBzSTtpObH2EQ67LDhAoXTE5leOfHP7U49QlS9tTy1dnpraBrCVrxv8yBjChyIHljp+jc5gvaMxSP86OLqwueLMX+/B0d1FZTmwA=="}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:02.136744 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-05c1a628-6c2c-48bd-ab0f-101f74bc96b2 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Getting quotas for project ccf0569de787477e964f570378d6459a. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:36:02.151548 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7d7bc61d-d8c4-492e-b07a-ff07d3ca02a7 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90" status: 200 len: 1931 microversion: 2.75 time: 0.486605 Oct 17 13:36:02.152969 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 360/712] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:36:01 2022] GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90 => generated 1931 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:36:02.171334 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-05c1a628-6c2c-48bd-ab0f-101f74bc96b2 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Getting quotas for user 62cc720667f44772988d7890c227b217 and project ccf0569de787477e964f570378d6459a. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:36:02.212606 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-05c1a628-6c2c-48bd-ab0f-101f74bc96b2 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.132488 Oct 17 13:36:02.214367 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 353/713] 10.222.0.79 () {60 vars in 1159 bytes} [Mon Oct 17 13:36:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:03.070200 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-05413a12-5e61-4402-b08b-f9803cdb21d8 tempest-FlavorsV2TestJSON-312503255 tempest-FlavorsV2TestJSON-312503255-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:03.081959 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ed77cda3-d9cd-47ec-afd1-0361485625ce tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:03.084078 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ed77cda3-d9cd-47ec-afd1-0361485625ce tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 4d242145-87ff-473a-bac2-fdd483fb5863] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:03.124516 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-05413a12-5e61-4402-b08b-f9803cdb21d8 tempest-FlavorsV2TestJSON-312503255 tempest-FlavorsV2TestJSON-312503255-project] 10.222.0.79 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.239411 Oct 17 13:36:03.125703 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ed77cda3-d9cd-47ec-afd1-0361485625ce tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:03.127349 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 361/714] 10.222.0.79 () {58 vars in 1137 bytes} [Mon Oct 17 13:36:02 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:03.127790 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ed77cda3-d9cd-47ec-afd1-0361485625ce tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:03.129417 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ed77cda3-d9cd-47ec-afd1-0361485625ce tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:03.130776 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ed77cda3-d9cd-47ec-afd1-0361485625ce tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:03.137672 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ed77cda3-d9cd-47ec-afd1-0361485625ce tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:03.138305 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ed77cda3-d9cd-47ec-afd1-0361485625ce tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:03.151689 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-50f200d0-5900-4757-aede-3a5454e8e74c tempest-FlavorsV2TestJSON-312503255 tempest-FlavorsV2TestJSON-312503255-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:03.231817 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-50f200d0-5900-4757-aede-3a5454e8e74c tempest-FlavorsV2TestJSON-312503255 tempest-FlavorsV2TestJSON-312503255-project] 10.222.0.79 "GET /compute/v2.1/flavors" status: 200 len: 3081 microversion: 2.1 time: 0.096467 Oct 17 13:36:03.232894 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 362/715] 10.222.0.79 () {58 vars in 1125 bytes} [Mon Oct 17 13:36:03 2022] GET /compute/v2.1/flavors => generated 3081 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:03.250701 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5041660a-dfbb-4507-a414-2520d03a1a4e tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:03.254959 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5041660a-dfbb-4507-a414-2520d03a1a4e tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] [instance: 51be2144-e969-4e1b-b5da-c43b9a7b7c90] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:03.261471 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5041660a-dfbb-4507-a414-2520d03a1a4e tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:03.261956 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5041660a-dfbb-4507-a414-2520d03a1a4e tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:03.262383 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5041660a-dfbb-4507-a414-2520d03a1a4e tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:03.263077 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5041660a-dfbb-4507-a414-2520d03a1a4e tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:03.263559 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5041660a-dfbb-4507-a414-2520d03a1a4e tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:03.264148 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5041660a-dfbb-4507-a414-2520d03a1a4e tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:03.439563 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-5041660a-dfbb-4507-a414-2520d03a1a4e tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lazy-loading 'services' on Instance uuid 51be2144-e969-4e1b-b5da-c43b9a7b7c90 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:36:03.469844 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5041660a-dfbb-4507-a414-2520d03a1a4e tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90" status: 200 len: 1931 microversion: 2.75 time: 0.234771 Oct 17 13:36:03.471567 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 363/716] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:36:03 2022] GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90 => generated 1931 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:36:03.476904 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-71ac2903-1385-425a-9687-d40b4bb12850 tempest-FlavorsV2TestJSON-312503255 tempest-FlavorsV2TestJSON-312503255-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:03.497646 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-71ac2903-1385-425a-9687-d40b4bb12850 tempest-FlavorsV2TestJSON-312503255 tempest-FlavorsV2TestJSON-312503255-project] 10.222.0.79 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024756 Oct 17 13:36:03.499051 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 364/717] 10.222.0.79 () {58 vars in 1137 bytes} [Mon Oct 17 13:36:03 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:03.518032 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-89334101-a0fb-481f-8c2b-12de4300e6e5 tempest-FlavorsV2TestJSON-312503255 tempest-FlavorsV2TestJSON-312503255-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:03.535074 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-89334101-a0fb-481f-8c2b-12de4300e6e5 tempest-FlavorsV2TestJSON-312503255 tempest-FlavorsV2TestJSON-312503255-project] 10.222.0.79 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027345 Oct 17 13:36:03.536655 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 365/718] 10.222.0.79 () {58 vars in 1137 bytes} [Mon Oct 17 13:36:03 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:36:03.550530 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fc16f386-6b22-4671-a087-4da7b176a282 tempest-FlavorsV2TestJSON-312503255 tempest-FlavorsV2TestJSON-312503255-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:03.603263 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ed77cda3-d9cd-47ec-afd1-0361485625ce tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:03.627551 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fc16f386-6b22-4671-a087-4da7b176a282 tempest-FlavorsV2TestJSON-312503255 tempest-FlavorsV2TestJSON-312503255-project] 10.222.0.79 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.079281 Oct 17 13:36:03.636905 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 366/719] 10.222.0.79 () {58 vars in 1165 bytes} [Mon Oct 17 13:36:03 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:36:03.637109 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ed77cda3-d9cd-47ec-afd1-0361485625ce tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/4d242145-87ff-473a-bac2-fdd483fb5863" status: 200 len: 1318 microversion: 2.1 time: 0.558100 Oct 17 13:36:03.637109 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 354/720] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:03 2022] GET /compute/v2.1/servers/4d242145-87ff-473a-bac2-fdd483fb5863 => generated 1318 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:36:03.657055 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-80ecf196-e8ed-41ad-91c5-858eb791ebdd tempest-FlavorsV2TestJSON-312503255 tempest-FlavorsV2TestJSON-312503255-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:03.672423 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-80ecf196-e8ed-41ad-91c5-858eb791ebdd tempest-FlavorsV2TestJSON-312503255 tempest-FlavorsV2TestJSON-312503255-project] 10.222.0.79 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018665 Oct 17 13:36:03.673038 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 367/721] 10.222.0.79 () {58 vars in 1137 bytes} [Mon Oct 17 13:36:03 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:03.689486 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-fb6744aa-1972-48eb-b323-6e2b0ef075b3 tempest-FlavorsV2TestJSON-312503255 tempest-FlavorsV2TestJSON-312503255-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:03.796722 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-fb6744aa-1972-48eb-b323-6e2b0ef075b3 tempest-FlavorsV2TestJSON-312503255 tempest-FlavorsV2TestJSON-312503255-project] 10.222.0.79 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.115270 Oct 17 13:36:03.800212 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 355/722] 10.222.0.79 () {58 vars in 1169 bytes} [Mon Oct 17 13:36:03 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:03.821594 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-05a05a4e-ee64-4a9c-bdb1-1764483f896e tempest-FlavorsV2TestJSON-312503255 tempest-FlavorsV2TestJSON-312503255-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:03.854794 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-05a05a4e-ee64-4a9c-bdb1-1764483f896e tempest-FlavorsV2TestJSON-312503255 tempest-FlavorsV2TestJSON-312503255-project] 10.222.0.79 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.040525 Oct 17 13:36:03.856420 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 368/723] 10.222.0.79 () {58 vars in 1161 bytes} [Mon Oct 17 13:36:03 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:03.871904 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ece8e103-f36a-47ff-8570-4954ceb33421 tempest-FlavorsV2TestJSON-312503255 tempest-FlavorsV2TestJSON-312503255-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:03.884473 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ece8e103-f36a-47ff-8570-4954ceb33421 tempest-FlavorsV2TestJSON-312503255 tempest-FlavorsV2TestJSON-312503255-project] 10.222.0.79 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016953 Oct 17 13:36:03.900656 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6e349edb-4034-4612-838e-decb428dc002 tempest-FlavorsV2TestJSON-312503255 tempest-FlavorsV2TestJSON-312503255-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:03.902178 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 356/724] 10.222.0.79 () {58 vars in 1137 bytes} [Mon Oct 17 13:36:03 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:03.953464 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6e349edb-4034-4612-838e-decb428dc002 tempest-FlavorsV2TestJSON-312503255 tempest-FlavorsV2TestJSON-312503255-project] 10.222.0.79 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.059038 Oct 17 13:36:03.983547 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b08b875e-6a6f-4863-b27c-092c9f0a8743 tempest-FlavorsV2TestJSON-312503255 tempest-FlavorsV2TestJSON-312503255-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:03.984624 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 369/725] 10.222.0.79 () {58 vars in 1167 bytes} [Mon Oct 17 13:36:03 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:04.007194 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b08b875e-6a6f-4863-b27c-092c9f0a8743 tempest-FlavorsV2TestJSON-312503255 tempest-FlavorsV2TestJSON-312503255-project] 10.222.0.79 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.035632 Oct 17 13:36:04.022835 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 357/726] 10.222.0.79 () {58 vars in 1137 bytes} [Mon Oct 17 13:36:03 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:04.026996 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d880bc3c-308a-4e99-a456-97b59dbcaae6 tempest-FlavorsV2TestJSON-312503255 tempest-FlavorsV2TestJSON-312503255-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:04.061020 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d880bc3c-308a-4e99-a456-97b59dbcaae6 tempest-FlavorsV2TestJSON-312503255 tempest-FlavorsV2TestJSON-312503255-project] 10.222.0.79 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.038094 Oct 17 13:36:04.062147 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 370/727] 10.222.0.79 () {58 vars in 1144 bytes} [Mon Oct 17 13:36:04 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:36:04.083493 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8b04269f-7674-4f52-b4fd-0fd5e6345784 tempest-FlavorsV2TestJSON-312503255 tempest-FlavorsV2TestJSON-312503255-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:04.114295 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8b04269f-7674-4f52-b4fd-0fd5e6345784 tempest-FlavorsV2TestJSON-312503255 tempest-FlavorsV2TestJSON-312503255-project] 10.222.0.79 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.035454 Oct 17 13:36:04.121592 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 358/728] 10.222.0.79 () {58 vars in 1137 bytes} [Mon Oct 17 13:36:04 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:04.132870 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d2f074ed-9052-46ca-86c7-6f0fc566e9f6 tempest-FlavorsV2TestJSON-312503255 tempest-FlavorsV2TestJSON-312503255-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:04.191014 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d2f074ed-9052-46ca-86c7-6f0fc566e9f6 tempest-FlavorsV2TestJSON-312503255 tempest-FlavorsV2TestJSON-312503255-project] 10.222.0.79 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.061739 Oct 17 13:36:04.197568 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 371/729] 10.222.0.79 () {58 vars in 1148 bytes} [Mon Oct 17 13:36:04 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:04.210028 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-95c5e1ef-f71d-4482-a333-b737ea4e2222 tempest-FlavorsV2TestJSON-312503255 tempest-FlavorsV2TestJSON-312503255-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:04.237867 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-95c5e1ef-f71d-4482-a333-b737ea4e2222 tempest-FlavorsV2TestJSON-312503255 tempest-FlavorsV2TestJSON-312503255-project] 10.222.0.79 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.031958 Oct 17 13:36:04.238467 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 359/730] 10.222.0.79 () {58 vars in 1140 bytes} [Mon Oct 17 13:36:04 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:04.256519 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-20d69ce7-312c-478d-b6cb-5ac3a80d1c00 tempest-FlavorsV2TestJSON-312503255 tempest-FlavorsV2TestJSON-312503255-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:04.273292 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-20d69ce7-312c-478d-b6cb-5ac3a80d1c00 tempest-FlavorsV2TestJSON-312503255 tempest-FlavorsV2TestJSON-312503255-project] 10.222.0.79 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021452 Oct 17 13:36:04.274225 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 372/731] 10.222.0.79 () {58 vars in 1137 bytes} [Mon Oct 17 13:36:04 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:04.295274 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-13181bf5-69f0-4c32-a3c3-955930b85420 tempest-FlavorsV2TestJSON-312503255 tempest-FlavorsV2TestJSON-312503255-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:04.364970 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-13181bf5-69f0-4c32-a3c3-955930b85420 tempest-FlavorsV2TestJSON-312503255 tempest-FlavorsV2TestJSON-312503255-project] 10.222.0.79 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.074441 Oct 17 13:36:04.366068 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 360/732] 10.222.0.79 () {58 vars in 1146 bytes} [Mon Oct 17 13:36:04 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:04.382460 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-804ba9f0-71bc-4728-be29-28e7a71d51d5 tempest-FlavorsV2TestJSON-312503255 tempest-FlavorsV2TestJSON-312503255-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:04.424643 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-804ba9f0-71bc-4728-be29-28e7a71d51d5 tempest-FlavorsV2TestJSON-312503255 tempest-FlavorsV2TestJSON-312503255-project] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.045803 Oct 17 13:36:04.442371 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 373/733] 10.222.0.79 () {58 vars in 1146 bytes} [Mon Oct 17 13:36:04 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:04.449034 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-13399fe4-750b-496a-ab6b-d79fd46cf63c tempest-FlavorsV2TestJSON-312503255 tempest-FlavorsV2TestJSON-312503255-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:04.465009 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-13399fe4-750b-496a-ab6b-d79fd46cf63c tempest-FlavorsV2TestJSON-312503255 tempest-FlavorsV2TestJSON-312503255-project] 10.222.0.79 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020677 Oct 17 13:36:04.477134 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 361/734] 10.222.0.79 () {58 vars in 1137 bytes} [Mon Oct 17 13:36:04 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:04.503495 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0e75afef-845d-4859-9d73-2ede49d73ef8 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:04.504117 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0e75afef-845d-4859-9d73-2ede49d73ef8 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] [instance: 51be2144-e969-4e1b-b5da-c43b9a7b7c90] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:04.512687 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0e75afef-845d-4859-9d73-2ede49d73ef8 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:04.513184 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0e75afef-845d-4859-9d73-2ede49d73ef8 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:04.513622 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0e75afef-845d-4859-9d73-2ede49d73ef8 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:04.514336 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0e75afef-845d-4859-9d73-2ede49d73ef8 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:04.515010 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0e75afef-845d-4859-9d73-2ede49d73ef8 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:04.515504 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0e75afef-845d-4859-9d73-2ede49d73ef8 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:04.663118 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c64bf297-85b8-4fb1-8a80-b0edc51ceda2 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:04.663919 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c64bf297-85b8-4fb1-8a80-b0edc51ceda2 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 4d242145-87ff-473a-bac2-fdd483fb5863] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:04.672120 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c64bf297-85b8-4fb1-8a80-b0edc51ceda2 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:04.672610 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c64bf297-85b8-4fb1-8a80-b0edc51ceda2 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:04.673044 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c64bf297-85b8-4fb1-8a80-b0edc51ceda2 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:04.682273 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c64bf297-85b8-4fb1-8a80-b0edc51ceda2 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:04.682784 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c64bf297-85b8-4fb1-8a80-b0edc51ceda2 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:04.683258 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c64bf297-85b8-4fb1-8a80-b0edc51ceda2 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:04.731788 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-0e75afef-845d-4859-9d73-2ede49d73ef8 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lazy-loading 'services' on Instance uuid 51be2144-e969-4e1b-b5da-c43b9a7b7c90 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:36:04.821512 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0e75afef-845d-4859-9d73-2ede49d73ef8 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90" status: 200 len: 1931 microversion: 2.75 time: 0.322741 Oct 17 13:36:04.838897 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 374/735] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:36:04 2022] GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90 => generated 1931 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:36:05.054742 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c64bf297-85b8-4fb1-8a80-b0edc51ceda2 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:05.084564 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c64bf297-85b8-4fb1-8a80-b0edc51ceda2 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/4d242145-87ff-473a-bac2-fdd483fb5863" status: 200 len: 1318 microversion: 2.1 time: 0.426196 Oct 17 13:36:05.092911 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 362/736] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:04 2022] GET /compute/v2.1/servers/4d242145-87ff-473a-bac2-fdd483fb5863 => generated 1318 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:36:05.856394 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-033488a4-e7e4-4528-92b6-805b5b87835c tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:05.857010 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-033488a4-e7e4-4528-92b6-805b5b87835c tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] [instance: 51be2144-e969-4e1b-b5da-c43b9a7b7c90] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:05.874659 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-033488a4-e7e4-4528-92b6-805b5b87835c tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:05.875177 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-033488a4-e7e4-4528-92b6-805b5b87835c tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:05.875613 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-033488a4-e7e4-4528-92b6-805b5b87835c tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:05.876319 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-033488a4-e7e4-4528-92b6-805b5b87835c tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:05.876766 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-033488a4-e7e4-4528-92b6-805b5b87835c tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:05.877181 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-033488a4-e7e4-4528-92b6-805b5b87835c tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:06.028897 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-033488a4-e7e4-4528-92b6-805b5b87835c tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lazy-loading 'services' on Instance uuid 51be2144-e969-4e1b-b5da-c43b9a7b7c90 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:36:06.070121 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-033488a4-e7e4-4528-92b6-805b5b87835c tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90" status: 200 len: 1931 microversion: 2.75 time: 0.218062 Oct 17 13:36:06.071158 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 375/737] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:36:05 2022] GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90 => generated 1931 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:36:06.122041 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-966069c0-4a76-4a1c-9c04-1e89ce816bd5 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:06.122727 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-966069c0-4a76-4a1c-9c04-1e89ce816bd5 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 4d242145-87ff-473a-bac2-fdd483fb5863] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:06.141554 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-966069c0-4a76-4a1c-9c04-1e89ce816bd5 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:06.142046 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-966069c0-4a76-4a1c-9c04-1e89ce816bd5 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:06.142475 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-966069c0-4a76-4a1c-9c04-1e89ce816bd5 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:06.143389 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-966069c0-4a76-4a1c-9c04-1e89ce816bd5 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:06.143982 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-966069c0-4a76-4a1c-9c04-1e89ce816bd5 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:06.144560 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-966069c0-4a76-4a1c-9c04-1e89ce816bd5 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:06.581977 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-966069c0-4a76-4a1c-9c04-1e89ce816bd5 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:06.625078 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-966069c0-4a76-4a1c-9c04-1e89ce816bd5 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/4d242145-87ff-473a-bac2-fdd483fb5863" status: 200 len: 1318 microversion: 2.1 time: 0.489134 Oct 17 13:36:06.647575 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 363/738] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:06 2022] GET /compute/v2.1/servers/4d242145-87ff-473a-bac2-fdd483fb5863 => generated 1318 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:06.708077 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-9f79d837-1d5f-40f8-abe5-d4cbe8042ee3 req-22bafec4-a0fb-48a5-b8d9-aab919b37075 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec948255-c8e9-4450-95d5-42f38b9afe45", "name": "network-vif-plugged", "status": "completed", "tag": "a94b07bc-c09e-4eea-90ac-84ce6048959b"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:06.725552 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-9f79d837-1d5f-40f8-abe5-d4cbe8042ee3 req-22bafec4-a0fb-48a5-b8d9-aab919b37075 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:06.726037 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-9f79d837-1d5f-40f8-abe5-d4cbe8042ee3 req-22bafec4-a0fb-48a5-b8d9-aab919b37075 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:06.726461 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-9f79d837-1d5f-40f8-abe5-d4cbe8042ee3 req-22bafec4-a0fb-48a5-b8d9-aab919b37075 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:06.795177 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-9f79d837-1d5f-40f8-abe5-d4cbe8042ee3 req-22bafec4-a0fb-48a5-b8d9-aab919b37075 service nova] Creating event network-vif-plugged:a94b07bc-c09e-4eea-90ac-84ce6048959b for instance ec948255-c8e9-4450-95d5-42f38b9afe45 on n-h2-854247-14 Oct 17 13:36:06.822650 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-9f79d837-1d5f-40f8-abe5-d4cbe8042ee3 req-22bafec4-a0fb-48a5-b8d9-aab919b37075 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117996 Oct 17 13:36:06.827612 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 376/739] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:36:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:07.106527 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8d1b39bb-3abf-4936-8335-757a72a939d3 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:07.107520 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8d1b39bb-3abf-4936-8335-757a72a939d3 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] [instance: 51be2144-e969-4e1b-b5da-c43b9a7b7c90] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:07.119869 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8d1b39bb-3abf-4936-8335-757a72a939d3 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:07.120641 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8d1b39bb-3abf-4936-8335-757a72a939d3 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:07.121093 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8d1b39bb-3abf-4936-8335-757a72a939d3 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:07.121831 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8d1b39bb-3abf-4936-8335-757a72a939d3 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:07.122286 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8d1b39bb-3abf-4936-8335-757a72a939d3 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:07.122790 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8d1b39bb-3abf-4936-8335-757a72a939d3 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:07.372487 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-8d1b39bb-3abf-4936-8335-757a72a939d3 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lazy-loading 'services' on Instance uuid 51be2144-e969-4e1b-b5da-c43b9a7b7c90 {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:36:07.424963 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8d1b39bb-3abf-4936-8335-757a72a939d3 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90" status: 200 len: 1931 microversion: 2.75 time: 0.327983 Oct 17 13:36:07.430579 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 364/740] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:36:07 2022] GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90 => generated 1931 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:36:07.508062 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cd03744d-e16c-431f-8e6f-f937eb96cdd9 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-953311201", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "0f6c7a6d-566d-4e1c-9b41-17525dda1910"}], "security_groups": [{"name": "tempest-securitygroup--25820933"}], "key_name": "tempest-keypair-1144851060", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:07.657285 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9ab46a70-57bf-4b0b-80e0-b33b5e18b14a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:07.658204 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9ab46a70-57bf-4b0b-80e0-b33b5e18b14a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 4d242145-87ff-473a-bac2-fdd483fb5863] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:07.668513 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9ab46a70-57bf-4b0b-80e0-b33b5e18b14a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:07.669705 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9ab46a70-57bf-4b0b-80e0-b33b5e18b14a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:07.674761 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9ab46a70-57bf-4b0b-80e0-b33b5e18b14a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:07.676207 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9ab46a70-57bf-4b0b-80e0-b33b5e18b14a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:07.677070 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9ab46a70-57bf-4b0b-80e0-b33b5e18b14a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:07.680750 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9ab46a70-57bf-4b0b-80e0-b33b5e18b14a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:07.717352 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-cd03744d-e16c-431f-8e6f-f937eb96cdd9 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] validate_networks() for [('0f6c7a6d-566d-4e1c-9b41-17525dda1910', None, None, None, None, None)] {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:36:07.736856 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:36:08.270460 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9ab46a70-57bf-4b0b-80e0-b33b5e18b14a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:08.285391 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9ab46a70-57bf-4b0b-80e0-b33b5e18b14a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/4d242145-87ff-473a-bac2-fdd483fb5863" status: 200 len: 1318 microversion: 2.1 time: 0.632679 Oct 17 13:36:08.288425 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 365/741] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:07 2022] GET /compute/v2.1/servers/4d242145-87ff-473a-bac2-fdd483fb5863 => generated 1318 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:08.459348 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d31a456d-aa7d-4128-995e-c81870dbf71a tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:08.460206 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d31a456d-aa7d-4128-995e-c81870dbf71a tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] [instance: 51be2144-e969-4e1b-b5da-c43b9a7b7c90] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:08.466500 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d31a456d-aa7d-4128-995e-c81870dbf71a tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:08.467228 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d31a456d-aa7d-4128-995e-c81870dbf71a tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:08.467809 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d31a456d-aa7d-4128-995e-c81870dbf71a tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:08.468797 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d31a456d-aa7d-4128-995e-c81870dbf71a tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:08.469392 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d31a456d-aa7d-4128-995e-c81870dbf71a tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:08.470264 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d31a456d-aa7d-4128-995e-c81870dbf71a tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:08.608468 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-d31a456d-aa7d-4128-995e-c81870dbf71a tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lazy-loading 'services' on Instance uuid 51be2144-e969-4e1b-b5da-c43b9a7b7c90 {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:36:08.662344 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d31a456d-aa7d-4128-995e-c81870dbf71a tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90" status: 200 len: 1931 microversion: 2.75 time: 0.206613 Oct 17 13:36:08.663524 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 366/742] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:36:08 2022] GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90 => generated 1931 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:36:08.853413 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-cd03744d-e16c-431f-8e6f-f937eb96cdd9 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:36:08.853868 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-cd03744d-e16c-431f-8e6f-f937eb96cdd9 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:36:08.854287 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-cd03744d-e16c-431f-8e6f-f937eb96cdd9 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:36:08.855938 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-cd03744d-e16c-431f-8e6f-f937eb96cdd9 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:36:08.856706 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-cd03744d-e16c-431f-8e6f-f937eb96cdd9 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:36:08.880278 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cd03744d-e16c-431f-8e6f-f937eb96cdd9 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:08.881069 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cd03744d-e16c-431f-8e6f-f937eb96cdd9 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:08.882153 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cd03744d-e16c-431f-8e6f-f937eb96cdd9 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:08.882530 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-59143c24-2866-449f-93db-04e7497730cb req-9a06298d-2a2c-40e8-9bd4-499b760cbe3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d242145-87ff-473a-bac2-fdd483fb5863", "name": "network-vif-plugged", "status": "completed", "tag": "a9ccbd26-cae4-415a-95db-3c249567971a"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:08.885192 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cd03744d-e16c-431f-8e6f-f937eb96cdd9 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:08.886111 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cd03744d-e16c-431f-8e6f-f937eb96cdd9 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:08.887443 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cd03744d-e16c-431f-8e6f-f937eb96cdd9 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:08.905999 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-59143c24-2866-449f-93db-04e7497730cb req-9a06298d-2a2c-40e8-9bd4-499b760cbe3f service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:08.911975 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-59143c24-2866-449f-93db-04e7497730cb req-9a06298d-2a2c-40e8-9bd4-499b760cbe3f service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:08.914056 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-59143c24-2866-449f-93db-04e7497730cb req-9a06298d-2a2c-40e8-9bd4-499b760cbe3f service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:08.942310 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-cd03744d-e16c-431f-8e6f-f937eb96cdd9 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Getting quotas for project ccf0569de787477e964f570378d6459a. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:36:08.956256 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-59143c24-2866-449f-93db-04e7497730cb req-9a06298d-2a2c-40e8-9bd4-499b760cbe3f service nova] Creating event network-vif-plugged:a9ccbd26-cae4-415a-95db-3c249567971a for instance 4d242145-87ff-473a-bac2-fdd483fb5863 on n-h1-854247-14 Oct 17 13:36:08.957945 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-cd03744d-e16c-431f-8e6f-f937eb96cdd9 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Getting quotas for user 62cc720667f44772988d7890c227b217 and project ccf0569de787477e964f570378d6459a. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:36:08.969721 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-59143c24-2866-449f-93db-04e7497730cb req-9a06298d-2a2c-40e8-9bd4-499b760cbe3f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094750 Oct 17 13:36:08.976238 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 367/743] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:36:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:36:09.008442 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cd03744d-e16c-431f-8e6f-f937eb96cdd9 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:36:09.023936 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cd03744d-e16c-431f-8e6f-f937eb96cdd9 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: a54adf11-ee58-4f13-82c8-9a00a36c536e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:36:09.176018 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cd03744d-e16c-431f-8e6f-f937eb96cdd9 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.663438 Oct 17 13:36:09.177612 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 377/744] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:36:07 2022] POST /compute/v2.1/servers => generated 404 bytes in 1675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:36:09.191115 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7413b65a-ab38-45ce-ae73-eda9ee03c71b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:09.192207 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7413b65a-ab38-45ce-ae73-eda9ee03c71b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: a54adf11-ee58-4f13-82c8-9a00a36c536e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:09.302821 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7413b65a-ab38-45ce-ae73-eda9ee03c71b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:09.323938 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-874620a7-cac4-4464-80f1-40faee14b5cc tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:09.324772 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-874620a7-cac4-4464-80f1-40faee14b5cc tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 4d242145-87ff-473a-bac2-fdd483fb5863] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:09.340808 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7413b65a-ab38-45ce-ae73-eda9ee03c71b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e" status: 200 len: 1234 microversion: 2.1 time: 0.155169 Oct 17 13:36:09.356157 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 368/745] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:09 2022] GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e => generated 1234 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:09.369005 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-874620a7-cac4-4464-80f1-40faee14b5cc tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:09.369330 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-874620a7-cac4-4464-80f1-40faee14b5cc tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:09.370517 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-874620a7-cac4-4464-80f1-40faee14b5cc tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:09.371823 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-874620a7-cac4-4464-80f1-40faee14b5cc tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:09.373505 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-874620a7-cac4-4464-80f1-40faee14b5cc tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:09.384846 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-874620a7-cac4-4464-80f1-40faee14b5cc tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:09.697462 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1c444ed0-9dad-48f1-83c4-2cb9e2671763 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:09.698247 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1c444ed0-9dad-48f1-83c4-2cb9e2671763 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] [instance: 51be2144-e969-4e1b-b5da-c43b9a7b7c90] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:09.711113 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c444ed0-9dad-48f1-83c4-2cb9e2671763 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:09.713129 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c444ed0-9dad-48f1-83c4-2cb9e2671763 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:09.715864 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c444ed0-9dad-48f1-83c4-2cb9e2671763 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:09.718495 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c444ed0-9dad-48f1-83c4-2cb9e2671763 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:09.720399 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c444ed0-9dad-48f1-83c4-2cb9e2671763 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:09.722210 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c444ed0-9dad-48f1-83c4-2cb9e2671763 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:10.103102 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-1c444ed0-9dad-48f1-83c4-2cb9e2671763 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lazy-loading 'services' on Instance uuid 51be2144-e969-4e1b-b5da-c43b9a7b7c90 {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:36:10.116399 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-874620a7-cac4-4464-80f1-40faee14b5cc tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:10.144372 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-874620a7-cac4-4464-80f1-40faee14b5cc tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/4d242145-87ff-473a-bac2-fdd483fb5863" status: 200 len: 1318 microversion: 2.1 time: 0.833762 Oct 17 13:36:10.155764 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 378/746] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:09 2022] GET /compute/v2.1/servers/4d242145-87ff-473a-bac2-fdd483fb5863 => generated 1318 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:36:10.195869 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1c444ed0-9dad-48f1-83c4-2cb9e2671763 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90" status: 200 len: 1931 microversion: 2.75 time: 0.503947 Oct 17 13:36:10.197080 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 369/747] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:36:09 2022] GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90 => generated 1931 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:36:10.375117 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0547f422-270d-4c11-91e1-4553c2d2a5e4 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:10.376023 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0547f422-270d-4c11-91e1-4553c2d2a5e4 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: a54adf11-ee58-4f13-82c8-9a00a36c536e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:10.385603 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:36:10.415281 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0547f422-270d-4c11-91e1-4553c2d2a5e4 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:10.416299 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0547f422-270d-4c11-91e1-4553c2d2a5e4 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:10.417403 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0547f422-270d-4c11-91e1-4553c2d2a5e4 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:10.427809 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0547f422-270d-4c11-91e1-4553c2d2a5e4 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:10.441022 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0547f422-270d-4c11-91e1-4553c2d2a5e4 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:10.443973 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0547f422-270d-4c11-91e1-4553c2d2a5e4 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:10.612275 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0547f422-270d-4c11-91e1-4553c2d2a5e4 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:10.624594 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0547f422-270d-4c11-91e1-4553c2d2a5e4 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e" status: 200 len: 1230 microversion: 2.1 time: 0.257989 Oct 17 13:36:10.627817 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 379/748] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:10 2022] GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e => generated 1230 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:10.763539 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-336480e4-4436-4f63-8e89-5d54f6a78e7e tempest-ListImagesTestJSON-881934573 tempest-ListImagesTestJSON-881934573-project] Calling method '.version_select at 0x7f7cd5f19c10>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:10.844683 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-336480e4-4436-4f63-8e89-5d54f6a78e7e tempest-ListImagesTestJSON-881934573 tempest-ListImagesTestJSON-881934573-project] 10.222.0.79 "GET /compute/v2.1/images/0743b21b-a6ff-4d02-897c-eabb68c3ba07" status: 200 len: 784 microversion: 2.1 time: 0.452885 Oct 17 13:36:10.845711 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 370/749] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:36:10 2022] GET /compute/v2.1/images/0743b21b-a6ff-4d02-897c-eabb68c3ba07 => generated 784 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:10.861641 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d3632590-7139-4fe7-b0a4-f47853244206 tempest-ListImagesTestJSON-881934573 tempest-ListImagesTestJSON-881934573-project] Calling method '.version_select at 0x7f7cd5688040>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:10.996193 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d3632590-7139-4fe7-b0a4-f47853244206 tempest-ListImagesTestJSON-881934573 tempest-ListImagesTestJSON-881934573-project] 10.222.0.79 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.138826 Oct 17 13:36:11.000263 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 380/750] 10.222.0.79 () {58 vars in 1122 bytes} [Mon Oct 17 13:36:10 2022] GET /compute/v2.1/images => generated 445 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:11.016594 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-babb9191-f6d1-4b92-8922-d92e6b538f80 tempest-ListImagesTestJSON-881934573 tempest-ListImagesTestJSON-881934573-project] Calling method '.version_select at 0x7f7cd59e3160>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:11.123520 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-babb9191-f6d1-4b92-8922-d92e6b538f80 tempest-ListImagesTestJSON-881934573 tempest-ListImagesTestJSON-881934573-project] 10.222.0.79 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.102353 Oct 17 13:36:11.125068 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 371/751] 10.222.0.79 () {58 vars in 1143 bytes} [Mon Oct 17 13:36:11 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:11.179997 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-dc14f16f-187c-4338-9f61-3335a86afabc tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:11.181631 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-dc14f16f-187c-4338-9f61-3335a86afabc tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 4d242145-87ff-473a-bac2-fdd483fb5863] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:11.194501 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc14f16f-187c-4338-9f61-3335a86afabc tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:11.196847 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc14f16f-187c-4338-9f61-3335a86afabc tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:11.198668 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc14f16f-187c-4338-9f61-3335a86afabc tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:11.203844 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc14f16f-187c-4338-9f61-3335a86afabc tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:11.204862 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc14f16f-187c-4338-9f61-3335a86afabc tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:11.205514 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc14f16f-187c-4338-9f61-3335a86afabc tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:11.229686 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e54a0943-8935-49d8-a9fe-8a19e97fd277 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:11.230340 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e54a0943-8935-49d8-a9fe-8a19e97fd277 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] [instance: 51be2144-e969-4e1b-b5da-c43b9a7b7c90] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:11.245788 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e54a0943-8935-49d8-a9fe-8a19e97fd277 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:11.252014 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e54a0943-8935-49d8-a9fe-8a19e97fd277 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:11.252711 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e54a0943-8935-49d8-a9fe-8a19e97fd277 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:11.254901 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e54a0943-8935-49d8-a9fe-8a19e97fd277 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:11.260391 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e54a0943-8935-49d8-a9fe-8a19e97fd277 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:11.261727 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e54a0943-8935-49d8-a9fe-8a19e97fd277 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:11.546248 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-e54a0943-8935-49d8-a9fe-8a19e97fd277 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lazy-loading 'services' on Instance uuid 51be2144-e969-4e1b-b5da-c43b9a7b7c90 {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:36:11.594354 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e54a0943-8935-49d8-a9fe-8a19e97fd277 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90" status: 200 len: 1931 microversion: 2.75 time: 0.369242 Oct 17 13:36:11.611691 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 372/752] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:36:11 2022] GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90 => generated 1931 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:36:11.653224 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-dc8953e0-cc88-4c18-b11c-903b5c47e946 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:11.654241 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-dc8953e0-cc88-4c18-b11c-903b5c47e946 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: a54adf11-ee58-4f13-82c8-9a00a36c536e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:11.667345 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dc8953e0-cc88-4c18-b11c-903b5c47e946 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:11.667825 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dc8953e0-cc88-4c18-b11c-903b5c47e946 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:11.668268 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dc8953e0-cc88-4c18-b11c-903b5c47e946 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:11.668984 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dc8953e0-cc88-4c18-b11c-903b5c47e946 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:11.669435 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dc8953e0-cc88-4c18-b11c-903b5c47e946 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:11.688697 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dc8953e0-cc88-4c18-b11c-903b5c47e946 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:11.904008 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-dc8953e0-cc88-4c18-b11c-903b5c47e946 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:11.914561 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-dc8953e0-cc88-4c18-b11c-903b5c47e946 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e" status: 200 len: 1294 microversion: 2.1 time: 0.265598 Oct 17 13:36:11.926967 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 373/753] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:11 2022] GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e => generated 1294 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:36:12.061828 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-dc14f16f-187c-4338-9f61-3335a86afabc tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:12.073252 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-dc14f16f-187c-4338-9f61-3335a86afabc tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/4d242145-87ff-473a-bac2-fdd483fb5863" status: 200 len: 1467 microversion: 2.1 time: 0.903811 Oct 17 13:36:12.075487 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 381/754] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:11 2022] GET /compute/v2.1/servers/4d242145-87ff-473a-bac2-fdd483fb5863 => generated 1467 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:12.121291 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c0fbfbf1-1048-4968-92b9-a4f18e84b225 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:12.122254 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c0fbfbf1-1048-4968-92b9-a4f18e84b225 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: ec948255-c8e9-4450-95d5-42f38b9afe45] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:12.133742 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c0fbfbf1-1048-4968-92b9-a4f18e84b225 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:12.140728 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c0fbfbf1-1048-4968-92b9-a4f18e84b225 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:12.144013 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c0fbfbf1-1048-4968-92b9-a4f18e84b225 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:12.144792 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c0fbfbf1-1048-4968-92b9-a4f18e84b225 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:12.145257 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c0fbfbf1-1048-4968-92b9-a4f18e84b225 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:12.145684 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c0fbfbf1-1048-4968-92b9-a4f18e84b225 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:12.634141 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0ec4bb11-ab1d-4526-bafe-8d5fedb02f03 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:12.642731 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0ec4bb11-ab1d-4526-bafe-8d5fedb02f03 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] [instance: 51be2144-e969-4e1b-b5da-c43b9a7b7c90] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:12.651198 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0ec4bb11-ab1d-4526-bafe-8d5fedb02f03 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:12.651870 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0ec4bb11-ab1d-4526-bafe-8d5fedb02f03 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:12.652371 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0ec4bb11-ab1d-4526-bafe-8d5fedb02f03 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:12.653378 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0ec4bb11-ab1d-4526-bafe-8d5fedb02f03 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:12.653937 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0ec4bb11-ab1d-4526-bafe-8d5fedb02f03 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:12.656055 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0ec4bb11-ab1d-4526-bafe-8d5fedb02f03 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:13.180201 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-0ec4bb11-ab1d-4526-bafe-8d5fedb02f03 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lazy-loading 'services' on Instance uuid 51be2144-e969-4e1b-b5da-c43b9a7b7c90 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:36:13.214156 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0ec4bb11-ab1d-4526-bafe-8d5fedb02f03 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90" status: 200 len: 1931 microversion: 2.75 time: 0.586937 Oct 17 13:36:13.215683 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 382/755] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:36:12 2022] GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90 => generated 1931 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:36:13.232123 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b44a820c-363a-4570-b50f-61de51f94c7e tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:13.233028 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b44a820c-363a-4570-b50f-61de51f94c7e tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: a54adf11-ee58-4f13-82c8-9a00a36c536e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:13.242462 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b44a820c-363a-4570-b50f-61de51f94c7e tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:13.243573 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b44a820c-363a-4570-b50f-61de51f94c7e tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:13.244214 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b44a820c-363a-4570-b50f-61de51f94c7e tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:13.245156 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b44a820c-363a-4570-b50f-61de51f94c7e tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:13.245789 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b44a820c-363a-4570-b50f-61de51f94c7e tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:13.246407 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b44a820c-363a-4570-b50f-61de51f94c7e tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:13.682070 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b44a820c-363a-4570-b50f-61de51f94c7e tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:13.705675 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b44a820c-363a-4570-b50f-61de51f94c7e tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e" status: 200 len: 1292 microversion: 2.1 time: 0.488493 Oct 17 13:36:13.706893 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 383/756] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:13 2022] GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e => generated 1292 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:13.713191 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0cc4a819-07f4-483e-9e50-5757317e3f06 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:13.714155 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0cc4a819-07f4-483e-9e50-5757317e3f06 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] [instance: dd9a885e-0fb3-411a-b816-eafc93e1c5cb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:13.720685 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0cc4a819-07f4-483e-9e50-5757317e3f06 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:13.721701 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0cc4a819-07f4-483e-9e50-5757317e3f06 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:13.722299 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0cc4a819-07f4-483e-9e50-5757317e3f06 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:13.723183 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0cc4a819-07f4-483e-9e50-5757317e3f06 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:13.724641 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0cc4a819-07f4-483e-9e50-5757317e3f06 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:13.725384 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0cc4a819-07f4-483e-9e50-5757317e3f06 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:13.801896 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0cc4a819-07f4-483e-9e50-5757317e3f06 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] [instance: dd9a885e-0fb3-411a-b816-eafc93e1c5cb] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:36:13.869169 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c0fbfbf1-1048-4968-92b9-a4f18e84b225 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:13.885398 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c0fbfbf1-1048-4968-92b9-a4f18e84b225 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/ec948255-c8e9-4450-95d5-42f38b9afe45" status: 200 len: 1468 microversion: 2.1 time: 1.788181 Oct 17 13:36:13.887095 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 374/757] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:12 2022] GET /compute/v2.1/servers/ec948255-c8e9-4450-95d5-42f38b9afe45 => generated 1468 bytes in 1791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:13.911653 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e8317fa8-c4b2-4d33-a93e-cf5da0ea148a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:13.928986 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e8317fa8-c4b2-4d33-a93e-cf5da0ea148a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:13.930009 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e8317fa8-c4b2-4d33-a93e-cf5da0ea148a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Searching by: {'reservation_id': 'r-fxur306u', 'deleted': False, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7'} {{(pid=127017) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:36:13.972990 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e8317fa8-c4b2-4d33-a93e-cf5da0ea148a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:13.973975 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e8317fa8-c4b2-4d33-a93e-cf5da0ea148a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:13.974806 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e8317fa8-c4b2-4d33-a93e-cf5da0ea148a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:13.975839 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e8317fa8-c4b2-4d33-a93e-cf5da0ea148a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:13.976509 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e8317fa8-c4b2-4d33-a93e-cf5da0ea148a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:13.977169 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e8317fa8-c4b2-4d33-a93e-cf5da0ea148a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:14.059125 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0cc4a819-07f4-483e-9e50-5757317e3f06 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] 10.222.0.79 "DELETE /compute/v2.1/servers/dd9a885e-0fb3-411a-b816-eafc93e1c5cb" status: 204 len: 0 microversion: 2.1 time: 0.348693 Oct 17 13:36:14.069571 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 384/758] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:36:13 2022] DELETE /compute/v2.1/servers/dd9a885e-0fb3-411a-b816-eafc93e1c5cb => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:36:14.077161 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0572f269-5993-4617-82bb-d34b7b870b9b tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:14.078163 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0572f269-5993-4617-82bb-d34b7b870b9b tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] [instance: dd9a885e-0fb3-411a-b816-eafc93e1c5cb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:14.107332 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0572f269-5993-4617-82bb-d34b7b870b9b tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:14.108189 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0572f269-5993-4617-82bb-d34b7b870b9b tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:14.108807 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0572f269-5993-4617-82bb-d34b7b870b9b tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:14.112280 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0572f269-5993-4617-82bb-d34b7b870b9b tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:14.112931 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0572f269-5993-4617-82bb-d34b7b870b9b tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:14.113567 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0572f269-5993-4617-82bb-d34b7b870b9b tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:14.301002 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.multi_cell_list [None req-e8317fa8-c4b2-4d33-a93e-cf5da0ea148a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127017) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:36:14.533349 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e8317fa8-c4b2-4d33-a93e-cf5da0ea148a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:14.554307 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e8317fa8-c4b2-4d33-a93e-cf5da0ea148a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:14.558986 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e8317fa8-c4b2-4d33-a93e-cf5da0ea148a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:14.559733 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e8317fa8-c4b2-4d33-a93e-cf5da0ea148a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:14.941740 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0572f269-5993-4617-82bb-d34b7b870b9b tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e836340278b49f593350249132b9cfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550b2bda88024756abc4134365842d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:14.950569 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0572f269-5993-4617-82bb-d34b7b870b9b tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] 10.222.0.79 "GET /compute/v2.1/servers/dd9a885e-0fb3-411a-b816-eafc93e1c5cb" status: 200 len: 1711 microversion: 2.1 time: 0.879323 Oct 17 13:36:14.970636 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 385/759] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:14 2022] GET /compute/v2.1/servers/dd9a885e-0fb3-411a-b816-eafc93e1c5cb => generated 1711 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:14.977421 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3e956d68-1440-4896-9fca-c1ce315990d4 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:14.983394 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3e956d68-1440-4896-9fca-c1ce315990d4 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] [instance: 51be2144-e969-4e1b-b5da-c43b9a7b7c90] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:14.996701 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3e956d68-1440-4896-9fca-c1ce315990d4 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:15.001413 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3e956d68-1440-4896-9fca-c1ce315990d4 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:15.002067 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3e956d68-1440-4896-9fca-c1ce315990d4 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:15.002975 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3e956d68-1440-4896-9fca-c1ce315990d4 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:15.005248 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3e956d68-1440-4896-9fca-c1ce315990d4 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:15.006996 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3e956d68-1440-4896-9fca-c1ce315990d4 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:15.463916 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-3e956d68-1440-4896-9fca-c1ce315990d4 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lazy-loading 'services' on Instance uuid 51be2144-e969-4e1b-b5da-c43b9a7b7c90 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:36:15.521872 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3e956d68-1440-4896-9fca-c1ce315990d4 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90" status: 200 len: 1931 microversion: 2.75 time: 0.549860 Oct 17 13:36:15.526850 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 386/760] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:36:14 2022] GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90 => generated 1931 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:36:15.542322 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e8317fa8-c4b2-4d33-a93e-cf5da0ea148a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/detail?reservation_id=r-fxur306u" status: 200 len: 2928 microversion: 2.1 time: 1.634660 Oct 17 13:36:15.542928 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 375/761] 10.222.0.79 () {58 vars in 1197 bytes} [Mon Oct 17 13:36:13 2022] GET /compute/v2.1/servers/detail?reservation_id=r-fxur306u => generated 2928 bytes in 1636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:15.550799 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-75279faa-4272-42cc-bc9c-961c52efe14c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:15.555124 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-75279faa-4272-42cc-bc9c-961c52efe14c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: a54adf11-ee58-4f13-82c8-9a00a36c536e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:15.569767 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d44c14b0-8ed4-4df8-9525-0ca00f0c80d4 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:15.602536 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-75279faa-4272-42cc-bc9c-961c52efe14c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:15.603443 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-75279faa-4272-42cc-bc9c-961c52efe14c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:15.606119 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-75279faa-4272-42cc-bc9c-961c52efe14c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:15.609177 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-75279faa-4272-42cc-bc9c-961c52efe14c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:15.612683 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-75279faa-4272-42cc-bc9c-961c52efe14c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:15.614250 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-75279faa-4272-42cc-bc9c-961c52efe14c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:15.631340 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:36:15.656395 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.compute.server_groups [None req-d44c14b0-8ed4-4df8-9525-0ca00f0c80d4 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Querying cell 23debefa-f967-4de1-8ea3-1fa7cc16392a(cell1) for 2 instances {{(pid=127017) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 17 13:36:15.657209 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d44c14b0-8ed4-4df8-9525-0ca00f0c80d4 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:15.661091 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d44c14b0-8ed4-4df8-9525-0ca00f0c80d4 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:15.661569 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d44c14b0-8ed4-4df8-9525-0ca00f0c80d4 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:15.742159 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d44c14b0-8ed4-4df8-9525-0ca00f0c80d4 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/os-server-groups/8dc84431-0b19-4210-9e52-d66f999b4795" status: 200 len: 271 microversion: 2.1 time: 0.173356 Oct 17 13:36:15.746285 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 376/762] 10.222.0.79 () {58 vars in 1263 bytes} [Mon Oct 17 13:36:15 2022] GET /compute/v2.1/os-server-groups/8dc84431-0b19-4210-9e52-d66f999b4795 => generated 271 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:36:15.766151 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ed3d0db6-0bef-487c-9ffe-fd8b35954c91 tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:15.772194 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ed3d0db6-0bef-487c-9ffe-fd8b35954c91 tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] [instance: 4d242145-87ff-473a-bac2-fdd483fb5863] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:15.828042 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ed3d0db6-0bef-487c-9ffe-fd8b35954c91 tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:15.828562 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ed3d0db6-0bef-487c-9ffe-fd8b35954c91 tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:15.829021 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ed3d0db6-0bef-487c-9ffe-fd8b35954c91 tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:15.840742 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ed3d0db6-0bef-487c-9ffe-fd8b35954c91 tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:15.841245 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ed3d0db6-0bef-487c-9ffe-fd8b35954c91 tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:15.841687 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ed3d0db6-0bef-487c-9ffe-fd8b35954c91 tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:16.010504 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-75279faa-4272-42cc-bc9c-961c52efe14c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:16.024098 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-75279faa-4272-42cc-bc9c-961c52efe14c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e" status: 200 len: 1292 microversion: 2.1 time: 0.492698 Oct 17 13:36:16.032414 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 387/763] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:15 2022] GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e => generated 1292 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:16.037544 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ce742a9a-14f8-4a0e-b393-91883eed07c7 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:16.050810 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ce742a9a-14f8-4a0e-b393-91883eed07c7 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] [instance: dd9a885e-0fb3-411a-b816-eafc93e1c5cb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:16.073322 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ce742a9a-14f8-4a0e-b393-91883eed07c7 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:16.073852 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ce742a9a-14f8-4a0e-b393-91883eed07c7 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:16.074310 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ce742a9a-14f8-4a0e-b393-91883eed07c7 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:16.075079 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ce742a9a-14f8-4a0e-b393-91883eed07c7 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:16.075579 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ce742a9a-14f8-4a0e-b393-91883eed07c7 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:16.076011 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ce742a9a-14f8-4a0e-b393-91883eed07c7 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:16.583828 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ed3d0db6-0bef-487c-9ffe-fd8b35954c91 tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/4d242145-87ff-473a-bac2-fdd483fb5863" status: 200 len: 1620 microversion: 2.1 time: 0.833459 Oct 17 13:36:16.584849 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 377/764] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:15 2022] GET /compute/v2.1/servers/4d242145-87ff-473a-bac2-fdd483fb5863 => generated 1620 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:16.600430 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-691a53fd-6cfb-455e-84eb-204223cbf944 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:16.600430 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-691a53fd-6cfb-455e-84eb-204223cbf944 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] [instance: 51be2144-e969-4e1b-b5da-c43b9a7b7c90] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:16.612926 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-691a53fd-6cfb-455e-84eb-204223cbf944 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:16.613425 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-691a53fd-6cfb-455e-84eb-204223cbf944 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:16.613866 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-691a53fd-6cfb-455e-84eb-204223cbf944 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:16.616772 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-691a53fd-6cfb-455e-84eb-204223cbf944 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:16.617237 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-691a53fd-6cfb-455e-84eb-204223cbf944 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:16.617787 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-691a53fd-6cfb-455e-84eb-204223cbf944 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:16.832651 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-691a53fd-6cfb-455e-84eb-204223cbf944 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lazy-loading 'services' on Instance uuid 51be2144-e969-4e1b-b5da-c43b9a7b7c90 {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:36:16.866648 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-691a53fd-6cfb-455e-84eb-204223cbf944 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90" status: 200 len: 1931 microversion: 2.75 time: 0.280233 Oct 17 13:36:16.867467 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ce742a9a-14f8-4a0e-b393-91883eed07c7 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e836340278b49f593350249132b9cfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550b2bda88024756abc4134365842d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:16.880863 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ce742a9a-14f8-4a0e-b393-91883eed07c7 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] 10.222.0.79 "GET /compute/v2.1/servers/dd9a885e-0fb3-411a-b816-eafc93e1c5cb" status: 200 len: 1711 microversion: 2.1 time: 0.847039 Oct 17 13:36:16.883086 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 388/766] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:16 2022] GET /compute/v2.1/servers/dd9a885e-0fb3-411a-b816-eafc93e1c5cb => generated 1711 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:16.883474 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 378/766] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:36:16 2022] GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90 => generated 1931 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:36:16.904953 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-22db047a-706a-42c6-8897-57dba766d53c tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:16.905999 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-22db047a-706a-42c6-8897-57dba766d53c tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] [instance: ec948255-c8e9-4450-95d5-42f38b9afe45] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:16.921180 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:36:16.923539 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-22db047a-706a-42c6-8897-57dba766d53c tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:16.924040 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-22db047a-706a-42c6-8897-57dba766d53c tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:16.924479 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-22db047a-706a-42c6-8897-57dba766d53c tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:16.925543 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-22db047a-706a-42c6-8897-57dba766d53c tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:16.926148 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-22db047a-706a-42c6-8897-57dba766d53c tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:16.926720 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-22db047a-706a-42c6-8897-57dba766d53c tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:17.047560 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9a02208e-600a-4f13-9328-68539072ab92 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:17.049599 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9a02208e-600a-4f13-9328-68539072ab92 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: a54adf11-ee58-4f13-82c8-9a00a36c536e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:17.066594 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9a02208e-600a-4f13-9328-68539072ab92 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:17.067405 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9a02208e-600a-4f13-9328-68539072ab92 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:17.068004 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9a02208e-600a-4f13-9328-68539072ab92 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:17.069082 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9a02208e-600a-4f13-9328-68539072ab92 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:17.071897 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9a02208e-600a-4f13-9328-68539072ab92 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:17.072566 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9a02208e-600a-4f13-9328-68539072ab92 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:18.919227 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:36:18.979035 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=6 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:36:19.132005 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-22db047a-706a-42c6-8897-57dba766d53c tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/ec948255-c8e9-4450-95d5-42f38b9afe45" status: 200 len: 1621 microversion: 2.1 time: 2.209336 Oct 17 13:36:19.134935 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 379/767] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:16 2022] GET /compute/v2.1/servers/ec948255-c8e9-4450-95d5-42f38b9afe45 => generated 1621 bytes in 2251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:19.153296 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d40151e1-bd76-40ce-84aa-9475af712a82 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:19.154462 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d40151e1-bd76-40ce-84aa-9475af712a82 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] [instance: 51be2144-e969-4e1b-b5da-c43b9a7b7c90] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:19.160448 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9a02208e-600a-4f13-9328-68539072ab92 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:19.180955 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9a02208e-600a-4f13-9328-68539072ab92 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e" status: 200 len: 1358 microversion: 2.1 time: 2.132684 Oct 17 13:36:19.194285 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 389/768] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:17 2022] GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e => generated 1358 bytes in 2149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:36:19.223702 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d40151e1-bd76-40ce-84aa-9475af712a82 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:19.224426 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d40151e1-bd76-40ce-84aa-9475af712a82 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:19.228192 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e95e24c0-b121-454e-8833-d240226140a0 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:19.229717 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d40151e1-bd76-40ce-84aa-9475af712a82 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:19.231442 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d40151e1-bd76-40ce-84aa-9475af712a82 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:19.234192 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d40151e1-bd76-40ce-84aa-9475af712a82 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:19.235017 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e95e24c0-b121-454e-8833-d240226140a0 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] [instance: dd9a885e-0fb3-411a-b816-eafc93e1c5cb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:19.240204 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d40151e1-bd76-40ce-84aa-9475af712a82 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:19.261945 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e95e24c0-b121-454e-8833-d240226140a0 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:19.263708 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e95e24c0-b121-454e-8833-d240226140a0 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:19.264415 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e95e24c0-b121-454e-8833-d240226140a0 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:19.266285 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e95e24c0-b121-454e-8833-d240226140a0 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:19.268960 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e95e24c0-b121-454e-8833-d240226140a0 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:19.269610 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e95e24c0-b121-454e-8833-d240226140a0 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:19.429167 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e95e24c0-b121-454e-8833-d240226140a0 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:19.437944 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e95e24c0-b121-454e-8833-d240226140a0 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:19.438693 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e95e24c0-b121-454e-8833-d240226140a0 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:19.442651 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-e95e24c0-b121-454e-8833-d240226140a0 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lazy-loading 'fault' on Instance uuid dd9a885e-0fb3-411a-b816-eafc93e1c5cb {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:36:19.517776 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-d40151e1-bd76-40ce-84aa-9475af712a82 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lazy-loading 'services' on Instance uuid 51be2144-e969-4e1b-b5da-c43b9a7b7c90 {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:36:19.556634 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d40151e1-bd76-40ce-84aa-9475af712a82 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90" status: 200 len: 1931 microversion: 2.75 time: 0.420306 Oct 17 13:36:19.557947 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 380/769] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:36:19 2022] GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90 => generated 1931 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:36:19.586647 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-95990e0b-c4c6-4991-ba1a-54f9c5899b7e req-1aa3c10a-4dea-4c0c-8435-344ccac3b804 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd9a885e-0fb3-411a-b816-eafc93e1c5cb", "name": "network-vif-deleted", "tag": "2ff450f2-efdf-4213-8a18-aa178b264642"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:19.621755 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-95990e0b-c4c6-4991-ba1a-54f9c5899b7e req-1aa3c10a-4dea-4c0c-8435-344ccac3b804 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:19.622009 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-95990e0b-c4c6-4991-ba1a-54f9c5899b7e req-1aa3c10a-4dea-4c0c-8435-344ccac3b804 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:19.635552 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-95990e0b-c4c6-4991-ba1a-54f9c5899b7e req-1aa3c10a-4dea-4c0c-8435-344ccac3b804 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:19.641694 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e95e24c0-b121-454e-8833-d240226140a0 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e836340278b49f593350249132b9cfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550b2bda88024756abc4134365842d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:19.650376 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e95e24c0-b121-454e-8833-d240226140a0 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] 10.222.0.79 "GET /compute/v2.1/servers/dd9a885e-0fb3-411a-b816-eafc93e1c5cb" status: 200 len: 1354 microversion: 2.1 time: 0.454754 Oct 17 13:36:19.667442 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 390/770] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:19 2022] GET /compute/v2.1/servers/dd9a885e-0fb3-411a-b816-eafc93e1c5cb => generated 1354 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:19.667442 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-45028451-bdd7-4240-9351-e14f63bffc93 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1964223200", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "32728e12-4f3f-4f72-902c-10349708549f"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:19.676018 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-95990e0b-c4c6-4991-ba1a-54f9c5899b7e req-1aa3c10a-4dea-4c0c-8435-344ccac3b804 service nova] Creating event network-vif-deleted:2ff450f2-efdf-4213-8a18-aa178b264642 for instance dd9a885e-0fb3-411a-b816-eafc93e1c5cb on n-h2-854247-14 Oct 17 13:36:19.697967 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-95990e0b-c4c6-4991-ba1a-54f9c5899b7e req-1aa3c10a-4dea-4c0c-8435-344ccac3b804 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136316 Oct 17 13:36:19.699004 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 381/771] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:36:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:19.797570 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-45028451-bdd7-4240-9351-e14f63bffc93 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] validate_networks() for None {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:36:20.212275 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f2c2ecc6-fb82-4ab7-b03d-a61de385616b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:20.213447 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f2c2ecc6-fb82-4ab7-b03d-a61de385616b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: a54adf11-ee58-4f13-82c8-9a00a36c536e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:20.231332 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f2c2ecc6-fb82-4ab7-b03d-a61de385616b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:20.231786 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f2c2ecc6-fb82-4ab7-b03d-a61de385616b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:20.232338 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f2c2ecc6-fb82-4ab7-b03d-a61de385616b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:20.234362 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f2c2ecc6-fb82-4ab7-b03d-a61de385616b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:20.242635 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f2c2ecc6-fb82-4ab7-b03d-a61de385616b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:20.243371 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f2c2ecc6-fb82-4ab7-b03d-a61de385616b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:20.747749 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-45028451-bdd7-4240-9351-e14f63bffc93 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:36:20.748784 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-45028451-bdd7-4240-9351-e14f63bffc93 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:36:20.749499 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-45028451-bdd7-4240-9351-e14f63bffc93 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:36:20.750121 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-45028451-bdd7-4240-9351-e14f63bffc93 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:36:20.750768 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-45028451-bdd7-4240-9351-e14f63bffc93 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:36:20.788132 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-45028451-bdd7-4240-9351-e14f63bffc93 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:20.788758 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-45028451-bdd7-4240-9351-e14f63bffc93 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:20.789435 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-45028451-bdd7-4240-9351-e14f63bffc93 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:20.792623 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-45028451-bdd7-4240-9351-e14f63bffc93 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:20.793366 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-45028451-bdd7-4240-9351-e14f63bffc93 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:20.797421 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-45028451-bdd7-4240-9351-e14f63bffc93 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:20.856388 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-45028451-bdd7-4240-9351-e14f63bffc93 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Getting quotas for project fa1db260a96a4c6aa69cd6437baab6f7. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:36:20.872052 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-45028451-bdd7-4240-9351-e14f63bffc93 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Getting quotas for user 7a7e082035084338966a1c56b30c7093 and project fa1db260a96a4c6aa69cd6437baab6f7. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:36:20.905986 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-45028451-bdd7-4240-9351-e14f63bffc93 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:36:20.916481 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-45028451-bdd7-4240-9351-e14f63bffc93 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 8138c4a6-0fa5-4427-a026-56618461dd14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:36:21.008204 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-45028451-bdd7-4240-9351-e14f63bffc93 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.350728 Oct 17 13:36:21.015412 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 391/772] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:36:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1353 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:36:21.021642 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8cb552f5-9601-481b-9d0b-cbd179192b3d tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:21.022666 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8cb552f5-9601-481b-9d0b-cbd179192b3d tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] [instance: 51be2144-e969-4e1b-b5da-c43b9a7b7c90] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:21.032906 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8cb552f5-9601-481b-9d0b-cbd179192b3d tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:21.033765 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8cb552f5-9601-481b-9d0b-cbd179192b3d tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:21.034416 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8cb552f5-9601-481b-9d0b-cbd179192b3d tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:21.035415 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8cb552f5-9601-481b-9d0b-cbd179192b3d tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:21.036598 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8cb552f5-9601-481b-9d0b-cbd179192b3d tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:21.037290 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8cb552f5-9601-481b-9d0b-cbd179192b3d tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:21.206740 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f2c2ecc6-fb82-4ab7-b03d-a61de385616b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:21.220878 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f2c2ecc6-fb82-4ab7-b03d-a61de385616b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e" status: 200 len: 1358 microversion: 2.1 time: 1.014826 Oct 17 13:36:21.226399 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 382/773] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:20 2022] GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e => generated 1358 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:21.243751 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-922b7095-d256-461f-ae21-2d68104e5e7d tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:21.245491 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-922b7095-d256-461f-ae21-2d68104e5e7d tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] [instance: dd9a885e-0fb3-411a-b816-eafc93e1c5cb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:21.255269 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-922b7095-d256-461f-ae21-2d68104e5e7d tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:21.255970 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-922b7095-d256-461f-ae21-2d68104e5e7d tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:21.257612 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-922b7095-d256-461f-ae21-2d68104e5e7d tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:21.259847 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-922b7095-d256-461f-ae21-2d68104e5e7d tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:21.260754 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-922b7095-d256-461f-ae21-2d68104e5e7d tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:21.262870 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-922b7095-d256-461f-ae21-2d68104e5e7d tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:21.304762 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-922b7095-d256-461f-ae21-2d68104e5e7d tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] HTTP exception thrown: Instance dd9a885e-0fb3-411a-b816-eafc93e1c5cb could not be found. Oct 17 13:36:21.309420 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-922b7095-d256-461f-ae21-2d68104e5e7d tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Request method failure captured: Oct 17 13:36:21.309420 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/dd9a885e-0fb3-411a-b816-eafc93e1c5cb HTTP/1.1 Oct 17 13:36:21.309420 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:36:21.309420 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:36:21.309420 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:36:21.309420 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:36:21.309420 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:36:21.309420 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:36:21.309420 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:36:21.309420 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:36:21.309420 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVm6bieuXIIYLvy0oOrXYn9AjBqz94a9CoehJppiqdZVer6fdf9NdlscbsLsoPT0irpyAYUhG8q8kx4oKEoVEnbwHr1rQpChIXaDXuoebwimC-XXq28fsEwRS9cZ23IJkd0wdxZLsqlKIxcNZ-MI0ZYUHOOzQxd5B01etTyK_ahJYiU Oct 17 13:36:21.309420 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:36:21.309420 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:36:21.309420 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:36:21.309420 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:36:21.309420 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:36:21.309420 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:36:21.309420 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 550b2bda88024756abc4134365842d17 Oct 17 13:36:21.309420 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-811640730 Oct 17 13:36:21.309420 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:36:21.309420 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:36:21.311059 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/550b2bda88024756abc4134365842d17"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/550b2bda88024756abc4134365842d17"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/550b2bda88024756abc4134365842d17"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_550b2bda88024756abc4134365842d17", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:36:21.311059 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-811640730 Oct 17 13:36:21.311059 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 550b2bda88024756abc4134365842d17 Oct 17 13:36:21.311059 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-811640730 Oct 17 13:36:21.311059 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServersWithSpecificFlavorTestJSON-811640730-project Oct 17 13:36:21.311059 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:36:21.311059 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:36:21.311059 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 8e836340278b49f593350249132b9cfc Oct 17 13:36:21.311059 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-811640730-project Oct 17 13:36:21.311059 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:36:21.311059 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance dd9a885e-0fb3-411a-b816-eafc93e1c5cb could not be found. Oct 17 13:36:21.311059 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'dd9a885e-0fb3-411a-b816-eafc93e1c5cb'} Oct 17 13:36:21.312240 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:36:21.312240 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:21.312240 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:36:21.312240 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:36:21.312240 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:36:21.312240 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:36:21.312240 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:36:21.312240 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:36:21.312240 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:36:21.312240 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:36:21.312240 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd9a885e-0fb3-411a-b816-eafc93e1c5cb could not be found. Oct 17 13:36:21.312240 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:21.312240 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:21.312240 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:21.312240 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:21.312240 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:21.312240 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:21.312240 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:36:21.312240 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:36:21.312240 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:36:21.313794 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:36:21.313794 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:36:21.313794 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:36:21.313794 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:36:21.313794 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:36:21.313794 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:36:21.313794 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:36:21.313794 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd9a885e-0fb3-411a-b816-eafc93e1c5cb could not be found. Oct 17 13:36:21.313794 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:21.313794 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:21.313794 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:21.313794 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:21.313794 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:21.313794 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:21.313794 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:36:21.313794 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:36:21.313794 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd9a885e-0fb3-411a-b816-eafc93e1c5cb could not be found. Oct 17 13:36:21.313794 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:21.316406 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-922b7095-d256-461f-ae21-2d68104e5e7d tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Returning 404 to user: Instance dd9a885e-0fb3-411a-b816-eafc93e1c5cb could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:36:21.318444 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-8cb552f5-9601-481b-9d0b-cbd179192b3d tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lazy-loading 'services' on Instance uuid 51be2144-e969-4e1b-b5da-c43b9a7b7c90 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:36:21.320091 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-922b7095-d256-461f-ae21-2d68104e5e7d tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] 10.222.0.79 "GET /compute/v2.1/servers/dd9a885e-0fb3-411a-b816-eafc93e1c5cb" status: 404 len: 111 microversion: 2.1 time: 0.090689 Oct 17 13:36:21.321111 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 383/774] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:21 2022] GET /compute/v2.1/servers/dd9a885e-0fb3-411a-b816-eafc93e1c5cb => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:36:21.332140 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-72f85024-5155-4d73-a2b8-46e2a131cca4 req-d9012f60-3c90-4071-b762-20ac55409f15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a54adf11-ee58-4f13-82c8-9a00a36c536e", "tag": "f261c54a-cf39-4ca3-a4d0-eb2c41dbcbe0"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:21.363800 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-72f85024-5155-4d73-a2b8-46e2a131cca4 req-d9012f60-3c90-4071-b762-20ac55409f15 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:21.364386 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-72f85024-5155-4d73-a2b8-46e2a131cca4 req-d9012f60-3c90-4071-b762-20ac55409f15 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:21.364907 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-72f85024-5155-4d73-a2b8-46e2a131cca4 req-d9012f60-3c90-4071-b762-20ac55409f15 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:21.379545 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8cb552f5-9601-481b-9d0b-cbd179192b3d tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90" status: 200 len: 1931 microversion: 2.75 time: 0.362092 Oct 17 13:36:21.380900 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 392/775] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:36:21 2022] GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90 => generated 1931 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:36:21.387486 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5bfd8e80-7391-488a-842d-d98f5c97c8b5 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:21.388694 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5bfd8e80-7391-488a-842d-d98f5c97c8b5 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 8138c4a6-0fa5-4427-a026-56618461dd14] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:21.393322 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-72f85024-5155-4d73-a2b8-46e2a131cca4 req-d9012f60-3c90-4071-b762-20ac55409f15 service nova] Creating event network-changed:f261c54a-cf39-4ca3-a4d0-eb2c41dbcbe0 for instance a54adf11-ee58-4f13-82c8-9a00a36c536e on n-h1-854247-14 Oct 17 13:36:21.417408 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-72f85024-5155-4d73-a2b8-46e2a131cca4 req-d9012f60-3c90-4071-b762-20ac55409f15 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090664 Oct 17 13:36:21.419677 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 384/776] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:36:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:21.435225 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bd8ae6b3-6ca0-47e9-8a67-60f68804e6f0 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:21.435863 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-bd8ae6b3-6ca0-47e9-8a67-60f68804e6f0 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] [instance: 12e5e9fe-b998-450c-94b0-492a92bb6027] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:21.453278 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bd8ae6b3-6ca0-47e9-8a67-60f68804e6f0 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:21.454370 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bd8ae6b3-6ca0-47e9-8a67-60f68804e6f0 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:21.455120 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bd8ae6b3-6ca0-47e9-8a67-60f68804e6f0 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:21.456630 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bd8ae6b3-6ca0-47e9-8a67-60f68804e6f0 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:21.460143 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bd8ae6b3-6ca0-47e9-8a67-60f68804e6f0 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:21.460784 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bd8ae6b3-6ca0-47e9-8a67-60f68804e6f0 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:21.500351 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-bd8ae6b3-6ca0-47e9-8a67-60f68804e6f0 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] HTTP exception thrown: Instance 12e5e9fe-b998-450c-94b0-492a92bb6027 could not be found. Oct 17 13:36:21.505221 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bd8ae6b3-6ca0-47e9-8a67-60f68804e6f0 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Request method failure captured: Oct 17 13:36:21.505221 n-d-854247-14 devstack@n-api.service[127017]: request: DELETE /compute/v2.1/servers/12e5e9fe-b998-450c-94b0-492a92bb6027 HTTP/1.1 Oct 17 13:36:21.505221 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:36:21.505221 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:36:21.505221 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:36:21.505221 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:36:21.505221 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:36:21.505221 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:36:21.505221 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:36:21.505221 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:36:21.505221 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVm6bieuXIIYLvy0oOrXYn9AjBqz94a9CoehJppiqdZVer6fdf9NdlscbsLsoPT0irpyAYUhG8q8kx4oKEoVEnbwHr1rQpChIXaDXuoebwimC-XXq28fsEwRS9cZ23IJkd0wdxZLsqlKIxcNZ-MI0ZYUHOOzQxd5B01etTyK_ahJYiU Oct 17 13:36:21.505221 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:36:21.505221 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:36:21.505221 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:36:21.505221 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:36:21.505221 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:36:21.505221 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:36:21.505221 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 550b2bda88024756abc4134365842d17 Oct 17 13:36:21.505221 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-811640730 Oct 17 13:36:21.505221 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:36:21.505221 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:36:21.506736 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/550b2bda88024756abc4134365842d17"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/550b2bda88024756abc4134365842d17"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/550b2bda88024756abc4134365842d17"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_550b2bda88024756abc4134365842d17", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:36:21.506736 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-811640730 Oct 17 13:36:21.506736 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 550b2bda88024756abc4134365842d17 Oct 17 13:36:21.506736 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-811640730 Oct 17 13:36:21.506736 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServersWithSpecificFlavorTestJSON-811640730-project Oct 17 13:36:21.506736 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:36:21.506736 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:36:21.506736 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 8e836340278b49f593350249132b9cfc Oct 17 13:36:21.506736 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-811640730-project Oct 17 13:36:21.506736 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:36:21.506736 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 12e5e9fe-b998-450c-94b0-492a92bb6027 could not be found. Oct 17 13:36:21.506736 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '12e5e9fe-b998-450c-94b0-492a92bb6027'} Oct 17 13:36:21.507564 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:36:21.507564 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:21.507564 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:36:21.507564 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:36:21.507564 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:36:21.507564 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:36:21.507564 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:36:21.507564 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:36:21.507564 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:36:21.507564 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:36:21.507564 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12e5e9fe-b998-450c-94b0-492a92bb6027 could not be found. Oct 17 13:36:21.507564 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:21.507564 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:21.507564 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:21.507564 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:21.507564 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:21.507564 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:21.507564 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:36:21.507564 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:36:21.507564 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:36:21.508873 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:36:21.508873 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:36:21.508873 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:36:21.508873 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:36:21.508873 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:36:21.508873 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:36:21.508873 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:36:21.508873 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:36:21.508873 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:36:21.508873 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12e5e9fe-b998-450c-94b0-492a92bb6027 could not be found. Oct 17 13:36:21.508873 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:21.508873 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:21.508873 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:21.508873 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:21.508873 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:21.508873 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:21.508873 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:36:21.508873 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:36:21.508873 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12e5e9fe-b998-450c-94b0-492a92bb6027 could not be found. Oct 17 13:36:21.508873 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:21.511694 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bd8ae6b3-6ca0-47e9-8a67-60f68804e6f0 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Returning 404 to user: Instance 12e5e9fe-b998-450c-94b0-492a92bb6027 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:36:21.513821 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-bd8ae6b3-6ca0-47e9-8a67-60f68804e6f0 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] 10.222.0.79 "DELETE /compute/v2.1/servers/12e5e9fe-b998-450c-94b0-492a92bb6027" status: 404 len: 111 microversion: 2.1 time: 0.093007 Oct 17 13:36:21.517780 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 385/777] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:36:21 2022] DELETE /compute/v2.1/servers/12e5e9fe-b998-450c-94b0-492a92bb6027 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:36:21.528717 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7652d84a-907b-4105-abc8-348161c10aa5 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:21.529759 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7652d84a-907b-4105-abc8-348161c10aa5 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] [instance: 12e5e9fe-b998-450c-94b0-492a92bb6027] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:21.538004 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7652d84a-907b-4105-abc8-348161c10aa5 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:21.538767 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7652d84a-907b-4105-abc8-348161c10aa5 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:21.539496 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7652d84a-907b-4105-abc8-348161c10aa5 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:21.540644 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7652d84a-907b-4105-abc8-348161c10aa5 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:21.541606 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7652d84a-907b-4105-abc8-348161c10aa5 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:21.542221 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7652d84a-907b-4105-abc8-348161c10aa5 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:21.560539 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-7652d84a-907b-4105-abc8-348161c10aa5 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] HTTP exception thrown: Instance 12e5e9fe-b998-450c-94b0-492a92bb6027 could not be found. Oct 17 13:36:21.563018 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7652d84a-907b-4105-abc8-348161c10aa5 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Request method failure captured: Oct 17 13:36:21.563018 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/12e5e9fe-b998-450c-94b0-492a92bb6027 HTTP/1.1 Oct 17 13:36:21.563018 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:36:21.563018 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:36:21.563018 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:36:21.563018 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:36:21.563018 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:36:21.563018 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:36:21.563018 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:36:21.563018 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:36:21.563018 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVm6bieuXIIYLvy0oOrXYn9AjBqz94a9CoehJppiqdZVer6fdf9NdlscbsLsoPT0irpyAYUhG8q8kx4oKEoVEnbwHr1rQpChIXaDXuoebwimC-XXq28fsEwRS9cZ23IJkd0wdxZLsqlKIxcNZ-MI0ZYUHOOzQxd5B01etTyK_ahJYiU Oct 17 13:36:21.563018 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:36:21.563018 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:36:21.563018 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:36:21.563018 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:36:21.563018 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:36:21.563018 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:36:21.563018 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 550b2bda88024756abc4134365842d17 Oct 17 13:36:21.563018 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-811640730 Oct 17 13:36:21.563018 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:36:21.563018 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:36:21.564299 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/550b2bda88024756abc4134365842d17"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/550b2bda88024756abc4134365842d17"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/550b2bda88024756abc4134365842d17"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_550b2bda88024756abc4134365842d17", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:36:21.564299 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-811640730 Oct 17 13:36:21.564299 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 550b2bda88024756abc4134365842d17 Oct 17 13:36:21.564299 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-811640730 Oct 17 13:36:21.564299 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServersWithSpecificFlavorTestJSON-811640730-project Oct 17 13:36:21.564299 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:36:21.564299 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:36:21.564299 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 8e836340278b49f593350249132b9cfc Oct 17 13:36:21.564299 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-811640730-project Oct 17 13:36:21.564299 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:36:21.564299 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 12e5e9fe-b998-450c-94b0-492a92bb6027 could not be found. Oct 17 13:36:21.564299 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '12e5e9fe-b998-450c-94b0-492a92bb6027'} Oct 17 13:36:21.565013 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:36:21.565013 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:21.565013 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:36:21.565013 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:36:21.565013 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:36:21.565013 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:36:21.565013 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:36:21.565013 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:36:21.565013 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:36:21.565013 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:36:21.565013 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12e5e9fe-b998-450c-94b0-492a92bb6027 could not be found. Oct 17 13:36:21.565013 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:21.565013 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:21.565013 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:21.565013 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:21.565013 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:21.565013 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:21.565013 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:36:21.565013 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:36:21.565013 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:36:21.566230 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:36:21.566230 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:36:21.566230 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:36:21.566230 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:36:21.566230 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:36:21.566230 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:36:21.566230 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:36:21.566230 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12e5e9fe-b998-450c-94b0-492a92bb6027 could not be found. Oct 17 13:36:21.566230 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:21.566230 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:21.566230 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:21.566230 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:21.566230 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:21.566230 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:21.566230 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:36:21.566230 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:36:21.566230 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12e5e9fe-b998-450c-94b0-492a92bb6027 could not be found. Oct 17 13:36:21.566230 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:21.569947 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7652d84a-907b-4105-abc8-348161c10aa5 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Returning 404 to user: Instance 12e5e9fe-b998-450c-94b0-492a92bb6027 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:36:21.570945 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7652d84a-907b-4105-abc8-348161c10aa5 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] 10.222.0.79 "GET /compute/v2.1/servers/12e5e9fe-b998-450c-94b0-492a92bb6027" status: 404 len: 111 microversion: 2.1 time: 0.046793 Oct 17 13:36:21.572323 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 386/778] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:21 2022] GET /compute/v2.1/servers/12e5e9fe-b998-450c-94b0-492a92bb6027 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:36:21.588518 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7ba84091-3b8a-472b-b75b-13a5510ae502 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Calling method '.version_select at 0x7f7cd59e3040>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:21.626588 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7ba84091-3b8a-472b-b75b-13a5510ae502 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-467217040" status: 202 len: 0 microversion: 2.1 time: 0.048133 Oct 17 13:36:21.629120 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 387/779] 10.222.0.79 () {58 vars in 1218 bytes} [Mon Oct 17 13:36:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-467217040 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:36:21.852254 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5bfd8e80-7391-488a-842d-d98f5c97c8b5 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:21.910649 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5bfd8e80-7391-488a-842d-d98f5c97c8b5 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/8138c4a6-0fa5-4427-a026-56618461dd14" status: 200 len: 1217 microversion: 2.1 time: 0.523997 Oct 17 13:36:21.914847 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 393/780] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:21 2022] GET /compute/v2.1/servers/8138c4a6-0fa5-4427-a026-56618461dd14 => generated 1217 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:22.249867 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ac446472-2738-4ab9-a80d-de3bc432932a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:22.252132 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ac446472-2738-4ab9-a80d-de3bc432932a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: a54adf11-ee58-4f13-82c8-9a00a36c536e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:22.266777 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac446472-2738-4ab9-a80d-de3bc432932a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:22.267983 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac446472-2738-4ab9-a80d-de3bc432932a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:22.270238 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac446472-2738-4ab9-a80d-de3bc432932a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:22.271160 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac446472-2738-4ab9-a80d-de3bc432932a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:22.272808 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac446472-2738-4ab9-a80d-de3bc432932a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:22.275453 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac446472-2738-4ab9-a80d-de3bc432932a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:22.309548 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=100 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:36:22.423639 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-afb31797-11cf-4f9f-af5e-f6ddfe27b31a tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:22.424661 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-afb31797-11cf-4f9f-af5e-f6ddfe27b31a tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] [instance: 51be2144-e969-4e1b-b5da-c43b9a7b7c90] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:22.444413 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-afb31797-11cf-4f9f-af5e-f6ddfe27b31a tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:22.444922 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-afb31797-11cf-4f9f-af5e-f6ddfe27b31a tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:22.445356 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-afb31797-11cf-4f9f-af5e-f6ddfe27b31a tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:22.446876 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-afb31797-11cf-4f9f-af5e-f6ddfe27b31a tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:22.451605 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-afb31797-11cf-4f9f-af5e-f6ddfe27b31a tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:22.453300 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-afb31797-11cf-4f9f-af5e-f6ddfe27b31a tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:22.925900 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-afb31797-11cf-4f9f-af5e-f6ddfe27b31a tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lazy-loading 'services' on Instance uuid 51be2144-e969-4e1b-b5da-c43b9a7b7c90 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:36:22.952506 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-afb31797-11cf-4f9f-af5e-f6ddfe27b31a tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90" status: 200 len: 1931 microversion: 2.75 time: 0.534889 Oct 17 13:36:22.953410 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 394/781] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:36:22 2022] GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90 => generated 1931 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:36:22.968341 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6bb787e9-680b-48f4-a5ac-19db08146c26 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:22.970667 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6bb787e9-680b-48f4-a5ac-19db08146c26 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 8138c4a6-0fa5-4427-a026-56618461dd14] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:22.984584 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6bb787e9-680b-48f4-a5ac-19db08146c26 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:22.985380 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6bb787e9-680b-48f4-a5ac-19db08146c26 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:22.986392 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6bb787e9-680b-48f4-a5ac-19db08146c26 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:22.987886 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6bb787e9-680b-48f4-a5ac-19db08146c26 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:22.988553 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6bb787e9-680b-48f4-a5ac-19db08146c26 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:22.989169 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6bb787e9-680b-48f4-a5ac-19db08146c26 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:23.292863 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6bb787e9-680b-48f4-a5ac-19db08146c26 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:23.325783 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6bb787e9-680b-48f4-a5ac-19db08146c26 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/8138c4a6-0fa5-4427-a026-56618461dd14" status: 200 len: 1213 microversion: 2.1 time: 0.358161 Oct 17 13:36:23.325783 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 395/782] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:22 2022] GET /compute/v2.1/servers/8138c4a6-0fa5-4427-a026-56618461dd14 => generated 1213 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:23.698854 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ac446472-2738-4ab9-a80d-de3bc432932a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:23.713151 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ac446472-2738-4ab9-a80d-de3bc432932a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e" status: 200 len: 1358 microversion: 2.1 time: 1.467570 Oct 17 13:36:23.716618 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 388/783] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:22 2022] GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e => generated 1358 bytes in 1472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:36:23.990480 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e3da7d5c-7b10-4941-99f3-e39ae9b319ee tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:23.991110 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e3da7d5c-7b10-4941-99f3-e39ae9b319ee tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] [instance: 51be2144-e969-4e1b-b5da-c43b9a7b7c90] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:24.004444 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e3da7d5c-7b10-4941-99f3-e39ae9b319ee tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:24.004937 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e3da7d5c-7b10-4941-99f3-e39ae9b319ee tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:24.005365 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e3da7d5c-7b10-4941-99f3-e39ae9b319ee tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:24.006069 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e3da7d5c-7b10-4941-99f3-e39ae9b319ee tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:24.006508 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e3da7d5c-7b10-4941-99f3-e39ae9b319ee tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:24.008834 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e3da7d5c-7b10-4941-99f3-e39ae9b319ee tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:24.346500 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e28adfff-ce09-48ac-9d70-ced51d100c3d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:24.347112 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e28adfff-ce09-48ac-9d70-ced51d100c3d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 8138c4a6-0fa5-4427-a026-56618461dd14] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:24.356102 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-e3da7d5c-7b10-4941-99f3-e39ae9b319ee tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lazy-loading 'services' on Instance uuid 51be2144-e969-4e1b-b5da-c43b9a7b7c90 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:36:24.357909 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:36:24.372611 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e28adfff-ce09-48ac-9d70-ced51d100c3d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:24.374912 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e28adfff-ce09-48ac-9d70-ced51d100c3d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:24.375655 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e28adfff-ce09-48ac-9d70-ced51d100c3d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:24.377574 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e28adfff-ce09-48ac-9d70-ced51d100c3d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:24.386833 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e28adfff-ce09-48ac-9d70-ced51d100c3d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:24.389549 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e28adfff-ce09-48ac-9d70-ced51d100c3d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:24.422598 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e3da7d5c-7b10-4941-99f3-e39ae9b319ee tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90" status: 200 len: 1931 microversion: 2.75 time: 0.435970 Oct 17 13:36:24.433412 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 396/784] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:36:23 2022] GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90 => generated 1931 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:36:24.524997 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=8 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:36:24.699277 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e28adfff-ce09-48ac-9d70-ced51d100c3d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:24.715922 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e28adfff-ce09-48ac-9d70-ced51d100c3d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/8138c4a6-0fa5-4427-a026-56618461dd14" status: 200 len: 1269 microversion: 2.1 time: 0.373249 Oct 17 13:36:24.721242 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 389/785] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:24 2022] GET /compute/v2.1/servers/8138c4a6-0fa5-4427-a026-56618461dd14 => generated 1269 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:24.741858 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b43650c9-9fa0-4852-a6f0-30b71f58193b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:24.743080 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b43650c9-9fa0-4852-a6f0-30b71f58193b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: a54adf11-ee58-4f13-82c8-9a00a36c536e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:24.754352 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b43650c9-9fa0-4852-a6f0-30b71f58193b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:24.757291 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b43650c9-9fa0-4852-a6f0-30b71f58193b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:24.759403 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b43650c9-9fa0-4852-a6f0-30b71f58193b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:24.760344 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b43650c9-9fa0-4852-a6f0-30b71f58193b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:24.762612 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b43650c9-9fa0-4852-a6f0-30b71f58193b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:24.767879 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b43650c9-9fa0-4852-a6f0-30b71f58193b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:25.469074 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3f3b37f6-3395-4549-9bdc-3a84d8a25fb3 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:25.470049 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3f3b37f6-3395-4549-9bdc-3a84d8a25fb3 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] [instance: 51be2144-e969-4e1b-b5da-c43b9a7b7c90] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:25.480300 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f3b37f6-3395-4549-9bdc-3a84d8a25fb3 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:25.482161 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f3b37f6-3395-4549-9bdc-3a84d8a25fb3 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:25.486604 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f3b37f6-3395-4549-9bdc-3a84d8a25fb3 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:25.487837 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f3b37f6-3395-4549-9bdc-3a84d8a25fb3 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:25.488476 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f3b37f6-3395-4549-9bdc-3a84d8a25fb3 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:25.489440 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f3b37f6-3395-4549-9bdc-3a84d8a25fb3 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:25.869536 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-3f3b37f6-3395-4549-9bdc-3a84d8a25fb3 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lazy-loading 'services' on Instance uuid 51be2144-e969-4e1b-b5da-c43b9a7b7c90 {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:36:25.925734 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3f3b37f6-3395-4549-9bdc-3a84d8a25fb3 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90" status: 200 len: 1931 microversion: 2.75 time: 0.463891 Oct 17 13:36:25.929241 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 390/786] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:36:25 2022] GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90 => generated 1931 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:36:25.940144 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9d9941ea-c20f-45fa-a321-5f76a6e94bae tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:25.940766 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9d9941ea-c20f-45fa-a321-5f76a6e94bae tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 8138c4a6-0fa5-4427-a026-56618461dd14] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:25.954893 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9d9941ea-c20f-45fa-a321-5f76a6e94bae tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:25.959876 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9d9941ea-c20f-45fa-a321-5f76a6e94bae tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:25.960461 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9d9941ea-c20f-45fa-a321-5f76a6e94bae tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:25.961314 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9d9941ea-c20f-45fa-a321-5f76a6e94bae tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:25.961785 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9d9941ea-c20f-45fa-a321-5f76a6e94bae tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:25.962202 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9d9941ea-c20f-45fa-a321-5f76a6e94bae tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:26.185869 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9d9941ea-c20f-45fa-a321-5f76a6e94bae tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:26.215953 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9d9941ea-c20f-45fa-a321-5f76a6e94bae tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/8138c4a6-0fa5-4427-a026-56618461dd14" status: 200 len: 1275 microversion: 2.1 time: 0.276372 Oct 17 13:36:26.217421 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 391/787] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:25 2022] GET /compute/v2.1/servers/8138c4a6-0fa5-4427-a026-56618461dd14 => generated 1275 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:26.223698 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-deacb0a5-a03f-43eb-8cc5-d564e7b1c0af tempest-ServersWithSpecificFlavorTestJSON-438742261 tempest-ServersWithSpecificFlavorTestJSON-438742261-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:26.275649 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-deacb0a5-a03f-43eb-8cc5-d564e7b1c0af tempest-ServersWithSpecificFlavorTestJSON-438742261 tempest-ServersWithSpecificFlavorTestJSON-438742261-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/1121781423" status: 202 len: 0 microversion: 2.1 time: 0.056617 Oct 17 13:36:26.281189 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 392/788] 10.222.0.79 () {58 vars in 1161 bytes} [Mon Oct 17 13:36:26 2022] DELETE /compute/v2.1/flavors/1121781423 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:36:26.302788 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-50a5fada-f1d4-4088-b104-cefe2fe6e38c tempest-ServersWithSpecificFlavorTestJSON-438742261 tempest-ServersWithSpecificFlavorTestJSON-438742261-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:26.332388 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b43650c9-9fa0-4852-a6f0-30b71f58193b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:26.348400 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b43650c9-9fa0-4852-a6f0-30b71f58193b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e" status: 200 len: 1358 microversion: 2.1 time: 1.611365 Oct 17 13:36:26.363111 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 397/789] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:24 2022] GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e => generated 1358 bytes in 1627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:26.387385 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-50a5fada-f1d4-4088-b104-cefe2fe6e38c tempest-ServersWithSpecificFlavorTestJSON-438742261 tempest-ServersWithSpecificFlavorTestJSON-438742261-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.102969 Oct 17 13:36:26.388696 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 393/790] 10.222.0.79 () {58 vars in 1146 bytes} [Mon Oct 17 13:36:26 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:36:26.407682 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5761afe0-40c9-49a8-bdaa-4a1f73f561f9 tempest-ServersWithSpecificFlavorTestJSON-438742261 tempest-ServersWithSpecificFlavorTestJSON-438742261-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:26.429877 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5761afe0-40c9-49a8-bdaa-4a1f73f561f9 tempest-ServersWithSpecificFlavorTestJSON-438742261 tempest-ServersWithSpecificFlavorTestJSON-438742261-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/2093214170" status: 202 len: 0 microversion: 2.1 time: 0.026039 Oct 17 13:36:26.440753 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-94ca9f12-ab28-4eaf-af61-e01f6a4f9cb4 tempest-ServersWithSpecificFlavorTestJSON-438742261 tempest-ServersWithSpecificFlavorTestJSON-438742261-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:26.445160 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 398/791] 10.222.0.79 () {58 vars in 1161 bytes} [Mon Oct 17 13:36:26 2022] DELETE /compute/v2.1/flavors/2093214170 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:36:26.468554 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-94ca9f12-ab28-4eaf-af61-e01f6a4f9cb4 tempest-ServersWithSpecificFlavorTestJSON-438742261 tempest-ServersWithSpecificFlavorTestJSON-438742261-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032065 Oct 17 13:36:26.485504 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 394/792] 10.222.0.79 () {58 vars in 1146 bytes} [Mon Oct 17 13:36:26 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:26.495811 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-51e6f704-4709-4be5-8f98-a1fa7cdbd20b tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:26.496698 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-51e6f704-4709-4be5-8f98-a1fa7cdbd20b tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] [instance: dd9a885e-0fb3-411a-b816-eafc93e1c5cb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:26.504555 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-51e6f704-4709-4be5-8f98-a1fa7cdbd20b tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:26.505515 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-51e6f704-4709-4be5-8f98-a1fa7cdbd20b tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:26.506118 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-51e6f704-4709-4be5-8f98-a1fa7cdbd20b tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:26.507089 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-51e6f704-4709-4be5-8f98-a1fa7cdbd20b tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:26.507814 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-51e6f704-4709-4be5-8f98-a1fa7cdbd20b tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:26.508563 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-51e6f704-4709-4be5-8f98-a1fa7cdbd20b tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:26.528593 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-51e6f704-4709-4be5-8f98-a1fa7cdbd20b tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] HTTP exception thrown: Instance dd9a885e-0fb3-411a-b816-eafc93e1c5cb could not be found. Oct 17 13:36:26.532084 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-51e6f704-4709-4be5-8f98-a1fa7cdbd20b tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Request method failure captured: Oct 17 13:36:26.532084 n-d-854247-14 devstack@n-api.service[127016]: request: DELETE /compute/v2.1/servers/dd9a885e-0fb3-411a-b816-eafc93e1c5cb HTTP/1.1 Oct 17 13:36:26.532084 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:36:26.532084 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:36:26.532084 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:36:26.532084 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:36:26.532084 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:36:26.532084 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:36:26.532084 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:36:26.532084 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:36:26.532084 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVm6bieuXIIYLvy0oOrXYn9AjBqz94a9CoehJppiqdZVer6fdf9NdlscbsLsoPT0irpyAYUhG8q8kx4oKEoVEnbwHr1rQpChIXaDXuoebwimC-XXq28fsEwRS9cZ23IJkd0wdxZLsqlKIxcNZ-MI0ZYUHOOzQxd5B01etTyK_ahJYiU Oct 17 13:36:26.532084 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:36:26.532084 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:36:26.532084 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:36:26.532084 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:36:26.532084 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:36:26.532084 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:36:26.532084 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 550b2bda88024756abc4134365842d17 Oct 17 13:36:26.532084 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-811640730 Oct 17 13:36:26.532084 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:36:26.532084 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:36:26.533766 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/550b2bda88024756abc4134365842d17"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/550b2bda88024756abc4134365842d17"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/550b2bda88024756abc4134365842d17"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_550b2bda88024756abc4134365842d17", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:36:26.533766 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-811640730 Oct 17 13:36:26.533766 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 550b2bda88024756abc4134365842d17 Oct 17 13:36:26.533766 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-811640730 Oct 17 13:36:26.533766 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServersWithSpecificFlavorTestJSON-811640730-project Oct 17 13:36:26.533766 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:36:26.533766 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:36:26.533766 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 8e836340278b49f593350249132b9cfc Oct 17 13:36:26.533766 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-811640730-project Oct 17 13:36:26.533766 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:36:26.533766 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance dd9a885e-0fb3-411a-b816-eafc93e1c5cb could not be found. Oct 17 13:36:26.533766 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'dd9a885e-0fb3-411a-b816-eafc93e1c5cb'} Oct 17 13:36:26.534687 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:36:26.534687 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:26.534687 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:36:26.534687 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:36:26.534687 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:36:26.534687 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:36:26.534687 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:36:26.534687 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:36:26.534687 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:36:26.534687 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:36:26.534687 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd9a885e-0fb3-411a-b816-eafc93e1c5cb could not be found. Oct 17 13:36:26.534687 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:36:26.534687 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:26.534687 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:36:26.534687 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:26.534687 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:26.534687 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:26.534687 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:36:26.534687 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:36:26.534687 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:36:26.536412 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:36:26.536412 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:36:26.536412 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:36:26.536412 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:36:26.536412 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:36:26.536412 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:36:26.536412 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:36:26.536412 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:36:26.536412 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:36:26.536412 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd9a885e-0fb3-411a-b816-eafc93e1c5cb could not be found. Oct 17 13:36:26.536412 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:36:26.536412 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:26.536412 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:36:26.536412 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:26.536412 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:26.536412 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:26.536412 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:36:26.536412 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:36:26.536412 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd9a885e-0fb3-411a-b816-eafc93e1c5cb could not be found. Oct 17 13:36:26.536412 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:36:26.540349 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-51e6f704-4709-4be5-8f98-a1fa7cdbd20b tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Returning 404 to user: Instance dd9a885e-0fb3-411a-b816-eafc93e1c5cb could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:36:26.541763 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-51e6f704-4709-4be5-8f98-a1fa7cdbd20b tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] 10.222.0.79 "DELETE /compute/v2.1/servers/dd9a885e-0fb3-411a-b816-eafc93e1c5cb" status: 404 len: 111 microversion: 2.1 time: 0.051574 Oct 17 13:36:26.546490 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 399/793] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:36:26 2022] DELETE /compute/v2.1/servers/dd9a885e-0fb3-411a-b816-eafc93e1c5cb => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:36:26.553075 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ac0f5fff-54ff-4428-ae1b-ca3b984cebf8 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:26.554079 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ac0f5fff-54ff-4428-ae1b-ca3b984cebf8 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] [instance: dd9a885e-0fb3-411a-b816-eafc93e1c5cb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:26.563890 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac0f5fff-54ff-4428-ae1b-ca3b984cebf8 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:26.564739 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac0f5fff-54ff-4428-ae1b-ca3b984cebf8 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:26.565410 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac0f5fff-54ff-4428-ae1b-ca3b984cebf8 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:26.566409 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac0f5fff-54ff-4428-ae1b-ca3b984cebf8 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:26.567111 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac0f5fff-54ff-4428-ae1b-ca3b984cebf8 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:26.567778 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac0f5fff-54ff-4428-ae1b-ca3b984cebf8 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:26.585935 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-ac0f5fff-54ff-4428-ae1b-ca3b984cebf8 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] HTTP exception thrown: Instance dd9a885e-0fb3-411a-b816-eafc93e1c5cb could not be found. Oct 17 13:36:26.589570 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ac0f5fff-54ff-4428-ae1b-ca3b984cebf8 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Request method failure captured: Oct 17 13:36:26.589570 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/dd9a885e-0fb3-411a-b816-eafc93e1c5cb HTTP/1.1 Oct 17 13:36:26.589570 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:36:26.589570 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:36:26.589570 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:36:26.589570 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:36:26.589570 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:36:26.589570 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:36:26.589570 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:36:26.589570 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:36:26.589570 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVm6bieuXIIYLvy0oOrXYn9AjBqz94a9CoehJppiqdZVer6fdf9NdlscbsLsoPT0irpyAYUhG8q8kx4oKEoVEnbwHr1rQpChIXaDXuoebwimC-XXq28fsEwRS9cZ23IJkd0wdxZLsqlKIxcNZ-MI0ZYUHOOzQxd5B01etTyK_ahJYiU Oct 17 13:36:26.589570 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:36:26.589570 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:36:26.589570 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:36:26.589570 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:36:26.589570 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:36:26.589570 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:36:26.589570 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 550b2bda88024756abc4134365842d17 Oct 17 13:36:26.589570 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-811640730 Oct 17 13:36:26.589570 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:36:26.589570 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:36:26.591074 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/550b2bda88024756abc4134365842d17"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/550b2bda88024756abc4134365842d17"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/550b2bda88024756abc4134365842d17"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_550b2bda88024756abc4134365842d17", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:36:26.591074 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-811640730 Oct 17 13:36:26.591074 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 550b2bda88024756abc4134365842d17 Oct 17 13:36:26.591074 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-811640730 Oct 17 13:36:26.591074 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServersWithSpecificFlavorTestJSON-811640730-project Oct 17 13:36:26.591074 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:36:26.591074 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:36:26.591074 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 8e836340278b49f593350249132b9cfc Oct 17 13:36:26.591074 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-811640730-project Oct 17 13:36:26.591074 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:36:26.591074 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance dd9a885e-0fb3-411a-b816-eafc93e1c5cb could not be found. Oct 17 13:36:26.591074 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'dd9a885e-0fb3-411a-b816-eafc93e1c5cb'} Oct 17 13:36:26.592231 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:36:26.592231 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:26.592231 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:36:26.592231 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:36:26.592231 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:36:26.592231 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:36:26.592231 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:36:26.592231 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:36:26.592231 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:36:26.592231 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:36:26.592231 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd9a885e-0fb3-411a-b816-eafc93e1c5cb could not be found. Oct 17 13:36:26.592231 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:26.592231 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:26.592231 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:26.592231 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:26.592231 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:26.592231 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:26.592231 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:36:26.592231 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:36:26.592231 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:36:26.593484 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:36:26.593484 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:36:26.593484 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:36:26.593484 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:36:26.593484 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:36:26.593484 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:36:26.593484 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:36:26.593484 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd9a885e-0fb3-411a-b816-eafc93e1c5cb could not be found. Oct 17 13:36:26.593484 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:26.593484 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:26.593484 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:26.593484 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:26.593484 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:26.593484 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:26.593484 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:36:26.593484 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:36:26.593484 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd9a885e-0fb3-411a-b816-eafc93e1c5cb could not be found. Oct 17 13:36:26.593484 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:26.594654 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ac0f5fff-54ff-4428-ae1b-ca3b984cebf8 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Returning 404 to user: Instance dd9a885e-0fb3-411a-b816-eafc93e1c5cb could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:36:26.596178 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ac0f5fff-54ff-4428-ae1b-ca3b984cebf8 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] 10.222.0.79 "GET /compute/v2.1/servers/dd9a885e-0fb3-411a-b816-eafc93e1c5cb" status: 404 len: 111 microversion: 2.1 time: 0.047320 Oct 17 13:36:26.600401 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 395/794] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:26 2022] GET /compute/v2.1/servers/dd9a885e-0fb3-411a-b816-eafc93e1c5cb => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:36:26.607106 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a52c5156-d822-4532-b1a2-a5726cf686da tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:26.607732 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a52c5156-d822-4532-b1a2-a5726cf686da tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] [instance: 12e5e9fe-b998-450c-94b0-492a92bb6027] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:26.619206 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a52c5156-d822-4532-b1a2-a5726cf686da tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:26.623881 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a52c5156-d822-4532-b1a2-a5726cf686da tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:26.624330 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a52c5156-d822-4532-b1a2-a5726cf686da tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:26.625073 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a52c5156-d822-4532-b1a2-a5726cf686da tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:26.625520 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a52c5156-d822-4532-b1a2-a5726cf686da tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:26.627358 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a52c5156-d822-4532-b1a2-a5726cf686da tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:26.665545 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-a52c5156-d822-4532-b1a2-a5726cf686da tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] HTTP exception thrown: Instance 12e5e9fe-b998-450c-94b0-492a92bb6027 could not be found. Oct 17 13:36:26.669198 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a52c5156-d822-4532-b1a2-a5726cf686da tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Request method failure captured: Oct 17 13:36:26.669198 n-d-854247-14 devstack@n-api.service[127016]: request: DELETE /compute/v2.1/servers/12e5e9fe-b998-450c-94b0-492a92bb6027 HTTP/1.1 Oct 17 13:36:26.669198 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:36:26.669198 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:36:26.669198 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:36:26.669198 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:36:26.669198 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:36:26.669198 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:36:26.669198 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:36:26.669198 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:36:26.669198 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVm6bieuXIIYLvy0oOrXYn9AjBqz94a9CoehJppiqdZVer6fdf9NdlscbsLsoPT0irpyAYUhG8q8kx4oKEoVEnbwHr1rQpChIXaDXuoebwimC-XXq28fsEwRS9cZ23IJkd0wdxZLsqlKIxcNZ-MI0ZYUHOOzQxd5B01etTyK_ahJYiU Oct 17 13:36:26.669198 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:36:26.669198 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:36:26.669198 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:36:26.669198 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:36:26.669198 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:36:26.669198 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:36:26.669198 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 550b2bda88024756abc4134365842d17 Oct 17 13:36:26.669198 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-811640730 Oct 17 13:36:26.669198 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:36:26.669198 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:36:26.670514 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/550b2bda88024756abc4134365842d17"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/550b2bda88024756abc4134365842d17"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/550b2bda88024756abc4134365842d17"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_550b2bda88024756abc4134365842d17", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:36:26.670514 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-811640730 Oct 17 13:36:26.670514 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 550b2bda88024756abc4134365842d17 Oct 17 13:36:26.670514 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-811640730 Oct 17 13:36:26.670514 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServersWithSpecificFlavorTestJSON-811640730-project Oct 17 13:36:26.670514 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:36:26.670514 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:36:26.670514 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 8e836340278b49f593350249132b9cfc Oct 17 13:36:26.670514 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-811640730-project Oct 17 13:36:26.670514 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:36:26.670514 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 12e5e9fe-b998-450c-94b0-492a92bb6027 could not be found. Oct 17 13:36:26.670514 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '12e5e9fe-b998-450c-94b0-492a92bb6027'} Oct 17 13:36:26.671798 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:36:26.671798 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:26.671798 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:36:26.671798 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:36:26.671798 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:36:26.671798 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:36:26.671798 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:36:26.671798 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:36:26.671798 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:36:26.671798 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:36:26.671798 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12e5e9fe-b998-450c-94b0-492a92bb6027 could not be found. Oct 17 13:36:26.671798 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:36:26.671798 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:26.671798 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:36:26.671798 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:26.671798 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:26.671798 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:26.671798 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:36:26.671798 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:36:26.671798 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:36:26.672974 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:36:26.672974 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:36:26.672974 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:36:26.672974 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:36:26.672974 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:36:26.672974 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:36:26.672974 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:36:26.672974 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:36:26.672974 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:36:26.672974 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12e5e9fe-b998-450c-94b0-492a92bb6027 could not be found. Oct 17 13:36:26.672974 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:36:26.672974 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:26.672974 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:36:26.672974 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:26.672974 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:26.672974 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:26.672974 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:36:26.672974 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:36:26.672974 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12e5e9fe-b998-450c-94b0-492a92bb6027 could not be found. Oct 17 13:36:26.672974 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:36:26.675933 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a52c5156-d822-4532-b1a2-a5726cf686da tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Returning 404 to user: Instance 12e5e9fe-b998-450c-94b0-492a92bb6027 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:36:26.678636 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a52c5156-d822-4532-b1a2-a5726cf686da tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] 10.222.0.79 "DELETE /compute/v2.1/servers/12e5e9fe-b998-450c-94b0-492a92bb6027" status: 404 len: 111 microversion: 2.1 time: 0.076806 Oct 17 13:36:26.686740 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 400/795] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:36:26 2022] DELETE /compute/v2.1/servers/12e5e9fe-b998-450c-94b0-492a92bb6027 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:36:26.695897 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3a9fc1b0-8997-4983-8026-b5f8a8f3a9b4 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:26.697520 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3a9fc1b0-8997-4983-8026-b5f8a8f3a9b4 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] [instance: 12e5e9fe-b998-450c-94b0-492a92bb6027] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:26.704780 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3a9fc1b0-8997-4983-8026-b5f8a8f3a9b4 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:26.706480 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3a9fc1b0-8997-4983-8026-b5f8a8f3a9b4 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:26.707150 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3a9fc1b0-8997-4983-8026-b5f8a8f3a9b4 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:26.709042 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3a9fc1b0-8997-4983-8026-b5f8a8f3a9b4 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:26.710288 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3a9fc1b0-8997-4983-8026-b5f8a8f3a9b4 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:26.710930 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3a9fc1b0-8997-4983-8026-b5f8a8f3a9b4 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:26.729297 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-3a9fc1b0-8997-4983-8026-b5f8a8f3a9b4 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] HTTP exception thrown: Instance 12e5e9fe-b998-450c-94b0-492a92bb6027 could not be found. Oct 17 13:36:26.731205 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3a9fc1b0-8997-4983-8026-b5f8a8f3a9b4 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Request method failure captured: Oct 17 13:36:26.731205 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/12e5e9fe-b998-450c-94b0-492a92bb6027 HTTP/1.1 Oct 17 13:36:26.731205 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:36:26.731205 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:36:26.731205 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:36:26.731205 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:36:26.731205 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:36:26.731205 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:36:26.731205 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:36:26.731205 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:36:26.731205 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVm6bieuXIIYLvy0oOrXYn9AjBqz94a9CoehJppiqdZVer6fdf9NdlscbsLsoPT0irpyAYUhG8q8kx4oKEoVEnbwHr1rQpChIXaDXuoebwimC-XXq28fsEwRS9cZ23IJkd0wdxZLsqlKIxcNZ-MI0ZYUHOOzQxd5B01etTyK_ahJYiU Oct 17 13:36:26.731205 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:36:26.731205 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:36:26.731205 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:36:26.731205 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:36:26.731205 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:36:26.731205 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:36:26.731205 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 550b2bda88024756abc4134365842d17 Oct 17 13:36:26.731205 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-811640730 Oct 17 13:36:26.731205 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:36:26.731205 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:36:26.732583 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/550b2bda88024756abc4134365842d17"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/550b2bda88024756abc4134365842d17"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/550b2bda88024756abc4134365842d17"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_550b2bda88024756abc4134365842d17", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:36:26.732583 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-811640730 Oct 17 13:36:26.732583 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 550b2bda88024756abc4134365842d17 Oct 17 13:36:26.732583 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-811640730 Oct 17 13:36:26.732583 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServersWithSpecificFlavorTestJSON-811640730-project Oct 17 13:36:26.732583 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:36:26.732583 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:36:26.732583 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 8e836340278b49f593350249132b9cfc Oct 17 13:36:26.732583 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-811640730-project Oct 17 13:36:26.732583 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:36:26.732583 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 12e5e9fe-b998-450c-94b0-492a92bb6027 could not be found. Oct 17 13:36:26.732583 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '12e5e9fe-b998-450c-94b0-492a92bb6027'} Oct 17 13:36:26.733335 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:36:26.733335 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:26.733335 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:36:26.733335 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:36:26.733335 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:36:26.733335 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:36:26.733335 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:36:26.733335 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:36:26.733335 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:36:26.733335 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:36:26.733335 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12e5e9fe-b998-450c-94b0-492a92bb6027 could not be found. Oct 17 13:36:26.733335 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:26.733335 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:26.733335 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:26.733335 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:26.733335 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:26.733335 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:26.733335 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:36:26.733335 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:36:26.733335 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:36:26.734504 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:36:26.734504 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:36:26.734504 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:36:26.734504 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:36:26.734504 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:36:26.734504 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:36:26.734504 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:36:26.734504 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12e5e9fe-b998-450c-94b0-492a92bb6027 could not be found. Oct 17 13:36:26.734504 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:26.734504 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:26.734504 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:26.734504 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:26.734504 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:26.734504 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:26.734504 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:36:26.734504 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:36:26.734504 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12e5e9fe-b998-450c-94b0-492a92bb6027 could not be found. Oct 17 13:36:26.734504 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:26.735586 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3a9fc1b0-8997-4983-8026-b5f8a8f3a9b4 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] Returning 404 to user: Instance 12e5e9fe-b998-450c-94b0-492a92bb6027 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:36:26.735671 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3a9fc1b0-8997-4983-8026-b5f8a8f3a9b4 tempest-ServersWithSpecificFlavorTestJSON-811640730 tempest-ServersWithSpecificFlavorTestJSON-811640730-project] 10.222.0.79 "GET /compute/v2.1/servers/12e5e9fe-b998-450c-94b0-492a92bb6027" status: 404 len: 111 microversion: 2.1 time: 0.044818 Oct 17 13:36:26.736250 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 396/796] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:26 2022] GET /compute/v2.1/servers/12e5e9fe-b998-450c-94b0-492a92bb6027 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:36:26.963854 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a7eb8e85-749e-4573-b933-53e2af7853c9 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:26.965056 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a7eb8e85-749e-4573-b933-53e2af7853c9 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] [instance: 51be2144-e969-4e1b-b5da-c43b9a7b7c90] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:26.977574 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a7eb8e85-749e-4573-b933-53e2af7853c9 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:26.978370 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a7eb8e85-749e-4573-b933-53e2af7853c9 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:26.979693 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a7eb8e85-749e-4573-b933-53e2af7853c9 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:26.981620 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a7eb8e85-749e-4573-b933-53e2af7853c9 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:26.983097 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a7eb8e85-749e-4573-b933-53e2af7853c9 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:26.984323 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a7eb8e85-749e-4573-b933-53e2af7853c9 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:27.244382 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1eee1c15-4197-4a5c-8312-ded5e6f66243 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:27.245002 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1eee1c15-4197-4a5c-8312-ded5e6f66243 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 8138c4a6-0fa5-4427-a026-56618461dd14] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:27.259485 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1eee1c15-4197-4a5c-8312-ded5e6f66243 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:27.260774 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1eee1c15-4197-4a5c-8312-ded5e6f66243 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:27.261757 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1eee1c15-4197-4a5c-8312-ded5e6f66243 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:27.269002 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1eee1c15-4197-4a5c-8312-ded5e6f66243 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:27.269737 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1eee1c15-4197-4a5c-8312-ded5e6f66243 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:27.270339 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1eee1c15-4197-4a5c-8312-ded5e6f66243 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:27.343721 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-a7eb8e85-749e-4573-b933-53e2af7853c9 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lazy-loading 'services' on Instance uuid 51be2144-e969-4e1b-b5da-c43b9a7b7c90 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:36:27.369629 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a7eb8e85-749e-4573-b933-53e2af7853c9 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90" status: 200 len: 1931 microversion: 2.75 time: 0.411689 Oct 17 13:36:27.378954 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 401/797] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:36:26 2022] GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90 => generated 1931 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:36:27.392795 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9989913a-52dd-4f0b-9d11-30e6c486605c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:27.393403 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9989913a-52dd-4f0b-9d11-30e6c486605c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: a54adf11-ee58-4f13-82c8-9a00a36c536e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:27.401272 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9989913a-52dd-4f0b-9d11-30e6c486605c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:27.402371 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9989913a-52dd-4f0b-9d11-30e6c486605c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:27.403895 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9989913a-52dd-4f0b-9d11-30e6c486605c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:27.406957 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9989913a-52dd-4f0b-9d11-30e6c486605c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:27.408179 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9989913a-52dd-4f0b-9d11-30e6c486605c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:27.411099 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9989913a-52dd-4f0b-9d11-30e6c486605c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:27.596807 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1eee1c15-4197-4a5c-8312-ded5e6f66243 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:27.606869 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1eee1c15-4197-4a5c-8312-ded5e6f66243 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/8138c4a6-0fa5-4427-a026-56618461dd14" status: 200 len: 1275 microversion: 2.1 time: 0.366392 Oct 17 13:36:27.613573 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 397/798] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:27 2022] GET /compute/v2.1/servers/8138c4a6-0fa5-4427-a026-56618461dd14 => generated 1275 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:28.254706 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9989913a-52dd-4f0b-9d11-30e6c486605c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:28.278971 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9989913a-52dd-4f0b-9d11-30e6c486605c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e" status: 200 len: 1358 microversion: 2.1 time: 0.884151 Oct 17 13:36:28.284257 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 402/799] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:27 2022] GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e => generated 1358 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:36:28.400172 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-717ea8e4-7dd2-4d97-917a-bd198c50ff4e tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:28.401092 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-717ea8e4-7dd2-4d97-917a-bd198c50ff4e tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] [instance: 51be2144-e969-4e1b-b5da-c43b9a7b7c90] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:28.410763 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-717ea8e4-7dd2-4d97-917a-bd198c50ff4e tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:28.411289 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-717ea8e4-7dd2-4d97-917a-bd198c50ff4e tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:28.411724 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-717ea8e4-7dd2-4d97-917a-bd198c50ff4e tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:28.424309 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-717ea8e4-7dd2-4d97-917a-bd198c50ff4e tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:28.425053 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-717ea8e4-7dd2-4d97-917a-bd198c50ff4e tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:28.425682 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-717ea8e4-7dd2-4d97-917a-bd198c50ff4e tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:28.637823 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-007701c7-3a22-43be-b414-1c3af9bd8690 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:28.641623 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-007701c7-3a22-43be-b414-1c3af9bd8690 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 8138c4a6-0fa5-4427-a026-56618461dd14] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:28.651048 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-717ea8e4-7dd2-4d97-917a-bd198c50ff4e tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lazy-loading 'services' on Instance uuid 51be2144-e969-4e1b-b5da-c43b9a7b7c90 {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:36:28.658571 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-007701c7-3a22-43be-b414-1c3af9bd8690 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:28.660186 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-007701c7-3a22-43be-b414-1c3af9bd8690 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:28.662305 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-007701c7-3a22-43be-b414-1c3af9bd8690 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:28.663331 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-007701c7-3a22-43be-b414-1c3af9bd8690 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:28.666108 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-007701c7-3a22-43be-b414-1c3af9bd8690 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:28.670998 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-007701c7-3a22-43be-b414-1c3af9bd8690 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:28.717313 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-717ea8e4-7dd2-4d97-917a-bd198c50ff4e tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90" status: 200 len: 1931 microversion: 2.75 time: 0.319740 Oct 17 13:36:28.718220 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 398/800] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:36:28 2022] GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90 => generated 1931 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:36:28.877334 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-007701c7-3a22-43be-b414-1c3af9bd8690 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:28.909764 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-007701c7-3a22-43be-b414-1c3af9bd8690 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/8138c4a6-0fa5-4427-a026-56618461dd14" status: 200 len: 1275 microversion: 2.1 time: 0.281361 Oct 17 13:36:28.910573 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 403/801] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:28 2022] GET /compute/v2.1/servers/8138c4a6-0fa5-4427-a026-56618461dd14 => generated 1275 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:29.308161 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1b354f7f-bb5f-4161-940b-80615c58062a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:29.309109 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-1b354f7f-bb5f-4161-940b-80615c58062a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: a54adf11-ee58-4f13-82c8-9a00a36c536e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:29.320881 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1b354f7f-bb5f-4161-940b-80615c58062a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:29.327277 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1b354f7f-bb5f-4161-940b-80615c58062a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:29.328056 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1b354f7f-bb5f-4161-940b-80615c58062a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:29.329042 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1b354f7f-bb5f-4161-940b-80615c58062a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:29.330104 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1b354f7f-bb5f-4161-940b-80615c58062a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:29.330767 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1b354f7f-bb5f-4161-940b-80615c58062a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:29.483085 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e49cda51-d1cb-4a39-9821-8cd43caf047c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-219295451", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "9fce71af-909d-4a58-8606-ba21d3f4b00f"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:29.585867 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-e49cda51-d1cb-4a39-9821-8cd43caf047c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] validate_networks() for [('9fce71af-909d-4a58-8606-ba21d3f4b00f', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:36:30.792502 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-1b354f7f-bb5f-4161-940b-80615c58062a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:30.804724 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1b354f7f-bb5f-4161-940b-80615c58062a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e" status: 200 len: 1358 microversion: 2.1 time: 1.500627 Oct 17 13:36:30.810915 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 404/802] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:29 2022] GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e => generated 1358 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:30.835459 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-907f0e4f-835d-43ec-80b8-ad0f2c474daa tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:30.836195 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-907f0e4f-835d-43ec-80b8-ad0f2c474daa tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] [instance: 51be2144-e969-4e1b-b5da-c43b9a7b7c90] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:30.844472 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:36:30.856663 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-907f0e4f-835d-43ec-80b8-ad0f2c474daa tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:30.857175 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-907f0e4f-835d-43ec-80b8-ad0f2c474daa tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:30.857776 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-907f0e4f-835d-43ec-80b8-ad0f2c474daa tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:30.858512 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-907f0e4f-835d-43ec-80b8-ad0f2c474daa tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:30.858962 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-907f0e4f-835d-43ec-80b8-ad0f2c474daa tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:30.859403 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-907f0e4f-835d-43ec-80b8-ad0f2c474daa tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:31.108432 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-907f0e4f-835d-43ec-80b8-ad0f2c474daa tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lazy-loading 'services' on Instance uuid 51be2144-e969-4e1b-b5da-c43b9a7b7c90 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:36:31.122219 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=100 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:36:31.168121 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-907f0e4f-835d-43ec-80b8-ad0f2c474daa tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90" status: 200 len: 1931 microversion: 2.75 time: 0.352270 Oct 17 13:36:31.180566 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 405/803] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:36:30 2022] GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90 => generated 1931 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:36:31.220122 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2b91fdb5-9f1f-44b7-b2b7-f87c9e65fdb5 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:31.221138 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2b91fdb5-9f1f-44b7-b2b7-f87c9e65fdb5 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 8138c4a6-0fa5-4427-a026-56618461dd14] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:31.228814 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2b91fdb5-9f1f-44b7-b2b7-f87c9e65fdb5 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:31.230362 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2b91fdb5-9f1f-44b7-b2b7-f87c9e65fdb5 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:31.231000 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2b91fdb5-9f1f-44b7-b2b7-f87c9e65fdb5 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:31.231964 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2b91fdb5-9f1f-44b7-b2b7-f87c9e65fdb5 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:31.232619 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2b91fdb5-9f1f-44b7-b2b7-f87c9e65fdb5 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:31.233232 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2b91fdb5-9f1f-44b7-b2b7-f87c9e65fdb5 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:31.901569 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=8 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:36:31.962831 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2b91fdb5-9f1f-44b7-b2b7-f87c9e65fdb5 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:31.984461 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2b91fdb5-9f1f-44b7-b2b7-f87c9e65fdb5 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/8138c4a6-0fa5-4427-a026-56618461dd14" status: 200 len: 1317 microversion: 2.1 time: 0.800727 Oct 17 13:36:31.985354 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 406/804] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:31 2022] GET /compute/v2.1/servers/8138c4a6-0fa5-4427-a026-56618461dd14 => generated 1317 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:32.011910 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9e4a8f4d-ab38-4ff6-a706-ff8b5870dbad tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:32.012788 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9e4a8f4d-ab38-4ff6-a706-ff8b5870dbad tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: a54adf11-ee58-4f13-82c8-9a00a36c536e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:32.029920 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9e4a8f4d-ab38-4ff6-a706-ff8b5870dbad tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:32.030260 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9e4a8f4d-ab38-4ff6-a706-ff8b5870dbad tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:32.030794 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9e4a8f4d-ab38-4ff6-a706-ff8b5870dbad tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:32.031728 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9e4a8f4d-ab38-4ff6-a706-ff8b5870dbad tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:32.032335 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9e4a8f4d-ab38-4ff6-a706-ff8b5870dbad tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:32.032900 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9e4a8f4d-ab38-4ff6-a706-ff8b5870dbad tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:32.355142 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-e49cda51-d1cb-4a39-9821-8cd43caf047c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:36:32.355697 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-e49cda51-d1cb-4a39-9821-8cd43caf047c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:36:32.356074 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-e49cda51-d1cb-4a39-9821-8cd43caf047c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:36:32.356480 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-e49cda51-d1cb-4a39-9821-8cd43caf047c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:36:32.356896 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-e49cda51-d1cb-4a39-9821-8cd43caf047c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:36:32.381516 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e49cda51-d1cb-4a39-9821-8cd43caf047c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:32.382487 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e49cda51-d1cb-4a39-9821-8cd43caf047c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:32.383146 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e49cda51-d1cb-4a39-9821-8cd43caf047c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:32.384687 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e49cda51-d1cb-4a39-9821-8cd43caf047c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:32.385946 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e49cda51-d1cb-4a39-9821-8cd43caf047c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:32.386573 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e49cda51-d1cb-4a39-9821-8cd43caf047c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:32.420287 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-e49cda51-d1cb-4a39-9821-8cd43caf047c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Getting quotas for project 461c44cb99ff4958a128679d3e10cd6f. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:36:32.435357 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-e49cda51-d1cb-4a39-9821-8cd43caf047c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Getting quotas for user 386397fd9194430b81ac465f9b3bf92d and project 461c44cb99ff4958a128679d3e10cd6f. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:36:32.469471 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e49cda51-d1cb-4a39-9821-8cd43caf047c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:36:32.476546 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e49cda51-d1cb-4a39-9821-8cd43caf047c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 9e72abb9-d4b5-4c67-8260-2828e3ab5ad2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:36:32.574182 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e49cda51-d1cb-4a39-9821-8cd43caf047c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.345428 Oct 17 13:36:32.582962 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 399/805] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:36:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 3355 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:36:32.588891 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-eed88f1e-addd-4903-8bb5-445e7f99379a tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:32.589873 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-eed88f1e-addd-4903-8bb5-445e7f99379a tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] [instance: 51be2144-e969-4e1b-b5da-c43b9a7b7c90] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:32.604080 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eed88f1e-addd-4903-8bb5-445e7f99379a tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:32.606598 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eed88f1e-addd-4903-8bb5-445e7f99379a tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:32.609958 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eed88f1e-addd-4903-8bb5-445e7f99379a tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:32.611809 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eed88f1e-addd-4903-8bb5-445e7f99379a tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:32.615495 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eed88f1e-addd-4903-8bb5-445e7f99379a tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:32.618158 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eed88f1e-addd-4903-8bb5-445e7f99379a tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:32.949112 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-eed88f1e-addd-4903-8bb5-445e7f99379a tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lazy-loading 'services' on Instance uuid 51be2144-e969-4e1b-b5da-c43b9a7b7c90 {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:36:33.029916 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-eed88f1e-addd-4903-8bb5-445e7f99379a tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90" status: 200 len: 1931 microversion: 2.75 time: 0.445244 Oct 17 13:36:33.057053 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 400/806] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:36:32 2022] GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90 => generated 1931 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:36:33.071471 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c37e399e-a799-4bbc-bbf0-73d5738589c3 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:33.072109 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c37e399e-a799-4bbc-bbf0-73d5738589c3 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 9e72abb9-d4b5-4c67-8260-2828e3ab5ad2] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:33.120037 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9e4a8f4d-ab38-4ff6-a706-ff8b5870dbad tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:33.130793 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9e4a8f4d-ab38-4ff6-a706-ff8b5870dbad tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e" status: 200 len: 1358 microversion: 2.1 time: 1.134529 Oct 17 13:36:33.155249 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 407/807] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:31 2022] GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e => generated 1358 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:33.172569 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fa5feeb3-d590-43f0-adc7-db86944c78d9 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:33.173229 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-fa5feeb3-d590-43f0-adc7-db86944c78d9 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 8138c4a6-0fa5-4427-a026-56618461dd14] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:33.188402 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fa5feeb3-d590-43f0-adc7-db86944c78d9 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:33.189118 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fa5feeb3-d590-43f0-adc7-db86944c78d9 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:33.190536 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fa5feeb3-d590-43f0-adc7-db86944c78d9 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:33.192489 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fa5feeb3-d590-43f0-adc7-db86944c78d9 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:33.194363 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fa5feeb3-d590-43f0-adc7-db86944c78d9 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:33.196255 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fa5feeb3-d590-43f0-adc7-db86944c78d9 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:33.508837 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c37e399e-a799-4bbc-bbf0-73d5738589c3 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:33.526638 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c37e399e-a799-4bbc-bbf0-73d5738589c3 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/9e72abb9-d4b5-4c67-8260-2828e3ab5ad2" status: 200 len: 1207 microversion: 2.1 time: 0.466020 Oct 17 13:36:33.527963 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 401/808] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:33 2022] GET /compute/v2.1/servers/9e72abb9-d4b5-4c67-8260-2828e3ab5ad2 => generated 1207 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:33.704957 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b8372828-ca3a-4fbe-866c-d1f9af06bcc4 tempest-FloatingIPDetailsNegativeTestJSON-1731752324 tempest-FloatingIPDetailsNegativeTestJSON-1731752324-project] Calling method '.version_select at 0x7f7cd5906700>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:34.178443 n-d-854247-14 devstack@n-api.service[127017]: DEBUG neutronclient.v2_0.client [None req-b8372828-ca3a-4fbe-866c-d1f9af06bcc4 tempest-FloatingIPDetailsNegativeTestJSON-1731752324 tempest-FloatingIPDetailsNegativeTestJSON-1731752324-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 2599e655-427c-439a-b1d7-cbf20a641e88 could not be found", "detail": ""}} {{(pid=127017) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 13:36:34.179468 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-b8372828-ca3a-4fbe-866c-d1f9af06bcc4 tempest-FloatingIPDetailsNegativeTestJSON-1731752324 tempest-FloatingIPDetailsNegativeTestJSON-1731752324-project] HTTP exception thrown: Floating IP not found for ID 2599e655-427c-439a-b1d7-cbf20a641e88 Oct 17 13:36:34.181734 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b8372828-ca3a-4fbe-866c-d1f9af06bcc4 tempest-FloatingIPDetailsNegativeTestJSON-1731752324 tempest-FloatingIPDetailsNegativeTestJSON-1731752324-project] Request method failure captured: Oct 17 13:36:34.181734 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/os-floating-ips/2599e655-427c-439a-b1d7-cbf20a641e88 HTTP/1.1 Oct 17 13:36:34.181734 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:36:34.181734 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:36:34.181734 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:36:34.181734 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:36:34.181734 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:36:34.181734 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:36:34.181734 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:36:34.181734 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:36:34.181734 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVpgGkD679tt9K94gF9SBsDPSQLOAzLiwHUVVZKfoLa9eV3shA-1xAafUAs52VTyKdGMBJdMxmGsh--R25GQf3eiMUNfFLuinYjSrttuX2I8g9vWjgnff2FjnDK6lQbkPezEnCrSIUi44qknr4XNT3TDAF7CK6NH7oMtdhcgvB6gd70 Oct 17 13:36:34.181734 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:36:34.181734 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:36:34.181734 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:36:34.181734 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:36:34.181734 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:36:34.181734 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:36:34.181734 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: e3a81be934d243f3b190f8aabad800a1 Oct 17 13:36:34.181734 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1731752324 Oct 17 13:36:34.181734 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:36:34.181734 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:36:34.183289 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e3a81be934d243f3b190f8aabad800a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/e3a81be934d243f3b190f8aabad800a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e3a81be934d243f3b190f8aabad800a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_e3a81be934d243f3b190f8aabad800a1", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:36:34.183289 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1731752324 Oct 17 13:36:34.183289 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: e3a81be934d243f3b190f8aabad800a1 Oct 17 13:36:34.183289 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1731752324 Oct 17 13:36:34.183289 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1731752324-project Oct 17 13:36:34.183289 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:36:34.183289 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:36:34.183289 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 0c2732000322432f8ecfad8c30b155b2 Oct 17 13:36:34.183289 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1731752324-project Oct 17 13:36:34.183289 n-d-854247-14 devstack@n-api.service[127017]: method: Oct 17 13:36:34.183289 n-d-854247-14 devstack@n-api.service[127017]: exception: Floating IP not found for ID 2599e655-427c-439a-b1d7-cbf20a641e88 Oct 17 13:36:34.183289 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '2599e655-427c-439a-b1d7-cbf20a641e88'} Oct 17 13:36:34.184240 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:36:34.184240 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:34.184240 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 17 13:36:34.184240 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 17 13:36:34.184240 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:36:34.184240 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:36:34.184240 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 17 13:36:34.184240 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 17 13:36:34.184240 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:36:34.184240 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:36:34.184240 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 13:36:34.184240 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 13:36:34.184240 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:36:34.184240 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:36:34.184240 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 13:36:34.184240 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 13:36:34.184240 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:36:34.184240 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:36:34.184240 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 13:36:34.185427 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 13:36:34.185427 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:36:34.185427 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:36:34.185427 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 13:36:34.185427 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 13:36:34.185427 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 13:36:34.185427 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 13:36:34.185427 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 2599e655-427c-439a-b1d7-cbf20a641e88 could not be found Oct 17 13:36:34.185427 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5e0da702-a051-41a7-9246-f5d71e1c231b'] Oct 17 13:36:34.185427 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:34.185427 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:34.185427 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:34.185427 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:34.185427 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 17 13:36:34.185427 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 17 13:36:34.185427 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 17 13:36:34.185427 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 17 13:36:34.185427 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 2599e655-427c-439a-b1d7-cbf20a641e88. Oct 17 13:36:34.185427 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:34.186868 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:34.186868 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:34.186868 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:34.186868 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:34.186868 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:34.186868 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:36:34.186868 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:36:34.186868 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:36:34.186868 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:36:34.186868 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:36:34.186868 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:36:34.186868 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 17 13:36:34.186868 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 17 13:36:34.186868 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 2599e655-427c-439a-b1d7-cbf20a641e88 Oct 17 13:36:34.186868 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:34.186868 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:34.186868 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:34.186868 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:34.186868 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:34.186868 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:34.186868 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:36:34.188309 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:36:34.188309 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 2599e655-427c-439a-b1d7-cbf20a641e88 Oct 17 13:36:34.188309 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:34.191018 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b8372828-ca3a-4fbe-866c-d1f9af06bcc4 tempest-FloatingIPDetailsNegativeTestJSON-1731752324 tempest-FloatingIPDetailsNegativeTestJSON-1731752324-project] Returning 404 to user: Floating IP not found for ID 2599e655-427c-439a-b1d7-cbf20a641e88 {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:36:34.192063 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b8372828-ca3a-4fbe-866c-d1f9af06bcc4 tempest-FloatingIPDetailsNegativeTestJSON-1731752324 tempest-FloatingIPDetailsNegativeTestJSON-1731752324-project] 10.222.0.79 "GET /compute/v2.1/os-floating-ips/2599e655-427c-439a-b1d7-cbf20a641e88" status: 404 len: 111 microversion: 2.1 time: 0.662238 Oct 17 13:36:34.193449 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 402/809] 10.222.0.79 () {58 vars in 1260 bytes} [Mon Oct 17 13:36:33 2022] GET /compute/v2.1/os-floating-ips/2599e655-427c-439a-b1d7-cbf20a641e88 => generated 111 bytes in 664 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:36:34.211963 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8321865a-4969-465c-bcde-d4cdb225957d tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:34.217191 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8321865a-4969-465c-bcde-d4cdb225957d tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] [instance: 51be2144-e969-4e1b-b5da-c43b9a7b7c90] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:34.270829 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8321865a-4969-465c-bcde-d4cdb225957d tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:34.276320 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8321865a-4969-465c-bcde-d4cdb225957d tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:34.278395 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8321865a-4969-465c-bcde-d4cdb225957d tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:34.279847 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8321865a-4969-465c-bcde-d4cdb225957d tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:34.310468 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8321865a-4969-465c-bcde-d4cdb225957d tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:34.310928 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8321865a-4969-465c-bcde-d4cdb225957d tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:34.487491 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fa5feeb3-d590-43f0-adc7-db86944c78d9 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:34.507331 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fa5feeb3-d590-43f0-adc7-db86944c78d9 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/8138c4a6-0fa5-4427-a026-56618461dd14" status: 200 len: 1317 microversion: 2.1 time: 1.343924 Oct 17 13:36:34.510220 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 408/810] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:33 2022] GET /compute/v2.1/servers/8138c4a6-0fa5-4427-a026-56618461dd14 => generated 1317 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:34.637153 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0bd69675-a474-4513-b8d2-6fb8ac734783 tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] Action: 'create', calling method: .version_select at 0x7f7cd56acc10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1908237050", "description": "tempest-description-1380894999"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:34.811043 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-8321865a-4969-465c-bcde-d4cdb225957d tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lazy-loading 'services' on Instance uuid 51be2144-e969-4e1b-b5da-c43b9a7b7c90 {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:36:34.859898 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8321865a-4969-465c-bcde-d4cdb225957d tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90" status: 200 len: 1937 microversion: 2.75 time: 0.665200 Oct 17 13:36:34.863017 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 403/811] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:36:34 2022] GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90 => generated 1937 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:36:34.878689 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2cc36445-8b0b-4214-9f77-d33411948d6b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:34.879954 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2cc36445-8b0b-4214-9f77-d33411948d6b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: a54adf11-ee58-4f13-82c8-9a00a36c536e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:34.922922 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2cc36445-8b0b-4214-9f77-d33411948d6b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:34.925757 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2cc36445-8b0b-4214-9f77-d33411948d6b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:34.927538 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2cc36445-8b0b-4214-9f77-d33411948d6b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:34.930360 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2cc36445-8b0b-4214-9f77-d33411948d6b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:34.932396 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2cc36445-8b0b-4214-9f77-d33411948d6b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:34.933852 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2cc36445-8b0b-4214-9f77-d33411948d6b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:35.316184 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2cc36445-8b0b-4214-9f77-d33411948d6b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:35.329601 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2cc36445-8b0b-4214-9f77-d33411948d6b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e" status: 200 len: 1358 microversion: 2.1 time: 0.461935 Oct 17 13:36:35.331108 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 404/812] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:34 2022] GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e => generated 1358 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:35.341189 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-bc629185-3ccd-4917-a32d-1ce336788dfc req-40579ef5-7bd1-441c-9d47-07e1e95e42af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a54adf11-ee58-4f13-82c8-9a00a36c536e", "name": "network-vif-plugged", "status": "completed", "tag": "f261c54a-cf39-4ca3-a4d0-eb2c41dbcbe0"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:35.381437 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-bc629185-3ccd-4917-a32d-1ce336788dfc req-40579ef5-7bd1-441c-9d47-07e1e95e42af service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:35.382287 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-bc629185-3ccd-4917-a32d-1ce336788dfc req-40579ef5-7bd1-441c-9d47-07e1e95e42af service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:35.382909 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-bc629185-3ccd-4917-a32d-1ce336788dfc req-40579ef5-7bd1-441c-9d47-07e1e95e42af service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:35.415224 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-bc629185-3ccd-4917-a32d-1ce336788dfc req-40579ef5-7bd1-441c-9d47-07e1e95e42af service nova] Creating event network-vif-plugged:f261c54a-cf39-4ca3-a4d0-eb2c41dbcbe0 for instance a54adf11-ee58-4f13-82c8-9a00a36c536e on n-h1-854247-14 Oct 17 13:36:35.430094 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-bc629185-3ccd-4917-a32d-1ce336788dfc req-40579ef5-7bd1-441c-9d47-07e1e95e42af service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097371 Oct 17 13:36:35.437025 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 405/813] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:36:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:35.461882 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-fd95424b-ced0-4fb0-a3ce-3c69450b1ade tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:35.463376 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-fd95424b-ced0-4fb0-a3ce-3c69450b1ade tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 9e72abb9-d4b5-4c67-8260-2828e3ab5ad2] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:35.478422 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fd95424b-ced0-4fb0-a3ce-3c69450b1ade tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:35.481133 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fd95424b-ced0-4fb0-a3ce-3c69450b1ade tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:35.483200 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fd95424b-ced0-4fb0-a3ce-3c69450b1ade tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:35.484149 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fd95424b-ced0-4fb0-a3ce-3c69450b1ade tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:35.486704 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fd95424b-ced0-4fb0-a3ce-3c69450b1ade tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:35.493210 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fd95424b-ced0-4fb0-a3ce-3c69450b1ade tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:35.692301 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-fd95424b-ced0-4fb0-a3ce-3c69450b1ade tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:35.704216 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-fd95424b-ced0-4fb0-a3ce-3c69450b1ade tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/9e72abb9-d4b5-4c67-8260-2828e3ab5ad2" status: 200 len: 1277 microversion: 2.1 time: 0.265827 Oct 17 13:36:35.706739 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 406/814] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:35 2022] GET /compute/v2.1/servers/9e72abb9-d4b5-4c67-8260-2828e3ab5ad2 => generated 1277 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:35.712101 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-39087468-a4f8-4f3c-be14-efb0346f47a9 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:35.728314 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-39087468-a4f8-4f3c-be14-efb0346f47a9 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 8138c4a6-0fa5-4427-a026-56618461dd14] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:35.737613 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-39087468-a4f8-4f3c-be14-efb0346f47a9 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:35.738499 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-39087468-a4f8-4f3c-be14-efb0346f47a9 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:35.739023 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-39087468-a4f8-4f3c-be14-efb0346f47a9 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:35.739958 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-39087468-a4f8-4f3c-be14-efb0346f47a9 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:35.741331 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-39087468-a4f8-4f3c-be14-efb0346f47a9 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:35.751245 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-39087468-a4f8-4f3c-be14-efb0346f47a9 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:36.607964 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0bd69675-a474-4513-b8d2-6fb8ac734783 tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 2.095641 Oct 17 13:36:36.609487 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 409/815] 10.222.0.79 () {60 vars in 1180 bytes} [Mon Oct 17 13:36:34 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 2098 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:36.622089 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-64abeed0-f03a-4c6d-a5c8-9e8bd4257700 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:36.622954 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-64abeed0-f03a-4c6d-a5c8-9e8bd4257700 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] [instance: 51be2144-e969-4e1b-b5da-c43b9a7b7c90] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:36.629120 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:36:36.634276 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-64abeed0-f03a-4c6d-a5c8-9e8bd4257700 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:36.634911 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-64abeed0-f03a-4c6d-a5c8-9e8bd4257700 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:36.635411 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-64abeed0-f03a-4c6d-a5c8-9e8bd4257700 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:36.636149 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-64abeed0-f03a-4c6d-a5c8-9e8bd4257700 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:36.636600 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-64abeed0-f03a-4c6d-a5c8-9e8bd4257700 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:36.637016 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-64abeed0-f03a-4c6d-a5c8-9e8bd4257700 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:36.841405 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-64abeed0-f03a-4c6d-a5c8-9e8bd4257700 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] Lazy-loading 'services' on Instance uuid 51be2144-e969-4e1b-b5da-c43b9a7b7c90 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:36:36.857245 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-39087468-a4f8-4f3c-be14-efb0346f47a9 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:36.865776 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-39087468-a4f8-4f3c-be14-efb0346f47a9 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/8138c4a6-0fa5-4427-a026-56618461dd14" status: 200 len: 1317 microversion: 2.1 time: 1.157685 Oct 17 13:36:36.869517 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-64abeed0-f03a-4c6d-a5c8-9e8bd4257700 tempest-ServersAdmin275Test-1290797445 tempest-ServersAdmin275Test-1290797445-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90" status: 200 len: 1922 microversion: 2.75 time: 0.258805 Oct 17 13:36:36.869832 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 407/816] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:35 2022] GET /compute/v2.1/servers/8138c4a6-0fa5-4427-a026-56618461dd14 => generated 1317 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:36.879799 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 410/817] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:36:36 2022] GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90 => generated 1922 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:36:36.884053 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-622e736a-a7db-4999-a638-3ef541ffc79d tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:36.884991 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-622e736a-a7db-4999-a638-3ef541ffc79d tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: a54adf11-ee58-4f13-82c8-9a00a36c536e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:36.901421 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-622e736a-a7db-4999-a638-3ef541ffc79d tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:36.902238 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3431cce2-a120-4f4c-90eb-517956398726 tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] Action: 'create', calling method: .version_select at 0x7f7cd56881f0>, body: {"security_group_rule": {"parent_group_id": "ae72bbe3-a962-4bba-b65a-ef96a1a2abc2", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:36.902422 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-622e736a-a7db-4999-a638-3ef541ffc79d tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:36.904111 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-622e736a-a7db-4999-a638-3ef541ffc79d tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:36.907398 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-622e736a-a7db-4999-a638-3ef541ffc79d tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:36.913669 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-622e736a-a7db-4999-a638-3ef541ffc79d tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:36.914727 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-622e736a-a7db-4999-a638-3ef541ffc79d tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:37.277871 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-622e736a-a7db-4999-a638-3ef541ffc79d tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:37.288609 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-622e736a-a7db-4999-a638-3ef541ffc79d tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e" status: 200 len: 1358 microversion: 2.1 time: 0.417505 Oct 17 13:36:37.289282 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 408/818] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:36 2022] GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e => generated 1358 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:37.295858 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f855c012-65a8-4190-bfef-d75f07615782 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:37.309380 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f855c012-65a8-4190-bfef-d75f07615782 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 9e72abb9-d4b5-4c67-8260-2828e3ab5ad2] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:37.325100 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f855c012-65a8-4190-bfef-d75f07615782 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:37.330908 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f855c012-65a8-4190-bfef-d75f07615782 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:37.331664 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f855c012-65a8-4190-bfef-d75f07615782 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:37.332562 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f855c012-65a8-4190-bfef-d75f07615782 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:37.333165 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f855c012-65a8-4190-bfef-d75f07615782 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:37.333729 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f855c012-65a8-4190-bfef-d75f07615782 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:37.511697 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f855c012-65a8-4190-bfef-d75f07615782 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:37.537906 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f855c012-65a8-4190-bfef-d75f07615782 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/9e72abb9-d4b5-4c67-8260-2828e3ab5ad2" status: 200 len: 1265 microversion: 2.1 time: 0.247447 Oct 17 13:36:37.543782 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 409/819] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:37 2022] GET /compute/v2.1/servers/9e72abb9-d4b5-4c67-8260-2828e3ab5ad2 => generated 1265 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:37.559469 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0a9cbd0d-43e8-4eed-87b5-62f35a0d624a tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:37.561947 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0a9cbd0d-43e8-4eed-87b5-62f35a0d624a tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] [instance: 51be2144-e969-4e1b-b5da-c43b9a7b7c90] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:37.581913 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0a9cbd0d-43e8-4eed-87b5-62f35a0d624a tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:37.584048 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0a9cbd0d-43e8-4eed-87b5-62f35a0d624a tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:37.585659 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0a9cbd0d-43e8-4eed-87b5-62f35a0d624a tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:37.588315 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0a9cbd0d-43e8-4eed-87b5-62f35a0d624a tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:37.589756 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0a9cbd0d-43e8-4eed-87b5-62f35a0d624a tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:37.593253 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0a9cbd0d-43e8-4eed-87b5-62f35a0d624a tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:37.641003 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0a9cbd0d-43e8-4eed-87b5-62f35a0d624a tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] [instance: 51be2144-e969-4e1b-b5da-c43b9a7b7c90] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:36:37.683524 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=100 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:36:37.832896 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=4,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:36:37.856630 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0a9cbd0d-43e8-4eed-87b5-62f35a0d624a tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] 10.222.0.79 "DELETE /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90" status: 204 len: 0 microversion: 2.75 time: 0.311431 Oct 17 13:36:37.861440 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 410/820] 10.222.0.79 () {60 vars in 1280 bytes} [Mon Oct 17 13:36:37 2022] DELETE /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:36:37.879863 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b1055888-ce21-43cc-bc60-5c46e731cff7 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:37.880978 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b1055888-ce21-43cc-bc60-5c46e731cff7 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] [instance: 51be2144-e969-4e1b-b5da-c43b9a7b7c90] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:37.889417 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b1055888-ce21-43cc-bc60-5c46e731cff7 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:37.890237 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b1055888-ce21-43cc-bc60-5c46e731cff7 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:37.892229 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b1055888-ce21-43cc-bc60-5c46e731cff7 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:37.898347 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b1055888-ce21-43cc-bc60-5c46e731cff7 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:37.899027 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b1055888-ce21-43cc-bc60-5c46e731cff7 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:37.899703 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b1055888-ce21-43cc-bc60-5c46e731cff7 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:37.926509 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3431cce2-a120-4f4c-90eb-517956398726 tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] 10.222.0.79 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.045349 Oct 17 13:36:37.928010 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 411/821] 10.222.0.79 () {60 vars in 1195 bytes} [Mon Oct 17 13:36:36 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:37.939512 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-030d694f-a4bc-4b01-882c-f6a8ca2221ac tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:37.940509 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-030d694f-a4bc-4b01-882c-f6a8ca2221ac tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 8138c4a6-0fa5-4427-a026-56618461dd14] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:37.948909 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-030d694f-a4bc-4b01-882c-f6a8ca2221ac tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:37.958684 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-030d694f-a4bc-4b01-882c-f6a8ca2221ac tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:37.959509 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-030d694f-a4bc-4b01-882c-f6a8ca2221ac tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:37.960760 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-030d694f-a4bc-4b01-882c-f6a8ca2221ac tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:37.961279 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-030d694f-a4bc-4b01-882c-f6a8ca2221ac tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:37.962067 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-030d694f-a4bc-4b01-882c-f6a8ca2221ac tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:38.272418 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b1055888-ce21-43cc-bc60-5c46e731cff7 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:38.284673 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b1055888-ce21-43cc-bc60-5c46e731cff7 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:38.291472 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b1055888-ce21-43cc-bc60-5c46e731cff7 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:38.307307 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b1055888-ce21-43cc-bc60-5c46e731cff7 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] 10.222.0.79 "GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90" status: 200 len: 1444 microversion: 2.75 time: 0.443804 Oct 17 13:36:38.313887 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 411/822] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:36:37 2022] GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90 => generated 1444 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:36:38.319923 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-fb06e94b-2d7d-4105-b99c-ef8364fb9afa tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] Action: 'create', calling method: .version_select at 0x7f7cd5756310>, body: {"security_group_rule": {"parent_group_id": "ae72bbe3-a962-4bba-b65a-ef96a1a2abc2", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:38.581091 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-030d694f-a4bc-4b01-882c-f6a8ca2221ac tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:38.593590 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-030d694f-a4bc-4b01-882c-f6a8ca2221ac tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/8138c4a6-0fa5-4427-a026-56618461dd14" status: 200 len: 1317 microversion: 2.1 time: 0.661310 Oct 17 13:36:38.594316 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 412/823] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:37 2022] GET /compute/v2.1/servers/8138c4a6-0fa5-4427-a026-56618461dd14 => generated 1317 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:38.611769 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-846c0858-4c5a-443c-a1ad-39b4253bc944 req-f66ca244-2c5a-4182-8aaf-e56406d0e14a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8138c4a6-0fa5-4427-a026-56618461dd14", "tag": "46def99d-baf2-40aa-8eb4-982b1afb28b7"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:38.660203 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-846c0858-4c5a-443c-a1ad-39b4253bc944 req-f66ca244-2c5a-4182-8aaf-e56406d0e14a service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:38.661489 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-846c0858-4c5a-443c-a1ad-39b4253bc944 req-f66ca244-2c5a-4182-8aaf-e56406d0e14a service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:38.662593 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-846c0858-4c5a-443c-a1ad-39b4253bc944 req-f66ca244-2c5a-4182-8aaf-e56406d0e14a service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:38.694998 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-846c0858-4c5a-443c-a1ad-39b4253bc944 req-f66ca244-2c5a-4182-8aaf-e56406d0e14a service nova] Creating event network-changed:46def99d-baf2-40aa-8eb4-982b1afb28b7 for instance 8138c4a6-0fa5-4427-a026-56618461dd14 on n-h1-854247-14 Oct 17 13:36:38.707213 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-846c0858-4c5a-443c-a1ad-39b4253bc944 req-f66ca244-2c5a-4182-8aaf-e56406d0e14a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102322 Oct 17 13:36:38.711974 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 413/824] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:38.727475 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d59ef347-b573-482f-b5b2-8c2cba9d19cc tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:38.728527 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d59ef347-b573-482f-b5b2-8c2cba9d19cc tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: a54adf11-ee58-4f13-82c8-9a00a36c536e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:38.754678 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d59ef347-b573-482f-b5b2-8c2cba9d19cc tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:38.756863 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d59ef347-b573-482f-b5b2-8c2cba9d19cc tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:38.757361 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d59ef347-b573-482f-b5b2-8c2cba9d19cc tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:38.758533 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d59ef347-b573-482f-b5b2-8c2cba9d19cc tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:38.759470 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d59ef347-b573-482f-b5b2-8c2cba9d19cc tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:38.760210 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d59ef347-b573-482f-b5b2-8c2cba9d19cc tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:38.894219 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-fb06e94b-2d7d-4105-b99c-ef8364fb9afa tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] HTTP exception thrown: This rule already exists in group ae72bbe3-a962-4bba-b65a-ef96a1a2abc2 Oct 17 13:36:38.897345 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-fb06e94b-2d7d-4105-b99c-ef8364fb9afa tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] Request method failure captured: Oct 17 13:36:38.897345 n-d-854247-14 devstack@n-api.service[127017]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 17 13:36:38.897345 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:36:38.897345 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:36:38.897345 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:36:38.897345 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 138 Oct 17 13:36:38.897345 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:36:38.897345 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:36:38.897345 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:36:38.897345 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:36:38.897345 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVphRhzL0EKu3SctdRYydoXpoZVC3Q2uQVpG4rFDIAFuwikD2i8u3MXWLU7iv344Ryav9rQGMK4XLpbWz2uAQ3WSwINLwkBVFOHhIAQbWZNryGBNHXzvUjhirG_OhS8IRJbNVQN9tLzl5GJCEAt1QJn1uph5FlWVnXkwMFqzm-irEk8 Oct 17 13:36:38.897345 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:36:38.897345 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:36:38.897345 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:36:38.897345 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:36:38.897345 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:36:38.897345 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:36:38.897345 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: bc704a85b3274ecf92e14ffb82362b99 Oct 17 13:36:38.897345 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1656695594 Oct 17 13:36:38.897345 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:36:38.897345 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:36:38.898762 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/bc704a85b3274ecf92e14ffb82362b99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/bc704a85b3274ecf92e14ffb82362b99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/bc704a85b3274ecf92e14ffb82362b99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_bc704a85b3274ecf92e14ffb82362b99", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:36:38.898762 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1656695594 Oct 17 13:36:38.898762 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: bc704a85b3274ecf92e14ffb82362b99 Oct 17 13:36:38.898762 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1656695594 Oct 17 13:36:38.898762 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project Oct 17 13:36:38.898762 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:36:38.898762 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:36:38.898762 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 3e45b41f64f249a6949865c8ee4f28ad Oct 17 13:36:38.898762 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project Oct 17 13:36:38.898762 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 13:36:38.898762 n-d-854247-14 devstack@n-api.service[127017]: {"security_group_rule": {"parent_group_id": "ae72bbe3-a962-4bba-b65a-ef96a1a2abc2", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 17 13:36:38.898762 n-d-854247-14 devstack@n-api.service[127017]: method: Oct 17 13:36:38.899759 n-d-854247-14 devstack@n-api.service[127017]: exception: This rule already exists in group ae72bbe3-a962-4bba-b65a-ef96a1a2abc2 Oct 17 13:36:38.899759 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'ae72bbe3-a962-4bba-b65a-ef96a1a2abc2', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 17 13:36:38.899759 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:36:38.899759 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:38.899759 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 17 13:36:38.899759 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 17 13:36:38.899759 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 17 13:36:38.899759 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 17 13:36:38.899759 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group ae72bbe3-a962-4bba-b65a-ef96a1a2abc2 Oct 17 13:36:38.899759 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:38.899759 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:38.899759 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:38.899759 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:38.899759 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:38.899759 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:38.899759 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:36:38.899759 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:36:38.899759 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:36:38.899759 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:36:38.899759 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:36:38.901240 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:36:38.901240 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 17 13:36:38.901240 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 17 13:36:38.901240 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group ae72bbe3-a962-4bba-b65a-ef96a1a2abc2 Oct 17 13:36:38.901240 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:38.901240 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:38.901240 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:38.901240 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:38.901240 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:38.901240 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:38.901240 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:36:38.901240 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:36:38.901240 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group ae72bbe3-a962-4bba-b65a-ef96a1a2abc2 Oct 17 13:36:38.901240 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:38.903358 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-fb06e94b-2d7d-4105-b99c-ef8364fb9afa tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] Returning 400 to user: This rule already exists in group ae72bbe3-a962-4bba-b65a-ef96a1a2abc2 {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:36:38.904369 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-fb06e94b-2d7d-4105-b99c-ef8364fb9afa tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] 10.222.0.79 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.589103 Oct 17 13:36:38.905257 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 412/825] 10.222.0.79 () {60 vars in 1195 bytes} [Mon Oct 17 13:36:38 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 591 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:36:38.913589 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-46a2704e-cb52-4835-bdb6-298aa63cf3b2 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:38.922058 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-46a2704e-cb52-4835-bdb6-298aa63cf3b2 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 9e72abb9-d4b5-4c67-8260-2828e3ab5ad2] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:38.943973 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-46a2704e-cb52-4835-bdb6-298aa63cf3b2 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:38.947695 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-46a2704e-cb52-4835-bdb6-298aa63cf3b2 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:38.948355 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-46a2704e-cb52-4835-bdb6-298aa63cf3b2 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:38.949266 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-46a2704e-cb52-4835-bdb6-298aa63cf3b2 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:38.951501 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-46a2704e-cb52-4835-bdb6-298aa63cf3b2 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:38.952101 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-46a2704e-cb52-4835-bdb6-298aa63cf3b2 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:39.351497 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d59ef347-b573-482f-b5b2-8c2cba9d19cc tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:39.370390 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-46a2704e-cb52-4835-bdb6-298aa63cf3b2 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:39.387782 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-46a2704e-cb52-4835-bdb6-298aa63cf3b2 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/9e72abb9-d4b5-4c67-8260-2828e3ab5ad2" status: 200 len: 1307 microversion: 2.1 time: 0.478061 Oct 17 13:36:39.388751 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d59ef347-b573-482f-b5b2-8c2cba9d19cc tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e" status: 200 len: 1539 microversion: 2.1 time: 0.672803 Oct 17 13:36:39.389858 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 414/826] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:38 2022] GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e => generated 1539 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:39.390552 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 413/827] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:38 2022] GET /compute/v2.1/servers/9e72abb9-d4b5-4c67-8260-2828e3ab5ad2 => generated 1307 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:39.400144 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-333c8be9-b721-4ba4-be7d-e6c44bb1755c tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] Calling method '.version_select at 0x7f7cd56ef670>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:39.408056 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-88924265-5550-4aa2-b3af-7605b7efafd7 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:39.408922 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-88924265-5550-4aa2-b3af-7605b7efafd7 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] [instance: 51be2144-e969-4e1b-b5da-c43b9a7b7c90] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:39.420676 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-88924265-5550-4aa2-b3af-7605b7efafd7 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:39.421815 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-88924265-5550-4aa2-b3af-7605b7efafd7 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:39.422580 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-88924265-5550-4aa2-b3af-7605b7efafd7 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:39.423932 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-88924265-5550-4aa2-b3af-7605b7efafd7 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:39.424694 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-88924265-5550-4aa2-b3af-7605b7efafd7 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:39.425262 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-88924265-5550-4aa2-b3af-7605b7efafd7 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:39.601071 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-88924265-5550-4aa2-b3af-7605b7efafd7 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:39.611843 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-88924265-5550-4aa2-b3af-7605b7efafd7 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:39.617200 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-88924265-5550-4aa2-b3af-7605b7efafd7 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:39.630052 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-88924265-5550-4aa2-b3af-7605b7efafd7 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] 10.222.0.79 "GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90" status: 200 len: 1444 microversion: 2.75 time: 0.237098 Oct 17 13:36:39.636104 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 414/828] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:36:39 2022] GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90 => generated 1444 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:36:39.641317 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-94108d48-877b-4fde-b8a9-1e3b867f7f06 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:39.650925 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-94108d48-877b-4fde-b8a9-1e3b867f7f06 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: a54adf11-ee58-4f13-82c8-9a00a36c536e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:39.665890 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-94108d48-877b-4fde-b8a9-1e3b867f7f06 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:39.666821 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-94108d48-877b-4fde-b8a9-1e3b867f7f06 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:39.667377 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-94108d48-877b-4fde-b8a9-1e3b867f7f06 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:39.668223 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-94108d48-877b-4fde-b8a9-1e3b867f7f06 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:39.671344 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-94108d48-877b-4fde-b8a9-1e3b867f7f06 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:39.671796 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-94108d48-877b-4fde-b8a9-1e3b867f7f06 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:39.872044 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-94108d48-877b-4fde-b8a9-1e3b867f7f06 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.234490 Oct 17 13:36:39.872638 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 415/829] 10.222.0.79 () {58 vars in 1275 bytes} [Mon Oct 17 13:36:39 2022] GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e/os-interface => generated 284 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:39.885335 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9dffb3ab-8a26-4730-9b99-6a44e2bd6086 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:39.885964 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9dffb3ab-8a26-4730-9b99-6a44e2bd6086 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 8138c4a6-0fa5-4427-a026-56618461dd14] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:39.906731 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9dffb3ab-8a26-4730-9b99-6a44e2bd6086 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:39.911131 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9dffb3ab-8a26-4730-9b99-6a44e2bd6086 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:39.911636 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9dffb3ab-8a26-4730-9b99-6a44e2bd6086 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:39.913237 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9dffb3ab-8a26-4730-9b99-6a44e2bd6086 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:39.913743 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9dffb3ab-8a26-4730-9b99-6a44e2bd6086 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:39.914209 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9dffb3ab-8a26-4730-9b99-6a44e2bd6086 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:40.783834 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-333c8be9-b721-4ba4-be7d-e6c44bb1755c tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-group-rules/2d7b4ce5-1638-4ad3-af3d-254c9be91c7e" status: 202 len: 0 microversion: 2.1 time: 1.390650 Oct 17 13:36:40.784441 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 415/830] 10.222.0.79 () {58 vars in 1287 bytes} [Mon Oct 17 13:36:39 2022] DELETE /compute/v2.1/os-security-group-rules/2d7b4ce5-1638-4ad3-af3d-254c9be91c7e => generated 0 bytes in 1393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:36:40.794109 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-95d1e30d-4529-4aa9-9dfa-7c37d69d7dd5 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:40.795838 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-95d1e30d-4529-4aa9-9dfa-7c37d69d7dd5 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 9e72abb9-d4b5-4c67-8260-2828e3ab5ad2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:40.835497 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-95d1e30d-4529-4aa9-9dfa-7c37d69d7dd5 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:40.840561 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-95d1e30d-4529-4aa9-9dfa-7c37d69d7dd5 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:40.841013 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-95d1e30d-4529-4aa9-9dfa-7c37d69d7dd5 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:40.841764 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-95d1e30d-4529-4aa9-9dfa-7c37d69d7dd5 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:40.843982 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-95d1e30d-4529-4aa9-9dfa-7c37d69d7dd5 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:40.844416 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-95d1e30d-4529-4aa9-9dfa-7c37d69d7dd5 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:41.519924 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9dffb3ab-8a26-4730-9b99-6a44e2bd6086 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:41.521101 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-95d1e30d-4529-4aa9-9dfa-7c37d69d7dd5 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:41.531872 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-95d1e30d-4529-4aa9-9dfa-7c37d69d7dd5 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/9e72abb9-d4b5-4c67-8260-2828e3ab5ad2" status: 200 len: 1307 microversion: 2.1 time: 0.745033 Oct 17 13:36:41.532792 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9dffb3ab-8a26-4730-9b99-6a44e2bd6086 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/8138c4a6-0fa5-4427-a026-56618461dd14" status: 200 len: 1317 microversion: 2.1 time: 1.652456 Oct 17 13:36:41.533225 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 416/831] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:39 2022] GET /compute/v2.1/servers/8138c4a6-0fa5-4427-a026-56618461dd14 => generated 1317 bytes in 1660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:41.553679 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 416/832] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:40 2022] GET /compute/v2.1/servers/9e72abb9-d4b5-4c67-8260-2828e3ab5ad2 => generated 1307 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:41.555042 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8c684cb3-4bd0-4255-940d-adeeca828932 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:41.555752 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8c684cb3-4bd0-4255-940d-adeeca828932 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] [instance: 51be2144-e969-4e1b-b5da-c43b9a7b7c90] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:41.561034 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ca2bd0a1-e05e-448f-ba41-a97328d247ba tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] Action: 'create', calling method: .version_select at 0x7f7cd5733f70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-275679721", "description": "tempest-description-91848946"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:41.569594 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8c684cb3-4bd0-4255-940d-adeeca828932 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:41.570490 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8c684cb3-4bd0-4255-940d-adeeca828932 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:41.571469 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8c684cb3-4bd0-4255-940d-adeeca828932 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:41.574453 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8c684cb3-4bd0-4255-940d-adeeca828932 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:41.575692 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8c684cb3-4bd0-4255-940d-adeeca828932 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:41.578644 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8c684cb3-4bd0-4255-940d-adeeca828932 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:41.670615 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8c684cb3-4bd0-4255-940d-adeeca828932 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:41.671099 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8c684cb3-4bd0-4255-940d-adeeca828932 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:41.671557 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8c684cb3-4bd0-4255-940d-adeeca828932 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:41.672003 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-8c684cb3-4bd0-4255-940d-adeeca828932 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lazy-loading 'fault' on Instance uuid 51be2144-e969-4e1b-b5da-c43b9a7b7c90 {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:36:41.784979 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8c684cb3-4bd0-4255-940d-adeeca828932 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:41.797688 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8c684cb3-4bd0-4255-940d-adeeca828932 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:41.799558 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8c684cb3-4bd0-4255-940d-adeeca828932 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbc256ad10b94b558c189cdf9496d63f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f1817aaa4248529aa6e3731422c44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:41.807624 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8c684cb3-4bd0-4255-940d-adeeca828932 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] 10.222.0.79 "GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90" status: 200 len: 1449 microversion: 2.75 time: 0.256491 Oct 17 13:36:41.808461 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 417/833] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:36:41 2022] GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90 => generated 1449 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:36:42.216591 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-7b287c29-cc83-4522-8af3-60d8b6197522 req-71045305-a709-4e5b-96bd-13e05f0af589 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e72abb9-d4b5-4c67-8260-2828e3ab5ad2", "tag": "1ff9eaee-9a81-45c4-aac7-0297656e1256"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:42.258771 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-7b287c29-cc83-4522-8af3-60d8b6197522 req-71045305-a709-4e5b-96bd-13e05f0af589 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:42.261098 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-7b287c29-cc83-4522-8af3-60d8b6197522 req-71045305-a709-4e5b-96bd-13e05f0af589 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:42.264825 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-7b287c29-cc83-4522-8af3-60d8b6197522 req-71045305-a709-4e5b-96bd-13e05f0af589 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:42.301614 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-7b287c29-cc83-4522-8af3-60d8b6197522 req-71045305-a709-4e5b-96bd-13e05f0af589 service nova] Creating event network-changed:1ff9eaee-9a81-45c4-aac7-0297656e1256 for instance 9e72abb9-d4b5-4c67-8260-2828e3ab5ad2 on n-h2-854247-14 Oct 17 13:36:42.320631 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-7b287c29-cc83-4522-8af3-60d8b6197522 req-71045305-a709-4e5b-96bd-13e05f0af589 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104703 Oct 17 13:36:42.323632 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 418/834] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:42.558841 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ee71832d-5516-4a30-b3d0-8ec82aec5cbd tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:42.560377 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ee71832d-5516-4a30-b3d0-8ec82aec5cbd tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 9e72abb9-d4b5-4c67-8260-2828e3ab5ad2] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:42.563159 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:36:42.578653 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ca2bd0a1-e05e-448f-ba41-a97328d247ba tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 253 microversion: 2.1 time: 1.022716 Oct 17 13:36:42.579273 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 417/835] 10.222.0.79 () {60 vars in 1180 bytes} [Mon Oct 17 13:36:41 2022] POST /compute/v2.1/os-security-groups => generated 253 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:42.584089 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-23accc2d-c3d6-45f4-8017-6cf2eb4aacb4 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:42.584944 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-23accc2d-c3d6-45f4-8017-6cf2eb4aacb4 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 8138c4a6-0fa5-4427-a026-56618461dd14] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:42.598008 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ee71832d-5516-4a30-b3d0-8ec82aec5cbd tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:42.600899 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ee71832d-5516-4a30-b3d0-8ec82aec5cbd tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:42.601470 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ee71832d-5516-4a30-b3d0-8ec82aec5cbd tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:42.604276 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ee71832d-5516-4a30-b3d0-8ec82aec5cbd tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:42.604871 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ee71832d-5516-4a30-b3d0-8ec82aec5cbd tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:42.605400 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ee71832d-5516-4a30-b3d0-8ec82aec5cbd tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:42.605651 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-23accc2d-c3d6-45f4-8017-6cf2eb4aacb4 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:42.606228 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-23accc2d-c3d6-45f4-8017-6cf2eb4aacb4 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:42.608702 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-23accc2d-c3d6-45f4-8017-6cf2eb4aacb4 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:42.610068 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-23accc2d-c3d6-45f4-8017-6cf2eb4aacb4 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:42.612100 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-23accc2d-c3d6-45f4-8017-6cf2eb4aacb4 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:42.613230 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-23accc2d-c3d6-45f4-8017-6cf2eb4aacb4 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:43.339475 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-23accc2d-c3d6-45f4-8017-6cf2eb4aacb4 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:43.351488 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-23accc2d-c3d6-45f4-8017-6cf2eb4aacb4 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/8138c4a6-0fa5-4427-a026-56618461dd14" status: 200 len: 1317 microversion: 2.1 time: 0.770921 Oct 17 13:36:43.358192 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ee71832d-5516-4a30-b3d0-8ec82aec5cbd tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:43.358712 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 418/836] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:42 2022] GET /compute/v2.1/servers/8138c4a6-0fa5-4427-a026-56618461dd14 => generated 1317 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:43.366370 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ee71832d-5516-4a30-b3d0-8ec82aec5cbd tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/9e72abb9-d4b5-4c67-8260-2828e3ab5ad2" status: 200 len: 1307 microversion: 2.1 time: 0.812947 Oct 17 13:36:43.366938 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 419/837] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:42 2022] GET /compute/v2.1/servers/9e72abb9-d4b5-4c67-8260-2828e3ab5ad2 => generated 1307 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:36:43.367644 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-29242f3a-59ca-4d21-9f80-ec1b1ddcba2b tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] Action: 'create', calling method: .version_select at 0x7f7cd5635670>, body: {"security_group_rule": {"parent_group_id": "618df2b2-4de4-42ca-a06e-32fe69076263", "ip_protocol": "tcp", "from_port": 1014526902, "to_port": 22}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:43.386897 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-908f3b32-5da9-4523-a6b1-337eceb33126 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:43.387608 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-908f3b32-5da9-4523-a6b1-337eceb33126 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] [instance: 51be2144-e969-4e1b-b5da-c43b9a7b7c90] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:43.409322 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-908f3b32-5da9-4523-a6b1-337eceb33126 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:43.409852 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-908f3b32-5da9-4523-a6b1-337eceb33126 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:43.410303 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-908f3b32-5da9-4523-a6b1-337eceb33126 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:43.427384 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-908f3b32-5da9-4523-a6b1-337eceb33126 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:43.427999 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-908f3b32-5da9-4523-a6b1-337eceb33126 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:43.428487 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-908f3b32-5da9-4523-a6b1-337eceb33126 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:43.472550 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-908f3b32-5da9-4523-a6b1-337eceb33126 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] HTTP exception thrown: Instance 51be2144-e969-4e1b-b5da-c43b9a7b7c90 could not be found. Oct 17 13:36:43.474251 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-908f3b32-5da9-4523-a6b1-337eceb33126 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Request method failure captured: Oct 17 13:36:43.474251 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90 HTTP/1.1 Oct 17 13:36:43.474251 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:36:43.474251 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:36:43.474251 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:36:43.474251 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:36:43.474251 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:36:43.474251 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:36:43.474251 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:36:43.474251 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:36:43.474251 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVoO-QqRHuQVwj-xWZZarLHbGM6rtfaFFPlyVGEoBUGOlJmR4NtfBmISo7n0aSo_Vqn4An1lS-wE_YNalOQXBR2Jy8yFv6OqDoCIP5u4K9xaWg0Kd-KS0gqTmyrAQU5Cnkc6aYOwLjnHTJSFctrWvi7TyESKv8JpHyygMCwIFAirEb0 Oct 17 13:36:43.474251 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:36:43.474251 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:36:43.474251 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:36:43.474251 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:36:43.474251 n-d-854247-14 devstack@n-api.service[127017]: X-Openstack-Nova-Api-Version: 2.75 Oct 17 13:36:43.474251 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:36:43.474251 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:36:43.474251 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 62f1817aaa4248529aa6e3731422c44c Oct 17 13:36:43.474251 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServersAdmin275Test-844952057 Oct 17 13:36:43.474251 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:36:43.474251 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:36:43.475986 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/62f1817aaa4248529aa6e3731422c44c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/62f1817aaa4248529aa6e3731422c44c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/62f1817aaa4248529aa6e3731422c44c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_62f1817aaa4248529aa6e3731422c44c", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:36:43.475986 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServersAdmin275Test-844952057 Oct 17 13:36:43.475986 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 62f1817aaa4248529aa6e3731422c44c Oct 17 13:36:43.475986 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServersAdmin275Test-844952057 Oct 17 13:36:43.475986 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServersAdmin275Test-844952057-project Oct 17 13:36:43.475986 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:36:43.475986 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:36:43.475986 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: dbc256ad10b94b558c189cdf9496d63f Oct 17 13:36:43.475986 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServersAdmin275Test-844952057-project Oct 17 13:36:43.475986 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:36:43.475986 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 51be2144-e969-4e1b-b5da-c43b9a7b7c90 could not be found. Oct 17 13:36:43.475986 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '51be2144-e969-4e1b-b5da-c43b9a7b7c90'} Oct 17 13:36:43.477025 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:36:43.477025 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:43.477025 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:36:43.477025 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:36:43.477025 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:36:43.477025 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:36:43.477025 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:36:43.477025 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:36:43.477025 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:36:43.477025 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:36:43.477025 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51be2144-e969-4e1b-b5da-c43b9a7b7c90 could not be found. Oct 17 13:36:43.477025 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:43.477025 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:43.477025 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:43.477025 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:43.477025 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:43.477025 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:43.477025 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:36:43.477025 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:36:43.477025 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:36:43.478674 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:36:43.478674 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:36:43.478674 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:36:43.478674 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:36:43.478674 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:36:43.478674 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:36:43.478674 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:36:43.478674 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51be2144-e969-4e1b-b5da-c43b9a7b7c90 could not be found. Oct 17 13:36:43.478674 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:43.478674 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:43.478674 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:43.478674 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:43.478674 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:43.478674 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:43.478674 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:36:43.478674 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:36:43.478674 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51be2144-e969-4e1b-b5da-c43b9a7b7c90 could not be found. Oct 17 13:36:43.478674 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:43.480202 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-908f3b32-5da9-4523-a6b1-337eceb33126 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] Returning 404 to user: Instance 51be2144-e969-4e1b-b5da-c43b9a7b7c90 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:36:43.480202 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-908f3b32-5da9-4523-a6b1-337eceb33126 tempest-ServersAdmin275Test-844952057 tempest-ServersAdmin275Test-844952057-project] 10.222.0.79 "GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90" status: 404 len: 111 microversion: 2.75 time: 0.098825 Oct 17 13:36:43.486230 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 420/838] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:36:43 2022] GET /compute/v2.1/servers/51be2144-e969-4e1b-b5da-c43b9a7b7c90 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:36:43.946232 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-29242f3a-59ca-4d21-9f80-ec1b1ddcba2b tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] HTTP exception thrown: Invalid port range 1014526902:22. Former value cannot be greater than the later Oct 17 13:36:43.949266 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-29242f3a-59ca-4d21-9f80-ec1b1ddcba2b tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] Request method failure captured: Oct 17 13:36:43.949266 n-d-854247-14 devstack@n-api.service[127016]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 17 13:36:43.949266 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:36:43.949266 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:36:43.949266 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:36:43.949266 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 146 Oct 17 13:36:43.949266 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:36:43.949266 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:36:43.949266 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:36:43.949266 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:36:43.949266 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVphRhzL0EKu3SctdRYydoXpoZVC3Q2uQVpG4rFDIAFuwikD2i8u3MXWLU7iv344Ryav9rQGMK4XLpbWz2uAQ3WSwINLwkBVFOHhIAQbWZNryGBNHXzvUjhirG_OhS8IRJbNVQN9tLzl5GJCEAt1QJn1uph5FlWVnXkwMFqzm-irEk8 Oct 17 13:36:43.949266 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:36:43.949266 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:36:43.949266 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:36:43.949266 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:36:43.949266 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:36:43.949266 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:36:43.949266 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: bc704a85b3274ecf92e14ffb82362b99 Oct 17 13:36:43.949266 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1656695594 Oct 17 13:36:43.949266 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:36:43.949266 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:36:43.950869 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/bc704a85b3274ecf92e14ffb82362b99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/bc704a85b3274ecf92e14ffb82362b99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/bc704a85b3274ecf92e14ffb82362b99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_bc704a85b3274ecf92e14ffb82362b99", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:36:43.950869 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1656695594 Oct 17 13:36:43.950869 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: bc704a85b3274ecf92e14ffb82362b99 Oct 17 13:36:43.950869 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1656695594 Oct 17 13:36:43.950869 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project Oct 17 13:36:43.950869 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:36:43.950869 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:36:43.950869 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 3e45b41f64f249a6949865c8ee4f28ad Oct 17 13:36:43.950869 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project Oct 17 13:36:43.950869 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:36:43.950869 n-d-854247-14 devstack@n-api.service[127016]: {"security_group_rule": {"parent_group_id": "618df2b2-4de4-42ca-a06e-32fe69076263", "ip_protocol": "tcp", "from_port": 1014526902, "to_port": 22}} Oct 17 13:36:43.950869 n-d-854247-14 devstack@n-api.service[127016]: method: Oct 17 13:36:43.951826 n-d-854247-14 devstack@n-api.service[127016]: exception: Invalid port range 1014526902:22. Former value cannot be greater than the later Oct 17 13:36:43.951826 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'body': {'security_group_rule': {'parent_group_id': '618df2b2-4de4-42ca-a06e-32fe69076263', 'ip_protocol': 'tcp', 'from_port': 1014526902, 'to_port': 22}}} Oct 17 13:36:43.951826 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:36:43.951826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:43.951826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 17 13:36:43.951826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 17 13:36:43.951826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 17 13:36:43.951826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 17 13:36:43.951826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 17 13:36:43.951826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 17 13:36:43.951826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 17 13:36:43.951826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 17 13:36:43.951826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1014526902:22. Former value cannot be greater than the later Oct 17 13:36:43.951826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:36:43.951826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:43.951826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:36:43.951826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:43.951826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:43.951826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:43.953373 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:36:43.953373 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:36:43.953373 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:36:43.953373 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:36:43.953373 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:36:43.953373 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:36:43.953373 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 17 13:36:43.953373 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 17 13:36:43.953373 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1014526902:22. Former value cannot be greater than the later Oct 17 13:36:43.953373 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:36:43.953373 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:43.953373 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:36:43.953373 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:43.953373 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:43.953373 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:43.953373 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:36:43.953373 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:36:43.953373 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1014526902:22. Former value cannot be greater than the later Oct 17 13:36:43.953373 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:36:43.954630 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-29242f3a-59ca-4d21-9f80-ec1b1ddcba2b tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] Returning 400 to user: Invalid port range 1014526902:22. Former value cannot be greater than the later {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:36:43.954630 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-29242f3a-59ca-4d21-9f80-ec1b1ddcba2b tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] 10.222.0.79 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.591025 Oct 17 13:36:43.956733 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 419/839] 10.222.0.79 () {60 vars in 1195 bytes} [Mon Oct 17 13:36:43 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 597 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:36:43.961529 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5ac2b652-e679-48d3-afef-f663606527bc tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] Action: 'create', calling method: .version_select at 0x7f7cd579d550>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-965518916", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:43.964958 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-5ac2b652-e679-48d3-afef-f663606527bc tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] HTTP exception thrown: Security group id should be uuid Oct 17 13:36:43.967804 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5ac2b652-e679-48d3-afef-f663606527bc tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] Request method failure captured: Oct 17 13:36:43.967804 n-d-854247-14 devstack@n-api.service[127017]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 17 13:36:43.967804 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:36:43.967804 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:36:43.967804 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:36:43.967804 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 130 Oct 17 13:36:43.967804 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:36:43.967804 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:36:43.967804 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:36:43.967804 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:36:43.967804 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVphRhzL0EKu3SctdRYydoXpoZVC3Q2uQVpG4rFDIAFuwikD2i8u3MXWLU7iv344Ryav9rQGMK4XLpbWz2uAQ3WSwINLwkBVFOHhIAQbWZNryGBNHXzvUjhirG_OhS8IRJbNVQN9tLzl5GJCEAt1QJn1uph5FlWVnXkwMFqzm-irEk8 Oct 17 13:36:43.967804 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:36:43.967804 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:36:43.967804 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:36:43.967804 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:36:43.967804 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:36:43.967804 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:36:43.967804 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: bc704a85b3274ecf92e14ffb82362b99 Oct 17 13:36:43.967804 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1656695594 Oct 17 13:36:43.967804 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:36:43.967804 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:36:43.969079 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/bc704a85b3274ecf92e14ffb82362b99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/bc704a85b3274ecf92e14ffb82362b99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/bc704a85b3274ecf92e14ffb82362b99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_bc704a85b3274ecf92e14ffb82362b99", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:36:43.969079 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1656695594 Oct 17 13:36:43.969079 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: bc704a85b3274ecf92e14ffb82362b99 Oct 17 13:36:43.969079 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1656695594 Oct 17 13:36:43.969079 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project Oct 17 13:36:43.969079 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:36:43.969079 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:36:43.969079 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 3e45b41f64f249a6949865c8ee4f28ad Oct 17 13:36:43.969079 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project Oct 17 13:36:43.969079 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 13:36:43.969079 n-d-854247-14 devstack@n-api.service[127017]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-965518916", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 17 13:36:43.969079 n-d-854247-14 devstack@n-api.service[127017]: method: Oct 17 13:36:43.969079 n-d-854247-14 devstack@n-api.service[127017]: exception: Security group id should be uuid Oct 17 13:36:43.973902 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-965518916', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 17 13:36:43.973902 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:36:43.973902 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:43.973902 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 17 13:36:43.973902 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 17 13:36:43.973902 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 17 13:36:43.973902 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 17 13:36:43.973902 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 17 13:36:43.973902 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:43.973902 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:43.973902 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:43.973902 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:43.973902 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:43.973902 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:43.973902 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:36:43.973902 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:36:43.973902 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:36:43.973902 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:36:43.973902 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:36:43.973902 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:36:43.975192 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 17 13:36:43.975192 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 17 13:36:43.975192 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 17 13:36:43.975192 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:43.975192 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:43.975192 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:43.975192 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:43.975192 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:43.975192 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:43.975192 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:36:43.975192 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:36:43.975192 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 17 13:36:43.975192 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:43.975192 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5ac2b652-e679-48d3-afef-f663606527bc tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] Returning 400 to user: Security group id should be uuid {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:36:43.975192 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5ac2b652-e679-48d3-afef-f663606527bc tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] 10.222.0.79 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.011732 Oct 17 13:36:43.976253 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 421/840] 10.222.0.79 () {60 vars in 1195 bytes} [Mon Oct 17 13:36:43 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 17 13:36:43.992891 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-331664ce-ea1e-49b0-8795-f0204148e3a9 tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] Action: 'create', calling method: .version_select at 0x7f7cd56ef790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1396839598", "description": "tempest-description-1182945364"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:44.378871 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-492a97fe-67b6-4bb3-b89d-93f36a3ba257 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:44.379659 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-492a97fe-67b6-4bb3-b89d-93f36a3ba257 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 8138c4a6-0fa5-4427-a026-56618461dd14] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:44.382202 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=8 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:36:44.393725 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-492a97fe-67b6-4bb3-b89d-93f36a3ba257 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:44.394211 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-492a97fe-67b6-4bb3-b89d-93f36a3ba257 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:44.394641 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-492a97fe-67b6-4bb3-b89d-93f36a3ba257 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:44.395364 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-492a97fe-67b6-4bb3-b89d-93f36a3ba257 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:44.395833 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-492a97fe-67b6-4bb3-b89d-93f36a3ba257 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:44.398444 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-492a97fe-67b6-4bb3-b89d-93f36a3ba257 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:45.136677 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-492a97fe-67b6-4bb3-b89d-93f36a3ba257 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:45.144576 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-331664ce-ea1e-49b0-8795-f0204148e3a9 tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.165315 Oct 17 13:36:45.146606 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 420/841] 10.222.0.79 () {60 vars in 1180 bytes} [Mon Oct 17 13:36:43 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:45.152246 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c93583d1-b1d1-4790-957c-3dad06add924 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:45.153143 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c93583d1-b1d1-4790-957c-3dad06add924 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 9e72abb9-d4b5-4c67-8260-2828e3ab5ad2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:45.173740 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-492a97fe-67b6-4bb3-b89d-93f36a3ba257 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/8138c4a6-0fa5-4427-a026-56618461dd14" status: 200 len: 1317 microversion: 2.1 time: 0.794479 Oct 17 13:36:45.174417 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 422/842] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:44 2022] GET /compute/v2.1/servers/8138c4a6-0fa5-4427-a026-56618461dd14 => generated 1317 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:45.182326 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d87f3e7f-69da-4b9d-8e3c-3b518e709804 tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] Action: 'create', calling method: .version_select at 0x7f7cd59e3b80>, body: {"security_group_rule": {"parent_group_id": "50165fb7-d2a2-46c7-afc4-b743a1dfaf22", "ip_protocol": "tempest-999-1124212207", "from_port": 22, "to_port": 22}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:45.207682 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c93583d1-b1d1-4790-957c-3dad06add924 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:45.209030 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c93583d1-b1d1-4790-957c-3dad06add924 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:45.211665 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c93583d1-b1d1-4790-957c-3dad06add924 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:45.212869 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c93583d1-b1d1-4790-957c-3dad06add924 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:45.213779 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c93583d1-b1d1-4790-957c-3dad06add924 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:45.214445 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c93583d1-b1d1-4790-957c-3dad06add924 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:45.622461 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-d87f3e7f-69da-4b9d-8e3c-3b518e709804 tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] HTTP exception thrown: Invalid IP protocol tempest-999-1124212207. Oct 17 13:36:45.624961 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d87f3e7f-69da-4b9d-8e3c-3b518e709804 tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] Request method failure captured: Oct 17 13:36:45.624961 n-d-854247-14 devstack@n-api.service[127017]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 17 13:36:45.624961 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:36:45.624961 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:36:45.624961 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:36:45.624961 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 157 Oct 17 13:36:45.624961 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:36:45.624961 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:36:45.624961 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:36:45.624961 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:36:45.624961 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVphRhzL0EKu3SctdRYydoXpoZVC3Q2uQVpG4rFDIAFuwikD2i8u3MXWLU7iv344Ryav9rQGMK4XLpbWz2uAQ3WSwINLwkBVFOHhIAQbWZNryGBNHXzvUjhirG_OhS8IRJbNVQN9tLzl5GJCEAt1QJn1uph5FlWVnXkwMFqzm-irEk8 Oct 17 13:36:45.624961 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:36:45.624961 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:36:45.624961 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:36:45.624961 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:36:45.624961 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:36:45.624961 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:36:45.624961 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: bc704a85b3274ecf92e14ffb82362b99 Oct 17 13:36:45.624961 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1656695594 Oct 17 13:36:45.624961 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:36:45.624961 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:36:45.626337 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/bc704a85b3274ecf92e14ffb82362b99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/bc704a85b3274ecf92e14ffb82362b99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/bc704a85b3274ecf92e14ffb82362b99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_bc704a85b3274ecf92e14ffb82362b99", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:36:45.626337 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1656695594 Oct 17 13:36:45.626337 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: bc704a85b3274ecf92e14ffb82362b99 Oct 17 13:36:45.626337 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1656695594 Oct 17 13:36:45.626337 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project Oct 17 13:36:45.626337 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:36:45.626337 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:36:45.626337 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 3e45b41f64f249a6949865c8ee4f28ad Oct 17 13:36:45.626337 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project Oct 17 13:36:45.626337 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 13:36:45.626337 n-d-854247-14 devstack@n-api.service[127017]: {"security_group_rule": {"parent_group_id": "50165fb7-d2a2-46c7-afc4-b743a1dfaf22", "ip_protocol": "tempest-999-1124212207", "from_port": 22, "to_port": 22}} Oct 17 13:36:45.626337 n-d-854247-14 devstack@n-api.service[127017]: method: Oct 17 13:36:45.627097 n-d-854247-14 devstack@n-api.service[127017]: exception: Invalid IP protocol tempest-999-1124212207. Oct 17 13:36:45.627097 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'body': {'security_group_rule': {'parent_group_id': '50165fb7-d2a2-46c7-afc4-b743a1dfaf22', 'ip_protocol': 'tempest-999-1124212207', 'from_port': 22, 'to_port': 22}}} Oct 17 13:36:45.627097 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:36:45.627097 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:45.627097 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 17 13:36:45.627097 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 17 13:36:45.627097 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 17 13:36:45.627097 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 17 13:36:45.627097 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 17 13:36:45.627097 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 17 13:36:45.627097 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 17 13:36:45.627097 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 17 13:36:45.627097 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1124212207. Oct 17 13:36:45.627097 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:45.627097 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:45.627097 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:45.627097 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:45.627097 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:45.627097 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:45.628245 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:36:45.628245 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:36:45.628245 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:36:45.628245 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:36:45.628245 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:36:45.628245 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:36:45.628245 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 17 13:36:45.628245 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 17 13:36:45.628245 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1124212207. Oct 17 13:36:45.628245 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:45.628245 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:45.628245 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:45.628245 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:45.628245 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:45.628245 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:45.628245 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:36:45.628245 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:36:45.628245 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1124212207. Oct 17 13:36:45.628245 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:45.638111 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d87f3e7f-69da-4b9d-8e3c-3b518e709804 tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] Returning 400 to user: Invalid IP protocol tempest-999-1124212207. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:36:45.640124 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d87f3e7f-69da-4b9d-8e3c-3b518e709804 tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] 10.222.0.79 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.464379 Oct 17 13:36:45.640692 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 423/843] 10.222.0.79 () {60 vars in 1195 bytes} [Mon Oct 17 13:36:45 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 465 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 17 13:36:45.653644 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c40eabbf-cecb-4a99-9f8c-b1e46ecd6427 tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] Action: 'create', calling method: .version_select at 0x7f7cd571fc10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-318257034", "description": "tempest-description-787047997"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:45.908982 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c93583d1-b1d1-4790-957c-3dad06add924 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:45.922851 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c93583d1-b1d1-4790-957c-3dad06add924 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/9e72abb9-d4b5-4c67-8260-2828e3ab5ad2" status: 200 len: 1307 microversion: 2.1 time: 0.774348 Oct 17 13:36:45.924307 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 421/844] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:45 2022] GET /compute/v2.1/servers/9e72abb9-d4b5-4c67-8260-2828e3ab5ad2 => generated 1307 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:45.978589 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-57542c66-1cb0-4c9b-9466-fab6f73bdbcf req-6fbb0f69-48e2-43c7-886c-cc141bc5fa96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a54adf11-ee58-4f13-82c8-9a00a36c536e", "tag": "f261c54a-cf39-4ca3-a4d0-eb2c41dbcbe0"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:45.999855 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-57542c66-1cb0-4c9b-9466-fab6f73bdbcf req-6fbb0f69-48e2-43c7-886c-cc141bc5fa96 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:46.002533 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-57542c66-1cb0-4c9b-9466-fab6f73bdbcf req-6fbb0f69-48e2-43c7-886c-cc141bc5fa96 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:46.003220 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-57542c66-1cb0-4c9b-9466-fab6f73bdbcf req-6fbb0f69-48e2-43c7-886c-cc141bc5fa96 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:46.041173 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-57542c66-1cb0-4c9b-9466-fab6f73bdbcf req-6fbb0f69-48e2-43c7-886c-cc141bc5fa96 service nova] Creating event network-changed:f261c54a-cf39-4ca3-a4d0-eb2c41dbcbe0 for instance a54adf11-ee58-4f13-82c8-9a00a36c536e on n-h1-854247-14 Oct 17 13:36:46.054450 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-57542c66-1cb0-4c9b-9466-fab6f73bdbcf req-6fbb0f69-48e2-43c7-886c-cc141bc5fa96 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079773 Oct 17 13:36:46.055208 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 422/845] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:36:46.209235 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a463abb5-f59a-49cf-8a79-bc11c1046755 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:46.214071 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a463abb5-f59a-49cf-8a79-bc11c1046755 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 8138c4a6-0fa5-4427-a026-56618461dd14] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:46.241268 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a463abb5-f59a-49cf-8a79-bc11c1046755 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:46.243127 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a463abb5-f59a-49cf-8a79-bc11c1046755 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:46.245439 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a463abb5-f59a-49cf-8a79-bc11c1046755 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:46.247247 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a463abb5-f59a-49cf-8a79-bc11c1046755 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:46.249165 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a463abb5-f59a-49cf-8a79-bc11c1046755 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:46.249936 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a463abb5-f59a-49cf-8a79-bc11c1046755 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:46.533185 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c40eabbf-cecb-4a99-9f8c-b1e46ecd6427 tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.884823 Oct 17 13:36:46.534357 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 424/846] 10.222.0.79 () {60 vars in 1180 bytes} [Mon Oct 17 13:36:45 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:46.550602 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0c61f54f-39ff-4291-a2eb-f032bf5b7d5f tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] Action: 'create', calling method: .version_select at 0x7f7cd57309d0>, body: {"security_group_rule": {"parent_group_id": "30484abc-9ff3-4637-aa91-938f3a6c334a", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:46.779578 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-0c61f54f-39ff-4291-a2eb-f032bf5b7d5f tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 17 13:36:46.781186 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0c61f54f-39ff-4291-a2eb-f032bf5b7d5f tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] Request method failure captured: Oct 17 13:36:46.781186 n-d-854247-14 devstack@n-api.service[127017]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 17 13:36:46.781186 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:36:46.781186 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:36:46.781186 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:36:46.781186 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 138 Oct 17 13:36:46.781186 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:36:46.781186 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:36:46.781186 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:36:46.781186 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:36:46.781186 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVphRhzL0EKu3SctdRYydoXpoZVC3Q2uQVpG4rFDIAFuwikD2i8u3MXWLU7iv344Ryav9rQGMK4XLpbWz2uAQ3WSwINLwkBVFOHhIAQbWZNryGBNHXzvUjhirG_OhS8IRJbNVQN9tLzl5GJCEAt1QJn1uph5FlWVnXkwMFqzm-irEk8 Oct 17 13:36:46.781186 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:36:46.781186 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:36:46.781186 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:36:46.781186 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:36:46.781186 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:36:46.781186 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:36:46.781186 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: bc704a85b3274ecf92e14ffb82362b99 Oct 17 13:36:46.781186 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1656695594 Oct 17 13:36:46.781186 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:36:46.781186 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:36:46.782448 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/bc704a85b3274ecf92e14ffb82362b99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/bc704a85b3274ecf92e14ffb82362b99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/bc704a85b3274ecf92e14ffb82362b99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_bc704a85b3274ecf92e14ffb82362b99", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:36:46.782448 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1656695594 Oct 17 13:36:46.782448 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: bc704a85b3274ecf92e14ffb82362b99 Oct 17 13:36:46.782448 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1656695594 Oct 17 13:36:46.782448 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project Oct 17 13:36:46.782448 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:36:46.782448 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:36:46.782448 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 3e45b41f64f249a6949865c8ee4f28ad Oct 17 13:36:46.782448 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project Oct 17 13:36:46.782448 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 13:36:46.782448 n-d-854247-14 devstack@n-api.service[127017]: {"security_group_rule": {"parent_group_id": "30484abc-9ff3-4637-aa91-938f3a6c334a", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 17 13:36:46.782448 n-d-854247-14 devstack@n-api.service[127017]: method: Oct 17 13:36:46.783214 n-d-854247-14 devstack@n-api.service[127017]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 17 13:36:46.783214 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'body': {'security_group_rule': {'parent_group_id': '30484abc-9ff3-4637-aa91-938f3a6c334a', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 17 13:36:46.783214 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:36:46.783214 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:46.783214 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 17 13:36:46.783214 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 17 13:36:46.783214 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 17 13:36:46.783214 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 17 13:36:46.783214 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 17 13:36:46.783214 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 17 13:36:46.783214 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 17 13:36:46.783214 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 17 13:36:46.783214 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 17 13:36:46.783214 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:46.783214 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:46.783214 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:46.783214 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:46.783214 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:46.783214 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:46.784329 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:36:46.784329 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:36:46.784329 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:36:46.784329 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:36:46.784329 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:36:46.784329 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:36:46.784329 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 17 13:36:46.784329 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 17 13:36:46.784329 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 17 13:36:46.784329 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:46.784329 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:46.784329 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:46.784329 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:46.784329 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:46.784329 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:46.784329 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:36:46.784329 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:36:46.784329 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 17 13:36:46.784329 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:46.785605 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0c61f54f-39ff-4291-a2eb-f032bf5b7d5f tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:36:46.785605 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0c61f54f-39ff-4291-a2eb-f032bf5b7d5f tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] 10.222.0.79 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.236075 Oct 17 13:36:46.785605 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 425/847] 10.222.0.79 () {60 vars in 1195 bytes} [Mon Oct 17 13:36:46 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 240 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:36:46.793304 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-eb7b8128-d3f8-42e7-923a-3d1430e1bad3 tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] Action: 'create', calling method: .version_select at 0x7f7cd5a24430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1965382835", "description": "tempest-description-1420993123"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:46.806700 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a463abb5-f59a-49cf-8a79-bc11c1046755 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:46.837794 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a463abb5-f59a-49cf-8a79-bc11c1046755 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/8138c4a6-0fa5-4427-a026-56618461dd14" status: 200 len: 1317 microversion: 2.1 time: 0.640759 Oct 17 13:36:46.840208 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 423/848] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:46 2022] GET /compute/v2.1/servers/8138c4a6-0fa5-4427-a026-56618461dd14 => generated 1317 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:46.952314 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9728c23d-d7ff-4aeb-8260-a1e38e48085a tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:46.953239 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9728c23d-d7ff-4aeb-8260-a1e38e48085a tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 9e72abb9-d4b5-4c67-8260-2828e3ab5ad2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:46.964760 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9728c23d-d7ff-4aeb-8260-a1e38e48085a tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:46.966723 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9728c23d-d7ff-4aeb-8260-a1e38e48085a tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:46.967969 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9728c23d-d7ff-4aeb-8260-a1e38e48085a tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:46.969429 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9728c23d-d7ff-4aeb-8260-a1e38e48085a tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:46.970850 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9728c23d-d7ff-4aeb-8260-a1e38e48085a tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:46.971654 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9728c23d-d7ff-4aeb-8260-a1e38e48085a tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:47.193433 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-eb7b8128-d3f8-42e7-923a-3d1430e1bad3 tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.403859 Oct 17 13:36:47.194155 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 426/849] 10.222.0.79 () {60 vars in 1180 bytes} [Mon Oct 17 13:36:46 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:47.207531 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-85a479b1-a230-430c-8e51-defb75727219 tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] Action: 'create', calling method: .version_select at 0x7f7cd57560d0>, body: {"security_group_rule": {"parent_group_id": "c7b8131b-60ec-4c64-8d8b-b924923a7855", "ip_protocol": "tcp", "from_port": 22, "to_port": 84442015}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:47.374005 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-85a479b1-a230-430c-8e51-defb75727219 tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] HTTP exception thrown: Invalid port range 22:84442015. Valid TCP ports should be between 1-65535 Oct 17 13:36:47.376086 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-85a479b1-a230-430c-8e51-defb75727219 tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] Request method failure captured: Oct 17 13:36:47.376086 n-d-854247-14 devstack@n-api.service[127017]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 17 13:36:47.376086 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:36:47.376086 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:36:47.376086 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:36:47.376086 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 144 Oct 17 13:36:47.376086 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:36:47.376086 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:36:47.376086 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:36:47.376086 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:36:47.376086 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVphRhzL0EKu3SctdRYydoXpoZVC3Q2uQVpG4rFDIAFuwikD2i8u3MXWLU7iv344Ryav9rQGMK4XLpbWz2uAQ3WSwINLwkBVFOHhIAQbWZNryGBNHXzvUjhirG_OhS8IRJbNVQN9tLzl5GJCEAt1QJn1uph5FlWVnXkwMFqzm-irEk8 Oct 17 13:36:47.376086 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:36:47.376086 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:36:47.376086 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:36:47.376086 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:36:47.376086 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:36:47.376086 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:36:47.376086 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: bc704a85b3274ecf92e14ffb82362b99 Oct 17 13:36:47.376086 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1656695594 Oct 17 13:36:47.376086 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:36:47.376086 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:36:47.377612 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/bc704a85b3274ecf92e14ffb82362b99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/bc704a85b3274ecf92e14ffb82362b99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/bc704a85b3274ecf92e14ffb82362b99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_bc704a85b3274ecf92e14ffb82362b99", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:36:47.377612 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1656695594 Oct 17 13:36:47.377612 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: bc704a85b3274ecf92e14ffb82362b99 Oct 17 13:36:47.377612 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1656695594 Oct 17 13:36:47.377612 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project Oct 17 13:36:47.377612 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:36:47.377612 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:36:47.377612 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 3e45b41f64f249a6949865c8ee4f28ad Oct 17 13:36:47.377612 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project Oct 17 13:36:47.377612 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 13:36:47.377612 n-d-854247-14 devstack@n-api.service[127017]: {"security_group_rule": {"parent_group_id": "c7b8131b-60ec-4c64-8d8b-b924923a7855", "ip_protocol": "tcp", "from_port": 22, "to_port": 84442015}} Oct 17 13:36:47.377612 n-d-854247-14 devstack@n-api.service[127017]: method: Oct 17 13:36:47.378335 n-d-854247-14 devstack@n-api.service[127017]: exception: Invalid port range 22:84442015. Valid TCP ports should be between 1-65535 Oct 17 13:36:47.378335 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'c7b8131b-60ec-4c64-8d8b-b924923a7855', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 84442015}}} Oct 17 13:36:47.378335 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:36:47.378335 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:47.378335 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 17 13:36:47.378335 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 17 13:36:47.378335 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 17 13:36:47.378335 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 17 13:36:47.378335 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 17 13:36:47.378335 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 17 13:36:47.378335 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 17 13:36:47.378335 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 17 13:36:47.378335 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:84442015. Valid TCP ports should be between 1-65535 Oct 17 13:36:47.378335 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:47.378335 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:47.378335 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:47.378335 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:47.378335 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:47.378335 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:47.379988 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:36:47.379988 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:36:47.379988 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:36:47.379988 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:36:47.379988 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:36:47.379988 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:36:47.379988 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 17 13:36:47.379988 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 17 13:36:47.379988 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:84442015. Valid TCP ports should be between 1-65535 Oct 17 13:36:47.379988 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:47.379988 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:47.379988 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:47.379988 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:47.379988 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:47.379988 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:47.379988 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:36:47.379988 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:36:47.379988 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:84442015. Valid TCP ports should be between 1-65535 Oct 17 13:36:47.379988 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:47.384060 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-85a479b1-a230-430c-8e51-defb75727219 tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] Returning 400 to user: Invalid port range 22:84442015. Valid TCP ports should be between 1-65535 {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:36:47.385522 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-85a479b1-a230-430c-8e51-defb75727219 tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] 10.222.0.79 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 117 microversion: 2.1 time: 0.182169 Oct 17 13:36:47.391341 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 427/850] 10.222.0.79 () {60 vars in 1195 bytes} [Mon Oct 17 13:36:47 2022] POST /compute/v2.1/os-security-group-rules => generated 117 bytes in 188 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 17 13:36:47.399314 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bc06a5e1-9ad7-4d7b-bd4d-5d2172b58d01 tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] Action: 'create', calling method: .version_select at 0x7f7cd57915e0>, body: {"security_group_rule": {"parent_group_id": "b06c4553-0bac-451d-a1e9-5526194ca27c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:47.421410 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9728c23d-d7ff-4aeb-8260-a1e38e48085a tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:47.435945 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9728c23d-d7ff-4aeb-8260-a1e38e48085a tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/9e72abb9-d4b5-4c67-8260-2828e3ab5ad2" status: 200 len: 1307 microversion: 2.1 time: 0.487942 Oct 17 13:36:47.437805 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 424/851] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:46 2022] GET /compute/v2.1/servers/9e72abb9-d4b5-4c67-8260-2828e3ab5ad2 => generated 1307 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:47.522642 n-d-854247-14 devstack@n-api.service[127017]: DEBUG neutronclient.v2_0.client [None req-bc06a5e1-9ad7-4d7b-bd4d-5d2172b58d01 tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b06c4553-0bac-451d-a1e9-5526194ca27c does not exist", "detail": ""}} {{(pid=127017) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 13:36:47.523399 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.security_group_api [None req-bc06a5e1-9ad7-4d7b-bd4d-5d2172b58d01 tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] Neutron security group b06c4553-0bac-451d-a1e9-5526194ca27c not found {{(pid=127017) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 17 13:36:47.524350 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-bc06a5e1-9ad7-4d7b-bd4d-5d2172b58d01 tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] HTTP exception thrown: Security group b06c4553-0bac-451d-a1e9-5526194ca27c does not exist Oct 17 13:36:47.524350 n-d-854247-14 devstack@n-api.service[127017]: Neutron server returns request_ids: ['req-61310f81-2763-4650-81ce-9606024ba9bf'] Oct 17 13:36:47.527416 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bc06a5e1-9ad7-4d7b-bd4d-5d2172b58d01 tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] Request method failure captured: Oct 17 13:36:47.527416 n-d-854247-14 devstack@n-api.service[127017]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 17 13:36:47.527416 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:36:47.527416 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:36:47.527416 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:36:47.527416 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 138 Oct 17 13:36:47.527416 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:36:47.527416 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:36:47.527416 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:36:47.527416 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:36:47.527416 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVphRhzL0EKu3SctdRYydoXpoZVC3Q2uQVpG4rFDIAFuwikD2i8u3MXWLU7iv344Ryav9rQGMK4XLpbWz2uAQ3WSwINLwkBVFOHhIAQbWZNryGBNHXzvUjhirG_OhS8IRJbNVQN9tLzl5GJCEAt1QJn1uph5FlWVnXkwMFqzm-irEk8 Oct 17 13:36:47.527416 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:36:47.527416 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:36:47.527416 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:36:47.527416 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:36:47.527416 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:36:47.527416 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:36:47.527416 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: bc704a85b3274ecf92e14ffb82362b99 Oct 17 13:36:47.527416 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1656695594 Oct 17 13:36:47.527416 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:36:47.527416 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:36:47.529073 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/bc704a85b3274ecf92e14ffb82362b99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/bc704a85b3274ecf92e14ffb82362b99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/bc704a85b3274ecf92e14ffb82362b99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_bc704a85b3274ecf92e14ffb82362b99", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:36:47.529073 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1656695594 Oct 17 13:36:47.529073 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: bc704a85b3274ecf92e14ffb82362b99 Oct 17 13:36:47.529073 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1656695594 Oct 17 13:36:47.529073 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project Oct 17 13:36:47.529073 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:36:47.529073 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:36:47.529073 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 3e45b41f64f249a6949865c8ee4f28ad Oct 17 13:36:47.529073 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project Oct 17 13:36:47.529073 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 13:36:47.529073 n-d-854247-14 devstack@n-api.service[127017]: {"security_group_rule": {"parent_group_id": "b06c4553-0bac-451d-a1e9-5526194ca27c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 17 13:36:47.529073 n-d-854247-14 devstack@n-api.service[127017]: method: Oct 17 13:36:47.529987 n-d-854247-14 devstack@n-api.service[127017]: exception: Security group b06c4553-0bac-451d-a1e9-5526194ca27c does not exist Oct 17 13:36:47.529987 n-d-854247-14 devstack@n-api.service[127017]: Neutron server returns request_ids: ['req-61310f81-2763-4650-81ce-9606024ba9bf'] Oct 17 13:36:47.529987 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'b06c4553-0bac-451d-a1e9-5526194ca27c', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 17 13:36:47.529987 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:36:47.529987 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:47.529987 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 17 13:36:47.529987 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 17 13:36:47.529987 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:36:47.529987 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:36:47.529987 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 17 13:36:47.529987 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 17 13:36:47.529987 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:36:47.529987 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:36:47.529987 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 13:36:47.529987 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 13:36:47.529987 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:36:47.529987 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:36:47.529987 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 13:36:47.529987 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 13:36:47.531570 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:36:47.531570 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:36:47.531570 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 13:36:47.531570 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 13:36:47.531570 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:36:47.531570 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:36:47.531570 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 13:36:47.531570 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 13:36:47.531570 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 13:36:47.531570 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 13:36:47.531570 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b06c4553-0bac-451d-a1e9-5526194ca27c does not exist Oct 17 13:36:47.531570 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-61310f81-2763-4650-81ce-9606024ba9bf'] Oct 17 13:36:47.531570 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:47.531570 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:47.531570 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:47.531570 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:47.531570 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 17 13:36:47.531570 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 17 13:36:47.531570 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 17 13:36:47.533953 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 13:36:47.533953 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b06c4553-0bac-451d-a1e9-5526194ca27c does not exist Oct 17 13:36:47.533953 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-61310f81-2763-4650-81ce-9606024ba9bf'] Oct 17 13:36:47.533953 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:47.533953 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:47.533953 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:47.533953 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:47.533953 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:47.533953 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:47.533953 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:36:47.533953 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:36:47.533953 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:36:47.533953 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:36:47.533953 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:36:47.533953 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:36:47.533953 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 17 13:36:47.533953 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 17 13:36:47.533953 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b06c4553-0bac-451d-a1e9-5526194ca27c does not exist Oct 17 13:36:47.533953 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-61310f81-2763-4650-81ce-9606024ba9bf'] Oct 17 13:36:47.533953 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:47.535687 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:47.535687 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:47.535687 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:47.535687 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:47.535687 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:47.535687 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:36:47.535687 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:36:47.535687 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b06c4553-0bac-451d-a1e9-5526194ca27c does not exist Oct 17 13:36:47.535687 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-61310f81-2763-4650-81ce-9606024ba9bf'] Oct 17 13:36:47.535687 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:47.535687 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bc06a5e1-9ad7-4d7b-bd4d-5d2172b58d01 tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] Returning 404 to user: Security group b06c4553-0bac-451d-a1e9-5526194ca27c does not exist Oct 17 13:36:47.535687 n-d-854247-14 devstack@n-api.service[127017]: Neutron server returns request_ids: ['req-61310f81-2763-4650-81ce-9606024ba9bf'] {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:36:47.535687 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-bc06a5e1-9ad7-4d7b-bd4d-5d2172b58d01 tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] 10.222.0.79 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.140964 Oct 17 13:36:47.540449 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 428/852] 10.222.0.79 () {60 vars in 1195 bytes} [Mon Oct 17 13:36:47 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:36:47.545325 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e58866b2-6d2f-47aa-81b9-16c94fec298f tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] Calling method '.version_select at 0x7f7cd56aaee0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:47.587592 n-d-854247-14 devstack@n-api.service[127016]: DEBUG neutronclient.v2_0.client [None req-e58866b2-6d2f-47aa-81b9-16c94fec298f tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule d9f97731-22c9-4868-a074-76decc8d9ef3 does not exist", "detail": ""}} {{(pid=127016) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 13:36:47.588207 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.security_group_api [None req-e58866b2-6d2f-47aa-81b9-16c94fec298f tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] Neutron security group rule d9f97731-22c9-4868-a074-76decc8d9ef3 not found {{(pid=127016) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 17 13:36:47.588727 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-e58866b2-6d2f-47aa-81b9-16c94fec298f tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] HTTP exception thrown: Security group rule d9f97731-22c9-4868-a074-76decc8d9ef3 does not exist Oct 17 13:36:47.588727 n-d-854247-14 devstack@n-api.service[127016]: Neutron server returns request_ids: ['req-c5ce8137-9029-4af4-b9b6-cf9b23438e6f'] Oct 17 13:36:47.591353 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e58866b2-6d2f-47aa-81b9-16c94fec298f tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] Request method failure captured: Oct 17 13:36:47.591353 n-d-854247-14 devstack@n-api.service[127016]: request: DELETE /compute/v2.1/os-security-group-rules/d9f97731-22c9-4868-a074-76decc8d9ef3 HTTP/1.1 Oct 17 13:36:47.591353 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:36:47.591353 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:36:47.591353 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:36:47.591353 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:36:47.591353 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:36:47.591353 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:36:47.591353 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:36:47.591353 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:36:47.591353 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVphRhzL0EKu3SctdRYydoXpoZVC3Q2uQVpG4rFDIAFuwikD2i8u3MXWLU7iv344Ryav9rQGMK4XLpbWz2uAQ3WSwINLwkBVFOHhIAQbWZNryGBNHXzvUjhirG_OhS8IRJbNVQN9tLzl5GJCEAt1QJn1uph5FlWVnXkwMFqzm-irEk8 Oct 17 13:36:47.591353 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:36:47.591353 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:36:47.591353 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:36:47.591353 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:36:47.591353 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:36:47.591353 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:36:47.591353 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: bc704a85b3274ecf92e14ffb82362b99 Oct 17 13:36:47.591353 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1656695594 Oct 17 13:36:47.591353 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:36:47.591353 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:36:47.592907 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/bc704a85b3274ecf92e14ffb82362b99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/bc704a85b3274ecf92e14ffb82362b99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/bc704a85b3274ecf92e14ffb82362b99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_bc704a85b3274ecf92e14ffb82362b99", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:36:47.592907 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1656695594 Oct 17 13:36:47.592907 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: bc704a85b3274ecf92e14ffb82362b99 Oct 17 13:36:47.592907 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1656695594 Oct 17 13:36:47.592907 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project Oct 17 13:36:47.592907 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:36:47.592907 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:36:47.592907 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 3e45b41f64f249a6949865c8ee4f28ad Oct 17 13:36:47.592907 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project Oct 17 13:36:47.592907 n-d-854247-14 devstack@n-api.service[127016]: method: Oct 17 13:36:47.592907 n-d-854247-14 devstack@n-api.service[127016]: exception: Security group rule d9f97731-22c9-4868-a074-76decc8d9ef3 does not exist Oct 17 13:36:47.592907 n-d-854247-14 devstack@n-api.service[127016]: Neutron server returns request_ids: ['req-c5ce8137-9029-4af4-b9b6-cf9b23438e6f'] Oct 17 13:36:47.593868 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'd9f97731-22c9-4868-a074-76decc8d9ef3'} Oct 17 13:36:47.593868 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:36:47.593868 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:47.593868 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 17 13:36:47.593868 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 17 13:36:47.593868 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:36:47.593868 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:36:47.593868 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 17 13:36:47.593868 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 17 13:36:47.593868 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:36:47.593868 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:36:47.593868 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 13:36:47.593868 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 13:36:47.593868 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:36:47.593868 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:36:47.593868 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 13:36:47.593868 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 13:36:47.593868 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:36:47.593868 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:36:47.594978 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 13:36:47.594978 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 13:36:47.594978 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:36:47.594978 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:36:47.594978 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 13:36:47.594978 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 13:36:47.594978 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 13:36:47.594978 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 13:36:47.594978 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule d9f97731-22c9-4868-a074-76decc8d9ef3 does not exist Oct 17 13:36:47.594978 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c5ce8137-9029-4af4-b9b6-cf9b23438e6f'] Oct 17 13:36:47.594978 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:36:47.594978 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:47.594978 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:36:47.594978 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:47.594978 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 17 13:36:47.594978 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 17 13:36:47.594978 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 17 13:36:47.594978 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 13:36:47.605419 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule d9f97731-22c9-4868-a074-76decc8d9ef3 does not exist Oct 17 13:36:47.605419 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c5ce8137-9029-4af4-b9b6-cf9b23438e6f'] Oct 17 13:36:47.605419 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:36:47.605419 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:47.605419 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:36:47.605419 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:47.605419 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:47.605419 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:47.605419 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:36:47.605419 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:36:47.605419 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:36:47.605419 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:36:47.605419 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:36:47.605419 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:36:47.605419 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 17 13:36:47.605419 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 17 13:36:47.605419 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule d9f97731-22c9-4868-a074-76decc8d9ef3 does not exist Oct 17 13:36:47.605419 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c5ce8137-9029-4af4-b9b6-cf9b23438e6f'] Oct 17 13:36:47.605419 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:36:47.605419 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:47.607093 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:36:47.607093 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:47.607093 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:47.607093 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:47.607093 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:36:47.607093 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:36:47.607093 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule d9f97731-22c9-4868-a074-76decc8d9ef3 does not exist Oct 17 13:36:47.607093 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c5ce8137-9029-4af4-b9b6-cf9b23438e6f'] Oct 17 13:36:47.607093 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:36:47.607093 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e58866b2-6d2f-47aa-81b9-16c94fec298f tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] Returning 404 to user: Security group rule d9f97731-22c9-4868-a074-76decc8d9ef3 does not exist Oct 17 13:36:47.607093 n-d-854247-14 devstack@n-api.service[127016]: Neutron server returns request_ids: ['req-c5ce8137-9029-4af4-b9b6-cf9b23438e6f'] {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:36:47.607093 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e58866b2-6d2f-47aa-81b9-16c94fec298f tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-group-rules/d9f97731-22c9-4868-a074-76decc8d9ef3" status: 404 len: 199 microversion: 2.1 time: 0.051946 Oct 17 13:36:47.608293 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 425/853] 10.222.0.79 () {58 vars in 1287 bytes} [Mon Oct 17 13:36:47 2022] DELETE /compute/v2.1/os-security-group-rules/d9f97731-22c9-4868-a074-76decc8d9ef3 => generated 199 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:36:47.616342 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2994798b-6b66-4b93-abbb-c64df87e4583 tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] Calling method '.version_select at 0x7f7cd5791820>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:47.861679 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3c7d7b41-f84c-45cf-8293-ff64b6095388 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:47.862562 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3c7d7b41-f84c-45cf-8293-ff64b6095388 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 8138c4a6-0fa5-4427-a026-56618461dd14] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:47.876470 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3c7d7b41-f84c-45cf-8293-ff64b6095388 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:47.877466 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3c7d7b41-f84c-45cf-8293-ff64b6095388 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:47.884305 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3c7d7b41-f84c-45cf-8293-ff64b6095388 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:47.887609 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3c7d7b41-f84c-45cf-8293-ff64b6095388 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:47.888297 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3c7d7b41-f84c-45cf-8293-ff64b6095388 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:47.888970 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3c7d7b41-f84c-45cf-8293-ff64b6095388 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:48.157491 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2994798b-6b66-4b93-abbb-c64df87e4583 tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/c7b8131b-60ec-4c64-8d8b-b924923a7855" status: 202 len: 0 microversion: 2.1 time: 0.558961 Oct 17 13:36:48.158330 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 429/854] 10.222.0.79 () {58 vars in 1272 bytes} [Mon Oct 17 13:36:47 2022] DELETE /compute/v2.1/os-security-groups/c7b8131b-60ec-4c64-8d8b-b924923a7855 => generated 0 bytes in 560 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:36:48.167142 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b1da8b88-99bb-40be-84c2-6bc77662be4a tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] Calling method '.version_select at 0x7f7cd5791430>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:48.333252 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3c7d7b41-f84c-45cf-8293-ff64b6095388 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:48.346726 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3c7d7b41-f84c-45cf-8293-ff64b6095388 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/8138c4a6-0fa5-4427-a026-56618461dd14" status: 200 len: 1317 microversion: 2.1 time: 0.487545 Oct 17 13:36:48.347355 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 426/855] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:47 2022] GET /compute/v2.1/servers/8138c4a6-0fa5-4427-a026-56618461dd14 => generated 1317 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:48.464831 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a12a8444-db87-4dca-93db-00e0b5e8258d tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:48.465544 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a12a8444-db87-4dca-93db-00e0b5e8258d tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 9e72abb9-d4b5-4c67-8260-2828e3ab5ad2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:48.483724 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a12a8444-db87-4dca-93db-00e0b5e8258d tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:48.484978 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a12a8444-db87-4dca-93db-00e0b5e8258d tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:48.487304 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a12a8444-db87-4dca-93db-00e0b5e8258d tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:48.488185 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a12a8444-db87-4dca-93db-00e0b5e8258d tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:48.490772 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a12a8444-db87-4dca-93db-00e0b5e8258d tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:48.492186 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a12a8444-db87-4dca-93db-00e0b5e8258d tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:48.707823 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b1da8b88-99bb-40be-84c2-6bc77662be4a tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/30484abc-9ff3-4637-aa91-938f3a6c334a" status: 202 len: 0 microversion: 2.1 time: 0.544649 Oct 17 13:36:48.709064 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 430/856] 10.222.0.79 () {58 vars in 1272 bytes} [Mon Oct 17 13:36:48 2022] DELETE /compute/v2.1/os-security-groups/30484abc-9ff3-4637-aa91-938f3a6c334a => generated 0 bytes in 547 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:36:48.718928 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9ae2d365-e0f4-440c-b0f2-426f13016612 tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] Calling method '.version_select at 0x7f7cd5756b80>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:48.873162 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a12a8444-db87-4dca-93db-00e0b5e8258d tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:48.884416 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a12a8444-db87-4dca-93db-00e0b5e8258d tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/9e72abb9-d4b5-4c67-8260-2828e3ab5ad2" status: 200 len: 1307 microversion: 2.1 time: 0.424064 Oct 17 13:36:48.899150 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 427/857] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:48 2022] GET /compute/v2.1/servers/9e72abb9-d4b5-4c67-8260-2828e3ab5ad2 => generated 1307 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:36:49.044715 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9ae2d365-e0f4-440c-b0f2-426f13016612 tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/50165fb7-d2a2-46c7-afc4-b743a1dfaf22" status: 202 len: 0 microversion: 2.1 time: 0.331080 Oct 17 13:36:49.045910 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 431/858] 10.222.0.79 () {58 vars in 1272 bytes} [Mon Oct 17 13:36:48 2022] DELETE /compute/v2.1/os-security-groups/50165fb7-d2a2-46c7-afc4-b743a1dfaf22 => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:36:49.055967 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6ebe16b5-860f-42c6-a2cb-e7757d179c11 tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] Calling method '.version_select at 0x7f7cd5639dc0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:49.140237 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-ea0c1d1e-1e85-4709-ac0d-66cc1e55cabf req-57948e46-de10-4b05-a16b-c6e9d32aa9fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8138c4a6-0fa5-4427-a026-56618461dd14", "name": "network-vif-plugged", "status": "completed", "tag": "46def99d-baf2-40aa-8eb4-982b1afb28b7"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:49.156369 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-ea0c1d1e-1e85-4709-ac0d-66cc1e55cabf req-57948e46-de10-4b05-a16b-c6e9d32aa9fb service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:49.157338 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-ea0c1d1e-1e85-4709-ac0d-66cc1e55cabf req-57948e46-de10-4b05-a16b-c6e9d32aa9fb service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:49.158032 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-ea0c1d1e-1e85-4709-ac0d-66cc1e55cabf req-57948e46-de10-4b05-a16b-c6e9d32aa9fb service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:49.172695 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-ea0c1d1e-1e85-4709-ac0d-66cc1e55cabf req-57948e46-de10-4b05-a16b-c6e9d32aa9fb service nova] Creating event network-vif-plugged:46def99d-baf2-40aa-8eb4-982b1afb28b7 for instance 8138c4a6-0fa5-4427-a026-56618461dd14 on n-h1-854247-14 Oct 17 13:36:49.189700 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-ea0c1d1e-1e85-4709-ac0d-66cc1e55cabf req-57948e46-de10-4b05-a16b-c6e9d32aa9fb service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057239 Oct 17 13:36:49.190909 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 432/859] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:36:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:36:49.371390 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3f1ef3e9-52e4-4582-b82c-d60256de6c14 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:49.372092 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3f1ef3e9-52e4-4582-b82c-d60256de6c14 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 8138c4a6-0fa5-4427-a026-56618461dd14] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:49.389168 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f1ef3e9-52e4-4582-b82c-d60256de6c14 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:49.391675 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f1ef3e9-52e4-4582-b82c-d60256de6c14 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:49.393777 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f1ef3e9-52e4-4582-b82c-d60256de6c14 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:49.395731 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f1ef3e9-52e4-4582-b82c-d60256de6c14 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:49.398545 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f1ef3e9-52e4-4582-b82c-d60256de6c14 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:49.399290 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f1ef3e9-52e4-4582-b82c-d60256de6c14 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:49.439404 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6ebe16b5-860f-42c6-a2cb-e7757d179c11 tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/618df2b2-4de4-42ca-a06e-32fe69076263" status: 202 len: 0 microversion: 2.1 time: 0.389344 Oct 17 13:36:49.443436 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 428/860] 10.222.0.79 () {58 vars in 1272 bytes} [Mon Oct 17 13:36:49 2022] DELETE /compute/v2.1/os-security-groups/618df2b2-4de4-42ca-a06e-32fe69076263 => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:36:49.449880 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a3a6ddd1-63af-429b-8c79-46ba833f5eeb tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] Calling method '.version_select at 0x7f7cd56888b0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:49.682117 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3f1ef3e9-52e4-4582-b82c-d60256de6c14 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:49.695011 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3f1ef3e9-52e4-4582-b82c-d60256de6c14 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/8138c4a6-0fa5-4427-a026-56618461dd14" status: 200 len: 1317 microversion: 2.1 time: 0.328258 Oct 17 13:36:49.696991 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 433/861] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:49 2022] GET /compute/v2.1/servers/8138c4a6-0fa5-4427-a026-56618461dd14 => generated 1317 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:36:49.885892 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a3a6ddd1-63af-429b-8c79-46ba833f5eeb tempest-SecurityGroupRulesNegativeTestJSON-1656695594 tempest-SecurityGroupRulesNegativeTestJSON-1656695594-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/ae72bbe3-a962-4bba-b65a-ef96a1a2abc2" status: 202 len: 0 microversion: 2.1 time: 0.440637 Oct 17 13:36:49.889247 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 429/862] 10.222.0.79 () {58 vars in 1272 bytes} [Mon Oct 17 13:36:49 2022] DELETE /compute/v2.1/os-security-groups/ae72bbe3-a962-4bba-b65a-ef96a1a2abc2 => generated 0 bytes in 442 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:36:49.906923 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-08a81887-aaa3-4dda-b240-53a51de9d3e6 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:49.908206 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-08a81887-aaa3-4dda-b240-53a51de9d3e6 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 9e72abb9-d4b5-4c67-8260-2828e3ab5ad2] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:49.917451 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-08a81887-aaa3-4dda-b240-53a51de9d3e6 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:49.918311 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-08a81887-aaa3-4dda-b240-53a51de9d3e6 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:49.922901 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-08a81887-aaa3-4dda-b240-53a51de9d3e6 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:49.924588 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-08a81887-aaa3-4dda-b240-53a51de9d3e6 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:49.925531 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-08a81887-aaa3-4dda-b240-53a51de9d3e6 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:49.927082 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-08a81887-aaa3-4dda-b240-53a51de9d3e6 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:50.117659 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-08a81887-aaa3-4dda-b240-53a51de9d3e6 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:50.128362 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-08a81887-aaa3-4dda-b240-53a51de9d3e6 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/9e72abb9-d4b5-4c67-8260-2828e3ab5ad2" status: 200 len: 1307 microversion: 2.1 time: 0.225690 Oct 17 13:36:50.130399 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 434/863] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:49 2022] GET /compute/v2.1/servers/9e72abb9-d4b5-4c67-8260-2828e3ab5ad2 => generated 1307 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:50.724394 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b04a665e-c85c-4eed-b196-4fa91d9a8836 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:50.725372 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b04a665e-c85c-4eed-b196-4fa91d9a8836 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 8138c4a6-0fa5-4427-a026-56618461dd14] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:50.746905 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b04a665e-c85c-4eed-b196-4fa91d9a8836 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:50.747620 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b04a665e-c85c-4eed-b196-4fa91d9a8836 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:50.748210 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b04a665e-c85c-4eed-b196-4fa91d9a8836 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:50.750722 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b04a665e-c85c-4eed-b196-4fa91d9a8836 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:50.753218 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b04a665e-c85c-4eed-b196-4fa91d9a8836 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:50.754221 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b04a665e-c85c-4eed-b196-4fa91d9a8836 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:51.155715 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-519e5cf5-e371-4082-ae12-6dd6a49053e9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:51.157231 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-519e5cf5-e371-4082-ae12-6dd6a49053e9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 9e72abb9-d4b5-4c67-8260-2828e3ab5ad2] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:51.165687 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-519e5cf5-e371-4082-ae12-6dd6a49053e9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:51.167020 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-519e5cf5-e371-4082-ae12-6dd6a49053e9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:51.167704 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-519e5cf5-e371-4082-ae12-6dd6a49053e9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:51.168563 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-519e5cf5-e371-4082-ae12-6dd6a49053e9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:51.169317 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-519e5cf5-e371-4082-ae12-6dd6a49053e9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:51.169994 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-519e5cf5-e371-4082-ae12-6dd6a49053e9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:51.677571 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b04a665e-c85c-4eed-b196-4fa91d9a8836 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:51.693928 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b04a665e-c85c-4eed-b196-4fa91d9a8836 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/8138c4a6-0fa5-4427-a026-56618461dd14" status: 200 len: 1467 microversion: 2.1 time: 0.974936 Oct 17 13:36:51.699583 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 430/864] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:50 2022] GET /compute/v2.1/servers/8138c4a6-0fa5-4427-a026-56618461dd14 => generated 1467 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:51.705178 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-8dba2aee-f5c0-4c2d-9304-93124718aa1c req-81b03cbb-05eb-4874-b976-fc88b6f7ef1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e72abb9-d4b5-4c67-8260-2828e3ab5ad2", "name": "network-vif-plugged", "status": "completed", "tag": "1ff9eaee-9a81-45c4-aac7-0297656e1256"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:51.739835 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-8dba2aee-f5c0-4c2d-9304-93124718aa1c req-81b03cbb-05eb-4874-b976-fc88b6f7ef1e service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:51.750574 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-8dba2aee-f5c0-4c2d-9304-93124718aa1c req-81b03cbb-05eb-4874-b976-fc88b6f7ef1e service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:51.751391 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-8dba2aee-f5c0-4c2d-9304-93124718aa1c req-81b03cbb-05eb-4874-b976-fc88b6f7ef1e service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:51.769337 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-8dba2aee-f5c0-4c2d-9304-93124718aa1c req-81b03cbb-05eb-4874-b976-fc88b6f7ef1e service nova] Creating event network-vif-plugged:1ff9eaee-9a81-45c4-aac7-0297656e1256 for instance 9e72abb9-d4b5-4c67-8260-2828e3ab5ad2 on n-h2-854247-14 Oct 17 13:36:51.788428 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-8dba2aee-f5c0-4c2d-9304-93124718aa1c req-81b03cbb-05eb-4874-b976-fc88b6f7ef1e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087191 Oct 17 13:36:51.793004 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 431/865] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:36:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:51.825023 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0c7f5757-b46b-4350-95d7-ef47e83f74ee tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:51.847029 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0c7f5757-b46b-4350-95d7-ef47e83f74ee tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] [instance: 8138c4a6-0fa5-4427-a026-56618461dd14] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:51.866362 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0c7f5757-b46b-4350-95d7-ef47e83f74ee tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:51.867138 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0c7f5757-b46b-4350-95d7-ef47e83f74ee tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:51.871356 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0c7f5757-b46b-4350-95d7-ef47e83f74ee tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:51.876159 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0c7f5757-b46b-4350-95d7-ef47e83f74ee tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:51.877030 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0c7f5757-b46b-4350-95d7-ef47e83f74ee tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:51.877714 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0c7f5757-b46b-4350-95d7-ef47e83f74ee tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:51.878702 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-519e5cf5-e371-4082-ae12-6dd6a49053e9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:51.894483 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-519e5cf5-e371-4082-ae12-6dd6a49053e9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/9e72abb9-d4b5-4c67-8260-2828e3ab5ad2" status: 200 len: 1307 microversion: 2.1 time: 0.738966 Oct 17 13:36:51.899524 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 435/866] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:51 2022] GET /compute/v2.1/servers/9e72abb9-d4b5-4c67-8260-2828e3ab5ad2 => generated 1307 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:36:52.350565 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c448e6cc-d345-4292-a4ba-a056a3e7a630 tempest-QuotasAdminNegativeTest-1130001571 tempest-QuotasAdminNegativeTest-1130001571-project-admin] Calling method '.version_select at 0x7f7cd5a24280>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:52.411186 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0c7f5757-b46b-4350-95d7-ef47e83f74ee tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/8138c4a6-0fa5-4427-a026-56618461dd14" status: 200 len: 1620 microversion: 2.1 time: 0.616272 Oct 17 13:36:52.413584 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 432/867] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:51 2022] GET /compute/v2.1/servers/8138c4a6-0fa5-4427-a026-56618461dd14 => generated 1620 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:52.481741 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c448e6cc-d345-4292-a4ba-a056a3e7a630 tempest-QuotasAdminNegativeTest-1130001571 tempest-QuotasAdminNegativeTest-1130001571-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/5d803a93e38d42deace52c7267f56fa2" status: 200 len: 371 microversion: 2.1 time: 0.571194 Oct 17 13:36:52.483654 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 436/868] 10.222.0.79 () {58 vars in 1242 bytes} [Mon Oct 17 13:36:51 2022] GET /compute/v2.1/os-quota-sets/5d803a93e38d42deace52c7267f56fa2 => generated 371 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:52.496841 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-23b98975-5a45-443b-ad02-2d08b631afe1 tempest-QuotasAdminNegativeTest-1130001571 tempest-QuotasAdminNegativeTest-1130001571-project-admin] Action: 'update', calling method: .version_select at 0x7f7cd5688790>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:52.688631 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ff115dfa-8475-47e0-9bfa-ba9ce6e74d27 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-492763071", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["32728e12-4f3f-4f72-902c-10349708549f"]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:52.810675 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-ff115dfa-8475-47e0-9bfa-ba9ce6e74d27 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] validate_networks() for None {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:36:52.985953 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-23b98975-5a45-443b-ad02-2d08b631afe1 tempest-QuotasAdminNegativeTest-1130001571 tempest-QuotasAdminNegativeTest-1130001571-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:52.986574 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-23b98975-5a45-443b-ad02-2d08b631afe1 tempest-QuotasAdminNegativeTest-1130001571 tempest-QuotasAdminNegativeTest-1130001571-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:52.986882 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-23b98975-5a45-443b-ad02-2d08b631afe1 tempest-QuotasAdminNegativeTest-1130001571 tempest-QuotasAdminNegativeTest-1130001571-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:52.987668 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-23b98975-5a45-443b-ad02-2d08b631afe1 tempest-QuotasAdminNegativeTest-1130001571 tempest-QuotasAdminNegativeTest-1130001571-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:52.990737 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-23b98975-5a45-443b-ad02-2d08b631afe1 tempest-QuotasAdminNegativeTest-1130001571 tempest-QuotasAdminNegativeTest-1130001571-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:52.996984 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-23b98975-5a45-443b-ad02-2d08b631afe1 tempest-QuotasAdminNegativeTest-1130001571 tempest-QuotasAdminNegativeTest-1130001571-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:53.023414 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=100 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:36:53.097845 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-23b98975-5a45-443b-ad02-2d08b631afe1 tempest-QuotasAdminNegativeTest-1130001571 tempest-QuotasAdminNegativeTest-1130001571-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-sets/5d803a93e38d42deace52c7267f56fa2" status: 200 len: 328 microversion: 2.1 time: 0.606465 Oct 17 13:36:53.110745 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 433/869] 10.222.0.79 () {60 vars in 1262 bytes} [Mon Oct 17 13:36:52 2022] PUT /compute/v2.1/os-quota-sets/5d803a93e38d42deace52c7267f56fa2 => generated 328 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:53.114665 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2de20b31-4612-450d-9d41-bcfdb91ef1c5 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:53.115628 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2de20b31-4612-450d-9d41-bcfdb91ef1c5 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 9e72abb9-d4b5-4c67-8260-2828e3ab5ad2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:53.122725 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2de20b31-4612-450d-9d41-bcfdb91ef1c5 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:53.123218 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2de20b31-4612-450d-9d41-bcfdb91ef1c5 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:53.123788 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2de20b31-4612-450d-9d41-bcfdb91ef1c5 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:53.124505 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2de20b31-4612-450d-9d41-bcfdb91ef1c5 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:53.124960 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2de20b31-4612-450d-9d41-bcfdb91ef1c5 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:53.125406 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2de20b31-4612-450d-9d41-bcfdb91ef1c5 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:53.539648 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2de20b31-4612-450d-9d41-bcfdb91ef1c5 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:53.548899 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2de20b31-4612-450d-9d41-bcfdb91ef1c5 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/9e72abb9-d4b5-4c67-8260-2828e3ab5ad2" status: 200 len: 1307 microversion: 2.1 time: 0.448700 Oct 17 13:36:53.558463 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 434/870] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:53 2022] GET /compute/v2.1/servers/9e72abb9-d4b5-4c67-8260-2828e3ab5ad2 => generated 1307 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:53.727011 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-ff115dfa-8475-47e0-9bfa-ba9ce6e74d27 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:36:53.727606 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-ff115dfa-8475-47e0-9bfa-ba9ce6e74d27 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:36:53.727717 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-ff115dfa-8475-47e0-9bfa-ba9ce6e74d27 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:36:53.728457 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-ff115dfa-8475-47e0-9bfa-ba9ce6e74d27 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:36:53.729006 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-ff115dfa-8475-47e0-9bfa-ba9ce6e74d27 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:36:53.746217 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ff115dfa-8475-47e0-9bfa-ba9ce6e74d27 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:53.746729 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ff115dfa-8475-47e0-9bfa-ba9ce6e74d27 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:53.747185 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ff115dfa-8475-47e0-9bfa-ba9ce6e74d27 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:53.747936 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ff115dfa-8475-47e0-9bfa-ba9ce6e74d27 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:53.750570 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ff115dfa-8475-47e0-9bfa-ba9ce6e74d27 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:53.751008 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ff115dfa-8475-47e0-9bfa-ba9ce6e74d27 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:53.791720 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-ff115dfa-8475-47e0-9bfa-ba9ce6e74d27 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Getting quotas for project fa1db260a96a4c6aa69cd6437baab6f7. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:36:53.802372 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-ff115dfa-8475-47e0-9bfa-ba9ce6e74d27 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Getting quotas for user 7a7e082035084338966a1c56b30c7093 and project fa1db260a96a4c6aa69cd6437baab6f7. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:36:53.830968 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ff115dfa-8475-47e0-9bfa-ba9ce6e74d27 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:36:53.841667 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ff115dfa-8475-47e0-9bfa-ba9ce6e74d27 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: fe214f31-2995-4475-bcb7-ae4cec33a6f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:36:53.918893 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c722c01c-dc5b-4220-bf24-0009a9fcb6f1 tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1027081780", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:53.948257 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ff115dfa-8475-47e0-9bfa-ba9ce6e74d27 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.265602 Oct 17 13:36:53.949207 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 437/871] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:36:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1267 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:36:54.043319 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-c722c01c-dc5b-4220-bf24-0009a9fcb6f1 tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] validate_networks() for None {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:36:54.070447 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f7bae6ba-4bdf-456b-99e9-a618cc98871c tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Calling method '.version_select at 0x7f7cd5917670>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:54.072564 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f7bae6ba-4bdf-456b-99e9-a618cc98871c tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:54.073154 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f7bae6ba-4bdf-456b-99e9-a618cc98871c tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:54.073826 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f7bae6ba-4bdf-456b-99e9-a618cc98871c tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:54.118132 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f7bae6ba-4bdf-456b-99e9-a618cc98871c tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:54.118625 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f7bae6ba-4bdf-456b-99e9-a618cc98871c tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:54.123491 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f7bae6ba-4bdf-456b-99e9-a618cc98871c tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:54.155140 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f7bae6ba-4bdf-456b-99e9-a618cc98871c tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:54.157706 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f7bae6ba-4bdf-456b-99e9-a618cc98871c tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:54.158177 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f7bae6ba-4bdf-456b-99e9-a618cc98871c tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:54.192775 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f7bae6ba-4bdf-456b-99e9-a618cc98871c tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.242340 Oct 17 13:36:54.200199 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 438/872] 10.222.0.79 () {58 vars in 1146 bytes} [Mon Oct 17 13:36:53 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:54.200199 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6689c462-85e9-4917-892c-1c194590535b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:54.200472 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6689c462-85e9-4917-892c-1c194590535b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: fe214f31-2995-4475-bcb7-ae4cec33a6f3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:54.323034 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6689c462-85e9-4917-892c-1c194590535b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:54.338848 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6689c462-85e9-4917-892c-1c194590535b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/fe214f31-2995-4475-bcb7-ae4cec33a6f3" status: 200 len: 1216 microversion: 2.1 time: 0.143991 Oct 17 13:36:54.340028 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 439/873] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:54 2022] GET /compute/v2.1/servers/fe214f31-2995-4475-bcb7-ae4cec33a6f3 => generated 1216 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:54.362870 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-95c7861c-5042-4cfe-b51a-11608446973a tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Calling method '.version_select at 0x7f7cd5a24e50>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:54.372321 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-95c7861c-5042-4cfe-b51a-11608446973a tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:54.372900 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-95c7861c-5042-4cfe-b51a-11608446973a tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:54.373348 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-95c7861c-5042-4cfe-b51a-11608446973a tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:54.407292 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-95c7861c-5042-4cfe-b51a-11608446973a tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:54.408966 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-95c7861c-5042-4cfe-b51a-11608446973a tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:54.410397 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-95c7861c-5042-4cfe-b51a-11608446973a tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:54.444209 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-95c7861c-5042-4cfe-b51a-11608446973a tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:54.446875 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-95c7861c-5042-4cfe-b51a-11608446973a tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:54.447535 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-95c7861c-5042-4cfe-b51a-11608446973a tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:54.466650 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-95c7861c-5042-4cfe-b51a-11608446973a tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1509 microversion: 2.1 time: 0.108427 Oct 17 13:36:54.467781 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 440/874] 10.222.0.79 () {58 vars in 1167 bytes} [Mon Oct 17 13:36:54 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1509 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:54.490882 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-dc4bd00e-c494-481b-978c-ce65a186717e tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Calling method '.version_select at 0x7f7cd5917f70>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:54.528779 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dc4bd00e-c494-481b-978c-ce65a186717e tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:54.529295 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dc4bd00e-c494-481b-978c-ce65a186717e tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:54.529731 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dc4bd00e-c494-481b-978c-ce65a186717e tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:54.562463 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dc4bd00e-c494-481b-978c-ce65a186717e tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:54.563625 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dc4bd00e-c494-481b-978c-ce65a186717e tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:54.564238 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dc4bd00e-c494-481b-978c-ce65a186717e tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:54.577319 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dc4bd00e-c494-481b-978c-ce65a186717e tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:54.578049 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dc4bd00e-c494-481b-978c-ce65a186717e tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:54.578471 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dc4bd00e-c494-481b-978c-ce65a186717e tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:54.581753 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:36:54.601047 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-dc4bd00e-c494-481b-978c-ce65a186717e tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.119867 Oct 17 13:36:54.607533 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 441/875] 10.222.0.79 () {58 vars in 1146 bytes} [Mon Oct 17 13:36:54 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:54.621629 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-965a4076-2707-45e9-854e-1cfc80f16054 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:54.622492 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-965a4076-2707-45e9-854e-1cfc80f16054 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 9e72abb9-d4b5-4c67-8260-2828e3ab5ad2] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:54.638147 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-965a4076-2707-45e9-854e-1cfc80f16054 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:54.638632 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-965a4076-2707-45e9-854e-1cfc80f16054 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:54.639250 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-965a4076-2707-45e9-854e-1cfc80f16054 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:54.640101 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-965a4076-2707-45e9-854e-1cfc80f16054 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:54.640842 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-965a4076-2707-45e9-854e-1cfc80f16054 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:54.641407 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-965a4076-2707-45e9-854e-1cfc80f16054 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:54.668107 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-c722c01c-dc5b-4220-bf24-0009a9fcb6f1 tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:36:54.668718 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-c722c01c-dc5b-4220-bf24-0009a9fcb6f1 tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:36:54.669332 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-c722c01c-dc5b-4220-bf24-0009a9fcb6f1 tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:36:54.669886 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-c722c01c-dc5b-4220-bf24-0009a9fcb6f1 tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:36:54.670317 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-c722c01c-dc5b-4220-bf24-0009a9fcb6f1 tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:36:54.685586 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c722c01c-dc5b-4220-bf24-0009a9fcb6f1 tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:54.687214 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c722c01c-dc5b-4220-bf24-0009a9fcb6f1 tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:54.689551 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c722c01c-dc5b-4220-bf24-0009a9fcb6f1 tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:54.690240 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c722c01c-dc5b-4220-bf24-0009a9fcb6f1 tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:54.690690 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c722c01c-dc5b-4220-bf24-0009a9fcb6f1 tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:54.691116 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c722c01c-dc5b-4220-bf24-0009a9fcb6f1 tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:54.731645 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-c722c01c-dc5b-4220-bf24-0009a9fcb6f1 tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] Getting quotas for project 5d803a93e38d42deace52c7267f56fa2. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:36:54.737523 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-c722c01c-dc5b-4220-bf24-0009a9fcb6f1 tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] Getting quotas for user d0a442dffee1492f8c9bbe64fb74e72b and project 5d803a93e38d42deace52c7267f56fa2. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:36:54.757508 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.utils [None req-c722c01c-dc5b-4220-bf24-0009a9fcb6f1 tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] cores quota exceeded for 5d803a93e38d42deace52c7267f56fa2, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=127016) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 17 13:36:54.758695 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-c722c01c-dc5b-4220-bf24-0009a9fcb6f1 tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 17 13:36:54.764097 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c722c01c-dc5b-4220-bf24-0009a9fcb6f1 tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] Request method failure captured: Oct 17 13:36:54.764097 n-d-854247-14 devstack@n-api.service[127016]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:36:54.764097 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:36:54.764097 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:36:54.764097 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:36:54.764097 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 145 Oct 17 13:36:54.764097 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:36:54.764097 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:36:54.764097 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:36:54.764097 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:36:54.764097 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVpyUBym4gKA5sBackpbe5OxCELp419K5JTCzHoTSLsBH5Omr-CqKi0Ru_10W8HZLuXXklWncIr3Kgl0KWW4Ny4jI05eIiFa-u0bNfMj6rH0gX4rgR3XWjDtKT46BRusWnugzJ8FFLQJa4THAH1yf6waDAtirROOSx8KTdXGQiK7OOI Oct 17 13:36:54.764097 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:36:54.764097 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:36:54.764097 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:36:54.764097 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:36:54.764097 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:36:54.764097 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:36:54.764097 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 5d803a93e38d42deace52c7267f56fa2 Oct 17 13:36:54.764097 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-QuotasAdminNegativeTest-649237353 Oct 17 13:36:54.764097 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:36:54.764097 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:36:54.765643 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5d803a93e38d42deace52c7267f56fa2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5d803a93e38d42deace52c7267f56fa2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5d803a93e38d42deace52c7267f56fa2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5d803a93e38d42deace52c7267f56fa2", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:36:54.765643 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-QuotasAdminNegativeTest-649237353 Oct 17 13:36:54.765643 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 5d803a93e38d42deace52c7267f56fa2 Oct 17 13:36:54.765643 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-649237353 Oct 17 13:36:54.765643 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-QuotasAdminNegativeTest-649237353-project Oct 17 13:36:54.765643 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:36:54.765643 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:36:54.765643 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: d0a442dffee1492f8c9bbe64fb74e72b Oct 17 13:36:54.765643 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-QuotasAdminNegativeTest-649237353-project Oct 17 13:36:54.765643 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:36:54.765643 n-d-854247-14 devstack@n-api.service[127016]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1027081780", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452"}} Oct 17 13:36:54.765643 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:36:54.766578 n-d-854247-14 devstack@n-api.service[127016]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 17 13:36:54.766578 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1027081780', 'imageRef': '0743b21b-a6ff-4d02-897c-eabb68c3ba07', 'flavorRef': '452'}}} Oct 17 13:36:54.766578 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:36:54.766578 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:54.766578 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 17 13:36:54.766578 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 17 13:36:54.766578 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:36:54.766578 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:36:54.766578 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 17 13:36:54.766578 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc Oct 17 13:36:54.766578 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 17 13:36:54.766578 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 17 13:36:54.766578 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:36:54.766578 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:36:54.766578 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 17 13:36:54.766578 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 17 13:36:54.766578 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 17 13:36:54.766578 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 17 13:36:54.768336 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 17 13:36:54.768336 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 17 13:36:54.768336 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 17 13:36:54.768336 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:36:54.768336 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:54.768336 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:36:54.768336 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:54.768336 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 17 13:36:54.768336 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 17 13:36:54.768336 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 17 13:36:54.768336 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 17 13:36:54.768336 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 17 13:36:54.768336 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 17 13:36:54.768336 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 17 13:36:54.768336 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 17 13:36:54.768336 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 17 13:36:54.768336 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 17 13:36:54.768336 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 17 13:36:54.768336 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:36:54.768336 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:54.768336 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:36:54.770910 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:54.770910 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:54.770910 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:54.770910 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:36:54.770910 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:36:54.770910 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:36:54.770910 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:36:54.770910 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:36:54.770910 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:36:54.770910 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:36:54.770910 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:36:54.770910 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:36:54.770910 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:36:54.770910 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 17 13:36:54.770910 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 17 13:36:54.770910 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 17 13:36:54.770910 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 17 13:36:54.770910 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:36:54.770910 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:54.770910 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:36:54.770910 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:54.774264 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:54.774264 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:54.774264 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:36:54.774264 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:36:54.774264 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 17 13:36:54.774264 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:36:54.776634 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c722c01c-dc5b-4220-bf24-0009a9fcb6f1 tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:36:54.777940 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c722c01c-dc5b-4220-bf24-0009a9fcb6f1 tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.218258 Oct 17 13:36:54.779047 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 435/876] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:36:53 2022] POST /compute/v2.1/servers => generated 111 bytes in 1220 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:36:54.784611 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-961882ab-510f-4e55-a30f-a8a9d349a455 tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Calling method '.version_select at 0x7f7cd56353a0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:54.787877 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-961882ab-510f-4e55-a30f-a8a9d349a455 tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:54.788587 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-961882ab-510f-4e55-a30f-a8a9d349a455 tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:54.789236 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-961882ab-510f-4e55-a30f-a8a9d349a455 tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:54.815459 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-961882ab-510f-4e55-a30f-a8a9d349a455 tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:54.816621 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-961882ab-510f-4e55-a30f-a8a9d349a455 tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:54.817162 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-961882ab-510f-4e55-a30f-a8a9d349a455 tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:54.840591 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-961882ab-510f-4e55-a30f-a8a9d349a455 tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.056468 Oct 17 13:36:54.859367 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 436/877] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Oct 17 13:36:54 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:54.864573 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c3de6e4f-e1ff-4711-92ed-bc38de096bc4 tempest-QuotasAdminNegativeTest-1130001571 tempest-QuotasAdminNegativeTest-1130001571-project-admin] Action: 'update', calling method: .version_select at 0x7f7cd56aa1f0>, body: {"quota_set": {"cores": 20}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:55.192529 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c3de6e4f-e1ff-4711-92ed-bc38de096bc4 tempest-QuotasAdminNegativeTest-1130001571 tempest-QuotasAdminNegativeTest-1130001571-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:55.193104 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c3de6e4f-e1ff-4711-92ed-bc38de096bc4 tempest-QuotasAdminNegativeTest-1130001571 tempest-QuotasAdminNegativeTest-1130001571-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:55.193437 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c3de6e4f-e1ff-4711-92ed-bc38de096bc4 tempest-QuotasAdminNegativeTest-1130001571 tempest-QuotasAdminNegativeTest-1130001571-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:55.194194 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c3de6e4f-e1ff-4711-92ed-bc38de096bc4 tempest-QuotasAdminNegativeTest-1130001571 tempest-QuotasAdminNegativeTest-1130001571-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:55.194645 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c3de6e4f-e1ff-4711-92ed-bc38de096bc4 tempest-QuotasAdminNegativeTest-1130001571 tempest-QuotasAdminNegativeTest-1130001571-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:55.195070 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c3de6e4f-e1ff-4711-92ed-bc38de096bc4 tempest-QuotasAdminNegativeTest-1130001571 tempest-QuotasAdminNegativeTest-1130001571-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:55.338078 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c3de6e4f-e1ff-4711-92ed-bc38de096bc4 tempest-QuotasAdminNegativeTest-1130001571 tempest-QuotasAdminNegativeTest-1130001571-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-sets/5d803a93e38d42deace52c7267f56fa2" status: 200 len: 329 microversion: 2.1 time: 0.477124 Oct 17 13:36:55.346604 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 437/878] 10.222.0.79 () {60 vars in 1262 bytes} [Mon Oct 17 13:36:54 2022] PUT /compute/v2.1/os-quota-sets/5d803a93e38d42deace52c7267f56fa2 => generated 329 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:55.346604 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d412191a-c8ba-4b54-aed5-71d3008080e7 tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Calling method '.version_select at 0x7f7cd566f3a0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:55.346604 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d412191a-c8ba-4b54-aed5-71d3008080e7 tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:55.346604 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d412191a-c8ba-4b54-aed5-71d3008080e7 tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:55.347569 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d412191a-c8ba-4b54-aed5-71d3008080e7 tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:55.367600 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d412191a-c8ba-4b54-aed5-71d3008080e7 tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 267 microversion: 2.1 time: 0.027093 Oct 17 13:36:55.368342 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 438/879] 10.222.0.79 () {58 vars in 1179 bytes} [Mon Oct 17 13:36:55 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 267 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:55.374143 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b9aada9c-92bc-4cfa-b2f3-a8d5fe1f12ba tempest-QuotasAdminNegativeTest-1130001571 tempest-QuotasAdminNegativeTest-1130001571-project-admin] Calling method '.version_select at 0x7f7cd56ef0d0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:55.436948 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-965a4076-2707-45e9-854e-1cfc80f16054 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:55.447157 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-965a4076-2707-45e9-854e-1cfc80f16054 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/9e72abb9-d4b5-4c67-8260-2828e3ab5ad2" status: 200 len: 1486 microversion: 2.1 time: 0.837898 Oct 17 13:36:55.456367 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 442/880] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:54 2022] GET /compute/v2.1/servers/9e72abb9-d4b5-4c67-8260-2828e3ab5ad2 => generated 1486 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:55.461280 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ae4203f1-068b-4be2-8572-64090cab1d55 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:55.463766 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ae4203f1-068b-4be2-8572-64090cab1d55 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: fe214f31-2995-4475-bcb7-ae4cec33a6f3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:55.476572 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae4203f1-068b-4be2-8572-64090cab1d55 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:55.477183 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae4203f1-068b-4be2-8572-64090cab1d55 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:55.480958 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae4203f1-068b-4be2-8572-64090cab1d55 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:55.481854 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae4203f1-068b-4be2-8572-64090cab1d55 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:55.482416 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae4203f1-068b-4be2-8572-64090cab1d55 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:55.483485 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae4203f1-068b-4be2-8572-64090cab1d55 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:55.509157 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b9aada9c-92bc-4cfa-b2f3-a8d5fe1f12ba tempest-QuotasAdminNegativeTest-1130001571 tempest-QuotasAdminNegativeTest-1130001571-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/5d803a93e38d42deace52c7267f56fa2" status: 200 len: 371 microversion: 2.1 time: 0.137565 Oct 17 13:36:55.512779 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 439/881] 10.222.0.79 () {58 vars in 1242 bytes} [Mon Oct 17 13:36:55 2022] GET /compute/v2.1/os-quota-sets/5d803a93e38d42deace52c7267f56fa2 => generated 371 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:55.525783 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e17ec804-e368-45a1-bf82-7d3dd2272527 tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Calling method '.version_select at 0x7f7cd56aadc0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:55.528793 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e17ec804-e368-45a1-bf82-7d3dd2272527 tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:55.529471 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e17ec804-e368-45a1-bf82-7d3dd2272527 tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:55.530090 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e17ec804-e368-45a1-bf82-7d3dd2272527 tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:55.562828 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e17ec804-e368-45a1-bf82-7d3dd2272527 tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:55.563346 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e17ec804-e368-45a1-bf82-7d3dd2272527 tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:55.563773 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e17ec804-e368-45a1-bf82-7d3dd2272527 tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:55.592919 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e17ec804-e368-45a1-bf82-7d3dd2272527 tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:55.593407 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e17ec804-e368-45a1-bf82-7d3dd2272527 tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:55.594055 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e17ec804-e368-45a1-bf82-7d3dd2272527 tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:55.612313 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e17ec804-e368-45a1-bf82-7d3dd2272527 tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.098088 Oct 17 13:36:55.612934 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 440/882] 10.222.0.79 () {58 vars in 1146 bytes} [Mon Oct 17 13:36:55 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:55.628146 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d574da3c-960a-4e94-b600-d3025bc209d6 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:55.635403 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d574da3c-960a-4e94-b600-d3025bc209d6 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 9e72abb9-d4b5-4c67-8260-2828e3ab5ad2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:55.645313 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d574da3c-960a-4e94-b600-d3025bc209d6 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:55.647590 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d574da3c-960a-4e94-b600-d3025bc209d6 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:55.648645 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d574da3c-960a-4e94-b600-d3025bc209d6 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:55.656214 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d574da3c-960a-4e94-b600-d3025bc209d6 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:55.662358 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d574da3c-960a-4e94-b600-d3025bc209d6 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:55.663398 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d574da3c-960a-4e94-b600-d3025bc209d6 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:55.831128 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d574da3c-960a-4e94-b600-d3025bc209d6 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "POST /compute/v2.1/servers/9e72abb9-d4b5-4c67-8260-2828e3ab5ad2/action" status: 202 len: 0 microversion: 2.1 time: 0.216551 Oct 17 13:36:55.832475 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 441/883] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:36:55 2022] POST /compute/v2.1/servers/9e72abb9-d4b5-4c67-8260-2828e3ab5ad2/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:36:55.838188 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-567c4d5d-0e78-4e18-a89c-8db9c28d67d7 tempest-QuotasAdminNegativeTest-1130001571 tempest-QuotasAdminNegativeTest-1130001571-project-admin] Action: 'update', calling method: .version_select at 0x7f7cd56aa820>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:55.958901 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-567c4d5d-0e78-4e18-a89c-8db9c28d67d7 tempest-QuotasAdminNegativeTest-1130001571 tempest-QuotasAdminNegativeTest-1130001571-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:55.959363 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-567c4d5d-0e78-4e18-a89c-8db9c28d67d7 tempest-QuotasAdminNegativeTest-1130001571 tempest-QuotasAdminNegativeTest-1130001571-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:55.959967 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-567c4d5d-0e78-4e18-a89c-8db9c28d67d7 tempest-QuotasAdminNegativeTest-1130001571 tempest-QuotasAdminNegativeTest-1130001571-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:55.960847 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-567c4d5d-0e78-4e18-a89c-8db9c28d67d7 tempest-QuotasAdminNegativeTest-1130001571 tempest-QuotasAdminNegativeTest-1130001571-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:55.961635 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-567c4d5d-0e78-4e18-a89c-8db9c28d67d7 tempest-QuotasAdminNegativeTest-1130001571 tempest-QuotasAdminNegativeTest-1130001571-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:55.962209 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-567c4d5d-0e78-4e18-a89c-8db9c28d67d7 tempest-QuotasAdminNegativeTest-1130001571 tempest-QuotasAdminNegativeTest-1130001571-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:56.123090 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:36:56.125977 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-567c4d5d-0e78-4e18-a89c-8db9c28d67d7 tempest-QuotasAdminNegativeTest-1130001571 tempest-QuotasAdminNegativeTest-1130001571-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-sets/5d803a93e38d42deace52c7267f56fa2" status: 200 len: 328 microversion: 2.1 time: 0.291958 Oct 17 13:36:56.135306 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 442/884] 10.222.0.79 () {60 vars in 1262 bytes} [Mon Oct 17 13:36:55 2022] PUT /compute/v2.1/os-quota-sets/5d803a93e38d42deace52c7267f56fa2 => generated 328 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:56.140061 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-142900b3-994a-40af-978a-129cdb8ae0dc tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Calling method '.version_select at 0x7f7cd55f2a60>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:56.142689 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-142900b3-994a-40af-978a-129cdb8ae0dc tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:56.143348 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-142900b3-994a-40af-978a-129cdb8ae0dc tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:56.143874 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-142900b3-994a-40af-978a-129cdb8ae0dc tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:56.162761 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-142900b3-994a-40af-978a-129cdb8ae0dc tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:56.163689 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-142900b3-994a-40af-978a-129cdb8ae0dc tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:56.164534 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-142900b3-994a-40af-978a-129cdb8ae0dc tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:56.173907 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-142900b3-994a-40af-978a-129cdb8ae0dc tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.045486 Oct 17 13:36:56.175088 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 443/885] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Oct 17 13:36:56 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:56.181692 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cf374e02-580b-4f74-94e2-cc411cde28ea tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:56.182856 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cf374e02-580b-4f74-94e2-cc411cde28ea tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 9e72abb9-d4b5-4c67-8260-2828e3ab5ad2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:56.191040 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cf374e02-580b-4f74-94e2-cc411cde28ea tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:56.192013 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cf374e02-580b-4f74-94e2-cc411cde28ea tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:56.192462 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cf374e02-580b-4f74-94e2-cc411cde28ea tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:56.193214 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cf374e02-580b-4f74-94e2-cc411cde28ea tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:56.194309 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cf374e02-580b-4f74-94e2-cc411cde28ea tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:56.194739 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cf374e02-580b-4f74-94e2-cc411cde28ea tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:56.382387 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ae4203f1-068b-4be2-8572-64090cab1d55 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:56.391580 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ae4203f1-068b-4be2-8572-64090cab1d55 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/fe214f31-2995-4475-bcb7-ae4cec33a6f3" status: 200 len: 1268 microversion: 2.1 time: 0.934012 Oct 17 13:36:56.396966 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 443/886] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:55 2022] GET /compute/v2.1/servers/fe214f31-2995-4475-bcb7-ae4cec33a6f3 => generated 1268 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:56.402092 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2bc1748c-e498-4745-8fab-7edb77af14ec tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-445157950", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:56.475028 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-2bc1748c-e498-4745-8fab-7edb77af14ec tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] validate_networks() for None {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:36:56.851281 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cf374e02-580b-4f74-94e2-cc411cde28ea tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:56.864295 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cf374e02-580b-4f74-94e2-cc411cde28ea tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/9e72abb9-d4b5-4c67-8260-2828e3ab5ad2" status: 200 len: 1471 microversion: 2.1 time: 0.687124 Oct 17 13:36:56.876705 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 444/887] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:56 2022] GET /compute/v2.1/servers/9e72abb9-d4b5-4c67-8260-2828e3ab5ad2 => generated 1471 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:56.909555 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3ad36c73-4034-487f-84d6-fd4f1e982f4f tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Calling method '.version_select at 0x7f7cd56350d0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:56.915399 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3ad36c73-4034-487f-84d6-fd4f1e982f4f tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:56.916144 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3ad36c73-4034-487f-84d6-fd4f1e982f4f tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:56.919184 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3ad36c73-4034-487f-84d6-fd4f1e982f4f tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:56.940753 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3ad36c73-4034-487f-84d6-fd4f1e982f4f tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:56.941376 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3ad36c73-4034-487f-84d6-fd4f1e982f4f tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:56.941994 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3ad36c73-4034-487f-84d6-fd4f1e982f4f tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:56.951484 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3ad36c73-4034-487f-84d6-fd4f1e982f4f tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 759 microversion: 2.1 time: 0.069699 Oct 17 13:36:56.964026 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 445/888] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Oct 17 13:36:56 2022] GET /compute/v2.1/os-hypervisors/2 => generated 759 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:56.969950 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2f64a50a-4267-438a-a4c0-e9b4fe832f9e tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1895753777"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:56.974315 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2f64a50a-4267-438a-a4c0-e9b4fe832f9e tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 9e72abb9-d4b5-4c67-8260-2828e3ab5ad2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:56.984034 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2f64a50a-4267-438a-a4c0-e9b4fe832f9e tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:56.984993 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2f64a50a-4267-438a-a4c0-e9b4fe832f9e tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:56.985599 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2f64a50a-4267-438a-a4c0-e9b4fe832f9e tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:56.987460 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2f64a50a-4267-438a-a4c0-e9b4fe832f9e tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:56.988121 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2f64a50a-4267-438a-a4c0-e9b4fe832f9e tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:56.988708 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2f64a50a-4267-438a-a4c0-e9b4fe832f9e tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:57.447942 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2f64a50a-4267-438a-a4c0-e9b4fe832f9e tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "POST /compute/v2.1/servers/9e72abb9-d4b5-4c67-8260-2828e3ab5ad2/action" status: 202 len: 0 microversion: 2.1 time: 0.478855 Oct 17 13:36:57.454774 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 446/889] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:36:56 2022] POST /compute/v2.1/servers/9e72abb9-d4b5-4c67-8260-2828e3ab5ad2/action => generated 0 bytes in 485 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 17 13:36:57.462391 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-94c81147-bbce-45a3-8e2c-7a19523d911b tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Calling method '.version_select at 0x7f7cd55f2040>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:57.476317 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94c81147-bbce-45a3-8e2c-7a19523d911b tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:57.476937 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94c81147-bbce-45a3-8e2c-7a19523d911b tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:57.477415 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94c81147-bbce-45a3-8e2c-7a19523d911b tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:57.501453 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94c81147-bbce-45a3-8e2c-7a19523d911b tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:57.502054 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94c81147-bbce-45a3-8e2c-7a19523d911b tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:57.502555 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94c81147-bbce-45a3-8e2c-7a19523d911b tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:57.525496 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94c81147-bbce-45a3-8e2c-7a19523d911b tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:57.525983 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94c81147-bbce-45a3-8e2c-7a19523d911b tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:57.526459 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94c81147-bbce-45a3-8e2c-7a19523d911b tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:57.562948 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-94c81147-bbce-45a3-8e2c-7a19523d911b tempest-HypervisorAdminTestJSON-708305381 tempest-HypervisorAdminTestJSON-708305381-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 176 microversion: 2.1 time: 0.107207 Oct 17 13:36:57.574230 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 447/890] 10.222.0.79 () {58 vars in 1173 bytes} [Mon Oct 17 13:36:57 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 176 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:57.582940 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-45aad866-84cc-4379-a224-89ff26967e0a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:57.582940 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-45aad866-84cc-4379-a224-89ff26967e0a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: fe214f31-2995-4475-bcb7-ae4cec33a6f3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:57.602903 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-45aad866-84cc-4379-a224-89ff26967e0a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:57.604243 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-45aad866-84cc-4379-a224-89ff26967e0a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:57.604738 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-45aad866-84cc-4379-a224-89ff26967e0a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:57.606876 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-45aad866-84cc-4379-a224-89ff26967e0a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:57.607375 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-45aad866-84cc-4379-a224-89ff26967e0a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:57.607796 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-45aad866-84cc-4379-a224-89ff26967e0a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:57.973767 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-2bc1748c-e498-4745-8fab-7edb77af14ec tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:36:57.974343 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-2bc1748c-e498-4745-8fab-7edb77af14ec tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:36:57.974803 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-2bc1748c-e498-4745-8fab-7edb77af14ec tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:36:57.975353 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-2bc1748c-e498-4745-8fab-7edb77af14ec tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:36:57.975997 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-2bc1748c-e498-4745-8fab-7edb77af14ec tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:36:57.996743 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2bc1748c-e498-4745-8fab-7edb77af14ec tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:57.997429 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2bc1748c-e498-4745-8fab-7edb77af14ec tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:57.998955 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2bc1748c-e498-4745-8fab-7edb77af14ec tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:58.000458 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2bc1748c-e498-4745-8fab-7edb77af14ec tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:58.002368 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2bc1748c-e498-4745-8fab-7edb77af14ec tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:58.002817 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2bc1748c-e498-4745-8fab-7edb77af14ec tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:58.053121 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-2bc1748c-e498-4745-8fab-7edb77af14ec tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] Getting quotas for project 5d803a93e38d42deace52c7267f56fa2. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:36:58.071390 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-2bc1748c-e498-4745-8fab-7edb77af14ec tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] Getting quotas for user d0a442dffee1492f8c9bbe64fb74e72b and project 5d803a93e38d42deace52c7267f56fa2. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:36:58.100203 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.utils [None req-2bc1748c-e498-4745-8fab-7edb77af14ec tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] instances quota exceeded for 5d803a93e38d42deace52c7267f56fa2, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=127017) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 17 13:36:58.101048 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-2bc1748c-e498-4745-8fab-7edb77af14ec tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 17 13:36:58.110907 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2bc1748c-e498-4745-8fab-7edb77af14ec tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] Request method failure captured: Oct 17 13:36:58.110907 n-d-854247-14 devstack@n-api.service[127017]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:36:58.110907 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:36:58.110907 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:36:58.110907 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:36:58.110907 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 144 Oct 17 13:36:58.110907 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:36:58.110907 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:36:58.110907 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:36:58.110907 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:36:58.110907 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVpyUBym4gKA5sBackpbe5OxCELp419K5JTCzHoTSLsBH5Omr-CqKi0Ru_10W8HZLuXXklWncIr3Kgl0KWW4Ny4jI05eIiFa-u0bNfMj6rH0gX4rgR3XWjDtKT46BRusWnugzJ8FFLQJa4THAH1yf6waDAtirROOSx8KTdXGQiK7OOI Oct 17 13:36:58.110907 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:36:58.110907 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:36:58.110907 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:36:58.110907 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:36:58.110907 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:36:58.110907 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:36:58.110907 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 5d803a93e38d42deace52c7267f56fa2 Oct 17 13:36:58.110907 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-QuotasAdminNegativeTest-649237353 Oct 17 13:36:58.110907 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:36:58.110907 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:36:58.112304 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5d803a93e38d42deace52c7267f56fa2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5d803a93e38d42deace52c7267f56fa2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5d803a93e38d42deace52c7267f56fa2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5d803a93e38d42deace52c7267f56fa2", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:36:58.112304 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-QuotasAdminNegativeTest-649237353 Oct 17 13:36:58.112304 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 5d803a93e38d42deace52c7267f56fa2 Oct 17 13:36:58.112304 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-649237353 Oct 17 13:36:58.112304 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-QuotasAdminNegativeTest-649237353-project Oct 17 13:36:58.112304 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:36:58.112304 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:36:58.112304 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: d0a442dffee1492f8c9bbe64fb74e72b Oct 17 13:36:58.112304 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-QuotasAdminNegativeTest-649237353-project Oct 17 13:36:58.112304 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 13:36:58.112304 n-d-854247-14 devstack@n-api.service[127017]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-445157950", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452"}} Oct 17 13:36:58.112304 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:36:58.113065 n-d-854247-14 devstack@n-api.service[127017]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 17 13:36:58.113065 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-445157950', 'imageRef': '0743b21b-a6ff-4d02-897c-eabb68c3ba07', 'flavorRef': '452'}}} Oct 17 13:36:58.113065 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:36:58.113065 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:58.113065 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 17 13:36:58.113065 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 17 13:36:58.113065 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:36:58.113065 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:36:58.113065 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 17 13:36:58.113065 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc Oct 17 13:36:58.113065 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 17 13:36:58.113065 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 17 13:36:58.113065 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:36:58.113065 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:36:58.113065 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 17 13:36:58.113065 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 17 13:36:58.113065 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 17 13:36:58.113065 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 17 13:36:58.114145 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 17 13:36:58.114145 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 17 13:36:58.114145 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 17 13:36:58.114145 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:58.114145 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:58.114145 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:58.114145 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:58.114145 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 17 13:36:58.114145 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 17 13:36:58.114145 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 17 13:36:58.114145 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 17 13:36:58.114145 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 17 13:36:58.114145 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 17 13:36:58.114145 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 17 13:36:58.114145 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 17 13:36:58.114145 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 17 13:36:58.114145 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 17 13:36:58.114145 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 17 13:36:58.114145 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:58.114145 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:58.114145 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:58.116669 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:58.116669 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:58.116669 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:58.116669 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:36:58.116669 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:36:58.116669 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:36:58.116669 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:36:58.116669 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:36:58.116669 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:36:58.116669 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:36:58.116669 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:36:58.116669 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:36:58.116669 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:36:58.116669 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 17 13:36:58.116669 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 17 13:36:58.116669 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 17 13:36:58.116669 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 17 13:36:58.116669 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:58.116669 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:58.116669 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:58.116669 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:58.119055 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:58.119055 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:58.119055 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:36:58.119055 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:36:58.119055 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 17 13:36:58.119055 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:36:58.119055 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2bc1748c-e498-4745-8fab-7edb77af14ec tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:36:58.119055 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2bc1748c-e498-4745-8fab-7edb77af14ec tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.714652 Oct 17 13:36:58.122354 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 444/891] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:36:56 2022] POST /compute/v2.1/servers => generated 119 bytes in 1724 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:36:58.127507 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c7e234a6-c28b-424f-83a5-5e9f76cf0e52 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd5756790>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:58.233282 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c7e234a6-c28b-424f-83a5-5e9f76cf0e52 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/2a2d7b14-a31e-4918-9ecb-2788c4cc869d" status: 200 len: 1414 microversion: 2.1 time: 0.109657 Oct 17 13:36:58.233856 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 445/892] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:36:58 2022] GET /compute/v2.1/images/2a2d7b14-a31e-4918-9ecb-2788c4cc869d => generated 1414 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:58.254052 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3e311cab-e729-4b7c-b684-0cbfbe8ca6cb tempest-QuotasAdminNegativeTest-1130001571 tempest-QuotasAdminNegativeTest-1130001571-project-admin] Action: 'update', calling method: .version_select at 0x7f7cd57564c0>, body: {"quota_set": {"instances": 10}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:58.546596 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-45aad866-84cc-4379-a224-89ff26967e0a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:58.558911 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-45aad866-84cc-4379-a224-89ff26967e0a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/fe214f31-2995-4475-bcb7-ae4cec33a6f3" status: 200 len: 1316 microversion: 2.1 time: 0.990913 Oct 17 13:36:58.565608 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 448/893] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:57 2022] GET /compute/v2.1/servers/fe214f31-2995-4475-bcb7-ae4cec33a6f3 => generated 1316 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:58.893187 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3e311cab-e729-4b7c-b684-0cbfbe8ca6cb tempest-QuotasAdminNegativeTest-1130001571 tempest-QuotasAdminNegativeTest-1130001571-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:58.893972 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3e311cab-e729-4b7c-b684-0cbfbe8ca6cb tempest-QuotasAdminNegativeTest-1130001571 tempest-QuotasAdminNegativeTest-1130001571-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:58.894492 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3e311cab-e729-4b7c-b684-0cbfbe8ca6cb tempest-QuotasAdminNegativeTest-1130001571 tempest-QuotasAdminNegativeTest-1130001571-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:58.895487 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3e311cab-e729-4b7c-b684-0cbfbe8ca6cb tempest-QuotasAdminNegativeTest-1130001571 tempest-QuotasAdminNegativeTest-1130001571-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:58.896217 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3e311cab-e729-4b7c-b684-0cbfbe8ca6cb tempest-QuotasAdminNegativeTest-1130001571 tempest-QuotasAdminNegativeTest-1130001571-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:58.896698 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3e311cab-e729-4b7c-b684-0cbfbe8ca6cb tempest-QuotasAdminNegativeTest-1130001571 tempest-QuotasAdminNegativeTest-1130001571-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:59.023354 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:36:59.065905 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3e311cab-e729-4b7c-b684-0cbfbe8ca6cb tempest-QuotasAdminNegativeTest-1130001571 tempest-QuotasAdminNegativeTest-1130001571-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-sets/5d803a93e38d42deace52c7267f56fa2" status: 200 len: 329 microversion: 2.1 time: 0.822706 Oct 17 13:36:59.067145 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 446/894] 10.222.0.79 () {60 vars in 1262 bytes} [Mon Oct 17 13:36:58 2022] PUT /compute/v2.1/os-quota-sets/5d803a93e38d42deace52c7267f56fa2 => generated 329 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:59.082503 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-32e9c638-594e-4722-b6d3-076f584ab1df tempest-QuotasAdminNegativeTest-1130001571 tempest-QuotasAdminNegativeTest-1130001571-project-admin] Calling method '.version_select at 0x7f7cd55f29d0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:59.240907 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-32e9c638-594e-4722-b6d3-076f584ab1df tempest-QuotasAdminNegativeTest-1130001571 tempest-QuotasAdminNegativeTest-1130001571-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/5d803a93e38d42deace52c7267f56fa2" status: 200 len: 371 microversion: 2.1 time: 0.161741 Oct 17 13:36:59.243393 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 449/895] 10.222.0.79 () {58 vars in 1242 bytes} [Mon Oct 17 13:36:59 2022] GET /compute/v2.1/os-quota-sets/5d803a93e38d42deace52c7267f56fa2 => generated 371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:59.255538 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ac3413bb-94c9-462d-9a1a-4c37d4c254a2 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd5730940>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:59.264079 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f7dfefe2-4b14-48c4-b8b9-3ae2824b1710 tempest-QuotasAdminNegativeTest-1130001571 tempest-QuotasAdminNegativeTest-1130001571-project-admin] Action: 'update', calling method: .version_select at 0x7f7cd5639310>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:59.351332 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ac3413bb-94c9-462d-9a1a-4c37d4c254a2 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/2a2d7b14-a31e-4918-9ecb-2788c4cc869d" status: 200 len: 1414 microversion: 2.1 time: 0.099027 Oct 17 13:36:59.360538 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 447/896] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:36:59 2022] GET /compute/v2.1/images/2a2d7b14-a31e-4918-9ecb-2788c4cc869d => generated 1414 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:59.392597 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f7dfefe2-4b14-48c4-b8b9-3ae2824b1710 tempest-QuotasAdminNegativeTest-1130001571 tempest-QuotasAdminNegativeTest-1130001571-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:59.395436 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f7dfefe2-4b14-48c4-b8b9-3ae2824b1710 tempest-QuotasAdminNegativeTest-1130001571 tempest-QuotasAdminNegativeTest-1130001571-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:59.396102 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f7dfefe2-4b14-48c4-b8b9-3ae2824b1710 tempest-QuotasAdminNegativeTest-1130001571 tempest-QuotasAdminNegativeTest-1130001571-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:59.398729 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f7dfefe2-4b14-48c4-b8b9-3ae2824b1710 tempest-QuotasAdminNegativeTest-1130001571 tempest-QuotasAdminNegativeTest-1130001571-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:59.402245 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f7dfefe2-4b14-48c4-b8b9-3ae2824b1710 tempest-QuotasAdminNegativeTest-1130001571 tempest-QuotasAdminNegativeTest-1130001571-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:59.402848 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f7dfefe2-4b14-48c4-b8b9-3ae2824b1710 tempest-QuotasAdminNegativeTest-1130001571 tempest-QuotasAdminNegativeTest-1130001571-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:59.523440 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f7dfefe2-4b14-48c4-b8b9-3ae2824b1710 tempest-QuotasAdminNegativeTest-1130001571 tempest-QuotasAdminNegativeTest-1130001571-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-sets/5d803a93e38d42deace52c7267f56fa2" status: 200 len: 325 microversion: 2.1 time: 0.262985 Oct 17 13:36:59.526399 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 450/897] 10.222.0.79 () {60 vars in 1262 bytes} [Mon Oct 17 13:36:59 2022] PUT /compute/v2.1/os-quota-sets/5d803a93e38d42deace52c7267f56fa2 => generated 325 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:59.588701 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5a5fb1a1-5d79-4fee-90d0-29c79cbf313c tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:59.590028 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5a5fb1a1-5d79-4fee-90d0-29c79cbf313c tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: fe214f31-2995-4475-bcb7-ae4cec33a6f3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:59.602974 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5a5fb1a1-5d79-4fee-90d0-29c79cbf313c tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:59.605425 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5a5fb1a1-5d79-4fee-90d0-29c79cbf313c tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:59.607267 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5a5fb1a1-5d79-4fee-90d0-29c79cbf313c tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:59.614943 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5a5fb1a1-5d79-4fee-90d0-29c79cbf313c tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:59.615932 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5a5fb1a1-5d79-4fee-90d0-29c79cbf313c tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:59.616607 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5a5fb1a1-5d79-4fee-90d0-29c79cbf313c tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:59.869783 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-45971832-ce10-40b6-b882-3270da5c8752 tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1255391145", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:59.983663 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-45971832-ce10-40b6-b882-3270da5c8752 tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] validate_networks() for None {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:37:00.034593 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5a5fb1a1-5d79-4fee-90d0-29c79cbf313c tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:00.049408 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5a5fb1a1-5d79-4fee-90d0-29c79cbf313c tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/fe214f31-2995-4475-bcb7-ae4cec33a6f3" status: 200 len: 1316 microversion: 2.1 time: 0.464743 Oct 17 13:37:00.052998 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 448/898] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:59 2022] GET /compute/v2.1/servers/fe214f31-2995-4475-bcb7-ae4cec33a6f3 => generated 1316 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:00.368958 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ce68de4a-fc34-426f-b4f2-da755e654304 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd5730af0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:00.471260 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ce68de4a-fc34-426f-b4f2-da755e654304 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/2a2d7b14-a31e-4918-9ecb-2788c4cc869d" status: 200 len: 1414 microversion: 2.1 time: 0.104840 Oct 17 13:37:00.475158 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 449/899] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:37:00 2022] GET /compute/v2.1/images/2a2d7b14-a31e-4918-9ecb-2788c4cc869d => generated 1414 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:37:00.834724 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-45971832-ce10-40b6-b882-3270da5c8752 tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:37:00.835329 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-45971832-ce10-40b6-b882-3270da5c8752 tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:37:00.836119 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-45971832-ce10-40b6-b882-3270da5c8752 tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:37:00.836753 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-45971832-ce10-40b6-b882-3270da5c8752 tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:37:00.837226 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-45971832-ce10-40b6-b882-3270da5c8752 tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:37:00.856469 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-45971832-ce10-40b6-b882-3270da5c8752 tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:00.857309 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-45971832-ce10-40b6-b882-3270da5c8752 tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:00.857949 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-45971832-ce10-40b6-b882-3270da5c8752 tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:00.858876 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-45971832-ce10-40b6-b882-3270da5c8752 tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:00.863899 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-45971832-ce10-40b6-b882-3270da5c8752 tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:00.864855 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-45971832-ce10-40b6-b882-3270da5c8752 tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:00.899618 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-45971832-ce10-40b6-b882-3270da5c8752 tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] Getting quotas for project 5d803a93e38d42deace52c7267f56fa2. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:37:00.906324 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-45971832-ce10-40b6-b882-3270da5c8752 tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] Getting quotas for user d0a442dffee1492f8c9bbe64fb74e72b and project 5d803a93e38d42deace52c7267f56fa2. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:37:00.922432 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.utils [None req-45971832-ce10-40b6-b882-3270da5c8752 tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] ram quota exceeded for 5d803a93e38d42deace52c7267f56fa2, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=127016) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 17 13:37:00.923493 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-45971832-ce10-40b6-b882-3270da5c8752 tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 17 13:37:00.926084 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-45971832-ce10-40b6-b882-3270da5c8752 tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] Request method failure captured: Oct 17 13:37:00.926084 n-d-854247-14 devstack@n-api.service[127016]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:37:00.926084 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:37:00.926084 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:37:00.926084 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:37:00.926084 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 145 Oct 17 13:37:00.926084 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:37:00.926084 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:37:00.926084 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:37:00.926084 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:37:00.926084 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVpyUBym4gKA5sBackpbe5OxCELp419K5JTCzHoTSLsBH5Omr-CqKi0Ru_10W8HZLuXXklWncIr3Kgl0KWW4Ny4jI05eIiFa-u0bNfMj6rH0gX4rgR3XWjDtKT46BRusWnugzJ8FFLQJa4THAH1yf6waDAtirROOSx8KTdXGQiK7OOI Oct 17 13:37:00.926084 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:37:00.926084 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:37:00.926084 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:37:00.926084 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:37:00.926084 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:37:00.926084 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:37:00.926084 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 5d803a93e38d42deace52c7267f56fa2 Oct 17 13:37:00.926084 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-QuotasAdminNegativeTest-649237353 Oct 17 13:37:00.926084 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:37:00.926084 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:37:00.927550 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5d803a93e38d42deace52c7267f56fa2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5d803a93e38d42deace52c7267f56fa2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5d803a93e38d42deace52c7267f56fa2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5d803a93e38d42deace52c7267f56fa2", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:37:00.927550 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-QuotasAdminNegativeTest-649237353 Oct 17 13:37:00.927550 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 5d803a93e38d42deace52c7267f56fa2 Oct 17 13:37:00.927550 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-649237353 Oct 17 13:37:00.927550 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-QuotasAdminNegativeTest-649237353-project Oct 17 13:37:00.927550 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:37:00.927550 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:37:00.927550 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: d0a442dffee1492f8c9bbe64fb74e72b Oct 17 13:37:00.927550 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-QuotasAdminNegativeTest-649237353-project Oct 17 13:37:00.927550 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:37:00.927550 n-d-854247-14 devstack@n-api.service[127016]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1255391145", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452"}} Oct 17 13:37:00.927550 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:37:00.928634 n-d-854247-14 devstack@n-api.service[127016]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 17 13:37:00.928634 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1255391145', 'imageRef': '0743b21b-a6ff-4d02-897c-eabb68c3ba07', 'flavorRef': '452'}}} Oct 17 13:37:00.928634 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:37:00.928634 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:00.928634 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 17 13:37:00.928634 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 17 13:37:00.928634 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:37:00.928634 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:37:00.928634 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 17 13:37:00.928634 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc Oct 17 13:37:00.928634 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 17 13:37:00.928634 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 17 13:37:00.928634 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:37:00.928634 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:37:00.928634 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 17 13:37:00.928634 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 17 13:37:00.928634 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 17 13:37:00.928634 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 17 13:37:00.929808 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 17 13:37:00.929808 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 17 13:37:00.929808 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 17 13:37:00.929808 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:37:00.929808 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:00.929808 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:37:00.929808 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:00.929808 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 17 13:37:00.929808 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 17 13:37:00.929808 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 17 13:37:00.929808 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 17 13:37:00.929808 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 17 13:37:00.929808 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 17 13:37:00.929808 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 17 13:37:00.929808 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 17 13:37:00.929808 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 17 13:37:00.929808 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 17 13:37:00.929808 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 17 13:37:00.929808 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:37:00.929808 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:00.929808 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:37:00.931628 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:00.931628 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:00.931628 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:00.931628 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:37:00.931628 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:37:00.931628 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:37:00.931628 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:37:00.931628 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:37:00.931628 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:37:00.931628 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:37:00.931628 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:37:00.931628 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:37:00.931628 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:37:00.931628 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 17 13:37:00.931628 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 17 13:37:00.931628 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 17 13:37:00.931628 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 17 13:37:00.931628 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:37:00.931628 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:00.931628 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:37:00.931628 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:00.932842 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:00.932842 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:00.932842 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:37:00.932842 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:37:00.932842 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 17 13:37:00.932842 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:37:00.935239 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-45971832-ce10-40b6-b882-3270da5c8752 tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:37:00.936727 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-45971832-ce10-40b6-b882-3270da5c8752 tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 1.070959 Oct 17 13:37:00.937791 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 451/900] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:36:59 2022] POST /compute/v2.1/servers => generated 110 bytes in 1073 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:37:00.946435 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-62c404ca-c2a4-490d-9b9f-e8e0b4621cf9 tempest-QuotasAdminNegativeTest-1130001571 tempest-QuotasAdminNegativeTest-1130001571-project-admin] Action: 'update', calling method: .version_select at 0x7f7cd5699040>, body: {"quota_set": {"ram": 51200}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:01.079004 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fc8bfd16-2f15-41b0-b620-5cc18326d5d2 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:01.080403 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-fc8bfd16-2f15-41b0-b620-5cc18326d5d2 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: fe214f31-2995-4475-bcb7-ae4cec33a6f3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:01.097550 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fc8bfd16-2f15-41b0-b620-5cc18326d5d2 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:01.103880 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fc8bfd16-2f15-41b0-b620-5cc18326d5d2 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:01.105083 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fc8bfd16-2f15-41b0-b620-5cc18326d5d2 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:01.106128 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fc8bfd16-2f15-41b0-b620-5cc18326d5d2 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:01.106982 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fc8bfd16-2f15-41b0-b620-5cc18326d5d2 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:01.107730 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fc8bfd16-2f15-41b0-b620-5cc18326d5d2 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:01.355796 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-62c404ca-c2a4-490d-9b9f-e8e0b4621cf9 tempest-QuotasAdminNegativeTest-1130001571 tempest-QuotasAdminNegativeTest-1130001571-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:01.357745 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-62c404ca-c2a4-490d-9b9f-e8e0b4621cf9 tempest-QuotasAdminNegativeTest-1130001571 tempest-QuotasAdminNegativeTest-1130001571-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:01.359132 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-62c404ca-c2a4-490d-9b9f-e8e0b4621cf9 tempest-QuotasAdminNegativeTest-1130001571 tempest-QuotasAdminNegativeTest-1130001571-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:01.362587 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-62c404ca-c2a4-490d-9b9f-e8e0b4621cf9 tempest-QuotasAdminNegativeTest-1130001571 tempest-QuotasAdminNegativeTest-1130001571-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:01.365120 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-62c404ca-c2a4-490d-9b9f-e8e0b4621cf9 tempest-QuotasAdminNegativeTest-1130001571 tempest-QuotasAdminNegativeTest-1130001571-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:01.366129 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-62c404ca-c2a4-490d-9b9f-e8e0b4621cf9 tempest-QuotasAdminNegativeTest-1130001571 tempest-QuotasAdminNegativeTest-1130001571-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:01.503429 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-62c404ca-c2a4-490d-9b9f-e8e0b4621cf9 tempest-QuotasAdminNegativeTest-1130001571 tempest-QuotasAdminNegativeTest-1130001571-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-sets/5d803a93e38d42deace52c7267f56fa2" status: 200 len: 329 microversion: 2.1 time: 0.560822 Oct 17 13:37:01.505106 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 450/901] 10.222.0.79 () {60 vars in 1262 bytes} [Mon Oct 17 13:37:00 2022] PUT /compute/v2.1/os-quota-sets/5d803a93e38d42deace52c7267f56fa2 => generated 329 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:37:01.525594 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-145d2ce1-3fee-49df-a237-eac1affc243f tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd5699dc0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:01.614769 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-145d2ce1-3fee-49df-a237-eac1affc243f tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/2a2d7b14-a31e-4918-9ecb-2788c4cc869d" status: 200 len: 1414 microversion: 2.1 time: 0.108262 Oct 17 13:37:01.616286 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 451/902] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:37:01 2022] GET /compute/v2.1/images/2a2d7b14-a31e-4918-9ecb-2788c4cc869d => generated 1414 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:01.624332 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8d8e5e98-3407-45e8-89e6-3886e2f5e894 tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] Action: 'update', calling method: .version_select at 0x7f7cd5692550>, body: {"quota_set": {"ram": 0}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:01.640727 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8d8e5e98-3407-45e8-89e6-3886e2f5e894 tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'd0a442dffee1492f8c9bbe64fb74e72b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d803a93e38d42deace52c7267f56fa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:01.642789 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8d8e5e98-3407-45e8-89e6-3886e2f5e894 tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] Request method failure captured: Oct 17 13:37:01.642789 n-d-854247-14 devstack@n-api.service[127017]: request: PUT /compute/v2.1/os-quota-sets/5d803a93e38d42deace52c7267f56fa2 HTTP/1.1 Oct 17 13:37:01.642789 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:37:01.642789 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:37:01.642789 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:37:01.642789 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 25 Oct 17 13:37:01.642789 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:37:01.642789 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:37:01.642789 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:37:01.642789 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:37:01.642789 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVpyUBym4gKA5sBackpbe5OxCELp419K5JTCzHoTSLsBH5Omr-CqKi0Ru_10W8HZLuXXklWncIr3Kgl0KWW4Ny4jI05eIiFa-u0bNfMj6rH0gX4rgR3XWjDtKT46BRusWnugzJ8FFLQJa4THAH1yf6waDAtirROOSx8KTdXGQiK7OOI Oct 17 13:37:01.642789 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:37:01.642789 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:37:01.642789 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:37:01.642789 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:37:01.642789 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:37:01.642789 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:37:01.642789 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 5d803a93e38d42deace52c7267f56fa2 Oct 17 13:37:01.642789 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-QuotasAdminNegativeTest-649237353 Oct 17 13:37:01.642789 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:37:01.642789 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:37:01.644387 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5d803a93e38d42deace52c7267f56fa2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5d803a93e38d42deace52c7267f56fa2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5d803a93e38d42deace52c7267f56fa2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5d803a93e38d42deace52c7267f56fa2", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:37:01.644387 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-QuotasAdminNegativeTest-649237353 Oct 17 13:37:01.644387 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 5d803a93e38d42deace52c7267f56fa2 Oct 17 13:37:01.644387 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-649237353 Oct 17 13:37:01.644387 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-QuotasAdminNegativeTest-649237353-project Oct 17 13:37:01.644387 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:37:01.644387 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:37:01.644387 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: d0a442dffee1492f8c9bbe64fb74e72b Oct 17 13:37:01.644387 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-QuotasAdminNegativeTest-649237353-project Oct 17 13:37:01.644387 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 13:37:01.644387 n-d-854247-14 devstack@n-api.service[127017]: {"quota_set": {"ram": 0}} Oct 17 13:37:01.644387 n-d-854247-14 devstack@n-api.service[127017]: method: Oct 17 13:37:01.644387 n-d-854247-14 devstack@n-api.service[127017]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 17 13:37:01.644387 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '5d803a93e38d42deace52c7267f56fa2', 'body': {'quota_set': {'ram': 0}}} Oct 17 13:37:01.645442 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:37:01.645442 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:01.645442 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:01.645442 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:01.645442 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:37:01.645442 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:37:01.645442 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:37:01.645442 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:37:01.645442 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:37:01.645442 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:37:01.645442 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:37:01.645442 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:37:01.645442 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 17 13:37:01.645442 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 17 13:37:01.645442 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 13:37:01.645442 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:37:01.645442 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 13:37:01.645442 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:37:01.645442 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 17 13:37:01.646623 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 17 13:37:01.646623 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:37:01.646623 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:37:01.646623 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:37:01.646623 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:37:01.646623 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:37:01.646623 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:37:01.646623 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:37:01.646623 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:37:01.646623 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:37:01.646623 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:37:01.646623 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:37:01.646623 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:37:01.646623 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:37:01.646623 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:37:01.646623 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 17 13:37:01.646623 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:37:01.646623 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:01.646623 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:37:01.646623 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:01.648048 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:01.648048 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:01.648048 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:37:01.648048 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:37:01.648048 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 17 13:37:01.648048 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:37:01.648048 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8d8e5e98-3407-45e8-89e6-3886e2f5e894 tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:37:01.648048 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8d8e5e98-3407-45e8-89e6-3886e2f5e894 tempest-QuotasAdminNegativeTest-649237353 tempest-QuotasAdminNegativeTest-649237353-project] 10.222.0.79 "PUT /compute/v2.1/os-quota-sets/5d803a93e38d42deace52c7267f56fa2" status: 403 len: 116 microversion: 2.1 time: 0.027085 Oct 17 13:37:01.661808 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 452/903] 10.222.0.79 () {60 vars in 1262 bytes} [Mon Oct 17 13:37:01 2022] PUT /compute/v2.1/os-quota-sets/5d803a93e38d42deace52c7267f56fa2 => generated 116 bytes in 43 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:37:02.220925 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fc8bfd16-2f15-41b0-b620-5cc18326d5d2 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:02.233756 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fc8bfd16-2f15-41b0-b620-5cc18326d5d2 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/fe214f31-2995-4475-bcb7-ae4cec33a6f3" status: 200 len: 1316 microversion: 2.1 time: 1.158558 Oct 17 13:37:02.235767 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 452/904] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:01 2022] GET /compute/v2.1/servers/fe214f31-2995-4475-bcb7-ae4cec33a6f3 => generated 1316 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:37:02.634012 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a7679c90-189f-400c-9ca7-ae477058499d tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd56ac9d0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:02.653814 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-ba9b8158-bbc6-4975-b252-73cdb62b0eab req-ee62d843-08c0-4f03-93a3-f9fa3b31ef4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe214f31-2995-4475-bcb7-ae4cec33a6f3", "tag": "28daee5a-5db6-48a0-af1d-c8b795cbeeb0"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:02.737673 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-ba9b8158-bbc6-4975-b252-73cdb62b0eab req-ee62d843-08c0-4f03-93a3-f9fa3b31ef4d service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:02.756921 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-ba9b8158-bbc6-4975-b252-73cdb62b0eab req-ee62d843-08c0-4f03-93a3-f9fa3b31ef4d service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:02.758382 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-ba9b8158-bbc6-4975-b252-73cdb62b0eab req-ee62d843-08c0-4f03-93a3-f9fa3b31ef4d service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:02.783388 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a7679c90-189f-400c-9ca7-ae477058499d tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/2a2d7b14-a31e-4918-9ecb-2788c4cc869d" status: 200 len: 1414 microversion: 2.1 time: 0.141658 Oct 17 13:37:02.784472 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 453/905] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:37:02 2022] GET /compute/v2.1/images/2a2d7b14-a31e-4918-9ecb-2788c4cc869d => generated 1414 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:02.786442 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-ba9b8158-bbc6-4975-b252-73cdb62b0eab req-ee62d843-08c0-4f03-93a3-f9fa3b31ef4d service nova] Creating event network-changed:28daee5a-5db6-48a0-af1d-c8b795cbeeb0 for instance fe214f31-2995-4475-bcb7-ae4cec33a6f3 on n-h1-854247-14 Oct 17 13:37:02.797657 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-ba9b8158-bbc6-4975-b252-73cdb62b0eab req-ee62d843-08c0-4f03-93a3-f9fa3b31ef4d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148480 Oct 17 13:37:02.798648 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 453/906] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:37:03.270582 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8c218732-48d4-47a0-9e48-3ce3f7a6804d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:03.273305 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8c218732-48d4-47a0-9e48-3ce3f7a6804d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: fe214f31-2995-4475-bcb7-ae4cec33a6f3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:03.312273 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8c218732-48d4-47a0-9e48-3ce3f7a6804d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:03.314525 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8c218732-48d4-47a0-9e48-3ce3f7a6804d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:03.316861 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8c218732-48d4-47a0-9e48-3ce3f7a6804d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:03.317873 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8c218732-48d4-47a0-9e48-3ce3f7a6804d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:03.318793 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8c218732-48d4-47a0-9e48-3ce3f7a6804d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:03.320101 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8c218732-48d4-47a0-9e48-3ce3f7a6804d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:03.977277 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f369270d-1df9-4f17-8c0c-9984b2088bb9 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-368691542", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "46e81a55-75e1-43e4-b23d-9bbaa4d6fbd9"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:04.127211 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-f369270d-1df9-4f17-8c0c-9984b2088bb9 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] validate_networks() for [('46e81a55-75e1-43e4-b23d-9bbaa4d6fbd9', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:37:04.220975 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8c218732-48d4-47a0-9e48-3ce3f7a6804d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:04.236755 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8c218732-48d4-47a0-9e48-3ce3f7a6804d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/fe214f31-2995-4475-bcb7-ae4cec33a6f3" status: 200 len: 1316 microversion: 2.1 time: 0.972433 Oct 17 13:37:04.238609 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 454/907] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:03 2022] GET /compute/v2.1/servers/fe214f31-2995-4475-bcb7-ae4cec33a6f3 => generated 1316 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:37:04.264439 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4449a786-9b69-49fd-9178-aaff6e535ad4 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd55f25e0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:04.350554 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4449a786-9b69-49fd-9178-aaff6e535ad4 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/2a2d7b14-a31e-4918-9ecb-2788c4cc869d" status: 200 len: 1414 microversion: 2.1 time: 0.108447 Oct 17 13:37:04.352501 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 455/908] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:37:04 2022] GET /compute/v2.1/images/2a2d7b14-a31e-4918-9ecb-2788c4cc869d => generated 1414 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:05.263010 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b8a55a76-bbfa-494c-a555-c91f67929c94 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:05.263740 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b8a55a76-bbfa-494c-a555-c91f67929c94 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: fe214f31-2995-4475-bcb7-ae4cec33a6f3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:05.287378 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b8a55a76-bbfa-494c-a555-c91f67929c94 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:05.290114 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b8a55a76-bbfa-494c-a555-c91f67929c94 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:05.290905 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b8a55a76-bbfa-494c-a555-c91f67929c94 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:05.294501 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b8a55a76-bbfa-494c-a555-c91f67929c94 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:05.295342 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b8a55a76-bbfa-494c-a555-c91f67929c94 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:05.296121 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b8a55a76-bbfa-494c-a555-c91f67929c94 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:06.324832 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b8a55a76-bbfa-494c-a555-c91f67929c94 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:06.329694 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:37:06.359941 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b8a55a76-bbfa-494c-a555-c91f67929c94 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/fe214f31-2995-4475-bcb7-ae4cec33a6f3" status: 200 len: 1316 microversion: 2.1 time: 1.101504 Oct 17 13:37:06.361115 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 456/909] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:05 2022] GET /compute/v2.1/servers/fe214f31-2995-4475-bcb7-ae4cec33a6f3 => generated 1316 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:06.378039 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-381765a7-ae33-497c-b0ea-907242379b25 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd559b160>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:06.468556 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-381765a7-ae33-497c-b0ea-907242379b25 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/2a2d7b14-a31e-4918-9ecb-2788c4cc869d" status: 200 len: 1414 microversion: 2.1 time: 0.106128 Oct 17 13:37:06.469293 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 457/910] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:37:06 2022] GET /compute/v2.1/images/2a2d7b14-a31e-4918-9ecb-2788c4cc869d => generated 1414 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:07.384642 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-91e46559-7e8b-40fe-9012-c38b89be6f99 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:07.388211 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-91e46559-7e8b-40fe-9012-c38b89be6f99 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: fe214f31-2995-4475-bcb7-ae4cec33a6f3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:07.410062 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-91e46559-7e8b-40fe-9012-c38b89be6f99 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:07.411620 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-91e46559-7e8b-40fe-9012-c38b89be6f99 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:07.412224 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-91e46559-7e8b-40fe-9012-c38b89be6f99 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:07.427530 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-91e46559-7e8b-40fe-9012-c38b89be6f99 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:07.428607 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-91e46559-7e8b-40fe-9012-c38b89be6f99 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:07.429228 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-91e46559-7e8b-40fe-9012-c38b89be6f99 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:07.570790 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-f369270d-1df9-4f17-8c0c-9984b2088bb9 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:37:07.572040 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-f369270d-1df9-4f17-8c0c-9984b2088bb9 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:37:07.572752 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-f369270d-1df9-4f17-8c0c-9984b2088bb9 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:37:07.573331 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-f369270d-1df9-4f17-8c0c-9984b2088bb9 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:37:07.573906 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-f369270d-1df9-4f17-8c0c-9984b2088bb9 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:37:07.594568 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f369270d-1df9-4f17-8c0c-9984b2088bb9 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:07.595461 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f369270d-1df9-4f17-8c0c-9984b2088bb9 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:07.596085 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f369270d-1df9-4f17-8c0c-9984b2088bb9 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:07.599568 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f369270d-1df9-4f17-8c0c-9984b2088bb9 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:07.600283 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f369270d-1df9-4f17-8c0c-9984b2088bb9 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:07.600283 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f369270d-1df9-4f17-8c0c-9984b2088bb9 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:07.642810 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-f369270d-1df9-4f17-8c0c-9984b2088bb9 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Getting quotas for project c7507d1dd2d345ca9b59dcaa7806b56e. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:37:07.664902 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-f369270d-1df9-4f17-8c0c-9984b2088bb9 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Getting quotas for user dcbd60cab4174e8db26e28f015795e1f and project c7507d1dd2d345ca9b59dcaa7806b56e. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:37:07.691607 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f369270d-1df9-4f17-8c0c-9984b2088bb9 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:37:07.695536 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f369270d-1df9-4f17-8c0c-9984b2088bb9 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 008be895-7153-417e-9b87-5b60ea31d0bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:37:07.827662 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f369270d-1df9-4f17-8c0c-9984b2088bb9 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.572519 Oct 17 13:37:07.835521 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 454/911] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:37:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 4581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:37:07.840908 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ad39dab1-31f9-45ae-8f87-2447bd8e51a0 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd56acaf0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:07.935207 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ad39dab1-31f9-45ae-8f87-2447bd8e51a0 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/2a2d7b14-a31e-4918-9ecb-2788c4cc869d" status: 200 len: 1414 microversion: 2.1 time: 0.097482 Oct 17 13:37:07.938937 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 455/912] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:37:07 2022] GET /compute/v2.1/images/2a2d7b14-a31e-4918-9ecb-2788c4cc869d => generated 1414 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:07.954722 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e40ff14a-8f76-458e-9a19-18ef32d29d07 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:07.955669 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e40ff14a-8f76-458e-9a19-18ef32d29d07 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 008be895-7153-417e-9b87-5b60ea31d0bc] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:09.022909 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e40ff14a-8f76-458e-9a19-18ef32d29d07 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:09.031134 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e40ff14a-8f76-458e-9a19-18ef32d29d07 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc" status: 200 len: 1224 microversion: 2.1 time: 1.090635 Oct 17 13:37:09.056485 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 456/913] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:07 2022] GET /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc => generated 1224 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:09.078323 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-0f4f30ea-3cd8-40a1-a1c5-be5f762e6cbf req-bcd815b1-9303-4df6-af03-f1496502a1a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e72abb9-d4b5-4c67-8260-2828e3ab5ad2", "name": "network-vif-plugged", "status": "completed", "tag": "1ff9eaee-9a81-45c4-aac7-0297656e1256"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:09.106818 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-0f4f30ea-3cd8-40a1-a1c5-be5f762e6cbf req-bcd815b1-9303-4df6-af03-f1496502a1a4 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:09.107958 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-0f4f30ea-3cd8-40a1-a1c5-be5f762e6cbf req-bcd815b1-9303-4df6-af03-f1496502a1a4 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:09.108667 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-0f4f30ea-3cd8-40a1-a1c5-be5f762e6cbf req-bcd815b1-9303-4df6-af03-f1496502a1a4 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:09.142911 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-0f4f30ea-3cd8-40a1-a1c5-be5f762e6cbf req-bcd815b1-9303-4df6-af03-f1496502a1a4 service nova] Creating event network-vif-plugged:1ff9eaee-9a81-45c4-aac7-0297656e1256 for instance 9e72abb9-d4b5-4c67-8260-2828e3ab5ad2 on n-h2-854247-14 Oct 17 13:37:09.161460 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-91e46559-7e8b-40fe-9012-c38b89be6f99 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:09.163194 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-0f4f30ea-3cd8-40a1-a1c5-be5f762e6cbf req-bcd815b1-9303-4df6-af03-f1496502a1a4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102633 Oct 17 13:37:09.173140 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-91e46559-7e8b-40fe-9012-c38b89be6f99 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/fe214f31-2995-4475-bcb7-ae4cec33a6f3" status: 200 len: 1316 microversion: 2.1 time: 1.792862 Oct 17 13:37:09.173718 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 458/914] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:07 2022] GET /compute/v2.1/servers/fe214f31-2995-4475-bcb7-ae4cec33a6f3 => generated 1316 bytes in 1794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:09.174480 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 457/915] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:37:09.199505 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-08ae58e3-1c57-4c49-918e-9a6c5eca4480 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd559b790>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:09.290046 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-08ae58e3-1c57-4c49-918e-9a6c5eca4480 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/2a2d7b14-a31e-4918-9ecb-2788c4cc869d" status: 200 len: 1414 microversion: 2.1 time: 0.115117 Oct 17 13:37:09.292791 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 459/916] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:37:09 2022] GET /compute/v2.1/images/2a2d7b14-a31e-4918-9ecb-2788c4cc869d => generated 1414 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:10.064917 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f4dc2388-a443-4d71-add1-eb18ef46ea40 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:10.065862 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f4dc2388-a443-4d71-add1-eb18ef46ea40 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 008be895-7153-417e-9b87-5b60ea31d0bc] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:10.079890 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f4dc2388-a443-4d71-add1-eb18ef46ea40 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:10.081376 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f4dc2388-a443-4d71-add1-eb18ef46ea40 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:10.084287 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f4dc2388-a443-4d71-add1-eb18ef46ea40 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:10.086532 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f4dc2388-a443-4d71-add1-eb18ef46ea40 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:10.091005 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f4dc2388-a443-4d71-add1-eb18ef46ea40 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:10.092284 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f4dc2388-a443-4d71-add1-eb18ef46ea40 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:10.203331 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1567f78f-b9f3-4cec-80a9-1b8d0851e935 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:10.203962 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-1567f78f-b9f3-4cec-80a9-1b8d0851e935 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: fe214f31-2995-4475-bcb7-ae4cec33a6f3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:10.240012 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1567f78f-b9f3-4cec-80a9-1b8d0851e935 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:10.240522 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1567f78f-b9f3-4cec-80a9-1b8d0851e935 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:10.240958 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1567f78f-b9f3-4cec-80a9-1b8d0851e935 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:10.241675 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1567f78f-b9f3-4cec-80a9-1b8d0851e935 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:10.242120 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1567f78f-b9f3-4cec-80a9-1b8d0851e935 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:10.242607 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1567f78f-b9f3-4cec-80a9-1b8d0851e935 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:10.309947 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f4dc2388-a443-4d71-add1-eb18ef46ea40 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:10.323544 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f4dc2388-a443-4d71-add1-eb18ef46ea40 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc" status: 200 len: 1276 microversion: 2.1 time: 0.263400 Oct 17 13:37:10.326482 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 458/917] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:10 2022] GET /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc => generated 1276 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:10.340224 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-206e482f-c972-43e1-923e-a220d2afc37b tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd5692ee0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:10.426357 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-206e482f-c972-43e1-923e-a220d2afc37b tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/2a2d7b14-a31e-4918-9ecb-2788c4cc869d" status: 200 len: 1414 microversion: 2.1 time: 0.096055 Oct 17 13:37:10.427104 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 459/918] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:37:10 2022] GET /compute/v2.1/images/2a2d7b14-a31e-4918-9ecb-2788c4cc869d => generated 1414 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:10.800816 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-1567f78f-b9f3-4cec-80a9-1b8d0851e935 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:10.824159 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1567f78f-b9f3-4cec-80a9-1b8d0851e935 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/fe214f31-2995-4475-bcb7-ae4cec33a6f3" status: 200 len: 1316 microversion: 2.1 time: 0.611370 Oct 17 13:37:10.828510 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 460/919] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:10 2022] GET /compute/v2.1/servers/fe214f31-2995-4475-bcb7-ae4cec33a6f3 => generated 1316 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:11.355196 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d51397c5-2733-4c4a-b172-bee6278d2ff8 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:11.355954 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d51397c5-2733-4c4a-b172-bee6278d2ff8 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 008be895-7153-417e-9b87-5b60ea31d0bc] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:11.372549 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d51397c5-2733-4c4a-b172-bee6278d2ff8 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:11.375524 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d51397c5-2733-4c4a-b172-bee6278d2ff8 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:11.377483 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d51397c5-2733-4c4a-b172-bee6278d2ff8 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:11.379575 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d51397c5-2733-4c4a-b172-bee6278d2ff8 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:11.382207 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d51397c5-2733-4c4a-b172-bee6278d2ff8 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:11.385360 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d51397c5-2733-4c4a-b172-bee6278d2ff8 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:11.443321 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-49dbc957-d13c-4685-be22-27cb35c9349f tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd55333a0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:11.471310 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=12 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:37:11.475609 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=48 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:37:11.527439 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-49dbc957-d13c-4685-be22-27cb35c9349f tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/2a2d7b14-a31e-4918-9ecb-2788c4cc869d" status: 200 len: 1414 microversion: 2.1 time: 0.088240 Oct 17 13:37:11.531766 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d51397c5-2733-4c4a-b172-bee6278d2ff8 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:11.532042 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 461/920] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:37:11 2022] GET /compute/v2.1/images/2a2d7b14-a31e-4918-9ecb-2788c4cc869d => generated 1414 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:11.540968 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d51397c5-2733-4c4a-b172-bee6278d2ff8 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc" status: 200 len: 1282 microversion: 2.1 time: 0.190639 Oct 17 13:37:11.544620 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 460/921] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:11 2022] GET /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc => generated 1282 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:11.862652 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-37b6e5a7-87df-4fa0-8be9-7938711a6ff5 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:11.863721 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-37b6e5a7-87df-4fa0-8be9-7938711a6ff5 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: fe214f31-2995-4475-bcb7-ae4cec33a6f3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:11.885707 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-37b6e5a7-87df-4fa0-8be9-7938711a6ff5 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:11.890451 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-37b6e5a7-87df-4fa0-8be9-7938711a6ff5 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:11.893620 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-37b6e5a7-87df-4fa0-8be9-7938711a6ff5 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:11.894390 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-37b6e5a7-87df-4fa0-8be9-7938711a6ff5 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:11.898122 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-37b6e5a7-87df-4fa0-8be9-7938711a6ff5 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:11.898944 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-37b6e5a7-87df-4fa0-8be9-7938711a6ff5 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:12.239794 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-37b6e5a7-87df-4fa0-8be9-7938711a6ff5 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:12.250155 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-37b6e5a7-87df-4fa0-8be9-7938711a6ff5 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/fe214f31-2995-4475-bcb7-ae4cec33a6f3" status: 200 len: 1316 microversion: 2.1 time: 0.402993 Oct 17 13:37:12.252245 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 462/922] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:11 2022] GET /compute/v2.1/servers/fe214f31-2995-4475-bcb7-ae4cec33a6f3 => generated 1316 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:37:12.459663 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-658d7a74-a925-438a-b9e1-fb4c6962a4e7 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Action: 'create', calling method: .version_select at 0x7f7cd5692040>, body: {"keypair": {"name": "tempest-keypair-1561111317", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZWW45JqL2uBAZ6OzUKq7rCXXj3VFvLbRn3F7LjbqhvnMQB44mlzmoOuuqJaglm1JyKQwjh5yL8TC3ShU24Apb9jgdBZXNwqA/bFXAFtdr4SfWeTZNqSgr261fa18W+UA=="}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:12.508489 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-658d7a74-a925-438a-b9e1-fb4c6962a4e7 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Getting quotas for project 63faec71e9ad449896c83868d52dd09c. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:37:12.520806 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-658d7a74-a925-438a-b9e1-fb4c6962a4e7 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Getting quotas for user a23b9d586c57421abf53a7eaa3af9b81 and project 63faec71e9ad449896c83868d52dd09c. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:37:12.547288 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-841d2eb4-3dac-4cc9-8bf0-e1cce871a294 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd5663160>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:12.651197 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-841d2eb4-3dac-4cc9-8bf0-e1cce871a294 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/2a2d7b14-a31e-4918-9ecb-2788c4cc869d" status: 200 len: 1414 microversion: 2.1 time: 0.108690 Oct 17 13:37:12.651775 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 463/923] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:37:12 2022] GET /compute/v2.1/images/2a2d7b14-a31e-4918-9ecb-2788c4cc869d => generated 1414 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:37:12.659753 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-658d7a74-a925-438a-b9e1-fb4c6962a4e7 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.370619 Oct 17 13:37:12.662240 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 461/924] 10.222.0.79 () {60 vars in 1159 bytes} [Mon Oct 17 13:37:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:37:12.687394 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2b5a0c35-9bd6-4ed7-b076-2e263de3274d tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:12.687394 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2b5a0c35-9bd6-4ed7-b076-2e263de3274d tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 008be895-7153-417e-9b87-5b60ea31d0bc] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:12.745504 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2b5a0c35-9bd6-4ed7-b076-2e263de3274d tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:12.752410 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2b5a0c35-9bd6-4ed7-b076-2e263de3274d tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:12.757730 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2b5a0c35-9bd6-4ed7-b076-2e263de3274d tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:12.762027 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2b5a0c35-9bd6-4ed7-b076-2e263de3274d tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:12.763567 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2b5a0c35-9bd6-4ed7-b076-2e263de3274d tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:12.766980 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2b5a0c35-9bd6-4ed7-b076-2e263de3274d tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:13.089761 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2b5a0c35-9bd6-4ed7-b076-2e263de3274d tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:13.105672 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2b5a0c35-9bd6-4ed7-b076-2e263de3274d tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc" status: 200 len: 1282 microversion: 2.1 time: 0.452822 Oct 17 13:37:13.110439 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 464/925] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:12 2022] GET /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc => generated 1282 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:13.275866 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0d5f88ef-d987-418e-8f75-c11202e80c70 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:13.277548 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0d5f88ef-d987-418e-8f75-c11202e80c70 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: fe214f31-2995-4475-bcb7-ae4cec33a6f3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:13.293017 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0d5f88ef-d987-418e-8f75-c11202e80c70 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:13.294144 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0d5f88ef-d987-418e-8f75-c11202e80c70 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:13.296356 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0d5f88ef-d987-418e-8f75-c11202e80c70 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:13.299599 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0d5f88ef-d987-418e-8f75-c11202e80c70 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:13.300271 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0d5f88ef-d987-418e-8f75-c11202e80c70 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:13.300946 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0d5f88ef-d987-418e-8f75-c11202e80c70 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:13.781952 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0d5f88ef-d987-418e-8f75-c11202e80c70 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:13.800217 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0d5f88ef-d987-418e-8f75-c11202e80c70 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/fe214f31-2995-4475-bcb7-ae4cec33a6f3" status: 200 len: 1316 microversion: 2.1 time: 0.528569 Oct 17 13:37:13.801633 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 462/926] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:13 2022] GET /compute/v2.1/servers/fe214f31-2995-4475-bcb7-ae4cec33a6f3 => generated 1316 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:13.820432 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0eab8ddb-5e51-4569-977e-45a010753984 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd5692670>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:13.847073 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-03bce23c-1be5-469f-a23d-a2aa07b78d7e tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-687408752", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:14.035775 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0eab8ddb-5e51-4569-977e-45a010753984 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/2a2d7b14-a31e-4918-9ecb-2788c4cc869d" status: 200 len: 1414 microversion: 2.1 time: 0.232784 Oct 17 13:37:14.036364 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 463/927] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:37:13 2022] GET /compute/v2.1/images/2a2d7b14-a31e-4918-9ecb-2788c4cc869d => generated 1414 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:14.045834 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-03bce23c-1be5-469f-a23d-a2aa07b78d7e tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] validate_networks() for None {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:37:14.136539 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5b660a80-a989-4e38-8437-c8d43887677a tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:14.153549 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5b660a80-a989-4e38-8437-c8d43887677a tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 008be895-7153-417e-9b87-5b60ea31d0bc] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:14.169745 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5b660a80-a989-4e38-8437-c8d43887677a tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:14.172513 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5b660a80-a989-4e38-8437-c8d43887677a tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:14.173250 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5b660a80-a989-4e38-8437-c8d43887677a tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:14.174117 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5b660a80-a989-4e38-8437-c8d43887677a tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:14.176575 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5b660a80-a989-4e38-8437-c8d43887677a tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:14.177195 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5b660a80-a989-4e38-8437-c8d43887677a tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:15.064221 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5b660a80-a989-4e38-8437-c8d43887677a tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:15.078311 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5b660a80-a989-4e38-8437-c8d43887677a tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc" status: 200 len: 1324 microversion: 2.1 time: 0.947269 Oct 17 13:37:15.079351 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 464/928] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:14 2022] GET /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc => generated 1324 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:15.084390 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4651dc7c-4246-45c2-9e6f-85fd40d6e9fc tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:15.090848 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4651dc7c-4246-45c2-9e6f-85fd40d6e9fc tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: fe214f31-2995-4475-bcb7-ae4cec33a6f3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:15.110241 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4651dc7c-4246-45c2-9e6f-85fd40d6e9fc tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:15.111802 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4651dc7c-4246-45c2-9e6f-85fd40d6e9fc tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:15.118480 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4651dc7c-4246-45c2-9e6f-85fd40d6e9fc tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:15.133509 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4651dc7c-4246-45c2-9e6f-85fd40d6e9fc tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:15.134567 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4651dc7c-4246-45c2-9e6f-85fd40d6e9fc tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:15.135305 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4651dc7c-4246-45c2-9e6f-85fd40d6e9fc tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:15.570681 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-03bce23c-1be5-469f-a23d-a2aa07b78d7e tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:37:15.571393 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-03bce23c-1be5-469f-a23d-a2aa07b78d7e tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:37:15.571977 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-03bce23c-1be5-469f-a23d-a2aa07b78d7e tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:37:15.572508 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-03bce23c-1be5-469f-a23d-a2aa07b78d7e tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:37:15.573020 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-03bce23c-1be5-469f-a23d-a2aa07b78d7e tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:37:15.630885 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-03bce23c-1be5-469f-a23d-a2aa07b78d7e tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:15.640658 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-03bce23c-1be5-469f-a23d-a2aa07b78d7e tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:15.641741 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-03bce23c-1be5-469f-a23d-a2aa07b78d7e tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:15.649307 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-03bce23c-1be5-469f-a23d-a2aa07b78d7e tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:15.656622 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-03bce23c-1be5-469f-a23d-a2aa07b78d7e tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:15.658693 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-03bce23c-1be5-469f-a23d-a2aa07b78d7e tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:15.728724 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-03bce23c-1be5-469f-a23d-a2aa07b78d7e tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Getting quotas for project 71fb92d4cf8c4016b31773ce48bf2ec6. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:37:15.744903 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-03bce23c-1be5-469f-a23d-a2aa07b78d7e tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Getting quotas for user b04053f6ae4d4d0cb32c11b5c94c38ef and project 71fb92d4cf8c4016b31773ce48bf2ec6. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:37:15.793006 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-03bce23c-1be5-469f-a23d-a2aa07b78d7e tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:37:15.797636 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-03bce23c-1be5-469f-a23d-a2aa07b78d7e tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] [instance: 0d642292-0447-42da-a7cf-9d15762db2ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:37:15.925306 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-03bce23c-1be5-469f-a23d-a2aa07b78d7e tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.590724 Oct 17 13:37:15.932121 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 465/929] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:37:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:37:15.949133 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-11369504-ee16-4a7e-be54-7a6738d13216 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd558ab80>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:16.117002 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-11369504-ee16-4a7e-be54-7a6738d13216 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/2a2d7b14-a31e-4918-9ecb-2788c4cc869d" status: 200 len: 1414 microversion: 2.1 time: 0.181843 Oct 17 13:37:16.120059 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 466/930] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:37:15 2022] GET /compute/v2.1/images/2a2d7b14-a31e-4918-9ecb-2788c4cc869d => generated 1414 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:16.135076 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0252fe07-5ccc-4c49-8e11-25470a035ced tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:16.139846 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0252fe07-5ccc-4c49-8e11-25470a035ced tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] [instance: 0d642292-0447-42da-a7cf-9d15762db2ab] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:16.501724 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0252fe07-5ccc-4c49-8e11-25470a035ced tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04053f6ae4d4d0cb32c11b5c94c38ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fb92d4cf8c4016b31773ce48bf2ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:16.533796 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0252fe07-5ccc-4c49-8e11-25470a035ced tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] 10.222.0.79 "GET /compute/v2.1/servers/0d642292-0447-42da-a7cf-9d15762db2ab" status: 200 len: 1222 microversion: 2.1 time: 0.393369 Oct 17 13:37:16.533796 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 467/931] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:16 2022] GET /compute/v2.1/servers/0d642292-0447-42da-a7cf-9d15762db2ab => generated 1222 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:16.571709 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8c557136-6c01-4c63-9180-04a68c5a47fa tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:16.574647 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8c557136-6c01-4c63-9180-04a68c5a47fa tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 008be895-7153-417e-9b87-5b60ea31d0bc] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:16.595994 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8c557136-6c01-4c63-9180-04a68c5a47fa tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:16.596594 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8c557136-6c01-4c63-9180-04a68c5a47fa tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:16.597154 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8c557136-6c01-4c63-9180-04a68c5a47fa tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:16.597953 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8c557136-6c01-4c63-9180-04a68c5a47fa tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:16.601978 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8c557136-6c01-4c63-9180-04a68c5a47fa tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:16.602577 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8c557136-6c01-4c63-9180-04a68c5a47fa tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:16.612147 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4651dc7c-4246-45c2-9e6f-85fd40d6e9fc tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:16.625073 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4651dc7c-4246-45c2-9e6f-85fd40d6e9fc tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/fe214f31-2995-4475-bcb7-ae4cec33a6f3" status: 200 len: 1316 microversion: 2.1 time: 1.544343 Oct 17 13:37:16.629009 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 465/932] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:15 2022] GET /compute/v2.1/servers/fe214f31-2995-4475-bcb7-ae4cec33a6f3 => generated 1316 bytes in 1549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:17.134455 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4b528cd1-ba5a-43ec-a322-2af1dbeb9704 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd573eaf0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:17.215390 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4b528cd1-ba5a-43ec-a322-2af1dbeb9704 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/2a2d7b14-a31e-4918-9ecb-2788c4cc869d" status: 200 len: 1414 microversion: 2.1 time: 0.085394 Oct 17 13:37:17.216283 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 466/933] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:37:17 2022] GET /compute/v2.1/images/2a2d7b14-a31e-4918-9ecb-2788c4cc869d => generated 1414 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:17.242299 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8c557136-6c01-4c63-9180-04a68c5a47fa tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:17.256119 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8c557136-6c01-4c63-9180-04a68c5a47fa tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc" status: 200 len: 1324 microversion: 2.1 time: 0.721432 Oct 17 13:37:17.271612 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 468/934] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:16 2022] GET /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc => generated 1324 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:17.561990 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f59903c1-52b8-4110-b827-2b45f51fc9e9 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:17.563086 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f59903c1-52b8-4110-b827-2b45f51fc9e9 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] [instance: 0d642292-0447-42da-a7cf-9d15762db2ab] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:17.575554 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f59903c1-52b8-4110-b827-2b45f51fc9e9 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:17.580109 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f59903c1-52b8-4110-b827-2b45f51fc9e9 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:17.580952 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f59903c1-52b8-4110-b827-2b45f51fc9e9 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:17.582314 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f59903c1-52b8-4110-b827-2b45f51fc9e9 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:17.583542 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f59903c1-52b8-4110-b827-2b45f51fc9e9 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:17.590991 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f59903c1-52b8-4110-b827-2b45f51fc9e9 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:17.649293 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4a98759a-f9ac-49a9-ae92-66ac045449d9 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:17.650548 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4a98759a-f9ac-49a9-ae92-66ac045449d9 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: fe214f31-2995-4475-bcb7-ae4cec33a6f3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:17.665758 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=10 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:37:17.667950 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4a98759a-f9ac-49a9-ae92-66ac045449d9 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:17.671230 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4a98759a-f9ac-49a9-ae92-66ac045449d9 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:17.675485 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4a98759a-f9ac-49a9-ae92-66ac045449d9 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:17.677157 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4a98759a-f9ac-49a9-ae92-66ac045449d9 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:17.678875 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4a98759a-f9ac-49a9-ae92-66ac045449d9 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:17.680499 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4a98759a-f9ac-49a9-ae92-66ac045449d9 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:17.880343 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f59903c1-52b8-4110-b827-2b45f51fc9e9 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04053f6ae4d4d0cb32c11b5c94c38ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fb92d4cf8c4016b31773ce48bf2ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:17.901241 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f59903c1-52b8-4110-b827-2b45f51fc9e9 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] 10.222.0.79 "GET /compute/v2.1/servers/0d642292-0447-42da-a7cf-9d15762db2ab" status: 200 len: 1218 microversion: 2.1 time: 0.339679 Oct 17 13:37:17.901916 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 467/935] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:17 2022] GET /compute/v2.1/servers/0d642292-0447-42da-a7cf-9d15762db2ab => generated 1218 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:17.920035 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-22fdedbe-5c59-4fe8-a713-2c745fdcc58f tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:17.934874 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-22fdedbe-5c59-4fe8-a713-2c745fdcc58f tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] [instance: a54adf11-ee58-4f13-82c8-9a00a36c536e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:18.000515 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-22fdedbe-5c59-4fe8-a713-2c745fdcc58f tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:18.001359 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-22fdedbe-5c59-4fe8-a713-2c745fdcc58f tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:18.007747 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-22fdedbe-5c59-4fe8-a713-2c745fdcc58f tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:18.018461 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-22fdedbe-5c59-4fe8-a713-2c745fdcc58f tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:18.019051 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-22fdedbe-5c59-4fe8-a713-2c745fdcc58f tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:18.019530 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-22fdedbe-5c59-4fe8-a713-2c745fdcc58f tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:18.320827 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4a98759a-f9ac-49a9-ae92-66ac045449d9 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:18.340436 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4a98759a-f9ac-49a9-ae92-66ac045449d9 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/fe214f31-2995-4475-bcb7-ae4cec33a6f3" status: 200 len: 1316 microversion: 2.1 time: 0.692719 Oct 17 13:37:18.341677 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 469/936] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:17 2022] GET /compute/v2.1/servers/fe214f31-2995-4475-bcb7-ae4cec33a6f3 => generated 1316 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:18.366167 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-0887cbb4-dada-43dc-bf72-4423f83081fd req-e71a4116-ed33-4a39-b8d9-d1713b909a06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe214f31-2995-4475-bcb7-ae4cec33a6f3", "name": "network-vif-plugged", "status": "completed", "tag": "28daee5a-5db6-48a0-af1d-c8b795cbeeb0"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:18.397688 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-0887cbb4-dada-43dc-bf72-4423f83081fd req-e71a4116-ed33-4a39-b8d9-d1713b909a06 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:18.398429 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-0887cbb4-dada-43dc-bf72-4423f83081fd req-e71a4116-ed33-4a39-b8d9-d1713b909a06 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:18.399260 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-0887cbb4-dada-43dc-bf72-4423f83081fd req-e71a4116-ed33-4a39-b8d9-d1713b909a06 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:18.429087 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-0887cbb4-dada-43dc-bf72-4423f83081fd req-e71a4116-ed33-4a39-b8d9-d1713b909a06 service nova] Creating event network-vif-plugged:28daee5a-5db6-48a0-af1d-c8b795cbeeb0 for instance fe214f31-2995-4475-bcb7-ae4cec33a6f3 on n-h1-854247-14 Oct 17 13:37:18.444098 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-0887cbb4-dada-43dc-bf72-4423f83081fd req-e71a4116-ed33-4a39-b8d9-d1713b909a06 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101056 Oct 17 13:37:18.451136 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 470/937] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:37:18.463582 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9b6782dc-0e31-4b54-9363-052776272664 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd55843a0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:18.570399 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9b6782dc-0e31-4b54-9363-052776272664 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/2a2d7b14-a31e-4918-9ecb-2788c4cc869d" status: 200 len: 1414 microversion: 2.1 time: 0.117559 Oct 17 13:37:18.571314 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 471/938] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:37:18 2022] GET /compute/v2.1/images/2a2d7b14-a31e-4918-9ecb-2788c4cc869d => generated 1414 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:18.581053 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-32541f03-2be2-4721-b31d-7a7c436d4af6 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:18.585655 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-32541f03-2be2-4721-b31d-7a7c436d4af6 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 008be895-7153-417e-9b87-5b60ea31d0bc] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:18.603898 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-32541f03-2be2-4721-b31d-7a7c436d4af6 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:18.605737 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-32541f03-2be2-4721-b31d-7a7c436d4af6 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:18.607493 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-32541f03-2be2-4721-b31d-7a7c436d4af6 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:18.610761 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-32541f03-2be2-4721-b31d-7a7c436d4af6 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:18.611985 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-32541f03-2be2-4721-b31d-7a7c436d4af6 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:18.612824 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-32541f03-2be2-4721-b31d-7a7c436d4af6 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:19.016529 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-22fdedbe-5c59-4fe8-a713-2c745fdcc58f tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e" status: 200 len: 1811 microversion: 2.1 time: 1.113497 Oct 17 13:37:19.025036 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 468/939] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:17 2022] GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e => generated 1811 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:19.058033 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b795870a-4dc9-441c-80ef-092d5abd3372 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:19.065748 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b795870a-4dc9-441c-80ef-092d5abd3372 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] [instance: 0d642292-0447-42da-a7cf-9d15762db2ab] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:19.105949 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b795870a-4dc9-441c-80ef-092d5abd3372 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:19.108036 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b795870a-4dc9-441c-80ef-092d5abd3372 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:19.108725 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b795870a-4dc9-441c-80ef-092d5abd3372 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:19.112808 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b795870a-4dc9-441c-80ef-092d5abd3372 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:19.116208 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b795870a-4dc9-441c-80ef-092d5abd3372 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:19.116778 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b795870a-4dc9-441c-80ef-092d5abd3372 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:20.224391 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b795870a-4dc9-441c-80ef-092d5abd3372 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04053f6ae4d4d0cb32c11b5c94c38ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fb92d4cf8c4016b31773ce48bf2ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:20.240441 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b795870a-4dc9-441c-80ef-092d5abd3372 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] 10.222.0.79 "GET /compute/v2.1/servers/0d642292-0447-42da-a7cf-9d15762db2ab" status: 200 len: 1280 microversion: 2.1 time: 1.214073 Oct 17 13:37:20.243114 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 469/940] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:19 2022] GET /compute/v2.1/servers/0d642292-0447-42da-a7cf-9d15762db2ab => generated 1280 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:20.256678 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-44225311-582b-4c8e-9562-1a8829ae87b5 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:20.266712 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-44225311-582b-4c8e-9562-1a8829ae87b5 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:20.267227 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-44225311-582b-4c8e-9562-1a8829ae87b5 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:20.267672 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-44225311-582b-4c8e-9562-1a8829ae87b5 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:20.279250 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-44225311-582b-4c8e-9562-1a8829ae87b5 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:20.281969 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-44225311-582b-4c8e-9562-1a8829ae87b5 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:20.282439 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-44225311-582b-4c8e-9562-1a8829ae87b5 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:20.349040 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-44225311-582b-4c8e-9562-1a8829ae87b5 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.104763 Oct 17 13:37:20.393252 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 470/941] 10.222.0.79 () {58 vars in 1176 bytes} [Mon Oct 17 13:37:20 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:37:20.426341 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7ed6e60f-04cc-47ab-9be0-c6678649ddcb tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:20.427611 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7ed6e60f-04cc-47ab-9be0-c6678649ddcb tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: fe214f31-2995-4475-bcb7-ae4cec33a6f3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:20.438533 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7ed6e60f-04cc-47ab-9be0-c6678649ddcb tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:20.439574 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7ed6e60f-04cc-47ab-9be0-c6678649ddcb tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:20.440341 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7ed6e60f-04cc-47ab-9be0-c6678649ddcb tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:20.441400 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7ed6e60f-04cc-47ab-9be0-c6678649ddcb tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:20.442144 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7ed6e60f-04cc-47ab-9be0-c6678649ddcb tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:20.442798 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7ed6e60f-04cc-47ab-9be0-c6678649ddcb tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:21.502692 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-32541f03-2be2-4721-b31d-7a7c436d4af6 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:21.527750 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-32541f03-2be2-4721-b31d-7a7c436d4af6 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc" status: 200 len: 1324 microversion: 2.1 time: 2.954613 Oct 17 13:37:21.531887 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 472/942] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:18 2022] GET /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc => generated 1324 bytes in 2960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:21.556652 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6ce4e08a-c49b-43b9-8ba5-25374c20514d tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd56630d0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:21.705994 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6ce4e08a-c49b-43b9-8ba5-25374c20514d tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/2a2d7b14-a31e-4918-9ecb-2788c4cc869d" status: 200 len: 1414 microversion: 2.1 time: 0.166741 Oct 17 13:37:21.708576 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 473/943] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:37:21 2022] GET /compute/v2.1/images/2a2d7b14-a31e-4918-9ecb-2788c4cc869d => generated 1414 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:21.719618 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c6f73c1e-5dc7-4a39-a97d-96b6c265324c tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2127983727", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "99703e36-844e-451a-b1d1-5eb4f79a2f77"}], "security_groups": [{"name": "tempest-securitygroup--1081995078"}], "key_name": "tempest-keypair-1561111317", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:22.180950 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7ed6e60f-04cc-47ab-9be0-c6678649ddcb tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:22.213446 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7ed6e60f-04cc-47ab-9be0-c6678649ddcb tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/fe214f31-2995-4475-bcb7-ae4cec33a6f3" status: 200 len: 1316 microversion: 2.1 time: 1.817676 Oct 17 13:37:22.219315 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 471/944] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:20 2022] GET /compute/v2.1/servers/fe214f31-2995-4475-bcb7-ae4cec33a6f3 => generated 1316 bytes in 1824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:22.223382 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-c6f73c1e-5dc7-4a39-a97d-96b6c265324c tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] validate_networks() for [('99703e36-844e-451a-b1d1-5eb4f79a2f77', None, None, None, None, None)] {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:37:22.248745 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-16a52744-2577-49ca-8ac8-b3bdda5dd8c1 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:22.253157 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-16a52744-2577-49ca-8ac8-b3bdda5dd8c1 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] [instance: 0d642292-0447-42da-a7cf-9d15762db2ab] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:22.292328 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-16a52744-2577-49ca-8ac8-b3bdda5dd8c1 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:22.299363 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-16a52744-2577-49ca-8ac8-b3bdda5dd8c1 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:22.300509 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-16a52744-2577-49ca-8ac8-b3bdda5dd8c1 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:22.309725 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-16a52744-2577-49ca-8ac8-b3bdda5dd8c1 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:22.312518 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-16a52744-2577-49ca-8ac8-b3bdda5dd8c1 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:22.315385 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-16a52744-2577-49ca-8ac8-b3bdda5dd8c1 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:22.578509 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=44 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:37:22.636427 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-16a52744-2577-49ca-8ac8-b3bdda5dd8c1 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04053f6ae4d4d0cb32c11b5c94c38ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fb92d4cf8c4016b31773ce48bf2ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:22.647900 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-16a52744-2577-49ca-8ac8-b3bdda5dd8c1 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] 10.222.0.79 "GET /compute/v2.1/servers/0d642292-0447-42da-a7cf-9d15762db2ab" status: 200 len: 1280 microversion: 2.1 time: 0.427122 Oct 17 13:37:22.658270 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 472/945] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:22 2022] GET /compute/v2.1/servers/0d642292-0447-42da-a7cf-9d15762db2ab => generated 1280 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:22.663561 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-03b9fc60-b723-43a8-a0bd-8628782ea19b req-80592841-1496-436d-bc1b-ae88f871bea9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "008be895-7153-417e-9b87-5b60ea31d0bc", "tag": "3a95ce9b-0623-4736-9d6e-2c8a93af74d8"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:22.691665 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-03b9fc60-b723-43a8-a0bd-8628782ea19b req-80592841-1496-436d-bc1b-ae88f871bea9 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:22.695870 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-03b9fc60-b723-43a8-a0bd-8628782ea19b req-80592841-1496-436d-bc1b-ae88f871bea9 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:22.701671 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-03b9fc60-b723-43a8-a0bd-8628782ea19b req-80592841-1496-436d-bc1b-ae88f871bea9 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:22.763975 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-03b9fc60-b723-43a8-a0bd-8628782ea19b req-80592841-1496-436d-bc1b-ae88f871bea9 service nova] Creating event network-changed:3a95ce9b-0623-4736-9d6e-2c8a93af74d8 for instance 008be895-7153-417e-9b87-5b60ea31d0bc on n-h2-854247-14 Oct 17 13:37:22.777074 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-03b9fc60-b723-43a8-a0bd-8628782ea19b req-80592841-1496-436d-bc1b-ae88f871bea9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117167 Oct 17 13:37:22.785850 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 473/946] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:37:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:37:22.808503 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-aceb8b67-adaa-40b8-a6ec-bee4e8542ccd tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:22.809069 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-aceb8b67-adaa-40b8-a6ec-bee4e8542ccd tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 008be895-7153-417e-9b87-5b60ea31d0bc] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:22.901835 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aceb8b67-adaa-40b8-a6ec-bee4e8542ccd tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:22.902680 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aceb8b67-adaa-40b8-a6ec-bee4e8542ccd tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:22.905644 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aceb8b67-adaa-40b8-a6ec-bee4e8542ccd tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:22.906597 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aceb8b67-adaa-40b8-a6ec-bee4e8542ccd tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:22.909324 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aceb8b67-adaa-40b8-a6ec-bee4e8542ccd tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:22.910462 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aceb8b67-adaa-40b8-a6ec-bee4e8542ccd tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:24.261669 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-aceb8b67-adaa-40b8-a6ec-bee4e8542ccd tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:24.275718 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-aceb8b67-adaa-40b8-a6ec-bee4e8542ccd tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc" status: 200 len: 1324 microversion: 2.1 time: 1.488391 Oct 17 13:37:24.297728 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 474/947] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:22 2022] GET /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc => generated 1324 bytes in 1510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:24.333997 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5bd35d7b-30c5-430e-ba0f-d91d6fb1198f tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd571f160>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:24.426856 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5bd35d7b-30c5-430e-ba0f-d91d6fb1198f tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/2a2d7b14-a31e-4918-9ecb-2788c4cc869d" status: 200 len: 1414 microversion: 2.1 time: 0.126011 Oct 17 13:37:24.427490 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 475/948] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:37:24 2022] GET /compute/v2.1/images/2a2d7b14-a31e-4918-9ecb-2788c4cc869d => generated 1414 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:24.433742 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-177ec332-7b43-4a71-9942-a773aa2266de tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:24.434360 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-177ec332-7b43-4a71-9942-a773aa2266de tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: fe214f31-2995-4475-bcb7-ae4cec33a6f3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:24.484361 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-177ec332-7b43-4a71-9942-a773aa2266de tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:24.485209 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-177ec332-7b43-4a71-9942-a773aa2266de tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:24.485811 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-177ec332-7b43-4a71-9942-a773aa2266de tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:24.486908 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-177ec332-7b43-4a71-9942-a773aa2266de tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:24.487548 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-177ec332-7b43-4a71-9942-a773aa2266de tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:24.488383 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-177ec332-7b43-4a71-9942-a773aa2266de tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:24.495805 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=100 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:37:25.702063 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:37:25.837162 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-177ec332-7b43-4a71-9942-a773aa2266de tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:25.847311 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-177ec332-7b43-4a71-9942-a773aa2266de tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/fe214f31-2995-4475-bcb7-ae4cec33a6f3" status: 200 len: 1465 microversion: 2.1 time: 1.418747 Oct 17 13:37:25.852264 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 476/949] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:24 2022] GET /compute/v2.1/servers/fe214f31-2995-4475-bcb7-ae4cec33a6f3 => generated 1465 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:25.859264 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-83c1a672-050a-4c69-b4d5-047c88e23a6d tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:25.866133 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-83c1a672-050a-4c69-b4d5-047c88e23a6d tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] [instance: 0d642292-0447-42da-a7cf-9d15762db2ab] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:25.885500 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-83c1a672-050a-4c69-b4d5-047c88e23a6d tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:25.887641 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-83c1a672-050a-4c69-b4d5-047c88e23a6d tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:25.890152 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-83c1a672-050a-4c69-b4d5-047c88e23a6d tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:25.894553 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-83c1a672-050a-4c69-b4d5-047c88e23a6d tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:25.895596 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-83c1a672-050a-4c69-b4d5-047c88e23a6d tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:25.897039 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-83c1a672-050a-4c69-b4d5-047c88e23a6d tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:25.905512 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-c6f73c1e-5dc7-4a39-a97d-96b6c265324c tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Getting quotas for project 63faec71e9ad449896c83868d52dd09c. Resources: dict_keys(['metadata_items']) {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:37:25.917892 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-c6f73c1e-5dc7-4a39-a97d-96b6c265324c tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Getting quotas for user a23b9d586c57421abf53a7eaa3af9b81 and project 63faec71e9ad449896c83868d52dd09c. Resources: dict_keys(['metadata_items']) {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:37:25.953360 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:37:25.958090 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-c6f73c1e-5dc7-4a39-a97d-96b6c265324c tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:37:25.958090 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-c6f73c1e-5dc7-4a39-a97d-96b6c265324c tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:37:25.958090 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-c6f73c1e-5dc7-4a39-a97d-96b6c265324c tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:37:25.960050 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-c6f73c1e-5dc7-4a39-a97d-96b6c265324c tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:37:25.960765 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-c6f73c1e-5dc7-4a39-a97d-96b6c265324c tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:37:25.978562 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c6f73c1e-5dc7-4a39-a97d-96b6c265324c tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:25.979458 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c6f73c1e-5dc7-4a39-a97d-96b6c265324c tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:25.980340 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c6f73c1e-5dc7-4a39-a97d-96b6c265324c tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:25.981452 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c6f73c1e-5dc7-4a39-a97d-96b6c265324c tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:25.983705 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c6f73c1e-5dc7-4a39-a97d-96b6c265324c tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:25.984383 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c6f73c1e-5dc7-4a39-a97d-96b6c265324c tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:26.022944 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-c6f73c1e-5dc7-4a39-a97d-96b6c265324c tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Getting quotas for project 63faec71e9ad449896c83868d52dd09c. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:37:26.029005 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-c6f73c1e-5dc7-4a39-a97d-96b6c265324c tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Getting quotas for user a23b9d586c57421abf53a7eaa3af9b81 and project 63faec71e9ad449896c83868d52dd09c. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:37:26.043985 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c6f73c1e-5dc7-4a39-a97d-96b6c265324c tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:37:26.046814 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c6f73c1e-5dc7-4a39-a97d-96b6c265324c tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] [instance: 82f35c2e-21ad-448d-a198-6847bf664d52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:37:26.104790 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-83c1a672-050a-4c69-b4d5-047c88e23a6d tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04053f6ae4d4d0cb32c11b5c94c38ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fb92d4cf8c4016b31773ce48bf2ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:26.110888 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-83c1a672-050a-4c69-b4d5-047c88e23a6d tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] 10.222.0.79 "GET /compute/v2.1/servers/0d642292-0447-42da-a7cf-9d15762db2ab" status: 200 len: 1280 microversion: 2.1 time: 0.255570 Oct 17 13:37:26.116447 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 477/950] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:25 2022] GET /compute/v2.1/servers/0d642292-0447-42da-a7cf-9d15762db2ab => generated 1280 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:26.124190 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b6d386f1-b097-49f0-8df1-e38f9f9aecd2 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:26.133469 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b6d386f1-b097-49f0-8df1-e38f9f9aecd2 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 008be895-7153-417e-9b87-5b60ea31d0bc] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:26.136022 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c6f73c1e-5dc7-4a39-a97d-96b6c265324c tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 4.425177 Oct 17 13:37:26.138083 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 474/951] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:37:21 2022] POST /compute/v2.1/servers => generated 407 bytes in 4429 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:37:26.144854 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b6d386f1-b097-49f0-8df1-e38f9f9aecd2 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:26.145699 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b6d386f1-b097-49f0-8df1-e38f9f9aecd2 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:26.146321 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b6d386f1-b097-49f0-8df1-e38f9f9aecd2 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:26.147496 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b6d386f1-b097-49f0-8df1-e38f9f9aecd2 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:26.148292 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b6d386f1-b097-49f0-8df1-e38f9f9aecd2 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:26.148972 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b6d386f1-b097-49f0-8df1-e38f9f9aecd2 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:26.156226 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d1a720c1-fa02-496a-af84-05b2a1ffe7e8 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd56633a0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:26.315373 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d1a720c1-fa02-496a-af84-05b2a1ffe7e8 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/2a2d7b14-a31e-4918-9ecb-2788c4cc869d" status: 200 len: 1414 microversion: 2.1 time: 0.173048 Oct 17 13:37:26.318457 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 475/952] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:37:26 2022] GET /compute/v2.1/images/2a2d7b14-a31e-4918-9ecb-2788c4cc869d => generated 1414 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:26.352587 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c765f386-97fb-462b-95de-6b18b716ad21 tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:26.353189 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c765f386-97fb-462b-95de-6b18b716ad21 tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] [instance: fe214f31-2995-4475-bcb7-ae4cec33a6f3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:26.399370 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c765f386-97fb-462b-95de-6b18b716ad21 tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:26.400170 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c765f386-97fb-462b-95de-6b18b716ad21 tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:26.400791 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c765f386-97fb-462b-95de-6b18b716ad21 tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:26.403338 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c765f386-97fb-462b-95de-6b18b716ad21 tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:26.404275 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c765f386-97fb-462b-95de-6b18b716ad21 tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:26.405007 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c765f386-97fb-462b-95de-6b18b716ad21 tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:26.485548 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b6d386f1-b097-49f0-8df1-e38f9f9aecd2 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:26.496041 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b6d386f1-b097-49f0-8df1-e38f9f9aecd2 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc" status: 200 len: 1324 microversion: 2.1 time: 0.377888 Oct 17 13:37:26.496384 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 478/953] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:26 2022] GET /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc => generated 1324 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:26.515279 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c6bc6f1e-8d75-43b0-9bcf-64f5a368fe40 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:26.516127 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c6bc6f1e-8d75-43b0-9bcf-64f5a368fe40 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] [instance: 82f35c2e-21ad-448d-a198-6847bf664d52] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:26.658089 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c6bc6f1e-8d75-43b0-9bcf-64f5a368fe40 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23b9d586c57421abf53a7eaa3af9b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63faec71e9ad449896c83868d52dd09c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:26.665539 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c6bc6f1e-8d75-43b0-9bcf-64f5a368fe40 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] 10.222.0.79 "GET /compute/v2.1/servers/82f35c2e-21ad-448d-a198-6847bf664d52" status: 200 len: 1270 microversion: 2.1 time: 0.161371 Oct 17 13:37:26.670652 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 479/954] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:26 2022] GET /compute/v2.1/servers/82f35c2e-21ad-448d-a198-6847bf664d52 => generated 1270 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:26.734579 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2951383d-e185-4128-a514-54586e9f1602 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0bd47343-44f4-4e4f-a2c1-3da24b3cd230", "device": "/dev/xvdb"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:26.737823 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2951383d-e185-4128-a514-54586e9f1602 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: a54adf11-ee58-4f13-82c8-9a00a36c536e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:26.754673 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2951383d-e185-4128-a514-54586e9f1602 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:26.755277 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2951383d-e185-4128-a514-54586e9f1602 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:26.755612 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2951383d-e185-4128-a514-54586e9f1602 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:26.756533 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2951383d-e185-4128-a514-54586e9f1602 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:26.761402 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2951383d-e185-4128-a514-54586e9f1602 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:26.762053 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2951383d-e185-4128-a514-54586e9f1602 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:26.819599 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c765f386-97fb-462b-95de-6b18b716ad21 tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/fe214f31-2995-4475-bcb7-ae4cec33a6f3" status: 200 len: 1618 microversion: 2.1 time: 0.497799 Oct 17 13:37:26.821053 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 476/955] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:26 2022] GET /compute/v2.1/servers/fe214f31-2995-4475-bcb7-ae4cec33a6f3 => generated 1618 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:27.123663 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fb2cd66e-db8d-4718-bcf3-6518d804b160 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-529759839", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "32728e12-4f3f-4f72-902c-10349708549f"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:27.335074 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-fb2cd66e-db8d-4718-bcf3-6518d804b160 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] validate_networks() for None {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:37:27.738887 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2951383d-e185-4128-a514-54586e9f1602 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "POST /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.008565 Oct 17 13:37:27.741399 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 480/956] 10.222.0.79 () {60 vars in 1323 bytes} [Mon Oct 17 13:37:26 2022] POST /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e/os-volume_attachments => generated 194 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:37:27.755656 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b8d0b5a4-bcdb-4eed-9517-83feba8ec5ff tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:27.761276 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b8d0b5a4-bcdb-4eed-9517-83feba8ec5ff tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] [instance: 0d642292-0447-42da-a7cf-9d15762db2ab] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:27.783123 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b8d0b5a4-bcdb-4eed-9517-83feba8ec5ff tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:27.785317 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b8d0b5a4-bcdb-4eed-9517-83feba8ec5ff tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:27.786911 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b8d0b5a4-bcdb-4eed-9517-83feba8ec5ff tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:27.789796 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b8d0b5a4-bcdb-4eed-9517-83feba8ec5ff tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:27.790955 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b8d0b5a4-bcdb-4eed-9517-83feba8ec5ff tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:27.794415 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b8d0b5a4-bcdb-4eed-9517-83feba8ec5ff tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:28.451726 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b8d0b5a4-bcdb-4eed-9517-83feba8ec5ff tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04053f6ae4d4d0cb32c11b5c94c38ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fb92d4cf8c4016b31773ce48bf2ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:28.466710 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b8d0b5a4-bcdb-4eed-9517-83feba8ec5ff tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] 10.222.0.79 "GET /compute/v2.1/servers/0d642292-0447-42da-a7cf-9d15762db2ab" status: 200 len: 1322 microversion: 2.1 time: 0.723601 Oct 17 13:37:28.471450 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 481/957] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:27 2022] GET /compute/v2.1/servers/0d642292-0447-42da-a7cf-9d15762db2ab => generated 1322 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:28.497024 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b68ea47f-03c5-4984-940d-0e306970fbc3 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd5e42790>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:28.607975 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b68ea47f-03c5-4984-940d-0e306970fbc3 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/2a2d7b14-a31e-4918-9ecb-2788c4cc869d" status: 200 len: 1414 microversion: 2.1 time: 0.135110 Oct 17 13:37:28.608856 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 482/958] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:37:28 2022] GET /compute/v2.1/images/2a2d7b14-a31e-4918-9ecb-2788c4cc869d => generated 1414 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:28.624455 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-fd85f04f-2d3f-4dc5-96d9-55f526ec18c8 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:28.626430 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-fd85f04f-2d3f-4dc5-96d9-55f526ec18c8 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 008be895-7153-417e-9b87-5b60ea31d0bc] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:28.640849 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:37:28.647909 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fd85f04f-2d3f-4dc5-96d9-55f526ec18c8 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:28.652756 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fd85f04f-2d3f-4dc5-96d9-55f526ec18c8 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:28.653821 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fd85f04f-2d3f-4dc5-96d9-55f526ec18c8 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:28.659485 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fd85f04f-2d3f-4dc5-96d9-55f526ec18c8 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:28.665107 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fd85f04f-2d3f-4dc5-96d9-55f526ec18c8 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:28.665896 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fd85f04f-2d3f-4dc5-96d9-55f526ec18c8 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:28.725298 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-fb2cd66e-db8d-4718-bcf3-6518d804b160 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:37:28.726312 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-fb2cd66e-db8d-4718-bcf3-6518d804b160 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:37:28.727057 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-fb2cd66e-db8d-4718-bcf3-6518d804b160 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:37:28.727632 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-fb2cd66e-db8d-4718-bcf3-6518d804b160 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:37:28.728212 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-fb2cd66e-db8d-4718-bcf3-6518d804b160 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:37:28.748542 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fb2cd66e-db8d-4718-bcf3-6518d804b160 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:28.749283 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fb2cd66e-db8d-4718-bcf3-6518d804b160 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:28.750270 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fb2cd66e-db8d-4718-bcf3-6518d804b160 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:28.751389 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fb2cd66e-db8d-4718-bcf3-6518d804b160 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:28.751989 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fb2cd66e-db8d-4718-bcf3-6518d804b160 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:28.752554 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fb2cd66e-db8d-4718-bcf3-6518d804b160 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:28.789059 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-fb2cd66e-db8d-4718-bcf3-6518d804b160 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Getting quotas for project fa1db260a96a4c6aa69cd6437baab6f7. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:37:28.797166 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-fb2cd66e-db8d-4718-bcf3-6518d804b160 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Getting quotas for user 7a7e082035084338966a1c56b30c7093 and project fa1db260a96a4c6aa69cd6437baab6f7. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:37:28.847878 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-fb2cd66e-db8d-4718-bcf3-6518d804b160 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:37:28.855140 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-fb2cd66e-db8d-4718-bcf3-6518d804b160 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 37496695-f6e7-4b76-ac8f-05da4f42cdf1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:37:29.002521 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fb2cd66e-db8d-4718-bcf3-6518d804b160 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.884577 Oct 17 13:37:29.003849 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 477/959] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:37:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:37:29.012024 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-71064d90-700e-4eb9-ae9e-df484f13bdee tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:29.012897 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-71064d90-700e-4eb9-ae9e-df484f13bdee tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] [instance: 82f35c2e-21ad-448d-a198-6847bf664d52] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:29.023051 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-71064d90-700e-4eb9-ae9e-df484f13bdee tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:29.024659 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-71064d90-700e-4eb9-ae9e-df484f13bdee tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:29.025288 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-71064d90-700e-4eb9-ae9e-df484f13bdee tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:29.026172 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-71064d90-700e-4eb9-ae9e-df484f13bdee tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:29.026774 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-71064d90-700e-4eb9-ae9e-df484f13bdee tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:29.027405 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-71064d90-700e-4eb9-ae9e-df484f13bdee tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:29.699465 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-71064d90-700e-4eb9-ae9e-df484f13bdee tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23b9d586c57421abf53a7eaa3af9b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63faec71e9ad449896c83868d52dd09c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:29.714554 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-71064d90-700e-4eb9-ae9e-df484f13bdee tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] 10.222.0.79 "GET /compute/v2.1/servers/82f35c2e-21ad-448d-a198-6847bf664d52" status: 200 len: 1330 microversion: 2.1 time: 0.708087 Oct 17 13:37:29.730362 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 478/960] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:29 2022] GET /compute/v2.1/servers/82f35c2e-21ad-448d-a198-6847bf664d52 => generated 1330 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:29.739978 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-374249cd-d460-40c5-8a0d-57b54848f975 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:29.740601 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-374249cd-d460-40c5-8a0d-57b54848f975 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 37496695-f6e7-4b76-ac8f-05da4f42cdf1] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:30.307789 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:37:31.010708 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-fd85f04f-2d3f-4dc5-96d9-55f526ec18c8 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:31.025936 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-fd85f04f-2d3f-4dc5-96d9-55f526ec18c8 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc" status: 200 len: 1324 microversion: 2.1 time: 2.415778 Oct 17 13:37:31.030533 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 483/961] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:28 2022] GET /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc => generated 1324 bytes in 2421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:31.066778 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ad448ae1-7b40-4195-ba53-316c59eadf2f tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:31.075410 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ad448ae1-7b40-4195-ba53-316c59eadf2f tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] [instance: 0d642292-0447-42da-a7cf-9d15762db2ab] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:31.129837 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ad448ae1-7b40-4195-ba53-316c59eadf2f tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:31.133993 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ad448ae1-7b40-4195-ba53-316c59eadf2f tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:31.134757 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ad448ae1-7b40-4195-ba53-316c59eadf2f tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:31.138844 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ad448ae1-7b40-4195-ba53-316c59eadf2f tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:31.142711 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ad448ae1-7b40-4195-ba53-316c59eadf2f tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:31.146694 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ad448ae1-7b40-4195-ba53-316c59eadf2f tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:31.567013 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-374249cd-d460-40c5-8a0d-57b54848f975 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:31.582221 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-374249cd-d460-40c5-8a0d-57b54848f975 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/37496695-f6e7-4b76-ac8f-05da4f42cdf1" status: 200 len: 1216 microversion: 2.1 time: 1.847945 Oct 17 13:37:31.600635 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 479/962] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:29 2022] GET /compute/v2.1/servers/37496695-f6e7-4b76-ac8f-05da4f42cdf1 => generated 1216 bytes in 1867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:31.621153 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-eb9504de-ea01-44d2-aeb4-7c469af034c9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd558c940>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:31.729903 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-eb9504de-ea01-44d2-aeb4-7c469af034c9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/2a2d7b14-a31e-4918-9ecb-2788c4cc869d" status: 200 len: 1414 microversion: 2.1 time: 0.127224 Oct 17 13:37:31.730498 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 480/963] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:37:31 2022] GET /compute/v2.1/images/2a2d7b14-a31e-4918-9ecb-2788c4cc869d => generated 1414 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:31.735080 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b5be3c1d-99df-4fbb-9b67-f7ebbfd949f2 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:31.755236 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b5be3c1d-99df-4fbb-9b67-f7ebbfd949f2 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] [instance: 82f35c2e-21ad-448d-a198-6847bf664d52] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:31.791262 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b5be3c1d-99df-4fbb-9b67-f7ebbfd949f2 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:31.797211 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b5be3c1d-99df-4fbb-9b67-f7ebbfd949f2 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:31.800669 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b5be3c1d-99df-4fbb-9b67-f7ebbfd949f2 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:31.803934 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b5be3c1d-99df-4fbb-9b67-f7ebbfd949f2 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:31.809629 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b5be3c1d-99df-4fbb-9b67-f7ebbfd949f2 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:31.810221 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b5be3c1d-99df-4fbb-9b67-f7ebbfd949f2 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:31.955953 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ad448ae1-7b40-4195-ba53-316c59eadf2f tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04053f6ae4d4d0cb32c11b5c94c38ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fb92d4cf8c4016b31773ce48bf2ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:31.966773 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ad448ae1-7b40-4195-ba53-316c59eadf2f tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] 10.222.0.79 "GET /compute/v2.1/servers/0d642292-0447-42da-a7cf-9d15762db2ab" status: 200 len: 1322 microversion: 2.1 time: 0.934725 Oct 17 13:37:31.973470 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 484/964] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:31 2022] GET /compute/v2.1/servers/0d642292-0447-42da-a7cf-9d15762db2ab => generated 1322 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:32.052530 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-29bbd0d9-2891-4dae-bf20-c783891e15cc tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:32.053820 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-29bbd0d9-2891-4dae-bf20-c783891e15cc tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 008be895-7153-417e-9b87-5b60ea31d0bc] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:32.067824 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-29bbd0d9-2891-4dae-bf20-c783891e15cc tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:32.068819 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-29bbd0d9-2891-4dae-bf20-c783891e15cc tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:32.069491 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-29bbd0d9-2891-4dae-bf20-c783891e15cc tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:32.070681 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-29bbd0d9-2891-4dae-bf20-c783891e15cc tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:32.071707 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-29bbd0d9-2891-4dae-bf20-c783891e15cc tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:32.072354 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-29bbd0d9-2891-4dae-bf20-c783891e15cc tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:32.158499 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b5be3c1d-99df-4fbb-9b67-f7ebbfd949f2 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23b9d586c57421abf53a7eaa3af9b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63faec71e9ad449896c83868d52dd09c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:32.180114 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b5be3c1d-99df-4fbb-9b67-f7ebbfd949f2 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] 10.222.0.79 "GET /compute/v2.1/servers/82f35c2e-21ad-448d-a198-6847bf664d52" status: 200 len: 1328 microversion: 2.1 time: 0.448273 Oct 17 13:37:32.204204 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 481/965] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:31 2022] GET /compute/v2.1/servers/82f35c2e-21ad-448d-a198-6847bf664d52 => generated 1328 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:32.620662 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-525f45d0-72e6-4ae6-b5ab-d2b4170f79c4 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:32.621286 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-525f45d0-72e6-4ae6-b5ab-d2b4170f79c4 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 37496695-f6e7-4b76-ac8f-05da4f42cdf1] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:32.641672 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-525f45d0-72e6-4ae6-b5ab-d2b4170f79c4 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:32.649158 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-525f45d0-72e6-4ae6-b5ab-d2b4170f79c4 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:32.649698 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-525f45d0-72e6-4ae6-b5ab-d2b4170f79c4 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:32.650468 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-525f45d0-72e6-4ae6-b5ab-d2b4170f79c4 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:32.650944 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-525f45d0-72e6-4ae6-b5ab-d2b4170f79c4 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:32.651403 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-525f45d0-72e6-4ae6-b5ab-d2b4170f79c4 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:32.739075 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-29bbd0d9-2891-4dae-bf20-c783891e15cc tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:32.757050 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-29bbd0d9-2891-4dae-bf20-c783891e15cc tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc" status: 200 len: 1324 microversion: 2.1 time: 0.708144 Oct 17 13:37:32.762366 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 485/966] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:32 2022] GET /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc => generated 1324 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:37:32.797396 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b2b28108-4fe8-4a25-9731-82ed991ac87d tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd5615d30>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:32.841127 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-525f45d0-72e6-4ae6-b5ab-d2b4170f79c4 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:32.862140 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-525f45d0-72e6-4ae6-b5ab-d2b4170f79c4 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/37496695-f6e7-4b76-ac8f-05da4f42cdf1" status: 200 len: 1274 microversion: 2.1 time: 0.249690 Oct 17 13:37:32.863333 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 482/967] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:32 2022] GET /compute/v2.1/servers/37496695-f6e7-4b76-ac8f-05da4f42cdf1 => generated 1274 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:32.868204 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-9cdd2c7e-ec28-4234-901f-00aa03d1c914 req-9623ae42-3bce-4096-b796-6c8adb6bd6e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d642292-0447-42da-a7cf-9d15762db2ab", "tag": "48c086d5-d910-43b5-8885-675d58e95b63"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:32.915928 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-9cdd2c7e-ec28-4234-901f-00aa03d1c914 req-9623ae42-3bce-4096-b796-6c8adb6bd6e5 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:32.916412 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-9cdd2c7e-ec28-4234-901f-00aa03d1c914 req-9623ae42-3bce-4096-b796-6c8adb6bd6e5 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:32.916836 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-9cdd2c7e-ec28-4234-901f-00aa03d1c914 req-9623ae42-3bce-4096-b796-6c8adb6bd6e5 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:32.958801 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-9cdd2c7e-ec28-4234-901f-00aa03d1c914 req-9623ae42-3bce-4096-b796-6c8adb6bd6e5 service nova] Creating event network-changed:48c086d5-d910-43b5-8885-675d58e95b63 for instance 0d642292-0447-42da-a7cf-9d15762db2ab on n-h2-854247-14 Oct 17 13:37:32.963570 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b2b28108-4fe8-4a25-9731-82ed991ac87d tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/2a2d7b14-a31e-4918-9ecb-2788c4cc869d" status: 200 len: 1414 microversion: 2.1 time: 0.188440 Oct 17 13:37:32.966979 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 486/968] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:37:32 2022] GET /compute/v2.1/images/2a2d7b14-a31e-4918-9ecb-2788c4cc869d => generated 1414 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:32.980519 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-9cdd2c7e-ec28-4234-901f-00aa03d1c914 req-9623ae42-3bce-4096-b796-6c8adb6bd6e5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115698 Oct 17 13:37:32.983317 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 483/969] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:37:33.014172 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-05d6a7e8-c51a-4086-b5bb-e03031f61b8d tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:33.027085 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-05d6a7e8-c51a-4086-b5bb-e03031f61b8d tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] [instance: 0d642292-0447-42da-a7cf-9d15762db2ab] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:33.062106 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-05d6a7e8-c51a-4086-b5bb-e03031f61b8d tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:33.065136 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-05d6a7e8-c51a-4086-b5bb-e03031f61b8d tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:33.066102 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-05d6a7e8-c51a-4086-b5bb-e03031f61b8d tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:33.067089 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-05d6a7e8-c51a-4086-b5bb-e03031f61b8d tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:33.069486 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-05d6a7e8-c51a-4086-b5bb-e03031f61b8d tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:33.070105 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-05d6a7e8-c51a-4086-b5bb-e03031f61b8d tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:33.213831 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-72d8ceda-8c18-4b1f-9b8d-73e70c79cc86 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:33.214926 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-72d8ceda-8c18-4b1f-9b8d-73e70c79cc86 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] [instance: 82f35c2e-21ad-448d-a198-6847bf664d52] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:33.266169 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-72d8ceda-8c18-4b1f-9b8d-73e70c79cc86 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:33.282093 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-72d8ceda-8c18-4b1f-9b8d-73e70c79cc86 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:33.286906 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-72d8ceda-8c18-4b1f-9b8d-73e70c79cc86 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:33.288147 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-72d8ceda-8c18-4b1f-9b8d-73e70c79cc86 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:33.297396 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-72d8ceda-8c18-4b1f-9b8d-73e70c79cc86 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:33.302012 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-72d8ceda-8c18-4b1f-9b8d-73e70c79cc86 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:33.779795 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-72d8ceda-8c18-4b1f-9b8d-73e70c79cc86 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23b9d586c57421abf53a7eaa3af9b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63faec71e9ad449896c83868d52dd09c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:33.789478 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-72d8ceda-8c18-4b1f-9b8d-73e70c79cc86 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] 10.222.0.79 "GET /compute/v2.1/servers/82f35c2e-21ad-448d-a198-6847bf664d52" status: 200 len: 1328 microversion: 2.1 time: 0.583344 Oct 17 13:37:33.793703 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 484/970] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:33 2022] GET /compute/v2.1/servers/82f35c2e-21ad-448d-a198-6847bf664d52 => generated 1328 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:33.807612 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f99a2114-9137-4a3f-a354-229823fa1923 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:33.808237 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f99a2114-9137-4a3f-a354-229823fa1923 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 008be895-7153-417e-9b87-5b60ea31d0bc] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:33.833442 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f99a2114-9137-4a3f-a354-229823fa1923 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:33.833932 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f99a2114-9137-4a3f-a354-229823fa1923 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:33.834380 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f99a2114-9137-4a3f-a354-229823fa1923 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:33.835298 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f99a2114-9137-4a3f-a354-229823fa1923 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:33.846102 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f99a2114-9137-4a3f-a354-229823fa1923 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:33.846564 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f99a2114-9137-4a3f-a354-229823fa1923 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:34.679335 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-05d6a7e8-c51a-4086-b5bb-e03031f61b8d tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04053f6ae4d4d0cb32c11b5c94c38ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fb92d4cf8c4016b31773ce48bf2ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:34.694753 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-05d6a7e8-c51a-4086-b5bb-e03031f61b8d tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] 10.222.0.79 "GET /compute/v2.1/servers/0d642292-0447-42da-a7cf-9d15762db2ab" status: 200 len: 1322 microversion: 2.1 time: 1.694340 Oct 17 13:37:34.711664 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 487/971] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:32 2022] GET /compute/v2.1/servers/0d642292-0447-42da-a7cf-9d15762db2ab => generated 1322 bytes in 1715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:34.728194 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-899582d0-ebc2-4ffe-be85-62f96f942310 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:34.729122 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-899582d0-ebc2-4ffe-be85-62f96f942310 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 37496695-f6e7-4b76-ac8f-05da4f42cdf1] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:34.738000 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f99a2114-9137-4a3f-a354-229823fa1923 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:34.745851 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-899582d0-ebc2-4ffe-be85-62f96f942310 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:34.746895 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-899582d0-ebc2-4ffe-be85-62f96f942310 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:34.747102 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f99a2114-9137-4a3f-a354-229823fa1923 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc" status: 200 len: 1324 microversion: 2.1 time: 0.952250 Oct 17 13:37:34.763682 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 485/972] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:33 2022] GET /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc => generated 1324 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:34.765739 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-899582d0-ebc2-4ffe-be85-62f96f942310 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:34.776757 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-899582d0-ebc2-4ffe-be85-62f96f942310 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:34.778178 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c2a503ca-1de2-41a8-b165-a802a0f6da2c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd5635b80>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:34.779409 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-899582d0-ebc2-4ffe-be85-62f96f942310 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:34.780551 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-899582d0-ebc2-4ffe-be85-62f96f942310 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:34.898525 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c2a503ca-1de2-41a8-b165-a802a0f6da2c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/2a2d7b14-a31e-4918-9ecb-2788c4cc869d" status: 200 len: 1414 microversion: 2.1 time: 0.144266 Oct 17 13:37:34.899430 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 486/973] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:37:34 2022] GET /compute/v2.1/images/2a2d7b14-a31e-4918-9ecb-2788c4cc869d => generated 1414 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:34.917926 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-973e4dde-46df-4846-a43f-4126e0a5ae16 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:34.921649 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-973e4dde-46df-4846-a43f-4126e0a5ae16 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] [instance: 82f35c2e-21ad-448d-a198-6847bf664d52] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:34.948294 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-973e4dde-46df-4846-a43f-4126e0a5ae16 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:34.948991 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-973e4dde-46df-4846-a43f-4126e0a5ae16 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:34.949449 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-973e4dde-46df-4846-a43f-4126e0a5ae16 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:34.950227 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-973e4dde-46df-4846-a43f-4126e0a5ae16 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:34.950685 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-973e4dde-46df-4846-a43f-4126e0a5ae16 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:34.951111 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-973e4dde-46df-4846-a43f-4126e0a5ae16 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:35.072648 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-899582d0-ebc2-4ffe-be85-62f96f942310 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:35.086394 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-899582d0-ebc2-4ffe-be85-62f96f942310 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/37496695-f6e7-4b76-ac8f-05da4f42cdf1" status: 200 len: 1274 microversion: 2.1 time: 0.369924 Oct 17 13:37:35.087024 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 488/974] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:34 2022] GET /compute/v2.1/servers/37496695-f6e7-4b76-ac8f-05da4f42cdf1 => generated 1274 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:35.578314 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-973e4dde-46df-4846-a43f-4126e0a5ae16 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23b9d586c57421abf53a7eaa3af9b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63faec71e9ad449896c83868d52dd09c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:35.601001 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-973e4dde-46df-4846-a43f-4126e0a5ae16 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] 10.222.0.79 "GET /compute/v2.1/servers/82f35c2e-21ad-448d-a198-6847bf664d52" status: 200 len: 1396 microversion: 2.1 time: 0.699767 Oct 17 13:37:35.608664 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 487/975] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:34 2022] GET /compute/v2.1/servers/82f35c2e-21ad-448d-a198-6847bf664d52 => generated 1396 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:35.722580 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8c25c897-8b89-43b1-be89-f2a085164d2a tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:35.723338 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8c25c897-8b89-43b1-be89-f2a085164d2a tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] [instance: 0d642292-0447-42da-a7cf-9d15762db2ab] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:35.735761 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8c25c897-8b89-43b1-be89-f2a085164d2a tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:35.736258 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8c25c897-8b89-43b1-be89-f2a085164d2a tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:35.736855 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8c25c897-8b89-43b1-be89-f2a085164d2a tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:35.737583 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8c25c897-8b89-43b1-be89-f2a085164d2a tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:35.738036 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8c25c897-8b89-43b1-be89-f2a085164d2a tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:35.738614 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8c25c897-8b89-43b1-be89-f2a085164d2a tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:35.772320 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c497adf2-2d35-436c-8649-b2b81b8c2be9 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:35.773156 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c497adf2-2d35-436c-8649-b2b81b8c2be9 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 008be895-7153-417e-9b87-5b60ea31d0bc] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:35.786600 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c497adf2-2d35-436c-8649-b2b81b8c2be9 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:35.787355 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c497adf2-2d35-436c-8649-b2b81b8c2be9 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:35.788512 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c497adf2-2d35-436c-8649-b2b81b8c2be9 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:35.790801 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c497adf2-2d35-436c-8649-b2b81b8c2be9 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:35.796099 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c497adf2-2d35-436c-8649-b2b81b8c2be9 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:35.800952 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c497adf2-2d35-436c-8649-b2b81b8c2be9 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:36.509415 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8c25c897-8b89-43b1-be89-f2a085164d2a tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04053f6ae4d4d0cb32c11b5c94c38ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fb92d4cf8c4016b31773ce48bf2ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:36.528985 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8c25c897-8b89-43b1-be89-f2a085164d2a tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] 10.222.0.79 "GET /compute/v2.1/servers/0d642292-0447-42da-a7cf-9d15762db2ab" status: 200 len: 1322 microversion: 2.1 time: 0.809740 Oct 17 13:37:36.530930 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 489/976] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:35 2022] GET /compute/v2.1/servers/0d642292-0447-42da-a7cf-9d15762db2ab => generated 1322 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:36.551446 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c497adf2-2d35-436c-8649-b2b81b8c2be9 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:36.554012 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=100 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:37:36.581576 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c497adf2-2d35-436c-8649-b2b81b8c2be9 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc" status: 200 len: 1324 microversion: 2.1 time: 0.811700 Oct 17 13:37:36.599145 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 488/977] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:35 2022] GET /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc => generated 1324 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:36.603692 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1c6ab1ed-2ce6-4cc6-9a87-c4f22268cafc tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd5602670>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:36.626093 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-83913583-dc2e-4af8-addf-6b3dbe327fd3 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:36.629018 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-83913583-dc2e-4af8-addf-6b3dbe327fd3 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 37496695-f6e7-4b76-ac8f-05da4f42cdf1] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:36.647640 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-83913583-dc2e-4af8-addf-6b3dbe327fd3 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:36.649728 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-83913583-dc2e-4af8-addf-6b3dbe327fd3 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:36.650172 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-83913583-dc2e-4af8-addf-6b3dbe327fd3 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:36.651780 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-83913583-dc2e-4af8-addf-6b3dbe327fd3 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:36.652447 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-83913583-dc2e-4af8-addf-6b3dbe327fd3 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:36.653046 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-83913583-dc2e-4af8-addf-6b3dbe327fd3 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:36.664768 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:37:36.735273 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1c6ab1ed-2ce6-4cc6-9a87-c4f22268cafc tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/2a2d7b14-a31e-4918-9ecb-2788c4cc869d" status: 200 len: 1423 microversion: 2.1 time: 0.168710 Oct 17 13:37:36.737620 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 490/978] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:37:36 2022] GET /compute/v2.1/images/2a2d7b14-a31e-4918-9ecb-2788c4cc869d => generated 1423 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:36.755856 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-60798a21-90d3-47f3-acb6-a4bbb8c4d9ad req-f1667fb4-abd5-496d-b057-73d331b00836 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "008be895-7153-417e-9b87-5b60ea31d0bc", "name": "network-vif-plugged", "status": "completed", "tag": "3a95ce9b-0623-4736-9d6e-2c8a93af74d8"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:36.787942 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-60798a21-90d3-47f3-acb6-a4bbb8c4d9ad req-f1667fb4-abd5-496d-b057-73d331b00836 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:36.792872 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-60798a21-90d3-47f3-acb6-a4bbb8c4d9ad req-f1667fb4-abd5-496d-b057-73d331b00836 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:36.795699 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-60798a21-90d3-47f3-acb6-a4bbb8c4d9ad req-f1667fb4-abd5-496d-b057-73d331b00836 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:36.820116 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-60798a21-90d3-47f3-acb6-a4bbb8c4d9ad req-f1667fb4-abd5-496d-b057-73d331b00836 service nova] Creating event network-vif-plugged:3a95ce9b-0623-4736-9d6e-2c8a93af74d8 for instance 008be895-7153-417e-9b87-5b60ea31d0bc on n-h2-854247-14 Oct 17 13:37:36.829499 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-60798a21-90d3-47f3-acb6-a4bbb8c4d9ad req-f1667fb4-abd5-496d-b057-73d331b00836 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090306 Oct 17 13:37:36.833808 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 491/979] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:37:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:37:36.860148 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-83913583-dc2e-4af8-addf-6b3dbe327fd3 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:36.867923 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-226a0e6e-d97d-490d-af1f-721e74d263e0 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:36.870390 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-226a0e6e-d97d-490d-af1f-721e74d263e0 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] [instance: 82f35c2e-21ad-448d-a198-6847bf664d52] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:36.870953 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-83913583-dc2e-4af8-addf-6b3dbe327fd3 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/37496695-f6e7-4b76-ac8f-05da4f42cdf1" status: 200 len: 1274 microversion: 2.1 time: 0.267898 Oct 17 13:37:36.871588 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 489/980] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:36 2022] GET /compute/v2.1/servers/37496695-f6e7-4b76-ac8f-05da4f42cdf1 => generated 1274 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:36.888420 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-226a0e6e-d97d-490d-af1f-721e74d263e0 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:36.892699 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f626cb88-ff48-4dd0-bc16-054725fcab60 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd56aa4c0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:36.895735 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-226a0e6e-d97d-490d-af1f-721e74d263e0 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:36.896906 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-226a0e6e-d97d-490d-af1f-721e74d263e0 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:36.897832 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-226a0e6e-d97d-490d-af1f-721e74d263e0 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:36.898580 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-226a0e6e-d97d-490d-af1f-721e74d263e0 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:36.899915 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-226a0e6e-d97d-490d-af1f-721e74d263e0 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:37.005875 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f626cb88-ff48-4dd0-bc16-054725fcab60 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/2a2d7b14-a31e-4918-9ecb-2788c4cc869d" status: 200 len: 1423 microversion: 2.1 time: 0.128594 Oct 17 13:37:37.019429 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 490/981] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:37:36 2022] GET /compute/v2.1/images/2a2d7b14-a31e-4918-9ecb-2788c4cc869d => generated 1423 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:37.034944 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-adc7b68a-e61b-493e-9e19-c2aa4633ac6c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd55333a0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:37.715027 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-226a0e6e-d97d-490d-af1f-721e74d263e0 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23b9d586c57421abf53a7eaa3af9b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63faec71e9ad449896c83868d52dd09c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:37.726339 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-226a0e6e-d97d-490d-af1f-721e74d263e0 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] 10.222.0.79 "GET /compute/v2.1/servers/82f35c2e-21ad-448d-a198-6847bf664d52" status: 200 len: 1396 microversion: 2.1 time: 0.890160 Oct 17 13:37:37.728158 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 492/982] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:36 2022] GET /compute/v2.1/servers/82f35c2e-21ad-448d-a198-6847bf664d52 => generated 1396 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:37.744139 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1dfa7717-77a3-4da6-a498-c8f56f0ae43d tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:37.749432 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1dfa7717-77a3-4da6-a498-c8f56f0ae43d tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] [instance: 0d642292-0447-42da-a7cf-9d15762db2ab] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:37.762677 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1dfa7717-77a3-4da6-a498-c8f56f0ae43d tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:37.766684 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1dfa7717-77a3-4da6-a498-c8f56f0ae43d tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:37.767972 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1dfa7717-77a3-4da6-a498-c8f56f0ae43d tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:37.768886 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1dfa7717-77a3-4da6-a498-c8f56f0ae43d tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:37.769907 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1dfa7717-77a3-4da6-a498-c8f56f0ae43d tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:37.770714 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1dfa7717-77a3-4da6-a498-c8f56f0ae43d tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:38.213079 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-adc7b68a-e61b-493e-9e19-c2aa4633ac6c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "DELETE /compute/v2.1/images/2a2d7b14-a31e-4918-9ecb-2788c4cc869d" status: 204 len: 0 microversion: 2.1 time: 1.191770 Oct 17 13:37:38.217607 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 491/983] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:37 2022] DELETE /compute/v2.1/images/2a2d7b14-a31e-4918-9ecb-2788c4cc869d => generated 0 bytes in 1194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:37:38.223470 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-df3d6ce3-f47d-4e60-9062-0bdf058c7cda tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:38.227934 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-df3d6ce3-f47d-4e60-9062-0bdf058c7cda tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 008be895-7153-417e-9b87-5b60ea31d0bc] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:38.249449 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1dfa7717-77a3-4da6-a498-c8f56f0ae43d tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04053f6ae4d4d0cb32c11b5c94c38ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fb92d4cf8c4016b31773ce48bf2ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:38.251790 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df3d6ce3-f47d-4e60-9062-0bdf058c7cda tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:38.255941 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df3d6ce3-f47d-4e60-9062-0bdf058c7cda tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:38.256574 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df3d6ce3-f47d-4e60-9062-0bdf058c7cda tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:38.258459 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1dfa7717-77a3-4da6-a498-c8f56f0ae43d tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] 10.222.0.79 "GET /compute/v2.1/servers/0d642292-0447-42da-a7cf-9d15762db2ab" status: 200 len: 1322 microversion: 2.1 time: 0.524271 Oct 17 13:37:38.259686 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df3d6ce3-f47d-4e60-9062-0bdf058c7cda tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:38.262059 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 493/984] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:37 2022] GET /compute/v2.1/servers/0d642292-0447-42da-a7cf-9d15762db2ab => generated 1322 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:38.267870 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-89d0bd95-5f4c-4f5e-9d1e-496b6becb87b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:38.272233 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df3d6ce3-f47d-4e60-9062-0bdf058c7cda tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:38.272848 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df3d6ce3-f47d-4e60-9062-0bdf058c7cda tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:38.280811 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-89d0bd95-5f4c-4f5e-9d1e-496b6becb87b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 37496695-f6e7-4b76-ac8f-05da4f42cdf1] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:38.287184 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-89d0bd95-5f4c-4f5e-9d1e-496b6becb87b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:38.288019 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-89d0bd95-5f4c-4f5e-9d1e-496b6becb87b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:38.290577 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-89d0bd95-5f4c-4f5e-9d1e-496b6becb87b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:38.291600 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-89d0bd95-5f4c-4f5e-9d1e-496b6becb87b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:38.295787 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-89d0bd95-5f4c-4f5e-9d1e-496b6becb87b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:38.296480 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-89d0bd95-5f4c-4f5e-9d1e-496b6becb87b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:38.777774 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=4 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:37:38.830719 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-89d0bd95-5f4c-4f5e-9d1e-496b6becb87b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:38.844511 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-89d0bd95-5f4c-4f5e-9d1e-496b6becb87b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/37496695-f6e7-4b76-ac8f-05da4f42cdf1" status: 200 len: 1316 microversion: 2.1 time: 0.578530 Oct 17 13:37:38.847751 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 494/985] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:38 2022] GET /compute/v2.1/servers/37496695-f6e7-4b76-ac8f-05da4f42cdf1 => generated 1316 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:38.854908 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1c419758-37a9-425f-a6b1-9059bd83bacb tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:38.855689 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1c419758-37a9-425f-a6b1-9059bd83bacb tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 9e72abb9-d4b5-4c67-8260-2828e3ab5ad2] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:38.862796 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c419758-37a9-425f-a6b1-9059bd83bacb tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:38.863721 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c419758-37a9-425f-a6b1-9059bd83bacb tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:38.864287 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c419758-37a9-425f-a6b1-9059bd83bacb tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:38.865132 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c419758-37a9-425f-a6b1-9059bd83bacb tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:38.865721 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c419758-37a9-425f-a6b1-9059bd83bacb tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:38.866430 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c419758-37a9-425f-a6b1-9059bd83bacb tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:38.919647 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1c419758-37a9-425f-a6b1-9059bd83bacb tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 9e72abb9-d4b5-4c67-8260-2828e3ab5ad2] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:37:38.966029 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-df3d6ce3-f47d-4e60-9062-0bdf058c7cda tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:38.975804 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-df3d6ce3-f47d-4e60-9062-0bdf058c7cda tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc" status: 200 len: 1324 microversion: 2.1 time: 0.756829 Oct 17 13:37:38.995203 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 492/986] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:38 2022] GET /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc => generated 1324 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:39.004112 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-42bd17cf-ff4a-4c7d-8f0d-9d839da50671 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:39.004323 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-42bd17cf-ff4a-4c7d-8f0d-9d839da50671 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] [instance: 82f35c2e-21ad-448d-a198-6847bf664d52] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:39.008714 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:37:39.025155 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-42bd17cf-ff4a-4c7d-8f0d-9d839da50671 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:39.025897 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-42bd17cf-ff4a-4c7d-8f0d-9d839da50671 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:39.028059 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-42bd17cf-ff4a-4c7d-8f0d-9d839da50671 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:39.029686 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-42bd17cf-ff4a-4c7d-8f0d-9d839da50671 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:39.033143 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-42bd17cf-ff4a-4c7d-8f0d-9d839da50671 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:39.034459 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-42bd17cf-ff4a-4c7d-8f0d-9d839da50671 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:39.128911 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1c419758-37a9-425f-a6b1-9059bd83bacb tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "DELETE /compute/v2.1/servers/9e72abb9-d4b5-4c67-8260-2828e3ab5ad2" status: 204 len: 0 microversion: 2.1 time: 0.279607 Oct 17 13:37:39.131647 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 495/987] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:37:38 2022] DELETE /compute/v2.1/servers/9e72abb9-d4b5-4c67-8260-2828e3ab5ad2 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:37:39.139089 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-337d0a04-81bf-4402-8b98-602404211e9c req-f91cc331-e470-4845-a39a-dcc251decb07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82f35c2e-21ad-448d-a198-6847bf664d52", "tag": "dd85193d-95aa-4f67-99f3-26d0422dc6af"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:39.173299 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-337d0a04-81bf-4402-8b98-602404211e9c req-f91cc331-e470-4845-a39a-dcc251decb07 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:39.176432 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-337d0a04-81bf-4402-8b98-602404211e9c req-f91cc331-e470-4845-a39a-dcc251decb07 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:39.177097 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-337d0a04-81bf-4402-8b98-602404211e9c req-f91cc331-e470-4845-a39a-dcc251decb07 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:39.213371 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-337d0a04-81bf-4402-8b98-602404211e9c req-f91cc331-e470-4845-a39a-dcc251decb07 service nova] Creating event network-changed:dd85193d-95aa-4f67-99f3-26d0422dc6af for instance 82f35c2e-21ad-448d-a198-6847bf664d52 on n-h1-854247-14 Oct 17 13:37:39.224341 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-337d0a04-81bf-4402-8b98-602404211e9c req-f91cc331-e470-4845-a39a-dcc251decb07 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090163 Oct 17 13:37:39.229376 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 496/988] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:37:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:37:39.286602 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f8b8b7b2-6fc7-48b3-8542-17b3f2c9e531 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:39.287502 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f8b8b7b2-6fc7-48b3-8542-17b3f2c9e531 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] [instance: 0d642292-0447-42da-a7cf-9d15762db2ab] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:39.300055 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f8b8b7b2-6fc7-48b3-8542-17b3f2c9e531 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:39.300879 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f8b8b7b2-6fc7-48b3-8542-17b3f2c9e531 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:39.301498 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f8b8b7b2-6fc7-48b3-8542-17b3f2c9e531 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:39.304492 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f8b8b7b2-6fc7-48b3-8542-17b3f2c9e531 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:39.307677 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f8b8b7b2-6fc7-48b3-8542-17b3f2c9e531 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:39.308515 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f8b8b7b2-6fc7-48b3-8542-17b3f2c9e531 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:40.058396 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f8b8b7b2-6fc7-48b3-8542-17b3f2c9e531 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04053f6ae4d4d0cb32c11b5c94c38ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fb92d4cf8c4016b31773ce48bf2ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:40.070996 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f8b8b7b2-6fc7-48b3-8542-17b3f2c9e531 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] 10.222.0.79 "GET /compute/v2.1/servers/0d642292-0447-42da-a7cf-9d15762db2ab" status: 200 len: 1322 microversion: 2.1 time: 0.788537 Oct 17 13:37:40.077332 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 497/989] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:39 2022] GET /compute/v2.1/servers/0d642292-0447-42da-a7cf-9d15762db2ab => generated 1322 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:40.082925 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ad7d021d-8068-4c9b-85c1-85b88823e2a6 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-810493205", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "9fce71af-909d-4a58-8606-ba21d3f4b00f"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:40.123780 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-42bd17cf-ff4a-4c7d-8f0d-9d839da50671 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23b9d586c57421abf53a7eaa3af9b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63faec71e9ad449896c83868d52dd09c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:40.159052 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-42bd17cf-ff4a-4c7d-8f0d-9d839da50671 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] 10.222.0.79 "GET /compute/v2.1/servers/82f35c2e-21ad-448d-a198-6847bf664d52" status: 200 len: 1396 microversion: 2.1 time: 1.174091 Oct 17 13:37:40.162765 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 493/990] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:38 2022] GET /compute/v2.1/servers/82f35c2e-21ad-448d-a198-6847bf664d52 => generated 1396 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:40.208665 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-ad7d021d-8068-4c9b-85c1-85b88823e2a6 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] validate_networks() for [('9fce71af-909d-4a58-8606-ba21d3f4b00f', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:37:40.488902 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-710fa9b0-4ad2-47ca-a0be-cc601fed3093 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Action: 'create', calling method: .version_select at 0x7f7cd55f21f0>, body: {"keypair": {"name": "tempest-keypair-1909150367", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpC1tmh4DGggFZVueb90DMyxmjLVpeTCgsYgR38O30OlGwRS+w2D5dBQT32GMIaBwV5YD0X+/2Nz7t2kad3EHX9vQdt8o7v0uxwsPtpN+uJ7SBdzLQlWzVQkj7kp7EWDw=="}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:40.515581 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-710fa9b0-4ad2-47ca-a0be-cc601fed3093 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Getting quotas for project d6642f912ba0467bac461bc7aedbf940. Resources: {'key_pairs'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:37:40.522251 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-710fa9b0-4ad2-47ca-a0be-cc601fed3093 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Getting quotas for user e6e5309bf84f4aafa9a17604f8452366 and project d6642f912ba0467bac461bc7aedbf940. Resources: {'key_pairs'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:37:40.588463 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-710fa9b0-4ad2-47ca-a0be-cc601fed3093 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.424380 Oct 17 13:37:40.597465 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 494/991] 10.222.0.79 () {60 vars in 1159 bytes} [Mon Oct 17 13:37:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:37:40.615507 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-629dd8d7-7e43-4d19-bac7-2242e16a1254 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:40.616706 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-629dd8d7-7e43-4d19-bac7-2242e16a1254 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 37496695-f6e7-4b76-ac8f-05da4f42cdf1] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:40.627419 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-629dd8d7-7e43-4d19-bac7-2242e16a1254 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:40.628584 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-629dd8d7-7e43-4d19-bac7-2242e16a1254 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:40.629270 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-629dd8d7-7e43-4d19-bac7-2242e16a1254 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:40.630483 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-629dd8d7-7e43-4d19-bac7-2242e16a1254 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:40.631142 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-629dd8d7-7e43-4d19-bac7-2242e16a1254 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:40.631791 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-629dd8d7-7e43-4d19-bac7-2242e16a1254 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:41.342866 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-629dd8d7-7e43-4d19-bac7-2242e16a1254 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:41.351954 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-629dd8d7-7e43-4d19-bac7-2242e16a1254 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/37496695-f6e7-4b76-ac8f-05da4f42cdf1" status: 200 len: 1316 microversion: 2.1 time: 0.752100 Oct 17 13:37:41.360203 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 495/992] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:40 2022] GET /compute/v2.1/servers/37496695-f6e7-4b76-ac8f-05da4f42cdf1 => generated 1316 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:41.366192 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-403448f2-d829-4f8a-bf93-f83f1ecf6fd8 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:41.371997 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-403448f2-d829-4f8a-bf93-f83f1ecf6fd8 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 008be895-7153-417e-9b87-5b60ea31d0bc] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:41.380812 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-403448f2-d829-4f8a-bf93-f83f1ecf6fd8 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:41.385178 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-403448f2-d829-4f8a-bf93-f83f1ecf6fd8 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:41.389709 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-403448f2-d829-4f8a-bf93-f83f1ecf6fd8 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:41.390955 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-403448f2-d829-4f8a-bf93-f83f1ecf6fd8 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:41.391627 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-403448f2-d829-4f8a-bf93-f83f1ecf6fd8 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:41.392975 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-403448f2-d829-4f8a-bf93-f83f1ecf6fd8 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:41.783130 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-ad7d021d-8068-4c9b-85c1-85b88823e2a6 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:37:41.784642 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-ad7d021d-8068-4c9b-85c1-85b88823e2a6 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:37:41.785660 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-ad7d021d-8068-4c9b-85c1-85b88823e2a6 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:37:41.786255 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-ad7d021d-8068-4c9b-85c1-85b88823e2a6 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:37:41.786841 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-ad7d021d-8068-4c9b-85c1-85b88823e2a6 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:37:41.808802 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ad7d021d-8068-4c9b-85c1-85b88823e2a6 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:41.809644 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ad7d021d-8068-4c9b-85c1-85b88823e2a6 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:41.810257 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ad7d021d-8068-4c9b-85c1-85b88823e2a6 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:41.811161 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ad7d021d-8068-4c9b-85c1-85b88823e2a6 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:41.812285 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ad7d021d-8068-4c9b-85c1-85b88823e2a6 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:41.812948 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ad7d021d-8068-4c9b-85c1-85b88823e2a6 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:41.898882 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-ad7d021d-8068-4c9b-85c1-85b88823e2a6 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Getting quotas for project 461c44cb99ff4958a128679d3e10cd6f. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:37:41.911683 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-ad7d021d-8068-4c9b-85c1-85b88823e2a6 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Getting quotas for user 386397fd9194430b81ac465f9b3bf92d and project 461c44cb99ff4958a128679d3e10cd6f. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:37:41.945130 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ad7d021d-8068-4c9b-85c1-85b88823e2a6 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:37:41.963257 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ad7d021d-8068-4c9b-85c1-85b88823e2a6 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: ae587603-994d-419d-979a-1b1361144872] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:37:42.014452 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ad7d021d-8068-4c9b-85c1-85b88823e2a6 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.935675 Oct 17 13:37:42.015604 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 498/993] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:37:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1937 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:37:42.022054 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d1631fa3-27a8-46c5-aa1c-a24f8f9d71aa tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:42.022996 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d1631fa3-27a8-46c5-aa1c-a24f8f9d71aa tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] [instance: 0d642292-0447-42da-a7cf-9d15762db2ab] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:42.032438 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d1631fa3-27a8-46c5-aa1c-a24f8f9d71aa tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:42.033280 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d1631fa3-27a8-46c5-aa1c-a24f8f9d71aa tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:42.034480 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d1631fa3-27a8-46c5-aa1c-a24f8f9d71aa tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:42.035438 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d1631fa3-27a8-46c5-aa1c-a24f8f9d71aa tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:42.036253 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d1631fa3-27a8-46c5-aa1c-a24f8f9d71aa tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:42.036884 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d1631fa3-27a8-46c5-aa1c-a24f8f9d71aa tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:42.098754 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-403448f2-d829-4f8a-bf93-f83f1ecf6fd8 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:42.133309 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-403448f2-d829-4f8a-bf93-f83f1ecf6fd8 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc" status: 200 len: 1520 microversion: 2.1 time: 0.753444 Oct 17 13:37:42.137888 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 496/994] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:41 2022] GET /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc => generated 1520 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:42.168505 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2c2a0b1b-4d1b-45e8-b66d-220bf66ed5e2 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:42.177727 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2c2a0b1b-4d1b-45e8-b66d-220bf66ed5e2 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] [instance: 82f35c2e-21ad-448d-a198-6847bf664d52] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:42.198184 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2c2a0b1b-4d1b-45e8-b66d-220bf66ed5e2 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:42.200546 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2c2a0b1b-4d1b-45e8-b66d-220bf66ed5e2 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:42.202366 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2c2a0b1b-4d1b-45e8-b66d-220bf66ed5e2 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:42.205840 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2c2a0b1b-4d1b-45e8-b66d-220bf66ed5e2 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:42.206516 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2c2a0b1b-4d1b-45e8-b66d-220bf66ed5e2 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:42.207117 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2c2a0b1b-4d1b-45e8-b66d-220bf66ed5e2 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:43.071421 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2c2a0b1b-4d1b-45e8-b66d-220bf66ed5e2 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23b9d586c57421abf53a7eaa3af9b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63faec71e9ad449896c83868d52dd09c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:43.083323 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d1631fa3-27a8-46c5-aa1c-a24f8f9d71aa tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04053f6ae4d4d0cb32c11b5c94c38ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fb92d4cf8c4016b31773ce48bf2ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:43.098224 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d1631fa3-27a8-46c5-aa1c-a24f8f9d71aa tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] 10.222.0.79 "GET /compute/v2.1/servers/0d642292-0447-42da-a7cf-9d15762db2ab" status: 200 len: 1322 microversion: 2.1 time: 1.080977 Oct 17 13:37:43.112058 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2c2a0b1b-4d1b-45e8-b66d-220bf66ed5e2 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] 10.222.0.79 "GET /compute/v2.1/servers/82f35c2e-21ad-448d-a198-6847bf664d52" status: 200 len: 1396 microversion: 2.1 time: 0.964063 Oct 17 13:37:43.115853 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 499/995] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:42 2022] GET /compute/v2.1/servers/0d642292-0447-42da-a7cf-9d15762db2ab => generated 1322 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:43.120987 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 497/996] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:42 2022] GET /compute/v2.1/servers/82f35c2e-21ad-448d-a198-6847bf664d52 => generated 1396 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:43.127752 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-c58483cf-a10f-472e-be59-a5db89b3c477 req-7877b58b-d9cb-4093-b643-c56db569475a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37496695-f6e7-4b76-ac8f-05da4f42cdf1", "tag": "db290fa7-4452-4dd9-932a-5f8775bde25b"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:43.136215 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-730660de-27ff-4c0f-bd73-6652ec14d923 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:43.138767 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-730660de-27ff-4c0f-bd73-6652ec14d923 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: ae587603-994d-419d-979a-1b1361144872] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:43.156530 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-730660de-27ff-4c0f-bd73-6652ec14d923 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:43.157021 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-730660de-27ff-4c0f-bd73-6652ec14d923 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:43.157447 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-730660de-27ff-4c0f-bd73-6652ec14d923 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:43.158157 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-730660de-27ff-4c0f-bd73-6652ec14d923 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:43.158623 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-730660de-27ff-4c0f-bd73-6652ec14d923 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:43.170502 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-c58483cf-a10f-472e-be59-a5db89b3c477 req-7877b58b-d9cb-4093-b643-c56db569475a service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:43.170984 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-c58483cf-a10f-472e-be59-a5db89b3c477 req-7877b58b-d9cb-4093-b643-c56db569475a service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:43.172287 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-730660de-27ff-4c0f-bd73-6652ec14d923 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:43.179342 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-c58483cf-a10f-472e-be59-a5db89b3c477 req-7877b58b-d9cb-4093-b643-c56db569475a service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:43.227509 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-c58483cf-a10f-472e-be59-a5db89b3c477 req-7877b58b-d9cb-4093-b643-c56db569475a service nova] Creating event network-changed:db290fa7-4452-4dd9-932a-5f8775bde25b for instance 37496695-f6e7-4b76-ac8f-05da4f42cdf1 on n-h2-854247-14 Oct 17 13:37:43.237819 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-c58483cf-a10f-472e-be59-a5db89b3c477 req-7877b58b-d9cb-4093-b643-c56db569475a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116668 Oct 17 13:37:43.238453 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 500/997] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:37:43.265068 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-872d7516-40df-411a-8b0e-e1af8b4fc3cd tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:43.265790 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-872d7516-40df-411a-8b0e-e1af8b4fc3cd tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 008be895-7153-417e-9b87-5b60ea31d0bc] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:43.288609 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-872d7516-40df-411a-8b0e-e1af8b4fc3cd tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:43.289106 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-872d7516-40df-411a-8b0e-e1af8b4fc3cd tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:43.301262 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-872d7516-40df-411a-8b0e-e1af8b4fc3cd tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:43.307153 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-872d7516-40df-411a-8b0e-e1af8b4fc3cd tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:43.308982 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-872d7516-40df-411a-8b0e-e1af8b4fc3cd tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:43.309588 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-872d7516-40df-411a-8b0e-e1af8b4fc3cd tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:43.699937 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-730660de-27ff-4c0f-bd73-6652ec14d923 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:43.711742 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-730660de-27ff-4c0f-bd73-6652ec14d923 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872" status: 200 len: 1211 microversion: 2.1 time: 0.585980 Oct 17 13:37:43.712433 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 498/998] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:43 2022] GET /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872 => generated 1211 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:43.732271 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-a8e1ab6f-f929-4704-baba-79612c2eef5a req-899a6b99-fdc4-444a-9362-c24e42c485df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e72abb9-d4b5-4c67-8260-2828e3ab5ad2", "name": "network-vif-deleted", "tag": "1ff9eaee-9a81-45c4-aac7-0297656e1256"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:43.769688 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-a8e1ab6f-f929-4704-baba-79612c2eef5a req-899a6b99-fdc4-444a-9362-c24e42c485df service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:43.770172 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-a8e1ab6f-f929-4704-baba-79612c2eef5a req-899a6b99-fdc4-444a-9362-c24e42c485df service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:43.770596 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-a8e1ab6f-f929-4704-baba-79612c2eef5a req-899a6b99-fdc4-444a-9362-c24e42c485df service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:43.823464 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-a8e1ab6f-f929-4704-baba-79612c2eef5a req-899a6b99-fdc4-444a-9362-c24e42c485df service nova] Creating event network-vif-deleted:1ff9eaee-9a81-45c4-aac7-0297656e1256 for instance 9e72abb9-d4b5-4c67-8260-2828e3ab5ad2 on n-h2-854247-14 Oct 17 13:37:43.843410 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-a8e1ab6f-f929-4704-baba-79612c2eef5a req-899a6b99-fdc4-444a-9362-c24e42c485df service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121628 Oct 17 13:37:43.846066 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 499/999] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:37:43.863264 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-35648584-1288-4dee-8137-138c96ec5312 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:43.864571 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-35648584-1288-4dee-8137-138c96ec5312 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 37496695-f6e7-4b76-ac8f-05da4f42cdf1] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:43.891311 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-35648584-1288-4dee-8137-138c96ec5312 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:43.891311 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-35648584-1288-4dee-8137-138c96ec5312 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:43.891754 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-35648584-1288-4dee-8137-138c96ec5312 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:43.892465 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-35648584-1288-4dee-8137-138c96ec5312 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:43.892908 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-35648584-1288-4dee-8137-138c96ec5312 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:43.893322 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-35648584-1288-4dee-8137-138c96ec5312 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:44.121912 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-872d7516-40df-411a-8b0e-e1af8b4fc3cd tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:44.140287 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-872d7516-40df-411a-8b0e-e1af8b4fc3cd tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc" status: 200 len: 1520 microversion: 2.1 time: 0.889148 Oct 17 13:37:44.141073 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 501/1000] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:43 2022] GET /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc => generated 1520 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:44.147416 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-046dc8aa-39d3-46ce-938c-35426a2db998 req-5e99aadc-f096-414c-86dd-9bf95a079600 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d642292-0447-42da-a7cf-9d15762db2ab", "name": "network-vif-plugged", "status": "completed", "tag": "48c086d5-d910-43b5-8885-675d58e95b63"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:44.162436 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-046dc8aa-39d3-46ce-938c-35426a2db998 req-5e99aadc-f096-414c-86dd-9bf95a079600 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:44.163299 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-046dc8aa-39d3-46ce-938c-35426a2db998 req-5e99aadc-f096-414c-86dd-9bf95a079600 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:44.163992 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-046dc8aa-39d3-46ce-938c-35426a2db998 req-5e99aadc-f096-414c-86dd-9bf95a079600 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:44.198558 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-046dc8aa-39d3-46ce-938c-35426a2db998 req-5e99aadc-f096-414c-86dd-9bf95a079600 service nova] Creating event network-vif-plugged:48c086d5-d910-43b5-8885-675d58e95b63 for instance 0d642292-0447-42da-a7cf-9d15762db2ab on n-h2-854247-14 Oct 17 13:37:44.208985 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-046dc8aa-39d3-46ce-938c-35426a2db998 req-5e99aadc-f096-414c-86dd-9bf95a079600 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066357 Oct 17 13:37:44.210131 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 502/1001] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:37:44.222350 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-67c3060f-f6e1-48c6-a640-85a3641e8a0e tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:44.247592 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-67c3060f-f6e1-48c6-a640-85a3641e8a0e tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] [instance: 0d642292-0447-42da-a7cf-9d15762db2ab] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:44.275618 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-67c3060f-f6e1-48c6-a640-85a3641e8a0e tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:44.276370 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-67c3060f-f6e1-48c6-a640-85a3641e8a0e tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:44.276996 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-67c3060f-f6e1-48c6-a640-85a3641e8a0e tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:44.277856 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-67c3060f-f6e1-48c6-a640-85a3641e8a0e tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:44.278455 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-67c3060f-f6e1-48c6-a640-85a3641e8a0e tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:44.279022 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-67c3060f-f6e1-48c6-a640-85a3641e8a0e tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:44.302852 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-35648584-1288-4dee-8137-138c96ec5312 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:44.324555 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-35648584-1288-4dee-8137-138c96ec5312 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/37496695-f6e7-4b76-ac8f-05da4f42cdf1" status: 200 len: 1316 microversion: 2.1 time: 0.476927 Oct 17 13:37:44.337001 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 500/1002] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:43 2022] GET /compute/v2.1/servers/37496695-f6e7-4b76-ac8f-05da4f42cdf1 => generated 1316 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:44.342454 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b121887b-e345-4264-8b59-fee2dd817f2c tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:44.343065 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b121887b-e345-4264-8b59-fee2dd817f2c tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] [instance: 82f35c2e-21ad-448d-a198-6847bf664d52] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:44.381014 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b121887b-e345-4264-8b59-fee2dd817f2c tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:44.382259 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b121887b-e345-4264-8b59-fee2dd817f2c tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:44.382866 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b121887b-e345-4264-8b59-fee2dd817f2c tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:44.386188 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b121887b-e345-4264-8b59-fee2dd817f2c tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:44.386873 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b121887b-e345-4264-8b59-fee2dd817f2c tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:44.391625 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b121887b-e345-4264-8b59-fee2dd817f2c tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:44.781615 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-67c3060f-f6e1-48c6-a640-85a3641e8a0e tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04053f6ae4d4d0cb32c11b5c94c38ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fb92d4cf8c4016b31773ce48bf2ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:44.794681 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-67c3060f-f6e1-48c6-a640-85a3641e8a0e tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] 10.222.0.79 "GET /compute/v2.1/servers/0d642292-0447-42da-a7cf-9d15762db2ab" status: 200 len: 1322 microversion: 2.1 time: 0.583155 Oct 17 13:37:44.795795 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 503/1003] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:44 2022] GET /compute/v2.1/servers/0d642292-0447-42da-a7cf-9d15762db2ab => generated 1322 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:44.816898 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-189cb51a-5211-40c3-ad56-501c29fb6fbe tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1257099598", "metadata": {"": ""}}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:44.822282 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-189cb51a-5211-40c3-ad56-501c29fb6fbe tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Request method failure captured: Oct 17 13:37:44.822282 n-d-854247-14 devstack@n-api.service[127017]: request: POST /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc/action HTTP/1.1 Oct 17 13:37:44.822282 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:37:44.822282 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:37:44.822282 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:37:44.822282 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 107 Oct 17 13:37:44.822282 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:37:44.822282 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:37:44.822282 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:37:44.822282 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:37:44.822282 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVp-7IxfFP3OCFXwoptz1mkTvVFP-q1mVdb9duvFJBSFB2Milojb0bt4JEkHbyx5bSK8AUBQstoN0fpOUoelRV9Ur5eKS-T70viEjT2k_9W3ZeERt1Gvx_VBqcxVNMvlXoLi-KthVHD7so8JMwaOern88ECZl5tX1TwIw6qcARP1TSo Oct 17 13:37:44.822282 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:37:44.822282 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:37:44.822282 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:37:44.822282 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:37:44.822282 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:37:44.822282 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:37:44.822282 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: c7507d1dd2d345ca9b59dcaa7806b56e Oct 17 13:37:44.822282 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2045461887 Oct 17 13:37:44.822282 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:37:44.822282 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:37:44.824022 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c7507d1dd2d345ca9b59dcaa7806b56e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c7507d1dd2d345ca9b59dcaa7806b56e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c7507d1dd2d345ca9b59dcaa7806b56e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c7507d1dd2d345ca9b59dcaa7806b56e", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:37:44.824022 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2045461887 Oct 17 13:37:44.824022 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: c7507d1dd2d345ca9b59dcaa7806b56e Oct 17 13:37:44.824022 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2045461887 Oct 17 13:37:44.824022 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ImagesOneServerNegativeTestJSON-2045461887-project Oct 17 13:37:44.824022 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:37:44.824022 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:37:44.824022 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: dcbd60cab4174e8db26e28f015795e1f Oct 17 13:37:44.824022 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2045461887-project Oct 17 13:37:44.824022 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 13:37:44.824022 n-d-854247-14 devstack@n-api.service[127017]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1257099598", "metadata": {"": ""}}} Oct 17 13:37:44.824022 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:37:44.825207 n-d-854247-14 devstack@n-api.service[127017]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 13:37:44.825207 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '008be895-7153-417e-9b87-5b60ea31d0bc', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1257099598', 'metadata': {'': ''}}}} Oct 17 13:37:44.825207 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:37:44.825207 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:44.825207 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:37:44.825207 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:37:44.825207 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:37:44.825207 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:37:44.825207 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 13:37:44.825207 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:37:44.825207 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 17 13:37:44.825207 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 17 13:37:44.825207 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 17 13:37:44.825207 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 17 13:37:44.825207 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 17 13:37:44.825207 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:37:44.825207 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 17 13:37:44.825207 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi {'': ''} Oct 17 13:37:44.825207 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:37:44.825207 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:44.825207 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:37:44.826888 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:44.826888 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:44.826888 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:44.826888 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:37:44.826888 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:37:44.826888 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:37:44.826888 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:37:44.826888 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:37:44.826888 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:37:44.826888 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:37:44.826888 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:37:44.826888 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:37:44.826888 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:37:44.826888 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:37:44.826888 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:37:44.826888 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 13:37:44.826888 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:37:44.826888 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:44.826888 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:37:44.826888 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:44.828610 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:44.828610 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:44.828610 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:37:44.828610 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:37:44.828610 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 13:37:44.828610 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:37:44.830154 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-189cb51a-5211-40c3-ad56-501c29fb6fbe tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:37:44.831362 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-189cb51a-5211-40c3-ad56-501c29fb6fbe tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "POST /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc/action" status: 400 len: 170 microversion: 2.1 time: 0.022468 Oct 17 13:37:44.835679 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 504/1004] 10.222.0.79 () {60 vars in 1279 bytes} [Mon Oct 17 13:37:44 2022] POST /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc/action => generated 170 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:37:44.841608 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f7731231-6af5-42db-a819-6445a7c74843 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:44.842370 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f7731231-6af5-42db-a819-6445a7c74843 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: ae587603-994d-419d-979a-1b1361144872] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:44.851423 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f7731231-6af5-42db-a819-6445a7c74843 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:44.852161 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f7731231-6af5-42db-a819-6445a7c74843 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:44.852821 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f7731231-6af5-42db-a819-6445a7c74843 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:44.853713 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f7731231-6af5-42db-a819-6445a7c74843 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:44.854300 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f7731231-6af5-42db-a819-6445a7c74843 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:44.854874 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f7731231-6af5-42db-a819-6445a7c74843 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:44.970147 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b121887b-e345-4264-8b59-fee2dd817f2c tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23b9d586c57421abf53a7eaa3af9b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63faec71e9ad449896c83868d52dd09c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:44.993598 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b121887b-e345-4264-8b59-fee2dd817f2c tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] 10.222.0.79 "GET /compute/v2.1/servers/82f35c2e-21ad-448d-a198-6847bf664d52" status: 200 len: 1396 microversion: 2.1 time: 0.655025 Oct 17 13:37:44.994549 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 501/1005] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:44 2022] GET /compute/v2.1/servers/82f35c2e-21ad-448d-a198-6847bf664d52 => generated 1396 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:44.996667 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f7731231-6af5-42db-a819-6445a7c74843 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:44.999239 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d224f142-070e-4947-8843-8dbc745007d0 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:44.999851 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d224f142-070e-4947-8843-8dbc745007d0 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 008be895-7153-417e-9b87-5b60ea31d0bc] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:45.016711 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f7731231-6af5-42db-a819-6445a7c74843 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872" status: 200 len: 1277 microversion: 2.1 time: 0.179353 Oct 17 13:37:45.018147 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 505/1006] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:44 2022] GET /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872 => generated 1277 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:45.020594 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d224f142-070e-4947-8843-8dbc745007d0 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:45.021207 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d224f142-070e-4947-8843-8dbc745007d0 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:45.021884 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d224f142-070e-4947-8843-8dbc745007d0 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:45.022631 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d224f142-070e-4947-8843-8dbc745007d0 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:45.024071 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d224f142-070e-4947-8843-8dbc745007d0 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:45.026068 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d224f142-070e-4947-8843-8dbc745007d0 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:45.349394 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c1c95c7e-5558-4aaf-88ae-8db963377102 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:45.350785 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c1c95c7e-5558-4aaf-88ae-8db963377102 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 37496695-f6e7-4b76-ac8f-05da4f42cdf1] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:45.367191 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c1c95c7e-5558-4aaf-88ae-8db963377102 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:45.367775 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c1c95c7e-5558-4aaf-88ae-8db963377102 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:45.368188 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c1c95c7e-5558-4aaf-88ae-8db963377102 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:45.368872 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c1c95c7e-5558-4aaf-88ae-8db963377102 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:45.369486 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c1c95c7e-5558-4aaf-88ae-8db963377102 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:45.370366 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c1c95c7e-5558-4aaf-88ae-8db963377102 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:45.409169 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d224f142-070e-4947-8843-8dbc745007d0 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:45.424035 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d224f142-070e-4947-8843-8dbc745007d0 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc" status: 200 len: 1520 microversion: 2.1 time: 0.428297 Oct 17 13:37:45.425233 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 502/1007] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:44 2022] GET /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc => generated 1520 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:45.455488 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cb8cf05c-2457-45ad-833d-f8afd4dea411 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:45.456370 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cb8cf05c-2457-45ad-833d-f8afd4dea411 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 008be895-7153-417e-9b87-5b60ea31d0bc] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:45.467570 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb8cf05c-2457-45ad-833d-f8afd4dea411 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:45.470256 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb8cf05c-2457-45ad-833d-f8afd4dea411 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:45.470911 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb8cf05c-2457-45ad-833d-f8afd4dea411 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:45.472501 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb8cf05c-2457-45ad-833d-f8afd4dea411 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:45.475199 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb8cf05c-2457-45ad-833d-f8afd4dea411 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:45.475802 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb8cf05c-2457-45ad-833d-f8afd4dea411 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:45.712451 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c1c95c7e-5558-4aaf-88ae-8db963377102 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:45.720435 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c1c95c7e-5558-4aaf-88ae-8db963377102 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/37496695-f6e7-4b76-ac8f-05da4f42cdf1" status: 200 len: 1316 microversion: 2.1 time: 0.375988 Oct 17 13:37:45.721026 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 506/1008] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:45 2022] GET /compute/v2.1/servers/37496695-f6e7-4b76-ac8f-05da4f42cdf1 => generated 1316 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:37:45.809624 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cb8cf05c-2457-45ad-833d-f8afd4dea411 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:45.822039 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5f254ef6-dd5b-483b-ae97-ddea62d6a703 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:45.823219 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5f254ef6-dd5b-483b-ae97-ddea62d6a703 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] [instance: 0d642292-0447-42da-a7cf-9d15762db2ab] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:45.829175 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cb8cf05c-2457-45ad-833d-f8afd4dea411 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc" status: 200 len: 1520 microversion: 2.1 time: 0.378452 Oct 17 13:37:45.830441 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 503/1009] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:45 2022] GET /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc => generated 1520 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:37:45.845922 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5f254ef6-dd5b-483b-ae97-ddea62d6a703 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:45.850669 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5f254ef6-dd5b-483b-ae97-ddea62d6a703 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:45.852087 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5f254ef6-dd5b-483b-ae97-ddea62d6a703 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:45.853125 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5f254ef6-dd5b-483b-ae97-ddea62d6a703 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:45.853800 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5f254ef6-dd5b-483b-ae97-ddea62d6a703 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:45.854379 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5f254ef6-dd5b-483b-ae97-ddea62d6a703 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:45.857199 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-79cc9b41-2540-44b8-9e49-1f6c4dccdcec tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-322537894", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:45.863464 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-79cc9b41-2540-44b8-9e49-1f6c4dccdcec tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Request method failure captured: Oct 17 13:37:45.863464 n-d-854247-14 devstack@n-api.service[127016]: request: POST /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc/action HTTP/1.1 Oct 17 13:37:45.863464 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:37:45.863464 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:37:45.863464 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:37:45.863464 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 618 Oct 17 13:37:45.863464 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:37:45.863464 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:37:45.863464 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:37:45.863464 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:37:45.863464 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVp-7IxfFP3OCFXwoptz1mkTvVFP-q1mVdb9duvFJBSFB2Milojb0bt4JEkHbyx5bSK8AUBQstoN0fpOUoelRV9Ur5eKS-T70viEjT2k_9W3ZeERt1Gvx_VBqcxVNMvlXoLi-KthVHD7so8JMwaOern88ECZl5tX1TwIw6qcARP1TSo Oct 17 13:37:45.863464 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:37:45.863464 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:37:45.863464 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:37:45.863464 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:37:45.863464 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:37:45.863464 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:37:45.863464 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: c7507d1dd2d345ca9b59dcaa7806b56e Oct 17 13:37:45.863464 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2045461887 Oct 17 13:37:45.863464 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:37:45.863464 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:37:45.865287 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c7507d1dd2d345ca9b59dcaa7806b56e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c7507d1dd2d345ca9b59dcaa7806b56e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c7507d1dd2d345ca9b59dcaa7806b56e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c7507d1dd2d345ca9b59dcaa7806b56e", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:37:45.865287 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2045461887 Oct 17 13:37:45.865287 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: c7507d1dd2d345ca9b59dcaa7806b56e Oct 17 13:37:45.865287 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2045461887 Oct 17 13:37:45.865287 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ImagesOneServerNegativeTestJSON-2045461887-project Oct 17 13:37:45.865287 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:37:45.865287 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:37:45.865287 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: dcbd60cab4174e8db26e28f015795e1f Oct 17 13:37:45.865287 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2045461887-project Oct 17 13:37:45.865287 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:37:45.869359 n-d-854247-14 devstack@n-api.service[127016]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-322537894", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 17 13:37:45.869359 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:37:45.869359 n-d-854247-14 devstack@n-api.service[127016]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 13:37:45.869635 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '008be895-7153-417e-9b87-5b60ea31d0bc', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-322537894', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 17 13:37:45.869635 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:37:45.869635 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:45.869635 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:37:45.869635 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:37:45.869635 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:37:45.869635 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:37:45.869635 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 13:37:45.869635 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:37:45.869635 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 17 13:37:45.869635 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 17 13:37:45.870469 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 17 13:37:45.870469 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 17 13:37:45.870469 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 17 13:37:45.870469 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:37:45.870469 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 17 13:37:45.870469 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 17 13:37:45.870469 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:37:45.870469 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:45.870469 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:37:45.870469 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:45.870469 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:45.870469 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:45.870469 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:37:45.870469 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:37:45.870469 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:37:45.870469 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:37:45.870469 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:37:45.871707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:37:45.871707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:37:45.871707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:37:45.871707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:37:45.871707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:37:45.871707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:37:45.871707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:37:45.871707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 13:37:45.871707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:37:45.871707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:45.871707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:37:45.871707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:45.872585 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:45.872585 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:45.872585 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:37:45.872585 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:37:45.872585 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 13:37:45.872585 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:37:45.873048 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-79cc9b41-2540-44b8-9e49-1f6c4dccdcec tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:37:45.873048 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-79cc9b41-2540-44b8-9e49-1f6c4dccdcec tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "POST /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc/action" status: 400 len: 938 microversion: 2.1 time: 0.012585 Oct 17 13:37:45.873856 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 504/1010] 10.222.0.79 () {60 vars in 1279 bytes} [Mon Oct 17 13:37:45 2022] POST /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc/action => generated 938 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 17 13:37:45.887232 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-96663e2f-c7b7-4fb9-9a87-151e0b6a7b39 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:45.887867 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-96663e2f-c7b7-4fb9-9a87-151e0b6a7b39 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 008be895-7153-417e-9b87-5b60ea31d0bc] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:45.908828 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-96663e2f-c7b7-4fb9-9a87-151e0b6a7b39 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:45.909758 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-96663e2f-c7b7-4fb9-9a87-151e0b6a7b39 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:45.910204 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-96663e2f-c7b7-4fb9-9a87-151e0b6a7b39 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:45.911075 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-96663e2f-c7b7-4fb9-9a87-151e0b6a7b39 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:45.911558 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-96663e2f-c7b7-4fb9-9a87-151e0b6a7b39 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:45.911980 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-96663e2f-c7b7-4fb9-9a87-151e0b6a7b39 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:46.374158 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5f254ef6-dd5b-483b-ae97-ddea62d6a703 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04053f6ae4d4d0cb32c11b5c94c38ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fb92d4cf8c4016b31773ce48bf2ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:46.392815 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-96663e2f-c7b7-4fb9-9a87-151e0b6a7b39 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:46.404483 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-96663e2f-c7b7-4fb9-9a87-151e0b6a7b39 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc" status: 200 len: 1520 microversion: 2.1 time: 0.529441 Oct 17 13:37:46.406541 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5f254ef6-dd5b-483b-ae97-ddea62d6a703 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] 10.222.0.79 "GET /compute/v2.1/servers/0d642292-0447-42da-a7cf-9d15762db2ab" status: 200 len: 1322 microversion: 2.1 time: 0.588307 Oct 17 13:37:46.408697 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 507/1011] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:45 2022] GET /compute/v2.1/servers/0d642292-0447-42da-a7cf-9d15762db2ab => generated 1322 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:37:46.419848 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-59d2a350-0d31-463d-8497-b1abf20e6dcd tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:46.421879 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-59d2a350-0d31-463d-8497-b1abf20e6dcd tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] [instance: 82f35c2e-21ad-448d-a198-6847bf664d52] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:46.424539 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 505/1012] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:45 2022] GET /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc => generated 1520 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:46.438262 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-59d2a350-0d31-463d-8497-b1abf20e6dcd tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:46.440557 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-59d2a350-0d31-463d-8497-b1abf20e6dcd tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:46.441377 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-59d2a350-0d31-463d-8497-b1abf20e6dcd tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:46.442170 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-59d2a350-0d31-463d-8497-b1abf20e6dcd tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:46.442610 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-59d2a350-0d31-463d-8497-b1abf20e6dcd tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:46.443111 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-59d2a350-0d31-463d-8497-b1abf20e6dcd tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:46.457384 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-59e4b6cb-15ae-402e-9895-3d94f492f588 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:46.458257 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-59e4b6cb-15ae-402e-9895-3d94f492f588 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: ae587603-994d-419d-979a-1b1361144872] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:46.465620 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-59e4b6cb-15ae-402e-9895-3d94f492f588 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:46.466282 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-59e4b6cb-15ae-402e-9895-3d94f492f588 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:46.466861 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-59e4b6cb-15ae-402e-9895-3d94f492f588 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:46.467777 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-59e4b6cb-15ae-402e-9895-3d94f492f588 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:46.468384 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-59e4b6cb-15ae-402e-9895-3d94f492f588 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:46.468957 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-59e4b6cb-15ae-402e-9895-3d94f492f588 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:47.027427 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-59e4b6cb-15ae-402e-9895-3d94f492f588 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:47.035600 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-59e4b6cb-15ae-402e-9895-3d94f492f588 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872" status: 200 len: 1307 microversion: 2.1 time: 0.582456 Oct 17 13:37:47.036181 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 506/1013] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:46 2022] GET /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872 => generated 1307 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:47.036474 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-59d2a350-0d31-463d-8497-b1abf20e6dcd tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23b9d586c57421abf53a7eaa3af9b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63faec71e9ad449896c83868d52dd09c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:47.048383 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-59d2a350-0d31-463d-8497-b1abf20e6dcd tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] 10.222.0.79 "GET /compute/v2.1/servers/82f35c2e-21ad-448d-a198-6847bf664d52" status: 200 len: 1396 microversion: 2.1 time: 0.638080 Oct 17 13:37:47.055155 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 508/1014] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:46 2022] GET /compute/v2.1/servers/82f35c2e-21ad-448d-a198-6847bf664d52 => generated 1396 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:47.062626 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d3544d74-aa67-47a9-b72a-ca7f8cc2e760 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:47.066954 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d3544d74-aa67-47a9-b72a-ca7f8cc2e760 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 008be895-7153-417e-9b87-5b60ea31d0bc] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:47.078187 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d3544d74-aa67-47a9-b72a-ca7f8cc2e760 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:47.079201 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d3544d74-aa67-47a9-b72a-ca7f8cc2e760 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:47.091940 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d3544d74-aa67-47a9-b72a-ca7f8cc2e760 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:47.094170 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d3544d74-aa67-47a9-b72a-ca7f8cc2e760 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:47.094902 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d3544d74-aa67-47a9-b72a-ca7f8cc2e760 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:47.095605 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d3544d74-aa67-47a9-b72a-ca7f8cc2e760 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:47.120318 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-130c3ff7-0dad-404d-9ec9-828efff6ee6a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1934898337", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "1fa43ed8-8e4b-47ac-aec2-8368253ad19e"}]}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:47.190337 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-130c3ff7-0dad-404d-9ec9-828efff6ee6a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] validate_networks() for [('1fa43ed8-8e4b-47ac-aec2-8368253ad19e', None, None, None, None, None)] {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:37:47.701234 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d3544d74-aa67-47a9-b72a-ca7f8cc2e760 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:47.715558 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d3544d74-aa67-47a9-b72a-ca7f8cc2e760 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc" status: 200 len: 1520 microversion: 2.1 time: 0.657084 Oct 17 13:37:47.720010 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 509/1015] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:47 2022] GET /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc => generated 1520 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:47.726137 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b304fd2d-8098-445b-bc8e-5a5891457086 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:47.729904 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b304fd2d-8098-445b-bc8e-5a5891457086 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 37496695-f6e7-4b76-ac8f-05da4f42cdf1] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:47.738179 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b304fd2d-8098-445b-bc8e-5a5891457086 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:47.739609 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b304fd2d-8098-445b-bc8e-5a5891457086 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:47.740404 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b304fd2d-8098-445b-bc8e-5a5891457086 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:47.741824 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b304fd2d-8098-445b-bc8e-5a5891457086 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:47.743287 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b304fd2d-8098-445b-bc8e-5a5891457086 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:47.745534 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b304fd2d-8098-445b-bc8e-5a5891457086 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:48.124931 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b304fd2d-8098-445b-bc8e-5a5891457086 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:48.134303 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b304fd2d-8098-445b-bc8e-5a5891457086 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/37496695-f6e7-4b76-ac8f-05da4f42cdf1" status: 200 len: 1316 microversion: 2.1 time: 0.412289 Oct 17 13:37:48.135209 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 510/1016] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:47 2022] GET /compute/v2.1/servers/37496695-f6e7-4b76-ac8f-05da4f42cdf1 => generated 1316 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:48.160184 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7651bafa-befb-4a5a-8d1e-9c4e76500968 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1199802508", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "e29bcb13-7c15-4ffd-8bbd-51a70191051d"}], "security_groups": [{"name": "tempest-securitygroup--417905805"}], "key_name": "tempest-keypair-1909150367", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:48.301045 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-130c3ff7-0dad-404d-9ec9-828efff6ee6a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:37:48.301629 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-130c3ff7-0dad-404d-9ec9-828efff6ee6a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:37:48.302134 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-130c3ff7-0dad-404d-9ec9-828efff6ee6a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:37:48.302791 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-130c3ff7-0dad-404d-9ec9-828efff6ee6a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:37:48.304865 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-130c3ff7-0dad-404d-9ec9-828efff6ee6a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:37:48.312491 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=31 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:37:48.321288 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-130c3ff7-0dad-404d-9ec9-828efff6ee6a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:48.322155 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-130c3ff7-0dad-404d-9ec9-828efff6ee6a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:48.323190 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-130c3ff7-0dad-404d-9ec9-828efff6ee6a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:48.324532 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-130c3ff7-0dad-404d-9ec9-828efff6ee6a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:48.325325 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-130c3ff7-0dad-404d-9ec9-828efff6ee6a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:48.326343 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-130c3ff7-0dad-404d-9ec9-828efff6ee6a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:48.337417 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-7651bafa-befb-4a5a-8d1e-9c4e76500968 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] validate_networks() for [('e29bcb13-7c15-4ffd-8bbd-51a70191051d', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:37:48.357223 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-130c3ff7-0dad-404d-9ec9-828efff6ee6a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Getting quotas for project 90d4540094b84255821c0ab95304d22a. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:37:48.359506 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:37:48.362923 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-130c3ff7-0dad-404d-9ec9-828efff6ee6a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Getting quotas for user 5bc3340d39404042af0eca8747874005 and project 90d4540094b84255821c0ab95304d22a. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:37:48.377038 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-130c3ff7-0dad-404d-9ec9-828efff6ee6a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:37:48.381398 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-130c3ff7-0dad-404d-9ec9-828efff6ee6a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 0ffbef37-e5f8-4de2-a29d-dba6782a3fe4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:37:48.438722 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-130c3ff7-0dad-404d-9ec9-828efff6ee6a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.400967 Oct 17 13:37:48.440905 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 507/1017] 10.222.0.79 () {62 vars in 1188 bytes} [Mon Oct 17 13:37:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1404 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 13:37:48.446732 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9881959d-bb98-4ac3-b53a-d8b70479875f tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:48.447802 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9881959d-bb98-4ac3-b53a-d8b70479875f tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] [instance: 0d642292-0447-42da-a7cf-9d15762db2ab] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:48.456041 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9881959d-bb98-4ac3-b53a-d8b70479875f tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:48.456947 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9881959d-bb98-4ac3-b53a-d8b70479875f tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:48.457542 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9881959d-bb98-4ac3-b53a-d8b70479875f tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:48.458417 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9881959d-bb98-4ac3-b53a-d8b70479875f tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:48.459020 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9881959d-bb98-4ac3-b53a-d8b70479875f tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:48.459763 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9881959d-bb98-4ac3-b53a-d8b70479875f tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:48.745911 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9881959d-bb98-4ac3-b53a-d8b70479875f tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04053f6ae4d4d0cb32c11b5c94c38ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fb92d4cf8c4016b31773ce48bf2ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:48.761168 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9881959d-bb98-4ac3-b53a-d8b70479875f tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] 10.222.0.79 "GET /compute/v2.1/servers/0d642292-0447-42da-a7cf-9d15762db2ab" status: 200 len: 1471 microversion: 2.1 time: 0.318619 Oct 17 13:37:48.762046 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 508/1018] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:48 2022] GET /compute/v2.1/servers/0d642292-0447-42da-a7cf-9d15762db2ab => generated 1471 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:48.768108 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-73eb4bf0-3724-4290-9610-d7a0767fc172 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:48.812731 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-73eb4bf0-3724-4290-9610-d7a0767fc172 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Request method failure captured: Oct 17 13:37:48.812731 n-d-854247-14 devstack@n-api.service[127016]: request: POST /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc/action HTTP/1.1 Oct 17 13:37:48.812731 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:37:48.812731 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:37:48.812731 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:37:48.812731 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 285 Oct 17 13:37:48.812731 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:37:48.812731 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:37:48.812731 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:37:48.812731 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:37:48.812731 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVp-7IxfFP3OCFXwoptz1mkTvVFP-q1mVdb9duvFJBSFB2Milojb0bt4JEkHbyx5bSK8AUBQstoN0fpOUoelRV9Ur5eKS-T70viEjT2k_9W3ZeERt1Gvx_VBqcxVNMvlXoLi-KthVHD7so8JMwaOern88ECZl5tX1TwIw6qcARP1TSo Oct 17 13:37:48.812731 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:37:48.812731 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:37:48.812731 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:37:48.812731 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:37:48.812731 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:37:48.812731 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:37:48.812731 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: c7507d1dd2d345ca9b59dcaa7806b56e Oct 17 13:37:48.812731 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2045461887 Oct 17 13:37:48.812731 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:37:48.812731 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:37:48.814157 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c7507d1dd2d345ca9b59dcaa7806b56e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c7507d1dd2d345ca9b59dcaa7806b56e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c7507d1dd2d345ca9b59dcaa7806b56e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c7507d1dd2d345ca9b59dcaa7806b56e", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:37:48.814157 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2045461887 Oct 17 13:37:48.814157 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: c7507d1dd2d345ca9b59dcaa7806b56e Oct 17 13:37:48.814157 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2045461887 Oct 17 13:37:48.814157 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ImagesOneServerNegativeTestJSON-2045461887-project Oct 17 13:37:48.814157 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:37:48.814157 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:37:48.814157 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: dcbd60cab4174e8db26e28f015795e1f Oct 17 13:37:48.814157 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2045461887-project Oct 17 13:37:48.814157 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:37:48.814157 n-d-854247-14 devstack@n-api.service[127016]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 17 13:37:48.814842 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:37:48.814842 n-d-854247-14 devstack@n-api.service[127016]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 17 13:37:48.814842 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '008be895-7153-417e-9b87-5b60ea31d0bc', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 17 13:37:48.814842 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:37:48.814842 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:48.814842 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:37:48.814842 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:37:48.814842 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:37:48.814842 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:37:48.814842 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 17 13:37:48.816061 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:37:48.816061 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 17 13:37:48.816061 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 17 13:37:48.816061 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:37:48.816061 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 17 13:37:48.816061 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 17 13:37:48.816061 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:37:48.816061 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:48.816061 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:37:48.816061 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:48.816061 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:48.816061 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:48.816061 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:37:48.816061 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:37:48.816061 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:37:48.816061 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:37:48.816061 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:37:48.816061 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:37:48.816061 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:37:48.816061 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:37:48.817252 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:37:48.817252 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:37:48.817252 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:37:48.817252 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:37:48.817252 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 17 13:37:48.817252 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:37:48.817252 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:48.817252 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:37:48.817252 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:48.817252 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:48.817252 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:48.817252 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:37:48.817252 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:37:48.818045 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 17 13:37:48.818045 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:37:48.818045 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-73eb4bf0-3724-4290-9610-d7a0767fc172 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:37:48.818045 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-73eb4bf0-3724-4290-9610-d7a0767fc172 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "POST /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc/action" status: 400 len: 619 microversion: 2.1 time: 0.050944 Oct 17 13:37:48.828532 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 509/1019] 10.222.0.79 () {60 vars in 1279 bytes} [Mon Oct 17 13:37:48 2022] POST /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc/action => generated 619 bytes in 62 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:37:48.831146 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-604ee0c4-e9b9-4c8c-88cf-c01f0176c69f tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:48.831887 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-604ee0c4-e9b9-4c8c-88cf-c01f0176c69f tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] [instance: a54adf11-ee58-4f13-82c8-9a00a36c536e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:48.853108 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-604ee0c4-e9b9-4c8c-88cf-c01f0176c69f tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:48.853593 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-604ee0c4-e9b9-4c8c-88cf-c01f0176c69f tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:48.853956 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-604ee0c4-e9b9-4c8c-88cf-c01f0176c69f tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:48.854663 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-604ee0c4-e9b9-4c8c-88cf-c01f0176c69f tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:48.855135 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-604ee0c4-e9b9-4c8c-88cf-c01f0176c69f tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:48.855577 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-604ee0c4-e9b9-4c8c-88cf-c01f0176c69f tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:49.391942 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-604ee0c4-e9b9-4c8c-88cf-c01f0176c69f tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e" status: 200 len: 1857 microversion: 2.1 time: 0.564959 Oct 17 13:37:49.392955 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 510/1020] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:48 2022] GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e => generated 1857 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:49.406506 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ef41aaa5-2310-44fd-a0b2-87618b23293f tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:49.415547 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ef41aaa5-2310-44fd-a0b2-87618b23293f tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: ae587603-994d-419d-979a-1b1361144872] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:49.430763 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ef41aaa5-2310-44fd-a0b2-87618b23293f tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:49.433363 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ef41aaa5-2310-44fd-a0b2-87618b23293f tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:49.434403 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ef41aaa5-2310-44fd-a0b2-87618b23293f tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:49.437150 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ef41aaa5-2310-44fd-a0b2-87618b23293f tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:49.438731 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ef41aaa5-2310-44fd-a0b2-87618b23293f tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:49.439767 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ef41aaa5-2310-44fd-a0b2-87618b23293f tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:49.466476 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-7651bafa-befb-4a5a-8d1e-9c4e76500968 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:37:49.467101 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-7651bafa-befb-4a5a-8d1e-9c4e76500968 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:37:49.467796 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-7651bafa-befb-4a5a-8d1e-9c4e76500968 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:37:49.468418 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-7651bafa-befb-4a5a-8d1e-9c4e76500968 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:37:49.468794 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-7651bafa-befb-4a5a-8d1e-9c4e76500968 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:37:49.490025 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7651bafa-befb-4a5a-8d1e-9c4e76500968 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:49.491334 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7651bafa-befb-4a5a-8d1e-9c4e76500968 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:49.492033 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7651bafa-befb-4a5a-8d1e-9c4e76500968 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:49.493281 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7651bafa-befb-4a5a-8d1e-9c4e76500968 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:49.493777 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7651bafa-befb-4a5a-8d1e-9c4e76500968 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:49.494251 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7651bafa-befb-4a5a-8d1e-9c4e76500968 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:49.517520 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-7651bafa-befb-4a5a-8d1e-9c4e76500968 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Getting quotas for project d6642f912ba0467bac461bc7aedbf940. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:37:49.524119 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-7651bafa-befb-4a5a-8d1e-9c4e76500968 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Getting quotas for user e6e5309bf84f4aafa9a17604f8452366 and project d6642f912ba0467bac461bc7aedbf940. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:37:49.540068 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7651bafa-befb-4a5a-8d1e-9c4e76500968 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:37:49.543047 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7651bafa-befb-4a5a-8d1e-9c4e76500968 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] [instance: b8d15c7c-7a1f-43e0-9c41-302172f31ca0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:37:49.645725 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7651bafa-befb-4a5a-8d1e-9c4e76500968 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.506236 Oct 17 13:37:49.647103 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 511/1021] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:37:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 1511 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:37:49.653044 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b6c559a2-b3d9-4d5d-bfc7-3ee8f84aaad5 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:49.653898 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b6c559a2-b3d9-4d5d-bfc7-3ee8f84aaad5 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] [instance: 82f35c2e-21ad-448d-a198-6847bf664d52] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:49.661291 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b6c559a2-b3d9-4d5d-bfc7-3ee8f84aaad5 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:49.662212 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b6c559a2-b3d9-4d5d-bfc7-3ee8f84aaad5 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:49.662885 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b6c559a2-b3d9-4d5d-bfc7-3ee8f84aaad5 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:49.663826 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b6c559a2-b3d9-4d5d-bfc7-3ee8f84aaad5 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:49.664524 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b6c559a2-b3d9-4d5d-bfc7-3ee8f84aaad5 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:49.665196 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b6c559a2-b3d9-4d5d-bfc7-3ee8f84aaad5 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:49.711658 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ef41aaa5-2310-44fd-a0b2-87618b23293f tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:49.715471 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=100 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:37:49.734235 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ef41aaa5-2310-44fd-a0b2-87618b23293f tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872" status: 200 len: 1307 microversion: 2.1 time: 0.339511 Oct 17 13:37:49.737658 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 511/1022] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:49 2022] GET /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872 => generated 1307 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:49.747790 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-be77ee84-73a0-4f3f-ad13-ffefcf068051 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:49.748593 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-be77ee84-73a0-4f3f-ad13-ffefcf068051 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 0ffbef37-e5f8-4de2-a29d-dba6782a3fe4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:49.755421 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be77ee84-73a0-4f3f-ad13-ffefcf068051 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:49.756202 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be77ee84-73a0-4f3f-ad13-ffefcf068051 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:49.756641 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be77ee84-73a0-4f3f-ad13-ffefcf068051 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:49.758437 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be77ee84-73a0-4f3f-ad13-ffefcf068051 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:49.758953 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be77ee84-73a0-4f3f-ad13-ffefcf068051 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:49.759387 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be77ee84-73a0-4f3f-ad13-ffefcf068051 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:49.883895 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-be77ee84-73a0-4f3f-ad13-ffefcf068051 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:49.905219 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-be77ee84-73a0-4f3f-ad13-ffefcf068051 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:49.913678 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-be77ee84-73a0-4f3f-ad13-ffefcf068051 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:49.916935 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-be77ee84-73a0-4f3f-ad13-ffefcf068051 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4" status: 200 len: 1314 microversion: 2.25 time: 0.177509 Oct 17 13:37:49.923145 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 512/1023] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:37:49 2022] GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:37:49.928979 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2a51d6f4-b75b-42d6-9ace-fcbbfd65ce28 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:49.929492 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2a51d6f4-b75b-42d6-9ace-fcbbfd65ce28 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] [instance: 0d642292-0447-42da-a7cf-9d15762db2ab] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:49.936804 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2a51d6f4-b75b-42d6-9ace-fcbbfd65ce28 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:49.937292 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2a51d6f4-b75b-42d6-9ace-fcbbfd65ce28 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:49.937736 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2a51d6f4-b75b-42d6-9ace-fcbbfd65ce28 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:49.938449 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2a51d6f4-b75b-42d6-9ace-fcbbfd65ce28 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:49.938901 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2a51d6f4-b75b-42d6-9ace-fcbbfd65ce28 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:49.939360 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2a51d6f4-b75b-42d6-9ace-fcbbfd65ce28 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:49.975608 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2a51d6f4-b75b-42d6-9ace-fcbbfd65ce28 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'b04053f6ae4d4d0cb32c11b5c94c38ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fb92d4cf8c4016b31773ce48bf2ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:49.977533 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2a51d6f4-b75b-42d6-9ace-fcbbfd65ce28 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Request method failure captured: Oct 17 13:37:49.977533 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/0d642292-0447-42da-a7cf-9d15762db2ab/diagnostics HTTP/1.1 Oct 17 13:37:49.977533 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:37:49.977533 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:37:49.977533 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:37:49.977533 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:37:49.977533 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:37:49.977533 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:37:49.977533 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:37:49.977533 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:37:49.977533 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVqHA7fHqqjp7XCDUhSEDfchXqtCuRcdWpZVigfv1kx_vqUt2rXSOzY86CDD0gUsabLnWvmZEC5mRJWHh_VAqG-CIOfj79qmvxF4wnk-tg6b8ujMI55JFgzNd0y_dpxj3TKEMSznpsePAhL-KaRxuvAj-dfIpThVCiYUQA8ApbE42MA Oct 17 13:37:49.977533 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:37:49.977533 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:37:49.977533 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:37:49.977533 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:37:49.977533 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:37:49.977533 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:37:49.977533 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 71fb92d4cf8c4016b31773ce48bf2ec6 Oct 17 13:37:49.977533 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1243028589 Oct 17 13:37:49.977533 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:37:49.977533 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:37:49.978881 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/71fb92d4cf8c4016b31773ce48bf2ec6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/71fb92d4cf8c4016b31773ce48bf2ec6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/71fb92d4cf8c4016b31773ce48bf2ec6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_71fb92d4cf8c4016b31773ce48bf2ec6", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:37:49.978881 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1243028589 Oct 17 13:37:49.978881 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 71fb92d4cf8c4016b31773ce48bf2ec6 Oct 17 13:37:49.978881 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1243028589 Oct 17 13:37:49.978881 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServerDiagnosticsNegativeTest-1243028589-project Oct 17 13:37:49.978881 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:37:49.978881 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:37:49.978881 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: b04053f6ae4d4d0cb32c11b5c94c38ef Oct 17 13:37:49.978881 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1243028589-project Oct 17 13:37:49.978881 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:37:49.978881 n-d-854247-14 devstack@n-api.service[127016]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 17 13:37:49.979629 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'server_id': '0d642292-0447-42da-a7cf-9d15762db2ab'} Oct 17 13:37:49.979629 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:37:49.979629 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:49.979629 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:49.979629 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:49.979629 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:37:49.979629 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:37:49.979629 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:37:49.979629 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:37:49.979629 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 17 13:37:49.979629 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 17 13:37:49.979629 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:37:49.979629 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:37:49.979629 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:37:49.979629 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:37:49.979629 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:37:49.979629 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:37:49.979629 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:37:49.979629 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:37:49.979629 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:37:49.981002 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:37:49.981002 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:37:49.981002 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:37:49.981002 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:37:49.981002 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:37:49.981002 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 17 13:37:49.981002 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:37:49.981002 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:49.981002 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:37:49.981002 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:49.981002 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:49.981002 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:49.981002 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:37:49.981002 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:37:49.981002 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 17 13:37:49.981002 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:37:49.981002 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2a51d6f4-b75b-42d6-9ace-fcbbfd65ce28 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:37:49.982822 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2a51d6f4-b75b-42d6-9ace-fcbbfd65ce28 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] 10.222.0.79 "GET /compute/v2.1/servers/0d642292-0447-42da-a7cf-9d15762db2ab/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.054577 Oct 17 13:37:49.982822 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 513/1024] 10.222.0.79 () {58 vars in 1272 bytes} [Mon Oct 17 13:37:49 2022] GET /compute/v2.1/servers/0d642292-0447-42da-a7cf-9d15762db2ab/diagnostics => generated 117 bytes in 56 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:37:49.992055 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-dab38670-bdd7-4aa9-b23d-a50d5f75709e tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:49.992893 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-dab38670-bdd7-4aa9-b23d-a50d5f75709e tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 008be895-7153-417e-9b87-5b60ea31d0bc] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:49.993135 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b6c559a2-b3d9-4d5d-bfc7-3ee8f84aaad5 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23b9d586c57421abf53a7eaa3af9b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63faec71e9ad449896c83868d52dd09c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:50.001621 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b6c559a2-b3d9-4d5d-bfc7-3ee8f84aaad5 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] 10.222.0.79 "GET /compute/v2.1/servers/82f35c2e-21ad-448d-a198-6847bf664d52" status: 200 len: 1396 microversion: 2.1 time: 0.352605 Oct 17 13:37:50.002219 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 512/1025] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:49 2022] GET /compute/v2.1/servers/82f35c2e-21ad-448d-a198-6847bf664d52 => generated 1396 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:50.005242 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dab38670-bdd7-4aa9-b23d-a50d5f75709e tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:50.007392 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-a49db7f8-b726-4af0-b0ac-62820f9c3882 req-cb31af60-f430-4894-9a11-d8aded836541 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82f35c2e-21ad-448d-a198-6847bf664d52", "name": "network-vif-plugged", "status": "completed", "tag": "dd85193d-95aa-4f67-99f3-26d0422dc6af"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:50.008139 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dab38670-bdd7-4aa9-b23d-a50d5f75709e tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:50.008854 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dab38670-bdd7-4aa9-b23d-a50d5f75709e tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:50.009603 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dab38670-bdd7-4aa9-b23d-a50d5f75709e tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:50.010116 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dab38670-bdd7-4aa9-b23d-a50d5f75709e tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:50.012561 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dab38670-bdd7-4aa9-b23d-a50d5f75709e tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:50.030463 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-a49db7f8-b726-4af0-b0ac-62820f9c3882 req-cb31af60-f430-4894-9a11-d8aded836541 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:50.031356 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-a49db7f8-b726-4af0-b0ac-62820f9c3882 req-cb31af60-f430-4894-9a11-d8aded836541 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:50.031950 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-a49db7f8-b726-4af0-b0ac-62820f9c3882 req-cb31af60-f430-4894-9a11-d8aded836541 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:50.045664 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-a49db7f8-b726-4af0-b0ac-62820f9c3882 req-cb31af60-f430-4894-9a11-d8aded836541 service nova] Creating event network-vif-plugged:dd85193d-95aa-4f67-99f3-26d0422dc6af for instance 82f35c2e-21ad-448d-a198-6847bf664d52 on n-h1-854247-14 Oct 17 13:37:50.052385 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-a49db7f8-b726-4af0-b0ac-62820f9c3882 req-cb31af60-f430-4894-9a11-d8aded836541 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048746 Oct 17 13:37:50.053165 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 513/1026] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:37:50.059106 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-26ca4d1a-8576-41e9-a460-bb8edf3bede7 req-a6c61031-5947-4ec3-93c3-47d3b3c2c2e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae587603-994d-419d-979a-1b1361144872", "tag": "e547063b-1442-46ea-a450-6fddc21a973b"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:50.069800 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-26ca4d1a-8576-41e9-a460-bb8edf3bede7 req-a6c61031-5947-4ec3-93c3-47d3b3c2c2e7 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:50.070237 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-26ca4d1a-8576-41e9-a460-bb8edf3bede7 req-a6c61031-5947-4ec3-93c3-47d3b3c2c2e7 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:50.071406 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-26ca4d1a-8576-41e9-a460-bb8edf3bede7 req-a6c61031-5947-4ec3-93c3-47d3b3c2c2e7 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:50.082983 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-26ca4d1a-8576-41e9-a460-bb8edf3bede7 req-a6c61031-5947-4ec3-93c3-47d3b3c2c2e7 service nova] Creating event network-changed:e547063b-1442-46ea-a450-6fddc21a973b for instance ae587603-994d-419d-979a-1b1361144872 on n-h1-854247-14 Oct 17 13:37:50.089039 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-26ca4d1a-8576-41e9-a460-bb8edf3bede7 req-a6c61031-5947-4ec3-93c3-47d3b3c2c2e7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034155 Oct 17 13:37:50.089709 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 514/1027] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:37:50.095569 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-86967701-4463-48c6-b608-0d0344894b61 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:50.096379 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-86967701-4463-48c6-b608-0d0344894b61 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 37496695-f6e7-4b76-ac8f-05da4f42cdf1] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:50.110710 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-86967701-4463-48c6-b608-0d0344894b61 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:50.111353 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-86967701-4463-48c6-b608-0d0344894b61 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:50.111799 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-86967701-4463-48c6-b608-0d0344894b61 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:50.112848 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-86967701-4463-48c6-b608-0d0344894b61 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:50.113317 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-86967701-4463-48c6-b608-0d0344894b61 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:50.113882 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-86967701-4463-48c6-b608-0d0344894b61 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:50.299908 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-dab38670-bdd7-4aa9-b23d-a50d5f75709e tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:50.317144 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-dab38670-bdd7-4aa9-b23d-a50d5f75709e tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc" status: 200 len: 1520 microversion: 2.1 time: 0.336086 Oct 17 13:37:50.317735 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 514/1028] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:49 2022] GET /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc => generated 1520 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:50.329307 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b4b3d3fe-05f2-4934-8f7f-75a84c74977f tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854247-14", "block_migration": true, "disk_over_commit": false}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:50.334354 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b4b3d3fe-05f2-4934-8f7f-75a84c74977f tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] [instance: a54adf11-ee58-4f13-82c8-9a00a36c536e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:50.342775 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b4b3d3fe-05f2-4934-8f7f-75a84c74977f tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:50.343998 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b4b3d3fe-05f2-4934-8f7f-75a84c74977f tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:50.344611 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b4b3d3fe-05f2-4934-8f7f-75a84c74977f tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:50.345648 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b4b3d3fe-05f2-4934-8f7f-75a84c74977f tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:50.346284 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b4b3d3fe-05f2-4934-8f7f-75a84c74977f tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:50.346855 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b4b3d3fe-05f2-4934-8f7f-75a84c74977f tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:50.421339 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-b4b3d3fe-05f2-4934-8f7f-75a84c74977f tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lazy-loading 'flavor' on Instance uuid a54adf11-ee58-4f13-82c8-9a00a36c536e {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:37:50.452077 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b4b3d3fe-05f2-4934-8f7f-75a84c74977f tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] [instance: a54adf11-ee58-4f13-82c8-9a00a36c536e] Going to try to live migrate instance to n-h2-854247-14 {{(pid=127016) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 17 13:37:50.478735 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-86967701-4463-48c6-b608-0d0344894b61 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:50.492675 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-86967701-4463-48c6-b608-0d0344894b61 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/37496695-f6e7-4b76-ac8f-05da4f42cdf1" status: 200 len: 1316 microversion: 2.1 time: 0.401507 Oct 17 13:37:50.493737 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 515/1029] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:50 2022] GET /compute/v2.1/servers/37496695-f6e7-4b76-ac8f-05da4f42cdf1 => generated 1316 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:50.502488 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-51952d48-60c6-4a68-a7a6-b87885fcc076 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:50.503256 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-51952d48-60c6-4a68-a7a6-b87885fcc076 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] [instance: b8d15c7c-7a1f-43e0-9c41-302172f31ca0] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:50.523313 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-51952d48-60c6-4a68-a7a6-b87885fcc076 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:50.524147 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-51952d48-60c6-4a68-a7a6-b87885fcc076 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:50.524595 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-51952d48-60c6-4a68-a7a6-b87885fcc076 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:50.528436 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-51952d48-60c6-4a68-a7a6-b87885fcc076 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:50.529128 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-51952d48-60c6-4a68-a7a6-b87885fcc076 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:50.530776 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-51952d48-60c6-4a68-a7a6-b87885fcc076 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:50.640203 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-51952d48-60c6-4a68-a7a6-b87885fcc076 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e5309bf84f4aafa9a17604f8452366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6642f912ba0467bac461bc7aedbf940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:50.644731 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:37:50.650872 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-51952d48-60c6-4a68-a7a6-b87885fcc076 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] 10.222.0.79 "GET /compute/v2.1/servers/b8d15c7c-7a1f-43e0-9c41-302172f31ca0" status: 200 len: 1238 microversion: 2.1 time: 0.155778 Oct 17 13:37:50.651549 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 516/1030] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:50 2022] GET /compute/v2.1/servers/b8d15c7c-7a1f-43e0-9c41-302172f31ca0 => generated 1238 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:50.663148 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-65ca116e-f723-421f-a4b6-41e6bd764143 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:50.663914 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-65ca116e-f723-421f-a4b6-41e6bd764143 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] [instance: 0d642292-0447-42da-a7cf-9d15762db2ab] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:50.674244 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-65ca116e-f723-421f-a4b6-41e6bd764143 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:50.675407 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-65ca116e-f723-421f-a4b6-41e6bd764143 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:50.676080 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-65ca116e-f723-421f-a4b6-41e6bd764143 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:50.678030 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-65ca116e-f723-421f-a4b6-41e6bd764143 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:50.678682 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-65ca116e-f723-421f-a4b6-41e6bd764143 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:50.679345 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-65ca116e-f723-421f-a4b6-41e6bd764143 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:50.711500 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-65ca116e-f723-421f-a4b6-41e6bd764143 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] [instance: 0d642292-0447-42da-a7cf-9d15762db2ab] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:37:50.784454 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:37:50.801039 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-65ca116e-f723-421f-a4b6-41e6bd764143 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] 10.222.0.79 "DELETE /compute/v2.1/servers/0d642292-0447-42da-a7cf-9d15762db2ab" status: 204 len: 0 microversion: 2.1 time: 0.147941 Oct 17 13:37:50.802140 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 517/1031] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:37:50 2022] DELETE /compute/v2.1/servers/0d642292-0447-42da-a7cf-9d15762db2ab => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:37:50.811668 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e7d0cee0-9503-4383-8ee4-bbab4eb248f5 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:50.812886 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e7d0cee0-9503-4383-8ee4-bbab4eb248f5 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 008be895-7153-417e-9b87-5b60ea31d0bc] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:50.822563 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e7d0cee0-9503-4383-8ee4-bbab4eb248f5 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:50.823474 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e7d0cee0-9503-4383-8ee4-bbab4eb248f5 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:50.827743 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e7d0cee0-9503-4383-8ee4-bbab4eb248f5 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:50.828673 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e7d0cee0-9503-4383-8ee4-bbab4eb248f5 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:50.829336 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e7d0cee0-9503-4383-8ee4-bbab4eb248f5 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:50.830345 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e7d0cee0-9503-4383-8ee4-bbab4eb248f5 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:51.013190 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e7d0cee0-9503-4383-8ee4-bbab4eb248f5 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:51.024722 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e7d0cee0-9503-4383-8ee4-bbab4eb248f5 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc" status: 200 len: 1520 microversion: 2.1 time: 0.220613 Oct 17 13:37:51.025633 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 518/1032] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:50 2022] GET /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc => generated 1520 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:51.030598 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e4c1e4b7-cdfa-4aa0-88e2-920ab79fa228 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:51.031520 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e4c1e4b7-cdfa-4aa0-88e2-920ab79fa228 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: ae587603-994d-419d-979a-1b1361144872] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:51.038174 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e4c1e4b7-cdfa-4aa0-88e2-920ab79fa228 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:51.038728 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e4c1e4b7-cdfa-4aa0-88e2-920ab79fa228 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:51.039266 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e4c1e4b7-cdfa-4aa0-88e2-920ab79fa228 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:51.040220 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e4c1e4b7-cdfa-4aa0-88e2-920ab79fa228 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:51.041044 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e4c1e4b7-cdfa-4aa0-88e2-920ab79fa228 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:51.041498 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e4c1e4b7-cdfa-4aa0-88e2-920ab79fa228 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:51.190923 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e4c1e4b7-cdfa-4aa0-88e2-920ab79fa228 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:51.199798 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e4c1e4b7-cdfa-4aa0-88e2-920ab79fa228 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872" status: 200 len: 1307 microversion: 2.1 time: 0.172843 Oct 17 13:37:51.201900 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 519/1033] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:51 2022] GET /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872 => generated 1307 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:51.206844 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a3594648-b403-40b0-9bff-76be55a130f3 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:51.207469 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a3594648-b403-40b0-9bff-76be55a130f3 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] [instance: 0d642292-0447-42da-a7cf-9d15762db2ab] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:51.213610 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a3594648-b403-40b0-9bff-76be55a130f3 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:51.214090 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a3594648-b403-40b0-9bff-76be55a130f3 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:51.214518 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a3594648-b403-40b0-9bff-76be55a130f3 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:51.215232 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a3594648-b403-40b0-9bff-76be55a130f3 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:51.215680 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a3594648-b403-40b0-9bff-76be55a130f3 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:51.216093 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a3594648-b403-40b0-9bff-76be55a130f3 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:51.345612 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a3594648-b403-40b0-9bff-76be55a130f3 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04053f6ae4d4d0cb32c11b5c94c38ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fb92d4cf8c4016b31773ce48bf2ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:51.355764 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a3594648-b403-40b0-9bff-76be55a130f3 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] 10.222.0.79 "GET /compute/v2.1/servers/0d642292-0447-42da-a7cf-9d15762db2ab" status: 200 len: 1477 microversion: 2.1 time: 0.152857 Oct 17 13:37:51.356371 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 520/1034] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:51 2022] GET /compute/v2.1/servers/0d642292-0447-42da-a7cf-9d15762db2ab => generated 1477 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:51.360971 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e1c408b8-eb0d-4570-8545-4979ff4f869a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:51.361575 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e1c408b8-eb0d-4570-8545-4979ff4f869a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 0ffbef37-e5f8-4de2-a29d-dba6782a3fe4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:51.367475 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e1c408b8-eb0d-4570-8545-4979ff4f869a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:51.367963 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e1c408b8-eb0d-4570-8545-4979ff4f869a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:51.368384 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e1c408b8-eb0d-4570-8545-4979ff4f869a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:51.369082 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e1c408b8-eb0d-4570-8545-4979ff4f869a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:51.369530 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e1c408b8-eb0d-4570-8545-4979ff4f869a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:51.369953 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e1c408b8-eb0d-4570-8545-4979ff4f869a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:51.445493 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e1c408b8-eb0d-4570-8545-4979ff4f869a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:51.453947 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e1c408b8-eb0d-4570-8545-4979ff4f869a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:51.455408 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e1c408b8-eb0d-4570-8545-4979ff4f869a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:51.456502 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e1c408b8-eb0d-4570-8545-4979ff4f869a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4" status: 200 len: 1320 microversion: 2.25 time: 0.099140 Oct 17 13:37:51.457053 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 521/1035] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:37:51 2022] GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4 => generated 1320 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:37:51.461485 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-547278cb-dd03-4976-9cbd-56140dc7a5fd tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:51.462088 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-547278cb-dd03-4976-9cbd-56140dc7a5fd tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] [instance: 82f35c2e-21ad-448d-a198-6847bf664d52] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:51.467783 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-547278cb-dd03-4976-9cbd-56140dc7a5fd tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:51.468257 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-547278cb-dd03-4976-9cbd-56140dc7a5fd tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:51.468682 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-547278cb-dd03-4976-9cbd-56140dc7a5fd tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:51.469355 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-547278cb-dd03-4976-9cbd-56140dc7a5fd tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:51.469793 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-547278cb-dd03-4976-9cbd-56140dc7a5fd tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:51.470206 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-547278cb-dd03-4976-9cbd-56140dc7a5fd tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:51.604546 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-547278cb-dd03-4976-9cbd-56140dc7a5fd tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23b9d586c57421abf53a7eaa3af9b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63faec71e9ad449896c83868d52dd09c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:51.615986 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-547278cb-dd03-4976-9cbd-56140dc7a5fd tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] 10.222.0.79 "GET /compute/v2.1/servers/82f35c2e-21ad-448d-a198-6847bf664d52" status: 200 len: 1396 microversion: 2.1 time: 0.157774 Oct 17 13:37:51.616753 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 522/1036] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:51 2022] GET /compute/v2.1/servers/82f35c2e-21ad-448d-a198-6847bf664d52 => generated 1396 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:51.621686 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4d23fcf0-0a26-48d1-b49f-9726e309458b tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2112951203"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:51.625156 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4d23fcf0-0a26-48d1-b49f-9726e309458b tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 008be895-7153-417e-9b87-5b60ea31d0bc] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:51.631901 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4d23fcf0-0a26-48d1-b49f-9726e309458b tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:51.632397 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4d23fcf0-0a26-48d1-b49f-9726e309458b tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:51.632819 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4d23fcf0-0a26-48d1-b49f-9726e309458b tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:51.633844 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4d23fcf0-0a26-48d1-b49f-9726e309458b tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:51.634336 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4d23fcf0-0a26-48d1-b49f-9726e309458b tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:51.634750 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4d23fcf0-0a26-48d1-b49f-9726e309458b tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:51.852441 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4d23fcf0-0a26-48d1-b49f-9726e309458b tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "POST /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc/action" status: 202 len: 0 microversion: 2.1 time: 0.233741 Oct 17 13:37:51.853101 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 523/1037] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:37:51 2022] POST /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 17 13:37:51.859253 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-968244d0-04f2-4a28-8fb2-53d2f0d25dae tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:51.859744 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-968244d0-04f2-4a28-8fb2-53d2f0d25dae tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 37496695-f6e7-4b76-ac8f-05da4f42cdf1] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:51.866329 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-968244d0-04f2-4a28-8fb2-53d2f0d25dae tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:51.866794 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-968244d0-04f2-4a28-8fb2-53d2f0d25dae tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:51.867255 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-968244d0-04f2-4a28-8fb2-53d2f0d25dae tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:51.867961 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-968244d0-04f2-4a28-8fb2-53d2f0d25dae tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:51.868397 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-968244d0-04f2-4a28-8fb2-53d2f0d25dae tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:51.868809 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-968244d0-04f2-4a28-8fb2-53d2f0d25dae tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:52.012455 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-968244d0-04f2-4a28-8fb2-53d2f0d25dae tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:52.021466 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-968244d0-04f2-4a28-8fb2-53d2f0d25dae tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/37496695-f6e7-4b76-ac8f-05da4f42cdf1" status: 200 len: 1316 microversion: 2.1 time: 0.167219 Oct 17 13:37:52.022232 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 524/1038] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:51 2022] GET /compute/v2.1/servers/37496695-f6e7-4b76-ac8f-05da4f42cdf1 => generated 1316 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:52.034704 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b59437be-0095-49ce-a3d1-78d0bfa3e7b8 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:52.035466 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b59437be-0095-49ce-a3d1-78d0bfa3e7b8 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] [instance: b8d15c7c-7a1f-43e0-9c41-302172f31ca0] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:52.042559 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b59437be-0095-49ce-a3d1-78d0bfa3e7b8 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:52.043192 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b59437be-0095-49ce-a3d1-78d0bfa3e7b8 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:52.043724 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b59437be-0095-49ce-a3d1-78d0bfa3e7b8 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:52.044527 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b59437be-0095-49ce-a3d1-78d0bfa3e7b8 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:52.045055 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b59437be-0095-49ce-a3d1-78d0bfa3e7b8 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:52.045666 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b59437be-0095-49ce-a3d1-78d0bfa3e7b8 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:52.149355 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b59437be-0095-49ce-a3d1-78d0bfa3e7b8 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e5309bf84f4aafa9a17604f8452366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6642f912ba0467bac461bc7aedbf940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:52.158250 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b59437be-0095-49ce-a3d1-78d0bfa3e7b8 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] 10.222.0.79 "GET /compute/v2.1/servers/b8d15c7c-7a1f-43e0-9c41-302172f31ca0" status: 200 len: 1294 microversion: 2.1 time: 0.134788 Oct 17 13:37:52.158838 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 525/1039] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:52 2022] GET /compute/v2.1/servers/b8d15c7c-7a1f-43e0-9c41-302172f31ca0 => generated 1294 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:52.163404 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f5b85da2-696f-443c-bac0-85c86633676f tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1227920408"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:52.166844 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f5b85da2-696f-443c-bac0-85c86633676f tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 008be895-7153-417e-9b87-5b60ea31d0bc] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:52.173066 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f5b85da2-696f-443c-bac0-85c86633676f tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:52.173653 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f5b85da2-696f-443c-bac0-85c86633676f tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:52.174087 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f5b85da2-696f-443c-bac0-85c86633676f tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:52.174778 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f5b85da2-696f-443c-bac0-85c86633676f tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:52.175393 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f5b85da2-696f-443c-bac0-85c86633676f tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:52.176000 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f5b85da2-696f-443c-bac0-85c86633676f tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:52.208855 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-f5b85da2-696f-443c-bac0-85c86633676f tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] HTTP exception thrown: Cannot 'createImage' instance 008be895-7153-417e-9b87-5b60ea31d0bc while it is in task_state image_snapshot Oct 17 13:37:52.210651 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f5b85da2-696f-443c-bac0-85c86633676f tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Request method failure captured: Oct 17 13:37:52.210651 n-d-854247-14 devstack@n-api.service[127017]: request: POST /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc/action HTTP/1.1 Oct 17 13:37:52.210651 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:37:52.210651 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:37:52.210651 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:37:52.210651 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 85 Oct 17 13:37:52.210651 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:37:52.210651 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:37:52.210651 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:37:52.210651 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:37:52.210651 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVp-7IxfFP3OCFXwoptz1mkTvVFP-q1mVdb9duvFJBSFB2Milojb0bt4JEkHbyx5bSK8AUBQstoN0fpOUoelRV9Ur5eKS-T70viEjT2k_9W3ZeERt1Gvx_VBqcxVNMvlXoLi-KthVHD7so8JMwaOern88ECZl5tX1TwIw6qcARP1TSo Oct 17 13:37:52.210651 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:37:52.210651 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:37:52.210651 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:37:52.210651 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:37:52.210651 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:37:52.210651 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:37:52.210651 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: c7507d1dd2d345ca9b59dcaa7806b56e Oct 17 13:37:52.210651 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2045461887 Oct 17 13:37:52.210651 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:37:52.210651 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:37:52.212403 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c7507d1dd2d345ca9b59dcaa7806b56e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c7507d1dd2d345ca9b59dcaa7806b56e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c7507d1dd2d345ca9b59dcaa7806b56e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c7507d1dd2d345ca9b59dcaa7806b56e", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:37:52.212403 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2045461887 Oct 17 13:37:52.212403 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: c7507d1dd2d345ca9b59dcaa7806b56e Oct 17 13:37:52.212403 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2045461887 Oct 17 13:37:52.212403 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ImagesOneServerNegativeTestJSON-2045461887-project Oct 17 13:37:52.212403 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:37:52.212403 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:37:52.212403 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: dcbd60cab4174e8db26e28f015795e1f Oct 17 13:37:52.212403 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2045461887-project Oct 17 13:37:52.212403 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 13:37:52.212403 n-d-854247-14 devstack@n-api.service[127017]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1227920408"}} Oct 17 13:37:52.212403 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:37:52.215606 n-d-854247-14 devstack@n-api.service[127017]: exception: Cannot 'createImage' instance 008be895-7153-417e-9b87-5b60ea31d0bc while it is in task_state image_snapshot Oct 17 13:37:52.215606 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '008be895-7153-417e-9b87-5b60ea31d0bc', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1227920408'}}} Oct 17 13:37:52.215606 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:37:52.215606 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:52.215606 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 17 13:37:52.215606 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 17 13:37:52.215606 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 17 13:37:52.215606 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 13:37:52.215606 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 008be895-7153-417e-9b87-5b60ea31d0bc in task_state image_snapshot. Cannot snapshot while the instance is in this state. Oct 17 13:37:52.215606 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:37:52.215606 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:52.215606 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:37:52.215606 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:52.215606 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:52.215606 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:52.215606 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:37:52.215606 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:37:52.215606 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:37:52.215606 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:37:52.216782 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:37:52.216782 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:37:52.216782 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:37:52.216782 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:37:52.216782 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 17 13:37:52.216782 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 17 13:37:52.216782 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 13:37:52.216782 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 13:37:52.216782 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 008be895-7153-417e-9b87-5b60ea31d0bc while it is in task_state image_snapshot Oct 17 13:37:52.216782 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:37:52.216782 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:52.216782 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:37:52.216782 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:52.216782 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:52.216782 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:52.216782 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:37:52.216782 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:37:52.216782 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 008be895-7153-417e-9b87-5b60ea31d0bc while it is in task_state image_snapshot Oct 17 13:37:52.216782 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:37:52.217938 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f5b85da2-696f-443c-bac0-85c86633676f tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Returning 409 to user: Cannot 'createImage' instance 008be895-7153-417e-9b87-5b60ea31d0bc while it is in task_state image_snapshot {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:37:52.217938 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f5b85da2-696f-443c-bac0-85c86633676f tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "POST /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc/action" status: 409 len: 159 microversion: 2.1 time: 0.052565 Oct 17 13:37:52.217938 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 526/1040] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:37:52 2022] POST /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc/action => generated 159 bytes in 53 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:37:52.217938 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-a1edb5ca-f8c0-4ad3-bfbf-1f6630d2510a req-1397d8f1-eee3-45a8-82c1-5cb12a4596eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37496695-f6e7-4b76-ac8f-05da4f42cdf1", "name": "network-vif-plugged", "status": "completed", "tag": "db290fa7-4452-4dd9-932a-5f8775bde25b"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:52.227927 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-a1edb5ca-f8c0-4ad3-bfbf-1f6630d2510a req-1397d8f1-eee3-45a8-82c1-5cb12a4596eb service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:52.228431 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-a1edb5ca-f8c0-4ad3-bfbf-1f6630d2510a req-1397d8f1-eee3-45a8-82c1-5cb12a4596eb service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:52.228855 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-a1edb5ca-f8c0-4ad3-bfbf-1f6630d2510a req-1397d8f1-eee3-45a8-82c1-5cb12a4596eb service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:52.241953 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-a1edb5ca-f8c0-4ad3-bfbf-1f6630d2510a req-1397d8f1-eee3-45a8-82c1-5cb12a4596eb service nova] Creating event network-vif-plugged:db290fa7-4452-4dd9-932a-5f8775bde25b for instance 37496695-f6e7-4b76-ac8f-05da4f42cdf1 on n-h2-854247-14 Oct 17 13:37:52.246052 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-a1edb5ca-f8c0-4ad3-bfbf-1f6630d2510a req-1397d8f1-eee3-45a8-82c1-5cb12a4596eb service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032004 Oct 17 13:37:52.246974 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 527/1041] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:37:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:37:52.252269 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-22b34120-9ede-426e-bd7b-a4789717f254 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '.version_select at 0x7f7cd5573310>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:52.435809 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-22b34120-9ede-426e-bd7b-a4789717f254 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "DELETE /compute/v2.1/images/b3fe21ef-98a7-47ff-affe-12e685194623" status: 204 len: 0 microversion: 2.1 time: 0.186773 Oct 17 13:37:52.436697 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 528/1042] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:52 2022] DELETE /compute/v2.1/images/b3fe21ef-98a7-47ff-affe-12e685194623 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:37:52.441880 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-226c744c-6ab5-4999-81a4-710a3744ecae tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:52.442746 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-226c744c-6ab5-4999-81a4-710a3744ecae tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: ae587603-994d-419d-979a-1b1361144872] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:52.449939 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-226c744c-6ab5-4999-81a4-710a3744ecae tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:52.450612 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-226c744c-6ab5-4999-81a4-710a3744ecae tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:52.451085 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-226c744c-6ab5-4999-81a4-710a3744ecae tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:52.451841 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-226c744c-6ab5-4999-81a4-710a3744ecae tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:52.452400 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-226c744c-6ab5-4999-81a4-710a3744ecae tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:52.452825 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-226c744c-6ab5-4999-81a4-710a3744ecae tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:52.608150 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-226c744c-6ab5-4999-81a4-710a3744ecae tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:52.616098 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-226c744c-6ab5-4999-81a4-710a3744ecae tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872" status: 200 len: 1307 microversion: 2.1 time: 0.178391 Oct 17 13:37:52.616846 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 529/1043] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:52 2022] GET /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872 => generated 1307 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:52.621506 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8474f74e-adb4-4b81-9baa-befe185bce55 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:52.622151 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8474f74e-adb4-4b81-9baa-befe185bce55 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] [instance: 0d642292-0447-42da-a7cf-9d15762db2ab] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:52.628145 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8474f74e-adb4-4b81-9baa-befe185bce55 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:52.628630 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8474f74e-adb4-4b81-9baa-befe185bce55 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:52.629063 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8474f74e-adb4-4b81-9baa-befe185bce55 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:52.629760 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8474f74e-adb4-4b81-9baa-befe185bce55 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:52.630207 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8474f74e-adb4-4b81-9baa-befe185bce55 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:52.630677 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8474f74e-adb4-4b81-9baa-befe185bce55 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:52.844994 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8474f74e-adb4-4b81-9baa-befe185bce55 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04053f6ae4d4d0cb32c11b5c94c38ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fb92d4cf8c4016b31773ce48bf2ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:52.861754 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8474f74e-adb4-4b81-9baa-befe185bce55 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] 10.222.0.79 "GET /compute/v2.1/servers/0d642292-0447-42da-a7cf-9d15762db2ab" status: 200 len: 1477 microversion: 2.1 time: 0.240571 Oct 17 13:37:52.875191 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 530/1044] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:52 2022] GET /compute/v2.1/servers/0d642292-0447-42da-a7cf-9d15762db2ab => generated 1477 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:52.876008 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1b51a8a7-1767-491f-8254-632abcfe5f5e tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:52.879649 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1b51a8a7-1767-491f-8254-632abcfe5f5e tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 008be895-7153-417e-9b87-5b60ea31d0bc] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:52.893562 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1b51a8a7-1767-491f-8254-632abcfe5f5e tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:52.894352 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1b51a8a7-1767-491f-8254-632abcfe5f5e tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:52.894921 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1b51a8a7-1767-491f-8254-632abcfe5f5e tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:52.896247 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1b51a8a7-1767-491f-8254-632abcfe5f5e tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:52.896837 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1b51a8a7-1767-491f-8254-632abcfe5f5e tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:52.897576 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1b51a8a7-1767-491f-8254-632abcfe5f5e tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:53.399972 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1b51a8a7-1767-491f-8254-632abcfe5f5e tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:53.410285 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1b51a8a7-1767-491f-8254-632abcfe5f5e tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc" status: 200 len: 1532 microversion: 2.1 time: 0.543314 Oct 17 13:37:53.411502 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 531/1045] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:52 2022] GET /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc => generated 1532 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:53.417296 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4f5341c0-a4fb-4483-8618-f7c3617614b0 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:53.418035 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4f5341c0-a4fb-4483-8618-f7c3617614b0 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 0ffbef37-e5f8-4de2-a29d-dba6782a3fe4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:53.427222 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4f5341c0-a4fb-4483-8618-f7c3617614b0 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:53.428123 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4f5341c0-a4fb-4483-8618-f7c3617614b0 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:53.428827 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4f5341c0-a4fb-4483-8618-f7c3617614b0 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:53.430053 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4f5341c0-a4fb-4483-8618-f7c3617614b0 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:53.430724 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4f5341c0-a4fb-4483-8618-f7c3617614b0 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:53.431742 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4f5341c0-a4fb-4483-8618-f7c3617614b0 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:53.439359 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:37:53.698972 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4f5341c0-a4fb-4483-8618-f7c3617614b0 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:53.711902 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4f5341c0-a4fb-4483-8618-f7c3617614b0 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:53.713701 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4f5341c0-a4fb-4483-8618-f7c3617614b0 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:53.714618 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4f5341c0-a4fb-4483-8618-f7c3617614b0 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4" status: 200 len: 1362 microversion: 2.25 time: 0.301816 Oct 17 13:37:53.715228 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 532/1046] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:37:53 2022] GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4 => generated 1362 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:37:53.720004 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e5e6380a-b52e-4506-9801-7ebe2ff62cff tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:53.720808 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e5e6380a-b52e-4506-9801-7ebe2ff62cff tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] [instance: 82f35c2e-21ad-448d-a198-6847bf664d52] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:53.727483 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e5e6380a-b52e-4506-9801-7ebe2ff62cff tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:53.728332 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e5e6380a-b52e-4506-9801-7ebe2ff62cff tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:53.729170 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e5e6380a-b52e-4506-9801-7ebe2ff62cff tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:53.730507 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e5e6380a-b52e-4506-9801-7ebe2ff62cff tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:53.732162 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e5e6380a-b52e-4506-9801-7ebe2ff62cff tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:53.733179 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e5e6380a-b52e-4506-9801-7ebe2ff62cff tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:53.880340 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e5e6380a-b52e-4506-9801-7ebe2ff62cff tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23b9d586c57421abf53a7eaa3af9b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63faec71e9ad449896c83868d52dd09c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:53.890222 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e5e6380a-b52e-4506-9801-7ebe2ff62cff tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] 10.222.0.79 "GET /compute/v2.1/servers/82f35c2e-21ad-448d-a198-6847bf664d52" status: 200 len: 1578 microversion: 2.1 time: 0.173652 Oct 17 13:37:53.890827 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 533/1047] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:53 2022] GET /compute/v2.1/servers/82f35c2e-21ad-448d-a198-6847bf664d52 => generated 1578 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:53.895356 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-818508e1-3013-4e9f-be13-e0e70baef6c0 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:53.895957 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-818508e1-3013-4e9f-be13-e0e70baef6c0 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 37496695-f6e7-4b76-ac8f-05da4f42cdf1] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:53.911988 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-818508e1-3013-4e9f-be13-e0e70baef6c0 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:53.912786 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-818508e1-3013-4e9f-be13-e0e70baef6c0 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:53.913237 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-818508e1-3013-4e9f-be13-e0e70baef6c0 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:53.913941 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-818508e1-3013-4e9f-be13-e0e70baef6c0 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:53.914732 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-818508e1-3013-4e9f-be13-e0e70baef6c0 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:53.915985 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-818508e1-3013-4e9f-be13-e0e70baef6c0 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:54.372494 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b4b3d3fe-05f2-4934-8f7f-75a84c74977f tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e/action" status: 202 len: 0 microversion: 2.1 time: 4.047287 Oct 17 13:37:54.376122 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 515/1048] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:37:50 2022] POST /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e/action => generated 0 bytes in 4057 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:37:54.392848 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b5f2e559-af44-4512-ad37-f66e20ab8742 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:54.394424 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b5f2e559-af44-4512-ad37-f66e20ab8742 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] [instance: b8d15c7c-7a1f-43e0-9c41-302172f31ca0] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:54.411405 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b5f2e559-af44-4512-ad37-f66e20ab8742 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:54.418812 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b5f2e559-af44-4512-ad37-f66e20ab8742 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:54.419698 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b5f2e559-af44-4512-ad37-f66e20ab8742 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:54.420576 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b5f2e559-af44-4512-ad37-f66e20ab8742 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:54.421344 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b5f2e559-af44-4512-ad37-f66e20ab8742 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:54.421776 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b5f2e559-af44-4512-ad37-f66e20ab8742 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:54.532514 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-818508e1-3013-4e9f-be13-e0e70baef6c0 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:54.538398 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b5f2e559-af44-4512-ad37-f66e20ab8742 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e5309bf84f4aafa9a17604f8452366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6642f912ba0467bac461bc7aedbf940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:54.545532 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-818508e1-3013-4e9f-be13-e0e70baef6c0 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/37496695-f6e7-4b76-ac8f-05da4f42cdf1" status: 200 len: 1316 microversion: 2.1 time: 0.653586 Oct 17 13:37:54.546791 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 534/1049] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:53 2022] GET /compute/v2.1/servers/37496695-f6e7-4b76-ac8f-05da4f42cdf1 => generated 1316 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:54.560117 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-48234e1a-d3f7-4077-8a8f-32e02f9b2d11 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:54.562353 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-48234e1a-d3f7-4077-8a8f-32e02f9b2d11 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: ae587603-994d-419d-979a-1b1361144872] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:54.572718 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48234e1a-d3f7-4077-8a8f-32e02f9b2d11 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:54.573463 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48234e1a-d3f7-4077-8a8f-32e02f9b2d11 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:54.574044 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48234e1a-d3f7-4077-8a8f-32e02f9b2d11 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:54.575037 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48234e1a-d3f7-4077-8a8f-32e02f9b2d11 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:54.575796 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48234e1a-d3f7-4077-8a8f-32e02f9b2d11 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:54.576373 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48234e1a-d3f7-4077-8a8f-32e02f9b2d11 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:54.611883 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b5f2e559-af44-4512-ad37-f66e20ab8742 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] 10.222.0.79 "GET /compute/v2.1/servers/b8d15c7c-7a1f-43e0-9c41-302172f31ca0" status: 200 len: 1300 microversion: 2.1 time: 0.233175 Oct 17 13:37:54.613546 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 516/1050] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:54 2022] GET /compute/v2.1/servers/b8d15c7c-7a1f-43e0-9c41-302172f31ca0 => generated 1300 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:54.635259 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-19fb1c50-407a-40e7-a17d-a14ac7f89c9b tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:54.637285 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-19fb1c50-407a-40e7-a17d-a14ac7f89c9b tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] [instance: 0d642292-0447-42da-a7cf-9d15762db2ab] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:54.645196 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-19fb1c50-407a-40e7-a17d-a14ac7f89c9b tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:54.645999 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-19fb1c50-407a-40e7-a17d-a14ac7f89c9b tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:54.646426 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-19fb1c50-407a-40e7-a17d-a14ac7f89c9b tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:54.647222 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-19fb1c50-407a-40e7-a17d-a14ac7f89c9b tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:54.647672 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-19fb1c50-407a-40e7-a17d-a14ac7f89c9b tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:54.648072 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-19fb1c50-407a-40e7-a17d-a14ac7f89c9b tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:54.692638 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-19fb1c50-407a-40e7-a17d-a14ac7f89c9b tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:54.693772 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-19fb1c50-407a-40e7-a17d-a14ac7f89c9b tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:54.694213 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-19fb1c50-407a-40e7-a17d-a14ac7f89c9b tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:54.695131 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-19fb1c50-407a-40e7-a17d-a14ac7f89c9b tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lazy-loading 'fault' on Instance uuid 0d642292-0447-42da-a7cf-9d15762db2ab {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:37:54.806193 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-19fb1c50-407a-40e7-a17d-a14ac7f89c9b tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04053f6ae4d4d0cb32c11b5c94c38ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71fb92d4cf8c4016b31773ce48bf2ec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:54.828965 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-48234e1a-d3f7-4077-8a8f-32e02f9b2d11 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:54.837688 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-19fb1c50-407a-40e7-a17d-a14ac7f89c9b tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] 10.222.0.79 "GET /compute/v2.1/servers/0d642292-0447-42da-a7cf-9d15762db2ab" status: 200 len: 1312 microversion: 2.1 time: 0.221807 Oct 17 13:37:54.842188 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-48234e1a-d3f7-4077-8a8f-32e02f9b2d11 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872" status: 200 len: 1307 microversion: 2.1 time: 0.291393 Oct 17 13:37:54.842528 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 517/1051] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:54 2022] GET /compute/v2.1/servers/0d642292-0447-42da-a7cf-9d15762db2ab => generated 1312 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:54.847505 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5715573a-e492-4401-a899-bacd97e3ddc2 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:54.849632 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5715573a-e492-4401-a899-bacd97e3ddc2 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] [instance: 82f35c2e-21ad-448d-a198-6847bf664d52] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:54.858013 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 535/1052] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:54 2022] GET /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872 => generated 1307 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:54.864958 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5715573a-e492-4401-a899-bacd97e3ddc2 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:54.869399 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-b0223d69-5572-4489-906d-2cd9419a3480 req-7dd90af0-ece7-4743-8a44-008be33d46bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d642292-0447-42da-a7cf-9d15762db2ab", "name": "network-vif-deleted", "tag": "48c086d5-d910-43b5-8885-675d58e95b63"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:54.870430 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5715573a-e492-4401-a899-bacd97e3ddc2 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:54.870882 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5715573a-e492-4401-a899-bacd97e3ddc2 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:54.871688 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5715573a-e492-4401-a899-bacd97e3ddc2 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:54.872134 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5715573a-e492-4401-a899-bacd97e3ddc2 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:54.872553 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5715573a-e492-4401-a899-bacd97e3ddc2 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:54.884163 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-b0223d69-5572-4489-906d-2cd9419a3480 req-7dd90af0-ece7-4743-8a44-008be33d46bb service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:54.884965 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-b0223d69-5572-4489-906d-2cd9419a3480 req-7dd90af0-ece7-4743-8a44-008be33d46bb service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:54.885553 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-b0223d69-5572-4489-906d-2cd9419a3480 req-7dd90af0-ece7-4743-8a44-008be33d46bb service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:54.903126 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-b0223d69-5572-4489-906d-2cd9419a3480 req-7dd90af0-ece7-4743-8a44-008be33d46bb service nova] Creating event network-vif-deleted:48c086d5-d910-43b5-8885-675d58e95b63 for instance 0d642292-0447-42da-a7cf-9d15762db2ab on n-h2-854247-14 Oct 17 13:37:54.909620 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-b0223d69-5572-4489-906d-2cd9419a3480 req-7dd90af0-ece7-4743-8a44-008be33d46bb service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049989 Oct 17 13:37:54.910762 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 536/1053] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:37:54.917639 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2f957fe3-1ab1-40d8-a94c-84e97c6bab4a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:54.919656 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2f957fe3-1ab1-40d8-a94c-84e97c6bab4a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: a54adf11-ee58-4f13-82c8-9a00a36c536e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:54.930898 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2f957fe3-1ab1-40d8-a94c-84e97c6bab4a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:54.931421 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2f957fe3-1ab1-40d8-a94c-84e97c6bab4a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:54.931918 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2f957fe3-1ab1-40d8-a94c-84e97c6bab4a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:54.932627 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2f957fe3-1ab1-40d8-a94c-84e97c6bab4a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:54.933089 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2f957fe3-1ab1-40d8-a94c-84e97c6bab4a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:54.933506 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2f957fe3-1ab1-40d8-a94c-84e97c6bab4a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:55.089202 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5715573a-e492-4401-a899-bacd97e3ddc2 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] 10.222.0.79 "GET /compute/v2.1/servers/82f35c2e-21ad-448d-a198-6847bf664d52/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.245507 Oct 17 13:37:55.098135 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 518/1054] 10.222.0.79 () {58 vars in 1275 bytes} [Mon Oct 17 13:37:54 2022] GET /compute/v2.1/servers/82f35c2e-21ad-448d-a198-6847bf664d52/os-interface => generated 285 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:37:55.103683 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f7cb0f50-f6d7-4770-ba52-6e5a67ea1366 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:55.104493 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f7cb0f50-f6d7-4770-ba52-6e5a67ea1366 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 008be895-7153-417e-9b87-5b60ea31d0bc] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:55.119453 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f7cb0f50-f6d7-4770-ba52-6e5a67ea1366 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:55.124257 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f7cb0f50-f6d7-4770-ba52-6e5a67ea1366 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:55.124859 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f7cb0f50-f6d7-4770-ba52-6e5a67ea1366 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:55.125750 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f7cb0f50-f6d7-4770-ba52-6e5a67ea1366 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:55.126348 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f7cb0f50-f6d7-4770-ba52-6e5a67ea1366 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:55.126916 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f7cb0f50-f6d7-4770-ba52-6e5a67ea1366 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:55.486733 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2f957fe3-1ab1-40d8-a94c-84e97c6bab4a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:55.497012 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2f957fe3-1ab1-40d8-a94c-84e97c6bab4a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e" status: 200 len: 1714 microversion: 2.1 time: 0.584769 Oct 17 13:37:55.499080 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 537/1055] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:54 2022] GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e => generated 1714 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:55.506148 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2ec6043b-688b-4d3c-9e84-486cc1294d1d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:55.507081 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2ec6043b-688b-4d3c-9e84-486cc1294d1d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 0ffbef37-e5f8-4de2-a29d-dba6782a3fe4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:55.517958 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2ec6043b-688b-4d3c-9e84-486cc1294d1d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:55.518993 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2ec6043b-688b-4d3c-9e84-486cc1294d1d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:55.519814 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2ec6043b-688b-4d3c-9e84-486cc1294d1d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:55.520634 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2ec6043b-688b-4d3c-9e84-486cc1294d1d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:55.521190 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2ec6043b-688b-4d3c-9e84-486cc1294d1d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:55.521804 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2ec6043b-688b-4d3c-9e84-486cc1294d1d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:55.604174 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f7cb0f50-f6d7-4770-ba52-6e5a67ea1366 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:55.613108 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f7cb0f50-f6d7-4770-ba52-6e5a67ea1366 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc" status: 200 len: 1538 microversion: 2.1 time: 0.513563 Oct 17 13:37:55.627844 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 519/1056] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:55 2022] GET /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc => generated 1538 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:55.638451 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a7f23935-b4a2-41be-a053-225118ddf2f2 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:55.639072 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a7f23935-b4a2-41be-a053-225118ddf2f2 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 37496695-f6e7-4b76-ac8f-05da4f42cdf1] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:55.646820 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a7f23935-b4a2-41be-a053-225118ddf2f2 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:55.651344 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a7f23935-b4a2-41be-a053-225118ddf2f2 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:55.651588 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a7f23935-b4a2-41be-a053-225118ddf2f2 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:55.652506 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a7f23935-b4a2-41be-a053-225118ddf2f2 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:55.654941 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a7f23935-b4a2-41be-a053-225118ddf2f2 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:55.655430 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a7f23935-b4a2-41be-a053-225118ddf2f2 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:55.971582 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2ec6043b-688b-4d3c-9e84-486cc1294d1d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:55.980048 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2ec6043b-688b-4d3c-9e84-486cc1294d1d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:55.981634 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2ec6043b-688b-4d3c-9e84-486cc1294d1d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:55.982779 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2ec6043b-688b-4d3c-9e84-486cc1294d1d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4" status: 200 len: 1362 microversion: 2.25 time: 0.482095 Oct 17 13:37:55.983364 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 538/1057] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:37:55 2022] GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4 => generated 1362 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:37:55.987757 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-034b4f55-b2f2-462f-bf38-a13aac0515a4 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:55.988559 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-034b4f55-b2f2-462f-bf38-a13aac0515a4 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] [instance: b8d15c7c-7a1f-43e0-9c41-302172f31ca0] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:55.994862 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-034b4f55-b2f2-462f-bf38-a13aac0515a4 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:55.995848 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-034b4f55-b2f2-462f-bf38-a13aac0515a4 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:55.996425 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-034b4f55-b2f2-462f-bf38-a13aac0515a4 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:55.997311 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-034b4f55-b2f2-462f-bf38-a13aac0515a4 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:55.997891 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-034b4f55-b2f2-462f-bf38-a13aac0515a4 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:55.998451 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-034b4f55-b2f2-462f-bf38-a13aac0515a4 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:56.032650 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a7f23935-b4a2-41be-a053-225118ddf2f2 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:56.040972 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a7f23935-b4a2-41be-a053-225118ddf2f2 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/37496695-f6e7-4b76-ac8f-05da4f42cdf1" status: 200 len: 1466 microversion: 2.1 time: 0.426231 Oct 17 13:37:56.041672 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 520/1058] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:55 2022] GET /compute/v2.1/servers/37496695-f6e7-4b76-ac8f-05da4f42cdf1 => generated 1466 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:56.046795 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1e4af241-2614-4c6f-bcb9-b6bb0b514e51 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:56.047438 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-1e4af241-2614-4c6f-bcb9-b6bb0b514e51 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] [instance: 0d642292-0447-42da-a7cf-9d15762db2ab] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:56.057596 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1e4af241-2614-4c6f-bcb9-b6bb0b514e51 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:56.058389 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1e4af241-2614-4c6f-bcb9-b6bb0b514e51 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:56.059185 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1e4af241-2614-4c6f-bcb9-b6bb0b514e51 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:56.059919 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1e4af241-2614-4c6f-bcb9-b6bb0b514e51 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:56.060531 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1e4af241-2614-4c6f-bcb9-b6bb0b514e51 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:56.061260 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1e4af241-2614-4c6f-bcb9-b6bb0b514e51 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:56.076425 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-1e4af241-2614-4c6f-bcb9-b6bb0b514e51 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] HTTP exception thrown: Instance 0d642292-0447-42da-a7cf-9d15762db2ab could not be found. Oct 17 13:37:56.078514 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1e4af241-2614-4c6f-bcb9-b6bb0b514e51 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Request method failure captured: Oct 17 13:37:56.078514 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/0d642292-0447-42da-a7cf-9d15762db2ab HTTP/1.1 Oct 17 13:37:56.078514 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:37:56.078514 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:37:56.078514 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:37:56.078514 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:37:56.078514 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:37:56.078514 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:37:56.078514 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:37:56.078514 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:37:56.078514 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVqHA7fHqqjp7XCDUhSEDfchXqtCuRcdWpZVigfv1kx_vqUt2rXSOzY86CDD0gUsabLnWvmZEC5mRJWHh_VAqG-CIOfj79qmvxF4wnk-tg6b8ujMI55JFgzNd0y_dpxj3TKEMSznpsePAhL-KaRxuvAj-dfIpThVCiYUQA8ApbE42MA Oct 17 13:37:56.078514 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:37:56.078514 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:37:56.078514 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:37:56.078514 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:37:56.078514 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:37:56.078514 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:37:56.078514 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 71fb92d4cf8c4016b31773ce48bf2ec6 Oct 17 13:37:56.078514 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1243028589 Oct 17 13:37:56.078514 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:37:56.078514 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:37:56.080136 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/71fb92d4cf8c4016b31773ce48bf2ec6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/71fb92d4cf8c4016b31773ce48bf2ec6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/71fb92d4cf8c4016b31773ce48bf2ec6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_71fb92d4cf8c4016b31773ce48bf2ec6", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:37:56.080136 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1243028589 Oct 17 13:37:56.080136 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 71fb92d4cf8c4016b31773ce48bf2ec6 Oct 17 13:37:56.080136 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1243028589 Oct 17 13:37:56.080136 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServerDiagnosticsNegativeTest-1243028589-project Oct 17 13:37:56.080136 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:37:56.080136 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:37:56.080136 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: b04053f6ae4d4d0cb32c11b5c94c38ef Oct 17 13:37:56.080136 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1243028589-project Oct 17 13:37:56.080136 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:37:56.080136 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 0d642292-0447-42da-a7cf-9d15762db2ab could not be found. Oct 17 13:37:56.080136 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '0d642292-0447-42da-a7cf-9d15762db2ab'} Oct 17 13:37:56.081043 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:37:56.081043 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:56.081043 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:37:56.081043 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:37:56.081043 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:37:56.081043 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:37:56.081043 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:37:56.081043 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:37:56.081043 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:37:56.081043 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:37:56.081043 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d642292-0447-42da-a7cf-9d15762db2ab could not be found. Oct 17 13:37:56.081043 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:37:56.081043 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:56.081043 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:37:56.081043 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:56.081043 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:56.081043 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:56.081043 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:37:56.081043 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:37:56.081043 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:37:56.082426 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:37:56.082426 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:37:56.082426 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:37:56.082426 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:37:56.082426 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:37:56.082426 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:37:56.082426 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:37:56.082426 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d642292-0447-42da-a7cf-9d15762db2ab could not be found. Oct 17 13:37:56.082426 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:37:56.082426 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:56.082426 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:37:56.082426 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:56.082426 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:56.082426 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:56.082426 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:37:56.082426 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:37:56.082426 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d642292-0447-42da-a7cf-9d15762db2ab could not be found. Oct 17 13:37:56.082426 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:37:56.084591 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1e4af241-2614-4c6f-bcb9-b6bb0b514e51 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] Returning 404 to user: Instance 0d642292-0447-42da-a7cf-9d15762db2ab could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:37:56.085580 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1e4af241-2614-4c6f-bcb9-b6bb0b514e51 tempest-ServerDiagnosticsNegativeTest-1243028589 tempest-ServerDiagnosticsNegativeTest-1243028589-project] 10.222.0.79 "GET /compute/v2.1/servers/0d642292-0447-42da-a7cf-9d15762db2ab" status: 404 len: 111 microversion: 2.1 time: 0.042486 Oct 17 13:37:56.086671 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 521/1059] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:56 2022] GET /compute/v2.1/servers/0d642292-0447-42da-a7cf-9d15762db2ab => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:37:56.093008 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-88f14ab0-87ff-4da9-9e5c-adc564a863a5 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:56.093821 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-88f14ab0-87ff-4da9-9e5c-adc564a863a5 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: ae587603-994d-419d-979a-1b1361144872] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:56.107901 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-88f14ab0-87ff-4da9-9e5c-adc564a863a5 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:56.108683 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-88f14ab0-87ff-4da9-9e5c-adc564a863a5 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:56.109265 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-88f14ab0-87ff-4da9-9e5c-adc564a863a5 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:56.110163 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-88f14ab0-87ff-4da9-9e5c-adc564a863a5 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:56.110762 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-88f14ab0-87ff-4da9-9e5c-adc564a863a5 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:56.111427 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-88f14ab0-87ff-4da9-9e5c-adc564a863a5 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:56.449304 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-034b4f55-b2f2-462f-bf38-a13aac0515a4 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e5309bf84f4aafa9a17604f8452366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6642f912ba0467bac461bc7aedbf940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:56.460245 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-034b4f55-b2f2-462f-bf38-a13aac0515a4 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] 10.222.0.79 "GET /compute/v2.1/servers/b8d15c7c-7a1f-43e0-9c41-302172f31ca0" status: 200 len: 1367 microversion: 2.1 time: 0.475823 Oct 17 13:37:56.461314 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 539/1060] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:55 2022] GET /compute/v2.1/servers/b8d15c7c-7a1f-43e0-9c41-302172f31ca0 => generated 1367 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:56.471718 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2344080b-37a1-4ac6-91cb-bc872d6cbb28 tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:56.472540 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2344080b-37a1-4ac6-91cb-bc872d6cbb28 tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] [instance: 37496695-f6e7-4b76-ac8f-05da4f42cdf1] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:56.485725 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2344080b-37a1-4ac6-91cb-bc872d6cbb28 tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:56.486448 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2344080b-37a1-4ac6-91cb-bc872d6cbb28 tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:56.487578 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2344080b-37a1-4ac6-91cb-bc872d6cbb28 tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:56.489236 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2344080b-37a1-4ac6-91cb-bc872d6cbb28 tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:56.489849 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2344080b-37a1-4ac6-91cb-bc872d6cbb28 tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:56.490426 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2344080b-37a1-4ac6-91cb-bc872d6cbb28 tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:56.549559 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-88f14ab0-87ff-4da9-9e5c-adc564a863a5 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:56.560253 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-88f14ab0-87ff-4da9-9e5c-adc564a863a5 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872" status: 200 len: 1307 microversion: 2.1 time: 0.472201 Oct 17 13:37:56.561185 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 522/1061] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:56 2022] GET /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872 => generated 1307 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:56.576446 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-06e9cd30-1c8e-4205-9cb4-a544ba3c3083 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:56.577896 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-06e9cd30-1c8e-4205-9cb4-a544ba3c3083 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: a54adf11-ee58-4f13-82c8-9a00a36c536e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:56.585830 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-06e9cd30-1c8e-4205-9cb4-a544ba3c3083 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:56.586676 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-06e9cd30-1c8e-4205-9cb4-a544ba3c3083 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:56.587515 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-06e9cd30-1c8e-4205-9cb4-a544ba3c3083 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:56.588565 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-06e9cd30-1c8e-4205-9cb4-a544ba3c3083 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:56.589206 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-06e9cd30-1c8e-4205-9cb4-a544ba3c3083 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:56.589846 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-06e9cd30-1c8e-4205-9cb4-a544ba3c3083 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:57.050774 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2344080b-37a1-4ac6-91cb-bc872d6cbb28 tempest-ServersOnMultiNodesTest-169058660 tempest-ServersOnMultiNodesTest-169058660-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/37496695-f6e7-4b76-ac8f-05da4f42cdf1" status: 200 len: 1619 microversion: 2.1 time: 0.588058 Oct 17 13:37:57.064205 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 540/1062] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:56 2022] GET /compute/v2.1/servers/37496695-f6e7-4b76-ac8f-05da4f42cdf1 => generated 1619 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:57.091615 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a50d13a9-3a84-4427-91ff-33ccc39d8c5b tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:57.092505 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a50d13a9-3a84-4427-91ff-33ccc39d8c5b tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 008be895-7153-417e-9b87-5b60ea31d0bc] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:57.094360 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-06e9cd30-1c8e-4205-9cb4-a544ba3c3083 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:57.102436 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a50d13a9-3a84-4427-91ff-33ccc39d8c5b tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:57.103452 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a50d13a9-3a84-4427-91ff-33ccc39d8c5b tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:57.104162 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a50d13a9-3a84-4427-91ff-33ccc39d8c5b tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:57.119045 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a50d13a9-3a84-4427-91ff-33ccc39d8c5b tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:57.120029 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a50d13a9-3a84-4427-91ff-33ccc39d8c5b tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:57.121074 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-06e9cd30-1c8e-4205-9cb4-a544ba3c3083 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e" status: 200 len: 1714 microversion: 2.1 time: 0.558197 Oct 17 13:37:57.121753 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a50d13a9-3a84-4427-91ff-33ccc39d8c5b tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:57.137140 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 523/1063] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:56 2022] GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e => generated 1714 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:57.146512 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-72ffd54b-bb28-4b4f-876f-f783d26b3599 req-da9dac60-0bd3-4530-be21-50db4846f8cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ffbef37-e5f8-4de2-a29d-dba6782a3fe4", "tag": "f6d4c8b6-ba32-4306-822c-cf94066fc47e"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:57.160076 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-72ffd54b-bb28-4b4f-876f-f783d26b3599 req-da9dac60-0bd3-4530-be21-50db4846f8cb service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:57.160878 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-72ffd54b-bb28-4b4f-876f-f783d26b3599 req-da9dac60-0bd3-4530-be21-50db4846f8cb service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:57.161490 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-72ffd54b-bb28-4b4f-876f-f783d26b3599 req-da9dac60-0bd3-4530-be21-50db4846f8cb service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:57.180585 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-72ffd54b-bb28-4b4f-876f-f783d26b3599 req-da9dac60-0bd3-4530-be21-50db4846f8cb service nova] Creating event network-changed:f6d4c8b6-ba32-4306-822c-cf94066fc47e for instance 0ffbef37-e5f8-4de2-a29d-dba6782a3fe4 on n-h1-854247-14 Oct 17 13:37:57.195636 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-72ffd54b-bb28-4b4f-876f-f783d26b3599 req-da9dac60-0bd3-4530-be21-50db4846f8cb service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056741 Oct 17 13:37:57.199154 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 524/1064] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:37:57.216009 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-f8812f79-1a46-4224-87df-6738135de27b req-e364ee6e-6ff8-4935-8c2c-01d22e725d20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae587603-994d-419d-979a-1b1361144872", "name": "network-vif-plugged", "status": "completed", "tag": "e547063b-1442-46ea-a450-6fddc21a973b"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:57.241264 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-f8812f79-1a46-4224-87df-6738135de27b req-e364ee6e-6ff8-4935-8c2c-01d22e725d20 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:57.242067 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-f8812f79-1a46-4224-87df-6738135de27b req-e364ee6e-6ff8-4935-8c2c-01d22e725d20 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:57.242845 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-f8812f79-1a46-4224-87df-6738135de27b req-e364ee6e-6ff8-4935-8c2c-01d22e725d20 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:57.272295 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-f8812f79-1a46-4224-87df-6738135de27b req-e364ee6e-6ff8-4935-8c2c-01d22e725d20 service nova] Creating event network-vif-plugged:e547063b-1442-46ea-a450-6fddc21a973b for instance ae587603-994d-419d-979a-1b1361144872 on n-h1-854247-14 Oct 17 13:37:57.288681 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-f8812f79-1a46-4224-87df-6738135de27b req-e364ee6e-6ff8-4935-8c2c-01d22e725d20 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084161 Oct 17 13:37:57.290546 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 525/1065] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:37:57.321003 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-65d5ef6c-50d6-481b-9050-b76438d9eca1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:57.322225 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-65d5ef6c-50d6-481b-9050-b76438d9eca1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 0ffbef37-e5f8-4de2-a29d-dba6782a3fe4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:57.350343 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-65d5ef6c-50d6-481b-9050-b76438d9eca1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:57.352628 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-65d5ef6c-50d6-481b-9050-b76438d9eca1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:57.353098 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-65d5ef6c-50d6-481b-9050-b76438d9eca1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:57.357034 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-65d5ef6c-50d6-481b-9050-b76438d9eca1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:57.359768 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-65d5ef6c-50d6-481b-9050-b76438d9eca1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:57.361988 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-65d5ef6c-50d6-481b-9050-b76438d9eca1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:58.043068 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a50d13a9-3a84-4427-91ff-33ccc39d8c5b tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:58.052162 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a50d13a9-3a84-4427-91ff-33ccc39d8c5b tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc" status: 200 len: 1520 microversion: 2.1 time: 0.986412 Oct 17 13:37:58.053773 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 541/1066] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:57 2022] GET /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc => generated 1520 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:58.058888 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-70290c16-adbc-4044-aca1-6453dc548eb0 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:58.059682 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-70290c16-adbc-4044-aca1-6453dc548eb0 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 37496695-f6e7-4b76-ac8f-05da4f42cdf1] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:58.066933 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70290c16-adbc-4044-aca1-6453dc548eb0 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:58.067713 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70290c16-adbc-4044-aca1-6453dc548eb0 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:58.068340 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70290c16-adbc-4044-aca1-6453dc548eb0 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:58.069946 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70290c16-adbc-4044-aca1-6453dc548eb0 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:58.070672 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70290c16-adbc-4044-aca1-6453dc548eb0 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:58.071628 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70290c16-adbc-4044-aca1-6453dc548eb0 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:58.119204 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-70290c16-adbc-4044-aca1-6453dc548eb0 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 37496695-f6e7-4b76-ac8f-05da4f42cdf1] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:37:58.220524 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-65d5ef6c-50d6-481b-9050-b76438d9eca1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:58.230596 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-65d5ef6c-50d6-481b-9050-b76438d9eca1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:58.232402 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-65d5ef6c-50d6-481b-9050-b76438d9eca1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:58.233698 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-65d5ef6c-50d6-481b-9050-b76438d9eca1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4" status: 200 len: 1362 microversion: 2.25 time: 0.941534 Oct 17 13:37:58.247886 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 526/1067] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:37:57 2022] GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4 => generated 1362 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:37:58.258028 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-dd337670-6b9b-42ae-8c7d-97d48d8f7e1f tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:58.259231 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-dd337670-6b9b-42ae-8c7d-97d48d8f7e1f tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] [instance: b8d15c7c-7a1f-43e0-9c41-302172f31ca0] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:58.266757 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dd337670-6b9b-42ae-8c7d-97d48d8f7e1f tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:58.267720 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dd337670-6b9b-42ae-8c7d-97d48d8f7e1f tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:58.268472 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dd337670-6b9b-42ae-8c7d-97d48d8f7e1f tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:58.269362 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dd337670-6b9b-42ae-8c7d-97d48d8f7e1f tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:58.270035 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dd337670-6b9b-42ae-8c7d-97d48d8f7e1f tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:58.270647 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dd337670-6b9b-42ae-8c7d-97d48d8f7e1f tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:58.299608 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-70290c16-adbc-4044-aca1-6453dc548eb0 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "DELETE /compute/v2.1/servers/37496695-f6e7-4b76-ac8f-05da4f42cdf1" status: 204 len: 0 microversion: 2.1 time: 0.244248 Oct 17 13:37:58.301946 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 542/1068] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:37:58 2022] DELETE /compute/v2.1/servers/37496695-f6e7-4b76-ac8f-05da4f42cdf1 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:37:58.307909 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7f0b15c6-74c4-47d1-94a5-cfb8597e19f3 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:58.308947 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7f0b15c6-74c4-47d1-94a5-cfb8597e19f3 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: ae587603-994d-419d-979a-1b1361144872] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:58.320620 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7f0b15c6-74c4-47d1-94a5-cfb8597e19f3 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:58.323274 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7f0b15c6-74c4-47d1-94a5-cfb8597e19f3 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:58.324247 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7f0b15c6-74c4-47d1-94a5-cfb8597e19f3 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:58.327807 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7f0b15c6-74c4-47d1-94a5-cfb8597e19f3 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:58.328667 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7f0b15c6-74c4-47d1-94a5-cfb8597e19f3 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:58.329483 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7f0b15c6-74c4-47d1-94a5-cfb8597e19f3 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:58.346328 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:37:58.371310 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=5 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:37:58.615442 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-dd337670-6b9b-42ae-8c7d-97d48d8f7e1f tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e5309bf84f4aafa9a17604f8452366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6642f912ba0467bac461bc7aedbf940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:58.631077 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-dd337670-6b9b-42ae-8c7d-97d48d8f7e1f tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] 10.222.0.79 "GET /compute/v2.1/servers/b8d15c7c-7a1f-43e0-9c41-302172f31ca0" status: 200 len: 1367 microversion: 2.1 time: 0.381649 Oct 17 13:37:58.632560 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 527/1069] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:58 2022] GET /compute/v2.1/servers/b8d15c7c-7a1f-43e0-9c41-302172f31ca0 => generated 1367 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:58.640161 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a9daf869-3d10-4dba-a79a-c32b7b70ee45 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:58.640979 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a9daf869-3d10-4dba-a79a-c32b7b70ee45 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 008be895-7153-417e-9b87-5b60ea31d0bc] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:58.649883 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a9daf869-3d10-4dba-a79a-c32b7b70ee45 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:58.651454 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a9daf869-3d10-4dba-a79a-c32b7b70ee45 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:58.652184 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a9daf869-3d10-4dba-a79a-c32b7b70ee45 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:58.653434 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a9daf869-3d10-4dba-a79a-c32b7b70ee45 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:58.654250 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a9daf869-3d10-4dba-a79a-c32b7b70ee45 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:58.656649 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a9daf869-3d10-4dba-a79a-c32b7b70ee45 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:58.700725 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a9daf869-3d10-4dba-a79a-c32b7b70ee45 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 008be895-7153-417e-9b87-5b60ea31d0bc] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:37:58.703506 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:37:58.730379 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7f0b15c6-74c4-47d1-94a5-cfb8597e19f3 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:58.759256 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7f0b15c6-74c4-47d1-94a5-cfb8597e19f3 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872" status: 200 len: 1307 microversion: 2.1 time: 0.452906 Oct 17 13:37:58.771765 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 543/1070] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:58 2022] GET /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872 => generated 1307 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:58.786952 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-97f2720c-5caa-434b-bda8-65d0e73da1bd tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:58.792346 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-97f2720c-5caa-434b-bda8-65d0e73da1bd tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: a54adf11-ee58-4f13-82c8-9a00a36c536e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:58.812847 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-97f2720c-5caa-434b-bda8-65d0e73da1bd tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:58.821774 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-97f2720c-5caa-434b-bda8-65d0e73da1bd tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:58.822472 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-97f2720c-5caa-434b-bda8-65d0e73da1bd tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:58.823380 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-97f2720c-5caa-434b-bda8-65d0e73da1bd tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:58.827685 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-97f2720c-5caa-434b-bda8-65d0e73da1bd tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:58.830595 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-97f2720c-5caa-434b-bda8-65d0e73da1bd tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:58.916765 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a9daf869-3d10-4dba-a79a-c32b7b70ee45 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "DELETE /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc" status: 204 len: 0 microversion: 2.1 time: 0.281876 Oct 17 13:37:58.917875 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 528/1071] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:37:58 2022] DELETE /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:37:58.924392 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1254ef81-cac7-4138-b906-34d6df189566 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:58.925244 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-1254ef81-cac7-4138-b906-34d6df189566 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 37496695-f6e7-4b76-ac8f-05da4f42cdf1] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:58.932376 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1254ef81-cac7-4138-b906-34d6df189566 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:58.933045 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1254ef81-cac7-4138-b906-34d6df189566 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:58.933719 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1254ef81-cac7-4138-b906-34d6df189566 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:58.934336 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1254ef81-cac7-4138-b906-34d6df189566 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:58.934886 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1254ef81-cac7-4138-b906-34d6df189566 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:58.935528 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1254ef81-cac7-4138-b906-34d6df189566 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:59.189730 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-97f2720c-5caa-434b-bda8-65d0e73da1bd tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:59.201220 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-97f2720c-5caa-434b-bda8-65d0e73da1bd tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e" status: 200 len: 1714 microversion: 2.1 time: 0.433081 Oct 17 13:37:59.204967 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 544/1072] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:58 2022] GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e => generated 1714 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:59.219284 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f469e9ec-60a4-4ad9-9f3e-7cb61a6d96b6 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:59.220276 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f469e9ec-60a4-4ad9-9f3e-7cb61a6d96b6 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] [instance: 82f35c2e-21ad-448d-a198-6847bf664d52] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:59.230375 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f469e9ec-60a4-4ad9-9f3e-7cb61a6d96b6 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:59.234914 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-1254ef81-cac7-4138-b906-34d6df189566 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:59.239637 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f469e9ec-60a4-4ad9-9f3e-7cb61a6d96b6 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:59.254608 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f469e9ec-60a4-4ad9-9f3e-7cb61a6d96b6 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:59.255760 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f469e9ec-60a4-4ad9-9f3e-7cb61a6d96b6 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:59.255973 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1254ef81-cac7-4138-b906-34d6df189566 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/37496695-f6e7-4b76-ac8f-05da4f42cdf1" status: 200 len: 1472 microversion: 2.1 time: 0.334221 Oct 17 13:37:59.256798 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 529/1073] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:58 2022] GET /compute/v2.1/servers/37496695-f6e7-4b76-ac8f-05da4f42cdf1 => generated 1472 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:59.257494 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f469e9ec-60a4-4ad9-9f3e-7cb61a6d96b6 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:59.258990 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f469e9ec-60a4-4ad9-9f3e-7cb61a6d96b6 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:59.263675 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-a8cc55de-79b9-43df-8331-0ffd3c97b600 req-765616b3-3c44-4a0d-a72a-47c1a0d125f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82f35c2e-21ad-448d-a198-6847bf664d52", "tag": "dd85193d-95aa-4f67-99f3-26d0422dc6af"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:59.293687 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-a8cc55de-79b9-43df-8331-0ffd3c97b600 req-765616b3-3c44-4a0d-a72a-47c1a0d125f2 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:59.294554 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-a8cc55de-79b9-43df-8331-0ffd3c97b600 req-765616b3-3c44-4a0d-a72a-47c1a0d125f2 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:59.296157 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-a8cc55de-79b9-43df-8331-0ffd3c97b600 req-765616b3-3c44-4a0d-a72a-47c1a0d125f2 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:59.357263 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-a8cc55de-79b9-43df-8331-0ffd3c97b600 req-765616b3-3c44-4a0d-a72a-47c1a0d125f2 service nova] Creating event network-changed:dd85193d-95aa-4f67-99f3-26d0422dc6af for instance 82f35c2e-21ad-448d-a198-6847bf664d52 on n-h1-854247-14 Oct 17 13:37:59.384572 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-a8cc55de-79b9-43df-8331-0ffd3c97b600 req-765616b3-3c44-4a0d-a72a-47c1a0d125f2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124323 Oct 17 13:37:59.391468 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 530/1074] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:37:59.415253 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ab7c705e-b52f-4787-a6eb-fb09a763133e tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:59.420236 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ab7c705e-b52f-4787-a6eb-fb09a763133e tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 008be895-7153-417e-9b87-5b60ea31d0bc] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:59.435754 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ab7c705e-b52f-4787-a6eb-fb09a763133e tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:59.438325 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ab7c705e-b52f-4787-a6eb-fb09a763133e tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:59.440304 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ab7c705e-b52f-4787-a6eb-fb09a763133e tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:59.442516 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ab7c705e-b52f-4787-a6eb-fb09a763133e tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:59.443566 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ab7c705e-b52f-4787-a6eb-fb09a763133e tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:59.444207 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ab7c705e-b52f-4787-a6eb-fb09a763133e tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:59.505473 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=4 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:37:59.534101 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=12 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:37:59.643276 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f469e9ec-60a4-4ad9-9f3e-7cb61a6d96b6 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23b9d586c57421abf53a7eaa3af9b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63faec71e9ad449896c83868d52dd09c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:59.660261 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f469e9ec-60a4-4ad9-9f3e-7cb61a6d96b6 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] 10.222.0.79 "GET /compute/v2.1/servers/82f35c2e-21ad-448d-a198-6847bf664d52" status: 200 len: 1578 microversion: 2.1 time: 0.450792 Oct 17 13:37:59.670125 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 545/1075] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:59 2022] GET /compute/v2.1/servers/82f35c2e-21ad-448d-a198-6847bf664d52 => generated 1578 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:59.690391 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1d5c6e36-c7c4-41af-ab46-d36bab5727d5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:59.709241 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1d5c6e36-c7c4-41af-ab46-d36bab5727d5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 0ffbef37-e5f8-4de2-a29d-dba6782a3fe4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:59.729305 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1d5c6e36-c7c4-41af-ab46-d36bab5727d5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:59.733778 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1d5c6e36-c7c4-41af-ab46-d36bab5727d5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:59.738020 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1d5c6e36-c7c4-41af-ab46-d36bab5727d5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:59.744843 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1d5c6e36-c7c4-41af-ab46-d36bab5727d5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:59.745440 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1d5c6e36-c7c4-41af-ab46-d36bab5727d5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:59.747560 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1d5c6e36-c7c4-41af-ab46-d36bab5727d5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:59.941264 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ab7c705e-b52f-4787-a6eb-fb09a763133e tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:59.956775 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ab7c705e-b52f-4787-a6eb-fb09a763133e tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc" status: 200 len: 1526 microversion: 2.1 time: 0.562543 Oct 17 13:37:59.958779 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 531/1076] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:59 2022] GET /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc => generated 1526 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:59.971698 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-ac97e05f-06ff-46e9-964d-fefdf4417de1 req-fe4b9abd-5c76-406c-b27b-881d86f5afb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "008be895-7153-417e-9b87-5b60ea31d0bc", "name": "network-vif-plugged", "status": "completed", "tag": "3a95ce9b-0623-4736-9d6e-2c8a93af74d8"}, {"server_uuid": "008be895-7153-417e-9b87-5b60ea31d0bc", "name": "network-vif-unplugged", "status": "completed", "tag": "3a95ce9b-0623-4736-9d6e-2c8a93af74d8"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:59.995898 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-ac97e05f-06ff-46e9-964d-fefdf4417de1 req-fe4b9abd-5c76-406c-b27b-881d86f5afb3 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:59.996673 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-ac97e05f-06ff-46e9-964d-fefdf4417de1 req-fe4b9abd-5c76-406c-b27b-881d86f5afb3 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:59.997298 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-ac97e05f-06ff-46e9-964d-fefdf4417de1 req-fe4b9abd-5c76-406c-b27b-881d86f5afb3 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:00.021768 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-ac97e05f-06ff-46e9-964d-fefdf4417de1 req-fe4b9abd-5c76-406c-b27b-881d86f5afb3 service nova] Creating event network-vif-plugged:3a95ce9b-0623-4736-9d6e-2c8a93af74d8 for instance 008be895-7153-417e-9b87-5b60ea31d0bc on n-h2-854247-14 Oct 17 13:38:00.024147 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-ac97e05f-06ff-46e9-964d-fefdf4417de1 req-fe4b9abd-5c76-406c-b27b-881d86f5afb3 service nova] Creating event network-vif-unplugged:3a95ce9b-0623-4736-9d6e-2c8a93af74d8 for instance 008be895-7153-417e-9b87-5b60ea31d0bc on n-h2-854247-14 Oct 17 13:38:00.036893 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-ac97e05f-06ff-46e9-964d-fefdf4417de1 req-fe4b9abd-5c76-406c-b27b-881d86f5afb3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.074387 Oct 17 13:38:00.037766 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 532/1077] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:38:00.063303 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-deaf8c68-767c-4d73-ba7b-e65b36eb4c63 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:00.066085 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-deaf8c68-767c-4d73-ba7b-e65b36eb4c63 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] [instance: b8d15c7c-7a1f-43e0-9c41-302172f31ca0] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:00.086100 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-deaf8c68-767c-4d73-ba7b-e65b36eb4c63 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:00.086684 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-deaf8c68-767c-4d73-ba7b-e65b36eb4c63 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:00.087139 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-deaf8c68-767c-4d73-ba7b-e65b36eb4c63 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:00.094130 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-deaf8c68-767c-4d73-ba7b-e65b36eb4c63 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:00.094130 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-deaf8c68-767c-4d73-ba7b-e65b36eb4c63 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:00.094130 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-deaf8c68-767c-4d73-ba7b-e65b36eb4c63 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:00.112455 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1d5c6e36-c7c4-41af-ab46-d36bab5727d5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:00.124777 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1d5c6e36-c7c4-41af-ab46-d36bab5727d5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:00.126495 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1d5c6e36-c7c4-41af-ab46-d36bab5727d5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:00.127957 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1d5c6e36-c7c4-41af-ab46-d36bab5727d5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4" status: 200 len: 1362 microversion: 2.25 time: 0.456631 Oct 17 13:38:00.128929 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 546/1078] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:37:59 2022] GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4 => generated 1362 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:38:00.134225 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3b22a1ea-fb69-4a76-8c89-440eb84e75fa tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:00.135056 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3b22a1ea-fb69-4a76-8c89-440eb84e75fa tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: ae587603-994d-419d-979a-1b1361144872] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:00.141653 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3b22a1ea-fb69-4a76-8c89-440eb84e75fa tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:00.142354 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3b22a1ea-fb69-4a76-8c89-440eb84e75fa tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:00.142937 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3b22a1ea-fb69-4a76-8c89-440eb84e75fa tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:00.143832 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3b22a1ea-fb69-4a76-8c89-440eb84e75fa tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:00.144431 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3b22a1ea-fb69-4a76-8c89-440eb84e75fa tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:00.144997 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3b22a1ea-fb69-4a76-8c89-440eb84e75fa tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:00.415133 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3b22a1ea-fb69-4a76-8c89-440eb84e75fa tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:00.419881 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-deaf8c68-767c-4d73-ba7b-e65b36eb4c63 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e5309bf84f4aafa9a17604f8452366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6642f912ba0467bac461bc7aedbf940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:00.421422 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:38:00.437527 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-deaf8c68-767c-4d73-ba7b-e65b36eb4c63 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] 10.222.0.79 "GET /compute/v2.1/servers/b8d15c7c-7a1f-43e0-9c41-302172f31ca0" status: 200 len: 1367 microversion: 2.1 time: 0.395116 Oct 17 13:38:00.438591 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 533/1079] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:00 2022] GET /compute/v2.1/servers/b8d15c7c-7a1f-43e0-9c41-302172f31ca0 => generated 1367 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:00.440652 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3b22a1ea-fb69-4a76-8c89-440eb84e75fa tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872" status: 200 len: 1487 microversion: 2.1 time: 0.308958 Oct 17 13:38:00.451534 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4495a2de-f62b-4b5c-94bf-adca760e47da tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:00.451534 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4495a2de-f62b-4b5c-94bf-adca760e47da tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: a54adf11-ee58-4f13-82c8-9a00a36c536e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:00.460784 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 547/1080] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:00 2022] GET /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872 => generated 1487 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:00.464449 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4495a2de-f62b-4b5c-94bf-adca760e47da tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:00.474664 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4495a2de-f62b-4b5c-94bf-adca760e47da tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:00.475244 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4495a2de-f62b-4b5c-94bf-adca760e47da tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:00.476043 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4495a2de-f62b-4b5c-94bf-adca760e47da tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:00.476526 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4495a2de-f62b-4b5c-94bf-adca760e47da tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:00.476981 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4495a2de-f62b-4b5c-94bf-adca760e47da tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:00.479381 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b10f1c8a-45f8-4488-bb8f-bbcc97f6a09e tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:00.480596 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b10f1c8a-45f8-4488-bb8f-bbcc97f6a09e tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 37496695-f6e7-4b76-ac8f-05da4f42cdf1] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:00.489957 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b10f1c8a-45f8-4488-bb8f-bbcc97f6a09e tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:00.490640 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b10f1c8a-45f8-4488-bb8f-bbcc97f6a09e tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:00.491379 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b10f1c8a-45f8-4488-bb8f-bbcc97f6a09e tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:00.492006 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b10f1c8a-45f8-4488-bb8f-bbcc97f6a09e tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:00.492864 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b10f1c8a-45f8-4488-bb8f-bbcc97f6a09e tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:00.493383 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b10f1c8a-45f8-4488-bb8f-bbcc97f6a09e tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:00.747278 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4495a2de-f62b-4b5c-94bf-adca760e47da tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:00.755919 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4495a2de-f62b-4b5c-94bf-adca760e47da tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e" status: 200 len: 1714 microversion: 2.1 time: 0.315720 Oct 17 13:38:00.758470 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 534/1081] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:00 2022] GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e => generated 1714 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:00.769928 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b10f1c8a-45f8-4488-bb8f-bbcc97f6a09e tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:00.778439 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b10f1c8a-45f8-4488-bb8f-bbcc97f6a09e tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/37496695-f6e7-4b76-ac8f-05da4f42cdf1" status: 200 len: 1472 microversion: 2.1 time: 0.314549 Oct 17 13:38:00.787201 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 548/1082] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:00 2022] GET /compute/v2.1/servers/37496695-f6e7-4b76-ac8f-05da4f42cdf1 => generated 1472 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:00.787473 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ba108e47-b7a4-46eb-8f13-98629fe3d94c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:38:00.797384 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ba108e47-b7a4-46eb-8f13-98629fe3d94c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:00.797384 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ba108e47-b7a4-46eb-8f13-98629fe3d94c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:00.797384 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ba108e47-b7a4-46eb-8f13-98629fe3d94c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:00.874439 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ba108e47-b7a4-46eb-8f13-98629fe3d94c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: ae587603-994d-419d-979a-1b1361144872] Going to try to stop instance {{(pid=127016) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 17 13:38:00.938328 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ba108e47-b7a4-46eb-8f13-98629fe3d94c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "POST /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872/action" status: 202 len: 0 microversion: 2.1 time: 0.178479 Oct 17 13:38:00.939273 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 535/1083] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:38:00 2022] POST /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:38:00.948446 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8c5984ed-2f15-4a42-bb69-4108935f534f tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:00.949324 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8c5984ed-2f15-4a42-bb69-4108935f534f tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: ae587603-994d-419d-979a-1b1361144872] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:00.962239 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8c5984ed-2f15-4a42-bb69-4108935f534f tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:00.963831 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8c5984ed-2f15-4a42-bb69-4108935f534f tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:00.965372 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8c5984ed-2f15-4a42-bb69-4108935f534f tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:00.966286 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8c5984ed-2f15-4a42-bb69-4108935f534f tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:00.967704 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8c5984ed-2f15-4a42-bb69-4108935f534f tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:00.969494 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8c5984ed-2f15-4a42-bb69-4108935f534f tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:00.984768 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b1824e39-4e90-4d86-a4d4-813bda11b25f tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:00.988922 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b1824e39-4e90-4d86-a4d4-813bda11b25f tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 008be895-7153-417e-9b87-5b60ea31d0bc] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:01.014458 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b1824e39-4e90-4d86-a4d4-813bda11b25f tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:01.016315 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b1824e39-4e90-4d86-a4d4-813bda11b25f tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:01.017074 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b1824e39-4e90-4d86-a4d4-813bda11b25f tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:01.018858 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b1824e39-4e90-4d86-a4d4-813bda11b25f tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:01.020755 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b1824e39-4e90-4d86-a4d4-813bda11b25f tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:01.030379 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b1824e39-4e90-4d86-a4d4-813bda11b25f tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:01.560569 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8c5984ed-2f15-4a42-bb69-4108935f534f tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:01.569084 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8c5984ed-2f15-4a42-bb69-4108935f534f tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872" status: 200 len: 1497 microversion: 2.1 time: 0.625781 Oct 17 13:38:01.569675 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 549/1084] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:00 2022] GET /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872 => generated 1497 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:01.581618 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f6b01ec8-c9a7-4157-9f9b-ef3e459dac6b tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:01.582238 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f6b01ec8-c9a7-4157-9f9b-ef3e459dac6b tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 0ffbef37-e5f8-4de2-a29d-dba6782a3fe4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:01.591485 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f6b01ec8-c9a7-4157-9f9b-ef3e459dac6b tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:01.595278 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f6b01ec8-c9a7-4157-9f9b-ef3e459dac6b tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:01.595845 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f6b01ec8-c9a7-4157-9f9b-ef3e459dac6b tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:01.596593 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f6b01ec8-c9a7-4157-9f9b-ef3e459dac6b tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:01.597047 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f6b01ec8-c9a7-4157-9f9b-ef3e459dac6b tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:01.597464 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f6b01ec8-c9a7-4157-9f9b-ef3e459dac6b tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:01.798643 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b1824e39-4e90-4d86-a4d4-813bda11b25f tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:01.808734 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b1824e39-4e90-4d86-a4d4-813bda11b25f tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc" status: 200 len: 1526 microversion: 2.1 time: 0.829679 Oct 17 13:38:01.808945 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 536/1085] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:00 2022] GET /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc => generated 1526 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:38:02.026160 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-911122dd-b58c-4791-8e02-e4e963144453 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1740030377", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:38:02.062208 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f6b01ec8-c9a7-4157-9f9b-ef3e459dac6b tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:02.076386 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f6b01ec8-c9a7-4157-9f9b-ef3e459dac6b tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:02.085139 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f6b01ec8-c9a7-4157-9f9b-ef3e459dac6b tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:02.091474 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f6b01ec8-c9a7-4157-9f9b-ef3e459dac6b tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4" status: 200 len: 1362 microversion: 2.25 time: 0.515827 Oct 17 13:38:02.092558 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 550/1086] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:38:01 2022] GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4 => generated 1362 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:38:02.100246 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-238d6d06-b9f7-467d-a05a-5d9dfc04ef85 req-9961fddc-1ed5-45d3-8e25-b551ec1f714d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8d15c7c-7a1f-43e0-9c41-302172f31ca0", "tag": "6b4af2c6-531c-4352-bbe4-6c4df4387bbf"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:38:02.121452 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-911122dd-b58c-4791-8e02-e4e963144453 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] validate_networks() for None {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:38:02.125807 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-238d6d06-b9f7-467d-a05a-5d9dfc04ef85 req-9961fddc-1ed5-45d3-8e25-b551ec1f714d service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:02.129477 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-238d6d06-b9f7-467d-a05a-5d9dfc04ef85 req-9961fddc-1ed5-45d3-8e25-b551ec1f714d service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:02.130322 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-238d6d06-b9f7-467d-a05a-5d9dfc04ef85 req-9961fddc-1ed5-45d3-8e25-b551ec1f714d service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:02.151384 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-238d6d06-b9f7-467d-a05a-5d9dfc04ef85 req-9961fddc-1ed5-45d3-8e25-b551ec1f714d service nova] Creating event network-changed:6b4af2c6-531c-4352-bbe4-6c4df4387bbf for instance b8d15c7c-7a1f-43e0-9c41-302172f31ca0 on n-h2-854247-14 Oct 17 13:38:02.157778 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-238d6d06-b9f7-467d-a05a-5d9dfc04ef85 req-9961fddc-1ed5-45d3-8e25-b551ec1f714d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063489 Oct 17 13:38:02.161440 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 551/1087] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:38:02.173351 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-548dc69d-356a-4672-9f91-7837b581a4be tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:02.174073 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-548dc69d-356a-4672-9f91-7837b581a4be tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] [instance: b8d15c7c-7a1f-43e0-9c41-302172f31ca0] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:02.189970 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-548dc69d-356a-4672-9f91-7837b581a4be tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:02.193190 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-548dc69d-356a-4672-9f91-7837b581a4be tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:02.196578 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-548dc69d-356a-4672-9f91-7837b581a4be tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:02.197694 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-548dc69d-356a-4672-9f91-7837b581a4be tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:02.198396 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-548dc69d-356a-4672-9f91-7837b581a4be tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:02.199071 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-548dc69d-356a-4672-9f91-7837b581a4be tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:02.524006 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-548dc69d-356a-4672-9f91-7837b581a4be tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e5309bf84f4aafa9a17604f8452366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6642f912ba0467bac461bc7aedbf940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:02.537732 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-548dc69d-356a-4672-9f91-7837b581a4be tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] 10.222.0.79 "GET /compute/v2.1/servers/b8d15c7c-7a1f-43e0-9c41-302172f31ca0" status: 200 len: 1367 microversion: 2.1 time: 0.374686 Oct 17 13:38:02.538331 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 552/1088] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:02 2022] GET /compute/v2.1/servers/b8d15c7c-7a1f-43e0-9c41-302172f31ca0 => generated 1367 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:02.547568 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-f3c8d4ad-6be8-461c-86c2-a300d68b65b5 req-1f652869-dec1-4c85-9039-92621d69a3b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37496695-f6e7-4b76-ac8f-05da4f42cdf1", "name": "network-vif-deleted", "tag": "db290fa7-4452-4dd9-932a-5f8775bde25b"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:38:02.557215 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-f3c8d4ad-6be8-461c-86c2-a300d68b65b5 req-1f652869-dec1-4c85-9039-92621d69a3b0 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:02.557969 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-f3c8d4ad-6be8-461c-86c2-a300d68b65b5 req-1f652869-dec1-4c85-9039-92621d69a3b0 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:02.558581 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-f3c8d4ad-6be8-461c-86c2-a300d68b65b5 req-1f652869-dec1-4c85-9039-92621d69a3b0 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:02.579373 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-f3c8d4ad-6be8-461c-86c2-a300d68b65b5 req-1f652869-dec1-4c85-9039-92621d69a3b0 service nova] Creating event network-vif-deleted:db290fa7-4452-4dd9-932a-5f8775bde25b for instance 37496695-f6e7-4b76-ac8f-05da4f42cdf1 on n-h2-854247-14 Oct 17 13:38:02.579969 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-911122dd-b58c-4791-8e02-e4e963144453 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:38:02.580132 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-911122dd-b58c-4791-8e02-e4e963144453 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:38:02.580740 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-911122dd-b58c-4791-8e02-e4e963144453 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:38:02.581347 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-911122dd-b58c-4791-8e02-e4e963144453 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:38:02.581955 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-911122dd-b58c-4791-8e02-e4e963144453 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:38:02.587408 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-f3c8d4ad-6be8-461c-86c2-a300d68b65b5 req-1f652869-dec1-4c85-9039-92621d69a3b0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047818 Oct 17 13:38:02.589099 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 553/1089] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:38:02.597314 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4a26cf00-d9e3-48e7-a286-2a4af849998e tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:02.598245 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4a26cf00-d9e3-48e7-a286-2a4af849998e tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: a54adf11-ee58-4f13-82c8-9a00a36c536e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:02.601703 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-911122dd-b58c-4791-8e02-e4e963144453 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:02.602208 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-911122dd-b58c-4791-8e02-e4e963144453 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:02.602637 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-911122dd-b58c-4791-8e02-e4e963144453 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:02.603582 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-911122dd-b58c-4791-8e02-e4e963144453 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:02.604208 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-911122dd-b58c-4791-8e02-e4e963144453 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:02.604809 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-911122dd-b58c-4791-8e02-e4e963144453 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:02.607123 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4a26cf00-d9e3-48e7-a286-2a4af849998e tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:02.607958 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4a26cf00-d9e3-48e7-a286-2a4af849998e tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:02.608566 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4a26cf00-d9e3-48e7-a286-2a4af849998e tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:02.610056 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4a26cf00-d9e3-48e7-a286-2a4af849998e tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:02.610684 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4a26cf00-d9e3-48e7-a286-2a4af849998e tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:02.611282 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4a26cf00-d9e3-48e7-a286-2a4af849998e tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:02.637908 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-911122dd-b58c-4791-8e02-e4e963144453 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Getting quotas for project 76eaaef0f6234db690a123c54cea5a6d. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:38:02.644163 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-911122dd-b58c-4791-8e02-e4e963144453 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Getting quotas for user 69bd293284874ca9ba415770de7b6965 and project 76eaaef0f6234db690a123c54cea5a6d. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:38:02.666922 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-911122dd-b58c-4791-8e02-e4e963144453 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:38:02.669534 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-911122dd-b58c-4791-8e02-e4e963144453 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: ab2b571e-376c-41d3-a778-44bedcaa5467] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:38:02.729220 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-911122dd-b58c-4791-8e02-e4e963144453 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.903398 Oct 17 13:38:02.730369 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 537/1090] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:38:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 921 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:38:02.735053 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e186b0fd-6f02-4466-94ab-de7956772fd2 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:02.735936 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e186b0fd-6f02-4466-94ab-de7956772fd2 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 37496695-f6e7-4b76-ac8f-05da4f42cdf1] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:02.745400 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e186b0fd-6f02-4466-94ab-de7956772fd2 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:02.746150 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e186b0fd-6f02-4466-94ab-de7956772fd2 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:02.747919 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e186b0fd-6f02-4466-94ab-de7956772fd2 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:02.748869 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e186b0fd-6f02-4466-94ab-de7956772fd2 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:02.749560 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e186b0fd-6f02-4466-94ab-de7956772fd2 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:02.751665 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e186b0fd-6f02-4466-94ab-de7956772fd2 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:02.802058 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e186b0fd-6f02-4466-94ab-de7956772fd2 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:02.802654 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e186b0fd-6f02-4466-94ab-de7956772fd2 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:02.803221 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e186b0fd-6f02-4466-94ab-de7956772fd2 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:02.803774 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-e186b0fd-6f02-4466-94ab-de7956772fd2 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lazy-loading 'fault' on Instance uuid 37496695-f6e7-4b76-ac8f-05da4f42cdf1 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:38:02.920112 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e186b0fd-6f02-4466-94ab-de7956772fd2 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:02.930738 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4a26cf00-d9e3-48e7-a286-2a4af849998e tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:02.934673 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e186b0fd-6f02-4466-94ab-de7956772fd2 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/37496695-f6e7-4b76-ac8f-05da4f42cdf1" status: 200 len: 1306 microversion: 2.1 time: 0.203180 Oct 17 13:38:02.935529 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 538/1091] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:02 2022] GET /compute/v2.1/servers/37496695-f6e7-4b76-ac8f-05da4f42cdf1 => generated 1306 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:02.940301 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4a26cf00-d9e3-48e7-a286-2a4af849998e tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e" status: 200 len: 1714 microversion: 2.1 time: 0.349826 Oct 17 13:38:02.940956 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 554/1092] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:02 2022] GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e => generated 1714 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:02.943878 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-2975ed81-6e80-47e2-bcb7-3491ff69b54e req-c86ab544-3bf3-4d56-a537-c784d40b943a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ffbef37-e5f8-4de2-a29d-dba6782a3fe4", "name": "network-vif-plugged", "status": "completed", "tag": "f6d4c8b6-ba32-4306-822c-cf94066fc47e"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:38:02.953899 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c019c123-a10e-47dd-b6ec-38fce5a9971a tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:02.954603 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c019c123-a10e-47dd-b6ec-38fce5a9971a tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: ae587603-994d-419d-979a-1b1361144872] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:02.955691 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-2975ed81-6e80-47e2-bcb7-3491ff69b54e req-c86ab544-3bf3-4d56-a537-c784d40b943a service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:02.956333 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-2975ed81-6e80-47e2-bcb7-3491ff69b54e req-c86ab544-3bf3-4d56-a537-c784d40b943a service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:02.956752 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-2975ed81-6e80-47e2-bcb7-3491ff69b54e req-c86ab544-3bf3-4d56-a537-c784d40b943a service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:02.966022 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c019c123-a10e-47dd-b6ec-38fce5a9971a tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:02.966525 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c019c123-a10e-47dd-b6ec-38fce5a9971a tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:02.967538 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c019c123-a10e-47dd-b6ec-38fce5a9971a tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:02.968503 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c019c123-a10e-47dd-b6ec-38fce5a9971a tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:02.969118 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c019c123-a10e-47dd-b6ec-38fce5a9971a tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:02.969539 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c019c123-a10e-47dd-b6ec-38fce5a9971a tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:02.972694 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-2975ed81-6e80-47e2-bcb7-3491ff69b54e req-c86ab544-3bf3-4d56-a537-c784d40b943a service nova] Creating event network-vif-plugged:f6d4c8b6-ba32-4306-822c-cf94066fc47e for instance 0ffbef37-e5f8-4de2-a29d-dba6782a3fe4 on n-h1-854247-14 Oct 17 13:38:02.980358 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-2975ed81-6e80-47e2-bcb7-3491ff69b54e req-c86ab544-3bf3-4d56-a537-c784d40b943a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042672 Oct 17 13:38:02.981389 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 539/1093] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:38:02.989722 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8572724a-7514-4fbc-bc9a-0a23a06c2601 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1905981021", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:38:03.064153 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-8572724a-7514-4fbc-bc9a-0a23a06c2601 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] validate_networks() for None {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:38:03.193524 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c019c123-a10e-47dd-b6ec-38fce5a9971a tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:03.201816 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c019c123-a10e-47dd-b6ec-38fce5a9971a tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872" status: 200 len: 1497 microversion: 2.1 time: 0.259862 Oct 17 13:38:03.202489 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 555/1094] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:02 2022] GET /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872 => generated 1497 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:03.212782 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6e835e0d-42ee-49ba-b57f-f3d3bb1b7fa1 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:03.213883 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6e835e0d-42ee-49ba-b57f-f3d3bb1b7fa1 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 008be895-7153-417e-9b87-5b60ea31d0bc] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:03.222887 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6e835e0d-42ee-49ba-b57f-f3d3bb1b7fa1 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:03.223412 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6e835e0d-42ee-49ba-b57f-f3d3bb1b7fa1 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:03.224614 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6e835e0d-42ee-49ba-b57f-f3d3bb1b7fa1 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:03.225488 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6e835e0d-42ee-49ba-b57f-f3d3bb1b7fa1 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:03.226341 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6e835e0d-42ee-49ba-b57f-f3d3bb1b7fa1 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:03.227476 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6e835e0d-42ee-49ba-b57f-f3d3bb1b7fa1 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:03.326641 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-8572724a-7514-4fbc-bc9a-0a23a06c2601 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:38:03.329444 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-8572724a-7514-4fbc-bc9a-0a23a06c2601 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:38:03.329925 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-8572724a-7514-4fbc-bc9a-0a23a06c2601 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:38:03.330325 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-8572724a-7514-4fbc-bc9a-0a23a06c2601 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:38:03.330799 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-8572724a-7514-4fbc-bc9a-0a23a06c2601 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:38:03.335311 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6e835e0d-42ee-49ba-b57f-f3d3bb1b7fa1 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:03.336355 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:38:03.344773 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6e835e0d-42ee-49ba-b57f-f3d3bb1b7fa1 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc" status: 200 len: 1484 microversion: 2.1 time: 0.140950 Oct 17 13:38:03.345219 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8572724a-7514-4fbc-bc9a-0a23a06c2601 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:03.345543 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 556/1095] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:03 2022] GET /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc => generated 1484 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:03.345760 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8572724a-7514-4fbc-bc9a-0a23a06c2601 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:03.346367 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8572724a-7514-4fbc-bc9a-0a23a06c2601 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:03.347127 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8572724a-7514-4fbc-bc9a-0a23a06c2601 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:03.347600 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8572724a-7514-4fbc-bc9a-0a23a06c2601 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:03.348011 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8572724a-7514-4fbc-bc9a-0a23a06c2601 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:03.350558 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e266156f-6f71-4a97-aa08-d66b52688072 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:03.351379 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e266156f-6f71-4a97-aa08-d66b52688072 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 0ffbef37-e5f8-4de2-a29d-dba6782a3fe4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:03.358235 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e266156f-6f71-4a97-aa08-d66b52688072 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:03.358990 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e266156f-6f71-4a97-aa08-d66b52688072 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:03.359679 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e266156f-6f71-4a97-aa08-d66b52688072 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:03.360727 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e266156f-6f71-4a97-aa08-d66b52688072 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:03.361470 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e266156f-6f71-4a97-aa08-d66b52688072 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:03.372151 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e266156f-6f71-4a97-aa08-d66b52688072 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:03.403333 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-8572724a-7514-4fbc-bc9a-0a23a06c2601 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Getting quotas for project 76eaaef0f6234db690a123c54cea5a6d. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:38:03.409787 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-8572724a-7514-4fbc-bc9a-0a23a06c2601 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Getting quotas for user 69bd293284874ca9ba415770de7b6965 and project 76eaaef0f6234db690a123c54cea5a6d. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:38:03.430490 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8572724a-7514-4fbc-bc9a-0a23a06c2601 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:38:03.435018 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8572724a-7514-4fbc-bc9a-0a23a06c2601 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: f47e3dcd-6e44-411d-bf0c-3da0abda9f87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:38:03.496671 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8572724a-7514-4fbc-bc9a-0a23a06c2601 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.513345 Oct 17 13:38:03.498216 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 540/1096] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:38:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:38:03.509027 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b1665f80-61c9-46d9-a499-cc9d29452f10 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:03.509936 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b1665f80-61c9-46d9-a499-cc9d29452f10 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: f47e3dcd-6e44-411d-bf0c-3da0abda9f87] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:03.605107 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e266156f-6f71-4a97-aa08-d66b52688072 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:03.617450 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e266156f-6f71-4a97-aa08-d66b52688072 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:03.617918 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b1665f80-61c9-46d9-a499-cc9d29452f10 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:03.620510 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e266156f-6f71-4a97-aa08-d66b52688072 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:03.622610 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e266156f-6f71-4a97-aa08-d66b52688072 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4" status: 200 len: 1362 microversion: 2.25 time: 0.275912 Oct 17 13:38:03.638924 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b1665f80-61c9-46d9-a499-cc9d29452f10 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/f47e3dcd-6e44-411d-bf0c-3da0abda9f87" status: 200 len: 1214 microversion: 2.1 time: 0.133733 Oct 17 13:38:03.645929 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 541/1097] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:03 2022] GET /compute/v2.1/servers/f47e3dcd-6e44-411d-bf0c-3da0abda9f87 => generated 1214 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:03.651377 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f04e7f1d-7575-4555-841d-5f60eb09b95f tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:03.651377 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f04e7f1d-7575-4555-841d-5f60eb09b95f tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] [instance: b8d15c7c-7a1f-43e0-9c41-302172f31ca0] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:03.658858 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 557/1098] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:38:03 2022] GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4 => generated 1362 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:38:03.667582 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f04e7f1d-7575-4555-841d-5f60eb09b95f tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:03.668103 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f04e7f1d-7575-4555-841d-5f60eb09b95f tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:03.668542 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f04e7f1d-7575-4555-841d-5f60eb09b95f tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:03.669297 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f04e7f1d-7575-4555-841d-5f60eb09b95f tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:03.669882 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f04e7f1d-7575-4555-841d-5f60eb09b95f tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:03.670202 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f04e7f1d-7575-4555-841d-5f60eb09b95f tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:03.916099 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f04e7f1d-7575-4555-841d-5f60eb09b95f tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e5309bf84f4aafa9a17604f8452366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6642f912ba0467bac461bc7aedbf940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:03.926626 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f04e7f1d-7575-4555-841d-5f60eb09b95f tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] 10.222.0.79 "GET /compute/v2.1/servers/b8d15c7c-7a1f-43e0-9c41-302172f31ca0" status: 200 len: 1367 microversion: 2.1 time: 0.281785 Oct 17 13:38:03.940958 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 542/1099] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:03 2022] GET /compute/v2.1/servers/b8d15c7c-7a1f-43e0-9c41-302172f31ca0 => generated 1367 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:03.962371 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b260541b-9a7d-4043-9474-e7c21990f20e tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:03.963099 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b260541b-9a7d-4043-9474-e7c21990f20e tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 37496695-f6e7-4b76-ac8f-05da4f42cdf1] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:03.969701 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-dc3cb914-0764-409b-b9b2-fc877f69674b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:03.970429 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b260541b-9a7d-4043-9474-e7c21990f20e tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:03.970772 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-dc3cb914-0764-409b-b9b2-fc877f69674b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: a54adf11-ee58-4f13-82c8-9a00a36c536e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:03.970898 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b260541b-9a7d-4043-9474-e7c21990f20e tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:03.971363 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b260541b-9a7d-4043-9474-e7c21990f20e tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:03.972062 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b260541b-9a7d-4043-9474-e7c21990f20e tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:03.972510 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b260541b-9a7d-4043-9474-e7c21990f20e tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:03.972930 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b260541b-9a7d-4043-9474-e7c21990f20e tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:03.978649 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc3cb914-0764-409b-b9b2-fc877f69674b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:03.979147 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc3cb914-0764-409b-b9b2-fc877f69674b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:03.979603 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc3cb914-0764-409b-b9b2-fc877f69674b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:03.980305 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc3cb914-0764-409b-b9b2-fc877f69674b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:03.980795 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc3cb914-0764-409b-b9b2-fc877f69674b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:03.981445 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc3cb914-0764-409b-b9b2-fc877f69674b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:03.990653 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-b260541b-9a7d-4043-9474-e7c21990f20e tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] HTTP exception thrown: Instance 37496695-f6e7-4b76-ac8f-05da4f42cdf1 could not be found. Oct 17 13:38:03.992627 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b260541b-9a7d-4043-9474-e7c21990f20e tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Request method failure captured: Oct 17 13:38:03.992627 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/37496695-f6e7-4b76-ac8f-05da4f42cdf1 HTTP/1.1 Oct 17 13:38:03.992627 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:38:03.992627 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:38:03.992627 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:38:03.992627 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:38:03.992627 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:38:03.992627 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:38:03.992627 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:38:03.992627 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:38:03.992627 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVn0rKCCzxL1KwIZI1Im8ygkuewY-UzF6Z81i6cNkagTk7ClET_LM7mvJkIi7s6pFyo0jkOjEfkZnFMR6ojJjeKHBwoksuv9Z4X8LYNw4iNhGgW8aAiE8QzHsCgl5CJTTDwKklbNcQOJJRXIUfAtc0cseQ_bknPsrUPdOoFAaQy0_jg Oct 17 13:38:03.992627 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:38:03.992627 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:38:03.992627 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:38:03.992627 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:38:03.992627 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:38:03.992627 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:38:03.992627 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: fa1db260a96a4c6aa69cd6437baab6f7 Oct 17 13:38:03.992627 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServersOnMultiNodesTest-1107099453 Oct 17 13:38:03.992627 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:38:03.992627 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:38:03.994643 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/fa1db260a96a4c6aa69cd6437baab6f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/fa1db260a96a4c6aa69cd6437baab6f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/fa1db260a96a4c6aa69cd6437baab6f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_fa1db260a96a4c6aa69cd6437baab6f7", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:38:03.994643 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServersOnMultiNodesTest-1107099453 Oct 17 13:38:03.994643 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: fa1db260a96a4c6aa69cd6437baab6f7 Oct 17 13:38:03.994643 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1107099453 Oct 17 13:38:03.994643 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServersOnMultiNodesTest-1107099453-project Oct 17 13:38:03.994643 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:38:03.994643 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:38:03.994643 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 7a7e082035084338966a1c56b30c7093 Oct 17 13:38:03.994643 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServersOnMultiNodesTest-1107099453-project Oct 17 13:38:03.994643 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:38:03.994643 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 37496695-f6e7-4b76-ac8f-05da4f42cdf1 could not be found. Oct 17 13:38:03.994643 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '37496695-f6e7-4b76-ac8f-05da4f42cdf1'} Oct 17 13:38:03.995591 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:38:03.995591 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:38:03.995591 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:38:03.995591 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:38:03.995591 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:38:03.995591 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:38:03.995591 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:38:03.995591 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:38:03.995591 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:38:03.995591 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:38:03.995591 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37496695-f6e7-4b76-ac8f-05da4f42cdf1 could not be found. Oct 17 13:38:03.995591 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:38:03.995591 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:38:03.995591 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:38:03.995591 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:38:03.995591 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:38:03.995591 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:38:03.995591 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:38:03.995591 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:38:03.995591 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:38:03.996896 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:38:03.996896 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:38:03.996896 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:38:03.996896 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:38:03.996896 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:38:03.996896 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:38:03.996896 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:38:03.996896 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37496695-f6e7-4b76-ac8f-05da4f42cdf1 could not be found. Oct 17 13:38:03.996896 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:38:03.996896 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:38:03.996896 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:38:03.996896 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:38:03.996896 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:38:03.996896 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:38:03.996896 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:38:03.996896 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:38:03.996896 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37496695-f6e7-4b76-ac8f-05da4f42cdf1 could not be found. Oct 17 13:38:03.996896 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:38:03.999301 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b260541b-9a7d-4043-9474-e7c21990f20e tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Returning 404 to user: Instance 37496695-f6e7-4b76-ac8f-05da4f42cdf1 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:38:04.000358 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b260541b-9a7d-4043-9474-e7c21990f20e tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/37496695-f6e7-4b76-ac8f-05da4f42cdf1" status: 404 len: 111 microversion: 2.1 time: 0.043040 Oct 17 13:38:04.001121 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 558/1100] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:03 2022] GET /compute/v2.1/servers/37496695-f6e7-4b76-ac8f-05da4f42cdf1 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:38:04.012834 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-948f2893-066a-47ca-b2f4-d299de060c0a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:04.013976 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-948f2893-066a-47ca-b2f4-d299de060c0a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: fe214f31-2995-4475-bcb7-ae4cec33a6f3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:04.024694 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-948f2893-066a-47ca-b2f4-d299de060c0a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:04.025405 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-948f2893-066a-47ca-b2f4-d299de060c0a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:04.025975 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-948f2893-066a-47ca-b2f4-d299de060c0a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:04.026789 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-948f2893-066a-47ca-b2f4-d299de060c0a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:04.027485 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-948f2893-066a-47ca-b2f4-d299de060c0a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:04.028077 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-948f2893-066a-47ca-b2f4-d299de060c0a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:04.056721 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-948f2893-066a-47ca-b2f4-d299de060c0a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: fe214f31-2995-4475-bcb7-ae4cec33a6f3] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:38:04.143680 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-948f2893-066a-47ca-b2f4-d299de060c0a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "DELETE /compute/v2.1/servers/fe214f31-2995-4475-bcb7-ae4cec33a6f3" status: 204 len: 0 microversion: 2.1 time: 0.137551 Oct 17 13:38:04.144568 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 559/1101] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:38:04 2022] DELETE /compute/v2.1/servers/fe214f31-2995-4475-bcb7-ae4cec33a6f3 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:38:04.153564 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d75a9a41-aa8e-4013-8174-e22f391deea6 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:04.154272 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-dc3cb914-0764-409b-b9b2-fc877f69674b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:04.154501 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d75a9a41-aa8e-4013-8174-e22f391deea6 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: fe214f31-2995-4475-bcb7-ae4cec33a6f3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:04.157747 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:38:04.161409 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d75a9a41-aa8e-4013-8174-e22f391deea6 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:04.161927 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d75a9a41-aa8e-4013-8174-e22f391deea6 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:04.162367 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d75a9a41-aa8e-4013-8174-e22f391deea6 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:04.162858 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-dc3cb914-0764-409b-b9b2-fc877f69674b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e" status: 200 len: 1714 microversion: 2.1 time: 0.202931 Oct 17 13:38:04.163066 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d75a9a41-aa8e-4013-8174-e22f391deea6 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:04.163540 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 543/1102] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:03 2022] GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e => generated 1714 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:04.163655 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d75a9a41-aa8e-4013-8174-e22f391deea6 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:04.163976 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d75a9a41-aa8e-4013-8174-e22f391deea6 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:04.198807 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-7aa29f8d-dfd9-4ef1-be89-3879ab264aaa req-c9ba5364-a341-42ca-8ad7-4d029e190fa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "008be895-7153-417e-9b87-5b60ea31d0bc", "name": "network-vif-deleted", "tag": "3a95ce9b-0623-4736-9d6e-2c8a93af74d8"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:38:04.208873 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-7aa29f8d-dfd9-4ef1-be89-3879ab264aaa req-c9ba5364-a341-42ca-8ad7-4d029e190fa7 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:04.209776 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-7aa29f8d-dfd9-4ef1-be89-3879ab264aaa req-c9ba5364-a341-42ca-8ad7-4d029e190fa7 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:04.211202 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-7aa29f8d-dfd9-4ef1-be89-3879ab264aaa req-c9ba5364-a341-42ca-8ad7-4d029e190fa7 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:04.223557 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-7aa29f8d-dfd9-4ef1-be89-3879ab264aaa req-c9ba5364-a341-42ca-8ad7-4d029e190fa7 service nova] Creating event network-vif-deleted:3a95ce9b-0623-4736-9d6e-2c8a93af74d8 for instance 008be895-7153-417e-9b87-5b60ea31d0bc on n-h2-854247-14 Oct 17 13:38:04.229503 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-7aa29f8d-dfd9-4ef1-be89-3879ab264aaa req-c9ba5364-a341-42ca-8ad7-4d029e190fa7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034258 Oct 17 13:38:04.230803 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 544/1103] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:38:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:38:04.236473 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a533d527-be7d-4d86-a32b-271dba5d992d tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:04.237856 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a533d527-be7d-4d86-a32b-271dba5d992d tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: ae587603-994d-419d-979a-1b1361144872] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:04.245156 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a533d527-be7d-4d86-a32b-271dba5d992d tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:04.245964 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a533d527-be7d-4d86-a32b-271dba5d992d tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:04.246644 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a533d527-be7d-4d86-a32b-271dba5d992d tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:04.248489 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a533d527-be7d-4d86-a32b-271dba5d992d tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:04.249249 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a533d527-be7d-4d86-a32b-271dba5d992d tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:04.249921 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a533d527-be7d-4d86-a32b-271dba5d992d tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:04.450785 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d75a9a41-aa8e-4013-8174-e22f391deea6 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:04.458772 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d75a9a41-aa8e-4013-8174-e22f391deea6 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/fe214f31-2995-4475-bcb7-ae4cec33a6f3" status: 200 len: 1471 microversion: 2.1 time: 0.309525 Oct 17 13:38:04.459377 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 560/1104] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:04 2022] GET /compute/v2.1/servers/fe214f31-2995-4475-bcb7-ae4cec33a6f3 => generated 1471 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:04.467821 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9384b1c4-5b67-4b9d-b7be-05a03fab32d4 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:04.468751 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9384b1c4-5b67-4b9d-b7be-05a03fab32d4 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 008be895-7153-417e-9b87-5b60ea31d0bc] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:04.476974 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9384b1c4-5b67-4b9d-b7be-05a03fab32d4 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:04.477989 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9384b1c4-5b67-4b9d-b7be-05a03fab32d4 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:04.478431 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9384b1c4-5b67-4b9d-b7be-05a03fab32d4 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:04.479265 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9384b1c4-5b67-4b9d-b7be-05a03fab32d4 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:04.479921 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9384b1c4-5b67-4b9d-b7be-05a03fab32d4 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:04.480161 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9384b1c4-5b67-4b9d-b7be-05a03fab32d4 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:04.494367 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a533d527-be7d-4d86-a32b-271dba5d992d tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:04.494892 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-9384b1c4-5b67-4b9d-b7be-05a03fab32d4 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] HTTP exception thrown: Instance 008be895-7153-417e-9b87-5b60ea31d0bc could not be found. Oct 17 13:38:04.496582 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9384b1c4-5b67-4b9d-b7be-05a03fab32d4 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Request method failure captured: Oct 17 13:38:04.496582 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc HTTP/1.1 Oct 17 13:38:04.496582 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:38:04.496582 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:38:04.496582 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:38:04.496582 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:38:04.496582 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:38:04.496582 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:38:04.496582 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:38:04.496582 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:38:04.496582 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVp-7IxfFP3OCFXwoptz1mkTvVFP-q1mVdb9duvFJBSFB2Milojb0bt4JEkHbyx5bSK8AUBQstoN0fpOUoelRV9Ur5eKS-T70viEjT2k_9W3ZeERt1Gvx_VBqcxVNMvlXoLi-KthVHD7so8JMwaOern88ECZl5tX1TwIw6qcARP1TSo Oct 17 13:38:04.496582 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:38:04.496582 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:38:04.496582 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:38:04.496582 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:38:04.496582 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:38:04.496582 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:38:04.496582 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: c7507d1dd2d345ca9b59dcaa7806b56e Oct 17 13:38:04.496582 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2045461887 Oct 17 13:38:04.496582 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:38:04.496582 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:38:04.498064 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c7507d1dd2d345ca9b59dcaa7806b56e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c7507d1dd2d345ca9b59dcaa7806b56e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c7507d1dd2d345ca9b59dcaa7806b56e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c7507d1dd2d345ca9b59dcaa7806b56e", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:38:04.498064 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2045461887 Oct 17 13:38:04.498064 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: c7507d1dd2d345ca9b59dcaa7806b56e Oct 17 13:38:04.498064 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2045461887 Oct 17 13:38:04.498064 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ImagesOneServerNegativeTestJSON-2045461887-project Oct 17 13:38:04.498064 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:38:04.498064 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:38:04.498064 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: dcbd60cab4174e8db26e28f015795e1f Oct 17 13:38:04.498064 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2045461887-project Oct 17 13:38:04.498064 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:38:04.498064 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 008be895-7153-417e-9b87-5b60ea31d0bc could not be found. Oct 17 13:38:04.498064 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '008be895-7153-417e-9b87-5b60ea31d0bc'} Oct 17 13:38:04.498846 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:38:04.498846 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:38:04.498846 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:38:04.498846 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:38:04.498846 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:38:04.498846 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:38:04.498846 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:38:04.498846 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:38:04.498846 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:38:04.498846 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:38:04.498846 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 008be895-7153-417e-9b87-5b60ea31d0bc could not be found. Oct 17 13:38:04.498846 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:38:04.498846 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:38:04.498846 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:38:04.498846 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:38:04.498846 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:38:04.498846 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:38:04.498846 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:38:04.498846 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:38:04.498846 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:38:04.500134 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:38:04.500134 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:38:04.500134 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:38:04.500134 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:38:04.500134 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:38:04.500134 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:38:04.500134 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:38:04.500134 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 008be895-7153-417e-9b87-5b60ea31d0bc could not be found. Oct 17 13:38:04.500134 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:38:04.500134 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:38:04.500134 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:38:04.500134 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:38:04.500134 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:38:04.500134 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:38:04.500134 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:38:04.500134 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:38:04.500134 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 008be895-7153-417e-9b87-5b60ea31d0bc could not be found. Oct 17 13:38:04.500134 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:38:04.501400 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9384b1c4-5b67-4b9d-b7be-05a03fab32d4 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Returning 404 to user: Instance 008be895-7153-417e-9b87-5b60ea31d0bc could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:38:04.501400 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9384b1c4-5b67-4b9d-b7be-05a03fab32d4 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc" status: 404 len: 111 microversion: 2.1 time: 0.037488 Oct 17 13:38:04.501400 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 561/1105] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:04 2022] GET /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:38:04.507755 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a533d527-be7d-4d86-a32b-271dba5d992d tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872" status: 200 len: 1497 microversion: 2.1 time: 0.275392 Oct 17 13:38:04.519375 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 545/1106] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:04 2022] GET /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872 => generated 1497 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:04.519772 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e6d801de-a7fd-41b5-97e0-46aafdd2aab1 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Action: 'create', calling method: .version_select at 0x7f7cd5548a60>, body: {"keypair": {"name": "tempest-keypair-153889258", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDfr9Q+y6p0eLU32xeu7X/ab2zIeHJri8AbE8e9ruAZFs+B9hkU/X9zOkP2bl9esKUFztkROUYtVRS/xg3NizwepJz34btU/VLKs58pbCNR9pp7LFJbN/jMI3M+dStpx1g=="}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:38:04.527371 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-e6d801de-a7fd-41b5-97e0-46aafdd2aab1 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Getting quotas for project c7507d1dd2d345ca9b59dcaa7806b56e. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:38:04.532278 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-e6d801de-a7fd-41b5-97e0-46aafdd2aab1 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Getting quotas for user dcbd60cab4174e8db26e28f015795e1f and project c7507d1dd2d345ca9b59dcaa7806b56e. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:38:04.557003 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e6d801de-a7fd-41b5-97e0-46aafdd2aab1 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050329 Oct 17 13:38:04.557533 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 562/1107] 10.222.0.79 () {60 vars in 1159 bytes} [Mon Oct 17 13:38:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:38:04.654312 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d982d8eb-7f85-4c97-bc31-246d1a22a827 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:04.655384 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d982d8eb-7f85-4c97-bc31-246d1a22a827 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 0ffbef37-e5f8-4de2-a29d-dba6782a3fe4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:04.662255 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6dd41393-ecfb-4d68-a509-1453eb87831f tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:04.662884 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6dd41393-ecfb-4d68-a509-1453eb87831f tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: f47e3dcd-6e44-411d-bf0c-3da0abda9f87] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:04.664585 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d982d8eb-7f85-4c97-bc31-246d1a22a827 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:04.665601 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d982d8eb-7f85-4c97-bc31-246d1a22a827 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:04.666262 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d982d8eb-7f85-4c97-bc31-246d1a22a827 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:04.667457 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d982d8eb-7f85-4c97-bc31-246d1a22a827 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:04.668423 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d982d8eb-7f85-4c97-bc31-246d1a22a827 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:04.669037 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d982d8eb-7f85-4c97-bc31-246d1a22a827 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:04.669579 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6dd41393-ecfb-4d68-a509-1453eb87831f tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:04.670107 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6dd41393-ecfb-4d68-a509-1453eb87831f tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:04.670557 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6dd41393-ecfb-4d68-a509-1453eb87831f tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:04.671915 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6dd41393-ecfb-4d68-a509-1453eb87831f tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:04.672596 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6dd41393-ecfb-4d68-a509-1453eb87831f tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:04.673023 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6dd41393-ecfb-4d68-a509-1453eb87831f tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:04.760899 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6dd41393-ecfb-4d68-a509-1453eb87831f tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:04.771773 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6dd41393-ecfb-4d68-a509-1453eb87831f tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/f47e3dcd-6e44-411d-bf0c-3da0abda9f87" status: 200 len: 1210 microversion: 2.1 time: 0.113677 Oct 17 13:38:04.772503 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 563/1108] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:04 2022] GET /compute/v2.1/servers/f47e3dcd-6e44-411d-bf0c-3da0abda9f87 => generated 1210 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:38:04.832266 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d982d8eb-7f85-4c97-bc31-246d1a22a827 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:04.845182 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d982d8eb-7f85-4c97-bc31-246d1a22a827 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:04.847597 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d982d8eb-7f85-4c97-bc31-246d1a22a827 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:04.849277 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d982d8eb-7f85-4c97-bc31-246d1a22a827 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4" status: 200 len: 1362 microversion: 2.25 time: 0.199342 Oct 17 13:38:04.850651 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 546/1109] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:38:04 2022] GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4 => generated 1362 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:38:04.950696 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-131f0bf0-9d3a-45f5-895a-7dd1fc6f444e tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:04.951359 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-131f0bf0-9d3a-45f5-895a-7dd1fc6f444e tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] [instance: b8d15c7c-7a1f-43e0-9c41-302172f31ca0] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:04.962233 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-131f0bf0-9d3a-45f5-895a-7dd1fc6f444e tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:04.962990 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-131f0bf0-9d3a-45f5-895a-7dd1fc6f444e tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:04.963843 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-131f0bf0-9d3a-45f5-895a-7dd1fc6f444e tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:04.964929 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-131f0bf0-9d3a-45f5-895a-7dd1fc6f444e tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:04.965720 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-131f0bf0-9d3a-45f5-895a-7dd1fc6f444e tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:04.967973 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-131f0bf0-9d3a-45f5-895a-7dd1fc6f444e tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:05.195046 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9960c4b0-f3d1-4b13-9052-2e005e25fd8b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:05.199091 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9960c4b0-f3d1-4b13-9052-2e005e25fd8b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: a54adf11-ee58-4f13-82c8-9a00a36c536e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:05.220129 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9960c4b0-f3d1-4b13-9052-2e005e25fd8b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:05.225561 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9960c4b0-f3d1-4b13-9052-2e005e25fd8b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:05.232139 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9960c4b0-f3d1-4b13-9052-2e005e25fd8b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:05.234410 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9960c4b0-f3d1-4b13-9052-2e005e25fd8b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:05.235071 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9960c4b0-f3d1-4b13-9052-2e005e25fd8b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:05.235696 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9960c4b0-f3d1-4b13-9052-2e005e25fd8b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:05.257682 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:38:05.681987 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-131f0bf0-9d3a-45f5-895a-7dd1fc6f444e tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e5309bf84f4aafa9a17604f8452366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6642f912ba0467bac461bc7aedbf940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:05.691151 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-131f0bf0-9d3a-45f5-895a-7dd1fc6f444e tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] 10.222.0.79 "GET /compute/v2.1/servers/b8d15c7c-7a1f-43e0-9c41-302172f31ca0" status: 200 len: 1367 microversion: 2.1 time: 0.744459 Oct 17 13:38:05.691745 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 564/1110] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:04 2022] GET /compute/v2.1/servers/b8d15c7c-7a1f-43e0-9c41-302172f31ca0 => generated 1367 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:38:05.716029 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b919af12-7373-4ac6-8ad9-2ba5c146aaa8 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:05.717040 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b919af12-7373-4ac6-8ad9-2ba5c146aaa8 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: fe214f31-2995-4475-bcb7-ae4cec33a6f3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:05.723470 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b919af12-7373-4ac6-8ad9-2ba5c146aaa8 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:05.724266 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b919af12-7373-4ac6-8ad9-2ba5c146aaa8 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:05.724830 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b919af12-7373-4ac6-8ad9-2ba5c146aaa8 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:05.725604 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b919af12-7373-4ac6-8ad9-2ba5c146aaa8 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:05.726180 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b919af12-7373-4ac6-8ad9-2ba5c146aaa8 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:05.726695 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b919af12-7373-4ac6-8ad9-2ba5c146aaa8 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:05.861195 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9960c4b0-f3d1-4b13-9052-2e005e25fd8b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:05.872145 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9960c4b0-f3d1-4b13-9052-2e005e25fd8b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e" status: 200 len: 1714 microversion: 2.1 time: 0.688026 Oct 17 13:38:05.889577 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 547/1111] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:05 2022] GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e => generated 1714 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:05.903091 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2aaa66a0-13dc-4f3a-af21-d2051780717c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:05.903741 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2aaa66a0-13dc-4f3a-af21-d2051780717c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: ae587603-994d-419d-979a-1b1361144872] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:05.910816 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2aaa66a0-13dc-4f3a-af21-d2051780717c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:05.911365 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2aaa66a0-13dc-4f3a-af21-d2051780717c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:05.911799 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2aaa66a0-13dc-4f3a-af21-d2051780717c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:05.912501 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2aaa66a0-13dc-4f3a-af21-d2051780717c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:05.912947 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2aaa66a0-13dc-4f3a-af21-d2051780717c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:05.913478 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2aaa66a0-13dc-4f3a-af21-d2051780717c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:06.139682 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b919af12-7373-4ac6-8ad9-2ba5c146aaa8 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:06.148205 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b919af12-7373-4ac6-8ad9-2ba5c146aaa8 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/fe214f31-2995-4475-bcb7-ae4cec33a6f3" status: 200 len: 1471 microversion: 2.1 time: 0.436006 Oct 17 13:38:06.149656 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 565/1112] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:05 2022] GET /compute/v2.1/servers/fe214f31-2995-4475-bcb7-ae4cec33a6f3 => generated 1471 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:06.155551 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c8de2ff3-19c2-4d32-a484-3c0977205ec1 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:06.156351 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c8de2ff3-19c2-4d32-a484-3c0977205ec1 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: f47e3dcd-6e44-411d-bf0c-3da0abda9f87] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:06.164066 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c8de2ff3-19c2-4d32-a484-3c0977205ec1 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:06.164926 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c8de2ff3-19c2-4d32-a484-3c0977205ec1 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:06.165654 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c8de2ff3-19c2-4d32-a484-3c0977205ec1 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:06.166518 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c8de2ff3-19c2-4d32-a484-3c0977205ec1 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:06.167396 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c8de2ff3-19c2-4d32-a484-3c0977205ec1 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:06.167965 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c8de2ff3-19c2-4d32-a484-3c0977205ec1 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:06.187501 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:38:06.290541 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c8de2ff3-19c2-4d32-a484-3c0977205ec1 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:06.300834 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c8de2ff3-19c2-4d32-a484-3c0977205ec1 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/f47e3dcd-6e44-411d-bf0c-3da0abda9f87" status: 200 len: 1272 microversion: 2.1 time: 0.149753 Oct 17 13:38:06.302892 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 566/1113] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:06 2022] GET /compute/v2.1/servers/f47e3dcd-6e44-411d-bf0c-3da0abda9f87 => generated 1272 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:06.308007 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-576ef00a-bdc6-4586-ac06-08902c47da77 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:06.309244 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-576ef00a-bdc6-4586-ac06-08902c47da77 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 0ffbef37-e5f8-4de2-a29d-dba6782a3fe4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:06.316061 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-576ef00a-bdc6-4586-ac06-08902c47da77 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:06.316802 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-576ef00a-bdc6-4586-ac06-08902c47da77 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:06.317754 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-576ef00a-bdc6-4586-ac06-08902c47da77 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:06.318329 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-576ef00a-bdc6-4586-ac06-08902c47da77 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:06.319211 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-576ef00a-bdc6-4586-ac06-08902c47da77 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:06.319896 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-576ef00a-bdc6-4586-ac06-08902c47da77 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:06.334336 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2aaa66a0-13dc-4f3a-af21-d2051780717c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:06.350011 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2aaa66a0-13dc-4f3a-af21-d2051780717c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872" status: 200 len: 1497 microversion: 2.1 time: 0.455448 Oct 17 13:38:06.353932 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 548/1114] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:05 2022] GET /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872 => generated 1497 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:06.532874 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-57a9289d-90f1-49fd-abdd-d06193968a6f req-1d31f4bc-c9bd-4a61-9e59-a61432d72123 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe214f31-2995-4475-bcb7-ae4cec33a6f3", "name": "network-vif-deleted", "tag": "28daee5a-5db6-48a0-af1d-c8b795cbeeb0"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:38:06.553558 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-57a9289d-90f1-49fd-abdd-d06193968a6f req-1d31f4bc-c9bd-4a61-9e59-a61432d72123 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:06.558285 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-57a9289d-90f1-49fd-abdd-d06193968a6f req-1d31f4bc-c9bd-4a61-9e59-a61432d72123 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:06.559055 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-57a9289d-90f1-49fd-abdd-d06193968a6f req-1d31f4bc-c9bd-4a61-9e59-a61432d72123 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:06.575307 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-57a9289d-90f1-49fd-abdd-d06193968a6f req-1d31f4bc-c9bd-4a61-9e59-a61432d72123 service nova] Creating event network-vif-deleted:28daee5a-5db6-48a0-af1d-c8b795cbeeb0 for instance fe214f31-2995-4475-bcb7-ae4cec33a6f3 on n-h1-854247-14 Oct 17 13:38:06.580534 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-57a9289d-90f1-49fd-abdd-d06193968a6f req-1d31f4bc-c9bd-4a61-9e59-a61432d72123 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054690 Oct 17 13:38:06.585858 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 549/1115] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:38:06.643843 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-966ad8e4-b328-4875-8ad3-2eecc8dd4937 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-407244136", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:38:06.712004 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-966ad8e4-b328-4875-8ad3-2eecc8dd4937 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] validate_networks() for [('46e81a55-75e1-43e4-b23d-9bbaa4d6fbd9', None, None, None, None, None)] {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:38:06.901544 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-576ef00a-bdc6-4586-ac06-08902c47da77 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:06.917404 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-576ef00a-bdc6-4586-ac06-08902c47da77 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:06.934472 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-576ef00a-bdc6-4586-ac06-08902c47da77 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:06.938162 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-576ef00a-bdc6-4586-ac06-08902c47da77 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4" status: 200 len: 1558 microversion: 2.25 time: 0.634011 Oct 17 13:38:06.945931 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 567/1116] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:38:06 2022] GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4 => generated 1558 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:38:06.956313 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-65275237-28e4-449e-8e4c-1304c9c698df tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:06.959099 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-65275237-28e4-449e-8e4c-1304c9c698df tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] [instance: b8d15c7c-7a1f-43e0-9c41-302172f31ca0] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:06.974221 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-65275237-28e4-449e-8e4c-1304c9c698df tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:06.974861 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-65275237-28e4-449e-8e4c-1304c9c698df tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:06.975547 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-65275237-28e4-449e-8e4c-1304c9c698df tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:06.986584 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-65275237-28e4-449e-8e4c-1304c9c698df tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:06.988584 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-65275237-28e4-449e-8e4c-1304c9c698df tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:06.989038 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-65275237-28e4-449e-8e4c-1304c9c698df tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:07.337152 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-65275237-28e4-449e-8e4c-1304c9c698df tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e5309bf84f4aafa9a17604f8452366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6642f912ba0467bac461bc7aedbf940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:07.346110 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-65275237-28e4-449e-8e4c-1304c9c698df tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] 10.222.0.79 "GET /compute/v2.1/servers/b8d15c7c-7a1f-43e0-9c41-302172f31ca0" status: 200 len: 1367 microversion: 2.1 time: 0.396116 Oct 17 13:38:07.346905 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 568/1117] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:06 2022] GET /compute/v2.1/servers/b8d15c7c-7a1f-43e0-9c41-302172f31ca0 => generated 1367 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:07.368101 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5d481dcc-81a3-4c2b-bca7-24e38cdcc1e2 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:07.368888 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5d481dcc-81a3-4c2b-bca7-24e38cdcc1e2 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: a54adf11-ee58-4f13-82c8-9a00a36c536e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:07.375546 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5d481dcc-81a3-4c2b-bca7-24e38cdcc1e2 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:07.376061 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5d481dcc-81a3-4c2b-bca7-24e38cdcc1e2 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:07.376707 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5d481dcc-81a3-4c2b-bca7-24e38cdcc1e2 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:07.378218 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5d481dcc-81a3-4c2b-bca7-24e38cdcc1e2 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:07.378218 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5d481dcc-81a3-4c2b-bca7-24e38cdcc1e2 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:07.378452 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5d481dcc-81a3-4c2b-bca7-24e38cdcc1e2 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:07.770471 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-966ad8e4-b328-4875-8ad3-2eecc8dd4937 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:38:07.771011 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-966ad8e4-b328-4875-8ad3-2eecc8dd4937 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:38:07.771379 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-966ad8e4-b328-4875-8ad3-2eecc8dd4937 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:38:07.771804 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-966ad8e4-b328-4875-8ad3-2eecc8dd4937 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:38:07.772913 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-966ad8e4-b328-4875-8ad3-2eecc8dd4937 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:38:07.782517 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-966ad8e4-b328-4875-8ad3-2eecc8dd4937 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:07.782994 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-966ad8e4-b328-4875-8ad3-2eecc8dd4937 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:07.783459 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-966ad8e4-b328-4875-8ad3-2eecc8dd4937 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:07.784180 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-966ad8e4-b328-4875-8ad3-2eecc8dd4937 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:07.784625 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-966ad8e4-b328-4875-8ad3-2eecc8dd4937 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:07.785040 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-966ad8e4-b328-4875-8ad3-2eecc8dd4937 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:07.785645 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5d481dcc-81a3-4c2b-bca7-24e38cdcc1e2 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:07.794138 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5d481dcc-81a3-4c2b-bca7-24e38cdcc1e2 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e" status: 200 len: 1714 microversion: 2.1 time: 0.430459 Oct 17 13:38:07.795486 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 569/1118] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:07 2022] GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e => generated 1714 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:07.806244 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-966ad8e4-b328-4875-8ad3-2eecc8dd4937 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Getting quotas for project c7507d1dd2d345ca9b59dcaa7806b56e. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:38:07.811826 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-966ad8e4-b328-4875-8ad3-2eecc8dd4937 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Getting quotas for user dcbd60cab4174e8db26e28f015795e1f and project c7507d1dd2d345ca9b59dcaa7806b56e. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:38:07.826647 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-966ad8e4-b328-4875-8ad3-2eecc8dd4937 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:38:07.829580 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-966ad8e4-b328-4875-8ad3-2eecc8dd4937 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 298b0f19-0a0c-4304-bb8b-4bd26cce2d9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:38:07.889302 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-966ad8e4-b328-4875-8ad3-2eecc8dd4937 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.251285 Oct 17 13:38:07.896977 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 550/1119] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:38:06 2022] POST /compute/v2.1/servers => generated 383 bytes in 1260 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 13:38:07.902362 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-252441cc-78f5-4b9e-abac-a783a6cfe125 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:07.903203 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-252441cc-78f5-4b9e-abac-a783a6cfe125 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: fe214f31-2995-4475-bcb7-ae4cec33a6f3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:07.910718 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-252441cc-78f5-4b9e-abac-a783a6cfe125 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:07.912564 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-252441cc-78f5-4b9e-abac-a783a6cfe125 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:07.913631 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-252441cc-78f5-4b9e-abac-a783a6cfe125 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:07.914796 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-252441cc-78f5-4b9e-abac-a783a6cfe125 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:07.915436 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-252441cc-78f5-4b9e-abac-a783a6cfe125 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:07.916112 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-252441cc-78f5-4b9e-abac-a783a6cfe125 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:07.941706 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-252441cc-78f5-4b9e-abac-a783a6cfe125 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] HTTP exception thrown: Instance fe214f31-2995-4475-bcb7-ae4cec33a6f3 could not be found. Oct 17 13:38:07.945254 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-252441cc-78f5-4b9e-abac-a783a6cfe125 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Request method failure captured: Oct 17 13:38:07.945254 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/fe214f31-2995-4475-bcb7-ae4cec33a6f3 HTTP/1.1 Oct 17 13:38:07.945254 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:38:07.945254 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:38:07.945254 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:38:07.945254 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:38:07.945254 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:38:07.945254 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:38:07.945254 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:38:07.945254 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:38:07.945254 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVn0rKCCzxL1KwIZI1Im8ygkuewY-UzF6Z81i6cNkagTk7ClET_LM7mvJkIi7s6pFyo0jkOjEfkZnFMR6ojJjeKHBwoksuv9Z4X8LYNw4iNhGgW8aAiE8QzHsCgl5CJTTDwKklbNcQOJJRXIUfAtc0cseQ_bknPsrUPdOoFAaQy0_jg Oct 17 13:38:07.945254 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:38:07.945254 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:38:07.945254 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:38:07.945254 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:38:07.945254 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:38:07.945254 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:38:07.945254 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: fa1db260a96a4c6aa69cd6437baab6f7 Oct 17 13:38:07.945254 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServersOnMultiNodesTest-1107099453 Oct 17 13:38:07.945254 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:38:07.945254 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:38:07.946999 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/fa1db260a96a4c6aa69cd6437baab6f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/fa1db260a96a4c6aa69cd6437baab6f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/fa1db260a96a4c6aa69cd6437baab6f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_fa1db260a96a4c6aa69cd6437baab6f7", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:38:07.946999 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServersOnMultiNodesTest-1107099453 Oct 17 13:38:07.946999 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: fa1db260a96a4c6aa69cd6437baab6f7 Oct 17 13:38:07.946999 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1107099453 Oct 17 13:38:07.946999 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServersOnMultiNodesTest-1107099453-project Oct 17 13:38:07.946999 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:38:07.946999 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:38:07.946999 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 7a7e082035084338966a1c56b30c7093 Oct 17 13:38:07.946999 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServersOnMultiNodesTest-1107099453-project Oct 17 13:38:07.946999 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:38:07.946999 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance fe214f31-2995-4475-bcb7-ae4cec33a6f3 could not be found. Oct 17 13:38:07.946999 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'fe214f31-2995-4475-bcb7-ae4cec33a6f3'} Oct 17 13:38:07.948026 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:38:07.948026 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:38:07.948026 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:38:07.948026 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:38:07.948026 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:38:07.948026 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:38:07.948026 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:38:07.948026 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:38:07.948026 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:38:07.948026 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:38:07.948026 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe214f31-2995-4475-bcb7-ae4cec33a6f3 could not be found. Oct 17 13:38:07.948026 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:38:07.948026 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:38:07.948026 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:38:07.948026 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:38:07.948026 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:38:07.948026 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:38:07.948026 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:38:07.948026 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:38:07.948026 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:38:07.949247 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:38:07.949247 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:38:07.949247 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:38:07.949247 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:38:07.949247 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:38:07.949247 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:38:07.949247 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:38:07.949247 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe214f31-2995-4475-bcb7-ae4cec33a6f3 could not be found. Oct 17 13:38:07.949247 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:38:07.949247 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:38:07.949247 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:38:07.949247 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:38:07.949247 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:38:07.949247 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:38:07.949247 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:38:07.949247 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:38:07.949247 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe214f31-2995-4475-bcb7-ae4cec33a6f3 could not be found. Oct 17 13:38:07.949247 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:38:07.950482 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-252441cc-78f5-4b9e-abac-a783a6cfe125 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Returning 404 to user: Instance fe214f31-2995-4475-bcb7-ae4cec33a6f3 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:38:07.950482 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-252441cc-78f5-4b9e-abac-a783a6cfe125 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/fe214f31-2995-4475-bcb7-ae4cec33a6f3" status: 404 len: 111 microversion: 2.1 time: 0.048981 Oct 17 13:38:07.950482 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 551/1120] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:07 2022] GET /compute/v2.1/servers/fe214f31-2995-4475-bcb7-ae4cec33a6f3 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:38:07.955402 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-be1019da-2dec-43e4-a22e-a6125bfaba92 req-e05a0ae5-cbed-44ba-b311-f6c66280c16d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8d15c7c-7a1f-43e0-9c41-302172f31ca0", "name": "network-vif-plugged", "status": "completed", "tag": "6b4af2c6-531c-4352-bbe4-6c4df4387bbf"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:38:07.973198 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-be1019da-2dec-43e4-a22e-a6125bfaba92 req-e05a0ae5-cbed-44ba-b311-f6c66280c16d service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:07.973690 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-be1019da-2dec-43e4-a22e-a6125bfaba92 req-e05a0ae5-cbed-44ba-b311-f6c66280c16d service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:07.974148 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-be1019da-2dec-43e4-a22e-a6125bfaba92 req-e05a0ae5-cbed-44ba-b311-f6c66280c16d service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:07.991876 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-be1019da-2dec-43e4-a22e-a6125bfaba92 req-e05a0ae5-cbed-44ba-b311-f6c66280c16d service nova] Creating event network-vif-plugged:6b4af2c6-531c-4352-bbe4-6c4df4387bbf for instance b8d15c7c-7a1f-43e0-9c41-302172f31ca0 on n-h2-854247-14 Oct 17 13:38:07.999107 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-be1019da-2dec-43e4-a22e-a6125bfaba92 req-e05a0ae5-cbed-44ba-b311-f6c66280c16d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048506 Oct 17 13:38:08.000211 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 552/1121] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:38:08.005644 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f731c057-d059-4195-879a-ed6d42eb8d3b tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:08.006475 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f731c057-d059-4195-879a-ed6d42eb8d3b tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: f47e3dcd-6e44-411d-bf0c-3da0abda9f87] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:08.014756 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f731c057-d059-4195-879a-ed6d42eb8d3b tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:08.015430 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f731c057-d059-4195-879a-ed6d42eb8d3b tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:08.016199 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f731c057-d059-4195-879a-ed6d42eb8d3b tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:08.017546 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f731c057-d059-4195-879a-ed6d42eb8d3b tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:08.018149 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f731c057-d059-4195-879a-ed6d42eb8d3b tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:08.018717 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f731c057-d059-4195-879a-ed6d42eb8d3b tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:08.033872 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8b6f15e0-2798-4a6c-a4ce-f65abdfa5e03 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:08.034495 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8b6f15e0-2798-4a6c-a4ce-f65abdfa5e03 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] [instance: 0ffbef37-e5f8-4de2-a29d-dba6782a3fe4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:08.063746 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8b6f15e0-2798-4a6c-a4ce-f65abdfa5e03 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:08.064258 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8b6f15e0-2798-4a6c-a4ce-f65abdfa5e03 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:08.064685 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8b6f15e0-2798-4a6c-a4ce-f65abdfa5e03 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:08.065389 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8b6f15e0-2798-4a6c-a4ce-f65abdfa5e03 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:08.066110 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8b6f15e0-2798-4a6c-a4ce-f65abdfa5e03 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:08.066534 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8b6f15e0-2798-4a6c-a4ce-f65abdfa5e03 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:08.479900 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f731c057-d059-4195-879a-ed6d42eb8d3b tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:08.486624 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-8b6f15e0-2798-4a6c-a4ce-f65abdfa5e03 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lazy-loading 'services' on Instance uuid 0ffbef37-e5f8-4de2-a29d-dba6782a3fe4 {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:38:08.495197 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f731c057-d059-4195-879a-ed6d42eb8d3b tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/f47e3dcd-6e44-411d-bf0c-3da0abda9f87" status: 200 len: 1314 microversion: 2.1 time: 0.493644 Oct 17 13:38:08.495820 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 553/1122] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:08 2022] GET /compute/v2.1/servers/f47e3dcd-6e44-411d-bf0c-3da0abda9f87 => generated 1314 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:08.500627 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3bfe5653-a856-4d2f-b0a4-b601675a8876 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:08.503823 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3bfe5653-a856-4d2f-b0a4-b601675a8876 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: ae587603-994d-419d-979a-1b1361144872] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:08.516740 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3bfe5653-a856-4d2f-b0a4-b601675a8876 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:08.519423 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3bfe5653-a856-4d2f-b0a4-b601675a8876 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:08.519993 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3bfe5653-a856-4d2f-b0a4-b601675a8876 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:08.520839 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8b6f15e0-2798-4a6c-a4ce-f65abdfa5e03 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4" status: 200 len: 2053 microversion: 2.25 time: 0.723973 Oct 17 13:38:08.521324 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3bfe5653-a856-4d2f-b0a4-b601675a8876 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:08.522211 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3bfe5653-a856-4d2f-b0a4-b601675a8876 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:08.522528 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 570/1123] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:38:07 2022] GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4 => generated 2053 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:38:08.531238 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9e559bb6-57eb-4777-9d6b-1e037bd613b1 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:08.532504 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9e559bb6-57eb-4777-9d6b-1e037bd613b1 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 298b0f19-0a0c-4304-bb8b-4bd26cce2d9d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:08.535041 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3bfe5653-a856-4d2f-b0a4-b601675a8876 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:08.540071 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9e559bb6-57eb-4777-9d6b-1e037bd613b1 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:08.542265 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9e559bb6-57eb-4777-9d6b-1e037bd613b1 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:08.542903 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9e559bb6-57eb-4777-9d6b-1e037bd613b1 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:08.543862 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9e559bb6-57eb-4777-9d6b-1e037bd613b1 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:08.544517 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9e559bb6-57eb-4777-9d6b-1e037bd613b1 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:08.545119 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9e559bb6-57eb-4777-9d6b-1e037bd613b1 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:08.953379 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9e559bb6-57eb-4777-9d6b-1e037bd613b1 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:08.961801 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9e559bb6-57eb-4777-9d6b-1e037bd613b1 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/298b0f19-0a0c-4304-bb8b-4bd26cce2d9d" status: 200 len: 1228 microversion: 2.1 time: 0.437279 Oct 17 13:38:08.962401 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 571/1124] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:08 2022] GET /compute/v2.1/servers/298b0f19-0a0c-4304-bb8b-4bd26cce2d9d => generated 1228 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:08.978142 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d62aa646-a714-430d-b7b6-616d92f2940c tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:08.978869 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d62aa646-a714-430d-b7b6-616d92f2940c tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 8138c4a6-0fa5-4427-a026-56618461dd14] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:08.985649 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d62aa646-a714-430d-b7b6-616d92f2940c tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:08.986132 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d62aa646-a714-430d-b7b6-616d92f2940c tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:08.986561 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d62aa646-a714-430d-b7b6-616d92f2940c tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:08.987284 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d62aa646-a714-430d-b7b6-616d92f2940c tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:08.987795 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d62aa646-a714-430d-b7b6-616d92f2940c tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:08.988213 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d62aa646-a714-430d-b7b6-616d92f2940c tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:09.017399 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d62aa646-a714-430d-b7b6-616d92f2940c tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 8138c4a6-0fa5-4427-a026-56618461dd14] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:38:09.108937 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d62aa646-a714-430d-b7b6-616d92f2940c tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "DELETE /compute/v2.1/servers/8138c4a6-0fa5-4427-a026-56618461dd14" status: 204 len: 0 microversion: 2.1 time: 0.144897 Oct 17 13:38:09.109652 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 572/1125] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:38:08 2022] DELETE /compute/v2.1/servers/8138c4a6-0fa5-4427-a026-56618461dd14 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:38:09.119332 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4df7a0f7-470d-4bb7-9245-24461749bd88 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:09.120353 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4df7a0f7-470d-4bb7-9245-24461749bd88 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] [instance: b8d15c7c-7a1f-43e0-9c41-302172f31ca0] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:09.126648 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4df7a0f7-470d-4bb7-9245-24461749bd88 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:09.127141 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4df7a0f7-470d-4bb7-9245-24461749bd88 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:09.128459 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4df7a0f7-470d-4bb7-9245-24461749bd88 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:09.128617 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4df7a0f7-470d-4bb7-9245-24461749bd88 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:09.129250 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4df7a0f7-470d-4bb7-9245-24461749bd88 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:09.129676 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4df7a0f7-470d-4bb7-9245-24461749bd88 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:09.205550 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3bfe5653-a856-4d2f-b0a4-b601675a8876 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:09.214306 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3bfe5653-a856-4d2f-b0a4-b601675a8876 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872" status: 200 len: 1497 microversion: 2.1 time: 0.717222 Oct 17 13:38:09.214962 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 554/1126] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:08 2022] GET /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872 => generated 1497 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:09.234166 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-95927ab5-fed7-4a4f-9708-0d0a83bf6b9e tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:09.234765 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-95927ab5-fed7-4a4f-9708-0d0a83bf6b9e tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] [instance: 0ffbef37-e5f8-4de2-a29d-dba6782a3fe4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:09.240944 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-95927ab5-fed7-4a4f-9708-0d0a83bf6b9e tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:09.241422 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-95927ab5-fed7-4a4f-9708-0d0a83bf6b9e tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:09.241847 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-95927ab5-fed7-4a4f-9708-0d0a83bf6b9e tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:09.242673 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-95927ab5-fed7-4a4f-9708-0d0a83bf6b9e tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:09.243005 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-95927ab5-fed7-4a4f-9708-0d0a83bf6b9e tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:09.243460 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-95927ab5-fed7-4a4f-9708-0d0a83bf6b9e tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:09.504654 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4df7a0f7-470d-4bb7-9245-24461749bd88 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e5309bf84f4aafa9a17604f8452366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6642f912ba0467bac461bc7aedbf940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:09.514108 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4df7a0f7-470d-4bb7-9245-24461749bd88 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] 10.222.0.79 "GET /compute/v2.1/servers/b8d15c7c-7a1f-43e0-9c41-302172f31ca0" status: 200 len: 1367 microversion: 2.1 time: 0.402948 Oct 17 13:38:09.517882 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 573/1127] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:09 2022] GET /compute/v2.1/servers/b8d15c7c-7a1f-43e0-9c41-302172f31ca0 => generated 1367 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:09.527754 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-74817955-a3b6-48e6-b7c7-c4b4f129030a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:09.528826 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-74817955-a3b6-48e6-b7c7-c4b4f129030a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: a54adf11-ee58-4f13-82c8-9a00a36c536e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:09.540396 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-74817955-a3b6-48e6-b7c7-c4b4f129030a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:09.540912 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-74817955-a3b6-48e6-b7c7-c4b4f129030a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:09.541326 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-74817955-a3b6-48e6-b7c7-c4b4f129030a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:09.542044 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-74817955-a3b6-48e6-b7c7-c4b4f129030a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:09.542513 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-74817955-a3b6-48e6-b7c7-c4b4f129030a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:09.542969 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-74817955-a3b6-48e6-b7c7-c4b4f129030a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:09.594658 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-95927ab5-fed7-4a4f-9708-0d0a83bf6b9e tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lazy-loading 'services' on Instance uuid 0ffbef37-e5f8-4de2-a29d-dba6782a3fe4 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:38:09.608340 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-95927ab5-fed7-4a4f-9708-0d0a83bf6b9e tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4" status: 200 len: 2053 microversion: 2.25 time: 0.377854 Oct 17 13:38:09.608947 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 555/1128] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:38:09 2022] GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4 => generated 2053 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:38:09.614930 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-89f050f6-b5fa-4399-9eca-b70c981ff44f tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:09.615708 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-89f050f6-b5fa-4399-9eca-b70c981ff44f tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 8138c4a6-0fa5-4427-a026-56618461dd14] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:09.625659 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-89f050f6-b5fa-4399-9eca-b70c981ff44f tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:09.626161 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-89f050f6-b5fa-4399-9eca-b70c981ff44f tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:09.626835 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-89f050f6-b5fa-4399-9eca-b70c981ff44f tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:09.627722 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-89f050f6-b5fa-4399-9eca-b70c981ff44f tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:09.628248 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-89f050f6-b5fa-4399-9eca-b70c981ff44f tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:09.628729 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-89f050f6-b5fa-4399-9eca-b70c981ff44f tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:09.918311 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-74817955-a3b6-48e6-b7c7-c4b4f129030a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:09.927293 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-74817955-a3b6-48e6-b7c7-c4b4f129030a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e" status: 200 len: 1714 microversion: 2.1 time: 0.407968 Oct 17 13:38:09.927880 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 574/1129] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:09 2022] GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e => generated 1714 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:09.932774 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-48e51eda-215f-42f9-9c65-c5f87588a9b3 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:09.933395 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-48e51eda-215f-42f9-9c65-c5f87588a9b3 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: f47e3dcd-6e44-411d-bf0c-3da0abda9f87] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:09.940082 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48e51eda-215f-42f9-9c65-c5f87588a9b3 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:09.940573 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48e51eda-215f-42f9-9c65-c5f87588a9b3 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:09.941007 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48e51eda-215f-42f9-9c65-c5f87588a9b3 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:09.941704 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48e51eda-215f-42f9-9c65-c5f87588a9b3 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:09.942360 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48e51eda-215f-42f9-9c65-c5f87588a9b3 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:09.942952 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48e51eda-215f-42f9-9c65-c5f87588a9b3 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:09.972618 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-89f050f6-b5fa-4399-9eca-b70c981ff44f tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:09.986839 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-89f050f6-b5fa-4399-9eca-b70c981ff44f tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/8138c4a6-0fa5-4427-a026-56618461dd14" status: 200 len: 1473 microversion: 2.1 time: 0.376455 Oct 17 13:38:09.987438 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 556/1130] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:09 2022] GET /compute/v2.1/servers/8138c4a6-0fa5-4427-a026-56618461dd14 => generated 1473 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:09.992554 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0a78ea0d-a0d6-4db6-bd27-b2a7249faee9 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:09.996466 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0a78ea0d-a0d6-4db6-bd27-b2a7249faee9 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:09.996946 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0a78ea0d-a0d6-4db6-bd27-b2a7249faee9 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:09.997368 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0a78ea0d-a0d6-4db6-bd27-b2a7249faee9 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:09.998125 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0a78ea0d-a0d6-4db6-bd27-b2a7249faee9 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:09.998601 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0a78ea0d-a0d6-4db6-bd27-b2a7249faee9 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:09.999010 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0a78ea0d-a0d6-4db6-bd27-b2a7249faee9 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:10.028142 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0a78ea0d-a0d6-4db6-bd27-b2a7249faee9 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.039412 Oct 17 13:38:10.029061 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 557/1131] 10.222.0.79 () {60 vars in 1217 bytes} [Mon Oct 17 13:38:09 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:38:10.033867 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-67fa7587-25cd-4769-a99e-7b3f5467cfb6 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:10.034474 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-67fa7587-25cd-4769-a99e-7b3f5467cfb6 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 298b0f19-0a0c-4304-bb8b-4bd26cce2d9d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:10.040738 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-67fa7587-25cd-4769-a99e-7b3f5467cfb6 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:10.041211 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-67fa7587-25cd-4769-a99e-7b3f5467cfb6 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:10.041623 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-67fa7587-25cd-4769-a99e-7b3f5467cfb6 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:10.042306 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-67fa7587-25cd-4769-a99e-7b3f5467cfb6 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:10.042745 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-67fa7587-25cd-4769-a99e-7b3f5467cfb6 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:10.043150 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-67fa7587-25cd-4769-a99e-7b3f5467cfb6 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:10.161138 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-67fa7587-25cd-4769-a99e-7b3f5467cfb6 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:10.169992 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-67fa7587-25cd-4769-a99e-7b3f5467cfb6 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/298b0f19-0a0c-4304-bb8b-4bd26cce2d9d" status: 200 len: 1276 microversion: 2.1 time: 0.139591 Oct 17 13:38:10.170556 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 558/1132] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:10 2022] GET /compute/v2.1/servers/298b0f19-0a0c-4304-bb8b-4bd26cce2d9d => generated 1276 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:10.175723 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-3d07618e-bc38-4964-bbfe-5cbdfd8f65a6 req-e5292e6b-ac81-4be0-87f6-d84c9a97dcd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab2b571e-376c-41d3-a778-44bedcaa5467", "tag": "7ff3914f-4ed0-4fef-bc81-8a07b3c2c97b"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:38:10.185737 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-3d07618e-bc38-4964-bbfe-5cbdfd8f65a6 req-e5292e6b-ac81-4be0-87f6-d84c9a97dcd5 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:10.186211 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-3d07618e-bc38-4964-bbfe-5cbdfd8f65a6 req-e5292e6b-ac81-4be0-87f6-d84c9a97dcd5 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:10.186976 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-3d07618e-bc38-4964-bbfe-5cbdfd8f65a6 req-e5292e6b-ac81-4be0-87f6-d84c9a97dcd5 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:10.198535 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-3d07618e-bc38-4964-bbfe-5cbdfd8f65a6 req-e5292e6b-ac81-4be0-87f6-d84c9a97dcd5 service nova] Creating event network-changed:7ff3914f-4ed0-4fef-bc81-8a07b3c2c97b for instance ab2b571e-376c-41d3-a778-44bedcaa5467 on n-h2-854247-14 Oct 17 13:38:10.204010 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-3d07618e-bc38-4964-bbfe-5cbdfd8f65a6 req-e5292e6b-ac81-4be0-87f6-d84c9a97dcd5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031907 Oct 17 13:38:10.204786 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 559/1133] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:38:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:38:10.209834 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6ccff54b-44d1-44b3-8d4f-bbbf3c68b510 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854247-14", "block_migration": "auto"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:38:10.212521 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-48e51eda-215f-42f9-9c65-c5f87588a9b3 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:10.213124 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6ccff54b-44d1-44b3-8d4f-bbbf3c68b510 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] [instance: 0ffbef37-e5f8-4de2-a29d-dba6782a3fe4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:10.219840 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6ccff54b-44d1-44b3-8d4f-bbbf3c68b510 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:10.220323 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6ccff54b-44d1-44b3-8d4f-bbbf3c68b510 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:10.220756 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6ccff54b-44d1-44b3-8d4f-bbbf3c68b510 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:10.221475 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6ccff54b-44d1-44b3-8d4f-bbbf3c68b510 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:10.221915 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6ccff54b-44d1-44b3-8d4f-bbbf3c68b510 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:10.222128 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-48e51eda-215f-42f9-9c65-c5f87588a9b3 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/f47e3dcd-6e44-411d-bf0c-3da0abda9f87" status: 200 len: 1314 microversion: 2.1 time: 0.293064 Oct 17 13:38:10.222325 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6ccff54b-44d1-44b3-8d4f-bbbf3c68b510 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:10.223080 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 575/1134] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:09 2022] GET /compute/v2.1/servers/f47e3dcd-6e44-411d-bf0c-3da0abda9f87 => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:10.237120 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5a3d245d-2fa5-4a5e-a216-320358bc7e05 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:10.238089 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5a3d245d-2fa5-4a5e-a216-320358bc7e05 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: ae587603-994d-419d-979a-1b1361144872] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:10.244467 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5a3d245d-2fa5-4a5e-a216-320358bc7e05 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:10.245026 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5a3d245d-2fa5-4a5e-a216-320358bc7e05 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:10.245678 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5a3d245d-2fa5-4a5e-a216-320358bc7e05 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:10.246466 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5a3d245d-2fa5-4a5e-a216-320358bc7e05 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:10.246984 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5a3d245d-2fa5-4a5e-a216-320358bc7e05 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:10.247641 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5a3d245d-2fa5-4a5e-a216-320358bc7e05 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:10.248306 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-6ccff54b-44d1-44b3-8d4f-bbbf3c68b510 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lazy-loading 'flavor' on Instance uuid 0ffbef37-e5f8-4de2-a29d-dba6782a3fe4 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:38:10.261072 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6ccff54b-44d1-44b3-8d4f-bbbf3c68b510 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] [instance: 0ffbef37-e5f8-4de2-a29d-dba6782a3fe4] Going to try to live migrate instance to n-h2-854247-14 {{(pid=127016) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 17 13:38:10.432787 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5a3d245d-2fa5-4a5e-a216-320358bc7e05 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:10.443550 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5a3d245d-2fa5-4a5e-a216-320358bc7e05 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872" status: 200 len: 1497 microversion: 2.1 time: 0.210029 Oct 17 13:38:10.444787 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 576/1135] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:10 2022] GET /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872 => generated 1497 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:38:10.537473 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a95f92f5-c8f6-410a-a61d-e7a0b2ca4df6 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:10.538114 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a95f92f5-c8f6-410a-a61d-e7a0b2ca4df6 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] [instance: b8d15c7c-7a1f-43e0-9c41-302172f31ca0] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:10.544474 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a95f92f5-c8f6-410a-a61d-e7a0b2ca4df6 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:10.544957 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a95f92f5-c8f6-410a-a61d-e7a0b2ca4df6 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:10.545383 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a95f92f5-c8f6-410a-a61d-e7a0b2ca4df6 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:10.546080 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a95f92f5-c8f6-410a-a61d-e7a0b2ca4df6 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:10.546524 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a95f92f5-c8f6-410a-a61d-e7a0b2ca4df6 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:10.546943 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a95f92f5-c8f6-410a-a61d-e7a0b2ca4df6 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:10.688443 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a95f92f5-c8f6-410a-a61d-e7a0b2ca4df6 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e5309bf84f4aafa9a17604f8452366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6642f912ba0467bac461bc7aedbf940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:10.697755 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a95f92f5-c8f6-410a-a61d-e7a0b2ca4df6 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] 10.222.0.79 "GET /compute/v2.1/servers/b8d15c7c-7a1f-43e0-9c41-302172f31ca0" status: 200 len: 1556 microversion: 2.1 time: 0.164127 Oct 17 13:38:10.698896 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 577/1136] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:10 2022] GET /compute/v2.1/servers/b8d15c7c-7a1f-43e0-9c41-302172f31ca0 => generated 1556 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:38:10.722602 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-985ffd9d-ddd2-42e7-9013-c2faf127f139 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:10.723159 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-985ffd9d-ddd2-42e7-9013-c2faf127f139 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] [instance: b8d15c7c-7a1f-43e0-9c41-302172f31ca0] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:10.730379 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-985ffd9d-ddd2-42e7-9013-c2faf127f139 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:10.731054 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-985ffd9d-ddd2-42e7-9013-c2faf127f139 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:10.731529 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-985ffd9d-ddd2-42e7-9013-c2faf127f139 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:10.732545 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-985ffd9d-ddd2-42e7-9013-c2faf127f139 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:10.732946 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-985ffd9d-ddd2-42e7-9013-c2faf127f139 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:10.733437 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-985ffd9d-ddd2-42e7-9013-c2faf127f139 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:10.815702 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-985ffd9d-ddd2-42e7-9013-c2faf127f139 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] 10.222.0.79 "GET /compute/v2.1/servers/b8d15c7c-7a1f-43e0-9c41-302172f31ca0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097173 Oct 17 13:38:10.816301 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 578/1137] 10.222.0.79 () {58 vars in 1275 bytes} [Mon Oct 17 13:38:10 2022] GET /compute/v2.1/servers/b8d15c7c-7a1f-43e0-9c41-302172f31ca0/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:38:10.953767 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b259e24d-9872-4a56-99c3-e5572374d2ee tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:10.954489 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b259e24d-9872-4a56-99c3-e5572374d2ee tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: a54adf11-ee58-4f13-82c8-9a00a36c536e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:10.961357 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b259e24d-9872-4a56-99c3-e5572374d2ee tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:10.961973 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b259e24d-9872-4a56-99c3-e5572374d2ee tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:10.962481 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b259e24d-9872-4a56-99c3-e5572374d2ee tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:10.963231 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b259e24d-9872-4a56-99c3-e5572374d2ee tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:10.963699 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b259e24d-9872-4a56-99c3-e5572374d2ee tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:10.964120 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b259e24d-9872-4a56-99c3-e5572374d2ee tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:11.418451 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b259e24d-9872-4a56-99c3-e5572374d2ee tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:11.427561 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b259e24d-9872-4a56-99c3-e5572374d2ee tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e" status: 200 len: 1714 microversion: 2.1 time: 0.478368 Oct 17 13:38:11.428225 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 579/1138] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:10 2022] GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e => generated 1714 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:11.443513 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d0ae677f-0a3e-42e4-9e54-b3af30dae560 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:11.444143 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d0ae677f-0a3e-42e4-9e54-b3af30dae560 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 8138c4a6-0fa5-4427-a026-56618461dd14] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:11.459335 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d0ae677f-0a3e-42e4-9e54-b3af30dae560 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:11.460065 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d0ae677f-0a3e-42e4-9e54-b3af30dae560 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:11.460694 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d0ae677f-0a3e-42e4-9e54-b3af30dae560 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:11.465046 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d0ae677f-0a3e-42e4-9e54-b3af30dae560 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:11.465733 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d0ae677f-0a3e-42e4-9e54-b3af30dae560 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:11.466522 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d0ae677f-0a3e-42e4-9e54-b3af30dae560 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:11.558534 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d0ae677f-0a3e-42e4-9e54-b3af30dae560 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:11.562255 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d0ae677f-0a3e-42e4-9e54-b3af30dae560 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:11.562754 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d0ae677f-0a3e-42e4-9e54-b3af30dae560 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:11.563293 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-d0ae677f-0a3e-42e4-9e54-b3af30dae560 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lazy-loading 'fault' on Instance uuid 8138c4a6-0fa5-4427-a026-56618461dd14 {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:38:11.782380 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d0ae677f-0a3e-42e4-9e54-b3af30dae560 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:11.790881 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d0ae677f-0a3e-42e4-9e54-b3af30dae560 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/8138c4a6-0fa5-4427-a026-56618461dd14" status: 200 len: 1307 microversion: 2.1 time: 0.361706 Oct 17 13:38:11.791534 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 580/1139] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:11 2022] GET /compute/v2.1/servers/8138c4a6-0fa5-4427-a026-56618461dd14 => generated 1307 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:11.796235 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-707051f1-419c-4956-ab62-645c63ea665b req-37d67dbb-1c36-4380-bb28-c372d2056ee4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8138c4a6-0fa5-4427-a026-56618461dd14", "name": "network-vif-deleted", "tag": "46def99d-baf2-40aa-8eb4-982b1afb28b7"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:38:11.806081 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-707051f1-419c-4956-ab62-645c63ea665b req-37d67dbb-1c36-4380-bb28-c372d2056ee4 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:11.806889 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-707051f1-419c-4956-ab62-645c63ea665b req-37d67dbb-1c36-4380-bb28-c372d2056ee4 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:11.807585 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-707051f1-419c-4956-ab62-645c63ea665b req-37d67dbb-1c36-4380-bb28-c372d2056ee4 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:11.812440 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:38:11.822218 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-707051f1-419c-4956-ab62-645c63ea665b req-37d67dbb-1c36-4380-bb28-c372d2056ee4 service nova] Creating event network-vif-deleted:46def99d-baf2-40aa-8eb4-982b1afb28b7 for instance 8138c4a6-0fa5-4427-a026-56618461dd14 on n-h1-854247-14 Oct 17 13:38:11.827469 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-707051f1-419c-4956-ab62-645c63ea665b req-37d67dbb-1c36-4380-bb28-c372d2056ee4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034432 Oct 17 13:38:11.828179 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 581/1140] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:38:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:38:11.833547 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1114e8e6-9bb7-47a8-8f19-19b7d0e6852d tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:11.834356 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1114e8e6-9bb7-47a8-8f19-19b7d0e6852d tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 298b0f19-0a0c-4304-bb8b-4bd26cce2d9d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:11.842192 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1114e8e6-9bb7-47a8-8f19-19b7d0e6852d tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:11.843003 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1114e8e6-9bb7-47a8-8f19-19b7d0e6852d tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:11.843673 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1114e8e6-9bb7-47a8-8f19-19b7d0e6852d tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:11.844627 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1114e8e6-9bb7-47a8-8f19-19b7d0e6852d tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:11.845292 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1114e8e6-9bb7-47a8-8f19-19b7d0e6852d tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:11.845926 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1114e8e6-9bb7-47a8-8f19-19b7d0e6852d tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:11.975617 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1114e8e6-9bb7-47a8-8f19-19b7d0e6852d tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:11.986986 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1114e8e6-9bb7-47a8-8f19-19b7d0e6852d tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/298b0f19-0a0c-4304-bb8b-4bd26cce2d9d" status: 200 len: 1276 microversion: 2.1 time: 0.157352 Oct 17 13:38:11.988511 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 582/1141] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:11 2022] GET /compute/v2.1/servers/298b0f19-0a0c-4304-bb8b-4bd26cce2d9d => generated 1276 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:11.995548 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-48102e75-2905-4393-b2b3-f255bf6f63ef tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:11.996529 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-48102e75-2905-4393-b2b3-f255bf6f63ef tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: f47e3dcd-6e44-411d-bf0c-3da0abda9f87] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:12.005648 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48102e75-2905-4393-b2b3-f255bf6f63ef tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:12.006624 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48102e75-2905-4393-b2b3-f255bf6f63ef tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:12.008352 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48102e75-2905-4393-b2b3-f255bf6f63ef tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:12.009672 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48102e75-2905-4393-b2b3-f255bf6f63ef tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:12.010777 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48102e75-2905-4393-b2b3-f255bf6f63ef tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:12.011787 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48102e75-2905-4393-b2b3-f255bf6f63ef tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:12.461594 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6ccff54b-44d1-44b3-8d4f-bbbf3c68b510 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4/action" status: 202 len: 0 microversion: 2.25 time: 2.255400 Oct 17 13:38:12.467053 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 560/1142] 10.222.0.79 () {62 vars in 1319 bytes} [Mon Oct 17 13:38:10 2022] POST /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4/action => generated 0 bytes in 2262 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:38:12.472586 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-dc1d130d-505c-4764-9834-eb25547feafe tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:12.473590 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-dc1d130d-505c-4764-9834-eb25547feafe tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: ae587603-994d-419d-979a-1b1361144872] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:12.486464 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc1d130d-505c-4764-9834-eb25547feafe tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:12.487615 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc1d130d-505c-4764-9834-eb25547feafe tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:12.488351 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc1d130d-505c-4764-9834-eb25547feafe tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:12.489303 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc1d130d-505c-4764-9834-eb25547feafe tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:12.489973 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc1d130d-505c-4764-9834-eb25547feafe tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:12.490605 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc1d130d-505c-4764-9834-eb25547feafe tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:12.940134 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-48102e75-2905-4393-b2b3-f255bf6f63ef tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:12.949273 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-48102e75-2905-4393-b2b3-f255bf6f63ef tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/f47e3dcd-6e44-411d-bf0c-3da0abda9f87" status: 200 len: 1314 microversion: 2.1 time: 0.959269 Oct 17 13:38:12.950186 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 583/1143] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:11 2022] GET /compute/v2.1/servers/f47e3dcd-6e44-411d-bf0c-3da0abda9f87 => generated 1314 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:12.954899 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-49e9560b-ffbf-4fcd-b67c-32488e0aa3a8 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:12.955837 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-49e9560b-ffbf-4fcd-b67c-32488e0aa3a8 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: a54adf11-ee58-4f13-82c8-9a00a36c536e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:12.962361 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-49e9560b-ffbf-4fcd-b67c-32488e0aa3a8 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:12.963184 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-49e9560b-ffbf-4fcd-b67c-32488e0aa3a8 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:12.963865 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-49e9560b-ffbf-4fcd-b67c-32488e0aa3a8 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:12.964800 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-49e9560b-ffbf-4fcd-b67c-32488e0aa3a8 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:12.965464 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-49e9560b-ffbf-4fcd-b67c-32488e0aa3a8 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:12.966097 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-49e9560b-ffbf-4fcd-b67c-32488e0aa3a8 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:13.150066 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-dc1d130d-505c-4764-9834-eb25547feafe tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:13.159042 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-dc1d130d-505c-4764-9834-eb25547feafe tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872" status: 200 len: 1497 microversion: 2.1 time: 0.690443 Oct 17 13:38:13.163248 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 561/1144] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:12 2022] GET /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872 => generated 1497 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:13.170900 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e6200e7d-16d6-4125-9c33-4762fc94358c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:13.172786 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e6200e7d-16d6-4125-9c33-4762fc94358c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 0ffbef37-e5f8-4de2-a29d-dba6782a3fe4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:13.179114 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e6200e7d-16d6-4125-9c33-4762fc94358c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:13.179645 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e6200e7d-16d6-4125-9c33-4762fc94358c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:13.180292 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e6200e7d-16d6-4125-9c33-4762fc94358c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:13.181168 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e6200e7d-16d6-4125-9c33-4762fc94358c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:13.181597 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e6200e7d-16d6-4125-9c33-4762fc94358c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:13.182020 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e6200e7d-16d6-4125-9c33-4762fc94358c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:13.448474 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-49e9560b-ffbf-4fcd-b67c-32488e0aa3a8 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:13.457225 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-49e9560b-ffbf-4fcd-b67c-32488e0aa3a8 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e" status: 200 len: 1714 microversion: 2.1 time: 0.505828 Oct 17 13:38:13.470122 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 584/1145] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:12 2022] GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e => generated 1714 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:13.479879 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-ff3fd152-c6b8-4677-b1f5-87240de17a49 req-1b3143bb-422a-478c-9ac3-735e69136799 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f47e3dcd-6e44-411d-bf0c-3da0abda9f87", "tag": "7497c35e-755d-4147-af48-6844f85aeea6"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:38:13.490877 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-ff3fd152-c6b8-4677-b1f5-87240de17a49 req-1b3143bb-422a-478c-9ac3-735e69136799 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:13.491419 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-ff3fd152-c6b8-4677-b1f5-87240de17a49 req-1b3143bb-422a-478c-9ac3-735e69136799 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:13.492416 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-ff3fd152-c6b8-4677-b1f5-87240de17a49 req-1b3143bb-422a-478c-9ac3-735e69136799 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:13.504551 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-ff3fd152-c6b8-4677-b1f5-87240de17a49 req-1b3143bb-422a-478c-9ac3-735e69136799 service nova] Creating event network-changed:7497c35e-755d-4147-af48-6844f85aeea6 for instance f47e3dcd-6e44-411d-bf0c-3da0abda9f87 on n-h2-854247-14 Oct 17 13:38:13.509737 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-ff3fd152-c6b8-4677-b1f5-87240de17a49 req-1b3143bb-422a-478c-9ac3-735e69136799 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037917 Oct 17 13:38:13.510331 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 585/1146] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:38:13.515424 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-71e49f68-d657-4a14-a89c-e7e9de9db423 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:13.516119 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-71e49f68-d657-4a14-a89c-e7e9de9db423 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 8138c4a6-0fa5-4427-a026-56618461dd14] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:13.522857 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-71e49f68-d657-4a14-a89c-e7e9de9db423 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:13.523685 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-71e49f68-d657-4a14-a89c-e7e9de9db423 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:13.523992 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-71e49f68-d657-4a14-a89c-e7e9de9db423 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:13.524935 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-71e49f68-d657-4a14-a89c-e7e9de9db423 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:13.525143 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-71e49f68-d657-4a14-a89c-e7e9de9db423 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:13.525555 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-71e49f68-d657-4a14-a89c-e7e9de9db423 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:13.539497 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-71e49f68-d657-4a14-a89c-e7e9de9db423 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] HTTP exception thrown: Instance 8138c4a6-0fa5-4427-a026-56618461dd14 could not be found. Oct 17 13:38:13.541144 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-71e49f68-d657-4a14-a89c-e7e9de9db423 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Request method failure captured: Oct 17 13:38:13.541144 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/8138c4a6-0fa5-4427-a026-56618461dd14 HTTP/1.1 Oct 17 13:38:13.541144 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:38:13.541144 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:38:13.541144 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:38:13.541144 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:38:13.541144 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:38:13.541144 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:38:13.541144 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:38:13.541144 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:38:13.541144 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVn0rKCCzxL1KwIZI1Im8ygkuewY-UzF6Z81i6cNkagTk7ClET_LM7mvJkIi7s6pFyo0jkOjEfkZnFMR6ojJjeKHBwoksuv9Z4X8LYNw4iNhGgW8aAiE8QzHsCgl5CJTTDwKklbNcQOJJRXIUfAtc0cseQ_bknPsrUPdOoFAaQy0_jg Oct 17 13:38:13.541144 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:38:13.541144 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:38:13.541144 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:38:13.541144 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:38:13.541144 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:38:13.541144 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:38:13.541144 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: fa1db260a96a4c6aa69cd6437baab6f7 Oct 17 13:38:13.541144 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServersOnMultiNodesTest-1107099453 Oct 17 13:38:13.541144 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:38:13.541144 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:38:13.542463 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/fa1db260a96a4c6aa69cd6437baab6f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/fa1db260a96a4c6aa69cd6437baab6f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/fa1db260a96a4c6aa69cd6437baab6f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_fa1db260a96a4c6aa69cd6437baab6f7", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:38:13.542463 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServersOnMultiNodesTest-1107099453 Oct 17 13:38:13.542463 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: fa1db260a96a4c6aa69cd6437baab6f7 Oct 17 13:38:13.542463 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1107099453 Oct 17 13:38:13.542463 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServersOnMultiNodesTest-1107099453-project Oct 17 13:38:13.542463 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:38:13.542463 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:38:13.542463 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 7a7e082035084338966a1c56b30c7093 Oct 17 13:38:13.542463 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServersOnMultiNodesTest-1107099453-project Oct 17 13:38:13.542463 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:38:13.542463 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 8138c4a6-0fa5-4427-a026-56618461dd14 could not be found. Oct 17 13:38:13.542463 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '8138c4a6-0fa5-4427-a026-56618461dd14'} Oct 17 13:38:13.543613 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:38:13.543613 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:38:13.543613 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:38:13.543613 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:38:13.543613 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:38:13.543613 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:38:13.543613 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:38:13.543613 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:38:13.543613 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:38:13.543613 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:38:13.543613 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8138c4a6-0fa5-4427-a026-56618461dd14 could not be found. Oct 17 13:38:13.543613 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:38:13.543613 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:38:13.543613 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:38:13.543613 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:38:13.543613 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:38:13.543613 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:38:13.543613 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:38:13.543613 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:38:13.543613 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:38:13.544813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:38:13.544813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:38:13.544813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:38:13.544813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:38:13.544813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:38:13.544813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:38:13.544813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:38:13.544813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8138c4a6-0fa5-4427-a026-56618461dd14 could not be found. Oct 17 13:38:13.544813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:38:13.544813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:38:13.544813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:38:13.544813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:38:13.544813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:38:13.544813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:38:13.544813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:38:13.544813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:38:13.544813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8138c4a6-0fa5-4427-a026-56618461dd14 could not be found. Oct 17 13:38:13.544813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:38:13.545904 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-71e49f68-d657-4a14-a89c-e7e9de9db423 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Returning 404 to user: Instance 8138c4a6-0fa5-4427-a026-56618461dd14 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:38:13.545904 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-71e49f68-d657-4a14-a89c-e7e9de9db423 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/8138c4a6-0fa5-4427-a026-56618461dd14" status: 404 len: 111 microversion: 2.1 time: 0.031136 Oct 17 13:38:13.545904 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 586/1147] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:13 2022] GET /compute/v2.1/servers/8138c4a6-0fa5-4427-a026-56618461dd14 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:38:13.548680 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ccb3aa45-6abd-438f-b01b-61b6f5bf29d2 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:13.549362 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ccb3aa45-6abd-438f-b01b-61b6f5bf29d2 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 298b0f19-0a0c-4304-bb8b-4bd26cce2d9d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:13.555212 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ccb3aa45-6abd-438f-b01b-61b6f5bf29d2 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:13.555738 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ccb3aa45-6abd-438f-b01b-61b6f5bf29d2 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:13.556186 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ccb3aa45-6abd-438f-b01b-61b6f5bf29d2 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:13.556851 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ccb3aa45-6abd-438f-b01b-61b6f5bf29d2 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:13.557309 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ccb3aa45-6abd-438f-b01b-61b6f5bf29d2 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:13.557725 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ccb3aa45-6abd-438f-b01b-61b6f5bf29d2 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:13.635874 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e6200e7d-16d6-4125-9c33-4762fc94358c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:13.645424 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e6200e7d-16d6-4125-9c33-4762fc94358c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:13.646880 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e6200e7d-16d6-4125-9c33-4762fc94358c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:13.648091 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e6200e7d-16d6-4125-9c33-4762fc94358c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4" status: 200 len: 1568 microversion: 2.25 time: 0.483555 Oct 17 13:38:13.648775 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 562/1148] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:38:13 2022] GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4 => generated 1568 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:38:13.653568 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-aa6550ca-54f7-4fdf-bbaa-7d6c22a1445c tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:13.654062 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-aa6550ca-54f7-4fdf-bbaa-7d6c22a1445c tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: ec948255-c8e9-4450-95d5-42f38b9afe45] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:13.660336 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aa6550ca-54f7-4fdf-bbaa-7d6c22a1445c tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:13.660753 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aa6550ca-54f7-4fdf-bbaa-7d6c22a1445c tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:13.661187 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aa6550ca-54f7-4fdf-bbaa-7d6c22a1445c tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:13.661893 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aa6550ca-54f7-4fdf-bbaa-7d6c22a1445c tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:13.662344 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aa6550ca-54f7-4fdf-bbaa-7d6c22a1445c tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:13.662749 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aa6550ca-54f7-4fdf-bbaa-7d6c22a1445c tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:13.670996 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ccb3aa45-6abd-438f-b01b-61b6f5bf29d2 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:13.679217 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ccb3aa45-6abd-438f-b01b-61b6f5bf29d2 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/298b0f19-0a0c-4304-bb8b-4bd26cce2d9d" status: 200 len: 1282 microversion: 2.1 time: 0.134972 Oct 17 13:38:13.680109 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 587/1149] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:13 2022] GET /compute/v2.1/servers/298b0f19-0a0c-4304-bb8b-4bd26cce2d9d => generated 1282 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:13.690245 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-aa6550ca-54f7-4fdf-bbaa-7d6c22a1445c tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: ec948255-c8e9-4450-95d5-42f38b9afe45] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:38:13.769283 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-aa6550ca-54f7-4fdf-bbaa-7d6c22a1445c tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "DELETE /compute/v2.1/servers/ec948255-c8e9-4450-95d5-42f38b9afe45" status: 204 len: 0 microversion: 2.1 time: 0.119212 Oct 17 13:38:13.770129 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 563/1150] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:38:13 2022] DELETE /compute/v2.1/servers/ec948255-c8e9-4450-95d5-42f38b9afe45 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:38:13.778185 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-70bb0b19-3b6e-483f-a6d8-aaf53eb48361 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:13.778688 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-70bb0b19-3b6e-483f-a6d8-aaf53eb48361 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 4d242145-87ff-473a-bac2-fdd483fb5863] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:13.784824 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70bb0b19-3b6e-483f-a6d8-aaf53eb48361 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:13.785532 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70bb0b19-3b6e-483f-a6d8-aaf53eb48361 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:13.786037 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70bb0b19-3b6e-483f-a6d8-aaf53eb48361 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:13.786880 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70bb0b19-3b6e-483f-a6d8-aaf53eb48361 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:13.787670 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70bb0b19-3b6e-483f-a6d8-aaf53eb48361 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:13.788369 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70bb0b19-3b6e-483f-a6d8-aaf53eb48361 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:13.815486 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-70bb0b19-3b6e-483f-a6d8-aaf53eb48361 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 4d242145-87ff-473a-bac2-fdd483fb5863] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:38:13.866325 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-b23cc6be-57bb-4224-a149-e8b7ee137b6f req-48aae255-36a3-45a4-b615-869e777ee451 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a54adf11-ee58-4f13-82c8-9a00a36c536e", "name": "network-vif-unplugged", "status": "completed", "tag": "f261c54a-cf39-4ca3-a4d0-eb2c41dbcbe0"}, {"name": "network-changed", "server_uuid": "a54adf11-ee58-4f13-82c8-9a00a36c536e", "tag": "f261c54a-cf39-4ca3-a4d0-eb2c41dbcbe0"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:38:13.876450 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-b23cc6be-57bb-4224-a149-e8b7ee137b6f req-48aae255-36a3-45a4-b615-869e777ee451 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:13.877015 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-b23cc6be-57bb-4224-a149-e8b7ee137b6f req-48aae255-36a3-45a4-b615-869e777ee451 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:13.877524 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-b23cc6be-57bb-4224-a149-e8b7ee137b6f req-48aae255-36a3-45a4-b615-869e777ee451 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:13.881631 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:38:13.889946 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-b23cc6be-57bb-4224-a149-e8b7ee137b6f req-48aae255-36a3-45a4-b615-869e777ee451 service nova] Creating event network-vif-unplugged:f261c54a-cf39-4ca3-a4d0-eb2c41dbcbe0 for instance a54adf11-ee58-4f13-82c8-9a00a36c536e on n-h1-854247-14 Oct 17 13:38:13.890439 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-b23cc6be-57bb-4224-a149-e8b7ee137b6f req-48aae255-36a3-45a4-b615-869e777ee451 service nova] Creating event network-changed:f261c54a-cf39-4ca3-a4d0-eb2c41dbcbe0 for instance a54adf11-ee58-4f13-82c8-9a00a36c536e on n-h1-854247-14 Oct 17 13:38:13.895886 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-b23cc6be-57bb-4224-a149-e8b7ee137b6f req-48aae255-36a3-45a4-b615-869e777ee451 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.033495 Oct 17 13:38:13.896794 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 564/1151] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:38:13.912928 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-70bb0b19-3b6e-483f-a6d8-aaf53eb48361 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "DELETE /compute/v2.1/servers/4d242145-87ff-473a-bac2-fdd483fb5863" status: 204 len: 0 microversion: 2.1 time: 0.138440 Oct 17 13:38:13.913538 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 588/1152] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:38:13 2022] DELETE /compute/v2.1/servers/4d242145-87ff-473a-bac2-fdd483fb5863 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 13:38:13.926774 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a633e2d2-ea6a-4d9c-bcc9-43def54c2527 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:13.928239 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a633e2d2-ea6a-4d9c-bcc9-43def54c2527 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: ec948255-c8e9-4450-95d5-42f38b9afe45] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:13.945660 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a633e2d2-ea6a-4d9c-bcc9-43def54c2527 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:13.946366 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a633e2d2-ea6a-4d9c-bcc9-43def54c2527 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:13.947009 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a633e2d2-ea6a-4d9c-bcc9-43def54c2527 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:13.947764 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a633e2d2-ea6a-4d9c-bcc9-43def54c2527 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:13.948381 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a633e2d2-ea6a-4d9c-bcc9-43def54c2527 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:13.949842 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a633e2d2-ea6a-4d9c-bcc9-43def54c2527 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:13.975142 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bf05ecf4-3da6-442b-886d-0f2a671d27d9 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:13.976238 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-bf05ecf4-3da6-442b-886d-0f2a671d27d9 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: f47e3dcd-6e44-411d-bf0c-3da0abda9f87] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:13.983337 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bf05ecf4-3da6-442b-886d-0f2a671d27d9 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:13.983832 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bf05ecf4-3da6-442b-886d-0f2a671d27d9 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:13.984272 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bf05ecf4-3da6-442b-886d-0f2a671d27d9 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:13.984982 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bf05ecf4-3da6-442b-886d-0f2a671d27d9 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:13.985435 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bf05ecf4-3da6-442b-886d-0f2a671d27d9 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:13.986109 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bf05ecf4-3da6-442b-886d-0f2a671d27d9 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:14.221060 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a633e2d2-ea6a-4d9c-bcc9-43def54c2527 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:14.230092 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a633e2d2-ea6a-4d9c-bcc9-43def54c2527 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/ec948255-c8e9-4450-95d5-42f38b9afe45" status: 200 len: 1474 microversion: 2.1 time: 0.310863 Oct 17 13:38:14.236185 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 565/1153] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:13 2022] GET /compute/v2.1/servers/ec948255-c8e9-4450-95d5-42f38b9afe45 => generated 1474 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:14.241813 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8b88a0fc-d30b-43c2-986b-94ffdc1a1ff0 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:14.242646 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8b88a0fc-d30b-43c2-986b-94ffdc1a1ff0 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: ae587603-994d-419d-979a-1b1361144872] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:14.251499 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8b88a0fc-d30b-43c2-986b-94ffdc1a1ff0 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:14.252128 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8b88a0fc-d30b-43c2-986b-94ffdc1a1ff0 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:14.252464 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8b88a0fc-d30b-43c2-986b-94ffdc1a1ff0 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:14.253170 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8b88a0fc-d30b-43c2-986b-94ffdc1a1ff0 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:14.253621 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8b88a0fc-d30b-43c2-986b-94ffdc1a1ff0 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:14.254253 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8b88a0fc-d30b-43c2-986b-94ffdc1a1ff0 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:14.259219 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-bf05ecf4-3da6-442b-886d-0f2a671d27d9 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:14.269728 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-bf05ecf4-3da6-442b-886d-0f2a671d27d9 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/f47e3dcd-6e44-411d-bf0c-3da0abda9f87" status: 200 len: 1314 microversion: 2.1 time: 0.299251 Oct 17 13:38:14.271323 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 589/1154] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:13 2022] GET /compute/v2.1/servers/f47e3dcd-6e44-411d-bf0c-3da0abda9f87 => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:38:14.447157 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8b88a0fc-d30b-43c2-986b-94ffdc1a1ff0 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:14.456092 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8b88a0fc-d30b-43c2-986b-94ffdc1a1ff0 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872" status: 200 len: 1497 microversion: 2.1 time: 0.218560 Oct 17 13:38:14.457013 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 566/1155] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:14 2022] GET /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872 => generated 1497 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:14.488419 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-59a85a72-4193-46fa-a56a-8b2d270ad1b6 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:14.488685 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-59a85a72-4193-46fa-a56a-8b2d270ad1b6 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: a54adf11-ee58-4f13-82c8-9a00a36c536e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:14.503245 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-59a85a72-4193-46fa-a56a-8b2d270ad1b6 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:14.505038 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-59a85a72-4193-46fa-a56a-8b2d270ad1b6 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:14.505585 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-59a85a72-4193-46fa-a56a-8b2d270ad1b6 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:14.506426 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-59a85a72-4193-46fa-a56a-8b2d270ad1b6 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:14.506969 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-59a85a72-4193-46fa-a56a-8b2d270ad1b6 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:14.507513 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-59a85a72-4193-46fa-a56a-8b2d270ad1b6 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:14.539033 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=4 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:38:14.675678 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-50ced06f-3f28-4703-9016-932002d5c8e3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:14.677629 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-50ced06f-3f28-4703-9016-932002d5c8e3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 0ffbef37-e5f8-4de2-a29d-dba6782a3fe4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:14.686094 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-50ced06f-3f28-4703-9016-932002d5c8e3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:14.687253 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-50ced06f-3f28-4703-9016-932002d5c8e3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:14.687940 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-50ced06f-3f28-4703-9016-932002d5c8e3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:14.688751 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-50ced06f-3f28-4703-9016-932002d5c8e3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:14.689332 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-50ced06f-3f28-4703-9016-932002d5c8e3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:14.690227 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-50ced06f-3f28-4703-9016-932002d5c8e3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:14.828472 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-59a85a72-4193-46fa-a56a-8b2d270ad1b6 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:14.838100 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-59a85a72-4193-46fa-a56a-8b2d270ad1b6 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e" status: 200 len: 1714 microversion: 2.1 time: 0.354381 Oct 17 13:38:14.838943 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 590/1156] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:14 2022] GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e => generated 1714 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:14.854200 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b4cfc908-fe73-462a-8409-9e81fa107392 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:14.855116 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b4cfc908-fe73-462a-8409-9e81fa107392 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 298b0f19-0a0c-4304-bb8b-4bd26cce2d9d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:14.861275 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b4cfc908-fe73-462a-8409-9e81fa107392 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:14.861747 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b4cfc908-fe73-462a-8409-9e81fa107392 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:14.862174 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b4cfc908-fe73-462a-8409-9e81fa107392 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:14.862918 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b4cfc908-fe73-462a-8409-9e81fa107392 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:14.863394 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b4cfc908-fe73-462a-8409-9e81fa107392 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:14.863830 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b4cfc908-fe73-462a-8409-9e81fa107392 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:14.986700 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-50ced06f-3f28-4703-9016-932002d5c8e3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:15.003767 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-50ced06f-3f28-4703-9016-932002d5c8e3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:15.005800 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-50ced06f-3f28-4703-9016-932002d5c8e3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:15.010250 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-50ced06f-3f28-4703-9016-932002d5c8e3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4" status: 200 len: 1568 microversion: 2.25 time: 0.336213 Oct 17 13:38:15.015735 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 567/1157] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:38:14 2022] GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4 => generated 1568 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:38:15.160066 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b4cfc908-fe73-462a-8409-9e81fa107392 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:15.174405 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b4cfc908-fe73-462a-8409-9e81fa107392 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/298b0f19-0a0c-4304-bb8b-4bd26cce2d9d" status: 200 len: 1324 microversion: 2.1 time: 0.324460 Oct 17 13:38:15.185063 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 591/1158] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:14 2022] GET /compute/v2.1/servers/298b0f19-0a0c-4304-bb8b-4bd26cce2d9d => generated 1324 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:15.254149 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5f6cb642-380f-4333-9a12-4a1ac79d577d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:15.254941 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5f6cb642-380f-4333-9a12-4a1ac79d577d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: ec948255-c8e9-4450-95d5-42f38b9afe45] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:15.268364 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5f6cb642-380f-4333-9a12-4a1ac79d577d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:15.269254 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5f6cb642-380f-4333-9a12-4a1ac79d577d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:15.269974 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5f6cb642-380f-4333-9a12-4a1ac79d577d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:15.273147 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5f6cb642-380f-4333-9a12-4a1ac79d577d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:15.274086 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5f6cb642-380f-4333-9a12-4a1ac79d577d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:15.274669 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5f6cb642-380f-4333-9a12-4a1ac79d577d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:15.298509 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e49664ee-2dd4-4aa5-ad9b-cae5dfaa5d83 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:15.299972 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e49664ee-2dd4-4aa5-ad9b-cae5dfaa5d83 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: f47e3dcd-6e44-411d-bf0c-3da0abda9f87] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:15.316922 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e49664ee-2dd4-4aa5-ad9b-cae5dfaa5d83 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:15.317468 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e49664ee-2dd4-4aa5-ad9b-cae5dfaa5d83 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:15.317923 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e49664ee-2dd4-4aa5-ad9b-cae5dfaa5d83 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:15.318656 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e49664ee-2dd4-4aa5-ad9b-cae5dfaa5d83 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:15.319115 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e49664ee-2dd4-4aa5-ad9b-cae5dfaa5d83 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:15.324046 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e49664ee-2dd4-4aa5-ad9b-cae5dfaa5d83 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:16.144562 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e49664ee-2dd4-4aa5-ad9b-cae5dfaa5d83 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:16.150715 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5f6cb642-380f-4333-9a12-4a1ac79d577d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:16.154281 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e49664ee-2dd4-4aa5-ad9b-cae5dfaa5d83 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/f47e3dcd-6e44-411d-bf0c-3da0abda9f87" status: 200 len: 1314 microversion: 2.1 time: 0.863134 Oct 17 13:38:16.155304 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 592/1159] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:15 2022] GET /compute/v2.1/servers/f47e3dcd-6e44-411d-bf0c-3da0abda9f87 => generated 1314 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:38:16.161666 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-79f2c50c-21cd-455a-ae48-b16c8f9ad13a tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:16.162963 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5f6cb642-380f-4333-9a12-4a1ac79d577d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/ec948255-c8e9-4450-95d5-42f38b9afe45" status: 200 len: 1474 microversion: 2.1 time: 0.911895 Oct 17 13:38:16.163118 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-79f2c50c-21cd-455a-ae48-b16c8f9ad13a tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: ae587603-994d-419d-979a-1b1361144872] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:16.164325 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 568/1160] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:15 2022] GET /compute/v2.1/servers/ec948255-c8e9-4450-95d5-42f38b9afe45 => generated 1474 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:16.170551 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-8452d69f-cafd-417c-a202-693e45001b4e req-897075b8-1559-49b6-b763-5214c1b3a5f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8d15c7c-7a1f-43e0-9c41-302172f31ca0", "tag": "6b4af2c6-531c-4352-bbe4-6c4df4387bbf"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:38:16.181370 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-8452d69f-cafd-417c-a202-693e45001b4e req-897075b8-1559-49b6-b763-5214c1b3a5f6 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:16.182051 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-8452d69f-cafd-417c-a202-693e45001b4e req-897075b8-1559-49b6-b763-5214c1b3a5f6 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:16.182602 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-8452d69f-cafd-417c-a202-693e45001b4e req-897075b8-1559-49b6-b763-5214c1b3a5f6 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:16.189030 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-79f2c50c-21cd-455a-ae48-b16c8f9ad13a tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:16.190289 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-79f2c50c-21cd-455a-ae48-b16c8f9ad13a tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:16.190947 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-79f2c50c-21cd-455a-ae48-b16c8f9ad13a tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:16.192018 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-79f2c50c-21cd-455a-ae48-b16c8f9ad13a tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:16.192693 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-79f2c50c-21cd-455a-ae48-b16c8f9ad13a tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:16.193328 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-79f2c50c-21cd-455a-ae48-b16c8f9ad13a tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:16.199127 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-8452d69f-cafd-417c-a202-693e45001b4e req-897075b8-1559-49b6-b763-5214c1b3a5f6 service nova] Creating event network-changed:6b4af2c6-531c-4352-bbe4-6c4df4387bbf for instance b8d15c7c-7a1f-43e0-9c41-302172f31ca0 on n-h2-854247-14 Oct 17 13:38:16.206329 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-8452d69f-cafd-417c-a202-693e45001b4e req-897075b8-1559-49b6-b763-5214c1b3a5f6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040405 Oct 17 13:38:16.206936 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 569/1161] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:38:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:38:16.214658 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2094ee39-acab-420f-ad53-f5ff7782b773 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:16.216698 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2094ee39-acab-420f-ad53-f5ff7782b773 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: a54adf11-ee58-4f13-82c8-9a00a36c536e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:16.223706 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2094ee39-acab-420f-ad53-f5ff7782b773 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:16.224392 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2094ee39-acab-420f-ad53-f5ff7782b773 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:16.224964 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2094ee39-acab-420f-ad53-f5ff7782b773 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:16.225827 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2094ee39-acab-420f-ad53-f5ff7782b773 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:16.226540 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2094ee39-acab-420f-ad53-f5ff7782b773 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:16.227013 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2094ee39-acab-420f-ad53-f5ff7782b773 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:16.544614 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-79f2c50c-21cd-455a-ae48-b16c8f9ad13a tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:16.553459 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-79f2c50c-21cd-455a-ae48-b16c8f9ad13a tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872" status: 200 len: 1497 microversion: 2.1 time: 0.396378 Oct 17 13:38:16.554026 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 593/1162] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:16 2022] GET /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872 => generated 1497 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:16.558641 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-022c22ba-9c7b-4a61-8212-5b6a5e5d83a7 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:16.559270 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-022c22ba-9c7b-4a61-8212-5b6a5e5d83a7 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 0ffbef37-e5f8-4de2-a29d-dba6782a3fe4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:16.565656 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-022c22ba-9c7b-4a61-8212-5b6a5e5d83a7 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:16.566145 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-022c22ba-9c7b-4a61-8212-5b6a5e5d83a7 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:16.566577 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-022c22ba-9c7b-4a61-8212-5b6a5e5d83a7 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:16.567290 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-022c22ba-9c7b-4a61-8212-5b6a5e5d83a7 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:16.567739 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-022c22ba-9c7b-4a61-8212-5b6a5e5d83a7 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:16.568155 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-022c22ba-9c7b-4a61-8212-5b6a5e5d83a7 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:16.605057 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2094ee39-acab-420f-ad53-f5ff7782b773 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:16.615200 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2094ee39-acab-420f-ad53-f5ff7782b773 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e" status: 200 len: 1714 microversion: 2.1 time: 0.405424 Oct 17 13:38:16.615684 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 570/1163] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:16 2022] GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e => generated 1714 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:16.621795 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-bf4e2342-ca27-48ce-8146-17f2bd6ce269 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:16.622696 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-bf4e2342-ca27-48ce-8146-17f2bd6ce269 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 298b0f19-0a0c-4304-bb8b-4bd26cce2d9d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:16.624714 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:38:16.630280 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bf4e2342-ca27-48ce-8146-17f2bd6ce269 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:16.630579 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bf4e2342-ca27-48ce-8146-17f2bd6ce269 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:16.631287 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bf4e2342-ca27-48ce-8146-17f2bd6ce269 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:16.632703 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bf4e2342-ca27-48ce-8146-17f2bd6ce269 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:16.633694 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bf4e2342-ca27-48ce-8146-17f2bd6ce269 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:16.634359 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bf4e2342-ca27-48ce-8146-17f2bd6ce269 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:16.875953 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-022c22ba-9c7b-4a61-8212-5b6a5e5d83a7 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:16.885490 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-022c22ba-9c7b-4a61-8212-5b6a5e5d83a7 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:16.886922 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-022c22ba-9c7b-4a61-8212-5b6a5e5d83a7 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:16.888119 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-022c22ba-9c7b-4a61-8212-5b6a5e5d83a7 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4" status: 200 len: 1568 microversion: 2.25 time: 0.333144 Oct 17 13:38:16.903190 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 594/1164] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:38:16 2022] GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4 => generated 1568 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:38:16.906159 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-bf4e2342-ca27-48ce-8146-17f2bd6ce269 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:16.916134 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-bf4e2342-ca27-48ce-8146-17f2bd6ce269 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/298b0f19-0a0c-4304-bb8b-4bd26cce2d9d" status: 200 len: 1324 microversion: 2.1 time: 0.299172 Oct 17 13:38:16.916843 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 571/1165] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:16 2022] GET /compute/v2.1/servers/298b0f19-0a0c-4304-bb8b-4bd26cce2d9d => generated 1324 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:17.182922 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-540428ae-ec0c-4aab-8a53-aacb24e0a3db tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:17.184425 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-540428ae-ec0c-4aab-8a53-aacb24e0a3db tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: f47e3dcd-6e44-411d-bf0c-3da0abda9f87] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:17.190015 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8a59e4b7-7560-4b5c-ae33-060638fc5aa8 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:17.190634 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8a59e4b7-7560-4b5c-ae33-060638fc5aa8 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: ec948255-c8e9-4450-95d5-42f38b9afe45] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:17.201949 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-540428ae-ec0c-4aab-8a53-aacb24e0a3db tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:17.202442 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-540428ae-ec0c-4aab-8a53-aacb24e0a3db tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:17.202880 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-540428ae-ec0c-4aab-8a53-aacb24e0a3db tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:17.203681 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-540428ae-ec0c-4aab-8a53-aacb24e0a3db tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:17.204078 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-540428ae-ec0c-4aab-8a53-aacb24e0a3db tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:17.204498 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-540428ae-ec0c-4aab-8a53-aacb24e0a3db tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:17.210344 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8a59e4b7-7560-4b5c-ae33-060638fc5aa8 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:17.210838 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8a59e4b7-7560-4b5c-ae33-060638fc5aa8 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:17.211345 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8a59e4b7-7560-4b5c-ae33-060638fc5aa8 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:17.213338 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8a59e4b7-7560-4b5c-ae33-060638fc5aa8 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:17.213800 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8a59e4b7-7560-4b5c-ae33-060638fc5aa8 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:17.214226 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8a59e4b7-7560-4b5c-ae33-060638fc5aa8 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:17.583921 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8a59e4b7-7560-4b5c-ae33-060638fc5aa8 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:17.592679 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8a59e4b7-7560-4b5c-ae33-060638fc5aa8 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/ec948255-c8e9-4450-95d5-42f38b9afe45" status: 200 len: 1474 microversion: 2.1 time: 0.406731 Oct 17 13:38:17.603309 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 572/1166] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:17 2022] GET /compute/v2.1/servers/ec948255-c8e9-4450-95d5-42f38b9afe45 => generated 1474 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:38:17.607909 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-591d70de-07b6-46ff-b2b3-08ab9d5701aa tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:17.612378 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-591d70de-07b6-46ff-b2b3-08ab9d5701aa tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: ae587603-994d-419d-979a-1b1361144872] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:17.620222 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-540428ae-ec0c-4aab-8a53-aacb24e0a3db tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:17.626274 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-591d70de-07b6-46ff-b2b3-08ab9d5701aa tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:17.629577 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-540428ae-ec0c-4aab-8a53-aacb24e0a3db tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/f47e3dcd-6e44-411d-bf0c-3da0abda9f87" status: 200 len: 1314 microversion: 2.1 time: 0.453027 Oct 17 13:38:17.643262 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-591d70de-07b6-46ff-b2b3-08ab9d5701aa tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:17.643262 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-591d70de-07b6-46ff-b2b3-08ab9d5701aa tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:17.643262 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-591d70de-07b6-46ff-b2b3-08ab9d5701aa tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:17.643262 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-591d70de-07b6-46ff-b2b3-08ab9d5701aa tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:17.643704 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-591d70de-07b6-46ff-b2b3-08ab9d5701aa tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:17.645043 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 595/1167] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:17 2022] GET /compute/v2.1/servers/f47e3dcd-6e44-411d-bf0c-3da0abda9f87 => generated 1314 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:17.660647 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-9db59502-c286-4a0a-9303-9ca701e92074 req-654505bd-7a48-4ef9-a963-2eb79f916c2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f47e3dcd-6e44-411d-bf0c-3da0abda9f87", "name": "network-vif-plugged", "status": "completed", "tag": "7497c35e-755d-4147-af48-6844f85aeea6"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:38:17.686388 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-9db59502-c286-4a0a-9303-9ca701e92074 req-654505bd-7a48-4ef9-a963-2eb79f916c2a service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:17.687365 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-9db59502-c286-4a0a-9303-9ca701e92074 req-654505bd-7a48-4ef9-a963-2eb79f916c2a service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:17.691484 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-9db59502-c286-4a0a-9303-9ca701e92074 req-654505bd-7a48-4ef9-a963-2eb79f916c2a service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:17.710483 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-9db59502-c286-4a0a-9303-9ca701e92074 req-654505bd-7a48-4ef9-a963-2eb79f916c2a service nova] Creating event network-vif-plugged:7497c35e-755d-4147-af48-6844f85aeea6 for instance f47e3dcd-6e44-411d-bf0c-3da0abda9f87 on n-h2-854247-14 Oct 17 13:38:17.719139 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-9db59502-c286-4a0a-9303-9ca701e92074 req-654505bd-7a48-4ef9-a963-2eb79f916c2a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067016 Oct 17 13:38:17.722522 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 596/1168] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:38:17.739364 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8987fb99-6c3d-40b5-8618-0608a2e604e0 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:17.740892 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8987fb99-6c3d-40b5-8618-0608a2e604e0 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: a54adf11-ee58-4f13-82c8-9a00a36c536e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:17.747888 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8987fb99-6c3d-40b5-8618-0608a2e604e0 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:17.749325 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8987fb99-6c3d-40b5-8618-0608a2e604e0 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:17.750021 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8987fb99-6c3d-40b5-8618-0608a2e604e0 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:17.750945 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8987fb99-6c3d-40b5-8618-0608a2e604e0 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:17.751654 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8987fb99-6c3d-40b5-8618-0608a2e604e0 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:17.752296 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8987fb99-6c3d-40b5-8618-0608a2e604e0 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:17.820855 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=20 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:38:18.143649 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-591d70de-07b6-46ff-b2b3-08ab9d5701aa tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:18.147341 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8987fb99-6c3d-40b5-8618-0608a2e604e0 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:18.154642 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-591d70de-07b6-46ff-b2b3-08ab9d5701aa tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872" status: 200 len: 1497 microversion: 2.1 time: 0.554392 Oct 17 13:38:18.156580 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8987fb99-6c3d-40b5-8618-0608a2e604e0 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e" status: 200 len: 1714 microversion: 2.1 time: 0.432923 Oct 17 13:38:18.157671 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 597/1169] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:17 2022] GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e => generated 1714 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:18.163949 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f37e8547-ead0-438f-b50f-fd1bee8e64a6 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:18.164807 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f37e8547-ead0-438f-b50f-fd1bee8e64a6 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 0ffbef37-e5f8-4de2-a29d-dba6782a3fe4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:18.170574 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:38:18.172846 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 573/1170] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:17 2022] GET /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872 => generated 1497 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:18.178366 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-07ef89c0-14f8-4fc7-bc30-9c16bbfc3af0 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:18.179147 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-07ef89c0-14f8-4fc7-bc30-9c16bbfc3af0 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 298b0f19-0a0c-4304-bb8b-4bd26cce2d9d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:18.183737 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f37e8547-ead0-438f-b50f-fd1bee8e64a6 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:18.187385 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-07ef89c0-14f8-4fc7-bc30-9c16bbfc3af0 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:18.187702 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f37e8547-ead0-438f-b50f-fd1bee8e64a6 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:18.188283 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f37e8547-ead0-438f-b50f-fd1bee8e64a6 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:18.188909 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-07ef89c0-14f8-4fc7-bc30-9c16bbfc3af0 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:18.189521 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-07ef89c0-14f8-4fc7-bc30-9c16bbfc3af0 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:18.189715 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f37e8547-ead0-438f-b50f-fd1bee8e64a6 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:18.190417 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f37e8547-ead0-438f-b50f-fd1bee8e64a6 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:18.190717 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-07ef89c0-14f8-4fc7-bc30-9c16bbfc3af0 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:18.191146 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f37e8547-ead0-438f-b50f-fd1bee8e64a6 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:18.191804 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-07ef89c0-14f8-4fc7-bc30-9c16bbfc3af0 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:18.193107 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-07ef89c0-14f8-4fc7-bc30-9c16bbfc3af0 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:18.563742 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-07ef89c0-14f8-4fc7-bc30-9c16bbfc3af0 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:18.575757 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-07ef89c0-14f8-4fc7-bc30-9c16bbfc3af0 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/298b0f19-0a0c-4304-bb8b-4bd26cce2d9d" status: 200 len: 1324 microversion: 2.1 time: 0.401348 Oct 17 13:38:18.576339 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 574/1171] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:18 2022] GET /compute/v2.1/servers/298b0f19-0a0c-4304-bb8b-4bd26cce2d9d => generated 1324 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:18.580973 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-211e4aa1-706e-46e7-99ec-dc6179cfe9ec req-45cddfc4-77e7-4320-939c-60dfc6c75c6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "298b0f19-0a0c-4304-bb8b-4bd26cce2d9d", "tag": "1b002cb5-02b8-45df-a6b3-cb4130290727"}, {"server_uuid": "4d242145-87ff-473a-bac2-fdd483fb5863", "name": "network-vif-deleted", "tag": "a9ccbd26-cae4-415a-95db-3c249567971a"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:38:18.597890 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-211e4aa1-706e-46e7-99ec-dc6179cfe9ec req-45cddfc4-77e7-4320-939c-60dfc6c75c6a service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:18.598372 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-211e4aa1-706e-46e7-99ec-dc6179cfe9ec req-45cddfc4-77e7-4320-939c-60dfc6c75c6a service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:18.598799 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-211e4aa1-706e-46e7-99ec-dc6179cfe9ec req-45cddfc4-77e7-4320-939c-60dfc6c75c6a service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:18.599386 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f37e8547-ead0-438f-b50f-fd1bee8e64a6 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:18.605472 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:38:18.612749 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-211e4aa1-706e-46e7-99ec-dc6179cfe9ec req-45cddfc4-77e7-4320-939c-60dfc6c75c6a service nova] Creating event network-changed:1b002cb5-02b8-45df-a6b3-cb4130290727 for instance 298b0f19-0a0c-4304-bb8b-4bd26cce2d9d on n-h2-854247-14 Oct 17 13:38:18.613412 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-211e4aa1-706e-46e7-99ec-dc6179cfe9ec req-45cddfc4-77e7-4320-939c-60dfc6c75c6a service nova] Creating event network-vif-deleted:a9ccbd26-cae4-415a-95db-3c249567971a for instance 4d242145-87ff-473a-bac2-fdd483fb5863 on n-h1-854247-14 Oct 17 13:38:18.625044 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-211e4aa1-706e-46e7-99ec-dc6179cfe9ec req-45cddfc4-77e7-4320-939c-60dfc6c75c6a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.047053 Oct 17 13:38:18.626363 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 575/1172] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:38:18 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:38:18.630156 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f37e8547-ead0-438f-b50f-fd1bee8e64a6 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:18.632017 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f37e8547-ead0-438f-b50f-fd1bee8e64a6 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:18.633687 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-9e09ca53-fa2a-48c2-accf-9d37da884c1f req-9558656c-7882-4964-959a-c107ccb5f2db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec948255-c8e9-4450-95d5-42f38b9afe45", "name": "network-vif-deleted", "tag": "a94b07bc-c09e-4eea-90ac-84ce6048959b"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:38:18.645109 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f37e8547-ead0-438f-b50f-fd1bee8e64a6 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4" status: 200 len: 1568 microversion: 2.25 time: 0.486050 Oct 17 13:38:18.645923 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-9e09ca53-fa2a-48c2-accf-9d37da884c1f req-9558656c-7882-4964-959a-c107ccb5f2db service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:18.646627 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-9e09ca53-fa2a-48c2-accf-9d37da884c1f req-9558656c-7882-4964-959a-c107ccb5f2db service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:18.647138 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 598/1173] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:38:18 2022] GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4 => generated 1568 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:38:18.648211 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-9e09ca53-fa2a-48c2-accf-9d37da884c1f req-9558656c-7882-4964-959a-c107ccb5f2db service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:18.656014 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c32c2417-c6dd-42c8-acc7-ffc76ee4962b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:18.656962 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c32c2417-c6dd-42c8-acc7-ffc76ee4962b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: ec948255-c8e9-4450-95d5-42f38b9afe45] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:18.666068 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c32c2417-c6dd-42c8-acc7-ffc76ee4962b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:18.667190 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c32c2417-c6dd-42c8-acc7-ffc76ee4962b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:18.667865 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c32c2417-c6dd-42c8-acc7-ffc76ee4962b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:18.668887 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c32c2417-c6dd-42c8-acc7-ffc76ee4962b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:18.669776 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c32c2417-c6dd-42c8-acc7-ffc76ee4962b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:18.670439 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c32c2417-c6dd-42c8-acc7-ffc76ee4962b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:18.671455 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-9e09ca53-fa2a-48c2-accf-9d37da884c1f req-9558656c-7882-4964-959a-c107ccb5f2db service nova] Creating event network-vif-deleted:a94b07bc-c09e-4eea-90ac-84ce6048959b for instance ec948255-c8e9-4450-95d5-42f38b9afe45 on n-h2-854247-14 Oct 17 13:38:18.680667 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-9e09ca53-fa2a-48c2-accf-9d37da884c1f req-9558656c-7882-4964-959a-c107ccb5f2db service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052216 Oct 17 13:38:18.684626 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 576/1174] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:38:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:38:18.690283 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-35493f2e-c4ce-4590-be08-2bc0cdaff833 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:18.691237 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-35493f2e-c4ce-4590-be08-2bc0cdaff833 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: f47e3dcd-6e44-411d-bf0c-3da0abda9f87] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:18.699881 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-35493f2e-c4ce-4590-be08-2bc0cdaff833 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:18.700652 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-35493f2e-c4ce-4590-be08-2bc0cdaff833 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:18.701236 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-35493f2e-c4ce-4590-be08-2bc0cdaff833 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:18.702831 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-35493f2e-c4ce-4590-be08-2bc0cdaff833 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:18.703489 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-35493f2e-c4ce-4590-be08-2bc0cdaff833 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:18.704064 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-35493f2e-c4ce-4590-be08-2bc0cdaff833 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:18.756492 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c32c2417-c6dd-42c8-acc7-ffc76ee4962b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:18.768478 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c32c2417-c6dd-42c8-acc7-ffc76ee4962b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/ec948255-c8e9-4450-95d5-42f38b9afe45" status: 200 len: 1303 microversion: 2.1 time: 0.119785 Oct 17 13:38:18.769709 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 599/1175] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:18 2022] GET /compute/v2.1/servers/ec948255-c8e9-4450-95d5-42f38b9afe45 => generated 1303 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:18.858386 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-35493f2e-c4ce-4590-be08-2bc0cdaff833 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:18.866602 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-35493f2e-c4ce-4590-be08-2bc0cdaff833 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/f47e3dcd-6e44-411d-bf0c-3da0abda9f87" status: 200 len: 1314 microversion: 2.1 time: 0.180793 Oct 17 13:38:18.867199 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 577/1176] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:18 2022] GET /compute/v2.1/servers/f47e3dcd-6e44-411d-bf0c-3da0abda9f87 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:19.185344 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6b9ed7c2-f80c-4cc2-89ed-42b0bb0997f4 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:19.187725 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c130cec2-4f2a-442d-a4b1-6e5d3a19ef5a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:19.188588 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6b9ed7c2-f80c-4cc2-89ed-42b0bb0997f4 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: ae587603-994d-419d-979a-1b1361144872] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:19.189357 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c130cec2-4f2a-442d-a4b1-6e5d3a19ef5a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: a54adf11-ee58-4f13-82c8-9a00a36c536e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:19.203822 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c130cec2-4f2a-442d-a4b1-6e5d3a19ef5a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:19.205093 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c130cec2-4f2a-442d-a4b1-6e5d3a19ef5a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:19.205584 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6b9ed7c2-f80c-4cc2-89ed-42b0bb0997f4 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:19.206874 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c130cec2-4f2a-442d-a4b1-6e5d3a19ef5a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:19.207219 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6b9ed7c2-f80c-4cc2-89ed-42b0bb0997f4 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:19.207820 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6b9ed7c2-f80c-4cc2-89ed-42b0bb0997f4 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:19.208786 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c130cec2-4f2a-442d-a4b1-6e5d3a19ef5a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:19.209873 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6b9ed7c2-f80c-4cc2-89ed-42b0bb0997f4 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:19.210554 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c130cec2-4f2a-442d-a4b1-6e5d3a19ef5a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:19.211298 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6b9ed7c2-f80c-4cc2-89ed-42b0bb0997f4 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:19.212361 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c130cec2-4f2a-442d-a4b1-6e5d3a19ef5a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:19.212958 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6b9ed7c2-f80c-4cc2-89ed-42b0bb0997f4 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:19.579449 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6b9ed7c2-f80c-4cc2-89ed-42b0bb0997f4 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:19.596190 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6b9ed7c2-f80c-4cc2-89ed-42b0bb0997f4 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872" status: 200 len: 1497 microversion: 2.1 time: 0.421222 Oct 17 13:38:19.611270 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 600/1177] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:19 2022] GET /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872 => generated 1497 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:19.611270 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-640c9cd6-159c-4d5a-a6a5-40b4fe5c5f6c tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:19.611270 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-640c9cd6-159c-4d5a-a6a5-40b4fe5c5f6c tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 298b0f19-0a0c-4304-bb8b-4bd26cce2d9d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:19.620437 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-640c9cd6-159c-4d5a-a6a5-40b4fe5c5f6c tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:19.620922 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-640c9cd6-159c-4d5a-a6a5-40b4fe5c5f6c tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:19.621350 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-640c9cd6-159c-4d5a-a6a5-40b4fe5c5f6c tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:19.622043 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-640c9cd6-159c-4d5a-a6a5-40b4fe5c5f6c tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:19.622488 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-640c9cd6-159c-4d5a-a6a5-40b4fe5c5f6c tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:19.622898 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-640c9cd6-159c-4d5a-a6a5-40b4fe5c5f6c tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:19.713993 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c130cec2-4f2a-442d-a4b1-6e5d3a19ef5a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:19.724131 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c130cec2-4f2a-442d-a4b1-6e5d3a19ef5a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e" status: 200 len: 1714 microversion: 2.1 time: 0.546142 Oct 17 13:38:19.725590 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 578/1178] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:19 2022] GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e => generated 1714 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:19.732507 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-12e186ee-7b17-4c40-856a-3a9ed2203df1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:19.733639 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-12e186ee-7b17-4c40-856a-3a9ed2203df1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 0ffbef37-e5f8-4de2-a29d-dba6782a3fe4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:19.761096 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-12e186ee-7b17-4c40-856a-3a9ed2203df1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:19.761831 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-12e186ee-7b17-4c40-856a-3a9ed2203df1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:19.762495 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-12e186ee-7b17-4c40-856a-3a9ed2203df1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:19.763332 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-12e186ee-7b17-4c40-856a-3a9ed2203df1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:19.764369 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-12e186ee-7b17-4c40-856a-3a9ed2203df1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:19.764983 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-12e186ee-7b17-4c40-856a-3a9ed2203df1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:20.010583 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=8 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:38:20.047487 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-640c9cd6-159c-4d5a-a6a5-40b4fe5c5f6c tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:20.059595 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-640c9cd6-159c-4d5a-a6a5-40b4fe5c5f6c tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/298b0f19-0a0c-4304-bb8b-4bd26cce2d9d" status: 200 len: 1324 microversion: 2.1 time: 0.459941 Oct 17 13:38:20.061395 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 601/1179] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:19 2022] GET /compute/v2.1/servers/298b0f19-0a0c-4304-bb8b-4bd26cce2d9d => generated 1324 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:20.067548 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-12f9a987-9fc9-4ae3-b434-6d65859042e0 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:20.068826 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-12f9a987-9fc9-4ae3-b434-6d65859042e0 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: ec948255-c8e9-4450-95d5-42f38b9afe45] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:20.075043 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-12e186ee-7b17-4c40-856a-3a9ed2203df1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:20.075282 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-12f9a987-9fc9-4ae3-b434-6d65859042e0 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:20.075779 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-12f9a987-9fc9-4ae3-b434-6d65859042e0 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:20.076213 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-12f9a987-9fc9-4ae3-b434-6d65859042e0 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:20.076916 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-12f9a987-9fc9-4ae3-b434-6d65859042e0 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:20.077368 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-12f9a987-9fc9-4ae3-b434-6d65859042e0 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:20.077888 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-12f9a987-9fc9-4ae3-b434-6d65859042e0 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:20.092439 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-12e186ee-7b17-4c40-856a-3a9ed2203df1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:20.094177 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-12e186ee-7b17-4c40-856a-3a9ed2203df1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:20.095927 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-12e186ee-7b17-4c40-856a-3a9ed2203df1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4" status: 200 len: 1568 microversion: 2.25 time: 0.369325 Oct 17 13:38:20.112413 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 579/1180] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:38:19 2022] GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4 => generated 1568 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:38:20.121460 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7ca34988-56e8-4437-88cd-bfecfb2df5ea tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:20.122648 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7ca34988-56e8-4437-88cd-bfecfb2df5ea tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: f47e3dcd-6e44-411d-bf0c-3da0abda9f87] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:20.130744 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-12f9a987-9fc9-4ae3-b434-6d65859042e0 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:20.131553 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-12f9a987-9fc9-4ae3-b434-6d65859042e0 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:20.132194 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-12f9a987-9fc9-4ae3-b434-6d65859042e0 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:20.132851 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-12f9a987-9fc9-4ae3-b434-6d65859042e0 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lazy-loading 'fault' on Instance uuid ec948255-c8e9-4450-95d5-42f38b9afe45 {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:38:20.142823 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7ca34988-56e8-4437-88cd-bfecfb2df5ea tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:20.143793 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7ca34988-56e8-4437-88cd-bfecfb2df5ea tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:20.144510 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7ca34988-56e8-4437-88cd-bfecfb2df5ea tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:20.145615 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7ca34988-56e8-4437-88cd-bfecfb2df5ea tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:20.146352 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7ca34988-56e8-4437-88cd-bfecfb2df5ea tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:20.146964 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7ca34988-56e8-4437-88cd-bfecfb2df5ea tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:20.557663 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-12f9a987-9fc9-4ae3-b434-6d65859042e0 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:20.572680 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-12f9a987-9fc9-4ae3-b434-6d65859042e0 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/ec948255-c8e9-4450-95d5-42f38b9afe45" status: 200 len: 1308 microversion: 2.1 time: 0.509499 Oct 17 13:38:20.588267 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 602/1181] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:20 2022] GET /compute/v2.1/servers/ec948255-c8e9-4450-95d5-42f38b9afe45 => generated 1308 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:20.627044 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4cda35da-325d-47d8-bc2d-0d262bbe0888 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:20.627881 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4cda35da-325d-47d8-bc2d-0d262bbe0888 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: ae587603-994d-419d-979a-1b1361144872] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:20.636012 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4cda35da-325d-47d8-bc2d-0d262bbe0888 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:20.636726 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4cda35da-325d-47d8-bc2d-0d262bbe0888 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:20.637233 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4cda35da-325d-47d8-bc2d-0d262bbe0888 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:20.638076 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4cda35da-325d-47d8-bc2d-0d262bbe0888 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:20.638987 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4cda35da-325d-47d8-bc2d-0d262bbe0888 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:20.639681 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4cda35da-325d-47d8-bc2d-0d262bbe0888 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:20.808418 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7ca34988-56e8-4437-88cd-bfecfb2df5ea tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:20.820179 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7ca34988-56e8-4437-88cd-bfecfb2df5ea tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/f47e3dcd-6e44-411d-bf0c-3da0abda9f87" status: 200 len: 1464 microversion: 2.1 time: 0.705637 Oct 17 13:38:20.835918 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 580/1182] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:20 2022] GET /compute/v2.1/servers/f47e3dcd-6e44-411d-bf0c-3da0abda9f87 => generated 1464 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:20.844275 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-da8403bf-336a-4fce-a901-e60272030a22 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:20.844935 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-da8403bf-336a-4fce-a901-e60272030a22 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: a54adf11-ee58-4f13-82c8-9a00a36c536e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:20.854118 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-da8403bf-336a-4fce-a901-e60272030a22 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:20.854613 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-da8403bf-336a-4fce-a901-e60272030a22 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:20.855048 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-da8403bf-336a-4fce-a901-e60272030a22 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:20.855863 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-da8403bf-336a-4fce-a901-e60272030a22 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:20.856319 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-da8403bf-336a-4fce-a901-e60272030a22 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:20.856752 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-da8403bf-336a-4fce-a901-e60272030a22 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:20.889787 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4cda35da-325d-47d8-bc2d-0d262bbe0888 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:20.903669 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4cda35da-325d-47d8-bc2d-0d262bbe0888 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872" status: 200 len: 1497 microversion: 2.1 time: 0.280352 Oct 17 13:38:20.904278 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 603/1183] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:20 2022] GET /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872 => generated 1497 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:20.909222 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-de1f1822-beff-4379-9f7b-217ca5e51424 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:20.910078 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-de1f1822-beff-4379-9f7b-217ca5e51424 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: ab2b571e-376c-41d3-a778-44bedcaa5467] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:20.917774 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-de1f1822-beff-4379-9f7b-217ca5e51424 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:20.918597 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-de1f1822-beff-4379-9f7b-217ca5e51424 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:20.919382 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-de1f1822-beff-4379-9f7b-217ca5e51424 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:20.922417 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-de1f1822-beff-4379-9f7b-217ca5e51424 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:20.923370 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-de1f1822-beff-4379-9f7b-217ca5e51424 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:20.924392 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-de1f1822-beff-4379-9f7b-217ca5e51424 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:21.217790 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-da8403bf-336a-4fce-a901-e60272030a22 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:21.235496 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-de1f1822-beff-4379-9f7b-217ca5e51424 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:21.238162 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-da8403bf-336a-4fce-a901-e60272030a22 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e" status: 200 len: 1714 microversion: 2.1 time: 0.399365 Oct 17 13:38:21.240073 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 581/1184] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:20 2022] GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e => generated 1714 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:21.250169 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7a5b0b40-63db-4884-95c6-0f6e3fb3a745 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:21.251757 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7a5b0b40-63db-4884-95c6-0f6e3fb3a745 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 298b0f19-0a0c-4304-bb8b-4bd26cce2d9d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:21.264113 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-de1f1822-beff-4379-9f7b-217ca5e51424 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467" status: 200 len: 1314 microversion: 2.1 time: 0.358423 Oct 17 13:38:21.264843 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 604/1185] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:20 2022] GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467 => generated 1314 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:21.267781 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7a5b0b40-63db-4884-95c6-0f6e3fb3a745 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:21.269079 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7a5b0b40-63db-4884-95c6-0f6e3fb3a745 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:21.270215 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7a5b0b40-63db-4884-95c6-0f6e3fb3a745 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:21.271525 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-94c3ce5a-f848-45d6-b937-25889dd17a45 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:21.272134 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-94c3ce5a-f848-45d6-b937-25889dd17a45 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 0ffbef37-e5f8-4de2-a29d-dba6782a3fe4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:21.272537 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7a5b0b40-63db-4884-95c6-0f6e3fb3a745 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:21.273487 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7a5b0b40-63db-4884-95c6-0f6e3fb3a745 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:21.275404 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7a5b0b40-63db-4884-95c6-0f6e3fb3a745 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:21.288536 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-94c3ce5a-f848-45d6-b937-25889dd17a45 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:21.290482 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-94c3ce5a-f848-45d6-b937-25889dd17a45 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:21.291384 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-94c3ce5a-f848-45d6-b937-25889dd17a45 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:21.296792 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-94c3ce5a-f848-45d6-b937-25889dd17a45 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:21.297581 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-94c3ce5a-f848-45d6-b937-25889dd17a45 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:21.300175 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-94c3ce5a-f848-45d6-b937-25889dd17a45 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:21.909768 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7a5b0b40-63db-4884-95c6-0f6e3fb3a745 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:21.914810 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-94c3ce5a-f848-45d6-b937-25889dd17a45 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:21.920276 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7a5b0b40-63db-4884-95c6-0f6e3fb3a745 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/298b0f19-0a0c-4304-bb8b-4bd26cce2d9d" status: 200 len: 1324 microversion: 2.1 time: 0.678466 Oct 17 13:38:21.920973 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 582/1186] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:21 2022] GET /compute/v2.1/servers/298b0f19-0a0c-4304-bb8b-4bd26cce2d9d => generated 1324 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:21.927413 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-f17b3fca-057d-43a0-9c4c-d22ee482d8e4 req-69a48c11-e3dc-4d1a-a23a-122c989dd359 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab2b571e-376c-41d3-a778-44bedcaa5467", "name": "network-vif-plugged", "status": "completed", "tag": "7ff3914f-4ed0-4fef-bc81-8a07b3c2c97b"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:38:21.932568 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-94c3ce5a-f848-45d6-b937-25889dd17a45 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:21.934053 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-94c3ce5a-f848-45d6-b937-25889dd17a45 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:21.936250 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-94c3ce5a-f848-45d6-b937-25889dd17a45 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4" status: 200 len: 1568 microversion: 2.25 time: 0.669960 Oct 17 13:38:21.937148 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 605/1187] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:38:21 2022] GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4 => generated 1568 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:38:21.941805 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-f17b3fca-057d-43a0-9c4c-d22ee482d8e4 req-69a48c11-e3dc-4d1a-a23a-122c989dd359 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:21.942502 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-f17b3fca-057d-43a0-9c4c-d22ee482d8e4 req-69a48c11-e3dc-4d1a-a23a-122c989dd359 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:21.942655 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c2a85734-d87f-4ee6-8077-f98230811f88 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:21.943232 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c2a85734-d87f-4ee6-8077-f98230811f88 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: ec948255-c8e9-4450-95d5-42f38b9afe45] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:21.943385 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-f17b3fca-057d-43a0-9c4c-d22ee482d8e4 req-69a48c11-e3dc-4d1a-a23a-122c989dd359 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:21.949906 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c2a85734-d87f-4ee6-8077-f98230811f88 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:21.950391 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c2a85734-d87f-4ee6-8077-f98230811f88 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:21.950802 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c2a85734-d87f-4ee6-8077-f98230811f88 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:21.951788 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c2a85734-d87f-4ee6-8077-f98230811f88 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:21.952239 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c2a85734-d87f-4ee6-8077-f98230811f88 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:21.952834 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c2a85734-d87f-4ee6-8077-f98230811f88 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:21.956763 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-f17b3fca-057d-43a0-9c4c-d22ee482d8e4 req-69a48c11-e3dc-4d1a-a23a-122c989dd359 service nova] Creating event network-vif-plugged:7ff3914f-4ed0-4fef-bc81-8a07b3c2c97b for instance ab2b571e-376c-41d3-a778-44bedcaa5467 on n-h2-854247-14 Oct 17 13:38:21.961764 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-f17b3fca-057d-43a0-9c4c-d22ee482d8e4 req-69a48c11-e3dc-4d1a-a23a-122c989dd359 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039392 Oct 17 13:38:21.963104 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 583/1188] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:38:21.969340 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2b9b7b2b-1d0e-4311-96f2-b3ec3e7c3f47 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:21.970319 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2b9b7b2b-1d0e-4311-96f2-b3ec3e7c3f47 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: ae587603-994d-419d-979a-1b1361144872] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:21.977028 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2b9b7b2b-1d0e-4311-96f2-b3ec3e7c3f47 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:21.978109 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2b9b7b2b-1d0e-4311-96f2-b3ec3e7c3f47 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:21.978759 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2b9b7b2b-1d0e-4311-96f2-b3ec3e7c3f47 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:21.979664 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2b9b7b2b-1d0e-4311-96f2-b3ec3e7c3f47 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:21.980318 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2b9b7b2b-1d0e-4311-96f2-b3ec3e7c3f47 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:21.980923 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2b9b7b2b-1d0e-4311-96f2-b3ec3e7c3f47 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:21.985707 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=100 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:38:21.991509 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c2a85734-d87f-4ee6-8077-f98230811f88 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:21.991999 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c2a85734-d87f-4ee6-8077-f98230811f88 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:21.992466 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c2a85734-d87f-4ee6-8077-f98230811f88 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:21.992911 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-c2a85734-d87f-4ee6-8077-f98230811f88 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lazy-loading 'fault' on Instance uuid ec948255-c8e9-4450-95d5-42f38b9afe45 {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:38:22.205093 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c2a85734-d87f-4ee6-8077-f98230811f88 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:22.212339 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c2a85734-d87f-4ee6-8077-f98230811f88 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/ec948255-c8e9-4450-95d5-42f38b9afe45" status: 200 len: 1308 microversion: 2.1 time: 0.274142 Oct 17 13:38:22.213159 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 606/1189] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:21 2022] GET /compute/v2.1/servers/ec948255-c8e9-4450-95d5-42f38b9afe45 => generated 1308 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:22.265405 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-92d53689-9735-41db-a669-9d998a81d284 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:22.266103 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-92d53689-9735-41db-a669-9d998a81d284 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: a54adf11-ee58-4f13-82c8-9a00a36c536e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:22.273417 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-92d53689-9735-41db-a669-9d998a81d284 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:22.274122 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-92d53689-9735-41db-a669-9d998a81d284 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:22.274610 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-92d53689-9735-41db-a669-9d998a81d284 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:22.275519 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-92d53689-9735-41db-a669-9d998a81d284 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:22.276061 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-92d53689-9735-41db-a669-9d998a81d284 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:22.276561 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-92d53689-9735-41db-a669-9d998a81d284 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:22.326350 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2b9b7b2b-1d0e-4311-96f2-b3ec3e7c3f47 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:22.334154 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2b9b7b2b-1d0e-4311-96f2-b3ec3e7c3f47 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872" status: 200 len: 1497 microversion: 2.1 time: 0.369658 Oct 17 13:38:22.334711 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 584/1190] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:21 2022] GET /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872 => generated 1497 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:22.339278 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d664f9d1-c690-4885-a741-6bc5731e9eb5 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:22.339889 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d664f9d1-c690-4885-a741-6bc5731e9eb5 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: ab2b571e-376c-41d3-a778-44bedcaa5467] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:22.345843 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d664f9d1-c690-4885-a741-6bc5731e9eb5 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:22.346125 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d664f9d1-c690-4885-a741-6bc5731e9eb5 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:22.346746 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d664f9d1-c690-4885-a741-6bc5731e9eb5 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:22.347466 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d664f9d1-c690-4885-a741-6bc5731e9eb5 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:22.347915 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d664f9d1-c690-4885-a741-6bc5731e9eb5 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:22.348730 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d664f9d1-c690-4885-a741-6bc5731e9eb5 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:22.573401 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-92d53689-9735-41db-a669-9d998a81d284 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:22.582234 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-92d53689-9735-41db-a669-9d998a81d284 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e" status: 200 len: 1714 microversion: 2.1 time: 0.320753 Oct 17 13:38:22.582810 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 607/1191] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:22 2022] GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e => generated 1714 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:22.680787 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d664f9d1-c690-4885-a741-6bc5731e9eb5 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:22.689278 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d664f9d1-c690-4885-a741-6bc5731e9eb5 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467" status: 200 len: 1314 microversion: 2.1 time: 0.353593 Oct 17 13:38:22.689865 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 585/1192] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:22 2022] GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467 => generated 1314 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:22.948261 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-751f2148-ed61-4aa4-9c6f-fd028a14a117 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:22.949090 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-751f2148-ed61-4aa4-9c6f-fd028a14a117 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 298b0f19-0a0c-4304-bb8b-4bd26cce2d9d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:22.959293 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-751f2148-ed61-4aa4-9c6f-fd028a14a117 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:22.960027 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-751f2148-ed61-4aa4-9c6f-fd028a14a117 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:22.960741 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-751f2148-ed61-4aa4-9c6f-fd028a14a117 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:22.961814 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-751f2148-ed61-4aa4-9c6f-fd028a14a117 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:22.962385 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-751f2148-ed61-4aa4-9c6f-fd028a14a117 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:22.962825 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-751f2148-ed61-4aa4-9c6f-fd028a14a117 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:22.963904 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a862bf6b-2525-4159-ba19-3373364b217c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:22.964514 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a862bf6b-2525-4159-ba19-3373364b217c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 0ffbef37-e5f8-4de2-a29d-dba6782a3fe4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:22.971593 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a862bf6b-2525-4159-ba19-3373364b217c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:22.972074 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a862bf6b-2525-4159-ba19-3373364b217c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:22.972504 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a862bf6b-2525-4159-ba19-3373364b217c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:22.973199 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a862bf6b-2525-4159-ba19-3373364b217c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:22.973647 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a862bf6b-2525-4159-ba19-3373364b217c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:22.974063 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a862bf6b-2525-4159-ba19-3373364b217c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:23.396053 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-751f2148-ed61-4aa4-9c6f-fd028a14a117 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:23.404315 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-751f2148-ed61-4aa4-9c6f-fd028a14a117 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/298b0f19-0a0c-4304-bb8b-4bd26cce2d9d" status: 200 len: 1324 microversion: 2.1 time: 0.463115 Oct 17 13:38:23.419824 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 608/1193] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:22 2022] GET /compute/v2.1/servers/298b0f19-0a0c-4304-bb8b-4bd26cce2d9d => generated 1324 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:23.428112 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ad0279fa-a01c-408a-bd45-45aa7a12134c tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:23.428943 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ad0279fa-a01c-408a-bd45-45aa7a12134c tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: ec948255-c8e9-4450-95d5-42f38b9afe45] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:23.431284 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a862bf6b-2525-4159-ba19-3373364b217c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:23.435655 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ad0279fa-a01c-408a-bd45-45aa7a12134c tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:23.437213 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ad0279fa-a01c-408a-bd45-45aa7a12134c tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:23.437830 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ad0279fa-a01c-408a-bd45-45aa7a12134c tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:23.438682 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ad0279fa-a01c-408a-bd45-45aa7a12134c tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:23.439321 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ad0279fa-a01c-408a-bd45-45aa7a12134c tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:23.439891 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ad0279fa-a01c-408a-bd45-45aa7a12134c tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:23.444131 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a862bf6b-2525-4159-ba19-3373364b217c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:23.446739 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a862bf6b-2525-4159-ba19-3373364b217c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:23.447988 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a862bf6b-2525-4159-ba19-3373364b217c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4" status: 200 len: 1568 microversion: 2.25 time: 0.489401 Oct 17 13:38:23.461798 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 586/1194] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:38:22 2022] GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4 => generated 1568 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:38:23.461798 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-09d0a127-57fd-48ff-b544-ec7a028a0325 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:23.461798 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-09d0a127-57fd-48ff-b544-ec7a028a0325 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: ae587603-994d-419d-979a-1b1361144872] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:23.464792 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-09d0a127-57fd-48ff-b544-ec7a028a0325 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:23.464792 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-09d0a127-57fd-48ff-b544-ec7a028a0325 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:23.467505 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-09d0a127-57fd-48ff-b544-ec7a028a0325 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:23.467505 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-09d0a127-57fd-48ff-b544-ec7a028a0325 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:23.467505 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-09d0a127-57fd-48ff-b544-ec7a028a0325 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:23.467505 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-09d0a127-57fd-48ff-b544-ec7a028a0325 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:23.467866 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-ad0279fa-a01c-408a-bd45-45aa7a12134c tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] HTTP exception thrown: Instance ec948255-c8e9-4450-95d5-42f38b9afe45 could not be found. Oct 17 13:38:23.470402 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ad0279fa-a01c-408a-bd45-45aa7a12134c tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Request method failure captured: Oct 17 13:38:23.470402 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/ec948255-c8e9-4450-95d5-42f38b9afe45 HTTP/1.1 Oct 17 13:38:23.470402 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:38:23.470402 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:38:23.470402 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:38:23.470402 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:38:23.470402 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:38:23.470402 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:38:23.470402 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:38:23.470402 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:38:23.470402 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVn0rKCCzxL1KwIZI1Im8ygkuewY-UzF6Z81i6cNkagTk7ClET_LM7mvJkIi7s6pFyo0jkOjEfkZnFMR6ojJjeKHBwoksuv9Z4X8LYNw4iNhGgW8aAiE8QzHsCgl5CJTTDwKklbNcQOJJRXIUfAtc0cseQ_bknPsrUPdOoFAaQy0_jg Oct 17 13:38:23.470402 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:38:23.470402 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:38:23.470402 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:38:23.470402 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:38:23.470402 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:38:23.470402 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:38:23.470402 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: fa1db260a96a4c6aa69cd6437baab6f7 Oct 17 13:38:23.470402 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServersOnMultiNodesTest-1107099453 Oct 17 13:38:23.470402 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:38:23.470402 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:38:23.472024 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/fa1db260a96a4c6aa69cd6437baab6f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/fa1db260a96a4c6aa69cd6437baab6f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/fa1db260a96a4c6aa69cd6437baab6f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_fa1db260a96a4c6aa69cd6437baab6f7", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:38:23.472024 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServersOnMultiNodesTest-1107099453 Oct 17 13:38:23.472024 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: fa1db260a96a4c6aa69cd6437baab6f7 Oct 17 13:38:23.472024 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1107099453 Oct 17 13:38:23.472024 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServersOnMultiNodesTest-1107099453-project Oct 17 13:38:23.472024 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:38:23.472024 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:38:23.472024 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 7a7e082035084338966a1c56b30c7093 Oct 17 13:38:23.472024 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServersOnMultiNodesTest-1107099453-project Oct 17 13:38:23.472024 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:38:23.472024 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance ec948255-c8e9-4450-95d5-42f38b9afe45 could not be found. Oct 17 13:38:23.472024 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'ec948255-c8e9-4450-95d5-42f38b9afe45'} Oct 17 13:38:23.472954 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:38:23.472954 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:38:23.472954 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:38:23.472954 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:38:23.472954 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:38:23.472954 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:38:23.472954 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:38:23.472954 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:38:23.472954 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:38:23.472954 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:38:23.472954 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec948255-c8e9-4450-95d5-42f38b9afe45 could not be found. Oct 17 13:38:23.472954 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:38:23.472954 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:38:23.472954 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:38:23.472954 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:38:23.472954 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:38:23.472954 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:38:23.472954 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:38:23.472954 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:38:23.472954 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:38:23.475755 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:38:23.475755 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:38:23.475755 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:38:23.475755 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:38:23.475755 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:38:23.475755 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:38:23.475755 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:38:23.475755 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec948255-c8e9-4450-95d5-42f38b9afe45 could not be found. Oct 17 13:38:23.475755 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:38:23.475755 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:38:23.475755 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:38:23.475755 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:38:23.475755 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:38:23.475755 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:38:23.475755 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:38:23.475755 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:38:23.475755 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec948255-c8e9-4450-95d5-42f38b9afe45 could not be found. Oct 17 13:38:23.475755 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:38:23.477409 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ad0279fa-a01c-408a-bd45-45aa7a12134c tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Returning 404 to user: Instance ec948255-c8e9-4450-95d5-42f38b9afe45 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:38:23.477409 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ad0279fa-a01c-408a-bd45-45aa7a12134c tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/ec948255-c8e9-4450-95d5-42f38b9afe45" status: 404 len: 111 microversion: 2.1 time: 0.049980 Oct 17 13:38:23.477409 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 609/1195] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:23 2022] GET /compute/v2.1/servers/ec948255-c8e9-4450-95d5-42f38b9afe45 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:38:23.480953 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2dc527ff-913a-4116-95c2-52094aeded7b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:23.481569 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2dc527ff-913a-4116-95c2-52094aeded7b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 4d242145-87ff-473a-bac2-fdd483fb5863] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:23.487651 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2dc527ff-913a-4116-95c2-52094aeded7b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:23.488137 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2dc527ff-913a-4116-95c2-52094aeded7b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:23.488575 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2dc527ff-913a-4116-95c2-52094aeded7b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:23.489272 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2dc527ff-913a-4116-95c2-52094aeded7b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:23.489725 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2dc527ff-913a-4116-95c2-52094aeded7b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:23.490142 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2dc527ff-913a-4116-95c2-52094aeded7b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:23.510376 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-2dc527ff-913a-4116-95c2-52094aeded7b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] HTTP exception thrown: Instance 4d242145-87ff-473a-bac2-fdd483fb5863 could not be found. Oct 17 13:38:23.512596 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2dc527ff-913a-4116-95c2-52094aeded7b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Request method failure captured: Oct 17 13:38:23.512596 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/4d242145-87ff-473a-bac2-fdd483fb5863 HTTP/1.1 Oct 17 13:38:23.512596 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:38:23.512596 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:38:23.512596 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:38:23.512596 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:38:23.512596 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:38:23.512596 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:38:23.512596 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:38:23.512596 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:38:23.512596 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVn0rKCCzxL1KwIZI1Im8ygkuewY-UzF6Z81i6cNkagTk7ClET_LM7mvJkIi7s6pFyo0jkOjEfkZnFMR6ojJjeKHBwoksuv9Z4X8LYNw4iNhGgW8aAiE8QzHsCgl5CJTTDwKklbNcQOJJRXIUfAtc0cseQ_bknPsrUPdOoFAaQy0_jg Oct 17 13:38:23.512596 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:38:23.512596 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:38:23.512596 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:38:23.512596 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:38:23.512596 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:38:23.512596 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:38:23.512596 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: fa1db260a96a4c6aa69cd6437baab6f7 Oct 17 13:38:23.512596 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServersOnMultiNodesTest-1107099453 Oct 17 13:38:23.512596 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:38:23.512596 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:38:23.514096 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/fa1db260a96a4c6aa69cd6437baab6f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/fa1db260a96a4c6aa69cd6437baab6f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/fa1db260a96a4c6aa69cd6437baab6f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_fa1db260a96a4c6aa69cd6437baab6f7", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:38:23.514096 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServersOnMultiNodesTest-1107099453 Oct 17 13:38:23.514096 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: fa1db260a96a4c6aa69cd6437baab6f7 Oct 17 13:38:23.514096 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1107099453 Oct 17 13:38:23.514096 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServersOnMultiNodesTest-1107099453-project Oct 17 13:38:23.514096 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:38:23.514096 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:38:23.514096 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 7a7e082035084338966a1c56b30c7093 Oct 17 13:38:23.514096 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServersOnMultiNodesTest-1107099453-project Oct 17 13:38:23.514096 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:38:23.514096 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 4d242145-87ff-473a-bac2-fdd483fb5863 could not be found. Oct 17 13:38:23.514096 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '4d242145-87ff-473a-bac2-fdd483fb5863'} Oct 17 13:38:23.514855 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:38:23.514855 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:38:23.514855 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:38:23.514855 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:38:23.514855 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:38:23.514855 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:38:23.514855 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:38:23.514855 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:38:23.514855 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:38:23.514855 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:38:23.514855 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d242145-87ff-473a-bac2-fdd483fb5863 could not be found. Oct 17 13:38:23.514855 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:38:23.514855 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:38:23.514855 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:38:23.514855 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:38:23.514855 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:38:23.514855 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:38:23.514855 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:38:23.514855 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:38:23.514855 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:38:23.516216 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:38:23.516216 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:38:23.516216 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:38:23.516216 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:38:23.516216 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:38:23.516216 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:38:23.516216 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:38:23.516216 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d242145-87ff-473a-bac2-fdd483fb5863 could not be found. Oct 17 13:38:23.516216 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:38:23.516216 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:38:23.516216 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:38:23.516216 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:38:23.516216 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:38:23.516216 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:38:23.516216 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:38:23.516216 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:38:23.516216 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d242145-87ff-473a-bac2-fdd483fb5863 could not be found. Oct 17 13:38:23.516216 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:38:23.517697 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2dc527ff-913a-4116-95c2-52094aeded7b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Returning 404 to user: Instance 4d242145-87ff-473a-bac2-fdd483fb5863 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:38:23.517697 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2dc527ff-913a-4116-95c2-52094aeded7b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/4d242145-87ff-473a-bac2-fdd483fb5863" status: 404 len: 111 microversion: 2.1 time: 0.036887 Oct 17 13:38:23.517697 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 610/1196] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:23 2022] GET /compute/v2.1/servers/4d242145-87ff-473a-bac2-fdd483fb5863 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:38:23.524200 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-587989a4-d15a-47d7-9d4c-04e5ade0734b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:23.555068 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-587989a4-d15a-47d7-9d4c-04e5ade0734b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "DELETE /compute/v2.1/os-server-groups/8dc84431-0b19-4210-9e52-d66f999b4795" status: 204 len: 0 microversion: 2.1 time: 0.034550 Oct 17 13:38:23.555863 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 611/1197] 10.222.0.79 () {58 vars in 1266 bytes} [Mon Oct 17 13:38:23 2022] DELETE /compute/v2.1/os-server-groups/8dc84431-0b19-4210-9e52-d66f999b4795 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:38:23.564006 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1040b942-afd2-4420-8f50-f16388e8c0ba tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:23.564504 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1040b942-afd2-4420-8f50-f16388e8c0ba tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 07af9912-df9b-4476-92b3-48858617dd29] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:23.570665 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1040b942-afd2-4420-8f50-f16388e8c0ba tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:23.571149 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1040b942-afd2-4420-8f50-f16388e8c0ba tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:23.571663 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1040b942-afd2-4420-8f50-f16388e8c0ba tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:23.572365 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1040b942-afd2-4420-8f50-f16388e8c0ba tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:23.572811 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1040b942-afd2-4420-8f50-f16388e8c0ba tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:23.573234 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1040b942-afd2-4420-8f50-f16388e8c0ba tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:23.598470 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1040b942-afd2-4420-8f50-f16388e8c0ba tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 07af9912-df9b-4476-92b3-48858617dd29] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:38:23.614972 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-09d0a127-57fd-48ff-b544-ec7a028a0325 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:23.626707 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-09d0a127-57fd-48ff-b544-ec7a028a0325 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872" status: 200 len: 1497 microversion: 2.1 time: 0.176509 Oct 17 13:38:23.643677 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 587/1198] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:23 2022] GET /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872 => generated 1497 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:23.649568 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-009b7f43-e75e-4338-b0d6-1638fb6b6856 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:23.650404 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-009b7f43-e75e-4338-b0d6-1638fb6b6856 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: a54adf11-ee58-4f13-82c8-9a00a36c536e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:23.657550 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-009b7f43-e75e-4338-b0d6-1638fb6b6856 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:23.658164 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-009b7f43-e75e-4338-b0d6-1638fb6b6856 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:23.658680 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-009b7f43-e75e-4338-b0d6-1638fb6b6856 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:23.659507 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-009b7f43-e75e-4338-b0d6-1638fb6b6856 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:23.660078 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-009b7f43-e75e-4338-b0d6-1638fb6b6856 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:23.660584 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-009b7f43-e75e-4338-b0d6-1638fb6b6856 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:23.706919 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1040b942-afd2-4420-8f50-f16388e8c0ba tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "DELETE /compute/v2.1/servers/07af9912-df9b-4476-92b3-48858617dd29" status: 204 len: 0 microversion: 2.1 time: 0.144099 Oct 17 13:38:23.706919 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 612/1199] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:38:23 2022] DELETE /compute/v2.1/servers/07af9912-df9b-4476-92b3-48858617dd29 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 13:38:23.716112 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-fa14a74c-5c2f-425c-b81e-0ca4ed1b6315 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:23.716753 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-fa14a74c-5c2f-425c-b81e-0ca4ed1b6315 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: ab2b571e-376c-41d3-a778-44bedcaa5467] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:23.723045 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fa14a74c-5c2f-425c-b81e-0ca4ed1b6315 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:23.724018 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fa14a74c-5c2f-425c-b81e-0ca4ed1b6315 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:23.724148 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fa14a74c-5c2f-425c-b81e-0ca4ed1b6315 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:23.725028 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fa14a74c-5c2f-425c-b81e-0ca4ed1b6315 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:23.725254 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fa14a74c-5c2f-425c-b81e-0ca4ed1b6315 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:23.725674 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fa14a74c-5c2f-425c-b81e-0ca4ed1b6315 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:24.372672 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-009b7f43-e75e-4338-b0d6-1638fb6b6856 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:24.381133 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-009b7f43-e75e-4338-b0d6-1638fb6b6856 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e" status: 200 len: 1714 microversion: 2.1 time: 0.736127 Oct 17 13:38:24.381878 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 588/1200] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:23 2022] GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e => generated 1714 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:24.386688 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-21360c2f-b70d-4918-a6ac-1b51c18cec9d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:24.387185 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-21360c2f-b70d-4918-a6ac-1b51c18cec9d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 03e8be7f-09be-488a-95ee-6951b53e35de] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:24.394782 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-21360c2f-b70d-4918-a6ac-1b51c18cec9d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:24.395618 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-21360c2f-b70d-4918-a6ac-1b51c18cec9d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:24.396202 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-21360c2f-b70d-4918-a6ac-1b51c18cec9d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:24.396966 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-21360c2f-b70d-4918-a6ac-1b51c18cec9d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:24.397420 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-21360c2f-b70d-4918-a6ac-1b51c18cec9d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:24.397837 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-21360c2f-b70d-4918-a6ac-1b51c18cec9d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:24.419491 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-fa14a74c-5c2f-425c-b81e-0ca4ed1b6315 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:24.425589 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-21360c2f-b70d-4918-a6ac-1b51c18cec9d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 03e8be7f-09be-488a-95ee-6951b53e35de] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:38:24.429108 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-fa14a74c-5c2f-425c-b81e-0ca4ed1b6315 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467" status: 200 len: 1464 microversion: 2.1 time: 0.717225 Oct 17 13:38:24.439006 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 613/1201] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:23 2022] GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467 => generated 1464 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:24.442613 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-59070a95-e60f-4ca0-a4a6-bf9cbc022a99 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:24.443229 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-59070a95-e60f-4ca0-a4a6-bf9cbc022a99 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 298b0f19-0a0c-4304-bb8b-4bd26cce2d9d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:24.449615 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-59070a95-e60f-4ca0-a4a6-bf9cbc022a99 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:24.450104 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-59070a95-e60f-4ca0-a4a6-bf9cbc022a99 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:24.450607 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-59070a95-e60f-4ca0-a4a6-bf9cbc022a99 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:24.451243 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-59070a95-e60f-4ca0-a4a6-bf9cbc022a99 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:24.452652 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-59070a95-e60f-4ca0-a4a6-bf9cbc022a99 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:24.452652 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-59070a95-e60f-4ca0-a4a6-bf9cbc022a99 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:24.533686 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-21360c2f-b70d-4918-a6ac-1b51c18cec9d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "DELETE /compute/v2.1/servers/03e8be7f-09be-488a-95ee-6951b53e35de" status: 204 len: 0 microversion: 2.1 time: 0.150522 Oct 17 13:38:24.534389 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 589/1202] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:38:24 2022] DELETE /compute/v2.1/servers/03e8be7f-09be-488a-95ee-6951b53e35de => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:38:24.541070 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d0f96677-5a5b-4c01-a046-c1541266967b tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:24.541888 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d0f96677-5a5b-4c01-a046-c1541266967b tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 0ffbef37-e5f8-4de2-a29d-dba6782a3fe4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:24.547841 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d0f96677-5a5b-4c01-a046-c1541266967b tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:24.548320 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d0f96677-5a5b-4c01-a046-c1541266967b tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:24.548754 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d0f96677-5a5b-4c01-a046-c1541266967b tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:24.549471 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d0f96677-5a5b-4c01-a046-c1541266967b tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:24.549901 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d0f96677-5a5b-4c01-a046-c1541266967b tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:24.550435 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d0f96677-5a5b-4c01-a046-c1541266967b tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:24.630500 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-59070a95-e60f-4ca0-a4a6-bf9cbc022a99 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:24.638449 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-59070a95-e60f-4ca0-a4a6-bf9cbc022a99 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/298b0f19-0a0c-4304-bb8b-4bd26cce2d9d" status: 200 len: 1324 microversion: 2.1 time: 0.207478 Oct 17 13:38:24.639406 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 614/1203] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:24 2022] GET /compute/v2.1/servers/298b0f19-0a0c-4304-bb8b-4bd26cce2d9d => generated 1324 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:24.644120 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-cb6524e6-d2d7-48ea-9c2c-604026f1f33f tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-832431667", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "ab2b571e-376c-41d3-a778-44bedcaa5467"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:38:24.701679 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-cb6524e6-d2d7-48ea-9c2c-604026f1f33f tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] validate_networks() for None {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:38:24.703041 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d0f96677-5a5b-4c01-a046-c1541266967b tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:24.712773 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d0f96677-5a5b-4c01-a046-c1541266967b tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:24.714979 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d0f96677-5a5b-4c01-a046-c1541266967b tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:24.716259 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d0f96677-5a5b-4c01-a046-c1541266967b tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4" status: 200 len: 1568 microversion: 2.25 time: 0.179537 Oct 17 13:38:24.716841 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 590/1204] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:38:24 2022] GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4 => generated 1568 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:38:24.721426 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-060926a0-a6e9-4555-b48a-bf2677ab5f5d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:24.722031 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-060926a0-a6e9-4555-b48a-bf2677ab5f5d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 07af9912-df9b-4476-92b3-48858617dd29] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:24.728321 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-060926a0-a6e9-4555-b48a-bf2677ab5f5d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:24.728805 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-060926a0-a6e9-4555-b48a-bf2677ab5f5d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:24.729235 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-060926a0-a6e9-4555-b48a-bf2677ab5f5d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:24.729959 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-060926a0-a6e9-4555-b48a-bf2677ab5f5d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:24.730429 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-060926a0-a6e9-4555-b48a-bf2677ab5f5d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:24.730829 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-060926a0-a6e9-4555-b48a-bf2677ab5f5d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:25.036327 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-060926a0-a6e9-4555-b48a-bf2677ab5f5d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:25.045244 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-060926a0-a6e9-4555-b48a-bf2677ab5f5d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/07af9912-df9b-4476-92b3-48858617dd29" status: 200 len: 1475 microversion: 2.1 time: 0.327258 Oct 17 13:38:25.045846 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 591/1205] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:24 2022] GET /compute/v2.1/servers/07af9912-df9b-4476-92b3-48858617dd29 => generated 1475 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:25.050248 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-96383ddc-28ce-4965-bc25-21ba12ce90b1 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:25.050839 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-96383ddc-28ce-4965-bc25-21ba12ce90b1 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: ae587603-994d-419d-979a-1b1361144872] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:25.062763 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-96383ddc-28ce-4965-bc25-21ba12ce90b1 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:25.063297 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-96383ddc-28ce-4965-bc25-21ba12ce90b1 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:25.063727 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-96383ddc-28ce-4965-bc25-21ba12ce90b1 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:25.064453 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-96383ddc-28ce-4965-bc25-21ba12ce90b1 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:25.064938 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-96383ddc-28ce-4965-bc25-21ba12ce90b1 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:25.065354 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-96383ddc-28ce-4965-bc25-21ba12ce90b1 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:25.105750 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-cb6524e6-d2d7-48ea-9c2c-604026f1f33f tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:38:25.106244 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-cb6524e6-d2d7-48ea-9c2c-604026f1f33f tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:38:25.106814 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-cb6524e6-d2d7-48ea-9c2c-604026f1f33f tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:38:25.107323 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-cb6524e6-d2d7-48ea-9c2c-604026f1f33f tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:38:25.107823 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-cb6524e6-d2d7-48ea-9c2c-604026f1f33f tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:38:25.116849 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cb6524e6-d2d7-48ea-9c2c-604026f1f33f tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:25.117322 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cb6524e6-d2d7-48ea-9c2c-604026f1f33f tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:25.117801 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cb6524e6-d2d7-48ea-9c2c-604026f1f33f tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:25.118603 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cb6524e6-d2d7-48ea-9c2c-604026f1f33f tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:25.119045 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cb6524e6-d2d7-48ea-9c2c-604026f1f33f tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:25.119490 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cb6524e6-d2d7-48ea-9c2c-604026f1f33f tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:25.136622 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-cb6524e6-d2d7-48ea-9c2c-604026f1f33f tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Getting quotas for project 76eaaef0f6234db690a123c54cea5a6d. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:38:25.142048 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-cb6524e6-d2d7-48ea-9c2c-604026f1f33f tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Getting quotas for user 69bd293284874ca9ba415770de7b6965 and project 76eaaef0f6234db690a123c54cea5a6d. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:38:25.154132 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-cb6524e6-d2d7-48ea-9c2c-604026f1f33f tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:38:25.156520 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-cb6524e6-d2d7-48ea-9c2c-604026f1f33f tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: 56f45c71-b693-48c4-a2b6-dcfea882eaa4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:38:25.206144 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-cb6524e6-d2d7-48ea-9c2c-604026f1f33f tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.565675 Oct 17 13:38:25.206298 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-96383ddc-28ce-4965-bc25-21ba12ce90b1 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:25.206852 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 615/1206] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:38:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:38:25.219258 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c01213a7-8957-4cfa-ae52-74e3f8c97157 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:25.219877 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c01213a7-8957-4cfa-ae52-74e3f8c97157 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: 56f45c71-b693-48c4-a2b6-dcfea882eaa4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:25.231087 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-96383ddc-28ce-4965-bc25-21ba12ce90b1 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872" status: 200 len: 1497 microversion: 2.1 time: 0.184139 Oct 17 13:38:25.243123 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 592/1207] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:25 2022] GET /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872 => generated 1497 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:25.280003 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c01213a7-8957-4cfa-ae52-74e3f8c97157 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:25.289634 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c01213a7-8957-4cfa-ae52-74e3f8c97157 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/56f45c71-b693-48c4-a2b6-dcfea882eaa4" status: 200 len: 1213 microversion: 2.1 time: 0.074426 Oct 17 13:38:25.292467 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 616/1208] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:25 2022] GET /compute/v2.1/servers/56f45c71-b693-48c4-a2b6-dcfea882eaa4 => generated 1213 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:25.405572 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-56bab42e-fcbe-4890-b169-8eeddf59a099 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:25.406249 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-56bab42e-fcbe-4890-b169-8eeddf59a099 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: a54adf11-ee58-4f13-82c8-9a00a36c536e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:25.413200 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-56bab42e-fcbe-4890-b169-8eeddf59a099 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:25.413831 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-56bab42e-fcbe-4890-b169-8eeddf59a099 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:25.414363 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-56bab42e-fcbe-4890-b169-8eeddf59a099 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:25.415296 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-56bab42e-fcbe-4890-b169-8eeddf59a099 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:25.415817 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-56bab42e-fcbe-4890-b169-8eeddf59a099 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:25.416446 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-56bab42e-fcbe-4890-b169-8eeddf59a099 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:25.557788 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-ca0924e8-c146-462a-b2e2-7f79e3173031 req-94f01e10-6737-47c7-ac3c-161e4a11ebe8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "298b0f19-0a0c-4304-bb8b-4bd26cce2d9d", "name": "network-vif-plugged", "status": "completed", "tag": "1b002cb5-02b8-45df-a6b3-cb4130290727"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:38:25.568292 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-56bab42e-fcbe-4890-b169-8eeddf59a099 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:25.571243 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-ca0924e8-c146-462a-b2e2-7f79e3173031 req-94f01e10-6737-47c7-ac3c-161e4a11ebe8 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:25.571948 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-ca0924e8-c146-462a-b2e2-7f79e3173031 req-94f01e10-6737-47c7-ac3c-161e4a11ebe8 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:25.572581 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-ca0924e8-c146-462a-b2e2-7f79e3173031 req-94f01e10-6737-47c7-ac3c-161e4a11ebe8 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:25.577455 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:38:25.582190 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-56bab42e-fcbe-4890-b169-8eeddf59a099 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e" status: 200 len: 1704 microversion: 2.1 time: 0.180843 Oct 17 13:38:25.583974 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 593/1209] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:25 2022] GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e => generated 1704 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:25.597915 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-ca0924e8-c146-462a-b2e2-7f79e3173031 req-94f01e10-6737-47c7-ac3c-161e4a11ebe8 service nova] Creating event network-vif-plugged:1b002cb5-02b8-45df-a6b3-cb4130290727 for instance 298b0f19-0a0c-4304-bb8b-4bd26cce2d9d on n-h2-854247-14 Oct 17 13:38:25.607087 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6b29eafe-712e-4292-80ba-362d2322180a tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Calling method '.version_select at 0x7f7cd5449940>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:25.609329 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-ca0924e8-c146-462a-b2e2-7f79e3173031 req-94f01e10-6737-47c7-ac3c-161e4a11ebe8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054245 Oct 17 13:38:25.610144 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 617/1210] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:38:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:38:25.611253 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6b29eafe-712e-4292-80ba-362d2322180a tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:25.611733 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6b29eafe-712e-4292-80ba-362d2322180a tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:25.612161 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6b29eafe-712e-4292-80ba-362d2322180a tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:25.623707 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6b29eafe-712e-4292-80ba-362d2322180a tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] 10.222.0.79 "GET /compute/v2.1/os-migrations" status: 200 len: 1563 microversion: 2.1 time: 0.021297 Oct 17 13:38:25.624569 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 594/1211] 10.222.0.79 () {58 vars in 1143 bytes} [Mon Oct 17 13:38:25 2022] GET /compute/v2.1/os-migrations => generated 1563 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:38:25.643282 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-59f60ec5-2db2-4d11-90fc-566485907092 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:25.643752 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-59f60ec5-2db2-4d11-90fc-566485907092 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] [instance: a54adf11-ee58-4f13-82c8-9a00a36c536e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:25.654096 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-59f60ec5-2db2-4d11-90fc-566485907092 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:25.654596 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-59f60ec5-2db2-4d11-90fc-566485907092 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:25.655089 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-59f60ec5-2db2-4d11-90fc-566485907092 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:25.656256 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-59f60ec5-2db2-4d11-90fc-566485907092 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:25.656718 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-59f60ec5-2db2-4d11-90fc-566485907092 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:25.657142 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-59f60ec5-2db2-4d11-90fc-566485907092 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:25.669051 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-63df062e-e72c-48af-b30c-8b9fec1182e6 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:25.669867 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-63df062e-e72c-48af-b30c-8b9fec1182e6 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 298b0f19-0a0c-4304-bb8b-4bd26cce2d9d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:25.687562 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-63df062e-e72c-48af-b30c-8b9fec1182e6 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:25.688049 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-63df062e-e72c-48af-b30c-8b9fec1182e6 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:25.688540 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-63df062e-e72c-48af-b30c-8b9fec1182e6 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:25.689418 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-63df062e-e72c-48af-b30c-8b9fec1182e6 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:25.690022 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-63df062e-e72c-48af-b30c-8b9fec1182e6 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:25.690438 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-63df062e-e72c-48af-b30c-8b9fec1182e6 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:25.940764 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-63df062e-e72c-48af-b30c-8b9fec1182e6 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:25.948033 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-59f60ec5-2db2-4d11-90fc-566485907092 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e" status: 200 len: 1857 microversion: 2.1 time: 0.310374 Oct 17 13:38:25.948851 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 618/1212] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:25 2022] GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e => generated 1857 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:25.950164 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-63df062e-e72c-48af-b30c-8b9fec1182e6 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/298b0f19-0a0c-4304-bb8b-4bd26cce2d9d" status: 200 len: 1324 microversion: 2.1 time: 0.289413 Oct 17 13:38:25.955245 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 595/1213] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:25 2022] GET /compute/v2.1/servers/298b0f19-0a0c-4304-bb8b-4bd26cce2d9d => generated 1324 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:25.955423 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0804b6b4-90ab-46f8-9756-9e1f4c79bb23 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:25.955423 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0804b6b4-90ab-46f8-9756-9e1f4c79bb23 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 0ffbef37-e5f8-4de2-a29d-dba6782a3fe4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:25.961236 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0804b6b4-90ab-46f8-9756-9e1f4c79bb23 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:25.961853 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0804b6b4-90ab-46f8-9756-9e1f4c79bb23 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:25.962550 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0804b6b4-90ab-46f8-9756-9e1f4c79bb23 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:25.963399 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0804b6b4-90ab-46f8-9756-9e1f4c79bb23 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:25.963953 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0804b6b4-90ab-46f8-9756-9e1f4c79bb23 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:25.964472 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0804b6b4-90ab-46f8-9756-9e1f4c79bb23 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:25.971568 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cb340b11-cd23-4afd-9ffe-3179aba6b23b tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:25.972525 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cb340b11-cd23-4afd-9ffe-3179aba6b23b tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] [instance: a54adf11-ee58-4f13-82c8-9a00a36c536e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:25.979489 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb340b11-cd23-4afd-9ffe-3179aba6b23b tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:25.979973 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb340b11-cd23-4afd-9ffe-3179aba6b23b tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:25.980401 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb340b11-cd23-4afd-9ffe-3179aba6b23b tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:25.981305 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb340b11-cd23-4afd-9ffe-3179aba6b23b tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:25.981753 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb340b11-cd23-4afd-9ffe-3179aba6b23b tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:25.982168 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb340b11-cd23-4afd-9ffe-3179aba6b23b tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:26.166853 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0804b6b4-90ab-46f8-9756-9e1f4c79bb23 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:26.175571 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0804b6b4-90ab-46f8-9756-9e1f4c79bb23 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:26.177077 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0804b6b4-90ab-46f8-9756-9e1f4c79bb23 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:26.178257 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0804b6b4-90ab-46f8-9756-9e1f4c79bb23 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4" status: 200 len: 1568 microversion: 2.25 time: 0.228587 Oct 17 13:38:26.178538 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cb340b11-cd23-4afd-9ffe-3179aba6b23b tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e" status: 200 len: 1857 microversion: 2.1 time: 0.210680 Oct 17 13:38:26.178785 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 619/1214] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:38:25 2022] GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4 => generated 1568 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:38:26.179086 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 596/1215] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:25 2022] GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e => generated 1857 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:38:26.183748 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9f98ce28-4329-4326-80b7-49e6c32a9c0d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:26.184069 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9f98ce28-4329-4326-80b7-49e6c32a9c0d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 07af9912-df9b-4476-92b3-48858617dd29] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:26.200591 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f98ce28-4329-4326-80b7-49e6c32a9c0d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:26.201081 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f98ce28-4329-4326-80b7-49e6c32a9c0d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:26.201512 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f98ce28-4329-4326-80b7-49e6c32a9c0d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:26.202181 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f98ce28-4329-4326-80b7-49e6c32a9c0d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:26.202630 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f98ce28-4329-4326-80b7-49e6c32a9c0d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:26.203070 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f98ce28-4329-4326-80b7-49e6c32a9c0d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:26.253695 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b95f7153-b572-4170-8fd0-f5a465874720 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:26.254395 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b95f7153-b572-4170-8fd0-f5a465874720 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: ae587603-994d-419d-979a-1b1361144872] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:26.261328 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b95f7153-b572-4170-8fd0-f5a465874720 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:26.261884 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b95f7153-b572-4170-8fd0-f5a465874720 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:26.262398 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b95f7153-b572-4170-8fd0-f5a465874720 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:26.263154 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b95f7153-b572-4170-8fd0-f5a465874720 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:26.263700 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b95f7153-b572-4170-8fd0-f5a465874720 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:26.264181 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b95f7153-b572-4170-8fd0-f5a465874720 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:26.399411 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9f98ce28-4329-4326-80b7-49e6c32a9c0d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:26.407858 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9f98ce28-4329-4326-80b7-49e6c32a9c0d tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/07af9912-df9b-4476-92b3-48858617dd29" status: 200 len: 1475 microversion: 2.1 time: 0.227806 Oct 17 13:38:26.408396 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 620/1216] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:26 2022] GET /compute/v2.1/servers/07af9912-df9b-4476-92b3-48858617dd29 => generated 1475 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:26.413417 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4916dcc4-c409-4049-be57-dba38dd7e062 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:26.413902 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4916dcc4-c409-4049-be57-dba38dd7e062 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: a54adf11-ee58-4f13-82c8-9a00a36c536e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:26.419984 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4916dcc4-c409-4049-be57-dba38dd7e062 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:26.420472 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4916dcc4-c409-4049-be57-dba38dd7e062 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:26.420903 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4916dcc4-c409-4049-be57-dba38dd7e062 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:26.421591 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4916dcc4-c409-4049-be57-dba38dd7e062 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:26.422044 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4916dcc4-c409-4049-be57-dba38dd7e062 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:26.422445 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4916dcc4-c409-4049-be57-dba38dd7e062 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:26.429056 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b95f7153-b572-4170-8fd0-f5a465874720 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:26.438282 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b95f7153-b572-4170-8fd0-f5a465874720 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872" status: 200 len: 1497 microversion: 2.1 time: 0.188265 Oct 17 13:38:26.438867 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 597/1217] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:26 2022] GET /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872 => generated 1497 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:38:26.443512 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-13a31a11-4444-4ecd-9ed5-45c48a83802a tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:26.444156 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-13a31a11-4444-4ecd-9ed5-45c48a83802a tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: 56f45c71-b693-48c4-a2b6-dcfea882eaa4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:26.450164 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-13a31a11-4444-4ecd-9ed5-45c48a83802a tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:26.450710 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-13a31a11-4444-4ecd-9ed5-45c48a83802a tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:26.451199 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-13a31a11-4444-4ecd-9ed5-45c48a83802a tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:26.451966 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-13a31a11-4444-4ecd-9ed5-45c48a83802a tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:26.452475 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-13a31a11-4444-4ecd-9ed5-45c48a83802a tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:26.452949 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-13a31a11-4444-4ecd-9ed5-45c48a83802a tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:26.513963 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-13a31a11-4444-4ecd-9ed5-45c48a83802a tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:26.521723 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-13a31a11-4444-4ecd-9ed5-45c48a83802a tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/56f45c71-b693-48c4-a2b6-dcfea882eaa4" status: 200 len: 1265 microversion: 2.1 time: 0.081723 Oct 17 13:38:26.522279 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 598/1218] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:26 2022] GET /compute/v2.1/servers/56f45c71-b693-48c4-a2b6-dcfea882eaa4 => generated 1265 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:26.550314 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-4916dcc4-c409-4049-be57-dba38dd7e062 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lazy-loading 'services' on Instance uuid a54adf11-ee58-4f13-82c8-9a00a36c536e {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:38:26.675494 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4916dcc4-c409-4049-be57-dba38dd7e062 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e/os-volume_attachments/0bd47343-44f4-4e4f-a2c1-3da24b3cd230" status: 202 len: 0 microversion: 2.1 time: 0.265214 Oct 17 13:38:26.676128 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 621/1219] 10.222.0.79 () {58 vars in 1416 bytes} [Mon Oct 17 13:38:26 2022] DELETE /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e/os-volume_attachments/0bd47343-44f4-4e4f-a2c1-3da24b3cd230 => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:38:26.685386 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0c3d0256-74e4-452a-92b6-1e89df23bce9 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:26.688179 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0c3d0256-74e4-452a-92b6-1e89df23bce9 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: a54adf11-ee58-4f13-82c8-9a00a36c536e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:26.695500 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0c3d0256-74e4-452a-92b6-1e89df23bce9 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:26.695939 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0c3d0256-74e4-452a-92b6-1e89df23bce9 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:26.696373 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0c3d0256-74e4-452a-92b6-1e89df23bce9 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:26.697070 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0c3d0256-74e4-452a-92b6-1e89df23bce9 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:26.697519 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0c3d0256-74e4-452a-92b6-1e89df23bce9 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:26.697938 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0c3d0256-74e4-452a-92b6-1e89df23bce9 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:26.724745 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:38:26.730314 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0c3d0256-74e4-452a-92b6-1e89df23bce9 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049758 Oct 17 13:38:26.730893 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 599/1220] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 13:38:26 2022] GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:38:26.976378 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-db7548be-e0a8-4779-9d1a-80ff482af8c4 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:26.977217 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-db7548be-e0a8-4779-9d1a-80ff482af8c4 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 298b0f19-0a0c-4304-bb8b-4bd26cce2d9d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:26.993382 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db7548be-e0a8-4779-9d1a-80ff482af8c4 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:26.993984 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db7548be-e0a8-4779-9d1a-80ff482af8c4 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:26.994415 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db7548be-e0a8-4779-9d1a-80ff482af8c4 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:26.995118 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db7548be-e0a8-4779-9d1a-80ff482af8c4 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:26.995584 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db7548be-e0a8-4779-9d1a-80ff482af8c4 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:26.995998 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db7548be-e0a8-4779-9d1a-80ff482af8c4 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:27.209659 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d4e2da27-2598-44b9-a77a-b57f8918f8a7 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:27.210680 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d4e2da27-2598-44b9-a77a-b57f8918f8a7 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 0ffbef37-e5f8-4de2-a29d-dba6782a3fe4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:27.220479 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d4e2da27-2598-44b9-a77a-b57f8918f8a7 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:27.221107 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d4e2da27-2598-44b9-a77a-b57f8918f8a7 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:27.221605 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d4e2da27-2598-44b9-a77a-b57f8918f8a7 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:27.223193 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d4e2da27-2598-44b9-a77a-b57f8918f8a7 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:27.223670 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d4e2da27-2598-44b9-a77a-b57f8918f8a7 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:27.224096 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d4e2da27-2598-44b9-a77a-b57f8918f8a7 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:27.265884 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-db7548be-e0a8-4779-9d1a-80ff482af8c4 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:27.299260 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-db7548be-e0a8-4779-9d1a-80ff482af8c4 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/298b0f19-0a0c-4304-bb8b-4bd26cce2d9d" status: 200 len: 1324 microversion: 2.1 time: 0.328294 Oct 17 13:38:27.312455 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 622/1221] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:26 2022] GET /compute/v2.1/servers/298b0f19-0a0c-4304-bb8b-4bd26cce2d9d => generated 1324 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:27.351221 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-d02862ed-685a-4c2f-bbdb-5f9cad4c2a13 req-947b1b60-0d58-472c-9eda-4093c2e5f226 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03e8be7f-09be-488a-95ee-6951b53e35de", "name": "network-vif-deleted", "tag": "c0d55331-8725-4b8f-8583-c7d47cad2300"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:38:27.362120 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-d02862ed-685a-4c2f-bbdb-5f9cad4c2a13 req-947b1b60-0d58-472c-9eda-4093c2e5f226 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:27.362602 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-d02862ed-685a-4c2f-bbdb-5f9cad4c2a13 req-947b1b60-0d58-472c-9eda-4093c2e5f226 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:27.363034 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-d02862ed-685a-4c2f-bbdb-5f9cad4c2a13 req-947b1b60-0d58-472c-9eda-4093c2e5f226 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:27.375991 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-d02862ed-685a-4c2f-bbdb-5f9cad4c2a13 req-947b1b60-0d58-472c-9eda-4093c2e5f226 service nova] Creating event network-vif-deleted:c0d55331-8725-4b8f-8583-c7d47cad2300 for instance 03e8be7f-09be-488a-95ee-6951b53e35de on n-h1-854247-14 Oct 17 13:38:27.382926 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-d02862ed-685a-4c2f-bbdb-5f9cad4c2a13 req-947b1b60-0d58-472c-9eda-4093c2e5f226 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034840 Oct 17 13:38:27.383845 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 623/1222] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:38:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:38:27.435527 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ab92f09f-7e14-47bb-944e-ef6f2042d64e tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:27.438294 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ab92f09f-7e14-47bb-944e-ef6f2042d64e tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 07af9912-df9b-4476-92b3-48858617dd29] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:27.447467 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d4e2da27-2598-44b9-a77a-b57f8918f8a7 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:27.466421 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d4e2da27-2598-44b9-a77a-b57f8918f8a7 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:27.469558 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ab92f09f-7e14-47bb-944e-ef6f2042d64e tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:27.469959 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d4e2da27-2598-44b9-a77a-b57f8918f8a7 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:27.471356 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d4e2da27-2598-44b9-a77a-b57f8918f8a7 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4" status: 200 len: 1568 microversion: 2.25 time: 0.269770 Oct 17 13:38:27.472252 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ab92f09f-7e14-47bb-944e-ef6f2042d64e tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:27.473559 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ab92f09f-7e14-47bb-944e-ef6f2042d64e tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:27.474354 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ab92f09f-7e14-47bb-944e-ef6f2042d64e tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:27.474826 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ab92f09f-7e14-47bb-944e-ef6f2042d64e tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:27.475280 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ab92f09f-7e14-47bb-944e-ef6f2042d64e tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:27.476045 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 600/1223] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:38:27 2022] GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4 => generated 1568 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:38:27.491382 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ce4b6dd2-63ef-400a-b969-e1d45ef7ce3a tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:27.494320 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ce4b6dd2-63ef-400a-b969-e1d45ef7ce3a tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: ae587603-994d-419d-979a-1b1361144872] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:27.514152 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ce4b6dd2-63ef-400a-b969-e1d45ef7ce3a tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:27.516332 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ce4b6dd2-63ef-400a-b969-e1d45ef7ce3a tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:27.516872 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ce4b6dd2-63ef-400a-b969-e1d45ef7ce3a tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:27.518364 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ce4b6dd2-63ef-400a-b969-e1d45ef7ce3a tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:27.521437 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ce4b6dd2-63ef-400a-b969-e1d45ef7ce3a tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:27.526044 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ce4b6dd2-63ef-400a-b969-e1d45ef7ce3a tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:27.607014 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ab92f09f-7e14-47bb-944e-ef6f2042d64e tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:27.619931 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ab92f09f-7e14-47bb-944e-ef6f2042d64e tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/07af9912-df9b-4476-92b3-48858617dd29" status: 200 len: 1433 microversion: 2.1 time: 0.191792 Oct 17 13:38:27.621037 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 624/1224] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:27 2022] GET /compute/v2.1/servers/07af9912-df9b-4476-92b3-48858617dd29 => generated 1433 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:27.626835 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4b93380a-26c8-40fe-be8e-333b9d0828d3 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:27.627779 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4b93380a-26c8-40fe-be8e-333b9d0828d3 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: 56f45c71-b693-48c4-a2b6-dcfea882eaa4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:27.636172 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4b93380a-26c8-40fe-be8e-333b9d0828d3 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:27.637743 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4b93380a-26c8-40fe-be8e-333b9d0828d3 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:27.638432 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4b93380a-26c8-40fe-be8e-333b9d0828d3 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:27.639194 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4b93380a-26c8-40fe-be8e-333b9d0828d3 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:27.640561 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4b93380a-26c8-40fe-be8e-333b9d0828d3 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:27.641253 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4b93380a-26c8-40fe-be8e-333b9d0828d3 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:27.754034 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4b93380a-26c8-40fe-be8e-333b9d0828d3 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:27.767834 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4b93380a-26c8-40fe-be8e-333b9d0828d3 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/56f45c71-b693-48c4-a2b6-dcfea882eaa4" status: 200 len: 1273 microversion: 2.1 time: 0.144207 Oct 17 13:38:27.769601 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 625/1225] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:27 2022] GET /compute/v2.1/servers/56f45c71-b693-48c4-a2b6-dcfea882eaa4 => generated 1273 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:27.774775 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-fbf66ede-02b6-435d-8861-9872c300507e req-42f0eaf6-c3c8-4f1b-a161-cefcfb8236cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07af9912-df9b-4476-92b3-48858617dd29", "name": "network-vif-deleted", "tag": "388a5339-117b-43e8-8264-a1aceb3ad3f6"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:38:27.777171 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ce4b6dd2-63ef-400a-b969-e1d45ef7ce3a tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:27.785591 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-fbf66ede-02b6-435d-8861-9872c300507e req-42f0eaf6-c3c8-4f1b-a161-cefcfb8236cf service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:27.786237 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-fbf66ede-02b6-435d-8861-9872c300507e req-42f0eaf6-c3c8-4f1b-a161-cefcfb8236cf service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:27.786796 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-fbf66ede-02b6-435d-8861-9872c300507e req-42f0eaf6-c3c8-4f1b-a161-cefcfb8236cf service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:27.798970 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ce4b6dd2-63ef-400a-b969-e1d45ef7ce3a tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872" status: 200 len: 1497 microversion: 2.1 time: 0.321270 Oct 17 13:38:27.800686 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 601/1226] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:27 2022] GET /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872 => generated 1497 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:27.801810 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-fbf66ede-02b6-435d-8861-9872c300507e req-42f0eaf6-c3c8-4f1b-a161-cefcfb8236cf service nova] Creating event network-vif-deleted:388a5339-117b-43e8-8264-a1aceb3ad3f6 for instance 07af9912-df9b-4476-92b3-48858617dd29 on n-h1-854247-14 Oct 17 13:38:27.806013 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-94928f86-57da-4f5a-9797-98f8f4eca848 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:27.808695 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-94928f86-57da-4f5a-9797-98f8f4eca848 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: a54adf11-ee58-4f13-82c8-9a00a36c536e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:27.812739 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-fbf66ede-02b6-435d-8861-9872c300507e req-42f0eaf6-c3c8-4f1b-a161-cefcfb8236cf service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040918 Oct 17 13:38:27.813993 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 626/1227] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:38:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:38:27.823112 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94928f86-57da-4f5a-9797-98f8f4eca848 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:27.823976 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94928f86-57da-4f5a-9797-98f8f4eca848 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:27.824473 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94928f86-57da-4f5a-9797-98f8f4eca848 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:27.825381 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94928f86-57da-4f5a-9797-98f8f4eca848 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:27.826206 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94928f86-57da-4f5a-9797-98f8f4eca848 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:27.826847 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94928f86-57da-4f5a-9797-98f8f4eca848 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:27.866107 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-94928f86-57da-4f5a-9797-98f8f4eca848 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064242 Oct 17 13:38:27.866817 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 602/1228] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 13:38:27 2022] GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:38:28.330697 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3226b305-0c3d-43c9-a974-3dcd0d7d8ed6 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:28.332573 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3226b305-0c3d-43c9-a974-3dcd0d7d8ed6 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 298b0f19-0a0c-4304-bb8b-4bd26cce2d9d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:28.345023 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3226b305-0c3d-43c9-a974-3dcd0d7d8ed6 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:28.347194 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3226b305-0c3d-43c9-a974-3dcd0d7d8ed6 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:28.357249 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3226b305-0c3d-43c9-a974-3dcd0d7d8ed6 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:28.358624 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3226b305-0c3d-43c9-a974-3dcd0d7d8ed6 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:28.359372 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3226b305-0c3d-43c9-a974-3dcd0d7d8ed6 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:28.360012 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3226b305-0c3d-43c9-a974-3dcd0d7d8ed6 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:28.503116 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4ef917d1-3313-430d-8081-a8b94d966982 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:28.503825 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4ef917d1-3313-430d-8081-a8b94d966982 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 0ffbef37-e5f8-4de2-a29d-dba6782a3fe4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:28.511744 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4ef917d1-3313-430d-8081-a8b94d966982 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:28.512514 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4ef917d1-3313-430d-8081-a8b94d966982 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:28.513128 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4ef917d1-3313-430d-8081-a8b94d966982 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:28.514052 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4ef917d1-3313-430d-8081-a8b94d966982 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:28.514734 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4ef917d1-3313-430d-8081-a8b94d966982 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:28.515363 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4ef917d1-3313-430d-8081-a8b94d966982 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:28.756303 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3226b305-0c3d-43c9-a974-3dcd0d7d8ed6 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:28.771359 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3226b305-0c3d-43c9-a974-3dcd0d7d8ed6 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/298b0f19-0a0c-4304-bb8b-4bd26cce2d9d" status: 200 len: 1520 microversion: 2.1 time: 0.448755 Oct 17 13:38:28.784561 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 627/1229] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:28 2022] GET /compute/v2.1/servers/298b0f19-0a0c-4304-bb8b-4bd26cce2d9d => generated 1520 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:28.798378 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4ef917d1-3313-430d-8081-a8b94d966982 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:28.806701 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7088b452-5cc9-40e1-91fb-db266828f235 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:28.807858 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7088b452-5cc9-40e1-91fb-db266828f235 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 07af9912-df9b-4476-92b3-48858617dd29] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:28.810227 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4ef917d1-3313-430d-8081-a8b94d966982 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:28.812280 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4ef917d1-3313-430d-8081-a8b94d966982 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:28.813616 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4ef917d1-3313-430d-8081-a8b94d966982 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4" status: 200 len: 1568 microversion: 2.25 time: 0.314477 Oct 17 13:38:28.818207 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7088b452-5cc9-40e1-91fb-db266828f235 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:28.818750 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7088b452-5cc9-40e1-91fb-db266828f235 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:28.819513 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7088b452-5cc9-40e1-91fb-db266828f235 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:28.821590 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7088b452-5cc9-40e1-91fb-db266828f235 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:28.822158 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7088b452-5cc9-40e1-91fb-db266828f235 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:28.822695 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7088b452-5cc9-40e1-91fb-db266828f235 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:28.826987 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 603/1230] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:38:28 2022] GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4 => generated 1568 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:38:28.839349 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5fae3938-7e9f-406b-9c0b-771860599a39 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:28.840910 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5fae3938-7e9f-406b-9c0b-771860599a39 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: 56f45c71-b693-48c4-a2b6-dcfea882eaa4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:28.854681 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5fae3938-7e9f-406b-9c0b-771860599a39 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:28.855427 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5fae3938-7e9f-406b-9c0b-771860599a39 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:28.856007 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5fae3938-7e9f-406b-9c0b-771860599a39 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:28.856967 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5fae3938-7e9f-406b-9c0b-771860599a39 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:28.857702 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5fae3938-7e9f-406b-9c0b-771860599a39 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:28.858269 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5fae3938-7e9f-406b-9c0b-771860599a39 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:28.864868 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7088b452-5cc9-40e1-91fb-db266828f235 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:28.865614 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7088b452-5cc9-40e1-91fb-db266828f235 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:28.866145 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7088b452-5cc9-40e1-91fb-db266828f235 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:28.866687 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-7088b452-5cc9-40e1-91fb-db266828f235 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lazy-loading 'fault' on Instance uuid 07af9912-df9b-4476-92b3-48858617dd29 {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:38:28.973352 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7088b452-5cc9-40e1-91fb-db266828f235 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:28.982413 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7088b452-5cc9-40e1-91fb-db266828f235 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/07af9912-df9b-4476-92b3-48858617dd29" status: 200 len: 1309 microversion: 2.1 time: 0.196062 Oct 17 13:38:28.982892 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 628/1231] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:28 2022] GET /compute/v2.1/servers/07af9912-df9b-4476-92b3-48858617dd29 => generated 1309 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:29.000526 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ef3a673c-b7a9-403e-b43d-ba490c2ef9c3 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:29.001305 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ef3a673c-b7a9-403e-b43d-ba490c2ef9c3 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 298b0f19-0a0c-4304-bb8b-4bd26cce2d9d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:29.005019 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5fae3938-7e9f-406b-9c0b-771860599a39 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:29.008427 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ef3a673c-b7a9-403e-b43d-ba490c2ef9c3 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:29.009397 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ef3a673c-b7a9-403e-b43d-ba490c2ef9c3 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:29.010030 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ef3a673c-b7a9-403e-b43d-ba490c2ef9c3 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:29.010934 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ef3a673c-b7a9-403e-b43d-ba490c2ef9c3 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:29.011598 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ef3a673c-b7a9-403e-b43d-ba490c2ef9c3 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:29.012408 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ef3a673c-b7a9-403e-b43d-ba490c2ef9c3 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:29.024117 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5fae3938-7e9f-406b-9c0b-771860599a39 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/56f45c71-b693-48c4-a2b6-dcfea882eaa4" status: 200 len: 1271 microversion: 2.1 time: 0.195595 Oct 17 13:38:29.024664 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 604/1232] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:28 2022] GET /compute/v2.1/servers/56f45c71-b693-48c4-a2b6-dcfea882eaa4 => generated 1271 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:29.029248 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3d58562b-714a-4e5c-ba14-d0a8f92eac07 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:29.029856 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3d58562b-714a-4e5c-ba14-d0a8f92eac07 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: ae587603-994d-419d-979a-1b1361144872] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:29.048170 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3d58562b-714a-4e5c-ba14-d0a8f92eac07 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:29.048659 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3d58562b-714a-4e5c-ba14-d0a8f92eac07 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:29.049087 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3d58562b-714a-4e5c-ba14-d0a8f92eac07 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:29.049798 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3d58562b-714a-4e5c-ba14-d0a8f92eac07 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:29.050324 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3d58562b-714a-4e5c-ba14-d0a8f92eac07 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:29.050746 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3d58562b-714a-4e5c-ba14-d0a8f92eac07 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:29.531129 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ef3a673c-b7a9-403e-b43d-ba490c2ef9c3 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:29.541857 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ef3a673c-b7a9-403e-b43d-ba490c2ef9c3 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/298b0f19-0a0c-4304-bb8b-4bd26cce2d9d" status: 200 len: 1520 microversion: 2.1 time: 0.546406 Oct 17 13:38:29.544014 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 629/1233] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:28 2022] GET /compute/v2.1/servers/298b0f19-0a0c-4304-bb8b-4bd26cce2d9d => generated 1520 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:29.550753 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c9090d7c-023e-4767-9305-30b0db41eb09 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:29.553879 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c9090d7c-023e-4767-9305-30b0db41eb09 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: a54adf11-ee58-4f13-82c8-9a00a36c536e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:29.571356 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c9090d7c-023e-4767-9305-30b0db41eb09 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:29.572390 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c9090d7c-023e-4767-9305-30b0db41eb09 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:29.573231 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c9090d7c-023e-4767-9305-30b0db41eb09 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:29.574638 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c9090d7c-023e-4767-9305-30b0db41eb09 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:29.575385 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c9090d7c-023e-4767-9305-30b0db41eb09 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:29.576161 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c9090d7c-023e-4767-9305-30b0db41eb09 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:29.586908 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3d58562b-714a-4e5c-ba14-d0a8f92eac07 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:29.630264 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3d58562b-714a-4e5c-ba14-d0a8f92eac07 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872" status: 200 len: 1497 microversion: 2.1 time: 0.602141 Oct 17 13:38:29.632664 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 605/1234] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:29 2022] GET /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872 => generated 1497 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:29.661598 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ef9d724f-4683-449a-96f1-f79baa0d19a9 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-129351110"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:38:29.666796 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ef9d724f-4683-449a-96f1-f79baa0d19a9 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 298b0f19-0a0c-4304-bb8b-4bd26cce2d9d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:29.681626 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ef9d724f-4683-449a-96f1-f79baa0d19a9 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:29.683057 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c9090d7c-023e-4767-9305-30b0db41eb09 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137045 Oct 17 13:38:29.683905 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 630/1235] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 13:38:29 2022] GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:38:29.685038 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ef9d724f-4683-449a-96f1-f79baa0d19a9 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:29.685473 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ef9d724f-4683-449a-96f1-f79baa0d19a9 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:29.686183 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ef9d724f-4683-449a-96f1-f79baa0d19a9 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:29.686944 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ef9d724f-4683-449a-96f1-f79baa0d19a9 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:29.687392 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ef9d724f-4683-449a-96f1-f79baa0d19a9 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:29.854283 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8c853f93-9ba2-482a-b25d-c81ff70d7065 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:29.855000 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8c853f93-9ba2-482a-b25d-c81ff70d7065 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 0ffbef37-e5f8-4de2-a29d-dba6782a3fe4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:29.858668 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:38:29.864115 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8c853f93-9ba2-482a-b25d-c81ff70d7065 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:29.865053 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8c853f93-9ba2-482a-b25d-c81ff70d7065 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:29.865751 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8c853f93-9ba2-482a-b25d-c81ff70d7065 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:29.866583 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8c853f93-9ba2-482a-b25d-c81ff70d7065 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:29.867144 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8c853f93-9ba2-482a-b25d-c81ff70d7065 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:29.867858 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8c853f93-9ba2-482a-b25d-c81ff70d7065 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:29.953475 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ef9d724f-4683-449a-96f1-f79baa0d19a9 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "POST /compute/v2.1/servers/298b0f19-0a0c-4304-bb8b-4bd26cce2d9d/action" status: 202 len: 0 microversion: 2.1 time: 0.305155 Oct 17 13:38:29.960004 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 606/1236] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:38:29 2022] POST /compute/v2.1/servers/298b0f19-0a0c-4304-bb8b-4bd26cce2d9d/action => generated 0 bytes in 327 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 17 13:38:29.966828 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a1b75ab9-bdca-4068-8f16-3213bc67a6af tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '.version_select at 0x7f7cd53fb790>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:30.120665 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a1b75ab9-bdca-4068-8f16-3213bc67a6af tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "DELETE /compute/v2.1/images/d67f13de-2fb7-40a9-a64c-1610a34e5fa4" status: 204 len: 0 microversion: 2.1 time: 0.159000 Oct 17 13:38:30.126342 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 607/1237] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:29 2022] DELETE /compute/v2.1/images/d67f13de-2fb7-40a9-a64c-1610a34e5fa4 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:38:30.132174 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a1ab3083-019d-49d3-a66f-e60af4ace886 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:30.133302 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a1ab3083-019d-49d3-a66f-e60af4ace886 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 07af9912-df9b-4476-92b3-48858617dd29] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:30.141669 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a1ab3083-019d-49d3-a66f-e60af4ace886 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:30.142497 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a1ab3083-019d-49d3-a66f-e60af4ace886 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:30.143422 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a1ab3083-019d-49d3-a66f-e60af4ace886 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:30.144372 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a1ab3083-019d-49d3-a66f-e60af4ace886 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:30.145026 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a1ab3083-019d-49d3-a66f-e60af4ace886 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:30.145644 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a1ab3083-019d-49d3-a66f-e60af4ace886 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:30.165781 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-a1ab3083-019d-49d3-a66f-e60af4ace886 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] HTTP exception thrown: Instance 07af9912-df9b-4476-92b3-48858617dd29 could not be found. Oct 17 13:38:30.168007 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a1ab3083-019d-49d3-a66f-e60af4ace886 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Request method failure captured: Oct 17 13:38:30.168007 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/07af9912-df9b-4476-92b3-48858617dd29 HTTP/1.1 Oct 17 13:38:30.168007 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:38:30.168007 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:38:30.168007 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:38:30.168007 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:38:30.168007 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:38:30.168007 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:38:30.168007 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:38:30.168007 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:38:30.168007 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVn0rKCCzxL1KwIZI1Im8ygkuewY-UzF6Z81i6cNkagTk7ClET_LM7mvJkIi7s6pFyo0jkOjEfkZnFMR6ojJjeKHBwoksuv9Z4X8LYNw4iNhGgW8aAiE8QzHsCgl5CJTTDwKklbNcQOJJRXIUfAtc0cseQ_bknPsrUPdOoFAaQy0_jg Oct 17 13:38:30.168007 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:38:30.168007 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:38:30.168007 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:38:30.168007 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:38:30.168007 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:38:30.168007 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:38:30.168007 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: fa1db260a96a4c6aa69cd6437baab6f7 Oct 17 13:38:30.168007 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServersOnMultiNodesTest-1107099453 Oct 17 13:38:30.168007 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:38:30.168007 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:38:30.169688 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/fa1db260a96a4c6aa69cd6437baab6f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/fa1db260a96a4c6aa69cd6437baab6f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/fa1db260a96a4c6aa69cd6437baab6f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_fa1db260a96a4c6aa69cd6437baab6f7", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:38:30.169688 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServersOnMultiNodesTest-1107099453 Oct 17 13:38:30.169688 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: fa1db260a96a4c6aa69cd6437baab6f7 Oct 17 13:38:30.169688 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1107099453 Oct 17 13:38:30.169688 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServersOnMultiNodesTest-1107099453-project Oct 17 13:38:30.169688 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:38:30.169688 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:38:30.169688 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 7a7e082035084338966a1c56b30c7093 Oct 17 13:38:30.169688 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServersOnMultiNodesTest-1107099453-project Oct 17 13:38:30.169688 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:38:30.169688 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 07af9912-df9b-4476-92b3-48858617dd29 could not be found. Oct 17 13:38:30.169688 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '07af9912-df9b-4476-92b3-48858617dd29'} Oct 17 13:38:30.170626 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:38:30.170626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:38:30.170626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:38:30.170626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:38:30.170626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:38:30.170626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:38:30.170626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:38:30.170626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:38:30.170626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:38:30.170626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:38:30.170626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07af9912-df9b-4476-92b3-48858617dd29 could not be found. Oct 17 13:38:30.170626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:38:30.170626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:38:30.170626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:38:30.170626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:38:30.170626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:38:30.170626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:38:30.170626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:38:30.170626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:38:30.170626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:38:30.172201 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:38:30.172201 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:38:30.172201 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:38:30.172201 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:38:30.172201 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:38:30.172201 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:38:30.172201 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:38:30.172201 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07af9912-df9b-4476-92b3-48858617dd29 could not be found. Oct 17 13:38:30.172201 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:38:30.172201 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:38:30.172201 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:38:30.172201 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:38:30.172201 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:38:30.172201 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:38:30.172201 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:38:30.172201 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:38:30.172201 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07af9912-df9b-4476-92b3-48858617dd29 could not be found. Oct 17 13:38:30.172201 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:38:30.175889 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a1ab3083-019d-49d3-a66f-e60af4ace886 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Returning 404 to user: Instance 07af9912-df9b-4476-92b3-48858617dd29 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:38:30.177203 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a1ab3083-019d-49d3-a66f-e60af4ace886 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/07af9912-df9b-4476-92b3-48858617dd29" status: 404 len: 111 microversion: 2.1 time: 0.049885 Oct 17 13:38:30.178023 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 608/1238] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:30 2022] GET /compute/v2.1/servers/07af9912-df9b-4476-92b3-48858617dd29 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:38:30.183144 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-da2ecbb9-3c5b-4475-84a2-60a85698c35e tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:30.183937 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-da2ecbb9-3c5b-4475-84a2-60a85698c35e tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: 56f45c71-b693-48c4-a2b6-dcfea882eaa4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:30.191452 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-da2ecbb9-3c5b-4475-84a2-60a85698c35e tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:30.192064 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-da2ecbb9-3c5b-4475-84a2-60a85698c35e tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:30.192574 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-da2ecbb9-3c5b-4475-84a2-60a85698c35e tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:30.193397 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-da2ecbb9-3c5b-4475-84a2-60a85698c35e tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:30.193928 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-da2ecbb9-3c5b-4475-84a2-60a85698c35e tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:30.194991 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-da2ecbb9-3c5b-4475-84a2-60a85698c35e tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:30.590045 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8c853f93-9ba2-482a-b25d-c81ff70d7065 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:30.601597 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8c853f93-9ba2-482a-b25d-c81ff70d7065 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:30.603885 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8c853f93-9ba2-482a-b25d-c81ff70d7065 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:30.605728 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8c853f93-9ba2-482a-b25d-c81ff70d7065 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4" status: 200 len: 1568 microversion: 2.25 time: 0.756650 Oct 17 13:38:30.606791 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 631/1239] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:38:29 2022] GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4 => generated 1568 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:38:30.612489 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e8486890-5f3b-42b4-beef-b174babfc1d4 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '.version_select at 0x7f7cd53fa160>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:30.644444 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-e8486890-5f3b-42b4-beef-b174babfc1d4 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] HTTP exception thrown: Image not found. Oct 17 13:38:30.657623 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e8486890-5f3b-42b4-beef-b174babfc1d4 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Request method failure captured: Oct 17 13:38:30.657623 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/images/d67f13de-2fb7-40a9-a64c-1610a34e5fa4 HTTP/1.1 Oct 17 13:38:30.657623 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:38:30.657623 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:38:30.657623 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:38:30.657623 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:38:30.657623 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:38:30.657623 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:38:30.657623 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:38:30.657623 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:38:30.657623 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVp-7IxfFP3OCFXwoptz1mkTvVFP-q1mVdb9duvFJBSFB2Milojb0bt4JEkHbyx5bSK8AUBQstoN0fpOUoelRV9Ur5eKS-T70viEjT2k_9W3ZeERt1Gvx_VBqcxVNMvlXoLi-KthVHD7so8JMwaOern88ECZl5tX1TwIw6qcARP1TSo Oct 17 13:38:30.657623 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:38:30.657623 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:38:30.657623 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:38:30.657623 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:38:30.657623 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:38:30.657623 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:38:30.657623 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: c7507d1dd2d345ca9b59dcaa7806b56e Oct 17 13:38:30.657623 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2045461887 Oct 17 13:38:30.657623 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:38:30.657623 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:38:30.659199 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c7507d1dd2d345ca9b59dcaa7806b56e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c7507d1dd2d345ca9b59dcaa7806b56e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c7507d1dd2d345ca9b59dcaa7806b56e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c7507d1dd2d345ca9b59dcaa7806b56e", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:38:30.659199 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2045461887 Oct 17 13:38:30.659199 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: c7507d1dd2d345ca9b59dcaa7806b56e Oct 17 13:38:30.659199 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2045461887 Oct 17 13:38:30.659199 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ImagesOneServerNegativeTestJSON-2045461887-project Oct 17 13:38:30.659199 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:38:30.659199 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:38:30.659199 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: dcbd60cab4174e8db26e28f015795e1f Oct 17 13:38:30.659199 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2045461887-project Oct 17 13:38:30.659199 n-d-854247-14 devstack@n-api.service[127017]: method: Oct 17 13:38:30.659199 n-d-854247-14 devstack@n-api.service[127017]: exception: Image not found. Oct 17 13:38:30.659199 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'd67f13de-2fb7-40a9-a64c-1610a34e5fa4'} Oct 17 13:38:30.659199 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:38:30.660123 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:38:30.660123 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 13:38:30.660123 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 13:38:30.660123 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:38:30.660123 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:38:30.660123 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 13:38:30.660123 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 13:38:30.660123 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:38:30.660123 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:38:30.660123 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 13:38:30.660123 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 13:38:30.660123 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 13:38:30.660123 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 13:38:30.660123 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:38:30.660123 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:38:30.660123 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:38:30.660123 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:38:30.660123 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d67f13de-2fb7-40a9-a64c-1610a34e5fa4 Oct 17 13:38:30.661450 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:38:30.661450 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:38:30.661450 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:38:30.661450 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:38:30.661450 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 17 13:38:30.661450 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 17 13:38:30.661450 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 17 13:38:30.661450 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 17 13:38:30.661450 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 17 13:38:30.661450 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 17 13:38:30.661450 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 17 13:38:30.661450 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 17 13:38:30.661450 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 13:38:30.661450 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 13:38:30.661450 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:38:30.661450 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:38:30.661450 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 13:38:30.661450 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 13:38:30.661450 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:38:30.661450 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:38:30.663502 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 13:38:30.663502 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 13:38:30.663502 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 13:38:30.663502 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 13:38:30.663502 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:38:30.663502 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:38:30.663502 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:38:30.663502 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:38:30.663502 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d67f13de-2fb7-40a9-a64c-1610a34e5fa4 could not be found. Oct 17 13:38:30.663502 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:38:30.663502 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:38:30.663502 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:38:30.663502 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:38:30.663502 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:38:30.663502 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:38:30.663502 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:38:30.663502 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:38:30.663502 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:38:30.663502 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:38:30.665196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:38:30.665196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:38:30.665196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 17 13:38:30.665196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 13:38:30.665196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 13:38:30.665196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:38:30.665196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:38:30.665196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:38:30.665196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:38:30.665196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:38:30.665196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:38:30.665196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:38:30.665196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:38:30.665196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 13:38:30.665196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:38:30.667957 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e8486890-5f3b-42b4-beef-b174babfc1d4 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Returning 404 to user: Image not found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:38:30.668871 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e8486890-5f3b-42b4-beef-b174babfc1d4 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/images/d67f13de-2fb7-40a9-a64c-1610a34e5fa4" status: 404 len: 62 microversion: 2.1 time: 0.060881 Oct 17 13:38:30.669671 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 632/1240] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:38:30 2022] GET /compute/v2.1/images/d67f13de-2fb7-40a9-a64c-1610a34e5fa4 => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:38:30.677067 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e9a88386-b987-45dc-a8eb-0aab15d27d9a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:30.678543 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e9a88386-b987-45dc-a8eb-0aab15d27d9a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 03e8be7f-09be-488a-95ee-6951b53e35de] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:30.686037 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-da2ecbb9-3c5b-4475-84a2-60a85698c35e tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:30.689025 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e9a88386-b987-45dc-a8eb-0aab15d27d9a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:30.689510 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e9a88386-b987-45dc-a8eb-0aab15d27d9a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:30.689942 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e9a88386-b987-45dc-a8eb-0aab15d27d9a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:30.690716 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e9a88386-b987-45dc-a8eb-0aab15d27d9a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:30.691448 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e9a88386-b987-45dc-a8eb-0aab15d27d9a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:30.691873 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e9a88386-b987-45dc-a8eb-0aab15d27d9a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:30.700736 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-da2ecbb9-3c5b-4475-84a2-60a85698c35e tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/56f45c71-b693-48c4-a2b6-dcfea882eaa4" status: 200 len: 1313 microversion: 2.1 time: 0.521414 Oct 17 13:38:30.701649 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 609/1241] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:30 2022] GET /compute/v2.1/servers/56f45c71-b693-48c4-a2b6-dcfea882eaa4 => generated 1313 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:30.707264 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5e564f7d-797c-4168-a0d0-87ceeb53a3c8 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:30.708919 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5e564f7d-797c-4168-a0d0-87ceeb53a3c8 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: ae587603-994d-419d-979a-1b1361144872] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:30.710519 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-e9a88386-b987-45dc-a8eb-0aab15d27d9a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] HTTP exception thrown: Instance 03e8be7f-09be-488a-95ee-6951b53e35de could not be found. Oct 17 13:38:30.712211 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e9a88386-b987-45dc-a8eb-0aab15d27d9a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Request method failure captured: Oct 17 13:38:30.712211 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/03e8be7f-09be-488a-95ee-6951b53e35de HTTP/1.1 Oct 17 13:38:30.712211 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:38:30.712211 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:38:30.712211 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:38:30.712211 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:38:30.712211 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:38:30.712211 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:38:30.712211 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:38:30.712211 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:38:30.712211 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVn0rKCCzxL1KwIZI1Im8ygkuewY-UzF6Z81i6cNkagTk7ClET_LM7mvJkIi7s6pFyo0jkOjEfkZnFMR6ojJjeKHBwoksuv9Z4X8LYNw4iNhGgW8aAiE8QzHsCgl5CJTTDwKklbNcQOJJRXIUfAtc0cseQ_bknPsrUPdOoFAaQy0_jg Oct 17 13:38:30.712211 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:38:30.712211 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:38:30.712211 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:38:30.712211 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:38:30.712211 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:38:30.712211 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:38:30.712211 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: fa1db260a96a4c6aa69cd6437baab6f7 Oct 17 13:38:30.712211 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServersOnMultiNodesTest-1107099453 Oct 17 13:38:30.712211 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:38:30.712211 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:38:30.713748 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/fa1db260a96a4c6aa69cd6437baab6f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/fa1db260a96a4c6aa69cd6437baab6f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/fa1db260a96a4c6aa69cd6437baab6f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_fa1db260a96a4c6aa69cd6437baab6f7", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:38:30.713748 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServersOnMultiNodesTest-1107099453 Oct 17 13:38:30.713748 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: fa1db260a96a4c6aa69cd6437baab6f7 Oct 17 13:38:30.713748 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1107099453 Oct 17 13:38:30.713748 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServersOnMultiNodesTest-1107099453-project Oct 17 13:38:30.713748 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:38:30.713748 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:38:30.713748 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 7a7e082035084338966a1c56b30c7093 Oct 17 13:38:30.713748 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServersOnMultiNodesTest-1107099453-project Oct 17 13:38:30.713748 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:38:30.713748 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 03e8be7f-09be-488a-95ee-6951b53e35de could not be found. Oct 17 13:38:30.713748 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '03e8be7f-09be-488a-95ee-6951b53e35de'} Oct 17 13:38:30.714503 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:38:30.714503 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:38:30.714503 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:38:30.714503 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:38:30.714503 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:38:30.714503 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:38:30.714503 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:38:30.714503 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:38:30.714503 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:38:30.714503 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:38:30.714503 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03e8be7f-09be-488a-95ee-6951b53e35de could not be found. Oct 17 13:38:30.714503 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:38:30.714503 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:38:30.714503 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:38:30.714503 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:38:30.714503 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:38:30.714503 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:38:30.714503 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:38:30.714503 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:38:30.714503 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:38:30.716504 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:38:30.716504 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:38:30.716504 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:38:30.716504 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:38:30.716504 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:38:30.716504 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:38:30.716504 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:38:30.716504 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03e8be7f-09be-488a-95ee-6951b53e35de could not be found. Oct 17 13:38:30.716504 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:38:30.716504 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:38:30.716504 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:38:30.716504 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:38:30.716504 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:38:30.716504 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:38:30.716504 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:38:30.716504 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:38:30.716504 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03e8be7f-09be-488a-95ee-6951b53e35de could not be found. Oct 17 13:38:30.716504 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:38:30.718897 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e9a88386-b987-45dc-a8eb-0aab15d27d9a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Returning 404 to user: Instance 03e8be7f-09be-488a-95ee-6951b53e35de could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:38:30.718897 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e9a88386-b987-45dc-a8eb-0aab15d27d9a tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/03e8be7f-09be-488a-95ee-6951b53e35de" status: 404 len: 111 microversion: 2.1 time: 0.042417 Oct 17 13:38:30.718897 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 633/1242] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:30 2022] GET /compute/v2.1/servers/03e8be7f-09be-488a-95ee-6951b53e35de => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:38:30.722322 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5509b626-3db1-415d-ae5d-040cf470dcfb tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:30.722931 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5509b626-3db1-415d-ae5d-040cf470dcfb tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 298b0f19-0a0c-4304-bb8b-4bd26cce2d9d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:30.723902 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5e564f7d-797c-4168-a0d0-87ceeb53a3c8 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:30.724403 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5e564f7d-797c-4168-a0d0-87ceeb53a3c8 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:30.724832 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5e564f7d-797c-4168-a0d0-87ceeb53a3c8 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:30.725540 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5e564f7d-797c-4168-a0d0-87ceeb53a3c8 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:30.725986 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5e564f7d-797c-4168-a0d0-87ceeb53a3c8 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:30.726401 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5e564f7d-797c-4168-a0d0-87ceeb53a3c8 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:30.729567 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5509b626-3db1-415d-ae5d-040cf470dcfb tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:30.730175 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5509b626-3db1-415d-ae5d-040cf470dcfb tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:30.730694 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5509b626-3db1-415d-ae5d-040cf470dcfb tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:30.733073 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5509b626-3db1-415d-ae5d-040cf470dcfb tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:30.733648 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5509b626-3db1-415d-ae5d-040cf470dcfb tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:30.734147 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5509b626-3db1-415d-ae5d-040cf470dcfb tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:31.124193 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5e564f7d-797c-4168-a0d0-87ceeb53a3c8 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:31.134578 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5e564f7d-797c-4168-a0d0-87ceeb53a3c8 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872" status: 200 len: 1497 microversion: 2.1 time: 0.431595 Oct 17 13:38:31.135346 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 610/1243] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:30 2022] GET /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872 => generated 1497 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:31.147941 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-19d104bc-cb76-4bcf-a6be-d004144a0016 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:31.151988 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-19d104bc-cb76-4bcf-a6be-d004144a0016 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: a54adf11-ee58-4f13-82c8-9a00a36c536e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:31.154797 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5509b626-3db1-415d-ae5d-040cf470dcfb tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:31.160556 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-19d104bc-cb76-4bcf-a6be-d004144a0016 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:31.161411 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-19d104bc-cb76-4bcf-a6be-d004144a0016 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:31.161935 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-19d104bc-cb76-4bcf-a6be-d004144a0016 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:31.163268 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-19d104bc-cb76-4bcf-a6be-d004144a0016 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:31.163945 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-19d104bc-cb76-4bcf-a6be-d004144a0016 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:31.164623 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-19d104bc-cb76-4bcf-a6be-d004144a0016 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:31.166685 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5509b626-3db1-415d-ae5d-040cf470dcfb tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/298b0f19-0a0c-4304-bb8b-4bd26cce2d9d" status: 200 len: 1532 microversion: 2.1 time: 0.447825 Oct 17 13:38:31.167568 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 634/1244] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:30 2022] GET /compute/v2.1/servers/298b0f19-0a0c-4304-bb8b-4bd26cce2d9d => generated 1532 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:31.175347 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-24974438-91e0-4463-8b3b-4a3fe9ba781f tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:31.215785 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-24974438-91e0-4463-8b3b-4a3fe9ba781f tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "DELETE /compute/v2.1/os-server-groups/aaa461b2-e1eb-4ef4-9a7c-d5ba39a4c4b4" status: 204 len: 0 microversion: 2.1 time: 0.046112 Oct 17 13:38:31.220228 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 635/1245] 10.222.0.79 () {58 vars in 1266 bytes} [Mon Oct 17 13:38:31 2022] DELETE /compute/v2.1/os-server-groups/aaa461b2-e1eb-4ef4-9a7c-d5ba39a4c4b4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:38:31.224397 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-19d104bc-cb76-4bcf-a6be-d004144a0016 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087268 Oct 17 13:38:31.225460 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 611/1246] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 13:38:31 2022] GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:38:31.226747 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1478b9ae-e2c2-4fbb-a68a-a2a904eef6e2 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:31.227414 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1478b9ae-e2c2-4fbb-a68a-a2a904eef6e2 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 32728e12-4f3f-4f72-902c-10349708549f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:31.234088 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1478b9ae-e2c2-4fbb-a68a-a2a904eef6e2 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:31.234810 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1478b9ae-e2c2-4fbb-a68a-a2a904eef6e2 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:31.235281 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1478b9ae-e2c2-4fbb-a68a-a2a904eef6e2 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:31.236169 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1478b9ae-e2c2-4fbb-a68a-a2a904eef6e2 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:31.236814 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1478b9ae-e2c2-4fbb-a68a-a2a904eef6e2 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:31.237226 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1478b9ae-e2c2-4fbb-a68a-a2a904eef6e2 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:31.264672 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1478b9ae-e2c2-4fbb-a68a-a2a904eef6e2 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 32728e12-4f3f-4f72-902c-10349708549f] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:38:31.291784 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:38:31.368809 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1478b9ae-e2c2-4fbb-a68a-a2a904eef6e2 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "DELETE /compute/v2.1/servers/32728e12-4f3f-4f72-902c-10349708549f" status: 204 len: 0 microversion: 2.1 time: 0.146947 Oct 17 13:38:31.369811 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 636/1247] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:38:31 2022] DELETE /compute/v2.1/servers/32728e12-4f3f-4f72-902c-10349708549f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:38:31.380125 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1173176f-f6fc-4740-807a-dfc6117c35fe tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:31.381005 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-1173176f-f6fc-4740-807a-dfc6117c35fe tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 32728e12-4f3f-4f72-902c-10349708549f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:31.393998 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1173176f-f6fc-4740-807a-dfc6117c35fe tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:31.395007 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1173176f-f6fc-4740-807a-dfc6117c35fe tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:31.395697 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1173176f-f6fc-4740-807a-dfc6117c35fe tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:31.396545 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1173176f-f6fc-4740-807a-dfc6117c35fe tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:31.397153 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1173176f-f6fc-4740-807a-dfc6117c35fe tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:31.398136 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1173176f-f6fc-4740-807a-dfc6117c35fe tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:31.518316 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-0e83e688-133d-4d5d-8760-d6d2ff866a7e req-c135269d-f5f0-4b14-86fa-70eb614836c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ffbef37-e5f8-4de2-a29d-dba6782a3fe4", "name": "network-vif-unplugged", "status": "completed", "tag": "f6d4c8b6-ba32-4306-822c-cf94066fc47e"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:38:31.530066 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-0e83e688-133d-4d5d-8760-d6d2ff866a7e req-c135269d-f5f0-4b14-86fa-70eb614836c2 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:31.530758 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-0e83e688-133d-4d5d-8760-d6d2ff866a7e req-c135269d-f5f0-4b14-86fa-70eb614836c2 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:31.531392 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-0e83e688-133d-4d5d-8760-d6d2ff866a7e req-c135269d-f5f0-4b14-86fa-70eb614836c2 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:31.544908 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-0e83e688-133d-4d5d-8760-d6d2ff866a7e req-c135269d-f5f0-4b14-86fa-70eb614836c2 service nova] Creating event network-vif-unplugged:f6d4c8b6-ba32-4306-822c-cf94066fc47e for instance 0ffbef37-e5f8-4de2-a29d-dba6782a3fe4 on n-h1-854247-14 Oct 17 13:38:31.550540 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-0e83e688-133d-4d5d-8760-d6d2ff866a7e req-c135269d-f5f0-4b14-86fa-70eb614836c2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038265 Oct 17 13:38:31.552649 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 637/1248] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:38:31.633883 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-50aa4ffc-9460-4e5e-bed5-aa54993c8ea6 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:31.635730 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-50aa4ffc-9460-4e5e-bed5-aa54993c8ea6 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 0ffbef37-e5f8-4de2-a29d-dba6782a3fe4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:31.642072 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-50aa4ffc-9460-4e5e-bed5-aa54993c8ea6 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:31.642611 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-50aa4ffc-9460-4e5e-bed5-aa54993c8ea6 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:31.643011 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-50aa4ffc-9460-4e5e-bed5-aa54993c8ea6 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:31.643696 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-50aa4ffc-9460-4e5e-bed5-aa54993c8ea6 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:31.644196 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-50aa4ffc-9460-4e5e-bed5-aa54993c8ea6 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:31.644576 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-50aa4ffc-9460-4e5e-bed5-aa54993c8ea6 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:31.766397 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-1173176f-f6fc-4740-807a-dfc6117c35fe tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:31.776890 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1173176f-f6fc-4740-807a-dfc6117c35fe tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/32728e12-4f3f-4f72-902c-10349708549f" status: 200 len: 1473 microversion: 2.1 time: 0.402077 Oct 17 13:38:31.777817 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 612/1249] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:31 2022] GET /compute/v2.1/servers/32728e12-4f3f-4f72-902c-10349708549f => generated 1473 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:31.785598 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f15b9277-d6f8-469b-8954-6222df1889c0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:31.791671 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f15b9277-d6f8-469b-8954-6222df1889c0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: 56f45c71-b693-48c4-a2b6-dcfea882eaa4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:31.799251 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f15b9277-d6f8-469b-8954-6222df1889c0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:31.799793 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f15b9277-d6f8-469b-8954-6222df1889c0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:31.800299 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f15b9277-d6f8-469b-8954-6222df1889c0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:31.801301 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f15b9277-d6f8-469b-8954-6222df1889c0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:31.801922 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f15b9277-d6f8-469b-8954-6222df1889c0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:31.803287 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f15b9277-d6f8-469b-8954-6222df1889c0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:32.014461 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-50aa4ffc-9460-4e5e-bed5-aa54993c8ea6 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:32.024942 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-50aa4ffc-9460-4e5e-bed5-aa54993c8ea6 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:32.026488 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-50aa4ffc-9460-4e5e-bed5-aa54993c8ea6 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:32.028068 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-50aa4ffc-9460-4e5e-bed5-aa54993c8ea6 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4" status: 200 len: 1568 microversion: 2.25 time: 0.398419 Oct 17 13:38:32.028681 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 638/1250] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:38:31 2022] GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4 => generated 1568 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:38:32.075790 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f15b9277-d6f8-469b-8954-6222df1889c0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:32.092745 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f15b9277-d6f8-469b-8954-6222df1889c0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/56f45c71-b693-48c4-a2b6-dcfea882eaa4" status: 200 len: 1313 microversion: 2.1 time: 0.313437 Oct 17 13:38:32.093802 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 613/1251] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:31 2022] GET /compute/v2.1/servers/56f45c71-b693-48c4-a2b6-dcfea882eaa4 => generated 1313 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:32.164275 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ddba4c83-64cd-47bf-a8dd-be306fde1950 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:32.165310 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ddba4c83-64cd-47bf-a8dd-be306fde1950 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: ae587603-994d-419d-979a-1b1361144872] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:32.172546 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ddba4c83-64cd-47bf-a8dd-be306fde1950 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:32.173072 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ddba4c83-64cd-47bf-a8dd-be306fde1950 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:32.173621 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ddba4c83-64cd-47bf-a8dd-be306fde1950 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:32.174407 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ddba4c83-64cd-47bf-a8dd-be306fde1950 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:32.174948 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ddba4c83-64cd-47bf-a8dd-be306fde1950 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:32.176210 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ddba4c83-64cd-47bf-a8dd-be306fde1950 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:32.193365 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e78eb911-9026-482b-9591-8eb59d1a80f0 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:32.194065 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e78eb911-9026-482b-9591-8eb59d1a80f0 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 298b0f19-0a0c-4304-bb8b-4bd26cce2d9d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:32.206603 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e78eb911-9026-482b-9591-8eb59d1a80f0 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:32.207144 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e78eb911-9026-482b-9591-8eb59d1a80f0 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:32.207851 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e78eb911-9026-482b-9591-8eb59d1a80f0 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:32.210165 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e78eb911-9026-482b-9591-8eb59d1a80f0 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:32.210904 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e78eb911-9026-482b-9591-8eb59d1a80f0 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:32.211627 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e78eb911-9026-482b-9591-8eb59d1a80f0 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:32.413090 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e78eb911-9026-482b-9591-8eb59d1a80f0 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:32.417006 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ddba4c83-64cd-47bf-a8dd-be306fde1950 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:32.429143 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e78eb911-9026-482b-9591-8eb59d1a80f0 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/298b0f19-0a0c-4304-bb8b-4bd26cce2d9d" status: 200 len: 1538 microversion: 2.1 time: 0.240142 Oct 17 13:38:32.429851 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 614/1252] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:32 2022] GET /compute/v2.1/servers/298b0f19-0a0c-4304-bb8b-4bd26cce2d9d => generated 1538 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:38:32.450731 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ddba4c83-64cd-47bf-a8dd-be306fde1950 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872" status: 200 len: 1474 microversion: 2.1 time: 0.290679 Oct 17 13:38:32.451764 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 639/1253] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:32 2022] GET /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872 => generated 1474 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:32.452203 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7c1d1c2e-bfe4-4094-b1f1-4fb2d39b025f tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:32.454488 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7c1d1c2e-bfe4-4094-b1f1-4fb2d39b025f tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: a54adf11-ee58-4f13-82c8-9a00a36c536e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:32.460678 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7c1d1c2e-bfe4-4094-b1f1-4fb2d39b025f tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:32.461099 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7c1d1c2e-bfe4-4094-b1f1-4fb2d39b025f tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:32.461660 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7c1d1c2e-bfe4-4094-b1f1-4fb2d39b025f tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:32.462368 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7c1d1c2e-bfe4-4094-b1f1-4fb2d39b025f tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:32.462819 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7c1d1c2e-bfe4-4094-b1f1-4fb2d39b025f tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:32.463259 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7c1d1c2e-bfe4-4094-b1f1-4fb2d39b025f tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:32.474579 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5308652e-a2a5-491f-8191-63312f94ca4e tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-841428280"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:38:32.476985 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5308652e-a2a5-491f-8191-63312f94ca4e tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: ae587603-994d-419d-979a-1b1361144872] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:32.483194 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5308652e-a2a5-491f-8191-63312f94ca4e tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:32.484034 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5308652e-a2a5-491f-8191-63312f94ca4e tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:32.484486 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5308652e-a2a5-491f-8191-63312f94ca4e tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:32.485187 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5308652e-a2a5-491f-8191-63312f94ca4e tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:32.485630 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5308652e-a2a5-491f-8191-63312f94ca4e tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:32.486042 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5308652e-a2a5-491f-8191-63312f94ca4e tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:32.495714 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7c1d1c2e-bfe4-4094-b1f1-4fb2d39b025f tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055207 Oct 17 13:38:32.498167 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 615/1254] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 13:38:32 2022] GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:38:32.692402 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5308652e-a2a5-491f-8191-63312f94ca4e tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "POST /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872/action" status: 202 len: 0 microversion: 2.1 time: 0.221824 Oct 17 13:38:32.692954 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 640/1255] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:38:32 2022] POST /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 17 13:38:32.703610 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-370e53a8-3d8b-4e0f-84b6-876692472e1b tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd53fbc10>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:32.772849 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-370e53a8-3d8b-4e0f-84b6-876692472e1b tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/c13431d2-5f95-49db-9d9a-05ff951c6069" status: 200 len: 1413 microversion: 2.1 time: 0.073138 Oct 17 13:38:32.774880 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 616/1256] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:38:32 2022] GET /compute/v2.1/images/c13431d2-5f95-49db-9d9a-05ff951c6069 => generated 1413 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:32.803282 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c2988ae0-3897-4eb8-9e20-ec18c0e626ac tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:32.804003 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c2988ae0-3897-4eb8-9e20-ec18c0e626ac tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 32728e12-4f3f-4f72-902c-10349708549f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:32.811084 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c2988ae0-3897-4eb8-9e20-ec18c0e626ac tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:32.812002 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c2988ae0-3897-4eb8-9e20-ec18c0e626ac tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:32.812687 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c2988ae0-3897-4eb8-9e20-ec18c0e626ac tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:32.813587 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c2988ae0-3897-4eb8-9e20-ec18c0e626ac tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:32.814049 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c2988ae0-3897-4eb8-9e20-ec18c0e626ac tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:32.814495 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c2988ae0-3897-4eb8-9e20-ec18c0e626ac tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:33.014980 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c2988ae0-3897-4eb8-9e20-ec18c0e626ac tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:33.023470 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c2988ae0-3897-4eb8-9e20-ec18c0e626ac tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/32728e12-4f3f-4f72-902c-10349708549f" status: 200 len: 1473 microversion: 2.1 time: 0.224537 Oct 17 13:38:33.024210 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 641/1257] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:32 2022] GET /compute/v2.1/servers/32728e12-4f3f-4f72-902c-10349708549f => generated 1473 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:33.053852 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8c92082d-4a31-45eb-8b60-727fe5ed1eff tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:33.054472 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8c92082d-4a31-45eb-8b60-727fe5ed1eff tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 0ffbef37-e5f8-4de2-a29d-dba6782a3fe4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:33.062486 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8c92082d-4a31-45eb-8b60-727fe5ed1eff tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:33.062966 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8c92082d-4a31-45eb-8b60-727fe5ed1eff tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:33.063432 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8c92082d-4a31-45eb-8b60-727fe5ed1eff tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:33.064123 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8c92082d-4a31-45eb-8b60-727fe5ed1eff tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:33.064574 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8c92082d-4a31-45eb-8b60-727fe5ed1eff tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:33.065033 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8c92082d-4a31-45eb-8b60-727fe5ed1eff tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:33.116310 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-74b5dc35-3a17-4eaa-861d-ab3632988c9d tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:33.116922 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-74b5dc35-3a17-4eaa-861d-ab3632988c9d tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: 56f45c71-b693-48c4-a2b6-dcfea882eaa4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:33.123590 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-74b5dc35-3a17-4eaa-861d-ab3632988c9d tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:33.124080 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-74b5dc35-3a17-4eaa-861d-ab3632988c9d tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:33.124539 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-74b5dc35-3a17-4eaa-861d-ab3632988c9d tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:33.125250 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-74b5dc35-3a17-4eaa-861d-ab3632988c9d tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:33.125705 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-74b5dc35-3a17-4eaa-861d-ab3632988c9d tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:33.126125 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-74b5dc35-3a17-4eaa-861d-ab3632988c9d tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:33.417988 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8c92082d-4a31-45eb-8b60-727fe5ed1eff tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:33.421632 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:38:33.430663 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8c92082d-4a31-45eb-8b60-727fe5ed1eff tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:33.432156 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8c92082d-4a31-45eb-8b60-727fe5ed1eff tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:33.433772 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8c92082d-4a31-45eb-8b60-727fe5ed1eff tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4" status: 200 len: 1568 microversion: 2.25 time: 0.384329 Oct 17 13:38:33.434415 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 617/1258] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:38:33 2022] GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4 => generated 1568 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:38:33.454976 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4291a829-5c65-4879-b2d5-09067d27fdee tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:33.455749 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4291a829-5c65-4879-b2d5-09067d27fdee tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 298b0f19-0a0c-4304-bb8b-4bd26cce2d9d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:33.464480 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4291a829-5c65-4879-b2d5-09067d27fdee tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:33.465043 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4291a829-5c65-4879-b2d5-09067d27fdee tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:33.465537 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4291a829-5c65-4879-b2d5-09067d27fdee tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:33.466337 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4291a829-5c65-4879-b2d5-09067d27fdee tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:33.466878 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4291a829-5c65-4879-b2d5-09067d27fdee tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:33.467372 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4291a829-5c65-4879-b2d5-09067d27fdee tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:33.541988 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-74b5dc35-3a17-4eaa-861d-ab3632988c9d tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:33.551211 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-74b5dc35-3a17-4eaa-861d-ab3632988c9d tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/56f45c71-b693-48c4-a2b6-dcfea882eaa4" status: 200 len: 1313 microversion: 2.1 time: 0.438833 Oct 17 13:38:33.551906 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 642/1259] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:33 2022] GET /compute/v2.1/servers/56f45c71-b693-48c4-a2b6-dcfea882eaa4 => generated 1313 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:33.557086 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-817765ba-e0f5-4af1-a508-a8d9d002fb7f tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:33.559423 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-817765ba-e0f5-4af1-a508-a8d9d002fb7f tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: a54adf11-ee58-4f13-82c8-9a00a36c536e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:33.566289 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-817765ba-e0f5-4af1-a508-a8d9d002fb7f tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:33.566693 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-817765ba-e0f5-4af1-a508-a8d9d002fb7f tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:33.567376 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-817765ba-e0f5-4af1-a508-a8d9d002fb7f tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:33.568456 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-817765ba-e0f5-4af1-a508-a8d9d002fb7f tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:33.569112 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-817765ba-e0f5-4af1-a508-a8d9d002fb7f tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:33.569739 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-817765ba-e0f5-4af1-a508-a8d9d002fb7f tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:33.600430 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-817765ba-e0f5-4af1-a508-a8d9d002fb7f tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047390 Oct 17 13:38:33.601018 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 643/1260] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 13:38:33 2022] GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:38:33.605984 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-e297da04-ecf8-4ebe-8e60-e9b4527dce8c req-6c4951d0-4d4f-4b01-9317-9a57ce11156c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56f45c71-b693-48c4-a2b6-dcfea882eaa4", "tag": "daf0db87-9b0f-4002-bd30-1e15678e955e"}, {"name": "network-changed", "server_uuid": "0ffbef37-e5f8-4de2-a29d-dba6782a3fe4", "tag": "f6d4c8b6-ba32-4306-822c-cf94066fc47e"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:38:33.616747 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-e297da04-ecf8-4ebe-8e60-e9b4527dce8c req-6c4951d0-4d4f-4b01-9317-9a57ce11156c service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:33.617225 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-e297da04-ecf8-4ebe-8e60-e9b4527dce8c req-6c4951d0-4d4f-4b01-9317-9a57ce11156c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:33.617865 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-e297da04-ecf8-4ebe-8e60-e9b4527dce8c req-6c4951d0-4d4f-4b01-9317-9a57ce11156c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:33.631776 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-e297da04-ecf8-4ebe-8e60-e9b4527dce8c req-6c4951d0-4d4f-4b01-9317-9a57ce11156c service nova] Creating event network-changed:daf0db87-9b0f-4002-bd30-1e15678e955e for instance 56f45c71-b693-48c4-a2b6-dcfea882eaa4 on n-h2-854247-14 Oct 17 13:38:33.632290 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-e297da04-ecf8-4ebe-8e60-e9b4527dce8c req-6c4951d0-4d4f-4b01-9317-9a57ce11156c service nova] Creating event network-changed:f6d4c8b6-ba32-4306-822c-cf94066fc47e for instance 0ffbef37-e5f8-4de2-a29d-dba6782a3fe4 on n-h1-854247-14 Oct 17 13:38:33.641245 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-e297da04-ecf8-4ebe-8e60-e9b4527dce8c req-6c4951d0-4d4f-4b01-9317-9a57ce11156c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.038767 Oct 17 13:38:33.642075 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 644/1261] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:38:33.792393 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-efcfdba3-c4b8-4d4f-92cc-8a3aecaa228c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd5522820>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:33.823281 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4291a829-5c65-4879-b2d5-09067d27fdee tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:33.834773 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4291a829-5c65-4879-b2d5-09067d27fdee tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/298b0f19-0a0c-4304-bb8b-4bd26cce2d9d" status: 200 len: 1538 microversion: 2.1 time: 0.384218 Oct 17 13:38:33.836015 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 618/1262] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:33 2022] GET /compute/v2.1/servers/298b0f19-0a0c-4304-bb8b-4bd26cce2d9d => generated 1538 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:33.859596 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-efcfdba3-c4b8-4d4f-92cc-8a3aecaa228c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/c13431d2-5f95-49db-9d9a-05ff951c6069" status: 200 len: 1413 microversion: 2.1 time: 0.073019 Oct 17 13:38:33.860301 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 645/1263] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:38:33 2022] GET /compute/v2.1/images/c13431d2-5f95-49db-9d9a-05ff951c6069 => generated 1413 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:34.046973 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4c73abb4-335c-436a-ace2-7f268c048bcf tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:34.047533 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4c73abb4-335c-436a-ace2-7f268c048bcf tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 32728e12-4f3f-4f72-902c-10349708549f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:34.053981 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4c73abb4-335c-436a-ace2-7f268c048bcf tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:34.054460 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4c73abb4-335c-436a-ace2-7f268c048bcf tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:34.055233 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4c73abb4-335c-436a-ace2-7f268c048bcf tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:34.055974 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4c73abb4-335c-436a-ace2-7f268c048bcf tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:34.056423 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4c73abb4-335c-436a-ace2-7f268c048bcf tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:34.056838 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4c73abb4-335c-436a-ace2-7f268c048bcf tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:34.377397 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4c73abb4-335c-436a-ace2-7f268c048bcf tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:34.386003 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4c73abb4-335c-436a-ace2-7f268c048bcf tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/32728e12-4f3f-4f72-902c-10349708549f" status: 200 len: 1431 microversion: 2.1 time: 0.343415 Oct 17 13:38:34.387083 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 619/1264] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:34 2022] GET /compute/v2.1/servers/32728e12-4f3f-4f72-902c-10349708549f => generated 1431 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:34.463434 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5a9c7710-6320-44ff-9915-d89be315d1b3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:34.464174 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5a9c7710-6320-44ff-9915-d89be315d1b3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 0ffbef37-e5f8-4de2-a29d-dba6782a3fe4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:34.470990 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5a9c7710-6320-44ff-9915-d89be315d1b3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:34.471505 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5a9c7710-6320-44ff-9915-d89be315d1b3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:34.471922 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5a9c7710-6320-44ff-9915-d89be315d1b3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:34.472693 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5a9c7710-6320-44ff-9915-d89be315d1b3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:34.473361 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5a9c7710-6320-44ff-9915-d89be315d1b3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:34.473987 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5a9c7710-6320-44ff-9915-d89be315d1b3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:34.574269 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e1e02f68-5054-4cfe-9f6f-e55e122128ec tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:34.575180 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e1e02f68-5054-4cfe-9f6f-e55e122128ec tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: 56f45c71-b693-48c4-a2b6-dcfea882eaa4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:34.584516 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e1e02f68-5054-4cfe-9f6f-e55e122128ec tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:34.591588 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e1e02f68-5054-4cfe-9f6f-e55e122128ec tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:34.592022 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e1e02f68-5054-4cfe-9f6f-e55e122128ec tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:34.593614 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e1e02f68-5054-4cfe-9f6f-e55e122128ec tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:34.595707 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e1e02f68-5054-4cfe-9f6f-e55e122128ec tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:34.596325 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e1e02f68-5054-4cfe-9f6f-e55e122128ec tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:34.700766 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5a9c7710-6320-44ff-9915-d89be315d1b3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:34.709509 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5a9c7710-6320-44ff-9915-d89be315d1b3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:34.710951 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5a9c7710-6320-44ff-9915-d89be315d1b3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:34.712238 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5a9c7710-6320-44ff-9915-d89be315d1b3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4" status: 200 len: 1568 microversion: 2.25 time: 0.253912 Oct 17 13:38:34.712789 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 646/1265] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:38:34 2022] GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4 => generated 1568 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:38:34.804412 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e1e02f68-5054-4cfe-9f6f-e55e122128ec tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:34.814516 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e1e02f68-5054-4cfe-9f6f-e55e122128ec tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/56f45c71-b693-48c4-a2b6-dcfea882eaa4" status: 200 len: 1313 microversion: 2.1 time: 0.244569 Oct 17 13:38:34.815741 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 620/1266] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:34 2022] GET /compute/v2.1/servers/56f45c71-b693-48c4-a2b6-dcfea882eaa4 => generated 1313 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:38:34.860279 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4847836c-e6bb-4fa0-96a3-e5bf5d67cd6e tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:34.860984 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4847836c-e6bb-4fa0-96a3-e5bf5d67cd6e tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 298b0f19-0a0c-4304-bb8b-4bd26cce2d9d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:34.869326 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4847836c-e6bb-4fa0-96a3-e5bf5d67cd6e tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:34.870136 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4847836c-e6bb-4fa0-96a3-e5bf5d67cd6e tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:34.871471 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4847836c-e6bb-4fa0-96a3-e5bf5d67cd6e tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:34.874765 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4847836c-e6bb-4fa0-96a3-e5bf5d67cd6e tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:34.876082 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4847836c-e6bb-4fa0-96a3-e5bf5d67cd6e tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:34.876382 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4be8aa57-4376-43a9-a196-e2cd879687c7 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd5404160>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:34.876857 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4847836c-e6bb-4fa0-96a3-e5bf5d67cd6e tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:34.952604 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4be8aa57-4376-43a9-a196-e2cd879687c7 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/c13431d2-5f95-49db-9d9a-05ff951c6069" status: 200 len: 1413 microversion: 2.1 time: 0.077817 Oct 17 13:38:34.962781 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 621/1267] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:38:34 2022] GET /compute/v2.1/images/c13431d2-5f95-49db-9d9a-05ff951c6069 => generated 1413 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:35.031622 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4847836c-e6bb-4fa0-96a3-e5bf5d67cd6e tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:35.040158 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4847836c-e6bb-4fa0-96a3-e5bf5d67cd6e tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/298b0f19-0a0c-4304-bb8b-4bd26cce2d9d" status: 200 len: 1538 microversion: 2.1 time: 0.183851 Oct 17 13:38:35.043271 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 647/1268] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:34 2022] GET /compute/v2.1/servers/298b0f19-0a0c-4304-bb8b-4bd26cce2d9d => generated 1538 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:35.409983 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9a9e9fa4-e54e-4a24-853b-1a1bbc5cfcc5 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:35.410941 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9a9e9fa4-e54e-4a24-853b-1a1bbc5cfcc5 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 32728e12-4f3f-4f72-902c-10349708549f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:35.413128 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:38:35.425736 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9a9e9fa4-e54e-4a24-853b-1a1bbc5cfcc5 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:35.426287 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9a9e9fa4-e54e-4a24-853b-1a1bbc5cfcc5 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:35.426677 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9a9e9fa4-e54e-4a24-853b-1a1bbc5cfcc5 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:35.429986 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9a9e9fa4-e54e-4a24-853b-1a1bbc5cfcc5 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:35.430515 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9a9e9fa4-e54e-4a24-853b-1a1bbc5cfcc5 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:35.431149 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9a9e9fa4-e54e-4a24-853b-1a1bbc5cfcc5 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:35.528891 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9a9e9fa4-e54e-4a24-853b-1a1bbc5cfcc5 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:35.544259 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9a9e9fa4-e54e-4a24-853b-1a1bbc5cfcc5 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/32728e12-4f3f-4f72-902c-10349708549f" status: 200 len: 1302 microversion: 2.1 time: 0.138425 Oct 17 13:38:35.545172 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 622/1269] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:35 2022] GET /compute/v2.1/servers/32728e12-4f3f-4f72-902c-10349708549f => generated 1302 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:35.578575 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-aba73393-882d-4950-a70d-a9e2c410f31f req-93a53141-b9c7-49d1-aa02-fbd817e68d79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "298b0f19-0a0c-4304-bb8b-4bd26cce2d9d", "name": "network-vif-plugged", "status": "completed", "tag": "1b002cb5-02b8-45df-a6b3-cb4130290727"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:38:35.590452 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:38:35.594040 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=8 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:38:35.608556 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-aba73393-882d-4950-a70d-a9e2c410f31f req-93a53141-b9c7-49d1-aa02-fbd817e68d79 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:35.609734 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-aba73393-882d-4950-a70d-a9e2c410f31f req-93a53141-b9c7-49d1-aa02-fbd817e68d79 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:35.611736 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-aba73393-882d-4950-a70d-a9e2c410f31f req-93a53141-b9c7-49d1-aa02-fbd817e68d79 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:35.626170 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-aba73393-882d-4950-a70d-a9e2c410f31f req-93a53141-b9c7-49d1-aa02-fbd817e68d79 service nova] Creating event network-vif-plugged:1b002cb5-02b8-45df-a6b3-cb4130290727 for instance 298b0f19-0a0c-4304-bb8b-4bd26cce2d9d on n-h2-854247-14 Oct 17 13:38:35.631241 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-aba73393-882d-4950-a70d-a9e2c410f31f req-93a53141-b9c7-49d1-aa02-fbd817e68d79 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056682 Oct 17 13:38:35.631824 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 648/1270] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:38:35.661333 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-cd601a6b-c714-4ced-abdd-9cf1d8c685be req-07d7eab8-a62b-4cad-9698-65035b9e1acd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32728e12-4f3f-4f72-902c-10349708549f", "name": "network-vif-deleted", "tag": "9e4bbd4c-aa1e-4e34-b511-617ea8517bf3"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:38:35.673759 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-cd601a6b-c714-4ced-abdd-9cf1d8c685be req-07d7eab8-a62b-4cad-9698-65035b9e1acd service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:35.674373 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-cd601a6b-c714-4ced-abdd-9cf1d8c685be req-07d7eab8-a62b-4cad-9698-65035b9e1acd service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:35.675147 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-cd601a6b-c714-4ced-abdd-9cf1d8c685be req-07d7eab8-a62b-4cad-9698-65035b9e1acd service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:35.689086 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-cd601a6b-c714-4ced-abdd-9cf1d8c685be req-07d7eab8-a62b-4cad-9698-65035b9e1acd service nova] Creating event network-vif-deleted:9e4bbd4c-aa1e-4e34-b511-617ea8517bf3 for instance 32728e12-4f3f-4f72-902c-10349708549f on n-h2-854247-14 Oct 17 13:38:35.696567 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-cd601a6b-c714-4ced-abdd-9cf1d8c685be req-07d7eab8-a62b-4cad-9698-65035b9e1acd service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040941 Oct 17 13:38:35.697405 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 623/1271] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:38:35.746212 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0d5ecb66-65e4-4499-a1b8-d9d94fed86d2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:35.747712 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0d5ecb66-65e4-4499-a1b8-d9d94fed86d2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 0ffbef37-e5f8-4de2-a29d-dba6782a3fe4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:35.755503 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0d5ecb66-65e4-4499-a1b8-d9d94fed86d2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:35.756000 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0d5ecb66-65e4-4499-a1b8-d9d94fed86d2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:35.756435 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0d5ecb66-65e4-4499-a1b8-d9d94fed86d2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:35.757142 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0d5ecb66-65e4-4499-a1b8-d9d94fed86d2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:35.757761 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0d5ecb66-65e4-4499-a1b8-d9d94fed86d2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:35.758350 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0d5ecb66-65e4-4499-a1b8-d9d94fed86d2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:35.838919 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-738a3cd8-227c-4b12-8c31-acbb0f9e89f0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:35.840218 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-738a3cd8-227c-4b12-8c31-acbb0f9e89f0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: 56f45c71-b693-48c4-a2b6-dcfea882eaa4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:35.848725 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-738a3cd8-227c-4b12-8c31-acbb0f9e89f0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:35.852279 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-738a3cd8-227c-4b12-8c31-acbb0f9e89f0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:35.852973 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-738a3cd8-227c-4b12-8c31-acbb0f9e89f0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:35.855079 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-738a3cd8-227c-4b12-8c31-acbb0f9e89f0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:35.858060 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-738a3cd8-227c-4b12-8c31-acbb0f9e89f0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:35.858757 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-738a3cd8-227c-4b12-8c31-acbb0f9e89f0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:36.371249 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-738a3cd8-227c-4b12-8c31-acbb0f9e89f0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:36.379140 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0d5ecb66-65e4-4499-a1b8-d9d94fed86d2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:36.380009 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-738a3cd8-227c-4b12-8c31-acbb0f9e89f0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/56f45c71-b693-48c4-a2b6-dcfea882eaa4" status: 200 len: 1313 microversion: 2.1 time: 0.545693 Oct 17 13:38:36.380751 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 624/1272] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:35 2022] GET /compute/v2.1/servers/56f45c71-b693-48c4-a2b6-dcfea882eaa4 => generated 1313 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:38:36.391577 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0d5ecb66-65e4-4499-a1b8-d9d94fed86d2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:36.391577 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0d5ecb66-65e4-4499-a1b8-d9d94fed86d2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:36.391875 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0d5ecb66-65e4-4499-a1b8-d9d94fed86d2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4" status: 200 len: 1568 microversion: 2.25 time: 0.656399 Oct 17 13:38:36.392729 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 649/1273] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:38:35 2022] GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4 => generated 1568 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:38:36.397547 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f0622477-b729-4bb5-8c88-1da5edfadcf6 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:36.398161 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f0622477-b729-4bb5-8c88-1da5edfadcf6 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 298b0f19-0a0c-4304-bb8b-4bd26cce2d9d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:36.404674 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f0622477-b729-4bb5-8c88-1da5edfadcf6 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:36.405133 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f0622477-b729-4bb5-8c88-1da5edfadcf6 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:36.405567 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f0622477-b729-4bb5-8c88-1da5edfadcf6 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:36.406271 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f0622477-b729-4bb5-8c88-1da5edfadcf6 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:36.406719 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f0622477-b729-4bb5-8c88-1da5edfadcf6 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:36.407139 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f0622477-b729-4bb5-8c88-1da5edfadcf6 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:36.416526 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5a0ab2e0-41ae-4485-a64f-dcb701e09fd0 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd54043a0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:36.567306 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f0622477-b729-4bb5-8c88-1da5edfadcf6 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:36.576178 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f0622477-b729-4bb5-8c88-1da5edfadcf6 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/298b0f19-0a0c-4304-bb8b-4bd26cce2d9d" status: 200 len: 1520 microversion: 2.1 time: 0.182167 Oct 17 13:38:36.577092 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 650/1274] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:36 2022] GET /compute/v2.1/servers/298b0f19-0a0c-4304-bb8b-4bd26cce2d9d => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:36.581635 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a4e93a63-91ec-409d-80cf-94f5532c1b57 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:36.582699 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a4e93a63-91ec-409d-80cf-94f5532c1b57 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 32728e12-4f3f-4f72-902c-10349708549f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:36.589122 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a4e93a63-91ec-409d-80cf-94f5532c1b57 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:36.592828 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a4e93a63-91ec-409d-80cf-94f5532c1b57 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:36.593517 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a4e93a63-91ec-409d-80cf-94f5532c1b57 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:36.594441 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a4e93a63-91ec-409d-80cf-94f5532c1b57 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:36.595195 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a4e93a63-91ec-409d-80cf-94f5532c1b57 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:36.596100 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a4e93a63-91ec-409d-80cf-94f5532c1b57 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:36.691477 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a4e93a63-91ec-409d-80cf-94f5532c1b57 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:36.691970 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a4e93a63-91ec-409d-80cf-94f5532c1b57 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:36.695274 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a4e93a63-91ec-409d-80cf-94f5532c1b57 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:36.695817 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-a4e93a63-91ec-409d-80cf-94f5532c1b57 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lazy-loading 'fault' on Instance uuid 32728e12-4f3f-4f72-902c-10349708549f {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:38:36.782937 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a4e93a63-91ec-409d-80cf-94f5532c1b57 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a7e082035084338966a1c56b30c7093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1db260a96a4c6aa69cd6437baab6f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:36.794240 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a4e93a63-91ec-409d-80cf-94f5532c1b57 tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/32728e12-4f3f-4f72-902c-10349708549f" status: 200 len: 1307 microversion: 2.1 time: 0.216070 Oct 17 13:38:36.799047 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 651/1275] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:36 2022] GET /compute/v2.1/servers/32728e12-4f3f-4f72-902c-10349708549f => generated 1307 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:36.805708 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-76336c80-b8ed-4c17-afe6-4a92eb72b19c tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:36.806935 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-76336c80-b8ed-4c17-afe6-4a92eb72b19c tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 298b0f19-0a0c-4304-bb8b-4bd26cce2d9d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:36.814117 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-76336c80-b8ed-4c17-afe6-4a92eb72b19c tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:36.814907 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-76336c80-b8ed-4c17-afe6-4a92eb72b19c tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:36.815644 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-76336c80-b8ed-4c17-afe6-4a92eb72b19c tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:36.816975 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-76336c80-b8ed-4c17-afe6-4a92eb72b19c tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:36.817640 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-76336c80-b8ed-4c17-afe6-4a92eb72b19c tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:36.818320 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-76336c80-b8ed-4c17-afe6-4a92eb72b19c tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:36.880480 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-76336c80-b8ed-4c17-afe6-4a92eb72b19c tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 298b0f19-0a0c-4304-bb8b-4bd26cce2d9d] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:38:36.938472 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:38:37.062176 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-76336c80-b8ed-4c17-afe6-4a92eb72b19c tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "DELETE /compute/v2.1/servers/298b0f19-0a0c-4304-bb8b-4bd26cce2d9d" status: 204 len: 0 microversion: 2.1 time: 0.259641 Oct 17 13:38:37.064335 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 652/1276] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:38:36 2022] DELETE /compute/v2.1/servers/298b0f19-0a0c-4304-bb8b-4bd26cce2d9d => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:38:37.091556 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4aeab73b-eb73-4e9c-a7ae-81a63c2fe630 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:37.092838 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4aeab73b-eb73-4e9c-a7ae-81a63c2fe630 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 298b0f19-0a0c-4304-bb8b-4bd26cce2d9d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:37.099927 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4aeab73b-eb73-4e9c-a7ae-81a63c2fe630 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:37.100673 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4aeab73b-eb73-4e9c-a7ae-81a63c2fe630 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:37.101269 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4aeab73b-eb73-4e9c-a7ae-81a63c2fe630 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:37.102217 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4aeab73b-eb73-4e9c-a7ae-81a63c2fe630 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:37.103292 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4aeab73b-eb73-4e9c-a7ae-81a63c2fe630 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:37.103968 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4aeab73b-eb73-4e9c-a7ae-81a63c2fe630 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:37.281630 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4aeab73b-eb73-4e9c-a7ae-81a63c2fe630 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:37.303399 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4aeab73b-eb73-4e9c-a7ae-81a63c2fe630 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/298b0f19-0a0c-4304-bb8b-4bd26cce2d9d" status: 200 len: 1526 microversion: 2.1 time: 0.233131 Oct 17 13:38:37.304517 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 653/1277] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:37 2022] GET /compute/v2.1/servers/298b0f19-0a0c-4304-bb8b-4bd26cce2d9d => generated 1526 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:37.309867 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-db63790e-8289-40c1-acb7-40c44b95be8a tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:37.314915 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-db63790e-8289-40c1-acb7-40c44b95be8a tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a23b9d586c57421abf53a7eaa3af9b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63faec71e9ad449896c83868d52dd09c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:37.325419 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-db63790e-8289-40c1-acb7-40c44b95be8a tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Searching by: {'deleted': False, 'project_id': '63faec71e9ad449896c83868d52dd09c'} {{(pid=127017) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:38:37.340727 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db63790e-8289-40c1-acb7-40c44b95be8a tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:37.341247 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db63790e-8289-40c1-acb7-40c44b95be8a tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:37.342932 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db63790e-8289-40c1-acb7-40c44b95be8a tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:37.345478 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db63790e-8289-40c1-acb7-40c44b95be8a tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:37.346149 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db63790e-8289-40c1-acb7-40c44b95be8a tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:37.346575 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db63790e-8289-40c1-acb7-40c44b95be8a tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:37.452336 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.multi_cell_list [None req-db63790e-8289-40c1-acb7-40c44b95be8a tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127017) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:38:37.782786 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-db63790e-8289-40c1-acb7-40c44b95be8a tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] 10.222.0.79 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.476852 Oct 17 13:38:37.783434 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 654/1278] 10.222.0.79 () {58 vars in 1125 bytes} [Mon Oct 17 13:38:37 2022] GET /compute/v2.1/servers => generated 334 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:38:37.797966 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-490bb5e4-a457-47fc-9037-a0e4c7297874 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:37.798885 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-490bb5e4-a457-47fc-9037-a0e4c7297874 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: 56f45c71-b693-48c4-a2b6-dcfea882eaa4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:37.805651 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-490bb5e4-a457-47fc-9037-a0e4c7297874 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:37.806145 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-490bb5e4-a457-47fc-9037-a0e4c7297874 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:37.806565 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-490bb5e4-a457-47fc-9037-a0e4c7297874 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:37.807287 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-490bb5e4-a457-47fc-9037-a0e4c7297874 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:37.807731 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-490bb5e4-a457-47fc-9037-a0e4c7297874 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:37.808141 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-490bb5e4-a457-47fc-9037-a0e4c7297874 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:37.997761 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-490bb5e4-a457-47fc-9037-a0e4c7297874 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:38.013937 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-490bb5e4-a457-47fc-9037-a0e4c7297874 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/56f45c71-b693-48c4-a2b6-dcfea882eaa4" status: 200 len: 1313 microversion: 2.1 time: 0.219891 Oct 17 13:38:38.014605 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 655/1279] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:37 2022] GET /compute/v2.1/servers/56f45c71-b693-48c4-a2b6-dcfea882eaa4 => generated 1313 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:38.019590 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b0f9383a-b066-4d0d-9bb2-b2621406ca7b tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:38.020258 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b0f9383a-b066-4d0d-9bb2-b2621406ca7b tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 0ffbef37-e5f8-4de2-a29d-dba6782a3fe4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:38.032342 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b0f9383a-b066-4d0d-9bb2-b2621406ca7b tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:38.032831 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b0f9383a-b066-4d0d-9bb2-b2621406ca7b tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:38.033268 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b0f9383a-b066-4d0d-9bb2-b2621406ca7b tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:38.033985 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b0f9383a-b066-4d0d-9bb2-b2621406ca7b tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:38.034435 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b0f9383a-b066-4d0d-9bb2-b2621406ca7b tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:38.034855 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b0f9383a-b066-4d0d-9bb2-b2621406ca7b tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:38.217493 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b0f9383a-b066-4d0d-9bb2-b2621406ca7b tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:38.230927 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b0f9383a-b066-4d0d-9bb2-b2621406ca7b tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:38.232833 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b0f9383a-b066-4d0d-9bb2-b2621406ca7b tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:38.234845 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b0f9383a-b066-4d0d-9bb2-b2621406ca7b tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4" status: 200 len: 1568 microversion: 2.25 time: 0.218443 Oct 17 13:38:38.235584 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 656/1280] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:38:38 2022] GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4 => generated 1568 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:38:38.246625 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-a87cd2b0-b981-4ed8-8e5d-e4089543087b req-5f9e1979-2162-4439-9cec-6ba4c94e70d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae587603-994d-419d-979a-1b1361144872", "name": "network-vif-plugged", "status": "completed", "tag": "e547063b-1442-46ea-a450-6fddc21a973b"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:38:38.266124 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-a87cd2b0-b981-4ed8-8e5d-e4089543087b req-5f9e1979-2162-4439-9cec-6ba4c94e70d9 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:38.266529 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-a87cd2b0-b981-4ed8-8e5d-e4089543087b req-5f9e1979-2162-4439-9cec-6ba4c94e70d9 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:38.266961 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-a87cd2b0-b981-4ed8-8e5d-e4089543087b req-5f9e1979-2162-4439-9cec-6ba4c94e70d9 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:38.285427 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-a87cd2b0-b981-4ed8-8e5d-e4089543087b req-5f9e1979-2162-4439-9cec-6ba4c94e70d9 service nova] Creating event network-vif-plugged:e547063b-1442-46ea-a450-6fddc21a973b for instance ae587603-994d-419d-979a-1b1361144872 on n-h1-854247-14 Oct 17 13:38:38.297784 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-a87cd2b0-b981-4ed8-8e5d-e4089543087b req-5f9e1979-2162-4439-9cec-6ba4c94e70d9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055605 Oct 17 13:38:38.299834 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 657/1281] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:38:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:38:38.315428 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-526bb431-e908-4125-924a-8ae5c94932f5 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:38.322062 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-526bb431-e908-4125-924a-8ae5c94932f5 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a23b9d586c57421abf53a7eaa3af9b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63faec71e9ad449896c83868d52dd09c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:38.323097 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-526bb431-e908-4125-924a-8ae5c94932f5 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Searching by: {'deleted': False, 'project_id': '63faec71e9ad449896c83868d52dd09c'} {{(pid=127017) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:38:38.329283 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-526bb431-e908-4125-924a-8ae5c94932f5 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:38.330748 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-526bb431-e908-4125-924a-8ae5c94932f5 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:38.331406 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-526bb431-e908-4125-924a-8ae5c94932f5 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:38.332696 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-526bb431-e908-4125-924a-8ae5c94932f5 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:38.333255 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-526bb431-e908-4125-924a-8ae5c94932f5 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:38.333778 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-526bb431-e908-4125-924a-8ae5c94932f5 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:38.442703 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.multi_cell_list [None req-526bb431-e908-4125-924a-8ae5c94932f5 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127017) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:38:38.521290 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-526bb431-e908-4125-924a-8ae5c94932f5 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23b9d586c57421abf53a7eaa3af9b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63faec71e9ad449896c83868d52dd09c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:38.528515 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-526bb431-e908-4125-924a-8ae5c94932f5 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:38.528515 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-526bb431-e908-4125-924a-8ae5c94932f5 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:38.529323 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-526bb431-e908-4125-924a-8ae5c94932f5 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:38.697831 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-526bb431-e908-4125-924a-8ae5c94932f5 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] 10.222.0.79 "GET /compute/v2.1/servers/detail" status: 200 len: 1700 microversion: 2.1 time: 0.395283 Oct 17 13:38:38.699547 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 658/1282] 10.222.0.79 () {58 vars in 1146 bytes} [Mon Oct 17 13:38:38 2022] GET /compute/v2.1/servers/detail => generated 1700 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:38.704445 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-df0bfb9b-9577-42a7-bb9e-9536d505e22b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:38.705257 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-df0bfb9b-9577-42a7-bb9e-9536d505e22b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] [instance: 32728e12-4f3f-4f72-902c-10349708549f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:38.712126 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-df0bfb9b-9577-42a7-bb9e-9536d505e22b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:38.712748 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-df0bfb9b-9577-42a7-bb9e-9536d505e22b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:38.724898 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-df0bfb9b-9577-42a7-bb9e-9536d505e22b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:38.724898 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-df0bfb9b-9577-42a7-bb9e-9536d505e22b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:38.724898 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-df0bfb9b-9577-42a7-bb9e-9536d505e22b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:38.724898 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-df0bfb9b-9577-42a7-bb9e-9536d505e22b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:38.740465 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-df0bfb9b-9577-42a7-bb9e-9536d505e22b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] HTTP exception thrown: Instance 32728e12-4f3f-4f72-902c-10349708549f could not be found. Oct 17 13:38:38.742885 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-df0bfb9b-9577-42a7-bb9e-9536d505e22b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Request method failure captured: Oct 17 13:38:38.742885 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/32728e12-4f3f-4f72-902c-10349708549f HTTP/1.1 Oct 17 13:38:38.742885 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:38:38.742885 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:38:38.742885 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:38:38.742885 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:38:38.742885 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:38:38.742885 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:38:38.742885 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:38:38.742885 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:38:38.742885 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVn0rKCCzxL1KwIZI1Im8ygkuewY-UzF6Z81i6cNkagTk7ClET_LM7mvJkIi7s6pFyo0jkOjEfkZnFMR6ojJjeKHBwoksuv9Z4X8LYNw4iNhGgW8aAiE8QzHsCgl5CJTTDwKklbNcQOJJRXIUfAtc0cseQ_bknPsrUPdOoFAaQy0_jg Oct 17 13:38:38.742885 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:38:38.742885 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:38:38.742885 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:38:38.742885 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:38:38.742885 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:38:38.742885 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:38:38.742885 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: fa1db260a96a4c6aa69cd6437baab6f7 Oct 17 13:38:38.742885 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServersOnMultiNodesTest-1107099453 Oct 17 13:38:38.742885 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:38:38.742885 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:38:38.745316 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/fa1db260a96a4c6aa69cd6437baab6f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/fa1db260a96a4c6aa69cd6437baab6f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/fa1db260a96a4c6aa69cd6437baab6f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_fa1db260a96a4c6aa69cd6437baab6f7", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:38:38.745316 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServersOnMultiNodesTest-1107099453 Oct 17 13:38:38.745316 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: fa1db260a96a4c6aa69cd6437baab6f7 Oct 17 13:38:38.745316 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1107099453 Oct 17 13:38:38.745316 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServersOnMultiNodesTest-1107099453-project Oct 17 13:38:38.745316 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:38:38.745316 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:38:38.745316 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 7a7e082035084338966a1c56b30c7093 Oct 17 13:38:38.745316 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServersOnMultiNodesTest-1107099453-project Oct 17 13:38:38.745316 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:38:38.745316 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 32728e12-4f3f-4f72-902c-10349708549f could not be found. Oct 17 13:38:38.745316 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '32728e12-4f3f-4f72-902c-10349708549f'} Oct 17 13:38:38.746332 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:38:38.746332 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:38:38.746332 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:38:38.746332 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:38:38.746332 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:38:38.746332 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:38:38.746332 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:38:38.746332 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:38:38.746332 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:38:38.746332 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:38:38.746332 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32728e12-4f3f-4f72-902c-10349708549f could not be found. Oct 17 13:38:38.746332 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:38:38.746332 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:38:38.746332 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:38:38.746332 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:38:38.746332 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:38:38.746332 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:38:38.746332 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:38:38.746332 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:38:38.746332 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:38:38.747912 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:38:38.747912 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:38:38.747912 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:38:38.747912 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:38:38.747912 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:38:38.747912 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:38:38.747912 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:38:38.747912 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32728e12-4f3f-4f72-902c-10349708549f could not be found. Oct 17 13:38:38.747912 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:38:38.747912 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:38:38.747912 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:38:38.747912 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:38:38.747912 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:38:38.747912 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:38:38.747912 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:38:38.747912 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:38:38.747912 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32728e12-4f3f-4f72-902c-10349708549f could not be found. Oct 17 13:38:38.747912 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:38:38.749347 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-df0bfb9b-9577-42a7-bb9e-9536d505e22b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] Returning 404 to user: Instance 32728e12-4f3f-4f72-902c-10349708549f could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:38:38.749347 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-df0bfb9b-9577-42a7-bb9e-9536d505e22b tempest-ServersOnMultiNodesTest-1107099453 tempest-ServersOnMultiNodesTest-1107099453-project] 10.222.0.79 "GET /compute/v2.1/servers/32728e12-4f3f-4f72-902c-10349708549f" status: 404 len: 111 microversion: 2.1 time: 0.045894 Oct 17 13:38:38.749347 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 659/1283] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:38 2022] GET /compute/v2.1/servers/32728e12-4f3f-4f72-902c-10349708549f => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:38:38.751902 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-94f39c53-1770-4eb4-a05e-0eac893597f8 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:38.752741 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-94f39c53-1770-4eb4-a05e-0eac893597f8 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 298b0f19-0a0c-4304-bb8b-4bd26cce2d9d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:38.765112 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-94f39c53-1770-4eb4-a05e-0eac893597f8 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:38.765736 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-94f39c53-1770-4eb4-a05e-0eac893597f8 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:38.766181 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-94f39c53-1770-4eb4-a05e-0eac893597f8 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:38.766897 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-94f39c53-1770-4eb4-a05e-0eac893597f8 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:38.767385 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-94f39c53-1770-4eb4-a05e-0eac893597f8 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:38.767808 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-94f39c53-1770-4eb4-a05e-0eac893597f8 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:39.061176 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-94f39c53-1770-4eb4-a05e-0eac893597f8 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:39.070500 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-94f39c53-1770-4eb4-a05e-0eac893597f8 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/298b0f19-0a0c-4304-bb8b-4bd26cce2d9d" status: 200 len: 1526 microversion: 2.1 time: 0.322510 Oct 17 13:38:39.079524 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 660/1284] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:38 2022] GET /compute/v2.1/servers/298b0f19-0a0c-4304-bb8b-4bd26cce2d9d => generated 1526 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:39.079524 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3d612eb5-8cb7-4413-8ac9-3dc573458d24 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:39.084442 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3d612eb5-8cb7-4413-8ac9-3dc573458d24 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] 10.222.0.79 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011677 Oct 17 13:38:39.103534 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 661/1285] 10.222.0.79 () {58 vars in 1137 bytes} [Mon Oct 17 13:38:39 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:38:39.109375 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a9de88a1-d50e-42f4-b0f4-30b401edb267 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:39.110146 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a9de88a1-d50e-42f4-b0f4-30b401edb267 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: 56f45c71-b693-48c4-a2b6-dcfea882eaa4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:39.119432 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a9de88a1-d50e-42f4-b0f4-30b401edb267 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:39.125042 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a9de88a1-d50e-42f4-b0f4-30b401edb267 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:39.125636 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a9de88a1-d50e-42f4-b0f4-30b401edb267 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:39.126749 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a9de88a1-d50e-42f4-b0f4-30b401edb267 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:39.127347 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a9de88a1-d50e-42f4-b0f4-30b401edb267 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:39.128039 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a9de88a1-d50e-42f4-b0f4-30b401edb267 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:39.380056 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a9de88a1-d50e-42f4-b0f4-30b401edb267 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:39.391464 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a9de88a1-d50e-42f4-b0f4-30b401edb267 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/56f45c71-b693-48c4-a2b6-dcfea882eaa4" status: 200 len: 1313 microversion: 2.1 time: 0.286047 Oct 17 13:38:39.396493 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 662/1286] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:39 2022] GET /compute/v2.1/servers/56f45c71-b693-48c4-a2b6-dcfea882eaa4 => generated 1313 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:39.405624 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ad256d6a-158f-48e5-b6e2-f18676a213d9 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:39.406942 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ad256d6a-158f-48e5-b6e2-f18676a213d9 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 0ffbef37-e5f8-4de2-a29d-dba6782a3fe4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:39.427466 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ad256d6a-158f-48e5-b6e2-f18676a213d9 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:39.432037 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ad256d6a-158f-48e5-b6e2-f18676a213d9 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:39.437018 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ad256d6a-158f-48e5-b6e2-f18676a213d9 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:39.440540 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ad256d6a-158f-48e5-b6e2-f18676a213d9 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:39.442681 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ad256d6a-158f-48e5-b6e2-f18676a213d9 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:39.443962 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ad256d6a-158f-48e5-b6e2-f18676a213d9 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:40.166074 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ad256d6a-158f-48e5-b6e2-f18676a213d9 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:40.179108 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ad256d6a-158f-48e5-b6e2-f18676a213d9 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:40.184378 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ad256d6a-158f-48e5-b6e2-f18676a213d9 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:40.188625 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ad256d6a-158f-48e5-b6e2-f18676a213d9 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4" status: 200 len: 1568 microversion: 2.25 time: 0.787559 Oct 17 13:38:40.199225 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 663/1287] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:38:39 2022] GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4 => generated 1568 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:38:40.212262 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a629bf14-8b15-40e1-86c4-ec8ab2578f2d tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:40.212818 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a629bf14-8b15-40e1-86c4-ec8ab2578f2d tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] [instance: 82f35c2e-21ad-448d-a198-6847bf664d52] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:40.226750 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a629bf14-8b15-40e1-86c4-ec8ab2578f2d tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:40.231318 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a629bf14-8b15-40e1-86c4-ec8ab2578f2d tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:40.235266 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a629bf14-8b15-40e1-86c4-ec8ab2578f2d tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:40.236135 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a629bf14-8b15-40e1-86c4-ec8ab2578f2d tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:40.236623 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a629bf14-8b15-40e1-86c4-ec8ab2578f2d tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:40.237059 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a629bf14-8b15-40e1-86c4-ec8ab2578f2d tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:40.285875 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a629bf14-8b15-40e1-86c4-ec8ab2578f2d tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] [instance: 82f35c2e-21ad-448d-a198-6847bf664d52] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:38:40.453270 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a629bf14-8b15-40e1-86c4-ec8ab2578f2d tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] 10.222.0.79 "DELETE /compute/v2.1/servers/82f35c2e-21ad-448d-a198-6847bf664d52" status: 204 len: 0 microversion: 2.1 time: 0.249929 Oct 17 13:38:40.454357 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 664/1288] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:38:40 2022] DELETE /compute/v2.1/servers/82f35c2e-21ad-448d-a198-6847bf664d52 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:38:40.463562 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7245255d-208b-4836-93f5-a4eab256e865 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:40.464712 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7245255d-208b-4836-93f5-a4eab256e865 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 298b0f19-0a0c-4304-bb8b-4bd26cce2d9d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:40.474863 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7245255d-208b-4836-93f5-a4eab256e865 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:40.475526 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7245255d-208b-4836-93f5-a4eab256e865 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:40.476630 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7245255d-208b-4836-93f5-a4eab256e865 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:40.477707 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7245255d-208b-4836-93f5-a4eab256e865 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:40.478348 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7245255d-208b-4836-93f5-a4eab256e865 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:40.478882 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7245255d-208b-4836-93f5-a4eab256e865 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:40.724358 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7245255d-208b-4836-93f5-a4eab256e865 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:40.740608 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7245255d-208b-4836-93f5-a4eab256e865 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/298b0f19-0a0c-4304-bb8b-4bd26cce2d9d" status: 200 len: 1526 microversion: 2.1 time: 0.284341 Oct 17 13:38:40.741214 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 665/1289] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:40 2022] GET /compute/v2.1/servers/298b0f19-0a0c-4304-bb8b-4bd26cce2d9d => generated 1526 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:40.749255 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-d2d7ca4c-9723-4555-afa3-96008a088d66 req-d9bcc009-96ca-407b-ad1f-fa538ee89de5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56f45c71-b693-48c4-a2b6-dcfea882eaa4", "name": "network-vif-plugged", "status": "completed", "tag": "daf0db87-9b0f-4002-bd30-1e15678e955e"}, {"server_uuid": "298b0f19-0a0c-4304-bb8b-4bd26cce2d9d", "name": "network-vif-unplugged", "status": "completed", "tag": "1b002cb5-02b8-45df-a6b3-cb4130290727"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:38:40.781188 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-d2d7ca4c-9723-4555-afa3-96008a088d66 req-d9bcc009-96ca-407b-ad1f-fa538ee89de5 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:40.781188 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-d2d7ca4c-9723-4555-afa3-96008a088d66 req-d9bcc009-96ca-407b-ad1f-fa538ee89de5 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:40.781188 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-d2d7ca4c-9723-4555-afa3-96008a088d66 req-d9bcc009-96ca-407b-ad1f-fa538ee89de5 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:40.821021 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-d2d7ca4c-9723-4555-afa3-96008a088d66 req-d9bcc009-96ca-407b-ad1f-fa538ee89de5 service nova] Creating event network-vif-plugged:daf0db87-9b0f-4002-bd30-1e15678e955e for instance 56f45c71-b693-48c4-a2b6-dcfea882eaa4 on n-h2-854247-14 Oct 17 13:38:40.821574 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-d2d7ca4c-9723-4555-afa3-96008a088d66 req-d9bcc009-96ca-407b-ad1f-fa538ee89de5 service nova] Creating event network-vif-unplugged:1b002cb5-02b8-45df-a6b3-cb4130290727 for instance 298b0f19-0a0c-4304-bb8b-4bd26cce2d9d on n-h2-854247-14 Oct 17 13:38:40.889736 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-d2d7ca4c-9723-4555-afa3-96008a088d66 req-d9bcc009-96ca-407b-ad1f-fa538ee89de5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.131989 Oct 17 13:38:40.889736 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 666/1290] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:38:40.910535 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a501d14c-ca5b-4ba9-a086-23bb371af407 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:40.911467 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a501d14c-ca5b-4ba9-a086-23bb371af407 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: 56f45c71-b693-48c4-a2b6-dcfea882eaa4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:40.923099 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a501d14c-ca5b-4ba9-a086-23bb371af407 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:40.923659 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a501d14c-ca5b-4ba9-a086-23bb371af407 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:40.924111 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a501d14c-ca5b-4ba9-a086-23bb371af407 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:40.926009 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a501d14c-ca5b-4ba9-a086-23bb371af407 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:40.926525 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a501d14c-ca5b-4ba9-a086-23bb371af407 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:40.927363 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a501d14c-ca5b-4ba9-a086-23bb371af407 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:41.335888 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a501d14c-ca5b-4ba9-a086-23bb371af407 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:41.350103 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a501d14c-ca5b-4ba9-a086-23bb371af407 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/56f45c71-b693-48c4-a2b6-dcfea882eaa4" status: 200 len: 1313 microversion: 2.1 time: 0.464063 Oct 17 13:38:41.361139 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 667/1291] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:40 2022] GET /compute/v2.1/servers/56f45c71-b693-48c4-a2b6-dcfea882eaa4 => generated 1313 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:41.372691 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d1cfc0ef-47d9-4b59-9736-779b23216570 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:41.374953 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d1cfc0ef-47d9-4b59-9736-779b23216570 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] [instance: 82f35c2e-21ad-448d-a198-6847bf664d52] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:41.394096 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d1cfc0ef-47d9-4b59-9736-779b23216570 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:41.395018 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d1cfc0ef-47d9-4b59-9736-779b23216570 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:41.395727 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d1cfc0ef-47d9-4b59-9736-779b23216570 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:41.396541 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d1cfc0ef-47d9-4b59-9736-779b23216570 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:41.397172 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d1cfc0ef-47d9-4b59-9736-779b23216570 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:41.398105 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d1cfc0ef-47d9-4b59-9736-779b23216570 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:41.682993 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d1cfc0ef-47d9-4b59-9736-779b23216570 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23b9d586c57421abf53a7eaa3af9b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63faec71e9ad449896c83868d52dd09c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:41.695616 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d1cfc0ef-47d9-4b59-9736-779b23216570 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] 10.222.0.79 "GET /compute/v2.1/servers/82f35c2e-21ad-448d-a198-6847bf664d52" status: 200 len: 1703 microversion: 2.1 time: 0.332036 Oct 17 13:38:41.705914 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 668/1292] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:41 2022] GET /compute/v2.1/servers/82f35c2e-21ad-448d-a198-6847bf664d52 => generated 1703 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:41.714807 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-4baee3b2-694b-449f-92b9-0d952a0d411e req-65c7e508-2244-4b57-a0d2-99abb02ab205 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "298b0f19-0a0c-4304-bb8b-4bd26cce2d9d", "name": "network-vif-deleted", "tag": "1b002cb5-02b8-45df-a6b3-cb4130290727"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:38:41.725486 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=3,nova_api:UPDATE=3 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:38:41.728680 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-4baee3b2-694b-449f-92b9-0d952a0d411e req-65c7e508-2244-4b57-a0d2-99abb02ab205 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:41.729509 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-4baee3b2-694b-449f-92b9-0d952a0d411e req-65c7e508-2244-4b57-a0d2-99abb02ab205 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:41.730400 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-4baee3b2-694b-449f-92b9-0d952a0d411e req-65c7e508-2244-4b57-a0d2-99abb02ab205 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:41.734286 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:38:41.747914 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-4baee3b2-694b-449f-92b9-0d952a0d411e req-65c7e508-2244-4b57-a0d2-99abb02ab205 service nova] Creating event network-vif-deleted:1b002cb5-02b8-45df-a6b3-cb4130290727 for instance 298b0f19-0a0c-4304-bb8b-4bd26cce2d9d on n-h2-854247-14 Oct 17 13:38:41.774366 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-4baee3b2-694b-449f-92b9-0d952a0d411e req-65c7e508-2244-4b57-a0d2-99abb02ab205 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060827 Oct 17 13:38:41.778555 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 669/1293] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:38:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:38:41.784519 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5ae93445-846a-4289-9fb7-d2eecb046b83 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:41.785271 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5ae93445-846a-4289-9fb7-d2eecb046b83 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 0ffbef37-e5f8-4de2-a29d-dba6782a3fe4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:41.793737 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5ae93445-846a-4289-9fb7-d2eecb046b83 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:41.794250 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5ae93445-846a-4289-9fb7-d2eecb046b83 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:41.794688 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5ae93445-846a-4289-9fb7-d2eecb046b83 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:41.795433 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5ae93445-846a-4289-9fb7-d2eecb046b83 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:41.796161 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5ae93445-846a-4289-9fb7-d2eecb046b83 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:41.796591 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5ae93445-846a-4289-9fb7-d2eecb046b83 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:42.127784 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5ae93445-846a-4289-9fb7-d2eecb046b83 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:42.143256 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5ae93445-846a-4289-9fb7-d2eecb046b83 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:42.144888 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5ae93445-846a-4289-9fb7-d2eecb046b83 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:42.146150 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5ae93445-846a-4289-9fb7-d2eecb046b83 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4" status: 200 len: 1568 microversion: 2.25 time: 0.366575 Oct 17 13:38:42.161706 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 670/1294] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:38:41 2022] GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4 => generated 1568 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:38:42.171456 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c71696d2-db47-47d8-ba06-aed16e6d6af3 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:42.172203 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c71696d2-db47-47d8-ba06-aed16e6d6af3 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 298b0f19-0a0c-4304-bb8b-4bd26cce2d9d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:42.189990 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c71696d2-db47-47d8-ba06-aed16e6d6af3 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:42.190279 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c71696d2-db47-47d8-ba06-aed16e6d6af3 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:42.190714 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c71696d2-db47-47d8-ba06-aed16e6d6af3 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:42.191478 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c71696d2-db47-47d8-ba06-aed16e6d6af3 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:42.191925 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c71696d2-db47-47d8-ba06-aed16e6d6af3 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:42.192346 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c71696d2-db47-47d8-ba06-aed16e6d6af3 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:42.229948 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c71696d2-db47-47d8-ba06-aed16e6d6af3 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:42.230679 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c71696d2-db47-47d8-ba06-aed16e6d6af3 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:42.231133 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c71696d2-db47-47d8-ba06-aed16e6d6af3 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:42.231674 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-c71696d2-db47-47d8-ba06-aed16e6d6af3 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lazy-loading 'fault' on Instance uuid 298b0f19-0a0c-4304-bb8b-4bd26cce2d9d {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:38:42.285237 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c71696d2-db47-47d8-ba06-aed16e6d6af3 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:42.297306 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c71696d2-db47-47d8-ba06-aed16e6d6af3 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/298b0f19-0a0c-4304-bb8b-4bd26cce2d9d" status: 200 len: 1314 microversion: 2.1 time: 0.134394 Oct 17 13:38:42.307628 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 671/1295] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:42 2022] GET /compute/v2.1/servers/298b0f19-0a0c-4304-bb8b-4bd26cce2d9d => generated 1314 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:42.373615 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-96ff5efd-dfad-45c3-b7e2-cb148c183866 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:42.374423 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-96ff5efd-dfad-45c3-b7e2-cb148c183866 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: 56f45c71-b693-48c4-a2b6-dcfea882eaa4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:42.386464 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-96ff5efd-dfad-45c3-b7e2-cb148c183866 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:42.388957 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-96ff5efd-dfad-45c3-b7e2-cb148c183866 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:42.389480 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-96ff5efd-dfad-45c3-b7e2-cb148c183866 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:42.390278 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-96ff5efd-dfad-45c3-b7e2-cb148c183866 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:42.392927 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-96ff5efd-dfad-45c3-b7e2-cb148c183866 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:42.394308 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-96ff5efd-dfad-45c3-b7e2-cb148c183866 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:42.799328 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-96ff5efd-dfad-45c3-b7e2-cb148c183866 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:42.810893 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-96ff5efd-dfad-45c3-b7e2-cb148c183866 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/56f45c71-b693-48c4-a2b6-dcfea882eaa4" status: 200 len: 1313 microversion: 2.1 time: 0.441478 Oct 17 13:38:42.811536 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 672/1296] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:42 2022] GET /compute/v2.1/servers/56f45c71-b693-48c4-a2b6-dcfea882eaa4 => generated 1313 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:38:42.823091 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f215e6bd-1888-4c16-b948-9ff8c795f2d6 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:42.827687 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f215e6bd-1888-4c16-b948-9ff8c795f2d6 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] [instance: 82f35c2e-21ad-448d-a198-6847bf664d52] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:42.840082 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f215e6bd-1888-4c16-b948-9ff8c795f2d6 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:42.840575 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f215e6bd-1888-4c16-b948-9ff8c795f2d6 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:42.841078 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f215e6bd-1888-4c16-b948-9ff8c795f2d6 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:42.841788 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f215e6bd-1888-4c16-b948-9ff8c795f2d6 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:42.842241 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f215e6bd-1888-4c16-b948-9ff8c795f2d6 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:42.842729 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f215e6bd-1888-4c16-b948-9ff8c795f2d6 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:43.392035 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f215e6bd-1888-4c16-b948-9ff8c795f2d6 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23b9d586c57421abf53a7eaa3af9b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63faec71e9ad449896c83868d52dd09c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:43.402407 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f215e6bd-1888-4c16-b948-9ff8c795f2d6 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] 10.222.0.79 "GET /compute/v2.1/servers/82f35c2e-21ad-448d-a198-6847bf664d52" status: 200 len: 1703 microversion: 2.1 time: 0.589451 Oct 17 13:38:43.410131 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 673/1297] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:42 2022] GET /compute/v2.1/servers/82f35c2e-21ad-448d-a198-6847bf664d52 => generated 1703 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:43.420425 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f4254cec-5728-45a8-b57a-9d603854ae4e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:43.425207 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f4254cec-5728-45a8-b57a-9d603854ae4e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 0ffbef37-e5f8-4de2-a29d-dba6782a3fe4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:43.448359 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f4254cec-5728-45a8-b57a-9d603854ae4e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:43.451330 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f4254cec-5728-45a8-b57a-9d603854ae4e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:43.452104 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f4254cec-5728-45a8-b57a-9d603854ae4e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:43.453135 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f4254cec-5728-45a8-b57a-9d603854ae4e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:43.453587 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f4254cec-5728-45a8-b57a-9d603854ae4e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:43.455908 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f4254cec-5728-45a8-b57a-9d603854ae4e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:43.841143 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f4254cec-5728-45a8-b57a-9d603854ae4e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:43.864605 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f4254cec-5728-45a8-b57a-9d603854ae4e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:43.867254 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f4254cec-5728-45a8-b57a-9d603854ae4e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:43.867543 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f4254cec-5728-45a8-b57a-9d603854ae4e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4" status: 200 len: 1568 microversion: 2.25 time: 0.456253 Oct 17 13:38:43.868531 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 674/1298] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:38:43 2022] GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4 => generated 1568 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:38:43.891273 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bd9cd4b4-b26c-4449-82b9-96dcdf9a1366 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:43.892776 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-bd9cd4b4-b26c-4449-82b9-96dcdf9a1366 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 298b0f19-0a0c-4304-bb8b-4bd26cce2d9d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:43.899997 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bd9cd4b4-b26c-4449-82b9-96dcdf9a1366 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:43.900758 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bd9cd4b4-b26c-4449-82b9-96dcdf9a1366 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:43.901176 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bd9cd4b4-b26c-4449-82b9-96dcdf9a1366 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:43.902054 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bd9cd4b4-b26c-4449-82b9-96dcdf9a1366 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:43.902513 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bd9cd4b4-b26c-4449-82b9-96dcdf9a1366 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:43.902914 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bd9cd4b4-b26c-4449-82b9-96dcdf9a1366 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:43.923591 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-bd9cd4b4-b26c-4449-82b9-96dcdf9a1366 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] HTTP exception thrown: Instance 298b0f19-0a0c-4304-bb8b-4bd26cce2d9d could not be found. Oct 17 13:38:43.925250 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bd9cd4b4-b26c-4449-82b9-96dcdf9a1366 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Request method failure captured: Oct 17 13:38:43.925250 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/298b0f19-0a0c-4304-bb8b-4bd26cce2d9d HTTP/1.1 Oct 17 13:38:43.925250 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:38:43.925250 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:38:43.925250 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:38:43.925250 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:38:43.925250 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:38:43.925250 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:38:43.925250 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:38:43.925250 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:38:43.925250 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVp-7IxfFP3OCFXwoptz1mkTvVFP-q1mVdb9duvFJBSFB2Milojb0bt4JEkHbyx5bSK8AUBQstoN0fpOUoelRV9Ur5eKS-T70viEjT2k_9W3ZeERt1Gvx_VBqcxVNMvlXoLi-KthVHD7so8JMwaOern88ECZl5tX1TwIw6qcARP1TSo Oct 17 13:38:43.925250 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:38:43.925250 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:38:43.925250 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:38:43.925250 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:38:43.925250 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:38:43.925250 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:38:43.925250 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: c7507d1dd2d345ca9b59dcaa7806b56e Oct 17 13:38:43.925250 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2045461887 Oct 17 13:38:43.925250 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:38:43.925250 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:38:43.926718 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c7507d1dd2d345ca9b59dcaa7806b56e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c7507d1dd2d345ca9b59dcaa7806b56e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c7507d1dd2d345ca9b59dcaa7806b56e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c7507d1dd2d345ca9b59dcaa7806b56e", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:38:43.926718 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2045461887 Oct 17 13:38:43.926718 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: c7507d1dd2d345ca9b59dcaa7806b56e Oct 17 13:38:43.926718 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2045461887 Oct 17 13:38:43.926718 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ImagesOneServerNegativeTestJSON-2045461887-project Oct 17 13:38:43.926718 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:38:43.926718 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:38:43.926718 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: dcbd60cab4174e8db26e28f015795e1f Oct 17 13:38:43.926718 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2045461887-project Oct 17 13:38:43.926718 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:38:43.926718 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 298b0f19-0a0c-4304-bb8b-4bd26cce2d9d could not be found. Oct 17 13:38:43.926718 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '298b0f19-0a0c-4304-bb8b-4bd26cce2d9d'} Oct 17 13:38:43.927594 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:38:43.927594 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:38:43.927594 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:38:43.927594 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:38:43.927594 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:38:43.927594 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:38:43.927594 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:38:43.927594 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:38:43.927594 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:38:43.927594 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:38:43.927594 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 298b0f19-0a0c-4304-bb8b-4bd26cce2d9d could not be found. Oct 17 13:38:43.927594 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:38:43.927594 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:38:43.927594 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:38:43.927594 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:38:43.927594 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:38:43.927594 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:38:43.927594 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:38:43.927594 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:38:43.927594 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:38:43.929845 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:38:43.929845 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:38:43.929845 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:38:43.929845 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:38:43.929845 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:38:43.929845 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:38:43.929845 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:38:43.929845 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 298b0f19-0a0c-4304-bb8b-4bd26cce2d9d could not be found. Oct 17 13:38:43.929845 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:38:43.929845 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:38:43.929845 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:38:43.929845 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:38:43.929845 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:38:43.929845 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:38:43.929845 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:38:43.929845 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:38:43.929845 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 298b0f19-0a0c-4304-bb8b-4bd26cce2d9d could not be found. Oct 17 13:38:43.929845 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:38:43.931700 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bd9cd4b4-b26c-4449-82b9-96dcdf9a1366 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Returning 404 to user: Instance 298b0f19-0a0c-4304-bb8b-4bd26cce2d9d could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:38:43.931700 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-bd9cd4b4-b26c-4449-82b9-96dcdf9a1366 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/298b0f19-0a0c-4304-bb8b-4bd26cce2d9d" status: 404 len: 111 microversion: 2.1 time: 0.042773 Oct 17 13:38:43.935333 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 675/1299] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:43 2022] GET /compute/v2.1/servers/298b0f19-0a0c-4304-bb8b-4bd26cce2d9d => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:38:43.951184 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7f0ae848-33b9-4450-9dcb-2875fd922357 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:43.955506 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7f0ae848-33b9-4450-9dcb-2875fd922357 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: 56f45c71-b693-48c4-a2b6-dcfea882eaa4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:43.967688 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7f0ae848-33b9-4450-9dcb-2875fd922357 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:43.982846 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7f0ae848-33b9-4450-9dcb-2875fd922357 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:43.984638 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7f0ae848-33b9-4450-9dcb-2875fd922357 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:43.986477 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7f0ae848-33b9-4450-9dcb-2875fd922357 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:43.987648 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7f0ae848-33b9-4450-9dcb-2875fd922357 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:43.989042 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7f0ae848-33b9-4450-9dcb-2875fd922357 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:44.365185 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7f0ae848-33b9-4450-9dcb-2875fd922357 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:44.379042 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7f0ae848-33b9-4450-9dcb-2875fd922357 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/56f45c71-b693-48c4-a2b6-dcfea882eaa4" status: 200 len: 1463 microversion: 2.1 time: 0.437788 Oct 17 13:38:44.379763 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 676/1300] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:43 2022] GET /compute/v2.1/servers/56f45c71-b693-48c4-a2b6-dcfea882eaa4 => generated 1463 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:44.706451 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9500ace8-5c61-4612-bf6b-22041bd09ed5 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-650874952", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": "none"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:38:45.846315 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=5 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:38:46.376785 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=33 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:38:48.369012 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=4 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:38:48.517366 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:38:49.988207 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5a0ab2e0-41ae-4485-a64f-dcb701e09fd0 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/c13431d2-5f95-49db-9d9a-05ff951c6069" status: 200 len: 1413 microversion: 2.1 time: 13.589265 Oct 17 13:38:49.989109 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 625/1301] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:38:36 2022] GET /compute/v2.1/images/c13431d2-5f95-49db-9d9a-05ff951c6069 => generated 1413 bytes in 13596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:49.998693 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d4b2e778-2dd2-455e-a2d5-739837bf2cc7 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-88443298", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:38:50.011581 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-9500ace8-5c61-4612-bf6b-22041bd09ed5 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:38:50.012157 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-9500ace8-5c61-4612-bf6b-22041bd09ed5 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:38:50.012608 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-9500ace8-5c61-4612-bf6b-22041bd09ed5 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:38:50.013084 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-9500ace8-5c61-4612-bf6b-22041bd09ed5 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:38:50.013563 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-9500ace8-5c61-4612-bf6b-22041bd09ed5 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:38:50.032678 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9500ace8-5c61-4612-bf6b-22041bd09ed5 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:50.036074 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9500ace8-5c61-4612-bf6b-22041bd09ed5 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:50.036767 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9500ace8-5c61-4612-bf6b-22041bd09ed5 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:50.038741 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9500ace8-5c61-4612-bf6b-22041bd09ed5 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:50.041551 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9500ace8-5c61-4612-bf6b-22041bd09ed5 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:50.042242 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9500ace8-5c61-4612-bf6b-22041bd09ed5 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:50.060233 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-d4b2e778-2dd2-455e-a2d5-739837bf2cc7 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] validate_networks() for [('46e81a55-75e1-43e4-b23d-9bbaa4d6fbd9', None, None, None, None, None)] {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:38:50.088646 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-9500ace8-5c61-4612-bf6b-22041bd09ed5 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Getting quotas for project 94c28b94c6334be0aa70c50b06b10e6e. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:38:50.100894 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-9500ace8-5c61-4612-bf6b-22041bd09ed5 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Getting quotas for user 38372f861f1649ac99de9fdc82648e76 and project 94c28b94c6334be0aa70c50b06b10e6e. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:38:50.126695 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9500ace8-5c61-4612-bf6b-22041bd09ed5 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:38:50.129395 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9500ace8-5c61-4612-bf6b-22041bd09ed5 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:38:50.223797 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9500ace8-5c61-4612-bf6b-22041bd09ed5 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 5.840309 Oct 17 13:38:50.224265 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 677/1302] 10.222.0.79 () {62 vars in 1188 bytes} [Mon Oct 17 13:38:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 5844 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 13:38:50.402839 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a52c73dd-9261-4882-9665-333afcac80fc tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:50.414004 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a52c73dd-9261-4882-9665-333afcac80fc tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Searching by: {'deleted': False, 'project_id': '7a45026c8fc2485b81631bb0fd29d718'} {{(pid=127017) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:38:50.433377 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a52c73dd-9261-4882-9665-333afcac80fc tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:50.434241 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a52c73dd-9261-4882-9665-333afcac80fc tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:50.435152 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a52c73dd-9261-4882-9665-333afcac80fc tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:50.437799 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a52c73dd-9261-4882-9665-333afcac80fc tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:50.438456 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a52c73dd-9261-4882-9665-333afcac80fc tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:50.439322 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a52c73dd-9261-4882-9665-333afcac80fc tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:50.475204 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a52c73dd-9261-4882-9665-333afcac80fc tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.249663 Oct 17 13:38:50.479393 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 678/1303] 10.222.0.79 () {58 vars in 1146 bytes} [Mon Oct 17 13:38:50 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:38:50.484305 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7c746b05-abf8-46c2-9abf-237834df3d69 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:50.485004 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7c746b05-abf8-46c2-9abf-237834df3d69 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] [instance: 82f35c2e-21ad-448d-a198-6847bf664d52] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:50.492875 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7c746b05-abf8-46c2-9abf-237834df3d69 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:50.493638 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7c746b05-abf8-46c2-9abf-237834df3d69 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:50.494147 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7c746b05-abf8-46c2-9abf-237834df3d69 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:50.496032 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7c746b05-abf8-46c2-9abf-237834df3d69 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:50.499506 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7c746b05-abf8-46c2-9abf-237834df3d69 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:50.499984 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7c746b05-abf8-46c2-9abf-237834df3d69 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:50.520147 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-7c746b05-abf8-46c2-9abf-237834df3d69 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] HTTP exception thrown: Instance 82f35c2e-21ad-448d-a198-6847bf664d52 could not be found. Oct 17 13:38:50.521762 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7c746b05-abf8-46c2-9abf-237834df3d69 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Request method failure captured: Oct 17 13:38:50.521762 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/82f35c2e-21ad-448d-a198-6847bf664d52 HTTP/1.1 Oct 17 13:38:50.521762 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:38:50.521762 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:38:50.521762 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:38:50.521762 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:38:50.521762 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:38:50.521762 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:38:50.521762 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:38:50.521762 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:38:50.521762 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVqHGJ_IDkLf5oL4W5spK0baxKQvv0uyL7dXp8mSIKd51oIgdMuWDc6V2TElhOqlv2GzImvED4VH-YV5k8sRVGc4PfmUndjEZ0jk4jMGUVqNN08W02c0-zxY26YVhlo0URSpQZzxTwibfwtEkEX0ScuabMmaRy3vT00X_9fYBuaglQ8 Oct 17 13:38:50.521762 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:38:50.521762 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:38:50.521762 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:38:50.521762 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:38:50.521762 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:38:50.521762 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:38:50.521762 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 63faec71e9ad449896c83868d52dd09c Oct 17 13:38:50.521762 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServersTestJSON-57903945 Oct 17 13:38:50.521762 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:38:50.521762 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:38:50.523646 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/63faec71e9ad449896c83868d52dd09c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/63faec71e9ad449896c83868d52dd09c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/63faec71e9ad449896c83868d52dd09c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_63faec71e9ad449896c83868d52dd09c", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:38:50.523646 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServersTestJSON-57903945 Oct 17 13:38:50.523646 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 63faec71e9ad449896c83868d52dd09c Oct 17 13:38:50.523646 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServersTestJSON-57903945 Oct 17 13:38:50.523646 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServersTestJSON-57903945-project Oct 17 13:38:50.523646 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:38:50.523646 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:38:50.523646 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: a23b9d586c57421abf53a7eaa3af9b81 Oct 17 13:38:50.523646 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServersTestJSON-57903945-project Oct 17 13:38:50.523646 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:38:50.523646 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 82f35c2e-21ad-448d-a198-6847bf664d52 could not be found. Oct 17 13:38:50.523646 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '82f35c2e-21ad-448d-a198-6847bf664d52'} Oct 17 13:38:50.524564 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:38:50.524564 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:38:50.524564 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:38:50.524564 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:38:50.524564 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:38:50.524564 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:38:50.524564 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:38:50.524564 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:38:50.524564 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:38:50.524564 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:38:50.524564 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82f35c2e-21ad-448d-a198-6847bf664d52 could not be found. Oct 17 13:38:50.524564 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:38:50.524564 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:38:50.524564 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:38:50.524564 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:38:50.524564 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:38:50.524564 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:38:50.524564 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:38:50.524564 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:38:50.524564 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:38:50.526030 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:38:50.526030 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:38:50.526030 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:38:50.526030 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:38:50.526030 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:38:50.526030 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:38:50.526030 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:38:50.526030 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82f35c2e-21ad-448d-a198-6847bf664d52 could not be found. Oct 17 13:38:50.526030 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:38:50.526030 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:38:50.526030 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:38:50.526030 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:38:50.526030 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:38:50.526030 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:38:50.526030 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:38:50.526030 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:38:50.526030 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82f35c2e-21ad-448d-a198-6847bf664d52 could not be found. Oct 17 13:38:50.526030 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:38:50.527226 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7c746b05-abf8-46c2-9abf-237834df3d69 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Returning 404 to user: Instance 82f35c2e-21ad-448d-a198-6847bf664d52 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:38:50.527226 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7c746b05-abf8-46c2-9abf-237834df3d69 tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] 10.222.0.79 "GET /compute/v2.1/servers/82f35c2e-21ad-448d-a198-6847bf664d52" status: 404 len: 111 microversion: 2.1 time: 0.042696 Oct 17 13:38:50.527226 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 679/1304] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:50 2022] GET /compute/v2.1/servers/82f35c2e-21ad-448d-a198-6847bf664d52 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:38:50.546554 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-d4b2e778-2dd2-455e-a2d5-739837bf2cc7 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:38:50.547323 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-d4b2e778-2dd2-455e-a2d5-739837bf2cc7 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:38:50.548501 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-d4b2e778-2dd2-455e-a2d5-739837bf2cc7 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:38:50.548923 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-d4b2e778-2dd2-455e-a2d5-739837bf2cc7 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:38:50.549626 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-d4b2e778-2dd2-455e-a2d5-739837bf2cc7 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:38:50.558991 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d4b2e778-2dd2-455e-a2d5-739837bf2cc7 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:50.559625 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d4b2e778-2dd2-455e-a2d5-739837bf2cc7 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:50.560288 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d4b2e778-2dd2-455e-a2d5-739837bf2cc7 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:50.561214 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d4b2e778-2dd2-455e-a2d5-739837bf2cc7 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:50.562029 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d4b2e778-2dd2-455e-a2d5-739837bf2cc7 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:50.562452 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d4b2e778-2dd2-455e-a2d5-739837bf2cc7 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:50.581582 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-d4b2e778-2dd2-455e-a2d5-739837bf2cc7 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Getting quotas for project c7507d1dd2d345ca9b59dcaa7806b56e. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:38:50.586720 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-d4b2e778-2dd2-455e-a2d5-739837bf2cc7 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Getting quotas for user dcbd60cab4174e8db26e28f015795e1f and project c7507d1dd2d345ca9b59dcaa7806b56e. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:38:50.593268 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-3f3c523c-25d7-423c-9a5b-4a0a0751e742 req-a425a773-b2ce-4b1e-9cb9-6c69d7f7cd23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82f35c2e-21ad-448d-a198-6847bf664d52", "name": "network-vif-deleted", "tag": "dd85193d-95aa-4f67-99f3-26d0422dc6af"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:38:50.599342 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d4b2e778-2dd2-455e-a2d5-739837bf2cc7 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:38:50.601821 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d4b2e778-2dd2-455e-a2d5-739837bf2cc7 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 68d9b4cb-0dc2-4809-8715-bdab9be79bd0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:38:50.606284 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-3f3c523c-25d7-423c-9a5b-4a0a0751e742 req-a425a773-b2ce-4b1e-9cb9-6c69d7f7cd23 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:50.607259 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-3f3c523c-25d7-423c-9a5b-4a0a0751e742 req-a425a773-b2ce-4b1e-9cb9-6c69d7f7cd23 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:50.608006 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-3f3c523c-25d7-423c-9a5b-4a0a0751e742 req-a425a773-b2ce-4b1e-9cb9-6c69d7f7cd23 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:50.626932 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-3f3c523c-25d7-423c-9a5b-4a0a0751e742 req-a425a773-b2ce-4b1e-9cb9-6c69d7f7cd23 service nova] Creating event network-vif-deleted:dd85193d-95aa-4f67-99f3-26d0422dc6af for instance 82f35c2e-21ad-448d-a198-6847bf664d52 on n-h1-854247-14 Oct 17 13:38:50.634483 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-3f3c523c-25d7-423c-9a5b-4a0a0751e742 req-a425a773-b2ce-4b1e-9cb9-6c69d7f7cd23 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108728 Oct 17 13:38:50.635407 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 680/1305] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:38:50.640458 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6a837dc8-f8df-40fd-86cb-16fce689500f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:50.641166 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6a837dc8-f8df-40fd-86cb-16fce689500f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 0ffbef37-e5f8-4de2-a29d-dba6782a3fe4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:50.648633 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6a837dc8-f8df-40fd-86cb-16fce689500f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:50.649191 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6a837dc8-f8df-40fd-86cb-16fce689500f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:50.654950 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6a837dc8-f8df-40fd-86cb-16fce689500f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:50.655750 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6a837dc8-f8df-40fd-86cb-16fce689500f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:50.656225 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6a837dc8-f8df-40fd-86cb-16fce689500f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:50.656663 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6a837dc8-f8df-40fd-86cb-16fce689500f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:50.658864 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d4b2e778-2dd2-455e-a2d5-739837bf2cc7 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.665392 Oct 17 13:38:50.659783 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 626/1306] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:38:49 2022] POST /compute/v2.1/servers => generated 383 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:38:50.668563 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5784142d-bc60-4748-af43-f7d266b0ba6f tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:50.669503 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5784142d-bc60-4748-af43-f7d266b0ba6f tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:50.761297 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5784142d-bc60-4748-af43-f7d266b0ba6f tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:50.770761 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5784142d-bc60-4748-af43-f7d266b0ba6f tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:50.778936 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5784142d-bc60-4748-af43-f7d266b0ba6f tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:50.788556 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5784142d-bc60-4748-af43-f7d266b0ba6f tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1452 microversion: 2.91 time: 0.127363 Oct 17 13:38:50.789594 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 627/1307] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:38:50 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1452 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:38:50.794170 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-74c6572b-762c-4d74-b949-761175d42268 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:50.801694 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-74c6572b-762c-4d74-b949-761175d42268 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Searching by: {'deleted': False} {{(pid=127016) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:38:50.828732 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-74c6572b-762c-4d74-b949-761175d42268 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:50.829268 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-74c6572b-762c-4d74-b949-761175d42268 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:50.829698 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-74c6572b-762c-4d74-b949-761175d42268 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:50.830998 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-74c6572b-762c-4d74-b949-761175d42268 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:50.830998 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-74c6572b-762c-4d74-b949-761175d42268 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:50.831488 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-74c6572b-762c-4d74-b949-761175d42268 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:50.931594 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6a837dc8-f8df-40fd-86cb-16fce689500f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:50.944200 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6a837dc8-f8df-40fd-86cb-16fce689500f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:50.947041 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6a837dc8-f8df-40fd-86cb-16fce689500f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:50.951272 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6a837dc8-f8df-40fd-86cb-16fce689500f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4" status: 200 len: 1558 microversion: 2.25 time: 0.314824 Oct 17 13:38:50.954530 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 681/1308] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:38:50 2022] GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4 => generated 1558 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:38:50.959424 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0514c6c4-d858-430a-886b-2b4b24053e8f tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] Calling method '.version_select at 0x7f7cd5502d30>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:50.983677 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.multi_cell_list [None req-74c6572b-762c-4d74-b949-761175d42268 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Listed batch of 9 results from cell out of 998 limit. Returned 9 total so far. {{(pid=127016) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:38:51.009667 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0514c6c4-d858-430a-886b-2b4b24053e8f tempest-ServersTestJSON-57903945 tempest-ServersTestJSON-57903945-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1561111317" status: 202 len: 0 microversion: 2.1 time: 0.052891 Oct 17 13:38:51.013375 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 682/1309] 10.222.0.79 () {58 vars in 1221 bytes} [Mon Oct 17 13:38:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1561111317 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:38:51.026886 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6f20c2f5-17e6-4c9d-86fb-d955074f4fce tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:51.029722 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6f20c2f5-17e6-4c9d-86fb-d955074f4fce tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 68d9b4cb-0dc2-4809-8715-bdab9be79bd0] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:51.095707 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-74c6572b-762c-4d74-b949-761175d42268 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:51.097893 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-74c6572b-762c-4d74-b949-761175d42268 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:51.098593 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-74c6572b-762c-4d74-b949-761175d42268 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:51.154351 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6f20c2f5-17e6-4c9d-86fb-d955074f4fce tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:51.172142 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6f20c2f5-17e6-4c9d-86fb-d955074f4fce tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/68d9b4cb-0dc2-4809-8715-bdab9be79bd0" status: 200 len: 1223 microversion: 2.1 time: 0.156590 Oct 17 13:38:51.183342 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 683/1310] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:51 2022] GET /compute/v2.1/servers/68d9b4cb-0dc2-4809-8715-bdab9be79bd0 => generated 1223 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:51.187821 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ef39842d-069a-488f-b25b-9f2dd792b5b6 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Calling method '.version_select at 0x7f7cd5555280>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:51.200168 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ef39842d-069a-488f-b25b-9f2dd792b5b6 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:51.200825 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ef39842d-069a-488f-b25b-9f2dd792b5b6 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:51.201309 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ef39842d-069a-488f-b25b-9f2dd792b5b6 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:51.211195 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ef39842d-069a-488f-b25b-9f2dd792b5b6 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] 10.222.0.79 "GET /compute/v2.1/os-migrations" status: 200 len: 1712 microversion: 2.25 time: 0.031042 Oct 17 13:38:51.222477 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 684/1311] 10.222.0.79 () {60 vars in 1184 bytes} [Mon Oct 17 13:38:51 2022] GET /compute/v2.1/os-migrations => generated 1712 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:38:51.228184 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-02969c99-21f4-43c7-980e-739e6ce1f49c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd5582550>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:51.290389 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-02969c99-21f4-43c7-980e-739e6ce1f49c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/c13431d2-5f95-49db-9d9a-05ff951c6069" status: 200 len: 1422 microversion: 2.1 time: 0.066336 Oct 17 13:38:51.291006 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 685/1312] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:38:51 2022] GET /compute/v2.1/images/c13431d2-5f95-49db-9d9a-05ff951c6069 => generated 1422 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:51.304931 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-cf023fd5-513a-4cc2-a6e3-9a21d962603c tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:51.305775 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-cf023fd5-513a-4cc2-a6e3-9a21d962603c tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] [instance: 0ffbef37-e5f8-4de2-a29d-dba6782a3fe4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:51.318159 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cf023fd5-513a-4cc2-a6e3-9a21d962603c tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:51.318670 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cf023fd5-513a-4cc2-a6e3-9a21d962603c tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:51.319332 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cf023fd5-513a-4cc2-a6e3-9a21d962603c tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:51.320138 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cf023fd5-513a-4cc2-a6e3-9a21d962603c tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:51.327575 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cf023fd5-513a-4cc2-a6e3-9a21d962603c tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:51.328063 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cf023fd5-513a-4cc2-a6e3-9a21d962603c tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:51.629334 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-cf023fd5-513a-4cc2-a6e3-9a21d962603c tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lazy-loading 'services' on Instance uuid 0ffbef37-e5f8-4de2-a29d-dba6782a3fe4 {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:38:51.649260 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-cf023fd5-513a-4cc2-a6e3-9a21d962603c tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4" status: 200 len: 2053 microversion: 2.25 time: 0.355081 Oct 17 13:38:51.650271 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 686/1313] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:38:51 2022] GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4 => generated 2053 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:38:51.655348 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-cf9a5dec-06dd-4caf-bbef-33d2c8e6e827 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd55e9700>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:51.731782 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-74c6572b-762c-4d74-b949-761175d42268 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 17634 microversion: 2.1 time: 0.940964 Oct 17 13:38:51.732387 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 628/1314] 10.222.0.79 () {58 vars in 1171 bytes} [Mon Oct 17 13:38:50 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 17634 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:38:51.735993 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-cf9a5dec-06dd-4caf-bbef-33d2c8e6e827 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/c13431d2-5f95-49db-9d9a-05ff951c6069" status: 200 len: 1422 microversion: 2.1 time: 0.084406 Oct 17 13:38:51.737297 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 687/1315] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:38:51 2022] GET /compute/v2.1/images/c13431d2-5f95-49db-9d9a-05ff951c6069 => generated 1422 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:51.759696 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-52973aa8-aabe-4d94-8a0c-4206eaf53c7d tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd5571f70>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:51.781958 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-81c9b341-1254-496b-8b1e-343797b9ec56 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:51.787375 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-81c9b341-1254-496b-8b1e-343797b9ec56 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Searching by: {'deleted': False, 'project_id': '7a45026c8fc2485b81631bb0fd29d718'} {{(pid=127017) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:38:51.796819 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-81c9b341-1254-496b-8b1e-343797b9ec56 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:51.797397 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-81c9b341-1254-496b-8b1e-343797b9ec56 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:51.797885 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-81c9b341-1254-496b-8b1e-343797b9ec56 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:51.798663 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-81c9b341-1254-496b-8b1e-343797b9ec56 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:51.799194 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-81c9b341-1254-496b-8b1e-343797b9ec56 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:51.799717 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-81c9b341-1254-496b-8b1e-343797b9ec56 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:51.851760 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-81c9b341-1254-496b-8b1e-343797b9ec56 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/detail?tenant_id=76eaaef0f6234db690a123c54cea5a6d" status: 200 len: 15 microversion: 2.1 time: 0.073304 Oct 17 13:38:51.852582 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 688/1316] 10.222.0.79 () {58 vars in 1231 bytes} [Mon Oct 17 13:38:51 2022] GET /compute/v2.1/servers/detail?tenant_id=76eaaef0f6234db690a123c54cea5a6d => generated 15 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:38:51.871290 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ecb35ad1-160b-4831-b9e7-22a72bf4993b tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:51.871905 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ecb35ad1-160b-4831-b9e7-22a72bf4993b tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:51.881082 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ecb35ad1-160b-4831-b9e7-22a72bf4993b tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:51.881577 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ecb35ad1-160b-4831-b9e7-22a72bf4993b tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:51.882018 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ecb35ad1-160b-4831-b9e7-22a72bf4993b tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:51.883011 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ecb35ad1-160b-4831-b9e7-22a72bf4993b tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:51.883133 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ecb35ad1-160b-4831-b9e7-22a72bf4993b tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:51.883994 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ecb35ad1-160b-4831-b9e7-22a72bf4993b tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:52.024597 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ecb35ad1-160b-4831-b9e7-22a72bf4993b tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:52.042819 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ecb35ad1-160b-4831-b9e7-22a72bf4993b tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:52.044532 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ecb35ad1-160b-4831-b9e7-22a72bf4993b tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:52.052093 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ecb35ad1-160b-4831-b9e7-22a72bf4993b tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1504 microversion: 2.91 time: 0.195787 Oct 17 13:38:52.065557 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 689/1317] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:38:51 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1504 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:38:52.085644 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6b86ec52-a5e3-4370-870c-d8cafdc5423d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1529865293", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "1fa43ed8-8e4b-47ac-aec2-8368253ad19e"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:38:52.190725 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-6b86ec52-a5e3-4370-870c-d8cafdc5423d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] validate_networks() for [('1fa43ed8-8e4b-47ac-aec2-8368253ad19e', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:38:52.685420 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-52973aa8-aabe-4d94-8a0c-4206eaf53c7d tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "DELETE /compute/v2.1/images/c13431d2-5f95-49db-9d9a-05ff951c6069" status: 204 len: 0 microversion: 2.1 time: 0.929594 Oct 17 13:38:52.689580 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 629/1318] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:51 2022] DELETE /compute/v2.1/images/c13431d2-5f95-49db-9d9a-05ff951c6069 => generated 0 bytes in 931 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:38:52.691356 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0171ebb2-b0f5-4d50-84b7-5a26f430fd83 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:52.708601 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0171ebb2-b0f5-4d50-84b7-5a26f430fd83 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Searching by: {'tenant_id': '76eaaef0f6234db690a123c54cea5a6d', 'deleted': False} {{(pid=127016) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:38:52.715855 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0171ebb2-b0f5-4d50-84b7-5a26f430fd83 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:52.716970 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0171ebb2-b0f5-4d50-84b7-5a26f430fd83 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:52.717440 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0171ebb2-b0f5-4d50-84b7-5a26f430fd83 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:52.718164 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0171ebb2-b0f5-4d50-84b7-5a26f430fd83 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:52.718781 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0171ebb2-b0f5-4d50-84b7-5a26f430fd83 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:52.719437 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0171ebb2-b0f5-4d50-84b7-5a26f430fd83 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:52.818102 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.multi_cell_list [None req-0171ebb2-b0f5-4d50-84b7-5a26f430fd83 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127016) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:38:52.911837 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0171ebb2-b0f5-4d50-84b7-5a26f430fd83 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:52.912334 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0171ebb2-b0f5-4d50-84b7-5a26f430fd83 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:52.913228 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0171ebb2-b0f5-4d50-84b7-5a26f430fd83 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:52.975661 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-6b86ec52-a5e3-4370-870c-d8cafdc5423d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:38:52.976757 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-6b86ec52-a5e3-4370-870c-d8cafdc5423d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:38:52.977531 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-6b86ec52-a5e3-4370-870c-d8cafdc5423d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:38:52.978126 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-6b86ec52-a5e3-4370-870c-d8cafdc5423d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:38:52.978545 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-6b86ec52-a5e3-4370-870c-d8cafdc5423d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:38:52.988002 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6b86ec52-a5e3-4370-870c-d8cafdc5423d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:52.988479 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6b86ec52-a5e3-4370-870c-d8cafdc5423d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:52.988939 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6b86ec52-a5e3-4370-870c-d8cafdc5423d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:52.989655 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6b86ec52-a5e3-4370-870c-d8cafdc5423d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:52.990086 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6b86ec52-a5e3-4370-870c-d8cafdc5423d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:52.990503 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6b86ec52-a5e3-4370-870c-d8cafdc5423d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:53.010962 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-6b86ec52-a5e3-4370-870c-d8cafdc5423d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Getting quotas for project 90d4540094b84255821c0ab95304d22a. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:38:53.016518 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-6b86ec52-a5e3-4370-870c-d8cafdc5423d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Getting quotas for user 5bc3340d39404042af0eca8747874005 and project 90d4540094b84255821c0ab95304d22a. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:38:53.048496 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6b86ec52-a5e3-4370-870c-d8cafdc5423d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:38:53.054132 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6b86ec52-a5e3-4370-870c-d8cafdc5423d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 16213741-2241-4f55-b7ca-20ab551e5596] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:38:53.120916 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6b86ec52-a5e3-4370-870c-d8cafdc5423d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.044752 Oct 17 13:38:53.121740 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 690/1319] 10.222.0.79 () {62 vars in 1188 bytes} [Mon Oct 17 13:38:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1048 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 13:38:53.128134 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-078ae063-dbea-4288-ae0d-2825f0f18260 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:53.128134 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-078ae063-dbea-4288-ae0d-2825f0f18260 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 68d9b4cb-0dc2-4809-8715-bdab9be79bd0] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:53.137030 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0171ebb2-b0f5-4d50-84b7-5a26f430fd83 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=76eaaef0f6234db690a123c54cea5a6d" status: 200 len: 4833 microversion: 2.1 time: 0.449123 Oct 17 13:38:53.139662 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 630/1320] 10.222.0.79 () {58 vars in 1257 bytes} [Mon Oct 17 13:38:52 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=76eaaef0f6234db690a123c54cea5a6d => generated 4833 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:53.144621 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-60116baf-b90a-41ee-b664-1db6954e3a93 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:53.145328 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-60116baf-b90a-41ee-b664-1db6954e3a93 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: ae587603-994d-419d-979a-1b1361144872] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:53.157004 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-60116baf-b90a-41ee-b664-1db6954e3a93 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:53.157901 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-078ae063-dbea-4288-ae0d-2825f0f18260 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:53.162321 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-078ae063-dbea-4288-ae0d-2825f0f18260 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:53.162774 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-078ae063-dbea-4288-ae0d-2825f0f18260 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:53.165448 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-60116baf-b90a-41ee-b664-1db6954e3a93 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:53.172656 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-078ae063-dbea-4288-ae0d-2825f0f18260 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:53.174127 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-078ae063-dbea-4288-ae0d-2825f0f18260 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:53.174127 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-078ae063-dbea-4288-ae0d-2825f0f18260 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:53.182487 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-60116baf-b90a-41ee-b664-1db6954e3a93 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:53.183313 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-60116baf-b90a-41ee-b664-1db6954e3a93 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:53.183802 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-60116baf-b90a-41ee-b664-1db6954e3a93 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:53.184231 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-60116baf-b90a-41ee-b664-1db6954e3a93 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:53.245554 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-60116baf-b90a-41ee-b664-1db6954e3a93 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: ae587603-994d-419d-979a-1b1361144872] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:38:53.299332 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-078ae063-dbea-4288-ae0d-2825f0f18260 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:53.321163 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-078ae063-dbea-4288-ae0d-2825f0f18260 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/68d9b4cb-0dc2-4809-8715-bdab9be79bd0" status: 200 len: 1283 microversion: 2.1 time: 0.198003 Oct 17 13:38:53.322195 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 691/1321] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:53 2022] GET /compute/v2.1/servers/68d9b4cb-0dc2-4809-8715-bdab9be79bd0 => generated 1283 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:53.327364 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2993666c-9879-4641-b70f-8e8ba545daac tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:53.328213 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2993666c-9879-4641-b70f-8e8ba545daac tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:53.347140 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2993666c-9879-4641-b70f-8e8ba545daac tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:53.347842 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2993666c-9879-4641-b70f-8e8ba545daac tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:53.352445 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2993666c-9879-4641-b70f-8e8ba545daac tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:53.353515 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2993666c-9879-4641-b70f-8e8ba545daac tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:53.354113 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2993666c-9879-4641-b70f-8e8ba545daac tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:53.354559 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2993666c-9879-4641-b70f-8e8ba545daac tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:53.374482 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-60116baf-b90a-41ee-b664-1db6954e3a93 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "DELETE /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872" status: 204 len: 0 microversion: 2.1 time: 0.231727 Oct 17 13:38:53.378868 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 631/1322] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:38:53 2022] DELETE /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:38:53.385634 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fe6f257e-642f-4b5c-a6e3-94c8bd588b80 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:53.386295 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-fe6f257e-642f-4b5c-a6e3-94c8bd588b80 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 16213741-2241-4f55-b7ca-20ab551e5596] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:53.576427 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fe6f257e-642f-4b5c-a6e3-94c8bd588b80 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:53.577116 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2993666c-9879-4641-b70f-8e8ba545daac tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:53.585890 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2993666c-9879-4641-b70f-8e8ba545daac tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:53.587552 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fe6f257e-642f-4b5c-a6e3-94c8bd588b80 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:53.589273 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fe6f257e-642f-4b5c-a6e3-94c8bd588b80 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:53.591076 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fe6f257e-642f-4b5c-a6e3-94c8bd588b80 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596" status: 200 len: 1262 microversion: 2.25 time: 0.210817 Oct 17 13:38:53.591769 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 632/1323] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:38:53 2022] GET /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596 => generated 1262 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:38:53.597208 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-270c7084-79b6-40e5-be08-58c0f00e2732 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:53.604404 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-270c7084-79b6-40e5-be08-58c0f00e2732 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Searching by: {'tenant_id': '7a45026c8fc2485b81631bb0fd29d718', 'deleted': False} {{(pid=127016) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:38:53.604852 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2993666c-9879-4641-b70f-8e8ba545daac tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:53.621993 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-270c7084-79b6-40e5-be08-58c0f00e2732 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:53.622691 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-270c7084-79b6-40e5-be08-58c0f00e2732 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:53.623460 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-270c7084-79b6-40e5-be08-58c0f00e2732 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:53.623812 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2993666c-9879-4641-b70f-8e8ba545daac tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1510 microversion: 2.91 time: 0.300626 Oct 17 13:38:53.625838 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-270c7084-79b6-40e5-be08-58c0f00e2732 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:53.626599 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-270c7084-79b6-40e5-be08-58c0f00e2732 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:53.627475 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-270c7084-79b6-40e5-be08-58c0f00e2732 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:53.636724 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 692/1324] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:38:53 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1510 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:38:53.662168 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-04b4e861-0bab-4092-baab-30bb23c7eb40 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1222859383", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "9fce71af-909d-4a58-8606-ba21d3f4b00f"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:38:53.663881 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-270c7084-79b6-40e5-be08-58c0f00e2732 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=7a45026c8fc2485b81631bb0fd29d718" status: 200 len: 15 microversion: 2.1 time: 0.071005 Oct 17 13:38:53.666770 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 633/1325] 10.222.0.79 () {58 vars in 1257 bytes} [Mon Oct 17 13:38:53 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=7a45026c8fc2485b81631bb0fd29d718 => generated 15 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:38:53.690075 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-006c28ae-16a4-4e60-8ca0-fa8819309344 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:53.697087 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-006c28ae-16a4-4e60-8ca0-fa8819309344 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.010956 Oct 17 13:38:53.697610 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 634/1326] 10.222.0.79 () {58 vars in 1189 bytes} [Mon Oct 17 13:38:53 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 17 13:38:53.722467 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e3d84d3e-82b0-4a6e-b84e-853527b6a724 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:38:53.725427 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e3d84d3e-82b0-4a6e-b84e-853527b6a724 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] [instance: ab2b571e-376c-41d3-a778-44bedcaa5467] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:53.735400 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e3d84d3e-82b0-4a6e-b84e-853527b6a724 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:53.736117 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e3d84d3e-82b0-4a6e-b84e-853527b6a724 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:53.736912 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e3d84d3e-82b0-4a6e-b84e-853527b6a724 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:53.737798 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e3d84d3e-82b0-4a6e-b84e-853527b6a724 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:53.738432 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e3d84d3e-82b0-4a6e-b84e-853527b6a724 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:53.739302 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e3d84d3e-82b0-4a6e-b84e-853527b6a724 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:53.752103 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-04b4e861-0bab-4092-baab-30bb23c7eb40 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] validate_networks() for [('9fce71af-909d-4a58-8606-ba21d3f4b00f', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:38:54.136971 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e3d84d3e-82b0-4a6e-b84e-853527b6a724 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467/action" status: 202 len: 0 microversion: 2.1 time: 0.418615 Oct 17 13:38:54.140585 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 635/1327] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:38:53 2022] POST /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467/action => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:38:54.147776 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cb6ad5e3-4751-422f-bf46-8a1678ceec40 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:54.163200 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cb6ad5e3-4751-422f-bf46-8a1678ceec40 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:54.164244 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cb6ad5e3-4751-422f-bf46-8a1678ceec40 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '76eaaef0f6234db690a123c54cea5a6d'} {{(pid=127016) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:38:54.175478 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb6ad5e3-4751-422f-bf46-8a1678ceec40 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:54.176290 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb6ad5e3-4751-422f-bf46-8a1678ceec40 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:54.176908 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb6ad5e3-4751-422f-bf46-8a1678ceec40 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:54.177850 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb6ad5e3-4751-422f-bf46-8a1678ceec40 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:54.178620 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb6ad5e3-4751-422f-bf46-8a1678ceec40 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:54.179280 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb6ad5e3-4751-422f-bf46-8a1678ceec40 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:54.287185 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.multi_cell_list [None req-cb6ad5e3-4751-422f-bf46-8a1678ceec40 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127016) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:38:54.362777 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cb6ad5e3-4751-422f-bf46-8a1678ceec40 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.219346 Oct 17 13:38:54.371153 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 636/1328] 10.222.0.79 () {58 vars in 1150 bytes} [Mon Oct 17 13:38:54 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:38:54.377782 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0de91ec0-8b19-4c74-9f8a-f90bae92987e tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:54.378398 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0de91ec0-8b19-4c74-9f8a-f90bae92987e tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 68d9b4cb-0dc2-4809-8715-bdab9be79bd0] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:54.386010 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0de91ec0-8b19-4c74-9f8a-f90bae92987e tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:54.386178 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0de91ec0-8b19-4c74-9f8a-f90bae92987e tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:54.386606 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0de91ec0-8b19-4c74-9f8a-f90bae92987e tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:54.387665 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0de91ec0-8b19-4c74-9f8a-f90bae92987e tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:54.387788 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0de91ec0-8b19-4c74-9f8a-f90bae92987e tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:54.388183 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0de91ec0-8b19-4c74-9f8a-f90bae92987e tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:54.487729 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0de91ec0-8b19-4c74-9f8a-f90bae92987e tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:54.496996 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0de91ec0-8b19-4c74-9f8a-f90bae92987e tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/68d9b4cb-0dc2-4809-8715-bdab9be79bd0" status: 200 len: 1283 microversion: 2.1 time: 0.124607 Oct 17 13:38:54.500225 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 637/1329] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:54 2022] GET /compute/v2.1/servers/68d9b4cb-0dc2-4809-8715-bdab9be79bd0 => generated 1283 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:54.502423 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-bd74fe10-9f6b-4d7d-bdf0-7320e98cfa78 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:38:54.505020 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-bd74fe10-9f6b-4d7d-bdf0-7320e98cfa78 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] [instance: ab2b571e-376c-41d3-a778-44bedcaa5467] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:54.513278 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bd74fe10-9f6b-4d7d-bdf0-7320e98cfa78 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:54.513796 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bd74fe10-9f6b-4d7d-bdf0-7320e98cfa78 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:54.514221 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bd74fe10-9f6b-4d7d-bdf0-7320e98cfa78 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:54.514947 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bd74fe10-9f6b-4d7d-bdf0-7320e98cfa78 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:54.515428 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bd74fe10-9f6b-4d7d-bdf0-7320e98cfa78 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:54.515809 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bd74fe10-9f6b-4d7d-bdf0-7320e98cfa78 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:54.548599 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-04b4e861-0bab-4092-baab-30bb23c7eb40 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:38:54.549696 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-04b4e861-0bab-4092-baab-30bb23c7eb40 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:38:54.550943 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-04b4e861-0bab-4092-baab-30bb23c7eb40 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:38:54.551753 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-04b4e861-0bab-4092-baab-30bb23c7eb40 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:38:54.552343 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-04b4e861-0bab-4092-baab-30bb23c7eb40 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:38:54.563991 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-04b4e861-0bab-4092-baab-30bb23c7eb40 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:54.564774 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-04b4e861-0bab-4092-baab-30bb23c7eb40 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:54.565446 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-04b4e861-0bab-4092-baab-30bb23c7eb40 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:54.566397 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-04b4e861-0bab-4092-baab-30bb23c7eb40 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:54.567082 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-04b4e861-0bab-4092-baab-30bb23c7eb40 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:54.567754 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-04b4e861-0bab-4092-baab-30bb23c7eb40 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:54.587614 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-04b4e861-0bab-4092-baab-30bb23c7eb40 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Getting quotas for project 461c44cb99ff4958a128679d3e10cd6f. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:38:54.592655 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-04b4e861-0bab-4092-baab-30bb23c7eb40 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Getting quotas for user 386397fd9194430b81ac465f9b3bf92d and project 461c44cb99ff4958a128679d3e10cd6f. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:38:54.606239 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-04b4e861-0bab-4092-baab-30bb23c7eb40 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:38:54.609616 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-04b4e861-0bab-4092-baab-30bb23c7eb40 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: d78e88b4-522f-4e6e-bcaa-dc259d9b8c89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:38:54.658592 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-bd74fe10-9f6b-4d7d-bdf0-7320e98cfa78 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467/action" status: 202 len: 0 microversion: 2.1 time: 0.159598 Oct 17 13:38:54.662150 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 638/1330] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:38:54 2022] POST /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:38:54.680366 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3a7370cb-dadc-4305-a124-a59352ab6e4e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:54.681004 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3a7370cb-dadc-4305-a124-a59352ab6e4e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 16213741-2241-4f55-b7ca-20ab551e5596] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:54.687621 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3a7370cb-dadc-4305-a124-a59352ab6e4e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:54.688111 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3a7370cb-dadc-4305-a124-a59352ab6e4e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:54.688543 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3a7370cb-dadc-4305-a124-a59352ab6e4e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:54.689245 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3a7370cb-dadc-4305-a124-a59352ab6e4e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:54.689694 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3a7370cb-dadc-4305-a124-a59352ab6e4e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:54.690108 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3a7370cb-dadc-4305-a124-a59352ab6e4e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:54.691474 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-04b4e861-0bab-4092-baab-30bb23c7eb40 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.049441 Oct 17 13:38:54.700661 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 693/1331] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:38:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1057 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:38:54.726052 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-850057ec-08b8-4630-a2f9-c80b14797bd0 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:54.727662 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-850057ec-08b8-4630-a2f9-c80b14797bd0 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:54.745160 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:DELETE=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:38:54.758544 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-850057ec-08b8-4630-a2f9-c80b14797bd0 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:54.759764 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-850057ec-08b8-4630-a2f9-c80b14797bd0 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:54.761632 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-850057ec-08b8-4630-a2f9-c80b14797bd0 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:54.762771 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-850057ec-08b8-4630-a2f9-c80b14797bd0 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:54.764249 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-850057ec-08b8-4630-a2f9-c80b14797bd0 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:54.764853 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-850057ec-08b8-4630-a2f9-c80b14797bd0 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:54.784067 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3a7370cb-dadc-4305-a124-a59352ab6e4e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:54.800484 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3a7370cb-dadc-4305-a124-a59352ab6e4e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:54.802478 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3a7370cb-dadc-4305-a124-a59352ab6e4e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:54.805441 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3a7370cb-dadc-4305-a124-a59352ab6e4e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596" status: 200 len: 1266 microversion: 2.25 time: 0.143339 Oct 17 13:38:54.815216 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 639/1332] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:38:54 2022] GET /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596 => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:38:54.821478 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-258cd831-93be-4e42-a989-28a2d43f7ccb tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:54.822643 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-258cd831-93be-4e42-a989-28a2d43f7ccb tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] [instance: ab2b571e-376c-41d3-a778-44bedcaa5467] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:54.835881 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-258cd831-93be-4e42-a989-28a2d43f7ccb tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:54.836919 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-258cd831-93be-4e42-a989-28a2d43f7ccb tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:54.837852 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-258cd831-93be-4e42-a989-28a2d43f7ccb tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:54.863897 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-258cd831-93be-4e42-a989-28a2d43f7ccb tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:54.869511 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-258cd831-93be-4e42-a989-28a2d43f7ccb tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:54.869960 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-258cd831-93be-4e42-a989-28a2d43f7ccb tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:55.693708 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-850057ec-08b8-4630-a2f9-c80b14797bd0 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:55.710650 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-850057ec-08b8-4630-a2f9-c80b14797bd0 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:55.717340 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-850057ec-08b8-4630-a2f9-c80b14797bd0 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:55.730705 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-850057ec-08b8-4630-a2f9-c80b14797bd0 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1510 microversion: 2.91 time: 1.034645 Oct 17 13:38:55.736199 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 694/1333] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:38:54 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1510 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:38:55.758630 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d19d8e73-3d89-4e46-aecf-0265e4184e61 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:55.759466 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d19d8e73-3d89-4e46-aecf-0265e4184e61 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: d78e88b4-522f-4e6e-bcaa-dc259d9b8c89] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:55.769259 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d19d8e73-3d89-4e46-aecf-0265e4184e61 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:55.775126 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d19d8e73-3d89-4e46-aecf-0265e4184e61 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:55.776000 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d19d8e73-3d89-4e46-aecf-0265e4184e61 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:55.776958 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d19d8e73-3d89-4e46-aecf-0265e4184e61 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:55.777729 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d19d8e73-3d89-4e46-aecf-0265e4184e61 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:55.780710 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d19d8e73-3d89-4e46-aecf-0265e4184e61 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:56.064962 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d19d8e73-3d89-4e46-aecf-0265e4184e61 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:56.067571 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=100 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:38:56.076199 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d19d8e73-3d89-4e46-aecf-0265e4184e61 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/d78e88b4-522f-4e6e-bcaa-dc259d9b8c89" status: 200 len: 1212 microversion: 2.1 time: 0.338536 Oct 17 13:38:56.076798 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 695/1334] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:55 2022] GET /compute/v2.1/servers/d78e88b4-522f-4e6e-bcaa-dc259d9b8c89 => generated 1212 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:56.121397 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-dc9ac8de-57f7-46c8-b00b-534c2b8ab94c req-7b47dc82-a01c-4d39-881e-edfa234da55e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae587603-994d-419d-979a-1b1361144872", "name": "network-vif-unplugged", "status": "completed", "tag": "e547063b-1442-46ea-a450-6fddc21a973b"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:38:56.130152 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-258cd831-93be-4e42-a989-28a2d43f7ccb tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467" status: 200 len: 1617 microversion: 2.1 time: 1.321449 Oct 17 13:38:56.130671 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 640/1335] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:54 2022] GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467 => generated 1617 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:56.148719 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-75abd40d-16bb-4e0d-9ffa-f46478c47711 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:56.154764 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-dc9ac8de-57f7-46c8-b00b-534c2b8ab94c req-7b47dc82-a01c-4d39-881e-edfa234da55e service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:56.155658 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-dc9ac8de-57f7-46c8-b00b-534c2b8ab94c req-7b47dc82-a01c-4d39-881e-edfa234da55e service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:56.156597 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-dc9ac8de-57f7-46c8-b00b-534c2b8ab94c req-7b47dc82-a01c-4d39-881e-edfa234da55e service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:56.165596 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-75abd40d-16bb-4e0d-9ffa-f46478c47711 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 68d9b4cb-0dc2-4809-8715-bdab9be79bd0] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:56.190354 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-dc9ac8de-57f7-46c8-b00b-534c2b8ab94c req-7b47dc82-a01c-4d39-881e-edfa234da55e service nova] Creating event network-vif-unplugged:e547063b-1442-46ea-a450-6fddc21a973b for instance ae587603-994d-419d-979a-1b1361144872 on n-h1-854247-14 Oct 17 13:38:56.197226 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-dc9ac8de-57f7-46c8-b00b-534c2b8ab94c req-7b47dc82-a01c-4d39-881e-edfa234da55e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.118862 Oct 17 13:38:56.198130 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-75abd40d-16bb-4e0d-9ffa-f46478c47711 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:56.201937 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-75abd40d-16bb-4e0d-9ffa-f46478c47711 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:56.203153 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-75abd40d-16bb-4e0d-9ffa-f46478c47711 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:56.203983 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 696/1336] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:38:56.204261 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-75abd40d-16bb-4e0d-9ffa-f46478c47711 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:56.204720 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-75abd40d-16bb-4e0d-9ffa-f46478c47711 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:56.205142 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-75abd40d-16bb-4e0d-9ffa-f46478c47711 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:56.233377 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1912e744-4558-4b78-98bb-9ec403e5d3fd tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:56.234581 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1912e744-4558-4b78-98bb-9ec403e5d3fd tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 16213741-2241-4f55-b7ca-20ab551e5596] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:56.241805 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1912e744-4558-4b78-98bb-9ec403e5d3fd tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:56.243758 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1912e744-4558-4b78-98bb-9ec403e5d3fd tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:56.244924 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1912e744-4558-4b78-98bb-9ec403e5d3fd tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:56.247091 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1912e744-4558-4b78-98bb-9ec403e5d3fd tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:56.247821 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1912e744-4558-4b78-98bb-9ec403e5d3fd tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:56.248531 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1912e744-4558-4b78-98bb-9ec403e5d3fd tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:56.281006 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:38:56.366878 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1912e744-4558-4b78-98bb-9ec403e5d3fd tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:56.386599 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-75abd40d-16bb-4e0d-9ffa-f46478c47711 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:56.386846 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1912e744-4558-4b78-98bb-9ec403e5d3fd tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:56.388224 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1912e744-4558-4b78-98bb-9ec403e5d3fd tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:56.393878 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1912e744-4558-4b78-98bb-9ec403e5d3fd tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596" status: 200 len: 1314 microversion: 2.25 time: 0.187605 Oct 17 13:38:56.400530 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-75abd40d-16bb-4e0d-9ffa-f46478c47711 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/68d9b4cb-0dc2-4809-8715-bdab9be79bd0" status: 200 len: 1281 microversion: 2.1 time: 0.263931 Oct 17 13:38:56.400716 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 697/1337] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:38:56 2022] GET /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:38:56.401774 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 641/1338] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:56 2022] GET /compute/v2.1/servers/68d9b4cb-0dc2-4809-8715-bdab9be79bd0 => generated 1281 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:56.409313 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e809de70-954d-45c2-86fd-18717a1df8cd tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:56.410164 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-c4ee6c0d-f856-4ef2-a473-3e8835d7b786 req-aebb9646-1448-4997-9b31-c5a55c633bcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae587603-994d-419d-979a-1b1361144872", "name": "network-vif-deleted", "tag": "e547063b-1442-46ea-a450-6fddc21a973b"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:38:56.411418 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e809de70-954d-45c2-86fd-18717a1df8cd tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] [instance: ab2b571e-376c-41d3-a778-44bedcaa5467] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:56.421696 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e809de70-954d-45c2-86fd-18717a1df8cd tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:56.424883 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e809de70-954d-45c2-86fd-18717a1df8cd tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:56.428628 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e809de70-954d-45c2-86fd-18717a1df8cd tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:56.429588 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e809de70-954d-45c2-86fd-18717a1df8cd tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:56.430395 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e809de70-954d-45c2-86fd-18717a1df8cd tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:56.431769 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e809de70-954d-45c2-86fd-18717a1df8cd tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:56.443577 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-c4ee6c0d-f856-4ef2-a473-3e8835d7b786 req-aebb9646-1448-4997-9b31-c5a55c633bcc service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:56.444406 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-c4ee6c0d-f856-4ef2-a473-3e8835d7b786 req-aebb9646-1448-4997-9b31-c5a55c633bcc service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:56.445153 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-c4ee6c0d-f856-4ef2-a473-3e8835d7b786 req-aebb9646-1448-4997-9b31-c5a55c633bcc service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:56.490342 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-c4ee6c0d-f856-4ef2-a473-3e8835d7b786 req-aebb9646-1448-4997-9b31-c5a55c633bcc service nova] Creating event network-vif-deleted:e547063b-1442-46ea-a450-6fddc21a973b for instance ae587603-994d-419d-979a-1b1361144872 on n-h1-854247-14 Oct 17 13:38:56.499905 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-c4ee6c0d-f856-4ef2-a473-3e8835d7b786 req-aebb9646-1448-4997-9b31-c5a55c633bcc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095637 Oct 17 13:38:56.500901 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 698/1339] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:38:56.768775 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f63cd84f-13db-4bee-aabd-09e9c61a4646 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:56.770403 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f63cd84f-13db-4bee-aabd-09e9c61a4646 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:56.783349 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f63cd84f-13db-4bee-aabd-09e9c61a4646 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:56.783929 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f63cd84f-13db-4bee-aabd-09e9c61a4646 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:56.784444 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f63cd84f-13db-4bee-aabd-09e9c61a4646 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:56.785225 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f63cd84f-13db-4bee-aabd-09e9c61a4646 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:56.791555 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f63cd84f-13db-4bee-aabd-09e9c61a4646 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:56.792301 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f63cd84f-13db-4bee-aabd-09e9c61a4646 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:57.003286 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f63cd84f-13db-4bee-aabd-09e9c61a4646 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:57.013783 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f63cd84f-13db-4bee-aabd-09e9c61a4646 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:57.028977 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f63cd84f-13db-4bee-aabd-09e9c61a4646 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:57.056568 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f63cd84f-13db-4bee-aabd-09e9c61a4646 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1531 microversion: 2.91 time: 0.292300 Oct 17 13:38:57.059493 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 699/1340] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:38:56 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1531 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:38:57.112667 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e809de70-954d-45c2-86fd-18717a1df8cd tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467" status: 200 len: 1617 microversion: 2.1 time: 0.709676 Oct 17 13:38:57.120246 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 642/1341] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:56 2022] GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467 => generated 1617 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:57.125574 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-80c675af-8f65-46a7-aa17-20db674cb8f3 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:57.126497 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-80c675af-8f65-46a7-aa17-20db674cb8f3 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: d78e88b4-522f-4e6e-bcaa-dc259d9b8c89] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:57.145736 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-80c675af-8f65-46a7-aa17-20db674cb8f3 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:57.147034 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-80c675af-8f65-46a7-aa17-20db674cb8f3 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:57.147925 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-80c675af-8f65-46a7-aa17-20db674cb8f3 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:57.148975 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-80c675af-8f65-46a7-aa17-20db674cb8f3 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:57.149767 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-80c675af-8f65-46a7-aa17-20db674cb8f3 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:57.150955 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-80c675af-8f65-46a7-aa17-20db674cb8f3 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:57.229317 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-48511379-9324-491d-9785-e3c8e51aa6da tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:57.231246 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-48511379-9324-491d-9785-e3c8e51aa6da tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:57.239246 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48511379-9324-491d-9785-e3c8e51aa6da tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:57.240239 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48511379-9324-491d-9785-e3c8e51aa6da tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:57.241314 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48511379-9324-491d-9785-e3c8e51aa6da tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:57.242697 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48511379-9324-491d-9785-e3c8e51aa6da tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:57.243588 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48511379-9324-491d-9785-e3c8e51aa6da tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:57.244764 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48511379-9324-491d-9785-e3c8e51aa6da tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:57.368809 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-80c675af-8f65-46a7-aa17-20db674cb8f3 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:57.386933 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-80c675af-8f65-46a7-aa17-20db674cb8f3 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/d78e88b4-522f-4e6e-bcaa-dc259d9b8c89" status: 200 len: 1260 microversion: 2.1 time: 0.265138 Oct 17 13:38:57.389120 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 643/1342] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:57 2022] GET /compute/v2.1/servers/d78e88b4-522f-4e6e-bcaa-dc259d9b8c89 => generated 1260 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:57.402836 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-97186240-fd95-4090-ae92-4afa3f6ef739 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:57.443072 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-97186240-fd95-4090-ae92-4afa3f6ef739 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Searching by: {'host': 'n-h2-854247-14', 'deleted': False} {{(pid=127016) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:38:57.463821 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-97186240-fd95-4090-ae92-4afa3f6ef739 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:57.466019 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-97186240-fd95-4090-ae92-4afa3f6ef739 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:57.466657 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-97186240-fd95-4090-ae92-4afa3f6ef739 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:57.468755 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-97186240-fd95-4090-ae92-4afa3f6ef739 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:57.469287 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-97186240-fd95-4090-ae92-4afa3f6ef739 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:57.470800 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-97186240-fd95-4090-ae92-4afa3f6ef739 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:57.763986 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.multi_cell_list [None req-97186240-fd95-4090-ae92-4afa3f6ef739 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Listed batch of 8 results from cell out of 1000 limit. Returned 8 total so far. {{(pid=127016) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:38:57.792155 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-48511379-9324-491d-9785-e3c8e51aa6da tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] Lazy-loading 'services' on Instance uuid 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:38:57.847132 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-48511379-9324-491d-9785-e3c8e51aa6da tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1938 microversion: 2.91 time: 0.761146 Oct 17 13:38:57.859752 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 700/1343] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:38:57 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1938 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:38:57.883527 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-870eeadc-d9c5-4d14-a0a8-fd70754b8b1a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:57.887655 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-870eeadc-d9c5-4d14-a0a8-fd70754b8b1a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 16213741-2241-4f55-b7ca-20ab551e5596] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:57.902603 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-870eeadc-d9c5-4d14-a0a8-fd70754b8b1a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:57.904642 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-870eeadc-d9c5-4d14-a0a8-fd70754b8b1a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:57.905415 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-870eeadc-d9c5-4d14-a0a8-fd70754b8b1a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:57.906497 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-97186240-fd95-4090-ae92-4afa3f6ef739 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] 10.222.0.79 "GET /compute/v2.1/servers?host=n-h2-854247-14&all_tenants=1" status: 200 len: 2623 microversion: 2.1 time: 0.513880 Oct 17 13:38:57.908586 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 644/1344] 10.222.0.79 () {58 vars in 1192 bytes} [Mon Oct 17 13:38:57 2022] GET /compute/v2.1/servers?host=n-h2-854247-14&all_tenants=1 => generated 2623 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:57.908910 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-870eeadc-d9c5-4d14-a0a8-fd70754b8b1a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:57.909449 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-870eeadc-d9c5-4d14-a0a8-fd70754b8b1a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:57.916174 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-870eeadc-d9c5-4d14-a0a8-fd70754b8b1a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:57.926253 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b1a9f400-22a7-431e-9799-647e6f93b323 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:57.927018 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b1a9f400-22a7-431e-9799-647e6f93b323 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 68d9b4cb-0dc2-4809-8715-bdab9be79bd0] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:57.934837 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b1a9f400-22a7-431e-9799-647e6f93b323 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:57.935447 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b1a9f400-22a7-431e-9799-647e6f93b323 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:57.935942 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b1a9f400-22a7-431e-9799-647e6f93b323 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:57.937072 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b1a9f400-22a7-431e-9799-647e6f93b323 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:57.937649 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b1a9f400-22a7-431e-9799-647e6f93b323 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:57.938139 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b1a9f400-22a7-431e-9799-647e6f93b323 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:58.202877 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-870eeadc-d9c5-4d14-a0a8-fd70754b8b1a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:58.217181 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-870eeadc-d9c5-4d14-a0a8-fd70754b8b1a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:58.221539 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-870eeadc-d9c5-4d14-a0a8-fd70754b8b1a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:58.223637 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-870eeadc-d9c5-4d14-a0a8-fd70754b8b1a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596" status: 200 len: 1320 microversion: 2.25 time: 0.361843 Oct 17 13:38:58.241924 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 701/1345] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:38:57 2022] GET /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596 => generated 1320 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:38:58.250976 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-04c7402d-d64e-4433-a576-3e305b9bc837 tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:58.251927 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-04c7402d-d64e-4433-a576-3e305b9bc837 tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:58.258987 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-04c7402d-d64e-4433-a576-3e305b9bc837 tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:58.259503 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-04c7402d-d64e-4433-a576-3e305b9bc837 tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:58.259934 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-04c7402d-d64e-4433-a576-3e305b9bc837 tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:58.260639 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-04c7402d-d64e-4433-a576-3e305b9bc837 tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:58.261084 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-04c7402d-d64e-4433-a576-3e305b9bc837 tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:58.261663 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-04c7402d-d64e-4433-a576-3e305b9bc837 tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:58.457290 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-04c7402d-d64e-4433-a576-3e305b9bc837 tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] Lazy-loading 'services' on Instance uuid 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:38:58.495254 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-04c7402d-d64e-4433-a576-3e305b9bc837 tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1938 microversion: 2.91 time: 0.251791 Oct 17 13:38:58.506548 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 702/1346] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:38:58 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1938 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:38:58.515552 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c514dbfc-c949-4fa4-a6bf-2849fa60f846 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:58.521818 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c514dbfc-c949-4fa4-a6bf-2849fa60f846 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=127017) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:38:58.539278 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c514dbfc-c949-4fa4-a6bf-2849fa60f846 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:58.539827 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c514dbfc-c949-4fa4-a6bf-2849fa60f846 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:58.540476 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c514dbfc-c949-4fa4-a6bf-2849fa60f846 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:58.541363 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c514dbfc-c949-4fa4-a6bf-2849fa60f846 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:58.542013 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c514dbfc-c949-4fa4-a6bf-2849fa60f846 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:58.542616 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c514dbfc-c949-4fa4-a6bf-2849fa60f846 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:58.559879 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b1a9f400-22a7-431e-9799-647e6f93b323 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:58.572266 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b1a9f400-22a7-431e-9799-647e6f93b323 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/68d9b4cb-0dc2-4809-8715-bdab9be79bd0" status: 200 len: 1323 microversion: 2.1 time: 0.650262 Oct 17 13:38:58.588792 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 645/1347] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:57 2022] GET /compute/v2.1/servers/68d9b4cb-0dc2-4809-8715-bdab9be79bd0 => generated 1323 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:58.608353 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c57685a1-c099-4439-9ee8-b466d1523b19 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:58.610727 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c57685a1-c099-4439-9ee8-b466d1523b19 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: d78e88b4-522f-4e6e-bcaa-dc259d9b8c89] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:58.628539 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c57685a1-c099-4439-9ee8-b466d1523b19 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:58.629445 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c57685a1-c099-4439-9ee8-b466d1523b19 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:58.631242 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c57685a1-c099-4439-9ee8-b466d1523b19 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:58.634638 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c57685a1-c099-4439-9ee8-b466d1523b19 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:58.638305 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c57685a1-c099-4439-9ee8-b466d1523b19 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:58.638953 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c57685a1-c099-4439-9ee8-b466d1523b19 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:58.669495 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c514dbfc-c949-4fa4-a6bf-2849fa60f846 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] 10.222.0.79 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.161791 Oct 17 13:38:58.670395 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 703/1348] 10.222.0.79 () {58 vars in 1196 bytes} [Mon Oct 17 13:38:58 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:38:58.696911 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-548adb66-02b0-4c24-b80a-437034a28e03 tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:58.703293 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-548adb66-02b0-4c24-b80a-437034a28e03 tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:58.706984 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-548adb66-02b0-4c24-b80a-437034a28e03 tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:58.711479 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-548adb66-02b0-4c24-b80a-437034a28e03 tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:58.714542 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-548adb66-02b0-4c24-b80a-437034a28e03 tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:58.717807 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-548adb66-02b0-4c24-b80a-437034a28e03 tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:58.718303 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-548adb66-02b0-4c24-b80a-437034a28e03 tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:58.764459 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-548adb66-02b0-4c24-b80a-437034a28e03 tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 500 microversion: 2.91 time: 0.077371 Oct 17 13:38:58.772218 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 704/1349] 10.222.0.79 () {60 vars in 1217 bytes} [Mon Oct 17 13:38:58 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 500 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:38:58.774737 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3880ff87-3f98-445f-bfca-9754ac6914dc tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:38:58.777514 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3880ff87-3f98-445f-bfca-9754ac6914dc tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] [instance: ab2b571e-376c-41d3-a778-44bedcaa5467] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:58.784566 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3880ff87-3f98-445f-bfca-9754ac6914dc tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:58.785141 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3880ff87-3f98-445f-bfca-9754ac6914dc tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:58.785645 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3880ff87-3f98-445f-bfca-9754ac6914dc tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:58.786421 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3880ff87-3f98-445f-bfca-9754ac6914dc tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:58.786945 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3880ff87-3f98-445f-bfca-9754ac6914dc tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:58.787457 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3880ff87-3f98-445f-bfca-9754ac6914dc tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:58.806458 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c57685a1-c099-4439-9ee8-b466d1523b19 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:58.818842 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c57685a1-c099-4439-9ee8-b466d1523b19 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/d78e88b4-522f-4e6e-bcaa-dc259d9b8c89" status: 200 len: 1266 microversion: 2.1 time: 0.226061 Oct 17 13:38:58.825231 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 646/1350] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:58 2022] GET /compute/v2.1/servers/d78e88b4-522f-4e6e-bcaa-dc259d9b8c89 => generated 1266 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:58.830626 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-62a09529-1946-4077-996d-a24fe65dc8fe tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:38:58.837948 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-62a09529-1946-4077-996d-a24fe65dc8fe tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:58.869504 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-62a09529-1946-4077-996d-a24fe65dc8fe tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:58.870004 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-62a09529-1946-4077-996d-a24fe65dc8fe tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:58.870439 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-62a09529-1946-4077-996d-a24fe65dc8fe tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:58.871159 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-62a09529-1946-4077-996d-a24fe65dc8fe tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:58.871629 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-62a09529-1946-4077-996d-a24fe65dc8fe tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:58.877298 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-62a09529-1946-4077-996d-a24fe65dc8fe tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:58.946666 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3880ff87-3f98-445f-bfca-9754ac6914dc tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467/action" status: 202 len: 0 microversion: 2.1 time: 0.179675 Oct 17 13:38:58.952214 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 705/1351] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:38:58 2022] POST /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:38:58.965773 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a216a434-42f7-4b3d-9c5e-8b3c3a87c9db tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:38:58.969377 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-62a09529-1946-4077-996d-a24fe65dc8fe tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lazy-loading 'flavor' on Instance uuid 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:38:58.971098 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a216a434-42f7-4b3d-9c5e-8b3c3a87c9db tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: ab2b571e-376c-41d3-a778-44bedcaa5467] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:58.986120 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a216a434-42f7-4b3d-9c5e-8b3c3a87c9db tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:58.986912 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a216a434-42f7-4b3d-9c5e-8b3c3a87c9db tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:58.988674 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a216a434-42f7-4b3d-9c5e-8b3c3a87c9db tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:58.989566 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a216a434-42f7-4b3d-9c5e-8b3c3a87c9db tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:58.996996 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a216a434-42f7-4b3d-9c5e-8b3c3a87c9db tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:58.996996 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a216a434-42f7-4b3d-9c5e-8b3c3a87c9db tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:59.196758 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-a216a434-42f7-4b3d-9c5e-8b3c3a87c9db tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:38:59.197191 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-a216a434-42f7-4b3d-9c5e-8b3c3a87c9db tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:38:59.199888 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-a216a434-42f7-4b3d-9c5e-8b3c3a87c9db tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:38:59.200322 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-a216a434-42f7-4b3d-9c5e-8b3c3a87c9db tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:38:59.200786 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-a216a434-42f7-4b3d-9c5e-8b3c3a87c9db tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:38:59.341103 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a216a434-42f7-4b3d-9c5e-8b3c3a87c9db tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: ab2b571e-376c-41d3-a778-44bedcaa5467] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:59.356334 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a216a434-42f7-4b3d-9c5e-8b3c3a87c9db tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:59.358798 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a216a434-42f7-4b3d-9c5e-8b3c3a87c9db tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:59.360033 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a216a434-42f7-4b3d-9c5e-8b3c3a87c9db tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:59.362830 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a216a434-42f7-4b3d-9c5e-8b3c3a87c9db tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:59.363400 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a216a434-42f7-4b3d-9c5e-8b3c3a87c9db tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:59.364582 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a216a434-42f7-4b3d-9c5e-8b3c3a87c9db tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:59.449713 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a216a434-42f7-4b3d-9c5e-8b3c3a87c9db tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "POST /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467/action" status: 202 len: 1068 microversion: 2.1 time: 0.494864 Oct 17 13:38:59.479143 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 706/1352] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:38:58 2022] POST /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467/action => generated 1068 bytes in 526 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 17 13:38:59.492543 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0450a7de-69f5-4c3a-89d3-8b8f70c319b2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:59.494125 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0450a7de-69f5-4c3a-89d3-8b8f70c319b2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 16213741-2241-4f55-b7ca-20ab551e5596] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:59.520681 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0450a7de-69f5-4c3a-89d3-8b8f70c319b2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:59.521908 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0450a7de-69f5-4c3a-89d3-8b8f70c319b2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:59.524107 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0450a7de-69f5-4c3a-89d3-8b8f70c319b2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:59.526143 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0450a7de-69f5-4c3a-89d3-8b8f70c319b2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:59.526655 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0450a7de-69f5-4c3a-89d3-8b8f70c319b2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:59.527656 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0450a7de-69f5-4c3a-89d3-8b8f70c319b2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:59.631619 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-62a09529-1946-4077-996d-a24fe65dc8fe tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "POST /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57/action" status: 202 len: 0 microversion: 2.91 time: 0.804738 Oct 17 13:38:59.636555 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 647/1353] 10.222.0.79 () {62 vars in 1319 bytes} [Mon Oct 17 13:38:58 2022] POST /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57/action => generated 0 bytes in 810 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:38:59.664198 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-aa3e6928-9883-4efc-b383-c0fe923f6597 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:59.665457 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-aa3e6928-9883-4efc-b383-c0fe923f6597 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: ab2b571e-376c-41d3-a778-44bedcaa5467] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:59.684132 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aa3e6928-9883-4efc-b383-c0fe923f6597 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:59.685117 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aa3e6928-9883-4efc-b383-c0fe923f6597 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:59.685850 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aa3e6928-9883-4efc-b383-c0fe923f6597 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:59.687206 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aa3e6928-9883-4efc-b383-c0fe923f6597 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:59.687882 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aa3e6928-9883-4efc-b383-c0fe923f6597 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:59.724329 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aa3e6928-9883-4efc-b383-c0fe923f6597 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:00.153101 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0450a7de-69f5-4c3a-89d3-8b8f70c319b2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:00.165478 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0450a7de-69f5-4c3a-89d3-8b8f70c319b2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:00.167343 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0450a7de-69f5-4c3a-89d3-8b8f70c319b2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:00.168940 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0450a7de-69f5-4c3a-89d3-8b8f70c319b2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596" status: 200 len: 1362 microversion: 2.25 time: 0.687547 Oct 17 13:39:00.184477 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 707/1354] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:38:59 2022] GET /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596 => generated 1362 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:39:00.188711 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b344a0ee-ac24-43f6-a841-39727787934a tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:00.189584 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b344a0ee-ac24-43f6-a841-39727787934a tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 68d9b4cb-0dc2-4809-8715-bdab9be79bd0] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:00.199994 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b344a0ee-ac24-43f6-a841-39727787934a tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:00.200486 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b344a0ee-ac24-43f6-a841-39727787934a tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:00.201862 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b344a0ee-ac24-43f6-a841-39727787934a tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:00.203008 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b344a0ee-ac24-43f6-a841-39727787934a tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:00.204100 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b344a0ee-ac24-43f6-a841-39727787934a tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:00.205447 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b344a0ee-ac24-43f6-a841-39727787934a tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:00.355895 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-aa3e6928-9883-4efc-b383-c0fe923f6597 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:00.365469 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-aa3e6928-9883-4efc-b383-c0fe923f6597 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467" status: 200 len: 1472 microversion: 2.1 time: 0.721170 Oct 17 13:39:00.366732 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 648/1355] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:59 2022] GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467 => generated 1472 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:00.372502 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-bf9e4d5d-bbb1-4fd7-aecf-209d329822fc tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:00.373506 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-bf9e4d5d-bbb1-4fd7-aecf-209d329822fc tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:00.380406 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bf9e4d5d-bbb1-4fd7-aecf-209d329822fc tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:00.381231 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bf9e4d5d-bbb1-4fd7-aecf-209d329822fc tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:00.381830 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bf9e4d5d-bbb1-4fd7-aecf-209d329822fc tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:00.382700 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bf9e4d5d-bbb1-4fd7-aecf-209d329822fc tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:00.384448 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bf9e4d5d-bbb1-4fd7-aecf-209d329822fc tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:00.385640 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bf9e4d5d-bbb1-4fd7-aecf-209d329822fc tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:00.585361 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-bf9e4d5d-bbb1-4fd7-aecf-209d329822fc tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:00.596548 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-bf9e4d5d-bbb1-4fd7-aecf-209d329822fc tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:00.598242 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-bf9e4d5d-bbb1-4fd7-aecf-209d329822fc tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:00.604054 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-bf9e4d5d-bbb1-4fd7-aecf-209d329822fc tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1537 microversion: 2.91 time: 0.236055 Oct 17 13:39:00.604635 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 649/1356] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:39:00 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1537 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:39:00.616171 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0ac8d3af-f2ad-4316-8506-4faccd3918d7 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:00.618133 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0ac8d3af-f2ad-4316-8506-4faccd3918d7 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: d78e88b4-522f-4e6e-bcaa-dc259d9b8c89] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:00.626027 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0ac8d3af-f2ad-4316-8506-4faccd3918d7 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:00.627973 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0ac8d3af-f2ad-4316-8506-4faccd3918d7 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:00.627973 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0ac8d3af-f2ad-4316-8506-4faccd3918d7 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:00.632179 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0ac8d3af-f2ad-4316-8506-4faccd3918d7 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:00.632779 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0ac8d3af-f2ad-4316-8506-4faccd3918d7 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:00.633173 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0ac8d3af-f2ad-4316-8506-4faccd3918d7 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:00.759336 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b344a0ee-ac24-43f6-a841-39727787934a tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:00.770341 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b344a0ee-ac24-43f6-a841-39727787934a tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/68d9b4cb-0dc2-4809-8715-bdab9be79bd0" status: 200 len: 1323 microversion: 2.1 time: 0.595562 Oct 17 13:39:00.770943 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 708/1357] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:00 2022] GET /compute/v2.1/servers/68d9b4cb-0dc2-4809-8715-bdab9be79bd0 => generated 1323 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:00.778330 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-067a04e5-f4e1-4cd8-89f1-1d223e430a33 req-becbc45a-a08a-4c12-ae21-3e2382a7986d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68d9b4cb-0dc2-4809-8715-bdab9be79bd0", "tag": "5d084305-dc3f-46d2-8407-4164b5cf23b7"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:00.789016 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-067a04e5-f4e1-4cd8-89f1-1d223e430a33 req-becbc45a-a08a-4c12-ae21-3e2382a7986d service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:00.789526 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-067a04e5-f4e1-4cd8-89f1-1d223e430a33 req-becbc45a-a08a-4c12-ae21-3e2382a7986d service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:00.789991 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-067a04e5-f4e1-4cd8-89f1-1d223e430a33 req-becbc45a-a08a-4c12-ae21-3e2382a7986d service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:00.806075 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-067a04e5-f4e1-4cd8-89f1-1d223e430a33 req-becbc45a-a08a-4c12-ae21-3e2382a7986d service nova] Creating event network-changed:5d084305-dc3f-46d2-8407-4164b5cf23b7 for instance 68d9b4cb-0dc2-4809-8715-bdab9be79bd0 on n-h1-854247-14 Oct 17 13:39:00.811213 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-067a04e5-f4e1-4cd8-89f1-1d223e430a33 req-becbc45a-a08a-4c12-ae21-3e2382a7986d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038754 Oct 17 13:39:00.812693 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 709/1358] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:39:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:39:00.817964 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-6597092e-d485-4c6f-be20-6a374a1282fe req-bc8a672e-110a-4474-a79a-411930010e1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16213741-2241-4f55-b7ca-20ab551e5596", "tag": "216dd503-7afa-42cd-aafc-f62df426ee70"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:00.839108 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-6597092e-d485-4c6f-be20-6a374a1282fe req-bc8a672e-110a-4474-a79a-411930010e1b service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:00.839608 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-6597092e-d485-4c6f-be20-6a374a1282fe req-bc8a672e-110a-4474-a79a-411930010e1b service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:00.840033 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-6597092e-d485-4c6f-be20-6a374a1282fe req-bc8a672e-110a-4474-a79a-411930010e1b service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:00.856757 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-6597092e-d485-4c6f-be20-6a374a1282fe req-bc8a672e-110a-4474-a79a-411930010e1b service nova] Creating event network-changed:216dd503-7afa-42cd-aafc-f62df426ee70 for instance 16213741-2241-4f55-b7ca-20ab551e5596 on n-h1-854247-14 Oct 17 13:39:00.862990 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-6597092e-d485-4c6f-be20-6a374a1282fe req-bc8a672e-110a-4474-a79a-411930010e1b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048729 Oct 17 13:39:00.867992 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 710/1359] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:39:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:39:00.903053 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-048ae306-588e-40ea-987b-8d863f1e6063 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-205725933", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "0f6c7a6d-566d-4e1c-9b41-17525dda1910"}], "block_device_mapping_v2": [{"uuid": "fcbace29-936c-4378-894c-42f9ce034294", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:00.974032 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-048ae306-588e-40ea-987b-8d863f1e6063 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] validate_networks() for [('0f6c7a6d-566d-4e1c-9b41-17525dda1910', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:39:01.142834 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0ac8d3af-f2ad-4316-8506-4faccd3918d7 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:01.155523 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0ac8d3af-f2ad-4316-8506-4faccd3918d7 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/d78e88b4-522f-4e6e-bcaa-dc259d9b8c89" status: 200 len: 1308 microversion: 2.1 time: 0.549520 Oct 17 13:39:01.159292 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 650/1360] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:00 2022] GET /compute/v2.1/servers/d78e88b4-522f-4e6e-bcaa-dc259d9b8c89 => generated 1308 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:01.195117 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-85e38321-b422-464b-a86b-a17be48044e2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:01.196507 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-85e38321-b422-464b-a86b-a17be48044e2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 16213741-2241-4f55-b7ca-20ab551e5596] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:01.204617 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-85e38321-b422-464b-a86b-a17be48044e2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:01.205549 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-85e38321-b422-464b-a86b-a17be48044e2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:01.210246 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-85e38321-b422-464b-a86b-a17be48044e2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:01.211261 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-85e38321-b422-464b-a86b-a17be48044e2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:01.211964 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-85e38321-b422-464b-a86b-a17be48044e2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:01.212494 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-85e38321-b422-464b-a86b-a17be48044e2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:01.943870 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-85e38321-b422-464b-a86b-a17be48044e2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:01.960415 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-85e38321-b422-464b-a86b-a17be48044e2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:01.962235 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-85e38321-b422-464b-a86b-a17be48044e2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:01.963606 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-85e38321-b422-464b-a86b-a17be48044e2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596" status: 200 len: 1362 microversion: 2.25 time: 0.772731 Oct 17 13:39:01.979565 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 651/1361] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:39:01 2022] GET /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596 => generated 1362 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:39:01.986190 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-adcb041e-69f5-46be-bd37-243fd8c52098 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:01.987009 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-adcb041e-69f5-46be-bd37-243fd8c52098 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: ab2b571e-376c-41d3-a778-44bedcaa5467] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:01.993898 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-adcb041e-69f5-46be-bd37-243fd8c52098 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:01.994316 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-adcb041e-69f5-46be-bd37-243fd8c52098 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:01.994743 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-adcb041e-69f5-46be-bd37-243fd8c52098 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:01.995478 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-adcb041e-69f5-46be-bd37-243fd8c52098 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:01.996092 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-adcb041e-69f5-46be-bd37-243fd8c52098 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:01.996661 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-adcb041e-69f5-46be-bd37-243fd8c52098 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:02.375401 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-adcb041e-69f5-46be-bd37-243fd8c52098 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:02.386254 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-adcb041e-69f5-46be-bd37-243fd8c52098 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467" status: 200 len: 1472 microversion: 2.1 time: 0.405494 Oct 17 13:39:02.387295 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 652/1362] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:01 2022] GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467 => generated 1472 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:02.396933 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-52d1759f-ec77-4760-bc0b-38cdec7df616 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:02.403450 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-52d1759f-ec77-4760-bc0b-38cdec7df616 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:02.413477 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-52d1759f-ec77-4760-bc0b-38cdec7df616 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:02.414028 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-52d1759f-ec77-4760-bc0b-38cdec7df616 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:02.415299 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-52d1759f-ec77-4760-bc0b-38cdec7df616 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:02.416244 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-52d1759f-ec77-4760-bc0b-38cdec7df616 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:02.416647 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-52d1759f-ec77-4760-bc0b-38cdec7df616 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:02.417079 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-52d1759f-ec77-4760-bc0b-38cdec7df616 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:02.559011 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-52d1759f-ec77-4760-bc0b-38cdec7df616 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:02.569045 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-52d1759f-ec77-4760-bc0b-38cdec7df616 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:02.570733 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-52d1759f-ec77-4760-bc0b-38cdec7df616 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:02.577757 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-52d1759f-ec77-4760-bc0b-38cdec7df616 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1537 microversion: 2.91 time: 0.189200 Oct 17 13:39:02.600671 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 653/1363] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:39:02 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1537 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:39:02.607942 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c70e28a6-7e4a-421e-b6c6-d278e4aa4d64 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:02.609044 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c70e28a6-7e4a-421e-b6c6-d278e4aa4d64 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 68d9b4cb-0dc2-4809-8715-bdab9be79bd0] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:02.615906 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c70e28a6-7e4a-421e-b6c6-d278e4aa4d64 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:02.616737 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c70e28a6-7e4a-421e-b6c6-d278e4aa4d64 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:02.617372 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c70e28a6-7e4a-421e-b6c6-d278e4aa4d64 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:02.618832 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c70e28a6-7e4a-421e-b6c6-d278e4aa4d64 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:02.619518 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c70e28a6-7e4a-421e-b6c6-d278e4aa4d64 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:02.620157 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c70e28a6-7e4a-421e-b6c6-d278e4aa4d64 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:02.636471 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-048ae306-588e-40ea-987b-8d863f1e6063 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:39:02.637650 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-048ae306-588e-40ea-987b-8d863f1e6063 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:39:02.639998 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-048ae306-588e-40ea-987b-8d863f1e6063 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:39:02.640894 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-048ae306-588e-40ea-987b-8d863f1e6063 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:39:02.641692 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-048ae306-588e-40ea-987b-8d863f1e6063 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:39:02.671759 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-048ae306-588e-40ea-987b-8d863f1e6063 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:02.672341 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-048ae306-588e-40ea-987b-8d863f1e6063 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:02.672843 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-048ae306-588e-40ea-987b-8d863f1e6063 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:02.673732 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-048ae306-588e-40ea-987b-8d863f1e6063 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:02.674259 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-048ae306-588e-40ea-987b-8d863f1e6063 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:02.674950 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-048ae306-588e-40ea-987b-8d863f1e6063 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:02.694591 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-048ae306-588e-40ea-987b-8d863f1e6063 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Getting quotas for project ccf0569de787477e964f570378d6459a. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:39:02.699644 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-048ae306-588e-40ea-987b-8d863f1e6063 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Getting quotas for user 62cc720667f44772988d7890c227b217 and project ccf0569de787477e964f570378d6459a. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:39:02.767128 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-048ae306-588e-40ea-987b-8d863f1e6063 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:39:02.769764 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-048ae306-588e-40ea-987b-8d863f1e6063 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: fd365dc4-44c6-4a00-971e-2699762ab41f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fcbace29-936c-4378-894c-42f9ce034294',volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:39:02.899951 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c70e28a6-7e4a-421e-b6c6-d278e4aa4d64 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:02.908570 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c70e28a6-7e4a-421e-b6c6-d278e4aa4d64 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/68d9b4cb-0dc2-4809-8715-bdab9be79bd0" status: 200 len: 1323 microversion: 2.1 time: 0.306384 Oct 17 13:39:02.909157 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 654/1364] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:02 2022] GET /compute/v2.1/servers/68d9b4cb-0dc2-4809-8715-bdab9be79bd0 => generated 1323 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:02.913851 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7073c4c6-6131-467c-8954-b948d7c99f84 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:02.915081 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7073c4c6-6131-467c-8954-b948d7c99f84 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: d78e88b4-522f-4e6e-bcaa-dc259d9b8c89] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:02.921698 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7073c4c6-6131-467c-8954-b948d7c99f84 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:02.922415 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7073c4c6-6131-467c-8954-b948d7c99f84 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:02.923005 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7073c4c6-6131-467c-8954-b948d7c99f84 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:02.923978 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7073c4c6-6131-467c-8954-b948d7c99f84 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:02.924832 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7073c4c6-6131-467c-8954-b948d7c99f84 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:02.925413 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7073c4c6-6131-467c-8954-b948d7c99f84 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:02.950666 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-048ae306-588e-40ea-987b-8d863f1e6063 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.051919 Oct 17 13:39:02.951827 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 711/1365] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:39:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2057 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:39:02.956978 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2599b3e6-f81b-40f1-80c9-c67321888e1f tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5d6ff845-01de-41f5-ba4d-2e912a918196"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:02.959969 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2599b3e6-f81b-40f1-80c9-c67321888e1f tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] [instance: b8d15c7c-7a1f-43e0-9c41-302172f31ca0] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:02.966623 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2599b3e6-f81b-40f1-80c9-c67321888e1f tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:02.967488 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2599b3e6-f81b-40f1-80c9-c67321888e1f tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:02.968201 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2599b3e6-f81b-40f1-80c9-c67321888e1f tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:02.969080 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2599b3e6-f81b-40f1-80c9-c67321888e1f tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:02.969686 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2599b3e6-f81b-40f1-80c9-c67321888e1f tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:02.970266 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2599b3e6-f81b-40f1-80c9-c67321888e1f tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:03.065948 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:39:03.095618 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7073c4c6-6131-467c-8954-b948d7c99f84 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:03.101935 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:39:03.114384 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7073c4c6-6131-467c-8954-b948d7c99f84 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/d78e88b4-522f-4e6e-bcaa-dc259d9b8c89" status: 200 len: 1308 microversion: 2.1 time: 0.203963 Oct 17 13:39:03.114964 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 655/1366] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:02 2022] GET /compute/v2.1/servers/d78e88b4-522f-4e6e-bcaa-dc259d9b8c89 => generated 1308 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:03.127268 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-857a87cb-8f6f-4471-98ff-f59a52363715 req-a312695a-4f1c-4990-a9c0-271888a7c883 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d78e88b4-522f-4e6e-bcaa-dc259d9b8c89", "tag": "6bcd59a8-7ecc-4515-bd57-70d42b0ae40f"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:03.149660 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-857a87cb-8f6f-4471-98ff-f59a52363715 req-a312695a-4f1c-4990-a9c0-271888a7c883 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:03.150103 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-857a87cb-8f6f-4471-98ff-f59a52363715 req-a312695a-4f1c-4990-a9c0-271888a7c883 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:03.150522 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-857a87cb-8f6f-4471-98ff-f59a52363715 req-a312695a-4f1c-4990-a9c0-271888a7c883 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:03.169985 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-857a87cb-8f6f-4471-98ff-f59a52363715 req-a312695a-4f1c-4990-a9c0-271888a7c883 service nova] Creating event network-changed:6bcd59a8-7ecc-4515-bd57-70d42b0ae40f for instance d78e88b4-522f-4e6e-bcaa-dc259d9b8c89 on n-h1-854247-14 Oct 17 13:39:03.174944 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-857a87cb-8f6f-4471-98ff-f59a52363715 req-a312695a-4f1c-4990-a9c0-271888a7c883 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058663 Oct 17 13:39:03.175658 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 656/1367] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:39:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:39:03.181156 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-45b8148f-7f12-40bf-b7b0-f8eba26476f0 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:03.181650 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-45b8148f-7f12-40bf-b7b0-f8eba26476f0 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: fd365dc4-44c6-4a00-971e-2699762ab41f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:03.269371 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-45b8148f-7f12-40bf-b7b0-f8eba26476f0 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:03.278999 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-45b8148f-7f12-40bf-b7b0-f8eba26476f0 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f" status: 200 len: 1052 microversion: 2.1 time: 0.102151 Oct 17 13:39:03.279615 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 657/1368] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:03 2022] GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f => generated 1052 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:03.290565 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-149f056c-0954-47af-8fd4-11d308b2fbd2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:03.291491 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-149f056c-0954-47af-8fd4-11d308b2fbd2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 16213741-2241-4f55-b7ca-20ab551e5596] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:03.294766 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:39:03.299015 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-149f056c-0954-47af-8fd4-11d308b2fbd2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:03.299591 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-149f056c-0954-47af-8fd4-11d308b2fbd2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:03.300375 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-149f056c-0954-47af-8fd4-11d308b2fbd2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:03.301595 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-149f056c-0954-47af-8fd4-11d308b2fbd2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:03.302101 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-149f056c-0954-47af-8fd4-11d308b2fbd2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:03.302526 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-149f056c-0954-47af-8fd4-11d308b2fbd2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:03.318780 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2599b3e6-f81b-40f1-80c9-c67321888e1f tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] 10.222.0.79 "POST /compute/v2.1/servers/b8d15c7c-7a1f-43e0-9c41-302172f31ca0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.365512 Oct 17 13:39:03.325345 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 712/1369] 10.222.0.79 () {60 vars in 1323 bytes} [Mon Oct 17 13:39:02 2022] POST /compute/v2.1/servers/b8d15c7c-7a1f-43e0-9c41-302172f31ca0/os-volume_attachments => generated 194 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:39:03.417134 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-00e6f4bf-f207-45b9-b1f8-45be9d4696bf tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:03.417867 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-00e6f4bf-f207-45b9-b1f8-45be9d4696bf tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: ab2b571e-376c-41d3-a778-44bedcaa5467] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:03.426948 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-00e6f4bf-f207-45b9-b1f8-45be9d4696bf tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:03.427498 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-00e6f4bf-f207-45b9-b1f8-45be9d4696bf tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:03.427943 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-00e6f4bf-f207-45b9-b1f8-45be9d4696bf tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:03.428861 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-00e6f4bf-f207-45b9-b1f8-45be9d4696bf tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:03.429328 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-00e6f4bf-f207-45b9-b1f8-45be9d4696bf tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:03.429888 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-00e6f4bf-f207-45b9-b1f8-45be9d4696bf tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:03.481899 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-149f056c-0954-47af-8fd4-11d308b2fbd2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:03.492762 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-149f056c-0954-47af-8fd4-11d308b2fbd2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:03.495264 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-149f056c-0954-47af-8fd4-11d308b2fbd2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:03.496952 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-149f056c-0954-47af-8fd4-11d308b2fbd2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596" status: 200 len: 1362 microversion: 2.25 time: 0.210511 Oct 17 13:39:03.497840 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 658/1370] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:39:03 2022] GET /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596 => generated 1362 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:39:03.610719 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d00b38cf-109f-4742-b263-0e97c91779df tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:03.611625 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d00b38cf-109f-4742-b263-0e97c91779df tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:03.625905 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d00b38cf-109f-4742-b263-0e97c91779df tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:03.626618 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d00b38cf-109f-4742-b263-0e97c91779df tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:03.627142 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d00b38cf-109f-4742-b263-0e97c91779df tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:03.628435 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d00b38cf-109f-4742-b263-0e97c91779df tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:03.628973 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d00b38cf-109f-4742-b263-0e97c91779df tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:03.629428 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d00b38cf-109f-4742-b263-0e97c91779df tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:03.692361 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-00e6f4bf-f207-45b9-b1f8-45be9d4696bf tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:03.708189 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-00e6f4bf-f207-45b9-b1f8-45be9d4696bf tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467" status: 200 len: 1472 microversion: 2.1 time: 0.298778 Oct 17 13:39:03.709020 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 713/1371] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:03 2022] GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467 => generated 1472 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:03.737231 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d00b38cf-109f-4742-b263-0e97c91779df tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:03.747775 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d00b38cf-109f-4742-b263-0e97c91779df tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:03.754918 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d00b38cf-109f-4742-b263-0e97c91779df tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:03.764597 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d00b38cf-109f-4742-b263-0e97c91779df tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1537 microversion: 2.91 time: 0.162209 Oct 17 13:39:03.765643 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 659/1372] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:39:03 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1537 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:39:03.933960 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a94196d2-8e5a-4888-ba85-70eb26a1d546 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:03.934898 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a94196d2-8e5a-4888-ba85-70eb26a1d546 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 68d9b4cb-0dc2-4809-8715-bdab9be79bd0] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:03.943388 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a94196d2-8e5a-4888-ba85-70eb26a1d546 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:03.944129 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a94196d2-8e5a-4888-ba85-70eb26a1d546 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:03.944771 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a94196d2-8e5a-4888-ba85-70eb26a1d546 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:03.945644 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a94196d2-8e5a-4888-ba85-70eb26a1d546 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:03.947755 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a94196d2-8e5a-4888-ba85-70eb26a1d546 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:03.948417 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a94196d2-8e5a-4888-ba85-70eb26a1d546 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:04.141621 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a0adf48f-9862-444f-9986-eb4726c40445 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:04.143125 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a0adf48f-9862-444f-9986-eb4726c40445 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: d78e88b4-522f-4e6e-bcaa-dc259d9b8c89] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:04.153553 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a0adf48f-9862-444f-9986-eb4726c40445 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:04.154295 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a0adf48f-9862-444f-9986-eb4726c40445 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:04.154947 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a0adf48f-9862-444f-9986-eb4726c40445 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:04.157003 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a0adf48f-9862-444f-9986-eb4726c40445 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:04.157652 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a0adf48f-9862-444f-9986-eb4726c40445 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:04.158593 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a0adf48f-9862-444f-9986-eb4726c40445 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:04.320126 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a94196d2-8e5a-4888-ba85-70eb26a1d546 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:04.329447 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a94196d2-8e5a-4888-ba85-70eb26a1d546 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/68d9b4cb-0dc2-4809-8715-bdab9be79bd0" status: 200 len: 1323 microversion: 2.1 time: 0.400826 Oct 17 13:39:04.348138 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 714/1373] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:03 2022] GET /compute/v2.1/servers/68d9b4cb-0dc2-4809-8715-bdab9be79bd0 => generated 1323 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:04.370383 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-82b246b8-0f0e-4fd4-adf8-1684bdc92694 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:04.371239 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-82b246b8-0f0e-4fd4-adf8-1684bdc92694 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: fd365dc4-44c6-4a00-971e-2699762ab41f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:04.378465 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82b246b8-0f0e-4fd4-adf8-1684bdc92694 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:04.381207 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82b246b8-0f0e-4fd4-adf8-1684bdc92694 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:04.381903 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82b246b8-0f0e-4fd4-adf8-1684bdc92694 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:04.383385 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82b246b8-0f0e-4fd4-adf8-1684bdc92694 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:04.384577 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82b246b8-0f0e-4fd4-adf8-1684bdc92694 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:04.385284 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82b246b8-0f0e-4fd4-adf8-1684bdc92694 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:04.567482 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a0adf48f-9862-444f-9986-eb4726c40445 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:04.577826 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a0adf48f-9862-444f-9986-eb4726c40445 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/d78e88b4-522f-4e6e-bcaa-dc259d9b8c89" status: 200 len: 1308 microversion: 2.1 time: 0.444095 Oct 17 13:39:04.580477 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 660/1374] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:04 2022] GET /compute/v2.1/servers/d78e88b4-522f-4e6e-bcaa-dc259d9b8c89 => generated 1308 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:04.594322 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-89f2230a-742c-4fd1-b5d1-9237d378592d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:04.596621 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-89f2230a-742c-4fd1-b5d1-9237d378592d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 16213741-2241-4f55-b7ca-20ab551e5596] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:04.618780 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-89f2230a-742c-4fd1-b5d1-9237d378592d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:04.619603 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-89f2230a-742c-4fd1-b5d1-9237d378592d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:04.620202 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-89f2230a-742c-4fd1-b5d1-9237d378592d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:04.621585 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-89f2230a-742c-4fd1-b5d1-9237d378592d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:04.622204 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-89f2230a-742c-4fd1-b5d1-9237d378592d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:04.623197 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-89f2230a-742c-4fd1-b5d1-9237d378592d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:04.689940 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-82b246b8-0f0e-4fd4-adf8-1684bdc92694 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:04.704433 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-82b246b8-0f0e-4fd4-adf8-1684bdc92694 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f" status: 200 len: 1150 microversion: 2.1 time: 0.354694 Oct 17 13:39:04.719811 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 715/1375] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:04 2022] GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f => generated 1150 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:04.732303 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b261f685-c056-43f9-ab7c-a51c895a05c0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:04.735566 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b261f685-c056-43f9-ab7c-a51c895a05c0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: ab2b571e-376c-41d3-a778-44bedcaa5467] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:04.750379 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b261f685-c056-43f9-ab7c-a51c895a05c0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:04.750965 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b261f685-c056-43f9-ab7c-a51c895a05c0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:04.751508 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b261f685-c056-43f9-ab7c-a51c895a05c0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:04.752284 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b261f685-c056-43f9-ab7c-a51c895a05c0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:04.752741 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b261f685-c056-43f9-ab7c-a51c895a05c0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:04.753164 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b261f685-c056-43f9-ab7c-a51c895a05c0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:05.552305 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b261f685-c056-43f9-ab7c-a51c895a05c0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:05.557717 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-89f2230a-742c-4fd1-b5d1-9237d378592d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:05.563868 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b261f685-c056-43f9-ab7c-a51c895a05c0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467" status: 200 len: 1472 microversion: 2.1 time: 0.835948 Oct 17 13:39:05.583194 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-89f2230a-742c-4fd1-b5d1-9237d378592d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:05.583194 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-89f2230a-742c-4fd1-b5d1-9237d378592d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:05.583543 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 716/1376] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:04 2022] GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467 => generated 1472 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:05.583646 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-89f2230a-742c-4fd1-b5d1-9237d378592d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596" status: 200 len: 1362 microversion: 2.25 time: 0.987196 Oct 17 13:39:05.588054 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-31c948ad-2c35-46f3-8ea1-87bcee123024 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:05.588686 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-31c948ad-2c35-46f3-8ea1-87bcee123024 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:05.599480 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 661/1377] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:39:04 2022] GET /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596 => generated 1362 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:39:05.613251 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-31c948ad-2c35-46f3-8ea1-87bcee123024 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:05.613782 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-31c948ad-2c35-46f3-8ea1-87bcee123024 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:05.614230 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-31c948ad-2c35-46f3-8ea1-87bcee123024 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:05.615511 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-00fbf024-7c82-40d9-a94c-66a6c142db03 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:05.616293 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-00fbf024-7c82-40d9-a94c-66a6c142db03 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 68d9b4cb-0dc2-4809-8715-bdab9be79bd0] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:05.623146 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-00fbf024-7c82-40d9-a94c-66a6c142db03 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:05.623701 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-31c948ad-2c35-46f3-8ea1-87bcee123024 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:05.624134 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-00fbf024-7c82-40d9-a94c-66a6c142db03 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:05.624263 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-31c948ad-2c35-46f3-8ea1-87bcee123024 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:05.624695 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-31c948ad-2c35-46f3-8ea1-87bcee123024 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:05.624855 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-00fbf024-7c82-40d9-a94c-66a6c142db03 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:05.625901 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-00fbf024-7c82-40d9-a94c-66a6c142db03 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:05.626676 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-00fbf024-7c82-40d9-a94c-66a6c142db03 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:05.627070 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-00fbf024-7c82-40d9-a94c-66a6c142db03 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:05.784507 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-31c948ad-2c35-46f3-8ea1-87bcee123024 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:05.798787 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-31c948ad-2c35-46f3-8ea1-87bcee123024 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:05.800951 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-31c948ad-2c35-46f3-8ea1-87bcee123024 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:05.807460 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-31c948ad-2c35-46f3-8ea1-87bcee123024 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1537 microversion: 2.91 time: 0.234298 Oct 17 13:39:05.809171 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 717/1378] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:39:05 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1537 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:39:05.817290 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3eabf824-2225-4c9f-9168-3d2cfcfc3cff tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:05.818129 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3eabf824-2225-4c9f-9168-3d2cfcfc3cff tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: d78e88b4-522f-4e6e-bcaa-dc259d9b8c89] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:05.839320 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3eabf824-2225-4c9f-9168-3d2cfcfc3cff tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:05.839990 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3eabf824-2225-4c9f-9168-3d2cfcfc3cff tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:05.840600 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3eabf824-2225-4c9f-9168-3d2cfcfc3cff tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:05.841496 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3eabf824-2225-4c9f-9168-3d2cfcfc3cff tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:05.842188 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3eabf824-2225-4c9f-9168-3d2cfcfc3cff tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:05.842769 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3eabf824-2225-4c9f-9168-3d2cfcfc3cff tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:06.017020 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-00fbf024-7c82-40d9-a94c-66a6c142db03 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:06.029644 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-00fbf024-7c82-40d9-a94c-66a6c142db03 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/68d9b4cb-0dc2-4809-8715-bdab9be79bd0" status: 200 len: 1323 microversion: 2.1 time: 0.424209 Oct 17 13:39:06.034478 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 662/1379] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:05 2022] GET /compute/v2.1/servers/68d9b4cb-0dc2-4809-8715-bdab9be79bd0 => generated 1323 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:06.052883 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4949f891-189c-4e7a-92de-e8334a2f668b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:06.060853 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4949f891-189c-4e7a-92de-e8334a2f668b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: fd365dc4-44c6-4a00-971e-2699762ab41f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:06.072679 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4949f891-189c-4e7a-92de-e8334a2f668b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:06.073774 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4949f891-189c-4e7a-92de-e8334a2f668b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:06.074450 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4949f891-189c-4e7a-92de-e8334a2f668b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:06.075417 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4949f891-189c-4e7a-92de-e8334a2f668b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:06.076083 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4949f891-189c-4e7a-92de-e8334a2f668b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:06.076829 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4949f891-189c-4e7a-92de-e8334a2f668b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:06.136337 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3eabf824-2225-4c9f-9168-3d2cfcfc3cff tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:06.150150 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3eabf824-2225-4c9f-9168-3d2cfcfc3cff tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/d78e88b4-522f-4e6e-bcaa-dc259d9b8c89" status: 200 len: 1308 microversion: 2.1 time: 0.339295 Oct 17 13:39:06.163199 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 718/1380] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:05 2022] GET /compute/v2.1/servers/d78e88b4-522f-4e6e-bcaa-dc259d9b8c89 => generated 1308 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:06.424391 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4949f891-189c-4e7a-92de-e8334a2f668b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:06.439339 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4949f891-189c-4e7a-92de-e8334a2f668b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f" status: 200 len: 1210 microversion: 2.1 time: 0.403602 Oct 17 13:39:06.441440 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 663/1381] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:06 2022] GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f => generated 1210 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:06.595411 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1acee0dc-e160-4987-b540-105cc33af405 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:06.596381 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1acee0dc-e160-4987-b540-105cc33af405 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: ab2b571e-376c-41d3-a778-44bedcaa5467] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:06.603767 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1acee0dc-e160-4987-b540-105cc33af405 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:06.604549 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1acee0dc-e160-4987-b540-105cc33af405 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:06.605173 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1acee0dc-e160-4987-b540-105cc33af405 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:06.606051 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1acee0dc-e160-4987-b540-105cc33af405 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:06.606783 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1acee0dc-e160-4987-b540-105cc33af405 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:06.607397 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1acee0dc-e160-4987-b540-105cc33af405 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:06.610971 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fbcfcf79-4f69-4d7f-b74e-1de242cad357 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:06.611695 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-fbcfcf79-4f69-4d7f-b74e-1de242cad357 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 16213741-2241-4f55-b7ca-20ab551e5596] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:06.624320 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fbcfcf79-4f69-4d7f-b74e-1de242cad357 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:06.624756 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fbcfcf79-4f69-4d7f-b74e-1de242cad357 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:06.625193 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fbcfcf79-4f69-4d7f-b74e-1de242cad357 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:06.628116 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fbcfcf79-4f69-4d7f-b74e-1de242cad357 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:06.628590 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fbcfcf79-4f69-4d7f-b74e-1de242cad357 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:06.629028 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fbcfcf79-4f69-4d7f-b74e-1de242cad357 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:07.365268 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fbcfcf79-4f69-4d7f-b74e-1de242cad357 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:07.381842 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fbcfcf79-4f69-4d7f-b74e-1de242cad357 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:07.385241 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fbcfcf79-4f69-4d7f-b74e-1de242cad357 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:07.390872 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fbcfcf79-4f69-4d7f-b74e-1de242cad357 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596" status: 200 len: 1362 microversion: 2.25 time: 0.782440 Oct 17 13:39:07.414392 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 664/1382] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:39:06 2022] GET /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596 => generated 1362 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:39:07.421035 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1acee0dc-e160-4987-b540-105cc33af405 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:07.430625 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d3f9b9fb-6ae3-4d83-bade-8cc06af687e4 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:07.431342 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d3f9b9fb-6ae3-4d83-bade-8cc06af687e4 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:07.435920 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1acee0dc-e160-4987-b540-105cc33af405 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467" status: 200 len: 1472 microversion: 2.1 time: 0.844219 Oct 17 13:39:07.449780 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d3f9b9fb-6ae3-4d83-bade-8cc06af687e4 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:07.450288 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d3f9b9fb-6ae3-4d83-bade-8cc06af687e4 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:07.450734 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d3f9b9fb-6ae3-4d83-bade-8cc06af687e4 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:07.451492 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d3f9b9fb-6ae3-4d83-bade-8cc06af687e4 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:07.451950 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d3f9b9fb-6ae3-4d83-bade-8cc06af687e4 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:07.452378 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d3f9b9fb-6ae3-4d83-bade-8cc06af687e4 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:07.458933 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 719/1383] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:06 2022] GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467 => generated 1472 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:07.469166 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-cd2a84f4-02f3-4e35-9731-ab0178c0f196 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:07.469995 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-cd2a84f4-02f3-4e35-9731-ab0178c0f196 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 68d9b4cb-0dc2-4809-8715-bdab9be79bd0] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:07.485357 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cd2a84f4-02f3-4e35-9731-ab0178c0f196 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:07.487609 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cd2a84f4-02f3-4e35-9731-ab0178c0f196 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:07.488173 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cd2a84f4-02f3-4e35-9731-ab0178c0f196 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:07.489012 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cd2a84f4-02f3-4e35-9731-ab0178c0f196 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:07.494385 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cd2a84f4-02f3-4e35-9731-ab0178c0f196 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:07.495603 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cd2a84f4-02f3-4e35-9731-ab0178c0f196 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:07.584747 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=12 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:39:07.762385 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d3f9b9fb-6ae3-4d83-bade-8cc06af687e4 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:07.776621 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d3f9b9fb-6ae3-4d83-bade-8cc06af687e4 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:07.782786 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d3f9b9fb-6ae3-4d83-bade-8cc06af687e4 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:07.790984 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d3f9b9fb-6ae3-4d83-bade-8cc06af687e4 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1537 microversion: 2.91 time: 0.374221 Oct 17 13:39:07.791941 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 665/1384] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:39:07 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1537 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:39:07.802302 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-13b07d01-5711-4adc-8ee8-e206fabd5f82 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:07.803276 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-13b07d01-5711-4adc-8ee8-e206fabd5f82 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: d78e88b4-522f-4e6e-bcaa-dc259d9b8c89] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:07.813523 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-13b07d01-5711-4adc-8ee8-e206fabd5f82 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:07.814022 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-13b07d01-5711-4adc-8ee8-e206fabd5f82 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:07.814465 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-13b07d01-5711-4adc-8ee8-e206fabd5f82 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:07.818478 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-13b07d01-5711-4adc-8ee8-e206fabd5f82 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:07.819209 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-13b07d01-5711-4adc-8ee8-e206fabd5f82 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:07.819835 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-13b07d01-5711-4adc-8ee8-e206fabd5f82 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:07.924556 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-cd2a84f4-02f3-4e35-9731-ab0178c0f196 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:07.935114 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-cd2a84f4-02f3-4e35-9731-ab0178c0f196 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/68d9b4cb-0dc2-4809-8715-bdab9be79bd0" status: 200 len: 1323 microversion: 2.1 time: 0.474723 Oct 17 13:39:07.936109 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 720/1385] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:07 2022] GET /compute/v2.1/servers/68d9b4cb-0dc2-4809-8715-bdab9be79bd0 => generated 1323 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:08.048542 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-13b07d01-5711-4adc-8ee8-e206fabd5f82 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:08.057934 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-13b07d01-5711-4adc-8ee8-e206fabd5f82 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/d78e88b4-522f-4e6e-bcaa-dc259d9b8c89" status: 200 len: 1308 microversion: 2.1 time: 0.260105 Oct 17 13:39:08.072958 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 666/1386] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:07 2022] GET /compute/v2.1/servers/d78e88b4-522f-4e6e-bcaa-dc259d9b8c89 => generated 1308 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:08.081435 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2768467c-76d3-4794-9656-1dab100f287e tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:08.082190 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2768467c-76d3-4794-9656-1dab100f287e tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: fd365dc4-44c6-4a00-971e-2699762ab41f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:08.090200 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2768467c-76d3-4794-9656-1dab100f287e tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:08.091015 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2768467c-76d3-4794-9656-1dab100f287e tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:08.091828 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2768467c-76d3-4794-9656-1dab100f287e tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:08.092764 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2768467c-76d3-4794-9656-1dab100f287e tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:08.093373 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2768467c-76d3-4794-9656-1dab100f287e tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:08.094020 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2768467c-76d3-4794-9656-1dab100f287e tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:08.132336 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-b848f94d-ee14-43d6-a815-2686eda89ae9 req-955d5723-e1ad-4262-a5b6-9404ff8d48ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68d9b4cb-0dc2-4809-8715-bdab9be79bd0", "name": "network-vif-plugged", "status": "completed", "tag": "5d084305-dc3f-46d2-8407-4164b5cf23b7"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:08.145295 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-b848f94d-ee14-43d6-a815-2686eda89ae9 req-955d5723-e1ad-4262-a5b6-9404ff8d48ab service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:08.146163 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-b848f94d-ee14-43d6-a815-2686eda89ae9 req-955d5723-e1ad-4262-a5b6-9404ff8d48ab service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:08.146655 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-b848f94d-ee14-43d6-a815-2686eda89ae9 req-955d5723-e1ad-4262-a5b6-9404ff8d48ab service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:08.180623 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-b848f94d-ee14-43d6-a815-2686eda89ae9 req-955d5723-e1ad-4262-a5b6-9404ff8d48ab service nova] Creating event network-vif-plugged:5d084305-dc3f-46d2-8407-4164b5cf23b7 for instance 68d9b4cb-0dc2-4809-8715-bdab9be79bd0 on n-h1-854247-14 Oct 17 13:39:08.194445 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-b848f94d-ee14-43d6-a815-2686eda89ae9 req-955d5723-e1ad-4262-a5b6-9404ff8d48ab service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.255155 Oct 17 13:39:08.196725 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 721/1387] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:39:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:39:08.211971 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-86743ec1-8a41-4a57-81ef-502dd9708f96 req-4aeece55-df17-4cde-94ed-ca87ccaa44c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd365dc4-44c6-4a00-971e-2699762ab41f", "tag": "6d5ddeb5-1324-4b12-9490-8c34031e6c41"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:08.233063 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-86743ec1-8a41-4a57-81ef-502dd9708f96 req-4aeece55-df17-4cde-94ed-ca87ccaa44c0 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:08.234535 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-86743ec1-8a41-4a57-81ef-502dd9708f96 req-4aeece55-df17-4cde-94ed-ca87ccaa44c0 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:08.235196 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-86743ec1-8a41-4a57-81ef-502dd9708f96 req-4aeece55-df17-4cde-94ed-ca87ccaa44c0 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:08.250544 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-86743ec1-8a41-4a57-81ef-502dd9708f96 req-4aeece55-df17-4cde-94ed-ca87ccaa44c0 service nova] Creating event network-changed:6d5ddeb5-1324-4b12-9490-8c34031e6c41 for instance fd365dc4-44c6-4a00-971e-2699762ab41f on n-h1-854247-14 Oct 17 13:39:08.255500 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-86743ec1-8a41-4a57-81ef-502dd9708f96 req-4aeece55-df17-4cde-94ed-ca87ccaa44c0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057337 Oct 17 13:39:08.256742 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 722/1388] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:39:08.336847 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2768467c-76d3-4794-9656-1dab100f287e tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:08.346805 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2768467c-76d3-4794-9656-1dab100f287e tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f" status: 200 len: 1210 microversion: 2.1 time: 0.271899 Oct 17 13:39:08.347835 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 667/1389] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:08 2022] GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f => generated 1210 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:08.420827 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0387158d-a6f2-4295-8b89-17e6c48fd70d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:08.421527 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0387158d-a6f2-4295-8b89-17e6c48fd70d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 16213741-2241-4f55-b7ca-20ab551e5596] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:08.432561 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0387158d-a6f2-4295-8b89-17e6c48fd70d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:08.433255 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0387158d-a6f2-4295-8b89-17e6c48fd70d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:08.433858 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0387158d-a6f2-4295-8b89-17e6c48fd70d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:08.434773 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0387158d-a6f2-4295-8b89-17e6c48fd70d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:08.435435 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0387158d-a6f2-4295-8b89-17e6c48fd70d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:08.435862 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0387158d-a6f2-4295-8b89-17e6c48fd70d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:08.460298 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0a217f2a-7070-447f-a4da-44f14b9081bd tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:08.461062 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0a217f2a-7070-447f-a4da-44f14b9081bd tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: ab2b571e-376c-41d3-a778-44bedcaa5467] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:08.470038 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0a217f2a-7070-447f-a4da-44f14b9081bd tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:08.470525 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0a217f2a-7070-447f-a4da-44f14b9081bd tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:08.470958 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0a217f2a-7070-447f-a4da-44f14b9081bd tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:08.475465 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0a217f2a-7070-447f-a4da-44f14b9081bd tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:08.475944 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0a217f2a-7070-447f-a4da-44f14b9081bd tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:08.476382 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0a217f2a-7070-447f-a4da-44f14b9081bd tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:08.679439 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0387158d-a6f2-4295-8b89-17e6c48fd70d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:08.690950 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0387158d-a6f2-4295-8b89-17e6c48fd70d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:08.692706 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0387158d-a6f2-4295-8b89-17e6c48fd70d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:08.698917 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0387158d-a6f2-4295-8b89-17e6c48fd70d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596" status: 200 len: 1362 microversion: 2.25 time: 0.277859 Oct 17 13:39:08.701206 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 723/1390] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:39:08 2022] GET /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596 => generated 1362 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:39:08.720189 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0a217f2a-7070-447f-a4da-44f14b9081bd tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:08.728839 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0a217f2a-7070-447f-a4da-44f14b9081bd tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467" status: 200 len: 1472 microversion: 2.1 time: 0.272360 Oct 17 13:39:08.729514 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 668/1391] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:08 2022] GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467 => generated 1472 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:39:08.824854 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9fead5a4-116d-42c4-9c4a-c55d537cc259 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:08.825834 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9fead5a4-116d-42c4-9c4a-c55d537cc259 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:08.832641 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9fead5a4-116d-42c4-9c4a-c55d537cc259 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:08.833351 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9fead5a4-116d-42c4-9c4a-c55d537cc259 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:08.833952 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9fead5a4-116d-42c4-9c4a-c55d537cc259 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:08.834847 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9fead5a4-116d-42c4-9c4a-c55d537cc259 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:08.835482 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9fead5a4-116d-42c4-9c4a-c55d537cc259 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:08.836061 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9fead5a4-116d-42c4-9c4a-c55d537cc259 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:08.931572 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9fead5a4-116d-42c4-9c4a-c55d537cc259 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:08.941519 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9fead5a4-116d-42c4-9c4a-c55d537cc259 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:08.943226 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9fead5a4-116d-42c4-9c4a-c55d537cc259 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:08.949738 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9fead5a4-116d-42c4-9c4a-c55d537cc259 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1537 microversion: 2.91 time: 0.129227 Oct 17 13:39:08.952600 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 724/1392] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:39:08 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1537 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:39:08.961141 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e8e48e76-3f90-4676-b319-84f0f3b39c91 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:08.961898 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e8e48e76-3f90-4676-b319-84f0f3b39c91 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 68d9b4cb-0dc2-4809-8715-bdab9be79bd0] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:08.973431 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e8e48e76-3f90-4676-b319-84f0f3b39c91 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:08.973922 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e8e48e76-3f90-4676-b319-84f0f3b39c91 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:08.974351 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e8e48e76-3f90-4676-b319-84f0f3b39c91 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:08.975069 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e8e48e76-3f90-4676-b319-84f0f3b39c91 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:08.975593 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e8e48e76-3f90-4676-b319-84f0f3b39c91 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:08.975945 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e8e48e76-3f90-4676-b319-84f0f3b39c91 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:09.085978 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9bbd3e9d-95a6-4c95-99dd-c239fa827887 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:09.086674 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9bbd3e9d-95a6-4c95-99dd-c239fa827887 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: d78e88b4-522f-4e6e-bcaa-dc259d9b8c89] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:09.093577 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9bbd3e9d-95a6-4c95-99dd-c239fa827887 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:09.094937 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9bbd3e9d-95a6-4c95-99dd-c239fa827887 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:09.097250 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9bbd3e9d-95a6-4c95-99dd-c239fa827887 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:09.097250 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9bbd3e9d-95a6-4c95-99dd-c239fa827887 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:09.097250 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9bbd3e9d-95a6-4c95-99dd-c239fa827887 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:09.097250 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9bbd3e9d-95a6-4c95-99dd-c239fa827887 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:09.355092 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e8e48e76-3f90-4676-b319-84f0f3b39c91 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:09.360080 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9bbd3e9d-95a6-4c95-99dd-c239fa827887 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:09.366466 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e8e48e76-3f90-4676-b319-84f0f3b39c91 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/68d9b4cb-0dc2-4809-8715-bdab9be79bd0" status: 200 len: 1323 microversion: 2.1 time: 0.408434 Oct 17 13:39:09.369109 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 669/1393] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:08 2022] GET /compute/v2.1/servers/68d9b4cb-0dc2-4809-8715-bdab9be79bd0 => generated 1323 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:09.373445 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9bbd3e9d-95a6-4c95-99dd-c239fa827887 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/d78e88b4-522f-4e6e-bcaa-dc259d9b8c89" status: 200 len: 1308 microversion: 2.1 time: 0.288943 Oct 17 13:39:09.385156 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 725/1394] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:09 2022] GET /compute/v2.1/servers/d78e88b4-522f-4e6e-bcaa-dc259d9b8c89 => generated 1308 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:09.391225 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f1f02b3d-a919-4219-a04f-7d78a421ff59 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:09.391225 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f1f02b3d-a919-4219-a04f-7d78a421ff59 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: fd365dc4-44c6-4a00-971e-2699762ab41f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:09.393922 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1f02b3d-a919-4219-a04f-7d78a421ff59 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:09.394415 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1f02b3d-a919-4219-a04f-7d78a421ff59 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:09.394853 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1f02b3d-a919-4219-a04f-7d78a421ff59 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:09.395598 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1f02b3d-a919-4219-a04f-7d78a421ff59 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:09.396141 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1f02b3d-a919-4219-a04f-7d78a421ff59 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:09.396500 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1f02b3d-a919-4219-a04f-7d78a421ff59 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:09.692952 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f1f02b3d-a919-4219-a04f-7d78a421ff59 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:09.704283 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f1f02b3d-a919-4219-a04f-7d78a421ff59 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f" status: 200 len: 1210 microversion: 2.1 time: 0.332481 Oct 17 13:39:09.705331 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 670/1395] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:09 2022] GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f => generated 1210 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:09.728214 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-99543ead-9de9-4093-8b47-b7339964d0c9 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:09.731445 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-99543ead-9de9-4093-8b47-b7339964d0c9 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 16213741-2241-4f55-b7ca-20ab551e5596] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:09.743063 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-99543ead-9de9-4093-8b47-b7339964d0c9 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:09.745603 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-99543ead-9de9-4093-8b47-b7339964d0c9 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:09.746279 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-99543ead-9de9-4093-8b47-b7339964d0c9 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:09.747348 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-99543ead-9de9-4093-8b47-b7339964d0c9 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:09.753202 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0148f486-8d52-4ed1-8108-5862309f2c43 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:09.754163 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0148f486-8d52-4ed1-8108-5862309f2c43 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: ab2b571e-376c-41d3-a778-44bedcaa5467] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:09.761054 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-99543ead-9de9-4093-8b47-b7339964d0c9 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:09.762028 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-99543ead-9de9-4093-8b47-b7339964d0c9 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:09.763841 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0148f486-8d52-4ed1-8108-5862309f2c43 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:09.767451 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0148f486-8d52-4ed1-8108-5862309f2c43 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:09.769992 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0148f486-8d52-4ed1-8108-5862309f2c43 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:09.771096 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0148f486-8d52-4ed1-8108-5862309f2c43 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:09.777118 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0148f486-8d52-4ed1-8108-5862309f2c43 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:09.780892 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0148f486-8d52-4ed1-8108-5862309f2c43 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:10.051683 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0148f486-8d52-4ed1-8108-5862309f2c43 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:10.060804 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0148f486-8d52-4ed1-8108-5862309f2c43 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467" status: 200 len: 1472 microversion: 2.1 time: 0.311659 Oct 17 13:39:10.065301 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 671/1396] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:09 2022] GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467 => generated 1472 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:10.077039 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e0549e90-59ce-4bba-bd03-af30869f47f6 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:10.077894 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e0549e90-59ce-4bba-bd03-af30869f47f6 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:10.099330 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e0549e90-59ce-4bba-bd03-af30869f47f6 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:10.100112 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e0549e90-59ce-4bba-bd03-af30869f47f6 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:10.102394 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e0549e90-59ce-4bba-bd03-af30869f47f6 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:10.103816 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e0549e90-59ce-4bba-bd03-af30869f47f6 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:10.104495 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e0549e90-59ce-4bba-bd03-af30869f47f6 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:10.105125 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e0549e90-59ce-4bba-bd03-af30869f47f6 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:10.158235 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-99543ead-9de9-4093-8b47-b7339964d0c9 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:10.170815 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-99543ead-9de9-4093-8b47-b7339964d0c9 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:10.177065 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-99543ead-9de9-4093-8b47-b7339964d0c9 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:10.178294 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-99543ead-9de9-4093-8b47-b7339964d0c9 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596" status: 200 len: 1362 microversion: 2.25 time: 0.456397 Oct 17 13:39:10.178950 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 726/1397] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:39:09 2022] GET /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596 => generated 1362 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:39:10.218623 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-84b07dfe-f3d7-4096-ae04-2bacdbbc58bc req-9f44078b-bfa5-4cdc-9f1a-61f8b0f62268 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16213741-2241-4f55-b7ca-20ab551e5596", "name": "network-vif-plugged", "status": "completed", "tag": "216dd503-7afa-42cd-aafc-f62df426ee70"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:10.228916 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-84b07dfe-f3d7-4096-ae04-2bacdbbc58bc req-9f44078b-bfa5-4cdc-9f1a-61f8b0f62268 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:10.229658 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-84b07dfe-f3d7-4096-ae04-2bacdbbc58bc req-9f44078b-bfa5-4cdc-9f1a-61f8b0f62268 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:10.230333 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-84b07dfe-f3d7-4096-ae04-2bacdbbc58bc req-9f44078b-bfa5-4cdc-9f1a-61f8b0f62268 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:10.233323 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e0549e90-59ce-4bba-bd03-af30869f47f6 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:10.245213 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-84b07dfe-f3d7-4096-ae04-2bacdbbc58bc req-9f44078b-bfa5-4cdc-9f1a-61f8b0f62268 service nova] Creating event network-vif-plugged:216dd503-7afa-42cd-aafc-f62df426ee70 for instance 16213741-2241-4f55-b7ca-20ab551e5596 on n-h1-854247-14 Oct 17 13:39:10.246106 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e0549e90-59ce-4bba-bd03-af30869f47f6 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:10.249740 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e0549e90-59ce-4bba-bd03-af30869f47f6 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:10.251540 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-84b07dfe-f3d7-4096-ae04-2bacdbbc58bc req-9f44078b-bfa5-4cdc-9f1a-61f8b0f62268 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037122 Oct 17 13:39:10.255992 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 727/1398] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:39:10.259023 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e0549e90-59ce-4bba-bd03-af30869f47f6 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1537 microversion: 2.91 time: 0.186375 Oct 17 13:39:10.259883 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 672/1399] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:39:10 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1537 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:39:10.394516 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0ec0b617-4703-4f96-a17e-91ba60cc60a8 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:10.400708 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1d499f9b-bb69-47a3-9d5f-a4fd053b04f0 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:10.401734 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-1d499f9b-bb69-47a3-9d5f-a4fd053b04f0 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: d78e88b4-522f-4e6e-bcaa-dc259d9b8c89] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:10.403737 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0ec0b617-4703-4f96-a17e-91ba60cc60a8 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 68d9b4cb-0dc2-4809-8715-bdab9be79bd0] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:10.418090 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:39:10.419385 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1d499f9b-bb69-47a3-9d5f-a4fd053b04f0 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:10.420240 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1d499f9b-bb69-47a3-9d5f-a4fd053b04f0 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:10.422329 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1d499f9b-bb69-47a3-9d5f-a4fd053b04f0 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:10.423551 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1d499f9b-bb69-47a3-9d5f-a4fd053b04f0 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:10.424528 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0ec0b617-4703-4f96-a17e-91ba60cc60a8 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:10.425195 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1d499f9b-bb69-47a3-9d5f-a4fd053b04f0 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:10.425864 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0ec0b617-4703-4f96-a17e-91ba60cc60a8 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:10.426603 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1d499f9b-bb69-47a3-9d5f-a4fd053b04f0 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:10.427352 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0ec0b617-4703-4f96-a17e-91ba60cc60a8 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:10.431519 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0ec0b617-4703-4f96-a17e-91ba60cc60a8 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:10.432473 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0ec0b617-4703-4f96-a17e-91ba60cc60a8 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:10.433308 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0ec0b617-4703-4f96-a17e-91ba60cc60a8 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:10.691278 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-1d499f9b-bb69-47a3-9d5f-a4fd053b04f0 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:10.708409 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1d499f9b-bb69-47a3-9d5f-a4fd053b04f0 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/d78e88b4-522f-4e6e-bcaa-dc259d9b8c89" status: 200 len: 1308 microversion: 2.1 time: 0.312110 Oct 17 13:39:10.709013 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 673/1400] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:10 2022] GET /compute/v2.1/servers/d78e88b4-522f-4e6e-bcaa-dc259d9b8c89 => generated 1308 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:39:10.731806 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d90260dd-ff63-417b-92f3-4931d8f9ebe4 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:10.732734 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d90260dd-ff63-417b-92f3-4931d8f9ebe4 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: fd365dc4-44c6-4a00-971e-2699762ab41f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:10.739094 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d90260dd-ff63-417b-92f3-4931d8f9ebe4 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:10.739614 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d90260dd-ff63-417b-92f3-4931d8f9ebe4 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:10.740045 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d90260dd-ff63-417b-92f3-4931d8f9ebe4 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:10.740920 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d90260dd-ff63-417b-92f3-4931d8f9ebe4 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:10.741538 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d90260dd-ff63-417b-92f3-4931d8f9ebe4 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:10.741778 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d90260dd-ff63-417b-92f3-4931d8f9ebe4 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:10.775995 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=100 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:39:10.791737 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0ec0b617-4703-4f96-a17e-91ba60cc60a8 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:10.803024 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0ec0b617-4703-4f96-a17e-91ba60cc60a8 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/68d9b4cb-0dc2-4809-8715-bdab9be79bd0" status: 200 len: 1519 microversion: 2.1 time: 0.413450 Oct 17 13:39:10.807270 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 728/1401] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:10 2022] GET /compute/v2.1/servers/68d9b4cb-0dc2-4809-8715-bdab9be79bd0 => generated 1519 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:10.843770 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-eb238f91-333a-4ef0-b472-483ef60b9d35 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:10.844566 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-eb238f91-333a-4ef0-b472-483ef60b9d35 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 68d9b4cb-0dc2-4809-8715-bdab9be79bd0] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:10.852906 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eb238f91-333a-4ef0-b472-483ef60b9d35 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:10.856130 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eb238f91-333a-4ef0-b472-483ef60b9d35 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:10.856582 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eb238f91-333a-4ef0-b472-483ef60b9d35 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:10.860876 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eb238f91-333a-4ef0-b472-483ef60b9d35 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:10.861538 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eb238f91-333a-4ef0-b472-483ef60b9d35 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:10.862165 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eb238f91-333a-4ef0-b472-483ef60b9d35 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:10.929408 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-eb238f91-333a-4ef0-b472-483ef60b9d35 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 68d9b4cb-0dc2-4809-8715-bdab9be79bd0] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:39:10.968624 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:39:10.986276 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d90260dd-ff63-417b-92f3-4931d8f9ebe4 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:10.995859 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d90260dd-ff63-417b-92f3-4931d8f9ebe4 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f" status: 200 len: 1210 microversion: 2.1 time: 0.269675 Oct 17 13:39:11.017706 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 674/1402] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:10 2022] GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f => generated 1210 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:11.092966 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-87b50655-ee91-4060-8203-ef84f853c81d tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:11.093596 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-87b50655-ee91-4060-8203-ef84f853c81d tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: ab2b571e-376c-41d3-a778-44bedcaa5467] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:11.105985 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-87b50655-ee91-4060-8203-ef84f853c81d tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:11.106481 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-87b50655-ee91-4060-8203-ef84f853c81d tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:11.106921 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-87b50655-ee91-4060-8203-ef84f853c81d tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:11.107663 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-87b50655-ee91-4060-8203-ef84f853c81d tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:11.108118 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-87b50655-ee91-4060-8203-ef84f853c81d tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:11.108540 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-87b50655-ee91-4060-8203-ef84f853c81d tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:11.134513 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-eb238f91-333a-4ef0-b472-483ef60b9d35 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "DELETE /compute/v2.1/servers/68d9b4cb-0dc2-4809-8715-bdab9be79bd0" status: 204 len: 0 microversion: 2.1 time: 0.295006 Oct 17 13:39:11.135598 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 729/1403] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:39:10 2022] DELETE /compute/v2.1/servers/68d9b4cb-0dc2-4809-8715-bdab9be79bd0 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 13:39:11.153828 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-73f207f9-3510-4ad6-8d46-73e17b17fa42 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:11.154466 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-73f207f9-3510-4ad6-8d46-73e17b17fa42 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 68d9b4cb-0dc2-4809-8715-bdab9be79bd0] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:11.169605 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-73f207f9-3510-4ad6-8d46-73e17b17fa42 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:11.170122 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-73f207f9-3510-4ad6-8d46-73e17b17fa42 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:11.170549 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-73f207f9-3510-4ad6-8d46-73e17b17fa42 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:11.171296 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-73f207f9-3510-4ad6-8d46-73e17b17fa42 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:11.171755 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-73f207f9-3510-4ad6-8d46-73e17b17fa42 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:11.172180 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-73f207f9-3510-4ad6-8d46-73e17b17fa42 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:11.348103 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-87b50655-ee91-4060-8203-ef84f853c81d tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:11.362741 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-87b50655-ee91-4060-8203-ef84f853c81d tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467" status: 200 len: 1472 microversion: 2.1 time: 0.275110 Oct 17 13:39:11.363849 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 675/1404] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:11 2022] GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467 => generated 1472 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:11.381873 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e9275e07-445b-4f41-a756-fd53fe1d689c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:11.382491 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e9275e07-445b-4f41-a756-fd53fe1d689c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 16213741-2241-4f55-b7ca-20ab551e5596] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:11.390069 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9275e07-445b-4f41-a756-fd53fe1d689c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:11.390561 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9275e07-445b-4f41-a756-fd53fe1d689c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:11.390985 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9275e07-445b-4f41-a756-fd53fe1d689c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:11.392013 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9275e07-445b-4f41-a756-fd53fe1d689c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:11.392464 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9275e07-445b-4f41-a756-fd53fe1d689c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:11.392977 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9275e07-445b-4f41-a756-fd53fe1d689c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:11.659003 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-73f207f9-3510-4ad6-8d46-73e17b17fa42 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:11.674050 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-73f207f9-3510-4ad6-8d46-73e17b17fa42 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/68d9b4cb-0dc2-4809-8715-bdab9be79bd0" status: 200 len: 1525 microversion: 2.1 time: 0.532006 Oct 17 13:39:11.675038 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 730/1405] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:11 2022] GET /compute/v2.1/servers/68d9b4cb-0dc2-4809-8715-bdab9be79bd0 => generated 1525 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:11.688364 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9f1b294b-bcbb-4a84-8383-99067bcfbcb1 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:11.688998 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9f1b294b-bcbb-4a84-8383-99067bcfbcb1 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:11.709272 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f1b294b-bcbb-4a84-8383-99067bcfbcb1 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:11.709856 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f1b294b-bcbb-4a84-8383-99067bcfbcb1 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:11.710309 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f1b294b-bcbb-4a84-8383-99067bcfbcb1 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:11.711036 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f1b294b-bcbb-4a84-8383-99067bcfbcb1 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:11.711673 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f1b294b-bcbb-4a84-8383-99067bcfbcb1 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:11.712107 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f1b294b-bcbb-4a84-8383-99067bcfbcb1 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:11.715031 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e9275e07-445b-4f41-a756-fd53fe1d689c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:11.729347 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e9275e07-445b-4f41-a756-fd53fe1d689c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:11.735613 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e9275e07-445b-4f41-a756-fd53fe1d689c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:11.739438 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e9275e07-445b-4f41-a756-fd53fe1d689c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596" status: 200 len: 1362 microversion: 2.25 time: 0.374499 Oct 17 13:39:11.747635 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 676/1406] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:39:11 2022] GET /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596 => generated 1362 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:39:11.760339 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2253de6a-c797-413d-bcb9-667a5d34f364 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:11.761340 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2253de6a-c797-413d-bcb9-667a5d34f364 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: d78e88b4-522f-4e6e-bcaa-dc259d9b8c89] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:11.785407 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2253de6a-c797-413d-bcb9-667a5d34f364 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:11.786111 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2253de6a-c797-413d-bcb9-667a5d34f364 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:11.786552 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2253de6a-c797-413d-bcb9-667a5d34f364 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:11.787304 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2253de6a-c797-413d-bcb9-667a5d34f364 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:11.787759 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2253de6a-c797-413d-bcb9-667a5d34f364 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:11.788176 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2253de6a-c797-413d-bcb9-667a5d34f364 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:11.795194 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9f1b294b-bcbb-4a84-8383-99067bcfbcb1 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:11.806508 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9f1b294b-bcbb-4a84-8383-99067bcfbcb1 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:11.808659 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9f1b294b-bcbb-4a84-8383-99067bcfbcb1 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:11.815888 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9f1b294b-bcbb-4a84-8383-99067bcfbcb1 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1537 microversion: 2.91 time: 0.137785 Oct 17 13:39:11.816803 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 731/1407] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:39:11 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1537 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:39:12.026530 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e693d227-2e35-46b3-96a9-3d3e792608f3 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:12.027199 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e693d227-2e35-46b3-96a9-3d3e792608f3 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: fd365dc4-44c6-4a00-971e-2699762ab41f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:12.035954 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e693d227-2e35-46b3-96a9-3d3e792608f3 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:12.036464 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e693d227-2e35-46b3-96a9-3d3e792608f3 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:12.036908 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e693d227-2e35-46b3-96a9-3d3e792608f3 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:12.037628 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e693d227-2e35-46b3-96a9-3d3e792608f3 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:12.038084 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e693d227-2e35-46b3-96a9-3d3e792608f3 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:12.038505 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e693d227-2e35-46b3-96a9-3d3e792608f3 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:12.084849 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2253de6a-c797-413d-bcb9-667a5d34f364 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:12.097971 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2253de6a-c797-413d-bcb9-667a5d34f364 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/d78e88b4-522f-4e6e-bcaa-dc259d9b8c89" status: 200 len: 1308 microversion: 2.1 time: 0.348801 Oct 17 13:39:12.098455 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 677/1408] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:11 2022] GET /compute/v2.1/servers/d78e88b4-522f-4e6e-bcaa-dc259d9b8c89 => generated 1308 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:12.270076 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e693d227-2e35-46b3-96a9-3d3e792608f3 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:12.280618 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e693d227-2e35-46b3-96a9-3d3e792608f3 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f" status: 200 len: 1210 microversion: 2.1 time: 0.259104 Oct 17 13:39:12.294258 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-00a1b07c-eb3e-4ab6-9321-9c2a40dd9549 req-9bc47d1b-afba-4876-8436-60b03a79f40b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d78e88b4-522f-4e6e-bcaa-dc259d9b8c89", "name": "network-vif-plugged", "status": "completed", "tag": "6bcd59a8-7ecc-4515-bd57-70d42b0ae40f"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:12.295856 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 732/1409] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:12 2022] GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f => generated 1210 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:12.309527 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-00a1b07c-eb3e-4ab6-9321-9c2a40dd9549 req-9bc47d1b-afba-4876-8436-60b03a79f40b service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:12.310009 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-00a1b07c-eb3e-4ab6-9321-9c2a40dd9549 req-9bc47d1b-afba-4876-8436-60b03a79f40b service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:12.310438 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-00a1b07c-eb3e-4ab6-9321-9c2a40dd9549 req-9bc47d1b-afba-4876-8436-60b03a79f40b service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:12.325378 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-00a1b07c-eb3e-4ab6-9321-9c2a40dd9549 req-9bc47d1b-afba-4876-8436-60b03a79f40b service nova] Creating event network-vif-plugged:6bcd59a8-7ecc-4515-bd57-70d42b0ae40f for instance d78e88b4-522f-4e6e-bcaa-dc259d9b8c89 on n-h1-854247-14 Oct 17 13:39:12.332863 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-00a1b07c-eb3e-4ab6-9321-9c2a40dd9549 req-9bc47d1b-afba-4876-8436-60b03a79f40b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048660 Oct 17 13:39:12.334264 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 678/1410] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:39:12.389101 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ccc80936-4cfc-44c2-9902-3d0b649c4352 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:12.390055 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ccc80936-4cfc-44c2-9902-3d0b649c4352 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: ab2b571e-376c-41d3-a778-44bedcaa5467] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:12.397496 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ccc80936-4cfc-44c2-9902-3d0b649c4352 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:12.398458 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ccc80936-4cfc-44c2-9902-3d0b649c4352 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:12.398908 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ccc80936-4cfc-44c2-9902-3d0b649c4352 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:12.399772 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ccc80936-4cfc-44c2-9902-3d0b649c4352 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:12.400244 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ccc80936-4cfc-44c2-9902-3d0b649c4352 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:12.400676 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ccc80936-4cfc-44c2-9902-3d0b649c4352 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:12.581249 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ccc80936-4cfc-44c2-9902-3d0b649c4352 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:12.592068 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ccc80936-4cfc-44c2-9902-3d0b649c4352 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467" status: 200 len: 1478 microversion: 2.1 time: 0.209732 Oct 17 13:39:12.604227 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 733/1411] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:12 2022] GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467 => generated 1478 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:12.705415 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b4eacbf5-5ace-4ce5-83d4-cb969afef386 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:12.706295 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b4eacbf5-5ace-4ce5-83d4-cb969afef386 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 68d9b4cb-0dc2-4809-8715-bdab9be79bd0] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:12.719905 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b4eacbf5-5ace-4ce5-83d4-cb969afef386 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:12.720437 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b4eacbf5-5ace-4ce5-83d4-cb969afef386 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:12.720989 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b4eacbf5-5ace-4ce5-83d4-cb969afef386 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:12.721777 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b4eacbf5-5ace-4ce5-83d4-cb969afef386 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:12.722314 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b4eacbf5-5ace-4ce5-83d4-cb969afef386 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:12.722784 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b4eacbf5-5ace-4ce5-83d4-cb969afef386 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:12.777299 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1babdcb6-f6d3-49dd-8ac9-662b0895b2ea tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:12.778202 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1babdcb6-f6d3-49dd-8ac9-662b0895b2ea tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 16213741-2241-4f55-b7ca-20ab551e5596] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:12.797952 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=16 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:39:12.800694 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=26 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:39:12.803481 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1babdcb6-f6d3-49dd-8ac9-662b0895b2ea tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:12.809904 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1babdcb6-f6d3-49dd-8ac9-662b0895b2ea tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:12.810649 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1babdcb6-f6d3-49dd-8ac9-662b0895b2ea tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:12.820345 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1babdcb6-f6d3-49dd-8ac9-662b0895b2ea tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:12.821144 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1babdcb6-f6d3-49dd-8ac9-662b0895b2ea tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:12.822226 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1babdcb6-f6d3-49dd-8ac9-662b0895b2ea tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:13.171770 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b4eacbf5-5ace-4ce5-83d4-cb969afef386 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:13.187841 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b4eacbf5-5ace-4ce5-83d4-cb969afef386 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/68d9b4cb-0dc2-4809-8715-bdab9be79bd0" status: 200 len: 1525 microversion: 2.1 time: 0.490850 Oct 17 13:39:13.189313 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 679/1412] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:12 2022] GET /compute/v2.1/servers/68d9b4cb-0dc2-4809-8715-bdab9be79bd0 => generated 1525 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:13.201741 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1babdcb6-f6d3-49dd-8ac9-662b0895b2ea tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:13.207812 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6cfae133-b388-4af8-9483-adb10c4a5336 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:13.208434 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6cfae133-b388-4af8-9483-adb10c4a5336 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:13.217399 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1babdcb6-f6d3-49dd-8ac9-662b0895b2ea tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:13.219438 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1babdcb6-f6d3-49dd-8ac9-662b0895b2ea tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:13.221451 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1babdcb6-f6d3-49dd-8ac9-662b0895b2ea tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596" status: 200 len: 1558 microversion: 2.25 time: 0.452457 Oct 17 13:39:13.222438 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6cfae133-b388-4af8-9483-adb10c4a5336 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:13.222806 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 734/1413] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:39:12 2022] GET /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596 => generated 1558 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:39:13.223339 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6cfae133-b388-4af8-9483-adb10c4a5336 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:13.223946 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6cfae133-b388-4af8-9483-adb10c4a5336 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:13.224857 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6cfae133-b388-4af8-9483-adb10c4a5336 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:13.225314 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6cfae133-b388-4af8-9483-adb10c4a5336 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:13.225736 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6cfae133-b388-4af8-9483-adb10c4a5336 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:13.300312 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=16 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:39:13.320153 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-819123b4-0abc-4b70-afb7-4528b8d02591 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1129046348", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "e1529a7b-3ab0-4698-a3c2-77381c75da8d"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:13.369104 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6cfae133-b388-4af8-9483-adb10c4a5336 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:13.379981 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6cfae133-b388-4af8-9483-adb10c4a5336 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:13.381238 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6cfae133-b388-4af8-9483-adb10c4a5336 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:13.387043 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6cfae133-b388-4af8-9483-adb10c4a5336 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1537 microversion: 2.91 time: 0.196146 Oct 17 13:39:13.389010 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 680/1414] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:39:13 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1537 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:39:13.415309 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-244a90e9-25f2-472d-b0a0-63b27b167df6 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:13.416218 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-244a90e9-25f2-472d-b0a0-63b27b167df6 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: d78e88b4-522f-4e6e-bcaa-dc259d9b8c89] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:13.422645 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-244a90e9-25f2-472d-b0a0-63b27b167df6 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:13.423321 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-244a90e9-25f2-472d-b0a0-63b27b167df6 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:13.423861 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-244a90e9-25f2-472d-b0a0-63b27b167df6 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:13.424628 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-244a90e9-25f2-472d-b0a0-63b27b167df6 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:13.425138 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-244a90e9-25f2-472d-b0a0-63b27b167df6 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:13.425611 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-244a90e9-25f2-472d-b0a0-63b27b167df6 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:13.449835 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-819123b4-0abc-4b70-afb7-4528b8d02591 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] validate_networks() for [('e1529a7b-3ab0-4698-a3c2-77381c75da8d', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:39:14.041954 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-244a90e9-25f2-472d-b0a0-63b27b167df6 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:14.058463 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-244a90e9-25f2-472d-b0a0-63b27b167df6 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/d78e88b4-522f-4e6e-bcaa-dc259d9b8c89" status: 200 len: 1308 microversion: 2.1 time: 0.653622 Oct 17 13:39:14.069634 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 681/1415] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:13 2022] GET /compute/v2.1/servers/d78e88b4-522f-4e6e-bcaa-dc259d9b8c89 => generated 1308 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:14.074562 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3360e8be-99a7-4dc5-8922-5511c2731adf tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:14.080057 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3360e8be-99a7-4dc5-8922-5511c2731adf tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] [instance: 16213741-2241-4f55-b7ca-20ab551e5596] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:14.099545 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3360e8be-99a7-4dc5-8922-5511c2731adf tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:14.104371 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3360e8be-99a7-4dc5-8922-5511c2731adf tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:14.105051 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3360e8be-99a7-4dc5-8922-5511c2731adf tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:14.106017 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3360e8be-99a7-4dc5-8922-5511c2731adf tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:14.106676 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3360e8be-99a7-4dc5-8922-5511c2731adf tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:14.107352 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3360e8be-99a7-4dc5-8922-5511c2731adf tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:14.422273 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-3360e8be-99a7-4dc5-8922-5511c2731adf tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lazy-loading 'services' on Instance uuid 16213741-2241-4f55-b7ca-20ab551e5596 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:39:14.477273 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3360e8be-99a7-4dc5-8922-5511c2731adf tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596" status: 200 len: 2053 microversion: 2.25 time: 0.409649 Oct 17 13:39:14.484016 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 682/1416] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:39:14 2022] GET /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596 => generated 2053 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:39:14.499823 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-db14e9a3-5a51-420b-8dca-b4fdae71a28c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:14.504334 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-db14e9a3-5a51-420b-8dca-b4fdae71a28c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: fd365dc4-44c6-4a00-971e-2699762ab41f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:14.528347 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-db14e9a3-5a51-420b-8dca-b4fdae71a28c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:14.529355 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-db14e9a3-5a51-420b-8dca-b4fdae71a28c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:14.529969 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-db14e9a3-5a51-420b-8dca-b4fdae71a28c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:14.530910 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-db14e9a3-5a51-420b-8dca-b4fdae71a28c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:14.531481 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-db14e9a3-5a51-420b-8dca-b4fdae71a28c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:14.531910 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-db14e9a3-5a51-420b-8dca-b4fdae71a28c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:14.682872 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-819123b4-0abc-4b70-afb7-4528b8d02591 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:39:14.683419 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-819123b4-0abc-4b70-afb7-4528b8d02591 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:39:14.683795 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-819123b4-0abc-4b70-afb7-4528b8d02591 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:39:14.684184 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-819123b4-0abc-4b70-afb7-4528b8d02591 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:39:14.684586 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-819123b4-0abc-4b70-afb7-4528b8d02591 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:39:14.700908 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-819123b4-0abc-4b70-afb7-4528b8d02591 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:14.712614 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-819123b4-0abc-4b70-afb7-4528b8d02591 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:14.713181 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-819123b4-0abc-4b70-afb7-4528b8d02591 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:14.714023 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-819123b4-0abc-4b70-afb7-4528b8d02591 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:14.714496 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-819123b4-0abc-4b70-afb7-4528b8d02591 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:14.720122 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-819123b4-0abc-4b70-afb7-4528b8d02591 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:14.744203 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-819123b4-0abc-4b70-afb7-4528b8d02591 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Getting quotas for project d4ed14a8051a4b8fb39d56280a2bcb41. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:39:14.745588 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-db14e9a3-5a51-420b-8dca-b4fdae71a28c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:14.751773 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-819123b4-0abc-4b70-afb7-4528b8d02591 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Getting quotas for user 0f5d2462ac744056be55262dacc72de8 and project d4ed14a8051a4b8fb39d56280a2bcb41. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:39:14.754669 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-db14e9a3-5a51-420b-8dca-b4fdae71a28c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f" status: 200 len: 1210 microversion: 2.1 time: 0.268471 Oct 17 13:39:14.755806 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 683/1417] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:14 2022] GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f => generated 1210 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:14.760767 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-344dce12-8fcf-444e-8c9b-68c260c5f6bc tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:14.761378 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-344dce12-8fcf-444e-8c9b-68c260c5f6bc tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: ab2b571e-376c-41d3-a778-44bedcaa5467] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:14.767452 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-344dce12-8fcf-444e-8c9b-68c260c5f6bc tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:14.767711 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-819123b4-0abc-4b70-afb7-4528b8d02591 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:39:14.767933 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-344dce12-8fcf-444e-8c9b-68c260c5f6bc tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:14.768356 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-344dce12-8fcf-444e-8c9b-68c260c5f6bc tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:14.769153 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-344dce12-8fcf-444e-8c9b-68c260c5f6bc tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:14.769718 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-344dce12-8fcf-444e-8c9b-68c260c5f6bc tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:14.770120 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-344dce12-8fcf-444e-8c9b-68c260c5f6bc tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:14.770802 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-819123b4-0abc-4b70-afb7-4528b8d02591 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] [instance: 5661197d-b679-48bc-bf2c-11e7b4f962bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:39:14.824536 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-819123b4-0abc-4b70-afb7-4528b8d02591 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.600353 Oct 17 13:39:14.825210 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 735/1418] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:39:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:39:14.835348 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-44665384-47e9-4167-9b5a-f265d3ec7780 req-29a1594f-213d-4808-9ab3-567e3c95bcec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68d9b4cb-0dc2-4809-8715-bdab9be79bd0", "name": "network-vif-deleted", "tag": "5d084305-dc3f-46d2-8407-4164b5cf23b7"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:14.851521 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-44665384-47e9-4167-9b5a-f265d3ec7780 req-29a1594f-213d-4808-9ab3-567e3c95bcec service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:14.852441 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-44665384-47e9-4167-9b5a-f265d3ec7780 req-29a1594f-213d-4808-9ab3-567e3c95bcec service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:14.853044 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-44665384-47e9-4167-9b5a-f265d3ec7780 req-29a1594f-213d-4808-9ab3-567e3c95bcec service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:14.885350 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-44665384-47e9-4167-9b5a-f265d3ec7780 req-29a1594f-213d-4808-9ab3-567e3c95bcec service nova] Creating event network-vif-deleted:5d084305-dc3f-46d2-8407-4164b5cf23b7 for instance 68d9b4cb-0dc2-4809-8715-bdab9be79bd0 on n-h1-854247-14 Oct 17 13:39:14.891135 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-44665384-47e9-4167-9b5a-f265d3ec7780 req-29a1594f-213d-4808-9ab3-567e3c95bcec service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064202 Oct 17 13:39:14.897978 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 736/1419] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:39:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:39:14.910982 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4afd3c59-8c64-4f16-bf5a-d5bc169ee692 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:14.912622 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4afd3c59-8c64-4f16-bf5a-d5bc169ee692 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 68d9b4cb-0dc2-4809-8715-bdab9be79bd0] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:14.923705 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4afd3c59-8c64-4f16-bf5a-d5bc169ee692 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:14.924498 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4afd3c59-8c64-4f16-bf5a-d5bc169ee692 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:14.925122 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4afd3c59-8c64-4f16-bf5a-d5bc169ee692 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:14.925848 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4afd3c59-8c64-4f16-bf5a-d5bc169ee692 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:14.926300 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4afd3c59-8c64-4f16-bf5a-d5bc169ee692 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:14.926834 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4afd3c59-8c64-4f16-bf5a-d5bc169ee692 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:14.988321 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-344dce12-8fcf-444e-8c9b-68c260c5f6bc tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:14.998647 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-344dce12-8fcf-444e-8c9b-68c260c5f6bc tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467" status: 200 len: 1478 microversion: 2.1 time: 0.241752 Oct 17 13:39:14.999261 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 684/1420] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:14 2022] GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467 => generated 1478 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:15.003754 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4afd3c59-8c64-4f16-bf5a-d5bc169ee692 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:15.004790 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4afd3c59-8c64-4f16-bf5a-d5bc169ee692 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:15.005410 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4afd3c59-8c64-4f16-bf5a-d5bc169ee692 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:15.006041 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-4afd3c59-8c64-4f16-bf5a-d5bc169ee692 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lazy-loading 'fault' on Instance uuid 68d9b4cb-0dc2-4809-8715-bdab9be79bd0 {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:39:15.019911 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a7b36a1f-5e9f-4ecb-88f6-b48a5b08aa23 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:15.020595 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a7b36a1f-5e9f-4ecb-88f6-b48a5b08aa23 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:15.034519 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a7b36a1f-5e9f-4ecb-88f6-b48a5b08aa23 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:15.035803 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a7b36a1f-5e9f-4ecb-88f6-b48a5b08aa23 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:15.036267 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a7b36a1f-5e9f-4ecb-88f6-b48a5b08aa23 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:15.036916 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a7b36a1f-5e9f-4ecb-88f6-b48a5b08aa23 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:15.037375 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a7b36a1f-5e9f-4ecb-88f6-b48a5b08aa23 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:15.044450 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a7b36a1f-5e9f-4ecb-88f6-b48a5b08aa23 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:15.061522 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4afd3c59-8c64-4f16-bf5a-d5bc169ee692 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcbd60cab4174e8db26e28f015795e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7507d1dd2d345ca9b59dcaa7806b56e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:15.073505 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4afd3c59-8c64-4f16-bf5a-d5bc169ee692 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/68d9b4cb-0dc2-4809-8715-bdab9be79bd0" status: 200 len: 1313 microversion: 2.1 time: 0.173992 Oct 17 13:39:15.083191 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 737/1421] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:14 2022] GET /compute/v2.1/servers/68d9b4cb-0dc2-4809-8715-bdab9be79bd0 => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:15.103683 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-05cca080-cd41-4cb5-af0f-c556e719165c tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:15.103683 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-05cca080-cd41-4cb5-af0f-c556e719165c tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] [instance: 16213741-2241-4f55-b7ca-20ab551e5596] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:15.117138 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-05cca080-cd41-4cb5-af0f-c556e719165c tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:15.118109 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-05cca080-cd41-4cb5-af0f-c556e719165c tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:15.118770 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-05cca080-cd41-4cb5-af0f-c556e719165c tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:15.130710 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-05cca080-cd41-4cb5-af0f-c556e719165c tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:15.131674 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-05cca080-cd41-4cb5-af0f-c556e719165c tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:15.134913 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-05cca080-cd41-4cb5-af0f-c556e719165c tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:15.157203 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a7b36a1f-5e9f-4ecb-88f6-b48a5b08aa23 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:15.168437 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a7b36a1f-5e9f-4ecb-88f6-b48a5b08aa23 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:15.173494 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a7b36a1f-5e9f-4ecb-88f6-b48a5b08aa23 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:15.202716 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a7b36a1f-5e9f-4ecb-88f6-b48a5b08aa23 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1537 microversion: 2.91 time: 0.186563 Oct 17 13:39:15.204253 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 685/1422] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:39:14 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1537 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:39:15.217704 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0f4c41fd-2d38-4119-acdd-84585864ac2b tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:15.219996 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0f4c41fd-2d38-4119-acdd-84585864ac2b tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] [instance: 5661197d-b679-48bc-bf2c-11e7b4f962bb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:15.420861 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0f4c41fd-2d38-4119-acdd-84585864ac2b tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d2462ac744056be55262dacc72de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ed14a8051a4b8fb39d56280a2bcb41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:15.435252 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0f4c41fd-2d38-4119-acdd-84585864ac2b tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] 10.222.0.79 "GET /compute/v2.1/servers/5661197d-b679-48bc-bf2c-11e7b4f962bb" status: 200 len: 1225 microversion: 2.1 time: 0.227942 Oct 17 13:39:15.437516 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 686/1423] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:15 2022] GET /compute/v2.1/servers/5661197d-b679-48bc-bf2c-11e7b4f962bb => generated 1225 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:15.452229 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0605ee19-9e9f-4284-b418-a76c41c00a8d tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:15.453031 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0605ee19-9e9f-4284-b418-a76c41c00a8d tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: d78e88b4-522f-4e6e-bcaa-dc259d9b8c89] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:15.460240 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0605ee19-9e9f-4284-b418-a76c41c00a8d tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:15.460965 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0605ee19-9e9f-4284-b418-a76c41c00a8d tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:15.461699 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0605ee19-9e9f-4284-b418-a76c41c00a8d tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:15.462710 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0605ee19-9e9f-4284-b418-a76c41c00a8d tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:15.463363 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0605ee19-9e9f-4284-b418-a76c41c00a8d tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:15.463975 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0605ee19-9e9f-4284-b418-a76c41c00a8d tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:15.532982 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-05cca080-cd41-4cb5-af0f-c556e719165c tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lazy-loading 'services' on Instance uuid 16213741-2241-4f55-b7ca-20ab551e5596 {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:39:15.554290 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-05cca080-cd41-4cb5-af0f-c556e719165c tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596" status: 200 len: 2053 microversion: 2.25 time: 0.477452 Oct 17 13:39:15.572178 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 738/1424] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:39:15 2022] GET /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596 => generated 2053 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:39:15.585740 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-73fe9e2b-1c74-44b8-8253-582b176b2fe6 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:15.589819 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-73fe9e2b-1c74-44b8-8253-582b176b2fe6 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:15.590304 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-73fe9e2b-1c74-44b8-8253-582b176b2fe6 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:15.590718 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-73fe9e2b-1c74-44b8-8253-582b176b2fe6 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:15.594611 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-73fe9e2b-1c74-44b8-8253-582b176b2fe6 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:15.595117 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-73fe9e2b-1c74-44b8-8253-582b176b2fe6 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:15.595621 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-73fe9e2b-1c74-44b8-8253-582b176b2fe6 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:15.623955 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-73fe9e2b-1c74-44b8-8253-582b176b2fe6 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.044621 Oct 17 13:39:15.631907 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 739/1425] 10.222.0.79 () {60 vars in 1217 bytes} [Mon Oct 17 13:39:15 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:39:15.645338 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c0cf8339-be85-48ed-85fa-342a9892bfa4 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:15.645928 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c0cf8339-be85-48ed-85fa-342a9892bfa4 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] [instance: 16213741-2241-4f55-b7ca-20ab551e5596] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:15.656273 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c0cf8339-be85-48ed-85fa-342a9892bfa4 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:15.659271 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c0cf8339-be85-48ed-85fa-342a9892bfa4 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:15.659789 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c0cf8339-be85-48ed-85fa-342a9892bfa4 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:15.660532 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c0cf8339-be85-48ed-85fa-342a9892bfa4 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:15.660991 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c0cf8339-be85-48ed-85fa-342a9892bfa4 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:15.663372 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c0cf8339-be85-48ed-85fa-342a9892bfa4 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:15.713797 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0605ee19-9e9f-4284-b418-a76c41c00a8d tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:15.729206 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0605ee19-9e9f-4284-b418-a76c41c00a8d tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/d78e88b4-522f-4e6e-bcaa-dc259d9b8c89" status: 200 len: 1488 microversion: 2.1 time: 0.290441 Oct 17 13:39:15.730321 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 687/1426] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:15 2022] GET /compute/v2.1/servers/d78e88b4-522f-4e6e-bcaa-dc259d9b8c89 => generated 1488 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:15.761405 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6310329f-d45a-440f-9a49-0d6fca3d395c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:15.762137 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6310329f-d45a-440f-9a49-0d6fca3d395c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: d78e88b4-522f-4e6e-bcaa-dc259d9b8c89] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:15.775259 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6310329f-d45a-440f-9a49-0d6fca3d395c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:15.778070 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6310329f-d45a-440f-9a49-0d6fca3d395c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:15.778518 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6310329f-d45a-440f-9a49-0d6fca3d395c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:15.781267 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6310329f-d45a-440f-9a49-0d6fca3d395c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:15.782877 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6310329f-d45a-440f-9a49-0d6fca3d395c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:15.785183 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6310329f-d45a-440f-9a49-0d6fca3d395c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:15.799524 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c0cf8339-be85-48ed-85fa-342a9892bfa4 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596/action" status: 202 len: 0 microversion: 2.25 time: 0.163364 Oct 17 13:39:15.800827 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 740/1427] 10.222.0.79 () {62 vars in 1319 bytes} [Mon Oct 17 13:39:15 2022] POST /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:39:15.813458 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e3aed716-0367-43ec-9b7f-343e20bb2bd4 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:15.815120 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e3aed716-0367-43ec-9b7f-343e20bb2bd4 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: fd365dc4-44c6-4a00-971e-2699762ab41f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:15.823674 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e3aed716-0367-43ec-9b7f-343e20bb2bd4 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:15.824701 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e3aed716-0367-43ec-9b7f-343e20bb2bd4 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:15.825570 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e3aed716-0367-43ec-9b7f-343e20bb2bd4 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:15.826954 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e3aed716-0367-43ec-9b7f-343e20bb2bd4 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:15.827828 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e3aed716-0367-43ec-9b7f-343e20bb2bd4 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:15.828741 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e3aed716-0367-43ec-9b7f-343e20bb2bd4 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:15.875285 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-6310329f-d45a-440f-9a49-0d6fca3d395c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lazy-loading 'flavor' on Instance uuid d78e88b4-522f-4e6e-bcaa-dc259d9b8c89 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:39:16.063569 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6310329f-d45a-440f-9a49-0d6fca3d395c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "POST /compute/v2.1/servers/d78e88b4-522f-4e6e-bcaa-dc259d9b8c89/action" status: 202 len: 0 microversion: 2.1 time: 0.306935 Oct 17 13:39:16.064221 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 688/1428] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:39:15 2022] POST /compute/v2.1/servers/d78e88b4-522f-4e6e-bcaa-dc259d9b8c89/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:39:16.078066 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-bec55619-8809-4a2c-8213-c264e03f2f94 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:16.078776 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-bec55619-8809-4a2c-8213-c264e03f2f94 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] [instance: 16213741-2241-4f55-b7ca-20ab551e5596] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:16.110988 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bec55619-8809-4a2c-8213-c264e03f2f94 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:16.111435 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bec55619-8809-4a2c-8213-c264e03f2f94 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:16.111865 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bec55619-8809-4a2c-8213-c264e03f2f94 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:16.112570 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bec55619-8809-4a2c-8213-c264e03f2f94 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:16.113015 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bec55619-8809-4a2c-8213-c264e03f2f94 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:16.113427 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bec55619-8809-4a2c-8213-c264e03f2f94 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:16.122626 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e3aed716-0367-43ec-9b7f-343e20bb2bd4 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:16.132571 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e3aed716-0367-43ec-9b7f-343e20bb2bd4 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f" status: 200 len: 1210 microversion: 2.1 time: 0.326188 Oct 17 13:39:16.132571 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 741/1429] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:15 2022] GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f => generated 1210 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:16.148289 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-e075b53b-2255-49a1-a3c6-a9ecc253b396 req-e31e47cf-09e6-4898-9487-6c5464449cc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab2b571e-376c-41d3-a778-44bedcaa5467", "name": "network-vif-plugged", "status": "completed", "tag": "7ff3914f-4ed0-4fef-bc81-8a07b3c2c97b"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:16.165411 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-e075b53b-2255-49a1-a3c6-a9ecc253b396 req-e31e47cf-09e6-4898-9487-6c5464449cc1 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:16.166158 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-e075b53b-2255-49a1-a3c6-a9ecc253b396 req-e31e47cf-09e6-4898-9487-6c5464449cc1 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:16.166840 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-e075b53b-2255-49a1-a3c6-a9ecc253b396 req-e31e47cf-09e6-4898-9487-6c5464449cc1 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:16.181243 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-e075b53b-2255-49a1-a3c6-a9ecc253b396 req-e31e47cf-09e6-4898-9487-6c5464449cc1 service nova] Creating event network-vif-plugged:7ff3914f-4ed0-4fef-bc81-8a07b3c2c97b for instance ab2b571e-376c-41d3-a778-44bedcaa5467 on n-h2-854247-14 Oct 17 13:39:16.186601 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-e075b53b-2255-49a1-a3c6-a9ecc253b396 req-e31e47cf-09e6-4898-9487-6c5464449cc1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047678 Oct 17 13:39:16.189307 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 742/1430] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:39:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:39:16.225966 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-adfb656e-4dbf-47f8-8d18-d7665dd7a2dd tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:16.226596 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-adfb656e-4dbf-47f8-8d18-d7665dd7a2dd tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: ab2b571e-376c-41d3-a778-44bedcaa5467] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:16.239743 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-adfb656e-4dbf-47f8-8d18-d7665dd7a2dd tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:16.240252 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-adfb656e-4dbf-47f8-8d18-d7665dd7a2dd tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:16.240677 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-adfb656e-4dbf-47f8-8d18-d7665dd7a2dd tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:16.241394 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-adfb656e-4dbf-47f8-8d18-d7665dd7a2dd tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:16.241839 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-adfb656e-4dbf-47f8-8d18-d7665dd7a2dd tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:16.242254 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-adfb656e-4dbf-47f8-8d18-d7665dd7a2dd tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:16.660555 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-bec55619-8809-4a2c-8213-c264e03f2f94 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lazy-loading 'services' on Instance uuid 16213741-2241-4f55-b7ca-20ab551e5596 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:39:16.695152 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-adfb656e-4dbf-47f8-8d18-d7665dd7a2dd tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:16.709619 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-adfb656e-4dbf-47f8-8d18-d7665dd7a2dd tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467" status: 200 len: 1478 microversion: 2.1 time: 0.497732 Oct 17 13:39:16.712058 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 743/1431] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:16 2022] GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467 => generated 1478 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:16.715804 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-bec55619-8809-4a2c-8213-c264e03f2f94 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596" status: 200 len: 2038 microversion: 2.25 time: 0.649134 Oct 17 13:39:16.716842 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 689/1432] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:39:16 2022] GET /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596 => generated 2038 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:39:16.735192 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9596a9da-15c7-405a-9fc0-2a8f32f0456a tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:16.735192 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9596a9da-15c7-405a-9fc0-2a8f32f0456a tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: d78e88b4-522f-4e6e-bcaa-dc259d9b8c89] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:16.737768 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9596a9da-15c7-405a-9fc0-2a8f32f0456a tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:16.738848 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-499ff391-1699-42c8-b480-26f6898f8b13 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:16.739773 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-499ff391-1699-42c8-b480-26f6898f8b13 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 68d9b4cb-0dc2-4809-8715-bdab9be79bd0] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:16.747239 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9596a9da-15c7-405a-9fc0-2a8f32f0456a tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:16.747239 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9596a9da-15c7-405a-9fc0-2a8f32f0456a tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:16.747239 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9596a9da-15c7-405a-9fc0-2a8f32f0456a tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:16.747239 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9596a9da-15c7-405a-9fc0-2a8f32f0456a tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:16.747674 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9596a9da-15c7-405a-9fc0-2a8f32f0456a tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:16.759206 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-499ff391-1699-42c8-b480-26f6898f8b13 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:16.759703 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-499ff391-1699-42c8-b480-26f6898f8b13 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:16.760131 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-499ff391-1699-42c8-b480-26f6898f8b13 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:16.760847 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-499ff391-1699-42c8-b480-26f6898f8b13 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:16.761301 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-499ff391-1699-42c8-b480-26f6898f8b13 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:16.761722 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-499ff391-1699-42c8-b480-26f6898f8b13 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:16.766242 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:39:16.799538 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-499ff391-1699-42c8-b480-26f6898f8b13 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] HTTP exception thrown: Instance 68d9b4cb-0dc2-4809-8715-bdab9be79bd0 could not be found. Oct 17 13:39:16.803731 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-499ff391-1699-42c8-b480-26f6898f8b13 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Request method failure captured: Oct 17 13:39:16.803731 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/68d9b4cb-0dc2-4809-8715-bdab9be79bd0 HTTP/1.1 Oct 17 13:39:16.803731 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:39:16.803731 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:39:16.803731 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:39:16.803731 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:39:16.803731 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:39:16.803731 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:39:16.803731 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:39:16.803731 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:39:16.803731 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVp-7IxfFP3OCFXwoptz1mkTvVFP-q1mVdb9duvFJBSFB2Milojb0bt4JEkHbyx5bSK8AUBQstoN0fpOUoelRV9Ur5eKS-T70viEjT2k_9W3ZeERt1Gvx_VBqcxVNMvlXoLi-KthVHD7so8JMwaOern88ECZl5tX1TwIw6qcARP1TSo Oct 17 13:39:16.803731 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:39:16.803731 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:39:16.803731 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:39:16.803731 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:39:16.803731 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:39:16.803731 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:39:16.803731 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: c7507d1dd2d345ca9b59dcaa7806b56e Oct 17 13:39:16.803731 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2045461887 Oct 17 13:39:16.803731 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:39:16.803731 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:39:16.805461 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c7507d1dd2d345ca9b59dcaa7806b56e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c7507d1dd2d345ca9b59dcaa7806b56e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c7507d1dd2d345ca9b59dcaa7806b56e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c7507d1dd2d345ca9b59dcaa7806b56e", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:39:16.805461 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2045461887 Oct 17 13:39:16.805461 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: c7507d1dd2d345ca9b59dcaa7806b56e Oct 17 13:39:16.805461 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2045461887 Oct 17 13:39:16.805461 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ImagesOneServerNegativeTestJSON-2045461887-project Oct 17 13:39:16.805461 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:39:16.805461 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:39:16.805461 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: dcbd60cab4174e8db26e28f015795e1f Oct 17 13:39:16.805461 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2045461887-project Oct 17 13:39:16.805461 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:39:16.805461 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 68d9b4cb-0dc2-4809-8715-bdab9be79bd0 could not be found. Oct 17 13:39:16.805461 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '68d9b4cb-0dc2-4809-8715-bdab9be79bd0'} Oct 17 13:39:16.806257 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:39:16.806257 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:16.806257 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:39:16.806257 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:39:16.806257 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:39:16.806257 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:39:16.806257 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:39:16.806257 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:39:16.806257 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:39:16.806257 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:39:16.806257 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68d9b4cb-0dc2-4809-8715-bdab9be79bd0 could not be found. Oct 17 13:39:16.806257 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:39:16.806257 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:39:16.806257 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:39:16.806257 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:16.806257 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:39:16.806257 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:39:16.806257 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:39:16.806257 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:39:16.806257 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:39:16.807736 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:39:16.807736 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:39:16.807736 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:39:16.807736 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:39:16.807736 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:39:16.807736 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:39:16.807736 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:39:16.807736 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68d9b4cb-0dc2-4809-8715-bdab9be79bd0 could not be found. Oct 17 13:39:16.807736 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:39:16.807736 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:39:16.807736 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:39:16.807736 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:16.807736 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:39:16.807736 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:39:16.807736 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:39:16.807736 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:39:16.807736 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68d9b4cb-0dc2-4809-8715-bdab9be79bd0 could not be found. Oct 17 13:39:16.807736 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:39:16.809296 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-499ff391-1699-42c8-b480-26f6898f8b13 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Returning 404 to user: Instance 68d9b4cb-0dc2-4809-8715-bdab9be79bd0 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:39:16.810014 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-499ff391-1699-42c8-b480-26f6898f8b13 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/68d9b4cb-0dc2-4809-8715-bdab9be79bd0" status: 404 len: 111 microversion: 2.1 time: 0.090991 Oct 17 13:39:16.815401 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 690/1433] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:16 2022] GET /compute/v2.1/servers/68d9b4cb-0dc2-4809-8715-bdab9be79bd0 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:39:16.822013 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-971356a2-6334-4609-a9f6-368cffc8df85 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:16.822937 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-971356a2-6334-4609-a9f6-368cffc8df85 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:16.830941 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-971356a2-6334-4609-a9f6-368cffc8df85 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:16.831715 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-971356a2-6334-4609-a9f6-368cffc8df85 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:16.832341 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-971356a2-6334-4609-a9f6-368cffc8df85 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:16.833749 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-971356a2-6334-4609-a9f6-368cffc8df85 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:16.834391 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-971356a2-6334-4609-a9f6-368cffc8df85 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:16.835026 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-971356a2-6334-4609-a9f6-368cffc8df85 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:16.982194 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-971356a2-6334-4609-a9f6-368cffc8df85 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:17.015076 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-971356a2-6334-4609-a9f6-368cffc8df85 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:17.021292 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-971356a2-6334-4609-a9f6-368cffc8df85 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:17.037575 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-971356a2-6334-4609-a9f6-368cffc8df85 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1537 microversion: 2.91 time: 0.220774 Oct 17 13:39:17.044216 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 691/1434] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:39:16 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1537 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:39:17.059750 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c1ec9496-af27-431c-9a7b-66643a829310 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:17.060821 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c1ec9496-af27-431c-9a7b-66643a829310 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] [instance: 5661197d-b679-48bc-bf2c-11e7b4f962bb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:17.074889 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1ec9496-af27-431c-9a7b-66643a829310 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:17.075777 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1ec9496-af27-431c-9a7b-66643a829310 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:17.077650 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1ec9496-af27-431c-9a7b-66643a829310 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:17.080224 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1ec9496-af27-431c-9a7b-66643a829310 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:17.084595 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1ec9496-af27-431c-9a7b-66643a829310 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:17.085624 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1ec9496-af27-431c-9a7b-66643a829310 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:17.097824 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9596a9da-15c7-405a-9fc0-2a8f32f0456a tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:17.114453 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9596a9da-15c7-405a-9fc0-2a8f32f0456a tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/d78e88b4-522f-4e6e-bcaa-dc259d9b8c89" status: 200 len: 1479 microversion: 2.1 time: 0.399753 Oct 17 13:39:17.115540 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 744/1435] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:16 2022] GET /compute/v2.1/servers/d78e88b4-522f-4e6e-bcaa-dc259d9b8c89 => generated 1479 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:17.127039 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-046888f2-ccee-4c9d-b1a5-47d035e643b0 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854247-14", "block_migration": "auto"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:17.130743 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-046888f2-ccee-4c9d-b1a5-47d035e643b0 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] [instance: 16213741-2241-4f55-b7ca-20ab551e5596] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:17.147086 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-046888f2-ccee-4c9d-b1a5-47d035e643b0 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:17.147600 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-046888f2-ccee-4c9d-b1a5-47d035e643b0 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:17.149028 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-046888f2-ccee-4c9d-b1a5-47d035e643b0 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:17.150356 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-046888f2-ccee-4c9d-b1a5-47d035e643b0 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:17.150982 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-046888f2-ccee-4c9d-b1a5-47d035e643b0 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:17.151609 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-046888f2-ccee-4c9d-b1a5-47d035e643b0 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:17.197505 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-046888f2-ccee-4c9d-b1a5-47d035e643b0 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lazy-loading 'flavor' on Instance uuid 16213741-2241-4f55-b7ca-20ab551e5596 {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:39:17.213348 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c1ec9496-af27-431c-9a7b-66643a829310 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d2462ac744056be55262dacc72de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ed14a8051a4b8fb39d56280a2bcb41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:17.221754 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-046888f2-ccee-4c9d-b1a5-47d035e643b0 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] [instance: 16213741-2241-4f55-b7ca-20ab551e5596] Going to try to live migrate instance to n-h2-854247-14 {{(pid=127017) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 17 13:39:17.222209 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c1ec9496-af27-431c-9a7b-66643a829310 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] 10.222.0.79 "GET /compute/v2.1/servers/5661197d-b679-48bc-bf2c-11e7b4f962bb" status: 200 len: 1285 microversion: 2.1 time: 0.175911 Oct 17 13:39:17.226814 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:39:17.233524 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 692/1436] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:17 2022] GET /compute/v2.1/servers/5661197d-b679-48bc-bf2c-11e7b4f962bb => generated 1285 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:17.250164 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a099010c-9bd9-4a41-a903-a5e592947ad8 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '.version_select at 0x7f7cd555b4c0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:17.340625 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-a099010c-9bd9-4a41-a903-a5e592947ad8 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] HTTP exception thrown: Image not found. Oct 17 13:39:17.346413 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a099010c-9bd9-4a41-a903-a5e592947ad8 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Request method failure captured: Oct 17 13:39:17.346413 n-d-854247-14 devstack@n-api.service[127016]: request: DELETE /compute/v2.1/images/d67f13de-2fb7-40a9-a64c-1610a34e5fa4 HTTP/1.1 Oct 17 13:39:17.346413 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:39:17.346413 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:39:17.346413 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:39:17.346413 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:39:17.346413 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:39:17.346413 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:39:17.346413 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:39:17.346413 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:39:17.346413 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVp-7IxfFP3OCFXwoptz1mkTvVFP-q1mVdb9duvFJBSFB2Milojb0bt4JEkHbyx5bSK8AUBQstoN0fpOUoelRV9Ur5eKS-T70viEjT2k_9W3ZeERt1Gvx_VBqcxVNMvlXoLi-KthVHD7so8JMwaOern88ECZl5tX1TwIw6qcARP1TSo Oct 17 13:39:17.346413 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:39:17.346413 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:39:17.346413 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:39:17.346413 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:39:17.346413 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:39:17.346413 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:39:17.346413 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: c7507d1dd2d345ca9b59dcaa7806b56e Oct 17 13:39:17.346413 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2045461887 Oct 17 13:39:17.346413 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:39:17.346413 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:39:17.348232 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c7507d1dd2d345ca9b59dcaa7806b56e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c7507d1dd2d345ca9b59dcaa7806b56e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c7507d1dd2d345ca9b59dcaa7806b56e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c7507d1dd2d345ca9b59dcaa7806b56e", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:39:17.348232 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2045461887 Oct 17 13:39:17.348232 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: c7507d1dd2d345ca9b59dcaa7806b56e Oct 17 13:39:17.348232 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2045461887 Oct 17 13:39:17.348232 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ImagesOneServerNegativeTestJSON-2045461887-project Oct 17 13:39:17.348232 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:39:17.348232 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:39:17.348232 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: dcbd60cab4174e8db26e28f015795e1f Oct 17 13:39:17.348232 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2045461887-project Oct 17 13:39:17.348232 n-d-854247-14 devstack@n-api.service[127016]: method: Oct 17 13:39:17.348232 n-d-854247-14 devstack@n-api.service[127016]: exception: Image not found. Oct 17 13:39:17.348232 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'd67f13de-2fb7-40a9-a64c-1610a34e5fa4'} Oct 17 13:39:17.348232 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:39:17.349255 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:17.349255 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 17 13:39:17.349255 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 17 13:39:17.349255 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:39:17.349255 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:39:17.349255 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:39:17.349255 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:39:17.349255 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 17 13:39:17.349255 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 17 13:39:17.349255 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 17 13:39:17.349255 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 17 13:39:17.349255 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:39:17.349255 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:39:17.349255 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:39:17.349255 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:39:17.349255 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image d67f13de-2fb7-40a9-a64c-1610a34e5fa4 to delete Oct 17 13:39:17.349255 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:39:17.349255 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:39:17.349255 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:39:17.350956 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:17.350956 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 17 13:39:17.350956 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 17 13:39:17.350956 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 17 13:39:17.350956 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 17 13:39:17.350956 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 17 13:39:17.350956 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 17 13:39:17.350956 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d67f13de-2fb7-40a9-a64c-1610a34e5fa4 could not be found. Oct 17 13:39:17.350956 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:39:17.350956 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:39:17.350956 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:39:17.350956 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:17.350956 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:39:17.350956 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:39:17.350956 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:39:17.350956 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:39:17.350956 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:39:17.350956 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:39:17.350956 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:39:17.350956 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:39:17.352883 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 17 13:39:17.352883 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 13:39:17.352883 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 13:39:17.352883 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:39:17.352883 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:39:17.352883 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:39:17.352883 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:17.352883 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:39:17.352883 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:39:17.352883 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:39:17.352883 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:39:17.352883 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 13:39:17.352883 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:39:17.352883 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a099010c-9bd9-4a41-a903-a5e592947ad8 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Returning 404 to user: Image not found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:39:17.352883 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a099010c-9bd9-4a41-a903-a5e592947ad8 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "DELETE /compute/v2.1/images/d67f13de-2fb7-40a9-a64c-1610a34e5fa4" status: 404 len: 62 microversion: 2.1 time: 0.113804 Oct 17 13:39:17.354050 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 693/1437] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:17 2022] DELETE /compute/v2.1/images/d67f13de-2fb7-40a9-a64c-1610a34e5fa4 => generated 62 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:39:17.358094 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a5f7207f-b6da-42c1-8a5d-8b6c3b03b11e tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1858289228"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:17.362133 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a5f7207f-b6da-42c1-8a5d-8b6c3b03b11e tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: d78e88b4-522f-4e6e-bcaa-dc259d9b8c89] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:17.373057 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a5f7207f-b6da-42c1-8a5d-8b6c3b03b11e tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:17.373178 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a5f7207f-b6da-42c1-8a5d-8b6c3b03b11e tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:17.373629 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a5f7207f-b6da-42c1-8a5d-8b6c3b03b11e tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:17.374356 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a5f7207f-b6da-42c1-8a5d-8b6c3b03b11e tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:17.374809 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a5f7207f-b6da-42c1-8a5d-8b6c3b03b11e tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:17.375558 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a5f7207f-b6da-42c1-8a5d-8b6c3b03b11e tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:17.631499 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a5f7207f-b6da-42c1-8a5d-8b6c3b03b11e tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "POST /compute/v2.1/servers/d78e88b4-522f-4e6e-bcaa-dc259d9b8c89/action" status: 202 len: 0 microversion: 2.1 time: 0.280242 Oct 17 13:39:17.638760 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 694/1438] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:39:17 2022] POST /compute/v2.1/servers/d78e88b4-522f-4e6e-bcaa-dc259d9b8c89/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 17 13:39:17.639130 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7c2961de-b647-40be-bb2e-dd3d8750567c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:17.639868 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7c2961de-b647-40be-bb2e-dd3d8750567c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: fd365dc4-44c6-4a00-971e-2699762ab41f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:17.646911 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7c2961de-b647-40be-bb2e-dd3d8750567c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:17.647710 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7c2961de-b647-40be-bb2e-dd3d8750567c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:17.648433 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7c2961de-b647-40be-bb2e-dd3d8750567c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:17.650800 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7c2961de-b647-40be-bb2e-dd3d8750567c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:17.651472 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7c2961de-b647-40be-bb2e-dd3d8750567c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:17.651916 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7c2961de-b647-40be-bb2e-dd3d8750567c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:17.807478 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7c2961de-b647-40be-bb2e-dd3d8750567c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:17.816958 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7c2961de-b647-40be-bb2e-dd3d8750567c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f" status: 200 len: 1198 microversion: 2.1 time: 0.183098 Oct 17 13:39:17.832335 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 695/1439] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:17 2022] GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f => generated 1198 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:17.832335 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ab2401be-1695-4846-bc50-a6bce118970d tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:17.832335 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ab2401be-1695-4846-bc50-a6bce118970d tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 298b0f19-0a0c-4304-bb8b-4bd26cce2d9d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:17.832335 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ab2401be-1695-4846-bc50-a6bce118970d tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:17.832859 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ab2401be-1695-4846-bc50-a6bce118970d tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:17.832859 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ab2401be-1695-4846-bc50-a6bce118970d tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:17.832859 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ab2401be-1695-4846-bc50-a6bce118970d tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:17.832859 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ab2401be-1695-4846-bc50-a6bce118970d tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:17.833206 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ab2401be-1695-4846-bc50-a6bce118970d tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:17.849755 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-ab2401be-1695-4846-bc50-a6bce118970d tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] HTTP exception thrown: Instance 298b0f19-0a0c-4304-bb8b-4bd26cce2d9d could not be found. Oct 17 13:39:17.851913 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ab2401be-1695-4846-bc50-a6bce118970d tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Request method failure captured: Oct 17 13:39:17.851913 n-d-854247-14 devstack@n-api.service[127016]: request: DELETE /compute/v2.1/servers/298b0f19-0a0c-4304-bb8b-4bd26cce2d9d HTTP/1.1 Oct 17 13:39:17.851913 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:39:17.851913 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:39:17.851913 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:39:17.851913 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:39:17.851913 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:39:17.851913 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:39:17.851913 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:39:17.851913 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:39:17.851913 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVp-7IxfFP3OCFXwoptz1mkTvVFP-q1mVdb9duvFJBSFB2Milojb0bt4JEkHbyx5bSK8AUBQstoN0fpOUoelRV9Ur5eKS-T70viEjT2k_9W3ZeERt1Gvx_VBqcxVNMvlXoLi-KthVHD7so8JMwaOern88ECZl5tX1TwIw6qcARP1TSo Oct 17 13:39:17.851913 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:39:17.851913 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:39:17.851913 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:39:17.851913 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:39:17.851913 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:39:17.851913 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:39:17.851913 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: c7507d1dd2d345ca9b59dcaa7806b56e Oct 17 13:39:17.851913 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2045461887 Oct 17 13:39:17.851913 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:39:17.851913 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:39:17.853564 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c7507d1dd2d345ca9b59dcaa7806b56e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c7507d1dd2d345ca9b59dcaa7806b56e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c7507d1dd2d345ca9b59dcaa7806b56e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c7507d1dd2d345ca9b59dcaa7806b56e", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:39:17.853564 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2045461887 Oct 17 13:39:17.853564 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: c7507d1dd2d345ca9b59dcaa7806b56e Oct 17 13:39:17.853564 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2045461887 Oct 17 13:39:17.853564 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ImagesOneServerNegativeTestJSON-2045461887-project Oct 17 13:39:17.853564 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:39:17.853564 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:39:17.853564 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: dcbd60cab4174e8db26e28f015795e1f Oct 17 13:39:17.853564 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2045461887-project Oct 17 13:39:17.853564 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:39:17.853564 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 298b0f19-0a0c-4304-bb8b-4bd26cce2d9d could not be found. Oct 17 13:39:17.853564 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '298b0f19-0a0c-4304-bb8b-4bd26cce2d9d'} Oct 17 13:39:17.854503 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:39:17.854503 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:17.854503 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:39:17.854503 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:39:17.854503 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:39:17.854503 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:39:17.854503 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:39:17.854503 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:39:17.854503 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:39:17.854503 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:39:17.854503 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 298b0f19-0a0c-4304-bb8b-4bd26cce2d9d could not be found. Oct 17 13:39:17.854503 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:39:17.854503 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:39:17.854503 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:39:17.854503 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:17.854503 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:39:17.854503 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:39:17.854503 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:39:17.854503 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:39:17.854503 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:39:17.857254 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:39:17.857254 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:39:17.857254 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:39:17.857254 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:39:17.857254 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:39:17.857254 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:39:17.857254 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:39:17.857254 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:39:17.857254 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:39:17.857254 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 298b0f19-0a0c-4304-bb8b-4bd26cce2d9d could not be found. Oct 17 13:39:17.857254 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:39:17.857254 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:39:17.857254 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:39:17.857254 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:17.857254 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:39:17.857254 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:39:17.857254 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:39:17.857254 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:39:17.857254 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 298b0f19-0a0c-4304-bb8b-4bd26cce2d9d could not be found. Oct 17 13:39:17.857254 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:39:17.859087 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ab2401be-1695-4846-bc50-a6bce118970d tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Returning 404 to user: Instance 298b0f19-0a0c-4304-bb8b-4bd26cce2d9d could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:39:17.859087 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ab2401be-1695-4846-bc50-a6bce118970d tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "DELETE /compute/v2.1/servers/298b0f19-0a0c-4304-bb8b-4bd26cce2d9d" status: 404 len: 111 microversion: 2.1 time: 0.035600 Oct 17 13:39:17.860154 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 696/1440] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:39:17 2022] DELETE /compute/v2.1/servers/298b0f19-0a0c-4304-bb8b-4bd26cce2d9d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:39:17.864433 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c5c5e02f-9a88-4ca6-9984-a4c7391e4c40 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd558f9d0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:17.942174 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c5c5e02f-9a88-4ca6-9984-a4c7391e4c40 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/377d98df-8887-4bb0-8a0b-84e4f2dc3871" status: 200 len: 1440 microversion: 2.1 time: 0.081375 Oct 17 13:39:17.943024 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 697/1441] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:39:17 2022] GET /compute/v2.1/images/377d98df-8887-4bb0-8a0b-84e4f2dc3871 => generated 1440 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:17.948116 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c8cb9cf8-6cf2-4088-a431-244b6f5d2696 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:17.949036 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c8cb9cf8-6cf2-4088-a431-244b6f5d2696 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: ab2b571e-376c-41d3-a778-44bedcaa5467] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:17.956098 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c8cb9cf8-6cf2-4088-a431-244b6f5d2696 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:17.956838 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c8cb9cf8-6cf2-4088-a431-244b6f5d2696 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:17.957611 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c8cb9cf8-6cf2-4088-a431-244b6f5d2696 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:17.958374 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c8cb9cf8-6cf2-4088-a431-244b6f5d2696 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:17.958899 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c8cb9cf8-6cf2-4088-a431-244b6f5d2696 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:17.959437 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c8cb9cf8-6cf2-4088-a431-244b6f5d2696 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:18.136038 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c8cb9cf8-6cf2-4088-a431-244b6f5d2696 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:18.144949 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c8cb9cf8-6cf2-4088-a431-244b6f5d2696 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467" status: 200 len: 1478 microversion: 2.1 time: 0.200823 Oct 17 13:39:18.145702 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 698/1442] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:17 2022] GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467 => generated 1478 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:18.151332 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-50398133-3d69-42d6-be3b-3d3da752bf46 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:18.152164 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-50398133-3d69-42d6-be3b-3d3da752bf46 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 298b0f19-0a0c-4304-bb8b-4bd26cce2d9d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:18.158845 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-50398133-3d69-42d6-be3b-3d3da752bf46 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:18.159374 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-50398133-3d69-42d6-be3b-3d3da752bf46 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:18.159948 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-50398133-3d69-42d6-be3b-3d3da752bf46 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:18.160664 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-50398133-3d69-42d6-be3b-3d3da752bf46 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:18.161107 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-50398133-3d69-42d6-be3b-3d3da752bf46 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:18.161522 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-50398133-3d69-42d6-be3b-3d3da752bf46 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:18.179989 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-50398133-3d69-42d6-be3b-3d3da752bf46 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] HTTP exception thrown: Instance 298b0f19-0a0c-4304-bb8b-4bd26cce2d9d could not be found. Oct 17 13:39:18.182386 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-50398133-3d69-42d6-be3b-3d3da752bf46 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Request method failure captured: Oct 17 13:39:18.182386 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/298b0f19-0a0c-4304-bb8b-4bd26cce2d9d HTTP/1.1 Oct 17 13:39:18.182386 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:39:18.182386 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:39:18.182386 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:39:18.182386 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:39:18.182386 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:39:18.182386 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:39:18.182386 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:39:18.182386 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:39:18.182386 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVp-7IxfFP3OCFXwoptz1mkTvVFP-q1mVdb9duvFJBSFB2Milojb0bt4JEkHbyx5bSK8AUBQstoN0fpOUoelRV9Ur5eKS-T70viEjT2k_9W3ZeERt1Gvx_VBqcxVNMvlXoLi-KthVHD7so8JMwaOern88ECZl5tX1TwIw6qcARP1TSo Oct 17 13:39:18.182386 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:39:18.182386 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:39:18.182386 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:39:18.182386 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:39:18.182386 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:39:18.182386 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:39:18.182386 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: c7507d1dd2d345ca9b59dcaa7806b56e Oct 17 13:39:18.182386 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2045461887 Oct 17 13:39:18.182386 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:39:18.182386 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:39:18.184091 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c7507d1dd2d345ca9b59dcaa7806b56e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c7507d1dd2d345ca9b59dcaa7806b56e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c7507d1dd2d345ca9b59dcaa7806b56e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c7507d1dd2d345ca9b59dcaa7806b56e", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:39:18.184091 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2045461887 Oct 17 13:39:18.184091 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: c7507d1dd2d345ca9b59dcaa7806b56e Oct 17 13:39:18.184091 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2045461887 Oct 17 13:39:18.184091 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ImagesOneServerNegativeTestJSON-2045461887-project Oct 17 13:39:18.184091 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:39:18.184091 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:39:18.184091 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: dcbd60cab4174e8db26e28f015795e1f Oct 17 13:39:18.184091 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2045461887-project Oct 17 13:39:18.184091 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:39:18.184091 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 298b0f19-0a0c-4304-bb8b-4bd26cce2d9d could not be found. Oct 17 13:39:18.184091 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '298b0f19-0a0c-4304-bb8b-4bd26cce2d9d'} Oct 17 13:39:18.184990 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:39:18.184990 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:18.184990 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:39:18.184990 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:39:18.184990 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:39:18.184990 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:39:18.184990 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:39:18.184990 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:39:18.184990 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:39:18.184990 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:39:18.184990 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 298b0f19-0a0c-4304-bb8b-4bd26cce2d9d could not be found. Oct 17 13:39:18.184990 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:39:18.184990 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:39:18.184990 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:39:18.184990 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:18.184990 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:39:18.184990 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:39:18.184990 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:39:18.184990 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:39:18.184990 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:39:18.186448 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:39:18.186448 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:39:18.186448 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:39:18.186448 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:39:18.186448 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:39:18.186448 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:39:18.186448 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:39:18.186448 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 298b0f19-0a0c-4304-bb8b-4bd26cce2d9d could not be found. Oct 17 13:39:18.186448 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:39:18.186448 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:39:18.186448 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:39:18.186448 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:18.186448 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:39:18.186448 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:39:18.186448 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:39:18.186448 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:39:18.186448 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 298b0f19-0a0c-4304-bb8b-4bd26cce2d9d could not be found. Oct 17 13:39:18.186448 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:39:18.188422 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-50398133-3d69-42d6-be3b-3d3da752bf46 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Returning 404 to user: Instance 298b0f19-0a0c-4304-bb8b-4bd26cce2d9d could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:39:18.188422 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-50398133-3d69-42d6-be3b-3d3da752bf46 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/298b0f19-0a0c-4304-bb8b-4bd26cce2d9d" status: 404 len: 111 microversion: 2.1 time: 0.037163 Oct 17 13:39:18.188422 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 699/1443] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:18 2022] GET /compute/v2.1/servers/298b0f19-0a0c-4304-bb8b-4bd26cce2d9d => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:39:18.194176 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fe394b03-5c5a-4746-9ff6-57fec6c99c5c tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:18.194795 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-fe394b03-5c5a-4746-9ff6-57fec6c99c5c tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:18.206547 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe394b03-5c5a-4746-9ff6-57fec6c99c5c tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:18.207049 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe394b03-5c5a-4746-9ff6-57fec6c99c5c tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:18.207527 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe394b03-5c5a-4746-9ff6-57fec6c99c5c tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:18.208252 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe394b03-5c5a-4746-9ff6-57fec6c99c5c tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:18.208877 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe394b03-5c5a-4746-9ff6-57fec6c99c5c tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:18.209307 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe394b03-5c5a-4746-9ff6-57fec6c99c5c tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:18.314539 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fe394b03-5c5a-4746-9ff6-57fec6c99c5c tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:18.337544 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fe394b03-5c5a-4746-9ff6-57fec6c99c5c tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:18.340945 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fe394b03-5c5a-4746-9ff6-57fec6c99c5c tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:18.354658 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fe394b03-5c5a-4746-9ff6-57fec6c99c5c tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1537 microversion: 2.91 time: 0.165183 Oct 17 13:39:18.356179 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 700/1444] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:39:18 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1537 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:39:18.388676 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-52d240d8-45d8-46b2-97dc-d5f6257ae5e0 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '.version_select at 0x7f7cd559b160>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:18.407584 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:39:18.421552 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-52d240d8-45d8-46b2-97dc-d5f6257ae5e0 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-153889258" status: 202 len: 0 microversion: 2.1 time: 0.052671 Oct 17 13:39:18.422866 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 701/1445] 10.222.0.79 () {58 vars in 1218 bytes} [Mon Oct 17 13:39:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-153889258 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:39:18.431955 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ddcb98d3-a284-4f05-9509-cbf830bf784d tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:18.432847 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ddcb98d3-a284-4f05-9509-cbf830bf784d tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] [instance: 5661197d-b679-48bc-bf2c-11e7b4f962bb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:18.440340 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ddcb98d3-a284-4f05-9509-cbf830bf784d tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:18.441939 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ddcb98d3-a284-4f05-9509-cbf830bf784d tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:18.442595 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ddcb98d3-a284-4f05-9509-cbf830bf784d tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:18.443872 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ddcb98d3-a284-4f05-9509-cbf830bf784d tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:18.445295 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ddcb98d3-a284-4f05-9509-cbf830bf784d tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:18.445802 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ddcb98d3-a284-4f05-9509-cbf830bf784d tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:18.795353 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ddcb98d3-a284-4f05-9509-cbf830bf784d tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d2462ac744056be55262dacc72de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ed14a8051a4b8fb39d56280a2bcb41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:18.810279 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ddcb98d3-a284-4f05-9509-cbf830bf784d tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] 10.222.0.79 "GET /compute/v2.1/servers/5661197d-b679-48bc-bf2c-11e7b4f962bb" status: 200 len: 1325 microversion: 2.1 time: 0.385963 Oct 17 13:39:18.811469 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 702/1446] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:18 2022] GET /compute/v2.1/servers/5661197d-b679-48bc-bf2c-11e7b4f962bb => generated 1325 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:18.850848 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-748219bb-d95f-4d2b-8c69-d04fd8ffc984 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:18.851549 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-748219bb-d95f-4d2b-8c69-d04fd8ffc984 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: fd365dc4-44c6-4a00-971e-2699762ab41f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:18.878253 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-748219bb-d95f-4d2b-8c69-d04fd8ffc984 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:18.881038 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-748219bb-d95f-4d2b-8c69-d04fd8ffc984 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:18.881498 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-748219bb-d95f-4d2b-8c69-d04fd8ffc984 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:18.883632 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-748219bb-d95f-4d2b-8c69-d04fd8ffc984 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:18.884910 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-748219bb-d95f-4d2b-8c69-d04fd8ffc984 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:18.886929 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-748219bb-d95f-4d2b-8c69-d04fd8ffc984 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:19.165721 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-748219bb-d95f-4d2b-8c69-d04fd8ffc984 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:19.176382 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-748219bb-d95f-4d2b-8c69-d04fd8ffc984 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f" status: 200 len: 1198 microversion: 2.1 time: 0.335242 Oct 17 13:39:19.177863 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 703/1447] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:18 2022] GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f => generated 1198 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:39:19.186627 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0147001b-3da2-43e5-a140-81a57ad72c12 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd559bd30>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:19.255340 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0147001b-3da2-43e5-a140-81a57ad72c12 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/377d98df-8887-4bb0-8a0b-84e4f2dc3871" status: 200 len: 1440 microversion: 2.1 time: 0.075143 Oct 17 13:39:19.262469 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 704/1448] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:39:19 2022] GET /compute/v2.1/images/377d98df-8887-4bb0-8a0b-84e4f2dc3871 => generated 1440 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:19.272319 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-49abbd3f-a8c6-4c06-8f0d-9442cf4065b0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:19.272932 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-49abbd3f-a8c6-4c06-8f0d-9442cf4065b0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: ab2b571e-376c-41d3-a778-44bedcaa5467] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:19.285474 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-49abbd3f-a8c6-4c06-8f0d-9442cf4065b0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:19.286171 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-49abbd3f-a8c6-4c06-8f0d-9442cf4065b0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:19.286865 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-49abbd3f-a8c6-4c06-8f0d-9442cf4065b0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:19.287759 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-49abbd3f-a8c6-4c06-8f0d-9442cf4065b0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:19.288388 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-49abbd3f-a8c6-4c06-8f0d-9442cf4065b0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:19.288961 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-49abbd3f-a8c6-4c06-8f0d-9442cf4065b0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:19.439914 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-046888f2-ccee-4c9d-b1a5-47d035e643b0 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596/action" status: 202 len: 0 microversion: 2.25 time: 2.322922 Oct 17 13:39:19.455400 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 745/1449] 10.222.0.79 () {62 vars in 1319 bytes} [Mon Oct 17 13:39:17 2022] POST /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596/action => generated 0 bytes in 2339 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:39:19.467670 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-134bcd63-df75-46fb-90ed-f0dfd2159721 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:19.468448 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-134bcd63-df75-46fb-90ed-f0dfd2159721 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:19.477168 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-134bcd63-df75-46fb-90ed-f0dfd2159721 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:19.477772 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-134bcd63-df75-46fb-90ed-f0dfd2159721 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:19.478300 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-134bcd63-df75-46fb-90ed-f0dfd2159721 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:19.479433 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-134bcd63-df75-46fb-90ed-f0dfd2159721 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:19.479978 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-134bcd63-df75-46fb-90ed-f0dfd2159721 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:19.480487 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-134bcd63-df75-46fb-90ed-f0dfd2159721 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:19.577349 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-134bcd63-df75-46fb-90ed-f0dfd2159721 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:19.580248 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-49abbd3f-a8c6-4c06-8f0d-9442cf4065b0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:19.588320 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-49abbd3f-a8c6-4c06-8f0d-9442cf4065b0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467" status: 200 len: 1464 microversion: 2.1 time: 0.324313 Oct 17 13:39:19.588826 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 705/1450] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:19 2022] GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467 => generated 1464 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:19.603332 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-134bcd63-df75-46fb-90ed-f0dfd2159721 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:19.603332 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-134bcd63-df75-46fb-90ed-f0dfd2159721 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:19.603332 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-134bcd63-df75-46fb-90ed-f0dfd2159721 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1537 microversion: 2.91 time: 0.141162 Oct 17 13:39:19.603906 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 746/1451] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:39:19 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1537 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:39:19.609650 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4037f55e-d492-40b9-820b-167b227f734b tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:19.610342 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4037f55e-d492-40b9-820b-167b227f734b tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 16213741-2241-4f55-b7ca-20ab551e5596] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:19.611463 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-22e6ac77-9924-423d-a680-fffa8601b92c tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '.version_select at 0x7f7cd559b280>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:19.619808 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4037f55e-d492-40b9-820b-167b227f734b tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:19.621448 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4037f55e-d492-40b9-820b-167b227f734b tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:19.621896 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4037f55e-d492-40b9-820b-167b227f734b tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:19.622612 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4037f55e-d492-40b9-820b-167b227f734b tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:19.623860 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4037f55e-d492-40b9-820b-167b227f734b tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:19.624474 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4037f55e-d492-40b9-820b-167b227f734b tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:19.663251 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-22e6ac77-9924-423d-a680-fffa8601b92c tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] HTTP exception thrown: Image not found. Oct 17 13:39:19.665271 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-22e6ac77-9924-423d-a680-fffa8601b92c tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Request method failure captured: Oct 17 13:39:19.665271 n-d-854247-14 devstack@n-api.service[127016]: request: DELETE /compute/v2.1/images/b3fe21ef-98a7-47ff-affe-12e685194623 HTTP/1.1 Oct 17 13:39:19.665271 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:39:19.665271 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:39:19.665271 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:39:19.665271 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:39:19.665271 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:39:19.665271 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:39:19.665271 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:39:19.665271 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:39:19.665271 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVp-7IxfFP3OCFXwoptz1mkTvVFP-q1mVdb9duvFJBSFB2Milojb0bt4JEkHbyx5bSK8AUBQstoN0fpOUoelRV9Ur5eKS-T70viEjT2k_9W3ZeERt1Gvx_VBqcxVNMvlXoLi-KthVHD7so8JMwaOern88ECZl5tX1TwIw6qcARP1TSo Oct 17 13:39:19.665271 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:39:19.665271 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:39:19.665271 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:39:19.665271 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:39:19.665271 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:39:19.665271 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:39:19.665271 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: c7507d1dd2d345ca9b59dcaa7806b56e Oct 17 13:39:19.665271 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2045461887 Oct 17 13:39:19.665271 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:39:19.665271 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:39:19.666892 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c7507d1dd2d345ca9b59dcaa7806b56e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c7507d1dd2d345ca9b59dcaa7806b56e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c7507d1dd2d345ca9b59dcaa7806b56e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c7507d1dd2d345ca9b59dcaa7806b56e", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:39:19.666892 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2045461887 Oct 17 13:39:19.666892 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: c7507d1dd2d345ca9b59dcaa7806b56e Oct 17 13:39:19.666892 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2045461887 Oct 17 13:39:19.666892 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ImagesOneServerNegativeTestJSON-2045461887-project Oct 17 13:39:19.666892 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:39:19.666892 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:39:19.666892 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: dcbd60cab4174e8db26e28f015795e1f Oct 17 13:39:19.666892 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2045461887-project Oct 17 13:39:19.666892 n-d-854247-14 devstack@n-api.service[127016]: method: Oct 17 13:39:19.666892 n-d-854247-14 devstack@n-api.service[127016]: exception: Image not found. Oct 17 13:39:19.666892 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'b3fe21ef-98a7-47ff-affe-12e685194623'} Oct 17 13:39:19.666892 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:39:19.667801 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:19.667801 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 17 13:39:19.667801 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 17 13:39:19.667801 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:39:19.667801 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:39:19.667801 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:39:19.667801 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:39:19.667801 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 17 13:39:19.667801 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 17 13:39:19.667801 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 17 13:39:19.667801 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 17 13:39:19.667801 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:39:19.667801 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:39:19.667801 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:39:19.667801 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:39:19.667801 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b3fe21ef-98a7-47ff-affe-12e685194623 to delete Oct 17 13:39:19.667801 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:39:19.667801 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:39:19.667801 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:39:19.669012 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:19.669012 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 17 13:39:19.669012 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 17 13:39:19.669012 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 17 13:39:19.669012 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 17 13:39:19.669012 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 17 13:39:19.669012 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 17 13:39:19.669012 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b3fe21ef-98a7-47ff-affe-12e685194623 could not be found. Oct 17 13:39:19.669012 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:39:19.669012 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:39:19.669012 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:39:19.669012 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:19.669012 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:39:19.669012 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:39:19.669012 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:39:19.669012 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:39:19.669012 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:39:19.669012 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:39:19.669012 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:39:19.669012 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:39:19.671108 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 17 13:39:19.671108 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 13:39:19.671108 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 13:39:19.671108 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:39:19.671108 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:39:19.671108 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:39:19.671108 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:19.671108 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:39:19.671108 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:39:19.671108 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:39:19.671108 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:39:19.671108 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 13:39:19.671108 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:39:19.671108 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-22e6ac77-9924-423d-a680-fffa8601b92c tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Returning 404 to user: Image not found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:39:19.671108 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-22e6ac77-9924-423d-a680-fffa8601b92c tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "DELETE /compute/v2.1/images/b3fe21ef-98a7-47ff-affe-12e685194623" status: 404 len: 62 microversion: 2.1 time: 0.061762 Oct 17 13:39:19.672661 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 706/1452] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:19 2022] DELETE /compute/v2.1/images/b3fe21ef-98a7-47ff-affe-12e685194623 => generated 62 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:39:19.675363 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-427d9065-fe51-413f-b9b7-c4c8fcbbf5cf tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:19.675977 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-427d9065-fe51-413f-b9b7-c4c8fcbbf5cf tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: ab2b571e-376c-41d3-a778-44bedcaa5467] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:19.688844 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-427d9065-fe51-413f-b9b7-c4c8fcbbf5cf tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:19.689341 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-427d9065-fe51-413f-b9b7-c4c8fcbbf5cf tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:19.689941 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-427d9065-fe51-413f-b9b7-c4c8fcbbf5cf tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:19.690817 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-427d9065-fe51-413f-b9b7-c4c8fcbbf5cf tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:19.691445 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-427d9065-fe51-413f-b9b7-c4c8fcbbf5cf tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:19.692035 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-427d9065-fe51-413f-b9b7-c4c8fcbbf5cf tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:19.895472 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4037f55e-d492-40b9-820b-167b227f734b tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:19.905447 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4037f55e-d492-40b9-820b-167b227f734b tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:19.907860 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4037f55e-d492-40b9-820b-167b227f734b tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:19.909437 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4037f55e-d492-40b9-820b-167b227f734b tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596" status: 200 len: 1568 microversion: 2.25 time: 0.304926 Oct 17 13:39:19.910722 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 747/1453] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:39:19 2022] GET /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596 => generated 1568 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:39:19.921732 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-cd7158ed-825f-4488-b35c-7f5f1d33b1b5 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:19.922546 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-cd7158ed-825f-4488-b35c-7f5f1d33b1b5 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 008be895-7153-417e-9b87-5b60ea31d0bc] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:19.927095 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-427d9065-fe51-413f-b9b7-c4c8fcbbf5cf tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:19.931426 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cd7158ed-825f-4488-b35c-7f5f1d33b1b5 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:19.932610 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cd7158ed-825f-4488-b35c-7f5f1d33b1b5 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:19.938766 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cd7158ed-825f-4488-b35c-7f5f1d33b1b5 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:19.939947 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cd7158ed-825f-4488-b35c-7f5f1d33b1b5 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:19.940068 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-427d9065-fe51-413f-b9b7-c4c8fcbbf5cf tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467" status: 200 len: 1464 microversion: 2.1 time: 0.268220 Oct 17 13:39:19.951191 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 707/1454] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:19 2022] GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467 => generated 1464 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:19.952876 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cd7158ed-825f-4488-b35c-7f5f1d33b1b5 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:19.953655 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cd7158ed-825f-4488-b35c-7f5f1d33b1b5 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:19.975147 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-cd7158ed-825f-4488-b35c-7f5f1d33b1b5 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] HTTP exception thrown: Instance 008be895-7153-417e-9b87-5b60ea31d0bc could not be found. Oct 17 13:39:19.976953 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-cd7158ed-825f-4488-b35c-7f5f1d33b1b5 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Request method failure captured: Oct 17 13:39:19.976953 n-d-854247-14 devstack@n-api.service[127017]: request: DELETE /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc HTTP/1.1 Oct 17 13:39:19.976953 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:39:19.976953 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:39:19.976953 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:39:19.976953 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:39:19.976953 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:39:19.976953 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:39:19.976953 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:39:19.976953 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:39:19.976953 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVp-7IxfFP3OCFXwoptz1mkTvVFP-q1mVdb9duvFJBSFB2Milojb0bt4JEkHbyx5bSK8AUBQstoN0fpOUoelRV9Ur5eKS-T70viEjT2k_9W3ZeERt1Gvx_VBqcxVNMvlXoLi-KthVHD7so8JMwaOern88ECZl5tX1TwIw6qcARP1TSo Oct 17 13:39:19.976953 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:39:19.976953 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:39:19.976953 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:39:19.976953 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:39:19.976953 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:39:19.976953 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:39:19.976953 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: c7507d1dd2d345ca9b59dcaa7806b56e Oct 17 13:39:19.976953 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2045461887 Oct 17 13:39:19.976953 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:39:19.976953 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:39:19.978777 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c7507d1dd2d345ca9b59dcaa7806b56e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c7507d1dd2d345ca9b59dcaa7806b56e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c7507d1dd2d345ca9b59dcaa7806b56e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c7507d1dd2d345ca9b59dcaa7806b56e", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:39:19.978777 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2045461887 Oct 17 13:39:19.978777 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: c7507d1dd2d345ca9b59dcaa7806b56e Oct 17 13:39:19.978777 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2045461887 Oct 17 13:39:19.978777 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ImagesOneServerNegativeTestJSON-2045461887-project Oct 17 13:39:19.978777 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:39:19.978777 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:39:19.978777 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: dcbd60cab4174e8db26e28f015795e1f Oct 17 13:39:19.978777 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2045461887-project Oct 17 13:39:19.978777 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:39:19.978777 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 008be895-7153-417e-9b87-5b60ea31d0bc could not be found. Oct 17 13:39:19.978777 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '008be895-7153-417e-9b87-5b60ea31d0bc'} Oct 17 13:39:19.983148 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:39:19.983148 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:19.983148 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:39:19.983148 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:39:19.983148 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:39:19.983148 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:39:19.983148 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:39:19.983148 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:39:19.983148 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:39:19.983148 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:39:19.983148 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 008be895-7153-417e-9b87-5b60ea31d0bc could not be found. Oct 17 13:39:19.983148 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:39:19.983148 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:39:19.983148 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:39:19.983148 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:19.983148 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:39:19.983148 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:39:19.983148 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:39:19.983148 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:39:19.983148 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:39:19.984537 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:39:19.984537 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:39:19.984537 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:39:19.984537 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:39:19.984537 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:39:19.984537 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:39:19.984537 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:39:19.984537 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:39:19.984537 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:39:19.984537 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 008be895-7153-417e-9b87-5b60ea31d0bc could not be found. Oct 17 13:39:19.984537 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:39:19.984537 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:39:19.984537 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:39:19.984537 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:19.984537 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:39:19.984537 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:39:19.984537 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:39:19.984537 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:39:19.984537 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 008be895-7153-417e-9b87-5b60ea31d0bc could not be found. Oct 17 13:39:19.984537 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:39:19.985824 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-cd7158ed-825f-4488-b35c-7f5f1d33b1b5 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Returning 404 to user: Instance 008be895-7153-417e-9b87-5b60ea31d0bc could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:39:19.985824 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-cd7158ed-825f-4488-b35c-7f5f1d33b1b5 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "DELETE /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc" status: 404 len: 111 microversion: 2.1 time: 0.066544 Oct 17 13:39:19.985824 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 748/1455] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:39:19 2022] DELETE /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:39:19.985824 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4f14411f-4037-47b6-9677-2c27ba461212 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:19.985824 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4f14411f-4037-47b6-9677-2c27ba461212 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] [instance: 5661197d-b679-48bc-bf2c-11e7b4f962bb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:19.995138 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4f14411f-4037-47b6-9677-2c27ba461212 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:19.995666 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4f14411f-4037-47b6-9677-2c27ba461212 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:19.998398 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4f14411f-4037-47b6-9677-2c27ba461212 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:19.999132 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4f14411f-4037-47b6-9677-2c27ba461212 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:20.002548 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4f14411f-4037-47b6-9677-2c27ba461212 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:20.003034 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4f14411f-4037-47b6-9677-2c27ba461212 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:20.054677 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-76c74a00-679e-4b6a-887b-07a1c5239a1c req-2cdec650-a0cb-4633-8c96-0f31607bb6f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5661197d-b679-48bc-bf2c-11e7b4f962bb", "tag": "a47f4bb8-acbd-43ec-91bb-a63ad37997b8"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:20.068492 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-76c74a00-679e-4b6a-887b-07a1c5239a1c req-2cdec650-a0cb-4633-8c96-0f31607bb6f4 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:20.068981 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-76c74a00-679e-4b6a-887b-07a1c5239a1c req-2cdec650-a0cb-4633-8c96-0f31607bb6f4 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:20.069484 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-76c74a00-679e-4b6a-887b-07a1c5239a1c req-2cdec650-a0cb-4633-8c96-0f31607bb6f4 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:20.105228 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-76c74a00-679e-4b6a-887b-07a1c5239a1c req-2cdec650-a0cb-4633-8c96-0f31607bb6f4 service nova] Creating event network-changed:a47f4bb8-acbd-43ec-91bb-a63ad37997b8 for instance 5661197d-b679-48bc-bf2c-11e7b4f962bb on n-h1-854247-14 Oct 17 13:39:20.111436 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-76c74a00-679e-4b6a-887b-07a1c5239a1c req-2cdec650-a0cb-4633-8c96-0f31607bb6f4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168939 Oct 17 13:39:20.112041 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 708/1456] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:39:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:39:20.118868 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8d2e0423-20de-4744-815e-506357f2f79b tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:20.121760 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8d2e0423-20de-4744-815e-506357f2f79b tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: ab2b571e-376c-41d3-a778-44bedcaa5467] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:20.128219 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8d2e0423-20de-4744-815e-506357f2f79b tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:20.128930 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8d2e0423-20de-4744-815e-506357f2f79b tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:20.129545 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8d2e0423-20de-4744-815e-506357f2f79b tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:20.130686 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8d2e0423-20de-4744-815e-506357f2f79b tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:20.131510 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8d2e0423-20de-4744-815e-506357f2f79b tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:20.131945 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8d2e0423-20de-4744-815e-506357f2f79b tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:20.219980 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-8d2e0423-20de-4744-815e-506357f2f79b tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:39:20.221063 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-8d2e0423-20de-4744-815e-506357f2f79b tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:39:20.221998 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-8d2e0423-20de-4744-815e-506357f2f79b tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:39:20.222978 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-8d2e0423-20de-4744-815e-506357f2f79b tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:39:20.224014 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-8d2e0423-20de-4744-815e-506357f2f79b tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:39:20.251534 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4f14411f-4037-47b6-9677-2c27ba461212 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d2462ac744056be55262dacc72de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ed14a8051a4b8fb39d56280a2bcb41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:20.266596 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4f14411f-4037-47b6-9677-2c27ba461212 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] 10.222.0.79 "GET /compute/v2.1/servers/5661197d-b679-48bc-bf2c-11e7b4f962bb" status: 200 len: 1325 microversion: 2.1 time: 0.285603 Oct 17 13:39:20.268022 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 749/1457] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:19 2022] GET /compute/v2.1/servers/5661197d-b679-48bc-bf2c-11e7b4f962bb => generated 1325 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:20.275510 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-24539498-d8bc-4d61-acae-b37fa5a40804 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:20.276325 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-24539498-d8bc-4d61-acae-b37fa5a40804 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] [instance: 008be895-7153-417e-9b87-5b60ea31d0bc] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:20.284508 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-24539498-d8bc-4d61-acae-b37fa5a40804 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:20.285307 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-24539498-d8bc-4d61-acae-b37fa5a40804 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:20.286045 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-24539498-d8bc-4d61-acae-b37fa5a40804 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:20.286961 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-24539498-d8bc-4d61-acae-b37fa5a40804 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:20.287745 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-24539498-d8bc-4d61-acae-b37fa5a40804 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:20.288324 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-24539498-d8bc-4d61-acae-b37fa5a40804 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:20.309378 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-24539498-d8bc-4d61-acae-b37fa5a40804 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] HTTP exception thrown: Instance 008be895-7153-417e-9b87-5b60ea31d0bc could not be found. Oct 17 13:39:20.311206 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-24539498-d8bc-4d61-acae-b37fa5a40804 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Request method failure captured: Oct 17 13:39:20.311206 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc HTTP/1.1 Oct 17 13:39:20.311206 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:39:20.311206 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:39:20.311206 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:39:20.311206 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:39:20.311206 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:39:20.311206 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:39:20.311206 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:39:20.311206 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:39:20.311206 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVp-7IxfFP3OCFXwoptz1mkTvVFP-q1mVdb9duvFJBSFB2Milojb0bt4JEkHbyx5bSK8AUBQstoN0fpOUoelRV9Ur5eKS-T70viEjT2k_9W3ZeERt1Gvx_VBqcxVNMvlXoLi-KthVHD7so8JMwaOern88ECZl5tX1TwIw6qcARP1TSo Oct 17 13:39:20.311206 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:39:20.311206 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:39:20.311206 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:39:20.311206 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:39:20.311206 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:39:20.311206 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:39:20.311206 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: c7507d1dd2d345ca9b59dcaa7806b56e Oct 17 13:39:20.311206 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2045461887 Oct 17 13:39:20.311206 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:39:20.311206 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:39:20.312945 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c7507d1dd2d345ca9b59dcaa7806b56e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c7507d1dd2d345ca9b59dcaa7806b56e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c7507d1dd2d345ca9b59dcaa7806b56e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c7507d1dd2d345ca9b59dcaa7806b56e", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:39:20.312945 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2045461887 Oct 17 13:39:20.312945 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: c7507d1dd2d345ca9b59dcaa7806b56e Oct 17 13:39:20.312945 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2045461887 Oct 17 13:39:20.312945 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ImagesOneServerNegativeTestJSON-2045461887-project Oct 17 13:39:20.312945 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:39:20.312945 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:39:20.312945 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: dcbd60cab4174e8db26e28f015795e1f Oct 17 13:39:20.312945 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2045461887-project Oct 17 13:39:20.312945 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:39:20.312945 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 008be895-7153-417e-9b87-5b60ea31d0bc could not be found. Oct 17 13:39:20.312945 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '008be895-7153-417e-9b87-5b60ea31d0bc'} Oct 17 13:39:20.313826 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:39:20.313826 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:20.313826 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:39:20.313826 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:39:20.313826 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:39:20.313826 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:39:20.313826 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:39:20.313826 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:39:20.313826 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:39:20.313826 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:39:20.313826 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 008be895-7153-417e-9b87-5b60ea31d0bc could not be found. Oct 17 13:39:20.313826 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:39:20.313826 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:39:20.313826 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:39:20.313826 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:20.313826 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:39:20.313826 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:39:20.313826 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:39:20.313826 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:39:20.313826 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:39:20.315039 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:39:20.315039 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:39:20.315039 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:39:20.315039 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:39:20.315039 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:39:20.315039 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:39:20.315039 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:39:20.315039 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 008be895-7153-417e-9b87-5b60ea31d0bc could not be found. Oct 17 13:39:20.315039 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:39:20.315039 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:39:20.315039 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:39:20.315039 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:20.315039 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:39:20.315039 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:39:20.315039 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:39:20.315039 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:39:20.315039 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 008be895-7153-417e-9b87-5b60ea31d0bc could not be found. Oct 17 13:39:20.315039 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:39:20.318323 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-24539498-d8bc-4d61-acae-b37fa5a40804 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] Returning 404 to user: Instance 008be895-7153-417e-9b87-5b60ea31d0bc could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:39:20.319223 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-24539498-d8bc-4d61-acae-b37fa5a40804 tempest-ImagesOneServerNegativeTestJSON-2045461887 tempest-ImagesOneServerNegativeTestJSON-2045461887-project] 10.222.0.79 "GET /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc" status: 404 len: 111 microversion: 2.1 time: 0.049850 Oct 17 13:39:20.319805 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 750/1458] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:20 2022] GET /compute/v2.1/servers/008be895-7153-417e-9b87-5b60ea31d0bc => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:39:20.324965 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8543b080-3586-405d-8154-dd4dbe9b2272 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:20.326338 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8543b080-3586-405d-8154-dd4dbe9b2272 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: fd365dc4-44c6-4a00-971e-2699762ab41f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:20.333429 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8543b080-3586-405d-8154-dd4dbe9b2272 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:20.334225 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8543b080-3586-405d-8154-dd4dbe9b2272 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:20.334855 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8543b080-3586-405d-8154-dd4dbe9b2272 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:20.335727 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8543b080-3586-405d-8154-dd4dbe9b2272 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:20.336171 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8543b080-3586-405d-8154-dd4dbe9b2272 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:20.336852 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8543b080-3586-405d-8154-dd4dbe9b2272 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:20.341524 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8d2e0423-20de-4744-815e-506357f2f79b tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: ab2b571e-376c-41d3-a778-44bedcaa5467] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:20.350572 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8d2e0423-20de-4744-815e-506357f2f79b tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:20.350988 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8d2e0423-20de-4744-815e-506357f2f79b tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:20.351670 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8d2e0423-20de-4744-815e-506357f2f79b tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:20.352466 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8d2e0423-20de-4744-815e-506357f2f79b tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:20.353126 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8d2e0423-20de-4744-815e-506357f2f79b tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:20.353930 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8d2e0423-20de-4744-815e-506357f2f79b tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:20.393090 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8d2e0423-20de-4744-815e-506357f2f79b tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "POST /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467/action" status: 202 len: 1068 microversion: 2.1 time: 0.279590 Oct 17 13:39:20.394154 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 709/1459] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:39:20 2022] POST /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467/action => generated 1068 bytes in 281 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 17 13:39:20.398840 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2a4d9454-6c11-4c34-85f2-29bcf1949cb2 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd554d3a0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:20.454967 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2a4d9454-6c11-4c34-85f2-29bcf1949cb2 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/377d98df-8887-4bb0-8a0b-84e4f2dc3871" status: 200 len: 1440 microversion: 2.1 time: 0.059606 Oct 17 13:39:20.455573 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 710/1460] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:39:20 2022] GET /compute/v2.1/images/377d98df-8887-4bb0-8a0b-84e4f2dc3871 => generated 1440 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:20.460331 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-bc50ed45-60ed-427e-88f8-3b55f56d56ef tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:20.461126 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-bc50ed45-60ed-427e-88f8-3b55f56d56ef tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: ab2b571e-376c-41d3-a778-44bedcaa5467] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:20.468014 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bc50ed45-60ed-427e-88f8-3b55f56d56ef tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:20.468496 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bc50ed45-60ed-427e-88f8-3b55f56d56ef tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:20.468928 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bc50ed45-60ed-427e-88f8-3b55f56d56ef tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:20.469622 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bc50ed45-60ed-427e-88f8-3b55f56d56ef tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:20.470246 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bc50ed45-60ed-427e-88f8-3b55f56d56ef tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:20.470664 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bc50ed45-60ed-427e-88f8-3b55f56d56ef tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:21.011279 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8543b080-3586-405d-8154-dd4dbe9b2272 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:21.021954 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8543b080-3586-405d-8154-dd4dbe9b2272 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f" status: 200 len: 1198 microversion: 2.1 time: 0.700459 Oct 17 13:39:21.032603 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 751/1461] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:20 2022] GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f => generated 1198 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:21.032603 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e25ad02c-c425-4e67-84df-26354f2ac641 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:21.032603 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e25ad02c-c425-4e67-84df-26354f2ac641 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:21.035153 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e25ad02c-c425-4e67-84df-26354f2ac641 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:21.035666 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e25ad02c-c425-4e67-84df-26354f2ac641 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:21.036095 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e25ad02c-c425-4e67-84df-26354f2ac641 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:21.037195 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e25ad02c-c425-4e67-84df-26354f2ac641 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:21.037647 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e25ad02c-c425-4e67-84df-26354f2ac641 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:21.038545 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e25ad02c-c425-4e67-84df-26354f2ac641 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:21.081607 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-bc50ed45-60ed-427e-88f8-3b55f56d56ef tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:21.090902 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-bc50ed45-60ed-427e-88f8-3b55f56d56ef tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467" status: 200 len: 1473 microversion: 2.1 time: 0.634080 Oct 17 13:39:21.091514 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 711/1462] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:20 2022] GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467 => generated 1473 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:21.210868 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e25ad02c-c425-4e67-84df-26354f2ac641 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:21.221080 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e25ad02c-c425-4e67-84df-26354f2ac641 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:21.223083 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e25ad02c-c425-4e67-84df-26354f2ac641 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:21.226980 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fa6d259b-4839-4a89-8f9c-5ec154f72443 tempest-VolumesAdminNegativeTest-2051731892 tempest-VolumesAdminNegativeTest-2051731892-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "0545828b-ffe3-459a-9e4f-27663a2435de"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:21.229541 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e25ad02c-c425-4e67-84df-26354f2ac641 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1537 microversion: 2.91 time: 0.205569 Oct 17 13:39:21.229964 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-fa6d259b-4839-4a89-8f9c-5ec154f72443 tempest-VolumesAdminNegativeTest-2051731892 tempest-VolumesAdminNegativeTest-2051731892-project-admin] [instance: b8d15c7c-7a1f-43e0-9c41-302172f31ca0] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:21.230300 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 752/1463] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:39:21 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1537 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:39:21.235744 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-dbac56e6-3ce3-41aa-8e47-390c647fbc65 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:21.236710 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-dbac56e6-3ce3-41aa-8e47-390c647fbc65 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 16213741-2241-4f55-b7ca-20ab551e5596] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:21.237293 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fa6d259b-4839-4a89-8f9c-5ec154f72443 tempest-VolumesAdminNegativeTest-2051731892 tempest-VolumesAdminNegativeTest-2051731892-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:21.237967 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fa6d259b-4839-4a89-8f9c-5ec154f72443 tempest-VolumesAdminNegativeTest-2051731892 tempest-VolumesAdminNegativeTest-2051731892-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:21.238575 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fa6d259b-4839-4a89-8f9c-5ec154f72443 tempest-VolumesAdminNegativeTest-2051731892 tempest-VolumesAdminNegativeTest-2051731892-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:21.239502 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fa6d259b-4839-4a89-8f9c-5ec154f72443 tempest-VolumesAdminNegativeTest-2051731892 tempest-VolumesAdminNegativeTest-2051731892-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:21.240100 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fa6d259b-4839-4a89-8f9c-5ec154f72443 tempest-VolumesAdminNegativeTest-2051731892 tempest-VolumesAdminNegativeTest-2051731892-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:21.240661 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fa6d259b-4839-4a89-8f9c-5ec154f72443 tempest-VolumesAdminNegativeTest-2051731892 tempest-VolumesAdminNegativeTest-2051731892-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:21.244497 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dbac56e6-3ce3-41aa-8e47-390c647fbc65 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:21.245348 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:39:21.245617 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dbac56e6-3ce3-41aa-8e47-390c647fbc65 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:21.246152 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dbac56e6-3ce3-41aa-8e47-390c647fbc65 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:21.247075 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dbac56e6-3ce3-41aa-8e47-390c647fbc65 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:21.247784 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dbac56e6-3ce3-41aa-8e47-390c647fbc65 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:21.248491 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dbac56e6-3ce3-41aa-8e47-390c647fbc65 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:21.393673 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-fa6d259b-4839-4a89-8f9c-5ec154f72443 tempest-VolumesAdminNegativeTest-2051731892 tempest-VolumesAdminNegativeTest-2051731892-project-admin] HTTP exception thrown: Volume 0545828b-ffe3-459a-9e4f-27663a2435de could not be found. Oct 17 13:39:21.398291 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fa6d259b-4839-4a89-8f9c-5ec154f72443 tempest-VolumesAdminNegativeTest-2051731892 tempest-VolumesAdminNegativeTest-2051731892-project-admin] Request method failure captured: Oct 17 13:39:21.398291 n-d-854247-14 devstack@n-api.service[127016]: request: PUT /compute/v2.1/servers/b8d15c7c-7a1f-43e0-9c41-302172f31ca0/os-volume_attachments/5d6ff845-01de-41f5-ba4d-2e912a918196 HTTP/1.1 Oct 17 13:39:21.398291 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:39:21.398291 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:39:21.398291 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:39:21.398291 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 74 Oct 17 13:39:21.398291 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:39:21.398291 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:39:21.398291 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:39:21.398291 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:39:21.398291 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVqjJRRApRhv7Znhke9NqevYx0aJnuFYEZqK3h_7w1T0hBTZRbVlHX_cjgPJlzD2Jsf6oBp5agkTRqDv7YyRrg9xe3a3LZIs3-Of5bkt9IrjglHpfXCMGPX5TBS0sL0jcMqY6ng9r8DS0HMz_y2lk33QgKQm_bziQ-ZoriOgGUyIuDg Oct 17 13:39:21.398291 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:39:21.398291 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:39:21.398291 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:39:21.398291 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:39:21.398291 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:39:21.398291 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:39:21.398291 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: ebd56f1255ea4e9db712e8c0f520b6c1 Oct 17 13:39:21.398291 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-VolumesAdminNegativeTest-2051731892 Oct 17 13:39:21.398291 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member,admin Oct 17 13:39:21.398291 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member,admin Oct 17 13:39:21.400086 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ebd56f1255ea4e9db712e8c0f520b6c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ebd56f1255ea4e9db712e8c0f520b6c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ebd56f1255ea4e9db712e8c0f520b6c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ebd56f1255ea4e9db712e8c0f520b6c1", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:39:21.400086 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-VolumesAdminNegativeTest-2051731892 Oct 17 13:39:21.400086 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: ebd56f1255ea4e9db712e8c0f520b6c1 Oct 17 13:39:21.400086 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-2051731892 Oct 17 13:39:21.400086 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-VolumesAdminNegativeTest-2051731892-project-admin Oct 17 13:39:21.400086 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:39:21.400086 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:39:21.400086 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: d5c7b44c059d46bb952082d4f4e637a5 Oct 17 13:39:21.400086 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-VolumesAdminNegativeTest-2051731892-project-admin Oct 17 13:39:21.400086 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:39:21.400086 n-d-854247-14 devstack@n-api.service[127016]: {"volumeAttachment": {"volumeId": "0545828b-ffe3-459a-9e4f-27663a2435de"}} Oct 17 13:39:21.400086 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:39:21.400086 n-d-854247-14 devstack@n-api.service[127016]: exception: Volume 0545828b-ffe3-459a-9e4f-27663a2435de could not be found. Oct 17 13:39:21.400970 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'server_id': 'b8d15c7c-7a1f-43e0-9c41-302172f31ca0', 'id': '5d6ff845-01de-41f5-ba4d-2e912a918196', 'body': {'volumeAttachment': {'volumeId': '0545828b-ffe3-459a-9e4f-27663a2435de'}}} Oct 17 13:39:21.400970 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:39:21.400970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:21.400970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 13:39:21.400970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 13:39:21.400970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 13:39:21.400970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 13:39:21.400970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 13:39:21.400970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 13:39:21.400970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 13:39:21.400970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 13:39:21.400970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 13:39:21.400970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 13:39:21.400970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 13:39:21.400970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 13:39:21.400970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 13:39:21.400970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 13:39:21.402460 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0545828b-ffe3-459a-9e4f-27663a2435de could not be found. (HTTP 404) (Request-ID: req-950758c2-dad6-4571-9d7e-814b7f43ef4a) Oct 17 13:39:21.402460 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:39:21.402460 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:39:21.402460 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:39:21.402460 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:21.402460 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 17 13:39:21.402460 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 17 13:39:21.402460 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 13:39:21.402460 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 13:39:21.402460 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 13:39:21.402460 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 13:39:21.402460 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 13:39:21.402460 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 13:39:21.402460 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 13:39:21.402460 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 13:39:21.402460 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 13:39:21.402460 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 13:39:21.402460 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 13:39:21.402460 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 13:39:21.403719 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 13:39:21.403719 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 13:39:21.403719 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 13:39:21.403719 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 13:39:21.403719 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 13:39:21.403719 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 13:39:21.403719 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 13:39:21.403719 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 13:39:21.403719 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0545828b-ffe3-459a-9e4f-27663a2435de could not be found. Oct 17 13:39:21.403719 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:39:21.403719 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:39:21.403719 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:39:21.403719 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:21.403719 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:39:21.403719 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:39:21.403719 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:39:21.403719 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:39:21.403719 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:39:21.403719 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:39:21.406439 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:39:21.406439 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:39:21.406439 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:39:21.406439 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:39:21.406439 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 17 13:39:21.406439 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 17 13:39:21.406439 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 17 13:39:21.406439 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 17 13:39:21.406439 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 0545828b-ffe3-459a-9e4f-27663a2435de could not be found. Oct 17 13:39:21.406439 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:39:21.406439 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:39:21.406439 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:39:21.406439 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:21.406439 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:39:21.406439 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:39:21.406439 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:39:21.406439 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:39:21.406439 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0545828b-ffe3-459a-9e4f-27663a2435de could not be found. Oct 17 13:39:21.406439 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:39:21.409099 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fa6d259b-4839-4a89-8f9c-5ec154f72443 tempest-VolumesAdminNegativeTest-2051731892 tempest-VolumesAdminNegativeTest-2051731892-project-admin] Returning 400 to user: Volume 0545828b-ffe3-459a-9e4f-27663a2435de could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:39:21.409099 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fa6d259b-4839-4a89-8f9c-5ec154f72443 tempest-VolumesAdminNegativeTest-2051731892 tempest-VolumesAdminNegativeTest-2051731892-project-admin] 10.222.0.79 "PUT /compute/v2.1/servers/b8d15c7c-7a1f-43e0-9c41-302172f31ca0/os-volume_attachments/5d6ff845-01de-41f5-ba4d-2e912a918196" status: 400 len: 107 microversion: 2.1 time: 0.307588 Oct 17 13:39:21.409099 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 712/1464] 10.222.0.79 () {60 vars in 1433 bytes} [Mon Oct 17 13:39:21 2022] PUT /compute/v2.1/servers/b8d15c7c-7a1f-43e0-9c41-302172f31ca0/os-volume_attachments/5d6ff845-01de-41f5-ba4d-2e912a918196 => generated 107 bytes in 309 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:39:21.414760 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8b9e8226-e5ad-49f6-8497-2ef27f7405c5 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:21.414760 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8b9e8226-e5ad-49f6-8497-2ef27f7405c5 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] [instance: 5661197d-b679-48bc-bf2c-11e7b4f962bb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:21.420666 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8b9e8226-e5ad-49f6-8497-2ef27f7405c5 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:21.421235 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8b9e8226-e5ad-49f6-8497-2ef27f7405c5 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:21.421742 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8b9e8226-e5ad-49f6-8497-2ef27f7405c5 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:21.422728 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8b9e8226-e5ad-49f6-8497-2ef27f7405c5 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:21.423345 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8b9e8226-e5ad-49f6-8497-2ef27f7405c5 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:21.423841 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8b9e8226-e5ad-49f6-8497-2ef27f7405c5 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:21.647826 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-dbac56e6-3ce3-41aa-8e47-390c647fbc65 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:21.659716 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-dbac56e6-3ce3-41aa-8e47-390c647fbc65 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:21.662511 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-dbac56e6-3ce3-41aa-8e47-390c647fbc65 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:21.665880 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-dbac56e6-3ce3-41aa-8e47-390c647fbc65 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596" status: 200 len: 1568 microversion: 2.25 time: 0.434191 Oct 17 13:39:21.668163 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 753/1465] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:39:21 2022] GET /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596 => generated 1568 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:39:21.673400 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4bcfe0fe-21dd-46bf-a0e8-e8d150230153 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd6064700>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:21.761650 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4bcfe0fe-21dd-46bf-a0e8-e8d150230153 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/377d98df-8887-4bb0-8a0b-84e4f2dc3871" status: 200 len: 1440 microversion: 2.1 time: 0.091360 Oct 17 13:39:21.763528 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 754/1466] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:39:21 2022] GET /compute/v2.1/images/377d98df-8887-4bb0-8a0b-84e4f2dc3871 => generated 1440 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:21.768526 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4cdc4532-ee87-414c-8072-ea6db59872b4 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:21.769410 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4cdc4532-ee87-414c-8072-ea6db59872b4 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] [instance: b8d15c7c-7a1f-43e0-9c41-302172f31ca0] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:21.777621 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4cdc4532-ee87-414c-8072-ea6db59872b4 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:21.778979 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4cdc4532-ee87-414c-8072-ea6db59872b4 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:21.780139 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4cdc4532-ee87-414c-8072-ea6db59872b4 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:21.781205 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4cdc4532-ee87-414c-8072-ea6db59872b4 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:21.785256 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4cdc4532-ee87-414c-8072-ea6db59872b4 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:21.786037 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4cdc4532-ee87-414c-8072-ea6db59872b4 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:21.829937 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8b9e8226-e5ad-49f6-8497-2ef27f7405c5 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d2462ac744056be55262dacc72de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ed14a8051a4b8fb39d56280a2bcb41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:21.845384 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8b9e8226-e5ad-49f6-8497-2ef27f7405c5 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] 10.222.0.79 "GET /compute/v2.1/servers/5661197d-b679-48bc-bf2c-11e7b4f962bb" status: 200 len: 1325 microversion: 2.1 time: 0.440890 Oct 17 13:39:21.847777 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 713/1467] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:21 2022] GET /compute/v2.1/servers/5661197d-b679-48bc-bf2c-11e7b4f962bb => generated 1325 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:21.980050 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-4cdc4532-ee87-414c-8072-ea6db59872b4 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lazy-loading 'services' on Instance uuid b8d15c7c-7a1f-43e0-9c41-302172f31ca0 {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:39:22.045636 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e509dd49-bd43-4478-994a-3317f08ce951 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:22.046251 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e509dd49-bd43-4478-994a-3317f08ce951 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: fd365dc4-44c6-4a00-971e-2699762ab41f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:22.055218 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e509dd49-bd43-4478-994a-3317f08ce951 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:22.055934 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e509dd49-bd43-4478-994a-3317f08ce951 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:22.056373 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e509dd49-bd43-4478-994a-3317f08ce951 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:22.065147 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e509dd49-bd43-4478-994a-3317f08ce951 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:22.065651 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e509dd49-bd43-4478-994a-3317f08ce951 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:22.066093 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e509dd49-bd43-4478-994a-3317f08ce951 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:22.095989 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4cdc4532-ee87-414c-8072-ea6db59872b4 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] 10.222.0.79 "DELETE /compute/v2.1/servers/b8d15c7c-7a1f-43e0-9c41-302172f31ca0/os-volume_attachments/5d6ff845-01de-41f5-ba4d-2e912a918196" status: 202 len: 0 microversion: 2.1 time: 0.330841 Oct 17 13:39:22.096711 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 755/1468] 10.222.0.79 () {58 vars in 1416 bytes} [Mon Oct 17 13:39:21 2022] DELETE /compute/v2.1/servers/b8d15c7c-7a1f-43e0-9c41-302172f31ca0/os-volume_attachments/5d6ff845-01de-41f5-ba4d-2e912a918196 => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:39:22.136501 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d8a16cfc-b302-48a1-85cc-ce4baf5b6a4d tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:22.138958 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d8a16cfc-b302-48a1-85cc-ce4baf5b6a4d tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] [instance: b8d15c7c-7a1f-43e0-9c41-302172f31ca0] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:22.145524 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d8a16cfc-b302-48a1-85cc-ce4baf5b6a4d tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:22.146031 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d8a16cfc-b302-48a1-85cc-ce4baf5b6a4d tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:22.146583 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d8a16cfc-b302-48a1-85cc-ce4baf5b6a4d tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:22.147415 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d8a16cfc-b302-48a1-85cc-ce4baf5b6a4d tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:22.147873 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d8a16cfc-b302-48a1-85cc-ce4baf5b6a4d tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:22.148298 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d8a16cfc-b302-48a1-85cc-ce4baf5b6a4d tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:22.201706 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d8a16cfc-b302-48a1-85cc-ce4baf5b6a4d tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] 10.222.0.79 "GET /compute/v2.1/servers/b8d15c7c-7a1f-43e0-9c41-302172f31ca0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090332 Oct 17 13:39:22.202519 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 756/1469] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 13:39:22 2022] GET /compute/v2.1/servers/b8d15c7c-7a1f-43e0-9c41-302172f31ca0/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:39:22.206983 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e77dbab9-8595-4d15-8d84-d90a5797045c tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:22.207630 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e77dbab9-8595-4d15-8d84-d90a5797045c tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: ab2b571e-376c-41d3-a778-44bedcaa5467] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:22.214277 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e77dbab9-8595-4d15-8d84-d90a5797045c tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:22.215119 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e77dbab9-8595-4d15-8d84-d90a5797045c tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:22.215796 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e77dbab9-8595-4d15-8d84-d90a5797045c tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:22.216892 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e77dbab9-8595-4d15-8d84-d90a5797045c tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:22.217344 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e77dbab9-8595-4d15-8d84-d90a5797045c tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:22.217761 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e77dbab9-8595-4d15-8d84-d90a5797045c tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:22.601602 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e509dd49-bd43-4478-994a-3317f08ce951 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:22.613063 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e509dd49-bd43-4478-994a-3317f08ce951 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f" status: 200 len: 1198 microversion: 2.1 time: 0.571184 Oct 17 13:39:22.613613 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 714/1470] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:22 2022] GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f => generated 1198 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:39:22.623026 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8273679a-4af9-405e-9d2d-e0ec4285ec9f tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:22.628662 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8273679a-4af9-405e-9d2d-e0ec4285ec9f tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:22.639875 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8273679a-4af9-405e-9d2d-e0ec4285ec9f tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:22.641311 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8273679a-4af9-405e-9d2d-e0ec4285ec9f tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:22.642601 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8273679a-4af9-405e-9d2d-e0ec4285ec9f tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:22.643930 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8273679a-4af9-405e-9d2d-e0ec4285ec9f tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:22.644356 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8273679a-4af9-405e-9d2d-e0ec4285ec9f tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:22.644766 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8273679a-4af9-405e-9d2d-e0ec4285ec9f tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:22.724577 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e77dbab9-8595-4d15-8d84-d90a5797045c tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:22.734987 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e77dbab9-8595-4d15-8d84-d90a5797045c tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467" status: 200 len: 1473 microversion: 2.1 time: 0.531343 Oct 17 13:39:22.739641 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 757/1471] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:22 2022] GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467 => generated 1473 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:22.748378 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c6869924-2fb5-41af-8fc2-00a4620dbbb0 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:22.749755 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c6869924-2fb5-41af-8fc2-00a4620dbbb0 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 16213741-2241-4f55-b7ca-20ab551e5596] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:22.759696 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c6869924-2fb5-41af-8fc2-00a4620dbbb0 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:22.760421 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c6869924-2fb5-41af-8fc2-00a4620dbbb0 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:22.761058 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c6869924-2fb5-41af-8fc2-00a4620dbbb0 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:22.762354 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c6869924-2fb5-41af-8fc2-00a4620dbbb0 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:22.762970 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c6869924-2fb5-41af-8fc2-00a4620dbbb0 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:22.763582 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c6869924-2fb5-41af-8fc2-00a4620dbbb0 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:22.804882 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8273679a-4af9-405e-9d2d-e0ec4285ec9f tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:22.819902 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8273679a-4af9-405e-9d2d-e0ec4285ec9f tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:22.823733 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8273679a-4af9-405e-9d2d-e0ec4285ec9f tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:22.831573 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8273679a-4af9-405e-9d2d-e0ec4285ec9f tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1537 microversion: 2.91 time: 0.216754 Oct 17 13:39:22.832702 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 715/1472] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:39:22 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1537 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:39:22.855510 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-183e8ffb-3dd4-4e40-850b-06009f3bd91f tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd50a0310>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:22.924766 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-183e8ffb-3dd4-4e40-850b-06009f3bd91f tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/377d98df-8887-4bb0-8a0b-84e4f2dc3871" status: 200 len: 1440 microversion: 2.1 time: 0.090417 Oct 17 13:39:22.926737 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 716/1473] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:39:22 2022] GET /compute/v2.1/images/377d98df-8887-4bb0-8a0b-84e4f2dc3871 => generated 1440 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:22.931758 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-979eab90-ae05-4c4a-a82e-e509559abf32 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:22.932933 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-979eab90-ae05-4c4a-a82e-e509559abf32 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] [instance: 5661197d-b679-48bc-bf2c-11e7b4f962bb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:22.940287 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-979eab90-ae05-4c4a-a82e-e509559abf32 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:22.940998 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-979eab90-ae05-4c4a-a82e-e509559abf32 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:22.941604 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-979eab90-ae05-4c4a-a82e-e509559abf32 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:22.942459 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-979eab90-ae05-4c4a-a82e-e509559abf32 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:22.943695 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-979eab90-ae05-4c4a-a82e-e509559abf32 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:22.944292 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-979eab90-ae05-4c4a-a82e-e509559abf32 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:23.373145 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c6869924-2fb5-41af-8fc2-00a4620dbbb0 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:23.394485 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c6869924-2fb5-41af-8fc2-00a4620dbbb0 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:23.396578 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c6869924-2fb5-41af-8fc2-00a4620dbbb0 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:23.398179 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c6869924-2fb5-41af-8fc2-00a4620dbbb0 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596" status: 200 len: 1568 microversion: 2.25 time: 0.656613 Oct 17 13:39:23.398951 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 758/1474] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:39:22 2022] GET /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596 => generated 1568 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:39:23.404388 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-81e4276f-1adb-4cdf-a9bb-be01127eaad0 req-7a6816ab-80c3-418e-9ba0-c79c5008cc53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16213741-2241-4f55-b7ca-20ab551e5596", "name": "network-vif-unplugged", "status": "completed", "tag": "216dd503-7afa-42cd-aafc-f62df426ee70"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:23.433590 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-81e4276f-1adb-4cdf-a9bb-be01127eaad0 req-7a6816ab-80c3-418e-9ba0-c79c5008cc53 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:23.443848 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-81e4276f-1adb-4cdf-a9bb-be01127eaad0 req-7a6816ab-80c3-418e-9ba0-c79c5008cc53 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:23.444298 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-81e4276f-1adb-4cdf-a9bb-be01127eaad0 req-7a6816ab-80c3-418e-9ba0-c79c5008cc53 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:23.460166 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-81e4276f-1adb-4cdf-a9bb-be01127eaad0 req-7a6816ab-80c3-418e-9ba0-c79c5008cc53 service nova] Creating event network-vif-unplugged:216dd503-7afa-42cd-aafc-f62df426ee70 for instance 16213741-2241-4f55-b7ca-20ab551e5596 on n-h1-854247-14 Oct 17 13:39:23.466984 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-81e4276f-1adb-4cdf-a9bb-be01127eaad0 req-7a6816ab-80c3-418e-9ba0-c79c5008cc53 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066302 Oct 17 13:39:23.468986 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 759/1475] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:39:23.477411 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8b091e64-58da-41ea-bce9-18d65cbd4cd3 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:23.481115 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8b091e64-58da-41ea-bce9-18d65cbd4cd3 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] [instance: b8d15c7c-7a1f-43e0-9c41-302172f31ca0] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:23.489092 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8b091e64-58da-41ea-bce9-18d65cbd4cd3 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:23.490077 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8b091e64-58da-41ea-bce9-18d65cbd4cd3 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:23.490757 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8b091e64-58da-41ea-bce9-18d65cbd4cd3 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:23.491865 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8b091e64-58da-41ea-bce9-18d65cbd4cd3 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:23.492533 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8b091e64-58da-41ea-bce9-18d65cbd4cd3 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:23.493250 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8b091e64-58da-41ea-bce9-18d65cbd4cd3 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:23.572614 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-979eab90-ae05-4c4a-a82e-e509559abf32 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d2462ac744056be55262dacc72de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ed14a8051a4b8fb39d56280a2bcb41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:23.574030 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8b091e64-58da-41ea-bce9-18d65cbd4cd3 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] 10.222.0.79 "GET /compute/v2.1/servers/b8d15c7c-7a1f-43e0-9c41-302172f31ca0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103468 Oct 17 13:39:23.582667 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 760/1476] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 13:39:23 2022] GET /compute/v2.1/servers/b8d15c7c-7a1f-43e0-9c41-302172f31ca0/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:39:23.597359 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-979eab90-ae05-4c4a-a82e-e509559abf32 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] 10.222.0.79 "GET /compute/v2.1/servers/5661197d-b679-48bc-bf2c-11e7b4f962bb" status: 200 len: 1325 microversion: 2.1 time: 0.668217 Oct 17 13:39:23.623336 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 717/1477] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:22 2022] GET /compute/v2.1/servers/5661197d-b679-48bc-bf2c-11e7b4f962bb => generated 1325 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:23.645382 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-889bf867-d1d6-40a9-9ba7-03167f2bf30a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:23.646761 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-889bf867-d1d6-40a9-9ba7-03167f2bf30a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: fd365dc4-44c6-4a00-971e-2699762ab41f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:23.654576 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-889bf867-d1d6-40a9-9ba7-03167f2bf30a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:23.662183 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-889bf867-d1d6-40a9-9ba7-03167f2bf30a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:23.663821 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-889bf867-d1d6-40a9-9ba7-03167f2bf30a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:23.664769 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-889bf867-d1d6-40a9-9ba7-03167f2bf30a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:23.668671 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-889bf867-d1d6-40a9-9ba7-03167f2bf30a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:23.669939 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-889bf867-d1d6-40a9-9ba7-03167f2bf30a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:23.765099 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-97305aae-1274-480b-9daf-511a5acf895a tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:23.765920 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-97305aae-1274-480b-9daf-511a5acf895a tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: ab2b571e-376c-41d3-a778-44bedcaa5467] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:23.785147 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-97305aae-1274-480b-9daf-511a5acf895a tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:23.785930 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-97305aae-1274-480b-9daf-511a5acf895a tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:23.786547 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-97305aae-1274-480b-9daf-511a5acf895a tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:23.787300 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-97305aae-1274-480b-9daf-511a5acf895a tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:23.787756 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-97305aae-1274-480b-9daf-511a5acf895a tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:23.788178 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-97305aae-1274-480b-9daf-511a5acf895a tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:24.350092 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-97305aae-1274-480b-9daf-511a5acf895a tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:24.359029 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-97305aae-1274-480b-9daf-511a5acf895a tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467" status: 200 len: 1473 microversion: 2.1 time: 0.598309 Oct 17 13:39:24.367260 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 718/1478] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:23 2022] GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467 => generated 1473 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:24.372807 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-96e1f3eb-0b7f-4232-8288-bc660a163d89 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:24.381575 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-96e1f3eb-0b7f-4232-8288-bc660a163d89 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:24.396269 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-96e1f3eb-0b7f-4232-8288-bc660a163d89 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:24.396970 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-96e1f3eb-0b7f-4232-8288-bc660a163d89 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:24.398704 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-96e1f3eb-0b7f-4232-8288-bc660a163d89 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:24.400529 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-889bf867-d1d6-40a9-9ba7-03167f2bf30a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:24.401275 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-96e1f3eb-0b7f-4232-8288-bc660a163d89 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:24.401935 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-96e1f3eb-0b7f-4232-8288-bc660a163d89 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:24.403484 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-96e1f3eb-0b7f-4232-8288-bc660a163d89 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:24.409245 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-889bf867-d1d6-40a9-9ba7-03167f2bf30a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f" status: 200 len: 1198 microversion: 2.1 time: 0.768652 Oct 17 13:39:24.409828 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 761/1479] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:23 2022] GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f => generated 1198 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:24.436428 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a7567bd8-b102-424d-8f52-f9cf54a79faa tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd56029d0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:24.512579 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a7567bd8-b102-424d-8f52-f9cf54a79faa tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/377d98df-8887-4bb0-8a0b-84e4f2dc3871" status: 200 len: 1440 microversion: 2.1 time: 0.080092 Oct 17 13:39:24.514248 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 762/1480] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:39:24 2022] GET /compute/v2.1/images/377d98df-8887-4bb0-8a0b-84e4f2dc3871 => generated 1440 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:24.519054 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-bebf607f-c784-4961-b8b4-27641aaa1508 req-ba6745e6-0d68-4566-8ae2-0bb7f475f328 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d78e88b4-522f-4e6e-bcaa-dc259d9b8c89", "name": "network-vif-plugged", "status": "completed", "tag": "6bcd59a8-7ecc-4515-bd57-70d42b0ae40f"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:24.530221 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-bebf607f-c784-4961-b8b4-27641aaa1508 req-ba6745e6-0d68-4566-8ae2-0bb7f475f328 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:24.531042 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-bebf607f-c784-4961-b8b4-27641aaa1508 req-ba6745e6-0d68-4566-8ae2-0bb7f475f328 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:24.532328 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-bebf607f-c784-4961-b8b4-27641aaa1508 req-ba6745e6-0d68-4566-8ae2-0bb7f475f328 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:24.537015 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-96e1f3eb-0b7f-4232-8288-bc660a163d89 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:24.560567 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-96e1f3eb-0b7f-4232-8288-bc660a163d89 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:24.563377 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-96e1f3eb-0b7f-4232-8288-bc660a163d89 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:24.577374 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-96e1f3eb-0b7f-4232-8288-bc660a163d89 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1537 microversion: 2.91 time: 0.208546 Oct 17 13:39:24.581175 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 719/1481] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:39:24 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1537 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:39:24.589676 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-bebf607f-c784-4961-b8b4-27641aaa1508 req-ba6745e6-0d68-4566-8ae2-0bb7f475f328 service nova] Creating event network-vif-plugged:6bcd59a8-7ecc-4515-bd57-70d42b0ae40f for instance d78e88b4-522f-4e6e-bcaa-dc259d9b8c89 on n-h1-854247-14 Oct 17 13:39:24.597100 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e9303b38-e6b7-4828-84dd-68e0d53f1e7f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:24.598065 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e9303b38-e6b7-4828-84dd-68e0d53f1e7f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 16213741-2241-4f55-b7ca-20ab551e5596] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:24.599200 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-bebf607f-c784-4961-b8b4-27641aaa1508 req-ba6745e6-0d68-4566-8ae2-0bb7f475f328 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083439 Oct 17 13:39:24.610758 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 763/1482] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:39:24.613655 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9303b38-e6b7-4828-84dd-68e0d53f1e7f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:24.614161 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9303b38-e6b7-4828-84dd-68e0d53f1e7f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:24.614591 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9303b38-e6b7-4828-84dd-68e0d53f1e7f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:24.615342 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9303b38-e6b7-4828-84dd-68e0d53f1e7f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:24.615795 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9303b38-e6b7-4828-84dd-68e0d53f1e7f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:24.616213 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9303b38-e6b7-4828-84dd-68e0d53f1e7f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:24.619401 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ecca42d5-1ec7-419f-a9dc-c115ba94721d tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:24.621998 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ecca42d5-1ec7-419f-a9dc-c115ba94721d tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] [instance: b8d15c7c-7a1f-43e0-9c41-302172f31ca0] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:24.639070 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:39:24.640803 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ecca42d5-1ec7-419f-a9dc-c115ba94721d tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:24.641389 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ecca42d5-1ec7-419f-a9dc-c115ba94721d tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:24.651749 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ecca42d5-1ec7-419f-a9dc-c115ba94721d tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:24.652826 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ecca42d5-1ec7-419f-a9dc-c115ba94721d tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:24.653460 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ecca42d5-1ec7-419f-a9dc-c115ba94721d tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:24.654082 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ecca42d5-1ec7-419f-a9dc-c115ba94721d tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:24.733625 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:39:24.740891 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ecca42d5-1ec7-419f-a9dc-c115ba94721d tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] 10.222.0.79 "GET /compute/v2.1/servers/b8d15c7c-7a1f-43e0-9c41-302172f31ca0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128661 Oct 17 13:39:24.746304 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 764/1483] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 13:39:24 2022] GET /compute/v2.1/servers/b8d15c7c-7a1f-43e0-9c41-302172f31ca0/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:39:24.752769 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-87edde22-60b0-48af-90b5-56d635349c21 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:24.758043 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-87edde22-60b0-48af-90b5-56d635349c21 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] [instance: 5661197d-b679-48bc-bf2c-11e7b4f962bb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:24.768757 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=6 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:39:24.770889 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-87edde22-60b0-48af-90b5-56d635349c21 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:24.771571 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-87edde22-60b0-48af-90b5-56d635349c21 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:24.772225 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-87edde22-60b0-48af-90b5-56d635349c21 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:24.773135 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-87edde22-60b0-48af-90b5-56d635349c21 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:24.773968 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-87edde22-60b0-48af-90b5-56d635349c21 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:24.775291 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-87edde22-60b0-48af-90b5-56d635349c21 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:25.344451 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e9303b38-e6b7-4828-84dd-68e0d53f1e7f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:25.375057 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e9303b38-e6b7-4828-84dd-68e0d53f1e7f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:25.376678 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e9303b38-e6b7-4828-84dd-68e0d53f1e7f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:25.377907 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e9303b38-e6b7-4828-84dd-68e0d53f1e7f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596" status: 200 len: 1568 microversion: 2.25 time: 0.795481 Oct 17 13:39:25.378476 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 720/1484] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:39:24 2022] GET /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596 => generated 1568 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:39:25.405490 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5437dc31-236d-4dec-b147-6e9eecd1daa0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:25.409069 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5437dc31-236d-4dec-b147-6e9eecd1daa0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: ab2b571e-376c-41d3-a778-44bedcaa5467] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:25.424400 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5437dc31-236d-4dec-b147-6e9eecd1daa0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:25.429179 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5437dc31-236d-4dec-b147-6e9eecd1daa0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:25.430103 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5437dc31-236d-4dec-b147-6e9eecd1daa0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:25.431217 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5437dc31-236d-4dec-b147-6e9eecd1daa0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:25.431860 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5437dc31-236d-4dec-b147-6e9eecd1daa0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:25.432261 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5437dc31-236d-4dec-b147-6e9eecd1daa0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:25.436292 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:39:25.608723 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-87edde22-60b0-48af-90b5-56d635349c21 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d2462ac744056be55262dacc72de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ed14a8051a4b8fb39d56280a2bcb41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:25.613477 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=4 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:39:25.627602 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-87edde22-60b0-48af-90b5-56d635349c21 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] 10.222.0.79 "GET /compute/v2.1/servers/5661197d-b679-48bc-bf2c-11e7b4f962bb" status: 200 len: 1325 microversion: 2.1 time: 0.879752 Oct 17 13:39:25.644039 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 765/1485] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:24 2022] GET /compute/v2.1/servers/5661197d-b679-48bc-bf2c-11e7b4f962bb => generated 1325 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:25.652376 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-61732452-d7f7-4dd1-a023-9b2ff351d237 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:25.653965 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-61732452-d7f7-4dd1-a023-9b2ff351d237 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: fd365dc4-44c6-4a00-971e-2699762ab41f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:25.661150 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-61732452-d7f7-4dd1-a023-9b2ff351d237 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:25.661921 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-61732452-d7f7-4dd1-a023-9b2ff351d237 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:25.663030 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-61732452-d7f7-4dd1-a023-9b2ff351d237 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:25.664309 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-61732452-d7f7-4dd1-a023-9b2ff351d237 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:25.665184 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-61732452-d7f7-4dd1-a023-9b2ff351d237 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:25.665917 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-61732452-d7f7-4dd1-a023-9b2ff351d237 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:25.897419 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5437dc31-236d-4dec-b147-6e9eecd1daa0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:25.906009 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5437dc31-236d-4dec-b147-6e9eecd1daa0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467" status: 200 len: 1473 microversion: 2.1 time: 0.520606 Oct 17 13:39:25.913067 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 721/1486] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:25 2022] GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467 => generated 1473 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:25.918651 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-749ecd80-8ec9-49cf-b6b3-4578f81b51c4 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd50a7280>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:26.026387 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-749ecd80-8ec9-49cf-b6b3-4578f81b51c4 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/377d98df-8887-4bb0-8a0b-84e4f2dc3871" status: 200 len: 1440 microversion: 2.1 time: 0.110227 Oct 17 13:39:26.026639 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-61732452-d7f7-4dd1-a023-9b2ff351d237 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:26.032006 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 722/1487] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:39:25 2022] GET /compute/v2.1/images/377d98df-8887-4bb0-8a0b-84e4f2dc3871 => generated 1440 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:26.037070 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-16038901-b3d3-4dc1-8431-48071a8ff4ca tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:26.040090 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-16038901-b3d3-4dc1-8431-48071a8ff4ca tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:26.040572 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-61732452-d7f7-4dd1-a023-9b2ff351d237 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f" status: 200 len: 1198 microversion: 2.1 time: 0.394710 Oct 17 13:39:26.041184 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 766/1488] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:25 2022] GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f => generated 1198 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:26.045842 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-5117872f-55f9-415b-8806-c8625b054055 req-f625f601-d715-4639-b0ff-2b84f74005db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16213741-2241-4f55-b7ca-20ab551e5596", "tag": "216dd503-7afa-42cd-aafc-f62df426ee70"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:26.052305 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-16038901-b3d3-4dc1-8431-48071a8ff4ca tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:26.056977 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-16038901-b3d3-4dc1-8431-48071a8ff4ca tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:26.057590 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-16038901-b3d3-4dc1-8431-48071a8ff4ca tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:26.058435 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-16038901-b3d3-4dc1-8431-48071a8ff4ca tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:26.059002 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-16038901-b3d3-4dc1-8431-48071a8ff4ca tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:26.059556 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-16038901-b3d3-4dc1-8431-48071a8ff4ca tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:26.071807 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-5117872f-55f9-415b-8806-c8625b054055 req-f625f601-d715-4639-b0ff-2b84f74005db service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:26.072287 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-5117872f-55f9-415b-8806-c8625b054055 req-f625f601-d715-4639-b0ff-2b84f74005db service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:26.077839 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-5117872f-55f9-415b-8806-c8625b054055 req-f625f601-d715-4639-b0ff-2b84f74005db service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:26.102410 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-5117872f-55f9-415b-8806-c8625b054055 req-f625f601-d715-4639-b0ff-2b84f74005db service nova] Creating event network-changed:216dd503-7afa-42cd-aafc-f62df426ee70 for instance 16213741-2241-4f55-b7ca-20ab551e5596 on n-h1-854247-14 Oct 17 13:39:26.114956 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-5117872f-55f9-415b-8806-c8625b054055 req-f625f601-d715-4639-b0ff-2b84f74005db service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072054 Oct 17 13:39:26.120048 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 767/1489] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:39:26.126669 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8089c95c-e034-4afd-908e-d14ee7c70628 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:26.137542 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8089c95c-e034-4afd-908e-d14ee7c70628 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] [instance: b8d15c7c-7a1f-43e0-9c41-302172f31ca0] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:26.159345 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8089c95c-e034-4afd-908e-d14ee7c70628 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:26.160671 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8089c95c-e034-4afd-908e-d14ee7c70628 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:26.161862 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8089c95c-e034-4afd-908e-d14ee7c70628 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:26.163317 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8089c95c-e034-4afd-908e-d14ee7c70628 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:26.164127 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8089c95c-e034-4afd-908e-d14ee7c70628 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:26.165324 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8089c95c-e034-4afd-908e-d14ee7c70628 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:26.228659 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-16038901-b3d3-4dc1-8431-48071a8ff4ca tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:26.247323 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8089c95c-e034-4afd-908e-d14ee7c70628 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] 10.222.0.79 "GET /compute/v2.1/servers/b8d15c7c-7a1f-43e0-9c41-302172f31ca0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125195 Oct 17 13:39:26.247672 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-16038901-b3d3-4dc1-8431-48071a8ff4ca tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:26.249509 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-16038901-b3d3-4dc1-8431-48071a8ff4ca tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:26.249674 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 768/1490] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 13:39:26 2022] GET /compute/v2.1/servers/b8d15c7c-7a1f-43e0-9c41-302172f31ca0/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:39:26.265178 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-16038901-b3d3-4dc1-8431-48071a8ff4ca tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1537 microversion: 2.91 time: 0.222342 Oct 17 13:39:26.266296 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 723/1491] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:39:26 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1537 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:39:26.407293 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-69c5d188-b814-4aab-8461-37c90a14d30f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:26.407914 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-69c5d188-b814-4aab-8461-37c90a14d30f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 16213741-2241-4f55-b7ca-20ab551e5596] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:26.420800 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69c5d188-b814-4aab-8461-37c90a14d30f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:26.422002 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69c5d188-b814-4aab-8461-37c90a14d30f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:26.422473 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69c5d188-b814-4aab-8461-37c90a14d30f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:26.425360 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69c5d188-b814-4aab-8461-37c90a14d30f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:26.425822 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69c5d188-b814-4aab-8461-37c90a14d30f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:26.426259 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69c5d188-b814-4aab-8461-37c90a14d30f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:26.656322 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-df1e8df3-4938-4cb9-b622-774022d8b021 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:26.657058 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-df1e8df3-4938-4cb9-b622-774022d8b021 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] [instance: 5661197d-b679-48bc-bf2c-11e7b4f962bb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:26.674638 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df1e8df3-4938-4cb9-b622-774022d8b021 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:26.675282 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df1e8df3-4938-4cb9-b622-774022d8b021 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:26.675735 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df1e8df3-4938-4cb9-b622-774022d8b021 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:26.682911 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df1e8df3-4938-4cb9-b622-774022d8b021 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:26.683668 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df1e8df3-4938-4cb9-b622-774022d8b021 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:26.684280 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df1e8df3-4938-4cb9-b622-774022d8b021 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:27.014095 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-df1e8df3-4938-4cb9-b622-774022d8b021 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d2462ac744056be55262dacc72de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ed14a8051a4b8fb39d56280a2bcb41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:27.023073 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-df1e8df3-4938-4cb9-b622-774022d8b021 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] 10.222.0.79 "GET /compute/v2.1/servers/5661197d-b679-48bc-bf2c-11e7b4f962bb" status: 200 len: 1325 microversion: 2.1 time: 0.370874 Oct 17 13:39:27.026758 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 724/1492] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:26 2022] GET /compute/v2.1/servers/5661197d-b679-48bc-bf2c-11e7b4f962bb => generated 1325 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:39:27.031960 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-16875685-e041-4182-937b-580dca40f27b tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:27.032785 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-16875685-e041-4182-937b-580dca40f27b tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: ab2b571e-376c-41d3-a778-44bedcaa5467] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:27.039457 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-16875685-e041-4182-937b-580dca40f27b tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:27.042689 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-16875685-e041-4182-937b-580dca40f27b tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:27.043418 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-16875685-e041-4182-937b-580dca40f27b tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:27.044338 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-16875685-e041-4182-937b-580dca40f27b tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:27.045104 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-16875685-e041-4182-937b-580dca40f27b tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:27.045678 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-16875685-e041-4182-937b-580dca40f27b tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:27.237926 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-69c5d188-b814-4aab-8461-37c90a14d30f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:27.251011 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-69c5d188-b814-4aab-8461-37c90a14d30f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:27.256619 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-69c5d188-b814-4aab-8461-37c90a14d30f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:27.257998 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-69c5d188-b814-4aab-8461-37c90a14d30f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596" status: 200 len: 1568 microversion: 2.25 time: 0.855185 Oct 17 13:39:27.258416 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 769/1493] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:39:26 2022] GET /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596 => generated 1568 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:39:27.278529 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-acd0d977-3b81-4428-9343-6caa1ade5daf tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd57919d0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:27.363047 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-acd0d977-3b81-4428-9343-6caa1ade5daf tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/377d98df-8887-4bb0-8a0b-84e4f2dc3871" status: 200 len: 1440 microversion: 2.1 time: 0.093691 Oct 17 13:39:27.364120 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 770/1494] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:39:27 2022] GET /compute/v2.1/images/377d98df-8887-4bb0-8a0b-84e4f2dc3871 => generated 1440 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:27.381788 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-65abdfbb-e33f-496a-aee1-cbdcbb35ef8d tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:27.382742 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-65abdfbb-e33f-496a-aee1-cbdcbb35ef8d tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: fd365dc4-44c6-4a00-971e-2699762ab41f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:27.408351 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-65abdfbb-e33f-496a-aee1-cbdcbb35ef8d tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:27.408856 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-65abdfbb-e33f-496a-aee1-cbdcbb35ef8d tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:27.409297 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-65abdfbb-e33f-496a-aee1-cbdcbb35ef8d tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:27.410018 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-65abdfbb-e33f-496a-aee1-cbdcbb35ef8d tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:27.410470 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-65abdfbb-e33f-496a-aee1-cbdcbb35ef8d tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:27.410895 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-65abdfbb-e33f-496a-aee1-cbdcbb35ef8d tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:27.838161 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-16875685-e041-4182-937b-580dca40f27b tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:27.851820 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-16875685-e041-4182-937b-580dca40f27b tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467" status: 200 len: 1473 microversion: 2.1 time: 0.819700 Oct 17 13:39:27.869179 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 725/1495] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:27 2022] GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467 => generated 1473 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:27.875358 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-a6a3bb2f-5b6a-4583-8ba5-64676b297fca req-72a52b57-bc64-4ec0-a089-2567ea54ea9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5661197d-b679-48bc-bf2c-11e7b4f962bb", "name": "network-vif-plugged", "status": "completed", "tag": "a47f4bb8-acbd-43ec-91bb-a63ad37997b8"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:27.887858 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-a6a3bb2f-5b6a-4583-8ba5-64676b297fca req-72a52b57-bc64-4ec0-a089-2567ea54ea9d service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:27.888715 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-a6a3bb2f-5b6a-4583-8ba5-64676b297fca req-72a52b57-bc64-4ec0-a089-2567ea54ea9d service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:27.889787 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-a6a3bb2f-5b6a-4583-8ba5-64676b297fca req-72a52b57-bc64-4ec0-a089-2567ea54ea9d service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:27.927407 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-a6a3bb2f-5b6a-4583-8ba5-64676b297fca req-72a52b57-bc64-4ec0-a089-2567ea54ea9d service nova] Creating event network-vif-plugged:a47f4bb8-acbd-43ec-91bb-a63ad37997b8 for instance 5661197d-b679-48bc-bf2c-11e7b4f962bb on n-h1-854247-14 Oct 17 13:39:27.935410 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-a6a3bb2f-5b6a-4583-8ba5-64676b297fca req-72a52b57-bc64-4ec0-a089-2567ea54ea9d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064315 Oct 17 13:39:27.937937 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 726/1496] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:39:27.978408 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c0b7d053-3e90-4144-a59e-898d8886f0c8 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:27.983277 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c0b7d053-3e90-4144-a59e-898d8886f0c8 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] [instance: b8d15c7c-7a1f-43e0-9c41-302172f31ca0] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:27.993891 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c0b7d053-3e90-4144-a59e-898d8886f0c8 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:27.995117 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c0b7d053-3e90-4144-a59e-898d8886f0c8 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:27.995784 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c0b7d053-3e90-4144-a59e-898d8886f0c8 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:27.996754 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c0b7d053-3e90-4144-a59e-898d8886f0c8 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:27.997399 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c0b7d053-3e90-4144-a59e-898d8886f0c8 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:27.999278 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c0b7d053-3e90-4144-a59e-898d8886f0c8 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:28.106597 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c0b7d053-3e90-4144-a59e-898d8886f0c8 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] 10.222.0.79 "GET /compute/v2.1/servers/b8d15c7c-7a1f-43e0-9c41-302172f31ca0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.165254 Oct 17 13:39:28.108782 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 727/1497] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 13:39:27 2022] GET /compute/v2.1/servers/b8d15c7c-7a1f-43e0-9c41-302172f31ca0/os-volume_attachments => generated 197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:39:28.121173 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8426f126-d852-4a8a-b5f5-eab078a586e0 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:28.121773 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8426f126-d852-4a8a-b5f5-eab078a586e0 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:28.140040 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8426f126-d852-4a8a-b5f5-eab078a586e0 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:28.140542 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8426f126-d852-4a8a-b5f5-eab078a586e0 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:28.140967 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8426f126-d852-4a8a-b5f5-eab078a586e0 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:28.142725 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8426f126-d852-4a8a-b5f5-eab078a586e0 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:28.143394 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8426f126-d852-4a8a-b5f5-eab078a586e0 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:28.148329 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8426f126-d852-4a8a-b5f5-eab078a586e0 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:28.186869 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-65abdfbb-e33f-496a-aee1-cbdcbb35ef8d tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:28.201591 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-65abdfbb-e33f-496a-aee1-cbdcbb35ef8d tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f" status: 200 len: 1198 microversion: 2.1 time: 0.826662 Oct 17 13:39:28.219574 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 771/1498] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:27 2022] GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f => generated 1198 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:28.228287 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-375e3ee7-a4ae-4afd-bb57-edcd6e12e2cb tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:28.236057 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-375e3ee7-a4ae-4afd-bb57-edcd6e12e2cb tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] [instance: 5661197d-b679-48bc-bf2c-11e7b4f962bb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:28.251877 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-375e3ee7-a4ae-4afd-bb57-edcd6e12e2cb tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:28.253076 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-375e3ee7-a4ae-4afd-bb57-edcd6e12e2cb tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:28.253686 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-375e3ee7-a4ae-4afd-bb57-edcd6e12e2cb tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:28.254573 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-375e3ee7-a4ae-4afd-bb57-edcd6e12e2cb tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:28.255203 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-375e3ee7-a4ae-4afd-bb57-edcd6e12e2cb tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:28.255782 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-375e3ee7-a4ae-4afd-bb57-edcd6e12e2cb tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:28.324843 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8426f126-d852-4a8a-b5f5-eab078a586e0 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:28.340982 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8426f126-d852-4a8a-b5f5-eab078a586e0 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:28.343424 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8426f126-d852-4a8a-b5f5-eab078a586e0 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:28.350198 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8426f126-d852-4a8a-b5f5-eab078a586e0 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1537 microversion: 2.91 time: 0.238684 Oct 17 13:39:28.351754 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 728/1499] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:39:28 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1537 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:39:28.371489 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0e2e08d2-1fef-4eb6-b79b-ecf1618e4103 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:28.372677 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0e2e08d2-1fef-4eb6-b79b-ecf1618e4103 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 16213741-2241-4f55-b7ca-20ab551e5596] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:28.381291 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0e2e08d2-1fef-4eb6-b79b-ecf1618e4103 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:28.382186 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0e2e08d2-1fef-4eb6-b79b-ecf1618e4103 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:28.382866 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0e2e08d2-1fef-4eb6-b79b-ecf1618e4103 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:28.384398 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0e2e08d2-1fef-4eb6-b79b-ecf1618e4103 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:28.385229 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0e2e08d2-1fef-4eb6-b79b-ecf1618e4103 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:28.386139 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0e2e08d2-1fef-4eb6-b79b-ecf1618e4103 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:28.606254 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-375e3ee7-a4ae-4afd-bb57-edcd6e12e2cb tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d2462ac744056be55262dacc72de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ed14a8051a4b8fb39d56280a2bcb41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:28.615636 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-375e3ee7-a4ae-4afd-bb57-edcd6e12e2cb tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] 10.222.0.79 "GET /compute/v2.1/servers/5661197d-b679-48bc-bf2c-11e7b4f962bb" status: 200 len: 1325 microversion: 2.1 time: 0.394614 Oct 17 13:39:28.616220 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 772/1500] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:28 2022] GET /compute/v2.1/servers/5661197d-b679-48bc-bf2c-11e7b4f962bb => generated 1325 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:28.632735 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6b064b20-5836-4312-abf6-9176ecc865ef tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd579dee0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:28.679840 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0e2e08d2-1fef-4eb6-b79b-ecf1618e4103 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:28.697378 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0e2e08d2-1fef-4eb6-b79b-ecf1618e4103 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:28.702168 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0e2e08d2-1fef-4eb6-b79b-ecf1618e4103 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:28.704691 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6b064b20-5836-4312-abf6-9176ecc865ef tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/377d98df-8887-4bb0-8a0b-84e4f2dc3871" status: 200 len: 1440 microversion: 2.1 time: 0.086946 Oct 17 13:39:28.705281 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 773/1501] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:39:28 2022] GET /compute/v2.1/images/377d98df-8887-4bb0-8a0b-84e4f2dc3871 => generated 1440 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:28.705433 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0e2e08d2-1fef-4eb6-b79b-ecf1618e4103 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596" status: 200 len: 1568 microversion: 2.25 time: 0.349305 Oct 17 13:39:28.706081 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 729/1502] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:39:28 2022] GET /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596 => generated 1568 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:39:28.879370 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9c44f605-91b5-47cc-9b68-8a37ac56b3d4 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:28.880386 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9c44f605-91b5-47cc-9b68-8a37ac56b3d4 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: ab2b571e-376c-41d3-a778-44bedcaa5467] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:28.895758 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9c44f605-91b5-47cc-9b68-8a37ac56b3d4 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:28.896536 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9c44f605-91b5-47cc-9b68-8a37ac56b3d4 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:28.897177 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9c44f605-91b5-47cc-9b68-8a37ac56b3d4 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:28.901068 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9c44f605-91b5-47cc-9b68-8a37ac56b3d4 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:28.901899 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9c44f605-91b5-47cc-9b68-8a37ac56b3d4 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:28.902530 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9c44f605-91b5-47cc-9b68-8a37ac56b3d4 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:29.127817 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-33df1311-4de0-4133-9472-17bf6280b80e tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:29.132222 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-33df1311-4de0-4133-9472-17bf6280b80e tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] [instance: b8d15c7c-7a1f-43e0-9c41-302172f31ca0] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:29.150867 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-33df1311-4de0-4133-9472-17bf6280b80e tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:29.151581 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-33df1311-4de0-4133-9472-17bf6280b80e tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:29.157506 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-33df1311-4de0-4133-9472-17bf6280b80e tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:29.159192 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-33df1311-4de0-4133-9472-17bf6280b80e tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:29.160254 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-33df1311-4de0-4133-9472-17bf6280b80e tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:29.160862 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-33df1311-4de0-4133-9472-17bf6280b80e tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:29.182726 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9c44f605-91b5-47cc-9b68-8a37ac56b3d4 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:29.191836 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9c44f605-91b5-47cc-9b68-8a37ac56b3d4 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467" status: 200 len: 1473 microversion: 2.1 time: 0.317080 Oct 17 13:39:29.195707 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 774/1503] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:28 2022] GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467 => generated 1473 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:29.228043 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f881930c-7549-401b-a169-d11b84167b4b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:29.228668 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f881930c-7549-401b-a169-d11b84167b4b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: fd365dc4-44c6-4a00-971e-2699762ab41f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:29.242457 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f881930c-7549-401b-a169-d11b84167b4b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:29.243255 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f881930c-7549-401b-a169-d11b84167b4b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:29.243486 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f881930c-7549-401b-a169-d11b84167b4b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:29.244202 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f881930c-7549-401b-a169-d11b84167b4b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:29.244654 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f881930c-7549-401b-a169-d11b84167b4b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:29.245092 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f881930c-7549-401b-a169-d11b84167b4b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:29.263467 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-33df1311-4de0-4133-9472-17bf6280b80e tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] 10.222.0.79 "GET /compute/v2.1/servers/b8d15c7c-7a1f-43e0-9c41-302172f31ca0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.146896 Oct 17 13:39:29.268183 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 730/1504] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 13:39:29 2022] GET /compute/v2.1/servers/b8d15c7c-7a1f-43e0-9c41-302172f31ca0/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:39:29.378920 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2dfc13c5-75ae-421e-9191-98b11f85c144 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:29.379678 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2dfc13c5-75ae-421e-9191-98b11f85c144 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:29.390861 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2dfc13c5-75ae-421e-9191-98b11f85c144 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:29.396757 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2dfc13c5-75ae-421e-9191-98b11f85c144 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:29.397705 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2dfc13c5-75ae-421e-9191-98b11f85c144 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:29.400813 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2dfc13c5-75ae-421e-9191-98b11f85c144 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:29.403981 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2dfc13c5-75ae-421e-9191-98b11f85c144 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:29.404500 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2dfc13c5-75ae-421e-9191-98b11f85c144 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:29.437433 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f881930c-7549-401b-a169-d11b84167b4b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:29.452483 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f881930c-7549-401b-a169-d11b84167b4b tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f" status: 200 len: 1198 microversion: 2.1 time: 0.230165 Oct 17 13:39:29.470080 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 775/1505] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:29 2022] GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f => generated 1198 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:29.579060 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2dfc13c5-75ae-421e-9191-98b11f85c144 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:29.583586 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=100 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:39:29.614361 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2dfc13c5-75ae-421e-9191-98b11f85c144 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:29.617118 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2dfc13c5-75ae-421e-9191-98b11f85c144 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:29.635331 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2dfc13c5-75ae-421e-9191-98b11f85c144 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1537 microversion: 2.91 time: 0.260553 Oct 17 13:39:29.638146 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 731/1506] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:39:29 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1537 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:39:29.638736 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-519f96dc-8995-4d74-9832-abb9abb8a527 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:29.639450 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-519f96dc-8995-4d74-9832-abb9abb8a527 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] [instance: 5661197d-b679-48bc-bf2c-11e7b4f962bb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:29.650712 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-519f96dc-8995-4d74-9832-abb9abb8a527 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:29.651219 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-519f96dc-8995-4d74-9832-abb9abb8a527 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:29.654132 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-519f96dc-8995-4d74-9832-abb9abb8a527 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:29.654881 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-519f96dc-8995-4d74-9832-abb9abb8a527 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:29.659783 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-519f96dc-8995-4d74-9832-abb9abb8a527 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:29.660253 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-519f96dc-8995-4d74-9832-abb9abb8a527 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:29.721146 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-23e1e428-8326-40f0-a8de-5b83c62e759e tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd50a18b0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:29.784894 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-23e1e428-8326-40f0-a8de-5b83c62e759e tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/377d98df-8887-4bb0-8a0b-84e4f2dc3871" status: 200 len: 1440 microversion: 2.1 time: 0.067884 Oct 17 13:39:29.786205 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 732/1507] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:39:29 2022] GET /compute/v2.1/images/377d98df-8887-4bb0-8a0b-84e4f2dc3871 => generated 1440 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:39:29.808480 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-12ba1aca-9e63-4275-922a-f7bbf0febadc tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:29.809510 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-12ba1aca-9e63-4275-922a-f7bbf0febadc tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 16213741-2241-4f55-b7ca-20ab551e5596] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:29.825225 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-12ba1aca-9e63-4275-922a-f7bbf0febadc tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:29.825996 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-12ba1aca-9e63-4275-922a-f7bbf0febadc tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:29.827011 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-12ba1aca-9e63-4275-922a-f7bbf0febadc tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:29.830576 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-12ba1aca-9e63-4275-922a-f7bbf0febadc tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:29.831459 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-12ba1aca-9e63-4275-922a-f7bbf0febadc tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:29.832123 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-12ba1aca-9e63-4275-922a-f7bbf0febadc tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:30.111653 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-519f96dc-8995-4d74-9832-abb9abb8a527 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d2462ac744056be55262dacc72de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ed14a8051a4b8fb39d56280a2bcb41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:30.126038 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-519f96dc-8995-4d74-9832-abb9abb8a527 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] 10.222.0.79 "GET /compute/v2.1/servers/5661197d-b679-48bc-bf2c-11e7b4f962bb" status: 200 len: 1521 microversion: 2.1 time: 0.486092 Oct 17 13:39:30.143588 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 776/1508] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:29 2022] GET /compute/v2.1/servers/5661197d-b679-48bc-bf2c-11e7b4f962bb => generated 1521 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:30.156111 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-33c8b0ec-6200-4a19-b380-1bb2fe103d1c tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:30.157000 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-33c8b0ec-6200-4a19-b380-1bb2fe103d1c tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] [instance: 5661197d-b679-48bc-bf2c-11e7b4f962bb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:30.177676 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-33c8b0ec-6200-4a19-b380-1bb2fe103d1c tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:30.178183 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-33c8b0ec-6200-4a19-b380-1bb2fe103d1c tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:30.178662 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-33c8b0ec-6200-4a19-b380-1bb2fe103d1c tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:30.179359 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-33c8b0ec-6200-4a19-b380-1bb2fe103d1c tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:30.179989 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-33c8b0ec-6200-4a19-b380-1bb2fe103d1c tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:30.187263 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-33c8b0ec-6200-4a19-b380-1bb2fe103d1c tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:30.234302 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-12ba1aca-9e63-4275-922a-f7bbf0febadc tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:30.260573 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-12ba1aca-9e63-4275-922a-f7bbf0febadc tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:30.265323 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-12ba1aca-9e63-4275-922a-f7bbf0febadc tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:30.267097 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-33c8b0ec-6200-4a19-b380-1bb2fe103d1c tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] HTTP exception thrown: Action 999 not found Oct 17 13:39:30.271508 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-12ba1aca-9e63-4275-922a-f7bbf0febadc tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596" status: 200 len: 1568 microversion: 2.25 time: 0.483932 Oct 17 13:39:30.273175 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 733/1509] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:39:29 2022] GET /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596 => generated 1568 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:39:30.273558 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-33c8b0ec-6200-4a19-b380-1bb2fe103d1c tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Request method failure captured: Oct 17 13:39:30.273558 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/5661197d-b679-48bc-bf2c-11e7b4f962bb/os-instance-actions/999 HTTP/1.1 Oct 17 13:39:30.273558 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:39:30.273558 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:39:30.273558 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:39:30.273558 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:39:30.273558 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:39:30.273558 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:39:30.273558 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:39:30.273558 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:39:30.273558 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVsAxaxhgm8jRrZYPuTTMzPs4vnEdUAfXFgbCtmQAfls3XXaevpslMaQ1qSIW0HLlUw_drjLJUTCtlMMMmczRsFboSJaNQvCfzqqNwKtnG_5W9mNSLBo4-HRMA3QCFJJj5UDNqni80lbhhoNaGtXhIM6gl3vdR6BV-j_zTgp7rmsjq0 Oct 17 13:39:30.273558 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:39:30.273558 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:39:30.273558 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:39:30.273558 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:39:30.273558 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:39:30.273558 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:39:30.273558 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: d4ed14a8051a4b8fb39d56280a2bcb41 Oct 17 13:39:30.273558 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-638645226 Oct 17 13:39:30.273558 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:39:30.273558 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:39:30.275037 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d4ed14a8051a4b8fb39d56280a2bcb41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d4ed14a8051a4b8fb39d56280a2bcb41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d4ed14a8051a4b8fb39d56280a2bcb41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d4ed14a8051a4b8fb39d56280a2bcb41", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:39:30.275037 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-638645226 Oct 17 13:39:30.275037 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: d4ed14a8051a4b8fb39d56280a2bcb41 Oct 17 13:39:30.275037 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-638645226 Oct 17 13:39:30.275037 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-InstanceActionsNegativeTestJSON-638645226-project Oct 17 13:39:30.275037 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:39:30.275037 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:39:30.275037 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 0f5d2462ac744056be55262dacc72de8 Oct 17 13:39:30.275037 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-638645226-project Oct 17 13:39:30.275037 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:39:30.275037 n-d-854247-14 devstack@n-api.service[127017]: exception: Action 999 not found Oct 17 13:39:30.275037 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'server_id': '5661197d-b679-48bc-bf2c-11e7b4f962bb', 'id': '999'} Oct 17 13:39:30.275874 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:39:30.275874 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:30.275874 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:39:30.275874 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:39:30.275874 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:39:30.275874 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:39:30.275874 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:39:30.275874 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:39:30.275874 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 17 13:39:30.275874 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 17 13:39:30.275874 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 17 13:39:30.275874 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:39:30.275874 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:39:30.275874 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:39:30.275874 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:30.275874 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:39:30.275874 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:39:30.275874 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:39:30.275874 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:39:30.275874 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 17 13:39:30.275874 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:39:30.278635 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-33c8b0ec-6200-4a19-b380-1bb2fe103d1c tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Returning 404 to user: Action 999 not found {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:39:30.279781 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-33c8b0ec-6200-4a19-b380-1bb2fe103d1c tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] 10.222.0.79 "GET /compute/v2.1/servers/5661197d-b679-48bc-bf2c-11e7b4f962bb/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.128072 Oct 17 13:39:30.281906 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 777/1510] 10.222.0.79 () {58 vars in 1308 bytes} [Mon Oct 17 13:39:30 2022] GET /compute/v2.1/servers/5661197d-b679-48bc-bf2c-11e7b4f962bb/os-instance-actions/999 => generated 66 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 17 13:39:30.283721 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8ae68c25-b001-455e-ac94-0f98a9ddc20c tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:30.284359 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8ae68c25-b001-455e-ac94-0f98a9ddc20c tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: ab2b571e-376c-41d3-a778-44bedcaa5467] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:30.287831 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8236bdea-2a88-417a-854f-8035b1a073a0 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:30.291190 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8236bdea-2a88-417a-854f-8035b1a073a0 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] [instance: b8d15c7c-7a1f-43e0-9c41-302172f31ca0] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:30.301801 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8ae68c25-b001-455e-ac94-0f98a9ddc20c tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:30.302298 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8ae68c25-b001-455e-ac94-0f98a9ddc20c tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:30.302736 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8ae68c25-b001-455e-ac94-0f98a9ddc20c tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:30.306613 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8ae68c25-b001-455e-ac94-0f98a9ddc20c tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:30.308787 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8ae68c25-b001-455e-ac94-0f98a9ddc20c tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:30.309243 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8ae68c25-b001-455e-ac94-0f98a9ddc20c tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:30.315798 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8236bdea-2a88-417a-854f-8035b1a073a0 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:30.316594 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8236bdea-2a88-417a-854f-8035b1a073a0 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:30.318558 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8236bdea-2a88-417a-854f-8035b1a073a0 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:30.320415 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8236bdea-2a88-417a-854f-8035b1a073a0 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:30.322717 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8236bdea-2a88-417a-854f-8035b1a073a0 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:30.323740 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8236bdea-2a88-417a-854f-8035b1a073a0 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:30.373920 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8236bdea-2a88-417a-854f-8035b1a073a0 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] 10.222.0.79 "GET /compute/v2.1/servers/b8d15c7c-7a1f-43e0-9c41-302172f31ca0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090655 Oct 17 13:39:30.380820 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 778/1511] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 13:39:30 2022] GET /compute/v2.1/servers/b8d15c7c-7a1f-43e0-9c41-302172f31ca0/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:39:30.383327 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6272f38f-bddb-4fdd-8806-75226a5a8b3a tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Calling method '.version_select at 0x7f7cd5782dc0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:30.384007 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6272f38f-bddb-4fdd-8806-75226a5a8b3a tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] [instance: 14179f0d-02bb-4260-9ae2-c712a7b6e33e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:30.392251 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-6272f38f-bddb-4fdd-8806-75226a5a8b3a tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] HTTP exception thrown: Instance 14179f0d-02bb-4260-9ae2-c712a7b6e33e could not be found. Oct 17 13:39:30.393894 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6272f38f-bddb-4fdd-8806-75226a5a8b3a tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Request method failure captured: Oct 17 13:39:30.393894 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/14179f0d-02bb-4260-9ae2-c712a7b6e33e/os-instance-actions HTTP/1.1 Oct 17 13:39:30.393894 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:39:30.393894 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:39:30.393894 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:39:30.393894 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:39:30.393894 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:39:30.393894 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:39:30.393894 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:39:30.393894 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:39:30.393894 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVsAxaxhgm8jRrZYPuTTMzPs4vnEdUAfXFgbCtmQAfls3XXaevpslMaQ1qSIW0HLlUw_drjLJUTCtlMMMmczRsFboSJaNQvCfzqqNwKtnG_5W9mNSLBo4-HRMA3QCFJJj5UDNqni80lbhhoNaGtXhIM6gl3vdR6BV-j_zTgp7rmsjq0 Oct 17 13:39:30.393894 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:39:30.393894 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:39:30.393894 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:39:30.393894 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:39:30.393894 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:39:30.393894 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:39:30.393894 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: d4ed14a8051a4b8fb39d56280a2bcb41 Oct 17 13:39:30.393894 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-638645226 Oct 17 13:39:30.393894 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:39:30.393894 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:39:30.395337 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d4ed14a8051a4b8fb39d56280a2bcb41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d4ed14a8051a4b8fb39d56280a2bcb41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d4ed14a8051a4b8fb39d56280a2bcb41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d4ed14a8051a4b8fb39d56280a2bcb41", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:39:30.395337 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-638645226 Oct 17 13:39:30.395337 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: d4ed14a8051a4b8fb39d56280a2bcb41 Oct 17 13:39:30.395337 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-638645226 Oct 17 13:39:30.395337 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-InstanceActionsNegativeTestJSON-638645226-project Oct 17 13:39:30.395337 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:39:30.395337 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:39:30.395337 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 0f5d2462ac744056be55262dacc72de8 Oct 17 13:39:30.395337 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-638645226-project Oct 17 13:39:30.395337 n-d-854247-14 devstack@n-api.service[127017]: method: Oct 17 13:39:30.395337 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 14179f0d-02bb-4260-9ae2-c712a7b6e33e could not be found. Oct 17 13:39:30.395337 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'server_id': '14179f0d-02bb-4260-9ae2-c712a7b6e33e'} Oct 17 13:39:30.396100 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:39:30.396100 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:30.396100 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:39:30.396100 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:39:30.396100 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:39:30.396100 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:39:30.396100 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 13:39:30.396100 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 13:39:30.396100 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14179f0d-02bb-4260-9ae2-c712a7b6e33e could not be found. Oct 17 13:39:30.396100 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:39:30.396100 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:39:30.396100 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:39:30.396100 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:30.396100 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:39:30.396100 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:39:30.396100 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:39:30.396100 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:39:30.396100 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:39:30.396100 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:39:30.396100 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:39:30.397403 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:39:30.397403 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 17 13:39:30.397403 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 17 13:39:30.397403 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:39:30.397403 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:39:30.397403 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 17 13:39:30.397403 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 17 13:39:30.397403 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:39:30.397403 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:39:30.397403 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14179f0d-02bb-4260-9ae2-c712a7b6e33e could not be found. Oct 17 13:39:30.397403 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:39:30.397403 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:39:30.397403 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:39:30.397403 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:30.397403 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:39:30.397403 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:39:30.397403 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:39:30.397403 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:39:30.397403 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14179f0d-02bb-4260-9ae2-c712a7b6e33e could not be found. Oct 17 13:39:30.397403 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:39:30.398769 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6272f38f-bddb-4fdd-8806-75226a5a8b3a tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Returning 404 to user: Instance 14179f0d-02bb-4260-9ae2-c712a7b6e33e could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:39:30.398769 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6272f38f-bddb-4fdd-8806-75226a5a8b3a tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] 10.222.0.79 "GET /compute/v2.1/servers/14179f0d-02bb-4260-9ae2-c712a7b6e33e/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.018919 Oct 17 13:39:30.398769 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 779/1512] 10.222.0.79 () {58 vars in 1296 bytes} [Mon Oct 17 13:39:30 2022] GET /compute/v2.1/servers/14179f0d-02bb-4260-9ae2-c712a7b6e33e/os-instance-actions => generated 111 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:39:30.413297 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9a0fe498-17f7-4f1a-9e45-ea78ebdb14b3 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:30.414070 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9a0fe498-17f7-4f1a-9e45-ea78ebdb14b3 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] [instance: 5661197d-b679-48bc-bf2c-11e7b4f962bb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:30.426028 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9a0fe498-17f7-4f1a-9e45-ea78ebdb14b3 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:30.427412 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9a0fe498-17f7-4f1a-9e45-ea78ebdb14b3 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:30.428593 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9a0fe498-17f7-4f1a-9e45-ea78ebdb14b3 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:30.430302 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9a0fe498-17f7-4f1a-9e45-ea78ebdb14b3 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:30.431843 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9a0fe498-17f7-4f1a-9e45-ea78ebdb14b3 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:30.434800 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9a0fe498-17f7-4f1a-9e45-ea78ebdb14b3 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:30.514544 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9a0fe498-17f7-4f1a-9e45-ea78ebdb14b3 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] [instance: 5661197d-b679-48bc-bf2c-11e7b4f962bb] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:39:30.658343 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8ae68c25-b001-455e-ac94-0f98a9ddc20c tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:30.666928 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8ae68c25-b001-455e-ac94-0f98a9ddc20c tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467" status: 200 len: 1473 microversion: 2.1 time: 0.392640 Oct 17 13:39:30.667559 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 734/1513] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:30 2022] GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467 => generated 1473 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:30.679639 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a20b66a5-6ada-4115-b6ca-30e0eb6b1247 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:30.680262 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a20b66a5-6ada-4115-b6ca-30e0eb6b1247 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: fd365dc4-44c6-4a00-971e-2699762ab41f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:30.692450 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a20b66a5-6ada-4115-b6ca-30e0eb6b1247 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:30.693877 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a20b66a5-6ada-4115-b6ca-30e0eb6b1247 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:30.693877 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a20b66a5-6ada-4115-b6ca-30e0eb6b1247 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:30.694308 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a20b66a5-6ada-4115-b6ca-30e0eb6b1247 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:30.694814 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a20b66a5-6ada-4115-b6ca-30e0eb6b1247 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:30.695026 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a20b66a5-6ada-4115-b6ca-30e0eb6b1247 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:30.708570 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9a0fe498-17f7-4f1a-9e45-ea78ebdb14b3 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] 10.222.0.79 "DELETE /compute/v2.1/servers/5661197d-b679-48bc-bf2c-11e7b4f962bb" status: 204 len: 0 microversion: 2.1 time: 0.300936 Oct 17 13:39:30.709360 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 780/1514] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:39:30 2022] DELETE /compute/v2.1/servers/5661197d-b679-48bc-bf2c-11e7b4f962bb => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:39:30.714402 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-09ea6ff1-4182-4a06-94e8-b372a6bef338 req-5433d6f9-66dd-4513-8dda-8ff1e1091d6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd365dc4-44c6-4a00-971e-2699762ab41f", "name": "network-vif-plugged", "status": "completed", "tag": "6d5ddeb5-1324-4b12-9490-8c34031e6c41"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:30.735288 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-09ea6ff1-4182-4a06-94e8-b372a6bef338 req-5433d6f9-66dd-4513-8dda-8ff1e1091d6b service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:30.735778 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-09ea6ff1-4182-4a06-94e8-b372a6bef338 req-5433d6f9-66dd-4513-8dda-8ff1e1091d6b service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:30.736212 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-09ea6ff1-4182-4a06-94e8-b372a6bef338 req-5433d6f9-66dd-4513-8dda-8ff1e1091d6b service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:30.748771 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-09ea6ff1-4182-4a06-94e8-b372a6bef338 req-5433d6f9-66dd-4513-8dda-8ff1e1091d6b service nova] Creating event network-vif-plugged:6d5ddeb5-1324-4b12-9490-8c34031e6c41 for instance fd365dc4-44c6-4a00-971e-2699762ab41f on n-h1-854247-14 Oct 17 13:39:30.753673 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-09ea6ff1-4182-4a06-94e8-b372a6bef338 req-5433d6f9-66dd-4513-8dda-8ff1e1091d6b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043200 Oct 17 13:39:30.754596 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 781/1515] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:39:30.760084 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9adb9aa4-102a-4680-bcef-a9303e416324 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:30.760813 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9adb9aa4-102a-4680-bcef-a9303e416324 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:30.767475 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9adb9aa4-102a-4680-bcef-a9303e416324 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:30.767967 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9adb9aa4-102a-4680-bcef-a9303e416324 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:30.770417 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9adb9aa4-102a-4680-bcef-a9303e416324 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:30.770417 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9adb9aa4-102a-4680-bcef-a9303e416324 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:30.770417 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9adb9aa4-102a-4680-bcef-a9303e416324 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:30.770417 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9adb9aa4-102a-4680-bcef-a9303e416324 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:30.898732 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9adb9aa4-102a-4680-bcef-a9303e416324 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:30.912871 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a20b66a5-6ada-4115-b6ca-30e0eb6b1247 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:30.918704 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a20b66a5-6ada-4115-b6ca-30e0eb6b1247 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f" status: 200 len: 1198 microversion: 2.1 time: 0.250079 Oct 17 13:39:30.920437 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 735/1516] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:30 2022] GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f => generated 1198 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:30.925216 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ff3d144f-b75e-4735-a1fa-e315c501ce6b tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:30.926113 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ff3d144f-b75e-4735-a1fa-e315c501ce6b tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] [instance: 5661197d-b679-48bc-bf2c-11e7b4f962bb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:30.933131 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ff3d144f-b75e-4735-a1fa-e315c501ce6b tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:30.933625 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ff3d144f-b75e-4735-a1fa-e315c501ce6b tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:30.934058 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ff3d144f-b75e-4735-a1fa-e315c501ce6b tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:30.934770 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ff3d144f-b75e-4735-a1fa-e315c501ce6b tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:30.938632 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9adb9aa4-102a-4680-bcef-a9303e416324 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:30.938899 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ff3d144f-b75e-4735-a1fa-e315c501ce6b tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:30.939699 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ff3d144f-b75e-4735-a1fa-e315c501ce6b tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:30.944009 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9adb9aa4-102a-4680-bcef-a9303e416324 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:30.952032 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9adb9aa4-102a-4680-bcef-a9303e416324 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1558 microversion: 2.91 time: 0.195661 Oct 17 13:39:30.971826 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 782/1517] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:39:30 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1558 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:39:30.994096 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-94faf962-f855-4f64-b838-6d0d9eff6663 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd573e700>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:31.093804 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-94faf962-f855-4f64-b838-6d0d9eff6663 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/377d98df-8887-4bb0-8a0b-84e4f2dc3871" status: 200 len: 1440 microversion: 2.1 time: 0.119116 Oct 17 13:39:31.095263 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 783/1518] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:39:30 2022] GET /compute/v2.1/images/377d98df-8887-4bb0-8a0b-84e4f2dc3871 => generated 1440 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:31.174302 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ff3d144f-b75e-4735-a1fa-e315c501ce6b tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d2462ac744056be55262dacc72de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ed14a8051a4b8fb39d56280a2bcb41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:31.185774 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ff3d144f-b75e-4735-a1fa-e315c501ce6b tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] 10.222.0.79 "GET /compute/v2.1/servers/5661197d-b679-48bc-bf2c-11e7b4f962bb" status: 200 len: 1527 microversion: 2.1 time: 0.263576 Oct 17 13:39:31.186570 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 736/1519] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:30 2022] GET /compute/v2.1/servers/5661197d-b679-48bc-bf2c-11e7b4f962bb => generated 1527 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:31.310513 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f8e0b164-bf87-4ceb-8234-140377fd8361 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:31.311248 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f8e0b164-bf87-4ceb-8234-140377fd8361 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 16213741-2241-4f55-b7ca-20ab551e5596] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:31.317922 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f8e0b164-bf87-4ceb-8234-140377fd8361 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:31.318402 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f8e0b164-bf87-4ceb-8234-140377fd8361 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:31.318853 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f8e0b164-bf87-4ceb-8234-140377fd8361 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:31.319551 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f8e0b164-bf87-4ceb-8234-140377fd8361 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:31.319994 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f8e0b164-bf87-4ceb-8234-140377fd8361 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:31.323038 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f8e0b164-bf87-4ceb-8234-140377fd8361 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:31.390572 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ed7c9fb5-69d6-416c-8981-9c41c05e410c tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:31.393097 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ed7c9fb5-69d6-416c-8981-9c41c05e410c tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] [instance: b8d15c7c-7a1f-43e0-9c41-302172f31ca0] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:31.403290 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ed7c9fb5-69d6-416c-8981-9c41c05e410c tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:31.403784 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ed7c9fb5-69d6-416c-8981-9c41c05e410c tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:31.408313 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ed7c9fb5-69d6-416c-8981-9c41c05e410c tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:31.409543 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ed7c9fb5-69d6-416c-8981-9c41c05e410c tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:31.411284 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ed7c9fb5-69d6-416c-8981-9c41c05e410c tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:31.411718 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ed7c9fb5-69d6-416c-8981-9c41c05e410c tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:31.450004 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ed7c9fb5-69d6-416c-8981-9c41c05e410c tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] 10.222.0.79 "GET /compute/v2.1/servers/b8d15c7c-7a1f-43e0-9c41-302172f31ca0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064714 Oct 17 13:39:31.451209 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 737/1520] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 13:39:31 2022] GET /compute/v2.1/servers/b8d15c7c-7a1f-43e0-9c41-302172f31ca0/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 17 13:39:31.694340 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-37e251c3-8d31-4ca9-8de3-eb2f7da246cd tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:31.695249 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-37e251c3-8d31-4ca9-8de3-eb2f7da246cd tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: ab2b571e-376c-41d3-a778-44bedcaa5467] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:31.713418 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-37e251c3-8d31-4ca9-8de3-eb2f7da246cd tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:31.716420 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-37e251c3-8d31-4ca9-8de3-eb2f7da246cd tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:31.717064 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-37e251c3-8d31-4ca9-8de3-eb2f7da246cd tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:31.717788 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-37e251c3-8d31-4ca9-8de3-eb2f7da246cd tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:31.718252 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-37e251c3-8d31-4ca9-8de3-eb2f7da246cd tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:31.718661 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-37e251c3-8d31-4ca9-8de3-eb2f7da246cd tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:31.965937 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f8e0b164-bf87-4ceb-8234-140377fd8361 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:31.975675 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f8e0b164-bf87-4ceb-8234-140377fd8361 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:31.977861 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f8e0b164-bf87-4ceb-8234-140377fd8361 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:31.979336 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f8e0b164-bf87-4ceb-8234-140377fd8361 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596" status: 200 len: 1568 microversion: 2.25 time: 0.673150 Oct 17 13:39:31.999720 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 784/1521] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:39:31 2022] GET /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596 => generated 1568 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:39:32.005822 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-da434a15-3b1c-4530-b250-863dd4d42028 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1940737955", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "e29bcb13-7c15-4ffd-8bbd-51a70191051d"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:32.090095 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-da434a15-3b1c-4530-b250-863dd4d42028 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] validate_networks() for [('e29bcb13-7c15-4ffd-8bbd-51a70191051d', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:39:32.096251 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-37e251c3-8d31-4ca9-8de3-eb2f7da246cd tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:32.115930 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-37e251c3-8d31-4ca9-8de3-eb2f7da246cd tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467" status: 200 len: 1473 microversion: 2.1 time: 0.424880 Oct 17 13:39:32.118177 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 738/1522] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:31 2022] GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467 => generated 1473 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:39:32.124065 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-67b3d29a-cb43-44cc-9f8f-47ba04fdd918 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:32.124695 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-67b3d29a-cb43-44cc-9f8f-47ba04fdd918 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: fd365dc4-44c6-4a00-971e-2699762ab41f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:32.130945 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-67b3d29a-cb43-44cc-9f8f-47ba04fdd918 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:32.131448 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-67b3d29a-cb43-44cc-9f8f-47ba04fdd918 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:32.131877 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-67b3d29a-cb43-44cc-9f8f-47ba04fdd918 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:32.136091 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-67b3d29a-cb43-44cc-9f8f-47ba04fdd918 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:32.136570 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-67b3d29a-cb43-44cc-9f8f-47ba04fdd918 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:32.137019 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-67b3d29a-cb43-44cc-9f8f-47ba04fdd918 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:32.553893 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-67b3d29a-cb43-44cc-9f8f-47ba04fdd918 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:32.572382 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-67b3d29a-cb43-44cc-9f8f-47ba04fdd918 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f" status: 200 len: 1198 microversion: 2.1 time: 0.453049 Oct 17 13:39:32.572966 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 739/1523] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:32 2022] GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f => generated 1198 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:32.597130 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ab727c2d-8d5b-4873-a3d9-3c62f0a82aa6 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:32.597732 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ab727c2d-8d5b-4873-a3d9-3c62f0a82aa6 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:32.607130 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ab727c2d-8d5b-4873-a3d9-3c62f0a82aa6 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:32.608005 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ab727c2d-8d5b-4873-a3d9-3c62f0a82aa6 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:32.608700 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ab727c2d-8d5b-4873-a3d9-3c62f0a82aa6 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:32.609618 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ab727c2d-8d5b-4873-a3d9-3c62f0a82aa6 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:32.610269 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ab727c2d-8d5b-4873-a3d9-3c62f0a82aa6 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:32.610894 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ab727c2d-8d5b-4873-a3d9-3c62f0a82aa6 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:32.854961 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ab727c2d-8d5b-4873-a3d9-3c62f0a82aa6 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:32.865862 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ab727c2d-8d5b-4873-a3d9-3c62f0a82aa6 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:32.869117 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ab727c2d-8d5b-4873-a3d9-3c62f0a82aa6 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:32.885900 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ab727c2d-8d5b-4873-a3d9-3c62f0a82aa6 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1558 microversion: 2.91 time: 0.297193 Oct 17 13:39:32.886505 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 740/1524] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:39:32 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1558 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:39:32.895723 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-698c5890-e48d-422c-bab1-3877aa393a6e tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd4ff4f70>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:32.967051 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-698c5890-e48d-422c-bab1-3877aa393a6e tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/377d98df-8887-4bb0-8a0b-84e4f2dc3871" status: 200 len: 1440 microversion: 2.1 time: 0.078966 Oct 17 13:39:32.970091 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 741/1525] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:39:32 2022] GET /compute/v2.1/images/377d98df-8887-4bb0-8a0b-84e4f2dc3871 => generated 1440 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:32.977626 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0d027776-026e-40e3-b528-f0595ef841f3 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:32.978765 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0d027776-026e-40e3-b528-f0595ef841f3 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] [instance: 5661197d-b679-48bc-bf2c-11e7b4f962bb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:32.989186 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0d027776-026e-40e3-b528-f0595ef841f3 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:32.991348 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0d027776-026e-40e3-b528-f0595ef841f3 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:32.993671 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0d027776-026e-40e3-b528-f0595ef841f3 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:32.994988 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0d027776-026e-40e3-b528-f0595ef841f3 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:32.995486 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0d027776-026e-40e3-b528-f0595ef841f3 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:32.998313 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0d027776-026e-40e3-b528-f0595ef841f3 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:33.396215 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-da434a15-3b1c-4530-b250-863dd4d42028 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:39:33.397765 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-da434a15-3b1c-4530-b250-863dd4d42028 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:39:33.402508 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-da434a15-3b1c-4530-b250-863dd4d42028 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:39:33.403106 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-da434a15-3b1c-4530-b250-863dd4d42028 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:39:33.403693 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-da434a15-3b1c-4530-b250-863dd4d42028 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:39:33.460471 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-da434a15-3b1c-4530-b250-863dd4d42028 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:33.461237 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-da434a15-3b1c-4530-b250-863dd4d42028 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:33.462142 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-da434a15-3b1c-4530-b250-863dd4d42028 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:33.463332 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-da434a15-3b1c-4530-b250-863dd4d42028 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:33.463980 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-da434a15-3b1c-4530-b250-863dd4d42028 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:33.464602 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-da434a15-3b1c-4530-b250-863dd4d42028 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:33.484121 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:39:33.505112 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-da434a15-3b1c-4530-b250-863dd4d42028 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Getting quotas for project d6642f912ba0467bac461bc7aedbf940. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:39:33.513487 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0d027776-026e-40e3-b528-f0595ef841f3 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d2462ac744056be55262dacc72de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ed14a8051a4b8fb39d56280a2bcb41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:33.521732 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-da434a15-3b1c-4530-b250-863dd4d42028 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Getting quotas for user e6e5309bf84f4aafa9a17604f8452366 and project d6642f912ba0467bac461bc7aedbf940. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:39:33.531228 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0d027776-026e-40e3-b528-f0595ef841f3 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] 10.222.0.79 "GET /compute/v2.1/servers/5661197d-b679-48bc-bf2c-11e7b4f962bb" status: 200 len: 1527 microversion: 2.1 time: 0.554177 Oct 17 13:39:33.556019 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 742/1526] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:32 2022] GET /compute/v2.1/servers/5661197d-b679-48bc-bf2c-11e7b4f962bb => generated 1527 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:33.556019 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-20b4f833-f79f-4bc1-8c92-a2bced4ae4a1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:33.556019 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-20b4f833-f79f-4bc1-8c92-a2bced4ae4a1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 16213741-2241-4f55-b7ca-20ab551e5596] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:33.557166 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-20b4f833-f79f-4bc1-8c92-a2bced4ae4a1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:33.557166 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-20b4f833-f79f-4bc1-8c92-a2bced4ae4a1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:33.557533 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-20b4f833-f79f-4bc1-8c92-a2bced4ae4a1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:33.561763 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-20b4f833-f79f-4bc1-8c92-a2bced4ae4a1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:33.562884 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-20b4f833-f79f-4bc1-8c92-a2bced4ae4a1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:33.565568 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-20b4f833-f79f-4bc1-8c92-a2bced4ae4a1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:33.580402 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-da434a15-3b1c-4530-b250-863dd4d42028 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:39:33.583284 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-da434a15-3b1c-4530-b250-863dd4d42028 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] [instance: 230b658a-6ae7-4812-ab1a-a5fee84100cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:39:33.680730 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-da434a15-3b1c-4530-b250-863dd4d42028 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.679289 Oct 17 13:39:33.681392 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 785/1527] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:39:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:39:33.885412 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-07d91254-233d-4505-b89f-a07d8be018b1 tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] Action: 'create', calling method: .version_select at 0x7f7cd59ba820>, body: {"keypair": {"name": "tempest-keypair-256605643", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAChrBxrzBHe52ASr++HprxPg7mX5xyHE5cxFjg2oixziJuxTvzbAHbEAp1FFVxwQCE0GAddS6cGuMFeOsUsEvtvG541j3F5ATQ1GO9vZAQFVfEma/0M48IuPnA/zrtGQ=="}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:33.924145 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-07d91254-233d-4505-b89f-a07d8be018b1 tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] Getting quotas for project c937d330643f439e9b078965821023a1. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:39:33.947683 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-07d91254-233d-4505-b89f-a07d8be018b1 tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] Getting quotas for user d78449f7c7334040b1f9823ec5496da5 and project c937d330643f439e9b078965821023a1. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:39:34.013714 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-07d91254-233d-4505-b89f-a07d8be018b1 tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.323998 Oct 17 13:39:34.016891 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 786/1528] 10.222.0.79 () {62 vars in 1199 bytes} [Mon Oct 17 13:39:33 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 335 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 17 13:39:34.050991 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3ae04cae-0584-497a-b506-6c7436a69bcd tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:34.054321 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3ae04cae-0584-497a-b506-6c7436a69bcd tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: ab2b571e-376c-41d3-a778-44bedcaa5467] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:34.082328 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3ae04cae-0584-497a-b506-6c7436a69bcd tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:34.085645 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3ae04cae-0584-497a-b506-6c7436a69bcd tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:34.085924 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-20b4f833-f79f-4bc1-8c92-a2bced4ae4a1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:34.086205 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3ae04cae-0584-497a-b506-6c7436a69bcd tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:34.093730 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3ae04cae-0584-497a-b506-6c7436a69bcd tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:34.095618 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3ae04cae-0584-497a-b506-6c7436a69bcd tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:34.096135 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3ae04cae-0584-497a-b506-6c7436a69bcd tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:34.103888 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-20b4f833-f79f-4bc1-8c92-a2bced4ae4a1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:34.106153 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-20b4f833-f79f-4bc1-8c92-a2bced4ae4a1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:34.107782 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-20b4f833-f79f-4bc1-8c92-a2bced4ae4a1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596" status: 200 len: 1568 microversion: 2.25 time: 0.562344 Oct 17 13:39:34.122521 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 743/1529] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:39:33 2022] GET /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596 => generated 1568 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:39:34.134322 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5aedac53-bd0d-4a6b-bb35-30f23e6ea02c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:34.135611 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5aedac53-bd0d-4a6b-bb35-30f23e6ea02c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: fd365dc4-44c6-4a00-971e-2699762ab41f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:34.142976 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5aedac53-bd0d-4a6b-bb35-30f23e6ea02c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:34.143852 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5aedac53-bd0d-4a6b-bb35-30f23e6ea02c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:34.144349 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5aedac53-bd0d-4a6b-bb35-30f23e6ea02c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:34.145358 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5aedac53-bd0d-4a6b-bb35-30f23e6ea02c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:34.146048 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5aedac53-bd0d-4a6b-bb35-30f23e6ea02c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:34.146695 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5aedac53-bd0d-4a6b-bb35-30f23e6ea02c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:34.698803 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5aedac53-bd0d-4a6b-bb35-30f23e6ea02c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:34.712868 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5aedac53-bd0d-4a6b-bb35-30f23e6ea02c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f" status: 200 len: 1380 microversion: 2.1 time: 0.588617 Oct 17 13:39:34.715638 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 744/1530] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:34 2022] GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f => generated 1380 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:34.737341 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0866ee99-7eb8-4f46-b782-03ff17140654 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:34.738226 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0866ee99-7eb8-4f46-b782-03ff17140654 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] [instance: 230b658a-6ae7-4812-ab1a-a5fee84100cd] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:34.744780 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3ae04cae-0584-497a-b506-6c7436a69bcd tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:34.752695 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0866ee99-7eb8-4f46-b782-03ff17140654 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:34.760820 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3ae04cae-0584-497a-b506-6c7436a69bcd tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467" status: 200 len: 1473 microversion: 2.1 time: 0.724761 Oct 17 13:39:34.775667 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 787/1531] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:34 2022] GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467 => generated 1473 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:34.787817 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-33ff4d4b-7a54-4337-8130-3a494e63ab7d tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:34.788539 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0866ee99-7eb8-4f46-b782-03ff17140654 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.036s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:34.789240 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0866ee99-7eb8-4f46-b782-03ff17140654 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:34.790342 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0866ee99-7eb8-4f46-b782-03ff17140654 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:34.791040 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0866ee99-7eb8-4f46-b782-03ff17140654 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:34.791764 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0866ee99-7eb8-4f46-b782-03ff17140654 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:34.791964 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-33ff4d4b-7a54-4337-8130-3a494e63ab7d tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:34.813732 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-33ff4d4b-7a54-4337-8130-3a494e63ab7d tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:34.816020 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-33ff4d4b-7a54-4337-8130-3a494e63ab7d tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:34.819883 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-33ff4d4b-7a54-4337-8130-3a494e63ab7d tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:34.820921 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-33ff4d4b-7a54-4337-8130-3a494e63ab7d tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:34.821847 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-33ff4d4b-7a54-4337-8130-3a494e63ab7d tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:34.825917 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-33ff4d4b-7a54-4337-8130-3a494e63ab7d tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:34.938738 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0866ee99-7eb8-4f46-b782-03ff17140654 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e5309bf84f4aafa9a17604f8452366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6642f912ba0467bac461bc7aedbf940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:34.962522 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0866ee99-7eb8-4f46-b782-03ff17140654 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] 10.222.0.79 "GET /compute/v2.1/servers/230b658a-6ae7-4812-ab1a-a5fee84100cd" status: 200 len: 1222 microversion: 2.1 time: 0.243938 Oct 17 13:39:34.987527 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 745/1532] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:34 2022] GET /compute/v2.1/servers/230b658a-6ae7-4812-ab1a-a5fee84100cd => generated 1222 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:34.997269 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b0f6a459-953b-4c5d-b602-34655582caca tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd4ff4790>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:35.032684 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-33ff4d4b-7a54-4337-8130-3a494e63ab7d tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:35.057273 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-33ff4d4b-7a54-4337-8130-3a494e63ab7d tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:35.061256 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-33ff4d4b-7a54-4337-8130-3a494e63ab7d tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:35.077042 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-33ff4d4b-7a54-4337-8130-3a494e63ab7d tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1553 microversion: 2.91 time: 0.299870 Oct 17 13:39:35.078303 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 788/1533] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:39:34 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1553 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:39:35.084022 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8f3fcfac-8ad4-47c9-84e8-53d09145b46b tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] Calling method '.version_select at 0x7f7cd5a1d0d0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:35.094193 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8f3fcfac-8ad4-47c9-84e8-53d09145b46b tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] 10.222.0.79 "GET /compute/v2.1/os-keypairs/tempest-keypair-256605643" status: 200 len: 511 microversion: 2.2 time: 0.014097 Oct 17 13:39:35.094813 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 789/1534] 10.222.0.79 () {60 vars in 1255 bytes} [Mon Oct 17 13:39:35 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-256605643 => generated 511 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:39:35.113631 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-92cbbe40-609f-4254-bccb-4721d8978c32 req-d3a6e075-dc91-4103-ab28-d74978020a4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5661197d-b679-48bc-bf2c-11e7b4f962bb", "name": "network-vif-deleted", "tag": "a47f4bb8-acbd-43ec-91bb-a63ad37997b8"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:35.144461 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-92cbbe40-609f-4254-bccb-4721d8978c32 req-d3a6e075-dc91-4103-ab28-d74978020a4c service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:35.144960 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-92cbbe40-609f-4254-bccb-4721d8978c32 req-d3a6e075-dc91-4103-ab28-d74978020a4c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:35.145400 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-92cbbe40-609f-4254-bccb-4721d8978c32 req-d3a6e075-dc91-4103-ab28-d74978020a4c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:35.162152 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-92cbbe40-609f-4254-bccb-4721d8978c32 req-d3a6e075-dc91-4103-ab28-d74978020a4c service nova] Creating event network-vif-deleted:a47f4bb8-acbd-43ec-91bb-a63ad37997b8 for instance 5661197d-b679-48bc-bf2c-11e7b4f962bb on n-h1-854247-14 Oct 17 13:39:35.172809 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-92cbbe40-609f-4254-bccb-4721d8978c32 req-d3a6e075-dc91-4103-ab28-d74978020a4c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074413 Oct 17 13:39:35.177053 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 790/1535] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:39:35.188831 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-59c60b2c-8edb-4997-b760-368471995bcc tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:35.189656 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-59c60b2c-8edb-4997-b760-368471995bcc tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] [instance: 5661197d-b679-48bc-bf2c-11e7b4f962bb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:35.206632 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-59c60b2c-8edb-4997-b760-368471995bcc tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:35.207280 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-59c60b2c-8edb-4997-b760-368471995bcc tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:35.208275 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-59c60b2c-8edb-4997-b760-368471995bcc tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:35.209235 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-59c60b2c-8edb-4997-b760-368471995bcc tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:35.220666 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-59c60b2c-8edb-4997-b760-368471995bcc tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:35.221286 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-59c60b2c-8edb-4997-b760-368471995bcc tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:35.300337 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-59c60b2c-8edb-4997-b760-368471995bcc tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:35.300689 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-59c60b2c-8edb-4997-b760-368471995bcc tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:35.301023 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-59c60b2c-8edb-4997-b760-368471995bcc tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:35.301888 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-59c60b2c-8edb-4997-b760-368471995bcc tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lazy-loading 'fault' on Instance uuid 5661197d-b679-48bc-bf2c-11e7b4f962bb {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:39:35.352565 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-59c60b2c-8edb-4997-b760-368471995bcc tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5d2462ac744056be55262dacc72de8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ed14a8051a4b8fb39d56280a2bcb41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:35.368289 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-59c60b2c-8edb-4997-b760-368471995bcc tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] 10.222.0.79 "GET /compute/v2.1/servers/5661197d-b679-48bc-bf2c-11e7b4f962bb" status: 200 len: 1315 microversion: 2.1 time: 0.189503 Oct 17 13:39:35.369355 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 791/1536] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:35 2022] GET /compute/v2.1/servers/5661197d-b679-48bc-bf2c-11e7b4f962bb => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:35.396978 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a20e2dc9-7afb-4f29-913e-55cc8016451e tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:35.397600 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a20e2dc9-7afb-4f29-913e-55cc8016451e tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] [instance: fd365dc4-44c6-4a00-971e-2699762ab41f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:35.404654 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a20e2dc9-7afb-4f29-913e-55cc8016451e tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:35.405064 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a20e2dc9-7afb-4f29-913e-55cc8016451e tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:35.405497 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a20e2dc9-7afb-4f29-913e-55cc8016451e tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:35.406209 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a20e2dc9-7afb-4f29-913e-55cc8016451e tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:35.406687 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a20e2dc9-7afb-4f29-913e-55cc8016451e tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:35.407879 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a20e2dc9-7afb-4f29-913e-55cc8016451e tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:35.664035 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a20e2dc9-7afb-4f29-913e-55cc8016451e tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f" status: 200 len: 1533 microversion: 2.1 time: 0.271426 Oct 17 13:39:35.666172 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 792/1537] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:35 2022] GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f => generated 1533 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:35.673357 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-252807d5-f1f2-48c4-9f07-b1c26f56ce97 tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] Calling method '.version_select at 0x7f7cd59e3670>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:35.723536 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-252807d5-f1f2-48c4-9f07-b1c26f56ce97 tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-256605643" status: 204 len: 0 microversion: 2.2 time: 0.053569 Oct 17 13:39:35.724222 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 793/1538] 10.222.0.79 () {60 vars in 1258 bytes} [Mon Oct 17 13:39:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-256605643 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:39:35.736221 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-064565ec-b10b-498d-863c-593df76958bd tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:35.738180 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-064565ec-b10b-498d-863c-593df76958bd tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 16213741-2241-4f55-b7ca-20ab551e5596] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:35.750397 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-064565ec-b10b-498d-863c-593df76958bd tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:35.751109 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-064565ec-b10b-498d-863c-593df76958bd tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:35.751705 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-064565ec-b10b-498d-863c-593df76958bd tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:35.752534 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-064565ec-b10b-498d-863c-593df76958bd tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:35.753154 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-064565ec-b10b-498d-863c-593df76958bd tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:35.753608 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-064565ec-b10b-498d-863c-593df76958bd tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:35.951648 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-064565ec-b10b-498d-863c-593df76958bd tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:35.966143 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-064565ec-b10b-498d-863c-593df76958bd tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:35.967449 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-064565ec-b10b-498d-863c-593df76958bd tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:35.969254 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-064565ec-b10b-498d-863c-593df76958bd tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596" status: 200 len: 1543 microversion: 2.25 time: 0.243522 Oct 17 13:39:35.984532 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 794/1539] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:39:35 2022] GET /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596 => generated 1543 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:39:35.999847 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c8f713a7-c60d-434d-a670-769ebc6b433e tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:36.000672 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c8f713a7-c60d-434d-a670-769ebc6b433e tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] [instance: fd365dc4-44c6-4a00-971e-2699762ab41f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:36.008647 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c8f713a7-c60d-434d-a670-769ebc6b433e tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:36.009456 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c8f713a7-c60d-434d-a670-769ebc6b433e tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:36.010119 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c8f713a7-c60d-434d-a670-769ebc6b433e tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:36.010920 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c8f713a7-c60d-434d-a670-769ebc6b433e tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:36.011503 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c8f713a7-c60d-434d-a670-769ebc6b433e tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:36.012032 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c8f713a7-c60d-434d-a670-769ebc6b433e tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:36.450088 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c8f713a7-c60d-434d-a670-769ebc6b433e tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f" status: 200 len: 1533 microversion: 2.1 time: 0.459834 Oct 17 13:39:36.466119 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 795/1540] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:35 2022] GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f => generated 1533 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:36.481364 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1bfa7ac7-1671-4ef6-b1ab-b069cf0bab82 tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] Action: 'create', calling method: .version_select at 0x7f7cd59e3670>, body: {"keypair": {"name": "tempest-keypair-677728363", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDpoBlTN89enRWK2G3hw8cf5GrdsHubU8KW93sGa0astq3Q4F1m14ebra6o3w6u5/Q3tooR49BcsCfGe8UajrXPgHquN2F7g18pqqzaMqNaVMV+PG+Wq+APcpeEfuCJTuw=="}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:36.523576 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-1bfa7ac7-1671-4ef6-b1ab-b069cf0bab82 tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] Getting quotas for project c937d330643f439e9b078965821023a1. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:39:36.535654 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:39:36.544584 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-1bfa7ac7-1671-4ef6-b1ab-b069cf0bab82 tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] Getting quotas for user d78449f7c7334040b1f9823ec5496da5 and project c937d330643f439e9b078965821023a1. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:39:36.620779 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1bfa7ac7-1671-4ef6-b1ab-b069cf0bab82 tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.149840 Oct 17 13:39:36.623089 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 796/1541] 10.222.0.79 () {62 vars in 1199 bytes} [Mon Oct 17 13:39:36 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 156 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 17 13:39:36.638379 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4967391c-1392-4233-965b-d4b004dcb583 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:36.640533 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4967391c-1392-4233-965b-d4b004dcb583 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: ab2b571e-376c-41d3-a778-44bedcaa5467] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:36.651254 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4967391c-1392-4233-965b-d4b004dcb583 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:36.651254 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4967391c-1392-4233-965b-d4b004dcb583 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:36.651584 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4967391c-1392-4233-965b-d4b004dcb583 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:36.652146 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4967391c-1392-4233-965b-d4b004dcb583 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:36.653166 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4967391c-1392-4233-965b-d4b004dcb583 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:36.653744 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4967391c-1392-4233-965b-d4b004dcb583 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:36.923221 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4967391c-1392-4233-965b-d4b004dcb583 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:36.935833 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4967391c-1392-4233-965b-d4b004dcb583 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467" status: 200 len: 1473 microversion: 2.1 time: 0.311491 Oct 17 13:39:36.955043 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 797/1542] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:36 2022] GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467 => generated 1473 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:36.963538 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-954ce4e7-0efc-4114-9259-86a3373647d9 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:36.963538 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-954ce4e7-0efc-4114-9259-86a3373647d9 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] [instance: 230b658a-6ae7-4812-ab1a-a5fee84100cd] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:36.971605 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-954ce4e7-0efc-4114-9259-86a3373647d9 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:36.972263 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-954ce4e7-0efc-4114-9259-86a3373647d9 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:36.972811 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-954ce4e7-0efc-4114-9259-86a3373647d9 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:36.973660 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-954ce4e7-0efc-4114-9259-86a3373647d9 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:36.974215 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-954ce4e7-0efc-4114-9259-86a3373647d9 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:36.974836 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-954ce4e7-0efc-4114-9259-86a3373647d9 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:37.170784 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-954ce4e7-0efc-4114-9259-86a3373647d9 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e5309bf84f4aafa9a17604f8452366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6642f912ba0467bac461bc7aedbf940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:37.189484 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-954ce4e7-0efc-4114-9259-86a3373647d9 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] 10.222.0.79 "GET /compute/v2.1/servers/230b658a-6ae7-4812-ab1a-a5fee84100cd" status: 200 len: 1276 microversion: 2.1 time: 0.232960 Oct 17 13:39:37.190116 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 798/1543] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:36 2022] GET /compute/v2.1/servers/230b658a-6ae7-4812-ab1a-a5fee84100cd => generated 1276 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:37.196781 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e8527ef2-030b-49e8-88c2-8c0e5cdaece1 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Calling method '.version_select at 0x7f7cd59e3a60>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:37.200314 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e8527ef2-030b-49e8-88c2-8c0e5cdaece1 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:37.202118 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e8527ef2-030b-49e8-88c2-8c0e5cdaece1 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:37.202575 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e8527ef2-030b-49e8-88c2-8c0e5cdaece1 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:37.221302 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e8527ef2-030b-49e8-88c2-8c0e5cdaece1 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] 10.222.0.79 "GET /compute/v2.1/os-migrations" status: 200 len: 2136 microversion: 2.25 time: 0.030058 Oct 17 13:39:37.245908 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 799/1544] 10.222.0.79 () {60 vars in 1184 bytes} [Mon Oct 17 13:39:37 2022] GET /compute/v2.1/os-migrations => generated 2136 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:39:37.250885 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e053460a-a218-42f7-b5d2-29712e3b6d42 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:37.251535 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e053460a-a218-42f7-b5d2-29712e3b6d42 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:37.270900 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e053460a-a218-42f7-b5d2-29712e3b6d42 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:37.271431 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e053460a-a218-42f7-b5d2-29712e3b6d42 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:37.271875 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e053460a-a218-42f7-b5d2-29712e3b6d42 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:37.272579 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e053460a-a218-42f7-b5d2-29712e3b6d42 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:37.273035 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e053460a-a218-42f7-b5d2-29712e3b6d42 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:37.273458 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e053460a-a218-42f7-b5d2-29712e3b6d42 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:37.407603 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e053460a-a218-42f7-b5d2-29712e3b6d42 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:37.420524 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e053460a-a218-42f7-b5d2-29712e3b6d42 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:37.424242 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e053460a-a218-42f7-b5d2-29712e3b6d42 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:37.438622 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e053460a-a218-42f7-b5d2-29712e3b6d42 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1553 microversion: 2.91 time: 0.191383 Oct 17 13:39:37.439118 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 800/1545] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:39:37 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1553 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:39:37.451950 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-dc80fcd9-b405-4ac0-bf58-8dbdaacaa838 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:37.457434 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-dc80fcd9-b405-4ac0-bf58-8dbdaacaa838 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] [instance: 5661197d-b679-48bc-bf2c-11e7b4f962bb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:37.468906 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dc80fcd9-b405-4ac0-bf58-8dbdaacaa838 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:37.469403 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dc80fcd9-b405-4ac0-bf58-8dbdaacaa838 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:37.469842 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dc80fcd9-b405-4ac0-bf58-8dbdaacaa838 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:37.471255 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dc80fcd9-b405-4ac0-bf58-8dbdaacaa838 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:37.471695 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dc80fcd9-b405-4ac0-bf58-8dbdaacaa838 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:37.472116 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dc80fcd9-b405-4ac0-bf58-8dbdaacaa838 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:37.512052 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-dc80fcd9-b405-4ac0-bf58-8dbdaacaa838 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] HTTP exception thrown: Instance 5661197d-b679-48bc-bf2c-11e7b4f962bb could not be found. Oct 17 13:39:37.517676 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-dc80fcd9-b405-4ac0-bf58-8dbdaacaa838 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Request method failure captured: Oct 17 13:39:37.517676 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/5661197d-b679-48bc-bf2c-11e7b4f962bb HTTP/1.1 Oct 17 13:39:37.517676 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:39:37.517676 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:39:37.517676 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:39:37.517676 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:39:37.517676 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:39:37.517676 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:39:37.517676 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:39:37.517676 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:39:37.517676 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVsAxaxhgm8jRrZYPuTTMzPs4vnEdUAfXFgbCtmQAfls3XXaevpslMaQ1qSIW0HLlUw_drjLJUTCtlMMMmczRsFboSJaNQvCfzqqNwKtnG_5W9mNSLBo4-HRMA3QCFJJj5UDNqni80lbhhoNaGtXhIM6gl3vdR6BV-j_zTgp7rmsjq0 Oct 17 13:39:37.517676 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:39:37.517676 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:39:37.517676 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:39:37.517676 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:39:37.517676 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:39:37.517676 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:39:37.517676 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: d4ed14a8051a4b8fb39d56280a2bcb41 Oct 17 13:39:37.517676 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-638645226 Oct 17 13:39:37.517676 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:39:37.517676 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:39:37.519269 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d4ed14a8051a4b8fb39d56280a2bcb41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d4ed14a8051a4b8fb39d56280a2bcb41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d4ed14a8051a4b8fb39d56280a2bcb41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d4ed14a8051a4b8fb39d56280a2bcb41", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:39:37.519269 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-638645226 Oct 17 13:39:37.519269 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: d4ed14a8051a4b8fb39d56280a2bcb41 Oct 17 13:39:37.519269 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-638645226 Oct 17 13:39:37.519269 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-InstanceActionsNegativeTestJSON-638645226-project Oct 17 13:39:37.519269 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:39:37.519269 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:39:37.519269 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 0f5d2462ac744056be55262dacc72de8 Oct 17 13:39:37.519269 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-638645226-project Oct 17 13:39:37.519269 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:39:37.519269 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 5661197d-b679-48bc-bf2c-11e7b4f962bb could not be found. Oct 17 13:39:37.519269 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '5661197d-b679-48bc-bf2c-11e7b4f962bb'} Oct 17 13:39:37.520092 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:39:37.520092 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:37.520092 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:39:37.520092 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:39:37.520092 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:39:37.520092 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:39:37.520092 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:39:37.520092 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:39:37.520092 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:39:37.520092 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:39:37.520092 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5661197d-b679-48bc-bf2c-11e7b4f962bb could not be found. Oct 17 13:39:37.520092 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:39:37.520092 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:39:37.520092 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:39:37.520092 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:37.520092 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:39:37.520092 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:39:37.520092 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:39:37.520092 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:39:37.520092 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:39:37.521402 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:39:37.521402 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:39:37.521402 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:39:37.521402 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:39:37.521402 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:39:37.521402 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:39:37.521402 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:39:37.521402 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5661197d-b679-48bc-bf2c-11e7b4f962bb could not be found. Oct 17 13:39:37.521402 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:39:37.521402 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:39:37.521402 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:39:37.521402 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:37.521402 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:39:37.521402 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:39:37.521402 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:39:37.521402 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:39:37.521402 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5661197d-b679-48bc-bf2c-11e7b4f962bb could not be found. Oct 17 13:39:37.521402 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:39:37.522604 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-dc80fcd9-b405-4ac0-bf58-8dbdaacaa838 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] Returning 404 to user: Instance 5661197d-b679-48bc-bf2c-11e7b4f962bb could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:39:37.522604 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-dc80fcd9-b405-4ac0-bf58-8dbdaacaa838 tempest-InstanceActionsNegativeTestJSON-638645226 tempest-InstanceActionsNegativeTestJSON-638645226-project] 10.222.0.79 "GET /compute/v2.1/servers/5661197d-b679-48bc-bf2c-11e7b4f962bb" status: 404 len: 111 microversion: 2.1 time: 0.076664 Oct 17 13:39:37.540714 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 801/1546] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:37 2022] GET /compute/v2.1/servers/5661197d-b679-48bc-bf2c-11e7b4f962bb => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:39:37.555941 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-80411a3b-8349-4ef6-a9f8-a4eef5ca631b tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:37.568599 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-80411a3b-8349-4ef6-a9f8-a4eef5ca631b tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:37.569100 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-80411a3b-8349-4ef6-a9f8-a4eef5ca631b tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:37.569528 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-80411a3b-8349-4ef6-a9f8-a4eef5ca631b tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:37.570334 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-80411a3b-8349-4ef6-a9f8-a4eef5ca631b tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:37.571515 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-80411a3b-8349-4ef6-a9f8-a4eef5ca631b tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:37.571938 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-80411a3b-8349-4ef6-a9f8-a4eef5ca631b tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:37.637073 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-80411a3b-8349-4ef6-a9f8-a4eef5ca631b tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.095119 Oct 17 13:39:37.637984 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 802/1547] 10.222.0.79 () {58 vars in 1176 bytes} [Mon Oct 17 13:39:37 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:39:37.643104 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b176b424-2e1f-4788-b705-a4ebe0170a63 tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] Calling method '.version_select at 0x7f7cd5a1d550>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:37.682659 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b176b424-2e1f-4788-b705-a4ebe0170a63 tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-677728363" status: 204 len: 0 microversion: 2.2 time: 0.043514 Oct 17 13:39:37.683313 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 803/1548] 10.222.0.79 () {60 vars in 1258 bytes} [Mon Oct 17 13:39:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-677728363 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:39:37.692282 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c2197e20-2bb1-47ee-8674-8ecb91551aa9 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:37.693270 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c2197e20-2bb1-47ee-8674-8ecb91551aa9 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] [instance: 16213741-2241-4f55-b7ca-20ab551e5596] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:37.703584 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c2197e20-2bb1-47ee-8674-8ecb91551aa9 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:37.706156 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c2197e20-2bb1-47ee-8674-8ecb91551aa9 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:37.709221 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c2197e20-2bb1-47ee-8674-8ecb91551aa9 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:37.710304 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c2197e20-2bb1-47ee-8674-8ecb91551aa9 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:37.712715 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c2197e20-2bb1-47ee-8674-8ecb91551aa9 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:37.716847 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c2197e20-2bb1-47ee-8674-8ecb91551aa9 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:38.255619 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-c2197e20-2bb1-47ee-8674-8ecb91551aa9 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lazy-loading 'services' on Instance uuid 16213741-2241-4f55-b7ca-20ab551e5596 {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:39:38.301707 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c2197e20-2bb1-47ee-8674-8ecb91551aa9 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596" status: 200 len: 2038 microversion: 2.25 time: 0.617315 Oct 17 13:39:38.327284 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 804/1549] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:39:37 2022] GET /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596 => generated 2038 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:39:38.327284 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d037690e-ae65-4f3b-9d99-8a0eca16c541 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854247-14", "block_migration": false, "disk_over_commit": false}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:38.338096 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d037690e-ae65-4f3b-9d99-8a0eca16c541 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] [instance: fd365dc4-44c6-4a00-971e-2699762ab41f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:38.356524 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d037690e-ae65-4f3b-9d99-8a0eca16c541 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:38.357647 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d037690e-ae65-4f3b-9d99-8a0eca16c541 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:38.360129 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d037690e-ae65-4f3b-9d99-8a0eca16c541 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:38.361419 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d037690e-ae65-4f3b-9d99-8a0eca16c541 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:38.362068 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d037690e-ae65-4f3b-9d99-8a0eca16c541 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:38.364156 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d037690e-ae65-4f3b-9d99-8a0eca16c541 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:38.428669 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-d037690e-ae65-4f3b-9d99-8a0eca16c541 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lazy-loading 'flavor' on Instance uuid fd365dc4-44c6-4a00-971e-2699762ab41f {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:39:38.466743 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d037690e-ae65-4f3b-9d99-8a0eca16c541 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] [instance: fd365dc4-44c6-4a00-971e-2699762ab41f] Going to try to live migrate instance to n-h2-854247-14 {{(pid=127017) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 17 13:39:39.955561 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b0f6a459-953b-4c5d-b602-34655582caca tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/377d98df-8887-4bb0-8a0b-84e4f2dc3871" status: 200 len: 1449 microversion: 2.1 time: 4.966480 Oct 17 13:39:39.956144 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 746/1550] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:39:34 2022] GET /compute/v2.1/images/377d98df-8887-4bb0-8a0b-84e4f2dc3871 => generated 1449 bytes in 4968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:39.976036 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8ecb159b-8d9d-4d17-b6b5-4cb7c21a043f tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] Action: 'create', calling method: .version_select at 0x7f7cd5059310>, body: {"keypair": {"name": "tempest-keypair-1219864768", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:39.995789 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-8ecb159b-8d9d-4d17-b6b5-4cb7c21a043f tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] Getting quotas for project c937d330643f439e9b078965821023a1. Resources: {'key_pairs'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:39:40.002309 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-8ecb159b-8d9d-4d17-b6b5-4cb7c21a043f tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] Getting quotas for user d78449f7c7334040b1f9823ec5496da5 and project c937d330643f439e9b078965821023a1. Resources: {'key_pairs'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:39:40.015767 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=100 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:39:40.047145 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8ecb159b-8d9d-4d17-b6b5-4cb7c21a043f tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.089003 Oct 17 13:39:40.048115 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 747/1551] 10.222.0.79 () {62 vars in 1199 bytes} [Mon Oct 17 13:39:39 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 91 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 17 13:39:40.059523 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4de3e903-8d39-4b0a-b563-e1a9c2d6795c tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:40.060492 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4de3e903-8d39-4b0a-b563-e1a9c2d6795c tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: ab2b571e-376c-41d3-a778-44bedcaa5467] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:40.069032 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4de3e903-8d39-4b0a-b563-e1a9c2d6795c tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:40.069801 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4de3e903-8d39-4b0a-b563-e1a9c2d6795c tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:40.070481 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4de3e903-8d39-4b0a-b563-e1a9c2d6795c tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:40.071451 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4de3e903-8d39-4b0a-b563-e1a9c2d6795c tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:40.072068 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4de3e903-8d39-4b0a-b563-e1a9c2d6795c tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:40.072650 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4de3e903-8d39-4b0a-b563-e1a9c2d6795c tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:40.361617 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4de3e903-8d39-4b0a-b563-e1a9c2d6795c tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:40.370718 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4de3e903-8d39-4b0a-b563-e1a9c2d6795c tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467" status: 200 len: 1473 microversion: 2.1 time: 0.315640 Oct 17 13:39:40.386316 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 748/1552] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:40 2022] GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467 => generated 1473 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:40.386316 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6c20b704-f08c-4df1-b1a5-adb6749c091f tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:40.386316 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6c20b704-f08c-4df1-b1a5-adb6749c091f tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] [instance: 230b658a-6ae7-4812-ab1a-a5fee84100cd] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:40.403294 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6c20b704-f08c-4df1-b1a5-adb6749c091f tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:40.403789 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6c20b704-f08c-4df1-b1a5-adb6749c091f tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:40.404223 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6c20b704-f08c-4df1-b1a5-adb6749c091f tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:40.404939 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6c20b704-f08c-4df1-b1a5-adb6749c091f tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:40.405394 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6c20b704-f08c-4df1-b1a5-adb6749c091f tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:40.405814 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6c20b704-f08c-4df1-b1a5-adb6749c091f tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:40.707686 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d037690e-ae65-4f3b-9d99-8a0eca16c541 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f/action" status: 202 len: 0 microversion: 2.1 time: 2.393050 Oct 17 13:39:40.714031 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 805/1553] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:39:38 2022] POST /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f/action => generated 0 bytes in 2401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:39:40.737369 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-dfede2da-07a9-4af1-952b-a3f296156b0d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Action: 'create', calling method: .version_select at 0x7f7cd5a1dc10>, body: {"keypair": {"name": "tempest-keypair-774404457", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLUpt4MVu3iy/wYteZFFrtQD12iDt25DFHT604KENr0q6cxrCMhzawhZ3J2xY9N+KildL3TgSB6dhg+oAWg9JNrBZANWhlw+U+9i8I5k6J/JCTnAh9RzvAVCoWv0dbDvvA=="}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:40.793766 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-dfede2da-07a9-4af1-952b-a3f296156b0d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Getting quotas for project 90d4540094b84255821c0ab95304d22a. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:39:40.800856 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-dfede2da-07a9-4af1-952b-a3f296156b0d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Getting quotas for user 5bc3340d39404042af0eca8747874005 and project 90d4540094b84255821c0ab95304d22a. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:39:40.835625 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-dfede2da-07a9-4af1-952b-a3f296156b0d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 0.110409 Oct 17 13:39:40.860727 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 806/1554] 10.222.0.79 () {62 vars in 1200 bytes} [Mon Oct 17 13:39:40 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 146 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 17 13:39:40.876612 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-918b3d6e-5232-4e41-abd2-5de74910a997 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:40.877814 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-918b3d6e-5232-4e41-abd2-5de74910a997 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:40.892247 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-918b3d6e-5232-4e41-abd2-5de74910a997 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:40.892743 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-918b3d6e-5232-4e41-abd2-5de74910a997 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:40.893183 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-918b3d6e-5232-4e41-abd2-5de74910a997 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:40.893912 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-918b3d6e-5232-4e41-abd2-5de74910a997 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:40.894372 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-918b3d6e-5232-4e41-abd2-5de74910a997 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:40.897711 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-918b3d6e-5232-4e41-abd2-5de74910a997 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:41.241686 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6c20b704-f08c-4df1-b1a5-adb6749c091f tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e5309bf84f4aafa9a17604f8452366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6642f912ba0467bac461bc7aedbf940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:41.255893 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6c20b704-f08c-4df1-b1a5-adb6749c091f tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] 10.222.0.79 "GET /compute/v2.1/servers/230b658a-6ae7-4812-ab1a-a5fee84100cd" status: 200 len: 1318 microversion: 2.1 time: 0.880224 Oct 17 13:39:41.263829 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 749/1555] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:40 2022] GET /compute/v2.1/servers/230b658a-6ae7-4812-ab1a-a5fee84100cd => generated 1318 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:41.271999 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-57a353b2-369f-4598-ad7f-0479f79f3793 req-0fa282b5-42b8-4b6a-8ec2-879ca863eeeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "230b658a-6ae7-4812-ab1a-a5fee84100cd", "tag": "67fb96db-403a-458b-b41d-68d7ee942ca8"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:41.295693 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-57a353b2-369f-4598-ad7f-0479f79f3793 req-0fa282b5-42b8-4b6a-8ec2-879ca863eeeb service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:41.299135 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-57a353b2-369f-4598-ad7f-0479f79f3793 req-0fa282b5-42b8-4b6a-8ec2-879ca863eeeb service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:41.300004 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-57a353b2-369f-4598-ad7f-0479f79f3793 req-0fa282b5-42b8-4b6a-8ec2-879ca863eeeb service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:41.328795 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-57a353b2-369f-4598-ad7f-0479f79f3793 req-0fa282b5-42b8-4b6a-8ec2-879ca863eeeb service nova] Creating event network-changed:67fb96db-403a-458b-b41d-68d7ee942ca8 for instance 230b658a-6ae7-4812-ab1a-a5fee84100cd on n-h2-854247-14 Oct 17 13:39:41.335155 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-918b3d6e-5232-4e41-abd2-5de74910a997 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:41.344215 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-57a353b2-369f-4598-ad7f-0479f79f3793 req-0fa282b5-42b8-4b6a-8ec2-879ca863eeeb service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078741 Oct 17 13:39:41.349281 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-918b3d6e-5232-4e41-abd2-5de74910a997 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:41.350104 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 750/1556] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:39:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:39:41.354230 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-918b3d6e-5232-4e41-abd2-5de74910a997 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:41.364062 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2bafa18c-7ac8-43d8-8e9c-c1a51a191e56 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd50710d0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:41.366892 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-918b3d6e-5232-4e41-abd2-5de74910a997 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1553 microversion: 2.91 time: 0.500757 Oct 17 13:39:41.368685 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 807/1557] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:39:40 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1553 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:39:41.373864 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0a39ba21-382c-496f-9095-be95cae61b88 tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] Calling method '.version_select at 0x7f7cd5a1d160>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:41.423142 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0a39ba21-382c-496f-9095-be95cae61b88 tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1219864768" status: 204 len: 0 microversion: 2.2 time: 0.052958 Oct 17 13:39:41.424908 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 808/1558] 10.222.0.79 () {60 vars in 1261 bytes} [Mon Oct 17 13:39:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1219864768 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:39:41.470409 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2bafa18c-7ac8-43d8-8e9c-c1a51a191e56 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/377d98df-8887-4bb0-8a0b-84e4f2dc3871" status: 200 len: 1449 microversion: 2.1 time: 0.118748 Oct 17 13:39:41.475072 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 751/1559] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:39:41 2022] GET /compute/v2.1/images/377d98df-8887-4bb0-8a0b-84e4f2dc3871 => generated 1449 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:41.483581 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6f8e7977-c224-4538-8c60-b98e25c5e132 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:41.488640 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6f8e7977-c224-4538-8c60-b98e25c5e132 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: ab2b571e-376c-41d3-a778-44bedcaa5467] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:41.507485 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6f8e7977-c224-4538-8c60-b98e25c5e132 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:41.512407 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6f8e7977-c224-4538-8c60-b98e25c5e132 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:41.514400 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6f8e7977-c224-4538-8c60-b98e25c5e132 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:41.515353 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6f8e7977-c224-4538-8c60-b98e25c5e132 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:41.517615 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6f8e7977-c224-4538-8c60-b98e25c5e132 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:41.519308 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6f8e7977-c224-4538-8c60-b98e25c5e132 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:41.715344 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-fa36116b-aec9-4e3d-bd5f-2e5991f7ef09 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:41.715972 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-fa36116b-aec9-4e3d-bd5f-2e5991f7ef09 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: fd365dc4-44c6-4a00-971e-2699762ab41f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:41.724626 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fa36116b-aec9-4e3d-bd5f-2e5991f7ef09 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:41.725153 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fa36116b-aec9-4e3d-bd5f-2e5991f7ef09 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:41.725550 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fa36116b-aec9-4e3d-bd5f-2e5991f7ef09 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:41.726260 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fa36116b-aec9-4e3d-bd5f-2e5991f7ef09 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:41.726947 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fa36116b-aec9-4e3d-bd5f-2e5991f7ef09 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:41.727740 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fa36116b-aec9-4e3d-bd5f-2e5991f7ef09 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:41.763355 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:39:41.980121 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6f8e7977-c224-4538-8c60-b98e25c5e132 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:41.987944 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6f8e7977-c224-4538-8c60-b98e25c5e132 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467" status: 200 len: 1473 microversion: 2.1 time: 0.511549 Oct 17 13:39:41.988518 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 752/1560] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:41 2022] GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467 => generated 1473 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:41.998341 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c9ae7eb2-04f5-421f-83cb-1340bc95cec4 tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] Action: 'create', calling method: .version_select at 0x7f7cd50a9b80>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-543190554", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBArd5j8CREYa+wBwrSSyErHMo0LWCfhfz0+Ziw+2G+EYF8FRZGJYRf8qEao/Wva60zK+NKlHgfH/7JMLUHlaI3omYJxKFpgMnxUsleUkL18I2aUBCf1NOoprIG1UooJYYA=="}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:42.008599 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-fa36116b-aec9-4e3d-bd5f-2e5991f7ef09 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:42.021585 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-fa36116b-aec9-4e3d-bd5f-2e5991f7ef09 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f" status: 200 len: 1390 microversion: 2.1 time: 0.594653 Oct 17 13:39:42.043397 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-c9ae7eb2-04f5-421f-83cb-1340bc95cec4 tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] Getting quotas for project c937d330643f439e9b078965821023a1. Resources: {'key_pairs'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:39:42.045460 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 809/1561] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:41 2022] GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f => generated 1390 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:42.048483 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-c9ae7eb2-04f5-421f-83cb-1340bc95cec4 tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] Getting quotas for user d78449f7c7334040b1f9823ec5496da5 and project c937d330643f439e9b078965821023a1. Resources: {'key_pairs'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:39:42.060092 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5db852d0-0582-4340-b2f3-c26e3b3a0bc3 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd5917040>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:42.090171 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c9ae7eb2-04f5-421f-83cb-1340bc95cec4 tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.095471 Oct 17 13:39:42.092424 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 753/1562] 10.222.0.79 () {62 vars in 1199 bytes} [Mon Oct 17 13:39:41 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 99 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 17 13:39:42.110515 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-73e14eec-bbae-43b0-ab0c-5f62125fd0e3 tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] Action: 'create', calling method: .version_select at 0x7f7cd5008670>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-943053940", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMff3Jb7Q1c5UcOw5r6mEqRm4HTV2Y88KS999matEAyll+AWsD+AGRx1CWrzgw881rmnNOtPISuca+523EcIFAVB9uqnB+cKcWYatGpUlbWCMbzUrIeRLJFSKBK1Y4PSQ=="}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:42.139880 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-73e14eec-bbae-43b0-ab0c-5f62125fd0e3 tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] Getting quotas for project c937d330643f439e9b078965821023a1. Resources: {'key_pairs'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:39:42.148159 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-73e14eec-bbae-43b0-ab0c-5f62125fd0e3 tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] Getting quotas for user d78449f7c7334040b1f9823ec5496da5 and project c937d330643f439e9b078965821023a1. Resources: {'key_pairs'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:39:42.189527 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-73e14eec-bbae-43b0-ab0c-5f62125fd0e3 tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.087613 Oct 17 13:39:42.190394 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 754/1563] 10.222.0.79 () {62 vars in 1199 bytes} [Mon Oct 17 13:39:42 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 89 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 17 13:39:42.208877 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9fe0c053-ab3e-4cc8-bdc7-e1eeeced3054 tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] Action: 'create', calling method: .version_select at 0x7f7cd50088b0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-441522974", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZV0aY4Uw1/NDRl2Ys36AM119dNQ+qpt8XyN2b+W7Zx9+REFA+2yXgypfBM1G9YctQdLeo9uvhf/9C2zbJWQxlMnvI7XuzUegSEhIgorchFfSb02mQdrnEQjZ7vnY6HpA=="}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:42.243090 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-9fe0c053-ab3e-4cc8-bdc7-e1eeeced3054 tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] Getting quotas for project c937d330643f439e9b078965821023a1. Resources: {'key_pairs'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:39:42.266476 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-9fe0c053-ab3e-4cc8-bdc7-e1eeeced3054 tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] Getting quotas for user d78449f7c7334040b1f9823ec5496da5 and project c937d330643f439e9b078965821023a1. Resources: {'key_pairs'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:39:42.323537 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9fe0c053-ab3e-4cc8-bdc7-e1eeeced3054 tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.120799 Oct 17 13:39:42.330368 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 755/1564] 10.222.0.79 () {62 vars in 1199 bytes} [Mon Oct 17 13:39:42 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 129 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 17 13:39:42.335576 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-62b1ca69-45a6-4388-9c1d-6da88a7d6570 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:42.339802 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-62b1ca69-45a6-4388-9c1d-6da88a7d6570 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] [instance: 230b658a-6ae7-4812-ab1a-a5fee84100cd] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:42.346383 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-62b1ca69-45a6-4388-9c1d-6da88a7d6570 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:42.347080 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-62b1ca69-45a6-4388-9c1d-6da88a7d6570 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:42.348814 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-62b1ca69-45a6-4388-9c1d-6da88a7d6570 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:42.350455 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-62b1ca69-45a6-4388-9c1d-6da88a7d6570 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:42.351308 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-62b1ca69-45a6-4388-9c1d-6da88a7d6570 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:42.351899 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-62b1ca69-45a6-4388-9c1d-6da88a7d6570 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:42.590155 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-62b1ca69-45a6-4388-9c1d-6da88a7d6570 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e5309bf84f4aafa9a17604f8452366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6642f912ba0467bac461bc7aedbf940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:42.604983 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-62b1ca69-45a6-4388-9c1d-6da88a7d6570 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] 10.222.0.79 "GET /compute/v2.1/servers/230b658a-6ae7-4812-ab1a-a5fee84100cd" status: 200 len: 1318 microversion: 2.1 time: 0.272312 Oct 17 13:39:42.619709 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 756/1565] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:42 2022] GET /compute/v2.1/servers/230b658a-6ae7-4812-ab1a-a5fee84100cd => generated 1318 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:42.641257 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3494c5e6-ff04-4ba1-a260-1a280cbc8e97 tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] Calling method '.version_select at 0x7f7cd506fdc0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:42.646923 n-d-854247-14 devstack@n-api.service[127016]: WARNING oslo_db.sqlalchemy.utils [None req-3494c5e6-ff04-4ba1-a260-1a280cbc8e97 tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 17 13:39:42.662600 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3494c5e6-ff04-4ba1-a260-1a280cbc8e97 tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] 10.222.0.79 "GET /compute/v2.1/os-keypairs" status: 200 len: 1139 microversion: 2.2 time: 0.041305 Oct 17 13:39:42.662851 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 757/1566] 10.222.0.79 () {60 vars in 1177 bytes} [Mon Oct 17 13:39:42 2022] GET /compute/v2.1/os-keypairs => generated 1139 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:42.688512 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6fba9f8d-10a5-4745-995e-c3f7125e09bd tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:42.689117 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6fba9f8d-10a5-4745-995e-c3f7125e09bd tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:42.701293 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6fba9f8d-10a5-4745-995e-c3f7125e09bd tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:42.701785 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6fba9f8d-10a5-4745-995e-c3f7125e09bd tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:42.702221 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6fba9f8d-10a5-4745-995e-c3f7125e09bd tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:42.702932 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6fba9f8d-10a5-4745-995e-c3f7125e09bd tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:42.715692 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6fba9f8d-10a5-4745-995e-c3f7125e09bd tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:42.716194 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6fba9f8d-10a5-4745-995e-c3f7125e09bd tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:42.722730 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=100 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:39:42.973694 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6fba9f8d-10a5-4745-995e-c3f7125e09bd tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:42.990625 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6fba9f8d-10a5-4745-995e-c3f7125e09bd tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:42.992151 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6fba9f8d-10a5-4745-995e-c3f7125e09bd tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:43.008241 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6fba9f8d-10a5-4745-995e-c3f7125e09bd tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1553 microversion: 2.91 time: 0.323842 Oct 17 13:39:43.009044 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 758/1567] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:39:42 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1553 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:39:43.044491 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fee58a29-f317-4771-bc4e-e0386aa48442 tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] Calling method '.version_select at 0x7f7cd506f9d0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:43.095191 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fee58a29-f317-4771-bc4e-e0386aa48442 tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-441522974" status: 204 len: 0 microversion: 2.2 time: 0.067381 Oct 17 13:39:43.096128 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 759/1568] 10.222.0.79 () {60 vars in 1318 bytes} [Mon Oct 17 13:39:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-441522974 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:39:43.104847 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d054a086-a6f6-4712-bbab-f83080f9f434 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:43.105872 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d054a086-a6f6-4712-bbab-f83080f9f434 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: ab2b571e-376c-41d3-a778-44bedcaa5467] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:43.121568 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d054a086-a6f6-4712-bbab-f83080f9f434 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:43.122443 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d054a086-a6f6-4712-bbab-f83080f9f434 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:43.123386 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d054a086-a6f6-4712-bbab-f83080f9f434 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:43.124347 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d054a086-a6f6-4712-bbab-f83080f9f434 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:43.125001 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d054a086-a6f6-4712-bbab-f83080f9f434 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:43.125648 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d054a086-a6f6-4712-bbab-f83080f9f434 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:43.314963 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5db852d0-0582-4340-b2f3-c26e3b3a0bc3 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "DELETE /compute/v2.1/images/377d98df-8887-4bb0-8a0b-84e4f2dc3871" status: 204 len: 0 microversion: 2.1 time: 1.267727 Oct 17 13:39:43.318588 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 810/1569] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:42 2022] DELETE /compute/v2.1/images/377d98df-8887-4bb0-8a0b-84e4f2dc3871 => generated 0 bytes in 1269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:39:43.338336 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a1bfcf06-08c7-4427-8f2d-0d687275e26f tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:43.338997 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a1bfcf06-08c7-4427-8f2d-0d687275e26f tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: fd365dc4-44c6-4a00-971e-2699762ab41f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:43.358021 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a1bfcf06-08c7-4427-8f2d-0d687275e26f tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:43.359695 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a1bfcf06-08c7-4427-8f2d-0d687275e26f tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:43.362784 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a1bfcf06-08c7-4427-8f2d-0d687275e26f tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:43.363796 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a1bfcf06-08c7-4427-8f2d-0d687275e26f tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:43.364472 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a1bfcf06-08c7-4427-8f2d-0d687275e26f tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:43.365081 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a1bfcf06-08c7-4427-8f2d-0d687275e26f tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:43.641093 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d054a086-a6f6-4712-bbab-f83080f9f434 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:43.653899 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d054a086-a6f6-4712-bbab-f83080f9f434 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467" status: 200 len: 1473 microversion: 2.1 time: 0.556964 Oct 17 13:39:43.673307 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 760/1570] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:43 2022] GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467 => generated 1473 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:43.681815 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-857d755b-0bf7-45ac-9e5a-b58b2e64bbdb tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] Calling method '.version_select at 0x7f7cd506f040>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:43.721224 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-857d755b-0bf7-45ac-9e5a-b58b2e64bbdb tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-943053940" status: 204 len: 0 microversion: 2.2 time: 0.046680 Oct 17 13:39:43.726912 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 761/1571] 10.222.0.79 () {60 vars in 1318 bytes} [Mon Oct 17 13:39:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-943053940 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:39:43.733263 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b74ca4e6-7848-41c0-8a06-ac3c9bd7f6d9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:43.734008 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b74ca4e6-7848-41c0-8a06-ac3c9bd7f6d9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: d78e88b4-522f-4e6e-bcaa-dc259d9b8c89] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:43.741122 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b74ca4e6-7848-41c0-8a06-ac3c9bd7f6d9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:43.741866 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b74ca4e6-7848-41c0-8a06-ac3c9bd7f6d9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:43.742403 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b74ca4e6-7848-41c0-8a06-ac3c9bd7f6d9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:43.743394 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b74ca4e6-7848-41c0-8a06-ac3c9bd7f6d9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:43.744289 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b74ca4e6-7848-41c0-8a06-ac3c9bd7f6d9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:43.744818 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b74ca4e6-7848-41c0-8a06-ac3c9bd7f6d9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:43.774910 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b74ca4e6-7848-41c0-8a06-ac3c9bd7f6d9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: d78e88b4-522f-4e6e-bcaa-dc259d9b8c89] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:39:43.877677 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a1bfcf06-08c7-4427-8f2d-0d687275e26f tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:43.899436 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a1bfcf06-08c7-4427-8f2d-0d687275e26f tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f" status: 200 len: 1390 microversion: 2.1 time: 0.576072 Oct 17 13:39:43.901137 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 811/1572] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:43 2022] GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f => generated 1390 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:43.916523 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7e64bab9-2ab6-4804-8cc9-a637d91809d2 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:43.917872 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7e64bab9-2ab6-4804-8cc9-a637d91809d2 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] [instance: 230b658a-6ae7-4812-ab1a-a5fee84100cd] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:43.926807 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7e64bab9-2ab6-4804-8cc9-a637d91809d2 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:43.938222 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7e64bab9-2ab6-4804-8cc9-a637d91809d2 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:43.941934 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7e64bab9-2ab6-4804-8cc9-a637d91809d2 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:43.944773 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7e64bab9-2ab6-4804-8cc9-a637d91809d2 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:43.948208 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7e64bab9-2ab6-4804-8cc9-a637d91809d2 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:43.950329 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7e64bab9-2ab6-4804-8cc9-a637d91809d2 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:43.960747 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b74ca4e6-7848-41c0-8a06-ac3c9bd7f6d9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "DELETE /compute/v2.1/servers/d78e88b4-522f-4e6e-bcaa-dc259d9b8c89" status: 204 len: 0 microversion: 2.1 time: 0.231226 Oct 17 13:39:43.963097 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 762/1573] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:39:43 2022] DELETE /compute/v2.1/servers/d78e88b4-522f-4e6e-bcaa-dc259d9b8c89 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:39:43.988658 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-46ff8a9f-6c1e-44ba-a1d5-b0735dd6b0f5 tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] Calling method '.version_select at 0x7f7cd506f4c0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:44.046716 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-46ff8a9f-6c1e-44ba-a1d5-b0735dd6b0f5 tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-543190554" status: 204 len: 0 microversion: 2.2 time: 0.082095 Oct 17 13:39:44.058187 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 763/1574] 10.222.0.79 () {60 vars in 1318 bytes} [Mon Oct 17 13:39:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-543190554 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:39:44.073105 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-efd37946-b32f-40d5-973a-1033e2d7e7b8 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:44.074859 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-efd37946-b32f-40d5-973a-1033e2d7e7b8 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:44.089841 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-efd37946-b32f-40d5-973a-1033e2d7e7b8 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:44.090207 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-efd37946-b32f-40d5-973a-1033e2d7e7b8 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:44.090717 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-efd37946-b32f-40d5-973a-1033e2d7e7b8 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:44.093232 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-efd37946-b32f-40d5-973a-1033e2d7e7b8 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:44.093609 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-efd37946-b32f-40d5-973a-1033e2d7e7b8 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:44.094106 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-efd37946-b32f-40d5-973a-1033e2d7e7b8 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:44.276501 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-efd37946-b32f-40d5-973a-1033e2d7e7b8 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:44.290138 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-efd37946-b32f-40d5-973a-1033e2d7e7b8 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:44.293108 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-efd37946-b32f-40d5-973a-1033e2d7e7b8 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:44.323495 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-efd37946-b32f-40d5-973a-1033e2d7e7b8 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1553 microversion: 2.91 time: 0.259855 Oct 17 13:39:44.325678 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 764/1575] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:39:44 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1553 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:39:44.332546 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7ec6e8a4-91a5-43dd-a7d5-fb08d7152181 tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] Action: 'create', calling method: .version_select at 0x7f7cd5008040>, body: {"keypair": {"name": "tempest-keypair-1002194046", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJACLwb0cB1EuDC+XOSUFfjzJYb/4uL+JYwwgMxUwpSPE3eDDv9vrgA6AFGHpvslOYPm53MMOS8H5dq5xPeOb3N4lSf94TJ494tkV9k8tFDyZQ5eAAIi8ax8Jsjk9CVGA=="}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:44.388125 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-7ec6e8a4-91a5-43dd-a7d5-fb08d7152181 tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] Getting quotas for project c937d330643f439e9b078965821023a1. Resources: {'key_pairs'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:39:44.400460 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-7ec6e8a4-91a5-43dd-a7d5-fb08d7152181 tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] Getting quotas for user d78449f7c7334040b1f9823ec5496da5 and project c937d330643f439e9b078965821023a1. Resources: {'key_pairs'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:39:44.434410 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7e64bab9-2ab6-4804-8cc9-a637d91809d2 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e5309bf84f4aafa9a17604f8452366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6642f912ba0467bac461bc7aedbf940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:44.445784 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7e64bab9-2ab6-4804-8cc9-a637d91809d2 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] 10.222.0.79 "GET /compute/v2.1/servers/230b658a-6ae7-4812-ab1a-a5fee84100cd" status: 200 len: 1318 microversion: 2.1 time: 0.543322 Oct 17 13:39:44.448180 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 812/1576] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:43 2022] GET /compute/v2.1/servers/230b658a-6ae7-4812-ab1a-a5fee84100cd => generated 1318 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:44.453365 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-571d0de4-41c2-4e96-8e6a-b721802f4b78 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-23898182", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "9fce71af-909d-4a58-8606-ba21d3f4b00f"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:44.456100 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7ec6e8a4-91a5-43dd-a7d5-fb08d7152181 tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.129141 Oct 17 13:39:44.462965 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 765/1577] 10.222.0.79 () {62 vars in 1199 bytes} [Mon Oct 17 13:39:44 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 136 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 17 13:39:44.471428 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-98e829fe-e663-4f7d-90c9-b5d5f44daf93 tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] Calling method '.version_select at 0x7f7cd50a14c0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:44.496268 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-98e829fe-e663-4f7d-90c9-b5d5f44daf93 tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] 10.222.0.79 "GET /compute/v2.1/os-keypairs/tempest-keypair-1002194046" status: 200 len: 513 microversion: 2.2 time: 0.031850 Oct 17 13:39:44.497225 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 766/1578] 10.222.0.79 () {60 vars in 1258 bytes} [Mon Oct 17 13:39:44 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1002194046 => generated 513 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:39:44.524906 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c3ec0466-2b9f-4fe6-8bd1-a6dc83d74d8b tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] Calling method '.version_select at 0x7f7cd50190d0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:44.532243 n-d-854247-14 devstack@n-api.service[127016]: WARNING oslo_db.sqlalchemy.utils [None req-c3ec0466-2b9f-4fe6-8bd1-a6dc83d74d8b tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 17 13:39:44.545671 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c3ec0466-2b9f-4fe6-8bd1-a6dc83d74d8b tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] 10.222.0.79 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.040916 Oct 17 13:39:44.546859 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 767/1579] 10.222.0.79 () {60 vars in 1177 bytes} [Mon Oct 17 13:39:44 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:39:44.547514 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-571d0de4-41c2-4e96-8e6a-b721802f4b78 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] validate_networks() for [('9fce71af-909d-4a58-8606-ba21d3f4b00f', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:39:44.562407 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0df5a2d9-fbdf-4b55-a7b7-f50d584cbb47 tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] Calling method '.version_select at 0x7f7cd50199d0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:44.615100 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=5,nova_api:DELETE=4,nova_api:UPDATE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:39:44.632293 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0df5a2d9-fbdf-4b55-a7b7-f50d584cbb47 tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1002194046" status: 204 len: 0 microversion: 2.2 time: 0.075320 Oct 17 13:39:44.640509 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 768/1580] 10.222.0.79 () {60 vars in 1261 bytes} [Mon Oct 17 13:39:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1002194046 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:39:44.710451 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a56edf58-9c1c-4fba-b2b8-08992869cc62 tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] Action: 'create', calling method: .version_select at 0x7f7cd50a9c10>, body: {"keypair": {"name": "tempest-keypair-2035307312", "type": "x509"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:44.747706 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-a56edf58-9c1c-4fba-b2b8-08992869cc62 tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] Getting quotas for project c937d330643f439e9b078965821023a1. Resources: {'key_pairs'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:39:44.754562 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-a56edf58-9c1c-4fba-b2b8-08992869cc62 tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] Getting quotas for user d78449f7c7334040b1f9823ec5496da5 and project c937d330643f439e9b078965821023a1. Resources: {'key_pairs'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:39:44.780238 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.processutils [None req-a56edf58-9c1c-4fba-b2b8-08992869cc62 tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmp1k1yhjq7/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp1k1yhjq7/temp.key -subj /CN=d78449f7c7334040b1f9823ec5496da5 -extensions v3_req_client {{(pid=127016) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 17 13:39:45.196448 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.processutils [None req-a56edf58-9c1c-4fba-b2b8-08992869cc62 tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmp1k1yhjq7/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp1k1yhjq7/temp.key -subj /CN=d78449f7c7334040b1f9823ec5496da5 -extensions v3_req_client" returned: 0 in 0.414s {{(pid=127016) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 17 13:39:45.198480 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.processutils [None req-a56edf58-9c1c-4fba-b2b8-08992869cc62 tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmp1k1yhjq7/temp.key -password pass: {{(pid=127016) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 17 13:39:45.266172 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.processutils [None req-a56edf58-9c1c-4fba-b2b8-08992869cc62 tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] CMD "openssl pkcs12 -export -inkey /tmp/tmp1k1yhjq7/temp.key -password pass:" returned: 0 in 0.067s {{(pid=127016) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 17 13:39:45.369118 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-a56edf58-9c1c-4fba-b2b8-08992869cc62 tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] Getting quotas for project c937d330643f439e9b078965821023a1. Resources: {'key_pairs'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:39:45.378399 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-a56edf58-9c1c-4fba-b2b8-08992869cc62 tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] Getting quotas for user d78449f7c7334040b1f9823ec5496da5 and project c937d330643f439e9b078965821023a1. Resources: {'key_pairs'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:39:45.460128 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a56edf58-9c1c-4fba-b2b8-08992869cc62 tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.814836 Oct 17 13:39:45.464437 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 769/1581] 10.222.0.79 () {62 vars in 1198 bytes} [Mon Oct 17 13:39:44 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 822 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:39:45.500162 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c8390803-dc13-425d-98df-fdc10df3a2e3 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:45.500917 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c8390803-dc13-425d-98df-fdc10df3a2e3 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: ab2b571e-376c-41d3-a778-44bedcaa5467] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:45.528321 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c8390803-dc13-425d-98df-fdc10df3a2e3 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:45.529269 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c8390803-dc13-425d-98df-fdc10df3a2e3 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:45.529925 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c8390803-dc13-425d-98df-fdc10df3a2e3 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:45.531059 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c8390803-dc13-425d-98df-fdc10df3a2e3 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:45.532695 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c8390803-dc13-425d-98df-fdc10df3a2e3 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:45.533744 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c8390803-dc13-425d-98df-fdc10df3a2e3 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:46.484271 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-571d0de4-41c2-4e96-8e6a-b721802f4b78 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:39:46.485261 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-571d0de4-41c2-4e96-8e6a-b721802f4b78 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:39:46.486196 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-571d0de4-41c2-4e96-8e6a-b721802f4b78 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:39:46.486776 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-571d0de4-41c2-4e96-8e6a-b721802f4b78 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:39:46.487391 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-571d0de4-41c2-4e96-8e6a-b721802f4b78 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:39:46.503313 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-571d0de4-41c2-4e96-8e6a-b721802f4b78 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:46.509988 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-571d0de4-41c2-4e96-8e6a-b721802f4b78 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:46.510664 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-571d0de4-41c2-4e96-8e6a-b721802f4b78 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:46.511676 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-571d0de4-41c2-4e96-8e6a-b721802f4b78 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:46.512373 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-571d0de4-41c2-4e96-8e6a-b721802f4b78 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:46.513025 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-571d0de4-41c2-4e96-8e6a-b721802f4b78 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:46.533818 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c8390803-dc13-425d-98df-fdc10df3a2e3 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:46.584518 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-571d0de4-41c2-4e96-8e6a-b721802f4b78 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Getting quotas for project 461c44cb99ff4958a128679d3e10cd6f. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:39:46.596872 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-571d0de4-41c2-4e96-8e6a-b721802f4b78 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Getting quotas for user 386397fd9194430b81ac465f9b3bf92d and project 461c44cb99ff4958a128679d3e10cd6f. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:39:46.610455 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c8390803-dc13-425d-98df-fdc10df3a2e3 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467" status: 200 len: 1473 microversion: 2.1 time: 1.142032 Oct 17 13:39:46.613750 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 770/1582] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:45 2022] GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467 => generated 1473 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:46.641752 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-60bc2c56-9c0e-46b8-a453-010aa58bd9be tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:46.643778 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-571d0de4-41c2-4e96-8e6a-b721802f4b78 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:39:46.644018 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-60bc2c56-9c0e-46b8-a453-010aa58bd9be tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: fd365dc4-44c6-4a00-971e-2699762ab41f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:46.646134 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-571d0de4-41c2-4e96-8e6a-b721802f4b78 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: b05d2fa3-d231-4842-a47b-26aa317ccaa3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:39:46.652193 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-60bc2c56-9c0e-46b8-a453-010aa58bd9be tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:46.654151 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-60bc2c56-9c0e-46b8-a453-010aa58bd9be tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:46.654883 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-60bc2c56-9c0e-46b8-a453-010aa58bd9be tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:46.656721 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-60bc2c56-9c0e-46b8-a453-010aa58bd9be tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:46.657745 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-60bc2c56-9c0e-46b8-a453-010aa58bd9be tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:46.658710 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-60bc2c56-9c0e-46b8-a453-010aa58bd9be tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:46.794127 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-571d0de4-41c2-4e96-8e6a-b721802f4b78 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.344625 Oct 17 13:39:46.800845 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 813/1583] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:39:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2346 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:39:46.804143 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-02e607db-e5a1-4ec0-8364-b8b2a08192b2 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:46.804789 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-02e607db-e5a1-4ec0-8364-b8b2a08192b2 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:46.822507 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-02e607db-e5a1-4ec0-8364-b8b2a08192b2 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:46.822999 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-02e607db-e5a1-4ec0-8364-b8b2a08192b2 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:46.823495 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-02e607db-e5a1-4ec0-8364-b8b2a08192b2 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:46.824206 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-02e607db-e5a1-4ec0-8364-b8b2a08192b2 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:46.824665 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-02e607db-e5a1-4ec0-8364-b8b2a08192b2 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:46.835429 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-02e607db-e5a1-4ec0-8364-b8b2a08192b2 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:46.984714 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-02e607db-e5a1-4ec0-8364-b8b2a08192b2 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:47.011675 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-02e607db-e5a1-4ec0-8364-b8b2a08192b2 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:47.013803 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-02e607db-e5a1-4ec0-8364-b8b2a08192b2 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:47.017520 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-60bc2c56-9c0e-46b8-a453-010aa58bd9be tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:47.023115 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-02e607db-e5a1-4ec0-8364-b8b2a08192b2 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1553 microversion: 2.91 time: 0.225468 Oct 17 13:39:47.028744 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 814/1584] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:39:46 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1553 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:39:47.047484 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-14ab2462-58e0-4ec9-9cd3-a92bb00835ff tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:47.048399 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-14ab2462-58e0-4ec9-9cd3-a92bb00835ff tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] [instance: 230b658a-6ae7-4812-ab1a-a5fee84100cd] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:47.055672 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-14ab2462-58e0-4ec9-9cd3-a92bb00835ff tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:47.060102 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-14ab2462-58e0-4ec9-9cd3-a92bb00835ff tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:47.062934 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-14ab2462-58e0-4ec9-9cd3-a92bb00835ff tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:47.064087 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-14ab2462-58e0-4ec9-9cd3-a92bb00835ff tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:47.065867 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-60bc2c56-9c0e-46b8-a453-010aa58bd9be tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f" status: 200 len: 1390 microversion: 2.1 time: 0.450542 Oct 17 13:39:47.066561 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-14ab2462-58e0-4ec9-9cd3-a92bb00835ff tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:47.066799 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 771/1585] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:46 2022] GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f => generated 1390 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:47.067345 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-14ab2462-58e0-4ec9-9cd3-a92bb00835ff tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:47.080436 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3d0a87d7-19f2-4ce9-8665-c686fc597410 tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] Calling method '.version_select at 0x7f7cd5449ca0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:47.130503 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3d0a87d7-19f2-4ce9-8665-c686fc597410 tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] 10.222.0.79 "GET /compute/v2.1/os-keypairs/tempest-keypair-2035307312" status: 200 len: 1534 microversion: 2.2 time: 0.062465 Oct 17 13:39:47.137196 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 772/1586] 10.222.0.79 () {60 vars in 1258 bytes} [Mon Oct 17 13:39:47 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2035307312 => generated 1534 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:47.156500 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-85a0ed75-1a17-4c55-a8b9-3cb94cbd4010 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-873265336", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "1fa43ed8-8e4b-47ac-aec2-8368253ad19e"}], "security_groups": [{"name": "tempest-securitygroup--1161943896"}], "key_name": "tempest-keypair-774404457", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:47.356450 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-14ab2462-58e0-4ec9-9cd3-a92bb00835ff tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e5309bf84f4aafa9a17604f8452366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6642f912ba0467bac461bc7aedbf940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:47.370881 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-14ab2462-58e0-4ec9-9cd3-a92bb00835ff tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] 10.222.0.79 "GET /compute/v2.1/servers/230b658a-6ae7-4812-ab1a-a5fee84100cd" status: 200 len: 1318 microversion: 2.1 time: 0.340641 Oct 17 13:39:47.384387 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 815/1587] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:47 2022] GET /compute/v2.1/servers/230b658a-6ae7-4812-ab1a-a5fee84100cd => generated 1318 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:47.399280 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-dd36f51b-4906-4798-984c-047fa5d6008c req-b6cc2c13-3fbd-4d1d-91a5-0828ec08fc66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d78e88b4-522f-4e6e-bcaa-dc259d9b8c89", "name": "network-vif-unplugged", "status": "completed", "tag": "6bcd59a8-7ecc-4515-bd57-70d42b0ae40f"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:47.411378 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-85a0ed75-1a17-4c55-a8b9-3cb94cbd4010 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] validate_networks() for [('1fa43ed8-8e4b-47ac-aec2-8368253ad19e', None, None, None, None, None)] {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:39:47.418154 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-dd36f51b-4906-4798-984c-047fa5d6008c req-b6cc2c13-3fbd-4d1d-91a5-0828ec08fc66 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:47.419033 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-dd36f51b-4906-4798-984c-047fa5d6008c req-b6cc2c13-3fbd-4d1d-91a5-0828ec08fc66 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:47.419712 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-dd36f51b-4906-4798-984c-047fa5d6008c req-b6cc2c13-3fbd-4d1d-91a5-0828ec08fc66 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:47.448940 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-dd36f51b-4906-4798-984c-047fa5d6008c req-b6cc2c13-3fbd-4d1d-91a5-0828ec08fc66 service nova] Creating event network-vif-unplugged:6bcd59a8-7ecc-4515-bd57-70d42b0ae40f for instance d78e88b4-522f-4e6e-bcaa-dc259d9b8c89 on n-h1-854247-14 Oct 17 13:39:47.457164 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-dd36f51b-4906-4798-984c-047fa5d6008c req-b6cc2c13-3fbd-4d1d-91a5-0828ec08fc66 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066843 Oct 17 13:39:47.460081 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 816/1588] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:39:47.468700 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-2b5614fc-3040-4a09-b00d-1d32bafbe589 req-83c0f41c-9cd2-4762-b62a-46ae3a51bae6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d78e88b4-522f-4e6e-bcaa-dc259d9b8c89", "name": "network-vif-deleted", "tag": "6bcd59a8-7ecc-4515-bd57-70d42b0ae40f"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:47.482847 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-2b5614fc-3040-4a09-b00d-1d32bafbe589 req-83c0f41c-9cd2-4762-b62a-46ae3a51bae6 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:47.483647 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-2b5614fc-3040-4a09-b00d-1d32bafbe589 req-83c0f41c-9cd2-4762-b62a-46ae3a51bae6 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:47.484209 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-2b5614fc-3040-4a09-b00d-1d32bafbe589 req-83c0f41c-9cd2-4762-b62a-46ae3a51bae6 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:47.498740 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-2b5614fc-3040-4a09-b00d-1d32bafbe589 req-83c0f41c-9cd2-4762-b62a-46ae3a51bae6 service nova] Creating event network-vif-deleted:6bcd59a8-7ecc-4515-bd57-70d42b0ae40f for instance d78e88b4-522f-4e6e-bcaa-dc259d9b8c89 on n-h1-854247-14 Oct 17 13:39:47.507147 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-2b5614fc-3040-4a09-b00d-1d32bafbe589 req-83c0f41c-9cd2-4762-b62a-46ae3a51bae6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045072 Oct 17 13:39:47.508325 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 817/1589] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:39:47.519425 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e3742bd5-28e2-445a-8ef9-2463ba81d901 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:47.523508 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e3742bd5-28e2-445a-8ef9-2463ba81d901 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: b05d2fa3-d231-4842-a47b-26aa317ccaa3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:47.697343 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e3742bd5-28e2-445a-8ef9-2463ba81d901 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:47.708718 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e3742bd5-28e2-445a-8ef9-2463ba81d901 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/b05d2fa3-d231-4842-a47b-26aa317ccaa3" status: 200 len: 1206 microversion: 2.1 time: 0.197796 Oct 17 13:39:47.720171 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 818/1590] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:47 2022] GET /compute/v2.1/servers/b05d2fa3-d231-4842-a47b-26aa317ccaa3 => generated 1206 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:47.737082 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2c0a163e-16b6-4d56-9c41-a53f515b5b4b tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] Calling method '.version_select at 0x7f7cd5791ee0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:47.759730 n-d-854247-14 devstack@n-api.service[127017]: WARNING oslo_db.sqlalchemy.utils [None req-2c0a163e-16b6-4d56-9c41-a53f515b5b4b tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 17 13:39:47.775550 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2c0a163e-16b6-4d56-9c41-a53f515b5b4b tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] 10.222.0.79 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.053580 Oct 17 13:39:47.776496 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 819/1591] 10.222.0.79 () {60 vars in 1177 bytes} [Mon Oct 17 13:39:47 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:47.790256 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4767f449-6c2f-42ba-8ef6-2bfafe966fb3 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:47.792253 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4767f449-6c2f-42ba-8ef6-2bfafe966fb3 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: ab2b571e-376c-41d3-a778-44bedcaa5467] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:47.809583 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4767f449-6c2f-42ba-8ef6-2bfafe966fb3 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:47.811849 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4767f449-6c2f-42ba-8ef6-2bfafe966fb3 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:47.814369 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4767f449-6c2f-42ba-8ef6-2bfafe966fb3 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:47.816378 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4767f449-6c2f-42ba-8ef6-2bfafe966fb3 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:47.818112 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4767f449-6c2f-42ba-8ef6-2bfafe966fb3 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:47.818785 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4767f449-6c2f-42ba-8ef6-2bfafe966fb3 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:48.167893 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4767f449-6c2f-42ba-8ef6-2bfafe966fb3 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:48.180969 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4767f449-6c2f-42ba-8ef6-2bfafe966fb3 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467" status: 200 len: 1473 microversion: 2.1 time: 0.399775 Oct 17 13:39:48.183540 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 820/1592] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:47 2022] GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467 => generated 1473 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:48.196282 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9eefcb4a-d2a7-4430-a9a1-30b3f39ce8c5 tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] Calling method '.version_select at 0x7f7cd571f310>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:48.238113 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9eefcb4a-d2a7-4430-a9a1-30b3f39ce8c5 tempest-KeyPairsV22TestJSON-1186372217 tempest-KeyPairsV22TestJSON-1186372217-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2035307312" status: 204 len: 0 microversion: 2.2 time: 0.053135 Oct 17 13:39:48.239368 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 821/1593] 10.222.0.79 () {60 vars in 1261 bytes} [Mon Oct 17 13:39:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2035307312 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:39:48.258548 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ffbe8d84-bfac-423a-9140-ab7578750942 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:48.264659 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ffbe8d84-bfac-423a-9140-ab7578750942 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:48.277599 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ffbe8d84-bfac-423a-9140-ab7578750942 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:48.278695 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ffbe8d84-bfac-423a-9140-ab7578750942 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:48.280947 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ffbe8d84-bfac-423a-9140-ab7578750942 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:48.282479 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ffbe8d84-bfac-423a-9140-ab7578750942 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:48.284149 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ffbe8d84-bfac-423a-9140-ab7578750942 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:48.288606 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ffbe8d84-bfac-423a-9140-ab7578750942 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:48.539796 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ffbe8d84-bfac-423a-9140-ab7578750942 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:48.554296 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ffbe8d84-bfac-423a-9140-ab7578750942 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:48.556500 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ffbe8d84-bfac-423a-9140-ab7578750942 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:48.576935 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ffbe8d84-bfac-423a-9140-ab7578750942 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1553 microversion: 2.91 time: 0.336310 Oct 17 13:39:48.599708 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 822/1594] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:39:48 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1553 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:39:48.617428 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7a036a39-2495-40c2-bbf1-7d26b45731cd tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:48.618565 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7a036a39-2495-40c2-bbf1-7d26b45731cd tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: fd365dc4-44c6-4a00-971e-2699762ab41f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:48.625913 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:39:48.634275 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7a036a39-2495-40c2-bbf1-7d26b45731cd tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:48.636930 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7a036a39-2495-40c2-bbf1-7d26b45731cd tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:48.639773 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7a036a39-2495-40c2-bbf1-7d26b45731cd tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:48.642474 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7a036a39-2495-40c2-bbf1-7d26b45731cd tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:48.643255 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7a036a39-2495-40c2-bbf1-7d26b45731cd tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:48.644486 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7a036a39-2495-40c2-bbf1-7d26b45731cd tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:48.650166 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-85a0ed75-1a17-4c55-a8b9-3cb94cbd4010 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:39:48.652126 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-85a0ed75-1a17-4c55-a8b9-3cb94cbd4010 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:39:48.653254 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-85a0ed75-1a17-4c55-a8b9-3cb94cbd4010 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:39:48.653837 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-85a0ed75-1a17-4c55-a8b9-3cb94cbd4010 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:39:48.654418 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-85a0ed75-1a17-4c55-a8b9-3cb94cbd4010 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:39:48.672073 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-85a0ed75-1a17-4c55-a8b9-3cb94cbd4010 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:48.672563 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-85a0ed75-1a17-4c55-a8b9-3cb94cbd4010 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:48.672998 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-85a0ed75-1a17-4c55-a8b9-3cb94cbd4010 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:48.673751 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-85a0ed75-1a17-4c55-a8b9-3cb94cbd4010 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:48.674200 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-85a0ed75-1a17-4c55-a8b9-3cb94cbd4010 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:48.679273 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-85a0ed75-1a17-4c55-a8b9-3cb94cbd4010 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:48.731275 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-85a0ed75-1a17-4c55-a8b9-3cb94cbd4010 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Getting quotas for project 90d4540094b84255821c0ab95304d22a. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:39:48.764355 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-85a0ed75-1a17-4c55-a8b9-3cb94cbd4010 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Getting quotas for user 5bc3340d39404042af0eca8747874005 and project 90d4540094b84255821c0ab95304d22a. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:39:48.825902 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-85a0ed75-1a17-4c55-a8b9-3cb94cbd4010 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:39:48.834100 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-85a0ed75-1a17-4c55-a8b9-3cb94cbd4010 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 709d926d-fba5-49ea-84ac-95d8bb018c68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:39:48.983130 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-85a0ed75-1a17-4c55-a8b9-3cb94cbd4010 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 1.842730 Oct 17 13:39:48.984572 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 773/1595] 10.222.0.79 () {62 vars in 1188 bytes} [Mon Oct 17 13:39:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 1846 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 13:39:49.004348 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-64d2fac5-f9c2-49eb-909a-601b5625f149 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:49.008115 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-64d2fac5-f9c2-49eb-909a-601b5625f149 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] [instance: 230b658a-6ae7-4812-ab1a-a5fee84100cd] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:49.017932 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7a036a39-2495-40c2-bbf1-7d26b45731cd tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:49.019448 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-64d2fac5-f9c2-49eb-909a-601b5625f149 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:49.023152 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-64d2fac5-f9c2-49eb-909a-601b5625f149 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:49.023887 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-64d2fac5-f9c2-49eb-909a-601b5625f149 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:49.025204 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-64d2fac5-f9c2-49eb-909a-601b5625f149 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:49.026511 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-64d2fac5-f9c2-49eb-909a-601b5625f149 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:49.026637 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7a036a39-2495-40c2-bbf1-7d26b45731cd tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f" status: 200 len: 1390 microversion: 2.1 time: 0.425648 Oct 17 13:39:49.027555 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-64d2fac5-f9c2-49eb-909a-601b5625f149 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:49.047379 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 823/1596] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:48 2022] GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f => generated 1390 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:49.052790 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9f787786-2f6f-4574-b38c-192c49588ebe tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:49.059013 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9f787786-2f6f-4574-b38c-192c49588ebe tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: b05d2fa3-d231-4842-a47b-26aa317ccaa3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:49.072394 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f787786-2f6f-4574-b38c-192c49588ebe tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:49.075085 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f787786-2f6f-4574-b38c-192c49588ebe tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:49.080905 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f787786-2f6f-4574-b38c-192c49588ebe tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:49.082005 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f787786-2f6f-4574-b38c-192c49588ebe tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:49.083199 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f787786-2f6f-4574-b38c-192c49588ebe tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:49.083837 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f787786-2f6f-4574-b38c-192c49588ebe tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:49.218652 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9f787786-2f6f-4574-b38c-192c49588ebe tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:49.230987 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9f787786-2f6f-4574-b38c-192c49588ebe tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/b05d2fa3-d231-4842-a47b-26aa317ccaa3" status: 200 len: 1258 microversion: 2.1 time: 0.182135 Oct 17 13:39:49.249648 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 824/1597] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:49 2022] GET /compute/v2.1/servers/b05d2fa3-d231-4842-a47b-26aa317ccaa3 => generated 1258 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:49.257416 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3644d7d3-f7d8-4033-9205-3814826a0dad tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:49.273530 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3644d7d3-f7d8-4033-9205-3814826a0dad tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 709d926d-fba5-49ea-84ac-95d8bb018c68] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:49.499423 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3644d7d3-f7d8-4033-9205-3814826a0dad tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:49.513470 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3644d7d3-f7d8-4033-9205-3814826a0dad tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:49.517809 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3644d7d3-f7d8-4033-9205-3814826a0dad tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:49.519611 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3644d7d3-f7d8-4033-9205-3814826a0dad tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68" status: 200 len: 1284 microversion: 2.25 time: 0.268162 Oct 17 13:39:49.522964 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 825/1598] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:39:49 2022] GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68 => generated 1284 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:39:49.538552 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c5c1e14c-8509-4830-9bc4-aab8a41fdb64 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:49.539489 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c5c1e14c-8509-4830-9bc4-aab8a41fdb64 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: ab2b571e-376c-41d3-a778-44bedcaa5467] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:49.554848 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c5c1e14c-8509-4830-9bc4-aab8a41fdb64 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:49.558835 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c5c1e14c-8509-4830-9bc4-aab8a41fdb64 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:49.561806 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c5c1e14c-8509-4830-9bc4-aab8a41fdb64 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:49.565235 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c5c1e14c-8509-4830-9bc4-aab8a41fdb64 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:49.567467 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c5c1e14c-8509-4830-9bc4-aab8a41fdb64 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:49.569136 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c5c1e14c-8509-4830-9bc4-aab8a41fdb64 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:49.706160 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-64d2fac5-f9c2-49eb-909a-601b5625f149 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e5309bf84f4aafa9a17604f8452366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6642f912ba0467bac461bc7aedbf940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:49.725732 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-64d2fac5-f9c2-49eb-909a-601b5625f149 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] 10.222.0.79 "GET /compute/v2.1/servers/230b658a-6ae7-4812-ab1a-a5fee84100cd" status: 200 len: 1318 microversion: 2.1 time: 0.731552 Oct 17 13:39:49.728906 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 774/1599] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:48 2022] GET /compute/v2.1/servers/230b658a-6ae7-4812-ab1a-a5fee84100cd => generated 1318 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:49.746181 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-5c9a8dba-66c7-493b-92b5-a45fa54e16e4 req-90dabce8-f093-48d3-af12-724d9d8df7cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "230b658a-6ae7-4812-ab1a-a5fee84100cd", "name": "network-vif-plugged", "status": "completed", "tag": "67fb96db-403a-458b-b41d-68d7ee942ca8"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:49.774835 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-5c9a8dba-66c7-493b-92b5-a45fa54e16e4 req-90dabce8-f093-48d3-af12-724d9d8df7cc service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:49.777271 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-5c9a8dba-66c7-493b-92b5-a45fa54e16e4 req-90dabce8-f093-48d3-af12-724d9d8df7cc service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:49.778071 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-5c9a8dba-66c7-493b-92b5-a45fa54e16e4 req-90dabce8-f093-48d3-af12-724d9d8df7cc service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:49.820634 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-5c9a8dba-66c7-493b-92b5-a45fa54e16e4 req-90dabce8-f093-48d3-af12-724d9d8df7cc service nova] Creating event network-vif-plugged:67fb96db-403a-458b-b41d-68d7ee942ca8 for instance 230b658a-6ae7-4812-ab1a-a5fee84100cd on n-h2-854247-14 Oct 17 13:39:49.836000 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-5c9a8dba-66c7-493b-92b5-a45fa54e16e4 req-90dabce8-f093-48d3-af12-724d9d8df7cc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100428 Oct 17 13:39:49.854671 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 775/1600] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:39:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:39:49.870219 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-81395737-616b-47e1-8d72-6e1a64429b2d tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:49.871392 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-81395737-616b-47e1-8d72-6e1a64429b2d tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:49.879498 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-81395737-616b-47e1-8d72-6e1a64429b2d tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:49.880222 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-81395737-616b-47e1-8d72-6e1a64429b2d tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:49.880831 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-81395737-616b-47e1-8d72-6e1a64429b2d tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:49.881703 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-81395737-616b-47e1-8d72-6e1a64429b2d tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:49.882540 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-81395737-616b-47e1-8d72-6e1a64429b2d tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:49.883302 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-81395737-616b-47e1-8d72-6e1a64429b2d tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:50.165438 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-81395737-616b-47e1-8d72-6e1a64429b2d tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:50.190516 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-81395737-616b-47e1-8d72-6e1a64429b2d tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:50.197494 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-81395737-616b-47e1-8d72-6e1a64429b2d tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:50.216574 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-81395737-616b-47e1-8d72-6e1a64429b2d tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1553 microversion: 2.91 time: 0.356087 Oct 17 13:39:50.246100 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 776/1601] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:39:49 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1553 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:39:50.257264 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b0869368-5ced-4f70-9cce-372506cc1474 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:50.262776 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b0869368-5ced-4f70-9cce-372506cc1474 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: fd365dc4-44c6-4a00-971e-2699762ab41f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:50.284031 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b0869368-5ced-4f70-9cce-372506cc1474 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:50.286680 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b0869368-5ced-4f70-9cce-372506cc1474 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:50.291283 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b0869368-5ced-4f70-9cce-372506cc1474 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:50.292435 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b0869368-5ced-4f70-9cce-372506cc1474 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:50.297199 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b0869368-5ced-4f70-9cce-372506cc1474 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:50.306404 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b0869368-5ced-4f70-9cce-372506cc1474 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:50.635751 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c5c1e14c-8509-4830-9bc4-aab8a41fdb64 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:50.651364 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c5c1e14c-8509-4830-9bc4-aab8a41fdb64 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467" status: 200 len: 1473 microversion: 2.1 time: 1.126842 Oct 17 13:39:50.652016 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 826/1602] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:49 2022] GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467 => generated 1473 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:50.670488 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-71e77e7a-ec28-45ff-93fc-3f7c58b40a9c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:50.671107 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-71e77e7a-ec28-45ff-93fc-3f7c58b40a9c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: b05d2fa3-d231-4842-a47b-26aa317ccaa3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:50.691153 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-71e77e7a-ec28-45ff-93fc-3f7c58b40a9c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:50.691669 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-71e77e7a-ec28-45ff-93fc-3f7c58b40a9c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:50.692137 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-71e77e7a-ec28-45ff-93fc-3f7c58b40a9c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:50.692835 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-71e77e7a-ec28-45ff-93fc-3f7c58b40a9c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:50.693288 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-71e77e7a-ec28-45ff-93fc-3f7c58b40a9c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:50.693712 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-71e77e7a-ec28-45ff-93fc-3f7c58b40a9c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:50.893610 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-71e77e7a-ec28-45ff-93fc-3f7c58b40a9c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:50.901941 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b0869368-5ced-4f70-9cce-372506cc1474 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:50.913242 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b0869368-5ced-4f70-9cce-372506cc1474 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f" status: 200 len: 1390 microversion: 2.1 time: 0.665791 Oct 17 13:39:50.915216 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 777/1603] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:50 2022] GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f => generated 1390 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:50.920970 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-71e77e7a-ec28-45ff-93fc-3f7c58b40a9c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/b05d2fa3-d231-4842-a47b-26aa317ccaa3" status: 200 len: 1264 microversion: 2.1 time: 0.252681 Oct 17 13:39:50.928758 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 827/1604] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:50 2022] GET /compute/v2.1/servers/b05d2fa3-d231-4842-a47b-26aa317ccaa3 => generated 1264 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:50.942410 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c18dfd5e-9f2f-4050-aeb1-ba00fd528cf2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:50.943133 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c18dfd5e-9f2f-4050-aeb1-ba00fd528cf2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 709d926d-fba5-49ea-84ac-95d8bb018c68] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:50.962089 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c18dfd5e-9f2f-4050-aeb1-ba00fd528cf2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:50.965432 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c18dfd5e-9f2f-4050-aeb1-ba00fd528cf2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:50.968722 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c18dfd5e-9f2f-4050-aeb1-ba00fd528cf2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:50.971151 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c18dfd5e-9f2f-4050-aeb1-ba00fd528cf2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:50.971889 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c18dfd5e-9f2f-4050-aeb1-ba00fd528cf2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:50.972904 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c18dfd5e-9f2f-4050-aeb1-ba00fd528cf2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:51.177723 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c18dfd5e-9f2f-4050-aeb1-ba00fd528cf2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:51.190781 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c18dfd5e-9f2f-4050-aeb1-ba00fd528cf2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:51.198380 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c18dfd5e-9f2f-4050-aeb1-ba00fd528cf2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:51.202718 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c18dfd5e-9f2f-4050-aeb1-ba00fd528cf2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68" status: 200 len: 1336 microversion: 2.25 time: 0.270524 Oct 17 13:39:51.207832 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 828/1605] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:39:50 2022] GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68 => generated 1336 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:39:51.249024 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0d2c3f8b-385b-4f1d-a1de-f65e50c0c86b tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:51.254207 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0d2c3f8b-385b-4f1d-a1de-f65e50c0c86b tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] [instance: 230b658a-6ae7-4812-ab1a-a5fee84100cd] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:51.273876 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0d2c3f8b-385b-4f1d-a1de-f65e50c0c86b tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:51.284927 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0d2c3f8b-385b-4f1d-a1de-f65e50c0c86b tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:51.285397 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0d2c3f8b-385b-4f1d-a1de-f65e50c0c86b tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:51.286160 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0d2c3f8b-385b-4f1d-a1de-f65e50c0c86b tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:51.286641 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0d2c3f8b-385b-4f1d-a1de-f65e50c0c86b tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:51.287117 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0d2c3f8b-385b-4f1d-a1de-f65e50c0c86b tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:51.456784 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ad6bcd1b-e413-42eb-b2d2-96f05cd9ac5d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-641343426", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "27c9f092-7f1b-4509-a9e2-f5ba474e53a0"}]}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:51.559043 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-ad6bcd1b-e413-42eb-b2d2-96f05cd9ac5d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] validate_networks() for [('27c9f092-7f1b-4509-a9e2-f5ba474e53a0', None, None, None, None, None)] {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:39:51.675856 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0d2c3f8b-385b-4f1d-a1de-f65e50c0c86b tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e5309bf84f4aafa9a17604f8452366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6642f912ba0467bac461bc7aedbf940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:51.694116 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0d2c3f8b-385b-4f1d-a1de-f65e50c0c86b tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] 10.222.0.79 "GET /compute/v2.1/servers/230b658a-6ae7-4812-ab1a-a5fee84100cd" status: 200 len: 1318 microversion: 2.1 time: 0.479002 Oct 17 13:39:51.695037 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 829/1606] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:51 2022] GET /compute/v2.1/servers/230b658a-6ae7-4812-ab1a-a5fee84100cd => generated 1318 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:51.703952 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7118bc83-1aaf-4126-89da-0411f3388504 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:51.708807 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7118bc83-1aaf-4126-89da-0411f3388504 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:51.736807 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7118bc83-1aaf-4126-89da-0411f3388504 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:51.744156 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7118bc83-1aaf-4126-89da-0411f3388504 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:51.745312 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7118bc83-1aaf-4126-89da-0411f3388504 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:51.753235 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7118bc83-1aaf-4126-89da-0411f3388504 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:51.754211 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7118bc83-1aaf-4126-89da-0411f3388504 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:51.759943 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7118bc83-1aaf-4126-89da-0411f3388504 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:52.762693 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7118bc83-1aaf-4126-89da-0411f3388504 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:52.772728 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7118bc83-1aaf-4126-89da-0411f3388504 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:52.780164 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7118bc83-1aaf-4126-89da-0411f3388504 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:52.800575 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7118bc83-1aaf-4126-89da-0411f3388504 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1553 microversion: 2.91 time: 1.104086 Oct 17 13:39:52.803493 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 830/1607] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:39:51 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1553 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:39:52.829970 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-94062598-9c34-41e0-8ade-8c55a1bae43d tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:52.830917 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-94062598-9c34-41e0-8ade-8c55a1bae43d tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: ab2b571e-376c-41d3-a778-44bedcaa5467] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:52.849470 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-94062598-9c34-41e0-8ade-8c55a1bae43d tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:52.868145 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-94062598-9c34-41e0-8ade-8c55a1bae43d tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:52.868758 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-94062598-9c34-41e0-8ade-8c55a1bae43d tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:52.869527 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-94062598-9c34-41e0-8ade-8c55a1bae43d tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:52.870020 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-94062598-9c34-41e0-8ade-8c55a1bae43d tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:52.870440 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-94062598-9c34-41e0-8ade-8c55a1bae43d tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:53.460141 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-94062598-9c34-41e0-8ade-8c55a1bae43d tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:53.481763 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-94062598-9c34-41e0-8ade-8c55a1bae43d tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467" status: 200 len: 1479 microversion: 2.1 time: 0.654071 Oct 17 13:39:53.484670 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 831/1608] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:52 2022] GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467 => generated 1479 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:53.499234 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d513025e-68d1-45a9-aae6-642c9a0661ed tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:53.510349 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d513025e-68d1-45a9-aae6-642c9a0661ed tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: fd365dc4-44c6-4a00-971e-2699762ab41f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:53.531309 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d513025e-68d1-45a9-aae6-642c9a0661ed tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:53.545725 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d513025e-68d1-45a9-aae6-642c9a0661ed tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:53.546537 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d513025e-68d1-45a9-aae6-642c9a0661ed tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:53.547495 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d513025e-68d1-45a9-aae6-642c9a0661ed tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:53.548110 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d513025e-68d1-45a9-aae6-642c9a0661ed tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:53.548968 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d513025e-68d1-45a9-aae6-642c9a0661ed tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:54.167391 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d513025e-68d1-45a9-aae6-642c9a0661ed tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:54.227273 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d513025e-68d1-45a9-aae6-642c9a0661ed tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f" status: 200 len: 1390 microversion: 2.1 time: 0.739025 Oct 17 13:39:54.236532 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 832/1609] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:53 2022] GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f => generated 1390 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:54.263544 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7742aef0-92da-46d5-a965-06e4658542a8 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:54.270903 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7742aef0-92da-46d5-a965-06e4658542a8 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: b05d2fa3-d231-4842-a47b-26aa317ccaa3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:54.300415 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7742aef0-92da-46d5-a965-06e4658542a8 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:54.304285 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7742aef0-92da-46d5-a965-06e4658542a8 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:54.307393 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7742aef0-92da-46d5-a965-06e4658542a8 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:54.308502 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7742aef0-92da-46d5-a965-06e4658542a8 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:54.314469 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7742aef0-92da-46d5-a965-06e4658542a8 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:54.317894 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7742aef0-92da-46d5-a965-06e4658542a8 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:54.347096 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=100 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:39:54.767406 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7742aef0-92da-46d5-a965-06e4658542a8 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:54.777365 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7742aef0-92da-46d5-a965-06e4658542a8 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/b05d2fa3-d231-4842-a47b-26aa317ccaa3" status: 200 len: 1306 microversion: 2.1 time: 0.539420 Oct 17 13:39:54.779708 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 833/1610] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:54 2022] GET /compute/v2.1/servers/b05d2fa3-d231-4842-a47b-26aa317ccaa3 => generated 1306 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:54.786807 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6492b7c0-1321-4730-bf63-1fa3b122cccf tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:54.787450 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6492b7c0-1321-4730-bf63-1fa3b122cccf tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 709d926d-fba5-49ea-84ac-95d8bb018c68] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:54.806213 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6492b7c0-1321-4730-bf63-1fa3b122cccf tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:54.806728 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6492b7c0-1321-4730-bf63-1fa3b122cccf tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:54.810220 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6492b7c0-1321-4730-bf63-1fa3b122cccf tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:54.811099 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6492b7c0-1321-4730-bf63-1fa3b122cccf tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:54.815376 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6492b7c0-1321-4730-bf63-1fa3b122cccf tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:54.815824 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6492b7c0-1321-4730-bf63-1fa3b122cccf tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:55.118694 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-ad6bcd1b-e413-42eb-b2d2-96f05cd9ac5d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:39:55.120353 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-ad6bcd1b-e413-42eb-b2d2-96f05cd9ac5d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:39:55.121964 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-ad6bcd1b-e413-42eb-b2d2-96f05cd9ac5d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:39:55.122709 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-ad6bcd1b-e413-42eb-b2d2-96f05cd9ac5d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:39:55.124234 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-ad6bcd1b-e413-42eb-b2d2-96f05cd9ac5d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:39:55.157442 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ad6bcd1b-e413-42eb-b2d2-96f05cd9ac5d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:55.162530 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ad6bcd1b-e413-42eb-b2d2-96f05cd9ac5d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:55.163299 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ad6bcd1b-e413-42eb-b2d2-96f05cd9ac5d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:55.165852 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ad6bcd1b-e413-42eb-b2d2-96f05cd9ac5d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:55.171603 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ad6bcd1b-e413-42eb-b2d2-96f05cd9ac5d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:55.175403 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ad6bcd1b-e413-42eb-b2d2-96f05cd9ac5d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:55.247615 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-ad6bcd1b-e413-42eb-b2d2-96f05cd9ac5d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Getting quotas for project 66d121d0b216416592c7048c2a46f625. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:39:55.282429 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-ad6bcd1b-e413-42eb-b2d2-96f05cd9ac5d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Getting quotas for user b849e8b87a4b49ffa7ad2dd6e95260aa and project 66d121d0b216416592c7048c2a46f625. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:39:55.361691 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ad6bcd1b-e413-42eb-b2d2-96f05cd9ac5d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:39:55.371041 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ad6bcd1b-e413-42eb-b2d2-96f05cd9ac5d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] [instance: 3d4188da-b0f7-4d97-952b-acebaa48f185] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:39:55.471685 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6492b7c0-1321-4730-bf63-1fa3b122cccf tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:55.480466 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ad6bcd1b-e413-42eb-b2d2-96f05cd9ac5d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.562172 Oct 17 13:39:55.481960 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 778/1611] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:39:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 4565 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:39:55.504921 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6492b7c0-1321-4730-bf63-1fa3b122cccf tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:55.507680 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d951b6bc-568f-4c7c-827c-efadaf00bffd tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:55.509906 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6492b7c0-1321-4730-bf63-1fa3b122cccf tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:55.510488 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d951b6bc-568f-4c7c-827c-efadaf00bffd tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] [instance: 230b658a-6ae7-4812-ab1a-a5fee84100cd] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:55.514114 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6492b7c0-1321-4730-bf63-1fa3b122cccf tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68" status: 200 len: 1410 microversion: 2.25 time: 0.733376 Oct 17 13:39:55.517859 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 834/1612] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:39:54 2022] GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68 => generated 1410 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:39:55.580323 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d951b6bc-568f-4c7c-827c-efadaf00bffd tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:55.580865 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d951b6bc-568f-4c7c-827c-efadaf00bffd tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:55.581456 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d951b6bc-568f-4c7c-827c-efadaf00bffd tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:55.582523 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b7c99e13-2f03-4058-ab29-04aeee5b2515 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:55.583181 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b7c99e13-2f03-4058-ab29-04aeee5b2515 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:55.584415 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d951b6bc-568f-4c7c-827c-efadaf00bffd tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:55.586040 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d951b6bc-568f-4c7c-827c-efadaf00bffd tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:55.587692 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d951b6bc-568f-4c7c-827c-efadaf00bffd tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:55.614622 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b7c99e13-2f03-4058-ab29-04aeee5b2515 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:55.615940 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b7c99e13-2f03-4058-ab29-04aeee5b2515 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:55.616409 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b7c99e13-2f03-4058-ab29-04aeee5b2515 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:55.623780 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b7c99e13-2f03-4058-ab29-04aeee5b2515 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:55.624671 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b7c99e13-2f03-4058-ab29-04aeee5b2515 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:55.625124 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b7c99e13-2f03-4058-ab29-04aeee5b2515 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:55.924707 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b7c99e13-2f03-4058-ab29-04aeee5b2515 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:55.936985 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b7c99e13-2f03-4058-ab29-04aeee5b2515 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:55.939250 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b7c99e13-2f03-4058-ab29-04aeee5b2515 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:55.947576 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b7c99e13-2f03-4058-ab29-04aeee5b2515 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1553 microversion: 2.91 time: 0.405416 Oct 17 13:39:55.948260 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 835/1613] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:39:55 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1553 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:39:55.953269 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4e496d78-9963-4ee1-82ee-294d6744402f tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:55.954249 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4e496d78-9963-4ee1-82ee-294d6744402f tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: ab2b571e-376c-41d3-a778-44bedcaa5467] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:55.966834 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4e496d78-9963-4ee1-82ee-294d6744402f tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:55.967918 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4e496d78-9963-4ee1-82ee-294d6744402f tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:55.969047 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4e496d78-9963-4ee1-82ee-294d6744402f tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:55.969990 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4e496d78-9963-4ee1-82ee-294d6744402f tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:55.970957 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4e496d78-9963-4ee1-82ee-294d6744402f tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:55.971660 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4e496d78-9963-4ee1-82ee-294d6744402f tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:55.991003 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d951b6bc-568f-4c7c-827c-efadaf00bffd tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e5309bf84f4aafa9a17604f8452366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6642f912ba0467bac461bc7aedbf940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:56.005601 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d951b6bc-568f-4c7c-827c-efadaf00bffd tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] 10.222.0.79 "GET /compute/v2.1/servers/230b658a-6ae7-4812-ab1a-a5fee84100cd" status: 200 len: 1507 microversion: 2.1 time: 0.521991 Oct 17 13:39:56.012046 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 779/1614] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:55 2022] GET /compute/v2.1/servers/230b658a-6ae7-4812-ab1a-a5fee84100cd => generated 1507 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:56.020503 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-6c1d4b2e-e712-429c-823a-3f2027497c20 req-9810a30b-6fbb-49c6-8af1-bd1b7fa214e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "709d926d-fba5-49ea-84ac-95d8bb018c68", "tag": "8407f400-367b-4c97-9c87-63bd179d8941"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:56.045015 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-6c1d4b2e-e712-429c-823a-3f2027497c20 req-9810a30b-6fbb-49c6-8af1-bd1b7fa214e6 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:56.045574 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-6c1d4b2e-e712-429c-823a-3f2027497c20 req-9810a30b-6fbb-49c6-8af1-bd1b7fa214e6 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:56.046064 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-6c1d4b2e-e712-429c-823a-3f2027497c20 req-9810a30b-6fbb-49c6-8af1-bd1b7fa214e6 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:56.069427 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-6c1d4b2e-e712-429c-823a-3f2027497c20 req-9810a30b-6fbb-49c6-8af1-bd1b7fa214e6 service nova] Creating event network-changed:8407f400-367b-4c97-9c87-63bd179d8941 for instance 709d926d-fba5-49ea-84ac-95d8bb018c68 on n-h1-854247-14 Oct 17 13:39:56.085973 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-6c1d4b2e-e712-429c-823a-3f2027497c20 req-9810a30b-6fbb-49c6-8af1-bd1b7fa214e6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072545 Oct 17 13:39:56.089067 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 780/1615] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:39:56.109454 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8d07034f-57e9-4f47-9e43-e61442615426 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:56.110441 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8d07034f-57e9-4f47-9e43-e61442615426 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: fd365dc4-44c6-4a00-971e-2699762ab41f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:56.129725 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8d07034f-57e9-4f47-9e43-e61442615426 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:56.131610 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8d07034f-57e9-4f47-9e43-e61442615426 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:56.134480 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8d07034f-57e9-4f47-9e43-e61442615426 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:56.137360 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8d07034f-57e9-4f47-9e43-e61442615426 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:56.138131 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8d07034f-57e9-4f47-9e43-e61442615426 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:56.138778 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8d07034f-57e9-4f47-9e43-e61442615426 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:56.520964 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4e496d78-9963-4ee1-82ee-294d6744402f tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:56.536165 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4e496d78-9963-4ee1-82ee-294d6744402f tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467" status: 200 len: 1479 microversion: 2.1 time: 0.585385 Oct 17 13:39:56.548475 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 836/1616] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:55 2022] GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467 => generated 1479 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:56.566506 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8d07034f-57e9-4f47-9e43-e61442615426 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:56.570313 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-937f59c8-8afd-4c95-a17c-a0b331096669 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-906005442", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "27c9f092-7f1b-4509-a9e2-f5ba474e53a0"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:56.591034 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8d07034f-57e9-4f47-9e43-e61442615426 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f" status: 200 len: 1390 microversion: 2.1 time: 0.500465 Oct 17 13:39:56.607428 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 781/1617] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:56 2022] GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f => generated 1390 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:56.618807 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=6 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:39:56.623393 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-15de410f-ab95-4e38-9381-70d0744c84a9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:56.628589 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-15de410f-ab95-4e38-9381-70d0744c84a9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: b05d2fa3-d231-4842-a47b-26aa317ccaa3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:56.636038 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-15de410f-ab95-4e38-9381-70d0744c84a9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:56.647947 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-15de410f-ab95-4e38-9381-70d0744c84a9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:56.648396 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-15de410f-ab95-4e38-9381-70d0744c84a9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:56.649516 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-15de410f-ab95-4e38-9381-70d0744c84a9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:56.649850 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-15de410f-ab95-4e38-9381-70d0744c84a9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:56.650448 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-15de410f-ab95-4e38-9381-70d0744c84a9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:56.679073 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-937f59c8-8afd-4c95-a17c-a0b331096669 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] validate_networks() for [('27c9f092-7f1b-4509-a9e2-f5ba474e53a0', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:39:57.328245 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-15de410f-ab95-4e38-9381-70d0744c84a9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:57.342062 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-15de410f-ab95-4e38-9381-70d0744c84a9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/b05d2fa3-d231-4842-a47b-26aa317ccaa3" status: 200 len: 1306 microversion: 2.1 time: 0.729280 Oct 17 13:39:57.342716 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 782/1618] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:56 2022] GET /compute/v2.1/servers/b05d2fa3-d231-4842-a47b-26aa317ccaa3 => generated 1306 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:57.366180 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-887ff850-e246-472a-8079-3eed319e45b8 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:57.370083 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-887ff850-e246-472a-8079-3eed319e45b8 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 709d926d-fba5-49ea-84ac-95d8bb018c68] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:57.394530 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-887ff850-e246-472a-8079-3eed319e45b8 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:57.395282 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-887ff850-e246-472a-8079-3eed319e45b8 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:57.395883 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-887ff850-e246-472a-8079-3eed319e45b8 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:57.396839 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-887ff850-e246-472a-8079-3eed319e45b8 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:57.397479 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-887ff850-e246-472a-8079-3eed319e45b8 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:57.397910 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-887ff850-e246-472a-8079-3eed319e45b8 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:58.262596 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-887ff850-e246-472a-8079-3eed319e45b8 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:58.277509 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-887ff850-e246-472a-8079-3eed319e45b8 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:58.278739 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-887ff850-e246-472a-8079-3eed319e45b8 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:58.279917 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-887ff850-e246-472a-8079-3eed319e45b8 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68" status: 200 len: 1410 microversion: 2.25 time: 0.918797 Oct 17 13:39:58.280471 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 783/1619] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:39:57 2022] GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68 => generated 1410 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:39:58.301568 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7ffffc8f-5795-4882-bc9e-4b80b7c6bba5 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:58.302470 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7ffffc8f-5795-4882-bc9e-4b80b7c6bba5 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:58.309569 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7ffffc8f-5795-4882-bc9e-4b80b7c6bba5 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:58.310255 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7ffffc8f-5795-4882-bc9e-4b80b7c6bba5 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:58.310871 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7ffffc8f-5795-4882-bc9e-4b80b7c6bba5 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:58.311906 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7ffffc8f-5795-4882-bc9e-4b80b7c6bba5 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:58.312829 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7ffffc8f-5795-4882-bc9e-4b80b7c6bba5 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:58.313582 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7ffffc8f-5795-4882-bc9e-4b80b7c6bba5 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:58.413486 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7ffffc8f-5795-4882-bc9e-4b80b7c6bba5 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:58.419290 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:39:58.427465 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7ffffc8f-5795-4882-bc9e-4b80b7c6bba5 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:58.429631 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7ffffc8f-5795-4882-bc9e-4b80b7c6bba5 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:58.430299 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-937f59c8-8afd-4c95-a17c-a0b331096669 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:39:58.431081 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-937f59c8-8afd-4c95-a17c-a0b331096669 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:39:58.432044 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-937f59c8-8afd-4c95-a17c-a0b331096669 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:39:58.432482 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-937f59c8-8afd-4c95-a17c-a0b331096669 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:39:58.433040 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-937f59c8-8afd-4c95-a17c-a0b331096669 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:39:58.439327 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7ffffc8f-5795-4882-bc9e-4b80b7c6bba5 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1535 microversion: 2.91 time: 0.141391 Oct 17 13:39:58.440259 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 784/1620] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:39:58 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1535 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:39:58.444846 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=29 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:39:58.445381 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-214b4eb7-a6f2-41ff-a85c-ee7b3736341b req-a0e4e42d-e0fb-4bf3-bebf-3660859d80e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b05d2fa3-d231-4842-a47b-26aa317ccaa3", "tag": "e6d816ac-9228-42e4-83a0-1b8d95fc766f"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:58.446762 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-937f59c8-8afd-4c95-a17c-a0b331096669 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:58.447446 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-937f59c8-8afd-4c95-a17c-a0b331096669 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:58.447884 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-937f59c8-8afd-4c95-a17c-a0b331096669 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:58.448630 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-937f59c8-8afd-4c95-a17c-a0b331096669 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:58.449075 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-937f59c8-8afd-4c95-a17c-a0b331096669 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:58.449495 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-937f59c8-8afd-4c95-a17c-a0b331096669 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:58.473553 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-214b4eb7-a6f2-41ff-a85c-ee7b3736341b req-a0e4e42d-e0fb-4bf3-bebf-3660859d80e9 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:58.474242 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-937f59c8-8afd-4c95-a17c-a0b331096669 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Getting quotas for project 66d121d0b216416592c7048c2a46f625. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:39:58.474582 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-214b4eb7-a6f2-41ff-a85c-ee7b3736341b req-a0e4e42d-e0fb-4bf3-bebf-3660859d80e9 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:58.475180 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-214b4eb7-a6f2-41ff-a85c-ee7b3736341b req-a0e4e42d-e0fb-4bf3-bebf-3660859d80e9 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:58.481513 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-937f59c8-8afd-4c95-a17c-a0b331096669 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Getting quotas for user b849e8b87a4b49ffa7ad2dd6e95260aa and project 66d121d0b216416592c7048c2a46f625. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:39:58.489501 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-214b4eb7-a6f2-41ff-a85c-ee7b3736341b req-a0e4e42d-e0fb-4bf3-bebf-3660859d80e9 service nova] Creating event network-changed:e6d816ac-9228-42e4-83a0-1b8d95fc766f for instance b05d2fa3-d231-4842-a47b-26aa317ccaa3 on n-h1-854247-14 Oct 17 13:39:58.495594 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-214b4eb7-a6f2-41ff-a85c-ee7b3736341b req-a0e4e42d-e0fb-4bf3-bebf-3660859d80e9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053627 Oct 17 13:39:58.496435 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 785/1621] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:39:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:39:58.503070 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-937f59c8-8afd-4c95-a17c-a0b331096669 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:39:58.503756 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ab2cb2ae-1358-425e-9349-aa45def86100 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:58.504713 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ab2cb2ae-1358-425e-9349-aa45def86100 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: ab2b571e-376c-41d3-a778-44bedcaa5467] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:58.507585 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-937f59c8-8afd-4c95-a17c-a0b331096669 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] [instance: d30452eb-38cd-413a-9369-f60aad1d31bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:39:58.512886 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ab2cb2ae-1358-425e-9349-aa45def86100 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:58.513551 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ab2cb2ae-1358-425e-9349-aa45def86100 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:58.514140 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ab2cb2ae-1358-425e-9349-aa45def86100 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:58.515374 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ab2cb2ae-1358-425e-9349-aa45def86100 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:58.516070 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ab2cb2ae-1358-425e-9349-aa45def86100 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:58.516672 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ab2cb2ae-1358-425e-9349-aa45def86100 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:58.580651 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-937f59c8-8afd-4c95-a17c-a0b331096669 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.029980 Oct 17 13:39:58.593219 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 837/1622] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:39:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 2033 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:39:58.593219 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ca8468db-37a6-4a7c-93fb-e361283c1510 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:58.593219 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ca8468db-37a6-4a7c-93fb-e361283c1510 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: fd365dc4-44c6-4a00-971e-2699762ab41f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:58.609909 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ca8468db-37a6-4a7c-93fb-e361283c1510 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:58.612038 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ca8468db-37a6-4a7c-93fb-e361283c1510 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:58.612491 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ca8468db-37a6-4a7c-93fb-e361283c1510 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:58.619686 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ca8468db-37a6-4a7c-93fb-e361283c1510 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:58.620424 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ca8468db-37a6-4a7c-93fb-e361283c1510 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:58.620886 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ca8468db-37a6-4a7c-93fb-e361283c1510 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:58.745987 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ab2cb2ae-1358-425e-9349-aa45def86100 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:58.762306 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ab2cb2ae-1358-425e-9349-aa45def86100 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467" status: 200 len: 1479 microversion: 2.1 time: 0.262806 Oct 17 13:39:58.766799 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 786/1623] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:58 2022] GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467 => generated 1479 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:58.780358 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-4f517d61-1287-4c1c-bde3-be5dfcd71e00 req-e95b45d0-f4fa-45a3-912c-6b730cecd405 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab2b571e-376c-41d3-a778-44bedcaa5467", "name": "network-vif-unplugged", "status": "completed", "tag": "7ff3914f-4ed0-4fef-bc81-8a07b3c2c97b"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:58.812038 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-4f517d61-1287-4c1c-bde3-be5dfcd71e00 req-e95b45d0-f4fa-45a3-912c-6b730cecd405 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:58.814850 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-4f517d61-1287-4c1c-bde3-be5dfcd71e00 req-e95b45d0-f4fa-45a3-912c-6b730cecd405 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:58.816336 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-4f517d61-1287-4c1c-bde3-be5dfcd71e00 req-e95b45d0-f4fa-45a3-912c-6b730cecd405 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:58.840572 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-4f517d61-1287-4c1c-bde3-be5dfcd71e00 req-e95b45d0-f4fa-45a3-912c-6b730cecd405 service nova] Creating event network-vif-unplugged:7ff3914f-4ed0-4fef-bc81-8a07b3c2c97b for instance ab2b571e-376c-41d3-a778-44bedcaa5467 on n-h2-854247-14 Oct 17 13:39:58.861938 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-4f517d61-1287-4c1c-bde3-be5dfcd71e00 req-e95b45d0-f4fa-45a3-912c-6b730cecd405 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092064 Oct 17 13:39:58.883494 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 787/1624] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:39:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:39:58.893760 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-10fc49ad-a070-45eb-aa87-3c7459951c68 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:58.895904 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-10fc49ad-a070-45eb-aa87-3c7459951c68 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: b05d2fa3-d231-4842-a47b-26aa317ccaa3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:58.916971 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-10fc49ad-a070-45eb-aa87-3c7459951c68 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:58.917627 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-10fc49ad-a070-45eb-aa87-3c7459951c68 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:58.918863 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-10fc49ad-a070-45eb-aa87-3c7459951c68 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:58.921082 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-10fc49ad-a070-45eb-aa87-3c7459951c68 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:58.924223 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-10fc49ad-a070-45eb-aa87-3c7459951c68 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:58.925126 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-10fc49ad-a070-45eb-aa87-3c7459951c68 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:58.934946 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ca8468db-37a6-4a7c-93fb-e361283c1510 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:58.947814 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ca8468db-37a6-4a7c-93fb-e361283c1510 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f" status: 200 len: 1390 microversion: 2.1 time: 0.364445 Oct 17 13:39:58.949104 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 838/1625] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:58 2022] GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f => generated 1390 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:58.957537 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-70951cc1-7e36-4538-adb9-5117437c4721 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1556301582", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "451", "networks": [{"uuid": "27c9f092-7f1b-4509-a9e2-f5ba474e53a0"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:59.061009 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-70951cc1-7e36-4538-adb9-5117437c4721 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] validate_networks() for [('27c9f092-7f1b-4509-a9e2-f5ba474e53a0', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:39:59.252739 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-10fc49ad-a070-45eb-aa87-3c7459951c68 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:59.272826 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-10fc49ad-a070-45eb-aa87-3c7459951c68 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/b05d2fa3-d231-4842-a47b-26aa317ccaa3" status: 200 len: 1306 microversion: 2.1 time: 0.393423 Oct 17 13:39:59.273716 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 788/1626] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:58 2022] GET /compute/v2.1/servers/b05d2fa3-d231-4842-a47b-26aa317ccaa3 => generated 1306 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:59.282052 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f0d2a202-2442-4a1e-a8fa-5bd112d0d5d0 tempest-VolumesAdminNegativeTest-2051731892 tempest-VolumesAdminNegativeTest-2051731892-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "7481a35f-1f59-4231-a949-fe96b0cb1d75"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:59.293343 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f0d2a202-2442-4a1e-a8fa-5bd112d0d5d0 tempest-VolumesAdminNegativeTest-2051731892 tempest-VolumesAdminNegativeTest-2051731892-project-admin] [instance: 230b658a-6ae7-4812-ab1a-a5fee84100cd] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:59.318237 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f0d2a202-2442-4a1e-a8fa-5bd112d0d5d0 tempest-VolumesAdminNegativeTest-2051731892 tempest-VolumesAdminNegativeTest-2051731892-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:59.318954 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f0d2a202-2442-4a1e-a8fa-5bd112d0d5d0 tempest-VolumesAdminNegativeTest-2051731892 tempest-VolumesAdminNegativeTest-2051731892-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:59.320073 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f0d2a202-2442-4a1e-a8fa-5bd112d0d5d0 tempest-VolumesAdminNegativeTest-2051731892 tempest-VolumesAdminNegativeTest-2051731892-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:59.323920 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f0d2a202-2442-4a1e-a8fa-5bd112d0d5d0 tempest-VolumesAdminNegativeTest-2051731892 tempest-VolumesAdminNegativeTest-2051731892-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:59.324595 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f0d2a202-2442-4a1e-a8fa-5bd112d0d5d0 tempest-VolumesAdminNegativeTest-2051731892 tempest-VolumesAdminNegativeTest-2051731892-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:59.325316 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f0d2a202-2442-4a1e-a8fa-5bd112d0d5d0 tempest-VolumesAdminNegativeTest-2051731892 tempest-VolumesAdminNegativeTest-2051731892-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:59.418180 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-f0d2a202-2442-4a1e-a8fa-5bd112d0d5d0 tempest-VolumesAdminNegativeTest-2051731892 tempest-VolumesAdminNegativeTest-2051731892-project-admin] HTTP exception thrown: Volume cd4291e5-7475-4c89-a1ee-812230b8f80d could not be found. Oct 17 13:39:59.420955 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f0d2a202-2442-4a1e-a8fa-5bd112d0d5d0 tempest-VolumesAdminNegativeTest-2051731892 tempest-VolumesAdminNegativeTest-2051731892-project-admin] Request method failure captured: Oct 17 13:39:59.420955 n-d-854247-14 devstack@n-api.service[127016]: request: PUT /compute/v2.1/servers/230b658a-6ae7-4812-ab1a-a5fee84100cd/os-volume_attachments/cd4291e5-7475-4c89-a1ee-812230b8f80d HTTP/1.1 Oct 17 13:39:59.420955 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:39:59.420955 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:39:59.420955 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:39:59.420955 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 74 Oct 17 13:39:59.420955 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:39:59.420955 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:39:59.420955 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:39:59.420955 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:39:59.420955 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVqjJRRApRhv7Znhke9NqevYx0aJnuFYEZqK3h_7w1T0hBTZRbVlHX_cjgPJlzD2Jsf6oBp5agkTRqDv7YyRrg9xe3a3LZIs3-Of5bkt9IrjglHpfXCMGPX5TBS0sL0jcMqY6ng9r8DS0HMz_y2lk33QgKQm_bziQ-ZoriOgGUyIuDg Oct 17 13:39:59.420955 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:39:59.420955 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:39:59.420955 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:39:59.420955 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:39:59.420955 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:39:59.420955 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:39:59.420955 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: ebd56f1255ea4e9db712e8c0f520b6c1 Oct 17 13:39:59.420955 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-VolumesAdminNegativeTest-2051731892 Oct 17 13:39:59.420955 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member,admin Oct 17 13:39:59.420955 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member,admin Oct 17 13:39:59.423426 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ebd56f1255ea4e9db712e8c0f520b6c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ebd56f1255ea4e9db712e8c0f520b6c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ebd56f1255ea4e9db712e8c0f520b6c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ebd56f1255ea4e9db712e8c0f520b6c1", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:39:59.423426 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-VolumesAdminNegativeTest-2051731892 Oct 17 13:39:59.423426 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: ebd56f1255ea4e9db712e8c0f520b6c1 Oct 17 13:39:59.423426 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-2051731892 Oct 17 13:39:59.423426 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-VolumesAdminNegativeTest-2051731892-project-admin Oct 17 13:39:59.423426 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:39:59.423426 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:39:59.423426 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: d5c7b44c059d46bb952082d4f4e637a5 Oct 17 13:39:59.423426 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-VolumesAdminNegativeTest-2051731892-project-admin Oct 17 13:39:59.423426 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:39:59.423426 n-d-854247-14 devstack@n-api.service[127016]: {"volumeAttachment": {"volumeId": "7481a35f-1f59-4231-a949-fe96b0cb1d75"}} Oct 17 13:39:59.423426 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:39:59.423426 n-d-854247-14 devstack@n-api.service[127016]: exception: Volume cd4291e5-7475-4c89-a1ee-812230b8f80d could not be found. Oct 17 13:39:59.424568 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'server_id': '230b658a-6ae7-4812-ab1a-a5fee84100cd', 'id': 'cd4291e5-7475-4c89-a1ee-812230b8f80d', 'body': {'volumeAttachment': {'volumeId': '7481a35f-1f59-4231-a949-fe96b0cb1d75'}}} Oct 17 13:39:59.424568 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:39:59.424568 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:59.424568 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 13:39:59.424568 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 13:39:59.424568 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 13:39:59.424568 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 13:39:59.424568 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 13:39:59.424568 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 13:39:59.424568 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 13:39:59.424568 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 13:39:59.424568 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 13:39:59.424568 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 13:39:59.424568 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 13:39:59.424568 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 13:39:59.424568 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 13:39:59.424568 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 13:39:59.426014 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cd4291e5-7475-4c89-a1ee-812230b8f80d could not be found. (HTTP 404) (Request-ID: req-b1b5e622-36a6-4bf9-8423-884640048d24) Oct 17 13:39:59.426014 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:39:59.426014 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:39:59.426014 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:39:59.426014 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:59.426014 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 17 13:39:59.426014 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 17 13:39:59.426014 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 13:39:59.426014 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 13:39:59.426014 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 13:39:59.426014 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 13:39:59.426014 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 13:39:59.426014 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 13:39:59.426014 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 13:39:59.426014 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 13:39:59.426014 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 13:39:59.426014 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 13:39:59.426014 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 13:39:59.426014 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 13:39:59.428590 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 13:39:59.428590 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 13:39:59.428590 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 13:39:59.428590 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 13:39:59.428590 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 13:39:59.428590 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 13:39:59.428590 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 13:39:59.428590 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 13:39:59.428590 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cd4291e5-7475-4c89-a1ee-812230b8f80d could not be found. Oct 17 13:39:59.428590 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:39:59.428590 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:39:59.428590 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:39:59.428590 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:59.428590 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:39:59.428590 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:39:59.428590 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:39:59.428590 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:39:59.428590 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:39:59.428590 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:39:59.430399 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:39:59.430399 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:39:59.430399 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:39:59.430399 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:39:59.430399 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 17 13:39:59.430399 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 17 13:39:59.430399 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 17 13:39:59.430399 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:39:59.430399 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cd4291e5-7475-4c89-a1ee-812230b8f80d could not be found. Oct 17 13:39:59.430399 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:39:59.430399 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:39:59.430399 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:39:59.430399 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:59.430399 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:39:59.430399 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:39:59.430399 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:39:59.430399 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:39:59.430399 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cd4291e5-7475-4c89-a1ee-812230b8f80d could not be found. Oct 17 13:39:59.430399 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:39:59.432365 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f0d2a202-2442-4a1e-a8fa-5bd112d0d5d0 tempest-VolumesAdminNegativeTest-2051731892 tempest-VolumesAdminNegativeTest-2051731892-project-admin] Returning 404 to user: Volume cd4291e5-7475-4c89-a1ee-812230b8f80d could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:39:59.432365 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f0d2a202-2442-4a1e-a8fa-5bd112d0d5d0 tempest-VolumesAdminNegativeTest-2051731892 tempest-VolumesAdminNegativeTest-2051731892-project-admin] 10.222.0.79 "PUT /compute/v2.1/servers/230b658a-6ae7-4812-ab1a-a5fee84100cd/os-volume_attachments/cd4291e5-7475-4c89-a1ee-812230b8f80d" status: 404 len: 109 microversion: 2.1 time: 0.150119 Oct 17 13:39:59.434766 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 789/1627] 10.222.0.79 () {60 vars in 1433 bytes} [Mon Oct 17 13:39:59 2022] PUT /compute/v2.1/servers/230b658a-6ae7-4812-ab1a-a5fee84100cd/os-volume_attachments/cd4291e5-7475-4c89-a1ee-812230b8f80d => generated 109 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:39:59.450187 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-09fbf65a-54fc-47f2-9c11-3e28a6c318df tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:59.452365 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-09fbf65a-54fc-47f2-9c11-3e28a6c318df tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 709d926d-fba5-49ea-84ac-95d8bb018c68] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:59.468999 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-09fbf65a-54fc-47f2-9c11-3e28a6c318df tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:59.470716 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-09fbf65a-54fc-47f2-9c11-3e28a6c318df tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:59.473043 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-09fbf65a-54fc-47f2-9c11-3e28a6c318df tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:59.474148 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-09fbf65a-54fc-47f2-9c11-3e28a6c318df tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:59.476950 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-09fbf65a-54fc-47f2-9c11-3e28a6c318df tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:59.477589 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-09fbf65a-54fc-47f2-9c11-3e28a6c318df tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:00.769698 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-09fbf65a-54fc-47f2-9c11-3e28a6c318df tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:00.782851 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-09fbf65a-54fc-47f2-9c11-3e28a6c318df tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:00.786408 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-09fbf65a-54fc-47f2-9c11-3e28a6c318df tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:00.790344 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-09fbf65a-54fc-47f2-9c11-3e28a6c318df tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68" status: 200 len: 1410 microversion: 2.25 time: 1.353707 Oct 17 13:40:00.793584 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 790/1628] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:39:59 2022] GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68 => generated 1410 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:40:00.808817 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-93ae860f-d1b5-4420-86b6-8cf8159ae514 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:00.810156 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-93ae860f-d1b5-4420-86b6-8cf8159ae514 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:00.825261 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:40:00.828083 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-70951cc1-7e36-4538-adb9-5117437c4721 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:40:00.828600 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-70951cc1-7e36-4538-adb9-5117437c4721 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:40:00.829173 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-70951cc1-7e36-4538-adb9-5117437c4721 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:40:00.831562 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-70951cc1-7e36-4538-adb9-5117437c4721 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:40:00.831562 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-70951cc1-7e36-4538-adb9-5117437c4721 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:40:00.834089 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-93ae860f-d1b5-4420-86b6-8cf8159ae514 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:00.835409 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-93ae860f-d1b5-4420-86b6-8cf8159ae514 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:00.836793 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-93ae860f-d1b5-4420-86b6-8cf8159ae514 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:00.838969 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-93ae860f-d1b5-4420-86b6-8cf8159ae514 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:00.840532 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-93ae860f-d1b5-4420-86b6-8cf8159ae514 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:00.841248 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-93ae860f-d1b5-4420-86b6-8cf8159ae514 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:00.846875 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70951cc1-7e36-4538-adb9-5117437c4721 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:00.847520 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70951cc1-7e36-4538-adb9-5117437c4721 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:00.848368 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70951cc1-7e36-4538-adb9-5117437c4721 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:00.850728 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70951cc1-7e36-4538-adb9-5117437c4721 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:00.853700 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70951cc1-7e36-4538-adb9-5117437c4721 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:00.854517 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70951cc1-7e36-4538-adb9-5117437c4721 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:00.886402 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-70951cc1-7e36-4538-adb9-5117437c4721 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Getting quotas for project 66d121d0b216416592c7048c2a46f625. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:40:00.892755 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-70951cc1-7e36-4538-adb9-5117437c4721 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Getting quotas for user b849e8b87a4b49ffa7ad2dd6e95260aa and project 66d121d0b216416592c7048c2a46f625. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:40:00.906685 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-70951cc1-7e36-4538-adb9-5117437c4721 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:40:00.910456 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-70951cc1-7e36-4538-adb9-5117437c4721 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] [instance: 8938a16d-a198-46b1-92aa-880f0cc290ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:40:00.965216 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-70951cc1-7e36-4538-adb9-5117437c4721 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.014585 Oct 17 13:40:00.966191 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 839/1629] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:39:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2016 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:40:00.971134 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5f4abcab-f93d-41f3-bfc9-15bb563868bc tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:00.972213 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5f4abcab-f93d-41f3-bfc9-15bb563868bc tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: ab2b571e-376c-41d3-a778-44bedcaa5467] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:00.980600 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5f4abcab-f93d-41f3-bfc9-15bb563868bc tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:00.981887 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5f4abcab-f93d-41f3-bfc9-15bb563868bc tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:00.982554 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5f4abcab-f93d-41f3-bfc9-15bb563868bc tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:00.983892 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5f4abcab-f93d-41f3-bfc9-15bb563868bc tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:00.985194 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5f4abcab-f93d-41f3-bfc9-15bb563868bc tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:00.986000 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5f4abcab-f93d-41f3-bfc9-15bb563868bc tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:01.405106 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-93ae860f-d1b5-4420-86b6-8cf8159ae514 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:01.417933 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-93ae860f-d1b5-4420-86b6-8cf8159ae514 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:01.424069 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-93ae860f-d1b5-4420-86b6-8cf8159ae514 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:01.435896 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-93ae860f-d1b5-4420-86b6-8cf8159ae514 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1478 microversion: 2.91 time: 0.640692 Oct 17 13:40:01.436636 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 791/1630] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:40:00 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1478 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:40:01.451934 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5cc6277f-9fd5-43d8-845e-67f765837c2c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:01.452973 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5cc6277f-9fd5-43d8-845e-67f765837c2c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: fd365dc4-44c6-4a00-971e-2699762ab41f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:01.464889 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5cc6277f-9fd5-43d8-845e-67f765837c2c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:01.470793 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5cc6277f-9fd5-43d8-845e-67f765837c2c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:01.471606 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5cc6277f-9fd5-43d8-845e-67f765837c2c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:01.472615 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5cc6277f-9fd5-43d8-845e-67f765837c2c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:01.473575 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5cc6277f-9fd5-43d8-845e-67f765837c2c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:01.474115 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5cc6277f-9fd5-43d8-845e-67f765837c2c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:01.586803 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5f4abcab-f93d-41f3-bfc9-15bb563868bc tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:01.601025 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5f4abcab-f93d-41f3-bfc9-15bb563868bc tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467" status: 200 len: 1479 microversion: 2.1 time: 0.633472 Oct 17 13:40:01.602436 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 840/1631] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:00 2022] GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467 => generated 1479 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:01.610197 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c8534c92-9453-4735-8a4b-6daa75a9085f tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:01.617891 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c8534c92-9453-4735-8a4b-6daa75a9085f tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: b05d2fa3-d231-4842-a47b-26aa317ccaa3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:01.633512 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c8534c92-9453-4735-8a4b-6daa75a9085f tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:01.634092 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c8534c92-9453-4735-8a4b-6daa75a9085f tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:01.634559 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c8534c92-9453-4735-8a4b-6daa75a9085f tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:01.635388 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c8534c92-9453-4735-8a4b-6daa75a9085f tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:01.635762 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c8534c92-9453-4735-8a4b-6daa75a9085f tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:01.636190 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c8534c92-9453-4735-8a4b-6daa75a9085f tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:01.894295 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c8534c92-9453-4735-8a4b-6daa75a9085f tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:01.905321 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c8534c92-9453-4735-8a4b-6daa75a9085f tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/b05d2fa3-d231-4842-a47b-26aa317ccaa3" status: 200 len: 1306 microversion: 2.1 time: 0.300133 Oct 17 13:40:01.905908 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 841/1632] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:01 2022] GET /compute/v2.1/servers/b05d2fa3-d231-4842-a47b-26aa317ccaa3 => generated 1306 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:01.910620 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b50e08fc-c19f-4b7c-b113-722616ce9e5c tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:01.917738 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b50e08fc-c19f-4b7c-b113-722616ce9e5c tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] [instance: 8938a16d-a198-46b1-92aa-880f0cc290ba] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:01.930464 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b50e08fc-c19f-4b7c-b113-722616ce9e5c tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:01.934817 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b50e08fc-c19f-4b7c-b113-722616ce9e5c tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:01.935558 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b50e08fc-c19f-4b7c-b113-722616ce9e5c tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:01.936463 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b50e08fc-c19f-4b7c-b113-722616ce9e5c tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:01.937084 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b50e08fc-c19f-4b7c-b113-722616ce9e5c tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:01.938020 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b50e08fc-c19f-4b7c-b113-722616ce9e5c tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:02.177623 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5cc6277f-9fd5-43d8-845e-67f765837c2c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:02.186984 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5cc6277f-9fd5-43d8-845e-67f765837c2c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f" status: 200 len: 1390 microversion: 2.1 time: 0.747910 Oct 17 13:40:02.211716 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 792/1633] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:01 2022] GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f => generated 1390 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:02.216927 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-7d2bbb1b-e563-4375-b09f-f548cb06c4df req-1a658eee-cd9e-4c38-a105-288ecfdd82ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab2b571e-376c-41d3-a778-44bedcaa5467", "name": "network-vif-plugged", "status": "completed", "tag": "7ff3914f-4ed0-4fef-bc81-8a07b3c2c97b"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:02.243261 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b50e08fc-c19f-4b7c-b113-722616ce9e5c tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:02.251737 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b50e08fc-c19f-4b7c-b113-722616ce9e5c tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers/8938a16d-a198-46b1-92aa-880f0cc290ba" status: 200 len: 1225 microversion: 2.1 time: 0.344540 Oct 17 13:40:02.252360 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 842/1634] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:01 2022] GET /compute/v2.1/servers/8938a16d-a198-46b1-92aa-880f0cc290ba => generated 1225 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:02.296131 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c750f625-1561-4ff5-b71b-28b0297ce3e8 tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-854247-14"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:02.298653 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c750f625-1561-4ff5-b71b-28b0297ce3e8 tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:02.301544 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-7d2bbb1b-e563-4375-b09f-f548cb06c4df req-1a658eee-cd9e-4c38-a105-288ecfdd82ae service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:02.307909 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-7d2bbb1b-e563-4375-b09f-f548cb06c4df req-1a658eee-cd9e-4c38-a105-288ecfdd82ae service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:02.308423 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-7d2bbb1b-e563-4375-b09f-f548cb06c4df req-1a658eee-cd9e-4c38-a105-288ecfdd82ae service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:02.344657 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c750f625-1561-4ff5-b71b-28b0297ce3e8 tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:02.345074 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c750f625-1561-4ff5-b71b-28b0297ce3e8 tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:02.345518 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c750f625-1561-4ff5-b71b-28b0297ce3e8 tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:02.346235 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c750f625-1561-4ff5-b71b-28b0297ce3e8 tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:02.346686 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c750f625-1561-4ff5-b71b-28b0297ce3e8 tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:02.347120 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c750f625-1561-4ff5-b71b-28b0297ce3e8 tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:02.366573 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-7d2bbb1b-e563-4375-b09f-f548cb06c4df req-1a658eee-cd9e-4c38-a105-288ecfdd82ae service nova] Creating event network-vif-plugged:7ff3914f-4ed0-4fef-bc81-8a07b3c2c97b for instance ab2b571e-376c-41d3-a778-44bedcaa5467 on n-h2-854247-14 Oct 17 13:40:02.394284 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-7d2bbb1b-e563-4375-b09f-f548cb06c4df req-1a658eee-cd9e-4c38-a105-288ecfdd82ae service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.181044 Oct 17 13:40:02.394930 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 793/1635] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:40:02.420569 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fe62396c-e596-40b9-8f51-d90b2b678f4a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:02.421291 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-fe62396c-e596-40b9-8f51-d90b2b678f4a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 709d926d-fba5-49ea-84ac-95d8bb018c68] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:02.458229 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe62396c-e596-40b9-8f51-d90b2b678f4a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:02.461831 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe62396c-e596-40b9-8f51-d90b2b678f4a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:02.462349 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe62396c-e596-40b9-8f51-d90b2b678f4a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:02.478429 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe62396c-e596-40b9-8f51-d90b2b678f4a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:02.479124 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe62396c-e596-40b9-8f51-d90b2b678f4a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:02.479598 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe62396c-e596-40b9-8f51-d90b2b678f4a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:02.562719 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c750f625-1561-4ff5-b71b-28b0297ce3e8 tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-854247-14". {{(pid=127017) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 17 13:40:02.751541 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c750f625-1561-4ff5-b71b-28b0297ce3e8 tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57/action" status: 202 len: 0 microversion: 2.91 time: 0.470702 Oct 17 13:40:02.755503 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 843/1636] 10.222.0.79 () {62 vars in 1319 bytes} [Mon Oct 17 13:40:02 2022] POST /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57/action => generated 0 bytes in 502 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:40:02.769328 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-122546d8-ceed-4ea2-bcce-7c6f039a68ec tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:02.770900 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-122546d8-ceed-4ea2-bcce-7c6f039a68ec tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: ab2b571e-376c-41d3-a778-44bedcaa5467] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:02.786194 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-122546d8-ceed-4ea2-bcce-7c6f039a68ec tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:02.786984 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-122546d8-ceed-4ea2-bcce-7c6f039a68ec tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:02.791424 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-122546d8-ceed-4ea2-bcce-7c6f039a68ec tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:02.792650 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-122546d8-ceed-4ea2-bcce-7c6f039a68ec tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:02.794182 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-122546d8-ceed-4ea2-bcce-7c6f039a68ec tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:02.795327 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-122546d8-ceed-4ea2-bcce-7c6f039a68ec tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:03.880572 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fe62396c-e596-40b9-8f51-d90b2b678f4a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:03.895601 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fe62396c-e596-40b9-8f51-d90b2b678f4a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:03.898221 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fe62396c-e596-40b9-8f51-d90b2b678f4a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:03.901123 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fe62396c-e596-40b9-8f51-d90b2b678f4a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68" status: 200 len: 1410 microversion: 2.25 time: 1.484552 Oct 17 13:40:03.903618 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 794/1637] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:40:02 2022] GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68 => generated 1410 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:40:03.909317 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-27efa5fa-d65b-4d67-9843-d0850c463277 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:03.910257 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-27efa5fa-d65b-4d67-9843-d0850c463277 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:03.923462 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-27efa5fa-d65b-4d67-9843-d0850c463277 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:03.924591 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-27efa5fa-d65b-4d67-9843-d0850c463277 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:03.925429 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-27efa5fa-d65b-4d67-9843-d0850c463277 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:03.926651 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-27efa5fa-d65b-4d67-9843-d0850c463277 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:03.928265 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-27efa5fa-d65b-4d67-9843-d0850c463277 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:03.929115 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-27efa5fa-d65b-4d67-9843-d0850c463277 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:04.106259 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-122546d8-ceed-4ea2-bcce-7c6f039a68ec tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:04.118609 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-122546d8-ceed-4ea2-bcce-7c6f039a68ec tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467" status: 200 len: 1479 microversion: 2.1 time: 1.361455 Oct 17 13:40:04.120247 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 844/1638] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:02 2022] GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467 => generated 1479 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:04.125178 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1e492e5d-7621-47c4-a69b-63b26f9cca9b tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:04.126777 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1e492e5d-7621-47c4-a69b-63b26f9cca9b tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: b05d2fa3-d231-4842-a47b-26aa317ccaa3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:04.139438 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1e492e5d-7621-47c4-a69b-63b26f9cca9b tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:04.140225 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1e492e5d-7621-47c4-a69b-63b26f9cca9b tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:04.140821 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1e492e5d-7621-47c4-a69b-63b26f9cca9b tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:04.141705 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1e492e5d-7621-47c4-a69b-63b26f9cca9b tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:04.142318 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1e492e5d-7621-47c4-a69b-63b26f9cca9b tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:04.142900 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1e492e5d-7621-47c4-a69b-63b26f9cca9b tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:04.157740 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-27efa5fa-d65b-4d67-9843-d0850c463277 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:04.171923 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-27efa5fa-d65b-4d67-9843-d0850c463277 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:04.173695 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-27efa5fa-d65b-4d67-9843-d0850c463277 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:04.189806 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-27efa5fa-d65b-4d67-9843-d0850c463277 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1486 microversion: 2.91 time: 0.284690 Oct 17 13:40:04.190407 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 795/1639] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:40:03 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1486 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:40:04.195503 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-55989edf-5a31-4af2-acf9-f008e6c9fb75 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:04.196323 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-55989edf-5a31-4af2-acf9-f008e6c9fb75 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: fd365dc4-44c6-4a00-971e-2699762ab41f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:04.222077 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-55989edf-5a31-4af2-acf9-f008e6c9fb75 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:04.223013 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-55989edf-5a31-4af2-acf9-f008e6c9fb75 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:04.223477 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-55989edf-5a31-4af2-acf9-f008e6c9fb75 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:04.224304 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-55989edf-5a31-4af2-acf9-f008e6c9fb75 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:04.225001 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-55989edf-5a31-4af2-acf9-f008e6c9fb75 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:04.225502 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-55989edf-5a31-4af2-acf9-f008e6c9fb75 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:05.059976 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1e492e5d-7621-47c4-a69b-63b26f9cca9b tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:05.079237 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1e492e5d-7621-47c4-a69b-63b26f9cca9b tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/b05d2fa3-d231-4842-a47b-26aa317ccaa3" status: 200 len: 1306 microversion: 2.1 time: 0.957446 Oct 17 13:40:05.080455 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 845/1640] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:04 2022] GET /compute/v2.1/servers/b05d2fa3-d231-4842-a47b-26aa317ccaa3 => generated 1306 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:05.100462 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-09ae1ef3-aaa0-46e1-a046-82d234dcd553 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:05.103704 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-09ae1ef3-aaa0-46e1-a046-82d234dcd553 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] [instance: 8938a16d-a198-46b1-92aa-880f0cc290ba] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:05.124780 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-09ae1ef3-aaa0-46e1-a046-82d234dcd553 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:05.127040 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-09ae1ef3-aaa0-46e1-a046-82d234dcd553 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:05.127972 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-09ae1ef3-aaa0-46e1-a046-82d234dcd553 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:05.128884 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-09ae1ef3-aaa0-46e1-a046-82d234dcd553 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:05.129625 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-09ae1ef3-aaa0-46e1-a046-82d234dcd553 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:05.130236 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-09ae1ef3-aaa0-46e1-a046-82d234dcd553 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:05.207910 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=4 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:40:05.331512 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=40 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:40:05.723958 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-55989edf-5a31-4af2-acf9-f008e6c9fb75 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:05.737556 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-55989edf-5a31-4af2-acf9-f008e6c9fb75 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f" status: 200 len: 1390 microversion: 2.1 time: 1.546043 Oct 17 13:40:05.738194 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-09ae1ef3-aaa0-46e1-a046-82d234dcd553 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:05.748406 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 796/1641] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:04 2022] GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f => generated 1390 bytes in 1557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:05.749687 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-09ae1ef3-aaa0-46e1-a046-82d234dcd553 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers/8938a16d-a198-46b1-92aa-880f0cc290ba" status: 200 len: 1279 microversion: 2.1 time: 0.667731 Oct 17 13:40:05.750883 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 846/1642] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:05 2022] GET /compute/v2.1/servers/8938a16d-a198-46b1-92aa-880f0cc290ba => generated 1279 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:05.762578 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1e4230b0-bad5-459d-b7dd-00be073ab49c tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:05.763132 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-1e4230b0-bad5-459d-b7dd-00be073ab49c tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] [instance: 230b658a-6ae7-4812-ab1a-a5fee84100cd] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:05.781345 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1e4230b0-bad5-459d-b7dd-00be073ab49c tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:05.781852 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1e4230b0-bad5-459d-b7dd-00be073ab49c tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:05.782291 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1e4230b0-bad5-459d-b7dd-00be073ab49c tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:05.783015 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1e4230b0-bad5-459d-b7dd-00be073ab49c tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:05.792010 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1e4230b0-bad5-459d-b7dd-00be073ab49c tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:05.792481 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1e4230b0-bad5-459d-b7dd-00be073ab49c tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:05.838916 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-1e4230b0-bad5-459d-b7dd-00be073ab49c tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] [instance: 230b658a-6ae7-4812-ab1a-a5fee84100cd] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:40:05.992629 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1e4230b0-bad5-459d-b7dd-00be073ab49c tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] 10.222.0.79 "DELETE /compute/v2.1/servers/230b658a-6ae7-4812-ab1a-a5fee84100cd" status: 204 len: 0 microversion: 2.1 time: 0.241915 Oct 17 13:40:05.993534 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 797/1643] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:40:05 2022] DELETE /compute/v2.1/servers/230b658a-6ae7-4812-ab1a-a5fee84100cd => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:40:06.000273 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c6185fe3-2db6-4430-ae96-0f87b41ca611 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-994100468", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "1fa8f2b8-208c-4e70-b9bb-194c580d73b4"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:06.002104 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-699241a7-100b-44fe-b19a-97aeac25d527 req-6509d117-74a7-4154-a5c1-f8e3060aa92d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd365dc4-44c6-4a00-971e-2699762ab41f", "name": "network-vif-unplugged", "status": "completed", "tag": "6d5ddeb5-1324-4b12-9490-8c34031e6c41"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:06.021357 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-699241a7-100b-44fe-b19a-97aeac25d527 req-6509d117-74a7-4154-a5c1-f8e3060aa92d service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:06.022222 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-699241a7-100b-44fe-b19a-97aeac25d527 req-6509d117-74a7-4154-a5c1-f8e3060aa92d service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:06.026941 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-699241a7-100b-44fe-b19a-97aeac25d527 req-6509d117-74a7-4154-a5c1-f8e3060aa92d service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:06.054741 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-699241a7-100b-44fe-b19a-97aeac25d527 req-6509d117-74a7-4154-a5c1-f8e3060aa92d service nova] Creating event network-vif-unplugged:6d5ddeb5-1324-4b12-9490-8c34031e6c41 for instance fd365dc4-44c6-4a00-971e-2699762ab41f on n-h1-854247-14 Oct 17 13:40:06.064275 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-699241a7-100b-44fe-b19a-97aeac25d527 req-6509d117-74a7-4154-a5c1-f8e3060aa92d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068411 Oct 17 13:40:06.069160 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 798/1644] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:40:06.080330 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-6ad465c4-e238-4f2d-8e33-7011e861e0bf req-62baf6a3-6db1-463d-82a3-2df9caf1b0fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "709d926d-fba5-49ea-84ac-95d8bb018c68", "name": "network-vif-plugged", "status": "completed", "tag": "8407f400-367b-4c97-9c87-63bd179d8941"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:06.098031 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-c6185fe3-2db6-4430-ae96-0f87b41ca611 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] validate_networks() for [('1fa8f2b8-208c-4e70-b9bb-194c580d73b4', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:40:06.103988 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-6ad465c4-e238-4f2d-8e33-7011e861e0bf req-62baf6a3-6db1-463d-82a3-2df9caf1b0fb service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:06.104481 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-6ad465c4-e238-4f2d-8e33-7011e861e0bf req-62baf6a3-6db1-463d-82a3-2df9caf1b0fb service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:06.105188 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-6ad465c4-e238-4f2d-8e33-7011e861e0bf req-62baf6a3-6db1-463d-82a3-2df9caf1b0fb service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:06.137771 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-6ad465c4-e238-4f2d-8e33-7011e861e0bf req-62baf6a3-6db1-463d-82a3-2df9caf1b0fb service nova] Creating event network-vif-plugged:8407f400-367b-4c97-9c87-63bd179d8941 for instance 709d926d-fba5-49ea-84ac-95d8bb018c68 on n-h1-854247-14 Oct 17 13:40:06.145506 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-6ad465c4-e238-4f2d-8e33-7011e861e0bf req-62baf6a3-6db1-463d-82a3-2df9caf1b0fb service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074202 Oct 17 13:40:06.146727 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 799/1645] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:40:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:40:06.166210 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-dc4fbddd-a97d-43c2-96da-ddbf78c9fcf5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:06.167953 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-dc4fbddd-a97d-43c2-96da-ddbf78c9fcf5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 709d926d-fba5-49ea-84ac-95d8bb018c68] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:06.183891 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc4fbddd-a97d-43c2-96da-ddbf78c9fcf5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:06.196347 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc4fbddd-a97d-43c2-96da-ddbf78c9fcf5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:06.200088 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc4fbddd-a97d-43c2-96da-ddbf78c9fcf5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:06.204826 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc4fbddd-a97d-43c2-96da-ddbf78c9fcf5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:06.209920 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc4fbddd-a97d-43c2-96da-ddbf78c9fcf5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:06.210598 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc4fbddd-a97d-43c2-96da-ddbf78c9fcf5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:06.831560 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-dc4fbddd-a97d-43c2-96da-ddbf78c9fcf5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:06.864953 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-dc4fbddd-a97d-43c2-96da-ddbf78c9fcf5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:06.868169 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-dc4fbddd-a97d-43c2-96da-ddbf78c9fcf5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:06.871906 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-dc4fbddd-a97d-43c2-96da-ddbf78c9fcf5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68" status: 200 len: 1410 microversion: 2.25 time: 0.723912 Oct 17 13:40:06.873715 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 800/1646] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:40:06 2022] GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68 => generated 1410 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:40:06.878737 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7d3f69c2-5615-4db0-b93e-95c71b682fe0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:06.879887 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7d3f69c2-5615-4db0-b93e-95c71b682fe0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: ab2b571e-376c-41d3-a778-44bedcaa5467] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:06.892617 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7d3f69c2-5615-4db0-b93e-95c71b682fe0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:06.893670 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7d3f69c2-5615-4db0-b93e-95c71b682fe0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:06.894320 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7d3f69c2-5615-4db0-b93e-95c71b682fe0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:06.896304 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7d3f69c2-5615-4db0-b93e-95c71b682fe0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:06.897232 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7d3f69c2-5615-4db0-b93e-95c71b682fe0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:06.897922 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7d3f69c2-5615-4db0-b93e-95c71b682fe0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:07.544069 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7d3f69c2-5615-4db0-b93e-95c71b682fe0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:07.571297 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7d3f69c2-5615-4db0-b93e-95c71b682fe0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467" status: 200 len: 1464 microversion: 2.1 time: 0.679163 Oct 17 13:40:07.572300 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 801/1647] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:06 2022] GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467 => generated 1464 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:07.587602 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0bc6f7c1-26fe-4533-b3b1-31f169d906d0 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:07.587602 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0bc6f7c1-26fe-4533-b3b1-31f169d906d0 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:07.615242 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0bc6f7c1-26fe-4533-b3b1-31f169d906d0 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:07.615883 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0bc6f7c1-26fe-4533-b3b1-31f169d906d0 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:07.624468 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0bc6f7c1-26fe-4533-b3b1-31f169d906d0 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:07.625271 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0bc6f7c1-26fe-4533-b3b1-31f169d906d0 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:07.625761 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0bc6f7c1-26fe-4533-b3b1-31f169d906d0 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:07.626191 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0bc6f7c1-26fe-4533-b3b1-31f169d906d0 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:07.810188 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0bc6f7c1-26fe-4533-b3b1-31f169d906d0 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:07.826547 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0bc6f7c1-26fe-4533-b3b1-31f169d906d0 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:07.828391 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0bc6f7c1-26fe-4533-b3b1-31f169d906d0 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:07.843585 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0bc6f7c1-26fe-4533-b3b1-31f169d906d0 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1544 microversion: 2.91 time: 0.269987 Oct 17 13:40:07.844446 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 802/1648] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:40:07 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1544 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:40:07.852367 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d1fd51cb-8e97-47eb-b363-3032165d1075 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:07.863494 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d1fd51cb-8e97-47eb-b363-3032165d1075 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] [instance: 230b658a-6ae7-4812-ab1a-a5fee84100cd] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:07.885265 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d1fd51cb-8e97-47eb-b363-3032165d1075 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:07.886812 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d1fd51cb-8e97-47eb-b363-3032165d1075 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:07.890363 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d1fd51cb-8e97-47eb-b363-3032165d1075 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:07.891623 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d1fd51cb-8e97-47eb-b363-3032165d1075 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:07.892447 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d1fd51cb-8e97-47eb-b363-3032165d1075 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:07.892983 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d1fd51cb-8e97-47eb-b363-3032165d1075 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:07.922240 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:40:08.566374 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d1fd51cb-8e97-47eb-b363-3032165d1075 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e5309bf84f4aafa9a17604f8452366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6642f912ba0467bac461bc7aedbf940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:08.577083 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d1fd51cb-8e97-47eb-b363-3032165d1075 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] 10.222.0.79 "GET /compute/v2.1/servers/230b658a-6ae7-4812-ab1a-a5fee84100cd" status: 200 len: 1513 microversion: 2.1 time: 0.728777 Oct 17 13:40:08.577679 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 803/1649] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:07 2022] GET /compute/v2.1/servers/230b658a-6ae7-4812-ab1a-a5fee84100cd => generated 1513 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:08.582204 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ade460aa-2f06-486c-83d3-0ab2522456a2 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:08.582806 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ade460aa-2f06-486c-83d3-0ab2522456a2 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: b05d2fa3-d231-4842-a47b-26aa317ccaa3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:08.595401 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ade460aa-2f06-486c-83d3-0ab2522456a2 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:08.597356 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ade460aa-2f06-486c-83d3-0ab2522456a2 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:08.598101 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ade460aa-2f06-486c-83d3-0ab2522456a2 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:08.599441 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ade460aa-2f06-486c-83d3-0ab2522456a2 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:08.600157 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ade460aa-2f06-486c-83d3-0ab2522456a2 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:08.600799 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ade460aa-2f06-486c-83d3-0ab2522456a2 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:08.601594 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-c6185fe3-2db6-4430-ae96-0f87b41ca611 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:40:08.602082 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-c6185fe3-2db6-4430-ae96-0f87b41ca611 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:40:08.603617 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-c6185fe3-2db6-4430-ae96-0f87b41ca611 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:40:08.604391 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-c6185fe3-2db6-4430-ae96-0f87b41ca611 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:40:08.605044 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-c6185fe3-2db6-4430-ae96-0f87b41ca611 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:40:08.615934 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c6185fe3-2db6-4430-ae96-0f87b41ca611 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:08.616622 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c6185fe3-2db6-4430-ae96-0f87b41ca611 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:08.617165 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c6185fe3-2db6-4430-ae96-0f87b41ca611 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:08.618023 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c6185fe3-2db6-4430-ae96-0f87b41ca611 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:08.618912 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c6185fe3-2db6-4430-ae96-0f87b41ca611 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:08.619436 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c6185fe3-2db6-4430-ae96-0f87b41ca611 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:08.641951 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-c6185fe3-2db6-4430-ae96-0f87b41ca611 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Getting quotas for project a8fe03af82c34607bfe43a58b997704f. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:40:08.652640 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-c6185fe3-2db6-4430-ae96-0f87b41ca611 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Getting quotas for user 17a7b6856447415487c272498ca335db and project a8fe03af82c34607bfe43a58b997704f. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:40:08.683201 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c6185fe3-2db6-4430-ae96-0f87b41ca611 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:40:08.692147 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c6185fe3-2db6-4430-ae96-0f87b41ca611 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9c6b4ed2-b111-41b0-9679-b66d386834b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:40:08.757372 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:UPDATE=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:40:08.790095 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c6185fe3-2db6-4430-ae96-0f87b41ca611 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.037780 Oct 17 13:40:08.799212 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 847/1650] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:40:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 3047 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:40:08.805562 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-51fab506-54a3-4dab-9168-b916fbfc6f00 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:08.807092 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-51fab506-54a3-4dab-9168-b916fbfc6f00 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: fd365dc4-44c6-4a00-971e-2699762ab41f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:08.817272 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-51fab506-54a3-4dab-9168-b916fbfc6f00 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:08.818335 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-51fab506-54a3-4dab-9168-b916fbfc6f00 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:08.819529 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-51fab506-54a3-4dab-9168-b916fbfc6f00 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:08.820596 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-51fab506-54a3-4dab-9168-b916fbfc6f00 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:08.821466 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-51fab506-54a3-4dab-9168-b916fbfc6f00 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:08.822243 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-51fab506-54a3-4dab-9168-b916fbfc6f00 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:09.190381 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ade460aa-2f06-486c-83d3-0ab2522456a2 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:09.203923 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ade460aa-2f06-486c-83d3-0ab2522456a2 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/b05d2fa3-d231-4842-a47b-26aa317ccaa3" status: 200 len: 1306 microversion: 2.1 time: 0.624958 Oct 17 13:40:09.205019 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 804/1651] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:08 2022] GET /compute/v2.1/servers/b05d2fa3-d231-4842-a47b-26aa317ccaa3 => generated 1306 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:09.225327 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1e39f4dd-1760-49f6-8be3-e7e432b4ad02 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:09.226150 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-1e39f4dd-1760-49f6-8be3-e7e432b4ad02 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] [instance: 8938a16d-a198-46b1-92aa-880f0cc290ba] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:09.237407 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1e39f4dd-1760-49f6-8be3-e7e432b4ad02 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:09.238272 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1e39f4dd-1760-49f6-8be3-e7e432b4ad02 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:09.239112 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1e39f4dd-1760-49f6-8be3-e7e432b4ad02 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:09.242254 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1e39f4dd-1760-49f6-8be3-e7e432b4ad02 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:09.242926 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1e39f4dd-1760-49f6-8be3-e7e432b4ad02 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:09.243588 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1e39f4dd-1760-49f6-8be3-e7e432b4ad02 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:09.317532 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-51fab506-54a3-4dab-9168-b916fbfc6f00 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:09.330360 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-51fab506-54a3-4dab-9168-b916fbfc6f00 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f" status: 200 len: 1390 microversion: 2.1 time: 0.528873 Oct 17 13:40:09.330685 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 848/1652] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:08 2022] GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f => generated 1390 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:09.335378 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e2aa895c-5c32-43ef-bae3-dc3b3c9073b9 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:09.351514 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e2aa895c-5c32-43ef-bae3-dc3b3c9073b9 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] [instance: ab2b571e-376c-41d3-a778-44bedcaa5467] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:09.371857 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e2aa895c-5c32-43ef-bae3-dc3b3c9073b9 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:09.372988 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e2aa895c-5c32-43ef-bae3-dc3b3c9073b9 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:09.374921 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e2aa895c-5c32-43ef-bae3-dc3b3c9073b9 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:09.375795 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e2aa895c-5c32-43ef-bae3-dc3b3c9073b9 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:09.377116 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e2aa895c-5c32-43ef-bae3-dc3b3c9073b9 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:09.378801 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e2aa895c-5c32-43ef-bae3-dc3b3c9073b9 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:09.500734 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-1e39f4dd-1760-49f6-8be3-e7e432b4ad02 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:09.513877 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1e39f4dd-1760-49f6-8be3-e7e432b4ad02 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers/8938a16d-a198-46b1-92aa-880f0cc290ba" status: 200 len: 1279 microversion: 2.1 time: 0.307723 Oct 17 13:40:09.514820 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 805/1653] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:09 2022] GET /compute/v2.1/servers/8938a16d-a198-46b1-92aa-880f0cc290ba => generated 1279 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:09.531824 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:40:09.540759 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0c4ccd4e-50d1-4dbe-afe8-83acb9f10dc3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:09.541526 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0c4ccd4e-50d1-4dbe-afe8-83acb9f10dc3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 709d926d-fba5-49ea-84ac-95d8bb018c68] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:09.565379 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0c4ccd4e-50d1-4dbe-afe8-83acb9f10dc3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:09.576181 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0c4ccd4e-50d1-4dbe-afe8-83acb9f10dc3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:09.576897 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0c4ccd4e-50d1-4dbe-afe8-83acb9f10dc3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:09.577422 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0c4ccd4e-50d1-4dbe-afe8-83acb9f10dc3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:09.577898 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0c4ccd4e-50d1-4dbe-afe8-83acb9f10dc3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:09.578435 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0c4ccd4e-50d1-4dbe-afe8-83acb9f10dc3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:09.628588 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e2aa895c-5c32-43ef-bae3-dc3b3c9073b9 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467/action" status: 202 len: 0 microversion: 2.1 time: 0.296492 Oct 17 13:40:09.633702 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 849/1654] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:40:09 2022] POST /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:40:09.651630 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-0a3fe470-a005-411c-a14c-c4a62666e206 req-7fec9030-1364-4337-9b67-23726431d78b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d4188da-b0f7-4d97-952b-acebaa48f185", "tag": "5aa937a2-940e-4a32-973c-4f39608f3902"}, {"name": "network-changed", "server_uuid": "fd365dc4-44c6-4a00-971e-2699762ab41f", "tag": "6d5ddeb5-1324-4b12-9490-8c34031e6c41"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:09.692640 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-0a3fe470-a005-411c-a14c-c4a62666e206 req-7fec9030-1364-4337-9b67-23726431d78b service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:09.700581 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-0a3fe470-a005-411c-a14c-c4a62666e206 req-7fec9030-1364-4337-9b67-23726431d78b service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:09.701267 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-0a3fe470-a005-411c-a14c-c4a62666e206 req-7fec9030-1364-4337-9b67-23726431d78b service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:09.742425 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-0a3fe470-a005-411c-a14c-c4a62666e206 req-7fec9030-1364-4337-9b67-23726431d78b service nova] Creating event network-changed:5aa937a2-940e-4a32-973c-4f39608f3902 for instance 3d4188da-b0f7-4d97-952b-acebaa48f185 on n-h1-854247-14 Oct 17 13:40:09.747941 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-0a3fe470-a005-411c-a14c-c4a62666e206 req-7fec9030-1364-4337-9b67-23726431d78b service nova] Creating event network-changed:6d5ddeb5-1324-4b12-9490-8c34031e6c41 for instance fd365dc4-44c6-4a00-971e-2699762ab41f on n-h1-854247-14 Oct 17 13:40:09.764871 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-0a3fe470-a005-411c-a14c-c4a62666e206 req-7fec9030-1364-4337-9b67-23726431d78b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.129700 Oct 17 13:40:09.767580 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 850/1655] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:40:09 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:40:09.779083 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-43b2e41a-6945-4ccb-918b-4fa32984c60d req-45cdb19a-7be6-46bd-9a95-8f205b60d212 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b05d2fa3-d231-4842-a47b-26aa317ccaa3", "name": "network-vif-plugged", "status": "completed", "tag": "e6d816ac-9228-42e4-83a0-1b8d95fc766f"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:09.801981 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-43b2e41a-6945-4ccb-918b-4fa32984c60d req-45cdb19a-7be6-46bd-9a95-8f205b60d212 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:09.802455 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-43b2e41a-6945-4ccb-918b-4fa32984c60d req-45cdb19a-7be6-46bd-9a95-8f205b60d212 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:09.808579 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-43b2e41a-6945-4ccb-918b-4fa32984c60d req-45cdb19a-7be6-46bd-9a95-8f205b60d212 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:09.835923 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-43b2e41a-6945-4ccb-918b-4fa32984c60d req-45cdb19a-7be6-46bd-9a95-8f205b60d212 service nova] Creating event network-vif-plugged:e6d816ac-9228-42e4-83a0-1b8d95fc766f for instance b05d2fa3-d231-4842-a47b-26aa317ccaa3 on n-h1-854247-14 Oct 17 13:40:09.847958 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-43b2e41a-6945-4ccb-918b-4fa32984c60d req-45cdb19a-7be6-46bd-9a95-8f205b60d212 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076109 Oct 17 13:40:09.856781 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 851/1656] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:40:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:40:09.878195 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-844b9a96-9624-4a84-be69-0f33d3ada422 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:09.879371 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-844b9a96-9624-4a84-be69-0f33d3ada422 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9c6b4ed2-b111-41b0-9679-b66d386834b9] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:09.899022 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-844b9a96-9624-4a84-be69-0f33d3ada422 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:09.903852 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-844b9a96-9624-4a84-be69-0f33d3ada422 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:09.906800 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-844b9a96-9624-4a84-be69-0f33d3ada422 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:09.910469 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-844b9a96-9624-4a84-be69-0f33d3ada422 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:09.913145 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-844b9a96-9624-4a84-be69-0f33d3ada422 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:09.914115 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-844b9a96-9624-4a84-be69-0f33d3ada422 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:10.737257 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-844b9a96-9624-4a84-be69-0f33d3ada422 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:10.748802 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-844b9a96-9624-4a84-be69-0f33d3ada422 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9" status: 200 len: 1221 microversion: 2.1 time: 0.890263 Oct 17 13:40:10.766851 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 852/1657] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:09 2022] GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9 => generated 1221 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:10.772844 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-adcdb5fa-e1e9-49db-9aee-df284f9140f7 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:10.773823 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-adcdb5fa-e1e9-49db-9aee-df284f9140f7 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:10.797297 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-adcdb5fa-e1e9-49db-9aee-df284f9140f7 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:10.797795 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-adcdb5fa-e1e9-49db-9aee-df284f9140f7 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:10.798237 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-adcdb5fa-e1e9-49db-9aee-df284f9140f7 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:10.798965 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-adcdb5fa-e1e9-49db-9aee-df284f9140f7 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:10.804891 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-adcdb5fa-e1e9-49db-9aee-df284f9140f7 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:10.809996 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-adcdb5fa-e1e9-49db-9aee-df284f9140f7 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:10.825394 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0c4ccd4e-50d1-4dbe-afe8-83acb9f10dc3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:10.837319 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0c4ccd4e-50d1-4dbe-afe8-83acb9f10dc3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:10.843752 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0c4ccd4e-50d1-4dbe-afe8-83acb9f10dc3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:10.852340 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0c4ccd4e-50d1-4dbe-afe8-83acb9f10dc3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68" status: 200 len: 1410 microversion: 2.25 time: 1.333073 Oct 17 13:40:10.853472 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 806/1658] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:40:09 2022] GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68 => generated 1410 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:40:10.871814 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e12585e0-1fdf-4ca3-8440-d37c9e1bb807 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:10.872872 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e12585e0-1fdf-4ca3-8440-d37c9e1bb807 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] [instance: 230b658a-6ae7-4812-ab1a-a5fee84100cd] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:10.887803 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e12585e0-1fdf-4ca3-8440-d37c9e1bb807 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:10.889143 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e12585e0-1fdf-4ca3-8440-d37c9e1bb807 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:10.889826 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e12585e0-1fdf-4ca3-8440-d37c9e1bb807 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:10.890971 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e12585e0-1fdf-4ca3-8440-d37c9e1bb807 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:10.891764 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e12585e0-1fdf-4ca3-8440-d37c9e1bb807 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:10.896335 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e12585e0-1fdf-4ca3-8440-d37c9e1bb807 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:10.997856 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e12585e0-1fdf-4ca3-8440-d37c9e1bb807 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e5309bf84f4aafa9a17604f8452366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6642f912ba0467bac461bc7aedbf940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:11.013936 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e12585e0-1fdf-4ca3-8440-d37c9e1bb807 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] 10.222.0.79 "GET /compute/v2.1/servers/230b658a-6ae7-4812-ab1a-a5fee84100cd" status: 200 len: 1471 microversion: 2.1 time: 0.157681 Oct 17 13:40:11.015118 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 807/1659] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:10 2022] GET /compute/v2.1/servers/230b658a-6ae7-4812-ab1a-a5fee84100cd => generated 1471 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:11.019973 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-71291371-b924-4aa6-a2af-948abf65c1bb tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:11.022526 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-71291371-b924-4aa6-a2af-948abf65c1bb tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] [instance: ab2b571e-376c-41d3-a778-44bedcaa5467] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:11.034581 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-71291371-b924-4aa6-a2af-948abf65c1bb tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:11.037608 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-71291371-b924-4aa6-a2af-948abf65c1bb tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:11.038346 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-71291371-b924-4aa6-a2af-948abf65c1bb tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:11.041518 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-71291371-b924-4aa6-a2af-948abf65c1bb tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:11.042396 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-71291371-b924-4aa6-a2af-948abf65c1bb tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:11.043009 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-71291371-b924-4aa6-a2af-948abf65c1bb tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:11.116735 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-71291371-b924-4aa6-a2af-948abf65c1bb tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:11.117232 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-71291371-b924-4aa6-a2af-948abf65c1bb tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:11.117672 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-71291371-b924-4aa6-a2af-948abf65c1bb tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:11.118142 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-71291371-b924-4aa6-a2af-948abf65c1bb tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lazy-loading 'fault' on Instance uuid ab2b571e-376c-41d3-a778-44bedcaa5467 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:40:11.144818 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-adcdb5fa-e1e9-49db-9aee-df284f9140f7 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:11.183358 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-adcdb5fa-e1e9-49db-9aee-df284f9140f7 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:11.183358 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-adcdb5fa-e1e9-49db-9aee-df284f9140f7 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:11.186795 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-adcdb5fa-e1e9-49db-9aee-df284f9140f7 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1544 microversion: 2.91 time: 0.418516 Oct 17 13:40:11.206080 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 853/1660] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:40:10 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1544 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:40:11.221703 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-80464f95-4f98-4fbf-85cc-0d3feb8461a0 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:11.224431 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-80464f95-4f98-4fbf-85cc-0d3feb8461a0 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: b05d2fa3-d231-4842-a47b-26aa317ccaa3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:11.239090 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-80464f95-4f98-4fbf-85cc-0d3feb8461a0 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:11.239634 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-80464f95-4f98-4fbf-85cc-0d3feb8461a0 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:11.240074 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-80464f95-4f98-4fbf-85cc-0d3feb8461a0 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:11.241670 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-80464f95-4f98-4fbf-85cc-0d3feb8461a0 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:11.242322 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-80464f95-4f98-4fbf-85cc-0d3feb8461a0 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:11.244249 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-80464f95-4f98-4fbf-85cc-0d3feb8461a0 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:12.162019 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-80464f95-4f98-4fbf-85cc-0d3feb8461a0 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:12.178416 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-80464f95-4f98-4fbf-85cc-0d3feb8461a0 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/b05d2fa3-d231-4842-a47b-26aa317ccaa3" status: 200 len: 1306 microversion: 2.1 time: 0.970723 Oct 17 13:40:12.196336 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 854/1661] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:11 2022] GET /compute/v2.1/servers/b05d2fa3-d231-4842-a47b-26aa317ccaa3 => generated 1306 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:12.215877 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a83e000c-4c31-413d-914e-c16c023fb311 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:12.218210 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a83e000c-4c31-413d-914e-c16c023fb311 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: fd365dc4-44c6-4a00-971e-2699762ab41f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:12.233320 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a83e000c-4c31-413d-914e-c16c023fb311 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:12.233821 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a83e000c-4c31-413d-914e-c16c023fb311 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:12.234262 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a83e000c-4c31-413d-914e-c16c023fb311 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:12.234977 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a83e000c-4c31-413d-914e-c16c023fb311 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:12.235459 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a83e000c-4c31-413d-914e-c16c023fb311 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:12.239490 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a83e000c-4c31-413d-914e-c16c023fb311 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:12.287408 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-71291371-b924-4aa6-a2af-948abf65c1bb tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467" status: 200 len: 1600 microversion: 2.1 time: 1.267545 Oct 17 13:40:12.289580 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 808/1662] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:11 2022] GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467 => generated 1600 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:12.307811 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c3bcd3f6-3ea0-4956-a9e3-dc454ce87e43 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:12.312644 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c3bcd3f6-3ea0-4956-a9e3-dc454ce87e43 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] [instance: 8938a16d-a198-46b1-92aa-880f0cc290ba] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:12.331352 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c3bcd3f6-3ea0-4956-a9e3-dc454ce87e43 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:12.332151 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c3bcd3f6-3ea0-4956-a9e3-dc454ce87e43 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:12.332769 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c3bcd3f6-3ea0-4956-a9e3-dc454ce87e43 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:12.333673 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c3bcd3f6-3ea0-4956-a9e3-dc454ce87e43 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:12.334350 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c3bcd3f6-3ea0-4956-a9e3-dc454ce87e43 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:12.334935 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c3bcd3f6-3ea0-4956-a9e3-dc454ce87e43 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:12.774827 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a83e000c-4c31-413d-914e-c16c023fb311 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:12.784465 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a83e000c-4c31-413d-914e-c16c023fb311 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f" status: 200 len: 1390 microversion: 2.1 time: 0.586581 Oct 17 13:40:12.795879 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 855/1663] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:12 2022] GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f => generated 1390 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:12.801156 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-eab7a383-48d7-45ec-bd2e-f37e97f015bc tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:12.802104 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-eab7a383-48d7-45ec-bd2e-f37e97f015bc tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9c6b4ed2-b111-41b0-9679-b66d386834b9] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:12.817501 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c3bcd3f6-3ea0-4956-a9e3-dc454ce87e43 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:12.818010 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eab7a383-48d7-45ec-bd2e-f37e97f015bc tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:12.819406 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eab7a383-48d7-45ec-bd2e-f37e97f015bc tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:12.820453 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eab7a383-48d7-45ec-bd2e-f37e97f015bc tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:12.823990 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eab7a383-48d7-45ec-bd2e-f37e97f015bc tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:12.825303 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eab7a383-48d7-45ec-bd2e-f37e97f015bc tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:12.826725 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eab7a383-48d7-45ec-bd2e-f37e97f015bc tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:12.834947 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c3bcd3f6-3ea0-4956-a9e3-dc454ce87e43 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers/8938a16d-a198-46b1-92aa-880f0cc290ba" status: 200 len: 1321 microversion: 2.1 time: 0.543822 Oct 17 13:40:12.851018 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 809/1664] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:12 2022] GET /compute/v2.1/servers/8938a16d-a198-46b1-92aa-880f0cc290ba => generated 1321 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:12.865848 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-01a908cd-d3c7-4751-a88a-99bdcecb3caf tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:12.886742 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-01a908cd-d3c7-4751-a88a-99bdcecb3caf tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 709d926d-fba5-49ea-84ac-95d8bb018c68] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:12.904199 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-01a908cd-d3c7-4751-a88a-99bdcecb3caf tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:12.905185 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-01a908cd-d3c7-4751-a88a-99bdcecb3caf tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:12.905740 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-01a908cd-d3c7-4751-a88a-99bdcecb3caf tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:12.906586 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-01a908cd-d3c7-4751-a88a-99bdcecb3caf tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:12.907205 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-01a908cd-d3c7-4751-a88a-99bdcecb3caf tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:12.907720 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-01a908cd-d3c7-4751-a88a-99bdcecb3caf tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:13.052183 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-eab7a383-48d7-45ec-bd2e-f37e97f015bc tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:13.062190 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-eab7a383-48d7-45ec-bd2e-f37e97f015bc tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9" status: 200 len: 1275 microversion: 2.1 time: 0.264785 Oct 17 13:40:13.082551 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 856/1665] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:12 2022] GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9 => generated 1275 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:13.097243 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-d42987b0-c796-46b3-afda-a4668f2a8da1 req-90ab2456-3ce4-405a-81f4-9b9978778512 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "230b658a-6ae7-4812-ab1a-a5fee84100cd", "name": "network-vif-deleted", "tag": "67fb96db-403a-458b-b41d-68d7ee942ca8"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:13.115600 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-d42987b0-c796-46b3-afda-a4668f2a8da1 req-90ab2456-3ce4-405a-81f4-9b9978778512 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:13.116277 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-d42987b0-c796-46b3-afda-a4668f2a8da1 req-90ab2456-3ce4-405a-81f4-9b9978778512 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:13.117071 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-d42987b0-c796-46b3-afda-a4668f2a8da1 req-90ab2456-3ce4-405a-81f4-9b9978778512 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:13.143003 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-d42987b0-c796-46b3-afda-a4668f2a8da1 req-90ab2456-3ce4-405a-81f4-9b9978778512 service nova] Creating event network-vif-deleted:67fb96db-403a-458b-b41d-68d7ee942ca8 for instance 230b658a-6ae7-4812-ab1a-a5fee84100cd on n-h2-854247-14 Oct 17 13:40:13.152617 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-d42987b0-c796-46b3-afda-a4668f2a8da1 req-90ab2456-3ce4-405a-81f4-9b9978778512 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067575 Oct 17 13:40:13.153710 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 857/1666] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:40:13.159826 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-163dc192-43e5-4de2-87dd-442d7346643c tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:13.160856 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-163dc192-43e5-4de2-87dd-442d7346643c tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] [instance: 230b658a-6ae7-4812-ab1a-a5fee84100cd] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:13.169655 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-163dc192-43e5-4de2-87dd-442d7346643c tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:13.170357 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-163dc192-43e5-4de2-87dd-442d7346643c tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:13.170688 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-163dc192-43e5-4de2-87dd-442d7346643c tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:13.171670 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-163dc192-43e5-4de2-87dd-442d7346643c tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:13.172376 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-163dc192-43e5-4de2-87dd-442d7346643c tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:13.172962 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-163dc192-43e5-4de2-87dd-442d7346643c tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:13.191688 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-163dc192-43e5-4de2-87dd-442d7346643c tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] HTTP exception thrown: Instance 230b658a-6ae7-4812-ab1a-a5fee84100cd could not be found. Oct 17 13:40:13.194589 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-163dc192-43e5-4de2-87dd-442d7346643c tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Request method failure captured: Oct 17 13:40:13.194589 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/230b658a-6ae7-4812-ab1a-a5fee84100cd HTTP/1.1 Oct 17 13:40:13.194589 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:40:13.194589 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:40:13.194589 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:40:13.194589 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:40:13.194589 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:40:13.194589 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:40:13.194589 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:40:13.194589 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:40:13.194589 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVqHDKZK0UDMC0buxb2LPnPqhcxaOM5Ncau5t5zHaLs3hJe3As3bsndaDotc7dMA4uoDNfPdoM5-KEV_13uzeXdpQ-rfept5XJeIaIyRo87ziVzoIbJq7rkr4g_FP_T2VHcRq3HnLytozEnidKSlTrA28ZjP3r2l4VW0UXSwZIwrHAY Oct 17 13:40:13.194589 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:40:13.194589 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:40:13.194589 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:40:13.194589 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:40:13.194589 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:40:13.194589 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:40:13.194589 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: d6642f912ba0467bac461bc7aedbf940 Oct 17 13:40:13.194589 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-VolumesAdminNegativeTest-1185171622 Oct 17 13:40:13.194589 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:40:13.194589 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:40:13.196314 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d6642f912ba0467bac461bc7aedbf940"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d6642f912ba0467bac461bc7aedbf940"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d6642f912ba0467bac461bc7aedbf940"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d6642f912ba0467bac461bc7aedbf940", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:40:13.196314 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-VolumesAdminNegativeTest-1185171622 Oct 17 13:40:13.196314 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: d6642f912ba0467bac461bc7aedbf940 Oct 17 13:40:13.196314 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1185171622 Oct 17 13:40:13.196314 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-VolumesAdminNegativeTest-1185171622-project Oct 17 13:40:13.196314 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:40:13.196314 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:40:13.196314 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: e6e5309bf84f4aafa9a17604f8452366 Oct 17 13:40:13.196314 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-VolumesAdminNegativeTest-1185171622-project Oct 17 13:40:13.196314 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:40:13.196314 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 230b658a-6ae7-4812-ab1a-a5fee84100cd could not be found. Oct 17 13:40:13.196314 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '230b658a-6ae7-4812-ab1a-a5fee84100cd'} Oct 17 13:40:13.197478 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:40:13.197478 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:40:13.197478 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:40:13.197478 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:40:13.197478 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:40:13.197478 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:40:13.197478 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:40:13.197478 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:40:13.197478 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:40:13.197478 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:40:13.197478 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 230b658a-6ae7-4812-ab1a-a5fee84100cd could not be found. Oct 17 13:40:13.197478 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:40:13.197478 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:40:13.197478 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:40:13.197478 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:40:13.197478 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:40:13.197478 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:40:13.197478 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:40:13.197478 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:40:13.197478 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:40:13.200320 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:40:13.200320 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:40:13.200320 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:40:13.200320 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:40:13.200320 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:40:13.200320 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:40:13.200320 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:40:13.200320 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 230b658a-6ae7-4812-ab1a-a5fee84100cd could not be found. Oct 17 13:40:13.200320 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:40:13.200320 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:40:13.200320 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:40:13.200320 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:40:13.200320 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:40:13.200320 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:40:13.200320 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:40:13.200320 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:40:13.200320 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 230b658a-6ae7-4812-ab1a-a5fee84100cd could not be found. Oct 17 13:40:13.200320 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:40:13.203095 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-163dc192-43e5-4de2-87dd-442d7346643c tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Returning 404 to user: Instance 230b658a-6ae7-4812-ab1a-a5fee84100cd could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:40:13.204752 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-163dc192-43e5-4de2-87dd-442d7346643c tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] 10.222.0.79 "GET /compute/v2.1/servers/230b658a-6ae7-4812-ab1a-a5fee84100cd" status: 404 len: 111 microversion: 2.1 time: 0.049482 Oct 17 13:40:13.209853 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 858/1667] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:13 2022] GET /compute/v2.1/servers/230b658a-6ae7-4812-ab1a-a5fee84100cd => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:40:13.217177 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-fd88f10d-346b-4f6c-bc9a-5df5e2c3b952 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:13.218277 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-fd88f10d-346b-4f6c-bc9a-5df5e2c3b952 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:13.226633 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fd88f10d-346b-4f6c-bc9a-5df5e2c3b952 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:13.227355 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fd88f10d-346b-4f6c-bc9a-5df5e2c3b952 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:13.228091 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fd88f10d-346b-4f6c-bc9a-5df5e2c3b952 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:13.229200 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fd88f10d-346b-4f6c-bc9a-5df5e2c3b952 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:13.229811 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fd88f10d-346b-4f6c-bc9a-5df5e2c3b952 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:13.230401 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fd88f10d-346b-4f6c-bc9a-5df5e2c3b952 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:13.281104 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-01a908cd-d3c7-4751-a88a-99bdcecb3caf tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:13.293366 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-01a908cd-d3c7-4751-a88a-99bdcecb3caf tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:13.299965 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-01a908cd-d3c7-4751-a88a-99bdcecb3caf tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:13.304004 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-01a908cd-d3c7-4751-a88a-99bdcecb3caf tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68" status: 200 len: 1606 microversion: 2.25 time: 0.453600 Oct 17 13:40:13.306047 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 810/1668] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:40:12 2022] GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68 => generated 1606 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:40:13.313077 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b98db779-c996-4df0-add9-bd2638f0f6e0 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:13.315732 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b98db779-c996-4df0-add9-bd2638f0f6e0 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] [instance: ab2b571e-376c-41d3-a778-44bedcaa5467] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:13.326653 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b98db779-c996-4df0-add9-bd2638f0f6e0 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:13.327483 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b98db779-c996-4df0-add9-bd2638f0f6e0 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:13.328076 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b98db779-c996-4df0-add9-bd2638f0f6e0 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:13.328968 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b98db779-c996-4df0-add9-bd2638f0f6e0 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:13.329625 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b98db779-c996-4df0-add9-bd2638f0f6e0 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:13.330209 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b98db779-c996-4df0-add9-bd2638f0f6e0 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:13.515927 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b98db779-c996-4df0-add9-bd2638f0f6e0 tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467/action" status: 202 len: 0 microversion: 2.1 time: 0.206668 Oct 17 13:40:13.521734 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 811/1669] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:40:13 2022] POST /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:40:13.542195 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6073f249-943c-4dcd-b7e7-93e47183d286 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:13.546040 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6073f249-943c-4dcd-b7e7-93e47183d286 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: b05d2fa3-d231-4842-a47b-26aa317ccaa3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:13.554061 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-fd88f10d-346b-4f6c-bc9a-5df5e2c3b952 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:13.575249 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-fd88f10d-346b-4f6c-bc9a-5df5e2c3b952 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:13.578311 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6073f249-943c-4dcd-b7e7-93e47183d286 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:13.579871 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6073f249-943c-4dcd-b7e7-93e47183d286 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:13.580860 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6073f249-943c-4dcd-b7e7-93e47183d286 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:13.581538 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-fd88f10d-346b-4f6c-bc9a-5df5e2c3b952 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:13.582103 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6073f249-943c-4dcd-b7e7-93e47183d286 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:13.583354 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6073f249-943c-4dcd-b7e7-93e47183d286 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:13.585736 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6073f249-943c-4dcd-b7e7-93e47183d286 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:13.600961 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-fd88f10d-346b-4f6c-bc9a-5df5e2c3b952 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1544 microversion: 2.91 time: 0.389498 Oct 17 13:40:13.602126 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 859/1670] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:40:13 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1544 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:40:13.612277 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-15653487-bfea-4f99-8993-b116a49c3927 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:13.615237 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-15653487-bfea-4f99-8993-b116a49c3927 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 709d926d-fba5-49ea-84ac-95d8bb018c68] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:13.633528 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-15653487-bfea-4f99-8993-b116a49c3927 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:13.634431 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-15653487-bfea-4f99-8993-b116a49c3927 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:13.636428 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-15653487-bfea-4f99-8993-b116a49c3927 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:13.638752 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-15653487-bfea-4f99-8993-b116a49c3927 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:13.640701 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-15653487-bfea-4f99-8993-b116a49c3927 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:13.641407 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-15653487-bfea-4f99-8993-b116a49c3927 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:13.926036 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-15653487-bfea-4f99-8993-b116a49c3927 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.321154 Oct 17 13:40:13.927043 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 860/1671] 10.222.0.79 () {60 vars in 1316 bytes} [Mon Oct 17 13:40:13 2022] GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68/os-interface => generated 284 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:40:13.931779 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d9a61a7d-424e-40e4-be5c-a8c6b7b8a1da tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:13.932420 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d9a61a7d-424e-40e4-be5c-a8c6b7b8a1da tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] [instance: ab2b571e-376c-41d3-a778-44bedcaa5467] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:13.955221 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d9a61a7d-424e-40e4-be5c-a8c6b7b8a1da tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:13.955691 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d9a61a7d-424e-40e4-be5c-a8c6b7b8a1da tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:13.956113 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d9a61a7d-424e-40e4-be5c-a8c6b7b8a1da tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:13.956986 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d9a61a7d-424e-40e4-be5c-a8c6b7b8a1da tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:13.957433 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d9a61a7d-424e-40e4-be5c-a8c6b7b8a1da tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:13.957898 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d9a61a7d-424e-40e4-be5c-a8c6b7b8a1da tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:14.198035 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6073f249-943c-4dcd-b7e7-93e47183d286 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:14.230604 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6073f249-943c-4dcd-b7e7-93e47183d286 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/b05d2fa3-d231-4842-a47b-26aa317ccaa3" status: 200 len: 1306 microversion: 2.1 time: 0.705506 Oct 17 13:40:14.252059 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 812/1672] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:13 2022] GET /compute/v2.1/servers/b05d2fa3-d231-4842-a47b-26aa317ccaa3 => generated 1306 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:14.277059 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e2cf9013-d309-4bf4-bc45-000a978fbc35 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:14.277696 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e2cf9013-d309-4bf4-bc45-000a978fbc35 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: fd365dc4-44c6-4a00-971e-2699762ab41f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:14.293396 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e2cf9013-d309-4bf4-bc45-000a978fbc35 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:14.294635 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e2cf9013-d309-4bf4-bc45-000a978fbc35 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:14.295287 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e2cf9013-d309-4bf4-bc45-000a978fbc35 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:14.296184 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e2cf9013-d309-4bf4-bc45-000a978fbc35 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:14.296794 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e2cf9013-d309-4bf4-bc45-000a978fbc35 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:14.297370 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e2cf9013-d309-4bf4-bc45-000a978fbc35 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:14.390407 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d9a61a7d-424e-40e4-be5c-a8c6b7b8a1da tempest-ServersAdminTestJSON-612244200 tempest-ServersAdminTestJSON-612244200-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467" status: 200 len: 1617 microversion: 2.1 time: 0.457952 Oct 17 13:40:14.398461 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 861/1673] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:13 2022] GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467 => generated 1617 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:14.433550 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c3c12066-5760-4393-b302-5e4e5f1e1d26 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:14.437723 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c3c12066-5760-4393-b302-5e4e5f1e1d26 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] [instance: 8938a16d-a198-46b1-92aa-880f0cc290ba] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:14.491848 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c3c12066-5760-4393-b302-5e4e5f1e1d26 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:14.500671 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c3c12066-5760-4393-b302-5e4e5f1e1d26 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:14.501190 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c3c12066-5760-4393-b302-5e4e5f1e1d26 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:14.510692 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c3c12066-5760-4393-b302-5e4e5f1e1d26 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:14.513023 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c3c12066-5760-4393-b302-5e4e5f1e1d26 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:14.517537 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c3c12066-5760-4393-b302-5e4e5f1e1d26 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:15.106163 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e2cf9013-d309-4bf4-bc45-000a978fbc35 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:15.122322 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e2cf9013-d309-4bf4-bc45-000a978fbc35 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f" status: 200 len: 1390 microversion: 2.1 time: 0.861350 Oct 17 13:40:15.136577 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 813/1674] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:14 2022] GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f => generated 1390 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:15.157094 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f75726e2-ed56-484e-8c0b-1e6d1492bd94 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:15.159535 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f75726e2-ed56-484e-8c0b-1e6d1492bd94 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9c6b4ed2-b111-41b0-9679-b66d386834b9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:15.176392 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f75726e2-ed56-484e-8c0b-1e6d1492bd94 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:15.178514 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f75726e2-ed56-484e-8c0b-1e6d1492bd94 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:15.179476 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f75726e2-ed56-484e-8c0b-1e6d1492bd94 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:15.183357 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f75726e2-ed56-484e-8c0b-1e6d1492bd94 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:15.184083 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f75726e2-ed56-484e-8c0b-1e6d1492bd94 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:15.186805 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f75726e2-ed56-484e-8c0b-1e6d1492bd94 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:16.267611 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f75726e2-ed56-484e-8c0b-1e6d1492bd94 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:16.276699 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f75726e2-ed56-484e-8c0b-1e6d1492bd94 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9" status: 200 len: 1317 microversion: 2.1 time: 1.134137 Oct 17 13:40:16.292059 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 814/1675] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:15 2022] GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9 => generated 1317 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:16.303352 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2cad6aa3-6ebe-44bd-992e-dab737568a17 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:16.303859 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2cad6aa3-6ebe-44bd-992e-dab737568a17 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: 56f45c71-b693-48c4-a2b6-dcfea882eaa4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:16.346186 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2cad6aa3-6ebe-44bd-992e-dab737568a17 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:16.350050 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2cad6aa3-6ebe-44bd-992e-dab737568a17 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:16.350050 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2cad6aa3-6ebe-44bd-992e-dab737568a17 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:16.366047 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2cad6aa3-6ebe-44bd-992e-dab737568a17 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:16.370203 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2cad6aa3-6ebe-44bd-992e-dab737568a17 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:16.381937 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2cad6aa3-6ebe-44bd-992e-dab737568a17 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:16.488831 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2cad6aa3-6ebe-44bd-992e-dab737568a17 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: 56f45c71-b693-48c4-a2b6-dcfea882eaa4] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:40:16.670994 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2cad6aa3-6ebe-44bd-992e-dab737568a17 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "DELETE /compute/v2.1/servers/56f45c71-b693-48c4-a2b6-dcfea882eaa4" status: 204 len: 0 microversion: 2.1 time: 0.377382 Oct 17 13:40:16.674786 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 815/1676] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:40:16 2022] DELETE /compute/v2.1/servers/56f45c71-b693-48c4-a2b6-dcfea882eaa4 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:40:16.679910 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6e5d4b87-bd02-4fc2-b601-a1d07afbc416 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:16.682593 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6e5d4b87-bd02-4fc2-b601-a1d07afbc416 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:16.700235 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6e5d4b87-bd02-4fc2-b601-a1d07afbc416 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:16.702477 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6e5d4b87-bd02-4fc2-b601-a1d07afbc416 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:16.703480 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6e5d4b87-bd02-4fc2-b601-a1d07afbc416 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:16.704925 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6e5d4b87-bd02-4fc2-b601-a1d07afbc416 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:16.706756 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6e5d4b87-bd02-4fc2-b601-a1d07afbc416 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:16.709023 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6e5d4b87-bd02-4fc2-b601-a1d07afbc416 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:17.204712 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c3c12066-5760-4393-b302-5e4e5f1e1d26 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:17.220558 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c3c12066-5760-4393-b302-5e4e5f1e1d26 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers/8938a16d-a198-46b1-92aa-880f0cc290ba" status: 200 len: 1321 microversion: 2.1 time: 2.820519 Oct 17 13:40:17.221529 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 862/1677] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:14 2022] GET /compute/v2.1/servers/8938a16d-a198-46b1-92aa-880f0cc290ba => generated 1321 bytes in 2822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:17.226486 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0b66d404-a9fb-451f-af35-abd222307031 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:17.231700 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0b66d404-a9fb-451f-af35-abd222307031 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: b05d2fa3-d231-4842-a47b-26aa317ccaa3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:17.249893 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0b66d404-a9fb-451f-af35-abd222307031 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:17.250305 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0b66d404-a9fb-451f-af35-abd222307031 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:17.250760 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0b66d404-a9fb-451f-af35-abd222307031 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:17.251505 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0b66d404-a9fb-451f-af35-abd222307031 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:17.251953 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0b66d404-a9fb-451f-af35-abd222307031 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:17.252390 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0b66d404-a9fb-451f-af35-abd222307031 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:17.388097 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6e5d4b87-bd02-4fc2-b601-a1d07afbc416 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:17.392615 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:40:17.411875 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6e5d4b87-bd02-4fc2-b601-a1d07afbc416 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:17.418612 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6e5d4b87-bd02-4fc2-b601-a1d07afbc416 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:17.440266 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6e5d4b87-bd02-4fc2-b601-a1d07afbc416 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1544 microversion: 2.91 time: 0.766484 Oct 17 13:40:17.441170 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 816/1678] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:40:16 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1544 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:40:17.451539 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-61f0c678-2bbc-47cf-ab9c-a6936527d741 req-580a7f5a-000f-4f92-a739-b0a5c5236903 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d30452eb-38cd-413a-9369-f60aad1d31bb", "tag": "76105cf8-6f9e-478d-8c19-ca94faa330f7"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:17.470416 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-61f0c678-2bbc-47cf-ab9c-a6936527d741 req-580a7f5a-000f-4f92-a739-b0a5c5236903 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:17.471699 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-61f0c678-2bbc-47cf-ab9c-a6936527d741 req-580a7f5a-000f-4f92-a739-b0a5c5236903 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:17.472935 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-61f0c678-2bbc-47cf-ab9c-a6936527d741 req-580a7f5a-000f-4f92-a739-b0a5c5236903 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:17.503049 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-61f0c678-2bbc-47cf-ab9c-a6936527d741 req-580a7f5a-000f-4f92-a739-b0a5c5236903 service nova] Creating event network-changed:76105cf8-6f9e-478d-8c19-ca94faa330f7 for instance d30452eb-38cd-413a-9369-f60aad1d31bb on n-h1-854247-14 Oct 17 13:40:17.510656 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-61f0c678-2bbc-47cf-ab9c-a6936527d741 req-580a7f5a-000f-4f92-a739-b0a5c5236903 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067863 Oct 17 13:40:17.523527 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 817/1679] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:40:17.529442 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5abe4d3b-25e8-4146-aa20-470dcda877a1 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:17.530397 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5abe4d3b-25e8-4146-aa20-470dcda877a1 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: fd365dc4-44c6-4a00-971e-2699762ab41f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:17.538776 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5abe4d3b-25e8-4146-aa20-470dcda877a1 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:17.539576 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5abe4d3b-25e8-4146-aa20-470dcda877a1 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:17.545293 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5abe4d3b-25e8-4146-aa20-470dcda877a1 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:17.546759 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5abe4d3b-25e8-4146-aa20-470dcda877a1 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:17.547411 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5abe4d3b-25e8-4146-aa20-470dcda877a1 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:17.547992 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5abe4d3b-25e8-4146-aa20-470dcda877a1 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:17.939139 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0b66d404-a9fb-451f-af35-abd222307031 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:17.956093 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0b66d404-a9fb-451f-af35-abd222307031 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/b05d2fa3-d231-4842-a47b-26aa317ccaa3" status: 200 len: 1485 microversion: 2.1 time: 0.733478 Oct 17 13:40:17.957215 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 863/1680] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:17 2022] GET /compute/v2.1/servers/b05d2fa3-d231-4842-a47b-26aa317ccaa3 => generated 1485 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:17.961851 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-14aeb0ab-1ccf-4b24-b95c-0f044e1a52c0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:17.962829 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-14aeb0ab-1ccf-4b24-b95c-0f044e1a52c0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: 56f45c71-b693-48c4-a2b6-dcfea882eaa4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:17.977427 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-14aeb0ab-1ccf-4b24-b95c-0f044e1a52c0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:17.978428 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-14aeb0ab-1ccf-4b24-b95c-0f044e1a52c0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:17.979078 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-14aeb0ab-1ccf-4b24-b95c-0f044e1a52c0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:17.980053 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-14aeb0ab-1ccf-4b24-b95c-0f044e1a52c0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:17.980672 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-14aeb0ab-1ccf-4b24-b95c-0f044e1a52c0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:17.980942 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5abe4d3b-25e8-4146-aa20-470dcda877a1 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:17.984051 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-14aeb0ab-1ccf-4b24-b95c-0f044e1a52c0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:17.991325 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5abe4d3b-25e8-4146-aa20-470dcda877a1 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f" status: 200 len: 1390 microversion: 2.1 time: 0.466025 Oct 17 13:40:17.992279 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 818/1681] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:17 2022] GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f => generated 1390 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:18.014603 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-e78f3112-6013-4173-a032-166f284f541e req-c62973ba-0274-427a-9957-b19e3c5b197a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "709d926d-fba5-49ea-84ac-95d8bb018c68", "tag": "8407f400-367b-4c97-9c87-63bd179d8941"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:18.029266 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-e78f3112-6013-4173-a032-166f284f541e req-c62973ba-0274-427a-9957-b19e3c5b197a service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:18.030044 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-e78f3112-6013-4173-a032-166f284f541e req-c62973ba-0274-427a-9957-b19e3c5b197a service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:18.030672 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-e78f3112-6013-4173-a032-166f284f541e req-c62973ba-0274-427a-9957-b19e3c5b197a service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:18.049419 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-e78f3112-6013-4173-a032-166f284f541e req-c62973ba-0274-427a-9957-b19e3c5b197a service nova] Creating event network-changed:8407f400-367b-4c97-9c87-63bd179d8941 for instance 709d926d-fba5-49ea-84ac-95d8bb018c68 on n-h1-854247-14 Oct 17 13:40:18.056012 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-e78f3112-6013-4173-a032-166f284f541e req-c62973ba-0274-427a-9957-b19e3c5b197a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046272 Oct 17 13:40:18.062210 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 819/1682] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:40:18.070474 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9fda4dfb-8e26-4afb-acee-d0236ec01f63 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:18.071581 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9fda4dfb-8e26-4afb-acee-d0236ec01f63 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9c6b4ed2-b111-41b0-9679-b66d386834b9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:18.080198 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9fda4dfb-8e26-4afb-acee-d0236ec01f63 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:18.083034 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9fda4dfb-8e26-4afb-acee-d0236ec01f63 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:18.083721 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9fda4dfb-8e26-4afb-acee-d0236ec01f63 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:18.087305 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9fda4dfb-8e26-4afb-acee-d0236ec01f63 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:18.087783 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9fda4dfb-8e26-4afb-acee-d0236ec01f63 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:18.088220 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9fda4dfb-8e26-4afb-acee-d0236ec01f63 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:18.628278 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=6 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:40:18.678555 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=17 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:40:18.875049 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-14aeb0ab-1ccf-4b24-b95c-0f044e1a52c0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:18.887573 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-14aeb0ab-1ccf-4b24-b95c-0f044e1a52c0 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/56f45c71-b693-48c4-a2b6-dcfea882eaa4" status: 200 len: 1469 microversion: 2.1 time: 0.927653 Oct 17 13:40:18.890079 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 864/1683] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:17 2022] GET /compute/v2.1/servers/56f45c71-b693-48c4-a2b6-dcfea882eaa4 => generated 1469 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:18.906325 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1c898d0a-2bd3-4eb5-972d-a579cc086d56 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-360215125"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:18.914769 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1c898d0a-2bd3-4eb5-972d-a579cc086d56 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: b05d2fa3-d231-4842-a47b-26aa317ccaa3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:18.932132 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c898d0a-2bd3-4eb5-972d-a579cc086d56 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:18.933023 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c898d0a-2bd3-4eb5-972d-a579cc086d56 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:18.935805 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c898d0a-2bd3-4eb5-972d-a579cc086d56 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:18.937113 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c898d0a-2bd3-4eb5-972d-a579cc086d56 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:18.938106 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c898d0a-2bd3-4eb5-972d-a579cc086d56 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:18.943380 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c898d0a-2bd3-4eb5-972d-a579cc086d56 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:19.182734 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9fda4dfb-8e26-4afb-acee-d0236ec01f63 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:19.199317 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9fda4dfb-8e26-4afb-acee-d0236ec01f63 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9" status: 200 len: 1317 microversion: 2.1 time: 1.130914 Oct 17 13:40:19.211340 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 820/1684] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:18 2022] GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9 => generated 1317 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:19.229877 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f9c3eaa8-e9d5-4760-b8d3-922d8f4cea8d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:19.233871 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f9c3eaa8-e9d5-4760-b8d3-922d8f4cea8d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] [instance: 8938a16d-a198-46b1-92aa-880f0cc290ba] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:19.257883 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f9c3eaa8-e9d5-4760-b8d3-922d8f4cea8d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:19.259570 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f9c3eaa8-e9d5-4760-b8d3-922d8f4cea8d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:19.260048 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f9c3eaa8-e9d5-4760-b8d3-922d8f4cea8d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:19.262745 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f9c3eaa8-e9d5-4760-b8d3-922d8f4cea8d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:19.263260 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f9c3eaa8-e9d5-4760-b8d3-922d8f4cea8d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:19.264932 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f9c3eaa8-e9d5-4760-b8d3-922d8f4cea8d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:19.350756 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1c898d0a-2bd3-4eb5-972d-a579cc086d56 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "POST /compute/v2.1/servers/b05d2fa3-d231-4842-a47b-26aa317ccaa3/action" status: 202 len: 0 microversion: 2.1 time: 0.459038 Oct 17 13:40:19.355431 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 865/1685] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:40:18 2022] POST /compute/v2.1/servers/b05d2fa3-d231-4842-a47b-26aa317ccaa3/action => generated 0 bytes in 464 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 17 13:40:19.370520 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9e803e9b-b505-40af-a83f-629d23a2d46e tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:19.373319 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9e803e9b-b505-40af-a83f-629d23a2d46e tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:19.388149 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9e803e9b-b505-40af-a83f-629d23a2d46e tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:19.391240 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9e803e9b-b505-40af-a83f-629d23a2d46e tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:19.393178 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9e803e9b-b505-40af-a83f-629d23a2d46e tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:19.394285 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9e803e9b-b505-40af-a83f-629d23a2d46e tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:19.395516 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9e803e9b-b505-40af-a83f-629d23a2d46e tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:19.397269 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9e803e9b-b505-40af-a83f-629d23a2d46e tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:19.671548 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9e803e9b-b505-40af-a83f-629d23a2d46e tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:19.694961 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9e803e9b-b505-40af-a83f-629d23a2d46e tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:19.696888 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9e803e9b-b505-40af-a83f-629d23a2d46e tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:19.705145 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9e803e9b-b505-40af-a83f-629d23a2d46e tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1544 microversion: 2.91 time: 0.347226 Oct 17 13:40:19.706538 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 866/1686] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:40:19 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1544 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:40:19.711965 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7b2c53d2-fc12-46f7-96c3-9b65cc253bdb tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:19.712785 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7b2c53d2-fc12-46f7-96c3-9b65cc253bdb tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] [instance: b8d15c7c-7a1f-43e0-9c41-302172f31ca0] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:19.720898 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7b2c53d2-fc12-46f7-96c3-9b65cc253bdb tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:19.721551 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7b2c53d2-fc12-46f7-96c3-9b65cc253bdb tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:19.722427 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7b2c53d2-fc12-46f7-96c3-9b65cc253bdb tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:19.723495 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7b2c53d2-fc12-46f7-96c3-9b65cc253bdb tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:19.724163 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7b2c53d2-fc12-46f7-96c3-9b65cc253bdb tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:19.724807 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7b2c53d2-fc12-46f7-96c3-9b65cc253bdb tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:19.755739 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=96,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:40:19.776063 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7b2c53d2-fc12-46f7-96c3-9b65cc253bdb tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] [instance: b8d15c7c-7a1f-43e0-9c41-302172f31ca0] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:40:19.935944 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7b2c53d2-fc12-46f7-96c3-9b65cc253bdb tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] 10.222.0.79 "DELETE /compute/v2.1/servers/b8d15c7c-7a1f-43e0-9c41-302172f31ca0" status: 204 len: 0 microversion: 2.1 time: 0.227215 Oct 17 13:40:19.937998 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 867/1687] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:40:19 2022] DELETE /compute/v2.1/servers/b8d15c7c-7a1f-43e0-9c41-302172f31ca0 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:40:19.938190 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f9c3eaa8-e9d5-4760-b8d3-922d8f4cea8d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:19.945876 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0c28a8bd-eeb7-4c76-b1c5-1d25a9701af8 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:19.946922 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0c28a8bd-eeb7-4c76-b1c5-1d25a9701af8 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: fd365dc4-44c6-4a00-971e-2699762ab41f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:19.948986 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f9c3eaa8-e9d5-4760-b8d3-922d8f4cea8d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers/8938a16d-a198-46b1-92aa-880f0cc290ba" status: 200 len: 1321 microversion: 2.1 time: 0.745047 Oct 17 13:40:19.949982 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 821/1688] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:19 2022] GET /compute/v2.1/servers/8938a16d-a198-46b1-92aa-880f0cc290ba => generated 1321 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:19.954568 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0c28a8bd-eeb7-4c76-b1c5-1d25a9701af8 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:19.955139 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0c28a8bd-eeb7-4c76-b1c5-1d25a9701af8 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:19.955800 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0c28a8bd-eeb7-4c76-b1c5-1d25a9701af8 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:19.956619 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0c28a8bd-eeb7-4c76-b1c5-1d25a9701af8 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:19.957147 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0c28a8bd-eeb7-4c76-b1c5-1d25a9701af8 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:19.957971 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0c28a8bd-eeb7-4c76-b1c5-1d25a9701af8 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:19.958581 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9a45f879-0f40-48fc-b39b-34685ff06157 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd50a9ee0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:20.021093 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9a45f879-0f40-48fc-b39b-34685ff06157 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/a8625a43-cc13-4579-b0e9-3ebd2183a277" status: 200 len: 1413 microversion: 2.1 time: 0.068801 Oct 17 13:40:20.029978 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 822/1689] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:40:19 2022] GET /compute/v2.1/images/a8625a43-cc13-4579-b0e9-3ebd2183a277 => generated 1413 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:20.036260 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-30ae2d21-e5a0-465f-9d4e-706a55144f1e req-ddd5efc8-fd1e-400f-9a74-cee26445fe6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8938a16d-a198-46b1-92aa-880f0cc290ba", "tag": "abcefd69-7991-4cf3-8930-d2004d820733"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:20.048297 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-30ae2d21-e5a0-465f-9d4e-706a55144f1e req-ddd5efc8-fd1e-400f-9a74-cee26445fe6d service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:20.048782 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-30ae2d21-e5a0-465f-9d4e-706a55144f1e req-ddd5efc8-fd1e-400f-9a74-cee26445fe6d service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:20.049449 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-30ae2d21-e5a0-465f-9d4e-706a55144f1e req-ddd5efc8-fd1e-400f-9a74-cee26445fe6d service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:20.063220 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-30ae2d21-e5a0-465f-9d4e-706a55144f1e req-ddd5efc8-fd1e-400f-9a74-cee26445fe6d service nova] Creating event network-changed:abcefd69-7991-4cf3-8930-d2004d820733 for instance 8938a16d-a198-46b1-92aa-880f0cc290ba on n-h1-854247-14 Oct 17 13:40:20.069772 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-30ae2d21-e5a0-465f-9d4e-706a55144f1e req-ddd5efc8-fd1e-400f-9a74-cee26445fe6d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038090 Oct 17 13:40:20.071268 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 823/1690] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:40:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:40:20.080708 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-170342c6-b90f-4d3a-b270-a058beb1824f tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:20.081965 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-170342c6-b90f-4d3a-b270-a058beb1824f tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: 56f45c71-b693-48c4-a2b6-dcfea882eaa4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:20.100100 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-170342c6-b90f-4d3a-b270-a058beb1824f tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:20.100827 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-170342c6-b90f-4d3a-b270-a058beb1824f tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:20.101418 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-170342c6-b90f-4d3a-b270-a058beb1824f tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:20.102581 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-170342c6-b90f-4d3a-b270-a058beb1824f tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:20.103293 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-170342c6-b90f-4d3a-b270-a058beb1824f tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:20.103882 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-170342c6-b90f-4d3a-b270-a058beb1824f tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:20.294970 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0c28a8bd-eeb7-4c76-b1c5-1d25a9701af8 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:20.306127 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0c28a8bd-eeb7-4c76-b1c5-1d25a9701af8 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f" status: 200 len: 1390 microversion: 2.1 time: 0.365277 Oct 17 13:40:20.306892 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 868/1691] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:19 2022] GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f => generated 1390 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:20.317203 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f6ef7cbb-c5c6-4a7a-bdd3-df695a4adba4 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:20.317828 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f6ef7cbb-c5c6-4a7a-bdd3-df695a4adba4 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] [instance: b8d15c7c-7a1f-43e0-9c41-302172f31ca0] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:20.332278 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f6ef7cbb-c5c6-4a7a-bdd3-df695a4adba4 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:20.332781 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f6ef7cbb-c5c6-4a7a-bdd3-df695a4adba4 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:20.333223 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f6ef7cbb-c5c6-4a7a-bdd3-df695a4adba4 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:20.333941 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f6ef7cbb-c5c6-4a7a-bdd3-df695a4adba4 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:20.334394 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f6ef7cbb-c5c6-4a7a-bdd3-df695a4adba4 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:20.334818 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f6ef7cbb-c5c6-4a7a-bdd3-df695a4adba4 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:20.398282 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-170342c6-b90f-4d3a-b270-a058beb1824f tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:20.408512 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-170342c6-b90f-4d3a-b270-a058beb1824f tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/56f45c71-b693-48c4-a2b6-dcfea882eaa4" status: 200 len: 1469 microversion: 2.1 time: 0.335420 Oct 17 13:40:20.423225 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 824/1692] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:20 2022] GET /compute/v2.1/servers/56f45c71-b693-48c4-a2b6-dcfea882eaa4 => generated 1469 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:20.423225 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-96f88ad5-6a43-4c08-b923-315aced1f422 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:20.423225 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-96f88ad5-6a43-4c08-b923-315aced1f422 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9c6b4ed2-b111-41b0-9679-b66d386834b9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:20.433179 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-96f88ad5-6a43-4c08-b923-315aced1f422 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:20.433179 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-96f88ad5-6a43-4c08-b923-315aced1f422 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:20.433179 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-96f88ad5-6a43-4c08-b923-315aced1f422 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:20.433179 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-96f88ad5-6a43-4c08-b923-315aced1f422 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:20.435403 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-96f88ad5-6a43-4c08-b923-315aced1f422 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:20.436066 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-96f88ad5-6a43-4c08-b923-315aced1f422 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:20.606661 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f6ef7cbb-c5c6-4a7a-bdd3-df695a4adba4 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e5309bf84f4aafa9a17604f8452366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6642f912ba0467bac461bc7aedbf940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:20.620183 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f6ef7cbb-c5c6-4a7a-bdd3-df695a4adba4 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] 10.222.0.79 "GET /compute/v2.1/servers/b8d15c7c-7a1f-43e0-9c41-302172f31ca0" status: 200 len: 1680 microversion: 2.1 time: 0.311580 Oct 17 13:40:20.621365 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 869/1693] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:20 2022] GET /compute/v2.1/servers/b8d15c7c-7a1f-43e0-9c41-302172f31ca0 => generated 1680 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:20.668927 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-96f88ad5-6a43-4c08-b923-315aced1f422 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:20.677598 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-96f88ad5-6a43-4c08-b923-315aced1f422 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9" status: 200 len: 1317 microversion: 2.1 time: 0.266689 Oct 17 13:40:20.678321 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 825/1694] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:20 2022] GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9 => generated 1317 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:20.733944 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-92455d58-a017-453d-a964-aacc165192c9 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:20.734694 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-92455d58-a017-453d-a964-aacc165192c9 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:20.741413 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-92455d58-a017-453d-a964-aacc165192c9 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:20.742013 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-92455d58-a017-453d-a964-aacc165192c9 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:20.742512 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-92455d58-a017-453d-a964-aacc165192c9 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:20.743358 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-92455d58-a017-453d-a964-aacc165192c9 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:20.744079 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-92455d58-a017-453d-a964-aacc165192c9 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:20.744721 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-92455d58-a017-453d-a964-aacc165192c9 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:20.817806 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-92455d58-a017-453d-a964-aacc165192c9 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:20.826565 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-92455d58-a017-453d-a964-aacc165192c9 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:20.828032 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-92455d58-a017-453d-a964-aacc165192c9 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:20.832877 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-92455d58-a017-453d-a964-aacc165192c9 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1531 microversion: 2.91 time: 0.103212 Oct 17 13:40:20.833455 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 870/1695] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:40:20 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1531 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:40:20.859803 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-34f36ff5-eacf-4dad-bc3f-30e175e59830 tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:20.860381 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-34f36ff5-eacf-4dad-bc3f-30e175e59830 tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:20.866693 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-34f36ff5-eacf-4dad-bc3f-30e175e59830 tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:20.867193 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-34f36ff5-eacf-4dad-bc3f-30e175e59830 tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:20.867630 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-34f36ff5-eacf-4dad-bc3f-30e175e59830 tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:20.868450 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-34f36ff5-eacf-4dad-bc3f-30e175e59830 tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:20.868868 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-34f36ff5-eacf-4dad-bc3f-30e175e59830 tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:20.869323 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-34f36ff5-eacf-4dad-bc3f-30e175e59830 tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:20.952958 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-34f36ff5-eacf-4dad-bc3f-30e175e59830 tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] Lazy-loading 'services' on Instance uuid 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:40:20.970575 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-34f36ff5-eacf-4dad-bc3f-30e175e59830 tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1938 microversion: 2.91 time: 0.114889 Oct 17 13:40:20.971128 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 826/1696] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:40:20 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1938 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:40:20.976120 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-aaed3c62-34e1-42ae-8ff6-956c9680f69e tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:20.976733 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-aaed3c62-34e1-42ae-8ff6-956c9680f69e tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] [instance: 8938a16d-a198-46b1-92aa-880f0cc290ba] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:20.983384 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aaed3c62-34e1-42ae-8ff6-956c9680f69e tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:20.983864 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aaed3c62-34e1-42ae-8ff6-956c9680f69e tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:20.984289 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aaed3c62-34e1-42ae-8ff6-956c9680f69e tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:20.984972 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aaed3c62-34e1-42ae-8ff6-956c9680f69e tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:20.985414 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aaed3c62-34e1-42ae-8ff6-956c9680f69e tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:20.985829 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aaed3c62-34e1-42ae-8ff6-956c9680f69e tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:20.997112 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6689ea77-3386-4633-aa62-e3b5c2a4183b tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:20.997666 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6689ea77-3386-4633-aa62-e3b5c2a4183b tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:21.003780 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6689ea77-3386-4633-aa62-e3b5c2a4183b tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:21.004271 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6689ea77-3386-4633-aa62-e3b5c2a4183b tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:21.004706 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6689ea77-3386-4633-aa62-e3b5c2a4183b tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:21.005421 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6689ea77-3386-4633-aa62-e3b5c2a4183b tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:21.005853 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6689ea77-3386-4633-aa62-e3b5c2a4183b tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:21.006274 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6689ea77-3386-4633-aa62-e3b5c2a4183b tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:21.029651 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-6689ea77-3386-4633-aa62-e3b5c2a4183b tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lazy-loading 'flavor' on Instance uuid 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:40:21.124945 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-aaed3c62-34e1-42ae-8ff6-956c9680f69e tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:21.133022 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-aaed3c62-34e1-42ae-8ff6-956c9680f69e tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers/8938a16d-a198-46b1-92aa-880f0cc290ba" status: 200 len: 1321 microversion: 2.1 time: 0.160744 Oct 17 13:40:21.133602 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 871/1697] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:20 2022] GET /compute/v2.1/servers/8938a16d-a198-46b1-92aa-880f0cc290ba => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:21.138144 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4cc1b1b2-ff1d-41a1-8d50-dc19ede1fdb2 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd9a590d0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:21.183016 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4cc1b1b2-ff1d-41a1-8d50-dc19ede1fdb2 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/a8625a43-cc13-4579-b0e9-3ebd2183a277" status: 200 len: 1413 microversion: 2.1 time: 0.048253 Oct 17 13:40:21.187950 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 872/1698] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:40:21 2022] GET /compute/v2.1/images/a8625a43-cc13-4579-b0e9-3ebd2183a277 => generated 1413 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:21.261278 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6689ea77-3386-4633-aa62-e3b5c2a4183b tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "POST /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57/action" status: 202 len: 0 microversion: 2.91 time: 0.267141 Oct 17 13:40:21.261933 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 827/1699] 10.222.0.79 () {62 vars in 1319 bytes} [Mon Oct 17 13:40:20 2022] POST /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:40:21.270906 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d3bfc29a-2c73-4413-b004-85fdf8195401 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:21.272116 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d3bfc29a-2c73-4413-b004-85fdf8195401 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:21.278310 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d3bfc29a-2c73-4413-b004-85fdf8195401 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:21.279267 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d3bfc29a-2c73-4413-b004-85fdf8195401 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:21.279884 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d3bfc29a-2c73-4413-b004-85fdf8195401 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:21.280862 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d3bfc29a-2c73-4413-b004-85fdf8195401 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:21.282382 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d3bfc29a-2c73-4413-b004-85fdf8195401 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:21.283032 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d3bfc29a-2c73-4413-b004-85fdf8195401 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:21.333871 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f79fd08a-1842-4ce2-b3cf-1b8a65417fbe tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:21.334587 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f79fd08a-1842-4ce2-b3cf-1b8a65417fbe tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: fd365dc4-44c6-4a00-971e-2699762ab41f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:21.341972 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f79fd08a-1842-4ce2-b3cf-1b8a65417fbe tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:21.342480 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f79fd08a-1842-4ce2-b3cf-1b8a65417fbe tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:21.342894 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f79fd08a-1842-4ce2-b3cf-1b8a65417fbe tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:21.343933 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f79fd08a-1842-4ce2-b3cf-1b8a65417fbe tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:21.344383 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f79fd08a-1842-4ce2-b3cf-1b8a65417fbe tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:21.344803 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f79fd08a-1842-4ce2-b3cf-1b8a65417fbe tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:21.357125 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d3bfc29a-2c73-4413-b004-85fdf8195401 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:21.365844 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d3bfc29a-2c73-4413-b004-85fdf8195401 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:21.367334 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d3bfc29a-2c73-4413-b004-85fdf8195401 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:21.372562 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d3bfc29a-2c73-4413-b004-85fdf8195401 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1537 microversion: 2.91 time: 0.106251 Oct 17 13:40:21.373074 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 873/1700] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:40:21 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1537 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:40:21.452706 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-82967618-1cc5-4495-a9a5-ca77b554fc0f tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:21.453499 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-82967618-1cc5-4495-a9a5-ca77b554fc0f tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: 56f45c71-b693-48c4-a2b6-dcfea882eaa4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:21.459460 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82967618-1cc5-4495-a9a5-ca77b554fc0f tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:21.460205 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82967618-1cc5-4495-a9a5-ca77b554fc0f tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:21.460635 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82967618-1cc5-4495-a9a5-ca77b554fc0f tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:21.461328 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82967618-1cc5-4495-a9a5-ca77b554fc0f tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:21.461771 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82967618-1cc5-4495-a9a5-ca77b554fc0f tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:21.462298 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82967618-1cc5-4495-a9a5-ca77b554fc0f tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:21.516812 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82967618-1cc5-4495-a9a5-ca77b554fc0f tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:21.517307 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82967618-1cc5-4495-a9a5-ca77b554fc0f tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:21.517746 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82967618-1cc5-4495-a9a5-ca77b554fc0f tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:21.518242 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-82967618-1cc5-4495-a9a5-ca77b554fc0f tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lazy-loading 'fault' on Instance uuid 56f45c71-b693-48c4-a2b6-dcfea882eaa4 {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:40:21.625751 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-82967618-1cc5-4495-a9a5-ca77b554fc0f tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:21.635690 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-82967618-1cc5-4495-a9a5-ca77b554fc0f tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/56f45c71-b693-48c4-a2b6-dcfea882eaa4" status: 200 len: 1303 microversion: 2.1 time: 0.197977 Oct 17 13:40:21.647854 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 874/1701] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:21 2022] GET /compute/v2.1/servers/56f45c71-b693-48c4-a2b6-dcfea882eaa4 => generated 1303 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:40:21.659375 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-fafb881b-39dd-4121-9c99-ed723f8c37e9 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:21.660255 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-fafb881b-39dd-4121-9c99-ed723f8c37e9 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] [instance: b8d15c7c-7a1f-43e0-9c41-302172f31ca0] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:21.666878 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fafb881b-39dd-4121-9c99-ed723f8c37e9 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:21.667380 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fafb881b-39dd-4121-9c99-ed723f8c37e9 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:21.668281 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fafb881b-39dd-4121-9c99-ed723f8c37e9 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:21.669018 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fafb881b-39dd-4121-9c99-ed723f8c37e9 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:21.669460 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fafb881b-39dd-4121-9c99-ed723f8c37e9 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:21.670050 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fafb881b-39dd-4121-9c99-ed723f8c37e9 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:21.681686 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f79fd08a-1842-4ce2-b3cf-1b8a65417fbe tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:21.692351 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f79fd08a-1842-4ce2-b3cf-1b8a65417fbe tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f" status: 200 len: 1390 microversion: 2.1 time: 0.363259 Oct 17 13:40:21.709598 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 828/1702] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:21 2022] GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f => generated 1390 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:21.716030 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-366c43ca-dece-4ca7-9323-15f315729aff tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:21.717243 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-366c43ca-dece-4ca7-9323-15f315729aff tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9c6b4ed2-b111-41b0-9679-b66d386834b9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:21.724339 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-366c43ca-dece-4ca7-9323-15f315729aff tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:21.725073 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-366c43ca-dece-4ca7-9323-15f315729aff tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:21.725708 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-366c43ca-dece-4ca7-9323-15f315729aff tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:21.727390 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-366c43ca-dece-4ca7-9323-15f315729aff tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:21.728112 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-366c43ca-dece-4ca7-9323-15f315729aff tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:21.728700 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-366c43ca-dece-4ca7-9323-15f315729aff tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:22.664619 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-fafb881b-39dd-4121-9c99-ed723f8c37e9 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e5309bf84f4aafa9a17604f8452366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6642f912ba0467bac461bc7aedbf940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:22.677681 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-fafb881b-39dd-4121-9c99-ed723f8c37e9 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] 10.222.0.79 "GET /compute/v2.1/servers/b8d15c7c-7a1f-43e0-9c41-302172f31ca0" status: 200 len: 1680 microversion: 2.1 time: 1.022272 Oct 17 13:40:22.678398 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 875/1703] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:21 2022] GET /compute/v2.1/servers/b8d15c7c-7a1f-43e0-9c41-302172f31ca0 => generated 1680 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:22.683467 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4891d4a9-01b0-4806-9b70-7d249885fd9e tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:22.684194 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4891d4a9-01b0-4806-9b70-7d249885fd9e tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] [instance: 8938a16d-a198-46b1-92aa-880f0cc290ba] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:22.700497 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4891d4a9-01b0-4806-9b70-7d249885fd9e tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:22.701383 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4891d4a9-01b0-4806-9b70-7d249885fd9e tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:22.702039 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4891d4a9-01b0-4806-9b70-7d249885fd9e tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:22.703011 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4891d4a9-01b0-4806-9b70-7d249885fd9e tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:22.703747 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4891d4a9-01b0-4806-9b70-7d249885fd9e tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:22.704392 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4891d4a9-01b0-4806-9b70-7d249885fd9e tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:22.771269 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-366c43ca-dece-4ca7-9323-15f315729aff tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:22.780918 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-366c43ca-dece-4ca7-9323-15f315729aff tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9" status: 200 len: 1317 microversion: 2.1 time: 1.069503 Oct 17 13:40:22.781742 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 829/1704] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:21 2022] GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9 => generated 1317 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:22.787347 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5ca813bd-c0c7-46c1-ac82-06388f0788ed tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd50711f0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:22.840432 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5ca813bd-c0c7-46c1-ac82-06388f0788ed tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/a8625a43-cc13-4579-b0e9-3ebd2183a277" status: 200 len: 1413 microversion: 2.1 time: 0.057014 Oct 17 13:40:22.841041 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 830/1705] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:40:22 2022] GET /compute/v2.1/images/a8625a43-cc13-4579-b0e9-3ebd2183a277 => generated 1413 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:22.845900 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-b600a9b3-e338-405d-9b96-7ad340e57977 req-201fdaa5-6c03-41ce-930e-e626855a7538 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c6b4ed2-b111-41b0-9679-b66d386834b9", "tag": "3a217dc6-53c2-4e51-abb4-9f6293319532"}, {"server_uuid": "56f45c71-b693-48c4-a2b6-dcfea882eaa4", "name": "network-vif-deleted", "tag": "daf0db87-9b0f-4002-bd30-1e15678e955e"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:22.853413 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:40:22.860001 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-b600a9b3-e338-405d-9b96-7ad340e57977 req-201fdaa5-6c03-41ce-930e-e626855a7538 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:22.860728 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-b600a9b3-e338-405d-9b96-7ad340e57977 req-201fdaa5-6c03-41ce-930e-e626855a7538 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:22.861350 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-b600a9b3-e338-405d-9b96-7ad340e57977 req-201fdaa5-6c03-41ce-930e-e626855a7538 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:22.883103 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-b600a9b3-e338-405d-9b96-7ad340e57977 req-201fdaa5-6c03-41ce-930e-e626855a7538 service nova] Creating event network-changed:3a217dc6-53c2-4e51-abb4-9f6293319532 for instance 9c6b4ed2-b111-41b0-9679-b66d386834b9 on n-h2-854247-14 Oct 17 13:40:22.883661 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-b600a9b3-e338-405d-9b96-7ad340e57977 req-201fdaa5-6c03-41ce-930e-e626855a7538 service nova] Creating event network-vif-deleted:daf0db87-9b0f-4002-bd30-1e15678e955e for instance 56f45c71-b693-48c4-a2b6-dcfea882eaa4 on n-h2-854247-14 Oct 17 13:40:22.890863 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-b600a9b3-e338-405d-9b96-7ad340e57977 req-201fdaa5-6c03-41ce-930e-e626855a7538 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.048372 Oct 17 13:40:22.892475 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 831/1706] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:40:22.901750 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a2ce3e9c-383e-4769-b911-e0632de66aab tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:22.903094 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a2ce3e9c-383e-4769-b911-e0632de66aab tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:22.910454 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a2ce3e9c-383e-4769-b911-e0632de66aab tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:22.910940 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a2ce3e9c-383e-4769-b911-e0632de66aab tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:22.911461 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a2ce3e9c-383e-4769-b911-e0632de66aab tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:22.912398 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a2ce3e9c-383e-4769-b911-e0632de66aab tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:22.912851 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a2ce3e9c-383e-4769-b911-e0632de66aab tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:22.913484 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a2ce3e9c-383e-4769-b911-e0632de66aab tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:23.072967 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a2ce3e9c-383e-4769-b911-e0632de66aab tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:23.082031 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a2ce3e9c-383e-4769-b911-e0632de66aab tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:23.083628 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a2ce3e9c-383e-4769-b911-e0632de66aab tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:23.095133 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a2ce3e9c-383e-4769-b911-e0632de66aab tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1537 microversion: 2.91 time: 0.201315 Oct 17 13:40:23.096508 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 832/1707] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:40:22 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1537 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:40:23.112314 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-504c299a-9e03-4eb8-a51a-de1f003c5f9c tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:23.113760 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-504c299a-9e03-4eb8-a51a-de1f003c5f9c tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: 56f45c71-b693-48c4-a2b6-dcfea882eaa4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:23.121139 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-504c299a-9e03-4eb8-a51a-de1f003c5f9c tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:23.121904 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-504c299a-9e03-4eb8-a51a-de1f003c5f9c tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:23.122558 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-504c299a-9e03-4eb8-a51a-de1f003c5f9c tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:23.123351 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-504c299a-9e03-4eb8-a51a-de1f003c5f9c tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:23.124077 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-504c299a-9e03-4eb8-a51a-de1f003c5f9c tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:23.124503 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-504c299a-9e03-4eb8-a51a-de1f003c5f9c tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:23.141041 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-504c299a-9e03-4eb8-a51a-de1f003c5f9c tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] HTTP exception thrown: Instance 56f45c71-b693-48c4-a2b6-dcfea882eaa4 could not be found. Oct 17 13:40:23.142738 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-504c299a-9e03-4eb8-a51a-de1f003c5f9c tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Request method failure captured: Oct 17 13:40:23.142738 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/56f45c71-b693-48c4-a2b6-dcfea882eaa4 HTTP/1.1 Oct 17 13:40:23.142738 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:40:23.142738 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:40:23.142738 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:40:23.142738 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:40:23.142738 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:40:23.142738 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:40:23.142738 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:40:23.142738 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:40:23.142738 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVq3QG91bsbrdujMx0w2rwLFi6GpzE732UrjJvuSTfBVExjcgLnF2M2z5qHJG62FSG1Pm6TSVJ3G0JMZXM4x5T8PL2EiMmH1zEj8FFbxs0eLY-dCHBBSOlmbkA3M_U3rDAsaCdweKlbyRuXYwRKNtgqMKG1bmX8eKrZqh0UiHb1LwEE Oct 17 13:40:23.142738 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:40:23.142738 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:40:23.142738 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:40:23.142738 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:40:23.142738 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:40:23.142738 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:40:23.142738 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 76eaaef0f6234db690a123c54cea5a6d Oct 17 13:40:23.142738 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServersAdminTestJSON-948985186 Oct 17 13:40:23.142738 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:40:23.142738 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:40:23.144534 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/76eaaef0f6234db690a123c54cea5a6d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/76eaaef0f6234db690a123c54cea5a6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/76eaaef0f6234db690a123c54cea5a6d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_76eaaef0f6234db690a123c54cea5a6d", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:40:23.144534 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServersAdminTestJSON-948985186 Oct 17 13:40:23.144534 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 76eaaef0f6234db690a123c54cea5a6d Oct 17 13:40:23.144534 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServersAdminTestJSON-948985186 Oct 17 13:40:23.144534 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServersAdminTestJSON-948985186-project Oct 17 13:40:23.144534 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:40:23.144534 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:40:23.144534 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 69bd293284874ca9ba415770de7b6965 Oct 17 13:40:23.144534 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServersAdminTestJSON-948985186-project Oct 17 13:40:23.144534 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:40:23.144534 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 56f45c71-b693-48c4-a2b6-dcfea882eaa4 could not be found. Oct 17 13:40:23.144534 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '56f45c71-b693-48c4-a2b6-dcfea882eaa4'} Oct 17 13:40:23.146116 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:40:23.146116 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:40:23.146116 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:40:23.146116 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:40:23.146116 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:40:23.146116 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:40:23.146116 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:40:23.146116 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:40:23.146116 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:40:23.146116 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:40:23.146116 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56f45c71-b693-48c4-a2b6-dcfea882eaa4 could not be found. Oct 17 13:40:23.146116 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:40:23.146116 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:40:23.146116 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:40:23.146116 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:40:23.146116 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:40:23.146116 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:40:23.146116 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:40:23.146116 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:40:23.146116 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:40:23.148865 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:40:23.148865 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:40:23.148865 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:40:23.148865 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:40:23.148865 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:40:23.148865 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:40:23.148865 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:40:23.148865 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56f45c71-b693-48c4-a2b6-dcfea882eaa4 could not be found. Oct 17 13:40:23.148865 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:40:23.148865 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:40:23.148865 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:40:23.148865 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:40:23.148865 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:40:23.148865 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:40:23.148865 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:40:23.148865 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:40:23.148865 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56f45c71-b693-48c4-a2b6-dcfea882eaa4 could not be found. Oct 17 13:40:23.148865 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:40:23.151964 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-504c299a-9e03-4eb8-a51a-de1f003c5f9c tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Returning 404 to user: Instance 56f45c71-b693-48c4-a2b6-dcfea882eaa4 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:40:23.151964 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-504c299a-9e03-4eb8-a51a-de1f003c5f9c tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/56f45c71-b693-48c4-a2b6-dcfea882eaa4" status: 404 len: 111 microversion: 2.1 time: 0.046240 Oct 17 13:40:23.151964 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 833/1708] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:23 2022] GET /compute/v2.1/servers/56f45c71-b693-48c4-a2b6-dcfea882eaa4 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:40:23.151964 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a0c3334d-c745-4827-be76-0ada6c1a97ec tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:23.151964 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a0c3334d-c745-4827-be76-0ada6c1a97ec tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: fd365dc4-44c6-4a00-971e-2699762ab41f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:23.157760 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a0c3334d-c745-4827-be76-0ada6c1a97ec tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:23.158557 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a0c3334d-c745-4827-be76-0ada6c1a97ec tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:23.158986 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a0c3334d-c745-4827-be76-0ada6c1a97ec tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:23.159912 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a0c3334d-c745-4827-be76-0ada6c1a97ec tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:23.160158 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a0c3334d-c745-4827-be76-0ada6c1a97ec tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:23.160604 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a0c3334d-c745-4827-be76-0ada6c1a97ec tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:23.353792 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4891d4a9-01b0-4806-9b70-7d249885fd9e tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:23.362148 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4891d4a9-01b0-4806-9b70-7d249885fd9e tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers/8938a16d-a198-46b1-92aa-880f0cc290ba" status: 200 len: 1321 microversion: 2.1 time: 0.682476 Oct 17 13:40:23.362742 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 876/1709] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:22 2022] GET /compute/v2.1/servers/8938a16d-a198-46b1-92aa-880f0cc290ba => generated 1321 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:23.367697 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-042bbd1d-cc5a-4061-a30c-ae818e4bb564 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:23.368185 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-042bbd1d-cc5a-4061-a30c-ae818e4bb564 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: f47e3dcd-6e44-411d-bf0c-3da0abda9f87] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:23.376031 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-042bbd1d-cc5a-4061-a30c-ae818e4bb564 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:23.376883 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-042bbd1d-cc5a-4061-a30c-ae818e4bb564 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:23.377419 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-042bbd1d-cc5a-4061-a30c-ae818e4bb564 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:23.378546 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-042bbd1d-cc5a-4061-a30c-ae818e4bb564 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:23.379088 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-042bbd1d-cc5a-4061-a30c-ae818e4bb564 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:23.379594 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-042bbd1d-cc5a-4061-a30c-ae818e4bb564 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:23.407417 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-042bbd1d-cc5a-4061-a30c-ae818e4bb564 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: f47e3dcd-6e44-411d-bf0c-3da0abda9f87] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:40:23.492648 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-042bbd1d-cc5a-4061-a30c-ae818e4bb564 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "DELETE /compute/v2.1/servers/f47e3dcd-6e44-411d-bf0c-3da0abda9f87" status: 204 len: 0 microversion: 2.1 time: 0.128482 Oct 17 13:40:23.494082 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 877/1710] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:40:23 2022] DELETE /compute/v2.1/servers/f47e3dcd-6e44-411d-bf0c-3da0abda9f87 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:40:23.503381 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-96459178-6bad-4a5b-9432-84c339e96a70 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:23.504074 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-96459178-6bad-4a5b-9432-84c339e96a70 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: f47e3dcd-6e44-411d-bf0c-3da0abda9f87] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:23.510442 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-96459178-6bad-4a5b-9432-84c339e96a70 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:23.510925 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-96459178-6bad-4a5b-9432-84c339e96a70 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:23.511402 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-96459178-6bad-4a5b-9432-84c339e96a70 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:23.512114 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-96459178-6bad-4a5b-9432-84c339e96a70 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:23.512551 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-96459178-6bad-4a5b-9432-84c339e96a70 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:23.512971 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-96459178-6bad-4a5b-9432-84c339e96a70 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:23.590047 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a0c3334d-c745-4827-be76-0ada6c1a97ec tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:23.598199 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a0c3334d-c745-4827-be76-0ada6c1a97ec tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f" status: 200 len: 1390 microversion: 2.1 time: 0.452073 Oct 17 13:40:23.598784 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 834/1711] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:23 2022] GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f => generated 1390 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:23.702321 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-466f2a2e-7211-4ea5-87df-4afa7d10ad30 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:23.702932 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-466f2a2e-7211-4ea5-87df-4afa7d10ad30 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] [instance: b8d15c7c-7a1f-43e0-9c41-302172f31ca0] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:23.709563 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-466f2a2e-7211-4ea5-87df-4afa7d10ad30 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:23.710045 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-466f2a2e-7211-4ea5-87df-4afa7d10ad30 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:23.710477 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-466f2a2e-7211-4ea5-87df-4afa7d10ad30 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:23.711208 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-466f2a2e-7211-4ea5-87df-4afa7d10ad30 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:23.711692 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-466f2a2e-7211-4ea5-87df-4afa7d10ad30 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:23.712117 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-466f2a2e-7211-4ea5-87df-4afa7d10ad30 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:23.737770 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-96459178-6bad-4a5b-9432-84c339e96a70 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:23.746252 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-96459178-6bad-4a5b-9432-84c339e96a70 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/f47e3dcd-6e44-411d-bf0c-3da0abda9f87" status: 200 len: 1470 microversion: 2.1 time: 0.247469 Oct 17 13:40:23.746826 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 878/1712] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:23 2022] GET /compute/v2.1/servers/f47e3dcd-6e44-411d-bf0c-3da0abda9f87 => generated 1470 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:40:23.808446 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4a8cdc57-058e-45ad-9ce2-2f21282382a3 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:23.809164 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4a8cdc57-058e-45ad-9ce2-2f21282382a3 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9c6b4ed2-b111-41b0-9679-b66d386834b9] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:23.815867 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4a8cdc57-058e-45ad-9ce2-2f21282382a3 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:23.816243 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4a8cdc57-058e-45ad-9ce2-2f21282382a3 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:23.816741 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4a8cdc57-058e-45ad-9ce2-2f21282382a3 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:23.817566 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4a8cdc57-058e-45ad-9ce2-2f21282382a3 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:23.818097 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4a8cdc57-058e-45ad-9ce2-2f21282382a3 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:23.818595 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4a8cdc57-058e-45ad-9ce2-2f21282382a3 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:23.945426 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-466f2a2e-7211-4ea5-87df-4afa7d10ad30 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e5309bf84f4aafa9a17604f8452366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6642f912ba0467bac461bc7aedbf940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:23.961554 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-466f2a2e-7211-4ea5-87df-4afa7d10ad30 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] 10.222.0.79 "GET /compute/v2.1/servers/b8d15c7c-7a1f-43e0-9c41-302172f31ca0" status: 200 len: 1680 microversion: 2.1 time: 0.263137 Oct 17 13:40:23.968755 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 835/1713] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:23 2022] GET /compute/v2.1/servers/b8d15c7c-7a1f-43e0-9c41-302172f31ca0 => generated 1680 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:23.977656 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-aa069f9e-2568-4046-9c3e-98d0d7ca5422 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd5b7bd30>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:24.033018 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-aa069f9e-2568-4046-9c3e-98d0d7ca5422 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/a8625a43-cc13-4579-b0e9-3ebd2183a277" status: 200 len: 1413 microversion: 2.1 time: 0.061328 Oct 17 13:40:24.033857 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 836/1714] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:40:23 2022] GET /compute/v2.1/images/a8625a43-cc13-4579-b0e9-3ebd2183a277 => generated 1413 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:24.083112 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4a8cdc57-058e-45ad-9ce2-2f21282382a3 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:24.094335 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4a8cdc57-058e-45ad-9ce2-2f21282382a3 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9" status: 200 len: 1317 microversion: 2.1 time: 0.289911 Oct 17 13:40:24.096586 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 879/1715] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:23 2022] GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9 => generated 1317 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:24.125752 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c3f90cfc-6b6b-471a-b421-4f2424602a32 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:24.126476 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c3f90cfc-6b6b-471a-b421-4f2424602a32 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:24.133083 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c3f90cfc-6b6b-471a-b421-4f2424602a32 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:24.133555 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c3f90cfc-6b6b-471a-b421-4f2424602a32 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:24.133962 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c3f90cfc-6b6b-471a-b421-4f2424602a32 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:24.135042 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c3f90cfc-6b6b-471a-b421-4f2424602a32 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:24.135690 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c3f90cfc-6b6b-471a-b421-4f2424602a32 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:24.136302 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c3f90cfc-6b6b-471a-b421-4f2424602a32 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:24.154922 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:40:24.232553 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c3f90cfc-6b6b-471a-b421-4f2424602a32 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:24.241599 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c3f90cfc-6b6b-471a-b421-4f2424602a32 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:24.244139 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c3f90cfc-6b6b-471a-b421-4f2424602a32 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:24.250896 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c3f90cfc-6b6b-471a-b421-4f2424602a32 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1537 microversion: 2.91 time: 0.129334 Oct 17 13:40:24.258683 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 837/1716] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:40:24 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1537 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:40:24.386581 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-63cceb54-ec66-4a40-a1f7-9296ba0ba883 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:24.387352 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-63cceb54-ec66-4a40-a1f7-9296ba0ba883 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] [instance: 8938a16d-a198-46b1-92aa-880f0cc290ba] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:24.394147 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-63cceb54-ec66-4a40-a1f7-9296ba0ba883 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:24.394776 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-63cceb54-ec66-4a40-a1f7-9296ba0ba883 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:24.395297 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-63cceb54-ec66-4a40-a1f7-9296ba0ba883 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:24.396139 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-63cceb54-ec66-4a40-a1f7-9296ba0ba883 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:24.396617 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-63cceb54-ec66-4a40-a1f7-9296ba0ba883 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:24.397029 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-63cceb54-ec66-4a40-a1f7-9296ba0ba883 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:24.545020 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-63cceb54-ec66-4a40-a1f7-9296ba0ba883 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:24.553907 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-63cceb54-ec66-4a40-a1f7-9296ba0ba883 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers/8938a16d-a198-46b1-92aa-880f0cc290ba" status: 200 len: 1321 microversion: 2.1 time: 0.172271 Oct 17 13:40:24.555233 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 880/1717] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:24 2022] GET /compute/v2.1/servers/8938a16d-a198-46b1-92aa-880f0cc290ba => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:24.623074 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fc691b1e-ec89-4651-afe5-17d8ae449a93 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:24.628122 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-fc691b1e-ec89-4651-afe5-17d8ae449a93 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: fd365dc4-44c6-4a00-971e-2699762ab41f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:24.638954 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fc691b1e-ec89-4651-afe5-17d8ae449a93 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:24.639576 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fc691b1e-ec89-4651-afe5-17d8ae449a93 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:24.640343 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fc691b1e-ec89-4651-afe5-17d8ae449a93 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:24.641228 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fc691b1e-ec89-4651-afe5-17d8ae449a93 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:24.641775 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fc691b1e-ec89-4651-afe5-17d8ae449a93 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:24.642384 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fc691b1e-ec89-4651-afe5-17d8ae449a93 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:24.769473 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4bd86bfa-a723-46d4-ab6a-34bfa44d5731 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:24.771014 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4bd86bfa-a723-46d4-ab6a-34bfa44d5731 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: f47e3dcd-6e44-411d-bf0c-3da0abda9f87] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:24.777636 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4bd86bfa-a723-46d4-ab6a-34bfa44d5731 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:24.778126 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4bd86bfa-a723-46d4-ab6a-34bfa44d5731 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:24.778562 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4bd86bfa-a723-46d4-ab6a-34bfa44d5731 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:24.779311 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4bd86bfa-a723-46d4-ab6a-34bfa44d5731 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:24.779955 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4bd86bfa-a723-46d4-ab6a-34bfa44d5731 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:24.780378 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4bd86bfa-a723-46d4-ab6a-34bfa44d5731 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:24.803359 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:40:25.310934 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fc691b1e-ec89-4651-afe5-17d8ae449a93 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:25.345746 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fc691b1e-ec89-4651-afe5-17d8ae449a93 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f" status: 200 len: 1390 microversion: 2.1 time: 0.725601 Oct 17 13:40:25.347499 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 838/1718] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:24 2022] GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f => generated 1390 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:25.355469 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4bc6ec5c-0388-433e-a041-b60e22a60201 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:25.356536 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4bc6ec5c-0388-433e-a041-b60e22a60201 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] [instance: b8d15c7c-7a1f-43e0-9c41-302172f31ca0] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:25.372097 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4bc6ec5c-0388-433e-a041-b60e22a60201 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:25.373630 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4bc6ec5c-0388-433e-a041-b60e22a60201 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:25.375537 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4bc6ec5c-0388-433e-a041-b60e22a60201 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:25.376374 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4bc6ec5c-0388-433e-a041-b60e22a60201 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:25.376865 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4bc6ec5c-0388-433e-a041-b60e22a60201 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:25.377297 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4bc6ec5c-0388-433e-a041-b60e22a60201 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:25.380496 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4bd86bfa-a723-46d4-ab6a-34bfa44d5731 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:25.395143 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4bd86bfa-a723-46d4-ab6a-34bfa44d5731 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/f47e3dcd-6e44-411d-bf0c-3da0abda9f87" status: 200 len: 1470 microversion: 2.1 time: 0.629473 Oct 17 13:40:25.398711 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 881/1719] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:24 2022] GET /compute/v2.1/servers/f47e3dcd-6e44-411d-bf0c-3da0abda9f87 => generated 1470 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:25.406671 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-57885e68-7c7e-422e-a5a6-e3520856b82e tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd5225310>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:25.487145 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-57885e68-7c7e-422e-a5a6-e3520856b82e tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/a8625a43-cc13-4579-b0e9-3ebd2183a277" status: 200 len: 1413 microversion: 2.1 time: 0.086106 Oct 17 13:40:25.489006 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 882/1720] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:40:25 2022] GET /compute/v2.1/images/a8625a43-cc13-4579-b0e9-3ebd2183a277 => generated 1413 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:25.498169 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-7a26e4c3-290f-4554-8b58-5e6ea01b6fac req-55117644-71c6-49a1-9f9c-ef722d99661b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8d15c7c-7a1f-43e0-9c41-302172f31ca0", "name": "network-vif-deleted", "tag": "6b4af2c6-531c-4352-bbe4-6c4df4387bbf"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:25.498589 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4bc6ec5c-0388-433e-a041-b60e22a60201 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e5309bf84f4aafa9a17604f8452366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6642f912ba0467bac461bc7aedbf940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:25.508188 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4bc6ec5c-0388-433e-a041-b60e22a60201 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] 10.222.0.79 "GET /compute/v2.1/servers/b8d15c7c-7a1f-43e0-9c41-302172f31ca0" status: 200 len: 1327 microversion: 2.1 time: 0.159101 Oct 17 13:40:25.508780 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 839/1721] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:25 2022] GET /compute/v2.1/servers/b8d15c7c-7a1f-43e0-9c41-302172f31ca0 => generated 1327 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:25.516577 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7c5862a0-8cc1-4112-bac4-47667e03c24b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:25.517390 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7c5862a0-8cc1-4112-bac4-47667e03c24b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9c6b4ed2-b111-41b0-9679-b66d386834b9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:25.522273 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-7a26e4c3-290f-4554-8b58-5e6ea01b6fac req-55117644-71c6-49a1-9f9c-ef722d99661b service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:25.523065 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-7a26e4c3-290f-4554-8b58-5e6ea01b6fac req-55117644-71c6-49a1-9f9c-ef722d99661b service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:25.524610 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-7a26e4c3-290f-4554-8b58-5e6ea01b6fac req-55117644-71c6-49a1-9f9c-ef722d99661b service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:25.530281 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7c5862a0-8cc1-4112-bac4-47667e03c24b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:25.530780 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7c5862a0-8cc1-4112-bac4-47667e03c24b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:25.531587 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7c5862a0-8cc1-4112-bac4-47667e03c24b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:25.531951 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7c5862a0-8cc1-4112-bac4-47667e03c24b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:25.532544 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7c5862a0-8cc1-4112-bac4-47667e03c24b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:25.532972 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7c5862a0-8cc1-4112-bac4-47667e03c24b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:25.546134 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-7a26e4c3-290f-4554-8b58-5e6ea01b6fac req-55117644-71c6-49a1-9f9c-ef722d99661b service nova] Creating event network-vif-deleted:6b4af2c6-531c-4352-bbe4-6c4df4387bbf for instance b8d15c7c-7a1f-43e0-9c41-302172f31ca0 on n-h2-854247-14 Oct 17 13:40:25.552455 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-7a26e4c3-290f-4554-8b58-5e6ea01b6fac req-55117644-71c6-49a1-9f9c-ef722d99661b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061975 Oct 17 13:40:25.555267 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 883/1722] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:40:25.568670 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-564e6d7f-60d5-4712-b598-162685404e91 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:25.577299 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-564e6d7f-60d5-4712-b598-162685404e91 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:25.588127 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-564e6d7f-60d5-4712-b598-162685404e91 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:25.589068 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-564e6d7f-60d5-4712-b598-162685404e91 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:25.589711 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-564e6d7f-60d5-4712-b598-162685404e91 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:25.590434 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-564e6d7f-60d5-4712-b598-162685404e91 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:25.590897 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-564e6d7f-60d5-4712-b598-162685404e91 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:25.591371 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-564e6d7f-60d5-4712-b598-162685404e91 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:25.743001 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-564e6d7f-60d5-4712-b598-162685404e91 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:25.757919 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-564e6d7f-60d5-4712-b598-162685404e91 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:25.761479 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-564e6d7f-60d5-4712-b598-162685404e91 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:25.786044 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-564e6d7f-60d5-4712-b598-162685404e91 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1537 microversion: 2.91 time: 0.225840 Oct 17 13:40:25.787458 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 884/1723] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:40:25 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1537 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:40:25.793494 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-67dd838c-de67-481a-b77b-92ea3ac8923a tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:25.800116 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-67dd838c-de67-481a-b77b-92ea3ac8923a tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] [instance: 8938a16d-a198-46b1-92aa-880f0cc290ba] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:25.817170 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-67dd838c-de67-481a-b77b-92ea3ac8923a tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:25.818042 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-67dd838c-de67-481a-b77b-92ea3ac8923a tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:25.819697 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-67dd838c-de67-481a-b77b-92ea3ac8923a tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:25.820614 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-67dd838c-de67-481a-b77b-92ea3ac8923a tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:25.823536 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-67dd838c-de67-481a-b77b-92ea3ac8923a tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:25.824207 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-67dd838c-de67-481a-b77b-92ea3ac8923a tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:26.132167 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7c5862a0-8cc1-4112-bac4-47667e03c24b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:26.147637 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7c5862a0-8cc1-4112-bac4-47667e03c24b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9" status: 200 len: 1317 microversion: 2.1 time: 0.631473 Oct 17 13:40:26.155551 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 840/1724] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:25 2022] GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9 => generated 1317 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:26.373497 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f28312c8-69ae-4b24-abb3-d2e250d3877a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:26.379302 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f28312c8-69ae-4b24-abb3-d2e250d3877a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: fd365dc4-44c6-4a00-971e-2699762ab41f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:26.388104 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f28312c8-69ae-4b24-abb3-d2e250d3877a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:26.392334 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f28312c8-69ae-4b24-abb3-d2e250d3877a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:26.395041 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f28312c8-69ae-4b24-abb3-d2e250d3877a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:26.397102 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f28312c8-69ae-4b24-abb3-d2e250d3877a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:26.398063 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f28312c8-69ae-4b24-abb3-d2e250d3877a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:26.404598 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f28312c8-69ae-4b24-abb3-d2e250d3877a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:26.680271 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-67dd838c-de67-481a-b77b-92ea3ac8923a tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:26.691476 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-67dd838c-de67-481a-b77b-92ea3ac8923a tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers/8938a16d-a198-46b1-92aa-880f0cc290ba" status: 200 len: 1321 microversion: 2.1 time: 0.901418 Oct 17 13:40:26.700780 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 885/1725] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:25 2022] GET /compute/v2.1/servers/8938a16d-a198-46b1-92aa-880f0cc290ba => generated 1321 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:26.706507 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-707d144b-ec39-455d-8d22-ae2da1d1bed4 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:26.707121 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-707d144b-ec39-455d-8d22-ae2da1d1bed4 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: f47e3dcd-6e44-411d-bf0c-3da0abda9f87] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:26.709168 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=97,nova_api:UPDATE=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:40:26.723203 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-707d144b-ec39-455d-8d22-ae2da1d1bed4 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:26.729953 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-707d144b-ec39-455d-8d22-ae2da1d1bed4 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:26.730674 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-707d144b-ec39-455d-8d22-ae2da1d1bed4 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:26.731751 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-707d144b-ec39-455d-8d22-ae2da1d1bed4 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:26.732361 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-707d144b-ec39-455d-8d22-ae2da1d1bed4 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:26.732964 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-707d144b-ec39-455d-8d22-ae2da1d1bed4 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:26.874180 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f28312c8-69ae-4b24-abb3-d2e250d3877a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:26.883303 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f28312c8-69ae-4b24-abb3-d2e250d3877a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f" status: 200 len: 1390 microversion: 2.1 time: 0.513653 Oct 17 13:40:26.907863 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 841/1726] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:26 2022] GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f => generated 1390 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:26.918187 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e2ce2912-94e2-4a10-84bb-34bd36980cbd tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd50a1f70>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:26.997969 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e2ce2912-94e2-4a10-84bb-34bd36980cbd tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/a8625a43-cc13-4579-b0e9-3ebd2183a277" status: 200 len: 1413 microversion: 2.1 time: 0.088398 Oct 17 13:40:27.000816 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 842/1727] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:40:26 2022] GET /compute/v2.1/images/a8625a43-cc13-4579-b0e9-3ebd2183a277 => generated 1413 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:27.005861 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8e8cb7dd-d81e-43cc-b467-5cd222ac63bd tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:27.020188 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8e8cb7dd-d81e-43cc-b467-5cd222ac63bd tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] [instance: b8d15c7c-7a1f-43e0-9c41-302172f31ca0] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:27.027570 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8e8cb7dd-d81e-43cc-b467-5cd222ac63bd tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:27.028450 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8e8cb7dd-d81e-43cc-b467-5cd222ac63bd tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:27.029115 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8e8cb7dd-d81e-43cc-b467-5cd222ac63bd tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:27.030039 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8e8cb7dd-d81e-43cc-b467-5cd222ac63bd tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:27.030706 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8e8cb7dd-d81e-43cc-b467-5cd222ac63bd tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:27.031353 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8e8cb7dd-d81e-43cc-b467-5cd222ac63bd tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:27.101297 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8e8cb7dd-d81e-43cc-b467-5cd222ac63bd tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:27.107989 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8e8cb7dd-d81e-43cc-b467-5cd222ac63bd tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:27.108862 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8e8cb7dd-d81e-43cc-b467-5cd222ac63bd tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:27.109551 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-8e8cb7dd-d81e-43cc-b467-5cd222ac63bd tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lazy-loading 'fault' on Instance uuid b8d15c7c-7a1f-43e0-9c41-302172f31ca0 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:40:27.246126 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8e8cb7dd-d81e-43cc-b467-5cd222ac63bd tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e5309bf84f4aafa9a17604f8452366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6642f912ba0467bac461bc7aedbf940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:27.254606 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8e8cb7dd-d81e-43cc-b467-5cd222ac63bd tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] 10.222.0.79 "GET /compute/v2.1/servers/b8d15c7c-7a1f-43e0-9c41-302172f31ca0" status: 200 len: 1332 microversion: 2.1 time: 0.252456 Oct 17 13:40:27.261484 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 843/1728] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:27 2022] GET /compute/v2.1/servers/b8d15c7c-7a1f-43e0-9c41-302172f31ca0 => generated 1332 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:27.275268 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0b12eb3b-f31f-4eb4-89df-02f3dabbd7e1 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:27.276447 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0b12eb3b-f31f-4eb4-89df-02f3dabbd7e1 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:27.286532 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0b12eb3b-f31f-4eb4-89df-02f3dabbd7e1 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:27.287482 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0b12eb3b-f31f-4eb4-89df-02f3dabbd7e1 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:27.288152 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0b12eb3b-f31f-4eb4-89df-02f3dabbd7e1 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:27.289098 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0b12eb3b-f31f-4eb4-89df-02f3dabbd7e1 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:27.289777 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0b12eb3b-f31f-4eb4-89df-02f3dabbd7e1 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:27.290455 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0b12eb3b-f31f-4eb4-89df-02f3dabbd7e1 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:27.489038 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0b12eb3b-f31f-4eb4-89df-02f3dabbd7e1 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:27.509731 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-707d144b-ec39-455d-8d22-ae2da1d1bed4 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:27.531108 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-707d144b-ec39-455d-8d22-ae2da1d1bed4 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/f47e3dcd-6e44-411d-bf0c-3da0abda9f87" status: 200 len: 1470 microversion: 2.1 time: 0.819262 Oct 17 13:40:27.532304 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 886/1729] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:26 2022] GET /compute/v2.1/servers/f47e3dcd-6e44-411d-bf0c-3da0abda9f87 => generated 1470 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:27.555417 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0b12eb3b-f31f-4eb4-89df-02f3dabbd7e1 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:27.557856 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0b12eb3b-f31f-4eb4-89df-02f3dabbd7e1 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:27.568881 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-5e9e5682-546d-4adc-98e2-1b9964655943 req-e71b6d1c-464c-4ad0-9038-38a7dbccabea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d30452eb-38cd-413a-9369-f60aad1d31bb", "name": "network-vif-plugged", "status": "completed", "tag": "76105cf8-6f9e-478d-8c19-ca94faa330f7"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:27.578864 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0b12eb3b-f31f-4eb4-89df-02f3dabbd7e1 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1537 microversion: 2.91 time: 0.315839 Oct 17 13:40:27.579532 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 844/1730] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:40:27 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1537 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:40:27.595228 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a70dd7f7-b2fe-4b1f-a144-882b0e2afda3 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:27.596200 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a70dd7f7-b2fe-4b1f-a144-882b0e2afda3 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9c6b4ed2-b111-41b0-9679-b66d386834b9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:27.611463 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a70dd7f7-b2fe-4b1f-a144-882b0e2afda3 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:27.622704 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-5e9e5682-546d-4adc-98e2-1b9964655943 req-e71b6d1c-464c-4ad0-9038-38a7dbccabea service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:27.624004 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a70dd7f7-b2fe-4b1f-a144-882b0e2afda3 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:27.624466 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a70dd7f7-b2fe-4b1f-a144-882b0e2afda3 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:27.625007 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-5e9e5682-546d-4adc-98e2-1b9964655943 req-e71b6d1c-464c-4ad0-9038-38a7dbccabea service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:27.625216 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a70dd7f7-b2fe-4b1f-a144-882b0e2afda3 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:27.625674 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a70dd7f7-b2fe-4b1f-a144-882b0e2afda3 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:27.625864 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-5e9e5682-546d-4adc-98e2-1b9964655943 req-e71b6d1c-464c-4ad0-9038-38a7dbccabea service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:27.626094 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a70dd7f7-b2fe-4b1f-a144-882b0e2afda3 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:27.660325 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-5e9e5682-546d-4adc-98e2-1b9964655943 req-e71b6d1c-464c-4ad0-9038-38a7dbccabea service nova] Creating event network-vif-plugged:76105cf8-6f9e-478d-8c19-ca94faa330f7 for instance d30452eb-38cd-413a-9369-f60aad1d31bb on n-h1-854247-14 Oct 17 13:40:27.669424 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-5e9e5682-546d-4adc-98e2-1b9964655943 req-e71b6d1c-464c-4ad0-9038-38a7dbccabea service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128639 Oct 17 13:40:27.672267 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 887/1731] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:40:27.684380 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-f2072c3c-7184-409c-9631-bad0bac001cb req-b98acf9e-d2cd-4619-aed5-7a42742e301d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f47e3dcd-6e44-411d-bf0c-3da0abda9f87", "name": "network-vif-deleted", "tag": "7497c35e-755d-4147-af48-6844f85aeea6"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:27.713791 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-f2072c3c-7184-409c-9631-bad0bac001cb req-b98acf9e-d2cd-4619-aed5-7a42742e301d service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:27.714867 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-f2072c3c-7184-409c-9631-bad0bac001cb req-b98acf9e-d2cd-4619-aed5-7a42742e301d service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:27.720470 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-f2072c3c-7184-409c-9631-bad0bac001cb req-b98acf9e-d2cd-4619-aed5-7a42742e301d service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:27.743734 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-f2072c3c-7184-409c-9631-bad0bac001cb req-b98acf9e-d2cd-4619-aed5-7a42742e301d service nova] Creating event network-vif-deleted:7497c35e-755d-4147-af48-6844f85aeea6 for instance f47e3dcd-6e44-411d-bf0c-3da0abda9f87 on n-h2-854247-14 Oct 17 13:40:27.754894 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-f2072c3c-7184-409c-9631-bad0bac001cb req-b98acf9e-d2cd-4619-aed5-7a42742e301d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080589 Oct 17 13:40:27.758186 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 888/1732] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:40:27.773933 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0559167f-5bad-4f56-ada4-d454fe13a72e tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:27.776220 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0559167f-5bad-4f56-ada4-d454fe13a72e tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] [instance: 8938a16d-a198-46b1-92aa-880f0cc290ba] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:27.785652 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0559167f-5bad-4f56-ada4-d454fe13a72e tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:27.788032 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0559167f-5bad-4f56-ada4-d454fe13a72e tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:27.789117 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0559167f-5bad-4f56-ada4-d454fe13a72e tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:27.793264 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0559167f-5bad-4f56-ada4-d454fe13a72e tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:27.795837 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0559167f-5bad-4f56-ada4-d454fe13a72e tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:27.798274 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0559167f-5bad-4f56-ada4-d454fe13a72e tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:28.335777 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a70dd7f7-b2fe-4b1f-a144-882b0e2afda3 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:28.347929 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a70dd7f7-b2fe-4b1f-a144-882b0e2afda3 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9" status: 200 len: 1317 microversion: 2.1 time: 0.767017 Oct 17 13:40:28.363581 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 845/1733] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:27 2022] GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9 => generated 1317 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:28.376768 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-390253a0-1ec3-48bc-b949-7717bcd3b17a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:28.377773 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-390253a0-1ec3-48bc-b949-7717bcd3b17a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: fd365dc4-44c6-4a00-971e-2699762ab41f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:28.386512 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-390253a0-1ec3-48bc-b949-7717bcd3b17a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:28.387615 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-390253a0-1ec3-48bc-b949-7717bcd3b17a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:28.388280 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-390253a0-1ec3-48bc-b949-7717bcd3b17a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:28.389857 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-390253a0-1ec3-48bc-b949-7717bcd3b17a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:28.390665 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-390253a0-1ec3-48bc-b949-7717bcd3b17a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:28.391849 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-390253a0-1ec3-48bc-b949-7717bcd3b17a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:28.650950 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0559167f-5bad-4f56-ada4-d454fe13a72e tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:28.666312 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0559167f-5bad-4f56-ada4-d454fe13a72e tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers/8938a16d-a198-46b1-92aa-880f0cc290ba" status: 200 len: 1321 microversion: 2.1 time: 0.904723 Oct 17 13:40:28.667139 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 889/1734] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:27 2022] GET /compute/v2.1/servers/8938a16d-a198-46b1-92aa-880f0cc290ba => generated 1321 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:28.678754 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f91f7baf-ef6d-4750-acad-c53b419d4167 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd5391040>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:28.803106 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f91f7baf-ef6d-4750-acad-c53b419d4167 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/a8625a43-cc13-4579-b0e9-3ebd2183a277" status: 200 len: 1413 microversion: 2.1 time: 0.131561 Oct 17 13:40:28.804098 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 890/1735] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:40:28 2022] GET /compute/v2.1/images/a8625a43-cc13-4579-b0e9-3ebd2183a277 => generated 1413 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:28.809886 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-06a09891-acf8-4af9-baac-d12cacbb30d4 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:28.811223 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-06a09891-acf8-4af9-baac-d12cacbb30d4 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] [instance: b8d15c7c-7a1f-43e0-9c41-302172f31ca0] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:28.821417 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-06a09891-acf8-4af9-baac-d12cacbb30d4 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:28.822293 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-06a09891-acf8-4af9-baac-d12cacbb30d4 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:28.822989 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-06a09891-acf8-4af9-baac-d12cacbb30d4 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:28.824516 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-06a09891-acf8-4af9-baac-d12cacbb30d4 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:28.826149 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-06a09891-acf8-4af9-baac-d12cacbb30d4 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:28.826899 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-06a09891-acf8-4af9-baac-d12cacbb30d4 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:28.861229 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-06a09891-acf8-4af9-baac-d12cacbb30d4 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] HTTP exception thrown: Instance b8d15c7c-7a1f-43e0-9c41-302172f31ca0 could not be found. Oct 17 13:40:28.868761 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-06a09891-acf8-4af9-baac-d12cacbb30d4 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Request method failure captured: Oct 17 13:40:28.868761 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/b8d15c7c-7a1f-43e0-9c41-302172f31ca0 HTTP/1.1 Oct 17 13:40:28.868761 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:40:28.868761 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:40:28.868761 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:40:28.868761 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:40:28.868761 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:40:28.868761 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:40:28.868761 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:40:28.868761 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:40:28.868761 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVqHDKZK0UDMC0buxb2LPnPqhcxaOM5Ncau5t5zHaLs3hJe3As3bsndaDotc7dMA4uoDNfPdoM5-KEV_13uzeXdpQ-rfept5XJeIaIyRo87ziVzoIbJq7rkr4g_FP_T2VHcRq3HnLytozEnidKSlTrA28ZjP3r2l4VW0UXSwZIwrHAY Oct 17 13:40:28.868761 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:40:28.868761 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:40:28.868761 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:40:28.868761 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:40:28.868761 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:40:28.868761 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:40:28.868761 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: d6642f912ba0467bac461bc7aedbf940 Oct 17 13:40:28.868761 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-VolumesAdminNegativeTest-1185171622 Oct 17 13:40:28.868761 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:40:28.868761 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:40:28.870405 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d6642f912ba0467bac461bc7aedbf940"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d6642f912ba0467bac461bc7aedbf940"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d6642f912ba0467bac461bc7aedbf940"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d6642f912ba0467bac461bc7aedbf940", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:40:28.870405 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-VolumesAdminNegativeTest-1185171622 Oct 17 13:40:28.870405 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: d6642f912ba0467bac461bc7aedbf940 Oct 17 13:40:28.870405 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1185171622 Oct 17 13:40:28.870405 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-VolumesAdminNegativeTest-1185171622-project Oct 17 13:40:28.870405 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:40:28.870405 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:40:28.870405 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: e6e5309bf84f4aafa9a17604f8452366 Oct 17 13:40:28.870405 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-VolumesAdminNegativeTest-1185171622-project Oct 17 13:40:28.870405 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:40:28.870405 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance b8d15c7c-7a1f-43e0-9c41-302172f31ca0 could not be found. Oct 17 13:40:28.870405 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'b8d15c7c-7a1f-43e0-9c41-302172f31ca0'} Oct 17 13:40:28.871330 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:40:28.871330 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:40:28.871330 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:40:28.871330 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:40:28.871330 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:40:28.871330 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:40:28.871330 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:40:28.871330 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:40:28.871330 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:40:28.871330 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:40:28.871330 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8d15c7c-7a1f-43e0-9c41-302172f31ca0 could not be found. Oct 17 13:40:28.871330 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:40:28.871330 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:40:28.871330 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:40:28.871330 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:40:28.871330 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:40:28.871330 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:40:28.871330 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:40:28.871330 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:40:28.871330 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:40:28.881094 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:40:28.881094 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:40:28.881094 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:40:28.881094 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:40:28.881094 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:40:28.881094 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:40:28.881094 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:40:28.881094 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8d15c7c-7a1f-43e0-9c41-302172f31ca0 could not be found. Oct 17 13:40:28.881094 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:40:28.881094 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:40:28.881094 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:40:28.881094 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:40:28.881094 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:40:28.881094 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:40:28.881094 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:40:28.881094 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:40:28.881094 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8d15c7c-7a1f-43e0-9c41-302172f31ca0 could not be found. Oct 17 13:40:28.881094 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:40:28.883897 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-06a09891-acf8-4af9-baac-d12cacbb30d4 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Returning 404 to user: Instance b8d15c7c-7a1f-43e0-9c41-302172f31ca0 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:40:28.883897 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-06a09891-acf8-4af9-baac-d12cacbb30d4 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] 10.222.0.79 "GET /compute/v2.1/servers/b8d15c7c-7a1f-43e0-9c41-302172f31ca0" status: 404 len: 111 microversion: 2.1 time: 0.068479 Oct 17 13:40:28.883897 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 891/1736] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:28 2022] GET /compute/v2.1/servers/b8d15c7c-7a1f-43e0-9c41-302172f31ca0 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:40:28.899579 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ad77f838-0b65-4faf-a607-588572aa238e tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:28.902076 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ad77f838-0b65-4faf-a607-588572aa238e tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: f47e3dcd-6e44-411d-bf0c-3da0abda9f87] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:28.926486 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ad77f838-0b65-4faf-a607-588572aa238e tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:28.927487 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ad77f838-0b65-4faf-a607-588572aa238e tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:28.928582 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ad77f838-0b65-4faf-a607-588572aa238e tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:28.930188 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ad77f838-0b65-4faf-a607-588572aa238e tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:28.931108 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ad77f838-0b65-4faf-a607-588572aa238e tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:28.932361 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ad77f838-0b65-4faf-a607-588572aa238e tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:28.955935 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-ad77f838-0b65-4faf-a607-588572aa238e tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] HTTP exception thrown: Instance f47e3dcd-6e44-411d-bf0c-3da0abda9f87 could not be found. Oct 17 13:40:28.958998 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ad77f838-0b65-4faf-a607-588572aa238e tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Request method failure captured: Oct 17 13:40:28.958998 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/f47e3dcd-6e44-411d-bf0c-3da0abda9f87 HTTP/1.1 Oct 17 13:40:28.958998 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:40:28.958998 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:40:28.958998 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:40:28.958998 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:40:28.958998 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:40:28.958998 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:40:28.958998 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:40:28.958998 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:40:28.958998 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVq3QG91bsbrdujMx0w2rwLFi6GpzE732UrjJvuSTfBVExjcgLnF2M2z5qHJG62FSG1Pm6TSVJ3G0JMZXM4x5T8PL2EiMmH1zEj8FFbxs0eLY-dCHBBSOlmbkA3M_U3rDAsaCdweKlbyRuXYwRKNtgqMKG1bmX8eKrZqh0UiHb1LwEE Oct 17 13:40:28.958998 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:40:28.958998 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:40:28.958998 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:40:28.958998 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:40:28.958998 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:40:28.958998 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:40:28.958998 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 76eaaef0f6234db690a123c54cea5a6d Oct 17 13:40:28.958998 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServersAdminTestJSON-948985186 Oct 17 13:40:28.958998 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:40:28.958998 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:40:28.960670 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/76eaaef0f6234db690a123c54cea5a6d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/76eaaef0f6234db690a123c54cea5a6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/76eaaef0f6234db690a123c54cea5a6d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_76eaaef0f6234db690a123c54cea5a6d", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:40:28.960670 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServersAdminTestJSON-948985186 Oct 17 13:40:28.960670 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 76eaaef0f6234db690a123c54cea5a6d Oct 17 13:40:28.960670 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServersAdminTestJSON-948985186 Oct 17 13:40:28.960670 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServersAdminTestJSON-948985186-project Oct 17 13:40:28.960670 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:40:28.960670 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:40:28.960670 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 69bd293284874ca9ba415770de7b6965 Oct 17 13:40:28.960670 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServersAdminTestJSON-948985186-project Oct 17 13:40:28.960670 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:40:28.960670 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance f47e3dcd-6e44-411d-bf0c-3da0abda9f87 could not be found. Oct 17 13:40:28.960670 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'f47e3dcd-6e44-411d-bf0c-3da0abda9f87'} Oct 17 13:40:28.961502 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:40:28.961502 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:40:28.961502 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:40:28.961502 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:40:28.961502 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:40:28.961502 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:40:28.961502 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:40:28.961502 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:40:28.961502 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:40:28.961502 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:40:28.961502 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f47e3dcd-6e44-411d-bf0c-3da0abda9f87 could not be found. Oct 17 13:40:28.961502 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:40:28.961502 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:40:28.961502 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:40:28.961502 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:40:28.961502 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:40:28.961502 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:40:28.961502 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:40:28.961502 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:40:28.961502 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:40:28.964828 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:40:28.964828 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:40:28.964828 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:40:28.964828 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:40:28.964828 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:40:28.964828 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:40:28.964828 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:40:28.964828 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f47e3dcd-6e44-411d-bf0c-3da0abda9f87 could not be found. Oct 17 13:40:28.964828 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:40:28.964828 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:40:28.964828 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:40:28.964828 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:40:28.964828 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:40:28.964828 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:40:28.964828 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:40:28.964828 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:40:28.964828 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f47e3dcd-6e44-411d-bf0c-3da0abda9f87 could not be found. Oct 17 13:40:28.964828 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:40:28.970310 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ad77f838-0b65-4faf-a607-588572aa238e tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Returning 404 to user: Instance f47e3dcd-6e44-411d-bf0c-3da0abda9f87 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:40:28.976169 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ad77f838-0b65-4faf-a607-588572aa238e tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/f47e3dcd-6e44-411d-bf0c-3da0abda9f87" status: 404 len: 111 microversion: 2.1 time: 0.089137 Oct 17 13:40:28.977631 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 892/1737] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:28 2022] GET /compute/v2.1/servers/f47e3dcd-6e44-411d-bf0c-3da0abda9f87 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:40:28.985708 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bd8ce64b-3bbd-499d-a57e-6f7e81bc1283 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:28.986681 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-bd8ce64b-3bbd-499d-a57e-6f7e81bc1283 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:28.995297 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bd8ce64b-3bbd-499d-a57e-6f7e81bc1283 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:28.997301 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bd8ce64b-3bbd-499d-a57e-6f7e81bc1283 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:28.998063 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bd8ce64b-3bbd-499d-a57e-6f7e81bc1283 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:28.999122 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bd8ce64b-3bbd-499d-a57e-6f7e81bc1283 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:29.000475 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bd8ce64b-3bbd-499d-a57e-6f7e81bc1283 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:29.001146 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bd8ce64b-3bbd-499d-a57e-6f7e81bc1283 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:29.154282 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-390253a0-1ec3-48bc-b949-7717bcd3b17a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:29.164929 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-390253a0-1ec3-48bc-b949-7717bcd3b17a tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f" status: 200 len: 1380 microversion: 2.1 time: 0.799889 Oct 17 13:40:29.170268 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 846/1738] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:28 2022] GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f => generated 1380 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:29.189142 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5bf94019-00e5-4391-aeca-013e0dc91cd3 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] Calling method '.version_select at 0x7f7cd4fede50>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:29.190136 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-bd8ce64b-3bbd-499d-a57e-6f7e81bc1283 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:29.202309 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-bd8ce64b-3bbd-499d-a57e-6f7e81bc1283 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:29.204058 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-bd8ce64b-3bbd-499d-a57e-6f7e81bc1283 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:29.209624 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-bd8ce64b-3bbd-499d-a57e-6f7e81bc1283 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1537 microversion: 2.91 time: 0.230551 Oct 17 13:40:29.210585 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 893/1739] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:40:28 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1537 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:40:29.223051 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7dbd3c7f-9852-4614-a6f5-15f4d3b316dc tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:29.228029 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7dbd3c7f-9852-4614-a6f5-15f4d3b316dc tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: ab2b571e-376c-41d3-a778-44bedcaa5467] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:29.240077 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7dbd3c7f-9852-4614-a6f5-15f4d3b316dc tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:29.243263 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7dbd3c7f-9852-4614-a6f5-15f4d3b316dc tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:29.244880 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5bf94019-00e5-4391-aeca-013e0dc91cd3 tempest-VolumesAdminNegativeTest-1185171622 tempest-VolumesAdminNegativeTest-1185171622-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1909150367" status: 202 len: 0 microversion: 2.1 time: 0.070607 Oct 17 13:40:29.245867 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 847/1740] 10.222.0.79 () {58 vars in 1221 bytes} [Mon Oct 17 13:40:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1909150367 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:40:29.246687 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7dbd3c7f-9852-4614-a6f5-15f4d3b316dc tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:29.247886 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7dbd3c7f-9852-4614-a6f5-15f4d3b316dc tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:29.250379 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7dbd3c7f-9852-4614-a6f5-15f4d3b316dc tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:29.250919 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7dbd3c7f-9852-4614-a6f5-15f4d3b316dc tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:29.254850 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2494bb3e-de98-4be1-8e42-08c1a3627a3f tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Calling method '.version_select at 0x7f7cd50a1b80>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:29.262625 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2494bb3e-de98-4be1-8e42-08c1a3627a3f tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:29.265701 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2494bb3e-de98-4be1-8e42-08c1a3627a3f tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:29.268132 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2494bb3e-de98-4be1-8e42-08c1a3627a3f tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:29.293691 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2494bb3e-de98-4be1-8e42-08c1a3627a3f tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] 10.222.0.79 "GET /compute/v2.1/os-migrations" status: 200 len: 2342 microversion: 2.1 time: 0.046016 Oct 17 13:40:29.298373 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 848/1741] 10.222.0.79 () {58 vars in 1143 bytes} [Mon Oct 17 13:40:29 2022] GET /compute/v2.1/os-migrations => generated 2342 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:29.304625 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7dbd3c7f-9852-4614-a6f5-15f4d3b316dc tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: ab2b571e-376c-41d3-a778-44bedcaa5467] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:40:29.317461 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3af752a7-5526-40ad-ac52-8124f8cb3068 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:29.318375 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3af752a7-5526-40ad-ac52-8124f8cb3068 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] [instance: fd365dc4-44c6-4a00-971e-2699762ab41f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:29.333378 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3af752a7-5526-40ad-ac52-8124f8cb3068 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:29.334226 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3af752a7-5526-40ad-ac52-8124f8cb3068 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:29.334589 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3af752a7-5526-40ad-ac52-8124f8cb3068 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:29.335345 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3af752a7-5526-40ad-ac52-8124f8cb3068 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:29.336034 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3af752a7-5526-40ad-ac52-8124f8cb3068 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:29.336710 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3af752a7-5526-40ad-ac52-8124f8cb3068 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:29.449918 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7dbd3c7f-9852-4614-a6f5-15f4d3b316dc tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "DELETE /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467" status: 204 len: 0 microversion: 2.1 time: 0.237220 Oct 17 13:40:29.451737 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 894/1742] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:40:29 2022] DELETE /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:40:29.460679 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a74f40d8-859b-44d9-a5d9-c73d1ba214cb tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:29.462489 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a74f40d8-859b-44d9-a5d9-c73d1ba214cb tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9c6b4ed2-b111-41b0-9679-b66d386834b9] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:29.470273 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a74f40d8-859b-44d9-a5d9-c73d1ba214cb tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:29.470815 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a74f40d8-859b-44d9-a5d9-c73d1ba214cb tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:29.471298 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a74f40d8-859b-44d9-a5d9-c73d1ba214cb tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:29.473548 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a74f40d8-859b-44d9-a5d9-c73d1ba214cb tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:29.473548 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a74f40d8-859b-44d9-a5d9-c73d1ba214cb tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:29.473548 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a74f40d8-859b-44d9-a5d9-c73d1ba214cb tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:29.644399 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3af752a7-5526-40ad-ac52-8124f8cb3068 tempest-LiveMigrationTest-11446358 tempest-LiveMigrationTest-11446358-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f" status: 200 len: 1533 microversion: 2.1 time: 0.330619 Oct 17 13:40:29.648710 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 849/1743] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:29 2022] GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f => generated 1533 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:29.661073 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5463c15b-54e5-4a27-a848-c943002a1c1e tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:29.662025 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5463c15b-54e5-4a27-a848-c943002a1c1e tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: ab2b571e-376c-41d3-a778-44bedcaa5467] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:29.683294 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5463c15b-54e5-4a27-a848-c943002a1c1e tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:29.684219 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5463c15b-54e5-4a27-a848-c943002a1c1e tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:29.685222 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5463c15b-54e5-4a27-a848-c943002a1c1e tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:29.686474 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5463c15b-54e5-4a27-a848-c943002a1c1e tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:29.687133 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5463c15b-54e5-4a27-a848-c943002a1c1e tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:29.688128 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5463c15b-54e5-4a27-a848-c943002a1c1e tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:29.853252 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a74f40d8-859b-44d9-a5d9-c73d1ba214cb tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:29.870108 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a74f40d8-859b-44d9-a5d9-c73d1ba214cb tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9" status: 200 len: 1317 microversion: 2.1 time: 0.415762 Oct 17 13:40:29.872309 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 895/1744] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:29 2022] GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9 => generated 1317 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:29.883871 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6005f61e-7439-494e-9011-ef02582e3ab5 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:29.885457 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6005f61e-7439-494e-9011-ef02582e3ab5 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: fd365dc4-44c6-4a00-971e-2699762ab41f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:29.895514 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6005f61e-7439-494e-9011-ef02582e3ab5 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:29.897188 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6005f61e-7439-494e-9011-ef02582e3ab5 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:29.898017 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6005f61e-7439-494e-9011-ef02582e3ab5 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:29.899016 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6005f61e-7439-494e-9011-ef02582e3ab5 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:29.900383 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6005f61e-7439-494e-9011-ef02582e3ab5 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:29.901043 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6005f61e-7439-494e-9011-ef02582e3ab5 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:29.936149 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6005f61e-7439-494e-9011-ef02582e3ab5 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: fd365dc4-44c6-4a00-971e-2699762ab41f] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:40:29.939338 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5463c15b-54e5-4a27-a848-c943002a1c1e tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:29.948582 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5463c15b-54e5-4a27-a848-c943002a1c1e tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467" status: 200 len: 1470 microversion: 2.1 time: 0.298311 Oct 17 13:40:29.949528 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 850/1745] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:29 2022] GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467 => generated 1470 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:29.955004 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a32538f0-6404-44c1-b336-721cd5e5dffe tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:29.955822 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a32538f0-6404-44c1-b336-721cd5e5dffe tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] [instance: 8938a16d-a198-46b1-92aa-880f0cc290ba] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:29.963249 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a32538f0-6404-44c1-b336-721cd5e5dffe tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:29.964003 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a32538f0-6404-44c1-b336-721cd5e5dffe tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:29.964657 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a32538f0-6404-44c1-b336-721cd5e5dffe tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:29.965523 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a32538f0-6404-44c1-b336-721cd5e5dffe tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:29.966121 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a32538f0-6404-44c1-b336-721cd5e5dffe tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:29.966731 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a32538f0-6404-44c1-b336-721cd5e5dffe tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:30.132614 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6005f61e-7439-494e-9011-ef02582e3ab5 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "DELETE /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f" status: 204 len: 0 microversion: 2.1 time: 0.254405 Oct 17 13:40:30.138297 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 896/1746] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:40:29 2022] DELETE /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:40:30.150930 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-ac97d392-3159-41de-b53f-75ca6543e5e7 req-750303b9-2d21-41fe-a7de-786e16570f5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d4188da-b0f7-4d97-952b-acebaa48f185", "name": "network-vif-plugged", "status": "completed", "tag": "5aa937a2-940e-4a32-973c-4f39608f3902"}, {"server_uuid": "b05d2fa3-d231-4842-a47b-26aa317ccaa3", "name": "network-vif-plugged", "status": "completed", "tag": "e6d816ac-9228-42e4-83a0-1b8d95fc766f"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:30.177816 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-ac97d392-3159-41de-b53f-75ca6543e5e7 req-750303b9-2d21-41fe-a7de-786e16570f5a service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:30.180340 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-ac97d392-3159-41de-b53f-75ca6543e5e7 req-750303b9-2d21-41fe-a7de-786e16570f5a service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:30.181075 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-ac97d392-3159-41de-b53f-75ca6543e5e7 req-750303b9-2d21-41fe-a7de-786e16570f5a service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:30.214861 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-ac97d392-3159-41de-b53f-75ca6543e5e7 req-750303b9-2d21-41fe-a7de-786e16570f5a service nova] Creating event network-vif-plugged:5aa937a2-940e-4a32-973c-4f39608f3902 for instance 3d4188da-b0f7-4d97-952b-acebaa48f185 on n-h1-854247-14 Oct 17 13:40:30.217378 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-ac97d392-3159-41de-b53f-75ca6543e5e7 req-750303b9-2d21-41fe-a7de-786e16570f5a service nova] Creating event network-vif-plugged:e6d816ac-9228-42e4-83a0-1b8d95fc766f for instance b05d2fa3-d231-4842-a47b-26aa317ccaa3 on n-h1-854247-14 Oct 17 13:40:30.233404 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-ac97d392-3159-41de-b53f-75ca6543e5e7 req-750303b9-2d21-41fe-a7de-786e16570f5a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.091558 Oct 17 13:40:30.236223 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 897/1747] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:40:30 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:40:30.251207 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-09ecf001-1fe7-4a6a-9863-cb4ee7289236 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd522cd30>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:30.330053 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-09ecf001-1fe7-4a6a-9863-cb4ee7289236 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/a8625a43-cc13-4579-b0e9-3ebd2183a277" status: 200 len: 1413 microversion: 2.1 time: 0.090799 Oct 17 13:40:30.338907 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 898/1748] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:40:30 2022] GET /compute/v2.1/images/a8625a43-cc13-4579-b0e9-3ebd2183a277 => generated 1413 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:30.338907 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2d7ce1f3-3e46-40f3-8301-6fd6c0cfc084 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:30.338907 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2d7ce1f3-3e46-40f3-8301-6fd6c0cfc084 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: fd365dc4-44c6-4a00-971e-2699762ab41f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:30.345242 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2d7ce1f3-3e46-40f3-8301-6fd6c0cfc084 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:30.345884 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2d7ce1f3-3e46-40f3-8301-6fd6c0cfc084 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:30.347405 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2d7ce1f3-3e46-40f3-8301-6fd6c0cfc084 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:30.348269 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2d7ce1f3-3e46-40f3-8301-6fd6c0cfc084 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:30.354891 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2d7ce1f3-3e46-40f3-8301-6fd6c0cfc084 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:30.355651 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2d7ce1f3-3e46-40f3-8301-6fd6c0cfc084 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:30.745006 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a32538f0-6404-44c1-b336-721cd5e5dffe tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:30.753875 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a32538f0-6404-44c1-b336-721cd5e5dffe tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers/8938a16d-a198-46b1-92aa-880f0cc290ba" status: 200 len: 1321 microversion: 2.1 time: 0.802504 Oct 17 13:40:30.761668 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 851/1749] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:29 2022] GET /compute/v2.1/servers/8938a16d-a198-46b1-92aa-880f0cc290ba => generated 1321 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:30.771336 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-66735b96-f808-4698-91cf-5f579cc5de1c tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:30.772151 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-66735b96-f808-4698-91cf-5f579cc5de1c tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:30.779310 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-66735b96-f808-4698-91cf-5f579cc5de1c tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:30.780008 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-66735b96-f808-4698-91cf-5f579cc5de1c tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:30.780620 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-66735b96-f808-4698-91cf-5f579cc5de1c tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:30.781504 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-66735b96-f808-4698-91cf-5f579cc5de1c tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:30.782116 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-66735b96-f808-4698-91cf-5f579cc5de1c tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:30.782529 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-66735b96-f808-4698-91cf-5f579cc5de1c tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:30.856340 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2d7ce1f3-3e46-40f3-8301-6fd6c0cfc084 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:30.865864 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2d7ce1f3-3e46-40f3-8301-6fd6c0cfc084 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f" status: 200 len: 1386 microversion: 2.1 time: 0.532912 Oct 17 13:40:30.873079 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 899/1750] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:30 2022] GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f => generated 1386 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:30.894517 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f8215351-be94-4531-b3be-10a61917375d tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:30.895461 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f8215351-be94-4531-b3be-10a61917375d tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9c6b4ed2-b111-41b0-9679-b66d386834b9] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:30.911285 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f8215351-be94-4531-b3be-10a61917375d tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:30.912934 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f8215351-be94-4531-b3be-10a61917375d tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:30.914439 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f8215351-be94-4531-b3be-10a61917375d tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:30.919670 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f8215351-be94-4531-b3be-10a61917375d tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:30.922565 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f8215351-be94-4531-b3be-10a61917375d tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:30.923139 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f8215351-be94-4531-b3be-10a61917375d tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:30.932742 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-66735b96-f808-4698-91cf-5f579cc5de1c tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:30.960132 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-66735b96-f808-4698-91cf-5f579cc5de1c tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:30.963430 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-66735b96-f808-4698-91cf-5f579cc5de1c tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:30.972730 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-66735b96-f808-4698-91cf-5f579cc5de1c tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1537 microversion: 2.91 time: 0.209476 Oct 17 13:40:30.977623 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 852/1751] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:40:30 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1537 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:40:30.990592 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1824781f-7f92-4b88-8b54-f8a2b3c01cd1 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:30.990998 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-1824781f-7f92-4b88-8b54-f8a2b3c01cd1 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: ab2b571e-376c-41d3-a778-44bedcaa5467] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:31.009195 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1824781f-7f92-4b88-8b54-f8a2b3c01cd1 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:31.010730 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1824781f-7f92-4b88-8b54-f8a2b3c01cd1 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:31.011402 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1824781f-7f92-4b88-8b54-f8a2b3c01cd1 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:31.012359 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1824781f-7f92-4b88-8b54-f8a2b3c01cd1 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:31.012983 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1824781f-7f92-4b88-8b54-f8a2b3c01cd1 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:31.013653 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1824781f-7f92-4b88-8b54-f8a2b3c01cd1 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:31.369397 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f8215351-be94-4531-b3be-10a61917375d tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:31.388418 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f8215351-be94-4531-b3be-10a61917375d tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9" status: 200 len: 1317 microversion: 2.1 time: 0.497520 Oct 17 13:40:31.389301 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 900/1752] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:30 2022] GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9 => generated 1317 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:31.393776 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9fa8fe46-2352-4775-9649-898f88b55495 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd522f820>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:31.453844 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9fa8fe46-2352-4775-9649-898f88b55495 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/a8625a43-cc13-4579-b0e9-3ebd2183a277" status: 200 len: 1413 microversion: 2.1 time: 0.063591 Oct 17 13:40:31.458314 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 901/1753] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:40:31 2022] GET /compute/v2.1/images/a8625a43-cc13-4579-b0e9-3ebd2183a277 => generated 1413 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:31.475834 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-1824781f-7f92-4b88-8b54-f8a2b3c01cd1 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:31.486518 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1824781f-7f92-4b88-8b54-f8a2b3c01cd1 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467" status: 200 len: 1470 microversion: 2.1 time: 0.507393 Oct 17 13:40:31.487799 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 853/1754] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:30 2022] GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467 => generated 1470 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:31.789090 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ae56e1e5-f83c-44fc-a6e8-c9b448bb04a4 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:31.800452 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ae56e1e5-f83c-44fc-a6e8-c9b448bb04a4 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] [instance: 8938a16d-a198-46b1-92aa-880f0cc290ba] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:31.822865 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae56e1e5-f83c-44fc-a6e8-c9b448bb04a4 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:31.827436 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae56e1e5-f83c-44fc-a6e8-c9b448bb04a4 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:31.828089 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae56e1e5-f83c-44fc-a6e8-c9b448bb04a4 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:31.830545 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae56e1e5-f83c-44fc-a6e8-c9b448bb04a4 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:31.832872 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae56e1e5-f83c-44fc-a6e8-c9b448bb04a4 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:31.838527 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae56e1e5-f83c-44fc-a6e8-c9b448bb04a4 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:31.898697 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-803c8679-fa1d-4cf8-ad3e-7326c6a77b88 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:31.900177 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-803c8679-fa1d-4cf8-ad3e-7326c6a77b88 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: fd365dc4-44c6-4a00-971e-2699762ab41f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:31.912858 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-803c8679-fa1d-4cf8-ad3e-7326c6a77b88 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:31.913665 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-803c8679-fa1d-4cf8-ad3e-7326c6a77b88 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:31.914467 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-803c8679-fa1d-4cf8-ad3e-7326c6a77b88 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:31.915487 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-803c8679-fa1d-4cf8-ad3e-7326c6a77b88 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:31.917723 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-803c8679-fa1d-4cf8-ad3e-7326c6a77b88 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:31.919003 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-803c8679-fa1d-4cf8-ad3e-7326c6a77b88 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:32.272100 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-803c8679-fa1d-4cf8-ad3e-7326c6a77b88 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:32.282593 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-803c8679-fa1d-4cf8-ad3e-7326c6a77b88 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f" status: 200 len: 1386 microversion: 2.1 time: 0.387632 Oct 17 13:40:32.291465 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 854/1755] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:31 2022] GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f => generated 1386 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:40:32.313310 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ae56e1e5-f83c-44fc-a6e8-c9b448bb04a4 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:32.318591 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ce412a26-f060-4371-85b8-cab6d0083820 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:32.319182 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:40:32.319475 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ce412a26-f060-4371-85b8-cab6d0083820 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:32.324540 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ae56e1e5-f83c-44fc-a6e8-c9b448bb04a4 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers/8938a16d-a198-46b1-92aa-880f0cc290ba" status: 200 len: 1321 microversion: 2.1 time: 0.540874 Oct 17 13:40:32.326724 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 902/1756] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:31 2022] GET /compute/v2.1/servers/8938a16d-a198-46b1-92aa-880f0cc290ba => generated 1321 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:32.332455 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ce412a26-f060-4371-85b8-cab6d0083820 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:32.335393 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ce412a26-f060-4371-85b8-cab6d0083820 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:32.336015 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ce412a26-f060-4371-85b8-cab6d0083820 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:32.336933 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ce412a26-f060-4371-85b8-cab6d0083820 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:32.341346 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ce412a26-f060-4371-85b8-cab6d0083820 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:32.342042 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ce412a26-f060-4371-85b8-cab6d0083820 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:32.380878 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-25fbcfc7-d3ae-427f-b5fc-3701b0586bd5 req-6d8fcc68-315d-4248-9ce7-03768a8138e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c6b4ed2-b111-41b0-9679-b66d386834b9", "name": "network-vif-plugged", "status": "completed", "tag": "3a217dc6-53c2-4e51-abb4-9f6293319532"}, {"server_uuid": "8938a16d-a198-46b1-92aa-880f0cc290ba", "name": "network-vif-plugged", "status": "completed", "tag": "abcefd69-7991-4cf3-8930-d2004d820733"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:32.426040 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-25fbcfc7-d3ae-427f-b5fc-3701b0586bd5 req-6d8fcc68-315d-4248-9ce7-03768a8138e2 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:32.434654 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-25fbcfc7-d3ae-427f-b5fc-3701b0586bd5 req-6d8fcc68-315d-4248-9ce7-03768a8138e2 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:32.435028 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-25fbcfc7-d3ae-427f-b5fc-3701b0586bd5 req-6d8fcc68-315d-4248-9ce7-03768a8138e2 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:32.494583 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-25fbcfc7-d3ae-427f-b5fc-3701b0586bd5 req-6d8fcc68-315d-4248-9ce7-03768a8138e2 service nova] Creating event network-vif-plugged:3a217dc6-53c2-4e51-abb4-9f6293319532 for instance 9c6b4ed2-b111-41b0-9679-b66d386834b9 on n-h2-854247-14 Oct 17 13:40:32.495513 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-25fbcfc7-d3ae-427f-b5fc-3701b0586bd5 req-6d8fcc68-315d-4248-9ce7-03768a8138e2 service nova] Creating event network-vif-plugged:abcefd69-7991-4cf3-8930-d2004d820733 for instance 8938a16d-a198-46b1-92aa-880f0cc290ba on n-h1-854247-14 Oct 17 13:40:32.534438 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-25fbcfc7-d3ae-427f-b5fc-3701b0586bd5 req-6d8fcc68-315d-4248-9ce7-03768a8138e2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.159351 Oct 17 13:40:32.541814 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 903/1757] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:40:32.553645 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d3496290-6cd4-4b34-9de0-3bfa7caaade3 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:32.554757 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d3496290-6cd4-4b34-9de0-3bfa7caaade3 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9c6b4ed2-b111-41b0-9679-b66d386834b9] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:32.583869 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d3496290-6cd4-4b34-9de0-3bfa7caaade3 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:32.584624 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d3496290-6cd4-4b34-9de0-3bfa7caaade3 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:32.585372 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d3496290-6cd4-4b34-9de0-3bfa7caaade3 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:32.586565 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d3496290-6cd4-4b34-9de0-3bfa7caaade3 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:32.594961 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d3496290-6cd4-4b34-9de0-3bfa7caaade3 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:32.596051 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d3496290-6cd4-4b34-9de0-3bfa7caaade3 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:32.609287 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ce412a26-f060-4371-85b8-cab6d0083820 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:32.636719 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ce412a26-f060-4371-85b8-cab6d0083820 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:32.639266 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ce412a26-f060-4371-85b8-cab6d0083820 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:32.667767 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ce412a26-f060-4371-85b8-cab6d0083820 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1537 microversion: 2.91 time: 0.369027 Oct 17 13:40:32.669632 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 855/1758] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:40:32 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1537 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:40:32.678263 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1c6ae585-7313-40af-a8f1-b18263e93182 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd4fa3a60>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:32.774974 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1c6ae585-7313-40af-a8f1-b18263e93182 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/a8625a43-cc13-4579-b0e9-3ebd2183a277" status: 200 len: 1413 microversion: 2.1 time: 0.101447 Oct 17 13:40:32.776323 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 856/1759] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:40:32 2022] GET /compute/v2.1/images/a8625a43-cc13-4579-b0e9-3ebd2183a277 => generated 1413 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:32.785015 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5b59ad2c-746c-458d-a74d-8babecbfce10 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:32.786592 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5b59ad2c-746c-458d-a74d-8babecbfce10 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: ab2b571e-376c-41d3-a778-44bedcaa5467] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:32.797663 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5b59ad2c-746c-458d-a74d-8babecbfce10 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:32.798969 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5b59ad2c-746c-458d-a74d-8babecbfce10 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:32.800060 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5b59ad2c-746c-458d-a74d-8babecbfce10 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:32.801573 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5b59ad2c-746c-458d-a74d-8babecbfce10 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:32.802676 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5b59ad2c-746c-458d-a74d-8babecbfce10 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:32.803802 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5b59ad2c-746c-458d-a74d-8babecbfce10 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:32.857224 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=100 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:40:33.453508 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5b59ad2c-746c-458d-a74d-8babecbfce10 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:33.480394 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5b59ad2c-746c-458d-a74d-8babecbfce10 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467" status: 200 len: 1428 microversion: 2.1 time: 0.699709 Oct 17 13:40:33.487802 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 857/1760] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:32 2022] GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467 => generated 1428 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:33.523159 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-1ce277c1-d113-4749-bcee-31ad7c44df7f req-e7a23053-c31d-4a25-ae93-e5532166f484 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab2b571e-376c-41d3-a778-44bedcaa5467", "name": "network-vif-deleted", "tag": "7ff3914f-4ed0-4fef-bc81-8a07b3c2c97b"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:33.559157 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-1ce277c1-d113-4749-bcee-31ad7c44df7f req-e7a23053-c31d-4a25-ae93-e5532166f484 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:33.560168 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-1ce277c1-d113-4749-bcee-31ad7c44df7f req-e7a23053-c31d-4a25-ae93-e5532166f484 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:33.560760 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-1ce277c1-d113-4749-bcee-31ad7c44df7f req-e7a23053-c31d-4a25-ae93-e5532166f484 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:33.579941 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-1ce277c1-d113-4749-bcee-31ad7c44df7f req-e7a23053-c31d-4a25-ae93-e5532166f484 service nova] Creating event network-vif-deleted:7ff3914f-4ed0-4fef-bc81-8a07b3c2c97b for instance ab2b571e-376c-41d3-a778-44bedcaa5467 on n-h2-854247-14 Oct 17 13:40:33.586010 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-1ce277c1-d113-4749-bcee-31ad7c44df7f req-e7a23053-c31d-4a25-ae93-e5532166f484 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096561 Oct 17 13:40:33.587212 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 858/1761] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:40:33.594017 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d3496290-6cd4-4b34-9de0-3bfa7caaade3 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:33.604802 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d3496290-6cd4-4b34-9de0-3bfa7caaade3 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9" status: 200 len: 1317 microversion: 2.1 time: 1.060965 Oct 17 13:40:33.607504 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-275aab35-efb2-43fd-a7dc-1136795e4eb5 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:33.608640 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 904/1762] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:32 2022] GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9 => generated 1317 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:33.613980 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6a71f7c1-ce77-4ab3-a827-e8dc1a07e806 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:33.614924 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-275aab35-efb2-43fd-a7dc-1136795e4eb5 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: fd365dc4-44c6-4a00-971e-2699762ab41f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:33.623825 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6a71f7c1-ce77-4ab3-a827-e8dc1a07e806 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] [instance: 8938a16d-a198-46b1-92aa-880f0cc290ba] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:33.628889 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-275aab35-efb2-43fd-a7dc-1136795e4eb5 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:33.632576 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-275aab35-efb2-43fd-a7dc-1136795e4eb5 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:33.635410 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-275aab35-efb2-43fd-a7dc-1136795e4eb5 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:33.636399 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-275aab35-efb2-43fd-a7dc-1136795e4eb5 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:33.637815 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-275aab35-efb2-43fd-a7dc-1136795e4eb5 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:33.640033 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-275aab35-efb2-43fd-a7dc-1136795e4eb5 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:33.644995 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6a71f7c1-ce77-4ab3-a827-e8dc1a07e806 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:33.645884 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6a71f7c1-ce77-4ab3-a827-e8dc1a07e806 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:33.646528 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6a71f7c1-ce77-4ab3-a827-e8dc1a07e806 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:33.647595 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6a71f7c1-ce77-4ab3-a827-e8dc1a07e806 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:33.648214 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6a71f7c1-ce77-4ab3-a827-e8dc1a07e806 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:33.648829 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6a71f7c1-ce77-4ab3-a827-e8dc1a07e806 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:33.896621 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-275aab35-efb2-43fd-a7dc-1136795e4eb5 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:33.906116 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-275aab35-efb2-43fd-a7dc-1136795e4eb5 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f" status: 200 len: 1183 microversion: 2.1 time: 0.317153 Oct 17 13:40:33.914654 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 859/1763] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:33 2022] GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f => generated 1183 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:33.934680 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b51c131b-f116-4cf1-a20b-4d7b487c270b tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:33.938495 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b51c131b-f116-4cf1-a20b-4d7b487c270b tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:33.968025 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b51c131b-f116-4cf1-a20b-4d7b487c270b tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:33.968701 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b51c131b-f116-4cf1-a20b-4d7b487c270b tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:33.969241 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b51c131b-f116-4cf1-a20b-4d7b487c270b tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:33.970071 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b51c131b-f116-4cf1-a20b-4d7b487c270b tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:33.970782 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b51c131b-f116-4cf1-a20b-4d7b487c270b tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:33.972237 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b51c131b-f116-4cf1-a20b-4d7b487c270b tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:33.996299 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6a71f7c1-ce77-4ab3-a827-e8dc1a07e806 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:34.004588 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6a71f7c1-ce77-4ab3-a827-e8dc1a07e806 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers/8938a16d-a198-46b1-92aa-880f0cc290ba" status: 200 len: 1321 microversion: 2.1 time: 0.394524 Oct 17 13:40:34.023205 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 905/1764] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:33 2022] GET /compute/v2.1/servers/8938a16d-a198-46b1-92aa-880f0cc290ba => generated 1321 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:34.023205 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a049c3db-cda0-47f5-ba5c-24bca5026906 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd5391550>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:34.135940 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a049c3db-cda0-47f5-ba5c-24bca5026906 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/a8625a43-cc13-4579-b0e9-3ebd2183a277" status: 200 len: 1413 microversion: 2.1 time: 0.128474 Oct 17 13:40:34.136527 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 906/1765] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:40:34 2022] GET /compute/v2.1/images/a8625a43-cc13-4579-b0e9-3ebd2183a277 => generated 1413 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:34.167255 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b51c131b-f116-4cf1-a20b-4d7b487c270b tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:34.180344 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b51c131b-f116-4cf1-a20b-4d7b487c270b tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:34.192560 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b51c131b-f116-4cf1-a20b-4d7b487c270b tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:34.221342 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b51c131b-f116-4cf1-a20b-4d7b487c270b tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1537 microversion: 2.91 time: 0.304823 Oct 17 13:40:34.221948 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 860/1766] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:40:33 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1537 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:40:34.510443 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1b7eaccb-836a-437d-9362-38347fa32775 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:34.518194 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1b7eaccb-836a-437d-9362-38347fa32775 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: ab2b571e-376c-41d3-a778-44bedcaa5467] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:34.546738 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1b7eaccb-836a-437d-9362-38347fa32775 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:34.547523 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1b7eaccb-836a-437d-9362-38347fa32775 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:34.548143 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1b7eaccb-836a-437d-9362-38347fa32775 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:34.552038 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1b7eaccb-836a-437d-9362-38347fa32775 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:34.552879 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1b7eaccb-836a-437d-9362-38347fa32775 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:34.553567 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1b7eaccb-836a-437d-9362-38347fa32775 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:34.631192 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e50adb89-5ce8-4112-b5d3-9af7f5f37e08 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:34.631970 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e50adb89-5ce8-4112-b5d3-9af7f5f37e08 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9c6b4ed2-b111-41b0-9679-b66d386834b9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:34.648415 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e50adb89-5ce8-4112-b5d3-9af7f5f37e08 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:34.649147 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e50adb89-5ce8-4112-b5d3-9af7f5f37e08 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:34.649839 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e50adb89-5ce8-4112-b5d3-9af7f5f37e08 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:34.650723 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e50adb89-5ce8-4112-b5d3-9af7f5f37e08 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:34.651448 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e50adb89-5ce8-4112-b5d3-9af7f5f37e08 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:34.653751 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e50adb89-5ce8-4112-b5d3-9af7f5f37e08 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:34.658723 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1b7eaccb-836a-437d-9362-38347fa32775 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:34.659878 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1b7eaccb-836a-437d-9362-38347fa32775 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:34.660744 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1b7eaccb-836a-437d-9362-38347fa32775 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:34.661661 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-1b7eaccb-836a-437d-9362-38347fa32775 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lazy-loading 'fault' on Instance uuid ab2b571e-376c-41d3-a778-44bedcaa5467 {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:40:34.734929 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1b7eaccb-836a-437d-9362-38347fa32775 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69bd293284874ca9ba415770de7b6965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76eaaef0f6234db690a123c54cea5a6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:34.774550 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1b7eaccb-836a-437d-9362-38347fa32775 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467" status: 200 len: 1304 microversion: 2.1 time: 0.265444 Oct 17 13:40:34.792647 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 907/1767] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:34 2022] GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467 => generated 1304 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:34.937430 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-68b97e40-69a2-4229-a58e-38572bbd881e tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:34.938692 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-68b97e40-69a2-4229-a58e-38572bbd881e tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: fd365dc4-44c6-4a00-971e-2699762ab41f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:34.948860 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-68b97e40-69a2-4229-a58e-38572bbd881e tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:34.953389 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-68b97e40-69a2-4229-a58e-38572bbd881e tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:34.956111 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-68b97e40-69a2-4229-a58e-38572bbd881e tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:34.959805 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e50adb89-5ce8-4112-b5d3-9af7f5f37e08 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:34.972990 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-68b97e40-69a2-4229-a58e-38572bbd881e tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:34.973496 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-68b97e40-69a2-4229-a58e-38572bbd881e tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:34.973763 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e50adb89-5ce8-4112-b5d3-9af7f5f37e08 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9" status: 200 len: 1317 microversion: 2.1 time: 0.346464 Oct 17 13:40:34.973942 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-68b97e40-69a2-4229-a58e-38572bbd881e tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:34.984140 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 861/1768] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:34 2022] GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9 => generated 1317 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:35.033770 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-25626e70-4fae-4d42-9f8c-9b4f072227ca tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:35.035483 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-25626e70-4fae-4d42-9f8c-9b4f072227ca tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] [instance: 8938a16d-a198-46b1-92aa-880f0cc290ba] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:35.047549 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-25626e70-4fae-4d42-9f8c-9b4f072227ca tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:35.048558 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-25626e70-4fae-4d42-9f8c-9b4f072227ca tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:35.050305 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-25626e70-4fae-4d42-9f8c-9b4f072227ca tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:35.051279 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-25626e70-4fae-4d42-9f8c-9b4f072227ca tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:35.057078 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-25626e70-4fae-4d42-9f8c-9b4f072227ca tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:35.057630 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-25626e70-4fae-4d42-9f8c-9b4f072227ca tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:35.183717 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-68b97e40-69a2-4229-a58e-38572bbd881e tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:35.195949 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-68b97e40-69a2-4229-a58e-38572bbd881e tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f" status: 200 len: 1183 microversion: 2.1 time: 0.262439 Oct 17 13:40:35.196778 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 908/1769] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:34 2022] GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f => generated 1183 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:35.209945 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7058766e-44d9-431a-a47f-629e3a404016 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd5e2e790>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:35.303872 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7058766e-44d9-431a-a47f-629e3a404016 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/a8625a43-cc13-4579-b0e9-3ebd2183a277" status: 200 len: 1413 microversion: 2.1 time: 0.103494 Oct 17 13:40:35.312264 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 909/1770] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:40:35 2022] GET /compute/v2.1/images/a8625a43-cc13-4579-b0e9-3ebd2183a277 => generated 1413 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:35.317697 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3ab4f5bb-fe79-436d-ab08-d8253d6751c2 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:35.318507 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3ab4f5bb-fe79-436d-ab08-d8253d6751c2 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:35.341270 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3ab4f5bb-fe79-436d-ab08-d8253d6751c2 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:35.342039 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3ab4f5bb-fe79-436d-ab08-d8253d6751c2 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:35.342676 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3ab4f5bb-fe79-436d-ab08-d8253d6751c2 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:35.343712 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3ab4f5bb-fe79-436d-ab08-d8253d6751c2 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:35.344673 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3ab4f5bb-fe79-436d-ab08-d8253d6751c2 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:35.345272 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3ab4f5bb-fe79-436d-ab08-d8253d6751c2 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:35.400559 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-25626e70-4fae-4d42-9f8c-9b4f072227ca tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:35.409979 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-25626e70-4fae-4d42-9f8c-9b4f072227ca tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers/8938a16d-a198-46b1-92aa-880f0cc290ba" status: 200 len: 1321 microversion: 2.1 time: 0.380182 Oct 17 13:40:35.413166 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 862/1771] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:35 2022] GET /compute/v2.1/servers/8938a16d-a198-46b1-92aa-880f0cc290ba => generated 1321 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:35.467755 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3ab4f5bb-fe79-436d-ab08-d8253d6751c2 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:35.477192 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3ab4f5bb-fe79-436d-ab08-d8253d6751c2 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:35.487586 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3ab4f5bb-fe79-436d-ab08-d8253d6751c2 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:35.506091 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3ab4f5bb-fe79-436d-ab08-d8253d6751c2 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1537 microversion: 2.91 time: 0.192094 Oct 17 13:40:35.508137 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 910/1772] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:40:35 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1537 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:40:35.611144 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-f7d41b9e-8c98-4ed1-820e-9199a6bd48b5 req-d0602b22-a43a-4bac-b8dc-406a6a58bcf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd365dc4-44c6-4a00-971e-2699762ab41f", "name": "network-vif-deleted", "tag": "6d5ddeb5-1324-4b12-9490-8c34031e6c41"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:35.634795 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-f7d41b9e-8c98-4ed1-820e-9199a6bd48b5 req-d0602b22-a43a-4bac-b8dc-406a6a58bcf4 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:35.635497 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-f7d41b9e-8c98-4ed1-820e-9199a6bd48b5 req-d0602b22-a43a-4bac-b8dc-406a6a58bcf4 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:35.635713 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-f7d41b9e-8c98-4ed1-820e-9199a6bd48b5 req-d0602b22-a43a-4bac-b8dc-406a6a58bcf4 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:35.671521 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-f7d41b9e-8c98-4ed1-820e-9199a6bd48b5 req-d0602b22-a43a-4bac-b8dc-406a6a58bcf4 service nova] Creating event network-vif-deleted:6d5ddeb5-1324-4b12-9490-8c34031e6c41 for instance fd365dc4-44c6-4a00-971e-2699762ab41f on n-h2-854247-14 Oct 17 13:40:35.689020 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-f7d41b9e-8c98-4ed1-820e-9199a6bd48b5 req-d0602b22-a43a-4bac-b8dc-406a6a58bcf4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081813 Oct 17 13:40:35.692065 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 863/1773] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:40:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:40:35.815656 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0b9ab33e-8836-4afe-95ca-5408390306e6 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:35.816970 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0b9ab33e-8836-4afe-95ca-5408390306e6 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] [instance: ab2b571e-376c-41d3-a778-44bedcaa5467] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:35.826116 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0b9ab33e-8836-4afe-95ca-5408390306e6 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:35.826949 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0b9ab33e-8836-4afe-95ca-5408390306e6 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:35.827602 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0b9ab33e-8836-4afe-95ca-5408390306e6 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:35.829059 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0b9ab33e-8836-4afe-95ca-5408390306e6 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:35.829671 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0b9ab33e-8836-4afe-95ca-5408390306e6 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:35.831642 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0b9ab33e-8836-4afe-95ca-5408390306e6 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:35.848985 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-0b9ab33e-8836-4afe-95ca-5408390306e6 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] HTTP exception thrown: Instance ab2b571e-376c-41d3-a778-44bedcaa5467 could not be found. Oct 17 13:40:35.851156 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0b9ab33e-8836-4afe-95ca-5408390306e6 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Request method failure captured: Oct 17 13:40:35.851156 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467 HTTP/1.1 Oct 17 13:40:35.851156 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:40:35.851156 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:40:35.851156 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:40:35.851156 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:40:35.851156 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:40:35.851156 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:40:35.851156 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:40:35.851156 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:40:35.851156 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVq3QG91bsbrdujMx0w2rwLFi6GpzE732UrjJvuSTfBVExjcgLnF2M2z5qHJG62FSG1Pm6TSVJ3G0JMZXM4x5T8PL2EiMmH1zEj8FFbxs0eLY-dCHBBSOlmbkA3M_U3rDAsaCdweKlbyRuXYwRKNtgqMKG1bmX8eKrZqh0UiHb1LwEE Oct 17 13:40:35.851156 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:40:35.851156 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:40:35.851156 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:40:35.851156 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:40:35.851156 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:40:35.851156 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:40:35.851156 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 76eaaef0f6234db690a123c54cea5a6d Oct 17 13:40:35.851156 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServersAdminTestJSON-948985186 Oct 17 13:40:35.851156 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:40:35.851156 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:40:35.852959 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/76eaaef0f6234db690a123c54cea5a6d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/76eaaef0f6234db690a123c54cea5a6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/76eaaef0f6234db690a123c54cea5a6d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_76eaaef0f6234db690a123c54cea5a6d", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:40:35.852959 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServersAdminTestJSON-948985186 Oct 17 13:40:35.852959 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 76eaaef0f6234db690a123c54cea5a6d Oct 17 13:40:35.852959 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServersAdminTestJSON-948985186 Oct 17 13:40:35.852959 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServersAdminTestJSON-948985186-project Oct 17 13:40:35.852959 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:40:35.852959 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:40:35.852959 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 69bd293284874ca9ba415770de7b6965 Oct 17 13:40:35.852959 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServersAdminTestJSON-948985186-project Oct 17 13:40:35.852959 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:40:35.852959 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance ab2b571e-376c-41d3-a778-44bedcaa5467 could not be found. Oct 17 13:40:35.852959 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'ab2b571e-376c-41d3-a778-44bedcaa5467'} Oct 17 13:40:35.853925 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:40:35.853925 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:40:35.853925 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:40:35.853925 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:40:35.853925 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:40:35.853925 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:40:35.853925 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:40:35.853925 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:40:35.853925 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:40:35.853925 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:40:35.853925 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab2b571e-376c-41d3-a778-44bedcaa5467 could not be found. Oct 17 13:40:35.853925 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:40:35.853925 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:40:35.853925 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:40:35.853925 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:40:35.853925 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:40:35.853925 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:40:35.853925 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:40:35.853925 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:40:35.853925 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:40:35.856346 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:40:35.856346 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:40:35.856346 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:40:35.856346 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:40:35.856346 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:40:35.856346 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:40:35.856346 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:40:35.856346 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab2b571e-376c-41d3-a778-44bedcaa5467 could not be found. Oct 17 13:40:35.856346 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:40:35.856346 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:40:35.856346 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:40:35.856346 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:40:35.856346 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:40:35.856346 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:40:35.856346 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:40:35.856346 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:40:35.856346 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab2b571e-376c-41d3-a778-44bedcaa5467 could not be found. Oct 17 13:40:35.856346 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:40:35.859770 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0b9ab33e-8836-4afe-95ca-5408390306e6 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] Returning 404 to user: Instance ab2b571e-376c-41d3-a778-44bedcaa5467 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:40:35.861038 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0b9ab33e-8836-4afe-95ca-5408390306e6 tempest-ServersAdminTestJSON-948985186 tempest-ServersAdminTestJSON-948985186-project] 10.222.0.79 "GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467" status: 404 len: 111 microversion: 2.1 time: 0.057494 Oct 17 13:40:35.862077 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 911/1774] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:35 2022] GET /compute/v2.1/servers/ab2b571e-376c-41d3-a778-44bedcaa5467 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:40:36.000873 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6969929e-11e9-4778-b9e9-0f5609b07536 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:36.001617 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6969929e-11e9-4778-b9e9-0f5609b07536 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9c6b4ed2-b111-41b0-9679-b66d386834b9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:36.016293 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6969929e-11e9-4778-b9e9-0f5609b07536 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:36.016794 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6969929e-11e9-4778-b9e9-0f5609b07536 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:36.017356 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6969929e-11e9-4778-b9e9-0f5609b07536 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:36.018336 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6969929e-11e9-4778-b9e9-0f5609b07536 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:36.018986 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6969929e-11e9-4778-b9e9-0f5609b07536 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:36.020017 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6969929e-11e9-4778-b9e9-0f5609b07536 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:36.224471 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-840dbc28-762e-4cf0-adfa-fc9b2f1d8718 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:36.225403 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-840dbc28-762e-4cf0-adfa-fc9b2f1d8718 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: fd365dc4-44c6-4a00-971e-2699762ab41f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:36.251404 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-840dbc28-762e-4cf0-adfa-fc9b2f1d8718 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:36.252588 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-840dbc28-762e-4cf0-adfa-fc9b2f1d8718 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:36.253416 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-840dbc28-762e-4cf0-adfa-fc9b2f1d8718 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:36.259222 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-840dbc28-762e-4cf0-adfa-fc9b2f1d8718 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:36.261021 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-840dbc28-762e-4cf0-adfa-fc9b2f1d8718 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:36.262022 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-840dbc28-762e-4cf0-adfa-fc9b2f1d8718 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:36.331045 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6969929e-11e9-4778-b9e9-0f5609b07536 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:36.342451 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6969929e-11e9-4778-b9e9-0f5609b07536 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9" status: 200 len: 1507 microversion: 2.1 time: 0.344766 Oct 17 13:40:36.363118 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 864/1775] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:35 2022] GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9 => generated 1507 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:36.383859 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2639056f-38cf-4e9d-96d7-8c5e55ffc9fc tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd55709d0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:36.418812 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-840dbc28-762e-4cf0-adfa-fc9b2f1d8718 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:36.430395 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-840dbc28-762e-4cf0-adfa-fc9b2f1d8718 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f" status: 200 len: 1183 microversion: 2.1 time: 0.211977 Oct 17 13:40:36.448798 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 912/1776] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:36 2022] GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f => generated 1183 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:40:36.461139 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c97a668e-e679-40f1-bd74-806a7fdcd63c tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:36.465122 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c97a668e-e679-40f1-bd74-806a7fdcd63c tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9c6b4ed2-b111-41b0-9679-b66d386834b9] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:36.477013 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2639056f-38cf-4e9d-96d7-8c5e55ffc9fc tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/a8625a43-cc13-4579-b0e9-3ebd2183a277" status: 200 len: 1413 microversion: 2.1 time: 0.111954 Oct 17 13:40:36.477857 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c97a668e-e679-40f1-bd74-806a7fdcd63c tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:36.479885 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 865/1777] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:40:36 2022] GET /compute/v2.1/images/a8625a43-cc13-4579-b0e9-3ebd2183a277 => generated 1413 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:36.480710 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c97a668e-e679-40f1-bd74-806a7fdcd63c tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:36.489993 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c97a668e-e679-40f1-bd74-806a7fdcd63c tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:36.490961 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c97a668e-e679-40f1-bd74-806a7fdcd63c tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:36.491652 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c97a668e-e679-40f1-bd74-806a7fdcd63c tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:36.492245 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c97a668e-e679-40f1-bd74-806a7fdcd63c tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:36.494747 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9b503a17-44b0-470b-85d0-687979267ee9 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:36.497091 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9b503a17-44b0-470b-85d0-687979267ee9 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] [instance: 8938a16d-a198-46b1-92aa-880f0cc290ba] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:36.514297 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9b503a17-44b0-470b-85d0-687979267ee9 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:36.517374 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9b503a17-44b0-470b-85d0-687979267ee9 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:36.518441 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9b503a17-44b0-470b-85d0-687979267ee9 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:36.519514 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9b503a17-44b0-470b-85d0-687979267ee9 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:36.521398 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9b503a17-44b0-470b-85d0-687979267ee9 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:36.522294 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9b503a17-44b0-470b-85d0-687979267ee9 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:36.830755 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9b503a17-44b0-470b-85d0-687979267ee9 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:36.840183 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9b503a17-44b0-470b-85d0-687979267ee9 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers/8938a16d-a198-46b1-92aa-880f0cc290ba" status: 200 len: 1513 microversion: 2.1 time: 0.359041 Oct 17 13:40:36.852423 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 866/1778] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:36 2022] GET /compute/v2.1/servers/8938a16d-a198-46b1-92aa-880f0cc290ba => generated 1513 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:36.857599 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d926562a-10cc-4498-99e2-84a2cc206cf1 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:36.858977 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d926562a-10cc-4498-99e2-84a2cc206cf1 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:36.870475 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d926562a-10cc-4498-99e2-84a2cc206cf1 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:36.874183 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d926562a-10cc-4498-99e2-84a2cc206cf1 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:36.878037 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d926562a-10cc-4498-99e2-84a2cc206cf1 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:36.878892 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d926562a-10cc-4498-99e2-84a2cc206cf1 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:36.879528 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d926562a-10cc-4498-99e2-84a2cc206cf1 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:36.880230 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d926562a-10cc-4498-99e2-84a2cc206cf1 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:36.924543 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c97a668e-e679-40f1-bd74-806a7fdcd63c tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:36.934416 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c97a668e-e679-40f1-bd74-806a7fdcd63c tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9" status: 200 len: 1507 microversion: 2.1 time: 0.484145 Oct 17 13:40:36.939626 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 913/1779] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:36 2022] GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9 => generated 1507 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:36.944657 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-64735720-0afa-4fdd-b91c-a8bfbfa19006 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:36.960457 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-64735720-0afa-4fdd-b91c-a8bfbfa19006 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] [instance: 3d4188da-b0f7-4d97-952b-acebaa48f185] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:36.974394 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-64735720-0afa-4fdd-b91c-a8bfbfa19006 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:36.977427 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-64735720-0afa-4fdd-b91c-a8bfbfa19006 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:36.978182 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-64735720-0afa-4fdd-b91c-a8bfbfa19006 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:36.982119 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-64735720-0afa-4fdd-b91c-a8bfbfa19006 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:36.984684 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-64735720-0afa-4fdd-b91c-a8bfbfa19006 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:36.985363 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-64735720-0afa-4fdd-b91c-a8bfbfa19006 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:37.040263 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d926562a-10cc-4498-99e2-84a2cc206cf1 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:37.050409 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d926562a-10cc-4498-99e2-84a2cc206cf1 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:37.058025 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d926562a-10cc-4498-99e2-84a2cc206cf1 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:37.068271 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d926562a-10cc-4498-99e2-84a2cc206cf1 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1537 microversion: 2.91 time: 0.214360 Oct 17 13:40:37.088326 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 867/1780] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:40:36 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1537 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:40:37.111655 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-61f68cfe-34c5-45ad-ac3a-32985c175fba tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "OS-DCF:diskConfig": "AUTO"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:37.115215 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-61f68cfe-34c5-45ad-ac3a-32985c175fba tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9c6b4ed2-b111-41b0-9679-b66d386834b9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:37.123452 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-61f68cfe-34c5-45ad-ac3a-32985c175fba tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:37.124367 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-61f68cfe-34c5-45ad-ac3a-32985c175fba tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:37.125047 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-61f68cfe-34c5-45ad-ac3a-32985c175fba tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:37.126004 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-61f68cfe-34c5-45ad-ac3a-32985c175fba tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:37.126685 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-61f68cfe-34c5-45ad-ac3a-32985c175fba tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:37.127393 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-61f68cfe-34c5-45ad-ac3a-32985c175fba tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:37.250114 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-61f68cfe-34c5-45ad-ac3a-32985c175fba tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:40:37.250540 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-61f68cfe-34c5-45ad-ac3a-32985c175fba tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:40:37.251015 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-61f68cfe-34c5-45ad-ac3a-32985c175fba tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:40:37.251465 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-61f68cfe-34c5-45ad-ac3a-32985c175fba tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:40:37.251874 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-61f68cfe-34c5-45ad-ac3a-32985c175fba tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:40:37.353649 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-61f68cfe-34c5-45ad-ac3a-32985c175fba tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9c6b4ed2-b111-41b0-9679-b66d386834b9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:37.369642 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-61f68cfe-34c5-45ad-ac3a-32985c175fba tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:37.370142 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-61f68cfe-34c5-45ad-ac3a-32985c175fba tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:37.370577 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-61f68cfe-34c5-45ad-ac3a-32985c175fba tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:37.371628 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-61f68cfe-34c5-45ad-ac3a-32985c175fba tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:37.372078 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-61f68cfe-34c5-45ad-ac3a-32985c175fba tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:37.376647 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-61f68cfe-34c5-45ad-ac3a-32985c175fba tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:37.437371 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-61f68cfe-34c5-45ad-ac3a-32985c175fba tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "POST /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9/action" status: 202 len: 1109 microversion: 2.1 time: 0.341457 Oct 17 13:40:37.438834 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 868/1781] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:40:37 2022] POST /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9/action => generated 1109 bytes in 350 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 17 13:40:37.458080 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-56a40b62-6c35-410c-bfb6-3a8311d1ad57 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:37.459087 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-56a40b62-6c35-410c-bfb6-3a8311d1ad57 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: fd365dc4-44c6-4a00-971e-2699762ab41f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:37.469315 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-56a40b62-6c35-410c-bfb6-3a8311d1ad57 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:37.470230 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-56a40b62-6c35-410c-bfb6-3a8311d1ad57 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:37.473852 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-56a40b62-6c35-410c-bfb6-3a8311d1ad57 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:37.474786 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-56a40b62-6c35-410c-bfb6-3a8311d1ad57 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:37.475396 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-56a40b62-6c35-410c-bfb6-3a8311d1ad57 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:37.475900 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-56a40b62-6c35-410c-bfb6-3a8311d1ad57 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:37.500371 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-64735720-0afa-4fdd-b91c-a8bfbfa19006 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:37.518886 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-64735720-0afa-4fdd-b91c-a8bfbfa19006 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers/3d4188da-b0f7-4d97-952b-acebaa48f185" status: 200 len: 1512 microversion: 2.1 time: 0.569580 Oct 17 13:40:37.522131 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 914/1782] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:36 2022] GET /compute/v2.1/servers/3d4188da-b0f7-4d97-952b-acebaa48f185 => generated 1512 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:37.538014 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d456b88f-653c-47c3-b545-a9cb6badccb2 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:37.538652 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d456b88f-653c-47c3-b545-a9cb6badccb2 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9c6b4ed2-b111-41b0-9679-b66d386834b9] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:37.565239 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d456b88f-653c-47c3-b545-a9cb6badccb2 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:37.567296 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d456b88f-653c-47c3-b545-a9cb6badccb2 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:37.567868 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d456b88f-653c-47c3-b545-a9cb6badccb2 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:37.568703 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d456b88f-653c-47c3-b545-a9cb6badccb2 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:37.570684 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d456b88f-653c-47c3-b545-a9cb6badccb2 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:37.572869 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d456b88f-653c-47c3-b545-a9cb6badccb2 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:37.650933 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-56a40b62-6c35-410c-bfb6-3a8311d1ad57 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:37.670511 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-56a40b62-6c35-410c-bfb6-3a8311d1ad57 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f" status: 200 len: 1183 microversion: 2.1 time: 0.216439 Oct 17 13:40:37.683513 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 869/1783] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:37 2022] GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f => generated 1183 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:40:37.691711 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-81180847-7167-46ac-b3cf-b35a60ebb8eb tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd4fa3160>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:37.788756 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-81180847-7167-46ac-b3cf-b35a60ebb8eb tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/a8625a43-cc13-4579-b0e9-3ebd2183a277" status: 200 len: 1413 microversion: 2.1 time: 0.102797 Oct 17 13:40:37.789523 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 870/1784] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:40:37 2022] GET /compute/v2.1/images/a8625a43-cc13-4579-b0e9-3ebd2183a277 => generated 1413 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:37.810769 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-646beae0-387f-4f3c-a59e-15d322ad0d3c tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:37.811795 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-646beae0-387f-4f3c-a59e-15d322ad0d3c tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] [instance: d30452eb-38cd-413a-9369-f60aad1d31bb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:37.833071 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-646beae0-387f-4f3c-a59e-15d322ad0d3c tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:37.835298 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-646beae0-387f-4f3c-a59e-15d322ad0d3c tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:37.836503 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-646beae0-387f-4f3c-a59e-15d322ad0d3c tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:37.839054 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-646beae0-387f-4f3c-a59e-15d322ad0d3c tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:37.841705 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-646beae0-387f-4f3c-a59e-15d322ad0d3c tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:37.842426 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-646beae0-387f-4f3c-a59e-15d322ad0d3c tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:37.920628 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d456b88f-653c-47c3-b545-a9cb6badccb2 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:37.932539 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d456b88f-653c-47c3-b545-a9cb6badccb2 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9" status: 200 len: 1514 microversion: 2.1 time: 0.409105 Oct 17 13:40:37.934535 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 915/1785] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:37 2022] GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9 => generated 1514 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:38.107269 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e90d97b0-c199-4013-9beb-d1c2e70ebd78 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:38.108052 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e90d97b0-c199-4013-9beb-d1c2e70ebd78 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:38.139606 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e90d97b0-c199-4013-9beb-d1c2e70ebd78 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:38.140309 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e90d97b0-c199-4013-9beb-d1c2e70ebd78 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:38.141347 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e90d97b0-c199-4013-9beb-d1c2e70ebd78 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:38.142663 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e90d97b0-c199-4013-9beb-d1c2e70ebd78 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:38.144624 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e90d97b0-c199-4013-9beb-d1c2e70ebd78 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:38.145167 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e90d97b0-c199-4013-9beb-d1c2e70ebd78 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:38.166447 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-646beae0-387f-4f3c-a59e-15d322ad0d3c tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:38.181169 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-646beae0-387f-4f3c-a59e-15d322ad0d3c tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers/d30452eb-38cd-413a-9369-f60aad1d31bb" status: 200 len: 1511 microversion: 2.1 time: 0.383467 Oct 17 13:40:38.184066 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 871/1786] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:37 2022] GET /compute/v2.1/servers/d30452eb-38cd-413a-9369-f60aad1d31bb => generated 1511 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:38.208706 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-dd62c8ba-b24c-4666-9dee-fe8637a280c8 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:38.214853 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-dd62c8ba-b24c-4666-9dee-fe8637a280c8 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:38.215835 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-dd62c8ba-b24c-4666-9dee-fe8637a280c8 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '66d121d0b216416592c7048c2a46f625'} {{(pid=127016) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:40:38.229401 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dd62c8ba-b24c-4666-9dee-fe8637a280c8 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:38.229947 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dd62c8ba-b24c-4666-9dee-fe8637a280c8 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:38.230385 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dd62c8ba-b24c-4666-9dee-fe8637a280c8 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:38.231156 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dd62c8ba-b24c-4666-9dee-fe8637a280c8 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:38.232128 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dd62c8ba-b24c-4666-9dee-fe8637a280c8 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:38.232615 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dd62c8ba-b24c-4666-9dee-fe8637a280c8 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:38.294789 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e90d97b0-c199-4013-9beb-d1c2e70ebd78 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:38.304346 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e90d97b0-c199-4013-9beb-d1c2e70ebd78 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:38.305773 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e90d97b0-c199-4013-9beb-d1c2e70ebd78 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:38.335961 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e90d97b0-c199-4013-9beb-d1c2e70ebd78 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1537 microversion: 2.91 time: 0.233541 Oct 17 13:40:38.336467 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 916/1787] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:40:38 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1537 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:40:38.367983 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.multi_cell_list [None req-dd62c8ba-b24c-4666-9dee-fe8637a280c8 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127016) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:40:38.512643 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-dd62c8ba-b24c-4666-9dee-fe8637a280c8 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:38.524299 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dd62c8ba-b24c-4666-9dee-fe8637a280c8 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:38.528909 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dd62c8ba-b24c-4666-9dee-fe8637a280c8 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:38.528909 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dd62c8ba-b24c-4666-9dee-fe8637a280c8 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:38.709636 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b6ca3041-aeab-4d2f-b267-126414d263f5 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:38.710243 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b6ca3041-aeab-4d2f-b267-126414d263f5 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: fd365dc4-44c6-4a00-971e-2699762ab41f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:38.733356 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b6ca3041-aeab-4d2f-b267-126414d263f5 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:38.733865 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b6ca3041-aeab-4d2f-b267-126414d263f5 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:38.734305 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b6ca3041-aeab-4d2f-b267-126414d263f5 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:38.735101 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b6ca3041-aeab-4d2f-b267-126414d263f5 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:38.735247 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-dd62c8ba-b24c-4666-9dee-fe8637a280c8 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1516 microversion: 2.1 time: 0.530248 Oct 17 13:40:38.735582 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b6ca3041-aeab-4d2f-b267-126414d263f5 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:38.736002 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b6ca3041-aeab-4d2f-b267-126414d263f5 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:38.747888 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 872/1788] 10.222.0.79 () {58 vars in 1167 bytes} [Mon Oct 17 13:40:38 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1516 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:40:38.762968 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3cad0941-d342-4d11-8480-747e04de0720 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:38.776580 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3cad0941-d342-4d11-8480-747e04de0720 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:38.777861 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3cad0941-d342-4d11-8480-747e04de0720 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-641343426', 'deleted': False, 'project_id': '66d121d0b216416592c7048c2a46f625'} {{(pid=127016) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:40:38.791006 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3cad0941-d342-4d11-8480-747e04de0720 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:38.791734 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3cad0941-d342-4d11-8480-747e04de0720 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:38.793819 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3cad0941-d342-4d11-8480-747e04de0720 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:38.794771 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3cad0941-d342-4d11-8480-747e04de0720 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:38.795504 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3cad0941-d342-4d11-8480-747e04de0720 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:38.796250 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3cad0941-d342-4d11-8480-747e04de0720 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:38.868433 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b6ca3041-aeab-4d2f-b267-126414d263f5 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:38.878762 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b6ca3041-aeab-4d2f-b267-126414d263f5 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f" status: 200 len: 1183 microversion: 2.1 time: 0.172881 Oct 17 13:40:38.879425 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 917/1789] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:38 2022] GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f => generated 1183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:38.906377 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ad563542-2b7b-43ed-87e5-cee90b2ae40f tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd9a14a60>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:39.001733 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ad563542-2b7b-43ed-87e5-cee90b2ae40f tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/a8625a43-cc13-4579-b0e9-3ebd2183a277" status: 200 len: 1413 microversion: 2.1 time: 0.120942 Oct 17 13:40:39.006167 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 918/1790] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:40:38 2022] GET /compute/v2.1/images/a8625a43-cc13-4579-b0e9-3ebd2183a277 => generated 1413 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:39.025758 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.multi_cell_list [None req-3cad0941-d342-4d11-8480-747e04de0720 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127016) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:40:39.041271 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9d5628ef-d2ae-4ae6-be66-179a6743e42e tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:39.045812 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9d5628ef-d2ae-4ae6-be66-179a6743e42e tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9c6b4ed2-b111-41b0-9679-b66d386834b9] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:39.064353 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9d5628ef-d2ae-4ae6-be66-179a6743e42e tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:39.064840 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9d5628ef-d2ae-4ae6-be66-179a6743e42e tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:39.065278 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9d5628ef-d2ae-4ae6-be66-179a6743e42e tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:39.065987 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9d5628ef-d2ae-4ae6-be66-179a6743e42e tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:39.066430 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9d5628ef-d2ae-4ae6-be66-179a6743e42e tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:39.066845 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9d5628ef-d2ae-4ae6-be66-179a6743e42e tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:39.170559 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3cad0941-d342-4d11-8480-747e04de0720 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:39.180557 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:40:39.183850 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3cad0941-d342-4d11-8480-747e04de0720 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:39.186999 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3cad0941-d342-4d11-8480-747e04de0720 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:39.188658 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3cad0941-d342-4d11-8480-747e04de0720 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:39.520640 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9d5628ef-d2ae-4ae6-be66-179a6743e42e tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:39.527349 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9d5628ef-d2ae-4ae6-be66-179a6743e42e tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9" status: 200 len: 1514 microversion: 2.1 time: 0.518816 Oct 17 13:40:39.527935 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 919/1791] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:39 2022] GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9 => generated 1514 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:39.544367 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e690854e-a759-47d9-99fc-cddc717910b6 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:39.545016 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e690854e-a759-47d9-99fc-cddc717910b6 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:39.569679 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e690854e-a759-47d9-99fc-cddc717910b6 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:39.570310 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e690854e-a759-47d9-99fc-cddc717910b6 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:39.570752 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e690854e-a759-47d9-99fc-cddc717910b6 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:39.571502 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e690854e-a759-47d9-99fc-cddc717910b6 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:39.571998 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e690854e-a759-47d9-99fc-cddc717910b6 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:39.572426 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e690854e-a759-47d9-99fc-cddc717910b6 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:39.682370 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3cad0941-d342-4d11-8480-747e04de0720 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-641343426" status: 200 len: 1515 microversion: 2.1 time: 0.924672 Oct 17 13:40:39.683431 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 873/1792] 10.222.0.79 () {58 vars in 1261 bytes} [Mon Oct 17 13:40:38 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-641343426 => generated 1515 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:39.709220 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-67608169-0d53-4246-9358-d2ace84b7455 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:39.721140 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-67608169-0d53-4246-9358-d2ace84b7455 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:39.721955 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-67608169-0d53-4246-9358-d2ace84b7455 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '66d121d0b216416592c7048c2a46f625'} {{(pid=127016) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:40:39.739213 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-67608169-0d53-4246-9358-d2ace84b7455 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:39.739676 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-67608169-0d53-4246-9358-d2ace84b7455 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:39.740098 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-67608169-0d53-4246-9358-d2ace84b7455 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:39.740807 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-67608169-0d53-4246-9358-d2ace84b7455 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:39.741245 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-67608169-0d53-4246-9358-d2ace84b7455 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:39.741659 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-67608169-0d53-4246-9358-d2ace84b7455 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:39.754891 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e690854e-a759-47d9-99fc-cddc717910b6 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:39.769995 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e690854e-a759-47d9-99fc-cddc717910b6 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:39.772531 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e690854e-a759-47d9-99fc-cddc717910b6 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:39.779502 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e690854e-a759-47d9-99fc-cddc717910b6 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1537 microversion: 2.91 time: 0.250264 Oct 17 13:40:39.780431 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 920/1793] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:40:39 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1537 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:40:39.880246 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:40:39.907434 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-76e66117-7b59-4a57-89af-58831e6dbce7 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:39.910768 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-76e66117-7b59-4a57-89af-58831e6dbce7 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: fd365dc4-44c6-4a00-971e-2699762ab41f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:39.934467 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-76e66117-7b59-4a57-89af-58831e6dbce7 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:39.938968 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-76e66117-7b59-4a57-89af-58831e6dbce7 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:39.939778 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-76e66117-7b59-4a57-89af-58831e6dbce7 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:39.940899 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-76e66117-7b59-4a57-89af-58831e6dbce7 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:39.941575 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-76e66117-7b59-4a57-89af-58831e6dbce7 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:39.942215 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-76e66117-7b59-4a57-89af-58831e6dbce7 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:39.960573 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.multi_cell_list [None req-67608169-0d53-4246-9358-d2ace84b7455 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127016) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:40:40.114371 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-76e66117-7b59-4a57-89af-58831e6dbce7 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:40.137979 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-76e66117-7b59-4a57-89af-58831e6dbce7 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f" status: 200 len: 1183 microversion: 2.1 time: 0.228742 Oct 17 13:40:40.142199 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 921/1794] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:39 2022] GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f => generated 1183 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:40.155186 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-645a849a-d0ee-4986-8905-7a86befa394a tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd9a29670>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:40.187321 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-67608169-0d53-4246-9358-d2ace84b7455 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:40.206133 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-67608169-0d53-4246-9358-d2ace84b7455 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:40.209601 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-67608169-0d53-4246-9358-d2ace84b7455 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:40.210260 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-67608169-0d53-4246-9358-d2ace84b7455 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:40.245372 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-645a849a-d0ee-4986-8905-7a86befa394a tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/a8625a43-cc13-4579-b0e9-3ebd2183a277" status: 200 len: 1413 microversion: 2.1 time: 0.101854 Oct 17 13:40:40.246415 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 922/1795] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:40:40 2022] GET /compute/v2.1/images/a8625a43-cc13-4579-b0e9-3ebd2183a277 => generated 1413 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:40.504337 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-67608169-0d53-4246-9358-d2ace84b7455 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4519 microversion: 2.1 time: 0.801113 Oct 17 13:40:40.522018 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 874/1796] 10.222.0.79 () {58 vars in 1173 bytes} [Mon Oct 17 13:40:39 2022] GET /compute/v2.1/servers/detail?status=active => generated 4519 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:40:40.538210 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1e1d975f-67ab-44bc-9300-204d3d569d6b tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:40.543733 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1e1d975f-67ab-44bc-9300-204d3d569d6b tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:40.544204 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.compute.servers [None req-1e1d975f-67ab-44bc-9300-204d3d569d6b tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Removing options 'limit' from query {{(pid=127017) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 17 13:40:40.545083 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1e1d975f-67ab-44bc-9300-204d3d569d6b tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Searching by: {'deleted': False, 'project_id': '66d121d0b216416592c7048c2a46f625'} {{(pid=127017) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:40:40.554329 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7154e9a8-6beb-4ba2-ad21-5ae90401f06b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:40.554950 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7154e9a8-6beb-4ba2-ad21-5ae90401f06b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9c6b4ed2-b111-41b0-9679-b66d386834b9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:40.566460 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7154e9a8-6beb-4ba2-ad21-5ae90401f06b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:40.568299 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7154e9a8-6beb-4ba2-ad21-5ae90401f06b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:40.569202 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7154e9a8-6beb-4ba2-ad21-5ae90401f06b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:40.569933 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7154e9a8-6beb-4ba2-ad21-5ae90401f06b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:40.570394 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7154e9a8-6beb-4ba2-ad21-5ae90401f06b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:40.570981 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7154e9a8-6beb-4ba2-ad21-5ae90401f06b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:40.588419 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1e1d975f-67ab-44bc-9300-204d3d569d6b tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:40.588894 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1e1d975f-67ab-44bc-9300-204d3d569d6b tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:40.589325 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1e1d975f-67ab-44bc-9300-204d3d569d6b tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:40.590048 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1e1d975f-67ab-44bc-9300-204d3d569d6b tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:40.590508 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1e1d975f-67ab-44bc-9300-204d3d569d6b tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:40.590920 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1e1d975f-67ab-44bc-9300-204d3d569d6b tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:40.714969 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1e1d975f-67ab-44bc-9300-204d3d569d6b tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:40.724221 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1e1d975f-67ab-44bc-9300-204d3d569d6b tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:40.725534 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1e1d975f-67ab-44bc-9300-204d3d569d6b tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:40.726133 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1e1d975f-67ab-44bc-9300-204d3d569d6b tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:41.060044 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7154e9a8-6beb-4ba2-ad21-5ae90401f06b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:41.069963 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1e1d975f-67ab-44bc-9300-204d3d569d6b tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1662 microversion: 2.1 time: 0.536405 Oct 17 13:40:41.070828 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 923/1797] 10.222.0.79 () {58 vars in 1161 bytes} [Mon Oct 17 13:40:40 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1662 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:41.074523 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7154e9a8-6beb-4ba2-ad21-5ae90401f06b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9" status: 200 len: 1514 microversion: 2.1 time: 0.524368 Oct 17 13:40:41.076114 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 875/1798] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:40 2022] GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9 => generated 1514 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:41.096900 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4b637ccc-78aa-4264-8725-9d6433cfc1da tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:41.098553 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4b637ccc-78aa-4264-8725-9d6433cfc1da tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:41.115771 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4b637ccc-78aa-4264-8725-9d6433cfc1da tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:41.118769 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4b637ccc-78aa-4264-8725-9d6433cfc1da tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:41.119890 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4b637ccc-78aa-4264-8725-9d6433cfc1da tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:41.125421 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4b637ccc-78aa-4264-8725-9d6433cfc1da tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:41.126349 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4b637ccc-78aa-4264-8725-9d6433cfc1da tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:41.126872 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4b637ccc-78aa-4264-8725-9d6433cfc1da tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:41.129252 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-bc67ab63-87a0-4996-b180-704dba6f41ca tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:41.155446 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-bc67ab63-87a0-4996-b180-704dba6f41ca tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:41.156221 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-bc67ab63-87a0-4996-b180-704dba6f41ca tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '66d121d0b216416592c7048c2a46f625'} {{(pid=127016) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:40:41.179065 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=100 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:40:41.186961 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bc67ab63-87a0-4996-b180-704dba6f41ca tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:41.188119 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bc67ab63-87a0-4996-b180-704dba6f41ca tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:41.189625 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bc67ab63-87a0-4996-b180-704dba6f41ca tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:41.192007 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bc67ab63-87a0-4996-b180-704dba6f41ca tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:41.195909 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bc67ab63-87a0-4996-b180-704dba6f41ca tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:41.196549 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bc67ab63-87a0-4996-b180-704dba6f41ca tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:41.266339 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.multi_cell_list [None req-bc67ab63-87a0-4996-b180-704dba6f41ca tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127016) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:40:41.269691 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4b637ccc-78aa-4264-8725-9d6433cfc1da tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:41.280339 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4b637ccc-78aa-4264-8725-9d6433cfc1da tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:41.286483 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4b637ccc-78aa-4264-8725-9d6433cfc1da tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:41.300414 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4b637ccc-78aa-4264-8725-9d6433cfc1da tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1537 microversion: 2.91 time: 0.228132 Oct 17 13:40:41.319574 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 924/1799] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:40:41 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1537 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:40:41.328153 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-23a87f03-c15c-47cc-a6db-9363415f7fbd tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:41.328920 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-23a87f03-c15c-47cc-a6db-9363415f7fbd tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: fd365dc4-44c6-4a00-971e-2699762ab41f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:41.335944 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-23a87f03-c15c-47cc-a6db-9363415f7fbd tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:41.336752 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-23a87f03-c15c-47cc-a6db-9363415f7fbd tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:41.337482 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-23a87f03-c15c-47cc-a6db-9363415f7fbd tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:41.338752 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-23a87f03-c15c-47cc-a6db-9363415f7fbd tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:41.339351 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-23a87f03-c15c-47cc-a6db-9363415f7fbd tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:41.339886 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-23a87f03-c15c-47cc-a6db-9363415f7fbd tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:41.359047 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-bc67ab63-87a0-4996-b180-704dba6f41ca tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers?status=active" status: 200 len: 1010 microversion: 2.1 time: 0.254467 Oct 17 13:40:41.360115 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 876/1800] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Oct 17 13:40:41 2022] GET /compute/v2.1/servers?status=active => generated 1010 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:41.372083 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7f9d8631-0673-433b-bcc9-dc17a026a1d0 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd4f550d0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:41.475419 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-23a87f03-c15c-47cc-a6db-9363415f7fbd tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:41.493209 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7f9d8631-0673-433b-bcc9-dc17a026a1d0 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/a8625a43-cc13-4579-b0e9-3ebd2183a277" status: 200 len: 1413 microversion: 2.1 time: 0.131959 Oct 17 13:40:41.493850 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 877/1801] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:40:41 2022] GET /compute/v2.1/images/a8625a43-cc13-4579-b0e9-3ebd2183a277 => generated 1413 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:41.504555 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-23a87f03-c15c-47cc-a6db-9363415f7fbd tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f" status: 200 len: 1183 microversion: 2.1 time: 0.183633 Oct 17 13:40:41.514237 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 925/1802] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:41 2022] GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f => generated 1183 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:41.520308 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-da73804e-1ba3-4fe7-a899-c6b4b92c3e22 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:41.536397 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-da73804e-1ba3-4fe7-a899-c6b4b92c3e22 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:41.538658 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.compute.servers [None req-da73804e-1ba3-4fe7-a899-c6b4b92c3e22 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Removing options 'limit' from query {{(pid=127016) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 17 13:40:41.542164 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-da73804e-1ba3-4fe7-a899-c6b4b92c3e22 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Searching by: {'deleted': False, 'project_id': '66d121d0b216416592c7048c2a46f625'} {{(pid=127016) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:40:41.554889 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-da73804e-1ba3-4fe7-a899-c6b4b92c3e22 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:41.555622 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-da73804e-1ba3-4fe7-a899-c6b4b92c3e22 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:41.557915 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-da73804e-1ba3-4fe7-a899-c6b4b92c3e22 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:41.560865 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-da73804e-1ba3-4fe7-a899-c6b4b92c3e22 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:41.561636 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-da73804e-1ba3-4fe7-a899-c6b4b92c3e22 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:41.564088 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-da73804e-1ba3-4fe7-a899-c6b4b92c3e22 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:41.623055 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.multi_cell_list [None req-da73804e-1ba3-4fe7-a899-c6b4b92c3e22 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127016) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:40:41.685897 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-da73804e-1ba3-4fe7-a899-c6b4b92c3e22 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1010 microversion: 2.1 time: 0.181955 Oct 17 13:40:41.686492 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 878/1803] 10.222.0.79 () {58 vars in 1150 bytes} [Mon Oct 17 13:40:41 2022] GET /compute/v2.1/servers?limit=100000 => generated 1010 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:41.700306 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9d22fb20-ce0c-46da-b784-a94dd4c2827e tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:41.705633 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9d22fb20-ce0c-46da-b784-a94dd4c2827e tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:41.706301 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9d22fb20-ce0c-46da-b784-a94dd4c2827e tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Searching by: {'deleted': False, 'project_id': '66d121d0b216416592c7048c2a46f625'} {{(pid=127017) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:40:41.730019 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9d22fb20-ce0c-46da-b784-a94dd4c2827e tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:41.730513 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9d22fb20-ce0c-46da-b784-a94dd4c2827e tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:41.730956 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9d22fb20-ce0c-46da-b784-a94dd4c2827e tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:41.731716 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9d22fb20-ce0c-46da-b784-a94dd4c2827e tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:41.732174 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9d22fb20-ce0c-46da-b784-a94dd4c2827e tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:41.737723 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9d22fb20-ce0c-46da-b784-a94dd4c2827e tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:41.809983 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.multi_cell_list [None req-9d22fb20-ce0c-46da-b784-a94dd4c2827e tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127017) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:40:41.898633 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9d22fb20-ce0c-46da-b784-a94dd4c2827e tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers" status: 200 len: 1010 microversion: 2.1 time: 0.203182 Oct 17 13:40:41.903304 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 926/1804] 10.222.0.79 () {58 vars in 1125 bytes} [Mon Oct 17 13:40:41 2022] GET /compute/v2.1/servers => generated 1010 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:41.940145 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-fc62e9b3-0b90-49d1-8089-34d71afd778f tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:41.947275 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-fc62e9b3-0b90-49d1-8089-34d71afd778f tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:41.948043 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-fc62e9b3-0b90-49d1-8089-34d71afd778f tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '66d121d0b216416592c7048c2a46f625'} {{(pid=127017) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:40:41.962778 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fc62e9b3-0b90-49d1-8089-34d71afd778f tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:41.965364 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fc62e9b3-0b90-49d1-8089-34d71afd778f tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:41.966577 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fc62e9b3-0b90-49d1-8089-34d71afd778f tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:41.968085 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fc62e9b3-0b90-49d1-8089-34d71afd778f tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:41.968733 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fc62e9b3-0b90-49d1-8089-34d71afd778f tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:41.969320 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fc62e9b3-0b90-49d1-8089-34d71afd778f tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:41.998532 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-837a0c0b-9a0b-4568-9c3e-1d3e28e99932 tempest-ServicesAdminTestJSON-42399611 tempest-ServicesAdminTestJSON-42399611-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:42.003062 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-837a0c0b-9a0b-4568-9c3e-1d3e28e99932 tempest-ServicesAdminTestJSON-42399611 tempest-ServicesAdminTestJSON-42399611-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:42.003677 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-837a0c0b-9a0b-4568-9c3e-1d3e28e99932 tempest-ServicesAdminTestJSON-42399611 tempest-ServicesAdminTestJSON-42399611-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:42.004116 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-837a0c0b-9a0b-4568-9c3e-1d3e28e99932 tempest-ServicesAdminTestJSON-42399611 tempest-ServicesAdminTestJSON-42399611-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:42.004923 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-837a0c0b-9a0b-4568-9c3e-1d3e28e99932 tempest-ServicesAdminTestJSON-42399611 tempest-ServicesAdminTestJSON-42399611-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:42.005382 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-837a0c0b-9a0b-4568-9c3e-1d3e28e99932 tempest-ServicesAdminTestJSON-42399611 tempest-ServicesAdminTestJSON-42399611-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:42.005987 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-837a0c0b-9a0b-4568-9c3e-1d3e28e99932 tempest-ServicesAdminTestJSON-42399611 tempest-ServicesAdminTestJSON-42399611-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:42.057493 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-837a0c0b-9a0b-4568-9c3e-1d3e28e99932 tempest-ServicesAdminTestJSON-42399611 tempest-ServicesAdminTestJSON-42399611-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.315040 Oct 17 13:40:42.058565 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 879/1805] 10.222.0.79 () {58 vars in 1137 bytes} [Mon Oct 17 13:40:41 2022] GET /compute/v2.1/os-services => generated 949 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:40:42.071272 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b333fdbd-0a1f-4fa3-a090-7699dedbc5b8 tempest-ServicesAdminTestJSON-42399611 tempest-ServicesAdminTestJSON-42399611-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:42.075408 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b333fdbd-0a1f-4fa3-a090-7699dedbc5b8 tempest-ServicesAdminTestJSON-42399611 tempest-ServicesAdminTestJSON-42399611-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:42.075903 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b333fdbd-0a1f-4fa3-a090-7699dedbc5b8 tempest-ServicesAdminTestJSON-42399611 tempest-ServicesAdminTestJSON-42399611-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:42.079483 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b333fdbd-0a1f-4fa3-a090-7699dedbc5b8 tempest-ServicesAdminTestJSON-42399611 tempest-ServicesAdminTestJSON-42399611-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:42.080505 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b333fdbd-0a1f-4fa3-a090-7699dedbc5b8 tempest-ServicesAdminTestJSON-42399611 tempest-ServicesAdminTestJSON-42399611-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:42.084548 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b333fdbd-0a1f-4fa3-a090-7699dedbc5b8 tempest-ServicesAdminTestJSON-42399611 tempest-ServicesAdminTestJSON-42399611-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:42.085188 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b333fdbd-0a1f-4fa3-a090-7699dedbc5b8 tempest-ServicesAdminTestJSON-42399611 tempest-ServicesAdminTestJSON-42399611-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:42.113251 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.multi_cell_list [None req-fc62e9b3-0b90-49d1-8089-34d71afd778f tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127017) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:40:42.121538 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b333fdbd-0a1f-4fa3-a090-7699dedbc5b8 tempest-ServicesAdminTestJSON-42399611 tempest-ServicesAdminTestJSON-42399611-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?host=n-d-854247-14" status: 200 len: 581 microversion: 2.1 time: 0.054081 Oct 17 13:40:42.122805 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 880/1806] 10.222.0.79 () {58 vars in 1174 bytes} [Mon Oct 17 13:40:42 2022] GET /compute/v2.1/os-services?host=n-d-854247-14 => generated 581 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:40:42.128477 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0bffff16-c5a2-41fc-8e0c-34a4d37d4973 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:42.129522 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0bffff16-c5a2-41fc-8e0c-34a4d37d4973 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9c6b4ed2-b111-41b0-9679-b66d386834b9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:42.139149 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0bffff16-c5a2-41fc-8e0c-34a4d37d4973 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:42.139972 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0bffff16-c5a2-41fc-8e0c-34a4d37d4973 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:42.141251 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0bffff16-c5a2-41fc-8e0c-34a4d37d4973 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:42.142120 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0bffff16-c5a2-41fc-8e0c-34a4d37d4973 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:42.142778 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0bffff16-c5a2-41fc-8e0c-34a4d37d4973 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:42.143411 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0bffff16-c5a2-41fc-8e0c-34a4d37d4973 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:42.242371 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-fc62e9b3-0b90-49d1-8089-34d71afd778f tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.316092 Oct 17 13:40:42.250923 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 927/1807] 10.222.0.79 () {58 vars in 1146 bytes} [Mon Oct 17 13:40:41 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:40:42.253125 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5b878aee-9d8b-49ac-8703-7f0496d6dc87 tempest-ServicesAdminTestJSON-42399611 tempest-ServicesAdminTestJSON-42399611-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:42.266027 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5b878aee-9d8b-49ac-8703-7f0496d6dc87 tempest-ServicesAdminTestJSON-42399611 tempest-ServicesAdminTestJSON-42399611-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:42.266516 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5b878aee-9d8b-49ac-8703-7f0496d6dc87 tempest-ServicesAdminTestJSON-42399611 tempest-ServicesAdminTestJSON-42399611-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:42.267130 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5b878aee-9d8b-49ac-8703-7f0496d6dc87 tempest-ServicesAdminTestJSON-42399611 tempest-ServicesAdminTestJSON-42399611-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:42.268751 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5b878aee-9d8b-49ac-8703-7f0496d6dc87 tempest-ServicesAdminTestJSON-42399611 tempest-ServicesAdminTestJSON-42399611-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:42.268751 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5b878aee-9d8b-49ac-8703-7f0496d6dc87 tempest-ServicesAdminTestJSON-42399611 tempest-ServicesAdminTestJSON-42399611-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:42.268751 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5b878aee-9d8b-49ac-8703-7f0496d6dc87 tempest-ServicesAdminTestJSON-42399611 tempest-ServicesAdminTestJSON-42399611-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:42.290763 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:40:42.320861 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5b878aee-9d8b-49ac-8703-7f0496d6dc87 tempest-ServicesAdminTestJSON-42399611 tempest-ServicesAdminTestJSON-42399611-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.075882 Oct 17 13:40:42.329435 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 928/1808] 10.222.0.79 () {58 vars in 1176 bytes} [Mon Oct 17 13:40:42 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:40:42.337746 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-272273d9-9f61-4d2a-9222-8df4abbf0c42 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:42.343125 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-272273d9-9f61-4d2a-9222-8df4abbf0c42 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:42.348101 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.compute.servers [None req-272273d9-9f61-4d2a-9222-8df4abbf0c42 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Removing options 'limit' from query {{(pid=127017) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 17 13:40:42.354411 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-272273d9-9f61-4d2a-9222-8df4abbf0c42 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Searching by: {'deleted': False, 'project_id': '66d121d0b216416592c7048c2a46f625'} {{(pid=127017) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:40:42.375714 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-272273d9-9f61-4d2a-9222-8df4abbf0c42 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:42.376832 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-272273d9-9f61-4d2a-9222-8df4abbf0c42 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:42.378461 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-272273d9-9f61-4d2a-9222-8df4abbf0c42 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:42.379349 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-272273d9-9f61-4d2a-9222-8df4abbf0c42 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:42.381693 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-272273d9-9f61-4d2a-9222-8df4abbf0c42 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:42.382144 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-272273d9-9f61-4d2a-9222-8df4abbf0c42 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:42.402830 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0bffff16-c5a2-41fc-8e0c-34a4d37d4973 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:42.419448 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0bffff16-c5a2-41fc-8e0c-34a4d37d4973 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9" status: 200 len: 1514 microversion: 2.1 time: 0.293734 Oct 17 13:40:42.447803 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 881/1809] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:42 2022] GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9 => generated 1514 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:42.455585 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fe547e99-32d7-4259-a8c4-663f318653e3 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:42.456091 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-272273d9-9f61-4d2a-9222-8df4abbf0c42 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.126196 Oct 17 13:40:42.456771 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-fe547e99-32d7-4259-a8c4-663f318653e3 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:42.456906 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 929/1810] 10.222.0.79 () {58 vars in 1140 bytes} [Mon Oct 17 13:40:42 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:40:42.468322 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-85d7a020-f09b-482e-8661-2ebeea56556b tempest-ServicesAdminTestJSON-42399611 tempest-ServicesAdminTestJSON-42399611-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:42.469049 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe547e99-32d7-4259-a8c4-663f318653e3 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:42.469780 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe547e99-32d7-4259-a8c4-663f318653e3 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:42.470414 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe547e99-32d7-4259-a8c4-663f318653e3 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:42.471445 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe547e99-32d7-4259-a8c4-663f318653e3 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:42.472197 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe547e99-32d7-4259-a8c4-663f318653e3 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:42.472973 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe547e99-32d7-4259-a8c4-663f318653e3 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:42.473150 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-85d7a020-f09b-482e-8661-2ebeea56556b tempest-ServicesAdminTestJSON-42399611 tempest-ServicesAdminTestJSON-42399611-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:42.473646 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-85d7a020-f09b-482e-8661-2ebeea56556b tempest-ServicesAdminTestJSON-42399611 tempest-ServicesAdminTestJSON-42399611-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:42.474095 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-85d7a020-f09b-482e-8661-2ebeea56556b tempest-ServicesAdminTestJSON-42399611 tempest-ServicesAdminTestJSON-42399611-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:42.474819 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-85d7a020-f09b-482e-8661-2ebeea56556b tempest-ServicesAdminTestJSON-42399611 tempest-ServicesAdminTestJSON-42399611-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:42.475299 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-85d7a020-f09b-482e-8661-2ebeea56556b tempest-ServicesAdminTestJSON-42399611 tempest-ServicesAdminTestJSON-42399611-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:42.475856 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-85d7a020-f09b-482e-8661-2ebeea56556b tempest-ServicesAdminTestJSON-42399611 tempest-ServicesAdminTestJSON-42399611-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:42.504775 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-85d7a020-f09b-482e-8661-2ebeea56556b tempest-ServicesAdminTestJSON-42399611 tempest-ServicesAdminTestJSON-42399611-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.046276 Oct 17 13:40:42.505541 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 930/1811] 10.222.0.79 () {58 vars in 1137 bytes} [Mon Oct 17 13:40:42 2022] GET /compute/v2.1/os-services => generated 949 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:40:42.510450 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d0b75f1e-6017-4c47-a211-3893daeccfc4 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:42.517484 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d0b75f1e-6017-4c47-a211-3893daeccfc4 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:42.518119 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d0b75f1e-6017-4c47-a211-3893daeccfc4 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-641343426', 'deleted': False, 'project_id': '66d121d0b216416592c7048c2a46f625'} {{(pid=127017) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:40:42.525856 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d0b75f1e-6017-4c47-a211-3893daeccfc4 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:42.526341 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d0b75f1e-6017-4c47-a211-3893daeccfc4 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:42.526790 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d0b75f1e-6017-4c47-a211-3893daeccfc4 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:42.527679 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d0b75f1e-6017-4c47-a211-3893daeccfc4 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:42.528134 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d0b75f1e-6017-4c47-a211-3893daeccfc4 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:42.528563 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d0b75f1e-6017-4c47-a211-3893daeccfc4 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:42.597323 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fe547e99-32d7-4259-a8c4-663f318653e3 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:42.620873 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fe547e99-32d7-4259-a8c4-663f318653e3 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:42.627538 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fe547e99-32d7-4259-a8c4-663f318653e3 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:42.647648 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fe547e99-32d7-4259-a8c4-663f318653e3 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1537 microversion: 2.91 time: 0.193166 Oct 17 13:40:42.649971 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.multi_cell_list [None req-d0b75f1e-6017-4c47-a211-3893daeccfc4 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127017) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:40:42.675628 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 882/1812] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:40:42 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1537 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:40:42.693679 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-dab77395-a0a5-4a59-845d-d6f2a1e401b2 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd4d63790>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:42.768681 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d0b75f1e-6017-4c47-a211-3893daeccfc4 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-641343426" status: 200 len: 345 microversion: 2.1 time: 0.261766 Oct 17 13:40:42.769386 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 931/1813] 10.222.0.79 () {58 vars in 1240 bytes} [Mon Oct 17 13:40:42 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-641343426 => generated 345 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:40:42.782727 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-dab77395-a0a5-4a59-845d-d6f2a1e401b2 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/a8625a43-cc13-4579-b0e9-3ebd2183a277" status: 200 len: 1413 microversion: 2.1 time: 0.106054 Oct 17 13:40:42.783557 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 883/1814] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:40:42 2022] GET /compute/v2.1/images/a8625a43-cc13-4579-b0e9-3ebd2183a277 => generated 1413 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:42.784090 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d5187134-9c2d-422d-a9bf-661f49d1f843 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:42.784841 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d5187134-9c2d-422d-a9bf-661f49d1f843 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: fd365dc4-44c6-4a00-971e-2699762ab41f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:42.793140 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fa7e3c02-044b-4c43-b8b1-4c682e6bfb19 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:42.798009 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d5187134-9c2d-422d-a9bf-661f49d1f843 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:42.798691 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d5187134-9c2d-422d-a9bf-661f49d1f843 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:42.801128 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d5187134-9c2d-422d-a9bf-661f49d1f843 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:42.804770 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d5187134-9c2d-422d-a9bf-661f49d1f843 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:42.805412 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d5187134-9c2d-422d-a9bf-661f49d1f843 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:42.805931 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d5187134-9c2d-422d-a9bf-661f49d1f843 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:42.807653 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fa7e3c02-044b-4c43-b8b1-4c682e6bfb19 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:42.808787 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fa7e3c02-044b-4c43-b8b1-4c682e6bfb19 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:42.808940 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fa7e3c02-044b-4c43-b8b1-4c682e6bfb19 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:42.844420 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-d5187134-9c2d-422d-a9bf-661f49d1f843 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] HTTP exception thrown: Instance fd365dc4-44c6-4a00-971e-2699762ab41f could not be found. Oct 17 13:40:42.848113 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d5187134-9c2d-422d-a9bf-661f49d1f843 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Request method failure captured: Oct 17 13:40:42.848113 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f HTTP/1.1 Oct 17 13:40:42.848113 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:40:42.848113 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:40:42.848113 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:40:42.848113 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:40:42.848113 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:40:42.848113 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:40:42.848113 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:40:42.848113 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:40:42.848113 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVnf7-Dca7FemnEfwN1PP70lPaklLhr73YscDZW-kH2dv9JufJhPrvu4B01Xz8mp5WeJNf6wVLfrcVKnHMZ0ejiaugm7o2xbOLsMKgoKWmbTZvm4LNm375rjAD4LdzC1RuTZUuDbYqOIeHyYqmXioD65BcGywVZd7DddcEolMO-Fowg Oct 17 13:40:42.848113 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:40:42.848113 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:40:42.848113 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:40:42.848113 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:40:42.848113 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:40:42.848113 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:40:42.848113 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: ccf0569de787477e964f570378d6459a Oct 17 13:40:42.848113 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-LiveMigrationTest-840909216 Oct 17 13:40:42.848113 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:40:42.848113 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:40:42.849580 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ccf0569de787477e964f570378d6459a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ccf0569de787477e964f570378d6459a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ccf0569de787477e964f570378d6459a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ccf0569de787477e964f570378d6459a", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:40:42.849580 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-LiveMigrationTest-840909216 Oct 17 13:40:42.849580 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: ccf0569de787477e964f570378d6459a Oct 17 13:40:42.849580 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-LiveMigrationTest-840909216 Oct 17 13:40:42.849580 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-LiveMigrationTest-840909216-project Oct 17 13:40:42.849580 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:40:42.849580 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:40:42.849580 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 62cc720667f44772988d7890c227b217 Oct 17 13:40:42.849580 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-LiveMigrationTest-840909216-project Oct 17 13:40:42.849580 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:40:42.849580 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance fd365dc4-44c6-4a00-971e-2699762ab41f could not be found. Oct 17 13:40:42.849580 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'fd365dc4-44c6-4a00-971e-2699762ab41f'} Oct 17 13:40:42.850406 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:40:42.850406 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:40:42.850406 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:40:42.850406 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:40:42.850406 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:40:42.850406 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:40:42.850406 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:40:42.850406 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:40:42.850406 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:40:42.850406 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:40:42.850406 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd365dc4-44c6-4a00-971e-2699762ab41f could not be found. Oct 17 13:40:42.850406 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:40:42.850406 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:40:42.850406 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:40:42.850406 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:40:42.850406 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:40:42.850406 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:40:42.850406 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:40:42.850406 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:40:42.850406 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:40:42.852787 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:40:42.852787 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:40:42.852787 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:40:42.852787 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:40:42.852787 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:40:42.852787 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:40:42.852787 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:40:42.852787 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd365dc4-44c6-4a00-971e-2699762ab41f could not be found. Oct 17 13:40:42.852787 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:40:42.852787 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:40:42.852787 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:40:42.852787 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:40:42.852787 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:40:42.852787 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:40:42.852787 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:40:42.852787 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:40:42.852787 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd365dc4-44c6-4a00-971e-2699762ab41f could not be found. Oct 17 13:40:42.852787 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:40:42.862793 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d5187134-9c2d-422d-a9bf-661f49d1f843 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Returning 404 to user: Instance fd365dc4-44c6-4a00-971e-2699762ab41f could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:40:42.867312 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d5187134-9c2d-422d-a9bf-661f49d1f843 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f" status: 404 len: 111 microversion: 2.1 time: 0.094906 Oct 17 13:40:42.869440 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 932/1815] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:42 2022] GET /compute/v2.1/servers/fd365dc4-44c6-4a00-971e-2699762ab41f => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:40:42.911066 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-fa7e3c02-044b-4c43-b8b1-4c682e6bfb19 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] [instance: 3d4188da-b0f7-4d97-952b-acebaa48f185] Going to try to stop instance {{(pid=127016) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 17 13:40:43.029781 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fa7e3c02-044b-4c43-b8b1-4c682e6bfb19 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "POST /compute/v2.1/servers/3d4188da-b0f7-4d97-952b-acebaa48f185/action" status: 202 len: 0 microversion: 2.1 time: 0.243333 Oct 17 13:40:43.032104 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 884/1816] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:40:42 2022] POST /compute/v2.1/servers/3d4188da-b0f7-4d97-952b-acebaa48f185/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:40:43.040679 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-492cc353-775d-4d5c-915c-d38133b1664c tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:43.041547 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-492cc353-775d-4d5c-915c-d38133b1664c tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] [instance: 3d4188da-b0f7-4d97-952b-acebaa48f185] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:43.054344 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-492cc353-775d-4d5c-915c-d38133b1664c tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:43.056222 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-492cc353-775d-4d5c-915c-d38133b1664c tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:43.058350 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-492cc353-775d-4d5c-915c-d38133b1664c tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:43.060457 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-492cc353-775d-4d5c-915c-d38133b1664c tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:43.064837 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-492cc353-775d-4d5c-915c-d38133b1664c tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:43.065679 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-492cc353-775d-4d5c-915c-d38133b1664c tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:43.446188 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-38c40d21-d3aa-4fbe-83fb-c94ea35af32f tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:43.456930 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-38c40d21-d3aa-4fbe-83fb-c94ea35af32f tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9c6b4ed2-b111-41b0-9679-b66d386834b9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:43.485233 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-38c40d21-d3aa-4fbe-83fb-c94ea35af32f tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:43.485873 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-38c40d21-d3aa-4fbe-83fb-c94ea35af32f tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:43.488094 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-38c40d21-d3aa-4fbe-83fb-c94ea35af32f tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:43.488868 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-38c40d21-d3aa-4fbe-83fb-c94ea35af32f tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:43.489149 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-492cc353-775d-4d5c-915c-d38133b1664c tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:43.489573 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-38c40d21-d3aa-4fbe-83fb-c94ea35af32f tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:43.489744 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-38c40d21-d3aa-4fbe-83fb-c94ea35af32f tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:43.503784 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-492cc353-775d-4d5c-915c-d38133b1664c tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers/3d4188da-b0f7-4d97-952b-acebaa48f185" status: 200 len: 1522 microversion: 2.1 time: 0.468263 Oct 17 13:40:43.509735 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 933/1817] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:43 2022] GET /compute/v2.1/servers/3d4188da-b0f7-4d97-952b-acebaa48f185 => generated 1522 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:43.679381 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c47d906b-3dec-40c5-bbb0-215164a13e28 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:43.680708 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c47d906b-3dec-40c5-bbb0-215164a13e28 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:43.690362 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c47d906b-3dec-40c5-bbb0-215164a13e28 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:43.701202 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c47d906b-3dec-40c5-bbb0-215164a13e28 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:43.701941 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c47d906b-3dec-40c5-bbb0-215164a13e28 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:43.702900 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c47d906b-3dec-40c5-bbb0-215164a13e28 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:43.703645 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c47d906b-3dec-40c5-bbb0-215164a13e28 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:43.704295 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c47d906b-3dec-40c5-bbb0-215164a13e28 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:43.815011 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c47d906b-3dec-40c5-bbb0-215164a13e28 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:43.822445 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-38c40d21-d3aa-4fbe-83fb-c94ea35af32f tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:43.828028 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c47d906b-3dec-40c5-bbb0-215164a13e28 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:43.831950 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c47d906b-3dec-40c5-bbb0-215164a13e28 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:43.832176 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-38c40d21-d3aa-4fbe-83fb-c94ea35af32f tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9" status: 200 len: 1514 microversion: 2.1 time: 0.390265 Oct 17 13:40:43.840895 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 885/1818] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:43 2022] GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9 => generated 1514 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:40:43.856196 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-470db257-a7fa-4d17-a7ca-a1009dd0f98e tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd4cb34c0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:43.863440 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c47d906b-3dec-40c5-bbb0-215164a13e28 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1537 microversion: 2.91 time: 0.187988 Oct 17 13:40:43.868837 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 934/1819] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:40:43 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1537 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:40:43.928530 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-470db257-a7fa-4d17-a7ca-a1009dd0f98e tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/a8625a43-cc13-4579-b0e9-3ebd2183a277" status: 200 len: 1413 microversion: 2.1 time: 0.089324 Oct 17 13:40:43.931022 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 886/1820] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:40:43 2022] GET /compute/v2.1/images/a8625a43-cc13-4579-b0e9-3ebd2183a277 => generated 1413 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:44.538814 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9ee9e78f-450f-48f7-9ec1-4e97e2f2dedc tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:44.540177 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9ee9e78f-450f-48f7-9ec1-4e97e2f2dedc tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] [instance: 3d4188da-b0f7-4d97-952b-acebaa48f185] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:44.547943 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9ee9e78f-450f-48f7-9ec1-4e97e2f2dedc tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:44.548970 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9ee9e78f-450f-48f7-9ec1-4e97e2f2dedc tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:44.549763 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9ee9e78f-450f-48f7-9ec1-4e97e2f2dedc tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:44.550689 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9ee9e78f-450f-48f7-9ec1-4e97e2f2dedc tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:44.552517 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9ee9e78f-450f-48f7-9ec1-4e97e2f2dedc tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:44.553227 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9ee9e78f-450f-48f7-9ec1-4e97e2f2dedc tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:44.854617 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9ee9e78f-450f-48f7-9ec1-4e97e2f2dedc tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:44.864480 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9ee9e78f-450f-48f7-9ec1-4e97e2f2dedc tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers/3d4188da-b0f7-4d97-952b-acebaa48f185" status: 200 len: 1522 microversion: 2.1 time: 0.330758 Oct 17 13:40:44.865972 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fb138a45-992d-413e-a082-53ce02ba6776 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:44.867635 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-fb138a45-992d-413e-a082-53ce02ba6776 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9c6b4ed2-b111-41b0-9679-b66d386834b9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:44.877801 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 935/1821] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:44 2022] GET /compute/v2.1/servers/3d4188da-b0f7-4d97-952b-acebaa48f185 => generated 1522 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:44.896783 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fb138a45-992d-413e-a082-53ce02ba6776 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:44.898476 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fb138a45-992d-413e-a082-53ce02ba6776 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:44.898876 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-451a37cd-37a5-4d70-b790-7388a72ca6c7 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:44.899026 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fb138a45-992d-413e-a082-53ce02ba6776 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:44.899885 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-451a37cd-37a5-4d70-b790-7388a72ca6c7 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:44.902035 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fb138a45-992d-413e-a082-53ce02ba6776 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:44.906912 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fb138a45-992d-413e-a082-53ce02ba6776 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:44.907451 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fb138a45-992d-413e-a082-53ce02ba6776 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:44.911987 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-451a37cd-37a5-4d70-b790-7388a72ca6c7 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:44.912875 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-451a37cd-37a5-4d70-b790-7388a72ca6c7 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:44.913589 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-451a37cd-37a5-4d70-b790-7388a72ca6c7 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:44.914517 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-451a37cd-37a5-4d70-b790-7388a72ca6c7 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:44.917312 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-451a37cd-37a5-4d70-b790-7388a72ca6c7 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:44.917941 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-451a37cd-37a5-4d70-b790-7388a72ca6c7 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:45.171696 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-451a37cd-37a5-4d70-b790-7388a72ca6c7 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:45.200581 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-451a37cd-37a5-4d70-b790-7388a72ca6c7 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:45.207696 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-451a37cd-37a5-4d70-b790-7388a72ca6c7 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:45.227442 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-451a37cd-37a5-4d70-b790-7388a72ca6c7 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1537 microversion: 2.91 time: 0.330319 Oct 17 13:40:45.232524 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 936/1822] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:40:44 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1537 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:40:45.244933 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-87148d22-3f0b-4f13-94f8-5a4df42ad11e tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd9a8be50>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:45.364251 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-87148d22-3f0b-4f13-94f8-5a4df42ad11e tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/a8625a43-cc13-4579-b0e9-3ebd2183a277" status: 200 len: 1413 microversion: 2.1 time: 0.130260 Oct 17 13:40:45.372244 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 937/1823] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:40:45 2022] GET /compute/v2.1/images/a8625a43-cc13-4579-b0e9-3ebd2183a277 => generated 1413 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:45.472673 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fb138a45-992d-413e-a082-53ce02ba6776 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:45.488115 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fb138a45-992d-413e-a082-53ce02ba6776 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9" status: 200 len: 1514 microversion: 2.1 time: 0.626086 Oct 17 13:40:45.489038 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 887/1824] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:44 2022] GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9 => generated 1514 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:40:45.890853 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f284e8f6-275b-414b-a541-f296f518b8be tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:45.892145 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f284e8f6-275b-414b-a541-f296f518b8be tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] [instance: 3d4188da-b0f7-4d97-952b-acebaa48f185] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:45.905861 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f284e8f6-275b-414b-a541-f296f518b8be tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:45.906760 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f284e8f6-275b-414b-a541-f296f518b8be tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:45.907438 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f284e8f6-275b-414b-a541-f296f518b8be tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:45.908523 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f284e8f6-275b-414b-a541-f296f518b8be tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:45.909829 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f284e8f6-275b-414b-a541-f296f518b8be tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:45.910153 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f284e8f6-275b-414b-a541-f296f518b8be tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:46.176777 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f284e8f6-275b-414b-a541-f296f518b8be tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:46.188722 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f284e8f6-275b-414b-a541-f296f518b8be tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers/3d4188da-b0f7-4d97-952b-acebaa48f185" status: 200 len: 1522 microversion: 2.1 time: 0.301807 Oct 17 13:40:46.189947 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 938/1825] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:45 2022] GET /compute/v2.1/servers/3d4188da-b0f7-4d97-952b-acebaa48f185 => generated 1522 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:46.264331 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d98b10bb-244a-424c-8be9-a7e205f2bb4e tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:46.265559 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d98b10bb-244a-424c-8be9-a7e205f2bb4e tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:46.282101 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d98b10bb-244a-424c-8be9-a7e205f2bb4e tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:46.283028 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d98b10bb-244a-424c-8be9-a7e205f2bb4e tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:46.283672 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d98b10bb-244a-424c-8be9-a7e205f2bb4e tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:46.284597 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d98b10bb-244a-424c-8be9-a7e205f2bb4e tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:46.285262 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d98b10bb-244a-424c-8be9-a7e205f2bb4e tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:46.285664 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d98b10bb-244a-424c-8be9-a7e205f2bb4e tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:46.379408 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b376c43f-2d16-4760-9aaf-8aa71280f06a tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd98d0f70>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:46.431438 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d98b10bb-244a-424c-8be9-a7e205f2bb4e tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:46.452290 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b376c43f-2d16-4760-9aaf-8aa71280f06a tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/a8625a43-cc13-4579-b0e9-3ebd2183a277" status: 200 len: 1413 microversion: 2.1 time: 0.076589 Oct 17 13:40:46.460502 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 939/1826] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:40:46 2022] GET /compute/v2.1/images/a8625a43-cc13-4579-b0e9-3ebd2183a277 => generated 1413 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:46.469932 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d98b10bb-244a-424c-8be9-a7e205f2bb4e tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:46.471639 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d98b10bb-244a-424c-8be9-a7e205f2bb4e tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:46.497521 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d98b10bb-244a-424c-8be9-a7e205f2bb4e tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1537 microversion: 2.91 time: 0.237268 Oct 17 13:40:46.512026 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 888/1827] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:40:46 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1537 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:40:46.517302 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8368640b-74bd-43ab-95bf-e43f12288184 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:46.518036 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8368640b-74bd-43ab-95bf-e43f12288184 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9c6b4ed2-b111-41b0-9679-b66d386834b9] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:46.527861 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8368640b-74bd-43ab-95bf-e43f12288184 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:46.535600 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8368640b-74bd-43ab-95bf-e43f12288184 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:46.536187 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8368640b-74bd-43ab-95bf-e43f12288184 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:46.538262 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8368640b-74bd-43ab-95bf-e43f12288184 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:46.538840 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8368640b-74bd-43ab-95bf-e43f12288184 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:46.540655 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8368640b-74bd-43ab-95bf-e43f12288184 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:47.224731 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8e426f09-3eb8-4609-ad60-ee59ce156820 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:47.227812 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8e426f09-3eb8-4609-ad60-ee59ce156820 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] [instance: 3d4188da-b0f7-4d97-952b-acebaa48f185] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:47.235902 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8e426f09-3eb8-4609-ad60-ee59ce156820 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:47.237658 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8e426f09-3eb8-4609-ad60-ee59ce156820 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:47.238336 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8e426f09-3eb8-4609-ad60-ee59ce156820 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:47.239560 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8e426f09-3eb8-4609-ad60-ee59ce156820 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:47.241064 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8e426f09-3eb8-4609-ad60-ee59ce156820 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:47.241977 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8e426f09-3eb8-4609-ad60-ee59ce156820 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:47.458877 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8368640b-74bd-43ab-95bf-e43f12288184 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:47.468449 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8368640b-74bd-43ab-95bf-e43f12288184 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9" status: 200 len: 1514 microversion: 2.1 time: 0.955476 Oct 17 13:40:47.472127 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 940/1828] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:46 2022] GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9 => generated 1514 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:40:47.500498 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ce87716e-21a4-4fc2-8d3a-79bec0b0ff16 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd9a5fb80>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:47.600417 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ce87716e-21a4-4fc2-8d3a-79bec0b0ff16 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/a8625a43-cc13-4579-b0e9-3ebd2183a277" status: 200 len: 1413 microversion: 2.1 time: 0.123641 Oct 17 13:40:47.607318 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 941/1829] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:40:47 2022] GET /compute/v2.1/images/a8625a43-cc13-4579-b0e9-3ebd2183a277 => generated 1413 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:47.614491 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ba185d78-1ef1-4b19-b917-c38cfa7b2093 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:47.615208 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ba185d78-1ef1-4b19-b917-c38cfa7b2093 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:47.632197 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ba185d78-1ef1-4b19-b917-c38cfa7b2093 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:47.632690 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ba185d78-1ef1-4b19-b917-c38cfa7b2093 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:47.633137 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ba185d78-1ef1-4b19-b917-c38cfa7b2093 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:47.633852 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ba185d78-1ef1-4b19-b917-c38cfa7b2093 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:47.634334 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ba185d78-1ef1-4b19-b917-c38cfa7b2093 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:47.634851 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ba185d78-1ef1-4b19-b917-c38cfa7b2093 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:47.696037 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8e426f09-3eb8-4609-ad60-ee59ce156820 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:47.722152 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8e426f09-3eb8-4609-ad60-ee59ce156820 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers/3d4188da-b0f7-4d97-952b-acebaa48f185" status: 200 len: 1522 microversion: 2.1 time: 0.501347 Oct 17 13:40:47.723054 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 889/1830] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:47 2022] GET /compute/v2.1/servers/3d4188da-b0f7-4d97-952b-acebaa48f185 => generated 1522 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:47.770319 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ba185d78-1ef1-4b19-b917-c38cfa7b2093 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:47.782690 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ba185d78-1ef1-4b19-b917-c38cfa7b2093 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:47.789088 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ba185d78-1ef1-4b19-b917-c38cfa7b2093 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:47.803097 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ba185d78-1ef1-4b19-b917-c38cfa7b2093 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1537 microversion: 2.91 time: 0.194597 Oct 17 13:40:47.804027 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 942/1831] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:40:47 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1537 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:40:48.294932 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2d050820-cc93-4f51-a8c7-8ecc0b7cb26e tempest-ImagesDeleteNegativeTestJSON-20043023 tempest-ImagesDeleteNegativeTestJSON-20043023-project] 10.222.0.79 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.422228 Oct 17 13:40:48.300666 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 890/1832] 10.222.0.79 () {58 vars in 1128 bytes} [Mon Oct 17 13:40:47 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 429 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 17 13:40:48.304910 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-26fe6e0f-3498-4dfb-94c4-e55191d46fb8 tempest-ImagesDeleteNegativeTestJSON-20043023 tempest-ImagesDeleteNegativeTestJSON-20043023-project] Calling method '.version_select at 0x7f7cd9a8b940>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:48.349301 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-26fe6e0f-3498-4dfb-94c4-e55191d46fb8 tempest-ImagesDeleteNegativeTestJSON-20043023 tempest-ImagesDeleteNegativeTestJSON-20043023-project] HTTP exception thrown: Image not found. Oct 17 13:40:48.351751 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-26fe6e0f-3498-4dfb-94c4-e55191d46fb8 tempest-ImagesDeleteNegativeTestJSON-20043023 tempest-ImagesDeleteNegativeTestJSON-20043023-project] Request method failure captured: Oct 17 13:40:48.351751 n-d-854247-14 devstack@n-api.service[127017]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 17 13:40:48.351751 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:40:48.351751 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:40:48.351751 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:40:48.351751 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:40:48.351751 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:40:48.351751 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:40:48.351751 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:40:48.351751 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:40:48.351751 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVtfWLPdhP36p8KBGKvN9HYreeHyDoHJMk1z_lImv9S7WncL9Lju1hZfy6QDbzKhyJK7lR2VmT96Skq39wVIR8n40WmX2Akwy4kREJwnwTvdgOJ8SDlvyPCFbTRSWZP9OY-ISOS-CTklorH_Tp-Z0z-H0X1pxEPjsV8jSixghbW_BEs Oct 17 13:40:48.351751 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:40:48.351751 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:40:48.351751 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:40:48.351751 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:40:48.351751 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:40:48.351751 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:40:48.351751 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 346fab0c7cec4adc8ee528c7a2df1733 Oct 17 13:40:48.351751 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-20043023 Oct 17 13:40:48.351751 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:40:48.351751 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:40:48.354017 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/346fab0c7cec4adc8ee528c7a2df1733"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/346fab0c7cec4adc8ee528c7a2df1733"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/346fab0c7cec4adc8ee528c7a2df1733"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_346fab0c7cec4adc8ee528c7a2df1733", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:40:48.354017 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-20043023 Oct 17 13:40:48.354017 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 346fab0c7cec4adc8ee528c7a2df1733 Oct 17 13:40:48.354017 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-20043023 Oct 17 13:40:48.354017 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ImagesDeleteNegativeTestJSON-20043023-project Oct 17 13:40:48.354017 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:40:48.354017 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:40:48.354017 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: bd9c685fdf1d4334ba61c03d3983c5c4 Oct 17 13:40:48.354017 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-20043023-project Oct 17 13:40:48.354017 n-d-854247-14 devstack@n-api.service[127017]: method: Oct 17 13:40:48.354017 n-d-854247-14 devstack@n-api.service[127017]: exception: Image not found. Oct 17 13:40:48.354017 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '-1'} Oct 17 13:40:48.354017 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:40:48.354017 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:40:48.355477 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 17 13:40:48.355477 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 17 13:40:48.355477 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:40:48.355477 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:40:48.355477 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:40:48.355477 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:40:48.355477 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 17 13:40:48.355477 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 17 13:40:48.355477 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 17 13:40:48.355477 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 17 13:40:48.355477 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:40:48.355477 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:40:48.355477 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:40:48.355477 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:40:48.355477 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 17 13:40:48.355477 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:40:48.355477 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:40:48.355477 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:40:48.355477 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:40:48.357238 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 17 13:40:48.357238 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 17 13:40:48.357238 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 17 13:40:48.357238 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 17 13:40:48.357238 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 17 13:40:48.357238 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 17 13:40:48.357238 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 17 13:40:48.357238 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:40:48.357238 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:40:48.357238 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:40:48.357238 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:40:48.357238 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:40:48.357238 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:40:48.357238 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:40:48.357238 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:40:48.357238 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:40:48.357238 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:40:48.357238 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:40:48.357238 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:40:48.357238 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 17 13:40:48.358647 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 13:40:48.358647 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 13:40:48.358647 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:40:48.358647 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:40:48.358647 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:40:48.358647 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:40:48.358647 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:40:48.358647 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:40:48.358647 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:40:48.358647 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:40:48.358647 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 13:40:48.358647 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:40:48.358647 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-26fe6e0f-3498-4dfb-94c4-e55191d46fb8 tempest-ImagesDeleteNegativeTestJSON-20043023 tempest-ImagesDeleteNegativeTestJSON-20043023-project] Returning 404 to user: Image not found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:40:48.358647 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-26fe6e0f-3498-4dfb-94c4-e55191d46fb8 tempest-ImagesDeleteNegativeTestJSON-20043023 tempest-ImagesDeleteNegativeTestJSON-20043023-project] 10.222.0.79 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.053803 Oct 17 13:40:48.358647 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 943/1833] 10.222.0.79 () {58 vars in 1134 bytes} [Mon Oct 17 13:40:48 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 17 13:40:48.368018 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e31d6b7d-4574-4fa6-bda5-913f4794313b tempest-ImagesDeleteNegativeTestJSON-20043023 tempest-ImagesDeleteNegativeTestJSON-20043023-project] Calling method '.version_select at 0x7f7cd4d58d30>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:48.409345 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-e31d6b7d-4574-4fa6-bda5-913f4794313b tempest-ImagesDeleteNegativeTestJSON-20043023 tempest-ImagesDeleteNegativeTestJSON-20043023-project] HTTP exception thrown: Image not found. Oct 17 13:40:48.411879 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e31d6b7d-4574-4fa6-bda5-913f4794313b tempest-ImagesDeleteNegativeTestJSON-20043023 tempest-ImagesDeleteNegativeTestJSON-20043023-project] Request method failure captured: Oct 17 13:40:48.411879 n-d-854247-14 devstack@n-api.service[127016]: request: DELETE /compute/v2.1/images/c515d196-20d4-4fca-9cfc-e634b706972j HTTP/1.1 Oct 17 13:40:48.411879 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:40:48.411879 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:40:48.411879 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:40:48.411879 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:40:48.411879 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:40:48.411879 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:40:48.411879 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:40:48.411879 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:40:48.411879 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVtfWLPdhP36p8KBGKvN9HYreeHyDoHJMk1z_lImv9S7WncL9Lju1hZfy6QDbzKhyJK7lR2VmT96Skq39wVIR8n40WmX2Akwy4kREJwnwTvdgOJ8SDlvyPCFbTRSWZP9OY-ISOS-CTklorH_Tp-Z0z-H0X1pxEPjsV8jSixghbW_BEs Oct 17 13:40:48.411879 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:40:48.411879 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:40:48.411879 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:40:48.411879 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:40:48.411879 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:40:48.411879 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:40:48.411879 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 346fab0c7cec4adc8ee528c7a2df1733 Oct 17 13:40:48.411879 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-20043023 Oct 17 13:40:48.411879 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:40:48.411879 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:40:48.413706 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/346fab0c7cec4adc8ee528c7a2df1733"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/346fab0c7cec4adc8ee528c7a2df1733"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/346fab0c7cec4adc8ee528c7a2df1733"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_346fab0c7cec4adc8ee528c7a2df1733", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:40:48.413706 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-20043023 Oct 17 13:40:48.413706 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 346fab0c7cec4adc8ee528c7a2df1733 Oct 17 13:40:48.413706 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-20043023 Oct 17 13:40:48.413706 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ImagesDeleteNegativeTestJSON-20043023-project Oct 17 13:40:48.413706 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:40:48.413706 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:40:48.413706 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: bd9c685fdf1d4334ba61c03d3983c5c4 Oct 17 13:40:48.413706 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-20043023-project Oct 17 13:40:48.413706 n-d-854247-14 devstack@n-api.service[127016]: method: Oct 17 13:40:48.413706 n-d-854247-14 devstack@n-api.service[127016]: exception: Image not found. Oct 17 13:40:48.413706 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'c515d196-20d4-4fca-9cfc-e634b706972j'} Oct 17 13:40:48.413706 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:40:48.414636 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:40:48.414636 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 17 13:40:48.414636 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 17 13:40:48.414636 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:40:48.414636 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:40:48.414636 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:40:48.414636 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:40:48.414636 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 17 13:40:48.414636 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 17 13:40:48.414636 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 17 13:40:48.414636 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 17 13:40:48.414636 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:40:48.414636 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:40:48.414636 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:40:48.414636 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:40:48.414636 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c515d196-20d4-4fca-9cfc-e634b706972j to delete Oct 17 13:40:48.414636 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:40:48.414636 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:40:48.414636 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:40:48.416093 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:40:48.416093 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 17 13:40:48.416093 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 17 13:40:48.416093 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 17 13:40:48.416093 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 17 13:40:48.416093 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 17 13:40:48.416093 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 17 13:40:48.416093 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c515d196-20d4-4fca-9cfc-e634b706972j could not be found. Oct 17 13:40:48.416093 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:40:48.416093 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:40:48.416093 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:40:48.416093 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:40:48.416093 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:40:48.416093 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:40:48.416093 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:40:48.416093 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:40:48.416093 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:40:48.416093 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:40:48.416093 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:40:48.416093 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:40:48.418711 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 17 13:40:48.418711 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 13:40:48.418711 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 13:40:48.418711 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:40:48.418711 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:40:48.418711 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:40:48.418711 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:40:48.418711 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:40:48.418711 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:40:48.418711 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:40:48.418711 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:40:48.418711 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 13:40:48.418711 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:40:48.418711 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e31d6b7d-4574-4fa6-bda5-913f4794313b tempest-ImagesDeleteNegativeTestJSON-20043023 tempest-ImagesDeleteNegativeTestJSON-20043023-project] Returning 404 to user: Image not found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:40:48.418711 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e31d6b7d-4574-4fa6-bda5-913f4794313b tempest-ImagesDeleteNegativeTestJSON-20043023 tempest-ImagesDeleteNegativeTestJSON-20043023-project] 10.222.0.79 "DELETE /compute/v2.1/images/c515d196-20d4-4fca-9cfc-e634b706972j" status: 404 len: 62 microversion: 2.1 time: 0.051031 Oct 17 13:40:48.421474 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 891/1834] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:48 2022] DELETE /compute/v2.1/images/c515d196-20d4-4fca-9cfc-e634b706972j => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:40:48.426614 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0961423a-65c4-444c-95e8-ba887824ac50 tempest-ImagesDeleteNegativeTestJSON-20043023 tempest-ImagesDeleteNegativeTestJSON-20043023-project] Calling method '.version_select at 0x7f7cd9944160>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:48.468014 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-0961423a-65c4-444c-95e8-ba887824ac50 tempest-ImagesDeleteNegativeTestJSON-20043023 tempest-ImagesDeleteNegativeTestJSON-20043023-project] HTTP exception thrown: Image not found. Oct 17 13:40:48.469778 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0961423a-65c4-444c-95e8-ba887824ac50 tempest-ImagesDeleteNegativeTestJSON-20043023 tempest-ImagesDeleteNegativeTestJSON-20043023-project] Request method failure captured: Oct 17 13:40:48.469778 n-d-854247-14 devstack@n-api.service[127017]: request: DELETE /compute/v2.1/images/5bee06f6-7951-43e5-ae37-925db2d844d81 HTTP/1.1 Oct 17 13:40:48.469778 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:40:48.469778 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:40:48.469778 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:40:48.469778 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:40:48.469778 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:40:48.469778 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:40:48.469778 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:40:48.469778 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:40:48.469778 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVtfWLPdhP36p8KBGKvN9HYreeHyDoHJMk1z_lImv9S7WncL9Lju1hZfy6QDbzKhyJK7lR2VmT96Skq39wVIR8n40WmX2Akwy4kREJwnwTvdgOJ8SDlvyPCFbTRSWZP9OY-ISOS-CTklorH_Tp-Z0z-H0X1pxEPjsV8jSixghbW_BEs Oct 17 13:40:48.469778 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:40:48.469778 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:40:48.469778 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:40:48.469778 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:40:48.469778 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:40:48.469778 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:40:48.469778 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 346fab0c7cec4adc8ee528c7a2df1733 Oct 17 13:40:48.469778 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-20043023 Oct 17 13:40:48.469778 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:40:48.469778 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:40:48.471547 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/346fab0c7cec4adc8ee528c7a2df1733"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/346fab0c7cec4adc8ee528c7a2df1733"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/346fab0c7cec4adc8ee528c7a2df1733"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_346fab0c7cec4adc8ee528c7a2df1733", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:40:48.471547 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-20043023 Oct 17 13:40:48.471547 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 346fab0c7cec4adc8ee528c7a2df1733 Oct 17 13:40:48.471547 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-20043023 Oct 17 13:40:48.471547 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ImagesDeleteNegativeTestJSON-20043023-project Oct 17 13:40:48.471547 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:40:48.471547 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:40:48.471547 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: bd9c685fdf1d4334ba61c03d3983c5c4 Oct 17 13:40:48.471547 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-20043023-project Oct 17 13:40:48.471547 n-d-854247-14 devstack@n-api.service[127017]: method: Oct 17 13:40:48.471547 n-d-854247-14 devstack@n-api.service[127017]: exception: Image not found. Oct 17 13:40:48.471547 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '5bee06f6-7951-43e5-ae37-925db2d844d81'} Oct 17 13:40:48.471547 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:40:48.472570 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:40:48.472570 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 17 13:40:48.472570 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 17 13:40:48.472570 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:40:48.472570 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:40:48.472570 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:40:48.472570 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:40:48.472570 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 17 13:40:48.472570 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 17 13:40:48.472570 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 17 13:40:48.472570 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 17 13:40:48.472570 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:40:48.472570 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:40:48.472570 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:40:48.472570 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:40:48.472570 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 5bee06f6-7951-43e5-ae37-925db2d844d81 to delete Oct 17 13:40:48.472570 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:40:48.472570 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:40:48.472570 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:40:48.473980 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:40:48.473980 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 17 13:40:48.473980 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 17 13:40:48.473980 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 17 13:40:48.473980 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 17 13:40:48.473980 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 17 13:40:48.473980 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 17 13:40:48.473980 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5bee06f6-7951-43e5-ae37-925db2d844d81 could not be found. Oct 17 13:40:48.473980 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:40:48.473980 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:40:48.473980 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:40:48.473980 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:40:48.473980 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:40:48.473980 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:40:48.473980 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:40:48.473980 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:40:48.473980 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:40:48.473980 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:40:48.473980 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:40:48.473980 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:40:48.475354 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 17 13:40:48.475354 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 13:40:48.475354 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 13:40:48.475354 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:40:48.475354 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:40:48.475354 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:40:48.475354 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:40:48.475354 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:40:48.475354 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:40:48.475354 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:40:48.475354 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:40:48.475354 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 13:40:48.475354 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:40:48.475354 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0961423a-65c4-444c-95e8-ba887824ac50 tempest-ImagesDeleteNegativeTestJSON-20043023 tempest-ImagesDeleteNegativeTestJSON-20043023-project] Returning 404 to user: Image not found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:40:48.475354 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0961423a-65c4-444c-95e8-ba887824ac50 tempest-ImagesDeleteNegativeTestJSON-20043023 tempest-ImagesDeleteNegativeTestJSON-20043023-project] 10.222.0.79 "DELETE /compute/v2.1/images/5bee06f6-7951-43e5-ae37-925db2d844d81" status: 404 len: 62 microversion: 2.1 time: 0.048440 Oct 17 13:40:48.485392 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 944/1835] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:40:48 2022] DELETE /compute/v2.1/images/5bee06f6-7951-43e5-ae37-925db2d844d81 => generated 62 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:40:48.497218 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0cf1bdbd-9fb6-49fb-877c-36328e4cc552 tempest-ImagesDeleteNegativeTestJSON-20043023 tempest-ImagesDeleteNegativeTestJSON-20043023-project] Calling method '.version_select at 0x7f7cd4f9ed30>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:48.517630 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bc92ed66-8304-443e-bac4-74938f8adc41 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:48.520953 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-bc92ed66-8304-443e-bac4-74938f8adc41 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9c6b4ed2-b111-41b0-9679-b66d386834b9] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:48.540423 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bc92ed66-8304-443e-bac4-74938f8adc41 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:48.540949 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bc92ed66-8304-443e-bac4-74938f8adc41 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:48.541601 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bc92ed66-8304-443e-bac4-74938f8adc41 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:48.542529 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bc92ed66-8304-443e-bac4-74938f8adc41 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:48.543149 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bc92ed66-8304-443e-bac4-74938f8adc41 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:48.543883 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bc92ed66-8304-443e-bac4-74938f8adc41 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:48.551340 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-0cf1bdbd-9fb6-49fb-877c-36328e4cc552 tempest-ImagesDeleteNegativeTestJSON-20043023 tempest-ImagesDeleteNegativeTestJSON-20043023-project] HTTP exception thrown: Image not found. Oct 17 13:40:48.554212 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0cf1bdbd-9fb6-49fb-877c-36328e4cc552 tempest-ImagesDeleteNegativeTestJSON-20043023 tempest-ImagesDeleteNegativeTestJSON-20043023-project] Request method failure captured: Oct 17 13:40:48.554212 n-d-854247-14 devstack@n-api.service[127016]: request: DELETE /compute/v2.1/images/tempest-invalid-753147766 HTTP/1.1 Oct 17 13:40:48.554212 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:40:48.554212 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:40:48.554212 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:40:48.554212 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:40:48.554212 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:40:48.554212 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:40:48.554212 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:40:48.554212 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:40:48.554212 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVtfWLPdhP36p8KBGKvN9HYreeHyDoHJMk1z_lImv9S7WncL9Lju1hZfy6QDbzKhyJK7lR2VmT96Skq39wVIR8n40WmX2Akwy4kREJwnwTvdgOJ8SDlvyPCFbTRSWZP9OY-ISOS-CTklorH_Tp-Z0z-H0X1pxEPjsV8jSixghbW_BEs Oct 17 13:40:48.554212 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:40:48.554212 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:40:48.554212 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:40:48.554212 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:40:48.554212 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:40:48.554212 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:40:48.554212 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 346fab0c7cec4adc8ee528c7a2df1733 Oct 17 13:40:48.554212 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-20043023 Oct 17 13:40:48.554212 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:40:48.554212 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:40:48.555790 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/346fab0c7cec4adc8ee528c7a2df1733"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/346fab0c7cec4adc8ee528c7a2df1733"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/346fab0c7cec4adc8ee528c7a2df1733"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_346fab0c7cec4adc8ee528c7a2df1733", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:40:48.555790 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-20043023 Oct 17 13:40:48.555790 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 346fab0c7cec4adc8ee528c7a2df1733 Oct 17 13:40:48.555790 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-20043023 Oct 17 13:40:48.555790 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ImagesDeleteNegativeTestJSON-20043023-project Oct 17 13:40:48.555790 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:40:48.555790 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:40:48.555790 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: bd9c685fdf1d4334ba61c03d3983c5c4 Oct 17 13:40:48.555790 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-20043023-project Oct 17 13:40:48.555790 n-d-854247-14 devstack@n-api.service[127016]: method: Oct 17 13:40:48.555790 n-d-854247-14 devstack@n-api.service[127016]: exception: Image not found. Oct 17 13:40:48.555790 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'tempest-invalid-753147766'} Oct 17 13:40:48.555790 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:40:48.556858 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:40:48.556858 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 17 13:40:48.556858 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 17 13:40:48.556858 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:40:48.556858 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:40:48.556858 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:40:48.556858 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:40:48.556858 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 17 13:40:48.556858 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 17 13:40:48.556858 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 17 13:40:48.556858 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 17 13:40:48.556858 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:40:48.556858 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:40:48.556858 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:40:48.556858 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:40:48.556858 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-753147766 to delete Oct 17 13:40:48.556858 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:40:48.556858 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:40:48.556858 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:40:48.558614 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:40:48.558614 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 17 13:40:48.558614 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 17 13:40:48.558614 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 17 13:40:48.558614 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 17 13:40:48.558614 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 17 13:40:48.558614 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 17 13:40:48.558614 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-753147766 could not be found. Oct 17 13:40:48.558614 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:40:48.558614 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:40:48.558614 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:40:48.558614 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:40:48.558614 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:40:48.558614 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:40:48.558614 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:40:48.558614 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:40:48.558614 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:40:48.558614 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:40:48.558614 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:40:48.558614 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:40:48.560512 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 17 13:40:48.560512 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 13:40:48.560512 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 13:40:48.560512 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:40:48.560512 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:40:48.560512 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:40:48.560512 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:40:48.560512 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:40:48.560512 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:40:48.560512 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:40:48.560512 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:40:48.560512 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 13:40:48.560512 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:40:48.564022 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0cf1bdbd-9fb6-49fb-877c-36328e4cc552 tempest-ImagesDeleteNegativeTestJSON-20043023 tempest-ImagesDeleteNegativeTestJSON-20043023-project] Returning 404 to user: Image not found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:40:48.565062 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0cf1bdbd-9fb6-49fb-877c-36328e4cc552 tempest-ImagesDeleteNegativeTestJSON-20043023 tempest-ImagesDeleteNegativeTestJSON-20043023-project] 10.222.0.79 "DELETE /compute/v2.1/images/tempest-invalid-753147766" status: 404 len: 62 microversion: 2.1 time: 0.074354 Oct 17 13:40:48.575139 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 892/1836] 10.222.0.79 () {58 vars in 1203 bytes} [Mon Oct 17 13:40:48 2022] DELETE /compute/v2.1/images/tempest-invalid-753147766 => generated 62 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:40:48.580157 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f9498f3f-852d-4237-b2eb-81afd8314c78 tempest-ImagesDeleteNegativeTestJSON-20043023 tempest-ImagesDeleteNegativeTestJSON-20043023-project] Calling method '.version_select at 0x7f7cd4d630d0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:48.604090 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-f9498f3f-852d-4237-b2eb-81afd8314c78 tempest-ImagesDeleteNegativeTestJSON-20043023 tempest-ImagesDeleteNegativeTestJSON-20043023-project] HTTP exception thrown: Image not found. Oct 17 13:40:48.607105 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f9498f3f-852d-4237-b2eb-81afd8314c78 tempest-ImagesDeleteNegativeTestJSON-20043023 tempest-ImagesDeleteNegativeTestJSON-20043023-project] Request method failure captured: Oct 17 13:40:48.607105 n-d-854247-14 devstack@n-api.service[127016]: request: DELETE /compute/v2.1/images/887833f1-eed7-4aee-9ebb-8b065020ce94 HTTP/1.1 Oct 17 13:40:48.607105 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:40:48.607105 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:40:48.607105 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:40:48.607105 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:40:48.607105 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:40:48.607105 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:40:48.607105 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:40:48.607105 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:40:48.607105 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVtfWLPdhP36p8KBGKvN9HYreeHyDoHJMk1z_lImv9S7WncL9Lju1hZfy6QDbzKhyJK7lR2VmT96Skq39wVIR8n40WmX2Akwy4kREJwnwTvdgOJ8SDlvyPCFbTRSWZP9OY-ISOS-CTklorH_Tp-Z0z-H0X1pxEPjsV8jSixghbW_BEs Oct 17 13:40:48.607105 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:40:48.607105 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:40:48.607105 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:40:48.607105 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:40:48.607105 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:40:48.607105 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:40:48.607105 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 346fab0c7cec4adc8ee528c7a2df1733 Oct 17 13:40:48.607105 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-20043023 Oct 17 13:40:48.607105 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:40:48.607105 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:40:48.609020 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/346fab0c7cec4adc8ee528c7a2df1733"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/346fab0c7cec4adc8ee528c7a2df1733"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/346fab0c7cec4adc8ee528c7a2df1733"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_346fab0c7cec4adc8ee528c7a2df1733", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:40:48.609020 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-20043023 Oct 17 13:40:48.609020 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 346fab0c7cec4adc8ee528c7a2df1733 Oct 17 13:40:48.609020 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-20043023 Oct 17 13:40:48.609020 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ImagesDeleteNegativeTestJSON-20043023-project Oct 17 13:40:48.609020 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:40:48.609020 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:40:48.609020 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: bd9c685fdf1d4334ba61c03d3983c5c4 Oct 17 13:40:48.609020 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-20043023-project Oct 17 13:40:48.609020 n-d-854247-14 devstack@n-api.service[127016]: method: Oct 17 13:40:48.609020 n-d-854247-14 devstack@n-api.service[127016]: exception: Image not found. Oct 17 13:40:48.609020 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '887833f1-eed7-4aee-9ebb-8b065020ce94'} Oct 17 13:40:48.609020 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:40:48.610242 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:40:48.610242 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 17 13:40:48.610242 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 17 13:40:48.610242 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:40:48.610242 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:40:48.610242 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:40:48.610242 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:40:48.610242 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 17 13:40:48.610242 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 17 13:40:48.610242 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 17 13:40:48.610242 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 17 13:40:48.610242 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:40:48.610242 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:40:48.610242 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:40:48.610242 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:40:48.610242 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 887833f1-eed7-4aee-9ebb-8b065020ce94 to delete Oct 17 13:40:48.610242 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:40:48.610242 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:40:48.610242 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:40:48.613456 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:40:48.613456 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 17 13:40:48.613456 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 17 13:40:48.613456 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 17 13:40:48.613456 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 17 13:40:48.613456 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 17 13:40:48.613456 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 17 13:40:48.613456 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 887833f1-eed7-4aee-9ebb-8b065020ce94 could not be found. Oct 17 13:40:48.613456 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:40:48.613456 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:40:48.613456 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:40:48.613456 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:40:48.613456 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:40:48.613456 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:40:48.613456 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:40:48.613456 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:40:48.613456 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:40:48.613456 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:40:48.613456 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:40:48.613456 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:40:48.615110 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 17 13:40:48.615110 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 13:40:48.615110 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 13:40:48.615110 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:40:48.615110 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:40:48.615110 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:40:48.615110 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:40:48.615110 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:40:48.615110 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:40:48.615110 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:40:48.615110 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:40:48.615110 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 13:40:48.615110 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:40:48.615110 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f9498f3f-852d-4237-b2eb-81afd8314c78 tempest-ImagesDeleteNegativeTestJSON-20043023 tempest-ImagesDeleteNegativeTestJSON-20043023-project] Returning 404 to user: Image not found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:40:48.615110 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f9498f3f-852d-4237-b2eb-81afd8314c78 tempest-ImagesDeleteNegativeTestJSON-20043023 tempest-ImagesDeleteNegativeTestJSON-20043023-project] 10.222.0.79 "DELETE /compute/v2.1/images/887833f1-eed7-4aee-9ebb-8b065020ce94" status: 404 len: 62 microversion: 2.1 time: 0.032415 Oct 17 13:40:48.616345 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 893/1837] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:48 2022] DELETE /compute/v2.1/images/887833f1-eed7-4aee-9ebb-8b065020ce94 => generated 62 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:40:48.619829 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f2744811-c846-4109-805e-6422f200e05a tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd59a1ca0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:48.691712 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f2744811-c846-4109-805e-6422f200e05a tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/a8625a43-cc13-4579-b0e9-3ebd2183a277" status: 200 len: 1413 microversion: 2.1 time: 0.077215 Oct 17 13:40:48.699887 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 894/1838] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:40:48 2022] GET /compute/v2.1/images/a8625a43-cc13-4579-b0e9-3ebd2183a277 => generated 1413 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:48.755611 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6a5d035d-a94e-4efa-bb38-c0d6d1cf7d53 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:48.756962 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6a5d035d-a94e-4efa-bb38-c0d6d1cf7d53 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] [instance: 3d4188da-b0f7-4d97-952b-acebaa48f185] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:48.779611 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6a5d035d-a94e-4efa-bb38-c0d6d1cf7d53 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:48.788374 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6a5d035d-a94e-4efa-bb38-c0d6d1cf7d53 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:48.789960 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6a5d035d-a94e-4efa-bb38-c0d6d1cf7d53 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:48.792510 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6a5d035d-a94e-4efa-bb38-c0d6d1cf7d53 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:48.793235 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6a5d035d-a94e-4efa-bb38-c0d6d1cf7d53 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:48.794488 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6a5d035d-a94e-4efa-bb38-c0d6d1cf7d53 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:48.917914 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-bc92ed66-8304-443e-bac4-74938f8adc41 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:48.926177 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-bc92ed66-8304-443e-bac4-74938f8adc41 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9" status: 200 len: 1514 microversion: 2.1 time: 0.426210 Oct 17 13:40:48.930931 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 945/1839] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:48 2022] GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9 => generated 1514 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:40:48.936429 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-92086ac6-7d92-44af-a555-8925beb6d22c tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:48.937302 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-92086ac6-7d92-44af-a555-8925beb6d22c tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:48.954488 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-92086ac6-7d92-44af-a555-8925beb6d22c tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:48.958232 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-92086ac6-7d92-44af-a555-8925beb6d22c tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:48.960518 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-92086ac6-7d92-44af-a555-8925beb6d22c tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:48.961532 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-92086ac6-7d92-44af-a555-8925beb6d22c tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:48.964253 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-92086ac6-7d92-44af-a555-8925beb6d22c tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:48.967615 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-92086ac6-7d92-44af-a555-8925beb6d22c tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:49.042694 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6a5d035d-a94e-4efa-bb38-c0d6d1cf7d53 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:49.058196 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6a5d035d-a94e-4efa-bb38-c0d6d1cf7d53 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers/3d4188da-b0f7-4d97-952b-acebaa48f185" status: 200 len: 1522 microversion: 2.1 time: 0.309329 Oct 17 13:40:49.063225 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 895/1840] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:48 2022] GET /compute/v2.1/servers/3d4188da-b0f7-4d97-952b-acebaa48f185 => generated 1522 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:40:49.111875 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-92086ac6-7d92-44af-a555-8925beb6d22c tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:49.121385 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-92086ac6-7d92-44af-a555-8925beb6d22c tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:49.122923 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-92086ac6-7d92-44af-a555-8925beb6d22c tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:49.129886 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-92086ac6-7d92-44af-a555-8925beb6d22c tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1537 microversion: 2.91 time: 0.197733 Oct 17 13:40:49.130650 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 946/1841] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:40:48 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1537 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:40:49.707361 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0591209d-305e-4864-9860-cbe0000fc405 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd4cc8d30>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:49.773092 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0591209d-305e-4864-9860-cbe0000fc405 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/a8625a43-cc13-4579-b0e9-3ebd2183a277" status: 200 len: 1422 microversion: 2.1 time: 0.069367 Oct 17 13:40:49.773805 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 896/1842] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:40:49 2022] GET /compute/v2.1/images/a8625a43-cc13-4579-b0e9-3ebd2183a277 => generated 1422 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:49.787523 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-264a1d30-c383-4a50-bdb0-a50e18bd8db4 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd9944b80>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:49.832700 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3a57664a-93bc-4d33-801d-bace737c2988 tempest-ImagesMetadataTestJSON-1828188922 tempest-ImagesMetadataTestJSON-1828188922-project] Calling method '.version_select at 0x7f7cd4ccd3a0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:49.849114 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-264a1d30-c383-4a50-bdb0-a50e18bd8db4 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/a8625a43-cc13-4579-b0e9-3ebd2183a277" status: 200 len: 1422 microversion: 2.1 time: 0.065474 Oct 17 13:40:49.849787 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 947/1843] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:40:49 2022] GET /compute/v2.1/images/a8625a43-cc13-4579-b0e9-3ebd2183a277 => generated 1422 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:49.882394 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3a57664a-93bc-4d33-801d-bace737c2988 tempest-ImagesMetadataTestJSON-1828188922 tempest-ImagesMetadataTestJSON-1828188922-project] 10.222.0.79 "GET /compute/v2.1/images/af0d807c-3629-472f-8ab5-0b3cedad7bc8" status: 200 len: 637 microversion: 2.1 time: 0.053243 Oct 17 13:40:49.883762 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 897/1844] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:40:49 2022] GET /compute/v2.1/images/af0d807c-3629-472f-8ab5-0b3cedad7bc8 => generated 637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:40:49.906510 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-277c96ac-8168-4d12-aadf-939584bae2e8 tempest-ImagesMetadataTestJSON-1828188922 tempest-ImagesMetadataTestJSON-1828188922-project] Action: 'update_all', calling method: .version_select at 0x7f7cd9a8b550>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:49.942240 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-491cd5b9-a352-4f4e-8617-ce07ef467526 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:49.942693 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-491cd5b9-a352-4f4e-8617-ce07ef467526 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: a54adf11-ee58-4f13-82c8-9a00a36c536e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:49.963294 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-491cd5b9-a352-4f4e-8617-ce07ef467526 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:49.963789 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-491cd5b9-a352-4f4e-8617-ce07ef467526 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:49.965387 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-491cd5b9-a352-4f4e-8617-ce07ef467526 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:49.975500 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-491cd5b9-a352-4f4e-8617-ce07ef467526 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:49.976691 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-491cd5b9-a352-4f4e-8617-ce07ef467526 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:49.977477 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-491cd5b9-a352-4f4e-8617-ce07ef467526 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:50.005791 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-277c96ac-8168-4d12-aadf-939584bae2e8 tempest-ImagesMetadataTestJSON-1828188922 tempest-ImagesMetadataTestJSON-1828188922-project] Getting quotas for project 51e91cb55f41495f976de19b833706b4. Resources: dict_keys(['metadata_items']) {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:40:50.010775 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-277c96ac-8168-4d12-aadf-939584bae2e8 tempest-ImagesMetadataTestJSON-1828188922 tempest-ImagesMetadataTestJSON-1828188922-project] Getting quotas for user 2bad6c96292e49d5823b08162071f840 and project 51e91cb55f41495f976de19b833706b4. Resources: dict_keys(['metadata_items']) {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:40:50.014028 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-491cd5b9-a352-4f4e-8617-ce07ef467526 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: a54adf11-ee58-4f13-82c8-9a00a36c536e] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:40:50.056113 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:40:50.154402 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-491cd5b9-a352-4f4e-8617-ce07ef467526 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e" status: 204 len: 0 microversion: 2.1 time: 0.231115 Oct 17 13:40:50.155276 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 898/1845] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:40:49 2022] DELETE /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:40:50.160583 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ec608211-6e2b-49ff-bf13-a5d0f0629510 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:50.161281 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ec608211-6e2b-49ff-bf13-a5d0f0629510 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9c6b4ed2-b111-41b0-9679-b66d386834b9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:50.167619 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ec608211-6e2b-49ff-bf13-a5d0f0629510 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:50.169131 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ec608211-6e2b-49ff-bf13-a5d0f0629510 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:50.169836 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ec608211-6e2b-49ff-bf13-a5d0f0629510 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:50.170722 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ec608211-6e2b-49ff-bf13-a5d0f0629510 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:50.171366 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ec608211-6e2b-49ff-bf13-a5d0f0629510 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:50.172012 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ec608211-6e2b-49ff-bf13-a5d0f0629510 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:50.190472 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=6 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:40:50.338497 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ec608211-6e2b-49ff-bf13-a5d0f0629510 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:50.351140 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ec608211-6e2b-49ff-bf13-a5d0f0629510 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9" status: 200 len: 1514 microversion: 2.1 time: 0.191978 Oct 17 13:40:50.368142 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 899/1846] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:50 2022] GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9 => generated 1514 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:50.376293 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2cd76fb4-5190-4e60-a525-16074252ddff tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-482155322", "imageRef": "a8625a43-cc13-4579-b0e9-3ebd2183a277", "flavorRef": "452", "networks": [{"uuid": "9fce71af-909d-4a58-8606-ba21d3f4b00f"}]}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:50.382139 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-277c96ac-8168-4d12-aadf-939584bae2e8 tempest-ImagesMetadataTestJSON-1828188922 tempest-ImagesMetadataTestJSON-1828188922-project] 10.222.0.79 "PUT /compute/v2.1/images/af0d807c-3629-472f-8ab5-0b3cedad7bc8/metadata" status: 200 len: 61 microversion: 2.1 time: 0.485494 Oct 17 13:40:50.382775 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 948/1847] 10.222.0.79 () {60 vars in 1280 bytes} [Mon Oct 17 13:40:49 2022] PUT /compute/v2.1/images/af0d807c-3629-472f-8ab5-0b3cedad7bc8/metadata => generated 61 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:40:50.392778 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-fe05c792-67db-4c79-ad39-62b44a92698d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:50.393404 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-fe05c792-67db-4c79-ad39-62b44a92698d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] [instance: 3d4188da-b0f7-4d97-952b-acebaa48f185] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:50.399715 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fe05c792-67db-4c79-ad39-62b44a92698d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:50.400465 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fe05c792-67db-4c79-ad39-62b44a92698d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:50.400913 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fe05c792-67db-4c79-ad39-62b44a92698d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:50.401632 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fe05c792-67db-4c79-ad39-62b44a92698d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:50.402082 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fe05c792-67db-4c79-ad39-62b44a92698d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:50.402504 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fe05c792-67db-4c79-ad39-62b44a92698d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:50.455025 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-2cd76fb4-5190-4e60-a525-16074252ddff tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] validate_networks() for [('9fce71af-909d-4a58-8606-ba21d3f4b00f', None, None, None, None, None)] {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:40:50.635699 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-fe05c792-67db-4c79-ad39-62b44a92698d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:50.637988 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=100 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:40:50.644829 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-fe05c792-67db-4c79-ad39-62b44a92698d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers/3d4188da-b0f7-4d97-952b-acebaa48f185" status: 200 len: 1522 microversion: 2.1 time: 0.260997 Oct 17 13:40:50.645417 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 949/1848] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:50 2022] GET /compute/v2.1/servers/3d4188da-b0f7-4d97-952b-acebaa48f185 => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:50.649864 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-af6fbe68-4201-4020-b804-83e44f831e31 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:50.650840 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-af6fbe68-4201-4020-b804-83e44f831e31 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:50.658789 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-af6fbe68-4201-4020-b804-83e44f831e31 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:50.659525 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-af6fbe68-4201-4020-b804-83e44f831e31 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:50.659958 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-af6fbe68-4201-4020-b804-83e44f831e31 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:50.660803 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-af6fbe68-4201-4020-b804-83e44f831e31 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:50.661247 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-af6fbe68-4201-4020-b804-83e44f831e31 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:50.661659 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-af6fbe68-4201-4020-b804-83e44f831e31 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:50.778327 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-af6fbe68-4201-4020-b804-83e44f831e31 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:50.786646 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-af6fbe68-4201-4020-b804-83e44f831e31 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:50.788106 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-af6fbe68-4201-4020-b804-83e44f831e31 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:50.793526 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-af6fbe68-4201-4020-b804-83e44f831e31 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1537 microversion: 2.91 time: 0.147160 Oct 17 13:40:50.794091 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 950/1849] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:40:50 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1537 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:40:50.798574 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b0eecdd9-03a2-4c58-903d-d9b21438a3d5 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:50.799192 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b0eecdd9-03a2-4c58-903d-d9b21438a3d5 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: a54adf11-ee58-4f13-82c8-9a00a36c536e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:50.806435 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b0eecdd9-03a2-4c58-903d-d9b21438a3d5 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:50.806670 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b0eecdd9-03a2-4c58-903d-d9b21438a3d5 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:50.807296 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b0eecdd9-03a2-4c58-903d-d9b21438a3d5 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:50.808012 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b0eecdd9-03a2-4c58-903d-d9b21438a3d5 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:50.808459 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b0eecdd9-03a2-4c58-903d-d9b21438a3d5 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:50.808881 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b0eecdd9-03a2-4c58-903d-d9b21438a3d5 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:51.131893 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b0eecdd9-03a2-4c58-903d-d9b21438a3d5 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:51.141536 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b0eecdd9-03a2-4c58-903d-d9b21438a3d5 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e" status: 200 len: 1664 microversion: 2.1 time: 0.346373 Oct 17 13:40:51.142088 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 951/1850] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:50 2022] GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e => generated 1664 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:51.147054 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d4cfd4d3-4a88-4fff-a896-9f51bf49aff8 tempest-ImagesMetadataTestJSON-1828188922 tempest-ImagesMetadataTestJSON-1828188922-project] Calling method '.version_select at 0x7f7cd9a59af0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:51.160842 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-2cd76fb4-5190-4e60-a525-16074252ddff tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:40:51.161402 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-2cd76fb4-5190-4e60-a525-16074252ddff tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:40:51.161882 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-2cd76fb4-5190-4e60-a525-16074252ddff tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:40:51.162364 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-2cd76fb4-5190-4e60-a525-16074252ddff tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:40:51.162988 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-2cd76fb4-5190-4e60-a525-16074252ddff tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:40:51.173816 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2cd76fb4-5190-4e60-a525-16074252ddff tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:51.174373 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2cd76fb4-5190-4e60-a525-16074252ddff tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:51.175231 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2cd76fb4-5190-4e60-a525-16074252ddff tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:51.176707 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2cd76fb4-5190-4e60-a525-16074252ddff tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:51.178418 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2cd76fb4-5190-4e60-a525-16074252ddff tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:51.179204 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2cd76fb4-5190-4e60-a525-16074252ddff tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:51.200159 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-2cd76fb4-5190-4e60-a525-16074252ddff tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Getting quotas for project 461c44cb99ff4958a128679d3e10cd6f. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:40:51.205134 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-2cd76fb4-5190-4e60-a525-16074252ddff tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Getting quotas for user 386397fd9194430b81ac465f9b3bf92d and project 461c44cb99ff4958a128679d3e10cd6f. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:40:51.219103 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2cd76fb4-5190-4e60-a525-16074252ddff tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:40:51.221706 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2cd76fb4-5190-4e60-a525-16074252ddff tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 0f4b3e9d-93c2-4556-84c6-b4fb26f4424d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a8625a43-cc13-4579-b0e9-3ebd2183a277',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:40:51.271370 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2cd76fb4-5190-4e60-a525-16074252ddff tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.902663 Oct 17 13:40:51.272461 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 900/1851] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:40:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 904 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:40:51.437435 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d4cfd4d3-4a88-4fff-a896-9f51bf49aff8 tempest-ImagesMetadataTestJSON-1828188922 tempest-ImagesMetadataTestJSON-1828188922-project] 10.222.0.79 "DELETE /compute/v2.1/images/af0d807c-3629-472f-8ab5-0b3cedad7bc8/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.293540 Oct 17 13:40:51.438899 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 952/1852] 10.222.0.79 () {58 vars in 1296 bytes} [Mon Oct 17 13:40:51 2022] DELETE /compute/v2.1/images/af0d807c-3629-472f-8ab5-0b3cedad7bc8/metadata/os_version => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:40:51.446334 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2f6815ce-3d4d-44d9-a13b-73a5c039a249 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:51.447536 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2f6815ce-3d4d-44d9-a13b-73a5c039a249 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 0f4b3e9d-93c2-4556-84c6-b4fb26f4424d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:51.454031 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ff2bb8c3-7ba4-415c-a444-fe6d29129e9f tempest-AbsoluteLimitsNegativeTestJSON-912247969 tempest-AbsoluteLimitsNegativeTestJSON-912247969-project] Calling method '.version_select at 0x7f7cd4cc8b80>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:51.477622 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ff2bb8c3-7ba4-415c-a444-fe6d29129e9f tempest-AbsoluteLimitsNegativeTestJSON-912247969 tempest-AbsoluteLimitsNegativeTestJSON-912247969-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:51.478293 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ff2bb8c3-7ba4-415c-a444-fe6d29129e9f tempest-AbsoluteLimitsNegativeTestJSON-912247969 tempest-AbsoluteLimitsNegativeTestJSON-912247969-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:51.478763 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ff2bb8c3-7ba4-415c-a444-fe6d29129e9f tempest-AbsoluteLimitsNegativeTestJSON-912247969 tempest-AbsoluteLimitsNegativeTestJSON-912247969-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:51.479528 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ff2bb8c3-7ba4-415c-a444-fe6d29129e9f tempest-AbsoluteLimitsNegativeTestJSON-912247969 tempest-AbsoluteLimitsNegativeTestJSON-912247969-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:51.479976 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ff2bb8c3-7ba4-415c-a444-fe6d29129e9f tempest-AbsoluteLimitsNegativeTestJSON-912247969 tempest-AbsoluteLimitsNegativeTestJSON-912247969-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:51.480558 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ff2bb8c3-7ba4-415c-a444-fe6d29129e9f tempest-AbsoluteLimitsNegativeTestJSON-912247969 tempest-AbsoluteLimitsNegativeTestJSON-912247969-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:51.501387 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ff2bb8c3-7ba4-415c-a444-fe6d29129e9f tempest-AbsoluteLimitsNegativeTestJSON-912247969 tempest-AbsoluteLimitsNegativeTestJSON-912247969-project] 10.222.0.79 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.227647 Oct 17 13:40:51.501973 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 901/1853] 10.222.0.79 () {58 vars in 1122 bytes} [Mon Oct 17 13:40:51 2022] GET /compute/v2.1/limits => generated 511 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:40:51.507850 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c8f3bf01-81eb-4b57-b659-43b0bdb49d87 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:51.508650 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c8f3bf01-81eb-4b57-b659-43b0bdb49d87 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9c6b4ed2-b111-41b0-9679-b66d386834b9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:51.515016 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c8f3bf01-81eb-4b57-b659-43b0bdb49d87 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:51.515760 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c8f3bf01-81eb-4b57-b659-43b0bdb49d87 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:51.516475 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c8f3bf01-81eb-4b57-b659-43b0bdb49d87 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:51.517406 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c8f3bf01-81eb-4b57-b659-43b0bdb49d87 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:51.518011 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c8f3bf01-81eb-4b57-b659-43b0bdb49d87 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:51.518602 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c8f3bf01-81eb-4b57-b659-43b0bdb49d87 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:51.539063 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2f6815ce-3d4d-44d9-a13b-73a5c039a249 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:51.548686 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2f6815ce-3d4d-44d9-a13b-73a5c039a249 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/0f4b3e9d-93c2-4556-84c6-b4fb26f4424d" status: 200 len: 1207 microversion: 2.1 time: 0.108510 Oct 17 13:40:51.549585 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 953/1854] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:51 2022] GET /compute/v2.1/servers/0f4b3e9d-93c2-4556-84c6-b4fb26f4424d => generated 1207 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:51.554323 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c259e985-b44f-48b0-8364-82f105a21286 tempest-ImagesMetadataTestJSON-1828188922 tempest-ImagesMetadataTestJSON-1828188922-project] Calling method '.version_select at 0x7f7cd9944e50>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:51.604037 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c259e985-b44f-48b0-8364-82f105a21286 tempest-ImagesMetadataTestJSON-1828188922 tempest-ImagesMetadataTestJSON-1828188922-project] 10.222.0.79 "GET /compute/v2.1/images/af0d807c-3629-472f-8ab5-0b3cedad7bc8/metadata" status: 200 len: 37 microversion: 2.1 time: 0.053198 Oct 17 13:40:51.604618 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 954/1855] 10.222.0.79 () {58 vars in 1260 bytes} [Mon Oct 17 13:40:51 2022] GET /compute/v2.1/images/af0d807c-3629-472f-8ab5-0b3cedad7bc8/metadata => generated 37 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:40:51.616685 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5e530d1c-d448-438f-8146-9cd9edaed35d tempest-AbsoluteLimitsNegativeTestJSON-912247969 tempest-AbsoluteLimitsNegativeTestJSON-912247969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1383102294", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:51.677091 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-5e530d1c-d448-438f-8146-9cd9edaed35d tempest-AbsoluteLimitsNegativeTestJSON-912247969 tempest-AbsoluteLimitsNegativeTestJSON-912247969-project] validate_networks() for None {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:40:51.861823 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c8f3bf01-81eb-4b57-b659-43b0bdb49d87 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:51.870624 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c8f3bf01-81eb-4b57-b659-43b0bdb49d87 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9" status: 200 len: 1514 microversion: 2.1 time: 0.367417 Oct 17 13:40:51.871690 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 902/1856] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:51 2022] GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9 => generated 1514 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:51.876901 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-62e460d3-3b6f-4966-abf7-3a8b9d706482 tempest-ImagesMetadataTestJSON-1828188922 tempest-ImagesMetadataTestJSON-1828188922-project] Action: 'update_all', calling method: .version_select at 0x7f7cd4f554c0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:51.933069 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-62e460d3-3b6f-4966-abf7-3a8b9d706482 tempest-ImagesMetadataTestJSON-1828188922 tempest-ImagesMetadataTestJSON-1828188922-project] Getting quotas for project 51e91cb55f41495f976de19b833706b4. Resources: dict_keys(['metadata_items']) {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:40:51.938288 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-62e460d3-3b6f-4966-abf7-3a8b9d706482 tempest-ImagesMetadataTestJSON-1828188922 tempest-ImagesMetadataTestJSON-1828188922-project] Getting quotas for user 2bad6c96292e49d5823b08162071f840 and project 51e91cb55f41495f976de19b833706b4. Resources: dict_keys(['metadata_items']) {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:40:52.141527 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-5e530d1c-d448-438f-8146-9cd9edaed35d tempest-AbsoluteLimitsNegativeTestJSON-912247969 tempest-AbsoluteLimitsNegativeTestJSON-912247969-project] Getting quotas for project bc801c3589404e3da3e57cb1ae708205. Resources: dict_keys(['metadata_items']) {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:40:52.161816 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-5e530d1c-d448-438f-8146-9cd9edaed35d tempest-AbsoluteLimitsNegativeTestJSON-912247969 tempest-AbsoluteLimitsNegativeTestJSON-912247969-project] Getting quotas for user 8b8dbba7878b4225a9401d26d672496d and project bc801c3589404e3da3e57cb1ae708205. Resources: dict_keys(['metadata_items']) {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:40:52.189755 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-5e530d1c-d448-438f-8146-9cd9edaed35d tempest-AbsoluteLimitsNegativeTestJSON-912247969 tempest-AbsoluteLimitsNegativeTestJSON-912247969-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 17 13:40:52.191772 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5e530d1c-d448-438f-8146-9cd9edaed35d tempest-AbsoluteLimitsNegativeTestJSON-912247969 tempest-AbsoluteLimitsNegativeTestJSON-912247969-project] Request method failure captured: Oct 17 13:40:52.191772 n-d-854247-14 devstack@n-api.service[127017]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:40:52.191772 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:40:52.191772 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:40:52.191772 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:40:52.191772 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 1752 Oct 17 13:40:52.191772 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:40:52.191772 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:40:52.191772 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:40:52.191772 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:40:52.191772 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVti2RP94PMJV-NyCDmhOrJS54jDyC38kku_UHSY684yZD6uI0ZYcjqAS36YpQI3ZfwVwHNGLLxaIkrhOcSWu-dvIdce-4q8dsCjNpPMZ45Cih_uNdtdcTqSJxl-Fpnfv3jmhSgSTClLkgPjAb1zPzsfdGTrAUdS4Z4uPwlvWSYj_Bg Oct 17 13:40:52.191772 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:40:52.191772 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:40:52.191772 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:40:52.191772 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:40:52.191772 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:40:52.191772 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:40:52.191772 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: bc801c3589404e3da3e57cb1ae708205 Oct 17 13:40:52.191772 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-912247969 Oct 17 13:40:52.191772 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:40:52.191772 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:40:52.191772 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/bc801c3589404e3da3e57cb1ae708205"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/bc801c3589404e3da3e57cb1ae708205"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/bc801c3589404e3da3e57cb1ae708205"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_bc801c3589404e3da3e57cb1ae708205", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:40:52.191772 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-912247969 Oct 17 13:40:52.191772 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: bc801c3589404e3da3e57cb1ae708205 Oct 17 13:40:52.191772 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-912247969 Oct 17 13:40:52.191772 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-912247969-project Oct 17 13:40:52.191772 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:40:52.191772 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:40:52.191772 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 8b8dbba7878b4225a9401d26d672496d Oct 17 13:40:52.191772 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-912247969-project Oct 17 13:40:52.191772 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 13:40:52.191772 n-d-854247-14 devstack@n-api.service[127017]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1383102294", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 17 13:40:52.191772 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:40:52.191772 n-d-854247-14 devstack@n-api.service[127017]: exception: Maximum number of metadata items exceeds 128 Oct 17 13:40:52.194670 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1383102294', 'imageRef': '0743b21b-a6ff-4d02-897c-eabb68c3ba07', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 17 13:40:52.194670 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:40:52.194670 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:40:52.194670 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 17 13:40:52.194670 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 17 13:40:52.194670 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:40:52.194670 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:40:52.194670 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 17 13:40:52.194670 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 17 13:40:52.194670 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 17 13:40:52.194670 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 17 13:40:52.194670 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 17 13:40:52.194670 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 17 13:40:52.194670 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 17 13:40:52.194670 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:40:52.194670 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:40:52.194670 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:40:52.194670 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:40:52.194670 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 17 13:40:52.194670 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 17 13:40:52.194670 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 17 13:40:52.194670 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 17 13:40:52.194670 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 17 13:40:52.194670 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 17 13:40:52.194670 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 17 13:40:52.194670 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 17 13:40:52.194670 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 17 13:40:52.194670 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 17 13:40:52.194670 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 17 13:40:52.194670 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:40:52.194670 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:40:52.194670 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:40:52.194670 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:40:52.194670 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:40:52.194670 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:40:52.194670 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:40:52.194670 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:40:52.194670 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:40:52.194670 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:40:52.194670 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:40:52.194670 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:40:52.194670 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:40:52.194670 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:40:52.194670 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:40:52.199493 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:40:52.199493 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 17 13:40:52.199493 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 17 13:40:52.199493 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 17 13:40:52.199493 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 17 13:40:52.199493 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:40:52.199493 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:40:52.199493 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:40:52.199493 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:40:52.199493 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:40:52.199493 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:40:52.199493 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:40:52.199493 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:40:52.199493 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 17 13:40:52.199493 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:40:52.199493 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5e530d1c-d448-438f-8146-9cd9edaed35d tempest-AbsoluteLimitsNegativeTestJSON-912247969 tempest-AbsoluteLimitsNegativeTestJSON-912247969-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:40:52.199493 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5e530d1c-d448-438f-8146-9cd9edaed35d tempest-AbsoluteLimitsNegativeTestJSON-912247969 tempest-AbsoluteLimitsNegativeTestJSON-912247969-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.584379 Oct 17 13:40:52.220101 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 955/1857] 10.222.0.79 () {60 vars in 1148 bytes} [Mon Oct 17 13:40:51 2022] POST /compute/v2.1/servers => generated 87 bytes in 611 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:40:52.225331 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-15c33139-99cf-4b2e-98e7-8312e0d68523 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:52.225954 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-15c33139-99cf-4b2e-98e7-8312e0d68523 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] [instance: 3d4188da-b0f7-4d97-952b-acebaa48f185] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:52.242762 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-15c33139-99cf-4b2e-98e7-8312e0d68523 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:52.243288 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-15c33139-99cf-4b2e-98e7-8312e0d68523 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:52.252067 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-15c33139-99cf-4b2e-98e7-8312e0d68523 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:52.253090 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-15c33139-99cf-4b2e-98e7-8312e0d68523 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:52.253767 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-15c33139-99cf-4b2e-98e7-8312e0d68523 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:52.254364 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-15c33139-99cf-4b2e-98e7-8312e0d68523 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:52.322200 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-62e460d3-3b6f-4966-abf7-3a8b9d706482 tempest-ImagesMetadataTestJSON-1828188922 tempest-ImagesMetadataTestJSON-1828188922-project] 10.222.0.79 "PUT /compute/v2.1/images/af0d807c-3629-472f-8ab5-0b3cedad7bc8/metadata" status: 200 len: 61 microversion: 2.1 time: 0.449008 Oct 17 13:40:52.328307 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 903/1858] 10.222.0.79 () {60 vars in 1280 bytes} [Mon Oct 17 13:40:51 2022] PUT /compute/v2.1/images/af0d807c-3629-472f-8ab5-0b3cedad7bc8/metadata => generated 61 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:40:52.334374 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c59c54d1-a7bc-47a4-be86-faa41f36f069 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:52.335473 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c59c54d1-a7bc-47a4-be86-faa41f36f069 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:52.358762 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c59c54d1-a7bc-47a4-be86-faa41f36f069 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:52.359566 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c59c54d1-a7bc-47a4-be86-faa41f36f069 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:52.360296 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c59c54d1-a7bc-47a4-be86-faa41f36f069 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:52.361312 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c59c54d1-a7bc-47a4-be86-faa41f36f069 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:52.361973 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c59c54d1-a7bc-47a4-be86-faa41f36f069 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:52.362607 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c59c54d1-a7bc-47a4-be86-faa41f36f069 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:52.503646 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c59c54d1-a7bc-47a4-be86-faa41f36f069 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:52.514905 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c59c54d1-a7bc-47a4-be86-faa41f36f069 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:52.516961 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c59c54d1-a7bc-47a4-be86-faa41f36f069 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:52.524137 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c59c54d1-a7bc-47a4-be86-faa41f36f069 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1537 microversion: 2.91 time: 0.193519 Oct 17 13:40:52.524806 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 904/1859] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:40:52 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1537 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:40:52.535366 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c04ad669-ffbb-43fe-b365-0751a92abe1c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:52.536426 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c04ad669-ffbb-43fe-b365-0751a92abe1c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: a54adf11-ee58-4f13-82c8-9a00a36c536e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:52.546224 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c04ad669-ffbb-43fe-b365-0751a92abe1c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:52.546878 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c04ad669-ffbb-43fe-b365-0751a92abe1c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:52.547560 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c04ad669-ffbb-43fe-b365-0751a92abe1c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:52.548508 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c04ad669-ffbb-43fe-b365-0751a92abe1c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:52.549162 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c04ad669-ffbb-43fe-b365-0751a92abe1c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:52.549998 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c04ad669-ffbb-43fe-b365-0751a92abe1c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:52.558751 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-15c33139-99cf-4b2e-98e7-8312e0d68523 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:52.561490 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=14 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:40:52.569320 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-15c33139-99cf-4b2e-98e7-8312e0d68523 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers/3d4188da-b0f7-4d97-952b-acebaa48f185" status: 200 len: 1522 microversion: 2.1 time: 0.348002 Oct 17 13:40:52.570044 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 956/1860] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:52 2022] GET /compute/v2.1/servers/3d4188da-b0f7-4d97-952b-acebaa48f185 => generated 1522 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:52.575325 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-ed550a04-8a00-4677-9f1b-ff7baaba9c8a req-298b357e-5b65-40ca-9ab0-a4bb7f0115aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a54adf11-ee58-4f13-82c8-9a00a36c536e", "name": "network-vif-deleted", "tag": "f261c54a-cf39-4ca3-a4d0-eb2c41dbcbe0"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:52.585584 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-ed550a04-8a00-4677-9f1b-ff7baaba9c8a req-298b357e-5b65-40ca-9ab0-a4bb7f0115aa service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:52.586444 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-ed550a04-8a00-4677-9f1b-ff7baaba9c8a req-298b357e-5b65-40ca-9ab0-a4bb7f0115aa service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:52.586923 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-ed550a04-8a00-4677-9f1b-ff7baaba9c8a req-298b357e-5b65-40ca-9ab0-a4bb7f0115aa service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:52.598598 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-ed550a04-8a00-4677-9f1b-ff7baaba9c8a req-298b357e-5b65-40ca-9ab0-a4bb7f0115aa service nova] Creating event network-vif-deleted:f261c54a-cf39-4ca3-a4d0-eb2c41dbcbe0 for instance a54adf11-ee58-4f13-82c8-9a00a36c536e on n-h2-854247-14 Oct 17 13:40:52.601890 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c04ad669-ffbb-43fe-b365-0751a92abe1c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:52.602602 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c04ad669-ffbb-43fe-b365-0751a92abe1c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:52.603670 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c04ad669-ffbb-43fe-b365-0751a92abe1c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:52.604278 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-c04ad669-ffbb-43fe-b365-0751a92abe1c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lazy-loading 'fault' on Instance uuid a54adf11-ee58-4f13-82c8-9a00a36c536e {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:40:52.604560 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-ed550a04-8a00-4677-9f1b-ff7baaba9c8a req-298b357e-5b65-40ca-9ab0-a4bb7f0115aa service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033094 Oct 17 13:40:52.605695 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 957/1861] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:40:52.611960 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-eacd047f-c33d-414a-ac24-0b642e2909e4 tempest-ImagesMetadataTestJSON-1828188922 tempest-ImagesMetadataTestJSON-1828188922-project] Calling method '.version_select at 0x7f7cd9a8bf70>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:52.654949 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-eacd047f-c33d-414a-ac24-0b642e2909e4 tempest-ImagesMetadataTestJSON-1828188922 tempest-ImagesMetadataTestJSON-1828188922-project] 10.222.0.79 "GET /compute/v2.1/images/af0d807c-3629-472f-8ab5-0b3cedad7bc8/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.047694 Oct 17 13:40:52.655797 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 958/1862] 10.222.0.79 () {58 vars in 1290 bytes} [Mon Oct 17 13:40:52 2022] GET /compute/v2.1/images/af0d807c-3629-472f-8ab5-0b3cedad7bc8/metadata/os_distro => generated 33 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:40:52.659406 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c04ad669-ffbb-43fe-b365-0751a92abe1c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:52.664012 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d6107e05-84d3-4366-9ffb-d9347ecea807 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:52.664814 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d6107e05-84d3-4366-9ffb-d9347ecea807 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 0f4b3e9d-93c2-4556-84c6-b4fb26f4424d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:52.672240 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d6107e05-84d3-4366-9ffb-d9347ecea807 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:52.673463 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d6107e05-84d3-4366-9ffb-d9347ecea807 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:52.673905 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d6107e05-84d3-4366-9ffb-d9347ecea807 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:52.674834 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d6107e05-84d3-4366-9ffb-d9347ecea807 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:52.675470 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d6107e05-84d3-4366-9ffb-d9347ecea807 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:52.676058 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d6107e05-84d3-4366-9ffb-d9347ecea807 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:52.679070 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c04ad669-ffbb-43fe-b365-0751a92abe1c tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e" status: 200 len: 1324 microversion: 2.1 time: 0.152477 Oct 17 13:40:52.680082 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 905/1863] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:52 2022] GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e => generated 1324 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:52.684768 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-54dd1785-e6c7-495e-b21e-9d278aac38f5 tempest-ImagesMetadataTestJSON-1828188922 tempest-ImagesMetadataTestJSON-1828188922-project] Action: 'update_all', calling method: .version_select at 0x7f7cd4cb3940>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:52.753859 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d6107e05-84d3-4366-9ffb-d9347ecea807 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:52.762009 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d6107e05-84d3-4366-9ffb-d9347ecea807 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/0f4b3e9d-93c2-4556-84c6-b4fb26f4424d" status: 200 len: 1259 microversion: 2.1 time: 0.104979 Oct 17 13:40:52.762963 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 959/1864] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:52 2022] GET /compute/v2.1/servers/0f4b3e9d-93c2-4556-84c6-b4fb26f4424d => generated 1259 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:52.785143 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-54dd1785-e6c7-495e-b21e-9d278aac38f5 tempest-ImagesMetadataTestJSON-1828188922 tempest-ImagesMetadataTestJSON-1828188922-project] Getting quotas for project 51e91cb55f41495f976de19b833706b4. Resources: dict_keys(['metadata_items']) {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:40:52.792759 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-54dd1785-e6c7-495e-b21e-9d278aac38f5 tempest-ImagesMetadataTestJSON-1828188922 tempest-ImagesMetadataTestJSON-1828188922-project] Getting quotas for user 2bad6c96292e49d5823b08162071f840 and project 51e91cb55f41495f976de19b833706b4. Resources: dict_keys(['metadata_items']) {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:40:52.884565 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-15c484b7-cb17-4022-b3fa-f630a4cfb300 req-3ce8c585-eb18-44d6-82c8-9273baae1da8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b05d2fa3-d231-4842-a47b-26aa317ccaa3", "name": "network-vif-unplugged", "status": "completed", "tag": "e6d816ac-9228-42e4-83a0-1b8d95fc766f"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:52.899115 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-15c484b7-cb17-4022-b3fa-f630a4cfb300 req-3ce8c585-eb18-44d6-82c8-9273baae1da8 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:52.902052 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-15c484b7-cb17-4022-b3fa-f630a4cfb300 req-3ce8c585-eb18-44d6-82c8-9273baae1da8 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:52.904006 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-15c484b7-cb17-4022-b3fa-f630a4cfb300 req-3ce8c585-eb18-44d6-82c8-9273baae1da8 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:52.946891 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-15c484b7-cb17-4022-b3fa-f630a4cfb300 req-3ce8c585-eb18-44d6-82c8-9273baae1da8 service nova] Creating event network-vif-unplugged:e6d816ac-9228-42e4-83a0-1b8d95fc766f for instance b05d2fa3-d231-4842-a47b-26aa317ccaa3 on n-h1-854247-14 Oct 17 13:40:52.962603 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-15c484b7-cb17-4022-b3fa-f630a4cfb300 req-3ce8c585-eb18-44d6-82c8-9273baae1da8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081784 Oct 17 13:40:52.965386 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 960/1865] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:40:52.979684 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b5cdf7a2-bf34-4639-963a-3ac07af2c11f tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:52.982694 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b5cdf7a2-bf34-4639-963a-3ac07af2c11f tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9c6b4ed2-b111-41b0-9679-b66d386834b9] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:52.997819 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b5cdf7a2-bf34-4639-963a-3ac07af2c11f tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:52.999748 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b5cdf7a2-bf34-4639-963a-3ac07af2c11f tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:53.000656 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b5cdf7a2-bf34-4639-963a-3ac07af2c11f tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:53.003159 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b5cdf7a2-bf34-4639-963a-3ac07af2c11f tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:53.004367 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b5cdf7a2-bf34-4639-963a-3ac07af2c11f tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:53.006105 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b5cdf7a2-bf34-4639-963a-3ac07af2c11f tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:53.052778 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-54dd1785-e6c7-495e-b21e-9d278aac38f5 tempest-ImagesMetadataTestJSON-1828188922 tempest-ImagesMetadataTestJSON-1828188922-project] 10.222.0.79 "PUT /compute/v2.1/images/af0d807c-3629-472f-8ab5-0b3cedad7bc8/metadata" status: 200 len: 61 microversion: 2.1 time: 0.371481 Oct 17 13:40:53.058379 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 906/1866] 10.222.0.79 () {60 vars in 1280 bytes} [Mon Oct 17 13:40:52 2022] PUT /compute/v2.1/images/af0d807c-3629-472f-8ab5-0b3cedad7bc8/metadata => generated 61 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:40:53.080996 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f618e8c8-ce62-4c05-a0e9-38d313a00734 tempest-ImagesMetadataTestJSON-1828188922 tempest-ImagesMetadataTestJSON-1828188922-project] Calling method '.version_select at 0x7f7cd4d63ee0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:53.186653 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f618e8c8-ce62-4c05-a0e9-38d313a00734 tempest-ImagesMetadataTestJSON-1828188922 tempest-ImagesMetadataTestJSON-1828188922-project] 10.222.0.79 "GET /compute/v2.1/images/af0d807c-3629-472f-8ab5-0b3cedad7bc8/metadata" status: 200 len: 61 microversion: 2.1 time: 0.126783 Oct 17 13:40:53.187676 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 907/1867] 10.222.0.79 () {58 vars in 1260 bytes} [Mon Oct 17 13:40:53 2022] GET /compute/v2.1/images/af0d807c-3629-472f-8ab5-0b3cedad7bc8/metadata => generated 61 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:40:53.199506 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b176d267-8e4e-4782-af15-de7242b64268 tempest-ImagesMetadataTestJSON-1828188922 tempest-ImagesMetadataTestJSON-1828188922-project] Action: 'update_all', calling method: .version_select at 0x7f7cd4f55040>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:53.276057 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-b176d267-8e4e-4782-af15-de7242b64268 tempest-ImagesMetadataTestJSON-1828188922 tempest-ImagesMetadataTestJSON-1828188922-project] Getting quotas for project 51e91cb55f41495f976de19b833706b4. Resources: dict_keys(['metadata_items']) {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:40:53.279884 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:40:53.284004 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-b176d267-8e4e-4782-af15-de7242b64268 tempest-ImagesMetadataTestJSON-1828188922 tempest-ImagesMetadataTestJSON-1828188922-project] Getting quotas for user 2bad6c96292e49d5823b08162071f840 and project 51e91cb55f41495f976de19b833706b4. Resources: dict_keys(['metadata_items']) {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:40:53.323573 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b5cdf7a2-bf34-4639-963a-3ac07af2c11f tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:53.339386 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b5cdf7a2-bf34-4639-963a-3ac07af2c11f tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9" status: 200 len: 1514 microversion: 2.1 time: 0.363274 Oct 17 13:40:53.340730 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 961/1868] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:52 2022] GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9 => generated 1514 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:53.528654 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b176d267-8e4e-4782-af15-de7242b64268 tempest-ImagesMetadataTestJSON-1828188922 tempest-ImagesMetadataTestJSON-1828188922-project] 10.222.0.79 "PUT /compute/v2.1/images/af0d807c-3629-472f-8ab5-0b3cedad7bc8/metadata" status: 200 len: 61 microversion: 2.1 time: 0.334320 Oct 17 13:40:53.529330 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 908/1869] 10.222.0.79 () {60 vars in 1280 bytes} [Mon Oct 17 13:40:53 2022] PUT /compute/v2.1/images/af0d807c-3629-472f-8ab5-0b3cedad7bc8/metadata => generated 61 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 17 13:40:53.540524 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2ee75b74-0a67-4f2b-a880-4f754a695e80 tempest-ImagesMetadataTestJSON-1828188922 tempest-ImagesMetadataTestJSON-1828188922-project] Action: 'update_all', calling method: .version_select at 0x7f7cd98e39d0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:53.554904 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e47ec37b-8c1a-4ab8-bafe-19e87f7c692e tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:53.555568 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e47ec37b-8c1a-4ab8-bafe-19e87f7c692e tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:53.570441 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e47ec37b-8c1a-4ab8-bafe-19e87f7c692e tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:53.577270 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e47ec37b-8c1a-4ab8-bafe-19e87f7c692e tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:53.577792 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e47ec37b-8c1a-4ab8-bafe-19e87f7c692e tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:53.579848 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e47ec37b-8c1a-4ab8-bafe-19e87f7c692e tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:53.581687 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e47ec37b-8c1a-4ab8-bafe-19e87f7c692e tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:53.583246 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e47ec37b-8c1a-4ab8-bafe-19e87f7c692e tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:53.615641 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-2ee75b74-0a67-4f2b-a880-4f754a695e80 tempest-ImagesMetadataTestJSON-1828188922 tempest-ImagesMetadataTestJSON-1828188922-project] Getting quotas for project 51e91cb55f41495f976de19b833706b4. Resources: dict_keys(['metadata_items']) {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:40:53.622531 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-2ee75b74-0a67-4f2b-a880-4f754a695e80 tempest-ImagesMetadataTestJSON-1828188922 tempest-ImagesMetadataTestJSON-1828188922-project] Getting quotas for user 2bad6c96292e49d5823b08162071f840 and project 51e91cb55f41495f976de19b833706b4. Resources: dict_keys(['metadata_items']) {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:40:53.731087 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e47ec37b-8c1a-4ab8-bafe-19e87f7c692e tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:53.743831 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e47ec37b-8c1a-4ab8-bafe-19e87f7c692e tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:53.747702 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e47ec37b-8c1a-4ab8-bafe-19e87f7c692e tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:53.765033 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e47ec37b-8c1a-4ab8-bafe-19e87f7c692e tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1558 microversion: 2.91 time: 0.213125 Oct 17 13:40:53.765033 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 909/1870] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:40:53 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1558 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:40:53.799227 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ae907e7f-f3b1-4855-a7bf-c64608119149 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:53.802120 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ae907e7f-f3b1-4855-a7bf-c64608119149 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] [instance: 3d4188da-b0f7-4d97-952b-acebaa48f185] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:53.810330 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ae907e7f-f3b1-4855-a7bf-c64608119149 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:53.810909 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ae907e7f-f3b1-4855-a7bf-c64608119149 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:53.811477 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ae907e7f-f3b1-4855-a7bf-c64608119149 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:53.812415 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ae907e7f-f3b1-4855-a7bf-c64608119149 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:53.813322 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ae907e7f-f3b1-4855-a7bf-c64608119149 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:53.813975 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ae907e7f-f3b1-4855-a7bf-c64608119149 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:54.163546 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ae907e7f-f3b1-4855-a7bf-c64608119149 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:54.173169 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ae907e7f-f3b1-4855-a7bf-c64608119149 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers/3d4188da-b0f7-4d97-952b-acebaa48f185" status: 200 len: 1522 microversion: 2.1 time: 0.409265 Oct 17 13:40:54.180006 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 910/1871] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:53 2022] GET /compute/v2.1/servers/3d4188da-b0f7-4d97-952b-acebaa48f185 => generated 1522 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:54.185386 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-47b41136-b7f0-46a7-aa2d-f2b3f250d5ea tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:54.186674 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-47b41136-b7f0-46a7-aa2d-f2b3f250d5ea tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: a54adf11-ee58-4f13-82c8-9a00a36c536e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:54.202755 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-47b41136-b7f0-46a7-aa2d-f2b3f250d5ea tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:54.207438 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-47b41136-b7f0-46a7-aa2d-f2b3f250d5ea tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:54.208051 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-47b41136-b7f0-46a7-aa2d-f2b3f250d5ea tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:54.209440 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-47b41136-b7f0-46a7-aa2d-f2b3f250d5ea tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:54.213891 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-47b41136-b7f0-46a7-aa2d-f2b3f250d5ea tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:54.214664 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-47b41136-b7f0-46a7-aa2d-f2b3f250d5ea tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:54.233206 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2ee75b74-0a67-4f2b-a880-4f754a695e80 tempest-ImagesMetadataTestJSON-1828188922 tempest-ImagesMetadataTestJSON-1828188922-project] 10.222.0.79 "PUT /compute/v2.1/images/af0d807c-3629-472f-8ab5-0b3cedad7bc8/metadata" status: 200 len: 64 microversion: 2.1 time: 0.697732 Oct 17 13:40:54.234529 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 962/1872] 10.222.0.79 () {60 vars in 1280 bytes} [Mon Oct 17 13:40:53 2022] PUT /compute/v2.1/images/af0d807c-3629-472f-8ab5-0b3cedad7bc8/metadata => generated 64 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:40:54.240510 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-546261a4-e8d4-4d61-a99b-dd42c58224fd tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:54.241759 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-546261a4-e8d4-4d61-a99b-dd42c58224fd tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 0f4b3e9d-93c2-4556-84c6-b4fb26f4424d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:54.246882 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-47b41136-b7f0-46a7-aa2d-f2b3f250d5ea tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] HTTP exception thrown: Instance a54adf11-ee58-4f13-82c8-9a00a36c536e could not be found. Oct 17 13:40:54.259709 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-47b41136-b7f0-46a7-aa2d-f2b3f250d5ea tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Request method failure captured: Oct 17 13:40:54.259709 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e HTTP/1.1 Oct 17 13:40:54.259709 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:40:54.259709 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:40:54.259709 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:40:54.259709 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:40:54.259709 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:40:54.259709 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:40:54.259709 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:40:54.259709 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:40:54.259709 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVnf7-Dca7FemnEfwN1PP70lPaklLhr73YscDZW-kH2dv9JufJhPrvu4B01Xz8mp5WeJNf6wVLfrcVKnHMZ0ejiaugm7o2xbOLsMKgoKWmbTZvm4LNm375rjAD4LdzC1RuTZUuDbYqOIeHyYqmXioD65BcGywVZd7DddcEolMO-Fowg Oct 17 13:40:54.259709 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:40:54.259709 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:40:54.259709 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:40:54.259709 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:40:54.259709 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:40:54.259709 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:40:54.259709 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: ccf0569de787477e964f570378d6459a Oct 17 13:40:54.259709 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-LiveMigrationTest-840909216 Oct 17 13:40:54.259709 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:40:54.259709 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:40:54.259709 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ccf0569de787477e964f570378d6459a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ccf0569de787477e964f570378d6459a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ccf0569de787477e964f570378d6459a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ccf0569de787477e964f570378d6459a", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:40:54.259709 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-LiveMigrationTest-840909216 Oct 17 13:40:54.259709 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: ccf0569de787477e964f570378d6459a Oct 17 13:40:54.259709 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-LiveMigrationTest-840909216 Oct 17 13:40:54.259709 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-LiveMigrationTest-840909216-project Oct 17 13:40:54.259709 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:40:54.259709 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:40:54.259709 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 62cc720667f44772988d7890c227b217 Oct 17 13:40:54.259709 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-LiveMigrationTest-840909216-project Oct 17 13:40:54.259709 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:40:54.259709 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance a54adf11-ee58-4f13-82c8-9a00a36c536e could not be found. Oct 17 13:40:54.259709 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'a54adf11-ee58-4f13-82c8-9a00a36c536e'} Oct 17 13:40:54.259709 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:40:54.259709 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:40:54.259709 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:40:54.259709 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:40:54.259709 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:40:54.259709 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:40:54.259709 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:40:54.259709 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:40:54.259709 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:40:54.259709 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:40:54.259709 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a54adf11-ee58-4f13-82c8-9a00a36c536e could not be found. Oct 17 13:40:54.259709 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:40:54.259709 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:40:54.259709 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:40:54.259709 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:40:54.259709 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:40:54.259709 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:40:54.259709 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:40:54.259709 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:40:54.259709 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:40:54.259709 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:40:54.259709 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:40:54.259709 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:40:54.259709 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:40:54.259709 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:40:54.259709 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:40:54.259709 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:40:54.259709 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a54adf11-ee58-4f13-82c8-9a00a36c536e could not be found. Oct 17 13:40:54.259709 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:40:54.259709 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:40:54.259709 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:40:54.264674 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:40:54.264674 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:40:54.264674 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:40:54.264674 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:40:54.264674 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:40:54.264674 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a54adf11-ee58-4f13-82c8-9a00a36c536e could not be found. Oct 17 13:40:54.264674 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:40:54.266990 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-47b41136-b7f0-46a7-aa2d-f2b3f250d5ea tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Returning 404 to user: Instance a54adf11-ee58-4f13-82c8-9a00a36c536e could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:40:54.268553 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-47b41136-b7f0-46a7-aa2d-f2b3f250d5ea tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e" status: 404 len: 111 microversion: 2.1 time: 0.087516 Oct 17 13:40:54.269133 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 911/1873] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:54 2022] GET /compute/v2.1/servers/a54adf11-ee58-4f13-82c8-9a00a36c536e => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:40:54.269811 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-546261a4-e8d4-4d61-a99b-dd42c58224fd tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:54.270445 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-546261a4-e8d4-4d61-a99b-dd42c58224fd tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:54.273060 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-546261a4-e8d4-4d61-a99b-dd42c58224fd tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:54.275541 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-546261a4-e8d4-4d61-a99b-dd42c58224fd tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:54.275928 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4ddfe324-e8b3-4eca-b0b0-180bff29ce2a tempest-ImagesMetadataTestJSON-1828188922 tempest-ImagesMetadataTestJSON-1828188922-project] Calling method '.version_select at 0x7f7cd4cc85e0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:54.287358 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-546261a4-e8d4-4d61-a99b-dd42c58224fd tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:54.294603 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-546261a4-e8d4-4d61-a99b-dd42c58224fd tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:54.329024 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4ddfe324-e8b3-4eca-b0b0-180bff29ce2a tempest-ImagesMetadataTestJSON-1828188922 tempest-ImagesMetadataTestJSON-1828188922-project] 10.222.0.79 "GET /compute/v2.1/images/af0d807c-3629-472f-8ab5-0b3cedad7bc8/metadata" status: 200 len: 64 microversion: 2.1 time: 0.058312 Oct 17 13:40:54.329752 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 912/1874] 10.222.0.79 () {58 vars in 1260 bytes} [Mon Oct 17 13:40:54 2022] GET /compute/v2.1/images/af0d807c-3629-472f-8ab5-0b3cedad7bc8/metadata => generated 64 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:40:54.337218 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0f018fe0-7c11-472e-99b3-2773d6e880c4 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '.version_select at 0x7f7cd4cb3160>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:54.399005 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0f018fe0-7c11-472e-99b3-2773d6e880c4 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1144851060" status: 202 len: 0 microversion: 2.1 time: 0.065163 Oct 17 13:40:54.404982 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 913/1875] 10.222.0.79 () {58 vars in 1221 bytes} [Mon Oct 17 13:40:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1144851060 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:40:54.410855 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c2cb7fd7-1cb4-45eb-8c94-434e7061ad6c tempest-ImagesMetadataTestJSON-1828188922 tempest-ImagesMetadataTestJSON-1828188922-project] Action: 'update_all', calling method: .version_select at 0x7f7cd50711f0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:54.532238 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-c2cb7fd7-1cb4-45eb-8c94-434e7061ad6c tempest-ImagesMetadataTestJSON-1828188922 tempest-ImagesMetadataTestJSON-1828188922-project] Getting quotas for project 51e91cb55f41495f976de19b833706b4. Resources: dict_keys(['metadata_items']) {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:40:54.548542 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-c2cb7fd7-1cb4-45eb-8c94-434e7061ad6c tempest-ImagesMetadataTestJSON-1828188922 tempest-ImagesMetadataTestJSON-1828188922-project] Getting quotas for user 2bad6c96292e49d5823b08162071f840 and project 51e91cb55f41495f976de19b833706b4. Resources: dict_keys(['metadata_items']) {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:40:54.697762 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-546261a4-e8d4-4d61-a99b-dd42c58224fd tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:54.719187 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-546261a4-e8d4-4d61-a99b-dd42c58224fd tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/0f4b3e9d-93c2-4556-84c6-b4fb26f4424d" status: 200 len: 1307 microversion: 2.1 time: 0.483330 Oct 17 13:40:54.728623 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 963/1876] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:54 2022] GET /compute/v2.1/servers/0f4b3e9d-93c2-4556-84c6-b4fb26f4424d => generated 1307 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:54.748974 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bc2fa6f2-4960-4a52-8423-f67a1122800b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:54.751002 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-bc2fa6f2-4960-4a52-8423-f67a1122800b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9c6b4ed2-b111-41b0-9679-b66d386834b9] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:54.783780 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bc2fa6f2-4960-4a52-8423-f67a1122800b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:54.784275 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bc2fa6f2-4960-4a52-8423-f67a1122800b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:54.798406 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bc2fa6f2-4960-4a52-8423-f67a1122800b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:54.809578 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bc2fa6f2-4960-4a52-8423-f67a1122800b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:54.812515 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bc2fa6f2-4960-4a52-8423-f67a1122800b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:54.813992 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bc2fa6f2-4960-4a52-8423-f67a1122800b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:55.230148 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c2cb7fd7-1cb4-45eb-8c94-434e7061ad6c tempest-ImagesMetadataTestJSON-1828188922 tempest-ImagesMetadataTestJSON-1828188922-project] 10.222.0.79 "PUT /compute/v2.1/images/af0d807c-3629-472f-8ab5-0b3cedad7bc8/metadata" status: 200 len: 61 microversion: 2.1 time: 0.821559 Oct 17 13:40:55.231413 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 914/1877] 10.222.0.79 () {60 vars in 1280 bytes} [Mon Oct 17 13:40:54 2022] PUT /compute/v2.1/images/af0d807c-3629-472f-8ab5-0b3cedad7bc8/metadata => generated 61 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:40:55.241565 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e3a49ee8-0bb9-438e-a5cc-930b726e390d tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:55.242430 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e3a49ee8-0bb9-438e-a5cc-930b726e390d tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:55.251114 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e3a49ee8-0bb9-438e-a5cc-930b726e390d tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:55.252096 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e3a49ee8-0bb9-438e-a5cc-930b726e390d tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:55.253062 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e3a49ee8-0bb9-438e-a5cc-930b726e390d tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:55.254524 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e3a49ee8-0bb9-438e-a5cc-930b726e390d tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:55.255528 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e3a49ee8-0bb9-438e-a5cc-930b726e390d tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:55.256408 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e3a49ee8-0bb9-438e-a5cc-930b726e390d tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:55.452790 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e3a49ee8-0bb9-438e-a5cc-930b726e390d tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:55.465944 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e3a49ee8-0bb9-438e-a5cc-930b726e390d tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:55.472040 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e3a49ee8-0bb9-438e-a5cc-930b726e390d tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:55.487679 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e3a49ee8-0bb9-438e-a5cc-930b726e390d tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1558 microversion: 2.91 time: 0.249950 Oct 17 13:40:55.492710 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 915/1878] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:40:55 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1558 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:40:55.505334 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-78fd5d44-0fab-4e59-9eeb-333c01cdfffc tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:55.506248 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-78fd5d44-0fab-4e59-9eeb-333c01cdfffc tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] [instance: 3d4188da-b0f7-4d97-952b-acebaa48f185] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:55.523030 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-78fd5d44-0fab-4e59-9eeb-333c01cdfffc tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:55.525682 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-78fd5d44-0fab-4e59-9eeb-333c01cdfffc tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:55.527485 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-78fd5d44-0fab-4e59-9eeb-333c01cdfffc tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:55.530832 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-78fd5d44-0fab-4e59-9eeb-333c01cdfffc tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:55.531927 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-78fd5d44-0fab-4e59-9eeb-333c01cdfffc tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:55.532917 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-78fd5d44-0fab-4e59-9eeb-333c01cdfffc tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:55.561795 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-bc2fa6f2-4960-4a52-8423-f67a1122800b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:55.580142 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-bc2fa6f2-4960-4a52-8423-f67a1122800b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9" status: 200 len: 1514 microversion: 2.1 time: 0.849348 Oct 17 13:40:55.582418 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 964/1879] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:54 2022] GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9 => generated 1514 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:55.595815 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4dd5dd7a-4650-4d87-89b3-04262c8693de tempest-ImagesMetadataTestJSON-1828188922 tempest-ImagesMetadataTestJSON-1828188922-project] Action: 'update', calling method: .version_select at 0x7f7cd98d0670>, body: {"meta": {"os_version": "alt"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:55.965811 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-4dd5dd7a-4650-4d87-89b3-04262c8693de tempest-ImagesMetadataTestJSON-1828188922 tempest-ImagesMetadataTestJSON-1828188922-project] Getting quotas for project 51e91cb55f41495f976de19b833706b4. Resources: dict_keys(['metadata_items']) {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:40:55.980816 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-4dd5dd7a-4650-4d87-89b3-04262c8693de tempest-ImagesMetadataTestJSON-1828188922 tempest-ImagesMetadataTestJSON-1828188922-project] Getting quotas for user 2bad6c96292e49d5823b08162071f840 and project 51e91cb55f41495f976de19b833706b4. Resources: dict_keys(['metadata_items']) {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:40:56.543136 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-78fd5d44-0fab-4e59-9eeb-333c01cdfffc tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:56.552608 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-78fd5d44-0fab-4e59-9eeb-333c01cdfffc tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers/3d4188da-b0f7-4d97-952b-acebaa48f185" status: 200 len: 1522 microversion: 2.1 time: 1.058576 Oct 17 13:40:56.564328 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 916/1880] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:55 2022] GET /compute/v2.1/servers/3d4188da-b0f7-4d97-952b-acebaa48f185 => generated 1522 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:56.569565 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9da8cb84-3858-4928-a034-5ac4ceed3447 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:56.570197 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9da8cb84-3858-4928-a034-5ac4ceed3447 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 0f4b3e9d-93c2-4556-84c6-b4fb26f4424d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:56.583246 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9da8cb84-3858-4928-a034-5ac4ceed3447 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:56.584017 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9da8cb84-3858-4928-a034-5ac4ceed3447 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:56.586168 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9da8cb84-3858-4928-a034-5ac4ceed3447 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:56.587102 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9da8cb84-3858-4928-a034-5ac4ceed3447 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:56.590090 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9da8cb84-3858-4928-a034-5ac4ceed3447 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:56.590990 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9da8cb84-3858-4928-a034-5ac4ceed3447 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:57.026144 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9da8cb84-3858-4928-a034-5ac4ceed3447 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:57.040977 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9da8cb84-3858-4928-a034-5ac4ceed3447 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/0f4b3e9d-93c2-4556-84c6-b4fb26f4424d" status: 200 len: 1307 microversion: 2.1 time: 0.475028 Oct 17 13:40:57.042461 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 917/1881] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:56 2022] GET /compute/v2.1/servers/0f4b3e9d-93c2-4556-84c6-b4fb26f4424d => generated 1307 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:57.049443 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9b036eea-d5ee-431b-951b-ca9c5e50e756 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:57.050670 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9b036eea-d5ee-431b-951b-ca9c5e50e756 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: f869f059-89c3-4462-a309-e27f650d7584] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:57.066465 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9b036eea-d5ee-431b-951b-ca9c5e50e756 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:57.069078 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9b036eea-d5ee-431b-951b-ca9c5e50e756 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:57.070020 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9b036eea-d5ee-431b-951b-ca9c5e50e756 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:57.071657 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9b036eea-d5ee-431b-951b-ca9c5e50e756 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:57.072465 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9b036eea-d5ee-431b-951b-ca9c5e50e756 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:57.073101 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9b036eea-d5ee-431b-951b-ca9c5e50e756 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:57.186602 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9b036eea-d5ee-431b-951b-ca9c5e50e756 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: f869f059-89c3-4462-a309-e27f650d7584] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:40:57.422182 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9b036eea-d5ee-431b-951b-ca9c5e50e756 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "DELETE /compute/v2.1/servers/f869f059-89c3-4462-a309-e27f650d7584" status: 204 len: 0 microversion: 2.1 time: 0.377146 Oct 17 13:40:57.422812 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 918/1882] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:40:57 2022] DELETE /compute/v2.1/servers/f869f059-89c3-4462-a309-e27f650d7584 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:40:57.430293 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c0dbffad-1119-4c23-a432-78e61f0b66ef tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:57.431388 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c0dbffad-1119-4c23-a432-78e61f0b66ef tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:57.441990 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c0dbffad-1119-4c23-a432-78e61f0b66ef tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:57.442882 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c0dbffad-1119-4c23-a432-78e61f0b66ef tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:57.443589 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c0dbffad-1119-4c23-a432-78e61f0b66ef tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:57.444649 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c0dbffad-1119-4c23-a432-78e61f0b66ef tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:57.445586 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c0dbffad-1119-4c23-a432-78e61f0b66ef tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:57.446561 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c0dbffad-1119-4c23-a432-78e61f0b66ef tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:57.594974 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c0dbffad-1119-4c23-a432-78e61f0b66ef tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:57.613815 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c0dbffad-1119-4c23-a432-78e61f0b66ef tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:57.620226 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c0dbffad-1119-4c23-a432-78e61f0b66ef tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:57.633547 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c0dbffad-1119-4c23-a432-78e61f0b66ef tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1553 microversion: 2.91 time: 0.209347 Oct 17 13:40:57.635329 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 919/1883] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:40:57 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1553 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:40:57.652791 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-89cd55f5-3d3c-4e2a-88dd-70fac93fef73 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:57.653721 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-89cd55f5-3d3c-4e2a-88dd-70fac93fef73 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9c6b4ed2-b111-41b0-9679-b66d386834b9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:57.676880 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-89cd55f5-3d3c-4e2a-88dd-70fac93fef73 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:57.677715 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-89cd55f5-3d3c-4e2a-88dd-70fac93fef73 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:57.678347 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-89cd55f5-3d3c-4e2a-88dd-70fac93fef73 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:57.680319 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-89cd55f5-3d3c-4e2a-88dd-70fac93fef73 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:57.680951 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-89cd55f5-3d3c-4e2a-88dd-70fac93fef73 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:57.681996 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-89cd55f5-3d3c-4e2a-88dd-70fac93fef73 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:58.314179 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-89cd55f5-3d3c-4e2a-88dd-70fac93fef73 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:58.352377 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-89cd55f5-3d3c-4e2a-88dd-70fac93fef73 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9" status: 200 len: 1514 microversion: 2.1 time: 0.700460 Oct 17 13:40:58.355616 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 920/1884] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:57 2022] GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9 => generated 1514 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:58.375795 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-dc54ec38-b363-4e76-94a3-b6bc5369dabd tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:58.380105 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-dc54ec38-b363-4e76-94a3-b6bc5369dabd tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: f869f059-89c3-4462-a309-e27f650d7584] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:58.415225 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc54ec38-b363-4e76-94a3-b6bc5369dabd tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:58.421151 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc54ec38-b363-4e76-94a3-b6bc5369dabd tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:58.421717 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc54ec38-b363-4e76-94a3-b6bc5369dabd tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:58.422488 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc54ec38-b363-4e76-94a3-b6bc5369dabd tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:58.422955 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc54ec38-b363-4e76-94a3-b6bc5369dabd tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:58.423407 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc54ec38-b363-4e76-94a3-b6bc5369dabd tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:59.901990 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-dc54ec38-b363-4e76-94a3-b6bc5369dabd tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:59.905656 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:40:59.923427 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-dc54ec38-b363-4e76-94a3-b6bc5369dabd tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/f869f059-89c3-4462-a309-e27f650d7584" status: 200 len: 1482 microversion: 2.1 time: 1.566215 Oct 17 13:40:59.924030 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 921/1885] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:58 2022] GET /compute/v2.1/servers/f869f059-89c3-4462-a309-e27f650d7584 => generated 1482 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:59.943338 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c1dcda53-0d52-478a-b5ad-fc64ba997a21 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:59.949671 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c1dcda53-0d52-478a-b5ad-fc64ba997a21 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] [instance: 3d4188da-b0f7-4d97-952b-acebaa48f185] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:59.976663 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1dcda53-0d52-478a-b5ad-fc64ba997a21 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:59.979410 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1dcda53-0d52-478a-b5ad-fc64ba997a21 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:59.980065 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1dcda53-0d52-478a-b5ad-fc64ba997a21 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:59.980972 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1dcda53-0d52-478a-b5ad-fc64ba997a21 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:59.982999 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1dcda53-0d52-478a-b5ad-fc64ba997a21 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:59.984713 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1dcda53-0d52-478a-b5ad-fc64ba997a21 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:00.397169 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c1dcda53-0d52-478a-b5ad-fc64ba997a21 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:00.411880 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c1dcda53-0d52-478a-b5ad-fc64ba997a21 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers/3d4188da-b0f7-4d97-952b-acebaa48f185" status: 200 len: 1522 microversion: 2.1 time: 0.482619 Oct 17 13:41:00.414182 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 922/1886] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:59 2022] GET /compute/v2.1/servers/3d4188da-b0f7-4d97-952b-acebaa48f185 => generated 1522 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:00.426263 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-511706af-95ff-4cbd-a3ad-0855eb27320f req-4046b426-5ea1-4608-be2a-031a1f6a5cdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f4b3e9d-93c2-4556-84c6-b4fb26f4424d", "tag": "e1f146be-c32e-4789-8774-ab71f775e6eb"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:00.460809 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-511706af-95ff-4cbd-a3ad-0855eb27320f req-4046b426-5ea1-4608-be2a-031a1f6a5cdc service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:00.461976 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-511706af-95ff-4cbd-a3ad-0855eb27320f req-4046b426-5ea1-4608-be2a-031a1f6a5cdc service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:00.462715 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-511706af-95ff-4cbd-a3ad-0855eb27320f req-4046b426-5ea1-4608-be2a-031a1f6a5cdc service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:00.491523 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-511706af-95ff-4cbd-a3ad-0855eb27320f req-4046b426-5ea1-4608-be2a-031a1f6a5cdc service nova] Creating event network-changed:e1f146be-c32e-4789-8774-ab71f775e6eb for instance 0f4b3e9d-93c2-4556-84c6-b4fb26f4424d on n-h2-854247-14 Oct 17 13:41:00.504942 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-511706af-95ff-4cbd-a3ad-0855eb27320f req-4046b426-5ea1-4608-be2a-031a1f6a5cdc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087301 Oct 17 13:41:00.506430 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 923/1887] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:41:00.522358 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cdfcfbc6-db1c-447a-9f9c-7617ffeda2e2 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:00.523273 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cdfcfbc6-db1c-447a-9f9c-7617ffeda2e2 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 0f4b3e9d-93c2-4556-84c6-b4fb26f4424d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:00.537540 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cdfcfbc6-db1c-447a-9f9c-7617ffeda2e2 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:00.539033 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cdfcfbc6-db1c-447a-9f9c-7617ffeda2e2 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:00.542910 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cdfcfbc6-db1c-447a-9f9c-7617ffeda2e2 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:00.544140 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cdfcfbc6-db1c-447a-9f9c-7617ffeda2e2 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:00.544757 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cdfcfbc6-db1c-447a-9f9c-7617ffeda2e2 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:00.546869 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cdfcfbc6-db1c-447a-9f9c-7617ffeda2e2 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:00.993902 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cdfcfbc6-db1c-447a-9f9c-7617ffeda2e2 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:01.003919 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cdfcfbc6-db1c-447a-9f9c-7617ffeda2e2 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/0f4b3e9d-93c2-4556-84c6-b4fb26f4424d" status: 200 len: 1307 microversion: 2.1 time: 0.494177 Oct 17 13:41:01.005866 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 924/1888] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:00 2022] GET /compute/v2.1/servers/0f4b3e9d-93c2-4556-84c6-b4fb26f4424d => generated 1307 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:01.012081 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-84d742af-c1d5-47ec-a65e-602714d6e351 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:01.013022 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-84d742af-c1d5-47ec-a65e-602714d6e351 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:01.027154 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-84d742af-c1d5-47ec-a65e-602714d6e351 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:01.027820 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-84d742af-c1d5-47ec-a65e-602714d6e351 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:01.028540 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-84d742af-c1d5-47ec-a65e-602714d6e351 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:01.029274 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-84d742af-c1d5-47ec-a65e-602714d6e351 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:01.037152 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-84d742af-c1d5-47ec-a65e-602714d6e351 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:01.037456 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-84d742af-c1d5-47ec-a65e-602714d6e351 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:01.200171 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-84d742af-c1d5-47ec-a65e-602714d6e351 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:01.209675 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-84d742af-c1d5-47ec-a65e-602714d6e351 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:01.221654 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-84d742af-c1d5-47ec-a65e-602714d6e351 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:01.238267 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-84d742af-c1d5-47ec-a65e-602714d6e351 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1553 microversion: 2.91 time: 0.230903 Oct 17 13:41:01.238990 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 925/1889] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:41:01 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1553 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:41:01.254809 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ec9cf5eb-d914-409e-971e-33cf0b4951e6 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:01.255511 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ec9cf5eb-d914-409e-971e-33cf0b4951e6 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] [instance: 709d926d-fba5-49ea-84ac-95d8bb018c68] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:01.282544 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ec9cf5eb-d914-409e-971e-33cf0b4951e6 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:01.285819 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ec9cf5eb-d914-409e-971e-33cf0b4951e6 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:01.287996 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ec9cf5eb-d914-409e-971e-33cf0b4951e6 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:01.289146 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ec9cf5eb-d914-409e-971e-33cf0b4951e6 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:01.289669 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ec9cf5eb-d914-409e-971e-33cf0b4951e6 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:01.290087 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ec9cf5eb-d914-409e-971e-33cf0b4951e6 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:01.490503 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=18 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:41:01.914443 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-ec9cf5eb-d914-409e-971e-33cf0b4951e6 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lazy-loading 'services' on Instance uuid 709d926d-fba5-49ea-84ac-95d8bb018c68 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:41:01.960119 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ec9cf5eb-d914-409e-971e-33cf0b4951e6 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68" status: 200 len: 2345 microversion: 2.25 time: 0.716123 Oct 17 13:41:01.985179 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 926/1890] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:41:01 2022] GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68 => generated 2345 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:41:01.993761 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-043270c7-0d77-4ba2-8428-46763dc31e3a tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:01.994759 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-043270c7-0d77-4ba2-8428-46763dc31e3a tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9c6b4ed2-b111-41b0-9679-b66d386834b9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:02.002559 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-043270c7-0d77-4ba2-8428-46763dc31e3a tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:02.003102 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-043270c7-0d77-4ba2-8428-46763dc31e3a tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:02.003673 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-043270c7-0d77-4ba2-8428-46763dc31e3a tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:02.004411 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-043270c7-0d77-4ba2-8428-46763dc31e3a tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:02.004870 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-043270c7-0d77-4ba2-8428-46763dc31e3a tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:02.010834 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-043270c7-0d77-4ba2-8428-46763dc31e3a tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:02.343965 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-043270c7-0d77-4ba2-8428-46763dc31e3a tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:02.353130 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-043270c7-0d77-4ba2-8428-46763dc31e3a tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9" status: 200 len: 1514 microversion: 2.1 time: 0.366493 Oct 17 13:41:02.356826 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 927/1891] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:01 2022] GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9 => generated 1514 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:02.371000 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-404865fa-0abe-4cdc-a49b-ec977aeedf63 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:02.371977 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-404865fa-0abe-4cdc-a49b-ec977aeedf63 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: f869f059-89c3-4462-a309-e27f650d7584] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:02.393480 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-404865fa-0abe-4cdc-a49b-ec977aeedf63 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:02.393896 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-404865fa-0abe-4cdc-a49b-ec977aeedf63 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:02.394334 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-404865fa-0abe-4cdc-a49b-ec977aeedf63 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:02.395062 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-404865fa-0abe-4cdc-a49b-ec977aeedf63 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:02.395543 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-404865fa-0abe-4cdc-a49b-ec977aeedf63 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:02.395967 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-404865fa-0abe-4cdc-a49b-ec977aeedf63 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:02.423724 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-404865fa-0abe-4cdc-a49b-ec977aeedf63 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] HTTP exception thrown: Instance f869f059-89c3-4462-a309-e27f650d7584 could not be found. Oct 17 13:41:02.426305 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-404865fa-0abe-4cdc-a49b-ec977aeedf63 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Request method failure captured: Oct 17 13:41:02.426305 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/f869f059-89c3-4462-a309-e27f650d7584 HTTP/1.1 Oct 17 13:41:02.426305 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:41:02.426305 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:41:02.426305 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:41:02.426305 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:41:02.426305 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:41:02.426305 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:41:02.426305 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:41:02.426305 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:41:02.426305 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVnf7-Dca7FemnEfwN1PP70lPaklLhr73YscDZW-kH2dv9JufJhPrvu4B01Xz8mp5WeJNf6wVLfrcVKnHMZ0ejiaugm7o2xbOLsMKgoKWmbTZvm4LNm375rjAD4LdzC1RuTZUuDbYqOIeHyYqmXioD65BcGywVZd7DddcEolMO-Fowg Oct 17 13:41:02.426305 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:41:02.426305 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:41:02.426305 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:41:02.426305 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:41:02.426305 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:41:02.426305 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:41:02.426305 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: ccf0569de787477e964f570378d6459a Oct 17 13:41:02.426305 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-LiveMigrationTest-840909216 Oct 17 13:41:02.426305 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:41:02.426305 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:41:02.426305 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ccf0569de787477e964f570378d6459a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ccf0569de787477e964f570378d6459a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ccf0569de787477e964f570378d6459a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ccf0569de787477e964f570378d6459a", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:41:02.426305 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-LiveMigrationTest-840909216 Oct 17 13:41:02.426305 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: ccf0569de787477e964f570378d6459a Oct 17 13:41:02.426305 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-LiveMigrationTest-840909216 Oct 17 13:41:02.426305 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-LiveMigrationTest-840909216-project Oct 17 13:41:02.426305 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:41:02.426305 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:41:02.426305 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 62cc720667f44772988d7890c227b217 Oct 17 13:41:02.426305 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-LiveMigrationTest-840909216-project Oct 17 13:41:02.426305 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:41:02.426305 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance f869f059-89c3-4462-a309-e27f650d7584 could not be found. Oct 17 13:41:02.426305 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'f869f059-89c3-4462-a309-e27f650d7584'} Oct 17 13:41:02.426305 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:41:02.426305 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:02.426305 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:41:02.426305 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:41:02.426305 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:41:02.426305 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:41:02.426305 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:41:02.426305 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:41:02.426305 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:41:02.426305 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:41:02.426305 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f869f059-89c3-4462-a309-e27f650d7584 could not be found. Oct 17 13:41:02.426305 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:41:02.426305 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:02.426305 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:41:02.426305 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:02.426305 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:02.426305 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:02.426305 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:41:02.426305 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:41:02.426305 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:41:02.426305 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:41:02.426305 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:41:02.426305 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:41:02.426305 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:41:02.426305 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:41:02.426305 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:41:02.426305 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:41:02.426305 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f869f059-89c3-4462-a309-e27f650d7584 could not be found. Oct 17 13:41:02.426305 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:41:02.426305 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:02.426305 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:41:02.432236 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:02.432236 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:02.432236 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:02.432236 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:41:02.432236 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:41:02.432236 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f869f059-89c3-4462-a309-e27f650d7584 could not be found. Oct 17 13:41:02.432236 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:41:02.433146 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-404865fa-0abe-4cdc-a49b-ec977aeedf63 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Returning 404 to user: Instance f869f059-89c3-4462-a309-e27f650d7584 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:41:02.434059 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-404865fa-0abe-4cdc-a49b-ec977aeedf63 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/f869f059-89c3-4462-a309-e27f650d7584" status: 404 len: 111 microversion: 2.1 time: 0.075634 Oct 17 13:41:02.439900 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 928/1892] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:02 2022] GET /compute/v2.1/servers/f869f059-89c3-4462-a309-e27f650d7584 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:41:02.452416 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cd89951c-7fe5-44c6-b0b5-e092953ed895 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:02.453189 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cd89951c-7fe5-44c6-b0b5-e092953ed895 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] [instance: 3d4188da-b0f7-4d97-952b-acebaa48f185] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:02.482506 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cd89951c-7fe5-44c6-b0b5-e092953ed895 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:02.482798 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cd89951c-7fe5-44c6-b0b5-e092953ed895 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:02.483053 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cd89951c-7fe5-44c6-b0b5-e092953ed895 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:02.485820 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cd89951c-7fe5-44c6-b0b5-e092953ed895 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:02.486300 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cd89951c-7fe5-44c6-b0b5-e092953ed895 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:02.486736 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cd89951c-7fe5-44c6-b0b5-e092953ed895 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:02.814302 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cd89951c-7fe5-44c6-b0b5-e092953ed895 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:02.823892 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cd89951c-7fe5-44c6-b0b5-e092953ed895 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers/3d4188da-b0f7-4d97-952b-acebaa48f185" status: 200 len: 1522 microversion: 2.1 time: 0.382858 Oct 17 13:41:02.843146 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 929/1893] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:02 2022] GET /compute/v2.1/servers/3d4188da-b0f7-4d97-952b-acebaa48f185 => generated 1522 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:02.850983 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0187af8b-3358-4614-b431-7db66a1bc67f tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:02.866702 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0187af8b-3358-4614-b431-7db66a1bc67f tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:02.867561 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0187af8b-3358-4614-b431-7db66a1bc67f tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:02.868225 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0187af8b-3358-4614-b431-7db66a1bc67f tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:02.869258 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0187af8b-3358-4614-b431-7db66a1bc67f tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:02.869881 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0187af8b-3358-4614-b431-7db66a1bc67f tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:02.870475 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0187af8b-3358-4614-b431-7db66a1bc67f tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:02.944252 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0187af8b-3358-4614-b431-7db66a1bc67f tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.099431 Oct 17 13:41:02.946596 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 930/1894] 10.222.0.79 () {60 vars in 1217 bytes} [Mon Oct 17 13:41:02 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:41:02.952426 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f2053a41-f49f-4067-a1cf-ec32b76bfc8b tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:02.966680 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f2053a41-f49f-4067-a1cf-ec32b76bfc8b tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 0f4b3e9d-93c2-4556-84c6-b4fb26f4424d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:02.973521 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f2053a41-f49f-4067-a1cf-ec32b76bfc8b tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:02.974124 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f2053a41-f49f-4067-a1cf-ec32b76bfc8b tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:02.974521 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f2053a41-f49f-4067-a1cf-ec32b76bfc8b tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:02.975232 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f2053a41-f49f-4067-a1cf-ec32b76bfc8b tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:02.975689 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f2053a41-f49f-4067-a1cf-ec32b76bfc8b tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:02.976109 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f2053a41-f49f-4067-a1cf-ec32b76bfc8b tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:03.293549 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f2053a41-f49f-4067-a1cf-ec32b76bfc8b tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:03.321373 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f2053a41-f49f-4067-a1cf-ec32b76bfc8b tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/0f4b3e9d-93c2-4556-84c6-b4fb26f4424d" status: 200 len: 1307 microversion: 2.1 time: 0.372693 Oct 17 13:41:03.322551 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 931/1895] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:02 2022] GET /compute/v2.1/servers/0f4b3e9d-93c2-4556-84c6-b4fb26f4424d => generated 1307 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:03.328991 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-00f7ac9a-e92e-4782-b5eb-4fbe7dbb8723 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:03.331524 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-00f7ac9a-e92e-4782-b5eb-4fbe7dbb8723 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:03.343101 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-00f7ac9a-e92e-4782-b5eb-4fbe7dbb8723 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:03.351528 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-00f7ac9a-e92e-4782-b5eb-4fbe7dbb8723 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:03.353360 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-00f7ac9a-e92e-4782-b5eb-4fbe7dbb8723 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:03.355460 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-00f7ac9a-e92e-4782-b5eb-4fbe7dbb8723 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:03.358790 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-00f7ac9a-e92e-4782-b5eb-4fbe7dbb8723 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:03.361058 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-00f7ac9a-e92e-4782-b5eb-4fbe7dbb8723 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:03.585871 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-00f7ac9a-e92e-4782-b5eb-4fbe7dbb8723 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:03.634701 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-00f7ac9a-e92e-4782-b5eb-4fbe7dbb8723 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:03.643752 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-00f7ac9a-e92e-4782-b5eb-4fbe7dbb8723 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:03.658978 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-00f7ac9a-e92e-4782-b5eb-4fbe7dbb8723 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1553 microversion: 2.91 time: 0.335021 Oct 17 13:41:03.660018 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 932/1896] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:41:03 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1553 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:41:03.689514 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-431ef20b-3d42-4b9b-9803-9fb0c58b1450 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:03.690516 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-431ef20b-3d42-4b9b-9803-9fb0c58b1450 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: 85444f54-9792-4b13-90dc-d698bc57b60b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:03.710317 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-431ef20b-3d42-4b9b-9803-9fb0c58b1450 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:03.713526 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-431ef20b-3d42-4b9b-9803-9fb0c58b1450 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:03.714333 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-431ef20b-3d42-4b9b-9803-9fb0c58b1450 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:03.715539 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-431ef20b-3d42-4b9b-9803-9fb0c58b1450 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:03.718129 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-431ef20b-3d42-4b9b-9803-9fb0c58b1450 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:03.718802 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-431ef20b-3d42-4b9b-9803-9fb0c58b1450 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:03.798481 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-431ef20b-3d42-4b9b-9803-9fb0c58b1450 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: 85444f54-9792-4b13-90dc-d698bc57b60b] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:41:03.996335 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-431ef20b-3d42-4b9b-9803-9fb0c58b1450 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "DELETE /compute/v2.1/servers/85444f54-9792-4b13-90dc-d698bc57b60b" status: 204 len: 0 microversion: 2.1 time: 0.322670 Oct 17 13:41:04.000094 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 933/1897] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:41:03 2022] DELETE /compute/v2.1/servers/85444f54-9792-4b13-90dc-d698bc57b60b => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:41:04.006273 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-f2762ff6-034f-4876-bcde-476cf530dd76 req-7597bb00-5f33-4df0-bba8-90b0e263cf0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f869f059-89c3-4462-a309-e27f650d7584", "name": "network-vif-deleted", "tag": "b4a014a2-f1ca-4513-9531-01b335adbbcb"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:04.032267 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-f2762ff6-034f-4876-bcde-476cf530dd76 req-7597bb00-5f33-4df0-bba8-90b0e263cf0c service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:04.032759 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-f2762ff6-034f-4876-bcde-476cf530dd76 req-7597bb00-5f33-4df0-bba8-90b0e263cf0c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:04.040898 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-f2762ff6-034f-4876-bcde-476cf530dd76 req-7597bb00-5f33-4df0-bba8-90b0e263cf0c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:04.073498 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-f2762ff6-034f-4876-bcde-476cf530dd76 req-7597bb00-5f33-4df0-bba8-90b0e263cf0c service nova] Creating event network-vif-deleted:b4a014a2-f1ca-4513-9531-01b335adbbcb for instance f869f059-89c3-4462-a309-e27f650d7584 on n-h2-854247-14 Oct 17 13:41:04.087968 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-f2762ff6-034f-4876-bcde-476cf530dd76 req-7597bb00-5f33-4df0-bba8-90b0e263cf0c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088268 Oct 17 13:41:04.095355 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 934/1898] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:41:04.102409 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e7b78bbc-bc09-46ee-9c81-8e7e4ffc0362 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:04.105807 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e7b78bbc-bc09-46ee-9c81-8e7e4ffc0362 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9c6b4ed2-b111-41b0-9679-b66d386834b9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:04.121893 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7b78bbc-bc09-46ee-9c81-8e7e4ffc0362 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:04.125156 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7b78bbc-bc09-46ee-9c81-8e7e4ffc0362 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:04.125855 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7b78bbc-bc09-46ee-9c81-8e7e4ffc0362 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:04.126817 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7b78bbc-bc09-46ee-9c81-8e7e4ffc0362 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:04.127846 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7b78bbc-bc09-46ee-9c81-8e7e4ffc0362 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:04.129692 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7b78bbc-bc09-46ee-9c81-8e7e4ffc0362 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:04.448518 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e7b78bbc-bc09-46ee-9c81-8e7e4ffc0362 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:04.463474 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e7b78bbc-bc09-46ee-9c81-8e7e4ffc0362 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9" status: 200 len: 1514 microversion: 2.1 time: 0.366198 Oct 17 13:41:04.471230 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 935/1899] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:04 2022] GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9 => generated 1514 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:04.481841 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f0e73b3e-005b-4539-8f74-1afa2c02b814 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:04.485937 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f0e73b3e-005b-4539-8f74-1afa2c02b814 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] [instance: 3d4188da-b0f7-4d97-952b-acebaa48f185] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:04.492695 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f0e73b3e-005b-4539-8f74-1afa2c02b814 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:04.494427 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f0e73b3e-005b-4539-8f74-1afa2c02b814 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:04.495408 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f0e73b3e-005b-4539-8f74-1afa2c02b814 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:04.496446 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f0e73b3e-005b-4539-8f74-1afa2c02b814 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:04.497158 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f0e73b3e-005b-4539-8f74-1afa2c02b814 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:04.498293 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f0e73b3e-005b-4539-8f74-1afa2c02b814 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:04.588421 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=24 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:41:04.755278 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f0e73b3e-005b-4539-8f74-1afa2c02b814 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:04.764785 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f0e73b3e-005b-4539-8f74-1afa2c02b814 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers/3d4188da-b0f7-4d97-952b-acebaa48f185" status: 200 len: 1522 microversion: 2.1 time: 0.297696 Oct 17 13:41:04.765642 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 936/1900] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:04 2022] GET /compute/v2.1/servers/3d4188da-b0f7-4d97-952b-acebaa48f185 => generated 1522 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:04.784578 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d00f1e65-bb28-478b-bd69-2e1adc0aefa1 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:04.785202 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d00f1e65-bb28-478b-bd69-2e1adc0aefa1 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: 85444f54-9792-4b13-90dc-d698bc57b60b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:04.824838 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d00f1e65-bb28-478b-bd69-2e1adc0aefa1 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:04.829847 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d00f1e65-bb28-478b-bd69-2e1adc0aefa1 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:04.831975 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d00f1e65-bb28-478b-bd69-2e1adc0aefa1 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:04.836032 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d00f1e65-bb28-478b-bd69-2e1adc0aefa1 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:04.839889 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d00f1e65-bb28-478b-bd69-2e1adc0aefa1 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:04.842182 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d00f1e65-bb28-478b-bd69-2e1adc0aefa1 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:05.197261 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d00f1e65-bb28-478b-bd69-2e1adc0aefa1 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:05.206632 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d00f1e65-bb28-478b-bd69-2e1adc0aefa1 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/85444f54-9792-4b13-90dc-d698bc57b60b" status: 200 len: 1499 microversion: 2.1 time: 0.439537 Oct 17 13:41:05.207412 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 937/1901] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:04 2022] GET /compute/v2.1/servers/85444f54-9792-4b13-90dc-d698bc57b60b => generated 1499 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:05.212080 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-22af6f7b-fd93-4f38-b8f8-ba969ee4493f tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:05.212739 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-22af6f7b-fd93-4f38-b8f8-ba969ee4493f tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 0f4b3e9d-93c2-4556-84c6-b4fb26f4424d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:05.221217 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-22af6f7b-fd93-4f38-b8f8-ba969ee4493f tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:05.221700 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-22af6f7b-fd93-4f38-b8f8-ba969ee4493f tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:05.222194 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-22af6f7b-fd93-4f38-b8f8-ba969ee4493f tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:05.222952 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-22af6f7b-fd93-4f38-b8f8-ba969ee4493f tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:05.223547 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-22af6f7b-fd93-4f38-b8f8-ba969ee4493f tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:05.223974 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-22af6f7b-fd93-4f38-b8f8-ba969ee4493f tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:05.569034 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=47 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:41:06.000419 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=20 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:41:06.003386 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=97 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:41:06.140507 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-22af6f7b-fd93-4f38-b8f8-ba969ee4493f tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:06.152503 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-22af6f7b-fd93-4f38-b8f8-ba969ee4493f tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/0f4b3e9d-93c2-4556-84c6-b4fb26f4424d" status: 200 len: 1307 microversion: 2.1 time: 0.944090 Oct 17 13:41:06.154409 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 938/1902] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:05 2022] GET /compute/v2.1/servers/0f4b3e9d-93c2-4556-84c6-b4fb26f4424d => generated 1307 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:06.160719 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7d9eb5ee-13b6-46f2-979a-0beeeaf3583a tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:06.161321 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7d9eb5ee-13b6-46f2-979a-0beeeaf3583a tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:06.168582 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7d9eb5ee-13b6-46f2-979a-0beeeaf3583a tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:06.169728 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7d9eb5ee-13b6-46f2-979a-0beeeaf3583a tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:06.170076 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7d9eb5ee-13b6-46f2-979a-0beeeaf3583a tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:06.170807 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7d9eb5ee-13b6-46f2-979a-0beeeaf3583a tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:06.171304 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7d9eb5ee-13b6-46f2-979a-0beeeaf3583a tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:06.171724 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7d9eb5ee-13b6-46f2-979a-0beeeaf3583a tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:06.175333 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:41:06.396730 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7d9eb5ee-13b6-46f2-979a-0beeeaf3583a tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:06.412652 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7d9eb5ee-13b6-46f2-979a-0beeeaf3583a tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:06.414120 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7d9eb5ee-13b6-46f2-979a-0beeeaf3583a tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:06.432989 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7d9eb5ee-13b6-46f2-979a-0beeeaf3583a tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1553 microversion: 2.91 time: 0.277453 Oct 17 13:41:06.433799 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 939/1903] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:41:06 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1553 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:41:06.457589 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5eb3f940-ec53-41a0-a3bd-931542ea4fee tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:06.459360 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5eb3f940-ec53-41a0-a3bd-931542ea4fee tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9c6b4ed2-b111-41b0-9679-b66d386834b9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:06.493498 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:41:06.495438 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5eb3f940-ec53-41a0-a3bd-931542ea4fee tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:06.495950 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5eb3f940-ec53-41a0-a3bd-931542ea4fee tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:06.496388 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5eb3f940-ec53-41a0-a3bd-931542ea4fee tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:06.497107 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5eb3f940-ec53-41a0-a3bd-931542ea4fee tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:06.497556 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5eb3f940-ec53-41a0-a3bd-931542ea4fee tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:06.497979 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5eb3f940-ec53-41a0-a3bd-931542ea4fee tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:06.726360 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5eb3f940-ec53-41a0-a3bd-931542ea4fee tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:06.745594 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5eb3f940-ec53-41a0-a3bd-931542ea4fee tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9" status: 200 len: 1520 microversion: 2.1 time: 0.292843 Oct 17 13:41:06.745938 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 940/1904] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:06 2022] GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9 => generated 1520 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:06.751735 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cfe1215e-9f28-48b2-bd46-4b6fc958e965 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:06.752347 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cfe1215e-9f28-48b2-bd46-4b6fc958e965 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] [instance: 3d4188da-b0f7-4d97-952b-acebaa48f185] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:06.759710 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cfe1215e-9f28-48b2-bd46-4b6fc958e965 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:06.760584 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cfe1215e-9f28-48b2-bd46-4b6fc958e965 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:06.760943 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cfe1215e-9f28-48b2-bd46-4b6fc958e965 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:06.761821 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cfe1215e-9f28-48b2-bd46-4b6fc958e965 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:06.762630 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cfe1215e-9f28-48b2-bd46-4b6fc958e965 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:06.763117 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cfe1215e-9f28-48b2-bd46-4b6fc958e965 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:07.030101 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cfe1215e-9f28-48b2-bd46-4b6fc958e965 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:07.044432 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cfe1215e-9f28-48b2-bd46-4b6fc958e965 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers/3d4188da-b0f7-4d97-952b-acebaa48f185" status: 200 len: 1522 microversion: 2.1 time: 0.297022 Oct 17 13:41:07.045353 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 941/1905] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:06 2022] GET /compute/v2.1/servers/3d4188da-b0f7-4d97-952b-acebaa48f185 => generated 1522 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:07.050137 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-de6bf116-fd8b-4052-ba5a-c3fad6df5eb1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "309eff69-6899-4ab1-96da-b108f5e4f3a6", "device": "/dev/xvdb"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:07.053143 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-de6bf116-fd8b-4052-ba5a-c3fad6df5eb1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 709d926d-fba5-49ea-84ac-95d8bb018c68] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:07.078069 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-de6bf116-fd8b-4052-ba5a-c3fad6df5eb1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:07.078578 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-de6bf116-fd8b-4052-ba5a-c3fad6df5eb1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:07.078996 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-de6bf116-fd8b-4052-ba5a-c3fad6df5eb1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:07.081975 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-de6bf116-fd8b-4052-ba5a-c3fad6df5eb1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:07.081975 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-de6bf116-fd8b-4052-ba5a-c3fad6df5eb1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:07.081975 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-de6bf116-fd8b-4052-ba5a-c3fad6df5eb1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:07.670049 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-de6bf116-fd8b-4052-ba5a-c3fad6df5eb1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "POST /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.623304 Oct 17 13:41:07.674725 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 942/1906] 10.222.0.79 () {62 vars in 1364 bytes} [Mon Oct 17 13:41:07 2022] POST /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68/os-volume_attachments => generated 194 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:41:07.684773 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-734772dd-7b81-40d0-bdd9-34e162ff7bae tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:07.691046 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-734772dd-7b81-40d0-bdd9-34e162ff7bae tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: 85444f54-9792-4b13-90dc-d698bc57b60b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:07.702147 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-734772dd-7b81-40d0-bdd9-34e162ff7bae tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:07.704892 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-734772dd-7b81-40d0-bdd9-34e162ff7bae tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:07.712355 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-734772dd-7b81-40d0-bdd9-34e162ff7bae tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:07.713450 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-734772dd-7b81-40d0-bdd9-34e162ff7bae tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:07.714088 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-734772dd-7b81-40d0-bdd9-34e162ff7bae tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:07.714627 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-734772dd-7b81-40d0-bdd9-34e162ff7bae tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:08.045862 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-734772dd-7b81-40d0-bdd9-34e162ff7bae tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc720667f44772988d7890c227b217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf0569de787477e964f570378d6459a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:08.057252 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-734772dd-7b81-40d0-bdd9-34e162ff7bae tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/85444f54-9792-4b13-90dc-d698bc57b60b" status: 200 len: 1499 microversion: 2.1 time: 0.380704 Oct 17 13:41:08.071457 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 943/1907] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:07 2022] GET /compute/v2.1/servers/85444f54-9792-4b13-90dc-d698bc57b60b => generated 1499 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:08.570477 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-dc6331dc-e2c8-4a2d-9cc0-6301da9b5c16 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Action: 'create', calling method: .version_select at 0x7f7cd4f555e0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-20813559", "description": "tempest-description-967864832"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:09.285292 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-dc6331dc-e2c8-4a2d-9cc0-6301da9b5c16 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 1.221967 Oct 17 13:41:09.294453 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 944/1908] 10.222.0.79 () {60 vars in 1180 bytes} [Mon Oct 17 13:41:08 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:41:09.302314 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4de7fb2f-2dc7-49a2-81a4-f2727d8aeda9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:09.303066 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4de7fb2f-2dc7-49a2-81a4-f2727d8aeda9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 0f4b3e9d-93c2-4556-84c6-b4fb26f4424d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:09.358829 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4de7fb2f-2dc7-49a2-81a4-f2727d8aeda9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:09.359749 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4de7fb2f-2dc7-49a2-81a4-f2727d8aeda9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:09.361812 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4de7fb2f-2dc7-49a2-81a4-f2727d8aeda9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:09.362790 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4de7fb2f-2dc7-49a2-81a4-f2727d8aeda9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:09.369616 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4de7fb2f-2dc7-49a2-81a4-f2727d8aeda9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:09.370355 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4de7fb2f-2dc7-49a2-81a4-f2727d8aeda9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:09.699380 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4de7fb2f-2dc7-49a2-81a4-f2727d8aeda9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:09.711788 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4de7fb2f-2dc7-49a2-81a4-f2727d8aeda9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/0f4b3e9d-93c2-4556-84c6-b4fb26f4424d" status: 200 len: 1307 microversion: 2.1 time: 0.421543 Oct 17 13:41:09.713051 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 945/1909] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:09 2022] GET /compute/v2.1/servers/0f4b3e9d-93c2-4556-84c6-b4fb26f4424d => generated 1307 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:09.723409 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-af7f771d-1f37-4d2a-9d3c-e282ccb8a07f tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:09.732103 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-af7f771d-1f37-4d2a-9d3c-e282ccb8a07f tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:09.760068 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af7f771d-1f37-4d2a-9d3c-e282ccb8a07f tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:09.760774 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af7f771d-1f37-4d2a-9d3c-e282ccb8a07f tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:09.761223 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af7f771d-1f37-4d2a-9d3c-e282ccb8a07f tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:09.761961 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af7f771d-1f37-4d2a-9d3c-e282ccb8a07f tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:09.762422 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af7f771d-1f37-4d2a-9d3c-e282ccb8a07f tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:09.762853 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af7f771d-1f37-4d2a-9d3c-e282ccb8a07f tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:09.926379 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-af7f771d-1f37-4d2a-9d3c-e282ccb8a07f tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:09.935707 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-af7f771d-1f37-4d2a-9d3c-e282ccb8a07f tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:09.942532 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-af7f771d-1f37-4d2a-9d3c-e282ccb8a07f tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:09.957412 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-af7f771d-1f37-4d2a-9d3c-e282ccb8a07f tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1553 microversion: 2.91 time: 0.240963 Oct 17 13:41:09.958007 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 946/1910] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:41:09 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1553 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:41:09.985759 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4cad2aca-ac7d-43f2-95f1-0a36bcd40f7d tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:09.986468 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4cad2aca-ac7d-43f2-95f1-0a36bcd40f7d tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9c6b4ed2-b111-41b0-9679-b66d386834b9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:09.993634 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4cad2aca-ac7d-43f2-95f1-0a36bcd40f7d tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:09.994198 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4cad2aca-ac7d-43f2-95f1-0a36bcd40f7d tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:09.994667 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4cad2aca-ac7d-43f2-95f1-0a36bcd40f7d tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:09.995431 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4cad2aca-ac7d-43f2-95f1-0a36bcd40f7d tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:09.995972 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4cad2aca-ac7d-43f2-95f1-0a36bcd40f7d tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:09.996841 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4cad2aca-ac7d-43f2-95f1-0a36bcd40f7d tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:10.259740 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4cad2aca-ac7d-43f2-95f1-0a36bcd40f7d tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:10.275077 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4cad2aca-ac7d-43f2-95f1-0a36bcd40f7d tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9" status: 200 len: 1520 microversion: 2.1 time: 0.302299 Oct 17 13:41:10.275843 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 947/1911] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:09 2022] GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9 => generated 1520 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:10.299525 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-86c2bdde-b874-4e90-a8e2-d84ffad38c5a tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:10.300271 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-86c2bdde-b874-4e90-a8e2-d84ffad38c5a tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] [instance: 3d4188da-b0f7-4d97-952b-acebaa48f185] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:10.321139 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-86c2bdde-b874-4e90-a8e2-d84ffad38c5a tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:10.322723 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-86c2bdde-b874-4e90-a8e2-d84ffad38c5a tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:10.323225 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-86c2bdde-b874-4e90-a8e2-d84ffad38c5a tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:10.332008 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-86c2bdde-b874-4e90-a8e2-d84ffad38c5a tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:10.332704 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-86c2bdde-b874-4e90-a8e2-d84ffad38c5a tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:10.333160 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-86c2bdde-b874-4e90-a8e2-d84ffad38c5a tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:10.675482 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-86c2bdde-b874-4e90-a8e2-d84ffad38c5a tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:10.685017 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-86c2bdde-b874-4e90-a8e2-d84ffad38c5a tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers/3d4188da-b0f7-4d97-952b-acebaa48f185" status: 200 len: 1522 microversion: 2.1 time: 0.408101 Oct 17 13:41:10.685608 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 948/1912] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:10 2022] GET /compute/v2.1/servers/3d4188da-b0f7-4d97-952b-acebaa48f185 => generated 1522 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:10.714027 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-da559674-d5d0-4478-8bf9-6a97e9529200 req-712d79bc-30df-4112-a8a0-aa541ebd52ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85444f54-9792-4b13-90dc-d698bc57b60b", "name": "network-vif-deleted", "tag": "48dfe136-d328-4b93-bfb8-302d0ec30369"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:10.745456 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-da559674-d5d0-4478-8bf9-6a97e9529200 req-712d79bc-30df-4112-a8a0-aa541ebd52ee service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:10.745940 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-da559674-d5d0-4478-8bf9-6a97e9529200 req-712d79bc-30df-4112-a8a0-aa541ebd52ee service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:10.746369 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-da559674-d5d0-4478-8bf9-6a97e9529200 req-712d79bc-30df-4112-a8a0-aa541ebd52ee service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:10.763287 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-da559674-d5d0-4478-8bf9-6a97e9529200 req-712d79bc-30df-4112-a8a0-aa541ebd52ee service nova] Creating event network-vif-deleted:48dfe136-d328-4b93-bfb8-302d0ec30369 for instance 85444f54-9792-4b13-90dc-d698bc57b60b on n-h2-854247-14 Oct 17 13:41:10.781276 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-da559674-d5d0-4478-8bf9-6a97e9529200 req-712d79bc-30df-4112-a8a0-aa541ebd52ee service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094397 Oct 17 13:41:10.785897 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 949/1913] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:41:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:41:10.797356 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8fffbeb3-efd3-4d8f-bf8d-fdd0e43d8775 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:10.798072 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8fffbeb3-efd3-4d8f-bf8d-fdd0e43d8775 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] [instance: 85444f54-9792-4b13-90dc-d698bc57b60b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:10.808438 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8fffbeb3-efd3-4d8f-bf8d-fdd0e43d8775 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:10.808925 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8fffbeb3-efd3-4d8f-bf8d-fdd0e43d8775 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:10.809359 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8fffbeb3-efd3-4d8f-bf8d-fdd0e43d8775 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:10.810074 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8fffbeb3-efd3-4d8f-bf8d-fdd0e43d8775 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:10.810533 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8fffbeb3-efd3-4d8f-bf8d-fdd0e43d8775 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:10.810951 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8fffbeb3-efd3-4d8f-bf8d-fdd0e43d8775 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:10.858010 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-8fffbeb3-efd3-4d8f-bf8d-fdd0e43d8775 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] HTTP exception thrown: Instance 85444f54-9792-4b13-90dc-d698bc57b60b could not be found. Oct 17 13:41:10.870892 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8fffbeb3-efd3-4d8f-bf8d-fdd0e43d8775 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Request method failure captured: Oct 17 13:41:10.870892 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/85444f54-9792-4b13-90dc-d698bc57b60b HTTP/1.1 Oct 17 13:41:10.870892 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:41:10.870892 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:41:10.870892 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:41:10.870892 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:41:10.870892 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:41:10.870892 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:41:10.870892 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:41:10.870892 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:41:10.870892 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVnf7-Dca7FemnEfwN1PP70lPaklLhr73YscDZW-kH2dv9JufJhPrvu4B01Xz8mp5WeJNf6wVLfrcVKnHMZ0ejiaugm7o2xbOLsMKgoKWmbTZvm4LNm375rjAD4LdzC1RuTZUuDbYqOIeHyYqmXioD65BcGywVZd7DddcEolMO-Fowg Oct 17 13:41:10.870892 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:41:10.870892 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:41:10.870892 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:41:10.870892 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:41:10.870892 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:41:10.870892 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:41:10.870892 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: ccf0569de787477e964f570378d6459a Oct 17 13:41:10.870892 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-LiveMigrationTest-840909216 Oct 17 13:41:10.870892 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:41:10.870892 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:41:10.870892 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ccf0569de787477e964f570378d6459a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ccf0569de787477e964f570378d6459a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ccf0569de787477e964f570378d6459a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ccf0569de787477e964f570378d6459a", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:41:10.870892 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-LiveMigrationTest-840909216 Oct 17 13:41:10.870892 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: ccf0569de787477e964f570378d6459a Oct 17 13:41:10.870892 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-LiveMigrationTest-840909216 Oct 17 13:41:10.870892 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-LiveMigrationTest-840909216-project Oct 17 13:41:10.870892 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:41:10.870892 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:41:10.870892 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 62cc720667f44772988d7890c227b217 Oct 17 13:41:10.870892 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-LiveMigrationTest-840909216-project Oct 17 13:41:10.870892 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:41:10.870892 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 85444f54-9792-4b13-90dc-d698bc57b60b could not be found. Oct 17 13:41:10.870892 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '85444f54-9792-4b13-90dc-d698bc57b60b'} Oct 17 13:41:10.870892 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:41:10.870892 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:10.870892 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:41:10.870892 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:41:10.870892 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:41:10.870892 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:41:10.870892 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:41:10.870892 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:41:10.870892 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:41:10.870892 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:41:10.870892 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85444f54-9792-4b13-90dc-d698bc57b60b could not be found. Oct 17 13:41:10.870892 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:41:10.870892 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:10.870892 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:41:10.870892 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:10.870892 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:10.870892 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:10.870892 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:41:10.870892 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:41:10.870892 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:41:10.870892 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:41:10.870892 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:41:10.870892 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:41:10.870892 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:41:10.870892 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:41:10.870892 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:41:10.870892 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:41:10.870892 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85444f54-9792-4b13-90dc-d698bc57b60b could not be found. Oct 17 13:41:10.870892 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:41:10.870892 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:10.870892 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:41:10.876975 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:10.876975 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:10.876975 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:10.876975 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:41:10.876975 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:41:10.876975 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85444f54-9792-4b13-90dc-d698bc57b60b could not be found. Oct 17 13:41:10.876975 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:41:10.876975 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8fffbeb3-efd3-4d8f-bf8d-fdd0e43d8775 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] Returning 404 to user: Instance 85444f54-9792-4b13-90dc-d698bc57b60b could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:41:10.876975 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8fffbeb3-efd3-4d8f-bf8d-fdd0e43d8775 tempest-LiveMigrationTest-840909216 tempest-LiveMigrationTest-840909216-project] 10.222.0.79 "GET /compute/v2.1/servers/85444f54-9792-4b13-90dc-d698bc57b60b" status: 404 len: 111 microversion: 2.1 time: 0.085707 Oct 17 13:41:10.876975 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 950/1914] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:10 2022] GET /compute/v2.1/servers/85444f54-9792-4b13-90dc-d698bc57b60b => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:41:10.898251 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-efa6f5fa-47f3-46a6-97e6-f5bae344425d tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Action: 'create', calling method: .version_select at 0x7f7cd4cb33a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2089555488", "description": "tempest-description-1937433940"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:12.086339 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-efa6f5fa-47f3-46a6-97e6-f5bae344425d tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.208572 Oct 17 13:41:12.095091 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 951/1915] 10.222.0.79 () {60 vars in 1180 bytes} [Mon Oct 17 13:41:10 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:41:12.113530 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ca0ba782-8dd9-4e28-8cd9-f8ae50e79028 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:12.115865 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ca0ba782-8dd9-4e28-8cd9-f8ae50e79028 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 0f4b3e9d-93c2-4556-84c6-b4fb26f4424d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:12.132996 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ca0ba782-8dd9-4e28-8cd9-f8ae50e79028 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:12.133498 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ca0ba782-8dd9-4e28-8cd9-f8ae50e79028 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:12.133920 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ca0ba782-8dd9-4e28-8cd9-f8ae50e79028 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:12.134932 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ca0ba782-8dd9-4e28-8cd9-f8ae50e79028 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:12.136243 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ca0ba782-8dd9-4e28-8cd9-f8ae50e79028 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:12.137068 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ca0ba782-8dd9-4e28-8cd9-f8ae50e79028 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:12.315095 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4dd5dd7a-4650-4d87-89b3-04262c8693de tempest-ImagesMetadataTestJSON-1828188922 tempest-ImagesMetadataTestJSON-1828188922-project] 10.222.0.79 "PUT /compute/v2.1/images/af0d807c-3629-472f-8ab5-0b3cedad7bc8/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 16.730187 Oct 17 13:41:12.316375 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 965/1916] 10.222.0.79 () {60 vars in 1313 bytes} [Mon Oct 17 13:40:55 2022] PUT /compute/v2.1/images/af0d807c-3629-472f-8ab5-0b3cedad7bc8/metadata/os_version => generated 31 bytes in 16732 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:41:12.321601 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-608b42e0-99f4-412c-a03e-cdb477425c42 req-164e256b-e3a4-4efc-9890-9152c1f56039 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c6b4ed2-b111-41b0-9679-b66d386834b9", "name": "network-vif-plugged", "status": "completed", "tag": "3a217dc6-53c2-4e51-abb4-9f6293319532"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:12.356202 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-608b42e0-99f4-412c-a03e-cdb477425c42 req-164e256b-e3a4-4efc-9890-9152c1f56039 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:12.356853 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-608b42e0-99f4-412c-a03e-cdb477425c42 req-164e256b-e3a4-4efc-9890-9152c1f56039 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:12.357391 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-608b42e0-99f4-412c-a03e-cdb477425c42 req-164e256b-e3a4-4efc-9890-9152c1f56039 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:12.394120 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-608b42e0-99f4-412c-a03e-cdb477425c42 req-164e256b-e3a4-4efc-9890-9152c1f56039 service nova] Creating event network-vif-plugged:3a217dc6-53c2-4e51-abb4-9f6293319532 for instance 9c6b4ed2-b111-41b0-9679-b66d386834b9 on n-h2-854247-14 Oct 17 13:41:12.399796 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-608b42e0-99f4-412c-a03e-cdb477425c42 req-164e256b-e3a4-4efc-9890-9152c1f56039 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081939 Oct 17 13:41:12.400774 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 966/1917] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:41:12.407299 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-cd5f4fc2-d95e-4228-9869-ead635159299 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:12.408930 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-cd5f4fc2-d95e-4228-9869-ead635159299 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:12.416011 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cd5f4fc2-d95e-4228-9869-ead635159299 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:12.416787 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cd5f4fc2-d95e-4228-9869-ead635159299 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:12.417515 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cd5f4fc2-d95e-4228-9869-ead635159299 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:12.419099 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cd5f4fc2-d95e-4228-9869-ead635159299 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:12.419771 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cd5f4fc2-d95e-4228-9869-ead635159299 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:12.420385 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cd5f4fc2-d95e-4228-9869-ead635159299 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:12.554721 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ca0ba782-8dd9-4e28-8cd9-f8ae50e79028 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:12.568987 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-cd5f4fc2-d95e-4228-9869-ead635159299 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:12.578409 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ca0ba782-8dd9-4e28-8cd9-f8ae50e79028 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/0f4b3e9d-93c2-4556-84c6-b4fb26f4424d" status: 200 len: 1307 microversion: 2.1 time: 0.479634 Oct 17 13:41:12.591205 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 952/1918] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:12 2022] GET /compute/v2.1/servers/0f4b3e9d-93c2-4556-84c6-b4fb26f4424d => generated 1307 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:12.594261 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-cd5f4fc2-d95e-4228-9869-ead635159299 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:12.599357 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e2a3cd00-de42-4f27-bd5b-597a18b2ac7d tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:12.599971 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e2a3cd00-de42-4f27-bd5b-597a18b2ac7d tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9c6b4ed2-b111-41b0-9679-b66d386834b9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:12.603123 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-cd5f4fc2-d95e-4228-9869-ead635159299 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:12.609392 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-cd5f4fc2-d95e-4228-9869-ead635159299 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1553 microversion: 2.91 time: 0.207148 Oct 17 13:41:12.612641 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 967/1919] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:41:12 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1553 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:41:12.620652 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e2a3cd00-de42-4f27-bd5b-597a18b2ac7d tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:12.621703 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e2a3cd00-de42-4f27-bd5b-597a18b2ac7d tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:12.624236 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e2a3cd00-de42-4f27-bd5b-597a18b2ac7d tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:12.626027 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-14fd9c94-e4ed-478a-9dc2-38395217ebf7 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:12.626398 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e2a3cd00-de42-4f27-bd5b-597a18b2ac7d tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:12.627212 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-14fd9c94-e4ed-478a-9dc2-38395217ebf7 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] [instance: 3d4188da-b0f7-4d97-952b-acebaa48f185] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:12.627841 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e2a3cd00-de42-4f27-bd5b-597a18b2ac7d tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:12.631291 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e2a3cd00-de42-4f27-bd5b-597a18b2ac7d tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:12.645258 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-14fd9c94-e4ed-478a-9dc2-38395217ebf7 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:12.647894 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-14fd9c94-e4ed-478a-9dc2-38395217ebf7 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:12.653642 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-14fd9c94-e4ed-478a-9dc2-38395217ebf7 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:12.655649 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-14fd9c94-e4ed-478a-9dc2-38395217ebf7 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:12.656479 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-14fd9c94-e4ed-478a-9dc2-38395217ebf7 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:12.656914 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-14fd9c94-e4ed-478a-9dc2-38395217ebf7 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:12.886132 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:41:13.376375 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-14fd9c94-e4ed-478a-9dc2-38395217ebf7 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:13.399617 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e2a3cd00-de42-4f27-bd5b-597a18b2ac7d tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:13.414406 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e2a3cd00-de42-4f27-bd5b-597a18b2ac7d tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9" status: 200 len: 1520 microversion: 2.1 time: 0.819277 Oct 17 13:41:13.418713 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-14fd9c94-e4ed-478a-9dc2-38395217ebf7 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers/3d4188da-b0f7-4d97-952b-acebaa48f185" status: 200 len: 1522 microversion: 2.1 time: 0.775733 Oct 17 13:41:13.419241 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 953/1920] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:12 2022] GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9 => generated 1520 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:13.419474 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 968/1921] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:12 2022] GET /compute/v2.1/servers/3d4188da-b0f7-4d97-952b-acebaa48f185 => generated 1522 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:13.440524 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-75448cac-910b-447e-ae21-7d8c4371df47 tempest-ImagesMetadataTestJSON-1828188922 tempest-ImagesMetadataTestJSON-1828188922-project] Calling method '.version_select at 0x7f7cd4f550d0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:13.440695 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1f67e2d2-1717-47f6-b5f3-24d6d9d8ad09 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1374349561", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "ecd2d387-07d8-47d6-a0ee-13b7d19ceb82"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:13.513130 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-75448cac-910b-447e-ae21-7d8c4371df47 tempest-ImagesMetadataTestJSON-1828188922 tempest-ImagesMetadataTestJSON-1828188922-project] 10.222.0.79 "GET /compute/v2.1/images/af0d807c-3629-472f-8ab5-0b3cedad7bc8/metadata" status: 200 len: 58 microversion: 2.1 time: 0.091970 Oct 17 13:41:13.513727 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 954/1922] 10.222.0.79 () {58 vars in 1260 bytes} [Mon Oct 17 13:41:13 2022] GET /compute/v2.1/images/af0d807c-3629-472f-8ab5-0b3cedad7bc8/metadata => generated 58 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:41:13.535051 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5ec62af0-321c-4b5b-afe8-0f033ea4a64a tempest-ImagesMetadataTestJSON-1828188922 tempest-ImagesMetadataTestJSON-1828188922-project] Action: 'update_all', calling method: .version_select at 0x7f7cd4e6e3a0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:13.566108 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-1f67e2d2-1717-47f6-b5f3-24d6d9d8ad09 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] validate_networks() for [('ecd2d387-07d8-47d6-a0ee-13b7d19ceb82', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:41:13.669472 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-5ec62af0-321c-4b5b-afe8-0f033ea4a64a tempest-ImagesMetadataTestJSON-1828188922 tempest-ImagesMetadataTestJSON-1828188922-project] Getting quotas for project 51e91cb55f41495f976de19b833706b4. Resources: dict_keys(['metadata_items']) {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:41:13.678485 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-5ec62af0-321c-4b5b-afe8-0f033ea4a64a tempest-ImagesMetadataTestJSON-1828188922 tempest-ImagesMetadataTestJSON-1828188922-project] Getting quotas for user 2bad6c96292e49d5823b08162071f840 and project 51e91cb55f41495f976de19b833706b4. Resources: dict_keys(['metadata_items']) {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:41:14.027104 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5ec62af0-321c-4b5b-afe8-0f033ea4a64a tempest-ImagesMetadataTestJSON-1828188922 tempest-ImagesMetadataTestJSON-1828188922-project] 10.222.0.79 "PUT /compute/v2.1/images/af0d807c-3629-472f-8ab5-0b3cedad7bc8/metadata" status: 200 len: 61 microversion: 2.1 time: 0.504094 Oct 17 13:41:14.028132 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 955/1923] 10.222.0.79 () {60 vars in 1280 bytes} [Mon Oct 17 13:41:13 2022] PUT /compute/v2.1/images/af0d807c-3629-472f-8ab5-0b3cedad7bc8/metadata => generated 61 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:41:14.033109 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5bccaef0-0b53-4102-b1b1-ab6b0b76358e tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:14.034065 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5bccaef0-0b53-4102-b1b1-ab6b0b76358e tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 0f4b3e9d-93c2-4556-84c6-b4fb26f4424d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:14.041754 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5bccaef0-0b53-4102-b1b1-ab6b0b76358e tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:14.042626 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5bccaef0-0b53-4102-b1b1-ab6b0b76358e tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:14.043443 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5bccaef0-0b53-4102-b1b1-ab6b0b76358e tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:14.044450 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5bccaef0-0b53-4102-b1b1-ab6b0b76358e tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:14.045135 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5bccaef0-0b53-4102-b1b1-ab6b0b76358e tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:14.045784 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5bccaef0-0b53-4102-b1b1-ab6b0b76358e tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:14.405533 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5bccaef0-0b53-4102-b1b1-ab6b0b76358e tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:14.435798 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5bccaef0-0b53-4102-b1b1-ab6b0b76358e tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/0f4b3e9d-93c2-4556-84c6-b4fb26f4424d" status: 200 len: 1307 microversion: 2.1 time: 0.404046 Oct 17 13:41:14.454341 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 956/1924] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:14 2022] GET /compute/v2.1/servers/0f4b3e9d-93c2-4556-84c6-b4fb26f4424d => generated 1307 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:14.460787 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-769a1439-2649-4faf-b431-c3bbcee26b85 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:14.461630 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-769a1439-2649-4faf-b431-c3bbcee26b85 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:14.503774 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-769a1439-2649-4faf-b431-c3bbcee26b85 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:14.512159 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-769a1439-2649-4faf-b431-c3bbcee26b85 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:14.514691 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-769a1439-2649-4faf-b431-c3bbcee26b85 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:14.515971 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-769a1439-2649-4faf-b431-c3bbcee26b85 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:14.519761 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-769a1439-2649-4faf-b431-c3bbcee26b85 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:14.520458 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-769a1439-2649-4faf-b431-c3bbcee26b85 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:14.639255 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-769a1439-2649-4faf-b431-c3bbcee26b85 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:14.648296 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-769a1439-2649-4faf-b431-c3bbcee26b85 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:14.649749 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-769a1439-2649-4faf-b431-c3bbcee26b85 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:14.667698 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-769a1439-2649-4faf-b431-c3bbcee26b85 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1535 microversion: 2.91 time: 0.211951 Oct 17 13:41:14.668305 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 957/1925] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:41:14 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1535 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:41:14.673000 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b7ec7703-cc3b-47e0-b8ed-992683520364 tempest-ImagesMetadataTestJSON-1828188922 tempest-ImagesMetadataTestJSON-1828188922-project] Action: 'create', calling method: .version_select at 0x7f7cd4f87c10>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:14.776829 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-b7ec7703-cc3b-47e0-b8ed-992683520364 tempest-ImagesMetadataTestJSON-1828188922 tempest-ImagesMetadataTestJSON-1828188922-project] Getting quotas for project 51e91cb55f41495f976de19b833706b4. Resources: dict_keys(['metadata_items']) {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:41:14.790530 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-b7ec7703-cc3b-47e0-b8ed-992683520364 tempest-ImagesMetadataTestJSON-1828188922 tempest-ImagesMetadataTestJSON-1828188922-project] Getting quotas for user 2bad6c96292e49d5823b08162071f840 and project 51e91cb55f41495f976de19b833706b4. Resources: dict_keys(['metadata_items']) {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:41:14.848282 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-1f67e2d2-1717-47f6-b5f3-24d6d9d8ad09 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:41:14.849353 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-1f67e2d2-1717-47f6-b5f3-24d6d9d8ad09 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:41:14.850059 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-1f67e2d2-1717-47f6-b5f3-24d6d9d8ad09 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:41:14.850939 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-1f67e2d2-1717-47f6-b5f3-24d6d9d8ad09 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:41:14.851610 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-1f67e2d2-1717-47f6-b5f3-24d6d9d8ad09 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:41:14.866722 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1f67e2d2-1717-47f6-b5f3-24d6d9d8ad09 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:14.867243 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1f67e2d2-1717-47f6-b5f3-24d6d9d8ad09 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:14.867683 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1f67e2d2-1717-47f6-b5f3-24d6d9d8ad09 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:14.868400 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1f67e2d2-1717-47f6-b5f3-24d6d9d8ad09 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:14.868846 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1f67e2d2-1717-47f6-b5f3-24d6d9d8ad09 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:14.873241 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1f67e2d2-1717-47f6-b5f3-24d6d9d8ad09 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:14.909021 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-1f67e2d2-1717-47f6-b5f3-24d6d9d8ad09 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Getting quotas for project 50c0147c5fae4017810887843b0afaa0. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:41:14.914939 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-1f67e2d2-1717-47f6-b5f3-24d6d9d8ad09 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Getting quotas for user 185235bc4e3245fc8d92b7e4bff6cbbd and project 50c0147c5fae4017810887843b0afaa0. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:41:14.932077 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1f67e2d2-1717-47f6-b5f3-24d6d9d8ad09 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:41:14.936707 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1f67e2d2-1717-47f6-b5f3-24d6d9d8ad09 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] [instance: 58a43093-7550-452c-bd8a-fab84203fca3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:41:15.051617 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1f67e2d2-1717-47f6-b5f3-24d6d9d8ad09 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.626846 Oct 17 13:41:15.054283 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 969/1926] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:41:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:41:15.066656 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-33978554-6936-475e-84b6-744f833366a2 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:15.070095 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-33978554-6936-475e-84b6-744f833366a2 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9c6b4ed2-b111-41b0-9679-b66d386834b9] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:15.082877 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-33978554-6936-475e-84b6-744f833366a2 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:15.083428 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-33978554-6936-475e-84b6-744f833366a2 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:15.084021 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-33978554-6936-475e-84b6-744f833366a2 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:15.084817 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-33978554-6936-475e-84b6-744f833366a2 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:15.085260 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-33978554-6936-475e-84b6-744f833366a2 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:15.085685 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-33978554-6936-475e-84b6-744f833366a2 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:15.486889 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-33978554-6936-475e-84b6-744f833366a2 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:15.503422 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-33978554-6936-475e-84b6-744f833366a2 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9" status: 200 len: 1505 microversion: 2.1 time: 0.444836 Oct 17 13:41:15.504035 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 970/1927] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:15 2022] GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9 => generated 1505 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:15.527724 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d01d88ae-2621-4758-b2f2-060fbe318dae tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:15.528674 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d01d88ae-2621-4758-b2f2-060fbe318dae tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] [instance: 3d4188da-b0f7-4d97-952b-acebaa48f185] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:15.535400 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d01d88ae-2621-4758-b2f2-060fbe318dae tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:15.537870 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d01d88ae-2621-4758-b2f2-060fbe318dae tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:15.540675 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d01d88ae-2621-4758-b2f2-060fbe318dae tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:15.543517 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d01d88ae-2621-4758-b2f2-060fbe318dae tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:15.544175 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d01d88ae-2621-4758-b2f2-060fbe318dae tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:15.546077 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d01d88ae-2621-4758-b2f2-060fbe318dae tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:15.726714 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b7ec7703-cc3b-47e0-b8ed-992683520364 tempest-ImagesMetadataTestJSON-1828188922 tempest-ImagesMetadataTestJSON-1828188922-project] 10.222.0.79 "POST /compute/v2.1/images/af0d807c-3629-472f-8ab5-0b3cedad7bc8/metadata" status: 200 len: 85 microversion: 2.1 time: 1.057265 Oct 17 13:41:15.727342 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 958/1928] 10.222.0.79 () {60 vars in 1281 bytes} [Mon Oct 17 13:41:14 2022] POST /compute/v2.1/images/af0d807c-3629-472f-8ab5-0b3cedad7bc8/metadata => generated 85 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:41:15.735746 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0189e15b-904a-437d-ae49-f9d7cb474bd7 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:15.738025 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0189e15b-904a-437d-ae49-f9d7cb474bd7 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] [instance: 58a43093-7550-452c-bd8a-fab84203fca3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:15.757359 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d01d88ae-2621-4758-b2f2-060fbe318dae tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:15.772475 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d01d88ae-2621-4758-b2f2-060fbe318dae tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers/3d4188da-b0f7-4d97-952b-acebaa48f185" status: 200 len: 1499 microversion: 2.1 time: 0.245541 Oct 17 13:41:15.774125 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 971/1929] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:15 2022] GET /compute/v2.1/servers/3d4188da-b0f7-4d97-952b-acebaa48f185 => generated 1499 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:15.784999 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-60f4c6cd-1cc5-4c01-bbc6-9706fa305c20 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:15.785652 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-60f4c6cd-1cc5-4c01-bbc6-9706fa305c20 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 0f4b3e9d-93c2-4556-84c6-b4fb26f4424d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:15.799356 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-60f4c6cd-1cc5-4c01-bbc6-9706fa305c20 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:15.799900 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-60f4c6cd-1cc5-4c01-bbc6-9706fa305c20 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:15.800340 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-60f4c6cd-1cc5-4c01-bbc6-9706fa305c20 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:15.801041 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-60f4c6cd-1cc5-4c01-bbc6-9706fa305c20 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:15.807316 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-60f4c6cd-1cc5-4c01-bbc6-9706fa305c20 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:15.808051 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-60f4c6cd-1cc5-4c01-bbc6-9706fa305c20 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:15.915930 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0189e15b-904a-437d-ae49-f9d7cb474bd7 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185235bc4e3245fc8d92b7e4bff6cbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c0147c5fae4017810887843b0afaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:15.927059 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0189e15b-904a-437d-ae49-f9d7cb474bd7 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "GET /compute/v2.1/servers/58a43093-7550-452c-bd8a-fab84203fca3" status: 200 len: 1216 microversion: 2.1 time: 0.198359 Oct 17 13:41:15.951209 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 959/1930] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:15 2022] GET /compute/v2.1/servers/58a43093-7550-452c-bd8a-fab84203fca3 => generated 1216 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:15.958964 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0ad5edbf-e657-4057-9299-bee5c7af4f43 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:15.968156 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0ad5edbf-e657-4057-9299-bee5c7af4f43 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9c6b4ed2-b111-41b0-9679-b66d386834b9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:15.993235 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0ad5edbf-e657-4057-9299-bee5c7af4f43 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:15.996461 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0ad5edbf-e657-4057-9299-bee5c7af4f43 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:15.998974 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0ad5edbf-e657-4057-9299-bee5c7af4f43 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:15.999897 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0ad5edbf-e657-4057-9299-bee5c7af4f43 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:16.001205 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0ad5edbf-e657-4057-9299-bee5c7af4f43 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:16.002778 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0ad5edbf-e657-4057-9299-bee5c7af4f43 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:16.283622 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-60f4c6cd-1cc5-4c01-bbc6-9706fa305c20 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:16.298597 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-60f4c6cd-1cc5-4c01-bbc6-9706fa305c20 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/0f4b3e9d-93c2-4556-84c6-b4fb26f4424d" status: 200 len: 1307 microversion: 2.1 time: 0.523270 Oct 17 13:41:16.299226 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 972/1931] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:15 2022] GET /compute/v2.1/servers/0f4b3e9d-93c2-4556-84c6-b4fb26f4424d => generated 1307 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:16.307516 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7c05123e-2971-45e7-ac62-3679f49c5190 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:16.311537 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7c05123e-2971-45e7-ac62-3679f49c5190 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:16.339489 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7c05123e-2971-45e7-ac62-3679f49c5190 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:16.359475 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7c05123e-2971-45e7-ac62-3679f49c5190 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:16.363390 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7c05123e-2971-45e7-ac62-3679f49c5190 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:16.365910 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7c05123e-2971-45e7-ac62-3679f49c5190 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:16.375720 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7c05123e-2971-45e7-ac62-3679f49c5190 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:16.376461 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7c05123e-2971-45e7-ac62-3679f49c5190 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:16.588616 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7c05123e-2971-45e7-ac62-3679f49c5190 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:16.610136 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7c05123e-2971-45e7-ac62-3679f49c5190 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:16.611658 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7c05123e-2971-45e7-ac62-3679f49c5190 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:16.627724 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0ad5edbf-e657-4057-9299-bee5c7af4f43 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:16.634640 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7c05123e-2971-45e7-ac62-3679f49c5190 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1538 microversion: 2.91 time: 0.330963 Oct 17 13:41:16.638843 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 973/1932] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:41:16 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1538 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:41:16.639652 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0ad5edbf-e657-4057-9299-bee5c7af4f43 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9" status: 200 len: 1505 microversion: 2.1 time: 0.687109 Oct 17 13:41:16.643653 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 960/1933] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:15 2022] GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9 => generated 1505 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:16.659462 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-fcd6116d-1e8f-4f06-8b63-25e356948dfc tempest-ImagesMetadataTestJSON-1828188922 tempest-ImagesMetadataTestJSON-1828188922-project] Calling method '.version_select at 0x7f7cd98c2d30>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:16.682180 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7270b457-cd6f-4c47-a977-baf468679f36 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:16.701174 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7270b457-cd6f-4c47-a977-baf468679f36 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:16.704565 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7270b457-cd6f-4c47-a977-baf468679f36 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '66d121d0b216416592c7048c2a46f625'} {{(pid=127016) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:41:16.730460 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7270b457-cd6f-4c47-a977-baf468679f36 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:16.731154 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7270b457-cd6f-4c47-a977-baf468679f36 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:16.737471 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7270b457-cd6f-4c47-a977-baf468679f36 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:16.738482 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7270b457-cd6f-4c47-a977-baf468679f36 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:16.738966 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7270b457-cd6f-4c47-a977-baf468679f36 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:16.739434 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7270b457-cd6f-4c47-a977-baf468679f36 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:16.748518 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-fcd6116d-1e8f-4f06-8b63-25e356948dfc tempest-ImagesMetadataTestJSON-1828188922 tempest-ImagesMetadataTestJSON-1828188922-project] 10.222.0.79 "GET /compute/v2.1/images/af0d807c-3629-472f-8ab5-0b3cedad7bc8/metadata" status: 200 len: 85 microversion: 2.1 time: 0.107829 Oct 17 13:41:16.749649 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 974/1934] 10.222.0.79 () {58 vars in 1260 bytes} [Mon Oct 17 13:41:16 2022] GET /compute/v2.1/images/af0d807c-3629-472f-8ab5-0b3cedad7bc8/metadata => generated 85 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:41:16.772425 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bfe41756-f704-45db-8463-f5a732e15894 tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-854247-14"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:16.780314 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-bfe41756-f704-45db-8463-f5a732e15894 tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:16.819353 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bfe41756-f704-45db-8463-f5a732e15894 tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:16.822310 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bfe41756-f704-45db-8463-f5a732e15894 tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:16.828560 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bfe41756-f704-45db-8463-f5a732e15894 tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:16.834918 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bfe41756-f704-45db-8463-f5a732e15894 tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:16.835624 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bfe41756-f704-45db-8463-f5a732e15894 tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:16.837140 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bfe41756-f704-45db-8463-f5a732e15894 tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:16.844357 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.multi_cell_list [None req-7270b457-cd6f-4c47-a977-baf468679f36 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127016) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:41:16.891912 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:41:16.965846 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7270b457-cd6f-4c47-a977-baf468679f36 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.302778 Oct 17 13:41:16.982124 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 961/1935] 10.222.0.79 () {58 vars in 1154 bytes} [Mon Oct 17 13:41:16 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:41:16.987791 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c80bbeb8-f333-40a3-a027-4a6f1f98597c tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:16.988386 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c80bbeb8-f333-40a3-a027-4a6f1f98597c tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9c6b4ed2-b111-41b0-9679-b66d386834b9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:17.012052 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c80bbeb8-f333-40a3-a027-4a6f1f98597c tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:17.013101 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c80bbeb8-f333-40a3-a027-4a6f1f98597c tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:17.013766 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c80bbeb8-f333-40a3-a027-4a6f1f98597c tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:17.015387 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c80bbeb8-f333-40a3-a027-4a6f1f98597c tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:17.016058 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c80bbeb8-f333-40a3-a027-4a6f1f98597c tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:17.016686 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c80bbeb8-f333-40a3-a027-4a6f1f98597c tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:17.023847 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-bfe41756-f704-45db-8463-f5a732e15894 tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-854247-14". {{(pid=127017) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 17 13:41:17.052861 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c80bbeb8-f333-40a3-a027-4a6f1f98597c tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9c6b4ed2-b111-41b0-9679-b66d386834b9] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:41:17.189274 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-bfe41756-f704-45db-8463-f5a732e15894 tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57/action" status: 202 len: 0 microversion: 2.91 time: 0.436910 Oct 17 13:41:17.190376 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 975/1936] 10.222.0.79 () {62 vars in 1319 bytes} [Mon Oct 17 13:41:16 2022] POST /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57/action => generated 0 bytes in 440 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:41:17.201193 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-26520356-4fe6-4d5f-ad30-6f9afff0b63c tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:17.202197 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-26520356-4fe6-4d5f-ad30-6f9afff0b63c tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] [instance: 58a43093-7550-452c-bd8a-fab84203fca3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:17.203850 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c80bbeb8-f333-40a3-a027-4a6f1f98597c tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "DELETE /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9" status: 204 len: 0 microversion: 2.1 time: 0.220097 Oct 17 13:41:17.213563 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 962/1937] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:41:16 2022] DELETE /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:41:17.218918 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-26520356-4fe6-4d5f-ad30-6f9afff0b63c tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:17.219729 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-26520356-4fe6-4d5f-ad30-6f9afff0b63c tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:17.220415 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-26520356-4fe6-4d5f-ad30-6f9afff0b63c tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:17.225026 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-26520356-4fe6-4d5f-ad30-6f9afff0b63c tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:17.225769 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-26520356-4fe6-4d5f-ad30-6f9afff0b63c tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:17.226476 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-26520356-4fe6-4d5f-ad30-6f9afff0b63c tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:17.251787 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e422d4f9-d3ee-4cc2-967a-6ad75f9c1d34 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:17.287213 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e422d4f9-d3ee-4cc2-967a-6ad75f9c1d34 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:17.290233 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e422d4f9-d3ee-4cc2-967a-6ad75f9c1d34 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:17.292834 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e422d4f9-d3ee-4cc2-967a-6ad75f9c1d34 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:17.390217 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-26520356-4fe6-4d5f-ad30-6f9afff0b63c tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185235bc4e3245fc8d92b7e4bff6cbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c0147c5fae4017810887843b0afaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:17.396019 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e422d4f9-d3ee-4cc2-967a-6ad75f9c1d34 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] [instance: 3d4188da-b0f7-4d97-952b-acebaa48f185] Going to try to start instance {{(pid=127016) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 17 13:41:17.403961 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-26520356-4fe6-4d5f-ad30-6f9afff0b63c tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "GET /compute/v2.1/servers/58a43093-7550-452c-bd8a-fab84203fca3" status: 200 len: 1276 microversion: 2.1 time: 0.206352 Oct 17 13:41:17.405311 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 976/1938] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:17 2022] GET /compute/v2.1/servers/58a43093-7550-452c-bd8a-fab84203fca3 => generated 1276 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:17.410334 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5b7ea88a-db0e-48bf-a316-dc7212874d46 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:17.414006 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5b7ea88a-db0e-48bf-a316-dc7212874d46 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:17.432384 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5b7ea88a-db0e-48bf-a316-dc7212874d46 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:17.433480 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5b7ea88a-db0e-48bf-a316-dc7212874d46 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:17.434334 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5b7ea88a-db0e-48bf-a316-dc7212874d46 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:17.435414 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5b7ea88a-db0e-48bf-a316-dc7212874d46 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:17.436476 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5b7ea88a-db0e-48bf-a316-dc7212874d46 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:17.437524 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5b7ea88a-db0e-48bf-a316-dc7212874d46 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:17.535562 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e422d4f9-d3ee-4cc2-967a-6ad75f9c1d34 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "POST /compute/v2.1/servers/3d4188da-b0f7-4d97-952b-acebaa48f185/action" status: 202 len: 0 microversion: 2.1 time: 0.314737 Oct 17 13:41:17.542666 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 963/1939] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:41:17 2022] POST /compute/v2.1/servers/3d4188da-b0f7-4d97-952b-acebaa48f185/action => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:41:17.576343 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6f3a0143-f23c-4d03-8766-62ce93e85839 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:17.577078 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6f3a0143-f23c-4d03-8766-62ce93e85839 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 0f4b3e9d-93c2-4556-84c6-b4fb26f4424d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:17.598427 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6f3a0143-f23c-4d03-8766-62ce93e85839 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:17.599062 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6f3a0143-f23c-4d03-8766-62ce93e85839 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:17.600709 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6f3a0143-f23c-4d03-8766-62ce93e85839 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:17.603853 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6f3a0143-f23c-4d03-8766-62ce93e85839 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:17.604609 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6f3a0143-f23c-4d03-8766-62ce93e85839 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:17.605965 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6f3a0143-f23c-4d03-8766-62ce93e85839 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:17.638350 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5b7ea88a-db0e-48bf-a316-dc7212874d46 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:17.653224 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5b7ea88a-db0e-48bf-a316-dc7212874d46 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:17.658898 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5b7ea88a-db0e-48bf-a316-dc7212874d46 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:17.670307 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5b7ea88a-db0e-48bf-a316-dc7212874d46 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1486 microversion: 2.91 time: 0.263613 Oct 17 13:41:17.674230 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 977/1940] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:41:17 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1486 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:41:17.679558 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9ce19242-8a21-4b73-be1d-054c7809bde0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1031602804", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "1fa8f2b8-208c-4e70-b9bb-194c580d73b4"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:17.779265 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-9ce19242-8a21-4b73-be1d-054c7809bde0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] validate_networks() for [('1fa8f2b8-208c-4e70-b9bb-194c580d73b4', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:41:18.082721 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6f3a0143-f23c-4d03-8766-62ce93e85839 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:18.123452 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6f3a0143-f23c-4d03-8766-62ce93e85839 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/0f4b3e9d-93c2-4556-84c6-b4fb26f4424d" status: 200 len: 1307 microversion: 2.1 time: 0.553621 Oct 17 13:41:18.139698 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 964/1941] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:17 2022] GET /compute/v2.1/servers/0f4b3e9d-93c2-4556-84c6-b4fb26f4424d => generated 1307 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:18.154289 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d05759f2-d6ec-4b5b-bedf-77a0f50bd14f tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:18.154915 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d05759f2-d6ec-4b5b-bedf-77a0f50bd14f tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] [instance: 3d4188da-b0f7-4d97-952b-acebaa48f185] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:18.166945 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d05759f2-d6ec-4b5b-bedf-77a0f50bd14f tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:18.167467 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d05759f2-d6ec-4b5b-bedf-77a0f50bd14f tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:18.167895 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d05759f2-d6ec-4b5b-bedf-77a0f50bd14f tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:18.169582 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d05759f2-d6ec-4b5b-bedf-77a0f50bd14f tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:18.170209 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d05759f2-d6ec-4b5b-bedf-77a0f50bd14f tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:18.170994 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d05759f2-d6ec-4b5b-bedf-77a0f50bd14f tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:18.880375 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d05759f2-d6ec-4b5b-bedf-77a0f50bd14f tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:18.893403 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d05759f2-d6ec-4b5b-bedf-77a0f50bd14f tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers/3d4188da-b0f7-4d97-952b-acebaa48f185" status: 200 len: 1508 microversion: 2.1 time: 0.752498 Oct 17 13:41:18.910326 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 965/1942] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:18 2022] GET /compute/v2.1/servers/3d4188da-b0f7-4d97-952b-acebaa48f185 => generated 1508 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:18.925687 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d835e7cd-3961-415c-8a7b-1ed4183a54c6 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:18.926616 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d835e7cd-3961-415c-8a7b-1ed4183a54c6 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] [instance: 58a43093-7550-452c-bd8a-fab84203fca3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:18.934136 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d835e7cd-3961-415c-8a7b-1ed4183a54c6 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:18.936336 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d835e7cd-3961-415c-8a7b-1ed4183a54c6 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:18.936969 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d835e7cd-3961-415c-8a7b-1ed4183a54c6 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:18.938540 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d835e7cd-3961-415c-8a7b-1ed4183a54c6 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:18.939156 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d835e7cd-3961-415c-8a7b-1ed4183a54c6 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:18.939971 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d835e7cd-3961-415c-8a7b-1ed4183a54c6 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:19.573178 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d835e7cd-3961-415c-8a7b-1ed4183a54c6 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185235bc4e3245fc8d92b7e4bff6cbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c0147c5fae4017810887843b0afaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:19.581193 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d835e7cd-3961-415c-8a7b-1ed4183a54c6 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "GET /compute/v2.1/servers/58a43093-7550-452c-bd8a-fab84203fca3" status: 200 len: 1274 microversion: 2.1 time: 0.666320 Oct 17 13:41:19.581774 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 966/1943] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:18 2022] GET /compute/v2.1/servers/58a43093-7550-452c-bd8a-fab84203fca3 => generated 1274 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:19.604633 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3839ad48-3d11-487a-9c05-e14e502a13d2 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:19.605679 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3839ad48-3d11-487a-9c05-e14e502a13d2 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:19.612823 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3839ad48-3d11-487a-9c05-e14e502a13d2 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:19.613305 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3839ad48-3d11-487a-9c05-e14e502a13d2 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:19.613903 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3839ad48-3d11-487a-9c05-e14e502a13d2 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:19.614805 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3839ad48-3d11-487a-9c05-e14e502a13d2 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:19.615280 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3839ad48-3d11-487a-9c05-e14e502a13d2 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:19.615875 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3839ad48-3d11-487a-9c05-e14e502a13d2 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:19.778628 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3839ad48-3d11-487a-9c05-e14e502a13d2 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:19.797232 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3839ad48-3d11-487a-9c05-e14e502a13d2 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:19.798677 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3839ad48-3d11-487a-9c05-e14e502a13d2 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:19.815667 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3839ad48-3d11-487a-9c05-e14e502a13d2 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1544 microversion: 2.91 time: 0.223228 Oct 17 13:41:19.818591 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 967/1944] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:41:19 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1544 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:41:19.824561 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4443d3bb-d29a-495e-a297-50af9de91f95 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:19.825111 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4443d3bb-d29a-495e-a297-50af9de91f95 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 0f4b3e9d-93c2-4556-84c6-b4fb26f4424d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:19.844352 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4443d3bb-d29a-495e-a297-50af9de91f95 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:19.845108 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4443d3bb-d29a-495e-a297-50af9de91f95 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:19.845737 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4443d3bb-d29a-495e-a297-50af9de91f95 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:19.846929 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4443d3bb-d29a-495e-a297-50af9de91f95 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:19.849399 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4443d3bb-d29a-495e-a297-50af9de91f95 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:19.849836 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4443d3bb-d29a-495e-a297-50af9de91f95 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:20.465795 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-9ce19242-8a21-4b73-be1d-054c7809bde0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:41:20.466353 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-9ce19242-8a21-4b73-be1d-054c7809bde0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:41:20.466982 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-9ce19242-8a21-4b73-be1d-054c7809bde0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:41:20.467841 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-9ce19242-8a21-4b73-be1d-054c7809bde0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:41:20.468483 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-9ce19242-8a21-4b73-be1d-054c7809bde0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:41:20.482737 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9ce19242-8a21-4b73-be1d-054c7809bde0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:20.483873 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9ce19242-8a21-4b73-be1d-054c7809bde0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:20.484674 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9ce19242-8a21-4b73-be1d-054c7809bde0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:20.486300 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9ce19242-8a21-4b73-be1d-054c7809bde0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:20.487693 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9ce19242-8a21-4b73-be1d-054c7809bde0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:20.488426 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9ce19242-8a21-4b73-be1d-054c7809bde0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:20.547399 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-9ce19242-8a21-4b73-be1d-054c7809bde0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Getting quotas for project a8fe03af82c34607bfe43a58b997704f. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:41:20.554888 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-9ce19242-8a21-4b73-be1d-054c7809bde0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Getting quotas for user 17a7b6856447415487c272498ca335db and project a8fe03af82c34607bfe43a58b997704f. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:41:20.560491 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4443d3bb-d29a-495e-a297-50af9de91f95 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:20.576133 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4443d3bb-d29a-495e-a297-50af9de91f95 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/0f4b3e9d-93c2-4556-84c6-b4fb26f4424d" status: 200 len: 1307 microversion: 2.1 time: 0.756420 Oct 17 13:41:20.576791 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 968/1945] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:19 2022] GET /compute/v2.1/servers/0f4b3e9d-93c2-4556-84c6-b4fb26f4424d => generated 1307 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:20.581736 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c58facc7-0294-4b9c-be1e-9e19508f2b7a tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:20.582288 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c58facc7-0294-4b9c-be1e-9e19508f2b7a tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] [instance: 3d4188da-b0f7-4d97-952b-acebaa48f185] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:20.587570 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9ce19242-8a21-4b73-be1d-054c7809bde0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:41:20.593345 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9ce19242-8a21-4b73-be1d-054c7809bde0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9044674d-a793-46c2-b3ec-e9377b30f253] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:41:20.597313 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c58facc7-0294-4b9c-be1e-9e19508f2b7a tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:20.597815 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c58facc7-0294-4b9c-be1e-9e19508f2b7a tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:20.598252 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c58facc7-0294-4b9c-be1e-9e19508f2b7a tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:20.598987 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c58facc7-0294-4b9c-be1e-9e19508f2b7a tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:20.599463 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c58facc7-0294-4b9c-be1e-9e19508f2b7a tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:20.599890 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c58facc7-0294-4b9c-be1e-9e19508f2b7a tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:20.681709 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9ce19242-8a21-4b73-be1d-054c7809bde0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.005718 Oct 17 13:41:20.682443 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 978/1946] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:41:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 3007 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:41:20.906320 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bd5692d9-8626-4b3c-a083-f565f8f81ad1 tempest-KeyPairsNegativeTestJSON-263395663 tempest-KeyPairsNegativeTestJSON-263395663-project] Action: 'create', calling method: .version_select at 0x7f7cd9a8b4c0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqYGdcSqdjCqBfaJ2bsvLngRqHdjks5tLA8/VxF2PudjVzC6dHxGY6TaioLgl3sWC5I+q3jxoB/1jFz8bit4marjV8qb8J+GYpDUCll1nCJKfTQYdVpVzcnMdO9H7y7SA=="}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:20.914445 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bd5692d9-8626-4b3c-a083-f565f8f81ad1 tempest-KeyPairsNegativeTestJSON-263395663 tempest-KeyPairsNegativeTestJSON-263395663-project] Request method failure captured: Oct 17 13:41:20.914445 n-d-854247-14 devstack@n-api.service[127017]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 17 13:41:20.914445 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:41:20.914445 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:41:20.914445 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:41:20.914445 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 257 Oct 17 13:41:20.914445 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:41:20.914445 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:41:20.914445 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:41:20.914445 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:41:20.914445 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVt_gnHLCSYbSquqholV1Q_aM7RUCT-bNYEm1WKgw9gyxKLwnPAx-wgTyMokeZuOlr9782RHqtN6VdemWiuNr51DVYHKamc6gYoEueimfUkWN92dtu4kOGuAcGA78dSrHDQDjdFER9Jny5NSbbgCOZNemIf5MIHKczVN-YrjIcHnR4Q Oct 17 13:41:20.914445 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:41:20.914445 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:41:20.914445 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:41:20.914445 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:41:20.914445 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:41:20.914445 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:41:20.914445 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 6312db43bf654b35889c65293f00da71 Oct 17 13:41:20.914445 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-263395663 Oct 17 13:41:20.914445 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:41:20.914445 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:41:20.914445 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6312db43bf654b35889c65293f00da71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6312db43bf654b35889c65293f00da71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6312db43bf654b35889c65293f00da71"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6312db43bf654b35889c65293f00da71", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:41:20.914445 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-KeyPairsNegativeTestJSON-263395663 Oct 17 13:41:20.914445 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 6312db43bf654b35889c65293f00da71 Oct 17 13:41:20.914445 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-263395663 Oct 17 13:41:20.914445 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-KeyPairsNegativeTestJSON-263395663-project Oct 17 13:41:20.914445 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:41:20.914445 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:41:20.914445 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: cbde23e318524b60bd21d96824739031 Oct 17 13:41:20.914445 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-KeyPairsNegativeTestJSON-263395663-project Oct 17 13:41:20.914445 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 13:41:20.914445 n-d-854247-14 devstack@n-api.service[127017]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqYGdcSqdjCqBfaJ2bsvLngRqHdjks5tLA8/VxF2PudjVzC6dHxGY6TaioLgl3sWC5I+q3jxoB/1jFz8bit4marjV8qb8J+GYpDUCll1nCJKfTQYdVpVzcnMdO9H7y7SA=="}} Oct 17 13:41:20.914445 n-d-854247-14 devstack@n-api.service[127017]: method: Oct 17 13:41:20.914445 n-d-854247-14 devstack@n-api.service[127017]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 17 13:41:20.914445 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqYGdcSqdjCqBfaJ2bsvLngRqHdjks5tLA8/VxF2PudjVzC6dHxGY6TaioLgl3sWC5I+q3jxoB/1jFz8bit4marjV8qb8J+GYpDUCll1nCJKfTQYdVpVzcnMdO9H7y7SA=='}}} Oct 17 13:41:20.914445 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:41:20.914445 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:20.914445 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 17 13:41:20.914445 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 17 13:41:20.914445 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 17 13:41:20.914445 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 17 13:41:20.914445 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 17 13:41:20.914445 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 17 13:41:20.914445 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 17 13:41:20.914445 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:41:20.914445 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 17 13:41:20.914445 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:41:20.914445 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:20.914445 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:41:20.914445 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:41:20.914445 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:41:20.914445 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:41:20.914445 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 17 13:41:20.914445 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:41:20.914445 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 17 13:41:20.914445 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 17 13:41:20.914445 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 17 13:41:20.914445 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 17 13:41:20.914445 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 17 13:41:20.914445 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:41:20.914445 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 17 13:41:20.914445 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 17 13:41:20.914445 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:41:20.919542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:20.919542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:41:20.919542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:20.919542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:20.919542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:20.919542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:41:20.919542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:41:20.919542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:41:20.919542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:41:20.919542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:41:20.919542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:41:20.919542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:41:20.919542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:41:20.919542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:41:20.919542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:41:20.919542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:41:20.919542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:41:20.919542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:41:20.919542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:41:20.919542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 17 13:41:20.919542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:41:20.919542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:20.919542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:41:20.919542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:20.919542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:20.919542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:20.919542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:41:20.919542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:41:20.919542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 17 13:41:20.919542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:41:20.925266 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bd5692d9-8626-4b3c-a083-f565f8f81ad1 tempest-KeyPairsNegativeTestJSON-263395663 tempest-KeyPairsNegativeTestJSON-263395663-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:41:20.927543 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-bd5692d9-8626-4b3c-a083-f565f8f81ad1 tempest-KeyPairsNegativeTestJSON-263395663 tempest-KeyPairsNegativeTestJSON-263395663-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.244047 Oct 17 13:41:20.929021 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 979/1947] 10.222.0.79 () {60 vars in 1159 bytes} [Mon Oct 17 13:41:20 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 246 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:41:20.939202 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-d6481acf-dfd7-414c-bf1b-79666dc0e7a3 req-d65858ce-f766-4bc6-b084-1d048bb093b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f4b3e9d-93c2-4556-84c6-b4fb26f4424d", "name": "network-vif-plugged", "status": "completed", "tag": "e1f146be-c32e-4789-8774-ab71f775e6eb"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:20.972541 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-d6481acf-dfd7-414c-bf1b-79666dc0e7a3 req-d65858ce-f766-4bc6-b084-1d048bb093b8 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:20.973144 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-d6481acf-dfd7-414c-bf1b-79666dc0e7a3 req-d65858ce-f766-4bc6-b084-1d048bb093b8 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:20.973759 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-d6481acf-dfd7-414c-bf1b-79666dc0e7a3 req-d65858ce-f766-4bc6-b084-1d048bb093b8 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:21.027087 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-d6481acf-dfd7-414c-bf1b-79666dc0e7a3 req-d65858ce-f766-4bc6-b084-1d048bb093b8 service nova] Creating event network-vif-plugged:e1f146be-c32e-4789-8774-ab71f775e6eb for instance 0f4b3e9d-93c2-4556-84c6-b4fb26f4424d on n-h2-854247-14 Oct 17 13:41:21.042227 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-d6481acf-dfd7-414c-bf1b-79666dc0e7a3 req-d65858ce-f766-4bc6-b084-1d048bb093b8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111406 Oct 17 13:41:21.043680 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 980/1948] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:41:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:41:21.088294 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0e5ced66-8f1e-4001-96d8-d32fd85f2290 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:21.092735 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0e5ced66-8f1e-4001-96d8-d32fd85f2290 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] [instance: 58a43093-7550-452c-bd8a-fab84203fca3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:21.110854 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0e5ced66-8f1e-4001-96d8-d32fd85f2290 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:21.111554 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0e5ced66-8f1e-4001-96d8-d32fd85f2290 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:21.112877 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0e5ced66-8f1e-4001-96d8-d32fd85f2290 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:21.115529 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0e5ced66-8f1e-4001-96d8-d32fd85f2290 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:21.116370 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0e5ced66-8f1e-4001-96d8-d32fd85f2290 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:21.117658 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0e5ced66-8f1e-4001-96d8-d32fd85f2290 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:21.183486 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c58facc7-0294-4b9c-be1e-9e19508f2b7a tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:21.197230 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c58facc7-0294-4b9c-be1e-9e19508f2b7a tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers/3d4188da-b0f7-4d97-952b-acebaa48f185" status: 200 len: 1508 microversion: 2.1 time: 0.616140 Oct 17 13:41:21.213164 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 969/1949] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:20 2022] GET /compute/v2.1/servers/3d4188da-b0f7-4d97-952b-acebaa48f185 => generated 1508 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:21.226855 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-95c904fb-aa04-48e3-934c-2c9b5a64a695 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:21.227520 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-95c904fb-aa04-48e3-934c-2c9b5a64a695 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9044674d-a793-46c2-b3ec-e9377b30f253] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:21.476120 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-95c904fb-aa04-48e3-934c-2c9b5a64a695 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:21.484405 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-95c904fb-aa04-48e3-934c-2c9b5a64a695 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253" status: 200 len: 1218 microversion: 2.1 time: 0.269434 Oct 17 13:41:21.491432 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 970/1950] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:21 2022] GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253 => generated 1218 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:21.496940 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-48583664-aa5a-4823-9ab3-d4ae9d647e93 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:21.497833 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-48583664-aa5a-4823-9ab3-d4ae9d647e93 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:21.506062 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48583664-aa5a-4823-9ab3-d4ae9d647e93 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:21.506920 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48583664-aa5a-4823-9ab3-d4ae9d647e93 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:21.507797 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48583664-aa5a-4823-9ab3-d4ae9d647e93 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:21.508678 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48583664-aa5a-4823-9ab3-d4ae9d647e93 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:21.509235 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48583664-aa5a-4823-9ab3-d4ae9d647e93 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:21.509850 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48583664-aa5a-4823-9ab3-d4ae9d647e93 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:21.637482 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0e5ced66-8f1e-4001-96d8-d32fd85f2290 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185235bc4e3245fc8d92b7e4bff6cbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c0147c5fae4017810887843b0afaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:21.656313 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0e5ced66-8f1e-4001-96d8-d32fd85f2290 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "GET /compute/v2.1/servers/58a43093-7550-452c-bd8a-fab84203fca3" status: 200 len: 1316 microversion: 2.1 time: 0.611058 Oct 17 13:41:21.656868 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 981/1951] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:21 2022] GET /compute/v2.1/servers/58a43093-7550-452c-bd8a-fab84203fca3 => generated 1316 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:21.669731 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c0b8e9be-e63f-46c8-858d-9a2e3d957707 tempest-KeyPairsNegativeTestJSON-263395663 tempest-KeyPairsNegativeTestJSON-263395663-project] Action: 'create', calling method: .version_select at 0x7f7cd986b5e0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-941604063", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:21.715947 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-c0b8e9be-e63f-46c8-858d-9a2e3d957707 tempest-KeyPairsNegativeTestJSON-263395663 tempest-KeyPairsNegativeTestJSON-263395663-project] Getting quotas for project 6312db43bf654b35889c65293f00da71. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:41:21.721275 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-c0b8e9be-e63f-46c8-858d-9a2e3d957707 tempest-KeyPairsNegativeTestJSON-263395663 tempest-KeyPairsNegativeTestJSON-263395663-project] Getting quotas for user cbde23e318524b60bd21d96824739031 and project 6312db43bf654b35889c65293f00da71. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:41:21.738901 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-c0b8e9be-e63f-46c8-858d-9a2e3d957707 tempest-KeyPairsNegativeTestJSON-263395663 tempest-KeyPairsNegativeTestJSON-263395663-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 17 13:41:21.742051 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-48583664-aa5a-4823-9ab3-d4ae9d647e93 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:21.761164 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-48583664-aa5a-4823-9ab3-d4ae9d647e93 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:21.762618 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-48583664-aa5a-4823-9ab3-d4ae9d647e93 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:21.771835 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c0b8e9be-e63f-46c8-858d-9a2e3d957707 tempest-KeyPairsNegativeTestJSON-263395663 tempest-KeyPairsNegativeTestJSON-263395663-project] Request method failure captured: Oct 17 13:41:21.771835 n-d-854247-14 devstack@n-api.service[127017]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 17 13:41:21.771835 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:41:21.771835 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:41:21.771835 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:41:21.771835 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 2166 Oct 17 13:41:21.771835 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:41:21.771835 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:41:21.771835 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:41:21.771835 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:41:21.771835 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVt_gnHLCSYbSquqholV1Q_aM7RUCT-bNYEm1WKgw9gyxKLwnPAx-wgTyMokeZuOlr9782RHqtN6VdemWiuNr51DVYHKamc6gYoEueimfUkWN92dtu4kOGuAcGA78dSrHDQDjdFER9Jny5NSbbgCOZNemIf5MIHKczVN-YrjIcHnR4Q Oct 17 13:41:21.771835 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:41:21.771835 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:41:21.771835 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:41:21.771835 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:41:21.771835 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:41:21.771835 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:41:21.771835 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 6312db43bf654b35889c65293f00da71 Oct 17 13:41:21.771835 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-263395663 Oct 17 13:41:21.771835 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:41:21.771835 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:41:21.771835 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6312db43bf654b35889c65293f00da71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6312db43bf654b35889c65293f00da71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6312db43bf654b35889c65293f00da71"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6312db43bf654b35889c65293f00da71", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:41:21.771835 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-KeyPairsNegativeTestJSON-263395663 Oct 17 13:41:21.771835 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 6312db43bf654b35889c65293f00da71 Oct 17 13:41:21.771835 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-263395663 Oct 17 13:41:21.771835 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-KeyPairsNegativeTestJSON-263395663-project Oct 17 13:41:21.771835 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:41:21.771835 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:41:21.771835 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: cbde23e318524b60bd21d96824739031 Oct 17 13:41:21.771835 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-KeyPairsNegativeTestJSON-263395663-project Oct 17 13:41:21.771835 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 13:41:21.771835 n-d-854247-14 devstack@n-api.service[127017]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-941604063", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 17 13:41:21.771835 n-d-854247-14 devstack@n-api.service[127017]: method: Oct 17 13:41:21.771835 n-d-854247-14 devstack@n-api.service[127017]: exception: Keypair data is invalid: failed to generate fingerprint Oct 17 13:41:21.774619 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-941604063', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 17 13:41:21.774619 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:41:21.774619 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:21.774619 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 17 13:41:21.774619 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 17 13:41:21.774619 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 17 13:41:21.774619 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 17 13:41:21.774619 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 17 13:41:21.774619 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:41:21.774619 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:21.774619 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:41:21.774619 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:21.774619 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 17 13:41:21.774619 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 17 13:41:21.774619 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 17 13:41:21.774619 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 17 13:41:21.774619 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:41:21.774619 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:41:21.774619 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:41:21.774619 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:41:21.774619 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 17 13:41:21.774619 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 17 13:41:21.774619 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 17 13:41:21.774619 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 17 13:41:21.774619 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 17 13:41:21.774619 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 17 13:41:21.774619 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 17 13:41:21.774619 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 17 13:41:21.774619 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 17 13:41:21.774619 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:41:21.774619 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:21.774619 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:41:21.774619 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:21.774619 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:21.774619 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:21.774619 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:41:21.774619 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:41:21.774619 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:41:21.774619 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:41:21.774619 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:41:21.774619 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:41:21.779669 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:41:21.779669 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:41:21.779669 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:41:21.779669 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:41:21.779669 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 17 13:41:21.779669 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 17 13:41:21.779669 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 17 13:41:21.779669 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 17 13:41:21.779669 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 17 13:41:21.779669 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:41:21.779669 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:21.779669 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:41:21.779669 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:21.779669 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:21.779669 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:21.779669 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:41:21.779669 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:41:21.779669 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 17 13:41:21.779669 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:41:21.779669 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c0b8e9be-e63f-46c8-858d-9a2e3d957707 tempest-KeyPairsNegativeTestJSON-263395663 tempest-KeyPairsNegativeTestJSON-263395663-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:41:21.779669 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c0b8e9be-e63f-46c8-858d-9a2e3d957707 tempest-KeyPairsNegativeTestJSON-263395663 tempest-KeyPairsNegativeTestJSON-263395663-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.113795 Oct 17 13:41:21.779669 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 982/1952] 10.222.0.79 () {60 vars in 1160 bytes} [Mon Oct 17 13:41:21 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 116 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 17 13:41:21.787765 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-48583664-aa5a-4823-9ab3-d4ae9d647e93 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1544 microversion: 2.91 time: 0.289828 Oct 17 13:41:21.790185 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 971/1953] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:41:21 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1544 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:41:21.796540 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-f2238b0f-3b95-46d0-a4d1-d36c46a48dd4 req-9090dea1-db3f-4e2e-aacd-ac38b77c096c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c6b4ed2-b111-41b0-9679-b66d386834b9", "name": "network-vif-deleted", "tag": "3a217dc6-53c2-4e51-abb4-9f6293319532"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:21.803075 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-eabebfc1-4990-4b84-9660-3f6672f020cc tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:21.808770 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-eabebfc1-4990-4b84-9660-3f6672f020cc tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 0f4b3e9d-93c2-4556-84c6-b4fb26f4424d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:21.824630 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eabebfc1-4990-4b84-9660-3f6672f020cc tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:21.828570 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eabebfc1-4990-4b84-9660-3f6672f020cc tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:21.829557 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eabebfc1-4990-4b84-9660-3f6672f020cc tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:21.830671 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eabebfc1-4990-4b84-9660-3f6672f020cc tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:21.831754 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eabebfc1-4990-4b84-9660-3f6672f020cc tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:21.834369 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eabebfc1-4990-4b84-9660-3f6672f020cc tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:21.856778 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-f2238b0f-3b95-46d0-a4d1-d36c46a48dd4 req-9090dea1-db3f-4e2e-aacd-ac38b77c096c service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:21.857261 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-f2238b0f-3b95-46d0-a4d1-d36c46a48dd4 req-9090dea1-db3f-4e2e-aacd-ac38b77c096c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:21.857693 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-f2238b0f-3b95-46d0-a4d1-d36c46a48dd4 req-9090dea1-db3f-4e2e-aacd-ac38b77c096c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:21.916184 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-f2238b0f-3b95-46d0-a4d1-d36c46a48dd4 req-9090dea1-db3f-4e2e-aacd-ac38b77c096c service nova] Creating event network-vif-deleted:3a217dc6-53c2-4e51-abb4-9f6293319532 for instance 9c6b4ed2-b111-41b0-9679-b66d386834b9 on n-h2-854247-14 Oct 17 13:41:21.926113 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-f2238b0f-3b95-46d0-a4d1-d36c46a48dd4 req-9090dea1-db3f-4e2e-aacd-ac38b77c096c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148233 Oct 17 13:41:21.941399 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 983/1954] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:41:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:41:21.965145 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-20fcf92f-db19-4ca5-be67-9e547f1fc13b tempest-KeyPairsNegativeTestJSON-263395663 tempest-KeyPairsNegativeTestJSON-263395663-project] Action: 'create', calling method: .version_select at 0x7f7cd579d550>, body: {"keypair": {"name": "tempest-keypair-1698966923", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWfBl22XvqFPzsM3IwK/vqvJTx5GyBfNIEkk5nie+G8j/Yw6rSxnQjat5EHHmEEY998eyRfIQNyBrn+J7jdPx3qc5v9imp0DvOsiV7EZWU0z+nuBymzSKOi3jBp7XefiQ=="}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:22.030611 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-20fcf92f-db19-4ca5-be67-9e547f1fc13b tempest-KeyPairsNegativeTestJSON-263395663 tempest-KeyPairsNegativeTestJSON-263395663-project] Getting quotas for project 6312db43bf654b35889c65293f00da71. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:41:22.054696 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-20fcf92f-db19-4ca5-be67-9e547f1fc13b tempest-KeyPairsNegativeTestJSON-263395663 tempest-KeyPairsNegativeTestJSON-263395663-project] Getting quotas for user cbde23e318524b60bd21d96824739031 and project 6312db43bf654b35889c65293f00da71. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:41:22.133601 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-20fcf92f-db19-4ca5-be67-9e547f1fc13b tempest-KeyPairsNegativeTestJSON-263395663 tempest-KeyPairsNegativeTestJSON-263395663-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.189467 Oct 17 13:41:22.139586 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 984/1955] 10.222.0.79 () {60 vars in 1159 bytes} [Mon Oct 17 13:41:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:41:22.153186 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4dedcc55-dfc8-4769-874c-496fdc3cf981 tempest-KeyPairsNegativeTestJSON-263395663 tempest-KeyPairsNegativeTestJSON-263395663-project] Action: 'create', calling method: .version_select at 0x7f7cd9a8b700>, body: {"keypair": {"name": "tempest-keypair-1698966923", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAzA3a0rpPZw9CWzb5qO3PKPchMewDaRM1UR7EMPqID92UuDbErJSrfWYC1ovYdsdNial1JQUWvktt4eaxFRMkES39PnUQPk6MMjR4bwOqNbes33sr7ymuwNOhe3wCCmQ=="}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:22.186274 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-4dedcc55-dfc8-4769-874c-496fdc3cf981 tempest-KeyPairsNegativeTestJSON-263395663 tempest-KeyPairsNegativeTestJSON-263395663-project] Getting quotas for project 6312db43bf654b35889c65293f00da71. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:41:22.205742 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-4dedcc55-dfc8-4769-874c-496fdc3cf981 tempest-KeyPairsNegativeTestJSON-263395663 tempest-KeyPairsNegativeTestJSON-263395663-project] Getting quotas for user cbde23e318524b60bd21d96824739031 and project 6312db43bf654b35889c65293f00da71. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:41:22.244307 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:41:22.265147 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-4dedcc55-dfc8-4769-874c-496fdc3cf981 tempest-KeyPairsNegativeTestJSON-263395663 tempest-KeyPairsNegativeTestJSON-263395663-project] HTTP exception thrown: Key pair 'tempest-keypair-1698966923' already exists. Oct 17 13:41:22.279608 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4dedcc55-dfc8-4769-874c-496fdc3cf981 tempest-KeyPairsNegativeTestJSON-263395663 tempest-KeyPairsNegativeTestJSON-263395663-project] Request method failure captured: Oct 17 13:41:22.279608 n-d-854247-14 devstack@n-api.service[127017]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 17 13:41:22.279608 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:41:22.279608 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:41:22.279608 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:41:22.279608 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 273 Oct 17 13:41:22.279608 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:41:22.279608 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:41:22.279608 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:41:22.279608 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:41:22.279608 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVt_gnHLCSYbSquqholV1Q_aM7RUCT-bNYEm1WKgw9gyxKLwnPAx-wgTyMokeZuOlr9782RHqtN6VdemWiuNr51DVYHKamc6gYoEueimfUkWN92dtu4kOGuAcGA78dSrHDQDjdFER9Jny5NSbbgCOZNemIf5MIHKczVN-YrjIcHnR4Q Oct 17 13:41:22.279608 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:41:22.279608 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:41:22.279608 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:41:22.279608 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:41:22.279608 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:41:22.279608 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:41:22.279608 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 6312db43bf654b35889c65293f00da71 Oct 17 13:41:22.279608 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-263395663 Oct 17 13:41:22.279608 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:41:22.279608 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:41:22.279608 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6312db43bf654b35889c65293f00da71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6312db43bf654b35889c65293f00da71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6312db43bf654b35889c65293f00da71"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6312db43bf654b35889c65293f00da71", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:41:22.279608 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-KeyPairsNegativeTestJSON-263395663 Oct 17 13:41:22.279608 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 6312db43bf654b35889c65293f00da71 Oct 17 13:41:22.279608 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-263395663 Oct 17 13:41:22.279608 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-KeyPairsNegativeTestJSON-263395663-project Oct 17 13:41:22.279608 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:41:22.279608 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:41:22.279608 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: cbde23e318524b60bd21d96824739031 Oct 17 13:41:22.279608 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-KeyPairsNegativeTestJSON-263395663-project Oct 17 13:41:22.279608 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 13:41:22.279608 n-d-854247-14 devstack@n-api.service[127017]: {"keypair": {"name": "tempest-keypair-1698966923", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAzA3a0rpPZw9CWzb5qO3PKPchMewDaRM1UR7EMPqID92UuDbErJSrfWYC1ovYdsdNial1JQUWvktt4eaxFRMkES39PnUQPk6MMjR4bwOqNbes33sr7ymuwNOhe3wCCmQ=="}} Oct 17 13:41:22.279608 n-d-854247-14 devstack@n-api.service[127017]: method: Oct 17 13:41:22.279608 n-d-854247-14 devstack@n-api.service[127017]: exception: Key pair 'tempest-keypair-1698966923' already exists. Oct 17 13:41:22.279608 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1698966923', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAzA3a0rpPZw9CWzb5qO3PKPchMewDaRM1UR7EMPqID92UuDbErJSrfWYC1ovYdsdNial1JQUWvktt4eaxFRMkES39PnUQPk6MMjR4bwOqNbes33sr7ymuwNOhe3wCCmQ=='}}} Oct 17 13:41:22.279608 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:41:22.279608 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:22.279608 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 17 13:41:22.279608 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 17 13:41:22.279608 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 17 13:41:22.279608 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 17 13:41:22.279608 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 17 13:41:22.279608 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 17 13:41:22.279608 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 17 13:41:22.279608 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 17 13:41:22.279608 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 17 13:41:22.279608 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 17 13:41:22.279608 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 17 13:41:22.279608 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi result.read() Oct 17 13:41:22.279608 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 17 13:41:22.279608 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 17 13:41:22.279608 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 17 13:41:22.279608 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 17 13:41:22.279608 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 17 13:41:22.279608 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 17 13:41:22.279608 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 17 13:41:22.279608 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 17 13:41:22.279608 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'cbde23e318524b60bd21d96824739031-tempest-keypair-1698966923' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 17 13:41:22.279608 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:41:22.284086 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 17 13:41:22.284086 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:41:22.284086 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:22.284086 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 17 13:41:22.284086 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 17 13:41:22.284086 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 17 13:41:22.284086 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi session.flush() Oct 17 13:41:22.284086 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 17 13:41:22.284086 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 17 13:41:22.284086 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 17 13:41:22.284086 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 17 13:41:22.284086 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 17 13:41:22.284086 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 17 13:41:22.284086 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 17 13:41:22.284086 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception Oct 17 13:41:22.284086 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 17 13:41:22.284086 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 17 13:41:22.284086 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 17 13:41:22.284086 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 17 13:41:22.284086 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 17 13:41:22.284086 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 17 13:41:22.284086 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 17 13:41:22.284086 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 17 13:41:22.284086 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 17 13:41:22.284086 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 17 13:41:22.284086 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 17 13:41:22.284086 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 17 13:41:22.284086 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 17 13:41:22.284086 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 17 13:41:22.284086 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 17 13:41:22.284086 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 17 13:41:22.284086 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 17 13:41:22.284086 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 17 13:41:22.284086 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 17 13:41:22.284086 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 17 13:41:22.284086 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 17 13:41:22.284086 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception Oct 17 13:41:22.284086 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 17 13:41:22.284086 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 17 13:41:22.284086 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 17 13:41:22.284086 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 17 13:41:22.284086 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 17 13:41:22.284086 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 17 13:41:22.284086 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 17 13:41:22.284086 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 17 13:41:22.284086 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 17 13:41:22.284086 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 17 13:41:22.284086 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 17 13:41:22.284086 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi result.read() Oct 17 13:41:22.284086 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 17 13:41:22.284086 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 17 13:41:22.284086 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 17 13:41:22.284086 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 17 13:41:22.284086 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 17 13:41:22.284086 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 17 13:41:22.284086 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 17 13:41:22.289856 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 17 13:41:22.289856 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'cbde23e318524b60bd21d96824739031-tempest-keypair-1698966923' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 17 13:41:22.289856 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 17 13:41:22.289856 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 17, 13, 41, 22, 256469), 'updated_at': None, 'name': 'tempest-keypair-1698966923', 'user_id': 'cbde23e318524b60bd21d96824739031', 'fingerprint': '26:41:82:48:b6:1c:79:5f:11:db:9b:01:ff:b7:68:d5', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAzA3a0rpPZw9CWzb5qO3PKPchMewDaRM1UR7EMPqID92UuDbErJSrfWYC1ovYdsdNial1JQUWvktt4eaxFRMkES39PnUQPk6MMjR4bwOqNbes33sr7ymuwNOhe3wCCmQ==', 'type': 'ssh'}] Oct 17 13:41:22.289856 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 17 13:41:22.289856 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:41:22.289856 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:22.289856 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:41:22.289856 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:22.289856 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 17 13:41:22.289856 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 17 13:41:22.289856 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 17 13:41:22.289856 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 17 13:41:22.289856 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:41:22.289856 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:41:22.289856 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:41:22.289856 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:41:22.289856 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 17 13:41:22.289856 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 17 13:41:22.289856 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 17 13:41:22.289856 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi keypair.create() Oct 17 13:41:22.289856 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 17 13:41:22.289856 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 17 13:41:22.289856 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 17 13:41:22.289856 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._create() Oct 17 13:41:22.289856 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 17 13:41:22.289856 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 17 13:41:22.289856 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 17 13:41:22.289856 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 17 13:41:22.289856 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 13:41:22.289856 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 13:41:22.289856 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 17 13:41:22.289856 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 17 13:41:22.289856 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1698966923' already exists. Oct 17 13:41:22.289856 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:41:22.289856 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:22.289856 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:41:22.289856 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:22.289856 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:22.289856 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:22.289856 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:41:22.289856 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:41:22.289856 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:41:22.289856 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:41:22.289856 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:41:22.289856 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:41:22.289856 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:41:22.289856 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:41:22.289856 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:41:22.289856 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:41:22.289856 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 17 13:41:22.289856 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 17 13:41:22.289856 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 17 13:41:22.289856 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 17 13:41:22.289856 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1698966923' already exists. Oct 17 13:41:22.302303 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:41:22.302303 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:22.302303 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:41:22.302303 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:22.302303 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:22.302303 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:22.302303 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:41:22.302303 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:41:22.302303 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1698966923' already exists. Oct 17 13:41:22.302303 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:41:22.302303 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4dedcc55-dfc8-4769-874c-496fdc3cf981 tempest-KeyPairsNegativeTestJSON-263395663 tempest-KeyPairsNegativeTestJSON-263395663-project] Returning 409 to user: Key pair 'tempest-keypair-1698966923' already exists. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:41:22.302303 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4dedcc55-dfc8-4769-874c-496fdc3cf981 tempest-KeyPairsNegativeTestJSON-263395663 tempest-KeyPairsNegativeTestJSON-263395663-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.147818 Oct 17 13:41:22.302303 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 985/1956] 10.222.0.79 () {60 vars in 1159 bytes} [Mon Oct 17 13:41:22 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 149 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 17 13:41:22.308638 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b57e16a8-6e94-497f-8655-fe20e86e8d97 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:22.310398 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b57e16a8-6e94-497f-8655-fe20e86e8d97 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] [instance: 3d4188da-b0f7-4d97-952b-acebaa48f185] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:22.319666 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b57e16a8-6e94-497f-8655-fe20e86e8d97 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:22.320520 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b57e16a8-6e94-497f-8655-fe20e86e8d97 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:22.321249 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b57e16a8-6e94-497f-8655-fe20e86e8d97 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:22.322289 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b57e16a8-6e94-497f-8655-fe20e86e8d97 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:22.323111 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b57e16a8-6e94-497f-8655-fe20e86e8d97 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:22.323800 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b57e16a8-6e94-497f-8655-fe20e86e8d97 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:22.374597 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-eabebfc1-4990-4b84-9660-3f6672f020cc tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:22.392096 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-eabebfc1-4990-4b84-9660-3f6672f020cc tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/0f4b3e9d-93c2-4556-84c6-b4fb26f4424d" status: 200 len: 1307 microversion: 2.1 time: 0.600051 Oct 17 13:41:22.410565 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 972/1957] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:21 2022] GET /compute/v2.1/servers/0f4b3e9d-93c2-4556-84c6-b4fb26f4424d => generated 1307 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:22.436358 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4d9a5c5f-7524-428f-a9e6-ecd3fe5819ad tempest-KeyPairsNegativeTestJSON-263395663 tempest-KeyPairsNegativeTestJSON-263395663-project] Calling method '.version_select at 0x7f7cd4ff0820>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:22.491709 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4d9a5c5f-7524-428f-a9e6-ecd3fe5819ad tempest-KeyPairsNegativeTestJSON-263395663 tempest-KeyPairsNegativeTestJSON-263395663-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1698966923" status: 202 len: 0 microversion: 2.1 time: 0.077668 Oct 17 13:41:22.493081 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 973/1958] 10.222.0.79 () {58 vars in 1221 bytes} [Mon Oct 17 13:41:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1698966923 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:41:22.507045 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7de35016-1d66-4bed-8a47-dbd6167d3dbc tempest-KeyPairsNegativeTestJSON-263395663 tempest-KeyPairsNegativeTestJSON-263395663-project] Action: 'create', calling method: .version_select at 0x7f7cd4fb7ee0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxXAD/6Er78Iy5QETXYc22UwQGCOeb2MLRQgpdt0JpdlVFH5V8r9IKlN0/6lP0ix2OI31UPpCyj1MRsnYd18Hj2MEVrumnA6N+T/zfmdlgb4jSNrzg4RgxIqjDQlYExAA=="}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:22.516458 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7de35016-1d66-4bed-8a47-dbd6167d3dbc tempest-KeyPairsNegativeTestJSON-263395663 tempest-KeyPairsNegativeTestJSON-263395663-project] Request method failure captured: Oct 17 13:41:22.516458 n-d-854247-14 devstack@n-api.service[127016]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 17 13:41:22.516458 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:41:22.516458 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:41:22.516458 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:41:22.516458 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 247 Oct 17 13:41:22.516458 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:41:22.516458 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:41:22.516458 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:41:22.516458 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:41:22.516458 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVt_gnHLCSYbSquqholV1Q_aM7RUCT-bNYEm1WKgw9gyxKLwnPAx-wgTyMokeZuOlr9782RHqtN6VdemWiuNr51DVYHKamc6gYoEueimfUkWN92dtu4kOGuAcGA78dSrHDQDjdFER9Jny5NSbbgCOZNemIf5MIHKczVN-YrjIcHnR4Q Oct 17 13:41:22.516458 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:41:22.516458 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:41:22.516458 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:41:22.516458 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:41:22.516458 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:41:22.516458 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:41:22.516458 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 6312db43bf654b35889c65293f00da71 Oct 17 13:41:22.516458 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-263395663 Oct 17 13:41:22.516458 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:41:22.516458 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:41:22.516458 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6312db43bf654b35889c65293f00da71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6312db43bf654b35889c65293f00da71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6312db43bf654b35889c65293f00da71"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6312db43bf654b35889c65293f00da71", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:41:22.516458 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-KeyPairsNegativeTestJSON-263395663 Oct 17 13:41:22.516458 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 6312db43bf654b35889c65293f00da71 Oct 17 13:41:22.516458 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-263395663 Oct 17 13:41:22.516458 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-KeyPairsNegativeTestJSON-263395663-project Oct 17 13:41:22.516458 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:41:22.516458 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:41:22.516458 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: cbde23e318524b60bd21d96824739031 Oct 17 13:41:22.516458 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-KeyPairsNegativeTestJSON-263395663-project Oct 17 13:41:22.516458 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:41:22.516458 n-d-854247-14 devstack@n-api.service[127016]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxXAD/6Er78Iy5QETXYc22UwQGCOeb2MLRQgpdt0JpdlVFH5V8r9IKlN0/6lP0ix2OI31UPpCyj1MRsnYd18Hj2MEVrumnA6N+T/zfmdlgb4jSNrzg4RgxIqjDQlYExAA=="}} Oct 17 13:41:22.516458 n-d-854247-14 devstack@n-api.service[127016]: method: Oct 17 13:41:22.516458 n-d-854247-14 devstack@n-api.service[127016]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 17 13:41:22.516458 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxXAD/6Er78Iy5QETXYc22UwQGCOeb2MLRQgpdt0JpdlVFH5V8r9IKlN0/6lP0ix2OI31UPpCyj1MRsnYd18Hj2MEVrumnA6N+T/zfmdlgb4jSNrzg4RgxIqjDQlYExAA=='}}} Oct 17 13:41:22.516458 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:41:22.516458 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:22.516458 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:41:22.516458 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:41:22.516458 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:41:22.516458 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:41:22.516458 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 17 13:41:22.516458 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:41:22.516458 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 17 13:41:22.516458 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 17 13:41:22.516458 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:41:22.516458 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 17 13:41:22.516458 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi '' Oct 17 13:41:22.516458 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:41:22.516458 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:22.516458 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:41:22.516458 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:22.516458 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:22.516458 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:22.516458 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:41:22.516458 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:41:22.516458 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:41:22.516458 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:41:22.516458 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:41:22.516458 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:41:22.516458 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:41:22.516458 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:41:22.516458 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:41:22.516458 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:41:22.523549 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:41:22.523549 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:41:22.523549 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:41:22.523549 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:41:22.523549 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 17 13:41:22.523549 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:41:22.523549 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:22.523549 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:41:22.523549 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:22.523549 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:22.523549 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:22.523549 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:41:22.523549 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:41:22.523549 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 17 13:41:22.523549 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:41:22.530243 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7de35016-1d66-4bed-8a47-dbd6167d3dbc tempest-KeyPairsNegativeTestJSON-263395663 tempest-KeyPairsNegativeTestJSON-263395663-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:41:22.535925 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7de35016-1d66-4bed-8a47-dbd6167d3dbc tempest-KeyPairsNegativeTestJSON-263395663 tempest-KeyPairsNegativeTestJSON-263395663-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.034554 Oct 17 13:41:22.537308 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 974/1959] 10.222.0.79 () {60 vars in 1159 bytes} [Mon Oct 17 13:41:22 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 17 13:41:22.562489 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5a4aa9b0-e364-40d2-961c-e10485a9a6cb tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:22.563745 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5a4aa9b0-e364-40d2-961c-e10485a9a6cb tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9044674d-a793-46c2-b3ec-e9377b30f253] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:22.573387 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5a4aa9b0-e364-40d2-961c-e10485a9a6cb tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:22.573896 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5a4aa9b0-e364-40d2-961c-e10485a9a6cb tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:22.574329 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5a4aa9b0-e364-40d2-961c-e10485a9a6cb tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:22.575913 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5a4aa9b0-e364-40d2-961c-e10485a9a6cb tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:22.576763 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5a4aa9b0-e364-40d2-961c-e10485a9a6cb tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:22.577389 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5a4aa9b0-e364-40d2-961c-e10485a9a6cb tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:22.818316 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5a4aa9b0-e364-40d2-961c-e10485a9a6cb tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:22.835729 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5a4aa9b0-e364-40d2-961c-e10485a9a6cb tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253" status: 200 len: 1214 microversion: 2.1 time: 0.290652 Oct 17 13:41:22.838383 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 975/1960] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:22 2022] GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253 => generated 1214 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:22.859914 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-60abd07d-bc6c-4bf2-aa68-6a92a086f3d1 tempest-KeyPairsNegativeTestJSON-263395663 tempest-KeyPairsNegativeTestJSON-263395663-project] Action: 'create', calling method: .version_select at 0x7f7cd4ff4820>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-550570646", "public_key": " "}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:22.922865 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-60abd07d-bc6c-4bf2-aa68-6a92a086f3d1 tempest-KeyPairsNegativeTestJSON-263395663 tempest-KeyPairsNegativeTestJSON-263395663-project] Getting quotas for project 6312db43bf654b35889c65293f00da71. Resources: {'key_pairs'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:41:22.940099 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:41:22.948985 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-60abd07d-bc6c-4bf2-aa68-6a92a086f3d1 tempest-KeyPairsNegativeTestJSON-263395663 tempest-KeyPairsNegativeTestJSON-263395663-project] Getting quotas for user cbde23e318524b60bd21d96824739031 and project 6312db43bf654b35889c65293f00da71. Resources: {'key_pairs'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:41:22.989615 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-60abd07d-bc6c-4bf2-aa68-6a92a086f3d1 tempest-KeyPairsNegativeTestJSON-263395663 tempest-KeyPairsNegativeTestJSON-263395663-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-60abd07d-bc6c-4bf2-aa68-6a92a086f3d1 tempest-KeyPairsNegativeTestJSON-263395663 tempest-KeyPairsNegativeTestJSON-263395663-project] Request method failure captured: Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 94 Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVt_gnHLCSYbSquqholV1Q_aM7RUCT-bNYEm1WKgw9gyxKLwnPAx-wgTyMokeZuOlr9782RHqtN6VdemWiuNr51DVYHKamc6gYoEueimfUkWN92dtu4kOGuAcGA78dSrHDQDjdFER9Jny5NSbbgCOZNemIf5MIHKczVN-YrjIcHnR4Q Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 6312db43bf654b35889c65293f00da71 Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-263395663 Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6312db43bf654b35889c65293f00da71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6312db43bf654b35889c65293f00da71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6312db43bf654b35889c65293f00da71"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6312db43bf654b35889c65293f00da71", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-KeyPairsNegativeTestJSON-263395663 Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 6312db43bf654b35889c65293f00da71 Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-263395663 Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-KeyPairsNegativeTestJSON-263395663-project Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: cbde23e318524b60bd21d96824739031 Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-KeyPairsNegativeTestJSON-263395663-project Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-550570646", "public_key": " "}} Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: method: Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: exception: Keypair data is invalid: failed to generate fingerprint Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-550570646', 'public_key': ' '}}} Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:23.000535 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:41:23.005411 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:23.005411 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:23.005411 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:23.005411 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:41:23.005411 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:41:23.005411 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:41:23.005411 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:41:23.005411 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:41:23.005411 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:41:23.005411 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:41:23.005411 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:41:23.005411 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:41:23.005411 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:41:23.005411 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 17 13:41:23.005411 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 17 13:41:23.005411 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 17 13:41:23.005411 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 17 13:41:23.005411 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 17 13:41:23.005411 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:41:23.005411 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:23.005411 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:41:23.005411 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:23.005411 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:23.005411 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:23.005411 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:41:23.005411 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:41:23.005411 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 17 13:41:23.005411 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:41:23.012955 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-60abd07d-bc6c-4bf2-aa68-6a92a086f3d1 tempest-KeyPairsNegativeTestJSON-263395663 tempest-KeyPairsNegativeTestJSON-263395663-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:41:23.014283 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-60abd07d-bc6c-4bf2-aa68-6a92a086f3d1 tempest-KeyPairsNegativeTestJSON-263395663 tempest-KeyPairsNegativeTestJSON-263395663-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.174416 Oct 17 13:41:23.019143 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 976/1961] 10.222.0.79 () {60 vars in 1158 bytes} [Mon Oct 17 13:41:22 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 180 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 17 13:41:23.031537 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a95e187b-811f-4395-a43e-ee006d98a846 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:23.039309 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a95e187b-811f-4395-a43e-ee006d98a846 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] [instance: 58a43093-7550-452c-bd8a-fab84203fca3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:23.057990 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a95e187b-811f-4395-a43e-ee006d98a846 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:23.058630 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a95e187b-811f-4395-a43e-ee006d98a846 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:23.059266 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a95e187b-811f-4395-a43e-ee006d98a846 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:23.062376 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a95e187b-811f-4395-a43e-ee006d98a846 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:23.064376 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a95e187b-811f-4395-a43e-ee006d98a846 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:23.066854 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a95e187b-811f-4395-a43e-ee006d98a846 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:23.093625 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b57e16a8-6e94-497f-8655-fe20e86e8d97 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:23.106413 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b57e16a8-6e94-497f-8655-fe20e86e8d97 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers/3d4188da-b0f7-4d97-952b-acebaa48f185" status: 200 len: 1512 microversion: 2.1 time: 0.812285 Oct 17 13:41:23.131748 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 986/1962] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:22 2022] GET /compute/v2.1/servers/3d4188da-b0f7-4d97-952b-acebaa48f185 => generated 1512 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:23.158105 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e5449826-2a3d-4f6a-a3a7-5a4b32dc1665 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:23.162288 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e5449826-2a3d-4f6a-a3a7-5a4b32dc1665 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:23.190222 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e5449826-2a3d-4f6a-a3a7-5a4b32dc1665 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:23.191942 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e5449826-2a3d-4f6a-a3a7-5a4b32dc1665 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:23.196124 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e5449826-2a3d-4f6a-a3a7-5a4b32dc1665 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:23.203377 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e5449826-2a3d-4f6a-a3a7-5a4b32dc1665 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:23.204224 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e5449826-2a3d-4f6a-a3a7-5a4b32dc1665 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:23.208453 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e5449826-2a3d-4f6a-a3a7-5a4b32dc1665 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:23.523993 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e5449826-2a3d-4f6a-a3a7-5a4b32dc1665 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:23.540023 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e5449826-2a3d-4f6a-a3a7-5a4b32dc1665 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:23.542162 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e5449826-2a3d-4f6a-a3a7-5a4b32dc1665 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:23.561269 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e5449826-2a3d-4f6a-a3a7-5a4b32dc1665 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1544 microversion: 2.91 time: 0.427877 Oct 17 13:41:23.576944 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 987/1963] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:41:23 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1544 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:41:23.594255 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e822be61-5fc7-4b9b-9eb5-d5c56cf1d0ba tempest-KeyPairsNegativeTestJSON-263395663 tempest-KeyPairsNegativeTestJSON-263395663-project] Action: 'create', calling method: .version_select at 0x7f7cd9a8b310>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZjFZbJqV1j9+cHvI+o41E/lUjuKiAaIam0s7dsNmLtv77nDLGf9wdVaf6nyf4hQg5LvRToZtPK+2lbcKgVAWwSwcyUnzyftqclggIevpqAEx4B53tH7GJHWXHEMhaHFg=="}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:23.604825 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e822be61-5fc7-4b9b-9eb5-d5c56cf1d0ba tempest-KeyPairsNegativeTestJSON-263395663 tempest-KeyPairsNegativeTestJSON-263395663-project] Request method failure captured: Oct 17 13:41:23.604825 n-d-854247-14 devstack@n-api.service[127017]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 17 13:41:23.604825 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:41:23.604825 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:41:23.604825 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:41:23.604825 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 507 Oct 17 13:41:23.604825 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:41:23.604825 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:41:23.604825 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:41:23.604825 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:41:23.604825 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVt_gnHLCSYbSquqholV1Q_aM7RUCT-bNYEm1WKgw9gyxKLwnPAx-wgTyMokeZuOlr9782RHqtN6VdemWiuNr51DVYHKamc6gYoEueimfUkWN92dtu4kOGuAcGA78dSrHDQDjdFER9Jny5NSbbgCOZNemIf5MIHKczVN-YrjIcHnR4Q Oct 17 13:41:23.604825 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:41:23.604825 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:41:23.604825 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:41:23.604825 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:41:23.604825 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:41:23.604825 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:41:23.604825 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 6312db43bf654b35889c65293f00da71 Oct 17 13:41:23.604825 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-263395663 Oct 17 13:41:23.604825 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:41:23.604825 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:41:23.604825 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6312db43bf654b35889c65293f00da71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6312db43bf654b35889c65293f00da71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6312db43bf654b35889c65293f00da71"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6312db43bf654b35889c65293f00da71", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:41:23.604825 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-KeyPairsNegativeTestJSON-263395663 Oct 17 13:41:23.604825 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 6312db43bf654b35889c65293f00da71 Oct 17 13:41:23.604825 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-263395663 Oct 17 13:41:23.604825 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-KeyPairsNegativeTestJSON-263395663-project Oct 17 13:41:23.604825 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:41:23.604825 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:41:23.604825 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: cbde23e318524b60bd21d96824739031 Oct 17 13:41:23.604825 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-KeyPairsNegativeTestJSON-263395663-project Oct 17 13:41:23.604825 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 13:41:23.604825 n-d-854247-14 devstack@n-api.service[127017]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZjFZbJqV1j9+cHvI+o41E/lUjuKiAaIam0s7dsNmLtv77nDLGf9wdVaf6nyf4hQg5LvRToZtPK+2lbcKgVAWwSwcyUnzyftqclggIevpqAEx4B53tH7GJHWXHEMhaHFg=="}} Oct 17 13:41:23.604825 n-d-854247-14 devstack@n-api.service[127017]: method: Oct 17 13:41:23.604825 n-d-854247-14 devstack@n-api.service[127017]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 17 13:41:23.604825 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZjFZbJqV1j9+cHvI+o41E/lUjuKiAaIam0s7dsNmLtv77nDLGf9wdVaf6nyf4hQg5LvRToZtPK+2lbcKgVAWwSwcyUnzyftqclggIevpqAEx4B53tH7GJHWXHEMhaHFg=='}}} Oct 17 13:41:23.604825 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:41:23.604825 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:23.604825 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:41:23.604825 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:41:23.604825 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:41:23.604825 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:41:23.604825 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 17 13:41:23.604825 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:41:23.604825 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 17 13:41:23.604825 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 17 13:41:23.604825 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:41:23.604825 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 17 13:41:23.604825 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 17 13:41:23.608423 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:41:23.608423 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:23.608423 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:41:23.608423 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:23.608423 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:23.608423 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:23.608423 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:41:23.608423 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:41:23.608423 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:41:23.608423 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:41:23.608423 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:41:23.608423 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:41:23.608423 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:41:23.608423 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:41:23.608423 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:41:23.608423 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:41:23.608423 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:41:23.608423 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:41:23.608423 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:41:23.608423 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:41:23.608423 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 17 13:41:23.608423 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:41:23.608423 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:23.608423 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:41:23.608423 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:23.608423 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:23.608423 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:23.608423 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:41:23.608423 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:41:23.608423 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 17 13:41:23.608423 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:41:23.608423 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e822be61-5fc7-4b9b-9eb5-d5c56cf1d0ba tempest-KeyPairsNegativeTestJSON-263395663 tempest-KeyPairsNegativeTestJSON-263395663-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:41:23.610686 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e822be61-5fc7-4b9b-9eb5-d5c56cf1d0ba tempest-KeyPairsNegativeTestJSON-263395663 tempest-KeyPairsNegativeTestJSON-263395663-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.019209 Oct 17 13:41:23.610686 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 988/1964] 10.222.0.79 () {60 vars in 1159 bytes} [Mon Oct 17 13:41:23 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:41:23.625044 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c2e69833-f84d-484a-baed-9fa40505327e tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:23.638110 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c2e69833-f84d-484a-baed-9fa40505327e tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:23.638826 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.compute.servers [None req-c2e69833-f84d-484a-baed-9fa40505327e tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Removing options 'limit' from query {{(pid=127017) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 17 13:41:23.641786 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c2e69833-f84d-484a-baed-9fa40505327e tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Searching by: {'deleted': False, 'project_id': '66d121d0b216416592c7048c2a46f625'} {{(pid=127017) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:41:23.645646 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c2e69833-f84d-484a-baed-9fa40505327e tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:23.646174 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c2e69833-f84d-484a-baed-9fa40505327e tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:23.646605 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c2e69833-f84d-484a-baed-9fa40505327e tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:23.654457 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c2e69833-f84d-484a-baed-9fa40505327e tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:23.655288 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c2e69833-f84d-484a-baed-9fa40505327e tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:23.655895 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c2e69833-f84d-484a-baed-9fa40505327e tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:23.657759 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c2e69833-f84d-484a-baed-9fa40505327e tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.041120 Oct 17 13:41:23.659393 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 989/1965] 10.222.0.79 () {58 vars in 1140 bytes} [Mon Oct 17 13:41:23 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:41:23.669062 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-024d414d-a415-46a6-aa62-4e4fa7d8eff9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:23.669696 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-024d414d-a415-46a6-aa62-4e4fa7d8eff9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 0f4b3e9d-93c2-4556-84c6-b4fb26f4424d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:23.687542 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-024d414d-a415-46a6-aa62-4e4fa7d8eff9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:23.689420 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-024d414d-a415-46a6-aa62-4e4fa7d8eff9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:23.689894 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-024d414d-a415-46a6-aa62-4e4fa7d8eff9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:23.690642 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-024d414d-a415-46a6-aa62-4e4fa7d8eff9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:23.693497 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-024d414d-a415-46a6-aa62-4e4fa7d8eff9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:23.693910 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-024d414d-a415-46a6-aa62-4e4fa7d8eff9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:23.738527 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a95e187b-811f-4395-a43e-ee006d98a846 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185235bc4e3245fc8d92b7e4bff6cbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c0147c5fae4017810887843b0afaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:23.747206 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a95e187b-811f-4395-a43e-ee006d98a846 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "GET /compute/v2.1/servers/58a43093-7550-452c-bd8a-fab84203fca3" status: 200 len: 1316 microversion: 2.1 time: 0.726454 Oct 17 13:41:23.770169 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 977/1966] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:23 2022] GET /compute/v2.1/servers/58a43093-7550-452c-bd8a-fab84203fca3 => generated 1316 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:23.781504 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-993ddb60-2b02-41e3-af33-37c7eee337ac tempest-KeyPairsNegativeTestJSON-263395663 tempest-KeyPairsNegativeTestJSON-263395663-project] Action: 'create', calling method: .version_select at 0x7f7cd4f870d0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1245324159", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:23.822983 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-993ddb60-2b02-41e3-af33-37c7eee337ac tempest-KeyPairsNegativeTestJSON-263395663 tempest-KeyPairsNegativeTestJSON-263395663-project] Getting quotas for project 6312db43bf654b35889c65293f00da71. Resources: {'key_pairs'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:41:23.835650 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-993ddb60-2b02-41e3-af33-37c7eee337ac tempest-KeyPairsNegativeTestJSON-263395663 tempest-KeyPairsNegativeTestJSON-263395663-project] Getting quotas for user cbde23e318524b60bd21d96824739031 and project 6312db43bf654b35889c65293f00da71. Resources: {'key_pairs'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:41:23.937953 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-993ddb60-2b02-41e3-af33-37c7eee337ac tempest-KeyPairsNegativeTestJSON-263395663 tempest-KeyPairsNegativeTestJSON-263395663-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 17 13:41:23.957507 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-993ddb60-2b02-41e3-af33-37c7eee337ac tempest-KeyPairsNegativeTestJSON-263395663 tempest-KeyPairsNegativeTestJSON-263395663-project] Request method failure captured: Oct 17 13:41:23.957507 n-d-854247-14 devstack@n-api.service[127016]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 17 13:41:23.957507 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:41:23.957507 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:41:23.957507 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:41:23.957507 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 118 Oct 17 13:41:23.957507 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:41:23.957507 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:41:23.957507 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:41:23.957507 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:41:23.957507 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVt_gnHLCSYbSquqholV1Q_aM7RUCT-bNYEm1WKgw9gyxKLwnPAx-wgTyMokeZuOlr9782RHqtN6VdemWiuNr51DVYHKamc6gYoEueimfUkWN92dtu4kOGuAcGA78dSrHDQDjdFER9Jny5NSbbgCOZNemIf5MIHKczVN-YrjIcHnR4Q Oct 17 13:41:23.957507 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:41:23.957507 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:41:23.957507 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:41:23.957507 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:41:23.957507 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:41:23.957507 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:41:23.957507 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 6312db43bf654b35889c65293f00da71 Oct 17 13:41:23.957507 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-263395663 Oct 17 13:41:23.957507 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:41:23.957507 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:41:23.957507 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6312db43bf654b35889c65293f00da71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6312db43bf654b35889c65293f00da71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6312db43bf654b35889c65293f00da71"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6312db43bf654b35889c65293f00da71", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:41:23.957507 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-KeyPairsNegativeTestJSON-263395663 Oct 17 13:41:23.957507 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 6312db43bf654b35889c65293f00da71 Oct 17 13:41:23.957507 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-263395663 Oct 17 13:41:23.957507 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-KeyPairsNegativeTestJSON-263395663-project Oct 17 13:41:23.957507 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:41:23.957507 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:41:23.957507 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: cbde23e318524b60bd21d96824739031 Oct 17 13:41:23.957507 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-KeyPairsNegativeTestJSON-263395663-project Oct 17 13:41:23.957507 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:41:23.957507 n-d-854247-14 devstack@n-api.service[127016]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1245324159", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 17 13:41:23.957507 n-d-854247-14 devstack@n-api.service[127016]: method: Oct 17 13:41:23.957507 n-d-854247-14 devstack@n-api.service[127016]: exception: Keypair data is invalid: failed to generate fingerprint Oct 17 13:41:23.957507 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1245324159', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 17 13:41:23.957507 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:41:23.957507 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:23.957507 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 17 13:41:23.957507 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 17 13:41:23.957507 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 17 13:41:23.957507 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 17 13:41:23.957507 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 17 13:41:23.957507 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 17 13:41:23.957507 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 17 13:41:23.957507 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 17 13:41:23.957507 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 17 13:41:23.957507 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:41:23.957507 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:23.957507 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:41:23.957507 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:23.957507 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 17 13:41:23.957507 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 17 13:41:23.957507 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 17 13:41:23.957507 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 17 13:41:23.957507 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:41:23.957507 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:41:23.957507 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:41:23.957507 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:41:23.957507 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 17 13:41:23.957507 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 17 13:41:23.957507 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 17 13:41:23.957507 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 17 13:41:23.957507 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 17 13:41:23.957507 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 17 13:41:23.963545 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 17 13:41:23.963545 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 17 13:41:23.963545 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 17 13:41:23.963545 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:41:23.963545 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:23.963545 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:41:23.963545 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:23.963545 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:23.963545 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:23.963545 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:41:23.963545 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:41:23.963545 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:41:23.963545 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:41:23.963545 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:41:23.963545 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:41:23.963545 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:41:23.963545 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:41:23.963545 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:41:23.963545 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:41:23.963545 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 17 13:41:23.963545 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 17 13:41:23.963545 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 17 13:41:23.963545 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 17 13:41:23.963545 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 17 13:41:23.963545 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:41:23.963545 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:23.963545 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:41:23.963545 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:23.963545 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:23.963545 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:23.963545 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:41:23.963545 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:41:23.963545 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 17 13:41:23.963545 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:41:23.963545 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-993ddb60-2b02-41e3-af33-37c7eee337ac tempest-KeyPairsNegativeTestJSON-263395663 tempest-KeyPairsNegativeTestJSON-263395663-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:41:23.971903 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-993ddb60-2b02-41e3-af33-37c7eee337ac tempest-KeyPairsNegativeTestJSON-263395663 tempest-KeyPairsNegativeTestJSON-263395663-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.195479 Oct 17 13:41:23.975342 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 978/1967] 10.222.0.79 () {60 vars in 1159 bytes} [Mon Oct 17 13:41:23 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 204 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 17 13:41:24.003709 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-729aabe3-e84f-4273-b500-2dc5a447d0c3 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:24.005746 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-729aabe3-e84f-4273-b500-2dc5a447d0c3 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] [instance: 3d4188da-b0f7-4d97-952b-acebaa48f185] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:24.047475 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-729aabe3-e84f-4273-b500-2dc5a447d0c3 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:24.048083 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-729aabe3-e84f-4273-b500-2dc5a447d0c3 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:24.048632 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-729aabe3-e84f-4273-b500-2dc5a447d0c3 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:24.049451 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-729aabe3-e84f-4273-b500-2dc5a447d0c3 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:24.058092 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-729aabe3-e84f-4273-b500-2dc5a447d0c3 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:24.058871 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-729aabe3-e84f-4273-b500-2dc5a447d0c3 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:24.418792 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-024d414d-a415-46a6-aa62-4e4fa7d8eff9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:24.434964 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-024d414d-a415-46a6-aa62-4e4fa7d8eff9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/0f4b3e9d-93c2-4556-84c6-b4fb26f4424d" status: 200 len: 1486 microversion: 2.1 time: 0.773445 Oct 17 13:41:24.436375 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 990/1968] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:23 2022] GET /compute/v2.1/servers/0f4b3e9d-93c2-4556-84c6-b4fb26f4424d => generated 1486 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:24.442941 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-884b9697-5ad1-42e1-af99-3c922c9a4a07 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:24.443791 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-884b9697-5ad1-42e1-af99-3c922c9a4a07 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] [instance: 709d926d-fba5-49ea-84ac-95d8bb018c68] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:24.462988 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-884b9697-5ad1-42e1-af99-3c922c9a4a07 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:24.464075 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-884b9697-5ad1-42e1-af99-3c922c9a4a07 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:24.464766 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-884b9697-5ad1-42e1-af99-3c922c9a4a07 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:24.465756 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-884b9697-5ad1-42e1-af99-3c922c9a4a07 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:24.467813 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-884b9697-5ad1-42e1-af99-3c922c9a4a07 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:24.468979 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-884b9697-5ad1-42e1-af99-3c922c9a4a07 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:24.516518 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:41:24.773494 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-884b9697-5ad1-42e1-af99-3c922c9a4a07 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lazy-loading 'services' on Instance uuid 709d926d-fba5-49ea-84ac-95d8bb018c68 {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:41:24.831845 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-884b9697-5ad1-42e1-af99-3c922c9a4a07 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68" status: 200 len: 2423 microversion: 2.25 time: 0.393830 Oct 17 13:41:24.846958 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 991/1969] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:41:24 2022] GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68 => generated 2423 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:41:24.852934 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2023afb3-3c13-48c4-aba9-b62f8efd27ae tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:24.855592 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2023afb3-3c13-48c4-aba9-b62f8efd27ae tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9044674d-a793-46c2-b3ec-e9377b30f253] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:24.869684 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2023afb3-3c13-48c4-aba9-b62f8efd27ae tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:24.870786 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2023afb3-3c13-48c4-aba9-b62f8efd27ae tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:24.871791 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2023afb3-3c13-48c4-aba9-b62f8efd27ae tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:24.872752 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2023afb3-3c13-48c4-aba9-b62f8efd27ae tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:24.875897 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2023afb3-3c13-48c4-aba9-b62f8efd27ae tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:24.876890 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2023afb3-3c13-48c4-aba9-b62f8efd27ae tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:24.952854 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-729aabe3-e84f-4273-b500-2dc5a447d0c3 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:24.970969 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-729aabe3-e84f-4273-b500-2dc5a447d0c3 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers/3d4188da-b0f7-4d97-952b-acebaa48f185" status: 200 len: 1512 microversion: 2.1 time: 0.982510 Oct 17 13:41:24.972713 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 979/1970] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:23 2022] GET /compute/v2.1/servers/3d4188da-b0f7-4d97-952b-acebaa48f185 => generated 1512 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:25.003567 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-37f9a983-0421-4a10-9123-b8b718ae2e76 tempest-KeyPairsNegativeTestJSON-263395663 tempest-KeyPairsNegativeTestJSON-263395663-project] Calling method '.version_select at 0x7f7cd4fa39d0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:25.038544 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-37f9a983-0421-4a10-9123-b8b718ae2e76 tempest-KeyPairsNegativeTestJSON-263395663 tempest-KeyPairsNegativeTestJSON-263395663-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-2020792725 not found for user cbde23e318524b60bd21d96824739031 Oct 17 13:41:25.043551 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-37f9a983-0421-4a10-9123-b8b718ae2e76 tempest-KeyPairsNegativeTestJSON-263395663 tempest-KeyPairsNegativeTestJSON-263395663-project] Request method failure captured: Oct 17 13:41:25.043551 n-d-854247-14 devstack@n-api.service[127016]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-2020792725 HTTP/1.1 Oct 17 13:41:25.043551 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:41:25.043551 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:41:25.043551 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:41:25.043551 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:41:25.043551 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:41:25.043551 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:41:25.043551 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:41:25.043551 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:41:25.043551 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVt_gnHLCSYbSquqholV1Q_aM7RUCT-bNYEm1WKgw9gyxKLwnPAx-wgTyMokeZuOlr9782RHqtN6VdemWiuNr51DVYHKamc6gYoEueimfUkWN92dtu4kOGuAcGA78dSrHDQDjdFER9Jny5NSbbgCOZNemIf5MIHKczVN-YrjIcHnR4Q Oct 17 13:41:25.043551 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:41:25.043551 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:41:25.043551 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:41:25.043551 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:41:25.043551 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:41:25.043551 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:41:25.043551 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 6312db43bf654b35889c65293f00da71 Oct 17 13:41:25.043551 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-263395663 Oct 17 13:41:25.043551 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:41:25.043551 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:41:25.043551 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6312db43bf654b35889c65293f00da71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6312db43bf654b35889c65293f00da71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6312db43bf654b35889c65293f00da71"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6312db43bf654b35889c65293f00da71", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:41:25.043551 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-KeyPairsNegativeTestJSON-263395663 Oct 17 13:41:25.043551 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 6312db43bf654b35889c65293f00da71 Oct 17 13:41:25.043551 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-263395663 Oct 17 13:41:25.043551 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-KeyPairsNegativeTestJSON-263395663-project Oct 17 13:41:25.043551 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:41:25.043551 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:41:25.043551 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: cbde23e318524b60bd21d96824739031 Oct 17 13:41:25.043551 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-KeyPairsNegativeTestJSON-263395663-project Oct 17 13:41:25.043551 n-d-854247-14 devstack@n-api.service[127016]: method: Oct 17 13:41:25.043551 n-d-854247-14 devstack@n-api.service[127016]: exception: Keypair tempest-keypair-non-existent-2020792725 not found for user cbde23e318524b60bd21d96824739031 Oct 17 13:41:25.043551 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'tempest-keypair-non-existent-2020792725'} Oct 17 13:41:25.043551 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:41:25.043551 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:25.043551 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 17 13:41:25.043551 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 17 13:41:25.043551 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 17 13:41:25.043551 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 17 13:41:25.043551 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:41:25.043551 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:41:25.043551 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:41:25.043551 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:41:25.043551 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 17 13:41:25.043551 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 17 13:41:25.043551 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Oct 17 13:41:25.043551 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 17 13:41:25.043551 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Oct 17 13:41:25.043551 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 17 13:41:25.043551 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:41:25.043551 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:41:25.043551 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 17 13:41:25.043551 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 17 13:41:25.043551 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 17 13:41:25.043551 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 17 13:41:25.043551 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 13:41:25.043551 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 13:41:25.043551 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 17 13:41:25.043551 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 17 13:41:25.043551 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-2020792725 not found for user cbde23e318524b60bd21d96824739031 Oct 17 13:41:25.043551 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:41:25.043551 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:25.051076 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:41:25.051076 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:25.051076 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:25.051076 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:25.051076 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:41:25.051076 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:41:25.051076 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:41:25.051076 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:41:25.051076 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 13:41:25.051076 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:41:25.051076 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:41:25.051076 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:41:25.051076 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 17 13:41:25.051076 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 17 13:41:25.051076 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 17 13:41:25.051076 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 17 13:41:25.051076 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-2020792725 not found for user cbde23e318524b60bd21d96824739031 Oct 17 13:41:25.051076 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:41:25.051076 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:25.051076 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:41:25.051076 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:25.051076 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:25.051076 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:25.051076 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:41:25.051076 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:41:25.051076 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-2020792725 not found for user cbde23e318524b60bd21d96824739031 Oct 17 13:41:25.051076 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:41:25.051076 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-37f9a983-0421-4a10-9123-b8b718ae2e76 tempest-KeyPairsNegativeTestJSON-263395663 tempest-KeyPairsNegativeTestJSON-263395663-project] Returning 404 to user: Keypair tempest-keypair-non-existent-2020792725 not found for user cbde23e318524b60bd21d96824739031 {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:41:25.051076 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-37f9a983-0421-4a10-9123-b8b718ae2e76 tempest-KeyPairsNegativeTestJSON-263395663 tempest-KeyPairsNegativeTestJSON-263395663-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-2020792725" status: 404 len: 145 microversion: 2.1 time: 0.069974 Oct 17 13:41:25.051076 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 980/1971] 10.222.0.79 () {58 vars in 1260 bytes} [Mon Oct 17 13:41:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-2020792725 => generated 145 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:41:25.058230 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0260a084-be05-4f71-a33a-f795936195a1 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:25.060059 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0260a084-be05-4f71-a33a-f795936195a1 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 0f4b3e9d-93c2-4556-84c6-b4fb26f4424d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:25.073004 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2023afb3-3c13-48c4-aba9-b62f8efd27ae tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:25.112994 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2023afb3-3c13-48c4-aba9-b62f8efd27ae tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253" status: 200 len: 1270 microversion: 2.1 time: 0.264328 Oct 17 13:41:25.113588 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 992/1972] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:24 2022] GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253 => generated 1270 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:25.119475 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0260a084-be05-4f71-a33a-f795936195a1 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:25.120242 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0260a084-be05-4f71-a33a-f795936195a1 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:25.122517 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0260a084-be05-4f71-a33a-f795936195a1 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:25.127066 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0260a084-be05-4f71-a33a-f795936195a1 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:25.130017 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0260a084-be05-4f71-a33a-f795936195a1 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:25.130762 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0260a084-be05-4f71-a33a-f795936195a1 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:25.133217 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c8e7e8fd-4207-4811-8c7f-2b4cd9323196 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:25.133859 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c8e7e8fd-4207-4811-8c7f-2b4cd9323196 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:25.156431 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c8e7e8fd-4207-4811-8c7f-2b4cd9323196 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:25.157204 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c8e7e8fd-4207-4811-8c7f-2b4cd9323196 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:25.159950 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c8e7e8fd-4207-4811-8c7f-2b4cd9323196 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:25.163100 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:41:25.163900 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c8e7e8fd-4207-4811-8c7f-2b4cd9323196 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:25.164385 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c8e7e8fd-4207-4811-8c7f-2b4cd9323196 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:25.168800 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c8e7e8fd-4207-4811-8c7f-2b4cd9323196 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:25.202023 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0260a084-be05-4f71-a33a-f795936195a1 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 0f4b3e9d-93c2-4556-84c6-b4fb26f4424d] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:41:25.458935 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0260a084-be05-4f71-a33a-f795936195a1 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "DELETE /compute/v2.1/servers/0f4b3e9d-93c2-4556-84c6-b4fb26f4424d" status: 204 len: 0 microversion: 2.1 time: 0.411031 Oct 17 13:41:25.460143 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 981/1973] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:41:25 2022] DELETE /compute/v2.1/servers/0f4b3e9d-93c2-4556-84c6-b4fb26f4424d => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:41:25.470279 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d62dd36e-0315-4b0a-b903-819c18ff5e8c tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:25.471545 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d62dd36e-0315-4b0a-b903-819c18ff5e8c tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] [instance: 58a43093-7550-452c-bd8a-fab84203fca3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:25.487155 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d62dd36e-0315-4b0a-b903-819c18ff5e8c tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:25.488007 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d62dd36e-0315-4b0a-b903-819c18ff5e8c tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:25.488681 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d62dd36e-0315-4b0a-b903-819c18ff5e8c tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:25.489592 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d62dd36e-0315-4b0a-b903-819c18ff5e8c tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:25.491884 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d62dd36e-0315-4b0a-b903-819c18ff5e8c tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:25.492710 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d62dd36e-0315-4b0a-b903-819c18ff5e8c tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:26.173655 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c8e7e8fd-4207-4811-8c7f-2b4cd9323196 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:26.193674 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c8e7e8fd-4207-4811-8c7f-2b4cd9323196 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:26.196224 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c8e7e8fd-4207-4811-8c7f-2b4cd9323196 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:26.206232 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c8e7e8fd-4207-4811-8c7f-2b4cd9323196 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1544 microversion: 2.91 time: 1.087015 Oct 17 13:41:26.208549 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 993/1974] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:41:25 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1544 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:41:26.219005 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ff2d9083-1001-4feb-908c-50ffc4798f5f tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854247-14", "block_migration": "auto"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:26.222802 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ff2d9083-1001-4feb-908c-50ffc4798f5f tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] [instance: 709d926d-fba5-49ea-84ac-95d8bb018c68] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:26.237502 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ff2d9083-1001-4feb-908c-50ffc4798f5f tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:26.238822 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ff2d9083-1001-4feb-908c-50ffc4798f5f tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:26.239852 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ff2d9083-1001-4feb-908c-50ffc4798f5f tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:26.241841 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ff2d9083-1001-4feb-908c-50ffc4798f5f tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:26.242941 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ff2d9083-1001-4feb-908c-50ffc4798f5f tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:26.243853 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ff2d9083-1001-4feb-908c-50ffc4798f5f tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:26.291656 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-ff2d9083-1001-4feb-908c-50ffc4798f5f tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lazy-loading 'flavor' on Instance uuid 709d926d-fba5-49ea-84ac-95d8bb018c68 {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:41:26.324068 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ff2d9083-1001-4feb-908c-50ffc4798f5f tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] [instance: 709d926d-fba5-49ea-84ac-95d8bb018c68] Going to try to live migrate instance to n-h2-854247-14 {{(pid=127017) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 17 13:41:26.433739 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d62dd36e-0315-4b0a-b903-819c18ff5e8c tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185235bc4e3245fc8d92b7e4bff6cbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c0147c5fae4017810887843b0afaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:26.448096 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d62dd36e-0315-4b0a-b903-819c18ff5e8c tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "GET /compute/v2.1/servers/58a43093-7550-452c-bd8a-fab84203fca3" status: 200 len: 1316 microversion: 2.1 time: 0.985125 Oct 17 13:41:26.460832 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 982/1975] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:25 2022] GET /compute/v2.1/servers/58a43093-7550-452c-bd8a-fab84203fca3 => generated 1316 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:26.476516 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fe547b21-2c82-4acf-9328-05c6f9e3d210 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:26.477150 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-fe547b21-2c82-4acf-9328-05c6f9e3d210 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] [instance: d30452eb-38cd-413a-9369-f60aad1d31bb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:26.486206 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe547b21-2c82-4acf-9328-05c6f9e3d210 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:26.486966 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe547b21-2c82-4acf-9328-05c6f9e3d210 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:26.487579 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe547b21-2c82-4acf-9328-05c6f9e3d210 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:26.488656 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe547b21-2c82-4acf-9328-05c6f9e3d210 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:26.489294 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe547b21-2c82-4acf-9328-05c6f9e3d210 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:26.490124 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe547b21-2c82-4acf-9328-05c6f9e3d210 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:26.796651 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:41:26.878388 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fe547b21-2c82-4acf-9328-05c6f9e3d210 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:26.889583 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fe547b21-2c82-4acf-9328-05c6f9e3d210 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers/d30452eb-38cd-413a-9369-f60aad1d31bb" status: 200 len: 1511 microversion: 2.1 time: 0.426913 Oct 17 13:41:26.892338 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 983/1976] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:26 2022] GET /compute/v2.1/servers/d30452eb-38cd-413a-9369-f60aad1d31bb => generated 1511 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:26.897860 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3d252275-08d4-4728-a165-44276a6dc9b0 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:26.906187 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3d252275-08d4-4728-a165-44276a6dc9b0 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 0f4b3e9d-93c2-4556-84c6-b4fb26f4424d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:26.927801 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3d252275-08d4-4728-a165-44276a6dc9b0 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:26.932130 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3d252275-08d4-4728-a165-44276a6dc9b0 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:26.932842 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3d252275-08d4-4728-a165-44276a6dc9b0 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:26.933901 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3d252275-08d4-4728-a165-44276a6dc9b0 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:26.935197 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3d252275-08d4-4728-a165-44276a6dc9b0 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:26.936406 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3d252275-08d4-4728-a165-44276a6dc9b0 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:27.251507 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3d252275-08d4-4728-a165-44276a6dc9b0 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:27.267045 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3d252275-08d4-4728-a165-44276a6dc9b0 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/0f4b3e9d-93c2-4556-84c6-b4fb26f4424d" status: 200 len: 1492 microversion: 2.1 time: 0.373179 Oct 17 13:41:27.268520 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 984/1977] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:26 2022] GET /compute/v2.1/servers/0f4b3e9d-93c2-4556-84c6-b4fb26f4424d => generated 1492 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:27.277414 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c7a39372-e375-47f2-a09f-caea06d1c6e0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:27.280993 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c7a39372-e375-47f2-a09f-caea06d1c6e0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9044674d-a793-46c2-b3ec-e9377b30f253] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:27.297363 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c7a39372-e375-47f2-a09f-caea06d1c6e0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:27.299448 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c7a39372-e375-47f2-a09f-caea06d1c6e0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:27.301274 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c7a39372-e375-47f2-a09f-caea06d1c6e0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:27.304164 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c7a39372-e375-47f2-a09f-caea06d1c6e0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:27.305489 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c7a39372-e375-47f2-a09f-caea06d1c6e0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:27.307119 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c7a39372-e375-47f2-a09f-caea06d1c6e0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:27.443923 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c7a39372-e375-47f2-a09f-caea06d1c6e0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:27.458490 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c7a39372-e375-47f2-a09f-caea06d1c6e0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253" status: 200 len: 1278 microversion: 2.1 time: 0.188451 Oct 17 13:41:27.472745 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 985/1978] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:27 2022] GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253 => generated 1278 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:27.481430 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-f7823e18-b10e-411d-9ad5-11e21e85cf15 req-1f926e0f-9abe-4f0c-b217-d025cea2e8e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58a43093-7550-452c-bd8a-fab84203fca3", "tag": "ef5798b1-64dc-43c6-93cc-2aebea1de96a"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:27.493655 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-f7823e18-b10e-411d-9ad5-11e21e85cf15 req-1f926e0f-9abe-4f0c-b217-d025cea2e8e1 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:27.495442 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-f7823e18-b10e-411d-9ad5-11e21e85cf15 req-1f926e0f-9abe-4f0c-b217-d025cea2e8e1 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:27.496267 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-f7823e18-b10e-411d-9ad5-11e21e85cf15 req-1f926e0f-9abe-4f0c-b217-d025cea2e8e1 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:27.509126 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-f7823e18-b10e-411d-9ad5-11e21e85cf15 req-1f926e0f-9abe-4f0c-b217-d025cea2e8e1 service nova] Creating event network-changed:ef5798b1-64dc-43c6-93cc-2aebea1de96a for instance 58a43093-7550-452c-bd8a-fab84203fca3 on n-h2-854247-14 Oct 17 13:41:27.515648 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-f7823e18-b10e-411d-9ad5-11e21e85cf15 req-1f926e0f-9abe-4f0c-b217-d025cea2e8e1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041480 Oct 17 13:41:27.517118 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 986/1979] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:41:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:41:27.528107 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-61b43bed-bb40-43d5-8e51-16976f717de0 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:27.529245 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-61b43bed-bb40-43d5-8e51-16976f717de0 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] [instance: 8938a16d-a198-46b1-92aa-880f0cc290ba] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:27.539697 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-61b43bed-bb40-43d5-8e51-16976f717de0 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:27.540307 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-61b43bed-bb40-43d5-8e51-16976f717de0 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:27.540918 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-61b43bed-bb40-43d5-8e51-16976f717de0 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:27.541861 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-61b43bed-bb40-43d5-8e51-16976f717de0 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:27.542374 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-61b43bed-bb40-43d5-8e51-16976f717de0 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:27.542996 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-61b43bed-bb40-43d5-8e51-16976f717de0 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:28.619450 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-61b43bed-bb40-43d5-8e51-16976f717de0 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:28.653891 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-61b43bed-bb40-43d5-8e51-16976f717de0 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers/8938a16d-a198-46b1-92aa-880f0cc290ba" status: 200 len: 1513 microversion: 2.1 time: 1.135114 Oct 17 13:41:28.658402 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 987/1980] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:27 2022] GET /compute/v2.1/servers/8938a16d-a198-46b1-92aa-880f0cc290ba => generated 1513 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:28.666860 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e4a21387-1c01-4bad-bd1f-888c02a60f2a tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:28.673562 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e4a21387-1c01-4bad-bd1f-888c02a60f2a tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:28.702974 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e4a21387-1c01-4bad-bd1f-888c02a60f2a tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:28.703675 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e4a21387-1c01-4bad-bd1f-888c02a60f2a tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:28.710079 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e4a21387-1c01-4bad-bd1f-888c02a60f2a tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:28.710639 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e4a21387-1c01-4bad-bd1f-888c02a60f2a tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:28.711131 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e4a21387-1c01-4bad-bd1f-888c02a60f2a tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:28.711611 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e4a21387-1c01-4bad-bd1f-888c02a60f2a tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:29.082964 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e4a21387-1c01-4bad-bd1f-888c02a60f2a tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:29.097311 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e4a21387-1c01-4bad-bd1f-888c02a60f2a tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:29.103098 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e4a21387-1c01-4bad-bd1f-888c02a60f2a tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:29.137820 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e4a21387-1c01-4bad-bd1f-888c02a60f2a tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1544 microversion: 2.91 time: 0.463503 Oct 17 13:41:29.139205 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 988/1981] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:41:28 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1544 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:41:29.144151 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0a2509b9-bd00-44bb-9556-448c198515a6 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:29.144977 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0a2509b9-bd00-44bb-9556-448c198515a6 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] [instance: 58a43093-7550-452c-bd8a-fab84203fca3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:29.160933 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0a2509b9-bd00-44bb-9556-448c198515a6 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:29.161693 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0a2509b9-bd00-44bb-9556-448c198515a6 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:29.162373 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0a2509b9-bd00-44bb-9556-448c198515a6 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:29.169305 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0a2509b9-bd00-44bb-9556-448c198515a6 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:29.170190 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0a2509b9-bd00-44bb-9556-448c198515a6 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:29.170631 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0a2509b9-bd00-44bb-9556-448c198515a6 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:29.744513 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0a2509b9-bd00-44bb-9556-448c198515a6 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185235bc4e3245fc8d92b7e4bff6cbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c0147c5fae4017810887843b0afaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:29.757552 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0a2509b9-bd00-44bb-9556-448c198515a6 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "GET /compute/v2.1/servers/58a43093-7550-452c-bd8a-fab84203fca3" status: 200 len: 1316 microversion: 2.1 time: 0.614592 Oct 17 13:41:29.759306 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 989/1982] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:29 2022] GET /compute/v2.1/servers/58a43093-7550-452c-bd8a-fab84203fca3 => generated 1316 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:30.086842 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cb7baeda-57d6-4726-90d0-ce1aba909f32 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:30.087636 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cb7baeda-57d6-4726-90d0-ce1aba909f32 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 0f4b3e9d-93c2-4556-84c6-b4fb26f4424d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:30.104775 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb7baeda-57d6-4726-90d0-ce1aba909f32 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:30.110091 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb7baeda-57d6-4726-90d0-ce1aba909f32 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:30.111848 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb7baeda-57d6-4726-90d0-ce1aba909f32 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:30.114284 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb7baeda-57d6-4726-90d0-ce1aba909f32 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:30.118317 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb7baeda-57d6-4726-90d0-ce1aba909f32 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:30.124835 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb7baeda-57d6-4726-90d0-ce1aba909f32 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:30.251589 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb7baeda-57d6-4726-90d0-ce1aba909f32 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:30.252109 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb7baeda-57d6-4726-90d0-ce1aba909f32 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:30.252546 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb7baeda-57d6-4726-90d0-ce1aba909f32 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:30.253028 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-cb7baeda-57d6-4726-90d0-ce1aba909f32 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lazy-loading 'fault' on Instance uuid 0f4b3e9d-93c2-4556-84c6-b4fb26f4424d {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:41:30.532742 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=4 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:41:30.534138 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ff2d9083-1001-4feb-908c-50ffc4798f5f tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68/action" status: 202 len: 0 microversion: 2.25 time: 4.323557 Oct 17 13:41:30.534743 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 994/1983] 10.222.0.79 () {62 vars in 1319 bytes} [Mon Oct 17 13:41:26 2022] POST /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68/action => generated 0 bytes in 4325 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:41:30.540224 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a523a3a9-5439-40b3-a245-95cae00c5a6f tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:30.540831 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a523a3a9-5439-40b3-a245-95cae00c5a6f tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9044674d-a793-46c2-b3ec-e9377b30f253] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:30.574910 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a523a3a9-5439-40b3-a245-95cae00c5a6f tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:30.579891 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a523a3a9-5439-40b3-a245-95cae00c5a6f tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:30.580512 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a523a3a9-5439-40b3-a245-95cae00c5a6f tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:30.581420 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a523a3a9-5439-40b3-a245-95cae00c5a6f tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:30.582028 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a523a3a9-5439-40b3-a245-95cae00c5a6f tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:30.585052 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a523a3a9-5439-40b3-a245-95cae00c5a6f tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:30.744030 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cb7baeda-57d6-4726-90d0-ce1aba909f32 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:30.766690 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cb7baeda-57d6-4726-90d0-ce1aba909f32 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/0f4b3e9d-93c2-4556-84c6-b4fb26f4424d" status: 200 len: 1297 microversion: 2.1 time: 1.005581 Oct 17 13:41:30.768074 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 990/1984] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:29 2022] GET /compute/v2.1/servers/0f4b3e9d-93c2-4556-84c6-b4fb26f4424d => generated 1297 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:30.773181 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-22071ec4-2448-41ce-a4cd-eb8499559dba tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:30.784062 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-22071ec4-2448-41ce-a4cd-eb8499559dba tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:30.790246 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-22071ec4-2448-41ce-a4cd-eb8499559dba tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Searching by: {'ip': '172.20.0.12', 'deleted': False, 'project_id': '66d121d0b216416592c7048c2a46f625'} {{(pid=127016) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:41:30.968821 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a523a3a9-5439-40b3-a245-95cae00c5a6f tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:30.978820 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a523a3a9-5439-40b3-a245-95cae00c5a6f tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253" status: 200 len: 1276 microversion: 2.1 time: 0.442739 Oct 17 13:41:30.999391 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 995/1985] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:30 2022] GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253 => generated 1276 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:31.005306 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-2017be48-266e-42e1-8a89-a6b54694a1e7 req-6131eee4-af65-414b-b75f-512e5806df33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f4b3e9d-93c2-4556-84c6-b4fb26f4424d", "name": "network-vif-deleted", "tag": "e1f146be-c32e-4789-8774-ab71f775e6eb"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:31.038641 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-2017be48-266e-42e1-8a89-a6b54694a1e7 req-6131eee4-af65-414b-b75f-512e5806df33 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:31.039404 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-2017be48-266e-42e1-8a89-a6b54694a1e7 req-6131eee4-af65-414b-b75f-512e5806df33 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:31.040037 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-2017be48-266e-42e1-8a89-a6b54694a1e7 req-6131eee4-af65-414b-b75f-512e5806df33 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:31.070153 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-2017be48-266e-42e1-8a89-a6b54694a1e7 req-6131eee4-af65-414b-b75f-512e5806df33 service nova] Creating event network-vif-deleted:e1f146be-c32e-4789-8774-ab71f775e6eb for instance 0f4b3e9d-93c2-4556-84c6-b4fb26f4424d on n-h2-854247-14 Oct 17 13:41:31.076778 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-2017be48-266e-42e1-8a89-a6b54694a1e7 req-6131eee4-af65-414b-b75f-512e5806df33 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081078 Oct 17 13:41:31.080111 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 996/1986] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:41:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:41:31.092187 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6a309e8b-4fcb-46ac-a4a6-4f07c84f6c10 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:31.095144 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6a309e8b-4fcb-46ac-a4a6-4f07c84f6c10 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:31.105153 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6a309e8b-4fcb-46ac-a4a6-4f07c84f6c10 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:31.106006 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6a309e8b-4fcb-46ac-a4a6-4f07c84f6c10 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:31.106679 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6a309e8b-4fcb-46ac-a4a6-4f07c84f6c10 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:31.107673 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6a309e8b-4fcb-46ac-a4a6-4f07c84f6c10 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:31.108366 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6a309e8b-4fcb-46ac-a4a6-4f07c84f6c10 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:31.109621 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6a309e8b-4fcb-46ac-a4a6-4f07c84f6c10 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:31.525563 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6a309e8b-4fcb-46ac-a4a6-4f07c84f6c10 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:31.569693 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6a309e8b-4fcb-46ac-a4a6-4f07c84f6c10 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:31.573029 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-22071ec4-2448-41ce-a4cd-eb8499559dba tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:31.573846 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-22071ec4-2448-41ce-a4cd-eb8499559dba tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:31.574595 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-22071ec4-2448-41ce-a4cd-eb8499559dba tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:31.575732 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-22071ec4-2448-41ce-a4cd-eb8499559dba tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:31.576549 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-22071ec4-2448-41ce-a4cd-eb8499559dba tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:31.577369 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-22071ec4-2448-41ce-a4cd-eb8499559dba tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:31.577854 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6a309e8b-4fcb-46ac-a4a6-4f07c84f6c10 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:31.609028 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6a309e8b-4fcb-46ac-a4a6-4f07c84f6c10 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1544 microversion: 2.91 time: 0.527349 Oct 17 13:41:31.609795 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 997/1987] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:41:31 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1544 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:41:31.643417 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3853c4c5-7505-4c26-8ea1-f38abafd2735 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:31.644026 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3853c4c5-7505-4c26-8ea1-f38abafd2735 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 709d926d-fba5-49ea-84ac-95d8bb018c68] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:31.675533 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3853c4c5-7505-4c26-8ea1-f38abafd2735 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:31.676028 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3853c4c5-7505-4c26-8ea1-f38abafd2735 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:31.679395 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3853c4c5-7505-4c26-8ea1-f38abafd2735 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:31.680435 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3853c4c5-7505-4c26-8ea1-f38abafd2735 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:31.681138 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3853c4c5-7505-4c26-8ea1-f38abafd2735 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:31.681851 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3853c4c5-7505-4c26-8ea1-f38abafd2735 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:31.837902 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.multi_cell_list [None req-22071ec4-2448-41ce-a4cd-eb8499559dba tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127016) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:41:31.962493 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-22071ec4-2448-41ce-a4cd-eb8499559dba tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers?ip=172.20.0.12" status: 200 len: 346 microversion: 2.1 time: 1.192295 Oct 17 13:41:31.963902 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 991/1988] 10.222.0.79 () {58 vars in 1154 bytes} [Mon Oct 17 13:41:30 2022] GET /compute/v2.1/servers?ip=172.20.0.12 => generated 346 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:41:31.970561 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-769a5647-8098-40a3-8c4f-a2c92bf46451 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:31.971789 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-769a5647-8098-40a3-8c4f-a2c92bf46451 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] [instance: 58a43093-7550-452c-bd8a-fab84203fca3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:31.981937 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-769a5647-8098-40a3-8c4f-a2c92bf46451 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:31.983197 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-769a5647-8098-40a3-8c4f-a2c92bf46451 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:31.985199 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-769a5647-8098-40a3-8c4f-a2c92bf46451 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:31.986659 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-769a5647-8098-40a3-8c4f-a2c92bf46451 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:31.989310 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-769a5647-8098-40a3-8c4f-a2c92bf46451 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:31.990117 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-769a5647-8098-40a3-8c4f-a2c92bf46451 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:32.235311 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=24 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:41:32.903911 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3853c4c5-7505-4c26-8ea1-f38abafd2735 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:32.922081 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3853c4c5-7505-4c26-8ea1-f38abafd2735 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:32.926917 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3853c4c5-7505-4c26-8ea1-f38abafd2735 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:32.933424 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3853c4c5-7505-4c26-8ea1-f38abafd2735 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68" status: 200 len: 1813 microversion: 2.25 time: 1.294113 Oct 17 13:41:32.934080 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 998/1989] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:41:31 2022] GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68 => generated 1813 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:41:32.941249 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a7118275-e160-446d-ac00-7d3ce7e020f9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:32.941908 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a7118275-e160-446d-ac00-7d3ce7e020f9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 0f4b3e9d-93c2-4556-84c6-b4fb26f4424d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:32.960878 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a7118275-e160-446d-ac00-7d3ce7e020f9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:32.961684 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a7118275-e160-446d-ac00-7d3ce7e020f9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:32.965386 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a7118275-e160-446d-ac00-7d3ce7e020f9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:32.966329 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a7118275-e160-446d-ac00-7d3ce7e020f9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:32.966956 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a7118275-e160-446d-ac00-7d3ce7e020f9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:32.967622 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a7118275-e160-446d-ac00-7d3ce7e020f9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:33.001342 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-a7118275-e160-446d-ac00-7d3ce7e020f9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] HTTP exception thrown: Instance 0f4b3e9d-93c2-4556-84c6-b4fb26f4424d could not be found. Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a7118275-e160-446d-ac00-7d3ce7e020f9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Request method failure captured: Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/0f4b3e9d-93c2-4556-84c6-b4fb26f4424d HTTP/1.1 Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVpcWSwKjkgHu1pOrzJj6HiDQ9hS6xF0hnYpT-9MjemVLwNDzCl7w6ETLwt3fC-SanrMXYSA6kHfWUvQJu5a3Y3I946ESkVOejyjKOR-whNFZHQOyDE2dNW3q_jrKN41Sl71zQIcHHv_pCPQ5Cu97jE35pUEh3xL0sRiioyX-jyds1o Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 461c44cb99ff4958a128679d3e10cd6f Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ImagesTestJSON-1110552804 Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/461c44cb99ff4958a128679d3e10cd6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/461c44cb99ff4958a128679d3e10cd6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/461c44cb99ff4958a128679d3e10cd6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_461c44cb99ff4958a128679d3e10cd6f", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ImagesTestJSON-1110552804 Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 461c44cb99ff4958a128679d3e10cd6f Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ImagesTestJSON-1110552804 Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ImagesTestJSON-1110552804-project Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 386397fd9194430b81ac465f9b3bf92d Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ImagesTestJSON-1110552804-project Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 0f4b3e9d-93c2-4556-84c6-b4fb26f4424d could not be found. Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '0f4b3e9d-93c2-4556-84c6-b4fb26f4424d'} Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f4b3e9d-93c2-4556-84c6-b4fb26f4424d could not be found. Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f4b3e9d-93c2-4556-84c6-b4fb26f4424d could not be found. Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:41:33.007320 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:33.014641 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:33.014641 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:33.014641 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:41:33.014641 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:41:33.014641 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f4b3e9d-93c2-4556-84c6-b4fb26f4424d could not be found. Oct 17 13:41:33.014641 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:41:33.019798 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a7118275-e160-446d-ac00-7d3ce7e020f9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Returning 404 to user: Instance 0f4b3e9d-93c2-4556-84c6-b4fb26f4424d could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:41:33.020865 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a7118275-e160-446d-ac00-7d3ce7e020f9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/0f4b3e9d-93c2-4556-84c6-b4fb26f4424d" status: 404 len: 111 microversion: 2.1 time: 0.085809 Oct 17 13:41:33.023071 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 999/1990] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:32 2022] GET /compute/v2.1/servers/0f4b3e9d-93c2-4556-84c6-b4fb26f4424d => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:41:33.034953 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-520ea000-f6c7-4e29-980f-35da2c31839d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:33.039210 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-520ea000-f6c7-4e29-980f-35da2c31839d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] [instance: 3d4188da-b0f7-4d97-952b-acebaa48f185] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:33.059961 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-520ea000-f6c7-4e29-980f-35da2c31839d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:33.062893 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-520ea000-f6c7-4e29-980f-35da2c31839d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:33.063871 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-520ea000-f6c7-4e29-980f-35da2c31839d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:33.072312 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-520ea000-f6c7-4e29-980f-35da2c31839d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:33.073139 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-520ea000-f6c7-4e29-980f-35da2c31839d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:33.073756 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-520ea000-f6c7-4e29-980f-35da2c31839d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:33.090646 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-769a5647-8098-40a3-8c4f-a2c92bf46451 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185235bc4e3245fc8d92b7e4bff6cbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c0147c5fae4017810887843b0afaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:33.098870 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-769a5647-8098-40a3-8c4f-a2c92bf46451 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "GET /compute/v2.1/servers/58a43093-7550-452c-bd8a-fab84203fca3" status: 200 len: 1316 microversion: 2.1 time: 1.133317 Oct 17 13:41:33.117695 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 992/1991] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:31 2022] GET /compute/v2.1/servers/58a43093-7550-452c-bd8a-fab84203fca3 => generated 1316 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:33.122828 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d202b089-0997-496f-9286-84d687797b41 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:33.131677 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d202b089-0997-496f-9286-84d687797b41 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9044674d-a793-46c2-b3ec-e9377b30f253] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:33.143892 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d202b089-0997-496f-9286-84d687797b41 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:33.144860 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d202b089-0997-496f-9286-84d687797b41 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:33.145529 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d202b089-0997-496f-9286-84d687797b41 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:33.146497 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d202b089-0997-496f-9286-84d687797b41 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:33.147228 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d202b089-0997-496f-9286-84d687797b41 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:33.147875 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d202b089-0997-496f-9286-84d687797b41 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:33.471621 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d202b089-0997-496f-9286-84d687797b41 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:33.481739 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d202b089-0997-496f-9286-84d687797b41 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253" status: 200 len: 1318 microversion: 2.1 time: 0.362733 Oct 17 13:41:33.482772 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 993/1992] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:33 2022] GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253 => generated 1318 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:33.488625 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9bff59ce-0c57-4e93-960a-8bc4ab58e4a0 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:33.489237 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9bff59ce-0c57-4e93-960a-8bc4ab58e4a0 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:33.496594 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9bff59ce-0c57-4e93-960a-8bc4ab58e4a0 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:33.497339 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9bff59ce-0c57-4e93-960a-8bc4ab58e4a0 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:33.498001 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9bff59ce-0c57-4e93-960a-8bc4ab58e4a0 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:33.498907 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9bff59ce-0c57-4e93-960a-8bc4ab58e4a0 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:33.502977 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-520ea000-f6c7-4e29-980f-35da2c31839d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:33.509434 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9bff59ce-0c57-4e93-960a-8bc4ab58e4a0 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:33.510116 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9bff59ce-0c57-4e93-960a-8bc4ab58e4a0 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:33.515628 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-520ea000-f6c7-4e29-980f-35da2c31839d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers/3d4188da-b0f7-4d97-952b-acebaa48f185" status: 200 len: 1512 microversion: 2.1 time: 0.487195 Oct 17 13:41:33.517685 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1000/1993] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:33 2022] GET /compute/v2.1/servers/3d4188da-b0f7-4d97-952b-acebaa48f185 => generated 1512 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:33.523521 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bc951946-4f02-43d4-8f9a-52846566ea4e tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd9876700>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:33.681759 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9bff59ce-0c57-4e93-960a-8bc4ab58e4a0 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:33.693600 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9bff59ce-0c57-4e93-960a-8bc4ab58e4a0 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:33.697522 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9bff59ce-0c57-4e93-960a-8bc4ab58e4a0 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:33.709640 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9bff59ce-0c57-4e93-960a-8bc4ab58e4a0 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1544 microversion: 2.91 time: 0.223001 Oct 17 13:41:33.710275 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 994/1994] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:41:33 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1544 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:41:33.723512 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2b0732b1-2dcd-4115-9410-b2b9d5be1748 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:33.723512 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2b0732b1-2dcd-4115-9410-b2b9d5be1748 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] [instance: d30452eb-38cd-413a-9369-f60aad1d31bb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:33.733213 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2b0732b1-2dcd-4115-9410-b2b9d5be1748 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:33.733997 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2b0732b1-2dcd-4115-9410-b2b9d5be1748 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:33.734724 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2b0732b1-2dcd-4115-9410-b2b9d5be1748 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:33.735867 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2b0732b1-2dcd-4115-9410-b2b9d5be1748 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:33.736514 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2b0732b1-2dcd-4115-9410-b2b9d5be1748 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:33.737262 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2b0732b1-2dcd-4115-9410-b2b9d5be1748 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:33.884562 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=20 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:41:34.107044 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2b0732b1-2dcd-4115-9410-b2b9d5be1748 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:34.120569 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2b0732b1-2dcd-4115-9410-b2b9d5be1748 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers/d30452eb-38cd-413a-9369-f60aad1d31bb" status: 200 len: 1511 microversion: 2.1 time: 0.403478 Oct 17 13:41:34.121270 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 995/1995] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:33 2022] GET /compute/v2.1/servers/d30452eb-38cd-413a-9369-f60aad1d31bb => generated 1511 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:34.132317 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a5ad385d-b3bb-438e-90b0-073ac4cef8bf tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:34.135503 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a5ad385d-b3bb-438e-90b0-073ac4cef8bf tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 709d926d-fba5-49ea-84ac-95d8bb018c68] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:34.149143 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a5ad385d-b3bb-438e-90b0-073ac4cef8bf tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:34.149645 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a5ad385d-b3bb-438e-90b0-073ac4cef8bf tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:34.150082 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a5ad385d-b3bb-438e-90b0-073ac4cef8bf tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:34.150876 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a5ad385d-b3bb-438e-90b0-073ac4cef8bf tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:34.151671 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a5ad385d-b3bb-438e-90b0-073ac4cef8bf tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:34.154633 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a5ad385d-b3bb-438e-90b0-073ac4cef8bf tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:34.191692 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:41:34.467874 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a5ad385d-b3bb-438e-90b0-073ac4cef8bf tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:34.477028 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a5ad385d-b3bb-438e-90b0-073ac4cef8bf tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:34.485963 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a5ad385d-b3bb-438e-90b0-073ac4cef8bf tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:34.488067 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a5ad385d-b3bb-438e-90b0-073ac4cef8bf tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68" status: 200 len: 1813 microversion: 2.25 time: 0.364332 Oct 17 13:41:34.490148 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 996/1996] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:41:34 2022] GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68 => generated 1813 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:41:34.504088 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-244c5f23-1e52-4a3a-8a6c-2da89a25fcf1 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:34.504938 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-244c5f23-1e52-4a3a-8a6c-2da89a25fcf1 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] [instance: 58a43093-7550-452c-bd8a-fab84203fca3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:34.519916 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-244c5f23-1e52-4a3a-8a6c-2da89a25fcf1 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:34.520440 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-244c5f23-1e52-4a3a-8a6c-2da89a25fcf1 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:34.520892 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-244c5f23-1e52-4a3a-8a6c-2da89a25fcf1 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:34.523420 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-244c5f23-1e52-4a3a-8a6c-2da89a25fcf1 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:34.525216 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-244c5f23-1e52-4a3a-8a6c-2da89a25fcf1 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:34.526864 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-244c5f23-1e52-4a3a-8a6c-2da89a25fcf1 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:35.166888 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-bc951946-4f02-43d4-8f9a-52846566ea4e tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "DELETE /compute/v2.1/images/a8625a43-cc13-4579-b0e9-3ebd2183a277" status: 204 len: 0 microversion: 2.1 time: 1.647740 Oct 17 13:41:35.167745 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1001/1997] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:33 2022] DELETE /compute/v2.1/images/a8625a43-cc13-4579-b0e9-3ebd2183a277 => generated 0 bytes in 1649 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:41:35.173076 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1012d409-0dc1-4634-a74a-b430f706fbf6 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:35.173682 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1012d409-0dc1-4634-a74a-b430f706fbf6 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] [instance: 8938a16d-a198-46b1-92aa-880f0cc290ba] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:35.208760 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1012d409-0dc1-4634-a74a-b430f706fbf6 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:35.209439 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1012d409-0dc1-4634-a74a-b430f706fbf6 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:35.209940 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1012d409-0dc1-4634-a74a-b430f706fbf6 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:35.220142 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1012d409-0dc1-4634-a74a-b430f706fbf6 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:35.226329 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1012d409-0dc1-4634-a74a-b430f706fbf6 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:35.227025 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1012d409-0dc1-4634-a74a-b430f706fbf6 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:35.507602 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-244c5f23-1e52-4a3a-8a6c-2da89a25fcf1 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185235bc4e3245fc8d92b7e4bff6cbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c0147c5fae4017810887843b0afaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:35.521829 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-244c5f23-1e52-4a3a-8a6c-2da89a25fcf1 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "GET /compute/v2.1/servers/58a43093-7550-452c-bd8a-fab84203fca3" status: 200 len: 1316 microversion: 2.1 time: 1.028643 Oct 17 13:41:35.528605 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 997/1998] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:34 2022] GET /compute/v2.1/servers/58a43093-7550-452c-bd8a-fab84203fca3 => generated 1316 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:35.542704 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cfaa3283-14e8-4e8a-b4f7-3b14bc7689ed tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:35.543372 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cfaa3283-14e8-4e8a-b4f7-3b14bc7689ed tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9044674d-a793-46c2-b3ec-e9377b30f253] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:35.552789 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cfaa3283-14e8-4e8a-b4f7-3b14bc7689ed tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:35.553539 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cfaa3283-14e8-4e8a-b4f7-3b14bc7689ed tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:35.554701 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cfaa3283-14e8-4e8a-b4f7-3b14bc7689ed tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:35.555868 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cfaa3283-14e8-4e8a-b4f7-3b14bc7689ed tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:35.558225 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cfaa3283-14e8-4e8a-b4f7-3b14bc7689ed tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:35.558837 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cfaa3283-14e8-4e8a-b4f7-3b14bc7689ed tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:35.900897 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1012d409-0dc1-4634-a74a-b430f706fbf6 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:35.916434 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1012d409-0dc1-4634-a74a-b430f706fbf6 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers/8938a16d-a198-46b1-92aa-880f0cc290ba" status: 200 len: 1513 microversion: 2.1 time: 0.744917 Oct 17 13:41:35.917403 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1002/1999] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:35 2022] GET /compute/v2.1/servers/8938a16d-a198-46b1-92aa-880f0cc290ba => generated 1513 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:35.958619 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7ad5e5a4-beec-4c43-8443-98b4b47f141e tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:35.959327 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7ad5e5a4-beec-4c43-8443-98b4b47f141e tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:35.981235 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7ad5e5a4-beec-4c43-8443-98b4b47f141e tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:35.982270 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7ad5e5a4-beec-4c43-8443-98b4b47f141e tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:35.983082 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7ad5e5a4-beec-4c43-8443-98b4b47f141e tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:35.983885 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7ad5e5a4-beec-4c43-8443-98b4b47f141e tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:35.984643 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7ad5e5a4-beec-4c43-8443-98b4b47f141e tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:35.984791 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7ad5e5a4-beec-4c43-8443-98b4b47f141e tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:36.108368 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7ad5e5a4-beec-4c43-8443-98b4b47f141e tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:36.118541 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7ad5e5a4-beec-4c43-8443-98b4b47f141e tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:36.132480 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7ad5e5a4-beec-4c43-8443-98b4b47f141e tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:36.139235 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7ad5e5a4-beec-4c43-8443-98b4b47f141e tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1544 microversion: 2.91 time: 0.195082 Oct 17 13:41:36.140331 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1003/2000] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:41:35 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1544 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:41:36.156537 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c7ba3be1-6d71-4e97-8313-e752813bce12 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:36.157195 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c7ba3be1-6d71-4e97-8313-e752813bce12 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: b05d2fa3-d231-4842-a47b-26aa317ccaa3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:36.165458 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7ba3be1-6d71-4e97-8313-e752813bce12 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:36.165962 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7ba3be1-6d71-4e97-8313-e752813bce12 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:36.166484 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7ba3be1-6d71-4e97-8313-e752813bce12 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:36.167676 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7ba3be1-6d71-4e97-8313-e752813bce12 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:36.168304 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7ba3be1-6d71-4e97-8313-e752813bce12 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:36.168552 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7ba3be1-6d71-4e97-8313-e752813bce12 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:36.179610 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cfaa3283-14e8-4e8a-b4f7-3b14bc7689ed tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:36.189644 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cfaa3283-14e8-4e8a-b4f7-3b14bc7689ed tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253" status: 200 len: 1318 microversion: 2.1 time: 0.659554 Oct 17 13:41:36.196555 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 998/2001] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:35 2022] GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253 => generated 1318 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:36.209476 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e70467f4-c17a-4a07-b630-11a164ec667e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:36.220212 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e70467f4-c17a-4a07-b630-11a164ec667e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 709d926d-fba5-49ea-84ac-95d8bb018c68] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:36.233471 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e70467f4-c17a-4a07-b630-11a164ec667e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:36.243974 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e70467f4-c17a-4a07-b630-11a164ec667e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:36.244751 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e70467f4-c17a-4a07-b630-11a164ec667e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:36.245999 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e70467f4-c17a-4a07-b630-11a164ec667e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:36.246625 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e70467f4-c17a-4a07-b630-11a164ec667e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:36.247244 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e70467f4-c17a-4a07-b630-11a164ec667e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:36.254370 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c7ba3be1-6d71-4e97-8313-e752813bce12 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: b05d2fa3-d231-4842-a47b-26aa317ccaa3] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:41:36.392116 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c7ba3be1-6d71-4e97-8313-e752813bce12 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "DELETE /compute/v2.1/servers/b05d2fa3-d231-4842-a47b-26aa317ccaa3" status: 204 len: 0 microversion: 2.1 time: 0.249798 Oct 17 13:41:36.393017 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1004/2002] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:41:36 2022] DELETE /compute/v2.1/servers/b05d2fa3-d231-4842-a47b-26aa317ccaa3 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:41:36.398850 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5ed14425-9de0-4df0-89e2-0d2448cf3e79 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:36.405098 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5ed14425-9de0-4df0-89e2-0d2448cf3e79 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:36.406267 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5ed14425-9de0-4df0-89e2-0d2448cf3e79 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Searching by: {'deleted': False, 'project_id': '66d121d0b216416592c7048c2a46f625'} {{(pid=127017) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:41:36.412443 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5ed14425-9de0-4df0-89e2-0d2448cf3e79 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:36.413223 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5ed14425-9de0-4df0-89e2-0d2448cf3e79 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:36.413857 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5ed14425-9de0-4df0-89e2-0d2448cf3e79 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:36.414965 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5ed14425-9de0-4df0-89e2-0d2448cf3e79 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:36.415647 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5ed14425-9de0-4df0-89e2-0d2448cf3e79 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:36.416278 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5ed14425-9de0-4df0-89e2-0d2448cf3e79 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:36.472563 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.multi_cell_list [None req-5ed14425-9de0-4df0-89e2-0d2448cf3e79 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127017) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:41:36.532031 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5ed14425-9de0-4df0-89e2-0d2448cf3e79 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:36.544246 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5ed14425-9de0-4df0-89e2-0d2448cf3e79 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:36.546070 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5ed14425-9de0-4df0-89e2-0d2448cf3e79 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:36.546753 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5ed14425-9de0-4df0-89e2-0d2448cf3e79 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:36.566954 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:41:36.998875 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e70467f4-c17a-4a07-b630-11a164ec667e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:37.010310 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e70467f4-c17a-4a07-b630-11a164ec667e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:37.016257 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e70467f4-c17a-4a07-b630-11a164ec667e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:37.021504 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e70467f4-c17a-4a07-b630-11a164ec667e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68" status: 200 len: 1813 microversion: 2.25 time: 0.822217 Oct 17 13:41:37.035439 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 999/2003] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:41:36 2022] GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68 => generated 1813 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:41:37.035439 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4d4c0a19-0a4a-4928-849c-178a0aeba045 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:37.035439 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4d4c0a19-0a4a-4928-849c-178a0aeba045 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] [instance: 58a43093-7550-452c-bd8a-fab84203fca3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:37.057818 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d4c0a19-0a4a-4928-849c-178a0aeba045 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:37.059654 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d4c0a19-0a4a-4928-849c-178a0aeba045 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:37.060296 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d4c0a19-0a4a-4928-849c-178a0aeba045 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:37.061238 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d4c0a19-0a4a-4928-849c-178a0aeba045 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:37.061916 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d4c0a19-0a4a-4928-849c-178a0aeba045 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:37.062440 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d4c0a19-0a4a-4928-849c-178a0aeba045 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:37.392396 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5ed14425-9de0-4df0-89e2-0d2448cf3e79 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers/detail" status: 200 len: 4519 microversion: 2.1 time: 0.997872 Oct 17 13:41:37.394183 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1005/2004] 10.222.0.79 () {58 vars in 1146 bytes} [Mon Oct 17 13:41:36 2022] GET /compute/v2.1/servers/detail => generated 4519 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:37.398897 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c03f71b1-5ecc-496c-a705-5d5fd5611871 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-2143814313", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "9fce71af-909d-4a58-8606-ba21d3f4b00f"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:37.501541 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-c03f71b1-5ecc-496c-a705-5d5fd5611871 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] validate_networks() for [('9fce71af-909d-4a58-8606-ba21d3f4b00f', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:41:38.160891 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4d4c0a19-0a4a-4928-849c-178a0aeba045 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185235bc4e3245fc8d92b7e4bff6cbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c0147c5fae4017810887843b0afaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:38.174753 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4d4c0a19-0a4a-4928-849c-178a0aeba045 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "GET /compute/v2.1/servers/58a43093-7550-452c-bd8a-fab84203fca3" status: 200 len: 1316 microversion: 2.1 time: 1.148246 Oct 17 13:41:38.177265 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1000/2005] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:37 2022] GET /compute/v2.1/servers/58a43093-7550-452c-bd8a-fab84203fca3 => generated 1316 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:38.193270 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1dac77ad-3070-4dc1-96bb-61f02602ec30 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:38.193985 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-1dac77ad-3070-4dc1-96bb-61f02602ec30 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:38.210565 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1dac77ad-3070-4dc1-96bb-61f02602ec30 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:38.212865 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1dac77ad-3070-4dc1-96bb-61f02602ec30 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:38.215321 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1dac77ad-3070-4dc1-96bb-61f02602ec30 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:38.216099 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1dac77ad-3070-4dc1-96bb-61f02602ec30 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:38.219413 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1dac77ad-3070-4dc1-96bb-61f02602ec30 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:38.220285 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1dac77ad-3070-4dc1-96bb-61f02602ec30 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:38.540270 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-1dac77ad-3070-4dc1-96bb-61f02602ec30 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:38.573853 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-1dac77ad-3070-4dc1-96bb-61f02602ec30 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:38.573853 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-1dac77ad-3070-4dc1-96bb-61f02602ec30 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:38.587375 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1dac77ad-3070-4dc1-96bb-61f02602ec30 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1544 microversion: 2.91 time: 0.406170 Oct 17 13:41:38.587978 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1001/2006] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:41:38 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1544 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:41:38.600475 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-06835e44-6d63-4b1c-b861-21e7e43b777e tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:38.601094 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-06835e44-6d63-4b1c-b861-21e7e43b777e tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9044674d-a793-46c2-b3ec-e9377b30f253] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:38.624445 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-06835e44-6d63-4b1c-b861-21e7e43b777e tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:38.625169 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-06835e44-6d63-4b1c-b861-21e7e43b777e tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:38.625811 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-06835e44-6d63-4b1c-b861-21e7e43b777e tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:38.626553 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-06835e44-6d63-4b1c-b861-21e7e43b777e tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:38.626992 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-06835e44-6d63-4b1c-b861-21e7e43b777e tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:38.627442 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-06835e44-6d63-4b1c-b861-21e7e43b777e tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:39.179961 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-06835e44-6d63-4b1c-b861-21e7e43b777e tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:39.193608 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-06835e44-6d63-4b1c-b861-21e7e43b777e tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253" status: 200 len: 1318 microversion: 2.1 time: 0.604373 Oct 17 13:41:39.208648 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1002/2007] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:38 2022] GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253 => generated 1318 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:39.219003 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a44acd07-9600-4696-beb7-09717dc2187a tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:39.224536 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a44acd07-9600-4696-beb7-09717dc2187a tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:39.226242 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a44acd07-9600-4696-beb7-09717dc2187a tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '66d121d0b216416592c7048c2a46f625'} {{(pid=127016) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:41:39.480561 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a44acd07-9600-4696-beb7-09717dc2187a tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:39.481136 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a44acd07-9600-4696-beb7-09717dc2187a tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:39.481649 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a44acd07-9600-4696-beb7-09717dc2187a tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:39.482466 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a44acd07-9600-4696-beb7-09717dc2187a tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:39.482991 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a44acd07-9600-4696-beb7-09717dc2187a tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:39.483520 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a44acd07-9600-4696-beb7-09717dc2187a tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:39.517749 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.multi_cell_list [None req-a44acd07-9600-4696-beb7-09717dc2187a tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127016) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:41:39.551379 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a44acd07-9600-4696-beb7-09717dc2187a tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1010 microversion: 2.1 time: 0.340996 Oct 17 13:41:39.561597 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1003/2008] 10.222.0.79 () {58 vars in 1150 bytes} [Mon Oct 17 13:41:39 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1010 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:39.572182 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-884208ba-34fd-4fff-b686-3834d30e7992 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:39.574197 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-884208ba-34fd-4fff-b686-3834d30e7992 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 709d926d-fba5-49ea-84ac-95d8bb018c68] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:39.582795 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-884208ba-34fd-4fff-b686-3834d30e7992 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:39.584255 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-884208ba-34fd-4fff-b686-3834d30e7992 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:39.585509 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-884208ba-34fd-4fff-b686-3834d30e7992 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:39.589395 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-884208ba-34fd-4fff-b686-3834d30e7992 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:39.590442 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-884208ba-34fd-4fff-b686-3834d30e7992 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:39.591100 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-884208ba-34fd-4fff-b686-3834d30e7992 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:40.180975 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-c03f71b1-5ecc-496c-a705-5d5fd5611871 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:41:40.181651 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-c03f71b1-5ecc-496c-a705-5d5fd5611871 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:41:40.182106 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-c03f71b1-5ecc-496c-a705-5d5fd5611871 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:41:40.182900 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-c03f71b1-5ecc-496c-a705-5d5fd5611871 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:41:40.183582 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-c03f71b1-5ecc-496c-a705-5d5fd5611871 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:41:40.206291 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c03f71b1-5ecc-496c-a705-5d5fd5611871 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:40.206788 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c03f71b1-5ecc-496c-a705-5d5fd5611871 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:40.211379 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c03f71b1-5ecc-496c-a705-5d5fd5611871 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:40.212573 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c03f71b1-5ecc-496c-a705-5d5fd5611871 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:40.213304 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c03f71b1-5ecc-496c-a705-5d5fd5611871 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:40.214201 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c03f71b1-5ecc-496c-a705-5d5fd5611871 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:40.238461 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-c03f71b1-5ecc-496c-a705-5d5fd5611871 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Getting quotas for project 461c44cb99ff4958a128679d3e10cd6f. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:41:40.247588 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-c03f71b1-5ecc-496c-a705-5d5fd5611871 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Getting quotas for user 386397fd9194430b81ac465f9b3bf92d and project 461c44cb99ff4958a128679d3e10cd6f. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:41:40.271975 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c03f71b1-5ecc-496c-a705-5d5fd5611871 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:41:40.274579 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c03f71b1-5ecc-496c-a705-5d5fd5611871 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 3e1d2587-26db-449e-81cd-677ce4f87a76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:41:40.381316 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c03f71b1-5ecc-496c-a705-5d5fd5611871 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.985905 Oct 17 13:41:40.393188 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1006/2009] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:41:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2998 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:41:40.519350 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-884208ba-34fd-4fff-b686-3834d30e7992 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:40.540702 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-884208ba-34fd-4fff-b686-3834d30e7992 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:40.549178 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-884208ba-34fd-4fff-b686-3834d30e7992 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:40.550483 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-884208ba-34fd-4fff-b686-3834d30e7992 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68" status: 200 len: 1813 microversion: 2.25 time: 0.987868 Oct 17 13:41:40.557433 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1004/2010] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:41:39 2022] GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68 => generated 1813 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:41:40.580749 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-238af8dd-c665-4b0c-8bf4-f0d0350e003e tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:40.582739 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-238af8dd-c665-4b0c-8bf4-f0d0350e003e tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] [instance: 58a43093-7550-452c-bd8a-fab84203fca3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:40.600264 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-238af8dd-c665-4b0c-8bf4-f0d0350e003e tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:40.600758 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-238af8dd-c665-4b0c-8bf4-f0d0350e003e tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:40.601193 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-238af8dd-c665-4b0c-8bf4-f0d0350e003e tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:40.601914 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-238af8dd-c665-4b0c-8bf4-f0d0350e003e tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:40.602367 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-238af8dd-c665-4b0c-8bf4-f0d0350e003e tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:40.609364 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-238af8dd-c665-4b0c-8bf4-f0d0350e003e tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:40.777229 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-451945c7-bd10-482f-b149-aa7678809da1 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Action: 'create', calling method: .version_select at 0x7f7cd989adc0>, body: {"keypair": {"name": "tempest-keypair-1687806208", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAP5IJzzaGzZ8jiOnFiivMM1JGCSdyfyx5R6vweQ9ZX3hivDDBKLH9YjME3QTEelALso0Ino7vwsWfngIf2wiY/MnV6LHC8K52jTG1XVryK8M+uELM8n2WSu7ua4ErfjYg=="}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:40.812963 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-451945c7-bd10-482f-b149-aa7678809da1 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Getting quotas for project 358604dd1cf74e5fab262179351d4d98. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:41:40.829891 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-451945c7-bd10-482f-b149-aa7678809da1 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Getting quotas for user b891d3b774e44de3ad1d3088990f6bd5 and project 358604dd1cf74e5fab262179351d4d98. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:41:40.905036 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-451945c7-bd10-482f-b149-aa7678809da1 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.510570 Oct 17 13:41:40.913798 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1007/2011] 10.222.0.79 () {60 vars in 1159 bytes} [Mon Oct 17 13:41:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:41:40.921351 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-04bc2584-ddf8-4875-b3c6-e31de331ae5a tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:40.936513 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-04bc2584-ddf8-4875-b3c6-e31de331ae5a tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:40.941043 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-04bc2584-ddf8-4875-b3c6-e31de331ae5a tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '66d121d0b216416592c7048c2a46f625'} {{(pid=127017) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:41:40.963795 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-04bc2584-ddf8-4875-b3c6-e31de331ae5a tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:40.964588 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-04bc2584-ddf8-4875-b3c6-e31de331ae5a tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:40.965253 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-04bc2584-ddf8-4875-b3c6-e31de331ae5a tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:40.966286 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-04bc2584-ddf8-4875-b3c6-e31de331ae5a tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:40.967016 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-04bc2584-ddf8-4875-b3c6-e31de331ae5a tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:40.968383 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-04bc2584-ddf8-4875-b3c6-e31de331ae5a tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:41.186098 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.multi_cell_list [None req-04bc2584-ddf8-4875-b3c6-e31de331ae5a tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127017) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:41:41.283979 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-04bc2584-ddf8-4875-b3c6-e31de331ae5a tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1010 microversion: 2.1 time: 0.368542 Oct 17 13:41:41.284937 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1008/2012] 10.222.0.79 () {58 vars in 1212 bytes} [Mon Oct 17 13:41:40 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1010 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:41.290358 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4914f635-b47b-4eec-91b0-38772a9de33b tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:41.291380 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4914f635-b47b-4eec-91b0-38772a9de33b tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:41.299252 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4914f635-b47b-4eec-91b0-38772a9de33b tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:41.300094 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4914f635-b47b-4eec-91b0-38772a9de33b tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:41.300769 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4914f635-b47b-4eec-91b0-38772a9de33b tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:41.301701 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4914f635-b47b-4eec-91b0-38772a9de33b tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:41.302353 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4914f635-b47b-4eec-91b0-38772a9de33b tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:41.302963 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4914f635-b47b-4eec-91b0-38772a9de33b tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:41.739796 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4914f635-b47b-4eec-91b0-38772a9de33b tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:41.751887 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4914f635-b47b-4eec-91b0-38772a9de33b tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:41.761842 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4914f635-b47b-4eec-91b0-38772a9de33b tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:41.792926 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4914f635-b47b-4eec-91b0-38772a9de33b tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1531 microversion: 2.91 time: 0.506556 Oct 17 13:41:41.796299 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1009/2013] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:41:41 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1531 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:41:41.814360 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-2f43fbfa-02d8-4205-8aa2-b46cb87a17fb req-436861bc-e839-4937-9639-8b4fa720f1e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9044674d-a793-46c2-b3ec-e9377b30f253", "tag": "b76e3be7-554d-4b8d-924c-9c699342cdd0"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:41.855300 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-2f43fbfa-02d8-4205-8aa2-b46cb87a17fb req-436861bc-e839-4937-9639-8b4fa720f1e4 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:41.861361 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-2f43fbfa-02d8-4205-8aa2-b46cb87a17fb req-436861bc-e839-4937-9639-8b4fa720f1e4 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:41.862129 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-2f43fbfa-02d8-4205-8aa2-b46cb87a17fb req-436861bc-e839-4937-9639-8b4fa720f1e4 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:41.879269 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-238af8dd-c665-4b0c-8bf4-f0d0350e003e tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185235bc4e3245fc8d92b7e4bff6cbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c0147c5fae4017810887843b0afaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:41.893891 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-238af8dd-c665-4b0c-8bf4-f0d0350e003e tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "GET /compute/v2.1/servers/58a43093-7550-452c-bd8a-fab84203fca3" status: 200 len: 1316 microversion: 2.1 time: 1.332060 Oct 17 13:41:41.895620 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1005/2014] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:40 2022] GET /compute/v2.1/servers/58a43093-7550-452c-bd8a-fab84203fca3 => generated 1316 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:41.907210 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8dcb88b7-4f50-478e-b249-d97e3b812a0d tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:41.912450 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8dcb88b7-4f50-478e-b249-d97e3b812a0d tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9044674d-a793-46c2-b3ec-e9377b30f253] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:41.924072 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8dcb88b7-4f50-478e-b249-d97e3b812a0d tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:41.927888 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8dcb88b7-4f50-478e-b249-d97e3b812a0d tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:41.928677 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8dcb88b7-4f50-478e-b249-d97e3b812a0d tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:41.929516 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8dcb88b7-4f50-478e-b249-d97e3b812a0d tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:41.931789 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8dcb88b7-4f50-478e-b249-d97e3b812a0d tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:41.932604 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8dcb88b7-4f50-478e-b249-d97e3b812a0d tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:42.316168 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-2f43fbfa-02d8-4205-8aa2-b46cb87a17fb req-436861bc-e839-4937-9639-8b4fa720f1e4 service nova] Creating event network-changed:b76e3be7-554d-4b8d-924c-9c699342cdd0 for instance 9044674d-a793-46c2-b3ec-e9377b30f253 on n-h2-854247-14 Oct 17 13:41:42.333018 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-2f43fbfa-02d8-4205-8aa2-b46cb87a17fb req-436861bc-e839-4937-9639-8b4fa720f1e4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.532896 Oct 17 13:41:42.334067 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1010/2015] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:41:42.345697 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6e4f3b7b-d56d-4c99-8a06-76fc2c77cca8 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:42.346423 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6e4f3b7b-d56d-4c99-8a06-76fc2c77cca8 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 3e1d2587-26db-449e-81cd-677ce4f87a76] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:42.353625 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6e4f3b7b-d56d-4c99-8a06-76fc2c77cca8 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:42.354162 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6e4f3b7b-d56d-4c99-8a06-76fc2c77cca8 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:42.354662 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6e4f3b7b-d56d-4c99-8a06-76fc2c77cca8 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:42.355470 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6e4f3b7b-d56d-4c99-8a06-76fc2c77cca8 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:42.356595 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6e4f3b7b-d56d-4c99-8a06-76fc2c77cca8 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:42.357034 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6e4f3b7b-d56d-4c99-8a06-76fc2c77cca8 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:43.163239 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6e4f3b7b-d56d-4c99-8a06-76fc2c77cca8 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:43.177168 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6e4f3b7b-d56d-4c99-8a06-76fc2c77cca8 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/3e1d2587-26db-449e-81cd-677ce4f87a76" status: 200 len: 1268 microversion: 2.1 time: 0.839586 Oct 17 13:41:43.181396 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1011/2016] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:42 2022] GET /compute/v2.1/servers/3e1d2587-26db-449e-81cd-677ce4f87a76 => generated 1268 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:43.190143 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-46c4124e-a1e4-4738-a948-72f99afdc453 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:43.212591 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-46c4124e-a1e4-4738-a948-72f99afdc453 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:43.213505 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-46c4124e-a1e4-4738-a948-72f99afdc453 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '66d121d0b216416592c7048c2a46f625'} {{(pid=127017) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:41:43.223804 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-46c4124e-a1e4-4738-a948-72f99afdc453 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:43.224288 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-46c4124e-a1e4-4738-a948-72f99afdc453 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:43.224726 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-46c4124e-a1e4-4738-a948-72f99afdc453 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:43.231599 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-46c4124e-a1e4-4738-a948-72f99afdc453 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:43.232402 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-46c4124e-a1e4-4738-a948-72f99afdc453 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:43.233127 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-46c4124e-a1e4-4738-a948-72f99afdc453 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:43.413081 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.multi_cell_list [None req-46c4124e-a1e4-4738-a948-72f99afdc453 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127017) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:41:43.469691 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8dcb88b7-4f50-478e-b249-d97e3b812a0d tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:43.485163 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8dcb88b7-4f50-478e-b249-d97e3b812a0d tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253" status: 200 len: 1318 microversion: 2.1 time: 1.587546 Oct 17 13:41:43.486494 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1006/2017] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:41 2022] GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253 => generated 1318 bytes in 1590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:43.491427 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ef7dd3f5-3359-4339-9dfa-f609e0d1e256 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:43.500160 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ef7dd3f5-3359-4339-9dfa-f609e0d1e256 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 709d926d-fba5-49ea-84ac-95d8bb018c68] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:43.519235 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ef7dd3f5-3359-4339-9dfa-f609e0d1e256 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:43.519988 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ef7dd3f5-3359-4339-9dfa-f609e0d1e256 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:43.520680 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ef7dd3f5-3359-4339-9dfa-f609e0d1e256 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:43.522458 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ef7dd3f5-3359-4339-9dfa-f609e0d1e256 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:43.523201 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ef7dd3f5-3359-4339-9dfa-f609e0d1e256 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:43.523881 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ef7dd3f5-3359-4339-9dfa-f609e0d1e256 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:43.561916 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-46c4124e-a1e4-4738-a948-72f99afdc453 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1010 microversion: 2.1 time: 0.379129 Oct 17 13:41:43.562509 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1012/2018] 10.222.0.79 () {58 vars in 1196 bytes} [Mon Oct 17 13:41:43 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1010 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:43.575553 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-7074b3bd-04e1-4e4b-9bfb-b3c0b0b9989e req-7f18a67a-0857-4665-87d9-2e6fe1dd05d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58a43093-7550-452c-bd8a-fab84203fca3", "name": "network-vif-plugged", "status": "completed", "tag": "ef5798b1-64dc-43c6-93cc-2aebea1de96a"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:43.599270 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-7074b3bd-04e1-4e4b-9bfb-b3c0b0b9989e req-7f18a67a-0857-4665-87d9-2e6fe1dd05d4 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:43.600148 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-7074b3bd-04e1-4e4b-9bfb-b3c0b0b9989e req-7f18a67a-0857-4665-87d9-2e6fe1dd05d4 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:43.600834 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-7074b3bd-04e1-4e4b-9bfb-b3c0b0b9989e req-7f18a67a-0857-4665-87d9-2e6fe1dd05d4 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:43.625135 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-7074b3bd-04e1-4e4b-9bfb-b3c0b0b9989e req-7f18a67a-0857-4665-87d9-2e6fe1dd05d4 service nova] Creating event network-vif-plugged:ef5798b1-64dc-43c6-93cc-2aebea1de96a for instance 58a43093-7550-452c-bd8a-fab84203fca3 on n-h2-854247-14 Oct 17 13:41:43.636494 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-7074b3bd-04e1-4e4b-9bfb-b3c0b0b9989e req-7f18a67a-0857-4665-87d9-2e6fe1dd05d4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065120 Oct 17 13:41:43.637800 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1013/2019] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:41:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:41:43.644593 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a20f2bd1-41bf-4189-8757-3d1858ea89bb tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:43.645671 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a20f2bd1-41bf-4189-8757-3d1858ea89bb tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:43.652792 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a20f2bd1-41bf-4189-8757-3d1858ea89bb tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:43.653698 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a20f2bd1-41bf-4189-8757-3d1858ea89bb tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:43.654361 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a20f2bd1-41bf-4189-8757-3d1858ea89bb tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:43.655352 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a20f2bd1-41bf-4189-8757-3d1858ea89bb tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:43.656021 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a20f2bd1-41bf-4189-8757-3d1858ea89bb tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:43.656661 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a20f2bd1-41bf-4189-8757-3d1858ea89bb tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:43.873662 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-a20f2bd1-41bf-4189-8757-3d1858ea89bb tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] Lazy-loading 'services' on Instance uuid 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:41:43.918813 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:41:43.921388 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a20f2bd1-41bf-4189-8757-3d1858ea89bb tempest-UnshelveToHostMultiNodesTest-812249846 tempest-UnshelveToHostMultiNodesTest-812249846-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1938 microversion: 2.91 time: 0.282026 Oct 17 13:41:43.968940 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1014/2020] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:41:43 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1938 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:41:43.978371 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-81e53361-c35f-47dd-92b6-b10468f74811 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:43.979409 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-81e53361-c35f-47dd-92b6-b10468f74811 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] [instance: 58a43093-7550-452c-bd8a-fab84203fca3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:43.986613 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-81e53361-c35f-47dd-92b6-b10468f74811 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:43.987459 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-81e53361-c35f-47dd-92b6-b10468f74811 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:43.988185 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-81e53361-c35f-47dd-92b6-b10468f74811 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:43.989214 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-81e53361-c35f-47dd-92b6-b10468f74811 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:43.990624 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-81e53361-c35f-47dd-92b6-b10468f74811 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:43.991383 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-81e53361-c35f-47dd-92b6-b10468f74811 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:44.252086 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ef7dd3f5-3359-4339-9dfa-f609e0d1e256 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:44.261242 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ef7dd3f5-3359-4339-9dfa-f609e0d1e256 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:44.262672 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ef7dd3f5-3359-4339-9dfa-f609e0d1e256 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:44.263930 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ef7dd3f5-3359-4339-9dfa-f609e0d1e256 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68" status: 200 len: 1813 microversion: 2.25 time: 0.776248 Oct 17 13:41:44.280558 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1007/2021] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:41:43 2022] GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68 => generated 1813 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:41:44.288525 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6673c53b-d336-418d-9384-69bd2277809b tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:44.294492 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6673c53b-d336-418d-9384-69bd2277809b tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:44.295479 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6673c53b-d336-418d-9384-69bd2277809b tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Searching by: {'name': '-641343426', 'deleted': False, 'project_id': '66d121d0b216416592c7048c2a46f625'} {{(pid=127016) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:41:44.301438 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6673c53b-d336-418d-9384-69bd2277809b tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:44.302228 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6673c53b-d336-418d-9384-69bd2277809b tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:44.302906 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6673c53b-d336-418d-9384-69bd2277809b tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:44.303735 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6673c53b-d336-418d-9384-69bd2277809b tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:44.304258 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6673c53b-d336-418d-9384-69bd2277809b tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:44.304741 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6673c53b-d336-418d-9384-69bd2277809b tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:44.421138 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.multi_cell_list [None req-6673c53b-d336-418d-9384-69bd2277809b tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127016) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:41:44.496695 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6673c53b-d336-418d-9384-69bd2277809b tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers?name=-641343426" status: 200 len: 345 microversion: 2.1 time: 0.214687 Oct 17 13:41:44.497619 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1008/2022] 10.222.0.79 () {58 vars in 1156 bytes} [Mon Oct 17 13:41:44 2022] GET /compute/v2.1/servers?name=-641343426 => generated 345 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:41:44.502875 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-343130d7-12bc-4614-88f8-769c728aebd4 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:44.505262 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-343130d7-12bc-4614-88f8-769c728aebd4 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:44.517699 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-343130d7-12bc-4614-88f8-769c728aebd4 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:44.518478 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-343130d7-12bc-4614-88f8-769c728aebd4 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:44.519094 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-343130d7-12bc-4614-88f8-769c728aebd4 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:44.520056 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-343130d7-12bc-4614-88f8-769c728aebd4 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:44.520675 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-343130d7-12bc-4614-88f8-769c728aebd4 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:44.521293 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-343130d7-12bc-4614-88f8-769c728aebd4 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:44.561874 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-343130d7-12bc-4614-88f8-769c728aebd4 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:41:44.691611 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-343130d7-12bc-4614-88f8-769c728aebd4 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "DELETE /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 204 len: 0 microversion: 2.91 time: 0.192435 Oct 17 13:41:44.695227 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1009/2023] 10.222.0.79 () {60 vars in 1280 bytes} [Mon Oct 17 13:41:44 2022] DELETE /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:41:44.700508 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d80ccb93-2450-4169-882a-7260dda79598 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:44.701224 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d80ccb93-2450-4169-882a-7260dda79598 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 3e1d2587-26db-449e-81cd-677ce4f87a76] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:44.714083 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d80ccb93-2450-4169-882a-7260dda79598 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:44.714579 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d80ccb93-2450-4169-882a-7260dda79598 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:44.715012 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d80ccb93-2450-4169-882a-7260dda79598 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:44.715754 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d80ccb93-2450-4169-882a-7260dda79598 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:44.716207 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d80ccb93-2450-4169-882a-7260dda79598 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:44.716632 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d80ccb93-2450-4169-882a-7260dda79598 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:44.905366 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-81e53361-c35f-47dd-92b6-b10468f74811 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185235bc4e3245fc8d92b7e4bff6cbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c0147c5fae4017810887843b0afaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:44.914324 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-81e53361-c35f-47dd-92b6-b10468f74811 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "GET /compute/v2.1/servers/58a43093-7550-452c-bd8a-fab84203fca3" status: 200 len: 1316 microversion: 2.1 time: 0.944131 Oct 17 13:41:44.914946 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1015/2024] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:43 2022] GET /compute/v2.1/servers/58a43093-7550-452c-bd8a-fab84203fca3 => generated 1316 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:44.930645 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e5b38d43-6c43-4d36-b43b-cfcad4b9d34c tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:44.940853 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e5b38d43-6c43-4d36-b43b-cfcad4b9d34c tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:44.948009 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e5b38d43-6c43-4d36-b43b-cfcad4b9d34c tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '66d121d0b216416592c7048c2a46f625'} {{(pid=127017) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:41:44.960644 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e5b38d43-6c43-4d36-b43b-cfcad4b9d34c tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:44.961759 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e5b38d43-6c43-4d36-b43b-cfcad4b9d34c tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:44.962208 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e5b38d43-6c43-4d36-b43b-cfcad4b9d34c tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:44.962952 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e5b38d43-6c43-4d36-b43b-cfcad4b9d34c tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:44.963465 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e5b38d43-6c43-4d36-b43b-cfcad4b9d34c tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:44.970098 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e5b38d43-6c43-4d36-b43b-cfcad4b9d34c tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:45.152943 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.multi_cell_list [None req-e5b38d43-6c43-4d36-b43b-cfcad4b9d34c tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127017) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:41:45.218681 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e5b38d43-6c43-4d36-b43b-cfcad4b9d34c tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1010 microversion: 2.1 time: 0.302597 Oct 17 13:41:45.219928 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1016/2025] 10.222.0.79 () {58 vars in 1154 bytes} [Mon Oct 17 13:41:44 2022] GET /compute/v2.1/servers?name=-instance => generated 1010 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:45.226998 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-93d0d88a-ce2b-4b3c-a065-a079896aab27 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:45.227926 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-93d0d88a-ce2b-4b3c-a065-a079896aab27 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9044674d-a793-46c2-b3ec-e9377b30f253] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:45.235231 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-93d0d88a-ce2b-4b3c-a065-a079896aab27 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:45.236238 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-93d0d88a-ce2b-4b3c-a065-a079896aab27 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:45.236700 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-93d0d88a-ce2b-4b3c-a065-a079896aab27 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:45.237445 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-93d0d88a-ce2b-4b3c-a065-a079896aab27 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:45.237917 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-93d0d88a-ce2b-4b3c-a065-a079896aab27 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:45.238350 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-93d0d88a-ce2b-4b3c-a065-a079896aab27 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:45.490413 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d80ccb93-2450-4169-882a-7260dda79598 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:45.499629 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:41:45.503157 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d80ccb93-2450-4169-882a-7260dda79598 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/3e1d2587-26db-449e-81cd-677ce4f87a76" status: 200 len: 1308 microversion: 2.1 time: 0.809379 Oct 17 13:41:45.504199 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1010/2026] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:44 2022] GET /compute/v2.1/servers/3e1d2587-26db-449e-81cd-677ce4f87a76 => generated 1308 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:45.509427 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4befc145-7e5f-4c21-bb69-f6c23cb5d1c0 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:45.514042 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4befc145-7e5f-4c21-bb69-f6c23cb5d1c0 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:45.522348 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4befc145-7e5f-4c21-bb69-f6c23cb5d1c0 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:45.523094 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4befc145-7e5f-4c21-bb69-f6c23cb5d1c0 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:45.523764 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4befc145-7e5f-4c21-bb69-f6c23cb5d1c0 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:45.524654 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4befc145-7e5f-4c21-bb69-f6c23cb5d1c0 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:45.525275 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4befc145-7e5f-4c21-bb69-f6c23cb5d1c0 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:45.525903 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4befc145-7e5f-4c21-bb69-f6c23cb5d1c0 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:45.684241 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4befc145-7e5f-4c21-bb69-f6c23cb5d1c0 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:45.697728 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4befc145-7e5f-4c21-bb69-f6c23cb5d1c0 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:45.701087 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4befc145-7e5f-4c21-bb69-f6c23cb5d1c0 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38372f861f1649ac99de9fdc82648e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c28b94c6334be0aa70c50b06b10e6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:45.707333 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:41:45.712035 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4befc145-7e5f-4c21-bb69-f6c23cb5d1c0 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 200 len: 1537 microversion: 2.91 time: 0.206116 Oct 17 13:41:45.713650 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1011/2027] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:41:45 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 1537 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:41:45.719242 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-2640ffe2-ce41-4c1c-8c4f-6f104d0d63a1 req-1d987539-2e49-4035-90ab-b83ed98c3d19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b05d2fa3-d231-4842-a47b-26aa317ccaa3", "name": "network-vif-deleted", "tag": "e6d816ac-9228-42e4-83a0-1b8d95fc766f"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:45.720509 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-93d0d88a-ce2b-4b3c-a065-a079896aab27 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:45.728663 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-93d0d88a-ce2b-4b3c-a065-a079896aab27 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253" status: 200 len: 1318 microversion: 2.1 time: 0.507540 Oct 17 13:41:45.731705 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-2640ffe2-ce41-4c1c-8c4f-6f104d0d63a1 req-1d987539-2e49-4035-90ab-b83ed98c3d19 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:45.732448 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-2640ffe2-ce41-4c1c-8c4f-6f104d0d63a1 req-1d987539-2e49-4035-90ab-b83ed98c3d19 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:45.733120 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1017/2028] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:45 2022] GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253 => generated 1318 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:45.745206 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-43bd109c-4736-4528-9f82-3bf0bd46f674 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-886596058", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "bf3e08f9-cf8f-442c-a23e-8c240ed74c72"}], "security_groups": [{"name": "tempest-securitygroup--94096881"}], "key_name": "tempest-keypair-1687806208", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:45.747204 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-2640ffe2-ce41-4c1c-8c4f-6f104d0d63a1 req-1d987539-2e49-4035-90ab-b83ed98c3d19 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:45.816710 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-2640ffe2-ce41-4c1c-8c4f-6f104d0d63a1 req-1d987539-2e49-4035-90ab-b83ed98c3d19 service nova] Creating event network-vif-deleted:e6d816ac-9228-42e4-83a0-1b8d95fc766f for instance b05d2fa3-d231-4842-a47b-26aa317ccaa3 on n-h1-854247-14 Oct 17 13:41:45.837493 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-2640ffe2-ce41-4c1c-8c4f-6f104d0d63a1 req-1d987539-2e49-4035-90ab-b83ed98c3d19 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121821 Oct 17 13:41:45.843928 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1012/2029] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:41:45.868913 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9037a536-0d7c-41aa-98e6-7cc462429f4d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:45.879423 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9037a536-0d7c-41aa-98e6-7cc462429f4d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:45.887837 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9037a536-0d7c-41aa-98e6-7cc462429f4d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-64134342', 'deleted': False, 'project_id': '66d121d0b216416592c7048c2a46f625'} {{(pid=127016) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:41:45.908968 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9037a536-0d7c-41aa-98e6-7cc462429f4d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:45.909784 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9037a536-0d7c-41aa-98e6-7cc462429f4d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:45.910447 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9037a536-0d7c-41aa-98e6-7cc462429f4d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:45.911628 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9037a536-0d7c-41aa-98e6-7cc462429f4d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:45.912481 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9037a536-0d7c-41aa-98e6-7cc462429f4d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:45.913082 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9037a536-0d7c-41aa-98e6-7cc462429f4d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:45.997687 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-43bd109c-4736-4528-9f82-3bf0bd46f674 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] validate_networks() for [('bf3e08f9-cf8f-442c-a23e-8c240ed74c72', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:41:46.070227 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.multi_cell_list [None req-9037a536-0d7c-41aa-98e6-7cc462429f4d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127016) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:41:46.177625 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9037a536-0d7c-41aa-98e6-7cc462429f4d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-64134342" status: 200 len: 345 microversion: 2.1 time: 0.331453 Oct 17 13:41:46.178837 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1013/2030] 10.222.0.79 () {58 vars in 1226 bytes} [Mon Oct 17 13:41:45 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-64134342 => generated 345 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:41:46.189468 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-282e2e67-1f56-41fe-bd09-28186051ab85 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:46.190727 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-282e2e67-1f56-41fe-bd09-28186051ab85 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 709d926d-fba5-49ea-84ac-95d8bb018c68] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:46.200895 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-282e2e67-1f56-41fe-bd09-28186051ab85 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:46.201631 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-282e2e67-1f56-41fe-bd09-28186051ab85 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:46.202538 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-282e2e67-1f56-41fe-bd09-28186051ab85 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:46.203534 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-282e2e67-1f56-41fe-bd09-28186051ab85 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:46.204229 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-282e2e67-1f56-41fe-bd09-28186051ab85 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:46.205005 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-282e2e67-1f56-41fe-bd09-28186051ab85 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:46.870888 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-282e2e67-1f56-41fe-bd09-28186051ab85 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:46.881183 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-282e2e67-1f56-41fe-bd09-28186051ab85 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:46.883663 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-282e2e67-1f56-41fe-bd09-28186051ab85 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:46.885134 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-282e2e67-1f56-41fe-bd09-28186051ab85 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68" status: 200 len: 1813 microversion: 2.25 time: 0.705019 Oct 17 13:41:46.886047 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1014/2031] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:41:46 2022] GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68 => generated 1813 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:41:46.890931 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-3f55bc33-14c0-4c71-b069-91a12e41f8a3 req-6abbc25c-e3f1-4bfa-8826-b9b54a0029d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e1d2587-26db-449e-81cd-677ce4f87a76", "tag": "396d247b-3b59-4e2c-b01c-d755d6e8254c"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:46.902288 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-3f55bc33-14c0-4c71-b069-91a12e41f8a3 req-6abbc25c-e3f1-4bfa-8826-b9b54a0029d2 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:46.903302 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-3f55bc33-14c0-4c71-b069-91a12e41f8a3 req-6abbc25c-e3f1-4bfa-8826-b9b54a0029d2 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:46.904071 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-3f55bc33-14c0-4c71-b069-91a12e41f8a3 req-6abbc25c-e3f1-4bfa-8826-b9b54a0029d2 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:46.932398 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-3f55bc33-14c0-4c71-b069-91a12e41f8a3 req-6abbc25c-e3f1-4bfa-8826-b9b54a0029d2 service nova] Creating event network-changed:396d247b-3b59-4e2c-b01c-d755d6e8254c for instance 3e1d2587-26db-449e-81cd-677ce4f87a76 on n-h1-854247-14 Oct 17 13:41:46.937683 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-3f55bc33-14c0-4c71-b069-91a12e41f8a3 req-6abbc25c-e3f1-4bfa-8826-b9b54a0029d2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050177 Oct 17 13:41:46.938472 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1015/2032] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:41:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:41:46.945451 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0b37881e-426a-47a0-8ce0-1a01f8748c05 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:46.946304 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0b37881e-426a-47a0-8ce0-1a01f8748c05 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] [instance: 58a43093-7550-452c-bd8a-fab84203fca3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:46.954290 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0b37881e-426a-47a0-8ce0-1a01f8748c05 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:46.955083 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0b37881e-426a-47a0-8ce0-1a01f8748c05 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:46.955817 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0b37881e-426a-47a0-8ce0-1a01f8748c05 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:46.956703 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0b37881e-426a-47a0-8ce0-1a01f8748c05 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:46.957466 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0b37881e-426a-47a0-8ce0-1a01f8748c05 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:46.958147 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0b37881e-426a-47a0-8ce0-1a01f8748c05 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:47.260862 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-43bd109c-4736-4528-9f82-3bf0bd46f674 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Getting quotas for project 358604dd1cf74e5fab262179351d4d98. Resources: dict_keys(['metadata_items']) {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:41:47.270466 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-43bd109c-4736-4528-9f82-3bf0bd46f674 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Getting quotas for user b891d3b774e44de3ad1d3088990f6bd5 and project 358604dd1cf74e5fab262179351d4d98. Resources: dict_keys(['metadata_items']) {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:41:47.284038 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0b37881e-426a-47a0-8ce0-1a01f8748c05 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185235bc4e3245fc8d92b7e4bff6cbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c0147c5fae4017810887843b0afaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:47.297558 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0b37881e-426a-47a0-8ce0-1a01f8748c05 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "GET /compute/v2.1/servers/58a43093-7550-452c-bd8a-fab84203fca3" status: 200 len: 1504 microversion: 2.1 time: 0.356277 Oct 17 13:41:47.299290 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1016/2033] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:46 2022] GET /compute/v2.1/servers/58a43093-7550-452c-bd8a-fab84203fca3 => generated 1504 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:47.310874 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d0647a70-9895-4403-97b4-82b6c33b74f6 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:47.312377 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d0647a70-9895-4403-97b4-82b6c33b74f6 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] [instance: 8938a16d-a198-46b1-92aa-880f0cc290ba] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:47.315398 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-43bd109c-4736-4528-9f82-3bf0bd46f674 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:41:47.316541 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-43bd109c-4736-4528-9f82-3bf0bd46f674 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:41:47.317396 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-43bd109c-4736-4528-9f82-3bf0bd46f674 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:41:47.319029 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-43bd109c-4736-4528-9f82-3bf0bd46f674 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:41:47.319477 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-43bd109c-4736-4528-9f82-3bf0bd46f674 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:41:47.320400 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d0647a70-9895-4403-97b4-82b6c33b74f6 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:47.320870 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d0647a70-9895-4403-97b4-82b6c33b74f6 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:47.321318 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d0647a70-9895-4403-97b4-82b6c33b74f6 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:47.322058 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d0647a70-9895-4403-97b4-82b6c33b74f6 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:47.322489 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d0647a70-9895-4403-97b4-82b6c33b74f6 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:47.323038 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d0647a70-9895-4403-97b4-82b6c33b74f6 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:47.355834 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-43bd109c-4736-4528-9f82-3bf0bd46f674 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:47.356601 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-43bd109c-4736-4528-9f82-3bf0bd46f674 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:47.357209 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-43bd109c-4736-4528-9f82-3bf0bd46f674 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:47.360082 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-43bd109c-4736-4528-9f82-3bf0bd46f674 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:47.360773 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-43bd109c-4736-4528-9f82-3bf0bd46f674 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:47.361934 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-43bd109c-4736-4528-9f82-3bf0bd46f674 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:47.364145 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d0647a70-9895-4403-97b4-82b6c33b74f6 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] [instance: 8938a16d-a198-46b1-92aa-880f0cc290ba] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:41:47.399864 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-43bd109c-4736-4528-9f82-3bf0bd46f674 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Getting quotas for project 358604dd1cf74e5fab262179351d4d98. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:41:47.407443 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-43bd109c-4736-4528-9f82-3bf0bd46f674 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Getting quotas for user b891d3b774e44de3ad1d3088990f6bd5 and project 358604dd1cf74e5fab262179351d4d98. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:41:47.423774 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-43bd109c-4736-4528-9f82-3bf0bd46f674 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:41:47.427150 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-43bd109c-4736-4528-9f82-3bf0bd46f674 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] [instance: 95418c39-6c0a-444e-93b4-4a90b31f3034] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:41:47.533868 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d0647a70-9895-4403-97b4-82b6c33b74f6 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "DELETE /compute/v2.1/servers/8938a16d-a198-46b1-92aa-880f0cc290ba" status: 204 len: 0 microversion: 2.1 time: 0.232988 Oct 17 13:41:47.535101 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1017/2034] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:41:47 2022] DELETE /compute/v2.1/servers/8938a16d-a198-46b1-92aa-880f0cc290ba => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:41:47.545349 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ed12c246-ec84-4878-810e-01a87449db02 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:47.546357 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ed12c246-ec84-4878-810e-01a87449db02 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 3e1d2587-26db-449e-81cd-677ce4f87a76] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:47.564545 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-43bd109c-4736-4528-9f82-3bf0bd46f674 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.830068 Oct 17 13:41:47.574811 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ed12c246-ec84-4878-810e-01a87449db02 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:47.575363 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ed12c246-ec84-4878-810e-01a87449db02 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:47.575808 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ed12c246-ec84-4878-810e-01a87449db02 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:47.576522 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ed12c246-ec84-4878-810e-01a87449db02 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:47.577964 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1018/2035] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:41:45 2022] POST /compute/v2.1/servers => generated 407 bytes in 1844 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:41:47.583536 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4efe8277-5483-439d-a9d3-d0e0ed6e332c tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:47.583656 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4efe8277-5483-439d-a9d3-d0e0ed6e332c tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9044674d-a793-46c2-b3ec-e9377b30f253] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:47.592036 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ed12c246-ec84-4878-810e-01a87449db02 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:47.592036 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ed12c246-ec84-4878-810e-01a87449db02 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:47.594200 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4efe8277-5483-439d-a9d3-d0e0ed6e332c tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:47.594688 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4efe8277-5483-439d-a9d3-d0e0ed6e332c tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:47.595130 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4efe8277-5483-439d-a9d3-d0e0ed6e332c tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:47.595889 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4efe8277-5483-439d-a9d3-d0e0ed6e332c tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:47.596346 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4efe8277-5483-439d-a9d3-d0e0ed6e332c tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:47.596773 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4efe8277-5483-439d-a9d3-d0e0ed6e332c tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:47.959788 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ed12c246-ec84-4878-810e-01a87449db02 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:47.970860 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ed12c246-ec84-4878-810e-01a87449db02 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/3e1d2587-26db-449e-81cd-677ce4f87a76" status: 200 len: 1308 microversion: 2.1 time: 0.433985 Oct 17 13:41:47.972207 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1018/2036] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:47 2022] GET /compute/v2.1/servers/3e1d2587-26db-449e-81cd-677ce4f87a76 => generated 1308 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:47.977906 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8d888e51-1b87-4b8e-aef7-887c40e5e555 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:47.978535 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8d888e51-1b87-4b8e-aef7-887c40e5e555 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] [instance: 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:47.986967 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8d888e51-1b87-4b8e-aef7-887c40e5e555 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:47.987574 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8d888e51-1b87-4b8e-aef7-887c40e5e555 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:47.987933 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8d888e51-1b87-4b8e-aef7-887c40e5e555 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:47.988786 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8d888e51-1b87-4b8e-aef7-887c40e5e555 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:47.989189 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8d888e51-1b87-4b8e-aef7-887c40e5e555 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:47.989603 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8d888e51-1b87-4b8e-aef7-887c40e5e555 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:48.008537 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-8d888e51-1b87-4b8e-aef7-887c40e5e555 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] HTTP exception thrown: Instance 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 could not be found. Oct 17 13:41:48.010973 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8d888e51-1b87-4b8e-aef7-887c40e5e555 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Request method failure captured: Oct 17 13:41:48.010973 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 HTTP/1.1 Oct 17 13:41:48.010973 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:41:48.010973 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:41:48.010973 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:41:48.010973 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:41:48.010973 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:41:48.010973 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:41:48.010973 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:41:48.010973 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:41:48.010973 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVriMrMrEJEMVYxrqfK6w77gSziS8fjtFBZtetpGCeJFVy0Ow94yZ6ouN43t6Z_nSOy6FI6Vry6qeytjG6zACpy-uJ50oZ5TUWwyqvgU-4cdj3-7JZdM3cBUE7rpYlD_bPmgoiPkLINk4ovnC-OHE2UTbl694F4qfoOouAlrtPkpa8U Oct 17 13:41:48.010973 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:41:48.010973 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:41:48.010973 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:41:48.010973 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:41:48.010973 n-d-854247-14 devstack@n-api.service[127016]: X-Openstack-Nova-Api-Version: 2.91 Oct 17 13:41:48.010973 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:41:48.010973 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:41:48.010973 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 94c28b94c6334be0aa70c50b06b10e6e Oct 17 13:41:48.010973 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-739474885 Oct 17 13:41:48.010973 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:41:48.010973 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:41:48.010973 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/94c28b94c6334be0aa70c50b06b10e6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/94c28b94c6334be0aa70c50b06b10e6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/94c28b94c6334be0aa70c50b06b10e6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_94c28b94c6334be0aa70c50b06b10e6e", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:41:48.010973 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-739474885 Oct 17 13:41:48.010973 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 94c28b94c6334be0aa70c50b06b10e6e Oct 17 13:41:48.010973 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-739474885 Oct 17 13:41:48.010973 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-UnshelveToHostMultiNodesTest-739474885-project Oct 17 13:41:48.010973 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:41:48.010973 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:41:48.010973 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 38372f861f1649ac99de9fdc82648e76 Oct 17 13:41:48.010973 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-739474885-project Oct 17 13:41:48.010973 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:41:48.010973 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 could not be found. Oct 17 13:41:48.010973 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '48cd9c0a-8ef0-4f45-8e2a-52f68da41c57'} Oct 17 13:41:48.010973 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:41:48.010973 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:48.010973 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:41:48.010973 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:41:48.010973 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:41:48.010973 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:41:48.010973 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:41:48.010973 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:41:48.010973 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:41:48.010973 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:41:48.010973 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 could not be found. Oct 17 13:41:48.010973 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:41:48.010973 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:48.010973 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:41:48.010973 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:48.010973 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:48.010973 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:48.010973 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:41:48.010973 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:41:48.010973 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:41:48.010973 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:41:48.010973 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:41:48.010973 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:41:48.010973 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:41:48.010973 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:41:48.010973 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:41:48.010973 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:41:48.010973 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 could not be found. Oct 17 13:41:48.010973 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:41:48.010973 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:48.017239 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:41:48.017239 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:48.017239 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:48.017239 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:48.017239 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:41:48.017239 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:41:48.017239 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 could not be found. Oct 17 13:41:48.017239 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:41:48.019063 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8d888e51-1b87-4b8e-aef7-887c40e5e555 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] Returning 404 to user: Instance 48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:41:48.020112 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8d888e51-1b87-4b8e-aef7-887c40e5e555 tempest-UnshelveToHostMultiNodesTest-739474885 tempest-UnshelveToHostMultiNodesTest-739474885-project] 10.222.0.79 "GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57" status: 404 len: 111 microversion: 2.91 time: 0.046548 Oct 17 13:41:48.020749 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1019/2037] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:41:47 2022] GET /compute/v2.1/servers/48cd9c0a-8ef0-4f45-8e2a-52f68da41c57 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:41:48.028233 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-06be28e6-ccd4-44b5-93f1-17443677da6c req-f66a87e2-286f-49c2-af1a-cb7eb80a31d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9044674d-a793-46c2-b3ec-e9377b30f253", "name": "network-vif-plugged", "status": "completed", "tag": "b76e3be7-554d-4b8d-924c-9c699342cdd0"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:48.040768 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-06be28e6-ccd4-44b5-93f1-17443677da6c req-f66a87e2-286f-49c2-af1a-cb7eb80a31d2 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:48.041670 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-06be28e6-ccd4-44b5-93f1-17443677da6c req-f66a87e2-286f-49c2-af1a-cb7eb80a31d2 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:48.041877 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-06be28e6-ccd4-44b5-93f1-17443677da6c req-f66a87e2-286f-49c2-af1a-cb7eb80a31d2 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:48.056735 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-06be28e6-ccd4-44b5-93f1-17443677da6c req-f66a87e2-286f-49c2-af1a-cb7eb80a31d2 service nova] Creating event network-vif-plugged:b76e3be7-554d-4b8d-924c-9c699342cdd0 for instance 9044674d-a793-46c2-b3ec-e9377b30f253 on n-h2-854247-14 Oct 17 13:41:48.063305 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-06be28e6-ccd4-44b5-93f1-17443677da6c req-f66a87e2-286f-49c2-af1a-cb7eb80a31d2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041089 Oct 17 13:41:48.064515 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1020/2038] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:41:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:41:48.071229 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d88ebe24-4393-436d-aaa8-a9317cc5f05f tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-20813559"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:48.072104 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d88ebe24-4393-436d-aaa8-a9317cc5f05f tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] [instance: 58a43093-7550-452c-bd8a-fab84203fca3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:48.080004 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d88ebe24-4393-436d-aaa8-a9317cc5f05f tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:48.080350 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d88ebe24-4393-436d-aaa8-a9317cc5f05f tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:48.080791 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d88ebe24-4393-436d-aaa8-a9317cc5f05f tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:48.082054 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d88ebe24-4393-436d-aaa8-a9317cc5f05f tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:48.082542 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d88ebe24-4393-436d-aaa8-a9317cc5f05f tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:48.082971 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d88ebe24-4393-436d-aaa8-a9317cc5f05f tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:48.178401 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4efe8277-5483-439d-a9d3-d0e0ed6e332c tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:48.190453 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4efe8277-5483-439d-a9d3-d0e0ed6e332c tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253" status: 200 len: 1318 microversion: 2.1 time: 0.611226 Oct 17 13:41:48.194158 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1019/2039] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:47 2022] GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253 => generated 1318 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:48.215613 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-68eeed1d-baca-4c9d-bae4-8476b531ccd6 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:48.216324 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-68eeed1d-baca-4c9d-bae4-8476b531ccd6 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] [instance: 8938a16d-a198-46b1-92aa-880f0cc290ba] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:48.236254 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-68eeed1d-baca-4c9d-bae4-8476b531ccd6 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:48.238166 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-68eeed1d-baca-4c9d-bae4-8476b531ccd6 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:48.240846 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-68eeed1d-baca-4c9d-bae4-8476b531ccd6 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:48.241934 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-68eeed1d-baca-4c9d-bae4-8476b531ccd6 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:48.242414 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-68eeed1d-baca-4c9d-bae4-8476b531ccd6 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:48.242852 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-68eeed1d-baca-4c9d-bae4-8476b531ccd6 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:48.601141 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.network.security_group_api [None req-d88ebe24-4393-436d-aaa8-a9317cc5f05f tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Adding security group c8e9b6be-fa85-4b27-b1e7-4b0885388437 to port ef5798b1-64dc-43c6-93cc-2aebea1de96a Oct 17 13:41:48.713518 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-68eeed1d-baca-4c9d-bae4-8476b531ccd6 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:48.738138 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-68eeed1d-baca-4c9d-bae4-8476b531ccd6 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers/8938a16d-a198-46b1-92aa-880f0cc290ba" status: 200 len: 1519 microversion: 2.1 time: 0.541715 Oct 17 13:41:48.739273 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1020/2040] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:48 2022] GET /compute/v2.1/servers/8938a16d-a198-46b1-92aa-880f0cc290ba => generated 1519 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:48.749058 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8e98755b-1111-463c-8d15-b96efd8cb276 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:48.753190 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8e98755b-1111-463c-8d15-b96efd8cb276 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] [instance: 95418c39-6c0a-444e-93b4-4a90b31f3034] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:48.773498 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8e98755b-1111-463c-8d15-b96efd8cb276 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:48.777183 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8e98755b-1111-463c-8d15-b96efd8cb276 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:48.778497 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8e98755b-1111-463c-8d15-b96efd8cb276 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:48.780199 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8e98755b-1111-463c-8d15-b96efd8cb276 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:48.782777 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8e98755b-1111-463c-8d15-b96efd8cb276 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:48.783579 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8e98755b-1111-463c-8d15-b96efd8cb276 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:48.926631 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8e98755b-1111-463c-8d15-b96efd8cb276 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b891d3b774e44de3ad1d3088990f6bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358604dd1cf74e5fab262179351d4d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:48.943738 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8e98755b-1111-463c-8d15-b96efd8cb276 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] 10.222.0.79 "GET /compute/v2.1/servers/95418c39-6c0a-444e-93b4-4a90b31f3034" status: 200 len: 1281 microversion: 2.1 time: 0.202570 Oct 17 13:41:48.944698 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1021/2041] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:48 2022] GET /compute/v2.1/servers/95418c39-6c0a-444e-93b4-4a90b31f3034 => generated 1281 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:48.951702 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a1fbea6d-7356-4937-aecf-644ae5043f26 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:48.952387 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a1fbea6d-7356-4937-aecf-644ae5043f26 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 709d926d-fba5-49ea-84ac-95d8bb018c68] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:48.959087 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a1fbea6d-7356-4937-aecf-644ae5043f26 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:48.960077 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a1fbea6d-7356-4937-aecf-644ae5043f26 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:48.960686 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a1fbea6d-7356-4937-aecf-644ae5043f26 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:48.961654 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a1fbea6d-7356-4937-aecf-644ae5043f26 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:48.962266 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a1fbea6d-7356-4937-aecf-644ae5043f26 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:48.963345 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a1fbea6d-7356-4937-aecf-644ae5043f26 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:49.273895 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a1fbea6d-7356-4937-aecf-644ae5043f26 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:49.287281 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a1fbea6d-7356-4937-aecf-644ae5043f26 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:49.298047 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a1fbea6d-7356-4937-aecf-644ae5043f26 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:49.299783 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a1fbea6d-7356-4937-aecf-644ae5043f26 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68" status: 200 len: 1813 microversion: 2.25 time: 0.354005 Oct 17 13:41:49.302125 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1022/2042] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:41:48 2022] GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68 => generated 1813 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:41:49.312694 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7fbdce98-9cf5-40fc-b10b-d60395f194d9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:49.313985 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7fbdce98-9cf5-40fc-b10b-d60395f194d9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 3e1d2587-26db-449e-81cd-677ce4f87a76] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:49.322411 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7fbdce98-9cf5-40fc-b10b-d60395f194d9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:49.324264 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7fbdce98-9cf5-40fc-b10b-d60395f194d9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:49.324928 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7fbdce98-9cf5-40fc-b10b-d60395f194d9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:49.327044 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7fbdce98-9cf5-40fc-b10b-d60395f194d9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:49.328468 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7fbdce98-9cf5-40fc-b10b-d60395f194d9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:49.331756 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7fbdce98-9cf5-40fc-b10b-d60395f194d9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:49.858700 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d88ebe24-4393-436d-aaa8-a9317cc5f05f tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "POST /compute/v2.1/servers/58a43093-7550-452c-bd8a-fab84203fca3/action" status: 202 len: 0 microversion: 2.1 time: 1.792841 Oct 17 13:41:49.859687 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1021/2043] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:41:48 2022] POST /compute/v2.1/servers/58a43093-7550-452c-bd8a-fab84203fca3/action => generated 0 bytes in 1794 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:41:49.866889 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-48d53124-14bd-40cb-886d-f4cffde3cf4f tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:49.867635 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-48d53124-14bd-40cb-886d-f4cffde3cf4f tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9044674d-a793-46c2-b3ec-e9377b30f253] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:49.877846 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7fbdce98-9cf5-40fc-b10b-d60395f194d9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:49.889000 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48d53124-14bd-40cb-886d-f4cffde3cf4f tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:49.891073 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48d53124-14bd-40cb-886d-f4cffde3cf4f tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:49.892494 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48d53124-14bd-40cb-886d-f4cffde3cf4f tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:49.894532 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48d53124-14bd-40cb-886d-f4cffde3cf4f tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:49.896938 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48d53124-14bd-40cb-886d-f4cffde3cf4f tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:49.900288 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7fbdce98-9cf5-40fc-b10b-d60395f194d9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/3e1d2587-26db-449e-81cd-677ce4f87a76" status: 200 len: 1308 microversion: 2.1 time: 0.594400 Oct 17 13:41:49.903833 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1023/2044] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:49 2022] GET /compute/v2.1/servers/3e1d2587-26db-449e-81cd-677ce4f87a76 => generated 1308 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:49.911028 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48d53124-14bd-40cb-886d-f4cffde3cf4f tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:49.912673 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-26eb2eb0-ca30-40a2-8443-f20f0458d3bd tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:49.913560 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-26eb2eb0-ca30-40a2-8443-f20f0458d3bd tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] [instance: 8938a16d-a198-46b1-92aa-880f0cc290ba] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:49.922337 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-26eb2eb0-ca30-40a2-8443-f20f0458d3bd tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:49.923208 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-26eb2eb0-ca30-40a2-8443-f20f0458d3bd tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:49.924211 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-26eb2eb0-ca30-40a2-8443-f20f0458d3bd tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:49.943034 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-26eb2eb0-ca30-40a2-8443-f20f0458d3bd tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:49.946189 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-26eb2eb0-ca30-40a2-8443-f20f0458d3bd tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:49.948103 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-26eb2eb0-ca30-40a2-8443-f20f0458d3bd tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:50.462356 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-48d53124-14bd-40cb-886d-f4cffde3cf4f tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:50.470732 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-48d53124-14bd-40cb-886d-f4cffde3cf4f tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253" status: 200 len: 1318 microversion: 2.1 time: 0.609985 Oct 17 13:41:50.477839 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1022/2045] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:49 2022] GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253 => generated 1318 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:50.492604 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f427c955-e995-4aa6-ae86-214f7f20dd8e tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2089555488"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:50.493171 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f427c955-e995-4aa6-ae86-214f7f20dd8e tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] [instance: 58a43093-7550-452c-bd8a-fab84203fca3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:50.501150 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f427c955-e995-4aa6-ae86-214f7f20dd8e tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:50.512114 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f427c955-e995-4aa6-ae86-214f7f20dd8e tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:50.512839 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f427c955-e995-4aa6-ae86-214f7f20dd8e tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:50.513780 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f427c955-e995-4aa6-ae86-214f7f20dd8e tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:50.514434 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f427c955-e995-4aa6-ae86-214f7f20dd8e tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:50.515034 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f427c955-e995-4aa6-ae86-214f7f20dd8e tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:50.538310 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-26eb2eb0-ca30-40a2-8443-f20f0458d3bd tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:50.543632 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=100 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:41:50.555734 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-26eb2eb0-ca30-40a2-8443-f20f0458d3bd tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers/8938a16d-a198-46b1-92aa-880f0cc290ba" status: 200 len: 1519 microversion: 2.1 time: 0.648855 Oct 17 13:41:50.558098 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1024/2046] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:49 2022] GET /compute/v2.1/servers/8938a16d-a198-46b1-92aa-880f0cc290ba => generated 1519 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:50.564890 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-724fb383-a37c-48ab-82f6-c12a076e431c req-2167fc8f-b6b9-45b1-acb1-fb823181f1bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58a43093-7550-452c-bd8a-fab84203fca3", "tag": "ef5798b1-64dc-43c6-93cc-2aebea1de96a"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:50.594953 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-724fb383-a37c-48ab-82f6-c12a076e431c req-2167fc8f-b6b9-45b1-acb1-fb823181f1bd service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:50.596782 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-724fb383-a37c-48ab-82f6-c12a076e431c req-2167fc8f-b6b9-45b1-acb1-fb823181f1bd service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:50.597394 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-724fb383-a37c-48ab-82f6-c12a076e431c req-2167fc8f-b6b9-45b1-acb1-fb823181f1bd service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:50.621267 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-724fb383-a37c-48ab-82f6-c12a076e431c req-2167fc8f-b6b9-45b1-acb1-fb823181f1bd service nova] Creating event network-changed:ef5798b1-64dc-43c6-93cc-2aebea1de96a for instance 58a43093-7550-452c-bd8a-fab84203fca3 on n-h2-854247-14 Oct 17 13:41:50.632049 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-724fb383-a37c-48ab-82f6-c12a076e431c req-2167fc8f-b6b9-45b1-acb1-fb823181f1bd service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070371 Oct 17 13:41:50.634048 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1025/2047] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:41:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:41:50.650984 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-00f39034-53cc-481c-9e2e-584efdac4820 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:50.659529 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-00f39034-53cc-481c-9e2e-584efdac4820 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] [instance: 95418c39-6c0a-444e-93b4-4a90b31f3034] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:50.667700 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-00f39034-53cc-481c-9e2e-584efdac4820 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:50.670700 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-00f39034-53cc-481c-9e2e-584efdac4820 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:50.671419 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-00f39034-53cc-481c-9e2e-584efdac4820 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:50.672350 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-00f39034-53cc-481c-9e2e-584efdac4820 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:50.672978 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-00f39034-53cc-481c-9e2e-584efdac4820 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:50.673598 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-00f39034-53cc-481c-9e2e-584efdac4820 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:51.039309 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-00f39034-53cc-481c-9e2e-584efdac4820 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b891d3b774e44de3ad1d3088990f6bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358604dd1cf74e5fab262179351d4d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:51.053031 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-00f39034-53cc-481c-9e2e-584efdac4820 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] 10.222.0.79 "GET /compute/v2.1/servers/95418c39-6c0a-444e-93b4-4a90b31f3034" status: 200 len: 1335 microversion: 2.1 time: 0.417466 Oct 17 13:41:51.058246 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1026/2048] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:50 2022] GET /compute/v2.1/servers/95418c39-6c0a-444e-93b4-4a90b31f3034 => generated 1335 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:51.069138 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-108243bf-65e2-4ee6-8598-e13c8559b553 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:51.073631 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-108243bf-65e2-4ee6-8598-e13c8559b553 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 709d926d-fba5-49ea-84ac-95d8bb018c68] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:51.092780 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-108243bf-65e2-4ee6-8598-e13c8559b553 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:51.094504 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-108243bf-65e2-4ee6-8598-e13c8559b553 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:51.100210 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-108243bf-65e2-4ee6-8598-e13c8559b553 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:51.101284 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-108243bf-65e2-4ee6-8598-e13c8559b553 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:51.101976 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-108243bf-65e2-4ee6-8598-e13c8559b553 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:51.102807 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-108243bf-65e2-4ee6-8598-e13c8559b553 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:52.020092 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.network.security_group_api [None req-f427c955-e995-4aa6-ae86-214f7f20dd8e tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Adding security group d399e3f5-49d2-4305-8eef-68fdcd2f3967 to port ef5798b1-64dc-43c6-93cc-2aebea1de96a Oct 17 13:41:52.135470 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-108243bf-65e2-4ee6-8598-e13c8559b553 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:52.167052 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-108243bf-65e2-4ee6-8598-e13c8559b553 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:52.170599 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-108243bf-65e2-4ee6-8598-e13c8559b553 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:52.172807 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-108243bf-65e2-4ee6-8598-e13c8559b553 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68" status: 200 len: 1813 microversion: 2.25 time: 1.112370 Oct 17 13:41:52.174321 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1027/2049] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:41:51 2022] GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68 => generated 1813 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:41:52.180258 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-555d6efe-cc82-4262-a3f7-751e5755f28c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:52.181165 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-555d6efe-cc82-4262-a3f7-751e5755f28c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 3e1d2587-26db-449e-81cd-677ce4f87a76] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:52.191714 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-555d6efe-cc82-4262-a3f7-751e5755f28c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:52.192657 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-555d6efe-cc82-4262-a3f7-751e5755f28c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:52.193319 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-555d6efe-cc82-4262-a3f7-751e5755f28c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:52.194808 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-555d6efe-cc82-4262-a3f7-751e5755f28c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:52.195866 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-555d6efe-cc82-4262-a3f7-751e5755f28c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:52.196865 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-555d6efe-cc82-4262-a3f7-751e5755f28c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:53.012936 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-555d6efe-cc82-4262-a3f7-751e5755f28c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:53.023887 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-555d6efe-cc82-4262-a3f7-751e5755f28c tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/3e1d2587-26db-449e-81cd-677ce4f87a76" status: 200 len: 1308 microversion: 2.1 time: 0.847123 Oct 17 13:41:53.026130 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1028/2050] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:52 2022] GET /compute/v2.1/servers/3e1d2587-26db-449e-81cd-677ce4f87a76 => generated 1308 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:53.033035 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-23b4e0e1-b556-4696-8638-dccd4b30adc0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:53.033655 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-23b4e0e1-b556-4696-8638-dccd4b30adc0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9044674d-a793-46c2-b3ec-e9377b30f253] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:53.082824 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-23b4e0e1-b556-4696-8638-dccd4b30adc0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:53.088023 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-23b4e0e1-b556-4696-8638-dccd4b30adc0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:53.091327 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-23b4e0e1-b556-4696-8638-dccd4b30adc0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:53.099392 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-23b4e0e1-b556-4696-8638-dccd4b30adc0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:53.103270 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-23b4e0e1-b556-4696-8638-dccd4b30adc0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:53.108954 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-23b4e0e1-b556-4696-8638-dccd4b30adc0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:53.589737 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-23b4e0e1-b556-4696-8638-dccd4b30adc0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:53.619395 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-23b4e0e1-b556-4696-8638-dccd4b30adc0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253" status: 200 len: 1508 microversion: 2.1 time: 0.591725 Oct 17 13:41:53.621825 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1029/2051] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:53 2022] GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253 => generated 1508 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:53.634153 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5354c9bf-652f-465c-9302-f24f3cd0ee6e tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:53.634810 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5354c9bf-652f-465c-9302-f24f3cd0ee6e tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] [instance: 8938a16d-a198-46b1-92aa-880f0cc290ba] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:53.655242 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5354c9bf-652f-465c-9302-f24f3cd0ee6e tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:53.655781 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5354c9bf-652f-465c-9302-f24f3cd0ee6e tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:53.657008 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5354c9bf-652f-465c-9302-f24f3cd0ee6e tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:53.658127 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5354c9bf-652f-465c-9302-f24f3cd0ee6e tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:53.658754 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5354c9bf-652f-465c-9302-f24f3cd0ee6e tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:53.660219 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5354c9bf-652f-465c-9302-f24f3cd0ee6e tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:53.678048 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-5354c9bf-652f-465c-9302-f24f3cd0ee6e tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] HTTP exception thrown: Instance 8938a16d-a198-46b1-92aa-880f0cc290ba could not be found. Oct 17 13:41:53.680242 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5354c9bf-652f-465c-9302-f24f3cd0ee6e tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Request method failure captured: Oct 17 13:41:53.680242 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/8938a16d-a198-46b1-92aa-880f0cc290ba HTTP/1.1 Oct 17 13:41:53.680242 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:41:53.680242 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:41:53.680242 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:41:53.680242 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:41:53.680242 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:41:53.680242 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:41:53.680242 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:41:53.680242 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:41:53.680242 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVslGtfdVSFrsbyAcibzm0QXeRfl7TdWgYNhhlDyieORwCEkTfFGyTqr2WajwaAPNWK_AwX9JHLnmfr1P3N1cRURlSaeSBTg8P3Vz51fs8eLQdrtDUCemS3C_9thFZYd0WRnVCXSd9OXtGY8dne0GASBJP5SvJ5N5pr9LQSsaCW0nS4 Oct 17 13:41:53.680242 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:41:53.680242 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:41:53.680242 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:41:53.680242 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:41:53.680242 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:41:53.680242 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:41:53.680242 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 66d121d0b216416592c7048c2a46f625 Oct 17 13:41:53.680242 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ListServerFiltersTestJSON-1908686196 Oct 17 13:41:53.680242 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:41:53.680242 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:41:53.680242 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/66d121d0b216416592c7048c2a46f625"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/66d121d0b216416592c7048c2a46f625"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/66d121d0b216416592c7048c2a46f625"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_66d121d0b216416592c7048c2a46f625", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:41:53.680242 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ListServerFiltersTestJSON-1908686196 Oct 17 13:41:53.680242 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 66d121d0b216416592c7048c2a46f625 Oct 17 13:41:53.680242 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1908686196 Oct 17 13:41:53.680242 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ListServerFiltersTestJSON-1908686196-project Oct 17 13:41:53.680242 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:41:53.680242 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:41:53.680242 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: b849e8b87a4b49ffa7ad2dd6e95260aa Oct 17 13:41:53.680242 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ListServerFiltersTestJSON-1908686196-project Oct 17 13:41:53.680242 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:41:53.680242 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 8938a16d-a198-46b1-92aa-880f0cc290ba could not be found. Oct 17 13:41:53.680242 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '8938a16d-a198-46b1-92aa-880f0cc290ba'} Oct 17 13:41:53.680242 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:41:53.680242 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:53.680242 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:41:53.680242 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:41:53.680242 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:41:53.680242 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:41:53.680242 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:41:53.680242 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:41:53.680242 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:41:53.680242 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:41:53.680242 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8938a16d-a198-46b1-92aa-880f0cc290ba could not be found. Oct 17 13:41:53.680242 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:41:53.680242 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:53.680242 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:41:53.680242 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:53.680242 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:53.680242 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:53.680242 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:41:53.680242 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:41:53.680242 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:41:53.680242 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:41:53.680242 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:41:53.680242 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:41:53.680242 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:41:53.680242 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:41:53.680242 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:41:53.680242 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:41:53.680242 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8938a16d-a198-46b1-92aa-880f0cc290ba could not be found. Oct 17 13:41:53.680242 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:41:53.680242 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:53.680242 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:41:53.685902 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:53.685902 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:53.685902 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:53.685902 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:41:53.685902 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:41:53.685902 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8938a16d-a198-46b1-92aa-880f0cc290ba could not be found. Oct 17 13:41:53.685902 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:41:53.688124 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5354c9bf-652f-465c-9302-f24f3cd0ee6e tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Returning 404 to user: Instance 8938a16d-a198-46b1-92aa-880f0cc290ba could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:41:53.689747 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5354c9bf-652f-465c-9302-f24f3cd0ee6e tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers/8938a16d-a198-46b1-92aa-880f0cc290ba" status: 404 len: 111 microversion: 2.1 time: 0.064811 Oct 17 13:41:53.694290 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1030/2052] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:53 2022] GET /compute/v2.1/servers/8938a16d-a198-46b1-92aa-880f0cc290ba => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:41:53.723029 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-71721c81-47e3-4c44-ada9-996c763a6bea tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:53.724362 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-71721c81-47e3-4c44-ada9-996c763a6bea tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] [instance: 95418c39-6c0a-444e-93b4-4a90b31f3034] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:53.743611 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-71721c81-47e3-4c44-ada9-996c763a6bea tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:53.744304 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-71721c81-47e3-4c44-ada9-996c763a6bea tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:53.746372 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-71721c81-47e3-4c44-ada9-996c763a6bea tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:53.751371 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-71721c81-47e3-4c44-ada9-996c763a6bea tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:53.752039 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-71721c81-47e3-4c44-ada9-996c763a6bea tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:53.754791 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-71721c81-47e3-4c44-ada9-996c763a6bea tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:54.260036 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f427c955-e995-4aa6-ae86-214f7f20dd8e tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "POST /compute/v2.1/servers/58a43093-7550-452c-bd8a-fab84203fca3/action" status: 202 len: 0 microversion: 2.1 time: 3.781024 Oct 17 13:41:54.261444 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1023/2053] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:41:50 2022] POST /compute/v2.1/servers/58a43093-7550-452c-bd8a-fab84203fca3/action => generated 0 bytes in 3783 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:41:54.269884 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-772889d7-22b0-4cdc-b006-e3cd30d3024a req-b9e93092-a5f0-4ec5-a1f6-b64ab66fe821 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8938a16d-a198-46b1-92aa-880f0cc290ba", "name": "network-vif-deleted", "tag": "abcefd69-7991-4cf3-8930-d2004d820733"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:54.298074 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-772889d7-22b0-4cdc-b006-e3cd30d3024a req-b9e93092-a5f0-4ec5-a1f6-b64ab66fe821 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:54.302441 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-772889d7-22b0-4cdc-b006-e3cd30d3024a req-b9e93092-a5f0-4ec5-a1f6-b64ab66fe821 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:54.303767 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-772889d7-22b0-4cdc-b006-e3cd30d3024a req-b9e93092-a5f0-4ec5-a1f6-b64ab66fe821 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:54.331980 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-772889d7-22b0-4cdc-b006-e3cd30d3024a req-b9e93092-a5f0-4ec5-a1f6-b64ab66fe821 service nova] Creating event network-vif-deleted:abcefd69-7991-4cf3-8930-d2004d820733 for instance 8938a16d-a198-46b1-92aa-880f0cc290ba on n-h1-854247-14 Oct 17 13:41:54.339661 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-772889d7-22b0-4cdc-b006-e3cd30d3024a req-b9e93092-a5f0-4ec5-a1f6-b64ab66fe821 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076344 Oct 17 13:41:54.341497 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1024/2054] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:41:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:41:54.353014 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-e290f931-5e34-4e07-8242-4a52246135c4 req-21cce3c1-8ea2-457f-b1f9-228672bf5d47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e1d2587-26db-449e-81cd-677ce4f87a76", "name": "network-vif-plugged", "status": "completed", "tag": "396d247b-3b59-4e2c-b01c-d755d6e8254c"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:54.364506 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-71721c81-47e3-4c44-ada9-996c763a6bea tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b891d3b774e44de3ad1d3088990f6bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358604dd1cf74e5fab262179351d4d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:54.365418 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-e290f931-5e34-4e07-8242-4a52246135c4 req-21cce3c1-8ea2-457f-b1f9-228672bf5d47 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:54.366162 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-e290f931-5e34-4e07-8242-4a52246135c4 req-21cce3c1-8ea2-457f-b1f9-228672bf5d47 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:54.366863 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-e290f931-5e34-4e07-8242-4a52246135c4 req-21cce3c1-8ea2-457f-b1f9-228672bf5d47 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:54.372970 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-71721c81-47e3-4c44-ada9-996c763a6bea tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] 10.222.0.79 "GET /compute/v2.1/servers/95418c39-6c0a-444e-93b4-4a90b31f3034" status: 200 len: 1401 microversion: 2.1 time: 0.672232 Oct 17 13:41:54.373563 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1031/2055] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:53 2022] GET /compute/v2.1/servers/95418c39-6c0a-444e-93b4-4a90b31f3034 => generated 1401 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:54.383891 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-e290f931-5e34-4e07-8242-4a52246135c4 req-21cce3c1-8ea2-457f-b1f9-228672bf5d47 service nova] Creating event network-vif-plugged:396d247b-3b59-4e2c-b01c-d755d6e8254c for instance 3e1d2587-26db-449e-81cd-677ce4f87a76 on n-h1-854247-14 Oct 17 13:41:54.389642 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a9f35fa8-4ffd-4676-ad6c-686cc2edff50 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:54.390671 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-e290f931-5e34-4e07-8242-4a52246135c4 req-21cce3c1-8ea2-457f-b1f9-228672bf5d47 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044724 Oct 17 13:41:54.391075 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a9f35fa8-4ffd-4676-ad6c-686cc2edff50 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 709d926d-fba5-49ea-84ac-95d8bb018c68] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:54.393555 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1025/2056] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:41:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:41:54.400275 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a50f823b-06bc-4ba7-9f6b-d0d9e39d0815 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:54.401544 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a50f823b-06bc-4ba7-9f6b-d0d9e39d0815 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9044674d-a793-46c2-b3ec-e9377b30f253] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:54.406426 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a9f35fa8-4ffd-4676-ad6c-686cc2edff50 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:54.406925 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a9f35fa8-4ffd-4676-ad6c-686cc2edff50 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:54.409296 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a50f823b-06bc-4ba7-9f6b-d0d9e39d0815 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:54.410056 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a50f823b-06bc-4ba7-9f6b-d0d9e39d0815 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:54.410734 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a50f823b-06bc-4ba7-9f6b-d0d9e39d0815 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:54.410861 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a9f35fa8-4ffd-4676-ad6c-686cc2edff50 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:54.411607 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a9f35fa8-4ffd-4676-ad6c-686cc2edff50 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:54.412126 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a9f35fa8-4ffd-4676-ad6c-686cc2edff50 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:54.415737 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a9f35fa8-4ffd-4676-ad6c-686cc2edff50 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:54.420118 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a50f823b-06bc-4ba7-9f6b-d0d9e39d0815 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:54.421015 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a50f823b-06bc-4ba7-9f6b-d0d9e39d0815 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:54.421696 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a50f823b-06bc-4ba7-9f6b-d0d9e39d0815 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:54.884038 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a9f35fa8-4ffd-4676-ad6c-686cc2edff50 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:54.901492 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a50f823b-06bc-4ba7-9f6b-d0d9e39d0815 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:54.922141 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a50f823b-06bc-4ba7-9f6b-d0d9e39d0815 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253" status: 200 len: 1508 microversion: 2.1 time: 0.526329 Oct 17 13:41:54.922833 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1026/2057] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:54 2022] GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253 => generated 1508 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:54.938223 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a9f35fa8-4ffd-4676-ad6c-686cc2edff50 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:54.943035 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-46fc07b4-6ed4-4aa9-b5e5-678f729a086a tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:54.943403 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a9f35fa8-4ffd-4676-ad6c-686cc2edff50 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:54.945463 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-46fc07b4-6ed4-4aa9-b5e5-678f729a086a tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] [instance: d30452eb-38cd-413a-9369-f60aad1d31bb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:54.948060 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a9f35fa8-4ffd-4676-ad6c-686cc2edff50 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68" status: 200 len: 1813 microversion: 2.25 time: 0.572514 Oct 17 13:41:54.948889 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1032/2058] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:41:54 2022] GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68 => generated 1813 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:41:54.963702 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-46fc07b4-6ed4-4aa9-b5e5-678f729a086a tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:54.967899 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-46fc07b4-6ed4-4aa9-b5e5-678f729a086a tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:54.968564 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-46fc07b4-6ed4-4aa9-b5e5-678f729a086a tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:54.968703 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-4cbca4f2-1490-4493-becf-7254b7d05e5a req-68582d31-b997-45cf-8959-ce04dcc4afb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95418c39-6c0a-444e-93b4-4a90b31f3034", "tag": "6ebf3968-13ef-4f4d-8666-1d89782149bf"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:54.971683 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-46fc07b4-6ed4-4aa9-b5e5-678f729a086a tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:54.972160 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-46fc07b4-6ed4-4aa9-b5e5-678f729a086a tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:54.974855 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-46fc07b4-6ed4-4aa9-b5e5-678f729a086a tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:54.997240 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-4cbca4f2-1490-4493-becf-7254b7d05e5a req-68582d31-b997-45cf-8959-ce04dcc4afb7 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:54.997871 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-4cbca4f2-1490-4493-becf-7254b7d05e5a req-68582d31-b997-45cf-8959-ce04dcc4afb7 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:54.998781 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-4cbca4f2-1490-4493-becf-7254b7d05e5a req-68582d31-b997-45cf-8959-ce04dcc4afb7 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:55.052881 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-4cbca4f2-1490-4493-becf-7254b7d05e5a req-68582d31-b997-45cf-8959-ce04dcc4afb7 service nova] Creating event network-changed:6ebf3968-13ef-4f4d-8666-1d89782149bf for instance 95418c39-6c0a-444e-93b4-4a90b31f3034 on n-h1-854247-14 Oct 17 13:41:55.071149 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-46fc07b4-6ed4-4aa9-b5e5-678f729a086a tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] [instance: d30452eb-38cd-413a-9369-f60aad1d31bb] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:41:55.074713 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-4cbca4f2-1490-4493-becf-7254b7d05e5a req-68582d31-b997-45cf-8959-ce04dcc4afb7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124233 Oct 17 13:41:55.075375 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1033/2059] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:41:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:41:55.083305 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5dd0cf9a-8411-4ece-9bab-3de21020f9d0 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:55.084065 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5dd0cf9a-8411-4ece-9bab-3de21020f9d0 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 3e1d2587-26db-449e-81cd-677ce4f87a76] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:55.094086 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5dd0cf9a-8411-4ece-9bab-3de21020f9d0 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:55.095147 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5dd0cf9a-8411-4ece-9bab-3de21020f9d0 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:55.095777 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5dd0cf9a-8411-4ece-9bab-3de21020f9d0 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:55.096946 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5dd0cf9a-8411-4ece-9bab-3de21020f9d0 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:55.097813 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5dd0cf9a-8411-4ece-9bab-3de21020f9d0 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:55.098457 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5dd0cf9a-8411-4ece-9bab-3de21020f9d0 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:55.237907 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-46fc07b4-6ed4-4aa9-b5e5-678f729a086a tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "DELETE /compute/v2.1/servers/d30452eb-38cd-413a-9369-f60aad1d31bb" status: 204 len: 0 microversion: 2.1 time: 0.308285 Oct 17 13:41:55.244413 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1027/2060] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:41:54 2022] DELETE /compute/v2.1/servers/d30452eb-38cd-413a-9369-f60aad1d31bb => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:41:55.258512 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-185e27ba-bd76-4773-8443-081d3fc7e4a3 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:55.259459 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-185e27ba-bd76-4773-8443-081d3fc7e4a3 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] [instance: 58a43093-7550-452c-bd8a-fab84203fca3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:55.269406 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-185e27ba-bd76-4773-8443-081d3fc7e4a3 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:55.270662 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-185e27ba-bd76-4773-8443-081d3fc7e4a3 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:55.271345 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-185e27ba-bd76-4773-8443-081d3fc7e4a3 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:55.272276 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-185e27ba-bd76-4773-8443-081d3fc7e4a3 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:55.272974 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-185e27ba-bd76-4773-8443-081d3fc7e4a3 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:55.273769 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-185e27ba-bd76-4773-8443-081d3fc7e4a3 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:55.305512 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:41:55.390164 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5dd0cf9a-8411-4ece-9bab-3de21020f9d0 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:55.405490 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5dd0cf9a-8411-4ece-9bab-3de21020f9d0 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/3e1d2587-26db-449e-81cd-677ce4f87a76" status: 200 len: 1308 microversion: 2.1 time: 0.328206 Oct 17 13:41:55.406858 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1034/2061] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:55 2022] GET /compute/v2.1/servers/3e1d2587-26db-449e-81cd-677ce4f87a76 => generated 1308 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:55.520064 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-185e27ba-bd76-4773-8443-081d3fc7e4a3 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "GET /compute/v2.1/servers/58a43093-7550-452c-bd8a-fab84203fca3/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 0.273535 Oct 17 13:41:55.522612 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1028/2062] 10.222.0.79 () {58 vars in 1293 bytes} [Mon Oct 17 13:41:55 2022] GET /compute/v2.1/servers/58a43093-7550-452c-bd8a-fab84203fca3/os-security-groups => generated 1156 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:55.537188 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5b9e78a4-8456-4e5f-831e-5b79b84c5f70 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:55.540594 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5b9e78a4-8456-4e5f-831e-5b79b84c5f70 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9044674d-a793-46c2-b3ec-e9377b30f253] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:55.552584 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5b9e78a4-8456-4e5f-831e-5b79b84c5f70 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:55.554350 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5b9e78a4-8456-4e5f-831e-5b79b84c5f70 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:55.555021 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5b9e78a4-8456-4e5f-831e-5b79b84c5f70 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:55.556158 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5b9e78a4-8456-4e5f-831e-5b79b84c5f70 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:55.556973 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5b9e78a4-8456-4e5f-831e-5b79b84c5f70 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:55.557887 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5b9e78a4-8456-4e5f-831e-5b79b84c5f70 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:55.642682 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-510c5987-999b-4714-a5f6-6202d3a31c1f tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Action: 'update', calling method: .version_select at 0x7f7cd9a29ee0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:55.643328 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5b9e78a4-8456-4e5f-831e-5b79b84c5f70 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "PUT /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253" status: 200 len: 1080 microversion: 2.1 time: 0.119163 Oct 17 13:41:55.657585 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1029/2063] 10.222.0.79 () {60 vars in 1256 bytes} [Mon Oct 17 13:41:55 2022] PUT /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253 => generated 1080 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:55.658110 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-510c5987-999b-4714-a5f6-6202d3a31c1f tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:55.658110 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-510c5987-999b-4714-a5f6-6202d3a31c1f tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:55.658110 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-510c5987-999b-4714-a5f6-6202d3a31c1f tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:55.662218 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-510c5987-999b-4714-a5f6-6202d3a31c1f tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:55.662782 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-510c5987-999b-4714-a5f6-6202d3a31c1f tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:55.663482 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-510c5987-999b-4714-a5f6-6202d3a31c1f tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:55.666693 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cfdd3ea1-cde5-47cc-bf25-cbf6cae7d629 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:55.668036 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cfdd3ea1-cde5-47cc-bf25-cbf6cae7d629 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] [instance: d30452eb-38cd-413a-9369-f60aad1d31bb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:55.676338 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cfdd3ea1-cde5-47cc-bf25-cbf6cae7d629 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:55.676488 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-510c5987-999b-4714-a5f6-6202d3a31c1f tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] HTTP exception thrown: Service 088d49ac-96cb-4a8e-972d-73c93671d685 could not be found. Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-510c5987-999b-4714-a5f6-6202d3a31c1f tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Request method failure captured: Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: request: PUT /compute/v2.1/os-services/088d49ac-96cb-4a8e-972d-73c93671d685 HTTP/1.1 Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 56 Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVuif4chV3PpEZjmC0FKdzSCexliSKCQpPGFMDQQxgt1qOIFhTX7d8oAWmjNHJ4p94zl5PUNuabA-bmRomPVmpujXkAxsmYZCqeGo9meoH-oWpMrOXuhkQE8JenzsUmF2Z9PAr7xYMX44Z2Y3z8bmoG_x_mwuebJPXl3Py40YbV4KfE Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: X-Openstack-Nova-Api-Version: 2.53 Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 939c81fd32054d1796546f24b791c830 Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-384941823 Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member,admin Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member,admin Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/939c81fd32054d1796546f24b791c830"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/939c81fd32054d1796546f24b791c830"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/939c81fd32054d1796546f24b791c830"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_939c81fd32054d1796546f24b791c830", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-384941823 Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 939c81fd32054d1796546f24b791c830 Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-384941823 Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: d2024b3bd57c4f338c4293f3cb9dcbd3 Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: method: Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: exception: Service 088d49ac-96cb-4a8e-972d-73c93671d685 could not be found. Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '088d49ac-96cb-4a8e-972d-73c93671d685', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 088d49ac-96cb-4a8e-972d-73c93671d685 could not be found. Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:41:55.678697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:41:55.684138 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 17 13:41:55.684138 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:41:55.684138 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 088d49ac-96cb-4a8e-972d-73c93671d685 could not be found. Oct 17 13:41:55.684138 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:41:55.684138 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:55.684138 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:41:55.684138 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:55.684138 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:55.684138 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:55.684138 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:41:55.684138 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:41:55.684138 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 088d49ac-96cb-4a8e-972d-73c93671d685 could not be found. Oct 17 13:41:55.684138 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:41:55.684138 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-510c5987-999b-4714-a5f6-6202d3a31c1f tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Returning 404 to user: Service 088d49ac-96cb-4a8e-972d-73c93671d685 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:41:55.685825 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cfdd3ea1-cde5-47cc-bf25-cbf6cae7d629 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:55.686113 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-510c5987-999b-4714-a5f6-6202d3a31c1f tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-services/088d49ac-96cb-4a8e-972d-73c93671d685" status: 404 len: 110 microversion: 2.53 time: 0.272277 Oct 17 13:41:55.686240 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cfdd3ea1-cde5-47cc-bf25-cbf6cae7d629 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:55.686240 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cfdd3ea1-cde5-47cc-bf25-cbf6cae7d629 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:55.686240 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cfdd3ea1-cde5-47cc-bf25-cbf6cae7d629 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:55.686240 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cfdd3ea1-cde5-47cc-bf25-cbf6cae7d629 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:55.688246 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1035/2064] 10.222.0.79 () {62 vars in 1309 bytes} [Mon Oct 17 13:41:55 2022] PUT /compute/v2.1/os-services/088d49ac-96cb-4a8e-972d-73c93671d685 => generated 110 bytes in 281 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:41:55.696144 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2cea65ea-bca1-4202-819b-ad4f40833346 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:55.698974 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2cea65ea-bca1-4202-819b-ad4f40833346 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] [instance: 95418c39-6c0a-444e-93b4-4a90b31f3034] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:55.705706 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2cea65ea-bca1-4202-819b-ad4f40833346 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:55.706200 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2cea65ea-bca1-4202-819b-ad4f40833346 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:55.706687 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2cea65ea-bca1-4202-819b-ad4f40833346 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:55.709132 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2cea65ea-bca1-4202-819b-ad4f40833346 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:55.709132 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2cea65ea-bca1-4202-819b-ad4f40833346 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:55.709132 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2cea65ea-bca1-4202-819b-ad4f40833346 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:55.922133 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cfdd3ea1-cde5-47cc-bf25-cbf6cae7d629 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:55.932165 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cfdd3ea1-cde5-47cc-bf25-cbf6cae7d629 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers/d30452eb-38cd-413a-9369-f60aad1d31bb" status: 200 len: 1517 microversion: 2.1 time: 0.285156 Oct 17 13:41:55.946842 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1030/2065] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:55 2022] GET /compute/v2.1/servers/d30452eb-38cd-413a-9369-f60aad1d31bb => generated 1517 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:55.959605 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7ef30398-aad2-48e3-846e-be12fc11dd8a tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Action: 'create', calling method: .version_select at 0x7f7cd55a7940>, body: {"security_group": {"name": " tempest-securitygroup -1259183035 ", "description": "tempest-description-1105092777"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:55.978504 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=8 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:41:55.986587 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2cea65ea-bca1-4202-819b-ad4f40833346 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b891d3b774e44de3ad1d3088990f6bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358604dd1cf74e5fab262179351d4d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:56.001093 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2cea65ea-bca1-4202-819b-ad4f40833346 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] 10.222.0.79 "GET /compute/v2.1/servers/95418c39-6c0a-444e-93b4-4a90b31f3034" status: 200 len: 1401 microversion: 2.1 time: 0.310689 Oct 17 13:41:56.002328 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1036/2066] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:55 2022] GET /compute/v2.1/servers/95418c39-6c0a-444e-93b4-4a90b31f3034 => generated 1401 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:56.007386 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-dbc4b23b-5cda-4954-9850-d8ca929c5895 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:56.008679 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-dbc4b23b-5cda-4954-9850-d8ca929c5895 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9044674d-a793-46c2-b3ec-e9377b30f253] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:56.015266 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dbc4b23b-5cda-4954-9850-d8ca929c5895 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:56.016232 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dbc4b23b-5cda-4954-9850-d8ca929c5895 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:56.016849 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dbc4b23b-5cda-4954-9850-d8ca929c5895 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:56.017748 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dbc4b23b-5cda-4954-9850-d8ca929c5895 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:56.018631 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dbc4b23b-5cda-4954-9850-d8ca929c5895 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:56.019387 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dbc4b23b-5cda-4954-9850-d8ca929c5895 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:56.224820 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7ef30398-aad2-48e3-846e-be12fc11dd8a tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 224 microversion: 2.1 time: 0.275716 Oct 17 13:41:56.225533 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1031/2067] 10.222.0.79 () {60 vars in 1180 bytes} [Mon Oct 17 13:41:55 2022] POST /compute/v2.1/os-security-groups => generated 224 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:41:56.231979 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b14a6060-39d1-4dbb-975c-37b4fd33372a tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Action: 'update', calling method: .version_select at 0x7f7cd555b8b0>, body: {"status": "disabled"} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:56.238529 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b14a6060-39d1-4dbb-975c-37b4fd33372a tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:56.239077 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b14a6060-39d1-4dbb-975c-37b4fd33372a tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:56.239543 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b14a6060-39d1-4dbb-975c-37b4fd33372a tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:56.245780 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-dbc4b23b-5cda-4954-9850-d8ca929c5895 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:56.249648 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b14a6060-39d1-4dbb-975c-37b4fd33372a tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:56.250546 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b14a6060-39d1-4dbb-975c-37b4fd33372a tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:56.251194 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b14a6060-39d1-4dbb-975c-37b4fd33372a tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:56.256788 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-dbc4b23b-5cda-4954-9850-d8ca929c5895 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253" status: 200 len: 1506 microversion: 2.1 time: 0.253135 Oct 17 13:41:56.257432 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1037/2068] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:56 2022] GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253 => generated 1506 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:56.262954 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-08d98729-3c1e-4a26-9883-af9db51d10f3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:56.263780 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-08d98729-3c1e-4a26-9883-af9db51d10f3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 709d926d-fba5-49ea-84ac-95d8bb018c68] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:56.270470 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-08d98729-3c1e-4a26-9883-af9db51d10f3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:56.270965 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-08d98729-3c1e-4a26-9883-af9db51d10f3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:56.271464 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-08d98729-3c1e-4a26-9883-af9db51d10f3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:56.272173 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-08d98729-3c1e-4a26-9883-af9db51d10f3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:56.272626 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-08d98729-3c1e-4a26-9883-af9db51d10f3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:56.273050 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-08d98729-3c1e-4a26-9883-af9db51d10f3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:56.273353 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-b14a6060-39d1-4dbb-975c-37b4fd33372a tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] HTTP exception thrown: Service 088d49ac-96cb-4a8e-972d-73c93671d685 could not be found. Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b14a6060-39d1-4dbb-975c-37b4fd33372a tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Request method failure captured: Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: request: PUT /compute/v2.1/os-services/088d49ac-96cb-4a8e-972d-73c93671d685 HTTP/1.1 Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 22 Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVuif4chV3PpEZjmC0FKdzSCexliSKCQpPGFMDQQxgt1qOIFhTX7d8oAWmjNHJ4p94zl5PUNuabA-bmRomPVmpujXkAxsmYZCqeGo9meoH-oWpMrOXuhkQE8JenzsUmF2Z9PAr7xYMX44Z2Y3z8bmoG_x_mwuebJPXl3Py40YbV4KfE Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: X-Openstack-Nova-Api-Version: 2.53 Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 939c81fd32054d1796546f24b791c830 Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-384941823 Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member,admin Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member,admin Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/939c81fd32054d1796546f24b791c830"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/939c81fd32054d1796546f24b791c830"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/939c81fd32054d1796546f24b791c830"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_939c81fd32054d1796546f24b791c830", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-384941823 Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 939c81fd32054d1796546f24b791c830 Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-384941823 Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: d2024b3bd57c4f338c4293f3cb9dcbd3 Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: {"status": "disabled"} Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: method: Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: exception: Service 088d49ac-96cb-4a8e-972d-73c93671d685 could not be found. Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '088d49ac-96cb-4a8e-972d-73c93671d685', 'body': {'status': 'disabled'}} Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 088d49ac-96cb-4a8e-972d-73c93671d685 could not be found. Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:41:56.275243 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:41:56.280890 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 17 13:41:56.280890 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:41:56.280890 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 088d49ac-96cb-4a8e-972d-73c93671d685 could not be found. Oct 17 13:41:56.280890 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:41:56.280890 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:56.280890 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:41:56.280890 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:56.280890 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:56.280890 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:56.280890 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:41:56.280890 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:41:56.280890 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 088d49ac-96cb-4a8e-972d-73c93671d685 could not be found. Oct 17 13:41:56.280890 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:41:56.280890 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b14a6060-39d1-4dbb-975c-37b4fd33372a tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Returning 404 to user: Service 088d49ac-96cb-4a8e-972d-73c93671d685 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:41:56.280890 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b14a6060-39d1-4dbb-975c-37b4fd33372a tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-services/088d49ac-96cb-4a8e-972d-73c93671d685" status: 404 len: 110 microversion: 2.53 time: 0.050654 Oct 17 13:41:56.280890 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1032/2069] 10.222.0.79 () {62 vars in 1309 bytes} [Mon Oct 17 13:41:56 2022] PUT /compute/v2.1/os-services/088d49ac-96cb-4a8e-972d-73c93671d685 => generated 110 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:41:56.283200 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2a516fc6-b770-4fde-91f5-19f48db79f40 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Calling method '.version_select at 0x7f7cd4fed820>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:56.375621 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2a516fc6-b770-4fde-91f5-19f48db79f40 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "GET /compute/v2.1/os-security-groups/23bd3a00-58c3-4c24-9221-e77357620949" status: 200 len: 224 microversion: 2.1 time: 0.094966 Oct 17 13:41:56.376931 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1033/2070] 10.222.0.79 () {58 vars in 1269 bytes} [Mon Oct 17 13:41:56 2022] GET /compute/v2.1/os-security-groups/23bd3a00-58c3-4c24-9221-e77357620949 => generated 224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:41:56.383288 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e7586274-1fbc-49a2-bb17-1a21e948f5e2 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:56.384009 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e7586274-1fbc-49a2-bb17-1a21e948f5e2 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9044674d-a793-46c2-b3ec-e9377b30f253] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:56.447724 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7586274-1fbc-49a2-bb17-1a21e948f5e2 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:56.448240 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7586274-1fbc-49a2-bb17-1a21e948f5e2 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:56.448679 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7586274-1fbc-49a2-bb17-1a21e948f5e2 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:56.449405 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7586274-1fbc-49a2-bb17-1a21e948f5e2 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:56.449865 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7586274-1fbc-49a2-bb17-1a21e948f5e2 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:56.451543 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7586274-1fbc-49a2-bb17-1a21e948f5e2 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:56.556199 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-08d98729-3c1e-4a26-9883-af9db51d10f3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:56.570654 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-08d98729-3c1e-4a26-9883-af9db51d10f3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:56.573677 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-08d98729-3c1e-4a26-9883-af9db51d10f3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:56.577030 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-08d98729-3c1e-4a26-9883-af9db51d10f3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68" status: 200 len: 1813 microversion: 2.25 time: 0.317343 Oct 17 13:41:56.585335 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1038/2071] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:41:56 2022] GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68 => generated 1813 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:41:56.592043 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d59b4798-b505-44db-aded-0c71e1b7530c tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Action: 'update', calling method: .version_select at 0x7f7cd9a29a60>, body: {"status": "enabled"} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:56.598342 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d59b4798-b505-44db-aded-0c71e1b7530c tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:56.599019 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d59b4798-b505-44db-aded-0c71e1b7530c tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:56.599658 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d59b4798-b505-44db-aded-0c71e1b7530c tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:56.607929 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d59b4798-b505-44db-aded-0c71e1b7530c tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:56.608697 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d59b4798-b505-44db-aded-0c71e1b7530c tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:56.609297 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d59b4798-b505-44db-aded-0c71e1b7530c tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:56.614601 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-d59b4798-b505-44db-aded-0c71e1b7530c tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] HTTP exception thrown: Service 088d49ac-96cb-4a8e-972d-73c93671d685 could not be found. Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d59b4798-b505-44db-aded-0c71e1b7530c tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Request method failure captured: Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: request: PUT /compute/v2.1/os-services/088d49ac-96cb-4a8e-972d-73c93671d685 HTTP/1.1 Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 21 Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVuif4chV3PpEZjmC0FKdzSCexliSKCQpPGFMDQQxgt1qOIFhTX7d8oAWmjNHJ4p94zl5PUNuabA-bmRomPVmpujXkAxsmYZCqeGo9meoH-oWpMrOXuhkQE8JenzsUmF2Z9PAr7xYMX44Z2Y3z8bmoG_x_mwuebJPXl3Py40YbV4KfE Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: X-Openstack-Nova-Api-Version: 2.53 Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 939c81fd32054d1796546f24b791c830 Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-384941823 Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member,admin Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member,admin Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/939c81fd32054d1796546f24b791c830"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/939c81fd32054d1796546f24b791c830"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/939c81fd32054d1796546f24b791c830"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_939c81fd32054d1796546f24b791c830", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-384941823 Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 939c81fd32054d1796546f24b791c830 Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-384941823 Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: d2024b3bd57c4f338c4293f3cb9dcbd3 Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: {"status": "enabled"} Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: method: Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: exception: Service 088d49ac-96cb-4a8e-972d-73c93671d685 could not be found. Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '088d49ac-96cb-4a8e-972d-73c93671d685', 'body': {'status': 'enabled'}} Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 088d49ac-96cb-4a8e-972d-73c93671d685 could not be found. Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:41:56.616601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:41:56.621858 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 17 13:41:56.621858 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:41:56.621858 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 088d49ac-96cb-4a8e-972d-73c93671d685 could not be found. Oct 17 13:41:56.621858 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:41:56.621858 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:56.621858 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:41:56.621858 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:56.621858 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:56.621858 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:56.621858 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:41:56.621858 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:41:56.621858 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 088d49ac-96cb-4a8e-972d-73c93671d685 could not be found. Oct 17 13:41:56.621858 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:41:56.624403 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d59b4798-b505-44db-aded-0c71e1b7530c tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Returning 404 to user: Service 088d49ac-96cb-4a8e-972d-73c93671d685 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:41:56.624926 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d59b4798-b505-44db-aded-0c71e1b7530c tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-services/088d49ac-96cb-4a8e-972d-73c93671d685" status: 404 len: 110 microversion: 2.53 time: 0.038325 Oct 17 13:41:56.625933 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1039/2072] 10.222.0.79 () {62 vars in 1309 bytes} [Mon Oct 17 13:41:56 2022] PUT /compute/v2.1/os-services/088d49ac-96cb-4a8e-972d-73c93671d685 => generated 110 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:41:56.631444 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-554f720a-c06e-46a8-bad1-8bbbab223006 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Calling method '.version_select at 0x7f7cd5415820>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:56.780454 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e7586274-1fbc-49a2-bb17-1a21e948f5e2 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:56.796837 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e7586274-1fbc-49a2-bb17-1a21e948f5e2 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253" status: 200 len: 1506 microversion: 2.1 time: 0.418673 Oct 17 13:41:56.797726 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1034/2073] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:56 2022] GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253 => generated 1506 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:56.804292 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-9b304547-6b1a-4ce4-a963-7a040b63ab50 req-4a751a31-7fad-4805-a155-3659b8294eef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "709d926d-fba5-49ea-84ac-95d8bb018c68", "name": "network-vif-unplugged", "status": "completed", "tag": "8407f400-367b-4c97-9c87-63bd179d8941"}, {"name": "network-changed", "server_uuid": "58a43093-7550-452c-bd8a-fab84203fca3", "tag": "ef5798b1-64dc-43c6-93cc-2aebea1de96a"}, {"name": "network-changed", "server_uuid": "709d926d-fba5-49ea-84ac-95d8bb018c68", "tag": "8407f400-367b-4c97-9c87-63bd179d8941"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:56.821195 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-9b304547-6b1a-4ce4-a963-7a040b63ab50 req-4a751a31-7fad-4805-a155-3659b8294eef service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:56.821677 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-9b304547-6b1a-4ce4-a963-7a040b63ab50 req-4a751a31-7fad-4805-a155-3659b8294eef service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:56.822307 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-9b304547-6b1a-4ce4-a963-7a040b63ab50 req-4a751a31-7fad-4805-a155-3659b8294eef service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:56.837203 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-9b304547-6b1a-4ce4-a963-7a040b63ab50 req-4a751a31-7fad-4805-a155-3659b8294eef service nova] Creating event network-vif-unplugged:8407f400-367b-4c97-9c87-63bd179d8941 for instance 709d926d-fba5-49ea-84ac-95d8bb018c68 on n-h1-854247-14 Oct 17 13:41:56.838006 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-9b304547-6b1a-4ce4-a963-7a040b63ab50 req-4a751a31-7fad-4805-a155-3659b8294eef service nova] Creating event network-changed:ef5798b1-64dc-43c6-93cc-2aebea1de96a for instance 58a43093-7550-452c-bd8a-fab84203fca3 on n-h2-854247-14 Oct 17 13:41:56.838877 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-9b304547-6b1a-4ce4-a963-7a040b63ab50 req-4a751a31-7fad-4805-a155-3659b8294eef service nova] Creating event network-changed:8407f400-367b-4c97-9c87-63bd179d8941 for instance 709d926d-fba5-49ea-84ac-95d8bb018c68 on n-h1-854247-14 Oct 17 13:41:56.851200 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-9b304547-6b1a-4ce4-a963-7a040b63ab50 req-4a751a31-7fad-4805-a155-3659b8294eef service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 519 microversion: 2.1 time: 0.051464 Oct 17 13:41:56.852253 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1035/2074] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:41:56 2022] POST /compute/v2.1/os-server-external-events => generated 519 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:41:56.858497 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9223351b-0bd8-4d08-960d-b6bfdf434372 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:56.859198 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9223351b-0bd8-4d08-960d-b6bfdf434372 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 3e1d2587-26db-449e-81cd-677ce4f87a76] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:56.870778 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9223351b-0bd8-4d08-960d-b6bfdf434372 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:56.871541 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9223351b-0bd8-4d08-960d-b6bfdf434372 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:56.872211 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9223351b-0bd8-4d08-960d-b6bfdf434372 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:56.874088 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9223351b-0bd8-4d08-960d-b6bfdf434372 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:56.875420 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9223351b-0bd8-4d08-960d-b6bfdf434372 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:56.876803 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9223351b-0bd8-4d08-960d-b6bfdf434372 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:57.299418 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9223351b-0bd8-4d08-960d-b6bfdf434372 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:57.313370 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9223351b-0bd8-4d08-960d-b6bfdf434372 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/3e1d2587-26db-449e-81cd-677ce4f87a76" status: 200 len: 1308 microversion: 2.1 time: 0.459481 Oct 17 13:41:57.314271 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1036/2075] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:56 2022] GET /compute/v2.1/servers/3e1d2587-26db-449e-81cd-677ce4f87a76 => generated 1308 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:57.319636 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6a328f02-4bad-49e3-bcd4-e5aefb65dd85 tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:57.323385 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6a328f02-4bad-49e3-bcd4-e5aefb65dd85 tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:57.324054 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6a328f02-4bad-49e3-bcd4-e5aefb65dd85 tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:57.324647 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6a328f02-4bad-49e3-bcd4-e5aefb65dd85 tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:57.325694 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6a328f02-4bad-49e3-bcd4-e5aefb65dd85 tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:57.326330 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6a328f02-4bad-49e3-bcd4-e5aefb65dd85 tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:57.326911 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6a328f02-4bad-49e3-bcd4-e5aefb65dd85 tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:57.339807 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-554f720a-c06e-46a8-bad1-8bbbab223006 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/23bd3a00-58c3-4c24-9221-e77357620949" status: 202 len: 0 microversion: 2.1 time: 0.712848 Oct 17 13:41:57.340474 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1040/2076] 10.222.0.79 () {58 vars in 1272 bytes} [Mon Oct 17 13:41:56 2022] DELETE /compute/v2.1/os-security-groups/23bd3a00-58c3-4c24-9221-e77357620949 => generated 0 bytes in 714 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:41:57.347194 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-70260a88-b55f-4074-90ca-433d7dd3beb0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:57.350693 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-70260a88-b55f-4074-90ca-433d7dd3beb0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9044674d-a793-46c2-b3ec-e9377b30f253] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:57.366305 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70260a88-b55f-4074-90ca-433d7dd3beb0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:57.367074 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70260a88-b55f-4074-90ca-433d7dd3beb0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:57.367770 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70260a88-b55f-4074-90ca-433d7dd3beb0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:57.368705 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70260a88-b55f-4074-90ca-433d7dd3beb0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:57.368829 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6a328f02-4bad-49e3-bcd4-e5aefb65dd85 tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.052043 Oct 17 13:41:57.369909 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70260a88-b55f-4074-90ca-433d7dd3beb0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:57.370113 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1037/2077] 10.222.0.79 () {60 vars in 1178 bytes} [Mon Oct 17 13:41:57 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:41:57.374387 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70260a88-b55f-4074-90ca-433d7dd3beb0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:57.386658 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3610df1e-725a-4916-b1e7-e1b98a368379 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:57.387594 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3610df1e-725a-4916-b1e7-e1b98a368379 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] [instance: d30452eb-38cd-413a-9369-f60aad1d31bb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:57.395124 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3610df1e-725a-4916-b1e7-e1b98a368379 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:57.395879 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3610df1e-725a-4916-b1e7-e1b98a368379 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:57.396759 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3610df1e-725a-4916-b1e7-e1b98a368379 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:57.397980 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3610df1e-725a-4916-b1e7-e1b98a368379 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:57.398769 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3610df1e-725a-4916-b1e7-e1b98a368379 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:57.399548 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3610df1e-725a-4916-b1e7-e1b98a368379 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:57.420234 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=22 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:41:57.475391 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-70260a88-b55f-4074-90ca-433d7dd3beb0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:41:57.475811 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-70260a88-b55f-4074-90ca-433d7dd3beb0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:41:57.476281 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-70260a88-b55f-4074-90ca-433d7dd3beb0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:41:57.476681 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-70260a88-b55f-4074-90ca-433d7dd3beb0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:41:57.477086 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-70260a88-b55f-4074-90ca-433d7dd3beb0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:41:57.560103 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-70260a88-b55f-4074-90ca-433d7dd3beb0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9044674d-a793-46c2-b3ec-e9377b30f253] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:57.567294 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70260a88-b55f-4074-90ca-433d7dd3beb0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:57.568393 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70260a88-b55f-4074-90ca-433d7dd3beb0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:57.568614 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70260a88-b55f-4074-90ca-433d7dd3beb0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:57.569345 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70260a88-b55f-4074-90ca-433d7dd3beb0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:57.569809 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70260a88-b55f-4074-90ca-433d7dd3beb0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:57.570487 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70260a88-b55f-4074-90ca-433d7dd3beb0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:57.607797 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-70260a88-b55f-4074-90ca-433d7dd3beb0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "POST /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253/action" status: 202 len: 1112 microversion: 2.1 time: 0.265709 Oct 17 13:41:57.608861 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1041/2078] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:41:57 2022] POST /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253/action => generated 1112 bytes in 268 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 17 13:41:57.616656 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9cbfbb17-bddb-4b22-974d-eb88bdf54513 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:57.618073 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9cbfbb17-bddb-4b22-974d-eb88bdf54513 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] [instance: 95418c39-6c0a-444e-93b4-4a90b31f3034] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:57.626356 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9cbfbb17-bddb-4b22-974d-eb88bdf54513 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:57.627853 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9cbfbb17-bddb-4b22-974d-eb88bdf54513 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:57.628321 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9cbfbb17-bddb-4b22-974d-eb88bdf54513 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:57.636226 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9cbfbb17-bddb-4b22-974d-eb88bdf54513 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:57.636733 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9cbfbb17-bddb-4b22-974d-eb88bdf54513 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:57.637446 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9cbfbb17-bddb-4b22-974d-eb88bdf54513 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:58.318159 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3610df1e-725a-4916-b1e7-e1b98a368379 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:58.333015 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3610df1e-725a-4916-b1e7-e1b98a368379 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers/d30452eb-38cd-413a-9369-f60aad1d31bb" status: 200 len: 1517 microversion: 2.1 time: 0.961338 Oct 17 13:41:58.336460 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1038/2079] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:57 2022] GET /compute/v2.1/servers/d30452eb-38cd-413a-9369-f60aad1d31bb => generated 1517 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:58.344461 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9365b688-c9fe-46e0-9c07-f9ff902e936c tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Calling method '.version_select at 0x7f7cd54a0ca0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:58.417511 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9cbfbb17-bddb-4b22-974d-eb88bdf54513 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b891d3b774e44de3ad1d3088990f6bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358604dd1cf74e5fab262179351d4d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:58.428906 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9cbfbb17-bddb-4b22-974d-eb88bdf54513 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] 10.222.0.79 "GET /compute/v2.1/servers/95418c39-6c0a-444e-93b4-4a90b31f3034" status: 200 len: 1401 microversion: 2.1 time: 0.818653 Oct 17 13:41:58.438622 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1042/2080] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:57 2022] GET /compute/v2.1/servers/95418c39-6c0a-444e-93b4-4a90b31f3034 => generated 1401 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:58.444244 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1537bbf6-d7e6-4081-9d8b-892dbbcea010 tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:58.450349 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1537bbf6-d7e6-4081-9d8b-892dbbcea010 tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:58.454913 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1537bbf6-d7e6-4081-9d8b-892dbbcea010 tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:58.455881 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1537bbf6-d7e6-4081-9d8b-892dbbcea010 tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:58.459965 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1537bbf6-d7e6-4081-9d8b-892dbbcea010 tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:58.460526 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1537bbf6-d7e6-4081-9d8b-892dbbcea010 tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:58.461202 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1537bbf6-d7e6-4081-9d8b-892dbbcea010 tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:58.486424 n-d-854247-14 devstack@n-api.service[127016]: DEBUG neutronclient.v2_0.client [None req-9365b688-c9fe-46e0-9c07-f9ff902e936c tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 23bd3a00-58c3-4c24-9221-e77357620949 does not exist", "detail": ""}} {{(pid=127016) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 13:41:58.487336 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.security_group_api [None req-9365b688-c9fe-46e0-9c07-f9ff902e936c tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Neutron security group 23bd3a00-58c3-4c24-9221-e77357620949 not found {{(pid=127016) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 17 13:41:58.488146 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-9365b688-c9fe-46e0-9c07-f9ff902e936c tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] HTTP exception thrown: Security group 23bd3a00-58c3-4c24-9221-e77357620949 does not exist Oct 17 13:41:58.488146 n-d-854247-14 devstack@n-api.service[127016]: Neutron server returns request_ids: ['req-e227b478-5ff1-45ce-9039-af60af2ed4ad'] Oct 17 13:41:58.490439 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9365b688-c9fe-46e0-9c07-f9ff902e936c tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Request method failure captured: Oct 17 13:41:58.490439 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/os-security-groups/23bd3a00-58c3-4c24-9221-e77357620949 HTTP/1.1 Oct 17 13:41:58.490439 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:41:58.490439 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:41:58.490439 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:41:58.490439 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:41:58.490439 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:41:58.490439 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:41:58.490439 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:41:58.490439 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:41:58.490439 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVtyFGyYtLVdwIq4ccz7RkXRa7NtlbhzSHc2HUbc2jnmH2QeepBwxbKf8toXm_ooPcHi9ET43LtT1AqXtRk9n6taXXPkcxvI9DAvMm-WduwoIrQJqrIBPqw0m6vAgqbSuo42q0EeC3f0tZCzBhE1QaAtaHcB-dTJTCp89NqtuNhDPjU Oct 17 13:41:58.490439 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:41:58.490439 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:41:58.490439 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:41:58.490439 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:41:58.490439 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:41:58.490439 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:41:58.490439 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 50c0147c5fae4017810887843b0afaa0 Oct 17 13:41:58.490439 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-SecurityGroupsTestJSON-1412652742 Oct 17 13:41:58.490439 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:41:58.490439 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:41:58.490439 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/50c0147c5fae4017810887843b0afaa0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/50c0147c5fae4017810887843b0afaa0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/50c0147c5fae4017810887843b0afaa0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_50c0147c5fae4017810887843b0afaa0", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:41:58.490439 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-SecurityGroupsTestJSON-1412652742 Oct 17 13:41:58.490439 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 50c0147c5fae4017810887843b0afaa0 Oct 17 13:41:58.490439 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1412652742 Oct 17 13:41:58.490439 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-SecurityGroupsTestJSON-1412652742-project Oct 17 13:41:58.490439 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:41:58.490439 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:41:58.490439 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 185235bc4e3245fc8d92b7e4bff6cbbd Oct 17 13:41:58.490439 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-SecurityGroupsTestJSON-1412652742-project Oct 17 13:41:58.490439 n-d-854247-14 devstack@n-api.service[127016]: method: Oct 17 13:41:58.490439 n-d-854247-14 devstack@n-api.service[127016]: exception: Security group 23bd3a00-58c3-4c24-9221-e77357620949 does not exist Oct 17 13:41:58.490439 n-d-854247-14 devstack@n-api.service[127016]: Neutron server returns request_ids: ['req-e227b478-5ff1-45ce-9039-af60af2ed4ad'] Oct 17 13:41:58.490439 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '23bd3a00-58c3-4c24-9221-e77357620949'} Oct 17 13:41:58.490439 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:41:58.490439 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:58.490439 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 17 13:41:58.490439 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 17 13:41:58.490439 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:41:58.490439 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:41:58.490439 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 17 13:41:58.490439 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 17 13:41:58.490439 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:41:58.490439 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:41:58.490439 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 13:41:58.490439 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 13:41:58.490439 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:41:58.490439 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:41:58.490439 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 13:41:58.490439 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 13:41:58.490439 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:41:58.490439 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:41:58.490439 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 13:41:58.490439 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 13:41:58.490439 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:41:58.490439 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:41:58.490439 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 13:41:58.490439 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 13:41:58.490439 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 13:41:58.490439 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 13:41:58.490439 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 23bd3a00-58c3-4c24-9221-e77357620949 does not exist Oct 17 13:41:58.494965 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e227b478-5ff1-45ce-9039-af60af2ed4ad'] Oct 17 13:41:58.494965 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:41:58.494965 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:58.494965 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:41:58.494965 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:58.494965 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 17 13:41:58.494965 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 17 13:41:58.494965 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 17 13:41:58.494965 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 13:41:58.494965 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 23bd3a00-58c3-4c24-9221-e77357620949 does not exist Oct 17 13:41:58.494965 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e227b478-5ff1-45ce-9039-af60af2ed4ad'] Oct 17 13:41:58.494965 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:41:58.494965 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:58.494965 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:41:58.494965 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:58.494965 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:58.494965 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:58.494965 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:41:58.494965 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:41:58.494965 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:41:58.494965 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:41:58.494965 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:41:58.494965 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:41:58.494965 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 17 13:41:58.494965 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 17 13:41:58.494965 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 23bd3a00-58c3-4c24-9221-e77357620949 does not exist Oct 17 13:41:58.494965 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e227b478-5ff1-45ce-9039-af60af2ed4ad'] Oct 17 13:41:58.494965 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:41:58.494965 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:58.494965 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:41:58.494965 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:58.494965 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:58.494965 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:58.494965 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:41:58.494965 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:41:58.494965 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 23bd3a00-58c3-4c24-9221-e77357620949 does not exist Oct 17 13:41:58.494965 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e227b478-5ff1-45ce-9039-af60af2ed4ad'] Oct 17 13:41:58.494965 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:41:58.510320 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9365b688-c9fe-46e0-9c07-f9ff902e936c tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Returning 404 to user: Security group 23bd3a00-58c3-4c24-9221-e77357620949 does not exist Oct 17 13:41:58.510320 n-d-854247-14 devstack@n-api.service[127016]: Neutron server returns request_ids: ['req-e227b478-5ff1-45ce-9039-af60af2ed4ad'] {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:41:58.510320 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9365b688-c9fe-46e0-9c07-f9ff902e936c tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "GET /compute/v2.1/os-security-groups/23bd3a00-58c3-4c24-9221-e77357620949" status: 404 len: 194 microversion: 2.1 time: 0.165894 Oct 17 13:41:58.510320 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1039/2081] 10.222.0.79 () {58 vars in 1269 bytes} [Mon Oct 17 13:41:58 2022] GET /compute/v2.1/os-security-groups/23bd3a00-58c3-4c24-9221-e77357620949 => generated 194 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:41:58.511830 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1537bbf6-d7e6-4081-9d8b-892dbbcea010 tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.069493 Oct 17 13:41:58.515285 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1043/2082] 10.222.0.79 () {60 vars in 1211 bytes} [Mon Oct 17 13:41:58 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1244 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:41:58.524645 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-84ac62ff-d2aa-4764-b00b-b9d6d8d88478 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:58.525660 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-84ac62ff-d2aa-4764-b00b-b9d6d8d88478 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 709d926d-fba5-49ea-84ac-95d8bb018c68] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:58.527941 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8d86f49f-e46f-440c-8bd4-9a466dc59f73 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:58.530675 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8d86f49f-e46f-440c-8bd4-9a466dc59f73 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9044674d-a793-46c2-b3ec-e9377b30f253] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:58.540026 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-84ac62ff-d2aa-4764-b00b-b9d6d8d88478 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:58.544249 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8d86f49f-e46f-440c-8bd4-9a466dc59f73 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:58.545167 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-84ac62ff-d2aa-4764-b00b-b9d6d8d88478 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:58.545971 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-84ac62ff-d2aa-4764-b00b-b9d6d8d88478 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:58.546969 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-84ac62ff-d2aa-4764-b00b-b9d6d8d88478 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:58.547728 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8d86f49f-e46f-440c-8bd4-9a466dc59f73 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:58.548413 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8d86f49f-e46f-440c-8bd4-9a466dc59f73 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:58.549090 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-84ac62ff-d2aa-4764-b00b-b9d6d8d88478 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:58.550030 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8d86f49f-e46f-440c-8bd4-9a466dc59f73 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:58.550698 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-84ac62ff-d2aa-4764-b00b-b9d6d8d88478 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:58.552121 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8d86f49f-e46f-440c-8bd4-9a466dc59f73 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:58.555217 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8d86f49f-e46f-440c-8bd4-9a466dc59f73 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:58.596967 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:41:59.119825 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-84ac62ff-d2aa-4764-b00b-b9d6d8d88478 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:59.137365 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-84ac62ff-d2aa-4764-b00b-b9d6d8d88478 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:59.138803 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-84ac62ff-d2aa-4764-b00b-b9d6d8d88478 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:59.140069 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-84ac62ff-d2aa-4764-b00b-b9d6d8d88478 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68" status: 200 len: 1813 microversion: 2.25 time: 0.626734 Oct 17 13:41:59.140635 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1040/2083] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:41:58 2022] GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68 => generated 1813 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:41:59.146836 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3df320e5-fee6-4e8d-83eb-16ec58e485ef tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:59.147483 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3df320e5-fee6-4e8d-83eb-16ec58e485ef tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 3e1d2587-26db-449e-81cd-677ce4f87a76] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:59.166882 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3df320e5-fee6-4e8d-83eb-16ec58e485ef tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:59.175643 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3df320e5-fee6-4e8d-83eb-16ec58e485ef tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:59.176218 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3df320e5-fee6-4e8d-83eb-16ec58e485ef tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:59.177019 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3df320e5-fee6-4e8d-83eb-16ec58e485ef tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:59.177478 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3df320e5-fee6-4e8d-83eb-16ec58e485ef tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:59.177875 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3df320e5-fee6-4e8d-83eb-16ec58e485ef tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:59.328139 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8d86f49f-e46f-440c-8bd4-9a466dc59f73 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:59.346576 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8d86f49f-e46f-440c-8bd4-9a466dc59f73 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253" status: 200 len: 1517 microversion: 2.1 time: 0.829899 Oct 17 13:41:59.358106 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1044/2084] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:58 2022] GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253 => generated 1517 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:59.376628 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a7a3f07a-5c89-48a0-a021-0d636c99c9f4 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Action: 'create', calling method: .version_select at 0x7f7cd9a14670>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-242672173", "description": "tempest-description-1161224992"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:59.625472 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3df320e5-fee6-4e8d-83eb-16ec58e485ef tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:59.638107 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3df320e5-fee6-4e8d-83eb-16ec58e485ef tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/3e1d2587-26db-449e-81cd-677ce4f87a76" status: 200 len: 1487 microversion: 2.1 time: 0.495740 Oct 17 13:41:59.639882 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1041/2085] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:59 2022] GET /compute/v2.1/servers/3e1d2587-26db-449e-81cd-677ce4f87a76 => generated 1487 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:59.646000 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7521f4f5-2a4b-475f-ba18-67fd6b74d697 tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:59.651001 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7521f4f5-2a4b-475f-ba18-67fd6b74d697 tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:59.652834 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7521f4f5-2a4b-475f-ba18-67fd6b74d697 tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:59.653630 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7521f4f5-2a4b-475f-ba18-67fd6b74d697 tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:59.655009 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7521f4f5-2a4b-475f-ba18-67fd6b74d697 tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:59.656313 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7521f4f5-2a4b-475f-ba18-67fd6b74d697 tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:59.656978 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7521f4f5-2a4b-475f-ba18-67fd6b74d697 tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:59.694212 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7521f4f5-2a4b-475f-ba18-67fd6b74d697 tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.052205 Oct 17 13:41:59.698918 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1042/2086] 10.222.0.79 () {60 vars in 1178 bytes} [Mon Oct 17 13:41:59 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:41:59.705190 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fb8f76c3-41b5-42e6-8bfe-cad6bb08df98 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:59.715689 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-fb8f76c3-41b5-42e6-8bfe-cad6bb08df98 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] [instance: d30452eb-38cd-413a-9369-f60aad1d31bb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:59.728272 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fb8f76c3-41b5-42e6-8bfe-cad6bb08df98 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:59.729154 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fb8f76c3-41b5-42e6-8bfe-cad6bb08df98 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:59.730963 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fb8f76c3-41b5-42e6-8bfe-cad6bb08df98 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:59.731965 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fb8f76c3-41b5-42e6-8bfe-cad6bb08df98 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:59.736149 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fb8f76c3-41b5-42e6-8bfe-cad6bb08df98 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:59.736839 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fb8f76c3-41b5-42e6-8bfe-cad6bb08df98 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:59.848303 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fb8f76c3-41b5-42e6-8bfe-cad6bb08df98 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:59.848801 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fb8f76c3-41b5-42e6-8bfe-cad6bb08df98 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:59.849521 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fb8f76c3-41b5-42e6-8bfe-cad6bb08df98 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:59.850151 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-fb8f76c3-41b5-42e6-8bfe-cad6bb08df98 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lazy-loading 'fault' on Instance uuid d30452eb-38cd-413a-9369-f60aad1d31bb {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:42:00.010127 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fb8f76c3-41b5-42e6-8bfe-cad6bb08df98 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:00.023096 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fb8f76c3-41b5-42e6-8bfe-cad6bb08df98 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers/d30452eb-38cd-413a-9369-f60aad1d31bb" status: 200 len: 1310 microversion: 2.1 time: 0.322881 Oct 17 13:42:00.029097 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1043/2087] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:59 2022] GET /compute/v2.1/servers/d30452eb-38cd-413a-9369-f60aad1d31bb => generated 1310 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:00.044795 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e8962b10-c75e-44f2-9a8e-38fe6b748e5a tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:00.047021 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e8962b10-c75e-44f2-9a8e-38fe6b748e5a tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] [instance: 95418c39-6c0a-444e-93b4-4a90b31f3034] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:00.059750 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a7a3f07a-5c89-48a0-a021-0d636c99c9f4 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.699948 Oct 17 13:42:00.061543 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1045/2088] 10.222.0.79 () {60 vars in 1180 bytes} [Mon Oct 17 13:41:59 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:42:00.065292 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e8962b10-c75e-44f2-9a8e-38fe6b748e5a tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:00.070678 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-fd46f237-dc49-4521-9050-68ef2fea8324 req-94a06153-9a0c-4738-91f5-d16fa40e43ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d30452eb-38cd-413a-9369-f60aad1d31bb", "name": "network-vif-deleted", "tag": "76105cf8-6f9e-478d-8c19-ca94faa330f7"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:42:00.075613 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e8962b10-c75e-44f2-9a8e-38fe6b748e5a tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:00.076145 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e8962b10-c75e-44f2-9a8e-38fe6b748e5a tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:00.076772 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e8962b10-c75e-44f2-9a8e-38fe6b748e5a tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:00.078142 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e8962b10-c75e-44f2-9a8e-38fe6b748e5a tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:00.079314 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e8962b10-c75e-44f2-9a8e-38fe6b748e5a tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:00.098005 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-fd46f237-dc49-4521-9050-68ef2fea8324 req-94a06153-9a0c-4738-91f5-d16fa40e43ca service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:00.099281 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-fd46f237-dc49-4521-9050-68ef2fea8324 req-94a06153-9a0c-4738-91f5-d16fa40e43ca service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:00.099970 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-fd46f237-dc49-4521-9050-68ef2fea8324 req-94a06153-9a0c-4738-91f5-d16fa40e43ca service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:00.129251 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-fd46f237-dc49-4521-9050-68ef2fea8324 req-94a06153-9a0c-4738-91f5-d16fa40e43ca service nova] Creating event network-vif-deleted:76105cf8-6f9e-478d-8c19-ca94faa330f7 for instance d30452eb-38cd-413a-9369-f60aad1d31bb on n-h1-854247-14 Oct 17 13:42:00.140754 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-fd46f237-dc49-4521-9050-68ef2fea8324 req-94a06153-9a0c-4738-91f5-d16fa40e43ca service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077412 Oct 17 13:42:00.142214 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1046/2089] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:42:00.152488 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-75ddd45e-8fe8-4cdf-a385-42251b914589 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1279306239"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:42:00.157040 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-75ddd45e-8fe8-4cdf-a385-42251b914589 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 3e1d2587-26db-449e-81cd-677ce4f87a76] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:00.165624 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-75ddd45e-8fe8-4cdf-a385-42251b914589 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:00.166127 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-75ddd45e-8fe8-4cdf-a385-42251b914589 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:00.166603 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-75ddd45e-8fe8-4cdf-a385-42251b914589 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:00.167403 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-75ddd45e-8fe8-4cdf-a385-42251b914589 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:00.167917 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-75ddd45e-8fe8-4cdf-a385-42251b914589 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:00.168288 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-75ddd45e-8fe8-4cdf-a385-42251b914589 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:00.375830 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e8962b10-c75e-44f2-9a8e-38fe6b748e5a tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b891d3b774e44de3ad1d3088990f6bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358604dd1cf74e5fab262179351d4d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:00.387113 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e8962b10-c75e-44f2-9a8e-38fe6b748e5a tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] 10.222.0.79 "GET /compute/v2.1/servers/95418c39-6c0a-444e-93b4-4a90b31f3034" status: 200 len: 1401 microversion: 2.1 time: 0.356553 Oct 17 13:42:00.388077 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1044/2090] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:00 2022] GET /compute/v2.1/servers/95418c39-6c0a-444e-93b4-4a90b31f3034 => generated 1401 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:00.388949 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-75ddd45e-8fe8-4cdf-a385-42251b914589 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "POST /compute/v2.1/servers/3e1d2587-26db-449e-81cd-677ce4f87a76/action" status: 202 len: 0 microversion: 2.1 time: 0.243266 Oct 17 13:42:00.389602 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1047/2091] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:42:00 2022] POST /compute/v2.1/servers/3e1d2587-26db-449e-81cd-677ce4f87a76/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 17 13:42:00.393498 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-946deca8-bb67-4f92-ba5f-a5f242668bd7 tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:00.395475 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0fc959fc-7ae0-4bf3-b471-36d472703e60 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Action: 'create', calling method: .version_select at 0x7f7cd98b8ee0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-437979356", "description": "tempest-description-131349712"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:42:00.398963 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-946deca8-bb67-4f92-ba5f-a5f242668bd7 tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:00.399710 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-946deca8-bb67-4f92-ba5f-a5f242668bd7 tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:00.400391 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-946deca8-bb67-4f92-ba5f-a5f242668bd7 tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:00.401402 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-946deca8-bb67-4f92-ba5f-a5f242668bd7 tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:00.402384 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-946deca8-bb67-4f92-ba5f-a5f242668bd7 tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:00.403026 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-946deca8-bb67-4f92-ba5f-a5f242668bd7 tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:00.429435 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-946deca8-bb67-4f92-ba5f-a5f242668bd7 tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?host=n-d-854247-14&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.039994 Oct 17 13:42:00.430161 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1045/2092] 10.222.0.79 () {60 vars in 1237 bytes} [Mon Oct 17 13:42:00 2022] GET /compute/v2.1/os-services?host=n-d-854247-14&binary=xxx => generated 16 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:00.435702 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e50ef1ad-e693-495c-a33f-51e8d7de1972 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:00.436635 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e50ef1ad-e693-495c-a33f-51e8d7de1972 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 709d926d-fba5-49ea-84ac-95d8bb018c68] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:00.443535 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e50ef1ad-e693-495c-a33f-51e8d7de1972 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:00.444112 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e50ef1ad-e693-495c-a33f-51e8d7de1972 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:00.444617 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e50ef1ad-e693-495c-a33f-51e8d7de1972 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:00.445329 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e50ef1ad-e693-495c-a33f-51e8d7de1972 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:00.445779 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e50ef1ad-e693-495c-a33f-51e8d7de1972 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:00.446198 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e50ef1ad-e693-495c-a33f-51e8d7de1972 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:00.792738 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e50ef1ad-e693-495c-a33f-51e8d7de1972 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:00.801638 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e50ef1ad-e693-495c-a33f-51e8d7de1972 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:00.803086 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e50ef1ad-e693-495c-a33f-51e8d7de1972 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:00.804319 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e50ef1ad-e693-495c-a33f-51e8d7de1972 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68" status: 200 len: 1813 microversion: 2.25 time: 0.373015 Oct 17 13:42:00.805080 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1046/2093] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:42:00 2022] GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68 => generated 1813 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:42:00.825824 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-22633484-7df9-409f-afbe-2c24254bcfb9 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:00.826741 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-22633484-7df9-409f-afbe-2c24254bcfb9 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9044674d-a793-46c2-b3ec-e9377b30f253] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:00.833597 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-22633484-7df9-409f-afbe-2c24254bcfb9 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:00.834081 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-22633484-7df9-409f-afbe-2c24254bcfb9 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:00.834501 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-22633484-7df9-409f-afbe-2c24254bcfb9 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:00.835222 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-22633484-7df9-409f-afbe-2c24254bcfb9 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:00.836322 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-22633484-7df9-409f-afbe-2c24254bcfb9 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:00.836831 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-22633484-7df9-409f-afbe-2c24254bcfb9 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:00.844610 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0fc959fc-7ae0-4bf3-b471-36d472703e60 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.453755 Oct 17 13:42:00.846300 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1048/2094] 10.222.0.79 () {60 vars in 1180 bytes} [Mon Oct 17 13:42:00 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:42:00.852276 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-04b7c1ee-3361-4253-b3b6-5f1926b46210 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd52258b0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:00.921383 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-04b7c1ee-3361-4253-b3b6-5f1926b46210 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/cc998ca8-905d-4b7f-baab-14bfc5cec9ff" status: 200 len: 1414 microversion: 2.1 time: 0.073418 Oct 17 13:42:00.927893 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1049/2095] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:42:00 2022] GET /compute/v2.1/images/cc998ca8-905d-4b7f-baab-14bfc5cec9ff => generated 1414 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:00.941176 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1cdd4422-f2bc-4ff1-959a-7bf8e06f589b tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:00.946486 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1cdd4422-f2bc-4ff1-959a-7bf8e06f589b tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:00.947002 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1cdd4422-f2bc-4ff1-959a-7bf8e06f589b tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:00.947463 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1cdd4422-f2bc-4ff1-959a-7bf8e06f589b tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:00.948406 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1cdd4422-f2bc-4ff1-959a-7bf8e06f589b tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:00.948849 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1cdd4422-f2bc-4ff1-959a-7bf8e06f589b tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:00.949275 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1cdd4422-f2bc-4ff1-959a-7bf8e06f589b tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:00.958625 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=19 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:42:00.983363 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1cdd4422-f2bc-4ff1-959a-7bf8e06f589b tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.053762 Oct 17 13:42:00.984403 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1050/2096] 10.222.0.79 () {60 vars in 1178 bytes} [Mon Oct 17 13:42:00 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:42:00.998830 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7789e0c5-8113-4161-81f1-5e0f6ec00ec3 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Action: 'create', calling method: .version_select at 0x7f7cd9a8b940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1358348481", "description": "tempest-description-1311690849"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:42:01.154033 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-22633484-7df9-409f-afbe-2c24254bcfb9 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:01.162440 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-22633484-7df9-409f-afbe-2c24254bcfb9 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253" status: 200 len: 1517 microversion: 2.1 time: 0.342857 Oct 17 13:42:01.163041 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1047/2097] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:00 2022] GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253 => generated 1517 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:01.183725 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-37949bfb-61e0-4bc2-8689-669719aa0267 req-7b8df536-3dd6-495d-b60b-7383f2cfedc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95418c39-6c0a-444e-93b4-4a90b31f3034", "name": "network-vif-plugged", "status": "completed", "tag": "6ebf3968-13ef-4f4d-8666-1d89782149bf"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:42:01.193729 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-37949bfb-61e0-4bc2-8689-669719aa0267 req-7b8df536-3dd6-495d-b60b-7383f2cfedc5 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:01.194113 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-37949bfb-61e0-4bc2-8689-669719aa0267 req-7b8df536-3dd6-495d-b60b-7383f2cfedc5 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:01.194541 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-37949bfb-61e0-4bc2-8689-669719aa0267 req-7b8df536-3dd6-495d-b60b-7383f2cfedc5 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:01.206207 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-37949bfb-61e0-4bc2-8689-669719aa0267 req-7b8df536-3dd6-495d-b60b-7383f2cfedc5 service nova] Creating event network-vif-plugged:6ebf3968-13ef-4f4d-8666-1d89782149bf for instance 95418c39-6c0a-444e-93b4-4a90b31f3034 on n-h1-854247-14 Oct 17 13:42:01.211228 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-37949bfb-61e0-4bc2-8689-669719aa0267 req-7b8df536-3dd6-495d-b60b-7383f2cfedc5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031463 Oct 17 13:42:01.211933 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1048/2098] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:42:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:42:01.217420 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6f1a3fc5-6f0a-4d32-94b0-46addc43f2f6 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd5533dc0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:01.283943 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6f1a3fc5-6f0a-4d32-94b0-46addc43f2f6 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/cc998ca8-905d-4b7f-baab-14bfc5cec9ff" status: 200 len: 1414 microversion: 2.1 time: 0.070776 Oct 17 13:42:01.285482 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1049/2099] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:42:01 2022] GET /compute/v2.1/images/cc998ca8-905d-4b7f-baab-14bfc5cec9ff => generated 1414 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:01.290475 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-69f65d67-8cdb-4215-9d31-efee9b63e8d0 tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:01.295445 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-69f65d67-8cdb-4215-9d31-efee9b63e8d0 tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:01.296337 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-69f65d67-8cdb-4215-9d31-efee9b63e8d0 tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:01.296779 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-69f65d67-8cdb-4215-9d31-efee9b63e8d0 tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:01.297573 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-69f65d67-8cdb-4215-9d31-efee9b63e8d0 tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:01.298026 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-69f65d67-8cdb-4215-9d31-efee9b63e8d0 tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:01.298451 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-69f65d67-8cdb-4215-9d31-efee9b63e8d0 tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:01.325214 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-69f65d67-8cdb-4215-9d31-efee9b63e8d0 tempest-ServicesAdminNegativeV253TestJSON-384941823 tempest-ServicesAdminNegativeV253TestJSON-384941823-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.038350 Oct 17 13:42:01.325840 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1050/2100] 10.222.0.79 () {60 vars in 1239 bytes} [Mon Oct 17 13:42:01 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:01.330338 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d633fa30-ec00-4ba9-9770-c9c4d8f26d9d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:01.331059 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d633fa30-ec00-4ba9-9770-c9c4d8f26d9d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] [instance: d30452eb-38cd-413a-9369-f60aad1d31bb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:01.338191 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d633fa30-ec00-4ba9-9770-c9c4d8f26d9d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:01.338794 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d633fa30-ec00-4ba9-9770-c9c4d8f26d9d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:01.339516 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d633fa30-ec00-4ba9-9770-c9c4d8f26d9d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:01.340258 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d633fa30-ec00-4ba9-9770-c9c4d8f26d9d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:01.340709 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d633fa30-ec00-4ba9-9770-c9c4d8f26d9d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:01.341129 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d633fa30-ec00-4ba9-9770-c9c4d8f26d9d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:01.355849 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-d633fa30-ec00-4ba9-9770-c9c4d8f26d9d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] HTTP exception thrown: Instance d30452eb-38cd-413a-9369-f60aad1d31bb could not be found. Oct 17 13:42:01.357536 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d633fa30-ec00-4ba9-9770-c9c4d8f26d9d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Request method failure captured: Oct 17 13:42:01.357536 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/d30452eb-38cd-413a-9369-f60aad1d31bb HTTP/1.1 Oct 17 13:42:01.357536 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:42:01.357536 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:42:01.357536 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:42:01.357536 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:42:01.357536 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:42:01.357536 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:42:01.357536 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:42:01.357536 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:42:01.357536 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVslGtfdVSFrsbyAcibzm0QXeRfl7TdWgYNhhlDyieORwCEkTfFGyTqr2WajwaAPNWK_AwX9JHLnmfr1P3N1cRURlSaeSBTg8P3Vz51fs8eLQdrtDUCemS3C_9thFZYd0WRnVCXSd9OXtGY8dne0GASBJP5SvJ5N5pr9LQSsaCW0nS4 Oct 17 13:42:01.357536 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:42:01.357536 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:42:01.357536 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:42:01.357536 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:42:01.357536 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:42:01.357536 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:42:01.357536 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 66d121d0b216416592c7048c2a46f625 Oct 17 13:42:01.357536 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ListServerFiltersTestJSON-1908686196 Oct 17 13:42:01.357536 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:42:01.357536 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:42:01.357536 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/66d121d0b216416592c7048c2a46f625"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/66d121d0b216416592c7048c2a46f625"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/66d121d0b216416592c7048c2a46f625"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_66d121d0b216416592c7048c2a46f625", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:42:01.357536 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ListServerFiltersTestJSON-1908686196 Oct 17 13:42:01.357536 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 66d121d0b216416592c7048c2a46f625 Oct 17 13:42:01.357536 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1908686196 Oct 17 13:42:01.357536 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ListServerFiltersTestJSON-1908686196-project Oct 17 13:42:01.357536 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:42:01.357536 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:42:01.357536 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: b849e8b87a4b49ffa7ad2dd6e95260aa Oct 17 13:42:01.357536 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ListServerFiltersTestJSON-1908686196-project Oct 17 13:42:01.357536 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:42:01.357536 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance d30452eb-38cd-413a-9369-f60aad1d31bb could not be found. Oct 17 13:42:01.357536 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'd30452eb-38cd-413a-9369-f60aad1d31bb'} Oct 17 13:42:01.357536 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:42:01.357536 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:01.357536 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:42:01.357536 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:42:01.357536 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:42:01.357536 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:42:01.357536 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:42:01.357536 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:42:01.357536 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:42:01.357536 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:42:01.357536 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d30452eb-38cd-413a-9369-f60aad1d31bb could not be found. Oct 17 13:42:01.357536 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:01.357536 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:01.357536 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:01.357536 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:01.357536 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:01.357536 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:01.357536 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:42:01.357536 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:42:01.357536 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:42:01.357536 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:42:01.357536 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:42:01.357536 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:42:01.357536 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:42:01.357536 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:42:01.357536 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:42:01.357536 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:42:01.357536 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d30452eb-38cd-413a-9369-f60aad1d31bb could not be found. Oct 17 13:42:01.357536 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:01.357536 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:01.357536 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:01.364132 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:01.364132 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:01.364132 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:01.364132 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:42:01.364132 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:42:01.364132 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d30452eb-38cd-413a-9369-f60aad1d31bb could not be found. Oct 17 13:42:01.364132 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:01.364132 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d633fa30-ec00-4ba9-9770-c9c4d8f26d9d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Returning 404 to user: Instance d30452eb-38cd-413a-9369-f60aad1d31bb could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:42:01.364132 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d633fa30-ec00-4ba9-9770-c9c4d8f26d9d tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers/d30452eb-38cd-413a-9369-f60aad1d31bb" status: 404 len: 111 microversion: 2.1 time: 0.032134 Oct 17 13:42:01.364132 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1051/2101] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:01 2022] GET /compute/v2.1/servers/d30452eb-38cd-413a-9369-f60aad1d31bb => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:42:01.367380 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2bba6c0e-af63-4d94-b8d4-a856095bde6e tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd4fedc10>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:01.394325 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7789e0c5-8113-4161-81f1-5e0f6ec00ec3 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.408190 Oct 17 13:42:01.394975 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1051/2102] 10.222.0.79 () {60 vars in 1180 bytes} [Mon Oct 17 13:42:00 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:42:01.549628 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ad0c7ff1-f8f8-4781-a840-e1d0a93f9a27 tempest-ServicesAdminNegativeV253TestJSON-343930723 tempest-ServicesAdminNegativeV253TestJSON-343930723-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:01.554986 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ad0c7ff1-f8f8-4781-a840-e1d0a93f9a27 tempest-ServicesAdminNegativeV253TestJSON-343930723 tempest-ServicesAdminNegativeV253TestJSON-343930723-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'a7cef0b77fc34c1fbc0b34a29527f1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a28d5d68d2fa40ffb9374e28a5f09a51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:01.558218 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ad0c7ff1-f8f8-4781-a840-e1d0a93f9a27 tempest-ServicesAdminNegativeV253TestJSON-343930723 tempest-ServicesAdminNegativeV253TestJSON-343930723-project] Request method failure captured: Oct 17 13:42:01.558218 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 17 13:42:01.558218 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:42:01.558218 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:42:01.558218 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:42:01.558218 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:42:01.558218 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:42:01.558218 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:42:01.558218 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:42:01.558218 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:42:01.558218 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVuh8vE7IbxrcrJzhEEq-jQSl3RmKXcJq8Lzu6SM__sw7CcsSOjKHQtEs4xcCLC9dmGoQnRg_50GpTHJvGNg87IEgrIUX_1VeyoH2F6oJMKX4YHDTCnQ3AVPEwwQgo0lOBKBCG6utzfRRPsQ1V6z9y_gJWQyo27RDAu8cnkti5bBWkM Oct 17 13:42:01.558218 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:42:01.558218 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:42:01.558218 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:42:01.558218 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:42:01.558218 n-d-854247-14 devstack@n-api.service[127017]: X-Openstack-Nova-Api-Version: 2.53 Oct 17 13:42:01.558218 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:42:01.558218 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:42:01.558218 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: a28d5d68d2fa40ffb9374e28a5f09a51 Oct 17 13:42:01.558218 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-343930723 Oct 17 13:42:01.558218 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:42:01.558218 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:42:01.558218 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a28d5d68d2fa40ffb9374e28a5f09a51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a28d5d68d2fa40ffb9374e28a5f09a51"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a28d5d68d2fa40ffb9374e28a5f09a51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a28d5d68d2fa40ffb9374e28a5f09a51", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:42:01.558218 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-343930723 Oct 17 13:42:01.558218 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: a28d5d68d2fa40ffb9374e28a5f09a51 Oct 17 13:42:01.558218 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-343930723 Oct 17 13:42:01.558218 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServicesAdminNegativeV253TestJSON-343930723-project Oct 17 13:42:01.558218 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:42:01.558218 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:42:01.558218 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: a7cef0b77fc34c1fbc0b34a29527f1e8 Oct 17 13:42:01.558218 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-343930723-project Oct 17 13:42:01.558218 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:42:01.558218 n-d-854247-14 devstack@n-api.service[127017]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 17 13:42:01.558218 n-d-854247-14 devstack@n-api.service[127017]: action_args: {} Oct 17 13:42:01.558218 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:42:01.558218 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:01.558218 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:01.558218 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:01.558218 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:42:01.558218 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:42:01.558218 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 13:42:01.558218 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:42:01.558218 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 13:42:01.558218 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:42:01.558218 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:42:01.558218 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:42:01.558218 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 17 13:42:01.558218 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 17 13:42:01.558218 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:42:01.558218 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:42:01.558218 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:42:01.558218 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:42:01.558218 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:42:01.558218 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:42:01.558218 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:42:01.558218 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:42:01.558218 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:42:01.558218 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:42:01.558218 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:42:01.558218 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:42:01.558218 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:42:01.558218 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:42:01.558218 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 17 13:42:01.564867 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:42:01.564867 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:01.564867 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:42:01.564867 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:01.564867 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:01.564867 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:01.564867 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:42:01.564867 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:42:01.564867 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 17 13:42:01.564867 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:42:01.564867 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ad0c7ff1-f8f8-4781-a840-e1d0a93f9a27 tempest-ServicesAdminNegativeV253TestJSON-343930723 tempest-ServicesAdminNegativeV253TestJSON-343930723-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:42:01.564867 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ad0c7ff1-f8f8-4781-a840-e1d0a93f9a27 tempest-ServicesAdminNegativeV253TestJSON-343930723 tempest-ServicesAdminNegativeV253TestJSON-343930723-project] 10.222.0.79 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.163820 Oct 17 13:42:01.564867 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1052/2103] 10.222.0.79 () {60 vars in 1178 bytes} [Mon Oct 17 13:42:01 2022] GET /compute/v2.1/os-services => generated 112 bytes in 165 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:42:01.572856 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bf538bb2-3a32-4a9c-aafa-ef23d61c4750 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:01.574925 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-bf538bb2-3a32-4a9c-aafa-ef23d61c4750 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] [instance: 3d4188da-b0f7-4d97-952b-acebaa48f185] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:01.585777 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bf538bb2-3a32-4a9c-aafa-ef23d61c4750 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:01.586751 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bf538bb2-3a32-4a9c-aafa-ef23d61c4750 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:01.587408 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bf538bb2-3a32-4a9c-aafa-ef23d61c4750 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:01.588576 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bf538bb2-3a32-4a9c-aafa-ef23d61c4750 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:01.589883 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bf538bb2-3a32-4a9c-aafa-ef23d61c4750 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:01.590518 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bf538bb2-3a32-4a9c-aafa-ef23d61c4750 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:01.595959 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2bba6c0e-af63-4d94-b8d4-a856095bde6e tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "DELETE /compute/v2.1/images/cc998ca8-905d-4b7f-baab-14bfc5cec9ff" status: 204 len: 0 microversion: 2.1 time: 0.232191 Oct 17 13:42:01.596786 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1052/2104] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:01 2022] DELETE /compute/v2.1/images/cc998ca8-905d-4b7f-baab-14bfc5cec9ff => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:42:01.602268 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-edd6206c-8712-45a0-8387-30a000439c04 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Calling method '.version_select at 0x7f7cd5533280>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:01.640390 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-bf538bb2-3a32-4a9c-aafa-ef23d61c4750 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] [instance: 3d4188da-b0f7-4d97-952b-acebaa48f185] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:42:01.760795 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:42:01.789595 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-bf538bb2-3a32-4a9c-aafa-ef23d61c4750 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3d4188da-b0f7-4d97-952b-acebaa48f185" status: 204 len: 0 microversion: 2.1 time: 0.225579 Oct 17 13:42:01.795635 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1053/2105] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:42:01 2022] DELETE /compute/v2.1/servers/3d4188da-b0f7-4d97-952b-acebaa48f185 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:42:01.807641 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3a249537-93ab-4893-ad50-28b7c1b7488d tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:01.812955 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3a249537-93ab-4893-ad50-28b7c1b7488d tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] [instance: 95418c39-6c0a-444e-93b4-4a90b31f3034] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:01.833225 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3a249537-93ab-4893-ad50-28b7c1b7488d tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:01.834304 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3a249537-93ab-4893-ad50-28b7c1b7488d tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:01.834751 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3a249537-93ab-4893-ad50-28b7c1b7488d tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:01.837405 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3a249537-93ab-4893-ad50-28b7c1b7488d tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:01.837946 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3a249537-93ab-4893-ad50-28b7c1b7488d tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:01.839487 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3a249537-93ab-4893-ad50-28b7c1b7488d tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:02.041174 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-edd6206c-8712-45a0-8387-30a000439c04 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "GET /compute/v2.1/os-security-groups" status: 200 len: 1831 microversion: 2.1 time: 0.443043 Oct 17 13:42:02.042176 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1053/2106] 10.222.0.79 () {58 vars in 1158 bytes} [Mon Oct 17 13:42:01 2022] GET /compute/v2.1/os-security-groups => generated 1831 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:02.049602 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-28018990-59f5-45f7-8933-24ed7f611bd9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd5404430>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:02.103951 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3a249537-93ab-4893-ad50-28b7c1b7488d tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b891d3b774e44de3ad1d3088990f6bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358604dd1cf74e5fab262179351d4d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:02.109059 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-28018990-59f5-45f7-8933-24ed7f611bd9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] HTTP exception thrown: Image not found. Oct 17 13:42:02.110948 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-28018990-59f5-45f7-8933-24ed7f611bd9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Request method failure captured: Oct 17 13:42:02.110948 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/images/cc998ca8-905d-4b7f-baab-14bfc5cec9ff HTTP/1.1 Oct 17 13:42:02.110948 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:42:02.110948 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:42:02.110948 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:42:02.110948 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:42:02.110948 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:42:02.110948 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:42:02.110948 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:42:02.110948 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:42:02.110948 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVpcWSwKjkgHu1pOrzJj6HiDQ9hS6xF0hnYpT-9MjemVLwNDzCl7w6ETLwt3fC-SanrMXYSA6kHfWUvQJu5a3Y3I946ESkVOejyjKOR-whNFZHQOyDE2dNW3q_jrKN41Sl71zQIcHHv_pCPQ5Cu97jE35pUEh3xL0sRiioyX-jyds1o Oct 17 13:42:02.110948 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:42:02.110948 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:42:02.110948 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:42:02.110948 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:42:02.110948 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:42:02.110948 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:42:02.110948 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 461c44cb99ff4958a128679d3e10cd6f Oct 17 13:42:02.110948 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ImagesTestJSON-1110552804 Oct 17 13:42:02.110948 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:42:02.110948 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:42:02.110948 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/461c44cb99ff4958a128679d3e10cd6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/461c44cb99ff4958a128679d3e10cd6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/461c44cb99ff4958a128679d3e10cd6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_461c44cb99ff4958a128679d3e10cd6f", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:42:02.110948 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ImagesTestJSON-1110552804 Oct 17 13:42:02.110948 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 461c44cb99ff4958a128679d3e10cd6f Oct 17 13:42:02.110948 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ImagesTestJSON-1110552804 Oct 17 13:42:02.110948 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ImagesTestJSON-1110552804-project Oct 17 13:42:02.110948 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:42:02.110948 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:42:02.110948 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 386397fd9194430b81ac465f9b3bf92d Oct 17 13:42:02.110948 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ImagesTestJSON-1110552804-project Oct 17 13:42:02.110948 n-d-854247-14 devstack@n-api.service[127016]: method: Oct 17 13:42:02.110948 n-d-854247-14 devstack@n-api.service[127016]: exception: Image not found. Oct 17 13:42:02.110948 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'cc998ca8-905d-4b7f-baab-14bfc5cec9ff'} Oct 17 13:42:02.110948 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:42:02.110948 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:02.110948 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 13:42:02.110948 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 13:42:02.110948 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:42:02.110948 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:42:02.110948 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 13:42:02.110948 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 13:42:02.110948 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:42:02.110948 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:42:02.110948 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 13:42:02.110948 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 13:42:02.110948 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 13:42:02.110948 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 13:42:02.110948 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:42:02.110948 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:42:02.110948 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:42:02.110948 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:42:02.110948 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID cc998ca8-905d-4b7f-baab-14bfc5cec9ff Oct 17 13:42:02.110948 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:02.110948 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:02.110948 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:02.110948 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:02.110948 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 17 13:42:02.110948 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 17 13:42:02.110948 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 17 13:42:02.110948 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 17 13:42:02.110948 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 17 13:42:02.110948 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 17 13:42:02.110948 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 17 13:42:02.110948 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 17 13:42:02.115916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 13:42:02.115916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 13:42:02.115916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:42:02.115916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:42:02.115916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 13:42:02.115916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 13:42:02.115916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:42:02.115916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:42:02.115916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 13:42:02.115916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 13:42:02.115916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 13:42:02.115916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 13:42:02.115916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:42:02.115916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:42:02.115916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:42:02.115916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:42:02.115916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cc998ca8-905d-4b7f-baab-14bfc5cec9ff could not be found. Oct 17 13:42:02.115916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:02.115916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:02.115916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:02.115916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:02.115916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:02.115916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:02.115916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:42:02.115916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:42:02.115916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:42:02.115916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:42:02.115916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:42:02.115916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:42:02.115916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 17 13:42:02.115916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 13:42:02.115916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 13:42:02.115916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:02.115916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:02.115916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:02.115916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:02.115916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:02.115916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:02.115916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:42:02.115916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:42:02.115916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 13:42:02.115916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:02.123936 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-28018990-59f5-45f7-8933-24ed7f611bd9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Returning 404 to user: Image not found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:42:02.124834 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-28018990-59f5-45f7-8933-24ed7f611bd9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/images/cc998ca8-905d-4b7f-baab-14bfc5cec9ff" status: 404 len: 62 microversion: 2.1 time: 0.081096 Oct 17 13:42:02.127584 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1054/2107] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:42:02 2022] GET /compute/v2.1/images/cc998ca8-905d-4b7f-baab-14bfc5cec9ff => generated 62 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:42:02.134291 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3a249537-93ab-4893-ad50-28b7c1b7488d tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] 10.222.0.79 "GET /compute/v2.1/servers/95418c39-6c0a-444e-93b4-4a90b31f3034" status: 200 len: 1401 microversion: 2.1 time: 0.336303 Oct 17 13:42:02.136807 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4b12292b-ae62-421c-b50e-a3726ab5a1fb tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:02.139044 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4b12292b-ae62-421c-b50e-a3726ab5a1fb tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] [instance: 3d4188da-b0f7-4d97-952b-acebaa48f185] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:02.143740 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1054/2108] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:01 2022] GET /compute/v2.1/servers/95418c39-6c0a-444e-93b4-4a90b31f3034 => generated 1401 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:02.156338 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-99708a61-1aef-40b6-9429-ca653e871713 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:02.156958 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-99708a61-1aef-40b6-9429-ca653e871713 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 709d926d-fba5-49ea-84ac-95d8bb018c68] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:02.159157 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4b12292b-ae62-421c-b50e-a3726ab5a1fb tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:02.159702 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4b12292b-ae62-421c-b50e-a3726ab5a1fb tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:02.160137 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4b12292b-ae62-421c-b50e-a3726ab5a1fb tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:02.160859 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4b12292b-ae62-421c-b50e-a3726ab5a1fb tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:02.165167 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-99708a61-1aef-40b6-9429-ca653e871713 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:02.165997 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-99708a61-1aef-40b6-9429-ca653e871713 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:02.167835 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-99708a61-1aef-40b6-9429-ca653e871713 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:02.169075 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-99708a61-1aef-40b6-9429-ca653e871713 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:02.170229 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-99708a61-1aef-40b6-9429-ca653e871713 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:02.170355 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4b12292b-ae62-421c-b50e-a3726ab5a1fb tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:02.170868 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4b12292b-ae62-421c-b50e-a3726ab5a1fb tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:02.171289 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-99708a61-1aef-40b6-9429-ca653e871713 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:02.416304 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-99708a61-1aef-40b6-9429-ca653e871713 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:02.431694 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-99708a61-1aef-40b6-9429-ca653e871713 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:02.436433 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-99708a61-1aef-40b6-9429-ca653e871713 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:02.439631 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-99708a61-1aef-40b6-9429-ca653e871713 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68" status: 200 len: 1813 microversion: 2.25 time: 0.294674 Oct 17 13:42:02.456299 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1055/2109] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:42:02 2022] GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68 => generated 1813 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:42:02.473567 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-77363947-5202-4214-a296-39129db5ebbb tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Calling method '.version_select at 0x7f7cd9a144c0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:02.515666 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4b12292b-ae62-421c-b50e-a3726ab5a1fb tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:02.527039 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4b12292b-ae62-421c-b50e-a3726ab5a1fb tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers/3d4188da-b0f7-4d97-952b-acebaa48f185" status: 200 len: 1518 microversion: 2.1 time: 0.397824 Oct 17 13:42:02.529568 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1055/2110] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:02 2022] GET /compute/v2.1/servers/3d4188da-b0f7-4d97-952b-acebaa48f185 => generated 1518 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:02.544802 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-93584315-d266-4a7c-9c77-416084e84df9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:02.545600 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-93584315-d266-4a7c-9c77-416084e84df9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 3e1d2587-26db-449e-81cd-677ce4f87a76] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:02.561409 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-93584315-d266-4a7c-9c77-416084e84df9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:02.563507 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-93584315-d266-4a7c-9c77-416084e84df9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:02.564610 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-93584315-d266-4a7c-9c77-416084e84df9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:02.567316 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-93584315-d266-4a7c-9c77-416084e84df9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:02.568074 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-93584315-d266-4a7c-9c77-416084e84df9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:02.570417 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-93584315-d266-4a7c-9c77-416084e84df9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:02.952148 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-93584315-d266-4a7c-9c77-416084e84df9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:02.955975 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:42:02.969006 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-93584315-d266-4a7c-9c77-416084e84df9 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/3e1d2587-26db-449e-81cd-677ce4f87a76" status: 200 len: 1505 microversion: 2.1 time: 0.434563 Oct 17 13:42:02.980085 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1056/2111] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:02 2022] GET /compute/v2.1/servers/3e1d2587-26db-449e-81cd-677ce4f87a76 => generated 1505 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:02.984112 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-77363947-5202-4214-a296-39129db5ebbb tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/cfeb08ea-35da-4ac9-b744-670b918ca956" status: 202 len: 0 microversion: 2.1 time: 0.525864 Oct 17 13:42:02.985361 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1056/2112] 10.222.0.79 () {58 vars in 1272 bytes} [Mon Oct 17 13:42:02 2022] DELETE /compute/v2.1/os-security-groups/cfeb08ea-35da-4ac9-b744-670b918ca956 => generated 0 bytes in 528 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:42:02.993506 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-fdb617a0-ec9a-4352-83d1-0b4a175f73c4 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Calling method '.version_select at 0x7f7cd989a160>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:02.996637 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a33518db-58dd-4f00-919c-b559f11a8430 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:02.997613 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a33518db-58dd-4f00-919c-b559f11a8430 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9044674d-a793-46c2-b3ec-e9377b30f253] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:03.006618 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a33518db-58dd-4f00-919c-b559f11a8430 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:03.008126 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a33518db-58dd-4f00-919c-b559f11a8430 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:03.008930 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a33518db-58dd-4f00-919c-b559f11a8430 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:03.010747 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a33518db-58dd-4f00-919c-b559f11a8430 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:03.011666 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a33518db-58dd-4f00-919c-b559f11a8430 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:03.012218 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a33518db-58dd-4f00-919c-b559f11a8430 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:03.090190 n-d-854247-14 devstack@n-api.service[127017]: DEBUG neutronclient.v2_0.client [None req-fdb617a0-ec9a-4352-83d1-0b4a175f73c4 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group cfeb08ea-35da-4ac9-b744-670b918ca956 does not exist", "detail": ""}} {{(pid=127017) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 13:42:03.090842 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.security_group_api [None req-fdb617a0-ec9a-4352-83d1-0b4a175f73c4 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Neutron security group cfeb08ea-35da-4ac9-b744-670b918ca956 not found {{(pid=127017) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 17 13:42:03.091429 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-fdb617a0-ec9a-4352-83d1-0b4a175f73c4 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] HTTP exception thrown: Security group cfeb08ea-35da-4ac9-b744-670b918ca956 does not exist Oct 17 13:42:03.091429 n-d-854247-14 devstack@n-api.service[127017]: Neutron server returns request_ids: ['req-82299079-011d-4d7d-ba4d-5ec42d33a67c'] Oct 17 13:42:03.094073 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-fdb617a0-ec9a-4352-83d1-0b4a175f73c4 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Request method failure captured: Oct 17 13:42:03.094073 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/os-security-groups/cfeb08ea-35da-4ac9-b744-670b918ca956 HTTP/1.1 Oct 17 13:42:03.094073 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:42:03.094073 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:42:03.094073 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:42:03.094073 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:42:03.094073 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:42:03.094073 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:42:03.094073 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:42:03.094073 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:42:03.094073 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVtyFGyYtLVdwIq4ccz7RkXRa7NtlbhzSHc2HUbc2jnmH2QeepBwxbKf8toXm_ooPcHi9ET43LtT1AqXtRk9n6taXXPkcxvI9DAvMm-WduwoIrQJqrIBPqw0m6vAgqbSuo42q0EeC3f0tZCzBhE1QaAtaHcB-dTJTCp89NqtuNhDPjU Oct 17 13:42:03.094073 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:42:03.094073 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:42:03.094073 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:42:03.094073 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:42:03.094073 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:42:03.094073 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:42:03.094073 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 50c0147c5fae4017810887843b0afaa0 Oct 17 13:42:03.094073 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-SecurityGroupsTestJSON-1412652742 Oct 17 13:42:03.094073 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:42:03.094073 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:42:03.094073 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/50c0147c5fae4017810887843b0afaa0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/50c0147c5fae4017810887843b0afaa0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/50c0147c5fae4017810887843b0afaa0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_50c0147c5fae4017810887843b0afaa0", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:42:03.094073 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-SecurityGroupsTestJSON-1412652742 Oct 17 13:42:03.094073 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 50c0147c5fae4017810887843b0afaa0 Oct 17 13:42:03.094073 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1412652742 Oct 17 13:42:03.094073 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-SecurityGroupsTestJSON-1412652742-project Oct 17 13:42:03.094073 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:42:03.094073 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:42:03.094073 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 185235bc4e3245fc8d92b7e4bff6cbbd Oct 17 13:42:03.094073 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-SecurityGroupsTestJSON-1412652742-project Oct 17 13:42:03.094073 n-d-854247-14 devstack@n-api.service[127017]: method: Oct 17 13:42:03.094073 n-d-854247-14 devstack@n-api.service[127017]: exception: Security group cfeb08ea-35da-4ac9-b744-670b918ca956 does not exist Oct 17 13:42:03.094073 n-d-854247-14 devstack@n-api.service[127017]: Neutron server returns request_ids: ['req-82299079-011d-4d7d-ba4d-5ec42d33a67c'] Oct 17 13:42:03.094073 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'cfeb08ea-35da-4ac9-b744-670b918ca956'} Oct 17 13:42:03.094073 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:42:03.094073 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:03.094073 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 17 13:42:03.094073 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 17 13:42:03.094073 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:03.094073 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:03.094073 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 17 13:42:03.094073 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 17 13:42:03.094073 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:03.094073 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:03.094073 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 13:42:03.094073 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 13:42:03.094073 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:03.094073 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:03.094073 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 13:42:03.094073 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 13:42:03.094073 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:03.094073 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:03.094073 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 13:42:03.094073 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 13:42:03.094073 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:03.094073 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:03.094073 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 13:42:03.094073 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 13:42:03.094073 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 13:42:03.094073 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 13:42:03.094073 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group cfeb08ea-35da-4ac9-b744-670b918ca956 does not exist Oct 17 13:42:03.099543 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-82299079-011d-4d7d-ba4d-5ec42d33a67c'] Oct 17 13:42:03.099543 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:42:03.099543 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:03.099543 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:42:03.099543 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:03.099543 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 17 13:42:03.099543 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 17 13:42:03.099543 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 17 13:42:03.099543 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 13:42:03.099543 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group cfeb08ea-35da-4ac9-b744-670b918ca956 does not exist Oct 17 13:42:03.099543 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-82299079-011d-4d7d-ba4d-5ec42d33a67c'] Oct 17 13:42:03.099543 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:42:03.099543 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:03.099543 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:42:03.099543 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:03.099543 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:03.099543 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:03.099543 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:42:03.099543 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:42:03.099543 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:42:03.099543 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:42:03.099543 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:42:03.099543 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:42:03.099543 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 17 13:42:03.099543 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 17 13:42:03.099543 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group cfeb08ea-35da-4ac9-b744-670b918ca956 does not exist Oct 17 13:42:03.099543 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-82299079-011d-4d7d-ba4d-5ec42d33a67c'] Oct 17 13:42:03.099543 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:42:03.099543 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:03.099543 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:42:03.099543 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:03.099543 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:03.099543 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:03.099543 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:42:03.099543 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:42:03.099543 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group cfeb08ea-35da-4ac9-b744-670b918ca956 does not exist Oct 17 13:42:03.099543 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-82299079-011d-4d7d-ba4d-5ec42d33a67c'] Oct 17 13:42:03.099543 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:42:03.099543 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-fdb617a0-ec9a-4352-83d1-0b4a175f73c4 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Returning 404 to user: Security group cfeb08ea-35da-4ac9-b744-670b918ca956 does not exist Oct 17 13:42:03.099543 n-d-854247-14 devstack@n-api.service[127017]: Neutron server returns request_ids: ['req-82299079-011d-4d7d-ba4d-5ec42d33a67c'] {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:42:03.099543 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-fdb617a0-ec9a-4352-83d1-0b4a175f73c4 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "GET /compute/v2.1/os-security-groups/cfeb08ea-35da-4ac9-b744-670b918ca956" status: 404 len: 194 microversion: 2.1 time: 0.106337 Oct 17 13:42:03.099543 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1057/2113] 10.222.0.79 () {58 vars in 1269 bytes} [Mon Oct 17 13:42:02 2022] GET /compute/v2.1/os-security-groups/cfeb08ea-35da-4ac9-b744-670b918ca956 => generated 194 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:42:03.111688 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1c384b12-88e9-4bcc-a0ec-712c96f2d952 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Calling method '.version_select at 0x7f7cd9a8b4c0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:03.399850 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a33518db-58dd-4f00-919c-b559f11a8430 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:03.409364 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a33518db-58dd-4f00-919c-b559f11a8430 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253" status: 200 len: 1517 microversion: 2.1 time: 0.419783 Oct 17 13:42:03.423648 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1057/2114] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:02 2022] GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253 => generated 1517 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:03.433618 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d35ef6fd-226c-482c-9895-fd36e30241db tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:03.434646 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d35ef6fd-226c-482c-9895-fd36e30241db tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] [instance: 95418c39-6c0a-444e-93b4-4a90b31f3034] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:03.441135 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:42:03.442893 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d35ef6fd-226c-482c-9895-fd36e30241db tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:03.443884 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d35ef6fd-226c-482c-9895-fd36e30241db tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:03.444566 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d35ef6fd-226c-482c-9895-fd36e30241db tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:03.445500 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d35ef6fd-226c-482c-9895-fd36e30241db tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:03.446188 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d35ef6fd-226c-482c-9895-fd36e30241db tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:03.446839 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d35ef6fd-226c-482c-9895-fd36e30241db tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:04.637734 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1c384b12-88e9-4bcc-a0ec-712c96f2d952 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/5ca54317-7291-4571-a040-4e4a3c88432f" status: 202 len: 0 microversion: 2.1 time: 1.531484 Oct 17 13:42:04.640174 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1058/2115] 10.222.0.79 () {58 vars in 1272 bytes} [Mon Oct 17 13:42:03 2022] DELETE /compute/v2.1/os-security-groups/5ca54317-7291-4571-a040-4e4a3c88432f => generated 0 bytes in 1535 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:42:04.646791 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9b7c6acf-bc88-4d07-acfc-9198d196b0c9 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:04.647861 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9b7c6acf-bc88-4d07-acfc-9198d196b0c9 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 709d926d-fba5-49ea-84ac-95d8bb018c68] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:04.667507 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9b7c6acf-bc88-4d07-acfc-9198d196b0c9 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:04.669613 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9b7c6acf-bc88-4d07-acfc-9198d196b0c9 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:04.670690 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9b7c6acf-bc88-4d07-acfc-9198d196b0c9 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:04.673555 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9b7c6acf-bc88-4d07-acfc-9198d196b0c9 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:04.674291 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9b7c6acf-bc88-4d07-acfc-9198d196b0c9 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:04.675740 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9b7c6acf-bc88-4d07-acfc-9198d196b0c9 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:04.795958 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d35ef6fd-226c-482c-9895-fd36e30241db tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b891d3b774e44de3ad1d3088990f6bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358604dd1cf74e5fab262179351d4d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:04.804762 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d35ef6fd-226c-482c-9895-fd36e30241db tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] 10.222.0.79 "GET /compute/v2.1/servers/95418c39-6c0a-444e-93b4-4a90b31f3034" status: 200 len: 1401 microversion: 2.1 time: 1.379668 Oct 17 13:42:04.806535 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1058/2116] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:03 2022] GET /compute/v2.1/servers/95418c39-6c0a-444e-93b4-4a90b31f3034 => generated 1401 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:04.815099 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-283238f3-0993-415e-a667-faf32f5dc8a9 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:04.823735 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-283238f3-0993-415e-a667-faf32f5dc8a9 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] [instance: 3d4188da-b0f7-4d97-952b-acebaa48f185] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:04.845358 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-283238f3-0993-415e-a667-faf32f5dc8a9 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:04.847054 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-283238f3-0993-415e-a667-faf32f5dc8a9 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:04.856196 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-283238f3-0993-415e-a667-faf32f5dc8a9 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:04.857643 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-283238f3-0993-415e-a667-faf32f5dc8a9 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:04.860043 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-283238f3-0993-415e-a667-faf32f5dc8a9 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:04.860822 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-283238f3-0993-415e-a667-faf32f5dc8a9 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:05.494619 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9b7c6acf-bc88-4d07-acfc-9198d196b0c9 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:05.511714 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9b7c6acf-bc88-4d07-acfc-9198d196b0c9 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:05.513716 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9b7c6acf-bc88-4d07-acfc-9198d196b0c9 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:05.515607 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9b7c6acf-bc88-4d07-acfc-9198d196b0c9 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68" status: 200 len: 1813 microversion: 2.25 time: 0.873602 Oct 17 13:42:05.519474 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1059/2117] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:42:04 2022] GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68 => generated 1813 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:42:05.532599 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f890bc72-f0fa-432c-a605-0c4485237551 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:05.533505 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f890bc72-f0fa-432c-a605-0c4485237551 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 3e1d2587-26db-449e-81cd-677ce4f87a76] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:05.556217 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f890bc72-f0fa-432c-a605-0c4485237551 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:05.557647 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f890bc72-f0fa-432c-a605-0c4485237551 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:05.561147 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f890bc72-f0fa-432c-a605-0c4485237551 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:05.562649 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f890bc72-f0fa-432c-a605-0c4485237551 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:05.563379 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f890bc72-f0fa-432c-a605-0c4485237551 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:05.564348 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f890bc72-f0fa-432c-a605-0c4485237551 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:05.759828 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-283238f3-0993-415e-a667-faf32f5dc8a9 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b849e8b87a4b49ffa7ad2dd6e95260aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d121d0b216416592c7048c2a46f625', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:05.770167 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-283238f3-0993-415e-a667-faf32f5dc8a9 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers/3d4188da-b0f7-4d97-952b-acebaa48f185" status: 200 len: 1518 microversion: 2.1 time: 0.962273 Oct 17 13:42:05.786355 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1059/2118] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:04 2022] GET /compute/v2.1/servers/3d4188da-b0f7-4d97-952b-acebaa48f185 => generated 1518 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:05.801008 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ae83df78-37c4-45c6-99c6-fabe68792afb tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:05.802374 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ae83df78-37c4-45c6-99c6-fabe68792afb tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9044674d-a793-46c2-b3ec-e9377b30f253] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:05.820389 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ae83df78-37c4-45c6-99c6-fabe68792afb tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:05.821149 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ae83df78-37c4-45c6-99c6-fabe68792afb tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:05.821775 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ae83df78-37c4-45c6-99c6-fabe68792afb tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:05.823596 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ae83df78-37c4-45c6-99c6-fabe68792afb tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:05.824291 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ae83df78-37c4-45c6-99c6-fabe68792afb tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:05.824983 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ae83df78-37c4-45c6-99c6-fabe68792afb tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:05.896296 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f890bc72-f0fa-432c-a605-0c4485237551 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:05.925618 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f890bc72-f0fa-432c-a605-0c4485237551 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/3e1d2587-26db-449e-81cd-677ce4f87a76" status: 200 len: 1505 microversion: 2.1 time: 0.404696 Oct 17 13:42:05.927131 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1060/2119] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:05 2022] GET /compute/v2.1/servers/3e1d2587-26db-449e-81cd-677ce4f87a76 => generated 1505 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:05.936393 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d362fc34-820d-4382-9063-797cefd3d3ec tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Calling method '.version_select at 0x7f7cd9a144c0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:06.072948 n-d-854247-14 devstack@n-api.service[127017]: DEBUG neutronclient.v2_0.client [None req-d362fc34-820d-4382-9063-797cefd3d3ec tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5ca54317-7291-4571-a040-4e4a3c88432f does not exist", "detail": ""}} {{(pid=127017) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 13:42:06.073902 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.security_group_api [None req-d362fc34-820d-4382-9063-797cefd3d3ec tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Neutron security group 5ca54317-7291-4571-a040-4e4a3c88432f not found {{(pid=127017) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 17 13:42:06.074708 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-d362fc34-820d-4382-9063-797cefd3d3ec tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] HTTP exception thrown: Security group 5ca54317-7291-4571-a040-4e4a3c88432f does not exist Oct 17 13:42:06.074708 n-d-854247-14 devstack@n-api.service[127017]: Neutron server returns request_ids: ['req-7858c83c-c148-4b6e-b8b3-2f99df04cda7'] Oct 17 13:42:06.076971 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d362fc34-820d-4382-9063-797cefd3d3ec tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Request method failure captured: Oct 17 13:42:06.076971 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/os-security-groups/5ca54317-7291-4571-a040-4e4a3c88432f HTTP/1.1 Oct 17 13:42:06.076971 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:42:06.076971 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:42:06.076971 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:42:06.076971 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:42:06.076971 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:42:06.076971 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:42:06.076971 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:42:06.076971 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:42:06.076971 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVtyFGyYtLVdwIq4ccz7RkXRa7NtlbhzSHc2HUbc2jnmH2QeepBwxbKf8toXm_ooPcHi9ET43LtT1AqXtRk9n6taXXPkcxvI9DAvMm-WduwoIrQJqrIBPqw0m6vAgqbSuo42q0EeC3f0tZCzBhE1QaAtaHcB-dTJTCp89NqtuNhDPjU Oct 17 13:42:06.076971 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:42:06.076971 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:42:06.076971 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:42:06.076971 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:42:06.076971 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:42:06.076971 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:42:06.076971 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 50c0147c5fae4017810887843b0afaa0 Oct 17 13:42:06.076971 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-SecurityGroupsTestJSON-1412652742 Oct 17 13:42:06.076971 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:42:06.076971 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:42:06.076971 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/50c0147c5fae4017810887843b0afaa0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/50c0147c5fae4017810887843b0afaa0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/50c0147c5fae4017810887843b0afaa0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_50c0147c5fae4017810887843b0afaa0", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:42:06.076971 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-SecurityGroupsTestJSON-1412652742 Oct 17 13:42:06.076971 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 50c0147c5fae4017810887843b0afaa0 Oct 17 13:42:06.076971 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1412652742 Oct 17 13:42:06.076971 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-SecurityGroupsTestJSON-1412652742-project Oct 17 13:42:06.076971 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:42:06.076971 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:42:06.076971 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 185235bc4e3245fc8d92b7e4bff6cbbd Oct 17 13:42:06.076971 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-SecurityGroupsTestJSON-1412652742-project Oct 17 13:42:06.076971 n-d-854247-14 devstack@n-api.service[127017]: method: Oct 17 13:42:06.076971 n-d-854247-14 devstack@n-api.service[127017]: exception: Security group 5ca54317-7291-4571-a040-4e4a3c88432f does not exist Oct 17 13:42:06.076971 n-d-854247-14 devstack@n-api.service[127017]: Neutron server returns request_ids: ['req-7858c83c-c148-4b6e-b8b3-2f99df04cda7'] Oct 17 13:42:06.076971 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '5ca54317-7291-4571-a040-4e4a3c88432f'} Oct 17 13:42:06.076971 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:42:06.076971 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:06.076971 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 17 13:42:06.076971 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 17 13:42:06.076971 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:06.076971 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:06.076971 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 17 13:42:06.076971 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 17 13:42:06.076971 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:06.076971 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:06.076971 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 13:42:06.076971 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 13:42:06.076971 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:06.076971 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:06.076971 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 13:42:06.076971 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 13:42:06.076971 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:06.076971 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:06.076971 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 13:42:06.076971 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 13:42:06.076971 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:06.076971 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:06.076971 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 13:42:06.076971 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 13:42:06.076971 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 13:42:06.076971 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 13:42:06.076971 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5ca54317-7291-4571-a040-4e4a3c88432f does not exist Oct 17 13:42:06.082237 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7858c83c-c148-4b6e-b8b3-2f99df04cda7'] Oct 17 13:42:06.082237 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:42:06.082237 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:06.082237 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:42:06.082237 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:06.082237 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 17 13:42:06.082237 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 17 13:42:06.082237 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 17 13:42:06.082237 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 13:42:06.082237 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5ca54317-7291-4571-a040-4e4a3c88432f does not exist Oct 17 13:42:06.082237 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7858c83c-c148-4b6e-b8b3-2f99df04cda7'] Oct 17 13:42:06.082237 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:42:06.082237 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:06.082237 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:42:06.082237 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:06.082237 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:06.082237 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:06.082237 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:42:06.082237 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:42:06.082237 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:42:06.082237 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:42:06.082237 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:42:06.082237 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:42:06.082237 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 17 13:42:06.082237 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 17 13:42:06.082237 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5ca54317-7291-4571-a040-4e4a3c88432f does not exist Oct 17 13:42:06.082237 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7858c83c-c148-4b6e-b8b3-2f99df04cda7'] Oct 17 13:42:06.082237 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:42:06.082237 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:06.082237 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:42:06.082237 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:06.082237 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:06.082237 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:06.082237 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:42:06.082237 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:42:06.082237 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5ca54317-7291-4571-a040-4e4a3c88432f does not exist Oct 17 13:42:06.082237 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7858c83c-c148-4b6e-b8b3-2f99df04cda7'] Oct 17 13:42:06.082237 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:42:06.086316 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d362fc34-820d-4382-9063-797cefd3d3ec tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Returning 404 to user: Security group 5ca54317-7291-4571-a040-4e4a3c88432f does not exist Oct 17 13:42:06.086316 n-d-854247-14 devstack@n-api.service[127017]: Neutron server returns request_ids: ['req-7858c83c-c148-4b6e-b8b3-2f99df04cda7'] {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:42:06.087521 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d362fc34-820d-4382-9063-797cefd3d3ec tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "GET /compute/v2.1/os-security-groups/5ca54317-7291-4571-a040-4e4a3c88432f" status: 404 len: 194 microversion: 2.1 time: 0.159144 Oct 17 13:42:06.088628 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1061/2120] 10.222.0.79 () {58 vars in 1269 bytes} [Mon Oct 17 13:42:05 2022] GET /compute/v2.1/os-security-groups/5ca54317-7291-4571-a040-4e4a3c88432f => generated 194 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:42:06.099763 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-88d9248c-edbe-4083-b711-3116479fc0a8 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:06.103963 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-88d9248c-edbe-4083-b711-3116479fc0a8 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] [instance: 95418c39-6c0a-444e-93b4-4a90b31f3034] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:06.123484 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-88d9248c-edbe-4083-b711-3116479fc0a8 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:06.124329 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-88d9248c-edbe-4083-b711-3116479fc0a8 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:06.124984 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-88d9248c-edbe-4083-b711-3116479fc0a8 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:06.128209 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-88d9248c-edbe-4083-b711-3116479fc0a8 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:06.128797 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-88d9248c-edbe-4083-b711-3116479fc0a8 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:06.129933 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-88d9248c-edbe-4083-b711-3116479fc0a8 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:06.532348 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ae83df78-37c4-45c6-99c6-fabe68792afb tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:06.548910 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ae83df78-37c4-45c6-99c6-fabe68792afb tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253" status: 200 len: 1517 microversion: 2.1 time: 0.749419 Oct 17 13:42:06.556299 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1060/2121] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:05 2022] GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253 => generated 1517 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:06.571419 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-20474a70-a025-47ec-a475-803fcdd122ec tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Calling method '.version_select at 0x7f7cd53fb040>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:06.678069 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-88d9248c-edbe-4083-b711-3116479fc0a8 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b891d3b774e44de3ad1d3088990f6bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358604dd1cf74e5fab262179351d4d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:06.742535 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-88d9248c-edbe-4083-b711-3116479fc0a8 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] 10.222.0.79 "GET /compute/v2.1/servers/95418c39-6c0a-444e-93b4-4a90b31f3034" status: 200 len: 1589 microversion: 2.1 time: 0.606314 Oct 17 13:42:06.742535 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1062/2122] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:06 2022] GET /compute/v2.1/servers/95418c39-6c0a-444e-93b4-4a90b31f3034 => generated 1589 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:06.756731 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-4619495a-3619-4d76-8ec7-c7ff336f26b2 req-ff5717d3-3766-4701-97ec-1a8cfa6cf12b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d4188da-b0f7-4d97-952b-acebaa48f185", "name": "network-vif-deleted", "tag": "5aa937a2-940e-4a32-973c-4f39608f3902"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:42:06.780000 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-4619495a-3619-4d76-8ec7-c7ff336f26b2 req-ff5717d3-3766-4701-97ec-1a8cfa6cf12b service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:06.783416 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-4619495a-3619-4d76-8ec7-c7ff336f26b2 req-ff5717d3-3766-4701-97ec-1a8cfa6cf12b service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:06.783924 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-4619495a-3619-4d76-8ec7-c7ff336f26b2 req-ff5717d3-3766-4701-97ec-1a8cfa6cf12b service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:06.819343 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-4619495a-3619-4d76-8ec7-c7ff336f26b2 req-ff5717d3-3766-4701-97ec-1a8cfa6cf12b service nova] Creating event network-vif-deleted:5aa937a2-940e-4a32-973c-4f39608f3902 for instance 3d4188da-b0f7-4d97-952b-acebaa48f185 on n-h1-854247-14 Oct 17 13:42:06.836739 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-4619495a-3619-4d76-8ec7-c7ff336f26b2 req-ff5717d3-3766-4701-97ec-1a8cfa6cf12b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119680 Oct 17 13:42:06.837831 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1063/2123] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:42:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:42:06.849311 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8bb50a67-7e0c-4b92-bd4f-f6562e1a45eb tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:06.850231 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8bb50a67-7e0c-4b92-bd4f-f6562e1a45eb tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 709d926d-fba5-49ea-84ac-95d8bb018c68] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:06.871261 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8bb50a67-7e0c-4b92-bd4f-f6562e1a45eb tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:06.872118 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8bb50a67-7e0c-4b92-bd4f-f6562e1a45eb tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:06.874558 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8bb50a67-7e0c-4b92-bd4f-f6562e1a45eb tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:06.875778 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8bb50a67-7e0c-4b92-bd4f-f6562e1a45eb tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:06.876380 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8bb50a67-7e0c-4b92-bd4f-f6562e1a45eb tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:06.879662 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8bb50a67-7e0c-4b92-bd4f-f6562e1a45eb tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:07.253943 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-20474a70-a025-47ec-a475-803fcdd122ec tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/b20231ea-dba1-407d-a7fd-39094706292a" status: 202 len: 0 microversion: 2.1 time: 0.702806 Oct 17 13:42:07.254926 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1061/2124] 10.222.0.79 () {58 vars in 1272 bytes} [Mon Oct 17 13:42:06 2022] DELETE /compute/v2.1/os-security-groups/b20231ea-dba1-407d-a7fd-39094706292a => generated 0 bytes in 704 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:42:07.260502 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-99097c05-456a-48b6-866c-576522be8696 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:07.261184 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-99097c05-456a-48b6-866c-576522be8696 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] [instance: 95418c39-6c0a-444e-93b4-4a90b31f3034] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:07.281975 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-99097c05-456a-48b6-866c-576522be8696 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:07.286531 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-99097c05-456a-48b6-866c-576522be8696 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:07.288780 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-99097c05-456a-48b6-866c-576522be8696 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:07.289955 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-99097c05-456a-48b6-866c-576522be8696 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:07.294123 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-99097c05-456a-48b6-866c-576522be8696 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:07.295668 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-99097c05-456a-48b6-866c-576522be8696 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:07.530717 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-99097c05-456a-48b6-866c-576522be8696 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] 10.222.0.79 "GET /compute/v2.1/servers/95418c39-6c0a-444e-93b4-4a90b31f3034/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.273857 Oct 17 13:42:07.531529 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1062/2125] 10.222.0.79 () {58 vars in 1275 bytes} [Mon Oct 17 13:42:07 2022] GET /compute/v2.1/servers/95418c39-6c0a-444e-93b4-4a90b31f3034/os-interface => generated 285 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:42:07.542141 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b6959658-dc6c-4dc9-a71b-9553684567e2 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:07.543840 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b6959658-dc6c-4dc9-a71b-9553684567e2 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] [instance: 3d4188da-b0f7-4d97-952b-acebaa48f185] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:07.564468 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8bb50a67-7e0c-4b92-bd4f-f6562e1a45eb tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:07.570766 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b6959658-dc6c-4dc9-a71b-9553684567e2 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:07.574257 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b6959658-dc6c-4dc9-a71b-9553684567e2 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:07.574985 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b6959658-dc6c-4dc9-a71b-9553684567e2 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:07.577120 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8bb50a67-7e0c-4b92-bd4f-f6562e1a45eb tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:07.580109 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b6959658-dc6c-4dc9-a71b-9553684567e2 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:07.580846 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8bb50a67-7e0c-4b92-bd4f-f6562e1a45eb tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:07.582065 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8bb50a67-7e0c-4b92-bd4f-f6562e1a45eb tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68" status: 200 len: 1813 microversion: 2.25 time: 0.742996 Oct 17 13:42:07.582497 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b6959658-dc6c-4dc9-a71b-9553684567e2 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:07.583080 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1064/2126] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:42:06 2022] GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68 => generated 1813 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:42:07.587933 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c37903e8-3acf-4c90-93c3-772b1757f841 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:07.592261 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c37903e8-3acf-4c90-93c3-772b1757f841 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 3e1d2587-26db-449e-81cd-677ce4f87a76] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:07.592344 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b6959658-dc6c-4dc9-a71b-9553684567e2 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:07.616583 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c37903e8-3acf-4c90-93c3-772b1757f841 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:07.618095 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c37903e8-3acf-4c90-93c3-772b1757f841 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:07.619316 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c37903e8-3acf-4c90-93c3-772b1757f841 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:07.624587 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c37903e8-3acf-4c90-93c3-772b1757f841 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:07.628218 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c37903e8-3acf-4c90-93c3-772b1757f841 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:07.629295 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c37903e8-3acf-4c90-93c3-772b1757f841 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:07.643801 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-b6959658-dc6c-4dc9-a71b-9553684567e2 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] HTTP exception thrown: Instance 3d4188da-b0f7-4d97-952b-acebaa48f185 could not be found. Oct 17 13:42:07.650016 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b6959658-dc6c-4dc9-a71b-9553684567e2 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Request method failure captured: Oct 17 13:42:07.650016 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/3d4188da-b0f7-4d97-952b-acebaa48f185 HTTP/1.1 Oct 17 13:42:07.650016 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:42:07.650016 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:42:07.650016 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:42:07.650016 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:42:07.650016 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:42:07.650016 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:42:07.650016 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:42:07.650016 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:42:07.650016 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVslGtfdVSFrsbyAcibzm0QXeRfl7TdWgYNhhlDyieORwCEkTfFGyTqr2WajwaAPNWK_AwX9JHLnmfr1P3N1cRURlSaeSBTg8P3Vz51fs8eLQdrtDUCemS3C_9thFZYd0WRnVCXSd9OXtGY8dne0GASBJP5SvJ5N5pr9LQSsaCW0nS4 Oct 17 13:42:07.650016 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:42:07.650016 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:42:07.650016 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:42:07.650016 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:42:07.650016 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:42:07.650016 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:42:07.650016 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 66d121d0b216416592c7048c2a46f625 Oct 17 13:42:07.650016 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ListServerFiltersTestJSON-1908686196 Oct 17 13:42:07.650016 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:42:07.650016 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:42:07.650016 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/66d121d0b216416592c7048c2a46f625"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/66d121d0b216416592c7048c2a46f625"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/66d121d0b216416592c7048c2a46f625"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_66d121d0b216416592c7048c2a46f625", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:42:07.650016 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ListServerFiltersTestJSON-1908686196 Oct 17 13:42:07.650016 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 66d121d0b216416592c7048c2a46f625 Oct 17 13:42:07.650016 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1908686196 Oct 17 13:42:07.650016 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ListServerFiltersTestJSON-1908686196-project Oct 17 13:42:07.650016 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:42:07.650016 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:42:07.650016 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: b849e8b87a4b49ffa7ad2dd6e95260aa Oct 17 13:42:07.650016 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ListServerFiltersTestJSON-1908686196-project Oct 17 13:42:07.650016 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:42:07.650016 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 3d4188da-b0f7-4d97-952b-acebaa48f185 could not be found. Oct 17 13:42:07.650016 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '3d4188da-b0f7-4d97-952b-acebaa48f185'} Oct 17 13:42:07.650016 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:42:07.650016 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:07.650016 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:42:07.650016 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:42:07.650016 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:42:07.650016 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:42:07.650016 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:42:07.650016 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:42:07.650016 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:42:07.650016 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:42:07.650016 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d4188da-b0f7-4d97-952b-acebaa48f185 could not be found. Oct 17 13:42:07.650016 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:07.650016 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:07.650016 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:07.650016 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:07.650016 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:07.650016 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:07.650016 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:42:07.650016 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:42:07.650016 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:42:07.650016 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:42:07.650016 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:42:07.650016 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:42:07.650016 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:42:07.650016 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:42:07.650016 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:42:07.650016 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:42:07.650016 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d4188da-b0f7-4d97-952b-acebaa48f185 could not be found. Oct 17 13:42:07.650016 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:07.650016 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:07.650016 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:07.652903 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:07.652903 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:07.652903 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:07.652903 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:42:07.652903 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:42:07.652903 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d4188da-b0f7-4d97-952b-acebaa48f185 could not be found. Oct 17 13:42:07.652903 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:07.659486 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b6959658-dc6c-4dc9-a71b-9553684567e2 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] Returning 404 to user: Instance 3d4188da-b0f7-4d97-952b-acebaa48f185 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:42:07.661361 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b6959658-dc6c-4dc9-a71b-9553684567e2 tempest-ListServerFiltersTestJSON-1908686196 tempest-ListServerFiltersTestJSON-1908686196-project] 10.222.0.79 "GET /compute/v2.1/servers/3d4188da-b0f7-4d97-952b-acebaa48f185" status: 404 len: 111 microversion: 2.1 time: 0.127663 Oct 17 13:42:07.670394 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1063/2127] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:07 2022] GET /compute/v2.1/servers/3d4188da-b0f7-4d97-952b-acebaa48f185 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:42:07.683811 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6920c2ef-92d2-4bbc-b60e-54e0d01bf95b tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Calling method '.version_select at 0x7f7cd544daf0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:07.877758 n-d-854247-14 devstack@n-api.service[127016]: DEBUG neutronclient.v2_0.client [None req-6920c2ef-92d2-4bbc-b60e-54e0d01bf95b tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b20231ea-dba1-407d-a7fd-39094706292a does not exist", "detail": ""}} {{(pid=127016) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 13:42:07.877758 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.security_group_api [None req-6920c2ef-92d2-4bbc-b60e-54e0d01bf95b tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Neutron security group b20231ea-dba1-407d-a7fd-39094706292a not found {{(pid=127016) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 17 13:42:07.877758 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-6920c2ef-92d2-4bbc-b60e-54e0d01bf95b tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] HTTP exception thrown: Security group b20231ea-dba1-407d-a7fd-39094706292a does not exist Oct 17 13:42:07.877758 n-d-854247-14 devstack@n-api.service[127016]: Neutron server returns request_ids: ['req-32bc506c-a30d-4819-9ea6-fa0b123ccf87'] Oct 17 13:42:07.877758 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6920c2ef-92d2-4bbc-b60e-54e0d01bf95b tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Request method failure captured: Oct 17 13:42:07.877758 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/os-security-groups/b20231ea-dba1-407d-a7fd-39094706292a HTTP/1.1 Oct 17 13:42:07.877758 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:42:07.877758 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:42:07.877758 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:42:07.877758 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:42:07.877758 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:42:07.877758 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:42:07.877758 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:42:07.877758 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:42:07.877758 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVtyFGyYtLVdwIq4ccz7RkXRa7NtlbhzSHc2HUbc2jnmH2QeepBwxbKf8toXm_ooPcHi9ET43LtT1AqXtRk9n6taXXPkcxvI9DAvMm-WduwoIrQJqrIBPqw0m6vAgqbSuo42q0EeC3f0tZCzBhE1QaAtaHcB-dTJTCp89NqtuNhDPjU Oct 17 13:42:07.877758 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:42:07.877758 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:42:07.877758 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:42:07.877758 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:42:07.877758 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:42:07.877758 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:42:07.877758 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 50c0147c5fae4017810887843b0afaa0 Oct 17 13:42:07.877758 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-SecurityGroupsTestJSON-1412652742 Oct 17 13:42:07.877758 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:42:07.877758 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:42:07.877758 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/50c0147c5fae4017810887843b0afaa0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/50c0147c5fae4017810887843b0afaa0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/50c0147c5fae4017810887843b0afaa0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_50c0147c5fae4017810887843b0afaa0", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:42:07.877758 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-SecurityGroupsTestJSON-1412652742 Oct 17 13:42:07.877758 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 50c0147c5fae4017810887843b0afaa0 Oct 17 13:42:07.877758 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1412652742 Oct 17 13:42:07.877758 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-SecurityGroupsTestJSON-1412652742-project Oct 17 13:42:07.877758 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:42:07.877758 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:42:07.877758 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 185235bc4e3245fc8d92b7e4bff6cbbd Oct 17 13:42:07.877758 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-SecurityGroupsTestJSON-1412652742-project Oct 17 13:42:07.877758 n-d-854247-14 devstack@n-api.service[127016]: method: Oct 17 13:42:07.877758 n-d-854247-14 devstack@n-api.service[127016]: exception: Security group b20231ea-dba1-407d-a7fd-39094706292a does not exist Oct 17 13:42:07.877758 n-d-854247-14 devstack@n-api.service[127016]: Neutron server returns request_ids: ['req-32bc506c-a30d-4819-9ea6-fa0b123ccf87'] Oct 17 13:42:07.877758 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'b20231ea-dba1-407d-a7fd-39094706292a'} Oct 17 13:42:07.877758 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:42:07.877758 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:07.877758 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 17 13:42:07.877758 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 17 13:42:07.877758 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:07.877758 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:07.877758 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 17 13:42:07.877758 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 17 13:42:07.877758 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:07.877758 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:07.877758 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 13:42:07.877758 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 13:42:07.877758 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:07.877758 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:07.877758 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 13:42:07.877758 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 13:42:07.880384 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:07.880384 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:07.880384 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 13:42:07.880384 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 13:42:07.880384 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:07.880384 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:07.880384 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 13:42:07.880384 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 13:42:07.880384 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 13:42:07.880384 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 13:42:07.880384 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b20231ea-dba1-407d-a7fd-39094706292a does not exist Oct 17 13:42:07.880384 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-32bc506c-a30d-4819-9ea6-fa0b123ccf87'] Oct 17 13:42:07.880384 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:07.880384 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:07.880384 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:07.880384 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:07.880384 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 17 13:42:07.880384 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 17 13:42:07.880384 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 17 13:42:07.880384 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 13:42:07.880384 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b20231ea-dba1-407d-a7fd-39094706292a does not exist Oct 17 13:42:07.880384 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-32bc506c-a30d-4819-9ea6-fa0b123ccf87'] Oct 17 13:42:07.880384 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:07.880384 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:07.880384 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:07.880384 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:07.880384 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:07.880384 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:07.880384 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:42:07.880384 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:42:07.880384 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:42:07.880384 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:42:07.880384 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:42:07.880384 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:42:07.880384 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 17 13:42:07.880384 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 17 13:42:07.880384 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b20231ea-dba1-407d-a7fd-39094706292a does not exist Oct 17 13:42:07.880384 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-32bc506c-a30d-4819-9ea6-fa0b123ccf87'] Oct 17 13:42:07.880384 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:07.880384 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:07.880384 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:07.880384 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:07.880384 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:07.880384 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:07.880384 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:42:07.880384 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:42:07.880384 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b20231ea-dba1-407d-a7fd-39094706292a does not exist Oct 17 13:42:07.880384 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-32bc506c-a30d-4819-9ea6-fa0b123ccf87'] Oct 17 13:42:07.880384 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:07.880384 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6920c2ef-92d2-4bbc-b60e-54e0d01bf95b tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Returning 404 to user: Security group b20231ea-dba1-407d-a7fd-39094706292a does not exist Oct 17 13:42:07.880384 n-d-854247-14 devstack@n-api.service[127016]: Neutron server returns request_ids: ['req-32bc506c-a30d-4819-9ea6-fa0b123ccf87'] {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:42:07.880384 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6920c2ef-92d2-4bbc-b60e-54e0d01bf95b tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "GET /compute/v2.1/os-security-groups/b20231ea-dba1-407d-a7fd-39094706292a" status: 404 len: 194 microversion: 2.1 time: 0.204979 Oct 17 13:42:07.880384 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1064/2128] 10.222.0.79 () {58 vars in 1269 bytes} [Mon Oct 17 13:42:07 2022] GET /compute/v2.1/os-security-groups/b20231ea-dba1-407d-a7fd-39094706292a => generated 194 bytes in 207 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:42:07.900896 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2a67a5d6-0bb0-464f-839b-884f9af3d89b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:07.904336 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2a67a5d6-0bb0-464f-839b-884f9af3d89b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9044674d-a793-46c2-b3ec-e9377b30f253] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:07.940226 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2a67a5d6-0bb0-464f-839b-884f9af3d89b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:07.940715 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2a67a5d6-0bb0-464f-839b-884f9af3d89b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:07.941149 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2a67a5d6-0bb0-464f-839b-884f9af3d89b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:07.941855 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2a67a5d6-0bb0-464f-839b-884f9af3d89b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:07.944877 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2a67a5d6-0bb0-464f-839b-884f9af3d89b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:07.945724 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2a67a5d6-0bb0-464f-839b-884f9af3d89b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:08.299826 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2a67a5d6-0bb0-464f-839b-884f9af3d89b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:08.312313 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2a67a5d6-0bb0-464f-839b-884f9af3d89b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253" status: 200 len: 1517 microversion: 2.1 time: 0.430411 Oct 17 13:42:08.312917 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1065/2129] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:07 2022] GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253 => generated 1517 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:08.342269 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-b509b0e7-6ac1-4983-a7d7-cacef95ed35d req-8543b921-9603-4e88-8a15-0368f4238794 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e1d2587-26db-449e-81cd-677ce4f87a76", "name": "network-vif-plugged", "status": "completed", "tag": "396d247b-3b59-4e2c-b01c-d755d6e8254c"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:42:08.361231 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-b509b0e7-6ac1-4983-a7d7-cacef95ed35d req-8543b921-9603-4e88-8a15-0368f4238794 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:08.361231 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-b509b0e7-6ac1-4983-a7d7-cacef95ed35d req-8543b921-9603-4e88-8a15-0368f4238794 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:08.361671 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-b509b0e7-6ac1-4983-a7d7-cacef95ed35d req-8543b921-9603-4e88-8a15-0368f4238794 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:08.393131 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-b509b0e7-6ac1-4983-a7d7-cacef95ed35d req-8543b921-9603-4e88-8a15-0368f4238794 service nova] Creating event network-vif-plugged:396d247b-3b59-4e2c-b01c-d755d6e8254c for instance 3e1d2587-26db-449e-81cd-677ce4f87a76 on n-h1-854247-14 Oct 17 13:42:08.407557 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-b509b0e7-6ac1-4983-a7d7-cacef95ed35d req-8543b921-9603-4e88-8a15-0368f4238794 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080622 Oct 17 13:42:08.409496 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1066/2130] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:42:08.423126 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-598de9bf-b654-47de-b970-fe218f0be1e7 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Calling method '.version_select at 0x7f7cd5533c10>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:08.527903 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c37903e8-3acf-4c90-93c3-772b1757f841 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:08.536054 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c37903e8-3acf-4c90-93c3-772b1757f841 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/3e1d2587-26db-449e-81cd-677ce4f87a76" status: 200 len: 1487 microversion: 2.1 time: 0.951911 Oct 17 13:42:08.539914 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1065/2131] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:07 2022] GET /compute/v2.1/servers/3e1d2587-26db-449e-81cd-677ce4f87a76 => generated 1487 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:08.572279 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-aa010505-0231-4825-85ef-a506f130a4ea tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:08.573550 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-aa010505-0231-4825-85ef-a506f130a4ea tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 3e1d2587-26db-449e-81cd-677ce4f87a76] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:08.583754 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aa010505-0231-4825-85ef-a506f130a4ea tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:08.585664 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aa010505-0231-4825-85ef-a506f130a4ea tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:08.586595 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aa010505-0231-4825-85ef-a506f130a4ea tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:08.588844 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aa010505-0231-4825-85ef-a506f130a4ea tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:08.590304 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aa010505-0231-4825-85ef-a506f130a4ea tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:08.590865 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aa010505-0231-4825-85ef-a506f130a4ea tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:08.648164 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-aa010505-0231-4825-85ef-a506f130a4ea tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 3e1d2587-26db-449e-81cd-677ce4f87a76] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:42:08.834607 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-aa010505-0231-4825-85ef-a506f130a4ea tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3e1d2587-26db-449e-81cd-677ce4f87a76" status: 204 len: 0 microversion: 2.1 time: 0.266224 Oct 17 13:42:08.841882 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1066/2132] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:42:08 2022] DELETE /compute/v2.1/servers/3e1d2587-26db-449e-81cd-677ce4f87a76 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:42:08.850502 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-16216100-61dd-4cf9-acc2-de8983435ac0 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:08.851241 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-16216100-61dd-4cf9-acc2-de8983435ac0 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 709d926d-fba5-49ea-84ac-95d8bb018c68] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:08.864046 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-16216100-61dd-4cf9-acc2-de8983435ac0 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:08.864557 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-16216100-61dd-4cf9-acc2-de8983435ac0 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:08.866201 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-16216100-61dd-4cf9-acc2-de8983435ac0 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:08.867025 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-16216100-61dd-4cf9-acc2-de8983435ac0 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:08.870987 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-16216100-61dd-4cf9-acc2-de8983435ac0 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:08.871590 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-16216100-61dd-4cf9-acc2-de8983435ac0 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:08.907269 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:42:09.150398 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-598de9bf-b654-47de-b970-fe218f0be1e7 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "GET /compute/v2.1/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 0.739052 Oct 17 13:42:09.151040 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1067/2133] 10.222.0.79 () {58 vars in 1158 bytes} [Mon Oct 17 13:42:08 2022] GET /compute/v2.1/os-security-groups => generated 1156 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:09.156581 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-97ffb9d2-9d15-4927-82e6-c9549cf796a0 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd554dca0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:09.209616 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-97ffb9d2-9d15-4927-82e6-c9549cf796a0 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] HTTP exception thrown: Image not found. Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-97ffb9d2-9d15-4927-82e6-c9549cf796a0 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Request method failure captured: Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: request: DELETE /compute/v2.1/images/cc998ca8-905d-4b7f-baab-14bfc5cec9ff HTTP/1.1 Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVpcWSwKjkgHu1pOrzJj6HiDQ9hS6xF0hnYpT-9MjemVLwNDzCl7w6ETLwt3fC-SanrMXYSA6kHfWUvQJu5a3Y3I946ESkVOejyjKOR-whNFZHQOyDE2dNW3q_jrKN41Sl71zQIcHHv_pCPQ5Cu97jE35pUEh3xL0sRiioyX-jyds1o Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 461c44cb99ff4958a128679d3e10cd6f Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ImagesTestJSON-1110552804 Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/461c44cb99ff4958a128679d3e10cd6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/461c44cb99ff4958a128679d3e10cd6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/461c44cb99ff4958a128679d3e10cd6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_461c44cb99ff4958a128679d3e10cd6f", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ImagesTestJSON-1110552804 Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 461c44cb99ff4958a128679d3e10cd6f Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ImagesTestJSON-1110552804 Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ImagesTestJSON-1110552804-project Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 386397fd9194430b81ac465f9b3bf92d Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ImagesTestJSON-1110552804-project Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: method: Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: exception: Image not found. Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'cc998ca8-905d-4b7f-baab-14bfc5cec9ff'} Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image cc998ca8-905d-4b7f-baab-14bfc5cec9ff to delete Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cc998ca8-905d-4b7f-baab-14bfc5cec9ff could not be found. Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:09.211523 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:09.215051 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:09.215051 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:09.215051 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:42:09.215051 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:42:09.215051 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:42:09.215051 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:42:09.215051 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:42:09.215051 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:42:09.215051 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 17 13:42:09.215051 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 13:42:09.215051 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 13:42:09.215051 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:09.215051 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:09.215051 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:09.215051 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:09.215051 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:09.215051 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:09.215051 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:42:09.215051 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:42:09.215051 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 13:42:09.215051 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:09.217488 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-97ffb9d2-9d15-4927-82e6-c9549cf796a0 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Returning 404 to user: Image not found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:42:09.218337 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-97ffb9d2-9d15-4927-82e6-c9549cf796a0 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "DELETE /compute/v2.1/images/cc998ca8-905d-4b7f-baab-14bfc5cec9ff" status: 404 len: 62 microversion: 2.1 time: 0.065860 Oct 17 13:42:09.218892 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1068/2134] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:09 2022] DELETE /compute/v2.1/images/cc998ca8-905d-4b7f-baab-14bfc5cec9ff => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:42:09.224407 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7682e2d1-0dc6-499c-b80b-5015ed9a1d28 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Action: 'create', calling method: .version_select at 0x7f7cd55673a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-491402492", "description": "tempest-description-676576558"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:42:09.430783 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-16216100-61dd-4cf9-acc2-de8983435ac0 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:09.456011 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-16216100-61dd-4cf9-acc2-de8983435ac0 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:09.457576 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-16216100-61dd-4cf9-acc2-de8983435ac0 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:09.458639 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-16216100-61dd-4cf9-acc2-de8983435ac0 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68" status: 200 len: 1813 microversion: 2.25 time: 0.618885 Oct 17 13:42:09.476144 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1067/2135] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:42:08 2022] GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68 => generated 1813 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:42:09.487071 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-61af1268-ba92-47c5-a7b8-9f2299ef6801 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:09.487831 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-61af1268-ba92-47c5-a7b8-9f2299ef6801 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 3e1d2587-26db-449e-81cd-677ce4f87a76] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:09.496198 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-61af1268-ba92-47c5-a7b8-9f2299ef6801 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:09.496960 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-61af1268-ba92-47c5-a7b8-9f2299ef6801 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:09.497504 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-61af1268-ba92-47c5-a7b8-9f2299ef6801 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:09.498497 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-61af1268-ba92-47c5-a7b8-9f2299ef6801 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:09.499078 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-61af1268-ba92-47c5-a7b8-9f2299ef6801 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:09.518725 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-61af1268-ba92-47c5-a7b8-9f2299ef6801 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:09.560159 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-61af1268-ba92-47c5-a7b8-9f2299ef6801 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 3e1d2587-26db-449e-81cd-677ce4f87a76] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:42:09.632834 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.compute.api [None req-61af1268-ba92-47c5-a7b8-9f2299ef6801 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 3e1d2587-26db-449e-81cd-677ce4f87a76] Instance is already in deleting state, ignoring this request Oct 17 13:42:09.635044 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-61af1268-ba92-47c5-a7b8-9f2299ef6801 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3e1d2587-26db-449e-81cd-677ce4f87a76" status: 204 len: 0 microversion: 2.1 time: 0.155470 Oct 17 13:42:09.640004 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1068/2136] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:42:09 2022] DELETE /compute/v2.1/servers/3e1d2587-26db-449e-81cd-677ce4f87a76 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:42:09.646754 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-033521cb-493d-4e0b-b6e3-51369138d0d9 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:09.647693 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-033521cb-493d-4e0b-b6e3-51369138d0d9 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9044674d-a793-46c2-b3ec-e9377b30f253] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:09.660216 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-033521cb-493d-4e0b-b6e3-51369138d0d9 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:09.660777 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-033521cb-493d-4e0b-b6e3-51369138d0d9 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:09.661359 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-033521cb-493d-4e0b-b6e3-51369138d0d9 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:09.662427 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-033521cb-493d-4e0b-b6e3-51369138d0d9 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:09.662868 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-033521cb-493d-4e0b-b6e3-51369138d0d9 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:09.663527 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-033521cb-493d-4e0b-b6e3-51369138d0d9 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:10.024206 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7682e2d1-0dc6-499c-b80b-5015ed9a1d28 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.803062 Oct 17 13:42:10.024881 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1069/2137] 10.222.0.79 () {60 vars in 1180 bytes} [Mon Oct 17 13:42:09 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:42:10.030542 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cec8ce1c-2563-4f37-9446-ed69fb1bd9d2 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:10.031468 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cec8ce1c-2563-4f37-9446-ed69fb1bd9d2 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 3e1d2587-26db-449e-81cd-677ce4f87a76] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:10.047965 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cec8ce1c-2563-4f37-9446-ed69fb1bd9d2 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:10.048680 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cec8ce1c-2563-4f37-9446-ed69fb1bd9d2 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:10.049283 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cec8ce1c-2563-4f37-9446-ed69fb1bd9d2 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:10.051409 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cec8ce1c-2563-4f37-9446-ed69fb1bd9d2 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:10.052530 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cec8ce1c-2563-4f37-9446-ed69fb1bd9d2 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:10.056091 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cec8ce1c-2563-4f37-9446-ed69fb1bd9d2 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:10.257217 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-033521cb-493d-4e0b-b6e3-51369138d0d9 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:10.271806 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-033521cb-493d-4e0b-b6e3-51369138d0d9 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253" status: 200 len: 1517 microversion: 2.1 time: 0.626989 Oct 17 13:42:10.272732 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1069/2138] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:09 2022] GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253 => generated 1517 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:10.283896 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7505b76a-1c4e-4e0e-9f65-1b0f05af9148 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Action: 'create', calling method: .version_select at 0x7f7cd5225c10>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1682438471", "description": "tempest-description-320943130"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:42:10.857324 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cec8ce1c-2563-4f37-9446-ed69fb1bd9d2 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:10.875148 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cec8ce1c-2563-4f37-9446-ed69fb1bd9d2 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/3e1d2587-26db-449e-81cd-677ce4f87a76" status: 200 len: 1493 microversion: 2.1 time: 0.848773 Oct 17 13:42:10.883969 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1070/2139] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:10 2022] GET /compute/v2.1/servers/3e1d2587-26db-449e-81cd-677ce4f87a76 => generated 1493 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:10.902943 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-08c93b59-bbeb-4661-8922-c5766c6af6db tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:10.905042 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-08c93b59-bbeb-4661-8922-c5766c6af6db tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 709d926d-fba5-49ea-84ac-95d8bb018c68] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:10.913260 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-08c93b59-bbeb-4661-8922-c5766c6af6db tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:10.914120 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-08c93b59-bbeb-4661-8922-c5766c6af6db tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:10.914916 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-08c93b59-bbeb-4661-8922-c5766c6af6db tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:10.916041 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-08c93b59-bbeb-4661-8922-c5766c6af6db tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:10.916858 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-08c93b59-bbeb-4661-8922-c5766c6af6db tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:10.917488 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-08c93b59-bbeb-4661-8922-c5766c6af6db tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:10.969121 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:42:11.158253 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7505b76a-1c4e-4e0e-9f65-1b0f05af9148 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.881709 Oct 17 13:42:11.169128 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1070/2140] 10.222.0.79 () {60 vars in 1180 bytes} [Mon Oct 17 13:42:10 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:42:11.307099 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=10 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:42:11.320018 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4c713f2b-4f4f-4704-bfb0-0d2e87bf1eee tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:11.320930 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4c713f2b-4f4f-4704-bfb0-0d2e87bf1eee tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9044674d-a793-46c2-b3ec-e9377b30f253] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:11.333524 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4c713f2b-4f4f-4704-bfb0-0d2e87bf1eee tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:11.334284 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4c713f2b-4f4f-4704-bfb0-0d2e87bf1eee tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:11.334871 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4c713f2b-4f4f-4704-bfb0-0d2e87bf1eee tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:11.335863 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4c713f2b-4f4f-4704-bfb0-0d2e87bf1eee tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:11.336461 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4c713f2b-4f4f-4704-bfb0-0d2e87bf1eee tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:11.337018 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4c713f2b-4f4f-4704-bfb0-0d2e87bf1eee tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:11.628483 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-08c93b59-bbeb-4661-8922-c5766c6af6db tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:11.642328 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-08c93b59-bbeb-4661-8922-c5766c6af6db tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:11.644124 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-08c93b59-bbeb-4661-8922-c5766c6af6db tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:11.649709 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-08c93b59-bbeb-4661-8922-c5766c6af6db tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68" status: 200 len: 1813 microversion: 2.25 time: 0.752908 Oct 17 13:42:11.650811 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1071/2141] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:42:10 2022] GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68 => generated 1813 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:42:11.661779 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c2c773f1-c4f7-452f-baba-3deb6530637b tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-714041834", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "ecd2d387-07d8-47d6-a0ee-13b7d19ceb82"}]}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:42:11.687966 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4c713f2b-4f4f-4704-bfb0-0d2e87bf1eee tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:11.704021 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4c713f2b-4f4f-4704-bfb0-0d2e87bf1eee tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253" status: 200 len: 1517 microversion: 2.1 time: 0.392663 Oct 17 13:42:11.720871 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1071/2142] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:11 2022] GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253 => generated 1517 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:11.735209 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-eb998612-54d1-47e4-8d04-b561e58613f9 req-143082f2-3496-4f11-bf76-bcae247c3b2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e1d2587-26db-449e-81cd-677ce4f87a76", "name": "network-vif-unplugged", "status": "completed", "tag": "396d247b-3b59-4e2c-b01c-d755d6e8254c"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:42:11.760811 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-eb998612-54d1-47e4-8d04-b561e58613f9 req-143082f2-3496-4f11-bf76-bcae247c3b2a service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:11.761628 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-eb998612-54d1-47e4-8d04-b561e58613f9 req-143082f2-3496-4f11-bf76-bcae247c3b2a service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:11.762100 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-eb998612-54d1-47e4-8d04-b561e58613f9 req-143082f2-3496-4f11-bf76-bcae247c3b2a service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:11.778876 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-c2c773f1-c4f7-452f-baba-3deb6530637b tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] validate_networks() for [('ecd2d387-07d8-47d6-a0ee-13b7d19ceb82', None, None, None, None, None)] {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:42:11.806796 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-eb998612-54d1-47e4-8d04-b561e58613f9 req-143082f2-3496-4f11-bf76-bcae247c3b2a service nova] Creating event network-vif-unplugged:396d247b-3b59-4e2c-b01c-d755d6e8254c for instance 3e1d2587-26db-449e-81cd-677ce4f87a76 on n-h1-854247-14 Oct 17 13:42:11.816338 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-eb998612-54d1-47e4-8d04-b561e58613f9 req-143082f2-3496-4f11-bf76-bcae247c3b2a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094099 Oct 17 13:42:11.820771 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1072/2143] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:42:11.922352 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-00537f81-d46e-487c-8e25-85a51b80bd5d tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:11.922982 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-00537f81-d46e-487c-8e25-85a51b80bd5d tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 3e1d2587-26db-449e-81cd-677ce4f87a76] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:11.937744 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-00537f81-d46e-487c-8e25-85a51b80bd5d tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:11.938403 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-00537f81-d46e-487c-8e25-85a51b80bd5d tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:11.938846 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-00537f81-d46e-487c-8e25-85a51b80bd5d tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:11.941947 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-00537f81-d46e-487c-8e25-85a51b80bd5d tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:11.942423 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-00537f81-d46e-487c-8e25-85a51b80bd5d tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:11.942855 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-00537f81-d46e-487c-8e25-85a51b80bd5d tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:12.242970 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-00537f81-d46e-487c-8e25-85a51b80bd5d tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386397fd9194430b81ac465f9b3bf92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461c44cb99ff4958a128679d3e10cd6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:12.252532 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-00537f81-d46e-487c-8e25-85a51b80bd5d tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/3e1d2587-26db-449e-81cd-677ce4f87a76" status: 200 len: 1493 microversion: 2.1 time: 0.339030 Oct 17 13:42:12.256632 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1073/2144] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:11 2022] GET /compute/v2.1/servers/3e1d2587-26db-449e-81cd-677ce4f87a76 => generated 1493 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:12.263815 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6b361b3b-fb30-46f0-80e7-73295dad8fc5 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:12.271402 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6b361b3b-fb30-46f0-80e7-73295dad8fc5 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] [instance: 95418c39-6c0a-444e-93b4-4a90b31f3034] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:12.283352 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6b361b3b-fb30-46f0-80e7-73295dad8fc5 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:12.286921 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6b361b3b-fb30-46f0-80e7-73295dad8fc5 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:12.287782 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6b361b3b-fb30-46f0-80e7-73295dad8fc5 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:12.288693 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6b361b3b-fb30-46f0-80e7-73295dad8fc5 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:12.289298 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6b361b3b-fb30-46f0-80e7-73295dad8fc5 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:12.291705 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6b361b3b-fb30-46f0-80e7-73295dad8fc5 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:13.133186 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6b361b3b-fb30-46f0-80e7-73295dad8fc5 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b891d3b774e44de3ad1d3088990f6bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358604dd1cf74e5fab262179351d4d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:13.153972 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6b361b3b-fb30-46f0-80e7-73295dad8fc5 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] 10.222.0.79 "GET /compute/v2.1/servers/95418c39-6c0a-444e-93b4-4a90b31f3034" status: 200 len: 1589 microversion: 2.1 time: 0.895903 Oct 17 13:42:13.176569 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1074/2145] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:12 2022] GET /compute/v2.1/servers/95418c39-6c0a-444e-93b4-4a90b31f3034 => generated 1589 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:13.181657 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-c2c773f1-c4f7-452f-baba-3deb6530637b tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:42:13.184865 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-c2c773f1-c4f7-452f-baba-3deb6530637b tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:42:13.186955 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-c2c773f1-c4f7-452f-baba-3deb6530637b tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:42:13.187804 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-c2c773f1-c4f7-452f-baba-3deb6530637b tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:42:13.188700 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-c2c773f1-c4f7-452f-baba-3deb6530637b tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:42:13.196679 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-d332356d-2092-44c8-9058-eccb51e9f9cc req-3ba9b36c-c319-416e-b120-7274c795c44e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95418c39-6c0a-444e-93b4-4a90b31f3034", "tag": "6ebf3968-13ef-4f4d-8666-1d89782149bf"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:42:13.211719 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-d332356d-2092-44c8-9058-eccb51e9f9cc req-3ba9b36c-c319-416e-b120-7274c795c44e service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:13.215637 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-d332356d-2092-44c8-9058-eccb51e9f9cc req-3ba9b36c-c319-416e-b120-7274c795c44e service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:13.219429 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c2c773f1-c4f7-452f-baba-3deb6530637b tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:13.220487 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c2c773f1-c4f7-452f-baba-3deb6530637b tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:13.220870 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-d332356d-2092-44c8-9058-eccb51e9f9cc req-3ba9b36c-c319-416e-b120-7274c795c44e service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:13.221412 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c2c773f1-c4f7-452f-baba-3deb6530637b tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:13.222443 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c2c773f1-c4f7-452f-baba-3deb6530637b tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:13.223085 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c2c773f1-c4f7-452f-baba-3deb6530637b tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:13.223939 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c2c773f1-c4f7-452f-baba-3deb6530637b tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:13.243256 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-d332356d-2092-44c8-9058-eccb51e9f9cc req-3ba9b36c-c319-416e-b120-7274c795c44e service nova] Creating event network-changed:6ebf3968-13ef-4f4d-8666-1d89782149bf for instance 95418c39-6c0a-444e-93b4-4a90b31f3034 on n-h1-854247-14 Oct 17 13:42:13.261883 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-c2c773f1-c4f7-452f-baba-3deb6530637b tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Getting quotas for project 50c0147c5fae4017810887843b0afaa0. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:42:13.268318 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-d332356d-2092-44c8-9058-eccb51e9f9cc req-3ba9b36c-c319-416e-b120-7274c795c44e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090329 Oct 17 13:42:13.269250 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1075/2146] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:42:13.271862 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-c2c773f1-c4f7-452f-baba-3deb6530637b tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Getting quotas for user 185235bc4e3245fc8d92b7e4bff6cbbd and project 50c0147c5fae4017810887843b0afaa0. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:42:13.281351 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9bbddd34-4609-4dd0-afe3-00095263445f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:13.282322 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9bbddd34-4609-4dd0-afe3-00095263445f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 709d926d-fba5-49ea-84ac-95d8bb018c68] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:13.296426 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9bbddd34-4609-4dd0-afe3-00095263445f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:13.312090 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9bbddd34-4609-4dd0-afe3-00095263445f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:13.314271 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9bbddd34-4609-4dd0-afe3-00095263445f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:13.315209 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c2c773f1-c4f7-452f-baba-3deb6530637b tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:42:13.316117 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9bbddd34-4609-4dd0-afe3-00095263445f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:13.317962 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c2c773f1-c4f7-452f-baba-3deb6530637b tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] [instance: bc9feeff-1ac7-4267-9351-3f1560dede9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:42:13.318746 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9bbddd34-4609-4dd0-afe3-00095263445f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:13.319968 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9bbddd34-4609-4dd0-afe3-00095263445f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:13.439303 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c2c773f1-c4f7-452f-baba-3deb6530637b tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.786740 Oct 17 13:42:13.440198 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1072/2147] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:42:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:42:13.452102 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3ea07060-d722-4934-b6a2-d04a61c41511 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:13.452603 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3ea07060-d722-4934-b6a2-d04a61c41511 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9044674d-a793-46c2-b3ec-e9377b30f253] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:13.511098 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3ea07060-d722-4934-b6a2-d04a61c41511 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:13.511630 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3ea07060-d722-4934-b6a2-d04a61c41511 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:13.512107 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3ea07060-d722-4934-b6a2-d04a61c41511 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:13.522150 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3ea07060-d722-4934-b6a2-d04a61c41511 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:13.525879 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3ea07060-d722-4934-b6a2-d04a61c41511 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:13.526614 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3ea07060-d722-4934-b6a2-d04a61c41511 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:14.864851 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9bbddd34-4609-4dd0-afe3-00095263445f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:14.868100 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3ea07060-d722-4934-b6a2-d04a61c41511 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:14.935602 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3ea07060-d722-4934-b6a2-d04a61c41511 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253" status: 200 len: 1517 microversion: 2.1 time: 1.482349 Oct 17 13:42:14.938739 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1073/2148] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:13 2022] GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253 => generated 1517 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:14.943992 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9bbddd34-4609-4dd0-afe3-00095263445f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:14.945566 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9bbddd34-4609-4dd0-afe3-00095263445f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:14.952235 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9bbddd34-4609-4dd0-afe3-00095263445f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68" status: 200 len: 1813 microversion: 2.25 time: 1.681743 Oct 17 13:42:14.957530 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1076/2149] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:42:13 2022] GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68 => generated 1813 bytes in 1687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:42:14.959728 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ed190262-22d4-4ebc-9eef-09422274c242 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:14.962424 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ed190262-22d4-4ebc-9eef-09422274c242 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 3e1d2587-26db-449e-81cd-677ce4f87a76] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:14.975286 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a67c59b8-1535-4fa7-9ea4-4cc8d9bbdfb3 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:14.977606 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a67c59b8-1535-4fa7-9ea4-4cc8d9bbdfb3 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] [instance: bc9feeff-1ac7-4267-9351-3f1560dede9b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:14.983884 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ed190262-22d4-4ebc-9eef-09422274c242 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:14.984802 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ed190262-22d4-4ebc-9eef-09422274c242 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:14.985866 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ed190262-22d4-4ebc-9eef-09422274c242 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:15.001238 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ed190262-22d4-4ebc-9eef-09422274c242 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:15.003443 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ed190262-22d4-4ebc-9eef-09422274c242 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:15.005898 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ed190262-22d4-4ebc-9eef-09422274c242 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:15.019721 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a67c59b8-1535-4fa7-9ea4-4cc8d9bbdfb3 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:15.025811 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a67c59b8-1535-4fa7-9ea4-4cc8d9bbdfb3 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:15.026366 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a67c59b8-1535-4fa7-9ea4-4cc8d9bbdfb3 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:15.031258 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a67c59b8-1535-4fa7-9ea4-4cc8d9bbdfb3 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:15.031803 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a67c59b8-1535-4fa7-9ea4-4cc8d9bbdfb3 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:15.032259 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a67c59b8-1535-4fa7-9ea4-4cc8d9bbdfb3 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:15.107309 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-ed190262-22d4-4ebc-9eef-09422274c242 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] HTTP exception thrown: Instance 3e1d2587-26db-449e-81cd-677ce4f87a76 could not be found. Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ed190262-22d4-4ebc-9eef-09422274c242 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Request method failure captured: Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/3e1d2587-26db-449e-81cd-677ce4f87a76 HTTP/1.1 Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVpcWSwKjkgHu1pOrzJj6HiDQ9hS6xF0hnYpT-9MjemVLwNDzCl7w6ETLwt3fC-SanrMXYSA6kHfWUvQJu5a3Y3I946ESkVOejyjKOR-whNFZHQOyDE2dNW3q_jrKN41Sl71zQIcHHv_pCPQ5Cu97jE35pUEh3xL0sRiioyX-jyds1o Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 461c44cb99ff4958a128679d3e10cd6f Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ImagesTestJSON-1110552804 Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/461c44cb99ff4958a128679d3e10cd6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/461c44cb99ff4958a128679d3e10cd6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/461c44cb99ff4958a128679d3e10cd6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_461c44cb99ff4958a128679d3e10cd6f", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ImagesTestJSON-1110552804 Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 461c44cb99ff4958a128679d3e10cd6f Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ImagesTestJSON-1110552804 Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ImagesTestJSON-1110552804-project Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 386397fd9194430b81ac465f9b3bf92d Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ImagesTestJSON-1110552804-project Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 3e1d2587-26db-449e-81cd-677ce4f87a76 could not be found. Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '3e1d2587-26db-449e-81cd-677ce4f87a76'} Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e1d2587-26db-449e-81cd-677ce4f87a76 could not be found. Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e1d2587-26db-449e-81cd-677ce4f87a76 could not be found. Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:15.111413 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:15.116246 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:15.116246 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:15.116246 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:42:15.116246 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:42:15.116246 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e1d2587-26db-449e-81cd-677ce4f87a76 could not be found. Oct 17 13:42:15.116246 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:15.117378 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ed190262-22d4-4ebc-9eef-09422274c242 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Returning 404 to user: Instance 3e1d2587-26db-449e-81cd-677ce4f87a76 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:42:15.120180 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ed190262-22d4-4ebc-9eef-09422274c242 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/3e1d2587-26db-449e-81cd-677ce4f87a76" status: 404 len: 111 microversion: 2.1 time: 0.176824 Oct 17 13:42:15.124062 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1074/2150] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:14 2022] GET /compute/v2.1/servers/3e1d2587-26db-449e-81cd-677ce4f87a76 => generated 111 bytes in 181 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:42:15.145301 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5b9d046d-a756-48ba-8d96-d6add51fef16 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:15.151886 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5b9d046d-a756-48ba-8d96-d6add51fef16 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 0f4b3e9d-93c2-4556-84c6-b4fb26f4424d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:15.169507 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5b9d046d-a756-48ba-8d96-d6add51fef16 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:15.170635 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5b9d046d-a756-48ba-8d96-d6add51fef16 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:15.171262 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5b9d046d-a756-48ba-8d96-d6add51fef16 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:15.172129 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5b9d046d-a756-48ba-8d96-d6add51fef16 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:15.172723 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5b9d046d-a756-48ba-8d96-d6add51fef16 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:15.175691 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5b9d046d-a756-48ba-8d96-d6add51fef16 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:15.211269 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-5b9d046d-a756-48ba-8d96-d6add51fef16 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] HTTP exception thrown: Instance 0f4b3e9d-93c2-4556-84c6-b4fb26f4424d could not be found. Oct 17 13:42:15.213071 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5b9d046d-a756-48ba-8d96-d6add51fef16 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Request method failure captured: Oct 17 13:42:15.213071 n-d-854247-14 devstack@n-api.service[127016]: request: DELETE /compute/v2.1/servers/0f4b3e9d-93c2-4556-84c6-b4fb26f4424d HTTP/1.1 Oct 17 13:42:15.213071 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:42:15.213071 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:42:15.213071 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:42:15.213071 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:42:15.213071 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:42:15.213071 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:42:15.213071 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:42:15.213071 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:42:15.213071 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVpcWSwKjkgHu1pOrzJj6HiDQ9hS6xF0hnYpT-9MjemVLwNDzCl7w6ETLwt3fC-SanrMXYSA6kHfWUvQJu5a3Y3I946ESkVOejyjKOR-whNFZHQOyDE2dNW3q_jrKN41Sl71zQIcHHv_pCPQ5Cu97jE35pUEh3xL0sRiioyX-jyds1o Oct 17 13:42:15.213071 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:42:15.213071 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:42:15.213071 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:42:15.213071 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:42:15.213071 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:42:15.213071 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:42:15.213071 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 461c44cb99ff4958a128679d3e10cd6f Oct 17 13:42:15.213071 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ImagesTestJSON-1110552804 Oct 17 13:42:15.213071 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:42:15.213071 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:42:15.213071 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/461c44cb99ff4958a128679d3e10cd6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/461c44cb99ff4958a128679d3e10cd6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/461c44cb99ff4958a128679d3e10cd6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_461c44cb99ff4958a128679d3e10cd6f", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:42:15.213071 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ImagesTestJSON-1110552804 Oct 17 13:42:15.213071 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 461c44cb99ff4958a128679d3e10cd6f Oct 17 13:42:15.213071 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ImagesTestJSON-1110552804 Oct 17 13:42:15.213071 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ImagesTestJSON-1110552804-project Oct 17 13:42:15.213071 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:42:15.213071 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:42:15.213071 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 386397fd9194430b81ac465f9b3bf92d Oct 17 13:42:15.213071 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ImagesTestJSON-1110552804-project Oct 17 13:42:15.213071 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:42:15.213071 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 0f4b3e9d-93c2-4556-84c6-b4fb26f4424d could not be found. Oct 17 13:42:15.213071 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '0f4b3e9d-93c2-4556-84c6-b4fb26f4424d'} Oct 17 13:42:15.213071 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:42:15.213071 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:15.213071 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:42:15.213071 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:42:15.213071 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:42:15.213071 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:42:15.213071 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:42:15.213071 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:42:15.213071 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:42:15.213071 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:42:15.213071 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f4b3e9d-93c2-4556-84c6-b4fb26f4424d could not be found. Oct 17 13:42:15.213071 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:15.213071 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:15.213071 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:15.213071 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:15.213071 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:15.213071 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:15.213071 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:42:15.213071 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:42:15.213071 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:42:15.213071 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:42:15.213071 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:42:15.213071 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:42:15.213071 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:42:15.213071 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:42:15.213071 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:42:15.213071 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:42:15.213071 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:42:15.213071 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:42:15.213071 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f4b3e9d-93c2-4556-84c6-b4fb26f4424d could not be found. Oct 17 13:42:15.217149 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:15.217149 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:15.217149 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:15.217149 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:15.217149 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:15.217149 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:15.217149 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:42:15.217149 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:42:15.217149 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f4b3e9d-93c2-4556-84c6-b4fb26f4424d could not be found. Oct 17 13:42:15.217149 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:15.219139 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5b9d046d-a756-48ba-8d96-d6add51fef16 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Returning 404 to user: Instance 0f4b3e9d-93c2-4556-84c6-b4fb26f4424d could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:42:15.220177 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5b9d046d-a756-48ba-8d96-d6add51fef16 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "DELETE /compute/v2.1/servers/0f4b3e9d-93c2-4556-84c6-b4fb26f4424d" status: 404 len: 111 microversion: 2.1 time: 0.091997 Oct 17 13:42:15.224241 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1075/2151] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:42:15 2022] DELETE /compute/v2.1/servers/0f4b3e9d-93c2-4556-84c6-b4fb26f4424d => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:42:15.230041 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-61a7c601-3b63-4699-a30d-b0bc200ee84d tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:15.231064 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-61a7c601-3b63-4699-a30d-b0bc200ee84d tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 0f4b3e9d-93c2-4556-84c6-b4fb26f4424d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:15.237997 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-61a7c601-3b63-4699-a30d-b0bc200ee84d tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:15.239741 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-61a7c601-3b63-4699-a30d-b0bc200ee84d tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:15.240433 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-61a7c601-3b63-4699-a30d-b0bc200ee84d tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:15.241349 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-61a7c601-3b63-4699-a30d-b0bc200ee84d tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:15.242023 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-61a7c601-3b63-4699-a30d-b0bc200ee84d tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:15.242634 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-61a7c601-3b63-4699-a30d-b0bc200ee84d tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:15.297894 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-61a7c601-3b63-4699-a30d-b0bc200ee84d tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] HTTP exception thrown: Instance 0f4b3e9d-93c2-4556-84c6-b4fb26f4424d could not be found. Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-61a7c601-3b63-4699-a30d-b0bc200ee84d tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Request method failure captured: Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/0f4b3e9d-93c2-4556-84c6-b4fb26f4424d HTTP/1.1 Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVpcWSwKjkgHu1pOrzJj6HiDQ9hS6xF0hnYpT-9MjemVLwNDzCl7w6ETLwt3fC-SanrMXYSA6kHfWUvQJu5a3Y3I946ESkVOejyjKOR-whNFZHQOyDE2dNW3q_jrKN41Sl71zQIcHHv_pCPQ5Cu97jE35pUEh3xL0sRiioyX-jyds1o Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 461c44cb99ff4958a128679d3e10cd6f Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ImagesTestJSON-1110552804 Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/461c44cb99ff4958a128679d3e10cd6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/461c44cb99ff4958a128679d3e10cd6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/461c44cb99ff4958a128679d3e10cd6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_461c44cb99ff4958a128679d3e10cd6f", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ImagesTestJSON-1110552804 Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 461c44cb99ff4958a128679d3e10cd6f Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ImagesTestJSON-1110552804 Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ImagesTestJSON-1110552804-project Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 386397fd9194430b81ac465f9b3bf92d Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ImagesTestJSON-1110552804-project Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 0f4b3e9d-93c2-4556-84c6-b4fb26f4424d could not be found. Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '0f4b3e9d-93c2-4556-84c6-b4fb26f4424d'} Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f4b3e9d-93c2-4556-84c6-b4fb26f4424d could not be found. Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f4b3e9d-93c2-4556-84c6-b4fb26f4424d could not be found. Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:15.308651 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:15.311729 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:15.311729 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:15.311729 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:42:15.311729 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:42:15.311729 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f4b3e9d-93c2-4556-84c6-b4fb26f4424d could not be found. Oct 17 13:42:15.311729 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:15.311729 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-61a7c601-3b63-4699-a30d-b0bc200ee84d tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Returning 404 to user: Instance 0f4b3e9d-93c2-4556-84c6-b4fb26f4424d could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:42:15.318954 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-61a7c601-3b63-4699-a30d-b0bc200ee84d tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/0f4b3e9d-93c2-4556-84c6-b4fb26f4424d" status: 404 len: 111 microversion: 2.1 time: 0.093055 Oct 17 13:42:15.320605 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1076/2152] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:15 2022] GET /compute/v2.1/servers/0f4b3e9d-93c2-4556-84c6-b4fb26f4424d => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:42:15.345197 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-05086d3a-792b-4b2e-95e4-d1178c23ba47 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd5465550>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:15.389678 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a67c59b8-1535-4fa7-9ea4-4cc8d9bbdfb3 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185235bc4e3245fc8d92b7e4bff6cbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c0147c5fae4017810887843b0afaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:15.394484 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-05086d3a-792b-4b2e-95e4-d1178c23ba47 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] HTTP exception thrown: Image not found. Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-05086d3a-792b-4b2e-95e4-d1178c23ba47 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Request method failure captured: Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: request: DELETE /compute/v2.1/images/a8625a43-cc13-4579-b0e9-3ebd2183a277 HTTP/1.1 Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVpcWSwKjkgHu1pOrzJj6HiDQ9hS6xF0hnYpT-9MjemVLwNDzCl7w6ETLwt3fC-SanrMXYSA6kHfWUvQJu5a3Y3I946ESkVOejyjKOR-whNFZHQOyDE2dNW3q_jrKN41Sl71zQIcHHv_pCPQ5Cu97jE35pUEh3xL0sRiioyX-jyds1o Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 461c44cb99ff4958a128679d3e10cd6f Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ImagesTestJSON-1110552804 Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/461c44cb99ff4958a128679d3e10cd6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/461c44cb99ff4958a128679d3e10cd6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/461c44cb99ff4958a128679d3e10cd6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_461c44cb99ff4958a128679d3e10cd6f", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ImagesTestJSON-1110552804 Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 461c44cb99ff4958a128679d3e10cd6f Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ImagesTestJSON-1110552804 Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ImagesTestJSON-1110552804-project Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 386397fd9194430b81ac465f9b3bf92d Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ImagesTestJSON-1110552804-project Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: method: Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: exception: Image not found. Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'a8625a43-cc13-4579-b0e9-3ebd2183a277'} Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a8625a43-cc13-4579-b0e9-3ebd2183a277 to delete Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a8625a43-cc13-4579-b0e9-3ebd2183a277 could not be found. Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:15.396930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:15.400912 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:15.400912 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:15.400912 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:42:15.400912 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:42:15.400912 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:42:15.400912 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:42:15.400912 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:42:15.400912 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:42:15.400912 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 17 13:42:15.400912 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 13:42:15.400912 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 13:42:15.400912 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:15.400912 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:15.400912 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:15.400912 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:15.400912 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:15.400912 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:15.400912 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:42:15.400912 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:42:15.400912 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 13:42:15.400912 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:15.404451 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-05086d3a-792b-4b2e-95e4-d1178c23ba47 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Returning 404 to user: Image not found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:42:15.405605 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-05086d3a-792b-4b2e-95e4-d1178c23ba47 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "DELETE /compute/v2.1/images/a8625a43-cc13-4579-b0e9-3ebd2183a277" status: 404 len: 62 microversion: 2.1 time: 0.080124 Oct 17 13:42:15.406529 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1077/2153] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:15 2022] DELETE /compute/v2.1/images/a8625a43-cc13-4579-b0e9-3ebd2183a277 => generated 62 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:42:15.426982 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5bf408c1-a869-4b89-b5ae-767d78ab4ab6 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:15.432825 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a67c59b8-1535-4fa7-9ea4-4cc8d9bbdfb3 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "GET /compute/v2.1/servers/bc9feeff-1ac7-4267-9351-3f1560dede9b" status: 200 len: 1211 microversion: 2.1 time: 0.473875 Oct 17 13:42:15.436657 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5bf408c1-a869-4b89-b5ae-767d78ab4ab6 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: b05d2fa3-d231-4842-a47b-26aa317ccaa3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:15.458271 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5bf408c1-a869-4b89-b5ae-767d78ab4ab6 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:15.461447 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5bf408c1-a869-4b89-b5ae-767d78ab4ab6 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:15.461741 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1077/2154] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:14 2022] GET /compute/v2.1/servers/bc9feeff-1ac7-4267-9351-3f1560dede9b => generated 1211 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:15.462491 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5bf408c1-a869-4b89-b5ae-767d78ab4ab6 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:15.463480 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5bf408c1-a869-4b89-b5ae-767d78ab4ab6 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:15.464940 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5bf408c1-a869-4b89-b5ae-767d78ab4ab6 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:15.465544 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5bf408c1-a869-4b89-b5ae-767d78ab4ab6 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:15.529133 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-cb756dee-bbc0-431f-8eb6-a931db00e6fa req-4fbc6d7e-57ab-4a38-9429-17355fa7700e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e1d2587-26db-449e-81cd-677ce4f87a76", "name": "network-vif-deleted", "tag": "396d247b-3b59-4e2c-b01c-d755d6e8254c"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:42:15.536560 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-5bf408c1-a869-4b89-b5ae-767d78ab4ab6 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] HTTP exception thrown: Instance b05d2fa3-d231-4842-a47b-26aa317ccaa3 could not be found. Oct 17 13:42:15.538192 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5bf408c1-a869-4b89-b5ae-767d78ab4ab6 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Request method failure captured: Oct 17 13:42:15.538192 n-d-854247-14 devstack@n-api.service[127016]: request: DELETE /compute/v2.1/servers/b05d2fa3-d231-4842-a47b-26aa317ccaa3 HTTP/1.1 Oct 17 13:42:15.538192 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:42:15.538192 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:42:15.538192 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:42:15.538192 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:42:15.538192 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:42:15.538192 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:42:15.538192 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:42:15.538192 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:42:15.538192 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVpcWSwKjkgHu1pOrzJj6HiDQ9hS6xF0hnYpT-9MjemVLwNDzCl7w6ETLwt3fC-SanrMXYSA6kHfWUvQJu5a3Y3I946ESkVOejyjKOR-whNFZHQOyDE2dNW3q_jrKN41Sl71zQIcHHv_pCPQ5Cu97jE35pUEh3xL0sRiioyX-jyds1o Oct 17 13:42:15.538192 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:42:15.538192 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:42:15.538192 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:42:15.538192 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:42:15.538192 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:42:15.538192 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:42:15.538192 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 461c44cb99ff4958a128679d3e10cd6f Oct 17 13:42:15.538192 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ImagesTestJSON-1110552804 Oct 17 13:42:15.538192 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:42:15.538192 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:42:15.538192 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/461c44cb99ff4958a128679d3e10cd6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/461c44cb99ff4958a128679d3e10cd6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/461c44cb99ff4958a128679d3e10cd6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_461c44cb99ff4958a128679d3e10cd6f", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:42:15.538192 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ImagesTestJSON-1110552804 Oct 17 13:42:15.538192 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 461c44cb99ff4958a128679d3e10cd6f Oct 17 13:42:15.538192 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ImagesTestJSON-1110552804 Oct 17 13:42:15.538192 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ImagesTestJSON-1110552804-project Oct 17 13:42:15.538192 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:42:15.538192 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:42:15.538192 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 386397fd9194430b81ac465f9b3bf92d Oct 17 13:42:15.538192 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ImagesTestJSON-1110552804-project Oct 17 13:42:15.538192 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:42:15.538192 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance b05d2fa3-d231-4842-a47b-26aa317ccaa3 could not be found. Oct 17 13:42:15.538192 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'b05d2fa3-d231-4842-a47b-26aa317ccaa3'} Oct 17 13:42:15.538192 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:42:15.538192 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:15.538192 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:42:15.538192 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:42:15.538192 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:42:15.538192 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:42:15.538192 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:42:15.538192 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:42:15.538192 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:42:15.538192 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:42:15.538192 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b05d2fa3-d231-4842-a47b-26aa317ccaa3 could not be found. Oct 17 13:42:15.538192 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:15.538192 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:15.538192 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:15.538192 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:15.538192 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:15.538192 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:15.538192 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:42:15.538192 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:42:15.538192 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:42:15.538192 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:42:15.538192 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:42:15.538192 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:42:15.538192 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:42:15.538192 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:42:15.538192 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:42:15.538192 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:42:15.538192 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:42:15.538192 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:42:15.538192 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b05d2fa3-d231-4842-a47b-26aa317ccaa3 could not be found. Oct 17 13:42:15.541656 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:15.541656 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:15.541656 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:15.541656 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:15.541656 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:15.541656 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:15.541656 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:42:15.541656 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:42:15.541656 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b05d2fa3-d231-4842-a47b-26aa317ccaa3 could not be found. Oct 17 13:42:15.541656 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:15.541656 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5bf408c1-a869-4b89-b5ae-767d78ab4ab6 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Returning 404 to user: Instance b05d2fa3-d231-4842-a47b-26aa317ccaa3 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:42:15.550639 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-cb756dee-bbc0-431f-8eb6-a931db00e6fa req-4fbc6d7e-57ab-4a38-9429-17355fa7700e service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:15.551509 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-cb756dee-bbc0-431f-8eb6-a931db00e6fa req-4fbc6d7e-57ab-4a38-9429-17355fa7700e service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:15.552453 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-cb756dee-bbc0-431f-8eb6-a931db00e6fa req-4fbc6d7e-57ab-4a38-9429-17355fa7700e service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:15.569169 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-cb756dee-bbc0-431f-8eb6-a931db00e6fa req-4fbc6d7e-57ab-4a38-9429-17355fa7700e service nova] Creating event network-vif-deleted:396d247b-3b59-4e2c-b01c-d755d6e8254c for instance 3e1d2587-26db-449e-81cd-677ce4f87a76 on n-h1-854247-14 Oct 17 13:42:15.576238 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-cb756dee-bbc0-431f-8eb6-a931db00e6fa req-4fbc6d7e-57ab-4a38-9429-17355fa7700e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056472 Oct 17 13:42:15.578578 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1078/2155] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:42:15.579757 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5bf408c1-a869-4b89-b5ae-767d78ab4ab6 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "DELETE /compute/v2.1/servers/b05d2fa3-d231-4842-a47b-26aa317ccaa3" status: 404 len: 111 microversion: 2.1 time: 0.163780 Oct 17 13:42:15.581019 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1078/2156] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:42:15 2022] DELETE /compute/v2.1/servers/b05d2fa3-d231-4842-a47b-26aa317ccaa3 => generated 111 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:42:15.618484 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e2ede3f2-fb95-4a60-9206-bc124fb58826 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:15.619237 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e2ede3f2-fb95-4a60-9206-bc124fb58826 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: b05d2fa3-d231-4842-a47b-26aa317ccaa3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:15.636845 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e2ede3f2-fb95-4a60-9206-bc124fb58826 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:15.637364 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e2ede3f2-fb95-4a60-9206-bc124fb58826 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:15.643060 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e2ede3f2-fb95-4a60-9206-bc124fb58826 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:15.643882 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e2ede3f2-fb95-4a60-9206-bc124fb58826 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:15.645477 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e2ede3f2-fb95-4a60-9206-bc124fb58826 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:15.645477 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e2ede3f2-fb95-4a60-9206-bc124fb58826 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:15.679296 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-e2ede3f2-fb95-4a60-9206-bc124fb58826 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] HTTP exception thrown: Instance b05d2fa3-d231-4842-a47b-26aa317ccaa3 could not be found. Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e2ede3f2-fb95-4a60-9206-bc124fb58826 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Request method failure captured: Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/b05d2fa3-d231-4842-a47b-26aa317ccaa3 HTTP/1.1 Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVpcWSwKjkgHu1pOrzJj6HiDQ9hS6xF0hnYpT-9MjemVLwNDzCl7w6ETLwt3fC-SanrMXYSA6kHfWUvQJu5a3Y3I946ESkVOejyjKOR-whNFZHQOyDE2dNW3q_jrKN41Sl71zQIcHHv_pCPQ5Cu97jE35pUEh3xL0sRiioyX-jyds1o Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 461c44cb99ff4958a128679d3e10cd6f Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ImagesTestJSON-1110552804 Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/461c44cb99ff4958a128679d3e10cd6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/461c44cb99ff4958a128679d3e10cd6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/461c44cb99ff4958a128679d3e10cd6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_461c44cb99ff4958a128679d3e10cd6f", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ImagesTestJSON-1110552804 Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 461c44cb99ff4958a128679d3e10cd6f Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ImagesTestJSON-1110552804 Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ImagesTestJSON-1110552804-project Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 386397fd9194430b81ac465f9b3bf92d Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ImagesTestJSON-1110552804-project Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance b05d2fa3-d231-4842-a47b-26aa317ccaa3 could not be found. Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'b05d2fa3-d231-4842-a47b-26aa317ccaa3'} Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b05d2fa3-d231-4842-a47b-26aa317ccaa3 could not be found. Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b05d2fa3-d231-4842-a47b-26aa317ccaa3 could not be found. Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:42:15.691441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:15.694600 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:15.694600 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:15.694600 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:42:15.694600 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:42:15.694600 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b05d2fa3-d231-4842-a47b-26aa317ccaa3 could not be found. Oct 17 13:42:15.694600 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:42:15.697228 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e2ede3f2-fb95-4a60-9206-bc124fb58826 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Returning 404 to user: Instance b05d2fa3-d231-4842-a47b-26aa317ccaa3 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:42:15.699017 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e2ede3f2-fb95-4a60-9206-bc124fb58826 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/b05d2fa3-d231-4842-a47b-26aa317ccaa3" status: 404 len: 111 microversion: 2.1 time: 0.113014 Oct 17 13:42:15.708417 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1079/2157] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:15 2022] GET /compute/v2.1/servers/b05d2fa3-d231-4842-a47b-26aa317ccaa3 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:42:15.716366 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e10b22e8-4073-4b78-ac77-15a98f60fd08 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd554dca0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:15.751869 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-e10b22e8-4073-4b78-ac77-15a98f60fd08 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] HTTP exception thrown: Image not found. Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e10b22e8-4073-4b78-ac77-15a98f60fd08 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Request method failure captured: Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: request: DELETE /compute/v2.1/images/377d98df-8887-4bb0-8a0b-84e4f2dc3871 HTTP/1.1 Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVpcWSwKjkgHu1pOrzJj6HiDQ9hS6xF0hnYpT-9MjemVLwNDzCl7w6ETLwt3fC-SanrMXYSA6kHfWUvQJu5a3Y3I946ESkVOejyjKOR-whNFZHQOyDE2dNW3q_jrKN41Sl71zQIcHHv_pCPQ5Cu97jE35pUEh3xL0sRiioyX-jyds1o Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 461c44cb99ff4958a128679d3e10cd6f Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ImagesTestJSON-1110552804 Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/461c44cb99ff4958a128679d3e10cd6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/461c44cb99ff4958a128679d3e10cd6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/461c44cb99ff4958a128679d3e10cd6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_461c44cb99ff4958a128679d3e10cd6f", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ImagesTestJSON-1110552804 Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 461c44cb99ff4958a128679d3e10cd6f Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ImagesTestJSON-1110552804 Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ImagesTestJSON-1110552804-project Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 386397fd9194430b81ac465f9b3bf92d Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ImagesTestJSON-1110552804-project Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: method: Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: exception: Image not found. Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '377d98df-8887-4bb0-8a0b-84e4f2dc3871'} Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 377d98df-8887-4bb0-8a0b-84e4f2dc3871 to delete Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 377d98df-8887-4bb0-8a0b-84e4f2dc3871 could not be found. Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:15.754463 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:15.757661 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:15.757661 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:15.757661 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:42:15.757661 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:42:15.757661 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:42:15.757661 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:42:15.757661 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:42:15.757661 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:42:15.757661 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 17 13:42:15.757661 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 13:42:15.757661 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 13:42:15.757661 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:15.757661 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:15.757661 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:15.757661 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:15.757661 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:15.757661 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:15.757661 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:42:15.757661 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:42:15.757661 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 13:42:15.757661 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:15.760714 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e10b22e8-4073-4b78-ac77-15a98f60fd08 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Returning 404 to user: Image not found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:42:15.761862 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e10b22e8-4073-4b78-ac77-15a98f60fd08 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "DELETE /compute/v2.1/images/377d98df-8887-4bb0-8a0b-84e4f2dc3871" status: 404 len: 62 microversion: 2.1 time: 0.050011 Oct 17 13:42:15.763649 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1079/2158] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:15 2022] DELETE /compute/v2.1/images/377d98df-8887-4bb0-8a0b-84e4f2dc3871 => generated 62 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:42:15.771232 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9627033a-36a8-4ad7-94e5-23bdcedc25ba tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:15.771785 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9627033a-36a8-4ad7-94e5-23bdcedc25ba tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: d78e88b4-522f-4e6e-bcaa-dc259d9b8c89] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:15.781834 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9627033a-36a8-4ad7-94e5-23bdcedc25ba tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:15.786323 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9627033a-36a8-4ad7-94e5-23bdcedc25ba tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:15.786785 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9627033a-36a8-4ad7-94e5-23bdcedc25ba tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:15.787583 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9627033a-36a8-4ad7-94e5-23bdcedc25ba tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:15.788040 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9627033a-36a8-4ad7-94e5-23bdcedc25ba tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:15.788467 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9627033a-36a8-4ad7-94e5-23bdcedc25ba tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:15.848163 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-9627033a-36a8-4ad7-94e5-23bdcedc25ba tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] HTTP exception thrown: Instance d78e88b4-522f-4e6e-bcaa-dc259d9b8c89 could not be found. Oct 17 13:42:15.851869 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9627033a-36a8-4ad7-94e5-23bdcedc25ba tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Request method failure captured: Oct 17 13:42:15.851869 n-d-854247-14 devstack@n-api.service[127017]: request: DELETE /compute/v2.1/servers/d78e88b4-522f-4e6e-bcaa-dc259d9b8c89 HTTP/1.1 Oct 17 13:42:15.851869 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:42:15.851869 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:42:15.851869 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:42:15.851869 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:42:15.851869 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:42:15.851869 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:42:15.851869 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:42:15.851869 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:42:15.851869 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVpcWSwKjkgHu1pOrzJj6HiDQ9hS6xF0hnYpT-9MjemVLwNDzCl7w6ETLwt3fC-SanrMXYSA6kHfWUvQJu5a3Y3I946ESkVOejyjKOR-whNFZHQOyDE2dNW3q_jrKN41Sl71zQIcHHv_pCPQ5Cu97jE35pUEh3xL0sRiioyX-jyds1o Oct 17 13:42:15.851869 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:42:15.851869 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:42:15.851869 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:42:15.851869 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:42:15.851869 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:42:15.851869 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:42:15.851869 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 461c44cb99ff4958a128679d3e10cd6f Oct 17 13:42:15.851869 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ImagesTestJSON-1110552804 Oct 17 13:42:15.851869 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:42:15.851869 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:42:15.851869 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/461c44cb99ff4958a128679d3e10cd6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/461c44cb99ff4958a128679d3e10cd6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/461c44cb99ff4958a128679d3e10cd6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_461c44cb99ff4958a128679d3e10cd6f", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:42:15.851869 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ImagesTestJSON-1110552804 Oct 17 13:42:15.851869 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 461c44cb99ff4958a128679d3e10cd6f Oct 17 13:42:15.851869 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ImagesTestJSON-1110552804 Oct 17 13:42:15.851869 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ImagesTestJSON-1110552804-project Oct 17 13:42:15.851869 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:42:15.851869 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:42:15.851869 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 386397fd9194430b81ac465f9b3bf92d Oct 17 13:42:15.851869 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ImagesTestJSON-1110552804-project Oct 17 13:42:15.851869 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:42:15.851869 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance d78e88b4-522f-4e6e-bcaa-dc259d9b8c89 could not be found. Oct 17 13:42:15.851869 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'd78e88b4-522f-4e6e-bcaa-dc259d9b8c89'} Oct 17 13:42:15.851869 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:42:15.851869 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:15.851869 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:42:15.851869 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:42:15.851869 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:42:15.851869 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:42:15.851869 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:42:15.851869 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:42:15.851869 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:42:15.851869 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:42:15.851869 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d78e88b4-522f-4e6e-bcaa-dc259d9b8c89 could not be found. Oct 17 13:42:15.851869 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:42:15.851869 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:15.851869 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:42:15.851869 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:15.851869 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:15.851869 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:15.851869 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:42:15.851869 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:42:15.851869 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:42:15.851869 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:42:15.851869 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:42:15.851869 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:42:15.851869 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:42:15.851869 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:42:15.851869 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:42:15.851869 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:42:15.851869 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:42:15.851869 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:42:15.851869 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d78e88b4-522f-4e6e-bcaa-dc259d9b8c89 could not be found. Oct 17 13:42:15.854916 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:42:15.854916 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:15.854916 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:42:15.854916 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:15.854916 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:15.854916 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:15.854916 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:42:15.854916 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:42:15.854916 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d78e88b4-522f-4e6e-bcaa-dc259d9b8c89 could not be found. Oct 17 13:42:15.854916 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:42:15.857355 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9627033a-36a8-4ad7-94e5-23bdcedc25ba tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Returning 404 to user: Instance d78e88b4-522f-4e6e-bcaa-dc259d9b8c89 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:42:15.858776 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9627033a-36a8-4ad7-94e5-23bdcedc25ba tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "DELETE /compute/v2.1/servers/d78e88b4-522f-4e6e-bcaa-dc259d9b8c89" status: 404 len: 111 microversion: 2.1 time: 0.091830 Oct 17 13:42:15.861866 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1080/2159] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:42:15 2022] DELETE /compute/v2.1/servers/d78e88b4-522f-4e6e-bcaa-dc259d9b8c89 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:42:15.868782 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a414b721-0b91-4f4f-ad54-d8f3042dc3b7 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:15.870175 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a414b721-0b91-4f4f-ad54-d8f3042dc3b7 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: d78e88b4-522f-4e6e-bcaa-dc259d9b8c89] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:15.883270 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a414b721-0b91-4f4f-ad54-d8f3042dc3b7 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:15.885772 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a414b721-0b91-4f4f-ad54-d8f3042dc3b7 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:15.886467 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a414b721-0b91-4f4f-ad54-d8f3042dc3b7 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:15.887543 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a414b721-0b91-4f4f-ad54-d8f3042dc3b7 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:15.887950 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a414b721-0b91-4f4f-ad54-d8f3042dc3b7 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:15.888376 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a414b721-0b91-4f4f-ad54-d8f3042dc3b7 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:15.943407 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-a414b721-0b91-4f4f-ad54-d8f3042dc3b7 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] HTTP exception thrown: Instance d78e88b4-522f-4e6e-bcaa-dc259d9b8c89 could not be found. Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a414b721-0b91-4f4f-ad54-d8f3042dc3b7 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Request method failure captured: Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/d78e88b4-522f-4e6e-bcaa-dc259d9b8c89 HTTP/1.1 Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVpcWSwKjkgHu1pOrzJj6HiDQ9hS6xF0hnYpT-9MjemVLwNDzCl7w6ETLwt3fC-SanrMXYSA6kHfWUvQJu5a3Y3I946ESkVOejyjKOR-whNFZHQOyDE2dNW3q_jrKN41Sl71zQIcHHv_pCPQ5Cu97jE35pUEh3xL0sRiioyX-jyds1o Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 461c44cb99ff4958a128679d3e10cd6f Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ImagesTestJSON-1110552804 Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/461c44cb99ff4958a128679d3e10cd6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/461c44cb99ff4958a128679d3e10cd6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/461c44cb99ff4958a128679d3e10cd6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_461c44cb99ff4958a128679d3e10cd6f", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ImagesTestJSON-1110552804 Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 461c44cb99ff4958a128679d3e10cd6f Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ImagesTestJSON-1110552804 Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ImagesTestJSON-1110552804-project Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 386397fd9194430b81ac465f9b3bf92d Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ImagesTestJSON-1110552804-project Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance d78e88b4-522f-4e6e-bcaa-dc259d9b8c89 could not be found. Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'd78e88b4-522f-4e6e-bcaa-dc259d9b8c89'} Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d78e88b4-522f-4e6e-bcaa-dc259d9b8c89 could not be found. Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d78e88b4-522f-4e6e-bcaa-dc259d9b8c89 could not be found. Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:15.952926 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:15.959736 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:15.959736 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:15.959736 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:42:15.959736 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:42:15.959736 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d78e88b4-522f-4e6e-bcaa-dc259d9b8c89 could not be found. Oct 17 13:42:15.959736 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:15.959736 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a414b721-0b91-4f4f-ad54-d8f3042dc3b7 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Returning 404 to user: Instance d78e88b4-522f-4e6e-bcaa-dc259d9b8c89 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:42:15.959736 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a414b721-0b91-4f4f-ad54-d8f3042dc3b7 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/d78e88b4-522f-4e6e-bcaa-dc259d9b8c89" status: 404 len: 111 microversion: 2.1 time: 0.089600 Oct 17 13:42:15.962024 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-77d44e69-2387-42e5-aed7-724701a62adc tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:15.962664 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-77d44e69-2387-42e5-aed7-724701a62adc tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9044674d-a793-46c2-b3ec-e9377b30f253] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:15.970090 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-77d44e69-2387-42e5-aed7-724701a62adc tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:15.970586 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-77d44e69-2387-42e5-aed7-724701a62adc tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:15.971028 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-77d44e69-2387-42e5-aed7-724701a62adc tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:15.971773 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-77d44e69-2387-42e5-aed7-724701a62adc tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:15.972479 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-77d44e69-2387-42e5-aed7-724701a62adc tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:15.972634 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-77d44e69-2387-42e5-aed7-724701a62adc tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:15.973873 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1080/2160] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:15 2022] GET /compute/v2.1/servers/d78e88b4-522f-4e6e-bcaa-dc259d9b8c89 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:42:15.981346 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d71cf38f-d741-42c3-8243-93e82e04b0b3 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd54828b0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:16.047719 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-d71cf38f-d741-42c3-8243-93e82e04b0b3 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] HTTP exception thrown: Image not found. Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d71cf38f-d741-42c3-8243-93e82e04b0b3 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Request method failure captured: Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: request: DELETE /compute/v2.1/images/c13431d2-5f95-49db-9d9a-05ff951c6069 HTTP/1.1 Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVpcWSwKjkgHu1pOrzJj6HiDQ9hS6xF0hnYpT-9MjemVLwNDzCl7w6ETLwt3fC-SanrMXYSA6kHfWUvQJu5a3Y3I946ESkVOejyjKOR-whNFZHQOyDE2dNW3q_jrKN41Sl71zQIcHHv_pCPQ5Cu97jE35pUEh3xL0sRiioyX-jyds1o Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 461c44cb99ff4958a128679d3e10cd6f Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ImagesTestJSON-1110552804 Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/461c44cb99ff4958a128679d3e10cd6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/461c44cb99ff4958a128679d3e10cd6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/461c44cb99ff4958a128679d3e10cd6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_461c44cb99ff4958a128679d3e10cd6f", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ImagesTestJSON-1110552804 Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 461c44cb99ff4958a128679d3e10cd6f Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ImagesTestJSON-1110552804 Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ImagesTestJSON-1110552804-project Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 386397fd9194430b81ac465f9b3bf92d Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ImagesTestJSON-1110552804-project Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: method: Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: exception: Image not found. Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'c13431d2-5f95-49db-9d9a-05ff951c6069'} Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c13431d2-5f95-49db-9d9a-05ff951c6069 to delete Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c13431d2-5f95-49db-9d9a-05ff951c6069 could not be found. Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:16.049621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:16.052866 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:16.052866 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:16.052866 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:42:16.052866 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:42:16.052866 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:42:16.052866 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:42:16.052866 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:42:16.052866 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:42:16.052866 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 17 13:42:16.052866 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 13:42:16.052866 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 13:42:16.052866 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:16.052866 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:16.052866 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:16.052866 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:16.052866 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:16.052866 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:16.052866 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:42:16.052866 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:42:16.052866 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 13:42:16.052866 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:16.052866 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d71cf38f-d741-42c3-8243-93e82e04b0b3 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Returning 404 to user: Image not found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:42:16.052866 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d71cf38f-d741-42c3-8243-93e82e04b0b3 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "DELETE /compute/v2.1/images/c13431d2-5f95-49db-9d9a-05ff951c6069" status: 404 len: 62 microversion: 2.1 time: 0.075897 Oct 17 13:42:16.052866 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1081/2161] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:15 2022] DELETE /compute/v2.1/images/c13431d2-5f95-49db-9d9a-05ff951c6069 => generated 62 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:42:16.058919 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d1a8a601-c171-42f0-a16c-70877cceb7c6 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:16.063718 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d1a8a601-c171-42f0-a16c-70877cceb7c6 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 709d926d-fba5-49ea-84ac-95d8bb018c68] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:16.079791 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d1a8a601-c171-42f0-a16c-70877cceb7c6 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:16.080585 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d1a8a601-c171-42f0-a16c-70877cceb7c6 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:16.084571 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d1a8a601-c171-42f0-a16c-70877cceb7c6 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:16.086759 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d1a8a601-c171-42f0-a16c-70877cceb7c6 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:16.096839 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d1a8a601-c171-42f0-a16c-70877cceb7c6 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:16.097577 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d1a8a601-c171-42f0-a16c-70877cceb7c6 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:16.619264 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d1a8a601-c171-42f0-a16c-70877cceb7c6 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:16.655051 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d1a8a601-c171-42f0-a16c-70877cceb7c6 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:16.657830 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d1a8a601-c171-42f0-a16c-70877cceb7c6 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:16.659989 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d1a8a601-c171-42f0-a16c-70877cceb7c6 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68" status: 200 len: 1803 microversion: 2.25 time: 0.606623 Oct 17 13:42:16.667757 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1082/2162] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:42:16 2022] GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68 => generated 1803 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:42:16.686123 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1b017931-26a1-4bd9-898b-b00a72a65f31 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:16.690212 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-1b017931-26a1-4bd9-898b-b00a72a65f31 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: ae587603-994d-419d-979a-1b1361144872] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:16.715913 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1b017931-26a1-4bd9-898b-b00a72a65f31 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:16.716673 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1b017931-26a1-4bd9-898b-b00a72a65f31 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:16.718924 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1b017931-26a1-4bd9-898b-b00a72a65f31 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:16.719868 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1b017931-26a1-4bd9-898b-b00a72a65f31 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:16.726399 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1b017931-26a1-4bd9-898b-b00a72a65f31 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:16.727160 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1b017931-26a1-4bd9-898b-b00a72a65f31 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:16.769967 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-77d44e69-2387-42e5-aed7-724701a62adc tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:16.775956 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-1b017931-26a1-4bd9-898b-b00a72a65f31 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] HTTP exception thrown: Instance ae587603-994d-419d-979a-1b1361144872 could not be found. Oct 17 13:42:16.783810 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-77d44e69-2387-42e5-aed7-724701a62adc tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253" status: 200 len: 1517 microversion: 2.1 time: 0.824659 Oct 17 13:42:16.787840 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1081/2163] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:15 2022] GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253 => generated 1517 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:42:16.802322 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1b017931-26a1-4bd9-898b-b00a72a65f31 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Request method failure captured: Oct 17 13:42:16.802322 n-d-854247-14 devstack@n-api.service[127016]: request: DELETE /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872 HTTP/1.1 Oct 17 13:42:16.802322 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:42:16.802322 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:42:16.802322 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:42:16.802322 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:42:16.802322 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:42:16.802322 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:42:16.802322 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:42:16.802322 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:42:16.802322 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVpcWSwKjkgHu1pOrzJj6HiDQ9hS6xF0hnYpT-9MjemVLwNDzCl7w6ETLwt3fC-SanrMXYSA6kHfWUvQJu5a3Y3I946ESkVOejyjKOR-whNFZHQOyDE2dNW3q_jrKN41Sl71zQIcHHv_pCPQ5Cu97jE35pUEh3xL0sRiioyX-jyds1o Oct 17 13:42:16.802322 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:42:16.802322 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:42:16.802322 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:42:16.802322 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:42:16.802322 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:42:16.802322 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:42:16.802322 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 461c44cb99ff4958a128679d3e10cd6f Oct 17 13:42:16.802322 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ImagesTestJSON-1110552804 Oct 17 13:42:16.802322 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:42:16.802322 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:42:16.802322 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/461c44cb99ff4958a128679d3e10cd6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/461c44cb99ff4958a128679d3e10cd6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/461c44cb99ff4958a128679d3e10cd6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_461c44cb99ff4958a128679d3e10cd6f", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:42:16.802322 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ImagesTestJSON-1110552804 Oct 17 13:42:16.802322 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 461c44cb99ff4958a128679d3e10cd6f Oct 17 13:42:16.802322 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ImagesTestJSON-1110552804 Oct 17 13:42:16.802322 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ImagesTestJSON-1110552804-project Oct 17 13:42:16.802322 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:42:16.802322 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:42:16.802322 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 386397fd9194430b81ac465f9b3bf92d Oct 17 13:42:16.802322 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ImagesTestJSON-1110552804-project Oct 17 13:42:16.802322 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:42:16.802322 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance ae587603-994d-419d-979a-1b1361144872 could not be found. Oct 17 13:42:16.802322 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'ae587603-994d-419d-979a-1b1361144872'} Oct 17 13:42:16.802322 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:42:16.802322 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:16.802322 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:42:16.802322 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:42:16.802322 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:42:16.802322 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:42:16.802322 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:42:16.802322 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:42:16.802322 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:42:16.802322 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:42:16.802322 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae587603-994d-419d-979a-1b1361144872 could not be found. Oct 17 13:42:16.802322 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:16.802322 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:16.802322 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:16.802322 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:16.802322 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:16.802322 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:16.802322 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:42:16.802322 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:42:16.802322 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:42:16.802322 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:42:16.802322 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:42:16.802322 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:42:16.802322 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:42:16.802322 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:42:16.802322 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:42:16.802322 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:42:16.802322 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:42:16.802322 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:42:16.802322 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae587603-994d-419d-979a-1b1361144872 could not be found. Oct 17 13:42:16.805644 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:16.805644 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:16.805644 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:16.805644 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:16.805644 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:16.805644 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:16.805644 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:42:16.805644 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:42:16.805644 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae587603-994d-419d-979a-1b1361144872 could not be found. Oct 17 13:42:16.805644 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:16.807519 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-09ad7e1f-6a83-436b-94be-2831ced619e4 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:16.809111 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-09ad7e1f-6a83-436b-94be-2831ced619e4 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] [instance: bc9feeff-1ac7-4267-9351-3f1560dede9b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:16.811484 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1b017931-26a1-4bd9-898b-b00a72a65f31 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Returning 404 to user: Instance ae587603-994d-419d-979a-1b1361144872 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:42:16.816482 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1b017931-26a1-4bd9-898b-b00a72a65f31 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "DELETE /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872" status: 404 len: 111 microversion: 2.1 time: 0.147586 Oct 17 13:42:16.824757 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1083/2164] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:42:16 2022] DELETE /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872 => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:42:16.827286 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-09ad7e1f-6a83-436b-94be-2831ced619e4 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:16.835718 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-09ad7e1f-6a83-436b-94be-2831ced619e4 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:16.841354 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-09ad7e1f-6a83-436b-94be-2831ced619e4 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:16.842273 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-09ad7e1f-6a83-436b-94be-2831ced619e4 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:16.842946 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-09ad7e1f-6a83-436b-94be-2831ced619e4 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:16.843553 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-09ad7e1f-6a83-436b-94be-2831ced619e4 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:16.844869 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-49df9157-84d9-4b21-977d-ff8625a9b95b tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Calling method '.version_select at 0x7f7cd541a8b0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:16.884766 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-49df9157-84d9-4b21-977d-ff8625a9b95b tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:16.887553 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-49df9157-84d9-4b21-977d-ff8625a9b95b tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:16.891464 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-49df9157-84d9-4b21-977d-ff8625a9b95b tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:16.946402 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-49df9157-84d9-4b21-977d-ff8625a9b95b tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] 10.222.0.79 "GET /compute/v2.1/os-migrations" status: 200 len: 1532 microversion: 2.25 time: 0.114494 Oct 17 13:42:16.951680 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1084/2165] 10.222.0.79 () {60 vars in 1184 bytes} [Mon Oct 17 13:42:16 2022] GET /compute/v2.1/os-migrations => generated 1532 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:42:16.979822 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7955307a-f279-44f6-8ce3-fe89fb7ab944 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:16.983895 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7955307a-f279-44f6-8ce3-fe89fb7ab944 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: ae587603-994d-419d-979a-1b1361144872] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:17.013789 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7955307a-f279-44f6-8ce3-fe89fb7ab944 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:17.015140 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7955307a-f279-44f6-8ce3-fe89fb7ab944 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:17.016563 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7955307a-f279-44f6-8ce3-fe89fb7ab944 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:17.019108 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7955307a-f279-44f6-8ce3-fe89fb7ab944 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:17.026318 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7955307a-f279-44f6-8ce3-fe89fb7ab944 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:17.027061 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7955307a-f279-44f6-8ce3-fe89fb7ab944 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:17.075348 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-09ad7e1f-6a83-436b-94be-2831ced619e4 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185235bc4e3245fc8d92b7e4bff6cbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c0147c5fae4017810887843b0afaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:17.085581 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-09ad7e1f-6a83-436b-94be-2831ced619e4 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "GET /compute/v2.1/servers/bc9feeff-1ac7-4267-9351-3f1560dede9b" status: 200 len: 1273 microversion: 2.1 time: 0.296387 Oct 17 13:42:17.090248 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-7955307a-f279-44f6-8ce3-fe89fb7ab944 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] HTTP exception thrown: Instance ae587603-994d-419d-979a-1b1361144872 could not be found. Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7955307a-f279-44f6-8ce3-fe89fb7ab944 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Request method failure captured: Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872 HTTP/1.1 Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVpcWSwKjkgHu1pOrzJj6HiDQ9hS6xF0hnYpT-9MjemVLwNDzCl7w6ETLwt3fC-SanrMXYSA6kHfWUvQJu5a3Y3I946ESkVOejyjKOR-whNFZHQOyDE2dNW3q_jrKN41Sl71zQIcHHv_pCPQ5Cu97jE35pUEh3xL0sRiioyX-jyds1o Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 461c44cb99ff4958a128679d3e10cd6f Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ImagesTestJSON-1110552804 Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/461c44cb99ff4958a128679d3e10cd6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/461c44cb99ff4958a128679d3e10cd6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/461c44cb99ff4958a128679d3e10cd6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_461c44cb99ff4958a128679d3e10cd6f", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ImagesTestJSON-1110552804 Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 461c44cb99ff4958a128679d3e10cd6f Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ImagesTestJSON-1110552804 Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ImagesTestJSON-1110552804-project Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 386397fd9194430b81ac465f9b3bf92d Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ImagesTestJSON-1110552804-project Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance ae587603-994d-419d-979a-1b1361144872 could not be found. Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'ae587603-994d-419d-979a-1b1361144872'} Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae587603-994d-419d-979a-1b1361144872 could not be found. Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae587603-994d-419d-979a-1b1361144872 could not be found. Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:17.093177 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:17.096292 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:17.096292 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:17.096292 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:42:17.096292 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:42:17.096292 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae587603-994d-419d-979a-1b1361144872 could not be found. Oct 17 13:42:17.096292 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:17.098870 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7955307a-f279-44f6-8ce3-fe89fb7ab944 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Returning 404 to user: Instance ae587603-994d-419d-979a-1b1361144872 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:42:17.099520 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1082/2166] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:16 2022] GET /compute/v2.1/servers/bc9feeff-1ac7-4267-9351-3f1560dede9b => generated 1273 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:17.100169 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7955307a-f279-44f6-8ce3-fe89fb7ab944 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872" status: 404 len: 111 microversion: 2.1 time: 0.144139 Oct 17 13:42:17.101160 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1085/2167] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:16 2022] GET /compute/v2.1/servers/ae587603-994d-419d-979a-1b1361144872 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:42:17.120946 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f81c2ec0-3e34-4814-acfa-4af0fbd527e3 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:17.123510 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f81c2ec0-3e34-4814-acfa-4af0fbd527e3 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] [instance: 709d926d-fba5-49ea-84ac-95d8bb018c68] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:17.124901 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2487cc82-c820-47f6-9015-930cf0e3249b tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '.version_select at 0x7f7cd5071700>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:17.153667 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f81c2ec0-3e34-4814-acfa-4af0fbd527e3 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:17.155364 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-2487cc82-c820-47f6-9015-930cf0e3249b tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] HTTP exception thrown: Image not found. Oct 17 13:42:17.155501 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f81c2ec0-3e34-4814-acfa-4af0fbd527e3 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2487cc82-c820-47f6-9015-930cf0e3249b tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Request method failure captured: Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: request: DELETE /compute/v2.1/images/2a2d7b14-a31e-4918-9ecb-2788c4cc869d HTTP/1.1 Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVpcWSwKjkgHu1pOrzJj6HiDQ9hS6xF0hnYpT-9MjemVLwNDzCl7w6ETLwt3fC-SanrMXYSA6kHfWUvQJu5a3Y3I946ESkVOejyjKOR-whNFZHQOyDE2dNW3q_jrKN41Sl71zQIcHHv_pCPQ5Cu97jE35pUEh3xL0sRiioyX-jyds1o Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 461c44cb99ff4958a128679d3e10cd6f Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ImagesTestJSON-1110552804 Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/461c44cb99ff4958a128679d3e10cd6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/461c44cb99ff4958a128679d3e10cd6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/461c44cb99ff4958a128679d3e10cd6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_461c44cb99ff4958a128679d3e10cd6f", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ImagesTestJSON-1110552804 Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 461c44cb99ff4958a128679d3e10cd6f Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ImagesTestJSON-1110552804 Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ImagesTestJSON-1110552804-project Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 386397fd9194430b81ac465f9b3bf92d Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ImagesTestJSON-1110552804-project Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: method: Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: exception: Image not found. Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '2a2d7b14-a31e-4918-9ecb-2788c4cc869d'} Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 2a2d7b14-a31e-4918-9ecb-2788c4cc869d to delete Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2a2d7b14-a31e-4918-9ecb-2788c4cc869d could not be found. Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:17.157508 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:17.160883 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:17.160883 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:17.160883 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:42:17.160883 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:42:17.160883 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:42:17.160883 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:42:17.160883 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:42:17.160883 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:42:17.160883 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 17 13:42:17.160883 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 13:42:17.160883 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 13:42:17.160883 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:17.160883 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:17.160883 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:17.160883 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:17.160883 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:17.160883 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:17.160883 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:42:17.160883 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:42:17.160883 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 13:42:17.160883 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:17.161957 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f81c2ec0-3e34-4814-acfa-4af0fbd527e3 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:17.161957 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f81c2ec0-3e34-4814-acfa-4af0fbd527e3 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:17.164191 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f81c2ec0-3e34-4814-acfa-4af0fbd527e3 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:17.164999 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2487cc82-c820-47f6-9015-930cf0e3249b tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Returning 404 to user: Image not found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:42:17.165888 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f81c2ec0-3e34-4814-acfa-4af0fbd527e3 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:17.166479 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2487cc82-c820-47f6-9015-930cf0e3249b tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "DELETE /compute/v2.1/images/2a2d7b14-a31e-4918-9ecb-2788c4cc869d" status: 404 len: 62 microversion: 2.1 time: 0.051704 Oct 17 13:42:17.170832 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1086/2168] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:17 2022] DELETE /compute/v2.1/images/2a2d7b14-a31e-4918-9ecb-2788c4cc869d => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:42:17.177161 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-471b0a4f-3d4b-4749-b790-dc716f7b8a32 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:17.178939 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-471b0a4f-3d4b-4749-b790-dc716f7b8a32 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 9e72abb9-d4b5-4c67-8260-2828e3ab5ad2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:17.188916 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-471b0a4f-3d4b-4749-b790-dc716f7b8a32 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:17.190101 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-471b0a4f-3d4b-4749-b790-dc716f7b8a32 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:17.190999 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-471b0a4f-3d4b-4749-b790-dc716f7b8a32 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:17.192503 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-471b0a4f-3d4b-4749-b790-dc716f7b8a32 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:17.194597 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-471b0a4f-3d4b-4749-b790-dc716f7b8a32 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:17.195794 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-471b0a4f-3d4b-4749-b790-dc716f7b8a32 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:17.248638 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-471b0a4f-3d4b-4749-b790-dc716f7b8a32 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] HTTP exception thrown: Instance 9e72abb9-d4b5-4c67-8260-2828e3ab5ad2 could not be found. Oct 17 13:42:17.258978 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-471b0a4f-3d4b-4749-b790-dc716f7b8a32 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Request method failure captured: Oct 17 13:42:17.258978 n-d-854247-14 devstack@n-api.service[127016]: request: DELETE /compute/v2.1/servers/9e72abb9-d4b5-4c67-8260-2828e3ab5ad2 HTTP/1.1 Oct 17 13:42:17.258978 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:42:17.258978 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:42:17.258978 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:42:17.258978 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:42:17.258978 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:42:17.258978 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:42:17.258978 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:42:17.258978 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:42:17.258978 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVpcWSwKjkgHu1pOrzJj6HiDQ9hS6xF0hnYpT-9MjemVLwNDzCl7w6ETLwt3fC-SanrMXYSA6kHfWUvQJu5a3Y3I946ESkVOejyjKOR-whNFZHQOyDE2dNW3q_jrKN41Sl71zQIcHHv_pCPQ5Cu97jE35pUEh3xL0sRiioyX-jyds1o Oct 17 13:42:17.258978 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:42:17.258978 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:42:17.258978 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:42:17.258978 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:42:17.258978 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:42:17.258978 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:42:17.258978 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 461c44cb99ff4958a128679d3e10cd6f Oct 17 13:42:17.258978 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ImagesTestJSON-1110552804 Oct 17 13:42:17.258978 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:42:17.258978 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:42:17.258978 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/461c44cb99ff4958a128679d3e10cd6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/461c44cb99ff4958a128679d3e10cd6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/461c44cb99ff4958a128679d3e10cd6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_461c44cb99ff4958a128679d3e10cd6f", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:42:17.258978 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ImagesTestJSON-1110552804 Oct 17 13:42:17.258978 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 461c44cb99ff4958a128679d3e10cd6f Oct 17 13:42:17.258978 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ImagesTestJSON-1110552804 Oct 17 13:42:17.258978 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ImagesTestJSON-1110552804-project Oct 17 13:42:17.258978 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:42:17.258978 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:42:17.258978 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 386397fd9194430b81ac465f9b3bf92d Oct 17 13:42:17.258978 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ImagesTestJSON-1110552804-project Oct 17 13:42:17.258978 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:42:17.258978 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 9e72abb9-d4b5-4c67-8260-2828e3ab5ad2 could not be found. Oct 17 13:42:17.258978 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '9e72abb9-d4b5-4c67-8260-2828e3ab5ad2'} Oct 17 13:42:17.258978 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:42:17.258978 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:17.258978 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:42:17.258978 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:42:17.258978 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:42:17.258978 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:42:17.258978 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:42:17.258978 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:42:17.258978 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:42:17.258978 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:42:17.258978 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e72abb9-d4b5-4c67-8260-2828e3ab5ad2 could not be found. Oct 17 13:42:17.258978 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:17.258978 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:17.258978 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:17.258978 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:17.258978 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:17.258978 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:17.258978 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:42:17.258978 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:42:17.258978 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:42:17.258978 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:42:17.258978 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:42:17.258978 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:42:17.258978 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:42:17.258978 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:42:17.258978 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:42:17.258978 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:42:17.258978 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:42:17.258978 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:42:17.258978 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e72abb9-d4b5-4c67-8260-2828e3ab5ad2 could not be found. Oct 17 13:42:17.262656 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:17.262656 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:17.262656 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:17.262656 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:17.262656 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:17.262656 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:17.262656 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:42:17.262656 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:42:17.262656 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e72abb9-d4b5-4c67-8260-2828e3ab5ad2 could not be found. Oct 17 13:42:17.262656 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:17.262656 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-471b0a4f-3d4b-4749-b790-dc716f7b8a32 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Returning 404 to user: Instance 9e72abb9-d4b5-4c67-8260-2828e3ab5ad2 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:42:17.262656 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-471b0a4f-3d4b-4749-b790-dc716f7b8a32 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "DELETE /compute/v2.1/servers/9e72abb9-d4b5-4c67-8260-2828e3ab5ad2" status: 404 len: 111 microversion: 2.1 time: 0.088369 Oct 17 13:42:17.276561 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1087/2169] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:42:17 2022] DELETE /compute/v2.1/servers/9e72abb9-d4b5-4c67-8260-2828e3ab5ad2 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:42:17.302134 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-48496b4d-e1d1-4f54-b4fa-d07647630935 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:17.302767 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-48496b4d-e1d1-4f54-b4fa-d07647630935 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] [instance: 9e72abb9-d4b5-4c67-8260-2828e3ab5ad2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:17.334468 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48496b4d-e1d1-4f54-b4fa-d07647630935 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:17.335093 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48496b4d-e1d1-4f54-b4fa-d07647630935 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:17.336040 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48496b4d-e1d1-4f54-b4fa-d07647630935 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:17.336801 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48496b4d-e1d1-4f54-b4fa-d07647630935 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:17.337364 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48496b4d-e1d1-4f54-b4fa-d07647630935 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:17.337904 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48496b4d-e1d1-4f54-b4fa-d07647630935 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:17.373925 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-48496b4d-e1d1-4f54-b4fa-d07647630935 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] HTTP exception thrown: Instance 9e72abb9-d4b5-4c67-8260-2828e3ab5ad2 could not be found. Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-48496b4d-e1d1-4f54-b4fa-d07647630935 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Request method failure captured: Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/9e72abb9-d4b5-4c67-8260-2828e3ab5ad2 HTTP/1.1 Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVpcWSwKjkgHu1pOrzJj6HiDQ9hS6xF0hnYpT-9MjemVLwNDzCl7w6ETLwt3fC-SanrMXYSA6kHfWUvQJu5a3Y3I946ESkVOejyjKOR-whNFZHQOyDE2dNW3q_jrKN41Sl71zQIcHHv_pCPQ5Cu97jE35pUEh3xL0sRiioyX-jyds1o Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 461c44cb99ff4958a128679d3e10cd6f Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ImagesTestJSON-1110552804 Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/461c44cb99ff4958a128679d3e10cd6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/461c44cb99ff4958a128679d3e10cd6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/461c44cb99ff4958a128679d3e10cd6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_461c44cb99ff4958a128679d3e10cd6f", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ImagesTestJSON-1110552804 Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 461c44cb99ff4958a128679d3e10cd6f Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ImagesTestJSON-1110552804 Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ImagesTestJSON-1110552804-project Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 386397fd9194430b81ac465f9b3bf92d Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ImagesTestJSON-1110552804-project Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 9e72abb9-d4b5-4c67-8260-2828e3ab5ad2 could not be found. Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '9e72abb9-d4b5-4c67-8260-2828e3ab5ad2'} Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e72abb9-d4b5-4c67-8260-2828e3ab5ad2 could not be found. Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e72abb9-d4b5-4c67-8260-2828e3ab5ad2 could not be found. Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:17.376271 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:17.379694 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:17.379694 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:17.379694 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:42:17.379694 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:42:17.379694 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e72abb9-d4b5-4c67-8260-2828e3ab5ad2 could not be found. Oct 17 13:42:17.379694 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:17.381603 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-48496b4d-e1d1-4f54-b4fa-d07647630935 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] Returning 404 to user: Instance 9e72abb9-d4b5-4c67-8260-2828e3ab5ad2 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:42:17.384787 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-f81c2ec0-3e34-4814-acfa-4af0fbd527e3 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lazy-loading 'services' on Instance uuid 709d926d-fba5-49ea-84ac-95d8bb018c68 {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:42:17.386617 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-48496b4d-e1d1-4f54-b4fa-d07647630935 tempest-ImagesTestJSON-1110552804 tempest-ImagesTestJSON-1110552804-project] 10.222.0.79 "GET /compute/v2.1/servers/9e72abb9-d4b5-4c67-8260-2828e3ab5ad2" status: 404 len: 111 microversion: 2.1 time: 0.108487 Oct 17 13:42:17.387894 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1088/2170] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:17 2022] GET /compute/v2.1/servers/9e72abb9-d4b5-4c67-8260-2828e3ab5ad2 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:42:17.452576 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f81c2ec0-3e34-4814-acfa-4af0fbd527e3 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68" status: 200 len: 2423 microversion: 2.25 time: 0.349708 Oct 17 13:42:17.457564 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1083/2171] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:42:17 2022] GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68 => generated 2423 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:42:17.482010 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-af14b69e-3473-4613-94a9-a62dd1e23275 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:17.482403 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-af14b69e-3473-4613-94a9-a62dd1e23275 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] [instance: 709d926d-fba5-49ea-84ac-95d8bb018c68] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:17.494504 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af14b69e-3473-4613-94a9-a62dd1e23275 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:17.495065 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af14b69e-3473-4613-94a9-a62dd1e23275 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:17.500643 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af14b69e-3473-4613-94a9-a62dd1e23275 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:17.501440 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af14b69e-3473-4613-94a9-a62dd1e23275 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:17.501917 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af14b69e-3473-4613-94a9-a62dd1e23275 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:17.502349 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af14b69e-3473-4613-94a9-a62dd1e23275 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:17.820417 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e2792939-b174-4537-9db4-8832467b6740 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:17.821085 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e2792939-b174-4537-9db4-8832467b6740 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9044674d-a793-46c2-b3ec-e9377b30f253] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:17.836449 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e2792939-b174-4537-9db4-8832467b6740 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:17.836941 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e2792939-b174-4537-9db4-8832467b6740 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:17.837373 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e2792939-b174-4537-9db4-8832467b6740 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:17.838086 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e2792939-b174-4537-9db4-8832467b6740 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:17.838531 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e2792939-b174-4537-9db4-8832467b6740 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:17.839001 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e2792939-b174-4537-9db4-8832467b6740 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:18.207124 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e2792939-b174-4537-9db4-8832467b6740 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:18.219980 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e2792939-b174-4537-9db4-8832467b6740 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253" status: 200 len: 1517 microversion: 2.1 time: 0.408028 Oct 17 13:42:18.221094 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1084/2172] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:17 2022] GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253 => generated 1517 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:18.232140 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8c5459cf-5017-4423-ad59-3105132a4d00 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:18.238803 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8c5459cf-5017-4423-ad59-3105132a4d00 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] [instance: bc9feeff-1ac7-4267-9351-3f1560dede9b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:18.246484 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8c5459cf-5017-4423-ad59-3105132a4d00 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:18.247314 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8c5459cf-5017-4423-ad59-3105132a4d00 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:18.247958 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8c5459cf-5017-4423-ad59-3105132a4d00 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:18.249107 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8c5459cf-5017-4423-ad59-3105132a4d00 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:18.249788 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8c5459cf-5017-4423-ad59-3105132a4d00 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:18.250440 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8c5459cf-5017-4423-ad59-3105132a4d00 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:18.289191 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-af14b69e-3473-4613-94a9-a62dd1e23275 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lazy-loading 'services' on Instance uuid 709d926d-fba5-49ea-84ac-95d8bb018c68 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:42:18.318856 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-af14b69e-3473-4613-94a9-a62dd1e23275 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68" status: 200 len: 2423 microversion: 2.25 time: 0.840988 Oct 17 13:42:18.326237 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1089/2173] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:42:17 2022] GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68 => generated 2423 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:42:18.423651 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8c5459cf-5017-4423-ad59-3105132a4d00 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185235bc4e3245fc8d92b7e4bff6cbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c0147c5fae4017810887843b0afaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:18.434910 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8c5459cf-5017-4423-ad59-3105132a4d00 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "GET /compute/v2.1/servers/bc9feeff-1ac7-4267-9351-3f1560dede9b" status: 200 len: 1273 microversion: 2.1 time: 0.210993 Oct 17 13:42:18.435888 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1085/2174] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:18 2022] GET /compute/v2.1/servers/bc9feeff-1ac7-4267-9351-3f1560dede9b => generated 1273 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:18.470720 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-488fd4c2-6fde-4c23-bf52-4dce4095c60a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:18.471263 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-488fd4c2-6fde-4c23-bf52-4dce4095c60a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 709d926d-fba5-49ea-84ac-95d8bb018c68] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:18.477773 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-488fd4c2-6fde-4c23-bf52-4dce4095c60a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:18.477952 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-488fd4c2-6fde-4c23-bf52-4dce4095c60a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:18.478349 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-488fd4c2-6fde-4c23-bf52-4dce4095c60a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:18.479065 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-488fd4c2-6fde-4c23-bf52-4dce4095c60a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:18.479953 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-488fd4c2-6fde-4c23-bf52-4dce4095c60a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:18.480114 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-488fd4c2-6fde-4c23-bf52-4dce4095c60a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:18.688502 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-488fd4c2-6fde-4c23-bf52-4dce4095c60a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lazy-loading 'services' on Instance uuid 709d926d-fba5-49ea-84ac-95d8bb018c68 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:42:18.751040 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=100 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:42:18.881551 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-488fd4c2-6fde-4c23-bf52-4dce4095c60a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "DELETE /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68/os-volume_attachments/309eff69-6899-4ab1-96da-b108f5e4f3a6" status: 202 len: 0 microversion: 2.25 time: 0.420277 Oct 17 13:42:18.886240 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1090/2175] 10.222.0.79 () {60 vars in 1457 bytes} [Mon Oct 17 13:42:18 2022] DELETE /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68/os-volume_attachments/309eff69-6899-4ab1-96da-b108f5e4f3a6 => generated 0 bytes in 426 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:42:18.897190 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-10c0e34a-432f-434f-a4cc-1cace10c4069 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:18.900096 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-10c0e34a-432f-434f-a4cc-1cace10c4069 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 709d926d-fba5-49ea-84ac-95d8bb018c68] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:18.907771 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-10c0e34a-432f-434f-a4cc-1cace10c4069 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:18.913676 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-10c0e34a-432f-434f-a4cc-1cace10c4069 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:18.916505 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-10c0e34a-432f-434f-a4cc-1cace10c4069 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:18.917472 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-10c0e34a-432f-434f-a4cc-1cace10c4069 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:18.919282 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-10c0e34a-432f-434f-a4cc-1cace10c4069 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:18.920843 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-10c0e34a-432f-434f-a4cc-1cace10c4069 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:18.964637 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:42:18.972160 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-10c0e34a-432f-434f-a4cc-1cace10c4069 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.081632 Oct 17 13:42:18.977848 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1086/2176] 10.222.0.79 () {60 vars in 1343 bytes} [Mon Oct 17 13:42:18 2022] GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:42:19.252877 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b39f3bd6-cbfb-473b-a26e-ae240dec2c08 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:19.253988 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b39f3bd6-cbfb-473b-a26e-ae240dec2c08 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9044674d-a793-46c2-b3ec-e9377b30f253] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:19.307958 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b39f3bd6-cbfb-473b-a26e-ae240dec2c08 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:19.309345 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b39f3bd6-cbfb-473b-a26e-ae240dec2c08 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:19.312711 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b39f3bd6-cbfb-473b-a26e-ae240dec2c08 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:19.317640 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b39f3bd6-cbfb-473b-a26e-ae240dec2c08 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:19.318490 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b39f3bd6-cbfb-473b-a26e-ae240dec2c08 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:19.326705 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b39f3bd6-cbfb-473b-a26e-ae240dec2c08 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:19.462690 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-87de9042-5591-4a08-9595-2f1a1f79ee3c tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:19.463451 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-87de9042-5591-4a08-9595-2f1a1f79ee3c tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] [instance: bc9feeff-1ac7-4267-9351-3f1560dede9b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:19.470348 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-87de9042-5591-4a08-9595-2f1a1f79ee3c tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:19.481154 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-87de9042-5591-4a08-9595-2f1a1f79ee3c tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:19.482320 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-87de9042-5591-4a08-9595-2f1a1f79ee3c tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:19.483844 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-87de9042-5591-4a08-9595-2f1a1f79ee3c tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:19.484925 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-87de9042-5591-4a08-9595-2f1a1f79ee3c tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:19.485973 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-87de9042-5591-4a08-9595-2f1a1f79ee3c tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:19.772078 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b39f3bd6-cbfb-473b-a26e-ae240dec2c08 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:19.809403 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b39f3bd6-cbfb-473b-a26e-ae240dec2c08 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253" status: 200 len: 1517 microversion: 2.1 time: 0.562436 Oct 17 13:42:19.875363 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1091/2177] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:19 2022] GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253 => generated 1517 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:19.992723 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-bb4df183-6cb4-4b9f-a729-b477dfc20693 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:19.995706 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-bb4df183-6cb4-4b9f-a729-b477dfc20693 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 709d926d-fba5-49ea-84ac-95d8bb018c68] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:20.014932 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bb4df183-6cb4-4b9f-a729-b477dfc20693 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:20.015079 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-87de9042-5591-4a08-9595-2f1a1f79ee3c tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185235bc4e3245fc8d92b7e4bff6cbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c0147c5fae4017810887843b0afaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:20.015729 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bb4df183-6cb4-4b9f-a729-b477dfc20693 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:20.018317 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bb4df183-6cb4-4b9f-a729-b477dfc20693 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:20.018462 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bb4df183-6cb4-4b9f-a729-b477dfc20693 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:20.028355 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bb4df183-6cb4-4b9f-a729-b477dfc20693 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:20.036815 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-87de9042-5591-4a08-9595-2f1a1f79ee3c tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "GET /compute/v2.1/servers/bc9feeff-1ac7-4267-9351-3f1560dede9b" status: 200 len: 1273 microversion: 2.1 time: 0.579588 Oct 17 13:42:20.037033 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bb4df183-6cb4-4b9f-a729-b477dfc20693 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:20.049363 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1087/2178] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:19 2022] GET /compute/v2.1/servers/bc9feeff-1ac7-4267-9351-3f1560dede9b => generated 1273 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:20.190445 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-bb4df183-6cb4-4b9f-a729-b477dfc20693 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.207721 Oct 17 13:42:20.199801 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1092/2179] 10.222.0.79 () {60 vars in 1343 bytes} [Mon Oct 17 13:42:19 2022] GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68/os-volume_attachments => generated 197 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:42:20.860272 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1a0c6f28-94ea-4e78-99d3-1445fd6cbd32 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:20.860984 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1a0c6f28-94ea-4e78-99d3-1445fd6cbd32 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9044674d-a793-46c2-b3ec-e9377b30f253] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:20.875113 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1a0c6f28-94ea-4e78-99d3-1445fd6cbd32 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:20.876010 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1a0c6f28-94ea-4e78-99d3-1445fd6cbd32 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:20.876645 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1a0c6f28-94ea-4e78-99d3-1445fd6cbd32 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:20.877592 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1a0c6f28-94ea-4e78-99d3-1445fd6cbd32 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:20.878271 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1a0c6f28-94ea-4e78-99d3-1445fd6cbd32 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:20.882899 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1a0c6f28-94ea-4e78-99d3-1445fd6cbd32 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:21.065341 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-57446c43-6012-4a6d-a90b-7e9832636e99 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:21.066264 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-57446c43-6012-4a6d-a90b-7e9832636e99 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] [instance: bc9feeff-1ac7-4267-9351-3f1560dede9b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:21.102311 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-57446c43-6012-4a6d-a90b-7e9832636e99 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:21.106023 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-57446c43-6012-4a6d-a90b-7e9832636e99 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:21.107356 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-57446c43-6012-4a6d-a90b-7e9832636e99 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:21.110397 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-57446c43-6012-4a6d-a90b-7e9832636e99 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:21.116094 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-57446c43-6012-4a6d-a90b-7e9832636e99 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:21.117904 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-57446c43-6012-4a6d-a90b-7e9832636e99 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:22.477043 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1a0c6f28-94ea-4e78-99d3-1445fd6cbd32 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:22.498058 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1a0c6f28-94ea-4e78-99d3-1445fd6cbd32 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253" status: 200 len: 1523 microversion: 2.1 time: 1.637757 Oct 17 13:42:22.499237 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1088/2180] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:20 2022] GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253 => generated 1523 bytes in 1644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:22.510410 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e0d1c454-530c-4e56-bdc4-0e548613f3cc tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:22.515744 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e0d1c454-530c-4e56-bdc4-0e548613f3cc tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 709d926d-fba5-49ea-84ac-95d8bb018c68] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:22.535901 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e0d1c454-530c-4e56-bdc4-0e548613f3cc tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:22.539066 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e0d1c454-530c-4e56-bdc4-0e548613f3cc tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:22.540256 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e0d1c454-530c-4e56-bdc4-0e548613f3cc tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:22.541243 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e0d1c454-530c-4e56-bdc4-0e548613f3cc tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:22.541957 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e0d1c454-530c-4e56-bdc4-0e548613f3cc tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:22.544769 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e0d1c454-530c-4e56-bdc4-0e548613f3cc tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:22.627774 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e0d1c454-530c-4e56-bdc4-0e548613f3cc tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.127187 Oct 17 13:42:22.629596 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1089/2181] 10.222.0.79 () {60 vars in 1343 bytes} [Mon Oct 17 13:42:22 2022] GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:42:22.941892 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9634490b-c208-48e7-a740-bfcdcfa15294 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1263361679", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "822fcd8e-a222-4649-abf1-075f8743bc3b"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:42:23.053648 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-9634490b-c208-48e7-a740-bfcdcfa15294 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] validate_networks() for [('822fcd8e-a222-4649-abf1-075f8743bc3b', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:42:23.235542 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:42:23.306269 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=6 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:42:23.361716 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-57446c43-6012-4a6d-a90b-7e9832636e99 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185235bc4e3245fc8d92b7e4bff6cbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c0147c5fae4017810887843b0afaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:23.375355 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-57446c43-6012-4a6d-a90b-7e9832636e99 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "GET /compute/v2.1/servers/bc9feeff-1ac7-4267-9351-3f1560dede9b" status: 200 len: 1315 microversion: 2.1 time: 2.314741 Oct 17 13:42:23.382170 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1093/2182] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:21 2022] GET /compute/v2.1/servers/bc9feeff-1ac7-4267-9351-3f1560dede9b => generated 1315 bytes in 2322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:23.388960 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-8e6b1b21-6365-4d70-ae3b-ac293bcaf317 req-ef2ef98a-f8c4-44d8-9f83-ec693b106a72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc9feeff-1ac7-4267-9351-3f1560dede9b", "tag": "821390e6-5b5f-4941-b743-c5c5ff8b7d80"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:42:23.423039 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-8e6b1b21-6365-4d70-ae3b-ac293bcaf317 req-ef2ef98a-f8c4-44d8-9f83-ec693b106a72 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:23.424210 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-8e6b1b21-6365-4d70-ae3b-ac293bcaf317 req-ef2ef98a-f8c4-44d8-9f83-ec693b106a72 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:23.424920 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-8e6b1b21-6365-4d70-ae3b-ac293bcaf317 req-ef2ef98a-f8c4-44d8-9f83-ec693b106a72 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:23.446349 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-8e6b1b21-6365-4d70-ae3b-ac293bcaf317 req-ef2ef98a-f8c4-44d8-9f83-ec693b106a72 service nova] Creating event network-changed:821390e6-5b5f-4941-b743-c5c5ff8b7d80 for instance bc9feeff-1ac7-4267-9351-3f1560dede9b on n-h1-854247-14 Oct 17 13:42:23.458030 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-8e6b1b21-6365-4d70-ae3b-ac293bcaf317 req-ef2ef98a-f8c4-44d8-9f83-ec693b106a72 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072773 Oct 17 13:42:23.461532 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1094/2183] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:42:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:42:23.522780 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-17db392b-2064-463b-aadb-6bb8fccbe15b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:23.523918 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-17db392b-2064-463b-aadb-6bb8fccbe15b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9044674d-a793-46c2-b3ec-e9377b30f253] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:23.534876 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-17db392b-2064-463b-aadb-6bb8fccbe15b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:23.536902 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-17db392b-2064-463b-aadb-6bb8fccbe15b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:23.539505 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-17db392b-2064-463b-aadb-6bb8fccbe15b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:23.543844 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-17db392b-2064-463b-aadb-6bb8fccbe15b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:23.546859 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-17db392b-2064-463b-aadb-6bb8fccbe15b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:23.548452 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-17db392b-2064-463b-aadb-6bb8fccbe15b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:24.637631 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-17db392b-2064-463b-aadb-6bb8fccbe15b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:24.648185 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-17db392b-2064-463b-aadb-6bb8fccbe15b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253" status: 200 len: 1523 microversion: 2.1 time: 1.129949 Oct 17 13:42:24.672670 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1095/2184] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:23 2022] GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253 => generated 1523 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:42:24.679865 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-0c188ea2-7394-4831-b1ff-a6aa4b1d6c63 req-6154d25d-57d5-4180-b593-4c446fb9b6fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9044674d-a793-46c2-b3ec-e9377b30f253", "name": "network-vif-unplugged", "status": "completed", "tag": "b76e3be7-554d-4b8d-924c-9c699342cdd0"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:42:24.703978 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-0c188ea2-7394-4831-b1ff-a6aa4b1d6c63 req-6154d25d-57d5-4180-b593-4c446fb9b6fd service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:24.704855 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-0c188ea2-7394-4831-b1ff-a6aa4b1d6c63 req-6154d25d-57d5-4180-b593-4c446fb9b6fd service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:24.705429 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-0c188ea2-7394-4831-b1ff-a6aa4b1d6c63 req-6154d25d-57d5-4180-b593-4c446fb9b6fd service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:24.753039 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-0c188ea2-7394-4831-b1ff-a6aa4b1d6c63 req-6154d25d-57d5-4180-b593-4c446fb9b6fd service nova] Creating event network-vif-unplugged:b76e3be7-554d-4b8d-924c-9c699342cdd0 for instance 9044674d-a793-46c2-b3ec-e9377b30f253 on n-h2-854247-14 Oct 17 13:42:24.761125 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-0c188ea2-7394-4831-b1ff-a6aa4b1d6c63 req-6154d25d-57d5-4180-b593-4c446fb9b6fd service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086313 Oct 17 13:42:24.762361 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1096/2185] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:42:24.769101 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d2e8d942-15b7-4033-905d-c3b59702a63d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:24.771901 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d2e8d942-15b7-4033-905d-c3b59702a63d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 709d926d-fba5-49ea-84ac-95d8bb018c68] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:24.797915 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d2e8d942-15b7-4033-905d-c3b59702a63d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:24.798603 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d2e8d942-15b7-4033-905d-c3b59702a63d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:24.799377 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d2e8d942-15b7-4033-905d-c3b59702a63d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:24.800439 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d2e8d942-15b7-4033-905d-c3b59702a63d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:24.801216 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d2e8d942-15b7-4033-905d-c3b59702a63d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:24.801776 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d2e8d942-15b7-4033-905d-c3b59702a63d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:24.888971 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d2e8d942-15b7-4033-905d-c3b59702a63d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.125213 Oct 17 13:42:24.892860 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1097/2186] 10.222.0.79 () {60 vars in 1343 bytes} [Mon Oct 17 13:42:24 2022] GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:42:24.899886 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ee1e6b1b-577d-4eca-8ad8-ce19a0872fc3 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:24.909729 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ee1e6b1b-577d-4eca-8ad8-ce19a0872fc3 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] [instance: bc9feeff-1ac7-4267-9351-3f1560dede9b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:24.931970 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ee1e6b1b-577d-4eca-8ad8-ce19a0872fc3 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:24.934380 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ee1e6b1b-577d-4eca-8ad8-ce19a0872fc3 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:24.935006 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ee1e6b1b-577d-4eca-8ad8-ce19a0872fc3 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:24.938006 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ee1e6b1b-577d-4eca-8ad8-ce19a0872fc3 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:24.938649 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ee1e6b1b-577d-4eca-8ad8-ce19a0872fc3 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:24.939548 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ee1e6b1b-577d-4eca-8ad8-ce19a0872fc3 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:25.777303 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-9634490b-c208-48e7-a740-bfcdcfa15294 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:42:25.778408 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-9634490b-c208-48e7-a740-bfcdcfa15294 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:42:25.785805 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-9634490b-c208-48e7-a740-bfcdcfa15294 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:42:25.786557 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-9634490b-c208-48e7-a740-bfcdcfa15294 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:42:25.787317 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-9634490b-c208-48e7-a740-bfcdcfa15294 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:42:25.807735 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9634490b-c208-48e7-a740-bfcdcfa15294 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:25.812616 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ee1e6b1b-577d-4eca-8ad8-ce19a0872fc3 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185235bc4e3245fc8d92b7e4bff6cbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c0147c5fae4017810887843b0afaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:25.817915 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9634490b-c208-48e7-a740-bfcdcfa15294 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:25.825639 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9634490b-c208-48e7-a740-bfcdcfa15294 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:25.826364 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ee1e6b1b-577d-4eca-8ad8-ce19a0872fc3 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "GET /compute/v2.1/servers/bc9feeff-1ac7-4267-9351-3f1560dede9b" status: 200 len: 1315 microversion: 2.1 time: 0.929623 Oct 17 13:42:25.828645 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9634490b-c208-48e7-a740-bfcdcfa15294 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:25.828784 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1098/2187] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:24 2022] GET /compute/v2.1/servers/bc9feeff-1ac7-4267-9351-3f1560dede9b => generated 1315 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:25.835880 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9634490b-c208-48e7-a740-bfcdcfa15294 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:25.837634 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9634490b-c208-48e7-a740-bfcdcfa15294 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:25.838367 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3fbcf08d-776b-40f7-ba24-bd3b683baae3 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:25.839209 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3fbcf08d-776b-40f7-ba24-bd3b683baae3 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9044674d-a793-46c2-b3ec-e9377b30f253] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:25.859397 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3fbcf08d-776b-40f7-ba24-bd3b683baae3 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:25.860013 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3fbcf08d-776b-40f7-ba24-bd3b683baae3 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:25.863364 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3fbcf08d-776b-40f7-ba24-bd3b683baae3 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:25.864154 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3fbcf08d-776b-40f7-ba24-bd3b683baae3 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:25.864628 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3fbcf08d-776b-40f7-ba24-bd3b683baae3 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:25.867286 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3fbcf08d-776b-40f7-ba24-bd3b683baae3 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:25.927465 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-9634490b-c208-48e7-a740-bfcdcfa15294 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Getting quotas for project 20e047e6275b42d6b6d5776ea2121b03. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:42:25.942344 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-9634490b-c208-48e7-a740-bfcdcfa15294 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Getting quotas for user cb0410e9acbf42ff9f51b096b98d4975 and project 20e047e6275b42d6b6d5776ea2121b03. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:42:25.982942 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9634490b-c208-48e7-a740-bfcdcfa15294 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:42:26.008611 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9634490b-c208-48e7-a740-bfcdcfa15294 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] [instance: 6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:42:26.156088 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9634490b-c208-48e7-a740-bfcdcfa15294 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.525135 Oct 17 13:42:26.156979 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1090/2188] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:42:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 3527 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:42:26.162035 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5dd3c720-ee4c-414b-a766-342326c1cdb7 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:26.183323 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5dd3c720-ee4c-414b-a766-342326c1cdb7 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 709d926d-fba5-49ea-84ac-95d8bb018c68] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:26.206611 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5dd3c720-ee4c-414b-a766-342326c1cdb7 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:26.208863 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5dd3c720-ee4c-414b-a766-342326c1cdb7 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:26.209503 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5dd3c720-ee4c-414b-a766-342326c1cdb7 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:26.213229 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5dd3c720-ee4c-414b-a766-342326c1cdb7 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:26.213954 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5dd3c720-ee4c-414b-a766-342326c1cdb7 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:26.214627 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5dd3c720-ee4c-414b-a766-342326c1cdb7 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:26.307393 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5dd3c720-ee4c-414b-a766-342326c1cdb7 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.149133 Oct 17 13:42:26.323502 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1091/2189] 10.222.0.79 () {60 vars in 1343 bytes} [Mon Oct 17 13:42:26 2022] GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:42:26.333231 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-fdaf7eb8-7d5a-4b67-8f6f-d2b4f6f6e375 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:26.334062 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-fdaf7eb8-7d5a-4b67-8f6f-d2b4f6f6e375 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] [instance: 6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:26.603764 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-fdaf7eb8-7d5a-4b67-8f6f-d2b4f6f6e375 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0410e9acbf42ff9f51b096b98d4975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e047e6275b42d6b6d5776ea2121b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:26.611488 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-fdaf7eb8-7d5a-4b67-8f6f-d2b4f6f6e375 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] 10.222.0.79 "GET /compute/v2.1/servers/6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37" status: 200 len: 1216 microversion: 2.1 time: 0.286523 Oct 17 13:42:26.615736 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1092/2190] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:26 2022] GET /compute/v2.1/servers/6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37 => generated 1216 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:26.628042 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3fbcf08d-776b-40f7-ba24-bd3b683baae3 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:26.638989 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3fbcf08d-776b-40f7-ba24-bd3b683baae3 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253" status: 200 len: 1523 microversion: 2.1 time: 0.807636 Oct 17 13:42:26.651919 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1099/2191] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:25 2022] GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253 => generated 1523 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:26.853675 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e282ae69-7b34-4fd2-ac75-c426a1ec1e54 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:26.854215 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e282ae69-7b34-4fd2-ac75-c426a1ec1e54 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] [instance: bc9feeff-1ac7-4267-9351-3f1560dede9b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:26.861868 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e282ae69-7b34-4fd2-ac75-c426a1ec1e54 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:26.862363 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e282ae69-7b34-4fd2-ac75-c426a1ec1e54 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:26.862798 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e282ae69-7b34-4fd2-ac75-c426a1ec1e54 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:26.863540 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e282ae69-7b34-4fd2-ac75-c426a1ec1e54 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:26.863988 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e282ae69-7b34-4fd2-ac75-c426a1ec1e54 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:26.866506 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e282ae69-7b34-4fd2-ac75-c426a1ec1e54 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:27.277033 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e282ae69-7b34-4fd2-ac75-c426a1ec1e54 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185235bc4e3245fc8d92b7e4bff6cbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c0147c5fae4017810887843b0afaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:27.292284 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e282ae69-7b34-4fd2-ac75-c426a1ec1e54 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "GET /compute/v2.1/servers/bc9feeff-1ac7-4267-9351-3f1560dede9b" status: 200 len: 1315 microversion: 2.1 time: 0.442543 Oct 17 13:42:27.295488 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1093/2192] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:26 2022] GET /compute/v2.1/servers/bc9feeff-1ac7-4267-9351-3f1560dede9b => generated 1315 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:27.326351 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-17aeb7f9-0eee-45f7-9ee8-6c386e88255c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:27.338550 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-17aeb7f9-0eee-45f7-9ee8-6c386e88255c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 709d926d-fba5-49ea-84ac-95d8bb018c68] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:27.379652 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-17aeb7f9-0eee-45f7-9ee8-6c386e88255c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:27.380256 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-17aeb7f9-0eee-45f7-9ee8-6c386e88255c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:27.380700 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-17aeb7f9-0eee-45f7-9ee8-6c386e88255c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:27.386610 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-17aeb7f9-0eee-45f7-9ee8-6c386e88255c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:27.388847 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-17aeb7f9-0eee-45f7-9ee8-6c386e88255c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:27.391422 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-17aeb7f9-0eee-45f7-9ee8-6c386e88255c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:27.442847 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-17aeb7f9-0eee-45f7-9ee8-6c386e88255c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.120254 Oct 17 13:42:27.444552 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1100/2193] 10.222.0.79 () {60 vars in 1343 bytes} [Mon Oct 17 13:42:27 2022] GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:42:27.642183 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6500b73b-7419-40b8-a9a0-af548470a3ae tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:27.643251 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6500b73b-7419-40b8-a9a0-af548470a3ae tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] [instance: 6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:27.659439 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6500b73b-7419-40b8-a9a0-af548470a3ae tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:27.663578 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6500b73b-7419-40b8-a9a0-af548470a3ae tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:27.664164 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6500b73b-7419-40b8-a9a0-af548470a3ae tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:27.665305 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8bc44cff-4c1d-4289-af50-754be0257cc7 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:27.666114 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8bc44cff-4c1d-4289-af50-754be0257cc7 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9044674d-a793-46c2-b3ec-e9377b30f253] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:27.666598 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6500b73b-7419-40b8-a9a0-af548470a3ae tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:27.667945 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6500b73b-7419-40b8-a9a0-af548470a3ae tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:27.671851 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6500b73b-7419-40b8-a9a0-af548470a3ae tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:27.700571 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8bc44cff-4c1d-4289-af50-754be0257cc7 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:27.701058 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8bc44cff-4c1d-4289-af50-754be0257cc7 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:27.717728 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8bc44cff-4c1d-4289-af50-754be0257cc7 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:27.723957 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8bc44cff-4c1d-4289-af50-754be0257cc7 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:27.727884 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8bc44cff-4c1d-4289-af50-754be0257cc7 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:27.731668 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8bc44cff-4c1d-4289-af50-754be0257cc7 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:27.960120 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6500b73b-7419-40b8-a9a0-af548470a3ae tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0410e9acbf42ff9f51b096b98d4975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e047e6275b42d6b6d5776ea2121b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:27.970728 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6500b73b-7419-40b8-a9a0-af548470a3ae tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] 10.222.0.79 "GET /compute/v2.1/servers/6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37" status: 200 len: 1268 microversion: 2.1 time: 0.330767 Oct 17 13:42:27.971545 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1094/2194] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:27 2022] GET /compute/v2.1/servers/6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37 => generated 1268 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:28.283863 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8bc44cff-4c1d-4289-af50-754be0257cc7 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:28.298321 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8bc44cff-4c1d-4289-af50-754be0257cc7 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253" status: 200 len: 1523 microversion: 2.1 time: 0.636222 Oct 17 13:42:28.313934 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1101/2195] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:27 2022] GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253 => generated 1523 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:42:28.326445 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1992ab39-467a-4ca2-aec6-2acf219ab600 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:28.329216 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1992ab39-467a-4ca2-aec6-2acf219ab600 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] [instance: bc9feeff-1ac7-4267-9351-3f1560dede9b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:28.339961 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1992ab39-467a-4ca2-aec6-2acf219ab600 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:28.357549 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1992ab39-467a-4ca2-aec6-2acf219ab600 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:28.361812 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1992ab39-467a-4ca2-aec6-2acf219ab600 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:28.365993 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1992ab39-467a-4ca2-aec6-2acf219ab600 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:28.366935 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1992ab39-467a-4ca2-aec6-2acf219ab600 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:28.369646 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1992ab39-467a-4ca2-aec6-2acf219ab600 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:28.456183 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7e638ee1-6519-46fa-a284-55f231461a2d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:28.459019 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7e638ee1-6519-46fa-a284-55f231461a2d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 709d926d-fba5-49ea-84ac-95d8bb018c68] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:28.476334 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7e638ee1-6519-46fa-a284-55f231461a2d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:28.481747 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7e638ee1-6519-46fa-a284-55f231461a2d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:28.487695 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7e638ee1-6519-46fa-a284-55f231461a2d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:28.493511 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7e638ee1-6519-46fa-a284-55f231461a2d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:28.494791 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7e638ee1-6519-46fa-a284-55f231461a2d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:28.498121 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7e638ee1-6519-46fa-a284-55f231461a2d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:28.608613 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7e638ee1-6519-46fa-a284-55f231461a2d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.153938 Oct 17 13:42:28.611343 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1102/2196] 10.222.0.79 () {60 vars in 1343 bytes} [Mon Oct 17 13:42:28 2022] GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 13:42:28.999678 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-eb839af6-da0e-4829-8fc2-534c362e8540 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:29.000731 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-eb839af6-da0e-4829-8fc2-534c362e8540 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] [instance: 6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:29.028845 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eb839af6-da0e-4829-8fc2-534c362e8540 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:29.031015 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eb839af6-da0e-4829-8fc2-534c362e8540 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:29.032922 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eb839af6-da0e-4829-8fc2-534c362e8540 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:29.035260 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eb839af6-da0e-4829-8fc2-534c362e8540 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:29.038930 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eb839af6-da0e-4829-8fc2-534c362e8540 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:29.039843 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eb839af6-da0e-4829-8fc2-534c362e8540 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:29.217363 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1992ab39-467a-4ca2-aec6-2acf219ab600 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185235bc4e3245fc8d92b7e4bff6cbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c0147c5fae4017810887843b0afaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:29.238954 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1992ab39-467a-4ca2-aec6-2acf219ab600 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "GET /compute/v2.1/servers/bc9feeff-1ac7-4267-9351-3f1560dede9b" status: 200 len: 1315 microversion: 2.1 time: 0.916403 Oct 17 13:42:29.243437 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1095/2197] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:28 2022] GET /compute/v2.1/servers/bc9feeff-1ac7-4267-9351-3f1560dede9b => generated 1315 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:29.276445 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-eb839af6-da0e-4829-8fc2-534c362e8540 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0410e9acbf42ff9f51b096b98d4975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e047e6275b42d6b6d5776ea2121b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:29.297084 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-eb839af6-da0e-4829-8fc2-534c362e8540 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] 10.222.0.79 "GET /compute/v2.1/servers/6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37" status: 200 len: 1274 microversion: 2.1 time: 0.299106 Oct 17 13:42:29.317648 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1103/2198] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:28 2022] GET /compute/v2.1/servers/6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37 => generated 1274 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:42:29.322305 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-407d0329-af2d-49da-b294-6fb0368c071e tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:29.323057 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-407d0329-af2d-49da-b294-6fb0368c071e tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9044674d-a793-46c2-b3ec-e9377b30f253] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:29.343509 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-407d0329-af2d-49da-b294-6fb0368c071e tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:29.344023 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-407d0329-af2d-49da-b294-6fb0368c071e tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:29.344465 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-407d0329-af2d-49da-b294-6fb0368c071e tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:29.356343 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-407d0329-af2d-49da-b294-6fb0368c071e tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:29.356850 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-407d0329-af2d-49da-b294-6fb0368c071e tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:29.357301 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-407d0329-af2d-49da-b294-6fb0368c071e tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:29.626129 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7815193d-7c27-4897-853d-85785b91f5c3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:29.629385 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7815193d-7c27-4897-853d-85785b91f5c3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 709d926d-fba5-49ea-84ac-95d8bb018c68] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:29.651993 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7815193d-7c27-4897-853d-85785b91f5c3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:29.652909 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7815193d-7c27-4897-853d-85785b91f5c3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:29.653556 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7815193d-7c27-4897-853d-85785b91f5c3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:29.654482 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7815193d-7c27-4897-853d-85785b91f5c3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:29.655964 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7815193d-7c27-4897-853d-85785b91f5c3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:29.657651 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7815193d-7c27-4897-853d-85785b91f5c3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:29.770787 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7815193d-7c27-4897-853d-85785b91f5c3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.151136 Oct 17 13:42:29.771417 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1104/2199] 10.222.0.79 () {60 vars in 1343 bytes} [Mon Oct 17 13:42:29 2022] GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:42:30.195473 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-147f1ef5-9ee1-462e-b91c-beebe810dd1d req-636dc458-a1ef-4d75-b00d-89357279bf5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9044674d-a793-46c2-b3ec-e9377b30f253", "name": "network-vif-plugged", "status": "completed", "tag": "b76e3be7-554d-4b8d-924c-9c699342cdd0"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:42:30.233989 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-147f1ef5-9ee1-462e-b91c-beebe810dd1d req-636dc458-a1ef-4d75-b00d-89357279bf5f service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:30.234473 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-147f1ef5-9ee1-462e-b91c-beebe810dd1d req-636dc458-a1ef-4d75-b00d-89357279bf5f service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:30.241342 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-147f1ef5-9ee1-462e-b91c-beebe810dd1d req-636dc458-a1ef-4d75-b00d-89357279bf5f service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:30.294401 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-147f1ef5-9ee1-462e-b91c-beebe810dd1d req-636dc458-a1ef-4d75-b00d-89357279bf5f service nova] Creating event network-vif-plugged:b76e3be7-554d-4b8d-924c-9c699342cdd0 for instance 9044674d-a793-46c2-b3ec-e9377b30f253 on n-h2-854247-14 Oct 17 13:42:30.341390 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-147f1ef5-9ee1-462e-b91c-beebe810dd1d req-636dc458-a1ef-4d75-b00d-89357279bf5f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146028 Oct 17 13:42:30.348393 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1105/2200] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:42:30.365950 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-93aaff97-9d34-4781-8403-ca3df0ebae3d tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:30.366676 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-93aaff97-9d34-4781-8403-ca3df0ebae3d tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] [instance: bc9feeff-1ac7-4267-9351-3f1560dede9b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:30.399663 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-93aaff97-9d34-4781-8403-ca3df0ebae3d tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:30.400168 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-93aaff97-9d34-4781-8403-ca3df0ebae3d tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:30.400606 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-93aaff97-9d34-4781-8403-ca3df0ebae3d tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:30.401699 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-93aaff97-9d34-4781-8403-ca3df0ebae3d tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:30.418283 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-93aaff97-9d34-4781-8403-ca3df0ebae3d tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:30.418902 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-93aaff97-9d34-4781-8403-ca3df0ebae3d tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:31.746601 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-407d0329-af2d-49da-b294-6fb0368c071e tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:31.755824 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-407d0329-af2d-49da-b294-6fb0368c071e tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253" status: 200 len: 1523 microversion: 2.1 time: 2.437845 Oct 17 13:42:31.756421 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1096/2201] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:29 2022] GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253 => generated 1523 bytes in 2439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:42:31.761085 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0b789c19-f994-4d28-b67b-36c6068d747a tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:31.776926 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0b789c19-f994-4d28-b67b-36c6068d747a tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] [instance: 6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:31.780432 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:42:31.794809 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0b789c19-f994-4d28-b67b-36c6068d747a tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:31.795737 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0b789c19-f994-4d28-b67b-36c6068d747a tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:31.796386 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0b789c19-f994-4d28-b67b-36c6068d747a tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:31.797425 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0b789c19-f994-4d28-b67b-36c6068d747a tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:31.798087 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0b789c19-f994-4d28-b67b-36c6068d747a tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:31.798712 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0b789c19-f994-4d28-b67b-36c6068d747a tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:31.868348 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-93aaff97-9d34-4781-8403-ca3df0ebae3d tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185235bc4e3245fc8d92b7e4bff6cbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c0147c5fae4017810887843b0afaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:31.887094 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-93aaff97-9d34-4781-8403-ca3df0ebae3d tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "GET /compute/v2.1/servers/bc9feeff-1ac7-4267-9351-3f1560dede9b" status: 200 len: 1315 microversion: 2.1 time: 1.535468 Oct 17 13:42:31.887899 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1106/2202] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:30 2022] GET /compute/v2.1/servers/bc9feeff-1ac7-4267-9351-3f1560dede9b => generated 1315 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:31.904100 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-491c3aaa-43cb-4a7c-9e1b-1068a016790f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:31.913568 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-491c3aaa-43cb-4a7c-9e1b-1068a016790f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 709d926d-fba5-49ea-84ac-95d8bb018c68] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:31.929776 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-491c3aaa-43cb-4a7c-9e1b-1068a016790f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:31.930498 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-491c3aaa-43cb-4a7c-9e1b-1068a016790f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:31.931098 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-491c3aaa-43cb-4a7c-9e1b-1068a016790f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:31.932571 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-491c3aaa-43cb-4a7c-9e1b-1068a016790f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:31.933226 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-491c3aaa-43cb-4a7c-9e1b-1068a016790f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:31.933804 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-491c3aaa-43cb-4a7c-9e1b-1068a016790f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:32.042483 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-491c3aaa-43cb-4a7c-9e1b-1068a016790f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.151719 Oct 17 13:42:32.062203 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1107/2203] 10.222.0.79 () {60 vars in 1343 bytes} [Mon Oct 17 13:42:31 2022] GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68/os-volume_attachments => generated 25 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:32.214246 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0b789c19-f994-4d28-b67b-36c6068d747a tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0410e9acbf42ff9f51b096b98d4975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e047e6275b42d6b6d5776ea2121b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:32.224279 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0b789c19-f994-4d28-b67b-36c6068d747a tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] 10.222.0.79 "GET /compute/v2.1/servers/6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37" status: 200 len: 1316 microversion: 2.1 time: 0.466701 Oct 17 13:42:32.226249 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1097/2204] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:31 2022] GET /compute/v2.1/servers/6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37 => generated 1316 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:32.365578 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-61a9b76b-2cfb-461c-8fb9-2dae656f7420 req-f4693a21-6805-4ff5-869e-c5827435cd69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc9feeff-1ac7-4267-9351-3f1560dede9b", "name": "network-vif-plugged", "status": "completed", "tag": "821390e6-5b5f-4941-b743-c5c5ff8b7d80"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:42:32.393540 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-61a9b76b-2cfb-461c-8fb9-2dae656f7420 req-f4693a21-6805-4ff5-869e-c5827435cd69 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:32.394032 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-61a9b76b-2cfb-461c-8fb9-2dae656f7420 req-f4693a21-6805-4ff5-869e-c5827435cd69 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:32.394451 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-61a9b76b-2cfb-461c-8fb9-2dae656f7420 req-f4693a21-6805-4ff5-869e-c5827435cd69 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:32.448122 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-61a9b76b-2cfb-461c-8fb9-2dae656f7420 req-f4693a21-6805-4ff5-869e-c5827435cd69 service nova] Creating event network-vif-plugged:821390e6-5b5f-4941-b743-c5c5ff8b7d80 for instance bc9feeff-1ac7-4267-9351-3f1560dede9b on n-h1-854247-14 Oct 17 13:42:32.459275 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-61a9b76b-2cfb-461c-8fb9-2dae656f7420 req-f4693a21-6805-4ff5-869e-c5827435cd69 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097196 Oct 17 13:42:32.459930 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1108/2205] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:42:32.779141 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-fd08dd60-176e-4b3f-8a5e-723c43e02fda tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:32.779809 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-fd08dd60-176e-4b3f-8a5e-723c43e02fda tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9044674d-a793-46c2-b3ec-e9377b30f253] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:32.795289 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fd08dd60-176e-4b3f-8a5e-723c43e02fda tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:32.802602 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fd08dd60-176e-4b3f-8a5e-723c43e02fda tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:32.804578 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fd08dd60-176e-4b3f-8a5e-723c43e02fda tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:32.805490 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fd08dd60-176e-4b3f-8a5e-723c43e02fda tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:32.807758 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fd08dd60-176e-4b3f-8a5e-723c43e02fda tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:32.815494 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fd08dd60-176e-4b3f-8a5e-723c43e02fda tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:32.916766 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-00042e88-38c4-4188-9730-f95bb02c8f10 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:32.917917 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-00042e88-38c4-4188-9730-f95bb02c8f10 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] [instance: bc9feeff-1ac7-4267-9351-3f1560dede9b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:32.952848 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-00042e88-38c4-4188-9730-f95bb02c8f10 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:32.959080 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-00042e88-38c4-4188-9730-f95bb02c8f10 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:32.962224 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-00042e88-38c4-4188-9730-f95bb02c8f10 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:32.963305 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-00042e88-38c4-4188-9730-f95bb02c8f10 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:32.967064 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-00042e88-38c4-4188-9730-f95bb02c8f10 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:32.968848 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-00042e88-38c4-4188-9730-f95bb02c8f10 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:33.402938 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-fd08dd60-176e-4b3f-8a5e-723c43e02fda tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:33.415773 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-fd08dd60-176e-4b3f-8a5e-723c43e02fda tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253" status: 200 len: 1523 microversion: 2.1 time: 0.640859 Oct 17 13:42:33.433566 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1098/2206] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:32 2022] GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253 => generated 1523 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:33.457470 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-2eecf639-5635-4b02-b3f6-02670dac807c req-0e346c3b-9b39-4af1-a301-b9c911f307d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37", "tag": "3dbc04db-8331-42cd-a117-acb2bbd05b2e"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:42:33.482825 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-2eecf639-5635-4b02-b3f6-02670dac807c req-0e346c3b-9b39-4af1-a301-b9c911f307d6 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:33.486385 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-2eecf639-5635-4b02-b3f6-02670dac807c req-0e346c3b-9b39-4af1-a301-b9c911f307d6 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:33.487252 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-2eecf639-5635-4b02-b3f6-02670dac807c req-0e346c3b-9b39-4af1-a301-b9c911f307d6 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:33.518116 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-2eecf639-5635-4b02-b3f6-02670dac807c req-0e346c3b-9b39-4af1-a301-b9c911f307d6 service nova] Creating event network-changed:3dbc04db-8331-42cd-a117-acb2bbd05b2e for instance 6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37 on n-h1-854247-14 Oct 17 13:42:33.524819 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-2eecf639-5635-4b02-b3f6-02670dac807c req-0e346c3b-9b39-4af1-a301-b9c911f307d6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081930 Oct 17 13:42:33.527868 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1099/2207] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:42:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:42:33.535697 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ef3dff7f-43c4-46a7-a79c-716d589c58bf tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:33.536705 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ef3dff7f-43c4-46a7-a79c-716d589c58bf tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] [instance: 6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:33.545884 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ef3dff7f-43c4-46a7-a79c-716d589c58bf tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:33.546796 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ef3dff7f-43c4-46a7-a79c-716d589c58bf tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:33.547652 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ef3dff7f-43c4-46a7-a79c-716d589c58bf tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:33.548708 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ef3dff7f-43c4-46a7-a79c-716d589c58bf tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:33.549409 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ef3dff7f-43c4-46a7-a79c-716d589c58bf tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:33.550070 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ef3dff7f-43c4-46a7-a79c-716d589c58bf tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:33.695514 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-00042e88-38c4-4188-9730-f95bb02c8f10 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185235bc4e3245fc8d92b7e4bff6cbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c0147c5fae4017810887843b0afaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:33.701580 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:42:33.719035 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-00042e88-38c4-4188-9730-f95bb02c8f10 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "GET /compute/v2.1/servers/bc9feeff-1ac7-4267-9351-3f1560dede9b" status: 200 len: 1315 microversion: 2.1 time: 0.807580 Oct 17 13:42:33.724216 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1109/2208] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:32 2022] GET /compute/v2.1/servers/bc9feeff-1ac7-4267-9351-3f1560dede9b => generated 1315 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:33.921214 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ef3dff7f-43c4-46a7-a79c-716d589c58bf tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0410e9acbf42ff9f51b096b98d4975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e047e6275b42d6b6d5776ea2121b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:33.952328 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ef3dff7f-43c4-46a7-a79c-716d589c58bf tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] 10.222.0.79 "GET /compute/v2.1/servers/6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37" status: 200 len: 1316 microversion: 2.1 time: 0.419402 Oct 17 13:42:33.974106 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1100/2209] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:33 2022] GET /compute/v2.1/servers/6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37 => generated 1316 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:34.482582 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3a7d29d8-5e12-401a-a194-b305858d3b12 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:34.483247 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3a7d29d8-5e12-401a-a194-b305858d3b12 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9044674d-a793-46c2-b3ec-e9377b30f253] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:34.527764 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:42:34.539971 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3a7d29d8-5e12-401a-a194-b305858d3b12 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:34.546294 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3a7d29d8-5e12-401a-a194-b305858d3b12 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:34.551726 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3a7d29d8-5e12-401a-a194-b305858d3b12 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:34.555437 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3a7d29d8-5e12-401a-a194-b305858d3b12 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:34.559788 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3a7d29d8-5e12-401a-a194-b305858d3b12 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:34.561578 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3a7d29d8-5e12-401a-a194-b305858d3b12 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:34.750061 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a544289a-2f1b-4658-a225-4c5f6728780d tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:34.750841 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a544289a-2f1b-4658-a225-4c5f6728780d tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] [instance: bc9feeff-1ac7-4267-9351-3f1560dede9b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:34.765297 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a544289a-2f1b-4658-a225-4c5f6728780d tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:34.769400 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a544289a-2f1b-4658-a225-4c5f6728780d tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:34.770007 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a544289a-2f1b-4658-a225-4c5f6728780d tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:34.771546 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a544289a-2f1b-4658-a225-4c5f6728780d tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:34.774499 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a544289a-2f1b-4658-a225-4c5f6728780d tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:34.776311 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a544289a-2f1b-4658-a225-4c5f6728780d tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:35.068578 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3a7d29d8-5e12-401a-a194-b305858d3b12 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:35.078471 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3a7d29d8-5e12-401a-a194-b305858d3b12 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253" status: 200 len: 1508 microversion: 2.1 time: 0.634488 Oct 17 13:42:35.084313 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1110/2210] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:34 2022] GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253 => generated 1508 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:35.233450 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a544289a-2f1b-4658-a225-4c5f6728780d tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185235bc4e3245fc8d92b7e4bff6cbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c0147c5fae4017810887843b0afaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:35.246234 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a544289a-2f1b-4658-a225-4c5f6728780d tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "GET /compute/v2.1/servers/bc9feeff-1ac7-4267-9351-3f1560dede9b" status: 200 len: 1315 microversion: 2.1 time: 0.501118 Oct 17 13:42:35.249684 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1101/2211] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:34 2022] GET /compute/v2.1/servers/bc9feeff-1ac7-4267-9351-3f1560dede9b => generated 1315 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:42:35.254874 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a1f34a6c-5558-4a19-bf4a-5e7d44346b56 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:35.255736 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a1f34a6c-5558-4a19-bf4a-5e7d44346b56 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] [instance: 6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:35.262018 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a1f34a6c-5558-4a19-bf4a-5e7d44346b56 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:35.262675 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a1f34a6c-5558-4a19-bf4a-5e7d44346b56 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:35.263306 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a1f34a6c-5558-4a19-bf4a-5e7d44346b56 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:35.264280 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a1f34a6c-5558-4a19-bf4a-5e7d44346b56 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:35.264878 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a1f34a6c-5558-4a19-bf4a-5e7d44346b56 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:35.265468 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a1f34a6c-5558-4a19-bf4a-5e7d44346b56 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:35.496440 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a1f34a6c-5558-4a19-bf4a-5e7d44346b56 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0410e9acbf42ff9f51b096b98d4975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e047e6275b42d6b6d5776ea2121b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:35.508099 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a1f34a6c-5558-4a19-bf4a-5e7d44346b56 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] 10.222.0.79 "GET /compute/v2.1/servers/6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37" status: 200 len: 1316 microversion: 2.1 time: 0.256305 Oct 17 13:42:35.509436 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1102/2212] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:35 2022] GET /compute/v2.1/servers/6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37 => generated 1316 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:35.527719 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ee25e170-bbb9-4aec-bcf5-34b669781508 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:35.532915 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ee25e170-bbb9-4aec-bcf5-34b669781508 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9044674d-a793-46c2-b3ec-e9377b30f253] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:35.545208 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ee25e170-bbb9-4aec-bcf5-34b669781508 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:35.547773 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ee25e170-bbb9-4aec-bcf5-34b669781508 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:35.554290 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ee25e170-bbb9-4aec-bcf5-34b669781508 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:35.555581 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ee25e170-bbb9-4aec-bcf5-34b669781508 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:35.557289 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ee25e170-bbb9-4aec-bcf5-34b669781508 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:35.558064 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c1021cd5-0720-48a9-8557-97e5dd3d55dd tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-489589174", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "a240be31-2b05-44ce-b51b-e629d71db798"}]}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:42:35.564241 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ee25e170-bbb9-4aec-bcf5-34b669781508 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:35.871705 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ee25e170-bbb9-4aec-bcf5-34b669781508 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:35.884645 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ee25e170-bbb9-4aec-bcf5-34b669781508 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253" status: 200 len: 1508 microversion: 2.1 time: 0.369713 Oct 17 13:42:35.894598 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1103/2213] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:35 2022] GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253 => generated 1508 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:35.919429 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b38aa023-e69f-4057-83fa-3cc328d514f5 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:35.921354 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b38aa023-e69f-4057-83fa-3cc328d514f5 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9044674d-a793-46c2-b3ec-e9377b30f253] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:35.926293 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:42:35.935880 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b38aa023-e69f-4057-83fa-3cc328d514f5 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:35.952011 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b38aa023-e69f-4057-83fa-3cc328d514f5 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:35.956943 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b38aa023-e69f-4057-83fa-3cc328d514f5 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:35.959968 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b38aa023-e69f-4057-83fa-3cc328d514f5 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:35.961334 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b38aa023-e69f-4057-83fa-3cc328d514f5 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:35.964064 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b38aa023-e69f-4057-83fa-3cc328d514f5 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:36.017505 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b38aa023-e69f-4057-83fa-3cc328d514f5 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9044674d-a793-46c2-b3ec-e9377b30f253] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:42:36.110779 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:42:36.242170 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b38aa023-e69f-4057-83fa-3cc328d514f5 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "DELETE /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253" status: 204 len: 0 microversion: 2.1 time: 0.335909 Oct 17 13:42:36.242811 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1104/2214] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:42:35 2022] DELETE /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 13:42:36.276997 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-104f7af6-57fe-4284-931c-5d8e75984c98 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:36.277807 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-104f7af6-57fe-4284-931c-5d8e75984c98 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] [instance: bc9feeff-1ac7-4267-9351-3f1560dede9b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:36.291970 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-104f7af6-57fe-4284-931c-5d8e75984c98 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:36.292738 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-104f7af6-57fe-4284-931c-5d8e75984c98 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:36.293378 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-104f7af6-57fe-4284-931c-5d8e75984c98 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:36.294109 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-104f7af6-57fe-4284-931c-5d8e75984c98 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:36.295454 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-104f7af6-57fe-4284-931c-5d8e75984c98 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:36.296131 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-104f7af6-57fe-4284-931c-5d8e75984c98 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:36.611534 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=8 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:42:36.669422 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-104f7af6-57fe-4284-931c-5d8e75984c98 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185235bc4e3245fc8d92b7e4bff6cbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c0147c5fae4017810887843b0afaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:36.681904 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-104f7af6-57fe-4284-931c-5d8e75984c98 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "GET /compute/v2.1/servers/bc9feeff-1ac7-4267-9351-3f1560dede9b" status: 200 len: 1503 microversion: 2.1 time: 0.409332 Oct 17 13:42:36.684441 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1105/2215] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:36 2022] GET /compute/v2.1/servers/bc9feeff-1ac7-4267-9351-3f1560dede9b => generated 1503 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:36.692079 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e2a04a0f-cb51-4a82-a608-ecece6b9db8b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-411969225", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "1fa8f2b8-208c-4e70-b9bb-194c580d73b4"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:42:43.610344 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-c1021cd5-0720-48a9-8557-97e5dd3d55dd tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] validate_networks() for [('a240be31-2b05-44ce-b51b-e629d71db798', None, None, None, None, None)] {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:42:43.613203 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-e2a04a0f-cb51-4a82-a608-ecece6b9db8b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] validate_networks() for [('1fa8f2b8-208c-4e70-b9bb-194c580d73b4', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:42:44.351334 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-e2a04a0f-cb51-4a82-a608-ecece6b9db8b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:42:44.352063 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-e2a04a0f-cb51-4a82-a608-ecece6b9db8b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:42:44.352810 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-e2a04a0f-cb51-4a82-a608-ecece6b9db8b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:42:44.352921 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-c1021cd5-0720-48a9-8557-97e5dd3d55dd tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:42:44.353287 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-c1021cd5-0720-48a9-8557-97e5dd3d55dd tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:42:44.353758 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-e2a04a0f-cb51-4a82-a608-ecece6b9db8b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:42:44.353890 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-c1021cd5-0720-48a9-8557-97e5dd3d55dd tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:42:44.354160 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-c1021cd5-0720-48a9-8557-97e5dd3d55dd tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:42:44.354552 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-e2a04a0f-cb51-4a82-a608-ecece6b9db8b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:42:44.354697 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-c1021cd5-0720-48a9-8557-97e5dd3d55dd tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:42:44.365207 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1021cd5-0720-48a9-8557-97e5dd3d55dd tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:44.365961 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1021cd5-0720-48a9-8557-97e5dd3d55dd tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:44.366220 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e2a04a0f-cb51-4a82-a608-ecece6b9db8b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:44.366768 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e2a04a0f-cb51-4a82-a608-ecece6b9db8b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:44.367054 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1021cd5-0720-48a9-8557-97e5dd3d55dd tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:44.367398 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e2a04a0f-cb51-4a82-a608-ecece6b9db8b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:44.368015 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1021cd5-0720-48a9-8557-97e5dd3d55dd tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:44.368302 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e2a04a0f-cb51-4a82-a608-ecece6b9db8b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:44.368756 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e2a04a0f-cb51-4a82-a608-ecece6b9db8b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:44.369135 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1021cd5-0720-48a9-8557-97e5dd3d55dd tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:44.369245 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e2a04a0f-cb51-4a82-a608-ecece6b9db8b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:44.369734 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1021cd5-0720-48a9-8557-97e5dd3d55dd tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:44.392456 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-c1021cd5-0720-48a9-8557-97e5dd3d55dd tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Getting quotas for project d3134826eb154c71bb67718c36ff38cd. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:42:44.394181 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-e2a04a0f-cb51-4a82-a608-ecece6b9db8b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Getting quotas for project a8fe03af82c34607bfe43a58b997704f. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:42:44.398083 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-c1021cd5-0720-48a9-8557-97e5dd3d55dd tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Getting quotas for user 76e77dade0e441a79c2c4d77993172ff and project d3134826eb154c71bb67718c36ff38cd. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:42:44.400069 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-e2a04a0f-cb51-4a82-a608-ecece6b9db8b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Getting quotas for user 17a7b6856447415487c272498ca335db and project a8fe03af82c34607bfe43a58b997704f. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:42:44.412628 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c1021cd5-0720-48a9-8557-97e5dd3d55dd tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Going to run 3 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:42:44.412812 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e2a04a0f-cb51-4a82-a608-ecece6b9db8b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:42:44.415113 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e2a04a0f-cb51-4a82-a608-ecece6b9db8b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 240648df-7968-4bbe-ac94-08360eb1049e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:42:44.415634 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c1021cd5-0720-48a9-8557-97e5dd3d55dd tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] [instance: 4f806fc0-61ef-4c0b-b6af-8f987148f5ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:42:44.459248 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c1021cd5-0720-48a9-8557-97e5dd3d55dd tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] [instance: 165d4143-55b3-4c2d-a08f-a5ae5352c934] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=4f806fc0-61ef-4c0b-b6af-8f987148f5ca,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:42:44.476798 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e2a04a0f-cb51-4a82-a608-ecece6b9db8b tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.791008 Oct 17 13:42:44.477365 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1106/2216] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:42:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 7792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:42:44.483275 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d6b74d43-abbc-4561-adc3-4686425d1f3d tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:44.483984 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d6b74d43-abbc-4561-adc3-4686425d1f3d tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] [instance: 6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:44.494974 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d6b74d43-abbc-4561-adc3-4686425d1f3d tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:44.496260 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d6b74d43-abbc-4561-adc3-4686425d1f3d tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:44.496862 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d6b74d43-abbc-4561-adc3-4686425d1f3d tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:44.497846 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d6b74d43-abbc-4561-adc3-4686425d1f3d tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:44.498440 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d6b74d43-abbc-4561-adc3-4686425d1f3d tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:44.499215 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d6b74d43-abbc-4561-adc3-4686425d1f3d tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:44.507727 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c1021cd5-0720-48a9-8557-97e5dd3d55dd tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] [instance: 1088ec60-b26d-4082-bfa8-e01bf9af31f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=165d4143-55b3-4c2d-a08f-a5ae5352c934,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:42:44.593993 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c1021cd5-0720-48a9-8557-97e5dd3d55dd tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 9.508279 Oct 17 13:42:44.601684 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1111/2217] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:42:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 9517 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:42:44.607725 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fac84706-fcfd-4eba-ada5-e3324e4b912e tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-491402492"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:42:44.608524 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-fac84706-fcfd-4eba-ada5-e3324e4b912e tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] [instance: bc9feeff-1ac7-4267-9351-3f1560dede9b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:44.615249 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fac84706-fcfd-4eba-ada5-e3324e4b912e tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:44.616394 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fac84706-fcfd-4eba-ada5-e3324e4b912e tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:44.617006 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fac84706-fcfd-4eba-ada5-e3324e4b912e tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:44.618941 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fac84706-fcfd-4eba-ada5-e3324e4b912e tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:44.620148 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fac84706-fcfd-4eba-ada5-e3324e4b912e tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:44.620572 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fac84706-fcfd-4eba-ada5-e3324e4b912e tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:44.739220 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d6b74d43-abbc-4561-adc3-4686425d1f3d tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0410e9acbf42ff9f51b096b98d4975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e047e6275b42d6b6d5776ea2121b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:44.752313 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d6b74d43-abbc-4561-adc3-4686425d1f3d tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] 10.222.0.79 "GET /compute/v2.1/servers/6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37" status: 200 len: 1316 microversion: 2.1 time: 0.270995 Oct 17 13:42:44.763853 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1107/2218] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:44 2022] GET /compute/v2.1/servers/6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37 => generated 1316 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:44.778835 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-87d4a44e-a112-47bb-bc77-b4f84df51800 req-2bf896cd-7150-4ba0-b649-aa730d29a8ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9044674d-a793-46c2-b3ec-e9377b30f253", "name": "network-vif-deleted", "tag": "b76e3be7-554d-4b8d-924c-9c699342cdd0"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:42:44.789859 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-87d4a44e-a112-47bb-bc77-b4f84df51800 req-2bf896cd-7150-4ba0-b649-aa730d29a8ee service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:44.790638 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-87d4a44e-a112-47bb-bc77-b4f84df51800 req-2bf896cd-7150-4ba0-b649-aa730d29a8ee service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:44.791295 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-87d4a44e-a112-47bb-bc77-b4f84df51800 req-2bf896cd-7150-4ba0-b649-aa730d29a8ee service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:44.804822 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-87d4a44e-a112-47bb-bc77-b4f84df51800 req-2bf896cd-7150-4ba0-b649-aa730d29a8ee service nova] Creating event network-vif-deleted:b76e3be7-554d-4b8d-924c-9c699342cdd0 for instance 9044674d-a793-46c2-b3ec-e9377b30f253 on n-h2-854247-14 Oct 17 13:42:44.811973 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-87d4a44e-a112-47bb-bc77-b4f84df51800 req-2bf896cd-7150-4ba0-b649-aa730d29a8ee service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039359 Oct 17 13:42:44.815585 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1108/2219] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:42:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:42:44.827654 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-fcfbe528-958e-4053-adcb-fdf1c3645b19 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:44.835063 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-fcfbe528-958e-4053-adcb-fdf1c3645b19 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b891d3b774e44de3ad1d3088990f6bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358604dd1cf74e5fab262179351d4d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:44.835845 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-fcfbe528-958e-4053-adcb-fdf1c3645b19 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Searching by: {'deleted': False, 'project_id': '358604dd1cf74e5fab262179351d4d98'} {{(pid=127017) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:42:44.842579 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fcfbe528-958e-4053-adcb-fdf1c3645b19 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:44.843053 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fcfbe528-958e-4053-adcb-fdf1c3645b19 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:44.843766 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fcfbe528-958e-4053-adcb-fdf1c3645b19 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:44.845291 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fcfbe528-958e-4053-adcb-fdf1c3645b19 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:44.845853 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fcfbe528-958e-4053-adcb-fdf1c3645b19 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:44.846569 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fcfbe528-958e-4053-adcb-fdf1c3645b19 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:44.878038 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.multi_cell_list [None req-fcfbe528-958e-4053-adcb-fdf1c3645b19 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127017) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:42:44.933248 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-fcfbe528-958e-4053-adcb-fdf1c3645b19 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] 10.222.0.79 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.116023 Oct 17 13:42:44.934650 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1109/2220] 10.222.0.79 () {58 vars in 1125 bytes} [Mon Oct 17 13:42:44 2022] GET /compute/v2.1/servers => generated 339 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:42:44.944318 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.network.security_group_api [None req-fac84706-fcfd-4eba-ada5-e3324e4b912e tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Adding security group 40a5b24c-a168-4bdf-b5f8-8211a29d8c9f to port 821390e6-5b5f-4941-b743-c5c5ff8b7d80 Oct 17 13:42:44.949443 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-10042308-bcc0-40cd-9dde-6de7b39f86be req-8011a4df-6710-4491-88c9-4a25f4aa94cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37", "name": "network-vif-plugged", "status": "completed", "tag": "3dbc04db-8331-42cd-a117-acb2bbd05b2e"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:42:44.964593 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-10042308-bcc0-40cd-9dde-6de7b39f86be req-8011a4df-6710-4491-88c9-4a25f4aa94cf service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:44.965284 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-10042308-bcc0-40cd-9dde-6de7b39f86be req-8011a4df-6710-4491-88c9-4a25f4aa94cf service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:44.966025 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-10042308-bcc0-40cd-9dde-6de7b39f86be req-8011a4df-6710-4491-88c9-4a25f4aa94cf service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:44.984174 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-10042308-bcc0-40cd-9dde-6de7b39f86be req-8011a4df-6710-4491-88c9-4a25f4aa94cf service nova] Creating event network-vif-plugged:3dbc04db-8331-42cd-a117-acb2bbd05b2e for instance 6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37 on n-h1-854247-14 Oct 17 13:42:44.989151 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-10042308-bcc0-40cd-9dde-6de7b39f86be req-8011a4df-6710-4491-88c9-4a25f4aa94cf service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052548 Oct 17 13:42:44.990119 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1110/2221] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:42:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:42:45.524247 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a299a591-008f-4984-9076-54d0259c3a23 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Action: 'create', calling method: .version_select at 0x7f7cd5b010d0>, body: {"keypair": {"name": "tempest-keypair-1101982132", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFL3kVfd1M4LcTBHg88zOKPczy/LYxdG16Jkjq5rXHBZSsek+XjqNT8myCuhBph3dbyjuJAzniYf5HfnT+1BiXkrogRmh7dnzrDr6ExHwgbIj0xZCpiH9xzLpinfvMr+g=="}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:42:45.574726 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-a299a591-008f-4984-9076-54d0259c3a23 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Getting quotas for project 5bb50742d06f403598634414befbeb12. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:42:45.593281 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-a299a591-008f-4984-9076-54d0259c3a23 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Getting quotas for user 799d72ccad514fd899d21809d613249b and project 5bb50742d06f403598634414befbeb12. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:42:45.647975 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a299a591-008f-4984-9076-54d0259c3a23 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.654197 Oct 17 13:42:45.649811 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1111/2222] 10.222.0.79 () {60 vars in 1159 bytes} [Mon Oct 17 13:42:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:42:45.742044 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-824fe95b-0a3d-4dc8-9d9f-df02ed400abf tempest-SecurityGroupsNegativeTestJSON-439659532 tempest-SecurityGroupsNegativeTestJSON-439659532-project] Calling method '.version_select at 0x7f7cd556f9d0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:45.833583 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fac84706-fcfd-4eba-ada5-e3324e4b912e tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "POST /compute/v2.1/servers/bc9feeff-1ac7-4267-9351-3f1560dede9b/action" status: 202 len: 0 microversion: 2.1 time: 1.230401 Oct 17 13:42:45.834864 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1112/2223] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:42:44 2022] POST /compute/v2.1/servers/bc9feeff-1ac7-4267-9351-3f1560dede9b/action => generated 0 bytes in 1232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:42:45.853093 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e2086803-59f1-4cbc-a3d6-e5ed3a48a93d tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:45.854357 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e2086803-59f1-4cbc-a3d6-e5ed3a48a93d tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 240648df-7968-4bbe-ac94-08360eb1049e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:45.865313 n-d-854247-14 devstack@n-api.service[127017]: DEBUG neutronclient.v2_0.client [None req-824fe95b-0a3d-4dc8-9d9f-df02ed400abf tempest-SecurityGroupsNegativeTestJSON-439659532 tempest-SecurityGroupsNegativeTestJSON-439659532-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1c31c743-f5ff-4c7c-bd0c-29ac17c4da58 does not exist", "detail": ""}} {{(pid=127017) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 13:42:45.866680 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.security_group_api [None req-824fe95b-0a3d-4dc8-9d9f-df02ed400abf tempest-SecurityGroupsNegativeTestJSON-439659532 tempest-SecurityGroupsNegativeTestJSON-439659532-project] Neutron security group 1c31c743-f5ff-4c7c-bd0c-29ac17c4da58 not found {{(pid=127017) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 17 13:42:45.867577 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-824fe95b-0a3d-4dc8-9d9f-df02ed400abf tempest-SecurityGroupsNegativeTestJSON-439659532 tempest-SecurityGroupsNegativeTestJSON-439659532-project] HTTP exception thrown: Security group 1c31c743-f5ff-4c7c-bd0c-29ac17c4da58 does not exist Oct 17 13:42:45.867577 n-d-854247-14 devstack@n-api.service[127017]: Neutron server returns request_ids: ['req-ec32bba6-b9ac-48d0-ae53-cac6636521cc'] Oct 17 13:42:45.869495 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e2086803-59f1-4cbc-a3d6-e5ed3a48a93d tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:45.870450 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e2086803-59f1-4cbc-a3d6-e5ed3a48a93d tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:45.871225 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-824fe95b-0a3d-4dc8-9d9f-df02ed400abf tempest-SecurityGroupsNegativeTestJSON-439659532 tempest-SecurityGroupsNegativeTestJSON-439659532-project] Request method failure captured: Oct 17 13:42:45.871225 n-d-854247-14 devstack@n-api.service[127017]: request: DELETE /compute/v2.1/os-security-groups/1c31c743-f5ff-4c7c-bd0c-29ac17c4da58 HTTP/1.1 Oct 17 13:42:45.871225 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:42:45.871225 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:42:45.871225 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:42:45.871225 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:42:45.871225 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:42:45.871225 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:42:45.871225 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:42:45.871225 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:42:45.871225 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVvTVKhNCTBB0QZXZEcfXkPEeTmPRUEzACJorzgxqdLosNZE4SsUn2uFLX0kyGkgCSKJM-seutI2AVB7KY2NMGoAH3AirJ4_FaAmmroAvVwizQVslXi8PG72S_csSO3xZLFvvDkKUbf4ch0UXSyp7Y1HdFcHsrV7X0GaNXDCbRpncpg Oct 17 13:42:45.871225 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:42:45.871225 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:42:45.871225 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:42:45.871225 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:42:45.871225 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:42:45.871225 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:42:45.871225 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: d282c8b0483c49f38ddb5165378a0c9d Oct 17 13:42:45.871225 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-439659532 Oct 17 13:42:45.871225 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:42:45.871225 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:42:45.871225 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d282c8b0483c49f38ddb5165378a0c9d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d282c8b0483c49f38ddb5165378a0c9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d282c8b0483c49f38ddb5165378a0c9d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d282c8b0483c49f38ddb5165378a0c9d", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:42:45.871225 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-439659532 Oct 17 13:42:45.871225 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: d282c8b0483c49f38ddb5165378a0c9d Oct 17 13:42:45.871225 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-439659532 Oct 17 13:42:45.871225 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-SecurityGroupsNegativeTestJSON-439659532-project Oct 17 13:42:45.871225 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:42:45.871225 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:42:45.871225 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 2c8a454eea284d67b12c57332203d0e8 Oct 17 13:42:45.871225 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-439659532-project Oct 17 13:42:45.871225 n-d-854247-14 devstack@n-api.service[127017]: method: Oct 17 13:42:45.871225 n-d-854247-14 devstack@n-api.service[127017]: exception: Security group 1c31c743-f5ff-4c7c-bd0c-29ac17c4da58 does not exist Oct 17 13:42:45.871225 n-d-854247-14 devstack@n-api.service[127017]: Neutron server returns request_ids: ['req-ec32bba6-b9ac-48d0-ae53-cac6636521cc'] Oct 17 13:42:45.871225 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '1c31c743-f5ff-4c7c-bd0c-29ac17c4da58'} Oct 17 13:42:45.871225 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:42:45.871225 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:45.871225 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 17 13:42:45.871225 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 17 13:42:45.871225 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:45.871225 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:45.871225 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 17 13:42:45.871225 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 17 13:42:45.871225 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:45.871225 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:45.871225 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 13:42:45.871225 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 13:42:45.871225 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:45.871225 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:45.871225 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 13:42:45.871225 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 13:42:45.871225 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:45.871225 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:45.871225 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 13:42:45.871225 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 13:42:45.871225 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:45.871225 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:45.871225 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 13:42:45.871225 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 13:42:45.871225 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 13:42:45.871225 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 13:42:45.871225 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1c31c743-f5ff-4c7c-bd0c-29ac17c4da58 does not exist Oct 17 13:42:45.875643 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ec32bba6-b9ac-48d0-ae53-cac6636521cc'] Oct 17 13:42:45.875643 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:42:45.875643 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:45.875643 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:42:45.875643 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:45.875643 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 17 13:42:45.875643 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 17 13:42:45.875643 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 17 13:42:45.875643 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 13:42:45.875643 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1c31c743-f5ff-4c7c-bd0c-29ac17c4da58 does not exist Oct 17 13:42:45.875643 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ec32bba6-b9ac-48d0-ae53-cac6636521cc'] Oct 17 13:42:45.875643 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:42:45.875643 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:45.875643 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:42:45.875643 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:45.875643 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:45.875643 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:45.875643 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:42:45.875643 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:42:45.875643 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:42:45.875643 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:42:45.875643 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:42:45.875643 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:42:45.875643 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 17 13:42:45.875643 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 17 13:42:45.875643 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1c31c743-f5ff-4c7c-bd0c-29ac17c4da58 does not exist Oct 17 13:42:45.875643 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ec32bba6-b9ac-48d0-ae53-cac6636521cc'] Oct 17 13:42:45.875643 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:42:45.875643 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:45.875643 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:42:45.875643 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:45.875643 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:45.875643 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:45.875643 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:42:45.875643 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:42:45.875643 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1c31c743-f5ff-4c7c-bd0c-29ac17c4da58 does not exist Oct 17 13:42:45.875643 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ec32bba6-b9ac-48d0-ae53-cac6636521cc'] Oct 17 13:42:45.875643 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:42:45.875643 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-824fe95b-0a3d-4dc8-9d9f-df02ed400abf tempest-SecurityGroupsNegativeTestJSON-439659532 tempest-SecurityGroupsNegativeTestJSON-439659532-project] Returning 404 to user: Security group 1c31c743-f5ff-4c7c-bd0c-29ac17c4da58 does not exist Oct 17 13:42:45.875643 n-d-854247-14 devstack@n-api.service[127017]: Neutron server returns request_ids: ['req-ec32bba6-b9ac-48d0-ae53-cac6636521cc'] {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:42:45.875643 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-824fe95b-0a3d-4dc8-9d9f-df02ed400abf tempest-SecurityGroupsNegativeTestJSON-439659532 tempest-SecurityGroupsNegativeTestJSON-439659532-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/1c31c743-f5ff-4c7c-bd0c-29ac17c4da58" status: 404 len: 194 microversion: 2.1 time: 0.220911 Oct 17 13:42:45.881437 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e2086803-59f1-4cbc-a3d6-e5ed3a48a93d tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:45.881527 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1112/2224] 10.222.0.79 () {58 vars in 1272 bytes} [Mon Oct 17 13:42:45 2022] DELETE /compute/v2.1/os-security-groups/1c31c743-f5ff-4c7c-bd0c-29ac17c4da58 => generated 194 bytes in 223 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:42:45.881601 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e2086803-59f1-4cbc-a3d6-e5ed3a48a93d tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:45.882287 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e2086803-59f1-4cbc-a3d6-e5ed3a48a93d tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:45.882721 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e2086803-59f1-4cbc-a3d6-e5ed3a48a93d tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:45.895771 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f005a54f-fd7b-4f91-a85f-8614e2ba1c22 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:45.915731 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f005a54f-fd7b-4f91-a85f-8614e2ba1c22 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '76e77dade0e441a79c2c4d77993172ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3134826eb154c71bb67718c36ff38cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:45.916567 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f005a54f-fd7b-4f91-a85f-8614e2ba1c22 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Searching by: {'deleted': False, 'project_id': 'd3134826eb154c71bb67718c36ff38cd'} {{(pid=127017) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:42:46.001269 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f005a54f-fd7b-4f91-a85f-8614e2ba1c22 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:46.001774 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f005a54f-fd7b-4f91-a85f-8614e2ba1c22 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:46.002225 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f005a54f-fd7b-4f91-a85f-8614e2ba1c22 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:46.011633 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f005a54f-fd7b-4f91-a85f-8614e2ba1c22 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:46.013398 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f005a54f-fd7b-4f91-a85f-8614e2ba1c22 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:46.015668 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f005a54f-fd7b-4f91-a85f-8614e2ba1c22 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:46.032489 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e2086803-59f1-4cbc-a3d6-e5ed3a48a93d tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:46.043349 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e2086803-59f1-4cbc-a3d6-e5ed3a48a93d tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/240648df-7968-4bbe-ac94-08360eb1049e" status: 200 len: 1269 microversion: 2.1 time: 0.198651 Oct 17 13:42:46.064141 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1113/2225] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:45 2022] GET /compute/v2.1/servers/240648df-7968-4bbe-ac94-08360eb1049e => generated 1269 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:46.071182 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3c6cb31f-26f2-40bd-8060-b05d601cdcca tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:46.079529 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3c6cb31f-26f2-40bd-8060-b05d601cdcca tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b891d3b774e44de3ad1d3088990f6bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358604dd1cf74e5fab262179351d4d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:46.080708 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3c6cb31f-26f2-40bd-8060-b05d601cdcca tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Searching by: {'deleted': False, 'project_id': '358604dd1cf74e5fab262179351d4d98'} {{(pid=127016) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:42:46.088036 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3c6cb31f-26f2-40bd-8060-b05d601cdcca tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:46.088697 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3c6cb31f-26f2-40bd-8060-b05d601cdcca tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:46.090540 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3c6cb31f-26f2-40bd-8060-b05d601cdcca tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:46.091625 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3c6cb31f-26f2-40bd-8060-b05d601cdcca tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:46.092244 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3c6cb31f-26f2-40bd-8060-b05d601cdcca tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:46.092815 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3c6cb31f-26f2-40bd-8060-b05d601cdcca tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:46.130760 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.multi_cell_list [None req-f005a54f-fd7b-4f91-a85f-8614e2ba1c22 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Listed batch of 2 results from cell out of 997 limit. Returned 2 total so far. {{(pid=127017) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:42:46.149826 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.multi_cell_list [None req-3c6cb31f-26f2-40bd-8060-b05d601cdcca tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127016) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:42:46.209774 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f005a54f-fd7b-4f91-a85f-8614e2ba1c22 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] 10.222.0.79 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.334309 Oct 17 13:42:46.213552 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1113/2226] 10.222.0.79 () {58 vars in 1125 bytes} [Mon Oct 17 13:42:45 2022] GET /compute/v2.1/servers => generated 1015 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:46.227018 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f066381c-5bc8-4d83-bf8a-0971eb7b6241 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:46.227807 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f066381c-5bc8-4d83-bf8a-0971eb7b6241 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] [instance: 6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:46.244039 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f066381c-5bc8-4d83-bf8a-0971eb7b6241 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:46.244854 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f066381c-5bc8-4d83-bf8a-0971eb7b6241 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:46.245316 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f066381c-5bc8-4d83-bf8a-0971eb7b6241 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:46.246199 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f066381c-5bc8-4d83-bf8a-0971eb7b6241 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:46.251828 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3c6cb31f-26f2-40bd-8060-b05d601cdcca tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b891d3b774e44de3ad1d3088990f6bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358604dd1cf74e5fab262179351d4d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:46.252190 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f066381c-5bc8-4d83-bf8a-0971eb7b6241 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:46.252642 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f066381c-5bc8-4d83-bf8a-0971eb7b6241 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:46.266976 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3c6cb31f-26f2-40bd-8060-b05d601cdcca tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:46.269090 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3c6cb31f-26f2-40bd-8060-b05d601cdcca tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:46.269553 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3c6cb31f-26f2-40bd-8060-b05d601cdcca tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:47.022697 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f066381c-5bc8-4d83-bf8a-0971eb7b6241 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0410e9acbf42ff9f51b096b98d4975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e047e6275b42d6b6d5776ea2121b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:47.034046 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f066381c-5bc8-4d83-bf8a-0971eb7b6241 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] 10.222.0.79 "GET /compute/v2.1/servers/6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37" status: 200 len: 1316 microversion: 2.1 time: 0.817892 Oct 17 13:42:47.037333 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1114/2227] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:46 2022] GET /compute/v2.1/servers/6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37 => generated 1316 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:47.045348 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3c6cb31f-26f2-40bd-8060-b05d601cdcca tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] 10.222.0.79 "GET /compute/v2.1/servers/detail" status: 200 len: 1710 microversion: 2.1 time: 0.979440 Oct 17 13:42:47.046753 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1114/2228] 10.222.0.79 () {58 vars in 1146 bytes} [Mon Oct 17 13:42:46 2022] GET /compute/v2.1/servers/detail => generated 1710 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:47.052673 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a979e4c5-3b9f-468a-a987-2b0cf5ef9bde tempest-SecurityGroupsNegativeTestJSON-439659532 tempest-SecurityGroupsNegativeTestJSON-439659532-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.004704 Oct 17 13:42:47.055903 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1115/2229] 10.222.0.79 () {58 vars in 1164 bytes} [Mon Oct 17 13:42:47 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 17 13:42:47.066357 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a4bb6f1e-dd74-4019-b8e3-8a76f2a92f86 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Calling method '.version_select at 0x7f7cd5ba2310>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:47.077320 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2e43a3f8-e6f4-4726-8c8b-e0444c73d3d5 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:47.081167 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2e43a3f8-e6f4-4726-8c8b-e0444c73d3d5 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] [instance: 1088ec60-b26d-4082-bfa8-e01bf9af31f8] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:47.099065 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2e43a3f8-e6f4-4726-8c8b-e0444c73d3d5 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:47.099831 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2e43a3f8-e6f4-4726-8c8b-e0444c73d3d5 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:47.100458 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2e43a3f8-e6f4-4726-8c8b-e0444c73d3d5 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:47.105107 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2e43a3f8-e6f4-4726-8c8b-e0444c73d3d5 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:47.105793 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2e43a3f8-e6f4-4726-8c8b-e0444c73d3d5 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:47.106377 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2e43a3f8-e6f4-4726-8c8b-e0444c73d3d5 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:47.481776 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2e43a3f8-e6f4-4726-8c8b-e0444c73d3d5 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76e77dade0e441a79c2c4d77993172ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3134826eb154c71bb67718c36ff38cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:47.491582 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2e43a3f8-e6f4-4726-8c8b-e0444c73d3d5 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] 10.222.0.79 "GET /compute/v2.1/servers/1088ec60-b26d-4082-bfa8-e01bf9af31f8" status: 200 len: 1226 microversion: 2.1 time: 0.430398 Oct 17 13:42:47.497843 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1116/2230] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:47 2022] GET /compute/v2.1/servers/1088ec60-b26d-4082-bfa8-e01bf9af31f8 => generated 1226 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:47.507673 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-d6bde1a2-ea84-46d5-ac53-295ddc257b3e req-48a1c8f8-a05e-4342-9420-60310e789944 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc9feeff-1ac7-4267-9351-3f1560dede9b", "tag": "821390e6-5b5f-4941-b743-c5c5ff8b7d80"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:42:47.533260 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-d6bde1a2-ea84-46d5-ac53-295ddc257b3e req-48a1c8f8-a05e-4342-9420-60310e789944 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:47.535549 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-d6bde1a2-ea84-46d5-ac53-295ddc257b3e req-48a1c8f8-a05e-4342-9420-60310e789944 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:47.536285 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-d6bde1a2-ea84-46d5-ac53-295ddc257b3e req-48a1c8f8-a05e-4342-9420-60310e789944 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:47.563908 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-d6bde1a2-ea84-46d5-ac53-295ddc257b3e req-48a1c8f8-a05e-4342-9420-60310e789944 service nova] Creating event network-changed:821390e6-5b5f-4941-b743-c5c5ff8b7d80 for instance bc9feeff-1ac7-4267-9351-3f1560dede9b on n-h1-854247-14 Oct 17 13:42:47.581876 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-d6bde1a2-ea84-46d5-ac53-295ddc257b3e req-48a1c8f8-a05e-4342-9420-60310e789944 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078705 Oct 17 13:42:47.583419 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1117/2231] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:42:47.602054 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9e869fd9-0546-4fbd-a639-52fd976f43eb tempest-SecurityGroupsNegativeTestJSON-439659532 tempest-SecurityGroupsNegativeTestJSON-439659532-project] Calling method '.version_select at 0x7f7cd5474f70>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:47.954493 n-d-854247-14 devstack@n-api.service[127017]: DEBUG neutronclient.v2_0.client [None req-a4bb6f1e-dd74-4019-b8e3-8a76f2a92f86 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 40a5b24c-a168-4bdf-b5f8-8211a29d8c9f in use.", "detail": ""}} {{(pid=127017) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 13:42:47.955202 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-a4bb6f1e-dd74-4019-b8e3-8a76f2a92f86 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] HTTP exception thrown: Security Group 40a5b24c-a168-4bdf-b5f8-8211a29d8c9f in use. Oct 17 13:42:47.955202 n-d-854247-14 devstack@n-api.service[127017]: Neutron server returns request_ids: ['req-bac74eda-dc40-40f3-b19a-6d588e407b2b'] Oct 17 13:42:47.957057 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a4bb6f1e-dd74-4019-b8e3-8a76f2a92f86 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Request method failure captured: Oct 17 13:42:47.957057 n-d-854247-14 devstack@n-api.service[127017]: request: DELETE /compute/v2.1/os-security-groups/40a5b24c-a168-4bdf-b5f8-8211a29d8c9f HTTP/1.1 Oct 17 13:42:47.957057 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:42:47.957057 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:42:47.957057 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:42:47.957057 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:42:47.957057 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:42:47.957057 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:42:47.957057 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:42:47.957057 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:42:47.957057 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVtyFGyYtLVdwIq4ccz7RkXRa7NtlbhzSHc2HUbc2jnmH2QeepBwxbKf8toXm_ooPcHi9ET43LtT1AqXtRk9n6taXXPkcxvI9DAvMm-WduwoIrQJqrIBPqw0m6vAgqbSuo42q0EeC3f0tZCzBhE1QaAtaHcB-dTJTCp89NqtuNhDPjU Oct 17 13:42:47.957057 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:42:47.957057 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:42:47.957057 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:42:47.957057 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:42:47.957057 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:42:47.957057 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:42:47.957057 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 50c0147c5fae4017810887843b0afaa0 Oct 17 13:42:47.957057 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-SecurityGroupsTestJSON-1412652742 Oct 17 13:42:47.957057 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:42:47.957057 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:42:47.957057 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/50c0147c5fae4017810887843b0afaa0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/50c0147c5fae4017810887843b0afaa0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/50c0147c5fae4017810887843b0afaa0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_50c0147c5fae4017810887843b0afaa0", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:42:47.957057 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-SecurityGroupsTestJSON-1412652742 Oct 17 13:42:47.957057 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 50c0147c5fae4017810887843b0afaa0 Oct 17 13:42:47.957057 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1412652742 Oct 17 13:42:47.957057 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-SecurityGroupsTestJSON-1412652742-project Oct 17 13:42:47.957057 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:42:47.957057 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:42:47.957057 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 185235bc4e3245fc8d92b7e4bff6cbbd Oct 17 13:42:47.957057 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-SecurityGroupsTestJSON-1412652742-project Oct 17 13:42:47.957057 n-d-854247-14 devstack@n-api.service[127017]: method: Oct 17 13:42:47.957057 n-d-854247-14 devstack@n-api.service[127017]: exception: Security Group 40a5b24c-a168-4bdf-b5f8-8211a29d8c9f in use. Oct 17 13:42:47.957057 n-d-854247-14 devstack@n-api.service[127017]: Neutron server returns request_ids: ['req-bac74eda-dc40-40f3-b19a-6d588e407b2b'] Oct 17 13:42:47.957057 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '40a5b24c-a168-4bdf-b5f8-8211a29d8c9f'} Oct 17 13:42:47.957057 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:42:47.957057 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:47.957057 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 17 13:42:47.957057 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 17 13:42:47.957057 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:47.957057 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:47.957057 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 17 13:42:47.957057 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 17 13:42:47.957057 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:47.957057 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:47.957057 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 17 13:42:47.957057 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 17 13:42:47.957057 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:47.957057 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:47.957057 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 13:42:47.957057 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 13:42:47.957057 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:47.957057 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:47.957057 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 13:42:47.957057 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 13:42:47.957057 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:47.957057 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:47.957057 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 13:42:47.957057 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 13:42:47.957057 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 13:42:47.957057 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 13:42:47.957057 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 40a5b24c-a168-4bdf-b5f8-8211a29d8c9f in use. Oct 17 13:42:47.960124 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bac74eda-dc40-40f3-b19a-6d588e407b2b'] Oct 17 13:42:47.960124 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:42:47.960124 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:47.960124 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:42:47.960124 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:47.960124 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 17 13:42:47.960124 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 17 13:42:47.960124 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 17 13:42:47.960124 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 17 13:42:47.960124 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 40a5b24c-a168-4bdf-b5f8-8211a29d8c9f in use. Oct 17 13:42:47.960124 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bac74eda-dc40-40f3-b19a-6d588e407b2b'] Oct 17 13:42:47.960124 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:42:47.960124 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:47.960124 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:42:47.960124 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:47.960124 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:47.960124 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:47.960124 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:42:47.960124 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:42:47.960124 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:42:47.960124 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:42:47.960124 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:42:47.960124 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:42:47.960124 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 17 13:42:47.960124 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 17 13:42:47.960124 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 40a5b24c-a168-4bdf-b5f8-8211a29d8c9f in use. Oct 17 13:42:47.960124 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bac74eda-dc40-40f3-b19a-6d588e407b2b'] Oct 17 13:42:47.960124 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:42:47.960124 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:47.960124 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:42:47.960124 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:47.960124 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:47.960124 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:47.960124 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:42:47.960124 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:42:47.960124 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 40a5b24c-a168-4bdf-b5f8-8211a29d8c9f in use. Oct 17 13:42:47.960124 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bac74eda-dc40-40f3-b19a-6d588e407b2b'] Oct 17 13:42:47.960124 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:42:47.960124 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a4bb6f1e-dd74-4019-b8e3-8a76f2a92f86 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Returning 400 to user: Security Group 40a5b24c-a168-4bdf-b5f8-8211a29d8c9f in use. Oct 17 13:42:47.960124 n-d-854247-14 devstack@n-api.service[127017]: Neutron server returns request_ids: ['req-bac74eda-dc40-40f3-b19a-6d588e407b2b'] {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:42:47.960124 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a4bb6f1e-dd74-4019-b8e3-8a76f2a92f86 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/40a5b24c-a168-4bdf-b5f8-8211a29d8c9f" status: 400 len: 185 microversion: 2.1 time: 0.919921 Oct 17 13:42:47.960124 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1115/2232] 10.222.0.79 () {58 vars in 1272 bytes} [Mon Oct 17 13:42:47 2022] DELETE /compute/v2.1/os-security-groups/40a5b24c-a168-4bdf-b5f8-8211a29d8c9f => generated 185 bytes in 921 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:42:47.970185 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3ec4085a-5d2d-4751-b3dc-0fc430248500 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:47.978872 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3ec4085a-5d2d-4751-b3dc-0fc430248500 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 240648df-7968-4bbe-ac94-08360eb1049e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:48.001648 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3ec4085a-5d2d-4751-b3dc-0fc430248500 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:48.002147 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3ec4085a-5d2d-4751-b3dc-0fc430248500 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:48.002588 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3ec4085a-5d2d-4751-b3dc-0fc430248500 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:48.012150 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3ec4085a-5d2d-4751-b3dc-0fc430248500 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:48.012792 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3ec4085a-5d2d-4751-b3dc-0fc430248500 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:48.013285 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3ec4085a-5d2d-4751-b3dc-0fc430248500 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:48.192215 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3ec4085a-5d2d-4751-b3dc-0fc430248500 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:48.213486 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3ec4085a-5d2d-4751-b3dc-0fc430248500 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/240648df-7968-4bbe-ac94-08360eb1049e" status: 200 len: 1275 microversion: 2.1 time: 0.252960 Oct 17 13:42:48.225789 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1116/2233] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:47 2022] GET /compute/v2.1/servers/240648df-7968-4bbe-ac94-08360eb1049e => generated 1275 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:48.231054 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-26b2959b-eb25-4d55-aad8-5d84745404e2 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:48.246846 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-26b2959b-eb25-4d55-aad8-5d84745404e2 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] 10.222.0.79 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019667 Oct 17 13:42:48.255504 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1117/2234] 10.222.0.79 () {58 vars in 1137 bytes} [Mon Oct 17 13:42:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:42:48.260659 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8f461f21-9339-43c0-8de4-70a0ded9a697 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:42:48.293333 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8f461f21-9339-43c0-8de4-70a0ded9a697 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] [instance: bc9feeff-1ac7-4267-9351-3f1560dede9b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:48.333667 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8f461f21-9339-43c0-8de4-70a0ded9a697 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:48.334419 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8f461f21-9339-43c0-8de4-70a0ded9a697 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:48.335033 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8f461f21-9339-43c0-8de4-70a0ded9a697 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:48.335959 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8f461f21-9339-43c0-8de4-70a0ded9a697 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:48.340858 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8f461f21-9339-43c0-8de4-70a0ded9a697 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:48.341969 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8f461f21-9339-43c0-8de4-70a0ded9a697 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:48.602040 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8f461f21-9339-43c0-8de4-70a0ded9a697 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "POST /compute/v2.1/servers/bc9feeff-1ac7-4267-9351-3f1560dede9b/action" status: 202 len: 0 microversion: 2.1 time: 0.343055 Oct 17 13:42:48.602757 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1118/2235] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:42:48 2022] POST /compute/v2.1/servers/bc9feeff-1ac7-4267-9351-3f1560dede9b/action => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:42:48.632605 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2c74a784-7b89-4ab5-a736-69b17f473992 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:48.634660 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2c74a784-7b89-4ab5-a736-69b17f473992 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] [instance: 6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:48.660525 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2c74a784-7b89-4ab5-a736-69b17f473992 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:48.666970 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2c74a784-7b89-4ab5-a736-69b17f473992 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:48.670466 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2c74a784-7b89-4ab5-a736-69b17f473992 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:48.674565 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2c74a784-7b89-4ab5-a736-69b17f473992 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:48.676248 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2c74a784-7b89-4ab5-a736-69b17f473992 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:48.677234 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2c74a784-7b89-4ab5-a736-69b17f473992 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:48.806274 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9e869fd9-0546-4fbd-a639-52fd976f43eb tempest-SecurityGroupsNegativeTestJSON-439659532 tempest-SecurityGroupsNegativeTestJSON-439659532-project] 10.222.0.79 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 1.218034 Oct 17 13:42:48.808805 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1118/2236] 10.222.0.79 () {58 vars in 1158 bytes} [Mon Oct 17 13:42:47 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:42:48.815386 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c67f020e-6fc8-471e-bc36-e706b0772db3 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:48.816393 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c67f020e-6fc8-471e-bc36-e706b0772db3 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] [instance: 1088ec60-b26d-4082-bfa8-e01bf9af31f8] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:48.826952 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c67f020e-6fc8-471e-bc36-e706b0772db3 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:48.828052 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c67f020e-6fc8-471e-bc36-e706b0772db3 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:48.828658 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c67f020e-6fc8-471e-bc36-e706b0772db3 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:48.829587 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c67f020e-6fc8-471e-bc36-e706b0772db3 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:48.830445 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c67f020e-6fc8-471e-bc36-e706b0772db3 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:48.831152 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c67f020e-6fc8-471e-bc36-e706b0772db3 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:49.079806 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c67f020e-6fc8-471e-bc36-e706b0772db3 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76e77dade0e441a79c2c4d77993172ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3134826eb154c71bb67718c36ff38cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:49.097363 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c67f020e-6fc8-471e-bc36-e706b0772db3 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] 10.222.0.79 "GET /compute/v2.1/servers/1088ec60-b26d-4082-bfa8-e01bf9af31f8" status: 200 len: 1280 microversion: 2.1 time: 0.286614 Oct 17 13:42:49.098015 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1119/2237] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:48 2022] GET /compute/v2.1/servers/1088ec60-b26d-4082-bfa8-e01bf9af31f8 => generated 1280 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:49.121130 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6d3b6c7b-d4f4-405c-a3a3-332bc4df0bfe tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:49.121882 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6d3b6c7b-d4f4-405c-a3a3-332bc4df0bfe tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] [instance: 95418c39-6c0a-444e-93b4-4a90b31f3034] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:49.138851 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6d3b6c7b-d4f4-405c-a3a3-332bc4df0bfe tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:49.139653 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6d3b6c7b-d4f4-405c-a3a3-332bc4df0bfe tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:49.140770 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6d3b6c7b-d4f4-405c-a3a3-332bc4df0bfe tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:49.141672 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6d3b6c7b-d4f4-405c-a3a3-332bc4df0bfe tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:49.142272 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6d3b6c7b-d4f4-405c-a3a3-332bc4df0bfe tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:49.142841 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6d3b6c7b-d4f4-405c-a3a3-332bc4df0bfe tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:49.206239 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6d3b6c7b-d4f4-405c-a3a3-332bc4df0bfe tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] [instance: 95418c39-6c0a-444e-93b4-4a90b31f3034] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:42:49.391232 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6d3b6c7b-d4f4-405c-a3a3-332bc4df0bfe tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] 10.222.0.79 "DELETE /compute/v2.1/servers/95418c39-6c0a-444e-93b4-4a90b31f3034" status: 204 len: 0 microversion: 2.1 time: 0.275588 Oct 17 13:42:49.392866 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1120/2238] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:42:49 2022] DELETE /compute/v2.1/servers/95418c39-6c0a-444e-93b4-4a90b31f3034 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:42:49.402874 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-56d000b2-7230-4645-a703-87a6a6b0df3f tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:49.404413 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-56d000b2-7230-4645-a703-87a6a6b0df3f tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] [instance: bc9feeff-1ac7-4267-9351-3f1560dede9b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:49.415517 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-56d000b2-7230-4645-a703-87a6a6b0df3f tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:49.416336 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-56d000b2-7230-4645-a703-87a6a6b0df3f tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:49.417337 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-56d000b2-7230-4645-a703-87a6a6b0df3f tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:49.419853 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-56d000b2-7230-4645-a703-87a6a6b0df3f tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:49.420749 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-56d000b2-7230-4645-a703-87a6a6b0df3f tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:49.421326 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-56d000b2-7230-4645-a703-87a6a6b0df3f tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:49.673874 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2c74a784-7b89-4ab5-a736-69b17f473992 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0410e9acbf42ff9f51b096b98d4975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e047e6275b42d6b6d5776ea2121b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:49.688120 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2c74a784-7b89-4ab5-a736-69b17f473992 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] 10.222.0.79 "GET /compute/v2.1/servers/6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37" status: 200 len: 1503 microversion: 2.1 time: 1.069201 Oct 17 13:42:49.689339 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1119/2239] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:48 2022] GET /compute/v2.1/servers/6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37 => generated 1503 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:49.701429 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7dce2c1d-b201-4705-b454-eac893a22893 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1606334217", "imageRef": "fd642abf-fc45-4a61-89a6-6834500debb5", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "b0fab2c7-27a1-419c-a90e-dfe698f7157d"}], "security_groups": [{"name": "tempest-securitygroup--1528157978"}], "key_name": "tempest-keypair-1101982132", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:42:50.091455 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-7dce2c1d-b201-4705-b454-eac893a22893 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] validate_networks() for [('b0fab2c7-27a1-419c-a90e-dfe698f7157d', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:42:50.316940 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-56d000b2-7230-4645-a703-87a6a6b0df3f tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185235bc4e3245fc8d92b7e4bff6cbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c0147c5fae4017810887843b0afaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:50.329282 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-56d000b2-7230-4645-a703-87a6a6b0df3f tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "GET /compute/v2.1/servers/bc9feeff-1ac7-4267-9351-3f1560dede9b" status: 200 len: 1573 microversion: 2.1 time: 0.934077 Oct 17 13:42:50.329971 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1121/2240] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:49 2022] GET /compute/v2.1/servers/bc9feeff-1ac7-4267-9351-3f1560dede9b => generated 1573 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:50.345154 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-87e1d591-274a-410f-a4e5-2b6a1453398a tempest-SecurityGroupsNegativeTestJSON-439659532 tempest-SecurityGroupsNegativeTestJSON-439659532-project] Calling method '.version_select at 0x7f7cd5404430>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:50.943666 n-d-854247-14 devstack@n-api.service[127016]: DEBUG neutronclient.v2_0.client [None req-87e1d591-274a-410f-a4e5-2b6a1453398a tempest-SecurityGroupsNegativeTestJSON-439659532 tempest-SecurityGroupsNegativeTestJSON-439659532-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=127016) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 13:42:50.944360 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-87e1d591-274a-410f-a4e5-2b6a1453398a tempest-SecurityGroupsNegativeTestJSON-439659532 tempest-SecurityGroupsNegativeTestJSON-439659532-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 17 13:42:50.944360 n-d-854247-14 devstack@n-api.service[127016]: Neutron server returns request_ids: ['req-49475723-79da-43cb-b7ff-4cc09863f990'] Oct 17 13:42:50.946696 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-87e1d591-274a-410f-a4e5-2b6a1453398a tempest-SecurityGroupsNegativeTestJSON-439659532 tempest-SecurityGroupsNegativeTestJSON-439659532-project] Request method failure captured: Oct 17 13:42:50.946696 n-d-854247-14 devstack@n-api.service[127016]: request: DELETE /compute/v2.1/os-security-groups/74021158-0eb1-4bfc-ba74-2c8e98c65709 HTTP/1.1 Oct 17 13:42:50.946696 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:42:50.946696 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:42:50.946696 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:42:50.946696 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:42:50.946696 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:42:50.946696 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:42:50.946696 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:42:50.946696 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:42:50.946696 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVvTVKhNCTBB0QZXZEcfXkPEeTmPRUEzACJorzgxqdLosNZE4SsUn2uFLX0kyGkgCSKJM-seutI2AVB7KY2NMGoAH3AirJ4_FaAmmroAvVwizQVslXi8PG72S_csSO3xZLFvvDkKUbf4ch0UXSyp7Y1HdFcHsrV7X0GaNXDCbRpncpg Oct 17 13:42:50.946696 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:42:50.946696 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:42:50.946696 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:42:50.946696 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:42:50.946696 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:42:50.946696 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:42:50.946696 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: d282c8b0483c49f38ddb5165378a0c9d Oct 17 13:42:50.946696 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-439659532 Oct 17 13:42:50.946696 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:42:50.946696 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:42:50.946696 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d282c8b0483c49f38ddb5165378a0c9d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d282c8b0483c49f38ddb5165378a0c9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d282c8b0483c49f38ddb5165378a0c9d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d282c8b0483c49f38ddb5165378a0c9d", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:42:50.946696 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-439659532 Oct 17 13:42:50.946696 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: d282c8b0483c49f38ddb5165378a0c9d Oct 17 13:42:50.946696 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-439659532 Oct 17 13:42:50.946696 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-SecurityGroupsNegativeTestJSON-439659532-project Oct 17 13:42:50.946696 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:42:50.946696 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:42:50.946696 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 2c8a454eea284d67b12c57332203d0e8 Oct 17 13:42:50.946696 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-439659532-project Oct 17 13:42:50.946696 n-d-854247-14 devstack@n-api.service[127016]: method: Oct 17 13:42:50.946696 n-d-854247-14 devstack@n-api.service[127016]: exception: Insufficient rights for removing default security group. Oct 17 13:42:50.946696 n-d-854247-14 devstack@n-api.service[127016]: Neutron server returns request_ids: ['req-49475723-79da-43cb-b7ff-4cc09863f990'] Oct 17 13:42:50.946696 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '74021158-0eb1-4bfc-ba74-2c8e98c65709'} Oct 17 13:42:50.946696 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:42:50.946696 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:50.946696 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 17 13:42:50.946696 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 17 13:42:50.946696 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:50.946696 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:50.946696 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 17 13:42:50.946696 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 17 13:42:50.946696 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:50.946696 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:50.946696 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 17 13:42:50.946696 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 17 13:42:50.946696 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:50.946696 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:50.946696 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 13:42:50.946696 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 13:42:50.946696 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:50.946696 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:50.946696 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 13:42:50.946696 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 13:42:50.946696 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:50.946696 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:50.946696 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 13:42:50.946696 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 13:42:50.946696 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 13:42:50.946696 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 13:42:50.946696 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 17 13:42:50.950340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-49475723-79da-43cb-b7ff-4cc09863f990'] Oct 17 13:42:50.950340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:50.950340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:50.950340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:50.950340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:50.950340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 17 13:42:50.950340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 17 13:42:50.950340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 17 13:42:50.950340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 17 13:42:50.950340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 17 13:42:50.950340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-49475723-79da-43cb-b7ff-4cc09863f990'] Oct 17 13:42:50.950340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:50.950340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:50.950340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:50.950340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:50.950340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:50.950340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:50.950340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:42:50.950340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:42:50.950340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:42:50.950340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:42:50.950340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:42:50.950340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:42:50.950340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 17 13:42:50.950340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 17 13:42:50.950340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 17 13:42:50.950340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-49475723-79da-43cb-b7ff-4cc09863f990'] Oct 17 13:42:50.950340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:50.950340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:50.950340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:50.950340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:50.950340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:50.950340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:50.950340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:42:50.950340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:42:50.950340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 17 13:42:50.950340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-49475723-79da-43cb-b7ff-4cc09863f990'] Oct 17 13:42:50.950340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:50.950340 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-87e1d591-274a-410f-a4e5-2b6a1453398a tempest-SecurityGroupsNegativeTestJSON-439659532 tempest-SecurityGroupsNegativeTestJSON-439659532-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 17 13:42:50.950340 n-d-854247-14 devstack@n-api.service[127016]: Neutron server returns request_ids: ['req-49475723-79da-43cb-b7ff-4cc09863f990'] {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:42:50.950340 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-87e1d591-274a-410f-a4e5-2b6a1453398a tempest-SecurityGroupsNegativeTestJSON-439659532 tempest-SecurityGroupsNegativeTestJSON-439659532-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/74021158-0eb1-4bfc-ba74-2c8e98c65709" status: 400 len: 182 microversion: 2.1 time: 0.617902 Oct 17 13:42:50.950340 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1122/2241] 10.222.0.79 () {58 vars in 1272 bytes} [Mon Oct 17 13:42:50 2022] DELETE /compute/v2.1/os-security-groups/74021158-0eb1-4bfc-ba74-2c8e98c65709 => generated 182 bytes in 619 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:42:50.963932 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-67de8952-5e67-4de5-8bff-eb44fb7437d6 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:50.967080 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-67de8952-5e67-4de5-8bff-eb44fb7437d6 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 240648df-7968-4bbe-ac94-08360eb1049e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:50.975926 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-67de8952-5e67-4de5-8bff-eb44fb7437d6 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:50.978132 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-67de8952-5e67-4de5-8bff-eb44fb7437d6 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:50.978784 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-67de8952-5e67-4de5-8bff-eb44fb7437d6 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:50.979874 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-67de8952-5e67-4de5-8bff-eb44fb7437d6 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:50.980662 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-67de8952-5e67-4de5-8bff-eb44fb7437d6 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:50.981296 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-67de8952-5e67-4de5-8bff-eb44fb7437d6 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:51.396076 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-67de8952-5e67-4de5-8bff-eb44fb7437d6 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:51.408870 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-67de8952-5e67-4de5-8bff-eb44fb7437d6 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/240648df-7968-4bbe-ac94-08360eb1049e" status: 200 len: 1317 microversion: 2.1 time: 0.457453 Oct 17 13:42:51.409761 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1123/2242] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:50 2022] GET /compute/v2.1/servers/240648df-7968-4bbe-ac94-08360eb1049e => generated 1317 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:51.421917 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8ad798b2-df67-4913-81e4-18e45fd2793f tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:51.422626 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8ad798b2-df67-4913-81e4-18e45fd2793f tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] [instance: 95418c39-6c0a-444e-93b4-4a90b31f3034] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:51.434449 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8ad798b2-df67-4913-81e4-18e45fd2793f tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:51.434952 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8ad798b2-df67-4913-81e4-18e45fd2793f tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:51.435432 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8ad798b2-df67-4913-81e4-18e45fd2793f tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:51.441297 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8ad798b2-df67-4913-81e4-18e45fd2793f tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:51.441784 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8ad798b2-df67-4913-81e4-18e45fd2793f tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:51.442222 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8ad798b2-df67-4913-81e4-18e45fd2793f tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:52.282430 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-7dce2c1d-b201-4705-b454-eac893a22893 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:42:52.284575 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-7dce2c1d-b201-4705-b454-eac893a22893 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:42:52.285604 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-7dce2c1d-b201-4705-b454-eac893a22893 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:42:52.286573 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-7dce2c1d-b201-4705-b454-eac893a22893 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:42:52.288423 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-7dce2c1d-b201-4705-b454-eac893a22893 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:42:52.308060 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7dce2c1d-b201-4705-b454-eac893a22893 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:52.309814 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7dce2c1d-b201-4705-b454-eac893a22893 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:52.311249 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7dce2c1d-b201-4705-b454-eac893a22893 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:52.312306 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7dce2c1d-b201-4705-b454-eac893a22893 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:52.312973 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7dce2c1d-b201-4705-b454-eac893a22893 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:52.316898 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7dce2c1d-b201-4705-b454-eac893a22893 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:52.341531 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-7dce2c1d-b201-4705-b454-eac893a22893 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Getting quotas for project 5bb50742d06f403598634414befbeb12. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:42:52.349265 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-7dce2c1d-b201-4705-b454-eac893a22893 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Getting quotas for user 799d72ccad514fd899d21809d613249b and project 5bb50742d06f403598634414befbeb12. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:42:52.363113 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8ad798b2-df67-4913-81e4-18e45fd2793f tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b891d3b774e44de3ad1d3088990f6bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358604dd1cf74e5fab262179351d4d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:52.377620 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7dce2c1d-b201-4705-b454-eac893a22893 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:42:52.379819 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8ad798b2-df67-4913-81e4-18e45fd2793f tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] 10.222.0.79 "GET /compute/v2.1/servers/95418c39-6c0a-444e-93b4-4a90b31f3034" status: 200 len: 1713 microversion: 2.1 time: 0.969011 Oct 17 13:42:52.380014 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7dce2c1d-b201-4705-b454-eac893a22893 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] [instance: 2184ae8f-022d-4de9-8d0f-0c2d546c9d6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fd642abf-fc45-4a61-89a6-6834500debb5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:42:52.386326 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1124/2243] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:51 2022] GET /compute/v2.1/servers/95418c39-6c0a-444e-93b4-4a90b31f3034 => generated 1713 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:52.399589 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-972ba2f9-352d-4f01-aff0-e1cd1eaac6a1 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:52.402631 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-972ba2f9-352d-4f01-aff0-e1cd1eaac6a1 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] [instance: 6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:52.435484 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-972ba2f9-352d-4f01-aff0-e1cd1eaac6a1 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:52.437819 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-972ba2f9-352d-4f01-aff0-e1cd1eaac6a1 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:52.439521 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-972ba2f9-352d-4f01-aff0-e1cd1eaac6a1 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:52.440828 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-972ba2f9-352d-4f01-aff0-e1cd1eaac6a1 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:52.446375 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-972ba2f9-352d-4f01-aff0-e1cd1eaac6a1 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:52.449390 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-972ba2f9-352d-4f01-aff0-e1cd1eaac6a1 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:52.481767 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7dce2c1d-b201-4705-b454-eac893a22893 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.790797 Oct 17 13:42:52.482991 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1120/2244] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:42:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 2793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:42:52.488086 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e645c034-8c90-427b-8fa5-6178664bfaed tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:52.491392 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e645c034-8c90-427b-8fa5-6178664bfaed tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] [instance: 1088ec60-b26d-4082-bfa8-e01bf9af31f8] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:52.498661 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e645c034-8c90-427b-8fa5-6178664bfaed tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:52.499626 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e645c034-8c90-427b-8fa5-6178664bfaed tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:52.500278 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e645c034-8c90-427b-8fa5-6178664bfaed tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:52.501151 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e645c034-8c90-427b-8fa5-6178664bfaed tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:52.501770 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e645c034-8c90-427b-8fa5-6178664bfaed tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:52.502878 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e645c034-8c90-427b-8fa5-6178664bfaed tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:52.573555 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-972ba2f9-352d-4f01-aff0-e1cd1eaac6a1 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] [instance: 6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:42:52.794569 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-972ba2f9-352d-4f01-aff0-e1cd1eaac6a1 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] 10.222.0.79 "DELETE /compute/v2.1/servers/6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37" status: 204 len: 0 microversion: 2.1 time: 0.406171 Oct 17 13:42:52.795189 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1125/2245] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:42:52 2022] DELETE /compute/v2.1/servers/6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:42:52.802793 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-20ccab99-53a4-46f0-98e7-234fa9f01787 tempest-SecurityGroupsNegativeTestJSON-439659532 tempest-SecurityGroupsNegativeTestJSON-439659532-project] Calling method '.version_select at 0x7f7cd59a11f0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:52.967017 n-d-854247-14 devstack@n-api.service[127016]: DEBUG neutronclient.v2_0.client [None req-20ccab99-53a4-46f0-98e7-234fa9f01787 tempest-SecurityGroupsNegativeTestJSON-439659532 tempest-SecurityGroupsNegativeTestJSON-439659532-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 68a71eca-9616-4765-ab47-25cf5e28892a does not exist", "detail": ""}} {{(pid=127016) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 13:42:52.967699 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.security_group_api [None req-20ccab99-53a4-46f0-98e7-234fa9f01787 tempest-SecurityGroupsNegativeTestJSON-439659532 tempest-SecurityGroupsNegativeTestJSON-439659532-project] Neutron security group 68a71eca-9616-4765-ab47-25cf5e28892a not found {{(pid=127016) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 17 13:42:52.968279 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-20ccab99-53a4-46f0-98e7-234fa9f01787 tempest-SecurityGroupsNegativeTestJSON-439659532 tempest-SecurityGroupsNegativeTestJSON-439659532-project] HTTP exception thrown: Security group 68a71eca-9616-4765-ab47-25cf5e28892a does not exist Oct 17 13:42:52.968279 n-d-854247-14 devstack@n-api.service[127016]: Neutron server returns request_ids: ['req-3d04f6b7-503f-409a-97a7-2747bfc52738'] Oct 17 13:42:52.970376 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-20ccab99-53a4-46f0-98e7-234fa9f01787 tempest-SecurityGroupsNegativeTestJSON-439659532 tempest-SecurityGroupsNegativeTestJSON-439659532-project] Request method failure captured: Oct 17 13:42:52.970376 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/os-security-groups/68a71eca-9616-4765-ab47-25cf5e28892a HTTP/1.1 Oct 17 13:42:52.970376 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:42:52.970376 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:42:52.970376 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:42:52.970376 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:42:52.970376 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:42:52.970376 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:42:52.970376 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:42:52.970376 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:42:52.970376 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVvTVKhNCTBB0QZXZEcfXkPEeTmPRUEzACJorzgxqdLosNZE4SsUn2uFLX0kyGkgCSKJM-seutI2AVB7KY2NMGoAH3AirJ4_FaAmmroAvVwizQVslXi8PG72S_csSO3xZLFvvDkKUbf4ch0UXSyp7Y1HdFcHsrV7X0GaNXDCbRpncpg Oct 17 13:42:52.970376 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:42:52.970376 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:42:52.970376 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:42:52.970376 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:42:52.970376 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:42:52.970376 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:42:52.970376 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: d282c8b0483c49f38ddb5165378a0c9d Oct 17 13:42:52.970376 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-439659532 Oct 17 13:42:52.970376 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:42:52.970376 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:42:52.970376 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d282c8b0483c49f38ddb5165378a0c9d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d282c8b0483c49f38ddb5165378a0c9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d282c8b0483c49f38ddb5165378a0c9d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d282c8b0483c49f38ddb5165378a0c9d", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:42:52.970376 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-439659532 Oct 17 13:42:52.970376 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: d282c8b0483c49f38ddb5165378a0c9d Oct 17 13:42:52.970376 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-439659532 Oct 17 13:42:52.970376 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-SecurityGroupsNegativeTestJSON-439659532-project Oct 17 13:42:52.970376 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:42:52.970376 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:42:52.970376 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 2c8a454eea284d67b12c57332203d0e8 Oct 17 13:42:52.970376 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-439659532-project Oct 17 13:42:52.970376 n-d-854247-14 devstack@n-api.service[127016]: method: Oct 17 13:42:52.970376 n-d-854247-14 devstack@n-api.service[127016]: exception: Security group 68a71eca-9616-4765-ab47-25cf5e28892a does not exist Oct 17 13:42:52.970376 n-d-854247-14 devstack@n-api.service[127016]: Neutron server returns request_ids: ['req-3d04f6b7-503f-409a-97a7-2747bfc52738'] Oct 17 13:42:52.970376 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '68a71eca-9616-4765-ab47-25cf5e28892a'} Oct 17 13:42:52.970376 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:42:52.970376 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:52.970376 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 17 13:42:52.970376 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 17 13:42:52.970376 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:52.970376 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:52.970376 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 17 13:42:52.970376 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 17 13:42:52.970376 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:52.970376 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:52.970376 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 13:42:52.970376 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 13:42:52.970376 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:52.970376 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:52.970376 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 13:42:52.970376 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 13:42:52.970376 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:52.970376 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:52.970376 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 13:42:52.970376 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 13:42:52.970376 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:52.970376 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:52.970376 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 13:42:52.970376 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 13:42:52.970376 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 13:42:52.970376 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 13:42:52.970376 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 68a71eca-9616-4765-ab47-25cf5e28892a does not exist Oct 17 13:42:52.974046 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3d04f6b7-503f-409a-97a7-2747bfc52738'] Oct 17 13:42:52.974046 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:52.974046 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:52.974046 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:52.974046 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:52.974046 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 17 13:42:52.974046 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 17 13:42:52.974046 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 17 13:42:52.974046 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 13:42:52.974046 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 68a71eca-9616-4765-ab47-25cf5e28892a does not exist Oct 17 13:42:52.974046 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3d04f6b7-503f-409a-97a7-2747bfc52738'] Oct 17 13:42:52.974046 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:52.974046 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:52.974046 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:52.974046 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:52.974046 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:52.974046 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:52.974046 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:42:52.974046 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:42:52.974046 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:42:52.974046 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:42:52.974046 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:42:52.974046 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:42:52.974046 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 17 13:42:52.974046 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 17 13:42:52.974046 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 68a71eca-9616-4765-ab47-25cf5e28892a does not exist Oct 17 13:42:52.974046 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3d04f6b7-503f-409a-97a7-2747bfc52738'] Oct 17 13:42:52.974046 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:52.974046 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:52.974046 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:52.974046 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:52.974046 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:52.974046 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:52.974046 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:42:52.974046 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:42:52.974046 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 68a71eca-9616-4765-ab47-25cf5e28892a does not exist Oct 17 13:42:52.974046 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3d04f6b7-503f-409a-97a7-2747bfc52738'] Oct 17 13:42:52.974046 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:52.974046 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-20ccab99-53a4-46f0-98e7-234fa9f01787 tempest-SecurityGroupsNegativeTestJSON-439659532 tempest-SecurityGroupsNegativeTestJSON-439659532-project] Returning 404 to user: Security group 68a71eca-9616-4765-ab47-25cf5e28892a does not exist Oct 17 13:42:52.974046 n-d-854247-14 devstack@n-api.service[127016]: Neutron server returns request_ids: ['req-3d04f6b7-503f-409a-97a7-2747bfc52738'] {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:42:52.974046 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-20ccab99-53a4-46f0-98e7-234fa9f01787 tempest-SecurityGroupsNegativeTestJSON-439659532 tempest-SecurityGroupsNegativeTestJSON-439659532-project] 10.222.0.79 "GET /compute/v2.1/os-security-groups/68a71eca-9616-4765-ab47-25cf5e28892a" status: 404 len: 194 microversion: 2.1 time: 0.175157 Oct 17 13:42:52.978159 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1126/2246] 10.222.0.79 () {58 vars in 1269 bytes} [Mon Oct 17 13:42:52 2022] GET /compute/v2.1/os-security-groups/68a71eca-9616-4765-ab47-25cf5e28892a => generated 194 bytes in 182 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:42:52.984113 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-87e23ddd-aa70-48dc-9c58-d36cff819779 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:52.986119 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-87e23ddd-aa70-48dc-9c58-d36cff819779 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] [instance: bc9feeff-1ac7-4267-9351-3f1560dede9b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:52.993076 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-87e23ddd-aa70-48dc-9c58-d36cff819779 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:52.993569 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-87e23ddd-aa70-48dc-9c58-d36cff819779 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:52.994305 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-87e23ddd-aa70-48dc-9c58-d36cff819779 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:52.995025 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-87e23ddd-aa70-48dc-9c58-d36cff819779 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:52.995568 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-87e23ddd-aa70-48dc-9c58-d36cff819779 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:52.996373 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-87e23ddd-aa70-48dc-9c58-d36cff819779 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:53.053904 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e645c034-8c90-427b-8fa5-6178664bfaed tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76e77dade0e441a79c2c4d77993172ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3134826eb154c71bb67718c36ff38cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:53.080020 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e645c034-8c90-427b-8fa5-6178664bfaed tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] 10.222.0.79 "GET /compute/v2.1/servers/1088ec60-b26d-4082-bfa8-e01bf9af31f8" status: 200 len: 1322 microversion: 2.1 time: 0.595273 Oct 17 13:42:53.080584 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1121/2247] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:52 2022] GET /compute/v2.1/servers/1088ec60-b26d-4082-bfa8-e01bf9af31f8 => generated 1322 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:53.110770 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e40cfe1d-213c-4b4d-bc6f-96fdcda7ec56 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:53.113069 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e40cfe1d-213c-4b4d-bc6f-96fdcda7ec56 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 240648df-7968-4bbe-ac94-08360eb1049e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:53.132738 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e40cfe1d-213c-4b4d-bc6f-96fdcda7ec56 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:53.133314 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e40cfe1d-213c-4b4d-bc6f-96fdcda7ec56 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:53.139142 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e40cfe1d-213c-4b4d-bc6f-96fdcda7ec56 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:53.140080 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e40cfe1d-213c-4b4d-bc6f-96fdcda7ec56 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:53.140936 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e40cfe1d-213c-4b4d-bc6f-96fdcda7ec56 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:53.141568 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e40cfe1d-213c-4b4d-bc6f-96fdcda7ec56 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:53.729136 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-87e23ddd-aa70-48dc-9c58-d36cff819779 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185235bc4e3245fc8d92b7e4bff6cbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c0147c5fae4017810887843b0afaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:53.740526 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-87e23ddd-aa70-48dc-9c58-d36cff819779 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "GET /compute/v2.1/servers/bc9feeff-1ac7-4267-9351-3f1560dede9b" status: 200 len: 1571 microversion: 2.1 time: 0.759856 Oct 17 13:42:53.742295 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1127/2248] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:52 2022] GET /compute/v2.1/servers/bc9feeff-1ac7-4267-9351-3f1560dede9b => generated 1571 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:53.746772 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e40cfe1d-213c-4b4d-bc6f-96fdcda7ec56 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:53.748491 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fab860a0-a60c-449b-b94b-8f8b7098c5ab tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:53.749605 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-fab860a0-a60c-449b-b94b-8f8b7098c5ab tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] [instance: 2184ae8f-022d-4de9-8d0f-0c2d546c9d6f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:53.754709 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e40cfe1d-213c-4b4d-bc6f-96fdcda7ec56 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/240648df-7968-4bbe-ac94-08360eb1049e" status: 200 len: 1317 microversion: 2.1 time: 0.669049 Oct 17 13:42:53.757395 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fab860a0-a60c-449b-b94b-8f8b7098c5ab tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:53.758104 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fab860a0-a60c-449b-b94b-8f8b7098c5ab tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:53.758739 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fab860a0-a60c-449b-b94b-8f8b7098c5ab tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:53.759770 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fab860a0-a60c-449b-b94b-8f8b7098c5ab tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:53.760447 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fab860a0-a60c-449b-b94b-8f8b7098c5ab tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:53.761101 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fab860a0-a60c-449b-b94b-8f8b7098c5ab tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:53.779565 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1122/2249] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:53 2022] GET /compute/v2.1/servers/240648df-7968-4bbe-ac94-08360eb1049e => generated 1317 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:53.785512 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f538635d-a4ce-4b33-9ac2-f781fb5bcbc4 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:53.786324 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f538635d-a4ce-4b33-9ac2-f781fb5bcbc4 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] [instance: 6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:53.787681 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:42:53.799416 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f538635d-a4ce-4b33-9ac2-f781fb5bcbc4 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:53.800139 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f538635d-a4ce-4b33-9ac2-f781fb5bcbc4 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:53.800788 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f538635d-a4ce-4b33-9ac2-f781fb5bcbc4 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:53.801466 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f538635d-a4ce-4b33-9ac2-f781fb5bcbc4 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:53.801915 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f538635d-a4ce-4b33-9ac2-f781fb5bcbc4 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:53.802380 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f538635d-a4ce-4b33-9ac2-f781fb5bcbc4 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:54.012929 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fab860a0-a60c-449b-b94b-8f8b7098c5ab tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799d72ccad514fd899d21809d613249b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb50742d06f403598634414befbeb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:54.027602 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fab860a0-a60c-449b-b94b-8f8b7098c5ab tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] 10.222.0.79 "GET /compute/v2.1/servers/2184ae8f-022d-4de9-8d0f-0c2d546c9d6f" status: 200 len: 1250 microversion: 2.1 time: 0.283480 Oct 17 13:42:54.028787 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1128/2250] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:53 2022] GET /compute/v2.1/servers/2184ae8f-022d-4de9-8d0f-0c2d546c9d6f => generated 1250 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:54.033680 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0c0999da-916d-44da-a3ea-b75ab31d7dab tempest-SecurityGroupsNegativeTestJSON-439659532 tempest-SecurityGroupsNegativeTestJSON-439659532-project] Action: 'update', calling method: .version_select at 0x7f7cd98e24c0>, body: {"security_group": {"name": "tempest-sg-1314840807", "description": "tempest-description-1521694427"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:42:54.174275 n-d-854247-14 devstack@n-api.service[127016]: DEBUG neutronclient.v2_0.client [None req-0c0999da-916d-44da-a3ea-b75ab31d7dab tempest-SecurityGroupsNegativeTestJSON-439659532 tempest-SecurityGroupsNegativeTestJSON-439659532-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b39695ac-81bd-4300-a4db-68d10d3a4ce4 does not exist", "detail": ""}} {{(pid=127016) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 13:42:54.175731 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.security_group_api [None req-0c0999da-916d-44da-a3ea-b75ab31d7dab tempest-SecurityGroupsNegativeTestJSON-439659532 tempest-SecurityGroupsNegativeTestJSON-439659532-project] Neutron security group b39695ac-81bd-4300-a4db-68d10d3a4ce4 not found {{(pid=127016) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 17 13:42:54.176464 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-0c0999da-916d-44da-a3ea-b75ab31d7dab tempest-SecurityGroupsNegativeTestJSON-439659532 tempest-SecurityGroupsNegativeTestJSON-439659532-project] HTTP exception thrown: Security group b39695ac-81bd-4300-a4db-68d10d3a4ce4 does not exist Oct 17 13:42:54.176464 n-d-854247-14 devstack@n-api.service[127016]: Neutron server returns request_ids: ['req-01aac2fb-c4e5-48dc-967b-6b2285f9abfe'] Oct 17 13:42:54.178619 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0c0999da-916d-44da-a3ea-b75ab31d7dab tempest-SecurityGroupsNegativeTestJSON-439659532 tempest-SecurityGroupsNegativeTestJSON-439659532-project] Request method failure captured: Oct 17 13:42:54.178619 n-d-854247-14 devstack@n-api.service[127016]: request: PUT /compute/v2.1/os-security-groups/b39695ac-81bd-4300-a4db-68d10d3a4ce4 HTTP/1.1 Oct 17 13:42:54.178619 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:42:54.178619 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:42:54.178619 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:42:54.178619 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 102 Oct 17 13:42:54.178619 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:42:54.178619 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:42:54.178619 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:42:54.178619 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:42:54.178619 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVvTVKhNCTBB0QZXZEcfXkPEeTmPRUEzACJorzgxqdLosNZE4SsUn2uFLX0kyGkgCSKJM-seutI2AVB7KY2NMGoAH3AirJ4_FaAmmroAvVwizQVslXi8PG72S_csSO3xZLFvvDkKUbf4ch0UXSyp7Y1HdFcHsrV7X0GaNXDCbRpncpg Oct 17 13:42:54.178619 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:42:54.178619 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:42:54.178619 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:42:54.178619 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:42:54.178619 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:42:54.178619 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:42:54.178619 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: d282c8b0483c49f38ddb5165378a0c9d Oct 17 13:42:54.178619 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-439659532 Oct 17 13:42:54.178619 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:42:54.178619 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:42:54.178619 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d282c8b0483c49f38ddb5165378a0c9d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d282c8b0483c49f38ddb5165378a0c9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d282c8b0483c49f38ddb5165378a0c9d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d282c8b0483c49f38ddb5165378a0c9d", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:42:54.178619 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-439659532 Oct 17 13:42:54.178619 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: d282c8b0483c49f38ddb5165378a0c9d Oct 17 13:42:54.178619 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-439659532 Oct 17 13:42:54.178619 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-SecurityGroupsNegativeTestJSON-439659532-project Oct 17 13:42:54.178619 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:42:54.178619 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:42:54.178619 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 2c8a454eea284d67b12c57332203d0e8 Oct 17 13:42:54.178619 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-439659532-project Oct 17 13:42:54.178619 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:42:54.178619 n-d-854247-14 devstack@n-api.service[127016]: {"security_group": {"name": "tempest-sg-1314840807", "description": "tempest-description-1521694427"}} Oct 17 13:42:54.178619 n-d-854247-14 devstack@n-api.service[127016]: method: Oct 17 13:42:54.178619 n-d-854247-14 devstack@n-api.service[127016]: exception: Security group b39695ac-81bd-4300-a4db-68d10d3a4ce4 does not exist Oct 17 13:42:54.178619 n-d-854247-14 devstack@n-api.service[127016]: Neutron server returns request_ids: ['req-01aac2fb-c4e5-48dc-967b-6b2285f9abfe'] Oct 17 13:42:54.178619 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'b39695ac-81bd-4300-a4db-68d10d3a4ce4', 'body': {'security_group': {'name': 'tempest-sg-1314840807', 'description': 'tempest-description-1521694427'}}} Oct 17 13:42:54.178619 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:42:54.178619 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:54.178619 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 17 13:42:54.178619 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 17 13:42:54.178619 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:54.178619 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:54.178619 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 17 13:42:54.178619 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 17 13:42:54.178619 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:54.178619 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:54.178619 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 13:42:54.178619 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 13:42:54.178619 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:54.178619 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:54.178619 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 13:42:54.178619 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 13:42:54.178619 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:54.178619 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:54.178619 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 13:42:54.178619 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 13:42:54.178619 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:54.178619 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:54.178619 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 13:42:54.178619 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 13:42:54.178619 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 13:42:54.182039 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 13:42:54.182039 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b39695ac-81bd-4300-a4db-68d10d3a4ce4 does not exist Oct 17 13:42:54.182039 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-01aac2fb-c4e5-48dc-967b-6b2285f9abfe'] Oct 17 13:42:54.182039 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:54.182039 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:54.182039 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:54.182039 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:54.182039 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 17 13:42:54.182039 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 17 13:42:54.182039 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 17 13:42:54.182039 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 13:42:54.182039 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b39695ac-81bd-4300-a4db-68d10d3a4ce4 does not exist Oct 17 13:42:54.182039 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-01aac2fb-c4e5-48dc-967b-6b2285f9abfe'] Oct 17 13:42:54.182039 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:54.182039 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:54.182039 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:54.182039 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:54.182039 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:54.182039 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:54.182039 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:42:54.182039 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:42:54.182039 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:42:54.182039 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:42:54.182039 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:42:54.182039 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:42:54.182039 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 17 13:42:54.182039 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 17 13:42:54.182039 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b39695ac-81bd-4300-a4db-68d10d3a4ce4 does not exist Oct 17 13:42:54.182039 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-01aac2fb-c4e5-48dc-967b-6b2285f9abfe'] Oct 17 13:42:54.182039 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:54.182039 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:54.182039 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:54.182039 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:54.182039 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:54.182039 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:54.182039 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:42:54.182039 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:42:54.182039 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b39695ac-81bd-4300-a4db-68d10d3a4ce4 does not exist Oct 17 13:42:54.182039 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-01aac2fb-c4e5-48dc-967b-6b2285f9abfe'] Oct 17 13:42:54.182039 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:54.186187 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0c0999da-916d-44da-a3ea-b75ab31d7dab tempest-SecurityGroupsNegativeTestJSON-439659532 tempest-SecurityGroupsNegativeTestJSON-439659532-project] Returning 404 to user: Security group b39695ac-81bd-4300-a4db-68d10d3a4ce4 does not exist Oct 17 13:42:54.186187 n-d-854247-14 devstack@n-api.service[127016]: Neutron server returns request_ids: ['req-01aac2fb-c4e5-48dc-967b-6b2285f9abfe'] {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:42:54.187439 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0c0999da-916d-44da-a3ea-b75ab31d7dab tempest-SecurityGroupsNegativeTestJSON-439659532 tempest-SecurityGroupsNegativeTestJSON-439659532-project] 10.222.0.79 "PUT /compute/v2.1/os-security-groups/b39695ac-81bd-4300-a4db-68d10d3a4ce4" status: 404 len: 194 microversion: 2.1 time: 0.157477 Oct 17 13:42:54.188535 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1129/2251] 10.222.0.79 () {60 vars in 1290 bytes} [Mon Oct 17 13:42:54 2022] PUT /compute/v2.1/os-security-groups/b39695ac-81bd-4300-a4db-68d10d3a4ce4 => generated 194 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:42:54.200592 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-badc0a98-405e-4bb1-8939-d15e85135fbc req-45cbda35-0c95-466f-8660-e8666652651b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95418c39-6c0a-444e-93b4-4a90b31f3034", "name": "network-vif-deleted", "tag": "6ebf3968-13ef-4f4d-8666-1d89782149bf"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:42:54.214368 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-badc0a98-405e-4bb1-8939-d15e85135fbc req-45cbda35-0c95-466f-8660-e8666652651b service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:54.216225 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-badc0a98-405e-4bb1-8939-d15e85135fbc req-45cbda35-0c95-466f-8660-e8666652651b service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:54.220514 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-badc0a98-405e-4bb1-8939-d15e85135fbc req-45cbda35-0c95-466f-8660-e8666652651b service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:54.236525 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-badc0a98-405e-4bb1-8939-d15e85135fbc req-45cbda35-0c95-466f-8660-e8666652651b service nova] Creating event network-vif-deleted:6ebf3968-13ef-4f4d-8666-1d89782149bf for instance 95418c39-6c0a-444e-93b4-4a90b31f3034 on n-h1-854247-14 Oct 17 13:42:54.249199 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-badc0a98-405e-4bb1-8939-d15e85135fbc req-45cbda35-0c95-466f-8660-e8666652651b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052468 Oct 17 13:42:54.250505 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1130/2252] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:42:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:42:54.256532 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-24bc473e-8a62-4d53-8686-8567cf4f87a6 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:54.257480 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-24bc473e-8a62-4d53-8686-8567cf4f87a6 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] [instance: 95418c39-6c0a-444e-93b4-4a90b31f3034] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:54.269083 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-24bc473e-8a62-4d53-8686-8567cf4f87a6 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:54.269992 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-24bc473e-8a62-4d53-8686-8567cf4f87a6 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:54.270641 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-24bc473e-8a62-4d53-8686-8567cf4f87a6 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:54.271946 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-24bc473e-8a62-4d53-8686-8567cf4f87a6 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:54.282313 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-24bc473e-8a62-4d53-8686-8567cf4f87a6 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:54.283210 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-24bc473e-8a62-4d53-8686-8567cf4f87a6 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:54.379069 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-24bc473e-8a62-4d53-8686-8567cf4f87a6 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:54.380094 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-24bc473e-8a62-4d53-8686-8567cf4f87a6 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:54.380888 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-24bc473e-8a62-4d53-8686-8567cf4f87a6 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:54.381575 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-24bc473e-8a62-4d53-8686-8567cf4f87a6 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lazy-loading 'fault' on Instance uuid 95418c39-6c0a-444e-93b4-4a90b31f3034 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:42:54.496209 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-24bc473e-8a62-4d53-8686-8567cf4f87a6 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b891d3b774e44de3ad1d3088990f6bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '358604dd1cf74e5fab262179351d4d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:54.508338 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-24bc473e-8a62-4d53-8686-8567cf4f87a6 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] 10.222.0.79 "GET /compute/v2.1/servers/95418c39-6c0a-444e-93b4-4a90b31f3034" status: 200 len: 1367 microversion: 2.1 time: 0.255517 Oct 17 13:42:54.508930 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1131/2253] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:54 2022] GET /compute/v2.1/servers/95418c39-6c0a-444e-93b4-4a90b31f3034 => generated 1367 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:54.520113 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-4c89c133-1ad7-40ac-aa17-a4b968079b18 req-1b74a31b-89fe-4851-86df-cc3122a855cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "240648df-7968-4bbe-ac94-08360eb1049e", "tag": "bb16bb6b-77f3-4d30-922f-0b42e294e0ec"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:42:54.547076 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-4c89c133-1ad7-40ac-aa17-a4b968079b18 req-1b74a31b-89fe-4851-86df-cc3122a855cf service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:54.549920 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-4c89c133-1ad7-40ac-aa17-a4b968079b18 req-1b74a31b-89fe-4851-86df-cc3122a855cf service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:54.552026 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-4c89c133-1ad7-40ac-aa17-a4b968079b18 req-1b74a31b-89fe-4851-86df-cc3122a855cf service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:54.581891 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-4c89c133-1ad7-40ac-aa17-a4b968079b18 req-1b74a31b-89fe-4851-86df-cc3122a855cf service nova] Creating event network-changed:bb16bb6b-77f3-4d30-922f-0b42e294e0ec for instance 240648df-7968-4bbe-ac94-08360eb1049e on n-h2-854247-14 Oct 17 13:42:54.588159 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f538635d-a4ce-4b33-9ac2-f781fb5bcbc4 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0410e9acbf42ff9f51b096b98d4975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e047e6275b42d6b6d5776ea2121b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:54.597858 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f538635d-a4ce-4b33-9ac2-f781fb5bcbc4 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] 10.222.0.79 "GET /compute/v2.1/servers/6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37" status: 200 len: 1509 microversion: 2.1 time: 0.816908 Oct 17 13:42:54.613656 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1123/2254] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:53 2022] GET /compute/v2.1/servers/6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37 => generated 1509 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:54.613656 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a14b4966-1aee-4e52-bea4-3e81f442c498 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1682438471"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:42:54.613656 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a14b4966-1aee-4e52-bea4-3e81f442c498 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] [instance: bc9feeff-1ac7-4267-9351-3f1560dede9b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:54.620196 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-4c89c133-1ad7-40ac-aa17-a4b968079b18 req-1b74a31b-89fe-4851-86df-cc3122a855cf service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108255 Oct 17 13:42:54.621073 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1132/2255] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:42:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:42:54.626705 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a14b4966-1aee-4e52-bea4-3e81f442c498 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:54.627247 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a14b4966-1aee-4e52-bea4-3e81f442c498 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:54.627662 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a14b4966-1aee-4e52-bea4-3e81f442c498 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:54.628370 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a14b4966-1aee-4e52-bea4-3e81f442c498 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:54.628823 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a14b4966-1aee-4e52-bea4-3e81f442c498 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:54.629249 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a14b4966-1aee-4e52-bea4-3e81f442c498 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:54.634905 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4b3c3f5a-da32-4f65-a6f5-b762f5201f98 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:54.638102 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4b3c3f5a-da32-4f65-a6f5-b762f5201f98 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] [instance: 1088ec60-b26d-4082-bfa8-e01bf9af31f8] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:54.656348 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4b3c3f5a-da32-4f65-a6f5-b762f5201f98 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:54.656855 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4b3c3f5a-da32-4f65-a6f5-b762f5201f98 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:54.657293 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4b3c3f5a-da32-4f65-a6f5-b762f5201f98 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:54.658016 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4b3c3f5a-da32-4f65-a6f5-b762f5201f98 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:54.663266 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4b3c3f5a-da32-4f65-a6f5-b762f5201f98 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:54.663865 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4b3c3f5a-da32-4f65-a6f5-b762f5201f98 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:55.473018 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.network.security_group_api [None req-a14b4966-1aee-4e52-bea4-3e81f442c498 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Adding security group d00eef40-614d-42f8-b3dd-328edb750eda to port 821390e6-5b5f-4941-b743-c5c5ff8b7d80 Oct 17 13:42:55.509063 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4b3c3f5a-da32-4f65-a6f5-b762f5201f98 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76e77dade0e441a79c2c4d77993172ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3134826eb154c71bb67718c36ff38cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:55.519031 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4b3c3f5a-da32-4f65-a6f5-b762f5201f98 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] 10.222.0.79 "GET /compute/v2.1/servers/1088ec60-b26d-4082-bfa8-e01bf9af31f8" status: 200 len: 1322 microversion: 2.1 time: 0.894807 Oct 17 13:42:55.522735 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1133/2256] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:54 2022] GET /compute/v2.1/servers/1088ec60-b26d-4082-bfa8-e01bf9af31f8 => generated 1322 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:55.533508 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4f6f1538-f882-4a51-9203-c0cc6c7437ed tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:55.539077 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4f6f1538-f882-4a51-9203-c0cc6c7437ed tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 240648df-7968-4bbe-ac94-08360eb1049e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:55.552823 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4f6f1538-f882-4a51-9203-c0cc6c7437ed tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:55.554322 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4f6f1538-f882-4a51-9203-c0cc6c7437ed tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:55.554774 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4f6f1538-f882-4a51-9203-c0cc6c7437ed tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:55.555864 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4f6f1538-f882-4a51-9203-c0cc6c7437ed tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:55.556322 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4f6f1538-f882-4a51-9203-c0cc6c7437ed tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:55.561575 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4f6f1538-f882-4a51-9203-c0cc6c7437ed tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:56.107346 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=4 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:42:56.249384 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=8 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:42:56.654906 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4f6f1538-f882-4a51-9203-c0cc6c7437ed tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:56.671126 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4f6f1538-f882-4a51-9203-c0cc6c7437ed tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/240648df-7968-4bbe-ac94-08360eb1049e" status: 200 len: 1317 microversion: 2.1 time: 1.146124 Oct 17 13:42:56.671947 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1134/2257] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:55 2022] GET /compute/v2.1/servers/240648df-7968-4bbe-ac94-08360eb1049e => generated 1317 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:56.686800 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7eb2aaba-dd53-46fa-91c5-44d221bcc980 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:56.687457 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7eb2aaba-dd53-46fa-91c5-44d221bcc980 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] [instance: 2184ae8f-022d-4de9-8d0f-0c2d546c9d6f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:56.708468 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7eb2aaba-dd53-46fa-91c5-44d221bcc980 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:56.710366 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7eb2aaba-dd53-46fa-91c5-44d221bcc980 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:56.712074 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7eb2aaba-dd53-46fa-91c5-44d221bcc980 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:56.713201 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7eb2aaba-dd53-46fa-91c5-44d221bcc980 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:56.717121 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7eb2aaba-dd53-46fa-91c5-44d221bcc980 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:56.717765 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7eb2aaba-dd53-46fa-91c5-44d221bcc980 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:57.433497 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7eb2aaba-dd53-46fa-91c5-44d221bcc980 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799d72ccad514fd899d21809d613249b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb50742d06f403598634414befbeb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:57.444779 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a14b4966-1aee-4e52-bea4-3e81f442c498 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "POST /compute/v2.1/servers/bc9feeff-1ac7-4267-9351-3f1560dede9b/action" status: 202 len: 0 microversion: 2.1 time: 2.839637 Oct 17 13:42:57.445689 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1124/2258] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:42:54 2022] POST /compute/v2.1/servers/bc9feeff-1ac7-4267-9351-3f1560dede9b/action => generated 0 bytes in 2841 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:42:57.451635 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-104c1175-0a2b-4aaf-a129-70bb9f87caf9 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:57.452685 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-104c1175-0a2b-4aaf-a129-70bb9f87caf9 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] [instance: 95418c39-6c0a-444e-93b4-4a90b31f3034] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:57.462499 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7eb2aaba-dd53-46fa-91c5-44d221bcc980 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] 10.222.0.79 "GET /compute/v2.1/servers/2184ae8f-022d-4de9-8d0f-0c2d546c9d6f" status: 200 len: 1304 microversion: 2.1 time: 0.789587 Oct 17 13:42:57.475296 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1135/2259] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:56 2022] GET /compute/v2.1/servers/2184ae8f-022d-4de9-8d0f-0c2d546c9d6f => generated 1304 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:57.491531 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-104c1175-0a2b-4aaf-a129-70bb9f87caf9 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:57.492650 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4963ade5-7bd1-4dbf-a0f1-8a9bf385ff63 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:57.493263 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-104c1175-0a2b-4aaf-a129-70bb9f87caf9 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:57.494764 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-104c1175-0a2b-4aaf-a129-70bb9f87caf9 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:57.498078 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-104c1175-0a2b-4aaf-a129-70bb9f87caf9 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:57.498407 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4963ade5-7bd1-4dbf-a0f1-8a9bf385ff63 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] [instance: 6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:57.500949 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-104c1175-0a2b-4aaf-a129-70bb9f87caf9 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:57.503329 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-104c1175-0a2b-4aaf-a129-70bb9f87caf9 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:57.518067 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4963ade5-7bd1-4dbf-a0f1-8a9bf385ff63 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:57.534618 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4963ade5-7bd1-4dbf-a0f1-8a9bf385ff63 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:57.535502 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4963ade5-7bd1-4dbf-a0f1-8a9bf385ff63 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:57.536601 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4963ade5-7bd1-4dbf-a0f1-8a9bf385ff63 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:57.537575 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4963ade5-7bd1-4dbf-a0f1-8a9bf385ff63 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:57.538279 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4963ade5-7bd1-4dbf-a0f1-8a9bf385ff63 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:57.565177 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-104c1175-0a2b-4aaf-a129-70bb9f87caf9 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] HTTP exception thrown: Instance 95418c39-6c0a-444e-93b4-4a90b31f3034 could not be found. Oct 17 13:42:57.567470 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-104c1175-0a2b-4aaf-a129-70bb9f87caf9 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Request method failure captured: Oct 17 13:42:57.567470 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/95418c39-6c0a-444e-93b4-4a90b31f3034 HTTP/1.1 Oct 17 13:42:57.567470 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:42:57.567470 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:42:57.567470 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:42:57.567470 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:42:57.567470 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:42:57.567470 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:42:57.567470 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:42:57.567470 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:42:57.567470 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVuSQJLpBKwr-ZdkJHz7g8fub70wA9miUHyPeiay47MCJb22K10aVpwYnZQskWEPaecr7Yj6C_dj9ls7OV3REWcvcm6BwE8ehU6Evx4reF0JZVoDyLHeX_uaYybjh-dWRY-4U8Y4f2exRnSfe5ryRBiXbndUPvAbF6fZ2t7FJU1-ewY Oct 17 13:42:57.567470 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:42:57.567470 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:42:57.567470 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:42:57.567470 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:42:57.567470 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:42:57.567470 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:42:57.567470 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 358604dd1cf74e5fab262179351d4d98 Oct 17 13:42:57.567470 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServersTestManualDisk-1878784848 Oct 17 13:42:57.567470 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:42:57.567470 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:42:57.567470 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/358604dd1cf74e5fab262179351d4d98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/358604dd1cf74e5fab262179351d4d98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/358604dd1cf74e5fab262179351d4d98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_358604dd1cf74e5fab262179351d4d98", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:42:57.567470 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServersTestManualDisk-1878784848 Oct 17 13:42:57.567470 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 358604dd1cf74e5fab262179351d4d98 Oct 17 13:42:57.567470 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServersTestManualDisk-1878784848 Oct 17 13:42:57.567470 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServersTestManualDisk-1878784848-project Oct 17 13:42:57.567470 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:42:57.567470 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:42:57.567470 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: b891d3b774e44de3ad1d3088990f6bd5 Oct 17 13:42:57.567470 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServersTestManualDisk-1878784848-project Oct 17 13:42:57.567470 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:42:57.567470 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 95418c39-6c0a-444e-93b4-4a90b31f3034 could not be found. Oct 17 13:42:57.567470 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '95418c39-6c0a-444e-93b4-4a90b31f3034'} Oct 17 13:42:57.567470 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:42:57.567470 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:57.567470 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:42:57.567470 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:42:57.567470 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:42:57.567470 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:42:57.567470 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:42:57.567470 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:42:57.567470 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:42:57.567470 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:42:57.567470 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95418c39-6c0a-444e-93b4-4a90b31f3034 could not be found. Oct 17 13:42:57.567470 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:42:57.567470 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:57.567470 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:42:57.567470 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:57.567470 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:57.567470 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:57.567470 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:42:57.567470 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:42:57.567470 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:42:57.567470 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:42:57.567470 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:42:57.567470 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:42:57.567470 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:42:57.567470 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:42:57.567470 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:42:57.567470 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:42:57.567470 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95418c39-6c0a-444e-93b4-4a90b31f3034 could not be found. Oct 17 13:42:57.567470 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:42:57.567470 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:57.567470 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:42:57.572224 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:57.572224 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:57.572224 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:57.572224 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:42:57.572224 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:42:57.572224 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95418c39-6c0a-444e-93b4-4a90b31f3034 could not be found. Oct 17 13:42:57.572224 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:42:57.573412 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-4963ade5-7bd1-4dbf-a0f1-8a9bf385ff63 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] HTTP exception thrown: Instance 6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37 could not be found. Oct 17 13:42:57.575518 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4963ade5-7bd1-4dbf-a0f1-8a9bf385ff63 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Request method failure captured: Oct 17 13:42:57.575518 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37 HTTP/1.1 Oct 17 13:42:57.575518 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:42:57.575518 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:42:57.575518 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:42:57.575518 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:42:57.575518 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:42:57.575518 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:42:57.575518 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:42:57.575518 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:42:57.575518 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVu8qL3GeB0qpqBRBngnaxkzmvZZ97gdulySLngtTD_epSxXJWPia8QnluYtHTrGKtnAU-9tgxKjUztzc30YsPKwHo5O3GaCpxsbLD11VK-zg8Dn-sNcKqFgTCF5pJTtc18E8Pg2cqgWn8wJ3M-xcEaX0pp87yJMlH18swRqMaFdHgc Oct 17 13:42:57.575518 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:42:57.575518 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:42:57.575518 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:42:57.575518 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:42:57.575518 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:42:57.575518 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:42:57.575518 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 20e047e6275b42d6b6d5776ea2121b03 Oct 17 13:42:57.575518 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ImagesNegativeTestJSON-1778978349 Oct 17 13:42:57.575518 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:42:57.575518 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:42:57.575518 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/20e047e6275b42d6b6d5776ea2121b03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/20e047e6275b42d6b6d5776ea2121b03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/20e047e6275b42d6b6d5776ea2121b03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_20e047e6275b42d6b6d5776ea2121b03", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:42:57.575518 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ImagesNegativeTestJSON-1778978349 Oct 17 13:42:57.575518 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 20e047e6275b42d6b6d5776ea2121b03 Oct 17 13:42:57.575518 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1778978349 Oct 17 13:42:57.575518 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ImagesNegativeTestJSON-1778978349-project Oct 17 13:42:57.575518 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:42:57.575518 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:42:57.575518 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: cb0410e9acbf42ff9f51b096b98d4975 Oct 17 13:42:57.575518 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ImagesNegativeTestJSON-1778978349-project Oct 17 13:42:57.575518 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:42:57.575518 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37 could not be found. Oct 17 13:42:57.575518 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37'} Oct 17 13:42:57.575518 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:42:57.575518 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:57.575518 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:42:57.575518 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:42:57.575518 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:42:57.575518 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:42:57.575518 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:42:57.575518 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:42:57.575518 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:42:57.575518 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:42:57.575518 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37 could not be found. Oct 17 13:42:57.575518 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:57.575518 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:57.575518 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:57.575518 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:57.575518 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:57.575518 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:57.575518 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:42:57.575518 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:42:57.575518 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:42:57.575518 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:42:57.575518 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:42:57.575518 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:42:57.575518 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:42:57.575518 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:42:57.575518 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:42:57.575518 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:42:57.575518 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37 could not be found. Oct 17 13:42:57.575518 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:57.575518 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:57.575518 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:57.579059 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:57.579059 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:57.579059 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:57.579059 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:42:57.579059 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:42:57.579059 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37 could not be found. Oct 17 13:42:57.579059 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:57.580597 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-104c1175-0a2b-4aaf-a129-70bb9f87caf9 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Returning 404 to user: Instance 95418c39-6c0a-444e-93b4-4a90b31f3034 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:42:57.580597 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-104c1175-0a2b-4aaf-a129-70bb9f87caf9 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] 10.222.0.79 "GET /compute/v2.1/servers/95418c39-6c0a-444e-93b4-4a90b31f3034" status: 404 len: 111 microversion: 2.1 time: 0.130760 Oct 17 13:42:57.580597 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1125/2260] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:57 2022] GET /compute/v2.1/servers/95418c39-6c0a-444e-93b4-4a90b31f3034 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:42:57.582564 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4963ade5-7bd1-4dbf-a0f1-8a9bf385ff63 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Returning 404 to user: Instance 6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:42:57.583928 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4963ade5-7bd1-4dbf-a0f1-8a9bf385ff63 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] 10.222.0.79 "GET /compute/v2.1/servers/6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37" status: 404 len: 111 microversion: 2.1 time: 0.115315 Oct 17 13:42:57.585036 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1136/2261] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:57 2022] GET /compute/v2.1/servers/6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:42:57.596289 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-6bdd03cf-b8e6-4451-bf00-d59118aa5c62 req-fa6b9283-fa0c-462f-bab6-1ac634100e33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f806fc0-61ef-4c0b-b6af-8f987148f5ca", "tag": "8852e286-0d94-4c6e-aeb7-c6b79afb6231"}, {"server_uuid": "6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37", "name": "network-vif-deleted", "tag": "3dbc04db-8331-42cd-a117-acb2bbd05b2e"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:42:57.604747 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d1b21be8-8e24-412e-9eb0-1a0334f721ff tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:57.607466 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d1b21be8-8e24-412e-9eb0-1a0334f721ff tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] [instance: 1088ec60-b26d-4082-bfa8-e01bf9af31f8] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:57.628503 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d1b21be8-8e24-412e-9eb0-1a0334f721ff tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:57.630364 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d1b21be8-8e24-412e-9eb0-1a0334f721ff tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:57.642477 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d1b21be8-8e24-412e-9eb0-1a0334f721ff tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:57.643267 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:42:57.643405 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d1b21be8-8e24-412e-9eb0-1a0334f721ff tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:57.643884 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d1b21be8-8e24-412e-9eb0-1a0334f721ff tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:57.645478 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-6bdd03cf-b8e6-4451-bf00-d59118aa5c62 req-fa6b9283-fa0c-462f-bab6-1ac634100e33 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:57.645834 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d1b21be8-8e24-412e-9eb0-1a0334f721ff tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:57.645955 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-6bdd03cf-b8e6-4451-bf00-d59118aa5c62 req-fa6b9283-fa0c-462f-bab6-1ac634100e33 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:57.646362 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-6bdd03cf-b8e6-4451-bf00-d59118aa5c62 req-fa6b9283-fa0c-462f-bab6-1ac634100e33 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:57.689635 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-6bdd03cf-b8e6-4451-bf00-d59118aa5c62 req-fa6b9283-fa0c-462f-bab6-1ac634100e33 service nova] Creating event network-changed:8852e286-0d94-4c6e-aeb7-c6b79afb6231 for instance 4f806fc0-61ef-4c0b-b6af-8f987148f5ca on n-h2-854247-14 Oct 17 13:42:57.690478 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-6bdd03cf-b8e6-4451-bf00-d59118aa5c62 req-fa6b9283-fa0c-462f-bab6-1ac634100e33 service nova] Creating event network-vif-deleted:3dbc04db-8331-42cd-a117-acb2bbd05b2e for instance 6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37 on n-h1-854247-14 Oct 17 13:42:57.723726 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-6bdd03cf-b8e6-4451-bf00-d59118aa5c62 req-fa6b9283-fa0c-462f-bab6-1ac634100e33 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.137116 Oct 17 13:42:57.724314 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1126/2262] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:42:57 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:42:57.750253 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-053324eb-cd0e-460c-98f2-1feb0f43d658 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Calling method '.version_select at 0x7f7cd5bcb8b0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:59.100899 n-d-854247-14 devstack@n-api.service[127017]: DEBUG neutronclient.v2_0.client [None req-053324eb-cd0e-460c-98f2-1feb0f43d658 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group d00eef40-614d-42f8-b3dd-328edb750eda in use.", "detail": ""}} {{(pid=127017) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 13:42:59.103198 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-053324eb-cd0e-460c-98f2-1feb0f43d658 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] HTTP exception thrown: Security Group d00eef40-614d-42f8-b3dd-328edb750eda in use. Oct 17 13:42:59.103198 n-d-854247-14 devstack@n-api.service[127017]: Neutron server returns request_ids: ['req-cc0de91a-c256-4a83-adfd-55784c548d24'] Oct 17 13:42:59.107469 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-053324eb-cd0e-460c-98f2-1feb0f43d658 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Request method failure captured: Oct 17 13:42:59.107469 n-d-854247-14 devstack@n-api.service[127017]: request: DELETE /compute/v2.1/os-security-groups/d00eef40-614d-42f8-b3dd-328edb750eda HTTP/1.1 Oct 17 13:42:59.107469 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:42:59.107469 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:42:59.107469 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:42:59.107469 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:42:59.107469 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:42:59.107469 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:42:59.107469 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:42:59.107469 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:42:59.107469 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVtyFGyYtLVdwIq4ccz7RkXRa7NtlbhzSHc2HUbc2jnmH2QeepBwxbKf8toXm_ooPcHi9ET43LtT1AqXtRk9n6taXXPkcxvI9DAvMm-WduwoIrQJqrIBPqw0m6vAgqbSuo42q0EeC3f0tZCzBhE1QaAtaHcB-dTJTCp89NqtuNhDPjU Oct 17 13:42:59.107469 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:42:59.107469 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:42:59.107469 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:42:59.107469 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:42:59.107469 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:42:59.107469 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:42:59.107469 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 50c0147c5fae4017810887843b0afaa0 Oct 17 13:42:59.107469 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-SecurityGroupsTestJSON-1412652742 Oct 17 13:42:59.107469 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:42:59.107469 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:42:59.107469 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/50c0147c5fae4017810887843b0afaa0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/50c0147c5fae4017810887843b0afaa0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/50c0147c5fae4017810887843b0afaa0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_50c0147c5fae4017810887843b0afaa0", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:42:59.107469 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-SecurityGroupsTestJSON-1412652742 Oct 17 13:42:59.107469 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 50c0147c5fae4017810887843b0afaa0 Oct 17 13:42:59.107469 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1412652742 Oct 17 13:42:59.107469 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-SecurityGroupsTestJSON-1412652742-project Oct 17 13:42:59.107469 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:42:59.107469 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:42:59.107469 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 185235bc4e3245fc8d92b7e4bff6cbbd Oct 17 13:42:59.107469 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-SecurityGroupsTestJSON-1412652742-project Oct 17 13:42:59.107469 n-d-854247-14 devstack@n-api.service[127017]: method: Oct 17 13:42:59.107469 n-d-854247-14 devstack@n-api.service[127017]: exception: Security Group d00eef40-614d-42f8-b3dd-328edb750eda in use. Oct 17 13:42:59.107469 n-d-854247-14 devstack@n-api.service[127017]: Neutron server returns request_ids: ['req-cc0de91a-c256-4a83-adfd-55784c548d24'] Oct 17 13:42:59.107469 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'd00eef40-614d-42f8-b3dd-328edb750eda'} Oct 17 13:42:59.107469 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:42:59.107469 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:59.107469 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 17 13:42:59.107469 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 17 13:42:59.107469 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:59.107469 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:59.107469 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 17 13:42:59.107469 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 17 13:42:59.107469 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:59.107469 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:59.107469 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 17 13:42:59.107469 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 17 13:42:59.107469 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:59.107469 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:59.107469 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 13:42:59.107469 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 13:42:59.107469 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:59.107469 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:59.107469 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 13:42:59.107469 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 13:42:59.107469 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:59.107469 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:59.107469 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 13:42:59.107469 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 13:42:59.107469 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 13:42:59.107469 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 13:42:59.107469 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group d00eef40-614d-42f8-b3dd-328edb750eda in use. Oct 17 13:42:59.114263 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cc0de91a-c256-4a83-adfd-55784c548d24'] Oct 17 13:42:59.114263 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:42:59.114263 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:59.114263 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:42:59.114263 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:59.114263 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 17 13:42:59.114263 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 17 13:42:59.114263 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 17 13:42:59.114263 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 17 13:42:59.114263 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group d00eef40-614d-42f8-b3dd-328edb750eda in use. Oct 17 13:42:59.114263 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cc0de91a-c256-4a83-adfd-55784c548d24'] Oct 17 13:42:59.114263 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:42:59.114263 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:59.114263 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:42:59.114263 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:59.114263 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:59.114263 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:59.114263 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:42:59.114263 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:42:59.114263 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:42:59.114263 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:42:59.114263 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:42:59.114263 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:42:59.114263 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 17 13:42:59.114263 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 17 13:42:59.114263 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group d00eef40-614d-42f8-b3dd-328edb750eda in use. Oct 17 13:42:59.114263 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cc0de91a-c256-4a83-adfd-55784c548d24'] Oct 17 13:42:59.114263 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:42:59.114263 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:59.114263 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:42:59.114263 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:59.114263 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:59.114263 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:59.114263 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:42:59.114263 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:42:59.114263 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group d00eef40-614d-42f8-b3dd-328edb750eda in use. Oct 17 13:42:59.114263 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cc0de91a-c256-4a83-adfd-55784c548d24'] Oct 17 13:42:59.114263 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:42:59.124154 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-053324eb-cd0e-460c-98f2-1feb0f43d658 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Returning 400 to user: Security Group d00eef40-614d-42f8-b3dd-328edb750eda in use. Oct 17 13:42:59.124154 n-d-854247-14 devstack@n-api.service[127017]: Neutron server returns request_ids: ['req-cc0de91a-c256-4a83-adfd-55784c548d24'] {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:42:59.124154 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-053324eb-cd0e-460c-98f2-1feb0f43d658 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/d00eef40-614d-42f8-b3dd-328edb750eda" status: 400 len: 185 microversion: 2.1 time: 1.392558 Oct 17 13:42:59.132721 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1127/2263] 10.222.0.79 () {58 vars in 1272 bytes} [Mon Oct 17 13:42:57 2022] DELETE /compute/v2.1/os-security-groups/d00eef40-614d-42f8-b3dd-328edb750eda => generated 185 bytes in 1403 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:42:59.157122 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d1b21be8-8e24-412e-9eb0-1a0334f721ff tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76e77dade0e441a79c2c4d77993172ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3134826eb154c71bb67718c36ff38cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:59.219323 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a82c7796-440c-48f7-8f47-7771a569cc50 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] Calling method '.version_select at 0x7f7cd5f12af0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:59.236689 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d1b21be8-8e24-412e-9eb0-1a0334f721ff tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] 10.222.0.79 "GET /compute/v2.1/servers/1088ec60-b26d-4082-bfa8-e01bf9af31f8" status: 200 len: 1322 microversion: 2.1 time: 1.649957 Oct 17 13:42:59.243979 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1137/2264] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:57 2022] GET /compute/v2.1/servers/1088ec60-b26d-4082-bfa8-e01bf9af31f8 => generated 1322 bytes in 1658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:59.271756 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ff4bc491-98a5-4dbd-be5b-4efce9ed840c tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1557633047", "metadata": {"image_type": "test"}}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:42:59.283933 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ff4bc491-98a5-4dbd-be5b-4efce9ed840c tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] [instance: 6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:59.321264 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a82c7796-440c-48f7-8f47-7771a569cc50 tempest-ServersTestManualDisk-1878784848 tempest-ServersTestManualDisk-1878784848-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1687806208" status: 202 len: 0 microversion: 2.1 time: 0.186355 Oct 17 13:42:59.323250 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1128/2265] 10.222.0.79 () {58 vars in 1221 bytes} [Mon Oct 17 13:42:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1687806208 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:42:59.330329 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ff4bc491-98a5-4dbd-be5b-4efce9ed840c tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:59.333087 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ff4bc491-98a5-4dbd-be5b-4efce9ed840c tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:59.334908 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ff4bc491-98a5-4dbd-be5b-4efce9ed840c tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:59.338967 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ff4bc491-98a5-4dbd-be5b-4efce9ed840c tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:59.343768 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ff4bc491-98a5-4dbd-be5b-4efce9ed840c tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:59.351837 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-6e4a7604-15d3-403f-a215-dc2ae53039c4 req-42854a58-9e97-434e-b808-a0703dbaf5c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc9feeff-1ac7-4267-9351-3f1560dede9b", "tag": "821390e6-5b5f-4941-b743-c5c5ff8b7d80"}, {"name": "network-changed", "server_uuid": "1088ec60-b26d-4082-bfa8-e01bf9af31f8", "tag": "c922642f-3d80-4a95-ab40-d8ce583ebe8d"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:42:59.352244 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ff4bc491-98a5-4dbd-be5b-4efce9ed840c tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:59.419101 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-ff4bc491-98a5-4dbd-be5b-4efce9ed840c tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] HTTP exception thrown: Instance 6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37 could not be found. Oct 17 13:42:59.419865 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-6e4a7604-15d3-403f-a215-dc2ae53039c4 req-42854a58-9e97-434e-b808-a0703dbaf5c8 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:59.420655 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-6e4a7604-15d3-403f-a215-dc2ae53039c4 req-42854a58-9e97-434e-b808-a0703dbaf5c8 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:59.421186 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ff4bc491-98a5-4dbd-be5b-4efce9ed840c tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Request method failure captured: Oct 17 13:42:59.421186 n-d-854247-14 devstack@n-api.service[127016]: request: POST /compute/v2.1/servers/6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37/action HTTP/1.1 Oct 17 13:42:59.421186 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:42:59.421186 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:42:59.421186 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:42:59.421186 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 112 Oct 17 13:42:59.421186 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:42:59.421186 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:42:59.421186 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:42:59.421186 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:42:59.421186 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVu8qL3GeB0qpqBRBngnaxkzmvZZ97gdulySLngtTD_epSxXJWPia8QnluYtHTrGKtnAU-9tgxKjUztzc30YsPKwHo5O3GaCpxsbLD11VK-zg8Dn-sNcKqFgTCF5pJTtc18E8Pg2cqgWn8wJ3M-xcEaX0pp87yJMlH18swRqMaFdHgc Oct 17 13:42:59.421186 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:42:59.421186 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:42:59.421186 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:42:59.421186 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:42:59.421186 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:42:59.421186 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:42:59.421186 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 20e047e6275b42d6b6d5776ea2121b03 Oct 17 13:42:59.421186 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ImagesNegativeTestJSON-1778978349 Oct 17 13:42:59.421186 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:42:59.421186 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:42:59.421186 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/20e047e6275b42d6b6d5776ea2121b03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/20e047e6275b42d6b6d5776ea2121b03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/20e047e6275b42d6b6d5776ea2121b03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_20e047e6275b42d6b6d5776ea2121b03", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:42:59.421186 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ImagesNegativeTestJSON-1778978349 Oct 17 13:42:59.421186 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 20e047e6275b42d6b6d5776ea2121b03 Oct 17 13:42:59.421186 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1778978349 Oct 17 13:42:59.421186 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ImagesNegativeTestJSON-1778978349-project Oct 17 13:42:59.421186 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:42:59.421186 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:42:59.421186 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: cb0410e9acbf42ff9f51b096b98d4975 Oct 17 13:42:59.421186 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ImagesNegativeTestJSON-1778978349-project Oct 17 13:42:59.421186 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:42:59.421186 n-d-854247-14 devstack@n-api.service[127016]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1557633047", "metadata": {"image_type": "test"}}} Oct 17 13:42:59.421186 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:42:59.421186 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37 could not be found. Oct 17 13:42:59.421186 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1557633047', 'metadata': {'image_type': 'test'}}}} Oct 17 13:42:59.421186 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:42:59.421186 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:59.421186 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:42:59.421186 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:42:59.421186 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:42:59.421186 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:42:59.421186 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:42:59.421186 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:42:59.421186 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:42:59.421186 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:42:59.421186 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37 could not be found. Oct 17 13:42:59.421186 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:59.421186 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:59.421186 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:59.421186 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:59.421186 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:59.421186 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:59.421186 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:42:59.421186 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:42:59.421186 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:42:59.421186 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:42:59.421186 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:42:59.421186 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:42:59.421186 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:42:59.421186 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:42:59.421186 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 17 13:42:59.421186 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 17 13:42:59.424864 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:42:59.424864 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:42:59.424864 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:42:59.424864 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:42:59.424864 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37 could not be found. Oct 17 13:42:59.424864 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:59.424864 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:59.424864 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:59.424864 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:59.424864 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:59.424864 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:59.424864 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:42:59.424864 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:42:59.424864 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37 could not be found. Oct 17 13:42:59.424864 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:42:59.429119 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ff4bc491-98a5-4dbd-be5b-4efce9ed840c tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Returning 404 to user: Instance 6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:42:59.430215 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ff4bc491-98a5-4dbd-be5b-4efce9ed840c tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] 10.222.0.79 "POST /compute/v2.1/servers/6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37/action" status: 404 len: 111 microversion: 2.1 time: 0.184154 Oct 17 13:42:59.431337 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1138/2266] 10.222.0.79 () {60 vars in 1279 bytes} [Mon Oct 17 13:42:59 2022] POST /compute/v2.1/servers/6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37/action => generated 111 bytes in 186 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:42:59.436329 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f6a9b0b9-c63f-4dc4-8b24-fcfa8d9a047f tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:59.437187 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f6a9b0b9-c63f-4dc4-8b24-fcfa8d9a047f tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 240648df-7968-4bbe-ac94-08360eb1049e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:59.446957 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-6e4a7604-15d3-403f-a215-dc2ae53039c4 req-42854a58-9e97-434e-b808-a0703dbaf5c8 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:59.453109 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f6a9b0b9-c63f-4dc4-8b24-fcfa8d9a047f tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:59.454025 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f6a9b0b9-c63f-4dc4-8b24-fcfa8d9a047f tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:59.454675 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f6a9b0b9-c63f-4dc4-8b24-fcfa8d9a047f tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:59.455667 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f6a9b0b9-c63f-4dc4-8b24-fcfa8d9a047f tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:59.456435 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f6a9b0b9-c63f-4dc4-8b24-fcfa8d9a047f tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:59.457216 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f6a9b0b9-c63f-4dc4-8b24-fcfa8d9a047f tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:59.512729 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-6e4a7604-15d3-403f-a215-dc2ae53039c4 req-42854a58-9e97-434e-b808-a0703dbaf5c8 service nova] Creating event network-changed:821390e6-5b5f-4941-b743-c5c5ff8b7d80 for instance bc9feeff-1ac7-4267-9351-3f1560dede9b on n-h1-854247-14 Oct 17 13:42:59.514228 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-6e4a7604-15d3-403f-a215-dc2ae53039c4 req-42854a58-9e97-434e-b808-a0703dbaf5c8 service nova] Creating event network-changed:c922642f-3d80-4a95-ab40-d8ce583ebe8d for instance 1088ec60-b26d-4082-bfa8-e01bf9af31f8 on n-h1-854247-14 Oct 17 13:42:59.533375 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-6e4a7604-15d3-403f-a215-dc2ae53039c4 req-42854a58-9e97-434e-b808-a0703dbaf5c8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.207840 Oct 17 13:42:59.537446 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1129/2267] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:42:59 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:42:59.552770 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7965fc0d-1bf2-4b48-a452-4cf4f41d1158 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:59.559347 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7965fc0d-1bf2-4b48-a452-4cf4f41d1158 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] [instance: 2184ae8f-022d-4de9-8d0f-0c2d546c9d6f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:59.572542 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7965fc0d-1bf2-4b48-a452-4cf4f41d1158 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:59.574194 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7965fc0d-1bf2-4b48-a452-4cf4f41d1158 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:59.575740 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7965fc0d-1bf2-4b48-a452-4cf4f41d1158 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:59.576777 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7965fc0d-1bf2-4b48-a452-4cf4f41d1158 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:59.578124 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7965fc0d-1bf2-4b48-a452-4cf4f41d1158 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:59.580353 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7965fc0d-1bf2-4b48-a452-4cf4f41d1158 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:59.631242 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:43:00.377118 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7965fc0d-1bf2-4b48-a452-4cf4f41d1158 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799d72ccad514fd899d21809d613249b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb50742d06f403598634414befbeb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:00.399264 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7965fc0d-1bf2-4b48-a452-4cf4f41d1158 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] 10.222.0.79 "GET /compute/v2.1/servers/2184ae8f-022d-4de9-8d0f-0c2d546c9d6f" status: 200 len: 1372 microversion: 2.1 time: 0.844836 Oct 17 13:43:00.400169 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1130/2268] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:59 2022] GET /compute/v2.1/servers/2184ae8f-022d-4de9-8d0f-0c2d546c9d6f => generated 1372 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:00.413430 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ca3ea6d3-91e8-4023-bdbe-ea0f57c07b5e tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:00.419107 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ca3ea6d3-91e8-4023-bdbe-ea0f57c07b5e tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] [instance: bc9feeff-1ac7-4267-9351-3f1560dede9b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:00.452894 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ca3ea6d3-91e8-4023-bdbe-ea0f57c07b5e tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:00.453543 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ca3ea6d3-91e8-4023-bdbe-ea0f57c07b5e tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:00.454080 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ca3ea6d3-91e8-4023-bdbe-ea0f57c07b5e tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:00.455056 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ca3ea6d3-91e8-4023-bdbe-ea0f57c07b5e tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:00.457789 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ca3ea6d3-91e8-4023-bdbe-ea0f57c07b5e tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:00.458346 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ca3ea6d3-91e8-4023-bdbe-ea0f57c07b5e tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:00.524548 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ca3ea6d3-91e8-4023-bdbe-ea0f57c07b5e tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] [instance: bc9feeff-1ac7-4267-9351-3f1560dede9b] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:43:00.719621 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ca3ea6d3-91e8-4023-bdbe-ea0f57c07b5e tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "DELETE /compute/v2.1/servers/bc9feeff-1ac7-4267-9351-3f1560dede9b" status: 204 len: 0 microversion: 2.1 time: 0.309600 Oct 17 13:43:00.722968 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1131/2269] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:43:00 2022] DELETE /compute/v2.1/servers/bc9feeff-1ac7-4267-9351-3f1560dede9b => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:43:00.761997 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d6c680f2-6338-44e7-b059-759bfa36bf39 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-321271452", "metadata": {"image_type": "test"}}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:00.772323 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d6c680f2-6338-44e7-b059-759bfa36bf39 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Failed to fetch instance by id tempest-invalid-184530332 {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 17 13:43:00.774444 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-d6c680f2-6338-44e7-b059-759bfa36bf39 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] HTTP exception thrown: Instance tempest-invalid-184530332 could not be found. Oct 17 13:43:00.781622 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d6c680f2-6338-44e7-b059-759bfa36bf39 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Request method failure captured: Oct 17 13:43:00.781622 n-d-854247-14 devstack@n-api.service[127017]: request: POST /compute/v2.1/servers/tempest-invalid-184530332/action HTTP/1.1 Oct 17 13:43:00.781622 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:43:00.781622 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:43:00.781622 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:43:00.781622 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 111 Oct 17 13:43:00.781622 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:43:00.781622 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:43:00.781622 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:43:00.781622 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:43:00.781622 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVu8qL3GeB0qpqBRBngnaxkzmvZZ97gdulySLngtTD_epSxXJWPia8QnluYtHTrGKtnAU-9tgxKjUztzc30YsPKwHo5O3GaCpxsbLD11VK-zg8Dn-sNcKqFgTCF5pJTtc18E8Pg2cqgWn8wJ3M-xcEaX0pp87yJMlH18swRqMaFdHgc Oct 17 13:43:00.781622 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:43:00.781622 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:43:00.781622 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:43:00.781622 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:43:00.781622 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:43:00.781622 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:43:00.781622 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 20e047e6275b42d6b6d5776ea2121b03 Oct 17 13:43:00.781622 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ImagesNegativeTestJSON-1778978349 Oct 17 13:43:00.781622 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:43:00.781622 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:43:00.781622 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/20e047e6275b42d6b6d5776ea2121b03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/20e047e6275b42d6b6d5776ea2121b03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/20e047e6275b42d6b6d5776ea2121b03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_20e047e6275b42d6b6d5776ea2121b03", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:43:00.781622 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ImagesNegativeTestJSON-1778978349 Oct 17 13:43:00.781622 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 20e047e6275b42d6b6d5776ea2121b03 Oct 17 13:43:00.781622 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1778978349 Oct 17 13:43:00.781622 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ImagesNegativeTestJSON-1778978349-project Oct 17 13:43:00.781622 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:43:00.781622 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:43:00.781622 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: cb0410e9acbf42ff9f51b096b98d4975 Oct 17 13:43:00.781622 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ImagesNegativeTestJSON-1778978349-project Oct 17 13:43:00.781622 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 13:43:00.781622 n-d-854247-14 devstack@n-api.service[127017]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-321271452", "metadata": {"image_type": "test"}}} Oct 17 13:43:00.781622 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:43:00.781622 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance tempest-invalid-184530332 could not be found. Oct 17 13:43:00.781622 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'tempest-invalid-184530332', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-321271452', 'metadata': {'image_type': 'test'}}}} Oct 17 13:43:00.781622 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:43:00.781622 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:00.781622 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:43:00.781622 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:43:00.781622 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 17 13:43:00.781622 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 17 13:43:00.781622 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-184530332 could not be found. Oct 17 13:43:00.781622 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:43:00.781622 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:00.781622 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:43:00.781622 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:00.781622 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:00.781622 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:00.781622 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:43:00.781622 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:43:00.781622 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:43:00.781622 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:43:00.781622 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:43:00.781622 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:43:00.781622 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:43:00.781622 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:43:00.781622 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 17 13:43:00.781622 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 17 13:43:00.781622 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:43:00.781622 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:43:00.781622 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:43:00.781622 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:43:00.781622 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-184530332 could not be found. Oct 17 13:43:00.789009 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:43:00.789009 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:00.789009 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:43:00.789009 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:00.789009 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:00.789009 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:00.789009 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:43:00.789009 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:43:00.789009 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-184530332 could not be found. Oct 17 13:43:00.789009 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:43:00.790912 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f6a9b0b9-c63f-4dc4-8b24-fcfa8d9a047f tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:00.795401 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d6c680f2-6338-44e7-b059-759bfa36bf39 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Returning 404 to user: Instance tempest-invalid-184530332 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:43:00.802144 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d6c680f2-6338-44e7-b059-759bfa36bf39 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] 10.222.0.79 "POST /compute/v2.1/servers/tempest-invalid-184530332/action" status: 404 len: 100 microversion: 2.1 time: 0.070148 Oct 17 13:43:00.810118 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1132/2270] 10.222.0.79 () {60 vars in 1246 bytes} [Mon Oct 17 13:43:00 2022] POST /compute/v2.1/servers/tempest-invalid-184530332/action => generated 100 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:43:00.821867 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f6a9b0b9-c63f-4dc4-8b24-fcfa8d9a047f tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/240648df-7968-4bbe-ac94-08360eb1049e" status: 200 len: 1317 microversion: 2.1 time: 1.389220 Oct 17 13:43:00.822945 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1139/2271] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:59 2022] GET /compute/v2.1/servers/240648df-7968-4bbe-ac94-08360eb1049e => generated 1317 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:00.827855 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5e52ceb1-81b5-4d2a-9768-fe0b3724623b tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:00.828611 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5e52ceb1-81b5-4d2a-9768-fe0b3724623b tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] [instance: bc9feeff-1ac7-4267-9351-3f1560dede9b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:00.834794 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-91e3079b-f4f3-40f2-99ac-fc80162d04d7 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:00.835012 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5e52ceb1-81b5-4d2a-9768-fe0b3724623b tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:00.835588 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5e52ceb1-81b5-4d2a-9768-fe0b3724623b tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:00.836120 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5e52ceb1-81b5-4d2a-9768-fe0b3724623b tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:00.836925 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5e52ceb1-81b5-4d2a-9768-fe0b3724623b tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:00.837484 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5e52ceb1-81b5-4d2a-9768-fe0b3724623b tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:00.838009 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5e52ceb1-81b5-4d2a-9768-fe0b3724623b tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:00.838280 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-91e3079b-f4f3-40f2-99ac-fc80162d04d7 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] [instance: 1088ec60-b26d-4082-bfa8-e01bf9af31f8] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:00.866534 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-91e3079b-f4f3-40f2-99ac-fc80162d04d7 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:00.867365 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-91e3079b-f4f3-40f2-99ac-fc80162d04d7 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:00.867976 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-91e3079b-f4f3-40f2-99ac-fc80162d04d7 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:00.868852 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-91e3079b-f4f3-40f2-99ac-fc80162d04d7 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:00.869456 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-91e3079b-f4f3-40f2-99ac-fc80162d04d7 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:00.870032 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-91e3079b-f4f3-40f2-99ac-fc80162d04d7 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:01.331921 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-91e3079b-f4f3-40f2-99ac-fc80162d04d7 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76e77dade0e441a79c2c4d77993172ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3134826eb154c71bb67718c36ff38cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:01.345134 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-91e3079b-f4f3-40f2-99ac-fc80162d04d7 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] 10.222.0.79 "GET /compute/v2.1/servers/1088ec60-b26d-4082-bfa8-e01bf9af31f8" status: 200 len: 1322 microversion: 2.1 time: 0.529020 Oct 17 13:43:01.346876 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1133/2272] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:00 2022] GET /compute/v2.1/servers/1088ec60-b26d-4082-bfa8-e01bf9af31f8 => generated 1322 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:01.395103 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2888b328-6be0-48df-98ed-f8d500894747 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2074139305"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:01.401582 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2888b328-6be0-48df-98ed-f8d500894747 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 17 13:43:01.405639 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-2888b328-6be0-48df-98ed-f8d500894747 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 17 13:43:01.409538 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2888b328-6be0-48df-98ed-f8d500894747 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Request method failure captured: Oct 17 13:43:01.409538 n-d-854247-14 devstack@n-api.service[127017]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 17 13:43:01.409538 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:43:01.409538 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:43:01.409538 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:43:01.409538 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 57 Oct 17 13:43:01.409538 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:43:01.409538 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:43:01.409538 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:43:01.409538 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:43:01.409538 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVu8qL3GeB0qpqBRBngnaxkzmvZZ97gdulySLngtTD_epSxXJWPia8QnluYtHTrGKtnAU-9tgxKjUztzc30YsPKwHo5O3GaCpxsbLD11VK-zg8Dn-sNcKqFgTCF5pJTtc18E8Pg2cqgWn8wJ3M-xcEaX0pp87yJMlH18swRqMaFdHgc Oct 17 13:43:01.409538 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:43:01.409538 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:43:01.409538 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:43:01.409538 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:43:01.409538 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:43:01.409538 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:43:01.409538 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 20e047e6275b42d6b6d5776ea2121b03 Oct 17 13:43:01.409538 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ImagesNegativeTestJSON-1778978349 Oct 17 13:43:01.409538 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:43:01.409538 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:43:01.409538 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/20e047e6275b42d6b6d5776ea2121b03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/20e047e6275b42d6b6d5776ea2121b03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/20e047e6275b42d6b6d5776ea2121b03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_20e047e6275b42d6b6d5776ea2121b03", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:43:01.409538 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ImagesNegativeTestJSON-1778978349 Oct 17 13:43:01.409538 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 20e047e6275b42d6b6d5776ea2121b03 Oct 17 13:43:01.409538 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1778978349 Oct 17 13:43:01.409538 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ImagesNegativeTestJSON-1778978349-project Oct 17 13:43:01.409538 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:43:01.409538 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:43:01.409538 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: cb0410e9acbf42ff9f51b096b98d4975 Oct 17 13:43:01.409538 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ImagesNegativeTestJSON-1778978349-project Oct 17 13:43:01.409538 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 13:43:01.409538 n-d-854247-14 devstack@n-api.service[127017]: {"createImage": {"name": "tempest-test-snap-2074139305"}} Oct 17 13:43:01.409538 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:43:01.409538 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 17 13:43:01.409538 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-2074139305'}}} Oct 17 13:43:01.409538 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:43:01.409538 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:01.409538 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:43:01.409538 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:43:01.409538 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 17 13:43:01.409538 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 17 13:43:01.409538 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 17 13:43:01.409538 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:43:01.409538 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:01.409538 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:43:01.409538 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:01.409538 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:01.409538 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:01.409538 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:43:01.409538 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:43:01.409538 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:43:01.409538 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:43:01.409538 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:43:01.409538 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:43:01.409538 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:43:01.409538 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:43:01.409538 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 17 13:43:01.409538 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 17 13:43:01.409538 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:43:01.409538 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:43:01.409538 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:43:01.409538 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:43:01.409538 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 17 13:43:01.409538 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:43:01.412935 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:01.412935 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:43:01.412935 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:01.412935 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:01.412935 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:01.412935 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:43:01.412935 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:43:01.412935 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 17 13:43:01.412935 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:43:01.417606 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2888b328-6be0-48df-98ed-f8d500894747 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:43:01.421198 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2888b328-6be0-48df-98ed-f8d500894747 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] 10.222.0.79 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.045946 Oct 17 13:43:01.422180 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1134/2273] 10.222.0.79 () {60 vars in 1275 bytes} [Mon Oct 17 13:43:01 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:43:01.432206 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-321f6bd3-dca3-426f-9a76-7f49019a1f6e tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:01.433221 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-321f6bd3-dca3-426f-9a76-7f49019a1f6e tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] [instance: 2184ae8f-022d-4de9-8d0f-0c2d546c9d6f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:01.469367 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-321f6bd3-dca3-426f-9a76-7f49019a1f6e tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:01.470203 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-321f6bd3-dca3-426f-9a76-7f49019a1f6e tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:01.470874 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-321f6bd3-dca3-426f-9a76-7f49019a1f6e tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:01.471836 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-321f6bd3-dca3-426f-9a76-7f49019a1f6e tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:01.472498 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-321f6bd3-dca3-426f-9a76-7f49019a1f6e tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:01.472605 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5e52ceb1-81b5-4d2a-9768-fe0b3724623b tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185235bc4e3245fc8d92b7e4bff6cbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c0147c5fae4017810887843b0afaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:01.473286 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-321f6bd3-dca3-426f-9a76-7f49019a1f6e tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:01.484131 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5e52ceb1-81b5-4d2a-9768-fe0b3724623b tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "GET /compute/v2.1/servers/bc9feeff-1ac7-4267-9351-3f1560dede9b" status: 200 len: 1646 microversion: 2.1 time: 0.660019 Oct 17 13:43:01.485903 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1140/2274] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:00 2022] GET /compute/v2.1/servers/bc9feeff-1ac7-4267-9351-3f1560dede9b => generated 1646 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:01.497312 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7eb67740-cec6-4866-8ee8-44d71f660271 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1451775983"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:01.500046 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7eb67740-cec6-4866-8ee8-44d71f660271 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 17 13:43:01.505587 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-7eb67740-cec6-4866-8ee8-44d71f660271 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 17 13:43:01.507382 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7eb67740-cec6-4866-8ee8-44d71f660271 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Request method failure captured: Oct 17 13:43:01.507382 n-d-854247-14 devstack@n-api.service[127016]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 17 13:43:01.507382 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:43:01.507382 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:43:01.507382 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:43:01.507382 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 57 Oct 17 13:43:01.507382 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:43:01.507382 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:43:01.507382 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:43:01.507382 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:43:01.507382 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVu8qL3GeB0qpqBRBngnaxkzmvZZ97gdulySLngtTD_epSxXJWPia8QnluYtHTrGKtnAU-9tgxKjUztzc30YsPKwHo5O3GaCpxsbLD11VK-zg8Dn-sNcKqFgTCF5pJTtc18E8Pg2cqgWn8wJ3M-xcEaX0pp87yJMlH18swRqMaFdHgc Oct 17 13:43:01.507382 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:43:01.507382 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:43:01.507382 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:43:01.507382 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:43:01.507382 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:43:01.507382 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:43:01.507382 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 20e047e6275b42d6b6d5776ea2121b03 Oct 17 13:43:01.507382 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ImagesNegativeTestJSON-1778978349 Oct 17 13:43:01.507382 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:43:01.507382 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:43:01.507382 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/20e047e6275b42d6b6d5776ea2121b03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/20e047e6275b42d6b6d5776ea2121b03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/20e047e6275b42d6b6d5776ea2121b03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_20e047e6275b42d6b6d5776ea2121b03", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:43:01.507382 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ImagesNegativeTestJSON-1778978349 Oct 17 13:43:01.507382 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 20e047e6275b42d6b6d5776ea2121b03 Oct 17 13:43:01.507382 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1778978349 Oct 17 13:43:01.507382 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ImagesNegativeTestJSON-1778978349-project Oct 17 13:43:01.507382 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:43:01.507382 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:43:01.507382 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: cb0410e9acbf42ff9f51b096b98d4975 Oct 17 13:43:01.507382 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ImagesNegativeTestJSON-1778978349-project Oct 17 13:43:01.507382 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:43:01.507382 n-d-854247-14 devstack@n-api.service[127016]: {"createImage": {"name": "tempest-test-snap-1451775983"}} Oct 17 13:43:01.507382 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:43:01.507382 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 17 13:43:01.507382 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1451775983'}}} Oct 17 13:43:01.507382 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:43:01.507382 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:01.507382 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:43:01.507382 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:43:01.507382 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 17 13:43:01.507382 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 17 13:43:01.507382 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 17 13:43:01.507382 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:01.507382 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:01.507382 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:01.507382 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:01.507382 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:01.507382 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:01.507382 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:43:01.507382 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:43:01.507382 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:43:01.507382 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:43:01.507382 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:43:01.507382 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:43:01.507382 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:43:01.507382 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:43:01.507382 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 17 13:43:01.507382 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 17 13:43:01.507382 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:43:01.507382 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:43:01.507382 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:43:01.507382 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:43:01.507382 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 17 13:43:01.507382 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:01.511584 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:01.511584 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:01.511584 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:01.511584 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:01.511584 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:01.511584 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:43:01.511584 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:43:01.511584 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 17 13:43:01.511584 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:01.513751 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7eb67740-cec6-4866-8ee8-44d71f660271 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:43:01.515548 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7eb67740-cec6-4866-8ee8-44d71f660271 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] 10.222.0.79 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.028658 Oct 17 13:43:01.524240 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1141/2275] 10.222.0.79 () {60 vars in 1281 bytes} [Mon Oct 17 13:43:01 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:43:01.534300 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7096cfc5-c232-4955-89ee-1eaa6f171365 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:01.535052 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7096cfc5-c232-4955-89ee-1eaa6f171365 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] [instance: 6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:01.554019 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7096cfc5-c232-4955-89ee-1eaa6f171365 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:01.554829 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7096cfc5-c232-4955-89ee-1eaa6f171365 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:01.555480 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7096cfc5-c232-4955-89ee-1eaa6f171365 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:01.556353 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7096cfc5-c232-4955-89ee-1eaa6f171365 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:01.556965 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7096cfc5-c232-4955-89ee-1eaa6f171365 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:01.557519 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7096cfc5-c232-4955-89ee-1eaa6f171365 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:01.579683 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-7096cfc5-c232-4955-89ee-1eaa6f171365 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] HTTP exception thrown: Instance 6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37 could not be found. Oct 17 13:43:01.591912 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7096cfc5-c232-4955-89ee-1eaa6f171365 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Request method failure captured: Oct 17 13:43:01.591912 n-d-854247-14 devstack@n-api.service[127016]: request: DELETE /compute/v2.1/servers/6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37 HTTP/1.1 Oct 17 13:43:01.591912 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:43:01.591912 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:43:01.591912 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:43:01.591912 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:43:01.591912 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:43:01.591912 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:43:01.591912 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:43:01.591912 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:43:01.591912 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVu8qL3GeB0qpqBRBngnaxkzmvZZ97gdulySLngtTD_epSxXJWPia8QnluYtHTrGKtnAU-9tgxKjUztzc30YsPKwHo5O3GaCpxsbLD11VK-zg8Dn-sNcKqFgTCF5pJTtc18E8Pg2cqgWn8wJ3M-xcEaX0pp87yJMlH18swRqMaFdHgc Oct 17 13:43:01.591912 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:43:01.591912 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:43:01.591912 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:43:01.591912 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:43:01.591912 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:43:01.591912 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:43:01.591912 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 20e047e6275b42d6b6d5776ea2121b03 Oct 17 13:43:01.591912 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ImagesNegativeTestJSON-1778978349 Oct 17 13:43:01.591912 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:43:01.591912 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:43:01.591912 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/20e047e6275b42d6b6d5776ea2121b03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/20e047e6275b42d6b6d5776ea2121b03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/20e047e6275b42d6b6d5776ea2121b03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_20e047e6275b42d6b6d5776ea2121b03", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:43:01.591912 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ImagesNegativeTestJSON-1778978349 Oct 17 13:43:01.591912 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 20e047e6275b42d6b6d5776ea2121b03 Oct 17 13:43:01.591912 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1778978349 Oct 17 13:43:01.591912 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ImagesNegativeTestJSON-1778978349-project Oct 17 13:43:01.591912 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:43:01.591912 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:43:01.591912 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: cb0410e9acbf42ff9f51b096b98d4975 Oct 17 13:43:01.591912 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ImagesNegativeTestJSON-1778978349-project Oct 17 13:43:01.591912 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:43:01.591912 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37 could not be found. Oct 17 13:43:01.591912 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37'} Oct 17 13:43:01.591912 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:43:01.591912 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:01.591912 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:43:01.591912 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:43:01.591912 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:43:01.591912 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:43:01.591912 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:43:01.591912 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:43:01.591912 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:43:01.591912 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:43:01.591912 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37 could not be found. Oct 17 13:43:01.591912 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:01.591912 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:01.591912 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:01.591912 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:01.591912 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:01.591912 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:01.591912 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:43:01.591912 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:43:01.591912 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:43:01.591912 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:43:01.591912 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:43:01.591912 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:43:01.591912 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:43:01.591912 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:43:01.591912 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:43:01.591912 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:43:01.591912 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:43:01.591912 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:43:01.595736 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37 could not be found. Oct 17 13:43:01.595736 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:01.595736 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:01.595736 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:01.595736 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:01.595736 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:01.595736 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:01.595736 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:43:01.595736 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:43:01.595736 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37 could not be found. Oct 17 13:43:01.595736 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:01.597532 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7096cfc5-c232-4955-89ee-1eaa6f171365 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Returning 404 to user: Instance 6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:43:01.598544 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7096cfc5-c232-4955-89ee-1eaa6f171365 tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] 10.222.0.79 "DELETE /compute/v2.1/servers/6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37" status: 404 len: 111 microversion: 2.1 time: 0.068191 Oct 17 13:43:01.599280 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1142/2276] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:43:01 2022] DELETE /compute/v2.1/servers/6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:43:01.607587 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-99d11d8e-4dbd-4c59-bee8-24646a347dfe tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:01.610277 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-99d11d8e-4dbd-4c59-bee8-24646a347dfe tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] [instance: 6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:01.623830 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-99d11d8e-4dbd-4c59-bee8-24646a347dfe tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:01.624477 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-99d11d8e-4dbd-4c59-bee8-24646a347dfe tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:01.632484 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-99d11d8e-4dbd-4c59-bee8-24646a347dfe tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:01.633352 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-99d11d8e-4dbd-4c59-bee8-24646a347dfe tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:01.633842 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-99d11d8e-4dbd-4c59-bee8-24646a347dfe tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:01.638646 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-99d11d8e-4dbd-4c59-bee8-24646a347dfe tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:01.668002 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-99d11d8e-4dbd-4c59-bee8-24646a347dfe tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] HTTP exception thrown: Instance 6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37 could not be found. Oct 17 13:43:01.678707 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-99d11d8e-4dbd-4c59-bee8-24646a347dfe tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Request method failure captured: Oct 17 13:43:01.678707 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37 HTTP/1.1 Oct 17 13:43:01.678707 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:43:01.678707 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:43:01.678707 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:43:01.678707 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:43:01.678707 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:43:01.678707 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:43:01.678707 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:43:01.678707 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:43:01.678707 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVu8qL3GeB0qpqBRBngnaxkzmvZZ97gdulySLngtTD_epSxXJWPia8QnluYtHTrGKtnAU-9tgxKjUztzc30YsPKwHo5O3GaCpxsbLD11VK-zg8Dn-sNcKqFgTCF5pJTtc18E8Pg2cqgWn8wJ3M-xcEaX0pp87yJMlH18swRqMaFdHgc Oct 17 13:43:01.678707 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:43:01.678707 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:43:01.678707 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:43:01.678707 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:43:01.678707 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:43:01.678707 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:43:01.678707 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 20e047e6275b42d6b6d5776ea2121b03 Oct 17 13:43:01.678707 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ImagesNegativeTestJSON-1778978349 Oct 17 13:43:01.678707 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:43:01.678707 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:43:01.678707 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/20e047e6275b42d6b6d5776ea2121b03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/20e047e6275b42d6b6d5776ea2121b03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/20e047e6275b42d6b6d5776ea2121b03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_20e047e6275b42d6b6d5776ea2121b03", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:43:01.678707 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ImagesNegativeTestJSON-1778978349 Oct 17 13:43:01.678707 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 20e047e6275b42d6b6d5776ea2121b03 Oct 17 13:43:01.678707 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1778978349 Oct 17 13:43:01.678707 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ImagesNegativeTestJSON-1778978349-project Oct 17 13:43:01.678707 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:43:01.678707 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:43:01.678707 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: cb0410e9acbf42ff9f51b096b98d4975 Oct 17 13:43:01.678707 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ImagesNegativeTestJSON-1778978349-project Oct 17 13:43:01.678707 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:43:01.678707 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37 could not be found. Oct 17 13:43:01.678707 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37'} Oct 17 13:43:01.678707 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:43:01.678707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:01.678707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:43:01.678707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:43:01.678707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:43:01.678707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:43:01.678707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:43:01.678707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:43:01.678707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:43:01.678707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:43:01.678707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37 could not be found. Oct 17 13:43:01.678707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:01.678707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:01.678707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:01.678707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:01.678707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:01.678707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:01.678707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:43:01.678707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:43:01.678707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:43:01.678707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:43:01.678707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:43:01.678707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:43:01.678707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:43:01.678707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:43:01.678707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:43:01.678707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:43:01.678707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37 could not be found. Oct 17 13:43:01.678707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:01.678707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:01.678707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:01.682458 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:01.682458 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:01.682458 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:01.682458 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:43:01.682458 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:43:01.682458 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37 could not be found. Oct 17 13:43:01.682458 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:01.682458 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-99d11d8e-4dbd-4c59-bee8-24646a347dfe tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] Returning 404 to user: Instance 6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:43:01.682458 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-99d11d8e-4dbd-4c59-bee8-24646a347dfe tempest-ImagesNegativeTestJSON-1778978349 tempest-ImagesNegativeTestJSON-1778978349-project] 10.222.0.79 "GET /compute/v2.1/servers/6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37" status: 404 len: 111 microversion: 2.1 time: 0.077110 Oct 17 13:43:01.682458 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1143/2277] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:01 2022] GET /compute/v2.1/servers/6d9cca44-e8d2-4dc7-b8d7-177cf9e19a37 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:43:01.690615 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-4b8c425e-e3f6-4317-a90c-9c676eeb66ab req-de3b47cd-d225-4fe5-9c17-ca1984a07c2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "165d4143-55b3-4c2d-a08f-a5ae5352c934", "tag": "427436f1-8c1c-458e-9e9d-ee0c9ee68351"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:01.724520 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-4b8c425e-e3f6-4317-a90c-9c676eeb66ab req-de3b47cd-d225-4fe5-9c17-ca1984a07c2e service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:01.724924 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-4b8c425e-e3f6-4317-a90c-9c676eeb66ab req-de3b47cd-d225-4fe5-9c17-ca1984a07c2e service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:01.726927 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-4b8c425e-e3f6-4317-a90c-9c676eeb66ab req-de3b47cd-d225-4fe5-9c17-ca1984a07c2e service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:01.744922 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-4b8c425e-e3f6-4317-a90c-9c676eeb66ab req-de3b47cd-d225-4fe5-9c17-ca1984a07c2e service nova] Creating event network-changed:427436f1-8c1c-458e-9e9d-ee0c9ee68351 for instance 165d4143-55b3-4c2d-a08f-a5ae5352c934 on n-h2-854247-14 Oct 17 13:43:01.754221 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-4b8c425e-e3f6-4317-a90c-9c676eeb66ab req-de3b47cd-d225-4fe5-9c17-ca1984a07c2e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071639 Oct 17 13:43:01.755732 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1144/2278] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:43:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:43:01.867626 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-035e5fb6-8c16-4d78-bc81-401d1ee4333d tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:01.868834 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-035e5fb6-8c16-4d78-bc81-401d1ee4333d tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 240648df-7968-4bbe-ac94-08360eb1049e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:01.924855 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-035e5fb6-8c16-4d78-bc81-401d1ee4333d tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:01.930354 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-035e5fb6-8c16-4d78-bc81-401d1ee4333d tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:01.932928 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-035e5fb6-8c16-4d78-bc81-401d1ee4333d tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:01.939351 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-035e5fb6-8c16-4d78-bc81-401d1ee4333d tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:01.944495 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-035e5fb6-8c16-4d78-bc81-401d1ee4333d tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:01.952643 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-035e5fb6-8c16-4d78-bc81-401d1ee4333d tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:02.121299 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-321f6bd3-dca3-426f-9a76-7f49019a1f6e tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799d72ccad514fd899d21809d613249b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb50742d06f403598634414befbeb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:02.145090 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-321f6bd3-dca3-426f-9a76-7f49019a1f6e tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] 10.222.0.79 "GET /compute/v2.1/servers/2184ae8f-022d-4de9-8d0f-0c2d546c9d6f" status: 200 len: 1372 microversion: 2.1 time: 0.720384 Oct 17 13:43:02.150837 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1135/2279] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:01 2022] GET /compute/v2.1/servers/2184ae8f-022d-4de9-8d0f-0c2d546c9d6f => generated 1372 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:02.182252 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-1bf2fe57-c266-4385-9d9b-8ef61245a14e req-893b7133-a265-4059-85df-63336b466351 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "240648df-7968-4bbe-ac94-08360eb1049e", "name": "network-vif-plugged", "status": "completed", "tag": "bb16bb6b-77f3-4d30-922f-0b42e294e0ec"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:02.225600 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-1bf2fe57-c266-4385-9d9b-8ef61245a14e req-893b7133-a265-4059-85df-63336b466351 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:02.227926 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-1bf2fe57-c266-4385-9d9b-8ef61245a14e req-893b7133-a265-4059-85df-63336b466351 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:02.230065 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-1bf2fe57-c266-4385-9d9b-8ef61245a14e req-893b7133-a265-4059-85df-63336b466351 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:02.265205 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-1bf2fe57-c266-4385-9d9b-8ef61245a14e req-893b7133-a265-4059-85df-63336b466351 service nova] Creating event network-vif-plugged:bb16bb6b-77f3-4d30-922f-0b42e294e0ec for instance 240648df-7968-4bbe-ac94-08360eb1049e on n-h2-854247-14 Oct 17 13:43:02.280043 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-1bf2fe57-c266-4385-9d9b-8ef61245a14e req-893b7133-a265-4059-85df-63336b466351 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124301 Oct 17 13:43:02.284871 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1136/2280] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:43:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:43:02.382331 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b334e439-2778-4504-a81d-e7b4be4b10f2 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:02.383290 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b334e439-2778-4504-a81d-e7b4be4b10f2 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] [instance: 1088ec60-b26d-4082-bfa8-e01bf9af31f8] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:02.389441 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=8 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:43:02.397815 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=16 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:43:02.438999 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b334e439-2778-4504-a81d-e7b4be4b10f2 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:02.439572 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b334e439-2778-4504-a81d-e7b4be4b10f2 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:02.442561 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b334e439-2778-4504-a81d-e7b4be4b10f2 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:02.444752 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b334e439-2778-4504-a81d-e7b4be4b10f2 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:02.445246 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b334e439-2778-4504-a81d-e7b4be4b10f2 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:02.445716 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b334e439-2778-4504-a81d-e7b4be4b10f2 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:03.022979 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-035e5fb6-8c16-4d78-bc81-401d1ee4333d tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:03.041273 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-035e5fb6-8c16-4d78-bc81-401d1ee4333d tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/240648df-7968-4bbe-ac94-08360eb1049e" status: 200 len: 1317 microversion: 2.1 time: 1.180316 Oct 17 13:43:03.041967 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1145/2281] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:01 2022] GET /compute/v2.1/servers/240648df-7968-4bbe-ac94-08360eb1049e => generated 1317 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:43:03.057512 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b25b7184-7aaa-470c-b75b-4682180ee392 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:03.059881 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b25b7184-7aaa-470c-b75b-4682180ee392 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] [instance: bc9feeff-1ac7-4267-9351-3f1560dede9b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:03.077702 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b25b7184-7aaa-470c-b75b-4682180ee392 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:03.078279 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b25b7184-7aaa-470c-b75b-4682180ee392 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:03.083706 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b25b7184-7aaa-470c-b75b-4682180ee392 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:03.087900 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b25b7184-7aaa-470c-b75b-4682180ee392 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:03.088485 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b25b7184-7aaa-470c-b75b-4682180ee392 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:03.089055 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b25b7184-7aaa-470c-b75b-4682180ee392 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:03.695867 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b25b7184-7aaa-470c-b75b-4682180ee392 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185235bc4e3245fc8d92b7e4bff6cbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c0147c5fae4017810887843b0afaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:03.731066 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b25b7184-7aaa-470c-b75b-4682180ee392 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "GET /compute/v2.1/servers/bc9feeff-1ac7-4267-9351-3f1560dede9b" status: 200 len: 1646 microversion: 2.1 time: 0.684147 Oct 17 13:43:03.732250 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1146/2282] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:03 2022] GET /compute/v2.1/servers/bc9feeff-1ac7-4267-9351-3f1560dede9b => generated 1646 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:03.781932 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-ebe82653-000a-46f1-9539-29248face550 req-4c521ec9-8631-4e28-b438-4d2ae9b1b4a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2184ae8f-022d-4de9-8d0f-0c2d546c9d6f", "tag": "39e1f2c4-d66a-48e8-b02b-3e21dd1312ae"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:03.787660 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=9,nova_api:UPDATE=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:43:03.806455 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-ebe82653-000a-46f1-9539-29248face550 req-4c521ec9-8631-4e28-b438-4d2ae9b1b4a1 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:03.810240 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-ebe82653-000a-46f1-9539-29248face550 req-4c521ec9-8631-4e28-b438-4d2ae9b1b4a1 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:03.812860 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-ebe82653-000a-46f1-9539-29248face550 req-4c521ec9-8631-4e28-b438-4d2ae9b1b4a1 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:03.847848 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-ebe82653-000a-46f1-9539-29248face550 req-4c521ec9-8631-4e28-b438-4d2ae9b1b4a1 service nova] Creating event network-changed:39e1f2c4-d66a-48e8-b02b-3e21dd1312ae for instance 2184ae8f-022d-4de9-8d0f-0c2d546c9d6f on n-h1-854247-14 Oct 17 13:43:03.856051 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-ebe82653-000a-46f1-9539-29248face550 req-4c521ec9-8631-4e28-b438-4d2ae9b1b4a1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096152 Oct 17 13:43:03.859536 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1147/2283] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:43:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:43:03.870475 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9c70fa2d-eff9-46de-acf7-bed7018fc995 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:03.871211 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9c70fa2d-eff9-46de-acf7-bed7018fc995 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] [instance: 2184ae8f-022d-4de9-8d0f-0c2d546c9d6f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:03.894958 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c70fa2d-eff9-46de-acf7-bed7018fc995 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:03.896799 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c70fa2d-eff9-46de-acf7-bed7018fc995 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:03.896799 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c70fa2d-eff9-46de-acf7-bed7018fc995 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:03.899233 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c70fa2d-eff9-46de-acf7-bed7018fc995 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:03.901848 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c70fa2d-eff9-46de-acf7-bed7018fc995 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:03.904753 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c70fa2d-eff9-46de-acf7-bed7018fc995 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:04.036730 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b334e439-2778-4504-a81d-e7b4be4b10f2 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76e77dade0e441a79c2c4d77993172ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3134826eb154c71bb67718c36ff38cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:04.053407 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b334e439-2778-4504-a81d-e7b4be4b10f2 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] 10.222.0.79 "GET /compute/v2.1/servers/1088ec60-b26d-4082-bfa8-e01bf9af31f8" status: 200 len: 1322 microversion: 2.1 time: 1.679672 Oct 17 13:43:04.054449 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1137/2284] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:02 2022] GET /compute/v2.1/servers/1088ec60-b26d-4082-bfa8-e01bf9af31f8 => generated 1322 bytes in 1687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:04.074222 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e201fa76-53de-42fe-b947-5eca3b9543ba tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:04.075119 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e201fa76-53de-42fe-b947-5eca3b9543ba tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 240648df-7968-4bbe-ac94-08360eb1049e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:04.091973 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e201fa76-53de-42fe-b947-5eca3b9543ba tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:04.098143 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e201fa76-53de-42fe-b947-5eca3b9543ba tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:04.098816 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e201fa76-53de-42fe-b947-5eca3b9543ba tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:04.099617 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e201fa76-53de-42fe-b947-5eca3b9543ba tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:04.100087 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e201fa76-53de-42fe-b947-5eca3b9543ba tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:04.100504 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e201fa76-53de-42fe-b947-5eca3b9543ba tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:04.992447 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9c70fa2d-eff9-46de-acf7-bed7018fc995 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799d72ccad514fd899d21809d613249b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb50742d06f403598634414befbeb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:05.002228 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9c70fa2d-eff9-46de-acf7-bed7018fc995 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] 10.222.0.79 "GET /compute/v2.1/servers/2184ae8f-022d-4de9-8d0f-0c2d546c9d6f" status: 200 len: 1372 microversion: 2.1 time: 1.139595 Oct 17 13:43:05.007417 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1148/2285] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:03 2022] GET /compute/v2.1/servers/2184ae8f-022d-4de9-8d0f-0c2d546c9d6f => generated 1372 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:05.017554 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-980790c7-9c27-4c5d-ae2d-8cf3e3d7c214 req-ad5789d8-69c7-4b25-9713-606db2a3692e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f806fc0-61ef-4c0b-b6af-8f987148f5ca", "name": "network-vif-plugged", "status": "completed", "tag": "8852e286-0d94-4c6e-aeb7-c6b79afb6231"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:05.037185 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-980790c7-9c27-4c5d-ae2d-8cf3e3d7c214 req-ad5789d8-69c7-4b25-9713-606db2a3692e service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:05.043242 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-980790c7-9c27-4c5d-ae2d-8cf3e3d7c214 req-ad5789d8-69c7-4b25-9713-606db2a3692e service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:05.044039 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-980790c7-9c27-4c5d-ae2d-8cf3e3d7c214 req-ad5789d8-69c7-4b25-9713-606db2a3692e service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:05.080772 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-980790c7-9c27-4c5d-ae2d-8cf3e3d7c214 req-ad5789d8-69c7-4b25-9713-606db2a3692e service nova] Creating event network-vif-plugged:8852e286-0d94-4c6e-aeb7-c6b79afb6231 for instance 4f806fc0-61ef-4c0b-b6af-8f987148f5ca on n-h2-854247-14 Oct 17 13:43:05.104742 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-980790c7-9c27-4c5d-ae2d-8cf3e3d7c214 req-ad5789d8-69c7-4b25-9713-606db2a3692e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086386 Oct 17 13:43:05.105792 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1149/2286] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:43:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:43:05.121667 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2cb4e169-bff9-498e-a3e3-ec37b8a0d4dc tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:05.124355 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2cb4e169-bff9-498e-a3e3-ec37b8a0d4dc tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] [instance: bc9feeff-1ac7-4267-9351-3f1560dede9b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:05.153584 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2cb4e169-bff9-498e-a3e3-ec37b8a0d4dc tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:05.159053 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2cb4e169-bff9-498e-a3e3-ec37b8a0d4dc tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:05.159726 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2cb4e169-bff9-498e-a3e3-ec37b8a0d4dc tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:05.160478 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2cb4e169-bff9-498e-a3e3-ec37b8a0d4dc tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:05.161096 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2cb4e169-bff9-498e-a3e3-ec37b8a0d4dc tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:05.161522 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2cb4e169-bff9-498e-a3e3-ec37b8a0d4dc tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:05.343073 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e201fa76-53de-42fe-b947-5eca3b9543ba tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:05.382168 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e201fa76-53de-42fe-b947-5eca3b9543ba tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/240648df-7968-4bbe-ac94-08360eb1049e" status: 200 len: 1317 microversion: 2.1 time: 1.317081 Oct 17 13:43:05.412217 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1138/2287] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:04 2022] GET /compute/v2.1/servers/240648df-7968-4bbe-ac94-08360eb1049e => generated 1317 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:43:05.462179 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-58b73242-c3a3-44c1-aea5-fb4351af9f85 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:05.464488 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-58b73242-c3a3-44c1-aea5-fb4351af9f85 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] [instance: 1088ec60-b26d-4082-bfa8-e01bf9af31f8] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:05.478151 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-58b73242-c3a3-44c1-aea5-fb4351af9f85 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:05.478648 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-58b73242-c3a3-44c1-aea5-fb4351af9f85 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:05.479074 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-58b73242-c3a3-44c1-aea5-fb4351af9f85 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:05.479817 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-58b73242-c3a3-44c1-aea5-fb4351af9f85 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:05.480314 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-58b73242-c3a3-44c1-aea5-fb4351af9f85 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:05.481070 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-58b73242-c3a3-44c1-aea5-fb4351af9f85 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:06.292918 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-58b73242-c3a3-44c1-aea5-fb4351af9f85 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76e77dade0e441a79c2c4d77993172ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3134826eb154c71bb67718c36ff38cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:06.309794 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-58b73242-c3a3-44c1-aea5-fb4351af9f85 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] 10.222.0.79 "GET /compute/v2.1/servers/1088ec60-b26d-4082-bfa8-e01bf9af31f8" status: 200 len: 1322 microversion: 2.1 time: 0.890678 Oct 17 13:43:06.312571 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1139/2288] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:05 2022] GET /compute/v2.1/servers/1088ec60-b26d-4082-bfa8-e01bf9af31f8 => generated 1322 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:06.352132 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b53cffa9-f6ed-4709-aa39-6a42cc57d4d8 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1386779704", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "1fa43ed8-8e4b-47ac-aec2-8368253ad19e"}], "block_device_mapping_v2": [{"uuid": "0286ee9f-9ac9-4318-a020-1946bcc33cfe", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:06.457394 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-b53cffa9-f6ed-4709-aa39-6a42cc57d4d8 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] validate_networks() for [('1fa43ed8-8e4b-47ac-aec2-8368253ad19e', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:43:06.506584 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2cb4e169-bff9-498e-a3e3-ec37b8a0d4dc tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185235bc4e3245fc8d92b7e4bff6cbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c0147c5fae4017810887843b0afaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:06.527481 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2cb4e169-bff9-498e-a3e3-ec37b8a0d4dc tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "GET /compute/v2.1/servers/bc9feeff-1ac7-4267-9351-3f1560dede9b" status: 200 len: 1646 microversion: 2.1 time: 1.417786 Oct 17 13:43:06.530957 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1150/2289] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:05 2022] GET /compute/v2.1/servers/bc9feeff-1ac7-4267-9351-3f1560dede9b => generated 1646 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:06.549180 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-aeab0f62-bb38-46b7-ad00-22553cc3e1f4 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:06.555679 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-aeab0f62-bb38-46b7-ad00-22553cc3e1f4 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] [instance: 2184ae8f-022d-4de9-8d0f-0c2d546c9d6f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:06.573129 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aeab0f62-bb38-46b7-ad00-22553cc3e1f4 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:06.573632 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aeab0f62-bb38-46b7-ad00-22553cc3e1f4 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:06.577311 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aeab0f62-bb38-46b7-ad00-22553cc3e1f4 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:06.578149 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aeab0f62-bb38-46b7-ad00-22553cc3e1f4 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:06.578627 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aeab0f62-bb38-46b7-ad00-22553cc3e1f4 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:06.581329 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aeab0f62-bb38-46b7-ad00-22553cc3e1f4 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:08.713007 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-aeab0f62-bb38-46b7-ad00-22553cc3e1f4 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799d72ccad514fd899d21809d613249b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb50742d06f403598634414befbeb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:08.722613 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-aeab0f62-bb38-46b7-ad00-22553cc3e1f4 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] 10.222.0.79 "GET /compute/v2.1/servers/2184ae8f-022d-4de9-8d0f-0c2d546c9d6f" status: 200 len: 1372 microversion: 2.1 time: 2.188127 Oct 17 13:43:08.735559 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1151/2290] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:06 2022] GET /compute/v2.1/servers/2184ae8f-022d-4de9-8d0f-0c2d546c9d6f => generated 1372 bytes in 2198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:08.753118 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d386c012-00d9-4b90-b458-c06d2e3d6784 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:08.753755 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d386c012-00d9-4b90-b458-c06d2e3d6784 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 240648df-7968-4bbe-ac94-08360eb1049e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:08.769073 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d386c012-00d9-4b90-b458-c06d2e3d6784 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:08.780097 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d386c012-00d9-4b90-b458-c06d2e3d6784 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:08.780530 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d386c012-00d9-4b90-b458-c06d2e3d6784 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:08.781305 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d386c012-00d9-4b90-b458-c06d2e3d6784 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:08.781831 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d386c012-00d9-4b90-b458-c06d2e3d6784 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:08.782303 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d386c012-00d9-4b90-b458-c06d2e3d6784 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:08.822586 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=100 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:43:09.594110 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d386c012-00d9-4b90-b458-c06d2e3d6784 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:09.617334 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d386c012-00d9-4b90-b458-c06d2e3d6784 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/240648df-7968-4bbe-ac94-08360eb1049e" status: 200 len: 1507 microversion: 2.1 time: 0.882710 Oct 17 13:43:09.620462 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1152/2291] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:08 2022] GET /compute/v2.1/servers/240648df-7968-4bbe-ac94-08360eb1049e => generated 1507 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:09.632880 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-e1ad42d2-d26a-48d1-a109-c921a07f3982 req-81062299-427d-45fe-b3b1-28bff4878428 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc9feeff-1ac7-4267-9351-3f1560dede9b", "name": "network-vif-deleted", "tag": "821390e6-5b5f-4941-b743-c5c5ff8b7d80"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:09.668189 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-e1ad42d2-d26a-48d1-a109-c921a07f3982 req-81062299-427d-45fe-b3b1-28bff4878428 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:09.669330 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-e1ad42d2-d26a-48d1-a109-c921a07f3982 req-81062299-427d-45fe-b3b1-28bff4878428 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:09.670099 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-e1ad42d2-d26a-48d1-a109-c921a07f3982 req-81062299-427d-45fe-b3b1-28bff4878428 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:09.711028 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-e1ad42d2-d26a-48d1-a109-c921a07f3982 req-81062299-427d-45fe-b3b1-28bff4878428 service nova] Creating event network-vif-deleted:821390e6-5b5f-4941-b743-c5c5ff8b7d80 for instance bc9feeff-1ac7-4267-9351-3f1560dede9b on n-h1-854247-14 Oct 17 13:43:09.721724 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-e1ad42d2-d26a-48d1-a109-c921a07f3982 req-81062299-427d-45fe-b3b1-28bff4878428 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099616 Oct 17 13:43:09.728313 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1153/2292] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:43:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:43:09.734030 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-bec632b2-0bb1-4702-83ab-f67cae35c8db tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:09.745659 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-bec632b2-0bb1-4702-83ab-f67cae35c8db tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] [instance: 1088ec60-b26d-4082-bfa8-e01bf9af31f8] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:09.753515 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bec632b2-0bb1-4702-83ab-f67cae35c8db tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:09.764014 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bec632b2-0bb1-4702-83ab-f67cae35c8db tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:09.764837 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bec632b2-0bb1-4702-83ab-f67cae35c8db tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:09.765878 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bec632b2-0bb1-4702-83ab-f67cae35c8db tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:09.766563 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bec632b2-0bb1-4702-83ab-f67cae35c8db tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:09.767251 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bec632b2-0bb1-4702-83ab-f67cae35c8db tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:10.040121 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-b53cffa9-f6ed-4709-aa39-6a42cc57d4d8 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:43:10.040814 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-b53cffa9-f6ed-4709-aa39-6a42cc57d4d8 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:43:10.041090 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-b53cffa9-f6ed-4709-aa39-6a42cc57d4d8 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:43:10.041506 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-b53cffa9-f6ed-4709-aa39-6a42cc57d4d8 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:43:10.041919 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-b53cffa9-f6ed-4709-aa39-6a42cc57d4d8 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:43:10.065990 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b53cffa9-f6ed-4709-aa39-6a42cc57d4d8 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:10.066535 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b53cffa9-f6ed-4709-aa39-6a42cc57d4d8 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:10.066925 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b53cffa9-f6ed-4709-aa39-6a42cc57d4d8 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:10.067684 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b53cffa9-f6ed-4709-aa39-6a42cc57d4d8 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:10.081525 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b53cffa9-f6ed-4709-aa39-6a42cc57d4d8 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:10.081980 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b53cffa9-f6ed-4709-aa39-6a42cc57d4d8 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:10.139189 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-b53cffa9-f6ed-4709-aa39-6a42cc57d4d8 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Getting quotas for project 90d4540094b84255821c0ab95304d22a. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:43:10.144846 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-b53cffa9-f6ed-4709-aa39-6a42cc57d4d8 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Getting quotas for user 5bc3340d39404042af0eca8747874005 and project 90d4540094b84255821c0ab95304d22a. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:43:10.298381 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b53cffa9-f6ed-4709-aa39-6a42cc57d4d8 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:43:10.300559 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b53cffa9-f6ed-4709-aa39-6a42cc57d4d8 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: b1b0d02c-b32f-45cd-8732-99b1e3119ca6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0286ee9f-9ac9-4318-a020-1946bcc33cfe',volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:43:10.349018 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-bec632b2-0bb1-4702-83ab-f67cae35c8db tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76e77dade0e441a79c2c4d77993172ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3134826eb154c71bb67718c36ff38cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:10.359092 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-bec632b2-0bb1-4702-83ab-f67cae35c8db tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] 10.222.0.79 "GET /compute/v2.1/servers/1088ec60-b26d-4082-bfa8-e01bf9af31f8" status: 200 len: 1322 microversion: 2.1 time: 0.629172 Oct 17 13:43:10.360723 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1154/2293] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:09 2022] GET /compute/v2.1/servers/1088ec60-b26d-4082-bfa8-e01bf9af31f8 => generated 1322 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:10.368955 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-a6df5a12-f82d-4b81-bd4c-f4447fca4de4 req-69f0ea2a-5b64-4ffe-ad2a-f905167649d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1088ec60-b26d-4082-bfa8-e01bf9af31f8", "name": "network-vif-plugged", "status": "completed", "tag": "c922642f-3d80-4a95-ab40-d8ce583ebe8d"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:10.386630 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-a6df5a12-f82d-4b81-bd4c-f4447fca4de4 req-69f0ea2a-5b64-4ffe-ad2a-f905167649d2 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:10.387752 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-a6df5a12-f82d-4b81-bd4c-f4447fca4de4 req-69f0ea2a-5b64-4ffe-ad2a-f905167649d2 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:10.389372 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-a6df5a12-f82d-4b81-bd4c-f4447fca4de4 req-69f0ea2a-5b64-4ffe-ad2a-f905167649d2 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:10.414494 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-a6df5a12-f82d-4b81-bd4c-f4447fca4de4 req-69f0ea2a-5b64-4ffe-ad2a-f905167649d2 service nova] Creating event network-vif-plugged:c922642f-3d80-4a95-ab40-d8ce583ebe8d for instance 1088ec60-b26d-4082-bfa8-e01bf9af31f8 on n-h1-854247-14 Oct 17 13:43:10.433730 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-a6df5a12-f82d-4b81-bd4c-f4447fca4de4 req-69f0ea2a-5b64-4ffe-ad2a-f905167649d2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070687 Oct 17 13:43:10.438210 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1155/2294] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:43:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:43:10.446609 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-82f202f3-c247-47d3-978f-4ec7e271b31f tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:10.448319 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-82f202f3-c247-47d3-978f-4ec7e271b31f tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] [instance: bc9feeff-1ac7-4267-9351-3f1560dede9b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:10.458066 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-82f202f3-c247-47d3-978f-4ec7e271b31f tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:10.458954 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-82f202f3-c247-47d3-978f-4ec7e271b31f tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:10.459597 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-82f202f3-c247-47d3-978f-4ec7e271b31f tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:10.460660 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-82f202f3-c247-47d3-978f-4ec7e271b31f tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:10.461331 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-82f202f3-c247-47d3-978f-4ec7e271b31f tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:10.462040 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-82f202f3-c247-47d3-978f-4ec7e271b31f tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:10.484641 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-82f202f3-c247-47d3-978f-4ec7e271b31f tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] HTTP exception thrown: Instance bc9feeff-1ac7-4267-9351-3f1560dede9b could not be found. Oct 17 13:43:10.486712 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-82f202f3-c247-47d3-978f-4ec7e271b31f tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Request method failure captured: Oct 17 13:43:10.486712 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/bc9feeff-1ac7-4267-9351-3f1560dede9b HTTP/1.1 Oct 17 13:43:10.486712 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:43:10.486712 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:43:10.486712 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:43:10.486712 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:43:10.486712 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:43:10.486712 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:43:10.486712 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:43:10.486712 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:43:10.486712 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVtyFGyYtLVdwIq4ccz7RkXRa7NtlbhzSHc2HUbc2jnmH2QeepBwxbKf8toXm_ooPcHi9ET43LtT1AqXtRk9n6taXXPkcxvI9DAvMm-WduwoIrQJqrIBPqw0m6vAgqbSuo42q0EeC3f0tZCzBhE1QaAtaHcB-dTJTCp89NqtuNhDPjU Oct 17 13:43:10.486712 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:43:10.486712 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:43:10.486712 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:43:10.486712 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:43:10.486712 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:43:10.486712 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:43:10.486712 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 50c0147c5fae4017810887843b0afaa0 Oct 17 13:43:10.486712 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-SecurityGroupsTestJSON-1412652742 Oct 17 13:43:10.486712 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:43:10.486712 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:43:10.486712 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/50c0147c5fae4017810887843b0afaa0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/50c0147c5fae4017810887843b0afaa0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/50c0147c5fae4017810887843b0afaa0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_50c0147c5fae4017810887843b0afaa0", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:43:10.486712 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-SecurityGroupsTestJSON-1412652742 Oct 17 13:43:10.486712 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 50c0147c5fae4017810887843b0afaa0 Oct 17 13:43:10.486712 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1412652742 Oct 17 13:43:10.486712 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-SecurityGroupsTestJSON-1412652742-project Oct 17 13:43:10.486712 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:43:10.486712 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:43:10.486712 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 185235bc4e3245fc8d92b7e4bff6cbbd Oct 17 13:43:10.486712 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-SecurityGroupsTestJSON-1412652742-project Oct 17 13:43:10.486712 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:43:10.486712 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance bc9feeff-1ac7-4267-9351-3f1560dede9b could not be found. Oct 17 13:43:10.486712 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'bc9feeff-1ac7-4267-9351-3f1560dede9b'} Oct 17 13:43:10.486712 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:43:10.486712 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:10.486712 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:43:10.486712 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:43:10.486712 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:43:10.486712 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:43:10.486712 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:43:10.486712 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:43:10.486712 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:43:10.486712 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:43:10.486712 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc9feeff-1ac7-4267-9351-3f1560dede9b could not be found. Oct 17 13:43:10.486712 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:10.486712 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:10.486712 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:10.486712 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:10.486712 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:10.486712 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:10.486712 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:43:10.486712 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:43:10.486712 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:43:10.486712 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:43:10.486712 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:43:10.486712 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:43:10.486712 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:43:10.486712 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:43:10.486712 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:43:10.486712 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:43:10.486712 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc9feeff-1ac7-4267-9351-3f1560dede9b could not be found. Oct 17 13:43:10.486712 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:10.486712 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:10.486712 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:10.490359 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:10.490359 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:10.490359 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:10.490359 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:43:10.490359 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:43:10.490359 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc9feeff-1ac7-4267-9351-3f1560dede9b could not be found. Oct 17 13:43:10.490359 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:10.492466 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-82f202f3-c247-47d3-978f-4ec7e271b31f tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Returning 404 to user: Instance bc9feeff-1ac7-4267-9351-3f1560dede9b could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:43:10.493727 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-82f202f3-c247-47d3-978f-4ec7e271b31f tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "GET /compute/v2.1/servers/bc9feeff-1ac7-4267-9351-3f1560dede9b" status: 404 len: 111 microversion: 2.1 time: 0.053985 Oct 17 13:43:10.494768 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1156/2295] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:10 2022] GET /compute/v2.1/servers/bc9feeff-1ac7-4267-9351-3f1560dede9b => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:43:10.501419 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a3716328-1525-4730-b01c-f337f8aeed36 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:10.502462 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a3716328-1525-4730-b01c-f337f8aeed36 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 240648df-7968-4bbe-ac94-08360eb1049e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:10.511089 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a3716328-1525-4730-b01c-f337f8aeed36 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:10.511683 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a3716328-1525-4730-b01c-f337f8aeed36 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:10.512395 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a3716328-1525-4730-b01c-f337f8aeed36 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:10.513337 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a3716328-1525-4730-b01c-f337f8aeed36 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:10.513934 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a3716328-1525-4730-b01c-f337f8aeed36 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:10.514940 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a3716328-1525-4730-b01c-f337f8aeed36 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:10.550810 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b53cffa9-f6ed-4709-aa39-6a42cc57d4d8 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 4.179861 Oct 17 13:43:10.558649 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1140/2296] 10.222.0.79 () {62 vars in 1188 bytes} [Mon Oct 17 13:43:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 4245 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 13:43:10.574631 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-060ee65b-bb0a-46fa-87cd-2261d72705c5 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:10.575279 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-060ee65b-bb0a-46fa-87cd-2261d72705c5 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] [instance: 2184ae8f-022d-4de9-8d0f-0c2d546c9d6f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:10.598913 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-060ee65b-bb0a-46fa-87cd-2261d72705c5 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:10.599348 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-060ee65b-bb0a-46fa-87cd-2261d72705c5 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:10.599781 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-060ee65b-bb0a-46fa-87cd-2261d72705c5 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:10.600481 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-060ee65b-bb0a-46fa-87cd-2261d72705c5 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:10.600931 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-060ee65b-bb0a-46fa-87cd-2261d72705c5 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:10.601345 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-060ee65b-bb0a-46fa-87cd-2261d72705c5 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:11.114832 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a3716328-1525-4730-b01c-f337f8aeed36 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:11.125165 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a3716328-1525-4730-b01c-f337f8aeed36 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/240648df-7968-4bbe-ac94-08360eb1049e" status: 200 len: 1507 microversion: 2.1 time: 0.628757 Oct 17 13:43:11.126125 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1157/2297] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:10 2022] GET /compute/v2.1/servers/240648df-7968-4bbe-ac94-08360eb1049e => generated 1507 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:11.131481 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-66ac03ab-64fe-4069-b1de-3fafb8adf20c tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Calling method '.version_select at 0x7f7cd9861a60>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:11.183328 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-060ee65b-bb0a-46fa-87cd-2261d72705c5 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799d72ccad514fd899d21809d613249b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb50742d06f403598634414befbeb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:11.196192 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-060ee65b-bb0a-46fa-87cd-2261d72705c5 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] 10.222.0.79 "GET /compute/v2.1/servers/2184ae8f-022d-4de9-8d0f-0c2d546c9d6f" status: 200 len: 1372 microversion: 2.1 time: 0.636879 Oct 17 13:43:11.196797 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1141/2298] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:10 2022] GET /compute/v2.1/servers/2184ae8f-022d-4de9-8d0f-0c2d546c9d6f => generated 1372 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:11.204300 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6bf73239-75b3-49b9-bcf0-2a0086f93885 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:11.205253 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6bf73239-75b3-49b9-bcf0-2a0086f93885 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: b1b0d02c-b32f-45cd-8732-99b1e3119ca6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:11.212144 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6bf73239-75b3-49b9-bcf0-2a0086f93885 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:11.212889 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6bf73239-75b3-49b9-bcf0-2a0086f93885 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:11.213575 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6bf73239-75b3-49b9-bcf0-2a0086f93885 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:11.214693 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6bf73239-75b3-49b9-bcf0-2a0086f93885 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:11.215694 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6bf73239-75b3-49b9-bcf0-2a0086f93885 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:11.216303 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6bf73239-75b3-49b9-bcf0-2a0086f93885 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:11.319435 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6bf73239-75b3-49b9-bcf0-2a0086f93885 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:11.350274 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6bf73239-75b3-49b9-bcf0-2a0086f93885 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:11.353456 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6bf73239-75b3-49b9-bcf0-2a0086f93885 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:11.354625 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6bf73239-75b3-49b9-bcf0-2a0086f93885 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6" status: 200 len: 1185 microversion: 2.25 time: 0.154630 Oct 17 13:43:11.371290 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1142/2299] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:11 2022] GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6 => generated 1185 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:43:11.371290 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-44d2817c-c029-42a0-8b03-90fdf40ff2ba tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:11.373252 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-44d2817c-c029-42a0-8b03-90fdf40ff2ba tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 240648df-7968-4bbe-ac94-08360eb1049e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:11.411643 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-44d2817c-c029-42a0-8b03-90fdf40ff2ba tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:11.412422 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-44d2817c-c029-42a0-8b03-90fdf40ff2ba tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:11.413135 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-44d2817c-c029-42a0-8b03-90fdf40ff2ba tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:11.415323 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-44d2817c-c029-42a0-8b03-90fdf40ff2ba tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:11.416704 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-44d2817c-c029-42a0-8b03-90fdf40ff2ba tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:11.417419 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-44d2817c-c029-42a0-8b03-90fdf40ff2ba tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:11.558367 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-44d2817c-c029-42a0-8b03-90fdf40ff2ba tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "PUT /compute/v2.1/servers/240648df-7968-4bbe-ac94-08360eb1049e" status: 200 len: 1079 microversion: 2.1 time: 0.196069 Oct 17 13:43:11.572460 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1143/2300] 10.222.0.79 () {60 vars in 1256 bytes} [Mon Oct 17 13:43:11 2022] PUT /compute/v2.1/servers/240648df-7968-4bbe-ac94-08360eb1049e => generated 1079 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:11.584065 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ec6b355d-4776-4d16-bc32-a99bf83a3cda tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:11.584701 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ec6b355d-4776-4d16-bc32-a99bf83a3cda tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] [instance: 1088ec60-b26d-4082-bfa8-e01bf9af31f8] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:11.598581 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ec6b355d-4776-4d16-bc32-a99bf83a3cda tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:11.599073 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ec6b355d-4776-4d16-bc32-a99bf83a3cda tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:11.599567 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ec6b355d-4776-4d16-bc32-a99bf83a3cda tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:11.600270 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ec6b355d-4776-4d16-bc32-a99bf83a3cda tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:11.600722 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ec6b355d-4776-4d16-bc32-a99bf83a3cda tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:11.601146 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ec6b355d-4776-4d16-bc32-a99bf83a3cda tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:12.094551 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ec6b355d-4776-4d16-bc32-a99bf83a3cda tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76e77dade0e441a79c2c4d77993172ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3134826eb154c71bb67718c36ff38cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:12.106020 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ec6b355d-4776-4d16-bc32-a99bf83a3cda tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] 10.222.0.79 "GET /compute/v2.1/servers/1088ec60-b26d-4082-bfa8-e01bf9af31f8" status: 200 len: 1322 microversion: 2.1 time: 0.532248 Oct 17 13:43:12.106908 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1144/2301] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:11 2022] GET /compute/v2.1/servers/1088ec60-b26d-4082-bfa8-e01bf9af31f8 => generated 1322 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:12.126018 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-75324625-bcfd-4d5e-ac19-bff13cdeaf89 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:12.126939 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-75324625-bcfd-4d5e-ac19-bff13cdeaf89 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 240648df-7968-4bbe-ac94-08360eb1049e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:12.135697 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-75324625-bcfd-4d5e-ac19-bff13cdeaf89 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:12.136526 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-75324625-bcfd-4d5e-ac19-bff13cdeaf89 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:12.144402 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-75324625-bcfd-4d5e-ac19-bff13cdeaf89 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:12.145299 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-75324625-bcfd-4d5e-ac19-bff13cdeaf89 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:12.146104 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-75324625-bcfd-4d5e-ac19-bff13cdeaf89 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:12.146726 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-75324625-bcfd-4d5e-ac19-bff13cdeaf89 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:12.249641 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-66ac03ab-64fe-4069-b1de-3fafb8adf20c tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/40a5b24c-a168-4bdf-b5f8-8211a29d8c9f" status: 202 len: 0 microversion: 2.1 time: 1.122360 Oct 17 13:43:12.250745 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1158/2302] 10.222.0.79 () {58 vars in 1272 bytes} [Mon Oct 17 13:43:11 2022] DELETE /compute/v2.1/os-security-groups/40a5b24c-a168-4bdf-b5f8-8211a29d8c9f => generated 0 bytes in 1124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:43:12.256627 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d84db3f4-8e85-4666-ac1f-cff5fcbf2e2b tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:12.257494 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d84db3f4-8e85-4666-ac1f-cff5fcbf2e2b tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] [instance: 2184ae8f-022d-4de9-8d0f-0c2d546c9d6f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:12.265230 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d84db3f4-8e85-4666-ac1f-cff5fcbf2e2b tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:12.266350 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d84db3f4-8e85-4666-ac1f-cff5fcbf2e2b tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:12.266985 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d84db3f4-8e85-4666-ac1f-cff5fcbf2e2b tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:12.267905 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d84db3f4-8e85-4666-ac1f-cff5fcbf2e2b tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:12.268552 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d84db3f4-8e85-4666-ac1f-cff5fcbf2e2b tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:12.269150 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d84db3f4-8e85-4666-ac1f-cff5fcbf2e2b tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:12.553087 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-75324625-bcfd-4d5e-ac19-bff13cdeaf89 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:12.567888 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-75324625-bcfd-4d5e-ac19-bff13cdeaf89 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/240648df-7968-4bbe-ac94-08360eb1049e" status: 200 len: 1505 microversion: 2.1 time: 0.458055 Oct 17 13:43:12.568897 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1145/2303] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:12 2022] GET /compute/v2.1/servers/240648df-7968-4bbe-ac94-08360eb1049e => generated 1505 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:12.575556 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ac4be0ce-e900-4c61-971d-abc3b479cfe4 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Calling method '.version_select at 0x7f7cd5730310>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:12.634201 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d84db3f4-8e85-4666-ac1f-cff5fcbf2e2b tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799d72ccad514fd899d21809d613249b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb50742d06f403598634414befbeb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:12.645528 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d84db3f4-8e85-4666-ac1f-cff5fcbf2e2b tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] 10.222.0.79 "GET /compute/v2.1/servers/2184ae8f-022d-4de9-8d0f-0c2d546c9d6f" status: 200 len: 1372 microversion: 2.1 time: 0.393451 Oct 17 13:43:12.648881 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1159/2304] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:12 2022] GET /compute/v2.1/servers/2184ae8f-022d-4de9-8d0f-0c2d546c9d6f => generated 1372 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:12.660709 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ee7c88aa-28f2-4e0c-bc7f-67c6c367dcd2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:12.662424 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ee7c88aa-28f2-4e0c-bc7f-67c6c367dcd2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: b1b0d02c-b32f-45cd-8732-99b1e3119ca6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:12.680542 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ee7c88aa-28f2-4e0c-bc7f-67c6c367dcd2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:12.681320 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ee7c88aa-28f2-4e0c-bc7f-67c6c367dcd2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:12.681975 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ee7c88aa-28f2-4e0c-bc7f-67c6c367dcd2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:12.687218 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ee7c88aa-28f2-4e0c-bc7f-67c6c367dcd2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:12.688005 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ee7c88aa-28f2-4e0c-bc7f-67c6c367dcd2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:12.688661 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ee7c88aa-28f2-4e0c-bc7f-67c6c367dcd2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:12.837884 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ee7c88aa-28f2-4e0c-bc7f-67c6c367dcd2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:12.848160 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ee7c88aa-28f2-4e0c-bc7f-67c6c367dcd2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:12.862958 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ee7c88aa-28f2-4e0c-bc7f-67c6c367dcd2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:12.871524 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ee7c88aa-28f2-4e0c-bc7f-67c6c367dcd2 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6" status: 200 len: 1233 microversion: 2.25 time: 0.214825 Oct 17 13:43:12.872648 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1160/2305] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:12 2022] GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6 => generated 1233 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:43:12.881248 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-74b9e1ac-e2a1-4373-ad08-3d65392f35f6 req-4b4f8433-23b1-4dab-910e-937f6b93d454 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "165d4143-55b3-4c2d-a08f-a5ae5352c934", "name": "network-vif-plugged", "status": "completed", "tag": "427436f1-8c1c-458e-9e9d-ee0c9ee68351"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:12.906728 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-74b9e1ac-e2a1-4373-ad08-3d65392f35f6 req-4b4f8433-23b1-4dab-910e-937f6b93d454 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:12.907624 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-74b9e1ac-e2a1-4373-ad08-3d65392f35f6 req-4b4f8433-23b1-4dab-910e-937f6b93d454 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:12.908275 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-74b9e1ac-e2a1-4373-ad08-3d65392f35f6 req-4b4f8433-23b1-4dab-910e-937f6b93d454 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:12.932116 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-74b9e1ac-e2a1-4373-ad08-3d65392f35f6 req-4b4f8433-23b1-4dab-910e-937f6b93d454 service nova] Creating event network-vif-plugged:427436f1-8c1c-458e-9e9d-ee0c9ee68351 for instance 165d4143-55b3-4c2d-a08f-a5ae5352c934 on n-h2-854247-14 Oct 17 13:43:12.944710 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-74b9e1ac-e2a1-4373-ad08-3d65392f35f6 req-4b4f8433-23b1-4dab-910e-937f6b93d454 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070528 Oct 17 13:43:12.947834 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1161/2306] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:43:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:43:12.956129 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3171c069-7495-4efb-add1-7c1311833c20 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:12.961519 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3171c069-7495-4efb-add1-7c1311833c20 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 240648df-7968-4bbe-ac94-08360eb1049e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:12.983699 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3171c069-7495-4efb-add1-7c1311833c20 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:12.984719 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3171c069-7495-4efb-add1-7c1311833c20 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:12.985372 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3171c069-7495-4efb-add1-7c1311833c20 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:12.986202 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3171c069-7495-4efb-add1-7c1311833c20 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:12.986744 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3171c069-7495-4efb-add1-7c1311833c20 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:12.987404 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3171c069-7495-4efb-add1-7c1311833c20 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:13.438303 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ac4be0ce-e900-4c61-971d-abc3b479cfe4 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/d00eef40-614d-42f8-b3dd-328edb750eda" status: 202 len: 0 microversion: 2.1 time: 0.868029 Oct 17 13:43:13.445076 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1146/2307] 10.222.0.79 () {58 vars in 1272 bytes} [Mon Oct 17 13:43:12 2022] DELETE /compute/v2.1/os-security-groups/d00eef40-614d-42f8-b3dd-328edb750eda => generated 0 bytes in 875 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:43:13.450434 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3816fd67-460d-43c8-8fe4-9e1b1952ebe4 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:13.451062 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3816fd67-460d-43c8-8fe4-9e1b1952ebe4 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] [instance: 1088ec60-b26d-4082-bfa8-e01bf9af31f8] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:13.469984 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3816fd67-460d-43c8-8fe4-9e1b1952ebe4 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:13.470492 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3816fd67-460d-43c8-8fe4-9e1b1952ebe4 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:13.470934 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3816fd67-460d-43c8-8fe4-9e1b1952ebe4 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:13.481481 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3171c069-7495-4efb-add1-7c1311833c20 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:13.486558 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3816fd67-460d-43c8-8fe4-9e1b1952ebe4 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:13.487061 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3816fd67-460d-43c8-8fe4-9e1b1952ebe4 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:13.487531 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3816fd67-460d-43c8-8fe4-9e1b1952ebe4 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:13.494993 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3171c069-7495-4efb-add1-7c1311833c20 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/240648df-7968-4bbe-ac94-08360eb1049e" status: 200 len: 1505 microversion: 2.1 time: 0.545586 Oct 17 13:43:13.496358 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1162/2308] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:12 2022] GET /compute/v2.1/servers/240648df-7968-4bbe-ac94-08360eb1049e => generated 1505 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:13.507389 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8338b536-2fc5-4485-a132-1bb58a163ea0 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Action: 'create', calling method: .version_select at 0x7f7cd59a13a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1907123343", "description": "tempest-description-1068208299"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:13.987810 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3816fd67-460d-43c8-8fe4-9e1b1952ebe4 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76e77dade0e441a79c2c4d77993172ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3134826eb154c71bb67718c36ff38cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:14.001887 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3816fd67-460d-43c8-8fe4-9e1b1952ebe4 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] 10.222.0.79 "GET /compute/v2.1/servers/1088ec60-b26d-4082-bfa8-e01bf9af31f8" status: 200 len: 1515 microversion: 2.1 time: 0.555555 Oct 17 13:43:14.002499 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1147/2309] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:13 2022] GET /compute/v2.1/servers/1088ec60-b26d-4082-bfa8-e01bf9af31f8 => generated 1515 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:14.014697 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-84dafe11-633a-4027-bff7-9c51d94453d0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:14.019811 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-84dafe11-633a-4027-bff7-9c51d94453d0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 240648df-7968-4bbe-ac94-08360eb1049e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:14.051151 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-84dafe11-633a-4027-bff7-9c51d94453d0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:14.051687 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-84dafe11-633a-4027-bff7-9c51d94453d0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:14.052581 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-84dafe11-633a-4027-bff7-9c51d94453d0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:14.053309 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-84dafe11-633a-4027-bff7-9c51d94453d0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:14.053691 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-84dafe11-633a-4027-bff7-9c51d94453d0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:14.054163 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-84dafe11-633a-4027-bff7-9c51d94453d0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:14.221016 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:43:14.241898 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-84dafe11-633a-4027-bff7-9c51d94453d0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "PUT /compute/v2.1/servers/240648df-7968-4bbe-ac94-08360eb1049e" status: 200 len: 1081 microversion: 2.1 time: 0.232310 Oct 17 13:43:14.244185 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1148/2310] 10.222.0.79 () {60 vars in 1256 bytes} [Mon Oct 17 13:43:14 2022] PUT /compute/v2.1/servers/240648df-7968-4bbe-ac94-08360eb1049e => generated 1081 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:14.257358 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-871f8a1c-cdc0-49de-afe8-39470740bcc6 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:14.257358 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-871f8a1c-cdc0-49de-afe8-39470740bcc6 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] [instance: 2184ae8f-022d-4de9-8d0f-0c2d546c9d6f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:14.272267 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-871f8a1c-cdc0-49de-afe8-39470740bcc6 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:14.272765 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-871f8a1c-cdc0-49de-afe8-39470740bcc6 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:14.273206 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-871f8a1c-cdc0-49de-afe8-39470740bcc6 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:14.273917 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-871f8a1c-cdc0-49de-afe8-39470740bcc6 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:14.274376 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-871f8a1c-cdc0-49de-afe8-39470740bcc6 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:14.274821 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-871f8a1c-cdc0-49de-afe8-39470740bcc6 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:14.321758 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8338b536-2fc5-4485-a132-1bb58a163ea0 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.824293 Oct 17 13:43:14.323990 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1163/2311] 10.222.0.79 () {60 vars in 1180 bytes} [Mon Oct 17 13:43:13 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:43:14.335802 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9503c67e-d4b8-4043-a3a6-7197560709ef tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:14.338159 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9503c67e-d4b8-4043-a3a6-7197560709ef tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: b1b0d02c-b32f-45cd-8732-99b1e3119ca6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:14.362351 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9503c67e-d4b8-4043-a3a6-7197560709ef tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:14.364974 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9503c67e-d4b8-4043-a3a6-7197560709ef tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:14.366115 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9503c67e-d4b8-4043-a3a6-7197560709ef tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:14.369809 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9503c67e-d4b8-4043-a3a6-7197560709ef tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:14.371055 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9503c67e-d4b8-4043-a3a6-7197560709ef tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:14.374239 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9503c67e-d4b8-4043-a3a6-7197560709ef tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:14.545103 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9503c67e-d4b8-4043-a3a6-7197560709ef tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:14.572649 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9503c67e-d4b8-4043-a3a6-7197560709ef tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:14.582940 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9503c67e-d4b8-4043-a3a6-7197560709ef tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:14.584304 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9503c67e-d4b8-4043-a3a6-7197560709ef tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6" status: 200 len: 1251 microversion: 2.25 time: 0.258078 Oct 17 13:43:14.600951 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1164/2312] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:14 2022] GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6 => generated 1251 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:43:14.612644 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-95c0a8b4-3f7f-4908-b17d-5c8970d09bbd tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:14.613651 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-95c0a8b4-3f7f-4908-b17d-5c8970d09bbd tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] [instance: 165d4143-55b3-4c2d-a08f-a5ae5352c934] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:14.625621 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-95c0a8b4-3f7f-4908-b17d-5c8970d09bbd tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:14.627999 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-95c0a8b4-3f7f-4908-b17d-5c8970d09bbd tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:14.628769 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-95c0a8b4-3f7f-4908-b17d-5c8970d09bbd tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:14.631036 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-95c0a8b4-3f7f-4908-b17d-5c8970d09bbd tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:14.633673 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-95c0a8b4-3f7f-4908-b17d-5c8970d09bbd tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:14.634363 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-95c0a8b4-3f7f-4908-b17d-5c8970d09bbd tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:14.805036 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-871f8a1c-cdc0-49de-afe8-39470740bcc6 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799d72ccad514fd899d21809d613249b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb50742d06f403598634414befbeb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:14.814910 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-871f8a1c-cdc0-49de-afe8-39470740bcc6 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] 10.222.0.79 "GET /compute/v2.1/servers/2184ae8f-022d-4de9-8d0f-0c2d546c9d6f" status: 200 len: 1372 microversion: 2.1 time: 0.571178 Oct 17 13:43:14.817622 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1149/2313] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:14 2022] GET /compute/v2.1/servers/2184ae8f-022d-4de9-8d0f-0c2d546c9d6f => generated 1372 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:14.823419 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f827b5d7-86ba-400f-bf13-be9341fba9a9 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:14.824681 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f827b5d7-86ba-400f-bf13-be9341fba9a9 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 240648df-7968-4bbe-ac94-08360eb1049e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:14.831897 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f827b5d7-86ba-400f-bf13-be9341fba9a9 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:14.832790 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f827b5d7-86ba-400f-bf13-be9341fba9a9 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:14.833445 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f827b5d7-86ba-400f-bf13-be9341fba9a9 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:14.834647 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f827b5d7-86ba-400f-bf13-be9341fba9a9 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:14.835364 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f827b5d7-86ba-400f-bf13-be9341fba9a9 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:14.836038 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f827b5d7-86ba-400f-bf13-be9341fba9a9 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:15.520190 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-95c0a8b4-3f7f-4908-b17d-5c8970d09bbd tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76e77dade0e441a79c2c4d77993172ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3134826eb154c71bb67718c36ff38cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:15.534126 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-95c0a8b4-3f7f-4908-b17d-5c8970d09bbd tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] 10.222.0.79 "GET /compute/v2.1/servers/165d4143-55b3-4c2d-a08f-a5ae5352c934" status: 200 len: 1322 microversion: 2.1 time: 0.931796 Oct 17 13:43:15.536255 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1165/2314] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:14 2022] GET /compute/v2.1/servers/165d4143-55b3-4c2d-a08f-a5ae5352c934 => generated 1322 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:15.549469 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e7ad9bf9-0d18-430e-8492-ab2b3aa39da6 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Action: 'update', calling method: .version_select at 0x7f7cd98ad670>, body: {"security_group": {"name": "tempest-sg-hth-192364701", "description": "tempest-description-hth-1910175171"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:16.068871 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f827b5d7-86ba-400f-bf13-be9341fba9a9 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:16.089123 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f827b5d7-86ba-400f-bf13-be9341fba9a9 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/240648df-7968-4bbe-ac94-08360eb1049e" status: 200 len: 1507 microversion: 2.1 time: 1.270041 Oct 17 13:43:16.089838 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1150/2315] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:14 2022] GET /compute/v2.1/servers/240648df-7968-4bbe-ac94-08360eb1049e => generated 1507 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:16.103828 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-80794e6a-7445-4978-bfe5-20406731492e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:16.117007 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-80794e6a-7445-4978-bfe5-20406731492e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: b1b0d02c-b32f-45cd-8732-99b1e3119ca6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:16.160860 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-80794e6a-7445-4978-bfe5-20406731492e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:16.168351 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-80794e6a-7445-4978-bfe5-20406731492e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:16.169674 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-80794e6a-7445-4978-bfe5-20406731492e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:16.171073 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-80794e6a-7445-4978-bfe5-20406731492e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:16.172043 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-80794e6a-7445-4978-bfe5-20406731492e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:16.172617 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-80794e6a-7445-4978-bfe5-20406731492e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:16.366313 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-80794e6a-7445-4978-bfe5-20406731492e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:16.386820 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-80794e6a-7445-4978-bfe5-20406731492e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:16.388759 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-80794e6a-7445-4978-bfe5-20406731492e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:16.390122 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-80794e6a-7445-4978-bfe5-20406731492e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6" status: 200 len: 1251 microversion: 2.25 time: 0.294585 Oct 17 13:43:16.391258 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1151/2316] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:16 2022] GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6 => generated 1251 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:43:16.413264 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5e897b28-098d-48ab-8f8c-72bf35a3127a tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:16.414134 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5e897b28-098d-48ab-8f8c-72bf35a3127a tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] [instance: 2184ae8f-022d-4de9-8d0f-0c2d546c9d6f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:16.421041 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5e897b28-098d-48ab-8f8c-72bf35a3127a tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:16.424603 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5e897b28-098d-48ab-8f8c-72bf35a3127a tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:16.425211 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5e897b28-098d-48ab-8f8c-72bf35a3127a tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:16.426103 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5e897b28-098d-48ab-8f8c-72bf35a3127a tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:16.427704 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5e897b28-098d-48ab-8f8c-72bf35a3127a tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:16.431001 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5e897b28-098d-48ab-8f8c-72bf35a3127a tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:16.762210 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e7ad9bf9-0d18-430e-8492-ab2b3aa39da6 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "PUT /compute/v2.1/os-security-groups/c415a318-8e1e-49de-b20a-a86b4cc9598c" status: 200 len: 217 microversion: 2.1 time: 1.223012 Oct 17 13:43:16.762914 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1166/2317] 10.222.0.79 () {60 vars in 1290 bytes} [Mon Oct 17 13:43:15 2022] PUT /compute/v2.1/os-security-groups/c415a318-8e1e-49de-b20a-a86b4cc9598c => generated 217 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:43:16.768061 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-1ba86bfe-9b97-4acd-b477-f9a0fee8423f req-c879b618-7f1b-406b-a37f-1cb5e96ceebe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2184ae8f-022d-4de9-8d0f-0c2d546c9d6f", "name": "network-vif-plugged", "status": "completed", "tag": "39e1f2c4-d66a-48e8-b02b-3e21dd1312ae"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:16.792072 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-1ba86bfe-9b97-4acd-b477-f9a0fee8423f req-c879b618-7f1b-406b-a37f-1cb5e96ceebe service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:16.792964 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-1ba86bfe-9b97-4acd-b477-f9a0fee8423f req-c879b618-7f1b-406b-a37f-1cb5e96ceebe service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:16.793582 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-1ba86bfe-9b97-4acd-b477-f9a0fee8423f req-c879b618-7f1b-406b-a37f-1cb5e96ceebe service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:16.819853 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-1ba86bfe-9b97-4acd-b477-f9a0fee8423f req-c879b618-7f1b-406b-a37f-1cb5e96ceebe service nova] Creating event network-vif-plugged:39e1f2c4-d66a-48e8-b02b-3e21dd1312ae for instance 2184ae8f-022d-4de9-8d0f-0c2d546c9d6f on n-h1-854247-14 Oct 17 13:43:16.832552 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-1ba86bfe-9b97-4acd-b477-f9a0fee8423f req-c879b618-7f1b-406b-a37f-1cb5e96ceebe service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067962 Oct 17 13:43:16.841756 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1167/2318] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:43:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:43:16.847828 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-de07d88b-8a52-43f1-a18a-c0a80c8c7484 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:16.850712 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-de07d88b-8a52-43f1-a18a-c0a80c8c7484 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 240648df-7968-4bbe-ac94-08360eb1049e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:16.876905 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-de07d88b-8a52-43f1-a18a-c0a80c8c7484 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:16.879598 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-de07d88b-8a52-43f1-a18a-c0a80c8c7484 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:16.880975 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-de07d88b-8a52-43f1-a18a-c0a80c8c7484 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:16.884334 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-de07d88b-8a52-43f1-a18a-c0a80c8c7484 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:16.884829 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-de07d88b-8a52-43f1-a18a-c0a80c8c7484 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:16.885276 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-de07d88b-8a52-43f1-a18a-c0a80c8c7484 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:17.163658 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5e897b28-098d-48ab-8f8c-72bf35a3127a tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799d72ccad514fd899d21809d613249b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb50742d06f403598634414befbeb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:17.173081 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5e897b28-098d-48ab-8f8c-72bf35a3127a tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] 10.222.0.79 "GET /compute/v2.1/servers/2184ae8f-022d-4de9-8d0f-0c2d546c9d6f" status: 200 len: 1372 microversion: 2.1 time: 0.780481 Oct 17 13:43:17.173664 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1152/2319] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:16 2022] GET /compute/v2.1/servers/2184ae8f-022d-4de9-8d0f-0c2d546c9d6f => generated 1372 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:17.198237 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-cb4637a5-92a5-42e0-839d-284f1d37837e tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:17.200348 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-cb4637a5-92a5-42e0-839d-284f1d37837e tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] [instance: 165d4143-55b3-4c2d-a08f-a5ae5352c934] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:17.215761 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cb4637a5-92a5-42e0-839d-284f1d37837e tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:17.222025 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cb4637a5-92a5-42e0-839d-284f1d37837e tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:17.222640 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cb4637a5-92a5-42e0-839d-284f1d37837e tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:17.223437 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cb4637a5-92a5-42e0-839d-284f1d37837e tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:17.223904 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cb4637a5-92a5-42e0-839d-284f1d37837e tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:17.224321 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cb4637a5-92a5-42e0-839d-284f1d37837e tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:18.207771 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-de07d88b-8a52-43f1-a18a-c0a80c8c7484 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:18.224962 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-de07d88b-8a52-43f1-a18a-c0a80c8c7484 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/240648df-7968-4bbe-ac94-08360eb1049e" status: 200 len: 1507 microversion: 2.1 time: 1.379432 Oct 17 13:43:18.226658 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1168/2320] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:16 2022] GET /compute/v2.1/servers/240648df-7968-4bbe-ac94-08360eb1049e => generated 1507 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:18.236070 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-588009ad-5719-46ca-aab9-5f039d7b89de tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Calling method '.version_select at 0x7f7cd5474700>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:18.239642 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-cb4637a5-92a5-42e0-839d-284f1d37837e tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76e77dade0e441a79c2c4d77993172ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3134826eb154c71bb67718c36ff38cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:18.254630 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-cb4637a5-92a5-42e0-839d-284f1d37837e tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] 10.222.0.79 "GET /compute/v2.1/servers/165d4143-55b3-4c2d-a08f-a5ae5352c934" status: 200 len: 1515 microversion: 2.1 time: 1.069958 Oct 17 13:43:18.259369 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1153/2321] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:17 2022] GET /compute/v2.1/servers/165d4143-55b3-4c2d-a08f-a5ae5352c934 => generated 1515 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:18.264476 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-18f95934-5423-432e-8925-a83c70be9267 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:18.265101 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-18f95934-5423-432e-8925-a83c70be9267 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: b1b0d02c-b32f-45cd-8732-99b1e3119ca6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:18.298432 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-18f95934-5423-432e-8925-a83c70be9267 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:18.298989 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-18f95934-5423-432e-8925-a83c70be9267 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:18.299464 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-18f95934-5423-432e-8925-a83c70be9267 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:18.300193 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-18f95934-5423-432e-8925-a83c70be9267 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:18.300650 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-18f95934-5423-432e-8925-a83c70be9267 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:18.301078 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-18f95934-5423-432e-8925-a83c70be9267 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:18.547801 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-588009ad-5719-46ca-aab9-5f039d7b89de tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "GET /compute/v2.1/os-security-groups/c415a318-8e1e-49de-b20a-a86b4cc9598c" status: 200 len: 217 microversion: 2.1 time: 0.319372 Oct 17 13:43:18.549489 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1169/2322] 10.222.0.79 () {58 vars in 1269 bytes} [Mon Oct 17 13:43:18 2022] GET /compute/v2.1/os-security-groups/c415a318-8e1e-49de-b20a-a86b4cc9598c => generated 217 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:43:18.557788 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-13329279-3f8e-42b9-a9af-357eb0dcb31d tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:18.558578 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-13329279-3f8e-42b9-a9af-357eb0dcb31d tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] [instance: 2184ae8f-022d-4de9-8d0f-0c2d546c9d6f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:18.584895 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-13329279-3f8e-42b9-a9af-357eb0dcb31d tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:18.590439 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-13329279-3f8e-42b9-a9af-357eb0dcb31d tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:18.593766 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-13329279-3f8e-42b9-a9af-357eb0dcb31d tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:18.602386 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-13329279-3f8e-42b9-a9af-357eb0dcb31d tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:18.603087 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-13329279-3f8e-42b9-a9af-357eb0dcb31d tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:18.604044 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-13329279-3f8e-42b9-a9af-357eb0dcb31d tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:18.828942 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-18f95934-5423-432e-8925-a83c70be9267 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:18.844023 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-18f95934-5423-432e-8925-a83c70be9267 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:18.845513 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-18f95934-5423-432e-8925-a83c70be9267 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:18.852795 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-18f95934-5423-432e-8925-a83c70be9267 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6" status: 200 len: 1293 microversion: 2.25 time: 0.586263 Oct 17 13:43:18.857867 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1154/2323] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:18 2022] GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6 => generated 1293 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:43:18.867560 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-912e52e8-4c52-452e-8f91-34665bcabe25 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:18.868353 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-912e52e8-4c52-452e-8f91-34665bcabe25 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 240648df-7968-4bbe-ac94-08360eb1049e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:18.884041 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-912e52e8-4c52-452e-8f91-34665bcabe25 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:18.884529 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-912e52e8-4c52-452e-8f91-34665bcabe25 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:18.888169 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-912e52e8-4c52-452e-8f91-34665bcabe25 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:18.890459 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-912e52e8-4c52-452e-8f91-34665bcabe25 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:18.890968 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-912e52e8-4c52-452e-8f91-34665bcabe25 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:18.893114 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-912e52e8-4c52-452e-8f91-34665bcabe25 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:18.960186 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-912e52e8-4c52-452e-8f91-34665bcabe25 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 240648df-7968-4bbe-ac94-08360eb1049e] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:43:19.137651 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-13329279-3f8e-42b9-a9af-357eb0dcb31d tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799d72ccad514fd899d21809d613249b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb50742d06f403598634414befbeb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:19.155711 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-13329279-3f8e-42b9-a9af-357eb0dcb31d tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] 10.222.0.79 "GET /compute/v2.1/servers/2184ae8f-022d-4de9-8d0f-0c2d546c9d6f" status: 200 len: 1372 microversion: 2.1 time: 0.603209 Oct 17 13:43:19.175390 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1170/2324] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:18 2022] GET /compute/v2.1/servers/2184ae8f-022d-4de9-8d0f-0c2d546c9d6f => generated 1372 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:19.186137 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5e8d5105-fd19-4930-98e3-de710aeebb8a tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:19.187097 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5e8d5105-fd19-4930-98e3-de710aeebb8a tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] [instance: 4f806fc0-61ef-4c0b-b6af-8f987148f5ca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:19.198260 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5e8d5105-fd19-4930-98e3-de710aeebb8a tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:19.201152 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5e8d5105-fd19-4930-98e3-de710aeebb8a tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:19.201854 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5e8d5105-fd19-4930-98e3-de710aeebb8a tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:19.202821 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5e8d5105-fd19-4930-98e3-de710aeebb8a tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:19.203825 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5e8d5105-fd19-4930-98e3-de710aeebb8a tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:19.204486 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5e8d5105-fd19-4930-98e3-de710aeebb8a tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:19.235149 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-912e52e8-4c52-452e-8f91-34665bcabe25 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "DELETE /compute/v2.1/servers/240648df-7968-4bbe-ac94-08360eb1049e" status: 204 len: 0 microversion: 2.1 time: 0.373022 Oct 17 13:43:19.254097 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1155/2325] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:43:18 2022] DELETE /compute/v2.1/servers/240648df-7968-4bbe-ac94-08360eb1049e => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:43:19.260551 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ccbf8a85-8495-4fe1-9f49-d4bd057ea859 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Calling method '.version_select at 0x7f7cd99448b0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:19.805518 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5e8d5105-fd19-4930-98e3-de710aeebb8a tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76e77dade0e441a79c2c4d77993172ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3134826eb154c71bb67718c36ff38cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:19.823944 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5e8d5105-fd19-4930-98e3-de710aeebb8a tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] 10.222.0.79 "GET /compute/v2.1/servers/4f806fc0-61ef-4c0b-b6af-8f987148f5ca" status: 200 len: 1515 microversion: 2.1 time: 0.646872 Oct 17 13:43:19.824807 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1171/2326] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:19 2022] GET /compute/v2.1/servers/4f806fc0-61ef-4c0b-b6af-8f987148f5ca => generated 1515 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:19.829653 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-5cb4457c-f478-471a-b7eb-dd140e855b99 req-78624904-b3e9-4987-adde-56350811db61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1b0d02c-b32f-45cd-8732-99b1e3119ca6", "tag": "8f48924e-befb-4a03-97da-73a3c4e335e9"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:19.851782 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-5cb4457c-f478-471a-b7eb-dd140e855b99 req-78624904-b3e9-4987-adde-56350811db61 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:19.852354 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-5cb4457c-f478-471a-b7eb-dd140e855b99 req-78624904-b3e9-4987-adde-56350811db61 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:19.852836 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-5cb4457c-f478-471a-b7eb-dd140e855b99 req-78624904-b3e9-4987-adde-56350811db61 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:19.873933 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-5cb4457c-f478-471a-b7eb-dd140e855b99 req-78624904-b3e9-4987-adde-56350811db61 service nova] Creating event network-changed:8f48924e-befb-4a03-97da-73a3c4e335e9 for instance b1b0d02c-b32f-45cd-8732-99b1e3119ca6 on n-h1-854247-14 Oct 17 13:43:19.881075 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-5cb4457c-f478-471a-b7eb-dd140e855b99 req-78624904-b3e9-4987-adde-56350811db61 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054789 Oct 17 13:43:19.882216 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1172/2327] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:43:19.887714 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-144cfeb9-290f-4827-9bf9-0685b9d7e5a1 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:19.888557 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-144cfeb9-290f-4827-9bf9-0685b9d7e5a1 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 240648df-7968-4bbe-ac94-08360eb1049e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:19.896259 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-144cfeb9-290f-4827-9bf9-0685b9d7e5a1 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:19.896961 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-144cfeb9-290f-4827-9bf9-0685b9d7e5a1 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:19.897599 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-144cfeb9-290f-4827-9bf9-0685b9d7e5a1 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:19.898492 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-144cfeb9-290f-4827-9bf9-0685b9d7e5a1 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:19.899122 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-144cfeb9-290f-4827-9bf9-0685b9d7e5a1 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:19.899758 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-144cfeb9-290f-4827-9bf9-0685b9d7e5a1 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:19.927862 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-144cfeb9-290f-4827-9bf9-0685b9d7e5a1 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 240648df-7968-4bbe-ac94-08360eb1049e] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:43:19.993623 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.compute.api [None req-144cfeb9-290f-4827-9bf9-0685b9d7e5a1 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 240648df-7968-4bbe-ac94-08360eb1049e] Instance is already in deleting state, ignoring this request Oct 17 13:43:19.995000 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-144cfeb9-290f-4827-9bf9-0685b9d7e5a1 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "DELETE /compute/v2.1/servers/240648df-7968-4bbe-ac94-08360eb1049e" status: 204 len: 0 microversion: 2.1 time: 0.111284 Oct 17 13:43:19.995752 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1173/2328] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:43:19 2022] DELETE /compute/v2.1/servers/240648df-7968-4bbe-ac94-08360eb1049e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:43:20.006151 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8a04375b-a892-405a-b2e8-96d7fa8c6c78 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:20.006655 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8a04375b-a892-405a-b2e8-96d7fa8c6c78 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] [instance: 4f806fc0-61ef-4c0b-b6af-8f987148f5ca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:20.019115 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8a04375b-a892-405a-b2e8-96d7fa8c6c78 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:20.020050 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8a04375b-a892-405a-b2e8-96d7fa8c6c78 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:20.020777 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8a04375b-a892-405a-b2e8-96d7fa8c6c78 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:20.021918 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8a04375b-a892-405a-b2e8-96d7fa8c6c78 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:20.022685 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8a04375b-a892-405a-b2e8-96d7fa8c6c78 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:20.023730 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8a04375b-a892-405a-b2e8-96d7fa8c6c78 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:20.078471 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8a04375b-a892-405a-b2e8-96d7fa8c6c78 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] [instance: 4f806fc0-61ef-4c0b-b6af-8f987148f5ca] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:43:20.115802 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:43:20.137966 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:43:20.169328 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=6 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:43:20.233507 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8a04375b-a892-405a-b2e8-96d7fa8c6c78 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] 10.222.0.79 "DELETE /compute/v2.1/servers/4f806fc0-61ef-4c0b-b6af-8f987148f5ca" status: 204 len: 0 microversion: 2.1 time: 0.232697 Oct 17 13:43:20.245898 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ccbf8a85-8495-4fe1-9f49-d4bd057ea859 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/c415a318-8e1e-49de-b20a-a86b4cc9598c" status: 202 len: 0 microversion: 2.1 time: 0.986985 Oct 17 13:43:20.246734 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1156/2330] 10.222.0.79 () {58 vars in 1272 bytes} [Mon Oct 17 13:43:19 2022] DELETE /compute/v2.1/os-security-groups/c415a318-8e1e-49de-b20a-a86b4cc9598c => generated 0 bytes in 991 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:43:20.259833 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2b96e618-f6ba-455f-bdc6-8be5e015509c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:20.262213 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2b96e618-f6ba-455f-bdc6-8be5e015509c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: b1b0d02c-b32f-45cd-8732-99b1e3119ca6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:20.266824 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1174/2330] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:43:19 2022] DELETE /compute/v2.1/servers/4f806fc0-61ef-4c0b-b6af-8f987148f5ca => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:43:20.281410 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-011e8110-7e42-41da-80be-8591936bef1c tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:20.287691 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-011e8110-7e42-41da-80be-8591936bef1c tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 240648df-7968-4bbe-ac94-08360eb1049e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:20.288224 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2b96e618-f6ba-455f-bdc6-8be5e015509c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:20.291342 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2b96e618-f6ba-455f-bdc6-8be5e015509c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:20.291963 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2b96e618-f6ba-455f-bdc6-8be5e015509c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:20.294944 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2b96e618-f6ba-455f-bdc6-8be5e015509c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:20.297695 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2b96e618-f6ba-455f-bdc6-8be5e015509c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:20.300481 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2b96e618-f6ba-455f-bdc6-8be5e015509c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:20.308363 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-011e8110-7e42-41da-80be-8591936bef1c tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:20.310950 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-011e8110-7e42-41da-80be-8591936bef1c tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:20.312322 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-011e8110-7e42-41da-80be-8591936bef1c tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:20.313717 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-011e8110-7e42-41da-80be-8591936bef1c tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:20.314331 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-011e8110-7e42-41da-80be-8591936bef1c tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:20.315436 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-011e8110-7e42-41da-80be-8591936bef1c tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:20.657081 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2b96e618-f6ba-455f-bdc6-8be5e015509c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:20.669211 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2b96e618-f6ba-455f-bdc6-8be5e015509c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:20.678019 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2b96e618-f6ba-455f-bdc6-8be5e015509c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:20.682391 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2b96e618-f6ba-455f-bdc6-8be5e015509c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6" status: 200 len: 1293 microversion: 2.25 time: 0.433758 Oct 17 13:43:20.697540 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1157/2331] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:20 2022] GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6 => generated 1293 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:43:20.697540 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-63e31e68-0240-4dc4-8df8-97c348f9af9c tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:20.698181 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-63e31e68-0240-4dc4-8df8-97c348f9af9c tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] [instance: 2184ae8f-022d-4de9-8d0f-0c2d546c9d6f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:20.717222 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-63e31e68-0240-4dc4-8df8-97c348f9af9c tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:20.717748 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-63e31e68-0240-4dc4-8df8-97c348f9af9c tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:20.718964 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-63e31e68-0240-4dc4-8df8-97c348f9af9c tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:20.719753 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-63e31e68-0240-4dc4-8df8-97c348f9af9c tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:20.722552 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-63e31e68-0240-4dc4-8df8-97c348f9af9c tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:20.723016 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-63e31e68-0240-4dc4-8df8-97c348f9af9c tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:20.912447 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-011e8110-7e42-41da-80be-8591936bef1c tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:20.923468 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-011e8110-7e42-41da-80be-8591936bef1c tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/240648df-7968-4bbe-ac94-08360eb1049e" status: 200 len: 1513 microversion: 2.1 time: 0.654936 Oct 17 13:43:20.929716 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1175/2332] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:20 2022] GET /compute/v2.1/servers/240648df-7968-4bbe-ac94-08360eb1049e => generated 1513 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:20.942277 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0b115a0e-060f-4ff7-8ef9-358f91d3bd8d tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:20.948473 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0b115a0e-060f-4ff7-8ef9-358f91d3bd8d tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] [instance: 4f806fc0-61ef-4c0b-b6af-8f987148f5ca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:20.968624 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0b115a0e-060f-4ff7-8ef9-358f91d3bd8d tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:20.976433 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0b115a0e-060f-4ff7-8ef9-358f91d3bd8d tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:20.977007 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0b115a0e-060f-4ff7-8ef9-358f91d3bd8d tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:20.977763 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0b115a0e-060f-4ff7-8ef9-358f91d3bd8d tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:20.978228 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0b115a0e-060f-4ff7-8ef9-358f91d3bd8d tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:20.978658 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0b115a0e-060f-4ff7-8ef9-358f91d3bd8d tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:21.591920 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-63e31e68-0240-4dc4-8df8-97c348f9af9c tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799d72ccad514fd899d21809d613249b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb50742d06f403598634414befbeb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:21.599917 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-63e31e68-0240-4dc4-8df8-97c348f9af9c tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] 10.222.0.79 "GET /compute/v2.1/servers/2184ae8f-022d-4de9-8d0f-0c2d546c9d6f" status: 200 len: 1558 microversion: 2.1 time: 0.908290 Oct 17 13:43:21.600501 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1158/2333] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:20 2022] GET /compute/v2.1/servers/2184ae8f-022d-4de9-8d0f-0c2d546c9d6f => generated 1558 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:21.612187 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-93a17321-5068-4050-9b2e-adf5cdf282b5 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:21.612877 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-93a17321-5068-4050-9b2e-adf5cdf282b5 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] [instance: bc9feeff-1ac7-4267-9351-3f1560dede9b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:21.613090 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0b115a0e-060f-4ff7-8ef9-358f91d3bd8d tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76e77dade0e441a79c2c4d77993172ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3134826eb154c71bb67718c36ff38cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:21.634442 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-93a17321-5068-4050-9b2e-adf5cdf282b5 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:21.634770 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0b115a0e-060f-4ff7-8ef9-358f91d3bd8d tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] 10.222.0.79 "GET /compute/v2.1/servers/4f806fc0-61ef-4c0b-b6af-8f987148f5ca" status: 200 len: 1521 microversion: 2.1 time: 0.701367 Oct 17 13:43:21.635230 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-93a17321-5068-4050-9b2e-adf5cdf282b5 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:21.635677 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-93a17321-5068-4050-9b2e-adf5cdf282b5 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:21.636400 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-93a17321-5068-4050-9b2e-adf5cdf282b5 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:21.636873 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1176/2334] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:20 2022] GET /compute/v2.1/servers/4f806fc0-61ef-4c0b-b6af-8f987148f5ca => generated 1521 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:21.637064 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-93a17321-5068-4050-9b2e-adf5cdf282b5 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:21.637502 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-93a17321-5068-4050-9b2e-adf5cdf282b5 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:21.642240 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-03d61eab-2cad-4b5d-86c3-8816a2d6ac57 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:21.643011 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-03d61eab-2cad-4b5d-86c3-8816a2d6ac57 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] [instance: 2184ae8f-022d-4de9-8d0f-0c2d546c9d6f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:21.649815 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-03d61eab-2cad-4b5d-86c3-8816a2d6ac57 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:21.650527 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-03d61eab-2cad-4b5d-86c3-8816a2d6ac57 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:21.651108 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-03d61eab-2cad-4b5d-86c3-8816a2d6ac57 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:21.651995 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-03d61eab-2cad-4b5d-86c3-8816a2d6ac57 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:21.652698 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-03d61eab-2cad-4b5d-86c3-8816a2d6ac57 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:21.653603 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-03d61eab-2cad-4b5d-86c3-8816a2d6ac57 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:21.673856 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-93a17321-5068-4050-9b2e-adf5cdf282b5 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] HTTP exception thrown: Instance bc9feeff-1ac7-4267-9351-3f1560dede9b could not be found. Oct 17 13:43:21.675864 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-93a17321-5068-4050-9b2e-adf5cdf282b5 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Request method failure captured: Oct 17 13:43:21.675864 n-d-854247-14 devstack@n-api.service[127017]: request: DELETE /compute/v2.1/servers/bc9feeff-1ac7-4267-9351-3f1560dede9b HTTP/1.1 Oct 17 13:43:21.675864 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:43:21.675864 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:43:21.675864 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:43:21.675864 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:43:21.675864 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:43:21.675864 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:43:21.675864 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:43:21.675864 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:43:21.675864 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVtyFGyYtLVdwIq4ccz7RkXRa7NtlbhzSHc2HUbc2jnmH2QeepBwxbKf8toXm_ooPcHi9ET43LtT1AqXtRk9n6taXXPkcxvI9DAvMm-WduwoIrQJqrIBPqw0m6vAgqbSuo42q0EeC3f0tZCzBhE1QaAtaHcB-dTJTCp89NqtuNhDPjU Oct 17 13:43:21.675864 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:43:21.675864 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:43:21.675864 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:43:21.675864 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:43:21.675864 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:43:21.675864 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:43:21.675864 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 50c0147c5fae4017810887843b0afaa0 Oct 17 13:43:21.675864 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-SecurityGroupsTestJSON-1412652742 Oct 17 13:43:21.675864 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:43:21.675864 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:43:21.675864 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/50c0147c5fae4017810887843b0afaa0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/50c0147c5fae4017810887843b0afaa0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/50c0147c5fae4017810887843b0afaa0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_50c0147c5fae4017810887843b0afaa0", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:43:21.675864 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-SecurityGroupsTestJSON-1412652742 Oct 17 13:43:21.675864 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 50c0147c5fae4017810887843b0afaa0 Oct 17 13:43:21.675864 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1412652742 Oct 17 13:43:21.675864 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-SecurityGroupsTestJSON-1412652742-project Oct 17 13:43:21.675864 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:43:21.675864 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:43:21.675864 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 185235bc4e3245fc8d92b7e4bff6cbbd Oct 17 13:43:21.675864 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-SecurityGroupsTestJSON-1412652742-project Oct 17 13:43:21.675864 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:43:21.675864 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance bc9feeff-1ac7-4267-9351-3f1560dede9b could not be found. Oct 17 13:43:21.675864 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'bc9feeff-1ac7-4267-9351-3f1560dede9b'} Oct 17 13:43:21.675864 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:43:21.675864 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:21.675864 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:43:21.675864 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:43:21.675864 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:43:21.675864 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:43:21.675864 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:43:21.675864 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:43:21.675864 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:43:21.675864 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:43:21.675864 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc9feeff-1ac7-4267-9351-3f1560dede9b could not be found. Oct 17 13:43:21.675864 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:43:21.675864 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:21.675864 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:43:21.675864 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:21.675864 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:21.675864 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:21.675864 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:43:21.675864 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:43:21.675864 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:43:21.675864 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:43:21.675864 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:43:21.675864 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:43:21.675864 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:43:21.675864 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:43:21.675864 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:43:21.675864 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:43:21.675864 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:43:21.675864 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:43:21.679663 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc9feeff-1ac7-4267-9351-3f1560dede9b could not be found. Oct 17 13:43:21.679663 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:43:21.679663 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:21.679663 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:43:21.679663 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:21.679663 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:21.679663 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:21.679663 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:43:21.679663 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:43:21.679663 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc9feeff-1ac7-4267-9351-3f1560dede9b could not be found. Oct 17 13:43:21.679663 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:43:21.681565 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-93a17321-5068-4050-9b2e-adf5cdf282b5 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Returning 404 to user: Instance bc9feeff-1ac7-4267-9351-3f1560dede9b could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:43:21.682614 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-93a17321-5068-4050-9b2e-adf5cdf282b5 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "DELETE /compute/v2.1/servers/bc9feeff-1ac7-4267-9351-3f1560dede9b" status: 404 len: 111 microversion: 2.1 time: 0.081187 Oct 17 13:43:21.686136 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1159/2335] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:43:21 2022] DELETE /compute/v2.1/servers/bc9feeff-1ac7-4267-9351-3f1560dede9b => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:43:21.796369 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-03d61eab-2cad-4b5d-86c3-8816a2d6ac57 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] 10.222.0.79 "GET /compute/v2.1/servers/2184ae8f-022d-4de9-8d0f-0c2d546c9d6f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.157853 Oct 17 13:43:21.797015 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1177/2336] 10.222.0.79 () {58 vars in 1275 bytes} [Mon Oct 17 13:43:21 2022] GET /compute/v2.1/servers/2184ae8f-022d-4de9-8d0f-0c2d546c9d6f/os-interface => generated 285 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:43:21.810303 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5b4de06b-d597-49ec-be17-f6fb8b8adf74 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:21.810985 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5b4de06b-d597-49ec-be17-f6fb8b8adf74 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] [instance: bc9feeff-1ac7-4267-9351-3f1560dede9b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:21.826131 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5b4de06b-d597-49ec-be17-f6fb8b8adf74 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:21.826638 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5b4de06b-d597-49ec-be17-f6fb8b8adf74 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:21.829067 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5b4de06b-d597-49ec-be17-f6fb8b8adf74 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:21.829850 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5b4de06b-d597-49ec-be17-f6fb8b8adf74 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:21.830323 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5b4de06b-d597-49ec-be17-f6fb8b8adf74 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:21.830753 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5b4de06b-d597-49ec-be17-f6fb8b8adf74 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:21.865580 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-5b4de06b-d597-49ec-be17-f6fb8b8adf74 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] HTTP exception thrown: Instance bc9feeff-1ac7-4267-9351-3f1560dede9b could not be found. Oct 17 13:43:21.874360 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5b4de06b-d597-49ec-be17-f6fb8b8adf74 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Request method failure captured: Oct 17 13:43:21.874360 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/bc9feeff-1ac7-4267-9351-3f1560dede9b HTTP/1.1 Oct 17 13:43:21.874360 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:43:21.874360 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:43:21.874360 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:43:21.874360 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:43:21.874360 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:43:21.874360 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:43:21.874360 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:43:21.874360 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:43:21.874360 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVtyFGyYtLVdwIq4ccz7RkXRa7NtlbhzSHc2HUbc2jnmH2QeepBwxbKf8toXm_ooPcHi9ET43LtT1AqXtRk9n6taXXPkcxvI9DAvMm-WduwoIrQJqrIBPqw0m6vAgqbSuo42q0EeC3f0tZCzBhE1QaAtaHcB-dTJTCp89NqtuNhDPjU Oct 17 13:43:21.874360 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:43:21.874360 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:43:21.874360 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:43:21.874360 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:43:21.874360 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:43:21.874360 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:43:21.874360 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 50c0147c5fae4017810887843b0afaa0 Oct 17 13:43:21.874360 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-SecurityGroupsTestJSON-1412652742 Oct 17 13:43:21.874360 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:43:21.874360 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:43:21.874360 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/50c0147c5fae4017810887843b0afaa0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/50c0147c5fae4017810887843b0afaa0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/50c0147c5fae4017810887843b0afaa0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_50c0147c5fae4017810887843b0afaa0", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:43:21.874360 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-SecurityGroupsTestJSON-1412652742 Oct 17 13:43:21.874360 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 50c0147c5fae4017810887843b0afaa0 Oct 17 13:43:21.874360 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1412652742 Oct 17 13:43:21.874360 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-SecurityGroupsTestJSON-1412652742-project Oct 17 13:43:21.874360 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:43:21.874360 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:43:21.874360 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 185235bc4e3245fc8d92b7e4bff6cbbd Oct 17 13:43:21.874360 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-SecurityGroupsTestJSON-1412652742-project Oct 17 13:43:21.874360 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:43:21.874360 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance bc9feeff-1ac7-4267-9351-3f1560dede9b could not be found. Oct 17 13:43:21.874360 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'bc9feeff-1ac7-4267-9351-3f1560dede9b'} Oct 17 13:43:21.874360 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:43:21.874360 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:21.874360 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:43:21.874360 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:43:21.874360 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:43:21.874360 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:43:21.874360 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:43:21.874360 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:43:21.874360 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:43:21.874360 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:43:21.874360 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc9feeff-1ac7-4267-9351-3f1560dede9b could not be found. Oct 17 13:43:21.874360 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:21.874360 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:21.874360 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:21.874360 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:21.874360 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:21.874360 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:21.874360 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:43:21.874360 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:43:21.874360 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:43:21.874360 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:43:21.874360 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:43:21.874360 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:43:21.874360 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:43:21.874360 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:43:21.874360 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:43:21.874360 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:43:21.874360 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc9feeff-1ac7-4267-9351-3f1560dede9b could not be found. Oct 17 13:43:21.874360 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:21.874360 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:21.874360 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:21.878135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:21.878135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:21.878135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:21.878135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:43:21.878135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:43:21.878135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc9feeff-1ac7-4267-9351-3f1560dede9b could not be found. Oct 17 13:43:21.878135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:21.878135 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5b4de06b-d597-49ec-be17-f6fb8b8adf74 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Returning 404 to user: Instance bc9feeff-1ac7-4267-9351-3f1560dede9b could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:43:21.878135 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5b4de06b-d597-49ec-be17-f6fb8b8adf74 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "GET /compute/v2.1/servers/bc9feeff-1ac7-4267-9351-3f1560dede9b" status: 404 len: 111 microversion: 2.1 time: 0.070096 Oct 17 13:43:21.880728 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1178/2337] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:21 2022] GET /compute/v2.1/servers/bc9feeff-1ac7-4267-9351-3f1560dede9b => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:43:21.891664 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0e1215b3-9f89-4e42-a3f4-90f19d1489be tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:21.892295 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0e1215b3-9f89-4e42-a3f4-90f19d1489be tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: b1b0d02c-b32f-45cd-8732-99b1e3119ca6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:21.904155 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0e1215b3-9f89-4e42-a3f4-90f19d1489be tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:21.905194 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0e1215b3-9f89-4e42-a3f4-90f19d1489be tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:21.905194 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0e1215b3-9f89-4e42-a3f4-90f19d1489be tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:21.908046 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0e1215b3-9f89-4e42-a3f4-90f19d1489be tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:21.908539 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0e1215b3-9f89-4e42-a3f4-90f19d1489be tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:21.908981 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0e1215b3-9f89-4e42-a3f4-90f19d1489be tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:21.982365 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e5b0f0f1-3d70-4421-a534-bf1883c735d1 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1507368113", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:22.080506 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-e5b0f0f1-3d70-4421-a534-bf1883c735d1 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] validate_networks() for None {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:43:23.280344 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-e5b0f0f1-3d70-4421-a534-bf1883c735d1 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:43:23.280933 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-e5b0f0f1-3d70-4421-a534-bf1883c735d1 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:43:23.282037 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-e5b0f0f1-3d70-4421-a534-bf1883c735d1 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:43:23.282452 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-e5b0f0f1-3d70-4421-a534-bf1883c735d1 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:43:23.283040 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-e5b0f0f1-3d70-4421-a534-bf1883c735d1 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:43:23.318167 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e5b0f0f1-3d70-4421-a534-bf1883c735d1 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:23.321497 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e5b0f0f1-3d70-4421-a534-bf1883c735d1 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:23.322902 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e5b0f0f1-3d70-4421-a534-bf1883c735d1 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:23.328169 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e5b0f0f1-3d70-4421-a534-bf1883c735d1 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:23.328942 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e5b0f0f1-3d70-4421-a534-bf1883c735d1 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:23.331112 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e5b0f0f1-3d70-4421-a534-bf1883c735d1 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:23.361658 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-e5b0f0f1-3d70-4421-a534-bf1883c735d1 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Getting quotas for project 87456dcb963449b2ac1c2d93da0a4ec7. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:43:23.370088 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-e5b0f0f1-3d70-4421-a534-bf1883c735d1 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Getting quotas for user dc1f69cda7724d9bb8a6beec6d4f973e and project 87456dcb963449b2ac1c2d93da0a4ec7. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:43:23.381980 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0e1215b3-9f89-4e42-a3f4-90f19d1489be tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:23.391119 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e5b0f0f1-3d70-4421-a534-bf1883c735d1 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:43:23.394516 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e5b0f0f1-3d70-4421-a534-bf1883c735d1 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] [instance: 87114af9-1214-4182-8f68-756a1a5dfc7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:43:23.401051 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0e1215b3-9f89-4e42-a3f4-90f19d1489be tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:23.402635 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0e1215b3-9f89-4e42-a3f4-90f19d1489be tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:23.403971 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0e1215b3-9f89-4e42-a3f4-90f19d1489be tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6" status: 200 len: 1293 microversion: 2.25 time: 1.522585 Oct 17 13:43:23.419397 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1179/2338] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:21 2022] GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6 => generated 1293 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:43:23.419397 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-77219967-3bd0-40dc-b0e3-8b32926de554 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Calling method '.version_select at 0x7f7cd9811820>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:23.439899 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:43:23.456491 n-d-854247-14 devstack@n-api.service[127016]: DEBUG neutronclient.v2_0.client [None req-77219967-3bd0-40dc-b0e3-8b32926de554 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d00eef40-614d-42f8-b3dd-328edb750eda does not exist", "detail": ""}} {{(pid=127016) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 13:43:23.457360 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.security_group_api [None req-77219967-3bd0-40dc-b0e3-8b32926de554 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Neutron security group d00eef40-614d-42f8-b3dd-328edb750eda not found {{(pid=127016) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 17 13:43:23.458148 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-77219967-3bd0-40dc-b0e3-8b32926de554 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] HTTP exception thrown: Security group d00eef40-614d-42f8-b3dd-328edb750eda does not exist Oct 17 13:43:23.458148 n-d-854247-14 devstack@n-api.service[127016]: Neutron server returns request_ids: ['req-592642fb-f45c-4086-8e74-3aedd9266ab5'] Oct 17 13:43:23.460215 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-77219967-3bd0-40dc-b0e3-8b32926de554 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Request method failure captured: Oct 17 13:43:23.460215 n-d-854247-14 devstack@n-api.service[127016]: request: DELETE /compute/v2.1/os-security-groups/d00eef40-614d-42f8-b3dd-328edb750eda HTTP/1.1 Oct 17 13:43:23.460215 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:43:23.460215 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:43:23.460215 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:43:23.460215 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:43:23.460215 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:43:23.460215 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:43:23.460215 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:43:23.460215 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:43:23.460215 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVtyFGyYtLVdwIq4ccz7RkXRa7NtlbhzSHc2HUbc2jnmH2QeepBwxbKf8toXm_ooPcHi9ET43LtT1AqXtRk9n6taXXPkcxvI9DAvMm-WduwoIrQJqrIBPqw0m6vAgqbSuo42q0EeC3f0tZCzBhE1QaAtaHcB-dTJTCp89NqtuNhDPjU Oct 17 13:43:23.460215 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:43:23.460215 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:43:23.460215 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:43:23.460215 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:43:23.460215 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:43:23.460215 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:43:23.460215 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 50c0147c5fae4017810887843b0afaa0 Oct 17 13:43:23.460215 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-SecurityGroupsTestJSON-1412652742 Oct 17 13:43:23.460215 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:43:23.460215 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:43:23.460215 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/50c0147c5fae4017810887843b0afaa0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/50c0147c5fae4017810887843b0afaa0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/50c0147c5fae4017810887843b0afaa0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_50c0147c5fae4017810887843b0afaa0", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:43:23.460215 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-SecurityGroupsTestJSON-1412652742 Oct 17 13:43:23.460215 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 50c0147c5fae4017810887843b0afaa0 Oct 17 13:43:23.460215 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1412652742 Oct 17 13:43:23.460215 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-SecurityGroupsTestJSON-1412652742-project Oct 17 13:43:23.460215 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:43:23.460215 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:43:23.460215 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 185235bc4e3245fc8d92b7e4bff6cbbd Oct 17 13:43:23.460215 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-SecurityGroupsTestJSON-1412652742-project Oct 17 13:43:23.460215 n-d-854247-14 devstack@n-api.service[127016]: method: Oct 17 13:43:23.460215 n-d-854247-14 devstack@n-api.service[127016]: exception: Security group d00eef40-614d-42f8-b3dd-328edb750eda does not exist Oct 17 13:43:23.460215 n-d-854247-14 devstack@n-api.service[127016]: Neutron server returns request_ids: ['req-592642fb-f45c-4086-8e74-3aedd9266ab5'] Oct 17 13:43:23.460215 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'd00eef40-614d-42f8-b3dd-328edb750eda'} Oct 17 13:43:23.460215 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:43:23.460215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:23.460215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 17 13:43:23.460215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 17 13:43:23.460215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:43:23.460215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:43:23.460215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 17 13:43:23.460215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 17 13:43:23.460215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:43:23.460215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:43:23.460215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 13:43:23.460215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 13:43:23.460215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:43:23.460215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:43:23.460215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 13:43:23.460215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 13:43:23.460215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:43:23.460215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:43:23.460215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 13:43:23.460215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 13:43:23.460215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:43:23.460215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:43:23.460215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 13:43:23.460215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 13:43:23.460215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 13:43:23.460215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 13:43:23.460215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d00eef40-614d-42f8-b3dd-328edb750eda does not exist Oct 17 13:43:23.464405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-592642fb-f45c-4086-8e74-3aedd9266ab5'] Oct 17 13:43:23.464405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:23.464405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:23.464405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:23.464405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:23.464405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 17 13:43:23.464405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 17 13:43:23.464405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 17 13:43:23.464405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 13:43:23.464405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d00eef40-614d-42f8-b3dd-328edb750eda does not exist Oct 17 13:43:23.464405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-592642fb-f45c-4086-8e74-3aedd9266ab5'] Oct 17 13:43:23.464405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:23.464405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:23.464405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:23.464405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:23.464405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:23.464405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:23.464405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:43:23.464405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:43:23.464405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:43:23.464405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:43:23.464405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:43:23.464405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:43:23.464405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 17 13:43:23.464405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 17 13:43:23.464405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d00eef40-614d-42f8-b3dd-328edb750eda does not exist Oct 17 13:43:23.464405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-592642fb-f45c-4086-8e74-3aedd9266ab5'] Oct 17 13:43:23.464405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:23.464405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:23.464405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:23.464405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:23.464405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:23.464405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:23.464405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:43:23.464405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:43:23.464405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d00eef40-614d-42f8-b3dd-328edb750eda does not exist Oct 17 13:43:23.464405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-592642fb-f45c-4086-8e74-3aedd9266ab5'] Oct 17 13:43:23.464405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:23.469666 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-77219967-3bd0-40dc-b0e3-8b32926de554 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Returning 404 to user: Security group d00eef40-614d-42f8-b3dd-328edb750eda does not exist Oct 17 13:43:23.469666 n-d-854247-14 devstack@n-api.service[127016]: Neutron server returns request_ids: ['req-592642fb-f45c-4086-8e74-3aedd9266ab5'] {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:43:23.470890 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-77219967-3bd0-40dc-b0e3-8b32926de554 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/d00eef40-614d-42f8-b3dd-328edb750eda" status: 404 len: 194 microversion: 2.1 time: 0.065453 Oct 17 13:43:23.471671 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1180/2339] 10.222.0.79 () {58 vars in 1272 bytes} [Mon Oct 17 13:43:23 2022] DELETE /compute/v2.1/os-security-groups/d00eef40-614d-42f8-b3dd-328edb750eda => generated 194 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:43:23.479833 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e5b0f0f1-3d70-4421-a534-bf1883c735d1 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.791867 Oct 17 13:43:23.480722 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1160/2340] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:43:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:43:23.481543 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6a19f066-f9eb-447c-adf1-1e0c64562dc0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:23.482261 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6a19f066-f9eb-447c-adf1-1e0c64562dc0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 240648df-7968-4bbe-ac94-08360eb1049e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:23.494599 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a7209487-d02d-4a0b-8a95-09b2b20c6adc tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:23.497960 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a7209487-d02d-4a0b-8a95-09b2b20c6adc tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] [instance: 4f806fc0-61ef-4c0b-b6af-8f987148f5ca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:23.504372 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6a19f066-f9eb-447c-adf1-1e0c64562dc0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:23.504672 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6a19f066-f9eb-447c-adf1-1e0c64562dc0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:23.505106 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6a19f066-f9eb-447c-adf1-1e0c64562dc0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:23.505821 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6a19f066-f9eb-447c-adf1-1e0c64562dc0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:23.506381 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6a19f066-f9eb-447c-adf1-1e0c64562dc0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:23.506971 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6a19f066-f9eb-447c-adf1-1e0c64562dc0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:23.511236 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a7209487-d02d-4a0b-8a95-09b2b20c6adc tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:23.511810 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a7209487-d02d-4a0b-8a95-09b2b20c6adc tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:23.519085 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a7209487-d02d-4a0b-8a95-09b2b20c6adc tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:23.519979 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a7209487-d02d-4a0b-8a95-09b2b20c6adc tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:23.520749 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a7209487-d02d-4a0b-8a95-09b2b20c6adc tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:23.537476 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a7209487-d02d-4a0b-8a95-09b2b20c6adc tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:23.616162 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6a19f066-f9eb-447c-adf1-1e0c64562dc0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:23.616658 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6a19f066-f9eb-447c-adf1-1e0c64562dc0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:23.617090 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6a19f066-f9eb-447c-adf1-1e0c64562dc0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:23.617547 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-6a19f066-f9eb-447c-adf1-1e0c64562dc0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lazy-loading 'fault' on Instance uuid 240648df-7968-4bbe-ac94-08360eb1049e {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:43:24.466905 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6a19f066-f9eb-447c-adf1-1e0c64562dc0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a7b6856447415487c272498ca335db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fe03af82c34607bfe43a58b997704f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:24.487482 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6a19f066-f9eb-447c-adf1-1e0c64562dc0 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/240648df-7968-4bbe-ac94-08360eb1049e" status: 200 len: 1307 microversion: 2.1 time: 1.013785 Oct 17 13:43:24.489422 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1181/2341] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:23 2022] GET /compute/v2.1/servers/240648df-7968-4bbe-ac94-08360eb1049e => generated 1307 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:24.502300 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-1abbc713-b9f3-4f0b-b72e-7a334680535a req-c2417646-e88a-44b7-b328-8f5ce33a8a54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "240648df-7968-4bbe-ac94-08360eb1049e", "name": "network-vif-deleted", "tag": "bb16bb6b-77f3-4d30-922f-0b42e294e0ec"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:24.543260 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-1abbc713-b9f3-4f0b-b72e-7a334680535a req-c2417646-e88a-44b7-b328-8f5ce33a8a54 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:24.544119 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-1abbc713-b9f3-4f0b-b72e-7a334680535a req-c2417646-e88a-44b7-b328-8f5ce33a8a54 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:24.544946 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-1abbc713-b9f3-4f0b-b72e-7a334680535a req-c2417646-e88a-44b7-b328-8f5ce33a8a54 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:24.560919 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-1abbc713-b9f3-4f0b-b72e-7a334680535a req-c2417646-e88a-44b7-b328-8f5ce33a8a54 service nova] Creating event network-vif-deleted:bb16bb6b-77f3-4d30-922f-0b42e294e0ec for instance 240648df-7968-4bbe-ac94-08360eb1049e on n-h2-854247-14 Oct 17 13:43:24.584700 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-1abbc713-b9f3-4f0b-b72e-7a334680535a req-c2417646-e88a-44b7-b328-8f5ce33a8a54 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093684 Oct 17 13:43:24.585924 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1182/2342] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:43:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:43:24.597787 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5ce317d9-a0b7-4e88-b8d3-41a800dfe4b4 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Calling method '.version_select at 0x7f7cd9892c10>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:24.826765 n-d-854247-14 devstack@n-api.service[127016]: DEBUG neutronclient.v2_0.client [None req-5ce317d9-a0b7-4e88-b8d3-41a800dfe4b4 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 40a5b24c-a168-4bdf-b5f8-8211a29d8c9f does not exist", "detail": ""}} {{(pid=127016) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 13:43:24.829768 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.security_group_api [None req-5ce317d9-a0b7-4e88-b8d3-41a800dfe4b4 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Neutron security group 40a5b24c-a168-4bdf-b5f8-8211a29d8c9f not found {{(pid=127016) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 17 13:43:24.830566 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-5ce317d9-a0b7-4e88-b8d3-41a800dfe4b4 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] HTTP exception thrown: Security group 40a5b24c-a168-4bdf-b5f8-8211a29d8c9f does not exist Oct 17 13:43:24.830566 n-d-854247-14 devstack@n-api.service[127016]: Neutron server returns request_ids: ['req-b63d1d06-a5f8-41b7-af30-56d4f8e73476'] Oct 17 13:43:24.834303 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5ce317d9-a0b7-4e88-b8d3-41a800dfe4b4 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Request method failure captured: Oct 17 13:43:24.834303 n-d-854247-14 devstack@n-api.service[127016]: request: DELETE /compute/v2.1/os-security-groups/40a5b24c-a168-4bdf-b5f8-8211a29d8c9f HTTP/1.1 Oct 17 13:43:24.834303 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:43:24.834303 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:43:24.834303 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:43:24.834303 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:43:24.834303 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:43:24.834303 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:43:24.834303 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:43:24.834303 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:43:24.834303 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVtyFGyYtLVdwIq4ccz7RkXRa7NtlbhzSHc2HUbc2jnmH2QeepBwxbKf8toXm_ooPcHi9ET43LtT1AqXtRk9n6taXXPkcxvI9DAvMm-WduwoIrQJqrIBPqw0m6vAgqbSuo42q0EeC3f0tZCzBhE1QaAtaHcB-dTJTCp89NqtuNhDPjU Oct 17 13:43:24.834303 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:43:24.834303 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:43:24.834303 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:43:24.834303 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:43:24.834303 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:43:24.834303 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:43:24.834303 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 50c0147c5fae4017810887843b0afaa0 Oct 17 13:43:24.834303 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-SecurityGroupsTestJSON-1412652742 Oct 17 13:43:24.834303 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:43:24.834303 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:43:24.834303 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/50c0147c5fae4017810887843b0afaa0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/50c0147c5fae4017810887843b0afaa0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/50c0147c5fae4017810887843b0afaa0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_50c0147c5fae4017810887843b0afaa0", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:43:24.834303 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-SecurityGroupsTestJSON-1412652742 Oct 17 13:43:24.834303 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 50c0147c5fae4017810887843b0afaa0 Oct 17 13:43:24.834303 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1412652742 Oct 17 13:43:24.834303 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-SecurityGroupsTestJSON-1412652742-project Oct 17 13:43:24.834303 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:43:24.834303 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:43:24.834303 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 185235bc4e3245fc8d92b7e4bff6cbbd Oct 17 13:43:24.834303 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-SecurityGroupsTestJSON-1412652742-project Oct 17 13:43:24.834303 n-d-854247-14 devstack@n-api.service[127016]: method: Oct 17 13:43:24.834303 n-d-854247-14 devstack@n-api.service[127016]: exception: Security group 40a5b24c-a168-4bdf-b5f8-8211a29d8c9f does not exist Oct 17 13:43:24.834303 n-d-854247-14 devstack@n-api.service[127016]: Neutron server returns request_ids: ['req-b63d1d06-a5f8-41b7-af30-56d4f8e73476'] Oct 17 13:43:24.834303 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '40a5b24c-a168-4bdf-b5f8-8211a29d8c9f'} Oct 17 13:43:24.834303 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:43:24.834303 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:24.834303 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 17 13:43:24.834303 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 17 13:43:24.834303 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:43:24.834303 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:43:24.834303 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 17 13:43:24.834303 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 17 13:43:24.834303 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:43:24.834303 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:43:24.834303 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 13:43:24.834303 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 13:43:24.834303 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:43:24.834303 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:43:24.834303 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 13:43:24.834303 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 13:43:24.834303 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:43:24.834303 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:43:24.834303 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 13:43:24.834303 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 13:43:24.834303 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:43:24.834303 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:43:24.834303 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 13:43:24.834303 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 13:43:24.834303 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 13:43:24.834303 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 13:43:24.834303 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 40a5b24c-a168-4bdf-b5f8-8211a29d8c9f does not exist Oct 17 13:43:24.838421 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b63d1d06-a5f8-41b7-af30-56d4f8e73476'] Oct 17 13:43:24.838421 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:24.838421 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:24.838421 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:24.838421 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:24.838421 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 17 13:43:24.838421 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 17 13:43:24.838421 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 17 13:43:24.838421 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 13:43:24.838421 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 40a5b24c-a168-4bdf-b5f8-8211a29d8c9f does not exist Oct 17 13:43:24.838421 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b63d1d06-a5f8-41b7-af30-56d4f8e73476'] Oct 17 13:43:24.838421 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:24.838421 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:24.838421 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:24.838421 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:24.838421 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:24.838421 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:24.838421 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:43:24.838421 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:43:24.838421 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:43:24.838421 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:43:24.838421 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:43:24.838421 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:43:24.838421 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 17 13:43:24.838421 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 17 13:43:24.838421 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 40a5b24c-a168-4bdf-b5f8-8211a29d8c9f does not exist Oct 17 13:43:24.838421 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b63d1d06-a5f8-41b7-af30-56d4f8e73476'] Oct 17 13:43:24.838421 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:24.838421 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:24.838421 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:24.838421 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:24.838421 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:24.838421 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:24.838421 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:43:24.838421 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:43:24.838421 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 40a5b24c-a168-4bdf-b5f8-8211a29d8c9f does not exist Oct 17 13:43:24.838421 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b63d1d06-a5f8-41b7-af30-56d4f8e73476'] Oct 17 13:43:24.838421 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:24.843855 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5ce317d9-a0b7-4e88-b8d3-41a800dfe4b4 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Returning 404 to user: Security group 40a5b24c-a168-4bdf-b5f8-8211a29d8c9f does not exist Oct 17 13:43:24.843855 n-d-854247-14 devstack@n-api.service[127016]: Neutron server returns request_ids: ['req-b63d1d06-a5f8-41b7-af30-56d4f8e73476'] {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:43:24.845127 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5ce317d9-a0b7-4e88-b8d3-41a800dfe4b4 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/40a5b24c-a168-4bdf-b5f8-8211a29d8c9f" status: 404 len: 194 microversion: 2.1 time: 0.257839 Oct 17 13:43:24.846223 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1183/2343] 10.222.0.79 () {58 vars in 1272 bytes} [Mon Oct 17 13:43:24 2022] DELETE /compute/v2.1/os-security-groups/40a5b24c-a168-4bdf-b5f8-8211a29d8c9f => generated 194 bytes in 259 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:43:24.854378 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7ade763d-423a-42b0-9cac-ce8d0470a027 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:24.855633 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7ade763d-423a-42b0-9cac-ce8d0470a027 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] [instance: 87114af9-1214-4182-8f68-756a1a5dfc7a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:24.865519 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7ade763d-423a-42b0-9cac-ce8d0470a027 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:24.866431 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7ade763d-423a-42b0-9cac-ce8d0470a027 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:24.877045 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a7209487-d02d-4a0b-8a95-09b2b20c6adc tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76e77dade0e441a79c2c4d77993172ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3134826eb154c71bb67718c36ff38cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:24.880633 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7ade763d-423a-42b0-9cac-ce8d0470a027 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:24.884278 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7ade763d-423a-42b0-9cac-ce8d0470a027 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:24.885175 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7ade763d-423a-42b0-9cac-ce8d0470a027 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:24.888643 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7ade763d-423a-42b0-9cac-ce8d0470a027 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:24.897930 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a7209487-d02d-4a0b-8a95-09b2b20c6adc tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] 10.222.0.79 "GET /compute/v2.1/servers/4f806fc0-61ef-4c0b-b6af-8f987148f5ca" status: 200 len: 1521 microversion: 2.1 time: 1.415331 Oct 17 13:43:24.911581 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1161/2344] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:23 2022] GET /compute/v2.1/servers/4f806fc0-61ef-4c0b-b6af-8f987148f5ca => generated 1521 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:24.925729 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-e02cbb20-ec19-4570-b59f-9174b8de4be4 req-870ba971-be91-447e-9535-9dd26dae12aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f806fc0-61ef-4c0b-b6af-8f987148f5ca", "name": "network-vif-unplugged", "status": "completed", "tag": "8852e286-0d94-4c6e-aeb7-c6b79afb6231"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:24.942954 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-e02cbb20-ec19-4570-b59f-9174b8de4be4 req-870ba971-be91-447e-9535-9dd26dae12aa service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:24.943759 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-e02cbb20-ec19-4570-b59f-9174b8de4be4 req-870ba971-be91-447e-9535-9dd26dae12aa service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:24.945453 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-e02cbb20-ec19-4570-b59f-9174b8de4be4 req-870ba971-be91-447e-9535-9dd26dae12aa service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:24.968117 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-e02cbb20-ec19-4570-b59f-9174b8de4be4 req-870ba971-be91-447e-9535-9dd26dae12aa service nova] Creating event network-vif-unplugged:8852e286-0d94-4c6e-aeb7-c6b79afb6231 for instance 4f806fc0-61ef-4c0b-b6af-8f987148f5ca on n-h2-854247-14 Oct 17 13:43:24.978299 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-e02cbb20-ec19-4570-b59f-9174b8de4be4 req-870ba971-be91-447e-9535-9dd26dae12aa service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064900 Oct 17 13:43:24.979438 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1162/2345] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:43:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:43:24.986573 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-04d1000b-2d74-43f6-b705-20b4600927ed tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:24.987563 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-04d1000b-2d74-43f6-b705-20b4600927ed tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: b1b0d02c-b32f-45cd-8732-99b1e3119ca6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:24.995314 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-04d1000b-2d74-43f6-b705-20b4600927ed tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:24.996043 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-04d1000b-2d74-43f6-b705-20b4600927ed tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:24.996972 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-04d1000b-2d74-43f6-b705-20b4600927ed tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:24.997841 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-04d1000b-2d74-43f6-b705-20b4600927ed tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:24.998578 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-04d1000b-2d74-43f6-b705-20b4600927ed tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:24.999749 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-04d1000b-2d74-43f6-b705-20b4600927ed tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:25.153782 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7ade763d-423a-42b0-9cac-ce8d0470a027 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1f69cda7724d9bb8a6beec6d4f973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87456dcb963449b2ac1c2d93da0a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:25.170839 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7ade763d-423a-42b0-9cac-ce8d0470a027 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "GET /compute/v2.1/servers/87114af9-1214-4182-8f68-756a1a5dfc7a" status: 200 len: 1269 microversion: 2.1 time: 0.322910 Oct 17 13:43:25.185843 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1184/2346] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:24 2022] GET /compute/v2.1/servers/87114af9-1214-4182-8f68-756a1a5dfc7a => generated 1269 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:25.204556 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d1f407bc-ba54-4e5a-b472-00b1df03e910 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Calling method '.version_select at 0x7f7cd981d550>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:25.310862 n-d-854247-14 devstack@n-api.service[127016]: DEBUG neutronclient.v2_0.client [None req-d1f407bc-ba54-4e5a-b472-00b1df03e910 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b20231ea-dba1-407d-a7fd-39094706292a does not exist", "detail": ""}} {{(pid=127016) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 13:43:25.311890 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.security_group_api [None req-d1f407bc-ba54-4e5a-b472-00b1df03e910 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Neutron security group b20231ea-dba1-407d-a7fd-39094706292a not found {{(pid=127016) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 17 13:43:25.312547 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-d1f407bc-ba54-4e5a-b472-00b1df03e910 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] HTTP exception thrown: Security group b20231ea-dba1-407d-a7fd-39094706292a does not exist Oct 17 13:43:25.312547 n-d-854247-14 devstack@n-api.service[127016]: Neutron server returns request_ids: ['req-ed3e40b0-0df0-4230-ac45-7e0923eedec4'] Oct 17 13:43:25.314957 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d1f407bc-ba54-4e5a-b472-00b1df03e910 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Request method failure captured: Oct 17 13:43:25.314957 n-d-854247-14 devstack@n-api.service[127016]: request: DELETE /compute/v2.1/os-security-groups/b20231ea-dba1-407d-a7fd-39094706292a HTTP/1.1 Oct 17 13:43:25.314957 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:43:25.314957 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:43:25.314957 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:43:25.314957 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:43:25.314957 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:43:25.314957 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:43:25.314957 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:43:25.314957 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:43:25.314957 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVtyFGyYtLVdwIq4ccz7RkXRa7NtlbhzSHc2HUbc2jnmH2QeepBwxbKf8toXm_ooPcHi9ET43LtT1AqXtRk9n6taXXPkcxvI9DAvMm-WduwoIrQJqrIBPqw0m6vAgqbSuo42q0EeC3f0tZCzBhE1QaAtaHcB-dTJTCp89NqtuNhDPjU Oct 17 13:43:25.314957 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:43:25.314957 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:43:25.314957 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:43:25.314957 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:43:25.314957 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:43:25.314957 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:43:25.314957 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 50c0147c5fae4017810887843b0afaa0 Oct 17 13:43:25.314957 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-SecurityGroupsTestJSON-1412652742 Oct 17 13:43:25.314957 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:43:25.314957 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:43:25.314957 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/50c0147c5fae4017810887843b0afaa0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/50c0147c5fae4017810887843b0afaa0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/50c0147c5fae4017810887843b0afaa0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_50c0147c5fae4017810887843b0afaa0", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:43:25.314957 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-SecurityGroupsTestJSON-1412652742 Oct 17 13:43:25.314957 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 50c0147c5fae4017810887843b0afaa0 Oct 17 13:43:25.314957 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1412652742 Oct 17 13:43:25.314957 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-SecurityGroupsTestJSON-1412652742-project Oct 17 13:43:25.314957 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:43:25.314957 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:43:25.314957 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 185235bc4e3245fc8d92b7e4bff6cbbd Oct 17 13:43:25.314957 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-SecurityGroupsTestJSON-1412652742-project Oct 17 13:43:25.314957 n-d-854247-14 devstack@n-api.service[127016]: method: Oct 17 13:43:25.314957 n-d-854247-14 devstack@n-api.service[127016]: exception: Security group b20231ea-dba1-407d-a7fd-39094706292a does not exist Oct 17 13:43:25.314957 n-d-854247-14 devstack@n-api.service[127016]: Neutron server returns request_ids: ['req-ed3e40b0-0df0-4230-ac45-7e0923eedec4'] Oct 17 13:43:25.314957 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'b20231ea-dba1-407d-a7fd-39094706292a'} Oct 17 13:43:25.314957 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:43:25.314957 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:25.314957 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 17 13:43:25.314957 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 17 13:43:25.314957 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:43:25.314957 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:43:25.314957 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 17 13:43:25.314957 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 17 13:43:25.314957 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:43:25.314957 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:43:25.314957 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 13:43:25.314957 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 13:43:25.314957 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:43:25.314957 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:43:25.314957 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 13:43:25.314957 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 13:43:25.314957 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:43:25.314957 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:43:25.314957 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 13:43:25.314957 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 13:43:25.314957 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:43:25.314957 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:43:25.314957 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 13:43:25.314957 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 13:43:25.314957 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 13:43:25.314957 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 13:43:25.314957 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b20231ea-dba1-407d-a7fd-39094706292a does not exist Oct 17 13:43:25.318593 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ed3e40b0-0df0-4230-ac45-7e0923eedec4'] Oct 17 13:43:25.318593 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:25.318593 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:25.318593 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:25.318593 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:25.318593 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 17 13:43:25.318593 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 17 13:43:25.318593 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 17 13:43:25.318593 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 13:43:25.318593 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b20231ea-dba1-407d-a7fd-39094706292a does not exist Oct 17 13:43:25.318593 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ed3e40b0-0df0-4230-ac45-7e0923eedec4'] Oct 17 13:43:25.318593 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:25.318593 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:25.318593 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:25.318593 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:25.318593 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:25.318593 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:25.318593 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:43:25.318593 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:43:25.318593 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:43:25.318593 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:43:25.318593 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:43:25.318593 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:43:25.318593 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 17 13:43:25.318593 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 17 13:43:25.318593 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b20231ea-dba1-407d-a7fd-39094706292a does not exist Oct 17 13:43:25.318593 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ed3e40b0-0df0-4230-ac45-7e0923eedec4'] Oct 17 13:43:25.318593 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:25.318593 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:25.318593 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:25.318593 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:25.318593 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:25.318593 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:25.318593 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:43:25.318593 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:43:25.318593 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b20231ea-dba1-407d-a7fd-39094706292a does not exist Oct 17 13:43:25.318593 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ed3e40b0-0df0-4230-ac45-7e0923eedec4'] Oct 17 13:43:25.318593 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:25.318593 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d1f407bc-ba54-4e5a-b472-00b1df03e910 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Returning 404 to user: Security group b20231ea-dba1-407d-a7fd-39094706292a does not exist Oct 17 13:43:25.318593 n-d-854247-14 devstack@n-api.service[127016]: Neutron server returns request_ids: ['req-ed3e40b0-0df0-4230-ac45-7e0923eedec4'] {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:43:25.318593 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d1f407bc-ba54-4e5a-b472-00b1df03e910 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/b20231ea-dba1-407d-a7fd-39094706292a" status: 404 len: 194 microversion: 2.1 time: 0.125633 Oct 17 13:43:25.318593 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1185/2347] 10.222.0.79 () {58 vars in 1272 bytes} [Mon Oct 17 13:43:25 2022] DELETE /compute/v2.1/os-security-groups/b20231ea-dba1-407d-a7fd-39094706292a => generated 194 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:43:25.326202 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ab91fbed-1884-4460-806a-e82305737ef1 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Calling method '.version_select at 0x7f7cd9882ee0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:25.444113 n-d-854247-14 devstack@n-api.service[127016]: DEBUG neutronclient.v2_0.client [None req-ab91fbed-1884-4460-806a-e82305737ef1 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5ca54317-7291-4571-a040-4e4a3c88432f does not exist", "detail": ""}} {{(pid=127016) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 13:43:25.444718 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.security_group_api [None req-ab91fbed-1884-4460-806a-e82305737ef1 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Neutron security group 5ca54317-7291-4571-a040-4e4a3c88432f not found {{(pid=127016) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 17 13:43:25.445233 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-ab91fbed-1884-4460-806a-e82305737ef1 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] HTTP exception thrown: Security group 5ca54317-7291-4571-a040-4e4a3c88432f does not exist Oct 17 13:43:25.445233 n-d-854247-14 devstack@n-api.service[127016]: Neutron server returns request_ids: ['req-2e5c7459-d192-4507-b48a-ff0306f1fc61'] Oct 17 13:43:25.448593 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ab91fbed-1884-4460-806a-e82305737ef1 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Request method failure captured: Oct 17 13:43:25.448593 n-d-854247-14 devstack@n-api.service[127016]: request: DELETE /compute/v2.1/os-security-groups/5ca54317-7291-4571-a040-4e4a3c88432f HTTP/1.1 Oct 17 13:43:25.448593 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:43:25.448593 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:43:25.448593 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:43:25.448593 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:43:25.448593 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:43:25.448593 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:43:25.448593 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:43:25.448593 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:43:25.448593 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVtyFGyYtLVdwIq4ccz7RkXRa7NtlbhzSHc2HUbc2jnmH2QeepBwxbKf8toXm_ooPcHi9ET43LtT1AqXtRk9n6taXXPkcxvI9DAvMm-WduwoIrQJqrIBPqw0m6vAgqbSuo42q0EeC3f0tZCzBhE1QaAtaHcB-dTJTCp89NqtuNhDPjU Oct 17 13:43:25.448593 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:43:25.448593 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:43:25.448593 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:43:25.448593 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:43:25.448593 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:43:25.448593 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:43:25.448593 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 50c0147c5fae4017810887843b0afaa0 Oct 17 13:43:25.448593 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-SecurityGroupsTestJSON-1412652742 Oct 17 13:43:25.448593 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:43:25.448593 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:43:25.448593 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/50c0147c5fae4017810887843b0afaa0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/50c0147c5fae4017810887843b0afaa0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/50c0147c5fae4017810887843b0afaa0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_50c0147c5fae4017810887843b0afaa0", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:43:25.448593 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-SecurityGroupsTestJSON-1412652742 Oct 17 13:43:25.448593 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 50c0147c5fae4017810887843b0afaa0 Oct 17 13:43:25.448593 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1412652742 Oct 17 13:43:25.448593 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-SecurityGroupsTestJSON-1412652742-project Oct 17 13:43:25.448593 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:43:25.448593 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:43:25.448593 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 185235bc4e3245fc8d92b7e4bff6cbbd Oct 17 13:43:25.448593 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-SecurityGroupsTestJSON-1412652742-project Oct 17 13:43:25.448593 n-d-854247-14 devstack@n-api.service[127016]: method: Oct 17 13:43:25.448593 n-d-854247-14 devstack@n-api.service[127016]: exception: Security group 5ca54317-7291-4571-a040-4e4a3c88432f does not exist Oct 17 13:43:25.448593 n-d-854247-14 devstack@n-api.service[127016]: Neutron server returns request_ids: ['req-2e5c7459-d192-4507-b48a-ff0306f1fc61'] Oct 17 13:43:25.448593 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '5ca54317-7291-4571-a040-4e4a3c88432f'} Oct 17 13:43:25.448593 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:43:25.448593 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:25.448593 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 17 13:43:25.448593 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 17 13:43:25.448593 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:43:25.448593 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:43:25.448593 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 17 13:43:25.448593 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 17 13:43:25.448593 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:43:25.448593 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:43:25.448593 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 13:43:25.448593 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 13:43:25.448593 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:43:25.448593 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:43:25.448593 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 13:43:25.448593 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 13:43:25.448593 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:43:25.448593 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:43:25.448593 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 13:43:25.448593 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 13:43:25.448593 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:43:25.448593 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:43:25.448593 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 13:43:25.448593 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 13:43:25.448593 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 13:43:25.448593 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 13:43:25.448593 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5ca54317-7291-4571-a040-4e4a3c88432f does not exist Oct 17 13:43:25.452684 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2e5c7459-d192-4507-b48a-ff0306f1fc61'] Oct 17 13:43:25.452684 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:25.452684 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:25.452684 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:25.452684 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:25.452684 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 17 13:43:25.452684 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 17 13:43:25.452684 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 17 13:43:25.452684 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 13:43:25.452684 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5ca54317-7291-4571-a040-4e4a3c88432f does not exist Oct 17 13:43:25.452684 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2e5c7459-d192-4507-b48a-ff0306f1fc61'] Oct 17 13:43:25.452684 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:25.452684 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:25.452684 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:25.452684 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:25.452684 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:25.452684 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:25.452684 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:43:25.452684 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:43:25.452684 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:43:25.452684 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:43:25.452684 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:43:25.452684 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:43:25.452684 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 17 13:43:25.452684 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 17 13:43:25.452684 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5ca54317-7291-4571-a040-4e4a3c88432f does not exist Oct 17 13:43:25.452684 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2e5c7459-d192-4507-b48a-ff0306f1fc61'] Oct 17 13:43:25.452684 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:25.452684 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:25.452684 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:25.452684 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:25.452684 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:25.452684 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:25.452684 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:43:25.452684 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:43:25.452684 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5ca54317-7291-4571-a040-4e4a3c88432f does not exist Oct 17 13:43:25.452684 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2e5c7459-d192-4507-b48a-ff0306f1fc61'] Oct 17 13:43:25.452684 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:25.452684 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ab91fbed-1884-4460-806a-e82305737ef1 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Returning 404 to user: Security group 5ca54317-7291-4571-a040-4e4a3c88432f does not exist Oct 17 13:43:25.452684 n-d-854247-14 devstack@n-api.service[127016]: Neutron server returns request_ids: ['req-2e5c7459-d192-4507-b48a-ff0306f1fc61'] {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:43:25.452684 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ab91fbed-1884-4460-806a-e82305737ef1 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/5ca54317-7291-4571-a040-4e4a3c88432f" status: 404 len: 194 microversion: 2.1 time: 0.128374 Oct 17 13:43:25.456940 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1186/2348] 10.222.0.79 () {58 vars in 1272 bytes} [Mon Oct 17 13:43:25 2022] DELETE /compute/v2.1/os-security-groups/5ca54317-7291-4571-a040-4e4a3c88432f => generated 194 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:43:25.460843 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-14bd940e-f0ba-4813-b567-97ebcc102353 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Calling method '.version_select at 0x7f7cd5474ee0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:25.549230 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-04d1000b-2d74-43f6-b705-20b4600927ed tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:25.567740 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-04d1000b-2d74-43f6-b705-20b4600927ed tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:25.575395 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-04d1000b-2d74-43f6-b705-20b4600927ed tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:25.576666 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-04d1000b-2d74-43f6-b705-20b4600927ed tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6" status: 200 len: 1281 microversion: 2.25 time: 0.595721 Oct 17 13:43:25.582451 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1163/2349] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:24 2022] GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6 => generated 1281 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:43:25.605269 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9ecb80dc-6425-4d52-8e3c-d0a5b87b7c08 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:25.606464 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9ecb80dc-6425-4d52-8e3c-d0a5b87b7c08 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 240648df-7968-4bbe-ac94-08360eb1049e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:25.625583 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9ecb80dc-6425-4d52-8e3c-d0a5b87b7c08 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:25.628123 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9ecb80dc-6425-4d52-8e3c-d0a5b87b7c08 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:25.628376 n-d-854247-14 devstack@n-api.service[127016]: DEBUG neutronclient.v2_0.client [None req-14bd940e-f0ba-4813-b567-97ebcc102353 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group cfeb08ea-35da-4ac9-b744-670b918ca956 does not exist", "detail": ""}} {{(pid=127016) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 13:43:25.629082 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.security_group_api [None req-14bd940e-f0ba-4813-b567-97ebcc102353 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Neutron security group cfeb08ea-35da-4ac9-b744-670b918ca956 not found {{(pid=127016) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 17 13:43:25.629433 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9ecb80dc-6425-4d52-8e3c-d0a5b87b7c08 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:25.629806 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-14bd940e-f0ba-4813-b567-97ebcc102353 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] HTTP exception thrown: Security group cfeb08ea-35da-4ac9-b744-670b918ca956 does not exist Oct 17 13:43:25.629806 n-d-854247-14 devstack@n-api.service[127016]: Neutron server returns request_ids: ['req-19b7c132-4fe6-445d-8beb-243802baabd3'] Oct 17 13:43:25.630819 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9ecb80dc-6425-4d52-8e3c-d0a5b87b7c08 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:25.631921 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-14bd940e-f0ba-4813-b567-97ebcc102353 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Request method failure captured: Oct 17 13:43:25.631921 n-d-854247-14 devstack@n-api.service[127016]: request: DELETE /compute/v2.1/os-security-groups/cfeb08ea-35da-4ac9-b744-670b918ca956 HTTP/1.1 Oct 17 13:43:25.631921 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:43:25.631921 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:43:25.631921 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:43:25.631921 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:43:25.631921 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:43:25.631921 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:43:25.631921 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:43:25.631921 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:43:25.631921 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVtyFGyYtLVdwIq4ccz7RkXRa7NtlbhzSHc2HUbc2jnmH2QeepBwxbKf8toXm_ooPcHi9ET43LtT1AqXtRk9n6taXXPkcxvI9DAvMm-WduwoIrQJqrIBPqw0m6vAgqbSuo42q0EeC3f0tZCzBhE1QaAtaHcB-dTJTCp89NqtuNhDPjU Oct 17 13:43:25.631921 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:43:25.631921 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:43:25.631921 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:43:25.631921 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:43:25.631921 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:43:25.631921 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:43:25.631921 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 50c0147c5fae4017810887843b0afaa0 Oct 17 13:43:25.631921 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-SecurityGroupsTestJSON-1412652742 Oct 17 13:43:25.631921 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:43:25.631921 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:43:25.631921 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/50c0147c5fae4017810887843b0afaa0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/50c0147c5fae4017810887843b0afaa0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/50c0147c5fae4017810887843b0afaa0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_50c0147c5fae4017810887843b0afaa0", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:43:25.631921 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-SecurityGroupsTestJSON-1412652742 Oct 17 13:43:25.631921 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 50c0147c5fae4017810887843b0afaa0 Oct 17 13:43:25.631921 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1412652742 Oct 17 13:43:25.631921 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-SecurityGroupsTestJSON-1412652742-project Oct 17 13:43:25.631921 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:43:25.631921 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:43:25.631921 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 185235bc4e3245fc8d92b7e4bff6cbbd Oct 17 13:43:25.631921 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-SecurityGroupsTestJSON-1412652742-project Oct 17 13:43:25.631921 n-d-854247-14 devstack@n-api.service[127016]: method: Oct 17 13:43:25.631921 n-d-854247-14 devstack@n-api.service[127016]: exception: Security group cfeb08ea-35da-4ac9-b744-670b918ca956 does not exist Oct 17 13:43:25.631921 n-d-854247-14 devstack@n-api.service[127016]: Neutron server returns request_ids: ['req-19b7c132-4fe6-445d-8beb-243802baabd3'] Oct 17 13:43:25.631921 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'cfeb08ea-35da-4ac9-b744-670b918ca956'} Oct 17 13:43:25.631921 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:43:25.631921 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:25.631921 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 17 13:43:25.631921 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 17 13:43:25.631921 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:43:25.631921 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:43:25.631921 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 17 13:43:25.631921 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 17 13:43:25.631921 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:43:25.631921 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:43:25.631921 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 13:43:25.631921 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 13:43:25.631921 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:43:25.631921 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:43:25.631921 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 13:43:25.631921 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 13:43:25.631921 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:43:25.631921 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:43:25.631921 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 13:43:25.631921 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 13:43:25.631921 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:43:25.631921 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:43:25.631921 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 13:43:25.631921 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 13:43:25.631921 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 13:43:25.631921 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 13:43:25.631921 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group cfeb08ea-35da-4ac9-b744-670b918ca956 does not exist Oct 17 13:43:25.635412 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-19b7c132-4fe6-445d-8beb-243802baabd3'] Oct 17 13:43:25.635412 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:25.635412 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:25.635412 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:25.635412 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:25.635412 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 17 13:43:25.635412 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 17 13:43:25.635412 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 17 13:43:25.635412 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 13:43:25.635412 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group cfeb08ea-35da-4ac9-b744-670b918ca956 does not exist Oct 17 13:43:25.635412 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-19b7c132-4fe6-445d-8beb-243802baabd3'] Oct 17 13:43:25.635412 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:25.635412 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:25.635412 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:25.635412 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:25.635412 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:25.635412 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:25.635412 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:43:25.635412 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:43:25.635412 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:43:25.635412 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:43:25.635412 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:43:25.635412 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:43:25.635412 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 17 13:43:25.635412 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 17 13:43:25.635412 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group cfeb08ea-35da-4ac9-b744-670b918ca956 does not exist Oct 17 13:43:25.635412 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-19b7c132-4fe6-445d-8beb-243802baabd3'] Oct 17 13:43:25.635412 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:25.635412 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:25.635412 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:25.635412 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:25.635412 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:25.635412 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:25.635412 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:43:25.635412 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:43:25.635412 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group cfeb08ea-35da-4ac9-b744-670b918ca956 does not exist Oct 17 13:43:25.635412 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-19b7c132-4fe6-445d-8beb-243802baabd3'] Oct 17 13:43:25.635412 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:25.637417 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9ecb80dc-6425-4d52-8e3c-d0a5b87b7c08 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:25.637417 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9ecb80dc-6425-4d52-8e3c-d0a5b87b7c08 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:25.640678 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-14bd940e-f0ba-4813-b567-97ebcc102353 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Returning 404 to user: Security group cfeb08ea-35da-4ac9-b744-670b918ca956 does not exist Oct 17 13:43:25.640678 n-d-854247-14 devstack@n-api.service[127016]: Neutron server returns request_ids: ['req-19b7c132-4fe6-445d-8beb-243802baabd3'] {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:43:25.641880 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-14bd940e-f0ba-4813-b567-97ebcc102353 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/cfeb08ea-35da-4ac9-b744-670b918ca956" status: 404 len: 194 microversion: 2.1 time: 0.185704 Oct 17 13:43:25.642663 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1187/2350] 10.222.0.79 () {58 vars in 1272 bytes} [Mon Oct 17 13:43:25 2022] DELETE /compute/v2.1/os-security-groups/cfeb08ea-35da-4ac9-b744-670b918ca956 => generated 194 bytes in 188 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:43:25.650827 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-833a10b7-745f-4061-9078-208a96c2b789 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Calling method '.version_select at 0x7f7cd541a820>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:25.711261 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-9ecb80dc-6425-4d52-8e3c-d0a5b87b7c08 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] HTTP exception thrown: Instance 240648df-7968-4bbe-ac94-08360eb1049e could not be found. Oct 17 13:43:25.722472 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9ecb80dc-6425-4d52-8e3c-d0a5b87b7c08 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Request method failure captured: Oct 17 13:43:25.722472 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/240648df-7968-4bbe-ac94-08360eb1049e HTTP/1.1 Oct 17 13:43:25.722472 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:43:25.722472 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:43:25.722472 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:43:25.722472 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:43:25.722472 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:43:25.722472 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:43:25.722472 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:43:25.722472 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:43:25.722472 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVszY_wclohBuNPK0P_3jbSFmXGILJiR0kut7HGY7vdojAtAlgLeOEyTvku-r4VQYKyuAyJM_KtqAXyFPanfsPpRz4_W6UcoeBgPABVSis4XYtKsP83QBvJQcsGPvp8Wx3GMX5AIKTAVb6IQUk7hxnikQ34nlW7VAbL3pwsly6HaYAc Oct 17 13:43:25.722472 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:43:25.722472 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:43:25.722472 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:43:25.722472 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:43:25.722472 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:43:25.722472 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:43:25.722472 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: a8fe03af82c34607bfe43a58b997704f Oct 17 13:43:25.722472 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1211509445 Oct 17 13:43:25.722472 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:43:25.722472 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:43:25.722472 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a8fe03af82c34607bfe43a58b997704f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a8fe03af82c34607bfe43a58b997704f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a8fe03af82c34607bfe43a58b997704f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a8fe03af82c34607bfe43a58b997704f", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:43:25.722472 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServerDiskConfigTestJSON-1211509445 Oct 17 13:43:25.722472 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: a8fe03af82c34607bfe43a58b997704f Oct 17 13:43:25.722472 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1211509445 Oct 17 13:43:25.722472 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServerDiskConfigTestJSON-1211509445-project Oct 17 13:43:25.722472 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:43:25.722472 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:43:25.722472 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 17a7b6856447415487c272498ca335db Oct 17 13:43:25.722472 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServerDiskConfigTestJSON-1211509445-project Oct 17 13:43:25.722472 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:43:25.722472 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 240648df-7968-4bbe-ac94-08360eb1049e could not be found. Oct 17 13:43:25.722472 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '240648df-7968-4bbe-ac94-08360eb1049e'} Oct 17 13:43:25.722472 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:43:25.722472 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:25.722472 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:43:25.722472 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:43:25.722472 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:43:25.722472 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:43:25.722472 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:43:25.722472 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:43:25.722472 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:43:25.722472 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:43:25.722472 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 240648df-7968-4bbe-ac94-08360eb1049e could not be found. Oct 17 13:43:25.722472 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:43:25.722472 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:25.722472 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:43:25.722472 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:25.722472 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:25.722472 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:25.722472 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:43:25.722472 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:43:25.722472 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:43:25.722472 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:43:25.722472 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:43:25.722472 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:43:25.722472 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:43:25.722472 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:43:25.722472 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:43:25.722472 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:43:25.722472 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 240648df-7968-4bbe-ac94-08360eb1049e could not be found. Oct 17 13:43:25.722472 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:43:25.722472 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:25.722472 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:43:25.726874 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:25.726874 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:25.726874 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:25.726874 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:43:25.726874 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:43:25.726874 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 240648df-7968-4bbe-ac94-08360eb1049e could not be found. Oct 17 13:43:25.726874 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:43:25.726874 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9ecb80dc-6425-4d52-8e3c-d0a5b87b7c08 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Returning 404 to user: Instance 240648df-7968-4bbe-ac94-08360eb1049e could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:43:25.726874 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9ecb80dc-6425-4d52-8e3c-d0a5b87b7c08 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/240648df-7968-4bbe-ac94-08360eb1049e" status: 404 len: 111 microversion: 2.1 time: 0.140660 Oct 17 13:43:25.728449 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1164/2351] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:25 2022] GET /compute/v2.1/servers/240648df-7968-4bbe-ac94-08360eb1049e => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:43:25.736845 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-55d1c5fe-8a32-4668-b6cb-92a8df037597 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:25.747986 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-55d1c5fe-8a32-4668-b6cb-92a8df037597 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9044674d-a793-46c2-b3ec-e9377b30f253] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:25.754384 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-55d1c5fe-8a32-4668-b6cb-92a8df037597 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:25.758718 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-55d1c5fe-8a32-4668-b6cb-92a8df037597 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:25.759591 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-55d1c5fe-8a32-4668-b6cb-92a8df037597 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:25.760726 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-55d1c5fe-8a32-4668-b6cb-92a8df037597 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:25.761349 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-55d1c5fe-8a32-4668-b6cb-92a8df037597 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:25.761991 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-55d1c5fe-8a32-4668-b6cb-92a8df037597 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:25.786571 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-55d1c5fe-8a32-4668-b6cb-92a8df037597 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] HTTP exception thrown: Instance 9044674d-a793-46c2-b3ec-e9377b30f253 could not be found. Oct 17 13:43:25.799602 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-55d1c5fe-8a32-4668-b6cb-92a8df037597 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Request method failure captured: Oct 17 13:43:25.799602 n-d-854247-14 devstack@n-api.service[127017]: request: DELETE /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253 HTTP/1.1 Oct 17 13:43:25.799602 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:43:25.799602 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:43:25.799602 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:43:25.799602 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:43:25.799602 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:43:25.799602 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:43:25.799602 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:43:25.799602 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:43:25.799602 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVszY_wclohBuNPK0P_3jbSFmXGILJiR0kut7HGY7vdojAtAlgLeOEyTvku-r4VQYKyuAyJM_KtqAXyFPanfsPpRz4_W6UcoeBgPABVSis4XYtKsP83QBvJQcsGPvp8Wx3GMX5AIKTAVb6IQUk7hxnikQ34nlW7VAbL3pwsly6HaYAc Oct 17 13:43:25.799602 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:43:25.799602 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:43:25.799602 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:43:25.799602 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:43:25.799602 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:43:25.799602 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:43:25.799602 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: a8fe03af82c34607bfe43a58b997704f Oct 17 13:43:25.799602 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1211509445 Oct 17 13:43:25.799602 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:43:25.799602 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:43:25.799602 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a8fe03af82c34607bfe43a58b997704f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a8fe03af82c34607bfe43a58b997704f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a8fe03af82c34607bfe43a58b997704f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a8fe03af82c34607bfe43a58b997704f", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:43:25.799602 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServerDiskConfigTestJSON-1211509445 Oct 17 13:43:25.799602 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: a8fe03af82c34607bfe43a58b997704f Oct 17 13:43:25.799602 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1211509445 Oct 17 13:43:25.799602 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServerDiskConfigTestJSON-1211509445-project Oct 17 13:43:25.799602 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:43:25.799602 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:43:25.799602 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 17a7b6856447415487c272498ca335db Oct 17 13:43:25.799602 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServerDiskConfigTestJSON-1211509445-project Oct 17 13:43:25.799602 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:43:25.799602 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 9044674d-a793-46c2-b3ec-e9377b30f253 could not be found. Oct 17 13:43:25.799602 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '9044674d-a793-46c2-b3ec-e9377b30f253'} Oct 17 13:43:25.799602 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:43:25.799602 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:25.799602 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:43:25.799602 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:43:25.799602 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:43:25.799602 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:43:25.799602 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:43:25.799602 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:43:25.799602 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:43:25.799602 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:43:25.799602 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9044674d-a793-46c2-b3ec-e9377b30f253 could not be found. Oct 17 13:43:25.799602 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:43:25.799602 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:25.799602 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:43:25.799602 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:25.799602 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:25.799602 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:25.799602 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:43:25.799602 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:43:25.799602 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:43:25.799602 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:43:25.799602 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:43:25.799602 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:43:25.799602 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:43:25.799602 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:43:25.799602 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:43:25.799602 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:43:25.799602 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:43:25.799602 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:43:25.802955 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9044674d-a793-46c2-b3ec-e9377b30f253 could not be found. Oct 17 13:43:25.802955 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:43:25.802955 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:25.802955 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:43:25.802955 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:25.802955 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:25.802955 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:25.802955 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:43:25.802955 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:43:25.802955 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9044674d-a793-46c2-b3ec-e9377b30f253 could not be found. Oct 17 13:43:25.802955 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:43:25.807803 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-55d1c5fe-8a32-4668-b6cb-92a8df037597 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Returning 404 to user: Instance 9044674d-a793-46c2-b3ec-e9377b30f253 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:43:25.809991 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-55d1c5fe-8a32-4668-b6cb-92a8df037597 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "DELETE /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253" status: 404 len: 111 microversion: 2.1 time: 0.077223 Oct 17 13:43:25.812582 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1165/2352] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:43:25 2022] DELETE /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:43:25.823756 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-82117e2c-00b3-4c9d-b36b-2fc14fb986cf tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:25.828377 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-82117e2c-00b3-4c9d-b36b-2fc14fb986cf tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9044674d-a793-46c2-b3ec-e9377b30f253] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:25.842800 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82117e2c-00b3-4c9d-b36b-2fc14fb986cf tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:25.844559 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82117e2c-00b3-4c9d-b36b-2fc14fb986cf tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:25.845243 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82117e2c-00b3-4c9d-b36b-2fc14fb986cf tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:25.848464 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82117e2c-00b3-4c9d-b36b-2fc14fb986cf tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:25.857470 n-d-854247-14 devstack@n-api.service[127016]: DEBUG neutronclient.v2_0.client [None req-833a10b7-745f-4061-9078-208a96c2b789 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 23bd3a00-58c3-4c24-9221-e77357620949 does not exist", "detail": ""}} {{(pid=127016) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 13:43:25.858091 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82117e2c-00b3-4c9d-b36b-2fc14fb986cf tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:25.858544 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.security_group_api [None req-833a10b7-745f-4061-9078-208a96c2b789 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Neutron security group 23bd3a00-58c3-4c24-9221-e77357620949 not found {{(pid=127016) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 17 13:43:25.859148 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-833a10b7-745f-4061-9078-208a96c2b789 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] HTTP exception thrown: Security group 23bd3a00-58c3-4c24-9221-e77357620949 does not exist Oct 17 13:43:25.859148 n-d-854247-14 devstack@n-api.service[127016]: Neutron server returns request_ids: ['req-2868ff88-5c4d-4147-8165-edb0f3b0d009'] Oct 17 13:43:25.860025 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82117e2c-00b3-4c9d-b36b-2fc14fb986cf tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:25.861635 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-833a10b7-745f-4061-9078-208a96c2b789 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Request method failure captured: Oct 17 13:43:25.861635 n-d-854247-14 devstack@n-api.service[127016]: request: DELETE /compute/v2.1/os-security-groups/23bd3a00-58c3-4c24-9221-e77357620949 HTTP/1.1 Oct 17 13:43:25.861635 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:43:25.861635 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:43:25.861635 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:43:25.861635 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:43:25.861635 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:43:25.861635 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:43:25.861635 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:43:25.861635 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:43:25.861635 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVtyFGyYtLVdwIq4ccz7RkXRa7NtlbhzSHc2HUbc2jnmH2QeepBwxbKf8toXm_ooPcHi9ET43LtT1AqXtRk9n6taXXPkcxvI9DAvMm-WduwoIrQJqrIBPqw0m6vAgqbSuo42q0EeC3f0tZCzBhE1QaAtaHcB-dTJTCp89NqtuNhDPjU Oct 17 13:43:25.861635 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:43:25.861635 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:43:25.861635 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:43:25.861635 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:43:25.861635 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:43:25.861635 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:43:25.861635 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 50c0147c5fae4017810887843b0afaa0 Oct 17 13:43:25.861635 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-SecurityGroupsTestJSON-1412652742 Oct 17 13:43:25.861635 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:43:25.861635 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:43:25.861635 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/50c0147c5fae4017810887843b0afaa0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/50c0147c5fae4017810887843b0afaa0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/50c0147c5fae4017810887843b0afaa0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_50c0147c5fae4017810887843b0afaa0", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:43:25.861635 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-SecurityGroupsTestJSON-1412652742 Oct 17 13:43:25.861635 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 50c0147c5fae4017810887843b0afaa0 Oct 17 13:43:25.861635 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1412652742 Oct 17 13:43:25.861635 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-SecurityGroupsTestJSON-1412652742-project Oct 17 13:43:25.861635 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:43:25.861635 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:43:25.861635 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 185235bc4e3245fc8d92b7e4bff6cbbd Oct 17 13:43:25.861635 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-SecurityGroupsTestJSON-1412652742-project Oct 17 13:43:25.861635 n-d-854247-14 devstack@n-api.service[127016]: method: Oct 17 13:43:25.861635 n-d-854247-14 devstack@n-api.service[127016]: exception: Security group 23bd3a00-58c3-4c24-9221-e77357620949 does not exist Oct 17 13:43:25.861635 n-d-854247-14 devstack@n-api.service[127016]: Neutron server returns request_ids: ['req-2868ff88-5c4d-4147-8165-edb0f3b0d009'] Oct 17 13:43:25.861635 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '23bd3a00-58c3-4c24-9221-e77357620949'} Oct 17 13:43:25.861635 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:43:25.861635 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:25.861635 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 17 13:43:25.861635 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 17 13:43:25.861635 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:43:25.861635 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:43:25.861635 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 17 13:43:25.861635 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 17 13:43:25.861635 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:43:25.861635 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:43:25.861635 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 13:43:25.861635 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 13:43:25.861635 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:43:25.861635 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:43:25.861635 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 13:43:25.861635 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 13:43:25.861635 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:43:25.861635 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:43:25.861635 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 13:43:25.861635 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 13:43:25.861635 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:43:25.861635 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:43:25.861635 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 13:43:25.861635 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 13:43:25.861635 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 13:43:25.861635 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 13:43:25.861635 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 23bd3a00-58c3-4c24-9221-e77357620949 does not exist Oct 17 13:43:25.864857 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2868ff88-5c4d-4147-8165-edb0f3b0d009'] Oct 17 13:43:25.864857 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:25.864857 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:25.864857 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:25.864857 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:25.864857 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 17 13:43:25.864857 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 17 13:43:25.864857 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 17 13:43:25.864857 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 13:43:25.864857 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 23bd3a00-58c3-4c24-9221-e77357620949 does not exist Oct 17 13:43:25.864857 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2868ff88-5c4d-4147-8165-edb0f3b0d009'] Oct 17 13:43:25.864857 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:25.864857 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:25.864857 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:25.864857 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:25.864857 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:25.864857 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:25.864857 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:43:25.864857 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:43:25.864857 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:43:25.864857 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:43:25.864857 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:43:25.864857 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:43:25.864857 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 17 13:43:25.864857 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 17 13:43:25.864857 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 23bd3a00-58c3-4c24-9221-e77357620949 does not exist Oct 17 13:43:25.864857 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2868ff88-5c4d-4147-8165-edb0f3b0d009'] Oct 17 13:43:25.864857 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:25.864857 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:25.864857 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:25.864857 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:25.864857 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:25.864857 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:25.864857 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:43:25.864857 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:43:25.864857 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 23bd3a00-58c3-4c24-9221-e77357620949 does not exist Oct 17 13:43:25.864857 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2868ff88-5c4d-4147-8165-edb0f3b0d009'] Oct 17 13:43:25.864857 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:25.864857 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-833a10b7-745f-4061-9078-208a96c2b789 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Returning 404 to user: Security group 23bd3a00-58c3-4c24-9221-e77357620949 does not exist Oct 17 13:43:25.864857 n-d-854247-14 devstack@n-api.service[127016]: Neutron server returns request_ids: ['req-2868ff88-5c4d-4147-8165-edb0f3b0d009'] {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:43:25.864857 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-833a10b7-745f-4061-9078-208a96c2b789 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/23bd3a00-58c3-4c24-9221-e77357620949" status: 404 len: 194 microversion: 2.1 time: 0.216253 Oct 17 13:43:25.868685 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1188/2353] 10.222.0.79 () {58 vars in 1272 bytes} [Mon Oct 17 13:43:25 2022] DELETE /compute/v2.1/os-security-groups/23bd3a00-58c3-4c24-9221-e77357620949 => generated 194 bytes in 217 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:43:25.890262 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3aea5e93-a9a6-4e66-b8f3-9f55673d147b tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:25.890894 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3aea5e93-a9a6-4e66-b8f3-9f55673d147b tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] [instance: 58a43093-7550-452c-bd8a-fab84203fca3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:25.921333 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3aea5e93-a9a6-4e66-b8f3-9f55673d147b tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:25.921799 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3aea5e93-a9a6-4e66-b8f3-9f55673d147b tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:25.922230 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3aea5e93-a9a6-4e66-b8f3-9f55673d147b tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:25.922947 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3aea5e93-a9a6-4e66-b8f3-9f55673d147b tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:25.923426 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3aea5e93-a9a6-4e66-b8f3-9f55673d147b tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:25.927272 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3aea5e93-a9a6-4e66-b8f3-9f55673d147b tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:25.937645 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-82117e2c-00b3-4c9d-b36b-2fc14fb986cf tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] HTTP exception thrown: Instance 9044674d-a793-46c2-b3ec-e9377b30f253 could not be found. Oct 17 13:43:25.946362 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-82117e2c-00b3-4c9d-b36b-2fc14fb986cf tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Request method failure captured: Oct 17 13:43:25.946362 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253 HTTP/1.1 Oct 17 13:43:25.946362 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:43:25.946362 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:43:25.946362 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:43:25.946362 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:43:25.946362 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:43:25.946362 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:43:25.946362 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:43:25.946362 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:43:25.946362 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVszY_wclohBuNPK0P_3jbSFmXGILJiR0kut7HGY7vdojAtAlgLeOEyTvku-r4VQYKyuAyJM_KtqAXyFPanfsPpRz4_W6UcoeBgPABVSis4XYtKsP83QBvJQcsGPvp8Wx3GMX5AIKTAVb6IQUk7hxnikQ34nlW7VAbL3pwsly6HaYAc Oct 17 13:43:25.946362 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:43:25.946362 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:43:25.946362 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:43:25.946362 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:43:25.946362 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:43:25.946362 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:43:25.946362 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: a8fe03af82c34607bfe43a58b997704f Oct 17 13:43:25.946362 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1211509445 Oct 17 13:43:25.946362 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:43:25.946362 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:43:25.946362 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a8fe03af82c34607bfe43a58b997704f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a8fe03af82c34607bfe43a58b997704f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a8fe03af82c34607bfe43a58b997704f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a8fe03af82c34607bfe43a58b997704f", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:43:25.946362 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServerDiskConfigTestJSON-1211509445 Oct 17 13:43:25.946362 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: a8fe03af82c34607bfe43a58b997704f Oct 17 13:43:25.946362 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1211509445 Oct 17 13:43:25.946362 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServerDiskConfigTestJSON-1211509445-project Oct 17 13:43:25.946362 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:43:25.946362 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:43:25.946362 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 17a7b6856447415487c272498ca335db Oct 17 13:43:25.946362 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServerDiskConfigTestJSON-1211509445-project Oct 17 13:43:25.946362 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:43:25.946362 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 9044674d-a793-46c2-b3ec-e9377b30f253 could not be found. Oct 17 13:43:25.946362 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '9044674d-a793-46c2-b3ec-e9377b30f253'} Oct 17 13:43:25.946362 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:43:25.946362 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:25.946362 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:43:25.946362 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:43:25.946362 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:43:25.946362 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:43:25.946362 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:43:25.946362 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:43:25.946362 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:43:25.946362 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:43:25.946362 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9044674d-a793-46c2-b3ec-e9377b30f253 could not be found. Oct 17 13:43:25.946362 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:43:25.946362 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:25.946362 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:43:25.946362 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:25.946362 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:25.946362 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:25.946362 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:43:25.946362 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:43:25.946362 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:43:25.946362 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:43:25.946362 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:43:25.946362 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:43:25.946362 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:43:25.946362 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:43:25.946362 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:43:25.946362 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:43:25.946362 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9044674d-a793-46c2-b3ec-e9377b30f253 could not be found. Oct 17 13:43:25.946362 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:43:25.946362 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:25.946362 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:43:25.951127 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:25.951127 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:25.951127 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:25.951127 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:43:25.951127 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:43:25.951127 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9044674d-a793-46c2-b3ec-e9377b30f253 could not be found. Oct 17 13:43:25.951127 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:43:25.953376 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-82117e2c-00b3-4c9d-b36b-2fc14fb986cf tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Returning 404 to user: Instance 9044674d-a793-46c2-b3ec-e9377b30f253 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:43:25.957428 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-82117e2c-00b3-4c9d-b36b-2fc14fb986cf tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253" status: 404 len: 111 microversion: 2.1 time: 0.142300 Oct 17 13:43:25.969294 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1166/2354] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:25 2022] GET /compute/v2.1/servers/9044674d-a793-46c2-b3ec-e9377b30f253 => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:43:25.976577 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-41770164-7d41-4de1-8218-30807952df53 req-b4e44a56-785f-4c6e-8237-27d503c51abc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f806fc0-61ef-4c0b-b6af-8f987148f5ca", "name": "network-vif-deleted", "tag": "8852e286-0d94-4c6e-aeb7-c6b79afb6231"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:26.000633 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3aea5e93-a9a6-4e66-b8f3-9f55673d147b tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] [instance: 58a43093-7550-452c-bd8a-fab84203fca3] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:43:26.009853 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-41770164-7d41-4de1-8218-30807952df53 req-b4e44a56-785f-4c6e-8237-27d503c51abc service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:26.010763 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-41770164-7d41-4de1-8218-30807952df53 req-b4e44a56-785f-4c6e-8237-27d503c51abc service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:26.013562 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-41770164-7d41-4de1-8218-30807952df53 req-b4e44a56-785f-4c6e-8237-27d503c51abc service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:26.030391 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-41770164-7d41-4de1-8218-30807952df53 req-b4e44a56-785f-4c6e-8237-27d503c51abc service nova] Creating event network-vif-deleted:8852e286-0d94-4c6e-aeb7-c6b79afb6231 for instance 4f806fc0-61ef-4c0b-b6af-8f987148f5ca on n-h2-854247-14 Oct 17 13:43:26.036878 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-41770164-7d41-4de1-8218-30807952df53 req-b4e44a56-785f-4c6e-8237-27d503c51abc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068056 Oct 17 13:43:26.040138 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1167/2355] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:43:26.052796 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-42077f43-8f4a-4b30-8269-3e0fed499550 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:26.056598 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-42077f43-8f4a-4b30-8269-3e0fed499550 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] [instance: 4f806fc0-61ef-4c0b-b6af-8f987148f5ca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:26.072866 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-42077f43-8f4a-4b30-8269-3e0fed499550 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:26.073950 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-42077f43-8f4a-4b30-8269-3e0fed499550 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:26.079864 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-42077f43-8f4a-4b30-8269-3e0fed499550 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:26.082291 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-42077f43-8f4a-4b30-8269-3e0fed499550 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:26.083152 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-42077f43-8f4a-4b30-8269-3e0fed499550 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:26.083961 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-42077f43-8f4a-4b30-8269-3e0fed499550 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:26.260305 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3aea5e93-a9a6-4e66-b8f3-9f55673d147b tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "DELETE /compute/v2.1/servers/58a43093-7550-452c-bd8a-fab84203fca3" status: 204 len: 0 microversion: 2.1 time: 0.390422 Oct 17 13:43:26.264140 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1189/2356] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:43:25 2022] DELETE /compute/v2.1/servers/58a43093-7550-452c-bd8a-fab84203fca3 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:43:26.275576 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-929c4477-14a4-4faa-9881-e516d06fc8c1 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:26.276472 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-929c4477-14a4-4faa-9881-e516d06fc8c1 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9c6b4ed2-b111-41b0-9679-b66d386834b9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:26.291446 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-929c4477-14a4-4faa-9881-e516d06fc8c1 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:26.293194 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-929c4477-14a4-4faa-9881-e516d06fc8c1 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:26.293777 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-929c4477-14a4-4faa-9881-e516d06fc8c1 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:26.294649 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-929c4477-14a4-4faa-9881-e516d06fc8c1 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:26.295276 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-929c4477-14a4-4faa-9881-e516d06fc8c1 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:26.295849 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-929c4477-14a4-4faa-9881-e516d06fc8c1 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:26.313536 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-929c4477-14a4-4faa-9881-e516d06fc8c1 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] HTTP exception thrown: Instance 9c6b4ed2-b111-41b0-9679-b66d386834b9 could not be found. Oct 17 13:43:26.315800 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-929c4477-14a4-4faa-9881-e516d06fc8c1 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Request method failure captured: Oct 17 13:43:26.315800 n-d-854247-14 devstack@n-api.service[127016]: request: DELETE /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9 HTTP/1.1 Oct 17 13:43:26.315800 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:43:26.315800 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:43:26.315800 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:43:26.315800 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:43:26.315800 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:43:26.315800 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:43:26.315800 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:43:26.315800 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:43:26.315800 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVszY_wclohBuNPK0P_3jbSFmXGILJiR0kut7HGY7vdojAtAlgLeOEyTvku-r4VQYKyuAyJM_KtqAXyFPanfsPpRz4_W6UcoeBgPABVSis4XYtKsP83QBvJQcsGPvp8Wx3GMX5AIKTAVb6IQUk7hxnikQ34nlW7VAbL3pwsly6HaYAc Oct 17 13:43:26.315800 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:43:26.315800 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:43:26.315800 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:43:26.315800 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:43:26.315800 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:43:26.315800 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:43:26.315800 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: a8fe03af82c34607bfe43a58b997704f Oct 17 13:43:26.315800 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1211509445 Oct 17 13:43:26.315800 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:43:26.315800 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:43:26.315800 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a8fe03af82c34607bfe43a58b997704f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a8fe03af82c34607bfe43a58b997704f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a8fe03af82c34607bfe43a58b997704f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a8fe03af82c34607bfe43a58b997704f", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:43:26.315800 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServerDiskConfigTestJSON-1211509445 Oct 17 13:43:26.315800 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: a8fe03af82c34607bfe43a58b997704f Oct 17 13:43:26.315800 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1211509445 Oct 17 13:43:26.315800 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServerDiskConfigTestJSON-1211509445-project Oct 17 13:43:26.315800 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:43:26.315800 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:43:26.315800 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 17a7b6856447415487c272498ca335db Oct 17 13:43:26.315800 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServerDiskConfigTestJSON-1211509445-project Oct 17 13:43:26.315800 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:43:26.315800 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 9c6b4ed2-b111-41b0-9679-b66d386834b9 could not be found. Oct 17 13:43:26.315800 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '9c6b4ed2-b111-41b0-9679-b66d386834b9'} Oct 17 13:43:26.315800 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:43:26.315800 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:26.315800 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:43:26.315800 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:43:26.315800 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:43:26.315800 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:43:26.315800 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:43:26.315800 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:43:26.315800 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:43:26.315800 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:43:26.315800 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c6b4ed2-b111-41b0-9679-b66d386834b9 could not be found. Oct 17 13:43:26.315800 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:26.315800 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:26.315800 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:26.315800 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:26.315800 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:26.315800 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:26.315800 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:43:26.315800 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:43:26.315800 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:43:26.315800 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:43:26.315800 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:43:26.315800 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:43:26.315800 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:43:26.315800 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:43:26.315800 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:43:26.315800 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:43:26.315800 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:43:26.315800 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:43:26.319883 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c6b4ed2-b111-41b0-9679-b66d386834b9 could not be found. Oct 17 13:43:26.319883 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:26.319883 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:26.319883 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:26.319883 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:26.319883 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:26.319883 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:26.319883 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:43:26.319883 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:43:26.319883 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c6b4ed2-b111-41b0-9679-b66d386834b9 could not be found. Oct 17 13:43:26.319883 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:26.321479 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-929c4477-14a4-4faa-9881-e516d06fc8c1 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Returning 404 to user: Instance 9c6b4ed2-b111-41b0-9679-b66d386834b9 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:43:26.322488 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-929c4477-14a4-4faa-9881-e516d06fc8c1 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "DELETE /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9" status: 404 len: 111 microversion: 2.1 time: 0.056973 Oct 17 13:43:26.323262 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1190/2357] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:43:26 2022] DELETE /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:43:26.328322 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ea7f4fc0-0691-428a-8e63-ebfee63ffa49 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:26.329139 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ea7f4fc0-0691-428a-8e63-ebfee63ffa49 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] [instance: 87114af9-1214-4182-8f68-756a1a5dfc7a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:26.337139 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ea7f4fc0-0691-428a-8e63-ebfee63ffa49 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:26.337789 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ea7f4fc0-0691-428a-8e63-ebfee63ffa49 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:26.338364 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ea7f4fc0-0691-428a-8e63-ebfee63ffa49 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:26.339277 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ea7f4fc0-0691-428a-8e63-ebfee63ffa49 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:26.340255 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ea7f4fc0-0691-428a-8e63-ebfee63ffa49 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:26.340828 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ea7f4fc0-0691-428a-8e63-ebfee63ffa49 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:26.341155 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-42077f43-8f4a-4b30-8269-3e0fed499550 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76e77dade0e441a79c2c4d77993172ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3134826eb154c71bb67718c36ff38cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:26.345674 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:43:26.358803 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-42077f43-8f4a-4b30-8269-3e0fed499550 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] 10.222.0.79 "GET /compute/v2.1/servers/4f806fc0-61ef-4c0b-b6af-8f987148f5ca" status: 200 len: 1307 microversion: 2.1 time: 0.316072 Oct 17 13:43:26.360866 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1168/2358] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:26 2022] GET /compute/v2.1/servers/4f806fc0-61ef-4c0b-b6af-8f987148f5ca => generated 1307 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:26.371579 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-be569de7-ecf3-4e6a-8fa2-2acf648b5c19 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:26.378871 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-be569de7-ecf3-4e6a-8fa2-2acf648b5c19 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] [instance: 58a43093-7550-452c-bd8a-fab84203fca3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:26.391942 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-be569de7-ecf3-4e6a-8fa2-2acf648b5c19 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:26.392623 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-be569de7-ecf3-4e6a-8fa2-2acf648b5c19 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:26.393180 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-be569de7-ecf3-4e6a-8fa2-2acf648b5c19 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:26.394025 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-be569de7-ecf3-4e6a-8fa2-2acf648b5c19 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:26.397237 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-be569de7-ecf3-4e6a-8fa2-2acf648b5c19 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:26.397811 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-be569de7-ecf3-4e6a-8fa2-2acf648b5c19 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:26.675501 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ea7f4fc0-0691-428a-8e63-ebfee63ffa49 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1f69cda7724d9bb8a6beec6d4f973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87456dcb963449b2ac1c2d93da0a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:26.684484 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ea7f4fc0-0691-428a-8e63-ebfee63ffa49 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "GET /compute/v2.1/servers/87114af9-1214-4182-8f68-756a1a5dfc7a" status: 200 len: 1275 microversion: 2.1 time: 0.359961 Oct 17 13:43:26.696701 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1191/2359] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:26 2022] GET /compute/v2.1/servers/87114af9-1214-4182-8f68-756a1a5dfc7a => generated 1275 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:26.710544 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4df95575-45a2-4034-84b2-99b79f6a7de4 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:26.716651 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4df95575-45a2-4034-84b2-99b79f6a7de4 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] [instance: 9c6b4ed2-b111-41b0-9679-b66d386834b9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:26.730517 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4df95575-45a2-4034-84b2-99b79f6a7de4 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:26.731511 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4df95575-45a2-4034-84b2-99b79f6a7de4 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:26.732185 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4df95575-45a2-4034-84b2-99b79f6a7de4 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:26.733424 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4df95575-45a2-4034-84b2-99b79f6a7de4 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:26.736673 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4df95575-45a2-4034-84b2-99b79f6a7de4 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:26.737424 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4df95575-45a2-4034-84b2-99b79f6a7de4 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:26.772101 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-4df95575-45a2-4034-84b2-99b79f6a7de4 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] HTTP exception thrown: Instance 9c6b4ed2-b111-41b0-9679-b66d386834b9 could not be found. Oct 17 13:43:26.774990 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4df95575-45a2-4034-84b2-99b79f6a7de4 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Request method failure captured: Oct 17 13:43:26.774990 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9 HTTP/1.1 Oct 17 13:43:26.774990 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:43:26.774990 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:43:26.774990 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:43:26.774990 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:43:26.774990 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:43:26.774990 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:43:26.774990 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:43:26.774990 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:43:26.774990 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVszY_wclohBuNPK0P_3jbSFmXGILJiR0kut7HGY7vdojAtAlgLeOEyTvku-r4VQYKyuAyJM_KtqAXyFPanfsPpRz4_W6UcoeBgPABVSis4XYtKsP83QBvJQcsGPvp8Wx3GMX5AIKTAVb6IQUk7hxnikQ34nlW7VAbL3pwsly6HaYAc Oct 17 13:43:26.774990 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:43:26.774990 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:43:26.774990 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:43:26.774990 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:43:26.774990 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:43:26.774990 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:43:26.774990 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: a8fe03af82c34607bfe43a58b997704f Oct 17 13:43:26.774990 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1211509445 Oct 17 13:43:26.774990 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:43:26.774990 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:43:26.774990 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a8fe03af82c34607bfe43a58b997704f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a8fe03af82c34607bfe43a58b997704f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a8fe03af82c34607bfe43a58b997704f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a8fe03af82c34607bfe43a58b997704f", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:43:26.774990 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServerDiskConfigTestJSON-1211509445 Oct 17 13:43:26.774990 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: a8fe03af82c34607bfe43a58b997704f Oct 17 13:43:26.774990 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1211509445 Oct 17 13:43:26.774990 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServerDiskConfigTestJSON-1211509445-project Oct 17 13:43:26.774990 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:43:26.774990 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:43:26.774990 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 17a7b6856447415487c272498ca335db Oct 17 13:43:26.774990 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServerDiskConfigTestJSON-1211509445-project Oct 17 13:43:26.774990 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:43:26.774990 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 9c6b4ed2-b111-41b0-9679-b66d386834b9 could not be found. Oct 17 13:43:26.774990 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '9c6b4ed2-b111-41b0-9679-b66d386834b9'} Oct 17 13:43:26.774990 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:43:26.774990 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:26.774990 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:43:26.774990 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:43:26.774990 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:43:26.774990 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:43:26.774990 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:43:26.774990 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:43:26.774990 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:43:26.774990 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:43:26.774990 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c6b4ed2-b111-41b0-9679-b66d386834b9 could not be found. Oct 17 13:43:26.774990 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:26.774990 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:26.774990 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:26.774990 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:26.774990 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:26.774990 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:26.774990 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:43:26.774990 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:43:26.774990 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:43:26.774990 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:43:26.774990 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:43:26.774990 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:43:26.774990 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:43:26.774990 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:43:26.774990 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:43:26.774990 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:43:26.774990 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c6b4ed2-b111-41b0-9679-b66d386834b9 could not be found. Oct 17 13:43:26.774990 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:26.774990 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:26.774990 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:26.778845 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:26.778845 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:26.778845 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:26.778845 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:43:26.778845 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:43:26.778845 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c6b4ed2-b111-41b0-9679-b66d386834b9 could not be found. Oct 17 13:43:26.778845 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:26.789388 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4df95575-45a2-4034-84b2-99b79f6a7de4 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] Returning 404 to user: Instance 9c6b4ed2-b111-41b0-9679-b66d386834b9 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:43:26.790458 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4df95575-45a2-4034-84b2-99b79f6a7de4 tempest-ServerDiskConfigTestJSON-1211509445 tempest-ServerDiskConfigTestJSON-1211509445-project] 10.222.0.79 "GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9" status: 404 len: 111 microversion: 2.1 time: 0.087314 Oct 17 13:43:26.791588 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1192/2360] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:26 2022] GET /compute/v2.1/servers/9c6b4ed2-b111-41b0-9679-b66d386834b9 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:43:26.796709 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-01a28075-f3c9-44b1-85a0-660f85bbc4c5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:26.797444 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-01a28075-f3c9-44b1-85a0-660f85bbc4c5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: b1b0d02c-b32f-45cd-8732-99b1e3119ca6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:26.808199 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-01a28075-f3c9-44b1-85a0-660f85bbc4c5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:26.810806 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-01a28075-f3c9-44b1-85a0-660f85bbc4c5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:26.811422 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-01a28075-f3c9-44b1-85a0-660f85bbc4c5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:26.816193 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-01a28075-f3c9-44b1-85a0-660f85bbc4c5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:26.816980 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-01a28075-f3c9-44b1-85a0-660f85bbc4c5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:26.817634 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-01a28075-f3c9-44b1-85a0-660f85bbc4c5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:27.844473 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-be569de7-ecf3-4e6a-8fa2-2acf648b5c19 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185235bc4e3245fc8d92b7e4bff6cbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c0147c5fae4017810887843b0afaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:27.857217 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-be569de7-ecf3-4e6a-8fa2-2acf648b5c19 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "GET /compute/v2.1/servers/58a43093-7550-452c-bd8a-fab84203fca3" status: 200 len: 1646 microversion: 2.1 time: 1.489404 Oct 17 13:43:27.857845 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1169/2361] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:26 2022] GET /compute/v2.1/servers/58a43093-7550-452c-bd8a-fab84203fca3 => generated 1646 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:27.874897 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b3f248f7-3ae9-4bcb-835a-55ab729872ba tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:27.875619 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b3f248f7-3ae9-4bcb-835a-55ab729872ba tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] [instance: 4f806fc0-61ef-4c0b-b6af-8f987148f5ca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:27.890611 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b3f248f7-3ae9-4bcb-835a-55ab729872ba tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:27.891112 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b3f248f7-3ae9-4bcb-835a-55ab729872ba tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:27.891604 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b3f248f7-3ae9-4bcb-835a-55ab729872ba tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:27.892322 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b3f248f7-3ae9-4bcb-835a-55ab729872ba tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:27.892775 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b3f248f7-3ae9-4bcb-835a-55ab729872ba tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:27.893395 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b3f248f7-3ae9-4bcb-835a-55ab729872ba tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:27.933233 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b3f248f7-3ae9-4bcb-835a-55ab729872ba tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:27.934034 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b3f248f7-3ae9-4bcb-835a-55ab729872ba tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:27.934815 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b3f248f7-3ae9-4bcb-835a-55ab729872ba tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:27.935462 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-b3f248f7-3ae9-4bcb-835a-55ab729872ba tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lazy-loading 'fault' on Instance uuid 4f806fc0-61ef-4c0b-b6af-8f987148f5ca {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:43:28.043470 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b3f248f7-3ae9-4bcb-835a-55ab729872ba tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76e77dade0e441a79c2c4d77993172ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3134826eb154c71bb67718c36ff38cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:28.067835 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b3f248f7-3ae9-4bcb-835a-55ab729872ba tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] 10.222.0.79 "GET /compute/v2.1/servers/4f806fc0-61ef-4c0b-b6af-8f987148f5ca" status: 200 len: 1312 microversion: 2.1 time: 0.208858 Oct 17 13:43:28.068641 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1170/2362] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:27 2022] GET /compute/v2.1/servers/4f806fc0-61ef-4c0b-b6af-8f987148f5ca => generated 1312 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:28.095297 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9254e5d3-7768-4727-a1ee-387476a8c07c tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:28.098423 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9254e5d3-7768-4727-a1ee-387476a8c07c tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] [instance: 87114af9-1214-4182-8f68-756a1a5dfc7a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:28.111258 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9254e5d3-7768-4727-a1ee-387476a8c07c tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:28.111929 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9254e5d3-7768-4727-a1ee-387476a8c07c tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:28.112670 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9254e5d3-7768-4727-a1ee-387476a8c07c tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:28.113601 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9254e5d3-7768-4727-a1ee-387476a8c07c tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:28.115385 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9254e5d3-7768-4727-a1ee-387476a8c07c tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:28.116032 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9254e5d3-7768-4727-a1ee-387476a8c07c tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:28.188612 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-01a28075-f3c9-44b1-85a0-660f85bbc4c5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:28.207868 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-01a28075-f3c9-44b1-85a0-660f85bbc4c5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:28.212416 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-01a28075-f3c9-44b1-85a0-660f85bbc4c5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:28.216410 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-01a28075-f3c9-44b1-85a0-660f85bbc4c5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6" status: 200 len: 1281 microversion: 2.25 time: 1.423552 Oct 17 13:43:28.220155 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1193/2363] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:26 2022] GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6 => generated 1281 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:43:28.361835 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9254e5d3-7768-4727-a1ee-387476a8c07c tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1f69cda7724d9bb8a6beec6d4f973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87456dcb963449b2ac1c2d93da0a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:28.376165 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9254e5d3-7768-4727-a1ee-387476a8c07c tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "GET /compute/v2.1/servers/87114af9-1214-4182-8f68-756a1a5dfc7a" status: 200 len: 1275 microversion: 2.1 time: 0.288050 Oct 17 13:43:28.377494 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1171/2364] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:28 2022] GET /compute/v2.1/servers/87114af9-1214-4182-8f68-756a1a5dfc7a => generated 1275 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:28.843812 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-add632c7-5c88-42cc-bf4f-506821afc718 req-e435f488-641e-46e7-9992-7b77c4d0f8b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2184ae8f-022d-4de9-8d0f-0c2d546c9d6f", "tag": "39e1f2c4-d66a-48e8-b02b-3e21dd1312ae"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:28.865519 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-add632c7-5c88-42cc-bf4f-506821afc718 req-e435f488-641e-46e7-9992-7b77c4d0f8b5 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:28.865901 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-add632c7-5c88-42cc-bf4f-506821afc718 req-e435f488-641e-46e7-9992-7b77c4d0f8b5 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:28.866488 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-add632c7-5c88-42cc-bf4f-506821afc718 req-e435f488-641e-46e7-9992-7b77c4d0f8b5 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:28.886180 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c4dd3d73-318e-4f88-a43f-d79b699c0cee tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:28.887512 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c4dd3d73-318e-4f88-a43f-d79b699c0cee tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] [instance: 58a43093-7550-452c-bd8a-fab84203fca3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:28.890959 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-add632c7-5c88-42cc-bf4f-506821afc718 req-e435f488-641e-46e7-9992-7b77c4d0f8b5 service nova] Creating event network-changed:39e1f2c4-d66a-48e8-b02b-3e21dd1312ae for instance 2184ae8f-022d-4de9-8d0f-0c2d546c9d6f on n-h1-854247-14 Oct 17 13:43:28.898166 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c4dd3d73-318e-4f88-a43f-d79b699c0cee tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:28.898925 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c4dd3d73-318e-4f88-a43f-d79b699c0cee tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:28.899601 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c4dd3d73-318e-4f88-a43f-d79b699c0cee tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:28.901117 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-add632c7-5c88-42cc-bf4f-506821afc718 req-e435f488-641e-46e7-9992-7b77c4d0f8b5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060840 Oct 17 13:43:28.901630 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c4dd3d73-318e-4f88-a43f-d79b699c0cee tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:28.902378 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c4dd3d73-318e-4f88-a43f-d79b699c0cee tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:28.903349 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c4dd3d73-318e-4f88-a43f-d79b699c0cee tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:28.903712 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1194/2365] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:43:29.110251 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6d58031e-aa65-4094-992d-8ecc0eacbb3e tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:29.111262 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6d58031e-aa65-4094-992d-8ecc0eacbb3e tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] [instance: 4f806fc0-61ef-4c0b-b6af-8f987148f5ca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:29.118450 n-d-854247-14 devstack@n-api.service[127016]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 13:43:29.118647 n-d-854247-14 devstack@n-api.service[127016]: Mon Oct 17 13:43:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4f806fc0-61ef-4c0b-b6af-8f987148f5ca (ip 10.222.0.79) !!! Oct 17 13:43:29.122134 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6d58031e-aa65-4094-992d-8ecc0eacbb3e tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:29.122988 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6d58031e-aa65-4094-992d-8ecc0eacbb3e tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:29.123680 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6d58031e-aa65-4094-992d-8ecc0eacbb3e tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:29.124631 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6d58031e-aa65-4094-992d-8ecc0eacbb3e tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:29.125370 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6d58031e-aa65-4094-992d-8ecc0eacbb3e tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:29.126025 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6d58031e-aa65-4094-992d-8ecc0eacbb3e tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:29.168861 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-6d58031e-aa65-4094-992d-8ecc0eacbb3e tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] HTTP exception thrown: Instance 4f806fc0-61ef-4c0b-b6af-8f987148f5ca could not be found. Oct 17 13:43:29.170986 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6d58031e-aa65-4094-992d-8ecc0eacbb3e tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Request method failure captured: Oct 17 13:43:29.170986 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/4f806fc0-61ef-4c0b-b6af-8f987148f5ca HTTP/1.1 Oct 17 13:43:29.170986 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:43:29.170986 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:43:29.170986 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:43:29.170986 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:43:29.170986 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:43:29.170986 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:43:29.170986 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:43:29.170986 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:43:29.170986 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVvK8_wS2nHHfPMnF_kVROupm1B93XXH6CadR5d5brqs58CvLnZFzMuJDXcSMS9acuIKGit3vfLCjgBXuz95lVpGzialkCnGpS0TXGYpYfOPgoVNPOFLEPk97806bk70-jYPzMgdI3WH1lumwYpNW_ZGfj2y4WYuyT2A7RLdwYxI3aQ Oct 17 13:43:29.170986 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:43:29.170986 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:43:29.170986 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:43:29.170986 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:43:29.170986 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:43:29.170986 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:43:29.170986 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: d3134826eb154c71bb67718c36ff38cd Oct 17 13:43:29.170986 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ListServersNegativeTestJSON-1442205123 Oct 17 13:43:29.170986 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:43:29.170986 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:43:29.170986 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d3134826eb154c71bb67718c36ff38cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d3134826eb154c71bb67718c36ff38cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d3134826eb154c71bb67718c36ff38cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d3134826eb154c71bb67718c36ff38cd", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:43:29.170986 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ListServersNegativeTestJSON-1442205123 Oct 17 13:43:29.170986 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: d3134826eb154c71bb67718c36ff38cd Oct 17 13:43:29.170986 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1442205123 Oct 17 13:43:29.170986 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ListServersNegativeTestJSON-1442205123-project Oct 17 13:43:29.170986 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:43:29.170986 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:43:29.170986 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 76e77dade0e441a79c2c4d77993172ff Oct 17 13:43:29.170986 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ListServersNegativeTestJSON-1442205123-project Oct 17 13:43:29.170986 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:43:29.170986 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 4f806fc0-61ef-4c0b-b6af-8f987148f5ca could not be found. Oct 17 13:43:29.170986 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '4f806fc0-61ef-4c0b-b6af-8f987148f5ca'} Oct 17 13:43:29.170986 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:43:29.170986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:29.170986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:43:29.170986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:43:29.170986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:43:29.170986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:43:29.170986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:43:29.170986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:43:29.170986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:43:29.170986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:43:29.170986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f806fc0-61ef-4c0b-b6af-8f987148f5ca could not be found. Oct 17 13:43:29.170986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:29.170986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:29.170986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:29.170986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:29.170986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:29.170986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:29.170986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:43:29.170986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:43:29.170986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:43:29.170986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:43:29.170986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:43:29.170986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:43:29.170986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:43:29.170986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:43:29.170986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:43:29.170986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:43:29.170986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f806fc0-61ef-4c0b-b6af-8f987148f5ca could not be found. Oct 17 13:43:29.170986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:29.170986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:29.176775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:29.176775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:29.176775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:29.176775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:29.176775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:43:29.176775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:43:29.176775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f806fc0-61ef-4c0b-b6af-8f987148f5ca could not be found. Oct 17 13:43:29.176775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:29.184140 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6d58031e-aa65-4094-992d-8ecc0eacbb3e tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Returning 404 to user: Instance 4f806fc0-61ef-4c0b-b6af-8f987148f5ca could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:43:29.185519 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6d58031e-aa65-4094-992d-8ecc0eacbb3e tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] 10.222.0.79 "GET /compute/v2.1/servers/4f806fc0-61ef-4c0b-b6af-8f987148f5ca" status: 404 len: 111 microversion: 2.1 time: 0.089701 Oct 17 13:43:29.186326 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1195/2366] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:29 2022] GET /compute/v2.1/servers/4f806fc0-61ef-4c0b-b6af-8f987148f5ca => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:43:29.201324 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-34bba71b-494f-4120-a37a-630b93aa8afc tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:29.212910 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-34bba71b-494f-4120-a37a-630b93aa8afc tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '76e77dade0e441a79c2c4d77993172ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3134826eb154c71bb67718c36ff38cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:29.213898 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-34bba71b-494f-4120-a37a-630b93aa8afc tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'd3134826eb154c71bb67718c36ff38cd'} {{(pid=127016) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:43:29.223330 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-34bba71b-494f-4120-a37a-630b93aa8afc tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:29.224036 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-34bba71b-494f-4120-a37a-630b93aa8afc tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:29.224634 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-34bba71b-494f-4120-a37a-630b93aa8afc tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:29.225603 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-34bba71b-494f-4120-a37a-630b93aa8afc tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:29.226216 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-34bba71b-494f-4120-a37a-630b93aa8afc tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:29.226830 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-34bba71b-494f-4120-a37a-630b93aa8afc tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:29.419643 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-34bba71b-494f-4120-a37a-630b93aa8afc tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] 10.222.0.79 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.226037 Oct 17 13:43:29.429400 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1196/2367] 10.222.0.79 () {58 vars in 1230 bytes} [Mon Oct 17 13:43:29 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:43:29.435232 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3d3a7ea9-5655-44bd-99a3-f6049ba847cc tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:29.436285 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3d3a7ea9-5655-44bd-99a3-f6049ba847cc tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: b1b0d02c-b32f-45cd-8732-99b1e3119ca6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:29.444434 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3d3a7ea9-5655-44bd-99a3-f6049ba847cc tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:29.445087 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3d3a7ea9-5655-44bd-99a3-f6049ba847cc tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:29.445710 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3d3a7ea9-5655-44bd-99a3-f6049ba847cc tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:29.446962 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3d3a7ea9-5655-44bd-99a3-f6049ba847cc tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:29.447612 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3d3a7ea9-5655-44bd-99a3-f6049ba847cc tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:29.448635 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3d3a7ea9-5655-44bd-99a3-f6049ba847cc tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:30.482495 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c4dd3d73-318e-4f88-a43f-d79b699c0cee tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '185235bc4e3245fc8d92b7e4bff6cbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c0147c5fae4017810887843b0afaa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:30.499985 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c4dd3d73-318e-4f88-a43f-d79b699c0cee tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "GET /compute/v2.1/servers/58a43093-7550-452c-bd8a-fab84203fca3" status: 200 len: 1646 microversion: 2.1 time: 1.616118 Oct 17 13:43:30.502295 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1172/2368] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:28 2022] GET /compute/v2.1/servers/58a43093-7550-452c-bd8a-fab84203fca3 => generated 1646 bytes in 1624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:43:30.523134 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-70764d9f-3ca5-4cff-919f-47d9e6e6d820 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:30.540606 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-70764d9f-3ca5-4cff-919f-47d9e6e6d820 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] [instance: 87114af9-1214-4182-8f68-756a1a5dfc7a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:30.547858 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70764d9f-3ca5-4cff-919f-47d9e6e6d820 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:30.548595 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70764d9f-3ca5-4cff-919f-47d9e6e6d820 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:30.549179 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70764d9f-3ca5-4cff-919f-47d9e6e6d820 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:30.551444 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70764d9f-3ca5-4cff-919f-47d9e6e6d820 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:30.552085 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70764d9f-3ca5-4cff-919f-47d9e6e6d820 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:30.558347 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3d3a7ea9-5655-44bd-99a3-f6049ba847cc tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:30.559710 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70764d9f-3ca5-4cff-919f-47d9e6e6d820 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:30.588855 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3d3a7ea9-5655-44bd-99a3-f6049ba847cc tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:30.592288 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3d3a7ea9-5655-44bd-99a3-f6049ba847cc tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:30.597084 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3d3a7ea9-5655-44bd-99a3-f6049ba847cc tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6" status: 200 len: 1281 microversion: 2.25 time: 1.170100 Oct 17 13:43:30.598963 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1197/2369] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:29 2022] GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6 => generated 1281 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:43:30.611689 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cf04d2f7-ab79-413f-b1e6-46db9da63fba tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cf04d2f7-ab79-413f-b1e6-46db9da63fba tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Request method failure captured: Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVvK8_wS2nHHfPMnF_kVROupm1B93XXH6CadR5d5brqs58CvLnZFzMuJDXcSMS9acuIKGit3vfLCjgBXuz95lVpGzialkCnGpS0TXGYpYfOPgoVNPOFLEPk97806bk70-jYPzMgdI3WH1lumwYpNW_ZGfj2y4WYuyT2A7RLdwYxI3aQ Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: d3134826eb154c71bb67718c36ff38cd Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ListServersNegativeTestJSON-1442205123 Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d3134826eb154c71bb67718c36ff38cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d3134826eb154c71bb67718c36ff38cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d3134826eb154c71bb67718c36ff38cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d3134826eb154c71bb67718c36ff38cd", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ListServersNegativeTestJSON-1442205123 Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: d3134826eb154c71bb67718c36ff38cd Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1442205123 Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ListServersNegativeTestJSON-1442205123-project Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 76e77dade0e441a79c2c4d77993172ff Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ListServersNegativeTestJSON-1442205123-project Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: action_args: {} Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 17 13:43:30.622486 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:43:30.626769 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:43:30.626769 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:43:30.626769 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:43:30.626769 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 17 13:43:30.626769 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:30.626769 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:30.626769 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:30.626769 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:30.626769 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:30.626769 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:30.626769 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:43:30.626769 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:43:30.626769 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 17 13:43:30.626769 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:30.628612 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cf04d2f7-ab79-413f-b1e6-46db9da63fba tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:43:30.631045 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cf04d2f7-ab79-413f-b1e6-46db9da63fba tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] 10.222.0.79 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.027213 Oct 17 13:43:30.634843 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1198/2370] 10.222.0.79 () {58 vars in 1182 bytes} [Mon Oct 17 13:43:30 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:43:30.666577 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c067612c-d9c2-41c2-b60d-31b923649207 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:30.680916 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c067612c-d9c2-41c2-b60d-31b923649207 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '76e77dade0e441a79c2c4d77993172ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3134826eb154c71bb67718c36ff38cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:30.688188 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c067612c-d9c2-41c2-b60d-31b923649207 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Searching by: {'deleted': False, 'project_id': 'd3134826eb154c71bb67718c36ff38cd'} {{(pid=127016) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:43:30.704103 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c067612c-d9c2-41c2-b60d-31b923649207 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:30.705228 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c067612c-d9c2-41c2-b60d-31b923649207 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:30.706369 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c067612c-d9c2-41c2-b60d-31b923649207 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:30.707439 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c067612c-d9c2-41c2-b60d-31b923649207 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:30.713256 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c067612c-d9c2-41c2-b60d-31b923649207 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:30.714114 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c067612c-d9c2-41c2-b60d-31b923649207 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:30.774691 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.multi_cell_list [None req-c067612c-d9c2-41c2-b60d-31b923649207 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127016) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:43:30.833865 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c067612c-d9c2-41c2-b60d-31b923649207 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] 10.222.0.79 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.196262 Oct 17 13:43:30.836375 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1199/2371] 10.222.0.79 () {58 vars in 1125 bytes} [Mon Oct 17 13:43:30 2022] GET /compute/v2.1/servers => generated 681 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:43:30.866559 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ce6da68e-d34c-4339-b32b-f342516f1fd7 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:30.890207 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ce6da68e-d34c-4339-b32b-f342516f1fd7 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '76e77dade0e441a79c2c4d77993172ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3134826eb154c71bb67718c36ff38cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:30.890678 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.compute.servers [None req-ce6da68e-d34c-4339-b32b-f342516f1fd7 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Removing options 'limit' from query {{(pid=127016) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 17 13:43:30.891400 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ce6da68e-d34c-4339-b32b-f342516f1fd7 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Searching by: {'deleted': False, 'project_id': 'd3134826eb154c71bb67718c36ff38cd'} {{(pid=127016) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:43:30.913079 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ce6da68e-d34c-4339-b32b-f342516f1fd7 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:30.913814 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ce6da68e-d34c-4339-b32b-f342516f1fd7 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:30.914401 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ce6da68e-d34c-4339-b32b-f342516f1fd7 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:30.919091 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ce6da68e-d34c-4339-b32b-f342516f1fd7 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:30.923044 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ce6da68e-d34c-4339-b32b-f342516f1fd7 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:30.926764 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ce6da68e-d34c-4339-b32b-f342516f1fd7 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:31.011129 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:43:31.021171 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.multi_cell_list [None req-ce6da68e-d34c-4339-b32b-f342516f1fd7 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=127016) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:43:31.059947 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-70764d9f-3ca5-4cff-919f-47d9e6e6d820 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1f69cda7724d9bb8a6beec6d4f973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87456dcb963449b2ac1c2d93da0a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:31.082010 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-70764d9f-3ca5-4cff-919f-47d9e6e6d820 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "GET /compute/v2.1/servers/87114af9-1214-4182-8f68-756a1a5dfc7a" status: 200 len: 1317 microversion: 2.1 time: 0.567537 Oct 17 13:43:31.088947 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1173/2372] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:30 2022] GET /compute/v2.1/servers/87114af9-1214-4182-8f68-756a1a5dfc7a => generated 1317 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:31.114646 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-e07db8f1-0d9a-4ce3-98cc-1c38fba5a73e req-7f9106c5-0986-43ca-a874-a9caa0b53049 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58a43093-7550-452c-bd8a-fab84203fca3", "name": "network-vif-deleted", "tag": "ef5798b1-64dc-43c6-93cc-2aebea1de96a"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:31.128671 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ce6da68e-d34c-4339-b32b-f342516f1fd7 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] 10.222.0.79 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.277062 Oct 17 13:43:31.132465 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1200/2373] 10.222.0.79 () {58 vars in 1144 bytes} [Mon Oct 17 13:43:30 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:43:31.145853 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-46e4617f-c03a-4569-9bd7-9bcdb9f7233a tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-46e4617f-c03a-4569-9bd7-9bcdb9f7233a tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Request method failure captured: Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVvK8_wS2nHHfPMnF_kVROupm1B93XXH6CadR5d5brqs58CvLnZFzMuJDXcSMS9acuIKGit3vfLCjgBXuz95lVpGzialkCnGpS0TXGYpYfOPgoVNPOFLEPk97806bk70-jYPzMgdI3WH1lumwYpNW_ZGfj2y4WYuyT2A7RLdwYxI3aQ Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: d3134826eb154c71bb67718c36ff38cd Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ListServersNegativeTestJSON-1442205123 Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d3134826eb154c71bb67718c36ff38cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d3134826eb154c71bb67718c36ff38cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d3134826eb154c71bb67718c36ff38cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d3134826eb154c71bb67718c36ff38cd", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ListServersNegativeTestJSON-1442205123 Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: d3134826eb154c71bb67718c36ff38cd Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1442205123 Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ListServersNegativeTestJSON-1442205123-project Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 76e77dade0e441a79c2c4d77993172ff Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ListServersNegativeTestJSON-1442205123-project Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: action_args: {} Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi '-1' Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 17 13:43:31.150440 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 17 13:43:31.154380 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:43:31.154380 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:43:31.154380 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:43:31.154380 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:43:31.154380 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 17 13:43:31.154380 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:31.154380 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:31.154380 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:31.154380 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:31.154380 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:31.154380 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:31.154380 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:43:31.154380 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:43:31.154380 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 17 13:43:31.154380 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:31.154380 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-46e4617f-c03a-4569-9bd7-9bcdb9f7233a tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:43:31.154380 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-46e4617f-c03a-4569-9bd7-9bcdb9f7233a tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] 10.222.0.79 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.010547 Oct 17 13:43:31.161855 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1201/2374] 10.222.0.79 () {58 vars in 1142 bytes} [Mon Oct 17 13:43:31 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 17 13:43:31.165583 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-86debc3a-110a-42f5-adb5-d9e60f1e28a6 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:31.166807 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-e07db8f1-0d9a-4ce3-98cc-1c38fba5a73e req-7f9106c5-0986-43ca-a874-a9caa0b53049 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:31.167587 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-e07db8f1-0d9a-4ce3-98cc-1c38fba5a73e req-7f9106c5-0986-43ca-a874-a9caa0b53049 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:31.168249 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-e07db8f1-0d9a-4ce3-98cc-1c38fba5a73e req-7f9106c5-0986-43ca-a874-a9caa0b53049 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-86debc3a-110a-42f5-adb5-d9e60f1e28a6 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Request method failure captured: Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVvK8_wS2nHHfPMnF_kVROupm1B93XXH6CadR5d5brqs58CvLnZFzMuJDXcSMS9acuIKGit3vfLCjgBXuz95lVpGzialkCnGpS0TXGYpYfOPgoVNPOFLEPk97806bk70-jYPzMgdI3WH1lumwYpNW_ZGfj2y4WYuyT2A7RLdwYxI3aQ Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: d3134826eb154c71bb67718c36ff38cd Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ListServersNegativeTestJSON-1442205123 Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d3134826eb154c71bb67718c36ff38cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d3134826eb154c71bb67718c36ff38cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d3134826eb154c71bb67718c36ff38cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d3134826eb154c71bb67718c36ff38cd", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ListServersNegativeTestJSON-1442205123 Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: d3134826eb154c71bb67718c36ff38cd Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1442205123 Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ListServersNegativeTestJSON-1442205123-project Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 76e77dade0e441a79c2c4d77993172ff Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ListServersNegativeTestJSON-1442205123-project Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: action_args: {} Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi 'testing' Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 17 13:43:31.177224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 17 13:43:31.181267 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:43:31.181267 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:43:31.181267 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:43:31.181267 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:43:31.181267 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 17 13:43:31.181267 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:31.181267 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:31.181267 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:31.181267 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:31.181267 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:31.181267 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:31.181267 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:43:31.181267 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:43:31.181267 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 17 13:43:31.181267 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:31.181267 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-86debc3a-110a-42f5-adb5-d9e60f1e28a6 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:43:31.181267 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-86debc3a-110a-42f5-adb5-d9e60f1e28a6 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] 10.222.0.79 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.019169 Oct 17 13:43:31.181267 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1202/2375] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Oct 17 13:43:31 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:43:31.192723 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-e07db8f1-0d9a-4ce3-98cc-1c38fba5a73e req-7f9106c5-0986-43ca-a874-a9caa0b53049 service nova] Creating event network-vif-deleted:ef5798b1-64dc-43c6-93cc-2aebea1de96a for instance 58a43093-7550-452c-bd8a-fab84203fca3 on n-h2-854247-14 Oct 17 13:43:31.203453 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-745ca296-9aec-4ec4-913b-ba2a0fbf400e tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:31.206366 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-e07db8f1-0d9a-4ce3-98cc-1c38fba5a73e req-7f9106c5-0986-43ca-a874-a9caa0b53049 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104392 Oct 17 13:43:31.211266 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1174/2376] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:43:31.211825 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-745ca296-9aec-4ec4-913b-ba2a0fbf400e tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '76e77dade0e441a79c2c4d77993172ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3134826eb154c71bb67718c36ff38cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:31.212726 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-745ca296-9aec-4ec4-913b-ba2a0fbf400e tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'd3134826eb154c71bb67718c36ff38cd'} {{(pid=127016) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:43:31.220285 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.compute.servers [None req-745ca296-9aec-4ec4-913b-ba2a0fbf400e tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Flavor 'non_existing_flavor' could not be found {{(pid=127016) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 17 13:43:31.221760 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-745ca296-9aec-4ec4-913b-ba2a0fbf400e tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] 10.222.0.79 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.037112 Oct 17 13:43:31.222888 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1203/2377] 10.222.0.79 () {58 vars in 1178 bytes} [Mon Oct 17 13:43:31 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 17 13:43:31.236872 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e295f278-4e48-4d13-a69d-0f3c5afb2b47 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:31.243231 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e295f278-4e48-4d13-a69d-0f3c5afb2b47 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '76e77dade0e441a79c2c4d77993172ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3134826eb154c71bb67718c36ff38cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:31.252226 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e295f278-4e48-4d13-a69d-0f3c5afb2b47 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'd3134826eb154c71bb67718c36ff38cd'} {{(pid=127017) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:43:31.261179 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e295f278-4e48-4d13-a69d-0f3c5afb2b47 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:31.264020 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e295f278-4e48-4d13-a69d-0f3c5afb2b47 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:31.265326 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e295f278-4e48-4d13-a69d-0f3c5afb2b47 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:31.266324 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e295f278-4e48-4d13-a69d-0f3c5afb2b47 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:31.268651 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e295f278-4e48-4d13-a69d-0f3c5afb2b47 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:31.269371 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e295f278-4e48-4d13-a69d-0f3c5afb2b47 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:31.469563 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e295f278-4e48-4d13-a69d-0f3c5afb2b47 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] 10.222.0.79 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.237938 Oct 17 13:43:31.472669 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1175/2378] 10.222.0.79 () {58 vars in 1174 bytes} [Mon Oct 17 13:43:31 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:43:31.485920 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3e3215e2-bedc-46bf-8830-e17a2f36bbe4 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:31.493180 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3e3215e2-bedc-46bf-8830-e17a2f36bbe4 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '76e77dade0e441a79c2c4d77993172ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3134826eb154c71bb67718c36ff38cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:31.501254 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3e3215e2-bedc-46bf-8830-e17a2f36bbe4 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'd3134826eb154c71bb67718c36ff38cd'} {{(pid=127016) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:43:31.503523 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:43:31.518116 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3e3215e2-bedc-46bf-8830-e17a2f36bbe4 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:31.518870 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3e3215e2-bedc-46bf-8830-e17a2f36bbe4 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:31.520362 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3e3215e2-bedc-46bf-8830-e17a2f36bbe4 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:31.528913 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-443cc981-56b1-460a-acb7-3d088004190b tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:31.530427 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-443cc981-56b1-460a-acb7-3d088004190b tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] [instance: 58a43093-7550-452c-bd8a-fab84203fca3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:31.537507 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3e3215e2-bedc-46bf-8830-e17a2f36bbe4 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:31.541813 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3e3215e2-bedc-46bf-8830-e17a2f36bbe4 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:31.542660 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3e3215e2-bedc-46bf-8830-e17a2f36bbe4 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:31.547730 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-443cc981-56b1-460a-acb7-3d088004190b tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:31.548433 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-443cc981-56b1-460a-acb7-3d088004190b tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:31.551967 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-443cc981-56b1-460a-acb7-3d088004190b tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:31.553021 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-443cc981-56b1-460a-acb7-3d088004190b tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:31.553637 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-443cc981-56b1-460a-acb7-3d088004190b tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:31.556482 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-443cc981-56b1-460a-acb7-3d088004190b tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:31.601873 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-443cc981-56b1-460a-acb7-3d088004190b tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] HTTP exception thrown: Instance 58a43093-7550-452c-bd8a-fab84203fca3 could not be found. Oct 17 13:43:31.607441 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-443cc981-56b1-460a-acb7-3d088004190b tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Request method failure captured: Oct 17 13:43:31.607441 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/58a43093-7550-452c-bd8a-fab84203fca3 HTTP/1.1 Oct 17 13:43:31.607441 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:43:31.607441 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:43:31.607441 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:43:31.607441 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:43:31.607441 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:43:31.607441 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:43:31.607441 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:43:31.607441 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:43:31.607441 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVtyFGyYtLVdwIq4ccz7RkXRa7NtlbhzSHc2HUbc2jnmH2QeepBwxbKf8toXm_ooPcHi9ET43LtT1AqXtRk9n6taXXPkcxvI9DAvMm-WduwoIrQJqrIBPqw0m6vAgqbSuo42q0EeC3f0tZCzBhE1QaAtaHcB-dTJTCp89NqtuNhDPjU Oct 17 13:43:31.607441 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:43:31.607441 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:43:31.607441 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:43:31.607441 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:43:31.607441 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:43:31.607441 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:43:31.607441 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 50c0147c5fae4017810887843b0afaa0 Oct 17 13:43:31.607441 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-SecurityGroupsTestJSON-1412652742 Oct 17 13:43:31.607441 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:43:31.607441 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:43:31.607441 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/50c0147c5fae4017810887843b0afaa0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/50c0147c5fae4017810887843b0afaa0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/50c0147c5fae4017810887843b0afaa0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_50c0147c5fae4017810887843b0afaa0", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:43:31.607441 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-SecurityGroupsTestJSON-1412652742 Oct 17 13:43:31.607441 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 50c0147c5fae4017810887843b0afaa0 Oct 17 13:43:31.607441 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1412652742 Oct 17 13:43:31.607441 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-SecurityGroupsTestJSON-1412652742-project Oct 17 13:43:31.607441 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:43:31.607441 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:43:31.607441 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 185235bc4e3245fc8d92b7e4bff6cbbd Oct 17 13:43:31.607441 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-SecurityGroupsTestJSON-1412652742-project Oct 17 13:43:31.607441 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:43:31.607441 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 58a43093-7550-452c-bd8a-fab84203fca3 could not be found. Oct 17 13:43:31.607441 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '58a43093-7550-452c-bd8a-fab84203fca3'} Oct 17 13:43:31.607441 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:43:31.607441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:31.607441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:43:31.607441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:43:31.607441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:43:31.607441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:43:31.607441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:43:31.607441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:43:31.607441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:43:31.607441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:43:31.607441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58a43093-7550-452c-bd8a-fab84203fca3 could not be found. Oct 17 13:43:31.607441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:43:31.607441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:31.607441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:43:31.607441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:31.607441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:31.607441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:31.607441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:43:31.607441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:43:31.607441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:43:31.607441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:43:31.607441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:43:31.607441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:43:31.607441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:43:31.607441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:43:31.607441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:43:31.607441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:43:31.607441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58a43093-7550-452c-bd8a-fab84203fca3 could not be found. Oct 17 13:43:31.607441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:43:31.607441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:31.607441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:43:31.612220 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:31.612220 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:31.612220 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:31.612220 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:43:31.612220 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:43:31.612220 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58a43093-7550-452c-bd8a-fab84203fca3 could not be found. Oct 17 13:43:31.612220 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:43:31.614380 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-443cc981-56b1-460a-acb7-3d088004190b tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Returning 404 to user: Instance 58a43093-7550-452c-bd8a-fab84203fca3 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:43:31.615855 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-443cc981-56b1-460a-acb7-3d088004190b tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "GET /compute/v2.1/servers/58a43093-7550-452c-bd8a-fab84203fca3" status: 404 len: 111 microversion: 2.1 time: 0.092095 Oct 17 13:43:31.616978 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1176/2379] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:31 2022] GET /compute/v2.1/servers/58a43093-7550-452c-bd8a-fab84203fca3 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:43:31.645037 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d619c3b6-92ea-45df-89a8-310827fb6213 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Calling method '.version_select at 0x7f7cd55e6820>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:31.747942 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3e3215e2-bedc-46bf-8830-e17a2f36bbe4 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] 10.222.0.79 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.266691 Oct 17 13:43:31.749649 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1204/2380] 10.222.0.79 () {58 vars in 1184 bytes} [Mon Oct 17 13:43:31 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:43:31.758429 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-74a8f272-87c1-4a9d-b6b9-2ab29cea6c90 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:31.760238 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-74a8f272-87c1-4a9d-b6b9-2ab29cea6c90 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: b1b0d02c-b32f-45cd-8732-99b1e3119ca6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:31.771926 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-74a8f272-87c1-4a9d-b6b9-2ab29cea6c90 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:31.772748 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-74a8f272-87c1-4a9d-b6b9-2ab29cea6c90 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:31.773680 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-74a8f272-87c1-4a9d-b6b9-2ab29cea6c90 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:31.775404 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-74a8f272-87c1-4a9d-b6b9-2ab29cea6c90 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:31.776665 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-74a8f272-87c1-4a9d-b6b9-2ab29cea6c90 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:31.782447 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-74a8f272-87c1-4a9d-b6b9-2ab29cea6c90 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:32.204962 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-74a8f272-87c1-4a9d-b6b9-2ab29cea6c90 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:32.250617 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-74a8f272-87c1-4a9d-b6b9-2ab29cea6c90 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:32.250617 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-74a8f272-87c1-4a9d-b6b9-2ab29cea6c90 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:32.251195 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-74a8f272-87c1-4a9d-b6b9-2ab29cea6c90 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6" status: 200 len: 1281 microversion: 2.25 time: 0.500388 Oct 17 13:43:32.278369 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1205/2381] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:31 2022] GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6 => generated 1281 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:43:32.283392 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a580b236-14a1-4ea7-84c5-27e1ba2c2e73 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:32.288135 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a580b236-14a1-4ea7-84c5-27e1ba2c2e73 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '76e77dade0e441a79c2c4d77993172ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3134826eb154c71bb67718c36ff38cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:32.303871 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a580b236-14a1-4ea7-84c5-27e1ba2c2e73 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Searching by: {'deleted': False, 'project_id': 'd3134826eb154c71bb67718c36ff38cd'} {{(pid=127016) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:43:32.309809 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a580b236-14a1-4ea7-84c5-27e1ba2c2e73 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:32.310516 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a580b236-14a1-4ea7-84c5-27e1ba2c2e73 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:32.311312 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a580b236-14a1-4ea7-84c5-27e1ba2c2e73 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:32.312218 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a580b236-14a1-4ea7-84c5-27e1ba2c2e73 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:32.316251 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a580b236-14a1-4ea7-84c5-27e1ba2c2e73 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:32.316850 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a580b236-14a1-4ea7-84c5-27e1ba2c2e73 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:32.364689 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.multi_cell_list [None req-a580b236-14a1-4ea7-84c5-27e1ba2c2e73 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127016) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:43:32.393872 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d619c3b6-92ea-45df-89a8-310827fb6213 tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/d399e3f5-49d2-4305-8eef-68fdcd2f3967" status: 202 len: 0 microversion: 2.1 time: 0.771594 Oct 17 13:43:32.394819 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1177/2382] 10.222.0.79 () {58 vars in 1272 bytes} [Mon Oct 17 13:43:31 2022] DELETE /compute/v2.1/os-security-groups/d399e3f5-49d2-4305-8eef-68fdcd2f3967 => generated 0 bytes in 773 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:43:32.413937 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-67de6e5d-e119-4c54-b1cc-50dd98537918 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:32.414769 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-67de6e5d-e119-4c54-b1cc-50dd98537918 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] [instance: 87114af9-1214-4182-8f68-756a1a5dfc7a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:32.444814 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-67de6e5d-e119-4c54-b1cc-50dd98537918 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:32.448854 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a580b236-14a1-4ea7-84c5-27e1ba2c2e73 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76e77dade0e441a79c2c4d77993172ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3134826eb154c71bb67718c36ff38cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:32.451595 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-67de6e5d-e119-4c54-b1cc-50dd98537918 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:32.452241 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-67de6e5d-e119-4c54-b1cc-50dd98537918 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:32.454899 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-67de6e5d-e119-4c54-b1cc-50dd98537918 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:32.459297 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-67de6e5d-e119-4c54-b1cc-50dd98537918 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:32.459852 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-67de6e5d-e119-4c54-b1cc-50dd98537918 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:32.469771 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a580b236-14a1-4ea7-84c5-27e1ba2c2e73 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:32.470585 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a580b236-14a1-4ea7-84c5-27e1ba2c2e73 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:32.471274 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a580b236-14a1-4ea7-84c5-27e1ba2c2e73 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:32.926182 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a580b236-14a1-4ea7-84c5-27e1ba2c2e73 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] 10.222.0.79 "GET /compute/v2.1/servers/detail" status: 200 len: 3023 microversion: 2.1 time: 0.646584 Oct 17 13:43:32.926831 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1206/2383] 10.222.0.79 () {58 vars in 1146 bytes} [Mon Oct 17 13:43:32 2022] GET /compute/v2.1/servers/detail => generated 3023 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:32.932260 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-c4426e8d-ff3d-44b8-92f0-b977537f3d0d req-da73ff4a-4564-4f56-b609-303c09715f89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87114af9-1214-4182-8f68-756a1a5dfc7a", "tag": "cde412a7-8204-4c39-8f24-2d2a36d636f9"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:32.951788 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-67de6e5d-e119-4c54-b1cc-50dd98537918 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1f69cda7724d9bb8a6beec6d4f973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87456dcb963449b2ac1c2d93da0a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:32.963293 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-67de6e5d-e119-4c54-b1cc-50dd98537918 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "GET /compute/v2.1/servers/87114af9-1214-4182-8f68-756a1a5dfc7a" status: 200 len: 1317 microversion: 2.1 time: 0.567103 Oct 17 13:43:32.968704 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1178/2384] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:32 2022] GET /compute/v2.1/servers/87114af9-1214-4182-8f68-756a1a5dfc7a => generated 1317 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:32.973555 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-c4426e8d-ff3d-44b8-92f0-b977537f3d0d req-da73ff4a-4564-4f56-b609-303c09715f89 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:32.974061 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-c4426e8d-ff3d-44b8-92f0-b977537f3d0d req-da73ff4a-4564-4f56-b609-303c09715f89 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:32.974499 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-c4426e8d-ff3d-44b8-92f0-b977537f3d0d req-da73ff4a-4564-4f56-b609-303c09715f89 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:32.983804 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7b898717-0030-46e5-9c91-ad910237838e tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] Calling method '.version_select at 0x7f7cd55e6160>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:33.011015 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-c4426e8d-ff3d-44b8-92f0-b977537f3d0d req-da73ff4a-4564-4f56-b609-303c09715f89 service nova] Creating event network-changed:cde412a7-8204-4c39-8f24-2d2a36d636f9 for instance 87114af9-1214-4182-8f68-756a1a5dfc7a on n-h2-854247-14 Oct 17 13:43:33.026238 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-c4426e8d-ff3d-44b8-92f0-b977537f3d0d req-da73ff4a-4564-4f56-b609-303c09715f89 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095230 Oct 17 13:43:33.027056 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1207/2385] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:43:33.163397 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ced12542-ce49-40f2-b500-23a5f48872c8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1808696495", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "72be642c-f241-4ddb-80d7-b14a93aa7fc9"}]}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:33.384692 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=6 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:43:33.471735 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-ced12542-ce49-40f2-b500-23a5f48872c8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] validate_networks() for [('72be642c-f241-4ddb-80d7-b14a93aa7fc9', None, None, None, None, None)] {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:43:33.928414 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7b898717-0030-46e5-9c91-ad910237838e tempest-SecurityGroupsTestJSON-1412652742 tempest-SecurityGroupsTestJSON-1412652742-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/c8e9b6be-fa85-4b27-b1e7-4b0885388437" status: 202 len: 0 microversion: 2.1 time: 0.955758 Oct 17 13:43:33.929661 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1179/2386] 10.222.0.79 () {58 vars in 1272 bytes} [Mon Oct 17 13:43:32 2022] DELETE /compute/v2.1/os-security-groups/c8e9b6be-fa85-4b27-b1e7-4b0885388437 => generated 0 bytes in 960 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:43:33.967681 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a2092c60-b0c3-403a-bf58-7a6311aeb92c tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:33.972329 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a2092c60-b0c3-403a-bf58-7a6311aeb92c tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '76e77dade0e441a79c2c4d77993172ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3134826eb154c71bb67718c36ff38cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:33.973347 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a2092c60-b0c3-403a-bf58-7a6311aeb92c tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] 10.222.0.79 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.042225 Oct 17 13:43:33.973906 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1180/2387] 10.222.0.79 () {58 vars in 1178 bytes} [Mon Oct 17 13:43:33 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:43:33.995906 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1cc339dc-82de-4745-9765-bb5d24951d39 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:33.996799 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1cc339dc-82de-4745-9765-bb5d24951d39 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: b1b0d02c-b32f-45cd-8732-99b1e3119ca6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:34.013205 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1cc339dc-82de-4745-9765-bb5d24951d39 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:34.014853 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1cc339dc-82de-4745-9765-bb5d24951d39 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:34.017492 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1cc339dc-82de-4745-9765-bb5d24951d39 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:34.018533 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1cc339dc-82de-4745-9765-bb5d24951d39 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:34.019660 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1cc339dc-82de-4745-9765-bb5d24951d39 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:34.020186 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1cc339dc-82de-4745-9765-bb5d24951d39 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:34.828984 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1cc339dc-82de-4745-9765-bb5d24951d39 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:34.845315 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1cc339dc-82de-4745-9765-bb5d24951d39 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:34.849997 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1cc339dc-82de-4745-9765-bb5d24951d39 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:34.851721 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1cc339dc-82de-4745-9765-bb5d24951d39 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6" status: 200 len: 1281 microversion: 2.25 time: 0.876800 Oct 17 13:43:34.861536 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1181/2388] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:33 2022] GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6 => generated 1281 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:43:34.881941 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-67ace799-f153-4b05-a53c-87658fbb6c49 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:34.892480 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-67ace799-f153-4b05-a53c-87658fbb6c49 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '76e77dade0e441a79c2c4d77993172ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3134826eb154c71bb67718c36ff38cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:34.893595 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-67ace799-f153-4b05-a53c-87658fbb6c49 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Searching by: {'deleted': False, 'project_id': 'd3134826eb154c71bb67718c36ff38cd'} {{(pid=127017) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:43:34.902561 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-67ace799-f153-4b05-a53c-87658fbb6c49 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:34.911912 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-67ace799-f153-4b05-a53c-87658fbb6c49 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:34.912665 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-67ace799-f153-4b05-a53c-87658fbb6c49 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:34.922573 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-67ace799-f153-4b05-a53c-87658fbb6c49 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:34.923486 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-67ace799-f153-4b05-a53c-87658fbb6c49 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:34.924152 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-67ace799-f153-4b05-a53c-87658fbb6c49 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:34.976076 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.multi_cell_list [None req-67ace799-f153-4b05-a53c-87658fbb6c49 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127017) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:43:35.017396 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-67ace799-f153-4b05-a53c-87658fbb6c49 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] 10.222.0.79 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.154089 Oct 17 13:43:35.019637 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1182/2389] 10.222.0.79 () {58 vars in 1125 bytes} [Mon Oct 17 13:43:34 2022] GET /compute/v2.1/servers => generated 681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:43:35.026531 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ecbb8fc2-da5d-4843-aa38-7a78496d9aa3 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:35.028002 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ecbb8fc2-da5d-4843-aa38-7a78496d9aa3 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] [instance: 87114af9-1214-4182-8f68-756a1a5dfc7a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:35.038152 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ecbb8fc2-da5d-4843-aa38-7a78496d9aa3 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:35.039205 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ecbb8fc2-da5d-4843-aa38-7a78496d9aa3 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:35.040094 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ecbb8fc2-da5d-4843-aa38-7a78496d9aa3 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:35.041281 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ecbb8fc2-da5d-4843-aa38-7a78496d9aa3 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:35.041965 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ecbb8fc2-da5d-4843-aa38-7a78496d9aa3 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:35.042862 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ecbb8fc2-da5d-4843-aa38-7a78496d9aa3 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:35.685513 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-ced12542-ce49-40f2-b500-23a5f48872c8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:43:35.686746 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-ced12542-ce49-40f2-b500-23a5f48872c8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:43:35.686746 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-ced12542-ce49-40f2-b500-23a5f48872c8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:43:35.687203 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-ced12542-ce49-40f2-b500-23a5f48872c8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:43:35.687725 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-ced12542-ce49-40f2-b500-23a5f48872c8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:43:35.719127 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ced12542-ce49-40f2-b500-23a5f48872c8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:35.720780 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ced12542-ce49-40f2-b500-23a5f48872c8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:35.721321 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ced12542-ce49-40f2-b500-23a5f48872c8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:35.724467 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ced12542-ce49-40f2-b500-23a5f48872c8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:35.725173 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ced12542-ce49-40f2-b500-23a5f48872c8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:35.735587 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ced12542-ce49-40f2-b500-23a5f48872c8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:35.811068 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-ced12542-ce49-40f2-b500-23a5f48872c8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Getting quotas for project 59e65f6eb06d40d583b9f43c9af94c13. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:43:35.817932 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-ced12542-ce49-40f2-b500-23a5f48872c8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Getting quotas for user 443c44b0bd9e4c56a7fe0c1a53238545 and project 59e65f6eb06d40d583b9f43c9af94c13. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:43:35.848933 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ced12542-ce49-40f2-b500-23a5f48872c8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:43:35.851609 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ced12542-ce49-40f2-b500-23a5f48872c8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:43:35.953577 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ced12542-ce49-40f2-b500-23a5f48872c8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.908641 Oct 17 13:43:35.961832 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1208/2390] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:43:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2922 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:43:36.009959 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-91cb231f-05ad-4183-9a01-997a1d68f620 req-7f5f168e-08d5-46db-bec5-9dce6addf367 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1b0d02c-b32f-45cd-8732-99b1e3119ca6", "name": "network-vif-plugged", "status": "completed", "tag": "8f48924e-befb-4a03-97da-73a3c4e335e9"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:36.035692 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ecbb8fc2-da5d-4843-aa38-7a78496d9aa3 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1f69cda7724d9bb8a6beec6d4f973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87456dcb963449b2ac1c2d93da0a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:36.058810 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-91cb231f-05ad-4183-9a01-997a1d68f620 req-7f5f168e-08d5-46db-bec5-9dce6addf367 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:36.061603 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ecbb8fc2-da5d-4843-aa38-7a78496d9aa3 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "GET /compute/v2.1/servers/87114af9-1214-4182-8f68-756a1a5dfc7a" status: 200 len: 1317 microversion: 2.1 time: 1.040620 Oct 17 13:43:36.062402 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-91cb231f-05ad-4183-9a01-997a1d68f620 req-7f5f168e-08d5-46db-bec5-9dce6addf367 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:36.063023 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-91cb231f-05ad-4183-9a01-997a1d68f620 req-7f5f168e-08d5-46db-bec5-9dce6addf367 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:36.065272 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1183/2391] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:35 2022] GET /compute/v2.1/servers/87114af9-1214-4182-8f68-756a1a5dfc7a => generated 1317 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:36.098830 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7697dd84-ec53-458b-be8e-8e08d912faea tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:36.099643 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7697dd84-ec53-458b-be8e-8e08d912faea tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] [instance: 4f806fc0-61ef-4c0b-b6af-8f987148f5ca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:36.116473 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-91cb231f-05ad-4183-9a01-997a1d68f620 req-7f5f168e-08d5-46db-bec5-9dce6addf367 service nova] Creating event network-vif-plugged:8f48924e-befb-4a03-97da-73a3c4e335e9 for instance b1b0d02c-b32f-45cd-8732-99b1e3119ca6 on n-h1-854247-14 Oct 17 13:43:36.120979 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7697dd84-ec53-458b-be8e-8e08d912faea tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:36.125361 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7697dd84-ec53-458b-be8e-8e08d912faea tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:36.126089 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7697dd84-ec53-458b-be8e-8e08d912faea tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:36.127009 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7697dd84-ec53-458b-be8e-8e08d912faea tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:36.131390 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7697dd84-ec53-458b-be8e-8e08d912faea tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:36.132032 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7697dd84-ec53-458b-be8e-8e08d912faea tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:36.141340 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-91cb231f-05ad-4183-9a01-997a1d68f620 req-7f5f168e-08d5-46db-bec5-9dce6addf367 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169581 Oct 17 13:43:36.142559 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1209/2392] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:43:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:43:36.155296 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-54525b44-3069-4fef-8730-f9f72f20d432 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-32650365", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "cf539f31-5e6d-48a6-bad7-bc7d5b2ba203"}, {"uuid": "45a094b9-63b2-488e-a81f-f57161744e21"}, {"uuid": "cf539f31-5e6d-48a6-bad7-bc7d5b2ba203"}]}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:36.170698 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-7697dd84-ec53-458b-be8e-8e08d912faea tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] HTTP exception thrown: Instance 4f806fc0-61ef-4c0b-b6af-8f987148f5ca could not be found. Oct 17 13:43:36.185201 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7697dd84-ec53-458b-be8e-8e08d912faea tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Request method failure captured: Oct 17 13:43:36.185201 n-d-854247-14 devstack@n-api.service[127017]: request: DELETE /compute/v2.1/servers/4f806fc0-61ef-4c0b-b6af-8f987148f5ca HTTP/1.1 Oct 17 13:43:36.185201 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:43:36.185201 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:43:36.185201 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:43:36.185201 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:43:36.185201 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:43:36.185201 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:43:36.185201 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:43:36.185201 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:43:36.185201 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVvK8_wS2nHHfPMnF_kVROupm1B93XXH6CadR5d5brqs58CvLnZFzMuJDXcSMS9acuIKGit3vfLCjgBXuz95lVpGzialkCnGpS0TXGYpYfOPgoVNPOFLEPk97806bk70-jYPzMgdI3WH1lumwYpNW_ZGfj2y4WYuyT2A7RLdwYxI3aQ Oct 17 13:43:36.185201 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:43:36.185201 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:43:36.185201 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:43:36.185201 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:43:36.185201 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:43:36.185201 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:43:36.185201 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: d3134826eb154c71bb67718c36ff38cd Oct 17 13:43:36.185201 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ListServersNegativeTestJSON-1442205123 Oct 17 13:43:36.185201 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:43:36.185201 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:43:36.185201 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d3134826eb154c71bb67718c36ff38cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d3134826eb154c71bb67718c36ff38cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d3134826eb154c71bb67718c36ff38cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d3134826eb154c71bb67718c36ff38cd", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:43:36.185201 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ListServersNegativeTestJSON-1442205123 Oct 17 13:43:36.185201 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: d3134826eb154c71bb67718c36ff38cd Oct 17 13:43:36.185201 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1442205123 Oct 17 13:43:36.185201 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ListServersNegativeTestJSON-1442205123-project Oct 17 13:43:36.185201 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:43:36.185201 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:43:36.185201 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 76e77dade0e441a79c2c4d77993172ff Oct 17 13:43:36.185201 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ListServersNegativeTestJSON-1442205123-project Oct 17 13:43:36.185201 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:43:36.185201 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 4f806fc0-61ef-4c0b-b6af-8f987148f5ca could not be found. Oct 17 13:43:36.185201 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '4f806fc0-61ef-4c0b-b6af-8f987148f5ca'} Oct 17 13:43:36.185201 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:43:36.185201 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:36.185201 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:43:36.185201 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:43:36.185201 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:43:36.185201 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:43:36.185201 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:43:36.185201 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:43:36.185201 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:43:36.185201 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:43:36.185201 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f806fc0-61ef-4c0b-b6af-8f987148f5ca could not be found. Oct 17 13:43:36.185201 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:43:36.185201 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:36.185201 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:43:36.185201 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:36.185201 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:36.185201 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:36.185201 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:43:36.185201 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:43:36.185201 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:43:36.185201 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:43:36.185201 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:43:36.185201 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:43:36.185201 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:43:36.185201 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:43:36.185201 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:43:36.185201 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:43:36.185201 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:43:36.185201 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:43:36.189062 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f806fc0-61ef-4c0b-b6af-8f987148f5ca could not be found. Oct 17 13:43:36.189062 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:43:36.189062 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:36.189062 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:43:36.189062 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:36.189062 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:36.189062 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:36.189062 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:43:36.189062 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:43:36.189062 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f806fc0-61ef-4c0b-b6af-8f987148f5ca could not be found. Oct 17 13:43:36.189062 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:43:36.192399 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7697dd84-ec53-458b-be8e-8e08d912faea tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Returning 404 to user: Instance 4f806fc0-61ef-4c0b-b6af-8f987148f5ca could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:43:36.194667 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7697dd84-ec53-458b-be8e-8e08d912faea tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] 10.222.0.79 "DELETE /compute/v2.1/servers/4f806fc0-61ef-4c0b-b6af-8f987148f5ca" status: 404 len: 111 microversion: 2.1 time: 0.113203 Oct 17 13:43:36.204263 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1184/2393] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:43:36 2022] DELETE /compute/v2.1/servers/4f806fc0-61ef-4c0b-b6af-8f987148f5ca => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:43:36.214340 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-49582a1e-65f8-495c-90b9-02a0e000a8e5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:36.220016 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-49582a1e-65f8-495c-90b9-02a0e000a8e5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: b1b0d02c-b32f-45cd-8732-99b1e3119ca6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:36.247571 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-49582a1e-65f8-495c-90b9-02a0e000a8e5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:36.251777 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-49582a1e-65f8-495c-90b9-02a0e000a8e5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:36.253313 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-49582a1e-65f8-495c-90b9-02a0e000a8e5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:36.257608 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-49582a1e-65f8-495c-90b9-02a0e000a8e5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:36.258381 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-49582a1e-65f8-495c-90b9-02a0e000a8e5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:36.263731 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-49582a1e-65f8-495c-90b9-02a0e000a8e5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:36.295015 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-54525b44-3069-4fef-8730-f9f72f20d432 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] validate_networks() for [('cf539f31-5e6d-48a6-bad7-bc7d5b2ba203', None, None, None, None, None), ('45a094b9-63b2-488e-a81f-f57161744e21', None, None, None, None, None), ('cf539f31-5e6d-48a6-bad7-bc7d5b2ba203', None, None, None, None, None)] {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:43:37.100223 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-49582a1e-65f8-495c-90b9-02a0e000a8e5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:37.113827 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-49582a1e-65f8-495c-90b9-02a0e000a8e5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:37.120327 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-49582a1e-65f8-495c-90b9-02a0e000a8e5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:37.126236 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-49582a1e-65f8-495c-90b9-02a0e000a8e5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6" status: 200 len: 1281 microversion: 2.25 time: 0.914682 Oct 17 13:43:37.140713 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1185/2394] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:36 2022] GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6 => generated 1281 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:43:37.161968 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6f0fd6f3-abee-4203-b3e0-4d0029bf635e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:37.168417 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6f0fd6f3-abee-4203-b3e0-4d0029bf635e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:37.184073 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6f0fd6f3-abee-4203-b3e0-4d0029bf635e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:37.184567 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6f0fd6f3-abee-4203-b3e0-4d0029bf635e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:37.185176 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6f0fd6f3-abee-4203-b3e0-4d0029bf635e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:37.185899 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6f0fd6f3-abee-4203-b3e0-4d0029bf635e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:37.195873 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6f0fd6f3-abee-4203-b3e0-4d0029bf635e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:37.196583 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6f0fd6f3-abee-4203-b3e0-4d0029bf635e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:37.434782 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6f0fd6f3-abee-4203-b3e0-4d0029bf635e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:37.445898 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6f0fd6f3-abee-4203-b3e0-4d0029bf635e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1221 microversion: 2.1 time: 0.304006 Oct 17 13:43:37.467870 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1186/2395] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:37 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1221 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:37.474343 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2d43a903-a837-44a7-b56c-c0249224db9f tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:37.475124 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2d43a903-a837-44a7-b56c-c0249224db9f tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] [instance: 165d4143-55b3-4c2d-a08f-a5ae5352c934] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:37.486270 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2d43a903-a837-44a7-b56c-c0249224db9f tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:37.487004 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2d43a903-a837-44a7-b56c-c0249224db9f tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:37.488387 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2d43a903-a837-44a7-b56c-c0249224db9f tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:37.490706 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2d43a903-a837-44a7-b56c-c0249224db9f tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:37.491379 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2d43a903-a837-44a7-b56c-c0249224db9f tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:37.493205 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2d43a903-a837-44a7-b56c-c0249224db9f tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:37.544553 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2d43a903-a837-44a7-b56c-c0249224db9f tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] [instance: 165d4143-55b3-4c2d-a08f-a5ae5352c934] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:43:37.774015 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2d43a903-a837-44a7-b56c-c0249224db9f tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] 10.222.0.79 "DELETE /compute/v2.1/servers/165d4143-55b3-4c2d-a08f-a5ae5352c934" status: 204 len: 0 microversion: 2.1 time: 0.303632 Oct 17 13:43:37.776943 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1187/2396] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:43:37 2022] DELETE /compute/v2.1/servers/165d4143-55b3-4c2d-a08f-a5ae5352c934 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:43:37.792525 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-838bb5a5-df2a-4a6f-b586-cf892fa431eb tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:37.793608 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-838bb5a5-df2a-4a6f-b586-cf892fa431eb tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] [instance: 87114af9-1214-4182-8f68-756a1a5dfc7a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:37.818654 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-838bb5a5-df2a-4a6f-b586-cf892fa431eb tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:37.822548 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-838bb5a5-df2a-4a6f-b586-cf892fa431eb tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:37.823251 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-838bb5a5-df2a-4a6f-b586-cf892fa431eb tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:37.826775 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-838bb5a5-df2a-4a6f-b586-cf892fa431eb tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:37.830635 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-838bb5a5-df2a-4a6f-b586-cf892fa431eb tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:37.831980 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-838bb5a5-df2a-4a6f-b586-cf892fa431eb tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:38.762028 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-838bb5a5-df2a-4a6f-b586-cf892fa431eb tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1f69cda7724d9bb8a6beec6d4f973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87456dcb963449b2ac1c2d93da0a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:38.770727 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:43:38.781504 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-838bb5a5-df2a-4a6f-b586-cf892fa431eb tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "GET /compute/v2.1/servers/87114af9-1214-4182-8f68-756a1a5dfc7a" status: 200 len: 1317 microversion: 2.1 time: 1.001247 Oct 17 13:43:38.783882 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1188/2397] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:37 2022] GET /compute/v2.1/servers/87114af9-1214-4182-8f68-756a1a5dfc7a => generated 1317 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:38.799871 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-29edfeea-d09e-44dd-8173-4047348032d7 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:38.800574 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-29edfeea-d09e-44dd-8173-4047348032d7 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] [instance: 1088ec60-b26d-4082-bfa8-e01bf9af31f8] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:38.825683 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-29edfeea-d09e-44dd-8173-4047348032d7 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:38.827963 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-29edfeea-d09e-44dd-8173-4047348032d7 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:38.828601 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-29edfeea-d09e-44dd-8173-4047348032d7 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:38.829875 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-29edfeea-d09e-44dd-8173-4047348032d7 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:38.830521 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-29edfeea-d09e-44dd-8173-4047348032d7 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:38.831810 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-29edfeea-d09e-44dd-8173-4047348032d7 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:38.878069 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-29edfeea-d09e-44dd-8173-4047348032d7 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] [instance: 1088ec60-b26d-4082-bfa8-e01bf9af31f8] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:43:39.027078 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-29edfeea-d09e-44dd-8173-4047348032d7 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] 10.222.0.79 "DELETE /compute/v2.1/servers/1088ec60-b26d-4082-bfa8-e01bf9af31f8" status: 204 len: 0 microversion: 2.1 time: 0.239634 Oct 17 13:43:39.031596 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1189/2398] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:43:38 2022] DELETE /compute/v2.1/servers/1088ec60-b26d-4082-bfa8-e01bf9af31f8 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:43:39.044511 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8720ac44-b872-4751-8a43-ea168eb58b58 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:39.045227 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8720ac44-b872-4751-8a43-ea168eb58b58 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: b1b0d02c-b32f-45cd-8732-99b1e3119ca6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:39.051504 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8720ac44-b872-4751-8a43-ea168eb58b58 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:39.052426 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8720ac44-b872-4751-8a43-ea168eb58b58 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:39.052862 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8720ac44-b872-4751-8a43-ea168eb58b58 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:39.053565 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8720ac44-b872-4751-8a43-ea168eb58b58 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:39.054011 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8720ac44-b872-4751-8a43-ea168eb58b58 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:39.055586 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8720ac44-b872-4751-8a43-ea168eb58b58 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:39.227836 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-54525b44-3069-4fef-8730-f9f72f20d432 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:43:39.228377 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-54525b44-3069-4fef-8730-f9f72f20d432 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:43:39.228721 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-54525b44-3069-4fef-8730-f9f72f20d432 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:43:39.229362 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-54525b44-3069-4fef-8730-f9f72f20d432 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:43:39.230003 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-54525b44-3069-4fef-8730-f9f72f20d432 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:43:39.246503 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-54525b44-3069-4fef-8730-f9f72f20d432 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:39.252173 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-54525b44-3069-4fef-8730-f9f72f20d432 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:39.252847 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-54525b44-3069-4fef-8730-f9f72f20d432 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:39.254060 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-54525b44-3069-4fef-8730-f9f72f20d432 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:39.254673 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-54525b44-3069-4fef-8730-f9f72f20d432 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:39.255304 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-54525b44-3069-4fef-8730-f9f72f20d432 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:39.312296 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-54525b44-3069-4fef-8730-f9f72f20d432 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Getting quotas for project 676987e95424497c94984347dd6a7988. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:43:39.322283 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-54525b44-3069-4fef-8730-f9f72f20d432 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Getting quotas for user 467250951f654e33b3e233868301bbf0 and project 676987e95424497c94984347dd6a7988. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:43:39.359335 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-54525b44-3069-4fef-8730-f9f72f20d432 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:43:39.362024 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-54525b44-3069-4fef-8730-f9f72f20d432 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: e555208e-39b0-4361-94a5-6b272c336be4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:43:39.363791 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8720ac44-b872-4751-8a43-ea168eb58b58 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:39.378478 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8720ac44-b872-4751-8a43-ea168eb58b58 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:39.397084 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8720ac44-b872-4751-8a43-ea168eb58b58 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:39.408739 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8720ac44-b872-4751-8a43-ea168eb58b58 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6" status: 200 len: 1478 microversion: 2.25 time: 0.371232 Oct 17 13:43:39.410936 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1190/2399] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:39 2022] GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6 => generated 1478 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:43:39.415868 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-78c3c9af-e553-4ce0-a265-dd666ae3445f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:39.432505 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-78c3c9af-e553-4ce0-a265-dd666ae3445f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:39.443853 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-78c3c9af-e553-4ce0-a265-dd666ae3445f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:39.444476 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-78c3c9af-e553-4ce0-a265-dd666ae3445f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:39.445256 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-78c3c9af-e553-4ce0-a265-dd666ae3445f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:39.446246 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-78c3c9af-e553-4ce0-a265-dd666ae3445f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:39.446946 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-78c3c9af-e553-4ce0-a265-dd666ae3445f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:39.455263 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-78c3c9af-e553-4ce0-a265-dd666ae3445f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:39.472654 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-54525b44-3069-4fef-8730-f9f72f20d432 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.328007 Oct 17 13:43:39.477175 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1210/2400] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:43:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 3334 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:43:39.496779 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9c0e2f44-423d-41b9-b2e8-96773e04084d tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:39.497607 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9c0e2f44-423d-41b9-b2e8-96773e04084d tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] [instance: 4f806fc0-61ef-4c0b-b6af-8f987148f5ca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:39.513993 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c0e2f44-423d-41b9-b2e8-96773e04084d tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:39.514490 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c0e2f44-423d-41b9-b2e8-96773e04084d tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:39.514920 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c0e2f44-423d-41b9-b2e8-96773e04084d tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:39.515663 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c0e2f44-423d-41b9-b2e8-96773e04084d tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:39.516311 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c0e2f44-423d-41b9-b2e8-96773e04084d tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:39.517207 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c0e2f44-423d-41b9-b2e8-96773e04084d tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:39.552944 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-9c0e2f44-423d-41b9-b2e8-96773e04084d tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] HTTP exception thrown: Instance 4f806fc0-61ef-4c0b-b6af-8f987148f5ca could not be found. Oct 17 13:43:39.554826 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9c0e2f44-423d-41b9-b2e8-96773e04084d tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Request method failure captured: Oct 17 13:43:39.554826 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/4f806fc0-61ef-4c0b-b6af-8f987148f5ca HTTP/1.1 Oct 17 13:43:39.554826 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:43:39.554826 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:43:39.554826 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:43:39.554826 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:43:39.554826 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:43:39.554826 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:43:39.554826 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:43:39.554826 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:43:39.554826 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVvK8_wS2nHHfPMnF_kVROupm1B93XXH6CadR5d5brqs58CvLnZFzMuJDXcSMS9acuIKGit3vfLCjgBXuz95lVpGzialkCnGpS0TXGYpYfOPgoVNPOFLEPk97806bk70-jYPzMgdI3WH1lumwYpNW_ZGfj2y4WYuyT2A7RLdwYxI3aQ Oct 17 13:43:39.554826 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:43:39.554826 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:43:39.554826 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:43:39.554826 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:43:39.554826 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:43:39.554826 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:43:39.554826 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: d3134826eb154c71bb67718c36ff38cd Oct 17 13:43:39.554826 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ListServersNegativeTestJSON-1442205123 Oct 17 13:43:39.554826 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:43:39.554826 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:43:39.554826 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d3134826eb154c71bb67718c36ff38cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d3134826eb154c71bb67718c36ff38cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d3134826eb154c71bb67718c36ff38cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d3134826eb154c71bb67718c36ff38cd", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:43:39.554826 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ListServersNegativeTestJSON-1442205123 Oct 17 13:43:39.554826 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: d3134826eb154c71bb67718c36ff38cd Oct 17 13:43:39.554826 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1442205123 Oct 17 13:43:39.554826 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ListServersNegativeTestJSON-1442205123-project Oct 17 13:43:39.554826 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:43:39.554826 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:43:39.554826 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 76e77dade0e441a79c2c4d77993172ff Oct 17 13:43:39.554826 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ListServersNegativeTestJSON-1442205123-project Oct 17 13:43:39.554826 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:43:39.554826 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 4f806fc0-61ef-4c0b-b6af-8f987148f5ca could not be found. Oct 17 13:43:39.554826 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '4f806fc0-61ef-4c0b-b6af-8f987148f5ca'} Oct 17 13:43:39.554826 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:43:39.554826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:39.554826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:43:39.554826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:43:39.554826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:43:39.554826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:43:39.554826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:43:39.554826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:43:39.554826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:43:39.554826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:43:39.554826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f806fc0-61ef-4c0b-b6af-8f987148f5ca could not be found. Oct 17 13:43:39.554826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:39.554826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:39.554826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:39.554826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:39.554826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:39.554826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:39.554826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:43:39.554826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:43:39.554826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:43:39.554826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:43:39.554826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:43:39.554826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:43:39.554826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:43:39.554826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:43:39.554826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:43:39.554826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:43:39.554826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f806fc0-61ef-4c0b-b6af-8f987148f5ca could not be found. Oct 17 13:43:39.554826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:39.554826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:39.559074 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:39.559074 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:39.559074 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:39.559074 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:39.559074 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:43:39.559074 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:43:39.559074 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f806fc0-61ef-4c0b-b6af-8f987148f5ca could not be found. Oct 17 13:43:39.559074 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:43:39.562677 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9c0e2f44-423d-41b9-b2e8-96773e04084d tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Returning 404 to user: Instance 4f806fc0-61ef-4c0b-b6af-8f987148f5ca could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:43:39.563774 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9c0e2f44-423d-41b9-b2e8-96773e04084d tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] 10.222.0.79 "GET /compute/v2.1/servers/4f806fc0-61ef-4c0b-b6af-8f987148f5ca" status: 404 len: 111 microversion: 2.1 time: 0.085596 Oct 17 13:43:39.576248 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1211/2401] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:39 2022] GET /compute/v2.1/servers/4f806fc0-61ef-4c0b-b6af-8f987148f5ca => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:43:39.688101 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-78c3c9af-e553-4ce0-a265-dd666ae3445f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:39.705852 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-78c3c9af-e553-4ce0-a265-dd666ae3445f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1275 microversion: 2.1 time: 0.293535 Oct 17 13:43:39.724451 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1191/2402] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:39 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1275 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:39.731428 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4588e3c9-7411-40ab-b0f4-e17b08428110 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:39.733406 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4588e3c9-7411-40ab-b0f4-e17b08428110 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: e555208e-39b0-4361-94a5-6b272c336be4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:39.820852 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-39b19f4d-e7e7-4162-bf0a-c625176f9e10 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:39.821472 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-39b19f4d-e7e7-4162-bf0a-c625176f9e10 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] [instance: b1b0d02c-b32f-45cd-8732-99b1e3119ca6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:39.822095 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4588e3c9-7411-40ab-b0f4-e17b08428110 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467250951f654e33b3e233868301bbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676987e95424497c94984347dd6a7988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:39.832430 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4588e3c9-7411-40ab-b0f4-e17b08428110 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4" status: 200 len: 1211 microversion: 2.1 time: 0.105644 Oct 17 13:43:39.835033 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1192/2403] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:39 2022] GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4 => generated 1211 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:39.840012 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b671b7c6-669c-4ce3-9d58-8135c0d9f9b0 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:39.840827 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b671b7c6-669c-4ce3-9d58-8135c0d9f9b0 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] [instance: 165d4143-55b3-4c2d-a08f-a5ae5352c934] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:39.842297 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-39b19f4d-e7e7-4162-bf0a-c625176f9e10 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:39.842809 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-39b19f4d-e7e7-4162-bf0a-c625176f9e10 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:39.843278 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-39b19f4d-e7e7-4162-bf0a-c625176f9e10 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:39.844001 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-39b19f4d-e7e7-4162-bf0a-c625176f9e10 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:39.844450 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-39b19f4d-e7e7-4162-bf0a-c625176f9e10 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:39.844858 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-39b19f4d-e7e7-4162-bf0a-c625176f9e10 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:39.849117 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b671b7c6-669c-4ce3-9d58-8135c0d9f9b0 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:39.849945 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b671b7c6-669c-4ce3-9d58-8135c0d9f9b0 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:39.854545 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b671b7c6-669c-4ce3-9d58-8135c0d9f9b0 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:39.855590 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b671b7c6-669c-4ce3-9d58-8135c0d9f9b0 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:39.856245 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b671b7c6-669c-4ce3-9d58-8135c0d9f9b0 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:39.856827 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b671b7c6-669c-4ce3-9d58-8135c0d9f9b0 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:40.275399 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-39b19f4d-e7e7-4162-bf0a-c625176f9e10 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lazy-loading 'services' on Instance uuid b1b0d02c-b32f-45cd-8732-99b1e3119ca6 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:43:40.320773 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b671b7c6-669c-4ce3-9d58-8135c0d9f9b0 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76e77dade0e441a79c2c4d77993172ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3134826eb154c71bb67718c36ff38cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:40.325703 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-39b19f4d-e7e7-4162-bf0a-c625176f9e10 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6" status: 200 len: 1973 microversion: 2.25 time: 0.743281 Oct 17 13:43:40.327103 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1212/2404] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:39 2022] GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6 => generated 1973 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:43:40.334187 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-50ef7fff-706e-4232-9c3b-2604e329c9bf tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:40.335300 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-50ef7fff-706e-4232-9c3b-2604e329c9bf tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] [instance: 87114af9-1214-4182-8f68-756a1a5dfc7a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:40.345806 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b671b7c6-669c-4ce3-9d58-8135c0d9f9b0 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] 10.222.0.79 "GET /compute/v2.1/servers/165d4143-55b3-4c2d-a08f-a5ae5352c934" status: 200 len: 1521 microversion: 2.1 time: 0.509509 Oct 17 13:43:40.346412 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1193/2405] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:39 2022] GET /compute/v2.1/servers/165d4143-55b3-4c2d-a08f-a5ae5352c934 => generated 1521 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:40.351961 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-50ef7fff-706e-4232-9c3b-2604e329c9bf tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:40.352786 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-50ef7fff-706e-4232-9c3b-2604e329c9bf tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:40.353471 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-50ef7fff-706e-4232-9c3b-2604e329c9bf tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:40.354442 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-50ef7fff-706e-4232-9c3b-2604e329c9bf tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:40.354581 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-ffc174b2-be58-41d1-8422-36fc1258aacf req-a14ebcc1-2bd1-4f81-b943-4f3491d40c66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "165d4143-55b3-4c2d-a08f-a5ae5352c934", "name": "network-vif-deleted", "tag": "427436f1-8c1c-458e-9e9d-ee0c9ee68351"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:40.355187 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-50ef7fff-706e-4232-9c3b-2604e329c9bf tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:40.355817 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-50ef7fff-706e-4232-9c3b-2604e329c9bf tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:40.389533 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-ffc174b2-be58-41d1-8422-36fc1258aacf req-a14ebcc1-2bd1-4f81-b943-4f3491d40c66 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:40.390308 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-ffc174b2-be58-41d1-8422-36fc1258aacf req-a14ebcc1-2bd1-4f81-b943-4f3491d40c66 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:40.391143 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-ffc174b2-be58-41d1-8422-36fc1258aacf req-a14ebcc1-2bd1-4f81-b943-4f3491d40c66 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:40.414387 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-ffc174b2-be58-41d1-8422-36fc1258aacf req-a14ebcc1-2bd1-4f81-b943-4f3491d40c66 service nova] Creating event network-vif-deleted:427436f1-8c1c-458e-9e9d-ee0c9ee68351 for instance 165d4143-55b3-4c2d-a08f-a5ae5352c934 on n-h2-854247-14 Oct 17 13:43:40.432744 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-ffc174b2-be58-41d1-8422-36fc1258aacf req-a14ebcc1-2bd1-4f81-b943-4f3491d40c66 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083014 Oct 17 13:43:40.433944 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1194/2406] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:43:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:43:40.446788 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0a7d0e83-0da1-490f-a3dc-61c6455ccf17 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:40.447801 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0a7d0e83-0da1-490f-a3dc-61c6455ccf17 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] [instance: b1b0d02c-b32f-45cd-8732-99b1e3119ca6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:40.463712 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0a7d0e83-0da1-490f-a3dc-61c6455ccf17 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:40.464435 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0a7d0e83-0da1-490f-a3dc-61c6455ccf17 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:40.465119 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0a7d0e83-0da1-490f-a3dc-61c6455ccf17 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:40.467341 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0a7d0e83-0da1-490f-a3dc-61c6455ccf17 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:40.480405 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0a7d0e83-0da1-490f-a3dc-61c6455ccf17 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:40.481704 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0a7d0e83-0da1-490f-a3dc-61c6455ccf17 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:41.124418 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-50ef7fff-706e-4232-9c3b-2604e329c9bf tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1f69cda7724d9bb8a6beec6d4f973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87456dcb963449b2ac1c2d93da0a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:41.152071 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-50ef7fff-706e-4232-9c3b-2604e329c9bf tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "GET /compute/v2.1/servers/87114af9-1214-4182-8f68-756a1a5dfc7a" status: 200 len: 1317 microversion: 2.1 time: 0.823000 Oct 17 13:43:41.153062 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1213/2407] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:40 2022] GET /compute/v2.1/servers/87114af9-1214-4182-8f68-756a1a5dfc7a => generated 1317 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:41.165580 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e9dc48e8-7b68-4b40-8452-76882434518d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:41.167091 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e9dc48e8-7b68-4b40-8452-76882434518d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:41.179699 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9dc48e8-7b68-4b40-8452-76882434518d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:41.180609 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9dc48e8-7b68-4b40-8452-76882434518d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:41.181356 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9dc48e8-7b68-4b40-8452-76882434518d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:41.182735 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9dc48e8-7b68-4b40-8452-76882434518d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:41.183397 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9dc48e8-7b68-4b40-8452-76882434518d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:41.184270 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9dc48e8-7b68-4b40-8452-76882434518d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:41.189520 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-0a7d0e83-0da1-490f-a3dc-61c6455ccf17 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lazy-loading 'services' on Instance uuid b1b0d02c-b32f-45cd-8732-99b1e3119ca6 {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:43:41.234205 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0a7d0e83-0da1-490f-a3dc-61c6455ccf17 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6" status: 200 len: 1973 microversion: 2.25 time: 0.798409 Oct 17 13:43:41.238992 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1195/2408] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:40 2022] GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6 => generated 1973 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:43:41.244252 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8f618c24-f573-4a8f-8e56-5d4f89af316b tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:41.245056 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8f618c24-f573-4a8f-8e56-5d4f89af316b tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: e555208e-39b0-4361-94a5-6b272c336be4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:41.281896 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8f618c24-f573-4a8f-8e56-5d4f89af316b tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:41.282341 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8f618c24-f573-4a8f-8e56-5d4f89af316b tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:41.287796 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8f618c24-f573-4a8f-8e56-5d4f89af316b tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:41.288771 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8f618c24-f573-4a8f-8e56-5d4f89af316b tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:41.289382 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8f618c24-f573-4a8f-8e56-5d4f89af316b tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:41.289951 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8f618c24-f573-4a8f-8e56-5d4f89af316b tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:41.916091 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e9dc48e8-7b68-4b40-8452-76882434518d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:41.930345 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8f618c24-f573-4a8f-8e56-5d4f89af316b tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467250951f654e33b3e233868301bbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676987e95424497c94984347dd6a7988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:41.945181 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e9dc48e8-7b68-4b40-8452-76882434518d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1275 microversion: 2.1 time: 0.787764 Oct 17 13:43:41.947596 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8f618c24-f573-4a8f-8e56-5d4f89af316b tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4" status: 200 len: 1207 microversion: 2.1 time: 0.707203 Oct 17 13:43:41.951483 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1196/2409] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:41 2022] GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4 => generated 1207 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:41.953389 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1214/2410] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:41 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1275 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:41.958230 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-7832922b-5c79-4b58-a312-3945a35a92df req-bc073ed7-9f55-43a4-be2d-d552b89f4f54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87114af9-1214-4182-8f68-756a1a5dfc7a", "name": "network-vif-plugged", "status": "completed", "tag": "cde412a7-8204-4c39-8f24-2d2a36d636f9"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:41.961698 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-703adf67-a329-4e88-a27f-bad6324c6a5b tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:41.976196 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-703adf67-a329-4e88-a27f-bad6324c6a5b tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:41.976905 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-703adf67-a329-4e88-a27f-bad6324c6a5b tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:41.977498 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-703adf67-a329-4e88-a27f-bad6324c6a5b tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:41.981046 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-703adf67-a329-4e88-a27f-bad6324c6a5b tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:41.981046 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-703adf67-a329-4e88-a27f-bad6324c6a5b tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:41.981046 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-703adf67-a329-4e88-a27f-bad6324c6a5b tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:41.986732 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-7832922b-5c79-4b58-a312-3945a35a92df req-bc073ed7-9f55-43a4-be2d-d552b89f4f54 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:41.987263 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-7832922b-5c79-4b58-a312-3945a35a92df req-bc073ed7-9f55-43a4-be2d-d552b89f4f54 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:41.996690 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-7832922b-5c79-4b58-a312-3945a35a92df req-bc073ed7-9f55-43a4-be2d-d552b89f4f54 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:42.076101 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-7832922b-5c79-4b58-a312-3945a35a92df req-bc073ed7-9f55-43a4-be2d-d552b89f4f54 service nova] Creating event network-vif-plugged:cde412a7-8204-4c39-8f24-2d2a36d636f9 for instance 87114af9-1214-4182-8f68-756a1a5dfc7a on n-h2-854247-14 Oct 17 13:43:42.088564 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-7832922b-5c79-4b58-a312-3945a35a92df req-bc073ed7-9f55-43a4-be2d-d552b89f4f54 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135332 Oct 17 13:43:42.090226 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1197/2411] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:43:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:43:42.098300 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-19c7dfb2-4803-429b-9d19-ad802e97369b tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:42.099616 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-19c7dfb2-4803-429b-9d19-ad802e97369b tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] [instance: 165d4143-55b3-4c2d-a08f-a5ae5352c934] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:42.114996 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-703adf67-a329-4e88-a27f-bad6324c6a5b tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.149035 Oct 17 13:43:42.120211 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1215/2412] 10.222.0.79 () {60 vars in 1217 bytes} [Mon Oct 17 13:43:41 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:43:42.142678 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-69fbbf63-4380-4034-aafb-ad960b502556 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854247-14", "block_migration": "auto"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:42.144352 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-19c7dfb2-4803-429b-9d19-ad802e97369b tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:42.144862 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-19c7dfb2-4803-429b-9d19-ad802e97369b tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:42.148670 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-19c7dfb2-4803-429b-9d19-ad802e97369b tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:42.151025 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-19c7dfb2-4803-429b-9d19-ad802e97369b tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:42.151025 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-19c7dfb2-4803-429b-9d19-ad802e97369b tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:42.151025 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-19c7dfb2-4803-429b-9d19-ad802e97369b tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:42.152708 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-69fbbf63-4380-4034-aafb-ad960b502556 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] [instance: b1b0d02c-b32f-45cd-8732-99b1e3119ca6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:42.170987 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-69fbbf63-4380-4034-aafb-ad960b502556 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:42.182880 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-19c7dfb2-4803-429b-9d19-ad802e97369b tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] HTTP exception thrown: Instance 165d4143-55b3-4c2d-a08f-a5ae5352c934 could not be found. Oct 17 13:43:42.183678 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-69fbbf63-4380-4034-aafb-ad960b502556 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:42.184357 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-69fbbf63-4380-4034-aafb-ad960b502556 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:42.185115 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-69fbbf63-4380-4034-aafb-ad960b502556 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:42.187512 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-69fbbf63-4380-4034-aafb-ad960b502556 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:42.188169 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-69fbbf63-4380-4034-aafb-ad960b502556 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:42.193193 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-19c7dfb2-4803-429b-9d19-ad802e97369b tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Request method failure captured: Oct 17 13:43:42.193193 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/165d4143-55b3-4c2d-a08f-a5ae5352c934 HTTP/1.1 Oct 17 13:43:42.193193 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:43:42.193193 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:43:42.193193 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:43:42.193193 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:43:42.193193 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:43:42.193193 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:43:42.193193 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:43:42.193193 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:43:42.193193 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVvK8_wS2nHHfPMnF_kVROupm1B93XXH6CadR5d5brqs58CvLnZFzMuJDXcSMS9acuIKGit3vfLCjgBXuz95lVpGzialkCnGpS0TXGYpYfOPgoVNPOFLEPk97806bk70-jYPzMgdI3WH1lumwYpNW_ZGfj2y4WYuyT2A7RLdwYxI3aQ Oct 17 13:43:42.193193 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:43:42.193193 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:43:42.193193 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:43:42.193193 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:43:42.193193 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:43:42.193193 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:43:42.193193 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: d3134826eb154c71bb67718c36ff38cd Oct 17 13:43:42.193193 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ListServersNegativeTestJSON-1442205123 Oct 17 13:43:42.193193 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:43:42.193193 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:43:42.193193 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d3134826eb154c71bb67718c36ff38cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d3134826eb154c71bb67718c36ff38cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d3134826eb154c71bb67718c36ff38cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d3134826eb154c71bb67718c36ff38cd", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:43:42.193193 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ListServersNegativeTestJSON-1442205123 Oct 17 13:43:42.193193 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: d3134826eb154c71bb67718c36ff38cd Oct 17 13:43:42.193193 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1442205123 Oct 17 13:43:42.193193 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ListServersNegativeTestJSON-1442205123-project Oct 17 13:43:42.193193 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:43:42.193193 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:43:42.193193 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 76e77dade0e441a79c2c4d77993172ff Oct 17 13:43:42.193193 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ListServersNegativeTestJSON-1442205123-project Oct 17 13:43:42.193193 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:43:42.193193 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 165d4143-55b3-4c2d-a08f-a5ae5352c934 could not be found. Oct 17 13:43:42.193193 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '165d4143-55b3-4c2d-a08f-a5ae5352c934'} Oct 17 13:43:42.193193 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:43:42.193193 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:42.193193 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:43:42.193193 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:43:42.193193 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:43:42.193193 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:43:42.193193 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:43:42.193193 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:43:42.193193 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:43:42.193193 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:43:42.193193 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 165d4143-55b3-4c2d-a08f-a5ae5352c934 could not be found. Oct 17 13:43:42.193193 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:43:42.193193 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:42.193193 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:43:42.193193 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:42.193193 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:42.193193 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:42.193193 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:43:42.193193 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:43:42.193193 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:43:42.193193 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:43:42.193193 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:43:42.193193 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:43:42.193193 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:43:42.193193 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:43:42.193193 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:43:42.193193 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:43:42.193193 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 165d4143-55b3-4c2d-a08f-a5ae5352c934 could not be found. Oct 17 13:43:42.193193 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:43:42.193193 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:42.200877 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:43:42.200877 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:42.200877 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:42.200877 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:42.200877 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:43:42.200877 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:43:42.200877 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 165d4143-55b3-4c2d-a08f-a5ae5352c934 could not be found. Oct 17 13:43:42.200877 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:43:42.215191 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-19c7dfb2-4803-429b-9d19-ad802e97369b tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Returning 404 to user: Instance 165d4143-55b3-4c2d-a08f-a5ae5352c934 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:43:42.232384 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-19c7dfb2-4803-429b-9d19-ad802e97369b tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] 10.222.0.79 "GET /compute/v2.1/servers/165d4143-55b3-4c2d-a08f-a5ae5352c934" status: 404 len: 111 microversion: 2.1 time: 0.139874 Oct 17 13:43:42.233629 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1198/2413] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:42 2022] GET /compute/v2.1/servers/165d4143-55b3-4c2d-a08f-a5ae5352c934 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:43:42.240868 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-43a5b1e2-6335-4e91-bb72-de6baf44bcdc tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:42.241750 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-43a5b1e2-6335-4e91-bb72-de6baf44bcdc tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] [instance: 87114af9-1214-4182-8f68-756a1a5dfc7a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:42.252789 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-69fbbf63-4380-4034-aafb-ad960b502556 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lazy-loading 'flavor' on Instance uuid b1b0d02c-b32f-45cd-8732-99b1e3119ca6 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:43:42.252983 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-43a5b1e2-6335-4e91-bb72-de6baf44bcdc tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:42.253363 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-43a5b1e2-6335-4e91-bb72-de6baf44bcdc tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:42.254262 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-43a5b1e2-6335-4e91-bb72-de6baf44bcdc tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:42.256621 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-43a5b1e2-6335-4e91-bb72-de6baf44bcdc tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:42.257398 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-43a5b1e2-6335-4e91-bb72-de6baf44bcdc tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:42.257991 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-43a5b1e2-6335-4e91-bb72-de6baf44bcdc tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:42.308199 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-69fbbf63-4380-4034-aafb-ad960b502556 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] [instance: b1b0d02c-b32f-45cd-8732-99b1e3119ca6] Going to try to live migrate instance to n-h2-854247-14 {{(pid=127016) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 17 13:43:42.789948 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-43a5b1e2-6335-4e91-bb72-de6baf44bcdc tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1f69cda7724d9bb8a6beec6d4f973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87456dcb963449b2ac1c2d93da0a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:42.798810 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-43a5b1e2-6335-4e91-bb72-de6baf44bcdc tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "GET /compute/v2.1/servers/87114af9-1214-4182-8f68-756a1a5dfc7a" status: 200 len: 1317 microversion: 2.1 time: 0.563812 Oct 17 13:43:42.799441 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1199/2414] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:42 2022] GET /compute/v2.1/servers/87114af9-1214-4182-8f68-756a1a5dfc7a => generated 1317 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:42.828570 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3074e0c4-d2b2-48ea-890e-2ffa76443860 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:42.828849 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3074e0c4-d2b2-48ea-890e-2ffa76443860 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] [instance: 1088ec60-b26d-4082-bfa8-e01bf9af31f8] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:42.842872 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3074e0c4-d2b2-48ea-890e-2ffa76443860 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:42.843401 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3074e0c4-d2b2-48ea-890e-2ffa76443860 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:42.843841 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3074e0c4-d2b2-48ea-890e-2ffa76443860 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:42.852232 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3074e0c4-d2b2-48ea-890e-2ffa76443860 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:42.856263 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3074e0c4-d2b2-48ea-890e-2ffa76443860 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:42.856713 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3074e0c4-d2b2-48ea-890e-2ffa76443860 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:43.346386 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3074e0c4-d2b2-48ea-890e-2ffa76443860 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76e77dade0e441a79c2c4d77993172ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3134826eb154c71bb67718c36ff38cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:43.354455 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3074e0c4-d2b2-48ea-890e-2ffa76443860 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] 10.222.0.79 "GET /compute/v2.1/servers/1088ec60-b26d-4082-bfa8-e01bf9af31f8" status: 200 len: 1521 microversion: 2.1 time: 0.553956 Oct 17 13:43:43.355040 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1200/2415] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:42 2022] GET /compute/v2.1/servers/1088ec60-b26d-4082-bfa8-e01bf9af31f8 => generated 1521 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:43.365395 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c54c2b44-da4e-4ecd-8557-0d9f483ba577 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:43.366018 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c54c2b44-da4e-4ecd-8557-0d9f483ba577 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:43.386881 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c54c2b44-da4e-4ecd-8557-0d9f483ba577 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:43.387652 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c54c2b44-da4e-4ecd-8557-0d9f483ba577 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:43.391810 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c54c2b44-da4e-4ecd-8557-0d9f483ba577 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:43.392781 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c54c2b44-da4e-4ecd-8557-0d9f483ba577 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:43.398813 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c54c2b44-da4e-4ecd-8557-0d9f483ba577 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:43.399517 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c54c2b44-da4e-4ecd-8557-0d9f483ba577 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:43.781707 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c54c2b44-da4e-4ecd-8557-0d9f483ba577 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:43.808294 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c54c2b44-da4e-4ecd-8557-0d9f483ba577 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1317 microversion: 2.1 time: 0.445150 Oct 17 13:43:43.811234 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1201/2416] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:43 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1317 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:43.842339 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ffe3f0c0-f951-487f-9aae-7ae98638bde2 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:43.845858 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ffe3f0c0-f951-487f-9aae-7ae98638bde2 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: e555208e-39b0-4361-94a5-6b272c336be4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:43.877052 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ffe3f0c0-f951-487f-9aae-7ae98638bde2 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:43.878531 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ffe3f0c0-f951-487f-9aae-7ae98638bde2 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:43.883099 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ffe3f0c0-f951-487f-9aae-7ae98638bde2 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:43.887904 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ffe3f0c0-f951-487f-9aae-7ae98638bde2 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:43.890446 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ffe3f0c0-f951-487f-9aae-7ae98638bde2 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:43.893140 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ffe3f0c0-f951-487f-9aae-7ae98638bde2 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:44.339243 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ffe3f0c0-f951-487f-9aae-7ae98638bde2 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467250951f654e33b3e233868301bbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676987e95424497c94984347dd6a7988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:44.354282 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ffe3f0c0-f951-487f-9aae-7ae98638bde2 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4" status: 200 len: 1269 microversion: 2.1 time: 0.537149 Oct 17 13:43:44.373500 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1202/2417] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:43 2022] GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4 => generated 1269 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:44.396719 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-f4df4d21-e69f-401c-88b8-3bff8c868830 req-30498315-f8b7-44e2-99fb-27d662171639 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1088ec60-b26d-4082-bfa8-e01bf9af31f8", "name": "network-vif-deleted", "tag": "c922642f-3d80-4a95-ab40-d8ce583ebe8d"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:44.449818 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-f4df4d21-e69f-401c-88b8-3bff8c868830 req-30498315-f8b7-44e2-99fb-27d662171639 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:44.450310 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-f4df4d21-e69f-401c-88b8-3bff8c868830 req-30498315-f8b7-44e2-99fb-27d662171639 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:44.450901 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-f4df4d21-e69f-401c-88b8-3bff8c868830 req-30498315-f8b7-44e2-99fb-27d662171639 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:44.505356 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-f4df4d21-e69f-401c-88b8-3bff8c868830 req-30498315-f8b7-44e2-99fb-27d662171639 service nova] Creating event network-vif-deleted:c922642f-3d80-4a95-ab40-d8ce583ebe8d for instance 1088ec60-b26d-4082-bfa8-e01bf9af31f8 on n-h1-854247-14 Oct 17 13:43:44.523731 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-f4df4d21-e69f-401c-88b8-3bff8c868830 req-30498315-f8b7-44e2-99fb-27d662171639 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139680 Oct 17 13:43:44.526032 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1203/2418] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:43:44.542010 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-888b6525-b67c-4111-b171-e48e12dd814b tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:44.547978 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-888b6525-b67c-4111-b171-e48e12dd814b tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] [instance: 87114af9-1214-4182-8f68-756a1a5dfc7a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:44.561841 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-888b6525-b67c-4111-b171-e48e12dd814b tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:44.562398 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-888b6525-b67c-4111-b171-e48e12dd814b tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:44.562844 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-888b6525-b67c-4111-b171-e48e12dd814b tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:44.575755 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-888b6525-b67c-4111-b171-e48e12dd814b tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:44.582368 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-888b6525-b67c-4111-b171-e48e12dd814b tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:44.585565 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-888b6525-b67c-4111-b171-e48e12dd814b tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:44.946269 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=6 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:43:45.134184 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-888b6525-b67c-4111-b171-e48e12dd814b tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1f69cda7724d9bb8a6beec6d4f973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87456dcb963449b2ac1c2d93da0a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:45.150713 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-888b6525-b67c-4111-b171-e48e12dd814b tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "GET /compute/v2.1/servers/87114af9-1214-4182-8f68-756a1a5dfc7a" status: 200 len: 1467 microversion: 2.1 time: 0.612822 Oct 17 13:43:45.153654 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1204/2419] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:44 2022] GET /compute/v2.1/servers/87114af9-1214-4182-8f68-756a1a5dfc7a => generated 1467 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:45.168474 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-280fd4dc-8a15-4ad6-bcb5-dc06a6391d24 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:45.173762 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-280fd4dc-8a15-4ad6-bcb5-dc06a6391d24 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] [instance: 1088ec60-b26d-4082-bfa8-e01bf9af31f8] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:45.193928 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:43:45.210975 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-280fd4dc-8a15-4ad6-bcb5-dc06a6391d24 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:45.211884 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-280fd4dc-8a15-4ad6-bcb5-dc06a6391d24 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:45.212342 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-280fd4dc-8a15-4ad6-bcb5-dc06a6391d24 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:45.213260 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-280fd4dc-8a15-4ad6-bcb5-dc06a6391d24 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:45.213942 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-280fd4dc-8a15-4ad6-bcb5-dc06a6391d24 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:45.214609 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-280fd4dc-8a15-4ad6-bcb5-dc06a6391d24 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:45.272720 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-280fd4dc-8a15-4ad6-bcb5-dc06a6391d24 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] HTTP exception thrown: Instance 1088ec60-b26d-4082-bfa8-e01bf9af31f8 could not be found. Oct 17 13:43:45.300601 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-280fd4dc-8a15-4ad6-bcb5-dc06a6391d24 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Request method failure captured: Oct 17 13:43:45.300601 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/1088ec60-b26d-4082-bfa8-e01bf9af31f8 HTTP/1.1 Oct 17 13:43:45.300601 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:43:45.300601 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:43:45.300601 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:43:45.300601 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:43:45.300601 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:43:45.300601 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:43:45.300601 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:43:45.300601 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:43:45.300601 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVvK8_wS2nHHfPMnF_kVROupm1B93XXH6CadR5d5brqs58CvLnZFzMuJDXcSMS9acuIKGit3vfLCjgBXuz95lVpGzialkCnGpS0TXGYpYfOPgoVNPOFLEPk97806bk70-jYPzMgdI3WH1lumwYpNW_ZGfj2y4WYuyT2A7RLdwYxI3aQ Oct 17 13:43:45.300601 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:43:45.300601 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:43:45.300601 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:43:45.300601 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:43:45.300601 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:43:45.300601 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:43:45.300601 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: d3134826eb154c71bb67718c36ff38cd Oct 17 13:43:45.300601 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ListServersNegativeTestJSON-1442205123 Oct 17 13:43:45.300601 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:43:45.300601 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:43:45.300601 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d3134826eb154c71bb67718c36ff38cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d3134826eb154c71bb67718c36ff38cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d3134826eb154c71bb67718c36ff38cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d3134826eb154c71bb67718c36ff38cd", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:43:45.300601 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ListServersNegativeTestJSON-1442205123 Oct 17 13:43:45.300601 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: d3134826eb154c71bb67718c36ff38cd Oct 17 13:43:45.300601 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1442205123 Oct 17 13:43:45.300601 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ListServersNegativeTestJSON-1442205123-project Oct 17 13:43:45.300601 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:43:45.300601 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:43:45.300601 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 76e77dade0e441a79c2c4d77993172ff Oct 17 13:43:45.300601 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ListServersNegativeTestJSON-1442205123-project Oct 17 13:43:45.300601 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:43:45.300601 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 1088ec60-b26d-4082-bfa8-e01bf9af31f8 could not be found. Oct 17 13:43:45.300601 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '1088ec60-b26d-4082-bfa8-e01bf9af31f8'} Oct 17 13:43:45.300601 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:43:45.300601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:45.300601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:43:45.300601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:43:45.300601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:43:45.300601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:43:45.300601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:43:45.300601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:43:45.300601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:43:45.300601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:43:45.300601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1088ec60-b26d-4082-bfa8-e01bf9af31f8 could not be found. Oct 17 13:43:45.300601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:43:45.300601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:45.300601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:43:45.300601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:45.300601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:45.300601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:45.300601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:43:45.300601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:43:45.300601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:43:45.300601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:43:45.300601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:43:45.300601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:43:45.300601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:43:45.300601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:43:45.300601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:43:45.300601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:43:45.300601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1088ec60-b26d-4082-bfa8-e01bf9af31f8 could not be found. Oct 17 13:43:45.300601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:43:45.300601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:45.303984 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:43:45.303984 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:45.303984 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:45.303984 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:45.303984 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:43:45.303984 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:43:45.303984 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1088ec60-b26d-4082-bfa8-e01bf9af31f8 could not be found. Oct 17 13:43:45.303984 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:43:45.303984 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-280fd4dc-8a15-4ad6-bcb5-dc06a6391d24 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] Returning 404 to user: Instance 1088ec60-b26d-4082-bfa8-e01bf9af31f8 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:43:45.303984 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-280fd4dc-8a15-4ad6-bcb5-dc06a6391d24 tempest-ListServersNegativeTestJSON-1442205123 tempest-ListServersNegativeTestJSON-1442205123-project] 10.222.0.79 "GET /compute/v2.1/servers/1088ec60-b26d-4082-bfa8-e01bf9af31f8" status: 404 len: 111 microversion: 2.1 time: 0.147502 Oct 17 13:43:45.309672 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1205/2420] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:45 2022] GET /compute/v2.1/servers/1088ec60-b26d-4082-bfa8-e01bf9af31f8 => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:43:45.320605 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4cd9797c-7bb0-4d4b-8a03-fdaa62dc8404 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:45.321237 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4cd9797c-7bb0-4d4b-8a03-fdaa62dc8404 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:45.343201 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4cd9797c-7bb0-4d4b-8a03-fdaa62dc8404 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:45.343800 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4cd9797c-7bb0-4d4b-8a03-fdaa62dc8404 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:45.344154 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4cd9797c-7bb0-4d4b-8a03-fdaa62dc8404 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:45.345087 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4cd9797c-7bb0-4d4b-8a03-fdaa62dc8404 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:45.345314 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4cd9797c-7bb0-4d4b-8a03-fdaa62dc8404 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:45.345901 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4cd9797c-7bb0-4d4b-8a03-fdaa62dc8404 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:45.981604 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4cd9797c-7bb0-4d4b-8a03-fdaa62dc8404 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:45.997762 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4cd9797c-7bb0-4d4b-8a03-fdaa62dc8404 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1317 microversion: 2.1 time: 0.686696 Oct 17 13:43:45.998352 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1206/2421] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:45 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1317 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:46.011054 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-f9481855-224b-47b4-a589-ec274395f16f req-87178244-ca6e-468e-88b4-7a402ccd8cc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ef00d34-7f81-4649-a90a-a52cf78dbeca", "tag": "841d5cd2-6ca1-435c-ac29-bfeee122d7fe"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:46.029760 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-f9481855-224b-47b4-a589-ec274395f16f req-87178244-ca6e-468e-88b4-7a402ccd8cc7 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:46.032372 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-f9481855-224b-47b4-a589-ec274395f16f req-87178244-ca6e-468e-88b4-7a402ccd8cc7 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:46.033530 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-f9481855-224b-47b4-a589-ec274395f16f req-87178244-ca6e-468e-88b4-7a402ccd8cc7 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:46.050893 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-f9481855-224b-47b4-a589-ec274395f16f req-87178244-ca6e-468e-88b4-7a402ccd8cc7 service nova] Creating event network-changed:841d5cd2-6ca1-435c-ac29-bfeee122d7fe for instance 5ef00d34-7f81-4649-a90a-a52cf78dbeca on n-h1-854247-14 Oct 17 13:43:46.059623 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-f9481855-224b-47b4-a589-ec274395f16f req-87178244-ca6e-468e-88b4-7a402ccd8cc7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056220 Oct 17 13:43:46.061066 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1207/2422] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:43:46.069261 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f9ca0126-412f-42d4-972c-9de9b6b32acd tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-832584267", "metadata": {"image_type": "test"}}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:46.073332 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f9ca0126-412f-42d4-972c-9de9b6b32acd tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] [instance: 87114af9-1214-4182-8f68-756a1a5dfc7a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:46.084833 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f9ca0126-412f-42d4-972c-9de9b6b32acd tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:46.085548 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f9ca0126-412f-42d4-972c-9de9b6b32acd tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:46.086127 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f9ca0126-412f-42d4-972c-9de9b6b32acd tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:46.087455 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f9ca0126-412f-42d4-972c-9de9b6b32acd tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:46.101966 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f9ca0126-412f-42d4-972c-9de9b6b32acd tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:46.103659 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f9ca0126-412f-42d4-972c-9de9b6b32acd tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:46.159621 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:43:46.183517 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-f9ca0126-412f-42d4-972c-9de9b6b32acd tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Getting quotas for project 87456dcb963449b2ac1c2d93da0a4ec7. Resources: dict_keys(['metadata_items']) {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:43:46.190440 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-f9ca0126-412f-42d4-972c-9de9b6b32acd tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Getting quotas for user dc1f69cda7724d9bb8a6beec6d4f973e and project 87456dcb963449b2ac1c2d93da0a4ec7. Resources: dict_keys(['metadata_items']) {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:43:46.453236 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f9ca0126-412f-42d4-972c-9de9b6b32acd tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "POST /compute/v2.1/servers/87114af9-1214-4182-8f68-756a1a5dfc7a/action" status: 202 len: 0 microversion: 2.1 time: 0.390121 Oct 17 13:43:46.454921 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1208/2423] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:43:46 2022] POST /compute/v2.1/servers/87114af9-1214-4182-8f68-756a1a5dfc7a/action => generated 0 bytes in 393 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 17 13:43:46.462820 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-fbcfe80c-1cc3-4ff2-8a4b-46a88abe56ba tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:46.465137 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-fbcfe80c-1cc3-4ff2-8a4b-46a88abe56ba tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: e555208e-39b0-4361-94a5-6b272c336be4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:46.478431 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fbcfe80c-1cc3-4ff2-8a4b-46a88abe56ba tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:46.479102 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fbcfe80c-1cc3-4ff2-8a4b-46a88abe56ba tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:46.479601 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fbcfe80c-1cc3-4ff2-8a4b-46a88abe56ba tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:46.480449 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fbcfe80c-1cc3-4ff2-8a4b-46a88abe56ba tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:46.480928 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fbcfe80c-1cc3-4ff2-8a4b-46a88abe56ba tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:46.481570 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fbcfe80c-1cc3-4ff2-8a4b-46a88abe56ba tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:46.484982 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-69fbbf63-4380-4034-aafb-ad960b502556 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6/action" status: 202 len: 0 microversion: 2.25 time: 4.357277 Oct 17 13:43:46.486038 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1216/2424] 10.222.0.79 () {62 vars in 1319 bytes} [Mon Oct 17 13:43:42 2022] POST /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6/action => generated 0 bytes in 4359 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:43:46.617928 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4ca1c7a2-c24f-4567-8209-f3db229310a7 tempest-AZV2TestJSON-936327745 tempest-AZV2TestJSON-936327745-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:46.619508 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4ca1c7a2-c24f-4567-8209-f3db229310a7 tempest-AZV2TestJSON-936327745 tempest-AZV2TestJSON-936327745-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:46.619989 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4ca1c7a2-c24f-4567-8209-f3db229310a7 tempest-AZV2TestJSON-936327745 tempest-AZV2TestJSON-936327745-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:46.620487 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4ca1c7a2-c24f-4567-8209-f3db229310a7 tempest-AZV2TestJSON-936327745 tempest-AZV2TestJSON-936327745-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:46.621211 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4ca1c7a2-c24f-4567-8209-f3db229310a7 tempest-AZV2TestJSON-936327745 tempest-AZV2TestJSON-936327745-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:46.622644 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4ca1c7a2-c24f-4567-8209-f3db229310a7 tempest-AZV2TestJSON-936327745 tempest-AZV2TestJSON-936327745-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:46.623071 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4ca1c7a2-c24f-4567-8209-f3db229310a7 tempest-AZV2TestJSON-936327745 tempest-AZV2TestJSON-936327745-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:46.648505 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4ca1c7a2-c24f-4567-8209-f3db229310a7 tempest-AZV2TestJSON-936327745 tempest-AZV2TestJSON-936327745-project] 10.222.0.79 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.161199 Oct 17 13:43:46.655381 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1217/2425] 10.222.0.79 () {58 vars in 1164 bytes} [Mon Oct 17 13:43:46 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:43:46.712454 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d5e97fcf-86f8-494a-9978-03db30dde6c7 tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-868689207", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": "none"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:46.788657 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-d5e97fcf-86f8-494a-9978-03db30dde6c7 tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:43:46.789728 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-d5e97fcf-86f8-494a-9978-03db30dde6c7 tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:43:46.790340 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-d5e97fcf-86f8-494a-9978-03db30dde6c7 tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:43:46.790955 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-d5e97fcf-86f8-494a-9978-03db30dde6c7 tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:43:46.791582 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-d5e97fcf-86f8-494a-9978-03db30dde6c7 tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:43:46.808870 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d5e97fcf-86f8-494a-9978-03db30dde6c7 tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:46.809615 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d5e97fcf-86f8-494a-9978-03db30dde6c7 tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:46.810456 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d5e97fcf-86f8-494a-9978-03db30dde6c7 tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:46.811310 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d5e97fcf-86f8-494a-9978-03db30dde6c7 tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:46.811655 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d5e97fcf-86f8-494a-9978-03db30dde6c7 tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:46.812109 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d5e97fcf-86f8-494a-9978-03db30dde6c7 tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:46.833242 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-d5e97fcf-86f8-494a-9978-03db30dde6c7 tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Getting quotas for project 79e12f6919cf49a981e1d1cf1c23a82c. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:43:46.849868 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-d5e97fcf-86f8-494a-9978-03db30dde6c7 tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Getting quotas for user 0c1d8f4ce88d4164bc5bce8399191760 and project 79e12f6919cf49a981e1d1cf1c23a82c. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:43:46.870754 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d5e97fcf-86f8-494a-9978-03db30dde6c7 tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:43:46.874657 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d5e97fcf-86f8-494a-9978-03db30dde6c7 tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] [instance: 056bdfdb-6fb3-4ccc-ba80-cbae9524f2c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:43:46.886739 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-fbcfe80c-1cc3-4ff2-8a4b-46a88abe56ba tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467250951f654e33b3e233868301bbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676987e95424497c94984347dd6a7988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:46.900355 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-fbcfe80c-1cc3-4ff2-8a4b-46a88abe56ba tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4" status: 200 len: 1332 microversion: 2.1 time: 0.443659 Oct 17 13:43:46.912518 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1209/2426] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:46 2022] GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4 => generated 1332 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:46.919328 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c6d5c2ae-0523-4fa2-8bf3-1891bb634816 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '.version_select at 0x7f7cd98b8dc0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:46.935320 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d5e97fcf-86f8-494a-9978-03db30dde6c7 tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.284678 Oct 17 13:43:46.942888 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1218/2427] 10.222.0.79 () {62 vars in 1188 bytes} [Mon Oct 17 13:43:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 293 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 13:43:46.948936 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-90e5efae-c89b-498c-a5b2-9e1c5327b60a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:46.949695 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-90e5efae-c89b-498c-a5b2-9e1c5327b60a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: b1b0d02c-b32f-45cd-8732-99b1e3119ca6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:46.956800 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-90e5efae-c89b-498c-a5b2-9e1c5327b60a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:46.957418 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-90e5efae-c89b-498c-a5b2-9e1c5327b60a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:46.958056 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-90e5efae-c89b-498c-a5b2-9e1c5327b60a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:46.958832 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-90e5efae-c89b-498c-a5b2-9e1c5327b60a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:46.959460 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-90e5efae-c89b-498c-a5b2-9e1c5327b60a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:46.960086 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-90e5efae-c89b-498c-a5b2-9e1c5327b60a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:46.966640 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c6d5c2ae-0523-4fa2-8bf3-1891bb634816 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "GET /compute/v2.1/images/49da5263-076c-4bed-b977-116e50ef3ee9" status: 200 len: 1421 microversion: 2.1 time: 0.063945 Oct 17 13:43:46.967403 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1210/2428] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:43:46 2022] GET /compute/v2.1/images/49da5263-076c-4bed-b977-116e50ef3ee9 => generated 1421 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:46.979715 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-99dd1837-282c-48ba-bed1-aa3448e0c732 tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:46.980310 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-99dd1837-282c-48ba-bed1-aa3448e0c732 tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] [instance: 056bdfdb-6fb3-4ccc-ba80-cbae9524f2c3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:47.266783 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-99dd1837-282c-48ba-bed1-aa3448e0c732 tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1d8f4ce88d4164bc5bce8399191760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e12f6919cf49a981e1d1cf1c23a82c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:47.288630 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-99dd1837-282c-48ba-bed1-aa3448e0c732 tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c1d8f4ce88d4164bc5bce8399191760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e12f6919cf49a981e1d1cf1c23a82c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:47.290460 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-99dd1837-282c-48ba-bed1-aa3448e0c732 tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c1d8f4ce88d4164bc5bce8399191760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e12f6919cf49a981e1d1cf1c23a82c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:47.293112 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-99dd1837-282c-48ba-bed1-aa3448e0c732 tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] 10.222.0.79 "GET /compute/v2.1/servers/056bdfdb-6fb3-4ccc-ba80-cbae9524f2c3" status: 200 len: 1280 microversion: 2.47 time: 0.317309 Oct 17 13:43:47.294653 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1211/2429] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:46 2022] GET /compute/v2.1/servers/056bdfdb-6fb3-4ccc-ba80-cbae9524f2c3 => generated 1280 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:43:47.312711 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-abffb84a-2379-4245-8f93-4d295aabbbc1 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:47.313945 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-abffb84a-2379-4245-8f93-4d295aabbbc1 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:47.321813 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-abffb84a-2379-4245-8f93-4d295aabbbc1 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:47.322303 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-abffb84a-2379-4245-8f93-4d295aabbbc1 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:47.322756 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-abffb84a-2379-4245-8f93-4d295aabbbc1 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:47.323467 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-abffb84a-2379-4245-8f93-4d295aabbbc1 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:47.323898 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-abffb84a-2379-4245-8f93-4d295aabbbc1 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:47.324370 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-abffb84a-2379-4245-8f93-4d295aabbbc1 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:47.543616 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-90e5efae-c89b-498c-a5b2-9e1c5327b60a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:47.560404 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-90e5efae-c89b-498c-a5b2-9e1c5327b60a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:47.567191 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-90e5efae-c89b-498c-a5b2-9e1c5327b60a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:47.570220 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-90e5efae-c89b-498c-a5b2-9e1c5327b60a tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6" status: 200 len: 1488 microversion: 2.25 time: 0.625453 Oct 17 13:43:47.571419 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1219/2430] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:46 2022] GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6 => generated 1488 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:43:47.719349 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-abffb84a-2379-4245-8f93-4d295aabbbc1 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:47.729638 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-abffb84a-2379-4245-8f93-4d295aabbbc1 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1317 microversion: 2.1 time: 0.433127 Oct 17 13:43:47.730796 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1212/2431] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:47 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1317 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:47.938341 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6f70cbcf-49a2-47be-9419-2b4cae31b430 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:47.939071 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6f70cbcf-49a2-47be-9419-2b4cae31b430 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: e555208e-39b0-4361-94a5-6b272c336be4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:47.949338 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6f70cbcf-49a2-47be-9419-2b4cae31b430 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:47.950503 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6f70cbcf-49a2-47be-9419-2b4cae31b430 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:47.951155 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6f70cbcf-49a2-47be-9419-2b4cae31b430 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:47.952055 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6f70cbcf-49a2-47be-9419-2b4cae31b430 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:47.952756 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6f70cbcf-49a2-47be-9419-2b4cae31b430 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:47.953685 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6f70cbcf-49a2-47be-9419-2b4cae31b430 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:47.984718 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-65a65789-59f6-4223-9b34-5f684ecefce0 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '.version_select at 0x7f7cd55480d0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:48.044853 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-65a65789-59f6-4223-9b34-5f684ecefce0 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "GET /compute/v2.1/images/49da5263-076c-4bed-b977-116e50ef3ee9" status: 200 len: 1421 microversion: 2.1 time: 0.066500 Oct 17 13:43:48.046468 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1213/2432] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:43:47 2022] GET /compute/v2.1/images/49da5263-076c-4bed-b977-116e50ef3ee9 => generated 1421 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:48.322526 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-60687bac-b41b-43bb-8ba5-25a869925aba tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:48.323264 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-60687bac-b41b-43bb-8ba5-25a869925aba tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] [instance: 056bdfdb-6fb3-4ccc-ba80-cbae9524f2c3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:48.336165 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-60687bac-b41b-43bb-8ba5-25a869925aba tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:48.347284 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-60687bac-b41b-43bb-8ba5-25a869925aba tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:48.347930 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-60687bac-b41b-43bb-8ba5-25a869925aba tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:48.348985 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-60687bac-b41b-43bb-8ba5-25a869925aba tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:48.349868 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-60687bac-b41b-43bb-8ba5-25a869925aba tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:48.350454 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-60687bac-b41b-43bb-8ba5-25a869925aba tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:48.473073 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6f70cbcf-49a2-47be-9419-2b4cae31b430 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467250951f654e33b3e233868301bbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676987e95424497c94984347dd6a7988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:48.486058 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6f70cbcf-49a2-47be-9419-2b4cae31b430 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4" status: 200 len: 1332 microversion: 2.1 time: 0.562755 Oct 17 13:43:48.487260 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1220/2433] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:47 2022] GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4 => generated 1332 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:48.598145 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c4ca9049-abc7-4b3a-961f-8292c04835f4 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:48.600265 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c4ca9049-abc7-4b3a-961f-8292c04835f4 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: b1b0d02c-b32f-45cd-8732-99b1e3119ca6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:48.607772 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c4ca9049-abc7-4b3a-961f-8292c04835f4 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:48.608501 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c4ca9049-abc7-4b3a-961f-8292c04835f4 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:48.609098 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c4ca9049-abc7-4b3a-961f-8292c04835f4 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:48.609956 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c4ca9049-abc7-4b3a-961f-8292c04835f4 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:48.610581 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c4ca9049-abc7-4b3a-961f-8292c04835f4 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:48.611152 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c4ca9049-abc7-4b3a-961f-8292c04835f4 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:48.979560 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-60687bac-b41b-43bb-8ba5-25a869925aba tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1d8f4ce88d4164bc5bce8399191760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e12f6919cf49a981e1d1cf1c23a82c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:48.991871 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-60687bac-b41b-43bb-8ba5-25a869925aba tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c1d8f4ce88d4164bc5bce8399191760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e12f6919cf49a981e1d1cf1c23a82c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:48.995012 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-60687bac-b41b-43bb-8ba5-25a869925aba tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c1d8f4ce88d4164bc5bce8399191760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e12f6919cf49a981e1d1cf1c23a82c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:49.000519 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-60687bac-b41b-43bb-8ba5-25a869925aba tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] 10.222.0.79 "GET /compute/v2.1/servers/056bdfdb-6fb3-4ccc-ba80-cbae9524f2c3" status: 200 len: 1332 microversion: 2.47 time: 0.680802 Oct 17 13:43:49.002205 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1214/2434] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:48 2022] GET /compute/v2.1/servers/056bdfdb-6fb3-4ccc-ba80-cbae9524f2c3 => generated 1332 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:43:49.012627 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7cb84783-7630-475a-bad8-daa6de6547f2 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:49.013248 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7cb84783-7630-475a-bad8-daa6de6547f2 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:49.032998 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7cb84783-7630-475a-bad8-daa6de6547f2 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:49.033507 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7cb84783-7630-475a-bad8-daa6de6547f2 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:49.033942 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7cb84783-7630-475a-bad8-daa6de6547f2 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:49.035432 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7cb84783-7630-475a-bad8-daa6de6547f2 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:49.035893 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7cb84783-7630-475a-bad8-daa6de6547f2 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:49.036352 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7cb84783-7630-475a-bad8-daa6de6547f2 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:49.349780 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c4ca9049-abc7-4b3a-961f-8292c04835f4 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:49.362520 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c4ca9049-abc7-4b3a-961f-8292c04835f4 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:49.364345 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c4ca9049-abc7-4b3a-961f-8292c04835f4 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:49.366106 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c4ca9049-abc7-4b3a-961f-8292c04835f4 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6" status: 200 len: 1488 microversion: 2.25 time: 0.772090 Oct 17 13:43:49.382813 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1221/2435] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:48 2022] GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6 => generated 1488 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:43:49.396738 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-433b64b4-4d1a-4087-87cc-ae3db9b9a71e tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '.version_select at 0x7f7cd4636d30>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:49.488198 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-433b64b4-4d1a-4087-87cc-ae3db9b9a71e tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "GET /compute/v2.1/images/49da5263-076c-4bed-b977-116e50ef3ee9" status: 200 len: 1421 microversion: 2.1 time: 0.103403 Oct 17 13:43:49.499574 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1222/2436] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:43:49 2022] GET /compute/v2.1/images/49da5263-076c-4bed-b977-116e50ef3ee9 => generated 1421 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:49.515083 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-dd280ec8-9452-417f-af16-589d82e9073b tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:49.515967 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-dd280ec8-9452-417f-af16-589d82e9073b tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: e555208e-39b0-4361-94a5-6b272c336be4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:49.526954 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dd280ec8-9452-417f-af16-589d82e9073b tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:49.527987 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dd280ec8-9452-417f-af16-589d82e9073b tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:49.528818 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dd280ec8-9452-417f-af16-589d82e9073b tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:49.531059 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dd280ec8-9452-417f-af16-589d82e9073b tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:49.532723 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dd280ec8-9452-417f-af16-589d82e9073b tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:49.533300 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dd280ec8-9452-417f-af16-589d82e9073b tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:49.634606 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7cb84783-7630-475a-bad8-daa6de6547f2 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:49.650324 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7cb84783-7630-475a-bad8-daa6de6547f2 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1317 microversion: 2.1 time: 0.646175 Oct 17 13:43:49.671074 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1215/2437] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:49 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1317 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:50.028161 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7d3228c7-2048-412d-8ebc-079984088212 tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:50.029304 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7d3228c7-2048-412d-8ebc-079984088212 tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] [instance: 056bdfdb-6fb3-4ccc-ba80-cbae9524f2c3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:50.038210 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-dd280ec8-9452-417f-af16-589d82e9073b tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467250951f654e33b3e233868301bbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676987e95424497c94984347dd6a7988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:50.046102 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:43:50.048055 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7d3228c7-2048-412d-8ebc-079984088212 tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:50.051085 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7d3228c7-2048-412d-8ebc-079984088212 tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:50.051609 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7d3228c7-2048-412d-8ebc-079984088212 tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:50.052456 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-dd280ec8-9452-417f-af16-589d82e9073b tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4" status: 200 len: 1353 microversion: 2.1 time: 0.543617 Oct 17 13:43:50.054900 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7d3228c7-2048-412d-8ebc-079984088212 tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:50.055470 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7d3228c7-2048-412d-8ebc-079984088212 tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:50.055946 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1223/2438] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:49 2022] GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4 => generated 1353 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:50.067473 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7d3228c7-2048-412d-8ebc-079984088212 tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:50.285100 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7d3228c7-2048-412d-8ebc-079984088212 tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1d8f4ce88d4164bc5bce8399191760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e12f6919cf49a981e1d1cf1c23a82c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:50.300795 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7d3228c7-2048-412d-8ebc-079984088212 tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c1d8f4ce88d4164bc5bce8399191760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e12f6919cf49a981e1d1cf1c23a82c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:50.302437 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7d3228c7-2048-412d-8ebc-079984088212 tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c1d8f4ce88d4164bc5bce8399191760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e12f6919cf49a981e1d1cf1c23a82c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:50.304442 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7d3228c7-2048-412d-8ebc-079984088212 tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] 10.222.0.79 "GET /compute/v2.1/servers/056bdfdb-6fb3-4ccc-ba80-cbae9524f2c3" status: 200 len: 1338 microversion: 2.47 time: 0.281133 Oct 17 13:43:50.306180 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1216/2439] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:50 2022] GET /compute/v2.1/servers/056bdfdb-6fb3-4ccc-ba80-cbae9524f2c3 => generated 1338 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:43:50.401756 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7ba69586-183f-4e4f-b0f7-8b00f917f506 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:50.402869 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7ba69586-183f-4e4f-b0f7-8b00f917f506 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: b1b0d02c-b32f-45cd-8732-99b1e3119ca6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:50.427389 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7ba69586-183f-4e4f-b0f7-8b00f917f506 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:50.428379 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7ba69586-183f-4e4f-b0f7-8b00f917f506 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:50.430148 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7ba69586-183f-4e4f-b0f7-8b00f917f506 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:50.432210 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7ba69586-183f-4e4f-b0f7-8b00f917f506 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:50.433971 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7ba69586-183f-4e4f-b0f7-8b00f917f506 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:50.434602 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7ba69586-183f-4e4f-b0f7-8b00f917f506 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:50.504201 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-29204f58-935e-4851-a8f1-de937e0b5ea3 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '.version_select at 0x7f7cd5536550>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:50.578747 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-29204f58-935e-4851-a8f1-de937e0b5ea3 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "GET /compute/v2.1/images/49da5263-076c-4bed-b977-116e50ef3ee9" status: 200 len: 1421 microversion: 2.1 time: 0.078321 Oct 17 13:43:50.579710 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1217/2440] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:43:50 2022] GET /compute/v2.1/images/49da5263-076c-4bed-b977-116e50ef3ee9 => generated 1421 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:50.680425 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4f7f9339-7cb5-46e7-ac7b-a108b3e0a931 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:50.681204 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4f7f9339-7cb5-46e7-ac7b-a108b3e0a931 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:50.695876 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4f7f9339-7cb5-46e7-ac7b-a108b3e0a931 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:50.697617 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4f7f9339-7cb5-46e7-ac7b-a108b3e0a931 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:50.700857 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4f7f9339-7cb5-46e7-ac7b-a108b3e0a931 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:50.701693 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4f7f9339-7cb5-46e7-ac7b-a108b3e0a931 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:50.702332 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4f7f9339-7cb5-46e7-ac7b-a108b3e0a931 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:50.704385 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4f7f9339-7cb5-46e7-ac7b-a108b3e0a931 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:51.019630 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7ba69586-183f-4e4f-b0f7-8b00f917f506 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:51.038064 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7ba69586-183f-4e4f-b0f7-8b00f917f506 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:51.040127 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7ba69586-183f-4e4f-b0f7-8b00f917f506 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:51.044839 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7ba69586-183f-4e4f-b0f7-8b00f917f506 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6" status: 200 len: 1488 microversion: 2.25 time: 0.647900 Oct 17 13:43:51.048074 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1224/2441] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:50 2022] GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6 => generated 1488 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:43:51.053749 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4f7f9339-7cb5-46e7-ac7b-a108b3e0a931 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:51.064103 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4f7f9339-7cb5-46e7-ac7b-a108b3e0a931 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1317 microversion: 2.1 time: 0.389889 Oct 17 13:43:51.075574 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1218/2442] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:50 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1317 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:51.076127 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-3c5743e8-edf7-4964-95d0-ec61528ca4a6 req-9344382c-893a-4088-9400-39764987d15d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87114af9-1214-4182-8f68-756a1a5dfc7a", "name": "network-vif-plugged", "status": "completed", "tag": "cde412a7-8204-4c39-8f24-2d2a36d636f9"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:51.109081 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0f8d549d-9de4-41fe-aaf6-7986b122676c tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:51.113967 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0f8d549d-9de4-41fe-aaf6-7986b122676c tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: e555208e-39b0-4361-94a5-6b272c336be4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:51.138275 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-3c5743e8-edf7-4964-95d0-ec61528ca4a6 req-9344382c-893a-4088-9400-39764987d15d service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:51.141754 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-3c5743e8-edf7-4964-95d0-ec61528ca4a6 req-9344382c-893a-4088-9400-39764987d15d service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:51.143124 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-3c5743e8-edf7-4964-95d0-ec61528ca4a6 req-9344382c-893a-4088-9400-39764987d15d service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:51.144405 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0f8d549d-9de4-41fe-aaf6-7986b122676c tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:51.146828 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0f8d549d-9de4-41fe-aaf6-7986b122676c tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:51.148783 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0f8d549d-9de4-41fe-aaf6-7986b122676c tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:51.152707 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0f8d549d-9de4-41fe-aaf6-7986b122676c tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:51.155042 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0f8d549d-9de4-41fe-aaf6-7986b122676c tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:51.155610 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0f8d549d-9de4-41fe-aaf6-7986b122676c tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:51.188057 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-3c5743e8-edf7-4964-95d0-ec61528ca4a6 req-9344382c-893a-4088-9400-39764987d15d service nova] Creating event network-vif-plugged:cde412a7-8204-4c39-8f24-2d2a36d636f9 for instance 87114af9-1214-4182-8f68-756a1a5dfc7a on n-h2-854247-14 Oct 17 13:43:51.199592 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-3c5743e8-edf7-4964-95d0-ec61528ca4a6 req-9344382c-893a-4088-9400-39764987d15d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149101 Oct 17 13:43:51.204452 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1225/2443] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:43:51.338049 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-12c55bd9-ebd7-486e-8acc-9f7733f4272d tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:51.339322 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-12c55bd9-ebd7-486e-8acc-9f7733f4272d tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] [instance: 056bdfdb-6fb3-4ccc-ba80-cbae9524f2c3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:51.357548 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-12c55bd9-ebd7-486e-8acc-9f7733f4272d tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:51.359861 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-12c55bd9-ebd7-486e-8acc-9f7733f4272d tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:51.363127 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-12c55bd9-ebd7-486e-8acc-9f7733f4272d tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:51.368056 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-12c55bd9-ebd7-486e-8acc-9f7733f4272d tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:51.368924 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-12c55bd9-ebd7-486e-8acc-9f7733f4272d tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:51.369574 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-12c55bd9-ebd7-486e-8acc-9f7733f4272d tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:51.708016 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-12c55bd9-ebd7-486e-8acc-9f7733f4272d tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1d8f4ce88d4164bc5bce8399191760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e12f6919cf49a981e1d1cf1c23a82c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:51.726573 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-12c55bd9-ebd7-486e-8acc-9f7733f4272d tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c1d8f4ce88d4164bc5bce8399191760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e12f6919cf49a981e1d1cf1c23a82c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:51.735614 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-12c55bd9-ebd7-486e-8acc-9f7733f4272d tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c1d8f4ce88d4164bc5bce8399191760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e12f6919cf49a981e1d1cf1c23a82c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:51.742155 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-12c55bd9-ebd7-486e-8acc-9f7733f4272d tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] 10.222.0.79 "GET /compute/v2.1/servers/056bdfdb-6fb3-4ccc-ba80-cbae9524f2c3" status: 200 len: 1359 microversion: 2.47 time: 0.403945 Oct 17 13:43:51.742816 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1226/2444] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:51 2022] GET /compute/v2.1/servers/056bdfdb-6fb3-4ccc-ba80-cbae9524f2c3 => generated 1359 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:43:51.761320 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b449cf1a-de46-4524-833f-0391fefc4a61 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '.version_select at 0x7f7cd46e6d30>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:51.792411 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0f8d549d-9de4-41fe-aaf6-7986b122676c tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467250951f654e33b3e233868301bbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676987e95424497c94984347dd6a7988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:51.825962 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0f8d549d-9de4-41fe-aaf6-7986b122676c tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4" status: 200 len: 1353 microversion: 2.1 time: 0.720292 Oct 17 13:43:51.842143 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1219/2445] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:51 2022] GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4 => generated 1353 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:51.896999 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-56422dab-59ad-44b4-9d5a-e0788f585b5f tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-381627083"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:51.916220 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-56422dab-59ad-44b4-9d5a-e0788f585b5f tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] [instance: 056bdfdb-6fb3-4ccc-ba80-cbae9524f2c3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:51.961593 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-56422dab-59ad-44b4-9d5a-e0788f585b5f tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:51.962111 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-56422dab-59ad-44b4-9d5a-e0788f585b5f tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:51.962560 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-56422dab-59ad-44b4-9d5a-e0788f585b5f tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:51.963485 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-56422dab-59ad-44b4-9d5a-e0788f585b5f tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:51.978031 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-56422dab-59ad-44b4-9d5a-e0788f585b5f tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:51.978700 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-56422dab-59ad-44b4-9d5a-e0788f585b5f tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:51.991308 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b449cf1a-de46-4524-833f-0391fefc4a61 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "GET /compute/v2.1/images/49da5263-076c-4bed-b977-116e50ef3ee9" status: 200 len: 1421 microversion: 2.1 time: 0.243977 Oct 17 13:43:51.992968 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1227/2446] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:43:51 2022] GET /compute/v2.1/images/49da5263-076c-4bed-b977-116e50ef3ee9 => generated 1421 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:52.348933 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-3e21467f-9b9f-4ab0-bf88-5a801a3482a1 req-ad658284-60e2-485b-b12f-90a7abd29a82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e555208e-39b0-4361-94a5-6b272c336be4", "tag": "dde3317b-4b55-489e-8fdb-a5cb0e8852af"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:52.387613 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-3e21467f-9b9f-4ab0-bf88-5a801a3482a1 req-ad658284-60e2-485b-b12f-90a7abd29a82 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:52.389255 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-3e21467f-9b9f-4ab0-bf88-5a801a3482a1 req-ad658284-60e2-485b-b12f-90a7abd29a82 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:52.393496 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-3e21467f-9b9f-4ab0-bf88-5a801a3482a1 req-ad658284-60e2-485b-b12f-90a7abd29a82 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:52.452121 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-3e21467f-9b9f-4ab0-bf88-5a801a3482a1 req-ad658284-60e2-485b-b12f-90a7abd29a82 service nova] Creating event network-changed:dde3317b-4b55-489e-8fdb-a5cb0e8852af for instance e555208e-39b0-4361-94a5-6b272c336be4 on n-h2-854247-14 Oct 17 13:43:52.478197 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-3e21467f-9b9f-4ab0-bf88-5a801a3482a1 req-ad658284-60e2-485b-b12f-90a7abd29a82 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.483627 Oct 17 13:43:52.484314 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1228/2447] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:43:52.503823 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3d67ee83-c726-41a0-8430-de6fc495a090 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:52.507632 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3d67ee83-c726-41a0-8430-de6fc495a090 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: b1b0d02c-b32f-45cd-8732-99b1e3119ca6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:52.547048 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3d67ee83-c726-41a0-8430-de6fc495a090 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:52.551546 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3d67ee83-c726-41a0-8430-de6fc495a090 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:52.553527 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3d67ee83-c726-41a0-8430-de6fc495a090 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:52.554339 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3d67ee83-c726-41a0-8430-de6fc495a090 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:52.558682 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3d67ee83-c726-41a0-8430-de6fc495a090 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:52.559775 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3d67ee83-c726-41a0-8430-de6fc495a090 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:52.734989 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-56422dab-59ad-44b4-9d5a-e0788f585b5f tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] 10.222.0.79 "POST /compute/v2.1/servers/056bdfdb-6fb3-4ccc-ba80-cbae9524f2c3/action" status: 202 len: 52 microversion: 2.47 time: 0.879210 Oct 17 13:43:52.743836 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1220/2448] 10.222.0.79 () {62 vars in 1319 bytes} [Mon Oct 17 13:43:51 2022] POST /compute/v2.1/servers/056bdfdb-6fb3-4ccc-ba80-cbae9524f2c3/action => generated 52 bytes in 892 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Oct 17 13:43:52.768779 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8c8830fd-5f05-4f6d-9e86-b152a3df724e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:52.775137 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8c8830fd-5f05-4f6d-9e86-b152a3df724e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:52.803012 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8c8830fd-5f05-4f6d-9e86-b152a3df724e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:52.803583 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8c8830fd-5f05-4f6d-9e86-b152a3df724e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:52.804016 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8c8830fd-5f05-4f6d-9e86-b152a3df724e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:52.804744 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8c8830fd-5f05-4f6d-9e86-b152a3df724e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:52.807667 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8c8830fd-5f05-4f6d-9e86-b152a3df724e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:52.808778 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8c8830fd-5f05-4f6d-9e86-b152a3df724e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:53.241447 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8c8830fd-5f05-4f6d-9e86-b152a3df724e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:53.250839 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8c8830fd-5f05-4f6d-9e86-b152a3df724e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1317 microversion: 2.1 time: 0.503927 Oct 17 13:43:53.256980 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1221/2449] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:52 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1317 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:53.263521 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0e3bd003-6159-4477-b7e4-90ba744c993f tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:53.268460 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0e3bd003-6159-4477-b7e4-90ba744c993f tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] [instance: 056bdfdb-6fb3-4ccc-ba80-cbae9524f2c3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:53.290282 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0e3bd003-6159-4477-b7e4-90ba744c993f tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:53.293421 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0e3bd003-6159-4477-b7e4-90ba744c993f tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:53.295683 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0e3bd003-6159-4477-b7e4-90ba744c993f tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:53.296643 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0e3bd003-6159-4477-b7e4-90ba744c993f tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:53.298715 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0e3bd003-6159-4477-b7e4-90ba744c993f tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:53.301564 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0e3bd003-6159-4477-b7e4-90ba744c993f tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:53.358418 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0e3bd003-6159-4477-b7e4-90ba744c993f tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] [instance: 056bdfdb-6fb3-4ccc-ba80-cbae9524f2c3] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:43:53.469484 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3d67ee83-c726-41a0-8430-de6fc495a090 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:53.480438 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3d67ee83-c726-41a0-8430-de6fc495a090 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:53.493770 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3d67ee83-c726-41a0-8430-de6fc495a090 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:53.497995 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3d67ee83-c726-41a0-8430-de6fc495a090 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6" status: 200 len: 1488 microversion: 2.25 time: 1.011377 Oct 17 13:43:53.515631 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1229/2450] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:52 2022] GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6 => generated 1488 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:43:53.535334 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0e3bd003-6159-4477-b7e4-90ba744c993f tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] 10.222.0.79 "DELETE /compute/v2.1/servers/056bdfdb-6fb3-4ccc-ba80-cbae9524f2c3" status: 204 len: 0 microversion: 2.47 time: 0.276482 Oct 17 13:43:53.540921 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1222/2451] 10.222.0.79 () {60 vars in 1280 bytes} [Mon Oct 17 13:43:53 2022] DELETE /compute/v2.1/servers/056bdfdb-6fb3-4ccc-ba80-cbae9524f2c3 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:43:53.545739 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-eb2244cb-2fed-48c3-bc1b-6b074fd34d63 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:53.546411 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-eb2244cb-2fed-48c3-bc1b-6b074fd34d63 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: e555208e-39b0-4361-94a5-6b272c336be4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:53.549572 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-808494f4-3e7b-4260-814d-03b95e44317c tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '.version_select at 0x7f7cd556b550>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:53.560278 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:43:53.565060 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eb2244cb-2fed-48c3-bc1b-6b074fd34d63 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:53.567684 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eb2244cb-2fed-48c3-bc1b-6b074fd34d63 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:53.568279 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eb2244cb-2fed-48c3-bc1b-6b074fd34d63 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:53.571654 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eb2244cb-2fed-48c3-bc1b-6b074fd34d63 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:53.572316 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eb2244cb-2fed-48c3-bc1b-6b074fd34d63 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:53.573226 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eb2244cb-2fed-48c3-bc1b-6b074fd34d63 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:53.690325 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-808494f4-3e7b-4260-814d-03b95e44317c tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "GET /compute/v2.1/images/49da5263-076c-4bed-b977-116e50ef3ee9" status: 200 len: 1421 microversion: 2.1 time: 0.147316 Oct 17 13:43:53.695763 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1223/2452] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:43:53 2022] GET /compute/v2.1/images/49da5263-076c-4bed-b977-116e50ef3ee9 => generated 1421 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:53.707861 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a5b03fd6-c22a-41e1-95ac-bf30a63b65c7 tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:53.713051 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a5b03fd6-c22a-41e1-95ac-bf30a63b65c7 tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] [instance: 056bdfdb-6fb3-4ccc-ba80-cbae9524f2c3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:53.731059 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a5b03fd6-c22a-41e1-95ac-bf30a63b65c7 tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:53.733254 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a5b03fd6-c22a-41e1-95ac-bf30a63b65c7 tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:53.733732 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a5b03fd6-c22a-41e1-95ac-bf30a63b65c7 tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:53.736361 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a5b03fd6-c22a-41e1-95ac-bf30a63b65c7 tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:53.737977 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a5b03fd6-c22a-41e1-95ac-bf30a63b65c7 tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:53.738432 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a5b03fd6-c22a-41e1-95ac-bf30a63b65c7 tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:54.243786 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a5b03fd6-c22a-41e1-95ac-bf30a63b65c7 tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1d8f4ce88d4164bc5bce8399191760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e12f6919cf49a981e1d1cf1c23a82c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:54.272779 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a5b03fd6-c22a-41e1-95ac-bf30a63b65c7 tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c1d8f4ce88d4164bc5bce8399191760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e12f6919cf49a981e1d1cf1c23a82c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:54.280495 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a5b03fd6-c22a-41e1-95ac-bf30a63b65c7 tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c1d8f4ce88d4164bc5bce8399191760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e12f6919cf49a981e1d1cf1c23a82c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:54.284043 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a5b03fd6-c22a-41e1-95ac-bf30a63b65c7 tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] 10.222.0.79 "GET /compute/v2.1/servers/056bdfdb-6fb3-4ccc-ba80-cbae9524f2c3" status: 200 len: 1365 microversion: 2.47 time: 0.584093 Oct 17 13:43:54.285459 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1224/2453] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:53 2022] GET /compute/v2.1/servers/056bdfdb-6fb3-4ccc-ba80-cbae9524f2c3 => generated 1365 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:43:54.293237 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-66f6d6e9-aa5a-4472-977b-b5a7e097e211 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:54.297669 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-66f6d6e9-aa5a-4472-977b-b5a7e097e211 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:54.310367 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-66f6d6e9-aa5a-4472-977b-b5a7e097e211 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:54.311130 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-66f6d6e9-aa5a-4472-977b-b5a7e097e211 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:54.311992 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-66f6d6e9-aa5a-4472-977b-b5a7e097e211 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:54.344578 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-66f6d6e9-aa5a-4472-977b-b5a7e097e211 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:54.346164 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-66f6d6e9-aa5a-4472-977b-b5a7e097e211 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:54.346648 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-66f6d6e9-aa5a-4472-977b-b5a7e097e211 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:54.367496 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:43:54.593247 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-eb2244cb-2fed-48c3-bc1b-6b074fd34d63 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467250951f654e33b3e233868301bbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676987e95424497c94984347dd6a7988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:54.605856 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-eb2244cb-2fed-48c3-bc1b-6b074fd34d63 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4" status: 200 len: 1353 microversion: 2.1 time: 1.085732 Oct 17 13:43:54.608456 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1230/2454] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:53 2022] GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4 => generated 1353 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:54.617418 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-30ab4107-b51d-491e-8ac4-c5058acfd892 req-2b79e2b7-98f4-4d2e-bb4a-0fd286530a16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ef00d34-7f81-4649-a90a-a52cf78dbeca", "name": "network-vif-plugged", "status": "completed", "tag": "841d5cd2-6ca1-435c-ac29-bfeee122d7fe"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:54.660387 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-30ab4107-b51d-491e-8ac4-c5058acfd892 req-2b79e2b7-98f4-4d2e-bb4a-0fd286530a16 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:54.661190 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-30ab4107-b51d-491e-8ac4-c5058acfd892 req-2b79e2b7-98f4-4d2e-bb4a-0fd286530a16 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:54.662337 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-30ab4107-b51d-491e-8ac4-c5058acfd892 req-2b79e2b7-98f4-4d2e-bb4a-0fd286530a16 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:54.698552 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-30ab4107-b51d-491e-8ac4-c5058acfd892 req-2b79e2b7-98f4-4d2e-bb4a-0fd286530a16 service nova] Creating event network-vif-plugged:841d5cd2-6ca1-435c-ac29-bfeee122d7fe for instance 5ef00d34-7f81-4649-a90a-a52cf78dbeca on n-h1-854247-14 Oct 17 13:43:54.719973 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-30ab4107-b51d-491e-8ac4-c5058acfd892 req-2b79e2b7-98f4-4d2e-bb4a-0fd286530a16 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108859 Oct 17 13:43:54.722470 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1231/2455] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:43:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:43:54.738505 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-64a321b5-297c-4155-94ff-445cbc0323c4 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:54.740761 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-64a321b5-297c-4155-94ff-445cbc0323c4 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: b1b0d02c-b32f-45cd-8732-99b1e3119ca6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:54.760405 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-64a321b5-297c-4155-94ff-445cbc0323c4 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:54.760905 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-64a321b5-297c-4155-94ff-445cbc0323c4 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:54.761345 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-64a321b5-297c-4155-94ff-445cbc0323c4 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:54.762104 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-64a321b5-297c-4155-94ff-445cbc0323c4 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:54.766343 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-64a321b5-297c-4155-94ff-445cbc0323c4 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:54.766935 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-64a321b5-297c-4155-94ff-445cbc0323c4 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:55.021215 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-66f6d6e9-aa5a-4472-977b-b5a7e097e211 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:55.029331 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-66f6d6e9-aa5a-4472-977b-b5a7e097e211 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1317 microversion: 2.1 time: 0.742450 Oct 17 13:43:55.039689 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1225/2456] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:54 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1317 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:55.045001 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3929851d-88d4-4cb1-aadd-7c39fde0ce5f tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '.version_select at 0x7f7cd5536ca0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:55.175610 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3929851d-88d4-4cb1-aadd-7c39fde0ce5f tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "GET /compute/v2.1/images/49da5263-076c-4bed-b977-116e50ef3ee9" status: 200 len: 1421 microversion: 2.1 time: 0.134310 Oct 17 13:43:55.176587 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1226/2457] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:43:55 2022] GET /compute/v2.1/images/49da5263-076c-4bed-b977-116e50ef3ee9 => generated 1421 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:55.315254 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-73fb1a15-8160-4f1c-93d8-524906250760 tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:55.317109 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-73fb1a15-8160-4f1c-93d8-524906250760 tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] [instance: 056bdfdb-6fb3-4ccc-ba80-cbae9524f2c3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:55.326051 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-73fb1a15-8160-4f1c-93d8-524906250760 tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:55.333851 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-73fb1a15-8160-4f1c-93d8-524906250760 tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:55.334305 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-73fb1a15-8160-4f1c-93d8-524906250760 tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:55.335047 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-73fb1a15-8160-4f1c-93d8-524906250760 tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:55.335541 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-73fb1a15-8160-4f1c-93d8-524906250760 tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:55.336102 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-73fb1a15-8160-4f1c-93d8-524906250760 tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:55.817149 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-64a321b5-297c-4155-94ff-445cbc0323c4 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:55.838390 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-64a321b5-297c-4155-94ff-445cbc0323c4 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:55.848819 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-64a321b5-297c-4155-94ff-445cbc0323c4 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:55.850285 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-64a321b5-297c-4155-94ff-445cbc0323c4 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6" status: 200 len: 1488 microversion: 2.25 time: 1.125106 Oct 17 13:43:55.853716 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1232/2458] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:54 2022] GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6 => generated 1488 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:43:55.873578 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a5718f18-5f6c-42c2-a793-452b6f45646a tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:55.874425 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a5718f18-5f6c-42c2-a793-452b6f45646a tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: e555208e-39b0-4361-94a5-6b272c336be4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:55.889005 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a5718f18-5f6c-42c2-a793-452b6f45646a tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:55.897490 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a5718f18-5f6c-42c2-a793-452b6f45646a tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:55.898187 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a5718f18-5f6c-42c2-a793-452b6f45646a tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:55.899109 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a5718f18-5f6c-42c2-a793-452b6f45646a tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:55.905335 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a5718f18-5f6c-42c2-a793-452b6f45646a tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:55.906067 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a5718f18-5f6c-42c2-a793-452b6f45646a tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:56.480224 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-73fb1a15-8160-4f1c-93d8-524906250760 tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c1d8f4ce88d4164bc5bce8399191760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e12f6919cf49a981e1d1cf1c23a82c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:56.497526 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-73fb1a15-8160-4f1c-93d8-524906250760 tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0c1d8f4ce88d4164bc5bce8399191760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e12f6919cf49a981e1d1cf1c23a82c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:56.504152 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-73fb1a15-8160-4f1c-93d8-524906250760 tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0c1d8f4ce88d4164bc5bce8399191760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e12f6919cf49a981e1d1cf1c23a82c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:56.505871 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-73fb1a15-8160-4f1c-93d8-524906250760 tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] 10.222.0.79 "GET /compute/v2.1/servers/056bdfdb-6fb3-4ccc-ba80-cbae9524f2c3" status: 200 len: 1365 microversion: 2.47 time: 1.194822 Oct 17 13:43:56.511215 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1227/2459] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:55 2022] GET /compute/v2.1/servers/056bdfdb-6fb3-4ccc-ba80-cbae9524f2c3 => generated 1365 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:43:56.534222 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-4ec8af97-4401-4864-8923-075ad8db333e req-6363f994-10c2-4d21-8e6a-a6718767d681 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e555208e-39b0-4361-94a5-6b272c336be4", "tag": "7b45bf47-c253-4e30-bf75-b6963b23bf0e"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:56.573696 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-4ec8af97-4401-4864-8923-075ad8db333e req-6363f994-10c2-4d21-8e6a-a6718767d681 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:56.576951 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-4ec8af97-4401-4864-8923-075ad8db333e req-6363f994-10c2-4d21-8e6a-a6718767d681 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:56.577546 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-4ec8af97-4401-4864-8923-075ad8db333e req-6363f994-10c2-4d21-8e6a-a6718767d681 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:56.599123 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-4ec8af97-4401-4864-8923-075ad8db333e req-6363f994-10c2-4d21-8e6a-a6718767d681 service nova] Creating event network-changed:7b45bf47-c253-4e30-bf75-b6963b23bf0e for instance e555208e-39b0-4361-94a5-6b272c336be4 on n-h2-854247-14 Oct 17 13:43:56.605541 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-4ec8af97-4401-4864-8923-075ad8db333e req-6363f994-10c2-4d21-8e6a-a6718767d681 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092325 Oct 17 13:43:56.607550 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1228/2460] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:43:56.636423 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a412d777-2c07-448d-b5d6-e947f755780a tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:56.639050 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a412d777-2c07-448d-b5d6-e947f755780a tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:56.648803 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a412d777-2c07-448d-b5d6-e947f755780a tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:56.649519 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a412d777-2c07-448d-b5d6-e947f755780a tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:56.650115 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a412d777-2c07-448d-b5d6-e947f755780a tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:56.651021 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a412d777-2c07-448d-b5d6-e947f755780a tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:56.651944 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a412d777-2c07-448d-b5d6-e947f755780a tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:56.652512 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a412d777-2c07-448d-b5d6-e947f755780a tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:56.820658 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=20 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:43:56.860156 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=20 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:43:57.284381 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=4 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:43:57.324139 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a5718f18-5f6c-42c2-a793-452b6f45646a tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467250951f654e33b3e233868301bbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676987e95424497c94984347dd6a7988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:57.351584 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a5718f18-5f6c-42c2-a793-452b6f45646a tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4" status: 200 len: 1353 microversion: 2.1 time: 1.496387 Oct 17 13:43:57.359146 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1233/2461] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:55 2022] GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4 => generated 1353 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:57.383218 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a766bb2d-c55e-4461-a6f8-36240e6e0d14 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '.version_select at 0x7f7cd9863040>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:57.473114 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a766bb2d-c55e-4461-a6f8-36240e6e0d14 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "GET /compute/v2.1/images/49da5263-076c-4bed-b977-116e50ef3ee9" status: 200 len: 1421 microversion: 2.1 time: 0.109693 Oct 17 13:43:57.492075 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1234/2462] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:43:57 2022] GET /compute/v2.1/images/49da5263-076c-4bed-b977-116e50ef3ee9 => generated 1421 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:57.497769 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7f1b594f-5d87-4239-addd-1bb3fe04d1b8 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:57.502425 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7f1b594f-5d87-4239-addd-1bb3fe04d1b8 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: b1b0d02c-b32f-45cd-8732-99b1e3119ca6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:57.522185 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7f1b594f-5d87-4239-addd-1bb3fe04d1b8 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:57.522922 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7f1b594f-5d87-4239-addd-1bb3fe04d1b8 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:57.525296 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7f1b594f-5d87-4239-addd-1bb3fe04d1b8 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:57.526192 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7f1b594f-5d87-4239-addd-1bb3fe04d1b8 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:57.526831 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7f1b594f-5d87-4239-addd-1bb3fe04d1b8 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:57.531489 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7f1b594f-5d87-4239-addd-1bb3fe04d1b8 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:58.510039 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a412d777-2c07-448d-b5d6-e947f755780a tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:58.523133 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a412d777-2c07-448d-b5d6-e947f755780a tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1317 microversion: 2.1 time: 1.914045 Oct 17 13:43:58.524435 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1229/2463] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:56 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1317 bytes in 1916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:58.534066 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1cf0d67c-44bc-40c4-933d-ba6c09138b6d tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:58.538922 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1cf0d67c-44bc-40c4-933d-ba6c09138b6d tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] [instance: 056bdfdb-6fb3-4ccc-ba80-cbae9524f2c3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:58.552130 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1cf0d67c-44bc-40c4-933d-ba6c09138b6d tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:58.554127 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1cf0d67c-44bc-40c4-933d-ba6c09138b6d tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:58.554748 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1cf0d67c-44bc-40c4-933d-ba6c09138b6d tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:58.557635 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1cf0d67c-44bc-40c4-933d-ba6c09138b6d tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:58.560981 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1cf0d67c-44bc-40c4-933d-ba6c09138b6d tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:58.561623 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1cf0d67c-44bc-40c4-933d-ba6c09138b6d tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:58.604797 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-1cf0d67c-44bc-40c4-933d-ba6c09138b6d tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] HTTP exception thrown: Instance 056bdfdb-6fb3-4ccc-ba80-cbae9524f2c3 could not be found. Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1cf0d67c-44bc-40c4-933d-ba6c09138b6d tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Request method failure captured: Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/056bdfdb-6fb3-4ccc-ba80-cbae9524f2c3 HTTP/1.1 Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVwR3g5nf03gsyOH_ZQdInWmjKZX3YOOTlkky23HOVCqGAygbjui3AuOvQh4QUGWVws3bei-s30aT2ajFokmq5rml7Um0WgrfwQ0JJX2Vjoa92fFyyAxmRJyvazUPkvW_fIZl3MPEzRRjYKqfD2sxs48cIo_cyhpwxOJY6mE6UCViu0 Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: X-Openstack-Nova-Api-Version: 2.47 Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 79e12f6919cf49a981e1d1cf1c23a82c Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServersAaction247Test-387252924 Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/79e12f6919cf49a981e1d1cf1c23a82c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/79e12f6919cf49a981e1d1cf1c23a82c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/79e12f6919cf49a981e1d1cf1c23a82c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_79e12f6919cf49a981e1d1cf1c23a82c", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServersAaction247Test-387252924 Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 79e12f6919cf49a981e1d1cf1c23a82c Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServersAaction247Test-387252924 Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServersAaction247Test-387252924-project Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 0c1d8f4ce88d4164bc5bce8399191760 Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServersAaction247Test-387252924-project Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 056bdfdb-6fb3-4ccc-ba80-cbae9524f2c3 could not be found. Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '056bdfdb-6fb3-4ccc-ba80-cbae9524f2c3'} Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 056bdfdb-6fb3-4ccc-ba80-cbae9524f2c3 could not be found. Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 056bdfdb-6fb3-4ccc-ba80-cbae9524f2c3 could not be found. Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:58.611688 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:43:58.616125 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:58.616125 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:58.616125 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:58.616125 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:43:58.616125 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:43:58.616125 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 056bdfdb-6fb3-4ccc-ba80-cbae9524f2c3 could not be found. Oct 17 13:43:58.616125 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:43:58.617315 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1cf0d67c-44bc-40c4-933d-ba6c09138b6d tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] Returning 404 to user: Instance 056bdfdb-6fb3-4ccc-ba80-cbae9524f2c3 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:43:58.619000 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1cf0d67c-44bc-40c4-933d-ba6c09138b6d tempest-ServersAaction247Test-387252924 tempest-ServersAaction247Test-387252924-project] 10.222.0.79 "GET /compute/v2.1/servers/056bdfdb-6fb3-4ccc-ba80-cbae9524f2c3" status: 404 len: 111 microversion: 2.47 time: 0.092180 Oct 17 13:43:58.619903 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1230/2464] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:58 2022] GET /compute/v2.1/servers/056bdfdb-6fb3-4ccc-ba80-cbae9524f2c3 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:43:58.632208 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2a16aa4b-8a46-47ac-af9d-676069c16bc0 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:58.633312 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2a16aa4b-8a46-47ac-af9d-676069c16bc0 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: e555208e-39b0-4361-94a5-6b272c336be4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:58.642951 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2a16aa4b-8a46-47ac-af9d-676069c16bc0 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:58.643742 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2a16aa4b-8a46-47ac-af9d-676069c16bc0 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:58.644554 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2a16aa4b-8a46-47ac-af9d-676069c16bc0 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:58.646248 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2a16aa4b-8a46-47ac-af9d-676069c16bc0 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:58.648420 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2a16aa4b-8a46-47ac-af9d-676069c16bc0 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:58.649509 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2a16aa4b-8a46-47ac-af9d-676069c16bc0 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:58.795222 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7f1b594f-5d87-4239-addd-1bb3fe04d1b8 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:58.814615 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7f1b594f-5d87-4239-addd-1bb3fe04d1b8 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:58.818918 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7f1b594f-5d87-4239-addd-1bb3fe04d1b8 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:58.821981 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7f1b594f-5d87-4239-addd-1bb3fe04d1b8 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6" status: 200 len: 1488 microversion: 2.25 time: 1.328596 Oct 17 13:43:58.825547 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1235/2465] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:57 2022] GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6 => generated 1488 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:43:58.851975 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e8f26be4-0bab-42c0-9147-05f486318204 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '.version_select at 0x7f7cd4617700>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:58.939249 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e8f26be4-0bab-42c0-9147-05f486318204 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "GET /compute/v2.1/images/49da5263-076c-4bed-b977-116e50ef3ee9" status: 200 len: 1421 microversion: 2.1 time: 0.112356 Oct 17 13:43:58.948178 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1236/2466] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:43:58 2022] GET /compute/v2.1/images/49da5263-076c-4bed-b977-116e50ef3ee9 => generated 1421 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:58.976201 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ff3a157c-ddc7-4395-8959-9e150f4ec8a1 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a5b302e9-6108-4c8e-b42b-5a6fcb8cccb4"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:58.978846 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ff3a157c-ddc7-4395-8959-9e150f4ec8a1 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] [instance: 2184ae8f-022d-4de9-8d0f-0c2d546c9d6f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:59.003096 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ff3a157c-ddc7-4395-8959-9e150f4ec8a1 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:59.004981 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ff3a157c-ddc7-4395-8959-9e150f4ec8a1 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:59.005988 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ff3a157c-ddc7-4395-8959-9e150f4ec8a1 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:59.008376 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ff3a157c-ddc7-4395-8959-9e150f4ec8a1 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:59.009093 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ff3a157c-ddc7-4395-8959-9e150f4ec8a1 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:59.012087 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ff3a157c-ddc7-4395-8959-9e150f4ec8a1 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:59.325174 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2a16aa4b-8a46-47ac-af9d-676069c16bc0 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467250951f654e33b3e233868301bbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676987e95424497c94984347dd6a7988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:59.337069 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2a16aa4b-8a46-47ac-af9d-676069c16bc0 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4" status: 200 len: 1353 microversion: 2.1 time: 0.714926 Oct 17 13:43:59.343671 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1231/2467] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:58 2022] GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4 => generated 1353 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:59.559079 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f2b2e45e-3ac7-4d90-977c-ab0034e3762f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:59.560707 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f2b2e45e-3ac7-4d90-977c-ab0034e3762f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:59.577829 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f2b2e45e-3ac7-4d90-977c-ab0034e3762f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:59.578321 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f2b2e45e-3ac7-4d90-977c-ab0034e3762f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:59.578798 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f2b2e45e-3ac7-4d90-977c-ab0034e3762f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:59.579658 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f2b2e45e-3ac7-4d90-977c-ab0034e3762f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:59.580108 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f2b2e45e-3ac7-4d90-977c-ab0034e3762f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:59.580565 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f2b2e45e-3ac7-4d90-977c-ab0034e3762f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:59.640441 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ff3a157c-ddc7-4395-8959-9e150f4ec8a1 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] 10.222.0.79 "POST /compute/v2.1/servers/2184ae8f-022d-4de9-8d0f-0c2d546c9d6f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.690041 Oct 17 13:43:59.647265 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1237/2468] 10.222.0.79 () {60 vars in 1323 bytes} [Mon Oct 17 13:43:58 2022] POST /compute/v2.1/servers/2184ae8f-022d-4de9-8d0f-0c2d546c9d6f/os-volume_attachments => generated 194 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:43:59.783187 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-0bab93e9-ef75-4d34-916d-3c2460fb1075 req-8d76091c-25c4-4848-a4cf-da9002132b15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e555208e-39b0-4361-94a5-6b272c336be4", "tag": "7383d71d-5872-4de8-87b0-e2c48915669c"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:59.805791 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-0bab93e9-ef75-4d34-916d-3c2460fb1075 req-8d76091c-25c4-4848-a4cf-da9002132b15 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:59.807157 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-0bab93e9-ef75-4d34-916d-3c2460fb1075 req-8d76091c-25c4-4848-a4cf-da9002132b15 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:59.811428 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-0bab93e9-ef75-4d34-916d-3c2460fb1075 req-8d76091c-25c4-4848-a4cf-da9002132b15 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:59.838651 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-0bab93e9-ef75-4d34-916d-3c2460fb1075 req-8d76091c-25c4-4848-a4cf-da9002132b15 service nova] Creating event network-changed:7383d71d-5872-4de8-87b0-e2c48915669c for instance e555208e-39b0-4361-94a5-6b272c336be4 on n-h2-854247-14 Oct 17 13:43:59.859908 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-0bab93e9-ef75-4d34-916d-3c2460fb1075 req-8d76091c-25c4-4848-a4cf-da9002132b15 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081131 Oct 17 13:43:59.865649 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1238/2469] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:43:59.874070 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e7aeaf1f-6031-436a-91e8-04f92e38efe5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:59.875149 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e7aeaf1f-6031-436a-91e8-04f92e38efe5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: b1b0d02c-b32f-45cd-8732-99b1e3119ca6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:59.883224 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7aeaf1f-6031-436a-91e8-04f92e38efe5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:59.883997 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7aeaf1f-6031-436a-91e8-04f92e38efe5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:59.884685 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7aeaf1f-6031-436a-91e8-04f92e38efe5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:59.885705 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7aeaf1f-6031-436a-91e8-04f92e38efe5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:59.886381 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7aeaf1f-6031-436a-91e8-04f92e38efe5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:59.888593 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7aeaf1f-6031-436a-91e8-04f92e38efe5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:00.007330 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f2b2e45e-3ac7-4d90-977c-ab0034e3762f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:00.017173 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f2b2e45e-3ac7-4d90-977c-ab0034e3762f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 0.463915 Oct 17 13:44:00.020218 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1232/2470] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:59 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:00.038747 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-139a7be4-2c22-41c5-bbf3-93c6d37da79d tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '.version_select at 0x7f7cd54553a0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:00.170759 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-139a7be4-2c22-41c5-bbf3-93c6d37da79d tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "GET /compute/v2.1/images/49da5263-076c-4bed-b977-116e50ef3ee9" status: 200 len: 1421 microversion: 2.1 time: 0.149016 Oct 17 13:44:00.171373 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1233/2471] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:44:00 2022] GET /compute/v2.1/images/49da5263-076c-4bed-b977-116e50ef3ee9 => generated 1421 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:00.358577 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4d3a66d9-97d3-4b93-acc5-0e0ac2a19193 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-957498500", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "72be642c-f241-4ddb-80d7-b14a93aa7fc9"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:44:00.474544 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-4d3a66d9-97d3-4b93-acc5-0e0ac2a19193 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] validate_networks() for [('72be642c-f241-4ddb-80d7-b14a93aa7fc9', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:44:00.848999 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e7aeaf1f-6031-436a-91e8-04f92e38efe5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:00.858388 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e7aeaf1f-6031-436a-91e8-04f92e38efe5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:00.859842 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e7aeaf1f-6031-436a-91e8-04f92e38efe5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:00.868352 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e7aeaf1f-6031-436a-91e8-04f92e38efe5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6" status: 200 len: 1488 microversion: 2.25 time: 1.001085 Oct 17 13:44:00.872624 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1239/2472] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:59 2022] GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6 => generated 1488 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:00.879122 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7f915dd5-89a3-40ee-94a2-c5cb0849bc35 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:00.879760 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7f915dd5-89a3-40ee-94a2-c5cb0849bc35 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: e555208e-39b0-4361-94a5-6b272c336be4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:00.905391 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7f915dd5-89a3-40ee-94a2-c5cb0849bc35 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:00.908858 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7f915dd5-89a3-40ee-94a2-c5cb0849bc35 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:00.909309 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7f915dd5-89a3-40ee-94a2-c5cb0849bc35 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:00.910274 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7f915dd5-89a3-40ee-94a2-c5cb0849bc35 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:00.910731 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7f915dd5-89a3-40ee-94a2-c5cb0849bc35 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:00.912787 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7f915dd5-89a3-40ee-94a2-c5cb0849bc35 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:02.115065 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7f915dd5-89a3-40ee-94a2-c5cb0849bc35 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467250951f654e33b3e233868301bbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676987e95424497c94984347dd6a7988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:02.127857 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7f915dd5-89a3-40ee-94a2-c5cb0849bc35 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4" status: 200 len: 1353 microversion: 2.1 time: 1.253946 Oct 17 13:44:02.128745 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1240/2473] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:00 2022] GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4 => generated 1353 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:02.133590 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fd94b03f-5ab2-410a-8870-5d4efe85968c tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '.version_select at 0x7f7cd4617940>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:02.233761 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fd94b03f-5ab2-410a-8870-5d4efe85968c tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "GET /compute/v2.1/images/49da5263-076c-4bed-b977-116e50ef3ee9" status: 200 len: 1421 microversion: 2.1 time: 0.103795 Oct 17 13:44:02.235906 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1241/2474] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:44:02 2022] GET /compute/v2.1/images/49da5263-076c-4bed-b977-116e50ef3ee9 => generated 1421 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:02.260298 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-77af3a7b-1641-4a11-9517-c0f3ff5b1e2d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:02.261461 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-77af3a7b-1641-4a11-9517-c0f3ff5b1e2d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: b1b0d02c-b32f-45cd-8732-99b1e3119ca6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:02.287446 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-77af3a7b-1641-4a11-9517-c0f3ff5b1e2d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:02.288321 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-77af3a7b-1641-4a11-9517-c0f3ff5b1e2d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:02.290730 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-77af3a7b-1641-4a11-9517-c0f3ff5b1e2d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:02.292250 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-77af3a7b-1641-4a11-9517-c0f3ff5b1e2d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:02.292885 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-77af3a7b-1641-4a11-9517-c0f3ff5b1e2d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:02.295866 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-77af3a7b-1641-4a11-9517-c0f3ff5b1e2d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:02.776334 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-77af3a7b-1641-4a11-9517-c0f3ff5b1e2d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:02.799920 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-77af3a7b-1641-4a11-9517-c0f3ff5b1e2d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:02.801556 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-77af3a7b-1641-4a11-9517-c0f3ff5b1e2d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:02.802930 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-77af3a7b-1641-4a11-9517-c0f3ff5b1e2d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6" status: 200 len: 1488 microversion: 2.25 time: 0.565689 Oct 17 13:44:02.803811 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1242/2475] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:02 2022] GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6 => generated 1488 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:02.808966 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-4d3a66d9-97d3-4b93-acc5-0e0ac2a19193 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:44:02.810237 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-4d3a66d9-97d3-4b93-acc5-0e0ac2a19193 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:44:02.810999 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-4d3a66d9-97d3-4b93-acc5-0e0ac2a19193 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:44:02.811604 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-4d3a66d9-97d3-4b93-acc5-0e0ac2a19193 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:44:02.812155 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-4d3a66d9-97d3-4b93-acc5-0e0ac2a19193 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:44:02.828083 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4d3a66d9-97d3-4b93-acc5-0e0ac2a19193 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:02.833684 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4d3a66d9-97d3-4b93-acc5-0e0ac2a19193 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:02.834471 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4d3a66d9-97d3-4b93-acc5-0e0ac2a19193 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:02.840488 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4d3a66d9-97d3-4b93-acc5-0e0ac2a19193 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:02.841436 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4d3a66d9-97d3-4b93-acc5-0e0ac2a19193 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:02.842032 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4d3a66d9-97d3-4b93-acc5-0e0ac2a19193 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:02.887373 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-4d3a66d9-97d3-4b93-acc5-0e0ac2a19193 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Getting quotas for project 59e65f6eb06d40d583b9f43c9af94c13. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:44:02.896691 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-4d3a66d9-97d3-4b93-acc5-0e0ac2a19193 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Getting quotas for user 443c44b0bd9e4c56a7fe0c1a53238545 and project 59e65f6eb06d40d583b9f43c9af94c13. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:44:02.926854 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4d3a66d9-97d3-4b93-acc5-0e0ac2a19193 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:44:02.929673 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4d3a66d9-97d3-4b93-acc5-0e0ac2a19193 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 9be563ca-739e-4121-9dc8-9e46c7a131b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:44:03.041376 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4d3a66d9-97d3-4b93-acc5-0e0ac2a19193 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.689013 Oct 17 13:44:03.042363 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1234/2476] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:44:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:44:03.058823 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1465e68e-6d0e-4ae1-b5aa-3e24cdccaa56 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:03.059921 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-1465e68e-6d0e-4ae1-b5aa-3e24cdccaa56 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 9be563ca-739e-4121-9dc8-9e46c7a131b6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:03.153187 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ff83fe64-fdda-4388-be19-bdd48c01ef7b tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:03.154151 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ff83fe64-fdda-4388-be19-bdd48c01ef7b tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: e555208e-39b0-4361-94a5-6b272c336be4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:03.174345 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ff83fe64-fdda-4388-be19-bdd48c01ef7b tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:03.181300 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ff83fe64-fdda-4388-be19-bdd48c01ef7b tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:03.191688 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ff83fe64-fdda-4388-be19-bdd48c01ef7b tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:03.192977 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ff83fe64-fdda-4388-be19-bdd48c01ef7b tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:03.193650 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ff83fe64-fdda-4388-be19-bdd48c01ef7b tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:03.194280 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ff83fe64-fdda-4388-be19-bdd48c01ef7b tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:03.347859 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-1465e68e-6d0e-4ae1-b5aa-3e24cdccaa56 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:03.356244 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1465e68e-6d0e-4ae1-b5aa-3e24cdccaa56 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/9be563ca-739e-4121-9dc8-9e46c7a131b6" status: 200 len: 1216 microversion: 2.1 time: 0.305903 Oct 17 13:44:03.360243 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1243/2477] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:03 2022] GET /compute/v2.1/servers/9be563ca-739e-4121-9dc8-9e46c7a131b6 => generated 1216 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:03.370190 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d7fadcc4-349c-420d-8566-783b45191226 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '.version_select at 0x7f7cd4689f70>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:03.497177 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d7fadcc4-349c-420d-8566-783b45191226 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "GET /compute/v2.1/images/49da5263-076c-4bed-b977-116e50ef3ee9" status: 200 len: 1421 microversion: 2.1 time: 0.135312 Oct 17 13:44:03.497972 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1244/2478] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:44:03 2022] GET /compute/v2.1/images/49da5263-076c-4bed-b977-116e50ef3ee9 => generated 1421 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:03.829637 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cbec5f48-8ff8-4700-8269-d178646aeacd tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:03.830442 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cbec5f48-8ff8-4700-8269-d178646aeacd tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: b1b0d02c-b32f-45cd-8732-99b1e3119ca6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:03.851120 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cbec5f48-8ff8-4700-8269-d178646aeacd tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:03.851671 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cbec5f48-8ff8-4700-8269-d178646aeacd tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:03.852117 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cbec5f48-8ff8-4700-8269-d178646aeacd tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:03.864832 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cbec5f48-8ff8-4700-8269-d178646aeacd tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:03.865355 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cbec5f48-8ff8-4700-8269-d178646aeacd tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:03.865812 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cbec5f48-8ff8-4700-8269-d178646aeacd tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:04.290514 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ff83fe64-fdda-4388-be19-bdd48c01ef7b tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467250951f654e33b3e233868301bbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676987e95424497c94984347dd6a7988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:04.306428 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ff83fe64-fdda-4388-be19-bdd48c01ef7b tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4" status: 200 len: 1353 microversion: 2.1 time: 1.156803 Oct 17 13:44:04.309504 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1235/2479] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:03 2022] GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4 => generated 1353 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:04.381526 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ec9af1cb-f202-48d0-9cea-b8ee226f4df8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:04.383121 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ec9af1cb-f202-48d0-9cea-b8ee226f4df8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 9be563ca-739e-4121-9dc8-9e46c7a131b6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:04.395455 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ec9af1cb-f202-48d0-9cea-b8ee226f4df8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:04.396735 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ec9af1cb-f202-48d0-9cea-b8ee226f4df8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:04.398499 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ec9af1cb-f202-48d0-9cea-b8ee226f4df8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:04.400876 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ec9af1cb-f202-48d0-9cea-b8ee226f4df8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:04.402482 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ec9af1cb-f202-48d0-9cea-b8ee226f4df8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:04.403820 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ec9af1cb-f202-48d0-9cea-b8ee226f4df8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:04.629886 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cbec5f48-8ff8-4700-8269-d178646aeacd tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:04.658723 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cbec5f48-8ff8-4700-8269-d178646aeacd tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:04.666292 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cbec5f48-8ff8-4700-8269-d178646aeacd tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:04.675182 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cbec5f48-8ff8-4700-8269-d178646aeacd tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6" status: 200 len: 1488 microversion: 2.25 time: 0.846896 Oct 17 13:44:04.681586 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1245/2480] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:03 2022] GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6 => generated 1488 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:44:04.701197 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e1060105-b645-450d-a397-958303698aeb tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '.version_select at 0x7f7cd46e69d0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:04.785127 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e1060105-b645-450d-a397-958303698aeb tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "GET /compute/v2.1/images/49da5263-076c-4bed-b977-116e50ef3ee9" status: 200 len: 1421 microversion: 2.1 time: 0.101740 Oct 17 13:44:04.786000 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1246/2481] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:44:04 2022] GET /compute/v2.1/images/49da5263-076c-4bed-b977-116e50ef3ee9 => generated 1421 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:04.908226 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ec9af1cb-f202-48d0-9cea-b8ee226f4df8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:04.920623 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ec9af1cb-f202-48d0-9cea-b8ee226f4df8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/9be563ca-739e-4121-9dc8-9e46c7a131b6" status: 200 len: 1220 microversion: 2.1 time: 0.543235 Oct 17 13:44:04.936586 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1236/2482] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:04 2022] GET /compute/v2.1/servers/9be563ca-739e-4121-9dc8-9e46c7a131b6 => generated 1220 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:44:05.338825 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-352af114-e7e1-46c0-8529-0f274566bae9 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:05.339463 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-352af114-e7e1-46c0-8529-0f274566bae9 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: e555208e-39b0-4361-94a5-6b272c336be4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:05.351182 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-352af114-e7e1-46c0-8529-0f274566bae9 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:05.367221 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-352af114-e7e1-46c0-8529-0f274566bae9 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:05.369968 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-352af114-e7e1-46c0-8529-0f274566bae9 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:05.373473 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-352af114-e7e1-46c0-8529-0f274566bae9 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:05.374301 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-352af114-e7e1-46c0-8529-0f274566bae9 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:05.376191 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-352af114-e7e1-46c0-8529-0f274566bae9 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:05.719804 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-53b76152-59f9-4984-8336-57797caf6178 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:05.720434 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-53b76152-59f9-4984-8336-57797caf6178 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: b1b0d02c-b32f-45cd-8732-99b1e3119ca6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:05.761725 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-53b76152-59f9-4984-8336-57797caf6178 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:05.762761 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-53b76152-59f9-4984-8336-57797caf6178 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:05.768377 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-53b76152-59f9-4984-8336-57797caf6178 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:05.770384 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-53b76152-59f9-4984-8336-57797caf6178 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:05.775233 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-53b76152-59f9-4984-8336-57797caf6178 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:05.782790 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-53b76152-59f9-4984-8336-57797caf6178 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:06.254615 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-352af114-e7e1-46c0-8529-0f274566bae9 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467250951f654e33b3e233868301bbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676987e95424497c94984347dd6a7988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:06.272448 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-352af114-e7e1-46c0-8529-0f274566bae9 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4" status: 200 len: 1353 microversion: 2.1 time: 0.936909 Oct 17 13:44:06.291661 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1247/2483] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:05 2022] GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4 => generated 1353 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:44:06.305471 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d65c7d3e-9f29-47dc-b812-f9279ce5899f tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '.version_select at 0x7f7cd46e73a0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:06.408883 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d65c7d3e-9f29-47dc-b812-f9279ce5899f tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "GET /compute/v2.1/images/49da5263-076c-4bed-b977-116e50ef3ee9" status: 200 len: 1421 microversion: 2.1 time: 0.115147 Oct 17 13:44:06.411312 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1248/2484] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:44:06 2022] GET /compute/v2.1/images/49da5263-076c-4bed-b977-116e50ef3ee9 => generated 1421 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:06.426340 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-81fb240b-b86f-40ae-81a7-6db8c25c1c67 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:06.427014 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-81fb240b-b86f-40ae-81a7-6db8c25c1c67 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 9be563ca-739e-4121-9dc8-9e46c7a131b6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:06.449759 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-81fb240b-b86f-40ae-81a7-6db8c25c1c67 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:06.451098 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-81fb240b-b86f-40ae-81a7-6db8c25c1c67 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:06.451752 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-81fb240b-b86f-40ae-81a7-6db8c25c1c67 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:06.454747 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-81fb240b-b86f-40ae-81a7-6db8c25c1c67 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:06.456482 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-81fb240b-b86f-40ae-81a7-6db8c25c1c67 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:06.458624 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-81fb240b-b86f-40ae-81a7-6db8c25c1c67 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:06.682728 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-53b76152-59f9-4984-8336-57797caf6178 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:06.698065 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-53b76152-59f9-4984-8336-57797caf6178 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:06.699886 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-53b76152-59f9-4984-8336-57797caf6178 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:06.707869 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-53b76152-59f9-4984-8336-57797caf6178 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6" status: 200 len: 1488 microversion: 2.25 time: 0.996159 Oct 17 13:44:06.732092 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1237/2485] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:05 2022] GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6 => generated 1488 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:06.738568 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-634fb644-d3e2-49ff-8844-80c9bdac58b3 req-8d9d7efb-e2a9-45ae-b916-c0a65bad47f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1b0d02c-b32f-45cd-8732-99b1e3119ca6", "name": "network-vif-unplugged", "status": "completed", "tag": "8f48924e-befb-4a03-97da-73a3c4e335e9"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:44:06.773447 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-634fb644-d3e2-49ff-8844-80c9bdac58b3 req-8d9d7efb-e2a9-45ae-b916-c0a65bad47f8 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:06.776550 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-634fb644-d3e2-49ff-8844-80c9bdac58b3 req-8d9d7efb-e2a9-45ae-b916-c0a65bad47f8 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:06.784452 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-634fb644-d3e2-49ff-8844-80c9bdac58b3 req-8d9d7efb-e2a9-45ae-b916-c0a65bad47f8 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:06.797863 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-81fb240b-b86f-40ae-81a7-6db8c25c1c67 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:06.802035 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:44:06.811078 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-81fb240b-b86f-40ae-81a7-6db8c25c1c67 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/9be563ca-739e-4121-9dc8-9e46c7a131b6" status: 200 len: 1274 microversion: 2.1 time: 0.396692 Oct 17 13:44:06.812373 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1249/2486] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:06 2022] GET /compute/v2.1/servers/9be563ca-739e-4121-9dc8-9e46c7a131b6 => generated 1274 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:06.812816 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-634fb644-d3e2-49ff-8844-80c9bdac58b3 req-8d9d7efb-e2a9-45ae-b916-c0a65bad47f8 service nova] Creating event network-vif-unplugged:8f48924e-befb-4a03-97da-73a3c4e335e9 for instance b1b0d02c-b32f-45cd-8732-99b1e3119ca6 on n-h1-854247-14 Oct 17 13:44:06.828745 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-634fb644-d3e2-49ff-8844-80c9bdac58b3 req-8d9d7efb-e2a9-45ae-b916-c0a65bad47f8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093762 Oct 17 13:44:06.833515 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1238/2487] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:44:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:44:07.299914 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1306a463-39ab-4f22-82eb-c9fa81a739b8 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:07.301338 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-1306a463-39ab-4f22-82eb-c9fa81a739b8 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: e555208e-39b0-4361-94a5-6b272c336be4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:07.316510 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1306a463-39ab-4f22-82eb-c9fa81a739b8 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:07.317363 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1306a463-39ab-4f22-82eb-c9fa81a739b8 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:07.319707 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1306a463-39ab-4f22-82eb-c9fa81a739b8 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:07.321462 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1306a463-39ab-4f22-82eb-c9fa81a739b8 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:07.323603 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1306a463-39ab-4f22-82eb-c9fa81a739b8 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:07.324371 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1306a463-39ab-4f22-82eb-c9fa81a739b8 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:07.427485 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-902fb49b-a49b-4c87-9d8f-6774ededf111 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '.version_select at 0x7f7cd5619e50>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:07.536596 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-902fb49b-a49b-4c87-9d8f-6774ededf111 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "GET /compute/v2.1/images/49da5263-076c-4bed-b977-116e50ef3ee9" status: 200 len: 1421 microversion: 2.1 time: 0.113963 Oct 17 13:44:07.538745 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1239/2488] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:44:07 2022] GET /compute/v2.1/images/49da5263-076c-4bed-b977-116e50ef3ee9 => generated 1421 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:07.743639 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-20097086-b191-4994-bef6-1fa708643918 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:07.744922 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-20097086-b191-4994-bef6-1fa708643918 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: b1b0d02c-b32f-45cd-8732-99b1e3119ca6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:07.773362 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-20097086-b191-4994-bef6-1fa708643918 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:07.781506 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-20097086-b191-4994-bef6-1fa708643918 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:07.782736 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-20097086-b191-4994-bef6-1fa708643918 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:07.787876 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-20097086-b191-4994-bef6-1fa708643918 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:07.794892 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-20097086-b191-4994-bef6-1fa708643918 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:07.796461 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-20097086-b191-4994-bef6-1fa708643918 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:08.465992 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-1306a463-39ab-4f22-82eb-c9fa81a739b8 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467250951f654e33b3e233868301bbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676987e95424497c94984347dd6a7988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:08.488386 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1306a463-39ab-4f22-82eb-c9fa81a739b8 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4" status: 200 len: 1353 microversion: 2.1 time: 1.193815 Oct 17 13:44:08.490241 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1250/2489] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:07 2022] GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4 => generated 1353 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:08.497429 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0463e687-2e59-41a5-94de-a3306338b9aa tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:08.498483 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0463e687-2e59-41a5-94de-a3306338b9aa tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 9be563ca-739e-4121-9dc8-9e46c7a131b6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:08.528799 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0463e687-2e59-41a5-94de-a3306338b9aa tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:08.531417 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0463e687-2e59-41a5-94de-a3306338b9aa tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:08.531904 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0463e687-2e59-41a5-94de-a3306338b9aa tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:08.532667 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0463e687-2e59-41a5-94de-a3306338b9aa tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:08.533137 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0463e687-2e59-41a5-94de-a3306338b9aa tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:08.533564 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0463e687-2e59-41a5-94de-a3306338b9aa tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:09.614715 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0463e687-2e59-41a5-94de-a3306338b9aa tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:09.625089 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0463e687-2e59-41a5-94de-a3306338b9aa tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/9be563ca-739e-4121-9dc8-9e46c7a131b6" status: 200 len: 1274 microversion: 2.1 time: 1.133508 Oct 17 13:44:09.637388 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1251/2490] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:08 2022] GET /compute/v2.1/servers/9be563ca-739e-4121-9dc8-9e46c7a131b6 => generated 1274 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:09.662981 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2f8f729e-1f38-4c7f-924c-a6710326e44b tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '.version_select at 0x7f7cd982a670>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:09.800129 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2f8f729e-1f38-4c7f-924c-a6710326e44b tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "GET /compute/v2.1/images/49da5263-076c-4bed-b977-116e50ef3ee9" status: 200 len: 1421 microversion: 2.1 time: 0.159657 Oct 17 13:44:09.802508 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1252/2491] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:44:09 2022] GET /compute/v2.1/images/49da5263-076c-4bed-b977-116e50ef3ee9 => generated 1421 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:09.824529 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a4ce34be-a36b-44c2-8ab9-feca41d1c92d tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:09.825639 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a4ce34be-a36b-44c2-8ab9-feca41d1c92d tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: e555208e-39b0-4361-94a5-6b272c336be4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:09.846688 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a4ce34be-a36b-44c2-8ab9-feca41d1c92d tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:09.853274 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a4ce34be-a36b-44c2-8ab9-feca41d1c92d tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:09.854988 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-20097086-b191-4994-bef6-1fa708643918 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:09.855893 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a4ce34be-a36b-44c2-8ab9-feca41d1c92d tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:09.856795 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a4ce34be-a36b-44c2-8ab9-feca41d1c92d tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:09.857274 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a4ce34be-a36b-44c2-8ab9-feca41d1c92d tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:09.868884 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a4ce34be-a36b-44c2-8ab9-feca41d1c92d tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:09.878577 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-20097086-b191-4994-bef6-1fa708643918 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:09.886218 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-20097086-b191-4994-bef6-1fa708643918 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:09.910685 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-20097086-b191-4994-bef6-1fa708643918 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6" status: 200 len: 1488 microversion: 2.25 time: 2.169133 Oct 17 13:44:09.911534 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1240/2492] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:07 2022] GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6 => generated 1488 bytes in 2177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:44:10.195100 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-e6cc4623-cc00-4156-9a4a-45060a239e36 req-421d08a8-48fc-4dc4-9103-4c5f2e04bbf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1b0d02c-b32f-45cd-8732-99b1e3119ca6", "tag": "8f48924e-befb-4a03-97da-73a3c4e335e9"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:44:10.239017 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-e6cc4623-cc00-4156-9a4a-45060a239e36 req-421d08a8-48fc-4dc4-9103-4c5f2e04bbf9 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:10.243509 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-e6cc4623-cc00-4156-9a4a-45060a239e36 req-421d08a8-48fc-4dc4-9103-4c5f2e04bbf9 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:10.247667 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-e6cc4623-cc00-4156-9a4a-45060a239e36 req-421d08a8-48fc-4dc4-9103-4c5f2e04bbf9 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:10.301889 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-e6cc4623-cc00-4156-9a4a-45060a239e36 req-421d08a8-48fc-4dc4-9103-4c5f2e04bbf9 service nova] Creating event network-changed:8f48924e-befb-4a03-97da-73a3c4e335e9 for instance b1b0d02c-b32f-45cd-8732-99b1e3119ca6 on n-h1-854247-14 Oct 17 13:44:10.329346 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-e6cc4623-cc00-4156-9a4a-45060a239e36 req-421d08a8-48fc-4dc4-9103-4c5f2e04bbf9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131613 Oct 17 13:44:10.334290 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1241/2493] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:44:10.579273 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a4ce34be-a36b-44c2-8ab9-feca41d1c92d tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467250951f654e33b3e233868301bbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676987e95424497c94984347dd6a7988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:10.588103 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a4ce34be-a36b-44c2-8ab9-feca41d1c92d tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4" status: 200 len: 1353 microversion: 2.1 time: 0.783645 Oct 17 13:44:10.588694 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1253/2494] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:09 2022] GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4 => generated 1353 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:10.666765 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-69e48112-0cd2-48d8-b309-65df331097a9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:10.667854 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-69e48112-0cd2-48d8-b309-65df331097a9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 9be563ca-739e-4121-9dc8-9e46c7a131b6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:10.682691 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69e48112-0cd2-48d8-b309-65df331097a9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:10.686015 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69e48112-0cd2-48d8-b309-65df331097a9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:10.686703 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69e48112-0cd2-48d8-b309-65df331097a9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:10.689657 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69e48112-0cd2-48d8-b309-65df331097a9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:10.690304 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69e48112-0cd2-48d8-b309-65df331097a9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:10.692298 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69e48112-0cd2-48d8-b309-65df331097a9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:10.816758 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8b77b0fb-7081-4ea6-b7c0-3352c9830f19 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '.version_select at 0x7f7cd46df0d0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:10.920360 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8b77b0fb-7081-4ea6-b7c0-3352c9830f19 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "GET /compute/v2.1/images/49da5263-076c-4bed-b977-116e50ef3ee9" status: 200 len: 1421 microversion: 2.1 time: 0.107412 Oct 17 13:44:10.922963 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1254/2495] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:44:10 2022] GET /compute/v2.1/images/49da5263-076c-4bed-b977-116e50ef3ee9 => generated 1421 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:10.938721 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-57b76ddf-43d0-40a1-9220-e1fa34808ed3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:10.939645 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-57b76ddf-43d0-40a1-9220-e1fa34808ed3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: b1b0d02c-b32f-45cd-8732-99b1e3119ca6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:10.957313 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-57b76ddf-43d0-40a1-9220-e1fa34808ed3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:10.958713 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-57b76ddf-43d0-40a1-9220-e1fa34808ed3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:10.959382 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-57b76ddf-43d0-40a1-9220-e1fa34808ed3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:10.960297 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-57b76ddf-43d0-40a1-9220-e1fa34808ed3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:10.960911 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-57b76ddf-43d0-40a1-9220-e1fa34808ed3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:10.961494 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-57b76ddf-43d0-40a1-9220-e1fa34808ed3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:11.379917 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-69e48112-0cd2-48d8-b309-65df331097a9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:11.396074 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-69e48112-0cd2-48d8-b309-65df331097a9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/9be563ca-739e-4121-9dc8-9e46c7a131b6" status: 200 len: 1316 microversion: 2.1 time: 0.734620 Oct 17 13:44:11.400187 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1242/2496] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:10 2022] GET /compute/v2.1/servers/9be563ca-739e-4121-9dc8-9e46c7a131b6 => generated 1316 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:11.420034 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-57b76ddf-43d0-40a1-9220-e1fa34808ed3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:11.430876 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-57b76ddf-43d0-40a1-9220-e1fa34808ed3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:11.433011 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-57b76ddf-43d0-40a1-9220-e1fa34808ed3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:11.437886 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-57b76ddf-43d0-40a1-9220-e1fa34808ed3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6" status: 200 len: 1488 microversion: 2.25 time: 0.503203 Oct 17 13:44:11.476272 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1255/2497] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:10 2022] GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6 => generated 1488 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:11.615122 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7e6bb5b0-dfc2-4612-894f-cde8a1eabc40 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:11.616241 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7e6bb5b0-dfc2-4612-894f-cde8a1eabc40 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: e555208e-39b0-4361-94a5-6b272c336be4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:11.629151 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7e6bb5b0-dfc2-4612-894f-cde8a1eabc40 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:11.631499 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7e6bb5b0-dfc2-4612-894f-cde8a1eabc40 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:11.632879 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7e6bb5b0-dfc2-4612-894f-cde8a1eabc40 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:11.636232 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7e6bb5b0-dfc2-4612-894f-cde8a1eabc40 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:11.637208 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7e6bb5b0-dfc2-4612-894f-cde8a1eabc40 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:11.637805 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7e6bb5b0-dfc2-4612-894f-cde8a1eabc40 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:11.937542 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-dbcd90a8-2faf-4c6c-acae-96e9f2677f19 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '.version_select at 0x7f7cd4636c10>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:12.031345 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-dbcd90a8-2faf-4c6c-acae-96e9f2677f19 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "GET /compute/v2.1/images/49da5263-076c-4bed-b977-116e50ef3ee9" status: 200 len: 1421 microversion: 2.1 time: 0.098704 Oct 17 13:44:12.034883 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1256/2498] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:44:11 2022] GET /compute/v2.1/images/49da5263-076c-4bed-b977-116e50ef3ee9 => generated 1421 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:12.425799 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-885114df-f9c8-46d1-ad23-a3a93eefdc67 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:12.427332 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-885114df-f9c8-46d1-ad23-a3a93eefdc67 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 9be563ca-739e-4121-9dc8-9e46c7a131b6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:12.451664 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-885114df-f9c8-46d1-ad23-a3a93eefdc67 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:12.471336 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-885114df-f9c8-46d1-ad23-a3a93eefdc67 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:12.474813 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-885114df-f9c8-46d1-ad23-a3a93eefdc67 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:12.478324 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-885114df-f9c8-46d1-ad23-a3a93eefdc67 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:12.486600 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-885114df-f9c8-46d1-ad23-a3a93eefdc67 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:12.487804 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-885114df-f9c8-46d1-ad23-a3a93eefdc67 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:12.672071 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7e6bb5b0-dfc2-4612-894f-cde8a1eabc40 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467250951f654e33b3e233868301bbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676987e95424497c94984347dd6a7988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:12.685685 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7e6bb5b0-dfc2-4612-894f-cde8a1eabc40 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4" status: 200 len: 1353 microversion: 2.1 time: 1.074041 Oct 17 13:44:12.688192 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1243/2499] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:11 2022] GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4 => generated 1353 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:12.698476 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3d5c3686-a092-4198-81cb-16f7d02ce1ea tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:12.702189 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3d5c3686-a092-4198-81cb-16f7d02ce1ea tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: b1b0d02c-b32f-45cd-8732-99b1e3119ca6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:12.717792 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3d5c3686-a092-4198-81cb-16f7d02ce1ea tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:12.718577 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3d5c3686-a092-4198-81cb-16f7d02ce1ea tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:12.719217 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3d5c3686-a092-4198-81cb-16f7d02ce1ea tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:12.723054 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3d5c3686-a092-4198-81cb-16f7d02ce1ea tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:12.723607 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3d5c3686-a092-4198-81cb-16f7d02ce1ea tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:12.724052 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3d5c3686-a092-4198-81cb-16f7d02ce1ea tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:12.851492 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:44:12.915996 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=6 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:44:13.356383 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:44:13.429219 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3d5c3686-a092-4198-81cb-16f7d02ce1ea tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:13.487134 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3d5c3686-a092-4198-81cb-16f7d02ce1ea tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:13.500370 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3d5c3686-a092-4198-81cb-16f7d02ce1ea tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:13.513803 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3d5c3686-a092-4198-81cb-16f7d02ce1ea tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6" status: 200 len: 1488 microversion: 2.25 time: 0.824131 Oct 17 13:44:13.516288 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1244/2500] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:12 2022] GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6 => generated 1488 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:13.525750 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-614e9b73-adf0-478a-96ff-15684524e315 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '.version_select at 0x7f7cd4a58160>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:13.655185 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-614e9b73-adf0-478a-96ff-15684524e315 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "GET /compute/v2.1/images/49da5263-076c-4bed-b977-116e50ef3ee9" status: 200 len: 1421 microversion: 2.1 time: 0.136678 Oct 17 13:44:13.671666 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1245/2501] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:44:13 2022] GET /compute/v2.1/images/49da5263-076c-4bed-b977-116e50ef3ee9 => generated 1421 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:13.717902 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8b9f6e9b-88a7-40ee-9785-f711f694e908 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:13.722579 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8b9f6e9b-88a7-40ee-9785-f711f694e908 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: e555208e-39b0-4361-94a5-6b272c336be4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:13.758180 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8b9f6e9b-88a7-40ee-9785-f711f694e908 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:13.759388 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8b9f6e9b-88a7-40ee-9785-f711f694e908 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:13.760413 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8b9f6e9b-88a7-40ee-9785-f711f694e908 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:13.761872 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8b9f6e9b-88a7-40ee-9785-f711f694e908 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:13.762981 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8b9f6e9b-88a7-40ee-9785-f711f694e908 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:13.763964 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8b9f6e9b-88a7-40ee-9785-f711f694e908 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:14.021475 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-885114df-f9c8-46d1-ad23-a3a93eefdc67 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:14.046494 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-885114df-f9c8-46d1-ad23-a3a93eefdc67 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/9be563ca-739e-4121-9dc8-9e46c7a131b6" status: 200 len: 1316 microversion: 2.1 time: 1.628087 Oct 17 13:44:14.056277 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1257/2502] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:12 2022] GET /compute/v2.1/servers/9be563ca-739e-4121-9dc8-9e46c7a131b6 => generated 1316 bytes in 1639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:44:14.550415 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cf0c9303-5547-428e-b3ea-ec985f11caaa tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:14.553144 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cf0c9303-5547-428e-b3ea-ec985f11caaa tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: b1b0d02c-b32f-45cd-8732-99b1e3119ca6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:14.588407 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8b9f6e9b-88a7-40ee-9785-f711f694e908 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467250951f654e33b3e233868301bbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676987e95424497c94984347dd6a7988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:14.611592 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cf0c9303-5547-428e-b3ea-ec985f11caaa tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:14.612399 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cf0c9303-5547-428e-b3ea-ec985f11caaa tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:14.615134 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8b9f6e9b-88a7-40ee-9785-f711f694e908 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4" status: 200 len: 1353 microversion: 2.1 time: 0.901239 Oct 17 13:44:14.619029 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1246/2503] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:13 2022] GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4 => generated 1353 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:44:14.626194 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cf0c9303-5547-428e-b3ea-ec985f11caaa tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:14.628108 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cf0c9303-5547-428e-b3ea-ec985f11caaa tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:14.629334 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cf0c9303-5547-428e-b3ea-ec985f11caaa tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:14.630237 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cf0c9303-5547-428e-b3ea-ec985f11caaa tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:14.695828 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9ac88021-a29b-4df6-a5e1-33aab9ac158a tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '.version_select at 0x7f7cd54b0280>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:14.805951 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9ac88021-a29b-4df6-a5e1-33aab9ac158a tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "GET /compute/v2.1/images/49da5263-076c-4bed-b977-116e50ef3ee9" status: 200 len: 1421 microversion: 2.1 time: 0.125741 Oct 17 13:44:14.809771 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1247/2504] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:44:14 2022] GET /compute/v2.1/images/49da5263-076c-4bed-b977-116e50ef3ee9 => generated 1421 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:44:15.120581 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1ae3ca0a-ac79-424a-a20e-6644cfe05e28 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:15.122261 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1ae3ca0a-ac79-424a-a20e-6644cfe05e28 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 9be563ca-739e-4121-9dc8-9e46c7a131b6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:15.138335 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1ae3ca0a-ac79-424a-a20e-6644cfe05e28 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:15.158808 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1ae3ca0a-ac79-424a-a20e-6644cfe05e28 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:15.162786 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1ae3ca0a-ac79-424a-a20e-6644cfe05e28 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:15.164618 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1ae3ca0a-ac79-424a-a20e-6644cfe05e28 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:15.170968 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1ae3ca0a-ac79-424a-a20e-6644cfe05e28 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:15.172430 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1ae3ca0a-ac79-424a-a20e-6644cfe05e28 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:15.217144 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cf0c9303-5547-428e-b3ea-ec985f11caaa tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:15.258081 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cf0c9303-5547-428e-b3ea-ec985f11caaa tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:15.264864 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cf0c9303-5547-428e-b3ea-ec985f11caaa tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:15.273138 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cf0c9303-5547-428e-b3ea-ec985f11caaa tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6" status: 200 len: 1488 microversion: 2.25 time: 0.731539 Oct 17 13:44:15.274254 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1258/2505] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:14 2022] GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6 => generated 1488 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:44:15.644018 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e191782c-07b4-422c-899f-e3e4c69eb15e tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:15.644641 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e191782c-07b4-422c-899f-e3e4c69eb15e tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: e555208e-39b0-4361-94a5-6b272c336be4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:15.664968 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e191782c-07b4-422c-899f-e3e4c69eb15e tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:15.674634 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e191782c-07b4-422c-899f-e3e4c69eb15e tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:15.680480 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e191782c-07b4-422c-899f-e3e4c69eb15e tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:15.681537 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e191782c-07b4-422c-899f-e3e4c69eb15e tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:15.684095 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e191782c-07b4-422c-899f-e3e4c69eb15e tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:15.685636 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e191782c-07b4-422c-899f-e3e4c69eb15e tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:17.137365 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1ae3ca0a-ac79-424a-a20e-6644cfe05e28 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:17.159911 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1ae3ca0a-ac79-424a-a20e-6644cfe05e28 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/9be563ca-739e-4121-9dc8-9e46c7a131b6" status: 200 len: 1316 microversion: 2.1 time: 2.077686 Oct 17 13:44:17.162124 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1248/2506] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:15 2022] GET /compute/v2.1/servers/9be563ca-739e-4121-9dc8-9e46c7a131b6 => generated 1316 bytes in 2088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:17.176924 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-637f8077-02ca-4704-bb98-4995cdfba99b tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '.version_select at 0x7f7cd55483a0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:17.267722 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-637f8077-02ca-4704-bb98-4995cdfba99b tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "GET /compute/v2.1/images/49da5263-076c-4bed-b977-116e50ef3ee9" status: 200 len: 1421 microversion: 2.1 time: 0.102772 Oct 17 13:44:17.279057 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1249/2507] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:44:17 2022] GET /compute/v2.1/images/49da5263-076c-4bed-b977-116e50ef3ee9 => generated 1421 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:17.287795 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1a92b23f-6720-4fd6-b6ac-f8bb01c5fbd1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:17.298659 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1a92b23f-6720-4fd6-b6ac-f8bb01c5fbd1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: b1b0d02c-b32f-45cd-8732-99b1e3119ca6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:17.337857 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:44:17.340014 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1a92b23f-6720-4fd6-b6ac-f8bb01c5fbd1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:17.346501 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1a92b23f-6720-4fd6-b6ac-f8bb01c5fbd1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:17.349931 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1a92b23f-6720-4fd6-b6ac-f8bb01c5fbd1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:17.352497 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1a92b23f-6720-4fd6-b6ac-f8bb01c5fbd1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:17.357289 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1a92b23f-6720-4fd6-b6ac-f8bb01c5fbd1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:17.360230 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1a92b23f-6720-4fd6-b6ac-f8bb01c5fbd1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:17.769917 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e191782c-07b4-422c-899f-e3e4c69eb15e tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467250951f654e33b3e233868301bbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676987e95424497c94984347dd6a7988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:17.794856 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e191782c-07b4-422c-899f-e3e4c69eb15e tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4" status: 200 len: 1353 microversion: 2.1 time: 2.152460 Oct 17 13:44:17.816435 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1259/2508] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:15 2022] GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4 => generated 1353 bytes in 2176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:44:17.838106 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-59f96528-f8cc-401e-bda3-da683dd40afc req-a8adffbe-3fe6-4e7f-915d-7348085e44ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9be563ca-739e-4121-9dc8-9e46c7a131b6", "tag": "3949bca1-350d-456b-8b19-4ce4d228854d"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:44:17.879149 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-59f96528-f8cc-401e-bda3-da683dd40afc req-a8adffbe-3fe6-4e7f-915d-7348085e44ca service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:17.879664 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-59f96528-f8cc-401e-bda3-da683dd40afc req-a8adffbe-3fe6-4e7f-915d-7348085e44ca service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:17.880105 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-59f96528-f8cc-401e-bda3-da683dd40afc req-a8adffbe-3fe6-4e7f-915d-7348085e44ca service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:17.935386 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1a92b23f-6720-4fd6-b6ac-f8bb01c5fbd1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:17.936845 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-59f96528-f8cc-401e-bda3-da683dd40afc req-a8adffbe-3fe6-4e7f-915d-7348085e44ca service nova] Creating event network-changed:3949bca1-350d-456b-8b19-4ce4d228854d for instance 9be563ca-739e-4121-9dc8-9e46c7a131b6 on n-h1-854247-14 Oct 17 13:44:17.955112 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-59f96528-f8cc-401e-bda3-da683dd40afc req-a8adffbe-3fe6-4e7f-915d-7348085e44ca service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135568 Oct 17 13:44:17.957020 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1260/2509] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:44:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:44:17.962204 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1a92b23f-6720-4fd6-b6ac-f8bb01c5fbd1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:17.975683 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9469a92f-2cc7-4545-b100-32d665bdafc8 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:17.982793 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9469a92f-2cc7-4545-b100-32d665bdafc8 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] [instance: 2184ae8f-022d-4de9-8d0f-0c2d546c9d6f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:17.983710 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1a92b23f-6720-4fd6-b6ac-f8bb01c5fbd1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:17.986070 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1a92b23f-6720-4fd6-b6ac-f8bb01c5fbd1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6" status: 200 len: 1488 microversion: 2.25 time: 0.705629 Oct 17 13:44:17.996172 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1250/2510] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:17 2022] GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6 => generated 1488 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:18.021524 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9469a92f-2cc7-4545-b100-32d665bdafc8 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:18.024624 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9469a92f-2cc7-4545-b100-32d665bdafc8 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:18.025978 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9469a92f-2cc7-4545-b100-32d665bdafc8 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:18.027113 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9469a92f-2cc7-4545-b100-32d665bdafc8 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:18.029430 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9469a92f-2cc7-4545-b100-32d665bdafc8 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:18.032806 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9469a92f-2cc7-4545-b100-32d665bdafc8 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:18.124609 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9469a92f-2cc7-4545-b100-32d665bdafc8 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] 10.222.0.79 "GET /compute/v2.1/servers/2184ae8f-022d-4de9-8d0f-0c2d546c9d6f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.164488 Oct 17 13:44:18.127459 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1261/2511] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 13:44:17 2022] GET /compute/v2.1/servers/2184ae8f-022d-4de9-8d0f-0c2d546c9d6f/os-volume_attachments => generated 197 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:44:18.140799 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-cc6360be-8df5-4095-9952-b6460639be63 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:18.141403 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-cc6360be-8df5-4095-9952-b6460639be63 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] [instance: 2184ae8f-022d-4de9-8d0f-0c2d546c9d6f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:18.159019 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cc6360be-8df5-4095-9952-b6460639be63 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:18.167996 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cc6360be-8df5-4095-9952-b6460639be63 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:18.168776 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cc6360be-8df5-4095-9952-b6460639be63 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:18.169776 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cc6360be-8df5-4095-9952-b6460639be63 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:18.170617 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cc6360be-8df5-4095-9952-b6460639be63 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:18.171538 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cc6360be-8df5-4095-9952-b6460639be63 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:18.220240 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=100 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:44:18.418251 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-cc6360be-8df5-4095-9952-b6460639be63 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lazy-loading 'services' on Instance uuid 2184ae8f-022d-4de9-8d0f-0c2d546c9d6f {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:44:18.501674 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b7da2fdf-a646-40bf-a30e-be323ceddbc5 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Action: 'create', calling method: .version_select at 0x7f7cd98829d0>, body: {"keypair": {"name": "tempest-keypair-578260608", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC3cIgWxPLby27lmu79vUQjY0G3khMzCMkbghxkjntQhHlwRlA25v0Ocj6unIC/oWZLTlG8V+nnIKHgHMkzyuchXwQy6lkkuLElzmn8+ngDdKsHzcpahWmpK4uvxNpyfVQ=="}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:44:18.521402 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-b7da2fdf-a646-40bf-a30e-be323ceddbc5 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Getting quotas for project 341aac3733474b58a6ce8724c8bba334. Resources: {'key_pairs'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:44:18.527416 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-b7da2fdf-a646-40bf-a30e-be323ceddbc5 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Getting quotas for user ecb93a068a854ec9a2c082b380e22466 and project 341aac3733474b58a6ce8724c8bba334. Resources: {'key_pairs'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:44:18.582174 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b7da2fdf-a646-40bf-a30e-be323ceddbc5 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.432402 Oct 17 13:44:18.583426 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1262/2512] 10.222.0.79 () {60 vars in 1159 bytes} [Mon Oct 17 13:44:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:44:18.590039 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b9b01300-31c8-4e46-966e-e0af8231e93b tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:18.591066 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b9b01300-31c8-4e46-966e-e0af8231e93b tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 9be563ca-739e-4121-9dc8-9e46c7a131b6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:18.604258 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b9b01300-31c8-4e46-966e-e0af8231e93b tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:18.604772 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b9b01300-31c8-4e46-966e-e0af8231e93b tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:18.605212 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b9b01300-31c8-4e46-966e-e0af8231e93b tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:18.605945 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b9b01300-31c8-4e46-966e-e0af8231e93b tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:18.606486 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b9b01300-31c8-4e46-966e-e0af8231e93b tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:18.606919 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b9b01300-31c8-4e46-966e-e0af8231e93b tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:18.629725 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-cc6360be-8df5-4095-9952-b6460639be63 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] 10.222.0.79 "DELETE /compute/v2.1/servers/2184ae8f-022d-4de9-8d0f-0c2d546c9d6f/os-volume_attachments/a5b302e9-6108-4c8e-b42b-5a6fcb8cccb4" status: 202 len: 0 microversion: 2.1 time: 0.491508 Oct 17 13:44:18.631195 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1251/2513] 10.222.0.79 () {58 vars in 1416 bytes} [Mon Oct 17 13:44:18 2022] DELETE /compute/v2.1/servers/2184ae8f-022d-4de9-8d0f-0c2d546c9d6f/os-volume_attachments/a5b302e9-6108-4c8e-b42b-5a6fcb8cccb4 => generated 0 bytes in 495 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:44:18.663835 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ae001f9d-b3eb-403f-89bb-bfbff3d630fa tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '.version_select at 0x7f7cd4a581f0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:18.735953 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ae001f9d-b3eb-403f-89bb-bfbff3d630fa tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "GET /compute/v2.1/images/49da5263-076c-4bed-b977-116e50ef3ee9" status: 200 len: 1421 microversion: 2.1 time: 0.102503 Oct 17 13:44:18.744743 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1252/2514] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:44:18 2022] GET /compute/v2.1/images/49da5263-076c-4bed-b977-116e50ef3ee9 => generated 1421 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:18.822084 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-59d86e6e-32e1-44bc-b90d-da656c04d58c tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:18.823108 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-59d86e6e-32e1-44bc-b90d-da656c04d58c tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: e555208e-39b0-4361-94a5-6b272c336be4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:18.848245 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-59d86e6e-32e1-44bc-b90d-da656c04d58c tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:18.854247 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-59d86e6e-32e1-44bc-b90d-da656c04d58c tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:18.859892 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-59d86e6e-32e1-44bc-b90d-da656c04d58c tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:18.866974 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-59d86e6e-32e1-44bc-b90d-da656c04d58c tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:18.874525 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-59d86e6e-32e1-44bc-b90d-da656c04d58c tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:18.876148 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-59d86e6e-32e1-44bc-b90d-da656c04d58c tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:19.433879 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-59d86e6e-32e1-44bc-b90d-da656c04d58c tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467250951f654e33b3e233868301bbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676987e95424497c94984347dd6a7988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:19.478065 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-59d86e6e-32e1-44bc-b90d-da656c04d58c tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4" status: 200 len: 1353 microversion: 2.1 time: 0.654901 Oct 17 13:44:19.499367 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1253/2515] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:18 2022] GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4 => generated 1353 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:44:19.518705 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a7f443be-d9ea-4d00-bf0f-6790c3eac8f5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:19.521257 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a7f443be-d9ea-4d00-bf0f-6790c3eac8f5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: b1b0d02c-b32f-45cd-8732-99b1e3119ca6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:19.540056 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a7f443be-d9ea-4d00-bf0f-6790c3eac8f5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:19.540932 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a7f443be-d9ea-4d00-bf0f-6790c3eac8f5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:19.543955 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a7f443be-d9ea-4d00-bf0f-6790c3eac8f5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:19.545208 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a7f443be-d9ea-4d00-bf0f-6790c3eac8f5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:19.547579 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a7f443be-d9ea-4d00-bf0f-6790c3eac8f5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:19.548231 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a7f443be-d9ea-4d00-bf0f-6790c3eac8f5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:20.399097 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a7f443be-d9ea-4d00-bf0f-6790c3eac8f5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:20.409293 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a7f443be-d9ea-4d00-bf0f-6790c3eac8f5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:20.410723 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a7f443be-d9ea-4d00-bf0f-6790c3eac8f5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:20.428678 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a7f443be-d9ea-4d00-bf0f-6790c3eac8f5 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6" status: 200 len: 1488 microversion: 2.25 time: 0.925241 Oct 17 13:44:20.445811 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1254/2516] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:19 2022] GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6 => generated 1488 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:20.456162 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e1a72161-e8bf-4f86-abbf-d5a6388d62db tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '.version_select at 0x7f7cd5528ee0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:20.556920 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e1a72161-e8bf-4f86-abbf-d5a6388d62db tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "GET /compute/v2.1/images/49da5263-076c-4bed-b977-116e50ef3ee9" status: 200 len: 1430 microversion: 2.1 time: 0.104594 Oct 17 13:44:20.569521 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1255/2517] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:44:20 2022] GET /compute/v2.1/images/49da5263-076c-4bed-b977-116e50ef3ee9 => generated 1430 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:20.580791 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-67d6780d-9bab-40d0-8ea9-ca79eb0fb5f9 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:20.583036 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-67d6780d-9bab-40d0-8ea9-ca79eb0fb5f9 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: e555208e-39b0-4361-94a5-6b272c336be4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:20.590880 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-67d6780d-9bab-40d0-8ea9-ca79eb0fb5f9 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:20.592836 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-67d6780d-9bab-40d0-8ea9-ca79eb0fb5f9 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:20.593717 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-67d6780d-9bab-40d0-8ea9-ca79eb0fb5f9 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:20.594961 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-67d6780d-9bab-40d0-8ea9-ca79eb0fb5f9 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:20.596735 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-67d6780d-9bab-40d0-8ea9-ca79eb0fb5f9 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:20.597596 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-67d6780d-9bab-40d0-8ea9-ca79eb0fb5f9 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:21.196891 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b9b01300-31c8-4e46-966e-e0af8231e93b tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:21.209117 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b9b01300-31c8-4e46-966e-e0af8231e93b tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/9be563ca-739e-4121-9dc8-9e46c7a131b6" status: 200 len: 1316 microversion: 2.1 time: 2.624498 Oct 17 13:44:21.220919 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1263/2518] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:18 2022] GET /compute/v2.1/servers/9be563ca-739e-4121-9dc8-9e46c7a131b6 => generated 1316 bytes in 2637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:21.248721 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-056cf2a4-e9e4-48f3-81f1-b7142e50fb6c tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '.version_select at 0x7f7cd4689280>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:21.334230 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-056cf2a4-e9e4-48f3-81f1-b7142e50fb6c tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "GET /compute/v2.1/images/49da5263-076c-4bed-b977-116e50ef3ee9" status: 200 len: 1430 microversion: 2.1 time: 0.112046 Oct 17 13:44:21.344800 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1264/2519] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:44:21 2022] GET /compute/v2.1/images/49da5263-076c-4bed-b977-116e50ef3ee9 => generated 1430 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:21.361486 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-dc7dd24b-80fe-439a-94e8-a5e9829a8d72 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:21.362388 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-dc7dd24b-80fe-439a-94e8-a5e9829a8d72 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] [instance: 87114af9-1214-4182-8f68-756a1a5dfc7a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:21.379350 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc7dd24b-80fe-439a-94e8-a5e9829a8d72 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:21.380035 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc7dd24b-80fe-439a-94e8-a5e9829a8d72 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:21.380655 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc7dd24b-80fe-439a-94e8-a5e9829a8d72 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:21.381551 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc7dd24b-80fe-439a-94e8-a5e9829a8d72 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:21.382220 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc7dd24b-80fe-439a-94e8-a5e9829a8d72 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:21.382795 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc7dd24b-80fe-439a-94e8-a5e9829a8d72 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:21.561711 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-67d6780d-9bab-40d0-8ea9-ca79eb0fb5f9 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467250951f654e33b3e233868301bbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676987e95424497c94984347dd6a7988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:21.578150 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-67d6780d-9bab-40d0-8ea9-ca79eb0fb5f9 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4" status: 200 len: 1353 microversion: 2.1 time: 1.005880 Oct 17 13:44:21.578772 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1256/2520] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:20 2022] GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4 => generated 1353 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:21.600585 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bbdd55e2-77cb-4e23-bd46-9c7bae9be1be tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:21.605800 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-bbdd55e2-77cb-4e23-bd46-9c7bae9be1be tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: b1b0d02c-b32f-45cd-8732-99b1e3119ca6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:21.629409 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bbdd55e2-77cb-4e23-bd46-9c7bae9be1be tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:21.630298 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bbdd55e2-77cb-4e23-bd46-9c7bae9be1be tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:21.630975 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bbdd55e2-77cb-4e23-bd46-9c7bae9be1be tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:21.632044 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bbdd55e2-77cb-4e23-bd46-9c7bae9be1be tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:21.632746 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bbdd55e2-77cb-4e23-bd46-9c7bae9be1be tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:21.633392 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bbdd55e2-77cb-4e23-bd46-9c7bae9be1be tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:22.614934 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-dc7dd24b-80fe-439a-94e8-a5e9829a8d72 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1f69cda7724d9bb8a6beec6d4f973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87456dcb963449b2ac1c2d93da0a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:22.627932 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-dc7dd24b-80fe-439a-94e8-a5e9829a8d72 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "GET /compute/v2.1/servers/87114af9-1214-4182-8f68-756a1a5dfc7a" status: 200 len: 1467 microversion: 2.1 time: 1.269631 Oct 17 13:44:22.630871 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1265/2521] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:21 2022] GET /compute/v2.1/servers/87114af9-1214-4182-8f68-756a1a5dfc7a => generated 1467 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:44:22.714944 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b7f70dba-5f86-4de5-ac65-ee197adcd30c tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-326773653", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "478c562d-61a8-4d9e-9df9-a1fa229b4006"}]}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:44:22.786065 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-bbdd55e2-77cb-4e23-bd46-9c7bae9be1be tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:22.800530 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-bbdd55e2-77cb-4e23-bd46-9c7bae9be1be tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:22.818604 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-bbdd55e2-77cb-4e23-bd46-9c7bae9be1be tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:22.820053 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-bbdd55e2-77cb-4e23-bd46-9c7bae9be1be tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6" status: 200 len: 1488 microversion: 2.25 time: 1.232822 Oct 17 13:44:22.820666 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1257/2522] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:21 2022] GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6 => generated 1488 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:22.827036 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-90bc363e-b61c-423d-b10e-8c5a997a5bc4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:22.827687 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-90bc363e-b61c-423d-b10e-8c5a997a5bc4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 9be563ca-739e-4121-9dc8-9e46c7a131b6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:22.843775 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-b7f70dba-5f86-4de5-ac65-ee197adcd30c tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] validate_networks() for [('478c562d-61a8-4d9e-9df9-a1fa229b4006', None, None, None, None, None)] {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:44:22.847682 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-90bc363e-b61c-423d-b10e-8c5a997a5bc4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:22.850219 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-90bc363e-b61c-423d-b10e-8c5a997a5bc4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:22.850585 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-90bc363e-b61c-423d-b10e-8c5a997a5bc4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:22.851408 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-90bc363e-b61c-423d-b10e-8c5a997a5bc4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:22.853008 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-90bc363e-b61c-423d-b10e-8c5a997a5bc4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:22.853509 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-90bc363e-b61c-423d-b10e-8c5a997a5bc4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:23.388983 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-90bc363e-b61c-423d-b10e-8c5a997a5bc4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:23.401343 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-90bc363e-b61c-423d-b10e-8c5a997a5bc4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/9be563ca-739e-4121-9dc8-9e46c7a131b6" status: 200 len: 1316 microversion: 2.1 time: 0.579596 Oct 17 13:44:23.419790 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1258/2523] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:22 2022] GET /compute/v2.1/servers/9be563ca-739e-4121-9dc8-9e46c7a131b6 => generated 1316 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:23.419790 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4534d6e6-8d0d-468e-ac87-a1ebcda255cb tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:23.419790 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4534d6e6-8d0d-468e-ac87-a1ebcda255cb tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: e555208e-39b0-4361-94a5-6b272c336be4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:23.444537 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4534d6e6-8d0d-468e-ac87-a1ebcda255cb tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:23.447610 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4534d6e6-8d0d-468e-ac87-a1ebcda255cb tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:23.448363 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4534d6e6-8d0d-468e-ac87-a1ebcda255cb tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:23.451397 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4534d6e6-8d0d-468e-ac87-a1ebcda255cb tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:23.451948 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4534d6e6-8d0d-468e-ac87-a1ebcda255cb tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:23.452389 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4534d6e6-8d0d-468e-ac87-a1ebcda255cb tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:24.208340 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4534d6e6-8d0d-468e-ac87-a1ebcda255cb tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467250951f654e33b3e233868301bbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676987e95424497c94984347dd6a7988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:24.224358 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4534d6e6-8d0d-468e-ac87-a1ebcda255cb tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4" status: 200 len: 1353 microversion: 2.1 time: 0.811379 Oct 17 13:44:24.226251 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1259/2524] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:23 2022] GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4 => generated 1353 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:24.232880 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ff168e66-a13c-4f0b-805e-96b7957b0ded tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '.version_select at 0x7f7cd9876670>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:24.321005 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ff168e66-a13c-4f0b-805e-96b7957b0ded tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "GET /compute/v2.1/images/0743b21b-a6ff-4d02-897c-eabb68c3ba07" status: 200 len: 784 microversion: 2.1 time: 0.092975 Oct 17 13:44:24.321976 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1260/2525] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:44:24 2022] GET /compute/v2.1/images/0743b21b-a6ff-4d02-897c-eabb68c3ba07 => generated 784 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:44:24.499559 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-21ae0819-380b-40d5-b33b-25f5d6884f27 req-edbae286-4a02-4218-bc37-61e50c0d7465 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e555208e-39b0-4361-94a5-6b272c336be4", "name": "network-vif-plugged", "status": "completed", "tag": "7b45bf47-c253-4e30-bf75-b6963b23bf0e"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:44:24.566571 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-21ae0819-380b-40d5-b33b-25f5d6884f27 req-edbae286-4a02-4218-bc37-61e50c0d7465 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:24.567150 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-21ae0819-380b-40d5-b33b-25f5d6884f27 req-edbae286-4a02-4218-bc37-61e50c0d7465 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:24.575056 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-21ae0819-380b-40d5-b33b-25f5d6884f27 req-edbae286-4a02-4218-bc37-61e50c0d7465 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:24.620916 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-21ae0819-380b-40d5-b33b-25f5d6884f27 req-edbae286-4a02-4218-bc37-61e50c0d7465 service nova] Creating event network-vif-plugged:7b45bf47-c253-4e30-bf75-b6963b23bf0e for instance e555208e-39b0-4361-94a5-6b272c336be4 on n-h2-854247-14 Oct 17 13:44:24.666204 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-21ae0819-380b-40d5-b33b-25f5d6884f27 req-edbae286-4a02-4218-bc37-61e50c0d7465 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.342545 Oct 17 13:44:24.666726 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1261/2526] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:44:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:44:24.672441 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1b64b4aa-384b-472f-a253-bd3a2c1651a1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:24.673423 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1b64b4aa-384b-472f-a253-bd3a2c1651a1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: b1b0d02c-b32f-45cd-8732-99b1e3119ca6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:24.686947 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1b64b4aa-384b-472f-a253-bd3a2c1651a1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:24.690938 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1b64b4aa-384b-472f-a253-bd3a2c1651a1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:24.691999 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1b64b4aa-384b-472f-a253-bd3a2c1651a1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:24.694556 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1b64b4aa-384b-472f-a253-bd3a2c1651a1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:24.695373 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1b64b4aa-384b-472f-a253-bd3a2c1651a1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:24.695968 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1b64b4aa-384b-472f-a253-bd3a2c1651a1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:25.151384 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-b7f70dba-5f86-4de5-ac65-ee197adcd30c tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:44:25.152642 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-b7f70dba-5f86-4de5-ac65-ee197adcd30c tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:44:25.153397 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-b7f70dba-5f86-4de5-ac65-ee197adcd30c tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:44:25.154014 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-b7f70dba-5f86-4de5-ac65-ee197adcd30c tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:44:25.154631 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-b7f70dba-5f86-4de5-ac65-ee197adcd30c tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:44:25.157097 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:44:25.177002 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b7f70dba-5f86-4de5-ac65-ee197adcd30c tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:25.179523 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b7f70dba-5f86-4de5-ac65-ee197adcd30c tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:25.180196 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b7f70dba-5f86-4de5-ac65-ee197adcd30c tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:25.186916 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b7f70dba-5f86-4de5-ac65-ee197adcd30c tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:25.187796 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b7f70dba-5f86-4de5-ac65-ee197adcd30c tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:25.188447 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b7f70dba-5f86-4de5-ac65-ee197adcd30c tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:25.233764 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-b7f70dba-5f86-4de5-ac65-ee197adcd30c tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Getting quotas for project b3126767b1c348859c2640dc21e38f6a. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:44:25.241511 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-b7f70dba-5f86-4de5-ac65-ee197adcd30c tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Getting quotas for user 75205205ba2946fbb18918201f54e15c and project b3126767b1c348859c2640dc21e38f6a. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:44:25.261652 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b7f70dba-5f86-4de5-ac65-ee197adcd30c tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Going to run 2 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:44:25.306806 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b7f70dba-5f86-4de5-ac65-ee197adcd30c tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] [instance: 25f78ad7-b6b1-4c56-bb29-4a1e6fd7fb85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:44:25.387749 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b7f70dba-5f86-4de5-ac65-ee197adcd30c tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] [instance: 408d8179-50fa-4c27-a2e9-85dc1daaa5b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=25f78ad7-b6b1-4c56-bb29-4a1e6fd7fb85,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:44:25.421964 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1b64b4aa-384b-472f-a253-bd3a2c1651a1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:25.445621 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1b64b4aa-384b-472f-a253-bd3a2c1651a1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:25.448624 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1b64b4aa-384b-472f-a253-bd3a2c1651a1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:25.450329 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1b64b4aa-384b-472f-a253-bd3a2c1651a1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6" status: 200 len: 1488 microversion: 2.25 time: 0.782026 Oct 17 13:44:25.451886 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1262/2527] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:24 2022] GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6 => generated 1488 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:25.541758 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b7f70dba-5f86-4de5-ac65-ee197adcd30c tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.909576 Oct 17 13:44:25.546836 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1266/2528] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:44:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2915 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:44:25.559427 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-53e95f43-e96c-40e3-9c83-d7e3b5d8eaee tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:25.594019 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-53e95f43-e96c-40e3-9c83-d7e3b5d8eaee tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.042775 Oct 17 13:44:25.597798 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1267/2529] 10.222.0.79 () {58 vars in 1137 bytes} [Mon Oct 17 13:44:25 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:44:25.610432 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a501af4f-a771-4efe-925d-4368eae803d3 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:25.614426 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a501af4f-a771-4efe-925d-4368eae803d3 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 9be563ca-739e-4121-9dc8-9e46c7a131b6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:25.629131 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a501af4f-a771-4efe-925d-4368eae803d3 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:25.632562 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a501af4f-a771-4efe-925d-4368eae803d3 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:25.648080 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a501af4f-a771-4efe-925d-4368eae803d3 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:25.651226 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a501af4f-a771-4efe-925d-4368eae803d3 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:25.652893 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a501af4f-a771-4efe-925d-4368eae803d3 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:25.656527 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a501af4f-a771-4efe-925d-4368eae803d3 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:25.660433 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-eb9cc32d-a887-4a66-ad21-55115330d54e tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-472936283", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "cbfb3c7d-3acf-4722-94ad-f872872e7365"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:44:25.776870 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-eb9cc32d-a887-4a66-ad21-55115330d54e tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] validate_networks() for [('cbfb3c7d-3acf-4722-94ad-f872872e7365', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:44:26.598511 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a501af4f-a771-4efe-925d-4368eae803d3 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:26.624306 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a501af4f-a771-4efe-925d-4368eae803d3 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/9be563ca-739e-4121-9dc8-9e46c7a131b6" status: 200 len: 1316 microversion: 2.1 time: 1.022561 Oct 17 13:44:26.630286 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1268/2530] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:25 2022] GET /compute/v2.1/servers/9be563ca-739e-4121-9dc8-9e46c7a131b6 => generated 1316 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:26.640038 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b3a9f373-01d4-4540-8b33-82d63ca79ecf tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:26.645400 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b3a9f373-01d4-4540-8b33-82d63ca79ecf tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: e555208e-39b0-4361-94a5-6b272c336be4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:26.665817 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b3a9f373-01d4-4540-8b33-82d63ca79ecf tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:26.669844 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b3a9f373-01d4-4540-8b33-82d63ca79ecf tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:26.670472 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b3a9f373-01d4-4540-8b33-82d63ca79ecf tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:26.671966 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b3a9f373-01d4-4540-8b33-82d63ca79ecf tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:26.671966 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b3a9f373-01d4-4540-8b33-82d63ca79ecf tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:26.674697 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b3a9f373-01d4-4540-8b33-82d63ca79ecf tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:27.266777 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b3a9f373-01d4-4540-8b33-82d63ca79ecf tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467250951f654e33b3e233868301bbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676987e95424497c94984347dd6a7988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:27.292602 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b3a9f373-01d4-4540-8b33-82d63ca79ecf tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4" status: 200 len: 1353 microversion: 2.1 time: 0.657478 Oct 17 13:44:27.296451 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1269/2531] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:26 2022] GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4 => generated 1353 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:27.324200 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-bd0458bf-456e-446f-b649-3a805253dc6a tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:27.352436 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-bd0458bf-456e-446f-b649-3a805253dc6a tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '75205205ba2946fbb18918201f54e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3126767b1c348859c2640dc21e38f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:27.353474 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-bd0458bf-456e-446f-b649-3a805253dc6a tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Searching by: {'deleted': False, 'project_id': 'b3126767b1c348859c2640dc21e38f6a'} {{(pid=127016) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:44:27.377001 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bd0458bf-456e-446f-b649-3a805253dc6a tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:27.382829 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bd0458bf-456e-446f-b649-3a805253dc6a tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:27.383402 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bd0458bf-456e-446f-b649-3a805253dc6a tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:27.384291 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bd0458bf-456e-446f-b649-3a805253dc6a tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:27.392718 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bd0458bf-456e-446f-b649-3a805253dc6a tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:27.394369 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bd0458bf-456e-446f-b649-3a805253dc6a tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:27.452802 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.multi_cell_list [None req-bd0458bf-456e-446f-b649-3a805253dc6a tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127016) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:44:27.531603 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-bd0458bf-456e-446f-b649-3a805253dc6a tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] 10.222.0.79 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.228225 Oct 17 13:44:27.533758 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1270/2532] 10.222.0.79 () {58 vars in 1125 bytes} [Mon Oct 17 13:44:27 2022] GET /compute/v2.1/servers => generated 675 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:44:27.549856 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-acf8ea24-fc63-4a7d-952e-9518b00e43cf tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '.version_select at 0x7f7cd4689ee0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:27.596884 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-eb9cc32d-a887-4a66-ad21-55115330d54e tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:44:27.597938 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-eb9cc32d-a887-4a66-ad21-55115330d54e tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:44:27.600236 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-eb9cc32d-a887-4a66-ad21-55115330d54e tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:44:27.601459 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-eb9cc32d-a887-4a66-ad21-55115330d54e tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:44:27.602848 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-eb9cc32d-a887-4a66-ad21-55115330d54e tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:44:27.646905 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eb9cc32d-a887-4a66-ad21-55115330d54e tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:27.647885 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eb9cc32d-a887-4a66-ad21-55115330d54e tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:27.648327 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eb9cc32d-a887-4a66-ad21-55115330d54e tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:27.649066 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eb9cc32d-a887-4a66-ad21-55115330d54e tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:27.649518 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eb9cc32d-a887-4a66-ad21-55115330d54e tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:27.649964 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eb9cc32d-a887-4a66-ad21-55115330d54e tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:27.801239 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-eb9cc32d-a887-4a66-ad21-55115330d54e tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Getting quotas for project 46a3aa5210b549fc95cd534135624ab5. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:44:27.821741 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-eb9cc32d-a887-4a66-ad21-55115330d54e tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Getting quotas for user fc181092e9cb42e6a751e9bec506d7f5 and project 46a3aa5210b549fc95cd534135624ab5. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:44:27.873520 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-eb9cc32d-a887-4a66-ad21-55115330d54e tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:44:27.879482 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-eb9cc32d-a887-4a66-ad21-55115330d54e tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] [instance: f59dba6a-0058-4aeb-a3b0-3e0209d928c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:44:28.045867 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-eb9cc32d-a887-4a66-ad21-55115330d54e tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.592448 Oct 17 13:44:28.046557 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1263/2533] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:44:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2594 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:44:28.068149 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f7be84d3-96e9-41b4-8414-fd1d8f21d19b tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "b7f39990-8117-4dab-aa7f-670835aec783"}], "security_groups": [{"name": "tempest-securitygroup--545141614"}], "key_name": "tempest-keypair-578260608", "user_data": "}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:44:28.422075 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-f7be84d3-96e9-41b4-8414-fd1d8f21d19b tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] validate_networks() for [('b7f39990-8117-4dab-aa7f-670835aec783', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:44:29.021262 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-acf8ea24-fc63-4a7d-952e-9518b00e43cf tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "DELETE /compute/v2.1/images/49da5263-076c-4bed-b977-116e50ef3ee9" status: 204 len: 0 microversion: 2.1 time: 1.485003 Oct 17 13:44:29.022025 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1271/2534] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:27 2022] DELETE /compute/v2.1/images/49da5263-076c-4bed-b977-116e50ef3ee9 => generated 0 bytes in 1488 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:44:29.031288 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-39bd1914-04df-4297-9e9d-2901f280f07d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:29.032192 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-39bd1914-04df-4297-9e9d-2901f280f07d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: b1b0d02c-b32f-45cd-8732-99b1e3119ca6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:29.056840 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-39bd1914-04df-4297-9e9d-2901f280f07d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:29.057394 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-39bd1914-04df-4297-9e9d-2901f280f07d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:29.059644 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-39bd1914-04df-4297-9e9d-2901f280f07d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:29.061504 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-39bd1914-04df-4297-9e9d-2901f280f07d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:29.061990 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-39bd1914-04df-4297-9e9d-2901f280f07d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:29.065484 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-39bd1914-04df-4297-9e9d-2901f280f07d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:29.922576 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-39bd1914-04df-4297-9e9d-2901f280f07d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:29.943000 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-39bd1914-04df-4297-9e9d-2901f280f07d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:29.944859 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-39bd1914-04df-4297-9e9d-2901f280f07d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:29.948234 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-39bd1914-04df-4297-9e9d-2901f280f07d tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6" status: 200 len: 1478 microversion: 2.25 time: 0.925051 Oct 17 13:44:29.950751 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1272/2535] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:29 2022] GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6 => generated 1478 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:29.965370 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-3ccb6916-b829-4906-86c7-258d97ff8374 req-2a13bbbe-f767-4168-978f-bdecbb0455a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e555208e-39b0-4361-94a5-6b272c336be4", "name": "network-vif-plugged", "status": "completed", "tag": "7383d71d-5872-4de8-87b0-e2c48915669c"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:44:30.010491 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-3ccb6916-b829-4906-86c7-258d97ff8374 req-2a13bbbe-f767-4168-978f-bdecbb0455a7 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:30.011142 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-3ccb6916-b829-4906-86c7-258d97ff8374 req-2a13bbbe-f767-4168-978f-bdecbb0455a7 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:30.012689 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-3ccb6916-b829-4906-86c7-258d97ff8374 req-2a13bbbe-f767-4168-978f-bdecbb0455a7 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:30.052081 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-3ccb6916-b829-4906-86c7-258d97ff8374 req-2a13bbbe-f767-4168-978f-bdecbb0455a7 service nova] Creating event network-vif-plugged:7383d71d-5872-4de8-87b0-e2c48915669c for instance e555208e-39b0-4361-94a5-6b272c336be4 on n-h2-854247-14 Oct 17 13:44:30.069107 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-3ccb6916-b829-4906-86c7-258d97ff8374 req-2a13bbbe-f767-4168-978f-bdecbb0455a7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112766 Oct 17 13:44:30.070515 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1273/2536] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:44:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:44:30.081883 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e936f551-8692-4542-95ce-e9e40e663658 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:30.082765 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e936f551-8692-4542-95ce-e9e40e663658 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] [instance: 25f78ad7-b6b1-4c56-bb29-4a1e6fd7fb85] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:30.099326 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e936f551-8692-4542-95ce-e9e40e663658 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:30.099828 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e936f551-8692-4542-95ce-e9e40e663658 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:30.100267 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e936f551-8692-4542-95ce-e9e40e663658 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:30.103961 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e936f551-8692-4542-95ce-e9e40e663658 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:30.104449 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e936f551-8692-4542-95ce-e9e40e663658 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:30.104940 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e936f551-8692-4542-95ce-e9e40e663658 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:30.242419 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e936f551-8692-4542-95ce-e9e40e663658 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75205205ba2946fbb18918201f54e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3126767b1c348859c2640dc21e38f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:30.257313 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e936f551-8692-4542-95ce-e9e40e663658 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] 10.222.0.79 "GET /compute/v2.1/servers/25f78ad7-b6b1-4c56-bb29-4a1e6fd7fb85" status: 200 len: 1277 microversion: 2.1 time: 0.180809 Oct 17 13:44:30.258328 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1274/2537] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:30 2022] GET /compute/v2.1/servers/25f78ad7-b6b1-4c56-bb29-4a1e6fd7fb85 => generated 1277 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:30.284580 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9fc2f786-9eb8-4057-951d-aab1cc98b32a tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:30.285581 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9fc2f786-9eb8-4057-951d-aab1cc98b32a tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 9be563ca-739e-4121-9dc8-9e46c7a131b6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:30.295696 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9fc2f786-9eb8-4057-951d-aab1cc98b32a tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:30.297207 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9fc2f786-9eb8-4057-951d-aab1cc98b32a tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:30.300632 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9fc2f786-9eb8-4057-951d-aab1cc98b32a tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:30.301517 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9fc2f786-9eb8-4057-951d-aab1cc98b32a tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:30.301994 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9fc2f786-9eb8-4057-951d-aab1cc98b32a tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:30.305819 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9fc2f786-9eb8-4057-951d-aab1cc98b32a tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:30.365935 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=100 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:44:30.771069 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-f7be84d3-96e9-41b4-8414-fd1d8f21d19b tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:44:30.771793 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-f7be84d3-96e9-41b4-8414-fd1d8f21d19b tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:44:30.771993 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-f7be84d3-96e9-41b4-8414-fd1d8f21d19b tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:44:30.772733 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-f7be84d3-96e9-41b4-8414-fd1d8f21d19b tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:44:30.773301 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-f7be84d3-96e9-41b4-8414-fd1d8f21d19b tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:44:30.794140 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f7be84d3-96e9-41b4-8414-fd1d8f21d19b tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:30.794631 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f7be84d3-96e9-41b4-8414-fd1d8f21d19b tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:30.795075 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f7be84d3-96e9-41b4-8414-fd1d8f21d19b tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:30.795849 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f7be84d3-96e9-41b4-8414-fd1d8f21d19b tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:30.796302 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f7be84d3-96e9-41b4-8414-fd1d8f21d19b tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:30.796728 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f7be84d3-96e9-41b4-8414-fd1d8f21d19b tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:30.838130 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-f7be84d3-96e9-41b4-8414-fd1d8f21d19b tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Getting quotas for project 341aac3733474b58a6ce8724c8bba334. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:44:30.846499 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-f7be84d3-96e9-41b4-8414-fd1d8f21d19b tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Getting quotas for user ecb93a068a854ec9a2c082b380e22466 and project 341aac3733474b58a6ce8724c8bba334. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:44:30.880161 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f7be84d3-96e9-41b4-8414-fd1d8f21d19b tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:44:30.882472 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f7be84d3-96e9-41b4-8414-fd1d8f21d19b tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] [instance: c8ec85bf-e448-4a4b-998d-a6bedb89d5e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:44:30.923496 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9fc2f786-9eb8-4057-951d-aab1cc98b32a tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:30.937748 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9fc2f786-9eb8-4057-951d-aab1cc98b32a tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/9be563ca-739e-4121-9dc8-9e46c7a131b6" status: 200 len: 1316 microversion: 2.1 time: 0.674731 Oct 17 13:44:30.938390 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1275/2538] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:30 2022] GET /compute/v2.1/servers/9be563ca-739e-4121-9dc8-9e46c7a131b6 => generated 1316 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:30.966285 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-75924305-7b32-4555-b040-90e8baafd37e tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:30.967316 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-75924305-7b32-4555-b040-90e8baafd37e tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] [instance: f59dba6a-0058-4aeb-a3b0-3e0209d928c4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:30.980157 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-75924305-7b32-4555-b040-90e8baafd37e tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:30.980957 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-75924305-7b32-4555-b040-90e8baafd37e tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:30.985563 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-75924305-7b32-4555-b040-90e8baafd37e tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:30.986612 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-75924305-7b32-4555-b040-90e8baafd37e tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:30.987295 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-75924305-7b32-4555-b040-90e8baafd37e tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:30.987920 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-75924305-7b32-4555-b040-90e8baafd37e tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:31.003122 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f7be84d3-96e9-41b4-8414-fd1d8f21d19b tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.943888 Oct 17 13:44:31.005436 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1264/2539] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:44:28 2022] POST /compute/v2.1/servers => generated 408 bytes in 2958 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:44:31.017383 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ac67d231-5bed-482e-a120-4fe8ce8d14d5 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:31.036791 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ac67d231-5bed-482e-a120-4fe8ce8d14d5 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: e555208e-39b0-4361-94a5-6b272c336be4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:31.054893 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac67d231-5bed-482e-a120-4fe8ce8d14d5 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:31.055414 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac67d231-5bed-482e-a120-4fe8ce8d14d5 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:31.064521 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac67d231-5bed-482e-a120-4fe8ce8d14d5 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:31.065685 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac67d231-5bed-482e-a120-4fe8ce8d14d5 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:31.066070 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac67d231-5bed-482e-a120-4fe8ce8d14d5 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:31.067002 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac67d231-5bed-482e-a120-4fe8ce8d14d5 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:31.192244 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-75924305-7b32-4555-b040-90e8baafd37e tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc181092e9cb42e6a751e9bec506d7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a3aa5210b549fc95cd534135624ab5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:31.212173 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-75924305-7b32-4555-b040-90e8baafd37e tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] 10.222.0.79 "GET /compute/v2.1/servers/f59dba6a-0058-4aeb-a3b0-3e0209d928c4" status: 200 len: 1282 microversion: 2.1 time: 0.271804 Oct 17 13:44:31.214773 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1276/2540] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:30 2022] GET /compute/v2.1/servers/f59dba6a-0058-4aeb-a3b0-3e0209d928c4 => generated 1282 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:31.231675 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-44ceb60c-2a33-4e67-bf8c-387e3ac17e73 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '.version_select at 0x7f7cd46e7430>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:31.286110 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-44ceb60c-2a33-4e67-bf8c-387e3ac17e73 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] HTTP exception thrown: Image not found. Oct 17 13:44:31.292967 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-44ceb60c-2a33-4e67-bf8c-387e3ac17e73 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Request method failure captured: Oct 17 13:44:31.292967 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/images/49da5263-076c-4bed-b977-116e50ef3ee9 HTTP/1.1 Oct 17 13:44:31.292967 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:44:31.292967 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:44:31.292967 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:44:31.292967 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:44:31.292967 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:44:31.292967 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:44:31.292967 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:44:31.292967 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:44:31.292967 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVv5BiKexrKvNbOl9A5FHtFV5mHehkwNbAoSAIsxyajSewiHDmmi2twNZBXlpujzoA265PfVkE-1IwZZm0IyESrVBaD0vciWX3eiruV4FpvSfn-F31Q-fvzCfNuXByY4yUholHF08eDyDs0t57RjfWJ2DQ1A52B7Q_xuIach-5Oj8eY Oct 17 13:44:31.292967 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:44:31.292967 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:44:31.292967 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:44:31.292967 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:44:31.292967 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:44:31.292967 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:44:31.292967 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 87456dcb963449b2ac1c2d93da0a4ec7 Oct 17 13:44:31.292967 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ImagesOneServerTestJSON-921891472 Oct 17 13:44:31.292967 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:44:31.292967 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:44:31.292967 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/87456dcb963449b2ac1c2d93da0a4ec7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/87456dcb963449b2ac1c2d93da0a4ec7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/87456dcb963449b2ac1c2d93da0a4ec7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_87456dcb963449b2ac1c2d93da0a4ec7", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:44:31.292967 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ImagesOneServerTestJSON-921891472 Oct 17 13:44:31.292967 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 87456dcb963449b2ac1c2d93da0a4ec7 Oct 17 13:44:31.292967 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-921891472 Oct 17 13:44:31.292967 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ImagesOneServerTestJSON-921891472-project Oct 17 13:44:31.292967 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:44:31.292967 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:44:31.292967 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: dc1f69cda7724d9bb8a6beec6d4f973e Oct 17 13:44:31.292967 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ImagesOneServerTestJSON-921891472-project Oct 17 13:44:31.292967 n-d-854247-14 devstack@n-api.service[127016]: method: Oct 17 13:44:31.292967 n-d-854247-14 devstack@n-api.service[127016]: exception: Image not found. Oct 17 13:44:31.292967 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '49da5263-076c-4bed-b977-116e50ef3ee9'} Oct 17 13:44:31.292967 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:44:31.292967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:44:31.292967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 13:44:31.292967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 13:44:31.292967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:44:31.292967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:44:31.292967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 13:44:31.292967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 13:44:31.292967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:44:31.292967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:44:31.292967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 13:44:31.292967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 13:44:31.292967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 13:44:31.292967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 13:44:31.292967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:44:31.292967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:44:31.292967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:44:31.292967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:44:31.292967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 49da5263-076c-4bed-b977-116e50ef3ee9 Oct 17 13:44:31.292967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:44:31.292967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:44:31.292967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:44:31.292967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:44:31.292967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 17 13:44:31.292967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 17 13:44:31.292967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 17 13:44:31.292967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 17 13:44:31.292967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 17 13:44:31.292967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 17 13:44:31.292967 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 17 13:44:31.297324 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 17 13:44:31.297324 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 13:44:31.297324 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 13:44:31.297324 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:44:31.297324 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:44:31.297324 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 13:44:31.297324 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 13:44:31.297324 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:44:31.297324 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:44:31.297324 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 13:44:31.297324 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 13:44:31.297324 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 13:44:31.297324 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 13:44:31.297324 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:44:31.297324 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:44:31.297324 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:44:31.297324 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:44:31.297324 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 49da5263-076c-4bed-b977-116e50ef3ee9 could not be found. Oct 17 13:44:31.297324 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:44:31.297324 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:44:31.297324 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:44:31.297324 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:44:31.297324 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:44:31.297324 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:44:31.297324 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:44:31.297324 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:44:31.297324 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:44:31.297324 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:44:31.297324 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:44:31.297324 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:44:31.297324 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 17 13:44:31.297324 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 13:44:31.297324 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 13:44:31.297324 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:44:31.297324 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:44:31.297324 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:44:31.297324 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:44:31.297324 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:44:31.297324 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:44:31.297324 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:44:31.297324 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:44:31.297324 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 13:44:31.297324 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:44:31.297324 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-44ceb60c-2a33-4e67-bf8c-387e3ac17e73 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Returning 404 to user: Image not found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:44:31.297324 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-44ceb60c-2a33-4e67-bf8c-387e3ac17e73 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "GET /compute/v2.1/images/49da5263-076c-4bed-b977-116e50ef3ee9" status: 404 len: 62 microversion: 2.1 time: 0.077315 Oct 17 13:44:31.301340 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1277/2541] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:44:31 2022] GET /compute/v2.1/images/49da5263-076c-4bed-b977-116e50ef3ee9 => generated 62 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:44:31.308931 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-734ad58b-8d5e-4aea-93ce-98d440275bc6 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:31.312683 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-734ad58b-8d5e-4aea-93ce-98d440275bc6 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] [instance: 2184ae8f-022d-4de9-8d0f-0c2d546c9d6f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:31.322189 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-734ad58b-8d5e-4aea-93ce-98d440275bc6 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:31.322670 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-734ad58b-8d5e-4aea-93ce-98d440275bc6 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:31.323227 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-734ad58b-8d5e-4aea-93ce-98d440275bc6 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:31.323949 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-734ad58b-8d5e-4aea-93ce-98d440275bc6 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:31.324676 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-734ad58b-8d5e-4aea-93ce-98d440275bc6 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:31.325451 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-734ad58b-8d5e-4aea-93ce-98d440275bc6 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:31.386830 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-734ad58b-8d5e-4aea-93ce-98d440275bc6 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] 10.222.0.79 "GET /compute/v2.1/servers/2184ae8f-022d-4de9-8d0f-0c2d546c9d6f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.084169 Oct 17 13:44:31.387853 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1278/2542] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 13:44:31 2022] GET /compute/v2.1/servers/2184ae8f-022d-4de9-8d0f-0c2d546c9d6f/os-volume_attachments => generated 25 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:44:31.394817 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-16875a4c-58ee-4232-864c-2769de383aa1 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Calling method '.version_select at 0x7f7cd45d8550>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:31.401735 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-16875a4c-58ee-4232-864c-2769de383aa1 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:31.401735 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-16875a4c-58ee-4232-864c-2769de383aa1 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:31.401735 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-16875a4c-58ee-4232-864c-2769de383aa1 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:31.416403 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-16875a4c-58ee-4232-864c-2769de383aa1 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] 10.222.0.79 "GET /compute/v2.1/os-migrations" status: 200 len: 1712 microversion: 2.25 time: 0.027081 Oct 17 13:44:31.417716 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1279/2543] 10.222.0.79 () {60 vars in 1184 bytes} [Mon Oct 17 13:44:31 2022] GET /compute/v2.1/os-migrations => generated 1712 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:31.431459 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-daf9dce4-02eb-4b8a-81fc-4abe05d9df85 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:31.432514 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-daf9dce4-02eb-4b8a-81fc-4abe05d9df85 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] [instance: c8ec85bf-e448-4a4b-998d-a6bedb89d5e8] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:31.462100 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ac67d231-5bed-482e-a120-4fe8ce8d14d5 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467250951f654e33b3e233868301bbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676987e95424497c94984347dd6a7988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:31.498776 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ac67d231-5bed-482e-a120-4fe8ce8d14d5 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4" status: 200 len: 1353 microversion: 2.1 time: 0.467674 Oct 17 13:44:31.500531 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1265/2544] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:31 2022] GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4 => generated 1353 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:31.507654 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ab79d86e-42b8-41a1-ac58-e3b333bf7f2d tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:31.509622 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ab79d86e-42b8-41a1-ac58-e3b333bf7f2d tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] [instance: 25f78ad7-b6b1-4c56-bb29-4a1e6fd7fb85] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:31.543540 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ab79d86e-42b8-41a1-ac58-e3b333bf7f2d tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:31.544500 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ab79d86e-42b8-41a1-ac58-e3b333bf7f2d tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:31.545132 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ab79d86e-42b8-41a1-ac58-e3b333bf7f2d tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:31.546432 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ab79d86e-42b8-41a1-ac58-e3b333bf7f2d tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:31.547053 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ab79d86e-42b8-41a1-ac58-e3b333bf7f2d tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:31.567477 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ab79d86e-42b8-41a1-ac58-e3b333bf7f2d tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:31.649097 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-daf9dce4-02eb-4b8a-81fc-4abe05d9df85 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb93a068a854ec9a2c082b380e22466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '341aac3733474b58a6ce8724c8bba334', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:31.660577 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-daf9dce4-02eb-4b8a-81fc-4abe05d9df85 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] 10.222.0.79 "GET /compute/v2.1/servers/c8ec85bf-e448-4a4b-998d-a6bedb89d5e8" status: 200 len: 1225 microversion: 2.1 time: 0.239723 Oct 17 13:44:31.663527 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1280/2545] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:31 2022] GET /compute/v2.1/servers/c8ec85bf-e448-4a4b-998d-a6bedb89d5e8 => generated 1225 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:31.682289 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b11852a8-9a51-4640-b08e-79f2ba341856 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-974471610"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:44:31.689331 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b11852a8-9a51-4640-b08e-79f2ba341856 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] [instance: 87114af9-1214-4182-8f68-756a1a5dfc7a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:31.743155 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b11852a8-9a51-4640-b08e-79f2ba341856 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:31.743681 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b11852a8-9a51-4640-b08e-79f2ba341856 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:31.747597 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b11852a8-9a51-4640-b08e-79f2ba341856 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:31.748599 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b11852a8-9a51-4640-b08e-79f2ba341856 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:31.749089 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b11852a8-9a51-4640-b08e-79f2ba341856 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:31.749531 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b11852a8-9a51-4640-b08e-79f2ba341856 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:32.207122 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b11852a8-9a51-4640-b08e-79f2ba341856 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "POST /compute/v2.1/servers/87114af9-1214-4182-8f68-756a1a5dfc7a/action" status: 202 len: 0 microversion: 2.1 time: 0.540221 Oct 17 13:44:32.210095 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1281/2546] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:44:31 2022] POST /compute/v2.1/servers/87114af9-1214-4182-8f68-756a1a5dfc7a/action => generated 0 bytes in 546 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 17 13:44:32.227143 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8b99b722-be7d-435e-8632-9da461640476 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:32.228294 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8b99b722-be7d-435e-8632-9da461640476 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] [instance: b1b0d02c-b32f-45cd-8732-99b1e3119ca6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:32.238319 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8b99b722-be7d-435e-8632-9da461640476 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:32.239646 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8b99b722-be7d-435e-8632-9da461640476 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:32.240437 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8b99b722-be7d-435e-8632-9da461640476 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:32.241886 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8b99b722-be7d-435e-8632-9da461640476 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:32.242550 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8b99b722-be7d-435e-8632-9da461640476 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:32.246005 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8b99b722-be7d-435e-8632-9da461640476 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:32.660550 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ab79d86e-42b8-41a1-ac58-e3b333bf7f2d tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75205205ba2946fbb18918201f54e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3126767b1c348859c2640dc21e38f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:32.675079 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ab79d86e-42b8-41a1-ac58-e3b333bf7f2d tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] 10.222.0.79 "GET /compute/v2.1/servers/25f78ad7-b6b1-4c56-bb29-4a1e6fd7fb85" status: 200 len: 1319 microversion: 2.1 time: 1.173179 Oct 17 13:44:32.677960 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1266/2547] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:31 2022] GET /compute/v2.1/servers/25f78ad7-b6b1-4c56-bb29-4a1e6fd7fb85 => generated 1319 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:32.701523 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4e8b2a4a-16a4-4ae5-a0e7-0f1ebe0b9f69 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:32.711241 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4e8b2a4a-16a4-4ae5-a0e7-0f1ebe0b9f69 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] [instance: 2184ae8f-022d-4de9-8d0f-0c2d546c9d6f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:32.752366 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4e8b2a4a-16a4-4ae5-a0e7-0f1ebe0b9f69 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:32.753207 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4e8b2a4a-16a4-4ae5-a0e7-0f1ebe0b9f69 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:32.753855 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4e8b2a4a-16a4-4ae5-a0e7-0f1ebe0b9f69 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:32.754911 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4e8b2a4a-16a4-4ae5-a0e7-0f1ebe0b9f69 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:32.755628 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4e8b2a4a-16a4-4ae5-a0e7-0f1ebe0b9f69 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:32.756808 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4e8b2a4a-16a4-4ae5-a0e7-0f1ebe0b9f69 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:32.776541 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-8b99b722-be7d-435e-8632-9da461640476 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] Lazy-loading 'services' on Instance uuid b1b0d02c-b32f-45cd-8732-99b1e3119ca6 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:44:32.803108 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4e8b2a4a-16a4-4ae5-a0e7-0f1ebe0b9f69 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] 10.222.0.79 "GET /compute/v2.1/servers/2184ae8f-022d-4de9-8d0f-0c2d546c9d6f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.121518 Oct 17 13:44:32.804391 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1267/2548] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 13:44:32 2022] GET /compute/v2.1/servers/2184ae8f-022d-4de9-8d0f-0c2d546c9d6f/os-volume_attachments => generated 25 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:44:32.811111 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1c8f8588-dcf6-4076-900e-e01f37ccc298 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:32.812067 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1c8f8588-dcf6-4076-900e-e01f37ccc298 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 9be563ca-739e-4121-9dc8-9e46c7a131b6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:32.817623 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8b99b722-be7d-435e-8632-9da461640476 tempest-LiveAutoBlockMigrationV225Test-1508570263 tempest-LiveAutoBlockMigrationV225Test-1508570263-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6" status: 200 len: 1973 microversion: 2.25 time: 0.600558 Oct 17 13:44:32.820073 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1282/2549] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:32 2022] GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6 => generated 1973 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:32.820693 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c8f8588-dcf6-4076-900e-e01f37ccc298 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:32.821329 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c8f8588-dcf6-4076-900e-e01f37ccc298 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:32.821919 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c8f8588-dcf6-4076-900e-e01f37ccc298 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:32.822765 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c8f8588-dcf6-4076-900e-e01f37ccc298 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:32.823580 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c8f8588-dcf6-4076-900e-e01f37ccc298 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:32.824238 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c8f8588-dcf6-4076-900e-e01f37ccc298 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:32.831413 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2050d873-6c71-42c2-b218-144856e7b549 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '.version_select at 0x7f7cd45b59d0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:32.917143 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2050d873-6c71-42c2-b218-144856e7b549 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "GET /compute/v2.1/images/545ba6e2-5330-47da-8d7e-390d40909596" status: 200 len: 1426 microversion: 2.1 time: 0.095930 Oct 17 13:44:32.918026 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1283/2550] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:44:32 2022] GET /compute/v2.1/images/545ba6e2-5330-47da-8d7e-390d40909596 => generated 1426 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:32.927834 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5abbfce0-2bac-4c46-8094-c542d0154fe7 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:32.929044 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5abbfce0-2bac-4c46-8094-c542d0154fe7 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] [instance: f59dba6a-0058-4aeb-a3b0-3e0209d928c4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:32.938478 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5abbfce0-2bac-4c46-8094-c542d0154fe7 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:32.939358 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5abbfce0-2bac-4c46-8094-c542d0154fe7 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:32.940210 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5abbfce0-2bac-4c46-8094-c542d0154fe7 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:32.941103 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5abbfce0-2bac-4c46-8094-c542d0154fe7 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:32.942794 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5abbfce0-2bac-4c46-8094-c542d0154fe7 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:32.943319 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5abbfce0-2bac-4c46-8094-c542d0154fe7 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:33.100782 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5abbfce0-2bac-4c46-8094-c542d0154fe7 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc181092e9cb42e6a751e9bec506d7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a3aa5210b549fc95cd534135624ab5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:33.112314 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5abbfce0-2bac-4c46-8094-c542d0154fe7 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] 10.222.0.79 "GET /compute/v2.1/servers/f59dba6a-0058-4aeb-a3b0-3e0209d928c4" status: 200 len: 1282 microversion: 2.1 time: 0.193507 Oct 17 13:44:33.113490 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1284/2551] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:32 2022] GET /compute/v2.1/servers/f59dba6a-0058-4aeb-a3b0-3e0209d928c4 => generated 1282 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:33.119467 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-de63469f-91a0-4559-aa7c-48861889ee0c req-b24af94b-e89c-441f-a08f-657914e0df45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e555208e-39b0-4361-94a5-6b272c336be4", "name": "network-vif-plugged", "status": "completed", "tag": "dde3317b-4b55-489e-8fdb-a5cb0e8852af"}, {"server_uuid": "87114af9-1214-4182-8f68-756a1a5dfc7a", "name": "network-vif-unplugged", "status": "completed", "tag": "cde412a7-8204-4c39-8f24-2d2a36d636f9"}, {"server_uuid": "9be563ca-739e-4121-9dc8-9e46c7a131b6", "name": "network-vif-plugged", "status": "completed", "tag": "3949bca1-350d-456b-8b19-4ce4d228854d"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:44:33.135823 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-de63469f-91a0-4559-aa7c-48861889ee0c req-b24af94b-e89c-441f-a08f-657914e0df45 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:33.136595 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-de63469f-91a0-4559-aa7c-48861889ee0c req-b24af94b-e89c-441f-a08f-657914e0df45 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:33.137173 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-de63469f-91a0-4559-aa7c-48861889ee0c req-b24af94b-e89c-441f-a08f-657914e0df45 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:33.161562 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-de63469f-91a0-4559-aa7c-48861889ee0c req-b24af94b-e89c-441f-a08f-657914e0df45 service nova] Creating event network-vif-plugged:dde3317b-4b55-489e-8fdb-a5cb0e8852af for instance e555208e-39b0-4361-94a5-6b272c336be4 on n-h2-854247-14 Oct 17 13:44:33.163760 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-de63469f-91a0-4559-aa7c-48861889ee0c req-b24af94b-e89c-441f-a08f-657914e0df45 service nova] Creating event network-vif-unplugged:cde412a7-8204-4c39-8f24-2d2a36d636f9 for instance 87114af9-1214-4182-8f68-756a1a5dfc7a on n-h2-854247-14 Oct 17 13:44:33.167366 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-de63469f-91a0-4559-aa7c-48861889ee0c req-b24af94b-e89c-441f-a08f-657914e0df45 service nova] Creating event network-vif-plugged:3949bca1-350d-456b-8b19-4ce4d228854d for instance 9be563ca-739e-4121-9dc8-9e46c7a131b6 on n-h1-854247-14 Oct 17 13:44:33.198742 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1c8f8588-dcf6-4076-900e-e01f37ccc298 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:33.201503 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-de63469f-91a0-4559-aa7c-48861889ee0c req-b24af94b-e89c-441f-a08f-657914e0df45 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.085923 Oct 17 13:44:33.202802 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1285/2552] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:44:33 2022] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:44:33.213421 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1c8f8588-dcf6-4076-900e-e01f37ccc298 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/9be563ca-739e-4121-9dc8-9e46c7a131b6" status: 200 len: 1316 microversion: 2.1 time: 0.407707 Oct 17 13:44:33.214844 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1268/2553] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:32 2022] GET /compute/v2.1/servers/9be563ca-739e-4121-9dc8-9e46c7a131b6 => generated 1316 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:33.221216 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b5e5c9fb-7cab-48b3-ba14-cbcac953dbe4 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:33.222150 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b5e5c9fb-7cab-48b3-ba14-cbcac953dbe4 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] [instance: c8ec85bf-e448-4a4b-998d-a6bedb89d5e8] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:33.228894 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b5e5c9fb-7cab-48b3-ba14-cbcac953dbe4 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:33.229420 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ff150238-1985-4537-a49a-dc901e1d647c tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:33.230284 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ff150238-1985-4537-a49a-dc901e1d647c tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: e555208e-39b0-4361-94a5-6b272c336be4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:33.230672 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b5e5c9fb-7cab-48b3-ba14-cbcac953dbe4 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:33.231656 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b5e5c9fb-7cab-48b3-ba14-cbcac953dbe4 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:33.232959 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b5e5c9fb-7cab-48b3-ba14-cbcac953dbe4 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:33.233835 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b5e5c9fb-7cab-48b3-ba14-cbcac953dbe4 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:33.234630 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b5e5c9fb-7cab-48b3-ba14-cbcac953dbe4 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:33.247091 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ff150238-1985-4537-a49a-dc901e1d647c tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:33.252259 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ff150238-1985-4537-a49a-dc901e1d647c tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:33.253619 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ff150238-1985-4537-a49a-dc901e1d647c tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:33.254596 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ff150238-1985-4537-a49a-dc901e1d647c tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:33.255238 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ff150238-1985-4537-a49a-dc901e1d647c tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:33.255815 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ff150238-1985-4537-a49a-dc901e1d647c tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:33.420487 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b5e5c9fb-7cab-48b3-ba14-cbcac953dbe4 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb93a068a854ec9a2c082b380e22466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '341aac3733474b58a6ce8724c8bba334', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:33.432378 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b5e5c9fb-7cab-48b3-ba14-cbcac953dbe4 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] 10.222.0.79 "GET /compute/v2.1/servers/c8ec85bf-e448-4a4b-998d-a6bedb89d5e8" status: 200 len: 1285 microversion: 2.1 time: 0.216000 Oct 17 13:44:33.433501 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1269/2554] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:33 2022] GET /compute/v2.1/servers/c8ec85bf-e448-4a4b-998d-a6bedb89d5e8 => generated 1285 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:33.439160 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-17b749a1-e059-4f86-b5bf-0db83e54044e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:33.439921 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-17b749a1-e059-4f86-b5bf-0db83e54044e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: b1b0d02c-b32f-45cd-8732-99b1e3119ca6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:33.448666 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-17b749a1-e059-4f86-b5bf-0db83e54044e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:33.449479 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-17b749a1-e059-4f86-b5bf-0db83e54044e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:33.451987 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-17b749a1-e059-4f86-b5bf-0db83e54044e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:33.452950 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-17b749a1-e059-4f86-b5bf-0db83e54044e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:33.453598 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-17b749a1-e059-4f86-b5bf-0db83e54044e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:33.454342 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-17b749a1-e059-4f86-b5bf-0db83e54044e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:33.493071 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-17b749a1-e059-4f86-b5bf-0db83e54044e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: b1b0d02c-b32f-45cd-8732-99b1e3119ca6] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:44:33.590671 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:44:33.674996 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-17b749a1-e059-4f86-b5bf-0db83e54044e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "DELETE /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6" status: 204 len: 0 microversion: 2.25 time: 0.239133 Oct 17 13:44:33.676439 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1270/2555] 10.222.0.79 () {60 vars in 1280 bytes} [Mon Oct 17 13:44:33 2022] DELETE /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:44:33.718977 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ff150238-1985-4537-a49a-dc901e1d647c tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467250951f654e33b3e233868301bbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676987e95424497c94984347dd6a7988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:33.733044 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ff150238-1985-4537-a49a-dc901e1d647c tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4" status: 200 len: 1353 microversion: 2.1 time: 0.527618 Oct 17 13:44:33.734337 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1286/2556] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:33 2022] GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4 => generated 1353 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:33.748903 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3a1381b6-8ea3-44a7-ba2c-6c8dfaf9a823 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:33.759323 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3a1381b6-8ea3-44a7-ba2c-6c8dfaf9a823 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] [instance: 2184ae8f-022d-4de9-8d0f-0c2d546c9d6f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:33.773887 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3a1381b6-8ea3-44a7-ba2c-6c8dfaf9a823 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:33.774389 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3a1381b6-8ea3-44a7-ba2c-6c8dfaf9a823 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:33.774830 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3a1381b6-8ea3-44a7-ba2c-6c8dfaf9a823 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:33.775606 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3a1381b6-8ea3-44a7-ba2c-6c8dfaf9a823 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:33.776059 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3a1381b6-8ea3-44a7-ba2c-6c8dfaf9a823 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:33.776482 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3a1381b6-8ea3-44a7-ba2c-6c8dfaf9a823 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:33.817375 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-062ea51c-e3d8-4d2d-af3b-64cbd358323d req-0f0685c0-9de6-416e-8e99-7cc64d8c1348 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "408d8179-50fa-4c27-a2e9-85dc1daaa5b3", "tag": "40711594-b3d5-4f64-901c-bfdbaddb9e73"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:44:33.834923 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3a1381b6-8ea3-44a7-ba2c-6c8dfaf9a823 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] [instance: 2184ae8f-022d-4de9-8d0f-0c2d546c9d6f] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:44:33.844673 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-062ea51c-e3d8-4d2d-af3b-64cbd358323d req-0f0685c0-9de6-416e-8e99-7cc64d8c1348 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:33.845996 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-062ea51c-e3d8-4d2d-af3b-64cbd358323d req-0f0685c0-9de6-416e-8e99-7cc64d8c1348 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:33.846443 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-062ea51c-e3d8-4d2d-af3b-64cbd358323d req-0f0685c0-9de6-416e-8e99-7cc64d8c1348 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:33.877127 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-062ea51c-e3d8-4d2d-af3b-64cbd358323d req-0f0685c0-9de6-416e-8e99-7cc64d8c1348 service nova] Creating event network-changed:40711594-b3d5-4f64-901c-bfdbaddb9e73 for instance 408d8179-50fa-4c27-a2e9-85dc1daaa5b3 on n-h1-854247-14 Oct 17 13:44:33.889828 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-062ea51c-e3d8-4d2d-af3b-64cbd358323d req-0f0685c0-9de6-416e-8e99-7cc64d8c1348 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.209354 Oct 17 13:44:33.890514 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1271/2557] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:44:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:44:33.903650 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4467e300-a40a-421f-be75-70930fa29737 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:33.904358 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4467e300-a40a-421f-be75-70930fa29737 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: b1b0d02c-b32f-45cd-8732-99b1e3119ca6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:33.926822 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4467e300-a40a-421f-be75-70930fa29737 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:33.927350 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4467e300-a40a-421f-be75-70930fa29737 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:33.927995 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4467e300-a40a-421f-be75-70930fa29737 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:33.931315 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4467e300-a40a-421f-be75-70930fa29737 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:33.932371 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4467e300-a40a-421f-be75-70930fa29737 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:33.932979 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4467e300-a40a-421f-be75-70930fa29737 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:34.006266 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3a1381b6-8ea3-44a7-ba2c-6c8dfaf9a823 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] 10.222.0.79 "DELETE /compute/v2.1/servers/2184ae8f-022d-4de9-8d0f-0c2d546c9d6f" status: 204 len: 0 microversion: 2.1 time: 0.269502 Oct 17 13:44:34.007072 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1287/2558] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:44:33 2022] DELETE /compute/v2.1/servers/2184ae8f-022d-4de9-8d0f-0c2d546c9d6f => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:44:34.012509 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b964fdcd-6881-45cd-a132-a01dadb2c34e tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:34.015798 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b964fdcd-6881-45cd-a132-a01dadb2c34e tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] [instance: 25f78ad7-b6b1-4c56-bb29-4a1e6fd7fb85] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:34.034484 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b964fdcd-6881-45cd-a132-a01dadb2c34e tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:34.045794 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b964fdcd-6881-45cd-a132-a01dadb2c34e tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:34.046618 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b964fdcd-6881-45cd-a132-a01dadb2c34e tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:34.048129 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b964fdcd-6881-45cd-a132-a01dadb2c34e tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:34.049316 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b964fdcd-6881-45cd-a132-a01dadb2c34e tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:34.049730 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b964fdcd-6881-45cd-a132-a01dadb2c34e tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:34.370745 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4467e300-a40a-421f-be75-70930fa29737 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:34.380480 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4467e300-a40a-421f-be75-70930fa29737 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:34.382309 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4467e300-a40a-421f-be75-70930fa29737 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:34.383818 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4467e300-a40a-421f-be75-70930fa29737 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6" status: 200 len: 1484 microversion: 2.25 time: 0.492191 Oct 17 13:44:34.395239 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1272/2559] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:33 2022] GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6 => generated 1484 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:34.395239 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f882fe62-7dab-4056-90a4-ec9ef3371324 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '.version_select at 0x7f7cd5536700>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:34.448159 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f882fe62-7dab-4056-90a4-ec9ef3371324 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "GET /compute/v2.1/images/545ba6e2-5330-47da-8d7e-390d40909596" status: 200 len: 1426 microversion: 2.1 time: 0.061974 Oct 17 13:44:34.448766 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1273/2560] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:44:34 2022] GET /compute/v2.1/images/545ba6e2-5330-47da-8d7e-390d40909596 => generated 1426 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:34.454007 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-29935bbf-75a3-45ba-a3f6-a5756e6e297d tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:34.454622 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-29935bbf-75a3-45ba-a3f6-a5756e6e297d tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] [instance: 2184ae8f-022d-4de9-8d0f-0c2d546c9d6f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:34.461485 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-29935bbf-75a3-45ba-a3f6-a5756e6e297d tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:34.461976 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-29935bbf-75a3-45ba-a3f6-a5756e6e297d tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:34.462403 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-29935bbf-75a3-45ba-a3f6-a5756e6e297d tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:34.463542 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-29935bbf-75a3-45ba-a3f6-a5756e6e297d tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:34.464145 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-29935bbf-75a3-45ba-a3f6-a5756e6e297d tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:34.464721 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-29935bbf-75a3-45ba-a3f6-a5756e6e297d tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:34.485055 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b964fdcd-6881-45cd-a132-a01dadb2c34e tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75205205ba2946fbb18918201f54e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3126767b1c348859c2640dc21e38f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:34.493336 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b964fdcd-6881-45cd-a132-a01dadb2c34e tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] 10.222.0.79 "GET /compute/v2.1/servers/25f78ad7-b6b1-4c56-bb29-4a1e6fd7fb85" status: 200 len: 1319 microversion: 2.1 time: 0.484969 Oct 17 13:44:34.493916 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1288/2561] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:34 2022] GET /compute/v2.1/servers/25f78ad7-b6b1-4c56-bb29-4a1e6fd7fb85 => generated 1319 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:34.498785 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-035cfdbd-9aad-4b18-8e85-91e34db31224 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:34.499930 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-035cfdbd-9aad-4b18-8e85-91e34db31224 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] [instance: f59dba6a-0058-4aeb-a3b0-3e0209d928c4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:34.507267 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-035cfdbd-9aad-4b18-8e85-91e34db31224 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:34.507716 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-035cfdbd-9aad-4b18-8e85-91e34db31224 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:34.508153 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-035cfdbd-9aad-4b18-8e85-91e34db31224 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:34.508897 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-035cfdbd-9aad-4b18-8e85-91e34db31224 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:34.509346 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-035cfdbd-9aad-4b18-8e85-91e34db31224 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:34.509809 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-035cfdbd-9aad-4b18-8e85-91e34db31224 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:34.941715 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-29935bbf-75a3-45ba-a3f6-a5756e6e297d tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799d72ccad514fd899d21809d613249b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb50742d06f403598634414befbeb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:34.950637 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-29935bbf-75a3-45ba-a3f6-a5756e6e297d tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] 10.222.0.79 "GET /compute/v2.1/servers/2184ae8f-022d-4de9-8d0f-0c2d546c9d6f" status: 200 len: 1682 microversion: 2.1 time: 0.500850 Oct 17 13:44:34.951887 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1274/2562] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:34 2022] GET /compute/v2.1/servers/2184ae8f-022d-4de9-8d0f-0c2d546c9d6f => generated 1682 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:34.957701 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-67057094-69db-4a97-a64f-9f222686308e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:34.958569 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-67057094-69db-4a97-a64f-9f222686308e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 9be563ca-739e-4121-9dc8-9e46c7a131b6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:34.972162 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-67057094-69db-4a97-a64f-9f222686308e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:34.972675 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-67057094-69db-4a97-a64f-9f222686308e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:34.973115 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-67057094-69db-4a97-a64f-9f222686308e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:34.973828 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-67057094-69db-4a97-a64f-9f222686308e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:34.974276 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-67057094-69db-4a97-a64f-9f222686308e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:34.974697 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-67057094-69db-4a97-a64f-9f222686308e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:35.032348 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-035cfdbd-9aad-4b18-8e85-91e34db31224 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc181092e9cb42e6a751e9bec506d7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a3aa5210b549fc95cd534135624ab5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:35.044980 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-035cfdbd-9aad-4b18-8e85-91e34db31224 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] 10.222.0.79 "GET /compute/v2.1/servers/f59dba6a-0058-4aeb-a3b0-3e0209d928c4" status: 200 len: 1324 microversion: 2.1 time: 0.549776 Oct 17 13:44:35.055372 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1289/2563] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:34 2022] GET /compute/v2.1/servers/f59dba6a-0058-4aeb-a3b0-3e0209d928c4 => generated 1324 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:35.055372 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ddc2a3ba-a6db-45b2-a35d-84fd0fc4254f tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:35.055372 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ddc2a3ba-a6db-45b2-a35d-84fd0fc4254f tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] [instance: c8ec85bf-e448-4a4b-998d-a6bedb89d5e8] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:35.058306 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ddc2a3ba-a6db-45b2-a35d-84fd0fc4254f tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:35.059776 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ddc2a3ba-a6db-45b2-a35d-84fd0fc4254f tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:35.060323 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ddc2a3ba-a6db-45b2-a35d-84fd0fc4254f tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:35.061346 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ddc2a3ba-a6db-45b2-a35d-84fd0fc4254f tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:35.061903 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ddc2a3ba-a6db-45b2-a35d-84fd0fc4254f tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:35.062416 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ddc2a3ba-a6db-45b2-a35d-84fd0fc4254f tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:35.231896 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ddc2a3ba-a6db-45b2-a35d-84fd0fc4254f tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb93a068a854ec9a2c082b380e22466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '341aac3733474b58a6ce8724c8bba334', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:35.239800 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ddc2a3ba-a6db-45b2-a35d-84fd0fc4254f tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] 10.222.0.79 "GET /compute/v2.1/servers/c8ec85bf-e448-4a4b-998d-a6bedb89d5e8" status: 200 len: 1283 microversion: 2.1 time: 0.192996 Oct 17 13:44:35.251397 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1290/2564] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:35 2022] GET /compute/v2.1/servers/c8ec85bf-e448-4a4b-998d-a6bedb89d5e8 => generated 1283 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:35.251397 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-370c4cb3-e74b-4a9e-a0a3-a42b7c2fe9f1 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:35.251397 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-370c4cb3-e74b-4a9e-a0a3-a42b7c2fe9f1 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: e555208e-39b0-4361-94a5-6b272c336be4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:35.256416 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-370c4cb3-e74b-4a9e-a0a3-a42b7c2fe9f1 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:35.256416 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-370c4cb3-e74b-4a9e-a0a3-a42b7c2fe9f1 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:35.256416 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-370c4cb3-e74b-4a9e-a0a3-a42b7c2fe9f1 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:35.256416 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-370c4cb3-e74b-4a9e-a0a3-a42b7c2fe9f1 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:35.256416 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-370c4cb3-e74b-4a9e-a0a3-a42b7c2fe9f1 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:35.256873 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-370c4cb3-e74b-4a9e-a0a3-a42b7c2fe9f1 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:35.536440 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-67057094-69db-4a97-a64f-9f222686308e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:35.557277 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-67057094-69db-4a97-a64f-9f222686308e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/9be563ca-739e-4121-9dc8-9e46c7a131b6" status: 200 len: 1316 microversion: 2.1 time: 0.603316 Oct 17 13:44:35.557834 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1275/2565] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:34 2022] GET /compute/v2.1/servers/9be563ca-739e-4121-9dc8-9e46c7a131b6 => generated 1316 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:35.570296 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-27970104-9f07-473f-a913-8c1e393c0577 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:35.570911 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-27970104-9f07-473f-a913-8c1e393c0577 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: b1b0d02c-b32f-45cd-8732-99b1e3119ca6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:35.579271 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-27970104-9f07-473f-a913-8c1e393c0577 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:35.579717 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-27970104-9f07-473f-a913-8c1e393c0577 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:35.580358 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-27970104-9f07-473f-a913-8c1e393c0577 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:35.581062 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-27970104-9f07-473f-a913-8c1e393c0577 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:35.581468 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-27970104-9f07-473f-a913-8c1e393c0577 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:35.582112 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-27970104-9f07-473f-a913-8c1e393c0577 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:35.746371 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-370c4cb3-e74b-4a9e-a0a3-a42b7c2fe9f1 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467250951f654e33b3e233868301bbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676987e95424497c94984347dd6a7988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:35.755022 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-370c4cb3-e74b-4a9e-a0a3-a42b7c2fe9f1 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4" status: 200 len: 1353 microversion: 2.1 time: 0.513014 Oct 17 13:44:35.755838 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1291/2566] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:35 2022] GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4 => generated 1353 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:35.774935 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-82055cdd-991a-41fd-a3e6-4e48f08a8b79 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '.version_select at 0x7f7cd45cf8b0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:35.821629 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-82055cdd-991a-41fd-a3e6-4e48f08a8b79 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "GET /compute/v2.1/images/545ba6e2-5330-47da-8d7e-390d40909596" status: 200 len: 1426 microversion: 2.1 time: 0.050340 Oct 17 13:44:35.822487 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1292/2567] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:44:35 2022] GET /compute/v2.1/images/545ba6e2-5330-47da-8d7e-390d40909596 => generated 1426 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:35.827490 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fea7713e-de95-4268-9a63-4a4ab676246a tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:35.829192 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-fea7713e-de95-4268-9a63-4a4ab676246a tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] [instance: 25f78ad7-b6b1-4c56-bb29-4a1e6fd7fb85] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:35.836491 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fea7713e-de95-4268-9a63-4a4ab676246a tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:35.836975 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fea7713e-de95-4268-9a63-4a4ab676246a tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:35.837406 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fea7713e-de95-4268-9a63-4a4ab676246a tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:35.838128 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fea7713e-de95-4268-9a63-4a4ab676246a tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:35.838589 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fea7713e-de95-4268-9a63-4a4ab676246a tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:35.839001 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fea7713e-de95-4268-9a63-4a4ab676246a tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:36.051984 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-27970104-9f07-473f-a913-8c1e393c0577 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:36.064079 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-27970104-9f07-473f-a913-8c1e393c0577 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:36.066763 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-27970104-9f07-473f-a913-8c1e393c0577 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:36.068295 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-27970104-9f07-473f-a913-8c1e393c0577 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6" status: 200 len: 1484 microversion: 2.25 time: 0.507062 Oct 17 13:44:36.069584 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1276/2568] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:35 2022] GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6 => generated 1484 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:36.074555 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-767404c4-5e5e-499b-a127-c0b94391053b tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:36.075210 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-767404c4-5e5e-499b-a127-c0b94391053b tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] [instance: 2184ae8f-022d-4de9-8d0f-0c2d546c9d6f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:36.082483 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-767404c4-5e5e-499b-a127-c0b94391053b tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:36.083295 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-767404c4-5e5e-499b-a127-c0b94391053b tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:36.083958 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-767404c4-5e5e-499b-a127-c0b94391053b tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:36.084868 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-767404c4-5e5e-499b-a127-c0b94391053b tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:36.085520 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-767404c4-5e5e-499b-a127-c0b94391053b tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:36.086145 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-767404c4-5e5e-499b-a127-c0b94391053b tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:36.194817 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fea7713e-de95-4268-9a63-4a4ab676246a tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75205205ba2946fbb18918201f54e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3126767b1c348859c2640dc21e38f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:36.197208 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:44:36.209735 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fea7713e-de95-4268-9a63-4a4ab676246a tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] 10.222.0.79 "GET /compute/v2.1/servers/25f78ad7-b6b1-4c56-bb29-4a1e6fd7fb85" status: 200 len: 1319 microversion: 2.1 time: 0.386133 Oct 17 13:44:36.211147 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1293/2569] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:35 2022] GET /compute/v2.1/servers/25f78ad7-b6b1-4c56-bb29-4a1e6fd7fb85 => generated 1319 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:36.217055 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d2ece188-860c-4afb-b923-b59775cb86c6 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:36.217758 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d2ece188-860c-4afb-b923-b59775cb86c6 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] [instance: f59dba6a-0058-4aeb-a3b0-3e0209d928c4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:36.224611 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d2ece188-860c-4afb-b923-b59775cb86c6 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:36.225313 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d2ece188-860c-4afb-b923-b59775cb86c6 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:36.225921 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d2ece188-860c-4afb-b923-b59775cb86c6 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:36.226943 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d2ece188-860c-4afb-b923-b59775cb86c6 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:36.227548 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d2ece188-860c-4afb-b923-b59775cb86c6 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:36.228184 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d2ece188-860c-4afb-b923-b59775cb86c6 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:36.811362 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-767404c4-5e5e-499b-a127-c0b94391053b tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799d72ccad514fd899d21809d613249b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb50742d06f403598634414befbeb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:36.824624 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-767404c4-5e5e-499b-a127-c0b94391053b tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] 10.222.0.79 "GET /compute/v2.1/servers/2184ae8f-022d-4de9-8d0f-0c2d546c9d6f" status: 200 len: 1682 microversion: 2.1 time: 0.753615 Oct 17 13:44:36.825232 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1277/2570] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:36 2022] GET /compute/v2.1/servers/2184ae8f-022d-4de9-8d0f-0c2d546c9d6f => generated 1682 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:36.845256 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8636dbc7-cad9-4abe-8c51-a01c1722bea4 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:36.845890 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8636dbc7-cad9-4abe-8c51-a01c1722bea4 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] [instance: c8ec85bf-e448-4a4b-998d-a6bedb89d5e8] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:36.862413 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8636dbc7-cad9-4abe-8c51-a01c1722bea4 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:36.862954 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8636dbc7-cad9-4abe-8c51-a01c1722bea4 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:36.864905 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8636dbc7-cad9-4abe-8c51-a01c1722bea4 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:36.865662 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8636dbc7-cad9-4abe-8c51-a01c1722bea4 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:36.866134 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8636dbc7-cad9-4abe-8c51-a01c1722bea4 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:36.866564 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8636dbc7-cad9-4abe-8c51-a01c1722bea4 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:37.060815 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d2ece188-860c-4afb-b923-b59775cb86c6 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc181092e9cb42e6a751e9bec506d7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a3aa5210b549fc95cd534135624ab5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:37.074033 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d2ece188-860c-4afb-b923-b59775cb86c6 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] 10.222.0.79 "GET /compute/v2.1/servers/f59dba6a-0058-4aeb-a3b0-3e0209d928c4" status: 200 len: 1324 microversion: 2.1 time: 0.860228 Oct 17 13:44:37.077979 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1294/2571] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:36 2022] GET /compute/v2.1/servers/f59dba6a-0058-4aeb-a3b0-3e0209d928c4 => generated 1324 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:37.119612 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-e5c0767a-6d30-4095-8b9e-0fc22d5778a8 req-0a4055f7-f591-453b-95ba-ebd558213204 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25f78ad7-b6b1-4c56-bb29-4a1e6fd7fb85", "tag": "cd4c537b-c52e-4348-a550-70444ff951d7"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:44:37.139045 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-e5c0767a-6d30-4095-8b9e-0fc22d5778a8 req-0a4055f7-f591-453b-95ba-ebd558213204 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:37.139563 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-e5c0767a-6d30-4095-8b9e-0fc22d5778a8 req-0a4055f7-f591-453b-95ba-ebd558213204 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:37.139993 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-e5c0767a-6d30-4095-8b9e-0fc22d5778a8 req-0a4055f7-f591-453b-95ba-ebd558213204 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:37.160808 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-e5c0767a-6d30-4095-8b9e-0fc22d5778a8 req-0a4055f7-f591-453b-95ba-ebd558213204 service nova] Creating event network-changed:cd4c537b-c52e-4348-a550-70444ff951d7 for instance 25f78ad7-b6b1-4c56-bb29-4a1e6fd7fb85 on n-h2-854247-14 Oct 17 13:44:37.167213 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-e5c0767a-6d30-4095-8b9e-0fc22d5778a8 req-0a4055f7-f591-453b-95ba-ebd558213204 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062975 Oct 17 13:44:37.168329 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1295/2572] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:44:37.176248 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-1e6ec626-44a4-4c7e-b460-f75278323887 req-b5282e0c-f6b0-492b-a070-83539f8111ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1b0d02c-b32f-45cd-8732-99b1e3119ca6", "name": "network-vif-deleted", "tag": "8f48924e-befb-4a03-97da-73a3c4e335e9"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:44:37.200438 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-1e6ec626-44a4-4c7e-b460-f75278323887 req-b5282e0c-f6b0-492b-a070-83539f8111ab service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:37.200818 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-1e6ec626-44a4-4c7e-b460-f75278323887 req-b5282e0c-f6b0-492b-a070-83539f8111ab service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:37.201185 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-1e6ec626-44a4-4c7e-b460-f75278323887 req-b5282e0c-f6b0-492b-a070-83539f8111ab service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:37.215071 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-1e6ec626-44a4-4c7e-b460-f75278323887 req-b5282e0c-f6b0-492b-a070-83539f8111ab service nova] Creating event network-vif-deleted:8f48924e-befb-4a03-97da-73a3c4e335e9 for instance b1b0d02c-b32f-45cd-8732-99b1e3119ca6 on n-h2-854247-14 Oct 17 13:44:37.221304 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-1e6ec626-44a4-4c7e-b460-f75278323887 req-b5282e0c-f6b0-492b-a070-83539f8111ab service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051239 Oct 17 13:44:37.222539 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1296/2573] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:44:37.230171 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-18df0ae7-7c16-439c-a04a-5ef8b3f8afab tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:37.231237 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-18df0ae7-7c16-439c-a04a-5ef8b3f8afab tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 9be563ca-739e-4121-9dc8-9e46c7a131b6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:37.238920 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-18df0ae7-7c16-439c-a04a-5ef8b3f8afab tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:37.239738 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-18df0ae7-7c16-439c-a04a-5ef8b3f8afab tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:37.240397 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-18df0ae7-7c16-439c-a04a-5ef8b3f8afab tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:37.241360 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-18df0ae7-7c16-439c-a04a-5ef8b3f8afab tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:37.242305 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-18df0ae7-7c16-439c-a04a-5ef8b3f8afab tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:37.242956 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-18df0ae7-7c16-439c-a04a-5ef8b3f8afab tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:37.407564 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=4 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:44:37.706349 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8636dbc7-cad9-4abe-8c51-a01c1722bea4 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb93a068a854ec9a2c082b380e22466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '341aac3733474b58a6ce8724c8bba334', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:37.717414 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8636dbc7-cad9-4abe-8c51-a01c1722bea4 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] 10.222.0.79 "GET /compute/v2.1/servers/c8ec85bf-e448-4a4b-998d-a6bedb89d5e8" status: 200 len: 1350 microversion: 2.1 time: 0.890673 Oct 17 13:44:37.731778 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1278/2574] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:36 2022] GET /compute/v2.1/servers/c8ec85bf-e448-4a4b-998d-a6bedb89d5e8 => generated 1350 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:37.731778 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a8796a5f-554e-40ec-89fb-224b919c45af tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:37.731778 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a8796a5f-554e-40ec-89fb-224b919c45af tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: e555208e-39b0-4361-94a5-6b272c336be4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:37.742258 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a8796a5f-554e-40ec-89fb-224b919c45af tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:37.742757 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a8796a5f-554e-40ec-89fb-224b919c45af tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:37.743218 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a8796a5f-554e-40ec-89fb-224b919c45af tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:37.744205 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a8796a5f-554e-40ec-89fb-224b919c45af tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:37.744660 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a8796a5f-554e-40ec-89fb-224b919c45af tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:37.745592 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a8796a5f-554e-40ec-89fb-224b919c45af tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:38.269147 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-18df0ae7-7c16-439c-a04a-5ef8b3f8afab tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:38.282177 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-18df0ae7-7c16-439c-a04a-5ef8b3f8afab tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/9be563ca-739e-4121-9dc8-9e46c7a131b6" status: 200 len: 1504 microversion: 2.1 time: 1.055028 Oct 17 13:44:38.284474 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1297/2575] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:37 2022] GET /compute/v2.1/servers/9be563ca-739e-4121-9dc8-9e46c7a131b6 => generated 1504 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:38.295463 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-44b5a041-5969-4e93-a803-2e4841733bc7 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '.version_select at 0x7f7cd62cedc0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:38.380524 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-44b5a041-5969-4e93-a803-2e4841733bc7 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "GET /compute/v2.1/images/545ba6e2-5330-47da-8d7e-390d40909596" status: 200 len: 1426 microversion: 2.1 time: 0.092288 Oct 17 13:44:38.384114 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1298/2576] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:44:38 2022] GET /compute/v2.1/images/545ba6e2-5330-47da-8d7e-390d40909596 => generated 1426 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:38.404916 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fc1a9d7a-03ef-4a6d-b530-0cee8ead6220 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:38.408473 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-fc1a9d7a-03ef-4a6d-b530-0cee8ead6220 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: b1b0d02c-b32f-45cd-8732-99b1e3119ca6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:38.421363 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fc1a9d7a-03ef-4a6d-b530-0cee8ead6220 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:38.421915 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fc1a9d7a-03ef-4a6d-b530-0cee8ead6220 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:38.422405 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fc1a9d7a-03ef-4a6d-b530-0cee8ead6220 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:38.423135 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fc1a9d7a-03ef-4a6d-b530-0cee8ead6220 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:38.423712 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fc1a9d7a-03ef-4a6d-b530-0cee8ead6220 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:38.424940 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fc1a9d7a-03ef-4a6d-b530-0cee8ead6220 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:38.616652 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a8796a5f-554e-40ec-89fb-224b919c45af tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467250951f654e33b3e233868301bbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676987e95424497c94984347dd6a7988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:38.629667 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a8796a5f-554e-40ec-89fb-224b919c45af tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4" status: 200 len: 1803 microversion: 2.1 time: 0.909708 Oct 17 13:44:38.647764 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1279/2577] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:37 2022] GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4 => generated 1803 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:38.653598 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-aa9c9ec2-088f-4f31-9c02-b8b4352366fd tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:38.654018 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-aa9c9ec2-088f-4f31-9c02-b8b4352366fd tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] [instance: 25f78ad7-b6b1-4c56-bb29-4a1e6fd7fb85] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:38.664650 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aa9c9ec2-088f-4f31-9c02-b8b4352366fd tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:38.665451 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aa9c9ec2-088f-4f31-9c02-b8b4352366fd tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:38.666071 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aa9c9ec2-088f-4f31-9c02-b8b4352366fd tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:38.666992 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aa9c9ec2-088f-4f31-9c02-b8b4352366fd tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:38.667715 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aa9c9ec2-088f-4f31-9c02-b8b4352366fd tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:38.668344 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aa9c9ec2-088f-4f31-9c02-b8b4352366fd tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:38.764377 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fc1a9d7a-03ef-4a6d-b530-0cee8ead6220 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:38.774714 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fc1a9d7a-03ef-4a6d-b530-0cee8ead6220 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:38.776279 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fc1a9d7a-03ef-4a6d-b530-0cee8ead6220 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:38.778640 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fc1a9d7a-03ef-4a6d-b530-0cee8ead6220 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6" status: 200 len: 1266 microversion: 2.25 time: 0.391423 Oct 17 13:44:38.792081 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1299/2578] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:38 2022] GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6 => generated 1266 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:38.803522 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-abb1b438-d264-42c0-8ef7-3fc8e18b2e9c tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:38.804224 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-abb1b438-d264-42c0-8ef7-3fc8e18b2e9c tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] [instance: 2184ae8f-022d-4de9-8d0f-0c2d546c9d6f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:38.814369 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-abb1b438-d264-42c0-8ef7-3fc8e18b2e9c tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:38.814985 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-abb1b438-d264-42c0-8ef7-3fc8e18b2e9c tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:38.815598 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-abb1b438-d264-42c0-8ef7-3fc8e18b2e9c tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:38.816729 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-abb1b438-d264-42c0-8ef7-3fc8e18b2e9c tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:38.817286 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-abb1b438-d264-42c0-8ef7-3fc8e18b2e9c tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:38.817800 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-abb1b438-d264-42c0-8ef7-3fc8e18b2e9c tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:39.229950 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-abb1b438-d264-42c0-8ef7-3fc8e18b2e9c tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '799d72ccad514fd899d21809d613249b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb50742d06f403598634414befbeb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:39.240807 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-abb1b438-d264-42c0-8ef7-3fc8e18b2e9c tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] 10.222.0.79 "GET /compute/v2.1/servers/2184ae8f-022d-4de9-8d0f-0c2d546c9d6f" status: 200 len: 1327 microversion: 2.1 time: 0.447503 Oct 17 13:44:39.255205 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1300/2579] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:38 2022] GET /compute/v2.1/servers/2184ae8f-022d-4de9-8d0f-0c2d546c9d6f => generated 1327 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:39.255205 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d927e9e1-fd27-4a07-a33a-9051abb4a50f tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:39.255205 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d927e9e1-fd27-4a07-a33a-9051abb4a50f tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] [instance: f59dba6a-0058-4aeb-a3b0-3e0209d928c4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:39.267507 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d927e9e1-fd27-4a07-a33a-9051abb4a50f tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:39.270154 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d927e9e1-fd27-4a07-a33a-9051abb4a50f tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:39.270715 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d927e9e1-fd27-4a07-a33a-9051abb4a50f tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:39.272208 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d927e9e1-fd27-4a07-a33a-9051abb4a50f tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:39.274659 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d927e9e1-fd27-4a07-a33a-9051abb4a50f tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:39.275317 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d927e9e1-fd27-4a07-a33a-9051abb4a50f tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:39.618091 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-aa9c9ec2-088f-4f31-9c02-b8b4352366fd tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75205205ba2946fbb18918201f54e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3126767b1c348859c2640dc21e38f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:39.631701 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-aa9c9ec2-088f-4f31-9c02-b8b4352366fd tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] 10.222.0.79 "GET /compute/v2.1/servers/25f78ad7-b6b1-4c56-bb29-4a1e6fd7fb85" status: 200 len: 1319 microversion: 2.1 time: 0.989951 Oct 17 13:44:39.633046 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1280/2580] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:38 2022] GET /compute/v2.1/servers/25f78ad7-b6b1-4c56-bb29-4a1e6fd7fb85 => generated 1319 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:39.644568 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-587c1759-17b2-4a47-8dc6-2c7857623d16 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:39.645496 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-587c1759-17b2-4a47-8dc6-2c7857623d16 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 9be563ca-739e-4121-9dc8-9e46c7a131b6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:39.662931 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-587c1759-17b2-4a47-8dc6-2c7857623d16 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:39.666825 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-587c1759-17b2-4a47-8dc6-2c7857623d16 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:39.667446 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-587c1759-17b2-4a47-8dc6-2c7857623d16 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:39.668517 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-587c1759-17b2-4a47-8dc6-2c7857623d16 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:39.670772 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-587c1759-17b2-4a47-8dc6-2c7857623d16 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:39.671984 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-587c1759-17b2-4a47-8dc6-2c7857623d16 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:39.681854 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d927e9e1-fd27-4a07-a33a-9051abb4a50f tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc181092e9cb42e6a751e9bec506d7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a3aa5210b549fc95cd534135624ab5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:39.697821 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d927e9e1-fd27-4a07-a33a-9051abb4a50f tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] 10.222.0.79 "GET /compute/v2.1/servers/f59dba6a-0058-4aeb-a3b0-3e0209d928c4" status: 200 len: 1324 microversion: 2.1 time: 0.452809 Oct 17 13:44:39.699120 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1301/2581] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:39 2022] GET /compute/v2.1/servers/f59dba6a-0058-4aeb-a3b0-3e0209d928c4 => generated 1324 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:39.707832 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-ebfa5b0a-0266-4843-a6d9-2df71b035bba req-fecc57ce-d972-490d-95b0-0da64ad999d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87114af9-1214-4182-8f68-756a1a5dfc7a", "name": "network-vif-plugged", "status": "completed", "tag": "cde412a7-8204-4c39-8f24-2d2a36d636f9"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:44:39.729453 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-ebfa5b0a-0266-4843-a6d9-2df71b035bba req-fecc57ce-d972-490d-95b0-0da64ad999d9 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:39.731961 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-ebfa5b0a-0266-4843-a6d9-2df71b035bba req-fecc57ce-d972-490d-95b0-0da64ad999d9 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:39.734126 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-ebfa5b0a-0266-4843-a6d9-2df71b035bba req-fecc57ce-d972-490d-95b0-0da64ad999d9 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:39.742815 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-587c1759-17b2-4a47-8dc6-2c7857623d16 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 9be563ca-739e-4121-9dc8-9e46c7a131b6] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:44:39.767595 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-ebfa5b0a-0266-4843-a6d9-2df71b035bba req-fecc57ce-d972-490d-95b0-0da64ad999d9 service nova] Creating event network-vif-plugged:cde412a7-8204-4c39-8f24-2d2a36d636f9 for instance 87114af9-1214-4182-8f68-756a1a5dfc7a on n-h2-854247-14 Oct 17 13:44:39.783191 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-ebfa5b0a-0266-4843-a6d9-2df71b035bba req-fecc57ce-d972-490d-95b0-0da64ad999d9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080753 Oct 17 13:44:39.787935 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1302/2582] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:44:39.799209 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-241a8379-c827-4e93-a3f7-c72cd8046ad6 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:39.805426 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-241a8379-c827-4e93-a3f7-c72cd8046ad6 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: e555208e-39b0-4361-94a5-6b272c336be4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:39.820641 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-241a8379-c827-4e93-a3f7-c72cd8046ad6 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:39.823080 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-241a8379-c827-4e93-a3f7-c72cd8046ad6 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:39.823803 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-241a8379-c827-4e93-a3f7-c72cd8046ad6 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:39.825820 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-241a8379-c827-4e93-a3f7-c72cd8046ad6 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:39.827758 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-241a8379-c827-4e93-a3f7-c72cd8046ad6 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:39.831185 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-241a8379-c827-4e93-a3f7-c72cd8046ad6 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:39.882446 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-241a8379-c827-4e93-a3f7-c72cd8046ad6 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4/ips" status: 200 len: 218 microversion: 2.1 time: 0.089112 Oct 17 13:44:39.900920 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1303/2583] 10.222.0.79 () {58 vars in 1248 bytes} [Mon Oct 17 13:44:39 2022] GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4/ips => generated 218 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:44:39.916247 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0155037d-95e3-4346-bb93-1f2dcb2c987a tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:39.921609 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0155037d-95e3-4346-bb93-1f2dcb2c987a tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] [instance: c8ec85bf-e448-4a4b-998d-a6bedb89d5e8] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:39.948193 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0155037d-95e3-4346-bb93-1f2dcb2c987a tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:39.950337 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0155037d-95e3-4346-bb93-1f2dcb2c987a tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:39.951305 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0155037d-95e3-4346-bb93-1f2dcb2c987a tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:39.955712 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0155037d-95e3-4346-bb93-1f2dcb2c987a tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:39.956107 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0155037d-95e3-4346-bb93-1f2dcb2c987a tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:39.956552 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0155037d-95e3-4346-bb93-1f2dcb2c987a tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:39.990876 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-587c1759-17b2-4a47-8dc6-2c7857623d16 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "DELETE /compute/v2.1/servers/9be563ca-739e-4121-9dc8-9e46c7a131b6" status: 204 len: 0 microversion: 2.1 time: 0.355031 Oct 17 13:44:39.999317 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1281/2584] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:44:39 2022] DELETE /compute/v2.1/servers/9be563ca-739e-4121-9dc8-9e46c7a131b6 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:44:40.016232 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-c03c28d8-b76c-4ba9-800b-a5cf32ff0d2b req-97ab6866-d4a5-4f9a-b38c-52b25dd1b9a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2184ae8f-022d-4de9-8d0f-0c2d546c9d6f", "name": "network-vif-deleted", "tag": "39e1f2c4-d66a-48e8-b02b-3e21dd1312ae"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:44:40.049889 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-c03c28d8-b76c-4ba9-800b-a5cf32ff0d2b req-97ab6866-d4a5-4f9a-b38c-52b25dd1b9a8 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:40.050366 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-c03c28d8-b76c-4ba9-800b-a5cf32ff0d2b req-97ab6866-d4a5-4f9a-b38c-52b25dd1b9a8 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:40.050801 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-c03c28d8-b76c-4ba9-800b-a5cf32ff0d2b req-97ab6866-d4a5-4f9a-b38c-52b25dd1b9a8 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:40.097324 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-c03c28d8-b76c-4ba9-800b-a5cf32ff0d2b req-97ab6866-d4a5-4f9a-b38c-52b25dd1b9a8 service nova] Creating event network-vif-deleted:39e1f2c4-d66a-48e8-b02b-3e21dd1312ae for instance 2184ae8f-022d-4de9-8d0f-0c2d546c9d6f on n-h1-854247-14 Oct 17 13:44:40.117013 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-c03c28d8-b76c-4ba9-800b-a5cf32ff0d2b req-97ab6866-d4a5-4f9a-b38c-52b25dd1b9a8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110267 Oct 17 13:44:40.124656 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1282/2585] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:44:40.140466 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-61ce4a13-8932-4089-aa04-9f7d43ce21b8 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '.version_select at 0x7f7cd4a43a60>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:40.245454 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-61ce4a13-8932-4089-aa04-9f7d43ce21b8 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "GET /compute/v2.1/images/545ba6e2-5330-47da-8d7e-390d40909596" status: 200 len: 1426 microversion: 2.1 time: 0.118196 Oct 17 13:44:40.250846 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1283/2586] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:44:40 2022] GET /compute/v2.1/images/545ba6e2-5330-47da-8d7e-390d40909596 => generated 1426 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:40.255723 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-41fdcaa5-34f8-43e9-b2ed-4289a0d9ad9b req-06d145d2-28f7-47f3-876b-9efcee1c4862 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f59dba6a-0058-4aeb-a3b0-3e0209d928c4", "tag": "a20526da-2349-4b19-a6a5-29f2525348f2"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:44:40.277594 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:44:40.283120 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-41fdcaa5-34f8-43e9-b2ed-4289a0d9ad9b req-06d145d2-28f7-47f3-876b-9efcee1c4862 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:40.283640 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-41fdcaa5-34f8-43e9-b2ed-4289a0d9ad9b req-06d145d2-28f7-47f3-876b-9efcee1c4862 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:40.283962 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0155037d-95e3-4346-bb93-1f2dcb2c987a tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb93a068a854ec9a2c082b380e22466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '341aac3733474b58a6ce8724c8bba334', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:40.284496 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-41fdcaa5-34f8-43e9-b2ed-4289a0d9ad9b req-06d145d2-28f7-47f3-876b-9efcee1c4862 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:40.305695 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0155037d-95e3-4346-bb93-1f2dcb2c987a tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] 10.222.0.79 "GET /compute/v2.1/servers/c8ec85bf-e448-4a4b-998d-a6bedb89d5e8" status: 200 len: 1350 microversion: 2.1 time: 0.403320 Oct 17 13:44:40.306874 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1304/2587] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:39 2022] GET /compute/v2.1/servers/c8ec85bf-e448-4a4b-998d-a6bedb89d5e8 => generated 1350 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:40.312361 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8080fc32-d5fd-40e3-ae78-f99fbee476d1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:40.313178 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8080fc32-d5fd-40e3-ae78-f99fbee476d1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: b1b0d02c-b32f-45cd-8732-99b1e3119ca6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:40.313346 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-41fdcaa5-34f8-43e9-b2ed-4289a0d9ad9b req-06d145d2-28f7-47f3-876b-9efcee1c4862 service nova] Creating event network-changed:a20526da-2349-4b19-a6a5-29f2525348f2 for instance f59dba6a-0058-4aeb-a3b0-3e0209d928c4 on n-h2-854247-14 Oct 17 13:44:40.323040 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-41fdcaa5-34f8-43e9-b2ed-4289a0d9ad9b req-06d145d2-28f7-47f3-876b-9efcee1c4862 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070811 Oct 17 13:44:40.323785 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1284/2588] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:44:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:44:40.333131 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8080fc32-d5fd-40e3-ae78-f99fbee476d1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:40.333743 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-331962ce-cee2-491d-982f-e5dd8e0af45c tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:40.334169 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8080fc32-d5fd-40e3-ae78-f99fbee476d1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:40.334331 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-331962ce-cee2-491d-982f-e5dd8e0af45c tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: e555208e-39b0-4361-94a5-6b272c336be4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:40.334961 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8080fc32-d5fd-40e3-ae78-f99fbee476d1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:40.335905 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8080fc32-d5fd-40e3-ae78-f99fbee476d1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:40.336549 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8080fc32-d5fd-40e3-ae78-f99fbee476d1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:40.337159 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8080fc32-d5fd-40e3-ae78-f99fbee476d1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:40.359390 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-331962ce-cee2-491d-982f-e5dd8e0af45c tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:40.359919 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-331962ce-cee2-491d-982f-e5dd8e0af45c tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:40.360360 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-331962ce-cee2-491d-982f-e5dd8e0af45c tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:40.361090 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-331962ce-cee2-491d-982f-e5dd8e0af45c tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:40.361535 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-331962ce-cee2-491d-982f-e5dd8e0af45c tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:40.361949 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-331962ce-cee2-491d-982f-e5dd8e0af45c tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:40.405126 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-331962ce-cee2-491d-982f-e5dd8e0af45c tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: e555208e-39b0-4361-94a5-6b272c336be4] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:44:40.503798 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8080fc32-d5fd-40e3-ae78-f99fbee476d1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:40.519648 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8080fc32-d5fd-40e3-ae78-f99fbee476d1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:40.527349 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8080fc32-d5fd-40e3-ae78-f99fbee476d1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:40.528630 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8080fc32-d5fd-40e3-ae78-f99fbee476d1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6" status: 200 len: 1266 microversion: 2.25 time: 0.220512 Oct 17 13:44:40.534943 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1305/2589] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:40 2022] GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6 => generated 1266 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:40.553362 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8a49c725-f14e-4a93-aba1-933ef4ce6cb4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:40.556666 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8a49c725-f14e-4a93-aba1-933ef4ce6cb4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 9be563ca-739e-4121-9dc8-9e46c7a131b6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:40.570071 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-331962ce-cee2-491d-982f-e5dd8e0af45c tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "DELETE /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4" status: 204 len: 0 microversion: 2.1 time: 0.244602 Oct 17 13:44:40.570634 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1285/2590] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:44:40 2022] DELETE /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:44:40.572963 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8a49c725-f14e-4a93-aba1-933ef4ce6cb4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:40.576254 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8a49c725-f14e-4a93-aba1-933ef4ce6cb4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:40.576880 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8a49c725-f14e-4a93-aba1-933ef4ce6cb4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:40.581968 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8a49c725-f14e-4a93-aba1-933ef4ce6cb4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:40.582616 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8a49c725-f14e-4a93-aba1-933ef4ce6cb4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:40.583256 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8a49c725-f14e-4a93-aba1-933ef4ce6cb4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:40.598786 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-46e5b08a-e6cb-40cd-b18e-65410525c826 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:40.599558 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-46e5b08a-e6cb-40cd-b18e-65410525c826 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] [instance: 2184ae8f-022d-4de9-8d0f-0c2d546c9d6f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:40.612141 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-46e5b08a-e6cb-40cd-b18e-65410525c826 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:40.612973 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-46e5b08a-e6cb-40cd-b18e-65410525c826 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:40.613479 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-46e5b08a-e6cb-40cd-b18e-65410525c826 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:40.614181 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-46e5b08a-e6cb-40cd-b18e-65410525c826 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:40.615686 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-46e5b08a-e6cb-40cd-b18e-65410525c826 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:40.616179 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-46e5b08a-e6cb-40cd-b18e-65410525c826 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:40.637762 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-46e5b08a-e6cb-40cd-b18e-65410525c826 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] HTTP exception thrown: Instance 2184ae8f-022d-4de9-8d0f-0c2d546c9d6f could not be found. Oct 17 13:44:40.640409 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-46e5b08a-e6cb-40cd-b18e-65410525c826 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Request method failure captured: Oct 17 13:44:40.640409 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/2184ae8f-022d-4de9-8d0f-0c2d546c9d6f HTTP/1.1 Oct 17 13:44:40.640409 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:44:40.640409 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:44:40.640409 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:44:40.640409 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:44:40.640409 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:44:40.640409 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:44:40.640409 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:44:40.640409 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:44:40.640409 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVue64m5R6rw6hm4n0GPQELiiIZiHcHY_OayUzz-BJS3xlzYFUnBRAs8GlOKgSdZftnfHTgck3Rq8-pCdjaziS1rz_ScuIwW2mZbBMPorBOz8ZemES7b8EhxnpIOw7VzFdlTEwNdJ-TTZHLLOAXDoFmWvrs7ZVy2Zo-5hLyq2Dtd7Xk Oct 17 13:44:40.640409 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:44:40.640409 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:44:40.640409 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:44:40.640409 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:44:40.640409 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:44:40.640409 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:44:40.640409 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 5bb50742d06f403598634414befbeb12 Oct 17 13:44:40.640409 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1251956669 Oct 17 13:44:40.640409 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:44:40.640409 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:44:40.640409 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5bb50742d06f403598634414befbeb12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5bb50742d06f403598634414befbeb12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5bb50742d06f403598634414befbeb12"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5bb50742d06f403598634414befbeb12", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:44:40.640409 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1251956669 Oct 17 13:44:40.640409 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 5bb50742d06f403598634414befbeb12 Oct 17 13:44:40.640409 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1251956669 Oct 17 13:44:40.640409 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-AttachSCSIVolumeTestJSON-1251956669-project Oct 17 13:44:40.640409 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:44:40.640409 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:44:40.640409 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 799d72ccad514fd899d21809d613249b Oct 17 13:44:40.640409 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1251956669-project Oct 17 13:44:40.640409 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:44:40.640409 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 2184ae8f-022d-4de9-8d0f-0c2d546c9d6f could not be found. Oct 17 13:44:40.640409 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '2184ae8f-022d-4de9-8d0f-0c2d546c9d6f'} Oct 17 13:44:40.640409 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:44:40.640409 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:44:40.640409 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:44:40.640409 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:44:40.640409 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:44:40.640409 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:44:40.640409 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:44:40.640409 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:44:40.640409 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:44:40.640409 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:44:40.640409 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2184ae8f-022d-4de9-8d0f-0c2d546c9d6f could not be found. Oct 17 13:44:40.640409 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:44:40.640409 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:44:40.640409 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:44:40.640409 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:44:40.640409 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:44:40.640409 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:44:40.640409 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:44:40.640409 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:44:40.640409 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:44:40.640409 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:44:40.640409 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:44:40.640409 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:44:40.640409 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:44:40.640409 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:44:40.640409 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:44:40.640409 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:44:40.640409 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2184ae8f-022d-4de9-8d0f-0c2d546c9d6f could not be found. Oct 17 13:44:40.640409 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:44:40.640409 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:44:40.640409 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:44:40.644816 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:44:40.644816 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:44:40.644816 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:44:40.644816 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:44:40.644816 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:44:40.644816 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2184ae8f-022d-4de9-8d0f-0c2d546c9d6f could not be found. Oct 17 13:44:40.644816 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:44:40.644816 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-46e5b08a-e6cb-40cd-b18e-65410525c826 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Returning 404 to user: Instance 2184ae8f-022d-4de9-8d0f-0c2d546c9d6f could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:44:40.644816 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-46e5b08a-e6cb-40cd-b18e-65410525c826 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] 10.222.0.79 "GET /compute/v2.1/servers/2184ae8f-022d-4de9-8d0f-0c2d546c9d6f" status: 404 len: 111 microversion: 2.1 time: 0.059348 Oct 17 13:44:40.644816 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1286/2591] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:40 2022] GET /compute/v2.1/servers/2184ae8f-022d-4de9-8d0f-0c2d546c9d6f => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:44:40.649056 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-51bb5b7e-da57-46b2-88cf-6ac656dbdb3a tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:40.649694 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-51bb5b7e-da57-46b2-88cf-6ac656dbdb3a tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: e555208e-39b0-4361-94a5-6b272c336be4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:40.660810 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-51bb5b7e-da57-46b2-88cf-6ac656dbdb3a tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:40.661300 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-51bb5b7e-da57-46b2-88cf-6ac656dbdb3a tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:40.661730 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-51bb5b7e-da57-46b2-88cf-6ac656dbdb3a tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:40.662427 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-51bb5b7e-da57-46b2-88cf-6ac656dbdb3a tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:40.664047 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-51bb5b7e-da57-46b2-88cf-6ac656dbdb3a tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:40.665038 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-51bb5b7e-da57-46b2-88cf-6ac656dbdb3a tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:40.816121 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=4 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:44:40.870336 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=12 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:44:41.003625 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-51bb5b7e-da57-46b2-88cf-6ac656dbdb3a tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467250951f654e33b3e233868301bbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676987e95424497c94984347dd6a7988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:41.008550 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8a49c725-f14e-4a93-aba1-933ef4ce6cb4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:41.015668 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-51bb5b7e-da57-46b2-88cf-6ac656dbdb3a tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4" status: 200 len: 1809 microversion: 2.1 time: 0.371826 Oct 17 13:44:41.018192 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1287/2592] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:40 2022] GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4 => generated 1809 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:41.019764 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8a49c725-f14e-4a93-aba1-933ef4ce6cb4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/9be563ca-739e-4121-9dc8-9e46c7a131b6" status: 200 len: 1510 microversion: 2.1 time: 0.482833 Oct 17 13:44:41.028374 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-28a755aa-f6d3-4b22-9c83-e5a040b00a04 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Calling method '.version_select at 0x7f7cd5906430>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:41.037162 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1306/2593] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:40 2022] GET /compute/v2.1/servers/9be563ca-739e-4121-9dc8-9e46c7a131b6 => generated 1510 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:41.046224 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-be86192d-45bb-433a-be9e-a67906071b28 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:41.048052 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-be86192d-45bb-433a-be9e-a67906071b28 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] [instance: 25f78ad7-b6b1-4c56-bb29-4a1e6fd7fb85] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:41.057297 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be86192d-45bb-433a-be9e-a67906071b28 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:41.057923 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be86192d-45bb-433a-be9e-a67906071b28 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:41.058631 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be86192d-45bb-433a-be9e-a67906071b28 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:41.059523 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be86192d-45bb-433a-be9e-a67906071b28 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:41.060907 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be86192d-45bb-433a-be9e-a67906071b28 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:41.061532 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be86192d-45bb-433a-be9e-a67906071b28 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:41.077742 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-28a755aa-f6d3-4b22-9c83-e5a040b00a04 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1101982132" status: 202 len: 0 microversion: 2.1 time: 0.056747 Oct 17 13:44:41.087600 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1288/2594] 10.222.0.79 () {58 vars in 1221 bytes} [Mon Oct 17 13:44:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1101982132 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:44:41.102409 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-fb292ded-da56-4110-961b-b9e68912bb31 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:41.103712 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-fb292ded-da56-4110-961b-b9e68912bb31 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] [instance: f59dba6a-0058-4aeb-a3b0-3e0209d928c4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:41.129240 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fb292ded-da56-4110-961b-b9e68912bb31 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:41.135102 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fb292ded-da56-4110-961b-b9e68912bb31 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:41.135759 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fb292ded-da56-4110-961b-b9e68912bb31 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:41.138559 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fb292ded-da56-4110-961b-b9e68912bb31 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:41.139152 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fb292ded-da56-4110-961b-b9e68912bb31 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:41.141471 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fb292ded-da56-4110-961b-b9e68912bb31 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:41.173006 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:44:41.658896 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=12 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:44:41.771764 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-fb292ded-da56-4110-961b-b9e68912bb31 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc181092e9cb42e6a751e9bec506d7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a3aa5210b549fc95cd534135624ab5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:41.787485 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-fb292ded-da56-4110-961b-b9e68912bb31 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] 10.222.0.79 "GET /compute/v2.1/servers/f59dba6a-0058-4aeb-a3b0-3e0209d928c4" status: 200 len: 1324 microversion: 2.1 time: 0.697959 Oct 17 13:44:41.788408 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1289/2595] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:41 2022] GET /compute/v2.1/servers/f59dba6a-0058-4aeb-a3b0-3e0209d928c4 => generated 1324 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:41.802964 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-28cfb4cb-5654-47e9-b068-e0e07f156679 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '.version_select at 0x7f7cd54f88b0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:41.839852 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-be86192d-45bb-433a-be9e-a67906071b28 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75205205ba2946fbb18918201f54e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3126767b1c348859c2640dc21e38f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:41.849144 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-be86192d-45bb-433a-be9e-a67906071b28 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] 10.222.0.79 "GET /compute/v2.1/servers/25f78ad7-b6b1-4c56-bb29-4a1e6fd7fb85" status: 200 len: 1319 microversion: 2.1 time: 0.810405 Oct 17 13:44:41.880724 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-28cfb4cb-5654-47e9-b068-e0e07f156679 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "GET /compute/v2.1/images/545ba6e2-5330-47da-8d7e-390d40909596" status: 200 len: 1426 microversion: 2.1 time: 0.090830 Oct 17 13:44:41.881520 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1290/2596] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:44:41 2022] GET /compute/v2.1/images/545ba6e2-5330-47da-8d7e-390d40909596 => generated 1426 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:41.882815 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1307/2597] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:41 2022] GET /compute/v2.1/servers/25f78ad7-b6b1-4c56-bb29-4a1e6fd7fb85 => generated 1319 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:41.895103 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-afbd8a5b-fc56-4d91-b230-32b50d838e8b tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:41.898069 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-afbd8a5b-fc56-4d91-b230-32b50d838e8b tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: b1b0d02c-b32f-45cd-8732-99b1e3119ca6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:41.903316 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-74e03d7c-baa4-4a87-a575-8775739e8317 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:41.904115 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-74e03d7c-baa4-4a87-a575-8775739e8317 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] [instance: c8ec85bf-e448-4a4b-998d-a6bedb89d5e8] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:41.921393 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-afbd8a5b-fc56-4d91-b230-32b50d838e8b tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:41.921924 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-afbd8a5b-fc56-4d91-b230-32b50d838e8b tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:41.922368 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-afbd8a5b-fc56-4d91-b230-32b50d838e8b tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:41.923083 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-afbd8a5b-fc56-4d91-b230-32b50d838e8b tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:41.923598 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-afbd8a5b-fc56-4d91-b230-32b50d838e8b tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:41.924025 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-afbd8a5b-fc56-4d91-b230-32b50d838e8b tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:41.929096 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-74e03d7c-baa4-4a87-a575-8775739e8317 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:41.929594 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-74e03d7c-baa4-4a87-a575-8775739e8317 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:41.930029 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-74e03d7c-baa4-4a87-a575-8775739e8317 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:41.930737 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-74e03d7c-baa4-4a87-a575-8775739e8317 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:41.931210 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-74e03d7c-baa4-4a87-a575-8775739e8317 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:41.931624 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-74e03d7c-baa4-4a87-a575-8775739e8317 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:42.317896 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-afbd8a5b-fc56-4d91-b230-32b50d838e8b tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:42.330219 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-afbd8a5b-fc56-4d91-b230-32b50d838e8b tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:42.335333 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-afbd8a5b-fc56-4d91-b230-32b50d838e8b tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:42.337880 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-afbd8a5b-fc56-4d91-b230-32b50d838e8b tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6" status: 200 len: 1266 microversion: 2.25 time: 0.452719 Oct 17 13:44:42.340354 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1308/2598] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:41 2022] GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6 => generated 1266 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:42.350386 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9af65b78-2357-421c-9e46-213198cb055f tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:42.351017 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9af65b78-2357-421c-9e46-213198cb055f tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: e555208e-39b0-4361-94a5-6b272c336be4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:42.366344 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9af65b78-2357-421c-9e46-213198cb055f tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:42.366840 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9af65b78-2357-421c-9e46-213198cb055f tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:42.370465 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9af65b78-2357-421c-9e46-213198cb055f tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:42.371385 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9af65b78-2357-421c-9e46-213198cb055f tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:42.377564 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9af65b78-2357-421c-9e46-213198cb055f tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:42.378072 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9af65b78-2357-421c-9e46-213198cb055f tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:43.648047 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-74e03d7c-baa4-4a87-a575-8775739e8317 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb93a068a854ec9a2c082b380e22466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '341aac3733474b58a6ce8724c8bba334', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:43.659876 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-74e03d7c-baa4-4a87-a575-8775739e8317 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] 10.222.0.79 "GET /compute/v2.1/servers/c8ec85bf-e448-4a4b-998d-a6bedb89d5e8" status: 200 len: 1350 microversion: 2.1 time: 1.777441 Oct 17 13:44:43.660568 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1291/2599] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:41 2022] GET /compute/v2.1/servers/c8ec85bf-e448-4a4b-998d-a6bedb89d5e8 => generated 1350 bytes in 1779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:43.683047 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b0ef6e21-f918-468b-aa5c-c1a387027032 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:43.684176 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b0ef6e21-f918-468b-aa5c-c1a387027032 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 9be563ca-739e-4121-9dc8-9e46c7a131b6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:43.692128 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b0ef6e21-f918-468b-aa5c-c1a387027032 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:43.692937 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b0ef6e21-f918-468b-aa5c-c1a387027032 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:43.693605 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b0ef6e21-f918-468b-aa5c-c1a387027032 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:43.694469 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b0ef6e21-f918-468b-aa5c-c1a387027032 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:43.695159 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b0ef6e21-f918-468b-aa5c-c1a387027032 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:43.695915 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b0ef6e21-f918-468b-aa5c-c1a387027032 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:43.740259 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b0ef6e21-f918-468b-aa5c-c1a387027032 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:43.741516 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b0ef6e21-f918-468b-aa5c-c1a387027032 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:43.742237 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b0ef6e21-f918-468b-aa5c-c1a387027032 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:43.743627 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-b0ef6e21-f918-468b-aa5c-c1a387027032 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lazy-loading 'fault' on Instance uuid 9be563ca-739e-4121-9dc8-9e46c7a131b6 {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:44:43.823745 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9af65b78-2357-421c-9e46-213198cb055f tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467250951f654e33b3e233868301bbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676987e95424497c94984347dd6a7988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:43.834234 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9af65b78-2357-421c-9e46-213198cb055f tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4" status: 200 len: 1809 microversion: 2.1 time: 1.492736 Oct 17 13:44:43.847971 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1309/2600] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:42 2022] GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4 => generated 1809 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:43.853173 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-d79cde6b-f271-4b86-918c-3e2ec8a1a3f6 req-995eaef2-e604-4db1-b70e-37e33fa436a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "408d8179-50fa-4c27-a2e9-85dc1daaa5b3", "name": "network-vif-plugged", "status": "completed", "tag": "40711594-b3d5-4f64-901c-bfdbaddb9e73"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:44:43.858414 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:44:43.875130 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-d79cde6b-f271-4b86-918c-3e2ec8a1a3f6 req-995eaef2-e604-4db1-b70e-37e33fa436a9 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:43.875682 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-d79cde6b-f271-4b86-918c-3e2ec8a1a3f6 req-995eaef2-e604-4db1-b70e-37e33fa436a9 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:43.876098 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-d79cde6b-f271-4b86-918c-3e2ec8a1a3f6 req-995eaef2-e604-4db1-b70e-37e33fa436a9 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:43.905876 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-d79cde6b-f271-4b86-918c-3e2ec8a1a3f6 req-995eaef2-e604-4db1-b70e-37e33fa436a9 service nova] Creating event network-vif-plugged:40711594-b3d5-4f64-901c-bfdbaddb9e73 for instance 408d8179-50fa-4c27-a2e9-85dc1daaa5b3 on n-h1-854247-14 Oct 17 13:44:43.913281 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-d79cde6b-f271-4b86-918c-3e2ec8a1a3f6 req-995eaef2-e604-4db1-b70e-37e33fa436a9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062514 Oct 17 13:44:43.915669 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1310/2601] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:44:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:44:43.923526 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-44160f01-c63b-44c7-9761-fee776bf115e req-591d6756-060e-4a49-ab7e-9bf383de1f98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8ec85bf-e448-4a4b-998d-a6bedb89d5e8", "tag": "d873d2fd-e2b6-4478-a3ae-55a34161df6e"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:44:43.943211 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-44160f01-c63b-44c7-9761-fee776bf115e req-591d6756-060e-4a49-ab7e-9bf383de1f98 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:43.946863 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-44160f01-c63b-44c7-9761-fee776bf115e req-591d6756-060e-4a49-ab7e-9bf383de1f98 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:43.947276 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-44160f01-c63b-44c7-9761-fee776bf115e req-591d6756-060e-4a49-ab7e-9bf383de1f98 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:43.961665 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b0ef6e21-f918-468b-aa5c-c1a387027032 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:43.970520 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b0ef6e21-f918-468b-aa5c-c1a387027032 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/9be563ca-739e-4121-9dc8-9e46c7a131b6" status: 200 len: 1306 microversion: 2.1 time: 0.292734 Oct 17 13:44:43.979542 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1292/2602] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:43 2022] GET /compute/v2.1/servers/9be563ca-739e-4121-9dc8-9e46c7a131b6 => generated 1306 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:43.983106 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-44160f01-c63b-44c7-9761-fee776bf115e req-591d6756-060e-4a49-ab7e-9bf383de1f98 service nova] Creating event network-changed:d873d2fd-e2b6-4478-a3ae-55a34161df6e for instance c8ec85bf-e448-4a4b-998d-a6bedb89d5e8 on n-h1-854247-14 Oct 17 13:44:43.990140 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-44160f01-c63b-44c7-9761-fee776bf115e req-591d6756-060e-4a49-ab7e-9bf383de1f98 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072708 Oct 17 13:44:43.991049 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1311/2603] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:44:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:44:43.995271 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-23a7d026-e032-42b4-80fc-b689b11920f1 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:43.996304 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-23a7d026-e032-42b4-80fc-b689b11920f1 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] [instance: f59dba6a-0058-4aeb-a3b0-3e0209d928c4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:44.009611 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f1a18b00-c1b0-4ce1-b811-488dc4e129ac tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:44.010548 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f1a18b00-c1b0-4ce1-b811-488dc4e129ac tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] [instance: 25f78ad7-b6b1-4c56-bb29-4a1e6fd7fb85] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:44.018735 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1a18b00-c1b0-4ce1-b811-488dc4e129ac tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:44.019510 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1a18b00-c1b0-4ce1-b811-488dc4e129ac tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:44.020190 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1a18b00-c1b0-4ce1-b811-488dc4e129ac tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:44.021210 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1a18b00-c1b0-4ce1-b811-488dc4e129ac tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:44.021915 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1a18b00-c1b0-4ce1-b811-488dc4e129ac tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:44.022706 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1a18b00-c1b0-4ce1-b811-488dc4e129ac tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:44.032199 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-23a7d026-e032-42b4-80fc-b689b11920f1 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:44.032708 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-23a7d026-e032-42b4-80fc-b689b11920f1 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:44.033156 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-23a7d026-e032-42b4-80fc-b689b11920f1 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:44.033878 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-23a7d026-e032-42b4-80fc-b689b11920f1 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:44.034331 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-23a7d026-e032-42b4-80fc-b689b11920f1 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:44.034758 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-23a7d026-e032-42b4-80fc-b689b11920f1 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:44.524712 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-23a7d026-e032-42b4-80fc-b689b11920f1 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc181092e9cb42e6a751e9bec506d7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a3aa5210b549fc95cd534135624ab5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:44.533639 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-23a7d026-e032-42b4-80fc-b689b11920f1 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] 10.222.0.79 "GET /compute/v2.1/servers/f59dba6a-0058-4aeb-a3b0-3e0209d928c4" status: 200 len: 1324 microversion: 2.1 time: 0.552734 Oct 17 13:44:44.540028 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1293/2604] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:43 2022] GET /compute/v2.1/servers/f59dba6a-0058-4aeb-a3b0-3e0209d928c4 => generated 1324 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:44.549836 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2973ea43-917b-4a0b-b482-70412641165e tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '.version_select at 0x7f7cd9876e50>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:44.617350 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f1a18b00-c1b0-4ce1-b811-488dc4e129ac tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75205205ba2946fbb18918201f54e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3126767b1c348859c2640dc21e38f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:44.625684 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f1a18b00-c1b0-4ce1-b811-488dc4e129ac tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] 10.222.0.79 "GET /compute/v2.1/servers/25f78ad7-b6b1-4c56-bb29-4a1e6fd7fb85" status: 200 len: 1319 microversion: 2.1 time: 0.632994 Oct 17 13:44:44.630038 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1312/2605] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:43 2022] GET /compute/v2.1/servers/25f78ad7-b6b1-4c56-bb29-4a1e6fd7fb85 => generated 1319 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:44.646893 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-4fb81fce-cbf0-4b36-b621-423eae0a146d req-f6716983-9fac-4837-ba94-6fc9e0bfe583 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9be563ca-739e-4121-9dc8-9e46c7a131b6", "name": "network-vif-deleted", "tag": "3949bca1-350d-456b-8b19-4ce4d228854d"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:44:44.655802 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2973ea43-917b-4a0b-b482-70412641165e tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "GET /compute/v2.1/images/545ba6e2-5330-47da-8d7e-390d40909596" status: 200 len: 1426 microversion: 2.1 time: 0.114347 Oct 17 13:44:44.658605 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1294/2606] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:44:44 2022] GET /compute/v2.1/images/545ba6e2-5330-47da-8d7e-390d40909596 => generated 1426 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:44.669939 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-4fb81fce-cbf0-4b36-b621-423eae0a146d req-f6716983-9fac-4837-ba94-6fc9e0bfe583 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:44.670425 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-4fb81fce-cbf0-4b36-b621-423eae0a146d req-f6716983-9fac-4837-ba94-6fc9e0bfe583 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:44.671745 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-4fb81fce-cbf0-4b36-b621-423eae0a146d req-f6716983-9fac-4837-ba94-6fc9e0bfe583 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:44.698174 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-4fb81fce-cbf0-4b36-b621-423eae0a146d req-f6716983-9fac-4837-ba94-6fc9e0bfe583 service nova] Creating event network-vif-deleted:3949bca1-350d-456b-8b19-4ce4d228854d for instance 9be563ca-739e-4121-9dc8-9e46c7a131b6 on n-h1-854247-14 Oct 17 13:44:44.699080 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-421a5c21-4393-4b19-afc9-5741f73f47f3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:44.699830 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-421a5c21-4393-4b19-afc9-5741f73f47f3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: b1b0d02c-b32f-45cd-8732-99b1e3119ca6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:44.714024 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-4fb81fce-cbf0-4b36-b621-423eae0a146d req-f6716983-9fac-4837-ba94-6fc9e0bfe583 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079535 Oct 17 13:44:44.715302 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1313/2607] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:44:44.718648 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-421a5c21-4393-4b19-afc9-5741f73f47f3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:44.720062 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-421a5c21-4393-4b19-afc9-5741f73f47f3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:44.727846 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-421a5c21-4393-4b19-afc9-5741f73f47f3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:44.729577 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-163ae2bc-a785-44a5-bc54-35cd61974dd9 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:44.729849 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-421a5c21-4393-4b19-afc9-5741f73f47f3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:44.732032 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-163ae2bc-a785-44a5-bc54-35cd61974dd9 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] [instance: c8ec85bf-e448-4a4b-998d-a6bedb89d5e8] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:44.733073 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-421a5c21-4393-4b19-afc9-5741f73f47f3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:44.733609 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-421a5c21-4393-4b19-afc9-5741f73f47f3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:44.747883 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-163ae2bc-a785-44a5-bc54-35cd61974dd9 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:44.748742 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-163ae2bc-a785-44a5-bc54-35cd61974dd9 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:44.750388 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-163ae2bc-a785-44a5-bc54-35cd61974dd9 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:44.752339 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-163ae2bc-a785-44a5-bc54-35cd61974dd9 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:44.752974 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-163ae2bc-a785-44a5-bc54-35cd61974dd9 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:44.753588 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-163ae2bc-a785-44a5-bc54-35cd61974dd9 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:44.779800 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-421a5c21-4393-4b19-afc9-5741f73f47f3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] HTTP exception thrown: Instance b1b0d02c-b32f-45cd-8732-99b1e3119ca6 could not be found. Oct 17 13:44:44.781794 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-421a5c21-4393-4b19-afc9-5741f73f47f3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Request method failure captured: Oct 17 13:44:44.781794 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6 HTTP/1.1 Oct 17 13:44:44.781794 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:44:44.781794 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:44:44.781794 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:44:44.781794 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:44:44.781794 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:44:44.781794 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:44:44.781794 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:44:44.781794 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:44:44.781794 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVqYdRrJYCWyuI_FQz_MllU78A6FgYoAnDA9gdwPauZtaBEX-T7MkFUfKOkAZSrtD_LmO7eB1jtruLn1rwEZOZdhe4hbAiSuVzct5qoO-IV9yMhGhcrR76eqo3706KiWiMqRJoDvSKZaGrDwgOi9uksXK7vrXL2pyT4e4DSq7MSXAPk Oct 17 13:44:44.781794 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:44:44.781794 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:44:44.781794 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:44:44.781794 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:44:44.781794 n-d-854247-14 devstack@n-api.service[127017]: X-Openstack-Nova-Api-Version: 2.25 Oct 17 13:44:44.781794 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:44:44.781794 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:44:44.781794 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 90d4540094b84255821c0ab95304d22a Oct 17 13:44:44.781794 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-404581456 Oct 17 13:44:44.781794 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:44:44.781794 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:44:44.781794 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/90d4540094b84255821c0ab95304d22a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/90d4540094b84255821c0ab95304d22a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/90d4540094b84255821c0ab95304d22a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_90d4540094b84255821c0ab95304d22a", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:44:44.781794 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-404581456 Oct 17 13:44:44.781794 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 90d4540094b84255821c0ab95304d22a Oct 17 13:44:44.781794 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-404581456 Oct 17 13:44:44.781794 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-LiveAutoBlockMigrationV225Test-404581456-project Oct 17 13:44:44.781794 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:44:44.781794 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:44:44.781794 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 5bc3340d39404042af0eca8747874005 Oct 17 13:44:44.781794 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-404581456-project Oct 17 13:44:44.781794 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:44:44.781794 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance b1b0d02c-b32f-45cd-8732-99b1e3119ca6 could not be found. Oct 17 13:44:44.781794 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'b1b0d02c-b32f-45cd-8732-99b1e3119ca6'} Oct 17 13:44:44.781794 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:44:44.781794 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:44:44.781794 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:44:44.781794 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:44:44.781794 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:44:44.781794 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:44:44.781794 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:44:44.781794 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:44:44.781794 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:44:44.781794 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:44:44.781794 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1b0d02c-b32f-45cd-8732-99b1e3119ca6 could not be found. Oct 17 13:44:44.781794 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:44:44.781794 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:44:44.781794 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:44:44.781794 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:44:44.781794 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:44:44.781794 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:44:44.781794 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:44:44.781794 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:44:44.781794 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:44:44.781794 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:44:44.781794 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:44:44.781794 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:44:44.781794 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:44:44.781794 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:44:44.781794 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:44:44.781794 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:44:44.781794 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1b0d02c-b32f-45cd-8732-99b1e3119ca6 could not be found. Oct 17 13:44:44.781794 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:44:44.785815 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:44:44.785815 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:44:44.785815 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:44:44.785815 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:44:44.785815 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:44:44.785815 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:44:44.785815 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:44:44.785815 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1b0d02c-b32f-45cd-8732-99b1e3119ca6 could not be found. Oct 17 13:44:44.785815 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:44:44.790901 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-421a5c21-4393-4b19-afc9-5741f73f47f3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Returning 404 to user: Instance b1b0d02c-b32f-45cd-8732-99b1e3119ca6 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:44:44.793568 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-421a5c21-4393-4b19-afc9-5741f73f47f3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6" status: 404 len: 111 microversion: 2.25 time: 0.119561 Oct 17 13:44:44.795730 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1295/2608] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:44 2022] GET /compute/v2.1/servers/b1b0d02c-b32f-45cd-8732-99b1e3119ca6 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:44:44.877973 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-96a49754-fa2a-42eb-ab5a-a589dcaa49fa tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:44.879020 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-96a49754-fa2a-42eb-ab5a-a589dcaa49fa tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: e555208e-39b0-4361-94a5-6b272c336be4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:44.907446 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-96a49754-fa2a-42eb-ab5a-a589dcaa49fa tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:44.908345 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-96a49754-fa2a-42eb-ab5a-a589dcaa49fa tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:44.910257 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-96a49754-fa2a-42eb-ab5a-a589dcaa49fa tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:44.912083 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-96a49754-fa2a-42eb-ab5a-a589dcaa49fa tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:44.912804 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-96a49754-fa2a-42eb-ab5a-a589dcaa49fa tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:44.913469 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-96a49754-fa2a-42eb-ab5a-a589dcaa49fa tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:45.538028 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-163ae2bc-a785-44a5-bc54-35cd61974dd9 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb93a068a854ec9a2c082b380e22466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '341aac3733474b58a6ce8724c8bba334', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:45.547484 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-163ae2bc-a785-44a5-bc54-35cd61974dd9 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] 10.222.0.79 "GET /compute/v2.1/servers/c8ec85bf-e448-4a4b-998d-a6bedb89d5e8" status: 200 len: 1350 microversion: 2.1 time: 0.830417 Oct 17 13:44:45.575083 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1314/2609] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:44 2022] GET /compute/v2.1/servers/c8ec85bf-e448-4a4b-998d-a6bedb89d5e8 => generated 1350 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:45.596587 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b7bf5267-cc90-4b39-aacb-f9e8a2d677e2 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:45.598393 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b7bf5267-cc90-4b39-aacb-f9e8a2d677e2 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 9be563ca-739e-4121-9dc8-9e46c7a131b6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:45.620680 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b7bf5267-cc90-4b39-aacb-f9e8a2d677e2 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:45.627805 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b7bf5267-cc90-4b39-aacb-f9e8a2d677e2 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:45.631144 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b7bf5267-cc90-4b39-aacb-f9e8a2d677e2 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:45.632372 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b7bf5267-cc90-4b39-aacb-f9e8a2d677e2 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:45.635743 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b7bf5267-cc90-4b39-aacb-f9e8a2d677e2 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:45.639305 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b7bf5267-cc90-4b39-aacb-f9e8a2d677e2 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:45.682382 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-b7bf5267-cc90-4b39-aacb-f9e8a2d677e2 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] HTTP exception thrown: Instance 9be563ca-739e-4121-9dc8-9e46c7a131b6 could not be found. Oct 17 13:44:45.686993 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b7bf5267-cc90-4b39-aacb-f9e8a2d677e2 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Request method failure captured: Oct 17 13:44:45.686993 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/9be563ca-739e-4121-9dc8-9e46c7a131b6 HTTP/1.1 Oct 17 13:44:45.686993 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:44:45.686993 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:44:45.686993 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:44:45.686993 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:44:45.686993 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:44:45.686993 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:44:45.686993 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:44:45.686993 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:44:45.686993 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVwEqzYAZh4AkEjRryOAZIhaHrAKxd2Qcal9md8a5n-MMUYSdXmcWYLDVkyQoPrDIbcsApBq2EewemPkBwvNDDOidb0hhc_Z3w9BeEUj5ET_flLYPqO5hgqCsuZGXFiYIEBJxrkx614fXiELZHaNkvhSdsJHShK0w7L-UPHhkPKqi5M Oct 17 13:44:45.686993 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:44:45.686993 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:44:45.686993 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:44:45.686993 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:44:45.686993 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:44:45.686993 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:44:45.686993 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:44:45.686993 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:44:45.686993 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:44:45.686993 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:44:45.686993 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_59e65f6eb06d40d583b9f43c9af94c13", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:44:45.686993 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:44:45.686993 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:44:45.686993 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:44:45.686993 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:44:45.686993 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:44:45.686993 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:44:45.686993 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 443c44b0bd9e4c56a7fe0c1a53238545 Oct 17 13:44:45.686993 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:44:45.686993 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:44:45.686993 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 9be563ca-739e-4121-9dc8-9e46c7a131b6 could not be found. Oct 17 13:44:45.686993 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '9be563ca-739e-4121-9dc8-9e46c7a131b6'} Oct 17 13:44:45.686993 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:44:45.686993 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:44:45.686993 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:44:45.686993 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:44:45.686993 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:44:45.686993 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:44:45.686993 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:44:45.686993 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:44:45.686993 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:44:45.686993 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:44:45.686993 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9be563ca-739e-4121-9dc8-9e46c7a131b6 could not be found. Oct 17 13:44:45.686993 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:44:45.686993 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:44:45.686993 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:44:45.686993 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:44:45.686993 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:44:45.686993 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:44:45.686993 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:44:45.686993 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:44:45.686993 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:44:45.686993 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:44:45.686993 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:44:45.686993 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:44:45.686993 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:44:45.686993 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:44:45.686993 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:44:45.686993 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:44:45.686993 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9be563ca-739e-4121-9dc8-9e46c7a131b6 could not be found. Oct 17 13:44:45.686993 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:44:45.686993 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:44:45.686993 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:44:45.692096 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:44:45.692096 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:44:45.692096 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:44:45.692096 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:44:45.692096 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:44:45.692096 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9be563ca-739e-4121-9dc8-9e46c7a131b6 could not be found. Oct 17 13:44:45.692096 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:44:45.702124 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b7bf5267-cc90-4b39-aacb-f9e8a2d677e2 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Returning 404 to user: Instance 9be563ca-739e-4121-9dc8-9e46c7a131b6 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:44:45.703319 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b7bf5267-cc90-4b39-aacb-f9e8a2d677e2 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/9be563ca-739e-4121-9dc8-9e46c7a131b6" status: 404 len: 111 microversion: 2.1 time: 0.126450 Oct 17 13:44:45.704952 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1315/2610] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:45 2022] GET /compute/v2.1/servers/9be563ca-739e-4121-9dc8-9e46c7a131b6 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:44:45.712333 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-600e1c02-46e0-42ca-97ee-b10f157ecc73 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:45.713193 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-600e1c02-46e0-42ca-97ee-b10f157ecc73 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] [instance: f59dba6a-0058-4aeb-a3b0-3e0209d928c4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:45.727683 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-600e1c02-46e0-42ca-97ee-b10f157ecc73 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:45.731946 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-600e1c02-46e0-42ca-97ee-b10f157ecc73 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:45.737710 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-600e1c02-46e0-42ca-97ee-b10f157ecc73 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:45.738713 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-600e1c02-46e0-42ca-97ee-b10f157ecc73 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:45.739415 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-600e1c02-46e0-42ca-97ee-b10f157ecc73 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:45.740031 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-600e1c02-46e0-42ca-97ee-b10f157ecc73 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:45.788086 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=100 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:44:46.110763 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-96a49754-fa2a-42eb-ab5a-a589dcaa49fa tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467250951f654e33b3e233868301bbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676987e95424497c94984347dd6a7988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:46.128564 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-96a49754-fa2a-42eb-ab5a-a589dcaa49fa tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4" status: 200 len: 1788 microversion: 2.1 time: 1.255320 Oct 17 13:44:46.136215 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1296/2611] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:44 2022] GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4 => generated 1788 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:46.145848 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-34093fc1-b0bd-43f9-8c02-58de46d831ba tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:46.146762 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-34093fc1-b0bd-43f9-8c02-58de46d831ba tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] [instance: 25f78ad7-b6b1-4c56-bb29-4a1e6fd7fb85] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:46.156259 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-34093fc1-b0bd-43f9-8c02-58de46d831ba tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:46.157013 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-34093fc1-b0bd-43f9-8c02-58de46d831ba tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:46.157593 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-34093fc1-b0bd-43f9-8c02-58de46d831ba tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:46.158575 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-34093fc1-b0bd-43f9-8c02-58de46d831ba tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:46.159821 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-34093fc1-b0bd-43f9-8c02-58de46d831ba tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:46.160425 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-34093fc1-b0bd-43f9-8c02-58de46d831ba tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:46.410701 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-600e1c02-46e0-42ca-97ee-b10f157ecc73 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc181092e9cb42e6a751e9bec506d7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a3aa5210b549fc95cd534135624ab5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:46.419356 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-600e1c02-46e0-42ca-97ee-b10f157ecc73 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] 10.222.0.79 "GET /compute/v2.1/servers/f59dba6a-0058-4aeb-a3b0-3e0209d928c4" status: 200 len: 1324 microversion: 2.1 time: 0.712970 Oct 17 13:44:46.435257 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1316/2612] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:45 2022] GET /compute/v2.1/servers/f59dba6a-0058-4aeb-a3b0-3e0209d928c4 => generated 1324 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:46.440277 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5493e1ee-fb49-46c3-ab9d-4ef08e2f34b6 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '.version_select at 0x7f7cd45b4ee0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:46.526745 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5493e1ee-fb49-46c3-ab9d-4ef08e2f34b6 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "GET /compute/v2.1/images/545ba6e2-5330-47da-8d7e-390d40909596" status: 200 len: 1426 microversion: 2.1 time: 0.090220 Oct 17 13:44:46.536224 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1317/2613] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:44:46 2022] GET /compute/v2.1/images/545ba6e2-5330-47da-8d7e-390d40909596 => generated 1426 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:46.545631 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-dc339a9c-61a1-45d1-a9de-135804de037f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:46.553556 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-dc339a9c-61a1-45d1-a9de-135804de037f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:46.575908 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc339a9c-61a1-45d1-a9de-135804de037f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:46.578800 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc339a9c-61a1-45d1-a9de-135804de037f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:46.579354 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc339a9c-61a1-45d1-a9de-135804de037f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:46.580111 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc339a9c-61a1-45d1-a9de-135804de037f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:46.580571 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc339a9c-61a1-45d1-a9de-135804de037f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:46.580991 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc339a9c-61a1-45d1-a9de-135804de037f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:46.712015 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-34093fc1-b0bd-43f9-8c02-58de46d831ba tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75205205ba2946fbb18918201f54e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3126767b1c348859c2640dc21e38f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:46.721636 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-34093fc1-b0bd-43f9-8c02-58de46d831ba tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] 10.222.0.79 "GET /compute/v2.1/servers/25f78ad7-b6b1-4c56-bb29-4a1e6fd7fb85" status: 200 len: 1319 microversion: 2.1 time: 0.583995 Oct 17 13:44:46.723933 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1297/2614] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:46 2022] GET /compute/v2.1/servers/25f78ad7-b6b1-4c56-bb29-4a1e6fd7fb85 => generated 1319 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:46.739520 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-516921ad-fd5d-4679-bf25-5b2126318b75 req-b763e062-d136-4a72-b687-f66a43596cba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25f78ad7-b6b1-4c56-bb29-4a1e6fd7fb85", "name": "network-vif-plugged", "status": "completed", "tag": "cd4c537b-c52e-4348-a550-70444ff951d7"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:44:46.761618 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-516921ad-fd5d-4679-bf25-5b2126318b75 req-b763e062-d136-4a72-b687-f66a43596cba service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:46.763299 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-516921ad-fd5d-4679-bf25-5b2126318b75 req-b763e062-d136-4a72-b687-f66a43596cba service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:46.772231 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-516921ad-fd5d-4679-bf25-5b2126318b75 req-b763e062-d136-4a72-b687-f66a43596cba service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:46.798342 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-516921ad-fd5d-4679-bf25-5b2126318b75 req-b763e062-d136-4a72-b687-f66a43596cba service nova] Creating event network-vif-plugged:cd4c537b-c52e-4348-a550-70444ff951d7 for instance 25f78ad7-b6b1-4c56-bb29-4a1e6fd7fb85 on n-h2-854247-14 Oct 17 13:44:46.809341 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-516921ad-fd5d-4679-bf25-5b2126318b75 req-b763e062-d136-4a72-b687-f66a43596cba service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080805 Oct 17 13:44:46.813776 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1298/2615] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:44:46.825413 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-18f963eb-230f-4303-9769-a75fc68a8369 req-7ac0f656-f1cb-4b88-becd-31412816fa21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e555208e-39b0-4361-94a5-6b272c336be4", "name": "network-vif-deleted", "tag": "7383d71d-5872-4de8-87b0-e2c48915669c"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:44:46.845943 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-18f963eb-230f-4303-9769-a75fc68a8369 req-7ac0f656-f1cb-4b88-becd-31412816fa21 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:46.847865 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-18f963eb-230f-4303-9769-a75fc68a8369 req-7ac0f656-f1cb-4b88-becd-31412816fa21 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:46.850980 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-18f963eb-230f-4303-9769-a75fc68a8369 req-7ac0f656-f1cb-4b88-becd-31412816fa21 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:46.881644 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-18f963eb-230f-4303-9769-a75fc68a8369 req-7ac0f656-f1cb-4b88-becd-31412816fa21 service nova] Creating event network-vif-deleted:7383d71d-5872-4de8-87b0-e2c48915669c for instance e555208e-39b0-4361-94a5-6b272c336be4 on n-h2-854247-14 Oct 17 13:44:46.895708 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-18f963eb-230f-4303-9769-a75fc68a8369 req-7ac0f656-f1cb-4b88-becd-31412816fa21 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080434 Oct 17 13:44:46.900162 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1299/2616] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:44:46.913533 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9a40e5bc-8b8d-4f8f-90b5-e1f396219ba3 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:46.914573 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9a40e5bc-8b8d-4f8f-90b5-e1f396219ba3 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] [instance: c8ec85bf-e448-4a4b-998d-a6bedb89d5e8] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:46.933004 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9a40e5bc-8b8d-4f8f-90b5-e1f396219ba3 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:46.933880 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9a40e5bc-8b8d-4f8f-90b5-e1f396219ba3 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:46.934556 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9a40e5bc-8b8d-4f8f-90b5-e1f396219ba3 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:46.935762 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9a40e5bc-8b8d-4f8f-90b5-e1f396219ba3 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:46.942553 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9a40e5bc-8b8d-4f8f-90b5-e1f396219ba3 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:46.943213 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9a40e5bc-8b8d-4f8f-90b5-e1f396219ba3 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:46.969077 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-dc339a9c-61a1-45d1-a9de-135804de037f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:46.989647 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-dc339a9c-61a1-45d1-a9de-135804de037f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 0.450708 Oct 17 13:44:46.996565 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1318/2617] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:46 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:47.164997 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-52a8f3d6-385f-45d5-9a08-97993f27a8cb tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:47.165713 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-52a8f3d6-385f-45d5-9a08-97993f27a8cb tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: e555208e-39b0-4361-94a5-6b272c336be4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:47.180455 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-52a8f3d6-385f-45d5-9a08-97993f27a8cb tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:47.188663 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-52a8f3d6-385f-45d5-9a08-97993f27a8cb tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:47.189227 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-52a8f3d6-385f-45d5-9a08-97993f27a8cb tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:47.191288 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-52a8f3d6-385f-45d5-9a08-97993f27a8cb tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:47.195111 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-52a8f3d6-385f-45d5-9a08-97993f27a8cb tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:47.196912 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-52a8f3d6-385f-45d5-9a08-97993f27a8cb tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:47.613777 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-52a8f3d6-385f-45d5-9a08-97993f27a8cb tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467250951f654e33b3e233868301bbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676987e95424497c94984347dd6a7988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:47.623706 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-52a8f3d6-385f-45d5-9a08-97993f27a8cb tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4" status: 200 len: 1673 microversion: 2.1 time: 0.462457 Oct 17 13:44:47.651573 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1319/2618] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:47 2022] GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4 => generated 1673 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:44:47.657681 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-be72ce1a-516d-4293-a708-8c862446267e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "72be642c-f241-4ddb-80d7-b14a93aa7fc9"}]}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-be72ce1a-516d-4293-a708-8c862446267e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Request method failure captured: Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 163 Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVwEqzYAZh4AkEjRryOAZIhaHrAKxd2Qcal9md8a5n-MMUYSdXmcWYLDVkyQoPrDIbcsApBq2EewemPkBwvNDDOidb0hhc_Z3w9BeEUj5ET_flLYPqO5hgqCsuZGXFiYIEBJxrkx614fXiELZHaNkvhSdsJHShK0w7L-UPHhkPKqi5M Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_59e65f6eb06d40d583b9f43c9af94c13", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 443c44b0bd9e4c56a7fe0c1a53238545 Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: {"server": {"name": 12345, "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "72be642c-f241-4ddb-80d7-b14a93aa7fc9"}]}} Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '0743b21b-a6ff-4d02-897c-eabb68c3ba07', 'flavorRef': '452', 'networks': [{'uuid': '72be642c-f241-4ddb-80d7-b14a93aa7fc9'}]}}} Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi 12345 Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:44:47.665916 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:44:47.671426 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:44:47.671426 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 17 13:44:47.671426 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:44:47.671426 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:44:47.671426 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:44:47.671426 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:44:47.671426 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:44:47.671426 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:44:47.671426 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:44:47.671426 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:44:47.671426 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 17 13:44:47.671426 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:44:47.673392 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-be72ce1a-516d-4293-a708-8c862446267e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:44:47.674436 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-be72ce1a-516d-4293-a708-8c862446267e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.021451 Oct 17 13:44:47.678077 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1320/2619] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:44:47 2022] POST /compute/v2.1/servers => generated 127 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:44:47.689827 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fef52056-a493-4d77-98ab-58c5fa47218e tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:47.690746 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-fef52056-a493-4d77-98ab-58c5fa47218e tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] [instance: f59dba6a-0058-4aeb-a3b0-3e0209d928c4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:47.709437 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fef52056-a493-4d77-98ab-58c5fa47218e tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:47.710273 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fef52056-a493-4d77-98ab-58c5fa47218e tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:47.710888 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fef52056-a493-4d77-98ab-58c5fa47218e tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:47.711870 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fef52056-a493-4d77-98ab-58c5fa47218e tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:47.712552 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fef52056-a493-4d77-98ab-58c5fa47218e tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:47.713123 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fef52056-a493-4d77-98ab-58c5fa47218e tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:47.848453 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9a40e5bc-8b8d-4f8f-90b5-e1f396219ba3 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb93a068a854ec9a2c082b380e22466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '341aac3733474b58a6ce8724c8bba334', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:47.861635 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9a40e5bc-8b8d-4f8f-90b5-e1f396219ba3 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] 10.222.0.79 "GET /compute/v2.1/servers/c8ec85bf-e448-4a4b-998d-a6bedb89d5e8" status: 200 len: 1350 microversion: 2.1 time: 0.958618 Oct 17 13:44:47.864610 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1300/2620] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:46 2022] GET /compute/v2.1/servers/c8ec85bf-e448-4a4b-998d-a6bedb89d5e8 => generated 1350 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:47.882493 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-026ed9dc-b625-4ea8-bf9e-0ae181bec95d tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '.version_select at 0x7f7cd4a164c0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:47.966383 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-026ed9dc-b625-4ea8-bf9e-0ae181bec95d tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "GET /compute/v2.1/images/545ba6e2-5330-47da-8d7e-390d40909596" status: 200 len: 1426 microversion: 2.1 time: 0.100403 Oct 17 13:44:47.980419 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1301/2621] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:44:47 2022] GET /compute/v2.1/images/545ba6e2-5330-47da-8d7e-390d40909596 => generated 1426 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:48.004125 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c49fdadc-8b7b-4172-b919-6499ffb867af tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:48.005098 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c49fdadc-8b7b-4172-b919-6499ffb867af tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:48.012020 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c49fdadc-8b7b-4172-b919-6499ffb867af tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:48.012754 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c49fdadc-8b7b-4172-b919-6499ffb867af tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:48.013431 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c49fdadc-8b7b-4172-b919-6499ffb867af tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:48.016022 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c49fdadc-8b7b-4172-b919-6499ffb867af tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:48.016688 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c49fdadc-8b7b-4172-b919-6499ffb867af tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:48.017271 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c49fdadc-8b7b-4172-b919-6499ffb867af tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:48.262532 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fef52056-a493-4d77-98ab-58c5fa47218e tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc181092e9cb42e6a751e9bec506d7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a3aa5210b549fc95cd534135624ab5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:48.272372 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fef52056-a493-4d77-98ab-58c5fa47218e tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] 10.222.0.79 "GET /compute/v2.1/servers/f59dba6a-0058-4aeb-a3b0-3e0209d928c4" status: 200 len: 1324 microversion: 2.1 time: 0.592877 Oct 17 13:44:48.276375 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1321/2622] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:47 2022] GET /compute/v2.1/servers/f59dba6a-0058-4aeb-a3b0-3e0209d928c4 => generated 1324 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:48.288503 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-32450abb-b9f8-4dc8-a4a3-1efdea0b5628 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:48.289400 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-32450abb-b9f8-4dc8-a4a3-1efdea0b5628 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] [instance: 25f78ad7-b6b1-4c56-bb29-4a1e6fd7fb85] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:48.310643 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-32450abb-b9f8-4dc8-a4a3-1efdea0b5628 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:48.325195 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-32450abb-b9f8-4dc8-a4a3-1efdea0b5628 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:48.326147 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-32450abb-b9f8-4dc8-a4a3-1efdea0b5628 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:48.327318 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-32450abb-b9f8-4dc8-a4a3-1efdea0b5628 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:48.327926 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-32450abb-b9f8-4dc8-a4a3-1efdea0b5628 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:48.328525 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-32450abb-b9f8-4dc8-a4a3-1efdea0b5628 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:48.909294 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c49fdadc-8b7b-4172-b919-6499ffb867af tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:48.918493 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c49fdadc-8b7b-4172-b919-6499ffb867af tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 0.936594 Oct 17 13:44:48.919075 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1302/2623] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:47 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:48.947322 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ce9c5197-31a8-4e32-868f-43bdb58dccb7 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:48.948568 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ce9c5197-31a8-4e32-868f-43bdb58dccb7 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: e555208e-39b0-4361-94a5-6b272c336be4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:48.975971 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ce9c5197-31a8-4e32-868f-43bdb58dccb7 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:48.978934 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ce9c5197-31a8-4e32-868f-43bdb58dccb7 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:48.980483 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ce9c5197-31a8-4e32-868f-43bdb58dccb7 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:48.983852 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ce9c5197-31a8-4e32-868f-43bdb58dccb7 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:48.985581 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ce9c5197-31a8-4e32-868f-43bdb58dccb7 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:48.986248 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ce9c5197-31a8-4e32-868f-43bdb58dccb7 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:49.190933 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-32450abb-b9f8-4dc8-a4a3-1efdea0b5628 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75205205ba2946fbb18918201f54e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3126767b1c348859c2640dc21e38f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:49.204606 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-32450abb-b9f8-4dc8-a4a3-1efdea0b5628 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] 10.222.0.79 "GET /compute/v2.1/servers/25f78ad7-b6b1-4c56-bb29-4a1e6fd7fb85" status: 200 len: 1319 microversion: 2.1 time: 0.926816 Oct 17 13:44:49.205865 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1322/2624] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:48 2022] GET /compute/v2.1/servers/25f78ad7-b6b1-4c56-bb29-4a1e6fd7fb85 => generated 1319 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:49.219632 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-fc765cd6-9de4-4a40-8dd7-636b50ab69ad req-f19bd1f4-fb32-4b27-9be1-4a370147edb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f59dba6a-0058-4aeb-a3b0-3e0209d928c4", "name": "network-vif-plugged", "status": "completed", "tag": "a20526da-2349-4b19-a6a5-29f2525348f2"}, {"server_uuid": "e555208e-39b0-4361-94a5-6b272c336be4", "name": "network-vif-unplugged", "status": "completed", "tag": "7b45bf47-c253-4e30-bf75-b6963b23bf0e"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:44:49.243707 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-fc765cd6-9de4-4a40-8dd7-636b50ab69ad req-f19bd1f4-fb32-4b27-9be1-4a370147edb2 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:49.244440 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-fc765cd6-9de4-4a40-8dd7-636b50ab69ad req-f19bd1f4-fb32-4b27-9be1-4a370147edb2 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:49.245049 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-fc765cd6-9de4-4a40-8dd7-636b50ab69ad req-f19bd1f4-fb32-4b27-9be1-4a370147edb2 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:49.269332 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-fc765cd6-9de4-4a40-8dd7-636b50ab69ad req-f19bd1f4-fb32-4b27-9be1-4a370147edb2 service nova] Creating event network-vif-plugged:a20526da-2349-4b19-a6a5-29f2525348f2 for instance f59dba6a-0058-4aeb-a3b0-3e0209d928c4 on n-h2-854247-14 Oct 17 13:44:49.280295 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-fc765cd6-9de4-4a40-8dd7-636b50ab69ad req-f19bd1f4-fb32-4b27-9be1-4a370147edb2 service nova] Creating event network-vif-unplugged:7b45bf47-c253-4e30-bf75-b6963b23bf0e for instance e555208e-39b0-4361-94a5-6b272c336be4 on n-h2-854247-14 Oct 17 13:44:49.290018 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-fc765cd6-9de4-4a40-8dd7-636b50ab69ad req-f19bd1f4-fb32-4b27-9be1-4a370147edb2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.082631 Oct 17 13:44:49.291424 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1323/2625] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:44:49.302294 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f1ad5177-56e5-4cf6-83d2-5a8d204eb41d tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:49.304642 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f1ad5177-56e5-4cf6-83d2-5a8d204eb41d tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] [instance: c8ec85bf-e448-4a4b-998d-a6bedb89d5e8] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:49.322032 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1ad5177-56e5-4cf6-83d2-5a8d204eb41d tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:49.322768 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1ad5177-56e5-4cf6-83d2-5a8d204eb41d tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:49.323411 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1ad5177-56e5-4cf6-83d2-5a8d204eb41d tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:49.324605 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1ad5177-56e5-4cf6-83d2-5a8d204eb41d tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:49.325368 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1ad5177-56e5-4cf6-83d2-5a8d204eb41d tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:49.326677 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1ad5177-56e5-4cf6-83d2-5a8d204eb41d tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:49.920354 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ce9c5197-31a8-4e32-868f-43bdb58dccb7 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467250951f654e33b3e233868301bbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676987e95424497c94984347dd6a7988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:49.936722 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ce9c5197-31a8-4e32-868f-43bdb58dccb7 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4" status: 200 len: 1652 microversion: 2.1 time: 1.009103 Oct 17 13:44:49.943032 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1303/2626] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:48 2022] GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4 => generated 1652 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:49.952326 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6ce0dc18-f191-4324-ae4f-a695568c18e7 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:49.954570 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6ce0dc18-f191-4324-ae4f-a695568c18e7 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:49.969213 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6ce0dc18-f191-4324-ae4f-a695568c18e7 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:49.969963 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6ce0dc18-f191-4324-ae4f-a695568c18e7 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:49.970574 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6ce0dc18-f191-4324-ae4f-a695568c18e7 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:49.976519 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6ce0dc18-f191-4324-ae4f-a695568c18e7 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:49.977289 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6ce0dc18-f191-4324-ae4f-a695568c18e7 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:49.978020 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6ce0dc18-f191-4324-ae4f-a695568c18e7 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:50.345613 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f1ad5177-56e5-4cf6-83d2-5a8d204eb41d tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb93a068a854ec9a2c082b380e22466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '341aac3733474b58a6ce8724c8bba334', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:50.362525 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f1ad5177-56e5-4cf6-83d2-5a8d204eb41d tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] 10.222.0.79 "GET /compute/v2.1/servers/c8ec85bf-e448-4a4b-998d-a6bedb89d5e8" status: 200 len: 1350 microversion: 2.1 time: 1.065211 Oct 17 13:44:50.379561 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1324/2627] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:49 2022] GET /compute/v2.1/servers/c8ec85bf-e448-4a4b-998d-a6bedb89d5e8 => generated 1350 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:50.386382 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6ce0dc18-f191-4324-ae4f-a695568c18e7 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:50.394559 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9051c890-1d0d-409f-a8c8-1679148f3e24 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '.version_select at 0x7f7cd459ec10>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:50.397528 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6ce0dc18-f191-4324-ae4f-a695568c18e7 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 0.453185 Oct 17 13:44:50.404104 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1304/2628] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:49 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:50.432101 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-e7b7fe6a-b7d7-4f95-ad4d-8682b1d559a5 req-aba7188d-812e-4b77-8937-4431c2efe0c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e555208e-39b0-4361-94a5-6b272c336be4", "name": "network-vif-deleted", "tag": "dde3317b-4b55-489e-8fdb-a5cb0e8852af"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:44:50.467788 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-e7b7fe6a-b7d7-4f95-ad4d-8682b1d559a5 req-aba7188d-812e-4b77-8937-4431c2efe0c2 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:50.468496 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-e7b7fe6a-b7d7-4f95-ad4d-8682b1d559a5 req-aba7188d-812e-4b77-8937-4431c2efe0c2 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:50.472728 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-e7b7fe6a-b7d7-4f95-ad4d-8682b1d559a5 req-aba7188d-812e-4b77-8937-4431c2efe0c2 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:50.497815 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9051c890-1d0d-409f-a8c8-1679148f3e24 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "GET /compute/v2.1/images/545ba6e2-5330-47da-8d7e-390d40909596" status: 200 len: 1426 microversion: 2.1 time: 0.116614 Oct 17 13:44:50.499460 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1325/2629] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:44:50 2022] GET /compute/v2.1/images/545ba6e2-5330-47da-8d7e-390d40909596 => generated 1426 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:50.509396 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-e7b7fe6a-b7d7-4f95-ad4d-8682b1d559a5 req-aba7188d-812e-4b77-8937-4431c2efe0c2 service nova] Creating event network-vif-deleted:dde3317b-4b55-489e-8fdb-a5cb0e8852af for instance e555208e-39b0-4361-94a5-6b272c336be4 on n-h2-854247-14 Oct 17 13:44:50.516440 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-e7b7fe6a-b7d7-4f95-ad4d-8682b1d559a5 req-aba7188d-812e-4b77-8937-4431c2efe0c2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110795 Oct 17 13:44:50.518379 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-045985f3-c417-4672-a0a4-3bb19e42e654 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:50.519194 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-045985f3-c417-4672-a0a4-3bb19e42e654 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] [instance: f59dba6a-0058-4aeb-a3b0-3e0209d928c4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:50.519373 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1305/2630] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:44:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:44:50.534613 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3eb15fee-ad74-462f-872b-b2051b748d4b tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:50.535640 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3eb15fee-ad74-462f-872b-b2051b748d4b tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] [instance: 25f78ad7-b6b1-4c56-bb29-4a1e6fd7fb85] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:50.556664 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-045985f3-c417-4672-a0a4-3bb19e42e654 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:50.568353 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3eb15fee-ad74-462f-872b-b2051b748d4b tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:50.570141 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-045985f3-c417-4672-a0a4-3bb19e42e654 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:50.570963 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3eb15fee-ad74-462f-872b-b2051b748d4b tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:50.571656 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-045985f3-c417-4672-a0a4-3bb19e42e654 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:50.572283 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3eb15fee-ad74-462f-872b-b2051b748d4b tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:50.573991 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3eb15fee-ad74-462f-872b-b2051b748d4b tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:50.574698 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-045985f3-c417-4672-a0a4-3bb19e42e654 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:50.575861 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-045985f3-c417-4672-a0a4-3bb19e42e654 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:50.576181 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3eb15fee-ad74-462f-872b-b2051b748d4b tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:50.576793 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-045985f3-c417-4672-a0a4-3bb19e42e654 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:50.577391 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3eb15fee-ad74-462f-872b-b2051b748d4b tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:51.033552 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3eb15fee-ad74-462f-872b-b2051b748d4b tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75205205ba2946fbb18918201f54e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3126767b1c348859c2640dc21e38f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:51.037903 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-045985f3-c417-4672-a0a4-3bb19e42e654 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc181092e9cb42e6a751e9bec506d7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a3aa5210b549fc95cd534135624ab5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:51.046518 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-045985f3-c417-4672-a0a4-3bb19e42e654 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] 10.222.0.79 "GET /compute/v2.1/servers/f59dba6a-0058-4aeb-a3b0-3e0209d928c4" status: 200 len: 1324 microversion: 2.1 time: 0.545822 Oct 17 13:44:51.047118 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1326/2631] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:50 2022] GET /compute/v2.1/servers/f59dba6a-0058-4aeb-a3b0-3e0209d928c4 => generated 1324 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:51.060213 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c7afdd43-eac2-4f06-ac87-1f9aa4d9ebe5 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:51.061066 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3eb15fee-ad74-462f-872b-b2051b748d4b tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] 10.222.0.79 "GET /compute/v2.1/servers/25f78ad7-b6b1-4c56-bb29-4a1e6fd7fb85" status: 200 len: 1507 microversion: 2.1 time: 0.526040 Oct 17 13:44:51.061336 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c7afdd43-eac2-4f06-ac87-1f9aa4d9ebe5 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: e555208e-39b0-4361-94a5-6b272c336be4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:51.061760 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1306/2632] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:50 2022] GET /compute/v2.1/servers/25f78ad7-b6b1-4c56-bb29-4a1e6fd7fb85 => generated 1507 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:51.084445 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c7afdd43-eac2-4f06-ac87-1f9aa4d9ebe5 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:51.091979 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c7afdd43-eac2-4f06-ac87-1f9aa4d9ebe5 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:51.093332 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c7afdd43-eac2-4f06-ac87-1f9aa4d9ebe5 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:51.094337 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c7afdd43-eac2-4f06-ac87-1f9aa4d9ebe5 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:51.095002 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c7afdd43-eac2-4f06-ac87-1f9aa4d9ebe5 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:51.095631 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c7afdd43-eac2-4f06-ac87-1f9aa4d9ebe5 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:51.099476 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8211e1fd-bdc1-47aa-9624-70c7993a4142 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:51.100437 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8211e1fd-bdc1-47aa-9624-70c7993a4142 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] [instance: 408d8179-50fa-4c27-a2e9-85dc1daaa5b3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:51.116605 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8211e1fd-bdc1-47aa-9624-70c7993a4142 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:51.117292 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8211e1fd-bdc1-47aa-9624-70c7993a4142 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:51.117917 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8211e1fd-bdc1-47aa-9624-70c7993a4142 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:51.118793 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8211e1fd-bdc1-47aa-9624-70c7993a4142 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:51.120412 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8211e1fd-bdc1-47aa-9624-70c7993a4142 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:51.121882 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8211e1fd-bdc1-47aa-9624-70c7993a4142 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:51.210020 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c7afdd43-eac2-4f06-ac87-1f9aa4d9ebe5 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:51.210781 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c7afdd43-eac2-4f06-ac87-1f9aa4d9ebe5 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:51.211414 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c7afdd43-eac2-4f06-ac87-1f9aa4d9ebe5 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:51.213854 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-c7afdd43-eac2-4f06-ac87-1f9aa4d9ebe5 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lazy-loading 'fault' on Instance uuid e555208e-39b0-4361-94a5-6b272c336be4 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:44:51.328513 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c7afdd43-eac2-4f06-ac87-1f9aa4d9ebe5 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467250951f654e33b3e233868301bbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676987e95424497c94984347dd6a7988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:51.342701 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c7afdd43-eac2-4f06-ac87-1f9aa4d9ebe5 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4" status: 200 len: 1301 microversion: 2.1 time: 0.283055 Oct 17 13:44:51.347798 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1327/2633] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:51 2022] GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4 => generated 1301 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:51.385447 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-660ff4cc-2e33-4762-bc4b-8922528b37de req-9f61dacd-fd44-4615-9a24-e978df7d6ac3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8ec85bf-e448-4a4b-998d-a6bedb89d5e8", "name": "network-vif-plugged", "status": "completed", "tag": "d873d2fd-e2b6-4478-a3ae-55a34161df6e"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:44:51.438985 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-660ff4cc-2e33-4762-bc4b-8922528b37de req-9f61dacd-fd44-4615-9a24-e978df7d6ac3 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:51.439503 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-660ff4cc-2e33-4762-bc4b-8922528b37de req-9f61dacd-fd44-4615-9a24-e978df7d6ac3 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:51.446314 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-660ff4cc-2e33-4762-bc4b-8922528b37de req-9f61dacd-fd44-4615-9a24-e978df7d6ac3 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:51.483593 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-660ff4cc-2e33-4762-bc4b-8922528b37de req-9f61dacd-fd44-4615-9a24-e978df7d6ac3 service nova] Creating event network-vif-plugged:d873d2fd-e2b6-4478-a3ae-55a34161df6e for instance c8ec85bf-e448-4a4b-998d-a6bedb89d5e8 on n-h1-854247-14 Oct 17 13:44:51.509122 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-660ff4cc-2e33-4762-bc4b-8922528b37de req-9f61dacd-fd44-4615-9a24-e978df7d6ac3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160015 Oct 17 13:44:51.510119 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1328/2634] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:44:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:44:51.516985 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b24399a6-21f8-43c3-bbb5-fb53d6290acf tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:51.528243 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b24399a6-21f8-43c3-bbb5-fb53d6290acf tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] [instance: c8ec85bf-e448-4a4b-998d-a6bedb89d5e8] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:51.528518 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8211e1fd-bdc1-47aa-9624-70c7993a4142 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75205205ba2946fbb18918201f54e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3126767b1c348859c2640dc21e38f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:51.538661 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8211e1fd-bdc1-47aa-9624-70c7993a4142 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] 10.222.0.79 "GET /compute/v2.1/servers/408d8179-50fa-4c27-a2e9-85dc1daaa5b3" status: 200 len: 1507 microversion: 2.1 time: 0.444240 Oct 17 13:44:51.549295 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b24399a6-21f8-43c3-bbb5-fb53d6290acf tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:51.549923 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b24399a6-21f8-43c3-bbb5-fb53d6290acf tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:51.550463 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b24399a6-21f8-43c3-bbb5-fb53d6290acf tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:51.553317 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b24399a6-21f8-43c3-bbb5-fb53d6290acf tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:51.553967 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b24399a6-21f8-43c3-bbb5-fb53d6290acf tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:51.554510 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b24399a6-21f8-43c3-bbb5-fb53d6290acf tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:51.556267 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1307/2635] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:51 2022] GET /compute/v2.1/servers/408d8179-50fa-4c27-a2e9-85dc1daaa5b3 => generated 1507 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:51.561994 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-508f1255-55a8-46fc-b568-286b8af7b2ab tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '.version_select at 0x7f7cd5573c10>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:51.666516 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-508f1255-55a8-46fc-b568-286b8af7b2ab tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "GET /compute/v2.1/images/545ba6e2-5330-47da-8d7e-390d40909596" status: 200 len: 1426 microversion: 2.1 time: 0.109029 Oct 17 13:44:51.687588 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1308/2636] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:44:51 2022] GET /compute/v2.1/images/545ba6e2-5330-47da-8d7e-390d40909596 => generated 1426 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:51.696610 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e2c898d5-63ee-4fdd-86fd-c9fe30f0c023 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:51.697522 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e2c898d5-63ee-4fdd-86fd-c9fe30f0c023 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] [instance: 408d8179-50fa-4c27-a2e9-85dc1daaa5b3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:51.710922 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e2c898d5-63ee-4fdd-86fd-c9fe30f0c023 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:51.711444 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e2c898d5-63ee-4fdd-86fd-c9fe30f0c023 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:51.712131 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e2c898d5-63ee-4fdd-86fd-c9fe30f0c023 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:51.713361 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e2c898d5-63ee-4fdd-86fd-c9fe30f0c023 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:51.715299 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e2c898d5-63ee-4fdd-86fd-c9fe30f0c023 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:51.715942 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e2c898d5-63ee-4fdd-86fd-c9fe30f0c023 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:51.749052 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e2c898d5-63ee-4fdd-86fd-c9fe30f0c023 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] [instance: 408d8179-50fa-4c27-a2e9-85dc1daaa5b3] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:44:51.897613 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e2c898d5-63ee-4fdd-86fd-c9fe30f0c023 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] 10.222.0.79 "DELETE /compute/v2.1/servers/408d8179-50fa-4c27-a2e9-85dc1daaa5b3" status: 204 len: 0 microversion: 2.1 time: 0.208283 Oct 17 13:44:51.898579 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1309/2637] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:44:51 2022] DELETE /compute/v2.1/servers/408d8179-50fa-4c27-a2e9-85dc1daaa5b3 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:44:51.912248 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4265f1a4-fbbf-4ca0-9fd5-5fb2645e7c46 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:51.913131 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4265f1a4-fbbf-4ca0-9fd5-5fb2645e7c46 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] [instance: 25f78ad7-b6b1-4c56-bb29-4a1e6fd7fb85] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:51.934086 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4265f1a4-fbbf-4ca0-9fd5-5fb2645e7c46 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:51.936684 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4265f1a4-fbbf-4ca0-9fd5-5fb2645e7c46 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:51.938166 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4265f1a4-fbbf-4ca0-9fd5-5fb2645e7c46 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:51.939079 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4265f1a4-fbbf-4ca0-9fd5-5fb2645e7c46 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:51.939739 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4265f1a4-fbbf-4ca0-9fd5-5fb2645e7c46 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:51.940786 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4265f1a4-fbbf-4ca0-9fd5-5fb2645e7c46 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:51.982288 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b24399a6-21f8-43c3-bbb5-fb53d6290acf tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb93a068a854ec9a2c082b380e22466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '341aac3733474b58a6ce8724c8bba334', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:51.996469 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4265f1a4-fbbf-4ca0-9fd5-5fb2645e7c46 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] [instance: 25f78ad7-b6b1-4c56-bb29-4a1e6fd7fb85] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:44:51.999675 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b24399a6-21f8-43c3-bbb5-fb53d6290acf tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] 10.222.0.79 "GET /compute/v2.1/servers/c8ec85bf-e448-4a4b-998d-a6bedb89d5e8" status: 200 len: 1350 microversion: 2.1 time: 0.488020 Oct 17 13:44:52.011217 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1329/2638] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:51 2022] GET /compute/v2.1/servers/c8ec85bf-e448-4a4b-998d-a6bedb89d5e8 => generated 1350 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:52.011437 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:44:52.011549 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b6bdf57f-dbc8-4485-827e-f4e3b0f8f40a tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:52.011549 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b6bdf57f-dbc8-4485-827e-f4e3b0f8f40a tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] [instance: 2184ae8f-022d-4de9-8d0f-0c2d546c9d6f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:52.021816 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b6bdf57f-dbc8-4485-827e-f4e3b0f8f40a tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:52.031859 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b6bdf57f-dbc8-4485-827e-f4e3b0f8f40a tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:52.032474 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b6bdf57f-dbc8-4485-827e-f4e3b0f8f40a tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:52.033351 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b6bdf57f-dbc8-4485-827e-f4e3b0f8f40a tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:52.033951 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b6bdf57f-dbc8-4485-827e-f4e3b0f8f40a tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:52.034478 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b6bdf57f-dbc8-4485-827e-f4e3b0f8f40a tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:52.063886 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-b6bdf57f-dbc8-4485-827e-f4e3b0f8f40a tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] HTTP exception thrown: Instance 2184ae8f-022d-4de9-8d0f-0c2d546c9d6f could not be found. Oct 17 13:44:52.073383 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b6bdf57f-dbc8-4485-827e-f4e3b0f8f40a tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Request method failure captured: Oct 17 13:44:52.073383 n-d-854247-14 devstack@n-api.service[127016]: request: DELETE /compute/v2.1/servers/2184ae8f-022d-4de9-8d0f-0c2d546c9d6f HTTP/1.1 Oct 17 13:44:52.073383 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:44:52.073383 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:44:52.073383 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:44:52.073383 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:44:52.073383 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:44:52.073383 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:44:52.073383 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:44:52.073383 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:44:52.073383 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVue64m5R6rw6hm4n0GPQELiiIZiHcHY_OayUzz-BJS3xlzYFUnBRAs8GlOKgSdZftnfHTgck3Rq8-pCdjaziS1rz_ScuIwW2mZbBMPorBOz8ZemES7b8EhxnpIOw7VzFdlTEwNdJ-TTZHLLOAXDoFmWvrs7ZVy2Zo-5hLyq2Dtd7Xk Oct 17 13:44:52.073383 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:44:52.073383 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:44:52.073383 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:44:52.073383 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:44:52.073383 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:44:52.073383 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:44:52.073383 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 5bb50742d06f403598634414befbeb12 Oct 17 13:44:52.073383 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1251956669 Oct 17 13:44:52.073383 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:44:52.073383 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:44:52.073383 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5bb50742d06f403598634414befbeb12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5bb50742d06f403598634414befbeb12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5bb50742d06f403598634414befbeb12"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5bb50742d06f403598634414befbeb12", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:44:52.073383 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1251956669 Oct 17 13:44:52.073383 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 5bb50742d06f403598634414befbeb12 Oct 17 13:44:52.073383 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1251956669 Oct 17 13:44:52.073383 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-AttachSCSIVolumeTestJSON-1251956669-project Oct 17 13:44:52.073383 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:44:52.073383 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:44:52.073383 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 799d72ccad514fd899d21809d613249b Oct 17 13:44:52.073383 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1251956669-project Oct 17 13:44:52.073383 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:44:52.073383 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 2184ae8f-022d-4de9-8d0f-0c2d546c9d6f could not be found. Oct 17 13:44:52.073383 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '2184ae8f-022d-4de9-8d0f-0c2d546c9d6f'} Oct 17 13:44:52.073383 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:44:52.073383 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:44:52.073383 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:44:52.073383 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:44:52.073383 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:44:52.073383 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:44:52.073383 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:44:52.073383 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:44:52.073383 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:44:52.073383 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:44:52.073383 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2184ae8f-022d-4de9-8d0f-0c2d546c9d6f could not be found. Oct 17 13:44:52.073383 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:44:52.073383 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:44:52.073383 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:44:52.073383 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:44:52.073383 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:44:52.073383 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:44:52.073383 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:44:52.073383 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:44:52.073383 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:44:52.073383 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:44:52.073383 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:44:52.073383 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:44:52.073383 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:44:52.073383 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:44:52.073383 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:44:52.073383 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:44:52.073383 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:44:52.073383 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:44:52.078317 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2184ae8f-022d-4de9-8d0f-0c2d546c9d6f could not be found. Oct 17 13:44:52.078317 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:44:52.078317 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:44:52.078317 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:44:52.078317 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:44:52.078317 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:44:52.078317 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:44:52.078317 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:44:52.078317 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:44:52.078317 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2184ae8f-022d-4de9-8d0f-0c2d546c9d6f could not be found. Oct 17 13:44:52.078317 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:44:52.079394 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b6bdf57f-dbc8-4485-827e-f4e3b0f8f40a tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Returning 404 to user: Instance 2184ae8f-022d-4de9-8d0f-0c2d546c9d6f could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:44:52.080400 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b6bdf57f-dbc8-4485-827e-f4e3b0f8f40a tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] 10.222.0.79 "DELETE /compute/v2.1/servers/2184ae8f-022d-4de9-8d0f-0c2d546c9d6f" status: 404 len: 111 microversion: 2.1 time: 0.078714 Oct 17 13:44:52.081430 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1330/2639] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:44:52 2022] DELETE /compute/v2.1/servers/2184ae8f-022d-4de9-8d0f-0c2d546c9d6f => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:44:52.089082 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fea3484d-a2a1-461f-a9e7-bd6c5b23d606 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:52.091708 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-fea3484d-a2a1-461f-a9e7-bd6c5b23d606 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] [instance: 2184ae8f-022d-4de9-8d0f-0c2d546c9d6f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:52.109874 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fea3484d-a2a1-461f-a9e7-bd6c5b23d606 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:52.110553 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fea3484d-a2a1-461f-a9e7-bd6c5b23d606 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:52.111103 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fea3484d-a2a1-461f-a9e7-bd6c5b23d606 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:52.111962 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fea3484d-a2a1-461f-a9e7-bd6c5b23d606 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:52.112530 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fea3484d-a2a1-461f-a9e7-bd6c5b23d606 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:52.113060 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fea3484d-a2a1-461f-a9e7-bd6c5b23d606 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:52.131778 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-fea3484d-a2a1-461f-a9e7-bd6c5b23d606 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] HTTP exception thrown: Instance 2184ae8f-022d-4de9-8d0f-0c2d546c9d6f could not be found. Oct 17 13:44:52.133775 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fea3484d-a2a1-461f-a9e7-bd6c5b23d606 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Request method failure captured: Oct 17 13:44:52.133775 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/2184ae8f-022d-4de9-8d0f-0c2d546c9d6f HTTP/1.1 Oct 17 13:44:52.133775 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:44:52.133775 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:44:52.133775 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:44:52.133775 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:44:52.133775 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:44:52.133775 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:44:52.133775 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:44:52.133775 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:44:52.133775 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVue64m5R6rw6hm4n0GPQELiiIZiHcHY_OayUzz-BJS3xlzYFUnBRAs8GlOKgSdZftnfHTgck3Rq8-pCdjaziS1rz_ScuIwW2mZbBMPorBOz8ZemES7b8EhxnpIOw7VzFdlTEwNdJ-TTZHLLOAXDoFmWvrs7ZVy2Zo-5hLyq2Dtd7Xk Oct 17 13:44:52.133775 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:44:52.133775 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:44:52.133775 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:44:52.133775 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:44:52.133775 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:44:52.133775 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:44:52.133775 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 5bb50742d06f403598634414befbeb12 Oct 17 13:44:52.133775 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1251956669 Oct 17 13:44:52.133775 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:44:52.133775 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:44:52.133775 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5bb50742d06f403598634414befbeb12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5bb50742d06f403598634414befbeb12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5bb50742d06f403598634414befbeb12"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5bb50742d06f403598634414befbeb12", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:44:52.133775 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1251956669 Oct 17 13:44:52.133775 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 5bb50742d06f403598634414befbeb12 Oct 17 13:44:52.133775 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1251956669 Oct 17 13:44:52.133775 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-AttachSCSIVolumeTestJSON-1251956669-project Oct 17 13:44:52.133775 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:44:52.133775 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:44:52.133775 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 799d72ccad514fd899d21809d613249b Oct 17 13:44:52.133775 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1251956669-project Oct 17 13:44:52.133775 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:44:52.133775 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 2184ae8f-022d-4de9-8d0f-0c2d546c9d6f could not be found. Oct 17 13:44:52.133775 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '2184ae8f-022d-4de9-8d0f-0c2d546c9d6f'} Oct 17 13:44:52.133775 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:44:52.133775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:44:52.133775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:44:52.133775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:44:52.133775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:44:52.133775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:44:52.133775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:44:52.133775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:44:52.133775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:44:52.133775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:44:52.133775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2184ae8f-022d-4de9-8d0f-0c2d546c9d6f could not be found. Oct 17 13:44:52.133775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:44:52.133775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:44:52.133775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:44:52.133775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:44:52.133775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:44:52.133775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:44:52.133775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:44:52.133775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:44:52.133775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:44:52.133775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:44:52.133775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:44:52.133775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:44:52.133775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:44:52.133775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:44:52.133775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:44:52.133775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:44:52.133775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2184ae8f-022d-4de9-8d0f-0c2d546c9d6f could not be found. Oct 17 13:44:52.133775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:44:52.133775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:44:52.133775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:44:52.138646 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:44:52.138646 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:44:52.138646 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:44:52.138646 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:44:52.138646 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:44:52.138646 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2184ae8f-022d-4de9-8d0f-0c2d546c9d6f could not be found. Oct 17 13:44:52.138646 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:44:52.141273 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fea3484d-a2a1-461f-a9e7-bd6c5b23d606 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] Returning 404 to user: Instance 2184ae8f-022d-4de9-8d0f-0c2d546c9d6f could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:44:52.143481 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fea3484d-a2a1-461f-a9e7-bd6c5b23d606 tempest-AttachSCSIVolumeTestJSON-1251956669 tempest-AttachSCSIVolumeTestJSON-1251956669-project] 10.222.0.79 "GET /compute/v2.1/servers/2184ae8f-022d-4de9-8d0f-0c2d546c9d6f" status: 404 len: 111 microversion: 2.1 time: 0.058135 Oct 17 13:44:52.144261 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1331/2640] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:52 2022] GET /compute/v2.1/servers/2184ae8f-022d-4de9-8d0f-0c2d546c9d6f => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:44:52.150327 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8aa6838f-ee95-4dc6-883d-8c7dda905257 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:52.151466 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8aa6838f-ee95-4dc6-883d-8c7dda905257 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] [instance: f59dba6a-0058-4aeb-a3b0-3e0209d928c4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:52.174820 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8aa6838f-ee95-4dc6-883d-8c7dda905257 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:52.177333 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8aa6838f-ee95-4dc6-883d-8c7dda905257 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:52.182409 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8aa6838f-ee95-4dc6-883d-8c7dda905257 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:52.186843 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8aa6838f-ee95-4dc6-883d-8c7dda905257 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:52.188978 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8aa6838f-ee95-4dc6-883d-8c7dda905257 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:52.191049 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8aa6838f-ee95-4dc6-883d-8c7dda905257 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:52.269523 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4265f1a4-fbbf-4ca0-9fd5-5fb2645e7c46 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] 10.222.0.79 "DELETE /compute/v2.1/servers/25f78ad7-b6b1-4c56-bb29-4a1e6fd7fb85" status: 204 len: 0 microversion: 2.1 time: 0.365863 Oct 17 13:44:52.271314 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1310/2641] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:44:51 2022] DELETE /compute/v2.1/servers/25f78ad7-b6b1-4c56-bb29-4a1e6fd7fb85 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 13:44:52.352617 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8f58fc5a-5c3b-4636-9383-e509d9687a9c tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-571868224", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "478c562d-61a8-4d9e-9df9-a1fa229b4006"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:44:52.442763 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-8f58fc5a-5c3b-4636-9383-e509d9687a9c tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] validate_networks() for [('478c562d-61a8-4d9e-9df9-a1fa229b4006', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:44:52.979798 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8aa6838f-ee95-4dc6-883d-8c7dda905257 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc181092e9cb42e6a751e9bec506d7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a3aa5210b549fc95cd534135624ab5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:52.993836 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8aa6838f-ee95-4dc6-883d-8c7dda905257 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] 10.222.0.79 "GET /compute/v2.1/servers/f59dba6a-0058-4aeb-a3b0-3e0209d928c4" status: 200 len: 1522 microversion: 2.1 time: 0.848263 Oct 17 13:44:52.995969 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1332/2642] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:52 2022] GET /compute/v2.1/servers/f59dba6a-0058-4aeb-a3b0-3e0209d928c4 => generated 1522 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:53.003244 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-dbad80f0-fe51-40e1-a8a2-0701c235346c tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:53.010101 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-dbad80f0-fe51-40e1-a8a2-0701c235346c tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: e555208e-39b0-4361-94a5-6b272c336be4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:53.023270 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dbad80f0-fe51-40e1-a8a2-0701c235346c tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:53.024886 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dbad80f0-fe51-40e1-a8a2-0701c235346c tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:53.025329 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dbad80f0-fe51-40e1-a8a2-0701c235346c tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:53.026063 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dbad80f0-fe51-40e1-a8a2-0701c235346c tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:53.026505 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dbad80f0-fe51-40e1-a8a2-0701c235346c tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:53.026924 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dbad80f0-fe51-40e1-a8a2-0701c235346c tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:53.073731 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-dbad80f0-fe51-40e1-a8a2-0701c235346c tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] HTTP exception thrown: Instance e555208e-39b0-4361-94a5-6b272c336be4 could not be found. Oct 17 13:44:53.075352 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-dbad80f0-fe51-40e1-a8a2-0701c235346c tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Request method failure captured: Oct 17 13:44:53.075352 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4 HTTP/1.1 Oct 17 13:44:53.075352 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:44:53.075352 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:44:53.075352 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:44:53.075352 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:44:53.075352 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:44:53.075352 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:44:53.075352 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:44:53.075352 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:44:53.075352 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVwC0e9CoATqGmYn4xGcT3FE8Oj9evjm1YFH2xWIDqz-SmDOiryAwzQTOs-GPJHVs4PIRhkBOEiVtiX5aSbffWwTV5LQD70QSurqjrRnAEAFbBczXuvyc9v448rv1Gp8IaOUfReXe6mhgboO9wnGT7El2Mktg9R2axOqjRB5s1DD5Jw Oct 17 13:44:53.075352 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:44:53.075352 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:44:53.075352 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:44:53.075352 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:44:53.075352 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:44:53.075352 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:44:53.075352 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 676987e95424497c94984347dd6a7988 Oct 17 13:44:53.075352 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServersTestMultiNic-156823294 Oct 17 13:44:53.075352 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:44:53.075352 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:44:53.075352 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/676987e95424497c94984347dd6a7988"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/676987e95424497c94984347dd6a7988"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/676987e95424497c94984347dd6a7988"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_676987e95424497c94984347dd6a7988", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:44:53.075352 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServersTestMultiNic-156823294 Oct 17 13:44:53.075352 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 676987e95424497c94984347dd6a7988 Oct 17 13:44:53.075352 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServersTestMultiNic-156823294 Oct 17 13:44:53.075352 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServersTestMultiNic-156823294-project Oct 17 13:44:53.075352 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:44:53.075352 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:44:53.075352 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 467250951f654e33b3e233868301bbf0 Oct 17 13:44:53.075352 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServersTestMultiNic-156823294-project Oct 17 13:44:53.075352 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:44:53.075352 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance e555208e-39b0-4361-94a5-6b272c336be4 could not be found. Oct 17 13:44:53.075352 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'e555208e-39b0-4361-94a5-6b272c336be4'} Oct 17 13:44:53.075352 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:44:53.075352 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:44:53.075352 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:44:53.075352 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:44:53.075352 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:44:53.075352 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:44:53.075352 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:44:53.075352 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:44:53.075352 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:44:53.075352 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:44:53.075352 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e555208e-39b0-4361-94a5-6b272c336be4 could not be found. Oct 17 13:44:53.075352 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:44:53.075352 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:44:53.075352 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:44:53.075352 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:44:53.075352 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:44:53.075352 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:44:53.075352 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:44:53.075352 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:44:53.075352 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:44:53.075352 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:44:53.075352 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:44:53.075352 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:44:53.075352 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:44:53.075352 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:44:53.075352 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:44:53.075352 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:44:53.075352 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e555208e-39b0-4361-94a5-6b272c336be4 could not be found. Oct 17 13:44:53.075352 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:44:53.075352 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:44:53.075352 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:44:53.080037 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:44:53.080037 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:44:53.080037 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:44:53.080037 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:44:53.080037 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:44:53.080037 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e555208e-39b0-4361-94a5-6b272c336be4 could not be found. Oct 17 13:44:53.080037 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:44:53.081181 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-dbad80f0-fe51-40e1-a8a2-0701c235346c tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Returning 404 to user: Instance e555208e-39b0-4361-94a5-6b272c336be4 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:44:53.082172 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-dbad80f0-fe51-40e1-a8a2-0701c235346c tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4" status: 404 len: 111 microversion: 2.1 time: 0.083880 Oct 17 13:44:53.085400 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1333/2643] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:52 2022] GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:44:53.115088 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-eb666349-f63d-400d-b086-d8b3e9313616 req-5c013361-9a6b-4980-af8b-d6b3ffc29c7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e555208e-39b0-4361-94a5-6b272c336be4", "name": "network-vif-deleted", "tag": "7b45bf47-c253-4e30-bf75-b6963b23bf0e"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:44:53.136246 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-eb666349-f63d-400d-b086-d8b3e9313616 req-5c013361-9a6b-4980-af8b-d6b3ffc29c7c service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:53.139642 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-eb666349-f63d-400d-b086-d8b3e9313616 req-5c013361-9a6b-4980-af8b-d6b3ffc29c7c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:53.140279 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-eb666349-f63d-400d-b086-d8b3e9313616 req-5c013361-9a6b-4980-af8b-d6b3ffc29c7c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:53.169385 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-eb666349-f63d-400d-b086-d8b3e9313616 req-5c013361-9a6b-4980-af8b-d6b3ffc29c7c service nova] Creating event network-vif-deleted:7b45bf47-c253-4e30-bf75-b6963b23bf0e for instance e555208e-39b0-4361-94a5-6b272c336be4 on n-h2-854247-14 Oct 17 13:44:53.184686 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-eb666349-f63d-400d-b086-d8b3e9313616 req-5c013361-9a6b-4980-af8b-d6b3ffc29c7c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096333 Oct 17 13:44:53.187626 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1334/2644] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:44:53.197169 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b38765fd-396f-4c2c-885d-aa3c3f20a31f tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '.version_select at 0x7f7cd5474670>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:53.304098 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b38765fd-396f-4c2c-885d-aa3c3f20a31f tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "GET /compute/v2.1/images/545ba6e2-5330-47da-8d7e-390d40909596" status: 200 len: 1426 microversion: 2.1 time: 0.112011 Oct 17 13:44:53.313357 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1335/2645] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:44:53 2022] GET /compute/v2.1/images/545ba6e2-5330-47da-8d7e-390d40909596 => generated 1426 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:53.326091 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c21b5cbc-6df8-42b8-a7e4-6ce4b44c5a2e tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:53.328589 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c21b5cbc-6df8-42b8-a7e4-6ce4b44c5a2e tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] [instance: f59dba6a-0058-4aeb-a3b0-3e0209d928c4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:53.341055 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c21b5cbc-6df8-42b8-a7e4-6ce4b44c5a2e tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:53.341613 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c21b5cbc-6df8-42b8-a7e4-6ce4b44c5a2e tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:53.342251 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c21b5cbc-6df8-42b8-a7e4-6ce4b44c5a2e tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:53.342976 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c21b5cbc-6df8-42b8-a7e4-6ce4b44c5a2e tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:53.343502 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c21b5cbc-6df8-42b8-a7e4-6ce4b44c5a2e tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:53.343972 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c21b5cbc-6df8-42b8-a7e4-6ce4b44c5a2e tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:53.378190 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-c21b5cbc-6df8-42b8-a7e4-6ce4b44c5a2e tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] HTTP exception thrown: Instance is not a member of specified network Oct 17 13:44:53.409909 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c21b5cbc-6df8-42b8-a7e4-6ce4b44c5a2e tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Request method failure captured: Oct 17 13:44:53.409909 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/f59dba6a-0058-4aeb-a3b0-3e0209d928c4/ips/invalid HTTP/1.1 Oct 17 13:44:53.409909 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:44:53.409909 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:44:53.409909 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:44:53.409909 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:44:53.409909 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:44:53.409909 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:44:53.409909 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:44:53.409909 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:44:53.409909 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVw3iQ6LJ-oU2tFwyJ5gsQeR3rjFTA_2XQb06KSB7HIS9wQkcUxeKcJP5eITwbNVvU9XbOa9TeL1yq85nhyiWvr98OnHcKnLZFDxBWcbgD2auKe4P84Uf4d9YQAPogX8gIDZNBrZNJmkJZwfgJRXoAEEwoAvarWNpSPiIpSAhcvVnY8 Oct 17 13:44:53.409909 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:44:53.409909 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:44:53.409909 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:44:53.409909 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:44:53.409909 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:44:53.409909 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:44:53.409909 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 46a3aa5210b549fc95cd534135624ab5 Oct 17 13:44:53.409909 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1429847772 Oct 17 13:44:53.409909 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:44:53.409909 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:44:53.409909 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/46a3aa5210b549fc95cd534135624ab5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/46a3aa5210b549fc95cd534135624ab5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/46a3aa5210b549fc95cd534135624ab5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_46a3aa5210b549fc95cd534135624ab5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:44:53.409909 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1429847772 Oct 17 13:44:53.409909 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 46a3aa5210b549fc95cd534135624ab5 Oct 17 13:44:53.409909 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1429847772 Oct 17 13:44:53.409909 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServerAddressesNegativeTestJSON-1429847772-project Oct 17 13:44:53.409909 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:44:53.409909 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:44:53.409909 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: fc181092e9cb42e6a751e9bec506d7f5 Oct 17 13:44:53.409909 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1429847772-project Oct 17 13:44:53.409909 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:44:53.409909 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance is not a member of specified network Oct 17 13:44:53.409909 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'server_id': 'f59dba6a-0058-4aeb-a3b0-3e0209d928c4', 'id': 'invalid'} Oct 17 13:44:53.409909 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:44:53.409909 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:44:53.409909 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:44:53.409909 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:44:53.409909 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:44:53.409909 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:44:53.409909 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:44:53.409909 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:44:53.409909 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 17 13:44:53.409909 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 17 13:44:53.409909 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 17 13:44:53.409909 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:44:53.409909 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:44:53.409909 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:44:53.409909 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:44:53.409909 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:44:53.409909 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:44:53.409909 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:44:53.409909 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:44:53.409909 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 17 13:44:53.409909 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:44:53.417671 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c21b5cbc-6df8-42b8-a7e4-6ce4b44c5a2e tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Returning 404 to user: Instance is not a member of specified network {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:44:53.422815 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c21b5cbc-6df8-42b8-a7e4-6ce4b44c5a2e tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] 10.222.0.79 "GET /compute/v2.1/servers/f59dba6a-0058-4aeb-a3b0-3e0209d928c4/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.106125 Oct 17 13:44:53.423790 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1336/2646] 10.222.0.79 () {58 vars in 1272 bytes} [Mon Oct 17 13:44:53 2022] GET /compute/v2.1/servers/f59dba6a-0058-4aeb-a3b0-3e0209d928c4/ips/invalid => generated 91 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:44:53.444208 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ca4166b5-31bb-45f2-aac9-657cbea5838f tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:53.450981 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ca4166b5-31bb-45f2-aac9-657cbea5838f tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] [instance: c8ec85bf-e448-4a4b-998d-a6bedb89d5e8] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:53.465925 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ca4166b5-31bb-45f2-aac9-657cbea5838f tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:53.481658 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ca4166b5-31bb-45f2-aac9-657cbea5838f tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:53.482621 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ca4166b5-31bb-45f2-aac9-657cbea5838f tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:53.484378 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ca4166b5-31bb-45f2-aac9-657cbea5838f tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:53.486064 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ca4166b5-31bb-45f2-aac9-657cbea5838f tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:53.486763 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ca4166b5-31bb-45f2-aac9-657cbea5838f tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:54.142805 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ca4166b5-31bb-45f2-aac9-657cbea5838f tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb93a068a854ec9a2c082b380e22466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '341aac3733474b58a6ce8724c8bba334', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:54.151648 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ca4166b5-31bb-45f2-aac9-657cbea5838f tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] 10.222.0.79 "GET /compute/v2.1/servers/c8ec85bf-e448-4a4b-998d-a6bedb89d5e8" status: 200 len: 1350 microversion: 2.1 time: 0.720408 Oct 17 13:44:54.156929 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1337/2647] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:53 2022] GET /compute/v2.1/servers/c8ec85bf-e448-4a4b-998d-a6bedb89d5e8 => generated 1350 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:54.166065 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2bc51e27-2246-4448-bd20-61622c3a93f5 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:54.171068 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2bc51e27-2246-4448-bd20-61622c3a93f5 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Failed to fetch instance by id 999 {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 17 13:44:54.171747 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-2bc51e27-2246-4448-bd20-61622c3a93f5 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] HTTP exception thrown: Instance 999 could not be found. Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2bc51e27-2246-4448-bd20-61622c3a93f5 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Request method failure captured: Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVw3iQ6LJ-oU2tFwyJ5gsQeR3rjFTA_2XQb06KSB7HIS9wQkcUxeKcJP5eITwbNVvU9XbOa9TeL1yq85nhyiWvr98OnHcKnLZFDxBWcbgD2auKe4P84Uf4d9YQAPogX8gIDZNBrZNJmkJZwfgJRXoAEEwoAvarWNpSPiIpSAhcvVnY8 Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 46a3aa5210b549fc95cd534135624ab5 Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1429847772 Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/46a3aa5210b549fc95cd534135624ab5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/46a3aa5210b549fc95cd534135624ab5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/46a3aa5210b549fc95cd534135624ab5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_46a3aa5210b549fc95cd534135624ab5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1429847772 Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 46a3aa5210b549fc95cd534135624ab5 Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1429847772 Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServerAddressesNegativeTestJSON-1429847772-project Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: fc181092e9cb42e6a751e9bec506d7f5 Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1429847772-project Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 999 could not be found. Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'server_id': '999'} Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 17 13:44:54.173762 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:44:54.178383 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2bc51e27-2246-4448-bd20-61622c3a93f5 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Returning 404 to user: Instance 999 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:44:54.178383 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2bc51e27-2246-4448-bd20-61622c3a93f5 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] 10.222.0.79 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.016671 Oct 17 13:44:54.182134 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1338/2648] 10.222.0.79 () {58 vars in 1149 bytes} [Mon Oct 17 13:44:54 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:44:54.195013 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-20c7b3cd-43a1-4efe-8285-915a0242d2a5 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1500640109", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "c2ceedb0-c787-4038-b824-4f08254fdfbf", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "72be642c-f241-4ddb-80d7-b14a93aa7fc9"}]}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:44:54.430540 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-8f58fc5a-5c3b-4636-9383-e509d9687a9c tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:44:54.431915 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-8f58fc5a-5c3b-4636-9383-e509d9687a9c tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:44:54.432560 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-8f58fc5a-5c3b-4636-9383-e509d9687a9c tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:44:54.433176 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-8f58fc5a-5c3b-4636-9383-e509d9687a9c tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:44:54.433859 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-8f58fc5a-5c3b-4636-9383-e509d9687a9c tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:44:54.459954 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8f58fc5a-5c3b-4636-9383-e509d9687a9c tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:54.461572 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8f58fc5a-5c3b-4636-9383-e509d9687a9c tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:54.463088 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8f58fc5a-5c3b-4636-9383-e509d9687a9c tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:54.468910 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8f58fc5a-5c3b-4636-9383-e509d9687a9c tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:54.469675 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8f58fc5a-5c3b-4636-9383-e509d9687a9c tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:54.470268 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8f58fc5a-5c3b-4636-9383-e509d9687a9c tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:54.526945 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-8f58fc5a-5c3b-4636-9383-e509d9687a9c tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Getting quotas for project b3126767b1c348859c2640dc21e38f6a. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:44:54.544181 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-8f58fc5a-5c3b-4636-9383-e509d9687a9c tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Getting quotas for user 75205205ba2946fbb18918201f54e15c and project b3126767b1c348859c2640dc21e38f6a. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:44:54.587986 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8f58fc5a-5c3b-4636-9383-e509d9687a9c tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Going to run 2 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:44:54.593963 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8f58fc5a-5c3b-4636-9383-e509d9687a9c tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] [instance: d58e9993-1b03-44b7-b27a-5ed4e7ee8232] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:44:54.693571 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8f58fc5a-5c3b-4636-9383-e509d9687a9c tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] [instance: 19575b3d-cba9-4060-9579-9133975767de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=d58e9993-1b03-44b7-b27a-5ed4e7ee8232,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:44:54.840292 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8f58fc5a-5c3b-4636-9383-e509d9687a9c tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.492618 Oct 17 13:44:54.840930 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1311/2649] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:44:52 2022] POST /compute/v2.1/servers => generated 32 bytes in 2494 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Oct 17 13:44:54.856568 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-06dceb03-52b8-4458-9af3-b220ad21f82c tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:54.857154 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-06dceb03-52b8-4458-9af3-b220ad21f82c tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] [instance: f59dba6a-0058-4aeb-a3b0-3e0209d928c4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:54.870884 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-06dceb03-52b8-4458-9af3-b220ad21f82c tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:54.871406 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-06dceb03-52b8-4458-9af3-b220ad21f82c tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:54.874544 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-06dceb03-52b8-4458-9af3-b220ad21f82c tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:54.875601 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-06dceb03-52b8-4458-9af3-b220ad21f82c tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:54.876069 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-06dceb03-52b8-4458-9af3-b220ad21f82c tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:54.879790 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-06dceb03-52b8-4458-9af3-b220ad21f82c tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:54.975366 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-06dceb03-52b8-4458-9af3-b220ad21f82c tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] [instance: f59dba6a-0058-4aeb-a3b0-3e0209d928c4] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:44:54.976214 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-20c7b3cd-43a1-4efe-8285-915a0242d2a5 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] HTTP exception thrown: Block Device c2ceedb0-c787-4038-b824-4f08254fdfbf is not bootable. Oct 17 13:44:54.990054 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-20c7b3cd-43a1-4efe-8285-915a0242d2a5 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Request method failure captured: Oct 17 13:44:54.990054 n-d-854247-14 devstack@n-api.service[127016]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:44:54.990054 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:44:54.990054 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:44:54.990054 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:44:54.990054 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 358 Oct 17 13:44:54.990054 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:44:54.990054 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:44:54.990054 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:44:54.990054 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:44:54.990054 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVwEqzYAZh4AkEjRryOAZIhaHrAKxd2Qcal9md8a5n-MMUYSdXmcWYLDVkyQoPrDIbcsApBq2EewemPkBwvNDDOidb0hhc_Z3w9BeEUj5ET_flLYPqO5hgqCsuZGXFiYIEBJxrkx614fXiELZHaNkvhSdsJHShK0w7L-UPHhkPKqi5M Oct 17 13:44:54.990054 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:44:54.990054 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:44:54.990054 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:44:54.990054 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:44:54.990054 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:44:54.990054 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:44:54.990054 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:44:54.990054 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:44:54.990054 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:44:54.990054 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:44:54.990054 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_59e65f6eb06d40d583b9f43c9af94c13", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:44:54.990054 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:44:54.990054 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:44:54.990054 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:44:54.990054 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:44:54.990054 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:44:54.990054 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:44:54.990054 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 443c44b0bd9e4c56a7fe0c1a53238545 Oct 17 13:44:54.990054 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:44:54.990054 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:44:54.990054 n-d-854247-14 devstack@n-api.service[127016]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1500640109", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "c2ceedb0-c787-4038-b824-4f08254fdfbf", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "72be642c-f241-4ddb-80d7-b14a93aa7fc9"}]}} Oct 17 13:44:54.990054 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:44:54.990054 n-d-854247-14 devstack@n-api.service[127016]: exception: Block Device c2ceedb0-c787-4038-b824-4f08254fdfbf is not bootable. Oct 17 13:44:54.990054 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1500640109', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'c2ceedb0-c787-4038-b824-4f08254fdfbf'}], 'networks': [{'uuid': '72be642c-f241-4ddb-80d7-b14a93aa7fc9'}]}}} Oct 17 13:44:54.990054 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:44:54.990054 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:44:54.990054 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 17 13:44:54.990054 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 17 13:44:54.990054 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 17 13:44:54.990054 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 17 13:44:54.990054 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 17 13:44:54.990054 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 17 13:44:54.990054 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 17 13:44:54.990054 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 17 13:44:54.990054 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device c2ceedb0-c787-4038-b824-4f08254fdfbf is not bootable. Oct 17 13:44:54.990054 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:44:54.990054 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:44:54.990054 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:44:54.990054 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:44:54.990054 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:44:54.990054 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:44:54.990054 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:44:54.990054 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:44:54.990054 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:44:54.990054 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:44:54.990054 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:44:54.990054 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:44:54.990054 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:44:54.994541 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:44:54.994541 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:44:54.994541 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:44:54.994541 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 17 13:44:54.994541 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 17 13:44:54.994541 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 17 13:44:54.994541 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device c2ceedb0-c787-4038-b824-4f08254fdfbf is not bootable. Oct 17 13:44:54.994541 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:44:54.994541 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:44:54.994541 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:44:54.994541 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:44:54.994541 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:44:54.994541 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:44:54.994541 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:44:54.994541 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:44:54.994541 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device c2ceedb0-c787-4038-b824-4f08254fdfbf is not bootable. Oct 17 13:44:54.994541 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:44:54.994541 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-20c7b3cd-43a1-4efe-8285-915a0242d2a5 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Returning 400 to user: Block Device c2ceedb0-c787-4038-b824-4f08254fdfbf is not bootable. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:44:54.996119 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-20c7b3cd-43a1-4efe-8285-915a0242d2a5 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.810938 Oct 17 13:44:55.001695 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1339/2650] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:44:54 2022] POST /compute/v2.1/servers => generated 110 bytes in 819 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:44:55.014279 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-99737623-cf0c-4916-bdf5-5259c0d7a311 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:55.014463 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-99737623-cf0c-4916-bdf5-5259c0d7a311 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 709d926d-fba5-49ea-84ac-95d8bb018c68] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:55.023440 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-99737623-cf0c-4916-bdf5-5259c0d7a311 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:55.024183 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-99737623-cf0c-4916-bdf5-5259c0d7a311 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:55.024749 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-99737623-cf0c-4916-bdf5-5259c0d7a311 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:55.025881 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-99737623-cf0c-4916-bdf5-5259c0d7a311 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:55.026609 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-99737623-cf0c-4916-bdf5-5259c0d7a311 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:55.027400 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-99737623-cf0c-4916-bdf5-5259c0d7a311 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:55.129474 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-99737623-cf0c-4916-bdf5-5259c0d7a311 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 709d926d-fba5-49ea-84ac-95d8bb018c68] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:44:55.205829 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-06dceb03-52b8-4458-9af3-b220ad21f82c tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] 10.222.0.79 "DELETE /compute/v2.1/servers/f59dba6a-0058-4aeb-a3b0-3e0209d928c4" status: 204 len: 0 microversion: 2.1 time: 0.360299 Oct 17 13:44:55.206760 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1312/2651] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:44:54 2022] DELETE /compute/v2.1/servers/f59dba6a-0058-4aeb-a3b0-3e0209d928c4 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:44:55.212443 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-dd069018-5bcb-4d8e-be43-e4d20832eefb tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '.version_select at 0x7f7cd5573f70>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:55.318056 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-dd069018-5bcb-4d8e-be43-e4d20832eefb tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "GET /compute/v2.1/images/545ba6e2-5330-47da-8d7e-390d40909596" status: 200 len: 1426 microversion: 2.1 time: 0.109943 Oct 17 13:44:55.327572 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1313/2652] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:44:55 2022] GET /compute/v2.1/images/545ba6e2-5330-47da-8d7e-390d40909596 => generated 1426 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:55.336168 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-51ff24e0-e33e-4509-b427-5e7c37d40f92 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:55.347223 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-51ff24e0-e33e-4509-b427-5e7c37d40f92 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '75205205ba2946fbb18918201f54e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3126767b1c348859c2640dc21e38f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:55.348275 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-51ff24e0-e33e-4509-b427-5e7c37d40f92 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Searching by: {'deleted': False, 'project_id': 'b3126767b1c348859c2640dc21e38f6a'} {{(pid=127017) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:44:55.414334 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-51ff24e0-e33e-4509-b427-5e7c37d40f92 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:55.415070 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-51ff24e0-e33e-4509-b427-5e7c37d40f92 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:55.415760 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-51ff24e0-e33e-4509-b427-5e7c37d40f92 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:55.416654 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-51ff24e0-e33e-4509-b427-5e7c37d40f92 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:55.417263 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-51ff24e0-e33e-4509-b427-5e7c37d40f92 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:55.418007 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-51ff24e0-e33e-4509-b427-5e7c37d40f92 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:55.423657 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-99737623-cf0c-4916-bdf5-5259c0d7a311 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "DELETE /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68" status: 204 len: 0 microversion: 2.25 time: 0.419774 Oct 17 13:44:55.425121 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1340/2653] 10.222.0.79 () {60 vars in 1280 bytes} [Mon Oct 17 13:44:55 2022] DELETE /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:44:55.432164 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e91758e5-b83f-4407-a41d-28a3971d4be8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:55.433119 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e91758e5-b83f-4407-a41d-28a3971d4be8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:55.450351 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e91758e5-b83f-4407-a41d-28a3971d4be8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:55.452997 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e91758e5-b83f-4407-a41d-28a3971d4be8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:55.453689 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e91758e5-b83f-4407-a41d-28a3971d4be8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:55.454670 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e91758e5-b83f-4407-a41d-28a3971d4be8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:55.461066 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e91758e5-b83f-4407-a41d-28a3971d4be8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:55.461830 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e91758e5-b83f-4407-a41d-28a3971d4be8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:55.485948 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.multi_cell_list [None req-51ff24e0-e33e-4509-b427-5e7c37d40f92 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=127017) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:44:55.492012 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:44:55.558150 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-51ff24e0-e33e-4509-b427-5e7c37d40f92 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] 10.222.0.79 "GET /compute/v2.1/servers" status: 200 len: 1333 microversion: 2.1 time: 0.229354 Oct 17 13:44:55.565243 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1314/2654] 10.222.0.79 () {58 vars in 1125 bytes} [Mon Oct 17 13:44:55 2022] GET /compute/v2.1/servers => generated 1333 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:55.624936 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7695e1e6-1a64-4725-b7d2-30e5fc82eead tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:55.631445 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7695e1e6-1a64-4725-b7d2-30e5fc82eead tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] [instance: c8ec85bf-e448-4a4b-998d-a6bedb89d5e8] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:55.661167 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7695e1e6-1a64-4725-b7d2-30e5fc82eead tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:55.661751 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7695e1e6-1a64-4725-b7d2-30e5fc82eead tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:55.662199 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7695e1e6-1a64-4725-b7d2-30e5fc82eead tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:55.664887 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7695e1e6-1a64-4725-b7d2-30e5fc82eead tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:55.666031 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7695e1e6-1a64-4725-b7d2-30e5fc82eead tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:55.668940 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7695e1e6-1a64-4725-b7d2-30e5fc82eead tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:56.632564 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e91758e5-b83f-4407-a41d-28a3971d4be8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:56.647673 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e91758e5-b83f-4407-a41d-28a3971d4be8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 1.216872 Oct 17 13:44:56.648670 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1341/2655] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:55 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:56.663867 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c38c6c58-5cbe-4f79-8a58-21d4564daa22 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:56.664493 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c38c6c58-5cbe-4f79-8a58-21d4564daa22 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] [instance: f59dba6a-0058-4aeb-a3b0-3e0209d928c4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:56.703989 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c38c6c58-5cbe-4f79-8a58-21d4564daa22 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:56.705001 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c38c6c58-5cbe-4f79-8a58-21d4564daa22 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:56.705659 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c38c6c58-5cbe-4f79-8a58-21d4564daa22 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:56.706580 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c38c6c58-5cbe-4f79-8a58-21d4564daa22 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:56.707253 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c38c6c58-5cbe-4f79-8a58-21d4564daa22 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:56.708112 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c38c6c58-5cbe-4f79-8a58-21d4564daa22 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:56.744493 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7695e1e6-1a64-4725-b7d2-30e5fc82eead tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb93a068a854ec9a2c082b380e22466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '341aac3733474b58a6ce8724c8bba334', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:56.758993 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7695e1e6-1a64-4725-b7d2-30e5fc82eead tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] 10.222.0.79 "GET /compute/v2.1/servers/c8ec85bf-e448-4a4b-998d-a6bedb89d5e8" status: 200 len: 1540 microversion: 2.1 time: 1.149523 Oct 17 13:44:56.760864 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1315/2656] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:55 2022] GET /compute/v2.1/servers/c8ec85bf-e448-4a4b-998d-a6bedb89d5e8 => generated 1540 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:56.780458 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e6bbd9fa-083a-44b1-9c1b-76d0c5110c5e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:56.782355 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e6bbd9fa-083a-44b1-9c1b-76d0c5110c5e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 709d926d-fba5-49ea-84ac-95d8bb018c68] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:56.791735 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=4,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:44:56.805241 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e6bbd9fa-083a-44b1-9c1b-76d0c5110c5e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:56.806521 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e6bbd9fa-083a-44b1-9c1b-76d0c5110c5e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:56.808518 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e6bbd9fa-083a-44b1-9c1b-76d0c5110c5e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:56.812472 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e6bbd9fa-083a-44b1-9c1b-76d0c5110c5e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:56.815850 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e6bbd9fa-083a-44b1-9c1b-76d0c5110c5e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:56.816521 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e6bbd9fa-083a-44b1-9c1b-76d0c5110c5e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:58.081531 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c38c6c58-5cbe-4f79-8a58-21d4564daa22 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc181092e9cb42e6a751e9bec506d7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a3aa5210b549fc95cd534135624ab5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:58.098660 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c38c6c58-5cbe-4f79-8a58-21d4564daa22 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] 10.222.0.79 "GET /compute/v2.1/servers/f59dba6a-0058-4aeb-a3b0-3e0209d928c4" status: 200 len: 1528 microversion: 2.1 time: 1.448212 Oct 17 13:44:58.099622 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1342/2657] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:56 2022] GET /compute/v2.1/servers/f59dba6a-0058-4aeb-a3b0-3e0209d928c4 => generated 1528 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:58.104740 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-613a4f74-c934-40ea-ac06-da03e60deceb tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:58.117370 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-613a4f74-c934-40ea-ac06-da03e60deceb tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] [instance: 19575b3d-cba9-4060-9579-9133975767de] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:58.146917 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-613a4f74-c934-40ea-ac06-da03e60deceb tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:58.150296 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-613a4f74-c934-40ea-ac06-da03e60deceb tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:58.150753 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-613a4f74-c934-40ea-ac06-da03e60deceb tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:58.154996 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-613a4f74-c934-40ea-ac06-da03e60deceb tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:58.157671 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-613a4f74-c934-40ea-ac06-da03e60deceb tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:58.158130 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-613a4f74-c934-40ea-ac06-da03e60deceb tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:58.418862 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-613a4f74-c934-40ea-ac06-da03e60deceb tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75205205ba2946fbb18918201f54e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3126767b1c348859c2640dc21e38f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:58.440045 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-613a4f74-c934-40ea-ac06-da03e60deceb tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] 10.222.0.79 "GET /compute/v2.1/servers/19575b3d-cba9-4060-9579-9133975767de" status: 200 len: 1213 microversion: 2.1 time: 0.328427 Oct 17 13:44:58.441086 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1343/2658] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:58 2022] GET /compute/v2.1/servers/19575b3d-cba9-4060-9579-9133975767de => generated 1213 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:58.446477 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e7c84075-2bc7-4687-904a-b280f84653ad tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '.version_select at 0x7f7cd4609160>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:58.482202 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e6bbd9fa-083a-44b1-9c1b-76d0c5110c5e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:58.507907 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e6bbd9fa-083a-44b1-9c1b-76d0c5110c5e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:58.510714 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e6bbd9fa-083a-44b1-9c1b-76d0c5110c5e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:58.512205 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e6bbd9fa-083a-44b1-9c1b-76d0c5110c5e tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68" status: 200 len: 1731 microversion: 2.25 time: 1.748878 Oct 17 13:44:58.514535 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1316/2659] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:56 2022] GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68 => generated 1731 bytes in 1753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:58.523894 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e7c84075-2bc7-4687-904a-b280f84653ad tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "GET /compute/v2.1/images/545ba6e2-5330-47da-8d7e-390d40909596" status: 200 len: 1426 microversion: 2.1 time: 0.081160 Oct 17 13:44:58.524831 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1344/2660] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:44:58 2022] GET /compute/v2.1/images/545ba6e2-5330-47da-8d7e-390d40909596 => generated 1426 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:58.534536 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-d2234eed-d6ba-47fa-80fa-039d88cd6837 req-62d98ed0-efd9-4422-a5a9-09caaae908d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "408d8179-50fa-4c27-a2e9-85dc1daaa5b3", "name": "network-vif-deleted", "tag": "40711594-b3d5-4f64-901c-bfdbaddb9e73"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:44:58.538694 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-41c90511-218a-4179-837d-ee5cd5580a78 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:58.547381 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-41c90511-218a-4179-837d-ee5cd5580a78 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:58.562364 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-41c90511-218a-4179-837d-ee5cd5580a78 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:58.565505 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-41c90511-218a-4179-837d-ee5cd5580a78 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:58.576078 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-d2234eed-d6ba-47fa-80fa-039d88cd6837 req-62d98ed0-efd9-4422-a5a9-09caaae908d0 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:58.577123 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-d2234eed-d6ba-47fa-80fa-039d88cd6837 req-62d98ed0-efd9-4422-a5a9-09caaae908d0 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:58.579458 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-d2234eed-d6ba-47fa-80fa-039d88cd6837 req-62d98ed0-efd9-4422-a5a9-09caaae908d0 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:58.579733 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-41c90511-218a-4179-837d-ee5cd5580a78 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:58.580754 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-41c90511-218a-4179-837d-ee5cd5580a78 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:58.582201 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-41c90511-218a-4179-837d-ee5cd5580a78 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:58.584034 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-41c90511-218a-4179-837d-ee5cd5580a78 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:58.613945 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-d2234eed-d6ba-47fa-80fa-039d88cd6837 req-62d98ed0-efd9-4422-a5a9-09caaae908d0 service nova] Creating event network-vif-deleted:40711594-b3d5-4f64-901c-bfdbaddb9e73 for instance 408d8179-50fa-4c27-a2e9-85dc1daaa5b3 on n-h1-854247-14 Oct 17 13:44:58.652516 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-d2234eed-d6ba-47fa-80fa-039d88cd6837 req-62d98ed0-efd9-4422-a5a9-09caaae908d0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136355 Oct 17 13:44:58.660881 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1317/2661] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:44:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:44:58.681522 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e15e0fef-a94b-4e98-99b6-690255ca35b5 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:58.684283 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e15e0fef-a94b-4e98-99b6-690255ca35b5 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] [instance: c8ec85bf-e448-4a4b-998d-a6bedb89d5e8] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:58.705844 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e15e0fef-a94b-4e98-99b6-690255ca35b5 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:58.707184 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e15e0fef-a94b-4e98-99b6-690255ca35b5 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:58.707184 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e15e0fef-a94b-4e98-99b6-690255ca35b5 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:58.707512 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e15e0fef-a94b-4e98-99b6-690255ca35b5 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:58.707963 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e15e0fef-a94b-4e98-99b6-690255ca35b5 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:58.708380 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e15e0fef-a94b-4e98-99b6-690255ca35b5 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:59.023106 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e15e0fef-a94b-4e98-99b6-690255ca35b5 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] 10.222.0.79 "GET /compute/v2.1/servers/c8ec85bf-e448-4a4b-998d-a6bedb89d5e8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.360426 Oct 17 13:44:59.023764 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1318/2662] 10.222.0.79 () {58 vars in 1275 bytes} [Mon Oct 17 13:44:58 2022] GET /compute/v2.1/servers/c8ec85bf-e448-4a4b-998d-a6bedb89d5e8/os-interface => generated 284 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:44:59.124925 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3368fba9-8aea-43c6-862c-faa517b019ba tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:59.126248 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3368fba9-8aea-43c6-862c-faa517b019ba tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] [instance: f59dba6a-0058-4aeb-a3b0-3e0209d928c4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:59.189174 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3368fba9-8aea-43c6-862c-faa517b019ba tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:59.189989 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3368fba9-8aea-43c6-862c-faa517b019ba tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:59.191003 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3368fba9-8aea-43c6-862c-faa517b019ba tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:59.194204 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3368fba9-8aea-43c6-862c-faa517b019ba tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:59.195410 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3368fba9-8aea-43c6-862c-faa517b019ba tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:59.198193 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3368fba9-8aea-43c6-862c-faa517b019ba tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:59.522824 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-41c90511-218a-4179-837d-ee5cd5580a78 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:59.538369 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-41c90511-218a-4179-837d-ee5cd5580a78 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 1.012199 Oct 17 13:44:59.539283 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1345/2663] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:58 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:59.567971 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-831b7b5a-df41-4b33-9c7e-86195718bcab tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:59.568597 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-831b7b5a-df41-4b33-9c7e-86195718bcab tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] [instance: 19575b3d-cba9-4060-9579-9133975767de] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:59.581143 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-831b7b5a-df41-4b33-9c7e-86195718bcab tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:59.595614 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-831b7b5a-df41-4b33-9c7e-86195718bcab tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:59.596445 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-831b7b5a-df41-4b33-9c7e-86195718bcab tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:59.597370 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-831b7b5a-df41-4b33-9c7e-86195718bcab tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:59.597982 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-831b7b5a-df41-4b33-9c7e-86195718bcab tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:59.598597 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-831b7b5a-df41-4b33-9c7e-86195718bcab tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:59.870129 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-831b7b5a-df41-4b33-9c7e-86195718bcab tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75205205ba2946fbb18918201f54e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3126767b1c348859c2640dc21e38f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:59.879106 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-831b7b5a-df41-4b33-9c7e-86195718bcab tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] 10.222.0.79 "GET /compute/v2.1/servers/19575b3d-cba9-4060-9579-9133975767de" status: 200 len: 1275 microversion: 2.1 time: 0.334707 Oct 17 13:44:59.891965 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1346/2664] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:59 2022] GET /compute/v2.1/servers/19575b3d-cba9-4060-9579-9133975767de => generated 1275 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:59.897246 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-59d8021a-fe9e-45bb-b50e-9bc074555faa tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '.version_select at 0x7f7cd45cf790>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:59.976990 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-59d8021a-fe9e-45bb-b50e-9bc074555faa tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "GET /compute/v2.1/images/545ba6e2-5330-47da-8d7e-390d40909596" status: 200 len: 1426 microversion: 2.1 time: 0.083447 Oct 17 13:44:59.979211 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1347/2665] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:44:59 2022] GET /compute/v2.1/images/545ba6e2-5330-47da-8d7e-390d40909596 => generated 1426 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:59.986920 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ea490392-6be2-43b4-98cc-721738e3a755 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:00.000158 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ea490392-6be2-43b4-98cc-721738e3a755 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 709d926d-fba5-49ea-84ac-95d8bb018c68] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:00.007266 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ea490392-6be2-43b4-98cc-721738e3a755 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:00.008191 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ea490392-6be2-43b4-98cc-721738e3a755 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:00.008856 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ea490392-6be2-43b4-98cc-721738e3a755 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:00.009809 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ea490392-6be2-43b4-98cc-721738e3a755 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:00.010482 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ea490392-6be2-43b4-98cc-721738e3a755 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:00.011110 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ea490392-6be2-43b4-98cc-721738e3a755 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:00.425362 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3368fba9-8aea-43c6-862c-faa517b019ba tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc181092e9cb42e6a751e9bec506d7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a3aa5210b549fc95cd534135624ab5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:00.446054 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3368fba9-8aea-43c6-862c-faa517b019ba tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] 10.222.0.79 "GET /compute/v2.1/servers/f59dba6a-0058-4aeb-a3b0-3e0209d928c4" status: 200 len: 1528 microversion: 2.1 time: 1.326595 Oct 17 13:45:00.446875 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1319/2666] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:59 2022] GET /compute/v2.1/servers/f59dba6a-0058-4aeb-a3b0-3e0209d928c4 => generated 1528 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:00.929100 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f101c543-70e3-43cc-bfd5-323a266ca69d tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:00.930320 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f101c543-70e3-43cc-bfd5-323a266ca69d tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] [instance: 19575b3d-cba9-4060-9579-9133975767de] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:00.946353 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f101c543-70e3-43cc-bfd5-323a266ca69d tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:00.949624 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f101c543-70e3-43cc-bfd5-323a266ca69d tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:00.950667 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f101c543-70e3-43cc-bfd5-323a266ca69d tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:00.953507 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f101c543-70e3-43cc-bfd5-323a266ca69d tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:00.954084 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f101c543-70e3-43cc-bfd5-323a266ca69d tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:00.959798 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f101c543-70e3-43cc-bfd5-323a266ca69d tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:01.699428 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ea490392-6be2-43b4-98cc-721738e3a755 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:01.713860 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ea490392-6be2-43b4-98cc-721738e3a755 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:01.715628 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ea490392-6be2-43b4-98cc-721738e3a755 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:01.716897 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f101c543-70e3-43cc-bfd5-323a266ca69d tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75205205ba2946fbb18918201f54e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3126767b1c348859c2640dc21e38f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:01.723619 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ea490392-6be2-43b4-98cc-721738e3a755 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68" status: 200 len: 1731 microversion: 2.25 time: 1.743053 Oct 17 13:45:01.724440 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1348/2667] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:59 2022] GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68 => generated 1731 bytes in 1744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:45:01.739922 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f101c543-70e3-43cc-bfd5-323a266ca69d tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] 10.222.0.79 "GET /compute/v2.1/servers/19575b3d-cba9-4060-9579-9133975767de" status: 200 len: 1275 microversion: 2.1 time: 0.816326 Oct 17 13:45:01.739922 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1320/2668] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:00 2022] GET /compute/v2.1/servers/19575b3d-cba9-4060-9579-9133975767de => generated 1275 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:01.739922 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a94e8681-a14c-4696-bb03-5ef5275d69a3 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '.version_select at 0x7f7cd4a58700>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:01.756595 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-e6c930be-51a4-4961-9ab1-6f9a1e2a69ff req-25f48178-2f93-477d-bcac-37934ac20d75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25f78ad7-b6b1-4c56-bb29-4a1e6fd7fb85", "name": "network-vif-deleted", "tag": "cd4c537b-c52e-4348-a550-70444ff951d7"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:01.821049 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-e6c930be-51a4-4961-9ab1-6f9a1e2a69ff req-25f48178-2f93-477d-bcac-37934ac20d75 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:01.838416 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-e6c930be-51a4-4961-9ab1-6f9a1e2a69ff req-25f48178-2f93-477d-bcac-37934ac20d75 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:01.856663 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a94e8681-a14c-4696-bb03-5ef5275d69a3 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "GET /compute/v2.1/images/545ba6e2-5330-47da-8d7e-390d40909596" status: 200 len: 1426 microversion: 2.1 time: 0.121883 Oct 17 13:45:01.858176 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1321/2669] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:45:01 2022] GET /compute/v2.1/images/545ba6e2-5330-47da-8d7e-390d40909596 => generated 1426 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:01.863496 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6539fa92-5f17-409c-aa4f-0dc7a66b55f5 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:01.864274 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6539fa92-5f17-409c-aa4f-0dc7a66b55f5 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] [instance: f59dba6a-0058-4aeb-a3b0-3e0209d928c4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:01.872378 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-e6c930be-51a4-4961-9ab1-6f9a1e2a69ff req-25f48178-2f93-477d-bcac-37934ac20d75 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:01.872927 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6539fa92-5f17-409c-aa4f-0dc7a66b55f5 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:01.873642 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6539fa92-5f17-409c-aa4f-0dc7a66b55f5 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:01.874244 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6539fa92-5f17-409c-aa4f-0dc7a66b55f5 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:01.875490 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6539fa92-5f17-409c-aa4f-0dc7a66b55f5 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:01.876113 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6539fa92-5f17-409c-aa4f-0dc7a66b55f5 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:01.876684 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6539fa92-5f17-409c-aa4f-0dc7a66b55f5 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:01.910037 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-e6c930be-51a4-4961-9ab1-6f9a1e2a69ff req-25f48178-2f93-477d-bcac-37934ac20d75 service nova] Creating event network-vif-deleted:cd4c537b-c52e-4348-a550-70444ff951d7 for instance 25f78ad7-b6b1-4c56-bb29-4a1e6fd7fb85 on n-h2-854247-14 Oct 17 13:45:01.937908 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-e6c930be-51a4-4961-9ab1-6f9a1e2a69ff req-25f48178-2f93-477d-bcac-37934ac20d75 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.196076 Oct 17 13:45:01.942522 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1349/2670] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:45:02.228909 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6539fa92-5f17-409c-aa4f-0dc7a66b55f5 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc181092e9cb42e6a751e9bec506d7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46a3aa5210b549fc95cd534135624ab5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:02.242016 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6539fa92-5f17-409c-aa4f-0dc7a66b55f5 tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] 10.222.0.79 "GET /compute/v2.1/servers/f59dba6a-0058-4aeb-a3b0-3e0209d928c4" status: 200 len: 1486 microversion: 2.1 time: 0.380439 Oct 17 13:45:02.242660 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1322/2671] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:01 2022] GET /compute/v2.1/servers/f59dba6a-0058-4aeb-a3b0-3e0209d928c4 => generated 1486 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:02.392919 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c5d6f47c-4b8e-472d-b787-486025254bc2 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-939088077", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "29566b82-3256-4863-9fc5-8ff16ee7e44a"}, {"uuid": "c240a909-2320-4368-8764-cf99d60e587b"}]}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:02.506883 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-c5d6f47c-4b8e-472d-b787-486025254bc2 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] validate_networks() for [('29566b82-3256-4863-9fc5-8ff16ee7e44a', None, None, None, None, None), ('c240a909-2320-4368-8764-cf99d60e587b', None, None, None, None, None)] {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:45:02.715722 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3d62df2b-9bda-411f-b6b0-0ea92c8912f9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1315434205", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "destination_type": "local"}, {"source_type": "volume", "uuid": "69cb6339-2bc4-4bb5-82a1-891e952c1791", "destination_type": "invalid"}], "networks": [{"uuid": "72be642c-f241-4ddb-80d7-b14a93aa7fc9"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:02.730398 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3d62df2b-9bda-411f-b6b0-0ea92c8912f9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Request method failure captured: Oct 17 13:45:02.730398 n-d-854247-14 devstack@n-api.service[127017]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:45:02.730398 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:45:02.730398 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:45:02.730398 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:45:02.730398 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 495 Oct 17 13:45:02.730398 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:45:02.730398 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:45:02.730398 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:45:02.730398 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:45:02.730398 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVwEqzYAZh4AkEjRryOAZIhaHrAKxd2Qcal9md8a5n-MMUYSdXmcWYLDVkyQoPrDIbcsApBq2EewemPkBwvNDDOidb0hhc_Z3w9BeEUj5ET_flLYPqO5hgqCsuZGXFiYIEBJxrkx614fXiELZHaNkvhSdsJHShK0w7L-UPHhkPKqi5M Oct 17 13:45:02.730398 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:45:02.730398 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:45:02.730398 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:45:02.730398 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:45:02.730398 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:45:02.730398 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:45:02.730398 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:45:02.730398 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:02.730398 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:45:02.730398 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:45:02.730398 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_59e65f6eb06d40d583b9f43c9af94c13", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:45:02.730398 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:02.730398 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:45:02.730398 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:02.730398 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:45:02.730398 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:45:02.730398 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:45:02.730398 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 443c44b0bd9e4c56a7fe0c1a53238545 Oct 17 13:45:02.730398 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:45:02.730398 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 13:45:02.730398 n-d-854247-14 devstack@n-api.service[127017]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1315434205", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "destination_type": "local"}, {"source_type": "volume", "uuid": "69cb6339-2bc4-4bb5-82a1-891e952c1791", "destination_type": "invalid"}], "networks": [{"uuid": "72be642c-f241-4ddb-80d7-b14a93aa7fc9"}]}} Oct 17 13:45:02.730398 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:45:02.730398 n-d-854247-14 devstack@n-api.service[127017]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 17 13:45:02.730398 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1315434205', 'imageRef': '0743b21b-a6ff-4d02-897c-eabb68c3ba07', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '0743b21b-a6ff-4d02-897c-eabb68c3ba07', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '69cb6339-2bc4-4bb5-82a1-891e952c1791', 'destination_type': 'invalid'}], 'networks': [{'uuid': '72be642c-f241-4ddb-80d7-b14a93aa7fc9'}]}}} Oct 17 13:45:02.730398 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:45:02.730398 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:02.730398 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:45:02.730398 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:45:02.730398 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:45:02.730398 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:45:02.730398 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 17 13:45:02.730398 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:02.730398 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 17 13:45:02.730398 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 17 13:45:02.730398 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:02.730398 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 17 13:45:02.730398 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi 'invalid' Oct 17 13:45:02.730398 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:02.730398 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:02.730398 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:02.730398 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:02.730398 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:02.730398 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:02.730398 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:45:02.730398 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:45:02.730398 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:45:02.735152 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:45:02.735152 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:45:02.735152 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:45:02.735152 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:45:02.735152 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:45:02.735152 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:45:02.735152 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:45:02.735152 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:45:02.735152 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:45:02.735152 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 17 13:45:02.735152 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:02.735152 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:02.735152 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:02.735152 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:02.735152 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:02.735152 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:02.735152 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:45:02.735152 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:45:02.735152 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 17 13:45:02.735152 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:02.744124 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3d62df2b-9bda-411f-b6b0-0ea92c8912f9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:45:02.747821 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3d62df2b-9bda-411f-b6b0-0ea92c8912f9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.036357 Oct 17 13:45:02.750886 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1323/2672] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:45:02 2022] POST /compute/v2.1/servers => generated 155 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 17 13:45:02.778481 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9c1660f1-7315-410d-a666-729ee794933f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:02.781129 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9c1660f1-7315-410d-a666-729ee794933f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 709d926d-fba5-49ea-84ac-95d8bb018c68] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:02.797792 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9c1660f1-7315-410d-a666-729ee794933f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:02.799404 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9c1660f1-7315-410d-a666-729ee794933f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:02.801955 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9c1660f1-7315-410d-a666-729ee794933f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:02.802974 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9c1660f1-7315-410d-a666-729ee794933f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:02.803684 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9c1660f1-7315-410d-a666-729ee794933f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:02.806094 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9c1660f1-7315-410d-a666-729ee794933f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:03.200257 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9c1660f1-7315-410d-a666-729ee794933f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:03.251948 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9c1660f1-7315-410d-a666-729ee794933f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:03.251948 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9c1660f1-7315-410d-a666-729ee794933f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:03.251948 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9c1660f1-7315-410d-a666-729ee794933f tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68" status: 200 len: 1663 microversion: 2.25 time: 0.469911 Oct 17 13:45:03.251948 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1324/2673] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:45:02 2022] GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68 => generated 1663 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:45:03.255771 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e57fd933-83de-4329-b7c0-0626d01a7441 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:03.257396 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e57fd933-83de-4329-b7c0-0626d01a7441 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] [instance: 19575b3d-cba9-4060-9579-9133975767de] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:03.306971 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e57fd933-83de-4329-b7c0-0626d01a7441 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:03.307498 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e57fd933-83de-4329-b7c0-0626d01a7441 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:03.308178 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e57fd933-83de-4329-b7c0-0626d01a7441 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:03.314536 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e57fd933-83de-4329-b7c0-0626d01a7441 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:03.316194 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e57fd933-83de-4329-b7c0-0626d01a7441 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:03.316665 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e57fd933-83de-4329-b7c0-0626d01a7441 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:04.569611 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=6 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:45:04.622770 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e57fd933-83de-4329-b7c0-0626d01a7441 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75205205ba2946fbb18918201f54e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3126767b1c348859c2640dc21e38f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:04.631070 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e57fd933-83de-4329-b7c0-0626d01a7441 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] 10.222.0.79 "GET /compute/v2.1/servers/19575b3d-cba9-4060-9579-9133975767de" status: 200 len: 1317 microversion: 2.1 time: 1.395590 Oct 17 13:45:04.635097 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1325/2674] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:03 2022] GET /compute/v2.1/servers/19575b3d-cba9-4060-9579-9133975767de => generated 1317 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:04.640815 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1f50d66d-85c5-4046-bba9-eddb88abc9b2 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:04.642085 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1f50d66d-85c5-4046-bba9-eddb88abc9b2 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:04.648478 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1f50d66d-85c5-4046-bba9-eddb88abc9b2 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:04.649815 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1f50d66d-85c5-4046-bba9-eddb88abc9b2 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:04.650468 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1f50d66d-85c5-4046-bba9-eddb88abc9b2 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:04.652325 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1f50d66d-85c5-4046-bba9-eddb88abc9b2 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:04.653026 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1f50d66d-85c5-4046-bba9-eddb88abc9b2 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:04.653727 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1f50d66d-85c5-4046-bba9-eddb88abc9b2 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:05.457793 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=4 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:45:05.981221 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1f50d66d-85c5-4046-bba9-eddb88abc9b2 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:06.018163 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1f50d66d-85c5-4046-bba9-eddb88abc9b2 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 1.380422 Oct 17 13:45:06.022829 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1326/2675] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:04 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:06.030499 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-29d28836-6e30-4473-8295-8d2c14c967a3 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '.version_select at 0x7f7cd499b040>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:06.119240 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-29d28836-6e30-4473-8295-8d2c14c967a3 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "GET /compute/v2.1/images/545ba6e2-5330-47da-8d7e-390d40909596" status: 200 len: 1435 microversion: 2.1 time: 0.080092 Oct 17 13:45:06.122094 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1327/2676] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:45:06 2022] GET /compute/v2.1/images/545ba6e2-5330-47da-8d7e-390d40909596 => generated 1435 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:06.132821 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d095cf44-0c1e-4c60-b10d-cef5291946ed tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:06.136481 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d095cf44-0c1e-4c60-b10d-cef5291946ed tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] [instance: f59dba6a-0058-4aeb-a3b0-3e0209d928c4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:06.149263 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d095cf44-0c1e-4c60-b10d-cef5291946ed tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:06.151015 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d095cf44-0c1e-4c60-b10d-cef5291946ed tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:06.152585 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d095cf44-0c1e-4c60-b10d-cef5291946ed tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:06.155793 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d095cf44-0c1e-4c60-b10d-cef5291946ed tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:06.160251 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d095cf44-0c1e-4c60-b10d-cef5291946ed tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:06.161226 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d095cf44-0c1e-4c60-b10d-cef5291946ed tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:06.186911 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-d095cf44-0c1e-4c60-b10d-cef5291946ed tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] HTTP exception thrown: Instance f59dba6a-0058-4aeb-a3b0-3e0209d928c4 could not be found. Oct 17 13:45:06.188801 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d095cf44-0c1e-4c60-b10d-cef5291946ed tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Request method failure captured: Oct 17 13:45:06.188801 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/f59dba6a-0058-4aeb-a3b0-3e0209d928c4 HTTP/1.1 Oct 17 13:45:06.188801 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:45:06.188801 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:45:06.188801 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:45:06.188801 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:45:06.188801 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:45:06.188801 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:45:06.188801 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:45:06.188801 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:45:06.188801 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVw3iQ6LJ-oU2tFwyJ5gsQeR3rjFTA_2XQb06KSB7HIS9wQkcUxeKcJP5eITwbNVvU9XbOa9TeL1yq85nhyiWvr98OnHcKnLZFDxBWcbgD2auKe4P84Uf4d9YQAPogX8gIDZNBrZNJmkJZwfgJRXoAEEwoAvarWNpSPiIpSAhcvVnY8 Oct 17 13:45:06.188801 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:45:06.188801 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:45:06.188801 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:45:06.188801 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:45:06.188801 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:45:06.188801 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:45:06.188801 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 46a3aa5210b549fc95cd534135624ab5 Oct 17 13:45:06.188801 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1429847772 Oct 17 13:45:06.188801 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:45:06.188801 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:45:06.188801 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/46a3aa5210b549fc95cd534135624ab5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/46a3aa5210b549fc95cd534135624ab5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/46a3aa5210b549fc95cd534135624ab5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_46a3aa5210b549fc95cd534135624ab5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:45:06.188801 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1429847772 Oct 17 13:45:06.188801 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 46a3aa5210b549fc95cd534135624ab5 Oct 17 13:45:06.188801 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1429847772 Oct 17 13:45:06.188801 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServerAddressesNegativeTestJSON-1429847772-project Oct 17 13:45:06.188801 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:45:06.188801 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:45:06.188801 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: fc181092e9cb42e6a751e9bec506d7f5 Oct 17 13:45:06.188801 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1429847772-project Oct 17 13:45:06.188801 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:45:06.188801 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance f59dba6a-0058-4aeb-a3b0-3e0209d928c4 could not be found. Oct 17 13:45:06.188801 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'f59dba6a-0058-4aeb-a3b0-3e0209d928c4'} Oct 17 13:45:06.188801 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:45:06.188801 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:06.188801 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:45:06.188801 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:45:06.188801 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:45:06.188801 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:45:06.188801 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:45:06.188801 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:45:06.188801 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:45:06.188801 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:45:06.188801 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f59dba6a-0058-4aeb-a3b0-3e0209d928c4 could not be found. Oct 17 13:45:06.188801 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:06.188801 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:06.188801 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:06.188801 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:06.188801 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:06.188801 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:06.188801 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:45:06.188801 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:45:06.188801 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:45:06.188801 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:45:06.188801 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:45:06.188801 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:45:06.188801 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:45:06.188801 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:45:06.188801 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:45:06.188801 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:45:06.188801 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f59dba6a-0058-4aeb-a3b0-3e0209d928c4 could not be found. Oct 17 13:45:06.188801 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:06.188801 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:06.193721 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:06.193721 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:06.193721 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:06.193721 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:06.193721 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:45:06.193721 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:45:06.193721 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f59dba6a-0058-4aeb-a3b0-3e0209d928c4 could not be found. Oct 17 13:45:06.193721 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:06.195484 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d095cf44-0c1e-4c60-b10d-cef5291946ed tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] Returning 404 to user: Instance f59dba6a-0058-4aeb-a3b0-3e0209d928c4 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:45:06.197809 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d095cf44-0c1e-4c60-b10d-cef5291946ed tempest-ServerAddressesNegativeTestJSON-1429847772 tempest-ServerAddressesNegativeTestJSON-1429847772-project] 10.222.0.79 "GET /compute/v2.1/servers/f59dba6a-0058-4aeb-a3b0-3e0209d928c4" status: 404 len: 111 microversion: 2.1 time: 0.073183 Oct 17 13:45:06.198868 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1328/2677] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:06 2022] GET /compute/v2.1/servers/f59dba6a-0058-4aeb-a3b0-3e0209d928c4 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:45:06.206257 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-bfbf04fd-6296-41e7-848a-293fce091830 req-18ee4305-96f9-4d66-8897-e655f75750a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f59dba6a-0058-4aeb-a3b0-3e0209d928c4", "name": "network-vif-deleted", "tag": "a20526da-2349-4b19-a6a5-29f2525348f2"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:06.217881 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-bfbf04fd-6296-41e7-848a-293fce091830 req-18ee4305-96f9-4d66-8897-e655f75750a6 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:06.218678 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-bfbf04fd-6296-41e7-848a-293fce091830 req-18ee4305-96f9-4d66-8897-e655f75750a6 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:06.219385 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-bfbf04fd-6296-41e7-848a-293fce091830 req-18ee4305-96f9-4d66-8897-e655f75750a6 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:06.238372 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-bfbf04fd-6296-41e7-848a-293fce091830 req-18ee4305-96f9-4d66-8897-e655f75750a6 service nova] Creating event network-vif-deleted:a20526da-2349-4b19-a6a5-29f2525348f2 for instance f59dba6a-0058-4aeb-a3b0-3e0209d928c4 on n-h2-854247-14 Oct 17 13:45:06.249497 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-bfbf04fd-6296-41e7-848a-293fce091830 req-18ee4305-96f9-4d66-8897-e655f75750a6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048259 Oct 17 13:45:06.250047 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1329/2678] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:45:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:45:06.265654 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6c7da941-a593-4d46-b514-ab116f129396 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:06.268341 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6c7da941-a593-4d46-b514-ab116f129396 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 709d926d-fba5-49ea-84ac-95d8bb018c68] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:06.294278 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6c7da941-a593-4d46-b514-ab116f129396 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:06.303177 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6c7da941-a593-4d46-b514-ab116f129396 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:06.304394 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6c7da941-a593-4d46-b514-ab116f129396 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:06.307499 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6c7da941-a593-4d46-b514-ab116f129396 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:06.309997 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6c7da941-a593-4d46-b514-ab116f129396 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:06.319834 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6c7da941-a593-4d46-b514-ab116f129396 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:06.396917 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6c7da941-a593-4d46-b514-ab116f129396 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:06.398006 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6c7da941-a593-4d46-b514-ab116f129396 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:06.399635 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6c7da941-a593-4d46-b514-ab116f129396 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:06.401228 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-6c7da941-a593-4d46-b514-ab116f129396 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lazy-loading 'fault' on Instance uuid 709d926d-fba5-49ea-84ac-95d8bb018c68 {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:45:06.414851 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:45:06.564802 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6c7da941-a593-4d46-b514-ab116f129396 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:06.584110 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6c7da941-a593-4d46-b514-ab116f129396 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:06.586170 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6c7da941-a593-4d46-b514-ab116f129396 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:06.587722 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6c7da941-a593-4d46-b514-ab116f129396 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68" status: 200 len: 1374 microversion: 2.25 time: 0.335053 Oct 17 13:45:06.617536 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1330/2679] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:45:06 2022] GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68 => generated 1374 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:45:06.628462 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a5394cfc-384c-4ebb-aca9-90c626c3bb91 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:06.629982 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a5394cfc-384c-4ebb-aca9-90c626c3bb91 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] [instance: 19575b3d-cba9-4060-9579-9133975767de] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:06.644468 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a5394cfc-384c-4ebb-aca9-90c626c3bb91 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:06.644968 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a5394cfc-384c-4ebb-aca9-90c626c3bb91 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:06.647467 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a5394cfc-384c-4ebb-aca9-90c626c3bb91 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:06.653696 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a5394cfc-384c-4ebb-aca9-90c626c3bb91 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:06.654588 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a5394cfc-384c-4ebb-aca9-90c626c3bb91 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:06.655343 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a5394cfc-384c-4ebb-aca9-90c626c3bb91 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:06.867138 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-c5d6f47c-4b8e-472d-b787-486025254bc2 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:45:06.868389 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-c5d6f47c-4b8e-472d-b787-486025254bc2 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:45:06.869087 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-c5d6f47c-4b8e-472d-b787-486025254bc2 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:45:06.869648 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-c5d6f47c-4b8e-472d-b787-486025254bc2 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:45:06.870347 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-c5d6f47c-4b8e-472d-b787-486025254bc2 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:45:06.884220 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c5d6f47c-4b8e-472d-b787-486025254bc2 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:06.888200 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c5d6f47c-4b8e-472d-b787-486025254bc2 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:06.891855 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c5d6f47c-4b8e-472d-b787-486025254bc2 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:06.892915 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c5d6f47c-4b8e-472d-b787-486025254bc2 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:06.893536 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c5d6f47c-4b8e-472d-b787-486025254bc2 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:06.895840 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c5d6f47c-4b8e-472d-b787-486025254bc2 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:06.929510 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a5394cfc-384c-4ebb-aca9-90c626c3bb91 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75205205ba2946fbb18918201f54e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3126767b1c348859c2640dc21e38f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:06.944353 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-c5d6f47c-4b8e-472d-b787-486025254bc2 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Getting quotas for project 676987e95424497c94984347dd6a7988. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:45:06.957377 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-c5d6f47c-4b8e-472d-b787-486025254bc2 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Getting quotas for user 467250951f654e33b3e233868301bbf0 and project 676987e95424497c94984347dd6a7988. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:45:06.959027 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a5394cfc-384c-4ebb-aca9-90c626c3bb91 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] 10.222.0.79 "GET /compute/v2.1/servers/19575b3d-cba9-4060-9579-9133975767de" status: 200 len: 1317 microversion: 2.1 time: 0.334382 Oct 17 13:45:06.975995 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1331/2680] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:06 2022] GET /compute/v2.1/servers/19575b3d-cba9-4060-9579-9133975767de => generated 1317 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:06.981916 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-504d2614-7f77-48a7-a7c3-a0a83faf6510 req-5e4af739-c194-4860-a106-94a6f9f442a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19575b3d-cba9-4060-9579-9133975767de", "tag": "87eb4336-0520-4977-b32a-7ee1560f6684"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:06.996845 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c5d6f47c-4b8e-472d-b787-486025254bc2 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:45:06.999527 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c5d6f47c-4b8e-472d-b787-486025254bc2 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: 87134cd4-0fff-43ba-b0a3-c4a62e3de5b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:45:07.026978 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-504d2614-7f77-48a7-a7c3-a0a83faf6510 req-5e4af739-c194-4860-a106-94a6f9f442a6 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:07.027488 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-504d2614-7f77-48a7-a7c3-a0a83faf6510 req-5e4af739-c194-4860-a106-94a6f9f442a6 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:07.027912 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-504d2614-7f77-48a7-a7c3-a0a83faf6510 req-5e4af739-c194-4860-a106-94a6f9f442a6 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:07.082601 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-504d2614-7f77-48a7-a7c3-a0a83faf6510 req-5e4af739-c194-4860-a106-94a6f9f442a6 service nova] Creating event network-changed:87eb4336-0520-4977-b32a-7ee1560f6684 for instance 19575b3d-cba9-4060-9579-9133975767de on n-h1-854247-14 Oct 17 13:45:07.096119 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-504d2614-7f77-48a7-a7c3-a0a83faf6510 req-5e4af739-c194-4860-a106-94a6f9f442a6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115847 Oct 17 13:45:07.105356 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c5d6f47c-4b8e-472d-b787-486025254bc2 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.730553 Oct 17 13:45:07.106617 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1350/2681] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:45:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 4733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:45:07.113821 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f1c3e11d-8fb5-406a-af03-448c6a19143e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:07.153560 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f1c3e11d-8fb5-406a-af03-448c6a19143e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:07.153560 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1c3e11d-8fb5-406a-af03-448c6a19143e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:07.153560 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1c3e11d-8fb5-406a-af03-448c6a19143e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:07.153560 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1c3e11d-8fb5-406a-af03-448c6a19143e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:07.153560 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1c3e11d-8fb5-406a-af03-448c6a19143e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:07.153560 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1c3e11d-8fb5-406a-af03-448c6a19143e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:07.154283 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1332/2682] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:45:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:45:07.154393 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1c3e11d-8fb5-406a-af03-448c6a19143e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:07.154494 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8208da71-b2cc-4c00-9138-c2076fe20739 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '.version_select at 0x7f7cd4a24d30>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:07.260693 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8208da71-b2cc-4c00-9138-c2076fe20739 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "GET /compute/v2.1/images/545ba6e2-5330-47da-8d7e-390d40909596" status: 200 len: 1435 microversion: 2.1 time: 0.127591 Oct 17 13:45:07.261471 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1333/2683] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:45:07 2022] GET /compute/v2.1/images/545ba6e2-5330-47da-8d7e-390d40909596 => generated 1435 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:07.271141 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f63a0bcc-505e-4c71-a458-74b54943f546 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:07.271837 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f63a0bcc-505e-4c71-a458-74b54943f546 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: 87134cd4-0fff-43ba-b0a3-c4a62e3de5b1] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:07.517018 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f63a0bcc-505e-4c71-a458-74b54943f546 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467250951f654e33b3e233868301bbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676987e95424497c94984347dd6a7988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:07.524529 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f63a0bcc-505e-4c71-a458-74b54943f546 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "GET /compute/v2.1/servers/87134cd4-0fff-43ba-b0a3-c4a62e3de5b1" status: 200 len: 1212 microversion: 2.1 time: 0.262105 Oct 17 13:45:07.528181 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1334/2684] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:07 2022] GET /compute/v2.1/servers/87134cd4-0fff-43ba-b0a3-c4a62e3de5b1 => generated 1212 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:07.538418 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d2278609-4216-4d80-b681-3159ef7bd368 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:07.543537 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d2278609-4216-4d80-b681-3159ef7bd368 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] [instance: 87114af9-1214-4182-8f68-756a1a5dfc7a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:07.561151 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d2278609-4216-4d80-b681-3159ef7bd368 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:07.561926 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d2278609-4216-4d80-b681-3159ef7bd368 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:07.562528 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d2278609-4216-4d80-b681-3159ef7bd368 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:07.563439 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d2278609-4216-4d80-b681-3159ef7bd368 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:07.575447 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d2278609-4216-4d80-b681-3159ef7bd368 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:07.576231 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d2278609-4216-4d80-b681-3159ef7bd368 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:07.723571 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f1c3e11d-8fb5-406a-af03-448c6a19143e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:07.733847 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f1c3e11d-8fb5-406a-af03-448c6a19143e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 0.625699 Oct 17 13:45:07.734353 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1351/2685] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:07 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:07.759924 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1ccd44da-4e22-46d1-9a54-ddf2cde2c770 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:07.763337 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-1ccd44da-4e22-46d1-9a54-ddf2cde2c770 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 709d926d-fba5-49ea-84ac-95d8bb018c68] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:07.788893 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1ccd44da-4e22-46d1-9a54-ddf2cde2c770 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:07.789791 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1ccd44da-4e22-46d1-9a54-ddf2cde2c770 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:07.791494 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1ccd44da-4e22-46d1-9a54-ddf2cde2c770 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:07.793718 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1ccd44da-4e22-46d1-9a54-ddf2cde2c770 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:07.795002 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1ccd44da-4e22-46d1-9a54-ddf2cde2c770 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:07.796191 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1ccd44da-4e22-46d1-9a54-ddf2cde2c770 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:07.837124 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-1ccd44da-4e22-46d1-9a54-ddf2cde2c770 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] HTTP exception thrown: Instance 709d926d-fba5-49ea-84ac-95d8bb018c68 could not be found. Oct 17 13:45:07.842913 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1ccd44da-4e22-46d1-9a54-ddf2cde2c770 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Request method failure captured: Oct 17 13:45:07.842913 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68 HTTP/1.1 Oct 17 13:45:07.842913 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:45:07.842913 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:45:07.842913 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:45:07.842913 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:45:07.842913 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:45:07.842913 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:45:07.842913 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:45:07.842913 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:45:07.842913 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVqYdRrJYCWyuI_FQz_MllU78A6FgYoAnDA9gdwPauZtaBEX-T7MkFUfKOkAZSrtD_LmO7eB1jtruLn1rwEZOZdhe4hbAiSuVzct5qoO-IV9yMhGhcrR76eqo3706KiWiMqRJoDvSKZaGrDwgOi9uksXK7vrXL2pyT4e4DSq7MSXAPk Oct 17 13:45:07.842913 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:45:07.842913 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:45:07.842913 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:45:07.842913 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:45:07.842913 n-d-854247-14 devstack@n-api.service[127016]: X-Openstack-Nova-Api-Version: 2.25 Oct 17 13:45:07.842913 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:45:07.842913 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:45:07.842913 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 90d4540094b84255821c0ab95304d22a Oct 17 13:45:07.842913 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-404581456 Oct 17 13:45:07.842913 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:45:07.842913 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:45:07.842913 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/90d4540094b84255821c0ab95304d22a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/90d4540094b84255821c0ab95304d22a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/90d4540094b84255821c0ab95304d22a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_90d4540094b84255821c0ab95304d22a", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:45:07.842913 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-404581456 Oct 17 13:45:07.842913 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 90d4540094b84255821c0ab95304d22a Oct 17 13:45:07.842913 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-404581456 Oct 17 13:45:07.842913 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-LiveAutoBlockMigrationV225Test-404581456-project Oct 17 13:45:07.842913 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:45:07.842913 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:45:07.842913 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 5bc3340d39404042af0eca8747874005 Oct 17 13:45:07.842913 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-404581456-project Oct 17 13:45:07.842913 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:45:07.842913 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 709d926d-fba5-49ea-84ac-95d8bb018c68 could not be found. Oct 17 13:45:07.842913 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '709d926d-fba5-49ea-84ac-95d8bb018c68'} Oct 17 13:45:07.842913 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:45:07.842913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:07.842913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:45:07.842913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:45:07.842913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:45:07.842913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:45:07.842913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:45:07.842913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:45:07.842913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:45:07.842913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:45:07.842913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 709d926d-fba5-49ea-84ac-95d8bb018c68 could not be found. Oct 17 13:45:07.842913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:07.842913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:07.842913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:07.842913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:07.842913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:07.842913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:07.842913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:45:07.842913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:45:07.842913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:45:07.842913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:45:07.842913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:45:07.842913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:45:07.842913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:45:07.842913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:45:07.842913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:45:07.842913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:45:07.842913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 709d926d-fba5-49ea-84ac-95d8bb018c68 could not be found. Oct 17 13:45:07.842913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:07.846972 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:07.846972 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:07.846972 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:07.846972 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:07.846972 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:07.846972 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:45:07.846972 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:45:07.846972 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 709d926d-fba5-49ea-84ac-95d8bb018c68 could not be found. Oct 17 13:45:07.846972 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:07.848422 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1ccd44da-4e22-46d1-9a54-ddf2cde2c770 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Returning 404 to user: Instance 709d926d-fba5-49ea-84ac-95d8bb018c68 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:45:07.855583 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1ccd44da-4e22-46d1-9a54-ddf2cde2c770 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68" status: 404 len: 111 microversion: 2.25 time: 0.116376 Oct 17 13:45:07.856410 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1352/2686] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:45:07 2022] GET /compute/v2.1/servers/709d926d-fba5-49ea-84ac-95d8bb018c68 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:45:07.866721 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b05ecc5f-81fa-4609-975c-e3e37118c018 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-193260157", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "72be642c-f241-4ddb-80d7-b14a93aa7fc9"}]}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:07.879894 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b05ecc5f-81fa-4609-975c-e3e37118c018 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Request method failure captured: Oct 17 13:45:07.879894 n-d-854247-14 devstack@n-api.service[127016]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:45:07.879894 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:45:07.879894 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:45:07.879894 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:45:07.879894 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 491 Oct 17 13:45:07.879894 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:45:07.879894 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:45:07.879894 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:45:07.879894 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:45:07.879894 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVwEqzYAZh4AkEjRryOAZIhaHrAKxd2Qcal9md8a5n-MMUYSdXmcWYLDVkyQoPrDIbcsApBq2EewemPkBwvNDDOidb0hhc_Z3w9BeEUj5ET_flLYPqO5hgqCsuZGXFiYIEBJxrkx614fXiELZHaNkvhSdsJHShK0w7L-UPHhkPKqi5M Oct 17 13:45:07.879894 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:45:07.879894 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:45:07.879894 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:45:07.879894 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:45:07.879894 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:45:07.879894 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:45:07.879894 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:45:07.879894 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:07.879894 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:45:07.879894 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:45:07.879894 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_59e65f6eb06d40d583b9f43c9af94c13", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:45:07.879894 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:07.879894 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:45:07.879894 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:07.879894 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:45:07.879894 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:45:07.879894 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:45:07.879894 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 443c44b0bd9e4c56a7fe0c1a53238545 Oct 17 13:45:07.879894 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:45:07.879894 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:45:07.879894 n-d-854247-14 devstack@n-api.service[127016]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-193260157", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "72be642c-f241-4ddb-80d7-b14a93aa7fc9"}]}} Oct 17 13:45:07.879894 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:45:07.879894 n-d-854247-14 devstack@n-api.service[127016]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 17 13:45:07.879894 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-193260157', 'imageRef': '0743b21b-a6ff-4d02-897c-eabb68c3ba07', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '72be642c-f241-4ddb-80d7-b14a93aa7fc9'}]}}} Oct 17 13:45:07.879894 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:45:07.879894 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:07.879894 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:45:07.879894 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:45:07.879894 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:45:07.879894 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:45:07.879894 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 17 13:45:07.879894 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:07.879894 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 17 13:45:07.879894 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 17 13:45:07.879894 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:07.879894 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 17 13:45:07.883934 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 17 13:45:07.883934 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:07.883934 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:07.883934 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:07.883934 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:07.883934 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:07.883934 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:07.883934 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:45:07.883934 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:45:07.883934 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:45:07.883934 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:45:07.883934 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:45:07.883934 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:45:07.883934 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:45:07.883934 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:45:07.883934 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:45:07.883934 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:45:07.883934 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:45:07.883934 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:45:07.883934 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 17 13:45:07.883934 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:07.883934 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:07.883934 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:07.883934 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:07.883934 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:07.883934 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:07.883934 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:45:07.883934 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:45:07.883934 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 17 13:45:07.883934 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:07.892505 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b05ecc5f-81fa-4609-975c-e3e37118c018 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:45:07.893735 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b05ecc5f-81fa-4609-975c-e3e37118c018 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.035246 Oct 17 13:45:07.894809 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1353/2687] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:45:07 2022] POST /compute/v2.1/servers => generated 624 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:45:07.902445 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c678d34f-6428-4704-b702-59dae22a9bf3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '.version_select at 0x7f7cd45b44c0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:07.952440 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c678d34f-6428-4704-b702-59dae22a9bf3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-774404457" status: 204 len: 0 microversion: 2.25 time: 0.056262 Oct 17 13:45:07.953182 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1354/2688] 10.222.0.79 () {60 vars in 1259 bytes} [Mon Oct 17 13:45:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-774404457 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:45:07.963280 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d28121be-bba8-4052-b983-092139135449 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:07.966965 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d28121be-bba8-4052-b983-092139135449 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:07.983300 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d28121be-bba8-4052-b983-092139135449 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:07.983816 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d28121be-bba8-4052-b983-092139135449 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:07.984260 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d28121be-bba8-4052-b983-092139135449 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:07.985002 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d28121be-bba8-4052-b983-092139135449 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:07.985465 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d28121be-bba8-4052-b983-092139135449 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:07.985893 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d28121be-bba8-4052-b983-092139135449 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:08.133768 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d2278609-4216-4d80-b681-3159ef7bd368 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1f69cda7724d9bb8a6beec6d4f973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87456dcb963449b2ac1c2d93da0a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:08.158003 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d2278609-4216-4d80-b681-3159ef7bd368 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "GET /compute/v2.1/servers/87114af9-1214-4182-8f68-756a1a5dfc7a" status: 200 len: 1467 microversion: 2.1 time: 0.628513 Oct 17 13:45:08.173002 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1335/2689] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:07 2022] GET /compute/v2.1/servers/87114af9-1214-4182-8f68-756a1a5dfc7a => generated 1467 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:08.178193 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6bf58bb2-dcaa-4266-8ffd-1ab5b7a0faa9 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:08.182740 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6bf58bb2-dcaa-4266-8ffd-1ab5b7a0faa9 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] [instance: 19575b3d-cba9-4060-9579-9133975767de] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:08.197276 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6bf58bb2-dcaa-4266-8ffd-1ab5b7a0faa9 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:08.198213 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6bf58bb2-dcaa-4266-8ffd-1ab5b7a0faa9 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:08.198890 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6bf58bb2-dcaa-4266-8ffd-1ab5b7a0faa9 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:08.199985 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6bf58bb2-dcaa-4266-8ffd-1ab5b7a0faa9 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:08.200687 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6bf58bb2-dcaa-4266-8ffd-1ab5b7a0faa9 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:08.201401 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6bf58bb2-dcaa-4266-8ffd-1ab5b7a0faa9 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:08.759270 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d28121be-bba8-4052-b983-092139135449 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:08.772888 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d28121be-bba8-4052-b983-092139135449 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 0.813507 Oct 17 13:45:08.775678 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1355/2690] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:07 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:08.783747 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-adac1f27-8505-47b2-a8b3-c17ed811b908 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '.version_select at 0x7f7cd9811940>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:09.099560 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6bf58bb2-dcaa-4266-8ffd-1ab5b7a0faa9 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75205205ba2946fbb18918201f54e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3126767b1c348859c2640dc21e38f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:09.108385 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6bf58bb2-dcaa-4266-8ffd-1ab5b7a0faa9 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] 10.222.0.79 "GET /compute/v2.1/servers/19575b3d-cba9-4060-9579-9133975767de" status: 200 len: 1317 microversion: 2.1 time: 0.933893 Oct 17 13:45:09.125290 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1336/2691] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:08 2022] GET /compute/v2.1/servers/19575b3d-cba9-4060-9579-9133975767de => generated 1317 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:09.149010 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-225b2187-d9fa-4544-bca2-bfd635c436d9 req-63d5029e-ad08-4c9e-aa42-efa22a0cab40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "709d926d-fba5-49ea-84ac-95d8bb018c68", "name": "network-vif-deleted", "tag": "8407f400-367b-4c97-9c87-63bd179d8941"}, {"name": "network-changed", "server_uuid": "c8ec85bf-e448-4a4b-998d-a6bedb89d5e8", "tag": "d873d2fd-e2b6-4478-a3ae-55a34161df6e"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:09.205744 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-225b2187-d9fa-4544-bca2-bfd635c436d9 req-63d5029e-ad08-4c9e-aa42-efa22a0cab40 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:09.207972 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-225b2187-d9fa-4544-bca2-bfd635c436d9 req-63d5029e-ad08-4c9e-aa42-efa22a0cab40 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:09.209459 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-225b2187-d9fa-4544-bca2-bfd635c436d9 req-63d5029e-ad08-4c9e-aa42-efa22a0cab40 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:09.230827 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-225b2187-d9fa-4544-bca2-bfd635c436d9 req-63d5029e-ad08-4c9e-aa42-efa22a0cab40 service nova] Creating event network-vif-deleted:8407f400-367b-4c97-9c87-63bd179d8941 for instance 709d926d-fba5-49ea-84ac-95d8bb018c68 on n-h2-854247-14 Oct 17 13:45:09.231693 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-225b2187-d9fa-4544-bca2-bfd635c436d9 req-63d5029e-ad08-4c9e-aa42-efa22a0cab40 service nova] Creating event network-changed:d873d2fd-e2b6-4478-a3ae-55a34161df6e for instance c8ec85bf-e448-4a4b-998d-a6bedb89d5e8 on n-h1-854247-14 Oct 17 13:45:09.248948 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-225b2187-d9fa-4544-bca2-bfd635c436d9 req-63d5029e-ad08-4c9e-aa42-efa22a0cab40 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.121569 Oct 17 13:45:09.250266 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1337/2692] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:45:09 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:45:09.259612 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f67b1bfb-3a82-4bc7-8481-85ab7cdc5040 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:09.260645 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f67b1bfb-3a82-4bc7-8481-85ab7cdc5040 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: 87134cd4-0fff-43ba-b0a3-c4a62e3de5b1] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:09.270566 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f67b1bfb-3a82-4bc7-8481-85ab7cdc5040 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:09.271857 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f67b1bfb-3a82-4bc7-8481-85ab7cdc5040 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:09.273579 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f67b1bfb-3a82-4bc7-8481-85ab7cdc5040 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:09.274624 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f67b1bfb-3a82-4bc7-8481-85ab7cdc5040 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:09.275494 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f67b1bfb-3a82-4bc7-8481-85ab7cdc5040 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:09.277296 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f67b1bfb-3a82-4bc7-8481-85ab7cdc5040 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:09.522618 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-adac1f27-8505-47b2-a8b3-c17ed811b908 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "DELETE /compute/v2.1/images/545ba6e2-5330-47da-8d7e-390d40909596" status: 204 len: 0 microversion: 2.1 time: 0.744154 Oct 17 13:45:09.526456 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1356/2693] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:08 2022] DELETE /compute/v2.1/images/545ba6e2-5330-47da-8d7e-390d40909596 => generated 0 bytes in 747 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:45:09.528192 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8b96786c-6294-4484-9ea9-701c90b2eb01 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:09.528813 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8b96786c-6294-4484-9ea9-701c90b2eb01 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:09.531272 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:45:09.536346 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8b96786c-6294-4484-9ea9-701c90b2eb01 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:09.537074 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8b96786c-6294-4484-9ea9-701c90b2eb01 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:09.537687 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8b96786c-6294-4484-9ea9-701c90b2eb01 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:09.538569 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8b96786c-6294-4484-9ea9-701c90b2eb01 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:09.540078 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8b96786c-6294-4484-9ea9-701c90b2eb01 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:09.541254 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8b96786c-6294-4484-9ea9-701c90b2eb01 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:09.657427 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f67b1bfb-3a82-4bc7-8481-85ab7cdc5040 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467250951f654e33b3e233868301bbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676987e95424497c94984347dd6a7988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:09.670274 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f67b1bfb-3a82-4bc7-8481-85ab7cdc5040 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "GET /compute/v2.1/servers/87134cd4-0fff-43ba-b0a3-c4a62e3de5b1" status: 200 len: 1272 microversion: 2.1 time: 0.416872 Oct 17 13:45:09.677195 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1338/2694] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:09 2022] GET /compute/v2.1/servers/87134cd4-0fff-43ba-b0a3-c4a62e3de5b1 => generated 1272 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:09.684509 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-49ad403a-cd91-45cb-aa36-104ca83661c6 req-1115480c-d741-439b-9d15-98a2da8ee71b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87114af9-1214-4182-8f68-756a1a5dfc7a", "name": "network-vif-unplugged", "status": "completed", "tag": "cde412a7-8204-4c39-8f24-2d2a36d636f9"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:09.704722 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-49ad403a-cd91-45cb-aa36-104ca83661c6 req-1115480c-d741-439b-9d15-98a2da8ee71b service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:09.706091 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-49ad403a-cd91-45cb-aa36-104ca83661c6 req-1115480c-d741-439b-9d15-98a2da8ee71b service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:09.706733 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-49ad403a-cd91-45cb-aa36-104ca83661c6 req-1115480c-d741-439b-9d15-98a2da8ee71b service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:09.725449 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-49ad403a-cd91-45cb-aa36-104ca83661c6 req-1115480c-d741-439b-9d15-98a2da8ee71b service nova] Creating event network-vif-unplugged:cde412a7-8204-4c39-8f24-2d2a36d636f9 for instance 87114af9-1214-4182-8f68-756a1a5dfc7a on n-h2-854247-14 Oct 17 13:45:09.731497 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-49ad403a-cd91-45cb-aa36-104ca83661c6 req-1115480c-d741-439b-9d15-98a2da8ee71b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052935 Oct 17 13:45:09.732999 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1339/2695] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:45:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:45:09.740485 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5d4ae8a7-10a4-4304-ac55-aff8135b95b8 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '.version_select at 0x7f7cd49bf430>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:09.780885 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-5d4ae8a7-10a4-4304-ac55-aff8135b95b8 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] HTTP exception thrown: Image not found. Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5d4ae8a7-10a4-4304-ac55-aff8135b95b8 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Request method failure captured: Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: request: DELETE /compute/v2.1/images/49da5263-076c-4bed-b977-116e50ef3ee9 HTTP/1.1 Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVv5BiKexrKvNbOl9A5FHtFV5mHehkwNbAoSAIsxyajSewiHDmmi2twNZBXlpujzoA265PfVkE-1IwZZm0IyESrVBaD0vciWX3eiruV4FpvSfn-F31Q-fvzCfNuXByY4yUholHF08eDyDs0t57RjfWJ2DQ1A52B7Q_xuIach-5Oj8eY Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 87456dcb963449b2ac1c2d93da0a4ec7 Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ImagesOneServerTestJSON-921891472 Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/87456dcb963449b2ac1c2d93da0a4ec7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/87456dcb963449b2ac1c2d93da0a4ec7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/87456dcb963449b2ac1c2d93da0a4ec7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_87456dcb963449b2ac1c2d93da0a4ec7", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ImagesOneServerTestJSON-921891472 Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 87456dcb963449b2ac1c2d93da0a4ec7 Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-921891472 Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ImagesOneServerTestJSON-921891472-project Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: dc1f69cda7724d9bb8a6beec6d4f973e Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ImagesOneServerTestJSON-921891472-project Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: method: Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: exception: Image not found. Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '49da5263-076c-4bed-b977-116e50ef3ee9'} Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 49da5263-076c-4bed-b977-116e50ef3ee9 to delete Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 49da5263-076c-4bed-b977-116e50ef3ee9 could not be found. Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:09.783805 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:09.788628 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:09.788628 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:09.788628 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:45:09.788628 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:45:09.788628 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:45:09.788628 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:45:09.788628 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:45:09.788628 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:45:09.788628 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 17 13:45:09.788628 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 13:45:09.788628 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 13:45:09.788628 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:09.788628 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:09.788628 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:09.788628 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:09.788628 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:09.788628 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:09.788628 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:45:09.788628 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:45:09.788628 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 13:45:09.788628 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:09.796744 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5d4ae8a7-10a4-4304-ac55-aff8135b95b8 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Returning 404 to user: Image not found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:45:09.797755 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5d4ae8a7-10a4-4304-ac55-aff8135b95b8 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "DELETE /compute/v2.1/images/49da5263-076c-4bed-b977-116e50ef3ee9" status: 404 len: 62 microversion: 2.1 time: 0.063262 Oct 17 13:45:09.802175 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1340/2696] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:09 2022] DELETE /compute/v2.1/images/49da5263-076c-4bed-b977-116e50ef3ee9 => generated 62 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:45:09.807433 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2e4ff4cd-12f7-4090-a2e5-45325014178b tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:09.811864 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2e4ff4cd-12f7-4090-a2e5-45325014178b tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] [instance: 87114af9-1214-4182-8f68-756a1a5dfc7a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:09.820039 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2e4ff4cd-12f7-4090-a2e5-45325014178b tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:09.820531 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2e4ff4cd-12f7-4090-a2e5-45325014178b tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:09.820961 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2e4ff4cd-12f7-4090-a2e5-45325014178b tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:09.821718 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2e4ff4cd-12f7-4090-a2e5-45325014178b tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:09.822309 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2e4ff4cd-12f7-4090-a2e5-45325014178b tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:09.822908 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2e4ff4cd-12f7-4090-a2e5-45325014178b tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:09.857197 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2e4ff4cd-12f7-4090-a2e5-45325014178b tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] [instance: 87114af9-1214-4182-8f68-756a1a5dfc7a] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:45:09.976229 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2e4ff4cd-12f7-4090-a2e5-45325014178b tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "DELETE /compute/v2.1/servers/87114af9-1214-4182-8f68-756a1a5dfc7a" status: 204 len: 0 microversion: 2.1 time: 0.171789 Oct 17 13:45:09.987134 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1341/2697] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:45:09 2022] DELETE /compute/v2.1/servers/87114af9-1214-4182-8f68-756a1a5dfc7a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:45:09.995630 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e6344a6e-ad05-41ee-80f4-34070fef413c tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:09.997262 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e6344a6e-ad05-41ee-80f4-34070fef413c tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] [instance: 87114af9-1214-4182-8f68-756a1a5dfc7a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:10.005890 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e6344a6e-ad05-41ee-80f4-34070fef413c tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:10.006466 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e6344a6e-ad05-41ee-80f4-34070fef413c tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:10.007899 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e6344a6e-ad05-41ee-80f4-34070fef413c tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:10.008850 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e6344a6e-ad05-41ee-80f4-34070fef413c tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:10.009310 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e6344a6e-ad05-41ee-80f4-34070fef413c tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:10.009982 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e6344a6e-ad05-41ee-80f4-34070fef413c tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:10.563390 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8b96786c-6294-4484-9ea9-701c90b2eb01 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:10.577293 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8b96786c-6294-4484-9ea9-701c90b2eb01 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 1.052727 Oct 17 13:45:10.578578 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1357/2698] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:09 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:10.585700 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-238ca028-373c-43eb-8b60-fd2f42c38460 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:10.586633 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-238ca028-373c-43eb-8b60-fd2f42c38460 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] [instance: 19575b3d-cba9-4060-9579-9133975767de] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:10.597245 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-238ca028-373c-43eb-8b60-fd2f42c38460 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:10.598124 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-238ca028-373c-43eb-8b60-fd2f42c38460 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:10.598798 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-238ca028-373c-43eb-8b60-fd2f42c38460 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:10.600051 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-238ca028-373c-43eb-8b60-fd2f42c38460 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:10.600727 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-238ca028-373c-43eb-8b60-fd2f42c38460 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:10.601365 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-238ca028-373c-43eb-8b60-fd2f42c38460 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:10.927395 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e6344a6e-ad05-41ee-80f4-34070fef413c tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1f69cda7724d9bb8a6beec6d4f973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87456dcb963449b2ac1c2d93da0a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:10.940363 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e6344a6e-ad05-41ee-80f4-34070fef413c tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "GET /compute/v2.1/servers/87114af9-1214-4182-8f68-756a1a5dfc7a" status: 200 len: 1473 microversion: 2.1 time: 0.950520 Oct 17 13:45:10.951265 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1342/2699] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:09 2022] GET /compute/v2.1/servers/87114af9-1214-4182-8f68-756a1a5dfc7a => generated 1473 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:10.951265 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e4e38e57-3f06-42f4-8780-4b638cd85b77 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "72be642c-f241-4ddb-80d7-b14a93aa7fc9"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:10.957998 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e4e38e57-3f06-42f4-8780-4b638cd85b77 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Request method failure captured: Oct 17 13:45:10.957998 n-d-854247-14 devstack@n-api.service[127017]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:45:10.957998 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:45:10.957998 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:45:10.957998 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:45:10.957998 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 416 Oct 17 13:45:10.957998 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:45:10.957998 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:45:10.957998 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:45:10.957998 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:45:10.957998 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVwEqzYAZh4AkEjRryOAZIhaHrAKxd2Qcal9md8a5n-MMUYSdXmcWYLDVkyQoPrDIbcsApBq2EewemPkBwvNDDOidb0hhc_Z3w9BeEUj5ET_flLYPqO5hgqCsuZGXFiYIEBJxrkx614fXiELZHaNkvhSdsJHShK0w7L-UPHhkPKqi5M Oct 17 13:45:10.957998 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:45:10.957998 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:45:10.957998 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:45:10.957998 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:45:10.957998 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:45:10.957998 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:45:10.957998 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:45:10.957998 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:10.957998 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:45:10.957998 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:45:10.957998 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_59e65f6eb06d40d583b9f43c9af94c13", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:45:10.957998 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:10.957998 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:45:10.957998 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:10.957998 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:45:10.957998 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:45:10.957998 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:45:10.957998 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 443c44b0bd9e4c56a7fe0c1a53238545 Oct 17 13:45:10.957998 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:45:10.957998 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 13:45:10.957998 n-d-854247-14 devstack@n-api.service[127017]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "72be642c-f241-4ddb-80d7-b14a93aa7fc9"}]}} Oct 17 13:45:10.957998 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:45:10.957998 n-d-854247-14 devstack@n-api.service[127017]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 17 13:45:10.957998 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '0743b21b-a6ff-4d02-897c-eabb68c3ba07', 'flavorRef': '452', 'networks': [{'uuid': '72be642c-f241-4ddb-80d7-b14a93aa7fc9'}]}}} Oct 17 13:45:10.957998 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:45:10.957998 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:10.957998 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:45:10.957998 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:45:10.957998 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:45:10.957998 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:45:10.957998 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 17 13:45:10.957998 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:10.957998 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 17 13:45:10.957998 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 17 13:45:10.957998 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:10.957998 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 13:45:10.957998 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 17 13:45:10.957998 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:10.957998 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:10.961022 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:10.961022 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:10.961022 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:10.961022 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:10.961022 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:45:10.961022 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:45:10.961022 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:45:10.961022 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:45:10.961022 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:45:10.961022 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:45:10.961022 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:45:10.961022 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:45:10.961022 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:45:10.961022 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:45:10.961022 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:45:10.961022 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:45:10.961022 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 17 13:45:10.961022 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:10.961022 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:10.961022 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:10.961022 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:10.961022 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:10.961022 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:10.961022 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:45:10.961022 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:45:10.961022 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 17 13:45:10.961022 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:10.968044 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e4e38e57-3f06-42f4-8780-4b638cd85b77 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:45:10.969353 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e4e38e57-3f06-42f4-8780-4b638cd85b77 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.025540 Oct 17 13:45:10.981294 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1343/2700] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:45:10 2022] POST /compute/v2.1/servers => generated 619 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:45:10.988293 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bcf9a5d5-c661-4276-b76a-9176807b2e4b tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:10.989029 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-bcf9a5d5-c661-4276-b76a-9176807b2e4b tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: 87134cd4-0fff-43ba-b0a3-c4a62e3de5b1] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:11.002418 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bcf9a5d5-c661-4276-b76a-9176807b2e4b tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:11.003002 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bcf9a5d5-c661-4276-b76a-9176807b2e4b tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:11.003702 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bcf9a5d5-c661-4276-b76a-9176807b2e4b tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:11.004604 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bcf9a5d5-c661-4276-b76a-9176807b2e4b tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:11.006723 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bcf9a5d5-c661-4276-b76a-9176807b2e4b tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:11.007419 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bcf9a5d5-c661-4276-b76a-9176807b2e4b tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:11.128934 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-238ca028-373c-43eb-8b60-fd2f42c38460 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75205205ba2946fbb18918201f54e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3126767b1c348859c2640dc21e38f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:11.140840 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-238ca028-373c-43eb-8b60-fd2f42c38460 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] 10.222.0.79 "GET /compute/v2.1/servers/19575b3d-cba9-4060-9579-9133975767de" status: 200 len: 1317 microversion: 2.1 time: 0.560167 Oct 17 13:45:11.153138 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-bcf9a5d5-c661-4276-b76a-9176807b2e4b tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467250951f654e33b3e233868301bbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676987e95424497c94984347dd6a7988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:11.158996 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1358/2701] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:10 2022] GET /compute/v2.1/servers/19575b3d-cba9-4060-9579-9133975767de => generated 1317 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:11.164020 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-bcf9a5d5-c661-4276-b76a-9176807b2e4b tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "GET /compute/v2.1/servers/87134cd4-0fff-43ba-b0a3-c4a62e3de5b1" status: 200 len: 1270 microversion: 2.1 time: 0.181359 Oct 17 13:45:11.165970 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1344/2702] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:10 2022] GET /compute/v2.1/servers/87134cd4-0fff-43ba-b0a3-c4a62e3de5b1 => generated 1270 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:11.166392 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-dd5c9db5-4ad3-43d1-954b-28aa845c22de tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:11.166916 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-dd5c9db5-4ad3-43d1-954b-28aa845c22de tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 16213741-2241-4f55-b7ca-20ab551e5596] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:11.171650 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-09863c90-8057-4030-aa14-bd93abc6ad8e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:11.172518 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-09863c90-8057-4030-aa14-bd93abc6ad8e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:11.180640 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-09863c90-8057-4030-aa14-bd93abc6ad8e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:11.181000 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dd5c9db5-4ad3-43d1-954b-28aa845c22de tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:11.181506 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dd5c9db5-4ad3-43d1-954b-28aa845c22de tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:11.181864 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-09863c90-8057-4030-aa14-bd93abc6ad8e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:11.182951 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-09863c90-8057-4030-aa14-bd93abc6ad8e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:11.183705 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-09863c90-8057-4030-aa14-bd93abc6ad8e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:11.187356 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-09863c90-8057-4030-aa14-bd93abc6ad8e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:11.187546 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dd5c9db5-4ad3-43d1-954b-28aa845c22de tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:11.188533 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-09863c90-8057-4030-aa14-bd93abc6ad8e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:11.190991 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dd5c9db5-4ad3-43d1-954b-28aa845c22de tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:11.191524 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dd5c9db5-4ad3-43d1-954b-28aa845c22de tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:11.194266 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dd5c9db5-4ad3-43d1-954b-28aa845c22de tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:11.227398 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-dd5c9db5-4ad3-43d1-954b-28aa845c22de tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 16213741-2241-4f55-b7ca-20ab551e5596] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:45:11.398032 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-dd5c9db5-4ad3-43d1-954b-28aa845c22de tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "DELETE /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596" status: 204 len: 0 microversion: 2.25 time: 0.237191 Oct 17 13:45:11.400525 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1359/2703] 10.222.0.79 () {60 vars in 1280 bytes} [Mon Oct 17 13:45:11 2022] DELETE /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:45:11.409528 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-c0305fa1-de9b-43df-926d-c6176c04810e req-fd537787-58f5-4603-87c6-eb02ce94bdac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d58e9993-1b03-44b7-b27a-5ed4e7ee8232", "tag": "f9564d02-3199-4bb0-909a-2be1f47a28a6"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:11.428273 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-c0305fa1-de9b-43df-926d-c6176c04810e req-fd537787-58f5-4603-87c6-eb02ce94bdac service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:11.430246 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-c0305fa1-de9b-43df-926d-c6176c04810e req-fd537787-58f5-4603-87c6-eb02ce94bdac service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:11.430875 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-c0305fa1-de9b-43df-926d-c6176c04810e req-fd537787-58f5-4603-87c6-eb02ce94bdac service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:11.451450 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-c0305fa1-de9b-43df-926d-c6176c04810e req-fd537787-58f5-4603-87c6-eb02ce94bdac service nova] Creating event network-changed:f9564d02-3199-4bb0-909a-2be1f47a28a6 for instance d58e9993-1b03-44b7-b27a-5ed4e7ee8232 on n-h1-854247-14 Oct 17 13:45:11.460983 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-c0305fa1-de9b-43df-926d-c6176c04810e req-fd537787-58f5-4603-87c6-eb02ce94bdac service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058438 Oct 17 13:45:11.462834 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1360/2704] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:45:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:45:11.472639 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-176e982f-e1cb-4a21-aee6-40fe2c8e5867 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:11.473362 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-176e982f-e1cb-4a21-aee6-40fe2c8e5867 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 16213741-2241-4f55-b7ca-20ab551e5596] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:11.485834 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-176e982f-e1cb-4a21-aee6-40fe2c8e5867 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:11.486596 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-176e982f-e1cb-4a21-aee6-40fe2c8e5867 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:11.487049 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-176e982f-e1cb-4a21-aee6-40fe2c8e5867 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:11.490468 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-176e982f-e1cb-4a21-aee6-40fe2c8e5867 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:11.492027 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-176e982f-e1cb-4a21-aee6-40fe2c8e5867 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:11.492471 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-176e982f-e1cb-4a21-aee6-40fe2c8e5867 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:11.667403 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-09863c90-8057-4030-aa14-bd93abc6ad8e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:11.685318 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-09863c90-8057-4030-aa14-bd93abc6ad8e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 0.517321 Oct 17 13:45:11.686532 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1345/2705] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:11 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:11.714349 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-309967f8-8b04-4b6a-96af-cde03295cab3 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:11.726732 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-309967f8-8b04-4b6a-96af-cde03295cab3 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:11.758285 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-309967f8-8b04-4b6a-96af-cde03295cab3 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:11.761648 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-309967f8-8b04-4b6a-96af-cde03295cab3 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:11.764058 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-309967f8-8b04-4b6a-96af-cde03295cab3 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:11.766182 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-309967f8-8b04-4b6a-96af-cde03295cab3 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:11.766839 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-309967f8-8b04-4b6a-96af-cde03295cab3 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:11.767476 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-309967f8-8b04-4b6a-96af-cde03295cab3 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:12.100548 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-176e982f-e1cb-4a21-aee6-40fe2c8e5867 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:12.121198 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-176e982f-e1cb-4a21-aee6-40fe2c8e5867 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:12.129277 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-176e982f-e1cb-4a21-aee6-40fe2c8e5867 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:12.131718 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-176e982f-e1cb-4a21-aee6-40fe2c8e5867 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596" status: 200 len: 1549 microversion: 2.25 time: 0.667569 Oct 17 13:45:12.132743 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1361/2706] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:45:11 2022] GET /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596 => generated 1549 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:45:12.139969 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-51d8c4ac-f365-4bab-8b49-82f92ce743a5 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:12.141012 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-51d8c4ac-f365-4bab-8b49-82f92ce743a5 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] [instance: 87114af9-1214-4182-8f68-756a1a5dfc7a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:12.153061 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-51d8c4ac-f365-4bab-8b49-82f92ce743a5 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:12.154312 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-51d8c4ac-f365-4bab-8b49-82f92ce743a5 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:12.162190 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-51d8c4ac-f365-4bab-8b49-82f92ce743a5 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:12.165174 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-51d8c4ac-f365-4bab-8b49-82f92ce743a5 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:12.167850 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-51d8c4ac-f365-4bab-8b49-82f92ce743a5 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:12.168660 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-51d8c4ac-f365-4bab-8b49-82f92ce743a5 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:12.407107 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-309967f8-8b04-4b6a-96af-cde03295cab3 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:12.425354 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-309967f8-8b04-4b6a-96af-cde03295cab3 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 0.719359 Oct 17 13:45:12.427458 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1346/2707] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:11 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:12.433953 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-88e1ab62-ee22-41ae-bf1f-b9cdd85406e6 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:12.435697 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-88e1ab62-ee22-41ae-bf1f-b9cdd85406e6 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] [instance: 19575b3d-cba9-4060-9579-9133975767de] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:12.448077 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-88e1ab62-ee22-41ae-bf1f-b9cdd85406e6 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:12.448958 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-88e1ab62-ee22-41ae-bf1f-b9cdd85406e6 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:12.449815 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-88e1ab62-ee22-41ae-bf1f-b9cdd85406e6 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:12.450779 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-88e1ab62-ee22-41ae-bf1f-b9cdd85406e6 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:12.451542 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-88e1ab62-ee22-41ae-bf1f-b9cdd85406e6 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:12.452203 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-88e1ab62-ee22-41ae-bf1f-b9cdd85406e6 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:13.110259 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-51d8c4ac-f365-4bab-8b49-82f92ce743a5 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1f69cda7724d9bb8a6beec6d4f973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87456dcb963449b2ac1c2d93da0a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:13.120739 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-51d8c4ac-f365-4bab-8b49-82f92ce743a5 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "GET /compute/v2.1/servers/87114af9-1214-4182-8f68-756a1a5dfc7a" status: 200 len: 1473 microversion: 2.1 time: 0.986379 Oct 17 13:45:13.136422 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1362/2708] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:12 2022] GET /compute/v2.1/servers/87114af9-1214-4182-8f68-756a1a5dfc7a => generated 1473 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:13.143854 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5085b0fb-9f2c-4ce8-96d6-470fa32a6b23 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:13.144749 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5085b0fb-9f2c-4ce8-96d6-470fa32a6b23 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: 87134cd4-0fff-43ba-b0a3-c4a62e3de5b1] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:13.151369 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5085b0fb-9f2c-4ce8-96d6-470fa32a6b23 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:13.152117 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5085b0fb-9f2c-4ce8-96d6-470fa32a6b23 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:13.152723 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5085b0fb-9f2c-4ce8-96d6-470fa32a6b23 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:13.153628 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5085b0fb-9f2c-4ce8-96d6-470fa32a6b23 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:13.154285 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5085b0fb-9f2c-4ce8-96d6-470fa32a6b23 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:13.154869 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5085b0fb-9f2c-4ce8-96d6-470fa32a6b23 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:13.349027 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-88e1ab62-ee22-41ae-bf1f-b9cdd85406e6 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75205205ba2946fbb18918201f54e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3126767b1c348859c2640dc21e38f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:13.357360 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-88e1ab62-ee22-41ae-bf1f-b9cdd85406e6 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] 10.222.0.79 "GET /compute/v2.1/servers/19575b3d-cba9-4060-9579-9133975767de" status: 200 len: 1317 microversion: 2.1 time: 0.928383 Oct 17 13:45:13.357946 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1347/2709] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:12 2022] GET /compute/v2.1/servers/19575b3d-cba9-4060-9579-9133975767de => generated 1317 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:13.376496 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4936b42c-0b46-4fed-ba56-9cf637c24d92 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1196155533", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": -1, "networks": [{"uuid": "72be642c-f241-4ddb-80d7-b14a93aa7fc9"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:13.405486 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-4936b42c-0b46-4fed-ba56-9cf637c24d92 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] HTTP exception thrown: Flavor -1 could not be found. Oct 17 13:45:13.416006 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4936b42c-0b46-4fed-ba56-9cf637c24d92 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Request method failure captured: Oct 17 13:45:13.416006 n-d-854247-14 devstack@n-api.service[127017]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:45:13.416006 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:45:13.416006 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:45:13.416006 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:45:13.416006 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 206 Oct 17 13:45:13.416006 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:45:13.416006 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:45:13.416006 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:45:13.416006 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:45:13.416006 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVwEqzYAZh4AkEjRryOAZIhaHrAKxd2Qcal9md8a5n-MMUYSdXmcWYLDVkyQoPrDIbcsApBq2EewemPkBwvNDDOidb0hhc_Z3w9BeEUj5ET_flLYPqO5hgqCsuZGXFiYIEBJxrkx614fXiELZHaNkvhSdsJHShK0w7L-UPHhkPKqi5M Oct 17 13:45:13.416006 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:45:13.416006 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:45:13.416006 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:45:13.416006 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:45:13.416006 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:45:13.416006 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:45:13.416006 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:45:13.416006 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:13.416006 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:45:13.416006 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:45:13.416006 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_59e65f6eb06d40d583b9f43c9af94c13", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:45:13.416006 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:13.416006 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:45:13.416006 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:13.416006 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:45:13.416006 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:45:13.416006 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:45:13.416006 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 443c44b0bd9e4c56a7fe0c1a53238545 Oct 17 13:45:13.416006 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:45:13.416006 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 13:45:13.416006 n-d-854247-14 devstack@n-api.service[127017]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1196155533", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": -1, "networks": [{"uuid": "72be642c-f241-4ddb-80d7-b14a93aa7fc9"}]}} Oct 17 13:45:13.416006 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:45:13.416006 n-d-854247-14 devstack@n-api.service[127017]: exception: Flavor -1 could not be found. Oct 17 13:45:13.416006 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1196155533', 'imageRef': '0743b21b-a6ff-4d02-897c-eabb68c3ba07', 'flavorRef': -1, 'networks': [{'uuid': '72be642c-f241-4ddb-80d7-b14a93aa7fc9'}]}}} Oct 17 13:45:13.416006 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:45:13.416006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:13.416006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 17 13:45:13.416006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 17 13:45:13.416006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 13:45:13.416006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 13:45:13.416006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:45:13.416006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:45:13.416006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 13:45:13.416006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 13:45:13.416006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 13:45:13.416006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:45:13.416006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 13:45:13.416006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 13:45:13.416006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 17 13:45:13.416006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:13.416006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:13.416006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:13.416006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:13.416006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:13.416006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:13.416006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:45:13.416006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:45:13.416006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:45:13.416006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:45:13.416006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:45:13.416006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:45:13.424929 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:45:13.424929 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:45:13.424929 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:45:13.424929 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:45:13.424929 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 17 13:45:13.424929 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 17 13:45:13.424929 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 17 13:45:13.424929 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 17 13:45:13.424929 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:13.424929 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:13.424929 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:13.424929 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:13.424929 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:13.424929 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:13.424929 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:45:13.424929 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:45:13.424929 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 17 13:45:13.424929 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:13.424929 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4936b42c-0b46-4fed-ba56-9cf637c24d92 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:45:13.424929 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4936b42c-0b46-4fed-ba56-9cf637c24d92 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.053501 Oct 17 13:45:13.424929 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1348/2710] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:45:13 2022] POST /compute/v2.1/servers => generated 73 bytes in 55 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 17 13:45:13.435501 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0f1a3dad-d719-4c20-8c46-69df3fcb405c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:13.437182 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0f1a3dad-d719-4c20-8c46-69df3fcb405c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 16213741-2241-4f55-b7ca-20ab551e5596] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:13.453835 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0f1a3dad-d719-4c20-8c46-69df3fcb405c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:13.454397 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0f1a3dad-d719-4c20-8c46-69df3fcb405c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:13.454832 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0f1a3dad-d719-4c20-8c46-69df3fcb405c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:13.456285 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0f1a3dad-d719-4c20-8c46-69df3fcb405c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:13.456751 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0f1a3dad-d719-4c20-8c46-69df3fcb405c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:13.457188 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0f1a3dad-d719-4c20-8c46-69df3fcb405c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:14.255615 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0f1a3dad-d719-4c20-8c46-69df3fcb405c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:14.268412 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0f1a3dad-d719-4c20-8c46-69df3fcb405c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:14.277049 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0f1a3dad-d719-4c20-8c46-69df3fcb405c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:14.281409 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0f1a3dad-d719-4c20-8c46-69df3fcb405c tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596" status: 200 len: 1332 microversion: 2.25 time: 0.860508 Oct 17 13:45:14.283785 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1349/2711] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:45:13 2022] GET /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596 => generated 1332 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:45:14.293637 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-cf1d8770-413b-4964-8a63-2f0874e809ca req-ebe82000-ae89-4384-9233-3e14734ad258 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16213741-2241-4f55-b7ca-20ab551e5596", "name": "network-vif-deleted", "tag": "216dd503-7afa-42cd-aafc-f62df426ee70"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:14.333583 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-cf1d8770-413b-4964-8a63-2f0874e809ca req-ebe82000-ae89-4384-9233-3e14734ad258 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:14.334153 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-cf1d8770-413b-4964-8a63-2f0874e809ca req-ebe82000-ae89-4384-9233-3e14734ad258 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:14.334673 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-cf1d8770-413b-4964-8a63-2f0874e809ca req-ebe82000-ae89-4384-9233-3e14734ad258 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:14.354063 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-cf1d8770-413b-4964-8a63-2f0874e809ca req-ebe82000-ae89-4384-9233-3e14734ad258 service nova] Creating event network-vif-deleted:216dd503-7afa-42cd-aafc-f62df426ee70 for instance 16213741-2241-4f55-b7ca-20ab551e5596 on n-h2-854247-14 Oct 17 13:45:14.369088 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-cf1d8770-413b-4964-8a63-2f0874e809ca req-ebe82000-ae89-4384-9233-3e14734ad258 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082984 Oct 17 13:45:14.369862 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1350/2712] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:45:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:45:14.377919 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3d052b7f-d062-43cf-9e95-bf096ce94b24 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:14.381046 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3d052b7f-d062-43cf-9e95-bf096ce94b24 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:14.389956 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3d052b7f-d062-43cf-9e95-bf096ce94b24 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:14.390955 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3d052b7f-d062-43cf-9e95-bf096ce94b24 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:14.391748 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3d052b7f-d062-43cf-9e95-bf096ce94b24 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:14.393549 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3d052b7f-d062-43cf-9e95-bf096ce94b24 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:14.394241 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3d052b7f-d062-43cf-9e95-bf096ce94b24 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:14.394956 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3d052b7f-d062-43cf-9e95-bf096ce94b24 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:14.458720 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5085b0fb-9f2c-4ce8-96d6-470fa32a6b23 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467250951f654e33b3e233868301bbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676987e95424497c94984347dd6a7988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:14.475284 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5085b0fb-9f2c-4ce8-96d6-470fa32a6b23 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "GET /compute/v2.1/servers/87134cd4-0fff-43ba-b0a3-c4a62e3de5b1" status: 200 len: 1312 microversion: 2.1 time: 1.337126 Oct 17 13:45:14.476612 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1363/2713] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:13 2022] GET /compute/v2.1/servers/87134cd4-0fff-43ba-b0a3-c4a62e3de5b1 => generated 1312 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:14.482387 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cc470959-172e-439e-817c-95c5451ebec0 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:14.483482 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cc470959-172e-439e-817c-95c5451ebec0 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] [instance: 87114af9-1214-4182-8f68-756a1a5dfc7a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:14.498880 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cc470959-172e-439e-817c-95c5451ebec0 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:14.499966 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cc470959-172e-439e-817c-95c5451ebec0 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:14.501113 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cc470959-172e-439e-817c-95c5451ebec0 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:14.502167 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cc470959-172e-439e-817c-95c5451ebec0 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:14.503149 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cc470959-172e-439e-817c-95c5451ebec0 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:14.503836 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cc470959-172e-439e-817c-95c5451ebec0 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:14.563677 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:45:14.860736 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3d052b7f-d062-43cf-9e95-bf096ce94b24 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:14.876323 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3d052b7f-d062-43cf-9e95-bf096ce94b24 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 0.504852 Oct 17 13:45:14.877108 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1351/2714] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:14 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:14.882878 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7790572f-4ff3-439f-853e-b3adb633abad tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:14.884487 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7790572f-4ff3-439f-853e-b3adb633abad tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] [instance: 19575b3d-cba9-4060-9579-9133975767de] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:14.894849 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7790572f-4ff3-439f-853e-b3adb633abad tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:14.896929 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7790572f-4ff3-439f-853e-b3adb633abad tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:14.897558 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7790572f-4ff3-439f-853e-b3adb633abad tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:14.899038 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7790572f-4ff3-439f-853e-b3adb633abad tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:14.900414 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7790572f-4ff3-439f-853e-b3adb633abad tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:14.901052 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7790572f-4ff3-439f-853e-b3adb633abad tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:15.155019 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cc470959-172e-439e-817c-95c5451ebec0 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc1f69cda7724d9bb8a6beec6d4f973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87456dcb963449b2ac1c2d93da0a4ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:15.165710 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cc470959-172e-439e-817c-95c5451ebec0 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "GET /compute/v2.1/servers/87114af9-1214-4182-8f68-756a1a5dfc7a" status: 200 len: 1473 microversion: 2.1 time: 0.687437 Oct 17 13:45:15.169862 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1364/2715] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:14 2022] GET /compute/v2.1/servers/87114af9-1214-4182-8f68-756a1a5dfc7a => generated 1473 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:15.175054 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-98b43bdf-d972-4d1a-acd8-5e780582f514 req-e2512be9-3a0c-4b23-92f4-45fc18030cb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19575b3d-cba9-4060-9579-9133975767de", "name": "network-vif-plugged", "status": "completed", "tag": "87eb4336-0520-4977-b32a-7ee1560f6684"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:15.248148 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-98b43bdf-d972-4d1a-acd8-5e780582f514 req-e2512be9-3a0c-4b23-92f4-45fc18030cb7 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:15.249737 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-98b43bdf-d972-4d1a-acd8-5e780582f514 req-e2512be9-3a0c-4b23-92f4-45fc18030cb7 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:15.250204 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-98b43bdf-d972-4d1a-acd8-5e780582f514 req-e2512be9-3a0c-4b23-92f4-45fc18030cb7 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:15.278893 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-98b43bdf-d972-4d1a-acd8-5e780582f514 req-e2512be9-3a0c-4b23-92f4-45fc18030cb7 service nova] Creating event network-vif-plugged:87eb4336-0520-4977-b32a-7ee1560f6684 for instance 19575b3d-cba9-4060-9579-9133975767de on n-h1-854247-14 Oct 17 13:45:15.300315 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-98b43bdf-d972-4d1a-acd8-5e780582f514 req-e2512be9-3a0c-4b23-92f4-45fc18030cb7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123333 Oct 17 13:45:15.301485 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1365/2716] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:45:15.309076 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-662b32bb-9f2b-4766-ab98-c9ef7b5840c9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:15.314722 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-662b32bb-9f2b-4766-ab98-c9ef7b5840c9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:15.328735 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-662b32bb-9f2b-4766-ab98-c9ef7b5840c9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:15.332657 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-662b32bb-9f2b-4766-ab98-c9ef7b5840c9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:15.333808 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-662b32bb-9f2b-4766-ab98-c9ef7b5840c9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:15.337343 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-662b32bb-9f2b-4766-ab98-c9ef7b5840c9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:15.338047 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-662b32bb-9f2b-4766-ab98-c9ef7b5840c9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:15.338706 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-662b32bb-9f2b-4766-ab98-c9ef7b5840c9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:15.402152 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7790572f-4ff3-439f-853e-b3adb633abad tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75205205ba2946fbb18918201f54e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3126767b1c348859c2640dc21e38f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:15.419561 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7790572f-4ff3-439f-853e-b3adb633abad tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] 10.222.0.79 "GET /compute/v2.1/servers/19575b3d-cba9-4060-9579-9133975767de" status: 200 len: 1317 microversion: 2.1 time: 0.536838 Oct 17 13:45:15.421111 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1352/2717] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:14 2022] GET /compute/v2.1/servers/19575b3d-cba9-4060-9579-9133975767de => generated 1317 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:15.430822 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-e52d1a2c-284a-4ab3-851a-88202ff2f2b6 req-c73a21c6-3e5f-4fe7-9287-437d3c93a7a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87114af9-1214-4182-8f68-756a1a5dfc7a", "name": "network-vif-deleted", "tag": "cde412a7-8204-4c39-8f24-2d2a36d636f9"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:15.472785 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-e52d1a2c-284a-4ab3-851a-88202ff2f2b6 req-c73a21c6-3e5f-4fe7-9287-437d3c93a7a5 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:15.473506 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-e52d1a2c-284a-4ab3-851a-88202ff2f2b6 req-c73a21c6-3e5f-4fe7-9287-437d3c93a7a5 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:15.476157 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-e52d1a2c-284a-4ab3-851a-88202ff2f2b6 req-c73a21c6-3e5f-4fe7-9287-437d3c93a7a5 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:15.488289 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:45:15.508073 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-e52d1a2c-284a-4ab3-851a-88202ff2f2b6 req-c73a21c6-3e5f-4fe7-9287-437d3c93a7a5 service nova] Creating event network-vif-deleted:cde412a7-8204-4c39-8f24-2d2a36d636f9 for instance 87114af9-1214-4182-8f68-756a1a5dfc7a on n-h2-854247-14 Oct 17 13:45:15.517952 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-e52d1a2c-284a-4ab3-851a-88202ff2f2b6 req-c73a21c6-3e5f-4fe7-9287-437d3c93a7a5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095047 Oct 17 13:45:15.519484 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1353/2718] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:45:15.525098 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e75a81d9-5793-40ef-bf7a-544bd894bb25 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:15.526041 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e75a81d9-5793-40ef-bf7a-544bd894bb25 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 16213741-2241-4f55-b7ca-20ab551e5596] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:15.535285 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e75a81d9-5793-40ef-bf7a-544bd894bb25 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:15.536391 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e75a81d9-5793-40ef-bf7a-544bd894bb25 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:15.538046 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e75a81d9-5793-40ef-bf7a-544bd894bb25 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:15.541116 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e75a81d9-5793-40ef-bf7a-544bd894bb25 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:15.542564 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e75a81d9-5793-40ef-bf7a-544bd894bb25 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:15.552102 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e75a81d9-5793-40ef-bf7a-544bd894bb25 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:15.590933 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-e75a81d9-5793-40ef-bf7a-544bd894bb25 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] HTTP exception thrown: Instance 16213741-2241-4f55-b7ca-20ab551e5596 could not be found. Oct 17 13:45:15.593542 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e75a81d9-5793-40ef-bf7a-544bd894bb25 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Request method failure captured: Oct 17 13:45:15.593542 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596 HTTP/1.1 Oct 17 13:45:15.593542 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:45:15.593542 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:45:15.593542 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:45:15.593542 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:45:15.593542 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:45:15.593542 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:45:15.593542 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:45:15.593542 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:45:15.593542 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVqYdRrJYCWyuI_FQz_MllU78A6FgYoAnDA9gdwPauZtaBEX-T7MkFUfKOkAZSrtD_LmO7eB1jtruLn1rwEZOZdhe4hbAiSuVzct5qoO-IV9yMhGhcrR76eqo3706KiWiMqRJoDvSKZaGrDwgOi9uksXK7vrXL2pyT4e4DSq7MSXAPk Oct 17 13:45:15.593542 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:45:15.593542 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:45:15.593542 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:45:15.593542 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:45:15.593542 n-d-854247-14 devstack@n-api.service[127017]: X-Openstack-Nova-Api-Version: 2.25 Oct 17 13:45:15.593542 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:45:15.593542 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:45:15.593542 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 90d4540094b84255821c0ab95304d22a Oct 17 13:45:15.593542 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-404581456 Oct 17 13:45:15.593542 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:45:15.593542 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:45:15.593542 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/90d4540094b84255821c0ab95304d22a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/90d4540094b84255821c0ab95304d22a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/90d4540094b84255821c0ab95304d22a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_90d4540094b84255821c0ab95304d22a", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:45:15.593542 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-404581456 Oct 17 13:45:15.593542 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 90d4540094b84255821c0ab95304d22a Oct 17 13:45:15.593542 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-404581456 Oct 17 13:45:15.593542 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-LiveAutoBlockMigrationV225Test-404581456-project Oct 17 13:45:15.593542 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:45:15.593542 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:45:15.593542 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 5bc3340d39404042af0eca8747874005 Oct 17 13:45:15.593542 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-404581456-project Oct 17 13:45:15.593542 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:45:15.593542 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 16213741-2241-4f55-b7ca-20ab551e5596 could not be found. Oct 17 13:45:15.593542 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '16213741-2241-4f55-b7ca-20ab551e5596'} Oct 17 13:45:15.593542 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:45:15.593542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:15.593542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:45:15.593542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:45:15.593542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:45:15.593542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:45:15.593542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:45:15.593542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:45:15.593542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:45:15.593542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:45:15.593542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16213741-2241-4f55-b7ca-20ab551e5596 could not be found. Oct 17 13:45:15.593542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:15.593542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:15.593542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:15.593542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:15.593542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:15.593542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:15.593542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:45:15.593542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:45:15.593542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:45:15.593542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:45:15.593542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:45:15.593542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:45:15.593542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:45:15.593542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:45:15.593542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:45:15.593542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:45:15.593542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16213741-2241-4f55-b7ca-20ab551e5596 could not be found. Oct 17 13:45:15.593542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:15.597465 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:15.597465 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:15.597465 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:15.597465 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:15.597465 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:15.597465 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:45:15.597465 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:45:15.597465 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16213741-2241-4f55-b7ca-20ab551e5596 could not be found. Oct 17 13:45:15.597465 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:15.599392 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e75a81d9-5793-40ef-bf7a-544bd894bb25 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Returning 404 to user: Instance 16213741-2241-4f55-b7ca-20ab551e5596 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:45:15.600488 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e75a81d9-5793-40ef-bf7a-544bd894bb25 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596" status: 404 len: 111 microversion: 2.25 time: 0.079850 Oct 17 13:45:15.604610 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1354/2719] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:45:15 2022] GET /compute/v2.1/servers/16213741-2241-4f55-b7ca-20ab551e5596 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:45:15.610152 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-66a79801-d391-4488-995a-f2aa50dffa63 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:15.613351 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-66a79801-d391-4488-995a-f2aa50dffa63 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: 87134cd4-0fff-43ba-b0a3-c4a62e3de5b1] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:15.629295 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-66a79801-d391-4488-995a-f2aa50dffa63 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:15.629861 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-66a79801-d391-4488-995a-f2aa50dffa63 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:15.630357 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-66a79801-d391-4488-995a-f2aa50dffa63 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:15.631228 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-66a79801-d391-4488-995a-f2aa50dffa63 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:15.631759 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-66a79801-d391-4488-995a-f2aa50dffa63 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:15.632238 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-66a79801-d391-4488-995a-f2aa50dffa63 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:15.951180 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-662b32bb-9f2b-4766-ab98-c9ef7b5840c9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:15.961401 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-662b32bb-9f2b-4766-ab98-c9ef7b5840c9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 0.658576 Oct 17 13:45:15.976003 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1366/2720] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:15 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:15.977954 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4adcf373-8519-445b-b556-5d66f333f4f3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:15.978459 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4adcf373-8519-445b-b556-5d66f333f4f3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 0ffbef37-e5f8-4de2-a29d-dba6782a3fe4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:15.993533 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4adcf373-8519-445b-b556-5d66f333f4f3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:15.994029 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4adcf373-8519-445b-b556-5d66f333f4f3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:15.994467 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4adcf373-8519-445b-b556-5d66f333f4f3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:15.995290 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4adcf373-8519-445b-b556-5d66f333f4f3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:15.999966 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4adcf373-8519-445b-b556-5d66f333f4f3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:16.000409 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4adcf373-8519-445b-b556-5d66f333f4f3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:16.054860 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4adcf373-8519-445b-b556-5d66f333f4f3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 0ffbef37-e5f8-4de2-a29d-dba6782a3fe4] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:45:16.110932 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-66a79801-d391-4488-995a-f2aa50dffa63 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467250951f654e33b3e233868301bbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676987e95424497c94984347dd6a7988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:16.122582 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-66a79801-d391-4488-995a-f2aa50dffa63 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "GET /compute/v2.1/servers/87134cd4-0fff-43ba-b0a3-c4a62e3de5b1" status: 200 len: 1312 microversion: 2.1 time: 0.516527 Oct 17 13:45:16.125909 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1355/2721] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:15 2022] GET /compute/v2.1/servers/87134cd4-0fff-43ba-b0a3-c4a62e3de5b1 => generated 1312 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:16.131074 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-cf12811d-e827-4fe7-9be8-a4f9e41a6853 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-989369687", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "72be642c-f241-4ddb-80d7-b14a93aa7fc9"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:16.144530 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-cf12811d-e827-4fe7-9be8-a4f9e41a6853 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Request method failure captured: Oct 17 13:45:16.144530 n-d-854247-14 devstack@n-api.service[127017]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:45:16.144530 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:45:16.144530 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:45:16.144530 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:45:16.144530 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 172 Oct 17 13:45:16.144530 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:45:16.144530 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:45:16.144530 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:45:16.144530 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:45:16.144530 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVwEqzYAZh4AkEjRryOAZIhaHrAKxd2Qcal9md8a5n-MMUYSdXmcWYLDVkyQoPrDIbcsApBq2EewemPkBwvNDDOidb0hhc_Z3w9BeEUj5ET_flLYPqO5hgqCsuZGXFiYIEBJxrkx614fXiELZHaNkvhSdsJHShK0w7L-UPHhkPKqi5M Oct 17 13:45:16.144530 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:45:16.144530 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:45:16.144530 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:45:16.144530 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:45:16.144530 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:45:16.144530 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:45:16.144530 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:45:16.144530 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:16.144530 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:45:16.144530 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:45:16.144530 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_59e65f6eb06d40d583b9f43c9af94c13", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:45:16.144530 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:16.144530 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:45:16.144530 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:16.144530 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:45:16.144530 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:45:16.144530 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:45:16.144530 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 443c44b0bd9e4c56a7fe0c1a53238545 Oct 17 13:45:16.144530 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:45:16.144530 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 13:45:16.144530 n-d-854247-14 devstack@n-api.service[127017]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-989369687", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "72be642c-f241-4ddb-80d7-b14a93aa7fc9"}]}} Oct 17 13:45:16.144530 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:45:16.144530 n-d-854247-14 devstack@n-api.service[127017]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 17 13:45:16.144530 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-989369687', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '72be642c-f241-4ddb-80d7-b14a93aa7fc9'}]}}} Oct 17 13:45:16.144530 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:45:16.144530 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:16.144530 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:45:16.144530 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:45:16.144530 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:45:16.144530 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:45:16.144530 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 17 13:45:16.144530 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:16.144530 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 17 13:45:16.144530 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 17 13:45:16.144530 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 17 13:45:16.144530 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:16.144530 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 13:45:16.144530 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi -1 Oct 17 13:45:16.144530 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:16.144530 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:16.144530 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:16.144530 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:16.144530 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:16.144530 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:16.144530 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:45:16.144530 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:45:16.144530 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:45:16.144530 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:45:16.144530 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:45:16.144530 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:45:16.144530 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:45:16.144530 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:45:16.144530 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:45:16.148802 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:45:16.148802 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:45:16.148802 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:45:16.148802 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 17 13:45:16.148802 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:16.148802 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:16.148802 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:16.148802 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:16.148802 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:16.148802 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:16.148802 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:45:16.148802 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:45:16.148802 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 17 13:45:16.148802 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:16.148802 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-cf12811d-e827-4fe7-9be8-a4f9e41a6853 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:45:16.148802 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-cf12811d-e827-4fe7-9be8-a4f9e41a6853 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.018887 Oct 17 13:45:16.152117 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1356/2722] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:45:16 2022] POST /compute/v2.1/servers => generated 145 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:45:16.158261 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-33f4d314-8779-4deb-8ea6-fb68d5116d74 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:16.161127 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-33f4d314-8779-4deb-8ea6-fb68d5116d74 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:16.172783 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-33f4d314-8779-4deb-8ea6-fb68d5116d74 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:16.173695 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-33f4d314-8779-4deb-8ea6-fb68d5116d74 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:16.174301 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-33f4d314-8779-4deb-8ea6-fb68d5116d74 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:16.175282 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-33f4d314-8779-4deb-8ea6-fb68d5116d74 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:16.176071 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-33f4d314-8779-4deb-8ea6-fb68d5116d74 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:16.176778 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-33f4d314-8779-4deb-8ea6-fb68d5116d74 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:16.271135 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4adcf373-8519-445b-b556-5d66f333f4f3 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "DELETE /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4" status: 204 len: 0 microversion: 2.25 time: 0.307811 Oct 17 13:45:16.271751 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1367/2723] 10.222.0.79 () {60 vars in 1280 bytes} [Mon Oct 17 13:45:15 2022] DELETE /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:45:16.277364 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fc5f8982-f05d-4ecc-8627-6baae18941a3 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:16.278085 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-fc5f8982-f05d-4ecc-8627-6baae18941a3 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] [instance: 87114af9-1214-4182-8f68-756a1a5dfc7a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:16.292242 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fc5f8982-f05d-4ecc-8627-6baae18941a3 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:16.292751 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fc5f8982-f05d-4ecc-8627-6baae18941a3 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:16.293216 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fc5f8982-f05d-4ecc-8627-6baae18941a3 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:16.294051 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fc5f8982-f05d-4ecc-8627-6baae18941a3 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:16.294528 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fc5f8982-f05d-4ecc-8627-6baae18941a3 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:16.294997 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fc5f8982-f05d-4ecc-8627-6baae18941a3 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:16.329443 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-fc5f8982-f05d-4ecc-8627-6baae18941a3 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] HTTP exception thrown: Instance 87114af9-1214-4182-8f68-756a1a5dfc7a could not be found. Oct 17 13:45:16.332639 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fc5f8982-f05d-4ecc-8627-6baae18941a3 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Request method failure captured: Oct 17 13:45:16.332639 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/87114af9-1214-4182-8f68-756a1a5dfc7a HTTP/1.1 Oct 17 13:45:16.332639 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:45:16.332639 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:45:16.332639 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:45:16.332639 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:45:16.332639 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:45:16.332639 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:45:16.332639 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:45:16.332639 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:45:16.332639 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVv5BiKexrKvNbOl9A5FHtFV5mHehkwNbAoSAIsxyajSewiHDmmi2twNZBXlpujzoA265PfVkE-1IwZZm0IyESrVBaD0vciWX3eiruV4FpvSfn-F31Q-fvzCfNuXByY4yUholHF08eDyDs0t57RjfWJ2DQ1A52B7Q_xuIach-5Oj8eY Oct 17 13:45:16.332639 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:45:16.332639 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:45:16.332639 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:45:16.332639 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:45:16.332639 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:45:16.332639 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:45:16.332639 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 87456dcb963449b2ac1c2d93da0a4ec7 Oct 17 13:45:16.332639 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ImagesOneServerTestJSON-921891472 Oct 17 13:45:16.332639 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:45:16.332639 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:45:16.332639 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/87456dcb963449b2ac1c2d93da0a4ec7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/87456dcb963449b2ac1c2d93da0a4ec7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/87456dcb963449b2ac1c2d93da0a4ec7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_87456dcb963449b2ac1c2d93da0a4ec7", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:45:16.332639 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ImagesOneServerTestJSON-921891472 Oct 17 13:45:16.332639 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 87456dcb963449b2ac1c2d93da0a4ec7 Oct 17 13:45:16.332639 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-921891472 Oct 17 13:45:16.332639 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ImagesOneServerTestJSON-921891472-project Oct 17 13:45:16.332639 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:45:16.332639 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:45:16.332639 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: dc1f69cda7724d9bb8a6beec6d4f973e Oct 17 13:45:16.332639 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ImagesOneServerTestJSON-921891472-project Oct 17 13:45:16.332639 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:45:16.332639 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 87114af9-1214-4182-8f68-756a1a5dfc7a could not be found. Oct 17 13:45:16.332639 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '87114af9-1214-4182-8f68-756a1a5dfc7a'} Oct 17 13:45:16.332639 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:45:16.332639 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:16.332639 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:45:16.332639 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:45:16.332639 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:45:16.332639 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:45:16.332639 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:45:16.332639 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:45:16.332639 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:45:16.332639 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:45:16.332639 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87114af9-1214-4182-8f68-756a1a5dfc7a could not be found. Oct 17 13:45:16.332639 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:16.332639 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:16.332639 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:16.332639 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:16.332639 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:16.332639 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:16.332639 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:45:16.332639 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:45:16.332639 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:45:16.332639 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:45:16.332639 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:45:16.332639 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:45:16.332639 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:45:16.332639 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:45:16.332639 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:45:16.332639 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:45:16.332639 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87114af9-1214-4182-8f68-756a1a5dfc7a could not be found. Oct 17 13:45:16.332639 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:16.332639 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:16.332639 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:16.336535 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:16.336535 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:16.336535 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:16.336535 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:45:16.336535 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:45:16.336535 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87114af9-1214-4182-8f68-756a1a5dfc7a could not be found. Oct 17 13:45:16.336535 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:16.340334 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fc5f8982-f05d-4ecc-8627-6baae18941a3 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] Returning 404 to user: Instance 87114af9-1214-4182-8f68-756a1a5dfc7a could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:45:16.341685 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fc5f8982-f05d-4ecc-8627-6baae18941a3 tempest-ImagesOneServerTestJSON-921891472 tempest-ImagesOneServerTestJSON-921891472-project] 10.222.0.79 "GET /compute/v2.1/servers/87114af9-1214-4182-8f68-756a1a5dfc7a" status: 404 len: 111 microversion: 2.1 time: 0.068389 Oct 17 13:45:16.342759 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1368/2724] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:16 2022] GET /compute/v2.1/servers/87114af9-1214-4182-8f68-756a1a5dfc7a => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:45:16.351766 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-aa78ca91-be96-495c-86c1-a505093d01d1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:16.352672 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-aa78ca91-be96-495c-86c1-a505093d01d1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 0ffbef37-e5f8-4de2-a29d-dba6782a3fe4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:16.386998 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aa78ca91-be96-495c-86c1-a505093d01d1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:16.388059 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aa78ca91-be96-495c-86c1-a505093d01d1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:16.388753 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aa78ca91-be96-495c-86c1-a505093d01d1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:16.394298 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aa78ca91-be96-495c-86c1-a505093d01d1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:16.394732 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aa78ca91-be96-495c-86c1-a505093d01d1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:16.395134 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aa78ca91-be96-495c-86c1-a505093d01d1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:16.810094 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-33f4d314-8779-4deb-8ea6-fb68d5116d74 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:16.826549 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-33f4d314-8779-4deb-8ea6-fb68d5116d74 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 0.671037 Oct 17 13:45:16.840700 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1357/2725] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:16 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:16.846768 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f0f5ad3d-b655-4ec7-be4e-24344fa4d116 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:16.846768 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f0f5ad3d-b655-4ec7-be4e-24344fa4d116 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] [instance: 19575b3d-cba9-4060-9579-9133975767de] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:16.867479 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f0f5ad3d-b655-4ec7-be4e-24344fa4d116 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:16.874716 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f0f5ad3d-b655-4ec7-be4e-24344fa4d116 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:16.877061 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f0f5ad3d-b655-4ec7-be4e-24344fa4d116 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:16.879148 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f0f5ad3d-b655-4ec7-be4e-24344fa4d116 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:16.881208 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f0f5ad3d-b655-4ec7-be4e-24344fa4d116 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:16.882892 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f0f5ad3d-b655-4ec7-be4e-24344fa4d116 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:16.922166 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:45:16.989354 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=6 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:45:17.233695 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-aa78ca91-be96-495c-86c1-a505093d01d1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:17.243796 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-aa78ca91-be96-495c-86c1-a505093d01d1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:17.256195 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-aa78ca91-be96-495c-86c1-a505093d01d1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:17.258092 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-aa78ca91-be96-495c-86c1-a505093d01d1 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4" status: 200 len: 1564 microversion: 2.25 time: 0.913574 Oct 17 13:45:17.259192 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1369/2726] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:45:16 2022] GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4 => generated 1564 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:45:17.285796 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2e3d323c-2096-4cc0-8678-1487afbf0805 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:17.286433 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2e3d323c-2096-4cc0-8678-1487afbf0805 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:17.304898 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2e3d323c-2096-4cc0-8678-1487afbf0805 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:17.305689 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2e3d323c-2096-4cc0-8678-1487afbf0805 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:17.306281 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2e3d323c-2096-4cc0-8678-1487afbf0805 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:17.307144 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2e3d323c-2096-4cc0-8678-1487afbf0805 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:17.307759 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2e3d323c-2096-4cc0-8678-1487afbf0805 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:17.308344 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2e3d323c-2096-4cc0-8678-1487afbf0805 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:17.524017 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:45:17.629043 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f0f5ad3d-b655-4ec7-be4e-24344fa4d116 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75205205ba2946fbb18918201f54e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3126767b1c348859c2640dc21e38f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:17.638144 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f0f5ad3d-b655-4ec7-be4e-24344fa4d116 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] 10.222.0.79 "GET /compute/v2.1/servers/19575b3d-cba9-4060-9579-9133975767de" status: 200 len: 1317 microversion: 2.1 time: 0.806689 Oct 17 13:45:17.639609 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1358/2727] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:16 2022] GET /compute/v2.1/servers/19575b3d-cba9-4060-9579-9133975767de => generated 1317 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:17.645284 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c732e4d0-0824-4a62-8918-610ca23b3dd5 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:17.646287 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c732e4d0-0824-4a62-8918-610ca23b3dd5 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: 87134cd4-0fff-43ba-b0a3-c4a62e3de5b1] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:17.653135 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c732e4d0-0824-4a62-8918-610ca23b3dd5 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:17.653993 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c732e4d0-0824-4a62-8918-610ca23b3dd5 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:17.654902 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c732e4d0-0824-4a62-8918-610ca23b3dd5 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:17.655898 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c732e4d0-0824-4a62-8918-610ca23b3dd5 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:17.656571 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c732e4d0-0824-4a62-8918-610ca23b3dd5 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:17.657206 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c732e4d0-0824-4a62-8918-610ca23b3dd5 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:17.835950 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2e3d323c-2096-4cc0-8678-1487afbf0805 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:17.846612 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2e3d323c-2096-4cc0-8678-1487afbf0805 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 0.585994 Oct 17 13:45:17.847094 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1370/2728] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:17 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:17.866411 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-809c7fa3-3537-4a65-bd4e-61b4bd7bee3c req-42af1fba-cc09-43a9-bcb4-a3caec4d4a6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d58e9993-1b03-44b7-b27a-5ed4e7ee8232", "name": "network-vif-plugged", "status": "completed", "tag": "f9564d02-3199-4bb0-909a-2be1f47a28a6"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:17.886428 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-809c7fa3-3537-4a65-bd4e-61b4bd7bee3c req-42af1fba-cc09-43a9-bcb4-a3caec4d4a6d service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:17.886985 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-809c7fa3-3537-4a65-bd4e-61b4bd7bee3c req-42af1fba-cc09-43a9-bcb4-a3caec4d4a6d service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:17.887458 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-809c7fa3-3537-4a65-bd4e-61b4bd7bee3c req-42af1fba-cc09-43a9-bcb4-a3caec4d4a6d service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:17.935783 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-809c7fa3-3537-4a65-bd4e-61b4bd7bee3c req-42af1fba-cc09-43a9-bcb4-a3caec4d4a6d service nova] Creating event network-vif-plugged:f9564d02-3199-4bb0-909a-2be1f47a28a6 for instance d58e9993-1b03-44b7-b27a-5ed4e7ee8232 on n-h1-854247-14 Oct 17 13:45:17.945788 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-809c7fa3-3537-4a65-bd4e-61b4bd7bee3c req-42af1fba-cc09-43a9-bcb4-a3caec4d4a6d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087106 Oct 17 13:45:17.946954 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1371/2729] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:45:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:45:18.086805 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-97d5c203-bcab-404c-944f-0017bd630955 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1056635701", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:18.102178 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-97d5c203-bcab-404c-944f-0017bd630955 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 17 13:45:18.109442 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-97d5c203-bcab-404c-944f-0017bd630955 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Request method failure captured: Oct 17 13:45:18.109442 n-d-854247-14 devstack@n-api.service[127016]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:45:18.109442 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:45:18.109442 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:45:18.109442 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:45:18.109442 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 216 Oct 17 13:45:18.109442 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:45:18.109442 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:45:18.109442 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:45:18.109442 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:45:18.109442 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVwEqzYAZh4AkEjRryOAZIhaHrAKxd2Qcal9md8a5n-MMUYSdXmcWYLDVkyQoPrDIbcsApBq2EewemPkBwvNDDOidb0hhc_Z3w9BeEUj5ET_flLYPqO5hgqCsuZGXFiYIEBJxrkx614fXiELZHaNkvhSdsJHShK0w7L-UPHhkPKqi5M Oct 17 13:45:18.109442 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:45:18.109442 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:45:18.109442 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:45:18.109442 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:45:18.109442 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:45:18.109442 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:45:18.109442 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:45:18.109442 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:18.109442 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:45:18.109442 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:45:18.109442 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_59e65f6eb06d40d583b9f43c9af94c13", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:45:18.109442 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:18.109442 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:45:18.109442 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:18.109442 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:45:18.109442 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:45:18.109442 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:45:18.109442 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 443c44b0bd9e4c56a7fe0c1a53238545 Oct 17 13:45:18.109442 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:45:18.109442 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:45:18.109442 n-d-854247-14 devstack@n-api.service[127016]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1056635701", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 17 13:45:18.109442 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:45:18.109442 n-d-854247-14 devstack@n-api.service[127016]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 17 13:45:18.109442 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1056635701', 'imageRef': '0743b21b-a6ff-4d02-897c-eabb68c3ba07', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 17 13:45:18.109442 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:45:18.109442 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:18.109442 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:18.109442 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:18.109442 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:45:18.109442 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:45:18.109442 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:45:18.109442 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:45:18.109442 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:45:18.109442 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:45:18.109442 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:45:18.109442 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:45:18.109442 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:45:18.109442 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:45:18.109442 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 17 13:45:18.109442 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 17 13:45:18.109442 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 17 13:45:18.109442 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 17 13:45:18.109442 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 17 13:45:18.109442 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 17 13:45:18.109442 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 17 13:45:18.109442 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 17 13:45:18.109442 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 17 13:45:18.109442 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 17 13:45:18.109442 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:18.109442 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:18.115820 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:18.115820 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:18.115820 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:18.115820 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:18.115820 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:45:18.115820 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:45:18.115820 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 17 13:45:18.115820 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:18.119515 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-97d5c203-bcab-404c-944f-0017bd630955 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:45:18.125357 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-97d5c203-bcab-404c-944f-0017bd630955 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.040733 Oct 17 13:45:18.130812 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1372/2730] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:45:18 2022] POST /compute/v2.1/servers => generated 123 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:45:18.145354 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ab6b2095-1851-4415-9580-5da71d3314c6 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:18.148551 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ab6b2095-1851-4415-9580-5da71d3314c6 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:18.165843 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ab6b2095-1851-4415-9580-5da71d3314c6 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:18.166258 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ab6b2095-1851-4415-9580-5da71d3314c6 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:18.166705 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ab6b2095-1851-4415-9580-5da71d3314c6 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:18.167467 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ab6b2095-1851-4415-9580-5da71d3314c6 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:18.167915 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ab6b2095-1851-4415-9580-5da71d3314c6 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:18.168343 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ab6b2095-1851-4415-9580-5da71d3314c6 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:18.359063 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c732e4d0-0824-4a62-8918-610ca23b3dd5 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467250951f654e33b3e233868301bbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676987e95424497c94984347dd6a7988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:18.372537 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c732e4d0-0824-4a62-8918-610ca23b3dd5 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "GET /compute/v2.1/servers/87134cd4-0fff-43ba-b0a3-c4a62e3de5b1" status: 200 len: 1333 microversion: 2.1 time: 0.730759 Oct 17 13:45:18.375593 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1359/2731] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:17 2022] GET /compute/v2.1/servers/87134cd4-0fff-43ba-b0a3-c4a62e3de5b1 => generated 1333 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:18.391776 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ec420f48-8af3-403b-92b3-f72e832829e7 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:18.392324 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ec420f48-8af3-403b-92b3-f72e832829e7 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 0ffbef37-e5f8-4de2-a29d-dba6782a3fe4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:18.399490 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ec420f48-8af3-403b-92b3-f72e832829e7 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:18.399843 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ec420f48-8af3-403b-92b3-f72e832829e7 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:18.400593 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ec420f48-8af3-403b-92b3-f72e832829e7 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:18.402192 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ec420f48-8af3-403b-92b3-f72e832829e7 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:18.402748 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ec420f48-8af3-403b-92b3-f72e832829e7 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:18.403202 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ec420f48-8af3-403b-92b3-f72e832829e7 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:18.731493 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ab6b2095-1851-4415-9580-5da71d3314c6 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:18.745074 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ab6b2095-1851-4415-9580-5da71d3314c6 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 0.611576 Oct 17 13:45:18.759967 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1373/2732] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:18 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:18.768992 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-419f845c-8e6d-4e00-a53f-026b2c815eaf tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:18.770036 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-419f845c-8e6d-4e00-a53f-026b2c815eaf tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] [instance: 19575b3d-cba9-4060-9579-9133975767de] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:18.778503 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-419f845c-8e6d-4e00-a53f-026b2c815eaf tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:18.779007 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-419f845c-8e6d-4e00-a53f-026b2c815eaf tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:18.779602 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-419f845c-8e6d-4e00-a53f-026b2c815eaf tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:18.780604 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-419f845c-8e6d-4e00-a53f-026b2c815eaf tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:18.781287 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-419f845c-8e6d-4e00-a53f-026b2c815eaf tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:18.781854 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-419f845c-8e6d-4e00-a53f-026b2c815eaf tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:18.926908 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ec420f48-8af3-403b-92b3-f72e832829e7 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:18.937261 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ec420f48-8af3-403b-92b3-f72e832829e7 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:18.938733 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ec420f48-8af3-403b-92b3-f72e832829e7 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5bc3340d39404042af0eca8747874005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d4540094b84255821c0ab95304d22a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:18.941217 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ec420f48-8af3-403b-92b3-f72e832829e7 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4" status: 200 len: 1564 microversion: 2.25 time: 0.562292 Oct 17 13:45:18.956204 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1360/2733] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:45:18 2022] GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4 => generated 1564 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:45:18.970345 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-73cd855e-d7c2-4419-9757-fc3142790c97 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:18.971384 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-73cd855e-d7c2-4419-9757-fc3142790c97 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:18.977670 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-73cd855e-d7c2-4419-9757-fc3142790c97 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:18.978397 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-73cd855e-d7c2-4419-9757-fc3142790c97 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:18.978993 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-73cd855e-d7c2-4419-9757-fc3142790c97 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:18.979998 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-73cd855e-d7c2-4419-9757-fc3142790c97 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:18.980600 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-73cd855e-d7c2-4419-9757-fc3142790c97 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:18.981198 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-73cd855e-d7c2-4419-9757-fc3142790c97 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:19.783012 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-419f845c-8e6d-4e00-a53f-026b2c815eaf tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75205205ba2946fbb18918201f54e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3126767b1c348859c2640dc21e38f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:19.793403 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-419f845c-8e6d-4e00-a53f-026b2c815eaf tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] 10.222.0.79 "GET /compute/v2.1/servers/19575b3d-cba9-4060-9579-9133975767de" status: 200 len: 1504 microversion: 2.1 time: 1.031929 Oct 17 13:45:19.808121 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-73cd855e-d7c2-4419-9757-fc3142790c97 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:19.808653 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1374/2734] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:18 2022] GET /compute/v2.1/servers/19575b3d-cba9-4060-9579-9133975767de => generated 1504 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:19.820111 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-1ebacfe6-655e-48cd-a807-af253acab511 req-99261333-3230-4e51-931a-327121e188ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ffbef37-e5f8-4de2-a29d-dba6782a3fe4", "name": "network-vif-deleted", "tag": "f6d4c8b6-ba32-4306-822c-cf94066fc47e"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:19.822002 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-73cd855e-d7c2-4419-9757-fc3142790c97 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 0.863601 Oct 17 13:45:19.822673 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1361/2735] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:18 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:19.831038 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-1ebacfe6-655e-48cd-a807-af253acab511 req-99261333-3230-4e51-931a-327121e188ee service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:19.831560 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-1ebacfe6-655e-48cd-a807-af253acab511 req-99261333-3230-4e51-931a-327121e188ee service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:19.832189 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-1ebacfe6-655e-48cd-a807-af253acab511 req-99261333-3230-4e51-931a-327121e188ee service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:19.835494 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3ed4a13a-10fd-46fe-ab39-afd918ce49ab tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:19.836126 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3ed4a13a-10fd-46fe-ab39-afd918ce49ab tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: 87134cd4-0fff-43ba-b0a3-c4a62e3de5b1] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:19.846198 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-1ebacfe6-655e-48cd-a807-af253acab511 req-99261333-3230-4e51-931a-327121e188ee service nova] Creating event network-vif-deleted:f6d4c8b6-ba32-4306-822c-cf94066fc47e for instance 0ffbef37-e5f8-4de2-a29d-dba6782a3fe4 on n-h2-854247-14 Oct 17 13:45:19.846549 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3ed4a13a-10fd-46fe-ab39-afd918ce49ab tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:19.847047 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3ed4a13a-10fd-46fe-ab39-afd918ce49ab tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:19.854828 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-1ebacfe6-655e-48cd-a807-af253acab511 req-99261333-3230-4e51-931a-327121e188ee service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043687 Oct 17 13:45:19.855740 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1375/2736] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:45:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:45:19.863729 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3ed4a13a-10fd-46fe-ab39-afd918ce49ab tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:19.864790 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3ed4a13a-10fd-46fe-ab39-afd918ce49ab tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:19.865517 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3ed4a13a-10fd-46fe-ab39-afd918ce49ab tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:19.866157 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3ed4a13a-10fd-46fe-ab39-afd918ce49ab tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:20.060649 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a99440e2-19a7-48a4-9712-c5d201004b35 tempest-KeyPairsV2TestJSON-1963779671 tempest-KeyPairsV2TestJSON-1963779671-project] Action: 'create', calling method: .version_select at 0x7f7cd9811b80>, body: {"keypair": {"name": "tempest-keypair-91262738", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+D7P331UZ9BYIdtD6IVnXwyF9/8TULGPc25F/9oitMyUGp6eqJ6uyHAvWd9BbNwRzgbyliJl4/dlSeY4umo31GbnG/M0V2amMp6eyPmXfGGP4KPJrE9ZbAlQLDlmff8g=="}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:20.102892 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-a99440e2-19a7-48a4-9712-c5d201004b35 tempest-KeyPairsV2TestJSON-1963779671 tempest-KeyPairsV2TestJSON-1963779671-project] Getting quotas for project b7f567e85ede485baa553594340213b0. Resources: {'key_pairs'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:45:20.114190 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3ed4a13a-10fd-46fe-ab39-afd918ce49ab tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467250951f654e33b3e233868301bbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676987e95424497c94984347dd6a7988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:20.114779 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-a99440e2-19a7-48a4-9712-c5d201004b35 tempest-KeyPairsV2TestJSON-1963779671 tempest-KeyPairsV2TestJSON-1963779671-project] Getting quotas for user 7f445d1348b14b5c808e7be00ec7416e and project b7f567e85ede485baa553594340213b0. Resources: {'key_pairs'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:45:20.127399 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3ed4a13a-10fd-46fe-ab39-afd918ce49ab tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "GET /compute/v2.1/servers/87134cd4-0fff-43ba-b0a3-c4a62e3de5b1" status: 200 len: 1333 microversion: 2.1 time: 0.303467 Oct 17 13:45:20.130953 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1362/2737] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:19 2022] GET /compute/v2.1/servers/87134cd4-0fff-43ba-b0a3-c4a62e3de5b1 => generated 1333 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:20.140959 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ea4f8c4f-a877-4a51-9e12-95f146101933 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:20.154700 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ea4f8c4f-a877-4a51-9e12-95f146101933 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] [instance: d58e9993-1b03-44b7-b27a-5ed4e7ee8232] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:20.162316 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ea4f8c4f-a877-4a51-9e12-95f146101933 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:20.164162 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ea4f8c4f-a877-4a51-9e12-95f146101933 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:20.165060 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ea4f8c4f-a877-4a51-9e12-95f146101933 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:20.166037 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ea4f8c4f-a877-4a51-9e12-95f146101933 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:20.167831 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ea4f8c4f-a877-4a51-9e12-95f146101933 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:20.168506 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ea4f8c4f-a877-4a51-9e12-95f146101933 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:20.175663 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a99440e2-19a7-48a4-9712-c5d201004b35 tempest-KeyPairsV2TestJSON-1963779671 tempest-KeyPairsV2TestJSON-1963779671-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.318429 Oct 17 13:45:20.176298 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1376/2738] 10.222.0.79 () {60 vars in 1159 bytes} [Mon Oct 17 13:45:19 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:45:20.187461 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1f0cc109-19de-4ff9-a786-2fb17713cef8 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:20.188225 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-1f0cc109-19de-4ff9-a786-2fb17713cef8 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] [instance: 0ffbef37-e5f8-4de2-a29d-dba6782a3fe4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:20.203847 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1f0cc109-19de-4ff9-a786-2fb17713cef8 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:20.204247 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1f0cc109-19de-4ff9-a786-2fb17713cef8 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:20.205618 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1f0cc109-19de-4ff9-a786-2fb17713cef8 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:20.206546 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1f0cc109-19de-4ff9-a786-2fb17713cef8 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:20.211861 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1f0cc109-19de-4ff9-a786-2fb17713cef8 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:20.212318 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1f0cc109-19de-4ff9-a786-2fb17713cef8 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:20.229171 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-1f0cc109-19de-4ff9-a786-2fb17713cef8 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] HTTP exception thrown: Instance 0ffbef37-e5f8-4de2-a29d-dba6782a3fe4 could not be found. Oct 17 13:45:20.231396 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1f0cc109-19de-4ff9-a786-2fb17713cef8 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Request method failure captured: Oct 17 13:45:20.231396 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4 HTTP/1.1 Oct 17 13:45:20.231396 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:45:20.231396 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:45:20.231396 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:45:20.231396 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:45:20.231396 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:45:20.231396 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:45:20.231396 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:45:20.231396 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:45:20.231396 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVqYdRrJYCWyuI_FQz_MllU78A6FgYoAnDA9gdwPauZtaBEX-T7MkFUfKOkAZSrtD_LmO7eB1jtruLn1rwEZOZdhe4hbAiSuVzct5qoO-IV9yMhGhcrR76eqo3706KiWiMqRJoDvSKZaGrDwgOi9uksXK7vrXL2pyT4e4DSq7MSXAPk Oct 17 13:45:20.231396 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:45:20.231396 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:45:20.231396 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:45:20.231396 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:45:20.231396 n-d-854247-14 devstack@n-api.service[127016]: X-Openstack-Nova-Api-Version: 2.25 Oct 17 13:45:20.231396 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:45:20.231396 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:45:20.231396 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 90d4540094b84255821c0ab95304d22a Oct 17 13:45:20.231396 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-404581456 Oct 17 13:45:20.231396 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:45:20.231396 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:45:20.231396 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/90d4540094b84255821c0ab95304d22a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/90d4540094b84255821c0ab95304d22a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/90d4540094b84255821c0ab95304d22a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_90d4540094b84255821c0ab95304d22a", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:45:20.231396 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-404581456 Oct 17 13:45:20.231396 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 90d4540094b84255821c0ab95304d22a Oct 17 13:45:20.231396 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-404581456 Oct 17 13:45:20.231396 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-LiveAutoBlockMigrationV225Test-404581456-project Oct 17 13:45:20.231396 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:45:20.231396 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:45:20.231396 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 5bc3340d39404042af0eca8747874005 Oct 17 13:45:20.231396 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-404581456-project Oct 17 13:45:20.231396 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:45:20.231396 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 0ffbef37-e5f8-4de2-a29d-dba6782a3fe4 could not be found. Oct 17 13:45:20.231396 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '0ffbef37-e5f8-4de2-a29d-dba6782a3fe4'} Oct 17 13:45:20.231396 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:45:20.231396 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:20.231396 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:45:20.231396 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:45:20.231396 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:45:20.231396 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:45:20.231396 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:45:20.231396 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:45:20.231396 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:45:20.231396 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:45:20.231396 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ffbef37-e5f8-4de2-a29d-dba6782a3fe4 could not be found. Oct 17 13:45:20.231396 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:20.231396 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:20.231396 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:20.231396 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:20.231396 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:20.231396 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:20.231396 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:45:20.231396 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:45:20.231396 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:45:20.231396 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:45:20.231396 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:45:20.231396 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:45:20.231396 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:45:20.231396 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:45:20.231396 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:45:20.231396 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:45:20.231396 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ffbef37-e5f8-4de2-a29d-dba6782a3fe4 could not be found. Oct 17 13:45:20.231396 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:20.235088 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:20.235088 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:20.235088 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:20.235088 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:20.235088 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:20.235088 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:45:20.235088 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:45:20.235088 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ffbef37-e5f8-4de2-a29d-dba6782a3fe4 could not be found. Oct 17 13:45:20.235088 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:20.236710 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1f0cc109-19de-4ff9-a786-2fb17713cef8 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] Returning 404 to user: Instance 0ffbef37-e5f8-4de2-a29d-dba6782a3fe4 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:45:20.237815 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1f0cc109-19de-4ff9-a786-2fb17713cef8 tempest-LiveAutoBlockMigrationV225Test-404581456 tempest-LiveAutoBlockMigrationV225Test-404581456-project] 10.222.0.79 "GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4" status: 404 len: 111 microversion: 2.25 time: 0.054739 Oct 17 13:45:20.238569 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1377/2739] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:45:20 2022] GET /compute/v2.1/servers/0ffbef37-e5f8-4de2-a29d-dba6782a3fe4 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:45:20.243849 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5c1da92b-f5fb-4660-8c09-f950bc336626 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-270383728", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "key_name": "tempest-key-433337698", "networks": [{"uuid": "72be642c-f241-4ddb-80d7-b14a93aa7fc9"}]}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:20.322414 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-5c1da92b-f5fb-4660-8c09-f950bc336626 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] validate_networks() for [('72be642c-f241-4ddb-80d7-b14a93aa7fc9', None, None, None, None, None)] {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:45:20.532818 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ea4f8c4f-a877-4a51-9e12-95f146101933 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75205205ba2946fbb18918201f54e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3126767b1c348859c2640dc21e38f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:20.544843 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ea4f8c4f-a877-4a51-9e12-95f146101933 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] 10.222.0.79 "GET /compute/v2.1/servers/d58e9993-1b03-44b7-b27a-5ed4e7ee8232" status: 200 len: 1505 microversion: 2.1 time: 0.412391 Oct 17 13:45:20.545721 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1363/2740] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:20 2022] GET /compute/v2.1/servers/d58e9993-1b03-44b7-b27a-5ed4e7ee8232 => generated 1505 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:20.564357 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-91053705-27f1-4ee2-ac74-8406dd4942e3 tempest-KeyPairsV2TestJSON-1963779671 tempest-KeyPairsV2TestJSON-1963779671-project] Calling method '.version_select at 0x7f7cd49ac0d0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:20.587347 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-91053705-27f1-4ee2-ac74-8406dd4942e3 tempest-KeyPairsV2TestJSON-1963779671 tempest-KeyPairsV2TestJSON-1963779671-project] 10.222.0.79 "GET /compute/v2.1/os-keypairs/tempest-keypair-91262738" status: 200 len: 496 microversion: 2.1 time: 0.039242 Oct 17 13:45:20.593122 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1364/2741] 10.222.0.79 () {58 vars in 1212 bytes} [Mon Oct 17 13:45:20 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-91262738 => generated 496 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:45:20.607180 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1ffa7200-2987-4e32-a068-a448e67f7ed2 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:20.609733 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1ffa7200-2987-4e32-a068-a448e67f7ed2 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] [instance: d58e9993-1b03-44b7-b27a-5ed4e7ee8232] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:20.630916 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1ffa7200-2987-4e32-a068-a448e67f7ed2 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:20.631855 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1ffa7200-2987-4e32-a068-a448e67f7ed2 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:20.632530 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1ffa7200-2987-4e32-a068-a448e67f7ed2 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:20.635959 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1ffa7200-2987-4e32-a068-a448e67f7ed2 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:20.637413 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1ffa7200-2987-4e32-a068-a448e67f7ed2 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:20.638327 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1ffa7200-2987-4e32-a068-a448e67f7ed2 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:20.679619 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1ffa7200-2987-4e32-a068-a448e67f7ed2 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] [instance: d58e9993-1b03-44b7-b27a-5ed4e7ee8232] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:45:20.783753 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:45:20.792656 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1ffa7200-2987-4e32-a068-a448e67f7ed2 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] 10.222.0.79 "DELETE /compute/v2.1/servers/d58e9993-1b03-44b7-b27a-5ed4e7ee8232" status: 204 len: 0 microversion: 2.1 time: 0.196914 Oct 17 13:45:20.794227 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1365/2742] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:45:20 2022] DELETE /compute/v2.1/servers/d58e9993-1b03-44b7-b27a-5ed4e7ee8232 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:45:20.803835 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f59f65a8-f757-4ed7-be73-d204e84e4568 tempest-KeyPairsV2TestJSON-1963779671 tempest-KeyPairsV2TestJSON-1963779671-project] Calling method '.version_select at 0x7f7cd4a431f0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:20.831737 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f59f65a8-f757-4ed7-be73-d204e84e4568 tempest-KeyPairsV2TestJSON-1963779671 tempest-KeyPairsV2TestJSON-1963779671-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-91262738" status: 202 len: 0 microversion: 2.1 time: 0.035686 Oct 17 13:45:20.832387 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1366/2743] 10.222.0.79 () {58 vars in 1215 bytes} [Mon Oct 17 13:45:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-91262738 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:45:20.841522 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e5cf58b1-3c60-4870-971e-f87a68c4b325 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:20.842586 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e5cf58b1-3c60-4870-971e-f87a68c4b325 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] [instance: 19575b3d-cba9-4060-9579-9133975767de] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:20.854162 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e5cf58b1-3c60-4870-971e-f87a68c4b325 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:20.855358 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e5cf58b1-3c60-4870-971e-f87a68c4b325 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:20.856053 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e5cf58b1-3c60-4870-971e-f87a68c4b325 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:20.857061 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e5cf58b1-3c60-4870-971e-f87a68c4b325 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:20.858048 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e5cf58b1-3c60-4870-971e-f87a68c4b325 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:20.859414 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e5cf58b1-3c60-4870-971e-f87a68c4b325 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:20.905774 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e5cf58b1-3c60-4870-971e-f87a68c4b325 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] [instance: 19575b3d-cba9-4060-9579-9133975767de] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:45:20.933100 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-5c1da92b-f5fb-4660-8c09-f950bc336626 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] HTTP exception thrown: Invalid key_name provided. Oct 17 13:45:20.934942 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5c1da92b-f5fb-4660-8c09-f950bc336626 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Request method failure captured: Oct 17 13:45:20.934942 n-d-854247-14 devstack@n-api.service[127016]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:45:20.934942 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:45:20.934942 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:45:20.934942 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:45:20.934942 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 245 Oct 17 13:45:20.934942 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:45:20.934942 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:45:20.934942 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:45:20.934942 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:45:20.934942 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVwEqzYAZh4AkEjRryOAZIhaHrAKxd2Qcal9md8a5n-MMUYSdXmcWYLDVkyQoPrDIbcsApBq2EewemPkBwvNDDOidb0hhc_Z3w9BeEUj5ET_flLYPqO5hgqCsuZGXFiYIEBJxrkx614fXiELZHaNkvhSdsJHShK0w7L-UPHhkPKqi5M Oct 17 13:45:20.934942 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:45:20.934942 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:45:20.934942 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:45:20.934942 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:45:20.934942 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:45:20.934942 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:45:20.934942 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:45:20.934942 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:20.934942 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:45:20.934942 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:45:20.934942 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_59e65f6eb06d40d583b9f43c9af94c13", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:45:20.934942 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:20.934942 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:45:20.934942 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:20.934942 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:45:20.934942 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:45:20.934942 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:45:20.934942 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 443c44b0bd9e4c56a7fe0c1a53238545 Oct 17 13:45:20.934942 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:45:20.934942 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:45:20.934942 n-d-854247-14 devstack@n-api.service[127016]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-270383728", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "key_name": "tempest-key-433337698", "networks": [{"uuid": "72be642c-f241-4ddb-80d7-b14a93aa7fc9"}]}} Oct 17 13:45:20.934942 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:45:20.934942 n-d-854247-14 devstack@n-api.service[127016]: exception: Invalid key_name provided. Oct 17 13:45:20.934942 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-270383728', 'imageRef': '0743b21b-a6ff-4d02-897c-eabb68c3ba07', 'flavorRef': '452', 'key_name': 'tempest-key-433337698', 'networks': [{'uuid': '72be642c-f241-4ddb-80d7-b14a93aa7fc9'}]}}} Oct 17 13:45:20.934942 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:45:20.934942 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:20.934942 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 17 13:45:20.934942 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 17 13:45:20.934942 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 17 13:45:20.934942 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 17 13:45:20.934942 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 17 13:45:20.934942 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 17 13:45:20.934942 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 17 13:45:20.934942 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 17 13:45:20.934942 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:45:20.934942 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:45:20.934942 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 17 13:45:20.934942 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 17 13:45:20.934942 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 17 13:45:20.934942 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 17 13:45:20.934942 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 13:45:20.934942 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 13:45:20.934942 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 17 13:45:20.934942 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 17 13:45:20.934942 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-433337698 not found for user 443c44b0bd9e4c56a7fe0c1a53238545 Oct 17 13:45:20.934942 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:20.934942 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:20.934942 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:20.934942 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:20.934942 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:20.939375 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:20.939375 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:45:20.939375 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:45:20.939375 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:45:20.939375 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:45:20.939375 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:45:20.939375 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:45:20.939375 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:45:20.939375 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:45:20.939375 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:45:20.939375 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:45:20.939375 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 17 13:45:20.939375 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 17 13:45:20.939375 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 17 13:45:20.939375 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 17 13:45:20.939375 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:20.939375 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:20.939375 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:20.939375 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:20.939375 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:20.939375 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:20.939375 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:45:20.939375 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:45:20.939375 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 17 13:45:20.939375 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:20.939375 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5c1da92b-f5fb-4660-8c09-f950bc336626 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Returning 400 to user: Invalid key_name provided. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:45:20.939375 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5c1da92b-f5fb-4660-8c09-f950bc336626 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.696940 Oct 17 13:45:20.940999 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1378/2744] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:45:20 2022] POST /compute/v2.1/servers => generated 70 bytes in 700 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 17 13:45:20.954231 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-794beb7c-e3ca-4df3-951b-3c1454bc4c20 tempest-KeyPairsV2TestJSON-1963779671 tempest-KeyPairsV2TestJSON-1963779671-project] Action: 'create', calling method: .version_select at 0x7f7cd9811160>, body: {"keypair": {"name": "tempest-keypair-36184927", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP4jUPSriALGk7Zxd55HF73M65aieXqkrwyILez0NjOPvkkG0FGLjRngrSeVI4nPT4BBJhSBWkXXBhxMtim5b+ceLYmRcmshEpkMYNAr/BBMavZ/2Oxt/J39x/zWRyckGg=="}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:20.989096 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-794beb7c-e3ca-4df3-951b-3c1454bc4c20 tempest-KeyPairsV2TestJSON-1963779671 tempest-KeyPairsV2TestJSON-1963779671-project] Getting quotas for project b7f567e85ede485baa553594340213b0. Resources: {'key_pairs'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:45:20.995744 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-794beb7c-e3ca-4df3-951b-3c1454bc4c20 tempest-KeyPairsV2TestJSON-1963779671 tempest-KeyPairsV2TestJSON-1963779671-project] Getting quotas for user 7f445d1348b14b5c808e7be00ec7416e and project b7f567e85ede485baa553594340213b0. Resources: {'key_pairs'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:45:21.034923 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-794beb7c-e3ca-4df3-951b-3c1454bc4c20 tempest-KeyPairsV2TestJSON-1963779671 tempest-KeyPairsV2TestJSON-1963779671-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.094063 Oct 17 13:45:21.039531 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1379/2745] 10.222.0.79 () {60 vars in 1159 bytes} [Mon Oct 17 13:45:20 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:45:21.049478 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4334f17f-b334-4f01-85d0-c1c67fd18bb0 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:21.051334 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4334f17f-b334-4f01-85d0-c1c67fd18bb0 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:21.061133 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e5cf58b1-3c60-4870-971e-f87a68c4b325 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] 10.222.0.79 "DELETE /compute/v2.1/servers/19575b3d-cba9-4060-9579-9133975767de" status: 204 len: 0 microversion: 2.1 time: 0.226012 Oct 17 13:45:21.061747 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1367/2746] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:45:20 2022] DELETE /compute/v2.1/servers/19575b3d-cba9-4060-9579-9133975767de => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:45:21.070854 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e72a15c2-9637-4d04-bcb9-f07652a2bcc3 tempest-KeyPairsV2TestJSON-1963779671 tempest-KeyPairsV2TestJSON-1963779671-project] Calling method '.version_select at 0x7f7cd49cb8b0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:21.075771 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4334f17f-b334-4f01-85d0-c1c67fd18bb0 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:21.080015 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4334f17f-b334-4f01-85d0-c1c67fd18bb0 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:21.080472 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4334f17f-b334-4f01-85d0-c1c67fd18bb0 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:21.081353 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4334f17f-b334-4f01-85d0-c1c67fd18bb0 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:21.085727 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4334f17f-b334-4f01-85d0-c1c67fd18bb0 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:21.087878 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4334f17f-b334-4f01-85d0-c1c67fd18bb0 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:21.109438 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e72a15c2-9637-4d04-bcb9-f07652a2bcc3 tempest-KeyPairsV2TestJSON-1963779671 tempest-KeyPairsV2TestJSON-1963779671-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-36184927" status: 202 len: 0 microversion: 2.1 time: 0.046153 Oct 17 13:45:21.111105 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1368/2747] 10.222.0.79 () {58 vars in 1215 bytes} [Mon Oct 17 13:45:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-36184927 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:45:21.119020 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1b425410-6c9c-4d69-a6ed-3e97df16e9e2 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:21.120102 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1b425410-6c9c-4d69-a6ed-3e97df16e9e2 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] [instance: d58e9993-1b03-44b7-b27a-5ed4e7ee8232] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:21.130101 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1b425410-6c9c-4d69-a6ed-3e97df16e9e2 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:21.130642 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1b425410-6c9c-4d69-a6ed-3e97df16e9e2 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:21.131107 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1b425410-6c9c-4d69-a6ed-3e97df16e9e2 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:21.131951 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1b425410-6c9c-4d69-a6ed-3e97df16e9e2 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:21.132788 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1b425410-6c9c-4d69-a6ed-3e97df16e9e2 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:21.133336 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1b425410-6c9c-4d69-a6ed-3e97df16e9e2 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:21.683387 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1b425410-6c9c-4d69-a6ed-3e97df16e9e2 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75205205ba2946fbb18918201f54e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3126767b1c348859c2640dc21e38f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:21.691807 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1b425410-6c9c-4d69-a6ed-3e97df16e9e2 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] 10.222.0.79 "GET /compute/v2.1/servers/d58e9993-1b03-44b7-b27a-5ed4e7ee8232" status: 200 len: 1511 microversion: 2.1 time: 0.579217 Oct 17 13:45:21.703305 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4334f17f-b334-4f01-85d0-c1c67fd18bb0 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:21.703667 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1369/2748] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:21 2022] GET /compute/v2.1/servers/d58e9993-1b03-44b7-b27a-5ed4e7ee8232 => generated 1511 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:21.703667 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-31113329-02a5-4a68-a9b2-7ac8bba5574a tempest-KeyPairsV2TestJSON-1963779671 tempest-KeyPairsV2TestJSON-1963779671-project] Action: 'create', calling method: .version_select at 0x7f7cd573e820>, body: {"keypair": {"name": "tempest-keypair-723494627", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:21.711955 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4334f17f-b334-4f01-85d0-c1c67fd18bb0 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 0.674316 Oct 17 13:45:21.718451 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-31113329-02a5-4a68-a9b2-7ac8bba5574a tempest-KeyPairsV2TestJSON-1963779671 tempest-KeyPairsV2TestJSON-1963779671-project] Getting quotas for project b7f567e85ede485baa553594340213b0. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:45:21.725410 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-31113329-02a5-4a68-a9b2-7ac8bba5574a tempest-KeyPairsV2TestJSON-1963779671 tempest-KeyPairsV2TestJSON-1963779671-project] Getting quotas for user 7f445d1348b14b5c808e7be00ec7416e and project b7f567e85ede485baa553594340213b0. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:45:21.727576 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1380/2749] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:21 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:21.736235 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f2885a90-3bdf-48df-91a3-ef81124ca6b3 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:21.736867 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f2885a90-3bdf-48df-91a3-ef81124ca6b3 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: 87134cd4-0fff-43ba-b0a3-c4a62e3de5b1] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:21.752618 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f2885a90-3bdf-48df-91a3-ef81124ca6b3 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:21.752943 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f2885a90-3bdf-48df-91a3-ef81124ca6b3 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:21.753384 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f2885a90-3bdf-48df-91a3-ef81124ca6b3 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:21.754098 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f2885a90-3bdf-48df-91a3-ef81124ca6b3 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:21.754554 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f2885a90-3bdf-48df-91a3-ef81124ca6b3 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:21.754984 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f2885a90-3bdf-48df-91a3-ef81124ca6b3 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:21.770224 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-31113329-02a5-4a68-a9b2-7ac8bba5574a tempest-KeyPairsV2TestJSON-1963779671 tempest-KeyPairsV2TestJSON-1963779671-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.075381 Oct 17 13:45:21.771354 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1370/2750] 10.222.0.79 () {60 vars in 1159 bytes} [Mon Oct 17 13:45:21 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:45:21.781040 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-aa154539-beb1-4b2b-8afd-4dc0f7fc415e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:21.781661 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-aa154539-beb1-4b2b-8afd-4dc0f7fc415e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:21.790557 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aa154539-beb1-4b2b-8afd-4dc0f7fc415e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:21.790972 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aa154539-beb1-4b2b-8afd-4dc0f7fc415e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:21.791878 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aa154539-beb1-4b2b-8afd-4dc0f7fc415e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:21.792239 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aa154539-beb1-4b2b-8afd-4dc0f7fc415e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:21.792697 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aa154539-beb1-4b2b-8afd-4dc0f7fc415e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:21.793115 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aa154539-beb1-4b2b-8afd-4dc0f7fc415e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:22.240762 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-aa154539-beb1-4b2b-8afd-4dc0f7fc415e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:22.254761 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-aa154539-beb1-4b2b-8afd-4dc0f7fc415e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 0.477875 Oct 17 13:45:22.257501 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1371/2751] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:21 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:22.273507 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8422c19b-653f-470b-b0c3-7b415846653a tempest-KeyPairsV2TestJSON-1963779671 tempest-KeyPairsV2TestJSON-1963779671-project] Calling method '.version_select at 0x7f7cd573e820>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:22.318497 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8422c19b-653f-470b-b0c3-7b415846653a tempest-KeyPairsV2TestJSON-1963779671 tempest-KeyPairsV2TestJSON-1963779671-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-723494627" status: 202 len: 0 microversion: 2.1 time: 0.058452 Oct 17 13:45:22.320258 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1372/2752] 10.222.0.79 () {58 vars in 1218 bytes} [Mon Oct 17 13:45:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-723494627 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:45:22.329687 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-10c92ad8-b04d-4b68-acc7-245192a7f3cd req-4fb5f31d-5842-4451-bc39-fa038924cdf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87134cd4-0fff-43ba-b0a3-c4a62e3de5b1", "tag": "d6910502-acfa-4d10-b826-aef72e177e6f"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:22.352734 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-10c92ad8-b04d-4b68-acc7-245192a7f3cd req-4fb5f31d-5842-4451-bc39-fa038924cdf9 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:22.353217 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-10c92ad8-b04d-4b68-acc7-245192a7f3cd req-4fb5f31d-5842-4451-bc39-fa038924cdf9 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:22.353651 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-10c92ad8-b04d-4b68-acc7-245192a7f3cd req-4fb5f31d-5842-4451-bc39-fa038924cdf9 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:22.369214 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-10c92ad8-b04d-4b68-acc7-245192a7f3cd req-4fb5f31d-5842-4451-bc39-fa038924cdf9 service nova] Creating event network-changed:d6910502-acfa-4d10-b826-aef72e177e6f for instance 87134cd4-0fff-43ba-b0a3-c4a62e3de5b1 on n-h2-854247-14 Oct 17 13:45:22.375618 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-10c92ad8-b04d-4b68-acc7-245192a7f3cd req-4fb5f31d-5842-4451-bc39-fa038924cdf9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053337 Oct 17 13:45:22.377060 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1373/2753] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:45:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:45:22.387495 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6bae3fcd-832c-43ee-84a4-e07b5bdf2faa tempest-KeyPairsV2TestJSON-1963779671 tempest-KeyPairsV2TestJSON-1963779671-project] Action: 'create', calling method: .version_select at 0x7f7cd4957790>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-700016715", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMAhk+dqD0IWYWQbsPUOgrlHcdlvJLWO13Kap5cW1u1o/88tbQ1Yp8nL3Xj2NQGzfQQHlHADLtRzaM9ZWA9Ooat9CPFaHPt2cq/63MKlCUFnTHAzZ/HYTdaBRndrbBZDrg=="}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:22.418661 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-6bae3fcd-832c-43ee-84a4-e07b5bdf2faa tempest-KeyPairsV2TestJSON-1963779671 tempest-KeyPairsV2TestJSON-1963779671-project] Getting quotas for project b7f567e85ede485baa553594340213b0. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:45:22.424672 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-6bae3fcd-832c-43ee-84a4-e07b5bdf2faa tempest-KeyPairsV2TestJSON-1963779671 tempest-KeyPairsV2TestJSON-1963779671-project] Getting quotas for user 7f445d1348b14b5c808e7be00ec7416e and project b7f567e85ede485baa553594340213b0. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:45:22.489848 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6bae3fcd-832c-43ee-84a4-e07b5bdf2faa tempest-KeyPairsV2TestJSON-1963779671 tempest-KeyPairsV2TestJSON-1963779671-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.102760 Oct 17 13:45:22.489848 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1374/2754] 10.222.0.79 () {60 vars in 1159 bytes} [Mon Oct 17 13:45:22 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:45:22.495186 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5137d343-1d75-4eb8-b062-e195989f278b tempest-KeyPairsV2TestJSON-1963779671 tempest-KeyPairsV2TestJSON-1963779671-project] Action: 'create', calling method: .version_select at 0x7f7cd4a241f0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-376586719", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOE9Z687IfufcC5QirKLYMiYc7bPwgfxEAqjAgzml8YUYnTmOCNXHz0psi1cKXnLWU0+AoUMWBBhlZ9ZrOxOhQDbo5t1ECWWOHd6M3ihCbhPqnswU8t6VItDghP9Vql11w=="}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:22.524315 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-5137d343-1d75-4eb8-b062-e195989f278b tempest-KeyPairsV2TestJSON-1963779671 tempest-KeyPairsV2TestJSON-1963779671-project] Getting quotas for project b7f567e85ede485baa553594340213b0. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:45:22.535071 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-5137d343-1d75-4eb8-b062-e195989f278b tempest-KeyPairsV2TestJSON-1963779671 tempest-KeyPairsV2TestJSON-1963779671-project] Getting quotas for user 7f445d1348b14b5c808e7be00ec7416e and project b7f567e85ede485baa553594340213b0. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:45:22.566368 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5137d343-1d75-4eb8-b062-e195989f278b tempest-KeyPairsV2TestJSON-1963779671 tempest-KeyPairsV2TestJSON-1963779671-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.074347 Oct 17 13:45:22.576438 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1375/2755] 10.222.0.79 () {60 vars in 1159 bytes} [Mon Oct 17 13:45:22 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:45:22.578567 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9832f857-17cd-4a8b-a73f-0ef3a002364f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-249270508", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "72be642c-f241-4ddb-80d7-b14a93aa7fc9"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:22.613812 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f2885a90-3bdf-48df-91a3-ef81124ca6b3 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467250951f654e33b3e233868301bbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676987e95424497c94984347dd6a7988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:22.625848 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f2885a90-3bdf-48df-91a3-ef81124ca6b3 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "GET /compute/v2.1/servers/87134cd4-0fff-43ba-b0a3-c4a62e3de5b1" status: 200 len: 1333 microversion: 2.1 time: 0.897000 Oct 17 13:45:22.648397 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1381/2756] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:21 2022] GET /compute/v2.1/servers/87134cd4-0fff-43ba-b0a3-c4a62e3de5b1 => generated 1333 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:22.670021 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-27976c91-ce87-450f-bb86-f7b58ec50f52 tempest-KeyPairsV2TestJSON-1963779671 tempest-KeyPairsV2TestJSON-1963779671-project] Action: 'create', calling method: .version_select at 0x7f7cd457c9d0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-332235722", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAi8izaefAE8l3A0+bwu5CckoKKFkady2DyoUr31gDX3O6dHvb2nzlLfkrkR/IUFZs9PRqQMxPLqbmmsa0Bfh82ffR55crvQPWezTeLug7zjCB3Sz+WDa0VcjwW6XKpiMw=="}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:22.714694 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-27976c91-ce87-450f-bb86-f7b58ec50f52 tempest-KeyPairsV2TestJSON-1963779671 tempest-KeyPairsV2TestJSON-1963779671-project] Getting quotas for project b7f567e85ede485baa553594340213b0. Resources: {'key_pairs'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:45:22.722542 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-27976c91-ce87-450f-bb86-f7b58ec50f52 tempest-KeyPairsV2TestJSON-1963779671 tempest-KeyPairsV2TestJSON-1963779671-project] Getting quotas for user 7f445d1348b14b5c808e7be00ec7416e and project b7f567e85ede485baa553594340213b0. Resources: {'key_pairs'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:45:22.787326 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-27976c91-ce87-450f-bb86-f7b58ec50f52 tempest-KeyPairsV2TestJSON-1963779671 tempest-KeyPairsV2TestJSON-1963779671-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.137661 Oct 17 13:45:22.788249 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1382/2757] 10.222.0.79 () {60 vars in 1159 bytes} [Mon Oct 17 13:45:22 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:45:22.799460 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a6f1da07-a9ba-4e74-9c23-5552db204fc1 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:22.800380 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a6f1da07-a9ba-4e74-9c23-5552db204fc1 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] [instance: d58e9993-1b03-44b7-b27a-5ed4e7ee8232] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:22.812054 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a6f1da07-a9ba-4e74-9c23-5552db204fc1 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:22.812921 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a6f1da07-a9ba-4e74-9c23-5552db204fc1 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:22.813583 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a6f1da07-a9ba-4e74-9c23-5552db204fc1 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:22.814411 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a6f1da07-a9ba-4e74-9c23-5552db204fc1 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:22.816045 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a6f1da07-a9ba-4e74-9c23-5552db204fc1 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:22.816728 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a6f1da07-a9ba-4e74-9c23-5552db204fc1 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:23.024317 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.security_group_api [None req-9832f857-17cd-4a8b-a73f-0ef3a002364f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Neutron security group does_not_exist not found {{(pid=127017) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 17 13:45:23.025630 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-9832f857-17cd-4a8b-a73f-0ef3a002364f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 17 13:45:23.036413 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9832f857-17cd-4a8b-a73f-0ef3a002364f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Request method failure captured: Oct 17 13:45:23.036413 n-d-854247-14 devstack@n-api.service[127017]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:45:23.036413 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:45:23.036413 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:45:23.036413 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:45:23.036413 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 257 Oct 17 13:45:23.036413 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:45:23.036413 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:45:23.036413 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:45:23.036413 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:45:23.036413 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVwEqzYAZh4AkEjRryOAZIhaHrAKxd2Qcal9md8a5n-MMUYSdXmcWYLDVkyQoPrDIbcsApBq2EewemPkBwvNDDOidb0hhc_Z3w9BeEUj5ET_flLYPqO5hgqCsuZGXFiYIEBJxrkx614fXiELZHaNkvhSdsJHShK0w7L-UPHhkPKqi5M Oct 17 13:45:23.036413 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:45:23.036413 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:45:23.036413 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:45:23.036413 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:45:23.036413 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:45:23.036413 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:45:23.036413 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:45:23.036413 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:23.036413 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:45:23.036413 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:45:23.036413 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_59e65f6eb06d40d583b9f43c9af94c13", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:45:23.036413 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:23.036413 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:45:23.036413 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:23.036413 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:45:23.036413 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:45:23.036413 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:45:23.036413 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 443c44b0bd9e4c56a7fe0c1a53238545 Oct 17 13:45:23.036413 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:45:23.036413 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 13:45:23.036413 n-d-854247-14 devstack@n-api.service[127017]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-249270508", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "72be642c-f241-4ddb-80d7-b14a93aa7fc9"}]}} Oct 17 13:45:23.036413 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:45:23.036413 n-d-854247-14 devstack@n-api.service[127017]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 17 13:45:23.036413 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-249270508', 'imageRef': '0743b21b-a6ff-4d02-897c-eabb68c3ba07', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '72be642c-f241-4ddb-80d7-b14a93aa7fc9'}]}}} Oct 17 13:45:23.036413 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:45:23.036413 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:23.036413 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 17 13:45:23.036413 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 17 13:45:23.036413 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:45:23.036413 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:45:23.036413 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 17 13:45:23.036413 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 17 13:45:23.036413 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 17 13:45:23.036413 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:23.036413 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:23.036413 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:23.036413 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:23.036413 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 17 13:45:23.036413 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 17 13:45:23.036413 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:45:23.036413 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:45:23.036413 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 17 13:45:23.036413 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 17 13:45:23.036413 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 17 13:45:23.036413 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:23.036413 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:23.036413 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:23.036413 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:23.036413 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 17 13:45:23.036413 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 17 13:45:23.041321 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 17 13:45:23.041321 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 17 13:45:23.041321 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 17 13:45:23.041321 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 17 13:45:23.041321 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:45:23.041321 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:45:23.041321 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 17 13:45:23.041321 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 17 13:45:23.041321 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 17 13:45:23.041321 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:23.041321 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:23.041321 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:23.041321 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:23.041321 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 17 13:45:23.041321 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 17 13:45:23.041321 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 17 13:45:23.041321 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 17 13:45:23.041321 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 17 13:45:23.041321 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 17 13:45:23.041321 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 17 13:45:23.041321 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 17 13:45:23.041321 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 17 13:45:23.041321 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 17 13:45:23.041321 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 17 13:45:23.041321 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 13:45:23.041321 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 17 13:45:23.041321 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:23.041321 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:23.041321 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:23.041321 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:23.041321 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:23.041321 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:23.041321 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:45:23.041321 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:45:23.041321 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:45:23.041321 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:45:23.041321 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:45:23.041321 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:45:23.041321 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:45:23.041321 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:45:23.041321 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:45:23.041321 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:45:23.041321 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 17 13:45:23.041321 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 17 13:45:23.041321 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 17 13:45:23.041321 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 17 13:45:23.041321 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:23.041321 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:23.041321 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:23.041321 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:23.041321 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:23.041321 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:23.041321 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:45:23.041321 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:45:23.041321 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 17 13:45:23.041321 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:23.050487 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9832f857-17cd-4a8b-a73f-0ef3a002364f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:45:23.051682 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9832f857-17cd-4a8b-a73f-0ef3a002364f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.479990 Oct 17 13:45:23.052500 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1376/2758] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:45:22 2022] POST /compute/v2.1/servers => generated 106 bytes in 481 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:45:23.064853 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2a9b6da9-81bd-4231-b0bb-845eb559f036 tempest-KeyPairsV2TestJSON-1963779671 tempest-KeyPairsV2TestJSON-1963779671-project] Calling method '.version_select at 0x7f7cd4957670>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:23.071609 n-d-854247-14 devstack@n-api.service[127017]: WARNING oslo_db.sqlalchemy.utils [None req-2a9b6da9-81bd-4231-b0bb-845eb559f036 tempest-KeyPairsV2TestJSON-1963779671 tempest-KeyPairsV2TestJSON-1963779671-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 17 13:45:23.078872 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2a9b6da9-81bd-4231-b0bb-845eb559f036 tempest-KeyPairsV2TestJSON-1963779671 tempest-KeyPairsV2TestJSON-1963779671-project] 10.222.0.79 "GET /compute/v2.1/os-keypairs" status: 200 len: 1091 microversion: 2.1 time: 0.023552 Oct 17 13:45:23.087992 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1377/2759] 10.222.0.79 () {58 vars in 1137 bytes} [Mon Oct 17 13:45:23 2022] GET /compute/v2.1/os-keypairs => generated 1091 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:23.098583 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-04384797-dd0b-4d8d-8fc4-2c3674fd2dbe tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:23.104126 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-04384797-dd0b-4d8d-8fc4-2c3674fd2dbe tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:23.124191 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-04384797-dd0b-4d8d-8fc4-2c3674fd2dbe tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:23.128701 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-04384797-dd0b-4d8d-8fc4-2c3674fd2dbe tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:23.129520 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-04384797-dd0b-4d8d-8fc4-2c3674fd2dbe tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:23.130474 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-04384797-dd0b-4d8d-8fc4-2c3674fd2dbe tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:23.131573 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-04384797-dd0b-4d8d-8fc4-2c3674fd2dbe tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:23.132238 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-04384797-dd0b-4d8d-8fc4-2c3674fd2dbe tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:23.174698 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:45:24.083429 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a6f1da07-a9ba-4e74-9c23-5552db204fc1 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75205205ba2946fbb18918201f54e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3126767b1c348859c2640dc21e38f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:24.097883 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a6f1da07-a9ba-4e74-9c23-5552db204fc1 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] 10.222.0.79 "GET /compute/v2.1/servers/d58e9993-1b03-44b7-b27a-5ed4e7ee8232" status: 200 len: 1511 microversion: 2.1 time: 1.306149 Oct 17 13:45:24.101140 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1383/2760] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:22 2022] GET /compute/v2.1/servers/d58e9993-1b03-44b7-b27a-5ed4e7ee8232 => generated 1511 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:24.113314 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-09ea9768-9107-4147-8585-6c9e0e5e1499 tempest-KeyPairsV2TestJSON-1963779671 tempest-KeyPairsV2TestJSON-1963779671-project] Calling method '.version_select at 0x7f7cd9892790>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:24.156595 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-09ea9768-9107-4147-8585-6c9e0e5e1499 tempest-KeyPairsV2TestJSON-1963779671 tempest-KeyPairsV2TestJSON-1963779671-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-332235722" status: 202 len: 0 microversion: 2.1 time: 0.053938 Oct 17 13:45:24.157868 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1384/2761] 10.222.0.79 () {58 vars in 1275 bytes} [Mon Oct 17 13:45:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-332235722 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:45:24.166931 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c279d403-83f7-4e77-823e-cc276b5bf02b tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:24.167997 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c279d403-83f7-4e77-823e-cc276b5bf02b tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: 87134cd4-0fff-43ba-b0a3-c4a62e3de5b1] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:24.178016 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:45:24.180260 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c279d403-83f7-4e77-823e-cc276b5bf02b tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:24.181742 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c279d403-83f7-4e77-823e-cc276b5bf02b tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:24.183359 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c279d403-83f7-4e77-823e-cc276b5bf02b tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:24.184445 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c279d403-83f7-4e77-823e-cc276b5bf02b tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:24.185195 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c279d403-83f7-4e77-823e-cc276b5bf02b tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:24.187852 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c279d403-83f7-4e77-823e-cc276b5bf02b tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:24.421458 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-04384797-dd0b-4d8d-8fc4-2c3674fd2dbe tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:24.431740 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-04384797-dd0b-4d8d-8fc4-2c3674fd2dbe tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 1.342315 Oct 17 13:45:24.457071 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1378/2762] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:23 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:24.466623 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-51f680b1-881c-49d4-8303-df9337cb683c tempest-KeyPairsV2TestJSON-1963779671 tempest-KeyPairsV2TestJSON-1963779671-project] Calling method '.version_select at 0x7f7cd4957310>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:24.499894 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-51f680b1-881c-49d4-8303-df9337cb683c tempest-KeyPairsV2TestJSON-1963779671 tempest-KeyPairsV2TestJSON-1963779671-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-376586719" status: 202 len: 0 microversion: 2.1 time: 0.040621 Oct 17 13:45:24.502109 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1379/2763] 10.222.0.79 () {58 vars in 1275 bytes} [Mon Oct 17 13:45:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-376586719 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:45:24.510544 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-719a1a08-d3d2-4475-a095-4e06e175ec65 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:24.511628 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-719a1a08-d3d2-4475-a095-4e06e175ec65 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:24.522326 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-719a1a08-d3d2-4475-a095-4e06e175ec65 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:24.523363 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-719a1a08-d3d2-4475-a095-4e06e175ec65 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:24.524186 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-719a1a08-d3d2-4475-a095-4e06e175ec65 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:24.526264 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-719a1a08-d3d2-4475-a095-4e06e175ec65 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:24.527430 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-719a1a08-d3d2-4475-a095-4e06e175ec65 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:24.528307 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-719a1a08-d3d2-4475-a095-4e06e175ec65 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:24.612581 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c279d403-83f7-4e77-823e-cc276b5bf02b tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467250951f654e33b3e233868301bbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676987e95424497c94984347dd6a7988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:24.620853 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c279d403-83f7-4e77-823e-cc276b5bf02b tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "GET /compute/v2.1/servers/87134cd4-0fff-43ba-b0a3-c4a62e3de5b1" status: 200 len: 1333 microversion: 2.1 time: 0.461504 Oct 17 13:45:24.622056 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1385/2764] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:24 2022] GET /compute/v2.1/servers/87134cd4-0fff-43ba-b0a3-c4a62e3de5b1 => generated 1333 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:24.627514 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-527d098c-2456-4d2c-8645-b571700f39e1 tempest-KeyPairsV2TestJSON-1963779671 tempest-KeyPairsV2TestJSON-1963779671-project] Calling method '.version_select at 0x7f7cd457cf70>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:24.662187 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-527d098c-2456-4d2c-8645-b571700f39e1 tempest-KeyPairsV2TestJSON-1963779671 tempest-KeyPairsV2TestJSON-1963779671-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-700016715" status: 202 len: 0 microversion: 2.1 time: 0.038815 Oct 17 13:45:24.663935 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1386/2765] 10.222.0.79 () {58 vars in 1275 bytes} [Mon Oct 17 13:45:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-700016715 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:45:24.677485 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-06dc2096-3a19-45fb-b053-67ee2f153cff req-910a1903-ee7d-4dd1-a67f-3e22058d0604 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87134cd4-0fff-43ba-b0a3-c4a62e3de5b1", "tag": "b5b05ac2-9883-43f6-aab3-a7d8332ddce5"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:24.693056 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-06dc2096-3a19-45fb-b053-67ee2f153cff req-910a1903-ee7d-4dd1-a67f-3e22058d0604 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:24.693897 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-06dc2096-3a19-45fb-b053-67ee2f153cff req-910a1903-ee7d-4dd1-a67f-3e22058d0604 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:24.694483 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-06dc2096-3a19-45fb-b053-67ee2f153cff req-910a1903-ee7d-4dd1-a67f-3e22058d0604 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:24.712227 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-06dc2096-3a19-45fb-b053-67ee2f153cff req-910a1903-ee7d-4dd1-a67f-3e22058d0604 service nova] Creating event network-changed:b5b05ac2-9883-43f6-aab3-a7d8332ddce5 for instance 87134cd4-0fff-43ba-b0a3-c4a62e3de5b1 on n-h2-854247-14 Oct 17 13:45:24.722496 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-06dc2096-3a19-45fb-b053-67ee2f153cff req-910a1903-ee7d-4dd1-a67f-3e22058d0604 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055073 Oct 17 13:45:24.727412 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1387/2766] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:45:24.911076 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-974bd056-4652-48e3-a3dc-2145d22c2669 req-e9718a52-d483-4ae7-bdc7-dc3d556023ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d58e9993-1b03-44b7-b27a-5ed4e7ee8232", "name": "network-vif-deleted", "tag": "f9564d02-3199-4bb0-909a-2be1f47a28a6"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:24.931075 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-974bd056-4652-48e3-a3dc-2145d22c2669 req-e9718a52-d483-4ae7-bdc7-dc3d556023ad service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:24.932037 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-974bd056-4652-48e3-a3dc-2145d22c2669 req-e9718a52-d483-4ae7-bdc7-dc3d556023ad service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:24.932707 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-974bd056-4652-48e3-a3dc-2145d22c2669 req-e9718a52-d483-4ae7-bdc7-dc3d556023ad service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:24.983589 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-974bd056-4652-48e3-a3dc-2145d22c2669 req-e9718a52-d483-4ae7-bdc7-dc3d556023ad service nova] Creating event network-vif-deleted:f9564d02-3199-4bb0-909a-2be1f47a28a6 for instance d58e9993-1b03-44b7-b27a-5ed4e7ee8232 on n-h1-854247-14 Oct 17 13:45:25.015773 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-974bd056-4652-48e3-a3dc-2145d22c2669 req-e9718a52-d483-4ae7-bdc7-dc3d556023ad service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112042 Oct 17 13:45:25.021441 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1388/2767] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:45:25.134356 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-694d1c52-c97f-43b6-89ec-7f4d11ec0eb3 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:25.135093 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-694d1c52-c97f-43b6-89ec-7f4d11ec0eb3 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] [instance: d58e9993-1b03-44b7-b27a-5ed4e7ee8232] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:25.157342 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-694d1c52-c97f-43b6-89ec-7f4d11ec0eb3 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:25.160646 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-694d1c52-c97f-43b6-89ec-7f4d11ec0eb3 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:25.163805 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-694d1c52-c97f-43b6-89ec-7f4d11ec0eb3 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:25.164704 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-694d1c52-c97f-43b6-89ec-7f4d11ec0eb3 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:25.166607 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-694d1c52-c97f-43b6-89ec-7f4d11ec0eb3 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:25.167240 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-694d1c52-c97f-43b6-89ec-7f4d11ec0eb3 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:25.229327 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-694d1c52-c97f-43b6-89ec-7f4d11ec0eb3 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:25.230089 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-694d1c52-c97f-43b6-89ec-7f4d11ec0eb3 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:25.230785 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-694d1c52-c97f-43b6-89ec-7f4d11ec0eb3 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:25.231491 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-694d1c52-c97f-43b6-89ec-7f4d11ec0eb3 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lazy-loading 'fault' on Instance uuid d58e9993-1b03-44b7-b27a-5ed4e7ee8232 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:45:25.501659 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-719a1a08-d3d2-4475-a095-4e06e175ec65 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:25.511332 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-694d1c52-c97f-43b6-89ec-7f4d11ec0eb3 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75205205ba2946fbb18918201f54e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3126767b1c348859c2640dc21e38f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:25.513503 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-719a1a08-d3d2-4475-a095-4e06e175ec65 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 1.009420 Oct 17 13:45:25.528534 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1380/2768] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:24 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:25.529580 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-694d1c52-c97f-43b6-89ec-7f4d11ec0eb3 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] 10.222.0.79 "GET /compute/v2.1/servers/d58e9993-1b03-44b7-b27a-5ed4e7ee8232" status: 200 len: 1307 microversion: 2.1 time: 0.399476 Oct 17 13:45:25.530322 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1389/2769] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:25 2022] GET /compute/v2.1/servers/d58e9993-1b03-44b7-b27a-5ed4e7ee8232 => generated 1307 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:45:25.541402 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-dbf180f8-9a49-46dc-a3bb-d40c01ad5387 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:25.542441 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-dbf180f8-9a49-46dc-a3bb-d40c01ad5387 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 86e2464f-333c-49f2-bb29-cd043c8a2be5] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:25.549690 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-dbf180f8-9a49-46dc-a3bb-d40c01ad5387 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] HTTP exception thrown: Instance 86e2464f-333c-49f2-bb29-cd043c8a2be5 could not be found. Oct 17 13:45:25.552607 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-dbf180f8-9a49-46dc-a3bb-d40c01ad5387 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Request method failure captured: Oct 17 13:45:25.552607 n-d-854247-14 devstack@n-api.service[127017]: request: DELETE /compute/v2.1/servers/86e2464f-333c-49f2-bb29-cd043c8a2be5 HTTP/1.1 Oct 17 13:45:25.552607 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:45:25.552607 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:45:25.552607 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:45:25.552607 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:45:25.552607 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:45:25.552607 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:45:25.552607 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:45:25.552607 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:45:25.552607 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVwEqzYAZh4AkEjRryOAZIhaHrAKxd2Qcal9md8a5n-MMUYSdXmcWYLDVkyQoPrDIbcsApBq2EewemPkBwvNDDOidb0hhc_Z3w9BeEUj5ET_flLYPqO5hgqCsuZGXFiYIEBJxrkx614fXiELZHaNkvhSdsJHShK0w7L-UPHhkPKqi5M Oct 17 13:45:25.552607 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:45:25.552607 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:45:25.552607 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:45:25.552607 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:45:25.552607 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:45:25.552607 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:45:25.552607 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:45:25.552607 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:25.552607 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:45:25.552607 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:45:25.552607 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_59e65f6eb06d40d583b9f43c9af94c13", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:45:25.552607 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:25.552607 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:45:25.552607 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:25.552607 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:45:25.552607 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:45:25.552607 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:45:25.552607 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 443c44b0bd9e4c56a7fe0c1a53238545 Oct 17 13:45:25.552607 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:45:25.552607 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:45:25.552607 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 86e2464f-333c-49f2-bb29-cd043c8a2be5 could not be found. Oct 17 13:45:25.552607 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '86e2464f-333c-49f2-bb29-cd043c8a2be5'} Oct 17 13:45:25.552607 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:45:25.552607 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:25.552607 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:45:25.552607 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:45:25.552607 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:45:25.552607 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:45:25.552607 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 13:45:25.552607 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 13:45:25.552607 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86e2464f-333c-49f2-bb29-cd043c8a2be5 could not be found. Oct 17 13:45:25.552607 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:25.552607 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:25.552607 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:25.552607 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:25.552607 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:25.552607 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:25.552607 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:45:25.552607 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:45:25.552607 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:45:25.552607 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:45:25.552607 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:45:25.552607 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:45:25.552607 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:45:25.552607 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:45:25.552607 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:45:25.552607 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:45:25.552607 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:45:25.552607 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:45:25.552607 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86e2464f-333c-49f2-bb29-cd043c8a2be5 could not be found. Oct 17 13:45:25.552607 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:25.552607 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:25.558134 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:25.558134 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:25.558134 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:25.558134 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:25.558134 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:45:25.558134 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:45:25.558134 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86e2464f-333c-49f2-bb29-cd043c8a2be5 could not be found. Oct 17 13:45:25.558134 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:25.558134 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-dbf180f8-9a49-46dc-a3bb-d40c01ad5387 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Returning 404 to user: Instance 86e2464f-333c-49f2-bb29-cd043c8a2be5 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:45:25.559149 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-dbf180f8-9a49-46dc-a3bb-d40c01ad5387 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "DELETE /compute/v2.1/servers/86e2464f-333c-49f2-bb29-cd043c8a2be5" status: 404 len: 111 microversion: 2.1 time: 0.022073 Oct 17 13:45:25.560049 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1381/2770] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:45:25 2022] DELETE /compute/v2.1/servers/86e2464f-333c-49f2-bb29-cd043c8a2be5 => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:45:25.575798 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-299fba2b-f1d8-4ca6-999f-8f721b4b55a9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:25.581875 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-299fba2b-f1d8-4ca6-999f-8f721b4b55a9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:25.592898 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-299fba2b-f1d8-4ca6-999f-8f721b4b55a9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:25.593418 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-299fba2b-f1d8-4ca6-999f-8f721b4b55a9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:25.593859 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-299fba2b-f1d8-4ca6-999f-8f721b4b55a9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:25.594582 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-299fba2b-f1d8-4ca6-999f-8f721b4b55a9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:25.595034 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-299fba2b-f1d8-4ca6-999f-8f721b4b55a9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:25.595481 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-299fba2b-f1d8-4ca6-999f-8f721b4b55a9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:25.618768 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:45:25.653175 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5e2beb89-00cd-4e7a-a183-3af74e4887ee tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:25.654065 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5e2beb89-00cd-4e7a-a183-3af74e4887ee tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: 87134cd4-0fff-43ba-b0a3-c4a62e3de5b1] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:25.678681 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5e2beb89-00cd-4e7a-a183-3af74e4887ee tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:25.682994 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5e2beb89-00cd-4e7a-a183-3af74e4887ee tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:25.683308 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5e2beb89-00cd-4e7a-a183-3af74e4887ee tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:25.684352 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5e2beb89-00cd-4e7a-a183-3af74e4887ee tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:25.686441 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5e2beb89-00cd-4e7a-a183-3af74e4887ee tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:25.686878 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5e2beb89-00cd-4e7a-a183-3af74e4887ee tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:26.458431 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-299fba2b-f1d8-4ca6-999f-8f721b4b55a9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:26.474037 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-299fba2b-f1d8-4ca6-999f-8f721b4b55a9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 0.902988 Oct 17 13:45:26.479152 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1390/2771] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:25 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:26.511130 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6aca3676-3a88-4ca1-8622-98a5e9b50bee tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:26.512259 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6aca3676-3a88-4ca1-8622-98a5e9b50bee tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:26.526376 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6aca3676-3a88-4ca1-8622-98a5e9b50bee tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:26.530804 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6aca3676-3a88-4ca1-8622-98a5e9b50bee tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:26.531649 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6aca3676-3a88-4ca1-8622-98a5e9b50bee tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:26.534552 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6aca3676-3a88-4ca1-8622-98a5e9b50bee tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:26.536295 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6aca3676-3a88-4ca1-8622-98a5e9b50bee tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:26.538445 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6aca3676-3a88-4ca1-8622-98a5e9b50bee tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:27.020877 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5e2beb89-00cd-4e7a-a183-3af74e4887ee tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467250951f654e33b3e233868301bbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676987e95424497c94984347dd6a7988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:27.035444 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5e2beb89-00cd-4e7a-a183-3af74e4887ee tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "GET /compute/v2.1/servers/87134cd4-0fff-43ba-b0a3-c4a62e3de5b1" status: 200 len: 1333 microversion: 2.1 time: 1.389638 Oct 17 13:45:27.044158 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1382/2772] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:25 2022] GET /compute/v2.1/servers/87134cd4-0fff-43ba-b0a3-c4a62e3de5b1 => generated 1333 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:45:27.055915 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b8aa5c9a-5d78-4f62-b81b-36cac067282f tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:27.056469 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b8aa5c9a-5d78-4f62-b81b-36cac067282f tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] [instance: d58e9993-1b03-44b7-b27a-5ed4e7ee8232] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:27.076075 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b8aa5c9a-5d78-4f62-b81b-36cac067282f tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:27.076706 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b8aa5c9a-5d78-4f62-b81b-36cac067282f tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:27.085853 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b8aa5c9a-5d78-4f62-b81b-36cac067282f tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:27.087198 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b8aa5c9a-5d78-4f62-b81b-36cac067282f tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:27.091611 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b8aa5c9a-5d78-4f62-b81b-36cac067282f tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:27.092866 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b8aa5c9a-5d78-4f62-b81b-36cac067282f tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:27.129381 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-b8aa5c9a-5d78-4f62-b81b-36cac067282f tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] HTTP exception thrown: Instance d58e9993-1b03-44b7-b27a-5ed4e7ee8232 could not be found. Oct 17 13:45:27.131268 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b8aa5c9a-5d78-4f62-b81b-36cac067282f tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Request method failure captured: Oct 17 13:45:27.131268 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/d58e9993-1b03-44b7-b27a-5ed4e7ee8232 HTTP/1.1 Oct 17 13:45:27.131268 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:45:27.131268 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:45:27.131268 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:45:27.131268 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:45:27.131268 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:45:27.131268 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:45:27.131268 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:45:27.131268 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:45:27.131268 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVw1-HwJn6iyuKsPKT97ELVveJC3MzRzhBBXXnEFJolX6n3Qe2FGJtX6v91UVtNWWc_d6cxUjtodAadVpj-GePH-rxG3A8NbM72q_jKPE06XDWfD4rg1gB3dkrFC_WCBVp4j8WFIcxoDmnugjx92zow8fEgEBxgim9wVKBpIIR05zSE Oct 17 13:45:27.131268 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:45:27.131268 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:45:27.131268 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:45:27.131268 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:45:27.131268 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:45:27.131268 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:45:27.131268 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: b3126767b1c348859c2640dc21e38f6a Oct 17 13:45:27.131268 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-MultipleCreateTestJSON-1134054782 Oct 17 13:45:27.131268 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:45:27.131268 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:45:27.131268 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b3126767b1c348859c2640dc21e38f6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b3126767b1c348859c2640dc21e38f6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b3126767b1c348859c2640dc21e38f6a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b3126767b1c348859c2640dc21e38f6a", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:45:27.131268 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-MultipleCreateTestJSON-1134054782 Oct 17 13:45:27.131268 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: b3126767b1c348859c2640dc21e38f6a Oct 17 13:45:27.131268 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1134054782 Oct 17 13:45:27.131268 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-MultipleCreateTestJSON-1134054782-project Oct 17 13:45:27.131268 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:45:27.131268 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:45:27.131268 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 75205205ba2946fbb18918201f54e15c Oct 17 13:45:27.131268 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-MultipleCreateTestJSON-1134054782-project Oct 17 13:45:27.131268 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:45:27.131268 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance d58e9993-1b03-44b7-b27a-5ed4e7ee8232 could not be found. Oct 17 13:45:27.131268 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'd58e9993-1b03-44b7-b27a-5ed4e7ee8232'} Oct 17 13:45:27.131268 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:45:27.131268 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:27.131268 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:45:27.131268 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:45:27.131268 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:45:27.131268 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:45:27.131268 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:45:27.131268 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:45:27.131268 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:45:27.131268 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:45:27.131268 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d58e9993-1b03-44b7-b27a-5ed4e7ee8232 could not be found. Oct 17 13:45:27.131268 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:27.131268 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:27.131268 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:27.131268 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:27.131268 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:27.131268 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:27.131268 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:45:27.131268 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:45:27.131268 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:45:27.131268 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:45:27.131268 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:45:27.131268 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:45:27.131268 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:45:27.131268 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:45:27.131268 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:45:27.131268 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:45:27.131268 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d58e9993-1b03-44b7-b27a-5ed4e7ee8232 could not be found. Oct 17 13:45:27.131268 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:27.131268 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:27.131268 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:27.135769 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:27.135769 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:27.135769 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:27.135769 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:45:27.135769 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:45:27.135769 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d58e9993-1b03-44b7-b27a-5ed4e7ee8232 could not be found. Oct 17 13:45:27.135769 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:27.141358 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b8aa5c9a-5d78-4f62-b81b-36cac067282f tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Returning 404 to user: Instance d58e9993-1b03-44b7-b27a-5ed4e7ee8232 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:45:27.143408 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b8aa5c9a-5d78-4f62-b81b-36cac067282f tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] 10.222.0.79 "GET /compute/v2.1/servers/d58e9993-1b03-44b7-b27a-5ed4e7ee8232" status: 404 len: 111 microversion: 2.1 time: 0.094834 Oct 17 13:45:27.148041 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1383/2773] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:27 2022] GET /compute/v2.1/servers/d58e9993-1b03-44b7-b27a-5ed4e7ee8232 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:45:27.153988 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-c0d4a53f-fb94-465c-8e25-d9399929a460 req-0adfe246-e6e6-4eb5-9625-0e8e261b5195 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19575b3d-cba9-4060-9579-9133975767de", "name": "network-vif-deleted", "tag": "87eb4336-0520-4977-b32a-7ee1560f6684"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:27.167073 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-c0d4a53f-fb94-465c-8e25-d9399929a460 req-0adfe246-e6e6-4eb5-9625-0e8e261b5195 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:27.167598 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-c0d4a53f-fb94-465c-8e25-d9399929a460 req-0adfe246-e6e6-4eb5-9625-0e8e261b5195 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:27.167976 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-c0d4a53f-fb94-465c-8e25-d9399929a460 req-0adfe246-e6e6-4eb5-9625-0e8e261b5195 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:27.180146 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-c0d4a53f-fb94-465c-8e25-d9399929a460 req-0adfe246-e6e6-4eb5-9625-0e8e261b5195 service nova] Creating event network-vif-deleted:87eb4336-0520-4977-b32a-7ee1560f6684 for instance 19575b3d-cba9-4060-9579-9133975767de on n-h1-854247-14 Oct 17 13:45:27.186441 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-c0d4a53f-fb94-465c-8e25-d9399929a460 req-0adfe246-e6e6-4eb5-9625-0e8e261b5195 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036668 Oct 17 13:45:27.187981 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1384/2774] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:45:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:45:27.329678 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6aca3676-3a88-4ca1-8622-98a5e9b50bee tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:27.345002 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6aca3676-3a88-4ca1-8622-98a5e9b50bee tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 0.846888 Oct 17 13:45:27.347845 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1391/2775] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:26 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:27.369468 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b3d68b56-dbe4-4935-9335-5bf11ffed23c tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:27.370994 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b3d68b56-dbe4-4935-9335-5bf11ffed23c tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] [instance: 19575b3d-cba9-4060-9579-9133975767de] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:27.392050 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b3d68b56-dbe4-4935-9335-5bf11ffed23c tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:27.392540 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b3d68b56-dbe4-4935-9335-5bf11ffed23c tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:27.393138 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b3d68b56-dbe4-4935-9335-5bf11ffed23c tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:27.394243 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b3d68b56-dbe4-4935-9335-5bf11ffed23c tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:27.394847 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b3d68b56-dbe4-4935-9335-5bf11ffed23c tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:27.395767 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b3d68b56-dbe4-4935-9335-5bf11ffed23c tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:27.434626 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-55300dae-6f6b-45dd-b5f5-8a413cdaff29 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1014069093", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "59d437ea-c51f-4bd2-bc6d-6c02e4137886"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:27.489987 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b3d68b56-dbe4-4935-9335-5bf11ffed23c tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:27.492293 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b3d68b56-dbe4-4935-9335-5bf11ffed23c tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:27.494697 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b3d68b56-dbe4-4935-9335-5bf11ffed23c tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:27.496693 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-b3d68b56-dbe4-4935-9335-5bf11ffed23c tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lazy-loading 'fault' on Instance uuid 19575b3d-cba9-4060-9579-9133975767de {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:45:27.559439 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-55300dae-6f6b-45dd-b5f5-8a413cdaff29 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] validate_networks() for [('59d437ea-c51f-4bd2-bc6d-6c02e4137886', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:45:28.153448 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b3d68b56-dbe4-4935-9335-5bf11ffed23c tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75205205ba2946fbb18918201f54e15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3126767b1c348859c2640dc21e38f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:28.162951 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b3d68b56-dbe4-4935-9335-5bf11ffed23c tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] 10.222.0.79 "GET /compute/v2.1/servers/19575b3d-cba9-4060-9579-9133975767de" status: 200 len: 1307 microversion: 2.1 time: 0.814175 Oct 17 13:45:28.172541 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1392/2776] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:27 2022] GET /compute/v2.1/servers/19575b3d-cba9-4060-9579-9133975767de => generated 1307 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:28.177705 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b00badb0-ead9-472e-8ffd-06aeecd29751 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:28.178376 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b00badb0-ead9-472e-8ffd-06aeecd29751 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Failed to fetch instance by id 9223372036854775808 {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 17 13:45:28.179034 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-b00badb0-ead9-472e-8ffd-06aeecd29751 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 17 13:45:28.180804 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b00badb0-ead9-472e-8ffd-06aeecd29751 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Request method failure captured: Oct 17 13:45:28.180804 n-d-854247-14 devstack@n-api.service[127016]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 17 13:45:28.180804 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:45:28.180804 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:45:28.180804 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:45:28.180804 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:45:28.180804 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:45:28.180804 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:45:28.180804 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:45:28.180804 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:45:28.180804 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVwEqzYAZh4AkEjRryOAZIhaHrAKxd2Qcal9md8a5n-MMUYSdXmcWYLDVkyQoPrDIbcsApBq2EewemPkBwvNDDOidb0hhc_Z3w9BeEUj5ET_flLYPqO5hgqCsuZGXFiYIEBJxrkx614fXiELZHaNkvhSdsJHShK0w7L-UPHhkPKqi5M Oct 17 13:45:28.180804 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:45:28.180804 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:45:28.180804 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:45:28.180804 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:45:28.180804 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:45:28.180804 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:45:28.180804 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:45:28.180804 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:28.180804 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:45:28.180804 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:45:28.180804 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_59e65f6eb06d40d583b9f43c9af94c13", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:45:28.180804 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:28.180804 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:45:28.180804 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:28.180804 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:45:28.180804 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:45:28.180804 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:45:28.180804 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 443c44b0bd9e4c56a7fe0c1a53238545 Oct 17 13:45:28.180804 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:45:28.180804 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:45:28.180804 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 9223372036854775808 could not be found. Oct 17 13:45:28.180804 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '9223372036854775808'} Oct 17 13:45:28.180804 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:45:28.180804 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:28.180804 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:45:28.180804 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:45:28.180804 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 17 13:45:28.180804 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 17 13:45:28.180804 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 17 13:45:28.180804 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:28.180804 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:28.180804 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:28.180804 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:28.180804 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:28.180804 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:28.180804 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:45:28.180804 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:45:28.180804 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:45:28.180804 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:45:28.180804 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:45:28.180804 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:45:28.180804 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:45:28.180804 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:45:28.180804 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:45:28.180804 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:45:28.180804 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:45:28.180804 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:45:28.180804 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 17 13:45:28.180804 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:28.180804 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:28.180804 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:28.180804 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:28.180804 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:28.184641 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:28.184641 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:45:28.184641 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:45:28.184641 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 17 13:45:28.184641 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:28.196317 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b00badb0-ead9-472e-8ffd-06aeecd29751 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:45:28.197213 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b00badb0-ead9-472e-8ffd-06aeecd29751 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.023418 Oct 17 13:45:28.197790 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1393/2777] 10.222.0.79 () {58 vars in 1188 bytes} [Mon Oct 17 13:45:28 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:45:28.206664 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-51be5b35-59b4-4394-a9fd-67b08d0ffe60 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:28.207625 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-51be5b35-59b4-4394-a9fd-67b08d0ffe60 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: 87134cd4-0fff-43ba-b0a3-c4a62e3de5b1] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:28.214284 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-51be5b35-59b4-4394-a9fd-67b08d0ffe60 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:28.215213 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-51be5b35-59b4-4394-a9fd-67b08d0ffe60 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:28.216068 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-51be5b35-59b4-4394-a9fd-67b08d0ffe60 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:28.217065 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-51be5b35-59b4-4394-a9fd-67b08d0ffe60 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:28.218120 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-51be5b35-59b4-4394-a9fd-67b08d0ffe60 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:28.218775 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-51be5b35-59b4-4394-a9fd-67b08d0ffe60 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:28.996402 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-51be5b35-59b4-4394-a9fd-67b08d0ffe60 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467250951f654e33b3e233868301bbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676987e95424497c94984347dd6a7988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:29.007096 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-51be5b35-59b4-4394-a9fd-67b08d0ffe60 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "GET /compute/v2.1/servers/87134cd4-0fff-43ba-b0a3-c4a62e3de5b1" status: 200 len: 1333 microversion: 2.1 time: 0.804564 Oct 17 13:45:29.008386 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1394/2778] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:28 2022] GET /compute/v2.1/servers/87134cd4-0fff-43ba-b0a3-c4a62e3de5b1 => generated 1333 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:29.014215 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-86758cd9-c41b-4454-82c9-182625ec0305 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:29.015439 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-86758cd9-c41b-4454-82c9-182625ec0305 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:29.023725 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-86758cd9-c41b-4454-82c9-182625ec0305 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:29.024430 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-86758cd9-c41b-4454-82c9-182625ec0305 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:29.025036 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-86758cd9-c41b-4454-82c9-182625ec0305 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:29.025892 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-86758cd9-c41b-4454-82c9-182625ec0305 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:29.026488 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-86758cd9-c41b-4454-82c9-182625ec0305 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:29.027124 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-86758cd9-c41b-4454-82c9-182625ec0305 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:29.510076 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-86758cd9-c41b-4454-82c9-182625ec0305 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:29.523347 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-86758cd9-c41b-4454-82c9-182625ec0305 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 0.513451 Oct 17 13:45:29.526351 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1395/2779] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:29 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:29.542454 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ba206b9b-dd6b-4eee-9b66-3d0f1fecce83 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:29.548197 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ba206b9b-dd6b-4eee-9b66-3d0f1fecce83 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] [instance: 19575b3d-cba9-4060-9579-9133975767de] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:29.564895 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ba206b9b-dd6b-4eee-9b66-3d0f1fecce83 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:29.566121 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ba206b9b-dd6b-4eee-9b66-3d0f1fecce83 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:29.568500 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ba206b9b-dd6b-4eee-9b66-3d0f1fecce83 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:29.571850 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ba206b9b-dd6b-4eee-9b66-3d0f1fecce83 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:29.573297 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ba206b9b-dd6b-4eee-9b66-3d0f1fecce83 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:29.574642 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ba206b9b-dd6b-4eee-9b66-3d0f1fecce83 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:29.611607 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-ba206b9b-dd6b-4eee-9b66-3d0f1fecce83 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] HTTP exception thrown: Instance 19575b3d-cba9-4060-9579-9133975767de could not be found. Oct 17 13:45:29.615093 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ba206b9b-dd6b-4eee-9b66-3d0f1fecce83 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Request method failure captured: Oct 17 13:45:29.615093 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/19575b3d-cba9-4060-9579-9133975767de HTTP/1.1 Oct 17 13:45:29.615093 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:45:29.615093 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:45:29.615093 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:45:29.615093 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:45:29.615093 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:45:29.615093 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:45:29.615093 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:45:29.615093 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:45:29.615093 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVw1-HwJn6iyuKsPKT97ELVveJC3MzRzhBBXXnEFJolX6n3Qe2FGJtX6v91UVtNWWc_d6cxUjtodAadVpj-GePH-rxG3A8NbM72q_jKPE06XDWfD4rg1gB3dkrFC_WCBVp4j8WFIcxoDmnugjx92zow8fEgEBxgim9wVKBpIIR05zSE Oct 17 13:45:29.615093 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:45:29.615093 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:45:29.615093 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:45:29.615093 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:45:29.615093 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:45:29.615093 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:45:29.615093 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: b3126767b1c348859c2640dc21e38f6a Oct 17 13:45:29.615093 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-MultipleCreateTestJSON-1134054782 Oct 17 13:45:29.615093 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:45:29.615093 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:45:29.615093 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b3126767b1c348859c2640dc21e38f6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b3126767b1c348859c2640dc21e38f6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b3126767b1c348859c2640dc21e38f6a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b3126767b1c348859c2640dc21e38f6a", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:45:29.615093 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-MultipleCreateTestJSON-1134054782 Oct 17 13:45:29.615093 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: b3126767b1c348859c2640dc21e38f6a Oct 17 13:45:29.615093 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1134054782 Oct 17 13:45:29.615093 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-MultipleCreateTestJSON-1134054782-project Oct 17 13:45:29.615093 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:45:29.615093 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:45:29.615093 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 75205205ba2946fbb18918201f54e15c Oct 17 13:45:29.615093 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-MultipleCreateTestJSON-1134054782-project Oct 17 13:45:29.615093 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:45:29.615093 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 19575b3d-cba9-4060-9579-9133975767de could not be found. Oct 17 13:45:29.615093 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '19575b3d-cba9-4060-9579-9133975767de'} Oct 17 13:45:29.615093 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:45:29.615093 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:29.615093 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:45:29.615093 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:45:29.615093 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:45:29.615093 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:45:29.615093 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:45:29.615093 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:45:29.615093 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:45:29.615093 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:45:29.615093 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19575b3d-cba9-4060-9579-9133975767de could not be found. Oct 17 13:45:29.615093 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:29.615093 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:29.615093 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:29.615093 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:29.615093 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:29.615093 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:29.615093 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:45:29.615093 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:45:29.615093 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:45:29.615093 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:45:29.615093 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:45:29.615093 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:45:29.615093 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:45:29.615093 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:45:29.615093 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:45:29.615093 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:45:29.615093 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19575b3d-cba9-4060-9579-9133975767de could not be found. Oct 17 13:45:29.615093 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:29.615093 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:29.615093 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:29.620464 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:29.620464 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:29.620464 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:29.620464 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:45:29.620464 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:45:29.620464 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19575b3d-cba9-4060-9579-9133975767de could not be found. Oct 17 13:45:29.620464 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:29.623881 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ba206b9b-dd6b-4eee-9b66-3d0f1fecce83 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] Returning 404 to user: Instance 19575b3d-cba9-4060-9579-9133975767de could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:45:29.625978 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ba206b9b-dd6b-4eee-9b66-3d0f1fecce83 tempest-MultipleCreateTestJSON-1134054782 tempest-MultipleCreateTestJSON-1134054782-project] 10.222.0.79 "GET /compute/v2.1/servers/19575b3d-cba9-4060-9579-9133975767de" status: 404 len: 111 microversion: 2.1 time: 0.097699 Oct 17 13:45:29.627129 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1396/2780] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:29 2022] GET /compute/v2.1/servers/19575b3d-cba9-4060-9579-9133975767de => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:45:29.632627 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5149d228-6895-4177-9fee-719236ca6bd0 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:29.633523 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5149d228-6895-4177-9fee-719236ca6bd0 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:29.641549 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5149d228-6895-4177-9fee-719236ca6bd0 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:29.642292 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5149d228-6895-4177-9fee-719236ca6bd0 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:29.643156 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5149d228-6895-4177-9fee-719236ca6bd0 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:29.644172 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5149d228-6895-4177-9fee-719236ca6bd0 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:29.644860 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5149d228-6895-4177-9fee-719236ca6bd0 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:29.645467 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5149d228-6895-4177-9fee-719236ca6bd0 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:29.712665 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-55300dae-6f6b-45dd-b5f5-8a413cdaff29 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:45:29.713202 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-55300dae-6f6b-45dd-b5f5-8a413cdaff29 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:45:29.713536 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-55300dae-6f6b-45dd-b5f5-8a413cdaff29 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:45:29.713943 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-55300dae-6f6b-45dd-b5f5-8a413cdaff29 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:45:29.714500 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-55300dae-6f6b-45dd-b5f5-8a413cdaff29 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:45:29.733168 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-55300dae-6f6b-45dd-b5f5-8a413cdaff29 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:29.733703 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-55300dae-6f6b-45dd-b5f5-8a413cdaff29 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:29.734140 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-55300dae-6f6b-45dd-b5f5-8a413cdaff29 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:29.738658 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-55300dae-6f6b-45dd-b5f5-8a413cdaff29 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:29.739239 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-55300dae-6f6b-45dd-b5f5-8a413cdaff29 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:29.739687 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-55300dae-6f6b-45dd-b5f5-8a413cdaff29 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:29.827906 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-55300dae-6f6b-45dd-b5f5-8a413cdaff29 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Getting quotas for project 338930cae76d48a19a9a0d960fc25457. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:45:29.835544 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-55300dae-6f6b-45dd-b5f5-8a413cdaff29 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Getting quotas for user e4e7aceb4e414d38a36d62fe086035d4 and project 338930cae76d48a19a9a0d960fc25457. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:45:29.881115 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-55300dae-6f6b-45dd-b5f5-8a413cdaff29 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:45:29.884218 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-55300dae-6f6b-45dd-b5f5-8a413cdaff29 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] [instance: b93ba3e5-0c3f-4e1b-825f-f788b1c32566] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:45:29.972125 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-55300dae-6f6b-45dd-b5f5-8a413cdaff29 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.781277 Oct 17 13:45:29.982381 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1385/2781] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:45:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:45:29.988349 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-58a86468-ee0d-46e7-b442-e95c75d9efa3 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:29.989283 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-58a86468-ee0d-46e7-b442-e95c75d9efa3 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] [instance: b93ba3e5-0c3f-4e1b-825f-f788b1c32566] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:29.995512 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=4,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:45:30.179500 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-58a86468-ee0d-46e7-b442-e95c75d9efa3 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e7aceb4e414d38a36d62fe086035d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338930cae76d48a19a9a0d960fc25457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:30.196355 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-58a86468-ee0d-46e7-b442-e95c75d9efa3 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] 10.222.0.79 "GET /compute/v2.1/servers/b93ba3e5-0c3f-4e1b-825f-f788b1c32566" status: 200 len: 1224 microversion: 2.1 time: 0.212443 Oct 17 13:45:30.204577 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1386/2782] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:29 2022] GET /compute/v2.1/servers/b93ba3e5-0c3f-4e1b-825f-f788b1c32566 => generated 1224 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:30.216425 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-16073de0-0c46-47e8-aebe-5a549af0a93a tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:30.221440 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-16073de0-0c46-47e8-aebe-5a549af0a93a tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: 87134cd4-0fff-43ba-b0a3-c4a62e3de5b1] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:30.244380 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-16073de0-0c46-47e8-aebe-5a549af0a93a tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:30.245051 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-16073de0-0c46-47e8-aebe-5a549af0a93a tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:30.245611 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-16073de0-0c46-47e8-aebe-5a549af0a93a tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:30.246441 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-16073de0-0c46-47e8-aebe-5a549af0a93a tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:30.247005 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-16073de0-0c46-47e8-aebe-5a549af0a93a tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:30.247564 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-16073de0-0c46-47e8-aebe-5a549af0a93a tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:30.657651 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5149d228-6895-4177-9fee-719236ca6bd0 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:30.673397 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5149d228-6895-4177-9fee-719236ca6bd0 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 1.042479 Oct 17 13:45:30.674442 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1397/2783] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:29 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:30.699001 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-106d03b4-0396-459b-bfe8-0831bbe45a51 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:30.699688 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-106d03b4-0396-459b-bfe8-0831bbe45a51 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Failed to fetch instance by id -1 {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 17 13:45:30.700309 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-106d03b4-0396-459b-bfe8-0831bbe45a51 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] HTTP exception thrown: Instance -1 could not be found. Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-106d03b4-0396-459b-bfe8-0831bbe45a51 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Request method failure captured: Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVwEqzYAZh4AkEjRryOAZIhaHrAKxd2Qcal9md8a5n-MMUYSdXmcWYLDVkyQoPrDIbcsApBq2EewemPkBwvNDDOidb0hhc_Z3w9BeEUj5ET_flLYPqO5hgqCsuZGXFiYIEBJxrkx614fXiELZHaNkvhSdsJHShK0w7L-UPHhkPKqi5M Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_59e65f6eb06d40d583b9f43c9af94c13", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 443c44b0bd9e4c56a7fe0c1a53238545 Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance -1 could not be found. Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '-1'} Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:30.706342 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:30.712003 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:45:30.712003 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:45:30.712003 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 17 13:45:30.712003 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:30.712003 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-106d03b4-0396-459b-bfe8-0831bbe45a51 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Returning 404 to user: Instance -1 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:45:30.712003 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-106d03b4-0396-459b-bfe8-0831bbe45a51 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.016636 Oct 17 13:45:30.715619 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1398/2784] 10.222.0.79 () {58 vars in 1137 bytes} [Mon Oct 17 13:45:30 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 17 13:45:30.728532 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-696b01dd-7235-475c-ad63-4601e17b1b9c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:30.729557 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-696b01dd-7235-475c-ad63-4601e17b1b9c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:30.751978 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-696b01dd-7235-475c-ad63-4601e17b1b9c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:30.752808 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-696b01dd-7235-475c-ad63-4601e17b1b9c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:30.753396 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-696b01dd-7235-475c-ad63-4601e17b1b9c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:30.754303 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-696b01dd-7235-475c-ad63-4601e17b1b9c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:30.754900 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-696b01dd-7235-475c-ad63-4601e17b1b9c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:30.755754 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-696b01dd-7235-475c-ad63-4601e17b1b9c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:31.398834 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-16073de0-0c46-47e8-aebe-5a549af0a93a tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467250951f654e33b3e233868301bbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676987e95424497c94984347dd6a7988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:31.408504 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-16073de0-0c46-47e8-aebe-5a549af0a93a tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "GET /compute/v2.1/servers/87134cd4-0fff-43ba-b0a3-c4a62e3de5b1" status: 200 len: 1333 microversion: 2.1 time: 1.202687 Oct 17 13:45:31.414155 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1387/2785] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:30 2022] GET /compute/v2.1/servers/87134cd4-0fff-43ba-b0a3-c4a62e3de5b1 => generated 1333 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:31.423118 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c32d086a-4387-4d20-9465-ccee1008a78f tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:31.427645 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c32d086a-4387-4d20-9465-ccee1008a78f tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] [instance: b93ba3e5-0c3f-4e1b-825f-f788b1c32566] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:31.443360 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-696b01dd-7235-475c-ad63-4601e17b1b9c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:31.443794 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c32d086a-4387-4d20-9465-ccee1008a78f tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:31.444460 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c32d086a-4387-4d20-9465-ccee1008a78f tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:31.445047 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c32d086a-4387-4d20-9465-ccee1008a78f tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:31.445899 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c32d086a-4387-4d20-9465-ccee1008a78f tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:31.446501 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c32d086a-4387-4d20-9465-ccee1008a78f tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:31.447081 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c32d086a-4387-4d20-9465-ccee1008a78f tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:31.457773 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-696b01dd-7235-475c-ad63-4601e17b1b9c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 0.740496 Oct 17 13:45:31.462542 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1399/2786] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:30 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:31.488481 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f94d6453-40ca-42d1-a6e9-ef5cdff7399e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:31.489549 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f94d6453-40ca-42d1-a6e9-ef5cdff7399e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:31.530610 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f94d6453-40ca-42d1-a6e9-ef5cdff7399e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:31.532572 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f94d6453-40ca-42d1-a6e9-ef5cdff7399e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:31.533858 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f94d6453-40ca-42d1-a6e9-ef5cdff7399e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:31.536629 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f94d6453-40ca-42d1-a6e9-ef5cdff7399e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:31.540064 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f94d6453-40ca-42d1-a6e9-ef5cdff7399e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:31.540704 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f94d6453-40ca-42d1-a6e9-ef5cdff7399e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:31.653947 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c32d086a-4387-4d20-9465-ccee1008a78f tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e7aceb4e414d38a36d62fe086035d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338930cae76d48a19a9a0d960fc25457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:31.663415 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c32d086a-4387-4d20-9465-ccee1008a78f tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] 10.222.0.79 "GET /compute/v2.1/servers/b93ba3e5-0c3f-4e1b-825f-f788b1c32566" status: 200 len: 1276 microversion: 2.1 time: 0.247749 Oct 17 13:45:31.679476 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1388/2787] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:31 2022] GET /compute/v2.1/servers/b93ba3e5-0c3f-4e1b-825f-f788b1c32566 => generated 1276 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:31.686480 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-87ea4d59-2fb5-41c9-8f97-1160b44c856f tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:31.691369 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-87ea4d59-2fb5-41c9-8f97-1160b44c856f tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] [instance: c8ec85bf-e448-4a4b-998d-a6bedb89d5e8] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:31.704430 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-87ea4d59-2fb5-41c9-8f97-1160b44c856f tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:31.705451 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-87ea4d59-2fb5-41c9-8f97-1160b44c856f tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:31.706556 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-87ea4d59-2fb5-41c9-8f97-1160b44c856f tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:31.707572 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-87ea4d59-2fb5-41c9-8f97-1160b44c856f tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:31.709185 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-87ea4d59-2fb5-41c9-8f97-1160b44c856f tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:31.710430 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-87ea4d59-2fb5-41c9-8f97-1160b44c856f tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:31.756598 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-87ea4d59-2fb5-41c9-8f97-1160b44c856f tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] [instance: c8ec85bf-e448-4a4b-998d-a6bedb89d5e8] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:45:31.976666 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-87ea4d59-2fb5-41c9-8f97-1160b44c856f tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c8ec85bf-e448-4a4b-998d-a6bedb89d5e8" status: 204 len: 0 microversion: 2.1 time: 0.294161 Oct 17 13:45:31.977366 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1389/2788] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:45:31 2022] DELETE /compute/v2.1/servers/c8ec85bf-e448-4a4b-998d-a6bedb89d5e8 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:45:31.989911 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-33c5a5af-bf5f-4ef8-b628-a86916d5e30f tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:31.990643 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-33c5a5af-bf5f-4ef8-b628-a86916d5e30f tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] [instance: c8ec85bf-e448-4a4b-998d-a6bedb89d5e8] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:32.008958 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-33c5a5af-bf5f-4ef8-b628-a86916d5e30f tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:32.010661 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-33c5a5af-bf5f-4ef8-b628-a86916d5e30f tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:32.011121 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-33c5a5af-bf5f-4ef8-b628-a86916d5e30f tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:32.014714 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-33c5a5af-bf5f-4ef8-b628-a86916d5e30f tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:32.017424 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-33c5a5af-bf5f-4ef8-b628-a86916d5e30f tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:32.017927 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-33c5a5af-bf5f-4ef8-b628-a86916d5e30f tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:32.180886 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f94d6453-40ca-42d1-a6e9-ef5cdff7399e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:32.215347 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f94d6453-40ca-42d1-a6e9-ef5cdff7399e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 0.731529 Oct 17 13:45:32.235102 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1400/2789] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:31 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:32.268608 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ff0e5df8-d08c-4743-b098-4668ef1cd4be tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:32.275823 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ff0e5df8-d08c-4743-b098-4668ef1cd4be tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: e77a5bba-2222-4868-96af-12255c22aa49] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:32.297127 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-ff0e5df8-d08c-4743-b098-4668ef1cd4be tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] HTTP exception thrown: Instance e77a5bba-2222-4868-96af-12255c22aa49 could not be found. Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ff0e5df8-d08c-4743-b098-4668ef1cd4be tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Request method failure captured: Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: request: POST /compute/v2.1/servers/e77a5bba-2222-4868-96af-12255c22aa49/action HTTP/1.1 Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 19 Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVwEqzYAZh4AkEjRryOAZIhaHrAKxd2Qcal9md8a5n-MMUYSdXmcWYLDVkyQoPrDIbcsApBq2EewemPkBwvNDDOidb0hhc_Z3w9BeEUj5ET_flLYPqO5hgqCsuZGXFiYIEBJxrkx614fXiELZHaNkvhSdsJHShK0w7L-UPHhkPKqi5M Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_59e65f6eb06d40d583b9f43c9af94c13", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 443c44b0bd9e4c56a7fe0c1a53238545 Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: {"forceDelete": {}} Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance e77a5bba-2222-4868-96af-12255c22aa49 could not be found. Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'e77a5bba-2222-4868-96af-12255c22aa49', 'body': {'forceDelete': {}}} Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e77a5bba-2222-4868-96af-12255c22aa49 could not be found. Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e77a5bba-2222-4868-96af-12255c22aa49 could not be found. Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:32.313567 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:32.319138 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:45:32.319138 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:45:32.319138 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e77a5bba-2222-4868-96af-12255c22aa49 could not be found. Oct 17 13:45:32.319138 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:32.324784 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ff0e5df8-d08c-4743-b098-4668ef1cd4be tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Returning 404 to user: Instance e77a5bba-2222-4868-96af-12255c22aa49 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:45:32.325926 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ff0e5df8-d08c-4743-b098-4668ef1cd4be tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "POST /compute/v2.1/servers/e77a5bba-2222-4868-96af-12255c22aa49/action" status: 404 len: 111 microversion: 2.1 time: 0.069261 Oct 17 13:45:32.327966 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1401/2790] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:45:32 2022] POST /compute/v2.1/servers/e77a5bba-2222-4868-96af-12255c22aa49/action => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:45:32.337068 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b5a5d6ce-6f2c-4d1b-901b-908034a0841d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:32.337957 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b5a5d6ce-6f2c-4d1b-901b-908034a0841d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:32.354468 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b5a5d6ce-6f2c-4d1b-901b-908034a0841d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:32.355221 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b5a5d6ce-6f2c-4d1b-901b-908034a0841d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:32.355847 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b5a5d6ce-6f2c-4d1b-901b-908034a0841d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:32.356582 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b5a5d6ce-6f2c-4d1b-901b-908034a0841d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:32.357045 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b5a5d6ce-6f2c-4d1b-901b-908034a0841d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:32.357474 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b5a5d6ce-6f2c-4d1b-901b-908034a0841d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:32.538519 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-33c5a5af-bf5f-4ef8-b628-a86916d5e30f tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb93a068a854ec9a2c082b380e22466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '341aac3733474b58a6ce8724c8bba334', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:32.547692 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-33c5a5af-bf5f-4ef8-b628-a86916d5e30f tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] 10.222.0.79 "GET /compute/v2.1/servers/c8ec85bf-e448-4a4b-998d-a6bedb89d5e8" status: 200 len: 1665 microversion: 2.1 time: 0.562830 Oct 17 13:45:32.559840 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1390/2791] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:31 2022] GET /compute/v2.1/servers/c8ec85bf-e448-4a4b-998d-a6bedb89d5e8 => generated 1665 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:32.570668 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b3786a41-bd2f-43bd-8227-e6be0e9ee5d6 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:32.571601 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b3786a41-bd2f-43bd-8227-e6be0e9ee5d6 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: 87134cd4-0fff-43ba-b0a3-c4a62e3de5b1] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:32.579139 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b3786a41-bd2f-43bd-8227-e6be0e9ee5d6 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:32.580029 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b3786a41-bd2f-43bd-8227-e6be0e9ee5d6 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:32.580460 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b3786a41-bd2f-43bd-8227-e6be0e9ee5d6 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:32.581316 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b3786a41-bd2f-43bd-8227-e6be0e9ee5d6 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:32.581917 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b3786a41-bd2f-43bd-8227-e6be0e9ee5d6 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:32.582490 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b3786a41-bd2f-43bd-8227-e6be0e9ee5d6 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:32.742383 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=12 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:45:32.762883 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b5a5d6ce-6f2c-4d1b-901b-908034a0841d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:32.778092 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b5a5d6ce-6f2c-4d1b-901b-908034a0841d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 0.444856 Oct 17 13:45:32.779526 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1402/2792] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:32 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:32.800447 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-49c790e8-ef4a-4b2e-a7e6-5da78cec3f2c tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:32.801493 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-49c790e8-ef4a-4b2e-a7e6-5da78cec3f2c tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] [instance: b93ba3e5-0c3f-4e1b-825f-f788b1c32566] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:32.818339 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-49c790e8-ef4a-4b2e-a7e6-5da78cec3f2c tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:32.818999 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-49c790e8-ef4a-4b2e-a7e6-5da78cec3f2c tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:32.819598 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-49c790e8-ef4a-4b2e-a7e6-5da78cec3f2c tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:32.820433 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-49c790e8-ef4a-4b2e-a7e6-5da78cec3f2c tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:32.820998 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-49c790e8-ef4a-4b2e-a7e6-5da78cec3f2c tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:32.821531 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-49c790e8-ef4a-4b2e-a7e6-5da78cec3f2c tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:32.951720 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-49c790e8-ef4a-4b2e-a7e6-5da78cec3f2c tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e7aceb4e414d38a36d62fe086035d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338930cae76d48a19a9a0d960fc25457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:32.964376 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-49c790e8-ef4a-4b2e-a7e6-5da78cec3f2c tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] 10.222.0.79 "GET /compute/v2.1/servers/b93ba3e5-0c3f-4e1b-825f-f788b1c32566" status: 200 len: 1282 microversion: 2.1 time: 0.183289 Oct 17 13:45:32.966118 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1403/2793] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:32 2022] GET /compute/v2.1/servers/b93ba3e5-0c3f-4e1b-825f-f788b1c32566 => generated 1282 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:32.975024 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-52c12725-eb82-4b1a-b314-b7c43cda1fa8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:32.999778 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-52c12725-eb82-4b1a-b314-b7c43cda1fa8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:33.015140 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-52c12725-eb82-4b1a-b314-b7c43cda1fa8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:33.016348 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-52c12725-eb82-4b1a-b314-b7c43cda1fa8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:33.017067 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-52c12725-eb82-4b1a-b314-b7c43cda1fa8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:33.046286 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-52c12725-eb82-4b1a-b314-b7c43cda1fa8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:33.049385 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-52c12725-eb82-4b1a-b314-b7c43cda1fa8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:33.051079 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-52c12725-eb82-4b1a-b314-b7c43cda1fa8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:33.213799 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b3786a41-bd2f-43bd-8227-e6be0e9ee5d6 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467250951f654e33b3e233868301bbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676987e95424497c94984347dd6a7988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:33.223947 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b3786a41-bd2f-43bd-8227-e6be0e9ee5d6 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "GET /compute/v2.1/servers/87134cd4-0fff-43ba-b0a3-c4a62e3de5b1" status: 200 len: 1333 microversion: 2.1 time: 0.662607 Oct 17 13:45:33.226471 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1391/2794] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:32 2022] GET /compute/v2.1/servers/87134cd4-0fff-43ba-b0a3-c4a62e3de5b1 => generated 1333 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:33.574033 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7225a01b-98ec-40de-9ea5-e655ecef6174 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:33.574881 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7225a01b-98ec-40de-9ea5-e655ecef6174 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] [instance: c8ec85bf-e448-4a4b-998d-a6bedb89d5e8] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:33.586262 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7225a01b-98ec-40de-9ea5-e655ecef6174 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:33.590842 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7225a01b-98ec-40de-9ea5-e655ecef6174 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:33.591567 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7225a01b-98ec-40de-9ea5-e655ecef6174 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:33.592688 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7225a01b-98ec-40de-9ea5-e655ecef6174 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:33.599721 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7225a01b-98ec-40de-9ea5-e655ecef6174 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:33.600414 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7225a01b-98ec-40de-9ea5-e655ecef6174 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:34.332485 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-52c12725-eb82-4b1a-b314-b7c43cda1fa8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:34.344444 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-52c12725-eb82-4b1a-b314-b7c43cda1fa8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 1.376889 Oct 17 13:45:34.345041 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1404/2795] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:32 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:34.372539 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2da07019-9a76-4f46-9b2b-6a1097bbf8c7 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:34.383544 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2da07019-9a76-4f46-9b2b-6a1097bbf8c7 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] [instance: b93ba3e5-0c3f-4e1b-825f-f788b1c32566] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:34.390349 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2da07019-9a76-4f46-9b2b-6a1097bbf8c7 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:34.390879 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2da07019-9a76-4f46-9b2b-6a1097bbf8c7 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:34.391338 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2da07019-9a76-4f46-9b2b-6a1097bbf8c7 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:34.392306 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2da07019-9a76-4f46-9b2b-6a1097bbf8c7 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:34.392976 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2da07019-9a76-4f46-9b2b-6a1097bbf8c7 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:34.393614 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2da07019-9a76-4f46-9b2b-6a1097bbf8c7 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:34.476532 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7225a01b-98ec-40de-9ea5-e655ecef6174 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb93a068a854ec9a2c082b380e22466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '341aac3733474b58a6ce8724c8bba334', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:34.485440 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7225a01b-98ec-40de-9ea5-e655ecef6174 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] 10.222.0.79 "GET /compute/v2.1/servers/c8ec85bf-e448-4a4b-998d-a6bedb89d5e8" status: 200 len: 1665 microversion: 2.1 time: 0.915322 Oct 17 13:45:34.494238 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1392/2796] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:33 2022] GET /compute/v2.1/servers/c8ec85bf-e448-4a4b-998d-a6bedb89d5e8 => generated 1665 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:34.509178 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ae122b8a-f777-4910-b10e-a8402ea6821f tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:34.510063 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ae122b8a-f777-4910-b10e-a8402ea6821f tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: 87134cd4-0fff-43ba-b0a3-c4a62e3de5b1] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:34.519698 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae122b8a-f777-4910-b10e-a8402ea6821f tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:34.520250 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae122b8a-f777-4910-b10e-a8402ea6821f tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:34.521304 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae122b8a-f777-4910-b10e-a8402ea6821f tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:34.522032 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae122b8a-f777-4910-b10e-a8402ea6821f tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:34.522493 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae122b8a-f777-4910-b10e-a8402ea6821f tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:34.522923 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae122b8a-f777-4910-b10e-a8402ea6821f tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:34.619530 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2da07019-9a76-4f46-9b2b-6a1097bbf8c7 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e7aceb4e414d38a36d62fe086035d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338930cae76d48a19a9a0d960fc25457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:34.633501 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2da07019-9a76-4f46-9b2b-6a1097bbf8c7 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] 10.222.0.79 "GET /compute/v2.1/servers/b93ba3e5-0c3f-4e1b-825f-f788b1c32566" status: 200 len: 1282 microversion: 2.1 time: 0.269095 Oct 17 13:45:34.634091 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1405/2797] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:34 2022] GET /compute/v2.1/servers/b93ba3e5-0c3f-4e1b-825f-f788b1c32566 => generated 1282 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:34.653712 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-db272063-2239-4f51-8a5e-ee2ce1b61f5c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:34.656341 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-db272063-2239-4f51-8a5e-ee2ce1b61f5c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 32a71148-2cb0-46ec-92c0-f643dd0df2c2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:34.664448 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-db272063-2239-4f51-8a5e-ee2ce1b61f5c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] HTTP exception thrown: Instance 32a71148-2cb0-46ec-92c0-f643dd0df2c2 could not be found. Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-db272063-2239-4f51-8a5e-ee2ce1b61f5c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Request method failure captured: Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: request: POST /compute/v2.1/servers/32a71148-2cb0-46ec-92c0-f643dd0df2c2/action HTTP/1.1 Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 39 Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVwEqzYAZh4AkEjRryOAZIhaHrAKxd2Qcal9md8a5n-MMUYSdXmcWYLDVkyQoPrDIbcsApBq2EewemPkBwvNDDOidb0hhc_Z3w9BeEUj5ET_flLYPqO5hgqCsuZGXFiYIEBJxrkx614fXiELZHaNkvhSdsJHShK0w7L-UPHhkPKqi5M Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_59e65f6eb06d40d583b9f43c9af94c13", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 443c44b0bd9e4c56a7fe0c1a53238545 Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: {"os-getConsoleOutput": {"length": 10}} Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 32a71148-2cb0-46ec-92c0-f643dd0df2c2 could not be found. Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '32a71148-2cb0-46ec-92c0-f643dd0df2c2', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32a71148-2cb0-46ec-92c0-f643dd0df2c2 could not be found. Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32a71148-2cb0-46ec-92c0-f643dd0df2c2 could not be found. Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:34.670314 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:34.674193 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:34.674193 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:34.674193 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:45:34.674193 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:45:34.674193 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32a71148-2cb0-46ec-92c0-f643dd0df2c2 could not be found. Oct 17 13:45:34.674193 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:34.674193 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-db272063-2239-4f51-8a5e-ee2ce1b61f5c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Returning 404 to user: Instance 32a71148-2cb0-46ec-92c0-f643dd0df2c2 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:45:34.674193 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-db272063-2239-4f51-8a5e-ee2ce1b61f5c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "POST /compute/v2.1/servers/32a71148-2cb0-46ec-92c0-f643dd0df2c2/action" status: 404 len: 111 microversion: 2.1 time: 0.027101 Oct 17 13:45:34.674193 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1406/2798] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:45:34 2022] POST /compute/v2.1/servers/32a71148-2cb0-46ec-92c0-f643dd0df2c2/action => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:45:34.685527 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-526c6add-41b2-4771-8320-cd73e77fa85e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:34.686205 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-526c6add-41b2-4771-8320-cd73e77fa85e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:34.706159 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-526c6add-41b2-4771-8320-cd73e77fa85e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:34.706569 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-526c6add-41b2-4771-8320-cd73e77fa85e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:34.707002 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-526c6add-41b2-4771-8320-cd73e77fa85e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:34.715099 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-526c6add-41b2-4771-8320-cd73e77fa85e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:34.715652 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-526c6add-41b2-4771-8320-cd73e77fa85e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:34.716089 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-526c6add-41b2-4771-8320-cd73e77fa85e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:35.016159 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ae122b8a-f777-4910-b10e-a8402ea6821f tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467250951f654e33b3e233868301bbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676987e95424497c94984347dd6a7988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:35.029573 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ae122b8a-f777-4910-b10e-a8402ea6821f tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "GET /compute/v2.1/servers/87134cd4-0fff-43ba-b0a3-c4a62e3de5b1" status: 200 len: 1333 microversion: 2.1 time: 0.533787 Oct 17 13:45:35.030988 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1393/2799] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:34 2022] GET /compute/v2.1/servers/87134cd4-0fff-43ba-b0a3-c4a62e3de5b1 => generated 1333 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:35.450494 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-526c6add-41b2-4771-8320-cd73e77fa85e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:35.472477 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-526c6add-41b2-4771-8320-cd73e77fa85e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 0.793607 Oct 17 13:45:35.473905 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1407/2800] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:34 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:35.502733 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-cb456e83-b6f3-4151-ba4a-36337c42b1ca tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:35.503773 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-cb456e83-b6f3-4151-ba4a-36337c42b1ca tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:35.538213 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c51347ac-1d24-43b0-9b3b-9ef00e5962cb tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:35.540893 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c51347ac-1d24-43b0-9b3b-9ef00e5962cb tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] [instance: c8ec85bf-e448-4a4b-998d-a6bedb89d5e8] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:35.549083 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cb456e83-b6f3-4151-ba4a-36337c42b1ca tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:35.551980 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cb456e83-b6f3-4151-ba4a-36337c42b1ca tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.039s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:35.552438 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cb456e83-b6f3-4151-ba4a-36337c42b1ca tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:35.560042 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cb456e83-b6f3-4151-ba4a-36337c42b1ca tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:35.563788 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cb456e83-b6f3-4151-ba4a-36337c42b1ca tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:35.569904 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cb456e83-b6f3-4151-ba4a-36337c42b1ca tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:35.575707 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c51347ac-1d24-43b0-9b3b-9ef00e5962cb tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:35.576214 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c51347ac-1d24-43b0-9b3b-9ef00e5962cb tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:35.585475 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c51347ac-1d24-43b0-9b3b-9ef00e5962cb tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:35.598517 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c51347ac-1d24-43b0-9b3b-9ef00e5962cb tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:35.603781 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c51347ac-1d24-43b0-9b3b-9ef00e5962cb tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:35.603986 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c51347ac-1d24-43b0-9b3b-9ef00e5962cb tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:36.296433 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-cb456e83-b6f3-4151-ba4a-36337c42b1ca tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:36.308109 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-cb456e83-b6f3-4151-ba4a-36337c42b1ca tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 0.808309 Oct 17 13:45:36.319501 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1394/2801] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:35 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:36.319501 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-397b0aac-21c6-4fb7-9bf9-ee3223b241b7 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:36.319501 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-397b0aac-21c6-4fb7-9bf9-ee3223b241b7 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] [instance: b93ba3e5-0c3f-4e1b-825f-f788b1c32566] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:36.328416 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-397b0aac-21c6-4fb7-9bf9-ee3223b241b7 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:36.329289 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-397b0aac-21c6-4fb7-9bf9-ee3223b241b7 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:36.330114 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-397b0aac-21c6-4fb7-9bf9-ee3223b241b7 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:36.331111 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-397b0aac-21c6-4fb7-9bf9-ee3223b241b7 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:36.331900 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-397b0aac-21c6-4fb7-9bf9-ee3223b241b7 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:36.332540 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-397b0aac-21c6-4fb7-9bf9-ee3223b241b7 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:36.383385 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c51347ac-1d24-43b0-9b3b-9ef00e5962cb tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb93a068a854ec9a2c082b380e22466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '341aac3733474b58a6ce8724c8bba334', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:36.396436 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c51347ac-1d24-43b0-9b3b-9ef00e5962cb tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] 10.222.0.79 "GET /compute/v2.1/servers/c8ec85bf-e448-4a4b-998d-a6bedb89d5e8" status: 200 len: 1665 microversion: 2.1 time: 0.882250 Oct 17 13:45:36.397041 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1408/2802] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:35 2022] GET /compute/v2.1/servers/c8ec85bf-e448-4a4b-998d-a6bedb89d5e8 => generated 1665 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:45:36.423362 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-494f10c4-5044-4e2d-80bc-c6bab0eef8cc req-bc97302a-2f35-45d1-872e-6f4e6add29d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87134cd4-0fff-43ba-b0a3-c4a62e3de5b1", "name": "network-vif-plugged", "status": "completed", "tag": "b5b05ac2-9883-43f6-aab3-a7d8332ddce5"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:36.440379 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-494f10c4-5044-4e2d-80bc-c6bab0eef8cc req-bc97302a-2f35-45d1-872e-6f4e6add29d5 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:36.440858 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-494f10c4-5044-4e2d-80bc-c6bab0eef8cc req-bc97302a-2f35-45d1-872e-6f4e6add29d5 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:36.441282 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-494f10c4-5044-4e2d-80bc-c6bab0eef8cc req-bc97302a-2f35-45d1-872e-6f4e6add29d5 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:36.473800 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-494f10c4-5044-4e2d-80bc-c6bab0eef8cc req-bc97302a-2f35-45d1-872e-6f4e6add29d5 service nova] Creating event network-vif-plugged:b5b05ac2-9883-43f6-aab3-a7d8332ddce5 for instance 87134cd4-0fff-43ba-b0a3-c4a62e3de5b1 on n-h2-854247-14 Oct 17 13:45:36.480985 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-494f10c4-5044-4e2d-80bc-c6bab0eef8cc req-bc97302a-2f35-45d1-872e-6f4e6add29d5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071167 Oct 17 13:45:36.481628 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1409/2803] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:45:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:45:36.495058 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9bd24053-ff6f-43c2-bad7-953168c70f11 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:36.495789 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9bd24053-ff6f-43c2-bad7-953168c70f11 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: 87134cd4-0fff-43ba-b0a3-c4a62e3de5b1] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:36.516506 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9bd24053-ff6f-43c2-bad7-953168c70f11 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:36.516911 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9bd24053-ff6f-43c2-bad7-953168c70f11 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:36.519765 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9bd24053-ff6f-43c2-bad7-953168c70f11 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:36.521993 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9bd24053-ff6f-43c2-bad7-953168c70f11 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:36.522694 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9bd24053-ff6f-43c2-bad7-953168c70f11 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:36.525772 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9bd24053-ff6f-43c2-bad7-953168c70f11 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:37.734550 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-397b0aac-21c6-4fb7-9bf9-ee3223b241b7 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e7aceb4e414d38a36d62fe086035d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338930cae76d48a19a9a0d960fc25457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:37.750172 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-397b0aac-21c6-4fb7-9bf9-ee3223b241b7 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] 10.222.0.79 "GET /compute/v2.1/servers/b93ba3e5-0c3f-4e1b-825f-f788b1c32566" status: 200 len: 1324 microversion: 2.1 time: 1.439093 Oct 17 13:45:37.751724 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1395/2804] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:36 2022] GET /compute/v2.1/servers/b93ba3e5-0c3f-4e1b-825f-f788b1c32566 => generated 1324 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:37.758421 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5c66a3d5-ef75-434a-b12a-d565d1ecf7ee tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:37.759297 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5c66a3d5-ef75-434a-b12a-d565d1ecf7ee tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 1014e668-8981-4ebf-9307-651e7eeb6701] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:37.768017 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-5c66a3d5-ef75-434a-b12a-d565d1ecf7ee tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] HTTP exception thrown: Instance 1014e668-8981-4ebf-9307-651e7eeb6701 could not be found. Oct 17 13:45:37.770114 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5c66a3d5-ef75-434a-b12a-d565d1ecf7ee tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Request method failure captured: Oct 17 13:45:37.770114 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/1014e668-8981-4ebf-9307-651e7eeb6701 HTTP/1.1 Oct 17 13:45:37.770114 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:45:37.770114 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:45:37.770114 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:45:37.770114 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:45:37.770114 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:45:37.770114 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:45:37.770114 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:45:37.770114 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:45:37.770114 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVwEqzYAZh4AkEjRryOAZIhaHrAKxd2Qcal9md8a5n-MMUYSdXmcWYLDVkyQoPrDIbcsApBq2EewemPkBwvNDDOidb0hhc_Z3w9BeEUj5ET_flLYPqO5hgqCsuZGXFiYIEBJxrkx614fXiELZHaNkvhSdsJHShK0w7L-UPHhkPKqi5M Oct 17 13:45:37.770114 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:45:37.770114 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:45:37.770114 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:45:37.770114 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:45:37.770114 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:45:37.770114 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:45:37.770114 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:45:37.770114 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:37.770114 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:45:37.770114 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:45:37.770114 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_59e65f6eb06d40d583b9f43c9af94c13", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:45:37.770114 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:37.770114 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:45:37.770114 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:37.770114 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:45:37.770114 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:45:37.770114 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:45:37.770114 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 443c44b0bd9e4c56a7fe0c1a53238545 Oct 17 13:45:37.770114 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:45:37.770114 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:45:37.770114 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 1014e668-8981-4ebf-9307-651e7eeb6701 could not be found. Oct 17 13:45:37.770114 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '1014e668-8981-4ebf-9307-651e7eeb6701'} Oct 17 13:45:37.770114 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:45:37.770114 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:37.770114 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:45:37.770114 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:45:37.770114 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:45:37.770114 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:45:37.770114 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 13:45:37.770114 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 13:45:37.770114 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1014e668-8981-4ebf-9307-651e7eeb6701 could not be found. Oct 17 13:45:37.770114 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:37.770114 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:37.770114 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:37.770114 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:37.770114 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:37.770114 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:37.770114 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:45:37.770114 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:45:37.770114 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:45:37.770114 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:45:37.770114 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:45:37.770114 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:45:37.770114 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:45:37.770114 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:45:37.770114 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:45:37.770114 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:45:37.770114 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1014e668-8981-4ebf-9307-651e7eeb6701 could not be found. Oct 17 13:45:37.770114 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:37.770114 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:37.770114 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:37.770114 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:37.770114 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:37.774059 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:37.774059 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:45:37.774059 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:45:37.774059 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1014e668-8981-4ebf-9307-651e7eeb6701 could not be found. Oct 17 13:45:37.774059 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:37.777315 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5c66a3d5-ef75-434a-b12a-d565d1ecf7ee tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Returning 404 to user: Instance 1014e668-8981-4ebf-9307-651e7eeb6701 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:45:37.778493 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5c66a3d5-ef75-434a-b12a-d565d1ecf7ee tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/1014e668-8981-4ebf-9307-651e7eeb6701" status: 404 len: 111 microversion: 2.1 time: 0.025156 Oct 17 13:45:37.779710 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1396/2805] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:37 2022] GET /compute/v2.1/servers/1014e668-8981-4ebf-9307-651e7eeb6701 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:45:37.784831 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-15caf202-867d-48eb-8e6d-17e5cc0a8210 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:37.786689 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-15caf202-867d-48eb-8e6d-17e5cc0a8210 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] [instance: c8ec85bf-e448-4a4b-998d-a6bedb89d5e8] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:37.794845 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-15caf202-867d-48eb-8e6d-17e5cc0a8210 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:37.796821 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-15caf202-867d-48eb-8e6d-17e5cc0a8210 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:37.797593 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-15caf202-867d-48eb-8e6d-17e5cc0a8210 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:37.798617 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-15caf202-867d-48eb-8e6d-17e5cc0a8210 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:37.799246 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-15caf202-867d-48eb-8e6d-17e5cc0a8210 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:37.799876 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-15caf202-867d-48eb-8e6d-17e5cc0a8210 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:37.988479 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-15caf202-867d-48eb-8e6d-17e5cc0a8210 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb93a068a854ec9a2c082b380e22466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '341aac3733474b58a6ce8724c8bba334', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:38.007478 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-15caf202-867d-48eb-8e6d-17e5cc0a8210 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] 10.222.0.79 "GET /compute/v2.1/servers/c8ec85bf-e448-4a4b-998d-a6bedb89d5e8" status: 200 len: 1598 microversion: 2.1 time: 0.218997 Oct 17 13:45:38.008415 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1397/2806] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:37 2022] GET /compute/v2.1/servers/c8ec85bf-e448-4a4b-998d-a6bedb89d5e8 => generated 1598 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:38.014253 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8777f399-863d-4958-b66a-26524661ada9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:38.018981 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8777f399-863d-4958-b66a-26524661ada9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:38.034178 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8777f399-863d-4958-b66a-26524661ada9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:38.034957 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8777f399-863d-4958-b66a-26524661ada9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:38.037841 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8777f399-863d-4958-b66a-26524661ada9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:38.038763 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8777f399-863d-4958-b66a-26524661ada9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:38.041094 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8777f399-863d-4958-b66a-26524661ada9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:38.041839 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8777f399-863d-4958-b66a-26524661ada9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:38.137803 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9bd24053-ff6f-43c2-bad7-953168c70f11 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467250951f654e33b3e233868301bbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676987e95424497c94984347dd6a7988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:38.146739 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9bd24053-ff6f-43c2-bad7-953168c70f11 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "GET /compute/v2.1/servers/87134cd4-0fff-43ba-b0a3-c4a62e3de5b1" status: 200 len: 1333 microversion: 2.1 time: 1.663878 Oct 17 13:45:38.148005 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1410/2807] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:36 2022] GET /compute/v2.1/servers/87134cd4-0fff-43ba-b0a3-c4a62e3de5b1 => generated 1333 bytes in 1666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:38.448567 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8777f399-863d-4958-b66a-26524661ada9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:38.481729 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8777f399-863d-4958-b66a-26524661ada9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 0.471896 Oct 17 13:45:38.482945 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1398/2808] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:38 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:38.517877 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e01065a1-7105-4bb5-84e3-7ab0e8f38e71 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:38.518773 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e01065a1-7105-4bb5-84e3-7ab0e8f38e71 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:38.526375 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-eb03e222-a795-490c-a132-6af7f9bb9f49 req-30063235-6619-415e-82fb-1356116d79c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87134cd4-0fff-43ba-b0a3-c4a62e3de5b1", "name": "network-vif-plugged", "status": "completed", "tag": "d6910502-acfa-4d10-b826-aef72e177e6f"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:38.540567 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e01065a1-7105-4bb5-84e3-7ab0e8f38e71 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:38.541373 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e01065a1-7105-4bb5-84e3-7ab0e8f38e71 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:38.541959 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e01065a1-7105-4bb5-84e3-7ab0e8f38e71 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:38.542886 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e01065a1-7105-4bb5-84e3-7ab0e8f38e71 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:38.548376 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e01065a1-7105-4bb5-84e3-7ab0e8f38e71 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:38.548826 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e01065a1-7105-4bb5-84e3-7ab0e8f38e71 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:38.554525 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-eb03e222-a795-490c-a132-6af7f9bb9f49 req-30063235-6619-415e-82fb-1356116d79c6 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:38.555291 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-eb03e222-a795-490c-a132-6af7f9bb9f49 req-30063235-6619-415e-82fb-1356116d79c6 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:38.556151 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-eb03e222-a795-490c-a132-6af7f9bb9f49 req-30063235-6619-415e-82fb-1356116d79c6 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:38.583754 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-eb03e222-a795-490c-a132-6af7f9bb9f49 req-30063235-6619-415e-82fb-1356116d79c6 service nova] Creating event network-vif-plugged:d6910502-acfa-4d10-b826-aef72e177e6f for instance 87134cd4-0fff-43ba-b0a3-c4a62e3de5b1 on n-h2-854247-14 Oct 17 13:45:38.591326 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-eb03e222-a795-490c-a132-6af7f9bb9f49 req-30063235-6619-415e-82fb-1356116d79c6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071761 Oct 17 13:45:38.592743 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1399/2809] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:45:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:45:38.779333 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7e85323e-ed8e-4dff-b1de-52d8cc877ec3 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:38.780864 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7e85323e-ed8e-4dff-b1de-52d8cc877ec3 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] [instance: b93ba3e5-0c3f-4e1b-825f-f788b1c32566] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:38.787621 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7e85323e-ed8e-4dff-b1de-52d8cc877ec3 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:38.788353 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7e85323e-ed8e-4dff-b1de-52d8cc877ec3 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:38.788954 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7e85323e-ed8e-4dff-b1de-52d8cc877ec3 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:38.789853 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7e85323e-ed8e-4dff-b1de-52d8cc877ec3 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:38.790462 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7e85323e-ed8e-4dff-b1de-52d8cc877ec3 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:38.791051 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7e85323e-ed8e-4dff-b1de-52d8cc877ec3 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:38.820230 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:45:39.315717 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e01065a1-7105-4bb5-84e3-7ab0e8f38e71 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:39.331419 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e01065a1-7105-4bb5-84e3-7ab0e8f38e71 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 0.822793 Oct 17 13:45:39.345430 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1411/2810] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:38 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:39.369388 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-807234c9-39e0-42e5-a856-f25f27c3bd23 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:39.371909 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-807234c9-39e0-42e5-a856-f25f27c3bd23 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] [instance: c8ec85bf-e448-4a4b-998d-a6bedb89d5e8] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:39.386733 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-807234c9-39e0-42e5-a856-f25f27c3bd23 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:39.387873 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-807234c9-39e0-42e5-a856-f25f27c3bd23 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:39.391452 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-807234c9-39e0-42e5-a856-f25f27c3bd23 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:39.394005 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-807234c9-39e0-42e5-a856-f25f27c3bd23 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:39.394488 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-807234c9-39e0-42e5-a856-f25f27c3bd23 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:39.396716 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-807234c9-39e0-42e5-a856-f25f27c3bd23 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:39.413103 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=100 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:45:39.491072 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-807234c9-39e0-42e5-a856-f25f27c3bd23 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:39.491588 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-807234c9-39e0-42e5-a856-f25f27c3bd23 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:39.492338 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-807234c9-39e0-42e5-a856-f25f27c3bd23 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:39.492960 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-807234c9-39e0-42e5-a856-f25f27c3bd23 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lazy-loading 'fault' on Instance uuid c8ec85bf-e448-4a4b-998d-a6bedb89d5e8 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:45:39.566300 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-807234c9-39e0-42e5-a856-f25f27c3bd23 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecb93a068a854ec9a2c082b380e22466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '341aac3733474b58a6ce8724c8bba334', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:39.579827 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-807234c9-39e0-42e5-a856-f25f27c3bd23 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] 10.222.0.79 "GET /compute/v2.1/servers/c8ec85bf-e448-4a4b-998d-a6bedb89d5e8" status: 200 len: 1315 microversion: 2.1 time: 0.233153 Oct 17 13:45:39.585585 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1412/2811] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:39 2022] GET /compute/v2.1/servers/c8ec85bf-e448-4a4b-998d-a6bedb89d5e8 => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:39.602532 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-6d542266-99c4-4e69-a6cb-b0af31ada08d req-c3179d41-c5ac-4205-ad8a-6eaa1aa767f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8ec85bf-e448-4a4b-998d-a6bedb89d5e8", "name": "network-vif-deleted", "tag": "d873d2fd-e2b6-4478-a3ae-55a34161df6e"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:39.607019 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7e85323e-ed8e-4dff-b1de-52d8cc877ec3 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e7aceb4e414d38a36d62fe086035d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338930cae76d48a19a9a0d960fc25457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:39.617514 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7e85323e-ed8e-4dff-b1de-52d8cc877ec3 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] 10.222.0.79 "GET /compute/v2.1/servers/b93ba3e5-0c3f-4e1b-825f-f788b1c32566" status: 200 len: 1324 microversion: 2.1 time: 0.843173 Oct 17 13:45:39.618102 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1400/2812] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:38 2022] GET /compute/v2.1/servers/b93ba3e5-0c3f-4e1b-825f-f788b1c32566 => generated 1324 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:45:39.627618 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2ff020b4-dc96-4678-8ad5-03332106d0bf tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:39.629005 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2ff020b4-dc96-4678-8ad5-03332106d0bf tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: 87134cd4-0fff-43ba-b0a3-c4a62e3de5b1] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:39.629149 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-6d542266-99c4-4e69-a6cb-b0af31ada08d req-c3179d41-c5ac-4205-ad8a-6eaa1aa767f1 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:39.629149 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-6d542266-99c4-4e69-a6cb-b0af31ada08d req-c3179d41-c5ac-4205-ad8a-6eaa1aa767f1 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:39.629498 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-6d542266-99c4-4e69-a6cb-b0af31ada08d req-c3179d41-c5ac-4205-ad8a-6eaa1aa767f1 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:39.649624 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2ff020b4-dc96-4678-8ad5-03332106d0bf tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:39.653416 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2ff020b4-dc96-4678-8ad5-03332106d0bf tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:39.654102 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2ff020b4-dc96-4678-8ad5-03332106d0bf tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:39.655073 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2ff020b4-dc96-4678-8ad5-03332106d0bf tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:39.655763 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2ff020b4-dc96-4678-8ad5-03332106d0bf tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:39.656915 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2ff020b4-dc96-4678-8ad5-03332106d0bf tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:39.662895 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-6d542266-99c4-4e69-a6cb-b0af31ada08d req-c3179d41-c5ac-4205-ad8a-6eaa1aa767f1 service nova] Creating event network-vif-deleted:d873d2fd-e2b6-4478-a3ae-55a34161df6e for instance c8ec85bf-e448-4a4b-998d-a6bedb89d5e8 on n-h1-854247-14 Oct 17 13:45:39.672762 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-6d542266-99c4-4e69-a6cb-b0af31ada08d req-c3179d41-c5ac-4205-ad8a-6eaa1aa767f1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082468 Oct 17 13:45:39.673700 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1413/2813] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:45:39.681483 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6fc21d87-f122-4941-b709-95ccc556c501 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-563174047", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "72be642c-f241-4ddb-80d7-b14a93aa7fc9"}]}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6fc21d87-f122-4941-b709-95ccc556c501 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Request method failure captured: Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 237 Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVwEqzYAZh4AkEjRryOAZIhaHrAKxd2Qcal9md8a5n-MMUYSdXmcWYLDVkyQoPrDIbcsApBq2EewemPkBwvNDDOidb0hhc_Z3w9BeEUj5ET_flLYPqO5hgqCsuZGXFiYIEBJxrkx614fXiELZHaNkvhSdsJHShK0w7L-UPHhkPKqi5M Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_59e65f6eb06d40d583b9f43c9af94c13", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 443c44b0bd9e4c56a7fe0c1a53238545 Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-563174047", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "72be642c-f241-4ddb-80d7-b14a93aa7fc9"}]}} Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-563174047', 'imageRef': '0743b21b-a6ff-4d02-897c-eabb68c3ba07', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '72be642c-f241-4ddb-80d7-b14a93aa7fc9'}]}}} Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:39.695466 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:39.700704 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:39.700704 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:39.700704 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:45:39.700704 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:45:39.700704 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:45:39.700704 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:45:39.700704 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:45:39.700704 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:45:39.700704 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:45:39.700704 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:45:39.700704 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:45:39.700704 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:45:39.700704 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:45:39.700704 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:45:39.700704 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 17 13:45:39.700704 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:39.700704 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:39.700704 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:39.700704 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:39.700704 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:39.700704 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:39.700704 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:45:39.700704 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:45:39.700704 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 17 13:45:39.700704 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:39.700704 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6fc21d87-f122-4941-b709-95ccc556c501 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:45:39.700704 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6fc21d87-f122-4941-b709-95ccc556c501 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.022243 Oct 17 13:45:39.700704 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1414/2814] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:45:39 2022] POST /compute/v2.1/servers => generated 139 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:45:39.718503 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0582b22e-2772-4683-bb6e-40f7318a8c35 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:39.719283 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0582b22e-2772-4683-bb6e-40f7318a8c35 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:39.753476 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0582b22e-2772-4683-bb6e-40f7318a8c35 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:39.754094 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0582b22e-2772-4683-bb6e-40f7318a8c35 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:39.754708 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0582b22e-2772-4683-bb6e-40f7318a8c35 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:39.757002 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0582b22e-2772-4683-bb6e-40f7318a8c35 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:39.757507 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0582b22e-2772-4683-bb6e-40f7318a8c35 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:39.760979 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0582b22e-2772-4683-bb6e-40f7318a8c35 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:39.785112 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:45:40.129755 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0582b22e-2772-4683-bb6e-40f7318a8c35 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:40.142637 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0582b22e-2772-4683-bb6e-40f7318a8c35 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 0.433313 Oct 17 13:45:40.145048 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1415/2815] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:39 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:40.170226 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-935104e6-a059-497c-a06f-d390acf2384f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:40.171570 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-935104e6-a059-497c-a06f-d390acf2384f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:40.172755 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2ff020b4-dc96-4678-8ad5-03332106d0bf tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467250951f654e33b3e233868301bbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676987e95424497c94984347dd6a7988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:40.178820 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-935104e6-a059-497c-a06f-d390acf2384f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:40.179717 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-935104e6-a059-497c-a06f-d390acf2384f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:40.180461 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-935104e6-a059-497c-a06f-d390acf2384f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:40.182059 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-935104e6-a059-497c-a06f-d390acf2384f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:40.182889 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-935104e6-a059-497c-a06f-d390acf2384f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:40.183580 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-935104e6-a059-497c-a06f-d390acf2384f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:40.193904 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2ff020b4-dc96-4678-8ad5-03332106d0bf tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "GET /compute/v2.1/servers/87134cd4-0fff-43ba-b0a3-c4a62e3de5b1" status: 200 len: 1333 microversion: 2.1 time: 0.565375 Oct 17 13:45:40.195799 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1401/2816] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:39 2022] GET /compute/v2.1/servers/87134cd4-0fff-43ba-b0a3-c4a62e3de5b1 => generated 1333 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:40.479406 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-935104e6-a059-497c-a06f-d390acf2384f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:40.491932 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-935104e6-a059-497c-a06f-d390acf2384f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 0.326032 Oct 17 13:45:40.494501 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1416/2817] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:40 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:40.590719 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4959c8b8-4386-4ff0-9b99-d5a2a8d7d208 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-674355978", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "72be642c-f241-4ddb-80d7-b14a93aa7fc9"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:40.614144 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1ec9d3e2-1375-4ee8-8b8a-ed46fc009240 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:40.615333 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-1ec9d3e2-1375-4ee8-8b8a-ed46fc009240 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] [instance: c8ec85bf-e448-4a4b-998d-a6bedb89d5e8] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4959c8b8-4386-4ff0-9b99-d5a2a8d7d208 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Request method failure captured: Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 234 Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVwEqzYAZh4AkEjRryOAZIhaHrAKxd2Qcal9md8a5n-MMUYSdXmcWYLDVkyQoPrDIbcsApBq2EewemPkBwvNDDOidb0hhc_Z3w9BeEUj5ET_flLYPqO5hgqCsuZGXFiYIEBJxrkx614fXiELZHaNkvhSdsJHShK0w7L-UPHhkPKqi5M Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_59e65f6eb06d40d583b9f43c9af94c13", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 443c44b0bd9e4c56a7fe0c1a53238545 Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-674355978", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "72be642c-f241-4ddb-80d7-b14a93aa7fc9"}]}} Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-674355978', 'imageRef': '0743b21b-a6ff-4d02-897c-eabb68c3ba07', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '72be642c-f241-4ddb-80d7-b14a93aa7fc9'}]}}} Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:40.623395 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:40.627231 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:40.627231 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:40.627231 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:45:40.627231 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:45:40.627231 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:45:40.627231 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:45:40.627231 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:45:40.627231 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:45:40.627231 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:45:40.627231 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:45:40.627231 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:45:40.627231 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:45:40.627231 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:45:40.627231 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:45:40.627231 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 17 13:45:40.627231 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:40.627231 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:40.627231 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:40.627231 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:40.627231 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:40.627231 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:40.627231 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:45:40.627231 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:45:40.627231 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 17 13:45:40.627231 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:40.633129 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1ec9d3e2-1375-4ee8-8b8a-ed46fc009240 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:40.634176 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4959c8b8-4386-4ff0-9b99-d5a2a8d7d208 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:45:40.635304 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4959c8b8-4386-4ff0-9b99-d5a2a8d7d208 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.050138 Oct 17 13:45:40.635999 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1ec9d3e2-1375-4ee8-8b8a-ed46fc009240 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:40.637322 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1ec9d3e2-1375-4ee8-8b8a-ed46fc009240 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:40.637800 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1402/2818] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:45:40 2022] POST /compute/v2.1/servers => generated 133 bytes in 53 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:45:40.641199 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1ec9d3e2-1375-4ee8-8b8a-ed46fc009240 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:40.642823 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1ec9d3e2-1375-4ee8-8b8a-ed46fc009240 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:40.651570 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1ec9d3e2-1375-4ee8-8b8a-ed46fc009240 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:40.658360 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-414e0d12-7486-4aa7-8465-dbd224ec6cb4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:40.660316 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-414e0d12-7486-4aa7-8465-dbd224ec6cb4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:40.684253 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=20 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:45:40.690264 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-1ec9d3e2-1375-4ee8-8b8a-ed46fc009240 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] HTTP exception thrown: Instance c8ec85bf-e448-4a4b-998d-a6bedb89d5e8 could not be found. Oct 17 13:45:40.697839 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1ec9d3e2-1375-4ee8-8b8a-ed46fc009240 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Request method failure captured: Oct 17 13:45:40.697839 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/c8ec85bf-e448-4a4b-998d-a6bedb89d5e8 HTTP/1.1 Oct 17 13:45:40.697839 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:45:40.697839 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:45:40.697839 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:45:40.697839 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:45:40.697839 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:45:40.697839 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:45:40.697839 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:45:40.697839 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:45:40.697839 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVwxBhfCMPuamzDPVmW24g_sLrg4a6wx7KgTjYq49KiPGW_erEqlGNYEzVznAwWQukZn9AE6aNEPnSXFgFoRdPkpjMVuja09Z-Azblbx0GVn6u458Ii7sZiPEppvCPiUE4QoJMWEOZ6EE8bFN5zi9cjsqVoqcRAwrJKzGHSGKZ6jasg Oct 17 13:45:40.697839 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:45:40.697839 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:45:40.697839 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:45:40.697839 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:45:40.697839 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:45:40.697839 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:45:40.697839 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 341aac3733474b58a6ce8724c8bba334 Oct 17 13:45:40.697839 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServersTestFqdnHostnames-149498888 Oct 17 13:45:40.697839 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:45:40.697839 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:45:40.697839 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/341aac3733474b58a6ce8724c8bba334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/341aac3733474b58a6ce8724c8bba334"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/341aac3733474b58a6ce8724c8bba334"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_341aac3733474b58a6ce8724c8bba334", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:45:40.697839 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServersTestFqdnHostnames-149498888 Oct 17 13:45:40.697839 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 341aac3733474b58a6ce8724c8bba334 Oct 17 13:45:40.697839 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-149498888 Oct 17 13:45:40.697839 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServersTestFqdnHostnames-149498888-project Oct 17 13:45:40.697839 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:45:40.697839 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:45:40.697839 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: ecb93a068a854ec9a2c082b380e22466 Oct 17 13:45:40.697839 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServersTestFqdnHostnames-149498888-project Oct 17 13:45:40.697839 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:45:40.697839 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance c8ec85bf-e448-4a4b-998d-a6bedb89d5e8 could not be found. Oct 17 13:45:40.697839 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'c8ec85bf-e448-4a4b-998d-a6bedb89d5e8'} Oct 17 13:45:40.697839 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:45:40.697839 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:40.697839 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:45:40.697839 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:45:40.697839 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:45:40.697839 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:45:40.697839 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:45:40.697839 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:45:40.697839 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:45:40.697839 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:45:40.697839 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8ec85bf-e448-4a4b-998d-a6bedb89d5e8 could not be found. Oct 17 13:45:40.697839 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:40.697839 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:40.697839 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:40.697839 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:40.697839 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:40.697839 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:40.697839 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:45:40.697839 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:45:40.697839 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:45:40.697839 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:45:40.697839 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:45:40.697839 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:45:40.697839 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:45:40.697839 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:45:40.697839 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:45:40.697839 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:45:40.697839 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8ec85bf-e448-4a4b-998d-a6bedb89d5e8 could not be found. Oct 17 13:45:40.697839 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:40.697839 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:40.697839 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:40.702894 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:40.702894 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:40.702894 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:40.702894 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:45:40.702894 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:45:40.702894 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8ec85bf-e448-4a4b-998d-a6bedb89d5e8 could not be found. Oct 17 13:45:40.702894 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:40.704714 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1ec9d3e2-1375-4ee8-8b8a-ed46fc009240 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Returning 404 to user: Instance c8ec85bf-e448-4a4b-998d-a6bedb89d5e8 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:45:40.705770 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1ec9d3e2-1375-4ee8-8b8a-ed46fc009240 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] 10.222.0.79 "GET /compute/v2.1/servers/c8ec85bf-e448-4a4b-998d-a6bedb89d5e8" status: 404 len: 111 microversion: 2.1 time: 0.095645 Oct 17 13:45:40.709148 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1417/2819] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:40 2022] GET /compute/v2.1/servers/c8ec85bf-e448-4a4b-998d-a6bedb89d5e8 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:45:40.720655 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-414e0d12-7486-4aa7-8465-dbd224ec6cb4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:40.721298 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-414e0d12-7486-4aa7-8465-dbd224ec6cb4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.034s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:40.721818 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-414e0d12-7486-4aa7-8465-dbd224ec6cb4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:40.722620 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-414e0d12-7486-4aa7-8465-dbd224ec6cb4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:40.723075 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-414e0d12-7486-4aa7-8465-dbd224ec6cb4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:40.723647 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-414e0d12-7486-4aa7-8465-dbd224ec6cb4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:40.727197 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b327a789-d438-4ca6-b761-1d90ed160b0e tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:40.728089 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b327a789-d438-4ca6-b761-1d90ed160b0e tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] [instance: b93ba3e5-0c3f-4e1b-825f-f788b1c32566] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:40.739481 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b327a789-d438-4ca6-b761-1d90ed160b0e tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:40.745002 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b327a789-d438-4ca6-b761-1d90ed160b0e tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:40.745739 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b327a789-d438-4ca6-b761-1d90ed160b0e tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:40.746797 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b327a789-d438-4ca6-b761-1d90ed160b0e tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:40.747608 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b327a789-d438-4ca6-b761-1d90ed160b0e tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:40.748233 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b327a789-d438-4ca6-b761-1d90ed160b0e tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:41.228919 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-414e0d12-7486-4aa7-8465-dbd224ec6cb4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:41.237866 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b327a789-d438-4ca6-b761-1d90ed160b0e tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e7aceb4e414d38a36d62fe086035d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338930cae76d48a19a9a0d960fc25457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:41.243756 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-414e0d12-7486-4aa7-8465-dbd224ec6cb4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 0.601555 Oct 17 13:45:41.244895 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1403/2820] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:40 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:41.253202 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7dac65fb-934a-4576-8ab7-db818598f4f3 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] Calling method '.version_select at 0x7f7cd498f700>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:41.269473 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b327a789-d438-4ca6-b761-1d90ed160b0e tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] 10.222.0.79 "GET /compute/v2.1/servers/b93ba3e5-0c3f-4e1b-825f-f788b1c32566" status: 200 len: 1324 microversion: 2.1 time: 0.557083 Oct 17 13:45:41.270079 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1418/2821] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:40 2022] GET /compute/v2.1/servers/b93ba3e5-0c3f-4e1b-825f-f788b1c32566 => generated 1324 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:41.283463 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f8bc096f-e28c-421e-a18c-e159b6342e74 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:41.284334 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f8bc096f-e28c-421e-a18c-e159b6342e74 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: 87134cd4-0fff-43ba-b0a3-c4a62e3de5b1] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:41.298570 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7dac65fb-934a-4576-8ab7-db818598f4f3 tempest-ServersTestFqdnHostnames-149498888 tempest-ServersTestFqdnHostnames-149498888-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-578260608" status: 202 len: 0 microversion: 2.1 time: 0.052342 Oct 17 13:45:41.299191 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1404/2822] 10.222.0.79 () {58 vars in 1218 bytes} [Mon Oct 17 13:45:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-578260608 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:45:41.302706 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f8bc096f-e28c-421e-a18c-e159b6342e74 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:41.303425 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f8bc096f-e28c-421e-a18c-e159b6342e74 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:41.303817 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-801f365b-1c53-441d-8e02-4a73ac362e50 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:41.304235 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f8bc096f-e28c-421e-a18c-e159b6342e74 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:41.305135 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f8bc096f-e28c-421e-a18c-e159b6342e74 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:41.305751 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f8bc096f-e28c-421e-a18c-e159b6342e74 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:41.306327 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f8bc096f-e28c-421e-a18c-e159b6342e74 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:41.310140 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-801f365b-1c53-441d-8e02-4a73ac362e50 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:41.328681 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-801f365b-1c53-441d-8e02-4a73ac362e50 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:41.329039 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-801f365b-1c53-441d-8e02-4a73ac362e50 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:41.329481 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-801f365b-1c53-441d-8e02-4a73ac362e50 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:41.330200 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-801f365b-1c53-441d-8e02-4a73ac362e50 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:41.330650 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-801f365b-1c53-441d-8e02-4a73ac362e50 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:41.331070 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-801f365b-1c53-441d-8e02-4a73ac362e50 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:41.921057 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f8bc096f-e28c-421e-a18c-e159b6342e74 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467250951f654e33b3e233868301bbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676987e95424497c94984347dd6a7988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:41.932374 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f8bc096f-e28c-421e-a18c-e159b6342e74 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "GET /compute/v2.1/servers/87134cd4-0fff-43ba-b0a3-c4a62e3de5b1" status: 200 len: 1669 microversion: 2.1 time: 0.661229 Oct 17 13:45:41.936041 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1419/2823] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:41 2022] GET /compute/v2.1/servers/87134cd4-0fff-43ba-b0a3-c4a62e3de5b1 => generated 1669 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:41.944398 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-e9d2f9d6-4e97-42f9-bd7a-04ae97142d8e req-9286eaeb-2c1b-4527-a5c2-a342c1d2a2b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b93ba3e5-0c3f-4e1b-825f-f788b1c32566", "tag": "7433f69b-78d0-4c1f-b875-f23a1a8e1fac"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:41.983778 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-e9d2f9d6-4e97-42f9-bd7a-04ae97142d8e req-9286eaeb-2c1b-4527-a5c2-a342c1d2a2b8 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:41.984716 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-e9d2f9d6-4e97-42f9-bd7a-04ae97142d8e req-9286eaeb-2c1b-4527-a5c2-a342c1d2a2b8 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:41.985304 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-e9d2f9d6-4e97-42f9-bd7a-04ae97142d8e req-9286eaeb-2c1b-4527-a5c2-a342c1d2a2b8 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:41.993718 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-801f365b-1c53-441d-8e02-4a73ac362e50 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:42.002234 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-e9d2f9d6-4e97-42f9-bd7a-04ae97142d8e req-9286eaeb-2c1b-4527-a5c2-a342c1d2a2b8 service nova] Creating event network-changed:7433f69b-78d0-4c1f-b875-f23a1a8e1fac for instance b93ba3e5-0c3f-4e1b-825f-f788b1c32566 on n-h2-854247-14 Oct 17 13:45:42.011138 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-e9d2f9d6-4e97-42f9-bd7a-04ae97142d8e req-9286eaeb-2c1b-4527-a5c2-a342c1d2a2b8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069641 Oct 17 13:45:42.011412 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-801f365b-1c53-441d-8e02-4a73ac362e50 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 0.708404 Oct 17 13:45:42.013002 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1405/2824] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:41 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:42.014378 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1420/2825] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:45:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:45:42.038034 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b99bbdf3-fd70-4181-a3e3-55c69af69ef5 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:42.038793 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b99bbdf3-fd70-4181-a3e3-55c69af69ef5 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 56cb072e-581d-415d-8838-3b07ca5f7348] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:42.040119 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-784ed61f-ed03-4c69-b6ae-1caf75275019 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:42.040713 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-784ed61f-ed03-4c69-b6ae-1caf75275019 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: 87134cd4-0fff-43ba-b0a3-c4a62e3de5b1] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:42.047530 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-b99bbdf3-fd70-4181-a3e3-55c69af69ef5 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] HTTP exception thrown: Instance 56cb072e-581d-415d-8838-3b07ca5f7348 could not be found. Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b99bbdf3-fd70-4181-a3e3-55c69af69ef5 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Request method failure captured: Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: request: POST /compute/v2.1/servers/56cb072e-581d-415d-8838-3b07ca5f7348/action HTTP/1.1 Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 13 Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVwEqzYAZh4AkEjRryOAZIhaHrAKxd2Qcal9md8a5n-MMUYSdXmcWYLDVkyQoPrDIbcsApBq2EewemPkBwvNDDOidb0hhc_Z3w9BeEUj5ET_flLYPqO5hgqCsuZGXFiYIEBJxrkx614fXiELZHaNkvhSdsJHShK0w7L-UPHhkPKqi5M Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_59e65f6eb06d40d583b9f43c9af94c13", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 443c44b0bd9e4c56a7fe0c1a53238545 Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: {"pause": {}} Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 56cb072e-581d-415d-8838-3b07ca5f7348 could not be found. Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '56cb072e-581d-415d-8838-3b07ca5f7348', 'body': {'pause': {}}} Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56cb072e-581d-415d-8838-3b07ca5f7348 could not be found. Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56cb072e-581d-415d-8838-3b07ca5f7348 could not be found. Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:42.056407 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:42.061255 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:45:42.061255 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:45:42.061255 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56cb072e-581d-415d-8838-3b07ca5f7348 could not be found. Oct 17 13:45:42.061255 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:42.061255 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b99bbdf3-fd70-4181-a3e3-55c69af69ef5 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Returning 404 to user: Instance 56cb072e-581d-415d-8838-3b07ca5f7348 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:45:42.061571 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-784ed61f-ed03-4c69-b6ae-1caf75275019 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:42.061653 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b99bbdf3-fd70-4181-a3e3-55c69af69ef5 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "POST /compute/v2.1/servers/56cb072e-581d-415d-8838-3b07ca5f7348/action" status: 404 len: 111 microversion: 2.1 time: 0.026421 Oct 17 13:45:42.062049 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-784ed61f-ed03-4c69-b6ae-1caf75275019 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:42.062131 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1421/2826] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:45:42 2022] POST /compute/v2.1/servers/56cb072e-581d-415d-8838-3b07ca5f7348/action => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:45:42.062214 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-784ed61f-ed03-4c69-b6ae-1caf75275019 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:42.062214 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-784ed61f-ed03-4c69-b6ae-1caf75275019 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:42.062214 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-784ed61f-ed03-4c69-b6ae-1caf75275019 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:42.062214 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-784ed61f-ed03-4c69-b6ae-1caf75275019 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:42.069732 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-29b7b7c1-ab9c-4d16-8299-87fec8371694 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:42.071472 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-29b7b7c1-ab9c-4d16-8299-87fec8371694 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:42.086917 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-29b7b7c1-ab9c-4d16-8299-87fec8371694 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:42.087453 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-29b7b7c1-ab9c-4d16-8299-87fec8371694 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:42.096602 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-29b7b7c1-ab9c-4d16-8299-87fec8371694 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:42.107335 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-29b7b7c1-ab9c-4d16-8299-87fec8371694 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:42.115825 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-29b7b7c1-ab9c-4d16-8299-87fec8371694 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:42.124294 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-29b7b7c1-ab9c-4d16-8299-87fec8371694 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:42.152519 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-784ed61f-ed03-4c69-b6ae-1caf75275019 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "GET /compute/v2.1/servers/87134cd4-0fff-43ba-b0a3-c4a62e3de5b1/ips" status: 200 len: 180 microversion: 2.1 time: 0.138297 Oct 17 13:45:42.154101 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1406/2827] 10.222.0.79 () {58 vars in 1248 bytes} [Mon Oct 17 13:45:42 2022] GET /compute/v2.1/servers/87134cd4-0fff-43ba-b0a3-c4a62e3de5b1/ips => generated 180 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:45:42.165412 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-171fbbcc-9c01-4d7d-b93e-045da4a6ef92 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:42.166154 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-171fbbcc-9c01-4d7d-b93e-045da4a6ef92 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: 87134cd4-0fff-43ba-b0a3-c4a62e3de5b1] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:42.182329 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-171fbbcc-9c01-4d7d-b93e-045da4a6ef92 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:42.182811 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-171fbbcc-9c01-4d7d-b93e-045da4a6ef92 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:42.183753 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-171fbbcc-9c01-4d7d-b93e-045da4a6ef92 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:42.185056 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-171fbbcc-9c01-4d7d-b93e-045da4a6ef92 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:42.186388 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-171fbbcc-9c01-4d7d-b93e-045da4a6ef92 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:42.186970 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-171fbbcc-9c01-4d7d-b93e-045da4a6ef92 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:42.239196 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-171fbbcc-9c01-4d7d-b93e-045da4a6ef92 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: 87134cd4-0fff-43ba-b0a3-c4a62e3de5b1] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:45:42.415454 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-171fbbcc-9c01-4d7d-b93e-045da4a6ef92 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "DELETE /compute/v2.1/servers/87134cd4-0fff-43ba-b0a3-c4a62e3de5b1" status: 204 len: 0 microversion: 2.1 time: 0.253283 Oct 17 13:45:42.416995 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1407/2828] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:45:42 2022] DELETE /compute/v2.1/servers/87134cd4-0fff-43ba-b0a3-c4a62e3de5b1 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:45:42.427017 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-840302e9-4e11-473c-82f6-87f14cb07f07 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:42.431645 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-840302e9-4e11-473c-82f6-87f14cb07f07 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] [instance: b93ba3e5-0c3f-4e1b-825f-f788b1c32566] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:42.448324 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-840302e9-4e11-473c-82f6-87f14cb07f07 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:42.448834 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-840302e9-4e11-473c-82f6-87f14cb07f07 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:42.449273 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-840302e9-4e11-473c-82f6-87f14cb07f07 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:42.451716 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-840302e9-4e11-473c-82f6-87f14cb07f07 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:42.454563 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-840302e9-4e11-473c-82f6-87f14cb07f07 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:42.455265 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-840302e9-4e11-473c-82f6-87f14cb07f07 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:43.235770 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-29b7b7c1-ab9c-4d16-8299-87fec8371694 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:43.249571 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-29b7b7c1-ab9c-4d16-8299-87fec8371694 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 1.183676 Oct 17 13:45:43.251040 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1422/2829] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:42 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:43.256283 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8760aba5-fd4e-48ef-a8b6-5e5f872ce95a tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:43.257179 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8760aba5-fd4e-48ef-a8b6-5e5f872ce95a tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: 87134cd4-0fff-43ba-b0a3-c4a62e3de5b1] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:43.265439 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8760aba5-fd4e-48ef-a8b6-5e5f872ce95a tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:43.270126 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8760aba5-fd4e-48ef-a8b6-5e5f872ce95a tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:43.270963 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8760aba5-fd4e-48ef-a8b6-5e5f872ce95a tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:43.273318 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8760aba5-fd4e-48ef-a8b6-5e5f872ce95a tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:43.273318 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8760aba5-fd4e-48ef-a8b6-5e5f872ce95a tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:43.273318 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8760aba5-fd4e-48ef-a8b6-5e5f872ce95a tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:43.400307 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-840302e9-4e11-473c-82f6-87f14cb07f07 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e7aceb4e414d38a36d62fe086035d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338930cae76d48a19a9a0d960fc25457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:43.413216 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-840302e9-4e11-473c-82f6-87f14cb07f07 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] 10.222.0.79 "GET /compute/v2.1/servers/b93ba3e5-0c3f-4e1b-825f-f788b1c32566" status: 200 len: 1324 microversion: 2.1 time: 0.994757 Oct 17 13:45:43.414194 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1408/2830] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:42 2022] GET /compute/v2.1/servers/b93ba3e5-0c3f-4e1b-825f-f788b1c32566 => generated 1324 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:43.424427 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-cd13be34-1baf-468c-b6fa-6ec494125fa1 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:43.425276 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-cd13be34-1baf-468c-b6fa-6ec494125fa1 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:43.434709 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cd13be34-1baf-468c-b6fa-6ec494125fa1 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:43.435520 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cd13be34-1baf-468c-b6fa-6ec494125fa1 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:43.436256 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cd13be34-1baf-468c-b6fa-6ec494125fa1 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:43.437280 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cd13be34-1baf-468c-b6fa-6ec494125fa1 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:43.437942 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cd13be34-1baf-468c-b6fa-6ec494125fa1 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:43.438469 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cd13be34-1baf-468c-b6fa-6ec494125fa1 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:43.624687 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8760aba5-fd4e-48ef-a8b6-5e5f872ce95a tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467250951f654e33b3e233868301bbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676987e95424497c94984347dd6a7988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:43.630112 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8760aba5-fd4e-48ef-a8b6-5e5f872ce95a tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "GET /compute/v2.1/servers/87134cd4-0fff-43ba-b0a3-c4a62e3de5b1" status: 200 len: 1675 microversion: 2.1 time: 0.377693 Oct 17 13:45:43.630795 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1423/2831] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:43 2022] GET /compute/v2.1/servers/87134cd4-0fff-43ba-b0a3-c4a62e3de5b1 => generated 1675 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:43.839464 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-cd13be34-1baf-468c-b6fa-6ec494125fa1 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:43.852884 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-cd13be34-1baf-468c-b6fa-6ec494125fa1 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 0.437393 Oct 17 13:45:43.854158 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1409/2832] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:43 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:43.879991 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f7d42e8b-aa5c-47d2-a7e2-905dff540fc6 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:43.880767 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f7d42e8b-aa5c-47d2-a7e2-905dff540fc6 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:43.894453 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f7d42e8b-aa5c-47d2-a7e2-905dff540fc6 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:43.895288 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f7d42e8b-aa5c-47d2-a7e2-905dff540fc6 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:43.895888 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f7d42e8b-aa5c-47d2-a7e2-905dff540fc6 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:43.896781 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f7d42e8b-aa5c-47d2-a7e2-905dff540fc6 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:43.897409 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f7d42e8b-aa5c-47d2-a7e2-905dff540fc6 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:43.898074 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f7d42e8b-aa5c-47d2-a7e2-905dff540fc6 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:44.071373 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f7d42e8b-aa5c-47d2-a7e2-905dff540fc6 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "POST /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca/action" status: 202 len: 0 microversion: 2.1 time: 0.195101 Oct 17 13:45:44.072436 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1424/2833] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:45:43 2022] POST /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:45:44.085464 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3fc9ba79-7070-49e5-90c9-40cecd1e7eeb tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:44.094628 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3fc9ba79-7070-49e5-90c9-40cecd1e7eeb tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:44.119151 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3fc9ba79-7070-49e5-90c9-40cecd1e7eeb tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:44.120042 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3fc9ba79-7070-49e5-90c9-40cecd1e7eeb tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:44.120955 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3fc9ba79-7070-49e5-90c9-40cecd1e7eeb tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:44.123930 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3fc9ba79-7070-49e5-90c9-40cecd1e7eeb tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:44.126172 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3fc9ba79-7070-49e5-90c9-40cecd1e7eeb tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:44.129089 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3fc9ba79-7070-49e5-90c9-40cecd1e7eeb tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:44.290219 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b994b0fc-0624-4869-bb4b-ce1aab3cb8f2 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-29225823", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "78e524a2-ee09-4045-aff8-792bc0397f6e"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:44.405656 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-b994b0fc-0624-4869-bb4b-ce1aab3cb8f2 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] validate_networks() for [('78e524a2-ee09-4045-aff8-792bc0397f6e', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:45:45.418320 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3fc9ba79-7070-49e5-90c9-40cecd1e7eeb tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:45.429045 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3fc9ba79-7070-49e5-90c9-40cecd1e7eeb tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1511 microversion: 2.1 time: 1.347680 Oct 17 13:45:45.429663 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1425/2834] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:44 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1511 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:45.440705 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cc2bd64d-3993-40cc-a7e5-69d743cdd8e6 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:45.442269 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cc2bd64d-3993-40cc-a7e5-69d743cdd8e6 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] [instance: b93ba3e5-0c3f-4e1b-825f-f788b1c32566] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:45.455159 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cc2bd64d-3993-40cc-a7e5-69d743cdd8e6 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:45.455759 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cc2bd64d-3993-40cc-a7e5-69d743cdd8e6 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:45.467648 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cc2bd64d-3993-40cc-a7e5-69d743cdd8e6 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:45.475378 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cc2bd64d-3993-40cc-a7e5-69d743cdd8e6 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:45.476027 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cc2bd64d-3993-40cc-a7e5-69d743cdd8e6 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:45.476482 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cc2bd64d-3993-40cc-a7e5-69d743cdd8e6 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:46.480187 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cc2bd64d-3993-40cc-a7e5-69d743cdd8e6 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e7aceb4e414d38a36d62fe086035d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338930cae76d48a19a9a0d960fc25457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:46.489471 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cc2bd64d-3993-40cc-a7e5-69d743cdd8e6 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] 10.222.0.79 "GET /compute/v2.1/servers/b93ba3e5-0c3f-4e1b-825f-f788b1c32566" status: 200 len: 1324 microversion: 2.1 time: 1.055037 Oct 17 13:45:46.497323 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1426/2835] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:45 2022] GET /compute/v2.1/servers/b93ba3e5-0c3f-4e1b-825f-f788b1c32566 => generated 1324 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:46.518284 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-017b57e7-d808-401c-9468-86b0df8117c3 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:46.518908 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-017b57e7-d808-401c-9468-86b0df8117c3 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: 87134cd4-0fff-43ba-b0a3-c4a62e3de5b1] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:46.534908 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-017b57e7-d808-401c-9468-86b0df8117c3 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:46.535805 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-017b57e7-d808-401c-9468-86b0df8117c3 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:46.536553 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-017b57e7-d808-401c-9468-86b0df8117c3 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:46.537470 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-017b57e7-d808-401c-9468-86b0df8117c3 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:46.538941 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-017b57e7-d808-401c-9468-86b0df8117c3 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:46.539666 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-017b57e7-d808-401c-9468-86b0df8117c3 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:46.699244 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-b994b0fc-0624-4869-bb4b-ce1aab3cb8f2 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:45:46.700192 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-b994b0fc-0624-4869-bb4b-ce1aab3cb8f2 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:45:46.700905 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-b994b0fc-0624-4869-bb4b-ce1aab3cb8f2 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:45:46.701459 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-b994b0fc-0624-4869-bb4b-ce1aab3cb8f2 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:45:46.702308 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-b994b0fc-0624-4869-bb4b-ce1aab3cb8f2 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:45:46.730008 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b994b0fc-0624-4869-bb4b-ce1aab3cb8f2 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:46.732252 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b994b0fc-0624-4869-bb4b-ce1aab3cb8f2 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:46.732707 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b994b0fc-0624-4869-bb4b-ce1aab3cb8f2 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:46.736066 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b994b0fc-0624-4869-bb4b-ce1aab3cb8f2 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:46.736550 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b994b0fc-0624-4869-bb4b-ce1aab3cb8f2 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:46.736982 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b994b0fc-0624-4869-bb4b-ce1aab3cb8f2 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:46.771237 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-b994b0fc-0624-4869-bb4b-ce1aab3cb8f2 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Getting quotas for project 18f91db965084796a4a3dce1b4e921e5. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:45:46.777152 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-b994b0fc-0624-4869-bb4b-ce1aab3cb8f2 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Getting quotas for user 43a3472f83914990ad41f037b4aafd63 and project 18f91db965084796a4a3dce1b4e921e5. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:45:46.792878 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b994b0fc-0624-4869-bb4b-ce1aab3cb8f2 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:45:46.795705 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b994b0fc-0624-4869-bb4b-ce1aab3cb8f2 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] [instance: 50e9eae9-df55-48ee-b984-e6b7e4bb2628] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:45:46.856774 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b994b0fc-0624-4869-bb4b-ce1aab3cb8f2 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.910719 Oct 17 13:45:46.857518 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1410/2836] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:45:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2912 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:45:46.876405 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a2d373bc-c6eb-4971-80d9-b85b7eee072d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:46.881747 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a2d373bc-c6eb-4971-80d9-b85b7eee072d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:46.891706 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a2d373bc-c6eb-4971-80d9-b85b7eee072d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:46.894973 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a2d373bc-c6eb-4971-80d9-b85b7eee072d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:46.895650 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a2d373bc-c6eb-4971-80d9-b85b7eee072d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:46.914812 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a2d373bc-c6eb-4971-80d9-b85b7eee072d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:46.916170 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a2d373bc-c6eb-4971-80d9-b85b7eee072d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:46.918885 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a2d373bc-c6eb-4971-80d9-b85b7eee072d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:47.383637 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-017b57e7-d808-401c-9468-86b0df8117c3 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467250951f654e33b3e233868301bbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676987e95424497c94984347dd6a7988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:47.398187 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-017b57e7-d808-401c-9468-86b0df8117c3 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "GET /compute/v2.1/servers/87134cd4-0fff-43ba-b0a3-c4a62e3de5b1" status: 200 len: 1654 microversion: 2.1 time: 0.899595 Oct 17 13:45:47.399887 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1427/2837] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:46 2022] GET /compute/v2.1/servers/87134cd4-0fff-43ba-b0a3-c4a62e3de5b1 => generated 1654 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:47.419545 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9bcacb06-5773-4b57-9afa-206b2e8567ba tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:47.420369 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9bcacb06-5773-4b57-9afa-206b2e8567ba tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] [instance: 50e9eae9-df55-48ee-b984-e6b7e4bb2628] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:47.866492 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9bcacb06-5773-4b57-9afa-206b2e8567ba tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a3472f83914990ad41f037b4aafd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f91db965084796a4a3dce1b4e921e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:47.878852 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9bcacb06-5773-4b57-9afa-206b2e8567ba tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] 10.222.0.79 "GET /compute/v2.1/servers/50e9eae9-df55-48ee-b984-e6b7e4bb2628" status: 200 len: 1222 microversion: 2.1 time: 0.477390 Oct 17 13:45:47.879464 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1428/2838] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:47 2022] GET /compute/v2.1/servers/50e9eae9-df55-48ee-b984-e6b7e4bb2628 => generated 1222 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:47.973800 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a2d373bc-c6eb-4971-80d9-b85b7eee072d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:48.002541 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a2d373bc-c6eb-4971-80d9-b85b7eee072d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1491 microversion: 2.1 time: 1.132743 Oct 17 13:45:48.008661 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1411/2839] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:46 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1491 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:48.031412 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-48c3898b-1a8c-4da6-b5a0-fdfab120d6ab req-544a62b8-869e-4980-91cf-175590e065fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b93ba3e5-0c3f-4e1b-825f-f788b1c32566", "name": "network-vif-plugged", "status": "completed", "tag": "7433f69b-78d0-4c1f-b875-f23a1a8e1fac"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:48.087021 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-48c3898b-1a8c-4da6-b5a0-fdfab120d6ab req-544a62b8-869e-4980-91cf-175590e065fd service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:48.106669 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-48c3898b-1a8c-4da6-b5a0-fdfab120d6ab req-544a62b8-869e-4980-91cf-175590e065fd service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:48.107274 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-48c3898b-1a8c-4da6-b5a0-fdfab120d6ab req-544a62b8-869e-4980-91cf-175590e065fd service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:48.140409 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-48c3898b-1a8c-4da6-b5a0-fdfab120d6ab req-544a62b8-869e-4980-91cf-175590e065fd service nova] Creating event network-vif-plugged:7433f69b-78d0-4c1f-b875-f23a1a8e1fac for instance b93ba3e5-0c3f-4e1b-825f-f788b1c32566 on n-h2-854247-14 Oct 17 13:45:48.151221 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-48c3898b-1a8c-4da6-b5a0-fdfab120d6ab req-544a62b8-869e-4980-91cf-175590e065fd service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137038 Oct 17 13:45:48.154518 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1412/2840] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:45:48.160719 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-9d700636-da79-4f3f-bd61-f3dbf83488c9 req-febc9514-e05c-42d1-8db8-24897a1ee1bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87134cd4-0fff-43ba-b0a3-c4a62e3de5b1", "name": "network-vif-deleted", "tag": "d6910502-acfa-4d10-b826-aef72e177e6f"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:48.189394 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-9d700636-da79-4f3f-bd61-f3dbf83488c9 req-febc9514-e05c-42d1-8db8-24897a1ee1bd service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:48.193167 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-9d700636-da79-4f3f-bd61-f3dbf83488c9 req-febc9514-e05c-42d1-8db8-24897a1ee1bd service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:48.194384 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-9d700636-da79-4f3f-bd61-f3dbf83488c9 req-febc9514-e05c-42d1-8db8-24897a1ee1bd service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:48.222877 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-575e0b09-9658-4227-bf49-d04c9d330412 tempest-MultipleCreateNegativeTestJSON-1436165126 tempest-MultipleCreateNegativeTestJSON-1436165126-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-108075942", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:48.225227 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-9d700636-da79-4f3f-bd61-f3dbf83488c9 req-febc9514-e05c-42d1-8db8-24897a1ee1bd service nova] Creating event network-vif-deleted:d6910502-acfa-4d10-b826-aef72e177e6f for instance 87134cd4-0fff-43ba-b0a3-c4a62e3de5b1 on n-h2-854247-14 Oct 17 13:45:48.236779 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-9d700636-da79-4f3f-bd61-f3dbf83488c9 req-febc9514-e05c-42d1-8db8-24897a1ee1bd service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080537 Oct 17 13:45:48.237834 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1413/2841] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:45:48.243804 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-58dfb5f1-b530-4f5c-991b-4291d485c250 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:48.245263 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-58dfb5f1-b530-4f5c-991b-4291d485c250 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] [instance: b93ba3e5-0c3f-4e1b-825f-f788b1c32566] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:48.253655 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-58dfb5f1-b530-4f5c-991b-4291d485c250 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:48.254401 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-58dfb5f1-b530-4f5c-991b-4291d485c250 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:48.255312 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-575e0b09-9658-4227-bf49-d04c9d330412 tempest-MultipleCreateNegativeTestJSON-1436165126 tempest-MultipleCreateNegativeTestJSON-1436165126-project] HTTP exception thrown: min_count must be <= max_count Oct 17 13:45:48.255632 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-58dfb5f1-b530-4f5c-991b-4291d485c250 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:48.256643 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-58dfb5f1-b530-4f5c-991b-4291d485c250 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:48.258085 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-58dfb5f1-b530-4f5c-991b-4291d485c250 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:48.258731 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-58dfb5f1-b530-4f5c-991b-4291d485c250 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:48.285528 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-575e0b09-9658-4227-bf49-d04c9d330412 tempest-MultipleCreateNegativeTestJSON-1436165126 tempest-MultipleCreateNegativeTestJSON-1436165126-project] Request method failure captured: Oct 17 13:45:48.285528 n-d-854247-14 devstack@n-api.service[127016]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:45:48.285528 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:45:48.285528 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:45:48.285528 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:45:48.285528 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 183 Oct 17 13:45:48.285528 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:45:48.285528 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:45:48.285528 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:45:48.285528 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:45:48.285528 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVyKURk5Jgclcamh9WCSASQHKsF9DENLr57OYFzfszwHUZwSslASQnjLj-MuH6glClQfK2ctzfGXqo5bbzGiXPxblCby9WpVEp46IDmWF60PLjX7DakU_XNle5kAETCX3lQmZCc-rkh2DGqtBhCB0gzXJ9uSaYJg7VV_PJazJpYiNtA Oct 17 13:45:48.285528 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:45:48.285528 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:45:48.285528 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:45:48.285528 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:45:48.285528 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:45:48.285528 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:45:48.285528 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 2bd55c5f4fa14bc89dfe0a0f1a4a02db Oct 17 13:45:48.285528 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1436165126 Oct 17 13:45:48.285528 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:45:48.285528 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:45:48.285528 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2bd55c5f4fa14bc89dfe0a0f1a4a02db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2bd55c5f4fa14bc89dfe0a0f1a4a02db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2bd55c5f4fa14bc89dfe0a0f1a4a02db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2bd55c5f4fa14bc89dfe0a0f1a4a02db", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:45:48.285528 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1436165126 Oct 17 13:45:48.285528 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 2bd55c5f4fa14bc89dfe0a0f1a4a02db Oct 17 13:45:48.285528 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1436165126 Oct 17 13:45:48.285528 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-MultipleCreateNegativeTestJSON-1436165126-project Oct 17 13:45:48.285528 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:45:48.285528 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:45:48.285528 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: b19a78358c87445daab752dd7d1208c7 Oct 17 13:45:48.285528 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1436165126-project Oct 17 13:45:48.285528 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:45:48.285528 n-d-854247-14 devstack@n-api.service[127016]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-108075942", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 17 13:45:48.285528 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:45:48.285528 n-d-854247-14 devstack@n-api.service[127016]: exception: min_count must be <= max_count Oct 17 13:45:48.285528 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-108075942', 'imageRef': '0743b21b-a6ff-4d02-897c-eabb68c3ba07', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 17 13:45:48.285528 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:45:48.285528 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:48.285528 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:48.285528 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:48.285528 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:45:48.285528 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:45:48.285528 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:45:48.285528 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:45:48.285528 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:45:48.285528 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:45:48.285528 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:45:48.285528 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:45:48.285528 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:45:48.285528 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:45:48.285528 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 17 13:45:48.285528 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 17 13:45:48.285528 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 17 13:45:48.285528 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 17 13:45:48.285528 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:48.285528 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:48.285528 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:48.285528 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:48.285528 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:48.285528 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:48.285528 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:45:48.285528 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:45:48.285528 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 17 13:45:48.285528 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:48.296361 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-575e0b09-9658-4227-bf49-d04c9d330412 tempest-MultipleCreateNegativeTestJSON-1436165126 tempest-MultipleCreateNegativeTestJSON-1436165126-project] Returning 400 to user: min_count must be <= max_count {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:45:48.308842 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-575e0b09-9658-4227-bf49-d04c9d330412 tempest-MultipleCreateNegativeTestJSON-1436165126 tempest-MultipleCreateNegativeTestJSON-1436165126-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.397646 Oct 17 13:45:48.339718 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1429/2842] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:45:47 2022] POST /compute/v2.1/servers => generated 74 bytes in 440 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 17 13:45:48.372351 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-05965f61-e008-4515-adb3-603436106a96 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:48.373305 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-05965f61-e008-4515-adb3-603436106a96 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:48.426927 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-05965f61-e008-4515-adb3-603436106a96 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:48.429382 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-05965f61-e008-4515-adb3-603436106a96 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:48.430204 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-05965f61-e008-4515-adb3-603436106a96 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:48.441967 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-05965f61-e008-4515-adb3-603436106a96 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:48.443265 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-05965f61-e008-4515-adb3-603436106a96 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:48.444062 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-05965f61-e008-4515-adb3-603436106a96 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:48.527055 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-05965f61-e008-4515-adb3-603436106a96 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] HTTP exception thrown: Cannot 'pause' instance 5ef00d34-7f81-4649-a90a-a52cf78dbeca while it is in vm_state paused Oct 17 13:45:48.529298 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-05965f61-e008-4515-adb3-603436106a96 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Request method failure captured: Oct 17 13:45:48.529298 n-d-854247-14 devstack@n-api.service[127016]: request: POST /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca/action HTTP/1.1 Oct 17 13:45:48.529298 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:45:48.529298 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:45:48.529298 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:45:48.529298 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 13 Oct 17 13:45:48.529298 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:45:48.529298 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:45:48.529298 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:45:48.529298 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:45:48.529298 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVwEqzYAZh4AkEjRryOAZIhaHrAKxd2Qcal9md8a5n-MMUYSdXmcWYLDVkyQoPrDIbcsApBq2EewemPkBwvNDDOidb0hhc_Z3w9BeEUj5ET_flLYPqO5hgqCsuZGXFiYIEBJxrkx614fXiELZHaNkvhSdsJHShK0w7L-UPHhkPKqi5M Oct 17 13:45:48.529298 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:45:48.529298 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:45:48.529298 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:45:48.529298 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:45:48.529298 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:45:48.529298 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:45:48.529298 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:45:48.529298 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:48.529298 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:45:48.529298 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:45:48.529298 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_59e65f6eb06d40d583b9f43c9af94c13", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:45:48.529298 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:48.529298 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:45:48.529298 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:48.529298 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:45:48.529298 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:45:48.529298 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:45:48.529298 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 443c44b0bd9e4c56a7fe0c1a53238545 Oct 17 13:45:48.529298 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:45:48.529298 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:45:48.529298 n-d-854247-14 devstack@n-api.service[127016]: {"pause": {}} Oct 17 13:45:48.529298 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:45:48.529298 n-d-854247-14 devstack@n-api.service[127016]: exception: Cannot 'pause' instance 5ef00d34-7f81-4649-a90a-a52cf78dbeca while it is in vm_state paused Oct 17 13:45:48.529298 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '5ef00d34-7f81-4649-a90a-a52cf78dbeca', 'body': {'pause': {}}} Oct 17 13:45:48.529298 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:45:48.529298 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:48.529298 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 17 13:45:48.529298 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 17 13:45:48.529298 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 13:45:48.529298 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:45:48.529298 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 13:45:48.529298 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 13:45:48.529298 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5ef00d34-7f81-4649-a90a-a52cf78dbeca in vm_state paused. Cannot pause while the instance is in this state. Oct 17 13:45:48.529298 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:48.529298 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:48.529298 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:48.529298 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:48.529298 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:48.529298 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:48.529298 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:45:48.529298 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:45:48.529298 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:45:48.529298 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:45:48.529298 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 17 13:45:48.529298 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 17 13:45:48.529298 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 13:45:48.529298 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 13:45:48.529298 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 5ef00d34-7f81-4649-a90a-a52cf78dbeca while it is in vm_state paused Oct 17 13:45:48.529298 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:48.529298 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:48.529298 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:48.529298 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:48.529298 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:48.533567 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:48.533567 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:45:48.533567 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:45:48.533567 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 5ef00d34-7f81-4649-a90a-a52cf78dbeca while it is in vm_state paused Oct 17 13:45:48.533567 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:48.536089 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-05965f61-e008-4515-adb3-603436106a96 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Returning 409 to user: Cannot 'pause' instance 5ef00d34-7f81-4649-a90a-a52cf78dbeca while it is in vm_state paused {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:45:48.537493 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-05965f61-e008-4515-adb3-603436106a96 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "POST /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca/action" status: 409 len: 143 microversion: 2.1 time: 0.189635 Oct 17 13:45:48.541805 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1430/2843] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:45:48 2022] POST /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca/action => generated 143 bytes in 201 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:45:48.548057 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ad5dd74f-dac5-4090-a61a-69c4572b33fb tempest-MultipleCreateNegativeTestJSON-1436165126 tempest-MultipleCreateNegativeTestJSON-1436165126-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-56453498", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "max_count": 0}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ad5dd74f-dac5-4090-a61a-69c4572b33fb tempest-MultipleCreateNegativeTestJSON-1436165126 tempest-MultipleCreateNegativeTestJSON-1436165126-project] Request method failure captured: Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 166 Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVyKURk5Jgclcamh9WCSASQHKsF9DENLr57OYFzfszwHUZwSslASQnjLj-MuH6glClQfK2ctzfGXqo5bbzGiXPxblCby9WpVEp46IDmWF60PLjX7DakU_XNle5kAETCX3lQmZCc-rkh2DGqtBhCB0gzXJ9uSaYJg7VV_PJazJpYiNtA Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 2bd55c5f4fa14bc89dfe0a0f1a4a02db Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1436165126 Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2bd55c5f4fa14bc89dfe0a0f1a4a02db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2bd55c5f4fa14bc89dfe0a0f1a4a02db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2bd55c5f4fa14bc89dfe0a0f1a4a02db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2bd55c5f4fa14bc89dfe0a0f1a4a02db", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1436165126 Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 2bd55c5f4fa14bc89dfe0a0f1a4a02db Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1436165126 Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-MultipleCreateNegativeTestJSON-1436165126-project Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: b19a78358c87445daab752dd7d1208c7 Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1436165126-project Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-56453498", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "max_count": 0}} Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-56453498', 'imageRef': '0743b21b-a6ff-4d02-897c-eabb68c3ba07', 'flavorRef': '452', 'max_count': 0}}} Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi 0 Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:45:48.553148 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:45:48.557726 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:45:48.557726 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:45:48.557726 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:45:48.557726 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:45:48.557726 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 17 13:45:48.557726 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:48.557726 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:48.557726 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:48.557726 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:48.557726 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:48.557726 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:48.557726 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:45:48.557726 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:45:48.557726 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 17 13:45:48.557726 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:48.560421 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ad5dd74f-dac5-4090-a61a-69c4572b33fb tempest-MultipleCreateNegativeTestJSON-1436165126 tempest-MultipleCreateNegativeTestJSON-1436165126-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:45:48.561936 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ad5dd74f-dac5-4090-a61a-69c4572b33fb tempest-MultipleCreateNegativeTestJSON-1436165126 tempest-MultipleCreateNegativeTestJSON-1436165126-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.018728 Oct 17 13:45:48.562888 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1431/2844] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:45:48 2022] POST /compute/v2.1/servers => generated 130 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:45:48.568121 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9d9dfa2b-77f2-489c-8bf8-84bfb52c442d tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:48.569066 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9d9dfa2b-77f2-489c-8bf8-84bfb52c442d tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: 87134cd4-0fff-43ba-b0a3-c4a62e3de5b1] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:48.577283 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9d9dfa2b-77f2-489c-8bf8-84bfb52c442d tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:48.577846 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9d9dfa2b-77f2-489c-8bf8-84bfb52c442d tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:48.578350 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9d9dfa2b-77f2-489c-8bf8-84bfb52c442d tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:48.580184 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9d9dfa2b-77f2-489c-8bf8-84bfb52c442d tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:48.580736 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9d9dfa2b-77f2-489c-8bf8-84bfb52c442d tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:48.581346 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9d9dfa2b-77f2-489c-8bf8-84bfb52c442d tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:49.430293 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-58dfb5f1-b530-4f5c-991b-4291d485c250 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e7aceb4e414d38a36d62fe086035d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338930cae76d48a19a9a0d960fc25457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:49.441655 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-58dfb5f1-b530-4f5c-991b-4291d485c250 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] 10.222.0.79 "GET /compute/v2.1/servers/b93ba3e5-0c3f-4e1b-825f-f788b1c32566" status: 200 len: 1324 microversion: 2.1 time: 1.202338 Oct 17 13:45:49.445208 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1414/2845] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:48 2022] GET /compute/v2.1/servers/b93ba3e5-0c3f-4e1b-825f-f788b1c32566 => generated 1324 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:49.457881 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6ecaad49-47aa-4ada-bcff-ce4f2df16cca tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:49.458698 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6ecaad49-47aa-4ada-bcff-ce4f2df16cca tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:49.479488 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6ecaad49-47aa-4ada-bcff-ce4f2df16cca tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:49.482579 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6ecaad49-47aa-4ada-bcff-ce4f2df16cca tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:49.483305 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6ecaad49-47aa-4ada-bcff-ce4f2df16cca tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:49.486583 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6ecaad49-47aa-4ada-bcff-ce4f2df16cca tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:49.487313 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6ecaad49-47aa-4ada-bcff-ce4f2df16cca tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:49.488206 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6ecaad49-47aa-4ada-bcff-ce4f2df16cca tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:49.616166 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6ecaad49-47aa-4ada-bcff-ce4f2df16cca tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "POST /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca/action" status: 202 len: 0 microversion: 2.1 time: 0.168543 Oct 17 13:45:49.617583 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1415/2846] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:45:49 2022] POST /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:45:49.623061 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-caa75e64-7234-4489-80c7-d9e16832fc48 tempest-MultipleCreateNegativeTestJSON-1436165126 tempest-MultipleCreateNegativeTestJSON-1436165126-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-354324640", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "max_count": 2.5}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-caa75e64-7234-4489-80c7-d9e16832fc48 tempest-MultipleCreateNegativeTestJSON-1436165126 tempest-MultipleCreateNegativeTestJSON-1436165126-project] Request method failure captured: Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 169 Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVyKURk5Jgclcamh9WCSASQHKsF9DENLr57OYFzfszwHUZwSslASQnjLj-MuH6glClQfK2ctzfGXqo5bbzGiXPxblCby9WpVEp46IDmWF60PLjX7DakU_XNle5kAETCX3lQmZCc-rkh2DGqtBhCB0gzXJ9uSaYJg7VV_PJazJpYiNtA Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 2bd55c5f4fa14bc89dfe0a0f1a4a02db Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1436165126 Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2bd55c5f4fa14bc89dfe0a0f1a4a02db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2bd55c5f4fa14bc89dfe0a0f1a4a02db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2bd55c5f4fa14bc89dfe0a0f1a4a02db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2bd55c5f4fa14bc89dfe0a0f1a4a02db", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1436165126 Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 2bd55c5f4fa14bc89dfe0a0f1a4a02db Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1436165126 Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-MultipleCreateNegativeTestJSON-1436165126-project Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: b19a78358c87445daab752dd7d1208c7 Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1436165126-project Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-354324640", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "max_count": 2.5}} Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-354324640', 'imageRef': '0743b21b-a6ff-4d02-897c-eabb68c3ba07', 'flavorRef': '452', 'max_count': 2.5}}} Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi 2.5 Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:45:49.636805 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:45:49.643648 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:45:49.643648 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:45:49.643648 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:45:49.643648 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:45:49.643648 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 17 13:45:49.643648 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:49.643648 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:49.643648 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:49.643648 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:49.643648 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:49.643648 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:49.643648 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:45:49.643648 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:45:49.643648 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 17 13:45:49.643648 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:49.643648 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-caa75e64-7234-4489-80c7-d9e16832fc48 tempest-MultipleCreateNegativeTestJSON-1436165126 tempest-MultipleCreateNegativeTestJSON-1436165126-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:45:49.643648 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-caa75e64-7234-4489-80c7-d9e16832fc48 tempest-MultipleCreateNegativeTestJSON-1436165126 tempest-MultipleCreateNegativeTestJSON-1436165126-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.019370 Oct 17 13:45:49.643648 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1416/2847] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:45:49 2022] POST /compute/v2.1/servers => generated 139 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:45:49.645891 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bab184de-6125-49e7-a490-070a18b8f088 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:49.647348 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-bab184de-6125-49e7-a490-070a18b8f088 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] [instance: 50e9eae9-df55-48ee-b984-e6b7e4bb2628] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:49.654718 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bab184de-6125-49e7-a490-070a18b8f088 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:49.655298 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bab184de-6125-49e7-a490-070a18b8f088 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:49.655735 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bab184de-6125-49e7-a490-070a18b8f088 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:49.656630 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bab184de-6125-49e7-a490-070a18b8f088 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:49.657250 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bab184de-6125-49e7-a490-070a18b8f088 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:49.658946 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bab184de-6125-49e7-a490-070a18b8f088 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:50.006361 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-bab184de-6125-49e7-a490-070a18b8f088 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a3472f83914990ad41f037b4aafd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f91db965084796a4a3dce1b4e921e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:50.017876 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-bab184de-6125-49e7-a490-070a18b8f088 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] 10.222.0.79 "GET /compute/v2.1/servers/50e9eae9-df55-48ee-b984-e6b7e4bb2628" status: 200 len: 1280 microversion: 2.1 time: 0.377894 Oct 17 13:45:50.018631 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1417/2848] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:49 2022] GET /compute/v2.1/servers/50e9eae9-df55-48ee-b984-e6b7e4bb2628 => generated 1280 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:50.029117 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-acc14cbe-e342-4a2c-ba26-1fa311eeb356 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:50.031873 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-acc14cbe-e342-4a2c-ba26-1fa311eeb356 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:50.040027 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-acc14cbe-e342-4a2c-ba26-1fa311eeb356 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:50.040516 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-acc14cbe-e342-4a2c-ba26-1fa311eeb356 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:50.040997 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-acc14cbe-e342-4a2c-ba26-1fa311eeb356 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:50.041698 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-acc14cbe-e342-4a2c-ba26-1fa311eeb356 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:50.042142 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-acc14cbe-e342-4a2c-ba26-1fa311eeb356 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:50.042560 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-acc14cbe-e342-4a2c-ba26-1fa311eeb356 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:50.174126 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9d9dfa2b-77f2-489c-8bf8-84bfb52c442d tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467250951f654e33b3e233868301bbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676987e95424497c94984347dd6a7988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:50.184044 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9d9dfa2b-77f2-489c-8bf8-84bfb52c442d tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "GET /compute/v2.1/servers/87134cd4-0fff-43ba-b0a3-c4a62e3de5b1" status: 200 len: 1495 microversion: 2.1 time: 1.619556 Oct 17 13:45:50.184939 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1432/2849] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:48 2022] GET /compute/v2.1/servers/87134cd4-0fff-43ba-b0a3-c4a62e3de5b1 => generated 1495 bytes in 1621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:50.191639 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-79e7dc90-c6a9-4b1a-9ca8-680a4b672842 tempest-MultipleCreateNegativeTestJSON-1436165126 tempest-MultipleCreateNegativeTestJSON-1436165126-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-164322536", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "min_count": 0}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-79e7dc90-c6a9-4b1a-9ca8-680a4b672842 tempest-MultipleCreateNegativeTestJSON-1436165126 tempest-MultipleCreateNegativeTestJSON-1436165126-project] Request method failure captured: Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 167 Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVyKURk5Jgclcamh9WCSASQHKsF9DENLr57OYFzfszwHUZwSslASQnjLj-MuH6glClQfK2ctzfGXqo5bbzGiXPxblCby9WpVEp46IDmWF60PLjX7DakU_XNle5kAETCX3lQmZCc-rkh2DGqtBhCB0gzXJ9uSaYJg7VV_PJazJpYiNtA Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 2bd55c5f4fa14bc89dfe0a0f1a4a02db Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1436165126 Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2bd55c5f4fa14bc89dfe0a0f1a4a02db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2bd55c5f4fa14bc89dfe0a0f1a4a02db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2bd55c5f4fa14bc89dfe0a0f1a4a02db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2bd55c5f4fa14bc89dfe0a0f1a4a02db", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1436165126 Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 2bd55c5f4fa14bc89dfe0a0f1a4a02db Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1436165126 Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-MultipleCreateNegativeTestJSON-1436165126-project Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: b19a78358c87445daab752dd7d1208c7 Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1436165126-project Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-164322536", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "min_count": 0}} Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-164322536', 'imageRef': '0743b21b-a6ff-4d02-897c-eabb68c3ba07', 'flavorRef': '452', 'min_count': 0}}} Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi 0 Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:45:50.197268 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:45:50.203688 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:45:50.203688 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:45:50.203688 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:45:50.203688 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:45:50.203688 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 17 13:45:50.203688 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:50.203688 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:50.203688 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:50.203688 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:50.203688 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:50.203688 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:50.203688 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:45:50.203688 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:45:50.203688 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 17 13:45:50.203688 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:50.205898 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-79e7dc90-c6a9-4b1a-9ca8-680a4b672842 tempest-MultipleCreateNegativeTestJSON-1436165126 tempest-MultipleCreateNegativeTestJSON-1436165126-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:45:50.207055 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-79e7dc90-c6a9-4b1a-9ca8-680a4b672842 tempest-MultipleCreateNegativeTestJSON-1436165126 tempest-MultipleCreateNegativeTestJSON-1436165126-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.020760 Oct 17 13:45:50.207969 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1433/2850] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:45:50 2022] POST /compute/v2.1/servers => generated 130 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:45:50.411221 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-905cce00-5cba-42f1-964e-e3b1e0983abd tempest-MultipleCreateNegativeTestJSON-1436165126 tempest-MultipleCreateNegativeTestJSON-1436165126-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2055422807", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "min_count": 2.5}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-905cce00-5cba-42f1-964e-e3b1e0983abd tempest-MultipleCreateNegativeTestJSON-1436165126 tempest-MultipleCreateNegativeTestJSON-1436165126-project] Request method failure captured: Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 170 Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVyKURk5Jgclcamh9WCSASQHKsF9DENLr57OYFzfszwHUZwSslASQnjLj-MuH6glClQfK2ctzfGXqo5bbzGiXPxblCby9WpVEp46IDmWF60PLjX7DakU_XNle5kAETCX3lQmZCc-rkh2DGqtBhCB0gzXJ9uSaYJg7VV_PJazJpYiNtA Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 2bd55c5f4fa14bc89dfe0a0f1a4a02db Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1436165126 Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2bd55c5f4fa14bc89dfe0a0f1a4a02db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2bd55c5f4fa14bc89dfe0a0f1a4a02db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2bd55c5f4fa14bc89dfe0a0f1a4a02db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2bd55c5f4fa14bc89dfe0a0f1a4a02db", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1436165126 Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 2bd55c5f4fa14bc89dfe0a0f1a4a02db Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1436165126 Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-MultipleCreateNegativeTestJSON-1436165126-project Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: b19a78358c87445daab752dd7d1208c7 Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1436165126-project Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2055422807", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "min_count": 2.5}} Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2055422807', 'imageRef': '0743b21b-a6ff-4d02-897c-eabb68c3ba07', 'flavorRef': '452', 'min_count': 2.5}}} Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi 2.5 Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:45:50.419601 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:45:50.423827 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:45:50.423827 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:45:50.423827 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:45:50.423827 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:45:50.423827 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 17 13:45:50.423827 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:50.423827 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:50.423827 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:50.423827 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:50.423827 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:50.423827 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:50.423827 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:45:50.423827 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:45:50.423827 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 17 13:45:50.423827 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:50.426499 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-905cce00-5cba-42f1-964e-e3b1e0983abd tempest-MultipleCreateNegativeTestJSON-1436165126 tempest-MultipleCreateNegativeTestJSON-1436165126-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:45:50.427781 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-905cce00-5cba-42f1-964e-e3b1e0983abd tempest-MultipleCreateNegativeTestJSON-1436165126 tempest-MultipleCreateNegativeTestJSON-1436165126-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.020752 Oct 17 13:45:50.428578 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1434/2851] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:45:50 2022] POST /compute/v2.1/servers => generated 139 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:45:50.467676 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d07e9361-0f7f-4e68-b989-5fbbf3c50df4 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:50.468848 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d07e9361-0f7f-4e68-b989-5fbbf3c50df4 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] [instance: b93ba3e5-0c3f-4e1b-825f-f788b1c32566] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:50.477022 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d07e9361-0f7f-4e68-b989-5fbbf3c50df4 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:50.488334 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d07e9361-0f7f-4e68-b989-5fbbf3c50df4 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:50.491783 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d07e9361-0f7f-4e68-b989-5fbbf3c50df4 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:50.492783 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d07e9361-0f7f-4e68-b989-5fbbf3c50df4 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:50.494196 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d07e9361-0f7f-4e68-b989-5fbbf3c50df4 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:50.509836 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d07e9361-0f7f-4e68-b989-5fbbf3c50df4 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:50.911880 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-acc14cbe-e342-4a2c-ba26-1fa311eeb356 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:50.927336 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-acc14cbe-e342-4a2c-ba26-1fa311eeb356 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 0.905911 Oct 17 13:45:50.928308 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1418/2852] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:50 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:50.951243 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-16702113-7001-4783-8a88-f904bec45632 req-2fa02d36-9f06-4dd9-b4b8-5cdbfc921d8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87134cd4-0fff-43ba-b0a3-c4a62e3de5b1", "name": "network-vif-unplugged", "status": "completed", "tag": "b5b05ac2-9883-43f6-aab3-a7d8332ddce5"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:50.978410 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-16702113-7001-4783-8a88-f904bec45632 req-2fa02d36-9f06-4dd9-b4b8-5cdbfc921d8d service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:50.981750 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-16702113-7001-4783-8a88-f904bec45632 req-2fa02d36-9f06-4dd9-b4b8-5cdbfc921d8d service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:50.986666 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-16702113-7001-4783-8a88-f904bec45632 req-2fa02d36-9f06-4dd9-b4b8-5cdbfc921d8d service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:51.004722 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-16702113-7001-4783-8a88-f904bec45632 req-2fa02d36-9f06-4dd9-b4b8-5cdbfc921d8d service nova] Creating event network-vif-unplugged:b5b05ac2-9883-43f6-aab3-a7d8332ddce5 for instance 87134cd4-0fff-43ba-b0a3-c4a62e3de5b1 on n-h2-854247-14 Oct 17 13:45:51.013596 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-16702113-7001-4783-8a88-f904bec45632 req-2fa02d36-9f06-4dd9-b4b8-5cdbfc921d8d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082068 Oct 17 13:45:51.014713 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1419/2853] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:45:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:45:51.029297 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0e3a06c8-a512-4d3c-a555-fccc290a0797 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:51.030229 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0e3a06c8-a512-4d3c-a555-fccc290a0797 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:51.056325 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0e3a06c8-a512-4d3c-a555-fccc290a0797 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:51.056819 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0e3a06c8-a512-4d3c-a555-fccc290a0797 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:51.057263 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0e3a06c8-a512-4d3c-a555-fccc290a0797 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:51.071509 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0e3a06c8-a512-4d3c-a555-fccc290a0797 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:51.072487 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0e3a06c8-a512-4d3c-a555-fccc290a0797 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:51.073169 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0e3a06c8-a512-4d3c-a555-fccc290a0797 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:51.087428 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:45:51.630210 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d07e9361-0f7f-4e68-b989-5fbbf3c50df4 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e7aceb4e414d38a36d62fe086035d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338930cae76d48a19a9a0d960fc25457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:51.633749 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0e3a06c8-a512-4d3c-a555-fccc290a0797 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:51.641665 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d07e9361-0f7f-4e68-b989-5fbbf3c50df4 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] 10.222.0.79 "GET /compute/v2.1/servers/b93ba3e5-0c3f-4e1b-825f-f788b1c32566" status: 200 len: 1324 microversion: 2.1 time: 1.178324 Oct 17 13:45:51.645578 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0e3a06c8-a512-4d3c-a555-fccc290a0797 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 0.629032 Oct 17 13:45:51.646376 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1420/2854] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:51 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:51.647481 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1435/2855] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:50 2022] GET /compute/v2.1/servers/b93ba3e5-0c3f-4e1b-825f-f788b1c32566 => generated 1324 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:45:51.663295 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-44cd93c4-40b8-4613-84ae-1fa4dc0f5aed tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:51.664280 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-44cd93c4-40b8-4613-84ae-1fa4dc0f5aed tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] [instance: 50e9eae9-df55-48ee-b984-e6b7e4bb2628] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:51.673640 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-44cd93c4-40b8-4613-84ae-1fa4dc0f5aed tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:51.675295 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-44cd93c4-40b8-4613-84ae-1fa4dc0f5aed tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:51.678206 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-44cd93c4-40b8-4613-84ae-1fa4dc0f5aed tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:51.679281 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-44cd93c4-40b8-4613-84ae-1fa4dc0f5aed tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:51.679969 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-44cd93c4-40b8-4613-84ae-1fa4dc0f5aed tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:51.682436 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-44cd93c4-40b8-4613-84ae-1fa4dc0f5aed tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:51.689751 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-85056781-aef4-4463-ae35-7e1c4fc609e0 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:51.699319 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-85056781-aef4-4463-ae35-7e1c4fc609e0 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: 87134cd4-0fff-43ba-b0a3-c4a62e3de5b1] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:51.710237 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-85056781-aef4-4463-ae35-7e1c4fc609e0 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:51.711110 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-85056781-aef4-4463-ae35-7e1c4fc609e0 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:51.711583 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-85056781-aef4-4463-ae35-7e1c4fc609e0 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:51.712814 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-85056781-aef4-4463-ae35-7e1c4fc609e0 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:51.713533 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-85056781-aef4-4463-ae35-7e1c4fc609e0 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:51.715298 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-85056781-aef4-4463-ae35-7e1c4fc609e0 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:51.772346 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:45:51.776093 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-85056781-aef4-4463-ae35-7e1c4fc609e0 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:51.776969 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-85056781-aef4-4463-ae35-7e1c4fc609e0 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:51.777608 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-85056781-aef4-4463-ae35-7e1c4fc609e0 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:51.779388 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-85056781-aef4-4463-ae35-7e1c4fc609e0 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lazy-loading 'fault' on Instance uuid 87134cd4-0fff-43ba-b0a3-c4a62e3de5b1 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:45:51.784479 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:45:51.983119 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-44cd93c4-40b8-4613-84ae-1fa4dc0f5aed tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a3472f83914990ad41f037b4aafd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f91db965084796a4a3dce1b4e921e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:51.998712 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-44cd93c4-40b8-4613-84ae-1fa4dc0f5aed tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] 10.222.0.79 "GET /compute/v2.1/servers/50e9eae9-df55-48ee-b984-e6b7e4bb2628" status: 200 len: 1280 microversion: 2.1 time: 0.350899 Oct 17 13:45:51.999418 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1421/2856] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:51 2022] GET /compute/v2.1/servers/50e9eae9-df55-48ee-b984-e6b7e4bb2628 => generated 1280 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:52.010098 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-fc4a6947-0d76-48ae-826c-4604eeafc8b4 req-53ca0583-d07f-446b-96da-5447e921b6e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87134cd4-0fff-43ba-b0a3-c4a62e3de5b1", "name": "network-vif-deleted", "tag": "b5b05ac2-9883-43f6-aab3-a7d8332ddce5"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:52.030883 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-fc4a6947-0d76-48ae-826c-4604eeafc8b4 req-53ca0583-d07f-446b-96da-5447e921b6e0 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:52.032292 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-fc4a6947-0d76-48ae-826c-4604eeafc8b4 req-53ca0583-d07f-446b-96da-5447e921b6e0 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:52.034032 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-fc4a6947-0d76-48ae-826c-4604eeafc8b4 req-53ca0583-d07f-446b-96da-5447e921b6e0 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:52.058103 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-fc4a6947-0d76-48ae-826c-4604eeafc8b4 req-53ca0583-d07f-446b-96da-5447e921b6e0 service nova] Creating event network-vif-deleted:b5b05ac2-9883-43f6-aab3-a7d8332ddce5 for instance 87134cd4-0fff-43ba-b0a3-c4a62e3de5b1 on n-h2-854247-14 Oct 17 13:45:52.077327 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-fc4a6947-0d76-48ae-826c-4604eeafc8b4 req-53ca0583-d07f-446b-96da-5447e921b6e0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076548 Oct 17 13:45:52.084618 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1422/2857] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:45:52.092463 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2a8b78d1-88ef-4781-9dfe-df8c6872218a tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:52.096197 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-85056781-aef4-4463-ae35-7e1c4fc609e0 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '467250951f654e33b3e233868301bbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676987e95424497c94984347dd6a7988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:52.115833 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-85056781-aef4-4463-ae35-7e1c4fc609e0 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "GET /compute/v2.1/servers/87134cd4-0fff-43ba-b0a3-c4a62e3de5b1" status: 200 len: 1302 microversion: 2.1 time: 0.451666 Oct 17 13:45:52.116431 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1436/2858] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:51 2022] GET /compute/v2.1/servers/87134cd4-0fff-43ba-b0a3-c4a62e3de5b1 => generated 1302 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:52.126782 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2a8b78d1-88ef-4781-9dfe-df8c6872218a tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 9be563ca-739e-4121-9dc8-9e46c7a131b6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:52.142530 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:45:52.146640 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2a8b78d1-88ef-4781-9dfe-df8c6872218a tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:52.147157 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2a8b78d1-88ef-4781-9dfe-df8c6872218a tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:52.147918 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2a8b78d1-88ef-4781-9dfe-df8c6872218a tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:52.149059 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2a8b78d1-88ef-4781-9dfe-df8c6872218a tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:52.149646 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2a8b78d1-88ef-4781-9dfe-df8c6872218a tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:52.150311 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2a8b78d1-88ef-4781-9dfe-df8c6872218a tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:52.181223 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-2a8b78d1-88ef-4781-9dfe-df8c6872218a tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] HTTP exception thrown: Instance 9be563ca-739e-4121-9dc8-9e46c7a131b6 could not be found. Oct 17 13:45:52.186616 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2a8b78d1-88ef-4781-9dfe-df8c6872218a tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Request method failure captured: Oct 17 13:45:52.186616 n-d-854247-14 devstack@n-api.service[127017]: request: POST /compute/v2.1/servers/9be563ca-739e-4121-9dc8-9e46c7a131b6/action HTTP/1.1 Oct 17 13:45:52.186616 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:45:52.186616 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:45:52.186616 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:45:52.186616 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 28 Oct 17 13:45:52.186616 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:45:52.186616 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:45:52.186616 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:45:52.186616 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:45:52.186616 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVwEqzYAZh4AkEjRryOAZIhaHrAKxd2Qcal9md8a5n-MMUYSdXmcWYLDVkyQoPrDIbcsApBq2EewemPkBwvNDDOidb0hhc_Z3w9BeEUj5ET_flLYPqO5hgqCsuZGXFiYIEBJxrkx614fXiELZHaNkvhSdsJHShK0w7L-UPHhkPKqi5M Oct 17 13:45:52.186616 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:45:52.186616 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:45:52.186616 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:45:52.186616 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:45:52.186616 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:45:52.186616 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:45:52.186616 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:45:52.186616 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:52.186616 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:45:52.186616 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:45:52.186616 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_59e65f6eb06d40d583b9f43c9af94c13", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:45:52.186616 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:52.186616 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:45:52.186616 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:52.186616 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:45:52.186616 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:45:52.186616 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:45:52.186616 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 443c44b0bd9e4c56a7fe0c1a53238545 Oct 17 13:45:52.186616 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:45:52.186616 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 13:45:52.186616 n-d-854247-14 devstack@n-api.service[127017]: {"reboot": {"type": "SOFT"}} Oct 17 13:45:52.186616 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:45:52.186616 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 9be563ca-739e-4121-9dc8-9e46c7a131b6 could not be found. Oct 17 13:45:52.186616 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '9be563ca-739e-4121-9dc8-9e46c7a131b6', 'body': {'reboot': {'type': 'SOFT'}}} Oct 17 13:45:52.186616 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:45:52.186616 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:52.186616 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:45:52.186616 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:45:52.186616 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:45:52.186616 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:45:52.186616 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:45:52.186616 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:45:52.186616 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:45:52.186616 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:45:52.186616 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9be563ca-739e-4121-9dc8-9e46c7a131b6 could not be found. Oct 17 13:45:52.186616 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:52.186616 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:52.186616 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:52.186616 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:52.186616 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:52.186616 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:52.186616 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:45:52.186616 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:45:52.186616 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:45:52.186616 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:45:52.186616 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:45:52.186616 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:45:52.186616 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 17 13:45:52.186616 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 17 13:45:52.186616 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:45:52.186616 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:45:52.186616 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:45:52.186616 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:45:52.191432 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9be563ca-739e-4121-9dc8-9e46c7a131b6 could not be found. Oct 17 13:45:52.191432 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:52.191432 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:52.191432 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:52.191432 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:52.191432 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:52.191432 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:52.191432 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:45:52.191432 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:45:52.191432 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9be563ca-739e-4121-9dc8-9e46c7a131b6 could not be found. Oct 17 13:45:52.191432 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:52.200806 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2a8b78d1-88ef-4781-9dfe-df8c6872218a tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Returning 404 to user: Instance 9be563ca-739e-4121-9dc8-9e46c7a131b6 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:45:52.202448 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2a8b78d1-88ef-4781-9dfe-df8c6872218a tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "POST /compute/v2.1/servers/9be563ca-739e-4121-9dc8-9e46c7a131b6/action" status: 404 len: 111 microversion: 2.1 time: 0.114701 Oct 17 13:45:52.203304 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1423/2859] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:45:52 2022] POST /compute/v2.1/servers/9be563ca-739e-4121-9dc8-9e46c7a131b6/action => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:45:52.212659 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-09fa6762-513a-476b-b980-e4ce3d06dad1 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:52.213208 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-09fa6762-513a-476b-b980-e4ce3d06dad1 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:52.226037 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-09fa6762-513a-476b-b980-e4ce3d06dad1 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:52.226697 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-09fa6762-513a-476b-b980-e4ce3d06dad1 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:52.227633 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-09fa6762-513a-476b-b980-e4ce3d06dad1 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:52.233861 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-09fa6762-513a-476b-b980-e4ce3d06dad1 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:52.234748 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-09fa6762-513a-476b-b980-e4ce3d06dad1 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:52.235355 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-09fa6762-513a-476b-b980-e4ce3d06dad1 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:52.680603 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-96c9afd7-ffeb-4ab5-b816-6e8ffe48b404 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:52.681570 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-96c9afd7-ffeb-4ab5-b816-6e8ffe48b404 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] [instance: b93ba3e5-0c3f-4e1b-825f-f788b1c32566] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:52.695854 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-96c9afd7-ffeb-4ab5-b816-6e8ffe48b404 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:52.699212 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-96c9afd7-ffeb-4ab5-b816-6e8ffe48b404 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:52.704605 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-96c9afd7-ffeb-4ab5-b816-6e8ffe48b404 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:52.707674 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-96c9afd7-ffeb-4ab5-b816-6e8ffe48b404 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:52.710637 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-96c9afd7-ffeb-4ab5-b816-6e8ffe48b404 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:52.711821 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-96c9afd7-ffeb-4ab5-b816-6e8ffe48b404 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:52.834140 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-09fa6762-513a-476b-b980-e4ce3d06dad1 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:52.846487 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-09fa6762-513a-476b-b980-e4ce3d06dad1 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 0.638266 Oct 17 13:45:52.859584 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1437/2860] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:52 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:52.875231 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7b310d81-5bde-4270-989f-e99a7a192ce4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:52.880464 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7b310d81-5bde-4270-989f-e99a7a192ce4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:52.892787 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7b310d81-5bde-4270-989f-e99a7a192ce4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:52.896384 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7b310d81-5bde-4270-989f-e99a7a192ce4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:52.897146 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7b310d81-5bde-4270-989f-e99a7a192ce4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:52.898128 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7b310d81-5bde-4270-989f-e99a7a192ce4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:52.899720 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7b310d81-5bde-4270-989f-e99a7a192ce4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:52.901896 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7b310d81-5bde-4270-989f-e99a7a192ce4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:53.371671 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7b310d81-5bde-4270-989f-e99a7a192ce4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:53.393896 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7b310d81-5bde-4270-989f-e99a7a192ce4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 0.518408 Oct 17 13:45:53.398730 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1438/2861] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:52 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:53.405973 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-23edd45c-23bc-4dc0-a443-fe95bf0cc2fe tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:53.412901 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-23edd45c-23bc-4dc0-a443-fe95bf0cc2fe tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] [instance: 50e9eae9-df55-48ee-b984-e6b7e4bb2628] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:53.425786 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-23edd45c-23bc-4dc0-a443-fe95bf0cc2fe tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:53.435515 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-23edd45c-23bc-4dc0-a443-fe95bf0cc2fe tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:53.435968 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-23edd45c-23bc-4dc0-a443-fe95bf0cc2fe tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:53.437377 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-23edd45c-23bc-4dc0-a443-fe95bf0cc2fe tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:53.437847 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-23edd45c-23bc-4dc0-a443-fe95bf0cc2fe tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:53.438255 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-23edd45c-23bc-4dc0-a443-fe95bf0cc2fe tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:53.462054 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-96c9afd7-ffeb-4ab5-b816-6e8ffe48b404 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e7aceb4e414d38a36d62fe086035d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338930cae76d48a19a9a0d960fc25457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:53.480611 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-96c9afd7-ffeb-4ab5-b816-6e8ffe48b404 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] 10.222.0.79 "GET /compute/v2.1/servers/b93ba3e5-0c3f-4e1b-825f-f788b1c32566" status: 200 len: 1520 microversion: 2.1 time: 0.798584 Oct 17 13:45:53.492201 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1424/2862] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:52 2022] GET /compute/v2.1/servers/b93ba3e5-0c3f-4e1b-825f-f788b1c32566 => generated 1520 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:53.523710 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0145f7aa-c3ce-49f4-94f8-279a342998a4 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:53.524707 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0145f7aa-c3ce-49f4-94f8-279a342998a4 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: 87134cd4-0fff-43ba-b0a3-c4a62e3de5b1] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:53.549748 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0145f7aa-c3ce-49f4-94f8-279a342998a4 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:53.554123 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0145f7aa-c3ce-49f4-94f8-279a342998a4 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:53.556219 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0145f7aa-c3ce-49f4-94f8-279a342998a4 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:53.557206 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0145f7aa-c3ce-49f4-94f8-279a342998a4 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:53.558564 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0145f7aa-c3ce-49f4-94f8-279a342998a4 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:53.559806 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0145f7aa-c3ce-49f4-94f8-279a342998a4 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:53.616672 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-0145f7aa-c3ce-49f4-94f8-279a342998a4 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] HTTP exception thrown: Instance 87134cd4-0fff-43ba-b0a3-c4a62e3de5b1 could not be found. Oct 17 13:45:53.619705 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0145f7aa-c3ce-49f4-94f8-279a342998a4 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Request method failure captured: Oct 17 13:45:53.619705 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/87134cd4-0fff-43ba-b0a3-c4a62e3de5b1 HTTP/1.1 Oct 17 13:45:53.619705 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:45:53.619705 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:45:53.619705 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:45:53.619705 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:45:53.619705 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:45:53.619705 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:45:53.619705 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:45:53.619705 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:45:53.619705 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVwC0e9CoATqGmYn4xGcT3FE8Oj9evjm1YFH2xWIDqz-SmDOiryAwzQTOs-GPJHVs4PIRhkBOEiVtiX5aSbffWwTV5LQD70QSurqjrRnAEAFbBczXuvyc9v448rv1Gp8IaOUfReXe6mhgboO9wnGT7El2Mktg9R2axOqjRB5s1DD5Jw Oct 17 13:45:53.619705 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:45:53.619705 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:45:53.619705 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:45:53.619705 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:45:53.619705 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:45:53.619705 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:45:53.619705 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 676987e95424497c94984347dd6a7988 Oct 17 13:45:53.619705 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServersTestMultiNic-156823294 Oct 17 13:45:53.619705 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:45:53.619705 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:45:53.619705 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/676987e95424497c94984347dd6a7988"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/676987e95424497c94984347dd6a7988"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/676987e95424497c94984347dd6a7988"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_676987e95424497c94984347dd6a7988", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:45:53.619705 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServersTestMultiNic-156823294 Oct 17 13:45:53.619705 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 676987e95424497c94984347dd6a7988 Oct 17 13:45:53.619705 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServersTestMultiNic-156823294 Oct 17 13:45:53.619705 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServersTestMultiNic-156823294-project Oct 17 13:45:53.619705 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:45:53.619705 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:45:53.619705 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 467250951f654e33b3e233868301bbf0 Oct 17 13:45:53.619705 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServersTestMultiNic-156823294-project Oct 17 13:45:53.619705 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:45:53.619705 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 87134cd4-0fff-43ba-b0a3-c4a62e3de5b1 could not be found. Oct 17 13:45:53.619705 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '87134cd4-0fff-43ba-b0a3-c4a62e3de5b1'} Oct 17 13:45:53.619705 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:45:53.619705 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:53.619705 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:45:53.619705 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:45:53.619705 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:45:53.619705 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:45:53.619705 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:45:53.619705 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:45:53.619705 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:45:53.619705 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:45:53.619705 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87134cd4-0fff-43ba-b0a3-c4a62e3de5b1 could not be found. Oct 17 13:45:53.619705 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:53.619705 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:53.619705 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:53.619705 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:53.619705 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:53.619705 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:53.619705 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:45:53.619705 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:45:53.619705 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:45:53.619705 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:45:53.619705 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:45:53.619705 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:45:53.619705 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:45:53.619705 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:45:53.619705 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:45:53.619705 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:45:53.619705 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87134cd4-0fff-43ba-b0a3-c4a62e3de5b1 could not be found. Oct 17 13:45:53.619705 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:53.619705 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:53.619705 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:53.624684 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:53.624684 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:53.624684 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:53.624684 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:45:53.624684 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:45:53.624684 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87134cd4-0fff-43ba-b0a3-c4a62e3de5b1 could not be found. Oct 17 13:45:53.624684 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:53.626613 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0145f7aa-c3ce-49f4-94f8-279a342998a4 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Returning 404 to user: Instance 87134cd4-0fff-43ba-b0a3-c4a62e3de5b1 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:45:53.628121 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0145f7aa-c3ce-49f4-94f8-279a342998a4 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "GET /compute/v2.1/servers/87134cd4-0fff-43ba-b0a3-c4a62e3de5b1" status: 404 len: 111 microversion: 2.1 time: 0.131371 Oct 17 13:45:53.629639 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1425/2863] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:53 2022] GET /compute/v2.1/servers/87134cd4-0fff-43ba-b0a3-c4a62e3de5b1 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:45:53.641802 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5ec46f29-8661-4691-9ff6-58dbeabb7e23 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:53.658220 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5ec46f29-8661-4691-9ff6-58dbeabb7e23 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: f01f96fc-c931-4ca4-96e2-c9ecf31b4f36] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:53.671622 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-5ec46f29-8661-4691-9ff6-58dbeabb7e23 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] HTTP exception thrown: Instance f01f96fc-c931-4ca4-96e2-c9ecf31b4f36 could not be found. Oct 17 13:45:53.679113 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5ec46f29-8661-4691-9ff6-58dbeabb7e23 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Request method failure captured: Oct 17 13:45:53.679113 n-d-854247-14 devstack@n-api.service[127017]: request: POST /compute/v2.1/servers/f01f96fc-c931-4ca4-96e2-c9ecf31b4f36/action HTTP/1.1 Oct 17 13:45:53.679113 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:45:53.679113 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:45:53.679113 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:45:53.679113 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 28 Oct 17 13:45:53.679113 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:45:53.679113 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:45:53.679113 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:45:53.679113 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:45:53.679113 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVwEqzYAZh4AkEjRryOAZIhaHrAKxd2Qcal9md8a5n-MMUYSdXmcWYLDVkyQoPrDIbcsApBq2EewemPkBwvNDDOidb0hhc_Z3w9BeEUj5ET_flLYPqO5hgqCsuZGXFiYIEBJxrkx614fXiELZHaNkvhSdsJHShK0w7L-UPHhkPKqi5M Oct 17 13:45:53.679113 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:45:53.679113 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:45:53.679113 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:45:53.679113 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:45:53.679113 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:45:53.679113 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:45:53.679113 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:45:53.679113 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:53.679113 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:45:53.679113 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:45:53.679113 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_59e65f6eb06d40d583b9f43c9af94c13", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:45:53.679113 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:53.679113 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:45:53.679113 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:53.679113 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:45:53.679113 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:45:53.679113 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:45:53.679113 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 443c44b0bd9e4c56a7fe0c1a53238545 Oct 17 13:45:53.679113 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:45:53.679113 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 13:45:53.679113 n-d-854247-14 devstack@n-api.service[127017]: {"reboot": {"type": "SOFT"}} Oct 17 13:45:53.679113 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:45:53.679113 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance f01f96fc-c931-4ca4-96e2-c9ecf31b4f36 could not be found. Oct 17 13:45:53.679113 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'f01f96fc-c931-4ca4-96e2-c9ecf31b4f36', 'body': {'reboot': {'type': 'SOFT'}}} Oct 17 13:45:53.679113 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:45:53.679113 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:53.679113 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:45:53.679113 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:45:53.679113 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:45:53.679113 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:45:53.679113 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 13:45:53.679113 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 13:45:53.679113 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f01f96fc-c931-4ca4-96e2-c9ecf31b4f36 could not be found. Oct 17 13:45:53.679113 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:53.679113 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:53.679113 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:53.679113 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:53.679113 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:53.679113 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:53.679113 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:45:53.679113 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:45:53.679113 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:45:53.679113 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:45:53.679113 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:45:53.679113 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:45:53.679113 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 17 13:45:53.679113 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 17 13:45:53.679113 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:45:53.679113 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:45:53.679113 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:45:53.679113 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:45:53.679113 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f01f96fc-c931-4ca4-96e2-c9ecf31b4f36 could not be found. Oct 17 13:45:53.679113 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:53.683910 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:53.683910 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:53.683910 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:53.683910 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:53.683910 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:53.683910 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:45:53.683910 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:45:53.683910 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f01f96fc-c931-4ca4-96e2-c9ecf31b4f36 could not be found. Oct 17 13:45:53.683910 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:53.684730 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5ec46f29-8661-4691-9ff6-58dbeabb7e23 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Returning 404 to user: Instance f01f96fc-c931-4ca4-96e2-c9ecf31b4f36 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:45:53.685629 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5ec46f29-8661-4691-9ff6-58dbeabb7e23 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "POST /compute/v2.1/servers/f01f96fc-c931-4ca4-96e2-c9ecf31b4f36/action" status: 404 len: 111 microversion: 2.1 time: 0.052565 Oct 17 13:45:53.691547 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1426/2864] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:45:53 2022] POST /compute/v2.1/servers/f01f96fc-c931-4ca4-96e2-c9ecf31b4f36/action => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:45:53.715808 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-dfa42512-1937-44db-ab60-ccf4a1e29a03 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-95414125", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "59d437ea-c51f-4bd2-bc6d-6c02e4137886"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:53.728306 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-dfa42512-1937-44db-ab60-ccf4a1e29a03 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Request method failure captured: Oct 17 13:45:53.728306 n-d-854247-14 devstack@n-api.service[127017]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:45:53.728306 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:45:53.728306 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:45:53.728306 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:45:53.728306 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 241 Oct 17 13:45:53.728306 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:45:53.728306 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:45:53.728306 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:45:53.728306 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:45:53.728306 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVx2VP6NYR8-SkUppp7ZQwsolX_3HpVY9Dm8yijSmnsfZFkREfPENQ_w1Ij1OC4qYH0lRLCr6f6gzIFPmDSK8YyuHHgSPapUyUDCpLTfhQwxRMmntSw4k4apKpJpFuIUaomiQLXdIgE4343xOBucfNSh4fmUpqADzhFPwQjNmgbiH0A Oct 17 13:45:53.728306 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:45:53.728306 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:45:53.728306 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:45:53.728306 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:45:53.728306 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:45:53.728306 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:45:53.728306 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 338930cae76d48a19a9a0d960fc25457 Oct 17 13:45:53.728306 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1288122608 Oct 17 13:45:53.728306 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:45:53.728306 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:45:53.728306 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/338930cae76d48a19a9a0d960fc25457"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/338930cae76d48a19a9a0d960fc25457"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/338930cae76d48a19a9a0d960fc25457"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_338930cae76d48a19a9a0d960fc25457", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:45:53.728306 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1288122608 Oct 17 13:45:53.728306 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 338930cae76d48a19a9a0d960fc25457 Oct 17 13:45:53.728306 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1288122608 Oct 17 13:45:53.728306 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServerMetadataNegativeTestJSON-1288122608-project Oct 17 13:45:53.728306 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:45:53.728306 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:45:53.728306 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: e4e7aceb4e414d38a36d62fe086035d4 Oct 17 13:45:53.728306 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1288122608-project Oct 17 13:45:53.728306 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 13:45:53.728306 n-d-854247-14 devstack@n-api.service[127017]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-95414125", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "59d437ea-c51f-4bd2-bc6d-6c02e4137886"}]}} Oct 17 13:45:53.728306 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:45:53.728306 n-d-854247-14 devstack@n-api.service[127017]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 13:45:53.728306 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-95414125', 'imageRef': '0743b21b-a6ff-4d02-897c-eabb68c3ba07', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '59d437ea-c51f-4bd2-bc6d-6c02e4137886'}]}}} Oct 17 13:45:53.728306 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:45:53.728306 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:53.728306 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:45:53.728306 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:45:53.728306 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:45:53.728306 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:45:53.728306 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 13:45:53.728306 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:53.728306 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 17 13:45:53.728306 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 17 13:45:53.728306 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 17 13:45:53.728306 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 17 13:45:53.728306 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 17 13:45:53.728306 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:53.728306 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 13:45:53.728306 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 17 13:45:53.728306 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:53.728306 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:53.728306 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:53.728306 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:53.728306 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:53.728306 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:53.728306 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:45:53.728306 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:45:53.728306 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:45:53.728306 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:45:53.728306 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:45:53.732858 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:45:53.732858 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:45:53.732858 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:45:53.732858 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:45:53.732858 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:45:53.732858 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:45:53.732858 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:45:53.732858 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 13:45:53.732858 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:53.732858 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:53.732858 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:53.732858 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:53.732858 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:53.732858 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:53.732858 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:45:53.732858 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:45:53.732858 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 13:45:53.732858 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:53.735196 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-dfa42512-1937-44db-ab60-ccf4a1e29a03 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:45:53.741321 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-dfa42512-1937-44db-ab60-ccf4a1e29a03 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.039984 Oct 17 13:45:53.748070 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1427/2865] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:45:53 2022] POST /compute/v2.1/servers => generated 175 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:45:53.760418 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b877b8fb-a8b2-48c8-9e0f-af8e5b72b219 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:53.761126 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b877b8fb-a8b2-48c8-9e0f-af8e5b72b219 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:53.775328 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b877b8fb-a8b2-48c8-9e0f-af8e5b72b219 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:53.777392 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b877b8fb-a8b2-48c8-9e0f-af8e5b72b219 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:53.779081 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b877b8fb-a8b2-48c8-9e0f-af8e5b72b219 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:53.780425 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b877b8fb-a8b2-48c8-9e0f-af8e5b72b219 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:53.783812 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b877b8fb-a8b2-48c8-9e0f-af8e5b72b219 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:53.787655 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b877b8fb-a8b2-48c8-9e0f-af8e5b72b219 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:54.559929 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b877b8fb-a8b2-48c8-9e0f-af8e5b72b219 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:54.585911 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b877b8fb-a8b2-48c8-9e0f-af8e5b72b219 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 0.840264 Oct 17 13:45:54.587677 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1428/2866] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:53 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:54.633315 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5ca05027-44e8-40bf-a34e-8f9a6e0c1fba tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:54.637832 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5ca05027-44e8-40bf-a34e-8f9a6e0c1fba tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] [instance: 966d30b1-f2d3-4427-b3f5-559b618f3923] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:54.665934 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-5ca05027-44e8-40bf-a34e-8f9a6e0c1fba tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] HTTP exception thrown: Instance 966d30b1-f2d3-4427-b3f5-559b618f3923 could not be found. Oct 17 13:45:54.684250 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5ca05027-44e8-40bf-a34e-8f9a6e0c1fba tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Request method failure captured: Oct 17 13:45:54.684250 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/966d30b1-f2d3-4427-b3f5-559b618f3923/metadata HTTP/1.1 Oct 17 13:45:54.684250 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:45:54.684250 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:45:54.684250 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:45:54.684250 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:45:54.684250 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:45:54.684250 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:45:54.684250 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:45:54.684250 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:45:54.684250 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVx2VP6NYR8-SkUppp7ZQwsolX_3HpVY9Dm8yijSmnsfZFkREfPENQ_w1Ij1OC4qYH0lRLCr6f6gzIFPmDSK8YyuHHgSPapUyUDCpLTfhQwxRMmntSw4k4apKpJpFuIUaomiQLXdIgE4343xOBucfNSh4fmUpqADzhFPwQjNmgbiH0A Oct 17 13:45:54.684250 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:45:54.684250 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:45:54.684250 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:45:54.684250 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:45:54.684250 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:45:54.684250 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:45:54.684250 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 338930cae76d48a19a9a0d960fc25457 Oct 17 13:45:54.684250 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1288122608 Oct 17 13:45:54.684250 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:45:54.684250 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:45:54.684250 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/338930cae76d48a19a9a0d960fc25457"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/338930cae76d48a19a9a0d960fc25457"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/338930cae76d48a19a9a0d960fc25457"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_338930cae76d48a19a9a0d960fc25457", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:45:54.684250 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1288122608 Oct 17 13:45:54.684250 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 338930cae76d48a19a9a0d960fc25457 Oct 17 13:45:54.684250 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1288122608 Oct 17 13:45:54.684250 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServerMetadataNegativeTestJSON-1288122608-project Oct 17 13:45:54.684250 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:45:54.684250 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:45:54.684250 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: e4e7aceb4e414d38a36d62fe086035d4 Oct 17 13:45:54.684250 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1288122608-project Oct 17 13:45:54.684250 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:45:54.684250 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 966d30b1-f2d3-4427-b3f5-559b618f3923 could not be found. Oct 17 13:45:54.684250 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'server_id': '966d30b1-f2d3-4427-b3f5-559b618f3923'} Oct 17 13:45:54.684250 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:45:54.684250 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:54.684250 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:45:54.684250 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:45:54.684250 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:45:54.684250 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:45:54.684250 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 13:45:54.684250 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 13:45:54.684250 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 966d30b1-f2d3-4427-b3f5-559b618f3923 could not be found. Oct 17 13:45:54.684250 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:54.684250 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:54.684250 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:54.684250 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:54.684250 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:54.684250 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:54.684250 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:45:54.684250 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:45:54.684250 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:45:54.684250 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:45:54.684250 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 17 13:45:54.684250 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 17 13:45:54.684250 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:45:54.684250 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:45:54.684250 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 966d30b1-f2d3-4427-b3f5-559b618f3923 could not be found. Oct 17 13:45:54.684250 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:54.684250 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:54.684250 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:54.684250 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:54.684250 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:54.684250 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:54.689418 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:45:54.689418 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:45:54.689418 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 966d30b1-f2d3-4427-b3f5-559b618f3923 could not be found. Oct 17 13:45:54.689418 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:54.691612 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5ca05027-44e8-40bf-a34e-8f9a6e0c1fba tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Returning 404 to user: Instance 966d30b1-f2d3-4427-b3f5-559b618f3923 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:45:54.692099 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5ca05027-44e8-40bf-a34e-8f9a6e0c1fba tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] 10.222.0.79 "GET /compute/v2.1/servers/966d30b1-f2d3-4427-b3f5-559b618f3923/metadata" status: 404 len: 111 microversion: 2.1 time: 0.089242 Oct 17 13:45:54.698781 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1429/2867] 10.222.0.79 () {58 vars in 1263 bytes} [Mon Oct 17 13:45:54 2022] GET /compute/v2.1/servers/966d30b1-f2d3-4427-b3f5-559b618f3923/metadata => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:45:54.717907 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5fa98ef6-2f45-41eb-b6a7-c8a1437120cd tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:54.729092 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5fa98ef6-2f45-41eb-b6a7-c8a1437120cd tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:54.756371 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5fa98ef6-2f45-41eb-b6a7-c8a1437120cd tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:54.756860 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5fa98ef6-2f45-41eb-b6a7-c8a1437120cd tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:54.757296 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5fa98ef6-2f45-41eb-b6a7-c8a1437120cd tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:54.758007 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5fa98ef6-2f45-41eb-b6a7-c8a1437120cd tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:54.758460 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5fa98ef6-2f45-41eb-b6a7-c8a1437120cd tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:54.758881 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5fa98ef6-2f45-41eb-b6a7-c8a1437120cd tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:55.557056 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-23edd45c-23bc-4dc0-a443-fe95bf0cc2fe tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a3472f83914990ad41f037b4aafd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f91db965084796a4a3dce1b4e921e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:55.576943 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-23edd45c-23bc-4dc0-a443-fe95bf0cc2fe tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] 10.222.0.79 "GET /compute/v2.1/servers/50e9eae9-df55-48ee-b984-e6b7e4bb2628" status: 200 len: 1322 microversion: 2.1 time: 2.176517 Oct 17 13:45:55.577544 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1439/2868] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:53 2022] GET /compute/v2.1/servers/50e9eae9-df55-48ee-b984-e6b7e4bb2628 => generated 1322 bytes in 2178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:55.978815 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5fa98ef6-2f45-41eb-b6a7-c8a1437120cd tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:55.989403 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5fa98ef6-2f45-41eb-b6a7-c8a1437120cd tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 1.286422 Oct 17 13:45:55.990440 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1430/2869] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:54 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:56.004765 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-887342c6-8550-4d78-82fe-7e9667bb8506 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1846633874", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "59d437ea-c51f-4bd2-bc6d-6c02e4137886"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:56.013303 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-887342c6-8550-4d78-82fe-7e9667bb8506 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Request method failure captured: Oct 17 13:45:56.013303 n-d-854247-14 devstack@n-api.service[127017]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:45:56.013303 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:45:56.013303 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:45:56.013303 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:45:56.013303 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 499 Oct 17 13:45:56.013303 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:45:56.013303 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:45:56.013303 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:45:56.013303 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:45:56.013303 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVx2VP6NYR8-SkUppp7ZQwsolX_3HpVY9Dm8yijSmnsfZFkREfPENQ_w1Ij1OC4qYH0lRLCr6f6gzIFPmDSK8YyuHHgSPapUyUDCpLTfhQwxRMmntSw4k4apKpJpFuIUaomiQLXdIgE4343xOBucfNSh4fmUpqADzhFPwQjNmgbiH0A Oct 17 13:45:56.013303 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:45:56.013303 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:45:56.013303 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:45:56.013303 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:45:56.013303 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:45:56.013303 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:45:56.013303 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 338930cae76d48a19a9a0d960fc25457 Oct 17 13:45:56.013303 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1288122608 Oct 17 13:45:56.013303 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:45:56.013303 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:45:56.013303 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/338930cae76d48a19a9a0d960fc25457"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/338930cae76d48a19a9a0d960fc25457"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/338930cae76d48a19a9a0d960fc25457"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_338930cae76d48a19a9a0d960fc25457", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:45:56.013303 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1288122608 Oct 17 13:45:56.013303 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 338930cae76d48a19a9a0d960fc25457 Oct 17 13:45:56.013303 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1288122608 Oct 17 13:45:56.013303 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServerMetadataNegativeTestJSON-1288122608-project Oct 17 13:45:56.013303 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:45:56.013303 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:45:56.013303 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: e4e7aceb4e414d38a36d62fe086035d4 Oct 17 13:45:56.013303 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1288122608-project Oct 17 13:45:56.013303 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 13:45:56.013303 n-d-854247-14 devstack@n-api.service[127017]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1846633874", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "59d437ea-c51f-4bd2-bc6d-6c02e4137886"}]}} Oct 17 13:45:56.013303 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:45:56.013303 n-d-854247-14 devstack@n-api.service[127017]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 13:45:56.013303 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1846633874', 'imageRef': '0743b21b-a6ff-4d02-897c-eabb68c3ba07', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '59d437ea-c51f-4bd2-bc6d-6c02e4137886'}]}}} Oct 17 13:45:56.013303 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:45:56.013303 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:56.013303 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:45:56.013303 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:45:56.013303 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:45:56.013303 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:45:56.013303 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 13:45:56.013303 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:56.013303 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 17 13:45:56.013303 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 17 13:45:56.013303 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 17 13:45:56.013303 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 17 13:45:56.016371 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 17 13:45:56.016371 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:56.016371 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 13:45:56.016371 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 17 13:45:56.016371 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:56.016371 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:56.016371 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:56.016371 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:56.016371 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:56.016371 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:56.016371 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:45:56.016371 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:45:56.016371 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:45:56.016371 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:45:56.016371 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:45:56.016371 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:45:56.016371 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:45:56.016371 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:45:56.016371 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:45:56.016371 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:45:56.016371 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:45:56.016371 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:45:56.016371 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 13:45:56.016371 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:56.016371 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:56.016371 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:56.016371 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:56.016371 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:56.016371 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:56.016371 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:45:56.016371 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:45:56.016371 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 13:45:56.016371 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:56.023997 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-887342c6-8550-4d78-82fe-7e9667bb8506 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:45:56.025143 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-887342c6-8550-4d78-82fe-7e9667bb8506 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.031811 Oct 17 13:45:56.030407 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1431/2870] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:45:55 2022] POST /compute/v2.1/servers => generated 687 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:45:56.038452 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6bc442a7-3cd8-4e1d-92c4-46dee0c65549 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:56.045941 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6bc442a7-3cd8-4e1d-92c4-46dee0c65549 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 9be563ca-739e-4121-9dc8-9e46c7a131b6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:56.065713 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6bc442a7-3cd8-4e1d-92c4-46dee0c65549 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:56.066537 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6bc442a7-3cd8-4e1d-92c4-46dee0c65549 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:56.067234 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6bc442a7-3cd8-4e1d-92c4-46dee0c65549 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:56.068859 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6bc442a7-3cd8-4e1d-92c4-46dee0c65549 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:56.069115 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-50cef520-9fe5-4cac-a7d3-80c44fd626cb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-156669194", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:56.069497 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6bc442a7-3cd8-4e1d-92c4-46dee0c65549 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:56.070282 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6bc442a7-3cd8-4e1d-92c4-46dee0c65549 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:56.138096 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-6bc442a7-3cd8-4e1d-92c4-46dee0c65549 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] HTTP exception thrown: Instance 9be563ca-739e-4121-9dc8-9e46c7a131b6 could not be found. Oct 17 13:45:56.142693 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6bc442a7-3cd8-4e1d-92c4-46dee0c65549 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Request method failure captured: Oct 17 13:45:56.142693 n-d-854247-14 devstack@n-api.service[127017]: request: POST /compute/v2.1/servers/9be563ca-739e-4121-9dc8-9e46c7a131b6/action HTTP/1.1 Oct 17 13:45:56.142693 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:45:56.142693 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:45:56.142693 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:45:56.142693 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 65 Oct 17 13:45:56.142693 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:45:56.142693 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:45:56.142693 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:45:56.142693 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:45:56.142693 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVwEqzYAZh4AkEjRryOAZIhaHrAKxd2Qcal9md8a5n-MMUYSdXmcWYLDVkyQoPrDIbcsApBq2EewemPkBwvNDDOidb0hhc_Z3w9BeEUj5ET_flLYPqO5hgqCsuZGXFiYIEBJxrkx614fXiELZHaNkvhSdsJHShK0w7L-UPHhkPKqi5M Oct 17 13:45:56.142693 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:45:56.142693 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:45:56.142693 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:45:56.142693 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:45:56.142693 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:45:56.142693 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:45:56.142693 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:45:56.142693 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:56.142693 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:45:56.142693 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:45:56.142693 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_59e65f6eb06d40d583b9f43c9af94c13", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:45:56.142693 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:56.142693 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:45:56.142693 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:56.142693 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:45:56.142693 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:45:56.142693 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:45:56.142693 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 443c44b0bd9e4c56a7fe0c1a53238545 Oct 17 13:45:56.142693 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:45:56.142693 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 13:45:56.142693 n-d-854247-14 devstack@n-api.service[127017]: {"rebuild": {"imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07"}} Oct 17 13:45:56.142693 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:45:56.142693 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 9be563ca-739e-4121-9dc8-9e46c7a131b6 could not be found. Oct 17 13:45:56.142693 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '9be563ca-739e-4121-9dc8-9e46c7a131b6', 'body': {'rebuild': {'imageRef': '0743b21b-a6ff-4d02-897c-eabb68c3ba07'}}} Oct 17 13:45:56.142693 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:45:56.142693 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:56.142693 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:45:56.142693 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:45:56.142693 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:45:56.142693 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:45:56.142693 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:45:56.142693 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:45:56.142693 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:45:56.142693 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:45:56.142693 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9be563ca-739e-4121-9dc8-9e46c7a131b6 could not be found. Oct 17 13:45:56.142693 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:56.142693 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:56.142693 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:56.142693 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:56.142693 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:56.142693 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:56.142693 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:45:56.142693 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:45:56.142693 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:45:56.142693 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:45:56.142693 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:45:56.142693 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:45:56.142693 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:45:56.142693 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:45:56.142693 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:45:56.142693 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:45:56.142693 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 17 13:45:56.142693 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 17 13:45:56.148087 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 17 13:45:56.148087 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:45:56.148087 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:45:56.148087 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:45:56.148087 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:45:56.148087 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9be563ca-739e-4121-9dc8-9e46c7a131b6 could not be found. Oct 17 13:45:56.148087 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:56.148087 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:56.148087 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:56.148087 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:56.148087 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:56.148087 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:56.148087 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:45:56.148087 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:45:56.148087 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9be563ca-739e-4121-9dc8-9e46c7a131b6 could not be found. Oct 17 13:45:56.148087 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:56.157679 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6bc442a7-3cd8-4e1d-92c4-46dee0c65549 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Returning 404 to user: Instance 9be563ca-739e-4121-9dc8-9e46c7a131b6 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:45:56.166960 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-50cef520-9fe5-4cac-a7d3-80c44fd626cb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] validate_networks() for None {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:45:56.169837 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6bc442a7-3cd8-4e1d-92c4-46dee0c65549 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "POST /compute/v2.1/servers/9be563ca-739e-4121-9dc8-9e46c7a131b6/action" status: 404 len: 111 microversion: 2.1 time: 0.127772 Oct 17 13:45:56.171221 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1432/2871] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:45:56 2022] POST /compute/v2.1/servers/9be563ca-739e-4121-9dc8-9e46c7a131b6/action => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:45:56.187268 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e128902b-ba5f-4445-87d2-d93e1bf7641f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:56.189861 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e128902b-ba5f-4445-87d2-d93e1bf7641f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:56.206648 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e128902b-ba5f-4445-87d2-d93e1bf7641f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:56.207544 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e128902b-ba5f-4445-87d2-d93e1bf7641f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:56.209399 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e128902b-ba5f-4445-87d2-d93e1bf7641f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:56.212673 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e128902b-ba5f-4445-87d2-d93e1bf7641f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:56.214436 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e128902b-ba5f-4445-87d2-d93e1bf7641f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:56.217179 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e128902b-ba5f-4445-87d2-d93e1bf7641f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:56.746919 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:45:56.789188 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=6 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:45:57.233632 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e128902b-ba5f-4445-87d2-d93e1bf7641f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:57.263412 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e128902b-ba5f-4445-87d2-d93e1bf7641f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 1.086347 Oct 17 13:45:57.265684 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1433/2872] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:56 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:57.313133 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-cb8b5646-e443-4bff-8534-f112ceb5c5bf tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-561432792", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "59d437ea-c51f-4bd2-bc6d-6c02e4137886"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:57.326558 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-cb8b5646-e443-4bff-8534-f112ceb5c5bf tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Request method failure captured: Oct 17 13:45:57.326558 n-d-854247-14 devstack@n-api.service[127017]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:45:57.326558 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:45:57.326558 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:45:57.326558 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:45:57.326558 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 499 Oct 17 13:45:57.326558 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:45:57.326558 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:45:57.326558 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:45:57.326558 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:45:57.326558 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVx2VP6NYR8-SkUppp7ZQwsolX_3HpVY9Dm8yijSmnsfZFkREfPENQ_w1Ij1OC4qYH0lRLCr6f6gzIFPmDSK8YyuHHgSPapUyUDCpLTfhQwxRMmntSw4k4apKpJpFuIUaomiQLXdIgE4343xOBucfNSh4fmUpqADzhFPwQjNmgbiH0A Oct 17 13:45:57.326558 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:45:57.326558 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:45:57.326558 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:45:57.326558 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:45:57.326558 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:45:57.326558 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:45:57.326558 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 338930cae76d48a19a9a0d960fc25457 Oct 17 13:45:57.326558 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1288122608 Oct 17 13:45:57.326558 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:45:57.326558 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:45:57.326558 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/338930cae76d48a19a9a0d960fc25457"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/338930cae76d48a19a9a0d960fc25457"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/338930cae76d48a19a9a0d960fc25457"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_338930cae76d48a19a9a0d960fc25457", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:45:57.326558 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1288122608 Oct 17 13:45:57.326558 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 338930cae76d48a19a9a0d960fc25457 Oct 17 13:45:57.326558 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1288122608 Oct 17 13:45:57.326558 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServerMetadataNegativeTestJSON-1288122608-project Oct 17 13:45:57.326558 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:45:57.326558 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:45:57.326558 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: e4e7aceb4e414d38a36d62fe086035d4 Oct 17 13:45:57.326558 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1288122608-project Oct 17 13:45:57.326558 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 13:45:57.326558 n-d-854247-14 devstack@n-api.service[127017]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-561432792", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "59d437ea-c51f-4bd2-bc6d-6c02e4137886"}]}} Oct 17 13:45:57.326558 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:45:57.326558 n-d-854247-14 devstack@n-api.service[127017]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 13:45:57.326558 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-561432792', 'imageRef': '0743b21b-a6ff-4d02-897c-eabb68c3ba07', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '59d437ea-c51f-4bd2-bc6d-6c02e4137886'}]}}} Oct 17 13:45:57.326558 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:45:57.326558 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:57.326558 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:45:57.326558 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:45:57.326558 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:45:57.326558 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:45:57.326558 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 13:45:57.326558 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:57.326558 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 17 13:45:57.326558 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 17 13:45:57.326558 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 17 13:45:57.326558 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 17 13:45:57.330334 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 17 13:45:57.330334 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:57.330334 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 13:45:57.330334 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 17 13:45:57.330334 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:57.330334 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:57.330334 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:57.330334 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:57.330334 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:57.330334 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:57.330334 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:45:57.330334 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:45:57.330334 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:45:57.330334 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:45:57.330334 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:45:57.330334 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:45:57.330334 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:45:57.330334 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:45:57.330334 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:45:57.330334 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:45:57.330334 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:45:57.330334 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:45:57.330334 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 13:45:57.330334 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:57.330334 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:57.330334 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:57.330334 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:57.330334 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:57.330334 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:57.330334 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:45:57.330334 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:45:57.330334 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 13:45:57.330334 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:57.347725 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-cb8b5646-e443-4bff-8534-f112ceb5c5bf tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:45:57.351688 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-cb8b5646-e443-4bff-8534-f112ceb5c5bf tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.083621 Oct 17 13:45:57.352842 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1434/2873] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:45:57 2022] POST /compute/v2.1/servers => generated 689 bytes in 86 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:45:57.366469 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2b6bf88f-1df6-4e01-8a5d-d4db2cb78d72 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:57.367920 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2b6bf88f-1df6-4e01-8a5d-d4db2cb78d72 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] [instance: 50e9eae9-df55-48ee-b984-e6b7e4bb2628] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:57.377842 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-50cef520-9fe5-4cac-a7d3-80c44fd626cb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:45:57.384984 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-50cef520-9fe5-4cac-a7d3-80c44fd626cb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:45:57.387144 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-50cef520-9fe5-4cac-a7d3-80c44fd626cb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:45:57.392225 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-50cef520-9fe5-4cac-a7d3-80c44fd626cb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:45:57.393853 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-50cef520-9fe5-4cac-a7d3-80c44fd626cb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:45:57.420307 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2b6bf88f-1df6-4e01-8a5d-d4db2cb78d72 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:57.422847 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2b6bf88f-1df6-4e01-8a5d-d4db2cb78d72 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:57.423695 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2b6bf88f-1df6-4e01-8a5d-d4db2cb78d72 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:57.425309 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2b6bf88f-1df6-4e01-8a5d-d4db2cb78d72 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:57.426024 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2b6bf88f-1df6-4e01-8a5d-d4db2cb78d72 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:57.426621 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2b6bf88f-1df6-4e01-8a5d-d4db2cb78d72 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:57.431200 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-50cef520-9fe5-4cac-a7d3-80c44fd626cb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:57.431801 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-50cef520-9fe5-4cac-a7d3-80c44fd626cb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:57.436531 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-50cef520-9fe5-4cac-a7d3-80c44fd626cb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:57.437962 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-50cef520-9fe5-4cac-a7d3-80c44fd626cb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:57.438280 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-50cef520-9fe5-4cac-a7d3-80c44fd626cb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:57.438838 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-50cef520-9fe5-4cac-a7d3-80c44fd626cb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:57.480066 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-50cef520-9fe5-4cac-a7d3-80c44fd626cb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Getting quotas for project 5b98e3f377c14838a31cc430c98855e1. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:45:57.485739 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-50cef520-9fe5-4cac-a7d3-80c44fd626cb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Getting quotas for user 0906fe70cb054729bfb95b2196c1a5d3 and project 5b98e3f377c14838a31cc430c98855e1. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:45:57.500114 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-50cef520-9fe5-4cac-a7d3-80c44fd626cb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:45:57.502862 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-50cef520-9fe5-4cac-a7d3-80c44fd626cb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9d1105b3-be41-4963-a86b-6f4486d1d382] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:45:57.591776 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-50cef520-9fe5-4cac-a7d3-80c44fd626cb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.008929 Oct 17 13:45:57.593213 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1440/2874] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:45:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2011 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:45:57.603753 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7735dc1e-4fe5-437f-b9eb-2581f240f0a8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:57.604385 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7735dc1e-4fe5-437f-b9eb-2581f240f0a8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:57.614416 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7735dc1e-4fe5-437f-b9eb-2581f240f0a8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:57.615328 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7735dc1e-4fe5-437f-b9eb-2581f240f0a8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:57.616211 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7735dc1e-4fe5-437f-b9eb-2581f240f0a8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:57.617339 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7735dc1e-4fe5-437f-b9eb-2581f240f0a8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:57.618074 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7735dc1e-4fe5-437f-b9eb-2581f240f0a8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:57.618645 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7735dc1e-4fe5-437f-b9eb-2581f240f0a8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:58.142752 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2b6bf88f-1df6-4e01-8a5d-d4db2cb78d72 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a3472f83914990ad41f037b4aafd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f91db965084796a4a3dce1b4e921e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:58.155726 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2b6bf88f-1df6-4e01-8a5d-d4db2cb78d72 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] 10.222.0.79 "GET /compute/v2.1/servers/50e9eae9-df55-48ee-b984-e6b7e4bb2628" status: 200 len: 1322 microversion: 2.1 time: 0.797703 Oct 17 13:45:58.158345 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1435/2875] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:57 2022] GET /compute/v2.1/servers/50e9eae9-df55-48ee-b984-e6b7e4bb2628 => generated 1322 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:58.174013 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-86a78e23-b46c-4b3b-a558-11ff95327165 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-785946872", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "59d437ea-c51f-4bd2-bc6d-6c02e4137886"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:58.195666 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-86a78e23-b46c-4b3b-a558-11ff95327165 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Request method failure captured: Oct 17 13:45:58.195666 n-d-854247-14 devstack@n-api.service[127017]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:45:58.195666 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:45:58.195666 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:45:58.195666 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:45:58.195666 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 753 Oct 17 13:45:58.195666 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:45:58.195666 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:45:58.195666 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:45:58.195666 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:45:58.195666 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVx2VP6NYR8-SkUppp7ZQwsolX_3HpVY9Dm8yijSmnsfZFkREfPENQ_w1Ij1OC4qYH0lRLCr6f6gzIFPmDSK8YyuHHgSPapUyUDCpLTfhQwxRMmntSw4k4apKpJpFuIUaomiQLXdIgE4343xOBucfNSh4fmUpqADzhFPwQjNmgbiH0A Oct 17 13:45:58.195666 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:45:58.195666 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:45:58.195666 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:45:58.195666 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:45:58.195666 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:45:58.195666 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:45:58.195666 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 338930cae76d48a19a9a0d960fc25457 Oct 17 13:45:58.195666 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1288122608 Oct 17 13:45:58.195666 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:45:58.195666 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:45:58.195666 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/338930cae76d48a19a9a0d960fc25457"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/338930cae76d48a19a9a0d960fc25457"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/338930cae76d48a19a9a0d960fc25457"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_338930cae76d48a19a9a0d960fc25457", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:45:58.195666 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1288122608 Oct 17 13:45:58.195666 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 338930cae76d48a19a9a0d960fc25457 Oct 17 13:45:58.195666 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1288122608 Oct 17 13:45:58.195666 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServerMetadataNegativeTestJSON-1288122608-project Oct 17 13:45:58.195666 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:45:58.195666 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:45:58.195666 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: e4e7aceb4e414d38a36d62fe086035d4 Oct 17 13:45:58.195666 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1288122608-project Oct 17 13:45:58.195666 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 13:45:58.195666 n-d-854247-14 devstack@n-api.service[127017]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-785946872", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "59d437ea-c51f-4bd2-bc6d-6c02e4137886"}]}} Oct 17 13:45:58.195666 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:45:58.195666 n-d-854247-14 devstack@n-api.service[127017]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 13:45:58.195666 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-785946872', 'imageRef': '0743b21b-a6ff-4d02-897c-eabb68c3ba07', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '59d437ea-c51f-4bd2-bc6d-6c02e4137886'}]}}} Oct 17 13:45:58.195666 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:45:58.195666 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:58.195666 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:45:58.195666 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:45:58.195666 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:45:58.198212 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:45:58.198212 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 13:45:58.198212 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:58.198212 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 17 13:45:58.198212 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 17 13:45:58.198212 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 17 13:45:58.198212 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 17 13:45:58.198212 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 17 13:45:58.198212 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:58.198212 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 13:45:58.198212 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 17 13:45:58.198212 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:58.198212 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:58.198212 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:58.198212 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:58.198212 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:58.198212 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:58.198212 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:45:58.198212 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:45:58.198212 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:45:58.198212 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:45:58.198212 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:45:58.198212 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:45:58.198212 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:45:58.198212 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:45:58.198212 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:45:58.198212 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:45:58.198212 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:45:58.198212 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:45:58.198212 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 13:45:58.198212 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:58.198212 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:58.198212 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:58.198212 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:58.198212 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:58.198212 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:58.198212 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:45:58.198212 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:45:58.200705 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 13:45:58.200705 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:45:58.202961 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-86a78e23-b46c-4b3b-a558-11ff95327165 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:45:58.204314 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-86a78e23-b46c-4b3b-a558-11ff95327165 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.044422 Oct 17 13:45:58.205458 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1436/2876] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:45:58 2022] POST /compute/v2.1/servers => generated 1197 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 17 13:45:58.210428 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6c3ef60f-b32f-486e-ad1f-cdc0fef666e5 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:58.211335 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6c3ef60f-b32f-486e-ad1f-cdc0fef666e5 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9d1105b3-be41-4963-a86b-6f4486d1d382] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:58.340196 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7735dc1e-4fe5-437f-b9eb-2581f240f0a8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:58.347444 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7735dc1e-4fe5-437f-b9eb-2581f240f0a8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 0.752711 Oct 17 13:45:58.348043 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1441/2877] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:57 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:58.364492 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-55fc5ebf-9ea7-43af-92c9-202e1a4be106 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-203567456", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "59d437ea-c51f-4bd2-bc6d-6c02e4137886"}]}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:58.374366 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-55fc5ebf-9ea7-43af-92c9-202e1a4be106 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Request method failure captured: Oct 17 13:45:58.374366 n-d-854247-14 devstack@n-api.service[127016]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:45:58.374366 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:45:58.374366 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:45:58.374366 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:45:58.374366 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 1265 Oct 17 13:45:58.374366 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:45:58.374366 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:45:58.374366 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:45:58.374366 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:45:58.374366 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVx2VP6NYR8-SkUppp7ZQwsolX_3HpVY9Dm8yijSmnsfZFkREfPENQ_w1Ij1OC4qYH0lRLCr6f6gzIFPmDSK8YyuHHgSPapUyUDCpLTfhQwxRMmntSw4k4apKpJpFuIUaomiQLXdIgE4343xOBucfNSh4fmUpqADzhFPwQjNmgbiH0A Oct 17 13:45:58.374366 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:45:58.374366 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:45:58.374366 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:45:58.374366 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:45:58.374366 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:45:58.374366 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:45:58.374366 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 338930cae76d48a19a9a0d960fc25457 Oct 17 13:45:58.374366 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1288122608 Oct 17 13:45:58.374366 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:45:58.374366 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:45:58.374366 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/338930cae76d48a19a9a0d960fc25457"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/338930cae76d48a19a9a0d960fc25457"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/338930cae76d48a19a9a0d960fc25457"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_338930cae76d48a19a9a0d960fc25457", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:45:58.374366 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1288122608 Oct 17 13:45:58.374366 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 338930cae76d48a19a9a0d960fc25457 Oct 17 13:45:58.374366 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1288122608 Oct 17 13:45:58.374366 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServerMetadataNegativeTestJSON-1288122608-project Oct 17 13:45:58.374366 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:45:58.374366 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:45:58.374366 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: e4e7aceb4e414d38a36d62fe086035d4 Oct 17 13:45:58.374366 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1288122608-project Oct 17 13:45:58.374366 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:45:58.374366 n-d-854247-14 devstack@n-api.service[127016]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-203567456", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "59d437ea-c51f-4bd2-bc6d-6c02e4137886"}]}} Oct 17 13:45:58.374366 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:45:58.376762 n-d-854247-14 devstack@n-api.service[127016]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 13:45:58.376762 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-203567456', 'imageRef': '0743b21b-a6ff-4d02-897c-eabb68c3ba07', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '59d437ea-c51f-4bd2-bc6d-6c02e4137886'}]}}} Oct 17 13:45:58.376762 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:45:58.376762 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:58.376762 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:45:58.376762 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:45:58.376762 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:45:58.376762 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:45:58.376762 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 13:45:58.376762 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:58.376762 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 17 13:45:58.376762 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 17 13:45:58.376762 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 17 13:45:58.376762 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 17 13:45:58.376762 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 17 13:45:58.376762 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:58.376762 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 13:45:58.378407 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 17 13:45:58.378407 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:58.378407 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:58.378407 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:58.378407 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:58.378407 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:58.378407 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:58.378407 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:45:58.378407 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:45:58.378407 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:45:58.378407 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:45:58.378407 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:45:58.378407 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:45:58.378407 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:45:58.378407 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:45:58.378407 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:45:58.378407 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:45:58.378407 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:45:58.378407 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:45:58.378407 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 13:45:58.378407 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:58.378407 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:58.378407 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:58.378407 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:58.378407 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:58.378407 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:58.378407 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:45:58.378407 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:45:58.380380 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 13:45:58.380380 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:58.381507 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-55fc5ebf-9ea7-43af-92c9-202e1a4be106 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:45:58.382555 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-55fc5ebf-9ea7-43af-92c9-202e1a4be106 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.022253 Oct 17 13:45:58.383833 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1442/2878] 10.222.0.79 () {60 vars in 1148 bytes} [Mon Oct 17 13:45:58 2022] POST /compute/v2.1/servers => generated 2221 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 17 13:45:58.395113 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b4559d56-8463-4a85-bfe4-0a95594d8d3d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:58.402721 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b4559d56-8463-4a85-bfe4-0a95594d8d3d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: c9010ccf-8204-4fca-a799-f6269140eb8d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:58.418064 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-b4559d56-8463-4a85-bfe4-0a95594d8d3d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] HTTP exception thrown: Instance c9010ccf-8204-4fca-a799-f6269140eb8d could not be found. Oct 17 13:45:58.422936 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6c3ef60f-b32f-486e-ad1f-cdc0fef666e5 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:58.427875 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b4559d56-8463-4a85-bfe4-0a95594d8d3d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Request method failure captured: Oct 17 13:45:58.427875 n-d-854247-14 devstack@n-api.service[127016]: request: POST /compute/v2.1/servers/c9010ccf-8204-4fca-a799-f6269140eb8d/action HTTP/1.1 Oct 17 13:45:58.427875 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:45:58.427875 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:45:58.427875 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:45:58.427875 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 65 Oct 17 13:45:58.427875 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:45:58.427875 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:45:58.427875 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:45:58.427875 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:45:58.427875 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVwEqzYAZh4AkEjRryOAZIhaHrAKxd2Qcal9md8a5n-MMUYSdXmcWYLDVkyQoPrDIbcsApBq2EewemPkBwvNDDOidb0hhc_Z3w9BeEUj5ET_flLYPqO5hgqCsuZGXFiYIEBJxrkx614fXiELZHaNkvhSdsJHShK0w7L-UPHhkPKqi5M Oct 17 13:45:58.427875 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:45:58.427875 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:45:58.427875 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:45:58.427875 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:45:58.427875 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:45:58.427875 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:45:58.427875 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:45:58.427875 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:58.427875 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:45:58.427875 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:45:58.427875 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_59e65f6eb06d40d583b9f43c9af94c13", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:45:58.427875 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:58.427875 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:45:58.427875 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:45:58.427875 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:45:58.427875 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:45:58.427875 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:45:58.427875 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 443c44b0bd9e4c56a7fe0c1a53238545 Oct 17 13:45:58.427875 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:45:58.427875 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:45:58.427875 n-d-854247-14 devstack@n-api.service[127016]: {"rebuild": {"imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07"}} Oct 17 13:45:58.427875 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:45:58.427875 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance c9010ccf-8204-4fca-a799-f6269140eb8d could not be found. Oct 17 13:45:58.427875 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'c9010ccf-8204-4fca-a799-f6269140eb8d', 'body': {'rebuild': {'imageRef': '0743b21b-a6ff-4d02-897c-eabb68c3ba07'}}} Oct 17 13:45:58.427875 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:45:58.427875 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:58.427875 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:45:58.427875 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:45:58.427875 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:45:58.427875 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:45:58.427875 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 13:45:58.427875 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 13:45:58.427875 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9010ccf-8204-4fca-a799-f6269140eb8d could not be found. Oct 17 13:45:58.427875 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:58.427875 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:58.427875 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:58.427875 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:58.427875 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:58.427875 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:58.427875 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:45:58.427875 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:45:58.427875 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:45:58.427875 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:45:58.427875 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:45:58.427875 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:45:58.427875 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:45:58.427875 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:45:58.427875 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:45:58.427875 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:45:58.427875 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 17 13:45:58.427875 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 17 13:45:58.427875 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 17 13:45:58.427875 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:45:58.431750 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:45:58.431750 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:45:58.431750 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:45:58.431750 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9010ccf-8204-4fca-a799-f6269140eb8d could not be found. Oct 17 13:45:58.431750 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:58.431750 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:58.431750 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:58.431750 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:58.431750 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:58.431750 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:58.431750 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:45:58.431750 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:45:58.431750 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9010ccf-8204-4fca-a799-f6269140eb8d could not be found. Oct 17 13:45:58.431750 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:58.431750 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b4559d56-8463-4a85-bfe4-0a95594d8d3d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Returning 404 to user: Instance c9010ccf-8204-4fca-a799-f6269140eb8d could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:45:58.433312 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b4559d56-8463-4a85-bfe4-0a95594d8d3d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "POST /compute/v2.1/servers/c9010ccf-8204-4fca-a799-f6269140eb8d/action" status: 404 len: 111 microversion: 2.1 time: 0.045706 Oct 17 13:45:58.437654 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1443/2879] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:45:58 2022] POST /compute/v2.1/servers/c9010ccf-8204-4fca-a799-f6269140eb8d/action => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:45:58.439605 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6c3ef60f-b32f-486e-ad1f-cdc0fef666e5 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382" status: 200 len: 1212 microversion: 2.1 time: 0.232769 Oct 17 13:45:58.446080 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1437/2880] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:58 2022] GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382 => generated 1212 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:58.451073 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6b14d54b-f08e-43a6-95c2-79791ed8a288 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:58.455813 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6b14d54b-f08e-43a6-95c2-79791ed8a288 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:58.463875 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-593792a3-61a9-4e08-8f51-8450b344aa35 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:58.464653 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-593792a3-61a9-4e08-8f51-8450b344aa35 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] [instance: c90c4555-75a0-405d-90c7-d6ed71cc4887] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:58.482009 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-593792a3-61a9-4e08-8f51-8450b344aa35 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] HTTP exception thrown: Instance c90c4555-75a0-405d-90c7-d6ed71cc4887 could not be found. Oct 17 13:45:58.487850 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-593792a3-61a9-4e08-8f51-8450b344aa35 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Request method failure captured: Oct 17 13:45:58.487850 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/c90c4555-75a0-405d-90c7-d6ed71cc4887/metadata/test2 HTTP/1.1 Oct 17 13:45:58.487850 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:45:58.487850 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:45:58.487850 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:45:58.487850 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:45:58.487850 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:45:58.487850 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:45:58.487850 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:45:58.487850 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:45:58.487850 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVx2VP6NYR8-SkUppp7ZQwsolX_3HpVY9Dm8yijSmnsfZFkREfPENQ_w1Ij1OC4qYH0lRLCr6f6gzIFPmDSK8YyuHHgSPapUyUDCpLTfhQwxRMmntSw4k4apKpJpFuIUaomiQLXdIgE4343xOBucfNSh4fmUpqADzhFPwQjNmgbiH0A Oct 17 13:45:58.487850 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:45:58.487850 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:45:58.487850 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:45:58.487850 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:45:58.487850 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:45:58.487850 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:45:58.487850 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 338930cae76d48a19a9a0d960fc25457 Oct 17 13:45:58.487850 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1288122608 Oct 17 13:45:58.487850 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:45:58.487850 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:45:58.487850 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/338930cae76d48a19a9a0d960fc25457"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/338930cae76d48a19a9a0d960fc25457"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/338930cae76d48a19a9a0d960fc25457"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_338930cae76d48a19a9a0d960fc25457", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:45:58.487850 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1288122608 Oct 17 13:45:58.487850 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 338930cae76d48a19a9a0d960fc25457 Oct 17 13:45:58.487850 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1288122608 Oct 17 13:45:58.487850 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServerMetadataNegativeTestJSON-1288122608-project Oct 17 13:45:58.487850 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:45:58.487850 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:45:58.487850 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: e4e7aceb4e414d38a36d62fe086035d4 Oct 17 13:45:58.487850 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1288122608-project Oct 17 13:45:58.487850 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:45:58.487850 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance c90c4555-75a0-405d-90c7-d6ed71cc4887 could not be found. Oct 17 13:45:58.487850 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'server_id': 'c90c4555-75a0-405d-90c7-d6ed71cc4887', 'id': 'test2'} Oct 17 13:45:58.487850 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:45:58.487850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:58.487850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:45:58.487850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:45:58.487850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:45:58.487850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:45:58.487850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 13:45:58.487850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 13:45:58.487850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c90c4555-75a0-405d-90c7-d6ed71cc4887 could not be found. Oct 17 13:45:58.487850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:58.487850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:58.487850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:58.487850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:58.487850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:58.487850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:58.487850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:45:58.487850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:45:58.487850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:45:58.487850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:45:58.487850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 17 13:45:58.487850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 17 13:45:58.487850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:45:58.487850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:45:58.487850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c90c4555-75a0-405d-90c7-d6ed71cc4887 could not be found. Oct 17 13:45:58.487850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:58.487850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:58.487850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:58.487850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:58.487850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:58.487850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:58.493251 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:45:58.493251 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:45:58.493251 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c90c4555-75a0-405d-90c7-d6ed71cc4887 could not be found. Oct 17 13:45:58.493251 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:45:58.493768 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6b14d54b-f08e-43a6-95c2-79791ed8a288 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:58.493768 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6b14d54b-f08e-43a6-95c2-79791ed8a288 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:58.494093 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6b14d54b-f08e-43a6-95c2-79791ed8a288 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:58.497728 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6b14d54b-f08e-43a6-95c2-79791ed8a288 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:58.498255 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6b14d54b-f08e-43a6-95c2-79791ed8a288 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:58.501741 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-593792a3-61a9-4e08-8f51-8450b344aa35 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Returning 404 to user: Instance c90c4555-75a0-405d-90c7-d6ed71cc4887 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:45:58.503151 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-593792a3-61a9-4e08-8f51-8450b344aa35 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] 10.222.0.79 "GET /compute/v2.1/servers/c90c4555-75a0-405d-90c7-d6ed71cc4887/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.062848 Oct 17 13:45:58.504076 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6b14d54b-f08e-43a6-95c2-79791ed8a288 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:58.504838 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1444/2881] 10.222.0.79 () {58 vars in 1281 bytes} [Mon Oct 17 13:45:58 2022] GET /compute/v2.1/servers/c90c4555-75a0-405d-90c7-d6ed71cc4887/metadata/test2 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:45:58.540615 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a77a0fe4-fada-43e8-90ce-1faad0924b9d tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:58.541310 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a77a0fe4-fada-43e8-90ce-1faad0924b9d tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] [instance: b93ba3e5-0c3f-4e1b-825f-f788b1c32566] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:58.565048 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a77a0fe4-fada-43e8-90ce-1faad0924b9d tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:58.565557 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a77a0fe4-fada-43e8-90ce-1faad0924b9d tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:58.565994 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a77a0fe4-fada-43e8-90ce-1faad0924b9d tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:58.577540 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a77a0fe4-fada-43e8-90ce-1faad0924b9d tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:58.585371 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a77a0fe4-fada-43e8-90ce-1faad0924b9d tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:58.589272 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a77a0fe4-fada-43e8-90ce-1faad0924b9d tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:58.655421 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a77a0fe4-fada-43e8-90ce-1faad0924b9d tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] [instance: b93ba3e5-0c3f-4e1b-825f-f788b1c32566] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:45:58.882382 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a77a0fe4-fada-43e8-90ce-1faad0924b9d tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] 10.222.0.79 "DELETE /compute/v2.1/servers/b93ba3e5-0c3f-4e1b-825f-f788b1c32566" status: 204 len: 0 microversion: 2.1 time: 0.366497 Oct 17 13:45:58.887723 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1445/2882] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:45:58 2022] DELETE /compute/v2.1/servers/b93ba3e5-0c3f-4e1b-825f-f788b1c32566 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:45:58.897786 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c7582f7a-0bef-4a6f-bf11-97f2618e2424 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:58.898518 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c7582f7a-0bef-4a6f-bf11-97f2618e2424 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] [instance: b93ba3e5-0c3f-4e1b-825f-f788b1c32566] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:58.917477 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c7582f7a-0bef-4a6f-bf11-97f2618e2424 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:58.917982 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c7582f7a-0bef-4a6f-bf11-97f2618e2424 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:58.918576 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c7582f7a-0bef-4a6f-bf11-97f2618e2424 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:58.919378 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c7582f7a-0bef-4a6f-bf11-97f2618e2424 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:58.919843 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c7582f7a-0bef-4a6f-bf11-97f2618e2424 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:58.920269 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c7582f7a-0bef-4a6f-bf11-97f2618e2424 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:59.440677 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6b14d54b-f08e-43a6-95c2-79791ed8a288 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:59.453510 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6b14d54b-f08e-43a6-95c2-79791ed8a288 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 1.005038 Oct 17 13:45:59.455065 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1438/2883] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:58 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:59.469632 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-11b68a50-508f-45a2-a52a-4a4068e419f9 req-c87bcc77-7ac9-4c29-be96-cf9ff39265a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50e9eae9-df55-48ee-b984-e6b7e4bb2628", "tag": "be3444eb-9f99-422e-963d-086fa4da6881"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:59.495973 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-11b68a50-508f-45a2-a52a-4a4068e419f9 req-c87bcc77-7ac9-4c29-be96-cf9ff39265a8 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:59.496699 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-11b68a50-508f-45a2-a52a-4a4068e419f9 req-c87bcc77-7ac9-4c29-be96-cf9ff39265a8 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:59.498238 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-11b68a50-508f-45a2-a52a-4a4068e419f9 req-c87bcc77-7ac9-4c29-be96-cf9ff39265a8 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:59.513208 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-11b68a50-508f-45a2-a52a-4a4068e419f9 req-c87bcc77-7ac9-4c29-be96-cf9ff39265a8 service nova] Creating event network-changed:be3444eb-9f99-422e-963d-086fa4da6881 for instance 50e9eae9-df55-48ee-b984-e6b7e4bb2628 on n-h1-854247-14 Oct 17 13:45:59.527039 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-11b68a50-508f-45a2-a52a-4a4068e419f9 req-c87bcc77-7ac9-4c29-be96-cf9ff39265a8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069777 Oct 17 13:45:59.529917 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1439/2884] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:45:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:45:59.536885 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c7582f7a-0bef-4a6f-bf11-97f2618e2424 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e7aceb4e414d38a36d62fe086035d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338930cae76d48a19a9a0d960fc25457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:59.558025 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-507126f4-45bd-4680-ad2e-12671720b2de tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:59.558848 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-507126f4-45bd-4680-ad2e-12671720b2de tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] [instance: 50e9eae9-df55-48ee-b984-e6b7e4bb2628] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:59.559607 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c7582f7a-0bef-4a6f-bf11-97f2618e2424 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] 10.222.0.79 "GET /compute/v2.1/servers/b93ba3e5-0c3f-4e1b-825f-f788b1c32566" status: 200 len: 1526 microversion: 2.1 time: 0.669905 Oct 17 13:45:59.563797 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1446/2885] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:58 2022] GET /compute/v2.1/servers/b93ba3e5-0c3f-4e1b-825f-f788b1c32566 => generated 1526 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:59.578658 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-507126f4-45bd-4680-ad2e-12671720b2de tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:59.579799 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-507126f4-45bd-4680-ad2e-12671720b2de tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:59.580617 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-507126f4-45bd-4680-ad2e-12671720b2de tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:59.581579 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-507126f4-45bd-4680-ad2e-12671720b2de tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:59.582474 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-507126f4-45bd-4680-ad2e-12671720b2de tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:59.583027 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-83f668f9-4a44-40dc-a560-3f1b9610fd17 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:59.583377 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-507126f4-45bd-4680-ad2e-12671720b2de tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:59.585032 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-83f668f9-4a44-40dc-a560-3f1b9610fd17 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9d1105b3-be41-4963-a86b-6f4486d1d382] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:59.601665 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-83f668f9-4a44-40dc-a560-3f1b9610fd17 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:59.602168 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-83f668f9-4a44-40dc-a560-3f1b9610fd17 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:59.602591 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-83f668f9-4a44-40dc-a560-3f1b9610fd17 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:59.608440 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-83f668f9-4a44-40dc-a560-3f1b9610fd17 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:59.609116 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-83f668f9-4a44-40dc-a560-3f1b9610fd17 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:59.609427 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-83f668f9-4a44-40dc-a560-3f1b9610fd17 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:59.834607 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-83f668f9-4a44-40dc-a560-3f1b9610fd17 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:59.846027 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-83f668f9-4a44-40dc-a560-3f1b9610fd17 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382" status: 200 len: 1264 microversion: 2.1 time: 0.280801 Oct 17 13:45:59.850338 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1447/2886] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:59 2022] GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382 => generated 1264 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:59.874894 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0ab06f9e-6628-41ee-8774-70de01c850c5 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:59.876726 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0ab06f9e-6628-41ee-8774-70de01c850c5 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:59.892032 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0ab06f9e-6628-41ee-8774-70de01c850c5 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:59.892877 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0ab06f9e-6628-41ee-8774-70de01c850c5 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:59.893488 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0ab06f9e-6628-41ee-8774-70de01c850c5 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:59.894392 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0ab06f9e-6628-41ee-8774-70de01c850c5 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:59.895019 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0ab06f9e-6628-41ee-8774-70de01c850c5 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:59.895657 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0ab06f9e-6628-41ee-8774-70de01c850c5 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:00.035590 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-507126f4-45bd-4680-ad2e-12671720b2de tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a3472f83914990ad41f037b4aafd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f91db965084796a4a3dce1b4e921e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:00.053731 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-507126f4-45bd-4680-ad2e-12671720b2de tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] 10.222.0.79 "GET /compute/v2.1/servers/50e9eae9-df55-48ee-b984-e6b7e4bb2628" status: 200 len: 1322 microversion: 2.1 time: 0.519459 Oct 17 13:46:00.054324 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1440/2887] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:59 2022] GET /compute/v2.1/servers/50e9eae9-df55-48ee-b984-e6b7e4bb2628 => generated 1322 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:00.590799 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2b472b4b-cf7a-4a05-a0be-a4a3b3972b46 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:00.591806 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2b472b4b-cf7a-4a05-a0be-a4a3b3972b46 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] [instance: b93ba3e5-0c3f-4e1b-825f-f788b1c32566] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:00.603147 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2b472b4b-cf7a-4a05-a0be-a4a3b3972b46 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:00.603670 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2b472b4b-cf7a-4a05-a0be-a4a3b3972b46 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:00.609027 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2b472b4b-cf7a-4a05-a0be-a4a3b3972b46 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:00.612749 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2b472b4b-cf7a-4a05-a0be-a4a3b3972b46 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:00.613514 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2b472b4b-cf7a-4a05-a0be-a4a3b3972b46 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:00.614156 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2b472b4b-cf7a-4a05-a0be-a4a3b3972b46 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:00.949010 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0ab06f9e-6628-41ee-8774-70de01c850c5 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:00.961902 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0ab06f9e-6628-41ee-8774-70de01c850c5 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 1.105770 Oct 17 13:46:00.965955 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1448/2888] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:59 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:00.979411 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7ed139c4-3982-49e4-a2f2-2da16db55d8d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:00.980067 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7ed139c4-3982-49e4-a2f2-2da16db55d8d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9d1105b3-be41-4963-a86b-6f4486d1d382] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:00.992898 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7ed139c4-3982-49e4-a2f2-2da16db55d8d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:00.993399 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7ed139c4-3982-49e4-a2f2-2da16db55d8d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:00.995564 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7ed139c4-3982-49e4-a2f2-2da16db55d8d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:00.995564 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7ed139c4-3982-49e4-a2f2-2da16db55d8d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:00.995564 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7ed139c4-3982-49e4-a2f2-2da16db55d8d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:00.995564 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7ed139c4-3982-49e4-a2f2-2da16db55d8d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:01.735730 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7ed139c4-3982-49e4-a2f2-2da16db55d8d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:01.753053 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7ed139c4-3982-49e4-a2f2-2da16db55d8d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382" status: 200 len: 1270 microversion: 2.1 time: 0.783597 Oct 17 13:46:01.756218 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1449/2889] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:00 2022] GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382 => generated 1270 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:01.774778 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-21b0533e-eba8-4be6-b1dc-d3dccdbfa389 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:46:01.780711 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-21b0533e-eba8-4be6-b1dc-d3dccdbfa389 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: adf50c37-a232-4fb8-9478-e2ef55fde6cc] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:01.796404 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-21b0533e-eba8-4be6-b1dc-d3dccdbfa389 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] HTTP exception thrown: Instance adf50c37-a232-4fb8-9478-e2ef55fde6cc could not be found. Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-21b0533e-eba8-4be6-b1dc-d3dccdbfa389 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Request method failure captured: Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: request: POST /compute/v2.1/servers/adf50c37-a232-4fb8-9478-e2ef55fde6cc/action HTTP/1.1 Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 15 Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVwEqzYAZh4AkEjRryOAZIhaHrAKxd2Qcal9md8a5n-MMUYSdXmcWYLDVkyQoPrDIbcsApBq2EewemPkBwvNDDOidb0hhc_Z3w9BeEUj5ET_flLYPqO5hgqCsuZGXFiYIEBJxrkx614fXiELZHaNkvhSdsJHShK0w7L-UPHhkPKqi5M Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_59e65f6eb06d40d583b9f43c9af94c13", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 443c44b0bd9e4c56a7fe0c1a53238545 Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: {"restore": {}} Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance adf50c37-a232-4fb8-9478-e2ef55fde6cc could not be found. Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'adf50c37-a232-4fb8-9478-e2ef55fde6cc', 'body': {'restore': {}}} Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adf50c37-a232-4fb8-9478-e2ef55fde6cc could not be found. Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adf50c37-a232-4fb8-9478-e2ef55fde6cc could not be found. Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:46:01.799652 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:46:01.804365 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:46:01.804365 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:46:01.804365 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adf50c37-a232-4fb8-9478-e2ef55fde6cc could not be found. Oct 17 13:46:01.804365 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:46:01.804365 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-21b0533e-eba8-4be6-b1dc-d3dccdbfa389 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Returning 404 to user: Instance adf50c37-a232-4fb8-9478-e2ef55fde6cc could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:46:01.804365 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-21b0533e-eba8-4be6-b1dc-d3dccdbfa389 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "POST /compute/v2.1/servers/adf50c37-a232-4fb8-9478-e2ef55fde6cc/action" status: 404 len: 111 microversion: 2.1 time: 0.043901 Oct 17 13:46:01.806479 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1450/2890] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:46:01 2022] POST /compute/v2.1/servers/adf50c37-a232-4fb8-9478-e2ef55fde6cc/action => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:46:01.824310 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8250f737-913b-483d-8c9e-05d24633a71f tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:01.825043 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8250f737-913b-483d-8c9e-05d24633a71f tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] [instance: 50e9eae9-df55-48ee-b984-e6b7e4bb2628] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:01.843214 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8250f737-913b-483d-8c9e-05d24633a71f tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:01.843816 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8250f737-913b-483d-8c9e-05d24633a71f tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:01.844258 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8250f737-913b-483d-8c9e-05d24633a71f tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:01.844986 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8250f737-913b-483d-8c9e-05d24633a71f tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:01.845444 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8250f737-913b-483d-8c9e-05d24633a71f tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:01.845874 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8250f737-913b-483d-8c9e-05d24633a71f tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:02.102906 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2b472b4b-cf7a-4a05-a0be-a4a3b3972b46 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e7aceb4e414d38a36d62fe086035d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338930cae76d48a19a9a0d960fc25457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:02.118452 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2b472b4b-cf7a-4a05-a0be-a4a3b3972b46 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] 10.222.0.79 "GET /compute/v2.1/servers/b93ba3e5-0c3f-4e1b-825f-f788b1c32566" status: 200 len: 1526 microversion: 2.1 time: 1.531827 Oct 17 13:46:02.124108 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1441/2891] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:00 2022] GET /compute/v2.1/servers/b93ba3e5-0c3f-4e1b-825f-f788b1c32566 => generated 1526 bytes in 1538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:02.130820 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-91ba5a71-2367-4bc9-a69b-87c7885106d3 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:02.131383 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-91ba5a71-2367-4bc9-a69b-87c7885106d3 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: 87134cd4-0fff-43ba-b0a3-c4a62e3de5b1] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:02.151154 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-91ba5a71-2367-4bc9-a69b-87c7885106d3 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:02.153283 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-91ba5a71-2367-4bc9-a69b-87c7885106d3 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:02.153891 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-91ba5a71-2367-4bc9-a69b-87c7885106d3 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:02.155948 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-91ba5a71-2367-4bc9-a69b-87c7885106d3 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:02.157967 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-91ba5a71-2367-4bc9-a69b-87c7885106d3 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:02.169785 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-91ba5a71-2367-4bc9-a69b-87c7885106d3 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:02.210718 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-91ba5a71-2367-4bc9-a69b-87c7885106d3 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] HTTP exception thrown: Instance 87134cd4-0fff-43ba-b0a3-c4a62e3de5b1 could not be found. Oct 17 13:46:02.216644 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-91ba5a71-2367-4bc9-a69b-87c7885106d3 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Request method failure captured: Oct 17 13:46:02.216644 n-d-854247-14 devstack@n-api.service[127017]: request: DELETE /compute/v2.1/servers/87134cd4-0fff-43ba-b0a3-c4a62e3de5b1 HTTP/1.1 Oct 17 13:46:02.216644 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:46:02.216644 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:46:02.216644 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:46:02.216644 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:46:02.216644 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:46:02.216644 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:46:02.216644 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:46:02.216644 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:46:02.216644 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVwC0e9CoATqGmYn4xGcT3FE8Oj9evjm1YFH2xWIDqz-SmDOiryAwzQTOs-GPJHVs4PIRhkBOEiVtiX5aSbffWwTV5LQD70QSurqjrRnAEAFbBczXuvyc9v448rv1Gp8IaOUfReXe6mhgboO9wnGT7El2Mktg9R2axOqjRB5s1DD5Jw Oct 17 13:46:02.216644 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:46:02.216644 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:46:02.216644 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:46:02.216644 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:46:02.216644 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:46:02.216644 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:46:02.216644 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 676987e95424497c94984347dd6a7988 Oct 17 13:46:02.216644 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServersTestMultiNic-156823294 Oct 17 13:46:02.216644 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:46:02.216644 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:46:02.216644 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/676987e95424497c94984347dd6a7988"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/676987e95424497c94984347dd6a7988"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/676987e95424497c94984347dd6a7988"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_676987e95424497c94984347dd6a7988", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:46:02.216644 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServersTestMultiNic-156823294 Oct 17 13:46:02.216644 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 676987e95424497c94984347dd6a7988 Oct 17 13:46:02.216644 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServersTestMultiNic-156823294 Oct 17 13:46:02.216644 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServersTestMultiNic-156823294-project Oct 17 13:46:02.216644 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:46:02.216644 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:46:02.216644 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 467250951f654e33b3e233868301bbf0 Oct 17 13:46:02.216644 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServersTestMultiNic-156823294-project Oct 17 13:46:02.216644 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:46:02.216644 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 87134cd4-0fff-43ba-b0a3-c4a62e3de5b1 could not be found. Oct 17 13:46:02.216644 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '87134cd4-0fff-43ba-b0a3-c4a62e3de5b1'} Oct 17 13:46:02.216644 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:46:02.216644 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:46:02.216644 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:46:02.216644 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:46:02.216644 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:46:02.216644 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:46:02.216644 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:46:02.216644 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:46:02.216644 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:46:02.216644 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:46:02.216644 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87134cd4-0fff-43ba-b0a3-c4a62e3de5b1 could not be found. Oct 17 13:46:02.216644 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:46:02.216644 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:46:02.216644 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:46:02.216644 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:46:02.216644 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:46:02.216644 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:46:02.216644 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:46:02.216644 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:46:02.216644 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:46:02.216644 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:46:02.216644 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:46:02.216644 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:46:02.216644 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:46:02.216644 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:46:02.216644 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:46:02.216644 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:46:02.216644 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:46:02.216644 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:46:02.221398 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87134cd4-0fff-43ba-b0a3-c4a62e3de5b1 could not be found. Oct 17 13:46:02.221398 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:46:02.221398 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:46:02.221398 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:46:02.221398 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:46:02.221398 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:46:02.221398 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:46:02.221398 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:46:02.221398 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:46:02.221398 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87134cd4-0fff-43ba-b0a3-c4a62e3de5b1 could not be found. Oct 17 13:46:02.221398 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:46:02.224952 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-91ba5a71-2367-4bc9-a69b-87c7885106d3 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Returning 404 to user: Instance 87134cd4-0fff-43ba-b0a3-c4a62e3de5b1 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:46:02.226361 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-91ba5a71-2367-4bc9-a69b-87c7885106d3 tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "DELETE /compute/v2.1/servers/87134cd4-0fff-43ba-b0a3-c4a62e3de5b1" status: 404 len: 111 microversion: 2.1 time: 0.101171 Oct 17 13:46:02.228804 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1442/2892] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:46:02 2022] DELETE /compute/v2.1/servers/87134cd4-0fff-43ba-b0a3-c4a62e3de5b1 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:46:02.242070 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-39dab50b-388c-4b83-86ca-773acba2cd6c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:02.243538 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-39dab50b-388c-4b83-86ca-773acba2cd6c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:02.261128 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-39dab50b-388c-4b83-86ca-773acba2cd6c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:02.261978 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-39dab50b-388c-4b83-86ca-773acba2cd6c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:02.262422 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-39dab50b-388c-4b83-86ca-773acba2cd6c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:02.265740 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-39dab50b-388c-4b83-86ca-773acba2cd6c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:02.266721 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-39dab50b-388c-4b83-86ca-773acba2cd6c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:02.268311 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-39dab50b-388c-4b83-86ca-773acba2cd6c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:02.665609 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8250f737-913b-483d-8c9e-05d24633a71f tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a3472f83914990ad41f037b4aafd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f91db965084796a4a3dce1b4e921e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:02.684868 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8250f737-913b-483d-8c9e-05d24633a71f tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] 10.222.0.79 "GET /compute/v2.1/servers/50e9eae9-df55-48ee-b984-e6b7e4bb2628" status: 200 len: 1322 microversion: 2.1 time: 0.874087 Oct 17 13:46:02.695820 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1451/2893] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:01 2022] GET /compute/v2.1/servers/50e9eae9-df55-48ee-b984-e6b7e4bb2628 => generated 1322 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:02.717296 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-89a19694-12c2-4eb7-bcda-4980352de79f tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:02.718257 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-89a19694-12c2-4eb7-bcda-4980352de79f tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: 87134cd4-0fff-43ba-b0a3-c4a62e3de5b1] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:02.734723 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-89a19694-12c2-4eb7-bcda-4980352de79f tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:02.735367 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-89a19694-12c2-4eb7-bcda-4980352de79f tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:02.735831 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-89a19694-12c2-4eb7-bcda-4980352de79f tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:02.736595 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-89a19694-12c2-4eb7-bcda-4980352de79f tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:02.737057 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-89a19694-12c2-4eb7-bcda-4980352de79f tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:02.741838 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-89a19694-12c2-4eb7-bcda-4980352de79f tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:02.807413 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-39dab50b-388c-4b83-86ca-773acba2cd6c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:02.807648 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-89a19694-12c2-4eb7-bcda-4980352de79f tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] HTTP exception thrown: Instance 87134cd4-0fff-43ba-b0a3-c4a62e3de5b1 could not be found. Oct 17 13:46:02.809099 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-89a19694-12c2-4eb7-bcda-4980352de79f tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Request method failure captured: Oct 17 13:46:02.809099 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/87134cd4-0fff-43ba-b0a3-c4a62e3de5b1 HTTP/1.1 Oct 17 13:46:02.809099 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:46:02.809099 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:46:02.809099 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:46:02.809099 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:46:02.809099 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:46:02.809099 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:46:02.809099 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:46:02.809099 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:46:02.809099 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVwC0e9CoATqGmYn4xGcT3FE8Oj9evjm1YFH2xWIDqz-SmDOiryAwzQTOs-GPJHVs4PIRhkBOEiVtiX5aSbffWwTV5LQD70QSurqjrRnAEAFbBczXuvyc9v448rv1Gp8IaOUfReXe6mhgboO9wnGT7El2Mktg9R2axOqjRB5s1DD5Jw Oct 17 13:46:02.809099 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:46:02.809099 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:46:02.809099 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:46:02.809099 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:46:02.809099 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:46:02.809099 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:46:02.809099 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 676987e95424497c94984347dd6a7988 Oct 17 13:46:02.809099 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServersTestMultiNic-156823294 Oct 17 13:46:02.809099 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:46:02.809099 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:46:02.809099 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/676987e95424497c94984347dd6a7988"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/676987e95424497c94984347dd6a7988"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/676987e95424497c94984347dd6a7988"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_676987e95424497c94984347dd6a7988", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:46:02.809099 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServersTestMultiNic-156823294 Oct 17 13:46:02.809099 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 676987e95424497c94984347dd6a7988 Oct 17 13:46:02.809099 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServersTestMultiNic-156823294 Oct 17 13:46:02.809099 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServersTestMultiNic-156823294-project Oct 17 13:46:02.809099 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:46:02.809099 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:46:02.809099 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 467250951f654e33b3e233868301bbf0 Oct 17 13:46:02.809099 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServersTestMultiNic-156823294-project Oct 17 13:46:02.809099 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:46:02.809099 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 87134cd4-0fff-43ba-b0a3-c4a62e3de5b1 could not be found. Oct 17 13:46:02.809099 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '87134cd4-0fff-43ba-b0a3-c4a62e3de5b1'} Oct 17 13:46:02.809099 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:46:02.809099 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:46:02.809099 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:46:02.809099 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:46:02.809099 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:46:02.809099 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:46:02.809099 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:46:02.809099 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:46:02.809099 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:46:02.809099 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:46:02.809099 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87134cd4-0fff-43ba-b0a3-c4a62e3de5b1 could not be found. Oct 17 13:46:02.809099 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:46:02.809099 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:46:02.809099 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:46:02.809099 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:46:02.809099 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:46:02.809099 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:46:02.809099 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:46:02.809099 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:46:02.809099 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:46:02.809099 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:46:02.809099 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:46:02.809099 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:46:02.809099 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:46:02.809099 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:46:02.809099 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:46:02.809099 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:46:02.809099 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87134cd4-0fff-43ba-b0a3-c4a62e3de5b1 could not be found. Oct 17 13:46:02.809099 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:46:02.809099 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:46:02.809099 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:46:02.814246 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:46:02.814246 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:46:02.814246 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:46:02.814246 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:46:02.814246 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:46:02.814246 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87134cd4-0fff-43ba-b0a3-c4a62e3de5b1 could not be found. Oct 17 13:46:02.814246 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:46:02.814246 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-89a19694-12c2-4eb7-bcda-4980352de79f tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Returning 404 to user: Instance 87134cd4-0fff-43ba-b0a3-c4a62e3de5b1 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:46:02.814246 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-89a19694-12c2-4eb7-bcda-4980352de79f tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "GET /compute/v2.1/servers/87134cd4-0fff-43ba-b0a3-c4a62e3de5b1" status: 404 len: 111 microversion: 2.1 time: 0.113384 Oct 17 13:46:02.815099 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1452/2894] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:02 2022] GET /compute/v2.1/servers/87134cd4-0fff-43ba-b0a3-c4a62e3de5b1 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:46:02.821486 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5e6e43a4-d353-498c-9a24-3b1262b3626f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:02.822121 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5e6e43a4-d353-498c-9a24-3b1262b3626f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9d1105b3-be41-4963-a86b-6f4486d1d382] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:02.839538 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-39dab50b-388c-4b83-86ca-773acba2cd6c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 0.600581 Oct 17 13:46:02.840436 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1443/2895] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:02 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:02.845514 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d2476bd8-3c40-4e4e-aad3-5ac185c268cf tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:02.868290 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d2476bd8-3c40-4e4e-aad3-5ac185c268cf tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: e555208e-39b0-4361-94a5-6b272c336be4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:02.872385 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5e6e43a4-d353-498c-9a24-3b1262b3626f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:02.873135 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5e6e43a4-d353-498c-9a24-3b1262b3626f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:02.874071 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5e6e43a4-d353-498c-9a24-3b1262b3626f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:02.875958 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5e6e43a4-d353-498c-9a24-3b1262b3626f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:02.879043 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5e6e43a4-d353-498c-9a24-3b1262b3626f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:02.879916 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5e6e43a4-d353-498c-9a24-3b1262b3626f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:02.894015 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d2476bd8-3c40-4e4e-aad3-5ac185c268cf tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:02.894520 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d2476bd8-3c40-4e4e-aad3-5ac185c268cf tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:02.894962 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d2476bd8-3c40-4e4e-aad3-5ac185c268cf tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:02.895719 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d2476bd8-3c40-4e4e-aad3-5ac185c268cf tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:02.896175 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d2476bd8-3c40-4e4e-aad3-5ac185c268cf tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:02.896695 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d2476bd8-3c40-4e4e-aad3-5ac185c268cf tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:02.945189 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-d2476bd8-3c40-4e4e-aad3-5ac185c268cf tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] HTTP exception thrown: Instance e555208e-39b0-4361-94a5-6b272c336be4 could not be found. Oct 17 13:46:02.951758 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d2476bd8-3c40-4e4e-aad3-5ac185c268cf tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Request method failure captured: Oct 17 13:46:02.951758 n-d-854247-14 devstack@n-api.service[127017]: request: DELETE /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4 HTTP/1.1 Oct 17 13:46:02.951758 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:46:02.951758 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:46:02.951758 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:46:02.951758 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:46:02.951758 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:46:02.951758 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:46:02.951758 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:46:02.951758 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:46:02.951758 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVwC0e9CoATqGmYn4xGcT3FE8Oj9evjm1YFH2xWIDqz-SmDOiryAwzQTOs-GPJHVs4PIRhkBOEiVtiX5aSbffWwTV5LQD70QSurqjrRnAEAFbBczXuvyc9v448rv1Gp8IaOUfReXe6mhgboO9wnGT7El2Mktg9R2axOqjRB5s1DD5Jw Oct 17 13:46:02.951758 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:46:02.951758 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:46:02.951758 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:46:02.951758 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:46:02.951758 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:46:02.951758 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:46:02.951758 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 676987e95424497c94984347dd6a7988 Oct 17 13:46:02.951758 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServersTestMultiNic-156823294 Oct 17 13:46:02.951758 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:46:02.951758 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:46:02.951758 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/676987e95424497c94984347dd6a7988"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/676987e95424497c94984347dd6a7988"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/676987e95424497c94984347dd6a7988"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_676987e95424497c94984347dd6a7988", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:46:02.951758 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServersTestMultiNic-156823294 Oct 17 13:46:02.951758 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 676987e95424497c94984347dd6a7988 Oct 17 13:46:02.951758 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServersTestMultiNic-156823294 Oct 17 13:46:02.951758 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServersTestMultiNic-156823294-project Oct 17 13:46:02.951758 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:46:02.951758 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:46:02.951758 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 467250951f654e33b3e233868301bbf0 Oct 17 13:46:02.951758 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServersTestMultiNic-156823294-project Oct 17 13:46:02.951758 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:46:02.951758 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance e555208e-39b0-4361-94a5-6b272c336be4 could not be found. Oct 17 13:46:02.951758 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'e555208e-39b0-4361-94a5-6b272c336be4'} Oct 17 13:46:02.951758 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:46:02.951758 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:46:02.951758 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:46:02.951758 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:46:02.951758 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:46:02.951758 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:46:02.951758 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:46:02.951758 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:46:02.951758 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:46:02.951758 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:46:02.951758 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e555208e-39b0-4361-94a5-6b272c336be4 could not be found. Oct 17 13:46:02.951758 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:46:02.951758 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:46:02.951758 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:46:02.951758 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:46:02.951758 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:46:02.951758 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:46:02.951758 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:46:02.951758 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:46:02.951758 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:46:02.951758 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:46:02.951758 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:46:02.951758 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:46:02.951758 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:46:02.951758 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:46:02.951758 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:46:02.951758 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:46:02.951758 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:46:02.951758 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:46:02.955907 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e555208e-39b0-4361-94a5-6b272c336be4 could not be found. Oct 17 13:46:02.955907 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:46:02.955907 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:46:02.955907 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:46:02.955907 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:46:02.955907 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:46:02.955907 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:46:02.955907 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:46:02.955907 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:46:02.955907 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e555208e-39b0-4361-94a5-6b272c336be4 could not be found. Oct 17 13:46:02.955907 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:46:02.960042 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d2476bd8-3c40-4e4e-aad3-5ac185c268cf tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Returning 404 to user: Instance e555208e-39b0-4361-94a5-6b272c336be4 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:46:02.961533 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d2476bd8-3c40-4e4e-aad3-5ac185c268cf tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "DELETE /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4" status: 404 len: 111 microversion: 2.1 time: 0.119971 Oct 17 13:46:02.970073 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1444/2896] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:46:02 2022] DELETE /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:46:02.990131 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9bbe6042-22bd-4cd9-bb61-410d9b07926c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:02.990789 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9bbe6042-22bd-4cd9-bb61-410d9b07926c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:03.015791 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9bbe6042-22bd-4cd9-bb61-410d9b07926c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:03.016300 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9bbe6042-22bd-4cd9-bb61-410d9b07926c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:03.019723 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9bbe6042-22bd-4cd9-bb61-410d9b07926c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:03.020702 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9bbe6042-22bd-4cd9-bb61-410d9b07926c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:03.021175 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9bbe6042-22bd-4cd9-bb61-410d9b07926c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:03.021655 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9bbe6042-22bd-4cd9-bb61-410d9b07926c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:03.248407 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5e6e43a4-d353-498c-9a24-3b1262b3626f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:03.263885 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5e6e43a4-d353-498c-9a24-3b1262b3626f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382" status: 200 len: 1270 microversion: 2.1 time: 0.448095 Oct 17 13:46:03.287543 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1453/2897] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:02 2022] GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382 => generated 1270 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:03.293235 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7c340012-712c-4eae-99ef-f1c68054065a tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:03.294112 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7c340012-712c-4eae-99ef-f1c68054065a tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] [instance: e555208e-39b0-4361-94a5-6b272c336be4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:03.301266 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7c340012-712c-4eae-99ef-f1c68054065a tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:03.302104 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7c340012-712c-4eae-99ef-f1c68054065a tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:03.302773 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7c340012-712c-4eae-99ef-f1c68054065a tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:03.303773 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7c340012-712c-4eae-99ef-f1c68054065a tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:03.304477 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7c340012-712c-4eae-99ef-f1c68054065a tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:03.305146 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7c340012-712c-4eae-99ef-f1c68054065a tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:03.341181 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-7c340012-712c-4eae-99ef-f1c68054065a tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] HTTP exception thrown: Instance e555208e-39b0-4361-94a5-6b272c336be4 could not be found. Oct 17 13:46:03.342964 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7c340012-712c-4eae-99ef-f1c68054065a tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Request method failure captured: Oct 17 13:46:03.342964 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4 HTTP/1.1 Oct 17 13:46:03.342964 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:46:03.342964 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:46:03.342964 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:46:03.342964 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:46:03.342964 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:46:03.342964 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:46:03.342964 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:46:03.342964 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:46:03.342964 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVwC0e9CoATqGmYn4xGcT3FE8Oj9evjm1YFH2xWIDqz-SmDOiryAwzQTOs-GPJHVs4PIRhkBOEiVtiX5aSbffWwTV5LQD70QSurqjrRnAEAFbBczXuvyc9v448rv1Gp8IaOUfReXe6mhgboO9wnGT7El2Mktg9R2axOqjRB5s1DD5Jw Oct 17 13:46:03.342964 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:46:03.342964 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:46:03.342964 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:46:03.342964 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:46:03.342964 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:46:03.342964 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:46:03.342964 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 676987e95424497c94984347dd6a7988 Oct 17 13:46:03.342964 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServersTestMultiNic-156823294 Oct 17 13:46:03.342964 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:46:03.342964 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:46:03.342964 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/676987e95424497c94984347dd6a7988"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/676987e95424497c94984347dd6a7988"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/676987e95424497c94984347dd6a7988"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_676987e95424497c94984347dd6a7988", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:46:03.342964 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServersTestMultiNic-156823294 Oct 17 13:46:03.342964 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 676987e95424497c94984347dd6a7988 Oct 17 13:46:03.342964 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServersTestMultiNic-156823294 Oct 17 13:46:03.342964 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServersTestMultiNic-156823294-project Oct 17 13:46:03.342964 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:46:03.342964 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:46:03.342964 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 467250951f654e33b3e233868301bbf0 Oct 17 13:46:03.342964 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServersTestMultiNic-156823294-project Oct 17 13:46:03.342964 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:46:03.342964 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance e555208e-39b0-4361-94a5-6b272c336be4 could not be found. Oct 17 13:46:03.342964 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'e555208e-39b0-4361-94a5-6b272c336be4'} Oct 17 13:46:03.342964 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:46:03.342964 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:46:03.342964 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:46:03.342964 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:46:03.342964 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:46:03.342964 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:46:03.342964 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:46:03.342964 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:46:03.342964 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:46:03.342964 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:46:03.342964 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e555208e-39b0-4361-94a5-6b272c336be4 could not be found. Oct 17 13:46:03.342964 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:46:03.342964 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:46:03.342964 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:46:03.342964 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:46:03.342964 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:46:03.342964 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:46:03.342964 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:46:03.342964 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:46:03.342964 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:46:03.342964 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:46:03.342964 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:46:03.342964 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:46:03.342964 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:46:03.342964 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:46:03.342964 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:46:03.342964 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:46:03.342964 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e555208e-39b0-4361-94a5-6b272c336be4 could not be found. Oct 17 13:46:03.342964 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:46:03.342964 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:46:03.342964 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:46:03.347895 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:46:03.347895 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:46:03.347895 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:46:03.347895 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:46:03.347895 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:46:03.347895 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e555208e-39b0-4361-94a5-6b272c336be4 could not be found. Oct 17 13:46:03.347895 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:46:03.348581 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7c340012-712c-4eae-99ef-f1c68054065a tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] Returning 404 to user: Instance e555208e-39b0-4361-94a5-6b272c336be4 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:46:03.349885 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7c340012-712c-4eae-99ef-f1c68054065a tempest-ServersTestMultiNic-156823294 tempest-ServersTestMultiNic-156823294-project] 10.222.0.79 "GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4" status: 404 len: 111 microversion: 2.1 time: 0.060895 Oct 17 13:46:03.359837 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1454/2898] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:03 2022] GET /compute/v2.1/servers/e555208e-39b0-4361-94a5-6b272c336be4 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:46:03.369849 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-20e5a8c3-b582-4c02-b952-39dc87575b46 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:03.370762 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-20e5a8c3-b582-4c02-b952-39dc87575b46 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] [instance: b93ba3e5-0c3f-4e1b-825f-f788b1c32566] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:03.385246 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-20e5a8c3-b582-4c02-b952-39dc87575b46 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:03.385847 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-20e5a8c3-b582-4c02-b952-39dc87575b46 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:03.386386 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-20e5a8c3-b582-4c02-b952-39dc87575b46 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:03.389949 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-20e5a8c3-b582-4c02-b952-39dc87575b46 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:03.389949 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-20e5a8c3-b582-4c02-b952-39dc87575b46 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:03.389949 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-20e5a8c3-b582-4c02-b952-39dc87575b46 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:03.951082 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9bbe6042-22bd-4cd9-bb61-410d9b07926c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:03.970197 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9bbe6042-22bd-4cd9-bb61-410d9b07926c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 0.985936 Oct 17 13:46:03.971249 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1445/2899] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:02 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:03.976359 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-99f0dcee-e9f5-4376-8d8e-3b6c89dce53a tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:03.989166 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-99f0dcee-e9f5-4376-8d8e-3b6c89dce53a tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] [instance: 50e9eae9-df55-48ee-b984-e6b7e4bb2628] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:03.995786 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-99f0dcee-e9f5-4376-8d8e-3b6c89dce53a tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:03.999585 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-99f0dcee-e9f5-4376-8d8e-3b6c89dce53a tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:04.000459 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-99f0dcee-e9f5-4376-8d8e-3b6c89dce53a tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:04.001206 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-99f0dcee-e9f5-4376-8d8e-3b6c89dce53a tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:04.001663 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-99f0dcee-e9f5-4376-8d8e-3b6c89dce53a tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:04.002098 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-99f0dcee-e9f5-4376-8d8e-3b6c89dce53a tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:04.203461 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-20e5a8c3-b582-4c02-b952-39dc87575b46 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e7aceb4e414d38a36d62fe086035d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338930cae76d48a19a9a0d960fc25457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:04.211703 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-20e5a8c3-b582-4c02-b952-39dc87575b46 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] 10.222.0.79 "GET /compute/v2.1/servers/b93ba3e5-0c3f-4e1b-825f-f788b1c32566" status: 200 len: 1526 microversion: 2.1 time: 0.846906 Oct 17 13:46:04.233523 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1455/2900] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:03 2022] GET /compute/v2.1/servers/b93ba3e5-0c3f-4e1b-825f-f788b1c32566 => generated 1526 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:04.238720 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0fb2d9ab-0a53-4005-afe7-e83c2668f298 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:46:04.239287 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0fb2d9ab-0a53-4005-afe7-e83c2668f298 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:04.257733 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0fb2d9ab-0a53-4005-afe7-e83c2668f298 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:04.258466 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0fb2d9ab-0a53-4005-afe7-e83c2668f298 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:04.259064 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0fb2d9ab-0a53-4005-afe7-e83c2668f298 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:04.259958 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0fb2d9ab-0a53-4005-afe7-e83c2668f298 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:04.260565 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0fb2d9ab-0a53-4005-afe7-e83c2668f298 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:04.261192 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0fb2d9ab-0a53-4005-afe7-e83c2668f298 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:04.315479 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-0fb2d9ab-0a53-4005-afe7-e83c2668f298 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] HTTP exception thrown: Cannot 'restore' instance 5ef00d34-7f81-4649-a90a-a52cf78dbeca while it is in vm_state active Oct 17 13:46:04.317185 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0fb2d9ab-0a53-4005-afe7-e83c2668f298 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Request method failure captured: Oct 17 13:46:04.317185 n-d-854247-14 devstack@n-api.service[127016]: request: POST /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca/action HTTP/1.1 Oct 17 13:46:04.317185 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:46:04.317185 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:46:04.317185 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:46:04.317185 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 15 Oct 17 13:46:04.317185 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:46:04.317185 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:46:04.317185 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:46:04.317185 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:46:04.317185 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVwEqzYAZh4AkEjRryOAZIhaHrAKxd2Qcal9md8a5n-MMUYSdXmcWYLDVkyQoPrDIbcsApBq2EewemPkBwvNDDOidb0hhc_Z3w9BeEUj5ET_flLYPqO5hgqCsuZGXFiYIEBJxrkx614fXiELZHaNkvhSdsJHShK0w7L-UPHhkPKqi5M Oct 17 13:46:04.317185 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:46:04.317185 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:46:04.317185 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:46:04.317185 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:46:04.317185 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:46:04.317185 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:46:04.317185 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:46:04.317185 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:46:04.317185 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:46:04.317185 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:46:04.317185 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_59e65f6eb06d40d583b9f43c9af94c13", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:46:04.317185 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:46:04.317185 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:46:04.317185 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:46:04.317185 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:46:04.317185 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:46:04.317185 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:46:04.317185 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 443c44b0bd9e4c56a7fe0c1a53238545 Oct 17 13:46:04.317185 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:46:04.317185 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:46:04.317185 n-d-854247-14 devstack@n-api.service[127016]: {"restore": {}} Oct 17 13:46:04.317185 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:46:04.317185 n-d-854247-14 devstack@n-api.service[127016]: exception: Cannot 'restore' instance 5ef00d34-7f81-4649-a90a-a52cf78dbeca while it is in vm_state active Oct 17 13:46:04.317185 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '5ef00d34-7f81-4649-a90a-a52cf78dbeca', 'body': {'restore': {}}} Oct 17 13:46:04.317185 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:46:04.317185 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:46:04.317185 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 17 13:46:04.317185 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 17 13:46:04.317185 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 13:46:04.317185 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:46:04.317185 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 13:46:04.317185 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 13:46:04.317185 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5ef00d34-7f81-4649-a90a-a52cf78dbeca in vm_state active. Cannot restore while the instance is in this state. Oct 17 13:46:04.317185 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:46:04.317185 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:46:04.317185 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:46:04.317185 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:46:04.317185 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:46:04.317185 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:46:04.317185 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:46:04.317185 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:46:04.317185 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:46:04.317185 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:46:04.317185 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 17 13:46:04.317185 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 17 13:46:04.317185 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 13:46:04.317185 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 13:46:04.317185 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 5ef00d34-7f81-4649-a90a-a52cf78dbeca while it is in vm_state active Oct 17 13:46:04.317185 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:46:04.317185 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:46:04.317185 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:46:04.317185 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:46:04.317185 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:46:04.322907 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:46:04.322907 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:46:04.322907 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:46:04.322907 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 5ef00d34-7f81-4649-a90a-a52cf78dbeca while it is in vm_state active Oct 17 13:46:04.322907 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:46:04.322907 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0fb2d9ab-0a53-4005-afe7-e83c2668f298 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Returning 409 to user: Cannot 'restore' instance 5ef00d34-7f81-4649-a90a-a52cf78dbeca while it is in vm_state active {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:46:04.322907 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0fb2d9ab-0a53-4005-afe7-e83c2668f298 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "POST /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca/action" status: 409 len: 145 microversion: 2.1 time: 0.084462 Oct 17 13:46:04.332184 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1456/2901] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:46:04 2022] POST /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca/action => generated 145 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:46:04.337189 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-95e1ba92-f0c8-4a2e-8e76-d66ebcaecc76 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:04.337815 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-95e1ba92-f0c8-4a2e-8e76-d66ebcaecc76 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9d1105b3-be41-4963-a86b-6f4486d1d382] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:04.353135 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-95e1ba92-f0c8-4a2e-8e76-d66ebcaecc76 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:04.353647 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-95e1ba92-f0c8-4a2e-8e76-d66ebcaecc76 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:04.354082 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-95e1ba92-f0c8-4a2e-8e76-d66ebcaecc76 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:04.355080 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-95e1ba92-f0c8-4a2e-8e76-d66ebcaecc76 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:04.355587 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-95e1ba92-f0c8-4a2e-8e76-d66ebcaecc76 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:04.356015 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-95e1ba92-f0c8-4a2e-8e76-d66ebcaecc76 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:04.710106 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-95e1ba92-f0c8-4a2e-8e76-d66ebcaecc76 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:04.732250 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:46:04.734669 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-95e1ba92-f0c8-4a2e-8e76-d66ebcaecc76 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382" status: 200 len: 1270 microversion: 2.1 time: 0.401331 Oct 17 13:46:04.746562 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1457/2902] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:04 2022] GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382 => generated 1270 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:04.788433 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1441ce79-7dad-47a9-8416-b4c5c3b863c1 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:04.789137 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-1441ce79-7dad-47a9-8416-b4c5c3b863c1 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:04.842398 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1441ce79-7dad-47a9-8416-b4c5c3b863c1 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:04.842938 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1441ce79-7dad-47a9-8416-b4c5c3b863c1 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:04.843611 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1441ce79-7dad-47a9-8416-b4c5c3b863c1 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:04.844224 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1441ce79-7dad-47a9-8416-b4c5c3b863c1 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:04.844620 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1441ce79-7dad-47a9-8416-b4c5c3b863c1 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:04.845047 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1441ce79-7dad-47a9-8416-b4c5c3b863c1 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:05.292259 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-99f0dcee-e9f5-4376-8d8e-3b6c89dce53a tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a3472f83914990ad41f037b4aafd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f91db965084796a4a3dce1b4e921e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:05.302074 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-99f0dcee-e9f5-4376-8d8e-3b6c89dce53a tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] 10.222.0.79 "GET /compute/v2.1/servers/50e9eae9-df55-48ee-b984-e6b7e4bb2628" status: 200 len: 1322 microversion: 2.1 time: 1.329466 Oct 17 13:46:05.331660 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1446/2903] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:03 2022] GET /compute/v2.1/servers/50e9eae9-df55-48ee-b984-e6b7e4bb2628 => generated 1322 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:05.338062 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-527a63c6-64b6-45a7-83a5-e9e9c4204358 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:05.343820 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-527a63c6-64b6-45a7-83a5-e9e9c4204358 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] [instance: b93ba3e5-0c3f-4e1b-825f-f788b1c32566] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:05.361369 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-527a63c6-64b6-45a7-83a5-e9e9c4204358 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:05.362115 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-527a63c6-64b6-45a7-83a5-e9e9c4204358 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:05.363679 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-527a63c6-64b6-45a7-83a5-e9e9c4204358 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:05.364587 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-527a63c6-64b6-45a7-83a5-e9e9c4204358 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:05.367863 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-527a63c6-64b6-45a7-83a5-e9e9c4204358 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:05.368515 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-527a63c6-64b6-45a7-83a5-e9e9c4204358 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:05.433846 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-527a63c6-64b6-45a7-83a5-e9e9c4204358 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:05.434548 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-527a63c6-64b6-45a7-83a5-e9e9c4204358 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:05.435618 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-527a63c6-64b6-45a7-83a5-e9e9c4204358 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:05.436216 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-527a63c6-64b6-45a7-83a5-e9e9c4204358 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lazy-loading 'fault' on Instance uuid b93ba3e5-0c3f-4e1b-825f-f788b1c32566 {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:46:05.686551 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-527a63c6-64b6-45a7-83a5-e9e9c4204358 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e7aceb4e414d38a36d62fe086035d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338930cae76d48a19a9a0d960fc25457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:05.703459 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-527a63c6-64b6-45a7-83a5-e9e9c4204358 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] 10.222.0.79 "GET /compute/v2.1/servers/b93ba3e5-0c3f-4e1b-825f-f788b1c32566" status: 200 len: 1314 microversion: 2.1 time: 0.365172 Oct 17 13:46:05.721972 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1447/2904] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:05 2022] GET /compute/v2.1/servers/b93ba3e5-0c3f-4e1b-825f-f788b1c32566 => generated 1314 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:05.736127 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-42a6124a-4b49-4014-91fe-9c654c449bac req-f2bc15b1-5ba7-471f-bfc2-dfaecdc6282f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b93ba3e5-0c3f-4e1b-825f-f788b1c32566", "name": "network-vif-deleted", "tag": "7433f69b-78d0-4c1f-b875-f23a1a8e1fac"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:46:05.752001 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-42a6124a-4b49-4014-91fe-9c654c449bac req-f2bc15b1-5ba7-471f-bfc2-dfaecdc6282f service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:05.752762 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-42a6124a-4b49-4014-91fe-9c654c449bac req-f2bc15b1-5ba7-471f-bfc2-dfaecdc6282f service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:05.753385 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-42a6124a-4b49-4014-91fe-9c654c449bac req-f2bc15b1-5ba7-471f-bfc2-dfaecdc6282f service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:05.774360 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=100 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:46:05.777342 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-42a6124a-4b49-4014-91fe-9c654c449bac req-f2bc15b1-5ba7-471f-bfc2-dfaecdc6282f service nova] Creating event network-vif-deleted:7433f69b-78d0-4c1f-b875-f23a1a8e1fac for instance b93ba3e5-0c3f-4e1b-825f-f788b1c32566 on n-h2-854247-14 Oct 17 13:46:05.787966 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-42a6124a-4b49-4014-91fe-9c654c449bac req-f2bc15b1-5ba7-471f-bfc2-dfaecdc6282f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064267 Oct 17 13:46:05.790766 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1448/2905] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:46:05.822650 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ee93c21c-0045-4e81-87b9-3b3301a15ad4 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:05.824159 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ee93c21c-0045-4e81-87b9-3b3301a15ad4 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9d1105b3-be41-4963-a86b-6f4486d1d382] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:05.831883 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ee93c21c-0045-4e81-87b9-3b3301a15ad4 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:05.832609 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ee93c21c-0045-4e81-87b9-3b3301a15ad4 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:05.833227 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ee93c21c-0045-4e81-87b9-3b3301a15ad4 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:05.837006 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-1441ce79-7dad-47a9-8416-b4c5c3b863c1 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:05.849902 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1441ce79-7dad-47a9-8416-b4c5c3b863c1 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 1.077875 Oct 17 13:46:05.851551 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ee93c21c-0045-4e81-87b9-3b3301a15ad4 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:05.852190 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ee93c21c-0045-4e81-87b9-3b3301a15ad4 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:05.852775 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ee93c21c-0045-4e81-87b9-3b3301a15ad4 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:05.854143 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1458/2906] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:04 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:05.882728 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a69a929d-72d0-431e-a77a-a664e2550c64 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:05.883809 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a69a929d-72d0-431e-a77a-a664e2550c64 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:05.895838 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a69a929d-72d0-431e-a77a-a664e2550c64 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:05.896542 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a69a929d-72d0-431e-a77a-a664e2550c64 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:05.906957 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a69a929d-72d0-431e-a77a-a664e2550c64 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:05.908746 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a69a929d-72d0-431e-a77a-a664e2550c64 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:05.909608 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a69a929d-72d0-431e-a77a-a664e2550c64 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:05.910271 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a69a929d-72d0-431e-a77a-a664e2550c64 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:06.109576 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ee93c21c-0045-4e81-87b9-3b3301a15ad4 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:06.118569 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ee93c21c-0045-4e81-87b9-3b3301a15ad4 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382" status: 200 len: 1270 microversion: 2.1 time: 0.309612 Oct 17 13:46:06.126680 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1449/2907] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:05 2022] GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382 => generated 1270 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:06.330337 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-64794fa0-0721-46d5-87b4-2553b17c30e6 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:06.331061 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-64794fa0-0721-46d5-87b4-2553b17c30e6 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] [instance: 50e9eae9-df55-48ee-b984-e6b7e4bb2628] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:06.350982 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-64794fa0-0721-46d5-87b4-2553b17c30e6 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:06.351520 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-64794fa0-0721-46d5-87b4-2553b17c30e6 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:06.351955 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-64794fa0-0721-46d5-87b4-2553b17c30e6 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:06.352656 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-64794fa0-0721-46d5-87b4-2553b17c30e6 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:06.353302 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-64794fa0-0721-46d5-87b4-2553b17c30e6 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:06.353734 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-64794fa0-0721-46d5-87b4-2553b17c30e6 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:07.392554 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a69a929d-72d0-431e-a77a-a664e2550c64 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:07.404791 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a69a929d-72d0-431e-a77a-a664e2550c64 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 1.526091 Oct 17 13:46:07.420724 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1459/2908] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:05 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 1542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:07.431697 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4dfa80a6-e01e-46b3-804f-1975a4fb8e65 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:07.432605 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4dfa80a6-e01e-46b3-804f-1975a4fb8e65 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] [instance: b93ba3e5-0c3f-4e1b-825f-f788b1c32566] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:07.445083 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4dfa80a6-e01e-46b3-804f-1975a4fb8e65 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:07.445900 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4dfa80a6-e01e-46b3-804f-1975a4fb8e65 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:07.446606 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4dfa80a6-e01e-46b3-804f-1975a4fb8e65 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:07.447888 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4dfa80a6-e01e-46b3-804f-1975a4fb8e65 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:07.448525 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4dfa80a6-e01e-46b3-804f-1975a4fb8e65 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:07.449201 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4dfa80a6-e01e-46b3-804f-1975a4fb8e65 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:07.466896 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:46:07.471848 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-4dfa80a6-e01e-46b3-804f-1975a4fb8e65 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] HTTP exception thrown: Instance b93ba3e5-0c3f-4e1b-825f-f788b1c32566 could not be found. Oct 17 13:46:07.473891 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4dfa80a6-e01e-46b3-804f-1975a4fb8e65 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Request method failure captured: Oct 17 13:46:07.473891 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/b93ba3e5-0c3f-4e1b-825f-f788b1c32566 HTTP/1.1 Oct 17 13:46:07.473891 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:46:07.473891 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:46:07.473891 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:46:07.473891 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:46:07.473891 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:46:07.473891 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:46:07.473891 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:46:07.473891 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:46:07.473891 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVx2VP6NYR8-SkUppp7ZQwsolX_3HpVY9Dm8yijSmnsfZFkREfPENQ_w1Ij1OC4qYH0lRLCr6f6gzIFPmDSK8YyuHHgSPapUyUDCpLTfhQwxRMmntSw4k4apKpJpFuIUaomiQLXdIgE4343xOBucfNSh4fmUpqADzhFPwQjNmgbiH0A Oct 17 13:46:07.473891 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:46:07.473891 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:46:07.473891 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:46:07.473891 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:46:07.473891 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:46:07.473891 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:46:07.473891 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 338930cae76d48a19a9a0d960fc25457 Oct 17 13:46:07.473891 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1288122608 Oct 17 13:46:07.473891 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:46:07.473891 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:46:07.473891 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/338930cae76d48a19a9a0d960fc25457"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/338930cae76d48a19a9a0d960fc25457"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/338930cae76d48a19a9a0d960fc25457"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_338930cae76d48a19a9a0d960fc25457", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:46:07.473891 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1288122608 Oct 17 13:46:07.473891 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 338930cae76d48a19a9a0d960fc25457 Oct 17 13:46:07.473891 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1288122608 Oct 17 13:46:07.473891 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServerMetadataNegativeTestJSON-1288122608-project Oct 17 13:46:07.473891 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:46:07.473891 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:46:07.473891 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: e4e7aceb4e414d38a36d62fe086035d4 Oct 17 13:46:07.473891 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1288122608-project Oct 17 13:46:07.473891 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:46:07.473891 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance b93ba3e5-0c3f-4e1b-825f-f788b1c32566 could not be found. Oct 17 13:46:07.473891 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'b93ba3e5-0c3f-4e1b-825f-f788b1c32566'} Oct 17 13:46:07.473891 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:46:07.473891 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:46:07.473891 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:46:07.473891 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:46:07.473891 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:46:07.473891 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:46:07.473891 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:46:07.473891 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:46:07.473891 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:46:07.473891 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:46:07.473891 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b93ba3e5-0c3f-4e1b-825f-f788b1c32566 could not be found. Oct 17 13:46:07.473891 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:46:07.473891 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:46:07.473891 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:46:07.473891 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:46:07.473891 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:46:07.473891 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:46:07.473891 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:46:07.473891 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:46:07.473891 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:46:07.473891 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:46:07.473891 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:46:07.473891 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:46:07.473891 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:46:07.473891 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:46:07.473891 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:46:07.473891 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:46:07.473891 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b93ba3e5-0c3f-4e1b-825f-f788b1c32566 could not be found. Oct 17 13:46:07.473891 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:46:07.473891 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:46:07.479217 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:46:07.479217 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:46:07.479217 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:46:07.479217 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:46:07.479217 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:46:07.479217 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:46:07.479217 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b93ba3e5-0c3f-4e1b-825f-f788b1c32566 could not be found. Oct 17 13:46:07.479217 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:46:07.480623 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4dfa80a6-e01e-46b3-804f-1975a4fb8e65 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] Returning 404 to user: Instance b93ba3e5-0c3f-4e1b-825f-f788b1c32566 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:46:07.482195 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4dfa80a6-e01e-46b3-804f-1975a4fb8e65 tempest-ServerMetadataNegativeTestJSON-1288122608 tempest-ServerMetadataNegativeTestJSON-1288122608-project] 10.222.0.79 "GET /compute/v2.1/servers/b93ba3e5-0c3f-4e1b-825f-f788b1c32566" status: 404 len: 111 microversion: 2.1 time: 0.059999 Oct 17 13:46:07.483700 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1460/2909] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:07 2022] GET /compute/v2.1/servers/b93ba3e5-0c3f-4e1b-825f-f788b1c32566 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:46:07.489812 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-27628d5e-4df7-4c78-832a-f725b768f547 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:07.490832 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-27628d5e-4df7-4c78-832a-f725b768f547 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9d1105b3-be41-4963-a86b-6f4486d1d382] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:07.498475 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=8 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:46:07.501063 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-27628d5e-4df7-4c78-832a-f725b768f547 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:07.502165 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-27628d5e-4df7-4c78-832a-f725b768f547 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:07.503734 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-27628d5e-4df7-4c78-832a-f725b768f547 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:07.504815 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-27628d5e-4df7-4c78-832a-f725b768f547 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:07.505440 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-27628d5e-4df7-4c78-832a-f725b768f547 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:07.506023 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-27628d5e-4df7-4c78-832a-f725b768f547 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:07.699216 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-27628d5e-4df7-4c78-832a-f725b768f547 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:07.708147 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-27628d5e-4df7-4c78-832a-f725b768f547 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382" status: 200 len: 1270 microversion: 2.1 time: 0.222509 Oct 17 13:46:07.709032 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1461/2910] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:07 2022] GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382 => generated 1270 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:07.716128 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-936953c8-b26a-44cb-b612-b10c78cf1cbf tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:46:07.717009 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-936953c8-b26a-44cb-b612-b10c78cf1cbf tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef0b144-21bc-472e-af71-2848dd20f8af] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:07.724754 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-936953c8-b26a-44cb-b612-b10c78cf1cbf tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] HTTP exception thrown: Instance 5ef0b144-21bc-472e-af71-2848dd20f8af could not be found. Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-936953c8-b26a-44cb-b612-b10c78cf1cbf tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Request method failure captured: Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: request: POST /compute/v2.1/servers/5ef0b144-21bc-472e-af71-2848dd20f8af/action HTTP/1.1 Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 14 Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVwEqzYAZh4AkEjRryOAZIhaHrAKxd2Qcal9md8a5n-MMUYSdXmcWYLDVkyQoPrDIbcsApBq2EewemPkBwvNDDOidb0hhc_Z3w9BeEUj5ET_flLYPqO5hgqCsuZGXFiYIEBJxrkx614fXiELZHaNkvhSdsJHShK0w7L-UPHhkPKqi5M Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_59e65f6eb06d40d583b9f43c9af94c13", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 443c44b0bd9e4c56a7fe0c1a53238545 Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: {"resume": {}} Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 5ef0b144-21bc-472e-af71-2848dd20f8af could not be found. Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '5ef0b144-21bc-472e-af71-2848dd20f8af', 'body': {'resume': {}}} Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ef0b144-21bc-472e-af71-2848dd20f8af could not be found. Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ef0b144-21bc-472e-af71-2848dd20f8af could not be found. Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:46:07.736109 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:46:07.742009 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:46:07.742009 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:46:07.742009 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ef0b144-21bc-472e-af71-2848dd20f8af could not be found. Oct 17 13:46:07.742009 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:46:07.742009 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-936953c8-b26a-44cb-b612-b10c78cf1cbf tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Returning 404 to user: Instance 5ef0b144-21bc-472e-af71-2848dd20f8af could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:46:07.742009 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-936953c8-b26a-44cb-b612-b10c78cf1cbf tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "POST /compute/v2.1/servers/5ef0b144-21bc-472e-af71-2848dd20f8af/action" status: 404 len: 111 microversion: 2.1 time: 0.026686 Oct 17 13:46:07.742009 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1462/2911] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:46:07 2022] POST /compute/v2.1/servers/5ef0b144-21bc-472e-af71-2848dd20f8af/action => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:46:07.748026 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-64794fa0-0721-46d5-87b4-2553b17c30e6 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a3472f83914990ad41f037b4aafd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f91db965084796a4a3dce1b4e921e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:07.751814 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a3c5853e-095d-403b-a6b5-2b69abf94fb7 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:07.757547 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a3c5853e-095d-403b-a6b5-2b69abf94fb7 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:07.779524 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-64794fa0-0721-46d5-87b4-2553b17c30e6 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] 10.222.0.79 "GET /compute/v2.1/servers/50e9eae9-df55-48ee-b984-e6b7e4bb2628" status: 200 len: 1322 microversion: 2.1 time: 1.441871 Oct 17 13:46:07.779883 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a3c5853e-095d-403b-a6b5-2b69abf94fb7 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:07.781596 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a3c5853e-095d-403b-a6b5-2b69abf94fb7 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:07.782099 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a3c5853e-095d-403b-a6b5-2b69abf94fb7 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:07.784331 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1450/2912] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:06 2022] GET /compute/v2.1/servers/50e9eae9-df55-48ee-b984-e6b7e4bb2628 => generated 1322 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:46:07.802237 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a3c5853e-095d-403b-a6b5-2b69abf94fb7 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:07.802802 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a3c5853e-095d-403b-a6b5-2b69abf94fb7 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:07.803280 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a3c5853e-095d-403b-a6b5-2b69abf94fb7 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:08.439783 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:46:08.568537 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-726263d1-28ef-48ed-9c55-b2f41719c0c3 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Action: 'create', calling method: .version_select at 0x7f7cd4a160d0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-2034000215", "policies": ["affinity"]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:46:08.600211 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-726263d1-28ef-48ed-9c55-b2f41719c0c3 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Getting quotas for project 9b0ffd0b1b764825826ab82cfbbe23e5. Resources: {'server_groups'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:46:08.608477 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-726263d1-28ef-48ed-9c55-b2f41719c0c3 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Getting quotas for user 6898fd7e18d3404a982b998171f8f7fc and project 9b0ffd0b1b764825826ab82cfbbe23e5. Resources: {'server_groups'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:46:08.699707 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a3c5853e-095d-403b-a6b5-2b69abf94fb7 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:08.706293 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-726263d1-28ef-48ed-9c55-b2f41719c0c3 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Getting quotas for project 9b0ffd0b1b764825826ab82cfbbe23e5. Resources: {'server_groups'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:46:08.720598 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-726263d1-28ef-48ed-9c55-b2f41719c0c3 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Getting quotas for user 6898fd7e18d3404a982b998171f8f7fc and project 9b0ffd0b1b764825826ab82cfbbe23e5. Resources: {'server_groups'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:46:08.721916 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a3c5853e-095d-403b-a6b5-2b69abf94fb7 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 0.975788 Oct 17 13:46:08.735204 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1463/2913] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:07 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:08.755836 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-bfb5ce31-abbb-40ec-b003-e12687748340 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:08.758532 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-bfb5ce31-abbb-40ec-b003-e12687748340 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9d1105b3-be41-4963-a86b-6f4486d1d382] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:08.774245 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-726263d1-28ef-48ed-9c55-b2f41719c0c3 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] 10.222.0.79 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.383898 Oct 17 13:46:08.779197 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bfb5ce31-abbb-40ec-b003-e12687748340 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:08.779820 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bfb5ce31-abbb-40ec-b003-e12687748340 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:08.780368 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bfb5ce31-abbb-40ec-b003-e12687748340 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:08.781767 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bfb5ce31-abbb-40ec-b003-e12687748340 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:08.784097 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1451/2914] 10.222.0.79 () {60 vars in 1174 bytes} [Mon Oct 17 13:46:08 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:46:08.785016 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bfb5ce31-abbb-40ec-b003-e12687748340 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:08.785616 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bfb5ce31-abbb-40ec-b003-e12687748340 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:08.790337 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-48c23375-2266-4609-9980-310896e16198 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:08.790970 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-48c23375-2266-4609-9980-310896e16198 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:08.799353 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48c23375-2266-4609-9980-310896e16198 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:08.799847 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48c23375-2266-4609-9980-310896e16198 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:08.800285 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48c23375-2266-4609-9980-310896e16198 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:08.803655 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48c23375-2266-4609-9980-310896e16198 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:08.804182 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48c23375-2266-4609-9980-310896e16198 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:08.804826 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48c23375-2266-4609-9980-310896e16198 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:09.257564 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-bfb5ce31-abbb-40ec-b003-e12687748340 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:09.272149 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-bfb5ce31-abbb-40ec-b003-e12687748340 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382" status: 200 len: 1312 microversion: 2.1 time: 0.528893 Oct 17 13:46:09.272920 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1464/2915] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:08 2022] GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382 => generated 1312 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:09.295042 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-792f5f5b-96c8-41bd-ac38-5a2297ef5ee1 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Action: 'create', calling method: .version_select at 0x7f7cd546aee0>, body: {"server_group": {"name": "tempest-server-group-2020415019", "policies": ["affinity"]}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:46:09.327764 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-792f5f5b-96c8-41bd-ac38-5a2297ef5ee1 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Getting quotas for project 9b0ffd0b1b764825826ab82cfbbe23e5. Resources: {'server_groups'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:46:09.335662 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-792f5f5b-96c8-41bd-ac38-5a2297ef5ee1 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Getting quotas for user 6898fd7e18d3404a982b998171f8f7fc and project 9b0ffd0b1b764825826ab82cfbbe23e5. Resources: {'server_groups'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:46:09.402291 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-792f5f5b-96c8-41bd-ac38-5a2297ef5ee1 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Getting quotas for project 9b0ffd0b1b764825826ab82cfbbe23e5. Resources: {'server_groups'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:46:09.408551 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-792f5f5b-96c8-41bd-ac38-5a2297ef5ee1 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Getting quotas for user 6898fd7e18d3404a982b998171f8f7fc and project 9b0ffd0b1b764825826ab82cfbbe23e5. Resources: {'server_groups'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:46:09.413727 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:46:09.427418 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-792f5f5b-96c8-41bd-ac38-5a2297ef5ee1 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] 10.222.0.79 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.137600 Oct 17 13:46:09.428642 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1465/2916] 10.222.0.79 () {60 vars in 1173 bytes} [Mon Oct 17 13:46:09 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:46:09.441908 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7675b091-c5fb-4a75-9108-aa41aeb0c4f5 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:09.442428 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7675b091-c5fb-4a75-9108-aa41aeb0c4f5 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] [instance: 50e9eae9-df55-48ee-b984-e6b7e4bb2628] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:09.456152 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7675b091-c5fb-4a75-9108-aa41aeb0c4f5 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:09.456930 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7675b091-c5fb-4a75-9108-aa41aeb0c4f5 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:09.457536 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7675b091-c5fb-4a75-9108-aa41aeb0c4f5 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:09.458466 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7675b091-c5fb-4a75-9108-aa41aeb0c4f5 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:09.459064 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7675b091-c5fb-4a75-9108-aa41aeb0c4f5 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:09.459669 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7675b091-c5fb-4a75-9108-aa41aeb0c4f5 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:10.025171 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-48c23375-2266-4609-9980-310896e16198 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:10.042035 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-48c23375-2266-4609-9980-310896e16198 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 1.255818 Oct 17 13:46:10.045767 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1452/2917] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:08 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:10.051815 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-54b729f0-77fb-4df6-9804-3fd00952c9fa req-7f9fdcdc-3433-4ecd-8b3f-1286b38fa80b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50e9eae9-df55-48ee-b984-e6b7e4bb2628", "name": "network-vif-plugged", "status": "completed", "tag": "be3444eb-9f99-422e-963d-086fa4da6881"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:46:10.069295 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-54b729f0-77fb-4df6-9804-3fd00952c9fa req-7f9fdcdc-3433-4ecd-8b3f-1286b38fa80b service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:10.081018 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-54b729f0-77fb-4df6-9804-3fd00952c9fa req-7f9fdcdc-3433-4ecd-8b3f-1286b38fa80b service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:10.082596 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-54b729f0-77fb-4df6-9804-3fd00952c9fa req-7f9fdcdc-3433-4ecd-8b3f-1286b38fa80b service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:10.128395 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-54b729f0-77fb-4df6-9804-3fd00952c9fa req-7f9fdcdc-3433-4ecd-8b3f-1286b38fa80b service nova] Creating event network-vif-plugged:be3444eb-9f99-422e-963d-086fa4da6881 for instance 50e9eae9-df55-48ee-b984-e6b7e4bb2628 on n-h1-854247-14 Oct 17 13:46:10.134256 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-54b729f0-77fb-4df6-9804-3fd00952c9fa req-7f9fdcdc-3433-4ecd-8b3f-1286b38fa80b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086903 Oct 17 13:46:10.135450 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1453/2918] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:46:10.141524 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a2f27923-818e-451d-b39f-ba4b9fc2e448 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Action: 'create', calling method: .version_select at 0x7f7cd54553a0>, body: {"server_group": {"name": "tempest-server-group-2020415019", "policies": ["affinity"]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:46:10.169929 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-a2f27923-818e-451d-b39f-ba4b9fc2e448 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Getting quotas for project 9b0ffd0b1b764825826ab82cfbbe23e5. Resources: {'server_groups'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:46:10.175550 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-a2f27923-818e-451d-b39f-ba4b9fc2e448 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Getting quotas for user 6898fd7e18d3404a982b998171f8f7fc and project 9b0ffd0b1b764825826ab82cfbbe23e5. Resources: {'server_groups'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:46:10.230268 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:46:10.250918 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-a2f27923-818e-451d-b39f-ba4b9fc2e448 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Getting quotas for project 9b0ffd0b1b764825826ab82cfbbe23e5. Resources: {'server_groups'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:46:10.262647 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-a2f27923-818e-451d-b39f-ba4b9fc2e448 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Getting quotas for user 6898fd7e18d3404a982b998171f8f7fc and project 9b0ffd0b1b764825826ab82cfbbe23e5. Resources: {'server_groups'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:46:10.291316 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a2f27923-818e-451d-b39f-ba4b9fc2e448 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] 10.222.0.79 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.154394 Oct 17 13:46:10.294784 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1454/2919] 10.222.0.79 () {60 vars in 1173 bytes} [Mon Oct 17 13:46:10 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:46:10.305598 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8ade0a0e-bb39-4456-af44-f071742cc671 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:46:10.306548 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8ade0a0e-bb39-4456-af44-f071742cc671 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:10.319886 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8ade0a0e-bb39-4456-af44-f071742cc671 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:10.331069 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8ade0a0e-bb39-4456-af44-f071742cc671 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:10.332865 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8ade0a0e-bb39-4456-af44-f071742cc671 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:10.333913 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8ade0a0e-bb39-4456-af44-f071742cc671 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:10.334611 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8ade0a0e-bb39-4456-af44-f071742cc671 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:10.335305 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8ade0a0e-bb39-4456-af44-f071742cc671 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:10.336320 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7675b091-c5fb-4a75-9108-aa41aeb0c4f5 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a3472f83914990ad41f037b4aafd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f91db965084796a4a3dce1b4e921e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:10.352425 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7675b091-c5fb-4a75-9108-aa41aeb0c4f5 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] 10.222.0.79 "GET /compute/v2.1/servers/50e9eae9-df55-48ee-b984-e6b7e4bb2628" status: 200 len: 1322 microversion: 2.1 time: 0.920108 Oct 17 13:46:10.359218 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1466/2920] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:09 2022] GET /compute/v2.1/servers/50e9eae9-df55-48ee-b984-e6b7e4bb2628 => generated 1322 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:10.382112 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7396b0c4-32e7-4024-a05e-32c50cbd2ac1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:10.382858 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7396b0c4-32e7-4024-a05e-32c50cbd2ac1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9d1105b3-be41-4963-a86b-6f4486d1d382] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:10.398911 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7396b0c4-32e7-4024-a05e-32c50cbd2ac1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:10.403943 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7396b0c4-32e7-4024-a05e-32c50cbd2ac1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:10.404445 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7396b0c4-32e7-4024-a05e-32c50cbd2ac1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:10.406835 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7396b0c4-32e7-4024-a05e-32c50cbd2ac1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:10.407383 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7396b0c4-32e7-4024-a05e-32c50cbd2ac1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:10.414135 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7396b0c4-32e7-4024-a05e-32c50cbd2ac1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:10.439794 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-8ade0a0e-bb39-4456-af44-f071742cc671 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] HTTP exception thrown: Cannot 'resume' instance 5ef00d34-7f81-4649-a90a-a52cf78dbeca while it is in vm_state active Oct 17 13:46:10.453313 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8ade0a0e-bb39-4456-af44-f071742cc671 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Request method failure captured: Oct 17 13:46:10.453313 n-d-854247-14 devstack@n-api.service[127017]: request: POST /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca/action HTTP/1.1 Oct 17 13:46:10.453313 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:46:10.453313 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:46:10.453313 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:46:10.453313 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 14 Oct 17 13:46:10.453313 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:46:10.453313 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:46:10.453313 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:46:10.453313 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:46:10.453313 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVwEqzYAZh4AkEjRryOAZIhaHrAKxd2Qcal9md8a5n-MMUYSdXmcWYLDVkyQoPrDIbcsApBq2EewemPkBwvNDDOidb0hhc_Z3w9BeEUj5ET_flLYPqO5hgqCsuZGXFiYIEBJxrkx614fXiELZHaNkvhSdsJHShK0w7L-UPHhkPKqi5M Oct 17 13:46:10.453313 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:46:10.453313 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:46:10.453313 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:46:10.453313 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:46:10.453313 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:46:10.453313 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:46:10.453313 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:46:10.453313 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:46:10.453313 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:46:10.453313 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:46:10.453313 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_59e65f6eb06d40d583b9f43c9af94c13", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:46:10.453313 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:46:10.453313 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:46:10.453313 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:46:10.453313 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:46:10.453313 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:46:10.453313 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:46:10.453313 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 443c44b0bd9e4c56a7fe0c1a53238545 Oct 17 13:46:10.453313 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:46:10.453313 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 13:46:10.453313 n-d-854247-14 devstack@n-api.service[127017]: {"resume": {}} Oct 17 13:46:10.453313 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:46:10.453313 n-d-854247-14 devstack@n-api.service[127017]: exception: Cannot 'resume' instance 5ef00d34-7f81-4649-a90a-a52cf78dbeca while it is in vm_state active Oct 17 13:46:10.453313 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '5ef00d34-7f81-4649-a90a-a52cf78dbeca', 'body': {'resume': {}}} Oct 17 13:46:10.453313 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:46:10.453313 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:46:10.453313 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 17 13:46:10.453313 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 17 13:46:10.453313 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 13:46:10.453313 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:46:10.453313 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 17 13:46:10.453313 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 13:46:10.453313 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 13:46:10.453313 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 13:46:10.453313 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5ef00d34-7f81-4649-a90a-a52cf78dbeca in vm_state active. Cannot resume while the instance is in this state. Oct 17 13:46:10.453313 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:46:10.453313 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:46:10.453313 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:46:10.453313 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:46:10.453313 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:46:10.453313 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:46:10.453313 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:46:10.453313 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:46:10.453313 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:46:10.453313 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:46:10.453313 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 17 13:46:10.453313 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 17 13:46:10.453313 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 13:46:10.453313 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 13:46:10.453313 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 5ef00d34-7f81-4649-a90a-a52cf78dbeca while it is in vm_state active Oct 17 13:46:10.453313 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:46:10.453313 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:46:10.453313 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:46:10.457479 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:46:10.457479 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:46:10.457479 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:46:10.457479 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:46:10.457479 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:46:10.457479 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 5ef00d34-7f81-4649-a90a-a52cf78dbeca while it is in vm_state active Oct 17 13:46:10.457479 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:46:10.460395 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8ade0a0e-bb39-4456-af44-f071742cc671 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Returning 409 to user: Cannot 'resume' instance 5ef00d34-7f81-4649-a90a-a52cf78dbeca while it is in vm_state active {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:46:10.461487 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8ade0a0e-bb39-4456-af44-f071742cc671 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "POST /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca/action" status: 409 len: 144 microversion: 2.1 time: 0.164506 Oct 17 13:46:10.462383 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1455/2921] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:46:10 2022] POST /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca/action => generated 144 bytes in 166 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:46:10.474343 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d0cc1c0d-8ee5-4fd7-8908-d3b7d793aaaf tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:10.545511 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d0cc1c0d-8ee5-4fd7-8908-d3b7d793aaaf tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] 10.222.0.79 "DELETE /compute/v2.1/os-server-groups/9e9ec619-3eba-4d3a-b81d-6236913faeb0" status: 204 len: 0 microversion: 2.1 time: 0.081948 Oct 17 13:46:10.547766 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1456/2922] 10.222.0.79 () {58 vars in 1266 bytes} [Mon Oct 17 13:46:10 2022] DELETE /compute/v2.1/os-server-groups/9e9ec619-3eba-4d3a-b81d-6236913faeb0 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:46:10.556625 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ed623e79-4dcb-4e52-98df-ca3d38bcfe78 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:10.570340 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ed623e79-4dcb-4e52-98df-ca3d38bcfe78 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:10.588976 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ed623e79-4dcb-4e52-98df-ca3d38bcfe78 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:10.589479 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ed623e79-4dcb-4e52-98df-ca3d38bcfe78 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:10.590096 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ed623e79-4dcb-4e52-98df-ca3d38bcfe78 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:10.591826 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ed623e79-4dcb-4e52-98df-ca3d38bcfe78 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:10.592450 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ed623e79-4dcb-4e52-98df-ca3d38bcfe78 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:10.593148 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ed623e79-4dcb-4e52-98df-ca3d38bcfe78 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:11.878589 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7396b0c4-32e7-4024-a05e-32c50cbd2ac1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:11.889136 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7396b0c4-32e7-4024-a05e-32c50cbd2ac1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382" status: 200 len: 1312 microversion: 2.1 time: 1.528723 Oct 17 13:46:11.890762 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1467/2923] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:10 2022] GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382 => generated 1312 bytes in 1531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:11.908474 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e093c1e1-9e15-4f1b-a157-a171e0aeeedd tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:11.956633 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e093c1e1-9e15-4f1b-a157-a171e0aeeedd tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] 10.222.0.79 "GET /compute/v2.1/os-server-groups" status: 200 len: 335 microversion: 2.1 time: 0.064038 Oct 17 13:46:11.968859 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1468/2924] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Oct 17 13:46:11 2022] GET /compute/v2.1/os-server-groups => generated 335 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:46:11.975150 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d968ad5d-cc52-42b6-a0c2-cdf0d25aefaa tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:11.976129 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d968ad5d-cc52-42b6-a0c2-cdf0d25aefaa tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] [instance: 50e9eae9-df55-48ee-b984-e6b7e4bb2628] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:11.984260 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d968ad5d-cc52-42b6-a0c2-cdf0d25aefaa tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:11.985556 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d968ad5d-cc52-42b6-a0c2-cdf0d25aefaa tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:11.986880 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d968ad5d-cc52-42b6-a0c2-cdf0d25aefaa tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:11.988173 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d968ad5d-cc52-42b6-a0c2-cdf0d25aefaa tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:11.989306 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d968ad5d-cc52-42b6-a0c2-cdf0d25aefaa tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:11.990340 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d968ad5d-cc52-42b6-a0c2-cdf0d25aefaa tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:12.044436 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ed623e79-4dcb-4e52-98df-ca3d38bcfe78 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:12.055451 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ed623e79-4dcb-4e52-98df-ca3d38bcfe78 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 1.506432 Oct 17 13:46:12.056032 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1457/2925] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:10 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:12.060649 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7e982990-f954-4086-aac7-72f05d348812 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:12.129146 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7e982990-f954-4086-aac7-72f05d348812 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] 10.222.0.79 "DELETE /compute/v2.1/os-server-groups/25b3e471-3257-4717-8856-0bacd3fde96f" status: 204 len: 0 microversion: 2.1 time: 0.072057 Oct 17 13:46:12.130038 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1458/2926] 10.222.0.79 () {58 vars in 1266 bytes} [Mon Oct 17 13:46:12 2022] DELETE /compute/v2.1/os-server-groups/25b3e471-3257-4717-8856-0bacd3fde96f => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:46:12.135276 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f4d0d1ab-fb0a-46f5-abc2-eae450815b48 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:12.136116 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f4d0d1ab-fb0a-46f5-abc2-eae450815b48 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:12.151349 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f4d0d1ab-fb0a-46f5-abc2-eae450815b48 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:12.156271 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f4d0d1ab-fb0a-46f5-abc2-eae450815b48 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:12.156989 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f4d0d1ab-fb0a-46f5-abc2-eae450815b48 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:12.158150 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f4d0d1ab-fb0a-46f5-abc2-eae450815b48 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:12.158914 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f4d0d1ab-fb0a-46f5-abc2-eae450815b48 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:12.160006 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f4d0d1ab-fb0a-46f5-abc2-eae450815b48 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:13.616149 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d968ad5d-cc52-42b6-a0c2-cdf0d25aefaa tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a3472f83914990ad41f037b4aafd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f91db965084796a4a3dce1b4e921e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:13.635884 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d968ad5d-cc52-42b6-a0c2-cdf0d25aefaa tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] 10.222.0.79 "GET /compute/v2.1/servers/50e9eae9-df55-48ee-b984-e6b7e4bb2628" status: 200 len: 1322 microversion: 2.1 time: 1.665179 Oct 17 13:46:13.638779 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1469/2927] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:11 2022] GET /compute/v2.1/servers/50e9eae9-df55-48ee-b984-e6b7e4bb2628 => generated 1322 bytes in 1669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:13.654337 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8a1d780a-4dea-4baf-ad83-0c3cad1b5507 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:13.674724 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8a1d780a-4dea-4baf-ad83-0c3cad1b5507 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] 10.222.0.79 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.034191 Oct 17 13:46:13.676069 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1470/2928] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Oct 17 13:46:13 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:46:13.681717 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a60abfda-e73d-407f-9cf8-ef3f1ed9ac8d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:13.686185 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a60abfda-e73d-407f-9cf8-ef3f1ed9ac8d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9d1105b3-be41-4963-a86b-6f4486d1d382] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:13.709776 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a60abfda-e73d-407f-9cf8-ef3f1ed9ac8d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:13.710371 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a60abfda-e73d-407f-9cf8-ef3f1ed9ac8d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:13.710751 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a60abfda-e73d-407f-9cf8-ef3f1ed9ac8d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:13.711730 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a60abfda-e73d-407f-9cf8-ef3f1ed9ac8d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:13.712346 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a60abfda-e73d-407f-9cf8-ef3f1ed9ac8d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:13.712976 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a60abfda-e73d-407f-9cf8-ef3f1ed9ac8d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:13.734310 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f4d0d1ab-fb0a-46f5-abc2-eae450815b48 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:13.751080 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f4d0d1ab-fb0a-46f5-abc2-eae450815b48 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 1.619679 Oct 17 13:46:13.755880 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1459/2929] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:12 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 1624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:13.771263 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5564b0d6-8dbd-4840-8a2a-05fca19b50ff tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Action: 'create', calling method: .version_select at 0x7f7cd49aca60>, body: {"server_group": {"name": "tempest-server-group-2055815845", "policies": ["affinity"]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:46:13.820923 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-5564b0d6-8dbd-4840-8a2a-05fca19b50ff tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Getting quotas for project 9b0ffd0b1b764825826ab82cfbbe23e5. Resources: {'server_groups'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:46:13.828529 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-5564b0d6-8dbd-4840-8a2a-05fca19b50ff tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Getting quotas for user 6898fd7e18d3404a982b998171f8f7fc and project 9b0ffd0b1b764825826ab82cfbbe23e5. Resources: {'server_groups'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:46:13.921483 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-5564b0d6-8dbd-4840-8a2a-05fca19b50ff tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Getting quotas for project 9b0ffd0b1b764825826ab82cfbbe23e5. Resources: {'server_groups'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:46:13.931514 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-5564b0d6-8dbd-4840-8a2a-05fca19b50ff tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Getting quotas for user 6898fd7e18d3404a982b998171f8f7fc and project 9b0ffd0b1b764825826ab82cfbbe23e5. Resources: {'server_groups'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:46:13.974175 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5564b0d6-8dbd-4840-8a2a-05fca19b50ff tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] 10.222.0.79 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.217515 Oct 17 13:46:13.977233 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1460/2930] 10.222.0.79 () {60 vars in 1173 bytes} [Mon Oct 17 13:46:13 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:46:13.999034 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1c8c9ee6-17b1-43ff-add1-5b4253615601 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:14.057777 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1c8c9ee6-17b1-43ff-add1-5b4253615601 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] 10.222.0.79 "DELETE /compute/v2.1/os-server-groups/ea007165-ff58-4b72-bc4a-f642812e2a85" status: 204 len: 0 microversion: 2.1 time: 0.074684 Oct 17 13:46:14.058724 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1461/2931] 10.222.0.79 () {58 vars in 1266 bytes} [Mon Oct 17 13:46:13 2022] DELETE /compute/v2.1/os-server-groups/ea007165-ff58-4b72-bc4a-f642812e2a85 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:46:14.064655 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-aa86cd79-f508-40cd-909d-62c58cd4c30c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "72be642c-f241-4ddb-80d7-b14a93aa7fc9"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-aa86cd79-f508-40cd-909d-62c58cd4c30c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Request method failure captured: Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 160 Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVwEqzYAZh4AkEjRryOAZIhaHrAKxd2Qcal9md8a5n-MMUYSdXmcWYLDVkyQoPrDIbcsApBq2EewemPkBwvNDDOidb0hhc_Z3w9BeEUj5ET_flLYPqO5hgqCsuZGXFiYIEBJxrkx614fXiELZHaNkvhSdsJHShK0w7L-UPHhkPKqi5M Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_59e65f6eb06d40d583b9f43c9af94c13", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 443c44b0bd9e4c56a7fe0c1a53238545 Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: {"server": {"name": "", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "72be642c-f241-4ddb-80d7-b14a93aa7fc9"}]}} Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'body': {'server': {'name': '', 'imageRef': '0743b21b-a6ff-4d02-897c-eabb68c3ba07', 'flavorRef': '452', 'networks': [{'uuid': '72be642c-f241-4ddb-80d7-b14a93aa7fc9'}]}}} Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi '' Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:46:14.069548 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:46:14.074150 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:46:14.074150 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 17 13:46:14.074150 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:46:14.074150 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:46:14.074150 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:46:14.074150 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:46:14.074150 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:46:14.074150 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:46:14.074150 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:46:14.074150 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:46:14.074150 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 17 13:46:14.074150 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:46:14.077805 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-aa86cd79-f508-40cd-909d-62c58cd4c30c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:46:14.078917 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-aa86cd79-f508-40cd-909d-62c58cd4c30c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.018980 Oct 17 13:46:14.079796 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1462/2932] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:46:14 2022] POST /compute/v2.1/servers => generated 108 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:46:14.085096 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8c6f49fa-964a-4dd7-b496-9b9c3b2e1572 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:14.129317 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8c6f49fa-964a-4dd7-b496-9b9c3b2e1572 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] 10.222.0.79 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.043146 Oct 17 13:46:14.135485 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1463/2933] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Oct 17 13:46:14 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:46:14.141676 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-006b7cb1-1061-4143-9272-6d222337aab9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:14.142312 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-006b7cb1-1061-4143-9272-6d222337aab9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:14.159696 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-006b7cb1-1061-4143-9272-6d222337aab9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:14.160537 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-006b7cb1-1061-4143-9272-6d222337aab9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:14.163464 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-006b7cb1-1061-4143-9272-6d222337aab9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:14.164394 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-006b7cb1-1061-4143-9272-6d222337aab9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:14.165006 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-006b7cb1-1061-4143-9272-6d222337aab9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:14.165597 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-006b7cb1-1061-4143-9272-6d222337aab9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:14.802868 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a60abfda-e73d-407f-9cf8-ef3f1ed9ac8d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:14.816418 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a60abfda-e73d-407f-9cf8-ef3f1ed9ac8d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382" status: 200 len: 1312 microversion: 2.1 time: 1.138838 Oct 17 13:46:14.837621 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1471/2934] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:13 2022] GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382 => generated 1312 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:14.843438 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0b04bea7-cd21-4793-b05c-694c886d3b4f tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Action: 'create', calling method: .version_select at 0x7f7cd5474ee0>, body: {"server_group": {"name": "tempest-server-group-228065363", "policies": ["anti-affinity"]}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:46:14.893580 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-0b04bea7-cd21-4793-b05c-694c886d3b4f tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Getting quotas for project 9b0ffd0b1b764825826ab82cfbbe23e5. Resources: {'server_groups'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:46:14.905461 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-0b04bea7-cd21-4793-b05c-694c886d3b4f tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Getting quotas for user 6898fd7e18d3404a982b998171f8f7fc and project 9b0ffd0b1b764825826ab82cfbbe23e5. Resources: {'server_groups'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:46:15.026811 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-0b04bea7-cd21-4793-b05c-694c886d3b4f tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Getting quotas for project 9b0ffd0b1b764825826ab82cfbbe23e5. Resources: {'server_groups'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:46:15.036588 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-0b04bea7-cd21-4793-b05c-694c886d3b4f tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Getting quotas for user 6898fd7e18d3404a982b998171f8f7fc and project 9b0ffd0b1b764825826ab82cfbbe23e5. Resources: {'server_groups'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:46:15.091778 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0b04bea7-cd21-4793-b05c-694c886d3b4f tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] 10.222.0.79 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.251801 Oct 17 13:46:15.093837 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1472/2935] 10.222.0.79 () {60 vars in 1173 bytes} [Mon Oct 17 13:46:14 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:46:15.104309 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d3e1cc49-a2f4-4a6a-84c0-85ab5f4a77da tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:15.106371 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d3e1cc49-a2f4-4a6a-84c0-85ab5f4a77da tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] [instance: 50e9eae9-df55-48ee-b984-e6b7e4bb2628] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:15.128719 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d3e1cc49-a2f4-4a6a-84c0-85ab5f4a77da tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:15.129480 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d3e1cc49-a2f4-4a6a-84c0-85ab5f4a77da tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:15.130422 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d3e1cc49-a2f4-4a6a-84c0-85ab5f4a77da tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:15.131439 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d3e1cc49-a2f4-4a6a-84c0-85ab5f4a77da tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:15.132345 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d3e1cc49-a2f4-4a6a-84c0-85ab5f4a77da tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:15.132993 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d3e1cc49-a2f4-4a6a-84c0-85ab5f4a77da tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:15.404954 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-006b7cb1-1061-4143-9272-6d222337aab9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:15.430161 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-006b7cb1-1061-4143-9272-6d222337aab9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 1.293215 Oct 17 13:46:15.431041 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1464/2936] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:14 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:15.439741 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3a0f0c8d-d663-4da4-b172-ab86c7629385 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:15.522922 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3a0f0c8d-d663-4da4-b172-ab86c7629385 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] 10.222.0.79 "DELETE /compute/v2.1/os-server-groups/537f6a3f-843f-4d3b-87eb-7be2bd31a965" status: 204 len: 0 microversion: 2.1 time: 0.090520 Oct 17 13:46:15.523646 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1465/2937] 10.222.0.79 () {58 vars in 1266 bytes} [Mon Oct 17 13:46:15 2022] DELETE /compute/v2.1/os-server-groups/537f6a3f-843f-4d3b-87eb-7be2bd31a965 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:46:15.534894 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c73e2e4f-b6f9-47a1-a824-b6dcc4dc2f2c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:15.550075 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c73e2e4f-b6f9-47a1-a824-b6dcc4dc2f2c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:15.577430 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c73e2e4f-b6f9-47a1-a824-b6dcc4dc2f2c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:15.584092 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c73e2e4f-b6f9-47a1-a824-b6dcc4dc2f2c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:15.587074 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c73e2e4f-b6f9-47a1-a824-b6dcc4dc2f2c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:15.588416 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c73e2e4f-b6f9-47a1-a824-b6dcc4dc2f2c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:15.590055 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c73e2e4f-b6f9-47a1-a824-b6dcc4dc2f2c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:15.593373 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c73e2e4f-b6f9-47a1-a824-b6dcc4dc2f2c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:17.449502 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d3e1cc49-a2f4-4a6a-84c0-85ab5f4a77da tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a3472f83914990ad41f037b4aafd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f91db965084796a4a3dce1b4e921e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:17.469143 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d3e1cc49-a2f4-4a6a-84c0-85ab5f4a77da tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] 10.222.0.79 "GET /compute/v2.1/servers/50e9eae9-df55-48ee-b984-e6b7e4bb2628" status: 200 len: 1518 microversion: 2.1 time: 2.370132 Oct 17 13:46:17.472396 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1473/2938] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:15 2022] GET /compute/v2.1/servers/50e9eae9-df55-48ee-b984-e6b7e4bb2628 => generated 1518 bytes in 2377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:17.478091 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d0905849-8763-499b-ad01-8cbfcc0aac7b tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:17.544968 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d0905849-8763-499b-ad01-8cbfcc0aac7b tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] 10.222.0.79 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.067134 Oct 17 13:46:17.555385 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1474/2939] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Oct 17 13:46:17 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:46:17.573342 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-debf0b3a-780a-4e55-895d-ed8791ed6d78 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:17.573967 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-debf0b3a-780a-4e55-895d-ed8791ed6d78 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9d1105b3-be41-4963-a86b-6f4486d1d382] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:17.614571 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-debf0b3a-780a-4e55-895d-ed8791ed6d78 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:17.615019 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-debf0b3a-780a-4e55-895d-ed8791ed6d78 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:17.635709 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c73e2e4f-b6f9-47a1-a824-b6dcc4dc2f2c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:17.637319 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-debf0b3a-780a-4e55-895d-ed8791ed6d78 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:17.647346 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c73e2e4f-b6f9-47a1-a824-b6dcc4dc2f2c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 2.122389 Oct 17 13:46:17.650661 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-debf0b3a-780a-4e55-895d-ed8791ed6d78 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:17.654142 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-debf0b3a-780a-4e55-895d-ed8791ed6d78 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:17.654931 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-debf0b3a-780a-4e55-895d-ed8791ed6d78 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:17.659985 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1466/2940] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:15 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 2136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:17.696671 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-2d82f84b-0506-4772-a2ca-9d60c2b16aec req-68e6ee06-2d63-4870-a829-34b846944c1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d1105b3-be41-4963-a86b-6f4486d1d382", "tag": "6cb71ea7-7943-454e-82a0-31ed2ec43a1c"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:46:17.766382 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-2d82f84b-0506-4772-a2ca-9d60c2b16aec req-68e6ee06-2d63-4870-a829-34b846944c1d service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:17.767187 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-2d82f84b-0506-4772-a2ca-9d60c2b16aec req-68e6ee06-2d63-4870-a829-34b846944c1d service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:17.768516 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-2d82f84b-0506-4772-a2ca-9d60c2b16aec req-68e6ee06-2d63-4870-a829-34b846944c1d service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:17.792957 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-2d82f84b-0506-4772-a2ca-9d60c2b16aec req-68e6ee06-2d63-4870-a829-34b846944c1d service nova] Creating event network-changed:6cb71ea7-7943-454e-82a0-31ed2ec43a1c for instance 9d1105b3-be41-4963-a86b-6f4486d1d382 on n-h2-854247-14 Oct 17 13:46:17.799900 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-2d82f84b-0506-4772-a2ca-9d60c2b16aec req-68e6ee06-2d63-4870-a829-34b846944c1d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119567 Oct 17 13:46:17.804542 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1467/2941] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:46:17.810942 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9d52054e-b574-4df3-bc7c-6382c6c1011e tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Action: 'create', calling method: .version_select at 0x7f7cd9876af0>, body: {"pool": null} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:46:18.363575 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-debf0b3a-780a-4e55-895d-ed8791ed6d78 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:18.378272 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-debf0b3a-780a-4e55-895d-ed8791ed6d78 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382" status: 200 len: 1312 microversion: 2.1 time: 0.818446 Oct 17 13:46:18.379304 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1475/2942] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:17 2022] GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382 => generated 1312 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:18.389533 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8b488ce1-f8eb-4079-b475-8fd896ff242f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:46:18.392650 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8b488ce1-f8eb-4079-b475-8fd896ff242f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: d481efaf-c468-44b2-b443-d487f3f3283c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:18.406958 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-8b488ce1-f8eb-4079-b475-8fd896ff242f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] HTTP exception thrown: Instance d481efaf-c468-44b2-b443-d487f3f3283c could not be found. Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8b488ce1-f8eb-4079-b475-8fd896ff242f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Request method failure captured: Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: request: POST /compute/v2.1/servers/d481efaf-c468-44b2-b443-d487f3f3283c/action HTTP/1.1 Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 14 Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVwEqzYAZh4AkEjRryOAZIhaHrAKxd2Qcal9md8a5n-MMUYSdXmcWYLDVkyQoPrDIbcsApBq2EewemPkBwvNDDOidb0hhc_Z3w9BeEUj5ET_flLYPqO5hgqCsuZGXFiYIEBJxrkx614fXiELZHaNkvhSdsJHShK0w7L-UPHhkPKqi5M Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_59e65f6eb06d40d583b9f43c9af94c13", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 443c44b0bd9e4c56a7fe0c1a53238545 Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: {"shelve": {}} Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance d481efaf-c468-44b2-b443-d487f3f3283c could not be found. Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'd481efaf-c468-44b2-b443-d487f3f3283c', 'body': {'shelve': {}}} Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d481efaf-c468-44b2-b443-d487f3f3283c could not be found. Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d481efaf-c468-44b2-b443-d487f3f3283c could not be found. Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:46:18.420719 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:46:18.426196 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:46:18.426196 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:46:18.426196 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d481efaf-c468-44b2-b443-d487f3f3283c could not be found. Oct 17 13:46:18.426196 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:46:18.428562 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8b488ce1-f8eb-4079-b475-8fd896ff242f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Returning 404 to user: Instance d481efaf-c468-44b2-b443-d487f3f3283c could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:46:18.429651 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8b488ce1-f8eb-4079-b475-8fd896ff242f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "POST /compute/v2.1/servers/d481efaf-c468-44b2-b443-d487f3f3283c/action" status: 404 len: 111 microversion: 2.1 time: 0.049186 Oct 17 13:46:18.430766 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1476/2943] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:46:18 2022] POST /compute/v2.1/servers/d481efaf-c468-44b2-b443-d487f3f3283c/action => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:46:18.436728 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f81b6e9c-33a0-433c-a70e-13a807f0cdc2 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1912793856", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "b3cea24b-0847-424a-819b-507d1cdac238"}]}, "os:scheduler_hints": {"group": "3c4c75ab-df90-4892-8eb8-1681a8a3f288"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:46:18.516156 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-f81b6e9c-33a0-433c-a70e-13a807f0cdc2 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] validate_networks() for [('b3cea24b-0847-424a-819b-507d1cdac238', None, None, None, None, None)] {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:46:20.277666 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-f81b6e9c-33a0-433c-a70e-13a807f0cdc2 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:46:20.278336 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-f81b6e9c-33a0-433c-a70e-13a807f0cdc2 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:46:20.278698 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-f81b6e9c-33a0-433c-a70e-13a807f0cdc2 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:46:20.279781 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-f81b6e9c-33a0-433c-a70e-13a807f0cdc2 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:46:20.280427 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-f81b6e9c-33a0-433c-a70e-13a807f0cdc2 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:46:20.318074 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f81b6e9c-33a0-433c-a70e-13a807f0cdc2 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:20.319125 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f81b6e9c-33a0-433c-a70e-13a807f0cdc2 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:20.319735 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f81b6e9c-33a0-433c-a70e-13a807f0cdc2 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:20.320623 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f81b6e9c-33a0-433c-a70e-13a807f0cdc2 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:20.321221 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f81b6e9c-33a0-433c-a70e-13a807f0cdc2 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:20.321808 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f81b6e9c-33a0-433c-a70e-13a807f0cdc2 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:20.346254 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-f81b6e9c-33a0-433c-a70e-13a807f0cdc2 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Getting quotas for project 9b0ffd0b1b764825826ab82cfbbe23e5. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:46:20.354670 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-f81b6e9c-33a0-433c-a70e-13a807f0cdc2 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Getting quotas for user 6898fd7e18d3404a982b998171f8f7fc and project 9b0ffd0b1b764825826ab82cfbbe23e5. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:46:20.377492 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f81b6e9c-33a0-433c-a70e-13a807f0cdc2 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:46:20.380724 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f81b6e9c-33a0-433c-a70e-13a807f0cdc2 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] [instance: ecd07fc5-cb11-4e4c-bc7f-5f591eca4597] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:46:20.482513 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-f81b6e9c-33a0-433c-a70e-13a807f0cdc2 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Getting quotas for project 9b0ffd0b1b764825826ab82cfbbe23e5. Resources: {'server_group_members'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:46:20.520540 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-f81b6e9c-33a0-433c-a70e-13a807f0cdc2 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Getting quotas for user 6898fd7e18d3404a982b998171f8f7fc and project 9b0ffd0b1b764825826ab82cfbbe23e5. Resources: {'server_group_members'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:46:20.602633 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-f81b6e9c-33a0-433c-a70e-13a807f0cdc2 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Getting quotas for project 9b0ffd0b1b764825826ab82cfbbe23e5. Resources: {'server_group_members'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:46:20.610934 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-f81b6e9c-33a0-433c-a70e-13a807f0cdc2 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Getting quotas for user 6898fd7e18d3404a982b998171f8f7fc and project 9b0ffd0b1b764825826ab82cfbbe23e5. Resources: {'server_group_members'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:46:20.692059 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f81b6e9c-33a0-433c-a70e-13a807f0cdc2 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.258715 Oct 17 13:46:20.703371 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1477/2944] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:46:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2272 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:46:20.717080 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c1b4ba6b-1678-44f5-be6a-454f71fd3bf6 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:20.718113 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c1b4ba6b-1678-44f5-be6a-454f71fd3bf6 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:20.749229 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1b4ba6b-1678-44f5-be6a-454f71fd3bf6 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:20.751360 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1b4ba6b-1678-44f5-be6a-454f71fd3bf6 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:20.753957 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1b4ba6b-1678-44f5-be6a-454f71fd3bf6 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:20.757333 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1b4ba6b-1678-44f5-be6a-454f71fd3bf6 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:20.757733 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1b4ba6b-1678-44f5-be6a-454f71fd3bf6 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:20.758182 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1b4ba6b-1678-44f5-be6a-454f71fd3bf6 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:22.171149 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c1b4ba6b-1678-44f5-be6a-454f71fd3bf6 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:22.187763 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c1b4ba6b-1678-44f5-be6a-454f71fd3bf6 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 1.482831 Oct 17 13:46:22.193782 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1478/2945] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:20 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:22.215653 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9cd114e0-89a9-4ff3-bcbb-a411a0b4b73d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:22.217613 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9cd114e0-89a9-4ff3-bcbb-a411a0b4b73d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9d1105b3-be41-4963-a86b-6f4486d1d382] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:22.238884 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9cd114e0-89a9-4ff3-bcbb-a411a0b4b73d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:22.250189 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9cd114e0-89a9-4ff3-bcbb-a411a0b4b73d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:22.257300 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9cd114e0-89a9-4ff3-bcbb-a411a0b4b73d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:22.275127 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9cd114e0-89a9-4ff3-bcbb-a411a0b4b73d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:22.275887 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9cd114e0-89a9-4ff3-bcbb-a411a0b4b73d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:22.276537 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9cd114e0-89a9-4ff3-bcbb-a411a0b4b73d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:23.005631 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9cd114e0-89a9-4ff3-bcbb-a411a0b4b73d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:23.017984 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9cd114e0-89a9-4ff3-bcbb-a411a0b4b73d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382" status: 200 len: 1312 microversion: 2.1 time: 0.817534 Oct 17 13:46:23.018643 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1479/2946] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:22 2022] GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382 => generated 1312 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:23.029133 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-904ed645-f459-4506-891c-afa7b7bee8b5 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:23.036999 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-904ed645-f459-4506-891c-afa7b7bee8b5 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] [instance: ecd07fc5-cb11-4e4c-bc7f-5f591eca4597] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:23.052595 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-904ed645-f459-4506-891c-afa7b7bee8b5 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:23.054247 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-904ed645-f459-4506-891c-afa7b7bee8b5 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:23.055350 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-904ed645-f459-4506-891c-afa7b7bee8b5 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:23.057328 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-904ed645-f459-4506-891c-afa7b7bee8b5 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:23.063259 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-904ed645-f459-4506-891c-afa7b7bee8b5 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:23.063971 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-904ed645-f459-4506-891c-afa7b7bee8b5 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:23.382005 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-904ed645-f459-4506-891c-afa7b7bee8b5 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6898fd7e18d3404a982b998171f8f7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0ffd0b1b764825826ab82cfbbe23e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:23.398139 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-904ed645-f459-4506-891c-afa7b7bee8b5 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] 10.222.0.79 "GET /compute/v2.1/servers/ecd07fc5-cb11-4e4c-bc7f-5f591eca4597" status: 200 len: 1265 microversion: 2.1 time: 0.370626 Oct 17 13:46:23.401153 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1480/2947] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:23 2022] GET /compute/v2.1/servers/ecd07fc5-cb11-4e4c-bc7f-5f591eca4597 => generated 1265 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:23.418594 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d9b596bb-cee9-4d9e-9c99-628d8243ef22 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:23.419257 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d9b596bb-cee9-4d9e-9c99-628d8243ef22 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:23.436545 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d9b596bb-cee9-4d9e-9c99-628d8243ef22 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:23.437419 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d9b596bb-cee9-4d9e-9c99-628d8243ef22 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:23.438066 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d9b596bb-cee9-4d9e-9c99-628d8243ef22 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:23.439042 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d9b596bb-cee9-4d9e-9c99-628d8243ef22 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:23.441049 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d9b596bb-cee9-4d9e-9c99-628d8243ef22 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:23.442889 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d9b596bb-cee9-4d9e-9c99-628d8243ef22 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:23.921850 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d9b596bb-cee9-4d9e-9c99-628d8243ef22 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:23.946048 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d9b596bb-cee9-4d9e-9c99-628d8243ef22 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 0.543657 Oct 17 13:46:23.946676 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1481/2948] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:23 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:23.962187 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=24 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:46:23.972710 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8e7d8a39-1423-4c7c-80e5-a4749def9e29 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:46:23.973844 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8e7d8a39-1423-4c7c-80e5-a4749def9e29 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:23.976185 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:46:23.996481 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8e7d8a39-1423-4c7c-80e5-a4749def9e29 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:23.997331 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8e7d8a39-1423-4c7c-80e5-a4749def9e29 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:23.998167 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8e7d8a39-1423-4c7c-80e5-a4749def9e29 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:23.999905 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8e7d8a39-1423-4c7c-80e5-a4749def9e29 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:24.001396 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8e7d8a39-1423-4c7c-80e5-a4749def9e29 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:24.005010 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8e7d8a39-1423-4c7c-80e5-a4749def9e29 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:24.059385 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-8e7d8a39-1423-4c7c-80e5-a4749def9e29 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lazy-loading 'flavor' on Instance uuid 5ef00d34-7f81-4649-a90a-a52cf78dbeca {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:46:24.070933 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=100 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:46:24.509272 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8e7d8a39-1423-4c7c-80e5-a4749def9e29 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "POST /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca/action" status: 202 len: 0 microversion: 2.1 time: 0.540455 Oct 17 13:46:24.511020 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1482/2949] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:46:23 2022] POST /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca/action => generated 0 bytes in 543 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:46:24.538744 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-520a7063-4b9d-4d72-9b1e-d1ddbc1b84e1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:24.540065 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-520a7063-4b9d-4d72-9b1e-d1ddbc1b84e1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9d1105b3-be41-4963-a86b-6f4486d1d382] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:24.562776 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-520a7063-4b9d-4d72-9b1e-d1ddbc1b84e1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:24.563525 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-520a7063-4b9d-4d72-9b1e-d1ddbc1b84e1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:24.565289 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-520a7063-4b9d-4d72-9b1e-d1ddbc1b84e1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:24.566205 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-520a7063-4b9d-4d72-9b1e-d1ddbc1b84e1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:24.566822 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-520a7063-4b9d-4d72-9b1e-d1ddbc1b84e1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:24.567433 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-520a7063-4b9d-4d72-9b1e-d1ddbc1b84e1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:24.867347 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-520a7063-4b9d-4d72-9b1e-d1ddbc1b84e1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:24.888280 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-520a7063-4b9d-4d72-9b1e-d1ddbc1b84e1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382" status: 200 len: 1312 microversion: 2.1 time: 0.374800 Oct 17 13:46:24.893640 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1483/2950] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:24 2022] GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382 => generated 1312 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:24.901105 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7fda8d69-0cdf-4117-82cb-af04ebced1ff tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:24.917463 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7fda8d69-0cdf-4117-82cb-af04ebced1ff tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] [instance: ecd07fc5-cb11-4e4c-bc7f-5f591eca4597] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:24.930536 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7fda8d69-0cdf-4117-82cb-af04ebced1ff tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:24.931031 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7fda8d69-0cdf-4117-82cb-af04ebced1ff tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:24.931484 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7fda8d69-0cdf-4117-82cb-af04ebced1ff tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:24.941439 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7fda8d69-0cdf-4117-82cb-af04ebced1ff tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:24.942487 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7fda8d69-0cdf-4117-82cb-af04ebced1ff tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:24.945158 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7fda8d69-0cdf-4117-82cb-af04ebced1ff tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:25.281560 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7fda8d69-0cdf-4117-82cb-af04ebced1ff tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6898fd7e18d3404a982b998171f8f7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0ffd0b1b764825826ab82cfbbe23e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:25.294941 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7fda8d69-0cdf-4117-82cb-af04ebced1ff tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] 10.222.0.79 "GET /compute/v2.1/servers/ecd07fc5-cb11-4e4c-bc7f-5f591eca4597" status: 200 len: 1271 microversion: 2.1 time: 0.399875 Oct 17 13:46:25.309639 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1484/2951] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:24 2022] GET /compute/v2.1/servers/ecd07fc5-cb11-4e4c-bc7f-5f591eca4597 => generated 1271 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:25.326689 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7955922c-614d-4420-bace-0189dfd91afb tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:25.327618 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7955922c-614d-4420-bace-0189dfd91afb tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:25.349368 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7955922c-614d-4420-bace-0189dfd91afb tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:25.352336 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7955922c-614d-4420-bace-0189dfd91afb tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:25.353058 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7955922c-614d-4420-bace-0189dfd91afb tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:25.354022 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7955922c-614d-4420-bace-0189dfd91afb tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:25.355429 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7955922c-614d-4420-bace-0189dfd91afb tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:25.356096 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7955922c-614d-4420-bace-0189dfd91afb tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:25.735928 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9d52054e-b574-4df3-bc7c-6382c6c1011e tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] 10.222.0.79 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 7.929705 Oct 17 13:46:25.741604 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1468/2952] 10.222.0.79 () {60 vars in 1170 bytes} [Mon Oct 17 13:46:17 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 7936 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:46:25.778084 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7955922c-614d-4420-bace-0189dfd91afb tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:25.792971 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7955922c-614d-4420-bace-0189dfd91afb tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1512 microversion: 2.1 time: 0.472395 Oct 17 13:46:25.793611 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1485/2953] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:25 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1512 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:25.918209 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0b1530fa-6bc7-48ce-8ec3-a76eff9948d9 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:25.919120 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0b1530fa-6bc7-48ce-8ec3-a76eff9948d9 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9d1105b3-be41-4963-a86b-6f4486d1d382] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:25.935624 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0b1530fa-6bc7-48ce-8ec3-a76eff9948d9 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:25.939673 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0b1530fa-6bc7-48ce-8ec3-a76eff9948d9 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:25.940374 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0b1530fa-6bc7-48ce-8ec3-a76eff9948d9 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:25.941276 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0b1530fa-6bc7-48ce-8ec3-a76eff9948d9 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:25.948347 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0b1530fa-6bc7-48ce-8ec3-a76eff9948d9 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:25.957520 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0b1530fa-6bc7-48ce-8ec3-a76eff9948d9 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:25.964815 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9c4fa2cf-8825-47e4-8d28-d2b97fccdc6c tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-297332071", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "78e524a2-ee09-4045-aff8-792bc0397f6e"}]}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:46:26.131216 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-9c4fa2cf-8825-47e4-8d28-d2b97fccdc6c tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] validate_networks() for [('78e524a2-ee09-4045-aff8-792bc0397f6e', None, None, None, None, None)] {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:46:26.706386 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0b1530fa-6bc7-48ce-8ec3-a76eff9948d9 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:26.718459 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0b1530fa-6bc7-48ce-8ec3-a76eff9948d9 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382" status: 200 len: 1312 microversion: 2.1 time: 0.803647 Oct 17 13:46:26.723997 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1469/2954] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:25 2022] GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382 => generated 1312 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:26.739877 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7cb11c12-9bbe-4d4e-81fd-d03a80bb7a28 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:26.741029 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7cb11c12-9bbe-4d4e-81fd-d03a80bb7a28 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] [instance: ecd07fc5-cb11-4e4c-bc7f-5f591eca4597] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:26.769313 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7cb11c12-9bbe-4d4e-81fd-d03a80bb7a28 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:26.776839 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7cb11c12-9bbe-4d4e-81fd-d03a80bb7a28 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:26.777549 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7cb11c12-9bbe-4d4e-81fd-d03a80bb7a28 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:26.780122 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7cb11c12-9bbe-4d4e-81fd-d03a80bb7a28 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:26.784089 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7cb11c12-9bbe-4d4e-81fd-d03a80bb7a28 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:26.784902 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7cb11c12-9bbe-4d4e-81fd-d03a80bb7a28 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:27.703179 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7cb11c12-9bbe-4d4e-81fd-d03a80bb7a28 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6898fd7e18d3404a982b998171f8f7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0ffd0b1b764825826ab82cfbbe23e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:27.723668 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7cb11c12-9bbe-4d4e-81fd-d03a80bb7a28 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] 10.222.0.79 "GET /compute/v2.1/servers/ecd07fc5-cb11-4e4c-bc7f-5f591eca4597" status: 200 len: 1313 microversion: 2.1 time: 0.990664 Oct 17 13:46:27.724516 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1470/2955] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:26 2022] GET /compute/v2.1/servers/ecd07fc5-cb11-4e4c-bc7f-5f591eca4597 => generated 1313 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:27.729605 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-24109ff7-769f-49c6-b172-32a0bda5f9ff req-ee105523-09d6-461d-9aaf-44f3bfef2a0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d1105b3-be41-4963-a86b-6f4486d1d382", "name": "network-vif-plugged", "status": "completed", "tag": "6cb71ea7-7943-454e-82a0-31ed2ec43a1c"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:46:27.756772 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-24109ff7-769f-49c6-b172-32a0bda5f9ff req-ee105523-09d6-461d-9aaf-44f3bfef2a0c service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:27.757435 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-24109ff7-769f-49c6-b172-32a0bda5f9ff req-ee105523-09d6-461d-9aaf-44f3bfef2a0c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:27.757911 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-24109ff7-769f-49c6-b172-32a0bda5f9ff req-ee105523-09d6-461d-9aaf-44f3bfef2a0c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:27.790931 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-24109ff7-769f-49c6-b172-32a0bda5f9ff req-ee105523-09d6-461d-9aaf-44f3bfef2a0c service nova] Creating event network-vif-plugged:6cb71ea7-7943-454e-82a0-31ed2ec43a1c for instance 9d1105b3-be41-4963-a86b-6f4486d1d382 on n-h2-854247-14 Oct 17 13:46:27.811471 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-24109ff7-769f-49c6-b172-32a0bda5f9ff req-ee105523-09d6-461d-9aaf-44f3bfef2a0c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085399 Oct 17 13:46:27.817268 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1471/2956] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:46:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:46:27.824038 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-91012575-4c32-44b3-ae69-45ad0b06596b tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:27.838801 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-91012575-4c32-44b3-ae69-45ad0b06596b tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:27.848652 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-91012575-4c32-44b3-ae69-45ad0b06596b tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:27.851484 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-91012575-4c32-44b3-ae69-45ad0b06596b tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:27.852632 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-91012575-4c32-44b3-ae69-45ad0b06596b tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:27.858244 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-91012575-4c32-44b3-ae69-45ad0b06596b tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:27.858980 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-91012575-4c32-44b3-ae69-45ad0b06596b tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:27.859619 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-91012575-4c32-44b3-ae69-45ad0b06596b tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:28.025957 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-9c4fa2cf-8825-47e4-8d28-d2b97fccdc6c tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:46:28.026477 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-9c4fa2cf-8825-47e4-8d28-d2b97fccdc6c tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:46:28.029730 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-9c4fa2cf-8825-47e4-8d28-d2b97fccdc6c tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:46:28.030414 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-9c4fa2cf-8825-47e4-8d28-d2b97fccdc6c tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:46:28.031234 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-9c4fa2cf-8825-47e4-8d28-d2b97fccdc6c tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:46:28.048733 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c4fa2cf-8825-47e4-8d28-d2b97fccdc6c tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:28.051443 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c4fa2cf-8825-47e4-8d28-d2b97fccdc6c tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:28.052017 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c4fa2cf-8825-47e4-8d28-d2b97fccdc6c tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:28.056749 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c4fa2cf-8825-47e4-8d28-d2b97fccdc6c tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:28.057363 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c4fa2cf-8825-47e4-8d28-d2b97fccdc6c tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:28.057907 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c4fa2cf-8825-47e4-8d28-d2b97fccdc6c tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:28.109241 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-9c4fa2cf-8825-47e4-8d28-d2b97fccdc6c tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Getting quotas for project 18f91db965084796a4a3dce1b4e921e5. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:46:28.117694 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-9c4fa2cf-8825-47e4-8d28-d2b97fccdc6c tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Getting quotas for user 43a3472f83914990ad41f037b4aafd63 and project 18f91db965084796a4a3dce1b4e921e5. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:46:28.151447 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9c4fa2cf-8825-47e4-8d28-d2b97fccdc6c tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:46:28.154316 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9c4fa2cf-8825-47e4-8d28-d2b97fccdc6c tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] [instance: 29fb8b41-6dcb-49f2-9e1c-11719cace5d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:46:28.316031 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9c4fa2cf-8825-47e4-8d28-d2b97fccdc6c tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.356565 Oct 17 13:46:28.320462 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1486/2957] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:46:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2360 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 13:46:28.333324 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-84e37ec4-66e7-4c4a-a554-72940e76e615 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:28.335605 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-84e37ec4-66e7-4c4a-a554-72940e76e615 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9d1105b3-be41-4963-a86b-6f4486d1d382] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:28.372722 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-84e37ec4-66e7-4c4a-a554-72940e76e615 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:28.373361 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-84e37ec4-66e7-4c4a-a554-72940e76e615 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:28.383429 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-84e37ec4-66e7-4c4a-a554-72940e76e615 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:28.384415 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-84e37ec4-66e7-4c4a-a554-72940e76e615 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:28.390712 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-84e37ec4-66e7-4c4a-a554-72940e76e615 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:28.391359 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-84e37ec4-66e7-4c4a-a554-72940e76e615 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:28.644439 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-91012575-4c32-44b3-ae69-45ad0b06596b tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:28.654045 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-91012575-4c32-44b3-ae69-45ad0b06596b tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1512 microversion: 2.1 time: 0.834363 Oct 17 13:46:28.659528 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1472/2958] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:27 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1512 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:28.669607 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7d49f458-8e22-4788-922f-6f99469d41ca tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:28.670530 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7d49f458-8e22-4788-922f-6f99469d41ca tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] [instance: 29fb8b41-6dcb-49f2-9e1c-11719cace5d9] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:28.809082 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-84e37ec4-66e7-4c4a-a554-72940e76e615 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:28.822372 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-84e37ec4-66e7-4c4a-a554-72940e76e615 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382" status: 200 len: 1312 microversion: 2.1 time: 0.500138 Oct 17 13:46:28.823748 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1487/2959] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:28 2022] GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382 => generated 1312 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:28.839082 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-90ce96e3-17ec-4913-a5c9-e9b86d40bae3 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:28.840247 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-90ce96e3-17ec-4913-a5c9-e9b86d40bae3 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] [instance: ecd07fc5-cb11-4e4c-bc7f-5f591eca4597] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:28.850014 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-90ce96e3-17ec-4913-a5c9-e9b86d40bae3 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:28.856001 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-90ce96e3-17ec-4913-a5c9-e9b86d40bae3 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:28.856831 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-90ce96e3-17ec-4913-a5c9-e9b86d40bae3 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:28.857803 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-90ce96e3-17ec-4913-a5c9-e9b86d40bae3 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:28.868666 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-90ce96e3-17ec-4913-a5c9-e9b86d40bae3 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:28.869388 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-90ce96e3-17ec-4913-a5c9-e9b86d40bae3 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:28.904357 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7d49f458-8e22-4788-922f-6f99469d41ca tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a3472f83914990ad41f037b4aafd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f91db965084796a4a3dce1b4e921e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:28.930325 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7d49f458-8e22-4788-922f-6f99469d41ca tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] 10.222.0.79 "GET /compute/v2.1/servers/29fb8b41-6dcb-49f2-9e1c-11719cace5d9" status: 200 len: 1223 microversion: 2.1 time: 0.269395 Oct 17 13:46:28.933415 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1473/2960] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:28 2022] GET /compute/v2.1/servers/29fb8b41-6dcb-49f2-9e1c-11719cace5d9 => generated 1223 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:29.340605 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-90ce96e3-17ec-4913-a5c9-e9b86d40bae3 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6898fd7e18d3404a982b998171f8f7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0ffd0b1b764825826ab82cfbbe23e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:29.353051 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-90ce96e3-17ec-4913-a5c9-e9b86d40bae3 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] 10.222.0.79 "GET /compute/v2.1/servers/ecd07fc5-cb11-4e4c-bc7f-5f591eca4597" status: 200 len: 1313 microversion: 2.1 time: 0.527992 Oct 17 13:46:29.369507 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1488/2961] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:28 2022] GET /compute/v2.1/servers/ecd07fc5-cb11-4e4c-bc7f-5f591eca4597 => generated 1313 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:29.699010 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-dc67ec4e-4dd6-4336-aff9-a3449318f927 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:29.699836 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-dc67ec4e-4dd6-4336-aff9-a3449318f927 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:29.729826 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dc67ec4e-4dd6-4336-aff9-a3449318f927 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:29.737868 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dc67ec4e-4dd6-4336-aff9-a3449318f927 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:29.740739 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dc67ec4e-4dd6-4336-aff9-a3449318f927 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:29.743015 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dc67ec4e-4dd6-4336-aff9-a3449318f927 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:29.745553 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dc67ec4e-4dd6-4336-aff9-a3449318f927 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:29.749282 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dc67ec4e-4dd6-4336-aff9-a3449318f927 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:29.850739 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a2faec2f-bd63-42a6-9aa5-526f12b24e87 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:29.855446 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a2faec2f-bd63-42a6-9aa5-526f12b24e87 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9d1105b3-be41-4963-a86b-6f4486d1d382] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:29.890815 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a2faec2f-bd63-42a6-9aa5-526f12b24e87 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:29.893906 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a2faec2f-bd63-42a6-9aa5-526f12b24e87 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:29.896205 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a2faec2f-bd63-42a6-9aa5-526f12b24e87 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:29.898676 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a2faec2f-bd63-42a6-9aa5-526f12b24e87 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:29.900262 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a2faec2f-bd63-42a6-9aa5-526f12b24e87 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:29.901427 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a2faec2f-bd63-42a6-9aa5-526f12b24e87 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:31.482723 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a2faec2f-bd63-42a6-9aa5-526f12b24e87 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:31.492280 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-dc67ec4e-4dd6-4336-aff9-a3449318f927 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:31.516445 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-dc67ec4e-4dd6-4336-aff9-a3449318f927 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1512 microversion: 2.1 time: 1.833396 Oct 17 13:46:31.518404 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1474/2962] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:29 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1512 bytes in 1838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:31.521473 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a2faec2f-bd63-42a6-9aa5-526f12b24e87 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382" status: 200 len: 1312 microversion: 2.1 time: 1.677137 Oct 17 13:46:31.541925 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1489/2963] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:29 2022] GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382 => generated 1312 bytes in 1693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:31.545253 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-cd6370e2-35cb-4bf7-ba1f-c6472304a47c req-4723d548-d87c-44bf-96d7-4d46b469461a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecd07fc5-cb11-4e4c-bc7f-5f591eca4597", "tag": "ce4b0109-2d0f-4ce6-9073-08b0afa38259"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:46:31.575375 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-cd6370e2-35cb-4bf7-ba1f-c6472304a47c req-4723d548-d87c-44bf-96d7-4d46b469461a service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:31.576335 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-cd6370e2-35cb-4bf7-ba1f-c6472304a47c req-4723d548-d87c-44bf-96d7-4d46b469461a service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:31.577949 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0ef6b609-2ce2-4f44-9770-2d495da92602 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:31.578196 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-cd6370e2-35cb-4bf7-ba1f-c6472304a47c req-4723d548-d87c-44bf-96d7-4d46b469461a service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:31.581471 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0ef6b609-2ce2-4f44-9770-2d495da92602 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] [instance: 29fb8b41-6dcb-49f2-9e1c-11719cace5d9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:31.597936 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-cd6370e2-35cb-4bf7-ba1f-c6472304a47c req-4723d548-d87c-44bf-96d7-4d46b469461a service nova] Creating event network-changed:ce4b0109-2d0f-4ce6-9073-08b0afa38259 for instance ecd07fc5-cb11-4e4c-bc7f-5f591eca4597 on n-h2-854247-14 Oct 17 13:46:31.606529 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-cd6370e2-35cb-4bf7-ba1f-c6472304a47c req-4723d548-d87c-44bf-96d7-4d46b469461a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083801 Oct 17 13:46:31.607967 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1475/2964] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:46:31.635115 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-687b9786-275f-457a-b168-6134d026514e tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:31.636487 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-687b9786-275f-457a-b168-6134d026514e tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] [instance: ecd07fc5-cb11-4e4c-bc7f-5f591eca4597] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:31.644307 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=12,nova_api:INSERT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:46:31.648739 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-687b9786-275f-457a-b168-6134d026514e tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:31.649733 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-687b9786-275f-457a-b168-6134d026514e tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:31.651372 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-687b9786-275f-457a-b168-6134d026514e tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:31.652958 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-687b9786-275f-457a-b168-6134d026514e tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:31.653765 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-687b9786-275f-457a-b168-6134d026514e tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:31.654582 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-687b9786-275f-457a-b168-6134d026514e tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:31.708473 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0ef6b609-2ce2-4f44-9770-2d495da92602 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:31.709675 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0ef6b609-2ce2-4f44-9770-2d495da92602 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:31.710415 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0ef6b609-2ce2-4f44-9770-2d495da92602 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:31.711707 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0ef6b609-2ce2-4f44-9770-2d495da92602 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:31.712413 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0ef6b609-2ce2-4f44-9770-2d495da92602 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:31.713583 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0ef6b609-2ce2-4f44-9770-2d495da92602 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:32.049999 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0ef6b609-2ce2-4f44-9770-2d495da92602 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a3472f83914990ad41f037b4aafd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f91db965084796a4a3dce1b4e921e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:32.066472 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0ef6b609-2ce2-4f44-9770-2d495da92602 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] 10.222.0.79 "GET /compute/v2.1/servers/29fb8b41-6dcb-49f2-9e1c-11719cace5d9" status: 200 len: 1281 microversion: 2.1 time: 0.519769 Oct 17 13:46:32.067410 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1490/2965] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:31 2022] GET /compute/v2.1/servers/29fb8b41-6dcb-49f2-9e1c-11719cace5d9 => generated 1281 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:32.313206 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-687b9786-275f-457a-b168-6134d026514e tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6898fd7e18d3404a982b998171f8f7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0ffd0b1b764825826ab82cfbbe23e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:32.322733 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-687b9786-275f-457a-b168-6134d026514e tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] 10.222.0.79 "GET /compute/v2.1/servers/ecd07fc5-cb11-4e4c-bc7f-5f591eca4597" status: 200 len: 1313 microversion: 2.1 time: 0.712948 Oct 17 13:46:32.323356 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1476/2966] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:31 2022] GET /compute/v2.1/servers/ecd07fc5-cb11-4e4c-bc7f-5f591eca4597 => generated 1313 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:32.559330 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ae5ba13f-3603-4d76-9201-c685afb3fd42 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:32.562004 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ae5ba13f-3603-4d76-9201-c685afb3fd42 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9d1105b3-be41-4963-a86b-6f4486d1d382] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:32.564585 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-89003b5c-cdbe-4172-b671-eff1d8636eda tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:32.567469 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-89003b5c-cdbe-4172-b671-eff1d8636eda tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:32.579347 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae5ba13f-3603-4d76-9201-c685afb3fd42 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:32.581070 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae5ba13f-3603-4d76-9201-c685afb3fd42 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:32.582060 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae5ba13f-3603-4d76-9201-c685afb3fd42 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:32.583025 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae5ba13f-3603-4d76-9201-c685afb3fd42 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:32.583782 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae5ba13f-3603-4d76-9201-c685afb3fd42 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:32.584516 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae5ba13f-3603-4d76-9201-c685afb3fd42 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:32.591395 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-89003b5c-cdbe-4172-b671-eff1d8636eda tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:32.593183 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-89003b5c-cdbe-4172-b671-eff1d8636eda tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:32.595468 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-89003b5c-cdbe-4172-b671-eff1d8636eda tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:32.597540 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-89003b5c-cdbe-4172-b671-eff1d8636eda tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:32.601787 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-89003b5c-cdbe-4172-b671-eff1d8636eda tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:32.602655 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-89003b5c-cdbe-4172-b671-eff1d8636eda tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:33.114242 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ae5ba13f-3603-4d76-9201-c685afb3fd42 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:33.142959 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ae5ba13f-3603-4d76-9201-c685afb3fd42 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382" status: 200 len: 1462 microversion: 2.1 time: 0.594878 Oct 17 13:46:33.155546 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1477/2967] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:32 2022] GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382 => generated 1462 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:33.162279 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-89003b5c-cdbe-4172-b671-eff1d8636eda tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:33.168791 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8d177690-2af3-4b10-a5f0-b256efc04c95 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:33.169384 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8d177690-2af3-4b10-a5f0-b256efc04c95 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] [instance: 29fb8b41-6dcb-49f2-9e1c-11719cace5d9] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:33.172037 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-89003b5c-cdbe-4172-b671-eff1d8636eda tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1512 microversion: 2.1 time: 0.618567 Oct 17 13:46:33.176769 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1491/2968] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:32 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1512 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:33.211260 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8d177690-2af3-4b10-a5f0-b256efc04c95 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:33.212841 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8d177690-2af3-4b10-a5f0-b256efc04c95 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:33.213278 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8d177690-2af3-4b10-a5f0-b256efc04c95 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:33.213999 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8d177690-2af3-4b10-a5f0-b256efc04c95 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:33.214445 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8d177690-2af3-4b10-a5f0-b256efc04c95 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:33.214864 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8d177690-2af3-4b10-a5f0-b256efc04c95 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:33.733579 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-47bb5a74-9673-4580-ac5c-edd77fbe1ca1 tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:33.735468 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-47bb5a74-9673-4580-ac5c-edd77fbe1ca1 tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] [instance: 9d1105b3-be41-4963-a86b-6f4486d1d382] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:33.747080 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-47bb5a74-9673-4580-ac5c-edd77fbe1ca1 tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:33.749616 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-47bb5a74-9673-4580-ac5c-edd77fbe1ca1 tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:33.750127 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-47bb5a74-9673-4580-ac5c-edd77fbe1ca1 tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:33.751808 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-47bb5a74-9673-4580-ac5c-edd77fbe1ca1 tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:33.753762 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-47bb5a74-9673-4580-ac5c-edd77fbe1ca1 tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:33.755304 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-47bb5a74-9673-4580-ac5c-edd77fbe1ca1 tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:34.064762 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8d177690-2af3-4b10-a5f0-b256efc04c95 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a3472f83914990ad41f037b4aafd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f91db965084796a4a3dce1b4e921e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:34.080866 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8d177690-2af3-4b10-a5f0-b256efc04c95 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] 10.222.0.79 "GET /compute/v2.1/servers/29fb8b41-6dcb-49f2-9e1c-11719cace5d9" status: 200 len: 1323 microversion: 2.1 time: 0.922316 Oct 17 13:46:34.082315 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1478/2969] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:33 2022] GET /compute/v2.1/servers/29fb8b41-6dcb-49f2-9e1c-11719cace5d9 => generated 1323 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:34.131405 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-eca8e253-3b96-438b-bb9b-35dbcd52d3f1 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:34.132668 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-eca8e253-3b96-438b-bb9b-35dbcd52d3f1 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] [instance: ecd07fc5-cb11-4e4c-bc7f-5f591eca4597] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:34.148892 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eca8e253-3b96-438b-bb9b-35dbcd52d3f1 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:34.149401 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eca8e253-3b96-438b-bb9b-35dbcd52d3f1 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:34.149840 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eca8e253-3b96-438b-bb9b-35dbcd52d3f1 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:34.150555 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eca8e253-3b96-438b-bb9b-35dbcd52d3f1 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:34.151088 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eca8e253-3b96-438b-bb9b-35dbcd52d3f1 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:34.151557 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eca8e253-3b96-438b-bb9b-35dbcd52d3f1 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:34.223630 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=100 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:46:34.925408 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-eca8e253-3b96-438b-bb9b-35dbcd52d3f1 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6898fd7e18d3404a982b998171f8f7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0ffd0b1b764825826ab82cfbbe23e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:34.939211 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-eca8e253-3b96-438b-bb9b-35dbcd52d3f1 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] 10.222.0.79 "GET /compute/v2.1/servers/ecd07fc5-cb11-4e4c-bc7f-5f591eca4597" status: 200 len: 1313 microversion: 2.1 time: 0.839381 Oct 17 13:46:34.942523 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1479/2970] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:34 2022] GET /compute/v2.1/servers/ecd07fc5-cb11-4e4c-bc7f-5f591eca4597 => generated 1313 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:34.956070 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9934ea44-3cc4-42c1-a305-053fcb6eeb8c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:34.957600 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9934ea44-3cc4-42c1-a305-053fcb6eeb8c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:34.975117 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9934ea44-3cc4-42c1-a305-053fcb6eeb8c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:34.975659 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9934ea44-3cc4-42c1-a305-053fcb6eeb8c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:34.994705 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9934ea44-3cc4-42c1-a305-053fcb6eeb8c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:35.001217 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9934ea44-3cc4-42c1-a305-053fcb6eeb8c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:35.007972 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-47bb5a74-9673-4580-ac5c-edd77fbe1ca1 tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382" status: 200 len: 1615 microversion: 2.1 time: 1.818907 Oct 17 13:46:35.008640 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9934ea44-3cc4-42c1-a305-053fcb6eeb8c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:35.009201 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9934ea44-3cc4-42c1-a305-053fcb6eeb8c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:35.011127 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1492/2971] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:33 2022] GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382 => generated 1615 bytes in 1828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:35.035548 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3628bcf0-c8dc-484b-93f6-d31df724c3cf tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:46:35.043756 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3628bcf0-c8dc-484b-93f6-d31df724c3cf tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] [instance: 9d1105b3-be41-4963-a86b-6f4486d1d382] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:35.060744 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3628bcf0-c8dc-484b-93f6-d31df724c3cf tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:35.061238 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3628bcf0-c8dc-484b-93f6-d31df724c3cf tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:35.061672 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3628bcf0-c8dc-484b-93f6-d31df724c3cf tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:35.062594 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3628bcf0-c8dc-484b-93f6-d31df724c3cf tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:35.080520 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3628bcf0-c8dc-484b-93f6-d31df724c3cf tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:35.081024 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3628bcf0-c8dc-484b-93f6-d31df724c3cf tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:35.245570 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3628bcf0-c8dc-484b-93f6-d31df724c3cf tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '8ad835fb172540caaa8195d1e3e454b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a040c7e5c765439896b2f969363b9e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:35.246477 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3628bcf0-c8dc-484b-93f6-d31df724c3cf tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] [instance: 9d1105b3-be41-4963-a86b-6f4486d1d382] flavor_id is None. Assuming migration. {{(pid=127016) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 17 13:46:35.246936 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3628bcf0-c8dc-484b-93f6-d31df724c3cf tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] [instance: 9d1105b3-be41-4963-a86b-6f4486d1d382] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=127016) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 17 13:46:35.730770 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3628bcf0-c8dc-484b-93f6-d31df724c3cf tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382/action" status: 202 len: 0 microversion: 2.1 time: 0.700618 Oct 17 13:46:35.735835 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1493/2972] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:46:35 2022] POST /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382/action => generated 0 bytes in 706 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:46:35.752769 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2f65886e-cbbb-4a59-b5fb-f94a437c4830 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:35.754226 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2f65886e-cbbb-4a59-b5fb-f94a437c4830 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] [instance: 29fb8b41-6dcb-49f2-9e1c-11719cace5d9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:35.771844 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2f65886e-cbbb-4a59-b5fb-f94a437c4830 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:35.772864 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2f65886e-cbbb-4a59-b5fb-f94a437c4830 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:35.773896 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2f65886e-cbbb-4a59-b5fb-f94a437c4830 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:35.777264 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2f65886e-cbbb-4a59-b5fb-f94a437c4830 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:35.778474 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2f65886e-cbbb-4a59-b5fb-f94a437c4830 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:35.780067 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2f65886e-cbbb-4a59-b5fb-f94a437c4830 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:35.857699 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9934ea44-3cc4-42c1-a305-053fcb6eeb8c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:35.888282 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9934ea44-3cc4-42c1-a305-053fcb6eeb8c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1512 microversion: 2.1 time: 0.942433 Oct 17 13:46:35.895051 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1480/2973] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:34 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1512 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:35.924183 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1cd9b6a0-d0f3-4d86-98f4-f64dca9664ea tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:35.929018 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1cd9b6a0-d0f3-4d86-98f4-f64dca9664ea tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9d1105b3-be41-4963-a86b-6f4486d1d382] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:35.956451 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1cd9b6a0-d0f3-4d86-98f4-f64dca9664ea tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:35.962698 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1cd9b6a0-d0f3-4d86-98f4-f64dca9664ea tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:35.964832 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1cd9b6a0-d0f3-4d86-98f4-f64dca9664ea tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:35.969974 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1cd9b6a0-d0f3-4d86-98f4-f64dca9664ea tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:35.978324 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1cd9b6a0-d0f3-4d86-98f4-f64dca9664ea tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:35.978990 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1cd9b6a0-d0f3-4d86-98f4-f64dca9664ea tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:36.953820 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2f65886e-cbbb-4a59-b5fb-f94a437c4830 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a3472f83914990ad41f037b4aafd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f91db965084796a4a3dce1b4e921e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:36.971334 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2f65886e-cbbb-4a59-b5fb-f94a437c4830 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] 10.222.0.79 "GET /compute/v2.1/servers/29fb8b41-6dcb-49f2-9e1c-11719cace5d9" status: 200 len: 1323 microversion: 2.1 time: 1.228305 Oct 17 13:46:36.976156 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1494/2974] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:35 2022] GET /compute/v2.1/servers/29fb8b41-6dcb-49f2-9e1c-11719cace5d9 => generated 1323 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:36.987309 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-36cef932-5237-4358-8dd6-725cdb5a6780 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:36.991832 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-36cef932-5237-4358-8dd6-725cdb5a6780 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] [instance: ecd07fc5-cb11-4e4c-bc7f-5f591eca4597] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:37.006435 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-36cef932-5237-4358-8dd6-725cdb5a6780 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:37.009271 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-36cef932-5237-4358-8dd6-725cdb5a6780 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:37.010835 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-36cef932-5237-4358-8dd6-725cdb5a6780 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:37.011893 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-36cef932-5237-4358-8dd6-725cdb5a6780 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:37.015055 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-36cef932-5237-4358-8dd6-725cdb5a6780 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:37.015847 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-36cef932-5237-4358-8dd6-725cdb5a6780 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:37.388455 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1cd9b6a0-d0f3-4d86-98f4-f64dca9664ea tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:37.401494 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1cd9b6a0-d0f3-4d86-98f4-f64dca9664ea tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382" status: 200 len: 1471 microversion: 2.1 time: 1.501193 Oct 17 13:46:37.405480 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1481/2975] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:35 2022] GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382 => generated 1471 bytes in 1510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:37.420401 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9c639b6a-9fdf-4cdb-9e7c-b7c012b654b4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:37.421399 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9c639b6a-9fdf-4cdb-9e7c-b7c012b654b4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:37.432419 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9c639b6a-9fdf-4cdb-9e7c-b7c012b654b4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:37.435043 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9c639b6a-9fdf-4cdb-9e7c-b7c012b654b4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:37.435836 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9c639b6a-9fdf-4cdb-9e7c-b7c012b654b4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:37.440204 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9c639b6a-9fdf-4cdb-9e7c-b7c012b654b4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:37.441343 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9c639b6a-9fdf-4cdb-9e7c-b7c012b654b4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:37.444249 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9c639b6a-9fdf-4cdb-9e7c-b7c012b654b4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:37.732296 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-36cef932-5237-4358-8dd6-725cdb5a6780 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6898fd7e18d3404a982b998171f8f7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0ffd0b1b764825826ab82cfbbe23e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:37.747477 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-36cef932-5237-4358-8dd6-725cdb5a6780 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] 10.222.0.79 "GET /compute/v2.1/servers/ecd07fc5-cb11-4e4c-bc7f-5f591eca4597" status: 200 len: 1313 microversion: 2.1 time: 0.766112 Oct 17 13:46:37.748987 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1495/2976] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:36 2022] GET /compute/v2.1/servers/ecd07fc5-cb11-4e4c-bc7f-5f591eca4597 => generated 1313 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:37.916192 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-bf3e8d7d-d760-4669-8c7d-2cbfdc603fe2 req-4423ef7d-f18e-48be-9005-038a8076c78d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29fb8b41-6dcb-49f2-9e1c-11719cace5d9", "tag": "9025275f-f4f7-42ab-bf78-e79c39398580"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:46:37.943333 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-bf3e8d7d-d760-4669-8c7d-2cbfdc603fe2 req-4423ef7d-f18e-48be-9005-038a8076c78d service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:37.952218 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-bf3e8d7d-d760-4669-8c7d-2cbfdc603fe2 req-4423ef7d-f18e-48be-9005-038a8076c78d service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:37.953032 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-bf3e8d7d-d760-4669-8c7d-2cbfdc603fe2 req-4423ef7d-f18e-48be-9005-038a8076c78d service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:38.008432 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-bf3e8d7d-d760-4669-8c7d-2cbfdc603fe2 req-4423ef7d-f18e-48be-9005-038a8076c78d service nova] Creating event network-changed:9025275f-f4f7-42ab-bf78-e79c39398580 for instance 29fb8b41-6dcb-49f2-9e1c-11719cace5d9 on n-h1-854247-14 Oct 17 13:46:38.032717 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-bf3e8d7d-d760-4669-8c7d-2cbfdc603fe2 req-4423ef7d-f18e-48be-9005-038a8076c78d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121097 Oct 17 13:46:38.036458 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1496/2977] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:46:38.081979 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-01a416bc-1e18-4264-ae54-cf18e1a7e6a1 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:38.083707 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-01a416bc-1e18-4264-ae54-cf18e1a7e6a1 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] [instance: 29fb8b41-6dcb-49f2-9e1c-11719cace5d9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:38.099281 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=4 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:46:38.115316 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-01a416bc-1e18-4264-ae54-cf18e1a7e6a1 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:38.123092 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9c639b6a-9fdf-4cdb-9e7c-b7c012b654b4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:38.123754 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-01a416bc-1e18-4264-ae54-cf18e1a7e6a1 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:38.128575 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-01a416bc-1e18-4264-ae54-cf18e1a7e6a1 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:38.130981 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-01a416bc-1e18-4264-ae54-cf18e1a7e6a1 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:38.137204 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9c639b6a-9fdf-4cdb-9e7c-b7c012b654b4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1533 microversion: 2.1 time: 0.730188 Oct 17 13:46:38.138326 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-01a416bc-1e18-4264-ae54-cf18e1a7e6a1 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:38.138817 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-01a416bc-1e18-4264-ae54-cf18e1a7e6a1 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:38.144156 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=36 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:46:38.148455 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1482/2978] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:37 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1533 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:38.239048 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:46:38.432730 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bc3fe722-9f3d-4f09-90ae-8cbf462f7168 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:38.434850 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-bc3fe722-9f3d-4f09-90ae-8cbf462f7168 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9d1105b3-be41-4963-a86b-6f4486d1d382] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:38.455805 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bc3fe722-9f3d-4f09-90ae-8cbf462f7168 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:38.457617 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bc3fe722-9f3d-4f09-90ae-8cbf462f7168 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:38.458308 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bc3fe722-9f3d-4f09-90ae-8cbf462f7168 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:38.459697 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bc3fe722-9f3d-4f09-90ae-8cbf462f7168 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:38.461108 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bc3fe722-9f3d-4f09-90ae-8cbf462f7168 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:38.461775 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bc3fe722-9f3d-4f09-90ae-8cbf462f7168 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:38.918092 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:46:40.370741 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-bc3fe722-9f3d-4f09-90ae-8cbf462f7168 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:40.418063 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-bc3fe722-9f3d-4f09-90ae-8cbf462f7168 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382" status: 200 len: 1471 microversion: 2.1 time: 1.990086 Oct 17 13:46:40.419414 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1483/2979] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:38 2022] GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382 => generated 1471 bytes in 1992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:40.441503 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-00100638-e81d-4fe0-a4a0-bc8d331ee937 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:40.444538 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-00100638-e81d-4fe0-a4a0-bc8d331ee937 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] [instance: ecd07fc5-cb11-4e4c-bc7f-5f591eca4597] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:40.458123 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-01a416bc-1e18-4264-ae54-cf18e1a7e6a1 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a3472f83914990ad41f037b4aafd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f91db965084796a4a3dce1b4e921e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:40.480480 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-01a416bc-1e18-4264-ae54-cf18e1a7e6a1 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] 10.222.0.79 "GET /compute/v2.1/servers/29fb8b41-6dcb-49f2-9e1c-11719cace5d9" status: 200 len: 1323 microversion: 2.1 time: 2.437693 Oct 17 13:46:40.481554 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-00100638-e81d-4fe0-a4a0-bc8d331ee937 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:40.482267 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1497/2980] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:38 2022] GET /compute/v2.1/servers/29fb8b41-6dcb-49f2-9e1c-11719cace5d9 => generated 1323 bytes in 2444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:40.507954 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-00100638-e81d-4fe0-a4a0-bc8d331ee937 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:40.510682 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-00100638-e81d-4fe0-a4a0-bc8d331ee937 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:40.512667 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-00100638-e81d-4fe0-a4a0-bc8d331ee937 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:40.517378 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-00100638-e81d-4fe0-a4a0-bc8d331ee937 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:40.522097 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-00100638-e81d-4fe0-a4a0-bc8d331ee937 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:40.536398 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3dcb3b8a-b50e-40d0-826b-46eb9ed8b342 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:40.545857 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3dcb3b8a-b50e-40d0-826b-46eb9ed8b342 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:40.557023 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3dcb3b8a-b50e-40d0-826b-46eb9ed8b342 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:40.559290 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3dcb3b8a-b50e-40d0-826b-46eb9ed8b342 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:40.562020 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3dcb3b8a-b50e-40d0-826b-46eb9ed8b342 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:40.562801 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3dcb3b8a-b50e-40d0-826b-46eb9ed8b342 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:40.570641 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3dcb3b8a-b50e-40d0-826b-46eb9ed8b342 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:40.571279 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3dcb3b8a-b50e-40d0-826b-46eb9ed8b342 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:41.826969 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-00100638-e81d-4fe0-a4a0-bc8d331ee937 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6898fd7e18d3404a982b998171f8f7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0ffd0b1b764825826ab82cfbbe23e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:41.841991 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-00100638-e81d-4fe0-a4a0-bc8d331ee937 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] 10.222.0.79 "GET /compute/v2.1/servers/ecd07fc5-cb11-4e4c-bc7f-5f591eca4597" status: 200 len: 1313 microversion: 2.1 time: 1.420148 Oct 17 13:46:41.842605 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1484/2981] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:40 2022] GET /compute/v2.1/servers/ecd07fc5-cb11-4e4c-bc7f-5f591eca4597 => generated 1313 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:41.858212 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-eab63ff9-b62d-4221-b634-f39a692e9bd5 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:41.861924 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-eab63ff9-b62d-4221-b634-f39a692e9bd5 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9d1105b3-be41-4963-a86b-6f4486d1d382] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:41.877518 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eab63ff9-b62d-4221-b634-f39a692e9bd5 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:41.882852 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eab63ff9-b62d-4221-b634-f39a692e9bd5 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:41.883632 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eab63ff9-b62d-4221-b634-f39a692e9bd5 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:41.884915 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eab63ff9-b62d-4221-b634-f39a692e9bd5 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:41.890283 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eab63ff9-b62d-4221-b634-f39a692e9bd5 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:41.891366 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eab63ff9-b62d-4221-b634-f39a692e9bd5 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:42.075068 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3dcb3b8a-b50e-40d0-826b-46eb9ed8b342 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:42.087940 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3dcb3b8a-b50e-40d0-826b-46eb9ed8b342 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1528 microversion: 2.1 time: 1.580207 Oct 17 13:46:42.092202 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1498/2982] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:40 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1528 bytes in 1594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:42.103371 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d13c8668-6a12-4e51-93e3-869755a6b72b tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:42.104177 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d13c8668-6a12-4e51-93e3-869755a6b72b tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] [instance: 29fb8b41-6dcb-49f2-9e1c-11719cace5d9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:42.122866 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d13c8668-6a12-4e51-93e3-869755a6b72b tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:42.123776 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d13c8668-6a12-4e51-93e3-869755a6b72b tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:42.124576 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d13c8668-6a12-4e51-93e3-869755a6b72b tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:42.125576 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d13c8668-6a12-4e51-93e3-869755a6b72b tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:42.126262 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d13c8668-6a12-4e51-93e3-869755a6b72b tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:42.126905 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d13c8668-6a12-4e51-93e3-869755a6b72b tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:42.693254 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-eab63ff9-b62d-4221-b634-f39a692e9bd5 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:42.710747 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-eab63ff9-b62d-4221-b634-f39a692e9bd5 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382" status: 200 len: 1471 microversion: 2.1 time: 0.862799 Oct 17 13:46:42.727222 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1485/2983] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:41 2022] GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382 => generated 1471 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:42.835990 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d13c8668-6a12-4e51-93e3-869755a6b72b tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a3472f83914990ad41f037b4aafd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f91db965084796a4a3dce1b4e921e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:42.848811 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d13c8668-6a12-4e51-93e3-869755a6b72b tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] 10.222.0.79 "GET /compute/v2.1/servers/29fb8b41-6dcb-49f2-9e1c-11719cace5d9" status: 200 len: 1323 microversion: 2.1 time: 0.755157 Oct 17 13:46:42.849652 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1499/2984] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:42 2022] GET /compute/v2.1/servers/29fb8b41-6dcb-49f2-9e1c-11719cace5d9 => generated 1323 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:42.874975 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-cab376ce-89f4-4ae4-81b3-0734e5afd751 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:42.876631 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-cab376ce-89f4-4ae4-81b3-0734e5afd751 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] [instance: ecd07fc5-cb11-4e4c-bc7f-5f591eca4597] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:42.898620 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cab376ce-89f4-4ae4-81b3-0734e5afd751 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:42.902619 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cab376ce-89f4-4ae4-81b3-0734e5afd751 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:42.904423 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cab376ce-89f4-4ae4-81b3-0734e5afd751 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:42.906370 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cab376ce-89f4-4ae4-81b3-0734e5afd751 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:42.909692 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cab376ce-89f4-4ae4-81b3-0734e5afd751 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:42.910560 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cab376ce-89f4-4ae4-81b3-0734e5afd751 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:43.119764 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a199b327-5b33-4808-aee8-2409044d436c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:43.120394 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a199b327-5b33-4808-aee8-2409044d436c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:43.137418 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a199b327-5b33-4808-aee8-2409044d436c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:43.141330 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a199b327-5b33-4808-aee8-2409044d436c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:43.141965 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a199b327-5b33-4808-aee8-2409044d436c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:43.142855 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a199b327-5b33-4808-aee8-2409044d436c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:43.153483 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a199b327-5b33-4808-aee8-2409044d436c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:43.154227 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a199b327-5b33-4808-aee8-2409044d436c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:43.860074 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-cab376ce-89f4-4ae4-81b3-0734e5afd751 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6898fd7e18d3404a982b998171f8f7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0ffd0b1b764825826ab82cfbbe23e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:43.890825 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-cab376ce-89f4-4ae4-81b3-0734e5afd751 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] 10.222.0.79 "GET /compute/v2.1/servers/ecd07fc5-cb11-4e4c-bc7f-5f591eca4597" status: 200 len: 1313 microversion: 2.1 time: 1.021226 Oct 17 13:46:43.892642 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1486/2985] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:42 2022] GET /compute/v2.1/servers/ecd07fc5-cb11-4e4c-bc7f-5f591eca4597 => generated 1313 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:43.902321 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-7a973634-8e6a-4b65-8aed-e57124a686a6 req-9e04ae1f-fed0-4c06-95fe-7f659ea3517f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ef00d34-7f81-4649-a90a-a52cf78dbeca", "name": "network-vif-plugged", "status": "completed", "tag": "841d5cd2-6ca1-435c-ac29-bfeee122d7fe"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:46:43.965564 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-7a973634-8e6a-4b65-8aed-e57124a686a6 req-9e04ae1f-fed0-4c06-95fe-7f659ea3517f service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:43.968046 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-7a973634-8e6a-4b65-8aed-e57124a686a6 req-9e04ae1f-fed0-4c06-95fe-7f659ea3517f service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:43.969395 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-7a973634-8e6a-4b65-8aed-e57124a686a6 req-9e04ae1f-fed0-4c06-95fe-7f659ea3517f service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:44.036867 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-7a973634-8e6a-4b65-8aed-e57124a686a6 req-9e04ae1f-fed0-4c06-95fe-7f659ea3517f service nova] Creating event network-vif-plugged:841d5cd2-6ca1-435c-ac29-bfeee122d7fe for instance 5ef00d34-7f81-4649-a90a-a52cf78dbeca on n-h1-854247-14 Oct 17 13:46:44.061471 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-7a973634-8e6a-4b65-8aed-e57124a686a6 req-9e04ae1f-fed0-4c06-95fe-7f659ea3517f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162886 Oct 17 13:46:44.065511 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1487/2986] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:46:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:46:44.083600 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f4ad1427-18d5-4b8c-8ee9-9b342f233e85 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:44.086189 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f4ad1427-18d5-4b8c-8ee9-9b342f233e85 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9d1105b3-be41-4963-a86b-6f4486d1d382] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:44.120513 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f4ad1427-18d5-4b8c-8ee9-9b342f233e85 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:44.122235 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f4ad1427-18d5-4b8c-8ee9-9b342f233e85 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:44.122683 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f4ad1427-18d5-4b8c-8ee9-9b342f233e85 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:44.125967 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f4ad1427-18d5-4b8c-8ee9-9b342f233e85 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:44.126446 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f4ad1427-18d5-4b8c-8ee9-9b342f233e85 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:44.128956 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f4ad1427-18d5-4b8c-8ee9-9b342f233e85 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:44.169691 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a199b327-5b33-4808-aee8-2409044d436c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:44.183745 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a199b327-5b33-4808-aee8-2409044d436c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1528 microversion: 2.1 time: 1.062809 Oct 17 13:46:44.188519 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1500/2987] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:43 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1528 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:46:44.198282 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-83d26b09-22ec-474c-9def-ddc74975c550 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:44.216732 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-83d26b09-22ec-474c-9def-ddc74975c550 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] [instance: 29fb8b41-6dcb-49f2-9e1c-11719cace5d9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:44.242110 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-83d26b09-22ec-474c-9def-ddc74975c550 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:44.242629 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-83d26b09-22ec-474c-9def-ddc74975c550 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:44.246084 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-83d26b09-22ec-474c-9def-ddc74975c550 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:44.246883 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-83d26b09-22ec-474c-9def-ddc74975c550 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:44.247397 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-83d26b09-22ec-474c-9def-ddc74975c550 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:44.247834 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-83d26b09-22ec-474c-9def-ddc74975c550 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:45.112674 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f4ad1427-18d5-4b8c-8ee9-9b342f233e85 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:45.123266 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f4ad1427-18d5-4b8c-8ee9-9b342f233e85 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382" status: 200 len: 1471 microversion: 2.1 time: 1.056639 Oct 17 13:46:45.134831 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-83d26b09-22ec-474c-9def-ddc74975c550 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a3472f83914990ad41f037b4aafd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f91db965084796a4a3dce1b4e921e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:45.147255 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1488/2988] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:44 2022] GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382 => generated 1471 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:45.159918 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-83d26b09-22ec-474c-9def-ddc74975c550 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] 10.222.0.79 "GET /compute/v2.1/servers/29fb8b41-6dcb-49f2-9e1c-11719cace5d9" status: 200 len: 1323 microversion: 2.1 time: 0.966851 Oct 17 13:46:45.160872 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1501/2989] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:44 2022] GET /compute/v2.1/servers/29fb8b41-6dcb-49f2-9e1c-11719cace5d9 => generated 1323 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:45.170997 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-970ca988-dea6-4469-b5f0-b711df34a072 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:45.176457 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-970ca988-dea6-4469-b5f0-b711df34a072 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] [instance: ecd07fc5-cb11-4e4c-bc7f-5f591eca4597] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:45.192790 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-970ca988-dea6-4469-b5f0-b711df34a072 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:45.194330 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-970ca988-dea6-4469-b5f0-b711df34a072 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:45.196148 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-970ca988-dea6-4469-b5f0-b711df34a072 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:45.197388 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-970ca988-dea6-4469-b5f0-b711df34a072 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:45.198951 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-970ca988-dea6-4469-b5f0-b711df34a072 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:45.202135 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-970ca988-dea6-4469-b5f0-b711df34a072 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:45.215107 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e4cad509-7aab-41e4-b76d-6aaf8f03f53d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:45.216585 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e4cad509-7aab-41e4-b76d-6aaf8f03f53d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:45.237452 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e4cad509-7aab-41e4-b76d-6aaf8f03f53d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:45.241378 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e4cad509-7aab-41e4-b76d-6aaf8f03f53d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:45.244962 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e4cad509-7aab-41e4-b76d-6aaf8f03f53d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:45.247697 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e4cad509-7aab-41e4-b76d-6aaf8f03f53d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:45.252326 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e4cad509-7aab-41e4-b76d-6aaf8f03f53d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:45.253717 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e4cad509-7aab-41e4-b76d-6aaf8f03f53d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:45.951114 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e4cad509-7aab-41e4-b76d-6aaf8f03f53d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:45.960455 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e4cad509-7aab-41e4-b76d-6aaf8f03f53d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1528 microversion: 2.1 time: 0.750042 Oct 17 13:46:45.972953 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1502/2990] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:45 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1528 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:46:45.991040 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-970ca988-dea6-4469-b5f0-b711df34a072 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6898fd7e18d3404a982b998171f8f7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0ffd0b1b764825826ab82cfbbe23e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:46.014782 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-970ca988-dea6-4469-b5f0-b711df34a072 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] 10.222.0.79 "GET /compute/v2.1/servers/ecd07fc5-cb11-4e4c-bc7f-5f591eca4597" status: 200 len: 1313 microversion: 2.1 time: 0.857212 Oct 17 13:46:46.030083 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1489/2991] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:45 2022] GET /compute/v2.1/servers/ecd07fc5-cb11-4e4c-bc7f-5f591eca4597 => generated 1313 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:46.143950 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-61fd7b2a-4b08-4c43-a0eb-384f2b1f14d7 req-ee82186e-fa7c-4646-b628-5cdcf8eab58f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecd07fc5-cb11-4e4c-bc7f-5f591eca4597", "name": "network-vif-plugged", "status": "completed", "tag": "ce4b0109-2d0f-4ce6-9073-08b0afa38259"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:46:46.176281 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-61fd7b2a-4b08-4c43-a0eb-384f2b1f14d7 req-ee82186e-fa7c-4646-b628-5cdcf8eab58f service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:46.176803 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-61fd7b2a-4b08-4c43-a0eb-384f2b1f14d7 req-ee82186e-fa7c-4646-b628-5cdcf8eab58f service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:46.177245 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-61fd7b2a-4b08-4c43-a0eb-384f2b1f14d7 req-ee82186e-fa7c-4646-b628-5cdcf8eab58f service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:46.181454 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-58303627-1eb8-4889-ac94-f0de9caac970 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:46.182111 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-58303627-1eb8-4889-ac94-f0de9caac970 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9d1105b3-be41-4963-a86b-6f4486d1d382] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:46.200403 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-58303627-1eb8-4889-ac94-f0de9caac970 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:46.200750 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-58303627-1eb8-4889-ac94-f0de9caac970 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:46.201196 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-58303627-1eb8-4889-ac94-f0de9caac970 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:46.201926 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-58303627-1eb8-4889-ac94-f0de9caac970 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:46.202371 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-58303627-1eb8-4889-ac94-f0de9caac970 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:46.202895 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-58303627-1eb8-4889-ac94-f0de9caac970 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:46.237065 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-61fd7b2a-4b08-4c43-a0eb-384f2b1f14d7 req-ee82186e-fa7c-4646-b628-5cdcf8eab58f service nova] Creating event network-vif-plugged:ce4b0109-2d0f-4ce6-9073-08b0afa38259 for instance ecd07fc5-cb11-4e4c-bc7f-5f591eca4597 on n-h2-854247-14 Oct 17 13:46:46.256016 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-61fd7b2a-4b08-4c43-a0eb-384f2b1f14d7 req-ee82186e-fa7c-4646-b628-5cdcf8eab58f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112854 Oct 17 13:46:46.265038 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1503/2992] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:46:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:46:46.280570 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7d379b7d-6be1-4939-ae7b-9a6caa1501eb tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:46.282077 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7d379b7d-6be1-4939-ae7b-9a6caa1501eb tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] [instance: 29fb8b41-6dcb-49f2-9e1c-11719cace5d9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:46.298786 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7d379b7d-6be1-4939-ae7b-9a6caa1501eb tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:46.301811 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7d379b7d-6be1-4939-ae7b-9a6caa1501eb tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:46.302563 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7d379b7d-6be1-4939-ae7b-9a6caa1501eb tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:46.303621 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7d379b7d-6be1-4939-ae7b-9a6caa1501eb tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:46.307709 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7d379b7d-6be1-4939-ae7b-9a6caa1501eb tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:46.308405 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7d379b7d-6be1-4939-ae7b-9a6caa1501eb tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:46.849279 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7d379b7d-6be1-4939-ae7b-9a6caa1501eb tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a3472f83914990ad41f037b4aafd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f91db965084796a4a3dce1b4e921e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:46.858087 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7d379b7d-6be1-4939-ae7b-9a6caa1501eb tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] 10.222.0.79 "GET /compute/v2.1/servers/29fb8b41-6dcb-49f2-9e1c-11719cace5d9" status: 200 len: 1323 microversion: 2.1 time: 0.588407 Oct 17 13:46:46.869657 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1504/2993] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:46 2022] GET /compute/v2.1/servers/29fb8b41-6dcb-49f2-9e1c-11719cace5d9 => generated 1323 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:46.886840 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-58303627-1eb8-4889-ac94-f0de9caac970 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:46.895954 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-58303627-1eb8-4889-ac94-f0de9caac970 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382" status: 200 len: 1476 microversion: 2.1 time: 0.726243 Oct 17 13:46:46.899874 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1490/2994] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:46 2022] GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382 => generated 1476 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:46:46.998660 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-192422c2-946e-4163-9b6f-c26e277a0374 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:46.999616 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-192422c2-946e-4163-9b6f-c26e277a0374 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:47.013798 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-192422c2-946e-4163-9b6f-c26e277a0374 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:47.020187 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-192422c2-946e-4163-9b6f-c26e277a0374 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:47.020778 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-192422c2-946e-4163-9b6f-c26e277a0374 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:47.021613 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-192422c2-946e-4163-9b6f-c26e277a0374 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:47.022292 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-192422c2-946e-4163-9b6f-c26e277a0374 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:47.022916 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-192422c2-946e-4163-9b6f-c26e277a0374 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:47.050353 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8177de8f-7588-41a0-a4bc-250584b458ce tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:47.051343 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8177de8f-7588-41a0-a4bc-250584b458ce tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] [instance: ecd07fc5-cb11-4e4c-bc7f-5f591eca4597] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:47.064468 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8177de8f-7588-41a0-a4bc-250584b458ce tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:47.065406 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8177de8f-7588-41a0-a4bc-250584b458ce tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:47.066343 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8177de8f-7588-41a0-a4bc-250584b458ce tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:47.068777 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8177de8f-7588-41a0-a4bc-250584b458ce tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:47.069797 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8177de8f-7588-41a0-a4bc-250584b458ce tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:47.070997 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8177de8f-7588-41a0-a4bc-250584b458ce tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:47.684150 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8177de8f-7588-41a0-a4bc-250584b458ce tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6898fd7e18d3404a982b998171f8f7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0ffd0b1b764825826ab82cfbbe23e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:47.697232 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8177de8f-7588-41a0-a4bc-250584b458ce tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] 10.222.0.79 "GET /compute/v2.1/servers/ecd07fc5-cb11-4e4c-bc7f-5f591eca4597" status: 200 len: 1313 microversion: 2.1 time: 0.654946 Oct 17 13:46:47.699208 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1491/2995] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:47 2022] GET /compute/v2.1/servers/ecd07fc5-cb11-4e4c-bc7f-5f591eca4597 => generated 1313 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:47.720639 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-192422c2-946e-4163-9b6f-c26e277a0374 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:47.743826 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-192422c2-946e-4163-9b6f-c26e277a0374 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1528 microversion: 2.1 time: 0.747452 Oct 17 13:46:47.746796 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1505/2996] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:46 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1528 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:47.907311 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5d21a7f3-c817-48bf-958e-d9f475d1980e tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:47.910026 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5d21a7f3-c817-48bf-958e-d9f475d1980e tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] [instance: 29fb8b41-6dcb-49f2-9e1c-11719cace5d9] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:47.928492 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2107ec01-0e11-40a2-b4c3-a4b1046d3b8b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:47.929172 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2107ec01-0e11-40a2-b4c3-a4b1046d3b8b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9d1105b3-be41-4963-a86b-6f4486d1d382] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:47.951648 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5d21a7f3-c817-48bf-958e-d9f475d1980e tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:47.956050 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5d21a7f3-c817-48bf-958e-d9f475d1980e tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:47.958051 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2107ec01-0e11-40a2-b4c3-a4b1046d3b8b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:47.958622 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2107ec01-0e11-40a2-b4c3-a4b1046d3b8b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:47.960232 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5d21a7f3-c817-48bf-958e-d9f475d1980e tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:47.961674 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2107ec01-0e11-40a2-b4c3-a4b1046d3b8b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:47.964568 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2107ec01-0e11-40a2-b4c3-a4b1046d3b8b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:47.968055 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5d21a7f3-c817-48bf-958e-d9f475d1980e tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:47.970680 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5d21a7f3-c817-48bf-958e-d9f475d1980e tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:47.971383 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5d21a7f3-c817-48bf-958e-d9f475d1980e tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:47.972002 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2107ec01-0e11-40a2-b4c3-a4b1046d3b8b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:47.972520 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2107ec01-0e11-40a2-b4c3-a4b1046d3b8b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:48.344696 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5d21a7f3-c817-48bf-958e-d9f475d1980e tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a3472f83914990ad41f037b4aafd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f91db965084796a4a3dce1b4e921e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:48.356754 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5d21a7f3-c817-48bf-958e-d9f475d1980e tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] 10.222.0.79 "GET /compute/v2.1/servers/29fb8b41-6dcb-49f2-9e1c-11719cace5d9" status: 200 len: 1323 microversion: 2.1 time: 0.464767 Oct 17 13:46:48.373567 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1492/2997] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:47 2022] GET /compute/v2.1/servers/29fb8b41-6dcb-49f2-9e1c-11719cace5d9 => generated 1323 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:48.457113 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2107ec01-0e11-40a2-b4c3-a4b1046d3b8b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:48.469542 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2107ec01-0e11-40a2-b4c3-a4b1046d3b8b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382" status: 200 len: 1476 microversion: 2.1 time: 0.544870 Oct 17 13:46:48.470751 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1506/2998] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:47 2022] GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382 => generated 1476 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:46:48.728082 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b7f3078e-9014-44cd-90b3-5d3d46562b80 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:48.728897 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b7f3078e-9014-44cd-90b3-5d3d46562b80 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] [instance: ecd07fc5-cb11-4e4c-bc7f-5f591eca4597] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:48.751321 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b7f3078e-9014-44cd-90b3-5d3d46562b80 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:48.757518 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b7f3078e-9014-44cd-90b3-5d3d46562b80 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:48.759437 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b7f3078e-9014-44cd-90b3-5d3d46562b80 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:48.763320 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b7f3078e-9014-44cd-90b3-5d3d46562b80 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:48.766948 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b7f3078e-9014-44cd-90b3-5d3d46562b80 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:48.768179 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b7f3078e-9014-44cd-90b3-5d3d46562b80 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:48.772195 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-174fda90-e5b1-4702-9fed-30d57da2380c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:48.772823 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-174fda90-e5b1-4702-9fed-30d57da2380c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:48.804944 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-174fda90-e5b1-4702-9fed-30d57da2380c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:48.805450 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-174fda90-e5b1-4702-9fed-30d57da2380c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:48.805894 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-174fda90-e5b1-4702-9fed-30d57da2380c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:48.808572 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-174fda90-e5b1-4702-9fed-30d57da2380c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:48.809957 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-174fda90-e5b1-4702-9fed-30d57da2380c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:48.812278 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-174fda90-e5b1-4702-9fed-30d57da2380c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:49.205759 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b7f3078e-9014-44cd-90b3-5d3d46562b80 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6898fd7e18d3404a982b998171f8f7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0ffd0b1b764825826ab82cfbbe23e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:49.217478 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b7f3078e-9014-44cd-90b3-5d3d46562b80 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] 10.222.0.79 "GET /compute/v2.1/servers/ecd07fc5-cb11-4e4c-bc7f-5f591eca4597" status: 200 len: 1497 microversion: 2.1 time: 0.493939 Oct 17 13:46:49.225697 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1493/2999] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:48 2022] GET /compute/v2.1/servers/ecd07fc5-cb11-4e4c-bc7f-5f591eca4597 => generated 1497 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:49.248172 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4d9272dc-27d0-4776-a129-be8a8b1d1559 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:49.253553 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-174fda90-e5b1-4702-9fed-30d57da2380c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:49.265535 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-174fda90-e5b1-4702-9fed-30d57da2380c tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1528 microversion: 2.1 time: 0.498105 Oct 17 13:46:49.279261 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1507/3000] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:48 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1528 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:49.325035 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.compute.server_groups [None req-4d9272dc-27d0-4776-a129-be8a8b1d1559 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Querying cell 23debefa-f967-4de1-8ea3-1fa7cc16392a(cell1) for 1 instances {{(pid=127017) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 17 13:46:49.325772 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4d9272dc-27d0-4776-a129-be8a8b1d1559 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:49.326262 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4d9272dc-27d0-4776-a129-be8a8b1d1559 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:49.326684 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4d9272dc-27d0-4776-a129-be8a8b1d1559 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:49.394249 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3aeba8fa-8a18-47ba-96db-9a4d90eb27d8 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:49.395197 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3aeba8fa-8a18-47ba-96db-9a4d90eb27d8 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] [instance: 29fb8b41-6dcb-49f2-9e1c-11719cace5d9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:49.395511 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4d9272dc-27d0-4776-a129-be8a8b1d1559 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] 10.222.0.79 "GET /compute/v2.1/os-server-groups/3c4c75ab-df90-4892-8eb8-1681a8a3f288" status: 200 len: 222 microversion: 2.1 time: 0.151526 Oct 17 13:46:49.408151 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1494/3001] 10.222.0.79 () {58 vars in 1263 bytes} [Mon Oct 17 13:46:49 2022] GET /compute/v2.1/os-server-groups/3c4c75ab-df90-4892-8eb8-1681a8a3f288 => generated 222 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:46:49.409474 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3aeba8fa-8a18-47ba-96db-9a4d90eb27d8 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:49.409987 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3aeba8fa-8a18-47ba-96db-9a4d90eb27d8 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:49.419685 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ba9c13f9-9f4c-4dcb-b984-177db76027ac tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:49.421156 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ba9c13f9-9f4c-4dcb-b984-177db76027ac tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] [instance: ecd07fc5-cb11-4e4c-bc7f-5f591eca4597] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:49.432608 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3aeba8fa-8a18-47ba-96db-9a4d90eb27d8 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:49.433503 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3aeba8fa-8a18-47ba-96db-9a4d90eb27d8 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:49.433995 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3aeba8fa-8a18-47ba-96db-9a4d90eb27d8 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:49.434430 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3aeba8fa-8a18-47ba-96db-9a4d90eb27d8 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:49.436824 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ba9c13f9-9f4c-4dcb-b984-177db76027ac tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:49.438600 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ba9c13f9-9f4c-4dcb-b984-177db76027ac tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:49.441768 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ba9c13f9-9f4c-4dcb-b984-177db76027ac tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:49.442701 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ba9c13f9-9f4c-4dcb-b984-177db76027ac tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:49.448030 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ba9c13f9-9f4c-4dcb-b984-177db76027ac tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:49.448865 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ba9c13f9-9f4c-4dcb-b984-177db76027ac tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:49.509649 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ba9c13f9-9f4c-4dcb-b984-177db76027ac tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] [instance: ecd07fc5-cb11-4e4c-bc7f-5f591eca4597] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:46:49.624505 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:46:49.697954 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ba9c13f9-9f4c-4dcb-b984-177db76027ac tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] 10.222.0.79 "DELETE /compute/v2.1/servers/ecd07fc5-cb11-4e4c-bc7f-5f591eca4597" status: 204 len: 0 microversion: 2.1 time: 0.285581 Oct 17 13:46:49.703974 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1495/3002] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:46:49 2022] DELETE /compute/v2.1/servers/ecd07fc5-cb11-4e4c-bc7f-5f591eca4597 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:46:49.718739 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c13253d9-25ec-438b-982a-9730d6c02e66 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:49.719876 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c13253d9-25ec-438b-982a-9730d6c02e66 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9d1105b3-be41-4963-a86b-6f4486d1d382] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:49.738230 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c13253d9-25ec-438b-982a-9730d6c02e66 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:49.738858 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c13253d9-25ec-438b-982a-9730d6c02e66 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:49.739053 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c13253d9-25ec-438b-982a-9730d6c02e66 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:49.749027 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c13253d9-25ec-438b-982a-9730d6c02e66 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:49.749956 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c13253d9-25ec-438b-982a-9730d6c02e66 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:49.750591 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c13253d9-25ec-438b-982a-9730d6c02e66 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:50.704844 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3aeba8fa-8a18-47ba-96db-9a4d90eb27d8 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a3472f83914990ad41f037b4aafd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f91db965084796a4a3dce1b4e921e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:50.736459 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3aeba8fa-8a18-47ba-96db-9a4d90eb27d8 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] 10.222.0.79 "GET /compute/v2.1/servers/29fb8b41-6dcb-49f2-9e1c-11719cace5d9" status: 200 len: 1323 microversion: 2.1 time: 1.346923 Oct 17 13:46:50.747767 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1508/3003] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:49 2022] GET /compute/v2.1/servers/29fb8b41-6dcb-49f2-9e1c-11719cace5d9 => generated 1323 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:50.775293 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c0473bd8-6abb-49f0-9cd4-03e558de0c6d tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:50.775937 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c0473bd8-6abb-49f0-9cd4-03e558de0c6d tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] [instance: ecd07fc5-cb11-4e4c-bc7f-5f591eca4597] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:50.797357 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c0473bd8-6abb-49f0-9cd4-03e558de0c6d tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:50.798030 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c0473bd8-6abb-49f0-9cd4-03e558de0c6d tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:50.798472 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c0473bd8-6abb-49f0-9cd4-03e558de0c6d tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:50.806432 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c0473bd8-6abb-49f0-9cd4-03e558de0c6d tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:50.807046 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c0473bd8-6abb-49f0-9cd4-03e558de0c6d tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:50.807544 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c0473bd8-6abb-49f0-9cd4-03e558de0c6d tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:50.913759 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c13253d9-25ec-438b-982a-9730d6c02e66 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:50.948623 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c13253d9-25ec-438b-982a-9730d6c02e66 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382" status: 200 len: 1476 microversion: 2.1 time: 1.240337 Oct 17 13:46:50.948738 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1496/3004] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:49 2022] GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382 => generated 1476 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:50.962016 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8fadaa25-256b-472c-953c-80b24f1a198b tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:50.962658 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8fadaa25-256b-472c-953c-80b24f1a198b tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:50.979754 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8fadaa25-256b-472c-953c-80b24f1a198b tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:50.980725 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8fadaa25-256b-472c-953c-80b24f1a198b tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:50.987961 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8fadaa25-256b-472c-953c-80b24f1a198b tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:50.990590 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8fadaa25-256b-472c-953c-80b24f1a198b tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:50.992045 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8fadaa25-256b-472c-953c-80b24f1a198b tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:50.993421 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8fadaa25-256b-472c-953c-80b24f1a198b tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:51.754902 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c0473bd8-6abb-49f0-9cd4-03e558de0c6d tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6898fd7e18d3404a982b998171f8f7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0ffd0b1b764825826ab82cfbbe23e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:51.755721 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8fadaa25-256b-472c-953c-80b24f1a198b tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:51.773446 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c0473bd8-6abb-49f0-9cd4-03e558de0c6d tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] 10.222.0.79 "GET /compute/v2.1/servers/ecd07fc5-cb11-4e4c-bc7f-5f591eca4597" status: 200 len: 1503 microversion: 2.1 time: 1.016952 Oct 17 13:46:51.774147 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1509/3005] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:50 2022] GET /compute/v2.1/servers/ecd07fc5-cb11-4e4c-bc7f-5f591eca4597 => generated 1503 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:51.775617 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8fadaa25-256b-472c-953c-80b24f1a198b tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1528 microversion: 2.1 time: 0.825733 Oct 17 13:46:51.776576 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1497/3006] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:50 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1528 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:51.786572 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-20a3a3f6-d6cd-442c-be1c-7ba63ba17a26 req-b6f3514e-63a0-4973-b040-e138fa7f1db1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29fb8b41-6dcb-49f2-9e1c-11719cace5d9", "name": "network-vif-plugged", "status": "completed", "tag": "9025275f-f4f7-42ab-bf78-e79c39398580"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:46:51.806756 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-debce6ec-ffc8-4c4e-8b97-0317378de61b tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:51.806756 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-debce6ec-ffc8-4c4e-8b97-0317378de61b tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] [instance: 29fb8b41-6dcb-49f2-9e1c-11719cace5d9] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:51.821446 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-20a3a3f6-d6cd-442c-be1c-7ba63ba17a26 req-b6f3514e-63a0-4973-b040-e138fa7f1db1 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:51.822290 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-20a3a3f6-d6cd-442c-be1c-7ba63ba17a26 req-b6f3514e-63a0-4973-b040-e138fa7f1db1 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:51.822903 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-20a3a3f6-d6cd-442c-be1c-7ba63ba17a26 req-b6f3514e-63a0-4973-b040-e138fa7f1db1 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:51.827040 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-debce6ec-ffc8-4c4e-8b97-0317378de61b tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:51.833826 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-debce6ec-ffc8-4c4e-8b97-0317378de61b tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:51.835110 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-debce6ec-ffc8-4c4e-8b97-0317378de61b tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:51.835923 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-debce6ec-ffc8-4c4e-8b97-0317378de61b tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:51.836405 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-debce6ec-ffc8-4c4e-8b97-0317378de61b tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:51.836862 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-debce6ec-ffc8-4c4e-8b97-0317378de61b tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:51.862491 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-20a3a3f6-d6cd-442c-be1c-7ba63ba17a26 req-b6f3514e-63a0-4973-b040-e138fa7f1db1 service nova] Creating event network-vif-plugged:9025275f-f4f7-42ab-bf78-e79c39398580 for instance 29fb8b41-6dcb-49f2-9e1c-11719cace5d9 on n-h1-854247-14 Oct 17 13:46:51.872953 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-20a3a3f6-d6cd-442c-be1c-7ba63ba17a26 req-b6f3514e-63a0-4973-b040-e138fa7f1db1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097537 Oct 17 13:46:51.875502 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1510/3007] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:46:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:46:51.980728 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c548ae4e-838b-4cda-a552-6e430ea898fc tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:51.981446 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c548ae4e-838b-4cda-a552-6e430ea898fc tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9d1105b3-be41-4963-a86b-6f4486d1d382] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:51.988818 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c548ae4e-838b-4cda-a552-6e430ea898fc tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:51.989562 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c548ae4e-838b-4cda-a552-6e430ea898fc tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:51.990186 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c548ae4e-838b-4cda-a552-6e430ea898fc tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:51.991063 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c548ae4e-838b-4cda-a552-6e430ea898fc tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:51.992608 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c548ae4e-838b-4cda-a552-6e430ea898fc tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:51.993210 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c548ae4e-838b-4cda-a552-6e430ea898fc tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:53.601740 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-debce6ec-ffc8-4c4e-8b97-0317378de61b tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a3472f83914990ad41f037b4aafd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f91db965084796a4a3dce1b4e921e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:53.605907 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c548ae4e-838b-4cda-a552-6e430ea898fc tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:53.644512 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c548ae4e-838b-4cda-a552-6e430ea898fc tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382" status: 200 len: 1476 microversion: 2.1 time: 1.666698 Oct 17 13:46:53.646877 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1511/3008] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:51 2022] GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382 => generated 1476 bytes in 1671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:46:53.649911 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c548ae4e-838b-4cda-a552-6e430ea898fc tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:53.651207 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-debce6ec-ffc8-4c4e-8b97-0317378de61b tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] 10.222.0.79 "GET /compute/v2.1/servers/29fb8b41-6dcb-49f2-9e1c-11719cace5d9" status: 200 len: 1323 microversion: 2.1 time: 1.871256 Oct 17 13:46:53.661607 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c548ae4e-838b-4cda-a552-6e430ea898fc tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute//" status: 200 len: 377 microversion: - time: 0.011877 Oct 17 13:46:53.662053 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1498/3009] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:51 2022] GET /compute/v2.1/servers/29fb8b41-6dcb-49f2-9e1c-11719cace5d9 => generated 1323 bytes in 1885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:53.667268 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1512/3010] 10.222.0.79 () {56 vars in 886 bytes} [Mon Oct 17 13:46:53 2022] GET /compute/ => generated 377 bytes in 19 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 17 13:46:53.705295 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e6882989-8907-430a-bc15-938f8c744203 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:53.708819 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-edf38412-7e11-492e-9f7a-7324aadf9a7d tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:53.711894 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e6882989-8907-430a-bc15-938f8c744203 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:53.716688 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-edf38412-7e11-492e-9f7a-7324aadf9a7d tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] [instance: ecd07fc5-cb11-4e4c-bc7f-5f591eca4597] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:53.730577 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e6882989-8907-430a-bc15-938f8c744203 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:53.735688 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-edf38412-7e11-492e-9f7a-7324aadf9a7d tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:53.738713 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-edf38412-7e11-492e-9f7a-7324aadf9a7d tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:53.739394 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-edf38412-7e11-492e-9f7a-7324aadf9a7d tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:53.740331 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-edf38412-7e11-492e-9f7a-7324aadf9a7d tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:53.742132 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e6882989-8907-430a-bc15-938f8c744203 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:53.742654 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-edf38412-7e11-492e-9f7a-7324aadf9a7d tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:53.743340 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-edf38412-7e11-492e-9f7a-7324aadf9a7d tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:53.745615 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e6882989-8907-430a-bc15-938f8c744203 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:53.746792 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e6882989-8907-430a-bc15-938f8c744203 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:53.749994 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e6882989-8907-430a-bc15-938f8c744203 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:53.753452 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e6882989-8907-430a-bc15-938f8c744203 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:53.997295 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-edf38412-7e11-492e-9f7a-7324aadf9a7d tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6898fd7e18d3404a982b998171f8f7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b0ffd0b1b764825826ab82cfbbe23e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:54.016430 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-edf38412-7e11-492e-9f7a-7324aadf9a7d tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] 10.222.0.79 "GET /compute/v2.1/servers/ecd07fc5-cb11-4e4c-bc7f-5f591eca4597" status: 200 len: 1461 microversion: 2.1 time: 0.345562 Oct 17 13:46:54.048565 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1513/3011] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:53 2022] GET /compute/v2.1/servers/ecd07fc5-cb11-4e4c-bc7f-5f591eca4597 => generated 1461 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:54.198448 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4193ed4f-80fa-470f-9219-9c484df55132 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-528727667", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "b0eb8f64-b53e-4a35-abe6-492b3b38de2e"}]}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:46:54.225726 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:46:54.634895 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e6882989-8907-430a-bc15-938f8c744203 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:54.643908 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e6882989-8907-430a-bc15-938f8c744203 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1528 microversion: 2.1 time: 0.978272 Oct 17 13:46:54.650847 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1499/3012] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:53 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1528 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:54.660502 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-604c1738-6f62-42c3-8165-dc90472d5da2 req-895250be-9667-4010-9d1d-64130b17c27d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecd07fc5-cb11-4e4c-bc7f-5f591eca4597", "name": "network-vif-deleted", "tag": "ce4b0109-2d0f-4ce6-9073-08b0afa38259"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:46:54.725107 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-604c1738-6f62-42c3-8165-dc90472d5da2 req-895250be-9667-4010-9d1d-64130b17c27d service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:54.729630 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-604c1738-6f62-42c3-8165-dc90472d5da2 req-895250be-9667-4010-9d1d-64130b17c27d service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:54.731069 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-604c1738-6f62-42c3-8165-dc90472d5da2 req-895250be-9667-4010-9d1d-64130b17c27d service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:54.772282 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-604c1738-6f62-42c3-8165-dc90472d5da2 req-895250be-9667-4010-9d1d-64130b17c27d service nova] Creating event network-vif-deleted:ce4b0109-2d0f-4ce6-9073-08b0afa38259 for instance ecd07fc5-cb11-4e4c-bc7f-5f591eca4597 on n-h2-854247-14 Oct 17 13:46:54.788024 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-604c1738-6f62-42c3-8165-dc90472d5da2 req-895250be-9667-4010-9d1d-64130b17c27d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132817 Oct 17 13:46:54.790803 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1500/3013] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:46:54.820564 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b73404a5-8b0b-4a17-b533-6626c186e354 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:54.824163 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b73404a5-8b0b-4a17-b533-6626c186e354 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9d1105b3-be41-4963-a86b-6f4486d1d382] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:54.849915 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b73404a5-8b0b-4a17-b533-6626c186e354 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:54.850804 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b73404a5-8b0b-4a17-b533-6626c186e354 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:54.851911 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b73404a5-8b0b-4a17-b533-6626c186e354 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:54.856148 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b73404a5-8b0b-4a17-b533-6626c186e354 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:54.856939 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b73404a5-8b0b-4a17-b533-6626c186e354 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:54.857606 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b73404a5-8b0b-4a17-b533-6626c186e354 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:55.666783 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b73404a5-8b0b-4a17-b533-6626c186e354 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:55.749627 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b73404a5-8b0b-4a17-b533-6626c186e354 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382" status: 200 len: 1476 microversion: 2.1 time: 0.955503 Oct 17 13:46:55.786015 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1501/3014] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:54 2022] GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382 => generated 1476 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:55.812818 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2a29dbfa-0421-4771-9fa7-d71f590b4811 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:55.815848 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2a29dbfa-0421-4771-9fa7-d71f590b4811 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] [instance: 29fb8b41-6dcb-49f2-9e1c-11719cace5d9] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:55.857524 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2a29dbfa-0421-4771-9fa7-d71f590b4811 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:55.859854 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2a29dbfa-0421-4771-9fa7-d71f590b4811 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:55.862285 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2a29dbfa-0421-4771-9fa7-d71f590b4811 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:55.871569 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2a29dbfa-0421-4771-9fa7-d71f590b4811 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:55.874356 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2a29dbfa-0421-4771-9fa7-d71f590b4811 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:55.884774 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2a29dbfa-0421-4771-9fa7-d71f590b4811 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:56.477669 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2a29dbfa-0421-4771-9fa7-d71f590b4811 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a3472f83914990ad41f037b4aafd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f91db965084796a4a3dce1b4e921e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:56.503227 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2a29dbfa-0421-4771-9fa7-d71f590b4811 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] 10.222.0.79 "GET /compute/v2.1/servers/29fb8b41-6dcb-49f2-9e1c-11719cace5d9" status: 200 len: 1519 microversion: 2.1 time: 0.713203 Oct 17 13:46:56.506968 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1502/3015] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:55 2022] GET /compute/v2.1/servers/29fb8b41-6dcb-49f2-9e1c-11719cace5d9 => generated 1519 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:56.526960 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0117a2d6-2f2e-4bb2-9b85-c599f098593f tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:56.533188 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0117a2d6-2f2e-4bb2-9b85-c599f098593f tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] [instance: ecd07fc5-cb11-4e4c-bc7f-5f591eca4597] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:56.587935 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0117a2d6-2f2e-4bb2-9b85-c599f098593f tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:56.593769 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0117a2d6-2f2e-4bb2-9b85-c599f098593f tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:56.596789 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0117a2d6-2f2e-4bb2-9b85-c599f098593f tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:56.603748 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0117a2d6-2f2e-4bb2-9b85-c599f098593f tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:56.605387 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0117a2d6-2f2e-4bb2-9b85-c599f098593f tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:56.606387 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0117a2d6-2f2e-4bb2-9b85-c599f098593f tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:56.657021 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-0117a2d6-2f2e-4bb2-9b85-c599f098593f tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] HTTP exception thrown: Instance ecd07fc5-cb11-4e4c-bc7f-5f591eca4597 could not be found. Oct 17 13:46:56.660487 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0117a2d6-2f2e-4bb2-9b85-c599f098593f tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Request method failure captured: Oct 17 13:46:56.660487 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/ecd07fc5-cb11-4e4c-bc7f-5f591eca4597 HTTP/1.1 Oct 17 13:46:56.660487 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:46:56.660487 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:46:56.660487 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:46:56.660487 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:46:56.660487 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:46:56.660487 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:46:56.660487 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:46:56.660487 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:46:56.660487 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVygGytS7RYUBUVn3Rrvb2xnZ2JVPZZnzAawDOw-DTOZuqE65rCrih7KtbRaMEMxdN2tci0436V9n0yOLMeK5_ZMkEV18BoYzyDPLHyLRHxHFxMi6AwgI2tRUBu0d0oYZczNNcWc1wER3vT5_LS-BXeps-Op-rs2ERrXH_6LMwnq-aE Oct 17 13:46:56.660487 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:46:56.660487 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:46:56.660487 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:46:56.660487 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:46:56.660487 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:46:56.660487 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:46:56.660487 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 9b0ffd0b1b764825826ab82cfbbe23e5 Oct 17 13:46:56.660487 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServerGroupTestJSON-1646380418 Oct 17 13:46:56.660487 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:46:56.660487 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:46:56.660487 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9b0ffd0b1b764825826ab82cfbbe23e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/9b0ffd0b1b764825826ab82cfbbe23e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9b0ffd0b1b764825826ab82cfbbe23e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_9b0ffd0b1b764825826ab82cfbbe23e5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:46:56.660487 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServerGroupTestJSON-1646380418 Oct 17 13:46:56.660487 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 9b0ffd0b1b764825826ab82cfbbe23e5 Oct 17 13:46:56.660487 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServerGroupTestJSON-1646380418 Oct 17 13:46:56.660487 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServerGroupTestJSON-1646380418-project Oct 17 13:46:56.660487 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:46:56.660487 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:46:56.660487 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 6898fd7e18d3404a982b998171f8f7fc Oct 17 13:46:56.660487 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServerGroupTestJSON-1646380418-project Oct 17 13:46:56.660487 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:46:56.660487 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance ecd07fc5-cb11-4e4c-bc7f-5f591eca4597 could not be found. Oct 17 13:46:56.660487 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'ecd07fc5-cb11-4e4c-bc7f-5f591eca4597'} Oct 17 13:46:56.660487 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:46:56.660487 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:46:56.660487 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:46:56.660487 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:46:56.660487 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:46:56.660487 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:46:56.660487 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:46:56.660487 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:46:56.660487 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:46:56.660487 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:46:56.660487 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecd07fc5-cb11-4e4c-bc7f-5f591eca4597 could not be found. Oct 17 13:46:56.660487 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:46:56.660487 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:46:56.660487 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:46:56.660487 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:46:56.660487 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:46:56.660487 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:46:56.660487 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:46:56.660487 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:46:56.660487 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:46:56.660487 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:46:56.660487 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:46:56.660487 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:46:56.660487 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:46:56.660487 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:46:56.660487 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:46:56.660487 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:46:56.660487 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecd07fc5-cb11-4e4c-bc7f-5f591eca4597 could not be found. Oct 17 13:46:56.660487 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:46:56.660487 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:46:56.660487 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:46:56.666232 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:46:56.666232 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:46:56.666232 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:46:56.666232 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:46:56.666232 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:46:56.666232 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecd07fc5-cb11-4e4c-bc7f-5f591eca4597 could not be found. Oct 17 13:46:56.666232 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:46:56.672222 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0117a2d6-2f2e-4bb2-9b85-c599f098593f tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Returning 404 to user: Instance ecd07fc5-cb11-4e4c-bc7f-5f591eca4597 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:46:56.673983 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0117a2d6-2f2e-4bb2-9b85-c599f098593f tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] 10.222.0.79 "GET /compute/v2.1/servers/ecd07fc5-cb11-4e4c-bc7f-5f591eca4597" status: 404 len: 111 microversion: 2.1 time: 0.164699 Oct 17 13:46:56.674823 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1503/3016] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:56 2022] GET /compute/v2.1/servers/ecd07fc5-cb11-4e4c-bc7f-5f591eca4597 => generated 111 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:46:56.684596 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-244ec12a-a2e2-4729-93ef-9d178d60a0d0 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:56.694735 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-244ec12a-a2e2-4729-93ef-9d178d60a0d0 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:56.720413 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-244ec12a-a2e2-4729-93ef-9d178d60a0d0 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:56.720931 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-244ec12a-a2e2-4729-93ef-9d178d60a0d0 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:56.721432 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-244ec12a-a2e2-4729-93ef-9d178d60a0d0 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:56.722161 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-244ec12a-a2e2-4729-93ef-9d178d60a0d0 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:56.722615 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-244ec12a-a2e2-4729-93ef-9d178d60a0d0 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:56.723325 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-244ec12a-a2e2-4729-93ef-9d178d60a0d0 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:57.143522 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-244ec12a-a2e2-4729-93ef-9d178d60a0d0 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:57.153017 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-244ec12a-a2e2-4729-93ef-9d178d60a0d0 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1528 microversion: 2.1 time: 0.472264 Oct 17 13:46:57.153806 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1504/3017] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:56 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1528 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:57.183566 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-90640ad4-0321-4c19-9a94-068581c6cd03 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.0.129"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:46:57.193085 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-90640ad4-0321-4c19-9a94-068581c6cd03 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] [instance: 50e9eae9-df55-48ee-b984-e6b7e4bb2628] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:57.216594 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-90640ad4-0321-4c19-9a94-068581c6cd03 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:57.217616 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-90640ad4-0321-4c19-9a94-068581c6cd03 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:57.219927 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-90640ad4-0321-4c19-9a94-068581c6cd03 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:57.222051 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-90640ad4-0321-4c19-9a94-068581c6cd03 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:57.224973 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-90640ad4-0321-4c19-9a94-068581c6cd03 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:57.225913 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-90640ad4-0321-4c19-9a94-068581c6cd03 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:57.307578 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-90640ad4-0321-4c19-9a94-068581c6cd03 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "refresh_cache-50e9eae9-df55-48ee-b984-e6b7e4bb2628" {{(pid=127017) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 17 13:46:57.314656 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-90640ad4-0321-4c19-9a94-068581c6cd03 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquired lock "refresh_cache-50e9eae9-df55-48ee-b984-e6b7e4bb2628" {{(pid=127017) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 17 13:46:58.410224 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-4193ed4f-80fa-470f-9219-9c484df55132 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] validate_networks() for [('b0eb8f64-b53e-4a35-abe6-492b3b38de2e', None, None, None, None, None)] {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:46:59.816505 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-4193ed4f-80fa-470f-9219-9c484df55132 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:46:59.817810 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-4193ed4f-80fa-470f-9219-9c484df55132 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:46:59.818535 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-4193ed4f-80fa-470f-9219-9c484df55132 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:46:59.819536 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-4193ed4f-80fa-470f-9219-9c484df55132 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:46:59.820209 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-4193ed4f-80fa-470f-9219-9c484df55132 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:46:59.864447 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4193ed4f-80fa-470f-9219-9c484df55132 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:59.865365 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4193ed4f-80fa-470f-9219-9c484df55132 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:59.866053 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4193ed4f-80fa-470f-9219-9c484df55132 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:59.867074 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4193ed4f-80fa-470f-9219-9c484df55132 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:59.867824 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4193ed4f-80fa-470f-9219-9c484df55132 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:59.874095 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4193ed4f-80fa-470f-9219-9c484df55132 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:59.964039 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-4193ed4f-80fa-470f-9219-9c484df55132 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Getting quotas for project 04b218c7b78b4c89baaf0cf4cb9a5fc7. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:47:00.042070 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-4193ed4f-80fa-470f-9219-9c484df55132 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Getting quotas for user 14f234ed5b074fb5b2596aa3dd59882e and project 04b218c7b78b4c89baaf0cf4cb9a5fc7. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:47:00.066589 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4193ed4f-80fa-470f-9219-9c484df55132 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:47:00.068899 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4193ed4f-80fa-470f-9219-9c484df55132 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] [instance: 61ef701e-38b1-42a5-a604-89d2e3403033] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:47:00.230225 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-90640ad4-0321-4c19-9a94-068581c6cd03 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] [instance: 50e9eae9-df55-48ee-b984-e6b7e4bb2628] Building network info cache for instance {{(pid=127017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 17 13:47:00.244014 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4193ed4f-80fa-470f-9219-9c484df55132 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 6.194184 Oct 17 13:47:00.245251 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1514/3018] 10.222.0.79 () {62 vars in 1188 bytes} [Mon Oct 17 13:46:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 6196 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 13:47:00.250036 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-93154cdd-bfdc-4f10-b18a-58fc01b28507 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:00.301833 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.compute.server_groups [None req-93154cdd-bfdc-4f10-b18a-58fc01b28507 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Querying cell 23debefa-f967-4de1-8ea3-1fa7cc16392a(cell1) for 1 instances {{(pid=127016) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 17 13:47:00.305592 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-93154cdd-bfdc-4f10-b18a-58fc01b28507 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:00.306833 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-93154cdd-bfdc-4f10-b18a-58fc01b28507 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:00.308683 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-93154cdd-bfdc-4f10-b18a-58fc01b28507 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:00.376503 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-93154cdd-bfdc-4f10-b18a-58fc01b28507 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] 10.222.0.79 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.129873 Oct 17 13:47:00.377619 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1515/3019] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Oct 17 13:47:00 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:47:00.383002 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-18942022-e863-4db8-82d3-4665d46c039a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:00.387657 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-18942022-e863-4db8-82d3-4665d46c039a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9d1105b3-be41-4963-a86b-6f4486d1d382] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:00.402029 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-18942022-e863-4db8-82d3-4665d46c039a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:00.405227 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-18942022-e863-4db8-82d3-4665d46c039a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:00.405857 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-18942022-e863-4db8-82d3-4665d46c039a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:00.407277 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-18942022-e863-4db8-82d3-4665d46c039a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:00.418762 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-18942022-e863-4db8-82d3-4665d46c039a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:00.419232 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-18942022-e863-4db8-82d3-4665d46c039a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:01.066504 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-18942022-e863-4db8-82d3-4665d46c039a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:01.075410 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-18942022-e863-4db8-82d3-4665d46c039a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382" status: 200 len: 1476 microversion: 2.1 time: 0.695942 Oct 17 13:47:01.076012 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1516/3020] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:00 2022] GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382 => generated 1476 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:01.132410 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e920f05f-084d-4fff-a42a-e4dd070cf856 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:01.133040 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e920f05f-084d-4fff-a42a-e4dd070cf856 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:01.175230 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e920f05f-084d-4fff-a42a-e4dd070cf856 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:01.175745 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e920f05f-084d-4fff-a42a-e4dd070cf856 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:01.176181 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e920f05f-084d-4fff-a42a-e4dd070cf856 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:01.185813 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e920f05f-084d-4fff-a42a-e4dd070cf856 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:01.190031 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e920f05f-084d-4fff-a42a-e4dd070cf856 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:01.196044 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e920f05f-084d-4fff-a42a-e4dd070cf856 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:01.330673 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=100 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:47:02.972244 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e920f05f-084d-4fff-a42a-e4dd070cf856 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:02.981388 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e920f05f-084d-4fff-a42a-e4dd070cf856 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1528 microversion: 2.1 time: 1.871803 Oct 17 13:47:02.992891 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1517/3021] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:01 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1528 bytes in 1916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:03.015325 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-93481df4-9a9f-42e6-8d87-a10d0e075b4c req-f38a5f9e-5f3f-4de5-b12a-fe9902dd6b7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50e9eae9-df55-48ee-b984-e6b7e4bb2628", "tag": "be3444eb-9f99-422e-963d-086fa4da6881"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:47:03.050047 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-93481df4-9a9f-42e6-8d87-a10d0e075b4c req-f38a5f9e-5f3f-4de5-b12a-fe9902dd6b7e service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:03.050538 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-93481df4-9a9f-42e6-8d87-a10d0e075b4c req-f38a5f9e-5f3f-4de5-b12a-fe9902dd6b7e service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:03.050958 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-93481df4-9a9f-42e6-8d87-a10d0e075b4c req-f38a5f9e-5f3f-4de5-b12a-fe9902dd6b7e service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:03.120440 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-93481df4-9a9f-42e6-8d87-a10d0e075b4c req-f38a5f9e-5f3f-4de5-b12a-fe9902dd6b7e service nova] Creating event network-changed:be3444eb-9f99-422e-963d-086fa4da6881 for instance 50e9eae9-df55-48ee-b984-e6b7e4bb2628 on n-h1-854247-14 Oct 17 13:47:03.146647 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-93481df4-9a9f-42e6-8d87-a10d0e075b4c req-f38a5f9e-5f3f-4de5-b12a-fe9902dd6b7e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152275 Oct 17 13:47:03.156858 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1518/3022] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:47:03.165870 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d5fce4a6-f303-48bc-87ca-31f1add0d653 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:03.166581 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d5fce4a6-f303-48bc-87ca-31f1add0d653 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] [instance: 61ef701e-38b1-42a5-a604-89d2e3403033] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:03.203801 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d5fce4a6-f303-48bc-87ca-31f1add0d653 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:03.204301 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d5fce4a6-f303-48bc-87ca-31f1add0d653 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:03.204742 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d5fce4a6-f303-48bc-87ca-31f1add0d653 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:03.205463 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d5fce4a6-f303-48bc-87ca-31f1add0d653 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:03.205912 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d5fce4a6-f303-48bc-87ca-31f1add0d653 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:03.206329 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d5fce4a6-f303-48bc-87ca-31f1add0d653 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:03.784931 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-90640ad4-0321-4c19-9a94-068581c6cd03 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] [instance: 50e9eae9-df55-48ee-b984-e6b7e4bb2628] Updating instance_info_cache with network_info: [{"id": "be3444eb-9f99-422e-963d-086fa4da6881", "address": "fa:16:3e:29:e0:b5", "network": {"id": "78e524a2-ee09-4045-aff8-792bc0397f6e", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1866044046-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.0.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "18f91db965084796a4a3dce1b4e921e5", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapbe3444eb-9f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 17 13:47:03.816064 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-90640ad4-0321-4c19-9a94-068581c6cd03 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Releasing lock "refresh_cache-50e9eae9-df55-48ee-b984-e6b7e4bb2628" {{(pid=127017) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 17 13:47:03.816962 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-90640ad4-0321-4c19-9a94-068581c6cd03 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] 10.222.0.79 "POST /compute/v2.1/servers/50e9eae9-df55-48ee-b984-e6b7e4bb2628/action" status: 202 len: 0 microversion: 2.1 time: 6.650410 Oct 17 13:47:03.817964 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1505/3023] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:46:57 2022] POST /compute/v2.1/servers/50e9eae9-df55-48ee-b984-e6b7e4bb2628/action => generated 0 bytes in 6653 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 17 13:47:03.831560 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-65b30665-c6ca-4425-9885-680b3bea931b tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Action: 'create', calling method: .version_select at 0x7f7cd49acdc0>, body: {"keypair": {"name": "tempest-keypair-1338624573", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMGS8/72glMu57339mQ8/2kayHZ1Ghlifc+h26wmviAwsEmae55RWX/nPMZeJTzk+mkZoskgN60fOVNEd5w79yGKigm8r4ExQpAUkAaMrDv2+ixiK1GgWqRjoCS3a82Sow=="}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:47:03.841025 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:47:03.905511 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-65b30665-c6ca-4425-9885-680b3bea931b tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Getting quotas for project 114d3f1fdbf74c649b48882f8aa177f9. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:47:03.924995 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-65b30665-c6ca-4425-9885-680b3bea931b tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Getting quotas for user 5670d6402d734aa9b1200a337000839d and project 114d3f1fdbf74c649b48882f8aa177f9. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:47:03.995817 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-65b30665-c6ca-4425-9885-680b3bea931b tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.176686 Oct 17 13:47:03.997539 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1506/3024] 10.222.0.79 () {62 vars in 1200 bytes} [Mon Oct 17 13:47:03 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 179 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 17 13:47:04.002889 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-db4f6b95-393d-4c62-8b0e-3212ebc2c5c9 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:04.036491 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.compute.server_groups [None req-db4f6b95-393d-4c62-8b0e-3212ebc2c5c9 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Querying cell 23debefa-f967-4de1-8ea3-1fa7cc16392a(cell1) for 1 instances {{(pid=127017) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 17 13:47:04.042464 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d5fce4a6-f303-48bc-87ca-31f1add0d653 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f234ed5b074fb5b2596aa3dd59882e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04b218c7b78b4c89baaf0cf4cb9a5fc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:04.044340 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db4f6b95-393d-4c62-8b0e-3212ebc2c5c9 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:04.046861 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db4f6b95-393d-4c62-8b0e-3212ebc2c5c9 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:04.048074 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db4f6b95-393d-4c62-8b0e-3212ebc2c5c9 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:04.052980 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d5fce4a6-f303-48bc-87ca-31f1add0d653 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14f234ed5b074fb5b2596aa3dd59882e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04b218c7b78b4c89baaf0cf4cb9a5fc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:04.054465 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d5fce4a6-f303-48bc-87ca-31f1add0d653 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14f234ed5b074fb5b2596aa3dd59882e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04b218c7b78b4c89baaf0cf4cb9a5fc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:04.055695 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d5fce4a6-f303-48bc-87ca-31f1add0d653 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] 10.222.0.79 "GET /compute/v2.1/servers/61ef701e-38b1-42a5-a604-89d2e3403033" status: 200 len: 1316 microversion: 2.21 time: 0.897462 Oct 17 13:47:04.075734 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1519/3025] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:47:03 2022] GET /compute/v2.1/servers/61ef701e-38b1-42a5-a604-89d2e3403033 => generated 1316 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:47:04.081463 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cff3fe3d-de72-4d83-a2c0-fa5a154e15fd tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:04.082087 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cff3fe3d-de72-4d83-a2c0-fa5a154e15fd tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9d1105b3-be41-4963-a86b-6f4486d1d382] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:04.144399 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-db4f6b95-393d-4c62-8b0e-3212ebc2c5c9 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] 10.222.0.79 "GET /compute/v2.1/os-server-groups/3c4c75ab-df90-4892-8eb8-1681a8a3f288" status: 200 len: 184 microversion: 2.1 time: 0.088178 Oct 17 13:47:04.145827 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1507/3026] 10.222.0.79 () {58 vars in 1263 bytes} [Mon Oct 17 13:47:03 2022] GET /compute/v2.1/os-server-groups/3c4c75ab-df90-4892-8eb8-1681a8a3f288 => generated 184 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:47:04.172956 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cff3fe3d-de72-4d83-a2c0-fa5a154e15fd tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:04.175943 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bbd85551-7789-4584-9176-ff98df1e9729 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.0.129"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:47:04.185188 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-bbd85551-7789-4584-9176-ff98df1e9729 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] [instance: 29fb8b41-6dcb-49f2-9e1c-11719cace5d9] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:04.185389 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cff3fe3d-de72-4d83-a2c0-fa5a154e15fd tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:04.185855 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cff3fe3d-de72-4d83-a2c0-fa5a154e15fd tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:04.186673 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cff3fe3d-de72-4d83-a2c0-fa5a154e15fd tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:04.188484 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cff3fe3d-de72-4d83-a2c0-fa5a154e15fd tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:04.189243 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cff3fe3d-de72-4d83-a2c0-fa5a154e15fd tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:04.216548 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bbd85551-7789-4584-9176-ff98df1e9729 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:04.218288 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bbd85551-7789-4584-9176-ff98df1e9729 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:04.223433 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bbd85551-7789-4584-9176-ff98df1e9729 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:04.228573 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bbd85551-7789-4584-9176-ff98df1e9729 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:04.229206 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bbd85551-7789-4584-9176-ff98df1e9729 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:04.229750 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bbd85551-7789-4584-9176-ff98df1e9729 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:04.286410 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bbd85551-7789-4584-9176-ff98df1e9729 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "refresh_cache-29fb8b41-6dcb-49f2-9e1c-11719cace5d9" {{(pid=127017) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 17 13:47:04.286850 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bbd85551-7789-4584-9176-ff98df1e9729 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquired lock "refresh_cache-29fb8b41-6dcb-49f2-9e1c-11719cace5d9" {{(pid=127017) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 17 13:47:05.519326 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cff3fe3d-de72-4d83-a2c0-fa5a154e15fd tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:05.536317 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cff3fe3d-de72-4d83-a2c0-fa5a154e15fd tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382" status: 200 len: 1475 microversion: 2.1 time: 1.462857 Oct 17 13:47:05.537047 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1520/3027] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:04 2022] GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382 => generated 1475 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:05.551330 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-72b0e366-2409-4d79-87d0-58921f907f8a tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:05.554885 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-72b0e366-2409-4d79-87d0-58921f907f8a tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:05.569854 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-72b0e366-2409-4d79-87d0-58921f907f8a tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:05.574012 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-72b0e366-2409-4d79-87d0-58921f907f8a tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:05.577105 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-72b0e366-2409-4d79-87d0-58921f907f8a tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:05.581704 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-72b0e366-2409-4d79-87d0-58921f907f8a tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:05.582828 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-72b0e366-2409-4d79-87d0-58921f907f8a tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:05.584915 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-72b0e366-2409-4d79-87d0-58921f907f8a tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:06.627189 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-72b0e366-2409-4d79-87d0-58921f907f8a tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:06.643518 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-72b0e366-2409-4d79-87d0-58921f907f8a tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1528 microversion: 2.1 time: 1.102242 Oct 17 13:47:06.655707 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1521/3028] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:05 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1528 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:06.669254 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8c18df13-988f-420d-ac08-1c7051d6948a tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:06.670339 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8c18df13-988f-420d-ac08-1c7051d6948a tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] [instance: ecd07fc5-cb11-4e4c-bc7f-5f591eca4597] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:06.684436 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8c18df13-988f-420d-ac08-1c7051d6948a tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:06.686151 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8c18df13-988f-420d-ac08-1c7051d6948a tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:06.686800 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8c18df13-988f-420d-ac08-1c7051d6948a tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:06.691467 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8c18df13-988f-420d-ac08-1c7051d6948a tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:06.692581 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8c18df13-988f-420d-ac08-1c7051d6948a tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:06.693261 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8c18df13-988f-420d-ac08-1c7051d6948a tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:06.737039 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-8c18df13-988f-420d-ac08-1c7051d6948a tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] HTTP exception thrown: Instance ecd07fc5-cb11-4e4c-bc7f-5f591eca4597 could not be found. Oct 17 13:47:06.750318 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8c18df13-988f-420d-ac08-1c7051d6948a tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Request method failure captured: Oct 17 13:47:06.750318 n-d-854247-14 devstack@n-api.service[127016]: request: DELETE /compute/v2.1/servers/ecd07fc5-cb11-4e4c-bc7f-5f591eca4597 HTTP/1.1 Oct 17 13:47:06.750318 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:47:06.750318 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:47:06.750318 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:47:06.750318 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:47:06.750318 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:47:06.750318 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:47:06.750318 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:47:06.750318 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:47:06.750318 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVygGytS7RYUBUVn3Rrvb2xnZ2JVPZZnzAawDOw-DTOZuqE65rCrih7KtbRaMEMxdN2tci0436V9n0yOLMeK5_ZMkEV18BoYzyDPLHyLRHxHFxMi6AwgI2tRUBu0d0oYZczNNcWc1wER3vT5_LS-BXeps-Op-rs2ERrXH_6LMwnq-aE Oct 17 13:47:06.750318 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:47:06.750318 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:47:06.750318 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:47:06.750318 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:47:06.750318 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:47:06.750318 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:47:06.750318 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 9b0ffd0b1b764825826ab82cfbbe23e5 Oct 17 13:47:06.750318 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServerGroupTestJSON-1646380418 Oct 17 13:47:06.750318 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:47:06.750318 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:47:06.750318 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9b0ffd0b1b764825826ab82cfbbe23e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/9b0ffd0b1b764825826ab82cfbbe23e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9b0ffd0b1b764825826ab82cfbbe23e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_9b0ffd0b1b764825826ab82cfbbe23e5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:47:06.750318 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServerGroupTestJSON-1646380418 Oct 17 13:47:06.750318 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 9b0ffd0b1b764825826ab82cfbbe23e5 Oct 17 13:47:06.750318 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServerGroupTestJSON-1646380418 Oct 17 13:47:06.750318 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServerGroupTestJSON-1646380418-project Oct 17 13:47:06.750318 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:47:06.750318 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:47:06.750318 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 6898fd7e18d3404a982b998171f8f7fc Oct 17 13:47:06.750318 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServerGroupTestJSON-1646380418-project Oct 17 13:47:06.750318 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:47:06.750318 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance ecd07fc5-cb11-4e4c-bc7f-5f591eca4597 could not be found. Oct 17 13:47:06.750318 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'ecd07fc5-cb11-4e4c-bc7f-5f591eca4597'} Oct 17 13:47:06.750318 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:47:06.750318 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:06.750318 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:47:06.750318 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:47:06.750318 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:47:06.750318 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:47:06.750318 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:47:06.750318 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:47:06.750318 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:47:06.750318 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:47:06.750318 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecd07fc5-cb11-4e4c-bc7f-5f591eca4597 could not be found. Oct 17 13:47:06.750318 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:47:06.750318 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:47:06.750318 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:47:06.750318 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:06.750318 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:47:06.750318 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:47:06.750318 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:47:06.750318 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:47:06.750318 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:47:06.750318 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:47:06.750318 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:47:06.750318 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:47:06.750318 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:47:06.750318 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:47:06.750318 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:47:06.750318 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:47:06.750318 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:47:06.750318 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:47:06.754072 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecd07fc5-cb11-4e4c-bc7f-5f591eca4597 could not be found. Oct 17 13:47:06.754072 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:47:06.754072 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:47:06.754072 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:47:06.754072 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:06.754072 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:47:06.754072 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:47:06.754072 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:47:06.754072 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:47:06.754072 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecd07fc5-cb11-4e4c-bc7f-5f591eca4597 could not be found. Oct 17 13:47:06.754072 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:47:06.756380 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8c18df13-988f-420d-ac08-1c7051d6948a tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Returning 404 to user: Instance ecd07fc5-cb11-4e4c-bc7f-5f591eca4597 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:47:06.759364 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8c18df13-988f-420d-ac08-1c7051d6948a tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] 10.222.0.79 "DELETE /compute/v2.1/servers/ecd07fc5-cb11-4e4c-bc7f-5f591eca4597" status: 404 len: 111 microversion: 2.1 time: 0.102272 Oct 17 13:47:06.763704 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1522/3029] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:47:06 2022] DELETE /compute/v2.1/servers/ecd07fc5-cb11-4e4c-bc7f-5f591eca4597 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:47:06.777118 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9f94eaa2-717a-4eca-a4df-d04be6db76f5 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:06.778111 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9f94eaa2-717a-4eca-a4df-d04be6db76f5 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] [instance: 61ef701e-38b1-42a5-a604-89d2e3403033] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:06.796453 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9f94eaa2-717a-4eca-a4df-d04be6db76f5 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:06.799143 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9f94eaa2-717a-4eca-a4df-d04be6db76f5 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:06.799865 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9f94eaa2-717a-4eca-a4df-d04be6db76f5 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:06.801670 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9f94eaa2-717a-4eca-a4df-d04be6db76f5 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:06.802358 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9f94eaa2-717a-4eca-a4df-d04be6db76f5 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:06.803222 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9f94eaa2-717a-4eca-a4df-d04be6db76f5 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:07.522327 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9f94eaa2-717a-4eca-a4df-d04be6db76f5 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f234ed5b074fb5b2596aa3dd59882e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04b218c7b78b4c89baaf0cf4cb9a5fc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:07.533167 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9f94eaa2-717a-4eca-a4df-d04be6db76f5 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14f234ed5b074fb5b2596aa3dd59882e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04b218c7b78b4c89baaf0cf4cb9a5fc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:07.538866 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9f94eaa2-717a-4eca-a4df-d04be6db76f5 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14f234ed5b074fb5b2596aa3dd59882e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04b218c7b78b4c89baaf0cf4cb9a5fc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:07.549192 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9f94eaa2-717a-4eca-a4df-d04be6db76f5 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] 10.222.0.79 "GET /compute/v2.1/servers/61ef701e-38b1-42a5-a604-89d2e3403033" status: 200 len: 1358 microversion: 2.21 time: 0.783223 Oct 17 13:47:07.567085 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1523/3030] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:47:06 2022] GET /compute/v2.1/servers/61ef701e-38b1-42a5-a604-89d2e3403033 => generated 1358 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:47:07.580982 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-960f609d-d88f-4544-8ec6-685060dd6e15 req-613b346a-abbb-4fce-8aef-cff39793d054 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d1105b3-be41-4963-a86b-6f4486d1d382", "name": "network-vif-unplugged", "status": "completed", "tag": "6cb71ea7-7943-454e-82a0-31ed2ec43a1c"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:47:07.625628 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-960f609d-d88f-4544-8ec6-685060dd6e15 req-613b346a-abbb-4fce-8aef-cff39793d054 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:07.626383 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-960f609d-d88f-4544-8ec6-685060dd6e15 req-613b346a-abbb-4fce-8aef-cff39793d054 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:07.627680 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-960f609d-d88f-4544-8ec6-685060dd6e15 req-613b346a-abbb-4fce-8aef-cff39793d054 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:07.662755 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-960f609d-d88f-4544-8ec6-685060dd6e15 req-613b346a-abbb-4fce-8aef-cff39793d054 service nova] Creating event network-vif-unplugged:6cb71ea7-7943-454e-82a0-31ed2ec43a1c for instance 9d1105b3-be41-4963-a86b-6f4486d1d382 on n-h1-854247-14 Oct 17 13:47:07.693848 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [req-960f609d-d88f-4544-8ec6-685060dd6e15 req-613b346a-abbb-4fce-8aef-cff39793d054 service nova] Instance 9d1105b3-be41-4963-a86b-6f4486d1d382 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854247-14', 'n-h1-854247-14'} {{(pid=127016) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:47:07.719450 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-960f609d-d88f-4544-8ec6-685060dd6e15 req-613b346a-abbb-4fce-8aef-cff39793d054 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.150786 Oct 17 13:47:07.729683 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1524/3031] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:47:07.747830 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6ace687c-2e44-45b0-a9c1-265953fd488f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:07.748917 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6ace687c-2e44-45b0-a9c1-265953fd488f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9d1105b3-be41-4963-a86b-6f4486d1d382] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:07.757232 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6ace687c-2e44-45b0-a9c1-265953fd488f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:07.758104 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6ace687c-2e44-45b0-a9c1-265953fd488f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:07.758753 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6ace687c-2e44-45b0-a9c1-265953fd488f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:07.759718 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6ace687c-2e44-45b0-a9c1-265953fd488f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:07.760394 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6ace687c-2e44-45b0-a9c1-265953fd488f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:07.761032 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6ace687c-2e44-45b0-a9c1-265953fd488f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:08.436499 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6ace687c-2e44-45b0-a9c1-265953fd488f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:08.449732 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6ace687c-2e44-45b0-a9c1-265953fd488f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382" status: 200 len: 1475 microversion: 2.1 time: 0.718229 Oct 17 13:47:08.455403 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1525/3032] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:07 2022] GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382 => generated 1475 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:08.463125 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-52fcfd0d-95ea-427a-b1b0-59aaafeb22d5 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:08.464021 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-52fcfd0d-95ea-427a-b1b0-59aaafeb22d5 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] [instance: ecd07fc5-cb11-4e4c-bc7f-5f591eca4597] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:08.473114 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-52fcfd0d-95ea-427a-b1b0-59aaafeb22d5 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:08.474269 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-52fcfd0d-95ea-427a-b1b0-59aaafeb22d5 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:08.476175 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-52fcfd0d-95ea-427a-b1b0-59aaafeb22d5 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:08.477047 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-52fcfd0d-95ea-427a-b1b0-59aaafeb22d5 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:08.478838 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-52fcfd0d-95ea-427a-b1b0-59aaafeb22d5 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:08.479576 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-52fcfd0d-95ea-427a-b1b0-59aaafeb22d5 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:08.497759 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-52fcfd0d-95ea-427a-b1b0-59aaafeb22d5 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] HTTP exception thrown: Instance ecd07fc5-cb11-4e4c-bc7f-5f591eca4597 could not be found. Oct 17 13:47:08.500633 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-52fcfd0d-95ea-427a-b1b0-59aaafeb22d5 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Request method failure captured: Oct 17 13:47:08.500633 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/ecd07fc5-cb11-4e4c-bc7f-5f591eca4597 HTTP/1.1 Oct 17 13:47:08.500633 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:47:08.500633 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:47:08.500633 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:47:08.500633 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:47:08.500633 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:47:08.500633 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:47:08.500633 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:47:08.500633 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:47:08.500633 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVygGytS7RYUBUVn3Rrvb2xnZ2JVPZZnzAawDOw-DTOZuqE65rCrih7KtbRaMEMxdN2tci0436V9n0yOLMeK5_ZMkEV18BoYzyDPLHyLRHxHFxMi6AwgI2tRUBu0d0oYZczNNcWc1wER3vT5_LS-BXeps-Op-rs2ERrXH_6LMwnq-aE Oct 17 13:47:08.500633 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:47:08.500633 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:47:08.500633 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:47:08.500633 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:47:08.500633 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:47:08.500633 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:47:08.500633 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 9b0ffd0b1b764825826ab82cfbbe23e5 Oct 17 13:47:08.500633 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServerGroupTestJSON-1646380418 Oct 17 13:47:08.500633 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:47:08.500633 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:47:08.500633 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9b0ffd0b1b764825826ab82cfbbe23e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/9b0ffd0b1b764825826ab82cfbbe23e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9b0ffd0b1b764825826ab82cfbbe23e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_9b0ffd0b1b764825826ab82cfbbe23e5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:47:08.500633 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServerGroupTestJSON-1646380418 Oct 17 13:47:08.500633 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 9b0ffd0b1b764825826ab82cfbbe23e5 Oct 17 13:47:08.500633 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServerGroupTestJSON-1646380418 Oct 17 13:47:08.500633 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServerGroupTestJSON-1646380418-project Oct 17 13:47:08.500633 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:47:08.500633 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:47:08.500633 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 6898fd7e18d3404a982b998171f8f7fc Oct 17 13:47:08.500633 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServerGroupTestJSON-1646380418-project Oct 17 13:47:08.500633 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:47:08.500633 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance ecd07fc5-cb11-4e4c-bc7f-5f591eca4597 could not be found. Oct 17 13:47:08.500633 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'ecd07fc5-cb11-4e4c-bc7f-5f591eca4597'} Oct 17 13:47:08.500633 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:47:08.500633 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:08.500633 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:47:08.500633 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:47:08.500633 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:47:08.500633 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:47:08.500633 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:47:08.500633 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:47:08.500633 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:47:08.500633 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:47:08.500633 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecd07fc5-cb11-4e4c-bc7f-5f591eca4597 could not be found. Oct 17 13:47:08.500633 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:47:08.500633 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:47:08.500633 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:47:08.500633 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:08.500633 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:47:08.500633 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:47:08.500633 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:47:08.500633 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:47:08.500633 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:47:08.500633 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:47:08.500633 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:47:08.500633 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:47:08.500633 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:47:08.500633 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:47:08.500633 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:47:08.500633 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:47:08.500633 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecd07fc5-cb11-4e4c-bc7f-5f591eca4597 could not be found. Oct 17 13:47:08.500633 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:47:08.500633 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:47:08.500633 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:47:08.505300 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:08.505300 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:47:08.505300 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:47:08.505300 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:47:08.505300 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:47:08.505300 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecd07fc5-cb11-4e4c-bc7f-5f591eca4597 could not be found. Oct 17 13:47:08.505300 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:47:08.506861 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-52fcfd0d-95ea-427a-b1b0-59aaafeb22d5 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Returning 404 to user: Instance ecd07fc5-cb11-4e4c-bc7f-5f591eca4597 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:47:08.507913 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-52fcfd0d-95ea-427a-b1b0-59aaafeb22d5 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] 10.222.0.79 "GET /compute/v2.1/servers/ecd07fc5-cb11-4e4c-bc7f-5f591eca4597" status: 404 len: 111 microversion: 2.1 time: 0.051246 Oct 17 13:47:08.509839 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1526/3033] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:08 2022] GET /compute/v2.1/servers/ecd07fc5-cb11-4e4c-bc7f-5f591eca4597 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:47:08.515148 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9f764ca8-9fdf-4335-99cf-37e7597e8af4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:08.516069 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9f764ca8-9fdf-4335-99cf-37e7597e8af4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:08.523655 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9f764ca8-9fdf-4335-99cf-37e7597e8af4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:08.524622 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9f764ca8-9fdf-4335-99cf-37e7597e8af4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:08.525198 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9f764ca8-9fdf-4335-99cf-37e7597e8af4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:08.526043 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9f764ca8-9fdf-4335-99cf-37e7597e8af4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:08.529824 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9f764ca8-9fdf-4335-99cf-37e7597e8af4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:08.530865 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9f764ca8-9fdf-4335-99cf-37e7597e8af4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:09.636158 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9f764ca8-9fdf-4335-99cf-37e7597e8af4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:09.658182 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9f764ca8-9fdf-4335-99cf-37e7597e8af4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1528 microversion: 2.1 time: 1.146935 Oct 17 13:47:09.658780 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1527/3034] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:08 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1528 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:09.667983 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-699387c5-4f6b-45cc-b396-5b6badc8a2cc tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-389772696", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "b8b34d85-5d2d-4ee6-af19-a2004a9db830"}, {"port": "9c9d5dd0-a8f0-41f1-bc68-e9fb795e1870", "tag": "port-1"}, {"port": "2ed852ff-90cb-44a1-8401-734cba5bea03", "tag": "port-2"}, {"uuid": "fcfcb6d5-cc0a-4ed6-b878-b23bf49a0c30", "tag": "net-1"}, {"uuid": "fcfcb6d5-cc0a-4ed6-b878-b23bf49a0c30"}, {"uuid": "efaa2d4b-c90a-4468-b98a-e8421e0d69f4", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "efaa2d4b-c90a-4468-b98a-e8421e0d69f4", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "7f998ade-815c-4edf-b67b-18a7cf90dfbd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "d02cc9d9-5b75-4807-9bf4-d1a41dbf200c", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "0080a9b7-c75e-4321-985e-de205f808540", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1888968729"}], "key_name": "tempest-keypair-1338624573", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:47:09.910381 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:47:10.052027 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=6 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:47:10.156432 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-699387c5-4f6b-45cc-b396-5b6badc8a2cc tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] validate_networks() for [('b8b34d85-5d2d-4ee6-af19-a2004a9db830', None, None, None, None, None), (None, None, '9c9d5dd0-a8f0-41f1-bc68-e9fb795e1870', None, None, None), (None, None, '2ed852ff-90cb-44a1-8401-734cba5bea03', None, None, None), ('fcfcb6d5-cc0a-4ed6-b878-b23bf49a0c30', None, None, None, None, None), ('fcfcb6d5-cc0a-4ed6-b878-b23bf49a0c30', None, None, None, None, None), ('efaa2d4b-c90a-4468-b98a-e8421e0d69f4', '10.2.2.100', None, None, None, None), ('efaa2d4b-c90a-4468-b98a-e8421e0d69f4', '10.2.2.200', None, None, None, None)] {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:47:13.949924 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=4 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:47:14.205557 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=16,nova_api:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:47:14.270976 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=61,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:47:14.375016 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.network.neutron [None req-bbd85551-7789-4584-9176-ff98df1e9729 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] [instance: 29fb8b41-6dcb-49f2-9e1c-11719cace5d9] re-assign floating IP 172.25.0.129 from instance 50e9eae9-df55-48ee-b984-e6b7e4bb2628 Oct 17 13:47:14.465410 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-bbd85551-7789-4584-9176-ff98df1e9729 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] [instance: 50e9eae9-df55-48ee-b984-e6b7e4bb2628] Building network info cache for instance {{(pid=127017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 17 13:47:15.421577 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-bbd85551-7789-4584-9176-ff98df1e9729 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] [instance: 50e9eae9-df55-48ee-b984-e6b7e4bb2628] Updating instance_info_cache with network_info: [{"id": "be3444eb-9f99-422e-963d-086fa4da6881", "address": "fa:16:3e:29:e0:b5", "network": {"id": "78e524a2-ee09-4045-aff8-792bc0397f6e", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1866044046-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "18f91db965084796a4a3dce1b4e921e5", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapbe3444eb-9f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 17 13:47:15.461446 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-bbd85551-7789-4584-9176-ff98df1e9729 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] [instance: 29fb8b41-6dcb-49f2-9e1c-11719cace5d9] Building network info cache for instance {{(pid=127017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 17 13:47:16.613621 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-699387c5-4f6b-45cc-b396-5b6badc8a2cc tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:47:16.614891 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-699387c5-4f6b-45cc-b396-5b6badc8a2cc tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:47:16.615949 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-699387c5-4f6b-45cc-b396-5b6badc8a2cc tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:47:16.617508 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-699387c5-4f6b-45cc-b396-5b6badc8a2cc tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:47:16.618652 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-699387c5-4f6b-45cc-b396-5b6badc8a2cc tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:47:16.642041 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-699387c5-4f6b-45cc-b396-5b6badc8a2cc tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:16.644640 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-699387c5-4f6b-45cc-b396-5b6badc8a2cc tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:16.646261 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-699387c5-4f6b-45cc-b396-5b6badc8a2cc tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:16.647598 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-699387c5-4f6b-45cc-b396-5b6badc8a2cc tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:16.655945 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-699387c5-4f6b-45cc-b396-5b6badc8a2cc tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:16.657051 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-699387c5-4f6b-45cc-b396-5b6badc8a2cc tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:16.729051 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-699387c5-4f6b-45cc-b396-5b6badc8a2cc tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Getting quotas for project 114d3f1fdbf74c649b48882f8aa177f9. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:47:16.735403 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-699387c5-4f6b-45cc-b396-5b6badc8a2cc tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Getting quotas for user 5670d6402d734aa9b1200a337000839d and project 114d3f1fdbf74c649b48882f8aa177f9. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:47:16.965398 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-699387c5-4f6b-45cc-b396-5b6badc8a2cc tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:47:16.969417 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-699387c5-4f6b-45cc-b396-5b6badc8a2cc tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] [instance: 531b762d-db7e-4911-af50-6b321b7706bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='7f998ade-815c-4edf-b67b-18a7cf90dfbd',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='d02cc9d9-5b75-4807-9bf4-d1a41dbf200c',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0080a9b7-c75e-4321-985e-de205f808540',volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:47:17.094458 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-bbd85551-7789-4584-9176-ff98df1e9729 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] [instance: 29fb8b41-6dcb-49f2-9e1c-11719cace5d9] Updating instance_info_cache with network_info: [{"id": "9025275f-f4f7-42ab-bf78-e79c39398580", "address": "fa:16:3e:21:c6:ae", "network": {"id": "78e524a2-ee09-4045-aff8-792bc0397f6e", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1866044046-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.0.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "18f91db965084796a4a3dce1b4e921e5", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9025275f-f4", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 17 13:47:17.123346 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bbd85551-7789-4584-9176-ff98df1e9729 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Releasing lock "refresh_cache-29fb8b41-6dcb-49f2-9e1c-11719cace5d9" {{(pid=127017) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 17 13:47:17.124781 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-bbd85551-7789-4584-9176-ff98df1e9729 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] 10.222.0.79 "POST /compute/v2.1/servers/29fb8b41-6dcb-49f2-9e1c-11719cace5d9/action" status: 202 len: 0 microversion: 2.1 time: 12.967597 Oct 17 13:47:17.125790 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1508/3035] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:47:04 2022] POST /compute/v2.1/servers/29fb8b41-6dcb-49f2-9e1c-11719cace5d9/action => generated 0 bytes in 12969 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 17 13:47:17.131682 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d1c192d9-e013-433e-8fa8-dd5f88a27261 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:17.139330 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-d1c192d9-e013-433e-8fa8-dd5f88a27261 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] HTTP exception thrown: Instance group 537f6a3f-843f-4d3b-87eb-7be2bd31a965 could not be found. Oct 17 13:47:17.148238 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d1c192d9-e013-433e-8fa8-dd5f88a27261 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Request method failure captured: Oct 17 13:47:17.148238 n-d-854247-14 devstack@n-api.service[127017]: request: DELETE /compute/v2.1/os-server-groups/537f6a3f-843f-4d3b-87eb-7be2bd31a965 HTTP/1.1 Oct 17 13:47:17.148238 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:47:17.148238 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:47:17.148238 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:47:17.148238 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:47:17.148238 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:47:17.148238 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:47:17.148238 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:47:17.148238 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:47:17.148238 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVygGytS7RYUBUVn3Rrvb2xnZ2JVPZZnzAawDOw-DTOZuqE65rCrih7KtbRaMEMxdN2tci0436V9n0yOLMeK5_ZMkEV18BoYzyDPLHyLRHxHFxMi6AwgI2tRUBu0d0oYZczNNcWc1wER3vT5_LS-BXeps-Op-rs2ERrXH_6LMwnq-aE Oct 17 13:47:17.148238 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:47:17.148238 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:47:17.148238 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:47:17.148238 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:47:17.148238 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:47:17.148238 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:47:17.148238 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 9b0ffd0b1b764825826ab82cfbbe23e5 Oct 17 13:47:17.148238 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServerGroupTestJSON-1646380418 Oct 17 13:47:17.148238 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:47:17.148238 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:47:17.148238 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9b0ffd0b1b764825826ab82cfbbe23e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/9b0ffd0b1b764825826ab82cfbbe23e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9b0ffd0b1b764825826ab82cfbbe23e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_9b0ffd0b1b764825826ab82cfbbe23e5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:47:17.148238 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServerGroupTestJSON-1646380418 Oct 17 13:47:17.148238 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 9b0ffd0b1b764825826ab82cfbbe23e5 Oct 17 13:47:17.148238 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServerGroupTestJSON-1646380418 Oct 17 13:47:17.148238 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServerGroupTestJSON-1646380418-project Oct 17 13:47:17.148238 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:47:17.148238 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:47:17.148238 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 6898fd7e18d3404a982b998171f8f7fc Oct 17 13:47:17.148238 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServerGroupTestJSON-1646380418-project Oct 17 13:47:17.148238 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:47:17.148238 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance group 537f6a3f-843f-4d3b-87eb-7be2bd31a965 could not be found. Oct 17 13:47:17.148238 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '537f6a3f-843f-4d3b-87eb-7be2bd31a965'} Oct 17 13:47:17.148238 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:47:17.148238 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:17.148238 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 17 13:47:17.148238 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 17 13:47:17.148238 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:47:17.148238 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:47:17.148238 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 17 13:47:17.148238 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 17 13:47:17.148238 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 13:47:17.148238 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 13:47:17.148238 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 17 13:47:17.148238 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 17 13:47:17.148238 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 537f6a3f-843f-4d3b-87eb-7be2bd31a965 could not be found. Oct 17 13:47:17.148238 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:47:17.148238 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:47:17.148238 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:47:17.148238 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:17.148238 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:47:17.148238 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:47:17.148238 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:47:17.148238 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:47:17.148238 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:47:17.148238 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:47:17.148238 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 17 13:47:17.148238 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:47:17.148238 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 537f6a3f-843f-4d3b-87eb-7be2bd31a965 could not be found. Oct 17 13:47:17.148238 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:47:17.148238 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:47:17.148238 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:47:17.148238 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:17.152950 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:47:17.152950 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:47:17.152950 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:47:17.152950 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:47:17.152950 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 537f6a3f-843f-4d3b-87eb-7be2bd31a965 could not be found. Oct 17 13:47:17.152950 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:47:17.152950 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d1c192d9-e013-433e-8fa8-dd5f88a27261 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Returning 404 to user: Instance group 537f6a3f-843f-4d3b-87eb-7be2bd31a965 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:47:17.152950 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d1c192d9-e013-433e-8fa8-dd5f88a27261 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] 10.222.0.79 "DELETE /compute/v2.1/os-server-groups/537f6a3f-843f-4d3b-87eb-7be2bd31a965" status: 404 len: 117 microversion: 2.1 time: 0.022638 Oct 17 13:47:17.152950 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1509/3036] 10.222.0.79 () {58 vars in 1266 bytes} [Mon Oct 17 13:47:17 2022] DELETE /compute/v2.1/os-server-groups/537f6a3f-843f-4d3b-87eb-7be2bd31a965 => generated 117 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:47:17.157719 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-31810d2c-d9f0-4f79-820b-2c9f85dd30c8 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:17.158207 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-31810d2c-d9f0-4f79-820b-2c9f85dd30c8 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] [instance: 61ef701e-38b1-42a5-a604-89d2e3403033] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:17.170252 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-31810d2c-d9f0-4f79-820b-2c9f85dd30c8 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:17.170772 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-31810d2c-d9f0-4f79-820b-2c9f85dd30c8 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:17.171150 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-31810d2c-d9f0-4f79-820b-2c9f85dd30c8 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:17.172229 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-31810d2c-d9f0-4f79-820b-2c9f85dd30c8 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:17.172909 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-31810d2c-d9f0-4f79-820b-2c9f85dd30c8 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:17.173308 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-31810d2c-d9f0-4f79-820b-2c9f85dd30c8 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:17.387591 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-31810d2c-d9f0-4f79-820b-2c9f85dd30c8 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f234ed5b074fb5b2596aa3dd59882e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04b218c7b78b4c89baaf0cf4cb9a5fc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:17.397461 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-31810d2c-d9f0-4f79-820b-2c9f85dd30c8 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14f234ed5b074fb5b2596aa3dd59882e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04b218c7b78b4c89baaf0cf4cb9a5fc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:17.398931 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-31810d2c-d9f0-4f79-820b-2c9f85dd30c8 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14f234ed5b074fb5b2596aa3dd59882e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04b218c7b78b4c89baaf0cf4cb9a5fc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:17.400131 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-31810d2c-d9f0-4f79-820b-2c9f85dd30c8 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] 10.222.0.79 "GET /compute/v2.1/servers/61ef701e-38b1-42a5-a604-89d2e3403033" status: 200 len: 1358 microversion: 2.21 time: 0.248567 Oct 17 13:47:17.401082 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1510/3037] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:47:17 2022] GET /compute/v2.1/servers/61ef701e-38b1-42a5-a604-89d2e3403033 => generated 1358 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:47:17.405930 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3d4b5e7f-c2fc-42af-bb40-fd46c8ad3046 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:17.406837 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3d4b5e7f-c2fc-42af-bb40-fd46c8ad3046 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9d1105b3-be41-4963-a86b-6f4486d1d382] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:17.414275 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3d4b5e7f-c2fc-42af-bb40-fd46c8ad3046 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:17.414762 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3d4b5e7f-c2fc-42af-bb40-fd46c8ad3046 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:17.415213 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3d4b5e7f-c2fc-42af-bb40-fd46c8ad3046 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:17.416181 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3d4b5e7f-c2fc-42af-bb40-fd46c8ad3046 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:17.416508 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3d4b5e7f-c2fc-42af-bb40-fd46c8ad3046 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:17.417206 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3d4b5e7f-c2fc-42af-bb40-fd46c8ad3046 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:17.487594 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-699387c5-4f6b-45cc-b396-5b6badc8a2cc tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 7.827599 Oct 17 13:47:17.488448 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1528/3038] 10.222.0.79 () {62 vars in 1189 bytes} [Mon Oct 17 13:47:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 7829 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 13:47:17.519059 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-c378427e-b2af-4c61-963b-c21580bb1dae req-924b21ac-0f4f-4f88-9d2a-5d05ac9fab00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d1105b3-be41-4963-a86b-6f4486d1d382", "tag": "6cb71ea7-7943-454e-82a0-31ed2ec43a1c"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:47:17.536058 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-c378427e-b2af-4c61-963b-c21580bb1dae req-924b21ac-0f4f-4f88-9d2a-5d05ac9fab00 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:17.536551 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-c378427e-b2af-4c61-963b-c21580bb1dae req-924b21ac-0f4f-4f88-9d2a-5d05ac9fab00 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:17.537191 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-c378427e-b2af-4c61-963b-c21580bb1dae req-924b21ac-0f4f-4f88-9d2a-5d05ac9fab00 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:17.551537 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-c378427e-b2af-4c61-963b-c21580bb1dae req-924b21ac-0f4f-4f88-9d2a-5d05ac9fab00 service nova] Creating event network-changed:6cb71ea7-7943-454e-82a0-31ed2ec43a1c for instance 9d1105b3-be41-4963-a86b-6f4486d1d382 on n-h1-854247-14 Oct 17 13:47:17.560760 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [req-c378427e-b2af-4c61-963b-c21580bb1dae req-924b21ac-0f4f-4f88-9d2a-5d05ac9fab00 service nova] Instance 9d1105b3-be41-4963-a86b-6f4486d1d382 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854247-14', 'n-h1-854247-14'} {{(pid=127016) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:47:17.591594 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-c378427e-b2af-4c61-963b-c21580bb1dae req-924b21ac-0f4f-4f88-9d2a-5d05ac9fab00 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098233 Oct 17 13:47:17.593629 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1529/3039] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:47:17.606141 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6a42e07a-136a-4c67-9dee-19a3994e7711 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:17.607129 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6a42e07a-136a-4c67-9dee-19a3994e7711 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:17.615309 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6a42e07a-136a-4c67-9dee-19a3994e7711 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:17.616515 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6a42e07a-136a-4c67-9dee-19a3994e7711 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:17.617111 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6a42e07a-136a-4c67-9dee-19a3994e7711 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:17.618005 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6a42e07a-136a-4c67-9dee-19a3994e7711 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:17.618761 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6a42e07a-136a-4c67-9dee-19a3994e7711 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:17.619418 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6a42e07a-136a-4c67-9dee-19a3994e7711 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:17.633358 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3d4b5e7f-c2fc-42af-bb40-fd46c8ad3046 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:17.652547 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3d4b5e7f-c2fc-42af-bb40-fd46c8ad3046 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382" status: 200 len: 1470 microversion: 2.1 time: 0.250304 Oct 17 13:47:17.653142 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1511/3040] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:17 2022] GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382 => generated 1470 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:17.922350 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5f90dd65-bf80-4659-afb9-a9bbec41a51d tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Action: 'create', calling method: .version_select at 0x7f7cd5615790>, body: {"keypair": {"name": "tempest-keypair-80570820", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLvtEzSFB7Zoq48Tvwu5LeySLQ/ZynpK/CjY9OGDkHVhsU4twfQAJkzOZgTq85mz7GIlPP7pwMHiY2SYc1VhX+FHr4GQ+R1xdhU2pjmrzuJuRopwM6SItOmXcRBAXlZNtQ=="}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:47:17.949274 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-5f90dd65-bf80-4659-afb9-a9bbec41a51d tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Getting quotas for project 11973b8e1d8a4af8add65726e8ba7c83. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:47:17.957538 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-5f90dd65-bf80-4659-afb9-a9bbec41a51d tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Getting quotas for user 683d18db860a4d60ab3eeba2a372b2c5 and project 11973b8e1d8a4af8add65726e8ba7c83. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:47:18.001015 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5f90dd65-bf80-4659-afb9-a9bbec41a51d tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.332009 Oct 17 13:47:18.001714 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1512/3041] 10.222.0.79 () {60 vars in 1159 bytes} [Mon Oct 17 13:47:17 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:47:18.008544 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-699f2943-9432-4c57-b59c-109e93f1292e req-7d95c464-f21a-4803-a245-200029369831 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ef00d34-7f81-4649-a90a-a52cf78dbeca", "name": "network-vif-unplugged", "status": "completed", "tag": "841d5cd2-6ca1-435c-ac29-bfeee122d7fe"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:47:18.047262 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-699f2943-9432-4c57-b59c-109e93f1292e req-7d95c464-f21a-4803-a245-200029369831 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:18.048374 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-699f2943-9432-4c57-b59c-109e93f1292e req-7d95c464-f21a-4803-a245-200029369831 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:18.049683 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-699f2943-9432-4c57-b59c-109e93f1292e req-7d95c464-f21a-4803-a245-200029369831 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:18.077726 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.compute.server_external_events [req-699f2943-9432-4c57-b59c-109e93f1292e req-7d95c464-f21a-4803-a245-200029369831 service nova] Unable to find a host for instance 5ef00d34-7f81-4649-a90a-a52cf78dbeca. Dropping event network-vif-unplugged {{(pid=127017) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 17 13:47:18.080516 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-699f2943-9432-4c57-b59c-109e93f1292e req-7d95c464-f21a-4803-a245-200029369831 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.077337 Oct 17 13:47:18.081582 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1513/3042] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 79 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 17 13:47:18.086617 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8c019593-dffe-412d-90f0-76a883b0b2b7 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Action: 'action', calling method: .version_select at 0x7f7cd7363430>, body: {"removeFloatingIp": {"address": "172.25.0.129"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:47:18.389735 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6a42e07a-136a-4c67-9dee-19a3994e7711 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:18.405079 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6a42e07a-136a-4c67-9dee-19a3994e7711 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1453 microversion: 2.1 time: 0.806431 Oct 17 13:47:18.419220 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1530/3043] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:17 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1453 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:18.427033 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-56507cb6-d748-4f35-a380-4ba123cac8a0 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:18.443081 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-56507cb6-d748-4f35-a380-4ba123cac8a0 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] HTTP exception thrown: Instance group ea007165-ff58-4b72-bc4a-f642812e2a85 could not be found. Oct 17 13:47:18.464963 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-56507cb6-d748-4f35-a380-4ba123cac8a0 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Request method failure captured: Oct 17 13:47:18.464963 n-d-854247-14 devstack@n-api.service[127016]: request: DELETE /compute/v2.1/os-server-groups/ea007165-ff58-4b72-bc4a-f642812e2a85 HTTP/1.1 Oct 17 13:47:18.464963 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:47:18.464963 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:47:18.464963 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:47:18.464963 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:47:18.464963 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:47:18.464963 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:47:18.464963 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:47:18.464963 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:47:18.464963 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVygGytS7RYUBUVn3Rrvb2xnZ2JVPZZnzAawDOw-DTOZuqE65rCrih7KtbRaMEMxdN2tci0436V9n0yOLMeK5_ZMkEV18BoYzyDPLHyLRHxHFxMi6AwgI2tRUBu0d0oYZczNNcWc1wER3vT5_LS-BXeps-Op-rs2ERrXH_6LMwnq-aE Oct 17 13:47:18.464963 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:47:18.464963 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:47:18.464963 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:47:18.464963 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:47:18.464963 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:47:18.464963 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:47:18.464963 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 9b0ffd0b1b764825826ab82cfbbe23e5 Oct 17 13:47:18.464963 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServerGroupTestJSON-1646380418 Oct 17 13:47:18.464963 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:47:18.464963 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:47:18.464963 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9b0ffd0b1b764825826ab82cfbbe23e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/9b0ffd0b1b764825826ab82cfbbe23e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9b0ffd0b1b764825826ab82cfbbe23e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_9b0ffd0b1b764825826ab82cfbbe23e5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:47:18.464963 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServerGroupTestJSON-1646380418 Oct 17 13:47:18.464963 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 9b0ffd0b1b764825826ab82cfbbe23e5 Oct 17 13:47:18.464963 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServerGroupTestJSON-1646380418 Oct 17 13:47:18.464963 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServerGroupTestJSON-1646380418-project Oct 17 13:47:18.464963 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:47:18.464963 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:47:18.464963 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 6898fd7e18d3404a982b998171f8f7fc Oct 17 13:47:18.464963 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServerGroupTestJSON-1646380418-project Oct 17 13:47:18.464963 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:47:18.464963 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance group ea007165-ff58-4b72-bc4a-f642812e2a85 could not be found. Oct 17 13:47:18.464963 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'ea007165-ff58-4b72-bc4a-f642812e2a85'} Oct 17 13:47:18.464963 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:47:18.464963 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:18.464963 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 17 13:47:18.464963 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 17 13:47:18.464963 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:47:18.464963 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:47:18.464963 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 17 13:47:18.464963 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 17 13:47:18.464963 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 13:47:18.464963 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 13:47:18.464963 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 17 13:47:18.464963 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 17 13:47:18.464963 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group ea007165-ff58-4b72-bc4a-f642812e2a85 could not be found. Oct 17 13:47:18.464963 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:47:18.464963 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:47:18.464963 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:47:18.464963 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:18.464963 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:47:18.464963 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:47:18.464963 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:47:18.464963 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:47:18.464963 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:47:18.464963 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:47:18.464963 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 17 13:47:18.464963 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:47:18.464963 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group ea007165-ff58-4b72-bc4a-f642812e2a85 could not be found. Oct 17 13:47:18.464963 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:47:18.464963 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:47:18.464963 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:47:18.464963 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:18.469986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:47:18.469986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:47:18.469986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:47:18.469986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:47:18.469986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group ea007165-ff58-4b72-bc4a-f642812e2a85 could not be found. Oct 17 13:47:18.469986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:47:18.472829 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-56507cb6-d748-4f35-a380-4ba123cac8a0 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Returning 404 to user: Instance group ea007165-ff58-4b72-bc4a-f642812e2a85 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:47:18.476968 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-56507cb6-d748-4f35-a380-4ba123cac8a0 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] 10.222.0.79 "DELETE /compute/v2.1/os-server-groups/ea007165-ff58-4b72-bc4a-f642812e2a85" status: 404 len: 117 microversion: 2.1 time: 0.066330 Oct 17 13:47:18.477799 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1531/3044] 10.222.0.79 () {58 vars in 1266 bytes} [Mon Oct 17 13:47:18 2022] DELETE /compute/v2.1/os-server-groups/ea007165-ff58-4b72-bc4a-f642812e2a85 => generated 117 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:47:18.487387 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fec59216-24bb-4351-a9fc-25bb65073c9f tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:18.488007 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-fec59216-24bb-4351-a9fc-25bb65073c9f tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] [instance: 531b762d-db7e-4911-af50-6b321b7706bf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:18.574193 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8c019593-dffe-412d-90f0-76a883b0b2b7 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] [instance: 29fb8b41-6dcb-49f2-9e1c-11719cace5d9] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:18.584102 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8c019593-dffe-412d-90f0-76a883b0b2b7 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:18.584102 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8c019593-dffe-412d-90f0-76a883b0b2b7 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:18.584102 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8c019593-dffe-412d-90f0-76a883b0b2b7 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:18.585410 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8c019593-dffe-412d-90f0-76a883b0b2b7 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:18.585876 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8c019593-dffe-412d-90f0-76a883b0b2b7 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:18.586308 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8c019593-dffe-412d-90f0-76a883b0b2b7 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:18.786618 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fec59216-24bb-4351-a9fc-25bb65073c9f tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:18.801113 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fec59216-24bb-4351-a9fc-25bb65073c9f tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:18.806233 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fec59216-24bb-4351-a9fc-25bb65073c9f tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:18.808924 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fec59216-24bb-4351-a9fc-25bb65073c9f tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] 10.222.0.79 "GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf" status: 200 len: 1285 microversion: 2.42 time: 0.325709 Oct 17 13:47:18.825124 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1532/3045] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:47:18 2022] GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf => generated 1285 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:47:18.840966 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-076366f4-04c1-4255-805b-a6f1156bac84 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:47:18.842042 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-076366f4-04c1-4255-805b-a6f1156bac84 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9d1105b3-be41-4963-a86b-6f4486d1d382] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:18.851205 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-076366f4-04c1-4255-805b-a6f1156bac84 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:18.852384 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-076366f4-04c1-4255-805b-a6f1156bac84 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:18.853063 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-076366f4-04c1-4255-805b-a6f1156bac84 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:18.854228 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-076366f4-04c1-4255-805b-a6f1156bac84 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:18.854907 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-076366f4-04c1-4255-805b-a6f1156bac84 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:18.856517 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-076366f4-04c1-4255-805b-a6f1156bac84 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:19.006047 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-076366f4-04c1-4255-805b-a6f1156bac84 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "POST /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382/action" status: 204 len: 0 microversion: 2.1 time: 0.179287 Oct 17 13:47:19.007445 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1533/3046] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:47:18 2022] POST /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382/action => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:47:19.021404 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b3a96d38-ecd5-469a-8104-1a9ae0d22ae6 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:19.024649 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b3a96d38-ecd5-469a-8104-1a9ae0d22ae6 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] [instance: 61ef701e-38b1-42a5-a604-89d2e3403033] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:19.040037 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b3a96d38-ecd5-469a-8104-1a9ae0d22ae6 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:19.044192 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b3a96d38-ecd5-469a-8104-1a9ae0d22ae6 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:19.044784 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b3a96d38-ecd5-469a-8104-1a9ae0d22ae6 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:19.046048 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b3a96d38-ecd5-469a-8104-1a9ae0d22ae6 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:19.048622 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b3a96d38-ecd5-469a-8104-1a9ae0d22ae6 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:19.050966 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b3a96d38-ecd5-469a-8104-1a9ae0d22ae6 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:19.578170 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-8c019593-dffe-412d-90f0-76a883b0b2b7 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] HTTP exception thrown: Floating IP 172.25.0.129 is not associated with instance 50e9eae9-df55-48ee-b984-e6b7e4bb2628. Oct 17 13:47:19.579667 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8c019593-dffe-412d-90f0-76a883b0b2b7 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Request method failure captured: Oct 17 13:47:19.579667 n-d-854247-14 devstack@n-api.service[127017]: request: POST /compute/v2.1/servers/50e9eae9-df55-48ee-b984-e6b7e4bb2628/action HTTP/1.1 Oct 17 13:47:19.579667 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:47:19.579667 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:47:19.579667 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:47:19.579667 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 49 Oct 17 13:47:19.579667 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:47:19.579667 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:47:19.579667 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:47:19.579667 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:47:19.579667 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVyHr9cMxqqpMQ_SGFYWfWNh2ukm6fljeGlynI7p-vwRyqG7rxvn3_33Cj97gvChwnYCDwAhthJ-BWlrwI8_a3OyS9DmQuOO_0qjGEcsRVLbQqHUiyE61o4LdbdwT0-3KIWQ5f4T-boDaU-G6V3CGAtmxh9Hoj3ZiO9LCTI0rTmfS60 Oct 17 13:47:19.579667 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:47:19.579667 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:47:19.579667 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:47:19.579667 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:47:19.579667 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:47:19.579667 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:47:19.579667 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 18f91db965084796a4a3dce1b4e921e5 Oct 17 13:47:19.579667 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-655180239 Oct 17 13:47:19.579667 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:47:19.579667 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:47:19.579667 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/18f91db965084796a4a3dce1b4e921e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/18f91db965084796a4a3dce1b4e921e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/18f91db965084796a4a3dce1b4e921e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_18f91db965084796a4a3dce1b4e921e5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:47:19.579667 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-655180239 Oct 17 13:47:19.579667 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 18f91db965084796a4a3dce1b4e921e5 Oct 17 13:47:19.579667 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-655180239 Oct 17 13:47:19.579667 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-FloatingIPsAssociationTestJSON-655180239-project Oct 17 13:47:19.579667 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:47:19.579667 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:47:19.579667 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 43a3472f83914990ad41f037b4aafd63 Oct 17 13:47:19.579667 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-655180239-project Oct 17 13:47:19.579667 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 13:47:19.579667 n-d-854247-14 devstack@n-api.service[127017]: {"removeFloatingIp": {"address": "172.25.0.129"}} Oct 17 13:47:19.579667 n-d-854247-14 devstack@n-api.service[127017]: method: Oct 17 13:47:19.579667 n-d-854247-14 devstack@n-api.service[127017]: exception: Floating IP 172.25.0.129 is not associated with instance 50e9eae9-df55-48ee-b984-e6b7e4bb2628. Oct 17 13:47:19.579667 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '50e9eae9-df55-48ee-b984-e6b7e4bb2628', 'body': {'removeFloatingIp': {'address': '172.25.0.129'}}} Oct 17 13:47:19.579667 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:47:19.579667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:19.579667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:47:19.579667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:47:19.579667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:47:19.579667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:47:19.579667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:47:19.579667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:47:19.579667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:47:19.579667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:47:19.579667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:47:19.579667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:47:19.579667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 17 13:47:19.579667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 13:47:19.579667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.0.129 is not associated with instance 50e9eae9-df55-48ee-b984-e6b7e4bb2628. Oct 17 13:47:19.579667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:47:19.579667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:47:19.579667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:47:19.579667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:19.579667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:47:19.579667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:47:19.579667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:47:19.579667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:47:19.579667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.0.129 is not associated with instance 50e9eae9-df55-48ee-b984-e6b7e4bb2628. Oct 17 13:47:19.579667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:47:19.586675 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8c019593-dffe-412d-90f0-76a883b0b2b7 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Returning 409 to user: Floating IP 172.25.0.129 is not associated with instance 50e9eae9-df55-48ee-b984-e6b7e4bb2628. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:47:19.587829 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8c019593-dffe-412d-90f0-76a883b0b2b7 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] 10.222.0.79 "POST /compute/v2.1/servers/50e9eae9-df55-48ee-b984-e6b7e4bb2628/action" status: 409 len: 146 microversion: 2.1 time: 1.505191 Oct 17 13:47:19.589088 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1514/3047] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:47:18 2022] POST /compute/v2.1/servers/50e9eae9-df55-48ee-b984-e6b7e4bb2628/action => generated 146 bytes in 1507 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:47:19.595633 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-798ee058-66c1-4ab3-8db1-318226adcb52 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:19.596553 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-798ee058-66c1-4ab3-8db1-318226adcb52 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:19.603949 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-798ee058-66c1-4ab3-8db1-318226adcb52 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:19.604745 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-798ee058-66c1-4ab3-8db1-318226adcb52 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:19.605406 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-798ee058-66c1-4ab3-8db1-318226adcb52 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:19.606466 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-798ee058-66c1-4ab3-8db1-318226adcb52 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:19.607142 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-798ee058-66c1-4ab3-8db1-318226adcb52 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:19.607802 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-798ee058-66c1-4ab3-8db1-318226adcb52 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:20.113678 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-798ee058-66c1-4ab3-8db1-318226adcb52 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:20.126026 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-798ee058-66c1-4ab3-8db1-318226adcb52 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1453 microversion: 2.1 time: 0.535430 Oct 17 13:47:20.128043 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1515/3048] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:19 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1453 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:20.137203 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b3a96d38-ecd5-469a-8104-1a9ae0d22ae6 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f234ed5b074fb5b2596aa3dd59882e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04b218c7b78b4c89baaf0cf4cb9a5fc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:20.159365 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e28b7744-aa71-4d8a-b586-e90cab2e2735 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:20.164871 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b3a96d38-ecd5-469a-8104-1a9ae0d22ae6 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14f234ed5b074fb5b2596aa3dd59882e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04b218c7b78b4c89baaf0cf4cb9a5fc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:20.170792 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b3a96d38-ecd5-469a-8104-1a9ae0d22ae6 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14f234ed5b074fb5b2596aa3dd59882e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04b218c7b78b4c89baaf0cf4cb9a5fc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:20.174599 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b3a96d38-ecd5-469a-8104-1a9ae0d22ae6 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] 10.222.0.79 "GET /compute/v2.1/servers/61ef701e-38b1-42a5-a604-89d2e3403033" status: 200 len: 1358 microversion: 2.21 time: 1.165826 Oct 17 13:47:20.177074 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1534/3049] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:47:19 2022] GET /compute/v2.1/servers/61ef701e-38b1-42a5-a604-89d2e3403033 => generated 1358 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:47:20.179723 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-e28b7744-aa71-4d8a-b586-e90cab2e2735 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] HTTP exception thrown: Instance group 25b3e471-3257-4717-8856-0bacd3fde96f could not be found. Oct 17 13:47:20.182022 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e28b7744-aa71-4d8a-b586-e90cab2e2735 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Request method failure captured: Oct 17 13:47:20.182022 n-d-854247-14 devstack@n-api.service[127017]: request: DELETE /compute/v2.1/os-server-groups/25b3e471-3257-4717-8856-0bacd3fde96f HTTP/1.1 Oct 17 13:47:20.182022 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:47:20.182022 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:47:20.182022 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:47:20.182022 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:47:20.182022 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:47:20.182022 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:47:20.182022 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:47:20.182022 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:47:20.182022 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVygGytS7RYUBUVn3Rrvb2xnZ2JVPZZnzAawDOw-DTOZuqE65rCrih7KtbRaMEMxdN2tci0436V9n0yOLMeK5_ZMkEV18BoYzyDPLHyLRHxHFxMi6AwgI2tRUBu0d0oYZczNNcWc1wER3vT5_LS-BXeps-Op-rs2ERrXH_6LMwnq-aE Oct 17 13:47:20.182022 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:47:20.182022 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:47:20.182022 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:47:20.182022 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:47:20.182022 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:47:20.182022 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:47:20.182022 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 9b0ffd0b1b764825826ab82cfbbe23e5 Oct 17 13:47:20.182022 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServerGroupTestJSON-1646380418 Oct 17 13:47:20.182022 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:47:20.182022 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:47:20.182022 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9b0ffd0b1b764825826ab82cfbbe23e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/9b0ffd0b1b764825826ab82cfbbe23e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9b0ffd0b1b764825826ab82cfbbe23e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_9b0ffd0b1b764825826ab82cfbbe23e5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:47:20.182022 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServerGroupTestJSON-1646380418 Oct 17 13:47:20.182022 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 9b0ffd0b1b764825826ab82cfbbe23e5 Oct 17 13:47:20.182022 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServerGroupTestJSON-1646380418 Oct 17 13:47:20.182022 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServerGroupTestJSON-1646380418-project Oct 17 13:47:20.182022 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:47:20.182022 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:47:20.182022 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 6898fd7e18d3404a982b998171f8f7fc Oct 17 13:47:20.182022 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServerGroupTestJSON-1646380418-project Oct 17 13:47:20.182022 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:47:20.182022 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance group 25b3e471-3257-4717-8856-0bacd3fde96f could not be found. Oct 17 13:47:20.182022 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '25b3e471-3257-4717-8856-0bacd3fde96f'} Oct 17 13:47:20.182022 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:47:20.182022 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:20.182022 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 17 13:47:20.182022 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 17 13:47:20.182022 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:47:20.182022 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:47:20.182022 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 17 13:47:20.182022 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 17 13:47:20.182022 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 13:47:20.182022 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 13:47:20.182022 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 17 13:47:20.182022 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 17 13:47:20.182022 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 25b3e471-3257-4717-8856-0bacd3fde96f could not be found. Oct 17 13:47:20.182022 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:47:20.182022 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:47:20.182022 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:47:20.182022 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:20.182022 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:47:20.182022 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:47:20.182022 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:47:20.182022 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:47:20.182022 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:47:20.182022 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:47:20.182022 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 17 13:47:20.182022 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:47:20.182022 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 25b3e471-3257-4717-8856-0bacd3fde96f could not be found. Oct 17 13:47:20.182022 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:47:20.182022 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:47:20.182022 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:47:20.182022 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:20.186633 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:47:20.186633 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:47:20.186633 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:47:20.186633 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:47:20.186633 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 25b3e471-3257-4717-8856-0bacd3fde96f could not be found. Oct 17 13:47:20.186633 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:47:20.188079 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e28b7744-aa71-4d8a-b586-e90cab2e2735 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Returning 404 to user: Instance group 25b3e471-3257-4717-8856-0bacd3fde96f could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:47:20.202256 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e28b7744-aa71-4d8a-b586-e90cab2e2735 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] 10.222.0.79 "DELETE /compute/v2.1/os-server-groups/25b3e471-3257-4717-8856-0bacd3fde96f" status: 404 len: 117 microversion: 2.1 time: 0.071859 Oct 17 13:47:20.204346 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1516/3050] 10.222.0.79 () {58 vars in 1266 bytes} [Mon Oct 17 13:47:20 2022] DELETE /compute/v2.1/os-server-groups/25b3e471-3257-4717-8856-0bacd3fde96f => generated 117 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:47:20.204818 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-89f62749-e1c0-4f52-8a15-8a7cf215e450 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:20.206846 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-89f62749-e1c0-4f52-8a15-8a7cf215e450 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9d1105b3-be41-4963-a86b-6f4486d1d382] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:20.220011 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4cc89ed1-6341-4e69-9548-e3182d179fd8 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.0.129"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:47:20.226473 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-89f62749-e1c0-4f52-8a15-8a7cf215e450 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:20.227230 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-89f62749-e1c0-4f52-8a15-8a7cf215e450 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:20.227860 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-89f62749-e1c0-4f52-8a15-8a7cf215e450 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:20.231330 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-89f62749-e1c0-4f52-8a15-8a7cf215e450 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:20.233339 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-89f62749-e1c0-4f52-8a15-8a7cf215e450 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:20.234799 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-89f62749-e1c0-4f52-8a15-8a7cf215e450 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:20.757619 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4cc89ed1-6341-4e69-9548-e3182d179fd8 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] [instance: 29fb8b41-6dcb-49f2-9e1c-11719cace5d9] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:20.774037 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4cc89ed1-6341-4e69-9548-e3182d179fd8 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:20.774247 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4cc89ed1-6341-4e69-9548-e3182d179fd8 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:20.774938 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4cc89ed1-6341-4e69-9548-e3182d179fd8 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:20.782071 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4cc89ed1-6341-4e69-9548-e3182d179fd8 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:20.784604 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4cc89ed1-6341-4e69-9548-e3182d179fd8 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:20.788491 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4cc89ed1-6341-4e69-9548-e3182d179fd8 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:20.924429 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-89f62749-e1c0-4f52-8a15-8a7cf215e450 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:20.937982 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-89f62749-e1c0-4f52-8a15-8a7cf215e450 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382" status: 200 len: 1470 microversion: 2.1 time: 0.756067 Oct 17 13:47:20.938666 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1535/3051] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:20 2022] GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382 => generated 1470 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:20.976653 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-56284319-c7d6-49f1-bc9c-0f7a472d9bed req-25230b80-53dd-4f57-be4f-db606a2f0f16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61ef701e-38b1-42a5-a604-89d2e3403033", "tag": "af5c24ee-cc81-4bef-985a-3bb76c775bbc"}, {"name": "network-changed", "server_uuid": "50e9eae9-df55-48ee-b984-e6b7e4bb2628", "tag": "be3444eb-9f99-422e-963d-086fa4da6881"}, {"name": "network-changed", "server_uuid": "29fb8b41-6dcb-49f2-9e1c-11719cace5d9", "tag": "9025275f-f4f7-42ab-bf78-e79c39398580"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:47:20.990200 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-56284319-c7d6-49f1-bc9c-0f7a472d9bed req-25230b80-53dd-4f57-be4f-db606a2f0f16 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:20.990979 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-56284319-c7d6-49f1-bc9c-0f7a472d9bed req-25230b80-53dd-4f57-be4f-db606a2f0f16 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:20.991649 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-56284319-c7d6-49f1-bc9c-0f7a472d9bed req-25230b80-53dd-4f57-be4f-db606a2f0f16 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:21.011673 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-56284319-c7d6-49f1-bc9c-0f7a472d9bed req-25230b80-53dd-4f57-be4f-db606a2f0f16 service nova] Creating event network-changed:af5c24ee-cc81-4bef-985a-3bb76c775bbc for instance 61ef701e-38b1-42a5-a604-89d2e3403033 on n-h2-854247-14 Oct 17 13:47:21.012494 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-56284319-c7d6-49f1-bc9c-0f7a472d9bed req-25230b80-53dd-4f57-be4f-db606a2f0f16 service nova] Creating event network-changed:be3444eb-9f99-422e-963d-086fa4da6881 for instance 50e9eae9-df55-48ee-b984-e6b7e4bb2628 on n-h1-854247-14 Oct 17 13:47:21.013431 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-56284319-c7d6-49f1-bc9c-0f7a472d9bed req-25230b80-53dd-4f57-be4f-db606a2f0f16 service nova] Creating event network-changed:9025275f-f4f7-42ab-bf78-e79c39398580 for instance 29fb8b41-6dcb-49f2-9e1c-11719cace5d9 on n-h1-854247-14 Oct 17 13:47:21.029033 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-56284319-c7d6-49f1-bc9c-0f7a472d9bed req-25230b80-53dd-4f57-be4f-db606a2f0f16 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.068934 Oct 17 13:47:21.032941 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1536/3052] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:47:21.044955 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c4bb7073-7267-4edf-ac16-4942f2a9a5e2 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:21.047952 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c4bb7073-7267-4edf-ac16-4942f2a9a5e2 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] [instance: 531b762d-db7e-4911-af50-6b321b7706bf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:21.065333 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c4bb7073-7267-4edf-ac16-4942f2a9a5e2 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:21.065814 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c4bb7073-7267-4edf-ac16-4942f2a9a5e2 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:21.067534 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c4bb7073-7267-4edf-ac16-4942f2a9a5e2 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:21.069883 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c4bb7073-7267-4edf-ac16-4942f2a9a5e2 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:21.083788 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c4bb7073-7267-4edf-ac16-4942f2a9a5e2 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:21.098292 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c4bb7073-7267-4edf-ac16-4942f2a9a5e2 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:21.464130 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4cc89ed1-6341-4e69-9548-e3182d179fd8 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "refresh_cache-29fb8b41-6dcb-49f2-9e1c-11719cace5d9" {{(pid=127017) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 17 13:47:21.464754 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4cc89ed1-6341-4e69-9548-e3182d179fd8 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquired lock "refresh_cache-29fb8b41-6dcb-49f2-9e1c-11719cace5d9" {{(pid=127017) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 17 13:47:21.533924 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c4bb7073-7267-4edf-ac16-4942f2a9a5e2 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:21.564035 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c4bb7073-7267-4edf-ac16-4942f2a9a5e2 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:21.572238 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c4bb7073-7267-4edf-ac16-4942f2a9a5e2 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:21.574838 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c4bb7073-7267-4edf-ac16-4942f2a9a5e2 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] 10.222.0.79 "GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf" status: 200 len: 1593 microversion: 2.42 time: 0.540190 Oct 17 13:47:21.575463 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1537/3053] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:47:21 2022] GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf => generated 1593 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:47:21.585442 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-42d4b366-c3a3-492c-8513-934a22e31e5a req-add22d6e-0f86-4d41-8223-1890927aab72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d1105b3-be41-4963-a86b-6f4486d1d382", "name": "network-vif-plugged", "status": "completed", "tag": "6cb71ea7-7943-454e-82a0-31ed2ec43a1c"}, {"server_uuid": "61ef701e-38b1-42a5-a604-89d2e3403033", "name": "network-vif-plugged", "status": "completed", "tag": "af5c24ee-cc81-4bef-985a-3bb76c775bbc"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:47:21.634536 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-42d4b366-c3a3-492c-8513-934a22e31e5a req-add22d6e-0f86-4d41-8223-1890927aab72 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:21.635192 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-42d4b366-c3a3-492c-8513-934a22e31e5a req-add22d6e-0f86-4d41-8223-1890927aab72 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:21.635746 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-42d4b366-c3a3-492c-8513-934a22e31e5a req-add22d6e-0f86-4d41-8223-1890927aab72 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:21.661212 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-42d4b366-c3a3-492c-8513-934a22e31e5a req-add22d6e-0f86-4d41-8223-1890927aab72 service nova] Creating event network-vif-plugged:6cb71ea7-7943-454e-82a0-31ed2ec43a1c for instance 9d1105b3-be41-4963-a86b-6f4486d1d382 on n-h1-854247-14 Oct 17 13:47:21.671988 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-42d4b366-c3a3-492c-8513-934a22e31e5a req-add22d6e-0f86-4d41-8223-1890927aab72 service nova] Creating event network-vif-plugged:af5c24ee-cc81-4bef-985a-3bb76c775bbc for instance 61ef701e-38b1-42a5-a604-89d2e3403033 on n-h2-854247-14 Oct 17 13:47:21.684191 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [req-42d4b366-c3a3-492c-8513-934a22e31e5a req-add22d6e-0f86-4d41-8223-1890927aab72 service nova] Instance 9d1105b3-be41-4963-a86b-6f4486d1d382 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854247-14', 'n-h1-854247-14'} {{(pid=127016) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:47:21.713138 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-42d4b366-c3a3-492c-8513-934a22e31e5a req-add22d6e-0f86-4d41-8223-1890927aab72 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.132228 Oct 17 13:47:21.715432 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1538/3054] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:47:21 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:47:21.724765 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-baa1514a-57cb-47f9-8793-62f0a0e87778 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:21.742751 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-baa1514a-57cb-47f9-8793-62f0a0e87778 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] HTTP exception thrown: Instance group 9e9ec619-3eba-4d3a-b81d-6236913faeb0 could not be found. Oct 17 13:47:21.744930 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-baa1514a-57cb-47f9-8793-62f0a0e87778 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Request method failure captured: Oct 17 13:47:21.744930 n-d-854247-14 devstack@n-api.service[127016]: request: DELETE /compute/v2.1/os-server-groups/9e9ec619-3eba-4d3a-b81d-6236913faeb0 HTTP/1.1 Oct 17 13:47:21.744930 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:47:21.744930 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:47:21.744930 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:47:21.744930 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:47:21.744930 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:47:21.744930 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:47:21.744930 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:47:21.744930 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:47:21.744930 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVygGytS7RYUBUVn3Rrvb2xnZ2JVPZZnzAawDOw-DTOZuqE65rCrih7KtbRaMEMxdN2tci0436V9n0yOLMeK5_ZMkEV18BoYzyDPLHyLRHxHFxMi6AwgI2tRUBu0d0oYZczNNcWc1wER3vT5_LS-BXeps-Op-rs2ERrXH_6LMwnq-aE Oct 17 13:47:21.744930 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:47:21.744930 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:47:21.744930 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:47:21.744930 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:47:21.744930 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:47:21.744930 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:47:21.744930 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 9b0ffd0b1b764825826ab82cfbbe23e5 Oct 17 13:47:21.744930 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServerGroupTestJSON-1646380418 Oct 17 13:47:21.744930 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:47:21.744930 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:47:21.744930 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9b0ffd0b1b764825826ab82cfbbe23e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/9b0ffd0b1b764825826ab82cfbbe23e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9b0ffd0b1b764825826ab82cfbbe23e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_9b0ffd0b1b764825826ab82cfbbe23e5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:47:21.744930 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServerGroupTestJSON-1646380418 Oct 17 13:47:21.744930 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 9b0ffd0b1b764825826ab82cfbbe23e5 Oct 17 13:47:21.744930 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServerGroupTestJSON-1646380418 Oct 17 13:47:21.744930 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServerGroupTestJSON-1646380418-project Oct 17 13:47:21.744930 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:47:21.744930 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:47:21.744930 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 6898fd7e18d3404a982b998171f8f7fc Oct 17 13:47:21.744930 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServerGroupTestJSON-1646380418-project Oct 17 13:47:21.744930 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:47:21.744930 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance group 9e9ec619-3eba-4d3a-b81d-6236913faeb0 could not be found. Oct 17 13:47:21.744930 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '9e9ec619-3eba-4d3a-b81d-6236913faeb0'} Oct 17 13:47:21.744930 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:47:21.744930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:21.744930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 17 13:47:21.744930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 17 13:47:21.744930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:47:21.744930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:47:21.744930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 17 13:47:21.744930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 17 13:47:21.744930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 13:47:21.744930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 13:47:21.744930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 17 13:47:21.744930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 17 13:47:21.744930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 9e9ec619-3eba-4d3a-b81d-6236913faeb0 could not be found. Oct 17 13:47:21.744930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:47:21.744930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:47:21.744930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:47:21.744930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:21.744930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:47:21.744930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:47:21.744930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:47:21.744930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:47:21.744930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:47:21.744930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:47:21.744930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 17 13:47:21.744930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:47:21.744930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 9e9ec619-3eba-4d3a-b81d-6236913faeb0 could not be found. Oct 17 13:47:21.744930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:47:21.744930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:47:21.744930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:47:21.744930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:21.749068 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:47:21.749068 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:47:21.749068 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:47:21.749068 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:47:21.749068 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 9e9ec619-3eba-4d3a-b81d-6236913faeb0 could not be found. Oct 17 13:47:21.749068 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:47:21.756210 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-baa1514a-57cb-47f9-8793-62f0a0e87778 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Returning 404 to user: Instance group 9e9ec619-3eba-4d3a-b81d-6236913faeb0 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:47:21.757405 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-baa1514a-57cb-47f9-8793-62f0a0e87778 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] 10.222.0.79 "DELETE /compute/v2.1/os-server-groups/9e9ec619-3eba-4d3a-b81d-6236913faeb0" status: 404 len: 117 microversion: 2.1 time: 0.040657 Oct 17 13:47:21.759087 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1539/3055] 10.222.0.79 () {58 vars in 1266 bytes} [Mon Oct 17 13:47:21 2022] DELETE /compute/v2.1/os-server-groups/9e9ec619-3eba-4d3a-b81d-6236913faeb0 => generated 117 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:47:21.768450 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-497d72ad-bf8b-480c-8956-d2ab238c163b tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:47:21.769979 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-497d72ad-bf8b-480c-8956-d2ab238c163b tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:21.778810 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-497d72ad-bf8b-480c-8956-d2ab238c163b tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:21.779661 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-497d72ad-bf8b-480c-8956-d2ab238c163b tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:21.780441 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-497d72ad-bf8b-480c-8956-d2ab238c163b tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:21.781357 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-497d72ad-bf8b-480c-8956-d2ab238c163b tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:21.782102 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-497d72ad-bf8b-480c-8956-d2ab238c163b tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:21.782923 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-497d72ad-bf8b-480c-8956-d2ab238c163b tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:21.787662 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:47:21.811250 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-497d72ad-bf8b-480c-8956-d2ab238c163b tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lazy-loading 'flavor' on Instance uuid 5ef00d34-7f81-4649-a90a-a52cf78dbeca {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:47:21.826797 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-497d72ad-bf8b-480c-8956-d2ab238c163b tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] HTTP exception thrown: Cannot 'shelve' instance 5ef00d34-7f81-4649-a90a-a52cf78dbeca while it is in vm_state shelved_offloaded Oct 17 13:47:21.829168 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-497d72ad-bf8b-480c-8956-d2ab238c163b tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Request method failure captured: Oct 17 13:47:21.829168 n-d-854247-14 devstack@n-api.service[127016]: request: POST /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca/action HTTP/1.1 Oct 17 13:47:21.829168 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:47:21.829168 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:47:21.829168 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:47:21.829168 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 14 Oct 17 13:47:21.829168 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:47:21.829168 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:47:21.829168 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:47:21.829168 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:47:21.829168 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVwEqzYAZh4AkEjRryOAZIhaHrAKxd2Qcal9md8a5n-MMUYSdXmcWYLDVkyQoPrDIbcsApBq2EewemPkBwvNDDOidb0hhc_Z3w9BeEUj5ET_flLYPqO5hgqCsuZGXFiYIEBJxrkx614fXiELZHaNkvhSdsJHShK0w7L-UPHhkPKqi5M Oct 17 13:47:21.829168 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:47:21.829168 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:47:21.829168 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:47:21.829168 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:47:21.829168 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:47:21.829168 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:47:21.829168 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:47:21.829168 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:47:21.829168 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:47:21.829168 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:47:21.829168 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_59e65f6eb06d40d583b9f43c9af94c13", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:47:21.829168 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:47:21.829168 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:47:21.829168 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:47:21.829168 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:47:21.829168 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:47:21.829168 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:47:21.829168 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 443c44b0bd9e4c56a7fe0c1a53238545 Oct 17 13:47:21.829168 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:47:21.829168 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:47:21.829168 n-d-854247-14 devstack@n-api.service[127016]: {"shelve": {}} Oct 17 13:47:21.829168 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:47:21.829168 n-d-854247-14 devstack@n-api.service[127016]: exception: Cannot 'shelve' instance 5ef00d34-7f81-4649-a90a-a52cf78dbeca while it is in vm_state shelved_offloaded Oct 17 13:47:21.829168 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '5ef00d34-7f81-4649-a90a-a52cf78dbeca', 'body': {'shelve': {}}} Oct 17 13:47:21.829168 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:47:21.829168 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:21.829168 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 17 13:47:21.829168 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 17 13:47:21.829168 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 17 13:47:21.829168 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 13:47:21.829168 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 17 13:47:21.829168 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 13:47:21.829168 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 17 13:47:21.829168 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 13:47:21.829168 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 13:47:21.829168 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:47:21.829168 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 13:47:21.829168 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 13:47:21.829168 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5ef00d34-7f81-4649-a90a-a52cf78dbeca in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 17 13:47:21.829168 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:47:21.829168 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:47:21.829168 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:47:21.829168 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:21.829168 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:47:21.829168 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:47:21.829168 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:47:21.829168 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:47:21.829168 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:47:21.829168 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:47:21.829168 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 17 13:47:21.829168 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 17 13:47:21.829168 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 13:47:21.833096 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 13:47:21.833096 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 5ef00d34-7f81-4649-a90a-a52cf78dbeca while it is in vm_state shelved_offloaded Oct 17 13:47:21.833096 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:47:21.833096 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:47:21.833096 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:47:21.833096 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:21.833096 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:47:21.833096 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:47:21.833096 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:47:21.833096 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:47:21.833096 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 5ef00d34-7f81-4649-a90a-a52cf78dbeca while it is in vm_state shelved_offloaded Oct 17 13:47:21.833096 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:47:21.837502 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-497d72ad-bf8b-480c-8956-d2ab238c163b tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Returning 409 to user: Cannot 'shelve' instance 5ef00d34-7f81-4649-a90a-a52cf78dbeca while it is in vm_state shelved_offloaded {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:47:21.838663 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-497d72ad-bf8b-480c-8956-d2ab238c163b tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "POST /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca/action" status: 409 len: 155 microversion: 2.1 time: 0.074368 Oct 17 13:47:21.843765 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1540/3056] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:47:21 2022] POST /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca/action => generated 155 bytes in 80 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:47:21.849662 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ed2f1b08-68ef-48fe-8089-189bc2b59a8e tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:21.850624 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ed2f1b08-68ef-48fe-8089-189bc2b59a8e tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] [instance: 61ef701e-38b1-42a5-a604-89d2e3403033] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:21.857866 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ed2f1b08-68ef-48fe-8089-189bc2b59a8e tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:21.858710 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ed2f1b08-68ef-48fe-8089-189bc2b59a8e tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:21.859471 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ed2f1b08-68ef-48fe-8089-189bc2b59a8e tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:21.860478 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ed2f1b08-68ef-48fe-8089-189bc2b59a8e tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:21.861259 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ed2f1b08-68ef-48fe-8089-189bc2b59a8e tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:21.861906 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ed2f1b08-68ef-48fe-8089-189bc2b59a8e tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:24.144907 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ed2f1b08-68ef-48fe-8089-189bc2b59a8e tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f234ed5b074fb5b2596aa3dd59882e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04b218c7b78b4c89baaf0cf4cb9a5fc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:24.162152 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ed2f1b08-68ef-48fe-8089-189bc2b59a8e tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14f234ed5b074fb5b2596aa3dd59882e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04b218c7b78b4c89baaf0cf4cb9a5fc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:24.164216 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ed2f1b08-68ef-48fe-8089-189bc2b59a8e tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14f234ed5b074fb5b2596aa3dd59882e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04b218c7b78b4c89baaf0cf4cb9a5fc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:24.165575 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ed2f1b08-68ef-48fe-8089-189bc2b59a8e tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] 10.222.0.79 "GET /compute/v2.1/servers/61ef701e-38b1-42a5-a604-89d2e3403033" status: 200 len: 1358 microversion: 2.21 time: 2.320304 Oct 17 13:47:24.185405 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1541/3057] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:47:21 2022] GET /compute/v2.1/servers/61ef701e-38b1-42a5-a604-89d2e3403033 => generated 1358 bytes in 2340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:47:24.198808 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b800dfba-db99-404a-bb48-8ee0a2609442 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:24.257705 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:47:24.296010 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b800dfba-db99-404a-bb48-8ee0a2609442 tempest-ServerGroupTestJSON-1646380418 tempest-ServerGroupTestJSON-1646380418-project] 10.222.0.79 "DELETE /compute/v2.1/os-server-groups/3c4c75ab-df90-4892-8eb8-1681a8a3f288" status: 204 len: 0 microversion: 2.1 time: 0.109178 Oct 17 13:47:24.298221 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1542/3058] 10.222.0.79 () {58 vars in 1266 bytes} [Mon Oct 17 13:47:24 2022] DELETE /compute/v2.1/os-server-groups/3c4c75ab-df90-4892-8eb8-1681a8a3f288 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:47:24.306431 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-454f6cf4-540c-488f-b368-cb1319a24afc tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:47:24.308434 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-454f6cf4-540c-488f-b368-cb1319a24afc tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:24.330164 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-454f6cf4-540c-488f-b368-cb1319a24afc tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:24.331070 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-454f6cf4-540c-488f-b368-cb1319a24afc tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:24.334800 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-454f6cf4-540c-488f-b368-cb1319a24afc tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:24.360765 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-454f6cf4-540c-488f-b368-cb1319a24afc tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:24.366873 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-454f6cf4-540c-488f-b368-cb1319a24afc tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:24.368069 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-454f6cf4-540c-488f-b368-cb1319a24afc tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:24.588197 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-454f6cf4-540c-488f-b368-cb1319a24afc tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127016) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 17 13:47:24.793776 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-454f6cf4-540c-488f-b368-cb1319a24afc tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "POST /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca/action" status: 202 len: 0 microversion: 2.1 time: 0.494093 Oct 17 13:47:24.794409 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1543/3059] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:47:24 2022] POST /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca/action => generated 0 bytes in 495 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:47:24.836555 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-66089ec4-a3f0-436e-b6bf-38e01bf5b45e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:24.837416 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-66089ec4-a3f0-436e-b6bf-38e01bf5b45e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9d1105b3-be41-4963-a86b-6f4486d1d382] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:24.846641 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-66089ec4-a3f0-436e-b6bf-38e01bf5b45e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:24.847776 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-66089ec4-a3f0-436e-b6bf-38e01bf5b45e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:24.848388 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-66089ec4-a3f0-436e-b6bf-38e01bf5b45e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:24.850406 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-66089ec4-a3f0-436e-b6bf-38e01bf5b45e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:24.851685 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-66089ec4-a3f0-436e-b6bf-38e01bf5b45e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:24.852332 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-66089ec4-a3f0-436e-b6bf-38e01bf5b45e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:25.379151 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-4cc89ed1-6341-4e69-9548-e3182d179fd8 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] [instance: 29fb8b41-6dcb-49f2-9e1c-11719cace5d9] Building network info cache for instance {{(pid=127017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 17 13:47:26.166424 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-66089ec4-a3f0-436e-b6bf-38e01bf5b45e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:26.191882 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-66089ec4-a3f0-436e-b6bf-38e01bf5b45e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382" status: 200 len: 1470 microversion: 2.1 time: 1.380913 Oct 17 13:47:26.193131 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1544/3060] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:24 2022] GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382 => generated 1470 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:26.204228 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5b481622-341d-460a-822f-44f52ba886ea tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:26.205415 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5b481622-341d-460a-822f-44f52ba886ea tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] [instance: 531b762d-db7e-4911-af50-6b321b7706bf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:26.218264 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5b481622-341d-460a-822f-44f52ba886ea tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:26.223045 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5b481622-341d-460a-822f-44f52ba886ea tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:26.223817 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5b481622-341d-460a-822f-44f52ba886ea tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:26.224683 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5b481622-341d-460a-822f-44f52ba886ea tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:26.225254 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5b481622-341d-460a-822f-44f52ba886ea tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:26.225782 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5b481622-341d-460a-822f-44f52ba886ea tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:26.655074 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5b481622-341d-460a-822f-44f52ba886ea tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:26.667121 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5b481622-341d-460a-822f-44f52ba886ea tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:26.681313 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5b481622-341d-460a-822f-44f52ba886ea tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:26.683366 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5b481622-341d-460a-822f-44f52ba886ea tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] 10.222.0.79 "GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf" status: 200 len: 1661 microversion: 2.42 time: 0.488885 Oct 17 13:47:26.685147 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1545/3061] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:47:26 2022] GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf => generated 1661 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:47:26.692575 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-64ee1228-c229-467b-9010-7b8994d8bb3b tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-446720662", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "84644223-f25c-4ea7-9eab-bdb2dffe59df"}], "security_groups": [{"name": "tempest-securitygroup--469111972"}], "key_name": "tempest-keypair-80570820", "user_data": "}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:47:26.743832 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:47:27.146874 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-64ee1228-c229-467b-9010-7b8994d8bb3b tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] validate_networks() for [('84644223-f25c-4ea7-9eab-bdb2dffe59df', None, None, None, None, None)] {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:47:27.808349 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-4cc89ed1-6341-4e69-9548-e3182d179fd8 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] [instance: 29fb8b41-6dcb-49f2-9e1c-11719cace5d9] Updating instance_info_cache with network_info: [{"id": "9025275f-f4f7-42ab-bf78-e79c39398580", "address": "fa:16:3e:21:c6:ae", "network": {"id": "78e524a2-ee09-4045-aff8-792bc0397f6e", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1866044046-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "18f91db965084796a4a3dce1b4e921e5", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9025275f-f4", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 17 13:47:27.834156 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4cc89ed1-6341-4e69-9548-e3182d179fd8 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Releasing lock "refresh_cache-29fb8b41-6dcb-49f2-9e1c-11719cace5d9" {{(pid=127017) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 17 13:47:27.835047 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4cc89ed1-6341-4e69-9548-e3182d179fd8 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] 10.222.0.79 "POST /compute/v2.1/servers/29fb8b41-6dcb-49f2-9e1c-11719cace5d9/action" status: 202 len: 0 microversion: 2.1 time: 7.629135 Oct 17 13:47:27.839268 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1517/3062] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:47:20 2022] POST /compute/v2.1/servers/29fb8b41-6dcb-49f2-9e1c-11719cace5d9/action => generated 0 bytes in 7634 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 17 13:47:27.844453 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-fa52c551-0906-46ef-b809-fef3626e281f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:27.845269 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-fa52c551-0906-46ef-b809-fef3626e281f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:27.863138 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fa52c551-0906-46ef-b809-fef3626e281f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:27.864011 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fa52c551-0906-46ef-b809-fef3626e281f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:27.864697 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fa52c551-0906-46ef-b809-fef3626e281f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:27.865577 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fa52c551-0906-46ef-b809-fef3626e281f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:27.866179 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fa52c551-0906-46ef-b809-fef3626e281f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:27.866750 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fa52c551-0906-46ef-b809-fef3626e281f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:27.970739 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=4 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:47:28.792783 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=8 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:47:28.982891 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-fa52c551-0906-46ef-b809-fef3626e281f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:28.993770 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-fa52c551-0906-46ef-b809-fef3626e281f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1519 microversion: 2.1 time: 1.151513 Oct 17 13:47:28.999234 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1518/3063] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:27 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1519 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:29.004595 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-cacde1c3-22df-4eac-91fe-5f6dacefd9ce tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:29.012990 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-cacde1c3-22df-4eac-91fe-5f6dacefd9ce tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] [instance: 61ef701e-38b1-42a5-a604-89d2e3403033] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:29.022464 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cacde1c3-22df-4eac-91fe-5f6dacefd9ce tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:29.025817 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cacde1c3-22df-4eac-91fe-5f6dacefd9ce tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:29.026379 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cacde1c3-22df-4eac-91fe-5f6dacefd9ce tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:29.027254 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cacde1c3-22df-4eac-91fe-5f6dacefd9ce tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:29.027826 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cacde1c3-22df-4eac-91fe-5f6dacefd9ce tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:29.037997 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cacde1c3-22df-4eac-91fe-5f6dacefd9ce tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:29.250676 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-64ee1228-c229-467b-9010-7b8994d8bb3b tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:47:29.251390 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-64ee1228-c229-467b-9010-7b8994d8bb3b tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:47:29.252011 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-64ee1228-c229-467b-9010-7b8994d8bb3b tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:47:29.252543 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-64ee1228-c229-467b-9010-7b8994d8bb3b tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:47:29.253065 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-64ee1228-c229-467b-9010-7b8994d8bb3b tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:47:29.271463 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-64ee1228-c229-467b-9010-7b8994d8bb3b tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:29.272137 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-64ee1228-c229-467b-9010-7b8994d8bb3b tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:29.272687 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-64ee1228-c229-467b-9010-7b8994d8bb3b tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:29.273551 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-64ee1228-c229-467b-9010-7b8994d8bb3b tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:29.284093 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-64ee1228-c229-467b-9010-7b8994d8bb3b tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:29.284892 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-64ee1228-c229-467b-9010-7b8994d8bb3b tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:29.313905 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-64ee1228-c229-467b-9010-7b8994d8bb3b tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Getting quotas for project 11973b8e1d8a4af8add65726e8ba7c83. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:47:29.319658 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-64ee1228-c229-467b-9010-7b8994d8bb3b tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Getting quotas for user 683d18db860a4d60ab3eeba2a372b2c5 and project 11973b8e1d8a4af8add65726e8ba7c83. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:47:29.350994 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-64ee1228-c229-467b-9010-7b8994d8bb3b tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:47:29.359939 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-64ee1228-c229-467b-9010-7b8994d8bb3b tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: a2994495-366a-446f-b7a6-16340911e17c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:47:29.402647 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-cacde1c3-22df-4eac-91fe-5f6dacefd9ce tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f234ed5b074fb5b2596aa3dd59882e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04b218c7b78b4c89baaf0cf4cb9a5fc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:29.411736 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-cacde1c3-22df-4eac-91fe-5f6dacefd9ce tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14f234ed5b074fb5b2596aa3dd59882e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04b218c7b78b4c89baaf0cf4cb9a5fc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:29.417278 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-cacde1c3-22df-4eac-91fe-5f6dacefd9ce tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14f234ed5b074fb5b2596aa3dd59882e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04b218c7b78b4c89baaf0cf4cb9a5fc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:29.421786 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-cacde1c3-22df-4eac-91fe-5f6dacefd9ce tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] 10.222.0.79 "GET /compute/v2.1/servers/61ef701e-38b1-42a5-a604-89d2e3403033" status: 200 len: 1552 microversion: 2.21 time: 0.420994 Oct 17 13:47:29.425605 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1519/3064] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:47:28 2022] GET /compute/v2.1/servers/61ef701e-38b1-42a5-a604-89d2e3403033 => generated 1552 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:47:29.430621 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-db922dd4-99aa-41e0-a1cd-615d9aec30c0 req-00b10d2f-45a8-4aad-b540-bfa7c723c5ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29fb8b41-6dcb-49f2-9e1c-11719cace5d9", "tag": "9025275f-f4f7-42ab-bf78-e79c39398580"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:47:29.456466 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-db922dd4-99aa-41e0-a1cd-615d9aec30c0 req-00b10d2f-45a8-4aad-b540-bfa7c723c5ca service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:29.457367 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-db922dd4-99aa-41e0-a1cd-615d9aec30c0 req-00b10d2f-45a8-4aad-b540-bfa7c723c5ca service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:29.458035 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-db922dd4-99aa-41e0-a1cd-615d9aec30c0 req-00b10d2f-45a8-4aad-b540-bfa7c723c5ca service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:29.468099 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-64ee1228-c229-467b-9010-7b8994d8bb3b tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.781580 Oct 17 13:47:29.481092 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1546/3065] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:47:26 2022] POST /compute/v2.1/servers => generated 401 bytes in 2795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:47:29.496666 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-06f24761-1dc8-48f8-ad54-99491f85a7cf tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:29.498376 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-06f24761-1dc8-48f8-ad54-99491f85a7cf tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9d1105b3-be41-4963-a86b-6f4486d1d382] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:29.510066 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-06f24761-1dc8-48f8-ad54-99491f85a7cf tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:29.510737 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-06f24761-1dc8-48f8-ad54-99491f85a7cf tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:29.512105 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-06f24761-1dc8-48f8-ad54-99491f85a7cf tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:29.527998 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-06f24761-1dc8-48f8-ad54-99491f85a7cf tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:29.528884 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-06f24761-1dc8-48f8-ad54-99491f85a7cf tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:29.529483 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-06f24761-1dc8-48f8-ad54-99491f85a7cf tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:29.532380 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-db922dd4-99aa-41e0-a1cd-615d9aec30c0 req-00b10d2f-45a8-4aad-b540-bfa7c723c5ca service nova] Creating event network-changed:9025275f-f4f7-42ab-bf78-e79c39398580 for instance 29fb8b41-6dcb-49f2-9e1c-11719cace5d9 on n-h1-854247-14 Oct 17 13:47:29.554492 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-db922dd4-99aa-41e0-a1cd-615d9aec30c0 req-00b10d2f-45a8-4aad-b540-bfa7c723c5ca service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127155 Oct 17 13:47:29.560771 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1520/3066] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:47:29.574792 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-419048dc-46f6-42e8-b827-cb18f4bc86ca tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:29.581860 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-419048dc-46f6-42e8-b827-cb18f4bc86ca tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] [instance: 531b762d-db7e-4911-af50-6b321b7706bf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:29.604607 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-419048dc-46f6-42e8-b827-cb18f4bc86ca tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:29.605287 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-419048dc-46f6-42e8-b827-cb18f4bc86ca tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:29.605841 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-419048dc-46f6-42e8-b827-cb18f4bc86ca tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:29.606689 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-419048dc-46f6-42e8-b827-cb18f4bc86ca tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:29.607429 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-419048dc-46f6-42e8-b827-cb18f4bc86ca tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:29.614312 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-419048dc-46f6-42e8-b827-cb18f4bc86ca tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:30.187459 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-419048dc-46f6-42e8-b827-cb18f4bc86ca tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:30.200302 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-419048dc-46f6-42e8-b827-cb18f4bc86ca tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:30.202451 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-419048dc-46f6-42e8-b827-cb18f4bc86ca tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:30.203270 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-06f24761-1dc8-48f8-ad54-99491f85a7cf tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:30.204018 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-419048dc-46f6-42e8-b827-cb18f4bc86ca tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] 10.222.0.79 "GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf" status: 200 len: 1708 microversion: 2.42 time: 0.635384 Oct 17 13:47:30.204685 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1521/3067] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:47:29 2022] GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf => generated 1708 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:47:30.220560 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-06f24761-1dc8-48f8-ad54-99491f85a7cf tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382" status: 200 len: 1462 microversion: 2.1 time: 0.734958 Oct 17 13:47:30.223212 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2c2cf624-6c3e-4a3a-b654-6f0f00895acd tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:30.224007 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2c2cf624-6c3e-4a3a-b654-6f0f00895acd tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] [instance: 29fb8b41-6dcb-49f2-9e1c-11719cace5d9] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:30.230604 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2c2cf624-6c3e-4a3a-b654-6f0f00895acd tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:30.231446 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2c2cf624-6c3e-4a3a-b654-6f0f00895acd tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:30.232131 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2c2cf624-6c3e-4a3a-b654-6f0f00895acd tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:30.233058 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2c2cf624-6c3e-4a3a-b654-6f0f00895acd tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:30.233723 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2c2cf624-6c3e-4a3a-b654-6f0f00895acd tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:30.234397 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2c2cf624-6c3e-4a3a-b654-6f0f00895acd tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:30.240102 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1547/3068] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:29 2022] GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382 => generated 1462 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:30.249011 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-27029b64-0070-4ed0-bc92-9c05e9cb2e2a tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Action: 'create', calling method: .version_select at 0x7f7cd4f87c10>, body: {"keypair": {"name": "tempest-keypair-1248928397", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSh712zZzXpCkqGTuLp3oTh5Eqkha7yzeHIaBW2j++CWUM4TYdewz+48x9Q1LqloWl9mOmZopzKx6qIKl0F7yB4v90WuP0lAh6m7lcm299Hjty08S0nGNBlweGxXzpC4w=="}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:47:30.264971 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2c2cf624-6c3e-4a3a-b654-6f0f00895acd tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] [instance: 29fb8b41-6dcb-49f2-9e1c-11719cace5d9] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:47:30.271041 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-27029b64-0070-4ed0-bc92-9c05e9cb2e2a tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Getting quotas for project cfbeaa08d8384042a26c865a2efba214. Resources: {'key_pairs'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:47:30.279344 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-27029b64-0070-4ed0-bc92-9c05e9cb2e2a tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Getting quotas for user e02c176dc1a6460882ca3969d52c195b and project cfbeaa08d8384042a26c865a2efba214. Resources: {'key_pairs'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:47:30.314152 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-27029b64-0070-4ed0-bc92-9c05e9cb2e2a tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.071191 Oct 17 13:47:30.315651 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1548/3069] 10.222.0.79 () {62 vars in 1200 bytes} [Mon Oct 17 13:47:30 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 75 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 17 13:47:30.323015 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-abf2c191-dc08-41bc-b45c-c619aac88f94 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:30.323962 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-abf2c191-dc08-41bc-b45c-c619aac88f94 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] [instance: 61ef701e-38b1-42a5-a604-89d2e3403033] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:30.339953 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-abf2c191-dc08-41bc-b45c-c619aac88f94 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:30.342129 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-abf2c191-dc08-41bc-b45c-c619aac88f94 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:30.342582 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-abf2c191-dc08-41bc-b45c-c619aac88f94 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:30.346515 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-abf2c191-dc08-41bc-b45c-c619aac88f94 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:30.346950 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-abf2c191-dc08-41bc-b45c-c619aac88f94 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:30.349086 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-abf2c191-dc08-41bc-b45c-c619aac88f94 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:30.399936 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-abf2c191-dc08-41bc-b45c-c619aac88f94 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] [instance: 61ef701e-38b1-42a5-a604-89d2e3403033] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:47:30.450572 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2c2cf624-6c3e-4a3a-b654-6f0f00895acd tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] 10.222.0.79 "DELETE /compute/v2.1/servers/29fb8b41-6dcb-49f2-9e1c-11719cace5d9" status: 204 len: 0 microversion: 2.1 time: 0.231685 Oct 17 13:47:30.451636 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1522/3070] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:47:30 2022] DELETE /compute/v2.1/servers/29fb8b41-6dcb-49f2-9e1c-11719cace5d9 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:47:30.458109 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3ab75b18-3add-42d4-97d6-48213f188470 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:30.476975 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3ab75b18-3add-42d4-97d6-48213f188470 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: a2994495-366a-446f-b7a6-16340911e17c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:30.498894 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3ab75b18-3add-42d4-97d6-48213f188470 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:30.499421 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3ab75b18-3add-42d4-97d6-48213f188470 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:30.499854 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3ab75b18-3add-42d4-97d6-48213f188470 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:30.504184 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3ab75b18-3add-42d4-97d6-48213f188470 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:30.506213 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3ab75b18-3add-42d4-97d6-48213f188470 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:30.506817 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3ab75b18-3add-42d4-97d6-48213f188470 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:30.566324 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-abf2c191-dc08-41bc-b45c-c619aac88f94 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] 10.222.0.79 "DELETE /compute/v2.1/servers/61ef701e-38b1-42a5-a604-89d2e3403033" status: 204 len: 0 microversion: 2.21 time: 0.248681 Oct 17 13:47:30.568858 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1549/3071] 10.222.0.79 () {60 vars in 1280 bytes} [Mon Oct 17 13:47:30 2022] DELETE /compute/v2.1/servers/61ef701e-38b1-42a5-a604-89d2e3403033 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:47:30.578550 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-838b8ea2-f1e6-4177-a769-f64670426592 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:30.580031 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-838b8ea2-f1e6-4177-a769-f64670426592 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:30.591716 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-838b8ea2-f1e6-4177-a769-f64670426592 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:30.594055 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-838b8ea2-f1e6-4177-a769-f64670426592 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:30.596876 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-838b8ea2-f1e6-4177-a769-f64670426592 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:30.599916 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-838b8ea2-f1e6-4177-a769-f64670426592 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:30.603063 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-838b8ea2-f1e6-4177-a769-f64670426592 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:30.603544 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-838b8ea2-f1e6-4177-a769-f64670426592 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:30.731429 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3ab75b18-3add-42d4-97d6-48213f188470 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683d18db860a4d60ab3eeba2a372b2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11973b8e1d8a4af8add65726e8ba7c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:30.740676 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3ab75b18-3add-42d4-97d6-48213f188470 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c" status: 200 len: 1239 microversion: 2.1 time: 0.287527 Oct 17 13:47:30.741268 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1523/3072] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:30 2022] GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c => generated 1239 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:30.764732 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1f5544a4-71b1-462b-931d-cccdc75e275b tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:30.768108 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1f5544a4-71b1-462b-931d-cccdc75e275b tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] [instance: 9d1105b3-be41-4963-a86b-6f4486d1d382] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:30.784217 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1f5544a4-71b1-462b-931d-cccdc75e275b tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:30.785010 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1f5544a4-71b1-462b-931d-cccdc75e275b tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:30.785709 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1f5544a4-71b1-462b-931d-cccdc75e275b tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:30.786588 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1f5544a4-71b1-462b-931d-cccdc75e275b tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:30.789558 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1f5544a4-71b1-462b-931d-cccdc75e275b tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:30.790210 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1f5544a4-71b1-462b-931d-cccdc75e275b tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:30.903571 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-838b8ea2-f1e6-4177-a769-f64670426592 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:30.916728 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-838b8ea2-f1e6-4177-a769-f64670426592 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1519 microversion: 2.1 time: 0.345528 Oct 17 13:47:30.917844 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1550/3073] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:30 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1519 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:30.936355 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1baaf45c-0630-4433-ab33-4a769a547782 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.0.129"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:47:30.940214 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-1baaf45c-0630-4433-ab33-4a769a547782 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] [instance: 50e9eae9-df55-48ee-b984-e6b7e4bb2628] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:30.954771 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1baaf45c-0630-4433-ab33-4a769a547782 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:30.957925 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1baaf45c-0630-4433-ab33-4a769a547782 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:30.958589 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1baaf45c-0630-4433-ab33-4a769a547782 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:30.959699 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1baaf45c-0630-4433-ab33-4a769a547782 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:30.966382 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1baaf45c-0630-4433-ab33-4a769a547782 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:30.967040 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1baaf45c-0630-4433-ab33-4a769a547782 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:31.040404 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1baaf45c-0630-4433-ab33-4a769a547782 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "refresh_cache-50e9eae9-df55-48ee-b984-e6b7e4bb2628" {{(pid=127016) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 17 13:47:31.040806 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1baaf45c-0630-4433-ab33-4a769a547782 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquired lock "refresh_cache-50e9eae9-df55-48ee-b984-e6b7e4bb2628" {{(pid=127016) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 17 13:47:31.242861 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1f5544a4-71b1-462b-931d-cccdc75e275b tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382" status: 200 len: 1615 microversion: 2.1 time: 0.485117 Oct 17 13:47:31.243582 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1524/3074] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:30 2022] GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382 => generated 1615 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:31.269674 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0f1e2af5-ee6b-4c75-9ce2-cc9400779434 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:31.270405 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0f1e2af5-ee6b-4c75-9ce2-cc9400779434 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] [instance: 61ef701e-38b1-42a5-a604-89d2e3403033] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:31.291952 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0f1e2af5-ee6b-4c75-9ce2-cc9400779434 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:31.292444 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0f1e2af5-ee6b-4c75-9ce2-cc9400779434 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:31.300746 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0f1e2af5-ee6b-4c75-9ce2-cc9400779434 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:31.301822 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0f1e2af5-ee6b-4c75-9ce2-cc9400779434 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:31.302442 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0f1e2af5-ee6b-4c75-9ce2-cc9400779434 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:31.303217 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0f1e2af5-ee6b-4c75-9ce2-cc9400779434 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:31.380442 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=89,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=4,nova_cell1:RELEASE=3,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:47:32.352447 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0f1e2af5-ee6b-4c75-9ce2-cc9400779434 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f234ed5b074fb5b2596aa3dd59882e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04b218c7b78b4c89baaf0cf4cb9a5fc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:32.368625 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0f1e2af5-ee6b-4c75-9ce2-cc9400779434 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14f234ed5b074fb5b2596aa3dd59882e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04b218c7b78b4c89baaf0cf4cb9a5fc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:32.374410 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0f1e2af5-ee6b-4c75-9ce2-cc9400779434 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14f234ed5b074fb5b2596aa3dd59882e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04b218c7b78b4c89baaf0cf4cb9a5fc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:32.381096 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0f1e2af5-ee6b-4c75-9ce2-cc9400779434 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] 10.222.0.79 "GET /compute/v2.1/servers/61ef701e-38b1-42a5-a604-89d2e3403033" status: 200 len: 1558 microversion: 2.21 time: 1.133045 Oct 17 13:47:32.383267 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1525/3075] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:47:31 2022] GET /compute/v2.1/servers/61ef701e-38b1-42a5-a604-89d2e3403033 => generated 1558 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:47:32.393471 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-cf36d213-8b42-42eb-9584-543b2f30ba7a tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:32.394094 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-cf36d213-8b42-42eb-9584-543b2f30ba7a tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] [instance: 531b762d-db7e-4911-af50-6b321b7706bf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:32.409031 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cf36d213-8b42-42eb-9584-543b2f30ba7a tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:32.411426 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cf36d213-8b42-42eb-9584-543b2f30ba7a tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:32.415325 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cf36d213-8b42-42eb-9584-543b2f30ba7a tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:32.416355 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cf36d213-8b42-42eb-9584-543b2f30ba7a tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:32.418037 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cf36d213-8b42-42eb-9584-543b2f30ba7a tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:32.418633 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cf36d213-8b42-42eb-9584-543b2f30ba7a tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:33.606904 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-cf36d213-8b42-42eb-9584-543b2f30ba7a tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:33.620746 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-cf36d213-8b42-42eb-9584-543b2f30ba7a tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:33.629301 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-cf36d213-8b42-42eb-9584-543b2f30ba7a tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:33.631675 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-cf36d213-8b42-42eb-9584-543b2f30ba7a tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] 10.222.0.79 "GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf" status: 200 len: 1755 microversion: 2.42 time: 1.247018 Oct 17 13:47:33.632771 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1526/3076] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:47:32 2022] GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf => generated 1755 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:47:33.637898 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-82c7b408-0a36-4b53-b08a-825ac8aa9460 tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] Calling method '.version_select at 0x7f7cd5548af0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:33.642383 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82c7b408-0a36-4b53-b08a-825ac8aa9460 tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:33.643208 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82c7b408-0a36-4b53-b08a-825ac8aa9460 tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:33.643912 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82c7b408-0a36-4b53-b08a-825ac8aa9460 tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:33.652907 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-82c7b408-0a36-4b53-b08a-825ac8aa9460 tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] 10.222.0.79 "GET /compute/v2.1/os-migrations" status: 200 len: 413 microversion: 2.1 time: 0.018883 Oct 17 13:47:33.655142 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1527/3077] 10.222.0.79 () {58 vars in 1143 bytes} [Mon Oct 17 13:47:33 2022] GET /compute/v2.1/os-migrations => generated 413 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:47:33.660930 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-db055e26-1095-4af7-8230-b010878c2b46 req-7cd674b5-2270-4a2b-b906-b17cc74e2e5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ef00d34-7f81-4649-a90a-a52cf78dbeca", "tag": "841d5cd2-6ca1-435c-ac29-bfeee122d7fe"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:47:33.673411 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-db055e26-1095-4af7-8230-b010878c2b46 req-7cd674b5-2270-4a2b-b906-b17cc74e2e5f service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:33.682978 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-db055e26-1095-4af7-8230-b010878c2b46 req-7cd674b5-2270-4a2b-b906-b17cc74e2e5f service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:33.688872 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-db055e26-1095-4af7-8230-b010878c2b46 req-7cd674b5-2270-4a2b-b906-b17cc74e2e5f service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:33.721826 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-db055e26-1095-4af7-8230-b010878c2b46 req-7cd674b5-2270-4a2b-b906-b17cc74e2e5f service nova] Creating event network-changed:841d5cd2-6ca1-435c-ac29-bfeee122d7fe for instance 5ef00d34-7f81-4649-a90a-a52cf78dbeca on n-h2-854247-14 Oct 17 13:47:33.733947 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-db055e26-1095-4af7-8230-b010878c2b46 req-7cd674b5-2270-4a2b-b906-b17cc74e2e5f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077157 Oct 17 13:47:33.739678 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1528/3078] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:47:33.751830 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c7d38e8a-028e-4bbd-a2d8-b5bb833ac143 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:33.753858 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c7d38e8a-028e-4bbd-a2d8-b5bb833ac143 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: a2994495-366a-446f-b7a6-16340911e17c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:33.771250 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7d38e8a-028e-4bbd-a2d8-b5bb833ac143 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:33.772957 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7d38e8a-028e-4bbd-a2d8-b5bb833ac143 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:33.773992 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7d38e8a-028e-4bbd-a2d8-b5bb833ac143 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:33.776465 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7d38e8a-028e-4bbd-a2d8-b5bb833ac143 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:33.777254 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7d38e8a-028e-4bbd-a2d8-b5bb833ac143 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:33.778708 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7d38e8a-028e-4bbd-a2d8-b5bb833ac143 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:34.351303 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c7d38e8a-028e-4bbd-a2d8-b5bb833ac143 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683d18db860a4d60ab3eeba2a372b2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11973b8e1d8a4af8add65726e8ba7c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:34.375433 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c7d38e8a-028e-4bbd-a2d8-b5bb833ac143 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c" status: 200 len: 1293 microversion: 2.1 time: 0.632887 Oct 17 13:47:34.399289 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1529/3079] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:33 2022] GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c => generated 1293 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:34.406792 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9db06991-5d59-42cb-ab1c-556d1db2f595 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:34.408485 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9db06991-5d59-42cb-ab1c-556d1db2f595 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:34.416362 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9db06991-5d59-42cb-ab1c-556d1db2f595 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:34.417049 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9db06991-5d59-42cb-ab1c-556d1db2f595 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:34.417923 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9db06991-5d59-42cb-ab1c-556d1db2f595 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:34.418558 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9db06991-5d59-42cb-ab1c-556d1db2f595 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:34.419939 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9db06991-5d59-42cb-ab1c-556d1db2f595 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:34.420629 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9db06991-5d59-42cb-ab1c-556d1db2f595 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:35.615386 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9db06991-5d59-42cb-ab1c-556d1db2f595 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:35.627793 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9db06991-5d59-42cb-ab1c-556d1db2f595 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1519 microversion: 2.1 time: 1.223119 Oct 17 13:47:35.628863 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1530/3080] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:34 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1519 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:35.655883 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-64650981-c683-46f1-9f93-151a84dcce93 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:35.659764 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-64650981-c683-46f1-9f93-151a84dcce93 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] [instance: 61ef701e-38b1-42a5-a604-89d2e3403033] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:35.676905 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-64650981-c683-46f1-9f93-151a84dcce93 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:35.677762 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-64650981-c683-46f1-9f93-151a84dcce93 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:35.679121 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-64650981-c683-46f1-9f93-151a84dcce93 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:35.680133 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-64650981-c683-46f1-9f93-151a84dcce93 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:35.681006 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-64650981-c683-46f1-9f93-151a84dcce93 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:35.681886 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-64650981-c683-46f1-9f93-151a84dcce93 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:36.198713 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-64650981-c683-46f1-9f93-151a84dcce93 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f234ed5b074fb5b2596aa3dd59882e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04b218c7b78b4c89baaf0cf4cb9a5fc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:36.208555 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-64650981-c683-46f1-9f93-151a84dcce93 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14f234ed5b074fb5b2596aa3dd59882e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04b218c7b78b4c89baaf0cf4cb9a5fc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:36.217255 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-64650981-c683-46f1-9f93-151a84dcce93 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14f234ed5b074fb5b2596aa3dd59882e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04b218c7b78b4c89baaf0cf4cb9a5fc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:36.218890 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-64650981-c683-46f1-9f93-151a84dcce93 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] 10.222.0.79 "GET /compute/v2.1/servers/61ef701e-38b1-42a5-a604-89d2e3403033" status: 200 len: 1516 microversion: 2.21 time: 0.572009 Oct 17 13:47:36.220988 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1531/3081] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:47:35 2022] GET /compute/v2.1/servers/61ef701e-38b1-42a5-a604-89d2e3403033 => generated 1516 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:47:36.227873 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-730b3379-2492-471e-b867-63bbe645f3b7 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-597383841", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:47:36.369886 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-730b3379-2492-471e-b867-63bbe645f3b7 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] validate_networks() for None {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:47:36.852856 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-1baaf45c-0630-4433-ab33-4a769a547782 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] [instance: 50e9eae9-df55-48ee-b984-e6b7e4bb2628] Building network info cache for instance {{(pid=127016) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 17 13:47:39.295429 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:47:39.830826 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-730b3379-2492-471e-b867-63bbe645f3b7 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:47:39.831485 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-730b3379-2492-471e-b867-63bbe645f3b7 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:47:39.831751 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-730b3379-2492-471e-b867-63bbe645f3b7 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:47:39.832163 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-730b3379-2492-471e-b867-63bbe645f3b7 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:47:39.832578 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-730b3379-2492-471e-b867-63bbe645f3b7 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:47:39.849518 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-730b3379-2492-471e-b867-63bbe645f3b7 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:39.850055 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-730b3379-2492-471e-b867-63bbe645f3b7 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:39.850500 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-730b3379-2492-471e-b867-63bbe645f3b7 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:39.851264 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-730b3379-2492-471e-b867-63bbe645f3b7 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:39.851724 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-730b3379-2492-471e-b867-63bbe645f3b7 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:39.852152 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-730b3379-2492-471e-b867-63bbe645f3b7 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:39.956938 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-730b3379-2492-471e-b867-63bbe645f3b7 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Getting quotas for project 5b98e3f377c14838a31cc430c98855e1. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:47:39.970982 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-730b3379-2492-471e-b867-63bbe645f3b7 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Getting quotas for user 0906fe70cb054729bfb95b2196c1a5d3 and project 5b98e3f377c14838a31cc430c98855e1. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:47:40.015116 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-730b3379-2492-471e-b867-63bbe645f3b7 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:47:40.019844 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-730b3379-2492-471e-b867-63bbe645f3b7 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9eaf1302-c967-4a24-8772-df5b32f11a60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:47:40.143881 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-730b3379-2492-471e-b867-63bbe645f3b7 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.917625 Oct 17 13:47:40.144810 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1532/3082] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:47:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 3921 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:47:40.157656 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-5717352b-6382-4943-9bf9-cff79bf6dd91 req-9dc43b5d-2bca-476e-9ef9-8c00fd894095 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29fb8b41-6dcb-49f2-9e1c-11719cace5d9", "name": "network-vif-deleted", "tag": "9025275f-f4f7-42ab-bf78-e79c39398580"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:47:40.194023 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-5717352b-6382-4943-9bf9-cff79bf6dd91 req-9dc43b5d-2bca-476e-9ef9-8c00fd894095 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:40.209203 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-5717352b-6382-4943-9bf9-cff79bf6dd91 req-9dc43b5d-2bca-476e-9ef9-8c00fd894095 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:40.211239 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-5717352b-6382-4943-9bf9-cff79bf6dd91 req-9dc43b5d-2bca-476e-9ef9-8c00fd894095 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:40.281456 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-5717352b-6382-4943-9bf9-cff79bf6dd91 req-9dc43b5d-2bca-476e-9ef9-8c00fd894095 service nova] Creating event network-vif-deleted:9025275f-f4f7-42ab-bf78-e79c39398580 for instance 29fb8b41-6dcb-49f2-9e1c-11719cace5d9 on n-h1-854247-14 Oct 17 13:47:40.288323 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=10 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:47:40.298144 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-5717352b-6382-4943-9bf9-cff79bf6dd91 req-9dc43b5d-2bca-476e-9ef9-8c00fd894095 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149662 Oct 17 13:47:40.305202 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1533/3083] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:47:40.318551 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3330f15c-d87f-4ecb-a9ef-4690b590ce2e tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:40.329176 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3330f15c-d87f-4ecb-a9ef-4690b590ce2e tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] [instance: 531b762d-db7e-4911-af50-6b321b7706bf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:40.345188 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3330f15c-d87f-4ecb-a9ef-4690b590ce2e tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:40.346114 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3330f15c-d87f-4ecb-a9ef-4690b590ce2e tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:40.346782 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3330f15c-d87f-4ecb-a9ef-4690b590ce2e tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:40.348569 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3330f15c-d87f-4ecb-a9ef-4690b590ce2e tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:40.350892 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3330f15c-d87f-4ecb-a9ef-4690b590ce2e tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:40.353967 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3330f15c-d87f-4ecb-a9ef-4690b590ce2e tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:40.946443 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:DELETE=2,nova_api:SELECT=49,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:47:41.790343 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3330f15c-d87f-4ecb-a9ef-4690b590ce2e tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:41.858782 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3330f15c-d87f-4ecb-a9ef-4690b590ce2e tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:41.872477 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3330f15c-d87f-4ecb-a9ef-4690b590ce2e tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:41.892056 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3330f15c-d87f-4ecb-a9ef-4690b590ce2e tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] 10.222.0.79 "GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf" status: 200 len: 1870 microversion: 2.42 time: 1.582412 Oct 17 13:47:41.892674 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1534/3084] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:47:40 2022] GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf => generated 1870 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:47:41.924246 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-05019fed-42ce-46d2-a7f7-7a1caa8402fc tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:41.932091 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-05019fed-42ce-46d2-a7f7-7a1caa8402fc tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: a2994495-366a-446f-b7a6-16340911e17c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:41.965246 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-05019fed-42ce-46d2-a7f7-7a1caa8402fc tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:41.965760 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-05019fed-42ce-46d2-a7f7-7a1caa8402fc tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:41.972241 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-05019fed-42ce-46d2-a7f7-7a1caa8402fc tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:41.976594 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-05019fed-42ce-46d2-a7f7-7a1caa8402fc tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:41.977476 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-05019fed-42ce-46d2-a7f7-7a1caa8402fc tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:41.977931 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-05019fed-42ce-46d2-a7f7-7a1caa8402fc tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:42.193382 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-1baaf45c-0630-4433-ab33-4a769a547782 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] [instance: 50e9eae9-df55-48ee-b984-e6b7e4bb2628] Updating instance_info_cache with network_info: [{"id": "be3444eb-9f99-422e-963d-086fa4da6881", "address": "fa:16:3e:29:e0:b5", "network": {"id": "78e524a2-ee09-4045-aff8-792bc0397f6e", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1866044046-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.0.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "18f91db965084796a4a3dce1b4e921e5", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapbe3444eb-9f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127016) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 17 13:47:42.219580 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1baaf45c-0630-4433-ab33-4a769a547782 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Releasing lock "refresh_cache-50e9eae9-df55-48ee-b984-e6b7e4bb2628" {{(pid=127016) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 17 13:47:42.223054 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1baaf45c-0630-4433-ab33-4a769a547782 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] 10.222.0.79 "POST /compute/v2.1/servers/50e9eae9-df55-48ee-b984-e6b7e4bb2628/action" status: 202 len: 0 microversion: 2.1 time: 11.303878 Oct 17 13:47:42.226654 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1551/3085] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:47:30 2022] POST /compute/v2.1/servers/50e9eae9-df55-48ee-b984-e6b7e4bb2628/action => generated 0 bytes in 11308 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 17 13:47:42.239789 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-2efbfefd-f83a-4933-b635-ae6b89fb52eb req-0a37eb32-0dcb-447f-be9a-622c1a1952ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61ef701e-38b1-42a5-a604-89d2e3403033", "name": "network-vif-deleted", "tag": "af5c24ee-cc81-4bef-985a-3bb76c775bbc"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:47:42.288280 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-2efbfefd-f83a-4933-b635-ae6b89fb52eb req-0a37eb32-0dcb-447f-be9a-622c1a1952ba service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:42.288896 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-2efbfefd-f83a-4933-b635-ae6b89fb52eb req-0a37eb32-0dcb-447f-be9a-622c1a1952ba service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:42.289344 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-2efbfefd-f83a-4933-b635-ae6b89fb52eb req-0a37eb32-0dcb-447f-be9a-622c1a1952ba service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:42.302699 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-2efbfefd-f83a-4933-b635-ae6b89fb52eb req-0a37eb32-0dcb-447f-be9a-622c1a1952ba service nova] Creating event network-vif-deleted:af5c24ee-cc81-4bef-985a-3bb76c775bbc for instance 61ef701e-38b1-42a5-a604-89d2e3403033 on n-h2-854247-14 Oct 17 13:47:42.309953 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-2efbfefd-f83a-4933-b635-ae6b89fb52eb req-0a37eb32-0dcb-447f-be9a-622c1a1952ba service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080811 Oct 17 13:47:42.311462 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1552/3086] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:47:42.317440 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ab4328b0-b8d6-4bd3-856c-0b5b021a4db7 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:42.318659 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ab4328b0-b8d6-4bd3-856c-0b5b021a4db7 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:42.326539 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ab4328b0-b8d6-4bd3-856c-0b5b021a4db7 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:42.327032 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ab4328b0-b8d6-4bd3-856c-0b5b021a4db7 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:42.327562 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ab4328b0-b8d6-4bd3-856c-0b5b021a4db7 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:42.328457 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ab4328b0-b8d6-4bd3-856c-0b5b021a4db7 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:42.329121 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ab4328b0-b8d6-4bd3-856c-0b5b021a4db7 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:42.329553 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ab4328b0-b8d6-4bd3-856c-0b5b021a4db7 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:42.349598 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-05019fed-42ce-46d2-a7f7-7a1caa8402fc tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683d18db860a4d60ab3eeba2a372b2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11973b8e1d8a4af8add65726e8ba7c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:42.363757 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-05019fed-42ce-46d2-a7f7-7a1caa8402fc tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c" status: 200 len: 1360 microversion: 2.1 time: 0.464417 Oct 17 13:47:42.365867 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1535/3087] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:41 2022] GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c => generated 1360 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:42.377608 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7ce6d410-026a-44ca-a1fa-355f4631830b tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:42.378306 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7ce6d410-026a-44ca-a1fa-355f4631830b tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] [instance: 61ef701e-38b1-42a5-a604-89d2e3403033] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:42.387660 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7ce6d410-026a-44ca-a1fa-355f4631830b tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:42.388223 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7ce6d410-026a-44ca-a1fa-355f4631830b tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:42.388663 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7ce6d410-026a-44ca-a1fa-355f4631830b tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:42.389367 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7ce6d410-026a-44ca-a1fa-355f4631830b tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:42.389885 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7ce6d410-026a-44ca-a1fa-355f4631830b tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:42.390309 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7ce6d410-026a-44ca-a1fa-355f4631830b tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:42.405262 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-7ce6d410-026a-44ca-a1fa-355f4631830b tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] HTTP exception thrown: Instance 61ef701e-38b1-42a5-a604-89d2e3403033 could not be found. Oct 17 13:47:42.407041 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7ce6d410-026a-44ca-a1fa-355f4631830b tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Request method failure captured: Oct 17 13:47:42.407041 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/61ef701e-38b1-42a5-a604-89d2e3403033 HTTP/1.1 Oct 17 13:47:42.407041 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:47:42.407041 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:47:42.407041 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:47:42.407041 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:47:42.407041 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:47:42.407041 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:47:42.407041 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:47:42.407041 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:47:42.407041 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVzM0ub15VWK9dXBX2E6bOmuBMM68OX4qVdJaHdwN3wTbr3cMpon0stofcgVs6aXkM_zrwvGY81jQA76Go2ahEqrzuDnAiJNw1N_F01fFfKYVd6FRBIz94yBCubG2texd9tOHnIhjrL-u6l58jN41ha8xBahEdvH-b69o9tFXR8hQFE Oct 17 13:47:42.407041 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:47:42.407041 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:47:42.407041 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:47:42.407041 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:47:42.407041 n-d-854247-14 devstack@n-api.service[127017]: X-Openstack-Nova-Api-Version: 2.21 Oct 17 13:47:42.407041 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:47:42.407041 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:47:42.407041 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 04b218c7b78b4c89baaf0cf4cb9a5fc7 Oct 17 13:47:42.407041 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1163806185 Oct 17 13:47:42.407041 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:47:42.407041 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:47:42.407041 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/04b218c7b78b4c89baaf0cf4cb9a5fc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/04b218c7b78b4c89baaf0cf4cb9a5fc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/04b218c7b78b4c89baaf0cf4cb9a5fc7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_04b218c7b78b4c89baaf0cf4cb9a5fc7", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:47:42.407041 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-InstanceActionsV221TestJSON-1163806185 Oct 17 13:47:42.407041 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 04b218c7b78b4c89baaf0cf4cb9a5fc7 Oct 17 13:47:42.407041 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1163806185 Oct 17 13:47:42.407041 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-InstanceActionsV221TestJSON-1163806185-project Oct 17 13:47:42.407041 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:47:42.407041 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:47:42.407041 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 14f234ed5b074fb5b2596aa3dd59882e Oct 17 13:47:42.407041 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-InstanceActionsV221TestJSON-1163806185-project Oct 17 13:47:42.407041 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:47:42.407041 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 61ef701e-38b1-42a5-a604-89d2e3403033 could not be found. Oct 17 13:47:42.407041 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '61ef701e-38b1-42a5-a604-89d2e3403033'} Oct 17 13:47:42.407041 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:47:42.407041 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:42.407041 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:47:42.407041 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:47:42.407041 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:47:42.407041 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:47:42.407041 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:47:42.407041 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:47:42.407041 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:47:42.407041 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:47:42.407041 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61ef701e-38b1-42a5-a604-89d2e3403033 could not be found. Oct 17 13:47:42.407041 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:47:42.407041 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:47:42.407041 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:47:42.407041 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:42.407041 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:47:42.407041 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:47:42.407041 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:47:42.407041 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:47:42.407041 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:47:42.407041 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:47:42.407041 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:47:42.407041 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:47:42.407041 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:47:42.407041 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:47:42.407041 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:47:42.407041 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:47:42.407041 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61ef701e-38b1-42a5-a604-89d2e3403033 could not be found. Oct 17 13:47:42.407041 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:47:42.407041 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:47:42.412272 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:47:42.412272 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:42.412272 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:47:42.412272 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:47:42.412272 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:47:42.412272 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:47:42.412272 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61ef701e-38b1-42a5-a604-89d2e3403033 could not be found. Oct 17 13:47:42.412272 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:47:42.412272 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7ce6d410-026a-44ca-a1fa-355f4631830b tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Returning 404 to user: Instance 61ef701e-38b1-42a5-a604-89d2e3403033 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:47:42.412272 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7ce6d410-026a-44ca-a1fa-355f4631830b tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] 10.222.0.79 "GET /compute/v2.1/servers/61ef701e-38b1-42a5-a604-89d2e3403033" status: 404 len: 111 microversion: 2.21 time: 0.041701 Oct 17 13:47:42.414639 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1536/3088] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:47:42 2022] GET /compute/v2.1/servers/61ef701e-38b1-42a5-a604-89d2e3403033 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:47:42.419342 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a2af1e4c-c258-407c-a832-239ea16382cc tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:42.419968 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a2af1e4c-c258-407c-a832-239ea16382cc tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9eaf1302-c967-4a24-8772-df5b32f11a60] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:42.426583 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a2af1e4c-c258-407c-a832-239ea16382cc tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:42.427075 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a2af1e4c-c258-407c-a832-239ea16382cc tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:42.427551 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a2af1e4c-c258-407c-a832-239ea16382cc tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:42.428260 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a2af1e4c-c258-407c-a832-239ea16382cc tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:42.428713 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a2af1e4c-c258-407c-a832-239ea16382cc tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:42.429136 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a2af1e4c-c258-407c-a832-239ea16382cc tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:42.524355 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a2af1e4c-c258-407c-a832-239ea16382cc tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:42.536597 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a2af1e4c-c258-407c-a832-239ea16382cc tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/9eaf1302-c967-4a24-8772-df5b32f11a60" status: 200 len: 1264 microversion: 2.1 time: 0.120910 Oct 17 13:47:42.551195 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1537/3089] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:42 2022] GET /compute/v2.1/servers/9eaf1302-c967-4a24-8772-df5b32f11a60 => generated 1264 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:42.551195 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7bbe810e-0407-427a-bdfe-12d98777d8d5 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Calling method '.version_select at 0x7f7cd55e6a60>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:42.553000 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ab4328b0-b8d6-4bd3-856c-0b5b021a4db7 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:42.562854 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ab4328b0-b8d6-4bd3-856c-0b5b021a4db7 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1519 microversion: 2.1 time: 0.250006 Oct 17 13:47:42.563830 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1553/3090] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:42 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1519 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:42.579499 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b1a2c762-faac-418f-8021-4b57ea8d5a9e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-726104632", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "a398dbce-c021-45a6-85ac-cad2a4c275b0"}, {"port": "dc9dca25-b1ad-44bb-8a66-3f7f867f9db4", "tag": "port-1"}, {"port": "d9802ec8-6622-432d-90fa-c32aa88e3fdb", "tag": "port-2"}, {"uuid": "5d8dfaa9-7385-4735-93b8-3b52fe3e286d", "tag": "net-1"}, {"uuid": "5d8dfaa9-7385-4735-93b8-3b52fe3e286d"}, {"uuid": "8ee7e461-a4f4-44a9-90d9-82eb37f13679", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "8ee7e461-a4f4-44a9-90d9-82eb37f13679", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "7142c891-ba71-4361-b361-99263d2cda22", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "393e5eac-0d65-45a9-984a-a3e81ec16a98", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "d071e55f-169d-4a0e-ae0c-e1b0f3965abd", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1295080775"}], "key_name": "tempest-keypair-1248928397", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:47:42.937061 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-b1a2c762-faac-418f-8021-4b57ea8d5a9e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] validate_networks() for [('a398dbce-c021-45a6-85ac-cad2a4c275b0', None, None, None, None, None), (None, None, 'dc9dca25-b1ad-44bb-8a66-3f7f867f9db4', None, None, None), (None, None, 'd9802ec8-6622-432d-90fa-c32aa88e3fdb', None, None, None), ('5d8dfaa9-7385-4735-93b8-3b52fe3e286d', None, None, None, None, None), ('5d8dfaa9-7385-4735-93b8-3b52fe3e286d', None, None, None, None, None), ('8ee7e461-a4f4-44a9-90d9-82eb37f13679', '10.2.2.100', None, None, None, None), ('8ee7e461-a4f4-44a9-90d9-82eb37f13679', '10.2.2.200', None, None, None, None)] {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:47:44.164884 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7bbe810e-0407-427a-bdfe-12d98777d8d5 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] 10.222.0.79 "GET /compute/v2.1/os-floating-ips/2b883d7e-9f22-4898-99a3-2b36358925fc" status: 200 len: 184 microversion: 2.1 time: 1.625745 Oct 17 13:47:44.165850 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1538/3091] 10.222.0.79 () {58 vars in 1260 bytes} [Mon Oct 17 13:47:42 2022] GET /compute/v2.1/os-floating-ips/2b883d7e-9f22-4898-99a3-2b36358925fc => generated 184 bytes in 1627 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:47:44.172655 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-ffaea55c-46f6-450c-ad21-54bb064d1bef req-b1c7685f-ee5d-4722-80bf-bc89090f3cc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "531b762d-db7e-4911-af50-6b321b7706bf", "tag": "13d96c52-0581-49ee-acc7-7c007590f889"}, {"name": "network-changed", "server_uuid": "a2994495-366a-446f-b7a6-16340911e17c", "tag": "f61459cf-c1c5-4d16-ab2f-16ab1c0ba28c"}, {"name": "network-changed", "server_uuid": "531b762d-db7e-4911-af50-6b321b7706bf", "tag": "9c9d5dd0-a8f0-41f1-bc68-e9fb795e1870"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:47:44.189019 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-ffaea55c-46f6-450c-ad21-54bb064d1bef req-b1c7685f-ee5d-4722-80bf-bc89090f3cc1 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:44.189569 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-ffaea55c-46f6-450c-ad21-54bb064d1bef req-b1c7685f-ee5d-4722-80bf-bc89090f3cc1 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:44.190020 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-ffaea55c-46f6-450c-ad21-54bb064d1bef req-b1c7685f-ee5d-4722-80bf-bc89090f3cc1 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:44.210253 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-ffaea55c-46f6-450c-ad21-54bb064d1bef req-b1c7685f-ee5d-4722-80bf-bc89090f3cc1 service nova] Creating event network-changed:13d96c52-0581-49ee-acc7-7c007590f889 for instance 531b762d-db7e-4911-af50-6b321b7706bf on n-h1-854247-14 Oct 17 13:47:44.210768 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-ffaea55c-46f6-450c-ad21-54bb064d1bef req-b1c7685f-ee5d-4722-80bf-bc89090f3cc1 service nova] Creating event network-changed:f61459cf-c1c5-4d16-ab2f-16ab1c0ba28c for instance a2994495-366a-446f-b7a6-16340911e17c on n-h2-854247-14 Oct 17 13:47:44.215049 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-ffaea55c-46f6-450c-ad21-54bb064d1bef req-b1c7685f-ee5d-4722-80bf-bc89090f3cc1 service nova] Creating event network-changed:9c9d5dd0-a8f0-41f1-bc68-e9fb795e1870 for instance 531b762d-db7e-4911-af50-6b321b7706bf on n-h1-854247-14 Oct 17 13:47:44.237551 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-ffaea55c-46f6-450c-ad21-54bb064d1bef req-b1c7685f-ee5d-4722-80bf-bc89090f3cc1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.067842 Oct 17 13:47:44.240060 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1539/3092] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:47:44 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:47:44.255979 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b5409397-62e8-4464-b106-945d5e0f8c2f tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Calling method '.version_select at 0x7f7cd55d9040>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:44.257283 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b5409397-62e8-4464-b106-945d5e0f8c2f tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] [instance: 61ef701e-38b1-42a5-a604-89d2e3403033] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:44.275424 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:47:44.309532 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b5409397-62e8-4464-b106-945d5e0f8c2f tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:44.311788 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b5409397-62e8-4464-b106-945d5e0f8c2f tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:44.315303 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b5409397-62e8-4464-b106-945d5e0f8c2f tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:44.324986 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b5409397-62e8-4464-b106-945d5e0f8c2f tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:44.329250 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b5409397-62e8-4464-b106-945d5e0f8c2f tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:44.331293 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b5409397-62e8-4464-b106-945d5e0f8c2f tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:44.795028 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b5409397-62e8-4464-b106-945d5e0f8c2f tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] 10.222.0.79 "GET /compute/v2.1/servers/61ef701e-38b1-42a5-a604-89d2e3403033/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.552225 Oct 17 13:47:44.797483 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1540/3093] 10.222.0.79 () {60 vars in 1337 bytes} [Mon Oct 17 13:47:44 2022] GET /compute/v2.1/servers/61ef701e-38b1-42a5-a604-89d2e3403033/os-instance-actions => generated 611 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:47:44.828737 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-12c7213e-a480-42df-8ed2-5445ac47dd3f tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:44.830316 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-12c7213e-a480-42df-8ed2-5445ac47dd3f tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] [instance: 531b762d-db7e-4911-af50-6b321b7706bf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:44.838822 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-12c7213e-a480-42df-8ed2-5445ac47dd3f tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:44.839855 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-12c7213e-a480-42df-8ed2-5445ac47dd3f tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:44.840463 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-12c7213e-a480-42df-8ed2-5445ac47dd3f tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:44.841320 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-12c7213e-a480-42df-8ed2-5445ac47dd3f tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:44.841918 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-12c7213e-a480-42df-8ed2-5445ac47dd3f tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:44.844213 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-12c7213e-a480-42df-8ed2-5445ac47dd3f tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:47.343027 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-12c7213e-a480-42df-8ed2-5445ac47dd3f tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:47.367146 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-12c7213e-a480-42df-8ed2-5445ac47dd3f tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:47.369115 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-12c7213e-a480-42df-8ed2-5445ac47dd3f tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:47.376531 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-12c7213e-a480-42df-8ed2-5445ac47dd3f tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] 10.222.0.79 "GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf" status: 200 len: 1891 microversion: 2.42 time: 2.572928 Oct 17 13:47:47.395530 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1541/3094] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:47:44 2022] GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf => generated 1891 bytes in 2581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:47:47.402481 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e66d4ebc-d78d-461a-8320-3cf4fef93069 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:47.404173 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e66d4ebc-d78d-461a-8320-3cf4fef93069 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: a2994495-366a-446f-b7a6-16340911e17c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:47.421935 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e66d4ebc-d78d-461a-8320-3cf4fef93069 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:47.422575 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e66d4ebc-d78d-461a-8320-3cf4fef93069 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:47.423841 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e66d4ebc-d78d-461a-8320-3cf4fef93069 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:47.428126 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e66d4ebc-d78d-461a-8320-3cf4fef93069 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:47.428685 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e66d4ebc-d78d-461a-8320-3cf4fef93069 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:47.429192 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e66d4ebc-d78d-461a-8320-3cf4fef93069 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:48.837415 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e66d4ebc-d78d-461a-8320-3cf4fef93069 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683d18db860a4d60ab3eeba2a372b2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11973b8e1d8a4af8add65726e8ba7c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:48.846727 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e66d4ebc-d78d-461a-8320-3cf4fef93069 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c" status: 200 len: 1360 microversion: 2.1 time: 1.464484 Oct 17 13:47:48.860425 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1542/3095] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:47 2022] GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c => generated 1360 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:48.868989 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-907a2239-8ea6-4f87-a183-933301addc72 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:48.869873 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-907a2239-8ea6-4f87-a183-933301addc72 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9eaf1302-c967-4a24-8772-df5b32f11a60] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:48.876479 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-907a2239-8ea6-4f87-a183-933301addc72 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:48.877227 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-907a2239-8ea6-4f87-a183-933301addc72 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:48.877831 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-907a2239-8ea6-4f87-a183-933301addc72 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:48.878702 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-907a2239-8ea6-4f87-a183-933301addc72 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:48.879333 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-907a2239-8ea6-4f87-a183-933301addc72 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:48.879903 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-907a2239-8ea6-4f87-a183-933301addc72 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:49.513693 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-907a2239-8ea6-4f87-a183-933301addc72 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:49.568579 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-907a2239-8ea6-4f87-a183-933301addc72 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/9eaf1302-c967-4a24-8772-df5b32f11a60" status: 200 len: 1312 microversion: 2.1 time: 0.706535 Oct 17 13:47:49.580106 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1543/3096] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:48 2022] GET /compute/v2.1/servers/9eaf1302-c967-4a24-8772-df5b32f11a60 => generated 1312 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:49.585743 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c283278e-af68-4c86-9176-d40a3d47c88f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:49.590688 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c283278e-af68-4c86-9176-d40a3d47c88f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:49.608100 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c283278e-af68-4c86-9176-d40a3d47c88f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:49.608594 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c283278e-af68-4c86-9176-d40a3d47c88f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:49.609035 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c283278e-af68-4c86-9176-d40a3d47c88f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:49.609746 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c283278e-af68-4c86-9176-d40a3d47c88f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:49.610265 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c283278e-af68-4c86-9176-d40a3d47c88f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:49.610749 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c283278e-af68-4c86-9176-d40a3d47c88f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:49.898382 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c283278e-af68-4c86-9176-d40a3d47c88f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:49.922464 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c283278e-af68-4c86-9176-d40a3d47c88f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1519 microversion: 2.1 time: 0.335439 Oct 17 13:47:49.930107 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1544/3097] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:49 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1519 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:49.940155 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ee9a79a7-de38-40d3-b796-30defc37048e tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.0.129"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:47:49.951063 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:47:50.001986 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=6 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:47:50.198699 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ee9a79a7-de38-40d3-b796-30defc37048e tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] [instance: 50e9eae9-df55-48ee-b984-e6b7e4bb2628] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:50.209229 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ee9a79a7-de38-40d3-b796-30defc37048e tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:50.210365 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ee9a79a7-de38-40d3-b796-30defc37048e tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:50.211060 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ee9a79a7-de38-40d3-b796-30defc37048e tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:50.213061 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ee9a79a7-de38-40d3-b796-30defc37048e tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:50.213785 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ee9a79a7-de38-40d3-b796-30defc37048e tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:50.215258 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ee9a79a7-de38-40d3-b796-30defc37048e tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:50.682297 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ee9a79a7-de38-40d3-b796-30defc37048e tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "refresh_cache-50e9eae9-df55-48ee-b984-e6b7e4bb2628" {{(pid=127017) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 17 13:47:50.685064 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ee9a79a7-de38-40d3-b796-30defc37048e tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquired lock "refresh_cache-50e9eae9-df55-48ee-b984-e6b7e4bb2628" {{(pid=127017) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 17 13:47:52.558023 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:47:52.837547 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-b1a2c762-faac-418f-8021-4b57ea8d5a9e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:47:52.837967 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-b1a2c762-faac-418f-8021-4b57ea8d5a9e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:47:52.838433 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-b1a2c762-faac-418f-8021-4b57ea8d5a9e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:47:52.838837 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-b1a2c762-faac-418f-8021-4b57ea8d5a9e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:47:52.839278 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-b1a2c762-faac-418f-8021-4b57ea8d5a9e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:47:52.850504 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b1a2c762-faac-418f-8021-4b57ea8d5a9e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:52.851003 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b1a2c762-faac-418f-8021-4b57ea8d5a9e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:52.851802 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b1a2c762-faac-418f-8021-4b57ea8d5a9e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:52.852540 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b1a2c762-faac-418f-8021-4b57ea8d5a9e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:52.852988 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b1a2c762-faac-418f-8021-4b57ea8d5a9e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:52.853400 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b1a2c762-faac-418f-8021-4b57ea8d5a9e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:52.877225 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-b1a2c762-faac-418f-8021-4b57ea8d5a9e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Getting quotas for project cfbeaa08d8384042a26c865a2efba214. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:47:52.882677 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-b1a2c762-faac-418f-8021-4b57ea8d5a9e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Getting quotas for user e02c176dc1a6460882ca3969d52c195b and project cfbeaa08d8384042a26c865a2efba214. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:47:52.966741 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-ee9a79a7-de38-40d3-b796-30defc37048e tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] [instance: 50e9eae9-df55-48ee-b984-e6b7e4bb2628] Building network info cache for instance {{(pid=127017) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 17 13:47:53.275066 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b1a2c762-faac-418f-8021-4b57ea8d5a9e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:47:53.279902 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b1a2c762-faac-418f-8021-4b57ea8d5a9e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='7142c891-ba71-4361-b361-99263d2cda22',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='393e5eac-0d65-45a9-984a-a3e81ec16a98',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d071e55f-169d-4a0e-ae0c-e1b0f3965abd',volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:47:53.694438 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-ee9a79a7-de38-40d3-b796-30defc37048e tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] [instance: 50e9eae9-df55-48ee-b984-e6b7e4bb2628] Updating instance_info_cache with network_info: [{"id": "be3444eb-9f99-422e-963d-086fa4da6881", "address": "fa:16:3e:29:e0:b5", "network": {"id": "78e524a2-ee09-4045-aff8-792bc0397f6e", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1866044046-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "18f91db965084796a4a3dce1b4e921e5", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapbe3444eb-9f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127017) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 17 13:47:53.704262 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:47:53.716867 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ee9a79a7-de38-40d3-b796-30defc37048e tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Releasing lock "refresh_cache-50e9eae9-df55-48ee-b984-e6b7e4bb2628" {{(pid=127017) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 17 13:47:53.718234 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ee9a79a7-de38-40d3-b796-30defc37048e tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] 10.222.0.79 "POST /compute/v2.1/servers/50e9eae9-df55-48ee-b984-e6b7e4bb2628/action" status: 202 len: 0 microversion: 2.1 time: 3.786989 Oct 17 13:47:53.719065 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1545/3098] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:47:49 2022] POST /compute/v2.1/servers/50e9eae9-df55-48ee-b984-e6b7e4bb2628/action => generated 0 bytes in 3788 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 17 13:47:53.730289 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-dd65b840-dcef-4b3d-b991-4de374a267e3 req-38ef714f-eb51-4f24-b9ab-3a68eec4f4d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50e9eae9-df55-48ee-b984-e6b7e4bb2628", "tag": "be3444eb-9f99-422e-963d-086fa4da6881"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:47:53.751909 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-dd65b840-dcef-4b3d-b991-4de374a267e3 req-38ef714f-eb51-4f24-b9ab-3a68eec4f4d2 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:53.752705 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-dd65b840-dcef-4b3d-b991-4de374a267e3 req-38ef714f-eb51-4f24-b9ab-3a68eec4f4d2 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:53.757977 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-dd65b840-dcef-4b3d-b991-4de374a267e3 req-38ef714f-eb51-4f24-b9ab-3a68eec4f4d2 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:53.797864 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-dd65b840-dcef-4b3d-b991-4de374a267e3 req-38ef714f-eb51-4f24-b9ab-3a68eec4f4d2 service nova] Creating event network-changed:be3444eb-9f99-422e-963d-086fa4da6881 for instance 50e9eae9-df55-48ee-b984-e6b7e4bb2628 on n-h1-854247-14 Oct 17 13:47:53.802839 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b1a2c762-faac-418f-8021-4b57ea8d5a9e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 11.237190 Oct 17 13:47:53.806661 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1554/3099] 10.222.0.79 () {62 vars in 1189 bytes} [Mon Oct 17 13:47:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 11242 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 13:47:53.813014 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-dd65b840-dcef-4b3d-b991-4de374a267e3 req-38ef714f-eb51-4f24-b9ab-3a68eec4f4d2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091992 Oct 17 13:47:53.817985 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1546/3100] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:47:53.832414 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0dd88dae-8571-4346-bcff-838b51c679f5 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:53.833450 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0dd88dae-8571-4346-bcff-838b51c679f5 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] [instance: 61ef701e-38b1-42a5-a604-89d2e3403033] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:53.845025 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-8fbcfe45-8066-43ee-9eb1-864c330790ed req-cf792988-d4ea-4e6a-bca7-7ac7c00521cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2994495-366a-446f-b7a6-16340911e17c", "name": "network-vif-plugged", "status": "completed", "tag": "f61459cf-c1c5-4d16-ab2f-16ab1c0ba28c"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:47:53.846166 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0dd88dae-8571-4346-bcff-838b51c679f5 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:53.847523 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0dd88dae-8571-4346-bcff-838b51c679f5 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:53.848221 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0dd88dae-8571-4346-bcff-838b51c679f5 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:53.849181 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0dd88dae-8571-4346-bcff-838b51c679f5 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:53.849909 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0dd88dae-8571-4346-bcff-838b51c679f5 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:53.850556 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0dd88dae-8571-4346-bcff-838b51c679f5 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:53.866321 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-8fbcfe45-8066-43ee-9eb1-864c330790ed req-cf792988-d4ea-4e6a-bca7-7ac7c00521cd service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:53.866794 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-8fbcfe45-8066-43ee-9eb1-864c330790ed req-cf792988-d4ea-4e6a-bca7-7ac7c00521cd service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:53.868001 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-0dd88dae-8571-4346-bcff-838b51c679f5 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] HTTP exception thrown: Instance 61ef701e-38b1-42a5-a604-89d2e3403033 could not be found. Oct 17 13:47:53.869970 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0dd88dae-8571-4346-bcff-838b51c679f5 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Request method failure captured: Oct 17 13:47:53.869970 n-d-854247-14 devstack@n-api.service[127016]: request: DELETE /compute/v2.1/servers/61ef701e-38b1-42a5-a604-89d2e3403033 HTTP/1.1 Oct 17 13:47:53.869970 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:47:53.869970 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:47:53.869970 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:47:53.869970 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:47:53.869970 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:47:53.869970 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:47:53.869970 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:47:53.869970 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:47:53.869970 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVzM0ub15VWK9dXBX2E6bOmuBMM68OX4qVdJaHdwN3wTbr3cMpon0stofcgVs6aXkM_zrwvGY81jQA76Go2ahEqrzuDnAiJNw1N_F01fFfKYVd6FRBIz94yBCubG2texd9tOHnIhjrL-u6l58jN41ha8xBahEdvH-b69o9tFXR8hQFE Oct 17 13:47:53.869970 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:47:53.869970 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:47:53.869970 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:47:53.869970 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:47:53.869970 n-d-854247-14 devstack@n-api.service[127016]: X-Openstack-Nova-Api-Version: 2.21 Oct 17 13:47:53.869970 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:47:53.869970 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:47:53.869970 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 04b218c7b78b4c89baaf0cf4cb9a5fc7 Oct 17 13:47:53.869970 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1163806185 Oct 17 13:47:53.869970 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:47:53.869970 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:47:53.869970 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/04b218c7b78b4c89baaf0cf4cb9a5fc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/04b218c7b78b4c89baaf0cf4cb9a5fc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/04b218c7b78b4c89baaf0cf4cb9a5fc7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_04b218c7b78b4c89baaf0cf4cb9a5fc7", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:47:53.869970 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-InstanceActionsV221TestJSON-1163806185 Oct 17 13:47:53.869970 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 04b218c7b78b4c89baaf0cf4cb9a5fc7 Oct 17 13:47:53.869970 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1163806185 Oct 17 13:47:53.869970 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-InstanceActionsV221TestJSON-1163806185-project Oct 17 13:47:53.869970 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:47:53.869970 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:47:53.869970 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 14f234ed5b074fb5b2596aa3dd59882e Oct 17 13:47:53.869970 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-InstanceActionsV221TestJSON-1163806185-project Oct 17 13:47:53.869970 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:47:53.869970 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 61ef701e-38b1-42a5-a604-89d2e3403033 could not be found. Oct 17 13:47:53.869970 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '61ef701e-38b1-42a5-a604-89d2e3403033'} Oct 17 13:47:53.869970 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:47:53.869970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:53.869970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:47:53.869970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:47:53.869970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:47:53.869970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:47:53.869970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:47:53.869970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:47:53.869970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:47:53.869970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:47:53.869970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61ef701e-38b1-42a5-a604-89d2e3403033 could not be found. Oct 17 13:47:53.869970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:47:53.869970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:47:53.869970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:47:53.869970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:53.869970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:47:53.869970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:47:53.869970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:47:53.869970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:47:53.869970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:47:53.869970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:47:53.869970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:47:53.869970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:47:53.869970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:47:53.869970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:47:53.869970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:47:53.869970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:47:53.869970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:47:53.869970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:47:53.874363 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61ef701e-38b1-42a5-a604-89d2e3403033 could not be found. Oct 17 13:47:53.874363 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:47:53.874363 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:47:53.874363 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:47:53.874363 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:53.874363 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:47:53.874363 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:47:53.874363 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:47:53.874363 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:47:53.874363 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61ef701e-38b1-42a5-a604-89d2e3403033 could not be found. Oct 17 13:47:53.874363 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:47:53.875049 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-8fbcfe45-8066-43ee-9eb1-864c330790ed req-cf792988-d4ea-4e6a-bca7-7ac7c00521cd service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:53.876717 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0dd88dae-8571-4346-bcff-838b51c679f5 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Returning 404 to user: Instance 61ef701e-38b1-42a5-a604-89d2e3403033 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:47:53.877927 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0dd88dae-8571-4346-bcff-838b51c679f5 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] 10.222.0.79 "DELETE /compute/v2.1/servers/61ef701e-38b1-42a5-a604-89d2e3403033" status: 404 len: 111 microversion: 2.21 time: 0.069937 Oct 17 13:47:53.879080 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1555/3101] 10.222.0.79 () {60 vars in 1280 bytes} [Mon Oct 17 13:47:53 2022] DELETE /compute/v2.1/servers/61ef701e-38b1-42a5-a604-89d2e3403033 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:47:53.884670 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-9fb138b0-65b9-4a5e-a53f-6bfe9bbe6066 req-bff0d6dd-bfe8-4b72-bbd6-bc7d1ec2f06b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "531b762d-db7e-4911-af50-6b321b7706bf", "tag": "2ed852ff-90cb-44a1-8401-734cba5bea03"}, {"name": "network-changed", "server_uuid": "531b762d-db7e-4911-af50-6b321b7706bf", "tag": "6f4cb81d-8d1e-46b5-be9e-808d081260d5"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:47:53.893528 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-8fbcfe45-8066-43ee-9eb1-864c330790ed req-cf792988-d4ea-4e6a-bca7-7ac7c00521cd service nova] Creating event network-vif-plugged:f61459cf-c1c5-4d16-ab2f-16ab1c0ba28c for instance a2994495-366a-446f-b7a6-16340911e17c on n-h2-854247-14 Oct 17 13:47:53.895559 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-9fb138b0-65b9-4a5e-a53f-6bfe9bbe6066 req-bff0d6dd-bfe8-4b72-bbd6-bc7d1ec2f06b service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:53.896909 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-9fb138b0-65b9-4a5e-a53f-6bfe9bbe6066 req-bff0d6dd-bfe8-4b72-bbd6-bc7d1ec2f06b service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:53.897560 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-9fb138b0-65b9-4a5e-a53f-6bfe9bbe6066 req-bff0d6dd-bfe8-4b72-bbd6-bc7d1ec2f06b service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:53.911938 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-9fb138b0-65b9-4a5e-a53f-6bfe9bbe6066 req-bff0d6dd-bfe8-4b72-bbd6-bc7d1ec2f06b service nova] Creating event network-changed:2ed852ff-90cb-44a1-8401-734cba5bea03 for instance 531b762d-db7e-4911-af50-6b321b7706bf on n-h1-854247-14 Oct 17 13:47:53.912820 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-9fb138b0-65b9-4a5e-a53f-6bfe9bbe6066 req-bff0d6dd-bfe8-4b72-bbd6-bc7d1ec2f06b service nova] Creating event network-changed:6f4cb81d-8d1e-46b5-be9e-808d081260d5 for instance 531b762d-db7e-4911-af50-6b321b7706bf on n-h1-854247-14 Oct 17 13:47:53.915355 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-8fbcfe45-8066-43ee-9eb1-864c330790ed req-cf792988-d4ea-4e6a-bca7-7ac7c00521cd service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095395 Oct 17 13:47:53.916924 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1547/3102] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:47:53.918948 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-9fb138b0-65b9-4a5e-a53f-6bfe9bbe6066 req-bff0d6dd-bfe8-4b72-bbd6-bc7d1ec2f06b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.038259 Oct 17 13:47:53.920076 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1556/3103] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:47:53.924802 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-29e496ec-2766-4b39-b441-832f601c1903 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:53.925531 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-29e496ec-2766-4b39-b441-832f601c1903 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] [instance: 531b762d-db7e-4911-af50-6b321b7706bf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:53.928083 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e989b1a0-4126-4b60-a771-088fc292a2f8 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:53.929075 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e989b1a0-4126-4b60-a771-088fc292a2f8 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: a2994495-366a-446f-b7a6-16340911e17c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:53.935733 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e989b1a0-4126-4b60-a771-088fc292a2f8 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:53.936527 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e989b1a0-4126-4b60-a771-088fc292a2f8 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:53.937350 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e989b1a0-4126-4b60-a771-088fc292a2f8 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:53.938755 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e989b1a0-4126-4b60-a771-088fc292a2f8 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:53.939530 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e989b1a0-4126-4b60-a771-088fc292a2f8 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:53.940498 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e989b1a0-4126-4b60-a771-088fc292a2f8 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:53.945061 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-29e496ec-2766-4b39-b441-832f601c1903 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:53.946300 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-29e496ec-2766-4b39-b441-832f601c1903 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:53.947022 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-29e496ec-2766-4b39-b441-832f601c1903 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:53.948193 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-29e496ec-2766-4b39-b441-832f601c1903 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:53.954700 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-29e496ec-2766-4b39-b441-832f601c1903 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:53.956064 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-29e496ec-2766-4b39-b441-832f601c1903 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:54.748622 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e989b1a0-4126-4b60-a771-088fc292a2f8 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683d18db860a4d60ab3eeba2a372b2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11973b8e1d8a4af8add65726e8ba7c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:54.757537 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e989b1a0-4126-4b60-a771-088fc292a2f8 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c" status: 200 len: 1360 microversion: 2.1 time: 0.835996 Oct 17 13:47:54.770517 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1557/3104] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:53 2022] GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c => generated 1360 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:54.780647 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7b3c2e97-ac83-4e28-b623-936c60a09f07 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:54.781277 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7b3c2e97-ac83-4e28-b623-936c60a09f07 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9eaf1302-c967-4a24-8772-df5b32f11a60] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:54.792798 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7b3c2e97-ac83-4e28-b623-936c60a09f07 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:54.793886 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7b3c2e97-ac83-4e28-b623-936c60a09f07 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:54.794335 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7b3c2e97-ac83-4e28-b623-936c60a09f07 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:54.795061 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7b3c2e97-ac83-4e28-b623-936c60a09f07 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:54.799709 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7b3c2e97-ac83-4e28-b623-936c60a09f07 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:54.800313 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7b3c2e97-ac83-4e28-b623-936c60a09f07 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:54.964814 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-29e496ec-2766-4b39-b441-832f601c1903 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:54.984164 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-29e496ec-2766-4b39-b441-832f601c1903 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:54.990848 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-29e496ec-2766-4b39-b441-832f601c1903 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:54.994991 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-29e496ec-2766-4b39-b441-832f601c1903 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] 10.222.0.79 "GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf" status: 200 len: 1879 microversion: 2.42 time: 1.076029 Oct 17 13:47:54.997148 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1548/3105] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:47:53 2022] GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf => generated 1879 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:47:55.012355 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-553fd99c-c1e3-40e3-8b31-9c2fc5881f55 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:55.013321 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-553fd99c-c1e3-40e3-8b31-9c2fc5881f55 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:55.025096 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-553fd99c-c1e3-40e3-8b31-9c2fc5881f55 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:55.025966 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-553fd99c-c1e3-40e3-8b31-9c2fc5881f55 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:55.027025 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-553fd99c-c1e3-40e3-8b31-9c2fc5881f55 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:55.027939 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-553fd99c-c1e3-40e3-8b31-9c2fc5881f55 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:55.029387 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-553fd99c-c1e3-40e3-8b31-9c2fc5881f55 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:55.029387 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-553fd99c-c1e3-40e3-8b31-9c2fc5881f55 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:55.333609 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7b3c2e97-ac83-4e28-b623-936c60a09f07 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:55.347837 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7b3c2e97-ac83-4e28-b623-936c60a09f07 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/9eaf1302-c967-4a24-8772-df5b32f11a60" status: 200 len: 1312 microversion: 2.1 time: 0.575996 Oct 17 13:47:55.362094 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1558/3106] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:54 2022] GET /compute/v2.1/servers/9eaf1302-c967-4a24-8772-df5b32f11a60 => generated 1312 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:55.403687 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-553fd99c-c1e3-40e3-8b31-9c2fc5881f55 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:55.413038 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-553fd99c-c1e3-40e3-8b31-9c2fc5881f55 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1519 microversion: 2.1 time: 0.414759 Oct 17 13:47:55.416585 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1549/3107] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:54 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1519 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:55.435057 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ae593de1-9b92-4b9c-ab4f-c9b49f5f2de3 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:55.435869 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ae593de1-9b92-4b9c-ab4f-c9b49f5f2de3 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] [instance: 29fb8b41-6dcb-49f2-9e1c-11719cace5d9] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:55.460137 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae593de1-9b92-4b9c-ab4f-c9b49f5f2de3 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:55.460637 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae593de1-9b92-4b9c-ab4f-c9b49f5f2de3 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:55.464702 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae593de1-9b92-4b9c-ab4f-c9b49f5f2de3 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:55.465840 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae593de1-9b92-4b9c-ab4f-c9b49f5f2de3 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:55.466557 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae593de1-9b92-4b9c-ab4f-c9b49f5f2de3 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:55.467768 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae593de1-9b92-4b9c-ab4f-c9b49f5f2de3 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:55.506204 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-ae593de1-9b92-4b9c-ab4f-c9b49f5f2de3 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] HTTP exception thrown: Instance 29fb8b41-6dcb-49f2-9e1c-11719cace5d9 could not be found. Oct 17 13:47:55.512215 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ae593de1-9b92-4b9c-ab4f-c9b49f5f2de3 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Request method failure captured: Oct 17 13:47:55.512215 n-d-854247-14 devstack@n-api.service[127017]: request: DELETE /compute/v2.1/servers/29fb8b41-6dcb-49f2-9e1c-11719cace5d9 HTTP/1.1 Oct 17 13:47:55.512215 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:47:55.512215 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:47:55.512215 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:47:55.512215 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:47:55.512215 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:47:55.512215 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:47:55.512215 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:47:55.512215 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:47:55.512215 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVyHr9cMxqqpMQ_SGFYWfWNh2ukm6fljeGlynI7p-vwRyqG7rxvn3_33Cj97gvChwnYCDwAhthJ-BWlrwI8_a3OyS9DmQuOO_0qjGEcsRVLbQqHUiyE61o4LdbdwT0-3KIWQ5f4T-boDaU-G6V3CGAtmxh9Hoj3ZiO9LCTI0rTmfS60 Oct 17 13:47:55.512215 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:47:55.512215 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:47:55.512215 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:47:55.512215 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:47:55.512215 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:47:55.512215 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:47:55.512215 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 18f91db965084796a4a3dce1b4e921e5 Oct 17 13:47:55.512215 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-655180239 Oct 17 13:47:55.512215 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:47:55.512215 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:47:55.512215 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/18f91db965084796a4a3dce1b4e921e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/18f91db965084796a4a3dce1b4e921e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/18f91db965084796a4a3dce1b4e921e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_18f91db965084796a4a3dce1b4e921e5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:47:55.512215 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-655180239 Oct 17 13:47:55.512215 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 18f91db965084796a4a3dce1b4e921e5 Oct 17 13:47:55.512215 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-655180239 Oct 17 13:47:55.512215 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-FloatingIPsAssociationTestJSON-655180239-project Oct 17 13:47:55.512215 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:47:55.512215 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:47:55.512215 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 43a3472f83914990ad41f037b4aafd63 Oct 17 13:47:55.512215 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-655180239-project Oct 17 13:47:55.512215 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:47:55.512215 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 29fb8b41-6dcb-49f2-9e1c-11719cace5d9 could not be found. Oct 17 13:47:55.512215 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '29fb8b41-6dcb-49f2-9e1c-11719cace5d9'} Oct 17 13:47:55.512215 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:47:55.512215 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:55.512215 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:47:55.512215 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:47:55.512215 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:47:55.512215 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:47:55.512215 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:47:55.512215 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:47:55.512215 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:47:55.512215 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:47:55.512215 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29fb8b41-6dcb-49f2-9e1c-11719cace5d9 could not be found. Oct 17 13:47:55.512215 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:47:55.512215 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:47:55.512215 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:47:55.512215 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:55.512215 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:47:55.512215 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:47:55.512215 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:47:55.512215 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:47:55.512215 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:47:55.512215 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:47:55.512215 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:47:55.512215 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:47:55.512215 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:47:55.512215 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:47:55.512215 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:47:55.512215 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:47:55.512215 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:47:55.512215 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:47:55.517263 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29fb8b41-6dcb-49f2-9e1c-11719cace5d9 could not be found. Oct 17 13:47:55.517263 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:47:55.517263 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:47:55.517263 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:47:55.517263 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:55.517263 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:47:55.517263 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:47:55.517263 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:47:55.517263 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:47:55.517263 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29fb8b41-6dcb-49f2-9e1c-11719cace5d9 could not be found. Oct 17 13:47:55.517263 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:47:55.520353 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ae593de1-9b92-4b9c-ab4f-c9b49f5f2de3 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Returning 404 to user: Instance 29fb8b41-6dcb-49f2-9e1c-11719cace5d9 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:47:55.523080 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ae593de1-9b92-4b9c-ab4f-c9b49f5f2de3 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] 10.222.0.79 "DELETE /compute/v2.1/servers/29fb8b41-6dcb-49f2-9e1c-11719cace5d9" status: 404 len: 111 microversion: 2.1 time: 0.103551 Oct 17 13:47:55.523725 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1550/3108] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:47:55 2022] DELETE /compute/v2.1/servers/29fb8b41-6dcb-49f2-9e1c-11719cace5d9 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:47:55.531907 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3c3805eb-34cd-4937-8d85-2ed7bd684ec7 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:55.532479 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3c3805eb-34cd-4937-8d85-2ed7bd684ec7 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:55.552839 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3c3805eb-34cd-4937-8d85-2ed7bd684ec7 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:55.553601 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3c3805eb-34cd-4937-8d85-2ed7bd684ec7 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:55.554038 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3c3805eb-34cd-4937-8d85-2ed7bd684ec7 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:55.554934 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3c3805eb-34cd-4937-8d85-2ed7bd684ec7 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:55.557969 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3c3805eb-34cd-4937-8d85-2ed7bd684ec7 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:55.558439 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3c3805eb-34cd-4937-8d85-2ed7bd684ec7 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:55.645552 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1ed1fd21-d66a-457c-8b11-3e3491fcff97 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Action: 'create', calling method: .version_select at 0x7f7cd4f875e0>, body: {"keypair": {"name": "tempest-keypair-1589025206", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsI2om89gIOgJ5IvFoA/P5s1jpCGfasnMCl0ZDn+7ppPHYT2lN2uYElMmOnsS2AgA9H23mzl2IehC3OTb+msPee4SWGC6KD2I5CU6On26SIJa2dTvcT3SeH00xmOo6KmQ=="}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:47:55.693513 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-1ed1fd21-d66a-457c-8b11-3e3491fcff97 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Getting quotas for project 4acd31ce63b64ac3a05b76d4a9fdf7c0. Resources: {'key_pairs'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:47:55.704902 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-1ed1fd21-d66a-457c-8b11-3e3491fcff97 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Getting quotas for user c7a7b9b048234fd2926739e3f08400b0 and project 4acd31ce63b64ac3a05b76d4a9fdf7c0. Resources: {'key_pairs'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:47:55.722672 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3c3805eb-34cd-4937-8d85-2ed7bd684ec7 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:55.732568 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3c3805eb-34cd-4937-8d85-2ed7bd684ec7 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:55.738602 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3c3805eb-34cd-4937-8d85-2ed7bd684ec7 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:55.740066 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3c3805eb-34cd-4937-8d85-2ed7bd684ec7 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1575 microversion: 2.32 time: 0.212206 Oct 17 13:47:55.740629 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1551/3109] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:47:55 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1575 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:47:55.753863 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a6497d0d-05d6-4985-886b-3692f3c23990 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:55.756108 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a6497d0d-05d6-4985-886b-3692f3c23990 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] [instance: 61ef701e-38b1-42a5-a604-89d2e3403033] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:55.768893 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a6497d0d-05d6-4985-886b-3692f3c23990 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:55.771006 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a6497d0d-05d6-4985-886b-3692f3c23990 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:55.771989 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a6497d0d-05d6-4985-886b-3692f3c23990 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:55.774582 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a6497d0d-05d6-4985-886b-3692f3c23990 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:55.775462 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a6497d0d-05d6-4985-886b-3692f3c23990 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:55.776066 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a6497d0d-05d6-4985-886b-3692f3c23990 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:55.778407 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1ed1fd21-d66a-457c-8b11-3e3491fcff97 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.426193 Oct 17 13:47:55.782328 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1559/3110] 10.222.0.79 () {60 vars in 1159 bytes} [Mon Oct 17 13:47:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:47:55.789292 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ca28829a-aa6b-40e0-83b5-984674d69449 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:55.790377 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ca28829a-aa6b-40e0-83b5-984674d69449 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] [instance: 29fb8b41-6dcb-49f2-9e1c-11719cace5d9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:55.801846 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ca28829a-aa6b-40e0-83b5-984674d69449 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:55.807500 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ca28829a-aa6b-40e0-83b5-984674d69449 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:55.808325 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ca28829a-aa6b-40e0-83b5-984674d69449 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:55.809319 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ca28829a-aa6b-40e0-83b5-984674d69449 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:55.810020 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ca28829a-aa6b-40e0-83b5-984674d69449 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:55.810689 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ca28829a-aa6b-40e0-83b5-984674d69449 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:55.835461 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-ca28829a-aa6b-40e0-83b5-984674d69449 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] HTTP exception thrown: Instance 29fb8b41-6dcb-49f2-9e1c-11719cace5d9 could not be found. Oct 17 13:47:55.841751 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-a6497d0d-05d6-4985-886b-3692f3c23990 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] HTTP exception thrown: Instance 61ef701e-38b1-42a5-a604-89d2e3403033 could not be found. Oct 17 13:47:55.842311 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ca28829a-aa6b-40e0-83b5-984674d69449 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Request method failure captured: Oct 17 13:47:55.842311 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/29fb8b41-6dcb-49f2-9e1c-11719cace5d9 HTTP/1.1 Oct 17 13:47:55.842311 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:47:55.842311 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:47:55.842311 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:47:55.842311 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:47:55.842311 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:47:55.842311 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:47:55.842311 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:47:55.842311 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:47:55.842311 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVyHr9cMxqqpMQ_SGFYWfWNh2ukm6fljeGlynI7p-vwRyqG7rxvn3_33Cj97gvChwnYCDwAhthJ-BWlrwI8_a3OyS9DmQuOO_0qjGEcsRVLbQqHUiyE61o4LdbdwT0-3KIWQ5f4T-boDaU-G6V3CGAtmxh9Hoj3ZiO9LCTI0rTmfS60 Oct 17 13:47:55.842311 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:47:55.842311 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:47:55.842311 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:47:55.842311 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:47:55.842311 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:47:55.842311 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:47:55.842311 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 18f91db965084796a4a3dce1b4e921e5 Oct 17 13:47:55.842311 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-655180239 Oct 17 13:47:55.842311 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:47:55.842311 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:47:55.842311 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/18f91db965084796a4a3dce1b4e921e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/18f91db965084796a4a3dce1b4e921e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/18f91db965084796a4a3dce1b4e921e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_18f91db965084796a4a3dce1b4e921e5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:47:55.842311 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-655180239 Oct 17 13:47:55.842311 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 18f91db965084796a4a3dce1b4e921e5 Oct 17 13:47:55.842311 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-655180239 Oct 17 13:47:55.842311 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-FloatingIPsAssociationTestJSON-655180239-project Oct 17 13:47:55.842311 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:47:55.842311 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:47:55.842311 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 43a3472f83914990ad41f037b4aafd63 Oct 17 13:47:55.842311 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-655180239-project Oct 17 13:47:55.842311 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:47:55.842311 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 29fb8b41-6dcb-49f2-9e1c-11719cace5d9 could not be found. Oct 17 13:47:55.842311 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '29fb8b41-6dcb-49f2-9e1c-11719cace5d9'} Oct 17 13:47:55.842311 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:47:55.842311 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:55.842311 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:47:55.842311 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:47:55.842311 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:47:55.842311 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:47:55.842311 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:47:55.842311 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:47:55.842311 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:47:55.842311 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:47:55.842311 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29fb8b41-6dcb-49f2-9e1c-11719cace5d9 could not be found. Oct 17 13:47:55.842311 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:47:55.842311 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:47:55.842311 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:47:55.842311 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:55.842311 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:47:55.842311 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:47:55.842311 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:47:55.842311 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:47:55.842311 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:47:55.842311 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:47:55.842311 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:47:55.842311 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:47:55.842311 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:47:55.842311 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:47:55.842311 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:47:55.842311 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:47:55.842311 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29fb8b41-6dcb-49f2-9e1c-11719cace5d9 could not be found. Oct 17 13:47:55.842311 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:47:55.842311 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:47:55.846248 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:47:55.846248 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:55.846248 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:47:55.846248 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:47:55.846248 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:47:55.846248 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:47:55.846248 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29fb8b41-6dcb-49f2-9e1c-11719cace5d9 could not be found. Oct 17 13:47:55.846248 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:47:55.847415 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a6497d0d-05d6-4985-886b-3692f3c23990 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Request method failure captured: Oct 17 13:47:55.847415 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/61ef701e-38b1-42a5-a604-89d2e3403033 HTTP/1.1 Oct 17 13:47:55.847415 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:47:55.847415 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:47:55.847415 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:47:55.847415 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:47:55.847415 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:47:55.847415 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:47:55.847415 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:47:55.847415 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:47:55.847415 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVzM0ub15VWK9dXBX2E6bOmuBMM68OX4qVdJaHdwN3wTbr3cMpon0stofcgVs6aXkM_zrwvGY81jQA76Go2ahEqrzuDnAiJNw1N_F01fFfKYVd6FRBIz94yBCubG2texd9tOHnIhjrL-u6l58jN41ha8xBahEdvH-b69o9tFXR8hQFE Oct 17 13:47:55.847415 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:47:55.847415 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:47:55.847415 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:47:55.847415 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:47:55.847415 n-d-854247-14 devstack@n-api.service[127017]: X-Openstack-Nova-Api-Version: 2.21 Oct 17 13:47:55.847415 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:47:55.847415 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:47:55.847415 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 04b218c7b78b4c89baaf0cf4cb9a5fc7 Oct 17 13:47:55.847415 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1163806185 Oct 17 13:47:55.847415 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:47:55.847415 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:47:55.847415 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/04b218c7b78b4c89baaf0cf4cb9a5fc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/04b218c7b78b4c89baaf0cf4cb9a5fc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/04b218c7b78b4c89baaf0cf4cb9a5fc7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_04b218c7b78b4c89baaf0cf4cb9a5fc7", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:47:55.847415 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-InstanceActionsV221TestJSON-1163806185 Oct 17 13:47:55.847415 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 04b218c7b78b4c89baaf0cf4cb9a5fc7 Oct 17 13:47:55.847415 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1163806185 Oct 17 13:47:55.847415 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-InstanceActionsV221TestJSON-1163806185-project Oct 17 13:47:55.847415 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:47:55.847415 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:47:55.847415 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 14f234ed5b074fb5b2596aa3dd59882e Oct 17 13:47:55.847415 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-InstanceActionsV221TestJSON-1163806185-project Oct 17 13:47:55.847415 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:47:55.847415 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 61ef701e-38b1-42a5-a604-89d2e3403033 could not be found. Oct 17 13:47:55.847415 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '61ef701e-38b1-42a5-a604-89d2e3403033'} Oct 17 13:47:55.847415 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:47:55.847415 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:55.847415 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:47:55.847415 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:47:55.847415 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:47:55.847415 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:47:55.847415 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:47:55.847415 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:47:55.847415 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:47:55.847415 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:47:55.847415 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61ef701e-38b1-42a5-a604-89d2e3403033 could not be found. Oct 17 13:47:55.847415 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:47:55.847415 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:47:55.847415 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:47:55.847415 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:55.847415 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:47:55.847415 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:47:55.847415 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:47:55.847415 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:47:55.847415 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:47:55.847415 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:47:55.847415 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:47:55.847415 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:47:55.847415 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:47:55.847415 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:47:55.847415 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:47:55.847415 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:47:55.847415 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61ef701e-38b1-42a5-a604-89d2e3403033 could not be found. Oct 17 13:47:55.847415 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:47:55.847415 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:47:55.860205 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:47:55.860205 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:55.860205 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:47:55.860205 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:47:55.860205 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:47:55.860205 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:47:55.860205 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61ef701e-38b1-42a5-a604-89d2e3403033 could not be found. Oct 17 13:47:55.860205 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:47:55.860971 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ca28829a-aa6b-40e0-83b5-984674d69449 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Returning 404 to user: Instance 29fb8b41-6dcb-49f2-9e1c-11719cace5d9 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:47:55.866071 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ca28829a-aa6b-40e0-83b5-984674d69449 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] 10.222.0.79 "GET /compute/v2.1/servers/29fb8b41-6dcb-49f2-9e1c-11719cace5d9" status: 404 len: 111 microversion: 2.1 time: 0.080975 Oct 17 13:47:55.871325 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1560/3111] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:55 2022] GET /compute/v2.1/servers/29fb8b41-6dcb-49f2-9e1c-11719cace5d9 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:47:55.872938 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a6497d0d-05d6-4985-886b-3692f3c23990 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] Returning 404 to user: Instance 61ef701e-38b1-42a5-a604-89d2e3403033 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:47:55.873822 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a6497d0d-05d6-4985-886b-3692f3c23990 tempest-InstanceActionsV221TestJSON-1163806185 tempest-InstanceActionsV221TestJSON-1163806185-project] 10.222.0.79 "GET /compute/v2.1/servers/61ef701e-38b1-42a5-a604-89d2e3403033" status: 404 len: 111 microversion: 2.21 time: 0.132079 Oct 17 13:47:55.874407 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1552/3112] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:47:55 2022] GET /compute/v2.1/servers/61ef701e-38b1-42a5-a604-89d2e3403033 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:47:55.882217 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f3e2aa6e-2f98-4c52-9dd2-5753628ded77 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:55.882849 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f3e2aa6e-2f98-4c52-9dd2-5753628ded77 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: a2994495-366a-446f-b7a6-16340911e17c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:55.891514 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-dbf4cab0-fdd7-4a54-9456-cecb3aebaed2 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Calling method '.version_select at 0x7f7cd56053a0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:55.907934 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f3e2aa6e-2f98-4c52-9dd2-5753628ded77 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:55.909060 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f3e2aa6e-2f98-4c52-9dd2-5753628ded77 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:55.910428 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f3e2aa6e-2f98-4c52-9dd2-5753628ded77 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:55.911343 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f3e2aa6e-2f98-4c52-9dd2-5753628ded77 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:55.912593 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f3e2aa6e-2f98-4c52-9dd2-5753628ded77 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:55.913305 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f3e2aa6e-2f98-4c52-9dd2-5753628ded77 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:56.377294 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f3e2aa6e-2f98-4c52-9dd2-5753628ded77 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683d18db860a4d60ab3eeba2a372b2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11973b8e1d8a4af8add65726e8ba7c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:56.389330 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f3e2aa6e-2f98-4c52-9dd2-5753628ded77 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c" status: 200 len: 1360 microversion: 2.1 time: 0.516345 Oct 17 13:47:56.403615 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1561/3113] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:55 2022] GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c => generated 1360 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:56.410546 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-9f4a837e-45ec-4a78-9642-6406b98ebf53 req-f4ca91c8-2d30-4664-a8fc-07c85ef76777 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9eaf1302-c967-4a24-8772-df5b32f11a60", "tag": "1629935f-cce8-40f2-bbc7-1ee779fadbb9"}, {"name": "network-changed", "server_uuid": "50e9eae9-df55-48ee-b984-e6b7e4bb2628", "tag": "be3444eb-9f99-422e-963d-086fa4da6881"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:47:56.441825 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-9f4a837e-45ec-4a78-9642-6406b98ebf53 req-f4ca91c8-2d30-4664-a8fc-07c85ef76777 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:56.442720 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-9f4a837e-45ec-4a78-9642-6406b98ebf53 req-f4ca91c8-2d30-4664-a8fc-07c85ef76777 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:56.443338 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-9f4a837e-45ec-4a78-9642-6406b98ebf53 req-f4ca91c8-2d30-4664-a8fc-07c85ef76777 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:56.466558 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-9f4a837e-45ec-4a78-9642-6406b98ebf53 req-f4ca91c8-2d30-4664-a8fc-07c85ef76777 service nova] Creating event network-changed:1629935f-cce8-40f2-bbc7-1ee779fadbb9 for instance 9eaf1302-c967-4a24-8772-df5b32f11a60 on n-h2-854247-14 Oct 17 13:47:56.467121 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-9f4a837e-45ec-4a78-9642-6406b98ebf53 req-f4ca91c8-2d30-4664-a8fc-07c85ef76777 service nova] Creating event network-changed:be3444eb-9f99-422e-963d-086fa4da6881 for instance 50e9eae9-df55-48ee-b984-e6b7e4bb2628 on n-h1-854247-14 Oct 17 13:47:56.477566 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-9f4a837e-45ec-4a78-9642-6406b98ebf53 req-f4ca91c8-2d30-4664-a8fc-07c85ef76777 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.072205 Oct 17 13:47:56.478627 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1562/3114] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:47:56 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:47:56.484256 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-428817f3-c425-4b8a-a35e-7fe722a6f698 req-08c8115b-7f28-4d31-aaa5-8535a61535c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "531b762d-db7e-4911-af50-6b321b7706bf", "tag": "97144afc-d9c2-4725-92c7-3d7418acb203"}, {"name": "network-changed", "server_uuid": "531b762d-db7e-4911-af50-6b321b7706bf", "tag": "8648d762-6ec8-45e8-8c5e-e21c582b7da6"}, {"name": "network-changed", "server_uuid": "531b762d-db7e-4911-af50-6b321b7706bf", "tag": "54e2aa0d-ebff-4ff5-a88b-865d4f0e8386"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:47:56.506167 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-428817f3-c425-4b8a-a35e-7fe722a6f698 req-08c8115b-7f28-4d31-aaa5-8535a61535c5 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:56.506621 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-428817f3-c425-4b8a-a35e-7fe722a6f698 req-08c8115b-7f28-4d31-aaa5-8535a61535c5 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:56.507499 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-428817f3-c425-4b8a-a35e-7fe722a6f698 req-08c8115b-7f28-4d31-aaa5-8535a61535c5 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:56.520557 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-428817f3-c425-4b8a-a35e-7fe722a6f698 req-08c8115b-7f28-4d31-aaa5-8535a61535c5 service nova] Creating event network-changed:97144afc-d9c2-4725-92c7-3d7418acb203 for instance 531b762d-db7e-4911-af50-6b321b7706bf on n-h1-854247-14 Oct 17 13:47:56.521299 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-428817f3-c425-4b8a-a35e-7fe722a6f698 req-08c8115b-7f28-4d31-aaa5-8535a61535c5 service nova] Creating event network-changed:8648d762-6ec8-45e8-8c5e-e21c582b7da6 for instance 531b762d-db7e-4911-af50-6b321b7706bf on n-h1-854247-14 Oct 17 13:47:56.522113 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-428817f3-c425-4b8a-a35e-7fe722a6f698 req-08c8115b-7f28-4d31-aaa5-8535a61535c5 service nova] Creating event network-changed:54e2aa0d-ebff-4ff5-a88b-865d4f0e8386 for instance 531b762d-db7e-4911-af50-6b321b7706bf on n-h1-854247-14 Oct 17 13:47:56.527621 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-428817f3-c425-4b8a-a35e-7fe722a6f698 req-08c8115b-7f28-4d31-aaa5-8535a61535c5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.047322 Oct 17 13:47:56.528969 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1563/3115] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:47:56 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:47:56.534681 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f42a09f1-56ef-4756-880d-1163d0f33bd6 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:56.535681 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f42a09f1-56ef-4756-880d-1163d0f33bd6 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] [instance: 531b762d-db7e-4911-af50-6b321b7706bf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:56.542461 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f42a09f1-56ef-4756-880d-1163d0f33bd6 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:56.543309 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f42a09f1-56ef-4756-880d-1163d0f33bd6 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:56.543901 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f42a09f1-56ef-4756-880d-1163d0f33bd6 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:56.544784 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f42a09f1-56ef-4756-880d-1163d0f33bd6 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:56.545392 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f42a09f1-56ef-4756-880d-1163d0f33bd6 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:56.545967 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f42a09f1-56ef-4756-880d-1163d0f33bd6 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:57.616848 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f42a09f1-56ef-4756-880d-1163d0f33bd6 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:57.624879 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f42a09f1-56ef-4756-880d-1163d0f33bd6 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:57.629285 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f42a09f1-56ef-4756-880d-1163d0f33bd6 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:57.630537 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f42a09f1-56ef-4756-880d-1163d0f33bd6 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] 10.222.0.79 "GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf" status: 200 len: 1879 microversion: 2.42 time: 1.100331 Oct 17 13:47:57.637737 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1564/3116] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:47:56 2022] GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf => generated 1879 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:47:57.648863 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-10a73919-f73f-4ffd-8ffa-37a5f3a40621 req-6b5b4f31-2b4a-4347-b363-4c4201920051 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ef00d34-7f81-4649-a90a-a52cf78dbeca", "name": "network-vif-plugged", "status": "completed", "tag": "841d5cd2-6ca1-435c-ac29-bfeee122d7fe"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:47:57.671689 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-10a73919-f73f-4ffd-8ffa-37a5f3a40621 req-6b5b4f31-2b4a-4347-b363-4c4201920051 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:57.674188 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-10a73919-f73f-4ffd-8ffa-37a5f3a40621 req-6b5b4f31-2b4a-4347-b363-4c4201920051 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:57.679483 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-10a73919-f73f-4ffd-8ffa-37a5f3a40621 req-6b5b4f31-2b4a-4347-b363-4c4201920051 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:57.722236 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-10a73919-f73f-4ffd-8ffa-37a5f3a40621 req-6b5b4f31-2b4a-4347-b363-4c4201920051 service nova] Creating event network-vif-plugged:841d5cd2-6ca1-435c-ac29-bfeee122d7fe for instance 5ef00d34-7f81-4649-a90a-a52cf78dbeca on n-h2-854247-14 Oct 17 13:47:57.739082 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-10a73919-f73f-4ffd-8ffa-37a5f3a40621 req-6b5b4f31-2b4a-4347-b363-4c4201920051 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099943 Oct 17 13:47:57.744672 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1565/3117] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:47:57.756604 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-de7df52c-5879-43b5-9fcb-12fb1050d8d2 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:57.757580 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-de7df52c-5879-43b5-9fcb-12fb1050d8d2 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9eaf1302-c967-4a24-8772-df5b32f11a60] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:57.773053 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-de7df52c-5879-43b5-9fcb-12fb1050d8d2 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:57.773943 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-de7df52c-5879-43b5-9fcb-12fb1050d8d2 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:57.774615 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-de7df52c-5879-43b5-9fcb-12fb1050d8d2 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:57.775576 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-de7df52c-5879-43b5-9fcb-12fb1050d8d2 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:57.776304 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-de7df52c-5879-43b5-9fcb-12fb1050d8d2 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:57.777680 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-de7df52c-5879-43b5-9fcb-12fb1050d8d2 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:58.338038 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-de7df52c-5879-43b5-9fcb-12fb1050d8d2 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:58.354484 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-de7df52c-5879-43b5-9fcb-12fb1050d8d2 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/9eaf1302-c967-4a24-8772-df5b32f11a60" status: 200 len: 1312 microversion: 2.1 time: 0.607183 Oct 17 13:47:58.367229 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1566/3118] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:57 2022] GET /compute/v2.1/servers/9eaf1302-c967-4a24-8772-df5b32f11a60 => generated 1312 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:58.367229 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-76b6787e-d264-4111-a96c-c6235b707f48 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:58.367229 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-76b6787e-d264-4111-a96c-c6235b707f48 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:58.380341 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-76b6787e-d264-4111-a96c-c6235b707f48 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:58.381310 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-76b6787e-d264-4111-a96c-c6235b707f48 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:58.382535 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-76b6787e-d264-4111-a96c-c6235b707f48 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:58.383911 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-76b6787e-d264-4111-a96c-c6235b707f48 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:58.384754 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-76b6787e-d264-4111-a96c-c6235b707f48 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:58.385441 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-76b6787e-d264-4111-a96c-c6235b707f48 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:58.952769 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-dbf4cab0-fdd7-4a54-9456-cecb3aebaed2 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] 10.222.0.79 "DELETE /compute/v2.1/os-floating-ips/2b883d7e-9f22-4898-99a3-2b36358925fc" status: 202 len: 0 microversion: 2.1 time: 3.072165 Oct 17 13:47:58.954602 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1553/3119] 10.222.0.79 () {58 vars in 1263 bytes} [Mon Oct 17 13:47:55 2022] DELETE /compute/v2.1/os-floating-ips/2b883d7e-9f22-4898-99a3-2b36358925fc => generated 0 bytes in 3079 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:47:58.961293 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9b30b9b6-be4c-4cdb-a537-ab165f421916 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:58.963215 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9b30b9b6-be4c-4cdb-a537-ab165f421916 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:58.987905 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9b30b9b6-be4c-4cdb-a537-ab165f421916 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:58.988673 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9b30b9b6-be4c-4cdb-a537-ab165f421916 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:58.990718 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9b30b9b6-be4c-4cdb-a537-ab165f421916 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:58.992645 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9b30b9b6-be4c-4cdb-a537-ab165f421916 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:58.993486 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9b30b9b6-be4c-4cdb-a537-ab165f421916 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:58.994124 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9b30b9b6-be4c-4cdb-a537-ab165f421916 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:59.218583 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9b30b9b6-be4c-4cdb-a537-ab165f421916 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:59.240117 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9b30b9b6-be4c-4cdb-a537-ab165f421916 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:59.242651 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9b30b9b6-be4c-4cdb-a537-ab165f421916 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:59.244645 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9b30b9b6-be4c-4cdb-a537-ab165f421916 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1593 microversion: 2.32 time: 0.288747 Oct 17 13:47:59.252296 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1554/3120] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:47:58 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1593 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:47:59.257863 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f1f24f7b-f4b0-4161-92b6-291c4b4ffe25 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:59.258836 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f1f24f7b-f4b0-4161-92b6-291c4b4ffe25 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: a2994495-366a-446f-b7a6-16340911e17c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:59.275109 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f1f24f7b-f4b0-4161-92b6-291c4b4ffe25 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:59.277830 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f1f24f7b-f4b0-4161-92b6-291c4b4ffe25 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:59.281583 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f1f24f7b-f4b0-4161-92b6-291c4b4ffe25 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:59.283127 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f1f24f7b-f4b0-4161-92b6-291c4b4ffe25 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:59.283983 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f1f24f7b-f4b0-4161-92b6-291c4b4ffe25 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:59.284740 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f1f24f7b-f4b0-4161-92b6-291c4b4ffe25 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:59.347733 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-76b6787e-d264-4111-a96c-c6235b707f48 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:59.369706 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-76b6787e-d264-4111-a96c-c6235b707f48 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1519 microversion: 2.1 time: 1.010317 Oct 17 13:47:59.371646 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1567/3121] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:58 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1519 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:59.381298 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2da23e6b-e3e9-4a6b-9a97-4652c924bcaa tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:59.382981 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2da23e6b-e3e9-4a6b-9a97-4652c924bcaa tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] [instance: 531b762d-db7e-4911-af50-6b321b7706bf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:59.395834 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2da23e6b-e3e9-4a6b-9a97-4652c924bcaa tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:59.397021 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2da23e6b-e3e9-4a6b-9a97-4652c924bcaa tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:59.399157 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2da23e6b-e3e9-4a6b-9a97-4652c924bcaa tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:59.400156 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2da23e6b-e3e9-4a6b-9a97-4652c924bcaa tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:59.401541 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2da23e6b-e3e9-4a6b-9a97-4652c924bcaa tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:59.402350 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2da23e6b-e3e9-4a6b-9a97-4652c924bcaa tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:59.873491 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f1f24f7b-f4b0-4161-92b6-291c4b4ffe25 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683d18db860a4d60ab3eeba2a372b2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11973b8e1d8a4af8add65726e8ba7c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:59.884119 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f1f24f7b-f4b0-4161-92b6-291c4b4ffe25 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c" status: 200 len: 1545 microversion: 2.1 time: 0.630251 Oct 17 13:47:59.892869 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1555/3122] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:59 2022] GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c => generated 1545 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:59.899673 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e840d4bb-c287-4d3e-8ceb-5ed60fbeaf9b tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:59.906489 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e840d4bb-c287-4d3e-8ceb-5ed60fbeaf9b tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] [instance: 50e9eae9-df55-48ee-b984-e6b7e4bb2628] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:59.921736 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e840d4bb-c287-4d3e-8ceb-5ed60fbeaf9b tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:59.922239 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e840d4bb-c287-4d3e-8ceb-5ed60fbeaf9b tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:59.922679 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e840d4bb-c287-4d3e-8ceb-5ed60fbeaf9b tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:59.923636 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e840d4bb-c287-4d3e-8ceb-5ed60fbeaf9b tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:59.924420 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e840d4bb-c287-4d3e-8ceb-5ed60fbeaf9b tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:59.925847 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e840d4bb-c287-4d3e-8ceb-5ed60fbeaf9b tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:59.984121 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e840d4bb-c287-4d3e-8ceb-5ed60fbeaf9b tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] [instance: 50e9eae9-df55-48ee-b984-e6b7e4bb2628] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:48:00.132708 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2da23e6b-e3e9-4a6b-9a97-4652c924bcaa tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:00.158681 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2da23e6b-e3e9-4a6b-9a97-4652c924bcaa tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:00.165210 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2da23e6b-e3e9-4a6b-9a97-4652c924bcaa tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:00.166714 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2da23e6b-e3e9-4a6b-9a97-4652c924bcaa tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] 10.222.0.79 "GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf" status: 200 len: 1879 microversion: 2.42 time: 0.794000 Oct 17 13:48:00.168747 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1568/3123] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:47:59 2022] GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf => generated 1879 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:48:00.179852 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-57702b15-8294-4914-ba8a-a901c5829988 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:00.182068 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-57702b15-8294-4914-ba8a-a901c5829988 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9eaf1302-c967-4a24-8772-df5b32f11a60] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:00.198610 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-57702b15-8294-4914-ba8a-a901c5829988 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:00.199231 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-57702b15-8294-4914-ba8a-a901c5829988 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:00.199613 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-57702b15-8294-4914-ba8a-a901c5829988 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:00.200499 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-57702b15-8294-4914-ba8a-a901c5829988 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:00.200756 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-57702b15-8294-4914-ba8a-a901c5829988 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:00.201182 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-57702b15-8294-4914-ba8a-a901c5829988 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:00.209116 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e840d4bb-c287-4d3e-8ceb-5ed60fbeaf9b tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] 10.222.0.79 "DELETE /compute/v2.1/servers/50e9eae9-df55-48ee-b984-e6b7e4bb2628" status: 204 len: 0 microversion: 2.1 time: 0.314520 Oct 17 13:48:00.209759 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1556/3124] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:47:59 2022] DELETE /compute/v2.1/servers/50e9eae9-df55-48ee-b984-e6b7e4bb2628 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:48:00.228846 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-73697b55-8b16-45ec-b37e-2d90a13f2723 req-a380579a-d610-4701-9aaa-9c62a772a43f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9eaf1302-c967-4a24-8772-df5b32f11a60", "name": "network-vif-plugged", "status": "completed", "tag": "1629935f-cce8-40f2-bbc7-1ee779fadbb9"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:00.252587 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-73697b55-8b16-45ec-b37e-2d90a13f2723 req-a380579a-d610-4701-9aaa-9c62a772a43f service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:00.253093 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-73697b55-8b16-45ec-b37e-2d90a13f2723 req-a380579a-d610-4701-9aaa-9c62a772a43f service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:00.256437 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-73697b55-8b16-45ec-b37e-2d90a13f2723 req-a380579a-d610-4701-9aaa-9c62a772a43f service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:00.290596 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-73697b55-8b16-45ec-b37e-2d90a13f2723 req-a380579a-d610-4701-9aaa-9c62a772a43f service nova] Creating event network-vif-plugged:1629935f-cce8-40f2-bbc7-1ee779fadbb9 for instance 9eaf1302-c967-4a24-8772-df5b32f11a60 on n-h2-854247-14 Oct 17 13:48:00.305377 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-73697b55-8b16-45ec-b37e-2d90a13f2723 req-a380579a-d610-4701-9aaa-9c62a772a43f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085980 Oct 17 13:48:00.319386 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1557/3125] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:48:00.338684 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bfe98bd4-f6c4-486d-9cde-bd4440b59af7 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:00.339887 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-bfe98bd4-f6c4-486d-9cde-bd4440b59af7 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: a2994495-366a-446f-b7a6-16340911e17c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:00.348476 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bfe98bd4-f6c4-486d-9cde-bd4440b59af7 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:00.349264 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bfe98bd4-f6c4-486d-9cde-bd4440b59af7 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:00.350612 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bfe98bd4-f6c4-486d-9cde-bd4440b59af7 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:00.351922 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bfe98bd4-f6c4-486d-9cde-bd4440b59af7 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:00.352608 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bfe98bd4-f6c4-486d-9cde-bd4440b59af7 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:00.353275 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bfe98bd4-f6c4-486d-9cde-bd4440b59af7 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:00.708803 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-bfe98bd4-f6c4-486d-9cde-bd4440b59af7 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.385281 Oct 17 13:48:00.709722 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1558/3126] 10.222.0.79 () {58 vars in 1275 bytes} [Mon Oct 17 13:48:00 2022] GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c/os-interface => generated 284 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:48:00.717521 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1890ed15-a46c-487c-a5cb-bee21a2af509 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:00.718830 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1890ed15-a46c-487c-a5cb-bee21a2af509 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] [instance: 50e9eae9-df55-48ee-b984-e6b7e4bb2628] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:00.738731 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1890ed15-a46c-487c-a5cb-bee21a2af509 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:00.739659 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1890ed15-a46c-487c-a5cb-bee21a2af509 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:00.740488 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1890ed15-a46c-487c-a5cb-bee21a2af509 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:00.741446 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1890ed15-a46c-487c-a5cb-bee21a2af509 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:00.743847 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1890ed15-a46c-487c-a5cb-bee21a2af509 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:00.744885 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1890ed15-a46c-487c-a5cb-bee21a2af509 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:01.064983 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-57702b15-8294-4914-ba8a-a901c5829988 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:01.077291 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-57702b15-8294-4914-ba8a-a901c5829988 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/9eaf1302-c967-4a24-8772-df5b32f11a60" status: 200 len: 1312 microversion: 2.1 time: 0.907403 Oct 17 13:48:01.080944 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1569/3127] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:00 2022] GET /compute/v2.1/servers/9eaf1302-c967-4a24-8772-df5b32f11a60 => generated 1312 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:01.090224 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0085daf5-9d42-48b3-af2a-d6184a4a8454 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:01.094371 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0085daf5-9d42-48b3-af2a-d6184a4a8454 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:01.107595 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0085daf5-9d42-48b3-af2a-d6184a4a8454 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:01.110475 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0085daf5-9d42-48b3-af2a-d6184a4a8454 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:01.111659 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0085daf5-9d42-48b3-af2a-d6184a4a8454 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:01.116546 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0085daf5-9d42-48b3-af2a-d6184a4a8454 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:01.117330 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0085daf5-9d42-48b3-af2a-d6184a4a8454 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:01.117978 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0085daf5-9d42-48b3-af2a-d6184a4a8454 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:01.635278 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1890ed15-a46c-487c-a5cb-bee21a2af509 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a3472f83914990ad41f037b4aafd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f91db965084796a4a3dce1b4e921e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:01.649588 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1890ed15-a46c-487c-a5cb-bee21a2af509 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] 10.222.0.79 "GET /compute/v2.1/servers/50e9eae9-df55-48ee-b984-e6b7e4bb2628" status: 200 len: 1524 microversion: 2.1 time: 0.936996 Oct 17 13:48:01.650308 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1559/3128] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:00 2022] GET /compute/v2.1/servers/50e9eae9-df55-48ee-b984-e6b7e4bb2628 => generated 1524 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:01.669702 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-50850079-01ff-435a-a8f8-40ac3f955ddd tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:01.672348 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-50850079-01ff-435a-a8f8-40ac3f955ddd tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:01.686719 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-50850079-01ff-435a-a8f8-40ac3f955ddd tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:01.688059 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-50850079-01ff-435a-a8f8-40ac3f955ddd tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:01.688863 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-50850079-01ff-435a-a8f8-40ac3f955ddd tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:01.689781 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-50850079-01ff-435a-a8f8-40ac3f955ddd tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:01.690475 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-50850079-01ff-435a-a8f8-40ac3f955ddd tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:01.691366 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-50850079-01ff-435a-a8f8-40ac3f955ddd tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:01.853233 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0085daf5-9d42-48b3-af2a-d6184a4a8454 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:01.869012 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0085daf5-9d42-48b3-af2a-d6184a4a8454 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:01.870898 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0085daf5-9d42-48b3-af2a-d6184a4a8454 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:01.873120 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0085daf5-9d42-48b3-af2a-d6184a4a8454 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1661 microversion: 2.32 time: 0.790810 Oct 17 13:48:01.874369 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1570/3129] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:01 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1661 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:48:01.880905 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-df4ad7ae-35cf-4dc9-90ff-916df0fc56e2 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:01.881793 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-df4ad7ae-35cf-4dc9-90ff-916df0fc56e2 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] [instance: 531b762d-db7e-4911-af50-6b321b7706bf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:01.894772 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df4ad7ae-35cf-4dc9-90ff-916df0fc56e2 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:01.895614 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df4ad7ae-35cf-4dc9-90ff-916df0fc56e2 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:01.896228 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df4ad7ae-35cf-4dc9-90ff-916df0fc56e2 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:01.897125 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df4ad7ae-35cf-4dc9-90ff-916df0fc56e2 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:01.897747 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df4ad7ae-35cf-4dc9-90ff-916df0fc56e2 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:01.898323 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df4ad7ae-35cf-4dc9-90ff-916df0fc56e2 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:02.776121 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-50850079-01ff-435a-a8f8-40ac3f955ddd tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:02.789449 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-50850079-01ff-435a-a8f8-40ac3f955ddd tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 1.137425 Oct 17 13:48:02.803664 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1560/3130] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:01 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:02.815493 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b694ccf9-90d2-4200-bb30-7c35ea03c798 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:02.816536 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b694ccf9-90d2-4200-bb30-7c35ea03c798 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9eaf1302-c967-4a24-8772-df5b32f11a60] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:02.824040 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b694ccf9-90d2-4200-bb30-7c35ea03c798 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:02.825763 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b694ccf9-90d2-4200-bb30-7c35ea03c798 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:02.826367 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b694ccf9-90d2-4200-bb30-7c35ea03c798 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:02.827267 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b694ccf9-90d2-4200-bb30-7c35ea03c798 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:02.827857 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b694ccf9-90d2-4200-bb30-7c35ea03c798 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:02.828444 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b694ccf9-90d2-4200-bb30-7c35ea03c798 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:02.863577 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:48:03.052954 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-df4ad7ae-35cf-4dc9-90ff-916df0fc56e2 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:03.066897 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-df4ad7ae-35cf-4dc9-90ff-916df0fc56e2 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:03.075245 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-df4ad7ae-35cf-4dc9-90ff-916df0fc56e2 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:03.077812 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-df4ad7ae-35cf-4dc9-90ff-916df0fc56e2 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] 10.222.0.79 "GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf" status: 200 len: 1879 microversion: 2.42 time: 1.201443 Oct 17 13:48:03.081502 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1571/3131] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:01 2022] GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf => generated 1879 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:48:03.094459 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-55abb1ad-af50-4a7a-adc0-57932f278d19 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:03.097748 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-55abb1ad-af50-4a7a-adc0-57932f278d19 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] [instance: 50e9eae9-df55-48ee-b984-e6b7e4bb2628] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:03.124838 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-55abb1ad-af50-4a7a-adc0-57932f278d19 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:03.128561 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-55abb1ad-af50-4a7a-adc0-57932f278d19 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:03.129197 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-55abb1ad-af50-4a7a-adc0-57932f278d19 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:03.130104 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-55abb1ad-af50-4a7a-adc0-57932f278d19 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:03.133961 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-55abb1ad-af50-4a7a-adc0-57932f278d19 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:03.134637 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-55abb1ad-af50-4a7a-adc0-57932f278d19 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:03.393230 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-55abb1ad-af50-4a7a-adc0-57932f278d19 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a3472f83914990ad41f037b4aafd63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f91db965084796a4a3dce1b4e921e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:03.404987 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-55abb1ad-af50-4a7a-adc0-57932f278d19 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] 10.222.0.79 "GET /compute/v2.1/servers/50e9eae9-df55-48ee-b984-e6b7e4bb2628" status: 200 len: 1482 microversion: 2.1 time: 0.322223 Oct 17 13:48:03.424447 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1572/3132] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:03 2022] GET /compute/v2.1/servers/50e9eae9-df55-48ee-b984-e6b7e4bb2628 => generated 1482 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:03.443257 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2c26120d-dab3-495a-93d7-4b43274c0c3d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:03.445745 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2c26120d-dab3-495a-93d7-4b43274c0c3d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:03.458220 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2c26120d-dab3-495a-93d7-4b43274c0c3d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:03.458905 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2c26120d-dab3-495a-93d7-4b43274c0c3d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:03.459568 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2c26120d-dab3-495a-93d7-4b43274c0c3d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:03.460635 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2c26120d-dab3-495a-93d7-4b43274c0c3d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:03.461315 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2c26120d-dab3-495a-93d7-4b43274c0c3d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:03.462023 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2c26120d-dab3-495a-93d7-4b43274c0c3d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:03.491493 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b694ccf9-90d2-4200-bb30-7c35ea03c798 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:03.504743 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b694ccf9-90d2-4200-bb30-7c35ea03c798 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/9eaf1302-c967-4a24-8772-df5b32f11a60" status: 200 len: 1462 microversion: 2.1 time: 0.699766 Oct 17 13:48:03.507887 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1561/3133] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:02 2022] GET /compute/v2.1/servers/9eaf1302-c967-4a24-8772-df5b32f11a60 => generated 1462 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:03.523669 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a6363b2c-c5c3-4e49-8e5a-50f196ce1dcb tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:03.524585 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a6363b2c-c5c3-4e49-8e5a-50f196ce1dcb tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:03.536832 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a6363b2c-c5c3-4e49-8e5a-50f196ce1dcb tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:03.539076 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a6363b2c-c5c3-4e49-8e5a-50f196ce1dcb tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:03.540883 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a6363b2c-c5c3-4e49-8e5a-50f196ce1dcb tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:03.544368 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a6363b2c-c5c3-4e49-8e5a-50f196ce1dcb tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:03.544859 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a6363b2c-c5c3-4e49-8e5a-50f196ce1dcb tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:03.545355 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a6363b2c-c5c3-4e49-8e5a-50f196ce1dcb tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:04.301641 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a6363b2c-c5c3-4e49-8e5a-50f196ce1dcb tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:04.314375 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a6363b2c-c5c3-4e49-8e5a-50f196ce1dcb tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:04.316538 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a6363b2c-c5c3-4e49-8e5a-50f196ce1dcb tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:04.318552 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a6363b2c-c5c3-4e49-8e5a-50f196ce1dcb tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1661 microversion: 2.32 time: 0.808528 Oct 17 13:48:04.319860 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1562/3134] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:03 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1661 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:48:04.326446 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-81492e27-991d-4eb4-bffb-d1262fbc651f req-d9da27ae-1833-46a7-b790-b023f85f6d2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50e9eae9-df55-48ee-b984-e6b7e4bb2628", "name": "network-vif-deleted", "tag": "be3444eb-9f99-422e-963d-086fa4da6881"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:04.336953 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-81492e27-991d-4eb4-bffb-d1262fbc651f req-d9da27ae-1833-46a7-b790-b023f85f6d2a service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:04.337437 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-81492e27-991d-4eb4-bffb-d1262fbc651f req-d9da27ae-1833-46a7-b790-b023f85f6d2a service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:04.337885 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-81492e27-991d-4eb4-bffb-d1262fbc651f req-d9da27ae-1833-46a7-b790-b023f85f6d2a service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:04.352855 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-81492e27-991d-4eb4-bffb-d1262fbc651f req-d9da27ae-1833-46a7-b790-b023f85f6d2a service nova] Creating event network-vif-deleted:be3444eb-9f99-422e-963d-086fa4da6881 for instance 50e9eae9-df55-48ee-b984-e6b7e4bb2628 on n-h1-854247-14 Oct 17 13:48:04.357921 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-81492e27-991d-4eb4-bffb-d1262fbc651f req-d9da27ae-1833-46a7-b790-b023f85f6d2a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036227 Oct 17 13:48:04.358563 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1563/3135] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:48:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:48:04.364008 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ac763431-1fee-4de6-8fe3-d7ffe8fca136 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:04.366362 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ac763431-1fee-4de6-8fe3-d7ffe8fca136 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9eaf1302-c967-4a24-8772-df5b32f11a60] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:04.372619 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2c26120d-dab3-495a-93d7-4b43274c0c3d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:04.373128 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac763431-1fee-4de6-8fe3-d7ffe8fca136 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:04.373588 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac763431-1fee-4de6-8fe3-d7ffe8fca136 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:04.374027 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac763431-1fee-4de6-8fe3-d7ffe8fca136 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:04.374781 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac763431-1fee-4de6-8fe3-d7ffe8fca136 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:04.375282 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac763431-1fee-4de6-8fe3-d7ffe8fca136 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:04.375731 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac763431-1fee-4de6-8fe3-d7ffe8fca136 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:04.395379 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2c26120d-dab3-495a-93d7-4b43274c0c3d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 0.956600 Oct 17 13:48:04.412102 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1573/3136] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:03 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:04.427692 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3a3e5e39-69f3-472d-a1d0-02906ed8e76b tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:04.427692 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3a3e5e39-69f3-472d-a1d0-02906ed8e76b tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] [instance: 531b762d-db7e-4911-af50-6b321b7706bf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:04.437032 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3a3e5e39-69f3-472d-a1d0-02906ed8e76b tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:04.437745 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3a3e5e39-69f3-472d-a1d0-02906ed8e76b tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:04.438508 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3a3e5e39-69f3-472d-a1d0-02906ed8e76b tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:04.440219 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3a3e5e39-69f3-472d-a1d0-02906ed8e76b tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:04.440845 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3a3e5e39-69f3-472d-a1d0-02906ed8e76b tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:04.441604 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3a3e5e39-69f3-472d-a1d0-02906ed8e76b tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:04.519464 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ac763431-1fee-4de6-8fe3-d7ffe8fca136 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:04.526482 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ac763431-1fee-4de6-8fe3-d7ffe8fca136 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9eaf1302-c967-4a24-8772-df5b32f11a60] Old instance type m1.heat2, new instance type m1.heat {{(pid=127017) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 17 13:48:04.535468 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-ac763431-1fee-4de6-8fe3-d7ffe8fca136 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:48:04.535468 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-ac763431-1fee-4de6-8fe3-d7ffe8fca136 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:48:04.536035 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-ac763431-1fee-4de6-8fe3-d7ffe8fca136 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:48:04.536477 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-ac763431-1fee-4de6-8fe3-d7ffe8fca136 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:48:04.536925 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-ac763431-1fee-4de6-8fe3-d7ffe8fca136 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:48:04.647355 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:48:04.670690 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ac763431-1fee-4de6-8fe3-d7ffe8fca136 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "POST /compute/v2.1/servers/9eaf1302-c967-4a24-8772-df5b32f11a60/action" status: 202 len: 0 microversion: 2.1 time: 0.310869 Oct 17 13:48:04.671918 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1564/3137] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:48:04 2022] POST /compute/v2.1/servers/9eaf1302-c967-4a24-8772-df5b32f11a60/action => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:48:04.678133 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-fd39fcee-2b81-439e-a0fb-5bed91929e39 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1081500542", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eb9b1c95-6d02-4d66-9e16-313080ea7e89"}], "security_groups": [{"name": "tempest-securitygroup--50343758"}], "key_name": "tempest-keypair-1589025206", "user_data": "}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:05.645622 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3a3e5e39-69f3-472d-a1d0-02906ed8e76b tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:05.674633 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-fd39fcee-2b81-439e-a0fb-5bed91929e39 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] validate_networks() for [('eb9b1c95-6d02-4d66-9e16-313080ea7e89', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:48:05.689016 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3a3e5e39-69f3-472d-a1d0-02906ed8e76b tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:05.691271 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3a3e5e39-69f3-472d-a1d0-02906ed8e76b tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:05.694311 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3a3e5e39-69f3-472d-a1d0-02906ed8e76b tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] 10.222.0.79 "GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf" status: 200 len: 1879 microversion: 2.42 time: 1.277050 Oct 17 13:48:05.710861 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1574/3138] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:04 2022] GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf => generated 1879 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:48:05.722604 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5a8f58f0-ff8f-4eef-8f24-d2b6d10c8724 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:05.723516 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5a8f58f0-ff8f-4eef-8f24-d2b6d10c8724 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:05.729315 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=10 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:48:05.731214 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5a8f58f0-ff8f-4eef-8f24-d2b6d10c8724 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:05.731932 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5a8f58f0-ff8f-4eef-8f24-d2b6d10c8724 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:05.732522 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5a8f58f0-ff8f-4eef-8f24-d2b6d10c8724 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:05.733557 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5a8f58f0-ff8f-4eef-8f24-d2b6d10c8724 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:05.734168 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5a8f58f0-ff8f-4eef-8f24-d2b6d10c8724 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:05.734746 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5a8f58f0-ff8f-4eef-8f24-d2b6d10c8724 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:06.292155 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5a8f58f0-ff8f-4eef-8f24-d2b6d10c8724 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:06.300844 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5a8f58f0-ff8f-4eef-8f24-d2b6d10c8724 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 0.588072 Oct 17 13:48:06.305895 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1575/3139] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:05 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:06.310737 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6bbf1cd1-5d94-453a-8d0d-365943a6de02 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:06.311384 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6bbf1cd1-5d94-453a-8d0d-365943a6de02 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] [instance: 50e9eae9-df55-48ee-b984-e6b7e4bb2628] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:06.348505 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6bbf1cd1-5d94-453a-8d0d-365943a6de02 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:06.349230 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6bbf1cd1-5d94-453a-8d0d-365943a6de02 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:06.349669 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6bbf1cd1-5d94-453a-8d0d-365943a6de02 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:06.358518 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6bbf1cd1-5d94-453a-8d0d-365943a6de02 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:06.359154 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6bbf1cd1-5d94-453a-8d0d-365943a6de02 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:06.359640 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6bbf1cd1-5d94-453a-8d0d-365943a6de02 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:06.385739 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=100 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:48:06.387416 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-6bbf1cd1-5d94-453a-8d0d-365943a6de02 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] HTTP exception thrown: Instance 50e9eae9-df55-48ee-b984-e6b7e4bb2628 could not be found. Oct 17 13:48:06.389583 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6bbf1cd1-5d94-453a-8d0d-365943a6de02 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Request method failure captured: Oct 17 13:48:06.389583 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/50e9eae9-df55-48ee-b984-e6b7e4bb2628 HTTP/1.1 Oct 17 13:48:06.389583 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:48:06.389583 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:48:06.389583 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:48:06.389583 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:48:06.389583 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:48:06.389583 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:48:06.389583 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:48:06.389583 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:48:06.389583 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVyHr9cMxqqpMQ_SGFYWfWNh2ukm6fljeGlynI7p-vwRyqG7rxvn3_33Cj97gvChwnYCDwAhthJ-BWlrwI8_a3OyS9DmQuOO_0qjGEcsRVLbQqHUiyE61o4LdbdwT0-3KIWQ5f4T-boDaU-G6V3CGAtmxh9Hoj3ZiO9LCTI0rTmfS60 Oct 17 13:48:06.389583 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:48:06.389583 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:48:06.389583 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:48:06.389583 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:48:06.389583 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:48:06.389583 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:48:06.389583 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 18f91db965084796a4a3dce1b4e921e5 Oct 17 13:48:06.389583 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-655180239 Oct 17 13:48:06.389583 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:48:06.389583 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:48:06.389583 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/18f91db965084796a4a3dce1b4e921e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/18f91db965084796a4a3dce1b4e921e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/18f91db965084796a4a3dce1b4e921e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_18f91db965084796a4a3dce1b4e921e5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:48:06.389583 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-655180239 Oct 17 13:48:06.389583 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 18f91db965084796a4a3dce1b4e921e5 Oct 17 13:48:06.389583 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-655180239 Oct 17 13:48:06.389583 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-FloatingIPsAssociationTestJSON-655180239-project Oct 17 13:48:06.389583 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:48:06.389583 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:48:06.389583 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 43a3472f83914990ad41f037b4aafd63 Oct 17 13:48:06.389583 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-655180239-project Oct 17 13:48:06.389583 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:48:06.389583 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 50e9eae9-df55-48ee-b984-e6b7e4bb2628 could not be found. Oct 17 13:48:06.389583 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '50e9eae9-df55-48ee-b984-e6b7e4bb2628'} Oct 17 13:48:06.389583 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:48:06.389583 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:48:06.389583 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:48:06.389583 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:48:06.389583 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:48:06.389583 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:48:06.389583 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:48:06.389583 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:48:06.389583 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:48:06.389583 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:48:06.389583 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50e9eae9-df55-48ee-b984-e6b7e4bb2628 could not be found. Oct 17 13:48:06.389583 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:48:06.389583 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:48:06.389583 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:48:06.389583 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:48:06.389583 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:48:06.389583 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:48:06.389583 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:48:06.389583 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:48:06.389583 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:48:06.389583 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:48:06.389583 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:48:06.389583 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:48:06.389583 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:48:06.389583 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:48:06.389583 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:48:06.389583 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:48:06.389583 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50e9eae9-df55-48ee-b984-e6b7e4bb2628 could not be found. Oct 17 13:48:06.389583 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:48:06.389583 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:48:06.395392 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:48:06.395392 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:48:06.395392 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:48:06.395392 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:48:06.395392 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:48:06.395392 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:48:06.395392 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50e9eae9-df55-48ee-b984-e6b7e4bb2628 could not be found. Oct 17 13:48:06.395392 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:48:06.395392 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6bbf1cd1-5d94-453a-8d0d-365943a6de02 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] Returning 404 to user: Instance 50e9eae9-df55-48ee-b984-e6b7e4bb2628 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:48:06.397845 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6bbf1cd1-5d94-453a-8d0d-365943a6de02 tempest-FloatingIPsAssociationTestJSON-655180239 tempest-FloatingIPsAssociationTestJSON-655180239-project] 10.222.0.79 "GET /compute/v2.1/servers/50e9eae9-df55-48ee-b984-e6b7e4bb2628" status: 404 len: 111 microversion: 2.1 time: 0.089645 Oct 17 13:48:06.397845 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1576/3140] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:06 2022] GET /compute/v2.1/servers/50e9eae9-df55-48ee-b984-e6b7e4bb2628 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:48:06.410710 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cf49a641-a5bd-466a-923d-f1146edc8742 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:06.419189 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cf49a641-a5bd-466a-923d-f1146edc8742 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9eaf1302-c967-4a24-8772-df5b32f11a60] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:06.434568 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cf49a641-a5bd-466a-923d-f1146edc8742 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:06.435461 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cf49a641-a5bd-466a-923d-f1146edc8742 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:06.436109 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cf49a641-a5bd-466a-923d-f1146edc8742 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:06.437036 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cf49a641-a5bd-466a-923d-f1146edc8742 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:06.437726 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cf49a641-a5bd-466a-923d-f1146edc8742 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:06.438491 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cf49a641-a5bd-466a-923d-f1146edc8742 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:06.906448 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cf49a641-a5bd-466a-923d-f1146edc8742 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:06.920185 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cf49a641-a5bd-466a-923d-f1146edc8742 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/9eaf1302-c967-4a24-8772-df5b32f11a60" status: 200 len: 1471 microversion: 2.1 time: 0.521115 Oct 17 13:48:06.922304 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1577/3141] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:06 2022] GET /compute/v2.1/servers/9eaf1302-c967-4a24-8772-df5b32f11a60 => generated 1471 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:06.931315 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-307a96af-2146-4e8c-8f26-f21e5f0571b2 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:06.932624 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-307a96af-2146-4e8c-8f26-f21e5f0571b2 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:06.942599 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-307a96af-2146-4e8c-8f26-f21e5f0571b2 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:06.943531 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-307a96af-2146-4e8c-8f26-f21e5f0571b2 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:06.944404 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-307a96af-2146-4e8c-8f26-f21e5f0571b2 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:06.946483 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-307a96af-2146-4e8c-8f26-f21e5f0571b2 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:06.947447 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-307a96af-2146-4e8c-8f26-f21e5f0571b2 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:06.948791 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-307a96af-2146-4e8c-8f26-f21e5f0571b2 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:07.406405 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-fd39fcee-2b81-439e-a0fb-5bed91929e39 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:48:07.407350 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-fd39fcee-2b81-439e-a0fb-5bed91929e39 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:48:07.408114 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-fd39fcee-2b81-439e-a0fb-5bed91929e39 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:48:07.408773 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-fd39fcee-2b81-439e-a0fb-5bed91929e39 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:48:07.409717 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-fd39fcee-2b81-439e-a0fb-5bed91929e39 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:48:07.432546 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fd39fcee-2b81-439e-a0fb-5bed91929e39 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:07.433238 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fd39fcee-2b81-439e-a0fb-5bed91929e39 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:07.433865 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fd39fcee-2b81-439e-a0fb-5bed91929e39 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:07.435944 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fd39fcee-2b81-439e-a0fb-5bed91929e39 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:07.438980 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fd39fcee-2b81-439e-a0fb-5bed91929e39 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:07.439713 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fd39fcee-2b81-439e-a0fb-5bed91929e39 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:07.500834 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-fd39fcee-2b81-439e-a0fb-5bed91929e39 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Getting quotas for project 4acd31ce63b64ac3a05b76d4a9fdf7c0. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:48:07.508733 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-fd39fcee-2b81-439e-a0fb-5bed91929e39 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Getting quotas for user c7a7b9b048234fd2926739e3f08400b0 and project 4acd31ce63b64ac3a05b76d4a9fdf7c0. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:48:07.528022 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-fd39fcee-2b81-439e-a0fb-5bed91929e39 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:48:07.534627 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-fd39fcee-2b81-439e-a0fb-5bed91929e39 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 10690310-b856-4f6e-a4ea-1b771f45a75f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:48:07.604544 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-307a96af-2146-4e8c-8f26-f21e5f0571b2 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:07.619032 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-307a96af-2146-4e8c-8f26-f21e5f0571b2 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:07.624851 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-307a96af-2146-4e8c-8f26-f21e5f0571b2 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:07.630010 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-307a96af-2146-4e8c-8f26-f21e5f0571b2 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1708 microversion: 2.32 time: 0.703582 Oct 17 13:48:07.646894 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-fd39fcee-2b81-439e-a0fb-5bed91929e39 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 2.973441 Oct 17 13:48:07.648763 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1565/3143] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:48:04 2022] POST /compute/v2.1/servers => generated 400 bytes in 2976 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:48:07.649663 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1578/3143] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:06 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1708 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:48:07.657025 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-7d2f216a-2756-429e-9657-64d3898497f1 req-847045bf-8c06-4a6e-b282-99bd0493b2b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2994495-366a-446f-b7a6-16340911e17c", "tag": "f61459cf-c1c5-4d16-ab2f-16ab1c0ba28c"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:07.665911 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b8dc22fb-b9b8-4c66-82e8-7fa78213cf6d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:07.670628 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-7d2f216a-2756-429e-9657-64d3898497f1 req-847045bf-8c06-4a6e-b282-99bd0493b2b3 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:07.672213 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-7d2f216a-2756-429e-9657-64d3898497f1 req-847045bf-8c06-4a6e-b282-99bd0493b2b3 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:07.672856 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-7d2f216a-2756-429e-9657-64d3898497f1 req-847045bf-8c06-4a6e-b282-99bd0493b2b3 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:07.684208 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-b8dc22fb-b9b8-4c66-82e8-7fa78213cf6d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] HTTP exception thrown: Instance 7e73d4af-c906-493d-8fd7-b90adc225207 has no mapping to a cell. Oct 17 13:48:07.688228 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-7d2f216a-2756-429e-9657-64d3898497f1 req-847045bf-8c06-4a6e-b282-99bd0493b2b3 service nova] Creating event network-changed:f61459cf-c1c5-4d16-ab2f-16ab1c0ba28c for instance a2994495-366a-446f-b7a6-16340911e17c on n-h2-854247-14 Oct 17 13:48:07.696228 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-7d2f216a-2756-429e-9657-64d3898497f1 req-847045bf-8c06-4a6e-b282-99bd0493b2b3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044039 Oct 17 13:48:07.697849 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1566/3144] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:48:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:48:07.702859 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b8dc22fb-b9b8-4c66-82e8-7fa78213cf6d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Request method failure captured: Oct 17 13:48:07.702859 n-d-854247-14 devstack@n-api.service[127016]: request: POST /compute/v2.1/servers/7e73d4af-c906-493d-8fd7-b90adc225207/action HTTP/1.1 Oct 17 13:48:07.702859 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:48:07.702859 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:48:07.702859 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:48:07.702859 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 15 Oct 17 13:48:07.702859 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:48:07.702859 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:48:07.702859 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:48:07.702859 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:48:07.702859 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVwEqzYAZh4AkEjRryOAZIhaHrAKxd2Qcal9md8a5n-MMUYSdXmcWYLDVkyQoPrDIbcsApBq2EewemPkBwvNDDOidb0hhc_Z3w9BeEUj5ET_flLYPqO5hgqCsuZGXFiYIEBJxrkx614fXiELZHaNkvhSdsJHShK0w7L-UPHhkPKqi5M Oct 17 13:48:07.702859 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:48:07.702859 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:48:07.702859 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:48:07.702859 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:48:07.702859 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:48:07.702859 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:48:07.702859 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:48:07.702859 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:48:07.702859 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:48:07.702859 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:48:07.702859 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_59e65f6eb06d40d583b9f43c9af94c13", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:48:07.702859 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:48:07.702859 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:48:07.702859 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:48:07.702859 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:48:07.702859 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:48:07.702859 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:48:07.702859 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 443c44b0bd9e4c56a7fe0c1a53238545 Oct 17 13:48:07.702859 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:48:07.702859 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:48:07.702859 n-d-854247-14 devstack@n-api.service[127016]: {"os-stop": {}} Oct 17 13:48:07.702859 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:48:07.702859 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 7e73d4af-c906-493d-8fd7-b90adc225207 has no mapping to a cell. Oct 17 13:48:07.702859 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '7e73d4af-c906-493d-8fd7-b90adc225207', 'body': {'os-stop': {}}} Oct 17 13:48:07.702859 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:48:07.702859 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:48:07.702859 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 17 13:48:07.702859 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 17 13:48:07.702859 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:48:07.702859 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:48:07.702859 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 17 13:48:07.702859 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 17 13:48:07.702859 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 13:48:07.702859 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 13:48:07.702859 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 17 13:48:07.702859 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 17 13:48:07.702859 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 7e73d4af-c906-493d-8fd7-b90adc225207 has no mapping to a cell. Oct 17 13:48:07.702859 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:48:07.702859 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:48:07.702859 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:48:07.702859 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:48:07.702859 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:48:07.702859 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:48:07.702859 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:48:07.702859 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:48:07.702859 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:48:07.702859 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:48:07.702859 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 17 13:48:07.702859 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 17 13:48:07.702859 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 17 13:48:07.702859 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:48:07.702859 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e73d4af-c906-493d-8fd7-b90adc225207 has no mapping to a cell. Oct 17 13:48:07.708654 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:48:07.708654 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:48:07.708654 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:48:07.708654 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:48:07.708654 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:48:07.708654 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:48:07.708654 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:48:07.708654 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:48:07.708654 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e73d4af-c906-493d-8fd7-b90adc225207 has no mapping to a cell. Oct 17 13:48:07.708654 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:48:07.709405 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-80213446-97db-4beb-88a4-8ffeb292f30a tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:07.709405 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-80213446-97db-4beb-88a4-8ffeb292f30a tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] [instance: 531b762d-db7e-4911-af50-6b321b7706bf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:07.710744 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b8dc22fb-b9b8-4c66-82e8-7fa78213cf6d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Returning 404 to user: Instance 7e73d4af-c906-493d-8fd7-b90adc225207 has no mapping to a cell. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:48:07.711888 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b8dc22fb-b9b8-4c66-82e8-7fa78213cf6d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "POST /compute/v2.1/servers/7e73d4af-c906-493d-8fd7-b90adc225207/action" status: 404 len: 117 microversion: 2.1 time: 0.059523 Oct 17 13:48:07.714175 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-80213446-97db-4beb-88a4-8ffeb292f30a tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:07.714912 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-80213446-97db-4beb-88a4-8ffeb292f30a tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:07.715584 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-80213446-97db-4beb-88a4-8ffeb292f30a tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:07.716250 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1579/3145] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:48:07 2022] POST /compute/v2.1/servers/7e73d4af-c906-493d-8fd7-b90adc225207/action => generated 117 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:48:07.717716 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-80213446-97db-4beb-88a4-8ffeb292f30a tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:07.718941 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-80213446-97db-4beb-88a4-8ffeb292f30a tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:07.719762 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-80213446-97db-4beb-88a4-8ffeb292f30a tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:07.721352 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4ea46dcf-e270-4b8b-a316-f268e777d2f0 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:07.726329 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4ea46dcf-e270-4b8b-a316-f268e777d2f0 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 10690310-b856-4f6e-a4ea-1b771f45a75f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:08.100096 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4ea46dcf-e270-4b8b-a316-f268e777d2f0 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:08.119514 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4ea46dcf-e270-4b8b-a316-f268e777d2f0 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/10690310-b856-4f6e-a4ea-1b771f45a75f" status: 200 len: 1242 microversion: 2.1 time: 0.402077 Oct 17 13:48:08.120110 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1580/3146] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:07 2022] GET /compute/v2.1/servers/10690310-b856-4f6e-a4ea-1b771f45a75f => generated 1242 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:08.139920 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-50760631-ceba-4850-b771-0ba4023d6e72 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:08.140628 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-50760631-ceba-4850-b771-0ba4023d6e72 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:08.170486 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-50760631-ceba-4850-b771-0ba4023d6e72 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:08.170946 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-50760631-ceba-4850-b771-0ba4023d6e72 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:08.171421 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-50760631-ceba-4850-b771-0ba4023d6e72 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:08.172128 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-50760631-ceba-4850-b771-0ba4023d6e72 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:08.172574 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-50760631-ceba-4850-b771-0ba4023d6e72 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:08.183268 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-50760631-ceba-4850-b771-0ba4023d6e72 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:08.994182 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-50760631-ceba-4850-b771-0ba4023d6e72 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:09.003858 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-50760631-ceba-4850-b771-0ba4023d6e72 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 0.879472 Oct 17 13:48:09.016553 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1581/3147] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:08 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:09.040754 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1fab3a14-7a28-4b1d-826f-2fe5d716707d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:09.043661 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-1fab3a14-7a28-4b1d-826f-2fe5d716707d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9eaf1302-c967-4a24-8772-df5b32f11a60] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:09.055682 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1fab3a14-7a28-4b1d-826f-2fe5d716707d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:09.064761 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1fab3a14-7a28-4b1d-826f-2fe5d716707d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:09.065644 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1fab3a14-7a28-4b1d-826f-2fe5d716707d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:09.066590 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1fab3a14-7a28-4b1d-826f-2fe5d716707d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:09.067246 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1fab3a14-7a28-4b1d-826f-2fe5d716707d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:09.067823 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1fab3a14-7a28-4b1d-826f-2fe5d716707d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:09.120681 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-80213446-97db-4beb-88a4-8ffeb292f30a tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:09.147084 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-80213446-97db-4beb-88a4-8ffeb292f30a tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:09.150600 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-80213446-97db-4beb-88a4-8ffeb292f30a tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:09.154812 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-80213446-97db-4beb-88a4-8ffeb292f30a tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] 10.222.0.79 "GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf" status: 200 len: 1879 microversion: 2.42 time: 1.454552 Oct 17 13:48:09.157042 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1567/3148] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:07 2022] GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf => generated 1879 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:48:09.173297 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-cbdf6b64-f7cb-484b-acf4-e198be3134f1 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:09.174191 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-cbdf6b64-f7cb-484b-acf4-e198be3134f1 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:09.190220 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cbdf6b64-f7cb-484b-acf4-e198be3134f1 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:09.190993 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cbdf6b64-f7cb-484b-acf4-e198be3134f1 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:09.194803 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cbdf6b64-f7cb-484b-acf4-e198be3134f1 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:09.196257 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cbdf6b64-f7cb-484b-acf4-e198be3134f1 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:09.197044 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cbdf6b64-f7cb-484b-acf4-e198be3134f1 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:09.198319 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cbdf6b64-f7cb-484b-acf4-e198be3134f1 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:09.406958 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-1fab3a14-7a28-4b1d-826f-2fe5d716707d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:09.435699 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1fab3a14-7a28-4b1d-826f-2fe5d716707d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/9eaf1302-c967-4a24-8772-df5b32f11a60" status: 200 len: 1471 microversion: 2.1 time: 0.398532 Oct 17 13:48:09.437006 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1582/3149] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:09 2022] GET /compute/v2.1/servers/9eaf1302-c967-4a24-8772-df5b32f11a60 => generated 1471 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:09.451860 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-bf32b0f0-7504-43eb-92f3-6ad0e72c7f8b tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:09.452669 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-bf32b0f0-7504-43eb-92f3-6ad0e72c7f8b tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:09.459333 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bf32b0f0-7504-43eb-92f3-6ad0e72c7f8b tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:09.463280 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bf32b0f0-7504-43eb-92f3-6ad0e72c7f8b tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:09.463880 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bf32b0f0-7504-43eb-92f3-6ad0e72c7f8b tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:09.464760 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bf32b0f0-7504-43eb-92f3-6ad0e72c7f8b tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:09.469552 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bf32b0f0-7504-43eb-92f3-6ad0e72c7f8b tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:09.470142 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bf32b0f0-7504-43eb-92f3-6ad0e72c7f8b tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:10.315694 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-cbdf6b64-f7cb-484b-acf4-e198be3134f1 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:10.340686 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-cbdf6b64-f7cb-484b-acf4-e198be3134f1 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:10.342157 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-cbdf6b64-f7cb-484b-acf4-e198be3134f1 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:10.345816 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-cbdf6b64-f7cb-484b-acf4-e198be3134f1 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1755 microversion: 2.32 time: 1.185769 Oct 17 13:48:10.349189 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1568/3150] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:09 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1755 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:48:10.361308 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ae7289d2-c911-4589-a986-f41b08a10768 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:10.362491 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ae7289d2-c911-4589-a986-f41b08a10768 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 10690310-b856-4f6e-a4ea-1b771f45a75f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:10.375098 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae7289d2-c911-4589-a986-f41b08a10768 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:10.380726 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae7289d2-c911-4589-a986-f41b08a10768 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:10.382274 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae7289d2-c911-4589-a986-f41b08a10768 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:10.384826 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae7289d2-c911-4589-a986-f41b08a10768 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:10.388040 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae7289d2-c911-4589-a986-f41b08a10768 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:10.388718 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae7289d2-c911-4589-a986-f41b08a10768 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:10.736207 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ae7289d2-c911-4589-a986-f41b08a10768 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:10.750520 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ae7289d2-c911-4589-a986-f41b08a10768 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/10690310-b856-4f6e-a4ea-1b771f45a75f" status: 200 len: 1300 microversion: 2.1 time: 0.400024 Oct 17 13:48:10.755774 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1569/3151] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:10 2022] GET /compute/v2.1/servers/10690310-b856-4f6e-a4ea-1b771f45a75f => generated 1300 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:10.765951 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-397d022f-ab83-4f3b-9eed-9181d3a7d573 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:10.767113 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-397d022f-ab83-4f3b-9eed-9181d3a7d573 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] [instance: 531b762d-db7e-4911-af50-6b321b7706bf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:10.784504 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-397d022f-ab83-4f3b-9eed-9181d3a7d573 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:10.788744 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-397d022f-ab83-4f3b-9eed-9181d3a7d573 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:10.794361 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-bf32b0f0-7504-43eb-92f3-6ad0e72c7f8b tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:10.801120 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-397d022f-ab83-4f3b-9eed-9181d3a7d573 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:10.808286 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-397d022f-ab83-4f3b-9eed-9181d3a7d573 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:10.810175 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-397d022f-ab83-4f3b-9eed-9181d3a7d573 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:10.810921 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-397d022f-ab83-4f3b-9eed-9181d3a7d573 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:10.813092 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-bf32b0f0-7504-43eb-92f3-6ad0e72c7f8b tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 1.371941 Oct 17 13:48:10.837847 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1583/3152] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:09 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:10.848901 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ecb997a6-debc-4e30-9872-0a3a189f85ef tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:10.849892 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ecb997a6-debc-4e30-9872-0a3a189f85ef tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9eaf1302-c967-4a24-8772-df5b32f11a60] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:10.866109 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ecb997a6-debc-4e30-9872-0a3a189f85ef tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:10.867266 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ecb997a6-debc-4e30-9872-0a3a189f85ef tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:10.871135 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ecb997a6-debc-4e30-9872-0a3a189f85ef tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:10.872585 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ecb997a6-debc-4e30-9872-0a3a189f85ef tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:10.873276 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ecb997a6-debc-4e30-9872-0a3a189f85ef tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:10.873919 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ecb997a6-debc-4e30-9872-0a3a189f85ef tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:11.366377 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ecb997a6-debc-4e30-9872-0a3a189f85ef tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:11.383154 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ecb997a6-debc-4e30-9872-0a3a189f85ef tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/9eaf1302-c967-4a24-8772-df5b32f11a60" status: 200 len: 1476 microversion: 2.1 time: 0.543394 Oct 17 13:48:11.384992 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1584/3153] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:10 2022] GET /compute/v2.1/servers/9eaf1302-c967-4a24-8772-df5b32f11a60 => generated 1476 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:11.427151 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8c2d0985-8590-4477-9ae8-8d4396d1713a tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:11.430957 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8c2d0985-8590-4477-9ae8-8d4396d1713a tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: e22c67c7-2783-416d-8397-f9bc1643575f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:11.440192 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-397d022f-ab83-4f3b-9eed-9181d3a7d573 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:11.445194 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:48:11.448051 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-8c2d0985-8590-4477-9ae8-8d4396d1713a tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] HTTP exception thrown: Instance e22c67c7-2783-416d-8397-f9bc1643575f could not be found. Oct 17 13:48:11.449505 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-397d022f-ab83-4f3b-9eed-9181d3a7d573 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:11.450945 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-397d022f-ab83-4f3b-9eed-9181d3a7d573 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8c2d0985-8590-4477-9ae8-8d4396d1713a tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Request method failure captured: Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: request: POST /compute/v2.1/servers/e22c67c7-2783-416d-8397-f9bc1643575f/action HTTP/1.1 Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 15 Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVwEqzYAZh4AkEjRryOAZIhaHrAKxd2Qcal9md8a5n-MMUYSdXmcWYLDVkyQoPrDIbcsApBq2EewemPkBwvNDDOidb0hhc_Z3w9BeEUj5ET_flLYPqO5hgqCsuZGXFiYIEBJxrkx614fXiELZHaNkvhSdsJHShK0w7L-UPHhkPKqi5M Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_59e65f6eb06d40d583b9f43c9af94c13", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 443c44b0bd9e4c56a7fe0c1a53238545 Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: {"suspend": {}} Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance e22c67c7-2783-416d-8397-f9bc1643575f could not be found. Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'e22c67c7-2783-416d-8397-f9bc1643575f', 'body': {'suspend': {}}} Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e22c67c7-2783-416d-8397-f9bc1643575f could not be found. Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e22c67c7-2783-416d-8397-f9bc1643575f could not be found. Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:48:11.453033 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:48:11.462717 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:48:11.462717 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:48:11.462717 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e22c67c7-2783-416d-8397-f9bc1643575f could not be found. Oct 17 13:48:11.462717 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:48:11.463350 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-397d022f-ab83-4f3b-9eed-9181d3a7d573 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] 10.222.0.79 "GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf" status: 200 len: 1879 microversion: 2.42 time: 0.698663 Oct 17 13:48:11.463350 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1570/3154] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:10 2022] GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf => generated 1879 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:48:11.466487 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8c2d0985-8590-4477-9ae8-8d4396d1713a tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Returning 404 to user: Instance e22c67c7-2783-416d-8397-f9bc1643575f could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:48:11.466948 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0a0f9a5f-9391-4deb-953d-f12d457b5338 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:11.467589 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0a0f9a5f-9391-4deb-953d-f12d457b5338 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:11.468084 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8c2d0985-8590-4477-9ae8-8d4396d1713a tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "POST /compute/v2.1/servers/e22c67c7-2783-416d-8397-f9bc1643575f/action" status: 404 len: 111 microversion: 2.1 time: 0.081653 Oct 17 13:48:11.469647 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1585/3155] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:48:11 2022] POST /compute/v2.1/servers/e22c67c7-2783-416d-8397-f9bc1643575f/action => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:48:11.482878 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0a0f9a5f-9391-4deb-953d-f12d457b5338 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:11.483395 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0a0f9a5f-9391-4deb-953d-f12d457b5338 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:11.483829 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0a0f9a5f-9391-4deb-953d-f12d457b5338 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:11.484689 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0a0f9a5f-9391-4deb-953d-f12d457b5338 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:11.485308 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0a0f9a5f-9391-4deb-953d-f12d457b5338 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:11.485942 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0a0f9a5f-9391-4deb-953d-f12d457b5338 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:11.488399 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ed371d60-051b-4c62-8ff1-5d706898418b tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:11.491187 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ed371d60-051b-4c62-8ff1-5d706898418b tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:11.500743 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ed371d60-051b-4c62-8ff1-5d706898418b tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:11.501645 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ed371d60-051b-4c62-8ff1-5d706898418b tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:11.502972 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ed371d60-051b-4c62-8ff1-5d706898418b tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:11.504511 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ed371d60-051b-4c62-8ff1-5d706898418b tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:11.508116 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ed371d60-051b-4c62-8ff1-5d706898418b tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:11.508737 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ed371d60-051b-4c62-8ff1-5d706898418b tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:11.994313 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0a0f9a5f-9391-4deb-953d-f12d457b5338 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:12.013337 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0a0f9a5f-9391-4deb-953d-f12d457b5338 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:12.016194 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0a0f9a5f-9391-4deb-953d-f12d457b5338 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:12.018404 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0a0f9a5f-9391-4deb-953d-f12d457b5338 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1802 microversion: 2.32 time: 0.554983 Oct 17 13:48:12.019777 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1571/3156] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:11 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1802 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:48:12.026557 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ffb4ed26-7c56-4e22-9167-cc32d58f9b64 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:12.027387 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ffb4ed26-7c56-4e22-9167-cc32d58f9b64 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 10690310-b856-4f6e-a4ea-1b771f45a75f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:12.051146 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ed371d60-051b-4c62-8ff1-5d706898418b tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:12.056335 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ffb4ed26-7c56-4e22-9167-cc32d58f9b64 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:12.058101 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ffb4ed26-7c56-4e22-9167-cc32d58f9b64 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:12.060638 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ffb4ed26-7c56-4e22-9167-cc32d58f9b64 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:12.061552 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ffb4ed26-7c56-4e22-9167-cc32d58f9b64 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:12.062167 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ffb4ed26-7c56-4e22-9167-cc32d58f9b64 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:12.063690 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ffb4ed26-7c56-4e22-9167-cc32d58f9b64 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:12.070217 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ed371d60-051b-4c62-8ff1-5d706898418b tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 0.593146 Oct 17 13:48:12.073469 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1586/3157] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:11 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:12.119719 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ce923ee8-c158-467a-802f-fdc328331273 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:12.121263 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ce923ee8-c158-467a-802f-fdc328331273 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:12.145834 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ce923ee8-c158-467a-802f-fdc328331273 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:12.146340 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ce923ee8-c158-467a-802f-fdc328331273 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:12.146776 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ce923ee8-c158-467a-802f-fdc328331273 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:12.153448 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ce923ee8-c158-467a-802f-fdc328331273 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:12.153936 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ce923ee8-c158-467a-802f-fdc328331273 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:12.156712 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ce923ee8-c158-467a-802f-fdc328331273 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:12.783413 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ce923ee8-c158-467a-802f-fdc328331273 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:12.794729 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ce923ee8-c158-467a-802f-fdc328331273 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 0.697088 Oct 17 13:48:12.795818 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1587/3158] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:12 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:12.804051 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e6ab1eee-a2f8-408c-822b-dd9e10159550 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:12.806522 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e6ab1eee-a2f8-408c-822b-dd9e10159550 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9eaf1302-c967-4a24-8772-df5b32f11a60] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:12.831352 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e6ab1eee-a2f8-408c-822b-dd9e10159550 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:12.832248 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e6ab1eee-a2f8-408c-822b-dd9e10159550 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:12.832912 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e6ab1eee-a2f8-408c-822b-dd9e10159550 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:12.833858 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e6ab1eee-a2f8-408c-822b-dd9e10159550 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:12.835861 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e6ab1eee-a2f8-408c-822b-dd9e10159550 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:12.837188 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e6ab1eee-a2f8-408c-822b-dd9e10159550 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:13.011337 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ffb4ed26-7c56-4e22-9167-cc32d58f9b64 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:13.021889 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ffb4ed26-7c56-4e22-9167-cc32d58f9b64 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/10690310-b856-4f6e-a4ea-1b771f45a75f" status: 200 len: 1366 microversion: 2.1 time: 1.000759 Oct 17 13:48:13.028588 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1572/3159] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:12 2022] GET /compute/v2.1/servers/10690310-b856-4f6e-a4ea-1b771f45a75f => generated 1366 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:13.034457 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-236c9837-ffa0-4b7f-b56f-df6038b19a61 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:13.045270 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-236c9837-ffa0-4b7f-b56f-df6038b19a61 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] [instance: 531b762d-db7e-4911-af50-6b321b7706bf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:13.066823 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-236c9837-ffa0-4b7f-b56f-df6038b19a61 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:13.068928 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-236c9837-ffa0-4b7f-b56f-df6038b19a61 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:13.069563 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-236c9837-ffa0-4b7f-b56f-df6038b19a61 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:13.072179 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-236c9837-ffa0-4b7f-b56f-df6038b19a61 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:13.079275 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-236c9837-ffa0-4b7f-b56f-df6038b19a61 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:13.081568 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-236c9837-ffa0-4b7f-b56f-df6038b19a61 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:13.568457 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-236c9837-ffa0-4b7f-b56f-df6038b19a61 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:13.586142 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-236c9837-ffa0-4b7f-b56f-df6038b19a61 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:13.589854 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-236c9837-ffa0-4b7f-b56f-df6038b19a61 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:13.591488 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-236c9837-ffa0-4b7f-b56f-df6038b19a61 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] 10.222.0.79 "GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf" status: 200 len: 1879 microversion: 2.42 time: 0.561587 Oct 17 13:48:13.593141 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1573/3160] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:13 2022] GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf => generated 1879 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:48:13.621430 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-473b644d-0db5-477f-ab3a-270595ce22a6 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:13.622261 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-473b644d-0db5-477f-ab3a-270595ce22a6 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:13.633316 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-473b644d-0db5-477f-ab3a-270595ce22a6 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:13.633936 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-473b644d-0db5-477f-ab3a-270595ce22a6 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:13.634464 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-473b644d-0db5-477f-ab3a-270595ce22a6 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:13.635320 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-473b644d-0db5-477f-ab3a-270595ce22a6 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:13.635876 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-473b644d-0db5-477f-ab3a-270595ce22a6 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:13.636415 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-473b644d-0db5-477f-ab3a-270595ce22a6 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:13.641662 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e6ab1eee-a2f8-408c-822b-dd9e10159550 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:13.653519 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e6ab1eee-a2f8-408c-822b-dd9e10159550 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/9eaf1302-c967-4a24-8772-df5b32f11a60" status: 200 len: 1476 microversion: 2.1 time: 0.856330 Oct 17 13:48:13.654750 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1588/3161] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:12 2022] GET /compute/v2.1/servers/9eaf1302-c967-4a24-8772-df5b32f11a60 => generated 1476 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:13.661677 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-56cd928a-bd4e-4f05-8a87-0a0f5630e36f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:13.663120 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-56cd928a-bd4e-4f05-8a87-0a0f5630e36f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:13.676213 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-56cd928a-bd4e-4f05-8a87-0a0f5630e36f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:13.680068 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-56cd928a-bd4e-4f05-8a87-0a0f5630e36f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:13.680933 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-56cd928a-bd4e-4f05-8a87-0a0f5630e36f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:13.683399 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-56cd928a-bd4e-4f05-8a87-0a0f5630e36f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:13.684073 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-56cd928a-bd4e-4f05-8a87-0a0f5630e36f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:13.684932 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-56cd928a-bd4e-4f05-8a87-0a0f5630e36f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:13.693382 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-473b644d-0db5-477f-ab3a-270595ce22a6 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lazy-loading 'flavor' on Instance uuid 5ef00d34-7f81-4649-a90a-a52cf78dbeca {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:48:13.945324 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-473b644d-0db5-477f-ab3a-270595ce22a6 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "POST /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca/action" status: 202 len: 0 microversion: 2.1 time: 0.350585 Oct 17 13:48:13.949716 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1574/3162] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:48:13 2022] POST /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca/action => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:48:13.974722 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-5a57ed77-4735-49f7-bb21-d6d86b742ddc req-9173db72-ac27-4729-8eba-a7d7b4996b65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10690310-b856-4f6e-a4ea-1b771f45a75f", "tag": "d7fa4d99-108e-4a0d-8bd2-0e8856410c77"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:14.002792 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-5a57ed77-4735-49f7-bb21-d6d86b742ddc req-9173db72-ac27-4729-8eba-a7d7b4996b65 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:14.008782 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-5a57ed77-4735-49f7-bb21-d6d86b742ddc req-9173db72-ac27-4729-8eba-a7d7b4996b65 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:14.009464 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-5a57ed77-4735-49f7-bb21-d6d86b742ddc req-9173db72-ac27-4729-8eba-a7d7b4996b65 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:14.038684 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-5a57ed77-4735-49f7-bb21-d6d86b742ddc req-9173db72-ac27-4729-8eba-a7d7b4996b65 service nova] Creating event network-changed:d7fa4d99-108e-4a0d-8bd2-0e8856410c77 for instance 10690310-b856-4f6e-a4ea-1b771f45a75f on n-h1-854247-14 Oct 17 13:48:14.048732 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-5a57ed77-4735-49f7-bb21-d6d86b742ddc req-9173db72-ac27-4729-8eba-a7d7b4996b65 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099648 Oct 17 13:48:14.055452 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1575/3163] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:48:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:48:14.062368 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3eecfcd7-9a17-4373-be1f-98a5e3077f97 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:14.065282 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3eecfcd7-9a17-4373-be1f-98a5e3077f97 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:14.078543 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3eecfcd7-9a17-4373-be1f-98a5e3077f97 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:14.081833 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3eecfcd7-9a17-4373-be1f-98a5e3077f97 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:14.082363 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3eecfcd7-9a17-4373-be1f-98a5e3077f97 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:14.083193 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3eecfcd7-9a17-4373-be1f-98a5e3077f97 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:14.084074 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-56cd928a-bd4e-4f05-8a87-0a0f5630e36f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:14.084697 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3eecfcd7-9a17-4373-be1f-98a5e3077f97 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:14.087027 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3eecfcd7-9a17-4373-be1f-98a5e3077f97 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:14.112732 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-56cd928a-bd4e-4f05-8a87-0a0f5630e36f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:14.118237 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-56cd928a-bd4e-4f05-8a87-0a0f5630e36f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:14.121919 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-56cd928a-bd4e-4f05-8a87-0a0f5630e36f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1802 microversion: 2.32 time: 0.465744 Oct 17 13:48:14.123544 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1589/3164] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:13 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1802 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:48:14.133650 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2db220ee-51b7-472b-9be9-9018002d869d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:14.134276 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2db220ee-51b7-472b-9be9-9018002d869d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 10690310-b856-4f6e-a4ea-1b771f45a75f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:14.142562 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2db220ee-51b7-472b-9be9-9018002d869d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:14.143433 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2db220ee-51b7-472b-9be9-9018002d869d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:14.144349 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2db220ee-51b7-472b-9be9-9018002d869d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:14.156956 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2db220ee-51b7-472b-9be9-9018002d869d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:14.165020 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2db220ee-51b7-472b-9be9-9018002d869d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:14.165020 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2db220ee-51b7-472b-9be9-9018002d869d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:14.646723 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3eecfcd7-9a17-4373-be1f-98a5e3077f97 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:14.659900 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3eecfcd7-9a17-4373-be1f-98a5e3077f97 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1514 microversion: 2.1 time: 0.602788 Oct 17 13:48:14.680799 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1576/3165] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:14 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1514 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:14.689375 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8a4b4300-32cd-45a6-9751-f2c7aa49b9c4 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:14.690401 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8a4b4300-32cd-45a6-9751-f2c7aa49b9c4 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] [instance: 531b762d-db7e-4911-af50-6b321b7706bf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:14.730015 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8a4b4300-32cd-45a6-9751-f2c7aa49b9c4 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:14.734750 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8a4b4300-32cd-45a6-9751-f2c7aa49b9c4 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:14.735238 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8a4b4300-32cd-45a6-9751-f2c7aa49b9c4 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:14.736718 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8a4b4300-32cd-45a6-9751-f2c7aa49b9c4 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:14.739444 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8a4b4300-32cd-45a6-9751-f2c7aa49b9c4 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:14.740219 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8a4b4300-32cd-45a6-9751-f2c7aa49b9c4 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:14.771124 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2db220ee-51b7-472b-9be9-9018002d869d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:14.782093 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2db220ee-51b7-472b-9be9-9018002d869d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/10690310-b856-4f6e-a4ea-1b771f45a75f" status: 200 len: 1366 microversion: 2.1 time: 0.653706 Oct 17 13:48:14.789852 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1590/3166] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:14 2022] GET /compute/v2.1/servers/10690310-b856-4f6e-a4ea-1b771f45a75f => generated 1366 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:14.800483 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3a5ac862-eac5-493b-9441-6e53b2ce7993 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:14.801291 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3a5ac862-eac5-493b-9441-6e53b2ce7993 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9eaf1302-c967-4a24-8772-df5b32f11a60] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:14.816447 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3a5ac862-eac5-493b-9441-6e53b2ce7993 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:14.819241 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3a5ac862-eac5-493b-9441-6e53b2ce7993 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:14.821455 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3a5ac862-eac5-493b-9441-6e53b2ce7993 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:14.822998 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3a5ac862-eac5-493b-9441-6e53b2ce7993 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:14.824975 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3a5ac862-eac5-493b-9441-6e53b2ce7993 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:14.827373 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3a5ac862-eac5-493b-9441-6e53b2ce7993 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:15.371314 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8a4b4300-32cd-45a6-9751-f2c7aa49b9c4 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:15.385497 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8a4b4300-32cd-45a6-9751-f2c7aa49b9c4 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:15.387117 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8a4b4300-32cd-45a6-9751-f2c7aa49b9c4 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:15.394099 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8a4b4300-32cd-45a6-9751-f2c7aa49b9c4 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] 10.222.0.79 "GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf" status: 200 len: 1879 microversion: 2.42 time: 0.709557 Oct 17 13:48:15.394749 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1577/3167] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:14 2022] GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf => generated 1879 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:48:15.421717 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d3a8c04e-e3fb-46b3-9720-a944cc6be337 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:15.423746 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d3a8c04e-e3fb-46b3-9720-a944cc6be337 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:15.427293 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:48:15.432527 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d3a8c04e-e3fb-46b3-9720-a944cc6be337 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:15.433365 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d3a8c04e-e3fb-46b3-9720-a944cc6be337 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:15.434075 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d3a8c04e-e3fb-46b3-9720-a944cc6be337 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:15.435110 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d3a8c04e-e3fb-46b3-9720-a944cc6be337 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:15.435781 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d3a8c04e-e3fb-46b3-9720-a944cc6be337 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:15.436385 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d3a8c04e-e3fb-46b3-9720-a944cc6be337 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:15.741610 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3a5ac862-eac5-493b-9441-6e53b2ce7993 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:15.762957 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3a5ac862-eac5-493b-9441-6e53b2ce7993 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/9eaf1302-c967-4a24-8772-df5b32f11a60" status: 200 len: 1476 microversion: 2.1 time: 0.971417 Oct 17 13:48:15.765723 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1591/3168] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:14 2022] GET /compute/v2.1/servers/9eaf1302-c967-4a24-8772-df5b32f11a60 => generated 1476 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:15.785318 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-496ff2d2-7721-4477-99fd-d521a1937ec6 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:15.785941 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-496ff2d2-7721-4477-99fd-d521a1937ec6 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:15.816071 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-496ff2d2-7721-4477-99fd-d521a1937ec6 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:15.816566 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-496ff2d2-7721-4477-99fd-d521a1937ec6 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:15.817002 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-496ff2d2-7721-4477-99fd-d521a1937ec6 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:15.817718 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-496ff2d2-7721-4477-99fd-d521a1937ec6 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:15.818173 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-496ff2d2-7721-4477-99fd-d521a1937ec6 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:15.818602 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-496ff2d2-7721-4477-99fd-d521a1937ec6 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:16.513913 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d3a8c04e-e3fb-46b3-9720-a944cc6be337 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:16.541487 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d3a8c04e-e3fb-46b3-9720-a944cc6be337 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:16.552062 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d3a8c04e-e3fb-46b3-9720-a944cc6be337 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:16.558757 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d3a8c04e-e3fb-46b3-9720-a944cc6be337 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1849 microversion: 2.32 time: 1.144366 Oct 17 13:48:16.561300 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1578/3169] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:15 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1849 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:48:16.564778 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-496ff2d2-7721-4477-99fd-d521a1937ec6 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:16.576005 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f80f166c-d944-4329-8f51-f825f872e460 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:16.578356 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f80f166c-d944-4329-8f51-f825f872e460 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 10690310-b856-4f6e-a4ea-1b771f45a75f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:16.586719 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-496ff2d2-7721-4477-99fd-d521a1937ec6 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1497 microversion: 2.1 time: 0.817757 Oct 17 13:48:16.599234 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1592/3170] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:15 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1497 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:16.599234 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6c91252d-09ab-4315-88f2-60e21e69c777 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:16.599234 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6c91252d-09ab-4315-88f2-60e21e69c777 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] [instance: 531b762d-db7e-4911-af50-6b321b7706bf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:16.604948 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f80f166c-d944-4329-8f51-f825f872e460 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:16.609458 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f80f166c-d944-4329-8f51-f825f872e460 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:16.611431 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f80f166c-d944-4329-8f51-f825f872e460 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:16.612671 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f80f166c-d944-4329-8f51-f825f872e460 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:16.615253 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f80f166c-d944-4329-8f51-f825f872e460 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:16.615926 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f80f166c-d944-4329-8f51-f825f872e460 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:16.621828 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6c91252d-09ab-4315-88f2-60e21e69c777 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:16.622322 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6c91252d-09ab-4315-88f2-60e21e69c777 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:16.622756 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6c91252d-09ab-4315-88f2-60e21e69c777 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:16.623500 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6c91252d-09ab-4315-88f2-60e21e69c777 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:16.623951 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6c91252d-09ab-4315-88f2-60e21e69c777 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:16.624371 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6c91252d-09ab-4315-88f2-60e21e69c777 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:17.477514 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:48:17.520717 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=6 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:48:17.550428 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f80f166c-d944-4329-8f51-f825f872e460 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:17.561826 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f80f166c-d944-4329-8f51-f825f872e460 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/10690310-b856-4f6e-a4ea-1b771f45a75f" status: 200 len: 1366 microversion: 2.1 time: 0.997144 Oct 17 13:48:17.562444 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1579/3171] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:16 2022] GET /compute/v2.1/servers/10690310-b856-4f6e-a4ea-1b771f45a75f => generated 1366 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:17.573488 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5a2f3d70-2209-49cd-9d8c-215ea05388c3 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:17.575797 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5a2f3d70-2209-49cd-9d8c-215ea05388c3 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:17.578116 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6c91252d-09ab-4315-88f2-60e21e69c777 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:17.586481 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5a2f3d70-2209-49cd-9d8c-215ea05388c3 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:17.586970 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5a2f3d70-2209-49cd-9d8c-215ea05388c3 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:17.587460 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5a2f3d70-2209-49cd-9d8c-215ea05388c3 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:17.588154 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5a2f3d70-2209-49cd-9d8c-215ea05388c3 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:17.590080 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5a2f3d70-2209-49cd-9d8c-215ea05388c3 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:17.590080 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5a2f3d70-2209-49cd-9d8c-215ea05388c3 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:17.595515 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6c91252d-09ab-4315-88f2-60e21e69c777 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:17.600803 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6c91252d-09ab-4315-88f2-60e21e69c777 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:17.605549 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6c91252d-09ab-4315-88f2-60e21e69c777 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] 10.222.0.79 "GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf" status: 200 len: 1879 microversion: 2.42 time: 1.017173 Oct 17 13:48:17.607840 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1593/3172] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:16 2022] GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf => generated 1879 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:48:17.614369 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-72c015cc-e4cc-4474-9c9d-7a24a5a44020 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:17.615585 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-72c015cc-e4cc-4474-9c9d-7a24a5a44020 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9eaf1302-c967-4a24-8772-df5b32f11a60] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:17.625650 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-72c015cc-e4cc-4474-9c9d-7a24a5a44020 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:17.626943 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-72c015cc-e4cc-4474-9c9d-7a24a5a44020 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:17.627707 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-72c015cc-e4cc-4474-9c9d-7a24a5a44020 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:17.628686 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-72c015cc-e4cc-4474-9c9d-7a24a5a44020 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:17.629414 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-72c015cc-e4cc-4474-9c9d-7a24a5a44020 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:17.629912 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-72c015cc-e4cc-4474-9c9d-7a24a5a44020 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:17.671319 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-5a2f3d70-2209-49cd-9d8c-215ea05388c3 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lazy-loading 'flavor' on Instance uuid 5ef00d34-7f81-4649-a90a-a52cf78dbeca {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:48:17.719987 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-5a2f3d70-2209-49cd-9d8c-215ea05388c3 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] HTTP exception thrown: Cannot 'suspend' instance 5ef00d34-7f81-4649-a90a-a52cf78dbeca while it is in vm_state suspended Oct 17 13:48:17.722547 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5a2f3d70-2209-49cd-9d8c-215ea05388c3 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Request method failure captured: Oct 17 13:48:17.722547 n-d-854247-14 devstack@n-api.service[127017]: request: POST /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca/action HTTP/1.1 Oct 17 13:48:17.722547 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:48:17.722547 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:48:17.722547 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:48:17.722547 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 15 Oct 17 13:48:17.722547 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:48:17.722547 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:48:17.722547 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:48:17.722547 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:48:17.722547 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVwEqzYAZh4AkEjRryOAZIhaHrAKxd2Qcal9md8a5n-MMUYSdXmcWYLDVkyQoPrDIbcsApBq2EewemPkBwvNDDOidb0hhc_Z3w9BeEUj5ET_flLYPqO5hgqCsuZGXFiYIEBJxrkx614fXiELZHaNkvhSdsJHShK0w7L-UPHhkPKqi5M Oct 17 13:48:17.722547 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:48:17.722547 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:48:17.722547 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:48:17.722547 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:48:17.722547 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:48:17.722547 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:48:17.722547 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:48:17.722547 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:48:17.722547 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:48:17.722547 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:48:17.722547 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_59e65f6eb06d40d583b9f43c9af94c13", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:48:17.722547 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:48:17.722547 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:48:17.722547 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:48:17.722547 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:48:17.722547 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:48:17.722547 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:48:17.722547 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 443c44b0bd9e4c56a7fe0c1a53238545 Oct 17 13:48:17.722547 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:48:17.722547 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 13:48:17.722547 n-d-854247-14 devstack@n-api.service[127017]: {"suspend": {}} Oct 17 13:48:17.722547 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:48:17.722547 n-d-854247-14 devstack@n-api.service[127017]: exception: Cannot 'suspend' instance 5ef00d34-7f81-4649-a90a-a52cf78dbeca while it is in vm_state suspended Oct 17 13:48:17.722547 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '5ef00d34-7f81-4649-a90a-a52cf78dbeca', 'body': {'suspend': {}}} Oct 17 13:48:17.722547 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:48:17.722547 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:48:17.722547 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 17 13:48:17.722547 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 17 13:48:17.722547 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 17 13:48:17.722547 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 13:48:17.722547 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 17 13:48:17.722547 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 13:48:17.722547 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 17 13:48:17.722547 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 13:48:17.722547 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 17 13:48:17.722547 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 13:48:17.722547 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 13:48:17.722547 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:48:17.722547 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 13:48:17.722547 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 13:48:17.722547 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5ef00d34-7f81-4649-a90a-a52cf78dbeca in vm_state suspended. Cannot suspend while the instance is in this state. Oct 17 13:48:17.722547 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:48:17.722547 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:48:17.722547 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:48:17.722547 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:48:17.722547 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:48:17.722547 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:48:17.722547 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:48:17.722547 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:48:17.722547 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:48:17.722547 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:48:17.722547 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 17 13:48:17.722547 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 17 13:48:17.727396 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 13:48:17.727396 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 13:48:17.727396 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 5ef00d34-7f81-4649-a90a-a52cf78dbeca while it is in vm_state suspended Oct 17 13:48:17.727396 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:48:17.727396 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:48:17.727396 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:48:17.727396 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:48:17.727396 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:48:17.727396 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:48:17.727396 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:48:17.727396 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:48:17.727396 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 5ef00d34-7f81-4649-a90a-a52cf78dbeca while it is in vm_state suspended Oct 17 13:48:17.727396 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:48:17.729359 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5a2f3d70-2209-49cd-9d8c-215ea05388c3 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Returning 409 to user: Cannot 'suspend' instance 5ef00d34-7f81-4649-a90a-a52cf78dbeca while it is in vm_state suspended {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:48:17.740322 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5a2f3d70-2209-49cd-9d8c-215ea05388c3 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "POST /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca/action" status: 409 len: 148 microversion: 2.1 time: 0.176790 Oct 17 13:48:17.741540 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1580/3173] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:48:17 2022] POST /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca/action => generated 148 bytes in 178 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:48:17.746929 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-eaebbac7-354d-4573-bf75-0e40ac1b88ed tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:17.747941 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-eaebbac7-354d-4573-bf75-0e40ac1b88ed tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:17.764723 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eaebbac7-354d-4573-bf75-0e40ac1b88ed tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:17.765494 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eaebbac7-354d-4573-bf75-0e40ac1b88ed tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:17.771643 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eaebbac7-354d-4573-bf75-0e40ac1b88ed tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:17.772652 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eaebbac7-354d-4573-bf75-0e40ac1b88ed tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:17.773292 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eaebbac7-354d-4573-bf75-0e40ac1b88ed tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:17.773881 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eaebbac7-354d-4573-bf75-0e40ac1b88ed tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:18.118660 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:48:18.157005 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-72c015cc-e4cc-4474-9c9d-7a24a5a44020 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:18.175017 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-72c015cc-e4cc-4474-9c9d-7a24a5a44020 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/9eaf1302-c967-4a24-8772-df5b32f11a60" status: 200 len: 1476 microversion: 2.1 time: 0.565311 Oct 17 13:48:18.177452 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1594/3174] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:17 2022] GET /compute/v2.1/servers/9eaf1302-c967-4a24-8772-df5b32f11a60 => generated 1476 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:18.186526 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2082b116-d9ba-4ad6-bdf0-ebf04568cb53 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:18.187654 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2082b116-d9ba-4ad6-bdf0-ebf04568cb53 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:18.197381 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2082b116-d9ba-4ad6-bdf0-ebf04568cb53 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:18.198173 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2082b116-d9ba-4ad6-bdf0-ebf04568cb53 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:18.199134 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2082b116-d9ba-4ad6-bdf0-ebf04568cb53 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:18.200983 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2082b116-d9ba-4ad6-bdf0-ebf04568cb53 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:18.201684 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2082b116-d9ba-4ad6-bdf0-ebf04568cb53 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:18.202309 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2082b116-d9ba-4ad6-bdf0-ebf04568cb53 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:18.287912 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:48:18.328259 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2082b116-d9ba-4ad6-bdf0-ebf04568cb53 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "POST /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca/action" status: 202 len: 0 microversion: 2.1 time: 0.147980 Oct 17 13:48:18.330370 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1595/3175] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:48:18 2022] POST /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:48:18.357124 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-50f1939a-71ed-444d-a13d-399006f2a539 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:18.357829 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-50f1939a-71ed-444d-a13d-399006f2a539 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:18.365910 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-50f1939a-71ed-444d-a13d-399006f2a539 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:18.366779 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-50f1939a-71ed-444d-a13d-399006f2a539 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:18.367712 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-50f1939a-71ed-444d-a13d-399006f2a539 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:18.368657 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-50f1939a-71ed-444d-a13d-399006f2a539 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:18.369274 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-50f1939a-71ed-444d-a13d-399006f2a539 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:18.369855 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-50f1939a-71ed-444d-a13d-399006f2a539 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:18.437330 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-eaebbac7-354d-4573-bf75-0e40ac1b88ed tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:18.442112 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:48:18.450528 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-eaebbac7-354d-4573-bf75-0e40ac1b88ed tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:18.452292 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-eaebbac7-354d-4573-bf75-0e40ac1b88ed tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:18.455819 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-eaebbac7-354d-4573-bf75-0e40ac1b88ed tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1849 microversion: 2.32 time: 0.711136 Oct 17 13:48:18.457256 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1581/3176] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:17 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1849 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:48:18.590510 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1e404d6b-eeee-480b-93ce-8d481bdb4d4c tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:18.591216 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1e404d6b-eeee-480b-93ce-8d481bdb4d4c tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 10690310-b856-4f6e-a4ea-1b771f45a75f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:18.611024 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1e404d6b-eeee-480b-93ce-8d481bdb4d4c tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:18.611951 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1e404d6b-eeee-480b-93ce-8d481bdb4d4c tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:18.612912 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1e404d6b-eeee-480b-93ce-8d481bdb4d4c tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:18.613872 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1e404d6b-eeee-480b-93ce-8d481bdb4d4c tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:18.614573 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1e404d6b-eeee-480b-93ce-8d481bdb4d4c tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:18.615157 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1e404d6b-eeee-480b-93ce-8d481bdb4d4c tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:18.935288 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-50f1939a-71ed-444d-a13d-399006f2a539 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:18.944702 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-50f1939a-71ed-444d-a13d-399006f2a539 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1503 microversion: 2.1 time: 0.592000 Oct 17 13:48:18.951507 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1596/3177] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:18 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1503 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:18.956915 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3459d8e6-3995-4273-a058-dff83711f346 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:18.967806 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3459d8e6-3995-4273-a058-dff83711f346 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] [instance: 531b762d-db7e-4911-af50-6b321b7706bf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:18.974791 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3459d8e6-3995-4273-a058-dff83711f346 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:18.975759 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3459d8e6-3995-4273-a058-dff83711f346 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:18.983945 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3459d8e6-3995-4273-a058-dff83711f346 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:18.985032 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3459d8e6-3995-4273-a058-dff83711f346 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:18.985701 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3459d8e6-3995-4273-a058-dff83711f346 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:18.986367 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3459d8e6-3995-4273-a058-dff83711f346 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:19.298196 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1e404d6b-eeee-480b-93ce-8d481bdb4d4c tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:19.307006 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1e404d6b-eeee-480b-93ce-8d481bdb4d4c tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/10690310-b856-4f6e-a4ea-1b771f45a75f" status: 200 len: 1366 microversion: 2.1 time: 0.720419 Oct 17 13:48:19.315218 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1582/3178] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:18 2022] GET /compute/v2.1/servers/10690310-b856-4f6e-a4ea-1b771f45a75f => generated 1366 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:48:19.320234 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-14f8b6c8-593d-46b9-92e4-f36df484a9c1 req-4d8111f1-9e8a-40b2-8dbd-8e6eda2ca163 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2", "tag": "09cd6d52-dd88-453b-97c9-b02b47bbb3bb"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:19.339966 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-14f8b6c8-593d-46b9-92e4-f36df484a9c1 req-4d8111f1-9e8a-40b2-8dbd-8e6eda2ca163 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:19.340732 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-14f8b6c8-593d-46b9-92e4-f36df484a9c1 req-4d8111f1-9e8a-40b2-8dbd-8e6eda2ca163 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:19.341328 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-14f8b6c8-593d-46b9-92e4-f36df484a9c1 req-4d8111f1-9e8a-40b2-8dbd-8e6eda2ca163 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:19.353129 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-14f8b6c8-593d-46b9-92e4-f36df484a9c1 req-4d8111f1-9e8a-40b2-8dbd-8e6eda2ca163 service nova] Creating event network-changed:09cd6d52-dd88-453b-97c9-b02b47bbb3bb for instance 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 on n-h1-854247-14 Oct 17 13:48:19.361278 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-14f8b6c8-593d-46b9-92e4-f36df484a9c1 req-4d8111f1-9e8a-40b2-8dbd-8e6eda2ca163 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044507 Oct 17 13:48:19.362380 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1583/3179] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:48:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:48:19.368502 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-db0f8cb2-136f-452a-b275-55fa44a129f1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:19.369406 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-db0f8cb2-136f-452a-b275-55fa44a129f1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9eaf1302-c967-4a24-8772-df5b32f11a60] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:19.377378 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db0f8cb2-136f-452a-b275-55fa44a129f1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:19.377874 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db0f8cb2-136f-452a-b275-55fa44a129f1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:19.378846 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db0f8cb2-136f-452a-b275-55fa44a129f1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:19.380242 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db0f8cb2-136f-452a-b275-55fa44a129f1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:19.381145 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db0f8cb2-136f-452a-b275-55fa44a129f1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:19.381716 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db0f8cb2-136f-452a-b275-55fa44a129f1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:19.592579 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3459d8e6-3995-4273-a058-dff83711f346 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:19.602516 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3459d8e6-3995-4273-a058-dff83711f346 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:19.604068 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3459d8e6-3995-4273-a058-dff83711f346 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:19.608511 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3459d8e6-3995-4273-a058-dff83711f346 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] 10.222.0.79 "GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf" status: 200 len: 1879 microversion: 2.42 time: 0.655669 Oct 17 13:48:19.609190 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1597/3180] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:18 2022] GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf => generated 1879 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:48:19.614942 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-266772a8-4a07-4c71-ace6-712440b6250b tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:19.625969 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-266772a8-4a07-4c71-ace6-712440b6250b tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:19.639065 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-266772a8-4a07-4c71-ace6-712440b6250b tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:19.639581 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-266772a8-4a07-4c71-ace6-712440b6250b tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:19.640175 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-266772a8-4a07-4c71-ace6-712440b6250b tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:19.641120 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-266772a8-4a07-4c71-ace6-712440b6250b tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:19.641722 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-266772a8-4a07-4c71-ace6-712440b6250b tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:19.642359 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-266772a8-4a07-4c71-ace6-712440b6250b tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:20.530066 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-db0f8cb2-136f-452a-b275-55fa44a129f1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:20.549513 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-db0f8cb2-136f-452a-b275-55fa44a129f1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/9eaf1302-c967-4a24-8772-df5b32f11a60" status: 200 len: 1476 microversion: 2.1 time: 1.183463 Oct 17 13:48:20.552493 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1584/3181] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:19 2022] GET /compute/v2.1/servers/9eaf1302-c967-4a24-8772-df5b32f11a60 => generated 1476 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:20.582551 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c0c25011-b648-4163-8058-34ad7d8a256f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:20.583879 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c0c25011-b648-4163-8058-34ad7d8a256f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:20.594918 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c0c25011-b648-4163-8058-34ad7d8a256f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:20.595498 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c0c25011-b648-4163-8058-34ad7d8a256f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:20.595942 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c0c25011-b648-4163-8058-34ad7d8a256f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:20.596664 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c0c25011-b648-4163-8058-34ad7d8a256f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:20.597115 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c0c25011-b648-4163-8058-34ad7d8a256f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:20.597536 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c0c25011-b648-4163-8058-34ad7d8a256f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:20.645790 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-266772a8-4a07-4c71-ace6-712440b6250b tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:20.688172 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-266772a8-4a07-4c71-ace6-712440b6250b tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:20.700742 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-266772a8-4a07-4c71-ace6-712440b6250b tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:20.701994 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-266772a8-4a07-4c71-ace6-712440b6250b tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1870 microversion: 2.32 time: 1.090888 Oct 17 13:48:20.702586 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1598/3182] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:19 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1870 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:48:20.715305 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-593011ce-eb76-416d-b57e-0d60fc130f16 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:20.715305 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-593011ce-eb76-416d-b57e-0d60fc130f16 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 10690310-b856-4f6e-a4ea-1b771f45a75f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:20.734959 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-593011ce-eb76-416d-b57e-0d60fc130f16 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:20.737497 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-593011ce-eb76-416d-b57e-0d60fc130f16 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:20.737998 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-593011ce-eb76-416d-b57e-0d60fc130f16 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:20.738768 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-593011ce-eb76-416d-b57e-0d60fc130f16 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:20.739450 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-593011ce-eb76-416d-b57e-0d60fc130f16 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:20.740036 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-593011ce-eb76-416d-b57e-0d60fc130f16 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:21.070580 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c0c25011-b648-4163-8058-34ad7d8a256f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:21.088468 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c0c25011-b648-4163-8058-34ad7d8a256f tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1503 microversion: 2.1 time: 0.529243 Oct 17 13:48:21.089389 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1585/3183] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:20 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1503 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:21.097117 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-f4c36fb1-ac2d-407a-bdb8-6dae63095a71 req-611f93f9-6a7e-47b3-a08b-9256ffb56406 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10690310-b856-4f6e-a4ea-1b771f45a75f", "name": "network-vif-plugged", "status": "completed", "tag": "d7fa4d99-108e-4a0d-8bd2-0e8856410c77"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:21.123878 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-f4c36fb1-ac2d-407a-bdb8-6dae63095a71 req-611f93f9-6a7e-47b3-a08b-9256ffb56406 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:21.124668 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-f4c36fb1-ac2d-407a-bdb8-6dae63095a71 req-611f93f9-6a7e-47b3-a08b-9256ffb56406 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:21.125493 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-f4c36fb1-ac2d-407a-bdb8-6dae63095a71 req-611f93f9-6a7e-47b3-a08b-9256ffb56406 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:21.167949 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-f4c36fb1-ac2d-407a-bdb8-6dae63095a71 req-611f93f9-6a7e-47b3-a08b-9256ffb56406 service nova] Creating event network-vif-plugged:d7fa4d99-108e-4a0d-8bd2-0e8856410c77 for instance 10690310-b856-4f6e-a4ea-1b771f45a75f on n-h1-854247-14 Oct 17 13:48:21.184119 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-f4c36fb1-ac2d-407a-bdb8-6dae63095a71 req-611f93f9-6a7e-47b3-a08b-9256ffb56406 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093269 Oct 17 13:48:21.187891 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1586/3184] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:48:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:48:21.201090 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9e03b1fb-40e1-46a1-8821-37ab7be8b3eb tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:21.201818 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9e03b1fb-40e1-46a1-8821-37ab7be8b3eb tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] [instance: 531b762d-db7e-4911-af50-6b321b7706bf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:21.237725 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9e03b1fb-40e1-46a1-8821-37ab7be8b3eb tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:21.239412 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9e03b1fb-40e1-46a1-8821-37ab7be8b3eb tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:21.239862 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9e03b1fb-40e1-46a1-8821-37ab7be8b3eb tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:21.241747 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9e03b1fb-40e1-46a1-8821-37ab7be8b3eb tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:21.242206 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9e03b1fb-40e1-46a1-8821-37ab7be8b3eb tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:21.242631 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9e03b1fb-40e1-46a1-8821-37ab7be8b3eb tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:21.253068 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-593011ce-eb76-416d-b57e-0d60fc130f16 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:21.266513 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-593011ce-eb76-416d-b57e-0d60fc130f16 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/10690310-b856-4f6e-a4ea-1b771f45a75f" status: 200 len: 1366 microversion: 2.1 time: 0.562591 Oct 17 13:48:21.282988 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1599/3185] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:20 2022] GET /compute/v2.1/servers/10690310-b856-4f6e-a4ea-1b771f45a75f => generated 1366 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:21.578155 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-58f6f059-cffd-48a3-bd34-a17a8ed57c57 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:21.578777 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-58f6f059-cffd-48a3-bd34-a17a8ed57c57 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9eaf1302-c967-4a24-8772-df5b32f11a60] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:21.591044 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-58f6f059-cffd-48a3-bd34-a17a8ed57c57 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:21.591576 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-58f6f059-cffd-48a3-bd34-a17a8ed57c57 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:21.592015 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-58f6f059-cffd-48a3-bd34-a17a8ed57c57 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:21.592853 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-58f6f059-cffd-48a3-bd34-a17a8ed57c57 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:21.593311 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-58f6f059-cffd-48a3-bd34-a17a8ed57c57 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:21.593790 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-58f6f059-cffd-48a3-bd34-a17a8ed57c57 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:21.905832 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9e03b1fb-40e1-46a1-8821-37ab7be8b3eb tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:21.932216 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9e03b1fb-40e1-46a1-8821-37ab7be8b3eb tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:21.933956 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9e03b1fb-40e1-46a1-8821-37ab7be8b3eb tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:21.935350 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9e03b1fb-40e1-46a1-8821-37ab7be8b3eb tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] 10.222.0.79 "GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf" status: 200 len: 1879 microversion: 2.42 time: 0.746278 Oct 17 13:48:21.936103 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1587/3186] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:21 2022] GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf => generated 1879 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:48:21.947820 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a32c87c8-b4a7-4d95-ae72-865424953bb3 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:21.950899 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a32c87c8-b4a7-4d95-ae72-865424953bb3 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:21.964574 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a32c87c8-b4a7-4d95-ae72-865424953bb3 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:21.969158 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a32c87c8-b4a7-4d95-ae72-865424953bb3 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:21.970823 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a32c87c8-b4a7-4d95-ae72-865424953bb3 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:21.974777 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a32c87c8-b4a7-4d95-ae72-865424953bb3 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:21.975496 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a32c87c8-b4a7-4d95-ae72-865424953bb3 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:21.975962 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a32c87c8-b4a7-4d95-ae72-865424953bb3 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:22.183394 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-58f6f059-cffd-48a3-bd34-a17a8ed57c57 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:22.194457 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-58f6f059-cffd-48a3-bd34-a17a8ed57c57 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/9eaf1302-c967-4a24-8772-df5b32f11a60" status: 200 len: 1476 microversion: 2.1 time: 0.620104 Oct 17 13:48:22.196876 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1600/3187] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:21 2022] GET /compute/v2.1/servers/9eaf1302-c967-4a24-8772-df5b32f11a60 => generated 1476 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:48:22.203645 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-7908a69a-b56f-473f-8b8c-ed2767110c3b req-854f8674-8858-45dd-a0bf-d5a63ca109f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2", "tag": "dc9dca25-b1ad-44bb-8a66-3f7f867f9db4"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:22.225126 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-7908a69a-b56f-473f-8b8c-ed2767110c3b req-854f8674-8858-45dd-a0bf-d5a63ca109f3 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:22.226157 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-7908a69a-b56f-473f-8b8c-ed2767110c3b req-854f8674-8858-45dd-a0bf-d5a63ca109f3 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:22.226844 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-7908a69a-b56f-473f-8b8c-ed2767110c3b req-854f8674-8858-45dd-a0bf-d5a63ca109f3 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:22.252578 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-7908a69a-b56f-473f-8b8c-ed2767110c3b req-854f8674-8858-45dd-a0bf-d5a63ca109f3 service nova] Creating event network-changed:dc9dca25-b1ad-44bb-8a66-3f7f867f9db4 for instance 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 on n-h1-854247-14 Oct 17 13:48:22.260664 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-7908a69a-b56f-473f-8b8c-ed2767110c3b req-854f8674-8858-45dd-a0bf-d5a63ca109f3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062201 Oct 17 13:48:22.263227 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1601/3188] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:48:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:48:22.274562 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-70139fb4-a2d0-4bae-9699-8e2aceed841a tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:22.276417 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-70139fb4-a2d0-4bae-9699-8e2aceed841a tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:22.284171 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-70139fb4-a2d0-4bae-9699-8e2aceed841a tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:22.285308 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-70139fb4-a2d0-4bae-9699-8e2aceed841a tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:22.285744 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-70139fb4-a2d0-4bae-9699-8e2aceed841a tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:22.286683 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-70139fb4-a2d0-4bae-9699-8e2aceed841a tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:22.287385 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-70139fb4-a2d0-4bae-9699-8e2aceed841a tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:22.295690 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-70139fb4-a2d0-4bae-9699-8e2aceed841a tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:22.360231 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a32c87c8-b4a7-4d95-ae72-865424953bb3 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:22.373811 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a32c87c8-b4a7-4d95-ae72-865424953bb3 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:22.377692 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a32c87c8-b4a7-4d95-ae72-865424953bb3 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:22.380210 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a32c87c8-b4a7-4d95-ae72-865424953bb3 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1858 microversion: 2.32 time: 0.442029 Oct 17 13:48:22.398761 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1588/3189] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:21 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1858 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:48:22.576461 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-70139fb4-a2d0-4bae-9699-8e2aceed841a tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:22.594262 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-70139fb4-a2d0-4bae-9699-8e2aceed841a tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 0.329164 Oct 17 13:48:22.595480 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1602/3190] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:22 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:22.647759 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c2e4e898-b713-40db-91bb-c642af6f8c9e tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:22.653483 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c2e4e898-b713-40db-91bb-c642af6f8c9e tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 10690310-b856-4f6e-a4ea-1b771f45a75f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:22.669418 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c2e4e898-b713-40db-91bb-c642af6f8c9e tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:22.670449 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c2e4e898-b713-40db-91bb-c642af6f8c9e tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:22.672123 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c2e4e898-b713-40db-91bb-c642af6f8c9e tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:22.673051 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c2e4e898-b713-40db-91bb-c642af6f8c9e tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:22.673744 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c2e4e898-b713-40db-91bb-c642af6f8c9e tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:22.674244 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c2e4e898-b713-40db-91bb-c642af6f8c9e tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:22.692735 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3621179e-6cac-410b-bf54-be2b898424a6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1408183803", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:22.784454 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-3621179e-6cac-410b-bf54-be2b898424a6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] validate_networks() for [('e17fb768-1158-4dd6-8430-46ce854c7d98', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:48:23.340663 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c2e4e898-b713-40db-91bb-c642af6f8c9e tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:23.354282 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c2e4e898-b713-40db-91bb-c642af6f8c9e tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/10690310-b856-4f6e-a4ea-1b771f45a75f" status: 200 len: 1557 microversion: 2.1 time: 0.748203 Oct 17 13:48:23.354788 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1603/3191] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:22 2022] GET /compute/v2.1/servers/10690310-b856-4f6e-a4ea-1b771f45a75f => generated 1557 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:23.379580 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5c5ed022-aa55-4b0c-9fb7-27b1c8089264 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:23.380694 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5c5ed022-aa55-4b0c-9fb7-27b1c8089264 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:23.387956 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5c5ed022-aa55-4b0c-9fb7-27b1c8089264 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:23.389009 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5c5ed022-aa55-4b0c-9fb7-27b1c8089264 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:23.389579 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5c5ed022-aa55-4b0c-9fb7-27b1c8089264 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:23.391009 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5c5ed022-aa55-4b0c-9fb7-27b1c8089264 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:23.392702 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5c5ed022-aa55-4b0c-9fb7-27b1c8089264 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:23.395704 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5c5ed022-aa55-4b0c-9fb7-27b1c8089264 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:23.771271 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5c5ed022-aa55-4b0c-9fb7-27b1c8089264 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:23.791484 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5c5ed022-aa55-4b0c-9fb7-27b1c8089264 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 0.419999 Oct 17 13:48:23.829836 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1604/3192] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:23 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:23.829836 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-26d4722c-1d2f-4f34-9def-dbd7568bb62e tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:23.829836 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-26d4722c-1d2f-4f34-9def-dbd7568bb62e tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] [instance: 531b762d-db7e-4911-af50-6b321b7706bf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:23.846774 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-26d4722c-1d2f-4f34-9def-dbd7568bb62e tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:23.847720 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-26d4722c-1d2f-4f34-9def-dbd7568bb62e tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:23.849670 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-26d4722c-1d2f-4f34-9def-dbd7568bb62e tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:23.850705 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-26d4722c-1d2f-4f34-9def-dbd7568bb62e tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:23.851572 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-26d4722c-1d2f-4f34-9def-dbd7568bb62e tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:23.852898 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-26d4722c-1d2f-4f34-9def-dbd7568bb62e tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:23.910734 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-3621179e-6cac-410b-bf54-be2b898424a6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:48:23.911813 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-3621179e-6cac-410b-bf54-be2b898424a6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:48:23.912518 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-3621179e-6cac-410b-bf54-be2b898424a6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:48:23.913156 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-3621179e-6cac-410b-bf54-be2b898424a6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:48:23.914053 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-3621179e-6cac-410b-bf54-be2b898424a6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:48:23.929916 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3621179e-6cac-410b-bf54-be2b898424a6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:23.930738 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3621179e-6cac-410b-bf54-be2b898424a6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:23.931489 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3621179e-6cac-410b-bf54-be2b898424a6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:23.932543 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3621179e-6cac-410b-bf54-be2b898424a6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:23.933226 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3621179e-6cac-410b-bf54-be2b898424a6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:23.933870 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3621179e-6cac-410b-bf54-be2b898424a6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:23.991576 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-3621179e-6cac-410b-bf54-be2b898424a6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Getting quotas for project 08068aeba86c4e718ba1e25c68fd3259. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:48:24.000817 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-3621179e-6cac-410b-bf54-be2b898424a6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Getting quotas for user d56b91ce42894bafac5ddb16ad6f037b and project 08068aeba86c4e718ba1e25c68fd3259. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:48:24.020407 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3621179e-6cac-410b-bf54-be2b898424a6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:48:24.030717 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3621179e-6cac-410b-bf54-be2b898424a6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 33de8199-8f00-40eb-9b95-b7ab5289dbe3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:48:24.107814 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3621179e-6cac-410b-bf54-be2b898424a6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.724947 Oct 17 13:48:24.111255 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1589/3193] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:48:22 2022] POST /compute/v2.1/servers => generated 383 bytes in 1727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:48:24.119116 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9989059a-947f-4f53-8d43-ab04ca81436f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:24.126254 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9989059a-947f-4f53-8d43-ab04ca81436f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9eaf1302-c967-4a24-8772-df5b32f11a60] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:24.151845 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9989059a-947f-4f53-8d43-ab04ca81436f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:24.153907 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9989059a-947f-4f53-8d43-ab04ca81436f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:24.154466 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9989059a-947f-4f53-8d43-ab04ca81436f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:24.156127 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9989059a-947f-4f53-8d43-ab04ca81436f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:24.157007 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9989059a-947f-4f53-8d43-ab04ca81436f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:24.157630 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9989059a-947f-4f53-8d43-ab04ca81436f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:24.198582 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-26d4722c-1d2f-4f34-9def-dbd7568bb62e tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:24.211553 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-26d4722c-1d2f-4f34-9def-dbd7568bb62e tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:24.213002 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-26d4722c-1d2f-4f34-9def-dbd7568bb62e tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:24.214195 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-26d4722c-1d2f-4f34-9def-dbd7568bb62e tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] 10.222.0.79 "GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf" status: 200 len: 1879 microversion: 2.42 time: 0.397985 Oct 17 13:48:24.214766 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1605/3194] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:23 2022] GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf => generated 1879 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:48:24.240063 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-951a0104-c132-4377-b09b-57b6b50dc9c0 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:24.240569 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-951a0104-c132-4377-b09b-57b6b50dc9c0 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 10690310-b856-4f6e-a4ea-1b771f45a75f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:24.246700 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-951a0104-c132-4377-b09b-57b6b50dc9c0 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:24.247206 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-951a0104-c132-4377-b09b-57b6b50dc9c0 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:24.247641 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-951a0104-c132-4377-b09b-57b6b50dc9c0 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:24.248344 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-951a0104-c132-4377-b09b-57b6b50dc9c0 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:24.248801 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-951a0104-c132-4377-b09b-57b6b50dc9c0 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:24.249221 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-951a0104-c132-4377-b09b-57b6b50dc9c0 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:24.689294 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-951a0104-c132-4377-b09b-57b6b50dc9c0 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/10690310-b856-4f6e-a4ea-1b771f45a75f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.452382 Oct 17 13:48:24.692631 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1606/3195] 10.222.0.79 () {58 vars in 1275 bytes} [Mon Oct 17 13:48:24 2022] GET /compute/v2.1/servers/10690310-b856-4f6e-a4ea-1b771f45a75f/os-interface => generated 285 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:48:24.700538 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3f50c437-d5e3-48e7-9896-c3423cb6cdc6 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:24.702074 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3f50c437-d5e3-48e7-9896-c3423cb6cdc6 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:24.724969 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3f50c437-d5e3-48e7-9896-c3423cb6cdc6 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:24.725664 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3f50c437-d5e3-48e7-9896-c3423cb6cdc6 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:24.726270 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3f50c437-d5e3-48e7-9896-c3423cb6cdc6 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:24.727201 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3f50c437-d5e3-48e7-9896-c3423cb6cdc6 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:24.728030 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3f50c437-d5e3-48e7-9896-c3423cb6cdc6 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:24.729067 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3f50c437-d5e3-48e7-9896-c3423cb6cdc6 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:24.943901 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9989059a-947f-4f53-8d43-ab04ca81436f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:24.957754 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9989059a-947f-4f53-8d43-ab04ca81436f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/9eaf1302-c967-4a24-8772-df5b32f11a60" status: 200 len: 1476 microversion: 2.1 time: 0.847502 Oct 17 13:48:24.962418 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1590/3196] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:24 2022] GET /compute/v2.1/servers/9eaf1302-c967-4a24-8772-df5b32f11a60 => generated 1476 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:24.972403 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-250a1434-40bc-4e10-bb54-dd251eb6a1e9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:24.975871 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-250a1434-40bc-4e10-bb54-dd251eb6a1e9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: ef0a0d74-d5a5-4618-a454-1909fd7352ed] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:24.987632 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-250a1434-40bc-4e10-bb54-dd251eb6a1e9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] HTTP exception thrown: Instance ef0a0d74-d5a5-4618-a454-1909fd7352ed could not be found. Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-250a1434-40bc-4e10-bb54-dd251eb6a1e9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Request method failure captured: Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: request: POST /compute/v2.1/servers/ef0a0d74-d5a5-4618-a454-1909fd7352ed/action HTTP/1.1 Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 15 Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVwEqzYAZh4AkEjRryOAZIhaHrAKxd2Qcal9md8a5n-MMUYSdXmcWYLDVkyQoPrDIbcsApBq2EewemPkBwvNDDOidb0hhc_Z3w9BeEUj5ET_flLYPqO5hgqCsuZGXFiYIEBJxrkx614fXiELZHaNkvhSdsJHShK0w7L-UPHhkPKqi5M Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_59e65f6eb06d40d583b9f43c9af94c13", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 443c44b0bd9e4c56a7fe0c1a53238545 Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: {"unpause": {}} Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance ef0a0d74-d5a5-4618-a454-1909fd7352ed could not be found. Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'ef0a0d74-d5a5-4618-a454-1909fd7352ed', 'body': {'unpause': {}}} Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef0a0d74-d5a5-4618-a454-1909fd7352ed could not be found. Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef0a0d74-d5a5-4618-a454-1909fd7352ed could not be found. Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:48:24.997620 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:48:25.003675 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:48:25.003675 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:48:25.003675 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef0a0d74-d5a5-4618-a454-1909fd7352ed could not be found. Oct 17 13:48:25.003675 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:48:25.003675 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-250a1434-40bc-4e10-bb54-dd251eb6a1e9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Returning 404 to user: Instance ef0a0d74-d5a5-4618-a454-1909fd7352ed could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:48:25.003675 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-250a1434-40bc-4e10-bb54-dd251eb6a1e9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "POST /compute/v2.1/servers/ef0a0d74-d5a5-4618-a454-1909fd7352ed/action" status: 404 len: 111 microversion: 2.1 time: 0.035852 Oct 17 13:48:25.005860 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1591/3197] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:48:24 2022] POST /compute/v2.1/servers/ef0a0d74-d5a5-4618-a454-1909fd7352ed/action => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:48:25.011496 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4d8ebd8d-0d08-48f3-bc14-885b36671e82 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:25.015657 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4d8ebd8d-0d08-48f3-bc14-885b36671e82 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 33de8199-8f00-40eb-9b95-b7ab5289dbe3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:25.029631 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4d8ebd8d-0d08-48f3-bc14-885b36671e82 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:25.031049 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4d8ebd8d-0d08-48f3-bc14-885b36671e82 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:25.036969 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4d8ebd8d-0d08-48f3-bc14-885b36671e82 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:25.039462 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4d8ebd8d-0d08-48f3-bc14-885b36671e82 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:25.040129 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4d8ebd8d-0d08-48f3-bc14-885b36671e82 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:25.040724 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4d8ebd8d-0d08-48f3-bc14-885b36671e82 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:25.321158 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4d8ebd8d-0d08-48f3-bc14-885b36671e82 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:25.331711 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4d8ebd8d-0d08-48f3-bc14-885b36671e82 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3" status: 200 len: 1226 microversion: 2.1 time: 0.325889 Oct 17 13:48:25.344307 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1592/3198] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:25 2022] GET /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3 => generated 1226 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:25.349422 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-0f3e1c2c-d195-40bd-8a0c-70e645e03cbc req-1e6db4d1-c82f-456f-98f6-aff21d7e5a47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2", "tag": "d9802ec8-6622-432d-90fa-c32aa88e3fdb"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:25.390368 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-0f3e1c2c-d195-40bd-8a0c-70e645e03cbc req-1e6db4d1-c82f-456f-98f6-aff21d7e5a47 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:25.391407 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-0f3e1c2c-d195-40bd-8a0c-70e645e03cbc req-1e6db4d1-c82f-456f-98f6-aff21d7e5a47 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:25.392143 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-0f3e1c2c-d195-40bd-8a0c-70e645e03cbc req-1e6db4d1-c82f-456f-98f6-aff21d7e5a47 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:25.433633 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-0f3e1c2c-d195-40bd-8a0c-70e645e03cbc req-1e6db4d1-c82f-456f-98f6-aff21d7e5a47 service nova] Creating event network-changed:d9802ec8-6622-432d-90fa-c32aa88e3fdb for instance 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 on n-h1-854247-14 Oct 17 13:48:25.444002 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-0f3e1c2c-d195-40bd-8a0c-70e645e03cbc req-1e6db4d1-c82f-456f-98f6-aff21d7e5a47 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098004 Oct 17 13:48:25.445216 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1593/3199] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:48:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:48:25.450817 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4f104d60-add3-4243-af7a-e3caa7d6f5b9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:25.456394 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4f104d60-add3-4243-af7a-e3caa7d6f5b9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:25.475679 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4f104d60-add3-4243-af7a-e3caa7d6f5b9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:25.476179 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4f104d60-add3-4243-af7a-e3caa7d6f5b9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:25.476682 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4f104d60-add3-4243-af7a-e3caa7d6f5b9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:25.477452 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4f104d60-add3-4243-af7a-e3caa7d6f5b9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:25.478128 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4f104d60-add3-4243-af7a-e3caa7d6f5b9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:25.478573 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4f104d60-add3-4243-af7a-e3caa7d6f5b9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:25.769137 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3f50c437-d5e3-48e7-9896-c3423cb6cdc6 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:25.784460 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3f50c437-d5e3-48e7-9896-c3423cb6cdc6 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:25.792096 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3f50c437-d5e3-48e7-9896-c3423cb6cdc6 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:25.795160 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3f50c437-d5e3-48e7-9896-c3423cb6cdc6 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1879 microversion: 2.32 time: 1.101343 Oct 17 13:48:25.800563 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1607/3200] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:24 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1879 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:48:25.805826 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e60b49ff-727d-4f6c-b318-8e9d86d54685 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:25.811269 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e60b49ff-727d-4f6c-b318-8e9d86d54685 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] [instance: 531b762d-db7e-4911-af50-6b321b7706bf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:25.827838 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e60b49ff-727d-4f6c-b318-8e9d86d54685 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:25.828807 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e60b49ff-727d-4f6c-b318-8e9d86d54685 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:25.829447 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e60b49ff-727d-4f6c-b318-8e9d86d54685 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:25.830407 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e60b49ff-727d-4f6c-b318-8e9d86d54685 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:25.831060 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e60b49ff-727d-4f6c-b318-8e9d86d54685 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:25.831710 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e60b49ff-727d-4f6c-b318-8e9d86d54685 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:26.393958 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4f104d60-add3-4243-af7a-e3caa7d6f5b9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:26.427918 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4f104d60-add3-4243-af7a-e3caa7d6f5b9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 0.977159 Oct 17 13:48:26.429212 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1594/3201] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:25 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:26.456175 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-147a1b9a-2091-4bc3-a740-a9eb981d1f06 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-105162107", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:26.572529 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-147a1b9a-2091-4bc3-a740-a9eb981d1f06 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] validate_networks() for [('e17fb768-1158-4dd6-8430-46ce854c7d98', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:48:26.767573 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e60b49ff-727d-4f6c-b318-8e9d86d54685 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:26.786649 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e60b49ff-727d-4f6c-b318-8e9d86d54685 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:26.788138 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e60b49ff-727d-4f6c-b318-8e9d86d54685 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:26.800609 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e60b49ff-727d-4f6c-b318-8e9d86d54685 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] 10.222.0.79 "GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf" status: 200 len: 1879 microversion: 2.42 time: 0.996843 Oct 17 13:48:26.802795 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1608/3202] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:25 2022] GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf => generated 1879 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:48:26.813816 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5ae10d89-6a1f-41d2-a44e-c47f1f72c08e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:26.817180 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5ae10d89-6a1f-41d2-a44e-c47f1f72c08e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9eaf1302-c967-4a24-8772-df5b32f11a60] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:26.845705 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5ae10d89-6a1f-41d2-a44e-c47f1f72c08e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:26.846441 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5ae10d89-6a1f-41d2-a44e-c47f1f72c08e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:26.847111 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5ae10d89-6a1f-41d2-a44e-c47f1f72c08e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:26.848123 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5ae10d89-6a1f-41d2-a44e-c47f1f72c08e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:26.848743 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5ae10d89-6a1f-41d2-a44e-c47f1f72c08e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:26.849899 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5ae10d89-6a1f-41d2-a44e-c47f1f72c08e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:28.973328 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5ae10d89-6a1f-41d2-a44e-c47f1f72c08e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:28.992174 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5ae10d89-6a1f-41d2-a44e-c47f1f72c08e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/9eaf1302-c967-4a24-8772-df5b32f11a60" status: 200 len: 1475 microversion: 2.1 time: 2.187747 Oct 17 13:48:29.010273 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1609/3203] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:26 2022] GET /compute/v2.1/servers/9eaf1302-c967-4a24-8772-df5b32f11a60 => generated 1475 bytes in 2206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:29.018892 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7d5a8def-4d21-4f00-b0df-2c2950edab30 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:29.020341 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7d5a8def-4d21-4f00-b0df-2c2950edab30 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:29.028688 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7d5a8def-4d21-4f00-b0df-2c2950edab30 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:29.029282 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7d5a8def-4d21-4f00-b0df-2c2950edab30 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:29.031068 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7d5a8def-4d21-4f00-b0df-2c2950edab30 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:29.032143 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7d5a8def-4d21-4f00-b0df-2c2950edab30 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:29.032578 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7d5a8def-4d21-4f00-b0df-2c2950edab30 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:29.033240 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7d5a8def-4d21-4f00-b0df-2c2950edab30 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:29.366324 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-147a1b9a-2091-4bc3-a740-a9eb981d1f06 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:48:29.366813 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-147a1b9a-2091-4bc3-a740-a9eb981d1f06 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:48:29.367558 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-147a1b9a-2091-4bc3-a740-a9eb981d1f06 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:48:29.368101 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-147a1b9a-2091-4bc3-a740-a9eb981d1f06 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:48:29.368568 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-147a1b9a-2091-4bc3-a740-a9eb981d1f06 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:48:29.380181 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-147a1b9a-2091-4bc3-a740-a9eb981d1f06 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:29.380993 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-147a1b9a-2091-4bc3-a740-a9eb981d1f06 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:29.381610 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-147a1b9a-2091-4bc3-a740-a9eb981d1f06 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:29.382415 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-147a1b9a-2091-4bc3-a740-a9eb981d1f06 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:29.382927 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-147a1b9a-2091-4bc3-a740-a9eb981d1f06 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:29.383425 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-147a1b9a-2091-4bc3-a740-a9eb981d1f06 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:29.405362 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-147a1b9a-2091-4bc3-a740-a9eb981d1f06 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Getting quotas for project 08068aeba86c4e718ba1e25c68fd3259. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:48:29.413580 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-147a1b9a-2091-4bc3-a740-a9eb981d1f06 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Getting quotas for user d56b91ce42894bafac5ddb16ad6f037b and project 08068aeba86c4e718ba1e25c68fd3259. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:48:29.429062 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-147a1b9a-2091-4bc3-a740-a9eb981d1f06 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:48:29.431398 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-147a1b9a-2091-4bc3-a740-a9eb981d1f06 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 68363fdf-f661-4b7c-abdc-7a8a85efa83a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:48:29.480158 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-147a1b9a-2091-4bc3-a740-a9eb981d1f06 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.043786 Oct 17 13:48:29.480646 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1595/3204] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:48:26 2022] POST /compute/v2.1/servers => generated 383 bytes in 3049 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:48:29.489680 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7d5a8def-4d21-4f00-b0df-2c2950edab30 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:29.490866 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-05a65a88-f717-496c-bfe7-0c465c683627 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:29.491516 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-05a65a88-f717-496c-bfe7-0c465c683627 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:29.497475 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7d5a8def-4d21-4f00-b0df-2c2950edab30 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 0.483967 Oct 17 13:48:29.497769 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-05a65a88-f717-496c-bfe7-0c465c683627 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:29.498256 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-05a65a88-f717-496c-bfe7-0c465c683627 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:29.514807 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-05a65a88-f717-496c-bfe7-0c465c683627 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:29.514807 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-05a65a88-f717-496c-bfe7-0c465c683627 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:29.514807 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-05a65a88-f717-496c-bfe7-0c465c683627 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:29.514807 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-05a65a88-f717-496c-bfe7-0c465c683627 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:29.517021 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1610/3205] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:29 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:29.522297 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-196524a6-f6a4-41b0-9aa4-602f29b8579b tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:29.523323 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-196524a6-f6a4-41b0-9aa4-602f29b8579b tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] [instance: 531b762d-db7e-4911-af50-6b321b7706bf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:29.529802 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-196524a6-f6a4-41b0-9aa4-602f29b8579b tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:29.530554 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-196524a6-f6a4-41b0-9aa4-602f29b8579b tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:29.531142 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-196524a6-f6a4-41b0-9aa4-602f29b8579b tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:29.532036 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-196524a6-f6a4-41b0-9aa4-602f29b8579b tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:29.532656 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-196524a6-f6a4-41b0-9aa4-602f29b8579b tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:29.533287 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-196524a6-f6a4-41b0-9aa4-602f29b8579b tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:30.255987 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-05a65a88-f717-496c-bfe7-0c465c683627 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:30.268553 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-05a65a88-f717-496c-bfe7-0c465c683627 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:30.270415 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-05a65a88-f717-496c-bfe7-0c465c683627 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:30.272574 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-05a65a88-f717-496c-bfe7-0c465c683627 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1879 microversion: 2.32 time: 0.790859 Oct 17 13:48:30.283289 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-196524a6-f6a4-41b0-9aa4-602f29b8579b tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:30.284082 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1596/3206] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:29 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1879 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:48:30.295053 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-196524a6-f6a4-41b0-9aa4-602f29b8579b tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:30.296599 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-196524a6-f6a4-41b0-9aa4-602f29b8579b tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:30.297842 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-196524a6-f6a4-41b0-9aa4-602f29b8579b tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] 10.222.0.79 "GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf" status: 200 len: 1879 microversion: 2.42 time: 0.779268 Oct 17 13:48:30.319441 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1611/3207] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:29 2022] GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf => generated 1879 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:48:30.335795 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-1a69f1d1-f0ff-431a-a6a7-7ff26d7c6e0c req-c747a5bc-e47c-4f1b-82bc-833d2a59996d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2", "tag": "d03d577d-51fe-4dfb-b7f2-e27b813faec8"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:30.348816 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-1a69f1d1-f0ff-431a-a6a7-7ff26d7c6e0c req-c747a5bc-e47c-4f1b-82bc-833d2a59996d service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:30.349607 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-1a69f1d1-f0ff-431a-a6a7-7ff26d7c6e0c req-c747a5bc-e47c-4f1b-82bc-833d2a59996d service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:30.350311 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-1a69f1d1-f0ff-431a-a6a7-7ff26d7c6e0c req-c747a5bc-e47c-4f1b-82bc-833d2a59996d service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:30.364310 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-1a69f1d1-f0ff-431a-a6a7-7ff26d7c6e0c req-c747a5bc-e47c-4f1b-82bc-833d2a59996d service nova] Creating event network-changed:d03d577d-51fe-4dfb-b7f2-e27b813faec8 for instance 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 on n-h1-854247-14 Oct 17 13:48:30.382632 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-1a69f1d1-f0ff-431a-a6a7-7ff26d7c6e0c req-c747a5bc-e47c-4f1b-82bc-833d2a59996d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059562 Oct 17 13:48:30.384012 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1612/3208] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:48:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:48:30.390242 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-02f667a2-7822-4e75-ac00-25e5d8ccc532 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:30.391324 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-02f667a2-7822-4e75-ac00-25e5d8ccc532 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 68363fdf-f661-4b7c-abdc-7a8a85efa83a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:30.400785 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-02f667a2-7822-4e75-ac00-25e5d8ccc532 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:30.401619 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-02f667a2-7822-4e75-ac00-25e5d8ccc532 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:30.402297 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-02f667a2-7822-4e75-ac00-25e5d8ccc532 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:30.403753 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-02f667a2-7822-4e75-ac00-25e5d8ccc532 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:30.404485 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-02f667a2-7822-4e75-ac00-25e5d8ccc532 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:30.410712 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d6836920-c2e7-4df9-a522-0b148a58fe0d tempest-FloatingIPDetailsTestJSON-589486563 tempest-FloatingIPDetailsTestJSON-589486563-project] Action: 'create', calling method: .version_select at 0x7f7cd53f1820>, body: {"pool": null} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:30.417024 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-02f667a2-7822-4e75-ac00-25e5d8ccc532 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:30.872066 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-02f667a2-7822-4e75-ac00-25e5d8ccc532 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:30.877763 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:48:30.883399 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-02f667a2-7822-4e75-ac00-25e5d8ccc532 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a" status: 200 len: 1217 microversion: 2.1 time: 0.497934 Oct 17 13:48:30.885482 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1613/3209] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:30 2022] GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a => generated 1217 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:30.890714 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-95bc6976-9c82-4e0a-91c8-d5bf5d5a8eb7 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:30.891574 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-95bc6976-9c82-4e0a-91c8-d5bf5d5a8eb7 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:30.899354 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-95bc6976-9c82-4e0a-91c8-d5bf5d5a8eb7 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:30.900124 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-95bc6976-9c82-4e0a-91c8-d5bf5d5a8eb7 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:30.902304 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-95bc6976-9c82-4e0a-91c8-d5bf5d5a8eb7 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:30.910489 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-95bc6976-9c82-4e0a-91c8-d5bf5d5a8eb7 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:30.911031 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-95bc6976-9c82-4e0a-91c8-d5bf5d5a8eb7 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:30.924754 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-95bc6976-9c82-4e0a-91c8-d5bf5d5a8eb7 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:30.975980 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-95bc6976-9c82-4e0a-91c8-d5bf5d5a8eb7 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] HTTP exception thrown: Cannot 'unpause' instance 5ef00d34-7f81-4649-a90a-a52cf78dbeca while it is in vm_state active Oct 17 13:48:30.977906 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-95bc6976-9c82-4e0a-91c8-d5bf5d5a8eb7 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Request method failure captured: Oct 17 13:48:30.977906 n-d-854247-14 devstack@n-api.service[127016]: request: POST /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca/action HTTP/1.1 Oct 17 13:48:30.977906 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:48:30.977906 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:48:30.977906 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:48:30.977906 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 15 Oct 17 13:48:30.977906 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:48:30.977906 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:48:30.977906 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:48:30.977906 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:48:30.977906 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVwEqzYAZh4AkEjRryOAZIhaHrAKxd2Qcal9md8a5n-MMUYSdXmcWYLDVkyQoPrDIbcsApBq2EewemPkBwvNDDOidb0hhc_Z3w9BeEUj5ET_flLYPqO5hgqCsuZGXFiYIEBJxrkx614fXiELZHaNkvhSdsJHShK0w7L-UPHhkPKqi5M Oct 17 13:48:30.977906 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:48:30.977906 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:48:30.977906 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:48:30.977906 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:48:30.977906 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:48:30.977906 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:48:30.977906 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:48:30.977906 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:48:30.977906 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:48:30.977906 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:48:30.977906 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_59e65f6eb06d40d583b9f43c9af94c13", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:48:30.977906 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:48:30.977906 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:48:30.977906 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:48:30.977906 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:48:30.977906 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:48:30.977906 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:48:30.977906 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 443c44b0bd9e4c56a7fe0c1a53238545 Oct 17 13:48:30.977906 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:48:30.977906 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:48:30.977906 n-d-854247-14 devstack@n-api.service[127016]: {"unpause": {}} Oct 17 13:48:30.977906 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:48:30.977906 n-d-854247-14 devstack@n-api.service[127016]: exception: Cannot 'unpause' instance 5ef00d34-7f81-4649-a90a-a52cf78dbeca while it is in vm_state active Oct 17 13:48:30.977906 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '5ef00d34-7f81-4649-a90a-a52cf78dbeca', 'body': {'unpause': {}}} Oct 17 13:48:30.977906 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:48:30.977906 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:48:30.977906 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 17 13:48:30.977906 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 17 13:48:30.977906 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 13:48:30.977906 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:48:30.977906 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 13:48:30.977906 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 13:48:30.977906 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5ef00d34-7f81-4649-a90a-a52cf78dbeca in vm_state active. Cannot unpause while the instance is in this state. Oct 17 13:48:30.977906 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:48:30.977906 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:48:30.977906 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:48:30.977906 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:48:30.977906 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:48:30.977906 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:48:30.977906 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:48:30.977906 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:48:30.977906 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:48:30.977906 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:48:30.977906 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 17 13:48:30.977906 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 17 13:48:30.977906 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 13:48:30.977906 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 13:48:30.977906 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 5ef00d34-7f81-4649-a90a-a52cf78dbeca while it is in vm_state active Oct 17 13:48:30.977906 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:48:30.977906 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:48:30.977906 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:48:30.977906 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:48:30.977906 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:48:30.982030 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:48:30.982030 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:48:30.982030 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:48:30.982030 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 5ef00d34-7f81-4649-a90a-a52cf78dbeca while it is in vm_state active Oct 17 13:48:30.982030 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:48:30.992746 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-95bc6976-9c82-4e0a-91c8-d5bf5d5a8eb7 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Returning 409 to user: Cannot 'unpause' instance 5ef00d34-7f81-4649-a90a-a52cf78dbeca while it is in vm_state active {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:48:30.994553 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-95bc6976-9c82-4e0a-91c8-d5bf5d5a8eb7 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "POST /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca/action" status: 409 len: 145 microversion: 2.1 time: 0.107931 Oct 17 13:48:30.995396 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1614/3210] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:48:30 2022] POST /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca/action => generated 145 bytes in 109 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:48:31.001848 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-329931ae-ae27-49bd-8e40-23e4d1922aff req-f6842f04-6f60-49b1-b9d1-9261c4b6cbbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9eaf1302-c967-4a24-8772-df5b32f11a60", "name": "network-vif-unplugged", "status": "completed", "tag": "1629935f-cce8-40f2-bbc7-1ee779fadbb9"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:31.014294 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-329931ae-ae27-49bd-8e40-23e4d1922aff req-f6842f04-6f60-49b1-b9d1-9261c4b6cbbd service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:31.015138 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-329931ae-ae27-49bd-8e40-23e4d1922aff req-f6842f04-6f60-49b1-b9d1-9261c4b6cbbd service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:31.015876 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-329931ae-ae27-49bd-8e40-23e4d1922aff req-f6842f04-6f60-49b1-b9d1-9261c4b6cbbd service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:31.035907 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-329931ae-ae27-49bd-8e40-23e4d1922aff req-f6842f04-6f60-49b1-b9d1-9261c4b6cbbd service nova] Creating event network-vif-unplugged:1629935f-cce8-40f2-bbc7-1ee779fadbb9 for instance 9eaf1302-c967-4a24-8772-df5b32f11a60 on n-h2-854247-14 Oct 17 13:48:31.043565 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [req-329931ae-ae27-49bd-8e40-23e4d1922aff req-f6842f04-6f60-49b1-b9d1-9261c4b6cbbd service nova] Instance 9eaf1302-c967-4a24-8772-df5b32f11a60 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854247-14'} {{(pid=127016) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:48:31.051104 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-329931ae-ae27-49bd-8e40-23e4d1922aff req-f6842f04-6f60-49b1-b9d1-9261c4b6cbbd service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053730 Oct 17 13:48:31.052381 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1615/3211] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:48:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:48:31.058316 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-22a25491-b41b-4ace-bc03-41661e86605a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:31.059322 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-22a25491-b41b-4ace-bc03-41661e86605a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9eaf1302-c967-4a24-8772-df5b32f11a60] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:31.067234 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-22a25491-b41b-4ace-bc03-41661e86605a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:31.068044 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-22a25491-b41b-4ace-bc03-41661e86605a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:31.068692 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-22a25491-b41b-4ace-bc03-41661e86605a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:31.069611 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-22a25491-b41b-4ace-bc03-41661e86605a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:31.070274 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-22a25491-b41b-4ace-bc03-41661e86605a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:31.071535 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-22a25491-b41b-4ace-bc03-41661e86605a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:31.501725 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-22a25491-b41b-4ace-bc03-41661e86605a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:31.531397 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-22a25491-b41b-4ace-bc03-41661e86605a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/9eaf1302-c967-4a24-8772-df5b32f11a60" status: 200 len: 1470 microversion: 2.1 time: 0.474469 Oct 17 13:48:31.534651 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1616/3212] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:31 2022] GET /compute/v2.1/servers/9eaf1302-c967-4a24-8772-df5b32f11a60 => generated 1470 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:31.554538 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-dd74ebf2-b19a-4daf-a537-8e0365521654 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:31.557655 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-dd74ebf2-b19a-4daf-a537-8e0365521654 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:31.576196 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dd74ebf2-b19a-4daf-a537-8e0365521654 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:31.578871 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dd74ebf2-b19a-4daf-a537-8e0365521654 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:31.579676 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dd74ebf2-b19a-4daf-a537-8e0365521654 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:31.581923 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dd74ebf2-b19a-4daf-a537-8e0365521654 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:31.583998 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dd74ebf2-b19a-4daf-a537-8e0365521654 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:31.585447 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dd74ebf2-b19a-4daf-a537-8e0365521654 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:32.210430 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-dd74ebf2-b19a-4daf-a537-8e0365521654 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:32.220083 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-dd74ebf2-b19a-4daf-a537-8e0365521654 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 0.683815 Oct 17 13:48:32.224324 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1617/3213] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:31 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:32.229305 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-afec320b-c7fd-44f2-9d82-44f1c32f80f8 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:32.244165 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-afec320b-c7fd-44f2-9d82-44f1c32f80f8 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:32.251209 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-afec320b-c7fd-44f2-9d82-44f1c32f80f8 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:32.252019 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-afec320b-c7fd-44f2-9d82-44f1c32f80f8 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:32.252648 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-afec320b-c7fd-44f2-9d82-44f1c32f80f8 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:32.253553 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-afec320b-c7fd-44f2-9d82-44f1c32f80f8 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:32.254455 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-afec320b-c7fd-44f2-9d82-44f1c32f80f8 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:32.257169 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-afec320b-c7fd-44f2-9d82-44f1c32f80f8 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:33.005267 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-afec320b-c7fd-44f2-9d82-44f1c32f80f8 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:33.034611 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-afec320b-c7fd-44f2-9d82-44f1c32f80f8 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:33.037635 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-afec320b-c7fd-44f2-9d82-44f1c32f80f8 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:33.039457 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-afec320b-c7fd-44f2-9d82-44f1c32f80f8 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1879 microversion: 2.32 time: 0.813926 Oct 17 13:48:33.055502 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1618/3214] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:32 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1879 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:48:33.074167 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9639596a-f971-4d55-ba74-4afb4687a717 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:33.076320 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9639596a-f971-4d55-ba74-4afb4687a717 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] [instance: 531b762d-db7e-4911-af50-6b321b7706bf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:33.089809 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9639596a-f971-4d55-ba74-4afb4687a717 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:33.091294 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9639596a-f971-4d55-ba74-4afb4687a717 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:33.091952 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9639596a-f971-4d55-ba74-4afb4687a717 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:33.092857 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9639596a-f971-4d55-ba74-4afb4687a717 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:33.093488 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9639596a-f971-4d55-ba74-4afb4687a717 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:33.094113 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9639596a-f971-4d55-ba74-4afb4687a717 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:34.053828 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9639596a-f971-4d55-ba74-4afb4687a717 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:34.086018 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9639596a-f971-4d55-ba74-4afb4687a717 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:34.090643 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9639596a-f971-4d55-ba74-4afb4687a717 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:34.092275 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9639596a-f971-4d55-ba74-4afb4687a717 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] 10.222.0.79 "GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf" status: 200 len: 1879 microversion: 2.42 time: 1.034299 Oct 17 13:48:34.112695 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1619/3215] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:33 2022] GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf => generated 1879 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:48:34.123806 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cb60b682-b7fc-4e70-91d3-965af31ca98b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:34.124364 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cb60b682-b7fc-4e70-91d3-965af31ca98b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9eaf1302-c967-4a24-8772-df5b32f11a60] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:34.134271 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb60b682-b7fc-4e70-91d3-965af31ca98b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:34.134874 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb60b682-b7fc-4e70-91d3-965af31ca98b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:34.135964 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb60b682-b7fc-4e70-91d3-965af31ca98b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:34.136744 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb60b682-b7fc-4e70-91d3-965af31ca98b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:34.137254 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb60b682-b7fc-4e70-91d3-965af31ca98b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:34.137684 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb60b682-b7fc-4e70-91d3-965af31ca98b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:34.291412 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cb60b682-b7fc-4e70-91d3-965af31ca98b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "POST /compute/v2.1/servers/9eaf1302-c967-4a24-8772-df5b32f11a60/action" status: 204 len: 0 microversion: 2.1 time: 0.174376 Oct 17 13:48:34.293216 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1620/3216] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:48:34 2022] POST /compute/v2.1/servers/9eaf1302-c967-4a24-8772-df5b32f11a60/action => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:48:34.299862 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b119291d-c63b-4782-8b58-08f16598d51a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:34.300860 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b119291d-c63b-4782-8b58-08f16598d51a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 68363fdf-f661-4b7c-abdc-7a8a85efa83a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:34.314434 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b119291d-c63b-4782-8b58-08f16598d51a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:34.322256 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b119291d-c63b-4782-8b58-08f16598d51a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:34.323506 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b119291d-c63b-4782-8b58-08f16598d51a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:34.324844 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b119291d-c63b-4782-8b58-08f16598d51a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:34.325608 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b119291d-c63b-4782-8b58-08f16598d51a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:34.326366 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b119291d-c63b-4782-8b58-08f16598d51a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:35.282465 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b119291d-c63b-4782-8b58-08f16598d51a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:35.291528 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b119291d-c63b-4782-8b58-08f16598d51a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a" status: 200 len: 1321 microversion: 2.1 time: 0.996681 Oct 17 13:48:35.292121 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1621/3217] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:34 2022] GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a => generated 1321 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:35.487735 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-bd470889-4459-46ae-b4fc-90b7fffd5660 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:35.488352 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-bd470889-4459-46ae-b4fc-90b7fffd5660 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:35.495852 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bd470889-4459-46ae-b4fc-90b7fffd5660 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:35.496544 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bd470889-4459-46ae-b4fc-90b7fffd5660 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:35.496973 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bd470889-4459-46ae-b4fc-90b7fffd5660 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:35.498325 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bd470889-4459-46ae-b4fc-90b7fffd5660 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:35.498768 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bd470889-4459-46ae-b4fc-90b7fffd5660 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:35.499195 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bd470889-4459-46ae-b4fc-90b7fffd5660 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:35.967388 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-bd470889-4459-46ae-b4fc-90b7fffd5660 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:35.976100 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-bd470889-4459-46ae-b4fc-90b7fffd5660 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 0.672976 Oct 17 13:48:35.990760 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1622/3218] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:35 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:35.990760 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-9cfeac35-7dce-4aa2-a44c-8f7cb9226934 req-cf421e7b-03a6-437d-a06e-68ad3549fe4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10690310-b856-4f6e-a4ea-1b771f45a75f", "tag": "d7fa4d99-108e-4a0d-8bd2-0e8856410c77"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:35.991102 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-9cfeac35-7dce-4aa2-a44c-8f7cb9226934 req-cf421e7b-03a6-437d-a06e-68ad3549fe4d service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:35.991450 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-9cfeac35-7dce-4aa2-a44c-8f7cb9226934 req-cf421e7b-03a6-437d-a06e-68ad3549fe4d service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:35.991870 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-9cfeac35-7dce-4aa2-a44c-8f7cb9226934 req-cf421e7b-03a6-437d-a06e-68ad3549fe4d service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:36.004368 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-9cfeac35-7dce-4aa2-a44c-8f7cb9226934 req-cf421e7b-03a6-437d-a06e-68ad3549fe4d service nova] Creating event network-changed:d7fa4d99-108e-4a0d-8bd2-0e8856410c77 for instance 10690310-b856-4f6e-a4ea-1b771f45a75f on n-h1-854247-14 Oct 17 13:48:36.009341 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-9cfeac35-7dce-4aa2-a44c-8f7cb9226934 req-cf421e7b-03a6-437d-a06e-68ad3549fe4d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031599 Oct 17 13:48:36.010099 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1623/3219] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:48:36.015103 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-1e58309b-b2fe-4f8c-a8fa-5edadea5e693 req-f7e98c2c-1d86-4f9d-99c8-e3ac7314416b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "531b762d-db7e-4911-af50-6b321b7706bf", "name": "network-vif-plugged", "status": "completed", "tag": "8648d762-6ec8-45e8-8c5e-e21c582b7da6"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:36.026158 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-1e58309b-b2fe-4f8c-a8fa-5edadea5e693 req-f7e98c2c-1d86-4f9d-99c8-e3ac7314416b service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:36.026723 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-1e58309b-b2fe-4f8c-a8fa-5edadea5e693 req-f7e98c2c-1d86-4f9d-99c8-e3ac7314416b service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:36.028232 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-1e58309b-b2fe-4f8c-a8fa-5edadea5e693 req-f7e98c2c-1d86-4f9d-99c8-e3ac7314416b service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:36.040770 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-1e58309b-b2fe-4f8c-a8fa-5edadea5e693 req-f7e98c2c-1d86-4f9d-99c8-e3ac7314416b service nova] Creating event network-vif-plugged:8648d762-6ec8-45e8-8c5e-e21c582b7da6 for instance 531b762d-db7e-4911-af50-6b321b7706bf on n-h1-854247-14 Oct 17 13:48:36.046130 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-1e58309b-b2fe-4f8c-a8fa-5edadea5e693 req-f7e98c2c-1d86-4f9d-99c8-e3ac7314416b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034715 Oct 17 13:48:36.046786 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1624/3220] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:48:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:48:36.053125 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-03d7d8c4-b4d9-4dbe-8911-b7646cfe8f56 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:36.053696 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-03d7d8c4-b4d9-4dbe-8911-b7646cfe8f56 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: a2994495-366a-446f-b7a6-16340911e17c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:36.063137 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-03d7d8c4-b4d9-4dbe-8911-b7646cfe8f56 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:36.063818 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-03d7d8c4-b4d9-4dbe-8911-b7646cfe8f56 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:36.064490 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-03d7d8c4-b4d9-4dbe-8911-b7646cfe8f56 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:36.065379 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-03d7d8c4-b4d9-4dbe-8911-b7646cfe8f56 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:36.066755 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-03d7d8c4-b4d9-4dbe-8911-b7646cfe8f56 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:36.067382 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-03d7d8c4-b4d9-4dbe-8911-b7646cfe8f56 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:36.109822 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-03d7d8c4-b4d9-4dbe-8911-b7646cfe8f56 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c/ips" status: 200 len: 145 microversion: 2.1 time: 0.054499 Oct 17 13:48:36.109822 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1625/3221] 10.222.0.79 () {58 vars in 1248 bytes} [Mon Oct 17 13:48:36 2022] GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c/ips => generated 145 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:48:36.111597 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cad4f0f4-1c3c-4ad3-8930-4e47e3aa72ae tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:36.112598 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cad4f0f4-1c3c-4ad3-8930-4e47e3aa72ae tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:36.120565 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cad4f0f4-1c3c-4ad3-8930-4e47e3aa72ae tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:36.121156 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cad4f0f4-1c3c-4ad3-8930-4e47e3aa72ae tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:36.121847 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cad4f0f4-1c3c-4ad3-8930-4e47e3aa72ae tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:36.122570 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cad4f0f4-1c3c-4ad3-8930-4e47e3aa72ae tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:36.125068 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cad4f0f4-1c3c-4ad3-8930-4e47e3aa72ae tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:36.125730 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cad4f0f4-1c3c-4ad3-8930-4e47e3aa72ae tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:36.401009 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d6836920-c2e7-4df9-a522-0b148a58fe0d tempest-FloatingIPDetailsTestJSON-589486563 tempest-FloatingIPDetailsTestJSON-589486563-project] 10.222.0.79 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.115617 Oct 17 13:48:36.410597 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1597/3222] 10.222.0.79 () {60 vars in 1170 bytes} [Mon Oct 17 13:48:30 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:48:36.416620 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-509d1c29-7477-4f67-b954-be81c39c5b83 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:36.417379 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-509d1c29-7477-4f67-b954-be81c39c5b83 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9eaf1302-c967-4a24-8772-df5b32f11a60] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:36.424429 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-509d1c29-7477-4f67-b954-be81c39c5b83 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:36.424967 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-509d1c29-7477-4f67-b954-be81c39c5b83 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:36.425399 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-509d1c29-7477-4f67-b954-be81c39c5b83 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:36.426333 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-509d1c29-7477-4f67-b954-be81c39c5b83 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:36.426795 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-509d1c29-7477-4f67-b954-be81c39c5b83 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:36.427246 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-509d1c29-7477-4f67-b954-be81c39c5b83 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:36.459385 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cad4f0f4-1c3c-4ad3-8930-4e47e3aa72ae tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:36.480911 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cad4f0f4-1c3c-4ad3-8930-4e47e3aa72ae tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:36.484663 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cad4f0f4-1c3c-4ad3-8930-4e47e3aa72ae tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:36.486442 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cad4f0f4-1c3c-4ad3-8930-4e47e3aa72ae tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1879 microversion: 2.32 time: 0.380740 Oct 17 13:48:36.487595 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1626/3223] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:36 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1879 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:48:36.494554 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-c8b56cc2-0ac7-4f7c-a6ec-5f226f815304 req-83b8f540-cbee-439d-b630-3ceee0b2e663 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68363fdf-f661-4b7c-abdc-7a8a85efa83a", "tag": "911f2c55-5cc0-40f4-bc39-8c329a19fc67"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:36.515539 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-c8b56cc2-0ac7-4f7c-a6ec-5f226f815304 req-83b8f540-cbee-439d-b630-3ceee0b2e663 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:36.516137 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-c8b56cc2-0ac7-4f7c-a6ec-5f226f815304 req-83b8f540-cbee-439d-b630-3ceee0b2e663 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:36.516589 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-c8b56cc2-0ac7-4f7c-a6ec-5f226f815304 req-83b8f540-cbee-439d-b630-3ceee0b2e663 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:36.534320 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-c8b56cc2-0ac7-4f7c-a6ec-5f226f815304 req-83b8f540-cbee-439d-b630-3ceee0b2e663 service nova] Creating event network-changed:911f2c55-5cc0-40f4-bc39-8c329a19fc67 for instance 68363fdf-f661-4b7c-abdc-7a8a85efa83a on n-h2-854247-14 Oct 17 13:48:36.540638 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-c8b56cc2-0ac7-4f7c-a6ec-5f226f815304 req-83b8f540-cbee-439d-b630-3ceee0b2e663 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051279 Oct 17 13:48:36.541350 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1627/3224] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:48:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:48:36.548248 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a9c9abff-3b3f-45c3-9777-37d353827e79 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:36.549242 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a9c9abff-3b3f-45c3-9777-37d353827e79 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] [instance: 531b762d-db7e-4911-af50-6b321b7706bf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:36.556370 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a9c9abff-3b3f-45c3-9777-37d353827e79 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:36.557071 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a9c9abff-3b3f-45c3-9777-37d353827e79 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:36.557743 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a9c9abff-3b3f-45c3-9777-37d353827e79 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:36.558841 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a9c9abff-3b3f-45c3-9777-37d353827e79 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:36.559537 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a9c9abff-3b3f-45c3-9777-37d353827e79 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:36.560120 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a9c9abff-3b3f-45c3-9777-37d353827e79 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:37.371386 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-509d1c29-7477-4f67-b954-be81c39c5b83 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:37.384215 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-509d1c29-7477-4f67-b954-be81c39c5b83 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/9eaf1302-c967-4a24-8772-df5b32f11a60" status: 200 len: 1470 microversion: 2.1 time: 0.972005 Oct 17 13:48:37.384844 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1598/3225] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:36 2022] GET /compute/v2.1/servers/9eaf1302-c967-4a24-8772-df5b32f11a60 => generated 1470 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:37.390558 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-246966c9-14d7-4b45-b766-a996c9410592 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:37.391462 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-246966c9-14d7-4b45-b766-a996c9410592 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 1abf4c76-24ee-4309-bf68-f429f7957e9e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:37.399329 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-246966c9-14d7-4b45-b766-a996c9410592 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] HTTP exception thrown: Instance 1abf4c76-24ee-4309-bf68-f429f7957e9e could not be found. Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-246966c9-14d7-4b45-b766-a996c9410592 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Request method failure captured: Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: request: POST /compute/v2.1/servers/1abf4c76-24ee-4309-bf68-f429f7957e9e/action HTTP/1.1 Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 18 Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVwEqzYAZh4AkEjRryOAZIhaHrAKxd2Qcal9md8a5n-MMUYSdXmcWYLDVkyQoPrDIbcsApBq2EewemPkBwvNDDOidb0hhc_Z3w9BeEUj5ET_flLYPqO5hgqCsuZGXFiYIEBJxrkx614fXiELZHaNkvhSdsJHShK0w7L-UPHhkPKqi5M Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_59e65f6eb06d40d583b9f43c9af94c13", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 443c44b0bd9e4c56a7fe0c1a53238545 Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: {"unshelve": null} Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 1abf4c76-24ee-4309-bf68-f429f7957e9e could not be found. Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '1abf4c76-24ee-4309-bf68-f429f7957e9e', 'body': {'unshelve': None}} Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1abf4c76-24ee-4309-bf68-f429f7957e9e could not be found. Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1abf4c76-24ee-4309-bf68-f429f7957e9e could not be found. Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:48:37.403273 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:48:37.410287 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:48:37.410287 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:48:37.410287 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:48:37.410287 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:48:37.410287 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:48:37.410287 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:48:37.410287 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1abf4c76-24ee-4309-bf68-f429f7957e9e could not be found. Oct 17 13:48:37.410287 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:48:37.410287 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-246966c9-14d7-4b45-b766-a996c9410592 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Returning 404 to user: Instance 1abf4c76-24ee-4309-bf68-f429f7957e9e could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:48:37.410287 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-246966c9-14d7-4b45-b766-a996c9410592 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "POST /compute/v2.1/servers/1abf4c76-24ee-4309-bf68-f429f7957e9e/action" status: 404 len: 111 microversion: 2.1 time: 0.019496 Oct 17 13:48:37.412480 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1599/3226] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:48:37 2022] POST /compute/v2.1/servers/1abf4c76-24ee-4309-bf68-f429f7957e9e/action => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:48:37.418844 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1e8e211d-5fdc-409f-bc28-d21a9b90d215 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:37.419526 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1e8e211d-5fdc-409f-bc28-d21a9b90d215 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 68363fdf-f661-4b7c-abdc-7a8a85efa83a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:37.427665 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1e8e211d-5fdc-409f-bc28-d21a9b90d215 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:37.428913 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1e8e211d-5fdc-409f-bc28-d21a9b90d215 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:37.429561 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1e8e211d-5fdc-409f-bc28-d21a9b90d215 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:37.430458 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1e8e211d-5fdc-409f-bc28-d21a9b90d215 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:37.431020 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1e8e211d-5fdc-409f-bc28-d21a9b90d215 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:37.431737 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1e8e211d-5fdc-409f-bc28-d21a9b90d215 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:37.459431 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a9c9abff-3b3f-45c3-9777-37d353827e79 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:37.474070 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a9c9abff-3b3f-45c3-9777-37d353827e79 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:37.475529 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a9c9abff-3b3f-45c3-9777-37d353827e79 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:37.476837 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a9c9abff-3b3f-45c3-9777-37d353827e79 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] 10.222.0.79 "GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf" status: 200 len: 1879 microversion: 2.42 time: 0.934143 Oct 17 13:48:37.495546 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1628/3227] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:36 2022] GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf => generated 1879 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:48:37.501167 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3c27582e-da3d-4966-a2ea-6b956d90fe2a tempest-FloatingIPDetailsTestJSON-589486563 tempest-FloatingIPDetailsTestJSON-589486563-project] Action: 'create', calling method: .version_select at 0x7f7cd4494280>, body: {"pool": null} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:38.080280 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1e8e211d-5fdc-409f-bc28-d21a9b90d215 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:38.089451 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1e8e211d-5fdc-409f-bc28-d21a9b90d215 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a" status: 200 len: 1321 microversion: 2.1 time: 0.675162 Oct 17 13:48:38.107079 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1600/3228] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:37 2022] GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a => generated 1321 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:38.115978 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-572368f3-79e7-49e2-8e7f-93a28d1e58a8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:38.116986 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-572368f3-79e7-49e2-8e7f-93a28d1e58a8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:38.124498 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-572368f3-79e7-49e2-8e7f-93a28d1e58a8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:38.125193 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-572368f3-79e7-49e2-8e7f-93a28d1e58a8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:38.125793 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-572368f3-79e7-49e2-8e7f-93a28d1e58a8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:38.126693 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-572368f3-79e7-49e2-8e7f-93a28d1e58a8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:38.127420 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-572368f3-79e7-49e2-8e7f-93a28d1e58a8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:38.128010 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-572368f3-79e7-49e2-8e7f-93a28d1e58a8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:38.681072 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-572368f3-79e7-49e2-8e7f-93a28d1e58a8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:38.692796 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-572368f3-79e7-49e2-8e7f-93a28d1e58a8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 0.584092 Oct 17 13:48:38.708998 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1601/3229] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:38 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:38.723042 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-16b4f650-6e87-4eb5-95cb-aa5d426cc1ba tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:38.724050 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-16b4f650-6e87-4eb5-95cb-aa5d426cc1ba tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:38.732754 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-16b4f650-6e87-4eb5-95cb-aa5d426cc1ba tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:38.733556 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-16b4f650-6e87-4eb5-95cb-aa5d426cc1ba tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:38.733999 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-16b4f650-6e87-4eb5-95cb-aa5d426cc1ba tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:38.734716 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-16b4f650-6e87-4eb5-95cb-aa5d426cc1ba tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:38.735191 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-16b4f650-6e87-4eb5-95cb-aa5d426cc1ba tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:38.735616 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-16b4f650-6e87-4eb5-95cb-aa5d426cc1ba tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:39.104826 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-16b4f650-6e87-4eb5-95cb-aa5d426cc1ba tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:39.116777 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-16b4f650-6e87-4eb5-95cb-aa5d426cc1ba tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:39.118641 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-16b4f650-6e87-4eb5-95cb-aa5d426cc1ba tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:39.120034 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-16b4f650-6e87-4eb5-95cb-aa5d426cc1ba tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1879 microversion: 2.32 time: 0.409109 Oct 17 13:48:39.120900 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1602/3230] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:38 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1879 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:48:39.125669 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-63a09999-826c-46a4-9e4f-47f337856ba1 req-e71a0440-3a12-441f-b995-7a57bba91fc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2", "tag": "fac894e0-9d90-47af-ad82-0c669f0a03f4"}, {"name": "network-changed", "server_uuid": "33de8199-8f00-40eb-9b95-b7ab5289dbe3", "tag": "2205d7dd-1b32-4750-962d-deadba8d5369"}, {"name": "network-changed", "server_uuid": "6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2", "tag": "c69dd4d3-7f9e-45b5-92dc-71c0e0407b40"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:39.138895 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-63a09999-826c-46a4-9e4f-47f337856ba1 req-e71a0440-3a12-441f-b995-7a57bba91fc6 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:39.139577 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-63a09999-826c-46a4-9e4f-47f337856ba1 req-e71a0440-3a12-441f-b995-7a57bba91fc6 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:39.140288 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-63a09999-826c-46a4-9e4f-47f337856ba1 req-e71a0440-3a12-441f-b995-7a57bba91fc6 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:39.155049 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-63a09999-826c-46a4-9e4f-47f337856ba1 req-e71a0440-3a12-441f-b995-7a57bba91fc6 service nova] Creating event network-changed:fac894e0-9d90-47af-ad82-0c669f0a03f4 for instance 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 on n-h1-854247-14 Oct 17 13:48:39.155585 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-63a09999-826c-46a4-9e4f-47f337856ba1 req-e71a0440-3a12-441f-b995-7a57bba91fc6 service nova] Creating event network-changed:2205d7dd-1b32-4750-962d-deadba8d5369 for instance 33de8199-8f00-40eb-9b95-b7ab5289dbe3 on n-h2-854247-14 Oct 17 13:48:39.156088 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-63a09999-826c-46a4-9e4f-47f337856ba1 req-e71a0440-3a12-441f-b995-7a57bba91fc6 service nova] Creating event network-changed:c69dd4d3-7f9e-45b5-92dc-71c0e0407b40 for instance 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 on n-h1-854247-14 Oct 17 13:48:39.164743 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-63a09999-826c-46a4-9e4f-47f337856ba1 req-e71a0440-3a12-441f-b995-7a57bba91fc6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.042509 Oct 17 13:48:39.165454 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1603/3231] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:48:39.170478 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-35633455-0306-4a65-9b0e-2f05fa1e783b req-2c147b1b-dd04-477d-ba70-0920d7624cfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "531b762d-db7e-4911-af50-6b321b7706bf", "name": "network-vif-plugged", "status": "completed", "tag": "9c9d5dd0-a8f0-41f1-bc68-e9fb795e1870"}, {"server_uuid": "531b762d-db7e-4911-af50-6b321b7706bf", "name": "network-vif-plugged", "status": "completed", "tag": "6f4cb81d-8d1e-46b5-be9e-808d081260d5"}, {"server_uuid": "531b762d-db7e-4911-af50-6b321b7706bf", "name": "network-vif-plugged", "status": "completed", "tag": "97144afc-d9c2-4725-92c7-3d7418acb203"}, {"server_uuid": "9eaf1302-c967-4a24-8772-df5b32f11a60", "name": "network-vif-plugged", "status": "completed", "tag": "1629935f-cce8-40f2-bbc7-1ee779fadbb9"}, {"server_uuid": "531b762d-db7e-4911-af50-6b321b7706bf", "name": "network-vif-plugged", "status": "completed", "tag": "2ed852ff-90cb-44a1-8401-734cba5bea03"}, {"server_uuid": "531b762d-db7e-4911-af50-6b321b7706bf", "name": "network-vif-plugged", "status": "completed", "tag": "13d96c52-0581-49ee-acc7-7c007590f889"}, {"server_uuid": "531b762d-db7e-4911-af50-6b321b7706bf", "name": "network-vif-plugged", "status": "completed", "tag": "54e2aa0d-ebff-4ff5-a88b-865d4f0e8386"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:39.185307 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-35633455-0306-4a65-9b0e-2f05fa1e783b req-2c147b1b-dd04-477d-ba70-0920d7624cfe service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:39.185813 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-35633455-0306-4a65-9b0e-2f05fa1e783b req-2c147b1b-dd04-477d-ba70-0920d7624cfe service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:39.186276 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-35633455-0306-4a65-9b0e-2f05fa1e783b req-2c147b1b-dd04-477d-ba70-0920d7624cfe service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:39.201989 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-35633455-0306-4a65-9b0e-2f05fa1e783b req-2c147b1b-dd04-477d-ba70-0920d7624cfe service nova] Creating event network-vif-plugged:9c9d5dd0-a8f0-41f1-bc68-e9fb795e1870 for instance 531b762d-db7e-4911-af50-6b321b7706bf on n-h1-854247-14 Oct 17 13:48:39.202490 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-35633455-0306-4a65-9b0e-2f05fa1e783b req-2c147b1b-dd04-477d-ba70-0920d7624cfe service nova] Creating event network-vif-plugged:6f4cb81d-8d1e-46b5-be9e-808d081260d5 for instance 531b762d-db7e-4911-af50-6b321b7706bf on n-h1-854247-14 Oct 17 13:48:39.202999 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-35633455-0306-4a65-9b0e-2f05fa1e783b req-2c147b1b-dd04-477d-ba70-0920d7624cfe service nova] Creating event network-vif-plugged:97144afc-d9c2-4725-92c7-3d7418acb203 for instance 531b762d-db7e-4911-af50-6b321b7706bf on n-h1-854247-14 Oct 17 13:48:39.203528 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-35633455-0306-4a65-9b0e-2f05fa1e783b req-2c147b1b-dd04-477d-ba70-0920d7624cfe service nova] Creating event network-vif-plugged:1629935f-cce8-40f2-bbc7-1ee779fadbb9 for instance 9eaf1302-c967-4a24-8772-df5b32f11a60 on n-h2-854247-14 Oct 17 13:48:39.204028 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-35633455-0306-4a65-9b0e-2f05fa1e783b req-2c147b1b-dd04-477d-ba70-0920d7624cfe service nova] Creating event network-vif-plugged:2ed852ff-90cb-44a1-8401-734cba5bea03 for instance 531b762d-db7e-4911-af50-6b321b7706bf on n-h1-854247-14 Oct 17 13:48:39.204523 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-35633455-0306-4a65-9b0e-2f05fa1e783b req-2c147b1b-dd04-477d-ba70-0920d7624cfe service nova] Creating event network-vif-plugged:13d96c52-0581-49ee-acc7-7c007590f889 for instance 531b762d-db7e-4911-af50-6b321b7706bf on n-h1-854247-14 Oct 17 13:48:39.205048 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-35633455-0306-4a65-9b0e-2f05fa1e783b req-2c147b1b-dd04-477d-ba70-0920d7624cfe service nova] Creating event network-vif-plugged:54e2aa0d-ebff-4ff5-a88b-865d4f0e8386 for instance 531b762d-db7e-4911-af50-6b321b7706bf on n-h1-854247-14 Oct 17 13:48:39.213941 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [req-35633455-0306-4a65-9b0e-2f05fa1e783b req-2c147b1b-dd04-477d-ba70-0920d7624cfe service nova] Instance 9eaf1302-c967-4a24-8772-df5b32f11a60 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854247-14'} {{(pid=127017) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:48:39.224442 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-35633455-0306-4a65-9b0e-2f05fa1e783b req-2c147b1b-dd04-477d-ba70-0920d7624cfe service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1209 microversion: 2.1 time: 0.057654 Oct 17 13:48:39.225056 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1604/3232] 10.222.0.79 () {64 vars in 1318 bytes} [Mon Oct 17 13:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 1209 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:39.229964 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1c4ebcf2-d498-47ab-8e9a-fd303563b8ac tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:39.230736 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1c4ebcf2-d498-47ab-8e9a-fd303563b8ac tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9eaf1302-c967-4a24-8772-df5b32f11a60] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:39.236911 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c4ebcf2-d498-47ab-8e9a-fd303563b8ac tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:39.237395 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c4ebcf2-d498-47ab-8e9a-fd303563b8ac tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:39.237828 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c4ebcf2-d498-47ab-8e9a-fd303563b8ac tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:39.238525 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c4ebcf2-d498-47ab-8e9a-fd303563b8ac tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:39.238979 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c4ebcf2-d498-47ab-8e9a-fd303563b8ac tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:39.239447 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c4ebcf2-d498-47ab-8e9a-fd303563b8ac tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:39.394552 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=4 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:48:39.421976 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=12 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:48:39.898341 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1c4ebcf2-d498-47ab-8e9a-fd303563b8ac tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:39.904413 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=100 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:48:39.913894 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1c4ebcf2-d498-47ab-8e9a-fd303563b8ac tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/9eaf1302-c967-4a24-8772-df5b32f11a60" status: 200 len: 1470 microversion: 2.1 time: 0.687664 Oct 17 13:48:39.915382 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1605/3233] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:39 2022] GET /compute/v2.1/servers/9eaf1302-c967-4a24-8772-df5b32f11a60 => generated 1470 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:39.927686 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-852cb32b-14e8-47eb-84d9-2f745ce6920e tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:39.928697 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-852cb32b-14e8-47eb-84d9-2f745ce6920e tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] [instance: 531b762d-db7e-4911-af50-6b321b7706bf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:39.935531 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-852cb32b-14e8-47eb-84d9-2f745ce6920e tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:39.936235 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-852cb32b-14e8-47eb-84d9-2f745ce6920e tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:39.936882 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-852cb32b-14e8-47eb-84d9-2f745ce6920e tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:39.937888 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-852cb32b-14e8-47eb-84d9-2f745ce6920e tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:39.938489 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-852cb32b-14e8-47eb-84d9-2f745ce6920e tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:39.939709 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-852cb32b-14e8-47eb-84d9-2f745ce6920e tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:40.410964 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-852cb32b-14e8-47eb-84d9-2f745ce6920e tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:40.421725 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-852cb32b-14e8-47eb-84d9-2f745ce6920e tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:40.423611 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-852cb32b-14e8-47eb-84d9-2f745ce6920e tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:40.424885 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-852cb32b-14e8-47eb-84d9-2f745ce6920e tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] 10.222.0.79 "GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf" status: 200 len: 1879 microversion: 2.42 time: 0.508307 Oct 17 13:48:40.425433 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1606/3234] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:39 2022] GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf => generated 1879 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:48:40.443253 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2d9ad5fd-2bdd-4bdf-9659-f1c6480119b8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:40.443862 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2d9ad5fd-2bdd-4bdf-9659-f1c6480119b8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:40.450736 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2d9ad5fd-2bdd-4bdf-9659-f1c6480119b8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:40.451274 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2d9ad5fd-2bdd-4bdf-9659-f1c6480119b8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:40.451956 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2d9ad5fd-2bdd-4bdf-9659-f1c6480119b8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:40.452682 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2d9ad5fd-2bdd-4bdf-9659-f1c6480119b8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:40.453139 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2d9ad5fd-2bdd-4bdf-9659-f1c6480119b8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:40.453575 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2d9ad5fd-2bdd-4bdf-9659-f1c6480119b8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:40.896151 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2d9ad5fd-2bdd-4bdf-9659-f1c6480119b8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:40.904572 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2d9ad5fd-2bdd-4bdf-9659-f1c6480119b8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 0.478182 Oct 17 13:48:40.905869 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1607/3235] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:40 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:40.911347 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-48c4c454-3f19-4b92-b958-ff270ea1ff04 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "edb8305e-d5a4-4644-a658-6f4b41170760"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:40.914080 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-48c4c454-3f19-4b92-b958-ff270ea1ff04 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: a2994495-366a-446f-b7a6-16340911e17c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:40.920352 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48c4c454-3f19-4b92-b958-ff270ea1ff04 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:40.920855 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48c4c454-3f19-4b92-b958-ff270ea1ff04 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:40.921276 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48c4c454-3f19-4b92-b958-ff270ea1ff04 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:40.922206 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48c4c454-3f19-4b92-b958-ff270ea1ff04 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:40.922856 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48c4c454-3f19-4b92-b958-ff270ea1ff04 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:40.923367 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48c4c454-3f19-4b92-b958-ff270ea1ff04 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:41.110044 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3c27582e-da3d-4966-a2ea-6b956d90fe2a tempest-FloatingIPDetailsTestJSON-589486563 tempest-FloatingIPDetailsTestJSON-589486563-project] 10.222.0.79 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.612736 Oct 17 13:48:41.112555 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1629/3236] 10.222.0.79 () {60 vars in 1170 bytes} [Mon Oct 17 13:48:37 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3616 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:48:41.117409 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-76163fac-26a5-4da3-be39-6488f75d2e7a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:41.118101 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-76163fac-26a5-4da3-be39-6488f75d2e7a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 68363fdf-f661-4b7c-abdc-7a8a85efa83a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:41.124835 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-76163fac-26a5-4da3-be39-6488f75d2e7a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:41.125310 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-76163fac-26a5-4da3-be39-6488f75d2e7a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:41.126031 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-76163fac-26a5-4da3-be39-6488f75d2e7a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:41.127291 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-76163fac-26a5-4da3-be39-6488f75d2e7a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:41.128059 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-76163fac-26a5-4da3-be39-6488f75d2e7a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:41.128695 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-76163fac-26a5-4da3-be39-6488f75d2e7a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:41.221396 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-48c4c454-3f19-4b92-b958-ff270ea1ff04 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "POST /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.313672 Oct 17 13:48:41.221940 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1608/3237] 10.222.0.79 () {60 vars in 1323 bytes} [Mon Oct 17 13:48:40 2022] POST /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c/os-volume_attachments => generated 194 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:48:41.228817 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-39ce6305-3b40-46fb-baaa-6d7148473ca4 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:41.230441 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-39ce6305-3b40-46fb-baaa-6d7148473ca4 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:41.240968 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-39ce6305-3b40-46fb-baaa-6d7148473ca4 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:41.242737 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-39ce6305-3b40-46fb-baaa-6d7148473ca4 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:41.243766 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-39ce6305-3b40-46fb-baaa-6d7148473ca4 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:41.245566 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-39ce6305-3b40-46fb-baaa-6d7148473ca4 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:41.247083 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-39ce6305-3b40-46fb-baaa-6d7148473ca4 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:41.247955 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-39ce6305-3b40-46fb-baaa-6d7148473ca4 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:41.436534 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-76163fac-26a5-4da3-be39-6488f75d2e7a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:41.446815 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-76163fac-26a5-4da3-be39-6488f75d2e7a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a" status: 200 len: 1321 microversion: 2.1 time: 0.332449 Oct 17 13:48:41.447592 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1630/3238] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:41 2022] GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a => generated 1321 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:41.454703 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f1214d68-62ce-45d0-a80b-1e496cc34f27 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:41.456346 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f1214d68-62ce-45d0-a80b-1e496cc34f27 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:41.463576 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1214d68-62ce-45d0-a80b-1e496cc34f27 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:41.464354 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1214d68-62ce-45d0-a80b-1e496cc34f27 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:41.464881 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1214d68-62ce-45d0-a80b-1e496cc34f27 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:41.465686 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1214d68-62ce-45d0-a80b-1e496cc34f27 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:41.466210 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1214d68-62ce-45d0-a80b-1e496cc34f27 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:41.466692 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1214d68-62ce-45d0-a80b-1e496cc34f27 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:41.495548 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-f1214d68-62ce-45d0-a80b-1e496cc34f27 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] HTTP exception thrown: Cannot 'unshelve' instance 5ef00d34-7f81-4649-a90a-a52cf78dbeca while it is in vm_state active Oct 17 13:48:41.497389 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f1214d68-62ce-45d0-a80b-1e496cc34f27 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Request method failure captured: Oct 17 13:48:41.497389 n-d-854247-14 devstack@n-api.service[127016]: request: POST /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca/action HTTP/1.1 Oct 17 13:48:41.497389 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:48:41.497389 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:48:41.497389 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:48:41.497389 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 18 Oct 17 13:48:41.497389 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:48:41.497389 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:48:41.497389 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:48:41.497389 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:48:41.497389 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVwEqzYAZh4AkEjRryOAZIhaHrAKxd2Qcal9md8a5n-MMUYSdXmcWYLDVkyQoPrDIbcsApBq2EewemPkBwvNDDOidb0hhc_Z3w9BeEUj5ET_flLYPqO5hgqCsuZGXFiYIEBJxrkx614fXiELZHaNkvhSdsJHShK0w7L-UPHhkPKqi5M Oct 17 13:48:41.497389 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:48:41.497389 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:48:41.497389 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:48:41.497389 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:48:41.497389 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:48:41.497389 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:48:41.497389 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:48:41.497389 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:48:41.497389 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:48:41.497389 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:48:41.497389 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_59e65f6eb06d40d583b9f43c9af94c13", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:48:41.497389 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:48:41.497389 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:48:41.497389 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:48:41.497389 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:48:41.497389 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:48:41.497389 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:48:41.497389 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 443c44b0bd9e4c56a7fe0c1a53238545 Oct 17 13:48:41.497389 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:48:41.497389 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:48:41.497389 n-d-854247-14 devstack@n-api.service[127016]: {"unshelve": null} Oct 17 13:48:41.497389 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:48:41.497389 n-d-854247-14 devstack@n-api.service[127016]: exception: Cannot 'unshelve' instance 5ef00d34-7f81-4649-a90a-a52cf78dbeca while it is in vm_state active Oct 17 13:48:41.497389 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '5ef00d34-7f81-4649-a90a-a52cf78dbeca', 'body': {'unshelve': None}} Oct 17 13:48:41.497389 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:48:41.497389 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:48:41.497389 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 17 13:48:41.497389 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 17 13:48:41.497389 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 17 13:48:41.497389 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:48:41.497389 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 13:48:41.497389 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:48:41.497389 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 13:48:41.497389 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 13:48:41.497389 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5ef00d34-7f81-4649-a90a-a52cf78dbeca in vm_state active. Cannot unshelve while the instance is in this state. Oct 17 13:48:41.497389 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:48:41.497389 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:48:41.497389 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:48:41.497389 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:48:41.497389 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:48:41.497389 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:48:41.497389 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:48:41.497389 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:48:41.497389 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:48:41.497389 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:48:41.497389 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:48:41.497389 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:48:41.497389 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:48:41.497389 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:48:41.497389 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 17 13:48:41.497389 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 17 13:48:41.497389 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 13:48:41.497389 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 13:48:41.501654 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 5ef00d34-7f81-4649-a90a-a52cf78dbeca while it is in vm_state active Oct 17 13:48:41.501654 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:48:41.501654 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:48:41.501654 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:48:41.501654 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:48:41.501654 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:48:41.501654 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:48:41.501654 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:48:41.501654 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:48:41.501654 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 5ef00d34-7f81-4649-a90a-a52cf78dbeca while it is in vm_state active Oct 17 13:48:41.501654 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:48:41.501654 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f1214d68-62ce-45d0-a80b-1e496cc34f27 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Returning 409 to user: Cannot 'unshelve' instance 5ef00d34-7f81-4649-a90a-a52cf78dbeca while it is in vm_state active {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:48:41.501654 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f1214d68-62ce-45d0-a80b-1e496cc34f27 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "POST /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca/action" status: 409 len: 146 microversion: 2.1 time: 0.048852 Oct 17 13:48:41.501654 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1631/3239] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:48:41 2022] POST /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca/action => generated 146 bytes in 51 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:48:41.506640 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f90c69dc-4d40-4e5c-bbaa-7c0e58db9820 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:41.507362 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f90c69dc-4d40-4e5c-bbaa-7c0e58db9820 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9eaf1302-c967-4a24-8772-df5b32f11a60] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:41.513620 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f90c69dc-4d40-4e5c-bbaa-7c0e58db9820 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:41.514178 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f90c69dc-4d40-4e5c-bbaa-7c0e58db9820 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:41.514677 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f90c69dc-4d40-4e5c-bbaa-7c0e58db9820 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:41.515530 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f90c69dc-4d40-4e5c-bbaa-7c0e58db9820 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:41.516074 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f90c69dc-4d40-4e5c-bbaa-7c0e58db9820 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:41.516556 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f90c69dc-4d40-4e5c-bbaa-7c0e58db9820 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:41.629606 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-39ce6305-3b40-46fb-baaa-6d7148473ca4 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:41.641066 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-39ce6305-3b40-46fb-baaa-6d7148473ca4 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:41.642799 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-39ce6305-3b40-46fb-baaa-6d7148473ca4 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:41.644055 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-39ce6305-3b40-46fb-baaa-6d7148473ca4 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1879 microversion: 2.32 time: 0.420751 Oct 17 13:48:41.644586 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1609/3240] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:41 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1879 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:48:41.651531 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d182b353-ba9c-42c9-b6a6-b4603be0400d tempest-FloatingIPDetailsTestJSON-589486563 tempest-FloatingIPDetailsTestJSON-589486563-project] Action: 'create', calling method: .version_select at 0x7f7cd5a245e0>, body: {"pool": null} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:41.838646 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f90c69dc-4d40-4e5c-bbaa-7c0e58db9820 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:41.848052 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f90c69dc-4d40-4e5c-bbaa-7c0e58db9820 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/9eaf1302-c967-4a24-8772-df5b32f11a60" status: 200 len: 1462 microversion: 2.1 time: 0.347652 Oct 17 13:48:41.849811 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1632/3241] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:41 2022] GET /compute/v2.1/servers/9eaf1302-c967-4a24-8772-df5b32f11a60 => generated 1462 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:41.855311 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-18f962ae-6ad6-4d66-8f8f-837a8f38ca97 req-292b19a3-476d-401f-b793-01f50c64ee36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2", "tag": "8fdca276-a9c8-4e30-8e15-4fc42ba37e91"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:41.866002 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=94 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:48:41.870971 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-18f962ae-6ad6-4d66-8f8f-837a8f38ca97 req-292b19a3-476d-401f-b793-01f50c64ee36 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:41.871971 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-18f962ae-6ad6-4d66-8f8f-837a8f38ca97 req-292b19a3-476d-401f-b793-01f50c64ee36 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:41.876132 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-18f962ae-6ad6-4d66-8f8f-837a8f38ca97 req-292b19a3-476d-401f-b793-01f50c64ee36 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:41.904143 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-18f962ae-6ad6-4d66-8f8f-837a8f38ca97 req-292b19a3-476d-401f-b793-01f50c64ee36 service nova] Creating event network-changed:8fdca276-a9c8-4e30-8e15-4fc42ba37e91 for instance 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 on n-h1-854247-14 Oct 17 13:48:41.915317 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-18f962ae-6ad6-4d66-8f8f-837a8f38ca97 req-292b19a3-476d-401f-b793-01f50c64ee36 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063835 Oct 17 13:48:41.916660 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1633/3242] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:48:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:48:41.925224 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-6d478070-c82a-45fa-bc73-f05ddfa66073 req-71852f27-d9c5-4438-b940-e3f44732c924 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68363fdf-f661-4b7c-abdc-7a8a85efa83a", "name": "network-vif-plugged", "status": "completed", "tag": "911f2c55-5cc0-40f4-bc39-8c329a19fc67"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:41.935145 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-6d478070-c82a-45fa-bc73-f05ddfa66073 req-71852f27-d9c5-4438-b940-e3f44732c924 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:41.935661 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-6d478070-c82a-45fa-bc73-f05ddfa66073 req-71852f27-d9c5-4438-b940-e3f44732c924 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:41.936258 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-6d478070-c82a-45fa-bc73-f05ddfa66073 req-71852f27-d9c5-4438-b940-e3f44732c924 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:41.950312 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-6d478070-c82a-45fa-bc73-f05ddfa66073 req-71852f27-d9c5-4438-b940-e3f44732c924 service nova] Creating event network-vif-plugged:911f2c55-5cc0-40f4-bc39-8c329a19fc67 for instance 68363fdf-f661-4b7c-abdc-7a8a85efa83a on n-h2-854247-14 Oct 17 13:48:41.955474 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-6d478070-c82a-45fa-bc73-f05ddfa66073 req-71852f27-d9c5-4438-b940-e3f44732c924 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037155 Oct 17 13:48:41.956415 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1634/3243] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:48:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:48:41.962252 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cc703ed0-ddbf-46ff-9c31-13691d9af70e tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:41.962994 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cc703ed0-ddbf-46ff-9c31-13691d9af70e tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] [instance: 531b762d-db7e-4911-af50-6b321b7706bf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:41.969750 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cc703ed0-ddbf-46ff-9c31-13691d9af70e tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:41.970240 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cc703ed0-ddbf-46ff-9c31-13691d9af70e tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:41.970737 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cc703ed0-ddbf-46ff-9c31-13691d9af70e tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:41.971785 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cc703ed0-ddbf-46ff-9c31-13691d9af70e tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:41.972244 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cc703ed0-ddbf-46ff-9c31-13691d9af70e tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:41.972818 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cc703ed0-ddbf-46ff-9c31-13691d9af70e tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:41.978142 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:48:42.476013 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cc703ed0-ddbf-46ff-9c31-13691d9af70e tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:42.486646 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cc703ed0-ddbf-46ff-9c31-13691d9af70e tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:42.488651 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cc703ed0-ddbf-46ff-9c31-13691d9af70e tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:42.490189 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cc703ed0-ddbf-46ff-9c31-13691d9af70e tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] 10.222.0.79 "GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf" status: 200 len: 2838 microversion: 2.42 time: 0.532665 Oct 17 13:48:42.503503 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1635/3244] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:41 2022] GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf => generated 2838 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:48:42.516847 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-dc3d672b-917d-4412-a92f-dec051c68111 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:42.517584 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-dc3d672b-917d-4412-a92f-dec051c68111 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:42.523790 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc3d672b-917d-4412-a92f-dec051c68111 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:42.524523 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc3d672b-917d-4412-a92f-dec051c68111 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:42.525141 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc3d672b-917d-4412-a92f-dec051c68111 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:42.526191 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc3d672b-917d-4412-a92f-dec051c68111 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:42.526796 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc3d672b-917d-4412-a92f-dec051c68111 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:42.527241 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc3d672b-917d-4412-a92f-dec051c68111 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:43.132857 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-dc3d672b-917d-4412-a92f-dec051c68111 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:43.141958 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-dc3d672b-917d-4412-a92f-dec051c68111 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 0.637254 Oct 17 13:48:43.142886 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1636/3245] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:42 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:43.149646 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c0c0e919-0fc1-48b6-ab8c-9d7ad2474bde tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:43.150250 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c0c0e919-0fc1-48b6-ab8c-9d7ad2474bde tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9eaf1302-c967-4a24-8772-df5b32f11a60] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:43.156867 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c0c0e919-0fc1-48b6-ab8c-9d7ad2474bde tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:43.157268 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c0c0e919-0fc1-48b6-ab8c-9d7ad2474bde tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:43.157839 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c0c0e919-0fc1-48b6-ab8c-9d7ad2474bde tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:43.158625 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c0c0e919-0fc1-48b6-ab8c-9d7ad2474bde tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:43.159359 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c0c0e919-0fc1-48b6-ab8c-9d7ad2474bde tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:43.160048 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c0c0e919-0fc1-48b6-ab8c-9d7ad2474bde tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:43.498333 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c0c0e919-0fc1-48b6-ab8c-9d7ad2474bde tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:43.507978 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c0c0e919-0fc1-48b6-ab8c-9d7ad2474bde tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/9eaf1302-c967-4a24-8772-df5b32f11a60" status: 200 len: 1462 microversion: 2.1 time: 0.362461 Oct 17 13:48:43.519260 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1637/3246] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:43 2022] GET /compute/v2.1/servers/9eaf1302-c967-4a24-8772-df5b32f11a60 => generated 1462 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:43.519260 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cbb8592b-952d-410f-9df0-343b6a0a13d1 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:43.519260 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cbb8592b-952d-410f-9df0-343b6a0a13d1 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 68363fdf-f661-4b7c-abdc-7a8a85efa83a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:43.523749 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cbb8592b-952d-410f-9df0-343b6a0a13d1 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:43.524604 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cbb8592b-952d-410f-9df0-343b6a0a13d1 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:43.525304 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cbb8592b-952d-410f-9df0-343b6a0a13d1 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:43.526215 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cbb8592b-952d-410f-9df0-343b6a0a13d1 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:43.526882 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cbb8592b-952d-410f-9df0-343b6a0a13d1 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:43.527516 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cbb8592b-952d-410f-9df0-343b6a0a13d1 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:43.849032 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cbb8592b-952d-410f-9df0-343b6a0a13d1 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:43.857491 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cbb8592b-952d-410f-9df0-343b6a0a13d1 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a" status: 200 len: 1321 microversion: 2.1 time: 0.347200 Oct 17 13:48:43.872997 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1638/3247] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:43 2022] GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a => generated 1321 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:43.878722 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-58235995-13cb-4b8a-830b-496b4497d6b6 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:43.879245 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-58235995-13cb-4b8a-830b-496b4497d6b6 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] [instance: 531b762d-db7e-4911-af50-6b321b7706bf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:43.885343 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-58235995-13cb-4b8a-830b-496b4497d6b6 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:43.885829 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-58235995-13cb-4b8a-830b-496b4497d6b6 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:43.886257 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-58235995-13cb-4b8a-830b-496b4497d6b6 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:43.886954 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-58235995-13cb-4b8a-830b-496b4497d6b6 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:43.887455 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-58235995-13cb-4b8a-830b-496b4497d6b6 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:43.887873 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-58235995-13cb-4b8a-830b-496b4497d6b6 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:44.082079 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-58235995-13cb-4b8a-830b-496b4497d6b6 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] 10.222.0.79 "GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.207536 Oct 17 13:48:44.082826 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1639/3248] 10.222.0.79 () {60 vars in 1316 bytes} [Mon Oct 17 13:48:43 2022] GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf/os-interface => generated 1832 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:48:44.119655 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ddd62671-1739-4158-aa4d-1bf356236b96 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:44.124078 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ddd62671-1739-4158-aa4d-1bf356236b96 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:44.132454 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ddd62671-1739-4158-aa4d-1bf356236b96 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:44.134034 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ddd62671-1739-4158-aa4d-1bf356236b96 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:44.134577 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ddd62671-1739-4158-aa4d-1bf356236b96 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:44.135441 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ddd62671-1739-4158-aa4d-1bf356236b96 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:44.136006 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ddd62671-1739-4158-aa4d-1bf356236b96 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:44.136551 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ddd62671-1739-4158-aa4d-1bf356236b96 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:44.583592 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ddd62671-1739-4158-aa4d-1bf356236b96 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:44.599099 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ddd62671-1739-4158-aa4d-1bf356236b96 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:44.605222 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ddd62671-1739-4158-aa4d-1bf356236b96 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:44.606448 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ddd62671-1739-4158-aa4d-1bf356236b96 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1879 microversion: 2.32 time: 0.522382 Oct 17 13:48:44.607021 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1640/3249] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:44 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1879 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:48:44.619033 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-825e892a-2a13-431b-ab06-62840701c0bd tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:44.619696 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-825e892a-2a13-431b-ab06-62840701c0bd tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:44.630883 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-825e892a-2a13-431b-ab06-62840701c0bd tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:44.631691 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-825e892a-2a13-431b-ab06-62840701c0bd tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:44.632273 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-825e892a-2a13-431b-ab06-62840701c0bd tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:44.633228 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-825e892a-2a13-431b-ab06-62840701c0bd tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:44.633837 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-825e892a-2a13-431b-ab06-62840701c0bd tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:44.634462 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-825e892a-2a13-431b-ab06-62840701c0bd tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:44.860523 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d182b353-ba9c-42c9-b6a6-b4603be0400d tempest-FloatingIPDetailsTestJSON-589486563 tempest-FloatingIPDetailsTestJSON-589486563-project] 10.222.0.79 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 3.213465 Oct 17 13:48:44.863298 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1610/3250] 10.222.0.79 () {60 vars in 1170 bytes} [Mon Oct 17 13:48:41 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 3218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:48:44.872731 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a77a5fa8-df6a-4479-b1b2-771b6f82b086 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Action: 'create', calling method: .version_select at 0x7f7cd5917430>, body: {"keypair": {"name": "tempest-keypair-437728581", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHeiSae77NVgOOKsChUgq2KQW+YZLj5rtBfYmAvno9UtRczuvwMaG69j32Zk13hMrbc6yz+hOAThrEOHKMZvZVEBkKK5Brj4/U50tkMhfvHAMxlOoGj9tcgjdhL5gyjMHA=="}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:44.901115 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-a77a5fa8-df6a-4479-b1b2-771b6f82b086 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Getting quotas for project 5b98e3f377c14838a31cc430c98855e1. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:48:44.907307 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-a77a5fa8-df6a-4479-b1b2-771b6f82b086 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Getting quotas for user 0906fe70cb054729bfb95b2196c1a5d3 and project 5b98e3f377c14838a31cc430c98855e1. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:48:44.934971 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:48:44.950033 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-825e892a-2a13-431b-ab06-62840701c0bd tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:44.963201 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a77a5fa8-df6a-4479-b1b2-771b6f82b086 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.097136 Oct 17 13:48:44.973356 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1611/3251] 10.222.0.79 () {60 vars in 1159 bytes} [Mon Oct 17 13:48:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:48:44.977332 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-825e892a-2a13-431b-ab06-62840701c0bd tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 0.366860 Oct 17 13:48:44.978036 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1641/3252] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:44 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:44.992347 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3c49608a-3dc5-4bd6-98f6-f70bbdb3dfcd tempest-FloatingIPDetailsTestJSON-589486563 tempest-FloatingIPDetailsTestJSON-589486563-project] Action: 'create', calling method: .version_select at 0x7f7cd4463280>, body: {"pool": null} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:44.998656 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-182db69e-907b-4faa-b81f-266c4719c776 req-4f338be9-9e3d-427c-b5a2-406b8b0c2ee4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33de8199-8f00-40eb-9b95-b7ab5289dbe3", "name": "network-vif-plugged", "status": "completed", "tag": "2205d7dd-1b32-4750-962d-deadba8d5369"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:45.014321 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-182db69e-907b-4faa-b81f-266c4719c776 req-4f338be9-9e3d-427c-b5a2-406b8b0c2ee4 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:45.015012 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-182db69e-907b-4faa-b81f-266c4719c776 req-4f338be9-9e3d-427c-b5a2-406b8b0c2ee4 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:45.016725 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-182db69e-907b-4faa-b81f-266c4719c776 req-4f338be9-9e3d-427c-b5a2-406b8b0c2ee4 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:45.040859 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-182db69e-907b-4faa-b81f-266c4719c776 req-4f338be9-9e3d-427c-b5a2-406b8b0c2ee4 service nova] Creating event network-vif-plugged:2205d7dd-1b32-4750-962d-deadba8d5369 for instance 33de8199-8f00-40eb-9b95-b7ab5289dbe3 on n-h2-854247-14 Oct 17 13:48:45.042945 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-182db69e-907b-4faa-b81f-266c4719c776 req-4f338be9-9e3d-427c-b5a2-406b8b0c2ee4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066738 Oct 17 13:48:45.049058 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1612/3253] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:48:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:48:45.055389 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c9434793-2a0c-4bc5-af54-31db696d6328 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:45.056868 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c9434793-2a0c-4bc5-af54-31db696d6328 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 68363fdf-f661-4b7c-abdc-7a8a85efa83a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:45.066044 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c9434793-2a0c-4bc5-af54-31db696d6328 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:45.066856 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c9434793-2a0c-4bc5-af54-31db696d6328 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:45.070195 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c9434793-2a0c-4bc5-af54-31db696d6328 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:45.071554 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c9434793-2a0c-4bc5-af54-31db696d6328 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:45.072246 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c9434793-2a0c-4bc5-af54-31db696d6328 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:45.072838 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c9434793-2a0c-4bc5-af54-31db696d6328 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:45.564813 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c9434793-2a0c-4bc5-af54-31db696d6328 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:45.583734 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c9434793-2a0c-4bc5-af54-31db696d6328 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a" status: 200 len: 1516 microversion: 2.1 time: 0.532544 Oct 17 13:48:45.595226 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1613/3254] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:45 2022] GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a => generated 1516 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:45.595226 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-38f2956b-01d4-4394-92c6-b973e06ecb7e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1025769651_updated"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:45.598574 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-38f2956b-01d4-4394-92c6-b973e06ecb7e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: f04d5d31-c255-4a50-9457-ccbdacb9696d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:45.612080 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-38f2956b-01d4-4394-92c6-b973e06ecb7e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] HTTP exception thrown: Instance f04d5d31-c255-4a50-9457-ccbdacb9696d could not be found. Oct 17 13:48:45.617061 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-38f2956b-01d4-4394-92c6-b973e06ecb7e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Request method failure captured: Oct 17 13:48:45.617061 n-d-854247-14 devstack@n-api.service[127017]: request: PUT /compute/v2.1/servers/f04d5d31-c255-4a50-9457-ccbdacb9696d HTTP/1.1 Oct 17 13:48:45.617061 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:48:45.617061 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:48:45.617061 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:48:45.617061 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 81 Oct 17 13:48:45.617061 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:48:45.617061 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:48:45.617061 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:48:45.617061 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:48:45.617061 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVwEqzYAZh4AkEjRryOAZIhaHrAKxd2Qcal9md8a5n-MMUYSdXmcWYLDVkyQoPrDIbcsApBq2EewemPkBwvNDDOidb0hhc_Z3w9BeEUj5ET_flLYPqO5hgqCsuZGXFiYIEBJxrkx614fXiELZHaNkvhSdsJHShK0w7L-UPHhkPKqi5M Oct 17 13:48:45.617061 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:48:45.617061 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:48:45.617061 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:48:45.617061 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:48:45.617061 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:48:45.617061 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:48:45.617061 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:48:45.617061 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:48:45.617061 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:48:45.617061 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:48:45.617061 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_59e65f6eb06d40d583b9f43c9af94c13", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:48:45.617061 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:48:45.617061 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:48:45.617061 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:48:45.617061 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:48:45.617061 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:48:45.617061 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:48:45.617061 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 443c44b0bd9e4c56a7fe0c1a53238545 Oct 17 13:48:45.617061 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:48:45.617061 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 13:48:45.617061 n-d-854247-14 devstack@n-api.service[127017]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1025769651_updated"}} Oct 17 13:48:45.617061 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:48:45.617061 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance f04d5d31-c255-4a50-9457-ccbdacb9696d could not be found. Oct 17 13:48:45.617061 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'f04d5d31-c255-4a50-9457-ccbdacb9696d', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1025769651_updated'}}} Oct 17 13:48:45.617061 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:48:45.617061 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:48:45.617061 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:48:45.617061 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:48:45.617061 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:48:45.617061 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:48:45.617061 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 13:48:45.617061 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 13:48:45.617061 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f04d5d31-c255-4a50-9457-ccbdacb9696d could not be found. Oct 17 13:48:45.617061 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:48:45.617061 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:48:45.617061 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:48:45.617061 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:48:45.617061 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:48:45.617061 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:48:45.617061 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:48:45.617061 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:48:45.617061 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:48:45.617061 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:48:45.617061 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:48:45.617061 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:48:45.617061 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:48:45.617061 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:48:45.617061 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:48:45.617061 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:48:45.617061 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 17 13:48:45.617061 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 17 13:48:45.617061 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 17 13:48:45.617061 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:48:45.621183 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:48:45.621183 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:48:45.621183 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:48:45.621183 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f04d5d31-c255-4a50-9457-ccbdacb9696d could not be found. Oct 17 13:48:45.621183 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:48:45.621183 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:48:45.621183 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:48:45.621183 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:48:45.621183 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:48:45.621183 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:48:45.621183 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:48:45.621183 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:48:45.621183 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f04d5d31-c255-4a50-9457-ccbdacb9696d could not be found. Oct 17 13:48:45.621183 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:48:45.626795 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-38f2956b-01d4-4394-92c6-b973e06ecb7e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Returning 404 to user: Instance f04d5d31-c255-4a50-9457-ccbdacb9696d could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:48:45.633886 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-38f2956b-01d4-4394-92c6-b973e06ecb7e tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "PUT /compute/v2.1/servers/f04d5d31-c255-4a50-9457-ccbdacb9696d" status: 404 len: 111 microversion: 2.1 time: 0.043269 Oct 17 13:48:45.636058 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1614/3255] 10.222.0.79 () {60 vars in 1256 bytes} [Mon Oct 17 13:48:45 2022] PUT /compute/v2.1/servers/f04d5d31-c255-4a50-9457-ccbdacb9696d => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:48:45.650572 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-10d8f5b9-fef6-4883-8531-e87834ae6a6a req-c7b9e2a0-9ede-4809-beb2-eefd16eeb08e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "531b762d-db7e-4911-af50-6b321b7706bf", "tag": "13d96c52-0581-49ee-acc7-7c007590f889"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:45.671670 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-10d8f5b9-fef6-4883-8531-e87834ae6a6a req-c7b9e2a0-9ede-4809-beb2-eefd16eeb08e service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:45.672657 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-10d8f5b9-fef6-4883-8531-e87834ae6a6a req-c7b9e2a0-9ede-4809-beb2-eefd16eeb08e service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:45.673304 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-10d8f5b9-fef6-4883-8531-e87834ae6a6a req-c7b9e2a0-9ede-4809-beb2-eefd16eeb08e service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:45.713261 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-10d8f5b9-fef6-4883-8531-e87834ae6a6a req-c7b9e2a0-9ede-4809-beb2-eefd16eeb08e service nova] Creating event network-changed:13d96c52-0581-49ee-acc7-7c007590f889 for instance 531b762d-db7e-4911-af50-6b321b7706bf on n-h1-854247-14 Oct 17 13:48:45.720322 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-10d8f5b9-fef6-4883-8531-e87834ae6a6a req-c7b9e2a0-9ede-4809-beb2-eefd16eeb08e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081087 Oct 17 13:48:45.721894 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1615/3256] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:48:45.729207 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d77af451-866f-46ef-8d62-01be640402db tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:45.732440 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d77af451-866f-46ef-8d62-01be640402db tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 68363fdf-f661-4b7c-abdc-7a8a85efa83a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:45.740501 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d77af451-866f-46ef-8d62-01be640402db tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:45.741698 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d77af451-866f-46ef-8d62-01be640402db tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:45.742565 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d77af451-866f-46ef-8d62-01be640402db tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:45.743590 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d77af451-866f-46ef-8d62-01be640402db tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:45.744198 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d77af451-866f-46ef-8d62-01be640402db tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:45.744819 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d77af451-866f-46ef-8d62-01be640402db tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:45.776683 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-d77af451-866f-46ef-8d62-01be640402db tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lazy-loading 'flavor' on Instance uuid 68363fdf-f661-4b7c-abdc-7a8a85efa83a {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:48:45.886930 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d77af451-866f-46ef-8d62-01be640402db tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "POST /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a/action" status: 200 len: 32 microversion: 2.1 time: 0.163338 Oct 17 13:48:45.897056 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1616/3257] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:48:45 2022] POST /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a/action => generated 32 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:48:45.913985 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1a722b21-a2f4-40c3-aae1-6d5793240825 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:45.915528 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1a722b21-a2f4-40c3-aae1-6d5793240825 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:45.932420 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1a722b21-a2f4-40c3-aae1-6d5793240825 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:45.932943 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1a722b21-a2f4-40c3-aae1-6d5793240825 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:45.933389 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1a722b21-a2f4-40c3-aae1-6d5793240825 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:45.938108 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1a722b21-a2f4-40c3-aae1-6d5793240825 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:45.938613 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1a722b21-a2f4-40c3-aae1-6d5793240825 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:45.941799 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1a722b21-a2f4-40c3-aae1-6d5793240825 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:46.741362 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1a722b21-a2f4-40c3-aae1-6d5793240825 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:46.773010 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1a722b21-a2f4-40c3-aae1-6d5793240825 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:46.785577 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1a722b21-a2f4-40c3-aae1-6d5793240825 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:46.796329 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1a722b21-a2f4-40c3-aae1-6d5793240825 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1879 microversion: 2.32 time: 0.897521 Oct 17 13:48:46.797513 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1617/3258] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:45 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1879 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:48:46.804830 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-66920f2a-77fc-457c-86b2-79dc129c7996 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:46.808961 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-66920f2a-77fc-457c-86b2-79dc129c7996 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:46.823106 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-66920f2a-77fc-457c-86b2-79dc129c7996 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:46.836035 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-66920f2a-77fc-457c-86b2-79dc129c7996 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:46.836954 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-66920f2a-77fc-457c-86b2-79dc129c7996 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:46.838014 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-66920f2a-77fc-457c-86b2-79dc129c7996 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:46.838744 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-66920f2a-77fc-457c-86b2-79dc129c7996 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:46.839436 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-66920f2a-77fc-457c-86b2-79dc129c7996 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:47.353540 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-66920f2a-77fc-457c-86b2-79dc129c7996 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:47.362034 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-66920f2a-77fc-457c-86b2-79dc129c7996 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 0.563281 Oct 17 13:48:47.362642 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1618/3259] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:46 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:47.367647 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e1230dad-b495-4190-8009-1419e28062e1 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:47.368265 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e1230dad-b495-4190-8009-1419e28062e1 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 68363fdf-f661-4b7c-abdc-7a8a85efa83a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:47.374220 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e1230dad-b495-4190-8009-1419e28062e1 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:47.374697 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e1230dad-b495-4190-8009-1419e28062e1 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:47.375134 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e1230dad-b495-4190-8009-1419e28062e1 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:47.376350 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e1230dad-b495-4190-8009-1419e28062e1 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:47.376818 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e1230dad-b495-4190-8009-1419e28062e1 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:47.377457 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e1230dad-b495-4190-8009-1419e28062e1 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:47.801234 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e1230dad-b495-4190-8009-1419e28062e1 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:47.813534 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e1230dad-b495-4190-8009-1419e28062e1 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a" status: 200 len: 1522 microversion: 2.1 time: 0.449458 Oct 17 13:48:47.816248 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1619/3260] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:47 2022] GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a => generated 1522 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:47.835581 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-92ff709c-d214-4bfc-9ac9-de1600332b37 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:47.836230 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-92ff709c-d214-4bfc-9ac9-de1600332b37 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:47.842739 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-92ff709c-d214-4bfc-9ac9-de1600332b37 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:47.843253 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-92ff709c-d214-4bfc-9ac9-de1600332b37 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:47.843694 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-92ff709c-d214-4bfc-9ac9-de1600332b37 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:47.844403 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-92ff709c-d214-4bfc-9ac9-de1600332b37 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:47.844856 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-92ff709c-d214-4bfc-9ac9-de1600332b37 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:47.845281 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-92ff709c-d214-4bfc-9ac9-de1600332b37 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:48.209306 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-92ff709c-d214-4bfc-9ac9-de1600332b37 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:48.220103 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-92ff709c-d214-4bfc-9ac9-de1600332b37 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 0.402204 Oct 17 13:48:48.223773 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1620/3261] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:47 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:48.230592 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ec279aae-9946-4a9c-9d6a-bb1a54ddd9fc tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:48.231530 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ec279aae-9946-4a9c-9d6a-bb1a54ddd9fc tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:48.240785 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ec279aae-9946-4a9c-9d6a-bb1a54ddd9fc tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:48.241850 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ec279aae-9946-4a9c-9d6a-bb1a54ddd9fc tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:48.242599 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ec279aae-9946-4a9c-9d6a-bb1a54ddd9fc tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:48.243374 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ec279aae-9946-4a9c-9d6a-bb1a54ddd9fc tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:48.244000 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ec279aae-9946-4a9c-9d6a-bb1a54ddd9fc tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:48.244455 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ec279aae-9946-4a9c-9d6a-bb1a54ddd9fc tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:48.624000 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ec279aae-9946-4a9c-9d6a-bb1a54ddd9fc tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:48.634760 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ec279aae-9946-4a9c-9d6a-bb1a54ddd9fc tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:48.636214 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ec279aae-9946-4a9c-9d6a-bb1a54ddd9fc tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:48.637384 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ec279aae-9946-4a9c-9d6a-bb1a54ddd9fc tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1879 microversion: 2.32 time: 0.412376 Oct 17 13:48:48.638355 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1621/3262] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:48 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1879 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:48:48.642819 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0d59a005-7821-4456-895c-84bac91e2ce8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:48.646896 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0d59a005-7821-4456-895c-84bac91e2ce8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Request method failure captured: Oct 17 13:48:48.646896 n-d-854247-14 devstack@n-api.service[127017]: request: PUT /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca HTTP/1.1 Oct 17 13:48:48.646896 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:48:48.646896 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:48:48.646896 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:48:48.646896 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 280 Oct 17 13:48:48.646896 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:48:48.646896 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:48:48.646896 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:48:48.646896 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:48:48.646896 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVwEqzYAZh4AkEjRryOAZIhaHrAKxd2Qcal9md8a5n-MMUYSdXmcWYLDVkyQoPrDIbcsApBq2EewemPkBwvNDDOidb0hhc_Z3w9BeEUj5ET_flLYPqO5hgqCsuZGXFiYIEBJxrkx614fXiELZHaNkvhSdsJHShK0w7L-UPHhkPKqi5M Oct 17 13:48:48.646896 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:48:48.646896 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:48:48.646896 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:48:48.646896 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:48:48.646896 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:48:48.646896 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:48:48.646896 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:48:48.646896 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:48:48.646896 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:48:48.646896 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:48:48.646896 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_59e65f6eb06d40d583b9f43c9af94c13", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:48:48.646896 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:48:48.646896 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:48:48.646896 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:48:48.646896 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:48:48.646896 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:48:48.646896 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:48:48.646896 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 443c44b0bd9e4c56a7fe0c1a53238545 Oct 17 13:48:48.646896 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:48:48.646896 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 13:48:48.646896 n-d-854247-14 devstack@n-api.service[127017]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 17 13:48:48.646896 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:48:48.646896 n-d-854247-14 devstack@n-api.service[127017]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 17 13:48:48.646896 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '5ef00d34-7f81-4649-a90a-a52cf78dbeca', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 17 13:48:48.646896 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:48:48.646896 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:48:48.646896 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:48:48.646896 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:48:48.646896 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:48:48.646896 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:48:48.646896 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 17 13:48:48.646896 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:48:48.646896 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 17 13:48:48.646896 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 17 13:48:48.646896 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:48:48.646896 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 13:48:48.646896 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 17 13:48:48.646896 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:48:48.646896 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:48:48.646896 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:48:48.646896 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:48:48.651375 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:48:48.651375 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:48:48.651375 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:48:48.651375 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:48:48.651375 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:48:48.651375 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:48:48.651375 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:48:48.651375 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:48:48.651375 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:48:48.651375 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:48:48.651375 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:48:48.651375 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:48:48.651375 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:48:48.651375 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:48:48.651375 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 17 13:48:48.651375 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:48:48.651375 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:48:48.651375 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:48:48.651375 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:48:48.651375 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:48:48.651375 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:48:48.651375 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:48:48.651375 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:48:48.651375 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 17 13:48:48.651375 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:48:48.651375 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0d59a005-7821-4456-895c-84bac91e2ce8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:48:48.651375 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0d59a005-7821-4456-895c-84bac91e2ce8 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "PUT /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 400 len: 619 microversion: 2.1 time: 0.009922 Oct 17 13:48:48.651375 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1622/3263] 10.222.0.79 () {60 vars in 1257 bytes} [Mon Oct 17 13:48:48 2022] PUT /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 619 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:48:48.657221 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f5b87739-6907-4cbf-951f-e0cc824e29c3 tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] Calling method '.version_select at 0x7f7cd9a74e50>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:48.660698 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f5b87739-6907-4cbf-951f-e0cc824e29c3 tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:48.661186 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f5b87739-6907-4cbf-951f-e0cc824e29c3 tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:48.661625 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f5b87739-6907-4cbf-951f-e0cc824e29c3 tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:48.670102 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f5b87739-6907-4cbf-951f-e0cc824e29c3 tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] 10.222.0.79 "GET /compute/v2.1/os-migrations" status: 200 len: 811 microversion: 2.1 time: 0.016281 Oct 17 13:48:48.670708 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1623/3264] 10.222.0.79 () {58 vars in 1143 bytes} [Mon Oct 17 13:48:48 2022] GET /compute/v2.1/os-migrations => generated 811 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:48:48.675259 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2d1767d4-f354-4f03-a73d-d056382c3195 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:48.675870 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2d1767d4-f354-4f03-a73d-d056382c3195 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:48.682065 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2d1767d4-f354-4f03-a73d-d056382c3195 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:48.683037 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2d1767d4-f354-4f03-a73d-d056382c3195 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:48.683658 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2d1767d4-f354-4f03-a73d-d056382c3195 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:48.684347 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2d1767d4-f354-4f03-a73d-d056382c3195 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:48.684802 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2d1767d4-f354-4f03-a73d-d056382c3195 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:48.685220 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2d1767d4-f354-4f03-a73d-d056382c3195 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:48.928406 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2d1767d4-f354-4f03-a73d-d056382c3195 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:48.938213 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2d1767d4-f354-4f03-a73d-d056382c3195 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 0.266487 Oct 17 13:48:48.938795 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1624/3265] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:48 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:48.943544 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f6ff2806-c64e-4160-b2e4-98a8576631b1 tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:48.950556 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f6ff2806-c64e-4160-b2e4-98a8576631b1 tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.010676 Oct 17 13:48:48.951444 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1625/3266] 10.222.0.79 () {58 vars in 1137 bytes} [Mon Oct 17 13:48:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:48:48.958973 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-542f439a-d934-48de-b690-6ffe93016562 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:48.958973 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-542f439a-d934-48de-b690-6ffe93016562 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 68363fdf-f661-4b7c-abdc-7a8a85efa83a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:48.962568 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-542f439a-d934-48de-b690-6ffe93016562 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:48.963062 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-542f439a-d934-48de-b690-6ffe93016562 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:48.963562 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-542f439a-d934-48de-b690-6ffe93016562 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:48.964762 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-542f439a-d934-48de-b690-6ffe93016562 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:48.964762 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-542f439a-d934-48de-b690-6ffe93016562 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:48.965119 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-542f439a-d934-48de-b690-6ffe93016562 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:48.970499 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:48:49.055701 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3c49608a-3dc5-4bd6-98f6-f70bbdb3dfcd tempest-FloatingIPDetailsTestJSON-589486563 tempest-FloatingIPDetailsTestJSON-589486563-project] 10.222.0.79 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.073452 Oct 17 13:48:49.056408 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1642/3267] 10.222.0.79 () {60 vars in 1170 bytes} [Mon Oct 17 13:48:44 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4078 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:48:49.065773 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e9f27e96-ec9b-4038-8f78-c22fef8367fc tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:49.065773 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e9f27e96-ec9b-4038-8f78-c22fef8367fc tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:49.069255 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9f27e96-ec9b-4038-8f78-c22fef8367fc tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:49.069821 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9f27e96-ec9b-4038-8f78-c22fef8367fc tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:49.070306 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9f27e96-ec9b-4038-8f78-c22fef8367fc tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:49.071131 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9f27e96-ec9b-4038-8f78-c22fef8367fc tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:49.072022 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9f27e96-ec9b-4038-8f78-c22fef8367fc tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:49.072514 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9f27e96-ec9b-4038-8f78-c22fef8367fc tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:49.544190 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-542f439a-d934-48de-b690-6ffe93016562 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:49.553171 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-542f439a-d934-48de-b690-6ffe93016562 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a" status: 200 len: 1522 microversion: 2.1 time: 0.601052 Oct 17 13:48:49.554094 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1626/3268] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:48 2022] GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a => generated 1522 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:49.558169 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-990103b5-67f4-49ce-af5a-8b0e50b56c26 tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1942281229", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:49.581900 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-990103b5-67f4-49ce-af5a-8b0e50b56c26 tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.027047 Oct 17 13:48:49.582802 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1627/3269] 10.222.0.79 () {60 vars in 1146 bytes} [Mon Oct 17 13:48:49 2022] POST /compute/v2.1/flavors => generated 499 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:48:49.587640 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-85896afb-2fe2-4c26-a7f1-656e94a321f3 tempest-FloatingIPDetailsTestJSON-589486563 tempest-FloatingIPDetailsTestJSON-589486563-project] Calling method '.version_select at 0x7f7cd522f040>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:49.593014 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e9f27e96-ec9b-4038-8f78-c22fef8367fc tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:49.601373 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e9f27e96-ec9b-4038-8f78-c22fef8367fc tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 0.543952 Oct 17 13:48:49.602220 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1643/3270] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:49 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:49.606562 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-991e9e33-4d07-4ffc-a019-ec6ed547e7dc tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:49.615864 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-991e9e33-4d07-4ffc-a019-ec6ed547e7dc tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.012625 Oct 17 13:48:49.616427 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1644/3271] 10.222.0.79 () {58 vars in 1182 bytes} [Mon Oct 17 13:48:49 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:48:49.623868 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-66e48a1c-4fd7-4d55-b25f-dfb0efc0fbe5 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-66e48a1c-4fd7-4d55-b25f-dfb0efc0fbe5 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Request method failure captured: Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: request: PUT /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca HTTP/1.1 Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 24 Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVwEqzYAZh4AkEjRryOAZIhaHrAKxd2Qcal9md8a5n-MMUYSdXmcWYLDVkyQoPrDIbcsApBq2EewemPkBwvNDDOidb0hhc_Z3w9BeEUj5ET_flLYPqO5hgqCsuZGXFiYIEBJxrkx614fXiELZHaNkvhSdsJHShK0w7L-UPHhkPKqi5M Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_59e65f6eb06d40d583b9f43c9af94c13", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 443c44b0bd9e4c56a7fe0c1a53238545 Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: {"server": {"name": ""}} Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '5ef00d34-7f81-4649-a90a-a52cf78dbeca', 'body': {'server': {'name': ''}}} Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi '' Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:48:49.633102 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:48:49.638490 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 17 13:48:49.638490 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:48:49.638490 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:48:49.638490 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:48:49.638490 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:48:49.638490 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:48:49.638490 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:48:49.638490 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:48:49.638490 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:48:49.638490 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 17 13:48:49.638490 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:48:49.638490 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-66e48a1c-4fd7-4d55-b25f-dfb0efc0fbe5 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:48:49.638490 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-66e48a1c-4fd7-4d55-b25f-dfb0efc0fbe5 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "PUT /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 400 len: 108 microversion: 2.1 time: 0.014609 Oct 17 13:48:49.638490 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1645/3272] 10.222.0.79 () {60 vars in 1256 bytes} [Mon Oct 17 13:48:49 2022] PUT /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 108 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:48:49.644871 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-96318d49-6018-470c-ab0f-f7afaf6749cb tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:49.645453 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-96318d49-6018-470c-ab0f-f7afaf6749cb tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:49.651485 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-96318d49-6018-470c-ab0f-f7afaf6749cb tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:49.651966 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-96318d49-6018-470c-ab0f-f7afaf6749cb tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:49.652393 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-96318d49-6018-470c-ab0f-f7afaf6749cb tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:49.653086 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-96318d49-6018-470c-ab0f-f7afaf6749cb tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:49.653530 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-96318d49-6018-470c-ab0f-f7afaf6749cb tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:49.653949 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-96318d49-6018-470c-ab0f-f7afaf6749cb tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:49.908990 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-85896afb-2fe2-4c26-a7f1-656e94a321f3 tempest-FloatingIPDetailsTestJSON-589486563 tempest-FloatingIPDetailsTestJSON-589486563-project] 10.222.0.79 "GET /compute/v2.1/os-floating-ips/43db4949-0d9f-4c32-b95a-fe7257be283b" status: 200 len: 142 microversion: 2.1 time: 0.324892 Oct 17 13:48:49.917249 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1628/3273] 10.222.0.79 () {58 vars in 1260 bytes} [Mon Oct 17 13:48:49 2022] GET /compute/v2.1/os-floating-ips/43db4949-0d9f-4c32-b95a-fe7257be283b => generated 142 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:48:49.923160 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-93ba179a-7ca2-4bc0-8572-cb345302466b tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:49.923807 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-93ba179a-7ca2-4bc0-8572-cb345302466b tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:49.930504 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-93ba179a-7ca2-4bc0-8572-cb345302466b tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:49.931112 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-93ba179a-7ca2-4bc0-8572-cb345302466b tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:49.931610 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-93ba179a-7ca2-4bc0-8572-cb345302466b tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:49.932282 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-93ba179a-7ca2-4bc0-8572-cb345302466b tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:49.932901 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-93ba179a-7ca2-4bc0-8572-cb345302466b tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:49.933500 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-93ba179a-7ca2-4bc0-8572-cb345302466b tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:49.979692 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-96318d49-6018-470c-ab0f-f7afaf6749cb tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:49.988873 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-96318d49-6018-470c-ab0f-f7afaf6749cb tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1506 microversion: 2.1 time: 0.349528 Oct 17 13:48:49.989605 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1646/3274] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:49 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1506 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:49.994703 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0914bb7b-101e-4b95-86ac-1578130d1e7f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-938424135", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "fcab7af2-ec08-4c4c-a1f9-aaa2d9f08711"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:50.062706 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-0914bb7b-101e-4b95-86ac-1578130d1e7f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] validate_networks() for None {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:48:50.305013 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-93ba179a-7ca2-4bc0-8572-cb345302466b tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:50.314995 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-93ba179a-7ca2-4bc0-8572-cb345302466b tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:50.316467 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-93ba179a-7ca2-4bc0-8572-cb345302466b tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:50.317650 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-93ba179a-7ca2-4bc0-8572-cb345302466b tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1879 microversion: 2.32 time: 0.399155 Oct 17 13:48:50.318195 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1629/3275] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:49 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1879 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:48:50.324608 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-220a78ae-dd83-4b88-9a90-ca7b915c8c43 tempest-FloatingIPDetailsTestJSON-589486563 tempest-FloatingIPDetailsTestJSON-589486563-project] Calling method '.version_select at 0x7f7cd522faf0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:50.537257 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-0914bb7b-101e-4b95-86ac-1578130d1e7f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:48:50.537866 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-0914bb7b-101e-4b95-86ac-1578130d1e7f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:48:50.538488 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-0914bb7b-101e-4b95-86ac-1578130d1e7f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:48:50.539141 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-0914bb7b-101e-4b95-86ac-1578130d1e7f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:48:50.539652 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-0914bb7b-101e-4b95-86ac-1578130d1e7f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:48:50.549379 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0914bb7b-101e-4b95-86ac-1578130d1e7f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:50.550013 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0914bb7b-101e-4b95-86ac-1578130d1e7f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:50.550515 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0914bb7b-101e-4b95-86ac-1578130d1e7f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:50.551368 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0914bb7b-101e-4b95-86ac-1578130d1e7f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:50.551892 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0914bb7b-101e-4b95-86ac-1578130d1e7f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:50.552380 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0914bb7b-101e-4b95-86ac-1578130d1e7f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:50.572729 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-0914bb7b-101e-4b95-86ac-1578130d1e7f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Getting quotas for project 5b98e3f377c14838a31cc430c98855e1. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:48:50.578075 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-0914bb7b-101e-4b95-86ac-1578130d1e7f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Getting quotas for user 0906fe70cb054729bfb95b2196c1a5d3 and project 5b98e3f377c14838a31cc430c98855e1. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:48:50.592318 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0914bb7b-101e-4b95-86ac-1578130d1e7f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:48:50.594656 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0914bb7b-101e-4b95-86ac-1578130d1e7f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: e1fb1718-c504-47dc-ab2e-28fe15d2c435] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:48:50.646890 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0914bb7b-101e-4b95-86ac-1578130d1e7f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.656132 Oct 17 13:48:50.653994 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1647/3276] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:48:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:48:50.653994 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4e184dc2-4d19-4d7e-8393-5c89525d0fe1 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:50.653994 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4e184dc2-4d19-4d7e-8393-5c89525d0fe1 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 68363fdf-f661-4b7c-abdc-7a8a85efa83a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:50.659700 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4e184dc2-4d19-4d7e-8393-5c89525d0fe1 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:50.660267 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4e184dc2-4d19-4d7e-8393-5c89525d0fe1 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:50.660769 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4e184dc2-4d19-4d7e-8393-5c89525d0fe1 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:50.662183 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4e184dc2-4d19-4d7e-8393-5c89525d0fe1 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:50.662183 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4e184dc2-4d19-4d7e-8393-5c89525d0fe1 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:50.662542 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4e184dc2-4d19-4d7e-8393-5c89525d0fe1 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:50.967628 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4e184dc2-4d19-4d7e-8393-5c89525d0fe1 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:50.982370 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4e184dc2-4d19-4d7e-8393-5c89525d0fe1 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a" status: 200 len: 1522 microversion: 2.1 time: 0.333633 Oct 17 13:48:50.982967 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1648/3277] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:50 2022] GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a => generated 1522 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:50.999386 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e6360a59-cbec-465f-a9ff-06c179e3515e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:51.000414 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e6360a59-cbec-465f-a9ff-06c179e3515e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: e1fb1718-c504-47dc-ab2e-28fe15d2c435] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:51.116705 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e6360a59-cbec-465f-a9ff-06c179e3515e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:51.130757 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e6360a59-cbec-465f-a9ff-06c179e3515e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435" status: 200 len: 1278 microversion: 2.1 time: 0.144016 Oct 17 13:48:51.134906 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1649/3278] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:50 2022] GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435 => generated 1278 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:51.345499 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ad13e7f2-40db-42b9-baa9-f62a05b136b2 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:51.346456 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ad13e7f2-40db-42b9-baa9-f62a05b136b2 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:51.353222 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ad13e7f2-40db-42b9-baa9-f62a05b136b2 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:51.353826 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ad13e7f2-40db-42b9-baa9-f62a05b136b2 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:51.354505 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ad13e7f2-40db-42b9-baa9-f62a05b136b2 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:51.355360 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ad13e7f2-40db-42b9-baa9-f62a05b136b2 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:51.355914 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ad13e7f2-40db-42b9-baa9-f62a05b136b2 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:51.356425 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ad13e7f2-40db-42b9-baa9-f62a05b136b2 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:51.372425 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-220a78ae-dd83-4b88-9a90-ca7b915c8c43 tempest-FloatingIPDetailsTestJSON-589486563 tempest-FloatingIPDetailsTestJSON-589486563-project] 10.222.0.79 "DELETE /compute/v2.1/os-floating-ips/43db4949-0d9f-4c32-b95a-fe7257be283b" status: 202 len: 0 microversion: 2.1 time: 1.051766 Oct 17 13:48:51.373369 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1630/3279] 10.222.0.79 () {58 vars in 1263 bytes} [Mon Oct 17 13:48:50 2022] DELETE /compute/v2.1/os-floating-ips/43db4949-0d9f-4c32-b95a-fe7257be283b => generated 0 bytes in 1053 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:48:51.383478 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-692b70ae-4a8b-449d-a12e-91714dc2dade tempest-FloatingIPDetailsTestJSON-589486563 tempest-FloatingIPDetailsTestJSON-589486563-project] Calling method '.version_select at 0x7f7cd53ee430>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:51.712038 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-692b70ae-4a8b-449d-a12e-91714dc2dade tempest-FloatingIPDetailsTestJSON-589486563 tempest-FloatingIPDetailsTestJSON-589486563-project] 10.222.0.79 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.332385 Oct 17 13:48:51.718534 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1631/3280] 10.222.0.79 () {58 vars in 1164 bytes} [Mon Oct 17 13:48:51 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 17 13:48:51.725043 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-749765b5-0be5-46b8-a036-ec0fb35812a7 tempest-FloatingIPDetailsTestJSON-589486563 tempest-FloatingIPDetailsTestJSON-589486563-project] Calling method '.version_select at 0x7f7cd59171f0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:51.732366 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ad13e7f2-40db-42b9-baa9-f62a05b136b2 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:51.743639 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ad13e7f2-40db-42b9-baa9-f62a05b136b2 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:51.745335 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ad13e7f2-40db-42b9-baa9-f62a05b136b2 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:51.746656 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ad13e7f2-40db-42b9-baa9-f62a05b136b2 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1879 microversion: 2.32 time: 0.406036 Oct 17 13:48:51.747369 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1650/3281] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:51 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1879 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:48:51.940640 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-749765b5-0be5-46b8-a036-ec0fb35812a7 tempest-FloatingIPDetailsTestJSON-589486563 tempest-FloatingIPDetailsTestJSON-589486563-project] 10.222.0.79 "GET /compute/v2.1/os-floating-ips" status: 200 len: 397 microversion: 2.1 time: 0.220416 Oct 17 13:48:51.941380 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1632/3282] 10.222.0.79 () {58 vars in 1149 bytes} [Mon Oct 17 13:48:51 2022] GET /compute/v2.1/os-floating-ips => generated 397 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:48:51.956857 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a4276729-45c3-4ac2-9fd4-8e22f3aa6d02 tempest-FloatingIPDetailsTestJSON-589486563 tempest-FloatingIPDetailsTestJSON-589486563-project] Calling method '.version_select at 0x7f7cd4408940>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:52.011352 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f058c633-ed0f-4b22-b4da-68f1962243ad tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:52.012496 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f058c633-ed0f-4b22-b4da-68f1962243ad tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 68363fdf-f661-4b7c-abdc-7a8a85efa83a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:52.026654 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f058c633-ed0f-4b22-b4da-68f1962243ad tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:52.027941 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f058c633-ed0f-4b22-b4da-68f1962243ad tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:52.028839 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f058c633-ed0f-4b22-b4da-68f1962243ad tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:52.030421 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f058c633-ed0f-4b22-b4da-68f1962243ad tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:52.032313 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f058c633-ed0f-4b22-b4da-68f1962243ad tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:52.034067 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f058c633-ed0f-4b22-b4da-68f1962243ad tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:52.790956 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f058c633-ed0f-4b22-b4da-68f1962243ad tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:52.801586 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f058c633-ed0f-4b22-b4da-68f1962243ad tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a" status: 200 len: 1522 microversion: 2.1 time: 0.799228 Oct 17 13:48:52.802896 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1633/3283] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:52 2022] GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a => generated 1522 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:52.808935 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-542b0050-882a-46d4-b422-20f58ba3c626 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:52.809738 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-542b0050-882a-46d4-b422-20f58ba3c626 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: e1fb1718-c504-47dc-ab2e-28fe15d2c435] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:52.818448 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-542b0050-882a-46d4-b422-20f58ba3c626 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:52.819256 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-542b0050-882a-46d4-b422-20f58ba3c626 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:52.819814 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-542b0050-882a-46d4-b422-20f58ba3c626 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:52.821886 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-542b0050-882a-46d4-b422-20f58ba3c626 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:52.822604 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-542b0050-882a-46d4-b422-20f58ba3c626 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:52.823131 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-542b0050-882a-46d4-b422-20f58ba3c626 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:52.940519 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-542b0050-882a-46d4-b422-20f58ba3c626 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:52.952780 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-542b0050-882a-46d4-b422-20f58ba3c626 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435" status: 200 len: 1336 microversion: 2.1 time: 0.148096 Oct 17 13:48:52.963333 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1634/3284] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:52 2022] GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435 => generated 1336 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:52.963333 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e6ec3a65-3d8c-47d7-8620-9e3c12fbecd6 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:52.963333 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e6ec3a65-3d8c-47d7-8620-9e3c12fbecd6 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:52.966639 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e6ec3a65-3d8c-47d7-8620-9e3c12fbecd6 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:52.967517 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e6ec3a65-3d8c-47d7-8620-9e3c12fbecd6 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:52.968099 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e6ec3a65-3d8c-47d7-8620-9e3c12fbecd6 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:52.968978 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e6ec3a65-3d8c-47d7-8620-9e3c12fbecd6 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:52.969576 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e6ec3a65-3d8c-47d7-8620-9e3c12fbecd6 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:52.970136 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e6ec3a65-3d8c-47d7-8620-9e3c12fbecd6 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:53.398885 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e6ec3a65-3d8c-47d7-8620-9e3c12fbecd6 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:53.425346 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e6ec3a65-3d8c-47d7-8620-9e3c12fbecd6 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:53.433189 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e6ec3a65-3d8c-47d7-8620-9e3c12fbecd6 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:53.436777 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e6ec3a65-3d8c-47d7-8620-9e3c12fbecd6 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1879 microversion: 2.32 time: 0.480632 Oct 17 13:48:53.437678 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1635/3285] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:52 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1879 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:48:53.465142 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8807b63e-d6ce-48af-9d31-237a4f57bfcb tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:53.477836 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8807b63e-d6ce-48af-9d31-237a4f57bfcb tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:53.478985 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8807b63e-d6ce-48af-9d31-237a4f57bfcb tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:53.480256 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8807b63e-d6ce-48af-9d31-237a4f57bfcb tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:53.645524 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8807b63e-d6ce-48af-9d31-237a4f57bfcb tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: a2994495-366a-446f-b7a6-16340911e17c] Going to try to stop instance {{(pid=127017) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 17 13:48:53.709739 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8807b63e-d6ce-48af-9d31-237a4f57bfcb tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "POST /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c/action" status: 202 len: 0 microversion: 2.1 time: 0.269741 Oct 17 13:48:53.710714 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1636/3286] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:48:53 2022] POST /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:48:53.722316 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-db74c54a-aa20-438f-9f5b-8d057fbd263a tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:53.723674 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-db74c54a-aa20-438f-9f5b-8d057fbd263a tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: a2994495-366a-446f-b7a6-16340911e17c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:53.731146 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db74c54a-aa20-438f-9f5b-8d057fbd263a tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:53.732051 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db74c54a-aa20-438f-9f5b-8d057fbd263a tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:53.732770 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db74c54a-aa20-438f-9f5b-8d057fbd263a tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:53.733764 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db74c54a-aa20-438f-9f5b-8d057fbd263a tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:53.734745 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db74c54a-aa20-438f-9f5b-8d057fbd263a tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:53.735542 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db74c54a-aa20-438f-9f5b-8d057fbd263a tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:53.951475 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a4276729-45c3-4ac2-9fd4-8e22f3aa6d02 tempest-FloatingIPDetailsTestJSON-589486563 tempest-FloatingIPDetailsTestJSON-589486563-project] 10.222.0.79 "DELETE /compute/v2.1/os-floating-ips/bc99f590-51d8-47ad-a246-4e600e6ed24e" status: 202 len: 0 microversion: 2.1 time: 1.998866 Oct 17 13:48:53.958245 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1651/3287] 10.222.0.79 () {58 vars in 1263 bytes} [Mon Oct 17 13:48:51 2022] DELETE /compute/v2.1/os-floating-ips/bc99f590-51d8-47ad-a246-4e600e6ed24e => generated 0 bytes in 2006 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:48:53.964550 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-453acbbb-1c82-48de-9240-4897d28efa57 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:53.970487 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-453acbbb-1c82-48de-9240-4897d28efa57 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 68363fdf-f661-4b7c-abdc-7a8a85efa83a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:53.992570 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-453acbbb-1c82-48de-9240-4897d28efa57 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:53.994908 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-453acbbb-1c82-48de-9240-4897d28efa57 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:53.996072 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-453acbbb-1c82-48de-9240-4897d28efa57 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:53.997290 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-453acbbb-1c82-48de-9240-4897d28efa57 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:53.998037 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-453acbbb-1c82-48de-9240-4897d28efa57 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:53.999719 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-453acbbb-1c82-48de-9240-4897d28efa57 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:54.056134 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-db74c54a-aa20-438f-9f5b-8d057fbd263a tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683d18db860a4d60ab3eeba2a372b2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11973b8e1d8a4af8add65726e8ba7c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:54.076500 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-db74c54a-aa20-438f-9f5b-8d057fbd263a tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c" status: 200 len: 1720 microversion: 2.1 time: 0.358209 Oct 17 13:48:54.107821 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1637/3288] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:53 2022] GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c => generated 1720 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:54.127810 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-da779652-5e9d-4789-9e90-726c08073246 tempest-FloatingIPDetailsTestJSON-589486563 tempest-FloatingIPDetailsTestJSON-589486563-project] Calling method '.version_select at 0x7f7cd9a59430>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:54.351075 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-453acbbb-1c82-48de-9240-4897d28efa57 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:54.359595 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-453acbbb-1c82-48de-9240-4897d28efa57 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a" status: 200 len: 1522 microversion: 2.1 time: 0.399954 Oct 17 13:48:54.360324 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1652/3289] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:53 2022] GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a => generated 1522 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:54.366015 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f740fb16-3391-4dff-bcda-fbe943d1c6fb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:54.366736 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f740fb16-3391-4dff-bcda-fbe943d1c6fb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: e1fb1718-c504-47dc-ab2e-28fe15d2c435] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:54.372975 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f740fb16-3391-4dff-bcda-fbe943d1c6fb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:54.373739 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f740fb16-3391-4dff-bcda-fbe943d1c6fb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:54.374385 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f740fb16-3391-4dff-bcda-fbe943d1c6fb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:54.375566 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f740fb16-3391-4dff-bcda-fbe943d1c6fb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:54.376286 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f740fb16-3391-4dff-bcda-fbe943d1c6fb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:54.376800 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f740fb16-3391-4dff-bcda-fbe943d1c6fb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:54.713820 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f740fb16-3391-4dff-bcda-fbe943d1c6fb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:54.722867 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f740fb16-3391-4dff-bcda-fbe943d1c6fb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435" status: 200 len: 1378 microversion: 2.1 time: 0.360564 Oct 17 13:48:54.723618 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1653/3290] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:54 2022] GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435 => generated 1378 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:54.734619 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6d94c95c-fcf5-4476-8364-80016d12280c tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:54.735580 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6d94c95c-fcf5-4476-8364-80016d12280c tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:54.743031 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6d94c95c-fcf5-4476-8364-80016d12280c tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:54.743686 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6d94c95c-fcf5-4476-8364-80016d12280c tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:54.744211 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6d94c95c-fcf5-4476-8364-80016d12280c tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:54.745080 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6d94c95c-fcf5-4476-8364-80016d12280c tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:54.745613 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6d94c95c-fcf5-4476-8364-80016d12280c tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:54.746941 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6d94c95c-fcf5-4476-8364-80016d12280c tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:54.918426 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=4 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:48:55.150155 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6d94c95c-fcf5-4476-8364-80016d12280c tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:55.160847 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6d94c95c-fcf5-4476-8364-80016d12280c tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:55.162677 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6d94c95c-fcf5-4476-8364-80016d12280c tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:55.164484 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6d94c95c-fcf5-4476-8364-80016d12280c tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1879 microversion: 2.32 time: 0.439539 Oct 17 13:48:55.164968 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1654/3291] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:54 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1879 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:48:55.178837 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8bcca981-fbf0-443b-981e-55345254cbeb tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:55.180217 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8bcca981-fbf0-443b-981e-55345254cbeb tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: a2994495-366a-446f-b7a6-16340911e17c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:55.188206 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8bcca981-fbf0-443b-981e-55345254cbeb tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:55.188813 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8bcca981-fbf0-443b-981e-55345254cbeb tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:55.189354 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8bcca981-fbf0-443b-981e-55345254cbeb tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:55.190888 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8bcca981-fbf0-443b-981e-55345254cbeb tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:55.191486 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8bcca981-fbf0-443b-981e-55345254cbeb tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:55.192009 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8bcca981-fbf0-443b-981e-55345254cbeb tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:55.439139 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8bcca981-fbf0-443b-981e-55345254cbeb tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683d18db860a4d60ab3eeba2a372b2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11973b8e1d8a4af8add65726e8ba7c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:55.448655 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8bcca981-fbf0-443b-981e-55345254cbeb tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c" status: 200 len: 1720 microversion: 2.1 time: 0.277233 Oct 17 13:48:55.449983 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1655/3292] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:55 2022] GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c => generated 1720 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:55.455624 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a38e44f0-438d-40f6-994f-5af43bcd8314 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:55.456869 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a38e44f0-438d-40f6-994f-5af43bcd8314 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 68363fdf-f661-4b7c-abdc-7a8a85efa83a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:55.463554 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a38e44f0-438d-40f6-994f-5af43bcd8314 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:55.464276 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a38e44f0-438d-40f6-994f-5af43bcd8314 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:55.464883 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a38e44f0-438d-40f6-994f-5af43bcd8314 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:55.466537 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a38e44f0-438d-40f6-994f-5af43bcd8314 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:55.466537 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a38e44f0-438d-40f6-994f-5af43bcd8314 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:55.467015 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a38e44f0-438d-40f6-994f-5af43bcd8314 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:55.776597 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-da779652-5e9d-4789-9e90-726c08073246 tempest-FloatingIPDetailsTestJSON-589486563 tempest-FloatingIPDetailsTestJSON-589486563-project] 10.222.0.79 "DELETE /compute/v2.1/os-floating-ips/afe24feb-5a5f-4451-94de-7aaf2a4a07c0" status: 202 len: 0 microversion: 2.1 time: 1.666699 Oct 17 13:48:55.781087 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1638/3293] 10.222.0.79 () {58 vars in 1263 bytes} [Mon Oct 17 13:48:54 2022] DELETE /compute/v2.1/os-floating-ips/afe24feb-5a5f-4451-94de-7aaf2a4a07c0 => generated 0 bytes in 1672 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:48:55.788743 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b6e04fa0-f0af-4440-b729-3812a09842b4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:55.789631 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b6e04fa0-f0af-4440-b729-3812a09842b4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 9be563ca-739e-4121-9dc8-9e46c7a131b6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:55.799777 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b6e04fa0-f0af-4440-b729-3812a09842b4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:55.800338 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b6e04fa0-f0af-4440-b729-3812a09842b4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:55.800907 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b6e04fa0-f0af-4440-b729-3812a09842b4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:55.801857 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b6e04fa0-f0af-4440-b729-3812a09842b4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:55.802406 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b6e04fa0-f0af-4440-b729-3812a09842b4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:55.802941 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b6e04fa0-f0af-4440-b729-3812a09842b4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:55.816116 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a38e44f0-438d-40f6-994f-5af43bcd8314 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:55.826649 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a38e44f0-438d-40f6-994f-5af43bcd8314 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a" status: 200 len: 1522 microversion: 2.1 time: 0.374985 Oct 17 13:48:55.844051 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1656/3294] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:55 2022] GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a => generated 1522 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:55.844051 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a85399bd-e21b-4ab4-ad95-6693084544b9 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:55.844051 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a85399bd-e21b-4ab4-ad95-6693084544b9 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: e1fb1718-c504-47dc-ab2e-28fe15d2c435] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:55.844481 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a85399bd-e21b-4ab4-ad95-6693084544b9 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:55.844948 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a85399bd-e21b-4ab4-ad95-6693084544b9 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:55.845069 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-b6e04fa0-f0af-4440-b729-3812a09842b4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] HTTP exception thrown: Instance 9be563ca-739e-4121-9dc8-9e46c7a131b6 could not be found. Oct 17 13:48:55.845487 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a85399bd-e21b-4ab4-ad95-6693084544b9 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:55.846781 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b6e04fa0-f0af-4440-b729-3812a09842b4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Request method failure captured: Oct 17 13:48:55.846781 n-d-854247-14 devstack@n-api.service[127017]: request: DELETE /compute/v2.1/servers/9be563ca-739e-4121-9dc8-9e46c7a131b6 HTTP/1.1 Oct 17 13:48:55.846781 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:48:55.846781 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:48:55.846781 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:48:55.846781 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:48:55.846781 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:48:55.846781 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:48:55.846781 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:48:55.846781 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:48:55.846781 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVwEqzYAZh4AkEjRryOAZIhaHrAKxd2Qcal9md8a5n-MMUYSdXmcWYLDVkyQoPrDIbcsApBq2EewemPkBwvNDDOidb0hhc_Z3w9BeEUj5ET_flLYPqO5hgqCsuZGXFiYIEBJxrkx614fXiELZHaNkvhSdsJHShK0w7L-UPHhkPKqi5M Oct 17 13:48:55.846781 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:48:55.846781 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:48:55.846781 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:48:55.846781 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:48:55.846781 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:48:55.846781 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:48:55.846781 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:48:55.846781 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:48:55.846781 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:48:55.846781 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:48:55.846781 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_59e65f6eb06d40d583b9f43c9af94c13", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:48:55.846781 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:48:55.846781 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:48:55.846781 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:48:55.846781 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:48:55.846781 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:48:55.846781 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:48:55.846781 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 443c44b0bd9e4c56a7fe0c1a53238545 Oct 17 13:48:55.846781 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:48:55.846781 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:48:55.846781 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 9be563ca-739e-4121-9dc8-9e46c7a131b6 could not be found. Oct 17 13:48:55.846781 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '9be563ca-739e-4121-9dc8-9e46c7a131b6'} Oct 17 13:48:55.846781 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:48:55.846781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:48:55.846781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:48:55.846781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:48:55.846781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:48:55.846781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:48:55.846781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:48:55.846781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:48:55.846781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:48:55.846781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:48:55.846781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9be563ca-739e-4121-9dc8-9e46c7a131b6 could not be found. Oct 17 13:48:55.846781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:48:55.846781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:48:55.846781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:48:55.846781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:48:55.846781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:48:55.846781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:48:55.846781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:48:55.846781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:48:55.846781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:48:55.846781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:48:55.846781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:48:55.846781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:48:55.846781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:48:55.846781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:48:55.846781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:48:55.846781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:48:55.846781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:48:55.846781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:48:55.853004 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9be563ca-739e-4121-9dc8-9e46c7a131b6 could not be found. Oct 17 13:48:55.853004 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:48:55.853004 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:48:55.853004 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:48:55.853004 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:48:55.853004 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:48:55.853004 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:48:55.853004 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:48:55.853004 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:48:55.853004 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9be563ca-739e-4121-9dc8-9e46c7a131b6 could not be found. Oct 17 13:48:55.853004 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:48:55.854780 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a85399bd-e21b-4ab4-ad95-6693084544b9 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:55.854780 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a85399bd-e21b-4ab4-ad95-6693084544b9 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:55.854780 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a85399bd-e21b-4ab4-ad95-6693084544b9 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:55.856523 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b6e04fa0-f0af-4440-b729-3812a09842b4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Returning 404 to user: Instance 9be563ca-739e-4121-9dc8-9e46c7a131b6 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:48:55.856523 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b6e04fa0-f0af-4440-b729-3812a09842b4 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "DELETE /compute/v2.1/servers/9be563ca-739e-4121-9dc8-9e46c7a131b6" status: 404 len: 111 microversion: 2.1 time: 0.068063 Oct 17 13:48:55.856523 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1639/3295] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:48:55 2022] DELETE /compute/v2.1/servers/9be563ca-739e-4121-9dc8-9e46c7a131b6 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:48:55.858143 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7c7baee0-263c-4a1d-8a9a-00f9e1773d15 tempest-FloatingIPDetailsTestJSON-589486563 tempest-FloatingIPDetailsTestJSON-589486563-project] Calling method '.version_select at 0x7f7cd5615ee0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:56.477343 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a85399bd-e21b-4ab4-ad95-6693084544b9 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:56.480184 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=100 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:48:56.487472 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a85399bd-e21b-4ab4-ad95-6693084544b9 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435" status: 200 len: 1378 microversion: 2.1 time: 0.656353 Oct 17 13:48:56.488669 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1657/3296] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:55 2022] GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435 => generated 1378 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:56.493432 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-66e8bd8a-5412-4da5-beb4-441986c69218 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:56.494194 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-66e8bd8a-5412-4da5-beb4-441986c69218 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 9be563ca-739e-4121-9dc8-9e46c7a131b6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:56.500521 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-66e8bd8a-5412-4da5-beb4-441986c69218 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:56.501192 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-66e8bd8a-5412-4da5-beb4-441986c69218 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:56.501759 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-66e8bd8a-5412-4da5-beb4-441986c69218 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:56.502712 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-66e8bd8a-5412-4da5-beb4-441986c69218 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:56.503389 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-66e8bd8a-5412-4da5-beb4-441986c69218 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:56.503951 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-66e8bd8a-5412-4da5-beb4-441986c69218 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:56.518563 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-66e8bd8a-5412-4da5-beb4-441986c69218 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] HTTP exception thrown: Instance 9be563ca-739e-4121-9dc8-9e46c7a131b6 could not be found. Oct 17 13:48:56.520140 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-66e8bd8a-5412-4da5-beb4-441986c69218 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Request method failure captured: Oct 17 13:48:56.520140 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/9be563ca-739e-4121-9dc8-9e46c7a131b6 HTTP/1.1 Oct 17 13:48:56.520140 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:48:56.520140 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:48:56.520140 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:48:56.520140 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:48:56.520140 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:48:56.520140 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:48:56.520140 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:48:56.520140 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:48:56.520140 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVwEqzYAZh4AkEjRryOAZIhaHrAKxd2Qcal9md8a5n-MMUYSdXmcWYLDVkyQoPrDIbcsApBq2EewemPkBwvNDDOidb0hhc_Z3w9BeEUj5ET_flLYPqO5hgqCsuZGXFiYIEBJxrkx614fXiELZHaNkvhSdsJHShK0w7L-UPHhkPKqi5M Oct 17 13:48:56.520140 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:48:56.520140 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:48:56.520140 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:48:56.520140 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:48:56.520140 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:48:56.520140 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:48:56.520140 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:48:56.520140 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:48:56.520140 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:48:56.520140 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:48:56.520140 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_59e65f6eb06d40d583b9f43c9af94c13", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:48:56.520140 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:48:56.520140 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:48:56.520140 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:48:56.520140 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:48:56.520140 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:48:56.520140 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:48:56.520140 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 443c44b0bd9e4c56a7fe0c1a53238545 Oct 17 13:48:56.520140 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:48:56.520140 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:48:56.520140 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 9be563ca-739e-4121-9dc8-9e46c7a131b6 could not be found. Oct 17 13:48:56.520140 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '9be563ca-739e-4121-9dc8-9e46c7a131b6'} Oct 17 13:48:56.520140 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:48:56.520140 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:48:56.520140 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:48:56.520140 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:48:56.520140 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:48:56.520140 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:48:56.520140 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:48:56.520140 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:48:56.520140 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:48:56.520140 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:48:56.520140 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9be563ca-739e-4121-9dc8-9e46c7a131b6 could not be found. Oct 17 13:48:56.520140 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:48:56.520140 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:48:56.520140 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:48:56.520140 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:48:56.520140 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:48:56.520140 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:48:56.520140 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:48:56.520140 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:48:56.520140 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:48:56.520140 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:48:56.520140 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:48:56.520140 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:48:56.520140 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:48:56.520140 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:48:56.520140 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:48:56.520140 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:48:56.520140 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9be563ca-739e-4121-9dc8-9e46c7a131b6 could not be found. Oct 17 13:48:56.520140 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:48:56.520140 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:48:56.520140 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:48:56.525525 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:48:56.525525 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:48:56.525525 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:48:56.525525 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:48:56.525525 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:48:56.525525 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9be563ca-739e-4121-9dc8-9e46c7a131b6 could not be found. Oct 17 13:48:56.525525 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:48:56.525525 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-66e8bd8a-5412-4da5-beb4-441986c69218 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Returning 404 to user: Instance 9be563ca-739e-4121-9dc8-9e46c7a131b6 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:48:56.525525 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-66e8bd8a-5412-4da5-beb4-441986c69218 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/9be563ca-739e-4121-9dc8-9e46c7a131b6" status: 404 len: 111 microversion: 2.1 time: 0.031766 Oct 17 13:48:56.525525 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1658/3297] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:56 2022] GET /compute/v2.1/servers/9be563ca-739e-4121-9dc8-9e46c7a131b6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:48:56.527235 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5590bdf8-7224-429b-b75e-317ea9c9f9e4 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:56.528078 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5590bdf8-7224-429b-b75e-317ea9c9f9e4 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:56.534185 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5590bdf8-7224-429b-b75e-317ea9c9f9e4 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:56.534664 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5590bdf8-7224-429b-b75e-317ea9c9f9e4 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:56.535091 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5590bdf8-7224-429b-b75e-317ea9c9f9e4 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:56.535820 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5590bdf8-7224-429b-b75e-317ea9c9f9e4 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:56.536263 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5590bdf8-7224-429b-b75e-317ea9c9f9e4 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:56.536675 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5590bdf8-7224-429b-b75e-317ea9c9f9e4 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:57.032366 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5590bdf8-7224-429b-b75e-317ea9c9f9e4 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:57.042776 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5590bdf8-7224-429b-b75e-317ea9c9f9e4 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:57.044255 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5590bdf8-7224-429b-b75e-317ea9c9f9e4 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:57.045436 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5590bdf8-7224-429b-b75e-317ea9c9f9e4 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1879 microversion: 2.32 time: 0.521966 Oct 17 13:48:57.059243 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1659/3298] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:56 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1879 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:48:57.059243 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-89b1af11-0a4b-4f41-8fbb-13ed8eb8bc60 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:57.059243 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-89b1af11-0a4b-4f41-8fbb-13ed8eb8bc60 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: a2994495-366a-446f-b7a6-16340911e17c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:57.059243 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-89b1af11-0a4b-4f41-8fbb-13ed8eb8bc60 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:57.059243 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-89b1af11-0a4b-4f41-8fbb-13ed8eb8bc60 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:57.059773 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-89b1af11-0a4b-4f41-8fbb-13ed8eb8bc60 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:57.060377 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-89b1af11-0a4b-4f41-8fbb-13ed8eb8bc60 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:57.061010 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-89b1af11-0a4b-4f41-8fbb-13ed8eb8bc60 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:57.061605 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-89b1af11-0a4b-4f41-8fbb-13ed8eb8bc60 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:57.374116 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-89b1af11-0a4b-4f41-8fbb-13ed8eb8bc60 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683d18db860a4d60ab3eeba2a372b2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11973b8e1d8a4af8add65726e8ba7c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:57.384491 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-89b1af11-0a4b-4f41-8fbb-13ed8eb8bc60 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c" status: 200 len: 1720 microversion: 2.1 time: 0.336839 Oct 17 13:48:57.385071 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1660/3299] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:57 2022] GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c => generated 1720 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:57.389785 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cf302b36-7f9d-47a4-9ce5-ec7452b250d9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:57.390569 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cf302b36-7f9d-47a4-9ce5-ec7452b250d9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:57.396436 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cf302b36-7f9d-47a4-9ce5-ec7452b250d9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:57.396968 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cf302b36-7f9d-47a4-9ce5-ec7452b250d9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:57.397442 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cf302b36-7f9d-47a4-9ce5-ec7452b250d9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:57.398332 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cf302b36-7f9d-47a4-9ce5-ec7452b250d9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:57.398786 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cf302b36-7f9d-47a4-9ce5-ec7452b250d9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:57.399247 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cf302b36-7f9d-47a4-9ce5-ec7452b250d9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:57.426752 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cf302b36-7f9d-47a4-9ce5-ec7452b250d9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:48:57.512165 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cf302b36-7f9d-47a4-9ce5-ec7452b250d9 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "DELETE /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 204 len: 0 microversion: 2.1 time: 0.125682 Oct 17 13:48:57.513021 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1661/3300] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:48:57 2022] DELETE /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:48:57.586927 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-094178ee-9cbe-434a-a320-3b8324121ffe req-f923c650-77f6-4803-af97-0cc234501134 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1fb1718-c504-47dc-ab2e-28fe15d2c435", "tag": "391b5d37-7616-4b7e-974a-cd5f28f3eb9a"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:57.600965 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-094178ee-9cbe-434a-a320-3b8324121ffe req-f923c650-77f6-4803-af97-0cc234501134 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:57.601608 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-094178ee-9cbe-434a-a320-3b8324121ffe req-f923c650-77f6-4803-af97-0cc234501134 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:57.602112 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-094178ee-9cbe-434a-a320-3b8324121ffe req-f923c650-77f6-4803-af97-0cc234501134 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:57.614675 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-094178ee-9cbe-434a-a320-3b8324121ffe req-f923c650-77f6-4803-af97-0cc234501134 service nova] Creating event network-changed:391b5d37-7616-4b7e-974a-cd5f28f3eb9a for instance e1fb1718-c504-47dc-ab2e-28fe15d2c435 on n-h1-854247-14 Oct 17 13:48:57.619770 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-094178ee-9cbe-434a-a320-3b8324121ffe req-f923c650-77f6-4803-af97-0cc234501134 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102295 Oct 17 13:48:57.620470 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1662/3301] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:48:57.625754 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d851dd26-47d6-4a06-a351-a5340475b003 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:57.626507 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d851dd26-47d6-4a06-a351-a5340475b003 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 68363fdf-f661-4b7c-abdc-7a8a85efa83a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:57.633278 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d851dd26-47d6-4a06-a351-a5340475b003 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:57.633731 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d851dd26-47d6-4a06-a351-a5340475b003 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:57.634162 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d851dd26-47d6-4a06-a351-a5340475b003 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:57.634858 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d851dd26-47d6-4a06-a351-a5340475b003 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:57.635631 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d851dd26-47d6-4a06-a351-a5340475b003 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:57.635787 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d851dd26-47d6-4a06-a351-a5340475b003 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:57.651496 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7c7baee0-263c-4a1d-8a9a-00f9e1773d15 tempest-FloatingIPDetailsTestJSON-589486563 tempest-FloatingIPDetailsTestJSON-589486563-project] 10.222.0.79 "DELETE /compute/v2.1/os-floating-ips/248f0b3d-eefd-4c6b-b550-9108bbbb38f4" status: 202 len: 0 microversion: 2.1 time: 1.798935 Oct 17 13:48:57.652112 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1640/3302] 10.222.0.79 () {58 vars in 1263 bytes} [Mon Oct 17 13:48:55 2022] DELETE /compute/v2.1/os-floating-ips/248f0b3d-eefd-4c6b-b550-9108bbbb38f4 => generated 0 bytes in 1800 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:48:57.656769 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a0607251-a3d8-4fe4-9d4a-bbca8974270a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:57.657384 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a0607251-a3d8-4fe4-9d4a-bbca8974270a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: e1fb1718-c504-47dc-ab2e-28fe15d2c435] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:57.664827 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a0607251-a3d8-4fe4-9d4a-bbca8974270a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:57.665320 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a0607251-a3d8-4fe4-9d4a-bbca8974270a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:57.665760 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a0607251-a3d8-4fe4-9d4a-bbca8974270a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:57.666471 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a0607251-a3d8-4fe4-9d4a-bbca8974270a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:57.666934 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a0607251-a3d8-4fe4-9d4a-bbca8974270a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:57.667388 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a0607251-a3d8-4fe4-9d4a-bbca8974270a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:57.847900 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d851dd26-47d6-4a06-a351-a5340475b003 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:57.857794 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d851dd26-47d6-4a06-a351-a5340475b003 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a" status: 200 len: 1522 microversion: 2.1 time: 0.236043 Oct 17 13:48:57.869508 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a0607251-a3d8-4fe4-9d4a-bbca8974270a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:57.870088 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1663/3303] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:57 2022] GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:57.873163 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a0607251-a3d8-4fe4-9d4a-bbca8974270a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435" status: 200 len: 1378 microversion: 2.1 time: 0.219970 Oct 17 13:48:57.876458 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9e728a94-2f34-43a8-a412-96e149adce99 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:57.877075 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9e728a94-2f34-43a8-a412-96e149adce99 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:57.882104 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1641/3304] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:57 2022] GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435 => generated 1378 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:57.885559 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9e728a94-2f34-43a8-a412-96e149adce99 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:57.886103 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9e728a94-2f34-43a8-a412-96e149adce99 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:57.886595 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9e728a94-2f34-43a8-a412-96e149adce99 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:57.887435 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9e728a94-2f34-43a8-a412-96e149adce99 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:57.887993 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9e728a94-2f34-43a8-a412-96e149adce99 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:57.888500 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9e728a94-2f34-43a8-a412-96e149adce99 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:58.034727 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9e728a94-2f34-43a8-a412-96e149adce99 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:58.043596 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9e728a94-2f34-43a8-a412-96e149adce99 tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1512 microversion: 2.1 time: 0.171731 Oct 17 13:48:58.044185 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1664/3305] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:57 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1512 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:58.074122 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4be7a7c5-18d3-4163-a721-2c0d5d08d4ba tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:58.074895 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4be7a7c5-18d3-4163-a721-2c0d5d08d4ba tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:58.082292 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4be7a7c5-18d3-4163-a721-2c0d5d08d4ba tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:58.082777 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4be7a7c5-18d3-4163-a721-2c0d5d08d4ba tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:58.083247 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4be7a7c5-18d3-4163-a721-2c0d5d08d4ba tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:58.084039 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4be7a7c5-18d3-4163-a721-2c0d5d08d4ba tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:58.084510 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4be7a7c5-18d3-4163-a721-2c0d5d08d4ba tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:58.084931 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4be7a7c5-18d3-4163-a721-2c0d5d08d4ba tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:58.281527 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4be7a7c5-18d3-4163-a721-2c0d5d08d4ba tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:58.294992 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4be7a7c5-18d3-4163-a721-2c0d5d08d4ba tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:58.297468 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4be7a7c5-18d3-4163-a721-2c0d5d08d4ba tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:58.299395 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4be7a7c5-18d3-4163-a721-2c0d5d08d4ba tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1879 microversion: 2.32 time: 0.229379 Oct 17 13:48:58.300119 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1642/3306] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:58 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1879 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:48:58.408973 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-10abb243-f075-4614-824f-32319ec2db5b tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:58.409810 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-10abb243-f075-4614-824f-32319ec2db5b tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: a2994495-366a-446f-b7a6-16340911e17c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:58.416443 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-10abb243-f075-4614-824f-32319ec2db5b tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:58.416929 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-10abb243-f075-4614-824f-32319ec2db5b tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:58.417369 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-10abb243-f075-4614-824f-32319ec2db5b tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:58.418073 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-10abb243-f075-4614-824f-32319ec2db5b tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:58.418525 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-10abb243-f075-4614-824f-32319ec2db5b tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:58.418949 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-10abb243-f075-4614-824f-32319ec2db5b tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:58.554657 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-10abb243-f075-4614-824f-32319ec2db5b tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683d18db860a4d60ab3eeba2a372b2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11973b8e1d8a4af8add65726e8ba7c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:58.564428 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-10abb243-f075-4614-824f-32319ec2db5b tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c" status: 200 len: 1720 microversion: 2.1 time: 0.159624 Oct 17 13:48:58.565048 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1665/3307] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:58 2022] GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:58.882564 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d87cd9d2-9937-45ad-8d7a-319b50d5819f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:58.883221 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d87cd9d2-9937-45ad-8d7a-319b50d5819f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 68363fdf-f661-4b7c-abdc-7a8a85efa83a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:58.889875 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d87cd9d2-9937-45ad-8d7a-319b50d5819f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:58.890485 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d87cd9d2-9937-45ad-8d7a-319b50d5819f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:58.890819 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d87cd9d2-9937-45ad-8d7a-319b50d5819f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:58.893372 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d87cd9d2-9937-45ad-8d7a-319b50d5819f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:58.893372 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d87cd9d2-9937-45ad-8d7a-319b50d5819f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:58.893372 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d87cd9d2-9937-45ad-8d7a-319b50d5819f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:58.901672 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ebe605cf-26ca-4606-8c0f-33b8dcd611ed tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:58.902511 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ebe605cf-26ca-4606-8c0f-33b8dcd611ed tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: e1fb1718-c504-47dc-ab2e-28fe15d2c435] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:58.913169 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ebe605cf-26ca-4606-8c0f-33b8dcd611ed tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:58.914198 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ebe605cf-26ca-4606-8c0f-33b8dcd611ed tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:58.915023 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ebe605cf-26ca-4606-8c0f-33b8dcd611ed tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:58.916005 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ebe605cf-26ca-4606-8c0f-33b8dcd611ed tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:58.917406 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ebe605cf-26ca-4606-8c0f-33b8dcd611ed tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:58.918090 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ebe605cf-26ca-4606-8c0f-33b8dcd611ed tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:59.235648 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d87cd9d2-9937-45ad-8d7a-319b50d5819f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:59.241239 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ebe605cf-26ca-4606-8c0f-33b8dcd611ed tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:59.246350 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d87cd9d2-9937-45ad-8d7a-319b50d5819f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a" status: 200 len: 1522 microversion: 2.1 time: 0.368302 Oct 17 13:48:59.250801 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ebe605cf-26ca-4606-8c0f-33b8dcd611ed tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435" status: 200 len: 1378 microversion: 2.1 time: 0.356012 Oct 17 13:48:59.255795 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1643/3308] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:58 2022] GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a => generated 1522 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:59.270957 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1666/3309] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:58 2022] GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435 => generated 1378 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:59.271238 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-de18ebdf-e06c-4599-9560-c4fffe0a98fd tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:59.271907 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-de18ebdf-e06c-4599-9560-c4fffe0a98fd tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:59.279657 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-de18ebdf-e06c-4599-9560-c4fffe0a98fd tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:59.280418 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-de18ebdf-e06c-4599-9560-c4fffe0a98fd tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:59.281029 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-de18ebdf-e06c-4599-9560-c4fffe0a98fd tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:59.281917 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-de18ebdf-e06c-4599-9560-c4fffe0a98fd tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:59.282532 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-de18ebdf-e06c-4599-9560-c4fffe0a98fd tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:59.283117 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-de18ebdf-e06c-4599-9560-c4fffe0a98fd tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:59.327076 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0978c97d-d98c-4c78-82db-7febb20796eb tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:59.327716 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0978c97d-d98c-4c78-82db-7febb20796eb tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:59.338657 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0978c97d-d98c-4c78-82db-7febb20796eb tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:59.339160 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0978c97d-d98c-4c78-82db-7febb20796eb tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:59.340132 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0978c97d-d98c-4c78-82db-7febb20796eb tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:59.340887 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0978c97d-d98c-4c78-82db-7febb20796eb tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:59.341348 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0978c97d-d98c-4c78-82db-7febb20796eb tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:59.341767 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0978c97d-d98c-4c78-82db-7febb20796eb tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:59.509172 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-de18ebdf-e06c-4599-9560-c4fffe0a98fd tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:59.518234 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-de18ebdf-e06c-4599-9560-c4fffe0a98fd tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1512 microversion: 2.1 time: 0.258585 Oct 17 13:48:59.523893 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1644/3310] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:59 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1512 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:59.594315 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d407143b-5b2b-44e5-8e93-d86faa172cb6 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:59.595411 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d407143b-5b2b-44e5-8e93-d86faa172cb6 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: a2994495-366a-446f-b7a6-16340911e17c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:59.602686 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d407143b-5b2b-44e5-8e93-d86faa172cb6 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:59.603428 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d407143b-5b2b-44e5-8e93-d86faa172cb6 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:59.604024 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d407143b-5b2b-44e5-8e93-d86faa172cb6 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:59.604888 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d407143b-5b2b-44e5-8e93-d86faa172cb6 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:59.605537 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d407143b-5b2b-44e5-8e93-d86faa172cb6 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:59.606104 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d407143b-5b2b-44e5-8e93-d86faa172cb6 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:59.653468 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0978c97d-d98c-4c78-82db-7febb20796eb tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:59.665604 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0978c97d-d98c-4c78-82db-7febb20796eb tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:59.667432 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0978c97d-d98c-4c78-82db-7febb20796eb tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:59.668952 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0978c97d-d98c-4c78-82db-7febb20796eb tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1879 microversion: 2.32 time: 0.346583 Oct 17 13:48:59.679610 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1667/3311] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:59 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1879 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:48:59.918358 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d407143b-5b2b-44e5-8e93-d86faa172cb6 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683d18db860a4d60ab3eeba2a372b2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11973b8e1d8a4af8add65726e8ba7c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:59.930776 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d407143b-5b2b-44e5-8e93-d86faa172cb6 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c" status: 200 len: 1720 microversion: 2.1 time: 0.345857 Oct 17 13:48:59.944788 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1645/3312] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:59 2022] GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c => generated 1720 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:00.270528 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-44cd7323-3551-42c1-b1ab-75ddc7f407ed tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:00.272625 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-44cd7323-3551-42c1-b1ab-75ddc7f407ed tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 68363fdf-f661-4b7c-abdc-7a8a85efa83a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:00.280016 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5efc0a12-1412-4588-8475-65e62746c28d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:00.280950 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5efc0a12-1412-4588-8475-65e62746c28d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: e1fb1718-c504-47dc-ab2e-28fe15d2c435] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:00.285153 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-44cd7323-3551-42c1-b1ab-75ddc7f407ed tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:00.285647 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-44cd7323-3551-42c1-b1ab-75ddc7f407ed tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:00.286086 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-44cd7323-3551-42c1-b1ab-75ddc7f407ed tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:00.286802 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-44cd7323-3551-42c1-b1ab-75ddc7f407ed tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:00.287286 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-44cd7323-3551-42c1-b1ab-75ddc7f407ed tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:00.287715 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-44cd7323-3551-42c1-b1ab-75ddc7f407ed tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:00.296578 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5efc0a12-1412-4588-8475-65e62746c28d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:00.297685 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5efc0a12-1412-4588-8475-65e62746c28d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:00.298333 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5efc0a12-1412-4588-8475-65e62746c28d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:00.299761 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5efc0a12-1412-4588-8475-65e62746c28d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:00.300818 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5efc0a12-1412-4588-8475-65e62746c28d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:00.301457 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5efc0a12-1412-4588-8475-65e62746c28d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:00.562014 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:49:00.610718 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5efc0a12-1412-4588-8475-65e62746c28d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:00.613038 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-44cd7323-3551-42c1-b1ab-75ddc7f407ed tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:00.621670 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5efc0a12-1412-4588-8475-65e62746c28d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435" status: 200 len: 1378 microversion: 2.1 time: 0.347471 Oct 17 13:49:00.624881 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-44cd7323-3551-42c1-b1ab-75ddc7f407ed tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a" status: 200 len: 1522 microversion: 2.1 time: 0.358647 Oct 17 13:49:00.632181 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1668/3313] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:00 2022] GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a => generated 1522 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:00.635668 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1646/3314] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:00 2022] GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435 => generated 1378 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:00.640618 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c561708e-98bd-4daa-8ccb-1ae895bdbffc tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:00.641238 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c561708e-98bd-4daa-8ccb-1ae895bdbffc tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:00.648414 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c561708e-98bd-4daa-8ccb-1ae895bdbffc tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:00.648826 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-9510ddae-d908-4b3b-bedd-bf92d1ee6984 req-ce065262-dbc3-46c6-b494-d865290ea679 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ef00d34-7f81-4649-a90a-a52cf78dbeca", "name": "network-vif-deleted", "tag": "841d5cd2-6ca1-435c-ac29-bfeee122d7fe"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:49:00.649376 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c561708e-98bd-4daa-8ccb-1ae895bdbffc tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:00.649985 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c561708e-98bd-4daa-8ccb-1ae895bdbffc tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:00.650873 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c561708e-98bd-4daa-8ccb-1ae895bdbffc tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:00.651756 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c561708e-98bd-4daa-8ccb-1ae895bdbffc tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:00.652349 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c561708e-98bd-4daa-8ccb-1ae895bdbffc tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:00.663039 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-9510ddae-d908-4b3b-bedd-bf92d1ee6984 req-ce065262-dbc3-46c6-b494-d865290ea679 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:00.663744 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-9510ddae-d908-4b3b-bedd-bf92d1ee6984 req-ce065262-dbc3-46c6-b494-d865290ea679 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:00.664312 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-9510ddae-d908-4b3b-bedd-bf92d1ee6984 req-ce065262-dbc3-46c6-b494-d865290ea679 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:00.678273 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-9510ddae-d908-4b3b-bedd-bf92d1ee6984 req-ce065262-dbc3-46c6-b494-d865290ea679 service nova] Creating event network-vif-deleted:841d5cd2-6ca1-435c-ac29-bfeee122d7fe for instance 5ef00d34-7f81-4649-a90a-a52cf78dbeca on n-h2-854247-14 Oct 17 13:49:00.683989 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-9510ddae-d908-4b3b-bedd-bf92d1ee6984 req-ce065262-dbc3-46c6-b494-d865290ea679 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050216 Oct 17 13:49:00.684993 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1669/3315] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:49:00.695104 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c561708e-98bd-4daa-8ccb-1ae895bdbffc tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:00.695640 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c561708e-98bd-4daa-8ccb-1ae895bdbffc tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:00.696086 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c561708e-98bd-4daa-8ccb-1ae895bdbffc tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:00.696893 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-c561708e-98bd-4daa-8ccb-1ae895bdbffc tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lazy-loading 'fault' on Instance uuid 5ef00d34-7f81-4649-a90a-a52cf78dbeca {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:49:00.702507 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-29fcca34-24bc-440c-b19f-76b70b9b3a50 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:00.704083 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-29fcca34-24bc-440c-b19f-76b70b9b3a50 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:00.713573 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-29fcca34-24bc-440c-b19f-76b70b9b3a50 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:00.714218 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-29fcca34-24bc-440c-b19f-76b70b9b3a50 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:00.714856 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-29fcca34-24bc-440c-b19f-76b70b9b3a50 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:00.715944 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-29fcca34-24bc-440c-b19f-76b70b9b3a50 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:00.716620 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-29fcca34-24bc-440c-b19f-76b70b9b3a50 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:00.717284 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-29fcca34-24bc-440c-b19f-76b70b9b3a50 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:00.844533 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c561708e-98bd-4daa-8ccb-1ae895bdbffc tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '443c44b0bd9e4c56a7fe0c1a53238545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e65f6eb06d40d583b9f43c9af94c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:00.853364 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c561708e-98bd-4daa-8ccb-1ae895bdbffc tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 200 len: 1307 microversion: 2.1 time: 0.216486 Oct 17 13:49:00.853965 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1647/3316] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:00 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 1307 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:00.963040 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3fb17c5e-58e3-497f-8dc0-ee44b0eb17c3 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:00.963932 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3fb17c5e-58e3-497f-8dc0-ee44b0eb17c3 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: a2994495-366a-446f-b7a6-16340911e17c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:00.973557 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3fb17c5e-58e3-497f-8dc0-ee44b0eb17c3 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:00.974312 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3fb17c5e-58e3-497f-8dc0-ee44b0eb17c3 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:00.975504 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3fb17c5e-58e3-497f-8dc0-ee44b0eb17c3 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:00.980629 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3fb17c5e-58e3-497f-8dc0-ee44b0eb17c3 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:00.981419 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3fb17c5e-58e3-497f-8dc0-ee44b0eb17c3 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:00.982030 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3fb17c5e-58e3-497f-8dc0-ee44b0eb17c3 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:01.014891 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-29fcca34-24bc-440c-b19f-76b70b9b3a50 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:01.025251 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-29fcca34-24bc-440c-b19f-76b70b9b3a50 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:01.027230 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-29fcca34-24bc-440c-b19f-76b70b9b3a50 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:01.028985 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-29fcca34-24bc-440c-b19f-76b70b9b3a50 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1879 microversion: 2.32 time: 0.331922 Oct 17 13:49:01.043325 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1670/3317] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:49:00 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1879 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:49:01.175532 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3fb17c5e-58e3-497f-8dc0-ee44b0eb17c3 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683d18db860a4d60ab3eeba2a372b2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11973b8e1d8a4af8add65726e8ba7c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:01.186362 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3fb17c5e-58e3-497f-8dc0-ee44b0eb17c3 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c" status: 200 len: 1720 microversion: 2.1 time: 0.229578 Oct 17 13:49:01.192891 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1648/3318] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:00 2022] GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c => generated 1720 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:01.651217 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3afc59f7-cfeb-4159-a308-07b3dee873f8 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:01.651976 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3afc59f7-cfeb-4159-a308-07b3dee873f8 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: e1fb1718-c504-47dc-ab2e-28fe15d2c435] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:01.652641 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1e733494-b892-4e74-8dd9-772ad3fa653d tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:01.653244 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1e733494-b892-4e74-8dd9-772ad3fa653d tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 68363fdf-f661-4b7c-abdc-7a8a85efa83a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:01.654265 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=8 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:49:01.660745 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3afc59f7-cfeb-4159-a308-07b3dee873f8 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:01.661274 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3afc59f7-cfeb-4159-a308-07b3dee873f8 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:01.661710 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3afc59f7-cfeb-4159-a308-07b3dee873f8 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:01.662178 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1e733494-b892-4e74-8dd9-772ad3fa653d tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:01.662752 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3afc59f7-cfeb-4159-a308-07b3dee873f8 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:01.663196 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1e733494-b892-4e74-8dd9-772ad3fa653d tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:01.663535 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3afc59f7-cfeb-4159-a308-07b3dee873f8 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:01.664006 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1e733494-b892-4e74-8dd9-772ad3fa653d tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:01.664230 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3afc59f7-cfeb-4159-a308-07b3dee873f8 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:01.664455 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1e733494-b892-4e74-8dd9-772ad3fa653d tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:01.665099 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1e733494-b892-4e74-8dd9-772ad3fa653d tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:01.665619 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1e733494-b892-4e74-8dd9-772ad3fa653d tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:01.671104 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:49:01.901123 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3afc59f7-cfeb-4159-a308-07b3dee873f8 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:01.908101 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1e733494-b892-4e74-8dd9-772ad3fa653d tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:01.910663 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3afc59f7-cfeb-4159-a308-07b3dee873f8 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435" status: 200 len: 1378 microversion: 2.1 time: 0.265018 Oct 17 13:49:01.911523 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1671/3319] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:01 2022] GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435 => generated 1378 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:01.923330 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1e733494-b892-4e74-8dd9-772ad3fa653d tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a" status: 200 len: 1522 microversion: 2.1 time: 0.268522 Oct 17 13:49:01.923330 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1649/3320] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:01 2022] GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:01.936195 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4f49cd17-8a30-4f62-9a12-18a221ab4e1d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:01.936883 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4f49cd17-8a30-4f62-9a12-18a221ab4e1d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] [instance: 5ef00d34-7f81-4649-a90a-a52cf78dbeca] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:01.943117 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4f49cd17-8a30-4f62-9a12-18a221ab4e1d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:01.943676 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4f49cd17-8a30-4f62-9a12-18a221ab4e1d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:01.944113 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4f49cd17-8a30-4f62-9a12-18a221ab4e1d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:01.944817 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4f49cd17-8a30-4f62-9a12-18a221ab4e1d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:01.945268 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4f49cd17-8a30-4f62-9a12-18a221ab4e1d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:01.945695 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4f49cd17-8a30-4f62-9a12-18a221ab4e1d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:01.960648 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-4f49cd17-8a30-4f62-9a12-18a221ab4e1d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] HTTP exception thrown: Instance 5ef00d34-7f81-4649-a90a-a52cf78dbeca could not be found. Oct 17 13:49:01.962214 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4f49cd17-8a30-4f62-9a12-18a221ab4e1d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Request method failure captured: Oct 17 13:49:01.962214 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca HTTP/1.1 Oct 17 13:49:01.962214 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:49:01.962214 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:49:01.962214 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:49:01.962214 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:49:01.962214 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:49:01.962214 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:49:01.962214 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:49:01.962214 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:49:01.962214 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVwEqzYAZh4AkEjRryOAZIhaHrAKxd2Qcal9md8a5n-MMUYSdXmcWYLDVkyQoPrDIbcsApBq2EewemPkBwvNDDOidb0hhc_Z3w9BeEUj5ET_flLYPqO5hgqCsuZGXFiYIEBJxrkx614fXiELZHaNkvhSdsJHShK0w7L-UPHhkPKqi5M Oct 17 13:49:01.962214 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:49:01.962214 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:49:01.962214 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:49:01.962214 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:49:01.962214 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:49:01.962214 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:49:01.962214 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:49:01.962214 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:49:01.962214 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:49:01.962214 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:49:01.962214 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/59e65f6eb06d40d583b9f43c9af94c13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_59e65f6eb06d40d583b9f43c9af94c13", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:49:01.962214 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:49:01.962214 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 59e65f6eb06d40d583b9f43c9af94c13 Oct 17 13:49:01.962214 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1245737498 Oct 17 13:49:01.962214 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:49:01.962214 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:49:01.962214 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:49:01.962214 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 443c44b0bd9e4c56a7fe0c1a53238545 Oct 17 13:49:01.962214 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServersNegativeTestJSON-1245737498-project Oct 17 13:49:01.962214 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:49:01.962214 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 5ef00d34-7f81-4649-a90a-a52cf78dbeca could not be found. Oct 17 13:49:01.962214 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '5ef00d34-7f81-4649-a90a-a52cf78dbeca'} Oct 17 13:49:01.962214 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:49:01.962214 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:49:01.962214 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:49:01.962214 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:49:01.962214 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:49:01.962214 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:49:01.962214 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:49:01.962214 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:49:01.962214 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:49:01.962214 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:49:01.962214 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ef00d34-7f81-4649-a90a-a52cf78dbeca could not be found. Oct 17 13:49:01.962214 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:49:01.962214 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:49:01.962214 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:49:01.962214 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:49:01.962214 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:49:01.962214 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:49:01.962214 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:49:01.962214 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:49:01.962214 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:49:01.962214 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:49:01.962214 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:49:01.962214 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:49:01.962214 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:49:01.962214 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:49:01.962214 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:49:01.962214 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:49:01.962214 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ef00d34-7f81-4649-a90a-a52cf78dbeca could not be found. Oct 17 13:49:01.962214 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:49:01.962214 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:49:01.962214 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:49:01.971201 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:49:01.971201 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:49:01.971201 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:49:01.971201 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:49:01.971201 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:49:01.971201 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ef00d34-7f81-4649-a90a-a52cf78dbeca could not be found. Oct 17 13:49:01.971201 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:49:01.971201 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4f49cd17-8a30-4f62-9a12-18a221ab4e1d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] Returning 404 to user: Instance 5ef00d34-7f81-4649-a90a-a52cf78dbeca could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:49:01.971201 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4f49cd17-8a30-4f62-9a12-18a221ab4e1d tempest-ServersNegativeTestJSON-1245737498 tempest-ServersNegativeTestJSON-1245737498-project] 10.222.0.79 "GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca" status: 404 len: 111 microversion: 2.1 time: 0.031276 Oct 17 13:49:01.971201 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1650/3321] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:01 2022] GET /compute/v2.1/servers/5ef00d34-7f81-4649-a90a-a52cf78dbeca => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:49:02.057696 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0413b6e1-f892-44f7-b756-9b570490b29f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:02.058308 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0413b6e1-f892-44f7-b756-9b570490b29f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:02.066052 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0413b6e1-f892-44f7-b756-9b570490b29f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:02.066546 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0413b6e1-f892-44f7-b756-9b570490b29f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:02.067275 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0413b6e1-f892-44f7-b756-9b570490b29f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:02.068253 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0413b6e1-f892-44f7-b756-9b570490b29f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:02.068856 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0413b6e1-f892-44f7-b756-9b570490b29f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:02.069674 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0413b6e1-f892-44f7-b756-9b570490b29f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:02.222570 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-01c2d39e-9d5c-4434-85ae-a465c00fc42e tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:02.223713 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-01c2d39e-9d5c-4434-85ae-a465c00fc42e tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: a2994495-366a-446f-b7a6-16340911e17c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:02.236188 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-01c2d39e-9d5c-4434-85ae-a465c00fc42e tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:02.237911 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-01c2d39e-9d5c-4434-85ae-a465c00fc42e tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:02.239912 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-01c2d39e-9d5c-4434-85ae-a465c00fc42e tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:02.242197 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-01c2d39e-9d5c-4434-85ae-a465c00fc42e tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:02.242677 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-01c2d39e-9d5c-4434-85ae-a465c00fc42e tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:02.243112 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-01c2d39e-9d5c-4434-85ae-a465c00fc42e tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:02.816386 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0413b6e1-f892-44f7-b756-9b570490b29f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:02.829808 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0413b6e1-f892-44f7-b756-9b570490b29f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:02.831927 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0413b6e1-f892-44f7-b756-9b570490b29f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:02.833208 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0413b6e1-f892-44f7-b756-9b570490b29f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1879 microversion: 2.32 time: 0.780904 Oct 17 13:49:02.833894 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1672/3322] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:49:02 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1879 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:49:02.886381 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-01c2d39e-9d5c-4434-85ae-a465c00fc42e tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683d18db860a4d60ab3eeba2a372b2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11973b8e1d8a4af8add65726e8ba7c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:02.895057 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-01c2d39e-9d5c-4434-85ae-a465c00fc42e tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c" status: 200 len: 1720 microversion: 2.1 time: 0.677354 Oct 17 13:49:02.895673 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1651/3323] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:02 2022] GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c => generated 1720 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:02.935820 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e313e779-85b4-4dea-8ad1-f25bc2d7019f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:02.936440 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e313e779-85b4-4dea-8ad1-f25bc2d7019f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: e1fb1718-c504-47dc-ab2e-28fe15d2c435] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:02.943812 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c73e5da1-be21-4451-bf14-60e8232476da tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:02.944084 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e313e779-85b4-4dea-8ad1-f25bc2d7019f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:02.944622 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e313e779-85b4-4dea-8ad1-f25bc2d7019f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:02.945783 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c73e5da1-be21-4451-bf14-60e8232476da tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 68363fdf-f661-4b7c-abdc-7a8a85efa83a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:02.945926 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e313e779-85b4-4dea-8ad1-f25bc2d7019f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:02.946979 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e313e779-85b4-4dea-8ad1-f25bc2d7019f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:02.947484 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e313e779-85b4-4dea-8ad1-f25bc2d7019f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:02.947880 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e313e779-85b4-4dea-8ad1-f25bc2d7019f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:02.956895 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c73e5da1-be21-4451-bf14-60e8232476da tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:02.957391 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c73e5da1-be21-4451-bf14-60e8232476da tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:02.957829 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c73e5da1-be21-4451-bf14-60e8232476da tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:02.958538 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c73e5da1-be21-4451-bf14-60e8232476da tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:02.958995 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c73e5da1-be21-4451-bf14-60e8232476da tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:02.959602 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c73e5da1-be21-4451-bf14-60e8232476da tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:03.261419 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e313e779-85b4-4dea-8ad1-f25bc2d7019f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:03.269614 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e313e779-85b4-4dea-8ad1-f25bc2d7019f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435" status: 200 len: 1378 microversion: 2.1 time: 0.338966 Oct 17 13:49:03.270269 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1673/3324] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:02 2022] GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435 => generated 1378 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:03.292017 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c73e5da1-be21-4451-bf14-60e8232476da tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:03.300852 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c73e5da1-be21-4451-bf14-60e8232476da tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a" status: 200 len: 1522 microversion: 2.1 time: 0.362345 Oct 17 13:49:03.301562 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1652/3325] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:02 2022] GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a => generated 1522 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:03.397861 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c0d651db-4ad9-46e0-be75-018811323dcf tempest-ImagesMetadataNegativeTestJSON-1279951188 tempest-ImagesMetadataNegativeTestJSON-1279951188-project] Calling method '.version_select at 0x7f7cd44aa8b0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:03.419655 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-c0d651db-4ad9-46e0-be75-018811323dcf tempest-ImagesMetadataNegativeTestJSON-1279951188 tempest-ImagesMetadataNegativeTestJSON-1279951188-project] HTTP exception thrown: Image not found. Oct 17 13:49:03.426022 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c0d651db-4ad9-46e0-be75-018811323dcf tempest-ImagesMetadataNegativeTestJSON-1279951188 tempest-ImagesMetadataNegativeTestJSON-1279951188-project] Request method failure captured: Oct 17 13:49:03.426022 n-d-854247-14 devstack@n-api.service[127016]: request: DELETE /compute/v2.1/images/61653d93-f378-417c-9940-7398b8699693/metadata/os_distro HTTP/1.1 Oct 17 13:49:03.426022 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:49:03.426022 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:49:03.426022 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:49:03.426022 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:49:03.426022 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:49:03.426022 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:49:03.426022 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:49:03.426022 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:49:03.426022 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTV1PnEKTYZr7KqCVAEox35-u4FAWgkPDXuX2pLNOcKicz-rF0HueZi8kLWkr1KwnDMRZtDPtCtAPQQhCZPUBwe_VDrjyDRsmTQVx3APuCcE9sTNopo6j2d_NVURpvrokLVpOJV_0lvhoRESc1cptyj8xK5Qf6_poYwxmFhWDaD7VkNY Oct 17 13:49:03.426022 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:49:03.426022 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:49:03.426022 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:49:03.426022 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:49:03.426022 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:49:03.426022 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:49:03.426022 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 388f978e1a2b4f458b9d9460b5c5a74b Oct 17 13:49:03.426022 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1279951188 Oct 17 13:49:03.426022 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:49:03.426022 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:49:03.426022 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/388f978e1a2b4f458b9d9460b5c5a74b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/388f978e1a2b4f458b9d9460b5c5a74b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/388f978e1a2b4f458b9d9460b5c5a74b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_388f978e1a2b4f458b9d9460b5c5a74b", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:49:03.426022 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1279951188 Oct 17 13:49:03.426022 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 388f978e1a2b4f458b9d9460b5c5a74b Oct 17 13:49:03.426022 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1279951188 Oct 17 13:49:03.426022 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ImagesMetadataNegativeTestJSON-1279951188-project Oct 17 13:49:03.426022 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:49:03.426022 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:49:03.426022 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 6d2545bf3bcc413dabcd3a8c1ce0ddab Oct 17 13:49:03.426022 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1279951188-project Oct 17 13:49:03.426022 n-d-854247-14 devstack@n-api.service[127016]: method: Oct 17 13:49:03.426022 n-d-854247-14 devstack@n-api.service[127016]: exception: Image not found. Oct 17 13:49:03.426022 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'image_id': '61653d93-f378-417c-9940-7398b8699693', 'id': 'os_distro'} Oct 17 13:49:03.426022 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:49:03.426022 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:49:03.426022 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 13:49:03.426022 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 13:49:03.426022 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:49:03.426022 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:49:03.426022 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 13:49:03.426022 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 13:49:03.426022 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:49:03.426022 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:49:03.426022 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 13:49:03.426022 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 13:49:03.426022 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 13:49:03.426022 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 13:49:03.426022 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:49:03.426022 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:49:03.426022 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:49:03.426022 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:49:03.426022 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 61653d93-f378-417c-9940-7398b8699693 Oct 17 13:49:03.426022 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:49:03.426022 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:49:03.426022 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:49:03.426022 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:49:03.426022 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 17 13:49:03.426022 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 17 13:49:03.426022 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 17 13:49:03.426022 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 17 13:49:03.426022 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 17 13:49:03.426022 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 17 13:49:03.431751 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 17 13:49:03.431751 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 17 13:49:03.431751 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 13:49:03.431751 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 13:49:03.431751 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:49:03.431751 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:49:03.431751 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 13:49:03.431751 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 13:49:03.431751 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:49:03.431751 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:49:03.431751 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 13:49:03.431751 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 13:49:03.431751 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 13:49:03.431751 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 13:49:03.431751 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:49:03.431751 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:49:03.431751 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:49:03.431751 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:49:03.431751 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 61653d93-f378-417c-9940-7398b8699693 could not be found. Oct 17 13:49:03.431751 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:49:03.431751 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:49:03.431751 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:49:03.431751 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:49:03.431751 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:49:03.431751 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:49:03.431751 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:49:03.431751 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:49:03.431751 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:49:03.431751 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:49:03.431751 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:49:03.431751 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:49:03.431751 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 17 13:49:03.431751 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 17 13:49:03.431751 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 17 13:49:03.431751 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 17 13:49:03.431751 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 13:49:03.431751 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:49:03.431751 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:49:03.431751 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:49:03.431751 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:49:03.431751 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:49:03.431751 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:49:03.431751 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:49:03.431751 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:49:03.431751 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 13:49:03.431751 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:49:03.431751 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c0d651db-4ad9-46e0-be75-018811323dcf tempest-ImagesMetadataNegativeTestJSON-1279951188 tempest-ImagesMetadataNegativeTestJSON-1279951188-project] Returning 404 to user: Image not found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:49:03.431751 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c0d651db-4ad9-46e0-be75-018811323dcf tempest-ImagesMetadataNegativeTestJSON-1279951188 tempest-ImagesMetadataNegativeTestJSON-1279951188-project] 10.222.0.79 "DELETE /compute/v2.1/images/61653d93-f378-417c-9940-7398b8699693/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.156272 Oct 17 13:49:03.435800 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1674/3326] 10.222.0.79 () {58 vars in 1293 bytes} [Mon Oct 17 13:49:03 2022] DELETE /compute/v2.1/images/61653d93-f378-417c-9940-7398b8699693/metadata/os_distro => generated 62 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:49:03.439333 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7e7d69d6-b264-43e3-938a-7ce1342e6b84 tempest-ImagesMetadataNegativeTestJSON-1279951188 tempest-ImagesMetadataNegativeTestJSON-1279951188-project] Calling method '.version_select at 0x7f7cd9a74f70>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:03.462008 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-7e7d69d6-b264-43e3-938a-7ce1342e6b84 tempest-ImagesMetadataNegativeTestJSON-1279951188 tempest-ImagesMetadataNegativeTestJSON-1279951188-project] HTTP exception thrown: Image not found. Oct 17 13:49:03.464328 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7e7d69d6-b264-43e3-938a-7ce1342e6b84 tempest-ImagesMetadataNegativeTestJSON-1279951188 tempest-ImagesMetadataNegativeTestJSON-1279951188-project] Request method failure captured: Oct 17 13:49:03.464328 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/images/f08dddc9-7591-4391-9cde-24e935954a30/metadata/os_version HTTP/1.1 Oct 17 13:49:03.464328 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:49:03.464328 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:49:03.464328 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:49:03.464328 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:49:03.464328 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:49:03.464328 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:49:03.464328 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:49:03.464328 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:49:03.464328 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTV1PnEKTYZr7KqCVAEox35-u4FAWgkPDXuX2pLNOcKicz-rF0HueZi8kLWkr1KwnDMRZtDPtCtAPQQhCZPUBwe_VDrjyDRsmTQVx3APuCcE9sTNopo6j2d_NVURpvrokLVpOJV_0lvhoRESc1cptyj8xK5Qf6_poYwxmFhWDaD7VkNY Oct 17 13:49:03.464328 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:49:03.464328 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:49:03.464328 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:49:03.464328 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:49:03.464328 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:49:03.464328 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:49:03.464328 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 388f978e1a2b4f458b9d9460b5c5a74b Oct 17 13:49:03.464328 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1279951188 Oct 17 13:49:03.464328 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:49:03.464328 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:49:03.464328 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/388f978e1a2b4f458b9d9460b5c5a74b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/388f978e1a2b4f458b9d9460b5c5a74b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/388f978e1a2b4f458b9d9460b5c5a74b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_388f978e1a2b4f458b9d9460b5c5a74b", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:49:03.464328 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1279951188 Oct 17 13:49:03.464328 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 388f978e1a2b4f458b9d9460b5c5a74b Oct 17 13:49:03.464328 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1279951188 Oct 17 13:49:03.464328 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ImagesMetadataNegativeTestJSON-1279951188-project Oct 17 13:49:03.464328 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:49:03.464328 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:49:03.464328 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 6d2545bf3bcc413dabcd3a8c1ce0ddab Oct 17 13:49:03.464328 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1279951188-project Oct 17 13:49:03.464328 n-d-854247-14 devstack@n-api.service[127017]: method: Oct 17 13:49:03.464328 n-d-854247-14 devstack@n-api.service[127017]: exception: Image not found. Oct 17 13:49:03.464328 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'image_id': 'f08dddc9-7591-4391-9cde-24e935954a30', 'id': 'os_version'} Oct 17 13:49:03.464328 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:49:03.464328 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:49:03.464328 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 13:49:03.464328 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 13:49:03.464328 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:49:03.464328 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:49:03.464328 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 13:49:03.464328 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 13:49:03.464328 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:49:03.464328 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:49:03.464328 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 13:49:03.464328 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 13:49:03.464328 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 13:49:03.464328 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 13:49:03.464328 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:49:03.464328 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:49:03.464328 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:49:03.464328 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:49:03.464328 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f08dddc9-7591-4391-9cde-24e935954a30 Oct 17 13:49:03.464328 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:49:03.464328 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:49:03.464328 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:49:03.464328 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:49:03.464328 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 17 13:49:03.464328 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 17 13:49:03.464328 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 17 13:49:03.464328 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 17 13:49:03.464328 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 17 13:49:03.464328 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 17 13:49:03.473495 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 17 13:49:03.473495 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 17 13:49:03.473495 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 13:49:03.473495 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 13:49:03.473495 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:49:03.473495 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:49:03.473495 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 13:49:03.473495 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 13:49:03.473495 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:49:03.473495 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:49:03.473495 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 13:49:03.473495 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 13:49:03.473495 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 13:49:03.473495 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 13:49:03.473495 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:49:03.473495 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:49:03.473495 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:49:03.473495 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:49:03.473495 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f08dddc9-7591-4391-9cde-24e935954a30 could not be found. Oct 17 13:49:03.473495 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:49:03.473495 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:49:03.473495 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:49:03.473495 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:49:03.473495 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:49:03.473495 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:49:03.473495 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:49:03.473495 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:49:03.473495 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:49:03.473495 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:49:03.473495 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:49:03.473495 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:49:03.473495 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 17 13:49:03.473495 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 17 13:49:03.473495 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 17 13:49:03.473495 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 17 13:49:03.473495 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 13:49:03.473495 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:49:03.473495 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:49:03.473495 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:49:03.473495 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:49:03.473495 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:49:03.473495 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:49:03.473495 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:49:03.473495 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:49:03.473495 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 13:49:03.473495 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:49:03.473495 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7e7d69d6-b264-43e3-938a-7ce1342e6b84 tempest-ImagesMetadataNegativeTestJSON-1279951188 tempest-ImagesMetadataNegativeTestJSON-1279951188-project] Returning 404 to user: Image not found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:49:03.473495 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7e7d69d6-b264-43e3-938a-7ce1342e6b84 tempest-ImagesMetadataNegativeTestJSON-1279951188 tempest-ImagesMetadataNegativeTestJSON-1279951188-project] 10.222.0.79 "GET /compute/v2.1/images/f08dddc9-7591-4391-9cde-24e935954a30/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.031155 Oct 17 13:49:03.473495 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1653/3327] 10.222.0.79 () {58 vars in 1293 bytes} [Mon Oct 17 13:49:03 2022] GET /compute/v2.1/images/f08dddc9-7591-4391-9cde-24e935954a30/metadata/os_version => generated 62 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 17 13:49:03.477501 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-305d5037-9352-46ad-8e29-d8cf8e0750b4 tempest-ImagesMetadataNegativeTestJSON-1279951188 tempest-ImagesMetadataNegativeTestJSON-1279951188-project] Calling method '.version_select at 0x7f7cd442d4c0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:03.497350 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-305d5037-9352-46ad-8e29-d8cf8e0750b4 tempest-ImagesMetadataNegativeTestJSON-1279951188 tempest-ImagesMetadataNegativeTestJSON-1279951188-project] HTTP exception thrown: Image not found. Oct 17 13:49:03.499453 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-305d5037-9352-46ad-8e29-d8cf8e0750b4 tempest-ImagesMetadataNegativeTestJSON-1279951188 tempest-ImagesMetadataNegativeTestJSON-1279951188-project] Request method failure captured: Oct 17 13:49:03.499453 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/images/c1de69bd-93e1-4946-bb2b-02fb8954ed7b/metadata HTTP/1.1 Oct 17 13:49:03.499453 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:49:03.499453 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:49:03.499453 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:49:03.499453 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:49:03.499453 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:49:03.499453 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:49:03.499453 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:49:03.499453 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:49:03.499453 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTV1PnEKTYZr7KqCVAEox35-u4FAWgkPDXuX2pLNOcKicz-rF0HueZi8kLWkr1KwnDMRZtDPtCtAPQQhCZPUBwe_VDrjyDRsmTQVx3APuCcE9sTNopo6j2d_NVURpvrokLVpOJV_0lvhoRESc1cptyj8xK5Qf6_poYwxmFhWDaD7VkNY Oct 17 13:49:03.499453 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:49:03.499453 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:49:03.499453 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:49:03.499453 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:49:03.499453 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:49:03.499453 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:49:03.499453 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 388f978e1a2b4f458b9d9460b5c5a74b Oct 17 13:49:03.499453 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1279951188 Oct 17 13:49:03.499453 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:49:03.499453 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:49:03.499453 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/388f978e1a2b4f458b9d9460b5c5a74b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/388f978e1a2b4f458b9d9460b5c5a74b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/388f978e1a2b4f458b9d9460b5c5a74b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_388f978e1a2b4f458b9d9460b5c5a74b", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:49:03.499453 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1279951188 Oct 17 13:49:03.499453 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 388f978e1a2b4f458b9d9460b5c5a74b Oct 17 13:49:03.499453 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1279951188 Oct 17 13:49:03.499453 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ImagesMetadataNegativeTestJSON-1279951188-project Oct 17 13:49:03.499453 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:49:03.499453 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:49:03.499453 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 6d2545bf3bcc413dabcd3a8c1ce0ddab Oct 17 13:49:03.499453 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1279951188-project Oct 17 13:49:03.499453 n-d-854247-14 devstack@n-api.service[127016]: method: Oct 17 13:49:03.499453 n-d-854247-14 devstack@n-api.service[127016]: exception: Image not found. Oct 17 13:49:03.499453 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'image_id': 'c1de69bd-93e1-4946-bb2b-02fb8954ed7b'} Oct 17 13:49:03.499453 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:49:03.499453 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:49:03.499453 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 13:49:03.499453 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 13:49:03.499453 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:49:03.499453 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:49:03.499453 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 13:49:03.499453 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 13:49:03.499453 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:49:03.499453 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:49:03.499453 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 13:49:03.499453 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 13:49:03.499453 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 13:49:03.499453 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 13:49:03.499453 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:49:03.499453 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:49:03.499453 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:49:03.499453 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:49:03.499453 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c1de69bd-93e1-4946-bb2b-02fb8954ed7b Oct 17 13:49:03.499453 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:49:03.499453 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:49:03.499453 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:49:03.499453 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:49:03.499453 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 17 13:49:03.499453 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 17 13:49:03.499453 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 17 13:49:03.499453 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 17 13:49:03.499453 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 17 13:49:03.499453 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 17 13:49:03.506215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 17 13:49:03.506215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 17 13:49:03.506215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 13:49:03.506215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 13:49:03.506215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:49:03.506215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:49:03.506215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 13:49:03.506215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 13:49:03.506215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:49:03.506215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:49:03.506215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 13:49:03.506215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 13:49:03.506215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 13:49:03.506215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 13:49:03.506215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:49:03.506215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:49:03.506215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:49:03.506215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:49:03.506215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c1de69bd-93e1-4946-bb2b-02fb8954ed7b could not be found. Oct 17 13:49:03.506215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:49:03.506215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:49:03.506215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:49:03.506215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:49:03.506215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:49:03.506215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:49:03.506215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:49:03.506215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:49:03.506215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:49:03.506215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:49:03.506215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:49:03.506215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:49:03.506215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 17 13:49:03.506215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 17 13:49:03.506215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 17 13:49:03.506215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 17 13:49:03.506215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 13:49:03.506215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:49:03.506215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:49:03.506215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:49:03.506215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:49:03.506215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:49:03.506215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:49:03.506215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:49:03.506215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:49:03.506215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 13:49:03.506215 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:49:03.506215 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-305d5037-9352-46ad-8e29-d8cf8e0750b4 tempest-ImagesMetadataNegativeTestJSON-1279951188 tempest-ImagesMetadataNegativeTestJSON-1279951188-project] Returning 404 to user: Image not found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:49:03.506215 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-305d5037-9352-46ad-8e29-d8cf8e0750b4 tempest-ImagesMetadataNegativeTestJSON-1279951188 tempest-ImagesMetadataNegativeTestJSON-1279951188-project] 10.222.0.79 "GET /compute/v2.1/images/c1de69bd-93e1-4946-bb2b-02fb8954ed7b/metadata" status: 404 len: 62 microversion: 2.1 time: 0.028934 Oct 17 13:49:03.506215 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1675/3328] 10.222.0.79 () {58 vars in 1260 bytes} [Mon Oct 17 13:49:03 2022] GET /compute/v2.1/images/c1de69bd-93e1-4946-bb2b-02fb8954ed7b/metadata => generated 62 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:49:03.511348 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-063d93cd-24ee-4b7f-9775-32a2bda29e97 tempest-ImagesMetadataNegativeTestJSON-1279951188 tempest-ImagesMetadataNegativeTestJSON-1279951188-project] Action: 'update_all', calling method: .version_select at 0x7f7cd9a59ee0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:49:03.536742 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-063d93cd-24ee-4b7f-9775-32a2bda29e97 tempest-ImagesMetadataNegativeTestJSON-1279951188 tempest-ImagesMetadataNegativeTestJSON-1279951188-project] HTTP exception thrown: Image not found. Oct 17 13:49:03.538845 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-063d93cd-24ee-4b7f-9775-32a2bda29e97 tempest-ImagesMetadataNegativeTestJSON-1279951188 tempest-ImagesMetadataNegativeTestJSON-1279951188-project] Request method failure captured: Oct 17 13:49:03.538845 n-d-854247-14 devstack@n-api.service[127017]: request: PUT /compute/v2.1/images/cc6fd37e-3fff-491d-a361-0e137e23dac4/metadata HTTP/1.1 Oct 17 13:49:03.538845 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:49:03.538845 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:49:03.538845 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:49:03.538845 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 57 Oct 17 13:49:03.538845 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:49:03.538845 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:49:03.538845 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:49:03.538845 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:49:03.538845 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTV1PnEKTYZr7KqCVAEox35-u4FAWgkPDXuX2pLNOcKicz-rF0HueZi8kLWkr1KwnDMRZtDPtCtAPQQhCZPUBwe_VDrjyDRsmTQVx3APuCcE9sTNopo6j2d_NVURpvrokLVpOJV_0lvhoRESc1cptyj8xK5Qf6_poYwxmFhWDaD7VkNY Oct 17 13:49:03.538845 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:49:03.538845 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:49:03.538845 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:49:03.538845 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:49:03.538845 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:49:03.538845 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:49:03.538845 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 388f978e1a2b4f458b9d9460b5c5a74b Oct 17 13:49:03.538845 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1279951188 Oct 17 13:49:03.538845 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:49:03.538845 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:49:03.538845 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/388f978e1a2b4f458b9d9460b5c5a74b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/388f978e1a2b4f458b9d9460b5c5a74b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/388f978e1a2b4f458b9d9460b5c5a74b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_388f978e1a2b4f458b9d9460b5c5a74b", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:49:03.538845 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1279951188 Oct 17 13:49:03.538845 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 388f978e1a2b4f458b9d9460b5c5a74b Oct 17 13:49:03.538845 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1279951188 Oct 17 13:49:03.538845 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ImagesMetadataNegativeTestJSON-1279951188-project Oct 17 13:49:03.538845 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:49:03.538845 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:49:03.538845 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 6d2545bf3bcc413dabcd3a8c1ce0ddab Oct 17 13:49:03.538845 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1279951188-project Oct 17 13:49:03.538845 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 13:49:03.538845 n-d-854247-14 devstack@n-api.service[127017]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 17 13:49:03.538845 n-d-854247-14 devstack@n-api.service[127017]: method: Oct 17 13:49:03.538845 n-d-854247-14 devstack@n-api.service[127017]: exception: Image not found. Oct 17 13:49:03.538845 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'image_id': 'cc6fd37e-3fff-491d-a361-0e137e23dac4', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 17 13:49:03.538845 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:49:03.538845 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:49:03.538845 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 13:49:03.538845 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 13:49:03.538845 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:49:03.538845 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:49:03.538845 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 13:49:03.538845 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 13:49:03.538845 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:49:03.538845 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:49:03.538845 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 13:49:03.538845 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 13:49:03.538845 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 13:49:03.538845 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 13:49:03.538845 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:49:03.538845 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:49:03.538845 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:49:03.538845 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:49:03.538845 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID cc6fd37e-3fff-491d-a361-0e137e23dac4 Oct 17 13:49:03.538845 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:49:03.538845 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:49:03.538845 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:49:03.538845 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:49:03.538845 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 17 13:49:03.538845 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 17 13:49:03.538845 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 17 13:49:03.538845 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 17 13:49:03.538845 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 17 13:49:03.543853 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 17 13:49:03.543853 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 17 13:49:03.543853 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 17 13:49:03.543853 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 13:49:03.543853 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 13:49:03.543853 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:49:03.543853 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:49:03.543853 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 13:49:03.543853 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 13:49:03.543853 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:49:03.543853 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:49:03.543853 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 13:49:03.543853 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 13:49:03.543853 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 13:49:03.543853 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 13:49:03.543853 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:49:03.543853 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:49:03.543853 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:49:03.543853 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:49:03.543853 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cc6fd37e-3fff-491d-a361-0e137e23dac4 could not be found. Oct 17 13:49:03.543853 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:49:03.543853 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:49:03.543853 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:49:03.543853 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:49:03.543853 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:49:03.543853 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:49:03.543853 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:49:03.543853 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:49:03.543853 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:49:03.543853 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:49:03.543853 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:49:03.543853 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:49:03.543853 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:49:03.543853 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:49:03.543853 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 17 13:49:03.543853 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 17 13:49:03.543853 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 17 13:49:03.543853 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 17 13:49:03.543853 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 13:49:03.543853 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:49:03.543853 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:49:03.543853 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:49:03.543853 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:49:03.543853 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:49:03.543853 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:49:03.543853 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:49:03.543853 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:49:03.543853 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 13:49:03.543853 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:49:03.543853 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-063d93cd-24ee-4b7f-9775-32a2bda29e97 tempest-ImagesMetadataNegativeTestJSON-1279951188 tempest-ImagesMetadataNegativeTestJSON-1279951188-project] Returning 404 to user: Image not found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:49:03.543853 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-063d93cd-24ee-4b7f-9775-32a2bda29e97 tempest-ImagesMetadataNegativeTestJSON-1279951188 tempest-ImagesMetadataNegativeTestJSON-1279951188-project] 10.222.0.79 "PUT /compute/v2.1/images/cc6fd37e-3fff-491d-a361-0e137e23dac4/metadata" status: 404 len: 62 microversion: 2.1 time: 0.033082 Oct 17 13:49:03.543853 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1654/3329] 10.222.0.79 () {60 vars in 1280 bytes} [Mon Oct 17 13:49:03 2022] PUT /compute/v2.1/images/cc6fd37e-3fff-491d-a361-0e137e23dac4/metadata => generated 62 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:49:03.550568 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0d21d0d7-7ef7-4862-8169-6712089bfd5c tempest-ImagesMetadataNegativeTestJSON-1279951188 tempest-ImagesMetadataNegativeTestJSON-1279951188-project] Action: 'update', calling method: .version_select at 0x7f7cd5fc50d0>, body: {"meta": {"os_distro": "alt"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:49:03.572588 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-0d21d0d7-7ef7-4862-8169-6712089bfd5c tempest-ImagesMetadataNegativeTestJSON-1279951188 tempest-ImagesMetadataNegativeTestJSON-1279951188-project] HTTP exception thrown: Image not found. Oct 17 13:49:03.574671 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0d21d0d7-7ef7-4862-8169-6712089bfd5c tempest-ImagesMetadataNegativeTestJSON-1279951188 tempest-ImagesMetadataNegativeTestJSON-1279951188-project] Request method failure captured: Oct 17 13:49:03.574671 n-d-854247-14 devstack@n-api.service[127016]: request: PUT /compute/v2.1/images/ee331d24-583d-4a47-bd64-4e6b18201443/metadata/os_distro HTTP/1.1 Oct 17 13:49:03.574671 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:49:03.574671 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:49:03.574671 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:49:03.574671 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 30 Oct 17 13:49:03.574671 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:49:03.574671 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:49:03.574671 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:49:03.574671 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:49:03.574671 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTV1PnEKTYZr7KqCVAEox35-u4FAWgkPDXuX2pLNOcKicz-rF0HueZi8kLWkr1KwnDMRZtDPtCtAPQQhCZPUBwe_VDrjyDRsmTQVx3APuCcE9sTNopo6j2d_NVURpvrokLVpOJV_0lvhoRESc1cptyj8xK5Qf6_poYwxmFhWDaD7VkNY Oct 17 13:49:03.574671 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:49:03.574671 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:49:03.574671 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:49:03.574671 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:49:03.574671 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:49:03.574671 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:49:03.574671 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 388f978e1a2b4f458b9d9460b5c5a74b Oct 17 13:49:03.574671 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1279951188 Oct 17 13:49:03.574671 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:49:03.574671 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:49:03.574671 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/388f978e1a2b4f458b9d9460b5c5a74b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/388f978e1a2b4f458b9d9460b5c5a74b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/388f978e1a2b4f458b9d9460b5c5a74b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_388f978e1a2b4f458b9d9460b5c5a74b", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:49:03.574671 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1279951188 Oct 17 13:49:03.574671 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 388f978e1a2b4f458b9d9460b5c5a74b Oct 17 13:49:03.574671 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1279951188 Oct 17 13:49:03.574671 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ImagesMetadataNegativeTestJSON-1279951188-project Oct 17 13:49:03.574671 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:49:03.574671 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:49:03.574671 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 6d2545bf3bcc413dabcd3a8c1ce0ddab Oct 17 13:49:03.574671 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1279951188-project Oct 17 13:49:03.574671 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:49:03.574671 n-d-854247-14 devstack@n-api.service[127016]: {"meta": {"os_distro": "alt"}} Oct 17 13:49:03.574671 n-d-854247-14 devstack@n-api.service[127016]: method: Oct 17 13:49:03.574671 n-d-854247-14 devstack@n-api.service[127016]: exception: Image not found. Oct 17 13:49:03.574671 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'image_id': 'ee331d24-583d-4a47-bd64-4e6b18201443', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 17 13:49:03.574671 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:49:03.574671 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:49:03.574671 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 13:49:03.574671 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 13:49:03.574671 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:49:03.574671 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:49:03.574671 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 13:49:03.574671 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 13:49:03.574671 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:49:03.574671 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:49:03.574671 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 13:49:03.574671 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 13:49:03.574671 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 13:49:03.574671 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 13:49:03.574671 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:49:03.574671 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:49:03.574671 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:49:03.574671 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:49:03.574671 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ee331d24-583d-4a47-bd64-4e6b18201443 Oct 17 13:49:03.574671 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:49:03.574671 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:49:03.574671 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:49:03.574671 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:49:03.574671 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 17 13:49:03.574671 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 17 13:49:03.574671 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 17 13:49:03.574671 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 17 13:49:03.574671 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 17 13:49:03.574671 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 17 13:49:03.579135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 17 13:49:03.579135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 17 13:49:03.579135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 13:49:03.579135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 13:49:03.579135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:49:03.579135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:49:03.579135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 13:49:03.579135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 13:49:03.579135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:49:03.579135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:49:03.579135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 13:49:03.579135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 13:49:03.579135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 13:49:03.579135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 13:49:03.579135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:49:03.579135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:49:03.579135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:49:03.579135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:49:03.579135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ee331d24-583d-4a47-bd64-4e6b18201443 could not be found. Oct 17 13:49:03.579135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:49:03.579135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:49:03.579135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:49:03.579135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:49:03.579135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:49:03.579135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:49:03.579135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:49:03.579135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:49:03.579135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:49:03.579135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:49:03.579135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:49:03.579135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:49:03.579135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:49:03.579135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:49:03.579135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 17 13:49:03.579135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 17 13:49:03.579135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 17 13:49:03.579135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 17 13:49:03.579135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 13:49:03.579135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:49:03.579135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:49:03.579135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:49:03.579135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:49:03.579135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:49:03.579135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:49:03.579135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:49:03.579135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:49:03.579135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 13:49:03.579135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:49:03.579135 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0d21d0d7-7ef7-4862-8169-6712089bfd5c tempest-ImagesMetadataNegativeTestJSON-1279951188 tempest-ImagesMetadataNegativeTestJSON-1279951188-project] Returning 404 to user: Image not found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:49:03.579135 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0d21d0d7-7ef7-4862-8169-6712089bfd5c tempest-ImagesMetadataNegativeTestJSON-1279951188 tempest-ImagesMetadataNegativeTestJSON-1279951188-project] 10.222.0.79 "PUT /compute/v2.1/images/ee331d24-583d-4a47-bd64-4e6b18201443/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.029967 Oct 17 13:49:03.579135 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1676/3330] 10.222.0.79 () {60 vars in 1310 bytes} [Mon Oct 17 13:49:03 2022] PUT /compute/v2.1/images/ee331d24-583d-4a47-bd64-4e6b18201443/metadata/os_distro => generated 62 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 17 13:49:03.586336 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e0bb04e4-5bd4-46d3-a069-2da8e18c0417 tempest-ImagesMetadataNegativeTestJSON-1279951188 tempest-ImagesMetadataNegativeTestJSON-1279951188-project] Action: 'create', calling method: .version_select at 0x7f7cd9a59820>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:49:03.609373 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-e0bb04e4-5bd4-46d3-a069-2da8e18c0417 tempest-ImagesMetadataNegativeTestJSON-1279951188 tempest-ImagesMetadataNegativeTestJSON-1279951188-project] HTTP exception thrown: Image not found. Oct 17 13:49:03.611620 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e0bb04e4-5bd4-46d3-a069-2da8e18c0417 tempest-ImagesMetadataNegativeTestJSON-1279951188 tempest-ImagesMetadataNegativeTestJSON-1279951188-project] Request method failure captured: Oct 17 13:49:03.611620 n-d-854247-14 devstack@n-api.service[127017]: request: POST /compute/v2.1/images/a440060e-74e4-4c85-8129-b24d5ac7898c/metadata HTTP/1.1 Oct 17 13:49:03.611620 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:49:03.611620 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:49:03.611620 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:49:03.611620 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 57 Oct 17 13:49:03.611620 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:49:03.611620 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:49:03.611620 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:49:03.611620 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:49:03.611620 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTV1PnEKTYZr7KqCVAEox35-u4FAWgkPDXuX2pLNOcKicz-rF0HueZi8kLWkr1KwnDMRZtDPtCtAPQQhCZPUBwe_VDrjyDRsmTQVx3APuCcE9sTNopo6j2d_NVURpvrokLVpOJV_0lvhoRESc1cptyj8xK5Qf6_poYwxmFhWDaD7VkNY Oct 17 13:49:03.611620 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:49:03.611620 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:49:03.611620 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:49:03.611620 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:49:03.611620 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:49:03.611620 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:49:03.611620 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 388f978e1a2b4f458b9d9460b5c5a74b Oct 17 13:49:03.611620 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1279951188 Oct 17 13:49:03.611620 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:49:03.611620 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:49:03.611620 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/388f978e1a2b4f458b9d9460b5c5a74b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/388f978e1a2b4f458b9d9460b5c5a74b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/388f978e1a2b4f458b9d9460b5c5a74b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_388f978e1a2b4f458b9d9460b5c5a74b", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:49:03.611620 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1279951188 Oct 17 13:49:03.611620 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 388f978e1a2b4f458b9d9460b5c5a74b Oct 17 13:49:03.611620 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1279951188 Oct 17 13:49:03.611620 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ImagesMetadataNegativeTestJSON-1279951188-project Oct 17 13:49:03.611620 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:49:03.611620 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:49:03.611620 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 6d2545bf3bcc413dabcd3a8c1ce0ddab Oct 17 13:49:03.611620 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1279951188-project Oct 17 13:49:03.611620 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 13:49:03.611620 n-d-854247-14 devstack@n-api.service[127017]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 17 13:49:03.611620 n-d-854247-14 devstack@n-api.service[127017]: method: Oct 17 13:49:03.611620 n-d-854247-14 devstack@n-api.service[127017]: exception: Image not found. Oct 17 13:49:03.611620 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'image_id': 'a440060e-74e4-4c85-8129-b24d5ac7898c', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 17 13:49:03.611620 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:49:03.611620 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:49:03.611620 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 13:49:03.611620 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 13:49:03.611620 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:49:03.611620 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:49:03.611620 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 13:49:03.611620 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 13:49:03.611620 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:49:03.611620 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:49:03.611620 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 13:49:03.611620 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 13:49:03.611620 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 13:49:03.611620 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 13:49:03.611620 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:49:03.611620 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:49:03.611620 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:49:03.611620 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:49:03.611620 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a440060e-74e4-4c85-8129-b24d5ac7898c Oct 17 13:49:03.611620 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:49:03.611620 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:49:03.611620 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:49:03.611620 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:49:03.611620 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 17 13:49:03.611620 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 17 13:49:03.611620 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 17 13:49:03.611620 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 17 13:49:03.611620 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 17 13:49:03.616419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 17 13:49:03.616419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 17 13:49:03.616419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 17 13:49:03.616419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 13:49:03.616419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 13:49:03.616419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:49:03.616419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:49:03.616419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 13:49:03.616419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 13:49:03.616419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:49:03.616419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:49:03.616419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 13:49:03.616419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 13:49:03.616419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 13:49:03.616419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 13:49:03.616419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:49:03.616419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:49:03.616419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:49:03.616419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:49:03.616419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a440060e-74e4-4c85-8129-b24d5ac7898c could not be found. Oct 17 13:49:03.616419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:49:03.616419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:49:03.616419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:49:03.616419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:49:03.616419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:49:03.616419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:49:03.616419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:49:03.616419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:49:03.616419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:49:03.616419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:49:03.616419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:49:03.616419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:49:03.616419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:49:03.616419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:49:03.616419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 17 13:49:03.616419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 17 13:49:03.616419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 17 13:49:03.616419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 17 13:49:03.616419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 13:49:03.616419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:49:03.616419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:49:03.616419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:49:03.616419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:49:03.616419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:49:03.616419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:49:03.616419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:49:03.616419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:49:03.616419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 13:49:03.616419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:49:03.616419 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e0bb04e4-5bd4-46d3-a069-2da8e18c0417 tempest-ImagesMetadataNegativeTestJSON-1279951188 tempest-ImagesMetadataNegativeTestJSON-1279951188-project] Returning 404 to user: Image not found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:49:03.616419 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e0bb04e4-5bd4-46d3-a069-2da8e18c0417 tempest-ImagesMetadataNegativeTestJSON-1279951188 tempest-ImagesMetadataNegativeTestJSON-1279951188-project] 10.222.0.79 "POST /compute/v2.1/images/a440060e-74e4-4c85-8129-b24d5ac7898c/metadata" status: 404 len: 62 microversion: 2.1 time: 0.031741 Oct 17 13:49:03.616419 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1655/3331] 10.222.0.79 () {60 vars in 1281 bytes} [Mon Oct 17 13:49:03 2022] POST /compute/v2.1/images/a440060e-74e4-4c85-8129-b24d5ac7898c/metadata => generated 62 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:49:03.863588 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c35bbb1f-0336-4a19-9522-b4d689df9444 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:03.864225 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c35bbb1f-0336-4a19-9522-b4d689df9444 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:03.873461 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c35bbb1f-0336-4a19-9522-b4d689df9444 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:03.873967 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c35bbb1f-0336-4a19-9522-b4d689df9444 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:03.874410 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c35bbb1f-0336-4a19-9522-b4d689df9444 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:03.875156 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c35bbb1f-0336-4a19-9522-b4d689df9444 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:03.875682 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c35bbb1f-0336-4a19-9522-b4d689df9444 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:03.876108 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c35bbb1f-0336-4a19-9522-b4d689df9444 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:03.923826 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6ab39960-b04a-41bb-b351-f810c39b429b tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:03.924610 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6ab39960-b04a-41bb-b351-f810c39b429b tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: a2994495-366a-446f-b7a6-16340911e17c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:03.940602 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6ab39960-b04a-41bb-b351-f810c39b429b tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:03.941107 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6ab39960-b04a-41bb-b351-f810c39b429b tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:03.941550 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6ab39960-b04a-41bb-b351-f810c39b429b tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:03.942535 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6ab39960-b04a-41bb-b351-f810c39b429b tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:03.943348 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6ab39960-b04a-41bb-b351-f810c39b429b tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:03.943946 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6ab39960-b04a-41bb-b351-f810c39b429b tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:04.255982 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c35bbb1f-0336-4a19-9522-b4d689df9444 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:04.263649 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:49:04.273690 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c35bbb1f-0336-4a19-9522-b4d689df9444 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:04.275567 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c35bbb1f-0336-4a19-9522-b4d689df9444 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:04.277080 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c35bbb1f-0336-4a19-9522-b4d689df9444 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1879 microversion: 2.32 time: 0.419680 Oct 17 13:49:04.278400 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1677/3332] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:49:03 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1879 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:49:04.296918 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-703a2341-3402-4501-a942-61f8cde96f45 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:04.299259 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-703a2341-3402-4501-a942-61f8cde96f45 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 10690310-b856-4f6e-a4ea-1b771f45a75f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:04.304954 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:49:04.317913 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-703a2341-3402-4501-a942-61f8cde96f45 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:04.319870 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-703a2341-3402-4501-a942-61f8cde96f45 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:04.319870 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-703a2341-3402-4501-a942-61f8cde96f45 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:04.327198 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-703a2341-3402-4501-a942-61f8cde96f45 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:04.327698 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-703a2341-3402-4501-a942-61f8cde96f45 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:04.328141 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-703a2341-3402-4501-a942-61f8cde96f45 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:04.344501 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6ab39960-b04a-41bb-b351-f810c39b429b tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683d18db860a4d60ab3eeba2a372b2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11973b8e1d8a4af8add65726e8ba7c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:04.356151 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6ab39960-b04a-41bb-b351-f810c39b429b tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c" status: 200 len: 1720 microversion: 2.1 time: 0.441527 Oct 17 13:49:04.357501 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1656/3333] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:03 2022] GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c => generated 1720 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:49:04.363827 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e7910dd0-37f0-4720-949b-d5a52244aff7 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:04.365231 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e7910dd0-37f0-4720-949b-d5a52244aff7 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: e1fb1718-c504-47dc-ab2e-28fe15d2c435] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:04.372757 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e7910dd0-37f0-4720-949b-d5a52244aff7 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:04.373377 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e7910dd0-37f0-4720-949b-d5a52244aff7 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:04.373912 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e7910dd0-37f0-4720-949b-d5a52244aff7 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:04.374860 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-703a2341-3402-4501-a942-61f8cde96f45 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/10690310-b856-4f6e-a4ea-1b771f45a75f/ips" status: 200 len: 150 microversion: 2.1 time: 0.095049 Oct 17 13:49:04.375008 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e7910dd0-37f0-4720-949b-d5a52244aff7 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:04.375501 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1678/3334] 10.222.0.79 () {58 vars in 1248 bytes} [Mon Oct 17 13:49:04 2022] GET /compute/v2.1/servers/10690310-b856-4f6e-a4ea-1b771f45a75f/ips => generated 150 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:49:04.375673 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e7910dd0-37f0-4720-949b-d5a52244aff7 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:04.376208 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e7910dd0-37f0-4720-949b-d5a52244aff7 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:04.390014 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9a1926e0-4c1d-49c5-8584-4210a26b8d32 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:04.400172 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9a1926e0-4c1d-49c5-8584-4210a26b8d32 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 68363fdf-f661-4b7c-abdc-7a8a85efa83a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:04.411866 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9a1926e0-4c1d-49c5-8584-4210a26b8d32 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:04.412872 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9a1926e0-4c1d-49c5-8584-4210a26b8d32 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:04.413501 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9a1926e0-4c1d-49c5-8584-4210a26b8d32 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:04.414412 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9a1926e0-4c1d-49c5-8584-4210a26b8d32 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:04.414872 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9a1926e0-4c1d-49c5-8584-4210a26b8d32 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:04.415343 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9a1926e0-4c1d-49c5-8584-4210a26b8d32 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:04.774771 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e7910dd0-37f0-4720-949b-d5a52244aff7 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:04.787199 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e7910dd0-37f0-4720-949b-d5a52244aff7 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435" status: 200 len: 1378 microversion: 2.1 time: 0.428050 Oct 17 13:49:04.803277 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9a1926e0-4c1d-49c5-8584-4210a26b8d32 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:04.804561 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1657/3335] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:04 2022] GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435 => generated 1378 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:04.807835 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9a1926e0-4c1d-49c5-8584-4210a26b8d32 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a" status: 200 len: 1522 microversion: 2.1 time: 0.420798 Oct 17 13:49:04.810563 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-c33e6189-355a-424b-864a-d661070f10e5 req-b50d2591-ebb0-4d30-b2ba-149272e215b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1fb1718-c504-47dc-ab2e-28fe15d2c435", "name": "network-vif-plugged", "status": "completed", "tag": "391b5d37-7616-4b7e-974a-cd5f28f3eb9a"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:49:04.811229 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1679/3336] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:04 2022] GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a => generated 1522 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:04.822499 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-c33e6189-355a-424b-864a-d661070f10e5 req-b50d2591-ebb0-4d30-b2ba-149272e215b9 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:04.822974 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-c33e6189-355a-424b-864a-d661070f10e5 req-b50d2591-ebb0-4d30-b2ba-149272e215b9 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:04.823577 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-c33e6189-355a-424b-864a-d661070f10e5 req-b50d2591-ebb0-4d30-b2ba-149272e215b9 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:04.848692 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-c33e6189-355a-424b-864a-d661070f10e5 req-b50d2591-ebb0-4d30-b2ba-149272e215b9 service nova] Creating event network-vif-plugged:391b5d37-7616-4b7e-974a-cd5f28f3eb9a for instance e1fb1718-c504-47dc-ab2e-28fe15d2c435 on n-h1-854247-14 Oct 17 13:49:04.864369 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-c33e6189-355a-424b-864a-d661070f10e5 req-b50d2591-ebb0-4d30-b2ba-149272e215b9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056602 Oct 17 13:49:04.870274 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1658/3337] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:49:05.308163 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-401652ba-3800-463f-9833-60eac626703d tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:05.309488 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-401652ba-3800-463f-9833-60eac626703d tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:05.321155 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-401652ba-3800-463f-9833-60eac626703d tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:05.324910 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-401652ba-3800-463f-9833-60eac626703d tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:05.325665 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-401652ba-3800-463f-9833-60eac626703d tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:05.326558 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-401652ba-3800-463f-9833-60eac626703d tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:05.330700 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-401652ba-3800-463f-9833-60eac626703d tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:05.331451 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-401652ba-3800-463f-9833-60eac626703d tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:05.383266 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-77cf2846-85fb-498a-9432-e240e28b200d tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:05.384116 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-77cf2846-85fb-498a-9432-e240e28b200d tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: a2994495-366a-446f-b7a6-16340911e17c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:05.409744 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-77cf2846-85fb-498a-9432-e240e28b200d tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:05.410468 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-77cf2846-85fb-498a-9432-e240e28b200d tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:05.412811 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-77cf2846-85fb-498a-9432-e240e28b200d tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:05.413676 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-77cf2846-85fb-498a-9432-e240e28b200d tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:05.417864 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-77cf2846-85fb-498a-9432-e240e28b200d tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:05.419420 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-77cf2846-85fb-498a-9432-e240e28b200d tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:05.698904 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-77cf2846-85fb-498a-9432-e240e28b200d tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683d18db860a4d60ab3eeba2a372b2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11973b8e1d8a4af8add65726e8ba7c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:05.713740 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-77cf2846-85fb-498a-9432-e240e28b200d tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c" status: 200 len: 1720 microversion: 2.1 time: 0.331620 Oct 17 13:49:05.714423 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1659/3338] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:05 2022] GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c => generated 1720 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:49:05.770775 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-401652ba-3800-463f-9833-60eac626703d tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:05.788425 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-401652ba-3800-463f-9833-60eac626703d tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:05.795623 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-401652ba-3800-463f-9833-60eac626703d tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:05.796908 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-401652ba-3800-463f-9833-60eac626703d tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1879 microversion: 2.32 time: 0.493410 Oct 17 13:49:05.805074 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1680/3339] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:49:05 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1879 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:49:05.814203 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8a17ab6c-71f0-46fb-9af4-c62dbdaf6be9 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:05.816425 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8a17ab6c-71f0-46fb-9af4-c62dbdaf6be9 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: e1fb1718-c504-47dc-ab2e-28fe15d2c435] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:05.846774 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8a17ab6c-71f0-46fb-9af4-c62dbdaf6be9 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:05.847303 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8a17ab6c-71f0-46fb-9af4-c62dbdaf6be9 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:05.847740 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8a17ab6c-71f0-46fb-9af4-c62dbdaf6be9 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:05.849250 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8a17ab6c-71f0-46fb-9af4-c62dbdaf6be9 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:05.850767 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8a17ab6c-71f0-46fb-9af4-c62dbdaf6be9 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:05.853270 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8a17ab6c-71f0-46fb-9af4-c62dbdaf6be9 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:05.920114 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-140cda24-cc2c-4916-a591-e0177a859232 tempest-ListImageFiltersNegativeTestJSON-1240419977 tempest-ListImageFiltersNegativeTestJSON-1240419977-project] Calling method '.version_select at 0x7f7cd54551f0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:05.950670 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-140cda24-cc2c-4916-a591-e0177a859232 tempest-ListImageFiltersNegativeTestJSON-1240419977 tempest-ListImageFiltersNegativeTestJSON-1240419977-project] HTTP exception thrown: Image not found. Oct 17 13:49:05.963340 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-140cda24-cc2c-4916-a591-e0177a859232 tempest-ListImageFiltersNegativeTestJSON-1240419977 tempest-ListImageFiltersNegativeTestJSON-1240419977-project] Request method failure captured: Oct 17 13:49:05.963340 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/images/3cc56771-efff-417d-883a-6fadd7699247 HTTP/1.1 Oct 17 13:49:05.963340 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:49:05.963340 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:49:05.963340 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:49:05.963340 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:49:05.963340 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:49:05.963340 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:49:05.963340 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:49:05.963340 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:49:05.963340 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTV1RfIb6iNYt_0iRRN7vbXwxhfQhUubnyLI85e9XCfvx9ba-6IK9BkfXFODuZoYebH3oIHZtshHFCZXC7jfbPwprMWQKwltjfwP5tAoFrldILMbQVKjzuKcKkToo64MVZ08bV9IeF18ZE38vJ4wIzqeJUZnVBkJXMFavaebeETz2H6E Oct 17 13:49:05.963340 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:49:05.963340 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:49:05.963340 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:49:05.963340 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:49:05.963340 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:49:05.963340 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:49:05.963340 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 9982a8016fd94807b73d13d35b3bb411 Oct 17 13:49:05.963340 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1240419977 Oct 17 13:49:05.963340 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:49:05.963340 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:49:05.963340 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9982a8016fd94807b73d13d35b3bb411"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/9982a8016fd94807b73d13d35b3bb411"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9982a8016fd94807b73d13d35b3bb411"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_9982a8016fd94807b73d13d35b3bb411", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:49:05.963340 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1240419977 Oct 17 13:49:05.963340 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 9982a8016fd94807b73d13d35b3bb411 Oct 17 13:49:05.963340 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1240419977 Oct 17 13:49:05.963340 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ListImageFiltersNegativeTestJSON-1240419977-project Oct 17 13:49:05.963340 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:49:05.963340 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:49:05.963340 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 7901c4a1e7364b10a13741f2c20d7013 Oct 17 13:49:05.963340 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1240419977-project Oct 17 13:49:05.963340 n-d-854247-14 devstack@n-api.service[127017]: method: Oct 17 13:49:05.963340 n-d-854247-14 devstack@n-api.service[127017]: exception: Image not found. Oct 17 13:49:05.963340 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '3cc56771-efff-417d-883a-6fadd7699247'} Oct 17 13:49:05.963340 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:49:05.963340 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:49:05.963340 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 13:49:05.963340 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 13:49:05.963340 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:49:05.963340 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:49:05.963340 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 13:49:05.963340 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 13:49:05.963340 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:49:05.963340 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:49:05.963340 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 13:49:05.963340 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 13:49:05.963340 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 13:49:05.963340 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 13:49:05.963340 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:49:05.963340 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:49:05.963340 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:49:05.963340 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:49:05.963340 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 3cc56771-efff-417d-883a-6fadd7699247 Oct 17 13:49:05.963340 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:49:05.963340 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:49:05.963340 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:49:05.963340 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:49:05.963340 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 17 13:49:05.963340 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 17 13:49:05.963340 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 17 13:49:05.963340 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 17 13:49:05.963340 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 17 13:49:05.963340 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 17 13:49:05.963340 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 17 13:49:05.970206 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 17 13:49:05.970206 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 13:49:05.970206 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 13:49:05.970206 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:49:05.970206 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:49:05.970206 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 13:49:05.970206 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 13:49:05.970206 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:49:05.970206 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:49:05.970206 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 13:49:05.970206 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 13:49:05.970206 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 13:49:05.970206 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 13:49:05.970206 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:49:05.970206 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:49:05.970206 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:49:05.970206 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:49:05.970206 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3cc56771-efff-417d-883a-6fadd7699247 could not be found. Oct 17 13:49:05.970206 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:49:05.970206 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:49:05.970206 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:49:05.970206 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:49:05.970206 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:49:05.970206 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:49:05.970206 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:49:05.970206 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:49:05.970206 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:49:05.970206 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:49:05.970206 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:49:05.970206 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:49:05.970206 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 17 13:49:05.970206 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 13:49:05.970206 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 13:49:05.970206 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:49:05.970206 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:49:05.970206 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:49:05.970206 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:49:05.970206 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:49:05.970206 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:49:05.970206 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:49:05.970206 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:49:05.970206 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 13:49:05.970206 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:49:05.970206 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-140cda24-cc2c-4916-a591-e0177a859232 tempest-ListImageFiltersNegativeTestJSON-1240419977 tempest-ListImageFiltersNegativeTestJSON-1240419977-project] Returning 404 to user: Image not found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:49:05.970206 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-140cda24-cc2c-4916-a591-e0177a859232 tempest-ListImageFiltersNegativeTestJSON-1240419977 tempest-ListImageFiltersNegativeTestJSON-1240419977-project] 10.222.0.79 "GET /compute/v2.1/images/3cc56771-efff-417d-883a-6fadd7699247" status: 404 len: 62 microversion: 2.1 time: 0.253447 Oct 17 13:49:05.970206 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1660/3340] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:49:05 2022] GET /compute/v2.1/images/3cc56771-efff-417d-883a-6fadd7699247 => generated 62 bytes in 255 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:49:05.985697 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-db42da3c-bc65-4ccc-a99e-8759b69ca426 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:05.986032 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-db42da3c-bc65-4ccc-a99e-8759b69ca426 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 68363fdf-f661-4b7c-abdc-7a8a85efa83a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:05.995043 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db42da3c-bc65-4ccc-a99e-8759b69ca426 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:05.995819 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db42da3c-bc65-4ccc-a99e-8759b69ca426 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:05.996114 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db42da3c-bc65-4ccc-a99e-8759b69ca426 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:05.997045 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db42da3c-bc65-4ccc-a99e-8759b69ca426 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:05.997669 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db42da3c-bc65-4ccc-a99e-8759b69ca426 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:05.998358 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db42da3c-bc65-4ccc-a99e-8759b69ca426 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:06.175227 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8a17ab6c-71f0-46fb-9af4-c62dbdaf6be9 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:06.187829 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8a17ab6c-71f0-46fb-9af4-c62dbdaf6be9 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435" status: 200 len: 1378 microversion: 2.1 time: 0.378443 Oct 17 13:49:06.188483 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1681/3341] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:05 2022] GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435 => generated 1378 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:06.289957 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-db42da3c-bc65-4ccc-a99e-8759b69ca426 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:06.298214 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-db42da3c-bc65-4ccc-a99e-8759b69ca426 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a" status: 200 len: 1522 microversion: 2.1 time: 0.326814 Oct 17 13:49:06.298994 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1661/3342] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:05 2022] GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a => generated 1522 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:06.739484 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-55156c1f-e697-4b2e-a974-9e5dbd26a147 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:06.740380 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-55156c1f-e697-4b2e-a974-9e5dbd26a147 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: a2994495-366a-446f-b7a6-16340911e17c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:06.747950 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-55156c1f-e697-4b2e-a974-9e5dbd26a147 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:06.749389 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-55156c1f-e697-4b2e-a974-9e5dbd26a147 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:06.749898 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-55156c1f-e697-4b2e-a974-9e5dbd26a147 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:06.750624 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-55156c1f-e697-4b2e-a974-9e5dbd26a147 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:06.751088 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-55156c1f-e697-4b2e-a974-9e5dbd26a147 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:06.751565 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-55156c1f-e697-4b2e-a974-9e5dbd26a147 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:06.829221 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-680a973b-397e-4bdc-b096-59ae43d283ae tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:06.829832 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-680a973b-397e-4bdc-b096-59ae43d283ae tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:06.838033 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-680a973b-397e-4bdc-b096-59ae43d283ae tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:06.839011 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-680a973b-397e-4bdc-b096-59ae43d283ae tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:06.839661 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-680a973b-397e-4bdc-b096-59ae43d283ae tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:06.840614 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-680a973b-397e-4bdc-b096-59ae43d283ae tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:06.841315 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-680a973b-397e-4bdc-b096-59ae43d283ae tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:06.841946 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-680a973b-397e-4bdc-b096-59ae43d283ae tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:06.938403 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-55156c1f-e697-4b2e-a974-9e5dbd26a147 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683d18db860a4d60ab3eeba2a372b2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11973b8e1d8a4af8add65726e8ba7c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:06.948258 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-55156c1f-e697-4b2e-a974-9e5dbd26a147 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c" status: 200 len: 1720 microversion: 2.1 time: 0.213803 Oct 17 13:49:06.965963 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1682/3343] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:06 2022] GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c => generated 1720 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:07.130536 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-680a973b-397e-4bdc-b096-59ae43d283ae tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:07.146238 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-680a973b-397e-4bdc-b096-59ae43d283ae tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:07.147733 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-680a973b-397e-4bdc-b096-59ae43d283ae tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:07.149156 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-680a973b-397e-4bdc-b096-59ae43d283ae tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1879 microversion: 2.32 time: 0.323934 Oct 17 13:49:07.150257 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1662/3344] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:49:06 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1879 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:49:07.168748 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1260e528-6b2d-41ff-9fec-25e089115553 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9f7fb08a-bb12-485a-b702-ad46276e16d5"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:49:07.172139 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-1260e528-6b2d-41ff-9fec-25e089115553 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 10690310-b856-4f6e-a4ea-1b771f45a75f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:07.178926 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1260e528-6b2d-41ff-9fec-25e089115553 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:07.179535 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1260e528-6b2d-41ff-9fec-25e089115553 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:07.179970 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1260e528-6b2d-41ff-9fec-25e089115553 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:07.180687 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1260e528-6b2d-41ff-9fec-25e089115553 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:07.181129 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1260e528-6b2d-41ff-9fec-25e089115553 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:07.181760 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1260e528-6b2d-41ff-9fec-25e089115553 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:07.223855 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-433bd84e-d7fa-42dc-80c6-9f4d97c45e00 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:07.224799 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-433bd84e-d7fa-42dc-80c6-9f4d97c45e00 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: e1fb1718-c504-47dc-ab2e-28fe15d2c435] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:07.248577 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-433bd84e-d7fa-42dc-80c6-9f4d97c45e00 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:07.249408 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-433bd84e-d7fa-42dc-80c6-9f4d97c45e00 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:07.249979 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-433bd84e-d7fa-42dc-80c6-9f4d97c45e00 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:07.250848 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-433bd84e-d7fa-42dc-80c6-9f4d97c45e00 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:07.252208 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-433bd84e-d7fa-42dc-80c6-9f4d97c45e00 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:07.252970 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-433bd84e-d7fa-42dc-80c6-9f4d97c45e00 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:07.502592 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-433bd84e-d7fa-42dc-80c6-9f4d97c45e00 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:07.512308 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-433bd84e-d7fa-42dc-80c6-9f4d97c45e00 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435" status: 200 len: 1378 microversion: 2.1 time: 0.298596 Oct 17 13:49:07.512921 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1663/3345] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:07 2022] GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435 => generated 1378 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:49:07.519649 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7eb730c4-b59e-4e7c-aeb7-500bfca28754 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:07.526400 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7eb730c4-b59e-4e7c-aeb7-500bfca28754 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 68363fdf-f661-4b7c-abdc-7a8a85efa83a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:07.547694 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7eb730c4-b59e-4e7c-aeb7-500bfca28754 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:07.549503 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7eb730c4-b59e-4e7c-aeb7-500bfca28754 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:07.550055 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7eb730c4-b59e-4e7c-aeb7-500bfca28754 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:07.552106 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7eb730c4-b59e-4e7c-aeb7-500bfca28754 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:07.552577 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7eb730c4-b59e-4e7c-aeb7-500bfca28754 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:07.553348 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7eb730c4-b59e-4e7c-aeb7-500bfca28754 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:07.646480 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1260e528-6b2d-41ff-9fec-25e089115553 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "POST /compute/v2.1/servers/10690310-b856-4f6e-a4ea-1b771f45a75f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.481792 Oct 17 13:49:07.647949 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1683/3346] 10.222.0.79 () {60 vars in 1323 bytes} [Mon Oct 17 13:49:07 2022] POST /compute/v2.1/servers/10690310-b856-4f6e-a4ea-1b771f45a75f/os-volume_attachments => generated 194 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:49:07.778361 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7eb730c4-b59e-4e7c-aeb7-500bfca28754 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:07.788869 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7eb730c4-b59e-4e7c-aeb7-500bfca28754 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a" status: 200 len: 1522 microversion: 2.1 time: 0.274539 Oct 17 13:49:07.789525 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1664/3347] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:07 2022] GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:07.974337 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-49c0a128-a6d9-41c2-bac5-22b89be050d0 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:07.976104 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-49c0a128-a6d9-41c2-bac5-22b89be050d0 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: a2994495-366a-446f-b7a6-16340911e17c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:07.988415 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-49c0a128-a6d9-41c2-bac5-22b89be050d0 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:07.991461 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-49c0a128-a6d9-41c2-bac5-22b89be050d0 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:07.992314 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-49c0a128-a6d9-41c2-bac5-22b89be050d0 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:07.993296 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-49c0a128-a6d9-41c2-bac5-22b89be050d0 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:07.993999 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-49c0a128-a6d9-41c2-bac5-22b89be050d0 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:07.994695 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-49c0a128-a6d9-41c2-bac5-22b89be050d0 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:08.177276 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4609b6ba-3848-4e56-8aed-4298e7377e4f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:08.178910 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4609b6ba-3848-4e56-8aed-4298e7377e4f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:08.192478 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4609b6ba-3848-4e56-8aed-4298e7377e4f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:08.194643 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4609b6ba-3848-4e56-8aed-4298e7377e4f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:08.197284 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4609b6ba-3848-4e56-8aed-4298e7377e4f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:08.198262 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4609b6ba-3848-4e56-8aed-4298e7377e4f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:08.200122 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4609b6ba-3848-4e56-8aed-4298e7377e4f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:08.202460 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4609b6ba-3848-4e56-8aed-4298e7377e4f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:08.227683 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-49c0a128-a6d9-41c2-bac5-22b89be050d0 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683d18db860a4d60ab3eeba2a372b2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11973b8e1d8a4af8add65726e8ba7c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:08.243879 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-49c0a128-a6d9-41c2-bac5-22b89be050d0 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c" status: 200 len: 1720 microversion: 2.1 time: 0.275109 Oct 17 13:49:08.262045 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1684/3348] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:07 2022] GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c => generated 1720 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:08.539843 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4609b6ba-3848-4e56-8aed-4298e7377e4f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:08.541788 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4cb2311b-2077-47bf-937b-dea35ca48c6a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:08.542645 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4cb2311b-2077-47bf-937b-dea35ca48c6a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: e1fb1718-c504-47dc-ab2e-28fe15d2c435] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:08.551215 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4cb2311b-2077-47bf-937b-dea35ca48c6a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:08.551927 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4cb2311b-2077-47bf-937b-dea35ca48c6a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:08.552313 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4609b6ba-3848-4e56-8aed-4298e7377e4f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:08.552505 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4cb2311b-2077-47bf-937b-dea35ca48c6a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:08.553472 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4cb2311b-2077-47bf-937b-dea35ca48c6a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:08.554100 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4cb2311b-2077-47bf-937b-dea35ca48c6a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:08.554224 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4609b6ba-3848-4e56-8aed-4298e7377e4f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:08.554640 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4cb2311b-2077-47bf-937b-dea35ca48c6a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:08.556261 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4609b6ba-3848-4e56-8aed-4298e7377e4f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1879 microversion: 2.32 time: 0.383162 Oct 17 13:49:08.557031 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1665/3349] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:49:08 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1879 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:49:08.822865 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-514211a8-9ce2-47ea-b6cc-16b6867e6644 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:08.823607 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-514211a8-9ce2-47ea-b6cc-16b6867e6644 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 68363fdf-f661-4b7c-abdc-7a8a85efa83a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:08.842268 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-514211a8-9ce2-47ea-b6cc-16b6867e6644 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:08.846789 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-514211a8-9ce2-47ea-b6cc-16b6867e6644 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:08.847530 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4cb2311b-2077-47bf-937b-dea35ca48c6a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:08.850365 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-514211a8-9ce2-47ea-b6cc-16b6867e6644 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:08.854346 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-514211a8-9ce2-47ea-b6cc-16b6867e6644 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:08.855328 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-514211a8-9ce2-47ea-b6cc-16b6867e6644 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:08.857011 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-514211a8-9ce2-47ea-b6cc-16b6867e6644 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:08.858584 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4cb2311b-2077-47bf-937b-dea35ca48c6a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435" status: 200 len: 1528 microversion: 2.1 time: 0.324677 Oct 17 13:49:08.859569 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1685/3350] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:08 2022] GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435 => generated 1528 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:08.887115 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-bff8d175-2575-4a1c-ba11-28b44f7c9d15 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:08.888102 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-bff8d175-2575-4a1c-ba11-28b44f7c9d15 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: e1fb1718-c504-47dc-ab2e-28fe15d2c435] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:08.896018 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bff8d175-2575-4a1c-ba11-28b44f7c9d15 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:08.896832 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bff8d175-2575-4a1c-ba11-28b44f7c9d15 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:08.897434 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bff8d175-2575-4a1c-ba11-28b44f7c9d15 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:08.898360 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bff8d175-2575-4a1c-ba11-28b44f7c9d15 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:08.898978 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bff8d175-2575-4a1c-ba11-28b44f7c9d15 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:08.899594 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bff8d175-2575-4a1c-ba11-28b44f7c9d15 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:09.223411 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-514211a8-9ce2-47ea-b6cc-16b6867e6644 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:09.241405 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-514211a8-9ce2-47ea-b6cc-16b6867e6644 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a" status: 200 len: 1522 microversion: 2.1 time: 0.432374 Oct 17 13:49:09.245590 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1666/3351] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:08 2022] GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a => generated 1522 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:09.270486 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-46ffa10a-d1a0-40c9-ada5-277faa59bab3 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:09.271989 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-46ffa10a-d1a0-40c9-ada5-277faa59bab3 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: a2994495-366a-446f-b7a6-16340911e17c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:09.285404 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-46ffa10a-d1a0-40c9-ada5-277faa59bab3 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:09.286167 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-46ffa10a-d1a0-40c9-ada5-277faa59bab3 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:09.286321 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-bff8d175-2575-4a1c-ba11-28b44f7c9d15 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:09.287909 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-46ffa10a-d1a0-40c9-ada5-277faa59bab3 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:09.291099 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-46ffa10a-d1a0-40c9-ada5-277faa59bab3 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:09.293055 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-46ffa10a-d1a0-40c9-ada5-277faa59bab3 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:09.293792 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-46ffa10a-d1a0-40c9-ada5-277faa59bab3 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:09.300521 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-bff8d175-2575-4a1c-ba11-28b44f7c9d15 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435" status: 200 len: 1528 microversion: 2.1 time: 0.415067 Oct 17 13:49:09.301222 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1686/3352] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:08 2022] GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435 => generated 1528 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:09.335609 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e378b39e-f450-43a8-a4c7-952b56e81e0f tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:09.371703 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e378b39e-f450-43a8-a4c7-952b56e81e0f tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/fcab7af2-ec08-4c4c-a1f9-aaa2d9f08711" status: 202 len: 0 microversion: 2.1 time: 0.045931 Oct 17 13:49:09.378427 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1687/3353] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:49:09 2022] DELETE /compute/v2.1/flavors/fcab7af2-ec08-4c4c-a1f9-aaa2d9f08711 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:49:09.390405 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8ae77f95-5f1b-42b1-a47d-ade6d90febcb tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:09.433326 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8ae77f95-5f1b-42b1-a47d-ade6d90febcb tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.052312 Oct 17 13:49:09.452638 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1688/3354] 10.222.0.79 () {58 vars in 1146 bytes} [Mon Oct 17 13:49:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:09.469845 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6a22a7b1-b4d0-4306-b547-267b2f3bc282 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:49:09.477389 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6a22a7b1-b4d0-4306-b547-267b2f3bc282 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: e1fb1718-c504-47dc-ab2e-28fe15d2c435] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:09.494847 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6a22a7b1-b4d0-4306-b547-267b2f3bc282 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:09.495394 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6a22a7b1-b4d0-4306-b547-267b2f3bc282 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:09.495816 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6a22a7b1-b4d0-4306-b547-267b2f3bc282 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:09.499494 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6a22a7b1-b4d0-4306-b547-267b2f3bc282 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:09.500444 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6a22a7b1-b4d0-4306-b547-267b2f3bc282 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:09.502124 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6a22a7b1-b4d0-4306-b547-267b2f3bc282 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:09.647413 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-46ffa10a-d1a0-40c9-ada5-277faa59bab3 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683d18db860a4d60ab3eeba2a372b2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11973b8e1d8a4af8add65726e8ba7c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:09.661570 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-46ffa10a-d1a0-40c9-ada5-277faa59bab3 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c" status: 200 len: 1697 microversion: 2.1 time: 0.395663 Oct 17 13:49:09.664042 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1667/3355] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:09 2022] GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c => generated 1697 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:49:09.678161 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-75e818a8-9e35-4654-bfe3-ce830200bb17 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:09.680990 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-75e818a8-9e35-4654-bfe3-ce830200bb17 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:09.690112 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6a22a7b1-b4d0-4306-b547-267b2f3bc282 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:09.698089 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-75e818a8-9e35-4654-bfe3-ce830200bb17 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:09.700533 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6a22a7b1-b4d0-4306-b547-267b2f3bc282 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: e1fb1718-c504-47dc-ab2e-28fe15d2c435] Old instance type tempest-test_resize_flavor_-1942281229, new instance type m1.heat {{(pid=127016) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 17 13:49:09.709289 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-75e818a8-9e35-4654-bfe3-ce830200bb17 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:09.711073 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-75e818a8-9e35-4654-bfe3-ce830200bb17 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:09.715133 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-75e818a8-9e35-4654-bfe3-ce830200bb17 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:09.715891 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-75e818a8-9e35-4654-bfe3-ce830200bb17 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:09.716191 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-6a22a7b1-b4d0-4306-b547-267b2f3bc282 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:49:09.716603 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-6a22a7b1-b4d0-4306-b547-267b2f3bc282 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:49:09.717068 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-6a22a7b1-b4d0-4306-b547-267b2f3bc282 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:49:09.718404 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-75e818a8-9e35-4654-bfe3-ce830200bb17 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:09.722893 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-6a22a7b1-b4d0-4306-b547-267b2f3bc282 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:49:09.723552 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-6a22a7b1-b4d0-4306-b547-267b2f3bc282 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:49:10.057986 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6a22a7b1-b4d0-4306-b547-267b2f3bc282 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "POST /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435/action" status: 202 len: 0 microversion: 2.1 time: 0.602770 Oct 17 13:49:10.061870 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1689/3356] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:49:09 2022] POST /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435/action => generated 0 bytes in 607 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:49:10.085881 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3a78ad66-e1de-4e22-a09a-5f20fbd29d58 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:49:10.111072 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3a78ad66-e1de-4e22-a09a-5f20fbd29d58 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:10.111840 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3a78ad66-e1de-4e22-a09a-5f20fbd29d58 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:10.126084 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3a78ad66-e1de-4e22-a09a-5f20fbd29d58 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:10.189819 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3a78ad66-e1de-4e22-a09a-5f20fbd29d58 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: a2994495-366a-446f-b7a6-16340911e17c] Going to try to start instance {{(pid=127016) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 17 13:49:10.291230 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3a78ad66-e1de-4e22-a09a-5f20fbd29d58 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "POST /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c/action" status: 202 len: 0 microversion: 2.1 time: 0.226682 Oct 17 13:49:10.293707 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1690/3357] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:49:10 2022] POST /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:49:10.317154 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-45137e60-3f88-4fba-b778-b0cd57659732 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:10.323668 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-45137e60-3f88-4fba-b778-b0cd57659732 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: e1fb1718-c504-47dc-ab2e-28fe15d2c435] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:10.356028 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-45137e60-3f88-4fba-b778-b0cd57659732 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:10.356541 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-45137e60-3f88-4fba-b778-b0cd57659732 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:10.357007 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-45137e60-3f88-4fba-b778-b0cd57659732 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:10.364092 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-45137e60-3f88-4fba-b778-b0cd57659732 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:10.365022 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-45137e60-3f88-4fba-b778-b0cd57659732 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:10.365471 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-45137e60-3f88-4fba-b778-b0cd57659732 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:11.175920 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-75e818a8-9e35-4654-bfe3-ce830200bb17 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:11.196467 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-75e818a8-9e35-4654-bfe3-ce830200bb17 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:11.200424 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-75e818a8-9e35-4654-bfe3-ce830200bb17 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:11.204833 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-75e818a8-9e35-4654-bfe3-ce830200bb17 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1879 microversion: 2.32 time: 1.539053 Oct 17 13:49:11.206732 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1668/3358] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:49:09 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1879 bytes in 1542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:49:11.218339 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ac31b903-d4f1-4ece-a5ef-003dd5541758 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:11.219947 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ac31b903-d4f1-4ece-a5ef-003dd5541758 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 68363fdf-f661-4b7c-abdc-7a8a85efa83a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:11.230126 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac31b903-d4f1-4ece-a5ef-003dd5541758 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:11.231358 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac31b903-d4f1-4ece-a5ef-003dd5541758 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:11.232444 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac31b903-d4f1-4ece-a5ef-003dd5541758 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:11.232738 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac31b903-d4f1-4ece-a5ef-003dd5541758 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:11.233332 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac31b903-d4f1-4ece-a5ef-003dd5541758 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:11.234090 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac31b903-d4f1-4ece-a5ef-003dd5541758 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:11.262755 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-45137e60-3f88-4fba-b778-b0cd57659732 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:11.284354 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-45137e60-3f88-4fba-b778-b0cd57659732 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435" status: 200 len: 1537 microversion: 2.1 time: 0.969049 Oct 17 13:49:11.287629 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1691/3359] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:10 2022] GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435 => generated 1537 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:11.315523 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e9328072-fab3-4b9d-830c-03161ade0ffb tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:11.323975 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e9328072-fab3-4b9d-830c-03161ade0ffb tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: a2994495-366a-446f-b7a6-16340911e17c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:11.342387 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9328072-fab3-4b9d-830c-03161ade0ffb tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:11.343376 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9328072-fab3-4b9d-830c-03161ade0ffb tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:11.344175 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9328072-fab3-4b9d-830c-03161ade0ffb tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:11.345232 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9328072-fab3-4b9d-830c-03161ade0ffb tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:11.346084 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9328072-fab3-4b9d-830c-03161ade0ffb tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:11.346829 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9328072-fab3-4b9d-830c-03161ade0ffb tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:11.649800 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ac31b903-d4f1-4ece-a5ef-003dd5541758 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:11.660058 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ac31b903-d4f1-4ece-a5ef-003dd5541758 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a" status: 200 len: 1522 microversion: 2.1 time: 0.452112 Oct 17 13:49:11.662869 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1669/3360] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:11 2022] GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a => generated 1522 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:11.766149 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e9328072-fab3-4b9d-830c-03161ade0ffb tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683d18db860a4d60ab3eeba2a372b2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11973b8e1d8a4af8add65726e8ba7c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:11.785212 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e9328072-fab3-4b9d-830c-03161ade0ffb tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c" status: 200 len: 1706 microversion: 2.1 time: 0.494804 Oct 17 13:49:11.786434 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1692/3361] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:11 2022] GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c => generated 1706 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:12.241432 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4ad58339-5c36-4373-8150-d7b8fdb838de tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:12.242669 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4ad58339-5c36-4373-8150-d7b8fdb838de tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:12.255648 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4ad58339-5c36-4373-8150-d7b8fdb838de tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:12.256605 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4ad58339-5c36-4373-8150-d7b8fdb838de tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:12.257219 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4ad58339-5c36-4373-8150-d7b8fdb838de tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:12.259447 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4ad58339-5c36-4373-8150-d7b8fdb838de tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:12.262106 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4ad58339-5c36-4373-8150-d7b8fdb838de tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:12.262539 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4ad58339-5c36-4373-8150-d7b8fdb838de tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:12.311066 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2d96e0d5-b52b-4068-ba35-2822e0414f76 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:12.311977 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2d96e0d5-b52b-4068-ba35-2822e0414f76 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: e1fb1718-c504-47dc-ab2e-28fe15d2c435] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:12.332928 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2d96e0d5-b52b-4068-ba35-2822e0414f76 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:12.335615 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2d96e0d5-b52b-4068-ba35-2822e0414f76 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:12.336374 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2d96e0d5-b52b-4068-ba35-2822e0414f76 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:12.337979 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2d96e0d5-b52b-4068-ba35-2822e0414f76 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:12.340358 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2d96e0d5-b52b-4068-ba35-2822e0414f76 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:12.341010 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2d96e0d5-b52b-4068-ba35-2822e0414f76 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:12.435712 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:49:12.895950 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4ad58339-5c36-4373-8150-d7b8fdb838de tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:12.900296 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2d96e0d5-b52b-4068-ba35-2822e0414f76 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:12.910136 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4ad58339-5c36-4373-8150-d7b8fdb838de tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:12.913290 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4ad58339-5c36-4373-8150-d7b8fdb838de tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:12.914843 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4ad58339-5c36-4373-8150-d7b8fdb838de tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1879 microversion: 2.32 time: 0.678162 Oct 17 13:49:12.918092 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2d96e0d5-b52b-4068-ba35-2822e0414f76 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435" status: 200 len: 1537 microversion: 2.1 time: 0.610746 Oct 17 13:49:12.927857 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1693/3362] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:12 2022] GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435 => generated 1537 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:49:12.940521 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1670/3363] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:49:12 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1879 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:49:12.948712 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b6336f9f-0c45-4e02-b7dc-49e25e648de0 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:12.950046 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b6336f9f-0c45-4e02-b7dc-49e25e648de0 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: a2994495-366a-446f-b7a6-16340911e17c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:12.956759 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=98 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:49:12.958543 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b6336f9f-0c45-4e02-b7dc-49e25e648de0 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:12.959283 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b6336f9f-0c45-4e02-b7dc-49e25e648de0 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:12.960255 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b6336f9f-0c45-4e02-b7dc-49e25e648de0 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:12.962216 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b6336f9f-0c45-4e02-b7dc-49e25e648de0 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:12.964610 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b6336f9f-0c45-4e02-b7dc-49e25e648de0 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:12.965330 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b6336f9f-0c45-4e02-b7dc-49e25e648de0 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:12.975082 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6bc44089-7b9b-4783-895b-3b7ff553d3b6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:12.978556 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6bc44089-7b9b-4783-895b-3b7ff553d3b6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 68363fdf-f661-4b7c-abdc-7a8a85efa83a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:13.024600 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6bc44089-7b9b-4783-895b-3b7ff553d3b6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:13.025142 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6bc44089-7b9b-4783-895b-3b7ff553d3b6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:13.033529 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6bc44089-7b9b-4783-895b-3b7ff553d3b6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:13.038956 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6bc44089-7b9b-4783-895b-3b7ff553d3b6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:13.040042 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=100 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:49:13.042946 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6bc44089-7b9b-4783-895b-3b7ff553d3b6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:13.044856 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6bc44089-7b9b-4783-895b-3b7ff553d3b6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:13.532194 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b6336f9f-0c45-4e02-b7dc-49e25e648de0 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683d18db860a4d60ab3eeba2a372b2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11973b8e1d8a4af8add65726e8ba7c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:13.546292 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b6336f9f-0c45-4e02-b7dc-49e25e648de0 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c" status: 200 len: 1706 microversion: 2.1 time: 0.601880 Oct 17 13:49:13.547898 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1671/3364] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:12 2022] GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c => generated 1706 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:13.682180 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6bc44089-7b9b-4783-895b-3b7ff553d3b6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:13.700460 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6bc44089-7b9b-4783-895b-3b7ff553d3b6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a" status: 200 len: 1522 microversion: 2.1 time: 0.776426 Oct 17 13:49:13.717078 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1694/3365] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:12 2022] GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a => generated 1522 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:13.946733 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-61ae09b4-c477-4406-af6f-6e139609041f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:13.959766 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a7697d13-6934-4433-ab89-c3de3c02fc59 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:13.960412 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a7697d13-6934-4433-ab89-c3de3c02fc59 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: e1fb1718-c504-47dc-ab2e-28fe15d2c435] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:13.961343 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-61ae09b4-c477-4406-af6f-6e139609041f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:13.976903 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a7697d13-6934-4433-ab89-c3de3c02fc59 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:13.979142 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-61ae09b4-c477-4406-af6f-6e139609041f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:13.980016 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a7697d13-6934-4433-ab89-c3de3c02fc59 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:13.980712 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a7697d13-6934-4433-ab89-c3de3c02fc59 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:13.981677 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a7697d13-6934-4433-ab89-c3de3c02fc59 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:13.982460 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-61ae09b4-c477-4406-af6f-6e139609041f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:13.983148 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-61ae09b4-c477-4406-af6f-6e139609041f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:13.986345 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a7697d13-6934-4433-ab89-c3de3c02fc59 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:13.989208 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-61ae09b4-c477-4406-af6f-6e139609041f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:13.990069 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a7697d13-6934-4433-ab89-c3de3c02fc59 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:13.994495 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-61ae09b4-c477-4406-af6f-6e139609041f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:13.997412 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-61ae09b4-c477-4406-af6f-6e139609041f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:14.649396 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-61ae09b4-c477-4406-af6f-6e139609041f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:14.663905 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-61ae09b4-c477-4406-af6f-6e139609041f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:14.665830 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-61ae09b4-c477-4406-af6f-6e139609041f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:14.667467 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-61ae09b4-c477-4406-af6f-6e139609041f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1879 microversion: 2.32 time: 0.724914 Oct 17 13:49:14.693972 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1695/3366] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:49:13 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1879 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:49:14.700128 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9ddb631e-d30a-4dd5-8afb-3d68996ecc0d tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:14.713134 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9ddb631e-d30a-4dd5-8afb-3d68996ecc0d tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: a2994495-366a-446f-b7a6-16340911e17c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:14.727576 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9ddb631e-d30a-4dd5-8afb-3d68996ecc0d tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:14.728434 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9ddb631e-d30a-4dd5-8afb-3d68996ecc0d tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:14.729113 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9ddb631e-d30a-4dd5-8afb-3d68996ecc0d tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:14.730099 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9ddb631e-d30a-4dd5-8afb-3d68996ecc0d tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:14.731973 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9ddb631e-d30a-4dd5-8afb-3d68996ecc0d tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:14.734021 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9ddb631e-d30a-4dd5-8afb-3d68996ecc0d tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:14.971528 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a7697d13-6934-4433-ab89-c3de3c02fc59 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:14.986880 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a7697d13-6934-4433-ab89-c3de3c02fc59 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435" status: 200 len: 1537 microversion: 2.1 time: 1.047424 Oct 17 13:49:15.005778 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1672/3367] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:13 2022] GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435 => generated 1537 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:15.018917 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-fd88e891-9ade-4f39-b1ad-37f6fc95ab18 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:15.026890 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-fd88e891-9ade-4f39-b1ad-37f6fc95ab18 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 68363fdf-f661-4b7c-abdc-7a8a85efa83a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:15.050634 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fd88e891-9ade-4f39-b1ad-37f6fc95ab18 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:15.051937 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fd88e891-9ade-4f39-b1ad-37f6fc95ab18 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:15.053933 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fd88e891-9ade-4f39-b1ad-37f6fc95ab18 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:15.057959 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fd88e891-9ade-4f39-b1ad-37f6fc95ab18 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:15.059825 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fd88e891-9ade-4f39-b1ad-37f6fc95ab18 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:15.060573 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fd88e891-9ade-4f39-b1ad-37f6fc95ab18 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:15.490479 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9ddb631e-d30a-4dd5-8afb-3d68996ecc0d tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683d18db860a4d60ab3eeba2a372b2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11973b8e1d8a4af8add65726e8ba7c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:15.525023 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9ddb631e-d30a-4dd5-8afb-3d68996ecc0d tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c" status: 200 len: 1710 microversion: 2.1 time: 0.828989 Oct 17 13:49:15.527133 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1696/3368] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:14 2022] GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c => generated 1710 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:15.676069 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-fd88e891-9ade-4f39-b1ad-37f6fc95ab18 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:15.699542 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ba9e1d9c-7917-4538-ad79-3fcfa78d90df tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:15.700841 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ba9e1d9c-7917-4538-ad79-3fcfa78d90df tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:15.713398 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-fd88e891-9ade-4f39-b1ad-37f6fc95ab18 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a" status: 200 len: 1522 microversion: 2.1 time: 0.701915 Oct 17 13:49:15.715506 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1673/3369] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:15 2022] GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a => generated 1522 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:15.719278 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ba9e1d9c-7917-4538-ad79-3fcfa78d90df tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:15.722949 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ba9e1d9c-7917-4538-ad79-3fcfa78d90df tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:15.723570 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ba9e1d9c-7917-4538-ad79-3fcfa78d90df tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:15.725534 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ba9e1d9c-7917-4538-ad79-3fcfa78d90df tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:15.728606 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ba9e1d9c-7917-4538-ad79-3fcfa78d90df tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:15.732309 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ba9e1d9c-7917-4538-ad79-3fcfa78d90df tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:16.016750 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-34b2c2bb-5712-40bf-bfb7-8194a05edabc tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:16.017491 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-34b2c2bb-5712-40bf-bfb7-8194a05edabc tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: e1fb1718-c504-47dc-ab2e-28fe15d2c435] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:16.032826 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-34b2c2bb-5712-40bf-bfb7-8194a05edabc tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:16.036647 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-34b2c2bb-5712-40bf-bfb7-8194a05edabc tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:16.037509 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-34b2c2bb-5712-40bf-bfb7-8194a05edabc tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:16.048356 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-34b2c2bb-5712-40bf-bfb7-8194a05edabc tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:16.050914 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-34b2c2bb-5712-40bf-bfb7-8194a05edabc tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:16.053120 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-34b2c2bb-5712-40bf-bfb7-8194a05edabc tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:16.130581 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ba9e1d9c-7917-4538-ad79-3fcfa78d90df tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:16.141088 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ba9e1d9c-7917-4538-ad79-3fcfa78d90df tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:16.142636 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ba9e1d9c-7917-4538-ad79-3fcfa78d90df tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:16.154809 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ba9e1d9c-7917-4538-ad79-3fcfa78d90df tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1879 microversion: 2.32 time: 0.450540 Oct 17 13:49:16.158404 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1697/3370] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:49:15 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1879 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:49:16.296246 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-34b2c2bb-5712-40bf-bfb7-8194a05edabc tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:16.312046 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-34b2c2bb-5712-40bf-bfb7-8194a05edabc tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435" status: 200 len: 1542 microversion: 2.1 time: 0.297727 Oct 17 13:49:16.314347 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1674/3371] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:16 2022] GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435 => generated 1542 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:49:16.741104 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e7d937a4-e34a-4c5c-a005-c23e0a92dbc5 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:16.741665 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e7d937a4-e34a-4c5c-a005-c23e0a92dbc5 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 68363fdf-f661-4b7c-abdc-7a8a85efa83a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:16.754644 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7d937a4-e34a-4c5c-a005-c23e0a92dbc5 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:16.755483 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7d937a4-e34a-4c5c-a005-c23e0a92dbc5 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:16.757569 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7d937a4-e34a-4c5c-a005-c23e0a92dbc5 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:16.760079 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7d937a4-e34a-4c5c-a005-c23e0a92dbc5 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:16.760801 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7d937a4-e34a-4c5c-a005-c23e0a92dbc5 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:16.763780 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7d937a4-e34a-4c5c-a005-c23e0a92dbc5 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:17.132041 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e7d937a4-e34a-4c5c-a005-c23e0a92dbc5 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:17.141442 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e7d937a4-e34a-4c5c-a005-c23e0a92dbc5 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a" status: 200 len: 1522 microversion: 2.1 time: 0.404474 Oct 17 13:49:17.142055 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1698/3372] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:16 2022] GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a => generated 1522 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:17.186637 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-34f6a090-c5c9-41f5-aa2e-2298a211a5a0 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:17.187543 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-34f6a090-c5c9-41f5-aa2e-2298a211a5a0 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:17.197599 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-34f6a090-c5c9-41f5-aa2e-2298a211a5a0 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:17.198238 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-34f6a090-c5c9-41f5-aa2e-2298a211a5a0 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:17.199043 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-34f6a090-c5c9-41f5-aa2e-2298a211a5a0 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:17.199992 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-34f6a090-c5c9-41f5-aa2e-2298a211a5a0 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:17.200593 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-34f6a090-c5c9-41f5-aa2e-2298a211a5a0 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:17.201251 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-34f6a090-c5c9-41f5-aa2e-2298a211a5a0 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:17.342310 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6fd24819-6c6e-4045-9feb-84d5c80556d1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:17.344090 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6fd24819-6c6e-4045-9feb-84d5c80556d1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: e1fb1718-c504-47dc-ab2e-28fe15d2c435] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:17.362704 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6fd24819-6c6e-4045-9feb-84d5c80556d1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:17.363754 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6fd24819-6c6e-4045-9feb-84d5c80556d1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:17.371732 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6fd24819-6c6e-4045-9feb-84d5c80556d1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:17.376422 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6fd24819-6c6e-4045-9feb-84d5c80556d1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:17.377210 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6fd24819-6c6e-4045-9feb-84d5c80556d1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:17.377948 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6fd24819-6c6e-4045-9feb-84d5c80556d1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:17.775517 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-34f6a090-c5c9-41f5-aa2e-2298a211a5a0 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:17.796766 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-34f6a090-c5c9-41f5-aa2e-2298a211a5a0 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:17.799189 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-34f6a090-c5c9-41f5-aa2e-2298a211a5a0 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:17.804699 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-34f6a090-c5c9-41f5-aa2e-2298a211a5a0 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1879 microversion: 2.32 time: 0.623758 Oct 17 13:49:17.808501 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1675/3373] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:49:17 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1879 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:49:17.822844 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-b0308e51-0b86-444a-94d5-fe6a78eed9b0 req-88561a65-1c54-4f97-99c1-173eccdf8f1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2", "name": "network-vif-plugged", "status": "completed", "tag": "fac894e0-9d90-47af-ad82-0c669f0a03f4"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:49:17.849898 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-b0308e51-0b86-444a-94d5-fe6a78eed9b0 req-88561a65-1c54-4f97-99c1-173eccdf8f1e service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:17.854610 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-b0308e51-0b86-444a-94d5-fe6a78eed9b0 req-88561a65-1c54-4f97-99c1-173eccdf8f1e service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:17.856219 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-b0308e51-0b86-444a-94d5-fe6a78eed9b0 req-88561a65-1c54-4f97-99c1-173eccdf8f1e service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:17.892603 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-b0308e51-0b86-444a-94d5-fe6a78eed9b0 req-88561a65-1c54-4f97-99c1-173eccdf8f1e service nova] Creating event network-vif-plugged:fac894e0-9d90-47af-ad82-0c669f0a03f4 for instance 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 on n-h1-854247-14 Oct 17 13:49:17.909588 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-b0308e51-0b86-444a-94d5-fe6a78eed9b0 req-88561a65-1c54-4f97-99c1-173eccdf8f1e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089434 Oct 17 13:49:17.915603 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1676/3374] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:49:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:49:17.957674 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6fd24819-6c6e-4045-9feb-84d5c80556d1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:17.968867 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6fd24819-6c6e-4045-9feb-84d5c80556d1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435" status: 200 len: 1542 microversion: 2.1 time: 0.630990 Oct 17 13:49:17.973355 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1699/3375] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:17 2022] GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435 => generated 1542 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:18.168475 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6209b9fb-2713-4380-81a2-61730e9bd75f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:18.169543 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6209b9fb-2713-4380-81a2-61730e9bd75f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 68363fdf-f661-4b7c-abdc-7a8a85efa83a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:18.179205 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6209b9fb-2713-4380-81a2-61730e9bd75f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:18.182135 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6209b9fb-2713-4380-81a2-61730e9bd75f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:18.185739 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6209b9fb-2713-4380-81a2-61730e9bd75f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:18.187078 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6209b9fb-2713-4380-81a2-61730e9bd75f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:18.187589 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6209b9fb-2713-4380-81a2-61730e9bd75f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:18.188016 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6209b9fb-2713-4380-81a2-61730e9bd75f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:18.237757 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-928e58a9-de6b-4e65-ad78-d19a7e6c54fe tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Action: 'create', calling method: .version_select at 0x7f7cd59e3a60>, body: {"keypair": {"name": "tempest-keypair-48261411", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNwoBDKSyi5czbSpEHK1SkWR01DDCcdKGJzipENDP5FLbqOzkpKJb66kAu/+gFhh5ACmEHKVwYZYD5rL5j2UUmLOlfQlMTLemNPASlSQ3vXOy2yztS4b+dDBePivPStm5w=="}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:49:18.265490 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-928e58a9-de6b-4e65-ad78-d19a7e6c54fe tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Getting quotas for project a584b724ab934dd59315d9c644f11cfa. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:49:18.272457 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-928e58a9-de6b-4e65-ad78-d19a7e6c54fe tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Getting quotas for user 5ef890da37cc444380f1c373ffbf1aac and project a584b724ab934dd59315d9c644f11cfa. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:49:18.305146 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-928e58a9-de6b-4e65-ad78-d19a7e6c54fe tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.387880 Oct 17 13:49:18.306090 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1677/3376] 10.222.0.79 () {60 vars in 1159 bytes} [Mon Oct 17 13:49:17 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:49:18.490918 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6209b9fb-2713-4380-81a2-61730e9bd75f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:18.509577 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6209b9fb-2713-4380-81a2-61730e9bd75f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a" status: 200 len: 1522 microversion: 2.1 time: 0.347289 Oct 17 13:49:18.515815 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1700/3377] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:18 2022] GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a => generated 1522 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:18.840814 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4f03ceaa-3c97-42a5-ad25-685dcd052fef tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:18.841730 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4f03ceaa-3c97-42a5-ad25-685dcd052fef tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:18.850123 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4f03ceaa-3c97-42a5-ad25-685dcd052fef tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:18.850777 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4f03ceaa-3c97-42a5-ad25-685dcd052fef tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:18.851527 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4f03ceaa-3c97-42a5-ad25-685dcd052fef tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:18.852478 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4f03ceaa-3c97-42a5-ad25-685dcd052fef tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:18.853041 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4f03ceaa-3c97-42a5-ad25-685dcd052fef tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:18.853824 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4f03ceaa-3c97-42a5-ad25-685dcd052fef tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:19.000268 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8aab9b66-dccf-4d51-8161-d56f58d56604 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:19.001664 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8aab9b66-dccf-4d51-8161-d56f58d56604 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: e1fb1718-c504-47dc-ab2e-28fe15d2c435] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:19.014287 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8aab9b66-dccf-4d51-8161-d56f58d56604 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:19.014776 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8aab9b66-dccf-4d51-8161-d56f58d56604 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:19.015250 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8aab9b66-dccf-4d51-8161-d56f58d56604 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:19.016055 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8aab9b66-dccf-4d51-8161-d56f58d56604 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:19.016509 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8aab9b66-dccf-4d51-8161-d56f58d56604 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:19.017070 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8aab9b66-dccf-4d51-8161-d56f58d56604 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:19.288701 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4f03ceaa-3c97-42a5-ad25-685dcd052fef tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:19.306286 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4f03ceaa-3c97-42a5-ad25-685dcd052fef tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:19.307972 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4f03ceaa-3c97-42a5-ad25-685dcd052fef tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:19.309467 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4f03ceaa-3c97-42a5-ad25-685dcd052fef tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1879 microversion: 2.32 time: 0.472881 Oct 17 13:49:19.310153 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1678/3378] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:49:18 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1879 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:49:19.374470 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8aab9b66-dccf-4d51-8161-d56f58d56604 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:19.388016 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8aab9b66-dccf-4d51-8161-d56f58d56604 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435" status: 200 len: 1542 microversion: 2.1 time: 0.393932 Oct 17 13:49:19.389153 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1701/3379] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:18 2022] GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435 => generated 1542 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:49:19.534829 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-081caa98-55f0-45d2-8757-5a9d60bf03f1 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:19.535667 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-081caa98-55f0-45d2-8757-5a9d60bf03f1 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 68363fdf-f661-4b7c-abdc-7a8a85efa83a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:19.542087 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-081caa98-55f0-45d2-8757-5a9d60bf03f1 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:19.542667 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-081caa98-55f0-45d2-8757-5a9d60bf03f1 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:19.543270 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-081caa98-55f0-45d2-8757-5a9d60bf03f1 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:19.544077 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-081caa98-55f0-45d2-8757-5a9d60bf03f1 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:19.544629 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-081caa98-55f0-45d2-8757-5a9d60bf03f1 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:19.545280 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-081caa98-55f0-45d2-8757-5a9d60bf03f1 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:19.812225 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-081caa98-55f0-45d2-8757-5a9d60bf03f1 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:19.827550 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-081caa98-55f0-45d2-8757-5a9d60bf03f1 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a" status: 200 len: 1522 microversion: 2.1 time: 0.297159 Oct 17 13:49:19.842767 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1679/3380] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:19 2022] GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a => generated 1522 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:20.337367 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e348bff5-3e50-4965-9478-71fd31a4094a tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:20.338168 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e348bff5-3e50-4965-9478-71fd31a4094a tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:20.347730 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e348bff5-3e50-4965-9478-71fd31a4094a tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:20.348297 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e348bff5-3e50-4965-9478-71fd31a4094a tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:20.348757 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e348bff5-3e50-4965-9478-71fd31a4094a tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:20.349536 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e348bff5-3e50-4965-9478-71fd31a4094a tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:20.350002 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e348bff5-3e50-4965-9478-71fd31a4094a tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:20.350420 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e348bff5-3e50-4965-9478-71fd31a4094a tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:20.416009 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d552467a-5754-4eb5-ac40-3dbfa7a90e83 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:20.416773 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d552467a-5754-4eb5-ac40-3dbfa7a90e83 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: e1fb1718-c504-47dc-ab2e-28fe15d2c435] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:20.426026 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d552467a-5754-4eb5-ac40-3dbfa7a90e83 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:20.426513 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d552467a-5754-4eb5-ac40-3dbfa7a90e83 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:20.426950 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d552467a-5754-4eb5-ac40-3dbfa7a90e83 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:20.427689 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d552467a-5754-4eb5-ac40-3dbfa7a90e83 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:20.428145 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d552467a-5754-4eb5-ac40-3dbfa7a90e83 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:20.428570 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d552467a-5754-4eb5-ac40-3dbfa7a90e83 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:20.696903 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e348bff5-3e50-4965-9478-71fd31a4094a tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:20.711694 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e348bff5-3e50-4965-9478-71fd31a4094a tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:20.717329 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e348bff5-3e50-4965-9478-71fd31a4094a tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:20.718573 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e348bff5-3e50-4965-9478-71fd31a4094a tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1879 microversion: 2.32 time: 0.385516 Oct 17 13:49:20.719148 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1702/3381] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:49:20 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1879 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:49:20.728008 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d552467a-5754-4eb5-ac40-3dbfa7a90e83 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:20.736041 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d552467a-5754-4eb5-ac40-3dbfa7a90e83 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435" status: 200 len: 1542 microversion: 2.1 time: 0.323950 Oct 17 13:49:20.736642 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1680/3382] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:20 2022] GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435 => generated 1542 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:20.853888 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8ccbb586-99a9-45d0-bf19-02f7db7e5cdf tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:20.854742 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8ccbb586-99a9-45d0-bf19-02f7db7e5cdf tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 68363fdf-f661-4b7c-abdc-7a8a85efa83a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:20.861719 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8ccbb586-99a9-45d0-bf19-02f7db7e5cdf tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:20.862680 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8ccbb586-99a9-45d0-bf19-02f7db7e5cdf tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:20.863450 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8ccbb586-99a9-45d0-bf19-02f7db7e5cdf tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:20.864353 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8ccbb586-99a9-45d0-bf19-02f7db7e5cdf tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:20.865616 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8ccbb586-99a9-45d0-bf19-02f7db7e5cdf tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:20.866357 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8ccbb586-99a9-45d0-bf19-02f7db7e5cdf tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:21.087275 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8ccbb586-99a9-45d0-bf19-02f7db7e5cdf tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:21.099367 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8ccbb586-99a9-45d0-bf19-02f7db7e5cdf tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a" status: 200 len: 1522 microversion: 2.1 time: 0.249394 Oct 17 13:49:21.114603 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1703/3383] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:20 2022] GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a => generated 1522 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:21.745205 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ab95290e-c7b9-48bd-9def-af1500251c50 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:21.745984 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ab95290e-c7b9-48bd-9def-af1500251c50 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:21.757042 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ab95290e-c7b9-48bd-9def-af1500251c50 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:21.758179 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ab95290e-c7b9-48bd-9def-af1500251c50 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:21.758807 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ab95290e-c7b9-48bd-9def-af1500251c50 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:21.760273 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ab95290e-c7b9-48bd-9def-af1500251c50 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:21.760603 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f19448bf-e04d-45c7-9821-61147ded9de7 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:21.761262 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f19448bf-e04d-45c7-9821-61147ded9de7 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: e1fb1718-c504-47dc-ab2e-28fe15d2c435] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:21.764986 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ab95290e-c7b9-48bd-9def-af1500251c50 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:21.765689 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ab95290e-c7b9-48bd-9def-af1500251c50 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:21.770186 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f19448bf-e04d-45c7-9821-61147ded9de7 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:21.771073 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f19448bf-e04d-45c7-9821-61147ded9de7 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:21.771654 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f19448bf-e04d-45c7-9821-61147ded9de7 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:21.772398 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f19448bf-e04d-45c7-9821-61147ded9de7 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:21.772849 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f19448bf-e04d-45c7-9821-61147ded9de7 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:21.773262 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f19448bf-e04d-45c7-9821-61147ded9de7 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:22.178211 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f19448bf-e04d-45c7-9821-61147ded9de7 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:22.191470 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f19448bf-e04d-45c7-9821-61147ded9de7 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435" status: 200 len: 1542 microversion: 2.1 time: 0.436168 Oct 17 13:49:22.198643 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1704/3384] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:21 2022] GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435 => generated 1542 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:22.212324 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0abead2f-dab9-463f-814e-7f06f0ede50a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:22.213043 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0abead2f-dab9-463f-814e-7f06f0ede50a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 68363fdf-f661-4b7c-abdc-7a8a85efa83a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:22.220086 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ab95290e-c7b9-48bd-9def-af1500251c50 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:22.224684 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0abead2f-dab9-463f-814e-7f06f0ede50a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:22.226127 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0abead2f-dab9-463f-814e-7f06f0ede50a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:22.227506 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0abead2f-dab9-463f-814e-7f06f0ede50a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:22.228655 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0abead2f-dab9-463f-814e-7f06f0ede50a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:22.229236 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0abead2f-dab9-463f-814e-7f06f0ede50a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:22.230223 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0abead2f-dab9-463f-814e-7f06f0ede50a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:22.232016 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ab95290e-c7b9-48bd-9def-af1500251c50 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:22.242733 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ab95290e-c7b9-48bd-9def-af1500251c50 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:22.244718 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ab95290e-c7b9-48bd-9def-af1500251c50 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1879 microversion: 2.32 time: 0.504053 Oct 17 13:49:22.245379 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1681/3385] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:49:21 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1879 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:49:22.938011 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0abead2f-dab9-463f-814e-7f06f0ede50a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:22.949749 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0abead2f-dab9-463f-814e-7f06f0ede50a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a" status: 200 len: 1502 microversion: 2.1 time: 0.749620 Oct 17 13:49:22.950727 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1705/3386] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:22 2022] GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a => generated 1502 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:22.978958 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-22ed827a-6149-488c-ade5-4eb07e4fcd51 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:22.979653 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-22ed827a-6149-488c-ade5-4eb07e4fcd51 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 33de8199-8f00-40eb-9b95-b7ab5289dbe3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:22.988477 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-22ed827a-6149-488c-ade5-4eb07e4fcd51 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:22.989560 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-22ed827a-6149-488c-ade5-4eb07e4fcd51 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:22.990022 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-bc64c324-db7a-402e-8c83-c330de195ccf req-573f3793-ecb3-4ec6-9118-df0f618409aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2", "name": "network-vif-plugged", "status": "completed", "tag": "09cd6d52-dd88-453b-97c9-b02b47bbb3bb"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:49:22.990534 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-22ed827a-6149-488c-ade5-4eb07e4fcd51 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:22.991508 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-22ed827a-6149-488c-ade5-4eb07e4fcd51 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:22.992441 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-22ed827a-6149-488c-ade5-4eb07e4fcd51 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:22.993088 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-22ed827a-6149-488c-ade5-4eb07e4fcd51 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:23.003044 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-bc64c324-db7a-402e-8c83-c330de195ccf req-573f3793-ecb3-4ec6-9118-df0f618409aa service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:23.003628 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-bc64c324-db7a-402e-8c83-c330de195ccf req-573f3793-ecb3-4ec6-9118-df0f618409aa service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:23.004100 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-bc64c324-db7a-402e-8c83-c330de195ccf req-573f3793-ecb3-4ec6-9118-df0f618409aa service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:23.025224 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-bc64c324-db7a-402e-8c83-c330de195ccf req-573f3793-ecb3-4ec6-9118-df0f618409aa service nova] Creating event network-vif-plugged:09cd6d52-dd88-453b-97c9-b02b47bbb3bb for instance 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 on n-h1-854247-14 Oct 17 13:49:23.033175 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-bc64c324-db7a-402e-8c83-c330de195ccf req-573f3793-ecb3-4ec6-9118-df0f618409aa service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047049 Oct 17 13:49:23.033992 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1706/3387] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:49:23.223962 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9d4490f6-d279-486b-92d1-32b3defb2989 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:23.225269 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9d4490f6-d279-486b-92d1-32b3defb2989 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: e1fb1718-c504-47dc-ab2e-28fe15d2c435] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:23.231134 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-22ed827a-6149-488c-ade5-4eb07e4fcd51 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:23.235325 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9d4490f6-d279-486b-92d1-32b3defb2989 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:23.235939 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9d4490f6-d279-486b-92d1-32b3defb2989 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:23.236502 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9d4490f6-d279-486b-92d1-32b3defb2989 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:23.237364 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9d4490f6-d279-486b-92d1-32b3defb2989 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:23.238339 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9d4490f6-d279-486b-92d1-32b3defb2989 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:23.239070 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9d4490f6-d279-486b-92d1-32b3defb2989 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:23.245501 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-22ed827a-6149-488c-ade5-4eb07e4fcd51 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3" status: 200 len: 1517 microversion: 2.1 time: 0.268938 Oct 17 13:49:23.247538 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1682/3388] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:22 2022] GET /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3 => generated 1517 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:23.272342 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-79d54112-9f15-4a7d-9c40-ca0f18c07291 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:49:23.275561 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-79d54112-9f15-4a7d-9c40-ca0f18c07291 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: ea2bdf0a-923d-4f3f-8cdb-477022b2abb9] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:23.284539 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-79d54112-9f15-4a7d-9c40-ca0f18c07291 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] HTTP exception thrown: Instance ea2bdf0a-923d-4f3f-8cdb-477022b2abb9 could not be found. Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-79d54112-9f15-4a7d-9c40-ca0f18c07291 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Request method failure captured: Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: request: POST /compute/v2.1/servers/ea2bdf0a-923d-4f3f-8cdb-477022b2abb9/action HTTP/1.1 Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 14 Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTV0lGewBAd5oX7RsuswRRrYdH_s7fnCDLNRSaJQAxErmqZOT5QT6523TfZqZvgb4tWrIGVLDqv0foQ4mpFwe91mdGAxx6JOfjpLIqY8Vnvh6NrynvpuS4ywkAJAwUfpPeJ0dauW6Gj_xg5-jDhUd1iFTLiSXh_-SOzh7_iyTjRI7Ovs Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 08068aeba86c4e718ba1e25c68fd3259 Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1627831718 Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/08068aeba86c4e718ba1e25c68fd3259"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/08068aeba86c4e718ba1e25c68fd3259"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/08068aeba86c4e718ba1e25c68fd3259"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_08068aeba86c4e718ba1e25c68fd3259", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1627831718 Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 08068aeba86c4e718ba1e25c68fd3259 Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1627831718 Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServerRescueNegativeTestJSON-1627831718-project Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: d56b91ce42894bafac5ddb16ad6f037b Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1627831718-project Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: {"rescue": {}} Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance ea2bdf0a-923d-4f3f-8cdb-477022b2abb9 could not be found. Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'ea2bdf0a-923d-4f3f-8cdb-477022b2abb9', 'body': {'rescue': {}}} Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea2bdf0a-923d-4f3f-8cdb-477022b2abb9 could not be found. Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea2bdf0a-923d-4f3f-8cdb-477022b2abb9 could not be found. Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:49:23.293940 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:49:23.301247 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:49:23.301247 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:49:23.301247 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:49:23.301247 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:49:23.301247 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea2bdf0a-923d-4f3f-8cdb-477022b2abb9 could not be found. Oct 17 13:49:23.301247 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:49:23.303471 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-79d54112-9f15-4a7d-9c40-ca0f18c07291 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Returning 404 to user: Instance ea2bdf0a-923d-4f3f-8cdb-477022b2abb9 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:49:23.304905 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-79d54112-9f15-4a7d-9c40-ca0f18c07291 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "POST /compute/v2.1/servers/ea2bdf0a-923d-4f3f-8cdb-477022b2abb9/action" status: 404 len: 111 microversion: 2.1 time: 0.037584 Oct 17 13:49:23.311385 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1683/3389] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:49:23 2022] POST /compute/v2.1/servers/ea2bdf0a-923d-4f3f-8cdb-477022b2abb9/action => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:49:23.319060 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-34a5b31b-b3aa-415e-8170-e9656e1cd7ac tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:23.320055 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-34a5b31b-b3aa-415e-8170-e9656e1cd7ac tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:23.329665 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-34a5b31b-b3aa-415e-8170-e9656e1cd7ac tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:23.330171 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-34a5b31b-b3aa-415e-8170-e9656e1cd7ac tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:23.331023 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-34a5b31b-b3aa-415e-8170-e9656e1cd7ac tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:23.332349 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-34a5b31b-b3aa-415e-8170-e9656e1cd7ac tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:23.334072 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-34a5b31b-b3aa-415e-8170-e9656e1cd7ac tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:23.334754 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-34a5b31b-b3aa-415e-8170-e9656e1cd7ac tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:23.566356 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9d4490f6-d279-486b-92d1-32b3defb2989 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:23.583762 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9d4490f6-d279-486b-92d1-32b3defb2989 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435" status: 200 len: 1542 microversion: 2.1 time: 0.359844 Oct 17 13:49:23.584722 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1707/3390] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:23 2022] GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435 => generated 1542 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:49:23.590021 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8e76066e-72fd-494f-bdc7-5ac86b4e10b3 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:49:23.595783 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8e76066e-72fd-494f-bdc7-5ac86b4e10b3 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 33de8199-8f00-40eb-9b95-b7ab5289dbe3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:23.608644 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8e76066e-72fd-494f-bdc7-5ac86b4e10b3 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:23.609562 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8e76066e-72fd-494f-bdc7-5ac86b4e10b3 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:23.610901 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8e76066e-72fd-494f-bdc7-5ac86b4e10b3 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:23.615146 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8e76066e-72fd-494f-bdc7-5ac86b4e10b3 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:23.616091 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8e76066e-72fd-494f-bdc7-5ac86b4e10b3 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:23.616837 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8e76066e-72fd-494f-bdc7-5ac86b4e10b3 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:23.682905 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-34a5b31b-b3aa-415e-8170-e9656e1cd7ac tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:23.693666 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-34a5b31b-b3aa-415e-8170-e9656e1cd7ac tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:23.695611 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-34a5b31b-b3aa-415e-8170-e9656e1cd7ac tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:23.697861 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-34a5b31b-b3aa-415e-8170-e9656e1cd7ac tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1879 microversion: 2.32 time: 0.383650 Oct 17 13:49:23.699071 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1684/3391] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:49:23 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1879 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:49:23.764822 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8e76066e-72fd-494f-bdc7-5ac86b4e10b3 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "POST /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3/action" status: 202 len: 0 microversion: 2.1 time: 0.178606 Oct 17 13:49:23.769660 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1708/3392] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:49:23 2022] POST /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:49:23.787253 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-445a7f0b-538d-4c9d-9d71-64d4dea31a76 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:23.790259 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-445a7f0b-538d-4c9d-9d71-64d4dea31a76 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 33de8199-8f00-40eb-9b95-b7ab5289dbe3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:23.807664 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-445a7f0b-538d-4c9d-9d71-64d4dea31a76 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:23.808764 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-445a7f0b-538d-4c9d-9d71-64d4dea31a76 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:23.811514 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-445a7f0b-538d-4c9d-9d71-64d4dea31a76 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:23.813494 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-445a7f0b-538d-4c9d-9d71-64d4dea31a76 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:23.814218 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-445a7f0b-538d-4c9d-9d71-64d4dea31a76 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:23.815870 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-445a7f0b-538d-4c9d-9d71-64d4dea31a76 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:24.066617 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-445a7f0b-538d-4c9d-9d71-64d4dea31a76 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:24.079523 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-445a7f0b-538d-4c9d-9d71-64d4dea31a76 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3" status: 200 len: 1522 microversion: 2.1 time: 0.307398 Oct 17 13:49:24.080235 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1685/3393] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:23 2022] GET /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3 => generated 1522 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:24.612541 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4cf26973-33c8-461f-90b4-7af002f0868b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:24.613894 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4cf26973-33c8-461f-90b4-7af002f0868b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: e1fb1718-c504-47dc-ab2e-28fe15d2c435] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:24.623265 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4cf26973-33c8-461f-90b4-7af002f0868b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:24.623661 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4cf26973-33c8-461f-90b4-7af002f0868b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:24.624295 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4cf26973-33c8-461f-90b4-7af002f0868b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:24.625226 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4cf26973-33c8-461f-90b4-7af002f0868b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:24.625845 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4cf26973-33c8-461f-90b4-7af002f0868b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:24.626429 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4cf26973-33c8-461f-90b4-7af002f0868b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:24.648256 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:49:24.668378 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-dbd02e99-0144-441a-839d-d90739505cec tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Action: 'create', calling method: .version_select at 0x7f7cd9a5fb80>, body: {"keypair": {"name": "tempest-keypair-540064923", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI0KY2gEd/HZmVLAMwhu/G1q/9miKj4aqbecN7Sxc3M9m/gFSPTaOGYCbmwCd3ju84fGa0fOtCCzE6ZJsoVpELTBZ0e8MrL5LsPOXGJX1zAf+MmrWJfyvnSSzOGHGoNoDQ=="}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:49:24.696070 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-dbd02e99-0144-441a-839d-d90739505cec tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Getting quotas for project 4acd31ce63b64ac3a05b76d4a9fdf7c0. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:49:24.701661 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-dbd02e99-0144-441a-839d-d90739505cec tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Getting quotas for user c7a7b9b048234fd2926739e3f08400b0 and project 4acd31ce63b64ac3a05b76d4a9fdf7c0. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:49:24.742407 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-dbd02e99-0144-441a-839d-d90739505cec tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.076068 Oct 17 13:49:24.743543 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1686/3394] 10.222.0.79 () {60 vars in 1159 bytes} [Mon Oct 17 13:49:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:49:24.758939 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-49cd1e82-434e-4106-830c-e0e95266a2fb tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:24.759564 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-49cd1e82-434e-4106-830c-e0e95266a2fb tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:24.774039 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-49cd1e82-434e-4106-830c-e0e95266a2fb tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:24.774412 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-49cd1e82-434e-4106-830c-e0e95266a2fb tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:24.774860 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-49cd1e82-434e-4106-830c-e0e95266a2fb tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:24.775703 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-49cd1e82-434e-4106-830c-e0e95266a2fb tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:24.780263 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-49cd1e82-434e-4106-830c-e0e95266a2fb tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:24.780710 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-49cd1e82-434e-4106-830c-e0e95266a2fb tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:24.977603 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4cf26973-33c8-461f-90b4-7af002f0868b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:24.998145 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4cf26973-33c8-461f-90b4-7af002f0868b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435" status: 200 len: 1542 microversion: 2.1 time: 0.391142 Oct 17 13:49:25.017939 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1709/3395] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:24 2022] GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435 => generated 1542 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:25.172744 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-49cd1e82-434e-4106-830c-e0e95266a2fb tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:25.188755 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-49cd1e82-434e-4106-830c-e0e95266a2fb tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:25.195469 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-49cd1e82-434e-4106-830c-e0e95266a2fb tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:25.197731 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-49cd1e82-434e-4106-830c-e0e95266a2fb tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1879 microversion: 2.32 time: 0.452394 Oct 17 13:49:25.198810 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1687/3396] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:49:24 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1879 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:49:25.204238 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7c78e2b8-5c11-4e33-bb58-0ff7d310a0ba tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:25.205111 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7c78e2b8-5c11-4e33-bb58-0ff7d310a0ba tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 33de8199-8f00-40eb-9b95-b7ab5289dbe3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:25.212219 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7c78e2b8-5c11-4e33-bb58-0ff7d310a0ba tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:25.212714 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7c78e2b8-5c11-4e33-bb58-0ff7d310a0ba tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:25.213148 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7c78e2b8-5c11-4e33-bb58-0ff7d310a0ba tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:25.213863 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7c78e2b8-5c11-4e33-bb58-0ff7d310a0ba tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:25.214488 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7c78e2b8-5c11-4e33-bb58-0ff7d310a0ba tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:25.214932 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7c78e2b8-5c11-4e33-bb58-0ff7d310a0ba tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:25.333763 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-19bf47cf-2a54-49f4-b74d-41064f38cd84 req-5a348886-14b0-4e30-a7a2-edd081c093c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2", "name": "network-vif-plugged", "status": "completed", "tag": "d9802ec8-6622-432d-90fa-c32aa88e3fdb"}, {"server_uuid": "6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2", "name": "network-vif-plugged", "status": "completed", "tag": "dc9dca25-b1ad-44bb-8a66-3f7f867f9db4"}, {"server_uuid": "6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2", "name": "network-vif-plugged", "status": "completed", "tag": "d03d577d-51fe-4dfb-b7f2-e27b813faec8"}, {"server_uuid": "6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2", "name": "network-vif-plugged", "status": "completed", "tag": "c69dd4d3-7f9e-45b5-92dc-71c0e0407b40"}, {"server_uuid": "6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2", "name": "network-vif-plugged", "status": "completed", "tag": "8fdca276-a9c8-4e30-8e15-4fc42ba37e91"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:49:25.356803 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-19bf47cf-2a54-49f4-b74d-41064f38cd84 req-5a348886-14b0-4e30-a7a2-edd081c093c4 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:25.357303 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-19bf47cf-2a54-49f4-b74d-41064f38cd84 req-5a348886-14b0-4e30-a7a2-edd081c093c4 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:25.358238 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-19bf47cf-2a54-49f4-b74d-41064f38cd84 req-5a348886-14b0-4e30-a7a2-edd081c093c4 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:25.376887 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-19bf47cf-2a54-49f4-b74d-41064f38cd84 req-5a348886-14b0-4e30-a7a2-edd081c093c4 service nova] Creating event network-vif-plugged:d9802ec8-6622-432d-90fa-c32aa88e3fdb for instance 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 on n-h1-854247-14 Oct 17 13:49:25.377581 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-19bf47cf-2a54-49f4-b74d-41064f38cd84 req-5a348886-14b0-4e30-a7a2-edd081c093c4 service nova] Creating event network-vif-plugged:dc9dca25-b1ad-44bb-8a66-3f7f867f9db4 for instance 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 on n-h1-854247-14 Oct 17 13:49:25.381146 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-19bf47cf-2a54-49f4-b74d-41064f38cd84 req-5a348886-14b0-4e30-a7a2-edd081c093c4 service nova] Creating event network-vif-plugged:d03d577d-51fe-4dfb-b7f2-e27b813faec8 for instance 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 on n-h1-854247-14 Oct 17 13:49:25.382229 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-19bf47cf-2a54-49f4-b74d-41064f38cd84 req-5a348886-14b0-4e30-a7a2-edd081c093c4 service nova] Creating event network-vif-plugged:c69dd4d3-7f9e-45b5-92dc-71c0e0407b40 for instance 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 on n-h1-854247-14 Oct 17 13:49:25.384335 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-19bf47cf-2a54-49f4-b74d-41064f38cd84 req-5a348886-14b0-4e30-a7a2-edd081c093c4 service nova] Creating event network-vif-plugged:8fdca276-a9c8-4e30-8e15-4fc42ba37e91 for instance 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 on n-h1-854247-14 Oct 17 13:49:25.394367 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-19bf47cf-2a54-49f4-b74d-41064f38cd84 req-5a348886-14b0-4e30-a7a2-edd081c093c4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.327985 Oct 17 13:49:25.396067 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1710/3397] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:49:25 2022] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:49:25.484180 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7c78e2b8-5c11-4e33-bb58-0ff7d310a0ba tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:25.495278 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7c78e2b8-5c11-4e33-bb58-0ff7d310a0ba tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3" status: 200 len: 1502 microversion: 2.1 time: 0.294855 Oct 17 13:49:25.496289 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1688/3398] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:25 2022] GET /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3 => generated 1502 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:25.522065 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-49c27906-54cd-4a43-a87e-babcb8447ae8 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:49:25.524829 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-49c27906-54cd-4a43-a87e-babcb8447ae8 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 33de8199-8f00-40eb-9b95-b7ab5289dbe3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:25.532808 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-49c27906-54cd-4a43-a87e-babcb8447ae8 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:25.533598 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-49c27906-54cd-4a43-a87e-babcb8447ae8 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:25.534492 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-49c27906-54cd-4a43-a87e-babcb8447ae8 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:25.535302 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-49c27906-54cd-4a43-a87e-babcb8447ae8 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:25.535955 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-49c27906-54cd-4a43-a87e-babcb8447ae8 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:25.536559 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-49c27906-54cd-4a43-a87e-babcb8447ae8 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:25.563687 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-49c27906-54cd-4a43-a87e-babcb8447ae8 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lazy-loading 'flavor' on Instance uuid 33de8199-8f00-40eb-9b95-b7ab5289dbe3 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:49:25.589258 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-49c27906-54cd-4a43-a87e-babcb8447ae8 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] HTTP exception thrown: Cannot 'rescue' instance 33de8199-8f00-40eb-9b95-b7ab5289dbe3 while it is in vm_state paused Oct 17 13:49:25.591788 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-49c27906-54cd-4a43-a87e-babcb8447ae8 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Request method failure captured: Oct 17 13:49:25.591788 n-d-854247-14 devstack@n-api.service[127016]: request: POST /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3/action HTTP/1.1 Oct 17 13:49:25.591788 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:49:25.591788 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:49:25.591788 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:49:25.591788 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 14 Oct 17 13:49:25.591788 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:49:25.591788 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:49:25.591788 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:49:25.591788 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:49:25.591788 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTV0lGewBAd5oX7RsuswRRrYdH_s7fnCDLNRSaJQAxErmqZOT5QT6523TfZqZvgb4tWrIGVLDqv0foQ4mpFwe91mdGAxx6JOfjpLIqY8Vnvh6NrynvpuS4ywkAJAwUfpPeJ0dauW6Gj_xg5-jDhUd1iFTLiSXh_-SOzh7_iyTjRI7Ovs Oct 17 13:49:25.591788 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:49:25.591788 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:49:25.591788 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:49:25.591788 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:49:25.591788 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:49:25.591788 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:49:25.591788 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 08068aeba86c4e718ba1e25c68fd3259 Oct 17 13:49:25.591788 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1627831718 Oct 17 13:49:25.591788 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:49:25.591788 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:49:25.591788 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/08068aeba86c4e718ba1e25c68fd3259"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/08068aeba86c4e718ba1e25c68fd3259"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/08068aeba86c4e718ba1e25c68fd3259"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_08068aeba86c4e718ba1e25c68fd3259", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:49:25.591788 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1627831718 Oct 17 13:49:25.591788 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 08068aeba86c4e718ba1e25c68fd3259 Oct 17 13:49:25.591788 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1627831718 Oct 17 13:49:25.591788 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServerRescueNegativeTestJSON-1627831718-project Oct 17 13:49:25.591788 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:49:25.591788 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:49:25.591788 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: d56b91ce42894bafac5ddb16ad6f037b Oct 17 13:49:25.591788 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1627831718-project Oct 17 13:49:25.591788 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:49:25.591788 n-d-854247-14 devstack@n-api.service[127016]: {"rescue": {}} Oct 17 13:49:25.591788 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:49:25.591788 n-d-854247-14 devstack@n-api.service[127016]: exception: Cannot 'rescue' instance 33de8199-8f00-40eb-9b95-b7ab5289dbe3 while it is in vm_state paused Oct 17 13:49:25.591788 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '33de8199-8f00-40eb-9b95-b7ab5289dbe3', 'body': {'rescue': {}}} Oct 17 13:49:25.591788 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:49:25.591788 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:49:25.591788 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 17 13:49:25.591788 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 17 13:49:25.591788 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 17 13:49:25.591788 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 13:49:25.591788 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 13:49:25.591788 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:49:25.591788 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 13:49:25.591788 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 13:49:25.591788 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 33de8199-8f00-40eb-9b95-b7ab5289dbe3 in vm_state paused. Cannot rescue while the instance is in this state. Oct 17 13:49:25.591788 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:49:25.591788 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:49:25.591788 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:49:25.591788 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:49:25.591788 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:49:25.591788 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:49:25.591788 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:49:25.591788 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:49:25.591788 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:49:25.591788 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:49:25.591788 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:49:25.591788 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:49:25.591788 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 17 13:49:25.591788 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 17 13:49:25.591788 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 13:49:25.591788 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 13:49:25.591788 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 33de8199-8f00-40eb-9b95-b7ab5289dbe3 while it is in vm_state paused Oct 17 13:49:25.591788 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:49:25.598387 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:49:25.598387 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:49:25.598387 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:49:25.598387 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:49:25.598387 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:49:25.598387 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:49:25.598387 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:49:25.598387 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 33de8199-8f00-40eb-9b95-b7ab5289dbe3 while it is in vm_state paused Oct 17 13:49:25.598387 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:49:25.598387 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-49c27906-54cd-4a43-a87e-babcb8447ae8 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Returning 409 to user: Cannot 'rescue' instance 33de8199-8f00-40eb-9b95-b7ab5289dbe3 while it is in vm_state paused {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:49:25.598387 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-49c27906-54cd-4a43-a87e-babcb8447ae8 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "POST /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3/action" status: 409 len: 144 microversion: 2.1 time: 0.077067 Oct 17 13:49:25.599873 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1711/3399] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:49:25 2022] POST /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3/action => generated 144 bytes in 82 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 17 13:49:25.603809 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c2430e1f-5244-40ee-a55d-b22d8ec140bc tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:49:25.604544 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c2430e1f-5244-40ee-a55d-b22d8ec140bc tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 33de8199-8f00-40eb-9b95-b7ab5289dbe3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:25.611975 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c2430e1f-5244-40ee-a55d-b22d8ec140bc tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:25.612259 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c2430e1f-5244-40ee-a55d-b22d8ec140bc tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:25.612724 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c2430e1f-5244-40ee-a55d-b22d8ec140bc tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:25.613738 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c2430e1f-5244-40ee-a55d-b22d8ec140bc tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:25.614332 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c2430e1f-5244-40ee-a55d-b22d8ec140bc tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:25.614950 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c2430e1f-5244-40ee-a55d-b22d8ec140bc tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:25.713911 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c2430e1f-5244-40ee-a55d-b22d8ec140bc tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "POST /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3/action" status: 202 len: 0 microversion: 2.1 time: 0.113837 Oct 17 13:49:25.715604 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1689/3400] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:49:25 2022] POST /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:49:25.736892 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8b2c5b9d-06ff-4dac-909f-e390bf722706 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:25.737632 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8b2c5b9d-06ff-4dac-909f-e390bf722706 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 33de8199-8f00-40eb-9b95-b7ab5289dbe3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:25.758265 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8b2c5b9d-06ff-4dac-909f-e390bf722706 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:25.759045 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8b2c5b9d-06ff-4dac-909f-e390bf722706 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:25.759707 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8b2c5b9d-06ff-4dac-909f-e390bf722706 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:25.761769 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8b2c5b9d-06ff-4dac-909f-e390bf722706 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:25.764399 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8b2c5b9d-06ff-4dac-909f-e390bf722706 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:25.765329 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8b2c5b9d-06ff-4dac-909f-e390bf722706 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:26.023456 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8b2c5b9d-06ff-4dac-909f-e390bf722706 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:26.030505 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0e809338-f9de-4948-af0f-32f644701041 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:26.031269 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0e809338-f9de-4948-af0f-32f644701041 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: e1fb1718-c504-47dc-ab2e-28fe15d2c435] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:26.037825 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8b2c5b9d-06ff-4dac-909f-e390bf722706 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3" status: 200 len: 1509 microversion: 2.1 time: 0.309583 Oct 17 13:49:26.040183 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1712/3401] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:25 2022] GET /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3 => generated 1509 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:26.040709 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0e809338-f9de-4948-af0f-32f644701041 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:26.041410 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0e809338-f9de-4948-af0f-32f644701041 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:26.042480 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0e809338-f9de-4948-af0f-32f644701041 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:26.043205 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0e809338-f9de-4948-af0f-32f644701041 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:26.043660 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0e809338-f9de-4948-af0f-32f644701041 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:26.044082 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0e809338-f9de-4948-af0f-32f644701041 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:26.069389 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:49:26.230452 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2032e4c2-021d-4b84-8dce-c91db2bc6ddb tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:26.231046 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2032e4c2-021d-4b84-8dce-c91db2bc6ddb tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:26.242337 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2032e4c2-021d-4b84-8dce-c91db2bc6ddb tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:26.246612 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2032e4c2-021d-4b84-8dce-c91db2bc6ddb tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:26.247092 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2032e4c2-021d-4b84-8dce-c91db2bc6ddb tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:26.248070 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2032e4c2-021d-4b84-8dce-c91db2bc6ddb tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:26.248555 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2032e4c2-021d-4b84-8dce-c91db2bc6ddb tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:26.250699 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2032e4c2-021d-4b84-8dce-c91db2bc6ddb tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:26.523483 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0e809338-f9de-4948-af0f-32f644701041 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:26.536902 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0e809338-f9de-4948-af0f-32f644701041 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435" status: 200 len: 1542 microversion: 2.1 time: 0.510230 Oct 17 13:49:26.538011 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1690/3402] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:26 2022] GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435 => generated 1542 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:49:26.613178 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2032e4c2-021d-4b84-8dce-c91db2bc6ddb tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:26.625349 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2032e4c2-021d-4b84-8dce-c91db2bc6ddb tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:26.627230 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2032e4c2-021d-4b84-8dce-c91db2bc6ddb tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:26.628922 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2032e4c2-021d-4b84-8dce-c91db2bc6ddb tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1879 microversion: 2.32 time: 0.404329 Oct 17 13:49:26.641129 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1713/3403] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:49:26 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1879 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:49:27.075877 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-79a2c2ac-bcf7-40f4-b8c0-6cd532d54e6c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:27.081070 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-79a2c2ac-bcf7-40f4-b8c0-6cd532d54e6c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 33de8199-8f00-40eb-9b95-b7ab5289dbe3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:27.104553 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-79a2c2ac-bcf7-40f4-b8c0-6cd532d54e6c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:27.107021 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-79a2c2ac-bcf7-40f4-b8c0-6cd532d54e6c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:27.109515 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-79a2c2ac-bcf7-40f4-b8c0-6cd532d54e6c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:27.110378 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-79a2c2ac-bcf7-40f4-b8c0-6cd532d54e6c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:27.111687 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-79a2c2ac-bcf7-40f4-b8c0-6cd532d54e6c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:27.114024 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-79a2c2ac-bcf7-40f4-b8c0-6cd532d54e6c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:27.380629 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-79a2c2ac-bcf7-40f4-b8c0-6cd532d54e6c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:27.397618 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-79a2c2ac-bcf7-40f4-b8c0-6cd532d54e6c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3" status: 200 len: 1517 microversion: 2.1 time: 0.334118 Oct 17 13:49:27.399101 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1691/3404] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:27 2022] GET /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3 => generated 1517 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:27.411617 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1ac23886-9946-4c9f-bd82-c08e97331983 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2077354957", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eb9b1c95-6d02-4d66-9e16-313080ea7e89"}], "security_groups": [{"name": "tempest-securitygroup--221460112"}], "key_name": "tempest-keypair-540064923", "user_data": "}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:49:27.566010 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0372130f-d0c3-4b67-a245-cbe18b59440e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:27.566783 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0372130f-d0c3-4b67-a245-cbe18b59440e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: e1fb1718-c504-47dc-ab2e-28fe15d2c435] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:27.576293 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0372130f-d0c3-4b67-a245-cbe18b59440e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:27.578079 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0372130f-d0c3-4b67-a245-cbe18b59440e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:27.578770 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0372130f-d0c3-4b67-a245-cbe18b59440e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:27.579953 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0372130f-d0c3-4b67-a245-cbe18b59440e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:27.580676 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0372130f-d0c3-4b67-a245-cbe18b59440e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:27.581599 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0372130f-d0c3-4b67-a245-cbe18b59440e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:27.605220 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-1ac23886-9946-4c9f-bd82-c08e97331983 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] validate_networks() for [('eb9b1c95-6d02-4d66-9e16-313080ea7e89', None, None, None, None, None)] {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:49:27.908806 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0372130f-d0c3-4b67-a245-cbe18b59440e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:27.936600 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0372130f-d0c3-4b67-a245-cbe18b59440e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435" status: 200 len: 1542 microversion: 2.1 time: 0.378270 Oct 17 13:49:27.937266 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1692/3405] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:27 2022] GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435 => generated 1542 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:49:27.952112 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-97f27a8a-af7c-4cf5-847e-6f3466bcb73e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:27.953160 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-97f27a8a-af7c-4cf5-847e-6f3466bcb73e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:27.965915 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-97f27a8a-af7c-4cf5-847e-6f3466bcb73e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:27.966583 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-97f27a8a-af7c-4cf5-847e-6f3466bcb73e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:27.967020 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-97f27a8a-af7c-4cf5-847e-6f3466bcb73e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:27.967760 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-97f27a8a-af7c-4cf5-847e-6f3466bcb73e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:27.968204 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-97f27a8a-af7c-4cf5-847e-6f3466bcb73e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:27.976300 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-97f27a8a-af7c-4cf5-847e-6f3466bcb73e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:28.460501 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-97f27a8a-af7c-4cf5-847e-6f3466bcb73e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:28.472779 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-97f27a8a-af7c-4cf5-847e-6f3466bcb73e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:28.480444 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-97f27a8a-af7c-4cf5-847e-6f3466bcb73e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:28.482419 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-97f27a8a-af7c-4cf5-847e-6f3466bcb73e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 2831 microversion: 2.32 time: 0.539953 Oct 17 13:49:28.483059 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-1ac23886-9946-4c9f-bd82-c08e97331983 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:49:28.483753 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-1ac23886-9946-4c9f-bd82-c08e97331983 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:49:28.484294 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-1ac23886-9946-4c9f-bd82-c08e97331983 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:49:28.484961 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-1ac23886-9946-4c9f-bd82-c08e97331983 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:49:28.485361 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-1ac23886-9946-4c9f-bd82-c08e97331983 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:49:28.487440 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1693/3406] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:49:27 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 2831 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:49:28.516604 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5c86f7d1-1f2b-4da5-92e7-945d8471961b tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:28.517143 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5c86f7d1-1f2b-4da5-92e7-945d8471961b tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:28.525295 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5c86f7d1-1f2b-4da5-92e7-945d8471961b tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:28.525773 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1ac23886-9946-4c9f-bd82-c08e97331983 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:28.525912 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5c86f7d1-1f2b-4da5-92e7-945d8471961b tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:28.526195 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5c86f7d1-1f2b-4da5-92e7-945d8471961b tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:28.526364 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1ac23886-9946-4c9f-bd82-c08e97331983 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:28.526716 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1ac23886-9946-4c9f-bd82-c08e97331983 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:28.527498 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1ac23886-9946-4c9f-bd82-c08e97331983 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:28.527899 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5c86f7d1-1f2b-4da5-92e7-945d8471961b tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:28.528117 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1ac23886-9946-4c9f-bd82-c08e97331983 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:28.528461 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1ac23886-9946-4c9f-bd82-c08e97331983 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:28.529030 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5c86f7d1-1f2b-4da5-92e7-945d8471961b tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:28.529660 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5c86f7d1-1f2b-4da5-92e7-945d8471961b tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:28.553143 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-1ac23886-9946-4c9f-bd82-c08e97331983 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Getting quotas for project 4acd31ce63b64ac3a05b76d4a9fdf7c0. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:49:28.559467 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-1ac23886-9946-4c9f-bd82-c08e97331983 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Getting quotas for user c7a7b9b048234fd2926739e3f08400b0 and project 4acd31ce63b64ac3a05b76d4a9fdf7c0. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:49:28.619451 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-1ac23886-9946-4c9f-bd82-c08e97331983 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:49:28.622286 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-1ac23886-9946-4c9f-bd82-c08e97331983 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 972070b6-59ae-472d-9dfb-75051a0d7701] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:49:28.694023 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1ac23886-9946-4c9f-bd82-c08e97331983 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.289696 Oct 17 13:49:28.704481 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1714/3407] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:49:27 2022] POST /compute/v2.1/servers => generated 401 bytes in 1300 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 13:49:28.711684 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ef7d211e-0438-4fcb-8339-10d97d71cca2 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:28.712587 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ef7d211e-0438-4fcb-8339-10d97d71cca2 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 972070b6-59ae-472d-9dfb-75051a0d7701] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:28.747873 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:49:28.764328 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5c86f7d1-1f2b-4da5-92e7-945d8471961b tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.252274 Oct 17 13:49:28.765263 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1694/3408] 10.222.0.79 () {60 vars in 1316 bytes} [Mon Oct 17 13:49:28 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2/os-interface => generated 1831 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:49:28.851488 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ef7d211e-0438-4fcb-8339-10d97d71cca2 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:28.867637 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ef7d211e-0438-4fcb-8339-10d97d71cca2 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/972070b6-59ae-472d-9dfb-75051a0d7701" status: 200 len: 1241 microversion: 2.1 time: 0.159855 Oct 17 13:49:28.869482 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1715/3409] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:28 2022] GET /compute/v2.1/servers/972070b6-59ae-472d-9dfb-75051a0d7701 => generated 1241 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:28.962549 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7b372401-6e5a-4574-aee7-401408a42ce1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:28.964588 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7b372401-6e5a-4574-aee7-401408a42ce1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: e1fb1718-c504-47dc-ab2e-28fe15d2c435] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:28.978141 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7b372401-6e5a-4574-aee7-401408a42ce1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:28.978646 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7b372401-6e5a-4574-aee7-401408a42ce1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:28.979080 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7b372401-6e5a-4574-aee7-401408a42ce1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:28.979824 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7b372401-6e5a-4574-aee7-401408a42ce1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:28.980283 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7b372401-6e5a-4574-aee7-401408a42ce1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:28.980707 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7b372401-6e5a-4574-aee7-401408a42ce1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:29.260162 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7b372401-6e5a-4574-aee7-401408a42ce1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:29.271212 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7b372401-6e5a-4574-aee7-401408a42ce1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435" status: 200 len: 1542 microversion: 2.1 time: 0.313178 Oct 17 13:49:29.271808 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1695/3410] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:28 2022] GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435 => generated 1542 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:29.895708 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9ce270d9-5729-48c0-963d-abd9b56ce983 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:29.897432 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9ce270d9-5729-48c0-963d-abd9b56ce983 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 972070b6-59ae-472d-9dfb-75051a0d7701] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:29.916694 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9ce270d9-5729-48c0-963d-abd9b56ce983 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:29.917629 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9ce270d9-5729-48c0-963d-abd9b56ce983 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:29.919762 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9ce270d9-5729-48c0-963d-abd9b56ce983 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:29.920751 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9ce270d9-5729-48c0-963d-abd9b56ce983 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:29.921784 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9ce270d9-5729-48c0-963d-abd9b56ce983 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:29.926524 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9ce270d9-5729-48c0-963d-abd9b56ce983 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:30.032617 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9ce270d9-5729-48c0-963d-abd9b56ce983 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:30.042664 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9ce270d9-5729-48c0-963d-abd9b56ce983 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/972070b6-59ae-472d-9dfb-75051a0d7701" status: 200 len: 1293 microversion: 2.1 time: 0.151924 Oct 17 13:49:30.047230 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1716/3411] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:29 2022] GET /compute/v2.1/servers/972070b6-59ae-472d-9dfb-75051a0d7701 => generated 1293 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:30.188867 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1c80f35a-58cd-4fc1-9458-18d2452936c5 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:49:30.191630 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1c80f35a-58cd-4fc1-9458-18d2452936c5 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 33de8199-8f00-40eb-9b95-b7ab5289dbe3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:30.207387 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c80f35a-58cd-4fc1-9458-18d2452936c5 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:30.207882 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c80f35a-58cd-4fc1-9458-18d2452936c5 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:30.208316 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c80f35a-58cd-4fc1-9458-18d2452936c5 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:30.209028 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c80f35a-58cd-4fc1-9458-18d2452936c5 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:30.209472 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c80f35a-58cd-4fc1-9458-18d2452936c5 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:30.209986 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c80f35a-58cd-4fc1-9458-18d2452936c5 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:30.244540 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-1c80f35a-58cd-4fc1-9458-18d2452936c5 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lazy-loading 'flavor' on Instance uuid 33de8199-8f00-40eb-9b95-b7ab5289dbe3 {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:49:30.297114 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-40fe8faf-2493-47d4-b79f-ee726d81b74c tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:30.297725 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-40fe8faf-2493-47d4-b79f-ee726d81b74c tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: e1fb1718-c504-47dc-ab2e-28fe15d2c435] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:30.308176 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-40fe8faf-2493-47d4-b79f-ee726d81b74c tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:30.308658 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-40fe8faf-2493-47d4-b79f-ee726d81b74c tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:30.309093 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-40fe8faf-2493-47d4-b79f-ee726d81b74c tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:30.309802 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-40fe8faf-2493-47d4-b79f-ee726d81b74c tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:30.310253 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-40fe8faf-2493-47d4-b79f-ee726d81b74c tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:30.310665 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-40fe8faf-2493-47d4-b79f-ee726d81b74c tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:30.388496 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1c80f35a-58cd-4fc1-9458-18d2452936c5 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "POST /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3/action" status: 200 len: 32 microversion: 2.1 time: 0.203473 Oct 17 13:49:30.391733 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1696/3412] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:49:30 2022] POST /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3/action => generated 32 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:49:30.416488 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-81e5f44e-4d7d-4649-9111-f9d0dbf4929a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:30.418356 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-81e5f44e-4d7d-4649-9111-f9d0dbf4929a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 33de8199-8f00-40eb-9b95-b7ab5289dbe3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:30.436898 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-81e5f44e-4d7d-4649-9111-f9d0dbf4929a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:30.438134 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-81e5f44e-4d7d-4649-9111-f9d0dbf4929a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:30.438815 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-81e5f44e-4d7d-4649-9111-f9d0dbf4929a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:30.439813 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-81e5f44e-4d7d-4649-9111-f9d0dbf4929a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:30.443431 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-81e5f44e-4d7d-4649-9111-f9d0dbf4929a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:30.444863 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-81e5f44e-4d7d-4649-9111-f9d0dbf4929a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:30.915266 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-40fe8faf-2493-47d4-b79f-ee726d81b74c tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:30.971333 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-81e5f44e-4d7d-4649-9111-f9d0dbf4929a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:30.975009 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-40fe8faf-2493-47d4-b79f-ee726d81b74c tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435" status: 200 len: 1542 microversion: 2.1 time: 0.682174 Oct 17 13:49:30.978548 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1717/3413] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:30 2022] GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435 => generated 1542 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:49:30.981862 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-81e5f44e-4d7d-4649-9111-f9d0dbf4929a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3" status: 200 len: 1523 microversion: 2.1 time: 0.574659 Oct 17 13:49:30.982450 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1697/3414] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:30 2022] GET /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3 => generated 1523 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:30.985567 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-26e6f22a-28c8-44da-93c0-f18ec372b27a req-268b492b-99eb-4965-a2cf-3002f5635173 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2", "tag": "09cd6d52-dd88-453b-97c9-b02b47bbb3bb"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:49:30.999192 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-26e6f22a-28c8-44da-93c0-f18ec372b27a req-268b492b-99eb-4965-a2cf-3002f5635173 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:30.999924 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-26e6f22a-28c8-44da-93c0-f18ec372b27a req-268b492b-99eb-4965-a2cf-3002f5635173 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:31.000451 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-26e6f22a-28c8-44da-93c0-f18ec372b27a req-268b492b-99eb-4965-a2cf-3002f5635173 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:31.017401 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-26e6f22a-28c8-44da-93c0-f18ec372b27a req-268b492b-99eb-4965-a2cf-3002f5635173 service nova] Creating event network-changed:09cd6d52-dd88-453b-97c9-b02b47bbb3bb for instance 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 on n-h1-854247-14 Oct 17 13:49:31.032676 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-26e6f22a-28c8-44da-93c0-f18ec372b27a req-268b492b-99eb-4965-a2cf-3002f5635173 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052263 Oct 17 13:49:31.035944 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1718/3415] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:49:31.072943 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3cbbc299-3da7-4553-a2e0-c133f5e7672f tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:31.073641 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3cbbc299-3da7-4553-a2e0-c133f5e7672f tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 972070b6-59ae-472d-9dfb-75051a0d7701] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:31.081599 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3cbbc299-3da7-4553-a2e0-c133f5e7672f tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:31.082214 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3cbbc299-3da7-4553-a2e0-c133f5e7672f tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:31.082726 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3cbbc299-3da7-4553-a2e0-c133f5e7672f tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:31.083564 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3cbbc299-3da7-4553-a2e0-c133f5e7672f tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:31.084316 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3cbbc299-3da7-4553-a2e0-c133f5e7672f tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:31.084822 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3cbbc299-3da7-4553-a2e0-c133f5e7672f tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:31.226613 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3cbbc299-3da7-4553-a2e0-c133f5e7672f tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:31.251291 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3cbbc299-3da7-4553-a2e0-c133f5e7672f tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/972070b6-59ae-472d-9dfb-75051a0d7701" status: 200 len: 1299 microversion: 2.1 time: 0.188597 Oct 17 13:49:31.275377 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1698/3416] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:31 2022] GET /compute/v2.1/servers/972070b6-59ae-472d-9dfb-75051a0d7701 => generated 1299 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:49:32.002587 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3c82e771-ea3b-4480-8655-5d3cd587c690 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:32.004134 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3c82e771-ea3b-4480-8655-5d3cd587c690 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: e1fb1718-c504-47dc-ab2e-28fe15d2c435] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:32.011996 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3c82e771-ea3b-4480-8655-5d3cd587c690 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:32.013059 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3c82e771-ea3b-4480-8655-5d3cd587c690 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:32.015695 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3c82e771-ea3b-4480-8655-5d3cd587c690 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:32.016843 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3c82e771-ea3b-4480-8655-5d3cd587c690 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:32.017626 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3c82e771-ea3b-4480-8655-5d3cd587c690 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:32.018291 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3c82e771-ea3b-4480-8655-5d3cd587c690 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:32.022686 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a9e92ce6-ed01-4250-aa8c-6df88ea2026b tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:32.023351 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a9e92ce6-ed01-4250-aa8c-6df88ea2026b tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 33de8199-8f00-40eb-9b95-b7ab5289dbe3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:32.037698 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a9e92ce6-ed01-4250-aa8c-6df88ea2026b tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:32.041951 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a9e92ce6-ed01-4250-aa8c-6df88ea2026b tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:32.043729 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a9e92ce6-ed01-4250-aa8c-6df88ea2026b tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:32.044536 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a9e92ce6-ed01-4250-aa8c-6df88ea2026b tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:32.047063 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a9e92ce6-ed01-4250-aa8c-6df88ea2026b tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:32.050018 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a9e92ce6-ed01-4250-aa8c-6df88ea2026b tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:32.680121 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3c82e771-ea3b-4480-8655-5d3cd587c690 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:32.690168 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3c82e771-ea3b-4480-8655-5d3cd587c690 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435" status: 200 len: 1542 microversion: 2.1 time: 0.691893 Oct 17 13:49:32.691382 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1719/3417] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:31 2022] GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435 => generated 1542 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:32.696752 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-77af0346-b40e-4e28-a333-eef9b48014cf tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:32.699378 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-77af0346-b40e-4e28-a333-eef9b48014cf tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 972070b6-59ae-472d-9dfb-75051a0d7701] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:32.710757 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-77af0346-b40e-4e28-a333-eef9b48014cf tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:32.711786 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-77af0346-b40e-4e28-a333-eef9b48014cf tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:32.712768 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-77af0346-b40e-4e28-a333-eef9b48014cf tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:32.714036 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-77af0346-b40e-4e28-a333-eef9b48014cf tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:32.714945 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-77af0346-b40e-4e28-a333-eef9b48014cf tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:32.715633 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-77af0346-b40e-4e28-a333-eef9b48014cf tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:32.761264 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a9e92ce6-ed01-4250-aa8c-6df88ea2026b tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:32.770372 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a9e92ce6-ed01-4250-aa8c-6df88ea2026b tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3" status: 200 len: 1523 microversion: 2.1 time: 0.753249 Oct 17 13:49:32.771136 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1699/3418] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:32 2022] GET /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3 => generated 1523 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:49:33.345802 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-77af0346-b40e-4e28-a333-eef9b48014cf tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:33.359350 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-77af0346-b40e-4e28-a333-eef9b48014cf tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/972070b6-59ae-472d-9dfb-75051a0d7701" status: 200 len: 1366 microversion: 2.1 time: 0.666597 Oct 17 13:49:33.360258 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1720/3419] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:32 2022] GET /compute/v2.1/servers/972070b6-59ae-472d-9dfb-75051a0d7701 => generated 1366 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:33.719539 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ba1d7492-2267-47fc-ac36-d915f54eec96 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:33.720420 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ba1d7492-2267-47fc-ac36-d915f54eec96 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: e1fb1718-c504-47dc-ab2e-28fe15d2c435] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:33.728281 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ba1d7492-2267-47fc-ac36-d915f54eec96 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:33.729332 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ba1d7492-2267-47fc-ac36-d915f54eec96 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:33.731404 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ba1d7492-2267-47fc-ac36-d915f54eec96 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:33.732503 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ba1d7492-2267-47fc-ac36-d915f54eec96 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:33.733464 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ba1d7492-2267-47fc-ac36-d915f54eec96 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:33.734060 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ba1d7492-2267-47fc-ac36-d915f54eec96 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:33.797206 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3d4c2e0d-fec4-4afe-9704-d116adffd96b tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:33.800391 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3d4c2e0d-fec4-4afe-9704-d116adffd96b tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 33de8199-8f00-40eb-9b95-b7ab5289dbe3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:33.813746 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3d4c2e0d-fec4-4afe-9704-d116adffd96b tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:33.814595 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3d4c2e0d-fec4-4afe-9704-d116adffd96b tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:33.816404 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3d4c2e0d-fec4-4afe-9704-d116adffd96b tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:33.817669 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3d4c2e0d-fec4-4afe-9704-d116adffd96b tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:33.819784 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3d4c2e0d-fec4-4afe-9704-d116adffd96b tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:33.823676 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3d4c2e0d-fec4-4afe-9704-d116adffd96b tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:34.695449 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ba1d7492-2267-47fc-ac36-d915f54eec96 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:34.703767 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ba1d7492-2267-47fc-ac36-d915f54eec96 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435" status: 200 len: 1541 microversion: 2.1 time: 0.990396 Oct 17 13:49:34.716004 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1700/3420] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:33 2022] GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435 => generated 1541 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:34.726608 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-68d0c852-b67f-40bb-84be-9393cf0c20cd tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:34.727633 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-68d0c852-b67f-40bb-84be-9393cf0c20cd tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 972070b6-59ae-472d-9dfb-75051a0d7701] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:34.733621 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=8 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:49:34.736417 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-68d0c852-b67f-40bb-84be-9393cf0c20cd tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:34.737220 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-68d0c852-b67f-40bb-84be-9393cf0c20cd tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:34.737985 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-68d0c852-b67f-40bb-84be-9393cf0c20cd tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:34.739013 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-68d0c852-b67f-40bb-84be-9393cf0c20cd tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:34.739729 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-68d0c852-b67f-40bb-84be-9393cf0c20cd tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:34.740270 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-68d0c852-b67f-40bb-84be-9393cf0c20cd tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:34.865288 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3d4c2e0d-fec4-4afe-9704-d116adffd96b tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:34.882244 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3d4c2e0d-fec4-4afe-9704-d116adffd96b tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3" status: 200 len: 1523 microversion: 2.1 time: 1.091981 Oct 17 13:49:34.886800 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1721/3421] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:33 2022] GET /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3 => generated 1523 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:49:35.119928 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-1b43b69b-4310-4747-b239-3397e6be8d1c req-b786538d-45c6-424a-bd2e-24a992ccc1b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1fb1718-c504-47dc-ab2e-28fe15d2c435", "name": "network-vif-unplugged", "status": "completed", "tag": "391b5d37-7616-4b7e-974a-cd5f28f3eb9a"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:49:35.136409 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-1b43b69b-4310-4747-b239-3397e6be8d1c req-b786538d-45c6-424a-bd2e-24a992ccc1b5 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:35.137123 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-1b43b69b-4310-4747-b239-3397e6be8d1c req-b786538d-45c6-424a-bd2e-24a992ccc1b5 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:35.138520 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-1b43b69b-4310-4747-b239-3397e6be8d1c req-b786538d-45c6-424a-bd2e-24a992ccc1b5 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:35.154065 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-1b43b69b-4310-4747-b239-3397e6be8d1c req-b786538d-45c6-424a-bd2e-24a992ccc1b5 service nova] Creating event network-vif-unplugged:391b5d37-7616-4b7e-974a-cd5f28f3eb9a for instance e1fb1718-c504-47dc-ab2e-28fe15d2c435 on n-h2-854247-14 Oct 17 13:49:35.162629 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [req-1b43b69b-4310-4747-b239-3397e6be8d1c req-b786538d-45c6-424a-bd2e-24a992ccc1b5 service nova] Instance e1fb1718-c504-47dc-ab2e-28fe15d2c435 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854247-14', 'n-h2-854247-14'} {{(pid=127016) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:49:35.177079 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-1b43b69b-4310-4747-b239-3397e6be8d1c req-b786538d-45c6-424a-bd2e-24a992ccc1b5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061829 Oct 17 13:49:35.177986 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1722/3422] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:49:35.343931 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-68d0c852-b67f-40bb-84be-9393cf0c20cd tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:35.412594 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-68d0c852-b67f-40bb-84be-9393cf0c20cd tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/972070b6-59ae-472d-9dfb-75051a0d7701" status: 200 len: 1366 microversion: 2.1 time: 0.645453 Oct 17 13:49:35.412594 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1701/3423] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:34 2022] GET /compute/v2.1/servers/972070b6-59ae-472d-9dfb-75051a0d7701 => generated 1366 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:35.733819 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-bdcd81a4-e3e5-47de-aee7-e7aaab07bb68 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:35.734540 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-bdcd81a4-e3e5-47de-aee7-e7aaab07bb68 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: e1fb1718-c504-47dc-ab2e-28fe15d2c435] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:35.745977 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bdcd81a4-e3e5-47de-aee7-e7aaab07bb68 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:35.746470 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bdcd81a4-e3e5-47de-aee7-e7aaab07bb68 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:35.746912 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bdcd81a4-e3e5-47de-aee7-e7aaab07bb68 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:35.749459 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bdcd81a4-e3e5-47de-aee7-e7aaab07bb68 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:35.751409 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bdcd81a4-e3e5-47de-aee7-e7aaab07bb68 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:35.752524 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bdcd81a4-e3e5-47de-aee7-e7aaab07bb68 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:35.910357 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0fe79ed5-abab-44cd-9508-3ef8162d018c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:35.913334 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0fe79ed5-abab-44cd-9508-3ef8162d018c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 33de8199-8f00-40eb-9b95-b7ab5289dbe3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:35.925661 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0fe79ed5-abab-44cd-9508-3ef8162d018c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:35.926787 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0fe79ed5-abab-44cd-9508-3ef8162d018c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:35.928336 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0fe79ed5-abab-44cd-9508-3ef8162d018c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:35.930192 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0fe79ed5-abab-44cd-9508-3ef8162d018c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:35.931112 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0fe79ed5-abab-44cd-9508-3ef8162d018c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:35.932743 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0fe79ed5-abab-44cd-9508-3ef8162d018c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:36.226020 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-bdcd81a4-e3e5-47de-aee7-e7aaab07bb68 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:36.241463 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-bdcd81a4-e3e5-47de-aee7-e7aaab07bb68 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435" status: 200 len: 1541 microversion: 2.1 time: 0.512573 Oct 17 13:49:36.244025 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1723/3424] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:35 2022] GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435 => generated 1541 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:36.387135 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-06979213-c0b4-4638-95a1-10b0ac8603d0 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:36.387974 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-06979213-c0b4-4638-95a1-10b0ac8603d0 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 972070b6-59ae-472d-9dfb-75051a0d7701] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:36.396214 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-06979213-c0b4-4638-95a1-10b0ac8603d0 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:36.396703 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-06979213-c0b4-4638-95a1-10b0ac8603d0 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:36.397136 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-06979213-c0b4-4638-95a1-10b0ac8603d0 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:36.398276 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-06979213-c0b4-4638-95a1-10b0ac8603d0 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:36.398841 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-06979213-c0b4-4638-95a1-10b0ac8603d0 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:36.399232 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-06979213-c0b4-4638-95a1-10b0ac8603d0 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:36.501052 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0fe79ed5-abab-44cd-9508-3ef8162d018c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:36.535038 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0fe79ed5-abab-44cd-9508-3ef8162d018c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3" status: 200 len: 1523 microversion: 2.1 time: 0.625869 Oct 17 13:49:36.537414 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1702/3425] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:35 2022] GET /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3 => generated 1523 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:36.800673 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-06979213-c0b4-4638-95a1-10b0ac8603d0 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:36.814396 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-06979213-c0b4-4638-95a1-10b0ac8603d0 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/972070b6-59ae-472d-9dfb-75051a0d7701" status: 200 len: 1366 microversion: 2.1 time: 0.431242 Oct 17 13:49:36.815507 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1724/3426] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:36 2022] GET /compute/v2.1/servers/972070b6-59ae-472d-9dfb-75051a0d7701 => generated 1366 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:49:37.226713 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-9b8563c2-680a-4c1e-9bed-725107848a78 req-f37a142d-2027-4201-b542-a059e816a8fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "972070b6-59ae-472d-9dfb-75051a0d7701", "tag": "57ff033e-f817-435b-943f-900adf5c7342"}, {"name": "network-changed", "server_uuid": "e1fb1718-c504-47dc-ab2e-28fe15d2c435", "tag": "391b5d37-7616-4b7e-974a-cd5f28f3eb9a"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:49:37.245911 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-9b8563c2-680a-4c1e-9bed-725107848a78 req-f37a142d-2027-4201-b542-a059e816a8fd service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:37.246796 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-9b8563c2-680a-4c1e-9bed-725107848a78 req-f37a142d-2027-4201-b542-a059e816a8fd service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:37.247488 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-9b8563c2-680a-4c1e-9bed-725107848a78 req-f37a142d-2027-4201-b542-a059e816a8fd service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:37.265600 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-9b8563c2-680a-4c1e-9bed-725107848a78 req-f37a142d-2027-4201-b542-a059e816a8fd service nova] Creating event network-changed:57ff033e-f817-435b-943f-900adf5c7342 for instance 972070b6-59ae-472d-9dfb-75051a0d7701 on n-h2-854247-14 Oct 17 13:49:37.266546 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-9b8563c2-680a-4c1e-9bed-725107848a78 req-f37a142d-2027-4201-b542-a059e816a8fd service nova] Creating event network-changed:391b5d37-7616-4b7e-974a-cd5f28f3eb9a for instance e1fb1718-c504-47dc-ab2e-28fe15d2c435 on n-h2-854247-14 Oct 17 13:49:37.271114 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d048b5c3-c388-4cfc-8a92-0cd9edad9a9f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:37.271855 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d048b5c3-c388-4cfc-8a92-0cd9edad9a9f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: e1fb1718-c504-47dc-ab2e-28fe15d2c435] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:37.273989 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [req-9b8563c2-680a-4c1e-9bed-725107848a78 req-f37a142d-2027-4201-b542-a059e816a8fd service nova] Instance e1fb1718-c504-47dc-ab2e-28fe15d2c435 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854247-14', 'n-h2-854247-14'} {{(pid=127017) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:49:37.284269 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d048b5c3-c388-4cfc-8a92-0cd9edad9a9f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:37.284998 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d048b5c3-c388-4cfc-8a92-0cd9edad9a9f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:37.285320 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d048b5c3-c388-4cfc-8a92-0cd9edad9a9f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:37.288280 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-9b8563c2-680a-4c1e-9bed-725107848a78 req-f37a142d-2027-4201-b542-a059e816a8fd service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.066696 Oct 17 13:49:37.289518 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1703/3427] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:49:37 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:49:37.290003 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d048b5c3-c388-4cfc-8a92-0cd9edad9a9f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:37.290482 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d048b5c3-c388-4cfc-8a92-0cd9edad9a9f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:37.290919 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d048b5c3-c388-4cfc-8a92-0cd9edad9a9f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:37.567688 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-dac3eba8-e216-4a7f-88e5-1f984b262712 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:37.568590 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-dac3eba8-e216-4a7f-88e5-1f984b262712 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 33de8199-8f00-40eb-9b95-b7ab5289dbe3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:37.578233 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dac3eba8-e216-4a7f-88e5-1f984b262712 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:37.579080 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dac3eba8-e216-4a7f-88e5-1f984b262712 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:37.579865 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dac3eba8-e216-4a7f-88e5-1f984b262712 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:37.580880 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dac3eba8-e216-4a7f-88e5-1f984b262712 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:37.582000 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dac3eba8-e216-4a7f-88e5-1f984b262712 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:37.582850 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dac3eba8-e216-4a7f-88e5-1f984b262712 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:37.602672 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d048b5c3-c388-4cfc-8a92-0cd9edad9a9f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:37.617780 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d048b5c3-c388-4cfc-8a92-0cd9edad9a9f tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435" status: 200 len: 1541 microversion: 2.1 time: 0.351063 Oct 17 13:49:37.626742 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1725/3428] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:37 2022] GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435 => generated 1541 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:49:37.842032 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-93739494-e156-4ad8-9c65-6462d0b9d9cf tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:37.842794 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-93739494-e156-4ad8-9c65-6462d0b9d9cf tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 972070b6-59ae-472d-9dfb-75051a0d7701] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:37.849856 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-93739494-e156-4ad8-9c65-6462d0b9d9cf tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:37.852416 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-93739494-e156-4ad8-9c65-6462d0b9d9cf tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:37.853163 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-93739494-e156-4ad8-9c65-6462d0b9d9cf tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:37.854914 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-93739494-e156-4ad8-9c65-6462d0b9d9cf tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:37.857696 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-93739494-e156-4ad8-9c65-6462d0b9d9cf tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:37.858151 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-93739494-e156-4ad8-9c65-6462d0b9d9cf tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:37.866981 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-dac3eba8-e216-4a7f-88e5-1f984b262712 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:37.874989 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-dac3eba8-e216-4a7f-88e5-1f984b262712 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3" status: 200 len: 1523 microversion: 2.1 time: 0.312803 Oct 17 13:49:37.875604 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1704/3429] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:37 2022] GET /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3 => generated 1523 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:49:38.076263 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-93739494-e156-4ad8-9c65-6462d0b9d9cf tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:38.109972 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-93739494-e156-4ad8-9c65-6462d0b9d9cf tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/972070b6-59ae-472d-9dfb-75051a0d7701" status: 200 len: 1366 microversion: 2.1 time: 0.271391 Oct 17 13:49:38.110512 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1726/3430] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:37 2022] GET /compute/v2.1/servers/972070b6-59ae-472d-9dfb-75051a0d7701 => generated 1366 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:38.644668 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3b2516b3-4317-43ea-8d4a-42ed81e44a29 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:38.645959 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3b2516b3-4317-43ea-8d4a-42ed81e44a29 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: e1fb1718-c504-47dc-ab2e-28fe15d2c435] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:38.656602 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3b2516b3-4317-43ea-8d4a-42ed81e44a29 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:38.659511 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3b2516b3-4317-43ea-8d4a-42ed81e44a29 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:38.663418 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3b2516b3-4317-43ea-8d4a-42ed81e44a29 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:38.664959 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3b2516b3-4317-43ea-8d4a-42ed81e44a29 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:38.665593 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3b2516b3-4317-43ea-8d4a-42ed81e44a29 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:38.666194 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3b2516b3-4317-43ea-8d4a-42ed81e44a29 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:38.830073 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3b2516b3-4317-43ea-8d4a-42ed81e44a29 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:38.834996 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:49:38.840984 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3b2516b3-4317-43ea-8d4a-42ed81e44a29 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435" status: 200 len: 1473 microversion: 2.1 time: 0.200494 Oct 17 13:49:38.849437 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1705/3431] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:38 2022] GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435 => generated 1473 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:38.900933 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c1039e94-81d5-481b-a4db-0fd10bcdb164 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:38.901716 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c1039e94-81d5-481b-a4db-0fd10bcdb164 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 33de8199-8f00-40eb-9b95-b7ab5289dbe3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:38.906624 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:49:38.907419 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=8 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:49:38.915785 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1039e94-81d5-481b-a4db-0fd10bcdb164 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:38.916601 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1039e94-81d5-481b-a4db-0fd10bcdb164 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:38.917103 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1039e94-81d5-481b-a4db-0fd10bcdb164 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:38.918132 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1039e94-81d5-481b-a4db-0fd10bcdb164 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:38.918835 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1039e94-81d5-481b-a4db-0fd10bcdb164 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:38.919449 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1039e94-81d5-481b-a4db-0fd10bcdb164 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:39.061648 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2c515546-09b6-4170-bba6-85c7196c3e8b tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:39.062552 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2c515546-09b6-4170-bba6-85c7196c3e8b tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] [instance: 531b762d-db7e-4911-af50-6b321b7706bf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:39.071547 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2c515546-09b6-4170-bba6-85c7196c3e8b tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:39.072269 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2c515546-09b6-4170-bba6-85c7196c3e8b tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:39.073241 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2c515546-09b6-4170-bba6-85c7196c3e8b tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:39.073975 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2c515546-09b6-4170-bba6-85c7196c3e8b tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:39.075830 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2c515546-09b6-4170-bba6-85c7196c3e8b tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:39.076471 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2c515546-09b6-4170-bba6-85c7196c3e8b tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:39.118083 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c1039e94-81d5-481b-a4db-0fd10bcdb164 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:39.130096 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c1039e94-81d5-481b-a4db-0fd10bcdb164 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3" status: 200 len: 1523 microversion: 2.1 time: 0.233382 Oct 17 13:49:39.131067 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1727/3432] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:38 2022] GET /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3 => generated 1523 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:39.137808 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1f1db34b-fe2f-44f5-8cbe-39ee737197a7 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:39.138809 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-1f1db34b-fe2f-44f5-8cbe-39ee737197a7 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 972070b6-59ae-472d-9dfb-75051a0d7701] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:39.146511 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1f1db34b-fe2f-44f5-8cbe-39ee737197a7 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:39.147217 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1f1db34b-fe2f-44f5-8cbe-39ee737197a7 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:39.147825 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1f1db34b-fe2f-44f5-8cbe-39ee737197a7 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:39.148759 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1f1db34b-fe2f-44f5-8cbe-39ee737197a7 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:39.149427 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1f1db34b-fe2f-44f5-8cbe-39ee737197a7 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:39.149867 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1f1db34b-fe2f-44f5-8cbe-39ee737197a7 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:39.781325 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2c515546-09b6-4170-bba6-85c7196c3e8b tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:39.785145 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-1f1db34b-fe2f-44f5-8cbe-39ee737197a7 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:39.795504 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2c515546-09b6-4170-bba6-85c7196c3e8b tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:39.797547 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1f1db34b-fe2f-44f5-8cbe-39ee737197a7 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/972070b6-59ae-472d-9dfb-75051a0d7701" status: 200 len: 1366 microversion: 2.1 time: 0.664889 Oct 17 13:49:39.798050 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2c515546-09b6-4170-bba6-85c7196c3e8b tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:39.798581 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1728/3433] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:39 2022] GET /compute/v2.1/servers/972070b6-59ae-472d-9dfb-75051a0d7701 => generated 1366 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:39.812811 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2c515546-09b6-4170-bba6-85c7196c3e8b tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] 10.222.0.79 "GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf" status: 200 len: 2957 microversion: 2.42 time: 0.756138 Oct 17 13:49:39.813410 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1706/3434] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:49:39 2022] GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf => generated 2957 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:49:39.840307 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a8ca7497-1e00-468c-aa53-c9567eca6377 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:39.840849 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a8ca7497-1e00-468c-aa53-c9567eca6377 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] [instance: 531b762d-db7e-4911-af50-6b321b7706bf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:39.849066 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a8ca7497-1e00-468c-aa53-c9567eca6377 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:39.849833 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a8ca7497-1e00-468c-aa53-c9567eca6377 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:39.850600 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a8ca7497-1e00-468c-aa53-c9567eca6377 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:39.851730 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a8ca7497-1e00-468c-aa53-c9567eca6377 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:39.852290 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a8ca7497-1e00-468c-aa53-c9567eca6377 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:39.852796 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a8ca7497-1e00-468c-aa53-c9567eca6377 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:39.866892 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ac34a842-c919-498a-8b54-44236ce4aa41 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:39.867811 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ac34a842-c919-498a-8b54-44236ce4aa41 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: e1fb1718-c504-47dc-ab2e-28fe15d2c435] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:39.872105 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=100 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:49:39.875882 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac34a842-c919-498a-8b54-44236ce4aa41 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:39.876350 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac34a842-c919-498a-8b54-44236ce4aa41 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:39.876992 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac34a842-c919-498a-8b54-44236ce4aa41 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:39.878663 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac34a842-c919-498a-8b54-44236ce4aa41 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:39.879327 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac34a842-c919-498a-8b54-44236ce4aa41 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:39.879996 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac34a842-c919-498a-8b54-44236ce4aa41 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:40.016188 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a8ca7497-1e00-468c-aa53-c9567eca6377 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] 10.222.0.79 "GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.179641 Oct 17 13:49:40.017982 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1729/3435] 10.222.0.79 () {60 vars in 1316 bytes} [Mon Oct 17 13:49:39 2022] GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf/os-interface => generated 1832 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:49:40.157193 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0084f552-79ab-4219-8606-678a32d907d4 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:40.173160 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0084f552-79ab-4219-8606-678a32d907d4 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 33de8199-8f00-40eb-9b95-b7ab5289dbe3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:40.180319 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0084f552-79ab-4219-8606-678a32d907d4 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:40.180810 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0084f552-79ab-4219-8606-678a32d907d4 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:40.181236 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0084f552-79ab-4219-8606-678a32d907d4 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:40.181934 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0084f552-79ab-4219-8606-678a32d907d4 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:40.186435 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ac34a842-c919-498a-8b54-44236ce4aa41 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:40.196766 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ac34a842-c919-498a-8b54-44236ce4aa41 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435" status: 200 len: 1473 microversion: 2.1 time: 0.333946 Oct 17 13:49:40.207741 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1707/3436] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:39 2022] GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435 => generated 1473 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:49:40.208220 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0084f552-79ab-4219-8606-678a32d907d4 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:40.208220 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0084f552-79ab-4219-8606-678a32d907d4 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:40.443329 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0084f552-79ab-4219-8606-678a32d907d4 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:40.452712 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0084f552-79ab-4219-8606-678a32d907d4 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3" status: 200 len: 1523 microversion: 2.1 time: 0.300584 Oct 17 13:49:40.460518 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1730/3437] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:40 2022] GET /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3 => generated 1523 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:40.828151 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-00b63e5a-0466-4578-b475-8f8d4f3bb5eb tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:40.829879 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-00b63e5a-0466-4578-b475-8f8d4f3bb5eb tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 972070b6-59ae-472d-9dfb-75051a0d7701] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:40.841713 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-00b63e5a-0466-4578-b475-8f8d4f3bb5eb tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:40.842570 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-00b63e5a-0466-4578-b475-8f8d4f3bb5eb tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:40.843353 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-00b63e5a-0466-4578-b475-8f8d4f3bb5eb tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:40.844873 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-00b63e5a-0466-4578-b475-8f8d4f3bb5eb tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:40.845650 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-00b63e5a-0466-4578-b475-8f8d4f3bb5eb tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:40.846322 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-00b63e5a-0466-4578-b475-8f8d4f3bb5eb tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:41.052476 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-00b63e5a-0466-4578-b475-8f8d4f3bb5eb tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:41.063143 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-00b63e5a-0466-4578-b475-8f8d4f3bb5eb tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/972070b6-59ae-472d-9dfb-75051a0d7701" status: 200 len: 1366 microversion: 2.1 time: 0.242107 Oct 17 13:49:41.065141 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1708/3438] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:40 2022] GET /compute/v2.1/servers/972070b6-59ae-472d-9dfb-75051a0d7701 => generated 1366 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:41.225430 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6f5872ad-7b16-4fd6-b99b-4f1a967c572b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:41.226577 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6f5872ad-7b16-4fd6-b99b-4f1a967c572b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: e1fb1718-c504-47dc-ab2e-28fe15d2c435] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:41.235966 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6f5872ad-7b16-4fd6-b99b-4f1a967c572b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:41.236581 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6f5872ad-7b16-4fd6-b99b-4f1a967c572b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:41.237433 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6f5872ad-7b16-4fd6-b99b-4f1a967c572b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:41.238366 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6f5872ad-7b16-4fd6-b99b-4f1a967c572b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:41.238985 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6f5872ad-7b16-4fd6-b99b-4f1a967c572b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:41.239598 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6f5872ad-7b16-4fd6-b99b-4f1a967c572b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:41.476110 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c9cf5ab7-5433-4212-b706-6c5f8e0238d1 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:41.477019 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c9cf5ab7-5433-4212-b706-6c5f8e0238d1 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 33de8199-8f00-40eb-9b95-b7ab5289dbe3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:41.492064 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c9cf5ab7-5433-4212-b706-6c5f8e0238d1 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:41.492569 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c9cf5ab7-5433-4212-b706-6c5f8e0238d1 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:41.493009 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c9cf5ab7-5433-4212-b706-6c5f8e0238d1 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:41.493922 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c9cf5ab7-5433-4212-b706-6c5f8e0238d1 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:41.494532 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c9cf5ab7-5433-4212-b706-6c5f8e0238d1 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:41.495122 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c9cf5ab7-5433-4212-b706-6c5f8e0238d1 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:41.601217 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6f5872ad-7b16-4fd6-b99b-4f1a967c572b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:41.613585 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6f5872ad-7b16-4fd6-b99b-4f1a967c572b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435" status: 200 len: 1470 microversion: 2.1 time: 0.394647 Oct 17 13:49:41.626352 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1731/3439] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:41 2022] GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435 => generated 1470 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:41.649295 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-034e6a9e-e8e1-4254-958a-71adb42c61aa tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:49:41.650332 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-034e6a9e-e8e1-4254-958a-71adb42c61aa tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: e1fb1718-c504-47dc-ab2e-28fe15d2c435] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:41.658122 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-034e6a9e-e8e1-4254-958a-71adb42c61aa tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:41.658972 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-034e6a9e-e8e1-4254-958a-71adb42c61aa tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:41.660164 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-034e6a9e-e8e1-4254-958a-71adb42c61aa tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:41.661266 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-034e6a9e-e8e1-4254-958a-71adb42c61aa tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:41.661988 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-034e6a9e-e8e1-4254-958a-71adb42c61aa tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:41.662621 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-034e6a9e-e8e1-4254-958a-71adb42c61aa tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:41.725636 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-034e6a9e-e8e1-4254-958a-71adb42c61aa tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:41.726531 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-034e6a9e-e8e1-4254-958a-71adb42c61aa tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:41.727348 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-034e6a9e-e8e1-4254-958a-71adb42c61aa tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:41.730265 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-034e6a9e-e8e1-4254-958a-71adb42c61aa tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:41.731662 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-034e6a9e-e8e1-4254-958a-71adb42c61aa tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:41.732488 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-034e6a9e-e8e1-4254-958a-71adb42c61aa tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:41.801904 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-034e6a9e-e8e1-4254-958a-71adb42c61aa tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Getting quotas for project 5b98e3f377c14838a31cc430c98855e1. Resources: {'ram', 'cores'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:49:41.812695 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-034e6a9e-e8e1-4254-958a-71adb42c61aa tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Getting quotas for user 0906fe70cb054729bfb95b2196c1a5d3 and project 5b98e3f377c14838a31cc430c98855e1. Resources: {'ram', 'cores'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:49:41.884105 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c9cf5ab7-5433-4212-b706-6c5f8e0238d1 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:41.892324 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c9cf5ab7-5433-4212-b706-6c5f8e0238d1 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3" status: 200 len: 1523 microversion: 2.1 time: 0.420068 Oct 17 13:49:41.907891 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1709/3440] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:41 2022] GET /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3 => generated 1523 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:49:42.012737 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-034e6a9e-e8e1-4254-958a-71adb42c61aa tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "POST /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435/action" status: 202 len: 0 microversion: 2.1 time: 0.377180 Oct 17 13:49:42.014179 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1732/3441] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:49:41 2022] POST /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435/action => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:49:42.022615 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-cec04f9f-5472-418b-9805-c7ef56511143 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:42.023394 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-cec04f9f-5472-418b-9805-c7ef56511143 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: e1fb1718-c504-47dc-ab2e-28fe15d2c435] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:42.034384 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cec04f9f-5472-418b-9805-c7ef56511143 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:42.035116 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cec04f9f-5472-418b-9805-c7ef56511143 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:42.037119 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cec04f9f-5472-418b-9805-c7ef56511143 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:42.039738 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cec04f9f-5472-418b-9805-c7ef56511143 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:42.040393 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cec04f9f-5472-418b-9805-c7ef56511143 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:42.040637 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cec04f9f-5472-418b-9805-c7ef56511143 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:42.092105 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5badd1fe-204d-47da-9c0f-3a2752e3b7a5 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:42.092809 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5badd1fe-204d-47da-9c0f-3a2752e3b7a5 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 972070b6-59ae-472d-9dfb-75051a0d7701] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:42.109706 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5badd1fe-204d-47da-9c0f-3a2752e3b7a5 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:42.110438 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5badd1fe-204d-47da-9c0f-3a2752e3b7a5 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:42.110893 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5badd1fe-204d-47da-9c0f-3a2752e3b7a5 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:42.115616 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5badd1fe-204d-47da-9c0f-3a2752e3b7a5 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:42.116105 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5badd1fe-204d-47da-9c0f-3a2752e3b7a5 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:42.116551 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5badd1fe-204d-47da-9c0f-3a2752e3b7a5 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:42.472378 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5badd1fe-204d-47da-9c0f-3a2752e3b7a5 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:42.482060 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5badd1fe-204d-47da-9c0f-3a2752e3b7a5 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/972070b6-59ae-472d-9dfb-75051a0d7701" status: 200 len: 1366 microversion: 2.1 time: 0.395668 Oct 17 13:49:42.493505 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1733/3442] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:42 2022] GET /compute/v2.1/servers/972070b6-59ae-472d-9dfb-75051a0d7701 => generated 1366 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:42.548097 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-cec04f9f-5472-418b-9805-c7ef56511143 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:42.556720 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-cec04f9f-5472-418b-9805-c7ef56511143 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435" status: 200 len: 1469 microversion: 2.1 time: 0.538567 Oct 17 13:49:42.557587 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1710/3443] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:42 2022] GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435 => generated 1469 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:42.720664 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-67c8f089-8591-4910-96a3-213ede243229 req-a61dd568-9581-4f57-8e94-43d47a21b29a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "972070b6-59ae-472d-9dfb-75051a0d7701", "name": "network-vif-plugged", "status": "completed", "tag": "57ff033e-f817-435b-943f-900adf5c7342"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:49:42.736754 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-67c8f089-8591-4910-96a3-213ede243229 req-a61dd568-9581-4f57-8e94-43d47a21b29a service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:42.737978 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-67c8f089-8591-4910-96a3-213ede243229 req-a61dd568-9581-4f57-8e94-43d47a21b29a service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:42.739008 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-67c8f089-8591-4910-96a3-213ede243229 req-a61dd568-9581-4f57-8e94-43d47a21b29a service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:42.757976 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-67c8f089-8591-4910-96a3-213ede243229 req-a61dd568-9581-4f57-8e94-43d47a21b29a service nova] Creating event network-vif-plugged:57ff033e-f817-435b-943f-900adf5c7342 for instance 972070b6-59ae-472d-9dfb-75051a0d7701 on n-h2-854247-14 Oct 17 13:49:42.765207 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-67c8f089-8591-4910-96a3-213ede243229 req-a61dd568-9581-4f57-8e94-43d47a21b29a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052565 Oct 17 13:49:42.766564 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1734/3444] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:49:42.917628 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a2113958-c717-4663-83c5-4bd41bdb4509 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:42.918362 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a2113958-c717-4663-83c5-4bd41bdb4509 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 33de8199-8f00-40eb-9b95-b7ab5289dbe3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:42.932680 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:49:42.935668 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a2113958-c717-4663-83c5-4bd41bdb4509 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:42.936249 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a2113958-c717-4663-83c5-4bd41bdb4509 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:42.936873 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a2113958-c717-4663-83c5-4bd41bdb4509 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:42.938839 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a2113958-c717-4663-83c5-4bd41bdb4509 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:42.939983 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a2113958-c717-4663-83c5-4bd41bdb4509 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:42.941430 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a2113958-c717-4663-83c5-4bd41bdb4509 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:43.249087 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a2113958-c717-4663-83c5-4bd41bdb4509 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:43.258810 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a2113958-c717-4663-83c5-4bd41bdb4509 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3" status: 200 len: 1523 microversion: 2.1 time: 0.345917 Oct 17 13:49:43.260571 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1711/3445] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:42 2022] GET /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3 => generated 1523 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:43.509351 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ba8861f1-dc76-485f-b9ba-4b696209b5cd tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:43.510987 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ba8861f1-dc76-485f-b9ba-4b696209b5cd tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 972070b6-59ae-472d-9dfb-75051a0d7701] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:43.524105 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ba8861f1-dc76-485f-b9ba-4b696209b5cd tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:43.524751 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ba8861f1-dc76-485f-b9ba-4b696209b5cd tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:43.525260 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ba8861f1-dc76-485f-b9ba-4b696209b5cd tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:43.526178 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ba8861f1-dc76-485f-b9ba-4b696209b5cd tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:43.528735 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ba8861f1-dc76-485f-b9ba-4b696209b5cd tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:43.529319 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ba8861f1-dc76-485f-b9ba-4b696209b5cd tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:43.588940 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5abcb2a0-dd8d-4cf7-9026-5d95025da66b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:43.589949 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5abcb2a0-dd8d-4cf7-9026-5d95025da66b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: e1fb1718-c504-47dc-ab2e-28fe15d2c435] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:43.596635 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5abcb2a0-dd8d-4cf7-9026-5d95025da66b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:43.597519 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5abcb2a0-dd8d-4cf7-9026-5d95025da66b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:43.598181 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5abcb2a0-dd8d-4cf7-9026-5d95025da66b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:43.599129 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5abcb2a0-dd8d-4cf7-9026-5d95025da66b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:43.599878 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5abcb2a0-dd8d-4cf7-9026-5d95025da66b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:43.600526 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5abcb2a0-dd8d-4cf7-9026-5d95025da66b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:43.770166 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ba8861f1-dc76-485f-b9ba-4b696209b5cd tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:43.784253 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ba8861f1-dc76-485f-b9ba-4b696209b5cd tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/972070b6-59ae-472d-9dfb-75051a0d7701" status: 200 len: 1366 microversion: 2.1 time: 0.281415 Oct 17 13:49:43.786470 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1735/3446] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:43 2022] GET /compute/v2.1/servers/972070b6-59ae-472d-9dfb-75051a0d7701 => generated 1366 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:43.794526 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5abcb2a0-dd8d-4cf7-9026-5d95025da66b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:43.805816 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5abcb2a0-dd8d-4cf7-9026-5d95025da66b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435" status: 200 len: 1469 microversion: 2.1 time: 0.220624 Oct 17 13:49:43.807639 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1712/3447] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:43 2022] GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435 => generated 1469 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:49:44.284705 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c5960068-b39a-4ddd-ae41-e504c8e19533 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:44.285904 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c5960068-b39a-4ddd-ae41-e504c8e19533 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 33de8199-8f00-40eb-9b95-b7ab5289dbe3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:44.292467 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c5960068-b39a-4ddd-ae41-e504c8e19533 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:44.292932 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c5960068-b39a-4ddd-ae41-e504c8e19533 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:44.293586 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c5960068-b39a-4ddd-ae41-e504c8e19533 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:44.294871 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c5960068-b39a-4ddd-ae41-e504c8e19533 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:44.295359 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c5960068-b39a-4ddd-ae41-e504c8e19533 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:44.295781 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c5960068-b39a-4ddd-ae41-e504c8e19533 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:44.460212 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c5960068-b39a-4ddd-ae41-e504c8e19533 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:44.468359 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c5960068-b39a-4ddd-ae41-e504c8e19533 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3" status: 200 len: 1523 microversion: 2.1 time: 0.188598 Oct 17 13:49:44.468995 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1736/3448] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:44 2022] GET /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3 => generated 1523 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:49:44.808435 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5eac7860-3b53-43aa-a220-a09d062eca0d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:44.809115 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5eac7860-3b53-43aa-a220-a09d062eca0d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 972070b6-59ae-472d-9dfb-75051a0d7701] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:44.816263 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5eac7860-3b53-43aa-a220-a09d062eca0d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:44.816745 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5eac7860-3b53-43aa-a220-a09d062eca0d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:44.817412 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5eac7860-3b53-43aa-a220-a09d062eca0d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:44.818106 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5eac7860-3b53-43aa-a220-a09d062eca0d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:44.818556 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5eac7860-3b53-43aa-a220-a09d062eca0d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:44.818978 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5eac7860-3b53-43aa-a220-a09d062eca0d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:44.834770 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-28c98a65-85cd-4052-b3c0-fa0a62a41c25 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:44.835957 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-28c98a65-85cd-4052-b3c0-fa0a62a41c25 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: e1fb1718-c504-47dc-ab2e-28fe15d2c435] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:44.847735 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-28c98a65-85cd-4052-b3c0-fa0a62a41c25 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:44.848621 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-28c98a65-85cd-4052-b3c0-fa0a62a41c25 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:44.849213 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-28c98a65-85cd-4052-b3c0-fa0a62a41c25 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:44.850676 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-28c98a65-85cd-4052-b3c0-fa0a62a41c25 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:44.851334 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-28c98a65-85cd-4052-b3c0-fa0a62a41c25 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:44.851798 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-28c98a65-85cd-4052-b3c0-fa0a62a41c25 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:45.048930 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5eac7860-3b53-43aa-a220-a09d062eca0d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:45.052880 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-28c98a65-85cd-4052-b3c0-fa0a62a41c25 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:45.057746 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5eac7860-3b53-43aa-a220-a09d062eca0d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/972070b6-59ae-472d-9dfb-75051a0d7701" status: 200 len: 1366 microversion: 2.1 time: 0.253947 Oct 17 13:49:45.058334 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1713/3449] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:44 2022] GET /compute/v2.1/servers/972070b6-59ae-472d-9dfb-75051a0d7701 => generated 1366 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:45.063152 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-0d04a4b2-d844-4441-b1ca-4581c518d546 req-9ec1a531-1225-4c25-b10f-7859bd1e49a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1fb1718-c504-47dc-ab2e-28fe15d2c435", "name": "network-vif-plugged", "status": "completed", "tag": "391b5d37-7616-4b7e-974a-cd5f28f3eb9a"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:49:45.073434 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-0d04a4b2-d844-4441-b1ca-4581c518d546 req-9ec1a531-1225-4c25-b10f-7859bd1e49a2 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:45.074219 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-0d04a4b2-d844-4441-b1ca-4581c518d546 req-9ec1a531-1225-4c25-b10f-7859bd1e49a2 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:45.074848 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-0d04a4b2-d844-4441-b1ca-4581c518d546 req-9ec1a531-1225-4c25-b10f-7859bd1e49a2 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:45.076766 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-28c98a65-85cd-4052-b3c0-fa0a62a41c25 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435" status: 200 len: 1469 microversion: 2.1 time: 0.250295 Oct 17 13:49:45.077440 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1737/3450] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:44 2022] GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435 => generated 1469 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:45.085174 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7584c8c0-8a45-41dc-b78d-07c652f31880 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-413188931", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "011d3a2e-37cb-44bf-9173-75f6507fcc0b"}], "security_groups": [{"name": "tempest-securitygroup--250184907"}], "key_name": "tempest-keypair-48261411", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "f8149fea-2abb-4bf5-a78d-d1c373e28575", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:49:45.095391 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-0d04a4b2-d844-4441-b1ca-4581c518d546 req-9ec1a531-1225-4c25-b10f-7859bd1e49a2 service nova] Creating event network-vif-plugged:391b5d37-7616-4b7e-974a-cd5f28f3eb9a for instance e1fb1718-c504-47dc-ab2e-28fe15d2c435 on n-h2-854247-14 Oct 17 13:49:45.109807 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [req-0d04a4b2-d844-4441-b1ca-4581c518d546 req-9ec1a531-1225-4c25-b10f-7859bd1e49a2 service nova] Instance e1fb1718-c504-47dc-ab2e-28fe15d2c435 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854247-14', 'n-h2-854247-14'} {{(pid=127017) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:49:45.125322 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-0d04a4b2-d844-4441-b1ca-4581c518d546 req-9ec1a531-1225-4c25-b10f-7859bd1e49a2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065529 Oct 17 13:49:45.127065 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1714/3451] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:49:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:49:45.210187 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-7584c8c0-8a45-41dc-b78d-07c652f31880 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] validate_networks() for [('011d3a2e-37cb-44bf-9173-75f6507fcc0b', None, None, None, None, None)] {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:49:45.492889 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-825b60b9-aba5-43ef-bdd6-04a794fcf320 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:45.493596 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-825b60b9-aba5-43ef-bdd6-04a794fcf320 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 33de8199-8f00-40eb-9b95-b7ab5289dbe3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:45.500197 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-825b60b9-aba5-43ef-bdd6-04a794fcf320 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:45.500935 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-825b60b9-aba5-43ef-bdd6-04a794fcf320 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:45.501574 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-825b60b9-aba5-43ef-bdd6-04a794fcf320 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:45.502442 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-825b60b9-aba5-43ef-bdd6-04a794fcf320 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:45.503055 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-825b60b9-aba5-43ef-bdd6-04a794fcf320 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:45.503692 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-825b60b9-aba5-43ef-bdd6-04a794fcf320 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:45.692285 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-7584c8c0-8a45-41dc-b78d-07c652f31880 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Getting quotas for project a584b724ab934dd59315d9c644f11cfa. Resources: dict_keys(['metadata_items']) {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:49:45.699789 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-7584c8c0-8a45-41dc-b78d-07c652f31880 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Getting quotas for user 5ef890da37cc444380f1c373ffbf1aac and project a584b724ab934dd59315d9c644f11cfa. Resources: dict_keys(['metadata_items']) {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:49:45.712906 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-825b60b9-aba5-43ef-bdd6-04a794fcf320 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:45.717190 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-7584c8c0-8a45-41dc-b78d-07c652f31880 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:49:45.717793 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-7584c8c0-8a45-41dc-b78d-07c652f31880 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:49:45.718707 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-7584c8c0-8a45-41dc-b78d-07c652f31880 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:49:45.719665 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-7584c8c0-8a45-41dc-b78d-07c652f31880 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:49:45.720431 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-7584c8c0-8a45-41dc-b78d-07c652f31880 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:49:45.722116 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-825b60b9-aba5-43ef-bdd6-04a794fcf320 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3" status: 200 len: 1523 microversion: 2.1 time: 0.233263 Oct 17 13:49:45.723066 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1715/3452] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:45 2022] GET /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3 => generated 1523 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:45.731523 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7584c8c0-8a45-41dc-b78d-07c652f31880 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:45.732495 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7584c8c0-8a45-41dc-b78d-07c652f31880 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:45.733202 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7584c8c0-8a45-41dc-b78d-07c652f31880 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:45.734307 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7584c8c0-8a45-41dc-b78d-07c652f31880 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:45.735000 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7584c8c0-8a45-41dc-b78d-07c652f31880 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:45.735694 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7584c8c0-8a45-41dc-b78d-07c652f31880 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:45.758844 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-7584c8c0-8a45-41dc-b78d-07c652f31880 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Getting quotas for project a584b724ab934dd59315d9c644f11cfa. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:49:45.767335 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-7584c8c0-8a45-41dc-b78d-07c652f31880 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Getting quotas for user 5ef890da37cc444380f1c373ffbf1aac and project a584b724ab934dd59315d9c644f11cfa. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:49:45.838877 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7584c8c0-8a45-41dc-b78d-07c652f31880 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:49:45.843032 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7584c8c0-8a45-41dc-b78d-07c652f31880 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] [instance: f5d52166-ed04-4313-8929-821bbae17f68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f8149fea-2abb-4bf5-a78d-d1c373e28575',volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:49:46.016341 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7584c8c0-8a45-41dc-b78d-07c652f31880 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.937773 Oct 17 13:49:46.017004 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1738/3453] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:49:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 939 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:49:46.028976 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ca266adb-d9a2-410f-a7a8-297d35aef8a8 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:46.029937 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ca266adb-d9a2-410f-a7a8-297d35aef8a8 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] [instance: f5d52166-ed04-4313-8929-821bbae17f68] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:46.084487 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8d008bc7-72f4-492f-98e0-9abc20de192b tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:46.085119 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8d008bc7-72f4-492f-98e0-9abc20de192b tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 972070b6-59ae-472d-9dfb-75051a0d7701] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:46.095023 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8d008bc7-72f4-492f-98e0-9abc20de192b tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:46.095842 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8d008bc7-72f4-492f-98e0-9abc20de192b tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:46.098878 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8d008bc7-72f4-492f-98e0-9abc20de192b tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:46.100124 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8d008bc7-72f4-492f-98e0-9abc20de192b tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:46.100745 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8d008bc7-72f4-492f-98e0-9abc20de192b tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:46.101348 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8d008bc7-72f4-492f-98e0-9abc20de192b tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:46.107968 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ca266adb-d9a2-410f-a7a8-297d35aef8a8 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef890da37cc444380f1c373ffbf1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a584b724ab934dd59315d9c644f11cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:46.117881 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ca266adb-d9a2-410f-a7a8-297d35aef8a8 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] 10.222.0.79 "GET /compute/v2.1/servers/f5d52166-ed04-4313-8929-821bbae17f68" status: 200 len: 1119 microversion: 2.1 time: 0.093113 Oct 17 13:49:46.119572 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1716/3454] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:46 2022] GET /compute/v2.1/servers/f5d52166-ed04-4313-8929-821bbae17f68 => generated 1119 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:46.141509 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-be5250ae-fd9f-4cfd-ba6c-dc7e54a5e264 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:46.143663 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-be5250ae-fd9f-4cfd-ba6c-dc7e54a5e264 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: e1fb1718-c504-47dc-ab2e-28fe15d2c435] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:46.157813 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-be5250ae-fd9f-4cfd-ba6c-dc7e54a5e264 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:46.158561 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-be5250ae-fd9f-4cfd-ba6c-dc7e54a5e264 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:46.159264 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-be5250ae-fd9f-4cfd-ba6c-dc7e54a5e264 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:46.160595 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-be5250ae-fd9f-4cfd-ba6c-dc7e54a5e264 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:46.161235 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-be5250ae-fd9f-4cfd-ba6c-dc7e54a5e264 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:46.162096 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-be5250ae-fd9f-4cfd-ba6c-dc7e54a5e264 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:46.356631 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8d008bc7-72f4-492f-98e0-9abc20de192b tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:46.366999 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8d008bc7-72f4-492f-98e0-9abc20de192b tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/972070b6-59ae-472d-9dfb-75051a0d7701" status: 200 len: 1556 microversion: 2.1 time: 0.287388 Oct 17 13:49:46.383273 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1739/3455] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:46 2022] GET /compute/v2.1/servers/972070b6-59ae-472d-9dfb-75051a0d7701 => generated 1556 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:49:46.390747 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4ab54ce8-6ead-4ba4-9a44-dc25a6324f9f tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:46.391565 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4ab54ce8-6ead-4ba4-9a44-dc25a6324f9f tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 972070b6-59ae-472d-9dfb-75051a0d7701] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:46.398262 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4ab54ce8-6ead-4ba4-9a44-dc25a6324f9f tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:46.399089 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4ab54ce8-6ead-4ba4-9a44-dc25a6324f9f tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:46.399748 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4ab54ce8-6ead-4ba4-9a44-dc25a6324f9f tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:46.400683 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4ab54ce8-6ead-4ba4-9a44-dc25a6324f9f tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:46.401346 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4ab54ce8-6ead-4ba4-9a44-dc25a6324f9f tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:46.401834 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4ab54ce8-6ead-4ba4-9a44-dc25a6324f9f tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:46.417462 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-be5250ae-fd9f-4cfd-ba6c-dc7e54a5e264 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:46.430003 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-be5250ae-fd9f-4cfd-ba6c-dc7e54a5e264 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435" status: 200 len: 1469 microversion: 2.1 time: 0.308998 Oct 17 13:49:46.432512 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1717/3456] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:46 2022] GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435 => generated 1469 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:46.516330 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4ab54ce8-6ead-4ba4-9a44-dc25a6324f9f tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/972070b6-59ae-472d-9dfb-75051a0d7701/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.129498 Oct 17 13:49:46.517142 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1740/3457] 10.222.0.79 () {58 vars in 1275 bytes} [Mon Oct 17 13:49:46 2022] GET /compute/v2.1/servers/972070b6-59ae-472d-9dfb-75051a0d7701/os-interface => generated 284 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:49:46.753132 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-de061625-787d-4726-a687-627f57c45761 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:46.755102 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-de061625-787d-4726-a687-627f57c45761 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 33de8199-8f00-40eb-9b95-b7ab5289dbe3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:46.761515 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-de061625-787d-4726-a687-627f57c45761 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:46.762359 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-de061625-787d-4726-a687-627f57c45761 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:46.763012 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-de061625-787d-4726-a687-627f57c45761 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:46.764084 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-de061625-787d-4726-a687-627f57c45761 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:46.764692 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-de061625-787d-4726-a687-627f57c45761 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:46.765337 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-de061625-787d-4726-a687-627f57c45761 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:47.151732 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1e1fb817-5968-461d-af16-52c3401394de tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:47.154431 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-1e1fb817-5968-461d-af16-52c3401394de tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] [instance: f5d52166-ed04-4313-8929-821bbae17f68] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:47.164261 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-de061625-787d-4726-a687-627f57c45761 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:47.165399 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1e1fb817-5968-461d-af16-52c3401394de tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:47.167466 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1e1fb817-5968-461d-af16-52c3401394de tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:47.167466 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1e1fb817-5968-461d-af16-52c3401394de tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:47.167764 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1e1fb817-5968-461d-af16-52c3401394de tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:47.168693 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1e1fb817-5968-461d-af16-52c3401394de tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:47.169538 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1e1fb817-5968-461d-af16-52c3401394de tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:47.178036 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-de061625-787d-4726-a687-627f57c45761 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3" status: 200 len: 1523 microversion: 2.1 time: 0.428862 Oct 17 13:49:47.180081 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1718/3458] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:46 2022] GET /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3 => generated 1523 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:47.457877 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0dae49dc-557e-4cfb-b222-3c8077726002 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:47.458501 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0dae49dc-557e-4cfb-b222-3c8077726002 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: e1fb1718-c504-47dc-ab2e-28fe15d2c435] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:47.465076 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0dae49dc-557e-4cfb-b222-3c8077726002 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:47.465811 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0dae49dc-557e-4cfb-b222-3c8077726002 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:47.466462 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0dae49dc-557e-4cfb-b222-3c8077726002 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:47.467234 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0dae49dc-557e-4cfb-b222-3c8077726002 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:47.467689 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0dae49dc-557e-4cfb-b222-3c8077726002 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:47.468109 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0dae49dc-557e-4cfb-b222-3c8077726002 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:47.610625 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-1e1fb817-5968-461d-af16-52c3401394de tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef890da37cc444380f1c373ffbf1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a584b724ab934dd59315d9c644f11cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:47.637651 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1e1fb817-5968-461d-af16-52c3401394de tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] 10.222.0.79 "GET /compute/v2.1/servers/f5d52166-ed04-4313-8929-821bbae17f68" status: 200 len: 1217 microversion: 2.1 time: 0.497496 Oct 17 13:49:47.651910 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1741/3459] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:47 2022] GET /compute/v2.1/servers/f5d52166-ed04-4313-8929-821bbae17f68 => generated 1217 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:49:47.875638 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0dae49dc-557e-4cfb-b222-3c8077726002 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:47.885894 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0dae49dc-557e-4cfb-b222-3c8077726002 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435" status: 200 len: 1535 microversion: 2.1 time: 0.432464 Oct 17 13:49:47.886959 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1719/3460] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:47 2022] GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435 => generated 1535 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:49:48.203085 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cbbc8b20-88ec-4fe3-a335-a4a5a51d8088 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:48.203932 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cbbc8b20-88ec-4fe3-a335-a4a5a51d8088 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 33de8199-8f00-40eb-9b95-b7ab5289dbe3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:48.217345 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cbbc8b20-88ec-4fe3-a335-a4a5a51d8088 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:48.217883 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cbbc8b20-88ec-4fe3-a335-a4a5a51d8088 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:48.218276 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cbbc8b20-88ec-4fe3-a335-a4a5a51d8088 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:48.220780 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cbbc8b20-88ec-4fe3-a335-a4a5a51d8088 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:48.222932 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cbbc8b20-88ec-4fe3-a335-a4a5a51d8088 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:48.223814 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cbbc8b20-88ec-4fe3-a335-a4a5a51d8088 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:48.309992 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-e0fef3bb-4700-43fb-b9c4-26328ef80840 req-039e9495-38dd-4b12-a5b0-a41f0552a8c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1fb1718-c504-47dc-ab2e-28fe15d2c435", "name": "network-vif-unplugged", "status": "completed", "tag": "391b5d37-7616-4b7e-974a-cd5f28f3eb9a"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:49:48.321595 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-e0fef3bb-4700-43fb-b9c4-26328ef80840 req-039e9495-38dd-4b12-a5b0-a41f0552a8c9 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:48.322495 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-e0fef3bb-4700-43fb-b9c4-26328ef80840 req-039e9495-38dd-4b12-a5b0-a41f0552a8c9 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:48.323511 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-e0fef3bb-4700-43fb-b9c4-26328ef80840 req-039e9495-38dd-4b12-a5b0-a41f0552a8c9 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:48.336511 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-e0fef3bb-4700-43fb-b9c4-26328ef80840 req-039e9495-38dd-4b12-a5b0-a41f0552a8c9 service nova] Creating event network-vif-unplugged:391b5d37-7616-4b7e-974a-cd5f28f3eb9a for instance e1fb1718-c504-47dc-ab2e-28fe15d2c435 on n-h1-854247-14 Oct 17 13:49:48.345972 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [req-e0fef3bb-4700-43fb-b9c4-26328ef80840 req-039e9495-38dd-4b12-a5b0-a41f0552a8c9 service nova] Instance e1fb1718-c504-47dc-ab2e-28fe15d2c435 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854247-14', 'n-h1-854247-14'} {{(pid=127017) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:49:48.359570 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-e0fef3bb-4700-43fb-b9c4-26328ef80840 req-039e9495-38dd-4b12-a5b0-a41f0552a8c9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053089 Oct 17 13:49:48.360850 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1720/3461] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:49:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:49:48.663372 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7463ef60-6ce5-4695-94ff-d59c84ee5308 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:48.664567 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7463ef60-6ce5-4695-94ff-d59c84ee5308 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] [instance: f5d52166-ed04-4313-8929-821bbae17f68] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:48.676093 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7463ef60-6ce5-4695-94ff-d59c84ee5308 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:48.679627 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7463ef60-6ce5-4695-94ff-d59c84ee5308 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:48.681563 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7463ef60-6ce5-4695-94ff-d59c84ee5308 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:48.683731 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7463ef60-6ce5-4695-94ff-d59c84ee5308 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:48.684696 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7463ef60-6ce5-4695-94ff-d59c84ee5308 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:48.687445 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7463ef60-6ce5-4695-94ff-d59c84ee5308 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:48.732975 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cbbc8b20-88ec-4fe3-a335-a4a5a51d8088 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:48.750283 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cbbc8b20-88ec-4fe3-a335-a4a5a51d8088 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3" status: 200 len: 1523 microversion: 2.1 time: 0.551765 Oct 17 13:49:48.752515 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1742/3462] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:48 2022] GET /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3 => generated 1523 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:48.913837 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e6364529-96e9-4715-9c1e-cde14abcab3a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:48.914433 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e6364529-96e9-4715-9c1e-cde14abcab3a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: e1fb1718-c504-47dc-ab2e-28fe15d2c435] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:48.921843 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e6364529-96e9-4715-9c1e-cde14abcab3a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:48.922318 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e6364529-96e9-4715-9c1e-cde14abcab3a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:48.927677 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e6364529-96e9-4715-9c1e-cde14abcab3a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:48.928651 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e6364529-96e9-4715-9c1e-cde14abcab3a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:48.930023 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e6364529-96e9-4715-9c1e-cde14abcab3a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:48.931362 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e6364529-96e9-4715-9c1e-cde14abcab3a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:49.200941 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7463ef60-6ce5-4695-94ff-d59c84ee5308 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef890da37cc444380f1c373ffbf1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a584b724ab934dd59315d9c644f11cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:49.215054 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7463ef60-6ce5-4695-94ff-d59c84ee5308 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] 10.222.0.79 "GET /compute/v2.1/servers/f5d52166-ed04-4313-8929-821bbae17f68" status: 200 len: 1302 microversion: 2.1 time: 0.556574 Oct 17 13:49:49.216343 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1721/3463] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:48 2022] GET /compute/v2.1/servers/f5d52166-ed04-4313-8929-821bbae17f68 => generated 1302 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:49:49.743358 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e6364529-96e9-4715-9c1e-cde14abcab3a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:49.753318 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-96fa469d-889d-471c-9a9c-3ea8e439f22e req-a8d66e24-ad6f-4319-a88b-e7ce41998333 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5d52166-ed04-4313-8929-821bbae17f68", "tag": "8d25e9b2-a5d2-482c-9ca9-2f5cb2363bea"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:49:49.775574 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e6364529-96e9-4715-9c1e-cde14abcab3a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435" status: 200 len: 1535 microversion: 2.1 time: 0.866501 Oct 17 13:49:49.776203 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1743/3464] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:48 2022] GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435 => generated 1535 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:49:49.798924 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-96fa469d-889d-471c-9a9c-3ea8e439f22e req-a8d66e24-ad6f-4319-a88b-e7ce41998333 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:49.801170 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-96fa469d-889d-471c-9a9c-3ea8e439f22e req-a8d66e24-ad6f-4319-a88b-e7ce41998333 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:49.801797 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-96fa469d-889d-471c-9a9c-3ea8e439f22e req-a8d66e24-ad6f-4319-a88b-e7ce41998333 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:49.807922 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c51b1e5f-4d7e-4cb5-874d-35c903418b81 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:49.808792 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c51b1e5f-4d7e-4cb5-874d-35c903418b81 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 33de8199-8f00-40eb-9b95-b7ab5289dbe3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:49.820001 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c51b1e5f-4d7e-4cb5-874d-35c903418b81 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:49.820492 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c51b1e5f-4d7e-4cb5-874d-35c903418b81 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:49.820927 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c51b1e5f-4d7e-4cb5-874d-35c903418b81 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:49.821683 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c51b1e5f-4d7e-4cb5-874d-35c903418b81 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:49.822066 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c51b1e5f-4d7e-4cb5-874d-35c903418b81 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:49.822482 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c51b1e5f-4d7e-4cb5-874d-35c903418b81 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:49.837483 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-96fa469d-889d-471c-9a9c-3ea8e439f22e req-a8d66e24-ad6f-4319-a88b-e7ce41998333 service nova] Creating event network-changed:8d25e9b2-a5d2-482c-9ca9-2f5cb2363bea for instance f5d52166-ed04-4313-8929-821bbae17f68 on n-h1-854247-14 Oct 17 13:49:49.852220 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-96fa469d-889d-471c-9a9c-3ea8e439f22e req-a8d66e24-ad6f-4319-a88b-e7ce41998333 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.344120 Oct 17 13:49:49.854665 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1722/3465] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:49:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:49:50.242348 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c490615e-3a63-47cd-b3a1-1eef6517eb1c tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:50.244296 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c490615e-3a63-47cd-b3a1-1eef6517eb1c tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] [instance: f5d52166-ed04-4313-8929-821bbae17f68] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:50.264828 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c490615e-3a63-47cd-b3a1-1eef6517eb1c tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:50.266308 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c490615e-3a63-47cd-b3a1-1eef6517eb1c tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:50.271990 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c490615e-3a63-47cd-b3a1-1eef6517eb1c tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:50.272766 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c490615e-3a63-47cd-b3a1-1eef6517eb1c tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:50.273243 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c490615e-3a63-47cd-b3a1-1eef6517eb1c tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:50.273868 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c490615e-3a63-47cd-b3a1-1eef6517eb1c tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:50.304839 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c51b1e5f-4d7e-4cb5-874d-35c903418b81 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:50.315470 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c51b1e5f-4d7e-4cb5-874d-35c903418b81 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3" status: 200 len: 1523 microversion: 2.1 time: 0.529152 Oct 17 13:49:50.316304 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1744/3466] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:49 2022] GET /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3 => generated 1523 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:50.440077 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-20cce537-5d29-4e11-a765-6bf4dff1f5bc req-5c3850dc-a559-4ba2-928f-4f33d354b379 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1fb1718-c504-47dc-ab2e-28fe15d2c435", "tag": "391b5d37-7616-4b7e-974a-cd5f28f3eb9a"}, {"name": "network-changed", "server_uuid": "972070b6-59ae-472d-9dfb-75051a0d7701", "tag": "57ff033e-f817-435b-943f-900adf5c7342"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:49:50.448387 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:49:50.463493 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-20cce537-5d29-4e11-a765-6bf4dff1f5bc req-5c3850dc-a559-4ba2-928f-4f33d354b379 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:50.471914 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-20cce537-5d29-4e11-a765-6bf4dff1f5bc req-5c3850dc-a559-4ba2-928f-4f33d354b379 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:50.472568 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-20cce537-5d29-4e11-a765-6bf4dff1f5bc req-5c3850dc-a559-4ba2-928f-4f33d354b379 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:50.476309 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:49:50.506104 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-20cce537-5d29-4e11-a765-6bf4dff1f5bc req-5c3850dc-a559-4ba2-928f-4f33d354b379 service nova] Creating event network-changed:391b5d37-7616-4b7e-974a-cd5f28f3eb9a for instance e1fb1718-c504-47dc-ab2e-28fe15d2c435 on n-h1-854247-14 Oct 17 13:49:50.506579 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-20cce537-5d29-4e11-a765-6bf4dff1f5bc req-5c3850dc-a559-4ba2-928f-4f33d354b379 service nova] Creating event network-changed:57ff033e-f817-435b-943f-900adf5c7342 for instance 972070b6-59ae-472d-9dfb-75051a0d7701 on n-h2-854247-14 Oct 17 13:49:50.523320 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [req-20cce537-5d29-4e11-a765-6bf4dff1f5bc req-5c3850dc-a559-4ba2-928f-4f33d354b379 service nova] Instance e1fb1718-c504-47dc-ab2e-28fe15d2c435 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854247-14', 'n-h1-854247-14'} {{(pid=127016) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:49:50.538633 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-20cce537-5d29-4e11-a765-6bf4dff1f5bc req-5c3850dc-a559-4ba2-928f-4f33d354b379 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.102147 Oct 17 13:49:50.539605 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1745/3467] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:49:50 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:49:50.641278 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c490615e-3a63-47cd-b3a1-1eef6517eb1c tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef890da37cc444380f1c373ffbf1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a584b724ab934dd59315d9c644f11cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:50.650399 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c490615e-3a63-47cd-b3a1-1eef6517eb1c tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] 10.222.0.79 "GET /compute/v2.1/servers/f5d52166-ed04-4313-8929-821bbae17f68" status: 200 len: 1302 microversion: 2.1 time: 0.414382 Oct 17 13:49:50.652248 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1723/3468] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:50 2022] GET /compute/v2.1/servers/f5d52166-ed04-4313-8929-821bbae17f68 => generated 1302 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:50.804176 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9eecc1ef-46d6-4d0b-b505-c6d8f14ed8a2 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:50.806076 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9eecc1ef-46d6-4d0b-b505-c6d8f14ed8a2 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: e1fb1718-c504-47dc-ab2e-28fe15d2c435] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:50.815619 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9eecc1ef-46d6-4d0b-b505-c6d8f14ed8a2 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:50.817861 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9eecc1ef-46d6-4d0b-b505-c6d8f14ed8a2 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:50.818478 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9eecc1ef-46d6-4d0b-b505-c6d8f14ed8a2 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:50.821193 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9eecc1ef-46d6-4d0b-b505-c6d8f14ed8a2 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:50.822177 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9eecc1ef-46d6-4d0b-b505-c6d8f14ed8a2 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:50.823190 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9eecc1ef-46d6-4d0b-b505-c6d8f14ed8a2 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:51.344746 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a1424375-c521-4aca-b4ad-f98bf2a6b050 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:51.346019 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a1424375-c521-4aca-b4ad-f98bf2a6b050 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 33de8199-8f00-40eb-9b95-b7ab5289dbe3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:51.354178 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a1424375-c521-4aca-b4ad-f98bf2a6b050 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:51.354917 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a1424375-c521-4aca-b4ad-f98bf2a6b050 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:51.355518 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a1424375-c521-4aca-b4ad-f98bf2a6b050 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:51.356405 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a1424375-c521-4aca-b4ad-f98bf2a6b050 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:51.356971 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a1424375-c521-4aca-b4ad-f98bf2a6b050 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:51.357499 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a1424375-c521-4aca-b4ad-f98bf2a6b050 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:51.692119 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9eecc1ef-46d6-4d0b-b505-c6d8f14ed8a2 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:51.712823 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9eecc1ef-46d6-4d0b-b505-c6d8f14ed8a2 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435" status: 200 len: 1535 microversion: 2.1 time: 0.915178 Oct 17 13:49:51.714706 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1746/3469] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:50 2022] GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435 => generated 1535 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:51.724238 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-97e20663-51d6-427e-b2dc-6462dcdcd926 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:51.725226 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-97e20663-51d6-427e-b2dc-6462dcdcd926 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] [instance: f5d52166-ed04-4313-8929-821bbae17f68] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:51.745750 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-97e20663-51d6-427e-b2dc-6462dcdcd926 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:51.746607 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-97e20663-51d6-427e-b2dc-6462dcdcd926 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:51.748999 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-97e20663-51d6-427e-b2dc-6462dcdcd926 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:51.750340 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-97e20663-51d6-427e-b2dc-6462dcdcd926 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:51.751276 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-97e20663-51d6-427e-b2dc-6462dcdcd926 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:51.752637 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-97e20663-51d6-427e-b2dc-6462dcdcd926 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:51.828041 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a1424375-c521-4aca-b4ad-f98bf2a6b050 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:51.841932 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=100 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:49:51.846057 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a1424375-c521-4aca-b4ad-f98bf2a6b050 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3" status: 200 len: 1503 microversion: 2.1 time: 0.505316 Oct 17 13:49:51.847521 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1724/3470] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:51 2022] GET /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3 => generated 1503 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:49:51.872286 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bdfd141a-5ddb-42b5-91c8-0591d232004f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "66874965-a18d-4c28-8087-6425881680ea"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:49:51.875422 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-bdfd141a-5ddb-42b5-91c8-0591d232004f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 33de8199-8f00-40eb-9b95-b7ab5289dbe3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:51.883115 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bdfd141a-5ddb-42b5-91c8-0591d232004f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:51.884039 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bdfd141a-5ddb-42b5-91c8-0591d232004f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:51.884673 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bdfd141a-5ddb-42b5-91c8-0591d232004f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:51.885608 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bdfd141a-5ddb-42b5-91c8-0591d232004f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:51.886344 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bdfd141a-5ddb-42b5-91c8-0591d232004f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:51.887011 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bdfd141a-5ddb-42b5-91c8-0591d232004f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:51.919640 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-bdfd141a-5ddb-42b5-91c8-0591d232004f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] HTTP exception thrown: Cannot 'attach_volume' instance 33de8199-8f00-40eb-9b95-b7ab5289dbe3 while it is in vm_state rescued Oct 17 13:49:51.923081 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bdfd141a-5ddb-42b5-91c8-0591d232004f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Request method failure captured: Oct 17 13:49:51.923081 n-d-854247-14 devstack@n-api.service[127017]: request: POST /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3/os-volume_attachments HTTP/1.1 Oct 17 13:49:51.923081 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:49:51.923081 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:49:51.923081 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:49:51.923081 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 74 Oct 17 13:49:51.923081 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:49:51.923081 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:49:51.923081 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:49:51.923081 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:49:51.923081 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTV0lGewBAd5oX7RsuswRRrYdH_s7fnCDLNRSaJQAxErmqZOT5QT6523TfZqZvgb4tWrIGVLDqv0foQ4mpFwe91mdGAxx6JOfjpLIqY8Vnvh6NrynvpuS4ywkAJAwUfpPeJ0dauW6Gj_xg5-jDhUd1iFTLiSXh_-SOzh7_iyTjRI7Ovs Oct 17 13:49:51.923081 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:49:51.923081 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:49:51.923081 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:49:51.923081 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:49:51.923081 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:49:51.923081 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:49:51.923081 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 08068aeba86c4e718ba1e25c68fd3259 Oct 17 13:49:51.923081 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1627831718 Oct 17 13:49:51.923081 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:49:51.923081 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:49:51.923081 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/08068aeba86c4e718ba1e25c68fd3259"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/08068aeba86c4e718ba1e25c68fd3259"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/08068aeba86c4e718ba1e25c68fd3259"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_08068aeba86c4e718ba1e25c68fd3259", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:49:51.923081 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1627831718 Oct 17 13:49:51.923081 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 08068aeba86c4e718ba1e25c68fd3259 Oct 17 13:49:51.923081 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1627831718 Oct 17 13:49:51.923081 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServerRescueNegativeTestJSON-1627831718-project Oct 17 13:49:51.923081 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:49:51.923081 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:49:51.923081 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: d56b91ce42894bafac5ddb16ad6f037b Oct 17 13:49:51.923081 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1627831718-project Oct 17 13:49:51.923081 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 13:49:51.923081 n-d-854247-14 devstack@n-api.service[127017]: {"volumeAttachment": {"volumeId": "66874965-a18d-4c28-8087-6425881680ea"}} Oct 17 13:49:51.923081 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:49:51.923081 n-d-854247-14 devstack@n-api.service[127017]: exception: Cannot 'attach_volume' instance 33de8199-8f00-40eb-9b95-b7ab5289dbe3 while it is in vm_state rescued Oct 17 13:49:51.923081 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'server_id': '33de8199-8f00-40eb-9b95-b7ab5289dbe3', 'body': {'volumeAttachment': {'volumeId': '66874965-a18d-4c28-8087-6425881680ea'}}} Oct 17 13:49:51.923081 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:49:51.923081 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:49:51.923081 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 17 13:49:51.923081 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 17 13:49:51.923081 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 13:49:51.923081 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:49:51.923081 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 13:49:51.923081 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 13:49:51.923081 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 33de8199-8f00-40eb-9b95-b7ab5289dbe3 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 17 13:49:51.923081 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:49:51.923081 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:49:51.923081 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:49:51.923081 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:49:51.923081 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:49:51.923081 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:49:51.923081 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:49:51.923081 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:49:51.923081 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:49:51.923081 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:49:51.923081 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:49:51.923081 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:49:51.923081 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:49:51.923081 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:49:51.923081 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:49:51.923081 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:49:51.923081 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 17 13:49:51.923081 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 17 13:49:51.929078 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 13:49:51.929078 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 13:49:51.929078 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 33de8199-8f00-40eb-9b95-b7ab5289dbe3 while it is in vm_state rescued Oct 17 13:49:51.929078 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:49:51.929078 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:49:51.929078 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:49:51.929078 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:49:51.929078 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:49:51.929078 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:49:51.929078 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:49:51.929078 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:49:51.929078 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 33de8199-8f00-40eb-9b95-b7ab5289dbe3 while it is in vm_state rescued Oct 17 13:49:51.929078 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:49:51.931644 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bdfd141a-5ddb-42b5-91c8-0591d232004f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Returning 409 to user: Cannot 'attach_volume' instance 33de8199-8f00-40eb-9b95-b7ab5289dbe3 while it is in vm_state rescued {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:49:51.932869 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-bdfd141a-5ddb-42b5-91c8-0591d232004f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "POST /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.065010 Oct 17 13:49:51.937188 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1725/3471] 10.222.0.79 () {60 vars in 1323 bytes} [Mon Oct 17 13:49:51 2022] POST /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3/os-volume_attachments => generated 152 bytes in 70 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:49:51.943230 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e96826d7-ee85-40ce-9bd2-e88f5f03537e tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:49:51.944307 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e96826d7-ee85-40ce-9bd2-e88f5f03537e tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 33de8199-8f00-40eb-9b95-b7ab5289dbe3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:51.952656 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e96826d7-ee85-40ce-9bd2-e88f5f03537e tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:51.953493 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e96826d7-ee85-40ce-9bd2-e88f5f03537e tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:51.954089 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e96826d7-ee85-40ce-9bd2-e88f5f03537e tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:51.955242 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e96826d7-ee85-40ce-9bd2-e88f5f03537e tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:51.955951 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e96826d7-ee85-40ce-9bd2-e88f5f03537e tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:51.956669 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e96826d7-ee85-40ce-9bd2-e88f5f03537e tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:52.044798 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e96826d7-ee85-40ce-9bd2-e88f5f03537e tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "POST /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3/action" status: 202 len: 0 microversion: 2.1 time: 0.106299 Oct 17 13:49:52.049185 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1726/3472] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:49:51 2022] POST /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:49:52.058411 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2db2f153-76f6-4253-a580-23125f722157 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:52.059507 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2db2f153-76f6-4253-a580-23125f722157 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 33de8199-8f00-40eb-9b95-b7ab5289dbe3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:52.070621 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2db2f153-76f6-4253-a580-23125f722157 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:52.072024 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2db2f153-76f6-4253-a580-23125f722157 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:52.072979 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2db2f153-76f6-4253-a580-23125f722157 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:52.073902 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2db2f153-76f6-4253-a580-23125f722157 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:52.074724 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2db2f153-76f6-4253-a580-23125f722157 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:52.075636 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2db2f153-76f6-4253-a580-23125f722157 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:52.122388 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-97e20663-51d6-427e-b2dc-6462dcdcd926 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef890da37cc444380f1c373ffbf1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a584b724ab934dd59315d9c644f11cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:52.131433 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-97e20663-51d6-427e-b2dc-6462dcdcd926 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] 10.222.0.79 "GET /compute/v2.1/servers/f5d52166-ed04-4313-8929-821bbae17f68" status: 200 len: 1302 microversion: 2.1 time: 0.415213 Oct 17 13:49:52.132032 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1747/3473] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:51 2022] GET /compute/v2.1/servers/f5d52166-ed04-4313-8929-821bbae17f68 => generated 1302 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:52.429153 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2db2f153-76f6-4253-a580-23125f722157 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:52.449005 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2db2f153-76f6-4253-a580-23125f722157 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3" status: 200 len: 1511 microversion: 2.1 time: 0.396471 Oct 17 13:49:52.450199 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1727/3474] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:52 2022] GET /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3 => generated 1511 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:52.736939 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-454002f0-91f8-4c61-be6f-25dbc1d1e499 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:52.737948 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-454002f0-91f8-4c61-be6f-25dbc1d1e499 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: e1fb1718-c504-47dc-ab2e-28fe15d2c435] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:52.745672 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-454002f0-91f8-4c61-be6f-25dbc1d1e499 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:52.746312 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-454002f0-91f8-4c61-be6f-25dbc1d1e499 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:52.746756 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-454002f0-91f8-4c61-be6f-25dbc1d1e499 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:52.747488 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-454002f0-91f8-4c61-be6f-25dbc1d1e499 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:52.747941 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-454002f0-91f8-4c61-be6f-25dbc1d1e499 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:52.748360 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-454002f0-91f8-4c61-be6f-25dbc1d1e499 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:53.146742 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-454002f0-91f8-4c61-be6f-25dbc1d1e499 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:53.154184 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-459d71bd-b2c3-435b-811b-d874180c90a5 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:53.154849 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-459d71bd-b2c3-435b-811b-d874180c90a5 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] [instance: f5d52166-ed04-4313-8929-821bbae17f68] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:53.162287 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-454002f0-91f8-4c61-be6f-25dbc1d1e499 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435" status: 200 len: 1535 microversion: 2.1 time: 0.429080 Oct 17 13:49:53.163594 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1748/3475] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:52 2022] GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435 => generated 1535 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:53.181572 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-459d71bd-b2c3-435b-811b-d874180c90a5 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:53.182059 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-459d71bd-b2c3-435b-811b-d874180c90a5 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:53.182500 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-459d71bd-b2c3-435b-811b-d874180c90a5 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:53.183238 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-459d71bd-b2c3-435b-811b-d874180c90a5 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:53.183692 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-459d71bd-b2c3-435b-811b-d874180c90a5 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:53.184206 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-459d71bd-b2c3-435b-811b-d874180c90a5 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:53.477673 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-545908eb-a482-4eb4-a53f-4b7d1fcf6e5d tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:53.479101 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-545908eb-a482-4eb4-a53f-4b7d1fcf6e5d tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 33de8199-8f00-40eb-9b95-b7ab5289dbe3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:53.487815 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-545908eb-a482-4eb4-a53f-4b7d1fcf6e5d tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:53.489205 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-545908eb-a482-4eb4-a53f-4b7d1fcf6e5d tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:53.490211 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-545908eb-a482-4eb4-a53f-4b7d1fcf6e5d tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:53.510732 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-545908eb-a482-4eb4-a53f-4b7d1fcf6e5d tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:53.512405 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-545908eb-a482-4eb4-a53f-4b7d1fcf6e5d tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:53.517191 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-545908eb-a482-4eb4-a53f-4b7d1fcf6e5d tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:53.633414 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-459d71bd-b2c3-435b-811b-d874180c90a5 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef890da37cc444380f1c373ffbf1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a584b724ab934dd59315d9c644f11cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:53.650902 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-459d71bd-b2c3-435b-811b-d874180c90a5 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] 10.222.0.79 "GET /compute/v2.1/servers/f5d52166-ed04-4313-8929-821bbae17f68" status: 200 len: 1302 microversion: 2.1 time: 0.500724 Oct 17 13:49:53.687406 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1728/3476] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:53 2022] GET /compute/v2.1/servers/f5d52166-ed04-4313-8929-821bbae17f68 => generated 1302 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:49:53.850967 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-545908eb-a482-4eb4-a53f-4b7d1fcf6e5d tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:53.860643 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-545908eb-a482-4eb4-a53f-4b7d1fcf6e5d tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3" status: 200 len: 1511 microversion: 2.1 time: 0.390062 Oct 17 13:49:53.865256 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1749/3477] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:53 2022] GET /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3 => generated 1511 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:54.111790 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2bdf2f68-68b8-48fc-a4d9-9d68b9e3f7a7 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:54.112448 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2bdf2f68-68b8-48fc-a4d9-9d68b9e3f7a7 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: a2994495-366a-446f-b7a6-16340911e17c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:54.120719 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2bdf2f68-68b8-48fc-a4d9-9d68b9e3f7a7 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:54.121300 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2bdf2f68-68b8-48fc-a4d9-9d68b9e3f7a7 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:54.122445 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2bdf2f68-68b8-48fc-a4d9-9d68b9e3f7a7 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:54.123402 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2bdf2f68-68b8-48fc-a4d9-9d68b9e3f7a7 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:54.123932 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2bdf2f68-68b8-48fc-a4d9-9d68b9e3f7a7 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:54.124424 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2bdf2f68-68b8-48fc-a4d9-9d68b9e3f7a7 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:54.186197 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cae0effb-9063-428d-91e8-df312c79d1c6 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:54.186769 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cae0effb-9063-428d-91e8-df312c79d1c6 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: e1fb1718-c504-47dc-ab2e-28fe15d2c435] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:54.197452 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cae0effb-9063-428d-91e8-df312c79d1c6 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:54.199679 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cae0effb-9063-428d-91e8-df312c79d1c6 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:54.200737 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cae0effb-9063-428d-91e8-df312c79d1c6 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:54.201850 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cae0effb-9063-428d-91e8-df312c79d1c6 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:54.202367 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cae0effb-9063-428d-91e8-df312c79d1c6 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:54.202860 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cae0effb-9063-428d-91e8-df312c79d1c6 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:54.254455 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-2bdf2f68-68b8-48fc-a4d9-9d68b9e3f7a7 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lazy-loading 'services' on Instance uuid a2994495-366a-446f-b7a6-16340911e17c {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:49:54.384464 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2bdf2f68-68b8-48fc-a4d9-9d68b9e3f7a7 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c/os-volume_attachments/edb8305e-d5a4-4644-a658-6f4b41170760" status: 202 len: 0 microversion: 2.1 time: 0.280752 Oct 17 13:49:54.385901 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1729/3478] 10.222.0.79 () {58 vars in 1416 bytes} [Mon Oct 17 13:49:54 2022] DELETE /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c/os-volume_attachments/edb8305e-d5a4-4644-a658-6f4b41170760 => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:49:54.392550 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cae0effb-9063-428d-91e8-df312c79d1c6 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:54.403546 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cae0effb-9063-428d-91e8-df312c79d1c6 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435" status: 200 len: 1528 microversion: 2.1 time: 0.220715 Oct 17 13:49:54.415223 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1750/3479] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:54 2022] GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435 => generated 1528 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:54.428700 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-09c80289-5ed1-4efc-9515-59f08d06f998 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:54.429984 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-09c80289-5ed1-4efc-9515-59f08d06f998 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: e1fb1718-c504-47dc-ab2e-28fe15d2c435] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:54.437812 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-09c80289-5ed1-4efc-9515-59f08d06f998 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:54.438300 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-09c80289-5ed1-4efc-9515-59f08d06f998 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:54.438767 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-09c80289-5ed1-4efc-9515-59f08d06f998 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:54.439502 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-09c80289-5ed1-4efc-9515-59f08d06f998 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:54.440084 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-09c80289-5ed1-4efc-9515-59f08d06f998 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:54.440509 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-09c80289-5ed1-4efc-9515-59f08d06f998 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:54.682142 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-775c68e3-3f89-4e52-85a3-b730e789663d tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:54.683159 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-775c68e3-3f89-4e52-85a3-b730e789663d tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] [instance: f5d52166-ed04-4313-8929-821bbae17f68] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:54.689662 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-775c68e3-3f89-4e52-85a3-b730e789663d tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:54.690487 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-775c68e3-3f89-4e52-85a3-b730e789663d tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:54.691214 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-775c68e3-3f89-4e52-85a3-b730e789663d tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:54.692155 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-775c68e3-3f89-4e52-85a3-b730e789663d tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:54.692875 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-775c68e3-3f89-4e52-85a3-b730e789663d tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:54.693573 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-775c68e3-3f89-4e52-85a3-b730e789663d tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:54.712537 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-09c80289-5ed1-4efc-9515-59f08d06f998 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:54.732415 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-09c80289-5ed1-4efc-9515-59f08d06f998 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435" status: 200 len: 1528 microversion: 2.1 time: 0.309315 Oct 17 13:49:54.733631 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1730/3480] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:54 2022] GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435 => generated 1528 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:54.759197 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1cbbd3ff-e2d5-47f7-adb1-aa267d64310c tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:54.772883 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-1cbbd3ff-e2d5-47f7-adb1-aa267d64310c tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] HTTP exception thrown: Flavor fcab7af2-ec08-4c4c-a1f9-aaa2d9f08711 could not be found. Oct 17 13:49:54.785419 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1cbbd3ff-e2d5-47f7-adb1-aa267d64310c tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] Request method failure captured: Oct 17 13:49:54.785419 n-d-854247-14 devstack@n-api.service[127017]: request: DELETE /compute/v2.1/flavors/fcab7af2-ec08-4c4c-a1f9-aaa2d9f08711 HTTP/1.1 Oct 17 13:49:54.785419 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:49:54.785419 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:49:54.785419 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:49:54.785419 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:49:54.785419 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:49:54.785419 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:49:54.785419 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:49:54.785419 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:49:54.785419 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVyS-LP0oN__PVkv3-2PtNSbdXhacHXr2vR3c5fB2Shodd2ZKp6Qp1FugYn3DL25flGJ1_T5at4OecC0xHjrW9DX9V80uDrG7YErkdz_pnteOWoIKsM5MH6xsUZ__-ymrb4ioCVZltvyuhgGdhjDxI_C57KtjZsGTf3QXMH1sYDKvyA Oct 17 13:49:54.785419 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:49:54.785419 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:49:54.785419 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:49:54.785419 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:49:54.785419 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:49:54.785419 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:49:54.785419 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: a040c7e5c765439896b2f969363b9e4f Oct 17 13:49:54.785419 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-MigrationsAdminTest-1543824424 Oct 17 13:49:54.785419 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member,admin Oct 17 13:49:54.785419 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member,admin Oct 17 13:49:54.785419 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a040c7e5c765439896b2f969363b9e4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a040c7e5c765439896b2f969363b9e4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a040c7e5c765439896b2f969363b9e4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a040c7e5c765439896b2f969363b9e4f", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:49:54.785419 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-MigrationsAdminTest-1543824424 Oct 17 13:49:54.785419 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: a040c7e5c765439896b2f969363b9e4f Oct 17 13:49:54.785419 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-MigrationsAdminTest-1543824424 Oct 17 13:49:54.785419 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-MigrationsAdminTest-1543824424-project-admin Oct 17 13:49:54.785419 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:49:54.785419 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:49:54.785419 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 8ad835fb172540caaa8195d1e3e454b6 Oct 17 13:49:54.785419 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-MigrationsAdminTest-1543824424-project-admin Oct 17 13:49:54.785419 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:49:54.785419 n-d-854247-14 devstack@n-api.service[127017]: exception: Flavor fcab7af2-ec08-4c4c-a1f9-aaa2d9f08711 could not be found. Oct 17 13:49:54.785419 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'fcab7af2-ec08-4c4c-a1f9-aaa2d9f08711'} Oct 17 13:49:54.785419 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:49:54.785419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:49:54.785419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 17 13:49:54.785419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 17 13:49:54.785419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 17 13:49:54.785419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 17 13:49:54.785419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 17 13:49:54.785419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 17 13:49:54.785419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 17 13:49:54.785419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 17 13:49:54.785419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 13:49:54.785419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 13:49:54.785419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 17 13:49:54.785419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 17 13:49:54.785419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor fcab7af2-ec08-4c4c-a1f9-aaa2d9f08711 could not be found. Oct 17 13:49:54.785419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:49:54.785419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:49:54.785419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:49:54.785419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:49:54.785419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:49:54.785419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:49:54.785419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:49:54.785419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:49:54.785419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:49:54.785419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:49:54.785419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 17 13:49:54.785419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:49:54.785419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor fcab7af2-ec08-4c4c-a1f9-aaa2d9f08711 could not be found. Oct 17 13:49:54.785419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:49:54.785419 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:49:54.793720 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:49:54.793720 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:49:54.793720 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:49:54.793720 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:49:54.793720 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:49:54.793720 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:49:54.793720 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor fcab7af2-ec08-4c4c-a1f9-aaa2d9f08711 could not be found. Oct 17 13:49:54.793720 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:49:54.793720 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1cbbd3ff-e2d5-47f7-adb1-aa267d64310c tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] Returning 404 to user: Flavor fcab7af2-ec08-4c4c-a1f9-aaa2d9f08711 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:49:54.793720 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1cbbd3ff-e2d5-47f7-adb1-aa267d64310c tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/fcab7af2-ec08-4c4c-a1f9-aaa2d9f08711" status: 404 len: 109 microversion: 2.1 time: 0.034345 Oct 17 13:49:54.793720 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1731/3481] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:49:54 2022] DELETE /compute/v2.1/flavors/fcab7af2-ec08-4c4c-a1f9-aaa2d9f08711 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:49:54.889998 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-190f7bf3-25f8-4686-ae96-aa760c24694e tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:54.890845 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-190f7bf3-25f8-4686-ae96-aa760c24694e tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 33de8199-8f00-40eb-9b95-b7ab5289dbe3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:54.913394 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-190f7bf3-25f8-4686-ae96-aa760c24694e tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:54.913916 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-190f7bf3-25f8-4686-ae96-aa760c24694e tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:54.915421 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-190f7bf3-25f8-4686-ae96-aa760c24694e tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:54.916196 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-190f7bf3-25f8-4686-ae96-aa760c24694e tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:54.916655 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-190f7bf3-25f8-4686-ae96-aa760c24694e tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:54.917072 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-190f7bf3-25f8-4686-ae96-aa760c24694e tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:55.131542 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-775c68e3-3f89-4e52-85a3-b730e789663d tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef890da37cc444380f1c373ffbf1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a584b724ab934dd59315d9c644f11cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:55.142596 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-775c68e3-3f89-4e52-85a3-b730e789663d tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] 10.222.0.79 "GET /compute/v2.1/servers/f5d52166-ed04-4313-8929-821bbae17f68" status: 200 len: 1290 microversion: 2.1 time: 0.464101 Oct 17 13:49:55.144002 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1751/3482] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:54 2022] GET /compute/v2.1/servers/f5d52166-ed04-4313-8929-821bbae17f68 => generated 1290 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:49:55.150293 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7b9d5ef4-1392-4603-bbc2-d8bc0c8fa4b6 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-696698168", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:49:55.221847 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-190f7bf3-25f8-4686-ae96-aa760c24694e tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:55.240606 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-190f7bf3-25f8-4686-ae96-aa760c24694e tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3" status: 200 len: 1511 microversion: 2.1 time: 0.352977 Oct 17 13:49:55.259402 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1732/3483] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:54 2022] GET /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3 => generated 1511 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:55.259665 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-7b9d5ef4-1392-4603-bbc2-d8bc0c8fa4b6 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] validate_networks() for None {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:49:55.747633 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=5 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:49:55.785760 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=10 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:49:55.951709 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-7b9d5ef4-1392-4603-bbc2-d8bc0c8fa4b6 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:49:55.952265 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-7b9d5ef4-1392-4603-bbc2-d8bc0c8fa4b6 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:49:55.953272 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-7b9d5ef4-1392-4603-bbc2-d8bc0c8fa4b6 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:49:55.953933 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-7b9d5ef4-1392-4603-bbc2-d8bc0c8fa4b6 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:49:55.957647 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-7b9d5ef4-1392-4603-bbc2-d8bc0c8fa4b6 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:49:55.976596 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7b9d5ef4-1392-4603-bbc2-d8bc0c8fa4b6 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:55.977089 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7b9d5ef4-1392-4603-bbc2-d8bc0c8fa4b6 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:55.977529 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7b9d5ef4-1392-4603-bbc2-d8bc0c8fa4b6 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:55.978293 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7b9d5ef4-1392-4603-bbc2-d8bc0c8fa4b6 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:55.979654 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7b9d5ef4-1392-4603-bbc2-d8bc0c8fa4b6 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:55.980099 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7b9d5ef4-1392-4603-bbc2-d8bc0c8fa4b6 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:56.006441 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-7b9d5ef4-1392-4603-bbc2-d8bc0c8fa4b6 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Getting quotas for project 5b98e3f377c14838a31cc430c98855e1. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:49:56.012527 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-7b9d5ef4-1392-4603-bbc2-d8bc0c8fa4b6 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Getting quotas for user 0906fe70cb054729bfb95b2196c1a5d3 and project 5b98e3f377c14838a31cc430c98855e1. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:49:56.029460 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7b9d5ef4-1392-4603-bbc2-d8bc0c8fa4b6 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:49:56.033404 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7b9d5ef4-1392-4603-bbc2-d8bc0c8fa4b6 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:49:56.124695 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7b9d5ef4-1392-4603-bbc2-d8bc0c8fa4b6 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.979271 Oct 17 13:49:56.125719 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1752/3484] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:49:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 981 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:49:56.137934 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a61eb214-ba77-4af8-870b-52b658b105ea tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:56.138559 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a61eb214-ba77-4af8-870b-52b658b105ea tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:56.149936 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:49:56.171934 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a44dee9c-97fe-4eb2-b6c9-7e0f00a24720 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:56.173488 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a44dee9c-97fe-4eb2-b6c9-7e0f00a24720 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] [instance: f5d52166-ed04-4313-8929-821bbae17f68] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:56.197672 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a44dee9c-97fe-4eb2-b6c9-7e0f00a24720 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:56.198938 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a44dee9c-97fe-4eb2-b6c9-7e0f00a24720 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:56.200052 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a44dee9c-97fe-4eb2-b6c9-7e0f00a24720 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:56.201010 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a44dee9c-97fe-4eb2-b6c9-7e0f00a24720 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:56.201691 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a44dee9c-97fe-4eb2-b6c9-7e0f00a24720 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:56.202342 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a44dee9c-97fe-4eb2-b6c9-7e0f00a24720 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:56.251326 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a61eb214-ba77-4af8-870b-52b658b105ea tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:56.260146 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a61eb214-ba77-4af8-870b-52b658b105ea tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b" status: 200 len: 1212 microversion: 2.1 time: 0.126491 Oct 17 13:49:56.261489 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1733/3485] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:56 2022] GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b => generated 1212 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:56.270828 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-95535b4e-65f9-49a5-8365-da4da3f6e78e tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:56.271962 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-95535b4e-65f9-49a5-8365-da4da3f6e78e tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 33de8199-8f00-40eb-9b95-b7ab5289dbe3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:56.280354 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-95535b4e-65f9-49a5-8365-da4da3f6e78e tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:56.281120 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-95535b4e-65f9-49a5-8365-da4da3f6e78e tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:56.281910 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-95535b4e-65f9-49a5-8365-da4da3f6e78e tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:56.282931 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-95535b4e-65f9-49a5-8365-da4da3f6e78e tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:56.283608 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-95535b4e-65f9-49a5-8365-da4da3f6e78e tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:56.284262 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-95535b4e-65f9-49a5-8365-da4da3f6e78e tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:56.512382 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a44dee9c-97fe-4eb2-b6c9-7e0f00a24720 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef890da37cc444380f1c373ffbf1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a584b724ab934dd59315d9c644f11cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:56.522795 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a44dee9c-97fe-4eb2-b6c9-7e0f00a24720 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] 10.222.0.79 "GET /compute/v2.1/servers/f5d52166-ed04-4313-8929-821bbae17f68" status: 200 len: 1290 microversion: 2.1 time: 0.354793 Oct 17 13:49:56.527932 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1753/3486] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:56 2022] GET /compute/v2.1/servers/f5d52166-ed04-4313-8929-821bbae17f68 => generated 1290 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:56.557003 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-95535b4e-65f9-49a5-8365-da4da3f6e78e tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:56.565693 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-95535b4e-65f9-49a5-8365-da4da3f6e78e tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3" status: 200 len: 1517 microversion: 2.1 time: 0.302748 Oct 17 13:49:56.566719 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1734/3487] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:56 2022] GET /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3 => generated 1517 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:49:56.909081 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-5a029b86-1b90-4aa3-b10d-ad45ecdf7da6 req-de83797f-ed72-4860-8b3b-1bea69572aee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1fb1718-c504-47dc-ab2e-28fe15d2c435", "name": "network-vif-plugged", "status": "completed", "tag": "391b5d37-7616-4b7e-974a-cd5f28f3eb9a"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:49:56.933651 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-5a029b86-1b90-4aa3-b10d-ad45ecdf7da6 req-de83797f-ed72-4860-8b3b-1bea69572aee service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:56.934138 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-5a029b86-1b90-4aa3-b10d-ad45ecdf7da6 req-de83797f-ed72-4860-8b3b-1bea69572aee service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:56.934570 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-5a029b86-1b90-4aa3-b10d-ad45ecdf7da6 req-de83797f-ed72-4860-8b3b-1bea69572aee service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:56.982887 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-5a029b86-1b90-4aa3-b10d-ad45ecdf7da6 req-de83797f-ed72-4860-8b3b-1bea69572aee service nova] Creating event network-vif-plugged:391b5d37-7616-4b7e-974a-cd5f28f3eb9a for instance e1fb1718-c504-47dc-ab2e-28fe15d2c435 on n-h1-854247-14 Oct 17 13:49:57.002050 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-5a029b86-1b90-4aa3-b10d-ad45ecdf7da6 req-de83797f-ed72-4860-8b3b-1bea69572aee service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096786 Oct 17 13:49:57.004968 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1754/3488] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:49:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:49:57.286426 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a273a6fd-80d9-4608-8d66-310e90f395dc tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:57.287957 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a273a6fd-80d9-4608-8d66-310e90f395dc tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:57.309877 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a273a6fd-80d9-4608-8d66-310e90f395dc tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:57.310608 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a273a6fd-80d9-4608-8d66-310e90f395dc tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:57.312077 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a273a6fd-80d9-4608-8d66-310e90f395dc tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:57.316641 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a273a6fd-80d9-4608-8d66-310e90f395dc tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:57.317332 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a273a6fd-80d9-4608-8d66-310e90f395dc tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:57.320053 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a273a6fd-80d9-4608-8d66-310e90f395dc tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:57.490225 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a273a6fd-80d9-4608-8d66-310e90f395dc tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:57.504313 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a273a6fd-80d9-4608-8d66-310e90f395dc tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b" status: 200 len: 1264 microversion: 2.1 time: 0.219173 Oct 17 13:49:57.505562 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1735/3489] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:57 2022] GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b => generated 1264 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:57.560830 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-12961a68-3385-4b8c-89e3-80a52844a46e tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:57.565033 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-12961a68-3385-4b8c-89e3-80a52844a46e tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] [instance: f5d52166-ed04-4313-8929-821bbae17f68] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:57.581420 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-12961a68-3385-4b8c-89e3-80a52844a46e tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:57.581962 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-12961a68-3385-4b8c-89e3-80a52844a46e tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:57.586658 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-12961a68-3385-4b8c-89e3-80a52844a46e tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:57.587689 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-12961a68-3385-4b8c-89e3-80a52844a46e tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:57.588117 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-12961a68-3385-4b8c-89e3-80a52844a46e tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:57.588641 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-12961a68-3385-4b8c-89e3-80a52844a46e tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:57.894997 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-12961a68-3385-4b8c-89e3-80a52844a46e tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef890da37cc444380f1c373ffbf1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a584b724ab934dd59315d9c644f11cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:57.904683 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-12961a68-3385-4b8c-89e3-80a52844a46e tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] 10.222.0.79 "GET /compute/v2.1/servers/f5d52166-ed04-4313-8929-821bbae17f68" status: 200 len: 1290 microversion: 2.1 time: 0.354903 Oct 17 13:49:57.909940 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1755/3490] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:57 2022] GET /compute/v2.1/servers/f5d52166-ed04-4313-8929-821bbae17f68 => generated 1290 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:58.532991 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3220fb76-bc08-409f-80a3-c18f1c956121 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:58.533622 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3220fb76-bc08-409f-80a3-c18f1c956121 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:58.553945 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3220fb76-bc08-409f-80a3-c18f1c956121 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:58.554435 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3220fb76-bc08-409f-80a3-c18f1c956121 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:58.554870 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3220fb76-bc08-409f-80a3-c18f1c956121 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:58.555589 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3220fb76-bc08-409f-80a3-c18f1c956121 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:58.556031 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3220fb76-bc08-409f-80a3-c18f1c956121 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:58.556441 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3220fb76-bc08-409f-80a3-c18f1c956121 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:58.662820 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3220fb76-bc08-409f-80a3-c18f1c956121 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:58.676153 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3220fb76-bc08-409f-80a3-c18f1c956121 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b" status: 200 len: 1270 microversion: 2.1 time: 0.146964 Oct 17 13:49:58.677331 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1736/3491] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:58 2022] GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b => generated 1270 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:58.935327 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-73d11807-7bce-4111-be59-c152dea6d619 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:58.937010 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-73d11807-7bce-4111-be59-c152dea6d619 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] [instance: f5d52166-ed04-4313-8929-821bbae17f68] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:58.951738 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-73d11807-7bce-4111-be59-c152dea6d619 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:58.952256 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-73d11807-7bce-4111-be59-c152dea6d619 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:58.952682 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-73d11807-7bce-4111-be59-c152dea6d619 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:58.959647 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-73d11807-7bce-4111-be59-c152dea6d619 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:58.960633 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-73d11807-7bce-4111-be59-c152dea6d619 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:58.961243 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-73d11807-7bce-4111-be59-c152dea6d619 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:59.351942 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-73d11807-7bce-4111-be59-c152dea6d619 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef890da37cc444380f1c373ffbf1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a584b724ab934dd59315d9c644f11cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:59.363112 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-73d11807-7bce-4111-be59-c152dea6d619 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] 10.222.0.79 "GET /compute/v2.1/servers/f5d52166-ed04-4313-8929-821bbae17f68" status: 200 len: 1290 microversion: 2.1 time: 0.432259 Oct 17 13:49:59.377225 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1756/3492] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:58 2022] GET /compute/v2.1/servers/f5d52166-ed04-4313-8929-821bbae17f68 => generated 1290 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:59.381776 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-14d3e048-9b62-45be-bd58-5bf85ee6ce70 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Action: 'create', calling method: .version_select at 0x7f7cd48c7280>, body: {"keypair": {"name": "tempest-keypair-235574990", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJu7V/4vhCxNItins73wezbX4lYRyK7dJf0FMN8OL0SdukrGq6YBC/7Ex9W+Hm1pOu1pi9b1TW5q/nnjIK8mhaxsVeAo2tunCfieOKIlqF1SKUd1uTVSH9qrNgVWVtrIIg=="}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:49:59.419900 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-14d3e048-9b62-45be-bd58-5bf85ee6ce70 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Getting quotas for project 08068aeba86c4e718ba1e25c68fd3259. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:49:59.430917 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-14d3e048-9b62-45be-bd58-5bf85ee6ce70 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Getting quotas for user d56b91ce42894bafac5ddb16ad6f037b and project 08068aeba86c4e718ba1e25c68fd3259. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:49:59.480117 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-14d3e048-9b62-45be-bd58-5bf85ee6ce70 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.114737 Oct 17 13:49:59.486793 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1737/3493] 10.222.0.79 () {60 vars in 1159 bytes} [Mon Oct 17 13:49:59 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:49:59.704895 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f11f0871-0a99-43fd-986f-57360ae2a76b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:59.706243 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f11f0871-0a99-43fd-986f-57360ae2a76b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:59.714188 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f11f0871-0a99-43fd-986f-57360ae2a76b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:59.715353 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f11f0871-0a99-43fd-986f-57360ae2a76b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:59.716141 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f11f0871-0a99-43fd-986f-57360ae2a76b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:59.717082 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f11f0871-0a99-43fd-986f-57360ae2a76b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:59.717760 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f11f0871-0a99-43fd-986f-57360ae2a76b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:59.718716 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f11f0871-0a99-43fd-986f-57360ae2a76b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:00.026727 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f11f0871-0a99-43fd-986f-57360ae2a76b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:00.044449 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f11f0871-0a99-43fd-986f-57360ae2a76b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b" status: 200 len: 1312 microversion: 2.1 time: 0.346732 Oct 17 13:50:00.052246 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1757/3494] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:59 2022] GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b => generated 1312 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:00.280718 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-52b9976f-a41a-400d-8488-4f9c91fddcee req-fb2e5885-3a92-472f-8d98-d8d3f09dc465 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50464f17-c798-4c70-b1c9-0f90c55def6b", "tag": "cb1b920d-1ee0-48dd-ade7-68e1d575df70"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:50:00.301574 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-52b9976f-a41a-400d-8488-4f9c91fddcee req-fb2e5885-3a92-472f-8d98-d8d3f09dc465 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:00.303046 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-52b9976f-a41a-400d-8488-4f9c91fddcee req-fb2e5885-3a92-472f-8d98-d8d3f09dc465 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:00.303899 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-52b9976f-a41a-400d-8488-4f9c91fddcee req-fb2e5885-3a92-472f-8d98-d8d3f09dc465 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:00.320201 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-52b9976f-a41a-400d-8488-4f9c91fddcee req-fb2e5885-3a92-472f-8d98-d8d3f09dc465 service nova] Creating event network-changed:cb1b920d-1ee0-48dd-ade7-68e1d575df70 for instance 50464f17-c798-4c70-b1c9-0f90c55def6b on n-h2-854247-14 Oct 17 13:50:00.326244 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-52b9976f-a41a-400d-8488-4f9c91fddcee req-fb2e5885-3a92-472f-8d98-d8d3f09dc465 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062723 Oct 17 13:50:00.327663 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1738/3495] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:50:00.389093 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-bcb8e1d9-cffb-4b3b-b8c1-49fbff78f534 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:00.389694 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-bcb8e1d9-cffb-4b3b-b8c1-49fbff78f534 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] [instance: f5d52166-ed04-4313-8929-821bbae17f68] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:00.397917 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bcb8e1d9-cffb-4b3b-b8c1-49fbff78f534 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:00.398809 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bcb8e1d9-cffb-4b3b-b8c1-49fbff78f534 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:00.399490 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bcb8e1d9-cffb-4b3b-b8c1-49fbff78f534 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:00.400453 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bcb8e1d9-cffb-4b3b-b8c1-49fbff78f534 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:00.401165 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bcb8e1d9-cffb-4b3b-b8c1-49fbff78f534 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:00.401809 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bcb8e1d9-cffb-4b3b-b8c1-49fbff78f534 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:00.727014 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-bcb8e1d9-cffb-4b3b-b8c1-49fbff78f534 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef890da37cc444380f1c373ffbf1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a584b724ab934dd59315d9c644f11cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:00.740364 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-bcb8e1d9-cffb-4b3b-b8c1-49fbff78f534 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] 10.222.0.79 "GET /compute/v2.1/servers/f5d52166-ed04-4313-8929-821bbae17f68" status: 200 len: 1290 microversion: 2.1 time: 0.354247 Oct 17 13:50:00.741880 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1758/3496] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:00 2022] GET /compute/v2.1/servers/f5d52166-ed04-4313-8929-821bbae17f68 => generated 1290 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:01.076519 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-cba93cbc-3bef-4089-9bce-758b03f353cb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:01.077244 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-cba93cbc-3bef-4089-9bce-758b03f353cb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:01.090134 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cba93cbc-3bef-4089-9bce-758b03f353cb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:01.090550 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cba93cbc-3bef-4089-9bce-758b03f353cb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:01.091027 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cba93cbc-3bef-4089-9bce-758b03f353cb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:01.091770 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cba93cbc-3bef-4089-9bce-758b03f353cb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:01.092223 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cba93cbc-3bef-4089-9bce-758b03f353cb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:01.092644 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cba93cbc-3bef-4089-9bce-758b03f353cb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:01.404714 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-cba93cbc-3bef-4089-9bce-758b03f353cb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:01.425128 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-cba93cbc-3bef-4089-9bce-758b03f353cb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b" status: 200 len: 1312 microversion: 2.1 time: 0.354395 Oct 17 13:50:01.426284 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1739/3497] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:01 2022] GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b => generated 1312 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:01.765041 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-42609379-4e3b-4c69-9598-0616de6fe3fe tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:01.765657 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-42609379-4e3b-4c69-9598-0616de6fe3fe tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] [instance: f5d52166-ed04-4313-8929-821bbae17f68] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:01.774415 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-42609379-4e3b-4c69-9598-0616de6fe3fe tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:01.774903 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-42609379-4e3b-4c69-9598-0616de6fe3fe tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:01.775380 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-42609379-4e3b-4c69-9598-0616de6fe3fe tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:01.776072 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-42609379-4e3b-4c69-9598-0616de6fe3fe tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:01.776523 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-42609379-4e3b-4c69-9598-0616de6fe3fe tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:01.776971 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-42609379-4e3b-4c69-9598-0616de6fe3fe tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:01.965572 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-42609379-4e3b-4c69-9598-0616de6fe3fe tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef890da37cc444380f1c373ffbf1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a584b724ab934dd59315d9c644f11cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:01.973989 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-42609379-4e3b-4c69-9598-0616de6fe3fe tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] 10.222.0.79 "GET /compute/v2.1/servers/f5d52166-ed04-4313-8929-821bbae17f68" status: 200 len: 1290 microversion: 2.1 time: 0.213087 Oct 17 13:50:01.986169 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1759/3498] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:01 2022] GET /compute/v2.1/servers/f5d52166-ed04-4313-8929-821bbae17f68 => generated 1290 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:02.025442 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7d089c1d-148c-4562-ac21-e209c8d67998 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-462534506", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e17fb768-1158-4dd6-8430-46ce854c7d98"}], "security_groups": [{"name": "tempest-securitygroup--810928100"}], "key_name": "tempest-keypair-235574990", "user_data": "}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:50:02.147500 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5ca96b8f-da2f-41ca-a26a-b1a102a0a570 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:50:02.157944 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5ca96b8f-da2f-41ca-a26a-b1a102a0a570 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:02.158433 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5ca96b8f-da2f-41ca-a26a-b1a102a0a570 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:02.158864 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5ca96b8f-da2f-41ca-a26a-b1a102a0a570 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:02.182265 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-7d089c1d-148c-4562-ac21-e209c8d67998 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] validate_networks() for [('e17fb768-1158-4dd6-8430-46ce854c7d98', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:50:02.194824 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5ca96b8f-da2f-41ca-a26a-b1a102a0a570 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: a2994495-366a-446f-b7a6-16340911e17c] Going to try to stop instance {{(pid=127016) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 17 13:50:02.259718 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5ca96b8f-da2f-41ca-a26a-b1a102a0a570 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "POST /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c/action" status: 202 len: 0 microversion: 2.1 time: 0.115938 Oct 17 13:50:02.260993 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1760/3499] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:50:02 2022] POST /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:50:02.273444 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-06ac9959-a5df-4fe2-bac6-53e5b4656fea tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:02.274384 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-06ac9959-a5df-4fe2-bac6-53e5b4656fea tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: a2994495-366a-446f-b7a6-16340911e17c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:02.284642 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-06ac9959-a5df-4fe2-bac6-53e5b4656fea tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:02.285515 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-06ac9959-a5df-4fe2-bac6-53e5b4656fea tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:02.286332 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-06ac9959-a5df-4fe2-bac6-53e5b4656fea tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:02.287321 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-06ac9959-a5df-4fe2-bac6-53e5b4656fea tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:02.287916 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-06ac9959-a5df-4fe2-bac6-53e5b4656fea tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:02.288498 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-06ac9959-a5df-4fe2-bac6-53e5b4656fea tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:02.577106 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-06ac9959-a5df-4fe2-bac6-53e5b4656fea tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683d18db860a4d60ab3eeba2a372b2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11973b8e1d8a4af8add65726e8ba7c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:02.588383 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-06ac9959-a5df-4fe2-bac6-53e5b4656fea tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c" status: 200 len: 1674 microversion: 2.1 time: 0.323134 Oct 17 13:50:02.589639 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1761/3500] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:02 2022] GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c => generated 1674 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:50:02.594769 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8757182c-38e4-41f0-9d6a-57263232c5c4 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:02.595691 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8757182c-38e4-41f0-9d6a-57263232c5c4 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:02.602402 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8757182c-38e4-41f0-9d6a-57263232c5c4 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:02.602887 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8757182c-38e4-41f0-9d6a-57263232c5c4 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:02.603375 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8757182c-38e4-41f0-9d6a-57263232c5c4 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:02.604281 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8757182c-38e4-41f0-9d6a-57263232c5c4 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:02.604729 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8757182c-38e4-41f0-9d6a-57263232c5c4 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:02.605236 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8757182c-38e4-41f0-9d6a-57263232c5c4 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:02.621660 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:50:02.903037 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8757182c-38e4-41f0-9d6a-57263232c5c4 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:02.918660 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8757182c-38e4-41f0-9d6a-57263232c5c4 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b" status: 200 len: 1312 microversion: 2.1 time: 0.327576 Oct 17 13:50:02.921071 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1762/3501] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:02 2022] GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b => generated 1312 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:02.997937 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4ed3a6e6-245e-48ca-8468-83d65fbcc616 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:02.999024 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4ed3a6e6-245e-48ca-8468-83d65fbcc616 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] [instance: f5d52166-ed04-4313-8929-821bbae17f68] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:03.006293 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4ed3a6e6-245e-48ca-8468-83d65fbcc616 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:03.007158 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4ed3a6e6-245e-48ca-8468-83d65fbcc616 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:03.008306 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4ed3a6e6-245e-48ca-8468-83d65fbcc616 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:03.009458 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4ed3a6e6-245e-48ca-8468-83d65fbcc616 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:03.010080 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4ed3a6e6-245e-48ca-8468-83d65fbcc616 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:03.010673 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4ed3a6e6-245e-48ca-8468-83d65fbcc616 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:03.456631 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-7d089c1d-148c-4562-ac21-e209c8d67998 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:50:03.457440 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-7d089c1d-148c-4562-ac21-e209c8d67998 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:50:03.458021 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-7d089c1d-148c-4562-ac21-e209c8d67998 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:50:03.458705 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-7d089c1d-148c-4562-ac21-e209c8d67998 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:50:03.459270 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-7d089c1d-148c-4562-ac21-e209c8d67998 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:50:03.469033 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7d089c1d-148c-4562-ac21-e209c8d67998 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:03.469869 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7d089c1d-148c-4562-ac21-e209c8d67998 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:03.470420 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7d089c1d-148c-4562-ac21-e209c8d67998 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:03.471269 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7d089c1d-148c-4562-ac21-e209c8d67998 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:03.472015 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7d089c1d-148c-4562-ac21-e209c8d67998 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:03.472515 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7d089c1d-148c-4562-ac21-e209c8d67998 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:03.502510 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-7d089c1d-148c-4562-ac21-e209c8d67998 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Getting quotas for project 08068aeba86c4e718ba1e25c68fd3259. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:50:03.511712 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-7d089c1d-148c-4562-ac21-e209c8d67998 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Getting quotas for user d56b91ce42894bafac5ddb16ad6f037b and project 08068aeba86c4e718ba1e25c68fd3259. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:50:03.531978 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7d089c1d-148c-4562-ac21-e209c8d67998 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:50:03.536215 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4ed3a6e6-245e-48ca-8468-83d65fbcc616 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef890da37cc444380f1c373ffbf1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a584b724ab934dd59315d9c644f11cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:03.536879 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7d089c1d-148c-4562-ac21-e209c8d67998 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 3197da72-e924-4f50-8c93-c3f3ff98e084] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:50:03.546104 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4ed3a6e6-245e-48ca-8468-83d65fbcc616 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] 10.222.0.79 "GET /compute/v2.1/servers/f5d52166-ed04-4313-8929-821bbae17f68" status: 200 len: 1290 microversion: 2.1 time: 0.552296 Oct 17 13:50:03.547752 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1763/3502] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:02 2022] GET /compute/v2.1/servers/f5d52166-ed04-4313-8929-821bbae17f68 => generated 1290 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:50:03.589654 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7d089c1d-148c-4562-ac21-e209c8d67998 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.569071 Oct 17 13:50:03.596832 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1740/3503] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:50:02 2022] POST /compute/v2.1/servers => generated 408 bytes in 1577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:50:03.602106 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9a211985-2808-460a-b42b-a92acedc3e42 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:03.603953 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9a211985-2808-460a-b42b-a92acedc3e42 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 3197da72-e924-4f50-8c93-c3f3ff98e084] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:03.614126 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b34ee872-5034-46dd-bb11-b48f51eb01a5 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:03.614741 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b34ee872-5034-46dd-bb11-b48f51eb01a5 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: a2994495-366a-446f-b7a6-16340911e17c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:03.624368 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b34ee872-5034-46dd-bb11-b48f51eb01a5 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:03.624860 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b34ee872-5034-46dd-bb11-b48f51eb01a5 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:03.625646 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b34ee872-5034-46dd-bb11-b48f51eb01a5 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:03.626009 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b34ee872-5034-46dd-bb11-b48f51eb01a5 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:03.636527 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b34ee872-5034-46dd-bb11-b48f51eb01a5 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:03.636992 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b34ee872-5034-46dd-bb11-b48f51eb01a5 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:03.680472 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9a211985-2808-460a-b42b-a92acedc3e42 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:03.688386 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9a211985-2808-460a-b42b-a92acedc3e42 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084" status: 200 len: 1244 microversion: 2.1 time: 0.090144 Oct 17 13:50:03.689284 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1764/3504] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:03 2022] GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084 => generated 1244 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:03.792444 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b34ee872-5034-46dd-bb11-b48f51eb01a5 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683d18db860a4d60ab3eeba2a372b2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11973b8e1d8a4af8add65726e8ba7c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:03.801329 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b34ee872-5034-46dd-bb11-b48f51eb01a5 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c" status: 200 len: 1674 microversion: 2.1 time: 0.190865 Oct 17 13:50:03.804779 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1741/3505] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:03 2022] GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c => generated 1674 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:50:03.945542 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1303ff18-4c96-4ba7-9a36-fcfaa322b2ff tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:03.947048 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-1303ff18-4c96-4ba7-9a36-fcfaa322b2ff tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:03.955250 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1303ff18-4c96-4ba7-9a36-fcfaa322b2ff tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:03.955773 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1303ff18-4c96-4ba7-9a36-fcfaa322b2ff tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:03.956318 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1303ff18-4c96-4ba7-9a36-fcfaa322b2ff tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:03.957166 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1303ff18-4c96-4ba7-9a36-fcfaa322b2ff tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:03.957705 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1303ff18-4c96-4ba7-9a36-fcfaa322b2ff tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:03.958339 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1303ff18-4c96-4ba7-9a36-fcfaa322b2ff tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:04.103643 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-1303ff18-4c96-4ba7-9a36-fcfaa322b2ff tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:04.112618 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1303ff18-4c96-4ba7-9a36-fcfaa322b2ff tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b" status: 200 len: 1312 microversion: 2.1 time: 0.172000 Oct 17 13:50:04.114063 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1765/3506] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:03 2022] GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b => generated 1312 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:04.570086 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e011ce63-e208-4ce1-956f-8350233933fa tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:04.571582 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e011ce63-e208-4ce1-956f-8350233933fa tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] [instance: f5d52166-ed04-4313-8929-821bbae17f68] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:04.580529 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e011ce63-e208-4ce1-956f-8350233933fa tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:04.581147 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e011ce63-e208-4ce1-956f-8350233933fa tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:04.581923 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e011ce63-e208-4ce1-956f-8350233933fa tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:04.582937 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e011ce63-e208-4ce1-956f-8350233933fa tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:04.583957 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e011ce63-e208-4ce1-956f-8350233933fa tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:04.583957 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e011ce63-e208-4ce1-956f-8350233933fa tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:04.715935 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1f0e4911-ec5f-4498-a0fd-5e05f125bd2a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:04.716859 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-1f0e4911-ec5f-4498-a0fd-5e05f125bd2a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 3197da72-e924-4f50-8c93-c3f3ff98e084] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:04.723774 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1f0e4911-ec5f-4498-a0fd-5e05f125bd2a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:04.724579 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1f0e4911-ec5f-4498-a0fd-5e05f125bd2a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:04.725205 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1f0e4911-ec5f-4498-a0fd-5e05f125bd2a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:04.725918 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1f0e4911-ec5f-4498-a0fd-5e05f125bd2a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:04.726535 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1f0e4911-ec5f-4498-a0fd-5e05f125bd2a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:04.727119 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1f0e4911-ec5f-4498-a0fd-5e05f125bd2a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:04.829107 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-1f0e4911-ec5f-4498-a0fd-5e05f125bd2a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:04.838179 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1f0e4911-ec5f-4498-a0fd-5e05f125bd2a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084" status: 200 len: 1296 microversion: 2.1 time: 0.126874 Oct 17 13:50:04.838784 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1766/3507] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:04 2022] GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084 => generated 1296 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:50:04.843996 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-bfbcab30-b553-4cf5-b87c-e7f6cbbb95f6 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:04.844963 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-bfbcab30-b553-4cf5-b87c-e7f6cbbb95f6 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: a2994495-366a-446f-b7a6-16340911e17c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:04.851503 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bfbcab30-b553-4cf5-b87c-e7f6cbbb95f6 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:04.852240 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bfbcab30-b553-4cf5-b87c-e7f6cbbb95f6 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:04.852829 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bfbcab30-b553-4cf5-b87c-e7f6cbbb95f6 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:04.853917 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bfbcab30-b553-4cf5-b87c-e7f6cbbb95f6 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:04.854524 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bfbcab30-b553-4cf5-b87c-e7f6cbbb95f6 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:04.855256 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bfbcab30-b553-4cf5-b87c-e7f6cbbb95f6 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:04.870774 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e011ce63-e208-4ce1-956f-8350233933fa tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef890da37cc444380f1c373ffbf1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a584b724ab934dd59315d9c644f11cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:04.883770 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e011ce63-e208-4ce1-956f-8350233933fa tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] 10.222.0.79 "GET /compute/v2.1/servers/f5d52166-ed04-4313-8929-821bbae17f68" status: 200 len: 1290 microversion: 2.1 time: 0.319294 Oct 17 13:50:04.884631 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1742/3508] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:04 2022] GET /compute/v2.1/servers/f5d52166-ed04-4313-8929-821bbae17f68 => generated 1290 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:05.089933 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-b80f3752-3714-4dcc-a610-1a6ddac0a6ca req-6417418b-e91c-4aea-885c-130fe1bf69db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5d52166-ed04-4313-8929-821bbae17f68", "name": "network-vif-plugged", "status": "completed", "tag": "8d25e9b2-a5d2-482c-9ca9-2f5cb2363bea"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:50:05.107715 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-b80f3752-3714-4dcc-a610-1a6ddac0a6ca req-6417418b-e91c-4aea-885c-130fe1bf69db service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:05.110286 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-b80f3752-3714-4dcc-a610-1a6ddac0a6ca req-6417418b-e91c-4aea-885c-130fe1bf69db service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:05.112745 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-b80f3752-3714-4dcc-a610-1a6ddac0a6ca req-6417418b-e91c-4aea-885c-130fe1bf69db service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:05.138850 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-b80f3752-3714-4dcc-a610-1a6ddac0a6ca req-6417418b-e91c-4aea-885c-130fe1bf69db service nova] Creating event network-vif-plugged:8d25e9b2-a5d2-482c-9ca9-2f5cb2363bea for instance f5d52166-ed04-4313-8929-821bbae17f68 on n-h1-854247-14 Oct 17 13:50:05.149307 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-b80f3752-3714-4dcc-a610-1a6ddac0a6ca req-6417418b-e91c-4aea-885c-130fe1bf69db service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063125 Oct 17 13:50:05.151395 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1743/3509] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:50:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:50:05.162070 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9a5b89de-5207-47fc-bf62-9396e17a3224 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:05.164420 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9a5b89de-5207-47fc-bf62-9396e17a3224 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:05.173307 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9a5b89de-5207-47fc-bf62-9396e17a3224 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:05.174182 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9a5b89de-5207-47fc-bf62-9396e17a3224 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:05.174844 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9a5b89de-5207-47fc-bf62-9396e17a3224 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:05.177202 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9a5b89de-5207-47fc-bf62-9396e17a3224 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:05.177928 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9a5b89de-5207-47fc-bf62-9396e17a3224 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:05.179313 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9a5b89de-5207-47fc-bf62-9396e17a3224 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:05.459607 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-bfbcab30-b553-4cf5-b87c-e7f6cbbb95f6 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683d18db860a4d60ab3eeba2a372b2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11973b8e1d8a4af8add65726e8ba7c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:05.468505 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-bfbcab30-b553-4cf5-b87c-e7f6cbbb95f6 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c" status: 200 len: 1674 microversion: 2.1 time: 0.628003 Oct 17 13:50:05.469175 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1767/3510] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:04 2022] GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c => generated 1674 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:05.575217 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9a5b89de-5207-47fc-bf62-9396e17a3224 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:05.584932 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9a5b89de-5207-47fc-bf62-9396e17a3224 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b" status: 200 len: 1312 microversion: 2.1 time: 0.430934 Oct 17 13:50:05.585568 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1744/3511] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:05 2022] GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b => generated 1312 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:05.863404 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8d65f3a3-38ce-4eb0-b5ac-b8a3faac50eb tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:05.863925 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8d65f3a3-38ce-4eb0-b5ac-b8a3faac50eb tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 3197da72-e924-4f50-8c93-c3f3ff98e084] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:05.876977 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8d65f3a3-38ce-4eb0-b5ac-b8a3faac50eb tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:05.879923 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8d65f3a3-38ce-4eb0-b5ac-b8a3faac50eb tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:05.899738 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8d65f3a3-38ce-4eb0-b5ac-b8a3faac50eb tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:05.900956 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8d65f3a3-38ce-4eb0-b5ac-b8a3faac50eb tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:05.901775 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8d65f3a3-38ce-4eb0-b5ac-b8a3faac50eb tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:05.902197 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8d65f3a3-38ce-4eb0-b5ac-b8a3faac50eb tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:05.916180 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b70f77d4-1829-4ea3-a2e4-7fe8f8bb4499 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:05.916794 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b70f77d4-1829-4ea3-a2e4-7fe8f8bb4499 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] [instance: f5d52166-ed04-4313-8929-821bbae17f68] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:05.923745 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b70f77d4-1829-4ea3-a2e4-7fe8f8bb4499 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:05.924227 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b70f77d4-1829-4ea3-a2e4-7fe8f8bb4499 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:05.925049 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b70f77d4-1829-4ea3-a2e4-7fe8f8bb4499 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:05.926002 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b70f77d4-1829-4ea3-a2e4-7fe8f8bb4499 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:05.927079 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b70f77d4-1829-4ea3-a2e4-7fe8f8bb4499 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:05.931391 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b70f77d4-1829-4ea3-a2e4-7fe8f8bb4499 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:05.961881 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:50:05.996745 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:50:06.116772 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8d65f3a3-38ce-4eb0-b5ac-b8a3faac50eb tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:06.127399 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8d65f3a3-38ce-4eb0-b5ac-b8a3faac50eb tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084" status: 200 len: 1302 microversion: 2.1 time: 0.268357 Oct 17 13:50:06.127915 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1768/3512] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:05 2022] GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084 => generated 1302 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:06.321947 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b70f77d4-1829-4ea3-a2e4-7fe8f8bb4499 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef890da37cc444380f1c373ffbf1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a584b724ab934dd59315d9c644f11cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:06.339002 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b70f77d4-1829-4ea3-a2e4-7fe8f8bb4499 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] 10.222.0.79 "GET /compute/v2.1/servers/f5d52166-ed04-4313-8929-821bbae17f68" status: 200 len: 1290 microversion: 2.1 time: 0.433865 Oct 17 13:50:06.340672 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1745/3513] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:05 2022] GET /compute/v2.1/servers/f5d52166-ed04-4313-8929-821bbae17f68 => generated 1290 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:06.492605 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fcf3751d-6df2-464a-a4aa-409b0e297558 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:06.493981 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-fcf3751d-6df2-464a-a4aa-409b0e297558 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: a2994495-366a-446f-b7a6-16340911e17c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:06.515187 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fcf3751d-6df2-464a-a4aa-409b0e297558 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:06.515689 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fcf3751d-6df2-464a-a4aa-409b0e297558 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:06.517255 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fcf3751d-6df2-464a-a4aa-409b0e297558 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:06.518149 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fcf3751d-6df2-464a-a4aa-409b0e297558 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:06.518763 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fcf3751d-6df2-464a-a4aa-409b0e297558 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:06.519844 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fcf3751d-6df2-464a-a4aa-409b0e297558 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:06.610887 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-13d262f4-23df-4a6b-a93b-9d2fe3e0a0d4 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:06.611716 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-13d262f4-23df-4a6b-a93b-9d2fe3e0a0d4 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:06.614813 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:50:06.624227 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-13d262f4-23df-4a6b-a93b-9d2fe3e0a0d4 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:06.624830 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-13d262f4-23df-4a6b-a93b-9d2fe3e0a0d4 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:06.625278 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-13d262f4-23df-4a6b-a93b-9d2fe3e0a0d4 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:06.626054 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-13d262f4-23df-4a6b-a93b-9d2fe3e0a0d4 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:06.626473 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-13d262f4-23df-4a6b-a93b-9d2fe3e0a0d4 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:06.626893 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-13d262f4-23df-4a6b-a93b-9d2fe3e0a0d4 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:07.210847 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fcf3751d-6df2-464a-a4aa-409b0e297558 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683d18db860a4d60ab3eeba2a372b2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11973b8e1d8a4af8add65726e8ba7c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:07.222537 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fcf3751d-6df2-464a-a4aa-409b0e297558 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c" status: 200 len: 1674 microversion: 2.1 time: 0.733689 Oct 17 13:50:07.223570 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1769/3514] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:06 2022] GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c => generated 1674 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:07.247039 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-50372e5b-341e-4a9a-8157-73e4b35fe3f6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:07.247755 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-50372e5b-341e-4a9a-8157-73e4b35fe3f6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 3197da72-e924-4f50-8c93-c3f3ff98e084] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:07.254894 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-50372e5b-341e-4a9a-8157-73e4b35fe3f6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:07.255415 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-50372e5b-341e-4a9a-8157-73e4b35fe3f6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:07.256072 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-50372e5b-341e-4a9a-8157-73e4b35fe3f6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:07.256726 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-50372e5b-341e-4a9a-8157-73e4b35fe3f6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:07.257288 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-50372e5b-341e-4a9a-8157-73e4b35fe3f6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:07.257777 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-50372e5b-341e-4a9a-8157-73e4b35fe3f6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:07.341538 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-13d262f4-23df-4a6b-a93b-9d2fe3e0a0d4 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:07.350836 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-13d262f4-23df-4a6b-a93b-9d2fe3e0a0d4 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b" status: 200 len: 1312 microversion: 2.1 time: 0.745463 Oct 17 13:50:07.351780 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1746/3515] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:06 2022] GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b => generated 1312 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:50:07.356538 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-6410bc8f-0ee6-4b0e-bc1f-d9de709ddd43 req-3939e16c-e239-4dd5-b0af-28b5ca6fdfd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50464f17-c798-4c70-b1c9-0f90c55def6b", "name": "network-vif-plugged", "status": "completed", "tag": "cb1b920d-1ee0-48dd-ade7-68e1d575df70"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:50:07.368392 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-6410bc8f-0ee6-4b0e-bc1f-d9de709ddd43 req-3939e16c-e239-4dd5-b0af-28b5ca6fdfd9 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:07.368907 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-6410bc8f-0ee6-4b0e-bc1f-d9de709ddd43 req-3939e16c-e239-4dd5-b0af-28b5ca6fdfd9 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:07.369857 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-6410bc8f-0ee6-4b0e-bc1f-d9de709ddd43 req-3939e16c-e239-4dd5-b0af-28b5ca6fdfd9 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:07.395117 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-6410bc8f-0ee6-4b0e-bc1f-d9de709ddd43 req-3939e16c-e239-4dd5-b0af-28b5ca6fdfd9 service nova] Creating event network-vif-plugged:cb1b920d-1ee0-48dd-ade7-68e1d575df70 for instance 50464f17-c798-4c70-b1c9-0f90c55def6b on n-h2-854247-14 Oct 17 13:50:07.402355 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-6410bc8f-0ee6-4b0e-bc1f-d9de709ddd43 req-3939e16c-e239-4dd5-b0af-28b5ca6fdfd9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048615 Oct 17 13:50:07.403028 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1747/3516] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:50:07.408781 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-08fa5af0-126b-41d1-bee0-c6fc7cb11f9b tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:07.410220 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-08fa5af0-126b-41d1-bee0-c6fc7cb11f9b tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] [instance: f5d52166-ed04-4313-8929-821bbae17f68] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:07.419849 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-08fa5af0-126b-41d1-bee0-c6fc7cb11f9b tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:07.421496 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-08fa5af0-126b-41d1-bee0-c6fc7cb11f9b tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:07.422151 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-08fa5af0-126b-41d1-bee0-c6fc7cb11f9b tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:07.423125 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-08fa5af0-126b-41d1-bee0-c6fc7cb11f9b tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:07.423732 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-08fa5af0-126b-41d1-bee0-c6fc7cb11f9b tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:07.424364 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-08fa5af0-126b-41d1-bee0-c6fc7cb11f9b tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:07.759111 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-50372e5b-341e-4a9a-8157-73e4b35fe3f6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:07.769561 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-50372e5b-341e-4a9a-8157-73e4b35fe3f6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084" status: 200 len: 1369 microversion: 2.1 time: 0.527598 Oct 17 13:50:07.770398 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1770/3517] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:07 2022] GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084 => generated 1369 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:07.869376 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-08fa5af0-126b-41d1-bee0-c6fc7cb11f9b tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef890da37cc444380f1c373ffbf1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a584b724ab934dd59315d9c644f11cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:07.877914 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-08fa5af0-126b-41d1-bee0-c6fc7cb11f9b tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] 10.222.0.79 "GET /compute/v2.1/servers/f5d52166-ed04-4313-8929-821bbae17f68" status: 200 len: 1481 microversion: 2.1 time: 0.473491 Oct 17 13:50:07.878668 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1748/3518] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:07 2022] GET /compute/v2.1/servers/f5d52166-ed04-4313-8929-821bbae17f68 => generated 1481 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:07.904432 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c962ce02-8014-473b-8ee0-45877f7728c9 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:07.905117 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c962ce02-8014-473b-8ee0-45877f7728c9 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] [instance: f5d52166-ed04-4313-8929-821bbae17f68] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:07.912758 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c962ce02-8014-473b-8ee0-45877f7728c9 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:07.913293 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c962ce02-8014-473b-8ee0-45877f7728c9 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:07.913810 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c962ce02-8014-473b-8ee0-45877f7728c9 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:07.914764 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c962ce02-8014-473b-8ee0-45877f7728c9 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:07.915398 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c962ce02-8014-473b-8ee0-45877f7728c9 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:07.916168 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c962ce02-8014-473b-8ee0-45877f7728c9 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:08.098074 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c962ce02-8014-473b-8ee0-45877f7728c9 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] 10.222.0.79 "GET /compute/v2.1/servers/f5d52166-ed04-4313-8929-821bbae17f68/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.197527 Oct 17 13:50:08.099148 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1771/3519] 10.222.0.79 () {58 vars in 1275 bytes} [Mon Oct 17 13:50:07 2022] GET /compute/v2.1/servers/f5d52166-ed04-4313-8929-821bbae17f68/os-interface => generated 285 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:50:08.252777 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-31c73453-3d63-4768-b147-9c81c68dc346 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:08.254301 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-31c73453-3d63-4768-b147-9c81c68dc346 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: a2994495-366a-446f-b7a6-16340911e17c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:08.265951 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-31c73453-3d63-4768-b147-9c81c68dc346 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:08.267440 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-31c73453-3d63-4768-b147-9c81c68dc346 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:08.271019 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-31c73453-3d63-4768-b147-9c81c68dc346 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:08.271983 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-31c73453-3d63-4768-b147-9c81c68dc346 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:08.273280 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-31c73453-3d63-4768-b147-9c81c68dc346 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:08.275895 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-31c73453-3d63-4768-b147-9c81c68dc346 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:08.378189 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c015764c-5a63-4ac2-8ed7-f8fde2f37bd8 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:08.379129 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c015764c-5a63-4ac2-8ed7-f8fde2f37bd8 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:08.389738 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c015764c-5a63-4ac2-8ed7-f8fde2f37bd8 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:08.390877 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c015764c-5a63-4ac2-8ed7-f8fde2f37bd8 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:08.391539 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c015764c-5a63-4ac2-8ed7-f8fde2f37bd8 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:08.393009 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c015764c-5a63-4ac2-8ed7-f8fde2f37bd8 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:08.393725 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c015764c-5a63-4ac2-8ed7-f8fde2f37bd8 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:08.394404 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c015764c-5a63-4ac2-8ed7-f8fde2f37bd8 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:08.659699 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-31c73453-3d63-4768-b147-9c81c68dc346 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683d18db860a4d60ab3eeba2a372b2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11973b8e1d8a4af8add65726e8ba7c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:08.679575 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-31c73453-3d63-4768-b147-9c81c68dc346 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c" status: 200 len: 1674 microversion: 2.1 time: 0.430172 Oct 17 13:50:08.690812 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1749/3520] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:08 2022] GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c => generated 1674 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:08.726799 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c015764c-5a63-4ac2-8ed7-f8fde2f37bd8 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:08.742447 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c015764c-5a63-4ac2-8ed7-f8fde2f37bd8 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b" status: 200 len: 1312 microversion: 2.1 time: 0.366976 Oct 17 13:50:08.745448 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1772/3521] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:08 2022] GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b => generated 1312 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:08.795866 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-96bc0515-bf9d-4088-89e3-1c59951673ca tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:08.796874 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-96bc0515-bf9d-4088-89e3-1c59951673ca tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 3197da72-e924-4f50-8c93-c3f3ff98e084] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:08.807252 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-96bc0515-bf9d-4088-89e3-1c59951673ca tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:08.808814 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-96bc0515-bf9d-4088-89e3-1c59951673ca tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:08.809590 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-96bc0515-bf9d-4088-89e3-1c59951673ca tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:08.811121 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-96bc0515-bf9d-4088-89e3-1c59951673ca tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:08.811262 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-96bc0515-bf9d-4088-89e3-1c59951673ca tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:08.811775 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-96bc0515-bf9d-4088-89e3-1c59951673ca tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:09.026724 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-96bc0515-bf9d-4088-89e3-1c59951673ca tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:09.042804 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-96bc0515-bf9d-4088-89e3-1c59951673ca tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084" status: 200 len: 1369 microversion: 2.1 time: 0.250700 Oct 17 13:50:09.055872 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1750/3522] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:08 2022] GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084 => generated 1369 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:09.079235 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-bcdb4461-4fa0-4abf-bc47-049debc3a07e req-7912ec92-a0a2-4522-a6c0-118d9e3ab0f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3197da72-e924-4f50-8c93-c3f3ff98e084", "tag": "ae63042f-2479-46ef-8b31-2a573c0b051b"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:50:09.121007 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-bcdb4461-4fa0-4abf-bc47-049debc3a07e req-7912ec92-a0a2-4522-a6c0-118d9e3ab0f1 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:09.122931 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-bcdb4461-4fa0-4abf-bc47-049debc3a07e req-7912ec92-a0a2-4522-a6c0-118d9e3ab0f1 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:09.123496 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-bcdb4461-4fa0-4abf-bc47-049debc3a07e req-7912ec92-a0a2-4522-a6c0-118d9e3ab0f1 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:09.155043 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-bcdb4461-4fa0-4abf-bc47-049debc3a07e req-7912ec92-a0a2-4522-a6c0-118d9e3ab0f1 service nova] Creating event network-changed:ae63042f-2479-46ef-8b31-2a573c0b051b for instance 3197da72-e924-4f50-8c93-c3f3ff98e084 on n-h1-854247-14 Oct 17 13:50:09.165528 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-bcdb4461-4fa0-4abf-bc47-049debc3a07e req-7912ec92-a0a2-4522-a6c0-118d9e3ab0f1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090646 Oct 17 13:50:09.166692 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1773/3523] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:50:09.706641 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-960ce82e-7c02-4709-98e9-b0bcc92a4b4e tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:09.708381 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-960ce82e-7c02-4709-98e9-b0bcc92a4b4e tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: a2994495-366a-446f-b7a6-16340911e17c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:09.718705 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-960ce82e-7c02-4709-98e9-b0bcc92a4b4e tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:09.719911 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-960ce82e-7c02-4709-98e9-b0bcc92a4b4e tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:09.720375 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-960ce82e-7c02-4709-98e9-b0bcc92a4b4e tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:09.721785 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-960ce82e-7c02-4709-98e9-b0bcc92a4b4e tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:09.722370 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-960ce82e-7c02-4709-98e9-b0bcc92a4b4e tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:09.722944 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-960ce82e-7c02-4709-98e9-b0bcc92a4b4e tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:09.766792 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-92ea3eb2-90e2-4f95-96e7-3329827005ac tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:09.768815 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-92ea3eb2-90e2-4f95-96e7-3329827005ac tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:09.777961 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-92ea3eb2-90e2-4f95-96e7-3329827005ac tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:09.778768 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-92ea3eb2-90e2-4f95-96e7-3329827005ac tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:09.779333 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-92ea3eb2-90e2-4f95-96e7-3329827005ac tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:09.780316 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-92ea3eb2-90e2-4f95-96e7-3329827005ac tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:09.781001 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-92ea3eb2-90e2-4f95-96e7-3329827005ac tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:09.781669 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-92ea3eb2-90e2-4f95-96e7-3329827005ac tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:09.923159 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-960ce82e-7c02-4709-98e9-b0bcc92a4b4e tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683d18db860a4d60ab3eeba2a372b2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11973b8e1d8a4af8add65726e8ba7c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:09.939238 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-960ce82e-7c02-4709-98e9-b0bcc92a4b4e tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c" status: 200 len: 1674 microversion: 2.1 time: 0.236973 Oct 17 13:50:09.948676 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1751/3524] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:09 2022] GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c => generated 1674 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:09.981199 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-92ea3eb2-90e2-4f95-96e7-3329827005ac tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:09.989732 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-92ea3eb2-90e2-4f95-96e7-3329827005ac tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b" status: 200 len: 1462 microversion: 2.1 time: 0.227147 Oct 17 13:50:09.990313 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1774/3525] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:09 2022] GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b => generated 1462 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:10.016417 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2d6928d9-e18c-4475-8b04-a4a6a159eb45 tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:10.017117 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2d6928d9-e18c-4475-8b04-a4a6a159eb45 tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:10.023751 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2d6928d9-e18c-4475-8b04-a4a6a159eb45 tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:10.024229 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2d6928d9-e18c-4475-8b04-a4a6a159eb45 tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:10.024729 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2d6928d9-e18c-4475-8b04-a4a6a159eb45 tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:10.025445 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2d6928d9-e18c-4475-8b04-a4a6a159eb45 tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:10.025960 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2d6928d9-e18c-4475-8b04-a4a6a159eb45 tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:10.026372 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2d6928d9-e18c-4475-8b04-a4a6a159eb45 tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:10.067714 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4b70644c-c1ec-4ece-b7b9-89220744a112 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:10.068292 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4b70644c-c1ec-4ece-b7b9-89220744a112 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 3197da72-e924-4f50-8c93-c3f3ff98e084] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:10.075992 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4b70644c-c1ec-4ece-b7b9-89220744a112 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:10.076830 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4b70644c-c1ec-4ece-b7b9-89220744a112 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:10.077437 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4b70644c-c1ec-4ece-b7b9-89220744a112 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:10.078310 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4b70644c-c1ec-4ece-b7b9-89220744a112 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:10.078930 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4b70644c-c1ec-4ece-b7b9-89220744a112 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:10.079540 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4b70644c-c1ec-4ece-b7b9-89220744a112 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:10.201389 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2d6928d9-e18c-4475-8b04-a4a6a159eb45 tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b" status: 200 len: 1615 microversion: 2.1 time: 0.189163 Oct 17 13:50:10.208287 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1752/3526] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:10 2022] GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b => generated 1615 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:10.213272 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ae705548-4a8f-44c3-bc3b-c86d0383cd25 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:10.221486 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ae705548-4a8f-44c3-bc3b-c86d0383cd25 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] [instance: f5d52166-ed04-4313-8929-821bbae17f68] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:10.237849 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae705548-4a8f-44c3-bc3b-c86d0383cd25 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:10.238652 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae705548-4a8f-44c3-bc3b-c86d0383cd25 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:10.239443 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae705548-4a8f-44c3-bc3b-c86d0383cd25 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:10.240467 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae705548-4a8f-44c3-bc3b-c86d0383cd25 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:10.241087 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae705548-4a8f-44c3-bc3b-c86d0383cd25 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:10.241676 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae705548-4a8f-44c3-bc3b-c86d0383cd25 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:10.289216 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4b70644c-c1ec-4ece-b7b9-89220744a112 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:10.297913 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4b70644c-c1ec-4ece-b7b9-89220744a112 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084" status: 200 len: 1369 microversion: 2.1 time: 0.234409 Oct 17 13:50:10.313829 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1775/3527] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:10 2022] GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084 => generated 1369 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:50:10.326624 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-63c0f33d-bbdf-4a30-b849-8d84a15469e6 req-55a07d73-95ce-48d8-9be9-94665acb1654 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5d52166-ed04-4313-8929-821bbae17f68", "tag": "8d25e9b2-a5d2-482c-9ca9-2f5cb2363bea"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:50:10.340855 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-63c0f33d-bbdf-4a30-b849-8d84a15469e6 req-55a07d73-95ce-48d8-9be9-94665acb1654 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:10.341332 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-63c0f33d-bbdf-4a30-b849-8d84a15469e6 req-55a07d73-95ce-48d8-9be9-94665acb1654 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:10.341776 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-63c0f33d-bbdf-4a30-b849-8d84a15469e6 req-55a07d73-95ce-48d8-9be9-94665acb1654 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:10.357161 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-63c0f33d-bbdf-4a30-b849-8d84a15469e6 req-55a07d73-95ce-48d8-9be9-94665acb1654 service nova] Creating event network-changed:8d25e9b2-a5d2-482c-9ca9-2f5cb2363bea for instance f5d52166-ed04-4313-8929-821bbae17f68 on n-h1-854247-14 Oct 17 13:50:10.362732 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-63c0f33d-bbdf-4a30-b849-8d84a15469e6 req-55a07d73-95ce-48d8-9be9-94665acb1654 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047151 Oct 17 13:50:10.364862 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1776/3528] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:50:10.371292 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-64d43d50-bd48-48e7-88ff-cec066d3655d tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:50:10.372282 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-64d43d50-bd48-48e7-88ff-cec066d3655d tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:10.379447 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-64d43d50-bd48-48e7-88ff-cec066d3655d tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:10.380140 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-64d43d50-bd48-48e7-88ff-cec066d3655d tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:10.380737 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-64d43d50-bd48-48e7-88ff-cec066d3655d tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:10.381959 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-64d43d50-bd48-48e7-88ff-cec066d3655d tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:10.382572 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-64d43d50-bd48-48e7-88ff-cec066d3655d tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:10.383148 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-64d43d50-bd48-48e7-88ff-cec066d3655d tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:10.417301 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-64d43d50-bd48-48e7-88ff-cec066d3655d tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '8ad835fb172540caaa8195d1e3e454b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a040c7e5c765439896b2f969363b9e4f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:10.418378 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-64d43d50-bd48-48e7-88ff-cec066d3655d tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] flavor_id is None. Assuming migration. {{(pid=127016) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 17 13:50:10.418981 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-64d43d50-bd48-48e7-88ff-cec066d3655d tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=127016) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 17 13:50:10.438459 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ae705548-4a8f-44c3-bc3b-c86d0383cd25 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef890da37cc444380f1c373ffbf1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a584b724ab934dd59315d9c644f11cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:10.448303 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ae705548-4a8f-44c3-bc3b-c86d0383cd25 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] 10.222.0.79 "GET /compute/v2.1/servers/f5d52166-ed04-4313-8929-821bbae17f68" status: 200 len: 1481 microversion: 2.1 time: 0.238246 Oct 17 13:50:10.449288 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1753/3529] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:10 2022] GET /compute/v2.1/servers/f5d52166-ed04-4313-8929-821bbae17f68 => generated 1481 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:10.553987 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-64d43d50-bd48-48e7-88ff-cec066d3655d tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b/action" status: 202 len: 0 microversion: 2.1 time: 0.187277 Oct 17 13:50:10.558390 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1777/3530] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:50:10 2022] POST /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:50:10.563132 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d694317c-4b0f-4d21-80d8-d08519664156 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:10.564057 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d694317c-4b0f-4d21-80d8-d08519664156 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:10.575521 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d694317c-4b0f-4d21-80d8-d08519664156 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:10.576076 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d694317c-4b0f-4d21-80d8-d08519664156 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:10.576666 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d694317c-4b0f-4d21-80d8-d08519664156 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:10.577473 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d694317c-4b0f-4d21-80d8-d08519664156 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:10.579673 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d694317c-4b0f-4d21-80d8-d08519664156 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:10.580247 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d694317c-4b0f-4d21-80d8-d08519664156 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:10.797315 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d694317c-4b0f-4d21-80d8-d08519664156 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:10.810652 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d694317c-4b0f-4d21-80d8-d08519664156 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b" status: 200 len: 1471 microversion: 2.1 time: 0.251415 Oct 17 13:50:10.814225 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1754/3531] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:10 2022] GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b => generated 1471 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:50:10.970502 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-11afd144-ae48-4695-a3d4-647e29a30e04 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:10.971746 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-11afd144-ae48-4695-a3d4-647e29a30e04 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: a2994495-366a-446f-b7a6-16340911e17c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:10.983743 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-11afd144-ae48-4695-a3d4-647e29a30e04 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:10.986081 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-11afd144-ae48-4695-a3d4-647e29a30e04 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:10.989199 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-11afd144-ae48-4695-a3d4-647e29a30e04 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:10.990447 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-11afd144-ae48-4695-a3d4-647e29a30e04 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:10.991179 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-11afd144-ae48-4695-a3d4-647e29a30e04 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:10.993400 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-11afd144-ae48-4695-a3d4-647e29a30e04 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:11.325610 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-08d12963-4791-4e94-bd06-daacb585fe18 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:11.334801 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-08d12963-4791-4e94-bd06-daacb585fe18 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 3197da72-e924-4f50-8c93-c3f3ff98e084] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:11.347456 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-08d12963-4791-4e94-bd06-daacb585fe18 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:11.348632 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-08d12963-4791-4e94-bd06-daacb585fe18 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:11.349084 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-08d12963-4791-4e94-bd06-daacb585fe18 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:11.349812 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-08d12963-4791-4e94-bd06-daacb585fe18 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:11.350264 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-08d12963-4791-4e94-bd06-daacb585fe18 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:11.350691 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-08d12963-4791-4e94-bd06-daacb585fe18 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:11.403358 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-11afd144-ae48-4695-a3d4-647e29a30e04 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683d18db860a4d60ab3eeba2a372b2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11973b8e1d8a4af8add65726e8ba7c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:11.415986 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-11afd144-ae48-4695-a3d4-647e29a30e04 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c" status: 200 len: 1674 microversion: 2.1 time: 0.450915 Oct 17 13:50:11.417458 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1778/3532] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:10 2022] GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c => generated 1674 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:11.702272 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-08d12963-4791-4e94-bd06-daacb585fe18 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:11.712054 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-08d12963-4791-4e94-bd06-daacb585fe18 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084" status: 200 len: 1369 microversion: 2.1 time: 0.390707 Oct 17 13:50:11.713462 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1755/3533] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:11 2022] GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084 => generated 1369 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:11.846052 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-977e486c-c11b-4c03-a69f-c99f81e141cb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:11.847089 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-977e486c-c11b-4c03-a69f-c99f81e141cb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:11.873086 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-977e486c-c11b-4c03-a69f-c99f81e141cb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:11.876713 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-977e486c-c11b-4c03-a69f-c99f81e141cb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:11.880055 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-977e486c-c11b-4c03-a69f-c99f81e141cb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:11.882868 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-977e486c-c11b-4c03-a69f-c99f81e141cb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:11.900521 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-977e486c-c11b-4c03-a69f-c99f81e141cb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:11.901359 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-977e486c-c11b-4c03-a69f-c99f81e141cb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:12.117706 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-977e486c-c11b-4c03-a69f-c99f81e141cb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:12.143797 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-977e486c-c11b-4c03-a69f-c99f81e141cb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b" status: 200 len: 1471 microversion: 2.1 time: 0.299543 Oct 17 13:50:12.144347 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1779/3534] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:11 2022] GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b => generated 1471 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:12.442343 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d3cfa0bf-f8af-4f28-95de-93dc25822079 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:12.442996 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d3cfa0bf-f8af-4f28-95de-93dc25822079 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: a2994495-366a-446f-b7a6-16340911e17c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:12.451373 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d3cfa0bf-f8af-4f28-95de-93dc25822079 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:12.451829 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d3cfa0bf-f8af-4f28-95de-93dc25822079 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:12.463748 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d3cfa0bf-f8af-4f28-95de-93dc25822079 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:12.465457 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d3cfa0bf-f8af-4f28-95de-93dc25822079 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:12.468748 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d3cfa0bf-f8af-4f28-95de-93dc25822079 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:12.469622 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d3cfa0bf-f8af-4f28-95de-93dc25822079 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:12.672798 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d3cfa0bf-f8af-4f28-95de-93dc25822079 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683d18db860a4d60ab3eeba2a372b2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11973b8e1d8a4af8add65726e8ba7c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:12.681979 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d3cfa0bf-f8af-4f28-95de-93dc25822079 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c" status: 200 len: 1674 microversion: 2.1 time: 0.243953 Oct 17 13:50:12.682565 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1756/3535] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:12 2022] GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c => generated 1674 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:12.739554 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c3f89c12-5d66-46c3-a007-2701d6c202b8 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:12.740219 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c3f89c12-5d66-46c3-a007-2701d6c202b8 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 3197da72-e924-4f50-8c93-c3f3ff98e084] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:12.746297 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c3f89c12-5d66-46c3-a007-2701d6c202b8 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:12.746775 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c3f89c12-5d66-46c3-a007-2701d6c202b8 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:12.747226 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c3f89c12-5d66-46c3-a007-2701d6c202b8 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:12.747915 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c3f89c12-5d66-46c3-a007-2701d6c202b8 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:12.748382 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c3f89c12-5d66-46c3-a007-2701d6c202b8 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:12.748791 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c3f89c12-5d66-46c3-a007-2701d6c202b8 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:12.757306 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:50:12.894899 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c3f89c12-5d66-46c3-a007-2701d6c202b8 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:12.903110 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c3f89c12-5d66-46c3-a007-2701d6c202b8 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084" status: 200 len: 1369 microversion: 2.1 time: 0.167794 Oct 17 13:50:12.915719 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1780/3536] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:12 2022] GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084 => generated 1369 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:13.168774 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e53febce-aed9-4628-a96a-524db72ada7b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:13.169916 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e53febce-aed9-4628-a96a-524db72ada7b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:13.178120 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e53febce-aed9-4628-a96a-524db72ada7b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:13.179759 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e53febce-aed9-4628-a96a-524db72ada7b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:13.182052 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e53febce-aed9-4628-a96a-524db72ada7b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:13.184157 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e53febce-aed9-4628-a96a-524db72ada7b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:13.185263 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e53febce-aed9-4628-a96a-524db72ada7b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:13.185908 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e53febce-aed9-4628-a96a-524db72ada7b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:13.421524 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e53febce-aed9-4628-a96a-524db72ada7b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:13.431319 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e53febce-aed9-4628-a96a-524db72ada7b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b" status: 200 len: 1471 microversion: 2.1 time: 0.266476 Oct 17 13:50:13.432092 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1757/3537] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:13 2022] GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b => generated 1471 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:13.707012 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c70bf610-cbeb-4b20-be76-88f09cc15af3 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:13.708161 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c70bf610-cbeb-4b20-be76-88f09cc15af3 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: a2994495-366a-446f-b7a6-16340911e17c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:13.711932 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=8 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:50:13.716151 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c70bf610-cbeb-4b20-be76-88f09cc15af3 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:13.716634 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c70bf610-cbeb-4b20-be76-88f09cc15af3 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:13.717067 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c70bf610-cbeb-4b20-be76-88f09cc15af3 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:13.717764 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c70bf610-cbeb-4b20-be76-88f09cc15af3 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:13.718213 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c70bf610-cbeb-4b20-be76-88f09cc15af3 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:13.718628 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c70bf610-cbeb-4b20-be76-88f09cc15af3 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:13.858702 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c70bf610-cbeb-4b20-be76-88f09cc15af3 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683d18db860a4d60ab3eeba2a372b2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11973b8e1d8a4af8add65726e8ba7c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:13.869799 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c70bf610-cbeb-4b20-be76-88f09cc15af3 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c" status: 200 len: 1651 microversion: 2.1 time: 0.166590 Oct 17 13:50:13.871228 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1781/3538] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:13 2022] GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c => generated 1651 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:13.895470 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1be6c3e0-dabd-42a7-962d-3ef16ba65699 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:50:13.900201 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:50:13.901197 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=12 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:50:13.906845 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1be6c3e0-dabd-42a7-962d-3ef16ba65699 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:13.907473 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1be6c3e0-dabd-42a7-962d-3ef16ba65699 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:13.908017 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1be6c3e0-dabd-42a7-962d-3ef16ba65699 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:13.930536 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d7077251-f55e-4e6c-bb9a-b5d975c07f67 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:13.931185 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d7077251-f55e-4e6c-bb9a-b5d975c07f67 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 3197da72-e924-4f50-8c93-c3f3ff98e084] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:13.936048 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1be6c3e0-dabd-42a7-962d-3ef16ba65699 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: a2994495-366a-446f-b7a6-16340911e17c] Going to try to start instance {{(pid=127017) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 17 13:50:13.940898 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d7077251-f55e-4e6c-bb9a-b5d975c07f67 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:13.941559 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d7077251-f55e-4e6c-bb9a-b5d975c07f67 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:13.942200 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d7077251-f55e-4e6c-bb9a-b5d975c07f67 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:13.943192 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d7077251-f55e-4e6c-bb9a-b5d975c07f67 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:13.943698 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d7077251-f55e-4e6c-bb9a-b5d975c07f67 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:13.944113 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d7077251-f55e-4e6c-bb9a-b5d975c07f67 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:13.987858 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1be6c3e0-dabd-42a7-962d-3ef16ba65699 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "POST /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c/action" status: 202 len: 0 microversion: 2.1 time: 0.096764 Oct 17 13:50:13.991050 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1758/3539] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:50:13 2022] POST /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:50:13.996860 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-505ff515-d122-4ad4-9246-36759369e399 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:13.997837 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-505ff515-d122-4ad4-9246-36759369e399 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: a2994495-366a-446f-b7a6-16340911e17c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:14.005158 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-505ff515-d122-4ad4-9246-36759369e399 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:14.005894 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-505ff515-d122-4ad4-9246-36759369e399 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:14.006522 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-505ff515-d122-4ad4-9246-36759369e399 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:14.007464 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-505ff515-d122-4ad4-9246-36759369e399 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:14.008072 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-505ff515-d122-4ad4-9246-36759369e399 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:14.008750 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-505ff515-d122-4ad4-9246-36759369e399 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:14.514720 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d7077251-f55e-4e6c-bb9a-b5d975c07f67 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:14.523413 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d7077251-f55e-4e6c-bb9a-b5d975c07f67 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084" status: 200 len: 1369 microversion: 2.1 time: 0.598832 Oct 17 13:50:14.524301 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1782/3540] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:13 2022] GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084 => generated 1369 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:14.529329 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-df936173-b252-4538-88b2-06372cdd9a25 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:14.530303 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-df936173-b252-4538-88b2-06372cdd9a25 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:14.539849 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df936173-b252-4538-88b2-06372cdd9a25 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:14.540727 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df936173-b252-4538-88b2-06372cdd9a25 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:14.541426 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df936173-b252-4538-88b2-06372cdd9a25 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:14.542365 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df936173-b252-4538-88b2-06372cdd9a25 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:14.542890 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df936173-b252-4538-88b2-06372cdd9a25 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:14.543666 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df936173-b252-4538-88b2-06372cdd9a25 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:14.651194 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-505ff515-d122-4ad4-9246-36759369e399 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683d18db860a4d60ab3eeba2a372b2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11973b8e1d8a4af8add65726e8ba7c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:14.659681 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-505ff515-d122-4ad4-9246-36759369e399 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c" status: 200 len: 1660 microversion: 2.1 time: 0.666992 Oct 17 13:50:14.660737 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1759/3541] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:13 2022] GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c => generated 1660 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:14.773194 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-df936173-b252-4538-88b2-06372cdd9a25 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:14.781660 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-df936173-b252-4538-88b2-06372cdd9a25 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b" status: 200 len: 1476 microversion: 2.1 time: 0.255932 Oct 17 13:50:14.782401 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1783/3542] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:14 2022] GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b => generated 1476 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:15.232373 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-cf525869-a976-49fa-aa0f-f667259aba9e req-049ec1c9-eb32-45af-8d23-fccf4fc4afca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3197da72-e924-4f50-8c93-c3f3ff98e084", "name": "network-vif-plugged", "status": "completed", "tag": "ae63042f-2479-46ef-8b31-2a573c0b051b"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:50:15.247041 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-cf525869-a976-49fa-aa0f-f667259aba9e req-049ec1c9-eb32-45af-8d23-fccf4fc4afca service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:15.247792 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-cf525869-a976-49fa-aa0f-f667259aba9e req-049ec1c9-eb32-45af-8d23-fccf4fc4afca service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:15.248396 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-cf525869-a976-49fa-aa0f-f667259aba9e req-049ec1c9-eb32-45af-8d23-fccf4fc4afca service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:15.262374 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-cf525869-a976-49fa-aa0f-f667259aba9e req-049ec1c9-eb32-45af-8d23-fccf4fc4afca service nova] Creating event network-vif-plugged:ae63042f-2479-46ef-8b31-2a573c0b051b for instance 3197da72-e924-4f50-8c93-c3f3ff98e084 on n-h1-854247-14 Oct 17 13:50:15.268878 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-cf525869-a976-49fa-aa0f-f667259aba9e req-049ec1c9-eb32-45af-8d23-fccf4fc4afca service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040758 Oct 17 13:50:15.270195 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1760/3543] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:50:15.548429 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-76821378-15dc-41b0-a8cd-357d6a482be0 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:15.550327 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-76821378-15dc-41b0-a8cd-357d6a482be0 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 3197da72-e924-4f50-8c93-c3f3ff98e084] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:15.557593 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-76821378-15dc-41b0-a8cd-357d6a482be0 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:15.558085 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-76821378-15dc-41b0-a8cd-357d6a482be0 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:15.558520 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-76821378-15dc-41b0-a8cd-357d6a482be0 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:15.559252 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-76821378-15dc-41b0-a8cd-357d6a482be0 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:15.569113 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-76821378-15dc-41b0-a8cd-357d6a482be0 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:15.569113 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-76821378-15dc-41b0-a8cd-357d6a482be0 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:15.685840 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-63d065f2-adfc-4fc7-aa05-3831a9476325 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:15.687741 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-63d065f2-adfc-4fc7-aa05-3831a9476325 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: a2994495-366a-446f-b7a6-16340911e17c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:15.696717 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-63d065f2-adfc-4fc7-aa05-3831a9476325 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:15.699348 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-63d065f2-adfc-4fc7-aa05-3831a9476325 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:15.700020 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-63d065f2-adfc-4fc7-aa05-3831a9476325 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:15.701603 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-63d065f2-adfc-4fc7-aa05-3831a9476325 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:15.702304 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-63d065f2-adfc-4fc7-aa05-3831a9476325 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:15.709038 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-63d065f2-adfc-4fc7-aa05-3831a9476325 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:15.714690 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-76821378-15dc-41b0-a8cd-357d6a482be0 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:15.725429 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-76821378-15dc-41b0-a8cd-357d6a482be0 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084" status: 200 len: 1369 microversion: 2.1 time: 0.181010 Oct 17 13:50:15.726763 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1784/3544] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:15 2022] GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084 => generated 1369 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:15.807721 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8dcb3f10-1d1a-4791-8924-6a15e1382229 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:15.808905 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8dcb3f10-1d1a-4791-8924-6a15e1382229 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:15.818111 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8dcb3f10-1d1a-4791-8924-6a15e1382229 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:15.819348 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8dcb3f10-1d1a-4791-8924-6a15e1382229 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:15.820250 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8dcb3f10-1d1a-4791-8924-6a15e1382229 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:15.821194 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8dcb3f10-1d1a-4791-8924-6a15e1382229 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:15.821823 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8dcb3f10-1d1a-4791-8924-6a15e1382229 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:15.822422 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8dcb3f10-1d1a-4791-8924-6a15e1382229 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:15.938235 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-63d065f2-adfc-4fc7-aa05-3831a9476325 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683d18db860a4d60ab3eeba2a372b2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11973b8e1d8a4af8add65726e8ba7c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:15.950632 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-63d065f2-adfc-4fc7-aa05-3831a9476325 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c" status: 200 len: 1660 microversion: 2.1 time: 0.269952 Oct 17 13:50:15.967139 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1761/3545] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:15 2022] GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c => generated 1660 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:50:16.017482 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8dcb3f10-1d1a-4791-8924-6a15e1382229 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:16.027751 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8dcb3f10-1d1a-4791-8924-6a15e1382229 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b" status: 200 len: 1476 microversion: 2.1 time: 0.225154 Oct 17 13:50:16.028501 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1785/3546] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:15 2022] GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b => generated 1476 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:16.753268 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7b71afb7-e015-41d8-9394-5e88d3ae4655 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:16.753997 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7b71afb7-e015-41d8-9394-5e88d3ae4655 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 3197da72-e924-4f50-8c93-c3f3ff98e084] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:16.761011 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7b71afb7-e015-41d8-9394-5e88d3ae4655 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:16.761497 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7b71afb7-e015-41d8-9394-5e88d3ae4655 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:16.761923 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7b71afb7-e015-41d8-9394-5e88d3ae4655 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:16.762643 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7b71afb7-e015-41d8-9394-5e88d3ae4655 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:16.763090 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7b71afb7-e015-41d8-9394-5e88d3ae4655 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:16.763537 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7b71afb7-e015-41d8-9394-5e88d3ae4655 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:16.767875 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:50:16.918410 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7b71afb7-e015-41d8-9394-5e88d3ae4655 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:16.926609 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7b71afb7-e015-41d8-9394-5e88d3ae4655 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084" status: 200 len: 1369 microversion: 2.1 time: 0.177089 Oct 17 13:50:16.927334 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1762/3547] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:16 2022] GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084 => generated 1369 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:16.974392 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4841c107-a05c-407c-ac3b-12f8a704ecfa tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:16.975053 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4841c107-a05c-407c-ac3b-12f8a704ecfa tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: a2994495-366a-446f-b7a6-16340911e17c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:16.978076 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:50:16.983977 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4841c107-a05c-407c-ac3b-12f8a704ecfa tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:16.984537 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4841c107-a05c-407c-ac3b-12f8a704ecfa tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:16.985212 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4841c107-a05c-407c-ac3b-12f8a704ecfa tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:16.985979 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4841c107-a05c-407c-ac3b-12f8a704ecfa tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:16.986675 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4841c107-a05c-407c-ac3b-12f8a704ecfa tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:16.987181 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4841c107-a05c-407c-ac3b-12f8a704ecfa tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:17.059129 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0ed94c9e-5eb0-4e25-8e49-546b8f7eb710 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:17.060382 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0ed94c9e-5eb0-4e25-8e49-546b8f7eb710 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:17.076500 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0ed94c9e-5eb0-4e25-8e49-546b8f7eb710 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:17.077347 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0ed94c9e-5eb0-4e25-8e49-546b8f7eb710 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:17.079051 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0ed94c9e-5eb0-4e25-8e49-546b8f7eb710 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:17.080978 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0ed94c9e-5eb0-4e25-8e49-546b8f7eb710 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:17.081553 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0ed94c9e-5eb0-4e25-8e49-546b8f7eb710 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:17.082268 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0ed94c9e-5eb0-4e25-8e49-546b8f7eb710 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:17.175192 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4841c107-a05c-407c-ac3b-12f8a704ecfa tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683d18db860a4d60ab3eeba2a372b2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11973b8e1d8a4af8add65726e8ba7c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:17.183995 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4841c107-a05c-407c-ac3b-12f8a704ecfa tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c" status: 200 len: 1664 microversion: 2.1 time: 0.213882 Oct 17 13:50:17.185078 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1786/3548] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:16 2022] GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c => generated 1664 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:17.240138 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0ed94c9e-5eb0-4e25-8e49-546b8f7eb710 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:17.248132 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0ed94c9e-5eb0-4e25-8e49-546b8f7eb710 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b" status: 200 len: 1476 microversion: 2.1 time: 0.198241 Oct 17 13:50:17.248705 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1763/3549] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:17 2022] GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b => generated 1476 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:17.951192 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-efa9bc1e-1ede-4413-8ff1-f768277c2dc8 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:17.951935 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-efa9bc1e-1ede-4413-8ff1-f768277c2dc8 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 3197da72-e924-4f50-8c93-c3f3ff98e084] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:17.959332 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-efa9bc1e-1ede-4413-8ff1-f768277c2dc8 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:17.959982 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-efa9bc1e-1ede-4413-8ff1-f768277c2dc8 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:17.960468 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-efa9bc1e-1ede-4413-8ff1-f768277c2dc8 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:17.961265 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-efa9bc1e-1ede-4413-8ff1-f768277c2dc8 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:17.961748 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-efa9bc1e-1ede-4413-8ff1-f768277c2dc8 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:17.962200 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-efa9bc1e-1ede-4413-8ff1-f768277c2dc8 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:18.129384 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-efa9bc1e-1ede-4413-8ff1-f768277c2dc8 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:18.138987 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-efa9bc1e-1ede-4413-8ff1-f768277c2dc8 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084" status: 200 len: 1564 microversion: 2.1 time: 0.192747 Oct 17 13:50:18.139628 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1787/3550] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:17 2022] GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084 => generated 1564 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:18.164108 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c5a8d911-9f98-4599-9848-674c8edf7b99 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:18.165238 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c5a8d911-9f98-4599-9848-674c8edf7b99 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 3197da72-e924-4f50-8c93-c3f3ff98e084] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:18.172604 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c5a8d911-9f98-4599-9848-674c8edf7b99 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:18.173158 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c5a8d911-9f98-4599-9848-674c8edf7b99 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:18.173684 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c5a8d911-9f98-4599-9848-674c8edf7b99 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:18.174464 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c5a8d911-9f98-4599-9848-674c8edf7b99 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:18.175013 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c5a8d911-9f98-4599-9848-674c8edf7b99 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:18.175653 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c5a8d911-9f98-4599-9848-674c8edf7b99 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:18.267482 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c5a8d911-9f98-4599-9848-674c8edf7b99 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.107679 Oct 17 13:50:18.268359 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1764/3551] 10.222.0.79 () {58 vars in 1275 bytes} [Mon Oct 17 13:50:18 2022] GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084/os-interface => generated 285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:50:18.273789 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fcd40213-d7b3-4301-86cb-cbe6407083ec tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:18.274532 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-fcd40213-d7b3-4301-86cb-cbe6407083ec tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:18.281734 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fcd40213-d7b3-4301-86cb-cbe6407083ec tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:18.282365 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fcd40213-d7b3-4301-86cb-cbe6407083ec tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:18.282879 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fcd40213-d7b3-4301-86cb-cbe6407083ec tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:18.283810 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fcd40213-d7b3-4301-86cb-cbe6407083ec tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:18.284303 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fcd40213-d7b3-4301-86cb-cbe6407083ec tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:18.285029 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fcd40213-d7b3-4301-86cb-cbe6407083ec tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:18.558069 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fcd40213-d7b3-4301-86cb-cbe6407083ec tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:18.566543 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fcd40213-d7b3-4301-86cb-cbe6407083ec tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b" status: 200 len: 1476 microversion: 2.1 time: 0.298439 Oct 17 13:50:18.567980 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1788/3552] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:18 2022] GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b => generated 1476 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:19.403499 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-bef3f468-f8bf-4d92-a609-42ee9613ca94 req-a365a8e1-8fb2-4485-b54b-307a5f312b41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3197da72-e924-4f50-8c93-c3f3ff98e084", "tag": "ae63042f-2479-46ef-8b31-2a573c0b051b"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:50:19.421056 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-bef3f468-f8bf-4d92-a609-42ee9613ca94 req-a365a8e1-8fb2-4485-b54b-307a5f312b41 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:19.421805 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-bef3f468-f8bf-4d92-a609-42ee9613ca94 req-a365a8e1-8fb2-4485-b54b-307a5f312b41 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:19.422244 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-bef3f468-f8bf-4d92-a609-42ee9613ca94 req-a365a8e1-8fb2-4485-b54b-307a5f312b41 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:19.434830 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-bef3f468-f8bf-4d92-a609-42ee9613ca94 req-a365a8e1-8fb2-4485-b54b-307a5f312b41 service nova] Creating event network-changed:ae63042f-2479-46ef-8b31-2a573c0b051b for instance 3197da72-e924-4f50-8c93-c3f3ff98e084 on n-h1-854247-14 Oct 17 13:50:19.439993 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-bef3f468-f8bf-4d92-a609-42ee9613ca94 req-a365a8e1-8fb2-4485-b54b-307a5f312b41 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041090 Oct 17 13:50:19.440597 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1765/3553] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:50:19.596589 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5bb6b5d0-8c5f-431b-99aa-c450c703e5a6 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:19.597245 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5bb6b5d0-8c5f-431b-99aa-c450c703e5a6 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:19.607818 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5bb6b5d0-8c5f-431b-99aa-c450c703e5a6 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:19.608378 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5bb6b5d0-8c5f-431b-99aa-c450c703e5a6 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:19.609046 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5bb6b5d0-8c5f-431b-99aa-c450c703e5a6 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:19.610454 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5bb6b5d0-8c5f-431b-99aa-c450c703e5a6 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:19.611028 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5bb6b5d0-8c5f-431b-99aa-c450c703e5a6 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:19.611498 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5bb6b5d0-8c5f-431b-99aa-c450c703e5a6 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:19.797142 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5bb6b5d0-8c5f-431b-99aa-c450c703e5a6 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:19.806886 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5bb6b5d0-8c5f-431b-99aa-c450c703e5a6 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b" status: 200 len: 1476 microversion: 2.1 time: 0.214344 Oct 17 13:50:19.807994 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1789/3554] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:19 2022] GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b => generated 1476 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:20.833808 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7dc5c953-aedb-4094-9f96-c3eec77ef2e0 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:20.834508 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7dc5c953-aedb-4094-9f96-c3eec77ef2e0 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:20.840765 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7dc5c953-aedb-4094-9f96-c3eec77ef2e0 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:20.841233 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7dc5c953-aedb-4094-9f96-c3eec77ef2e0 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:20.841656 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7dc5c953-aedb-4094-9f96-c3eec77ef2e0 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:20.842330 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7dc5c953-aedb-4094-9f96-c3eec77ef2e0 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:20.842776 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7dc5c953-aedb-4094-9f96-c3eec77ef2e0 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:20.843191 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7dc5c953-aedb-4094-9f96-c3eec77ef2e0 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:20.976798 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7dc5c953-aedb-4094-9f96-c3eec77ef2e0 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:20.984878 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7dc5c953-aedb-4094-9f96-c3eec77ef2e0 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b" status: 200 len: 1476 microversion: 2.1 time: 0.156428 Oct 17 13:50:20.985449 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1766/3555] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:20 2022] GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b => generated 1476 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:22.008708 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7415181b-7f16-4876-a8e3-3741643b5cbe tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:22.009358 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7415181b-7f16-4876-a8e3-3741643b5cbe tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:22.016677 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7415181b-7f16-4876-a8e3-3741643b5cbe tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:22.017251 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7415181b-7f16-4876-a8e3-3741643b5cbe tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:22.017731 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7415181b-7f16-4876-a8e3-3741643b5cbe tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:22.018480 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7415181b-7f16-4876-a8e3-3741643b5cbe tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:22.019016 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7415181b-7f16-4876-a8e3-3741643b5cbe tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:22.019609 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7415181b-7f16-4876-a8e3-3741643b5cbe tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:22.211874 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7415181b-7f16-4876-a8e3-3741643b5cbe tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:22.220797 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7415181b-7f16-4876-a8e3-3741643b5cbe tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b" status: 200 len: 1476 microversion: 2.1 time: 0.216146 Oct 17 13:50:22.221405 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1790/3556] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:22 2022] GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b => generated 1476 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:22.992286 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5e63683e-9416-4e67-ac43-2c439f968c40 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:22.993030 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5e63683e-9416-4e67-ac43-2c439f968c40 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:23.000177 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5e63683e-9416-4e67-ac43-2c439f968c40 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:23.000703 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5e63683e-9416-4e67-ac43-2c439f968c40 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:23.001108 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5e63683e-9416-4e67-ac43-2c439f968c40 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:23.001816 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5e63683e-9416-4e67-ac43-2c439f968c40 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:23.002268 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5e63683e-9416-4e67-ac43-2c439f968c40 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:23.002691 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5e63683e-9416-4e67-ac43-2c439f968c40 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:23.245777 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-88a7bfbb-0c82-463a-b598-80abcde7b689 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:23.246337 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-88a7bfbb-0c82-463a-b598-80abcde7b689 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:23.253456 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-88a7bfbb-0c82-463a-b598-80abcde7b689 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:23.254187 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-88a7bfbb-0c82-463a-b598-80abcde7b689 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:23.254460 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-88a7bfbb-0c82-463a-b598-80abcde7b689 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:23.255205 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-88a7bfbb-0c82-463a-b598-80abcde7b689 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:23.255803 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-88a7bfbb-0c82-463a-b598-80abcde7b689 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:23.256372 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-88a7bfbb-0c82-463a-b598-80abcde7b689 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:23.391488 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5e63683e-9416-4e67-ac43-2c439f968c40 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:23.401518 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5e63683e-9416-4e67-ac43-2c439f968c40 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:23.402952 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5e63683e-9416-4e67-ac43-2c439f968c40 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:23.404277 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5e63683e-9416-4e67-ac43-2c439f968c40 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 2949 microversion: 2.32 time: 0.416184 Oct 17 13:50:23.404834 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1767/3557] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:50:22 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 2949 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:50:23.433955 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-77d5aa09-91f4-4919-902b-3e0b83d61847 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:23.434640 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-77d5aa09-91f4-4919-902b-3e0b83d61847 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:23.440822 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-77d5aa09-91f4-4919-902b-3e0b83d61847 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:23.441304 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-77d5aa09-91f4-4919-902b-3e0b83d61847 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:23.441914 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-77d5aa09-91f4-4919-902b-3e0b83d61847 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:23.442741 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-77d5aa09-91f4-4919-902b-3e0b83d61847 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:23.443307 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-77d5aa09-91f4-4919-902b-3e0b83d61847 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:23.443747 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-77d5aa09-91f4-4919-902b-3e0b83d61847 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:23.617350 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-88a7bfbb-0c82-463a-b598-80abcde7b689 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:23.626262 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-88a7bfbb-0c82-463a-b598-80abcde7b689 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b" status: 200 len: 1476 microversion: 2.1 time: 0.385018 Oct 17 13:50:23.627001 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1791/3558] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:23 2022] GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b => generated 1476 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:50:23.665245 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-77d5aa09-91f4-4919-902b-3e0b83d61847 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.235452 Oct 17 13:50:23.665911 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1768/3559] 10.222.0.79 () {60 vars in 1316 bytes} [Mon Oct 17 13:50:23 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2/os-interface => generated 1831 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:50:24.650359 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-98389061-d6e3-49c8-9538-bd3a64b0036e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:24.651011 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-98389061-d6e3-49c8-9538-bd3a64b0036e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:24.658561 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-98389061-d6e3-49c8-9538-bd3a64b0036e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:24.659019 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-98389061-d6e3-49c8-9538-bd3a64b0036e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:24.659668 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-98389061-d6e3-49c8-9538-bd3a64b0036e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:24.660580 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-98389061-d6e3-49c8-9538-bd3a64b0036e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:24.661344 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-98389061-d6e3-49c8-9538-bd3a64b0036e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:24.661760 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-98389061-d6e3-49c8-9538-bd3a64b0036e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:24.833143 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-98389061-d6e3-49c8-9538-bd3a64b0036e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:24.841542 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-98389061-d6e3-49c8-9538-bd3a64b0036e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b" status: 200 len: 1476 microversion: 2.1 time: 0.195032 Oct 17 13:50:24.842579 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1792/3560] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:24 2022] GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b => generated 1476 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:25.866001 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-42ff2ff4-7924-4c63-a019-20943022707b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:25.866609 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-42ff2ff4-7924-4c63-a019-20943022707b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:25.872587 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-42ff2ff4-7924-4c63-a019-20943022707b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:25.873095 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-42ff2ff4-7924-4c63-a019-20943022707b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:25.873503 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-42ff2ff4-7924-4c63-a019-20943022707b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:25.874174 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-42ff2ff4-7924-4c63-a019-20943022707b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:25.874613 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-42ff2ff4-7924-4c63-a019-20943022707b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:25.875406 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-42ff2ff4-7924-4c63-a019-20943022707b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:26.068595 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-42ff2ff4-7924-4c63-a019-20943022707b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:26.076481 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a3d77b33-337e-44d5-b03b-5c8656cd4182 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:26.077014 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a3d77b33-337e-44d5-b03b-5c8656cd4182 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 972070b6-59ae-472d-9dfb-75051a0d7701] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:26.086601 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a3d77b33-337e-44d5-b03b-5c8656cd4182 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:26.087093 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a3d77b33-337e-44d5-b03b-5c8656cd4182 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:26.087691 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a3d77b33-337e-44d5-b03b-5c8656cd4182 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:26.088406 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a3d77b33-337e-44d5-b03b-5c8656cd4182 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:26.088872 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a3d77b33-337e-44d5-b03b-5c8656cd4182 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:26.089285 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a3d77b33-337e-44d5-b03b-5c8656cd4182 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:26.094823 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-42ff2ff4-7924-4c63-a019-20943022707b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b" status: 200 len: 1476 microversion: 2.1 time: 0.227442 Oct 17 13:50:26.123949 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1769/3561] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:25 2022] GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b => generated 1476 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:26.125392 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a3d77b33-337e-44d5-b03b-5c8656cd4182 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/972070b6-59ae-472d-9dfb-75051a0d7701/ips" status: 200 len: 150 microversion: 2.1 time: 0.053491 Oct 17 13:50:26.125979 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1793/3562] 10.222.0.79 () {58 vars in 1248 bytes} [Mon Oct 17 13:50:26 2022] GET /compute/v2.1/servers/972070b6-59ae-472d-9dfb-75051a0d7701/ips => generated 150 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:50:26.139961 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6a94359a-295b-44d4-af93-32833f62260a tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9f7fb08a-bb12-485a-b702-ad46276e16d5"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:50:26.142411 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6a94359a-295b-44d4-af93-32833f62260a tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 972070b6-59ae-472d-9dfb-75051a0d7701] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:26.148682 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6a94359a-295b-44d4-af93-32833f62260a tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:26.149158 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6a94359a-295b-44d4-af93-32833f62260a tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:26.149583 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6a94359a-295b-44d4-af93-32833f62260a tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:26.150297 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6a94359a-295b-44d4-af93-32833f62260a tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:26.150735 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6a94359a-295b-44d4-af93-32833f62260a tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:26.151154 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6a94359a-295b-44d4-af93-32833f62260a tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:26.242681 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-6a94359a-295b-44d4-af93-32833f62260a tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] HTTP exception thrown: Invalid volume: volume 9f7fb08a-bb12-485a-b702-ad46276e16d5 is already attached to instances: 10690310-b856-4f6e-a4ea-1b771f45a75f Oct 17 13:50:26.244472 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6a94359a-295b-44d4-af93-32833f62260a tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Request method failure captured: Oct 17 13:50:26.244472 n-d-854247-14 devstack@n-api.service[127017]: request: POST /compute/v2.1/servers/972070b6-59ae-472d-9dfb-75051a0d7701/os-volume_attachments HTTP/1.1 Oct 17 13:50:26.244472 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:50:26.244472 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:50:26.244472 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:50:26.244472 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 74 Oct 17 13:50:26.244472 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:50:26.244472 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:50:26.244472 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:50:26.244472 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:50:26.244472 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTV0JL7NQSDQqh4ZMvkCDXT2fwovcCgk-nxK1nRG4B-HeC5OA7y2_TQv_yPRGTaQ-3zvHufQBJMrO1ZhsIWZZ0ugPMuvlokQmhLWi-H9zySFSYK0iM1qNABohwKQ4S7v-F2ZGFUB1jMKnP05ShlKiL4M8_7Jns7W8GDQtoUfjwQ0M1Lk Oct 17 13:50:26.244472 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:50:26.244472 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:50:26.244472 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:50:26.244472 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:50:26.244472 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:50:26.244472 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:50:26.244472 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 4acd31ce63b64ac3a05b76d4a9fdf7c0 Oct 17 13:50:26.244472 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-AttachVolumeNegativeTest-1792618646 Oct 17 13:50:26.244472 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:50:26.244472 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:50:26.244472 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4acd31ce63b64ac3a05b76d4a9fdf7c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4acd31ce63b64ac3a05b76d4a9fdf7c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4acd31ce63b64ac3a05b76d4a9fdf7c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4acd31ce63b64ac3a05b76d4a9fdf7c0", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:50:26.244472 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-AttachVolumeNegativeTest-1792618646 Oct 17 13:50:26.244472 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 4acd31ce63b64ac3a05b76d4a9fdf7c0 Oct 17 13:50:26.244472 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1792618646 Oct 17 13:50:26.244472 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-AttachVolumeNegativeTest-1792618646-project Oct 17 13:50:26.244472 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:50:26.244472 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:50:26.244472 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: c7a7b9b048234fd2926739e3f08400b0 Oct 17 13:50:26.244472 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-AttachVolumeNegativeTest-1792618646-project Oct 17 13:50:26.244472 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 13:50:26.244472 n-d-854247-14 devstack@n-api.service[127017]: {"volumeAttachment": {"volumeId": "9f7fb08a-bb12-485a-b702-ad46276e16d5"}} Oct 17 13:50:26.244472 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:50:26.244472 n-d-854247-14 devstack@n-api.service[127017]: exception: Invalid volume: volume 9f7fb08a-bb12-485a-b702-ad46276e16d5 is already attached to instances: 10690310-b856-4f6e-a4ea-1b771f45a75f Oct 17 13:50:26.244472 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'server_id': '972070b6-59ae-472d-9dfb-75051a0d7701', 'body': {'volumeAttachment': {'volumeId': '9f7fb08a-bb12-485a-b702-ad46276e16d5'}}} Oct 17 13:50:26.244472 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:50:26.244472 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:50:26.244472 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 17 13:50:26.244472 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 17 13:50:26.244472 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 13:50:26.244472 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:50:26.244472 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 17 13:50:26.244472 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 13:50:26.244472 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 17 13:50:26.244472 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 17 13:50:26.244472 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 17 13:50:26.244472 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 17 13:50:26.244472 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 9f7fb08a-bb12-485a-b702-ad46276e16d5 is already attached to instances: 10690310-b856-4f6e-a4ea-1b771f45a75f Oct 17 13:50:26.244472 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:50:26.244472 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:50:26.244472 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:50:26.244472 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:50:26.244472 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:50:26.244472 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:50:26.244472 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:50:26.244472 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:50:26.244472 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:50:26.244472 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:50:26.244472 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:50:26.244472 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:50:26.244472 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:50:26.244472 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:50:26.250910 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:50:26.250910 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:50:26.250910 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 17 13:50:26.250910 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 17 13:50:26.250910 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 9f7fb08a-bb12-485a-b702-ad46276e16d5 is already attached to instances: 10690310-b856-4f6e-a4ea-1b771f45a75f Oct 17 13:50:26.250910 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:50:26.250910 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:50:26.250910 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:50:26.250910 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:50:26.250910 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:50:26.250910 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:50:26.250910 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:50:26.250910 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:50:26.250910 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 9f7fb08a-bb12-485a-b702-ad46276e16d5 is already attached to instances: 10690310-b856-4f6e-a4ea-1b771f45a75f Oct 17 13:50:26.250910 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:50:26.250910 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6a94359a-295b-44d4-af93-32833f62260a tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Returning 400 to user: Invalid volume: volume 9f7fb08a-bb12-485a-b702-ad46276e16d5 is already attached to instances: 10690310-b856-4f6e-a4ea-1b771f45a75f {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:50:26.250910 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6a94359a-295b-44d4-af93-32833f62260a tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "POST /compute/v2.1/servers/972070b6-59ae-472d-9dfb-75051a0d7701/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.110096 Oct 17 13:50:26.250910 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1770/3563] 10.222.0.79 () {60 vars in 1323 bytes} [Mon Oct 17 13:50:26 2022] POST /compute/v2.1/servers/972070b6-59ae-472d-9dfb-75051a0d7701/os-volume_attachments => generated 174 bytes in 112 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:50:26.256667 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a8c0b6eb-5439-4c31-b059-ba8e86cb8945 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:26.257287 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a8c0b6eb-5439-4c31-b059-ba8e86cb8945 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 972070b6-59ae-472d-9dfb-75051a0d7701] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:26.264519 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a8c0b6eb-5439-4c31-b059-ba8e86cb8945 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:26.265306 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a8c0b6eb-5439-4c31-b059-ba8e86cb8945 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:26.265835 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a8c0b6eb-5439-4c31-b059-ba8e86cb8945 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:26.266778 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a8c0b6eb-5439-4c31-b059-ba8e86cb8945 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:26.267293 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a8c0b6eb-5439-4c31-b059-ba8e86cb8945 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:26.267688 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a8c0b6eb-5439-4c31-b059-ba8e86cb8945 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:26.297364 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a8c0b6eb-5439-4c31-b059-ba8e86cb8945 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 972070b6-59ae-472d-9dfb-75051a0d7701] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:50:26.394531 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a8c0b6eb-5439-4c31-b059-ba8e86cb8945 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "DELETE /compute/v2.1/servers/972070b6-59ae-472d-9dfb-75051a0d7701" status: 204 len: 0 microversion: 2.1 time: 0.142530 Oct 17 13:50:26.395656 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1794/3564] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:50:26 2022] DELETE /compute/v2.1/servers/972070b6-59ae-472d-9dfb-75051a0d7701 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:50:26.404524 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-878fb356-91b3-4f4e-a69f-6e174a03074e tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:26.405431 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-878fb356-91b3-4f4e-a69f-6e174a03074e tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 972070b6-59ae-472d-9dfb-75051a0d7701] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:26.415871 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-878fb356-91b3-4f4e-a69f-6e174a03074e tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:26.416792 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-878fb356-91b3-4f4e-a69f-6e174a03074e tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:26.417395 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-878fb356-91b3-4f4e-a69f-6e174a03074e tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:26.418100 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-878fb356-91b3-4f4e-a69f-6e174a03074e tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:26.418546 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-878fb356-91b3-4f4e-a69f-6e174a03074e tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:26.418963 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-878fb356-91b3-4f4e-a69f-6e174a03074e tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:26.566608 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-878fb356-91b3-4f4e-a69f-6e174a03074e tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:26.575661 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-878fb356-91b3-4f4e-a69f-6e174a03074e tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/972070b6-59ae-472d-9dfb-75051a0d7701" status: 200 len: 1681 microversion: 2.1 time: 0.175467 Oct 17 13:50:26.576254 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1771/3565] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:26 2022] GET /compute/v2.1/servers/972070b6-59ae-472d-9dfb-75051a0d7701 => generated 1681 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:50:27.122569 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9c42c771-2b56-4e8a-afc0-b9b5af226b25 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:27.123323 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9c42c771-2b56-4e8a-afc0-b9b5af226b25 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:27.130528 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c42c771-2b56-4e8a-afc0-b9b5af226b25 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:27.131000 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c42c771-2b56-4e8a-afc0-b9b5af226b25 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:27.131451 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c42c771-2b56-4e8a-afc0-b9b5af226b25 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:27.132141 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c42c771-2b56-4e8a-afc0-b9b5af226b25 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:27.132580 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c42c771-2b56-4e8a-afc0-b9b5af226b25 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:27.132993 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c42c771-2b56-4e8a-afc0-b9b5af226b25 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:27.148692 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:50:27.270804 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9c42c771-2b56-4e8a-afc0-b9b5af226b25 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:27.278819 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9c42c771-2b56-4e8a-afc0-b9b5af226b25 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b" status: 200 len: 1476 microversion: 2.1 time: 0.160481 Oct 17 13:50:27.279720 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1795/3566] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:27 2022] GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b => generated 1476 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:27.601920 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ef12dccd-f33d-42c1-a0b1-592106c5aeef tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:27.602536 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ef12dccd-f33d-42c1-a0b1-592106c5aeef tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 972070b6-59ae-472d-9dfb-75051a0d7701] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:27.609921 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ef12dccd-f33d-42c1-a0b1-592106c5aeef tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:27.610389 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ef12dccd-f33d-42c1-a0b1-592106c5aeef tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:27.611035 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ef12dccd-f33d-42c1-a0b1-592106c5aeef tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:27.611771 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ef12dccd-f33d-42c1-a0b1-592106c5aeef tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:27.612222 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ef12dccd-f33d-42c1-a0b1-592106c5aeef tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:27.612645 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ef12dccd-f33d-42c1-a0b1-592106c5aeef tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:27.749438 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ef12dccd-f33d-42c1-a0b1-592106c5aeef tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:27.758452 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ef12dccd-f33d-42c1-a0b1-592106c5aeef tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/972070b6-59ae-472d-9dfb-75051a0d7701" status: 200 len: 1681 microversion: 2.1 time: 0.160772 Oct 17 13:50:27.759154 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1772/3567] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:27 2022] GET /compute/v2.1/servers/972070b6-59ae-472d-9dfb-75051a0d7701 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:28.302460 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cbb41a58-a017-4a46-9596-3efd699b05f0 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:28.303414 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cbb41a58-a017-4a46-9596-3efd699b05f0 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:28.310355 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cbb41a58-a017-4a46-9596-3efd699b05f0 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:28.310939 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cbb41a58-a017-4a46-9596-3efd699b05f0 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:28.311516 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cbb41a58-a017-4a46-9596-3efd699b05f0 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:28.312323 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cbb41a58-a017-4a46-9596-3efd699b05f0 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:28.312868 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cbb41a58-a017-4a46-9596-3efd699b05f0 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:28.313551 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cbb41a58-a017-4a46-9596-3efd699b05f0 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:28.543274 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cbb41a58-a017-4a46-9596-3efd699b05f0 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:28.555239 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cbb41a58-a017-4a46-9596-3efd699b05f0 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b" status: 200 len: 1476 microversion: 2.1 time: 0.257026 Oct 17 13:50:28.556637 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1796/3568] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:28 2022] GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b => generated 1476 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:28.783561 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-01a83593-843c-4dfe-8da1-621bbc416b8e tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:28.784938 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-01a83593-843c-4dfe-8da1-621bbc416b8e tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 972070b6-59ae-472d-9dfb-75051a0d7701] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:28.798707 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-01a83593-843c-4dfe-8da1-621bbc416b8e tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:28.799195 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-01a83593-843c-4dfe-8da1-621bbc416b8e tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:28.799656 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-01a83593-843c-4dfe-8da1-621bbc416b8e tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:28.800360 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-01a83593-843c-4dfe-8da1-621bbc416b8e tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:28.800774 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-01a83593-843c-4dfe-8da1-621bbc416b8e tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:28.801195 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-01a83593-843c-4dfe-8da1-621bbc416b8e tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:29.447584 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-01a83593-843c-4dfe-8da1-621bbc416b8e tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:29.464289 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-01a83593-843c-4dfe-8da1-621bbc416b8e tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/972070b6-59ae-472d-9dfb-75051a0d7701" status: 200 len: 1681 microversion: 2.1 time: 0.685521 Oct 17 13:50:29.475437 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1773/3569] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:28 2022] GET /compute/v2.1/servers/972070b6-59ae-472d-9dfb-75051a0d7701 => generated 1681 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:29.594617 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-234318c0-dce4-4845-9037-26a9fb9f1797 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:29.598359 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-234318c0-dce4-4845-9037-26a9fb9f1797 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:29.607089 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-234318c0-dce4-4845-9037-26a9fb9f1797 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:29.607602 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-234318c0-dce4-4845-9037-26a9fb9f1797 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:29.608175 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-234318c0-dce4-4845-9037-26a9fb9f1797 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:29.608875 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-234318c0-dce4-4845-9037-26a9fb9f1797 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:29.609333 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-234318c0-dce4-4845-9037-26a9fb9f1797 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:29.609893 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-234318c0-dce4-4845-9037-26a9fb9f1797 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:29.829755 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-234318c0-dce4-4845-9037-26a9fb9f1797 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:29.839823 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-234318c0-dce4-4845-9037-26a9fb9f1797 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b" status: 200 len: 1476 microversion: 2.1 time: 0.263388 Oct 17 13:50:29.840581 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1797/3570] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:29 2022] GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b => generated 1476 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:29.999227 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-6c51abd1-03bf-4245-808f-3a3d58005309 req-8564a990-c098-44ba-a40c-fa7f1e8f80ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "972070b6-59ae-472d-9dfb-75051a0d7701", "name": "network-vif-deleted", "tag": "57ff033e-f817-435b-943f-900adf5c7342"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:50:30.018058 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-6c51abd1-03bf-4245-808f-3a3d58005309 req-8564a990-c098-44ba-a40c-fa7f1e8f80ca service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:30.019371 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-6c51abd1-03bf-4245-808f-3a3d58005309 req-8564a990-c098-44ba-a40c-fa7f1e8f80ca service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:30.020073 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-6c51abd1-03bf-4245-808f-3a3d58005309 req-8564a990-c098-44ba-a40c-fa7f1e8f80ca service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:30.048808 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-6c51abd1-03bf-4245-808f-3a3d58005309 req-8564a990-c098-44ba-a40c-fa7f1e8f80ca service nova] Creating event network-vif-deleted:57ff033e-f817-435b-943f-900adf5c7342 for instance 972070b6-59ae-472d-9dfb-75051a0d7701 on n-h2-854247-14 Oct 17 13:50:30.056687 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-6c51abd1-03bf-4245-808f-3a3d58005309 req-8564a990-c098-44ba-a40c-fa7f1e8f80ca service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060967 Oct 17 13:50:30.062630 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1774/3571] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:50:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:50:30.490001 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-75f9ed3d-a5b0-4d59-b1c0-29102bda17e1 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:30.490616 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-75f9ed3d-a5b0-4d59-b1c0-29102bda17e1 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 972070b6-59ae-472d-9dfb-75051a0d7701] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:30.496935 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-75f9ed3d-a5b0-4d59-b1c0-29102bda17e1 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:30.497416 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-75f9ed3d-a5b0-4d59-b1c0-29102bda17e1 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:30.497819 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-75f9ed3d-a5b0-4d59-b1c0-29102bda17e1 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:30.498668 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-75f9ed3d-a5b0-4d59-b1c0-29102bda17e1 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:30.499101 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-75f9ed3d-a5b0-4d59-b1c0-29102bda17e1 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:30.499560 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-75f9ed3d-a5b0-4d59-b1c0-29102bda17e1 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:30.534334 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-75f9ed3d-a5b0-4d59-b1c0-29102bda17e1 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:30.535084 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-75f9ed3d-a5b0-4d59-b1c0-29102bda17e1 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:30.535862 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-75f9ed3d-a5b0-4d59-b1c0-29102bda17e1 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:30.536476 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-75f9ed3d-a5b0-4d59-b1c0-29102bda17e1 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lazy-loading 'fault' on Instance uuid 972070b6-59ae-472d-9dfb-75051a0d7701 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:50:30.578784 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-75f9ed3d-a5b0-4d59-b1c0-29102bda17e1 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:30.586727 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-75f9ed3d-a5b0-4d59-b1c0-29102bda17e1 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/972070b6-59ae-472d-9dfb-75051a0d7701" status: 200 len: 1331 microversion: 2.1 time: 0.102294 Oct 17 13:50:30.587652 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1798/3572] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:30 2022] GET /compute/v2.1/servers/972070b6-59ae-472d-9dfb-75051a0d7701 => generated 1331 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:30.866021 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f1ec6a83-d9d8-4099-8eed-c57ba1787b26 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:30.867185 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f1ec6a83-d9d8-4099-8eed-c57ba1787b26 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:30.874483 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f1ec6a83-d9d8-4099-8eed-c57ba1787b26 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:30.875076 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f1ec6a83-d9d8-4099-8eed-c57ba1787b26 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:30.875657 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f1ec6a83-d9d8-4099-8eed-c57ba1787b26 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:30.876450 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f1ec6a83-d9d8-4099-8eed-c57ba1787b26 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:30.876818 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f1ec6a83-d9d8-4099-8eed-c57ba1787b26 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:30.877472 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f1ec6a83-d9d8-4099-8eed-c57ba1787b26 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:31.075228 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f1ec6a83-d9d8-4099-8eed-c57ba1787b26 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:31.084011 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f1ec6a83-d9d8-4099-8eed-c57ba1787b26 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b" status: 200 len: 1476 microversion: 2.1 time: 0.225091 Oct 17 13:50:31.084616 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1775/3573] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:30 2022] GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b => generated 1476 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:31.611097 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f66fde87-bbb4-40fe-b082-3790ae79fc90 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:31.611809 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f66fde87-bbb4-40fe-b082-3790ae79fc90 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 972070b6-59ae-472d-9dfb-75051a0d7701] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:31.619148 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f66fde87-bbb4-40fe-b082-3790ae79fc90 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:31.619750 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f66fde87-bbb4-40fe-b082-3790ae79fc90 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:31.620337 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f66fde87-bbb4-40fe-b082-3790ae79fc90 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:31.621107 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f66fde87-bbb4-40fe-b082-3790ae79fc90 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:31.621756 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f66fde87-bbb4-40fe-b082-3790ae79fc90 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:31.622249 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f66fde87-bbb4-40fe-b082-3790ae79fc90 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:31.637141 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-f66fde87-bbb4-40fe-b082-3790ae79fc90 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] HTTP exception thrown: Instance 972070b6-59ae-472d-9dfb-75051a0d7701 could not be found. Oct 17 13:50:31.638819 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f66fde87-bbb4-40fe-b082-3790ae79fc90 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Request method failure captured: Oct 17 13:50:31.638819 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/972070b6-59ae-472d-9dfb-75051a0d7701 HTTP/1.1 Oct 17 13:50:31.638819 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:50:31.638819 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:50:31.638819 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:50:31.638819 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:50:31.638819 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:50:31.638819 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:50:31.638819 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:50:31.638819 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:50:31.638819 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTV0JL7NQSDQqh4ZMvkCDXT2fwovcCgk-nxK1nRG4B-HeC5OA7y2_TQv_yPRGTaQ-3zvHufQBJMrO1ZhsIWZZ0ugPMuvlokQmhLWi-H9zySFSYK0iM1qNABohwKQ4S7v-F2ZGFUB1jMKnP05ShlKiL4M8_7Jns7W8GDQtoUfjwQ0M1Lk Oct 17 13:50:31.638819 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:50:31.638819 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:50:31.638819 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:50:31.638819 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:50:31.638819 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:50:31.638819 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:50:31.638819 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 4acd31ce63b64ac3a05b76d4a9fdf7c0 Oct 17 13:50:31.638819 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-AttachVolumeNegativeTest-1792618646 Oct 17 13:50:31.638819 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:50:31.638819 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:50:31.638819 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4acd31ce63b64ac3a05b76d4a9fdf7c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4acd31ce63b64ac3a05b76d4a9fdf7c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4acd31ce63b64ac3a05b76d4a9fdf7c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4acd31ce63b64ac3a05b76d4a9fdf7c0", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:50:31.638819 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-AttachVolumeNegativeTest-1792618646 Oct 17 13:50:31.638819 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 4acd31ce63b64ac3a05b76d4a9fdf7c0 Oct 17 13:50:31.638819 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1792618646 Oct 17 13:50:31.638819 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-AttachVolumeNegativeTest-1792618646-project Oct 17 13:50:31.638819 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:50:31.638819 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:50:31.638819 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: c7a7b9b048234fd2926739e3f08400b0 Oct 17 13:50:31.638819 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-AttachVolumeNegativeTest-1792618646-project Oct 17 13:50:31.638819 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:50:31.638819 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 972070b6-59ae-472d-9dfb-75051a0d7701 could not be found. Oct 17 13:50:31.638819 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '972070b6-59ae-472d-9dfb-75051a0d7701'} Oct 17 13:50:31.638819 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:50:31.638819 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:50:31.638819 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:50:31.638819 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:50:31.638819 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:50:31.638819 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:50:31.638819 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:50:31.638819 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:50:31.638819 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:50:31.638819 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:50:31.638819 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 972070b6-59ae-472d-9dfb-75051a0d7701 could not be found. Oct 17 13:50:31.638819 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:50:31.638819 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:50:31.638819 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:50:31.638819 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:50:31.638819 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:50:31.638819 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:50:31.638819 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:50:31.638819 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:50:31.638819 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:50:31.638819 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:50:31.638819 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:50:31.638819 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:50:31.638819 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:50:31.638819 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:50:31.638819 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:50:31.638819 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:50:31.638819 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 972070b6-59ae-472d-9dfb-75051a0d7701 could not be found. Oct 17 13:50:31.638819 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:50:31.638819 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:50:31.638819 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:50:31.644567 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:50:31.644567 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:50:31.644567 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:50:31.644567 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:50:31.644567 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:50:31.644567 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 972070b6-59ae-472d-9dfb-75051a0d7701 could not be found. Oct 17 13:50:31.644567 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:50:31.644567 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f66fde87-bbb4-40fe-b082-3790ae79fc90 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Returning 404 to user: Instance 972070b6-59ae-472d-9dfb-75051a0d7701 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:50:31.644567 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f66fde87-bbb4-40fe-b082-3790ae79fc90 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/972070b6-59ae-472d-9dfb-75051a0d7701" status: 404 len: 111 microversion: 2.1 time: 0.033154 Oct 17 13:50:31.644567 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1799/3574] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:31 2022] GET /compute/v2.1/servers/972070b6-59ae-472d-9dfb-75051a0d7701 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:50:31.651575 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5b9ce45b-2369-4e31-a9c7-9b3fada80399 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '.version_select at 0x7f7cd5602550>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:31.674495 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5b9ce45b-2369-4e31-a9c7-9b3fada80399 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-540064923" status: 202 len: 0 microversion: 2.1 time: 0.028433 Oct 17 13:50:31.675302 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1776/3575] 10.222.0.79 () {58 vars in 1218 bytes} [Mon Oct 17 13:50:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-540064923 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:50:32.109098 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-87d80751-0248-4a93-95e2-bb7e173dff20 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:32.109575 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-87d80751-0248-4a93-95e2-bb7e173dff20 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:32.116495 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-87d80751-0248-4a93-95e2-bb7e173dff20 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:32.116981 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-87d80751-0248-4a93-95e2-bb7e173dff20 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:32.117607 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-87d80751-0248-4a93-95e2-bb7e173dff20 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:32.118596 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-87d80751-0248-4a93-95e2-bb7e173dff20 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:32.119263 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-87d80751-0248-4a93-95e2-bb7e173dff20 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:32.119978 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-87d80751-0248-4a93-95e2-bb7e173dff20 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:32.318597 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-87d80751-0248-4a93-95e2-bb7e173dff20 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:32.329084 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-87d80751-0248-4a93-95e2-bb7e173dff20 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b" status: 200 len: 1476 microversion: 2.1 time: 0.223929 Oct 17 13:50:32.330348 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1800/3576] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:32 2022] GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b => generated 1476 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:32.491594 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ebbbf420-2b9f-4fc7-a5c9-7f86937aca00 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:32.492163 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ebbbf420-2b9f-4fc7-a5c9-7f86937aca00 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 10690310-b856-4f6e-a4ea-1b771f45a75f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:32.499609 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ebbbf420-2b9f-4fc7-a5c9-7f86937aca00 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:32.500084 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ebbbf420-2b9f-4fc7-a5c9-7f86937aca00 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:32.500512 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ebbbf420-2b9f-4fc7-a5c9-7f86937aca00 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:32.501200 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ebbbf420-2b9f-4fc7-a5c9-7f86937aca00 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:32.501646 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ebbbf420-2b9f-4fc7-a5c9-7f86937aca00 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:32.502133 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ebbbf420-2b9f-4fc7-a5c9-7f86937aca00 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:32.594824 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-ebbbf420-2b9f-4fc7-a5c9-7f86937aca00 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lazy-loading 'services' on Instance uuid 10690310-b856-4f6e-a4ea-1b771f45a75f {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:50:32.675760 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ebbbf420-2b9f-4fc7-a5c9-7f86937aca00 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "DELETE /compute/v2.1/servers/10690310-b856-4f6e-a4ea-1b771f45a75f/os-volume_attachments/9f7fb08a-bb12-485a-b702-ad46276e16d5" status: 202 len: 0 microversion: 2.1 time: 0.189121 Oct 17 13:50:32.676491 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1777/3577] 10.222.0.79 () {58 vars in 1416 bytes} [Mon Oct 17 13:50:32 2022] DELETE /compute/v2.1/servers/10690310-b856-4f6e-a4ea-1b771f45a75f/os-volume_attachments/9f7fb08a-bb12-485a-b702-ad46276e16d5 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:50:32.684860 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f0117bee-a631-4712-b772-8d0d57bc9cbf tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:32.687958 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f0117bee-a631-4712-b772-8d0d57bc9cbf tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 10690310-b856-4f6e-a4ea-1b771f45a75f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:32.696001 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f0117bee-a631-4712-b772-8d0d57bc9cbf tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:32.696634 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f0117bee-a631-4712-b772-8d0d57bc9cbf tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:32.697311 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f0117bee-a631-4712-b772-8d0d57bc9cbf tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:32.698157 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f0117bee-a631-4712-b772-8d0d57bc9cbf tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:32.699101 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f0117bee-a631-4712-b772-8d0d57bc9cbf tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:32.699594 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f0117bee-a631-4712-b772-8d0d57bc9cbf tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:32.739393 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f0117bee-a631-4712-b772-8d0d57bc9cbf tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/10690310-b856-4f6e-a4ea-1b771f45a75f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058382 Oct 17 13:50:32.740270 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1801/3578] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 13:50:32 2022] GET /compute/v2.1/servers/10690310-b856-4f6e-a4ea-1b771f45a75f/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:50:33.356743 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a7f41c4e-65f5-4870-8a4b-47df01279851 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:33.357784 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a7f41c4e-65f5-4870-8a4b-47df01279851 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:33.365521 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a7f41c4e-65f5-4870-8a4b-47df01279851 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:33.366222 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a7f41c4e-65f5-4870-8a4b-47df01279851 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:33.366710 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a7f41c4e-65f5-4870-8a4b-47df01279851 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:33.367671 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a7f41c4e-65f5-4870-8a4b-47df01279851 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:33.368228 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a7f41c4e-65f5-4870-8a4b-47df01279851 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:33.368727 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a7f41c4e-65f5-4870-8a4b-47df01279851 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:33.610907 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a7f41c4e-65f5-4870-8a4b-47df01279851 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:33.633976 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a7f41c4e-65f5-4870-8a4b-47df01279851 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b" status: 200 len: 1476 microversion: 2.1 time: 0.281462 Oct 17 13:50:33.634570 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1778/3579] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:33 2022] GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b => generated 1476 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:33.753369 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1a51b5a9-2cc6-4ef8-9a61-c8922a34f252 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:33.757313 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-1a51b5a9-2cc6-4ef8-9a61-c8922a34f252 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 10690310-b856-4f6e-a4ea-1b771f45a75f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:33.764763 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1a51b5a9-2cc6-4ef8-9a61-c8922a34f252 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:33.765371 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1a51b5a9-2cc6-4ef8-9a61-c8922a34f252 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:33.765800 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1a51b5a9-2cc6-4ef8-9a61-c8922a34f252 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:33.766687 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1a51b5a9-2cc6-4ef8-9a61-c8922a34f252 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:33.767135 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1a51b5a9-2cc6-4ef8-9a61-c8922a34f252 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:33.767594 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1a51b5a9-2cc6-4ef8-9a61-c8922a34f252 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:33.800306 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1a51b5a9-2cc6-4ef8-9a61-c8922a34f252 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/10690310-b856-4f6e-a4ea-1b771f45a75f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051530 Oct 17 13:50:33.806052 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1802/3580] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 13:50:33 2022] GET /compute/v2.1/servers/10690310-b856-4f6e-a4ea-1b771f45a75f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:50:34.662569 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-176800c3-9e2f-4056-ba1a-74295f8dd245 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:34.663275 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-176800c3-9e2f-4056-ba1a-74295f8dd245 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:34.682979 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-176800c3-9e2f-4056-ba1a-74295f8dd245 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:34.683430 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-176800c3-9e2f-4056-ba1a-74295f8dd245 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:34.683867 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-176800c3-9e2f-4056-ba1a-74295f8dd245 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:34.684790 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-176800c3-9e2f-4056-ba1a-74295f8dd245 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:34.685508 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-176800c3-9e2f-4056-ba1a-74295f8dd245 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:34.686189 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-176800c3-9e2f-4056-ba1a-74295f8dd245 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:34.813376 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9dea6cb8-880a-4991-83fa-38d8a59f5d3c tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:34.815546 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9dea6cb8-880a-4991-83fa-38d8a59f5d3c tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 10690310-b856-4f6e-a4ea-1b771f45a75f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:34.823118 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9dea6cb8-880a-4991-83fa-38d8a59f5d3c tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:34.824235 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9dea6cb8-880a-4991-83fa-38d8a59f5d3c tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:34.824842 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9dea6cb8-880a-4991-83fa-38d8a59f5d3c tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:34.825713 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9dea6cb8-880a-4991-83fa-38d8a59f5d3c tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:34.826313 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9dea6cb8-880a-4991-83fa-38d8a59f5d3c tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:34.826884 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9dea6cb8-880a-4991-83fa-38d8a59f5d3c tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:34.852649 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-176800c3-9e2f-4056-ba1a-74295f8dd245 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:34.864002 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9dea6cb8-880a-4991-83fa-38d8a59f5d3c tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/10690310-b856-4f6e-a4ea-1b771f45a75f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054513 Oct 17 13:50:34.865237 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1803/3581] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 13:50:34 2022] GET /compute/v2.1/servers/10690310-b856-4f6e-a4ea-1b771f45a75f/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:50:34.887416 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-176800c3-9e2f-4056-ba1a-74295f8dd245 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b" status: 200 len: 1476 microversion: 2.1 time: 0.232146 Oct 17 13:50:34.888123 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1779/3582] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:34 2022] GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b => generated 1476 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:35.878939 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1eb05d5c-eb1a-450f-abe6-a5921b151429 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:35.882955 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-1eb05d5c-eb1a-450f-abe6-a5921b151429 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 10690310-b856-4f6e-a4ea-1b771f45a75f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:35.895242 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1eb05d5c-eb1a-450f-abe6-a5921b151429 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:35.896045 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1eb05d5c-eb1a-450f-abe6-a5921b151429 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:35.897079 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1eb05d5c-eb1a-450f-abe6-a5921b151429 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:35.898219 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1eb05d5c-eb1a-450f-abe6-a5921b151429 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:35.898976 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1eb05d5c-eb1a-450f-abe6-a5921b151429 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:35.899850 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1eb05d5c-eb1a-450f-abe6-a5921b151429 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:35.911935 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5bc51e55-c8b3-4077-8245-10a8d37847c2 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:35.912807 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5bc51e55-c8b3-4077-8245-10a8d37847c2 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:35.924127 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5bc51e55-c8b3-4077-8245-10a8d37847c2 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:35.924842 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5bc51e55-c8b3-4077-8245-10a8d37847c2 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:35.925584 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5bc51e55-c8b3-4077-8245-10a8d37847c2 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:35.926930 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5bc51e55-c8b3-4077-8245-10a8d37847c2 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:35.927607 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5bc51e55-c8b3-4077-8245-10a8d37847c2 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:35.928207 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5bc51e55-c8b3-4077-8245-10a8d37847c2 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:36.170661 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5bc51e55-c8b3-4077-8245-10a8d37847c2 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:36.180919 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5bc51e55-c8b3-4077-8245-10a8d37847c2 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b" status: 200 len: 1476 microversion: 2.1 time: 0.273757 Oct 17 13:50:36.201829 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1780/3583] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:35 2022] GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b => generated 1476 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:36.248073 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1eb05d5c-eb1a-450f-abe6-a5921b151429 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/10690310-b856-4f6e-a4ea-1b771f45a75f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.374844 Oct 17 13:50:36.253367 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1804/3584] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 13:50:35 2022] GET /compute/v2.1/servers/10690310-b856-4f6e-a4ea-1b771f45a75f/os-volume_attachments => generated 197 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:50:37.207052 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-868875e0-67bc-41c8-85d8-85233c58153e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:37.208141 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-868875e0-67bc-41c8-85d8-85233c58153e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:37.211350 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:50:37.217749 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-868875e0-67bc-41c8-85d8-85233c58153e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:37.218612 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-868875e0-67bc-41c8-85d8-85233c58153e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:37.219294 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-868875e0-67bc-41c8-85d8-85233c58153e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:37.220269 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-868875e0-67bc-41c8-85d8-85233c58153e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:37.221009 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-868875e0-67bc-41c8-85d8-85233c58153e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:37.221703 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-868875e0-67bc-41c8-85d8-85233c58153e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:37.228453 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:50:37.263911 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8454042b-d355-4a73-a7c2-06d0410eff25 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:37.266711 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8454042b-d355-4a73-a7c2-06d0410eff25 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 10690310-b856-4f6e-a4ea-1b771f45a75f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:37.279212 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8454042b-d355-4a73-a7c2-06d0410eff25 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:37.283857 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8454042b-d355-4a73-a7c2-06d0410eff25 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:37.284695 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8454042b-d355-4a73-a7c2-06d0410eff25 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:37.286406 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8454042b-d355-4a73-a7c2-06d0410eff25 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:37.287087 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8454042b-d355-4a73-a7c2-06d0410eff25 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:37.287730 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8454042b-d355-4a73-a7c2-06d0410eff25 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:37.351662 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8454042b-d355-4a73-a7c2-06d0410eff25 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/10690310-b856-4f6e-a4ea-1b771f45a75f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093992 Oct 17 13:50:37.352631 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1805/3585] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 13:50:37 2022] GET /compute/v2.1/servers/10690310-b856-4f6e-a4ea-1b771f45a75f/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:50:37.414428 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-868875e0-67bc-41c8-85d8-85233c58153e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:37.424323 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-868875e0-67bc-41c8-85d8-85233c58153e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b" status: 200 len: 1476 microversion: 2.1 time: 0.221370 Oct 17 13:50:37.431319 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1781/3586] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:37 2022] GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b => generated 1476 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:38.365150 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fd086c3f-6919-4963-b1ac-6d16e3c0afa8 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:38.367498 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-fd086c3f-6919-4963-b1ac-6d16e3c0afa8 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 10690310-b856-4f6e-a4ea-1b771f45a75f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:38.374873 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fd086c3f-6919-4963-b1ac-6d16e3c0afa8 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:38.375483 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fd086c3f-6919-4963-b1ac-6d16e3c0afa8 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:38.376964 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fd086c3f-6919-4963-b1ac-6d16e3c0afa8 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:38.377723 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fd086c3f-6919-4963-b1ac-6d16e3c0afa8 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:38.378236 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fd086c3f-6919-4963-b1ac-6d16e3c0afa8 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:38.379004 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fd086c3f-6919-4963-b1ac-6d16e3c0afa8 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:38.417909 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fd086c3f-6919-4963-b1ac-6d16e3c0afa8 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/10690310-b856-4f6e-a4ea-1b771f45a75f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057396 Oct 17 13:50:38.418582 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1806/3587] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 13:50:38 2022] GET /compute/v2.1/servers/10690310-b856-4f6e-a4ea-1b771f45a75f/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:50:38.449729 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4dbbd5ef-40a7-4339-9fd3-c30bb8cac10d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:38.450347 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4dbbd5ef-40a7-4339-9fd3-c30bb8cac10d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:38.458314 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4dbbd5ef-40a7-4339-9fd3-c30bb8cac10d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:38.458771 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4dbbd5ef-40a7-4339-9fd3-c30bb8cac10d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:38.459284 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4dbbd5ef-40a7-4339-9fd3-c30bb8cac10d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:38.460184 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4dbbd5ef-40a7-4339-9fd3-c30bb8cac10d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:38.461014 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4dbbd5ef-40a7-4339-9fd3-c30bb8cac10d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:38.461652 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4dbbd5ef-40a7-4339-9fd3-c30bb8cac10d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:38.490519 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-585f4d3e-0303-4f22-899e-2fe16e08cbab tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:38.491025 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-585f4d3e-0303-4f22-899e-2fe16e08cbab tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 10690310-b856-4f6e-a4ea-1b771f45a75f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:38.497693 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-585f4d3e-0303-4f22-899e-2fe16e08cbab tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:38.498160 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-585f4d3e-0303-4f22-899e-2fe16e08cbab tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:38.498612 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-585f4d3e-0303-4f22-899e-2fe16e08cbab tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:38.499336 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-585f4d3e-0303-4f22-899e-2fe16e08cbab tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:38.500026 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-585f4d3e-0303-4f22-899e-2fe16e08cbab tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:38.500625 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-585f4d3e-0303-4f22-899e-2fe16e08cbab tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:38.529325 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-585f4d3e-0303-4f22-899e-2fe16e08cbab tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 10690310-b856-4f6e-a4ea-1b771f45a75f] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:50:38.617993 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-585f4d3e-0303-4f22-899e-2fe16e08cbab tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "DELETE /compute/v2.1/servers/10690310-b856-4f6e-a4ea-1b771f45a75f" status: 204 len: 0 microversion: 2.1 time: 0.131115 Oct 17 13:50:38.618624 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1807/3588] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:50:38 2022] DELETE /compute/v2.1/servers/10690310-b856-4f6e-a4ea-1b771f45a75f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 13:50:38.630778 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-99d001e0-8324-4bce-bb10-76948baa87a1 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:38.631751 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-99d001e0-8324-4bce-bb10-76948baa87a1 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 10690310-b856-4f6e-a4ea-1b771f45a75f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:38.637975 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-99d001e0-8324-4bce-bb10-76948baa87a1 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:38.638471 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-99d001e0-8324-4bce-bb10-76948baa87a1 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:38.638907 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-99d001e0-8324-4bce-bb10-76948baa87a1 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:38.639631 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-99d001e0-8324-4bce-bb10-76948baa87a1 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:38.640088 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-99d001e0-8324-4bce-bb10-76948baa87a1 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:38.640511 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-99d001e0-8324-4bce-bb10-76948baa87a1 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:38.679122 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4dbbd5ef-40a7-4339-9fd3-c30bb8cac10d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:38.688234 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4dbbd5ef-40a7-4339-9fd3-c30bb8cac10d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b" status: 200 len: 1476 microversion: 2.1 time: 0.242920 Oct 17 13:50:38.688956 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1782/3589] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:38 2022] GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b => generated 1476 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:38.901057 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-99d001e0-8324-4bce-bb10-76948baa87a1 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:38.911956 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-99d001e0-8324-4bce-bb10-76948baa87a1 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/10690310-b856-4f6e-a4ea-1b771f45a75f" status: 200 len: 1681 microversion: 2.1 time: 0.287214 Oct 17 13:50:38.913220 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1808/3590] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:38 2022] GET /compute/v2.1/servers/10690310-b856-4f6e-a4ea-1b771f45a75f => generated 1681 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:50:39.714199 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-10cd9232-618a-4695-b6d0-0531efad41b4 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:39.715005 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-10cd9232-618a-4695-b6d0-0531efad41b4 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:39.724684 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-10cd9232-618a-4695-b6d0-0531efad41b4 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:39.725292 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-10cd9232-618a-4695-b6d0-0531efad41b4 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:39.725997 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-10cd9232-618a-4695-b6d0-0531efad41b4 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:39.727135 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-10cd9232-618a-4695-b6d0-0531efad41b4 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:39.727623 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-10cd9232-618a-4695-b6d0-0531efad41b4 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:39.728070 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-10cd9232-618a-4695-b6d0-0531efad41b4 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:39.870684 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-10cd9232-618a-4695-b6d0-0531efad41b4 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:39.879092 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-10cd9232-618a-4695-b6d0-0531efad41b4 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b" status: 200 len: 1476 microversion: 2.1 time: 0.169656 Oct 17 13:50:39.880013 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1783/3591] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:39 2022] GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b => generated 1476 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:39.938077 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-258485ca-a79d-407d-a507-d55baff675fc tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:39.939401 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-258485ca-a79d-407d-a507-d55baff675fc tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 10690310-b856-4f6e-a4ea-1b771f45a75f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:39.948111 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-258485ca-a79d-407d-a507-d55baff675fc tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:39.949276 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-258485ca-a79d-407d-a507-d55baff675fc tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:39.949682 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-258485ca-a79d-407d-a507-d55baff675fc tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:39.950609 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-258485ca-a79d-407d-a507-d55baff675fc tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:39.951065 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-258485ca-a79d-407d-a507-d55baff675fc tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:39.951519 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-258485ca-a79d-407d-a507-d55baff675fc tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:40.115450 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-258485ca-a79d-407d-a507-d55baff675fc tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:40.123980 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-258485ca-a79d-407d-a507-d55baff675fc tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/10690310-b856-4f6e-a4ea-1b771f45a75f" status: 200 len: 1681 microversion: 2.1 time: 0.190563 Oct 17 13:50:40.124641 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1809/3592] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:39 2022] GET /compute/v2.1/servers/10690310-b856-4f6e-a4ea-1b771f45a75f => generated 1681 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:40.903968 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-edf1e8a8-2928-48bd-886a-2e8fb6b4a5eb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:40.904905 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-edf1e8a8-2928-48bd-886a-2e8fb6b4a5eb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:40.912396 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-edf1e8a8-2928-48bd-886a-2e8fb6b4a5eb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:40.912921 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-edf1e8a8-2928-48bd-886a-2e8fb6b4a5eb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:40.913638 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-edf1e8a8-2928-48bd-886a-2e8fb6b4a5eb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:40.914710 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-edf1e8a8-2928-48bd-886a-2e8fb6b4a5eb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:40.915370 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-edf1e8a8-2928-48bd-886a-2e8fb6b4a5eb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:40.915992 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-edf1e8a8-2928-48bd-886a-2e8fb6b4a5eb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:41.077668 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-edf1e8a8-2928-48bd-886a-2e8fb6b4a5eb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:41.087078 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-edf1e8a8-2928-48bd-886a-2e8fb6b4a5eb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b" status: 200 len: 1476 microversion: 2.1 time: 0.187186 Oct 17 13:50:41.087900 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1784/3593] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:40 2022] GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b => generated 1476 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:41.148658 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9de23d6f-84c6-499e-b51d-3acb1877b089 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:41.149299 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9de23d6f-84c6-499e-b51d-3acb1877b089 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 10690310-b856-4f6e-a4ea-1b771f45a75f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:41.157641 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9de23d6f-84c6-499e-b51d-3acb1877b089 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:41.158411 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9de23d6f-84c6-499e-b51d-3acb1877b089 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:41.159245 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9de23d6f-84c6-499e-b51d-3acb1877b089 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:41.160185 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9de23d6f-84c6-499e-b51d-3acb1877b089 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:41.160837 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9de23d6f-84c6-499e-b51d-3acb1877b089 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:41.161426 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9de23d6f-84c6-499e-b51d-3acb1877b089 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:41.323042 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9de23d6f-84c6-499e-b51d-3acb1877b089 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:41.329431 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:50:41.341160 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9de23d6f-84c6-499e-b51d-3acb1877b089 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/10690310-b856-4f6e-a4ea-1b771f45a75f" status: 200 len: 1681 microversion: 2.1 time: 0.197540 Oct 17 13:50:41.342116 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1810/3594] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:41 2022] GET /compute/v2.1/servers/10690310-b856-4f6e-a4ea-1b771f45a75f => generated 1681 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:42.110070 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-efb5d4a7-081f-4c5b-b157-f104bb968f1d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:42.110690 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-efb5d4a7-081f-4c5b-b157-f104bb968f1d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:42.119837 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-efb5d4a7-081f-4c5b-b157-f104bb968f1d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:42.120394 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-efb5d4a7-081f-4c5b-b157-f104bb968f1d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:42.120923 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-efb5d4a7-081f-4c5b-b157-f104bb968f1d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:42.122068 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-efb5d4a7-081f-4c5b-b157-f104bb968f1d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:42.122068 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-efb5d4a7-081f-4c5b-b157-f104bb968f1d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:42.122446 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-efb5d4a7-081f-4c5b-b157-f104bb968f1d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:42.267029 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-db236a2f-0a22-44a6-8fcf-be7ea0e7c24b req-786e4a8d-af11-4b8c-b321-dab327013a0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10690310-b856-4f6e-a4ea-1b771f45a75f", "name": "network-vif-deleted", "tag": "d7fa4d99-108e-4a0d-8bd2-0e8856410c77"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:50:42.314476 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-db236a2f-0a22-44a6-8fcf-be7ea0e7c24b req-786e4a8d-af11-4b8c-b321-dab327013a0b service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:42.315039 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-db236a2f-0a22-44a6-8fcf-be7ea0e7c24b req-786e4a8d-af11-4b8c-b321-dab327013a0b service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:42.318314 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-db236a2f-0a22-44a6-8fcf-be7ea0e7c24b req-786e4a8d-af11-4b8c-b321-dab327013a0b service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:42.340446 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-db236a2f-0a22-44a6-8fcf-be7ea0e7c24b req-786e4a8d-af11-4b8c-b321-dab327013a0b service nova] Creating event network-vif-deleted:d7fa4d99-108e-4a0d-8bd2-0e8856410c77 for instance 10690310-b856-4f6e-a4ea-1b771f45a75f on n-h1-854247-14 Oct 17 13:50:42.347824 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-db236a2f-0a22-44a6-8fcf-be7ea0e7c24b req-786e4a8d-af11-4b8c-b321-dab327013a0b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086957 Oct 17 13:50:42.353884 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1811/3595] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:50:42.375022 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1961b0f0-cef5-41df-8379-4aa67b14648d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:42.378165 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-1961b0f0-cef5-41df-8379-4aa67b14648d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 10690310-b856-4f6e-a4ea-1b771f45a75f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:42.398645 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1961b0f0-cef5-41df-8379-4aa67b14648d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:42.399349 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1961b0f0-cef5-41df-8379-4aa67b14648d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:42.399895 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1961b0f0-cef5-41df-8379-4aa67b14648d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:42.400902 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1961b0f0-cef5-41df-8379-4aa67b14648d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:42.403133 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1961b0f0-cef5-41df-8379-4aa67b14648d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:42.404298 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1961b0f0-cef5-41df-8379-4aa67b14648d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:42.415125 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-efb5d4a7-081f-4c5b-b157-f104bb968f1d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:42.438073 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-efb5d4a7-081f-4c5b-b157-f104bb968f1d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b" status: 200 len: 1476 microversion: 2.1 time: 0.331734 Oct 17 13:50:42.448190 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1785/3596] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:42 2022] GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b => generated 1476 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:42.492868 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1961b0f0-cef5-41df-8379-4aa67b14648d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:42.493373 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1961b0f0-cef5-41df-8379-4aa67b14648d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:42.493815 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1961b0f0-cef5-41df-8379-4aa67b14648d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:42.494284 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-1961b0f0-cef5-41df-8379-4aa67b14648d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lazy-loading 'fault' on Instance uuid 10690310-b856-4f6e-a4ea-1b771f45a75f {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:50:42.590730 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-1961b0f0-cef5-41df-8379-4aa67b14648d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:42.603528 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1961b0f0-cef5-41df-8379-4aa67b14648d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/10690310-b856-4f6e-a4ea-1b771f45a75f" status: 200 len: 1332 microversion: 2.1 time: 0.239490 Oct 17 13:50:42.609045 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1812/3597] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:42 2022] GET /compute/v2.1/servers/10690310-b856-4f6e-a4ea-1b771f45a75f => generated 1332 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:43.478020 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-fdb53a41-c9ea-4585-81ff-b7c51b4ef41b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:43.479697 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-fdb53a41-c9ea-4585-81ff-b7c51b4ef41b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:43.487991 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fdb53a41-c9ea-4585-81ff-b7c51b4ef41b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:43.489068 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fdb53a41-c9ea-4585-81ff-b7c51b4ef41b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:43.489682 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fdb53a41-c9ea-4585-81ff-b7c51b4ef41b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:43.491118 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fdb53a41-c9ea-4585-81ff-b7c51b4ef41b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:43.491922 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fdb53a41-c9ea-4585-81ff-b7c51b4ef41b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:43.493299 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fdb53a41-c9ea-4585-81ff-b7c51b4ef41b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:43.628433 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-dd88f31a-5dd0-4035-b549-2731c71315ea tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:43.630348 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-dd88f31a-5dd0-4035-b549-2731c71315ea tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 10690310-b856-4f6e-a4ea-1b771f45a75f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:43.644100 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dd88f31a-5dd0-4035-b549-2731c71315ea tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:43.645040 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dd88f31a-5dd0-4035-b549-2731c71315ea tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:43.645910 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dd88f31a-5dd0-4035-b549-2731c71315ea tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:43.647472 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dd88f31a-5dd0-4035-b549-2731c71315ea tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:43.648172 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dd88f31a-5dd0-4035-b549-2731c71315ea tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:43.648813 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dd88f31a-5dd0-4035-b549-2731c71315ea tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:43.678063 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-dd88f31a-5dd0-4035-b549-2731c71315ea tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] HTTP exception thrown: Instance 10690310-b856-4f6e-a4ea-1b771f45a75f could not be found. Oct 17 13:50:43.680555 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-dd88f31a-5dd0-4035-b549-2731c71315ea tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Request method failure captured: Oct 17 13:50:43.680555 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/10690310-b856-4f6e-a4ea-1b771f45a75f HTTP/1.1 Oct 17 13:50:43.680555 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:50:43.680555 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:50:43.680555 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:50:43.680555 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:50:43.680555 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:50:43.680555 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:50:43.680555 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:50:43.680555 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:50:43.680555 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTV0JL7NQSDQqh4ZMvkCDXT2fwovcCgk-nxK1nRG4B-HeC5OA7y2_TQv_yPRGTaQ-3zvHufQBJMrO1ZhsIWZZ0ugPMuvlokQmhLWi-H9zySFSYK0iM1qNABohwKQ4S7v-F2ZGFUB1jMKnP05ShlKiL4M8_7Jns7W8GDQtoUfjwQ0M1Lk Oct 17 13:50:43.680555 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:50:43.680555 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:50:43.680555 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:50:43.680555 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:50:43.680555 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:50:43.680555 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:50:43.680555 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 4acd31ce63b64ac3a05b76d4a9fdf7c0 Oct 17 13:50:43.680555 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-AttachVolumeNegativeTest-1792618646 Oct 17 13:50:43.680555 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:50:43.680555 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:50:43.680555 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4acd31ce63b64ac3a05b76d4a9fdf7c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4acd31ce63b64ac3a05b76d4a9fdf7c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4acd31ce63b64ac3a05b76d4a9fdf7c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4acd31ce63b64ac3a05b76d4a9fdf7c0", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:50:43.680555 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-AttachVolumeNegativeTest-1792618646 Oct 17 13:50:43.680555 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 4acd31ce63b64ac3a05b76d4a9fdf7c0 Oct 17 13:50:43.680555 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1792618646 Oct 17 13:50:43.680555 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-AttachVolumeNegativeTest-1792618646-project Oct 17 13:50:43.680555 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:50:43.680555 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:50:43.680555 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: c7a7b9b048234fd2926739e3f08400b0 Oct 17 13:50:43.680555 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-AttachVolumeNegativeTest-1792618646-project Oct 17 13:50:43.680555 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:50:43.680555 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 10690310-b856-4f6e-a4ea-1b771f45a75f could not be found. Oct 17 13:50:43.680555 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '10690310-b856-4f6e-a4ea-1b771f45a75f'} Oct 17 13:50:43.680555 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:50:43.680555 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:50:43.680555 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:50:43.680555 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:50:43.680555 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:50:43.680555 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:50:43.680555 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:50:43.680555 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:50:43.680555 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:50:43.680555 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:50:43.680555 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10690310-b856-4f6e-a4ea-1b771f45a75f could not be found. Oct 17 13:50:43.680555 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:50:43.680555 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:50:43.680555 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:50:43.680555 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:50:43.680555 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:50:43.680555 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:50:43.680555 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:50:43.680555 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:50:43.680555 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:50:43.680555 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:50:43.680555 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:50:43.680555 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:50:43.680555 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:50:43.680555 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:50:43.680555 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:50:43.680555 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:50:43.680555 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10690310-b856-4f6e-a4ea-1b771f45a75f could not be found. Oct 17 13:50:43.680555 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:50:43.680555 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:50:43.680555 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:50:43.686224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:50:43.686224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:50:43.686224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:50:43.686224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:50:43.686224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:50:43.686224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10690310-b856-4f6e-a4ea-1b771f45a75f could not be found. Oct 17 13:50:43.686224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:50:43.688420 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-dd88f31a-5dd0-4035-b549-2731c71315ea tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Returning 404 to user: Instance 10690310-b856-4f6e-a4ea-1b771f45a75f could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:50:43.689765 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-dd88f31a-5dd0-4035-b549-2731c71315ea tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/10690310-b856-4f6e-a4ea-1b771f45a75f" status: 404 len: 111 microversion: 2.1 time: 0.065863 Oct 17 13:50:43.690930 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1813/3598] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:43 2022] GET /compute/v2.1/servers/10690310-b856-4f6e-a4ea-1b771f45a75f => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:50:43.703258 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-fdb53a41-c9ea-4585-81ff-b7c51b4ef41b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:43.703931 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a281bbf3-2484-487c-a4b5-acaa7c3e0b1a tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '.version_select at 0x7f7cd42c73a0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:43.728329 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-fdb53a41-c9ea-4585-81ff-b7c51b4ef41b tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b" status: 200 len: 1476 microversion: 2.1 time: 0.255795 Oct 17 13:50:43.729068 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1786/3599] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:43 2022] GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b => generated 1476 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:43.745177 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a281bbf3-2484-487c-a4b5-acaa7c3e0b1a tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1589025206" status: 202 len: 0 microversion: 2.1 time: 0.044530 Oct 17 13:50:43.745806 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1814/3600] 10.222.0.79 () {58 vars in 1221 bytes} [Mon Oct 17 13:50:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1589025206 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:50:44.514244 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-987c4feb-8ae4-4cc8-82f4-2e8e56db2fb7 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Action: 'create', calling method: .version_select at 0x7f7cd5391a60>, body: {"keypair": {"name": "tempest-keypair-1556615056", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBh7gCOGT4HGHmUL7wGlRIY3wIFVnkm3vUL7gH45vWbVP4oaDnG9+G9wrTIG8Fg+u/cXtcG1nU4AqkXHe/EV8Jng/wWIhX4E6+tfvdM/h0nsihg17lQGdE0/aW2u/WPVeg=="}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:50:44.532492 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-987c4feb-8ae4-4cc8-82f4-2e8e56db2fb7 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Getting quotas for project 4acd31ce63b64ac3a05b76d4a9fdf7c0. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:50:44.537800 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-987c4feb-8ae4-4cc8-82f4-2e8e56db2fb7 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Getting quotas for user c7a7b9b048234fd2926739e3f08400b0 and project 4acd31ce63b64ac3a05b76d4a9fdf7c0. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:50:44.567505 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-987c4feb-8ae4-4cc8-82f4-2e8e56db2fb7 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.057387 Oct 17 13:50:44.569278 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1787/3601] 10.222.0.79 () {60 vars in 1159 bytes} [Mon Oct 17 13:50:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:50:44.761205 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a3567851-cccb-4949-a291-aaf88663227a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:44.762439 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a3567851-cccb-4949-a291-aaf88663227a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:44.770992 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a3567851-cccb-4949-a291-aaf88663227a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:44.771577 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a3567851-cccb-4949-a291-aaf88663227a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:44.771991 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a3567851-cccb-4949-a291-aaf88663227a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:44.772702 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a3567851-cccb-4949-a291-aaf88663227a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:44.773153 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a3567851-cccb-4949-a291-aaf88663227a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:44.773579 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a3567851-cccb-4949-a291-aaf88663227a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:45.009575 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a3567851-cccb-4949-a291-aaf88663227a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:45.025183 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a3567851-cccb-4949-a291-aaf88663227a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b" status: 200 len: 1476 microversion: 2.1 time: 0.269115 Oct 17 13:50:45.026191 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1815/3602] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:44 2022] GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b => generated 1476 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:46.055931 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8d313d07-3962-4962-bb96-d5832f530a76 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:46.057668 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8d313d07-3962-4962-bb96-d5832f530a76 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:46.070963 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8d313d07-3962-4962-bb96-d5832f530a76 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:46.071507 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8d313d07-3962-4962-bb96-d5832f530a76 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:46.071939 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8d313d07-3962-4962-bb96-d5832f530a76 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:46.072650 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8d313d07-3962-4962-bb96-d5832f530a76 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:46.073185 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8d313d07-3962-4962-bb96-d5832f530a76 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:46.073963 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8d313d07-3962-4962-bb96-d5832f530a76 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:46.250371 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8d313d07-3962-4962-bb96-d5832f530a76 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:46.260388 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8d313d07-3962-4962-bb96-d5832f530a76 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b" status: 200 len: 1475 microversion: 2.1 time: 0.210372 Oct 17 13:50:46.261050 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1788/3603] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:46 2022] GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b => generated 1475 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:50:46.352647 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-da79814a-f566-4e6d-8811-98690a90653d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-503827549", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eb9b1c95-6d02-4d66-9e16-313080ea7e89"}], "security_groups": [{"name": "tempest-securitygroup--2137685262"}], "key_name": "tempest-keypair-1556615056", "user_data": "}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:50:46.465740 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-8db10306-c930-4942-836b-abd557ba09d8 req-f085b19d-80d3-453b-bb4f-c21bf53d5c16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50464f17-c798-4c70-b1c9-0f90c55def6b", "name": "network-vif-unplugged", "status": "completed", "tag": "cb1b920d-1ee0-48dd-ade7-68e1d575df70"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:50:46.475427 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-8db10306-c930-4942-836b-abd557ba09d8 req-f085b19d-80d3-453b-bb4f-c21bf53d5c16 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:46.476163 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-8db10306-c930-4942-836b-abd557ba09d8 req-f085b19d-80d3-453b-bb4f-c21bf53d5c16 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:46.476729 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-8db10306-c930-4942-836b-abd557ba09d8 req-f085b19d-80d3-453b-bb4f-c21bf53d5c16 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:46.486963 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-da79814a-f566-4e6d-8811-98690a90653d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] validate_networks() for [('eb9b1c95-6d02-4d66-9e16-313080ea7e89', None, None, None, None, None)] {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:50:46.490259 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-8db10306-c930-4942-836b-abd557ba09d8 req-f085b19d-80d3-453b-bb4f-c21bf53d5c16 service nova] Creating event network-vif-unplugged:cb1b920d-1ee0-48dd-ade7-68e1d575df70 for instance 50464f17-c798-4c70-b1c9-0f90c55def6b on n-h1-854247-14 Oct 17 13:50:46.496365 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [req-8db10306-c930-4942-836b-abd557ba09d8 req-f085b19d-80d3-453b-bb4f-c21bf53d5c16 service nova] Instance 50464f17-c798-4c70-b1c9-0f90c55def6b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854247-14', 'n-h1-854247-14'} {{(pid=127017) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:50:46.512385 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-8db10306-c930-4942-836b-abd557ba09d8 req-f085b19d-80d3-453b-bb4f-c21bf53d5c16 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050690 Oct 17 13:50:46.513216 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1789/3604] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:50:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:50:47.105746 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-da79814a-f566-4e6d-8811-98690a90653d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:50:47.105930 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-da79814a-f566-4e6d-8811-98690a90653d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:50:47.106591 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-da79814a-f566-4e6d-8811-98690a90653d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:50:47.106993 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-da79814a-f566-4e6d-8811-98690a90653d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:50:47.107422 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-da79814a-f566-4e6d-8811-98690a90653d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:50:47.109564 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:50:47.118908 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-da79814a-f566-4e6d-8811-98690a90653d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:47.119470 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-da79814a-f566-4e6d-8811-98690a90653d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:47.120224 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-da79814a-f566-4e6d-8811-98690a90653d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:47.121301 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-da79814a-f566-4e6d-8811-98690a90653d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:47.121920 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-da79814a-f566-4e6d-8811-98690a90653d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:47.122594 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-da79814a-f566-4e6d-8811-98690a90653d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:47.144639 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-da79814a-f566-4e6d-8811-98690a90653d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Getting quotas for project 4acd31ce63b64ac3a05b76d4a9fdf7c0. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:50:47.150402 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-da79814a-f566-4e6d-8811-98690a90653d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Getting quotas for user c7a7b9b048234fd2926739e3f08400b0 and project 4acd31ce63b64ac3a05b76d4a9fdf7c0. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:50:47.169268 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-da79814a-f566-4e6d-8811-98690a90653d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:50:47.172516 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-da79814a-f566-4e6d-8811-98690a90653d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:50:47.225859 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-da79814a-f566-4e6d-8811-98690a90653d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.878244 Oct 17 13:50:47.226849 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1816/3605] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:50:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 880 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:50:47.238827 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-af2c0be9-a711-458d-a319-8901711a2a93 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:47.240328 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-af2c0be9-a711-458d-a319-8901711a2a93 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:47.287323 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2c1cfb2c-059b-489d-a351-3bf6e87b6d1c tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:47.288345 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2c1cfb2c-059b-489d-a351-3bf6e87b6d1c tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:47.294658 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2c1cfb2c-059b-489d-a351-3bf6e87b6d1c tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:47.295237 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2c1cfb2c-059b-489d-a351-3bf6e87b6d1c tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:47.296044 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2c1cfb2c-059b-489d-a351-3bf6e87b6d1c tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:47.296975 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2c1cfb2c-059b-489d-a351-3bf6e87b6d1c tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:47.297642 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2c1cfb2c-059b-489d-a351-3bf6e87b6d1c tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:47.298294 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2c1cfb2c-059b-489d-a351-3bf6e87b6d1c tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:47.394484 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-af2c0be9-a711-458d-a319-8901711a2a93 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:47.419836 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-af2c0be9-a711-458d-a319-8901711a2a93 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e" status: 200 len: 1241 microversion: 2.1 time: 0.185656 Oct 17 13:50:47.423927 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1790/3606] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:47 2022] GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e => generated 1241 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:47.554509 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2c1cfb2c-059b-489d-a351-3bf6e87b6d1c tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:47.569874 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2c1cfb2c-059b-489d-a351-3bf6e87b6d1c tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b" status: 200 len: 1475 microversion: 2.1 time: 0.287148 Oct 17 13:50:47.572009 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1817/3607] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:47 2022] GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b => generated 1475 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:50:48.376079 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-80453f37-0780-4eb5-89e0-d0a09a6b82f6 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:48.380948 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-80453f37-0780-4eb5-89e0-d0a09a6b82f6 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5ef890da37cc444380f1c373ffbf1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a584b724ab934dd59315d9c644f11cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:48.381609 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-80453f37-0780-4eb5-89e0-d0a09a6b82f6 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Searching by: {'deleted': False, 'project_id': 'a584b724ab934dd59315d9c644f11cfa'} {{(pid=127017) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:50:48.388790 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-80453f37-0780-4eb5-89e0-d0a09a6b82f6 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:48.389263 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-80453f37-0780-4eb5-89e0-d0a09a6b82f6 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:48.389691 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-80453f37-0780-4eb5-89e0-d0a09a6b82f6 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:48.390399 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-80453f37-0780-4eb5-89e0-d0a09a6b82f6 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:48.390843 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-80453f37-0780-4eb5-89e0-d0a09a6b82f6 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:48.391269 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-80453f37-0780-4eb5-89e0-d0a09a6b82f6 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:48.414799 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.multi_cell_list [None req-80453f37-0780-4eb5-89e0-d0a09a6b82f6 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127017) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:50:48.444762 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-889908d4-7f80-4941-bb65-1e45b7530fd2 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:48.445630 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-889908d4-7f80-4941-bb65-1e45b7530fd2 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:48.445836 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-80453f37-0780-4eb5-89e0-d0a09a6b82f6 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] 10.222.0.79 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.073773 Oct 17 13:50:48.453435 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1791/3608] 10.222.0.79 () {58 vars in 1125 bytes} [Mon Oct 17 13:50:48 2022] GET /compute/v2.1/servers => generated 343 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:50:48.453624 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-889908d4-7f80-4941-bb65-1e45b7530fd2 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:48.453987 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-889908d4-7f80-4941-bb65-1e45b7530fd2 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:48.454571 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-889908d4-7f80-4941-bb65-1e45b7530fd2 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:48.455710 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-889908d4-7f80-4941-bb65-1e45b7530fd2 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:48.456031 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-889908d4-7f80-4941-bb65-1e45b7530fd2 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:48.456455 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-889908d4-7f80-4941-bb65-1e45b7530fd2 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:48.462975 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-710b41b1-528b-489d-b0f6-5f784e809a11 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:48.467897 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-710b41b1-528b-489d-b0f6-5f784e809a11 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5ef890da37cc444380f1c373ffbf1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a584b724ab934dd59315d9c644f11cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:48.468721 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-710b41b1-528b-489d-b0f6-5f784e809a11 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Searching by: {'deleted': False, 'project_id': 'a584b724ab934dd59315d9c644f11cfa'} {{(pid=127017) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:50:48.474732 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-710b41b1-528b-489d-b0f6-5f784e809a11 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:48.475275 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-710b41b1-528b-489d-b0f6-5f784e809a11 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:48.475914 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-710b41b1-528b-489d-b0f6-5f784e809a11 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:48.476643 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-710b41b1-528b-489d-b0f6-5f784e809a11 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:48.477094 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-710b41b1-528b-489d-b0f6-5f784e809a11 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:48.477516 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-710b41b1-528b-489d-b0f6-5f784e809a11 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:48.505607 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.multi_cell_list [None req-710b41b1-528b-489d-b0f6-5f784e809a11 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127017) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:50:48.523434 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-889908d4-7f80-4941-bb65-1e45b7530fd2 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:48.531886 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-889908d4-7f80-4941-bb65-1e45b7530fd2 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e" status: 200 len: 1245 microversion: 2.1 time: 0.091546 Oct 17 13:50:48.532878 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1818/3609] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:48 2022] GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e => generated 1245 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:48.545361 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-75e6ca8b-17e2-4558-b378-c784f84ebda4 req-087b7e9e-27ca-44a4-b44d-029656a234f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50464f17-c798-4c70-b1c9-0f90c55def6b", "tag": "cb1b920d-1ee0-48dd-ade7-68e1d575df70"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:50:48.556345 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-710b41b1-528b-489d-b0f6-5f784e809a11 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef890da37cc444380f1c373ffbf1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a584b724ab934dd59315d9c644f11cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:48.557399 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-75e6ca8b-17e2-4558-b378-c784f84ebda4 req-087b7e9e-27ca-44a4-b44d-029656a234f7 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:48.557911 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-75e6ca8b-17e2-4558-b378-c784f84ebda4 req-087b7e9e-27ca-44a4-b44d-029656a234f7 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:48.558291 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-75e6ca8b-17e2-4558-b378-c784f84ebda4 req-087b7e9e-27ca-44a4-b44d-029656a234f7 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:48.563694 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-710b41b1-528b-489d-b0f6-5f784e809a11 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:48.564170 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-710b41b1-528b-489d-b0f6-5f784e809a11 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:48.564605 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-710b41b1-528b-489d-b0f6-5f784e809a11 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:48.571821 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-75e6ca8b-17e2-4558-b378-c784f84ebda4 req-087b7e9e-27ca-44a4-b44d-029656a234f7 service nova] Creating event network-changed:cb1b920d-1ee0-48dd-ade7-68e1d575df70 for instance 50464f17-c798-4c70-b1c9-0f90c55def6b on n-h1-854247-14 Oct 17 13:50:48.578167 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [req-75e6ca8b-17e2-4558-b378-c784f84ebda4 req-087b7e9e-27ca-44a4-b44d-029656a234f7 service nova] Instance 50464f17-c798-4c70-b1c9-0f90c55def6b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854247-14', 'n-h1-854247-14'} {{(pid=127016) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:50:48.593248 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-75e6ca8b-17e2-4558-b378-c784f84ebda4 req-087b7e9e-27ca-44a4-b44d-029656a234f7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050278 Oct 17 13:50:48.593870 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1819/3610] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:50:48.601771 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2d13125f-fcb9-4b16-ab0d-e39c0dce6e6e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:48.602846 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2d13125f-fcb9-4b16-ab0d-e39c0dce6e6e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:48.610880 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2d13125f-fcb9-4b16-ab0d-e39c0dce6e6e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:48.611757 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2d13125f-fcb9-4b16-ab0d-e39c0dce6e6e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:48.612314 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2d13125f-fcb9-4b16-ab0d-e39c0dce6e6e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:48.613034 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2d13125f-fcb9-4b16-ab0d-e39c0dce6e6e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:48.613636 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2d13125f-fcb9-4b16-ab0d-e39c0dce6e6e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:48.614058 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2d13125f-fcb9-4b16-ab0d-e39c0dce6e6e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:48.882140 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-710b41b1-528b-489d-b0f6-5f784e809a11 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] 10.222.0.79 "GET /compute/v2.1/servers/detail" status: 200 len: 1602 microversion: 2.1 time: 0.423292 Oct 17 13:50:48.883196 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1792/3611] 10.222.0.79 () {58 vars in 1146 bytes} [Mon Oct 17 13:50:48 2022] GET /compute/v2.1/servers/detail => generated 1602 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:50:48.903276 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2d13125f-fcb9-4b16-ab0d-e39c0dce6e6e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:48.908913 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f0621e4d-a5a9-4f42-99d3-e3f82d2b853f tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:48.914530 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2d13125f-fcb9-4b16-ab0d-e39c0dce6e6e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b" status: 200 len: 1473 microversion: 2.1 time: 0.318491 Oct 17 13:50:48.915961 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1820/3612] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:48 2022] GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b => generated 1473 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:48.927039 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f0621e4d-a5a9-4f42-99d3-e3f82d2b853f tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] 10.222.0.79 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021920 Oct 17 13:50:48.936909 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1793/3613] 10.222.0.79 () {58 vars in 1137 bytes} [Mon Oct 17 13:50:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:50:49.557248 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2fccee06-1219-4d43-8daa-370bf3c5569e tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:49.558380 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2fccee06-1219-4d43-8daa-370bf3c5569e tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:49.570216 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2fccee06-1219-4d43-8daa-370bf3c5569e tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:49.571945 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2fccee06-1219-4d43-8daa-370bf3c5569e tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:49.572448 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2fccee06-1219-4d43-8daa-370bf3c5569e tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:49.573502 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2fccee06-1219-4d43-8daa-370bf3c5569e tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:49.575207 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2fccee06-1219-4d43-8daa-370bf3c5569e tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:49.575684 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2fccee06-1219-4d43-8daa-370bf3c5569e tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:49.684893 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2fccee06-1219-4d43-8daa-370bf3c5569e tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:49.696069 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2fccee06-1219-4d43-8daa-370bf3c5569e tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e" status: 200 len: 1293 microversion: 2.1 time: 0.143638 Oct 17 13:50:49.697804 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1821/3614] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:49 2022] GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e => generated 1293 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:49.863072 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0bd01405-9b73-4ef3-92ce-7f26694e2c9d tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:49.863780 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0bd01405-9b73-4ef3-92ce-7f26694e2c9d tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] [instance: f5d52166-ed04-4313-8929-821bbae17f68] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:49.871804 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0bd01405-9b73-4ef3-92ce-7f26694e2c9d tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:49.872306 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0bd01405-9b73-4ef3-92ce-7f26694e2c9d tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:49.872741 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0bd01405-9b73-4ef3-92ce-7f26694e2c9d tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:49.873453 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0bd01405-9b73-4ef3-92ce-7f26694e2c9d tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:49.873911 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0bd01405-9b73-4ef3-92ce-7f26694e2c9d tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:49.874331 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0bd01405-9b73-4ef3-92ce-7f26694e2c9d tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:49.900786 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0bd01405-9b73-4ef3-92ce-7f26694e2c9d tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] [instance: f5d52166-ed04-4313-8929-821bbae17f68] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:50:49.946752 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8b20e86d-d26a-42d8-b1f9-13d1b3a0c2b5 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:49.949409 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8b20e86d-d26a-42d8-b1f9-13d1b3a0c2b5 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:49.959153 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8b20e86d-d26a-42d8-b1f9-13d1b3a0c2b5 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:49.960979 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8b20e86d-d26a-42d8-b1f9-13d1b3a0c2b5 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:49.961713 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8b20e86d-d26a-42d8-b1f9-13d1b3a0c2b5 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:49.962850 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8b20e86d-d26a-42d8-b1f9-13d1b3a0c2b5 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:49.963439 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8b20e86d-d26a-42d8-b1f9-13d1b3a0c2b5 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:49.964268 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8b20e86d-d26a-42d8-b1f9-13d1b3a0c2b5 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:49.993252 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0bd01405-9b73-4ef3-92ce-7f26694e2c9d tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] 10.222.0.79 "DELETE /compute/v2.1/servers/f5d52166-ed04-4313-8929-821bbae17f68" status: 204 len: 0 microversion: 2.1 time: 0.137525 Oct 17 13:50:49.997313 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1794/3615] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:50:49 2022] DELETE /compute/v2.1/servers/f5d52166-ed04-4313-8929-821bbae17f68 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:50:50.003871 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1cf1d012-b5fe-4cc8-8305-4289b6656a59 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:50.004777 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1cf1d012-b5fe-4cc8-8305-4289b6656a59 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] [instance: f5d52166-ed04-4313-8929-821bbae17f68] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:50.011292 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1cf1d012-b5fe-4cc8-8305-4289b6656a59 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:50.011774 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1cf1d012-b5fe-4cc8-8305-4289b6656a59 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:50.012205 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1cf1d012-b5fe-4cc8-8305-4289b6656a59 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:50.012896 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1cf1d012-b5fe-4cc8-8305-4289b6656a59 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:50.013362 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1cf1d012-b5fe-4cc8-8305-4289b6656a59 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:50.013777 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1cf1d012-b5fe-4cc8-8305-4289b6656a59 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:50.235908 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8b20e86d-d26a-42d8-b1f9-13d1b3a0c2b5 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:50.240359 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1cf1d012-b5fe-4cc8-8305-4289b6656a59 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef890da37cc444380f1c373ffbf1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a584b724ab934dd59315d9c644f11cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:50.244399 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8b20e86d-d26a-42d8-b1f9-13d1b3a0c2b5 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b" status: 200 len: 1470 microversion: 2.1 time: 0.304435 Oct 17 13:50:50.245071 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1822/3616] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:49 2022] GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b => generated 1470 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:50:50.250488 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-70a816c4-e954-4f38-a9fe-9f524549e12e tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:50.252999 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-70a816c4-e954-4f38-a9fe-9f524549e12e tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: a2994495-366a-446f-b7a6-16340911e17c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:50.259219 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-70a816c4-e954-4f38-a9fe-9f524549e12e tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:50.259902 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-70a816c4-e954-4f38-a9fe-9f524549e12e tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:50.260342 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-70a816c4-e954-4f38-a9fe-9f524549e12e tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:50.261116 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-70a816c4-e954-4f38-a9fe-9f524549e12e tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:50.261574 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-70a816c4-e954-4f38-a9fe-9f524549e12e tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:50.261995 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-70a816c4-e954-4f38-a9fe-9f524549e12e tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:50.266391 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1cf1d012-b5fe-4cc8-8305-4289b6656a59 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] 10.222.0.79 "GET /compute/v2.1/servers/f5d52166-ed04-4313-8929-821bbae17f68" status: 200 len: 1605 microversion: 2.1 time: 0.267308 Oct 17 13:50:50.266977 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1795/3617] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:49 2022] GET /compute/v2.1/servers/f5d52166-ed04-4313-8929-821bbae17f68 => generated 1605 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:50:50.277895 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-fb465e92-a5ac-4d8c-9c80-c1643e58e5cb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:50:50.278420 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-fb465e92-a5ac-4d8c-9c80-c1643e58e5cb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:50.285318 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fb465e92-a5ac-4d8c-9c80-c1643e58e5cb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:50.285825 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fb465e92-a5ac-4d8c-9c80-c1643e58e5cb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:50.286450 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fb465e92-a5ac-4d8c-9c80-c1643e58e5cb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:50.287141 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fb465e92-a5ac-4d8c-9c80-c1643e58e5cb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:50.287634 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fb465e92-a5ac-4d8c-9c80-c1643e58e5cb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:50.288262 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fb465e92-a5ac-4d8c-9c80-c1643e58e5cb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:50.310310 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-70a816c4-e954-4f38-a9fe-9f524549e12e tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063559 Oct 17 13:50:50.310934 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1823/3618] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 13:50:50 2022] GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:50:50.376970 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2bcf3ebf-5a25-4a85-a63b-02f258e83890 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:50.377627 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2bcf3ebf-5a25-4a85-a63b-02f258e83890 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: a2994495-366a-446f-b7a6-16340911e17c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:50.384290 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2bcf3ebf-5a25-4a85-a63b-02f258e83890 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:50.385173 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2bcf3ebf-5a25-4a85-a63b-02f258e83890 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:50.385786 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2bcf3ebf-5a25-4a85-a63b-02f258e83890 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:50.386713 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2bcf3ebf-5a25-4a85-a63b-02f258e83890 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:50.387456 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2bcf3ebf-5a25-4a85-a63b-02f258e83890 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:50.388151 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2bcf3ebf-5a25-4a85-a63b-02f258e83890 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:50.412271 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:50:50.421803 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2bcf3ebf-5a25-4a85-a63b-02f258e83890 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: a2994495-366a-446f-b7a6-16340911e17c] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:50:50.435309 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-fb465e92-a5ac-4d8c-9c80-c1643e58e5cb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "POST /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b/action" status: 202 len: 0 microversion: 2.1 time: 0.161410 Oct 17 13:50:50.436483 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1796/3619] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:50:50 2022] POST /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:50:50.447387 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-59f2e072-99ac-4333-b26e-d220186ccb65 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:50.448569 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-59f2e072-99ac-4333-b26e-d220186ccb65 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:50.460127 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-59f2e072-99ac-4333-b26e-d220186ccb65 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:50.460610 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-59f2e072-99ac-4333-b26e-d220186ccb65 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:50.461065 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-59f2e072-99ac-4333-b26e-d220186ccb65 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:50.461798 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-59f2e072-99ac-4333-b26e-d220186ccb65 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:50.462562 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-59f2e072-99ac-4333-b26e-d220186ccb65 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:50.462983 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-59f2e072-99ac-4333-b26e-d220186ccb65 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:50.521488 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2bcf3ebf-5a25-4a85-a63b-02f258e83890 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c" status: 204 len: 0 microversion: 2.1 time: 0.147972 Oct 17 13:50:50.525569 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1824/3620] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:50:50 2022] DELETE /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 13:50:50.531988 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f857189a-6736-4ee6-b71e-4e018426f3da tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:50.532799 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f857189a-6736-4ee6-b71e-4e018426f3da tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: a2994495-366a-446f-b7a6-16340911e17c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:50.540810 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f857189a-6736-4ee6-b71e-4e018426f3da tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:50.541332 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f857189a-6736-4ee6-b71e-4e018426f3da tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:50.541802 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f857189a-6736-4ee6-b71e-4e018426f3da tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:50.542555 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f857189a-6736-4ee6-b71e-4e018426f3da tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:50.543086 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f857189a-6736-4ee6-b71e-4e018426f3da tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:50.543770 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f857189a-6736-4ee6-b71e-4e018426f3da tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:50.686393 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-59f2e072-99ac-4333-b26e-d220186ccb65 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:50.699844 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-59f2e072-99ac-4333-b26e-d220186ccb65 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b" status: 200 len: 1469 microversion: 2.1 time: 0.258648 Oct 17 13:50:50.700651 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1797/3621] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:50 2022] GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b => generated 1469 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:50.725224 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ab651656-e012-4829-85c5-ba70edded347 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:50.725979 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ab651656-e012-4829-85c5-ba70edded347 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:50.732557 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ab651656-e012-4829-85c5-ba70edded347 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:50.733501 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ab651656-e012-4829-85c5-ba70edded347 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:50.733501 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ab651656-e012-4829-85c5-ba70edded347 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:50.734212 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ab651656-e012-4829-85c5-ba70edded347 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:50.734578 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ab651656-e012-4829-85c5-ba70edded347 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:50.734988 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ab651656-e012-4829-85c5-ba70edded347 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:50.747760 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f857189a-6736-4ee6-b71e-4e018426f3da tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683d18db860a4d60ab3eeba2a372b2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11973b8e1d8a4af8add65726e8ba7c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:50.756075 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f857189a-6736-4ee6-b71e-4e018426f3da tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c" status: 200 len: 1670 microversion: 2.1 time: 0.228993 Oct 17 13:50:50.756866 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1825/3622] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:50 2022] GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c => generated 1670 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:50:50.802844 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ab651656-e012-4829-85c5-ba70edded347 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:50.810913 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ab651656-e012-4829-85c5-ba70edded347 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e" status: 200 len: 1301 microversion: 2.1 time: 0.089933 Oct 17 13:50:50.811600 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1798/3623] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:50 2022] GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e => generated 1301 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:51.297868 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-10f978d3-c2b3-4935-804c-f365ee30b822 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:51.298478 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-10f978d3-c2b3-4935-804c-f365ee30b822 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] [instance: f5d52166-ed04-4313-8929-821bbae17f68] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:51.305248 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-10f978d3-c2b3-4935-804c-f365ee30b822 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:51.306172 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-10f978d3-c2b3-4935-804c-f365ee30b822 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:51.306675 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-10f978d3-c2b3-4935-804c-f365ee30b822 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:51.307407 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-10f978d3-c2b3-4935-804c-f365ee30b822 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:51.308061 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-10f978d3-c2b3-4935-804c-f365ee30b822 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:51.308708 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-10f978d3-c2b3-4935-804c-f365ee30b822 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:51.695861 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-10f978d3-c2b3-4935-804c-f365ee30b822 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef890da37cc444380f1c373ffbf1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a584b724ab934dd59315d9c644f11cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:51.706868 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-10f978d3-c2b3-4935-804c-f365ee30b822 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] 10.222.0.79 "GET /compute/v2.1/servers/f5d52166-ed04-4313-8929-821bbae17f68" status: 200 len: 1605 microversion: 2.1 time: 0.412587 Oct 17 13:50:51.707845 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1826/3624] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:51 2022] GET /compute/v2.1/servers/f5d52166-ed04-4313-8929-821bbae17f68 => generated 1605 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:50:51.726558 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-19f55118-b2fe-4ab3-bfdb-25388818ecb1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:51.727203 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-19f55118-b2fe-4ab3-bfdb-25388818ecb1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:51.735595 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-19f55118-b2fe-4ab3-bfdb-25388818ecb1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:51.736761 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-19f55118-b2fe-4ab3-bfdb-25388818ecb1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:51.737274 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-19f55118-b2fe-4ab3-bfdb-25388818ecb1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:51.739792 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-19f55118-b2fe-4ab3-bfdb-25388818ecb1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:51.740831 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-19f55118-b2fe-4ab3-bfdb-25388818ecb1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:51.741027 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-19f55118-b2fe-4ab3-bfdb-25388818ecb1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:51.781036 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-25e4dfe8-5093-4673-854b-267efdb48b31 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:51.782637 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-25e4dfe8-5093-4673-854b-267efdb48b31 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: a2994495-366a-446f-b7a6-16340911e17c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:51.795573 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-25e4dfe8-5093-4673-854b-267efdb48b31 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:51.796069 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-25e4dfe8-5093-4673-854b-267efdb48b31 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:51.796504 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-25e4dfe8-5093-4673-854b-267efdb48b31 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:51.797209 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-25e4dfe8-5093-4673-854b-267efdb48b31 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:51.801337 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-25e4dfe8-5093-4673-854b-267efdb48b31 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:51.802053 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-25e4dfe8-5093-4673-854b-267efdb48b31 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:52.229586 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-19f55118-b2fe-4ab3-bfdb-25388818ecb1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:52.240650 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-19f55118-b2fe-4ab3-bfdb-25388818ecb1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b" status: 200 len: 1469 microversion: 2.1 time: 0.519971 Oct 17 13:50:52.246254 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1799/3625] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:51 2022] GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b => generated 1469 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:52.248932 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-25e4dfe8-5093-4673-854b-267efdb48b31 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683d18db860a4d60ab3eeba2a372b2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11973b8e1d8a4af8add65726e8ba7c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:52.263742 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6928ecff-ec16-4592-bd75-5b29efb9f58a tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:52.264380 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6928ecff-ec16-4592-bd75-5b29efb9f58a tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:52.269145 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-25e4dfe8-5093-4673-854b-267efdb48b31 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c" status: 200 len: 1670 microversion: 2.1 time: 0.492743 Oct 17 13:50:52.270374 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1827/3626] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:51 2022] GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c => generated 1670 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:50:52.272588 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6928ecff-ec16-4592-bd75-5b29efb9f58a tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:52.273084 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6928ecff-ec16-4592-bd75-5b29efb9f58a tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:52.276605 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6928ecff-ec16-4592-bd75-5b29efb9f58a tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:52.277373 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6928ecff-ec16-4592-bd75-5b29efb9f58a tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:52.277857 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6928ecff-ec16-4592-bd75-5b29efb9f58a tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:52.278294 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6928ecff-ec16-4592-bd75-5b29efb9f58a tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:52.450247 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6928ecff-ec16-4592-bd75-5b29efb9f58a tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:52.461843 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6928ecff-ec16-4592-bd75-5b29efb9f58a tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e" status: 200 len: 1299 microversion: 2.1 time: 0.212530 Oct 17 13:50:52.462519 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1800/3627] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:52 2022] GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e => generated 1299 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:52.736819 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-131df2e7-81f5-421c-8454-9d73e9b676a8 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:52.739951 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-131df2e7-81f5-421c-8454-9d73e9b676a8 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] [instance: f5d52166-ed04-4313-8929-821bbae17f68] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:52.770160 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-131df2e7-81f5-421c-8454-9d73e9b676a8 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:52.770533 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-131df2e7-81f5-421c-8454-9d73e9b676a8 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:52.772333 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-131df2e7-81f5-421c-8454-9d73e9b676a8 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:52.774610 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-131df2e7-81f5-421c-8454-9d73e9b676a8 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:52.775094 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-131df2e7-81f5-421c-8454-9d73e9b676a8 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:52.776172 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-131df2e7-81f5-421c-8454-9d73e9b676a8 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:53.153179 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-131df2e7-81f5-421c-8454-9d73e9b676a8 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef890da37cc444380f1c373ffbf1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a584b724ab934dd59315d9c644f11cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:53.156451 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:50:53.163528 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-131df2e7-81f5-421c-8454-9d73e9b676a8 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] 10.222.0.79 "GET /compute/v2.1/servers/f5d52166-ed04-4313-8929-821bbae17f68" status: 200 len: 1605 microversion: 2.1 time: 0.431745 Oct 17 13:50:53.180375 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1828/3628] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:52 2022] GET /compute/v2.1/servers/f5d52166-ed04-4313-8929-821bbae17f68 => generated 1605 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:53.276930 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-adb3c2fb-42e8-4481-baad-abd4c20d7642 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:53.277743 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-adb3c2fb-42e8-4481-baad-abd4c20d7642 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:53.295470 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-adb3c2fb-42e8-4481-baad-abd4c20d7642 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:53.296248 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-adb3c2fb-42e8-4481-baad-abd4c20d7642 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:53.296800 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-adb3c2fb-42e8-4481-baad-abd4c20d7642 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:53.297788 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-adb3c2fb-42e8-4481-baad-abd4c20d7642 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:53.298345 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-adb3c2fb-42e8-4481-baad-abd4c20d7642 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:53.298860 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-adb3c2fb-42e8-4481-baad-abd4c20d7642 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:53.300168 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-87650206-352b-41f3-a76e-8b65de356021 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:53.301216 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-87650206-352b-41f3-a76e-8b65de356021 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: a2994495-366a-446f-b7a6-16340911e17c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:53.317180 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-87650206-352b-41f3-a76e-8b65de356021 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:53.317951 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-87650206-352b-41f3-a76e-8b65de356021 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:53.318709 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-87650206-352b-41f3-a76e-8b65de356021 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:53.320432 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-87650206-352b-41f3-a76e-8b65de356021 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:53.321949 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-87650206-352b-41f3-a76e-8b65de356021 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:53.326691 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-87650206-352b-41f3-a76e-8b65de356021 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:54.219934 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-adb3c2fb-42e8-4481-baad-abd4c20d7642 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:54.228569 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-adb3c2fb-42e8-4481-baad-abd4c20d7642 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b" status: 200 len: 1469 microversion: 2.1 time: 0.957672 Oct 17 13:50:54.243698 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1801/3629] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:53 2022] GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b => generated 1469 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:54.255116 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e8546f86-185a-448c-8a90-2179f5753c22 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:54.264100 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e8546f86-185a-448c-8a90-2179f5753c22 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:54.276307 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e8546f86-185a-448c-8a90-2179f5753c22 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:54.277064 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e8546f86-185a-448c-8a90-2179f5753c22 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:54.278093 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e8546f86-185a-448c-8a90-2179f5753c22 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:54.278965 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e8546f86-185a-448c-8a90-2179f5753c22 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:54.279636 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e8546f86-185a-448c-8a90-2179f5753c22 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:54.280432 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e8546f86-185a-448c-8a90-2179f5753c22 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:54.308702 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-87650206-352b-41f3-a76e-8b65de356021 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683d18db860a4d60ab3eeba2a372b2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11973b8e1d8a4af8add65726e8ba7c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:54.333921 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-87650206-352b-41f3-a76e-8b65de356021 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c" status: 200 len: 1670 microversion: 2.1 time: 1.037991 Oct 17 13:50:54.357577 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1829/3630] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:53 2022] GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c => generated 1670 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:54.362923 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7c92f2d4-d2bc-47e0-acef-3ad1b68add9a tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:54.377558 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7c92f2d4-d2bc-47e0-acef-3ad1b68add9a tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] [instance: f5d52166-ed04-4313-8929-821bbae17f68] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:54.400492 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7c92f2d4-d2bc-47e0-acef-3ad1b68add9a tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:54.401014 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7c92f2d4-d2bc-47e0-acef-3ad1b68add9a tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:54.401797 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7c92f2d4-d2bc-47e0-acef-3ad1b68add9a tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:54.429976 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7c92f2d4-d2bc-47e0-acef-3ad1b68add9a tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:54.430732 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7c92f2d4-d2bc-47e0-acef-3ad1b68add9a tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:54.448898 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7c92f2d4-d2bc-47e0-acef-3ad1b68add9a tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:54.647377 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7c92f2d4-d2bc-47e0-acef-3ad1b68add9a tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef890da37cc444380f1c373ffbf1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a584b724ab934dd59315d9c644f11cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:54.664825 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7c92f2d4-d2bc-47e0-acef-3ad1b68add9a tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] 10.222.0.79 "GET /compute/v2.1/servers/f5d52166-ed04-4313-8929-821bbae17f68" status: 200 len: 1538 microversion: 2.1 time: 0.305678 Oct 17 13:50:54.668277 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1830/3631] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:54 2022] GET /compute/v2.1/servers/f5d52166-ed04-4313-8929-821bbae17f68 => generated 1538 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:54.754529 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e8546f86-185a-448c-8a90-2179f5753c22 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:54.767553 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e8546f86-185a-448c-8a90-2179f5753c22 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e" status: 200 len: 1367 microversion: 2.1 time: 0.520822 Oct 17 13:50:54.768495 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1802/3632] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:54 2022] GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e => generated 1367 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:54.790934 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-b0779c21-ef89-4c9f-9ff1-26cfd3f37c69 req-6d5d59be-e913-494f-b6d5-3258ab0f08f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50464f17-c798-4c70-b1c9-0f90c55def6b", "name": "network-vif-plugged", "status": "completed", "tag": "cb1b920d-1ee0-48dd-ade7-68e1d575df70"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:50:54.806730 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-b0779c21-ef89-4c9f-9ff1-26cfd3f37c69 req-6d5d59be-e913-494f-b6d5-3258ab0f08f7 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:54.807638 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-b0779c21-ef89-4c9f-9ff1-26cfd3f37c69 req-6d5d59be-e913-494f-b6d5-3258ab0f08f7 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:54.808231 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-b0779c21-ef89-4c9f-9ff1-26cfd3f37c69 req-6d5d59be-e913-494f-b6d5-3258ab0f08f7 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:54.838029 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-b0779c21-ef89-4c9f-9ff1-26cfd3f37c69 req-6d5d59be-e913-494f-b6d5-3258ab0f08f7 service nova] Creating event network-vif-plugged:cb1b920d-1ee0-48dd-ade7-68e1d575df70 for instance 50464f17-c798-4c70-b1c9-0f90c55def6b on n-h1-854247-14 Oct 17 13:50:54.845332 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [req-b0779c21-ef89-4c9f-9ff1-26cfd3f37c69 req-6d5d59be-e913-494f-b6d5-3258ab0f08f7 service nova] Instance 50464f17-c798-4c70-b1c9-0f90c55def6b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854247-14', 'n-h1-854247-14'} {{(pid=127016) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:50:54.870046 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-b0779c21-ef89-4c9f-9ff1-26cfd3f37c69 req-6d5d59be-e913-494f-b6d5-3258ab0f08f7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102768 Oct 17 13:50:54.871232 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1831/3633] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:50:55.013599 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-1c444bc4-d5bc-4e3b-b9b6-7045d6cf9af5 req-f4b77ee3-b28c-4b88-855c-c1f2f987d98b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5d52166-ed04-4313-8929-821bbae17f68", "name": "network-vif-deleted", "tag": "8d25e9b2-a5d2-482c-9ca9-2f5cb2363bea"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:50:55.031727 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-1c444bc4-d5bc-4e3b-b9b6-7045d6cf9af5 req-f4b77ee3-b28c-4b88-855c-c1f2f987d98b service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:55.034395 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-1c444bc4-d5bc-4e3b-b9b6-7045d6cf9af5 req-f4b77ee3-b28c-4b88-855c-c1f2f987d98b service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:55.036296 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-1c444bc4-d5bc-4e3b-b9b6-7045d6cf9af5 req-f4b77ee3-b28c-4b88-855c-c1f2f987d98b service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:55.063389 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-1c444bc4-d5bc-4e3b-b9b6-7045d6cf9af5 req-f4b77ee3-b28c-4b88-855c-c1f2f987d98b service nova] Creating event network-vif-deleted:8d25e9b2-a5d2-482c-9ca9-2f5cb2363bea for instance f5d52166-ed04-4313-8929-821bbae17f68 on n-h1-854247-14 Oct 17 13:50:55.066949 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-e325c37b-1324-42fc-8bde-7e0e726a9f7f req-5984dde1-f534-4f80-9429-f038a8b52e73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2994495-366a-446f-b7a6-16340911e17c", "name": "network-vif-deleted", "tag": "f61459cf-c1c5-4d16-ab2f-16ab1c0ba28c"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:50:55.071425 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-1c444bc4-d5bc-4e3b-b9b6-7045d6cf9af5 req-f4b77ee3-b28c-4b88-855c-c1f2f987d98b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061711 Oct 17 13:50:55.073418 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1803/3634] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:50:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:50:55.087791 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-e325c37b-1324-42fc-8bde-7e0e726a9f7f req-5984dde1-f534-4f80-9429-f038a8b52e73 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:55.088276 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-e325c37b-1324-42fc-8bde-7e0e726a9f7f req-5984dde1-f534-4f80-9429-f038a8b52e73 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:55.088767 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-e325c37b-1324-42fc-8bde-7e0e726a9f7f req-5984dde1-f534-4f80-9429-f038a8b52e73 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:55.112165 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-e325c37b-1324-42fc-8bde-7e0e726a9f7f req-5984dde1-f534-4f80-9429-f038a8b52e73 service nova] Creating event network-vif-deleted:f61459cf-c1c5-4d16-ab2f-16ab1c0ba28c for instance a2994495-366a-446f-b7a6-16340911e17c on n-h2-854247-14 Oct 17 13:50:55.118562 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-e325c37b-1324-42fc-8bde-7e0e726a9f7f req-5984dde1-f534-4f80-9429-f038a8b52e73 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055631 Oct 17 13:50:55.120042 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1832/3635] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:50:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:50:55.256793 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b25b84fa-451e-42fe-8041-007159605fe2 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:55.257663 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b25b84fa-451e-42fe-8041-007159605fe2 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:55.265181 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b25b84fa-451e-42fe-8041-007159605fe2 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:55.267272 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b25b84fa-451e-42fe-8041-007159605fe2 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:55.268161 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b25b84fa-451e-42fe-8041-007159605fe2 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:55.269742 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b25b84fa-451e-42fe-8041-007159605fe2 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:55.270475 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b25b84fa-451e-42fe-8041-007159605fe2 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:55.271071 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b25b84fa-451e-42fe-8041-007159605fe2 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:55.362840 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d76cd9c2-1f4a-43b8-87e0-3b453d1f9453 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:55.364296 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d76cd9c2-1f4a-43b8-87e0-3b453d1f9453 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: a2994495-366a-446f-b7a6-16340911e17c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:55.386115 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d76cd9c2-1f4a-43b8-87e0-3b453d1f9453 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:55.387086 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d76cd9c2-1f4a-43b8-87e0-3b453d1f9453 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:55.387925 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d76cd9c2-1f4a-43b8-87e0-3b453d1f9453 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:55.389156 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d76cd9c2-1f4a-43b8-87e0-3b453d1f9453 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:55.393185 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d76cd9c2-1f4a-43b8-87e0-3b453d1f9453 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:55.395364 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d76cd9c2-1f4a-43b8-87e0-3b453d1f9453 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:55.468091 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d76cd9c2-1f4a-43b8-87e0-3b453d1f9453 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:55.470185 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d76cd9c2-1f4a-43b8-87e0-3b453d1f9453 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:55.471978 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d76cd9c2-1f4a-43b8-87e0-3b453d1f9453 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:55.478743 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-d76cd9c2-1f4a-43b8-87e0-3b453d1f9453 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lazy-loading 'fault' on Instance uuid a2994495-366a-446f-b7a6-16340911e17c {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:50:55.580289 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d76cd9c2-1f4a-43b8-87e0-3b453d1f9453 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683d18db860a4d60ab3eeba2a372b2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11973b8e1d8a4af8add65726e8ba7c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:55.592294 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d76cd9c2-1f4a-43b8-87e0-3b453d1f9453 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c" status: 200 len: 1325 microversion: 2.1 time: 0.234483 Oct 17 13:50:55.601808 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1833/3636] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:55 2022] GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c => generated 1325 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:55.615803 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b209522c-2357-4ee9-aa49-4848a43fcfe1 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "77d7b55b-2e3d-411c-a86b-6aad4731ff76"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:50:55.620978 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b209522c-2357-4ee9-aa49-4848a43fcfe1 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 3197da72-e924-4f50-8c93-c3f3ff98e084] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:55.638374 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b209522c-2357-4ee9-aa49-4848a43fcfe1 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:55.639020 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b209522c-2357-4ee9-aa49-4848a43fcfe1 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:55.639502 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b209522c-2357-4ee9-aa49-4848a43fcfe1 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:55.640234 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b209522c-2357-4ee9-aa49-4848a43fcfe1 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:55.640695 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b209522c-2357-4ee9-aa49-4848a43fcfe1 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:55.641120 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b209522c-2357-4ee9-aa49-4848a43fcfe1 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:55.806092 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b25b84fa-451e-42fe-8041-007159605fe2 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:55.816009 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b25b84fa-451e-42fe-8041-007159605fe2 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b" status: 200 len: 1469 microversion: 2.1 time: 0.565411 Oct 17 13:50:55.832117 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1804/3637] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:55 2022] GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b => generated 1469 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:55.837163 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e7407298-c7f3-486a-98b5-eb20e44b668f tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:55.837783 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e7407298-c7f3-486a-98b5-eb20e44b668f tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] [instance: f5d52166-ed04-4313-8929-821bbae17f68] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:55.844616 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e7407298-c7f3-486a-98b5-eb20e44b668f tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:55.845115 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e7407298-c7f3-486a-98b5-eb20e44b668f tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:55.845565 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e7407298-c7f3-486a-98b5-eb20e44b668f tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:55.846275 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e7407298-c7f3-486a-98b5-eb20e44b668f tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:55.846728 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e7407298-c7f3-486a-98b5-eb20e44b668f tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:55.847234 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e7407298-c7f3-486a-98b5-eb20e44b668f tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:55.979063 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e7407298-c7f3-486a-98b5-eb20e44b668f tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef890da37cc444380f1c373ffbf1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a584b724ab934dd59315d9c644f11cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:55.992182 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e7407298-c7f3-486a-98b5-eb20e44b668f tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] 10.222.0.79 "GET /compute/v2.1/servers/f5d52166-ed04-4313-8929-821bbae17f68" status: 200 len: 1250 microversion: 2.1 time: 0.172024 Oct 17 13:50:55.993872 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1805/3638] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:55 2022] GET /compute/v2.1/servers/f5d52166-ed04-4313-8929-821bbae17f68 => generated 1250 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:56.011503 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f0c41c57-1192-49a2-8e38-857794e2c411 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:56.012337 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f0c41c57-1192-49a2-8e38-857794e2c411 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:56.039218 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f0c41c57-1192-49a2-8e38-857794e2c411 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:56.039793 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f0c41c57-1192-49a2-8e38-857794e2c411 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:56.040234 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f0c41c57-1192-49a2-8e38-857794e2c411 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:56.040946 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f0c41c57-1192-49a2-8e38-857794e2c411 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:56.041607 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f0c41c57-1192-49a2-8e38-857794e2c411 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:56.042042 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f0c41c57-1192-49a2-8e38-857794e2c411 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:56.302547 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b209522c-2357-4ee9-aa49-4848a43fcfe1 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "POST /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.699354 Oct 17 13:50:56.307308 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1834/3639] 10.222.0.79 () {60 vars in 1323 bytes} [Mon Oct 17 13:50:55 2022] POST /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084/os-volume_attachments => generated 194 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:50:56.318147 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f0c41c57-1192-49a2-8e38-857794e2c411 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:56.344008 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f0c41c57-1192-49a2-8e38-857794e2c411 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e" status: 200 len: 1367 microversion: 2.1 time: 0.347707 Oct 17 13:50:56.348806 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1806/3640] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:55 2022] GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e => generated 1367 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:56.626232 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-02a94fe9-8274-4a5e-93cd-28e2a56440d1 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:56.627277 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-02a94fe9-8274-4a5e-93cd-28e2a56440d1 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: a2994495-366a-446f-b7a6-16340911e17c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:56.645500 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-02a94fe9-8274-4a5e-93cd-28e2a56440d1 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:56.646390 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-02a94fe9-8274-4a5e-93cd-28e2a56440d1 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:56.647079 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-02a94fe9-8274-4a5e-93cd-28e2a56440d1 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:56.648008 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-02a94fe9-8274-4a5e-93cd-28e2a56440d1 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:56.648630 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-02a94fe9-8274-4a5e-93cd-28e2a56440d1 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:56.649360 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-02a94fe9-8274-4a5e-93cd-28e2a56440d1 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:56.674805 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-02a94fe9-8274-4a5e-93cd-28e2a56440d1 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] HTTP exception thrown: Instance a2994495-366a-446f-b7a6-16340911e17c could not be found. Oct 17 13:50:56.679660 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-02a94fe9-8274-4a5e-93cd-28e2a56440d1 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Request method failure captured: Oct 17 13:50:56.679660 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c HTTP/1.1 Oct 17 13:50:56.679660 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:50:56.679660 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:50:56.679660 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:50:56.679660 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:50:56.679660 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:50:56.679660 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:50:56.679660 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:50:56.679660 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:50:56.679660 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVzj7ySRjNRGWeLZhuOn9q-1zQEMM4cm4f1Hd3un42c2zlaS1Crq4DnN26vS4u-r9RlLxn9BBcFV2T6QJYLkUmK8IYzpajU2f5b8Nv4JJmW6GJSH7eSOWEJIthN2nve8_TpMYj0RwNzzlkurCU_UZmVG-U7xXVbyvUUBd_Ch7Kacuyc Oct 17 13:50:56.679660 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:50:56.679660 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:50:56.679660 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:50:56.679660 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:50:56.679660 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:50:56.679660 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:50:56.679660 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 11973b8e1d8a4af8add65726e8ba7c83 Oct 17 13:50:56.679660 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-AttachVolumeTestJSON-829991168 Oct 17 13:50:56.679660 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:50:56.679660 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:50:56.679660 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/11973b8e1d8a4af8add65726e8ba7c83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/11973b8e1d8a4af8add65726e8ba7c83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/11973b8e1d8a4af8add65726e8ba7c83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_11973b8e1d8a4af8add65726e8ba7c83", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:50:56.679660 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-AttachVolumeTestJSON-829991168 Oct 17 13:50:56.679660 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 11973b8e1d8a4af8add65726e8ba7c83 Oct 17 13:50:56.679660 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-AttachVolumeTestJSON-829991168 Oct 17 13:50:56.679660 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-AttachVolumeTestJSON-829991168-project Oct 17 13:50:56.679660 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:50:56.679660 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:50:56.679660 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 683d18db860a4d60ab3eeba2a372b2c5 Oct 17 13:50:56.679660 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-AttachVolumeTestJSON-829991168-project Oct 17 13:50:56.679660 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:50:56.679660 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance a2994495-366a-446f-b7a6-16340911e17c could not be found. Oct 17 13:50:56.679660 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'a2994495-366a-446f-b7a6-16340911e17c'} Oct 17 13:50:56.679660 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:50:56.679660 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:50:56.679660 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:50:56.679660 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:50:56.679660 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:50:56.679660 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:50:56.679660 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:50:56.679660 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:50:56.679660 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:50:56.679660 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:50:56.679660 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2994495-366a-446f-b7a6-16340911e17c could not be found. Oct 17 13:50:56.679660 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:50:56.679660 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:50:56.679660 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:50:56.679660 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:50:56.679660 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:50:56.679660 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:50:56.679660 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:50:56.679660 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:50:56.679660 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:50:56.679660 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:50:56.679660 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:50:56.679660 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:50:56.679660 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:50:56.679660 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:50:56.679660 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:50:56.679660 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:50:56.679660 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2994495-366a-446f-b7a6-16340911e17c could not be found. Oct 17 13:50:56.679660 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:50:56.679660 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:50:56.679660 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:50:56.684255 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:50:56.684255 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:50:56.684255 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:50:56.684255 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:50:56.684255 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:50:56.684255 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2994495-366a-446f-b7a6-16340911e17c could not be found. Oct 17 13:50:56.684255 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:50:56.684255 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-02a94fe9-8274-4a5e-93cd-28e2a56440d1 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Returning 404 to user: Instance a2994495-366a-446f-b7a6-16340911e17c could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:50:56.684255 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-02a94fe9-8274-4a5e-93cd-28e2a56440d1 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c" status: 404 len: 111 microversion: 2.1 time: 0.061738 Oct 17 13:50:56.685921 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1835/3641] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:56 2022] GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:50:56.694431 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ee744200-0fbe-4ab9-9c6d-25a750d7ba85 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '.version_select at 0x7f7cd4763b80>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:56.728647 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ee744200-0fbe-4ab9-9c6d-25a750d7ba85 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-80570820" status: 202 len: 0 microversion: 2.1 time: 0.036099 Oct 17 13:50:56.730654 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1807/3642] 10.222.0.79 () {58 vars in 1215 bytes} [Mon Oct 17 13:50:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-80570820 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:50:56.840200 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-faba28c5-74dc-46ce-a8e1-1f77c01993ad tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:56.840718 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-faba28c5-74dc-46ce-a8e1-1f77c01993ad tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:56.849571 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-faba28c5-74dc-46ce-a8e1-1f77c01993ad tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:56.863699 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-faba28c5-74dc-46ce-a8e1-1f77c01993ad tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:56.864167 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-faba28c5-74dc-46ce-a8e1-1f77c01993ad tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:56.871998 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-faba28c5-74dc-46ce-a8e1-1f77c01993ad tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:56.872521 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-faba28c5-74dc-46ce-a8e1-1f77c01993ad tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:56.872967 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-faba28c5-74dc-46ce-a8e1-1f77c01993ad tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:57.018157 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4a24f00a-7726-448c-b2cc-8016974fd878 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:57.020788 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4a24f00a-7726-448c-b2cc-8016974fd878 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] [instance: f5d52166-ed04-4313-8929-821bbae17f68] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:57.032673 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4a24f00a-7726-448c-b2cc-8016974fd878 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:57.035969 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4a24f00a-7726-448c-b2cc-8016974fd878 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:57.036729 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4a24f00a-7726-448c-b2cc-8016974fd878 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:57.039824 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4a24f00a-7726-448c-b2cc-8016974fd878 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:57.040526 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4a24f00a-7726-448c-b2cc-8016974fd878 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:57.046103 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4a24f00a-7726-448c-b2cc-8016974fd878 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:57.133440 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:50:57.159414 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=6 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:50:57.248330 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-faba28c5-74dc-46ce-a8e1-1f77c01993ad tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:57.262134 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4a24f00a-7726-448c-b2cc-8016974fd878 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef890da37cc444380f1c373ffbf1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a584b724ab934dd59315d9c644f11cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:57.266407 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-faba28c5-74dc-46ce-a8e1-1f77c01993ad tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b" status: 200 len: 1469 microversion: 2.1 time: 0.421556 Oct 17 13:50:57.290464 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1836/3643] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:56 2022] GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b => generated 1469 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:57.294561 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4a24f00a-7726-448c-b2cc-8016974fd878 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] 10.222.0.79 "GET /compute/v2.1/servers/f5d52166-ed04-4313-8929-821bbae17f68" status: 200 len: 1250 microversion: 2.1 time: 0.281604 Oct 17 13:50:57.308184 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1808/3644] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:57 2022] GET /compute/v2.1/servers/f5d52166-ed04-4313-8929-821bbae17f68 => generated 1250 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:50:57.310225 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-f7562c66-0ebd-4494-902b-917189562d37 req-8e5d57cf-1e7c-43f4-b85d-a61fb66f44c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e", "tag": "8cc688d9-f7d0-40a2-ad9e-33689003bb82"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:50:57.325588 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-f7562c66-0ebd-4494-902b-917189562d37 req-8e5d57cf-1e7c-43f4-b85d-a61fb66f44c0 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:57.326106 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-f7562c66-0ebd-4494-902b-917189562d37 req-8e5d57cf-1e7c-43f4-b85d-a61fb66f44c0 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:57.326534 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-f7562c66-0ebd-4494-902b-917189562d37 req-8e5d57cf-1e7c-43f4-b85d-a61fb66f44c0 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:57.340219 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-f7562c66-0ebd-4494-902b-917189562d37 req-8e5d57cf-1e7c-43f4-b85d-a61fb66f44c0 service nova] Creating event network-changed:8cc688d9-f7d0-40a2-ad9e-33689003bb82 for instance 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e on n-h1-854247-14 Oct 17 13:50:57.345144 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-f7562c66-0ebd-4494-902b-917189562d37 req-8e5d57cf-1e7c-43f4-b85d-a61fb66f44c0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053356 Oct 17 13:50:57.345947 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1837/3645] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:50:57.368886 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-daa46fc5-a6d3-42ef-835e-bef1f2a19131 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:57.370221 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-daa46fc5-a6d3-42ef-835e-bef1f2a19131 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:57.384380 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-daa46fc5-a6d3-42ef-835e-bef1f2a19131 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:57.385160 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-daa46fc5-a6d3-42ef-835e-bef1f2a19131 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:57.385749 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-daa46fc5-a6d3-42ef-835e-bef1f2a19131 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:57.386702 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-daa46fc5-a6d3-42ef-835e-bef1f2a19131 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:57.388454 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-daa46fc5-a6d3-42ef-835e-bef1f2a19131 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:57.389169 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-daa46fc5-a6d3-42ef-835e-bef1f2a19131 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:58.233684 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-daa46fc5-a6d3-42ef-835e-bef1f2a19131 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:58.251230 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-daa46fc5-a6d3-42ef-835e-bef1f2a19131 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e" status: 200 len: 1367 microversion: 2.1 time: 0.886475 Oct 17 13:50:58.254487 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1809/3646] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:57 2022] GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e => generated 1367 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:58.293653 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6fc5a317-9a22-4354-a052-469dd8269b42 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:58.294352 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6fc5a317-9a22-4354-a052-469dd8269b42 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:58.321074 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6fc5a317-9a22-4354-a052-469dd8269b42 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:58.321771 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e36cae89-1164-4957-a654-45fa79d1a46c tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:58.321950 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6fc5a317-9a22-4354-a052-469dd8269b42 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:58.322513 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e36cae89-1164-4957-a654-45fa79d1a46c tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] [instance: f5d52166-ed04-4313-8929-821bbae17f68] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:58.323057 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6fc5a317-9a22-4354-a052-469dd8269b42 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:58.324295 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6fc5a317-9a22-4354-a052-469dd8269b42 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:58.324909 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6fc5a317-9a22-4354-a052-469dd8269b42 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:58.325640 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6fc5a317-9a22-4354-a052-469dd8269b42 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:58.335675 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e36cae89-1164-4957-a654-45fa79d1a46c tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:58.336173 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e36cae89-1164-4957-a654-45fa79d1a46c tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:58.336612 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e36cae89-1164-4957-a654-45fa79d1a46c tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:58.337323 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e36cae89-1164-4957-a654-45fa79d1a46c tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:58.337771 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e36cae89-1164-4957-a654-45fa79d1a46c tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:58.338192 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e36cae89-1164-4957-a654-45fa79d1a46c tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:58.490518 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=4 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:50:58.516949 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e36cae89-1164-4957-a654-45fa79d1a46c tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef890da37cc444380f1c373ffbf1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a584b724ab934dd59315d9c644f11cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:58.525504 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e36cae89-1164-4957-a654-45fa79d1a46c tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] 10.222.0.79 "GET /compute/v2.1/servers/f5d52166-ed04-4313-8929-821bbae17f68" status: 200 len: 1250 microversion: 2.1 time: 0.207728 Oct 17 13:50:58.526598 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1810/3647] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:58 2022] GET /compute/v2.1/servers/f5d52166-ed04-4313-8929-821bbae17f68 => generated 1250 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:50:58.538098 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c4b072ce-a5fc-4f50-9e98-dea7b6db7255 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Action: 'create', calling method: .version_select at 0x7f7cd46f7940>, body: {"keypair": {"name": "tempest-keypair-2081898665", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1nzQl8QczBE4nRV5+KPXLpFiUzUi+FKdR1ch2HqbdLQjgFvhAsNUOJZdk+qnpAMQfT7W/QtWhY4OUZcXlZqqQXp5kheno9+o9yerG4aygUpXf9W6QuTXuPk+DTg9Sndw=="}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:50:58.555223 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=8 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:50:58.557663 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-c4b072ce-a5fc-4f50-9e98-dea7b6db7255 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Getting quotas for project 11973b8e1d8a4af8add65726e8ba7c83. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:50:58.563092 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-c4b072ce-a5fc-4f50-9e98-dea7b6db7255 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Getting quotas for user 683d18db860a4d60ab3eeba2a372b2c5 and project 11973b8e1d8a4af8add65726e8ba7c83. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:50:58.588814 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c4b072ce-a5fc-4f50-9e98-dea7b6db7255 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.060788 Oct 17 13:50:58.589799 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1811/3648] 10.222.0.79 () {60 vars in 1159 bytes} [Mon Oct 17 13:50:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:50:58.762651 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6fc5a317-9a22-4354-a052-469dd8269b42 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:58.777731 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6fc5a317-9a22-4354-a052-469dd8269b42 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b" status: 200 len: 1469 microversion: 2.1 time: 0.489265 Oct 17 13:50:58.779273 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1838/3649] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:58 2022] GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b => generated 1469 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:58.940138 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-b50a5f99-95dd-4869-b0a8-84d26c59817a req-bf0b305b-9c99-4ec3-a7ea-77155bbe1e73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50464f17-c798-4c70-b1c9-0f90c55def6b", "name": "network-vif-unplugged", "status": "completed", "tag": "cb1b920d-1ee0-48dd-ade7-68e1d575df70"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:50:58.962011 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-b50a5f99-95dd-4869-b0a8-84d26c59817a req-bf0b305b-9c99-4ec3-a7ea-77155bbe1e73 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:58.962826 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-b50a5f99-95dd-4869-b0a8-84d26c59817a req-bf0b305b-9c99-4ec3-a7ea-77155bbe1e73 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:58.963845 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-b50a5f99-95dd-4869-b0a8-84d26c59817a req-bf0b305b-9c99-4ec3-a7ea-77155bbe1e73 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:58.983105 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-b50a5f99-95dd-4869-b0a8-84d26c59817a req-bf0b305b-9c99-4ec3-a7ea-77155bbe1e73 service nova] Creating event network-vif-unplugged:cb1b920d-1ee0-48dd-ade7-68e1d575df70 for instance 50464f17-c798-4c70-b1c9-0f90c55def6b on n-h2-854247-14 Oct 17 13:50:58.993945 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [req-b50a5f99-95dd-4869-b0a8-84d26c59817a req-bf0b305b-9c99-4ec3-a7ea-77155bbe1e73 service nova] Instance 50464f17-c798-4c70-b1c9-0f90c55def6b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854247-14', 'n-h2-854247-14'} {{(pid=127017) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:50:59.011988 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-b50a5f99-95dd-4869-b0a8-84d26c59817a req-bf0b305b-9c99-4ec3-a7ea-77155bbe1e73 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080814 Oct 17 13:50:59.013873 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1812/3650] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:50:59.286410 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c914db55-a8d0-4ebc-8eeb-a4a5c28f56a5 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:59.287021 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c914db55-a8d0-4ebc-8eeb-a4a5c28f56a5 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:59.303348 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c914db55-a8d0-4ebc-8eeb-a4a5c28f56a5 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:59.304581 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c914db55-a8d0-4ebc-8eeb-a4a5c28f56a5 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:59.305322 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c914db55-a8d0-4ebc-8eeb-a4a5c28f56a5 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:59.306309 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c914db55-a8d0-4ebc-8eeb-a4a5c28f56a5 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:59.306928 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c914db55-a8d0-4ebc-8eeb-a4a5c28f56a5 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:59.307539 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c914db55-a8d0-4ebc-8eeb-a4a5c28f56a5 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:59.551488 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-52157880-950d-45ec-982c-d8e1250d5d75 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:59.552310 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-52157880-950d-45ec-982c-d8e1250d5d75 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] [instance: f5d52166-ed04-4313-8929-821bbae17f68] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:59.557996 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=2,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:50:59.575253 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-52157880-950d-45ec-982c-d8e1250d5d75 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:59.576131 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-52157880-950d-45ec-982c-d8e1250d5d75 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:59.578024 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-52157880-950d-45ec-982c-d8e1250d5d75 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:59.579960 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-52157880-950d-45ec-982c-d8e1250d5d75 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:59.581558 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-52157880-950d-45ec-982c-d8e1250d5d75 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:59.582743 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-52157880-950d-45ec-982c-d8e1250d5d75 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:59.628540 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c914db55-a8d0-4ebc-8eeb-a4a5c28f56a5 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:59.638166 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c914db55-a8d0-4ebc-8eeb-a4a5c28f56a5 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e" status: 200 len: 1367 microversion: 2.1 time: 0.360393 Oct 17 13:50:59.642446 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1839/3651] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:59 2022] GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e => generated 1367 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:59.804478 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-072cd982-4159-409a-979d-9ec9f8737a43 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:59.805499 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-072cd982-4159-409a-979d-9ec9f8737a43 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:59.820673 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-072cd982-4159-409a-979d-9ec9f8737a43 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:59.823682 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-072cd982-4159-409a-979d-9ec9f8737a43 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:59.824704 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-072cd982-4159-409a-979d-9ec9f8737a43 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:59.825770 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-072cd982-4159-409a-979d-9ec9f8737a43 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:59.828822 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-072cd982-4159-409a-979d-9ec9f8737a43 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:59.829548 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-072cd982-4159-409a-979d-9ec9f8737a43 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:59.904989 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-52157880-950d-45ec-982c-d8e1250d5d75 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef890da37cc444380f1c373ffbf1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a584b724ab934dd59315d9c644f11cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:59.916613 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-52157880-950d-45ec-982c-d8e1250d5d75 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] 10.222.0.79 "GET /compute/v2.1/servers/f5d52166-ed04-4313-8929-821bbae17f68" status: 200 len: 1250 microversion: 2.1 time: 0.370856 Oct 17 13:50:59.920695 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1813/3652] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:59 2022] GET /compute/v2.1/servers/f5d52166-ed04-4313-8929-821bbae17f68 => generated 1250 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:00.199929 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-072cd982-4159-409a-979d-9ec9f8737a43 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:00.212100 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-072cd982-4159-409a-979d-9ec9f8737a43 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b" status: 200 len: 1469 microversion: 2.1 time: 0.413717 Oct 17 13:51:00.212701 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1840/3653] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:59 2022] GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b => generated 1469 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:00.693247 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-33e2e8c0-e208-40cb-a824-6b40f29aa3c9 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:00.694051 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-33e2e8c0-e208-40cb-a824-6b40f29aa3c9 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:00.702555 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-33e2e8c0-e208-40cb-a824-6b40f29aa3c9 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:00.703216 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-33e2e8c0-e208-40cb-a824-6b40f29aa3c9 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:00.703759 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-33e2e8c0-e208-40cb-a824-6b40f29aa3c9 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:00.704590 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-33e2e8c0-e208-40cb-a824-6b40f29aa3c9 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:00.707656 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-33e2e8c0-e208-40cb-a824-6b40f29aa3c9 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:00.708054 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-33e2e8c0-e208-40cb-a824-6b40f29aa3c9 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:00.908013 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-33e2e8c0-e208-40cb-a824-6b40f29aa3c9 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:00.920165 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-33e2e8c0-e208-40cb-a824-6b40f29aa3c9 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e" status: 200 len: 1367 microversion: 2.1 time: 0.239351 Oct 17 13:51:00.948690 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fff427da-595d-440f-9905-3bfbfa77a122 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:00.950127 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-fff427da-595d-440f-9905-3bfbfa77a122 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] [instance: f5d52166-ed04-4313-8929-821bbae17f68] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:00.954245 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1814/3654] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:00 2022] GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e => generated 1367 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:00.959949 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fff427da-595d-440f-9905-3bfbfa77a122 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:00.960781 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fff427da-595d-440f-9905-3bfbfa77a122 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:00.961435 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fff427da-595d-440f-9905-3bfbfa77a122 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:00.962413 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fff427da-595d-440f-9905-3bfbfa77a122 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:00.963070 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fff427da-595d-440f-9905-3bfbfa77a122 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:00.963725 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fff427da-595d-440f-9905-3bfbfa77a122 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:01.048170 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-5b67f86a-2229-4665-85bd-7583fe9e8b26 req-01bf1d4d-406b-45f0-8faf-0106ef3b4f36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50464f17-c798-4c70-b1c9-0f90c55def6b", "tag": "cb1b920d-1ee0-48dd-ade7-68e1d575df70"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:51:01.069973 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-5b67f86a-2229-4665-85bd-7583fe9e8b26 req-01bf1d4d-406b-45f0-8faf-0106ef3b4f36 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:01.070484 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-5b67f86a-2229-4665-85bd-7583fe9e8b26 req-01bf1d4d-406b-45f0-8faf-0106ef3b4f36 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:01.073237 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-5b67f86a-2229-4665-85bd-7583fe9e8b26 req-01bf1d4d-406b-45f0-8faf-0106ef3b4f36 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:01.104724 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fff427da-595d-440f-9905-3bfbfa77a122 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef890da37cc444380f1c373ffbf1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a584b724ab934dd59315d9c644f11cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:01.116645 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-5b67f86a-2229-4665-85bd-7583fe9e8b26 req-01bf1d4d-406b-45f0-8faf-0106ef3b4f36 service nova] Creating event network-changed:cb1b920d-1ee0-48dd-ade7-68e1d575df70 for instance 50464f17-c798-4c70-b1c9-0f90c55def6b on n-h2-854247-14 Oct 17 13:51:01.119829 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fff427da-595d-440f-9905-3bfbfa77a122 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] 10.222.0.79 "GET /compute/v2.1/servers/f5d52166-ed04-4313-8929-821bbae17f68" status: 200 len: 1250 microversion: 2.1 time: 0.180423 Oct 17 13:51:01.122953 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1841/3655] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:00 2022] GET /compute/v2.1/servers/f5d52166-ed04-4313-8929-821bbae17f68 => generated 1250 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:01.127009 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [req-5b67f86a-2229-4665-85bd-7583fe9e8b26 req-01bf1d4d-406b-45f0-8faf-0106ef3b4f36 service nova] Instance 50464f17-c798-4c70-b1c9-0f90c55def6b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854247-14', 'n-h2-854247-14'} {{(pid=127017) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:51:01.149484 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-5b67f86a-2229-4665-85bd-7583fe9e8b26 req-01bf1d4d-406b-45f0-8faf-0106ef3b4f36 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105940 Oct 17 13:51:01.157324 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1815/3656] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:51:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:51:01.239672 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2f83d6f2-ec6e-43f3-bd85-8116d8f75278 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:01.240312 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2f83d6f2-ec6e-43f3-bd85-8116d8f75278 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:01.247364 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2f83d6f2-ec6e-43f3-bd85-8116d8f75278 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:01.247878 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2f83d6f2-ec6e-43f3-bd85-8116d8f75278 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:01.248320 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2f83d6f2-ec6e-43f3-bd85-8116d8f75278 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:01.249056 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2f83d6f2-ec6e-43f3-bd85-8116d8f75278 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:01.249523 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2f83d6f2-ec6e-43f3-bd85-8116d8f75278 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:01.249955 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2f83d6f2-ec6e-43f3-bd85-8116d8f75278 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:01.284679 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-02815f11-036d-4dca-91c5-e078904034b6 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2027076333", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "84644223-f25c-4ea7-9eab-bdb2dffe59df"}], "security_groups": [{"name": "tempest-securitygroup--57076316"}], "key_name": "tempest-keypair-2081898665", "user_data": "}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:51:01.600975 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2f83d6f2-ec6e-43f3-bd85-8116d8f75278 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:01.602988 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-02815f11-036d-4dca-91c5-e078904034b6 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] validate_networks() for [('84644223-f25c-4ea7-9eab-bdb2dffe59df', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:51:01.614892 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2f83d6f2-ec6e-43f3-bd85-8116d8f75278 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b" status: 200 len: 1469 microversion: 2.1 time: 0.377416 Oct 17 13:51:01.632574 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1842/3657] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:01 2022] GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b => generated 1469 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:01.953302 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-65b6f5ce-85a4-4214-a7ad-634061c00aba tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:01.955041 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-65b6f5ce-85a4-4214-a7ad-634061c00aba tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:01.971694 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-65b6f5ce-85a4-4214-a7ad-634061c00aba tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:01.972582 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-65b6f5ce-85a4-4214-a7ad-634061c00aba tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:01.973414 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-65b6f5ce-85a4-4214-a7ad-634061c00aba tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:01.974383 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-65b6f5ce-85a4-4214-a7ad-634061c00aba tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:01.979905 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-65b6f5ce-85a4-4214-a7ad-634061c00aba tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:01.980586 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-65b6f5ce-85a4-4214-a7ad-634061c00aba tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:03.125397 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-65b6f5ce-85a4-4214-a7ad-634061c00aba tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:03.140276 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-65b6f5ce-85a4-4214-a7ad-634061c00aba tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e" status: 200 len: 1367 microversion: 2.1 time: 1.190474 Oct 17 13:51:03.142634 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1843/3658] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:01 2022] GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e => generated 1367 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:03.190495 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0c0195fd-30ce-4074-9b8e-1f2497d1afb9 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:03.192010 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0c0195fd-30ce-4074-9b8e-1f2497d1afb9 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] [instance: f5d52166-ed04-4313-8929-821bbae17f68] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:03.201308 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0c0195fd-30ce-4074-9b8e-1f2497d1afb9 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:03.204012 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0c0195fd-30ce-4074-9b8e-1f2497d1afb9 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:03.204645 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0c0195fd-30ce-4074-9b8e-1f2497d1afb9 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:03.205543 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0c0195fd-30ce-4074-9b8e-1f2497d1afb9 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:03.206457 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0c0195fd-30ce-4074-9b8e-1f2497d1afb9 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:03.207126 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0c0195fd-30ce-4074-9b8e-1f2497d1afb9 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:03.277618 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0c0195fd-30ce-4074-9b8e-1f2497d1afb9 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:03.278110 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0c0195fd-30ce-4074-9b8e-1f2497d1afb9 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:03.278608 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0c0195fd-30ce-4074-9b8e-1f2497d1afb9 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:03.279080 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-0c0195fd-30ce-4074-9b8e-1f2497d1afb9 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lazy-loading 'fault' on Instance uuid f5d52166-ed04-4313-8929-821bbae17f68 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:51:03.490618 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0c0195fd-30ce-4074-9b8e-1f2497d1afb9 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef890da37cc444380f1c373ffbf1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a584b724ab934dd59315d9c644f11cfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:03.509139 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0c0195fd-30ce-4074-9b8e-1f2497d1afb9 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] 10.222.0.79 "GET /compute/v2.1/servers/f5d52166-ed04-4313-8929-821bbae17f68" status: 200 len: 1255 microversion: 2.1 time: 0.362625 Oct 17 13:51:03.510277 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1844/3659] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:03 2022] GET /compute/v2.1/servers/f5d52166-ed04-4313-8929-821bbae17f68 => generated 1255 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:03.516222 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-90cb5071-35e6-42bf-a1ae-51d47d0f40a0 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:03.517306 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-90cb5071-35e6-42bf-a1ae-51d47d0f40a0 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:03.537179 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-90cb5071-35e6-42bf-a1ae-51d47d0f40a0 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:03.540364 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-90cb5071-35e6-42bf-a1ae-51d47d0f40a0 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:03.543806 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-90cb5071-35e6-42bf-a1ae-51d47d0f40a0 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:03.544766 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-90cb5071-35e6-42bf-a1ae-51d47d0f40a0 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:03.545451 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-90cb5071-35e6-42bf-a1ae-51d47d0f40a0 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:03.546050 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-90cb5071-35e6-42bf-a1ae-51d47d0f40a0 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:03.603873 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-02815f11-036d-4dca-91c5-e078904034b6 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:51:03.604900 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-02815f11-036d-4dca-91c5-e078904034b6 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:51:03.605698 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-02815f11-036d-4dca-91c5-e078904034b6 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:51:03.606284 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-02815f11-036d-4dca-91c5-e078904034b6 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:51:03.606849 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-02815f11-036d-4dca-91c5-e078904034b6 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:51:03.625966 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-02815f11-036d-4dca-91c5-e078904034b6 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:03.626508 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-02815f11-036d-4dca-91c5-e078904034b6 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:03.626948 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-02815f11-036d-4dca-91c5-e078904034b6 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:03.627730 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-02815f11-036d-4dca-91c5-e078904034b6 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:03.628239 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-02815f11-036d-4dca-91c5-e078904034b6 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:03.628657 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-02815f11-036d-4dca-91c5-e078904034b6 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:03.689433 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-02815f11-036d-4dca-91c5-e078904034b6 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Getting quotas for project 11973b8e1d8a4af8add65726e8ba7c83. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:51:03.695055 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-02815f11-036d-4dca-91c5-e078904034b6 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Getting quotas for user 683d18db860a4d60ab3eeba2a372b2c5 and project 11973b8e1d8a4af8add65726e8ba7c83. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:51:03.710756 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-02815f11-036d-4dca-91c5-e078904034b6 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:51:03.713594 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-02815f11-036d-4dca-91c5-e078904034b6 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:51:03.801567 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-02815f11-036d-4dca-91c5-e078904034b6 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 2.520160 Oct 17 13:51:03.802569 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1816/3660] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:51:01 2022] POST /compute/v2.1/servers => generated 400 bytes in 2525 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 13:51:03.814849 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-fdfffa7a-1da4-4859-adb4-f324c539f9f7 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:03.820138 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-fdfffa7a-1da4-4859-adb4-f324c539f9f7 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:04.009834 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-fdfffa7a-1da4-4859-adb4-f324c539f9f7 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683d18db860a4d60ab3eeba2a372b2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11973b8e1d8a4af8add65726e8ba7c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:04.035599 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-fdfffa7a-1da4-4859-adb4-f324c539f9f7 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5" status: 200 len: 1238 microversion: 2.1 time: 0.222388 Oct 17 13:51:04.039126 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1817/3661] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:03 2022] GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5 => generated 1238 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:04.090338 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-90cb5071-35e6-42bf-a1ae-51d47d0f40a0 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:04.093525 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:51:04.112797 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-90cb5071-35e6-42bf-a1ae-51d47d0f40a0 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b" status: 200 len: 1462 microversion: 2.1 time: 0.600603 Oct 17 13:51:04.114656 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1845/3662] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:03 2022] GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b => generated 1462 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:04.143069 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6c0e7441-c50c-4c3e-bba6-87d8b44c276d tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:04.143761 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6c0e7441-c50c-4c3e-bba6-87d8b44c276d tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:04.152171 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6c0e7441-c50c-4c3e-bba6-87d8b44c276d tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:04.152580 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6c0e7441-c50c-4c3e-bba6-87d8b44c276d tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:04.153054 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6c0e7441-c50c-4c3e-bba6-87d8b44c276d tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:04.153737 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6c0e7441-c50c-4c3e-bba6-87d8b44c276d tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:04.154188 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6c0e7441-c50c-4c3e-bba6-87d8b44c276d tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:04.154607 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6c0e7441-c50c-4c3e-bba6-87d8b44c276d tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:04.166107 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-35bf5f3e-e275-4146-b6c2-3e6941f3b515 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:04.166686 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-35bf5f3e-e275-4146-b6c2-3e6941f3b515 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:04.178762 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-35bf5f3e-e275-4146-b6c2-3e6941f3b515 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:04.179293 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-35bf5f3e-e275-4146-b6c2-3e6941f3b515 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:04.179735 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-35bf5f3e-e275-4146-b6c2-3e6941f3b515 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:04.180464 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-35bf5f3e-e275-4146-b6c2-3e6941f3b515 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:04.180925 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-35bf5f3e-e275-4146-b6c2-3e6941f3b515 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:04.181441 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-35bf5f3e-e275-4146-b6c2-3e6941f3b515 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:04.190691 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:51:04.563902 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-35bf5f3e-e275-4146-b6c2-3e6941f3b515 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:04.579669 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-35bf5f3e-e275-4146-b6c2-3e6941f3b515 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e" status: 200 len: 1367 microversion: 2.1 time: 0.416105 Oct 17 13:51:04.581824 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1846/3663] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:04 2022] GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e => generated 1367 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:51:04.601087 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b9bba76f-7f4f-4991-afc1-ec3d53718bd3 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:04.601700 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b9bba76f-7f4f-4991-afc1-ec3d53718bd3 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] [instance: f5d52166-ed04-4313-8929-821bbae17f68] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:04.609447 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6c0e7441-c50c-4c3e-bba6-87d8b44c276d tempest-MigrationsAdminTest-1543824424 tempest-MigrationsAdminTest-1543824424-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b" status: 200 len: 1615 microversion: 2.1 time: 0.470011 Oct 17 13:51:04.611433 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1818/3664] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:04 2022] GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b => generated 1615 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:04.615483 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b9bba76f-7f4f-4991-afc1-ec3d53718bd3 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:04.616362 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b9bba76f-7f4f-4991-afc1-ec3d53718bd3 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:04.617068 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b9bba76f-7f4f-4991-afc1-ec3d53718bd3 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:04.618060 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b9bba76f-7f4f-4991-afc1-ec3d53718bd3 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:04.618744 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b9bba76f-7f4f-4991-afc1-ec3d53718bd3 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:04.619488 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b9bba76f-7f4f-4991-afc1-ec3d53718bd3 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:04.640242 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-eb419f58-5cbd-4b73-9437-25c1de861e52 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:04.641250 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-eb419f58-5cbd-4b73-9437-25c1de861e52 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:04.648086 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eb419f58-5cbd-4b73-9437-25c1de861e52 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:04.648976 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eb419f58-5cbd-4b73-9437-25c1de861e52 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:04.649627 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eb419f58-5cbd-4b73-9437-25c1de861e52 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:04.650375 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-b9bba76f-7f4f-4991-afc1-ec3d53718bd3 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] HTTP exception thrown: Instance f5d52166-ed04-4313-8929-821bbae17f68 could not be found. Oct 17 13:51:04.651086 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eb419f58-5cbd-4b73-9437-25c1de861e52 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:04.651818 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eb419f58-5cbd-4b73-9437-25c1de861e52 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:04.652154 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b9bba76f-7f4f-4991-afc1-ec3d53718bd3 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Request method failure captured: Oct 17 13:51:04.652154 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/f5d52166-ed04-4313-8929-821bbae17f68 HTTP/1.1 Oct 17 13:51:04.652154 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:51:04.652154 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:51:04.652154 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:51:04.652154 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:51:04.652154 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:51:04.652154 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:51:04.652154 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:51:04.652154 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:51:04.652154 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTV1dau9UUJwvozpw1GzQ4NiJ3hdokxyUqKE4sBMGrpjxh73alflubX4fD2s0pkMdjWbgHlYJbSD20k9qe1SBAbIYPvtNn_3il9A_2hsqr5sPlWE0m-7KaG6C5wvWV9P86OKuoz5n0YmtGnsszh5nfk1fXTZRu7diqHxNrjUUO1bYCVQ Oct 17 13:51:04.652154 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:51:04.652154 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:51:04.652154 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:51:04.652154 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:51:04.652154 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:51:04.652154 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:51:04.652154 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: a584b724ab934dd59315d9c644f11cfa Oct 17 13:51:04.652154 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServersTestBootFromVolume-1736044007 Oct 17 13:51:04.652154 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:51:04.652154 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:51:04.652154 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a584b724ab934dd59315d9c644f11cfa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a584b724ab934dd59315d9c644f11cfa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a584b724ab934dd59315d9c644f11cfa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a584b724ab934dd59315d9c644f11cfa", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:51:04.652154 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServersTestBootFromVolume-1736044007 Oct 17 13:51:04.652154 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: a584b724ab934dd59315d9c644f11cfa Oct 17 13:51:04.652154 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1736044007 Oct 17 13:51:04.652154 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServersTestBootFromVolume-1736044007-project Oct 17 13:51:04.652154 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:51:04.652154 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:51:04.652154 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 5ef890da37cc444380f1c373ffbf1aac Oct 17 13:51:04.652154 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServersTestBootFromVolume-1736044007-project Oct 17 13:51:04.652154 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:51:04.652154 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance f5d52166-ed04-4313-8929-821bbae17f68 could not be found. Oct 17 13:51:04.652154 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'f5d52166-ed04-4313-8929-821bbae17f68'} Oct 17 13:51:04.652154 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:51:04.652154 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:04.652154 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:51:04.652154 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:51:04.652154 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:51:04.652154 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:51:04.652154 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:51:04.652154 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:51:04.652154 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:51:04.652154 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:51:04.652154 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5d52166-ed04-4313-8929-821bbae17f68 could not be found. Oct 17 13:51:04.652154 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:51:04.652154 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:51:04.652154 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:51:04.652154 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:04.652154 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:51:04.652154 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:51:04.652154 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:51:04.652154 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:51:04.652154 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:51:04.652154 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:51:04.652154 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:51:04.652154 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:51:04.652154 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:51:04.652154 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:51:04.652154 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:51:04.652154 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:51:04.652154 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5d52166-ed04-4313-8929-821bbae17f68 could not be found. Oct 17 13:51:04.652154 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:51:04.652154 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:51:04.652154 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:51:04.656973 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:04.656973 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:51:04.656973 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:51:04.656973 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:51:04.656973 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:51:04.656973 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5d52166-ed04-4313-8929-821bbae17f68 could not be found. Oct 17 13:51:04.656973 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:51:04.656973 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b9bba76f-7f4f-4991-afc1-ec3d53718bd3 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Returning 404 to user: Instance f5d52166-ed04-4313-8929-821bbae17f68 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:51:04.656973 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b9bba76f-7f4f-4991-afc1-ec3d53718bd3 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] 10.222.0.79 "GET /compute/v2.1/servers/f5d52166-ed04-4313-8929-821bbae17f68" status: 404 len: 111 microversion: 2.1 time: 0.069457 Oct 17 13:51:04.656973 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1847/3665] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:04 2022] GET /compute/v2.1/servers/f5d52166-ed04-4313-8929-821bbae17f68 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:51:04.658855 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eb419f58-5cbd-4b73-9437-25c1de861e52 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:04.667118 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-359d5066-15fa-4fa6-b7c2-3c1ac23b4205 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] Calling method '.version_select at 0x7f7cd424bdc0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:04.709972 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-eb419f58-5cbd-4b73-9437-25c1de861e52 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:51:04.715312 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-359d5066-15fa-4fa6-b7c2-3c1ac23b4205 tempest-ServersTestBootFromVolume-1736044007 tempest-ServersTestBootFromVolume-1736044007-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-48261411" status: 202 len: 0 microversion: 2.1 time: 0.056295 Oct 17 13:51:04.716027 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1848/3666] 10.222.0.79 () {58 vars in 1215 bytes} [Mon Oct 17 13:51:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-48261411 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:51:04.901834 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-eb419f58-5cbd-4b73-9437-25c1de861e52 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "DELETE /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b" status: 204 len: 0 microversion: 2.1 time: 0.265181 Oct 17 13:51:04.903237 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1819/3667] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:51:04 2022] DELETE /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 13:51:04.912279 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-595d0e3d-3193-470a-afe4-3712796740f5 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:04.913281 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-595d0e3d-3193-470a-afe4-3712796740f5 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:04.921040 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-595d0e3d-3193-470a-afe4-3712796740f5 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:04.922121 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-595d0e3d-3193-470a-afe4-3712796740f5 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:04.923768 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-595d0e3d-3193-470a-afe4-3712796740f5 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:04.924965 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-595d0e3d-3193-470a-afe4-3712796740f5 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:04.925843 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-595d0e3d-3193-470a-afe4-3712796740f5 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:04.926525 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-595d0e3d-3193-470a-afe4-3712796740f5 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:05.065542 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9b909933-b2aa-43a4-a538-30ef7de55790 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:05.066311 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9b909933-b2aa-43a4-a538-30ef7de55790 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:05.080028 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9b909933-b2aa-43a4-a538-30ef7de55790 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:05.083412 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9b909933-b2aa-43a4-a538-30ef7de55790 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:05.083901 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9b909933-b2aa-43a4-a538-30ef7de55790 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:05.085168 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9b909933-b2aa-43a4-a538-30ef7de55790 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:05.115692 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9b909933-b2aa-43a4-a538-30ef7de55790 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:05.115823 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-595d0e3d-3193-470a-afe4-3712796740f5 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:05.115945 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9b909933-b2aa-43a4-a538-30ef7de55790 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:05.123616 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-595d0e3d-3193-470a-afe4-3712796740f5 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b" status: 200 len: 1468 microversion: 2.1 time: 0.216366 Oct 17 13:51:05.124717 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1849/3668] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:04 2022] GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b => generated 1468 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:05.240350 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9b909933-b2aa-43a4-a538-30ef7de55790 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683d18db860a4d60ab3eeba2a372b2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11973b8e1d8a4af8add65726e8ba7c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:05.256431 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9b909933-b2aa-43a4-a538-30ef7de55790 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5" status: 200 len: 1234 microversion: 2.1 time: 0.195956 Oct 17 13:51:05.257576 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1820/3669] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:05 2022] GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5 => generated 1234 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:05.607550 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-598901f0-254b-45a5-98b6-f3100bd8e0a0 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:05.608192 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-598901f0-254b-45a5-98b6-f3100bd8e0a0 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:05.620758 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-598901f0-254b-45a5-98b6-f3100bd8e0a0 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:05.621269 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-598901f0-254b-45a5-98b6-f3100bd8e0a0 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:05.621715 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-598901f0-254b-45a5-98b6-f3100bd8e0a0 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:05.624855 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-598901f0-254b-45a5-98b6-f3100bd8e0a0 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:05.626114 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-598901f0-254b-45a5-98b6-f3100bd8e0a0 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:05.626780 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-598901f0-254b-45a5-98b6-f3100bd8e0a0 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:05.860546 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-598901f0-254b-45a5-98b6-f3100bd8e0a0 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:05.870387 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-598901f0-254b-45a5-98b6-f3100bd8e0a0 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e" status: 200 len: 1367 microversion: 2.1 time: 0.267365 Oct 17 13:51:05.871040 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1850/3670] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:05 2022] GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e => generated 1367 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:06.146381 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-71b4ba22-bdad-4a60-a940-5c6c64f6eeaf tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:06.147777 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-71b4ba22-bdad-4a60-a940-5c6c64f6eeaf tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:06.160009 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-71b4ba22-bdad-4a60-a940-5c6c64f6eeaf tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:06.160629 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-71b4ba22-bdad-4a60-a940-5c6c64f6eeaf tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:06.162326 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-71b4ba22-bdad-4a60-a940-5c6c64f6eeaf tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:06.163738 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-71b4ba22-bdad-4a60-a940-5c6c64f6eeaf tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:06.166139 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-71b4ba22-bdad-4a60-a940-5c6c64f6eeaf tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:06.174309 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-11e10c5b-ec9f-401d-9d20-bd5a5e61b388 req-9b96b687-9098-4e1c-b970-31ada43aea94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e", "name": "network-vif-plugged", "status": "completed", "tag": "8cc688d9-f7d0-40a2-ad9e-33689003bb82"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:51:06.179917 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-71b4ba22-bdad-4a60-a940-5c6c64f6eeaf tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:06.201414 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-11e10c5b-ec9f-401d-9d20-bd5a5e61b388 req-9b96b687-9098-4e1c-b970-31ada43aea94 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:06.206343 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-11e10c5b-ec9f-401d-9d20-bd5a5e61b388 req-9b96b687-9098-4e1c-b970-31ada43aea94 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:06.207431 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-11e10c5b-ec9f-401d-9d20-bd5a5e61b388 req-9b96b687-9098-4e1c-b970-31ada43aea94 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:06.234929 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-11e10c5b-ec9f-401d-9d20-bd5a5e61b388 req-9b96b687-9098-4e1c-b970-31ada43aea94 service nova] Creating event network-vif-plugged:8cc688d9-f7d0-40a2-ad9e-33689003bb82 for instance 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e on n-h1-854247-14 Oct 17 13:51:06.274387 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-11e10c5b-ec9f-401d-9d20-bd5a5e61b388 req-9b96b687-9098-4e1c-b970-31ada43aea94 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098674 Oct 17 13:51:06.278951 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1851/3671] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:51:06.299379 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d3f0ac0c-5283-4540-87a8-f9adae63356a tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:06.301480 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d3f0ac0c-5283-4540-87a8-f9adae63356a tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:06.319671 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d3f0ac0c-5283-4540-87a8-f9adae63356a tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:06.320561 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d3f0ac0c-5283-4540-87a8-f9adae63356a tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:06.321279 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d3f0ac0c-5283-4540-87a8-f9adae63356a tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:06.322558 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d3f0ac0c-5283-4540-87a8-f9adae63356a tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:06.325826 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d3f0ac0c-5283-4540-87a8-f9adae63356a tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:06.326580 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d3f0ac0c-5283-4540-87a8-f9adae63356a tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:06.527979 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d3f0ac0c-5283-4540-87a8-f9adae63356a tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683d18db860a4d60ab3eeba2a372b2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11973b8e1d8a4af8add65726e8ba7c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:06.541333 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d3f0ac0c-5283-4540-87a8-f9adae63356a tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5" status: 200 len: 1290 microversion: 2.1 time: 0.259697 Oct 17 13:51:06.546290 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1852/3672] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:06 2022] GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5 => generated 1290 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:06.649985 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-71b4ba22-bdad-4a60-a940-5c6c64f6eeaf tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:06.665554 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-71b4ba22-bdad-4a60-a940-5c6c64f6eeaf tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b" status: 200 len: 1468 microversion: 2.1 time: 0.523263 Oct 17 13:51:06.670499 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1821/3673] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:06 2022] GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b => generated 1468 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:06.893470 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7d9a2c76-f33d-49cf-b53d-b979a0aa16e2 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:06.894085 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7d9a2c76-f33d-49cf-b53d-b979a0aa16e2 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:06.919870 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7d9a2c76-f33d-49cf-b53d-b979a0aa16e2 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:06.920681 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7d9a2c76-f33d-49cf-b53d-b979a0aa16e2 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:06.922912 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7d9a2c76-f33d-49cf-b53d-b979a0aa16e2 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:06.923943 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7d9a2c76-f33d-49cf-b53d-b979a0aa16e2 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:06.924634 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7d9a2c76-f33d-49cf-b53d-b979a0aa16e2 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:06.925248 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7d9a2c76-f33d-49cf-b53d-b979a0aa16e2 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:07.448801 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7d9a2c76-f33d-49cf-b53d-b979a0aa16e2 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:07.465119 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7d9a2c76-f33d-49cf-b53d-b979a0aa16e2 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e" status: 200 len: 1367 microversion: 2.1 time: 0.575446 Oct 17 13:51:07.465843 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1853/3674] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:06 2022] GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e => generated 1367 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:07.574576 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2f095443-cc7c-4c34-97ab-50985b4ed22b tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:07.576106 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2f095443-cc7c-4c34-97ab-50985b4ed22b tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:07.590641 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2f095443-cc7c-4c34-97ab-50985b4ed22b tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:07.592827 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2f095443-cc7c-4c34-97ab-50985b4ed22b tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:07.593511 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2f095443-cc7c-4c34-97ab-50985b4ed22b tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:07.595202 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2f095443-cc7c-4c34-97ab-50985b4ed22b tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:07.596992 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2f095443-cc7c-4c34-97ab-50985b4ed22b tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:07.600656 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2f095443-cc7c-4c34-97ab-50985b4ed22b tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:07.697832 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-16d126c8-c6a2-4bc0-a291-e6a026b9c989 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:07.698582 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-16d126c8-c6a2-4bc0-a291-e6a026b9c989 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:07.716039 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:51:07.718659 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-16d126c8-c6a2-4bc0-a291-e6a026b9c989 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:07.740762 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-16d126c8-c6a2-4bc0-a291-e6a026b9c989 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:07.743009 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-16d126c8-c6a2-4bc0-a291-e6a026b9c989 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:07.746533 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-16d126c8-c6a2-4bc0-a291-e6a026b9c989 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:07.749974 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-16d126c8-c6a2-4bc0-a291-e6a026b9c989 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:07.750711 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-16d126c8-c6a2-4bc0-a291-e6a026b9c989 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:07.811579 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2f095443-cc7c-4c34-97ab-50985b4ed22b tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683d18db860a4d60ab3eeba2a372b2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11973b8e1d8a4af8add65726e8ba7c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:07.829665 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2f095443-cc7c-4c34-97ab-50985b4ed22b tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5" status: 200 len: 1296 microversion: 2.1 time: 0.255770 Oct 17 13:51:07.832525 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1822/3675] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:07 2022] GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5 => generated 1296 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:08.448641 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-16d126c8-c6a2-4bc0-a291-e6a026b9c989 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:08.460828 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-16d126c8-c6a2-4bc0-a291-e6a026b9c989 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b" status: 200 len: 1468 microversion: 2.1 time: 0.770305 Oct 17 13:51:08.471588 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1854/3676] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:07 2022] GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b => generated 1468 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:51:08.489973 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5d79d3dd-201d-4efa-8e24-03261d3d6a7b tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:08.490251 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5d79d3dd-201d-4efa-8e24-03261d3d6a7b tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:08.499754 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5d79d3dd-201d-4efa-8e24-03261d3d6a7b tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:08.500241 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5d79d3dd-201d-4efa-8e24-03261d3d6a7b tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:08.500673 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5d79d3dd-201d-4efa-8e24-03261d3d6a7b tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:08.508216 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5d79d3dd-201d-4efa-8e24-03261d3d6a7b tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:08.508713 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5d79d3dd-201d-4efa-8e24-03261d3d6a7b tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:08.509154 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5d79d3dd-201d-4efa-8e24-03261d3d6a7b tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:08.859704 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0631935b-f449-4e9c-85e6-a23380c8c590 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:08.860334 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0631935b-f449-4e9c-85e6-a23380c8c590 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:08.874287 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0631935b-f449-4e9c-85e6-a23380c8c590 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:08.874781 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0631935b-f449-4e9c-85e6-a23380c8c590 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:08.879927 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0631935b-f449-4e9c-85e6-a23380c8c590 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:08.880948 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0631935b-f449-4e9c-85e6-a23380c8c590 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:08.881711 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0631935b-f449-4e9c-85e6-a23380c8c590 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:08.882294 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0631935b-f449-4e9c-85e6-a23380c8c590 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:09.013120 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0631935b-f449-4e9c-85e6-a23380c8c590 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683d18db860a4d60ab3eeba2a372b2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11973b8e1d8a4af8add65726e8ba7c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:09.026006 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0631935b-f449-4e9c-85e6-a23380c8c590 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5" status: 200 len: 1296 microversion: 2.1 time: 0.171356 Oct 17 13:51:09.026602 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1855/3677] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:08 2022] GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5 => generated 1296 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:51:09.398071 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-756f16a0-efcf-4ba1-859c-ab9d34496745 req-849d29e4-c922-4b09-a9bf-ce2e5020b938 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50464f17-c798-4c70-b1c9-0f90c55def6b", "name": "network-vif-deleted", "tag": "cb1b920d-1ee0-48dd-ade7-68e1d575df70"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:51:09.418187 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-756f16a0-efcf-4ba1-859c-ab9d34496745 req-849d29e4-c922-4b09-a9bf-ce2e5020b938 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:09.427491 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5d79d3dd-201d-4efa-8e24-03261d3d6a7b tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:09.431113 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-756f16a0-efcf-4ba1-859c-ab9d34496745 req-849d29e4-c922-4b09-a9bf-ce2e5020b938 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:09.431676 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-756f16a0-efcf-4ba1-859c-ab9d34496745 req-849d29e4-c922-4b09-a9bf-ce2e5020b938 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:09.445715 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5d79d3dd-201d-4efa-8e24-03261d3d6a7b tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e" status: 200 len: 1558 microversion: 2.1 time: 0.961315 Oct 17 13:51:09.459233 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1823/3678] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:08 2022] GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e => generated 1558 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:09.468583 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-756f16a0-efcf-4ba1-859c-ab9d34496745 req-849d29e4-c922-4b09-a9bf-ce2e5020b938 service nova] Creating event network-vif-deleted:cb1b920d-1ee0-48dd-ade7-68e1d575df70 for instance 50464f17-c798-4c70-b1c9-0f90c55def6b on n-h2-854247-14 Oct 17 13:51:09.470959 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e38b2a7a-5f09-4faf-bc58-51f6d9c76a63 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:09.475930 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e38b2a7a-5f09-4faf-bc58-51f6d9c76a63 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:09.477046 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-756f16a0-efcf-4ba1-859c-ab9d34496745 req-849d29e4-c922-4b09-a9bf-ce2e5020b938 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083324 Oct 17 13:51:09.477696 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1856/3679] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:51:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:51:09.490495 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-58e45410-d2c4-4aec-9913-0d0ce88f454a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:09.493187 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-58e45410-d2c4-4aec-9913-0d0ce88f454a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:09.507651 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e38b2a7a-5f09-4faf-bc58-51f6d9c76a63 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:09.508729 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e38b2a7a-5f09-4faf-bc58-51f6d9c76a63 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:09.509347 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e38b2a7a-5f09-4faf-bc58-51f6d9c76a63 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:09.509833 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-58e45410-d2c4-4aec-9913-0d0ce88f454a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:09.510331 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-58e45410-d2c4-4aec-9913-0d0ce88f454a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:09.510637 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e38b2a7a-5f09-4faf-bc58-51f6d9c76a63 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:09.510766 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-58e45410-d2c4-4aec-9913-0d0ce88f454a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:09.511421 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e38b2a7a-5f09-4faf-bc58-51f6d9c76a63 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:09.511566 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-58e45410-d2c4-4aec-9913-0d0ce88f454a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:09.511956 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-58e45410-d2c4-4aec-9913-0d0ce88f454a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:09.512307 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e38b2a7a-5f09-4faf-bc58-51f6d9c76a63 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:09.512444 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-58e45410-d2c4-4aec-9913-0d0ce88f454a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:09.627129 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-58e45410-d2c4-4aec-9913-0d0ce88f454a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:09.637115 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-58e45410-d2c4-4aec-9913-0d0ce88f454a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:09.639583 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-58e45410-d2c4-4aec-9913-0d0ce88f454a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:09.640402 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-58e45410-d2c4-4aec-9913-0d0ce88f454a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lazy-loading 'fault' on Instance uuid 50464f17-c798-4c70-b1c9-0f90c55def6b {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:51:09.984409 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-58e45410-d2c4-4aec-9913-0d0ce88f454a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:09.993769 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-58e45410-d2c4-4aec-9913-0d0ce88f454a tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b" status: 200 len: 1302 microversion: 2.1 time: 0.508156 Oct 17 13:51:10.000893 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1857/3680] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:09 2022] GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b => generated 1302 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:51:10.031581 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e38b2a7a-5f09-4faf-bc58-51f6d9c76a63 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.566062 Oct 17 13:51:10.032780 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1824/3681] 10.222.0.79 () {58 vars in 1275 bytes} [Mon Oct 17 13:51:09 2022] GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e/os-interface => generated 285 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:51:10.053674 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a76e58ed-0856-4ea2-b709-bb901af5d91f tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:10.054294 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a76e58ed-0856-4ea2-b709-bb901af5d91f tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:10.068767 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a76e58ed-0856-4ea2-b709-bb901af5d91f tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:10.069271 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a76e58ed-0856-4ea2-b709-bb901af5d91f tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:10.069707 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a76e58ed-0856-4ea2-b709-bb901af5d91f tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:10.071042 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a76e58ed-0856-4ea2-b709-bb901af5d91f tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:10.071551 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a76e58ed-0856-4ea2-b709-bb901af5d91f tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:10.072329 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a76e58ed-0856-4ea2-b709-bb901af5d91f tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:10.587805 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a76e58ed-0856-4ea2-b709-bb901af5d91f tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683d18db860a4d60ab3eeba2a372b2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11973b8e1d8a4af8add65726e8ba7c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:10.596566 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a76e58ed-0856-4ea2-b709-bb901af5d91f tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5" status: 200 len: 1362 microversion: 2.1 time: 0.546815 Oct 17 13:51:10.602347 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1858/3682] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:10 2022] GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5 => generated 1362 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:11.026097 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4e1457cb-e5e2-4522-9f22-431b0e7b5bf8 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:11.027363 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4e1457cb-e5e2-4522-9f22-431b0e7b5bf8 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 50464f17-c798-4c70-b1c9-0f90c55def6b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:11.038934 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4e1457cb-e5e2-4522-9f22-431b0e7b5bf8 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:11.043924 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4e1457cb-e5e2-4522-9f22-431b0e7b5bf8 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:11.044620 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4e1457cb-e5e2-4522-9f22-431b0e7b5bf8 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:11.045538 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4e1457cb-e5e2-4522-9f22-431b0e7b5bf8 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:11.046139 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4e1457cb-e5e2-4522-9f22-431b0e7b5bf8 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:11.047064 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4e1457cb-e5e2-4522-9f22-431b0e7b5bf8 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:11.104862 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-4e1457cb-e5e2-4522-9f22-431b0e7b5bf8 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] HTTP exception thrown: Instance 50464f17-c798-4c70-b1c9-0f90c55def6b could not be found. Oct 17 13:51:11.106609 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4e1457cb-e5e2-4522-9f22-431b0e7b5bf8 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Request method failure captured: Oct 17 13:51:11.106609 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b HTTP/1.1 Oct 17 13:51:11.106609 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:51:11.106609 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:51:11.106609 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:51:11.106609 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:51:11.106609 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:51:11.106609 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:51:11.106609 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:51:11.106609 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:51:11.106609 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVyQD_4uCbehCVnS_PsuBoADiugecl4b8yF4Y4WeVLBs8DKVR1pyqyL4gbSchpL08WwYQsQVUqfERwxTe-Bz7MzGTlzKyUOmDjD_KYqYHnzmtD-KnmDvRRFEL0fc4o_hrhmb6pjsJG0GId0mXfwWZE_ZbBqg8YJCAEy8ViKVBYdNuoQ Oct 17 13:51:11.106609 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:51:11.106609 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:51:11.106609 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:51:11.106609 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:51:11.106609 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:51:11.106609 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:51:11.106609 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 5b98e3f377c14838a31cc430c98855e1 Oct 17 13:51:11.106609 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-MigrationsAdminTest-2029741506 Oct 17 13:51:11.106609 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:51:11.106609 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:51:11.106609 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5b98e3f377c14838a31cc430c98855e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5b98e3f377c14838a31cc430c98855e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5b98e3f377c14838a31cc430c98855e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5b98e3f377c14838a31cc430c98855e1", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:51:11.106609 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-MigrationsAdminTest-2029741506 Oct 17 13:51:11.106609 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 5b98e3f377c14838a31cc430c98855e1 Oct 17 13:51:11.106609 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-MigrationsAdminTest-2029741506 Oct 17 13:51:11.106609 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-MigrationsAdminTest-2029741506-project Oct 17 13:51:11.106609 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:51:11.106609 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:51:11.106609 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 0906fe70cb054729bfb95b2196c1a5d3 Oct 17 13:51:11.106609 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-MigrationsAdminTest-2029741506-project Oct 17 13:51:11.106609 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:51:11.106609 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 50464f17-c798-4c70-b1c9-0f90c55def6b could not be found. Oct 17 13:51:11.106609 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '50464f17-c798-4c70-b1c9-0f90c55def6b'} Oct 17 13:51:11.106609 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:51:11.106609 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:11.106609 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:51:11.106609 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:51:11.106609 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:51:11.106609 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:51:11.106609 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:51:11.106609 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:51:11.106609 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:51:11.106609 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:51:11.106609 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50464f17-c798-4c70-b1c9-0f90c55def6b could not be found. Oct 17 13:51:11.106609 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:51:11.106609 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:51:11.106609 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:51:11.106609 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:11.106609 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:51:11.106609 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:51:11.106609 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:51:11.106609 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:51:11.106609 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:51:11.106609 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:51:11.106609 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:51:11.106609 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:51:11.106609 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:51:11.106609 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:51:11.106609 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:51:11.106609 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:51:11.106609 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50464f17-c798-4c70-b1c9-0f90c55def6b could not be found. Oct 17 13:51:11.106609 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:51:11.106609 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:51:11.106609 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:51:11.113833 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:11.113833 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:51:11.113833 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:51:11.113833 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:51:11.113833 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:51:11.113833 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50464f17-c798-4c70-b1c9-0f90c55def6b could not be found. Oct 17 13:51:11.113833 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:51:11.113833 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4e1457cb-e5e2-4522-9f22-431b0e7b5bf8 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Returning 404 to user: Instance 50464f17-c798-4c70-b1c9-0f90c55def6b could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:51:11.113833 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4e1457cb-e5e2-4522-9f22-431b0e7b5bf8 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b" status: 404 len: 111 microversion: 2.1 time: 0.086211 Oct 17 13:51:11.121407 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-26f92a5b-8dc3-4cb7-87bf-efd58a334b67 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:11.122236 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-26f92a5b-8dc3-4cb7-87bf-efd58a334b67 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: e1fb1718-c504-47dc-ab2e-28fe15d2c435] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:11.129345 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1825/3683] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:11 2022] GET /compute/v2.1/servers/50464f17-c798-4c70-b1c9-0f90c55def6b => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:51:11.131261 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-26f92a5b-8dc3-4cb7-87bf-efd58a334b67 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:11.131955 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-26f92a5b-8dc3-4cb7-87bf-efd58a334b67 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:11.132580 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-26f92a5b-8dc3-4cb7-87bf-efd58a334b67 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:11.133462 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-26f92a5b-8dc3-4cb7-87bf-efd58a334b67 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:11.134095 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-26f92a5b-8dc3-4cb7-87bf-efd58a334b67 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:11.134681 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-26f92a5b-8dc3-4cb7-87bf-efd58a334b67 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:11.224507 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-26f92a5b-8dc3-4cb7-87bf-efd58a334b67 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: e1fb1718-c504-47dc-ab2e-28fe15d2c435] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:51:11.419626 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-26f92a5b-8dc3-4cb7-87bf-efd58a334b67 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "DELETE /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435" status: 204 len: 0 microversion: 2.1 time: 0.302669 Oct 17 13:51:11.420935 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1859/3684] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:51:11 2022] DELETE /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:51:11.435844 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1c0519a4-0f7d-4ca5-bb42-14dd550bb7b6 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:11.436540 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1c0519a4-0f7d-4ca5-bb42-14dd550bb7b6 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: e1fb1718-c504-47dc-ab2e-28fe15d2c435] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:11.445787 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c0519a4-0f7d-4ca5-bb42-14dd550bb7b6 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:11.446457 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c0519a4-0f7d-4ca5-bb42-14dd550bb7b6 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:11.447112 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c0519a4-0f7d-4ca5-bb42-14dd550bb7b6 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:11.447915 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c0519a4-0f7d-4ca5-bb42-14dd550bb7b6 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:11.448505 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c0519a4-0f7d-4ca5-bb42-14dd550bb7b6 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:11.449072 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c0519a4-0f7d-4ca5-bb42-14dd550bb7b6 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:11.627072 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c32b535b-81ab-46da-a830-f8c797a7b57f tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:11.628653 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c32b535b-81ab-46da-a830-f8c797a7b57f tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:11.649831 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c32b535b-81ab-46da-a830-f8c797a7b57f tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:11.650330 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c32b535b-81ab-46da-a830-f8c797a7b57f tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:11.650974 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c32b535b-81ab-46da-a830-f8c797a7b57f tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:11.651714 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c32b535b-81ab-46da-a830-f8c797a7b57f tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:11.652312 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c32b535b-81ab-46da-a830-f8c797a7b57f tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:11.652731 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c32b535b-81ab-46da-a830-f8c797a7b57f tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:11.878986 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1c0519a4-0f7d-4ca5-bb42-14dd550bb7b6 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:11.888075 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1c0519a4-0f7d-4ca5-bb42-14dd550bb7b6 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435" status: 200 len: 1534 microversion: 2.1 time: 0.460442 Oct 17 13:51:11.912598 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1826/3685] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:11 2022] GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435 => generated 1534 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:12.200220 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c32b535b-81ab-46da-a830-f8c797a7b57f tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683d18db860a4d60ab3eeba2a372b2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11973b8e1d8a4af8add65726e8ba7c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:12.222923 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c32b535b-81ab-46da-a830-f8c797a7b57f tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5" status: 200 len: 1362 microversion: 2.1 time: 0.599641 Oct 17 13:51:12.223594 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1860/3686] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:11 2022] GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5 => generated 1362 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:12.917913 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-27bfafac-343f-4e17-9f14-2b58779a6acf tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:12.918656 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-27bfafac-343f-4e17-9f14-2b58779a6acf tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: e1fb1718-c504-47dc-ab2e-28fe15d2c435] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:12.936081 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-27bfafac-343f-4e17-9f14-2b58779a6acf tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:12.936608 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-27bfafac-343f-4e17-9f14-2b58779a6acf tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:12.937051 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-27bfafac-343f-4e17-9f14-2b58779a6acf tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:12.937774 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-27bfafac-343f-4e17-9f14-2b58779a6acf tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:12.942366 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-27bfafac-343f-4e17-9f14-2b58779a6acf tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:12.942962 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-27bfafac-343f-4e17-9f14-2b58779a6acf tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:13.253597 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c8c96f71-91b1-46d9-95bb-3036fd30480e tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:13.255819 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c8c96f71-91b1-46d9-95bb-3036fd30480e tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:13.273576 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c8c96f71-91b1-46d9-95bb-3036fd30480e tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:13.275101 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c8c96f71-91b1-46d9-95bb-3036fd30480e tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:13.276369 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c8c96f71-91b1-46d9-95bb-3036fd30480e tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:13.278585 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c8c96f71-91b1-46d9-95bb-3036fd30480e tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:13.279617 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c8c96f71-91b1-46d9-95bb-3036fd30480e tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:13.280316 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c8c96f71-91b1-46d9-95bb-3036fd30480e tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:13.341044 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-27bfafac-343f-4e17-9f14-2b58779a6acf tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:13.350749 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-27bfafac-343f-4e17-9f14-2b58779a6acf tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435" status: 200 len: 1534 microversion: 2.1 time: 0.436679 Oct 17 13:51:13.356187 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1827/3687] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:12 2022] GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435 => generated 1534 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:13.526568 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-6d9152d2-3f77-4ca2-bdf8-c4b518fee533 req-6ea94174-cd4c-4aed-9331-55b1b828ae33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5", "tag": "f4683ce3-d22f-48db-8109-19e7698684bb"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:51:13.545715 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-6d9152d2-3f77-4ca2-bdf8-c4b518fee533 req-6ea94174-cd4c-4aed-9331-55b1b828ae33 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:13.546697 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-6d9152d2-3f77-4ca2-bdf8-c4b518fee533 req-6ea94174-cd4c-4aed-9331-55b1b828ae33 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:13.548007 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-6d9152d2-3f77-4ca2-bdf8-c4b518fee533 req-6ea94174-cd4c-4aed-9331-55b1b828ae33 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:13.564734 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-6d9152d2-3f77-4ca2-bdf8-c4b518fee533 req-6ea94174-cd4c-4aed-9331-55b1b828ae33 service nova] Creating event network-changed:f4683ce3-d22f-48db-8109-19e7698684bb for instance bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5 on n-h2-854247-14 Oct 17 13:51:13.573211 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-6d9152d2-3f77-4ca2-bdf8-c4b518fee533 req-6ea94174-cd4c-4aed-9331-55b1b828ae33 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052590 Oct 17 13:51:13.575459 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1828/3688] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:51:13.763930 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-ddbce8f1-04eb-4d63-a631-1e5d8715deea req-5ee52a2c-01e9-48de-9892-899941931315 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1fb1718-c504-47dc-ab2e-28fe15d2c435", "name": "network-vif-deleted", "tag": "391b5d37-7616-4b7e-974a-cd5f28f3eb9a"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:51:13.769896 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:51:13.797136 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-ddbce8f1-04eb-4d63-a631-1e5d8715deea req-5ee52a2c-01e9-48de-9892-899941931315 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:13.801751 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c8c96f71-91b1-46d9-95bb-3036fd30480e tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683d18db860a4d60ab3eeba2a372b2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11973b8e1d8a4af8add65726e8ba7c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:13.801970 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-ddbce8f1-04eb-4d63-a631-1e5d8715deea req-5ee52a2c-01e9-48de-9892-899941931315 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:13.802312 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-ddbce8f1-04eb-4d63-a631-1e5d8715deea req-5ee52a2c-01e9-48de-9892-899941931315 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:13.818145 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c8c96f71-91b1-46d9-95bb-3036fd30480e tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5" status: 200 len: 1362 microversion: 2.1 time: 0.571198 Oct 17 13:51:13.820368 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1861/3689] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:13 2022] GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5 => generated 1362 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:13.832679 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-ddbce8f1-04eb-4d63-a631-1e5d8715deea req-5ee52a2c-01e9-48de-9892-899941931315 service nova] Creating event network-vif-deleted:391b5d37-7616-4b7e-974a-cd5f28f3eb9a for instance e1fb1718-c504-47dc-ab2e-28fe15d2c435 on n-h1-854247-14 Oct 17 13:51:13.843065 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-ddbce8f1-04eb-4d63-a631-1e5d8715deea req-5ee52a2c-01e9-48de-9892-899941931315 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083222 Oct 17 13:51:13.848368 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1829/3690] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:51:14.380780 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4081b5ab-3f65-44aa-870b-a95af8fdc7c1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:14.381455 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4081b5ab-3f65-44aa-870b-a95af8fdc7c1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: e1fb1718-c504-47dc-ab2e-28fe15d2c435] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:14.389110 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4081b5ab-3f65-44aa-870b-a95af8fdc7c1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:14.389846 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4081b5ab-3f65-44aa-870b-a95af8fdc7c1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:14.390291 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4081b5ab-3f65-44aa-870b-a95af8fdc7c1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:14.391002 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4081b5ab-3f65-44aa-870b-a95af8fdc7c1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:14.391730 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4081b5ab-3f65-44aa-870b-a95af8fdc7c1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:14.393028 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4081b5ab-3f65-44aa-870b-a95af8fdc7c1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:14.468232 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4081b5ab-3f65-44aa-870b-a95af8fdc7c1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:14.472089 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4081b5ab-3f65-44aa-870b-a95af8fdc7c1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:14.472808 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4081b5ab-3f65-44aa-870b-a95af8fdc7c1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:14.473648 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-4081b5ab-3f65-44aa-870b-a95af8fdc7c1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lazy-loading 'fault' on Instance uuid e1fb1718-c504-47dc-ab2e-28fe15d2c435 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:51:14.531670 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4081b5ab-3f65-44aa-870b-a95af8fdc7c1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:14.540268 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4081b5ab-3f65-44aa-870b-a95af8fdc7c1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435" status: 200 len: 1368 microversion: 2.1 time: 0.163625 Oct 17 13:51:14.541181 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1862/3691] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:14 2022] GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:14.845934 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-53a5431a-b376-4ceb-962c-d1d483ea3416 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:14.847456 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-53a5431a-b376-4ceb-962c-d1d483ea3416 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:14.854518 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=12 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:51:14.857536 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-53a5431a-b376-4ceb-962c-d1d483ea3416 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:14.858185 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-53a5431a-b376-4ceb-962c-d1d483ea3416 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:14.858916 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-53a5431a-b376-4ceb-962c-d1d483ea3416 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:14.859717 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-53a5431a-b376-4ceb-962c-d1d483ea3416 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:14.860244 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-53a5431a-b376-4ceb-962c-d1d483ea3416 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:14.860853 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-53a5431a-b376-4ceb-962c-d1d483ea3416 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:15.080145 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-53a5431a-b376-4ceb-962c-d1d483ea3416 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683d18db860a4d60ab3eeba2a372b2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11973b8e1d8a4af8add65726e8ba7c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:15.090006 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-53a5431a-b376-4ceb-962c-d1d483ea3416 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5" status: 200 len: 1362 microversion: 2.1 time: 0.250450 Oct 17 13:51:15.090587 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1830/3692] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:14 2022] GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5 => generated 1362 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:15.564773 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-809d83d5-5bf5-487f-b07b-36cddcd0949d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:15.566133 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-809d83d5-5bf5-487f-b07b-36cddcd0949d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: e1fb1718-c504-47dc-ab2e-28fe15d2c435] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:15.578477 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-809d83d5-5bf5-487f-b07b-36cddcd0949d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:15.582313 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-809d83d5-5bf5-487f-b07b-36cddcd0949d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:15.583049 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-809d83d5-5bf5-487f-b07b-36cddcd0949d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:15.584211 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-809d83d5-5bf5-487f-b07b-36cddcd0949d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:15.584852 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-809d83d5-5bf5-487f-b07b-36cddcd0949d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:15.585505 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-809d83d5-5bf5-487f-b07b-36cddcd0949d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:15.609150 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-14fcd34e-9ae8-4a93-95c7-95a250a2c026 req-3771b0c0-c70f-46cb-ae0e-8f613024b90e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e", "tag": "8cc688d9-f7d0-40a2-ad9e-33689003bb82"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:51:15.627105 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:51:15.628560 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-809d83d5-5bf5-487f-b07b-36cddcd0949d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] HTTP exception thrown: Instance e1fb1718-c504-47dc-ab2e-28fe15d2c435 could not be found. Oct 17 13:51:15.632800 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-14fcd34e-9ae8-4a93-95c7-95a250a2c026 req-3771b0c0-c70f-46cb-ae0e-8f613024b90e service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:15.633408 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-809d83d5-5bf5-487f-b07b-36cddcd0949d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Request method failure captured: Oct 17 13:51:15.633408 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435 HTTP/1.1 Oct 17 13:51:15.633408 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:51:15.633408 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:51:15.633408 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:51:15.633408 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:51:15.633408 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:51:15.633408 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:51:15.633408 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:51:15.633408 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:51:15.633408 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVyQD_4uCbehCVnS_PsuBoADiugecl4b8yF4Y4WeVLBs8DKVR1pyqyL4gbSchpL08WwYQsQVUqfERwxTe-Bz7MzGTlzKyUOmDjD_KYqYHnzmtD-KnmDvRRFEL0fc4o_hrhmb6pjsJG0GId0mXfwWZE_ZbBqg8YJCAEy8ViKVBYdNuoQ Oct 17 13:51:15.633408 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:51:15.633408 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:51:15.633408 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:51:15.633408 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:51:15.633408 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:51:15.633408 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:51:15.633408 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 5b98e3f377c14838a31cc430c98855e1 Oct 17 13:51:15.633408 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-MigrationsAdminTest-2029741506 Oct 17 13:51:15.633408 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:51:15.633408 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:51:15.633408 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5b98e3f377c14838a31cc430c98855e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5b98e3f377c14838a31cc430c98855e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5b98e3f377c14838a31cc430c98855e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5b98e3f377c14838a31cc430c98855e1", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:51:15.633408 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-MigrationsAdminTest-2029741506 Oct 17 13:51:15.633408 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 5b98e3f377c14838a31cc430c98855e1 Oct 17 13:51:15.633408 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-MigrationsAdminTest-2029741506 Oct 17 13:51:15.633408 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-MigrationsAdminTest-2029741506-project Oct 17 13:51:15.633408 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:51:15.633408 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:51:15.633408 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 0906fe70cb054729bfb95b2196c1a5d3 Oct 17 13:51:15.633408 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-MigrationsAdminTest-2029741506-project Oct 17 13:51:15.633408 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:51:15.633408 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance e1fb1718-c504-47dc-ab2e-28fe15d2c435 could not be found. Oct 17 13:51:15.633408 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'e1fb1718-c504-47dc-ab2e-28fe15d2c435'} Oct 17 13:51:15.633408 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:51:15.633408 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:15.633408 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:51:15.633408 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:51:15.633408 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:51:15.633408 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:51:15.633408 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:51:15.633408 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:51:15.633408 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:51:15.633408 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:51:15.633408 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1fb1718-c504-47dc-ab2e-28fe15d2c435 could not be found. Oct 17 13:51:15.633408 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:51:15.633408 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:51:15.633408 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:51:15.633408 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:15.633408 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:51:15.633408 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:51:15.633408 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:51:15.633408 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:51:15.633408 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:51:15.633408 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:51:15.633408 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:51:15.633408 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:51:15.633408 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:51:15.633408 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:51:15.633408 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:51:15.633408 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:51:15.633408 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1fb1718-c504-47dc-ab2e-28fe15d2c435 could not be found. Oct 17 13:51:15.633408 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:51:15.633408 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:51:15.633408 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:51:15.639718 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:15.639718 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:51:15.639718 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:51:15.639718 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:51:15.639718 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:51:15.639718 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1fb1718-c504-47dc-ab2e-28fe15d2c435 could not be found. Oct 17 13:51:15.639718 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:51:15.639718 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-809d83d5-5bf5-487f-b07b-36cddcd0949d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Returning 404 to user: Instance e1fb1718-c504-47dc-ab2e-28fe15d2c435 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:51:15.639718 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-809d83d5-5bf5-487f-b07b-36cddcd0949d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435" status: 404 len: 111 microversion: 2.1 time: 0.076725 Oct 17 13:51:15.642012 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1863/3693] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:15 2022] GET /compute/v2.1/servers/e1fb1718-c504-47dc-ab2e-28fe15d2c435 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:51:15.646691 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-14fcd34e-9ae8-4a93-95c7-95a250a2c026 req-3771b0c0-c70f-46cb-ae0e-8f613024b90e service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:15.648873 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-14fcd34e-9ae8-4a93-95c7-95a250a2c026 req-3771b0c0-c70f-46cb-ae0e-8f613024b90e service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:15.653912 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-19c605ce-b7d4-4ece-8409-19caf5f54bbb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '.version_select at 0x7f7cd449c550>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:15.681884 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-14fcd34e-9ae8-4a93-95c7-95a250a2c026 req-3771b0c0-c70f-46cb-ae0e-8f613024b90e service nova] Creating event network-changed:8cc688d9-f7d0-40a2-ad9e-33689003bb82 for instance 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e on n-h1-854247-14 Oct 17 13:51:15.700271 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-14fcd34e-9ae8-4a93-95c7-95a250a2c026 req-3771b0c0-c70f-46cb-ae0e-8f613024b90e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094919 Oct 17 13:51:15.703097 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1831/3694] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:51:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:51:15.703771 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-19c605ce-b7d4-4ece-8409-19caf5f54bbb tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-437728581" status: 202 len: 0 microversion: 2.1 time: 0.057606 Oct 17 13:51:15.705587 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1864/3695] 10.222.0.79 () {58 vars in 1218 bytes} [Mon Oct 17 13:51:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-437728581 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:51:16.116905 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ed804a25-e58f-481f-8d03-e9252cacbbcc tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:16.117622 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ed804a25-e58f-481f-8d03-e9252cacbbcc tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:16.130514 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ed804a25-e58f-481f-8d03-e9252cacbbcc tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:16.131014 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ed804a25-e58f-481f-8d03-e9252cacbbcc tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:16.131489 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ed804a25-e58f-481f-8d03-e9252cacbbcc tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:16.132223 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ed804a25-e58f-481f-8d03-e9252cacbbcc tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:16.132668 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ed804a25-e58f-481f-8d03-e9252cacbbcc tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:16.133091 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ed804a25-e58f-481f-8d03-e9252cacbbcc tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:16.361047 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ed804a25-e58f-481f-8d03-e9252cacbbcc tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683d18db860a4d60ab3eeba2a372b2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11973b8e1d8a4af8add65726e8ba7c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:16.383015 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ed804a25-e58f-481f-8d03-e9252cacbbcc tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5" status: 200 len: 1362 microversion: 2.1 time: 0.270347 Oct 17 13:51:16.392973 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1832/3696] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:16 2022] GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5 => generated 1362 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:17.419536 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-76d0b355-0dee-492c-86cb-96ae10229a36 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:17.420171 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-76d0b355-0dee-492c-86cb-96ae10229a36 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:17.429679 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-76d0b355-0dee-492c-86cb-96ae10229a36 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:17.430236 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-76d0b355-0dee-492c-86cb-96ae10229a36 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:17.430779 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-76d0b355-0dee-492c-86cb-96ae10229a36 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:17.431551 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-76d0b355-0dee-492c-86cb-96ae10229a36 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:17.432197 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-76d0b355-0dee-492c-86cb-96ae10229a36 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:17.432463 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-76d0b355-0dee-492c-86cb-96ae10229a36 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:18.038024 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-76d0b355-0dee-492c-86cb-96ae10229a36 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683d18db860a4d60ab3eeba2a372b2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11973b8e1d8a4af8add65726e8ba7c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:18.046587 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-76d0b355-0dee-492c-86cb-96ae10229a36 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5" status: 200 len: 1362 microversion: 2.1 time: 0.632387 Oct 17 13:51:18.048705 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1865/3697] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:17 2022] GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5 => generated 1362 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:18.522809 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-cb590d23-9384-4f3a-97a4-6bb39a56f2de tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:18.524083 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-cb590d23-9384-4f3a-97a4-6bb39a56f2de tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9eaf1302-c967-4a24-8772-df5b32f11a60] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:18.550178 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cb590d23-9384-4f3a-97a4-6bb39a56f2de tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:18.550685 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cb590d23-9384-4f3a-97a4-6bb39a56f2de tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:18.551148 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cb590d23-9384-4f3a-97a4-6bb39a56f2de tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:18.557120 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cb590d23-9384-4f3a-97a4-6bb39a56f2de tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:18.557606 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cb590d23-9384-4f3a-97a4-6bb39a56f2de tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:18.558046 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cb590d23-9384-4f3a-97a4-6bb39a56f2de tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:18.609151 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-cb590d23-9384-4f3a-97a4-6bb39a56f2de tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9eaf1302-c967-4a24-8772-df5b32f11a60] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:51:18.653028 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-16b5dde9-a96e-4ca3-8fc1-dc6d17800007 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:51:18.657361 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-16b5dde9-a96e-4ca3-8fc1-dc6d17800007 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 3197da72-e924-4f50-8c93-c3f3ff98e084] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:18.677101 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-16b5dde9-a96e-4ca3-8fc1-dc6d17800007 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:18.677583 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-16b5dde9-a96e-4ca3-8fc1-dc6d17800007 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:18.678016 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-16b5dde9-a96e-4ca3-8fc1-dc6d17800007 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:18.678810 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-16b5dde9-a96e-4ca3-8fc1-dc6d17800007 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:18.682607 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-16b5dde9-a96e-4ca3-8fc1-dc6d17800007 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:18.683049 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-16b5dde9-a96e-4ca3-8fc1-dc6d17800007 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:18.746372 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-16b5dde9-a96e-4ca3-8fc1-dc6d17800007 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lazy-loading 'flavor' on Instance uuid 3197da72-e924-4f50-8c93-c3f3ff98e084 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:51:18.764174 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-cb590d23-9384-4f3a-97a4-6bb39a56f2de tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "DELETE /compute/v2.1/servers/9eaf1302-c967-4a24-8772-df5b32f11a60" status: 204 len: 0 microversion: 2.1 time: 0.244894 Oct 17 13:51:18.764998 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1833/3698] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:51:18 2022] DELETE /compute/v2.1/servers/9eaf1302-c967-4a24-8772-df5b32f11a60 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:51:18.778306 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0e08c5f4-f559-447e-9c09-09ae8cb67f3e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:18.780049 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0e08c5f4-f559-447e-9c09-09ae8cb67f3e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9eaf1302-c967-4a24-8772-df5b32f11a60] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:18.796873 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0e08c5f4-f559-447e-9c09-09ae8cb67f3e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:18.797730 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0e08c5f4-f559-447e-9c09-09ae8cb67f3e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:18.798457 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0e08c5f4-f559-447e-9c09-09ae8cb67f3e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:18.800042 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0e08c5f4-f559-447e-9c09-09ae8cb67f3e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:18.800898 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0e08c5f4-f559-447e-9c09-09ae8cb67f3e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:18.802870 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0e08c5f4-f559-447e-9c09-09ae8cb67f3e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:19.000836 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-16b5dde9-a96e-4ca3-8fc1-dc6d17800007 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "POST /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084/action" status: 200 len: 32 microversion: 2.1 time: 0.358773 Oct 17 13:51:19.001475 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1866/3699] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:51:18 2022] POST /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084/action => generated 32 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 17 13:51:19.012985 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b62418d1-9925-436c-9cc8-879a96303772 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:19.014002 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b62418d1-9925-436c-9cc8-879a96303772 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 3197da72-e924-4f50-8c93-c3f3ff98e084] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:19.021418 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b62418d1-9925-436c-9cc8-879a96303772 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:19.022206 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b62418d1-9925-436c-9cc8-879a96303772 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:19.023076 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b62418d1-9925-436c-9cc8-879a96303772 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:19.024163 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b62418d1-9925-436c-9cc8-879a96303772 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:19.024991 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b62418d1-9925-436c-9cc8-879a96303772 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:19.025638 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b62418d1-9925-436c-9cc8-879a96303772 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:19.189805 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0e08c5f4-f559-447e-9c09-09ae8cb67f3e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:19.192411 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:51:19.202634 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0e08c5f4-f559-447e-9c09-09ae8cb67f3e tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/9eaf1302-c967-4a24-8772-df5b32f11a60" status: 200 len: 1468 microversion: 2.1 time: 0.430737 Oct 17 13:51:19.209307 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1834/3700] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:18 2022] GET /compute/v2.1/servers/9eaf1302-c967-4a24-8772-df5b32f11a60 => generated 1468 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:19.230829 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b1f87402-eba2-4bfe-b936-11954c617958 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:19.232019 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b1f87402-eba2-4bfe-b936-11954c617958 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:19.239987 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b1f87402-eba2-4bfe-b936-11954c617958 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:19.240875 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b1f87402-eba2-4bfe-b936-11954c617958 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:19.241550 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b1f87402-eba2-4bfe-b936-11954c617958 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:19.242778 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b1f87402-eba2-4bfe-b936-11954c617958 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:19.243491 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b1f87402-eba2-4bfe-b936-11954c617958 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:19.244897 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b1f87402-eba2-4bfe-b936-11954c617958 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:19.328375 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b62418d1-9925-436c-9cc8-879a96303772 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:19.344868 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b62418d1-9925-436c-9cc8-879a96303772 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084" status: 200 len: 1735 microversion: 2.1 time: 0.336528 Oct 17 13:51:19.345663 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1867/3701] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:19 2022] GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084 => generated 1735 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:19.560312 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b1f87402-eba2-4bfe-b936-11954c617958 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683d18db860a4d60ab3eeba2a372b2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11973b8e1d8a4af8add65726e8ba7c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:19.570677 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b1f87402-eba2-4bfe-b936-11954c617958 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5" status: 200 len: 1362 microversion: 2.1 time: 0.344667 Oct 17 13:51:19.572346 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1835/3702] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:19 2022] GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5 => generated 1362 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:20.236589 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e8ff7df8-369e-4cd1-be4f-591a472bd1d6 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:20.237936 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e8ff7df8-369e-4cd1-be4f-591a472bd1d6 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9eaf1302-c967-4a24-8772-df5b32f11a60] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:20.258109 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e8ff7df8-369e-4cd1-be4f-591a472bd1d6 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:20.258881 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e8ff7df8-369e-4cd1-be4f-591a472bd1d6 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:20.259606 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e8ff7df8-369e-4cd1-be4f-591a472bd1d6 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:20.260637 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e8ff7df8-369e-4cd1-be4f-591a472bd1d6 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:20.261321 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e8ff7df8-369e-4cd1-be4f-591a472bd1d6 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:20.261978 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e8ff7df8-369e-4cd1-be4f-591a472bd1d6 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:20.368165 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a15b0ddb-7a33-476c-a04e-4b10f972eca4 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:20.369198 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a15b0ddb-7a33-476c-a04e-4b10f972eca4 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 3197da72-e924-4f50-8c93-c3f3ff98e084] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:20.380021 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a15b0ddb-7a33-476c-a04e-4b10f972eca4 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:20.383907 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a15b0ddb-7a33-476c-a04e-4b10f972eca4 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:20.384639 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a15b0ddb-7a33-476c-a04e-4b10f972eca4 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:20.385645 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a15b0ddb-7a33-476c-a04e-4b10f972eca4 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:20.386326 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a15b0ddb-7a33-476c-a04e-4b10f972eca4 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:20.389363 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a15b0ddb-7a33-476c-a04e-4b10f972eca4 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:20.761382 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e8ff7df8-369e-4cd1-be4f-591a472bd1d6 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:20.774429 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e8ff7df8-369e-4cd1-be4f-591a472bd1d6 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/9eaf1302-c967-4a24-8772-df5b32f11a60" status: 200 len: 1468 microversion: 2.1 time: 0.541729 Oct 17 13:51:20.775953 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1868/3703] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:20 2022] GET /compute/v2.1/servers/9eaf1302-c967-4a24-8772-df5b32f11a60 => generated 1468 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:20.782031 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-23809952-1012-45a3-b995-0dbbbf3a6130 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:20.782842 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-23809952-1012-45a3-b995-0dbbbf3a6130 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:20.796219 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-23809952-1012-45a3-b995-0dbbbf3a6130 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:20.797140 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-23809952-1012-45a3-b995-0dbbbf3a6130 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:20.798117 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-23809952-1012-45a3-b995-0dbbbf3a6130 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:20.799754 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-23809952-1012-45a3-b995-0dbbbf3a6130 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:20.800537 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-23809952-1012-45a3-b995-0dbbbf3a6130 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:20.801195 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-23809952-1012-45a3-b995-0dbbbf3a6130 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:20.894338 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a15b0ddb-7a33-476c-a04e-4b10f972eca4 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:20.903415 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a15b0ddb-7a33-476c-a04e-4b10f972eca4 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084" status: 200 len: 1735 microversion: 2.1 time: 0.539155 Oct 17 13:51:20.904226 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1836/3704] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:20 2022] GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084 => generated 1735 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:51:21.122297 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-1a5dbc20-a10d-4ebf-89e6-6045eaeae8b2 req-2b7af252-c9c5-4501-8659-cbe026cff339 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9eaf1302-c967-4a24-8772-df5b32f11a60", "name": "network-vif-deleted", "tag": "1629935f-cce8-40f2-bbc7-1ee779fadbb9"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:51:21.149457 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-1a5dbc20-a10d-4ebf-89e6-6045eaeae8b2 req-2b7af252-c9c5-4501-8659-cbe026cff339 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:21.152244 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-1a5dbc20-a10d-4ebf-89e6-6045eaeae8b2 req-2b7af252-c9c5-4501-8659-cbe026cff339 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:21.155984 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-1a5dbc20-a10d-4ebf-89e6-6045eaeae8b2 req-2b7af252-c9c5-4501-8659-cbe026cff339 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:21.174268 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-1a5dbc20-a10d-4ebf-89e6-6045eaeae8b2 req-2b7af252-c9c5-4501-8659-cbe026cff339 service nova] Creating event network-vif-deleted:1629935f-cce8-40f2-bbc7-1ee779fadbb9 for instance 9eaf1302-c967-4a24-8772-df5b32f11a60 on n-h2-854247-14 Oct 17 13:51:21.198871 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-1a5dbc20-a10d-4ebf-89e6-6045eaeae8b2 req-2b7af252-c9c5-4501-8659-cbe026cff339 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080829 Oct 17 13:51:21.199776 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1837/3705] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:51:21.351008 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-23809952-1012-45a3-b995-0dbbbf3a6130 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683d18db860a4d60ab3eeba2a372b2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11973b8e1d8a4af8add65726e8ba7c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:21.367102 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-23809952-1012-45a3-b995-0dbbbf3a6130 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5" status: 200 len: 1362 microversion: 2.1 time: 0.589731 Oct 17 13:51:21.370743 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1869/3706] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:20 2022] GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5 => generated 1362 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:21.800140 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9cbc4a1a-9970-46a0-b911-3c223a6938fd tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:21.800761 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9cbc4a1a-9970-46a0-b911-3c223a6938fd tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9eaf1302-c967-4a24-8772-df5b32f11a60] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:21.815705 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9cbc4a1a-9970-46a0-b911-3c223a6938fd tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:21.818614 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9cbc4a1a-9970-46a0-b911-3c223a6938fd tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:21.819201 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9cbc4a1a-9970-46a0-b911-3c223a6938fd tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:21.820567 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9cbc4a1a-9970-46a0-b911-3c223a6938fd tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:21.821846 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9cbc4a1a-9970-46a0-b911-3c223a6938fd tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:21.822206 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9cbc4a1a-9970-46a0-b911-3c223a6938fd tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:21.874540 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9cbc4a1a-9970-46a0-b911-3c223a6938fd tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:21.875728 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9cbc4a1a-9970-46a0-b911-3c223a6938fd tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:21.876542 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9cbc4a1a-9970-46a0-b911-3c223a6938fd tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:21.877403 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-9cbc4a1a-9970-46a0-b911-3c223a6938fd tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lazy-loading 'fault' on Instance uuid 9eaf1302-c967-4a24-8772-df5b32f11a60 {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:51:21.933510 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-081edee1-8a3a-4726-a329-2b53525012bc tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:21.935654 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-081edee1-8a3a-4726-a329-2b53525012bc tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 3197da72-e924-4f50-8c93-c3f3ff98e084] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:21.949566 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-081edee1-8a3a-4726-a329-2b53525012bc tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:21.950699 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-081edee1-8a3a-4726-a329-2b53525012bc tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:21.957858 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-081edee1-8a3a-4726-a329-2b53525012bc tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:21.960371 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-081edee1-8a3a-4726-a329-2b53525012bc tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:21.962895 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-081edee1-8a3a-4726-a329-2b53525012bc tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:21.964635 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-081edee1-8a3a-4726-a329-2b53525012bc tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:22.025807 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9cbc4a1a-9970-46a0-b911-3c223a6938fd tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:22.049215 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9cbc4a1a-9970-46a0-b911-3c223a6938fd tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/9eaf1302-c967-4a24-8772-df5b32f11a60" status: 200 len: 1302 microversion: 2.1 time: 0.254693 Oct 17 13:51:22.073594 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1838/3707] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:21 2022] GET /compute/v2.1/servers/9eaf1302-c967-4a24-8772-df5b32f11a60 => generated 1302 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:22.363723 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-081edee1-8a3a-4726-a329-2b53525012bc tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:22.377649 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-081edee1-8a3a-4726-a329-2b53525012bc tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084" status: 200 len: 1735 microversion: 2.1 time: 0.453910 Oct 17 13:51:22.394032 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b260cf45-4965-47f2-8b12-f1646980f5ed tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:22.394651 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b260cf45-4965-47f2-8b12-f1646980f5ed tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:22.399796 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1870/3708] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:21 2022] GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084 => generated 1735 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:51:22.402045 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b260cf45-4965-47f2-8b12-f1646980f5ed tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:22.413191 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b260cf45-4965-47f2-8b12-f1646980f5ed tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:22.413690 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b260cf45-4965-47f2-8b12-f1646980f5ed tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:22.414454 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b260cf45-4965-47f2-8b12-f1646980f5ed tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:22.414915 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b260cf45-4965-47f2-8b12-f1646980f5ed tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:22.415414 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b260cf45-4965-47f2-8b12-f1646980f5ed tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:22.804483 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b260cf45-4965-47f2-8b12-f1646980f5ed tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683d18db860a4d60ab3eeba2a372b2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11973b8e1d8a4af8add65726e8ba7c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:22.819659 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b260cf45-4965-47f2-8b12-f1646980f5ed tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5" status: 200 len: 1362 microversion: 2.1 time: 0.430003 Oct 17 13:51:22.820754 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1839/3709] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:22 2022] GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5 => generated 1362 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:51:23.078558 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3d381117-81f1-49c9-9ebb-9459770db856 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:23.079278 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3d381117-81f1-49c9-9ebb-9459770db856 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9eaf1302-c967-4a24-8772-df5b32f11a60] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:23.088198 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3d381117-81f1-49c9-9ebb-9459770db856 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:23.088983 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3d381117-81f1-49c9-9ebb-9459770db856 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:23.089698 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3d381117-81f1-49c9-9ebb-9459770db856 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:23.090687 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3d381117-81f1-49c9-9ebb-9459770db856 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:23.091405 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3d381117-81f1-49c9-9ebb-9459770db856 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:23.092119 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3d381117-81f1-49c9-9ebb-9459770db856 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:23.112840 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-3d381117-81f1-49c9-9ebb-9459770db856 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] HTTP exception thrown: Instance 9eaf1302-c967-4a24-8772-df5b32f11a60 could not be found. Oct 17 13:51:23.114988 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3d381117-81f1-49c9-9ebb-9459770db856 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Request method failure captured: Oct 17 13:51:23.114988 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/9eaf1302-c967-4a24-8772-df5b32f11a60 HTTP/1.1 Oct 17 13:51:23.114988 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:51:23.114988 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:51:23.114988 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:51:23.114988 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:51:23.114988 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:51:23.114988 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:51:23.114988 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:51:23.114988 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:51:23.114988 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVyQD_4uCbehCVnS_PsuBoADiugecl4b8yF4Y4WeVLBs8DKVR1pyqyL4gbSchpL08WwYQsQVUqfERwxTe-Bz7MzGTlzKyUOmDjD_KYqYHnzmtD-KnmDvRRFEL0fc4o_hrhmb6pjsJG0GId0mXfwWZE_ZbBqg8YJCAEy8ViKVBYdNuoQ Oct 17 13:51:23.114988 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:51:23.114988 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:51:23.114988 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:51:23.114988 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:51:23.114988 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:51:23.114988 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:51:23.114988 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 5b98e3f377c14838a31cc430c98855e1 Oct 17 13:51:23.114988 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-MigrationsAdminTest-2029741506 Oct 17 13:51:23.114988 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:51:23.114988 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:51:23.114988 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5b98e3f377c14838a31cc430c98855e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5b98e3f377c14838a31cc430c98855e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5b98e3f377c14838a31cc430c98855e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5b98e3f377c14838a31cc430c98855e1", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:51:23.114988 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-MigrationsAdminTest-2029741506 Oct 17 13:51:23.114988 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 5b98e3f377c14838a31cc430c98855e1 Oct 17 13:51:23.114988 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-MigrationsAdminTest-2029741506 Oct 17 13:51:23.114988 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-MigrationsAdminTest-2029741506-project Oct 17 13:51:23.114988 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:51:23.114988 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:51:23.114988 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 0906fe70cb054729bfb95b2196c1a5d3 Oct 17 13:51:23.114988 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-MigrationsAdminTest-2029741506-project Oct 17 13:51:23.114988 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:51:23.114988 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 9eaf1302-c967-4a24-8772-df5b32f11a60 could not be found. Oct 17 13:51:23.114988 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '9eaf1302-c967-4a24-8772-df5b32f11a60'} Oct 17 13:51:23.114988 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:51:23.114988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:23.114988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:51:23.114988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:51:23.114988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:51:23.114988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:51:23.114988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:51:23.114988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:51:23.114988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:51:23.114988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:51:23.114988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9eaf1302-c967-4a24-8772-df5b32f11a60 could not be found. Oct 17 13:51:23.114988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:51:23.114988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:51:23.114988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:51:23.114988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:23.114988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:51:23.114988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:51:23.114988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:51:23.114988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:51:23.114988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:51:23.114988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:51:23.114988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:51:23.114988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:51:23.114988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:51:23.114988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:51:23.114988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:51:23.114988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:51:23.114988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9eaf1302-c967-4a24-8772-df5b32f11a60 could not be found. Oct 17 13:51:23.114988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:51:23.114988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:51:23.114988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:51:23.119437 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:23.119437 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:51:23.119437 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:51:23.119437 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:51:23.119437 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:51:23.119437 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9eaf1302-c967-4a24-8772-df5b32f11a60 could not be found. Oct 17 13:51:23.119437 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:51:23.121638 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3d381117-81f1-49c9-9ebb-9459770db856 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Returning 404 to user: Instance 9eaf1302-c967-4a24-8772-df5b32f11a60 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:51:23.124823 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3d381117-81f1-49c9-9ebb-9459770db856 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/9eaf1302-c967-4a24-8772-df5b32f11a60" status: 404 len: 111 microversion: 2.1 time: 0.050111 Oct 17 13:51:23.129612 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1871/3710] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:23 2022] GET /compute/v2.1/servers/9eaf1302-c967-4a24-8772-df5b32f11a60 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:51:23.136536 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2a61d245-1c5e-4552-af5a-56031bb15c36 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:23.137097 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2a61d245-1c5e-4552-af5a-56031bb15c36 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9d1105b3-be41-4963-a86b-6f4486d1d382] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:23.155192 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2a61d245-1c5e-4552-af5a-56031bb15c36 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:23.155699 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2a61d245-1c5e-4552-af5a-56031bb15c36 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:23.156140 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2a61d245-1c5e-4552-af5a-56031bb15c36 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:23.156846 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2a61d245-1c5e-4552-af5a-56031bb15c36 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:23.157942 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2a61d245-1c5e-4552-af5a-56031bb15c36 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:23.158451 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2a61d245-1c5e-4552-af5a-56031bb15c36 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:23.202705 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2a61d245-1c5e-4552-af5a-56031bb15c36 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9d1105b3-be41-4963-a86b-6f4486d1d382] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:51:23.331386 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2a61d245-1c5e-4552-af5a-56031bb15c36 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "DELETE /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382" status: 204 len: 0 microversion: 2.1 time: 0.194602 Oct 17 13:51:23.332560 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1840/3711] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:51:23 2022] DELETE /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:51:23.340938 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fc117df8-a08f-40fd-80b0-42de853bf8f0 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:23.341689 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-fc117df8-a08f-40fd-80b0-42de853bf8f0 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9d1105b3-be41-4963-a86b-6f4486d1d382] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:23.352008 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fc117df8-a08f-40fd-80b0-42de853bf8f0 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:23.352992 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fc117df8-a08f-40fd-80b0-42de853bf8f0 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:23.353678 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fc117df8-a08f-40fd-80b0-42de853bf8f0 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:23.354633 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fc117df8-a08f-40fd-80b0-42de853bf8f0 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:23.355356 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fc117df8-a08f-40fd-80b0-42de853bf8f0 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:23.357972 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fc117df8-a08f-40fd-80b0-42de853bf8f0 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:23.408874 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-20a0c624-85c2-457e-8d9e-eb9408202557 req-56132781-3302-4a34-a95d-17a4c2326aa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5", "name": "network-vif-plugged", "status": "completed", "tag": "f4683ce3-d22f-48db-8109-19e7698684bb"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:51:23.420475 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-20a0c624-85c2-457e-8d9e-eb9408202557 req-56132781-3302-4a34-a95d-17a4c2326aa8 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:23.420953 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-20a0c624-85c2-457e-8d9e-eb9408202557 req-56132781-3302-4a34-a95d-17a4c2326aa8 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:23.421378 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-20a0c624-85c2-457e-8d9e-eb9408202557 req-56132781-3302-4a34-a95d-17a4c2326aa8 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:23.460482 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-20a0c624-85c2-457e-8d9e-eb9408202557 req-56132781-3302-4a34-a95d-17a4c2326aa8 service nova] Creating event network-vif-plugged:f4683ce3-d22f-48db-8109-19e7698684bb for instance bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5 on n-h2-854247-14 Oct 17 13:51:23.466198 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-20a0c624-85c2-457e-8d9e-eb9408202557 req-56132781-3302-4a34-a95d-17a4c2326aa8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061711 Oct 17 13:51:23.471974 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1841/3712] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:51:23.484153 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-97ccd334-3d9e-41ae-b9ce-506c1a2e98a8 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:23.485020 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-97ccd334-3d9e-41ae-b9ce-506c1a2e98a8 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 3197da72-e924-4f50-8c93-c3f3ff98e084] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:23.493606 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-97ccd334-3d9e-41ae-b9ce-506c1a2e98a8 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:23.497198 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-97ccd334-3d9e-41ae-b9ce-506c1a2e98a8 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:23.497951 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-97ccd334-3d9e-41ae-b9ce-506c1a2e98a8 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:23.498909 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-97ccd334-3d9e-41ae-b9ce-506c1a2e98a8 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:23.501319 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-97ccd334-3d9e-41ae-b9ce-506c1a2e98a8 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:23.502480 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-97ccd334-3d9e-41ae-b9ce-506c1a2e98a8 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:24.245694 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fc117df8-a08f-40fd-80b0-42de853bf8f0 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:24.274876 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fc117df8-a08f-40fd-80b0-42de853bf8f0 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382" status: 200 len: 1468 microversion: 2.1 time: 0.938158 Oct 17 13:51:24.278373 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1872/3713] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:23 2022] GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382 => generated 1468 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:51:24.289172 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cc3c5e9d-52dc-4787-93bb-e3e7d3b37dd3 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:24.289799 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cc3c5e9d-52dc-4787-93bb-e3e7d3b37dd3 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:24.316412 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cc3c5e9d-52dc-4787-93bb-e3e7d3b37dd3 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:24.316929 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cc3c5e9d-52dc-4787-93bb-e3e7d3b37dd3 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:24.317374 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cc3c5e9d-52dc-4787-93bb-e3e7d3b37dd3 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:24.329759 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cc3c5e9d-52dc-4787-93bb-e3e7d3b37dd3 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:24.332509 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cc3c5e9d-52dc-4787-93bb-e3e7d3b37dd3 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:24.335578 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cc3c5e9d-52dc-4787-93bb-e3e7d3b37dd3 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:24.424991 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-97ccd334-3d9e-41ae-b9ce-506c1a2e98a8 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:24.458416 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-97ccd334-3d9e-41ae-b9ce-506c1a2e98a8 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084" status: 200 len: 1735 microversion: 2.1 time: 0.978685 Oct 17 13:51:24.459056 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1842/3714] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:23 2022] GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084 => generated 1735 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:24.690215 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cc3c5e9d-52dc-4787-93bb-e3e7d3b37dd3 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683d18db860a4d60ab3eeba2a372b2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11973b8e1d8a4af8add65726e8ba7c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:24.699477 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cc3c5e9d-52dc-4787-93bb-e3e7d3b37dd3 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5" status: 200 len: 1362 microversion: 2.1 time: 0.414943 Oct 17 13:51:24.717084 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1873/3715] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:24 2022] GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5 => generated 1362 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:25.301531 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-daff2079-33ff-401a-8e85-b6183f1c3e65 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:25.302152 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-daff2079-33ff-401a-8e85-b6183f1c3e65 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9d1105b3-be41-4963-a86b-6f4486d1d382] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:25.311467 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-daff2079-33ff-401a-8e85-b6183f1c3e65 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:25.311981 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-daff2079-33ff-401a-8e85-b6183f1c3e65 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:25.312387 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-daff2079-33ff-401a-8e85-b6183f1c3e65 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:25.313810 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-daff2079-33ff-401a-8e85-b6183f1c3e65 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:25.314735 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-daff2079-33ff-401a-8e85-b6183f1c3e65 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:25.315669 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-daff2079-33ff-401a-8e85-b6183f1c3e65 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:25.485739 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5b1c2d92-579e-4772-b964-19554a521dd6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:25.487297 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5b1c2d92-579e-4772-b964-19554a521dd6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 3197da72-e924-4f50-8c93-c3f3ff98e084] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:25.501085 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5b1c2d92-579e-4772-b964-19554a521dd6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:25.502125 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5b1c2d92-579e-4772-b964-19554a521dd6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:25.502817 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5b1c2d92-579e-4772-b964-19554a521dd6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:25.503919 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5b1c2d92-579e-4772-b964-19554a521dd6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:25.506004 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5b1c2d92-579e-4772-b964-19554a521dd6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:25.506681 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5b1c2d92-579e-4772-b964-19554a521dd6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:25.663725 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-daff2079-33ff-401a-8e85-b6183f1c3e65 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:25.673233 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-daff2079-33ff-401a-8e85-b6183f1c3e65 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382" status: 200 len: 1468 microversion: 2.1 time: 0.375661 Oct 17 13:51:25.674584 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1843/3716] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:25 2022] GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382 => generated 1468 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:25.722021 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5b1c2d92-579e-4772-b964-19554a521dd6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:25.734274 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5b1c2d92-579e-4772-b964-19554a521dd6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084" status: 200 len: 1735 microversion: 2.1 time: 0.253694 Oct 17 13:51:25.747711 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1874/3717] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:25 2022] GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084 => generated 1735 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:25.756940 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2b9b508d-0b05-4ecc-983d-d3ee8f53aef2 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:25.758011 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2b9b508d-0b05-4ecc-983d-d3ee8f53aef2 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:25.764637 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2b9b508d-0b05-4ecc-983d-d3ee8f53aef2 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:25.765484 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2b9b508d-0b05-4ecc-983d-d3ee8f53aef2 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:25.766111 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2b9b508d-0b05-4ecc-983d-d3ee8f53aef2 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:25.767013 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2b9b508d-0b05-4ecc-983d-d3ee8f53aef2 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:25.767881 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2b9b508d-0b05-4ecc-983d-d3ee8f53aef2 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:25.768566 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2b9b508d-0b05-4ecc-983d-d3ee8f53aef2 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:25.844113 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-62fe83a1-3f92-4c37-826a-9b2907388a02 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Action: 'create', calling method: .version_select at 0x7f7cd46955e0>, body: {"keypair": {"name": "tempest-keypair-981586921", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgPl/UDpIHmAve0c2iY1IMqihc6bYeziiyugHL3GOOYm14KCeYW3isI6k1Pldk5RbHxadbFszo0qg4M7xTx7kx8S+0Ooffs5n2fMAw3Hm+iX8Ed1s2N88w5fEYiWZoLyg=="}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:51:25.854882 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:51:25.870938 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-62fe83a1-3f92-4c37-826a-9b2907388a02 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Getting quotas for project 45371f66db35454fbe896194e75afd6e. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:51:25.880032 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-62fe83a1-3f92-4c37-826a-9b2907388a02 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Getting quotas for user c9382b34782f44e2818a26ecadc3f386 and project 45371f66db35454fbe896194e75afd6e. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:51:25.914654 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-62fe83a1-3f92-4c37-826a-9b2907388a02 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.238394 Oct 17 13:51:25.916034 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1844/3718] 10.222.0.79 () {60 vars in 1159 bytes} [Mon Oct 17 13:51:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:51:25.978813 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2b9b508d-0b05-4ecc-983d-d3ee8f53aef2 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683d18db860a4d60ab3eeba2a372b2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11973b8e1d8a4af8add65726e8ba7c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:25.994460 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2b9b508d-0b05-4ecc-983d-d3ee8f53aef2 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5" status: 200 len: 1547 microversion: 2.1 time: 0.245183 Oct 17 13:51:25.996481 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1875/3719] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:25 2022] GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5 => generated 1547 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:26.020658 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-555f99a9-a4a5-4e32-9cf8-bb14c2202615 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:26.021432 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-555f99a9-a4a5-4e32-9cf8-bb14c2202615 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:26.027907 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-555f99a9-a4a5-4e32-9cf8-bb14c2202615 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:26.028711 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-555f99a9-a4a5-4e32-9cf8-bb14c2202615 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:26.029387 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-555f99a9-a4a5-4e32-9cf8-bb14c2202615 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:26.030243 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-555f99a9-a4a5-4e32-9cf8-bb14c2202615 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:26.030880 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-555f99a9-a4a5-4e32-9cf8-bb14c2202615 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:26.031678 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-555f99a9-a4a5-4e32-9cf8-bb14c2202615 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:26.136520 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-3599a0ad-e869-4161-93a3-fcb425855258 req-b8306c64-6d1b-4807-8604-3355b8415694 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d1105b3-be41-4963-a86b-6f4486d1d382", "name": "network-vif-deleted", "tag": "6cb71ea7-7943-454e-82a0-31ed2ec43a1c"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:51:26.153136 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-3599a0ad-e869-4161-93a3-fcb425855258 req-b8306c64-6d1b-4807-8604-3355b8415694 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:26.153925 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-3599a0ad-e869-4161-93a3-fcb425855258 req-b8306c64-6d1b-4807-8604-3355b8415694 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:26.154565 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-3599a0ad-e869-4161-93a3-fcb425855258 req-b8306c64-6d1b-4807-8604-3355b8415694 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:26.193694 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-555f99a9-a4a5-4e32-9cf8-bb14c2202615 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.178647 Oct 17 13:51:26.194535 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1845/3720] 10.222.0.79 () {58 vars in 1275 bytes} [Mon Oct 17 13:51:26 2022] GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5/os-interface => generated 284 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:51:26.223114 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-3599a0ad-e869-4161-93a3-fcb425855258 req-b8306c64-6d1b-4807-8604-3355b8415694 service nova] Creating event network-vif-deleted:6cb71ea7-7943-454e-82a0-31ed2ec43a1c for instance 9d1105b3-be41-4963-a86b-6f4486d1d382 on n-h1-854247-14 Oct 17 13:51:26.230800 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-3599a0ad-e869-4161-93a3-fcb425855258 req-b8306c64-6d1b-4807-8604-3355b8415694 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098233 Oct 17 13:51:26.234676 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1876/3721] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:51:26.698464 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-69e51410-f625-4b7d-a00b-29a3677b380d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:26.699094 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-69e51410-f625-4b7d-a00b-29a3677b380d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9d1105b3-be41-4963-a86b-6f4486d1d382] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:26.712642 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69e51410-f625-4b7d-a00b-29a3677b380d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:26.713143 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69e51410-f625-4b7d-a00b-29a3677b380d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:26.713582 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69e51410-f625-4b7d-a00b-29a3677b380d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:26.714435 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69e51410-f625-4b7d-a00b-29a3677b380d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:26.714751 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69e51410-f625-4b7d-a00b-29a3677b380d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:26.715207 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69e51410-f625-4b7d-a00b-29a3677b380d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:26.751306 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69e51410-f625-4b7d-a00b-29a3677b380d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:26.752097 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69e51410-f625-4b7d-a00b-29a3677b380d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:26.752614 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69e51410-f625-4b7d-a00b-29a3677b380d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:26.753299 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-69e51410-f625-4b7d-a00b-29a3677b380d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lazy-loading 'fault' on Instance uuid 9d1105b3-be41-4963-a86b-6f4486d1d382 {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:51:26.763052 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4cc2b514-29a2-4ed8-9008-d3cd6472929f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:26.764008 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4cc2b514-29a2-4ed8-9008-d3cd6472929f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 3197da72-e924-4f50-8c93-c3f3ff98e084] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:26.772862 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4cc2b514-29a2-4ed8-9008-d3cd6472929f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:26.773804 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4cc2b514-29a2-4ed8-9008-d3cd6472929f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:26.774440 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4cc2b514-29a2-4ed8-9008-d3cd6472929f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:26.775526 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4cc2b514-29a2-4ed8-9008-d3cd6472929f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:26.776178 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4cc2b514-29a2-4ed8-9008-d3cd6472929f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:26.776853 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4cc2b514-29a2-4ed8-9008-d3cd6472929f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:26.985174 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-69e51410-f625-4b7d-a00b-29a3677b380d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0906fe70cb054729bfb95b2196c1a5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b98e3f377c14838a31cc430c98855e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:26.998410 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-69e51410-f625-4b7d-a00b-29a3677b380d tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382" status: 200 len: 1302 microversion: 2.1 time: 0.304247 Oct 17 13:51:26.999009 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1846/3722] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:26 2022] GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382 => generated 1302 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:27.233205 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4cc2b514-29a2-4ed8-9008-d3cd6472929f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:27.247653 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4cc2b514-29a2-4ed8-9008-d3cd6472929f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084" status: 200 len: 1735 microversion: 2.1 time: 0.489124 Oct 17 13:51:27.249066 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1877/3723] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:26 2022] GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084 => generated 1735 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:27.944206 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-12459cfd-a133-4d7c-8c59-7890530c85fc tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-178478333", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1d5948d6-f169-4d00-b98f-07daff8883f9"}], "security_groups": [{"name": "tempest-securitygroup--941089339"}], "key_name": "tempest-keypair-981586921", "user_data": "}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:51:28.022048 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0c4c1590-6ea5-49be-93d2-32d915120df1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:28.022766 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0c4c1590-6ea5-49be-93d2-32d915120df1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] [instance: 9d1105b3-be41-4963-a86b-6f4486d1d382] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:28.030391 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0c4c1590-6ea5-49be-93d2-32d915120df1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:28.031114 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0c4c1590-6ea5-49be-93d2-32d915120df1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:28.031572 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0c4c1590-6ea5-49be-93d2-32d915120df1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:28.032284 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0c4c1590-6ea5-49be-93d2-32d915120df1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:28.032807 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0c4c1590-6ea5-49be-93d2-32d915120df1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:28.033277 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0c4c1590-6ea5-49be-93d2-32d915120df1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:28.049866 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-0c4c1590-6ea5-49be-93d2-32d915120df1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] HTTP exception thrown: Instance 9d1105b3-be41-4963-a86b-6f4486d1d382 could not be found. Oct 17 13:51:28.051826 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0c4c1590-6ea5-49be-93d2-32d915120df1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Request method failure captured: Oct 17 13:51:28.051826 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382 HTTP/1.1 Oct 17 13:51:28.051826 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:51:28.051826 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:51:28.051826 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:51:28.051826 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:51:28.051826 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:51:28.051826 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:51:28.051826 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:51:28.051826 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:51:28.051826 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVyQD_4uCbehCVnS_PsuBoADiugecl4b8yF4Y4WeVLBs8DKVR1pyqyL4gbSchpL08WwYQsQVUqfERwxTe-Bz7MzGTlzKyUOmDjD_KYqYHnzmtD-KnmDvRRFEL0fc4o_hrhmb6pjsJG0GId0mXfwWZE_ZbBqg8YJCAEy8ViKVBYdNuoQ Oct 17 13:51:28.051826 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:51:28.051826 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:51:28.051826 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:51:28.051826 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:51:28.051826 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:51:28.051826 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:51:28.051826 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 5b98e3f377c14838a31cc430c98855e1 Oct 17 13:51:28.051826 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-MigrationsAdminTest-2029741506 Oct 17 13:51:28.051826 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:51:28.051826 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:51:28.051826 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5b98e3f377c14838a31cc430c98855e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5b98e3f377c14838a31cc430c98855e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5b98e3f377c14838a31cc430c98855e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5b98e3f377c14838a31cc430c98855e1", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:51:28.051826 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-MigrationsAdminTest-2029741506 Oct 17 13:51:28.051826 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 5b98e3f377c14838a31cc430c98855e1 Oct 17 13:51:28.051826 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-MigrationsAdminTest-2029741506 Oct 17 13:51:28.051826 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-MigrationsAdminTest-2029741506-project Oct 17 13:51:28.051826 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:51:28.051826 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:51:28.051826 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 0906fe70cb054729bfb95b2196c1a5d3 Oct 17 13:51:28.051826 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-MigrationsAdminTest-2029741506-project Oct 17 13:51:28.051826 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:51:28.051826 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 9d1105b3-be41-4963-a86b-6f4486d1d382 could not be found. Oct 17 13:51:28.051826 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '9d1105b3-be41-4963-a86b-6f4486d1d382'} Oct 17 13:51:28.051826 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:51:28.051826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:28.051826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:51:28.051826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:51:28.051826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:51:28.051826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:51:28.051826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:51:28.051826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:51:28.051826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:51:28.051826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:51:28.051826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d1105b3-be41-4963-a86b-6f4486d1d382 could not be found. Oct 17 13:51:28.051826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:51:28.051826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:51:28.051826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:51:28.051826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:28.051826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:51:28.051826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:51:28.051826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:51:28.051826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:51:28.051826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:51:28.051826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:51:28.051826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:51:28.051826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:51:28.051826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:51:28.051826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:51:28.051826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:51:28.051826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:51:28.051826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d1105b3-be41-4963-a86b-6f4486d1d382 could not be found. Oct 17 13:51:28.051826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:51:28.051826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:51:28.051826 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:51:28.058019 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:28.058019 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:51:28.058019 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:51:28.058019 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:51:28.058019 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:51:28.058019 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d1105b3-be41-4963-a86b-6f4486d1d382 could not be found. Oct 17 13:51:28.058019 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:51:28.058019 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0c4c1590-6ea5-49be-93d2-32d915120df1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] Returning 404 to user: Instance 9d1105b3-be41-4963-a86b-6f4486d1d382 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:51:28.058019 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0c4c1590-6ea5-49be-93d2-32d915120df1 tempest-MigrationsAdminTest-2029741506 tempest-MigrationsAdminTest-2029741506-project] 10.222.0.79 "GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382" status: 404 len: 111 microversion: 2.1 time: 0.035499 Oct 17 13:51:28.058019 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1878/3724] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:28 2022] GET /compute/v2.1/servers/9d1105b3-be41-4963-a86b-6f4486d1d382 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:51:28.273421 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1e779cbe-aa52-438f-801a-cee487c46dc9 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:28.274416 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-1e779cbe-aa52-438f-801a-cee487c46dc9 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 3197da72-e924-4f50-8c93-c3f3ff98e084] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:28.288153 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-12459cfd-a133-4d7c-8c59-7890530c85fc tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] validate_networks() for [('1d5948d6-f169-4d00-b98f-07daff8883f9', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:51:28.293385 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1e779cbe-aa52-438f-801a-cee487c46dc9 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:28.301853 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1e779cbe-aa52-438f-801a-cee487c46dc9 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:28.302963 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1e779cbe-aa52-438f-801a-cee487c46dc9 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:28.306582 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1e779cbe-aa52-438f-801a-cee487c46dc9 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:28.307629 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1e779cbe-aa52-438f-801a-cee487c46dc9 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:28.309800 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1e779cbe-aa52-438f-801a-cee487c46dc9 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:29.014887 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-1e779cbe-aa52-438f-801a-cee487c46dc9 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:29.029353 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1e779cbe-aa52-438f-801a-cee487c46dc9 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084" status: 200 len: 1735 microversion: 2.1 time: 0.760166 Oct 17 13:51:29.033398 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1879/3725] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:28 2022] GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084 => generated 1735 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:29.105299 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-c32b7b0f-1785-41d6-a9d2-be1a0ed0ef6a req-3eab77fd-e40f-46fb-b709-4a3640d7a910 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5", "tag": "f4683ce3-d22f-48db-8109-19e7698684bb"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:51:29.127794 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-c32b7b0f-1785-41d6-a9d2-be1a0ed0ef6a req-3eab77fd-e40f-46fb-b709-4a3640d7a910 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:29.130135 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-c32b7b0f-1785-41d6-a9d2-be1a0ed0ef6a req-3eab77fd-e40f-46fb-b709-4a3640d7a910 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:29.132458 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-c32b7b0f-1785-41d6-a9d2-be1a0ed0ef6a req-3eab77fd-e40f-46fb-b709-4a3640d7a910 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:29.208359 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-c32b7b0f-1785-41d6-a9d2-be1a0ed0ef6a req-3eab77fd-e40f-46fb-b709-4a3640d7a910 service nova] Creating event network-changed:f4683ce3-d22f-48db-8109-19e7698684bb for instance bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5 on n-h2-854247-14 Oct 17 13:51:29.223117 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-c32b7b0f-1785-41d6-a9d2-be1a0ed0ef6a req-3eab77fd-e40f-46fb-b709-4a3640d7a910 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121855 Oct 17 13:51:29.262490 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1880/3726] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:51:29.735062 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-12459cfd-a133-4d7c-8c59-7890530c85fc tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:51:29.735062 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-12459cfd-a133-4d7c-8c59-7890530c85fc tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:51:29.735062 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-12459cfd-a133-4d7c-8c59-7890530c85fc tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:51:29.735062 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-12459cfd-a133-4d7c-8c59-7890530c85fc tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:51:29.735062 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-12459cfd-a133-4d7c-8c59-7890530c85fc tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:51:29.763007 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-12459cfd-a133-4d7c-8c59-7890530c85fc tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:29.763570 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-12459cfd-a133-4d7c-8c59-7890530c85fc tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:29.764189 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-12459cfd-a133-4d7c-8c59-7890530c85fc tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:29.765288 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-12459cfd-a133-4d7c-8c59-7890530c85fc tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:29.765947 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-12459cfd-a133-4d7c-8c59-7890530c85fc tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:29.766651 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-12459cfd-a133-4d7c-8c59-7890530c85fc tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:29.792661 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-12459cfd-a133-4d7c-8c59-7890530c85fc tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Getting quotas for project 45371f66db35454fbe896194e75afd6e. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:51:29.802059 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-12459cfd-a133-4d7c-8c59-7890530c85fc tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Getting quotas for user c9382b34782f44e2818a26ecadc3f386 and project 45371f66db35454fbe896194e75afd6e. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:51:29.828329 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-12459cfd-a133-4d7c-8c59-7890530c85fc tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:51:29.833034 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-12459cfd-a133-4d7c-8c59-7890530c85fc tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:51:29.956721 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-12459cfd-a133-4d7c-8c59-7890530c85fc tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.018303 Oct 17 13:51:29.958005 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1847/3727] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:51:27 2022] POST /compute/v2.1/servers => generated 408 bytes in 2020 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:51:29.970147 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5cd2e2ef-f3aa-473e-8e72-c660033b6ca1 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:29.972291 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5cd2e2ef-f3aa-473e-8e72-c660033b6ca1 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:30.066720 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-fd84518a-13b2-440d-b936-f9d1d2f60d10 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:30.067304 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-fd84518a-13b2-440d-b936-f9d1d2f60d10 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 3197da72-e924-4f50-8c93-c3f3ff98e084] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:30.103227 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fd84518a-13b2-440d-b936-f9d1d2f60d10 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:30.103711 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fd84518a-13b2-440d-b936-f9d1d2f60d10 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:30.110241 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fd84518a-13b2-440d-b936-f9d1d2f60d10 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:30.111761 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fd84518a-13b2-440d-b936-f9d1d2f60d10 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:30.112387 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fd84518a-13b2-440d-b936-f9d1d2f60d10 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:30.114804 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fd84518a-13b2-440d-b936-f9d1d2f60d10 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:30.127408 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5cd2e2ef-f3aa-473e-8e72-c660033b6ca1 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:30.142971 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5cd2e2ef-f3aa-473e-8e72-c660033b6ca1 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1237 microversion: 2.1 time: 0.176657 Oct 17 13:51:30.183391 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1881/3728] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:29 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1237 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:30.700570 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-fd84518a-13b2-440d-b936-f9d1d2f60d10 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:30.725968 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-fd84518a-13b2-440d-b936-f9d1d2f60d10 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084" status: 200 len: 1735 microversion: 2.1 time: 0.671170 Oct 17 13:51:30.729732 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1848/3729] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:30 2022] GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084 => generated 1735 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:31.170602 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5ecb8be7-5504-46cc-892c-db80e4bf8ce6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:31.171745 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5ecb8be7-5504-46cc-892c-db80e4bf8ce6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:31.190277 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5ecb8be7-5504-46cc-892c-db80e4bf8ce6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:31.190984 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5ecb8be7-5504-46cc-892c-db80e4bf8ce6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:31.191744 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5ecb8be7-5504-46cc-892c-db80e4bf8ce6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:31.192464 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5ecb8be7-5504-46cc-892c-db80e4bf8ce6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:31.192918 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5ecb8be7-5504-46cc-892c-db80e4bf8ce6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:31.193344 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5ecb8be7-5504-46cc-892c-db80e4bf8ce6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:31.307950 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5ecb8be7-5504-46cc-892c-db80e4bf8ce6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:31.321891 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5ecb8be7-5504-46cc-892c-db80e4bf8ce6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1289 microversion: 2.1 time: 0.154877 Oct 17 13:51:31.342248 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1882/3730] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:31 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1289 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:31.754372 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a682b46a-699e-4a05-b363-c30ed37c5f5f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:31.754889 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a682b46a-699e-4a05-b363-c30ed37c5f5f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 3197da72-e924-4f50-8c93-c3f3ff98e084] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:31.772032 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a682b46a-699e-4a05-b363-c30ed37c5f5f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:31.772855 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a682b46a-699e-4a05-b363-c30ed37c5f5f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:31.773567 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a682b46a-699e-4a05-b363-c30ed37c5f5f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:31.775468 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a682b46a-699e-4a05-b363-c30ed37c5f5f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:31.779760 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a682b46a-699e-4a05-b363-c30ed37c5f5f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:31.780422 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a682b46a-699e-4a05-b363-c30ed37c5f5f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:32.055149 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a682b46a-699e-4a05-b363-c30ed37c5f5f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:32.068244 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a682b46a-699e-4a05-b363-c30ed37c5f5f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084" status: 200 len: 1735 microversion: 2.1 time: 0.317863 Oct 17 13:51:32.069576 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1849/3731] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:31 2022] GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084 => generated 1735 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:32.350502 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4843d0e5-cecd-499c-826f-d9c74702a617 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:32.351309 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4843d0e5-cecd-499c-826f-d9c74702a617 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:32.365029 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4843d0e5-cecd-499c-826f-d9c74702a617 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:32.365525 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4843d0e5-cecd-499c-826f-d9c74702a617 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:32.367900 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4843d0e5-cecd-499c-826f-d9c74702a617 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:32.369731 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4843d0e5-cecd-499c-826f-d9c74702a617 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:32.371371 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4843d0e5-cecd-499c-826f-d9c74702a617 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:32.372165 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4843d0e5-cecd-499c-826f-d9c74702a617 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:32.431521 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:51:32.522312 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4843d0e5-cecd-499c-826f-d9c74702a617 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:32.530969 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4843d0e5-cecd-499c-826f-d9c74702a617 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1295 microversion: 2.1 time: 0.188093 Oct 17 13:51:32.532274 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1883/3732] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:32 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1295 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:32.840641 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ef1f394c-5922-446f-9465-149648f5e3bf tempest-QuotaClassesAdminTestJSON-2115169356 tempest-QuotaClassesAdminTestJSON-2115169356-project-admin] Calling method '.version_select at 0x7f7cd4695430>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:32.852876 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ef1f394c-5922-446f-9465-149648f5e3bf tempest-QuotaClassesAdminTestJSON-2115169356 tempest-QuotaClassesAdminTestJSON-2115169356-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.179470 Oct 17 13:51:32.853604 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1850/3733] 10.222.0.79 () {58 vars in 1185 bytes} [Mon Oct 17 13:51:32 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:51:32.866528 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-93399e02-3358-4eed-8c58-374d9da5b813 tempest-QuotaClassesAdminTestJSON-2115169356 tempest-QuotaClassesAdminTestJSON-2115169356-project-admin] Action: 'update', calling method: .version_select at 0x7f7cd4fa39d0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:51:33.018818 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=7,nova_api:DELETE=1,nova_api:INSERT=5 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:51:33.095012 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c1c2788b-a5ed-44f4-817b-e044aea93665 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:33.096280 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c1c2788b-a5ed-44f4-817b-e044aea93665 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 3197da72-e924-4f50-8c93-c3f3ff98e084] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:33.113149 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c1c2788b-a5ed-44f4-817b-e044aea93665 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:33.113986 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c1c2788b-a5ed-44f4-817b-e044aea93665 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:33.114561 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c1c2788b-a5ed-44f4-817b-e044aea93665 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:33.115403 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c1c2788b-a5ed-44f4-817b-e044aea93665 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:33.115977 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c1c2788b-a5ed-44f4-817b-e044aea93665 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:33.116723 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c1c2788b-a5ed-44f4-817b-e044aea93665 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:33.145704 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-93399e02-3358-4eed-8c58-374d9da5b813 tempest-QuotaClassesAdminTestJSON-2115169356 tempest-QuotaClassesAdminTestJSON-2115169356-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.283570 Oct 17 13:51:33.146650 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1884/3734] 10.222.0.79 () {60 vars in 1206 bytes} [Mon Oct 17 13:51:32 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:51:33.158405 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a8806ad6-4d14-4887-87a2-077393fb20d2 tempest-QuotaClassesAdminTestJSON-2115169356 tempest-QuotaClassesAdminTestJSON-2115169356-project-admin] Calling method '.version_select at 0x7f7cd5533af0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:33.170177 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a8806ad6-4d14-4887-87a2-077393fb20d2 tempest-QuotaClassesAdminTestJSON-2115169356 tempest-QuotaClassesAdminTestJSON-2115169356-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.016116 Oct 17 13:51:33.170780 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1885/3735] 10.222.0.79 () {58 vars in 1185 bytes} [Mon Oct 17 13:51:33 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:51:33.185355 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f8b5dcd0-9a80-4dbe-99fd-aa6984057518 tempest-QuotaClassesAdminTestJSON-2115169356 tempest-QuotaClassesAdminTestJSON-2115169356-project-admin] Action: 'update', calling method: .version_select at 0x7f7cd4cc8dc0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:51:33.290786 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f8b5dcd0-9a80-4dbe-99fd-aa6984057518 tempest-QuotaClassesAdminTestJSON-2115169356 tempest-QuotaClassesAdminTestJSON-2115169356-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.110101 Oct 17 13:51:33.299465 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1886/3736] 10.222.0.79 () {60 vars in 1206 bytes} [Mon Oct 17 13:51:33 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:51:33.451653 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c1c2788b-a5ed-44f4-817b-e044aea93665 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:33.464350 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c1c2788b-a5ed-44f4-817b-e044aea93665 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084" status: 200 len: 1735 microversion: 2.1 time: 0.375181 Oct 17 13:51:33.465479 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1851/3737] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:33 2022] GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084 => generated 1735 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:51:33.557497 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8bd4f7d0-d5cb-448d-867b-ab4ca47e0a21 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:33.559857 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8bd4f7d0-d5cb-448d-867b-ab4ca47e0a21 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:33.568254 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8bd4f7d0-d5cb-448d-867b-ab4ca47e0a21 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:33.569599 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8bd4f7d0-d5cb-448d-867b-ab4ca47e0a21 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:33.570273 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8bd4f7d0-d5cb-448d-867b-ab4ca47e0a21 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:33.572125 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8bd4f7d0-d5cb-448d-867b-ab4ca47e0a21 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:33.572810 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8bd4f7d0-d5cb-448d-867b-ab4ca47e0a21 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:33.573552 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8bd4f7d0-d5cb-448d-867b-ab4ca47e0a21 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:33.802594 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8bd4f7d0-d5cb-448d-867b-ab4ca47e0a21 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:33.811922 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8bd4f7d0-d5cb-448d-867b-ab4ca47e0a21 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1362 microversion: 2.1 time: 0.261681 Oct 17 13:51:33.812608 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1887/3738] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:33 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1362 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:34.437888 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-17addf64-1ff0-477c-8fd4-2bfab7a4f3e7 req-506e997d-ebe5-467b-9f40-5087378eded6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96dd349a-6476-4a7d-8f55-ea10e3b1e05d", "tag": "fa985869-a190-4726-b04f-7d06a5c193e1"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:51:34.473009 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-17addf64-1ff0-477c-8fd4-2bfab7a4f3e7 req-506e997d-ebe5-467b-9f40-5087378eded6 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:34.473649 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-17addf64-1ff0-477c-8fd4-2bfab7a4f3e7 req-506e997d-ebe5-467b-9f40-5087378eded6 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:34.474235 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-17addf64-1ff0-477c-8fd4-2bfab7a4f3e7 req-506e997d-ebe5-467b-9f40-5087378eded6 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:34.492946 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f2815b88-179c-48da-8522-7c9c0b6ab47c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:34.493793 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f2815b88-179c-48da-8522-7c9c0b6ab47c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 3197da72-e924-4f50-8c93-c3f3ff98e084] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:34.509040 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f2815b88-179c-48da-8522-7c9c0b6ab47c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:34.510247 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f2815b88-179c-48da-8522-7c9c0b6ab47c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:34.511029 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f2815b88-179c-48da-8522-7c9c0b6ab47c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:34.513008 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f2815b88-179c-48da-8522-7c9c0b6ab47c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:34.513490 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f2815b88-179c-48da-8522-7c9c0b6ab47c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:34.517209 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-17addf64-1ff0-477c-8fd4-2bfab7a4f3e7 req-506e997d-ebe5-467b-9f40-5087378eded6 service nova] Creating event network-changed:fa985869-a190-4726-b04f-7d06a5c193e1 for instance 96dd349a-6476-4a7d-8f55-ea10e3b1e05d on n-h2-854247-14 Oct 17 13:51:34.518894 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f2815b88-179c-48da-8522-7c9c0b6ab47c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:34.534588 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-17addf64-1ff0-477c-8fd4-2bfab7a4f3e7 req-506e997d-ebe5-467b-9f40-5087378eded6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100330 Oct 17 13:51:34.535743 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1852/3739] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:51:34.844547 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c6875d28-a057-4230-afb3-ce42040924d5 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:34.846119 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c6875d28-a057-4230-afb3-ce42040924d5 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:34.856293 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c6875d28-a057-4230-afb3-ce42040924d5 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:34.858261 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c6875d28-a057-4230-afb3-ce42040924d5 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:34.858948 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c6875d28-a057-4230-afb3-ce42040924d5 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:34.859908 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c6875d28-a057-4230-afb3-ce42040924d5 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:34.861132 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c6875d28-a057-4230-afb3-ce42040924d5 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:34.863072 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c6875d28-a057-4230-afb3-ce42040924d5 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:35.378299 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f2815b88-179c-48da-8522-7c9c0b6ab47c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:35.388990 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f2815b88-179c-48da-8522-7c9c0b6ab47c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084" status: 200 len: 1735 microversion: 2.1 time: 0.900822 Oct 17 13:51:35.390536 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1888/3740] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:34 2022] GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084 => generated 1735 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:51:35.580666 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c6875d28-a057-4230-afb3-ce42040924d5 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:35.589320 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c6875d28-a057-4230-afb3-ce42040924d5 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1362 microversion: 2.1 time: 0.755949 Oct 17 13:51:35.589958 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1853/3741] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:34 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1362 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:36.413679 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b69bbf10-5515-4a09-adc4-405ec01f99e2 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:36.414358 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b69bbf10-5515-4a09-adc4-405ec01f99e2 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 3197da72-e924-4f50-8c93-c3f3ff98e084] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:36.429842 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b69bbf10-5515-4a09-adc4-405ec01f99e2 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:36.431199 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b69bbf10-5515-4a09-adc4-405ec01f99e2 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:36.432960 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b69bbf10-5515-4a09-adc4-405ec01f99e2 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:36.434222 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b69bbf10-5515-4a09-adc4-405ec01f99e2 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:36.434699 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b69bbf10-5515-4a09-adc4-405ec01f99e2 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:36.439837 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b69bbf10-5515-4a09-adc4-405ec01f99e2 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:36.614305 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-48644794-9ff3-43d9-8ad5-ca45e911d8f9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:36.615417 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-48644794-9ff3-43d9-8ad5-ca45e911d8f9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:36.623572 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48644794-9ff3-43d9-8ad5-ca45e911d8f9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:36.630175 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48644794-9ff3-43d9-8ad5-ca45e911d8f9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:36.630831 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48644794-9ff3-43d9-8ad5-ca45e911d8f9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:36.631776 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48644794-9ff3-43d9-8ad5-ca45e911d8f9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:36.633167 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48644794-9ff3-43d9-8ad5-ca45e911d8f9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:36.634813 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48644794-9ff3-43d9-8ad5-ca45e911d8f9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:36.685342 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:51:36.943790 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b69bbf10-5515-4a09-adc4-405ec01f99e2 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:36.958521 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b69bbf10-5515-4a09-adc4-405ec01f99e2 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084" status: 200 len: 1735 microversion: 2.1 time: 0.549168 Oct 17 13:51:36.959820 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1889/3742] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:36 2022] GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084 => generated 1735 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:37.190297 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-48644794-9ff3-43d9-8ad5-ca45e911d8f9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:37.200199 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-48644794-9ff3-43d9-8ad5-ca45e911d8f9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1362 microversion: 2.1 time: 0.591518 Oct 17 13:51:37.201484 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1854/3743] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:36 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1362 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:37.756395 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1e87cf91-d4da-4fbc-a46d-1c26fd395807 tempest-TenantUsagesNegativeTestJSON-622104603 tempest-TenantUsagesNegativeTestJSON-622104603-project-admin] 10.222.0.79 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-16T13%3A51%3A37.626628&end=2022-10-18T13%3A51%3A37.626628" status: 404 len: 112 microversion: - time: 0.126009 Oct 17 13:51:37.757514 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1890/3744] 10.222.0.79 () {58 vars in 1316 bytes} [Mon Oct 17 13:51:37 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-16T13%3A51%3A37.626628&end=2022-10-18T13%3A51%3A37.626628 => generated 112 bytes in 128 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 17 13:51:37.772264 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-19ddc9b8-459d-49e8-b408-b66f109961e4 tempest-TenantUsagesNegativeTestJSON-622104603 tempest-TenantUsagesNegativeTestJSON-622104603-project-admin] Calling method '.version_select at 0x7f7cd98a1670>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:37.778586 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-19ddc9b8-459d-49e8-b408-b66f109961e4 tempest-TenantUsagesNegativeTestJSON-622104603 tempest-TenantUsagesNegativeTestJSON-622104603-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 17 13:51:37.790335 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-19ddc9b8-459d-49e8-b408-b66f109961e4 tempest-TenantUsagesNegativeTestJSON-622104603 tempest-TenantUsagesNegativeTestJSON-622104603-project-admin] Request method failure captured: Oct 17 13:51:37.790335 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/os-simple-tenant-usage/0363e28b90854ced930210c693faa8c5?start=2022-10-18T13%3A51%3A37.626628&end=2022-10-16T13%3A51%3A37.626628 HTTP/1.1 Oct 17 13:51:37.790335 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:51:37.790335 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:51:37.790335 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:51:37.790335 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:51:37.790335 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:51:37.790335 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:51:37.790335 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:51:37.790335 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:51:37.790335 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTV3pShiGrONkguXdo_p1IOeNOzCKCyCXcn9603T-8Y70nX3mPyVjAy1HXs9RYzwetKQ3kLVsN5OFqPRXFvvJMhKkFEO2DLucnIvK2gVujWIBwh8t60Uv6uVod2fE-ak6RPWx8T6C3VlSJb7BYfVmFspZziVQ-k-f3i_mGRwRwF9hA4w Oct 17 13:51:37.790335 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:51:37.790335 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:51:37.790335 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:51:37.790335 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:51:37.790335 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:51:37.790335 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:51:37.790335 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 3c531b05fc2145f88083bc6104255c47 Oct 17 13:51:37.790335 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-622104603 Oct 17 13:51:37.790335 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member,admin Oct 17 13:51:37.790335 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member,admin Oct 17 13:51:37.790335 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3c531b05fc2145f88083bc6104255c47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/3c531b05fc2145f88083bc6104255c47"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3c531b05fc2145f88083bc6104255c47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_3c531b05fc2145f88083bc6104255c47", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:51:37.790335 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-622104603 Oct 17 13:51:37.790335 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 3c531b05fc2145f88083bc6104255c47 Oct 17 13:51:37.790335 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-622104603 Oct 17 13:51:37.790335 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-TenantUsagesNegativeTestJSON-622104603-project-admin Oct 17 13:51:37.790335 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:51:37.790335 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:51:37.790335 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: de2f5586b7e1424a9ed09b8af2f5a573 Oct 17 13:51:37.790335 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-622104603-project-admin Oct 17 13:51:37.790335 n-d-854247-14 devstack@n-api.service[127017]: method: Oct 17 13:51:37.790335 n-d-854247-14 devstack@n-api.service[127017]: exception: Invalid start time. The start time cannot occur after the end time. Oct 17 13:51:37.790335 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '0363e28b90854ced930210c693faa8c5'} Oct 17 13:51:37.790335 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:51:37.790335 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:37.790335 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:51:37.790335 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:51:37.790335 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:51:37.790335 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:51:37.790335 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:51:37.790335 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:51:37.790335 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 13:51:37.790335 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:51:37.790335 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:51:37.790335 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:51:37.790335 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 17 13:51:37.790335 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 17 13:51:37.790335 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 17 13:51:37.790335 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 17 13:51:37.790335 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 17 13:51:37.790335 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 17 13:51:37.790335 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 17 13:51:37.790335 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:51:37.790335 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:51:37.790335 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:51:37.790335 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:37.790335 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:51:37.790335 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:51:37.790335 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:51:37.790335 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:51:37.790335 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 17 13:51:37.790335 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:51:37.796025 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-19ddc9b8-459d-49e8-b408-b66f109961e4 tempest-TenantUsagesNegativeTestJSON-622104603 tempest-TenantUsagesNegativeTestJSON-622104603-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:51:37.797064 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-19ddc9b8-459d-49e8-b408-b66f109961e4 tempest-TenantUsagesNegativeTestJSON-622104603 tempest-TenantUsagesNegativeTestJSON-622104603-project-admin] 10.222.0.79 "GET /compute/v2.1/os-simple-tenant-usage/0363e28b90854ced930210c693faa8c5?start=2022-10-18T13%3A51%3A37.626628&end=2022-10-16T13%3A51%3A37.626628" status: 400 len: 111 microversion: 2.1 time: 0.033576 Oct 17 13:51:37.798078 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1855/3745] 10.222.0.79 () {58 vars in 1412 bytes} [Mon Oct 17 13:51:37 2022] GET /compute/v2.1/os-simple-tenant-usage/0363e28b90854ced930210c693faa8c5?start=2022-10-18T13%3A51%3A37.626628&end=2022-10-16T13%3A51%3A37.626628 => generated 111 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:51:37.943639 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0235b609-2bbf-42ba-8674-894cb79f7568 tempest-TenantUsagesNegativeTestJSON-1995584543 tempest-TenantUsagesNegativeTestJSON-1995584543-project] Calling method '.version_select at 0x7f7cd44843a0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:37.947802 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0235b609-2bbf-42ba-8674-894cb79f7568 tempest-TenantUsagesNegativeTestJSON-1995584543 tempest-TenantUsagesNegativeTestJSON-1995584543-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'b07d0def15f447c79382a64b944f611d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0363e28b90854ced930210c693faa8c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:37.952942 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0235b609-2bbf-42ba-8674-894cb79f7568 tempest-TenantUsagesNegativeTestJSON-1995584543 tempest-TenantUsagesNegativeTestJSON-1995584543-project] Request method failure captured: Oct 17 13:51:37.952942 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-16T13%3A51%3A37.626628&end=2022-10-18T13%3A51%3A37.626628&detailed=1 HTTP/1.1 Oct 17 13:51:37.952942 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:51:37.952942 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:51:37.952942 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:51:37.952942 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:51:37.952942 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:51:37.952942 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:51:37.952942 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:51:37.952942 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:51:37.952942 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTV3oHOYFiUNkjqjbFthGAoa48V2vrzNqyscGkjzFm771TaOQ8WQUHHxxWY9PjrZmhlRbbGFW7c7Y47IbMCJBgVHa-rdBM9QVH9Q0T20pr89xj1yyaFVEMAQaExUQtYqnGekwzINXsEtPxjWBPnxLtL1g68jWXSjU8fdTHfIJWl7dlRE Oct 17 13:51:37.952942 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:51:37.952942 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:51:37.952942 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:51:37.952942 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:51:37.952942 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:51:37.952942 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:51:37.952942 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 0363e28b90854ced930210c693faa8c5 Oct 17 13:51:37.952942 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1995584543 Oct 17 13:51:37.952942 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:51:37.952942 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:51:37.952942 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0363e28b90854ced930210c693faa8c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0363e28b90854ced930210c693faa8c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0363e28b90854ced930210c693faa8c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0363e28b90854ced930210c693faa8c5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:51:37.952942 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1995584543 Oct 17 13:51:37.952942 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 0363e28b90854ced930210c693faa8c5 Oct 17 13:51:37.952942 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1995584543 Oct 17 13:51:37.952942 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-TenantUsagesNegativeTestJSON-1995584543-project Oct 17 13:51:37.952942 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:51:37.952942 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:51:37.952942 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: b07d0def15f447c79382a64b944f611d Oct 17 13:51:37.952942 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1995584543-project Oct 17 13:51:37.952942 n-d-854247-14 devstack@n-api.service[127016]: method: Oct 17 13:51:37.952942 n-d-854247-14 devstack@n-api.service[127016]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 17 13:51:37.952942 n-d-854247-14 devstack@n-api.service[127016]: action_args: {} Oct 17 13:51:37.952942 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:51:37.952942 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:37.952942 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:51:37.952942 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:51:37.952942 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:51:37.952942 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:51:37.952942 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:51:37.952942 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:51:37.952942 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 13:51:37.952942 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:51:37.952942 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:51:37.952942 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:51:37.952942 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 17 13:51:37.952942 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 17 13:51:37.952942 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 17 13:51:37.952942 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 17 13:51:37.952942 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:51:37.952942 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:51:37.952942 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:51:37.952942 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:51:37.952942 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:51:37.952942 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:51:37.952942 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:51:37.952942 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:51:37.952942 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:51:37.952942 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:51:37.952942 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:51:37.952942 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:51:37.952942 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:51:37.955954 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:51:37.955954 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 17 13:51:37.955954 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:51:37.955954 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:51:37.955954 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:51:37.955954 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:37.955954 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:51:37.955954 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:51:37.955954 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:51:37.955954 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:51:37.955954 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 17 13:51:37.955954 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:51:37.957624 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0235b609-2bbf-42ba-8674-894cb79f7568 tempest-TenantUsagesNegativeTestJSON-1995584543 tempest-TenantUsagesNegativeTestJSON-1995584543-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:51:37.958497 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0235b609-2bbf-42ba-8674-894cb79f7568 tempest-TenantUsagesNegativeTestJSON-1995584543 tempest-TenantUsagesNegativeTestJSON-1995584543-project] 10.222.0.79 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-16T13%3A51%3A37.626628&end=2022-10-18T13%3A51%3A37.626628&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.154770 Oct 17 13:51:37.963113 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1891/3746] 10.222.0.79 () {58 vars in 1335 bytes} [Mon Oct 17 13:51:37 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-16T13%3A51%3A37.626628&end=2022-10-18T13%3A51%3A37.626628&detailed=1 => generated 123 bytes in 156 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:51:37.986683 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a0db42fa-b0c5-4dd6-8618-2b0a6563225b tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:37.988186 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a0db42fa-b0c5-4dd6-8618-2b0a6563225b tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 3197da72-e924-4f50-8c93-c3f3ff98e084] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:37.997087 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a0db42fa-b0c5-4dd6-8618-2b0a6563225b tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:37.997584 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a0db42fa-b0c5-4dd6-8618-2b0a6563225b tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:38.004891 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a0db42fa-b0c5-4dd6-8618-2b0a6563225b tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:38.005729 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a0db42fa-b0c5-4dd6-8618-2b0a6563225b tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:38.006221 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a0db42fa-b0c5-4dd6-8618-2b0a6563225b tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:38.006663 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a0db42fa-b0c5-4dd6-8618-2b0a6563225b tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:38.227955 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f6f74395-d251-428b-a759-ff3101e65d5c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:38.228661 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f6f74395-d251-428b-a759-ff3101e65d5c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:38.235601 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f6f74395-d251-428b-a759-ff3101e65d5c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:38.236599 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f6f74395-d251-428b-a759-ff3101e65d5c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:38.237490 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f6f74395-d251-428b-a759-ff3101e65d5c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:38.238536 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f6f74395-d251-428b-a759-ff3101e65d5c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:38.239649 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f6f74395-d251-428b-a759-ff3101e65d5c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:38.240783 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f6f74395-d251-428b-a759-ff3101e65d5c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:38.245724 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a0db42fa-b0c5-4dd6-8618-2b0a6563225b tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:38.261061 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a0db42fa-b0c5-4dd6-8618-2b0a6563225b tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084" status: 200 len: 1735 microversion: 2.1 time: 0.279699 Oct 17 13:51:38.261659 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1856/3747] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:37 2022] GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084 => generated 1735 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:38.593854 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f6f74395-d251-428b-a759-ff3101e65d5c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:38.601930 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f6f74395-d251-428b-a759-ff3101e65d5c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1362 microversion: 2.1 time: 0.380437 Oct 17 13:51:38.616033 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1892/3748] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:38 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1362 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:51:39.284437 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e8d64788-86ca-47e1-951b-f793e4c6899a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:39.285042 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e8d64788-86ca-47e1-951b-f793e4c6899a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 3197da72-e924-4f50-8c93-c3f3ff98e084] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:39.292156 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e8d64788-86ca-47e1-951b-f793e4c6899a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:39.292922 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e8d64788-86ca-47e1-951b-f793e4c6899a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:39.293347 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e8d64788-86ca-47e1-951b-f793e4c6899a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:39.294044 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e8d64788-86ca-47e1-951b-f793e4c6899a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:39.294695 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e8d64788-86ca-47e1-951b-f793e4c6899a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:39.295105 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e8d64788-86ca-47e1-951b-f793e4c6899a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:39.438054 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e8d64788-86ca-47e1-951b-f793e4c6899a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:39.447993 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e8d64788-86ca-47e1-951b-f793e4c6899a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084" status: 200 len: 1735 microversion: 2.1 time: 0.167510 Oct 17 13:51:39.458106 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1857/3749] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:39 2022] GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:39.626324 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-11421e6d-3945-44f6-ae4c-e339bd186c9b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:39.627023 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-11421e6d-3945-44f6-ae4c-e339bd186c9b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:39.641545 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-11421e6d-3945-44f6-ae4c-e339bd186c9b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:39.642146 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-11421e6d-3945-44f6-ae4c-e339bd186c9b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:39.642594 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-11421e6d-3945-44f6-ae4c-e339bd186c9b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:39.643353 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-11421e6d-3945-44f6-ae4c-e339bd186c9b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:39.643818 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-11421e6d-3945-44f6-ae4c-e339bd186c9b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:39.644242 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-11421e6d-3945-44f6-ae4c-e339bd186c9b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:39.828738 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-11421e6d-3945-44f6-ae4c-e339bd186c9b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:39.838562 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-11421e6d-3945-44f6-ae4c-e339bd186c9b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1362 microversion: 2.1 time: 0.216505 Oct 17 13:51:39.839184 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1893/3750] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:39 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1362 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:40.473655 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9f266630-c412-437f-b030-c40a95280c56 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:40.475445 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9f266630-c412-437f-b030-c40a95280c56 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 3197da72-e924-4f50-8c93-c3f3ff98e084] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:40.478557 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:51:40.488379 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f266630-c412-437f-b030-c40a95280c56 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:40.489076 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f266630-c412-437f-b030-c40a95280c56 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:40.489992 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f266630-c412-437f-b030-c40a95280c56 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:40.490915 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f266630-c412-437f-b030-c40a95280c56 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:40.491601 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f266630-c412-437f-b030-c40a95280c56 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:40.493025 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f266630-c412-437f-b030-c40a95280c56 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:40.687682 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9f266630-c412-437f-b030-c40a95280c56 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:40.698451 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9f266630-c412-437f-b030-c40a95280c56 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084" status: 200 len: 1735 microversion: 2.1 time: 0.230343 Oct 17 13:51:40.699041 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1858/3751] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:40 2022] GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084 => generated 1735 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:40.732326 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-133bb8b7-ae7f-4807-9162-2bd93044bd04 req-5d8e3d9b-8f79-417d-9785-75a68f54ce54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96dd349a-6476-4a7d-8f55-ea10e3b1e05d", "name": "network-vif-plugged", "status": "completed", "tag": "fa985869-a190-4726-b04f-7d06a5c193e1"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:51:40.762628 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-133bb8b7-ae7f-4807-9162-2bd93044bd04 req-5d8e3d9b-8f79-417d-9785-75a68f54ce54 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:40.763508 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-133bb8b7-ae7f-4807-9162-2bd93044bd04 req-5d8e3d9b-8f79-417d-9785-75a68f54ce54 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:40.764328 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-133bb8b7-ae7f-4807-9162-2bd93044bd04 req-5d8e3d9b-8f79-417d-9785-75a68f54ce54 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:40.778304 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-133bb8b7-ae7f-4807-9162-2bd93044bd04 req-5d8e3d9b-8f79-417d-9785-75a68f54ce54 service nova] Creating event network-vif-plugged:fa985869-a190-4726-b04f-7d06a5c193e1 for instance 96dd349a-6476-4a7d-8f55-ea10e3b1e05d on n-h2-854247-14 Oct 17 13:51:40.785022 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-133bb8b7-ae7f-4807-9162-2bd93044bd04 req-5d8e3d9b-8f79-417d-9785-75a68f54ce54 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056361 Oct 17 13:51:40.785941 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1894/3752] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:51:40.864448 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9b979ba6-5d95-4361-8d68-0378cd01cd04 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:40.865189 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9b979ba6-5d95-4361-8d68-0378cd01cd04 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:40.872248 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9b979ba6-5d95-4361-8d68-0378cd01cd04 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:40.872924 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9b979ba6-5d95-4361-8d68-0378cd01cd04 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:40.873423 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9b979ba6-5d95-4361-8d68-0378cd01cd04 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:40.874306 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9b979ba6-5d95-4361-8d68-0378cd01cd04 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:40.874852 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9b979ba6-5d95-4361-8d68-0378cd01cd04 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:40.875406 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9b979ba6-5d95-4361-8d68-0378cd01cd04 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:40.952673 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f09383ee-0a41-437a-a496-37d8d093b17e tempest-FlavorsV2NegativeTest-783643963 tempest-FlavorsV2NegativeTest-783643963-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:40.961537 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f09383ee-0a41-437a-a496-37d8d093b17e tempest-FlavorsV2NegativeTest-783643963 tempest-FlavorsV2NegativeTest-783643963-project] 10.222.0.79 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.165418 Oct 17 13:51:40.962131 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1859/3753] 10.222.0.79 () {58 vars in 1137 bytes} [Mon Oct 17 13:51:40 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:51:41.110176 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9b979ba6-5d95-4361-8d68-0378cd01cd04 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:41.120466 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9b979ba6-5d95-4361-8d68-0378cd01cd04 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1362 microversion: 2.1 time: 0.260604 Oct 17 13:51:41.121144 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1895/3754] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:40 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1362 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:41.610251 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f7888b57-9d96-47cc-a857-a94e6b227741 tempest-FlavorsV2NegativeTest-783643963 tempest-FlavorsV2NegativeTest-783643963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1536175099", "imageRef": "71f9235d-484c-47a5-9afc-2b1a4414a03b", "flavorRef": "452"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:51:41.663466 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-f7888b57-9d96-47cc-a857-a94e6b227741 tempest-FlavorsV2NegativeTest-783643963 tempest-FlavorsV2NegativeTest-783643963-project] validate_networks() for None {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:51:41.725697 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cb873a0a-cfe6-497d-b897-18a75bc6266a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:41.726346 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cb873a0a-cfe6-497d-b897-18a75bc6266a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 3197da72-e924-4f50-8c93-c3f3ff98e084] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:41.732865 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb873a0a-cfe6-497d-b897-18a75bc6266a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:41.733640 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb873a0a-cfe6-497d-b897-18a75bc6266a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:41.734079 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb873a0a-cfe6-497d-b897-18a75bc6266a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:41.734784 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb873a0a-cfe6-497d-b897-18a75bc6266a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:41.735314 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb873a0a-cfe6-497d-b897-18a75bc6266a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:41.735763 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb873a0a-cfe6-497d-b897-18a75bc6266a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:41.939010 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-f7888b57-9d96-47cc-a857-a94e6b227741 tempest-FlavorsV2NegativeTest-783643963 tempest-FlavorsV2NegativeTest-783643963-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 17 13:51:41.941474 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cb873a0a-cfe6-497d-b897-18a75bc6266a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:41.942020 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f7888b57-9d96-47cc-a857-a94e6b227741 tempest-FlavorsV2NegativeTest-783643963 tempest-FlavorsV2NegativeTest-783643963-project] Request method failure captured: Oct 17 13:51:41.942020 n-d-854247-14 devstack@n-api.service[127017]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:51:41.942020 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:51:41.942020 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:51:41.942020 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:51:41.942020 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 143 Oct 17 13:51:41.942020 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:51:41.942020 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:51:41.942020 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:51:41.942020 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:51:41.942020 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTV3st4saAD2_aDHJ5_9FIXtnayPs7PadajpRYAWMH8jLK_gQet76lMO8zUa50WxGZq5MeN7vbhwsj8Fn0wCn_SZrHTGqP1GW3_RieE2CSpotNJqzsK23NIs6ekJ7sZBza5o_4-M3dGbV5UU5DDeXj1zzy_XbSW_IcjzJim54Qkvi5pw Oct 17 13:51:41.942020 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:51:41.942020 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:51:41.942020 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:51:41.942020 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:51:41.942020 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:51:41.942020 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:51:41.942020 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: b614ef52af9a47da9b60bc71e4332c49 Oct 17 13:51:41.942020 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-FlavorsV2NegativeTest-783643963 Oct 17 13:51:41.942020 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:51:41.942020 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:51:41.942020 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b614ef52af9a47da9b60bc71e4332c49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b614ef52af9a47da9b60bc71e4332c49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b614ef52af9a47da9b60bc71e4332c49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b614ef52af9a47da9b60bc71e4332c49", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:51:41.942020 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-FlavorsV2NegativeTest-783643963 Oct 17 13:51:41.942020 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: b614ef52af9a47da9b60bc71e4332c49 Oct 17 13:51:41.942020 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-783643963 Oct 17 13:51:41.942020 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-FlavorsV2NegativeTest-783643963-project Oct 17 13:51:41.942020 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:51:41.942020 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:51:41.942020 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: d7b5039da1f4444fbbdb774f884f9999 Oct 17 13:51:41.942020 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-FlavorsV2NegativeTest-783643963-project Oct 17 13:51:41.942020 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 13:51:41.942020 n-d-854247-14 devstack@n-api.service[127017]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1536175099", "imageRef": "71f9235d-484c-47a5-9afc-2b1a4414a03b", "flavorRef": "452"}} Oct 17 13:51:41.942020 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:51:41.942020 n-d-854247-14 devstack@n-api.service[127017]: exception: Flavor's memory is too small for requested image. Oct 17 13:51:41.942020 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1536175099', 'imageRef': '71f9235d-484c-47a5-9afc-2b1a4414a03b', 'flavorRef': '452'}}} Oct 17 13:51:41.942020 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:51:41.942020 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:41.942020 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 17 13:51:41.942020 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 17 13:51:41.942020 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 17 13:51:41.942020 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 17 13:51:41.942020 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 17 13:51:41.942020 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 17 13:51:41.942020 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 17 13:51:41.942020 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 17 13:51:41.942020 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 17 13:51:41.942020 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 17 13:51:41.942020 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 17 13:51:41.942020 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 17 13:51:41.942020 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 17 13:51:41.942020 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:51:41.942020 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:51:41.942020 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:51:41.942020 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:41.942020 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:51:41.942020 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:51:41.942020 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:51:41.942020 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:51:41.942020 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:51:41.942020 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:51:41.942020 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:51:41.942020 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:51:41.942020 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:51:41.942020 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:51:41.947503 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:51:41.947503 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:51:41.947503 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 17 13:51:41.947503 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 17 13:51:41.947503 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 17 13:51:41.947503 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 17 13:51:41.947503 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:51:41.947503 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:51:41.947503 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:51:41.947503 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:41.947503 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:51:41.947503 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:51:41.947503 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:51:41.947503 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:51:41.947503 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 17 13:51:41.947503 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:51:41.950601 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cb873a0a-cfe6-497d-b897-18a75bc6266a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084" status: 200 len: 1735 microversion: 2.1 time: 0.229546 Oct 17 13:51:41.956108 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1896/3755] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:41 2022] GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084 => generated 1735 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:51:41.956345 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f7888b57-9d96-47cc-a857-a94e6b227741 tempest-FlavorsV2NegativeTest-783643963 tempest-FlavorsV2NegativeTest-783643963-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:51:41.957470 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f7888b57-9d96-47cc-a857-a94e6b227741 tempest-FlavorsV2NegativeTest-783643963 tempest-FlavorsV2NegativeTest-783643963-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.351117 Oct 17 13:51:41.958265 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1860/3756] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:51:41 2022] POST /compute/v2.1/servers => generated 93 bytes in 353 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 17 13:51:42.143438 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-caf0c97f-3cda-4198-8a96-128537753f7c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:42.144128 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-caf0c97f-3cda-4198-8a96-128537753f7c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:42.155937 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-caf0c97f-3cda-4198-8a96-128537753f7c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:42.157201 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-caf0c97f-3cda-4198-8a96-128537753f7c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:42.157881 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-caf0c97f-3cda-4198-8a96-128537753f7c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:42.158809 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-caf0c97f-3cda-4198-8a96-128537753f7c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:42.160754 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-caf0c97f-3cda-4198-8a96-128537753f7c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:42.161467 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-caf0c97f-3cda-4198-8a96-128537753f7c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:42.369227 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-caf0c97f-3cda-4198-8a96-128537753f7c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:42.379336 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-caf0c97f-3cda-4198-8a96-128537753f7c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1362 microversion: 2.1 time: 0.239604 Oct 17 13:51:42.380512 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1897/3757] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:42 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1362 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:42.976406 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6a972b7a-71f6-4a24-8f57-53c2d42a2017 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:42.977678 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6a972b7a-71f6-4a24-8f57-53c2d42a2017 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 3197da72-e924-4f50-8c93-c3f3ff98e084] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:42.992251 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=12 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:51:42.995363 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6a972b7a-71f6-4a24-8f57-53c2d42a2017 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:42.996042 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6a972b7a-71f6-4a24-8f57-53c2d42a2017 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:42.996746 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6a972b7a-71f6-4a24-8f57-53c2d42a2017 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:42.997599 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6a972b7a-71f6-4a24-8f57-53c2d42a2017 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:42.998067 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6a972b7a-71f6-4a24-8f57-53c2d42a2017 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:42.998495 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6a972b7a-71f6-4a24-8f57-53c2d42a2017 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:43.162730 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6a972b7a-71f6-4a24-8f57-53c2d42a2017 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:43.171959 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6a972b7a-71f6-4a24-8f57-53c2d42a2017 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084" status: 200 len: 1735 microversion: 2.1 time: 0.199821 Oct 17 13:51:43.172930 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1861/3758] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:42 2022] GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084 => generated 1735 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:43.406867 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1b81becb-beea-4f0a-8932-d926dc25c3a0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:43.406867 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-1b81becb-beea-4f0a-8932-d926dc25c3a0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:43.409486 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=29,nova_cell0:UPDATE=7 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:51:43.416288 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1b81becb-beea-4f0a-8932-d926dc25c3a0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:43.417007 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1b81becb-beea-4f0a-8932-d926dc25c3a0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:43.417445 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1b81becb-beea-4f0a-8932-d926dc25c3a0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:43.418166 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1b81becb-beea-4f0a-8932-d926dc25c3a0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:43.418619 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1b81becb-beea-4f0a-8932-d926dc25c3a0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:43.419229 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1b81becb-beea-4f0a-8932-d926dc25c3a0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:43.592807 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-1b81becb-beea-4f0a-8932-d926dc25c3a0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:43.601576 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1b81becb-beea-4f0a-8932-d926dc25c3a0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1548 microversion: 2.1 time: 0.200994 Oct 17 13:51:43.607521 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1898/3759] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:43 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1548 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:43.625230 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-38e72624-1cc1-4a7d-affd-24bf61092594 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:43.626085 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-38e72624-1cc1-4a7d-affd-24bf61092594 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:43.632406 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-38e72624-1cc1-4a7d-affd-24bf61092594 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:43.632897 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-38e72624-1cc1-4a7d-affd-24bf61092594 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:43.633360 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-38e72624-1cc1-4a7d-affd-24bf61092594 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:43.634599 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-38e72624-1cc1-4a7d-affd-24bf61092594 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:43.635147 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-38e72624-1cc1-4a7d-affd-24bf61092594 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:43.635777 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-38e72624-1cc1-4a7d-affd-24bf61092594 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:43.736980 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-38e72624-1cc1-4a7d-affd-24bf61092594 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.116225 Oct 17 13:51:43.738536 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1862/3760] 10.222.0.79 () {58 vars in 1275 bytes} [Mon Oct 17 13:51:43 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d/os-interface => generated 284 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:51:44.199703 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-93313d03-d7f0-40c6-b48d-b283edb3f516 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:44.200470 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-93313d03-d7f0-40c6-b48d-b283edb3f516 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 3197da72-e924-4f50-8c93-c3f3ff98e084] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:44.208254 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-93313d03-d7f0-40c6-b48d-b283edb3f516 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:44.209039 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-93313d03-d7f0-40c6-b48d-b283edb3f516 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:44.209710 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-93313d03-d7f0-40c6-b48d-b283edb3f516 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:44.210515 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-93313d03-d7f0-40c6-b48d-b283edb3f516 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:44.211065 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-93313d03-d7f0-40c6-b48d-b283edb3f516 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:44.211621 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-93313d03-d7f0-40c6-b48d-b283edb3f516 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:44.555276 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-93313d03-d7f0-40c6-b48d-b283edb3f516 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:44.566576 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-93313d03-d7f0-40c6-b48d-b283edb3f516 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084" status: 200 len: 1735 microversion: 2.1 time: 0.372387 Oct 17 13:51:44.567825 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1899/3761] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:44 2022] GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084 => generated 1735 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:44.684547 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1025163d-3a92-49d2-b88c-aad5915ec3ad tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:44.686907 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1025163d-3a92-49d2-b88c-aad5915ec3ad tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] [instance: 531b762d-db7e-4911-af50-6b321b7706bf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:44.697365 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1025163d-3a92-49d2-b88c-aad5915ec3ad tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:44.698238 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1025163d-3a92-49d2-b88c-aad5915ec3ad tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:44.698982 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1025163d-3a92-49d2-b88c-aad5915ec3ad tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:44.700075 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1025163d-3a92-49d2-b88c-aad5915ec3ad tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:44.700780 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1025163d-3a92-49d2-b88c-aad5915ec3ad tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:44.701422 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1025163d-3a92-49d2-b88c-aad5915ec3ad tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:44.739307 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1025163d-3a92-49d2-b88c-aad5915ec3ad tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] [instance: 531b762d-db7e-4911-af50-6b321b7706bf] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:51:44.865374 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1025163d-3a92-49d2-b88c-aad5915ec3ad tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] 10.222.0.79 "DELETE /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf" status: 204 len: 0 microversion: 2.42 time: 0.574601 Oct 17 13:51:44.866198 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1863/3762] 10.222.0.79 () {60 vars in 1280 bytes} [Mon Oct 17 13:51:44 2022] DELETE /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf => generated 0 bytes in 578 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:51:44.875551 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4e4db0ed-2a99-49a9-8e9a-58586768a955 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:44.876538 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4e4db0ed-2a99-49a9-8e9a-58586768a955 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] [instance: 531b762d-db7e-4911-af50-6b321b7706bf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:44.900803 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4e4db0ed-2a99-49a9-8e9a-58586768a955 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:44.901684 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4e4db0ed-2a99-49a9-8e9a-58586768a955 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:44.902369 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4e4db0ed-2a99-49a9-8e9a-58586768a955 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:44.903239 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4e4db0ed-2a99-49a9-8e9a-58586768a955 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:44.903965 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4e4db0ed-2a99-49a9-8e9a-58586768a955 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:44.904466 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4e4db0ed-2a99-49a9-8e9a-58586768a955 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:45.275611 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4e4db0ed-2a99-49a9-8e9a-58586768a955 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:45.302729 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4e4db0ed-2a99-49a9-8e9a-58586768a955 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:45.304225 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4e4db0ed-2a99-49a9-8e9a-58586768a955 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:45.305861 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4e4db0ed-2a99-49a9-8e9a-58586768a955 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] 10.222.0.79 "GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf" status: 200 len: 2963 microversion: 2.42 time: 0.434497 Oct 17 13:51:45.332363 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1900/3763] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:51:44 2022] GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf => generated 2963 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:51:45.537183 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-3e98c723-03aa-4e59-b13c-7fd68c11ce6b req-45f44d4d-29c1-4991-a277-3069f17127e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96dd349a-6476-4a7d-8f55-ea10e3b1e05d", "tag": "fa985869-a190-4726-b04f-7d06a5c193e1"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:51:45.556081 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-3e98c723-03aa-4e59-b13c-7fd68c11ce6b req-45f44d4d-29c1-4991-a277-3069f17127e1 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:45.557097 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-3e98c723-03aa-4e59-b13c-7fd68c11ce6b req-45f44d4d-29c1-4991-a277-3069f17127e1 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:45.558089 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-3e98c723-03aa-4e59-b13c-7fd68c11ce6b req-45f44d4d-29c1-4991-a277-3069f17127e1 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:45.572270 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-3e98c723-03aa-4e59-b13c-7fd68c11ce6b req-45f44d4d-29c1-4991-a277-3069f17127e1 service nova] Creating event network-changed:fa985869-a190-4726-b04f-7d06a5c193e1 for instance 96dd349a-6476-4a7d-8f55-ea10e3b1e05d on n-h2-854247-14 Oct 17 13:51:45.581822 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-3e98c723-03aa-4e59-b13c-7fd68c11ce6b req-45f44d4d-29c1-4991-a277-3069f17127e1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048738 Oct 17 13:51:45.582917 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1864/3764] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:51:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:51:45.594856 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cdc92ef3-55b2-414c-93b9-fbdb7f8d58d9 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:45.595462 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cdc92ef3-55b2-414c-93b9-fbdb7f8d58d9 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 3197da72-e924-4f50-8c93-c3f3ff98e084] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:45.622704 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cdc92ef3-55b2-414c-93b9-fbdb7f8d58d9 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:45.626044 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cdc92ef3-55b2-414c-93b9-fbdb7f8d58d9 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:45.627010 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cdc92ef3-55b2-414c-93b9-fbdb7f8d58d9 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:45.627981 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cdc92ef3-55b2-414c-93b9-fbdb7f8d58d9 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:45.635693 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cdc92ef3-55b2-414c-93b9-fbdb7f8d58d9 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:45.636529 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cdc92ef3-55b2-414c-93b9-fbdb7f8d58d9 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:46.360237 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-37696bf6-89d5-40ae-9762-eb1779c21310 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:46.365916 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-37696bf6-89d5-40ae-9762-eb1779c21310 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] [instance: 531b762d-db7e-4911-af50-6b321b7706bf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:46.382583 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-37696bf6-89d5-40ae-9762-eb1779c21310 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:46.385808 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-37696bf6-89d5-40ae-9762-eb1779c21310 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:46.386472 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-37696bf6-89d5-40ae-9762-eb1779c21310 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:46.390648 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-37696bf6-89d5-40ae-9762-eb1779c21310 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:46.392274 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-37696bf6-89d5-40ae-9762-eb1779c21310 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:46.393560 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-37696bf6-89d5-40ae-9762-eb1779c21310 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:46.469196 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cdc92ef3-55b2-414c-93b9-fbdb7f8d58d9 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:46.483420 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cdc92ef3-55b2-414c-93b9-fbdb7f8d58d9 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084" status: 200 len: 1735 microversion: 2.1 time: 0.894157 Oct 17 13:51:46.496485 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1901/3765] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:45 2022] GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084 => generated 1735 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:47.005613 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-37696bf6-89d5-40ae-9762-eb1779c21310 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:47.029227 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-37696bf6-89d5-40ae-9762-eb1779c21310 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:47.043399 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-37696bf6-89d5-40ae-9762-eb1779c21310 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:47.048142 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-37696bf6-89d5-40ae-9762-eb1779c21310 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] 10.222.0.79 "GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf" status: 200 len: 2963 microversion: 2.42 time: 0.697759 Oct 17 13:51:47.052825 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1865/3766] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:51:46 2022] GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf => generated 2963 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:51:47.510663 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e05590a0-675d-4fb4-a562-3ed55d15c3ff tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:47.511703 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e05590a0-675d-4fb4-a562-3ed55d15c3ff tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 3197da72-e924-4f50-8c93-c3f3ff98e084] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:47.534559 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e05590a0-675d-4fb4-a562-3ed55d15c3ff tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:47.535444 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e05590a0-675d-4fb4-a562-3ed55d15c3ff tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:47.536102 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e05590a0-675d-4fb4-a562-3ed55d15c3ff tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:47.537124 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e05590a0-675d-4fb4-a562-3ed55d15c3ff tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:47.538579 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e05590a0-675d-4fb4-a562-3ed55d15c3ff tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:47.539063 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e05590a0-675d-4fb4-a562-3ed55d15c3ff tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:47.699880 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c3ab8382-eb9f-4ad8-a0e9-3451f5ff0db8 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:47.703217 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c3ab8382-eb9f-4ad8-a0e9-3451f5ff0db8 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:47.710946 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c3ab8382-eb9f-4ad8-a0e9-3451f5ff0db8 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:47.711854 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c3ab8382-eb9f-4ad8-a0e9-3451f5ff0db8 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:47.712479 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c3ab8382-eb9f-4ad8-a0e9-3451f5ff0db8 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:47.713376 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c3ab8382-eb9f-4ad8-a0e9-3451f5ff0db8 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:47.714015 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c3ab8382-eb9f-4ad8-a0e9-3451f5ff0db8 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:47.714644 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c3ab8382-eb9f-4ad8-a0e9-3451f5ff0db8 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:47.761695 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c3ab8382-eb9f-4ad8-a0e9-3451f5ff0db8 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e/ips" status: 200 len: 151 microversion: 2.1 time: 0.065192 Oct 17 13:51:47.762619 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1866/3767] 10.222.0.79 () {58 vars in 1248 bytes} [Mon Oct 17 13:51:47 2022] GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e/ips => generated 151 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:51:47.917932 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e05590a0-675d-4fb4-a562-3ed55d15c3ff tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:47.929508 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e05590a0-675d-4fb4-a562-3ed55d15c3ff tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084" status: 200 len: 1735 microversion: 2.1 time: 0.423703 Oct 17 13:51:47.930101 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1902/3768] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:47 2022] GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084 => generated 1735 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:48.082480 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ca69e3e4-f669-4924-bffe-59526a05c20d tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:48.090315 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ca69e3e4-f669-4924-bffe-59526a05c20d tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] [instance: 531b762d-db7e-4911-af50-6b321b7706bf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:48.101365 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ca69e3e4-f669-4924-bffe-59526a05c20d tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:48.102355 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ca69e3e4-f669-4924-bffe-59526a05c20d tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:48.115692 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ca69e3e4-f669-4924-bffe-59526a05c20d tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:48.118197 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ca69e3e4-f669-4924-bffe-59526a05c20d tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:48.118777 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ca69e3e4-f669-4924-bffe-59526a05c20d tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:48.128033 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ca69e3e4-f669-4924-bffe-59526a05c20d tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:48.558870 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ca69e3e4-f669-4924-bffe-59526a05c20d tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:48.576196 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ca69e3e4-f669-4924-bffe-59526a05c20d tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:48.578078 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ca69e3e4-f669-4924-bffe-59526a05c20d tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:48.582364 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ca69e3e4-f669-4924-bffe-59526a05c20d tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] 10.222.0.79 "GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf" status: 200 len: 2963 microversion: 2.42 time: 0.506231 Oct 17 13:51:48.583309 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1867/3769] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:51:48 2022] GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf => generated 2963 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:51:48.957937 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9ebe6cae-3114-433b-9639-bf18deb8621a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:48.958548 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9ebe6cae-3114-433b-9639-bf18deb8621a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 3197da72-e924-4f50-8c93-c3f3ff98e084] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:48.971897 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9ebe6cae-3114-433b-9639-bf18deb8621a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:48.972596 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9ebe6cae-3114-433b-9639-bf18deb8621a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:48.974262 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9ebe6cae-3114-433b-9639-bf18deb8621a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:48.976034 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9ebe6cae-3114-433b-9639-bf18deb8621a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:48.976735 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9ebe6cae-3114-433b-9639-bf18deb8621a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:48.979387 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9ebe6cae-3114-433b-9639-bf18deb8621a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:49.392573 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9ebe6cae-3114-433b-9639-bf18deb8621a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:49.411406 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9ebe6cae-3114-433b-9639-bf18deb8621a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084" status: 200 len: 1735 microversion: 2.1 time: 0.454874 Oct 17 13:51:49.412139 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1903/3770] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:48 2022] GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084 => generated 1735 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:49.612100 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9df8d409-977d-491e-96ea-42bda1e358c9 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:49.613338 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9df8d409-977d-491e-96ea-42bda1e358c9 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] [instance: 531b762d-db7e-4911-af50-6b321b7706bf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:49.621159 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9df8d409-977d-491e-96ea-42bda1e358c9 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:49.621933 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9df8d409-977d-491e-96ea-42bda1e358c9 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:49.622525 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9df8d409-977d-491e-96ea-42bda1e358c9 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:49.623419 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9df8d409-977d-491e-96ea-42bda1e358c9 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:49.624033 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9df8d409-977d-491e-96ea-42bda1e358c9 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:49.624595 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9df8d409-977d-491e-96ea-42bda1e358c9 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:49.998634 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9df8d409-977d-491e-96ea-42bda1e358c9 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:50.011477 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9df8d409-977d-491e-96ea-42bda1e358c9 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:50.017199 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9df8d409-977d-491e-96ea-42bda1e358c9 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:50.027442 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9df8d409-977d-491e-96ea-42bda1e358c9 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] 10.222.0.79 "GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf" status: 200 len: 2963 microversion: 2.42 time: 0.411961 Oct 17 13:51:50.029597 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1868/3771] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:51:49 2022] GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf => generated 2963 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:51:50.354294 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-72b41545-92b5-4e5b-8305-d4ec4b6ea543 req-9d588151-6c8b-470a-8073-8fc3ba0c2c3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "531b762d-db7e-4911-af50-6b321b7706bf", "name": "network-vif-unplugged", "status": "completed", "tag": "8648d762-6ec8-45e8-8c5e-e21c582b7da6"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:51:50.374218 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-72b41545-92b5-4e5b-8305-d4ec4b6ea543 req-9d588151-6c8b-470a-8073-8fc3ba0c2c3e service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:50.375893 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-72b41545-92b5-4e5b-8305-d4ec4b6ea543 req-9d588151-6c8b-470a-8073-8fc3ba0c2c3e service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:50.377512 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-72b41545-92b5-4e5b-8305-d4ec4b6ea543 req-9d588151-6c8b-470a-8073-8fc3ba0c2c3e service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:50.415398 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-72b41545-92b5-4e5b-8305-d4ec4b6ea543 req-9d588151-6c8b-470a-8073-8fc3ba0c2c3e service nova] Creating event network-vif-unplugged:8648d762-6ec8-45e8-8c5e-e21c582b7da6 for instance 531b762d-db7e-4911-af50-6b321b7706bf on n-h1-854247-14 Oct 17 13:51:50.427061 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-72b41545-92b5-4e5b-8305-d4ec4b6ea543 req-9d588151-6c8b-470a-8073-8fc3ba0c2c3e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076414 Oct 17 13:51:50.432172 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1904/3772] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:51:50.439823 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2047099d-3d44-4792-b9ec-2d377afcd101 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:50.440242 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2047099d-3d44-4792-b9ec-2d377afcd101 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 3197da72-e924-4f50-8c93-c3f3ff98e084] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:50.455599 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2047099d-3d44-4792-b9ec-2d377afcd101 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:50.456077 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2047099d-3d44-4792-b9ec-2d377afcd101 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:50.456513 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2047099d-3d44-4792-b9ec-2d377afcd101 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:50.457227 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2047099d-3d44-4792-b9ec-2d377afcd101 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:50.457671 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2047099d-3d44-4792-b9ec-2d377afcd101 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:50.458088 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2047099d-3d44-4792-b9ec-2d377afcd101 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:50.503709 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-22afa515-4f0d-4974-8a2b-b68291f33b06 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "273ea9d4-92d5-45c4-8894-5af093e6dee0"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:51:50.508445 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-22afa515-4f0d-4974-8a2b-b68291f33b06 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:50.520365 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-22afa515-4f0d-4974-8a2b-b68291f33b06 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:50.521533 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-22afa515-4f0d-4974-8a2b-b68291f33b06 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:50.522176 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-22afa515-4f0d-4974-8a2b-b68291f33b06 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:50.523145 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-22afa515-4f0d-4974-8a2b-b68291f33b06 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:50.523784 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-22afa515-4f0d-4974-8a2b-b68291f33b06 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:50.524584 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-22afa515-4f0d-4974-8a2b-b68291f33b06 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:50.785116 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=100 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:51:50.855802 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2047099d-3d44-4792-b9ec-2d377afcd101 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:50.872395 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2047099d-3d44-4792-b9ec-2d377afcd101 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084" status: 200 len: 1715 microversion: 2.1 time: 0.437646 Oct 17 13:51:50.873006 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1869/3773] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:50 2022] GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084 => generated 1715 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:51.035246 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8a97cc83-6500-4ddf-8c6f-a84d06e85c96 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:51.035968 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8a97cc83-6500-4ddf-8c6f-a84d06e85c96 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 3197da72-e924-4f50-8c93-c3f3ff98e084] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:51.040896 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-22afa515-4f0d-4974-8a2b-b68291f33b06 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "POST /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.542862 Oct 17 13:51:51.051438 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1905/3774] 10.222.0.79 () {60 vars in 1323 bytes} [Mon Oct 17 13:51:50 2022] POST /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e/os-volume_attachments => generated 194 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:51:51.054431 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8a97cc83-6500-4ddf-8c6f-a84d06e85c96 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:51.055266 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8a97cc83-6500-4ddf-8c6f-a84d06e85c96 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:51.055889 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8a97cc83-6500-4ddf-8c6f-a84d06e85c96 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:51.056798 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8a97cc83-6500-4ddf-8c6f-a84d06e85c96 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:51.057165 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c1e379a9-673c-4bbc-a4bd-7e484bf32d3f tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:51.057613 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8a97cc83-6500-4ddf-8c6f-a84d06e85c96 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:51.062989 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c1e379a9-673c-4bbc-a4bd-7e484bf32d3f tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] [instance: 531b762d-db7e-4911-af50-6b321b7706bf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:51.079210 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1e379a9-673c-4bbc-a4bd-7e484bf32d3f tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:51.080484 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1e379a9-673c-4bbc-a4bd-7e484bf32d3f tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:51.081307 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8a97cc83-6500-4ddf-8c6f-a84d06e85c96 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:51.082573 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1e379a9-673c-4bbc-a4bd-7e484bf32d3f tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:51.084578 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1e379a9-673c-4bbc-a4bd-7e484bf32d3f tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:51.086275 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1e379a9-673c-4bbc-a4bd-7e484bf32d3f tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:51.086971 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1e379a9-673c-4bbc-a4bd-7e484bf32d3f tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:51.318884 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-8a97cc83-6500-4ddf-8c6f-a84d06e85c96 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] HTTP exception thrown: Cannot 'detach_volume' instance 3197da72-e924-4f50-8c93-c3f3ff98e084 while it is in vm_state rescued Oct 17 13:51:51.326868 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8a97cc83-6500-4ddf-8c6f-a84d06e85c96 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Request method failure captured: Oct 17 13:51:51.326868 n-d-854247-14 devstack@n-api.service[127017]: request: DELETE /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084/os-volume_attachments/77d7b55b-2e3d-411c-a86b-6aad4731ff76 HTTP/1.1 Oct 17 13:51:51.326868 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:51:51.326868 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:51:51.326868 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:51:51.326868 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:51:51.326868 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:51:51.326868 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:51:51.326868 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:51:51.326868 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:51:51.326868 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTV0lGewBAd5oX7RsuswRRrYdH_s7fnCDLNRSaJQAxErmqZOT5QT6523TfZqZvgb4tWrIGVLDqv0foQ4mpFwe91mdGAxx6JOfjpLIqY8Vnvh6NrynvpuS4ywkAJAwUfpPeJ0dauW6Gj_xg5-jDhUd1iFTLiSXh_-SOzh7_iyTjRI7Ovs Oct 17 13:51:51.326868 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:51:51.326868 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:51:51.326868 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:51:51.326868 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:51:51.326868 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:51:51.326868 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:51:51.326868 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 08068aeba86c4e718ba1e25c68fd3259 Oct 17 13:51:51.326868 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1627831718 Oct 17 13:51:51.326868 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:51:51.326868 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:51:51.326868 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/08068aeba86c4e718ba1e25c68fd3259"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/08068aeba86c4e718ba1e25c68fd3259"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/08068aeba86c4e718ba1e25c68fd3259"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_08068aeba86c4e718ba1e25c68fd3259", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:51:51.326868 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1627831718 Oct 17 13:51:51.326868 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 08068aeba86c4e718ba1e25c68fd3259 Oct 17 13:51:51.326868 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1627831718 Oct 17 13:51:51.326868 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServerRescueNegativeTestJSON-1627831718-project Oct 17 13:51:51.326868 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:51:51.326868 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:51:51.326868 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: d56b91ce42894bafac5ddb16ad6f037b Oct 17 13:51:51.326868 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1627831718-project Oct 17 13:51:51.326868 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:51:51.326868 n-d-854247-14 devstack@n-api.service[127017]: exception: Cannot 'detach_volume' instance 3197da72-e924-4f50-8c93-c3f3ff98e084 while it is in vm_state rescued Oct 17 13:51:51.326868 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'server_id': '3197da72-e924-4f50-8c93-c3f3ff98e084', 'id': '77d7b55b-2e3d-411c-a86b-6aad4731ff76'} Oct 17 13:51:51.326868 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:51:51.326868 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:51.326868 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 17 13:51:51.326868 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 17 13:51:51.326868 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 13:51:51.326868 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:51:51.326868 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 13:51:51.326868 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 13:51:51.326868 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3197da72-e924-4f50-8c93-c3f3ff98e084 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 17 13:51:51.326868 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:51:51.326868 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:51:51.326868 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:51:51.326868 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:51.326868 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:51:51.326868 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:51:51.326868 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:51:51.326868 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:51:51.326868 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:51:51.326868 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:51:51.326868 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 17 13:51:51.326868 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 17 13:51:51.326868 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 13:51:51.326868 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 13:51:51.326868 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 3197da72-e924-4f50-8c93-c3f3ff98e084 while it is in vm_state rescued Oct 17 13:51:51.326868 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:51:51.326868 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:51:51.326868 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:51:51.326868 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:51.333903 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:51:51.333903 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:51:51.333903 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:51:51.333903 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:51:51.333903 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 3197da72-e924-4f50-8c93-c3f3ff98e084 while it is in vm_state rescued Oct 17 13:51:51.333903 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:51:51.333903 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8a97cc83-6500-4ddf-8c6f-a84d06e85c96 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Returning 409 to user: Cannot 'detach_volume' instance 3197da72-e924-4f50-8c93-c3f3ff98e084 while it is in vm_state rescued {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:51:51.333903 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8a97cc83-6500-4ddf-8c6f-a84d06e85c96 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084/os-volume_attachments/77d7b55b-2e3d-411c-a86b-6aad4731ff76" status: 409 len: 152 microversion: 2.1 time: 0.298278 Oct 17 13:51:51.333903 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1870/3775] 10.222.0.79 () {58 vars in 1416 bytes} [Mon Oct 17 13:51:51 2022] DELETE /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084/os-volume_attachments/77d7b55b-2e3d-411c-a86b-6aad4731ff76 => generated 152 bytes in 300 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 17 13:51:51.351591 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-fec7a76e-3860-45bb-84b7-9d36dd07649f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:51:51.352212 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-fec7a76e-3860-45bb-84b7-9d36dd07649f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 3197da72-e924-4f50-8c93-c3f3ff98e084] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:51.391012 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fec7a76e-3860-45bb-84b7-9d36dd07649f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:51.391412 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fec7a76e-3860-45bb-84b7-9d36dd07649f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:51.391833 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fec7a76e-3860-45bb-84b7-9d36dd07649f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:51.392547 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fec7a76e-3860-45bb-84b7-9d36dd07649f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:51.393003 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fec7a76e-3860-45bb-84b7-9d36dd07649f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:51.393427 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fec7a76e-3860-45bb-84b7-9d36dd07649f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:51.540578 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c1e379a9-673c-4bbc-a4bd-7e484bf32d3f tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:51.563081 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c1e379a9-673c-4bbc-a4bd-7e484bf32d3f tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:51.569075 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c1e379a9-673c-4bbc-a4bd-7e484bf32d3f tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:51.580305 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c1e379a9-673c-4bbc-a4bd-7e484bf32d3f tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] 10.222.0.79 "GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf" status: 200 len: 2942 microversion: 2.42 time: 0.517974 Oct 17 13:51:51.582336 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1906/3776] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:51:51 2022] GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf => generated 2942 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:51:51.597494 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-fec7a76e-3860-45bb-84b7-9d36dd07649f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "POST /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084/action" status: 202 len: 0 microversion: 2.1 time: 0.243536 Oct 17 13:51:51.609212 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1871/3777] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:51:51 2022] POST /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:51:51.614470 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-876f0255-5c7f-4950-9471-2cd0e692577c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:51.617279 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-876f0255-5c7f-4950-9471-2cd0e692577c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 3197da72-e924-4f50-8c93-c3f3ff98e084] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:51.635593 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-876f0255-5c7f-4950-9471-2cd0e692577c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:51.635857 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-876f0255-5c7f-4950-9471-2cd0e692577c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:51.642960 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-876f0255-5c7f-4950-9471-2cd0e692577c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:51.650414 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-876f0255-5c7f-4950-9471-2cd0e692577c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:51.650414 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-876f0255-5c7f-4950-9471-2cd0e692577c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:51.650414 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-876f0255-5c7f-4950-9471-2cd0e692577c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:51.946644 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0378c8d4-a8d4-4cba-b6bc-8651f8908105 tempest-FloatingIPsTestJSON-404917541 tempest-FloatingIPsTestJSON-404917541-project] Action: 'create', calling method: .version_select at 0x7f7cd46ed3a0>, body: {"pool": null} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:51:51.961571 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-876f0255-5c7f-4950-9471-2cd0e692577c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:51.988251 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-876f0255-5c7f-4950-9471-2cd0e692577c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084" status: 200 len: 1723 microversion: 2.1 time: 0.382834 Oct 17 13:51:51.990081 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1907/3778] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:51 2022] GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084 => generated 1723 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:52.478821 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-b7c6074f-de25-4cfb-84e5-7164aeae433e req-cddef9d8-f671-4873-8d9c-8137a19077f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "531b762d-db7e-4911-af50-6b321b7706bf", "name": "network-vif-unplugged", "status": "completed", "tag": "6f4cb81d-8d1e-46b5-be9e-808d081260d5"}, {"server_uuid": "531b762d-db7e-4911-af50-6b321b7706bf", "name": "network-vif-unplugged", "status": "completed", "tag": "97144afc-d9c2-4725-92c7-3d7418acb203"}, {"server_uuid": "531b762d-db7e-4911-af50-6b321b7706bf", "name": "network-vif-unplugged", "status": "completed", "tag": "13d96c52-0581-49ee-acc7-7c007590f889"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:51:52.499047 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-b7c6074f-de25-4cfb-84e5-7164aeae433e req-cddef9d8-f671-4873-8d9c-8137a19077f2 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:52.499811 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-b7c6074f-de25-4cfb-84e5-7164aeae433e req-cddef9d8-f671-4873-8d9c-8137a19077f2 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:52.500738 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-b7c6074f-de25-4cfb-84e5-7164aeae433e req-cddef9d8-f671-4873-8d9c-8137a19077f2 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:52.527261 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-b7c6074f-de25-4cfb-84e5-7164aeae433e req-cddef9d8-f671-4873-8d9c-8137a19077f2 service nova] Creating event network-vif-unplugged:6f4cb81d-8d1e-46b5-be9e-808d081260d5 for instance 531b762d-db7e-4911-af50-6b321b7706bf on n-h1-854247-14 Oct 17 13:51:52.528229 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-b7c6074f-de25-4cfb-84e5-7164aeae433e req-cddef9d8-f671-4873-8d9c-8137a19077f2 service nova] Creating event network-vif-unplugged:97144afc-d9c2-4725-92c7-3d7418acb203 for instance 531b762d-db7e-4911-af50-6b321b7706bf on n-h1-854247-14 Oct 17 13:51:52.529509 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-b7c6074f-de25-4cfb-84e5-7164aeae433e req-cddef9d8-f671-4873-8d9c-8137a19077f2 service nova] Creating event network-vif-unplugged:13d96c52-0581-49ee-acc7-7c007590f889 for instance 531b762d-db7e-4911-af50-6b321b7706bf on n-h1-854247-14 Oct 17 13:51:52.540794 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-b7c6074f-de25-4cfb-84e5-7164aeae433e req-cddef9d8-f671-4873-8d9c-8137a19077f2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.068362 Oct 17 13:51:52.543672 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1908/3779] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:51:52.618642 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6de89361-cb6e-4098-b8e3-745fadd95bda tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:52.619399 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6de89361-cb6e-4098-b8e3-745fadd95bda tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] [instance: 531b762d-db7e-4911-af50-6b321b7706bf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:52.635197 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6de89361-cb6e-4098-b8e3-745fadd95bda tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:52.638245 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6de89361-cb6e-4098-b8e3-745fadd95bda tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:52.638726 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6de89361-cb6e-4098-b8e3-745fadd95bda tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:52.639511 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6de89361-cb6e-4098-b8e3-745fadd95bda tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:52.642257 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6de89361-cb6e-4098-b8e3-745fadd95bda tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:52.642733 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6de89361-cb6e-4098-b8e3-745fadd95bda tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:53.214174 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6de89361-cb6e-4098-b8e3-745fadd95bda tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:53.232874 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6de89361-cb6e-4098-b8e3-745fadd95bda tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:53.235906 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6de89361-cb6e-4098-b8e3-745fadd95bda tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:53.238123 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6de89361-cb6e-4098-b8e3-745fadd95bda tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] 10.222.0.79 "GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf" status: 200 len: 2921 microversion: 2.42 time: 0.625045 Oct 17 13:51:53.242896 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1909/3780] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:51:52 2022] GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf => generated 2921 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:51:53.253373 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-316bbef4-76c4-4ca0-a86c-33393f3681f4 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:53.254276 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-316bbef4-76c4-4ca0-a86c-33393f3681f4 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 3197da72-e924-4f50-8c93-c3f3ff98e084] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:53.271640 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-316bbef4-76c4-4ca0-a86c-33393f3681f4 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:53.272651 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-316bbef4-76c4-4ca0-a86c-33393f3681f4 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:53.274548 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-316bbef4-76c4-4ca0-a86c-33393f3681f4 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:53.275542 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-316bbef4-76c4-4ca0-a86c-33393f3681f4 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:53.278051 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-316bbef4-76c4-4ca0-a86c-33393f3681f4 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:53.278724 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-316bbef4-76c4-4ca0-a86c-33393f3681f4 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:53.561046 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-316bbef4-76c4-4ca0-a86c-33393f3681f4 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:53.573945 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-316bbef4-76c4-4ca0-a86c-33393f3681f4 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084" status: 200 len: 1723 microversion: 2.1 time: 0.329632 Oct 17 13:51:53.575556 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1910/3781] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:53 2022] GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084 => generated 1723 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:53.581302 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-4c80c065-5aad-4cfb-b16c-8d5518a35d09 req-fd799af7-f756-4fe5-bd55-376055d8f34b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "531b762d-db7e-4911-af50-6b321b7706bf", "name": "network-vif-deleted", "tag": "6f4cb81d-8d1e-46b5-be9e-808d081260d5"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:51:53.593901 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-4c80c065-5aad-4cfb-b16c-8d5518a35d09 req-fd799af7-f756-4fe5-bd55-376055d8f34b service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:53.594893 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-4c80c065-5aad-4cfb-b16c-8d5518a35d09 req-fd799af7-f756-4fe5-bd55-376055d8f34b service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:53.595907 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-4c80c065-5aad-4cfb-b16c-8d5518a35d09 req-fd799af7-f756-4fe5-bd55-376055d8f34b service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:53.627668 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-4c80c065-5aad-4cfb-b16c-8d5518a35d09 req-fd799af7-f756-4fe5-bd55-376055d8f34b service nova] Creating event network-vif-deleted:6f4cb81d-8d1e-46b5-be9e-808d081260d5 for instance 531b762d-db7e-4911-af50-6b321b7706bf on n-h1-854247-14 Oct 17 13:51:53.641957 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-4c80c065-5aad-4cfb-b16c-8d5518a35d09 req-fd799af7-f756-4fe5-bd55-376055d8f34b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064756 Oct 17 13:51:53.646645 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1911/3782] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:51:54.282384 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8ec81198-18f4-4032-9428-0233b41c2ffa tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:54.283331 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8ec81198-18f4-4032-9428-0233b41c2ffa tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] [instance: 531b762d-db7e-4911-af50-6b321b7706bf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:54.294011 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8ec81198-18f4-4032-9428-0233b41c2ffa tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:54.309471 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8ec81198-18f4-4032-9428-0233b41c2ffa tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:54.310007 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8ec81198-18f4-4032-9428-0233b41c2ffa tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:54.311057 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8ec81198-18f4-4032-9428-0233b41c2ffa tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:54.316170 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8ec81198-18f4-4032-9428-0233b41c2ffa tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:54.316973 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8ec81198-18f4-4032-9428-0233b41c2ffa tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:54.754086 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8ec81198-18f4-4032-9428-0233b41c2ffa tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:54.772786 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8ec81198-18f4-4032-9428-0233b41c2ffa tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:54.779055 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8ec81198-18f4-4032-9428-0233b41c2ffa tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:54.781386 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8ec81198-18f4-4032-9428-0233b41c2ffa tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] 10.222.0.79 "GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf" status: 200 len: 2713 microversion: 2.42 time: 0.511437 Oct 17 13:51:54.783092 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1912/3783] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:51:54 2022] GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf => generated 2713 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:51:54.790375 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-44b9b859-f639-4bee-b960-b2afc4149a82 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:54.791681 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-44b9b859-f639-4bee-b960-b2afc4149a82 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 3197da72-e924-4f50-8c93-c3f3ff98e084] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:54.801597 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-44b9b859-f639-4bee-b960-b2afc4149a82 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:54.802470 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-44b9b859-f639-4bee-b960-b2afc4149a82 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:54.803298 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-44b9b859-f639-4bee-b960-b2afc4149a82 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:54.804196 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-44b9b859-f639-4bee-b960-b2afc4149a82 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:54.805300 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-44b9b859-f639-4bee-b960-b2afc4149a82 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:54.805904 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-44b9b859-f639-4bee-b960-b2afc4149a82 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:55.058133 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0378c8d4-a8d4-4cba-b6bc-8651f8908105 tempest-FloatingIPsTestJSON-404917541 tempest-FloatingIPsTestJSON-404917541-project] 10.222.0.79 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.230881 Oct 17 13:51:55.059402 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1872/3784] 10.222.0.79 () {60 vars in 1170 bytes} [Mon Oct 17 13:51:51 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:51:55.068697 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-351dfb89-f963-4cc2-a595-c760156fa16c req-1bb4debd-c3fc-4833-aa0b-26cd5deecf56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "531b762d-db7e-4911-af50-6b321b7706bf", "name": "network-vif-unplugged", "status": "completed", "tag": "54e2aa0d-ebff-4ff5-a88b-865d4f0e8386"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:51:55.094833 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-351dfb89-f963-4cc2-a595-c760156fa16c req-1bb4debd-c3fc-4833-aa0b-26cd5deecf56 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:55.095726 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-351dfb89-f963-4cc2-a595-c760156fa16c req-1bb4debd-c3fc-4833-aa0b-26cd5deecf56 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:55.096744 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-351dfb89-f963-4cc2-a595-c760156fa16c req-1bb4debd-c3fc-4833-aa0b-26cd5deecf56 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:55.117736 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-44b9b859-f639-4bee-b960-b2afc4149a82 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:55.129031 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-44b9b859-f639-4bee-b960-b2afc4149a82 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084" status: 200 len: 1723 microversion: 2.1 time: 0.342788 Oct 17 13:51:55.143842 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-351dfb89-f963-4cc2-a595-c760156fa16c req-1bb4debd-c3fc-4833-aa0b-26cd5deecf56 service nova] Creating event network-vif-unplugged:54e2aa0d-ebff-4ff5-a88b-865d4f0e8386 for instance 531b762d-db7e-4911-af50-6b321b7706bf on n-h1-854247-14 Oct 17 13:51:55.151256 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1913/3785] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:54 2022] GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084 => generated 1723 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:55.158069 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-351dfb89-f963-4cc2-a595-c760156fa16c req-1bb4debd-c3fc-4833-aa0b-26cd5deecf56 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097080 Oct 17 13:51:55.160400 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-acd43963-57dc-47e3-b992-1c009bea2bd0 tempest-FloatingIPsTestJSON-404917541 tempest-FloatingIPsTestJSON-404917541-project] Calling method '.version_select at 0x7f7cd4cec4c0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:55.161375 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1873/3786] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:51:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:51:55.430275 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-acd43963-57dc-47e3-b992-1c009bea2bd0 tempest-FloatingIPsTestJSON-404917541 tempest-FloatingIPsTestJSON-404917541-project] 10.222.0.79 "GET /compute/v2.1/os-floating-ips/a83e85b9-956f-4978-a8f3-9089814ccb1f" status: 200 len: 142 microversion: 2.1 time: 0.277763 Oct 17 13:51:55.431213 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1914/3787] 10.222.0.79 () {58 vars in 1260 bytes} [Mon Oct 17 13:51:55 2022] GET /compute/v2.1/os-floating-ips/a83e85b9-956f-4978-a8f3-9089814ccb1f => generated 142 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:51:55.445181 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4d5d5e29-5a7f-4f86-92bd-52587812f182 tempest-FloatingIPsTestJSON-404917541 tempest-FloatingIPsTestJSON-404917541-project] Calling method '.version_select at 0x7f7cd4674e50>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:55.757119 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-7f4a674c-f0fd-4ba8-adda-650a98cb07a5 req-356c2f03-5d13-4ea7-b677-85bc5b93b9b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "531b762d-db7e-4911-af50-6b321b7706bf", "name": "network-vif-deleted", "tag": "97144afc-d9c2-4725-92c7-3d7418acb203"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:51:55.767770 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=18,nova_api:INSERT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:51:55.791714 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-7f4a674c-f0fd-4ba8-adda-650a98cb07a5 req-356c2f03-5d13-4ea7-b677-85bc5b93b9b0 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:55.792675 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-7f4a674c-f0fd-4ba8-adda-650a98cb07a5 req-356c2f03-5d13-4ea7-b677-85bc5b93b9b0 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:55.794324 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-7f4a674c-f0fd-4ba8-adda-650a98cb07a5 req-356c2f03-5d13-4ea7-b677-85bc5b93b9b0 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:55.825154 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4d5d5e29-5a7f-4f86-92bd-52587812f182 tempest-FloatingIPsTestJSON-404917541 tempest-FloatingIPsTestJSON-404917541-project] 10.222.0.79 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.384446 Oct 17 13:51:55.826297 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1874/3788] 10.222.0.79 () {58 vars in 1149 bytes} [Mon Oct 17 13:51:55 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:51:55.832711 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-25ae0d12-0bd9-406d-ba5d-e997a3a7ce50 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:55.833777 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-25ae0d12-0bd9-406d-ba5d-e997a3a7ce50 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] [instance: 531b762d-db7e-4911-af50-6b321b7706bf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:55.856668 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-25ae0d12-0bd9-406d-ba5d-e997a3a7ce50 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:55.857160 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-25ae0d12-0bd9-406d-ba5d-e997a3a7ce50 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:55.859821 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-7f4a674c-f0fd-4ba8-adda-650a98cb07a5 req-356c2f03-5d13-4ea7-b677-85bc5b93b9b0 service nova] Creating event network-vif-deleted:97144afc-d9c2-4725-92c7-3d7418acb203 for instance 531b762d-db7e-4911-af50-6b321b7706bf on n-h1-854247-14 Oct 17 13:51:55.859963 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-25ae0d12-0bd9-406d-ba5d-e997a3a7ce50 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:55.860905 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-25ae0d12-0bd9-406d-ba5d-e997a3a7ce50 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:55.863675 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-25ae0d12-0bd9-406d-ba5d-e997a3a7ce50 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:55.866937 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-25ae0d12-0bd9-406d-ba5d-e997a3a7ce50 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:55.875791 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-7f4a674c-f0fd-4ba8-adda-650a98cb07a5 req-356c2f03-5d13-4ea7-b677-85bc5b93b9b0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122797 Oct 17 13:51:55.877003 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1915/3789] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:51:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:51:55.883880 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-573a2c56-1a78-49ee-94bc-26fa2e3ce2ba tempest-FloatingIPsTestJSON-404917541 tempest-FloatingIPsTestJSON-404917541-project] Calling method '.version_select at 0x7f7cd4ff4670>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:55.920695 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:51:56.155082 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-25ae0d12-0bd9-406d-ba5d-e997a3a7ce50 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:56.167119 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-25ae0d12-0bd9-406d-ba5d-e997a3a7ce50 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:56.176965 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-25ae0d12-0bd9-406d-ba5d-e997a3a7ce50 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:56.179053 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-25ae0d12-0bd9-406d-ba5d-e997a3a7ce50 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] 10.222.0.79 "GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf" status: 200 len: 2666 microversion: 2.42 time: 0.351040 Oct 17 13:51:56.180848 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1875/3790] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:51:55 2022] GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf => generated 2666 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:51:56.190191 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4a9e6d33-5942-46c2-92fd-92597c047036 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:56.190817 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4a9e6d33-5942-46c2-92fd-92597c047036 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 3197da72-e924-4f50-8c93-c3f3ff98e084] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:56.211665 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:51:56.214390 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4a9e6d33-5942-46c2-92fd-92597c047036 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:56.216012 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4a9e6d33-5942-46c2-92fd-92597c047036 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:56.216459 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4a9e6d33-5942-46c2-92fd-92597c047036 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:56.220378 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4a9e6d33-5942-46c2-92fd-92597c047036 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:56.220879 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4a9e6d33-5942-46c2-92fd-92597c047036 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:56.221324 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4a9e6d33-5942-46c2-92fd-92597c047036 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:56.783138 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4a9e6d33-5942-46c2-92fd-92597c047036 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:56.803547 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4a9e6d33-5942-46c2-92fd-92597c047036 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084" status: 200 len: 1729 microversion: 2.1 time: 0.614973 Oct 17 13:51:56.810747 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1876/3791] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:56 2022] GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084 => generated 1729 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:56.824706 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-64983012-bd33-48e2-8fad-f2fd0c084cd4 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:56.825220 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-64983012-bd33-48e2-8fad-f2fd0c084cd4 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 3197da72-e924-4f50-8c93-c3f3ff98e084] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:56.835675 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-64983012-bd33-48e2-8fad-f2fd0c084cd4 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:56.838517 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-64983012-bd33-48e2-8fad-f2fd0c084cd4 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:56.839359 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-64983012-bd33-48e2-8fad-f2fd0c084cd4 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:56.840105 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-64983012-bd33-48e2-8fad-f2fd0c084cd4 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:56.840564 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-64983012-bd33-48e2-8fad-f2fd0c084cd4 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:56.840992 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-64983012-bd33-48e2-8fad-f2fd0c084cd4 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:57.404352 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-64983012-bd33-48e2-8fad-f2fd0c084cd4 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.584237 Oct 17 13:51:57.411332 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-573a2c56-1a78-49ee-94bc-26fa2e3ce2ba tempest-FloatingIPsTestJSON-404917541 tempest-FloatingIPsTestJSON-404917541-project] 10.222.0.79 "DELETE /compute/v2.1/os-floating-ips/a83e85b9-956f-4978-a8f3-9089814ccb1f" status: 202 len: 0 microversion: 2.1 time: 1.532480 Oct 17 13:51:57.411761 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1877/3792] 10.222.0.79 () {58 vars in 1275 bytes} [Mon Oct 17 13:51:56 2022] GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084/os-interface => generated 285 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:51:57.412605 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1916/3793] 10.222.0.79 () {58 vars in 1263 bytes} [Mon Oct 17 13:51:55 2022] DELETE /compute/v2.1/os-floating-ips/a83e85b9-956f-4978-a8f3-9089814ccb1f => generated 0 bytes in 1535 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:51:57.419439 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-875b1c46-e03f-484f-ac60-a2acf5fc08fe tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:57.420066 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-875b1c46-e03f-484f-ac60-a2acf5fc08fe tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] [instance: 531b762d-db7e-4911-af50-6b321b7706bf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:57.424190 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-81f51972-c4c6-426e-afad-b42fcc5744f7 tempest-FloatingIPsTestJSON-404917541 tempest-FloatingIPsTestJSON-404917541-project] Action: 'create', calling method: .version_select at 0x7f7cd5019820>, body: {"pool": null} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:51:57.435340 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-875b1c46-e03f-484f-ac60-a2acf5fc08fe tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:57.435839 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-875b1c46-e03f-484f-ac60-a2acf5fc08fe tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:57.436282 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-875b1c46-e03f-484f-ac60-a2acf5fc08fe tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:57.440232 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-875b1c46-e03f-484f-ac60-a2acf5fc08fe tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:57.441084 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-875b1c46-e03f-484f-ac60-a2acf5fc08fe tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:57.441541 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-875b1c46-e03f-484f-ac60-a2acf5fc08fe tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:57.967016 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-875b1c46-e03f-484f-ac60-a2acf5fc08fe tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:57.978666 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-875b1c46-e03f-484f-ac60-a2acf5fc08fe tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:57.980288 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-875b1c46-e03f-484f-ac60-a2acf5fc08fe tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:57.987518 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-875b1c46-e03f-484f-ac60-a2acf5fc08fe tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] 10.222.0.79 "GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf" status: 200 len: 2505 microversion: 2.42 time: 0.574910 Oct 17 13:51:57.988492 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1878/3794] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:51:57 2022] GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf => generated 2505 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:51:57.998460 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-2a1659f5-a388-4574-a31c-7a4ed4608c6b req-95cc3351-7dca-4f95-94d4-dcd68e819906 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "531b762d-db7e-4911-af50-6b321b7706bf", "name": "network-vif-deleted", "tag": "8648d762-6ec8-45e8-8c5e-e21c582b7da6"}, {"server_uuid": "531b762d-db7e-4911-af50-6b321b7706bf", "name": "network-vif-deleted", "tag": "54e2aa0d-ebff-4ff5-a88b-865d4f0e8386"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:51:58.024398 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-2a1659f5-a388-4574-a31c-7a4ed4608c6b req-95cc3351-7dca-4f95-94d4-dcd68e819906 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:58.024928 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-2a1659f5-a388-4574-a31c-7a4ed4608c6b req-95cc3351-7dca-4f95-94d4-dcd68e819906 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:58.025377 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-2a1659f5-a388-4574-a31c-7a4ed4608c6b req-95cc3351-7dca-4f95-94d4-dcd68e819906 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:58.052254 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-2a1659f5-a388-4574-a31c-7a4ed4608c6b req-95cc3351-7dca-4f95-94d4-dcd68e819906 service nova] Creating event network-vif-deleted:8648d762-6ec8-45e8-8c5e-e21c582b7da6 for instance 531b762d-db7e-4911-af50-6b321b7706bf on n-h1-854247-14 Oct 17 13:51:58.052778 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-2a1659f5-a388-4574-a31c-7a4ed4608c6b req-95cc3351-7dca-4f95-94d4-dcd68e819906 service nova] Creating event network-vif-deleted:54e2aa0d-ebff-4ff5-a88b-865d4f0e8386 for instance 531b762d-db7e-4911-af50-6b321b7706bf on n-h1-854247-14 Oct 17 13:51:58.069619 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-2a1659f5-a388-4574-a31c-7a4ed4608c6b req-95cc3351-7dca-4f95-94d4-dcd68e819906 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.079458 Oct 17 13:51:58.070200 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1879/3795] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:51:59.022397 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-aaf88735-e3e2-40e8-8fb6-e9cc8aa17053 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:59.023107 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-aaf88735-e3e2-40e8-8fb6-e9cc8aa17053 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] [instance: 531b762d-db7e-4911-af50-6b321b7706bf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:59.037386 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aaf88735-e3e2-40e8-8fb6-e9cc8aa17053 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:59.037879 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aaf88735-e3e2-40e8-8fb6-e9cc8aa17053 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:59.038314 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aaf88735-e3e2-40e8-8fb6-e9cc8aa17053 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:59.039034 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aaf88735-e3e2-40e8-8fb6-e9cc8aa17053 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:59.047269 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aaf88735-e3e2-40e8-8fb6-e9cc8aa17053 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:59.047993 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aaf88735-e3e2-40e8-8fb6-e9cc8aa17053 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:59.374013 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-aaf88735-e3e2-40e8-8fb6-e9cc8aa17053 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:59.396827 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-aaf88735-e3e2-40e8-8fb6-e9cc8aa17053 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:59.400237 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-aaf88735-e3e2-40e8-8fb6-e9cc8aa17053 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:59.401754 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-aaf88735-e3e2-40e8-8fb6-e9cc8aa17053 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] 10.222.0.79 "GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf" status: 200 len: 1604 microversion: 2.42 time: 0.385683 Oct 17 13:51:59.424409 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1880/3796] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:51:59 2022] GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf => generated 1604 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:52:00.065892 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-d734695b-15b5-4346-80ca-6fd70d414f54 req-2d8fa152-242f-41bf-9ac6-f88dcb7c8ae2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3197da72-e924-4f50-8c93-c3f3ff98e084", "tag": "ae63042f-2479-46ef-8b31-2a573c0b051b"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:52:00.083001 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-d734695b-15b5-4346-80ca-6fd70d414f54 req-2d8fa152-242f-41bf-9ac6-f88dcb7c8ae2 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:00.083923 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-d734695b-15b5-4346-80ca-6fd70d414f54 req-2d8fa152-242f-41bf-9ac6-f88dcb7c8ae2 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:00.084570 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-d734695b-15b5-4346-80ca-6fd70d414f54 req-2d8fa152-242f-41bf-9ac6-f88dcb7c8ae2 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:00.103953 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-d734695b-15b5-4346-80ca-6fd70d414f54 req-2d8fa152-242f-41bf-9ac6-f88dcb7c8ae2 service nova] Creating event network-changed:ae63042f-2479-46ef-8b31-2a573c0b051b for instance 3197da72-e924-4f50-8c93-c3f3ff98e084 on n-h1-854247-14 Oct 17 13:52:00.114091 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-d734695b-15b5-4346-80ca-6fd70d414f54 req-2d8fa152-242f-41bf-9ac6-f88dcb7c8ae2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053561 Oct 17 13:52:00.115365 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1881/3797] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:52:00.121516 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-d385d451-a2ee-48fe-b424-c25433691e54 req-76dcfc00-125b-4c37-be4b-f303c928a57c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "531b762d-db7e-4911-af50-6b321b7706bf", "name": "network-vif-deleted", "tag": "13d96c52-0581-49ee-acc7-7c007590f889"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:52:00.135097 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-d385d451-a2ee-48fe-b424-c25433691e54 req-76dcfc00-125b-4c37-be4b-f303c928a57c service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:00.135987 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-d385d451-a2ee-48fe-b424-c25433691e54 req-76dcfc00-125b-4c37-be4b-f303c928a57c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:00.138321 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-d385d451-a2ee-48fe-b424-c25433691e54 req-76dcfc00-125b-4c37-be4b-f303c928a57c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:00.152215 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-d385d451-a2ee-48fe-b424-c25433691e54 req-76dcfc00-125b-4c37-be4b-f303c928a57c service nova] Creating event network-vif-deleted:13d96c52-0581-49ee-acc7-7c007590f889 for instance 531b762d-db7e-4911-af50-6b321b7706bf on n-h1-854247-14 Oct 17 13:52:00.158449 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-d385d451-a2ee-48fe-b424-c25433691e54 req-76dcfc00-125b-4c37-be4b-f303c928a57c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040514 Oct 17 13:52:00.159842 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1882/3798] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:52:00.438245 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-57a3243c-e264-4f41-9b78-2467d3b1aeec tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:00.439515 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-57a3243c-e264-4f41-9b78-2467d3b1aeec tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] [instance: 531b762d-db7e-4911-af50-6b321b7706bf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:00.460149 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-57a3243c-e264-4f41-9b78-2467d3b1aeec tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:00.462845 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-57a3243c-e264-4f41-9b78-2467d3b1aeec tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:00.464089 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-57a3243c-e264-4f41-9b78-2467d3b1aeec tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:00.465912 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-57a3243c-e264-4f41-9b78-2467d3b1aeec tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:00.472486 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-57a3243c-e264-4f41-9b78-2467d3b1aeec tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:00.473568 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-57a3243c-e264-4f41-9b78-2467d3b1aeec tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:00.532522 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-81f51972-c4c6-426e-afad-b42fcc5744f7 tempest-FloatingIPsTestJSON-404917541 tempest-FloatingIPsTestJSON-404917541-project] 10.222.0.79 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 3.113200 Oct 17 13:52:00.533132 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1917/3799] 10.222.0.79 () {60 vars in 1170 bytes} [Mon Oct 17 13:51:57 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 3115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:52:00.545984 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d5332ac5-b1d7-437c-ac7a-2515c38ea815 tempest-FloatingIPsTestJSON-404917541 tempest-FloatingIPsTestJSON-404917541-project] Calling method '.version_select at 0x7f7cd5533c10>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:00.585955 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-57a3243c-e264-4f41-9b78-2467d3b1aeec tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:00.599555 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-57a3243c-e264-4f41-9b78-2467d3b1aeec tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:00.604416 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-57a3243c-e264-4f41-9b78-2467d3b1aeec tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:00.609884 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-57a3243c-e264-4f41-9b78-2467d3b1aeec tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] 10.222.0.79 "GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf" status: 200 len: 1604 microversion: 2.42 time: 0.173897 Oct 17 13:52:00.610774 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1883/3800] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:52:00 2022] GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf => generated 1604 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:52:01.608575 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d5332ac5-b1d7-437c-ac7a-2515c38ea815 tempest-FloatingIPsTestJSON-404917541 tempest-FloatingIPsTestJSON-404917541-project] 10.222.0.79 "DELETE /compute/v2.1/os-floating-ips/47b034a4-8965-4988-9268-9ce666ee1a19" status: 202 len: 0 microversion: 2.1 time: 1.066771 Oct 17 13:52:01.609311 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1918/3801] 10.222.0.79 () {58 vars in 1263 bytes} [Mon Oct 17 13:52:00 2022] DELETE /compute/v2.1/os-floating-ips/47b034a4-8965-4988-9268-9ce666ee1a19 => generated 0 bytes in 1068 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:52:01.617821 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-984e298d-b35d-45d4-8761-6abc81f6eba5 tempest-FloatingIPsTestJSON-404917541 tempest-FloatingIPsTestJSON-404917541-project] Calling method '.version_select at 0x7f7cd477f670>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:01.641426 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-203bee80-7255-4948-9b99-6e73cec2125b tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:01.642482 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-203bee80-7255-4948-9b99-6e73cec2125b tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] [instance: 531b762d-db7e-4911-af50-6b321b7706bf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:01.650352 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-203bee80-7255-4948-9b99-6e73cec2125b tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:01.650984 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-203bee80-7255-4948-9b99-6e73cec2125b tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:01.651651 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-203bee80-7255-4948-9b99-6e73cec2125b tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:01.652492 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-203bee80-7255-4948-9b99-6e73cec2125b tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:01.653053 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-203bee80-7255-4948-9b99-6e73cec2125b tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:01.653552 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-203bee80-7255-4948-9b99-6e73cec2125b tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:01.684056 n-d-854247-14 devstack@n-api.service[127017]: DEBUG neutronclient.v2_0.client [None req-984e298d-b35d-45d4-8761-6abc81f6eba5 tempest-FloatingIPsTestJSON-404917541 tempest-FloatingIPsTestJSON-404917541-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 47b034a4-8965-4988-9268-9ce666ee1a19 could not be found", "detail": ""}} {{(pid=127017) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 13:52:01.684754 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-984e298d-b35d-45d4-8761-6abc81f6eba5 tempest-FloatingIPsTestJSON-404917541 tempest-FloatingIPsTestJSON-404917541-project] HTTP exception thrown: Floating IP not found for ID 47b034a4-8965-4988-9268-9ce666ee1a19 Oct 17 13:52:01.690134 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-984e298d-b35d-45d4-8761-6abc81f6eba5 tempest-FloatingIPsTestJSON-404917541 tempest-FloatingIPsTestJSON-404917541-project] Request method failure captured: Oct 17 13:52:01.690134 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/os-floating-ips/47b034a4-8965-4988-9268-9ce666ee1a19 HTTP/1.1 Oct 17 13:52:01.690134 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:52:01.690134 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:52:01.690134 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:52:01.690134 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:52:01.690134 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:52:01.690134 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:52:01.690134 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:52:01.690134 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:52:01.690134 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTV33JbK4Gr7AqvkjRAjcqHmHh6CosJIA8k2CJWtL7zgDF4gF4SciiAW-0S02zNFF3TUYdxnGxodGA44ISCJBoiXOByJftet-ucLkTzl8c1a3i0ES9-E2LwYIjNLFwvx_WmzBfyFpUvgh0x8fJseOn6uXQQWV86BLSBqWdylEvBRPr-k Oct 17 13:52:01.690134 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:52:01.690134 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:52:01.690134 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:52:01.690134 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:52:01.690134 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:52:01.690134 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:52:01.690134 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: c34717b160f24733b318481288cdec17 Oct 17 13:52:01.690134 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-FloatingIPsTestJSON-404917541 Oct 17 13:52:01.690134 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:52:01.690134 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:52:01.690134 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c34717b160f24733b318481288cdec17"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c34717b160f24733b318481288cdec17"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c34717b160f24733b318481288cdec17"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c34717b160f24733b318481288cdec17", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:52:01.690134 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-FloatingIPsTestJSON-404917541 Oct 17 13:52:01.690134 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: c34717b160f24733b318481288cdec17 Oct 17 13:52:01.690134 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-FloatingIPsTestJSON-404917541 Oct 17 13:52:01.690134 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-FloatingIPsTestJSON-404917541-project Oct 17 13:52:01.690134 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:52:01.690134 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:52:01.690134 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 8aa49a65cbe647b8b97019d0f469b654 Oct 17 13:52:01.690134 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-FloatingIPsTestJSON-404917541-project Oct 17 13:52:01.690134 n-d-854247-14 devstack@n-api.service[127017]: method: Oct 17 13:52:01.690134 n-d-854247-14 devstack@n-api.service[127017]: exception: Floating IP not found for ID 47b034a4-8965-4988-9268-9ce666ee1a19 Oct 17 13:52:01.690134 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '47b034a4-8965-4988-9268-9ce666ee1a19'} Oct 17 13:52:01.690134 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:52:01.690134 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:52:01.690134 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 17 13:52:01.690134 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 17 13:52:01.690134 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:52:01.690134 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:52:01.690134 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 17 13:52:01.690134 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 17 13:52:01.690134 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:52:01.690134 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:52:01.690134 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 13:52:01.690134 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 13:52:01.690134 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:52:01.690134 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:52:01.690134 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 13:52:01.690134 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 13:52:01.690134 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:52:01.690134 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:52:01.690134 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 13:52:01.690134 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 13:52:01.690134 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:52:01.690134 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:52:01.690134 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 13:52:01.690134 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 13:52:01.690134 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 13:52:01.690134 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 13:52:01.690134 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 47b034a4-8965-4988-9268-9ce666ee1a19 could not be found Oct 17 13:52:01.690134 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-90518c26-a7fb-4d44-82b2-1e3583c75a9f'] Oct 17 13:52:01.690134 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:52:01.693637 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:52:01.693637 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:52:01.693637 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:52:01.693637 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 17 13:52:01.693637 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 17 13:52:01.693637 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 17 13:52:01.693637 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 17 13:52:01.693637 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 47b034a4-8965-4988-9268-9ce666ee1a19. Oct 17 13:52:01.693637 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:52:01.693637 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:52:01.693637 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:52:01.693637 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:52:01.693637 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:52:01.693637 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:52:01.693637 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:52:01.693637 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:52:01.693637 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:52:01.693637 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:52:01.693637 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:52:01.693637 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:52:01.693637 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 17 13:52:01.693637 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 17 13:52:01.693637 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 47b034a4-8965-4988-9268-9ce666ee1a19 Oct 17 13:52:01.693637 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:52:01.693637 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:52:01.693637 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:52:01.693637 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:52:01.693637 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:52:01.693637 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:52:01.693637 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:52:01.693637 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:52:01.693637 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 47b034a4-8965-4988-9268-9ce666ee1a19 Oct 17 13:52:01.693637 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:52:01.693637 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-984e298d-b35d-45d4-8761-6abc81f6eba5 tempest-FloatingIPsTestJSON-404917541 tempest-FloatingIPsTestJSON-404917541-project] Returning 404 to user: Floating IP not found for ID 47b034a4-8965-4988-9268-9ce666ee1a19 {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:52:01.693637 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-984e298d-b35d-45d4-8761-6abc81f6eba5 tempest-FloatingIPsTestJSON-404917541 tempest-FloatingIPsTestJSON-404917541-project] 10.222.0.79 "GET /compute/v2.1/os-floating-ips/47b034a4-8965-4988-9268-9ce666ee1a19" status: 404 len: 111 microversion: 2.1 time: 0.075143 Oct 17 13:52:01.693637 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1884/3802] 10.222.0.79 () {58 vars in 1260 bytes} [Mon Oct 17 13:52:01 2022] GET /compute/v2.1/os-floating-ips/47b034a4-8965-4988-9268-9ce666ee1a19 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:52:01.698373 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1cc7a808-0117-4287-b205-67561d59977e tempest-FloatingIPsTestJSON-404917541 tempest-FloatingIPsTestJSON-404917541-project] Calling method '.version_select at 0x7f7cd5391af0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:01.755494 n-d-854247-14 devstack@n-api.service[127017]: DEBUG neutronclient.v2_0.client [None req-1cc7a808-0117-4287-b205-67561d59977e tempest-FloatingIPsTestJSON-404917541 tempest-FloatingIPsTestJSON-404917541-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 47b034a4-8965-4988-9268-9ce666ee1a19 could not be found", "detail": ""}} {{(pid=127017) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 13:52:01.756352 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-1cc7a808-0117-4287-b205-67561d59977e tempest-FloatingIPsTestJSON-404917541 tempest-FloatingIPsTestJSON-404917541-project] HTTP exception thrown: Floating IP not found for ID 47b034a4-8965-4988-9268-9ce666ee1a19 Oct 17 13:52:01.758339 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1cc7a808-0117-4287-b205-67561d59977e tempest-FloatingIPsTestJSON-404917541 tempest-FloatingIPsTestJSON-404917541-project] Request method failure captured: Oct 17 13:52:01.758339 n-d-854247-14 devstack@n-api.service[127017]: request: DELETE /compute/v2.1/os-floating-ips/47b034a4-8965-4988-9268-9ce666ee1a19 HTTP/1.1 Oct 17 13:52:01.758339 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:52:01.758339 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:52:01.758339 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:52:01.758339 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:52:01.758339 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:52:01.758339 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:52:01.758339 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:52:01.758339 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:52:01.758339 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTV33JbK4Gr7AqvkjRAjcqHmHh6CosJIA8k2CJWtL7zgDF4gF4SciiAW-0S02zNFF3TUYdxnGxodGA44ISCJBoiXOByJftet-ucLkTzl8c1a3i0ES9-E2LwYIjNLFwvx_WmzBfyFpUvgh0x8fJseOn6uXQQWV86BLSBqWdylEvBRPr-k Oct 17 13:52:01.758339 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:52:01.758339 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:52:01.758339 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:52:01.758339 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:52:01.758339 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:52:01.758339 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:52:01.758339 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: c34717b160f24733b318481288cdec17 Oct 17 13:52:01.758339 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-FloatingIPsTestJSON-404917541 Oct 17 13:52:01.758339 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:52:01.758339 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:52:01.758339 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c34717b160f24733b318481288cdec17"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c34717b160f24733b318481288cdec17"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c34717b160f24733b318481288cdec17"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c34717b160f24733b318481288cdec17", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:52:01.758339 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-FloatingIPsTestJSON-404917541 Oct 17 13:52:01.758339 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: c34717b160f24733b318481288cdec17 Oct 17 13:52:01.758339 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-FloatingIPsTestJSON-404917541 Oct 17 13:52:01.758339 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-FloatingIPsTestJSON-404917541-project Oct 17 13:52:01.758339 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:52:01.758339 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:52:01.758339 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 8aa49a65cbe647b8b97019d0f469b654 Oct 17 13:52:01.758339 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-FloatingIPsTestJSON-404917541-project Oct 17 13:52:01.758339 n-d-854247-14 devstack@n-api.service[127017]: method: Oct 17 13:52:01.758339 n-d-854247-14 devstack@n-api.service[127017]: exception: Floating IP not found for ID 47b034a4-8965-4988-9268-9ce666ee1a19 Oct 17 13:52:01.758339 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '47b034a4-8965-4988-9268-9ce666ee1a19'} Oct 17 13:52:01.758339 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:52:01.758339 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:52:01.758339 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 17 13:52:01.758339 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 17 13:52:01.758339 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:52:01.758339 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:52:01.758339 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 17 13:52:01.758339 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 17 13:52:01.758339 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:52:01.758339 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:52:01.758339 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 13:52:01.758339 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 13:52:01.758339 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:52:01.758339 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:52:01.758339 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 13:52:01.758339 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 13:52:01.758339 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:52:01.758339 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:52:01.758339 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 13:52:01.758339 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 13:52:01.758339 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:52:01.758339 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:52:01.758339 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 13:52:01.758339 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 13:52:01.758339 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 13:52:01.758339 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 13:52:01.758339 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 47b034a4-8965-4988-9268-9ce666ee1a19 could not be found Oct 17 13:52:01.758339 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fd4c9731-f2db-4034-b952-37600896ced4'] Oct 17 13:52:01.758339 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:52:01.761387 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:52:01.761387 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:52:01.761387 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:52:01.761387 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 17 13:52:01.761387 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 17 13:52:01.761387 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 17 13:52:01.761387 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 17 13:52:01.761387 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 47b034a4-8965-4988-9268-9ce666ee1a19. Oct 17 13:52:01.761387 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:52:01.761387 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:52:01.761387 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:52:01.761387 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:52:01.761387 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:52:01.761387 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:52:01.761387 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:52:01.761387 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:52:01.761387 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:52:01.761387 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:52:01.761387 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:52:01.761387 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:52:01.761387 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 17 13:52:01.761387 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 17 13:52:01.761387 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 47b034a4-8965-4988-9268-9ce666ee1a19 Oct 17 13:52:01.761387 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:52:01.761387 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:52:01.761387 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:52:01.761387 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:52:01.761387 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:52:01.761387 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:52:01.761387 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:52:01.761387 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:52:01.761387 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 47b034a4-8965-4988-9268-9ce666ee1a19 Oct 17 13:52:01.761387 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:52:01.764744 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1cc7a808-0117-4287-b205-67561d59977e tempest-FloatingIPsTestJSON-404917541 tempest-FloatingIPsTestJSON-404917541-project] Returning 404 to user: Floating IP not found for ID 47b034a4-8965-4988-9268-9ce666ee1a19 {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:52:01.766007 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1cc7a808-0117-4287-b205-67561d59977e tempest-FloatingIPsTestJSON-404917541 tempest-FloatingIPsTestJSON-404917541-project] 10.222.0.79 "DELETE /compute/v2.1/os-floating-ips/47b034a4-8965-4988-9268-9ce666ee1a19" status: 404 len: 111 microversion: 2.1 time: 0.072071 Oct 17 13:52:01.770984 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1885/3803] 10.222.0.79 () {58 vars in 1263 bytes} [Mon Oct 17 13:52:01 2022] DELETE /compute/v2.1/os-floating-ips/47b034a4-8965-4988-9268-9ce666ee1a19 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:52:01.779985 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-203bee80-7255-4948-9b99-6e73cec2125b tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:01.791519 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-203bee80-7255-4948-9b99-6e73cec2125b tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:01.793324 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-203bee80-7255-4948-9b99-6e73cec2125b tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:01.794835 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-203bee80-7255-4948-9b99-6e73cec2125b tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] 10.222.0.79 "GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf" status: 200 len: 1604 microversion: 2.42 time: 0.160029 Oct 17 13:52:01.796601 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1919/3804] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:52:01 2022] GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf => generated 1604 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:52:02.144603 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-23970242-44f5-40ea-af1d-95ac58a72ec4 req-263e5320-de29-4c77-ab77-dd011efc6070 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3197da72-e924-4f50-8c93-c3f3ff98e084", "tag": "ae63042f-2479-46ef-8b31-2a573c0b051b"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:52:02.157269 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-23970242-44f5-40ea-af1d-95ac58a72ec4 req-263e5320-de29-4c77-ab77-dd011efc6070 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:02.157815 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-23970242-44f5-40ea-af1d-95ac58a72ec4 req-263e5320-de29-4c77-ab77-dd011efc6070 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:02.158466 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-23970242-44f5-40ea-af1d-95ac58a72ec4 req-263e5320-de29-4c77-ab77-dd011efc6070 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:02.176757 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-23970242-44f5-40ea-af1d-95ac58a72ec4 req-263e5320-de29-4c77-ab77-dd011efc6070 service nova] Creating event network-changed:ae63042f-2479-46ef-8b31-2a573c0b051b for instance 3197da72-e924-4f50-8c93-c3f3ff98e084 on n-h1-854247-14 Oct 17 13:52:02.180568 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-23970242-44f5-40ea-af1d-95ac58a72ec4 req-263e5320-de29-4c77-ab77-dd011efc6070 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039498 Oct 17 13:52:02.181156 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1886/3805] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:52:02.824071 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-20e7f8ad-01df-423b-be29-56bedf76bcfa tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:02.824896 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-20e7f8ad-01df-423b-be29-56bedf76bcfa tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] [instance: 531b762d-db7e-4911-af50-6b321b7706bf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:02.835435 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-20e7f8ad-01df-423b-be29-56bedf76bcfa tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:02.836072 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-20e7f8ad-01df-423b-be29-56bedf76bcfa tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:02.836918 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-20e7f8ad-01df-423b-be29-56bedf76bcfa tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:02.838018 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-20e7f8ad-01df-423b-be29-56bedf76bcfa tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:02.838890 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-20e7f8ad-01df-423b-be29-56bedf76bcfa tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:02.839661 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-20e7f8ad-01df-423b-be29-56bedf76bcfa tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:02.952091 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-20e7f8ad-01df-423b-be29-56bedf76bcfa tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:02.963453 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-20e7f8ad-01df-423b-be29-56bedf76bcfa tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:02.965708 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-20e7f8ad-01df-423b-be29-56bedf76bcfa tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:02.967158 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-20e7f8ad-01df-423b-be29-56bedf76bcfa tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] 10.222.0.79 "GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf" status: 200 len: 1604 microversion: 2.42 time: 0.148989 Oct 17 13:52:02.973870 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1920/3806] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:52:02 2022] GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf => generated 1604 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:52:03.550848 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ac56c662-a2b8-49f4-aa69-e52d4e7d65da tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:03.551530 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ac56c662-a2b8-49f4-aa69-e52d4e7d65da tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:03.571708 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac56c662-a2b8-49f4-aa69-e52d4e7d65da tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:03.574310 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac56c662-a2b8-49f4-aa69-e52d4e7d65da tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:03.574756 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac56c662-a2b8-49f4-aa69-e52d4e7d65da tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:03.575691 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac56c662-a2b8-49f4-aa69-e52d4e7d65da tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:03.576445 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac56c662-a2b8-49f4-aa69-e52d4e7d65da tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:03.577011 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac56c662-a2b8-49f4-aa69-e52d4e7d65da tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:03.606633 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ac56c662-a2b8-49f4-aa69-e52d4e7d65da tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5/ips" status: 200 len: 145 microversion: 2.1 time: 0.061945 Oct 17 13:52:03.608231 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1887/3807] 10.222.0.79 () {58 vars in 1248 bytes} [Mon Oct 17 13:52:03 2022] GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5/ips => generated 145 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:52:04.015555 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0cff7232-48dd-446b-ac0e-1f76580682fe tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:04.016094 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0cff7232-48dd-446b-ac0e-1f76580682fe tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] [instance: 531b762d-db7e-4911-af50-6b321b7706bf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:04.040549 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0cff7232-48dd-446b-ac0e-1f76580682fe tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:04.041049 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0cff7232-48dd-446b-ac0e-1f76580682fe tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:04.055771 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0cff7232-48dd-446b-ac0e-1f76580682fe tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:04.055771 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0cff7232-48dd-446b-ac0e-1f76580682fe tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:04.055771 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0cff7232-48dd-446b-ac0e-1f76580682fe tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:04.055771 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0cff7232-48dd-446b-ac0e-1f76580682fe tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:05.099510 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0cff7232-48dd-446b-ac0e-1f76580682fe tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:05.117617 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0cff7232-48dd-446b-ac0e-1f76580682fe tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:05.119133 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0cff7232-48dd-446b-ac0e-1f76580682fe tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:05.121097 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0cff7232-48dd-446b-ac0e-1f76580682fe tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] 10.222.0.79 "GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf" status: 200 len: 1604 microversion: 2.42 time: 1.110691 Oct 17 13:52:05.124292 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1921/3808] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:52:04 2022] GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf => generated 1604 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:52:05.445129 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bfd63d8a-c4df-48e7-b825-473da7db5b47 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "273ea9d4-92d5-45c4-8894-5af093e6dee0"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:52:05.448705 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-bfd63d8a-c4df-48e7-b825-473da7db5b47 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:05.471009 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bfd63d8a-c4df-48e7-b825-473da7db5b47 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:05.472379 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bfd63d8a-c4df-48e7-b825-473da7db5b47 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:05.473095 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bfd63d8a-c4df-48e7-b825-473da7db5b47 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:05.474560 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bfd63d8a-c4df-48e7-b825-473da7db5b47 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:05.475096 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bfd63d8a-c4df-48e7-b825-473da7db5b47 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:05.477424 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bfd63d8a-c4df-48e7-b825-473da7db5b47 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:05.623870 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-bfd63d8a-c4df-48e7-b825-473da7db5b47 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] HTTP exception thrown: Invalid volume: volume 273ea9d4-92d5-45c4-8894-5af093e6dee0 is already attached to instances: 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e Oct 17 13:52:05.626542 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bfd63d8a-c4df-48e7-b825-473da7db5b47 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Request method failure captured: Oct 17 13:52:05.626542 n-d-854247-14 devstack@n-api.service[127017]: request: POST /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e/os-volume_attachments HTTP/1.1 Oct 17 13:52:05.626542 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:52:05.626542 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:52:05.626542 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:52:05.626542 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 74 Oct 17 13:52:05.626542 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:52:05.626542 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:52:05.626542 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:52:05.626542 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:52:05.626542 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTV0JL7NQSDQqh4ZMvkCDXT2fwovcCgk-nxK1nRG4B-HeC5OA7y2_TQv_yPRGTaQ-3zvHufQBJMrO1ZhsIWZZ0ugPMuvlokQmhLWi-H9zySFSYK0iM1qNABohwKQ4S7v-F2ZGFUB1jMKnP05ShlKiL4M8_7Jns7W8GDQtoUfjwQ0M1Lk Oct 17 13:52:05.626542 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:52:05.626542 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:52:05.626542 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:52:05.626542 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:52:05.626542 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:52:05.626542 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:52:05.626542 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 4acd31ce63b64ac3a05b76d4a9fdf7c0 Oct 17 13:52:05.626542 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-AttachVolumeNegativeTest-1792618646 Oct 17 13:52:05.626542 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:52:05.626542 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:52:05.626542 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4acd31ce63b64ac3a05b76d4a9fdf7c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4acd31ce63b64ac3a05b76d4a9fdf7c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4acd31ce63b64ac3a05b76d4a9fdf7c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4acd31ce63b64ac3a05b76d4a9fdf7c0", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:52:05.626542 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-AttachVolumeNegativeTest-1792618646 Oct 17 13:52:05.626542 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 4acd31ce63b64ac3a05b76d4a9fdf7c0 Oct 17 13:52:05.626542 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1792618646 Oct 17 13:52:05.626542 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-AttachVolumeNegativeTest-1792618646-project Oct 17 13:52:05.626542 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:52:05.626542 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:52:05.626542 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: c7a7b9b048234fd2926739e3f08400b0 Oct 17 13:52:05.626542 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-AttachVolumeNegativeTest-1792618646-project Oct 17 13:52:05.626542 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 13:52:05.626542 n-d-854247-14 devstack@n-api.service[127017]: {"volumeAttachment": {"volumeId": "273ea9d4-92d5-45c4-8894-5af093e6dee0"}} Oct 17 13:52:05.626542 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:52:05.626542 n-d-854247-14 devstack@n-api.service[127017]: exception: Invalid volume: volume 273ea9d4-92d5-45c4-8894-5af093e6dee0 is already attached to instances: 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e Oct 17 13:52:05.626542 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'server_id': '2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e', 'body': {'volumeAttachment': {'volumeId': '273ea9d4-92d5-45c4-8894-5af093e6dee0'}}} Oct 17 13:52:05.626542 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:52:05.626542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:52:05.626542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 17 13:52:05.626542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 17 13:52:05.626542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 13:52:05.626542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:52:05.626542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 17 13:52:05.626542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 13:52:05.626542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 17 13:52:05.626542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 17 13:52:05.626542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 17 13:52:05.626542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 17 13:52:05.626542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 273ea9d4-92d5-45c4-8894-5af093e6dee0 is already attached to instances: 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e Oct 17 13:52:05.626542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:52:05.626542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:52:05.626542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:52:05.626542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:52:05.626542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:52:05.626542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:52:05.626542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:52:05.626542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:52:05.626542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:52:05.626542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:52:05.626542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:52:05.626542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:52:05.626542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:52:05.626542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:52:05.634123 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:52:05.634123 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:52:05.634123 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 17 13:52:05.634123 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 17 13:52:05.634123 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 273ea9d4-92d5-45c4-8894-5af093e6dee0 is already attached to instances: 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e Oct 17 13:52:05.634123 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:52:05.634123 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:52:05.634123 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:52:05.634123 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:52:05.634123 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:52:05.634123 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:52:05.634123 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:52:05.634123 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:52:05.634123 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 273ea9d4-92d5-45c4-8894-5af093e6dee0 is already attached to instances: 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e Oct 17 13:52:05.634123 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:52:05.634123 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bfd63d8a-c4df-48e7-b825-473da7db5b47 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Returning 400 to user: Invalid volume: volume 273ea9d4-92d5-45c4-8894-5af093e6dee0 is already attached to instances: 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:52:05.634123 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-bfd63d8a-c4df-48e7-b825-473da7db5b47 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "POST /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.187605 Oct 17 13:52:05.634123 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1888/3809] 10.222.0.79 () {60 vars in 1323 bytes} [Mon Oct 17 13:52:05 2022] POST /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e/os-volume_attachments => generated 174 bytes in 189 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:52:05.722159 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-af1c40ac-d1a5-494b-944d-f001578dd9f3 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:05.722824 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-af1c40ac-d1a5-494b-944d-f001578dd9f3 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:05.731739 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af1c40ac-d1a5-494b-944d-f001578dd9f3 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:05.733016 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af1c40ac-d1a5-494b-944d-f001578dd9f3 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:05.735623 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af1c40ac-d1a5-494b-944d-f001578dd9f3 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:05.736746 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af1c40ac-d1a5-494b-944d-f001578dd9f3 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:05.738730 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af1c40ac-d1a5-494b-944d-f001578dd9f3 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:05.739321 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af1c40ac-d1a5-494b-944d-f001578dd9f3 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:05.866536 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-af1c40ac-d1a5-494b-944d-f001578dd9f3 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lazy-loading 'services' on Instance uuid 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:52:05.953434 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-af1c40ac-d1a5-494b-944d-f001578dd9f3 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "DELETE /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e/os-volume_attachments/273ea9d4-92d5-45c4-8894-5af093e6dee0" status: 202 len: 0 microversion: 2.1 time: 0.236860 Oct 17 13:52:05.954582 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1922/3810] 10.222.0.79 () {58 vars in 1416 bytes} [Mon Oct 17 13:52:05 2022] DELETE /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e/os-volume_attachments/273ea9d4-92d5-45c4-8894-5af093e6dee0 => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:52:05.968293 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b3f4cc31-4d98-4caf-80f6-97ad1e5cdc47 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:05.972176 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b3f4cc31-4d98-4caf-80f6-97ad1e5cdc47 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:05.987145 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b3f4cc31-4d98-4caf-80f6-97ad1e5cdc47 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:05.987999 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b3f4cc31-4d98-4caf-80f6-97ad1e5cdc47 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:05.988619 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b3f4cc31-4d98-4caf-80f6-97ad1e5cdc47 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:05.989504 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b3f4cc31-4d98-4caf-80f6-97ad1e5cdc47 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:05.990740 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b3f4cc31-4d98-4caf-80f6-97ad1e5cdc47 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:05.991486 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b3f4cc31-4d98-4caf-80f6-97ad1e5cdc47 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:06.052226 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b3f4cc31-4d98-4caf-80f6-97ad1e5cdc47 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090080 Oct 17 13:52:06.061016 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1889/3811] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 13:52:05 2022] GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:52:06.154659 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-bd680344-1df4-4f15-b5e2-f5c620bf3f11 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:06.155520 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-bd680344-1df4-4f15-b5e2-f5c620bf3f11 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] [instance: 531b762d-db7e-4911-af50-6b321b7706bf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:06.163778 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bd680344-1df4-4f15-b5e2-f5c620bf3f11 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:06.164258 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bd680344-1df4-4f15-b5e2-f5c620bf3f11 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:06.164696 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bd680344-1df4-4f15-b5e2-f5c620bf3f11 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:06.165410 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bd680344-1df4-4f15-b5e2-f5c620bf3f11 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:06.166001 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bd680344-1df4-4f15-b5e2-f5c620bf3f11 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:06.166433 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bd680344-1df4-4f15-b5e2-f5c620bf3f11 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:06.310718 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-bd680344-1df4-4f15-b5e2-f5c620bf3f11 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:06.330186 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-bd680344-1df4-4f15-b5e2-f5c620bf3f11 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:06.334715 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-bd680344-1df4-4f15-b5e2-f5c620bf3f11 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:06.339182 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-bd680344-1df4-4f15-b5e2-f5c620bf3f11 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] 10.222.0.79 "GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf" status: 200 len: 1604 microversion: 2.42 time: 0.189059 Oct 17 13:52:06.359228 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1923/3812] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:52:06 2022] GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf => generated 1604 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:52:06.493441 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9de069f0-f52d-4ce3-9a57-6dc916abb6b3 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a926cc62-2fec-45a4-abdb-8cd1eee8ff64"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:52:06.496611 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9de069f0-f52d-4ce3-9a57-6dc916abb6b3 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:06.505044 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9de069f0-f52d-4ce3-9a57-6dc916abb6b3 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:06.507598 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9de069f0-f52d-4ce3-9a57-6dc916abb6b3 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:06.510650 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9de069f0-f52d-4ce3-9a57-6dc916abb6b3 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:06.511588 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9de069f0-f52d-4ce3-9a57-6dc916abb6b3 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:06.512203 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9de069f0-f52d-4ce3-9a57-6dc916abb6b3 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:06.520120 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9de069f0-f52d-4ce3-9a57-6dc916abb6b3 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:07.078609 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6e6543b0-715a-40d2-a345-5ffd2ae022f2 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:07.086048 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6e6543b0-715a-40d2-a345-5ffd2ae022f2 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:07.095701 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6e6543b0-715a-40d2-a345-5ffd2ae022f2 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:07.096570 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6e6543b0-715a-40d2-a345-5ffd2ae022f2 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:07.097201 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6e6543b0-715a-40d2-a345-5ffd2ae022f2 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:07.098903 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6e6543b0-715a-40d2-a345-5ffd2ae022f2 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:07.099614 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6e6543b0-715a-40d2-a345-5ffd2ae022f2 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:07.100233 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6e6543b0-715a-40d2-a345-5ffd2ae022f2 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:07.163328 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6e6543b0-715a-40d2-a345-5ffd2ae022f2 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100758 Oct 17 13:52:07.165134 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1924/3813] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 13:52:07 2022] GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:52:07.365706 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-881e0f94-4158-400d-80e9-1ebc04c25343 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:07.366322 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-881e0f94-4158-400d-80e9-1ebc04c25343 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] [instance: 531b762d-db7e-4911-af50-6b321b7706bf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:07.380845 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-881e0f94-4158-400d-80e9-1ebc04c25343 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:07.381623 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-881e0f94-4158-400d-80e9-1ebc04c25343 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:07.382210 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-881e0f94-4158-400d-80e9-1ebc04c25343 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:07.383087 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-881e0f94-4158-400d-80e9-1ebc04c25343 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:07.383708 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-881e0f94-4158-400d-80e9-1ebc04c25343 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:07.384348 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-881e0f94-4158-400d-80e9-1ebc04c25343 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:07.489317 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-881e0f94-4158-400d-80e9-1ebc04c25343 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:07.528799 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-881e0f94-4158-400d-80e9-1ebc04c25343 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:07.531115 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-881e0f94-4158-400d-80e9-1ebc04c25343 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:07.533292 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-881e0f94-4158-400d-80e9-1ebc04c25343 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] 10.222.0.79 "GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf" status: 200 len: 1604 microversion: 2.42 time: 0.171474 Oct 17 13:52:07.536498 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1925/3814] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:52:07 2022] GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf => generated 1604 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:52:08.176397 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4d72920a-5d4e-4e88-8a74-6667e961785d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:08.179035 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4d72920a-5d4e-4e88-8a74-6667e961785d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:08.188691 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d72920a-5d4e-4e88-8a74-6667e961785d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:08.189188 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d72920a-5d4e-4e88-8a74-6667e961785d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:08.189970 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d72920a-5d4e-4e88-8a74-6667e961785d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:08.190686 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d72920a-5d4e-4e88-8a74-6667e961785d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:08.191192 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d72920a-5d4e-4e88-8a74-6667e961785d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:08.191616 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d72920a-5d4e-4e88-8a74-6667e961785d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:08.223842 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:52:08.230714 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4d72920a-5d4e-4e88-8a74-6667e961785d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058690 Oct 17 13:52:08.231962 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1926/3815] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 13:52:08 2022] GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:52:08.564026 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e249a5d8-6d70-4698-bc44-1decc8d13afe tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:08.565452 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e249a5d8-6d70-4698-bc44-1decc8d13afe tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] [instance: 531b762d-db7e-4911-af50-6b321b7706bf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:08.574075 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e249a5d8-6d70-4698-bc44-1decc8d13afe tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:08.574716 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e249a5d8-6d70-4698-bc44-1decc8d13afe tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:08.575443 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e249a5d8-6d70-4698-bc44-1decc8d13afe tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:08.576258 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e249a5d8-6d70-4698-bc44-1decc8d13afe tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:08.576807 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e249a5d8-6d70-4698-bc44-1decc8d13afe tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:08.577499 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e249a5d8-6d70-4698-bc44-1decc8d13afe tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:08.653390 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e249a5d8-6d70-4698-bc44-1decc8d13afe tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:08.668521 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e249a5d8-6d70-4698-bc44-1decc8d13afe tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:08.670694 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e249a5d8-6d70-4698-bc44-1decc8d13afe tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:08.672880 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e249a5d8-6d70-4698-bc44-1decc8d13afe tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] 10.222.0.79 "GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf" status: 200 len: 1604 microversion: 2.42 time: 0.114485 Oct 17 13:52:08.673703 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1927/3816] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:52:08 2022] GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf => generated 1604 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:52:09.245413 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-31850620-af28-4f02-9d20-ed5900ea21e3 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:09.247792 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-31850620-af28-4f02-9d20-ed5900ea21e3 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:09.257923 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-31850620-af28-4f02-9d20-ed5900ea21e3 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:09.261831 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-31850620-af28-4f02-9d20-ed5900ea21e3 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:09.262376 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-31850620-af28-4f02-9d20-ed5900ea21e3 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:09.264150 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-31850620-af28-4f02-9d20-ed5900ea21e3 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:09.266270 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-31850620-af28-4f02-9d20-ed5900ea21e3 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:09.266768 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-31850620-af28-4f02-9d20-ed5900ea21e3 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:09.312566 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-31850620-af28-4f02-9d20-ed5900ea21e3 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072163 Oct 17 13:52:09.313681 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1928/3817] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 13:52:09 2022] GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:52:09.701963 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ca2107db-5cf8-482f-b855-5aab100d0567 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:09.702989 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ca2107db-5cf8-482f-b855-5aab100d0567 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] [instance: 531b762d-db7e-4911-af50-6b321b7706bf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:09.716327 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ca2107db-5cf8-482f-b855-5aab100d0567 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:09.716908 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ca2107db-5cf8-482f-b855-5aab100d0567 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:09.717448 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ca2107db-5cf8-482f-b855-5aab100d0567 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:09.718317 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ca2107db-5cf8-482f-b855-5aab100d0567 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:09.726672 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ca2107db-5cf8-482f-b855-5aab100d0567 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:09.727350 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ca2107db-5cf8-482f-b855-5aab100d0567 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:09.813314 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ca2107db-5cf8-482f-b855-5aab100d0567 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:09.827314 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ca2107db-5cf8-482f-b855-5aab100d0567 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:09.829105 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ca2107db-5cf8-482f-b855-5aab100d0567 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:09.830686 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ca2107db-5cf8-482f-b855-5aab100d0567 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] 10.222.0.79 "GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf" status: 200 len: 1604 microversion: 2.42 time: 0.133634 Oct 17 13:52:09.832104 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1929/3818] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:52:09 2022] GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf => generated 1604 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:52:10.326974 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-02b1be5a-b77b-4fff-a666-93a5a62c5bd6 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:10.337322 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-02b1be5a-b77b-4fff-a666-93a5a62c5bd6 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:10.367318 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-02b1be5a-b77b-4fff-a666-93a5a62c5bd6 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:10.368981 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-02b1be5a-b77b-4fff-a666-93a5a62c5bd6 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:10.369712 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-02b1be5a-b77b-4fff-a666-93a5a62c5bd6 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:10.371160 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-02b1be5a-b77b-4fff-a666-93a5a62c5bd6 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:10.371917 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-02b1be5a-b77b-4fff-a666-93a5a62c5bd6 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:10.372495 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-02b1be5a-b77b-4fff-a666-93a5a62c5bd6 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:10.428551 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-02b1be5a-b77b-4fff-a666-93a5a62c5bd6 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106564 Oct 17 13:52:10.429351 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1930/3819] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 13:52:10 2022] GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:52:10.850502 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2064ebe3-ca88-4339-b78d-2b521446224d tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd554dca0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:10.905981 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2064ebe3-ca88-4339-b78d-2b521446224d tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/images/a226dc23-d66a-4cb3-856f-8e9c429ce665" status: 200 len: 661 microversion: 2.1 time: 0.060589 Oct 17 13:52:10.911398 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1931/3820] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:52:10 2022] GET /compute/v2.1/images/a226dc23-d66a-4cb3-856f-8e9c429ce665 => generated 661 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:52:10.915985 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ba81cdc1-b42f-4f07-81e4-946fd55a7c31 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:10.916639 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ba81cdc1-b42f-4f07-81e4-946fd55a7c31 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] [instance: 531b762d-db7e-4911-af50-6b321b7706bf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:10.925065 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ba81cdc1-b42f-4f07-81e4-946fd55a7c31 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:10.927392 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ba81cdc1-b42f-4f07-81e4-946fd55a7c31 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:10.927392 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ba81cdc1-b42f-4f07-81e4-946fd55a7c31 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:10.927637 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ba81cdc1-b42f-4f07-81e4-946fd55a7c31 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:10.928082 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ba81cdc1-b42f-4f07-81e4-946fd55a7c31 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:10.928719 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ba81cdc1-b42f-4f07-81e4-946fd55a7c31 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:11.011757 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ba81cdc1-b42f-4f07-81e4-946fd55a7c31 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:11.030861 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ba81cdc1-b42f-4f07-81e4-946fd55a7c31 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:11.038066 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ba81cdc1-b42f-4f07-81e4-946fd55a7c31 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:11.039480 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ba81cdc1-b42f-4f07-81e4-946fd55a7c31 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] 10.222.0.79 "GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf" status: 200 len: 1604 microversion: 2.42 time: 0.131031 Oct 17 13:52:11.040054 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1932/3821] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:52:10 2022] GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf => generated 1604 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:52:11.053489 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-61a52dc1-464b-4207-8a02-696d78bb76af tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd554d820>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:11.104975 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-61a52dc1-464b-4207-8a02-696d78bb76af tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/images/a226dc23-d66a-4cb3-856f-8e9c429ce665" status: 200 len: 661 microversion: 2.1 time: 0.059410 Oct 17 13:52:11.105684 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1933/3822] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:52:11 2022] GET /compute/v2.1/images/a226dc23-d66a-4cb3-856f-8e9c429ce665 => generated 661 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:52:11.443253 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-da5681c3-0ded-48da-82c3-a642b320075b tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:11.446595 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-da5681c3-0ded-48da-82c3-a642b320075b tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:11.456808 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-da5681c3-0ded-48da-82c3-a642b320075b tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:11.457123 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-da5681c3-0ded-48da-82c3-a642b320075b tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:11.457567 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-da5681c3-0ded-48da-82c3-a642b320075b tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:11.458283 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-da5681c3-0ded-48da-82c3-a642b320075b tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:11.458739 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-da5681c3-0ded-48da-82c3-a642b320075b tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:11.459258 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-da5681c3-0ded-48da-82c3-a642b320075b tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:11.494752 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-da5681c3-0ded-48da-82c3-a642b320075b tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055707 Oct 17 13:52:11.495390 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1934/3823] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 13:52:11 2022] GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:52:12.072407 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7f4f73dc-6e46-4e60-bb6b-022155048f69 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:12.073026 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7f4f73dc-6e46-4e60-bb6b-022155048f69 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] [instance: 531b762d-db7e-4911-af50-6b321b7706bf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:12.097214 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7f4f73dc-6e46-4e60-bb6b-022155048f69 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:12.097716 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7f4f73dc-6e46-4e60-bb6b-022155048f69 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:12.105828 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7f4f73dc-6e46-4e60-bb6b-022155048f69 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:12.106958 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7f4f73dc-6e46-4e60-bb6b-022155048f69 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:12.107602 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7f4f73dc-6e46-4e60-bb6b-022155048f69 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:12.114088 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7f4f73dc-6e46-4e60-bb6b-022155048f69 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:12.195969 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7f4f73dc-6e46-4e60-bb6b-022155048f69 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:12.211580 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7f4f73dc-6e46-4e60-bb6b-022155048f69 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:12.219157 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7f4f73dc-6e46-4e60-bb6b-022155048f69 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:12.221012 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7f4f73dc-6e46-4e60-bb6b-022155048f69 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] 10.222.0.79 "GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf" status: 200 len: 1604 microversion: 2.42 time: 0.153048 Oct 17 13:52:12.222420 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1935/3824] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:52:12 2022] GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf => generated 1604 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:52:12.521005 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c6cb8d3c-8ed8-486c-a8b7-abaf551f3f75 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:12.525091 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c6cb8d3c-8ed8-486c-a8b7-abaf551f3f75 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:12.536552 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c6cb8d3c-8ed8-486c-a8b7-abaf551f3f75 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:12.537214 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c6cb8d3c-8ed8-486c-a8b7-abaf551f3f75 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:12.537785 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c6cb8d3c-8ed8-486c-a8b7-abaf551f3f75 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:12.539734 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c6cb8d3c-8ed8-486c-a8b7-abaf551f3f75 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:12.540768 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c6cb8d3c-8ed8-486c-a8b7-abaf551f3f75 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:12.541336 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c6cb8d3c-8ed8-486c-a8b7-abaf551f3f75 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:12.588828 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c6cb8d3c-8ed8-486c-a8b7-abaf551f3f75 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085192 Oct 17 13:52:12.590108 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1936/3825] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 13:52:12 2022] GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:52:12.621330 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8d3663e1-c440-4852-ab2d-5a1b40cf6b71 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd555d940>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:12.678010 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8d3663e1-c440-4852-ab2d-5a1b40cf6b71 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/images/cc4ed12d-5901-47a8-8c62-890e6368f280" status: 200 len: 660 microversion: 2.1 time: 0.060952 Oct 17 13:52:12.678763 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1937/3826] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:52:12 2022] GET /compute/v2.1/images/cc4ed12d-5901-47a8-8c62-890e6368f280 => generated 660 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:52:12.695574 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-89cbcafa-7445-4a74-82ad-947366ddc46d tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd5733ee0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:12.745243 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-89cbcafa-7445-4a74-82ad-947366ddc46d tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/images/cc4ed12d-5901-47a8-8c62-890e6368f280" status: 200 len: 660 microversion: 2.1 time: 0.054408 Oct 17 13:52:12.746234 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1938/3827] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:52:12 2022] GET /compute/v2.1/images/cc4ed12d-5901-47a8-8c62-890e6368f280 => generated 660 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:52:13.250220 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-757e2c3d-0cd4-4602-9a9d-357dcb4be69a tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:13.250839 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-757e2c3d-0cd4-4602-9a9d-357dcb4be69a tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] [instance: 531b762d-db7e-4911-af50-6b321b7706bf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:13.261190 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-757e2c3d-0cd4-4602-9a9d-357dcb4be69a tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:13.261699 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-757e2c3d-0cd4-4602-9a9d-357dcb4be69a tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:13.262139 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-757e2c3d-0cd4-4602-9a9d-357dcb4be69a tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:13.262847 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-757e2c3d-0cd4-4602-9a9d-357dcb4be69a tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:13.263326 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-757e2c3d-0cd4-4602-9a9d-357dcb4be69a tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:13.263753 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-757e2c3d-0cd4-4602-9a9d-357dcb4be69a tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:13.336877 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-757e2c3d-0cd4-4602-9a9d-357dcb4be69a tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:13.348217 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-757e2c3d-0cd4-4602-9a9d-357dcb4be69a tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:13.349590 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-757e2c3d-0cd4-4602-9a9d-357dcb4be69a tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:13.350984 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-757e2c3d-0cd4-4602-9a9d-357dcb4be69a tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] 10.222.0.79 "GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf" status: 200 len: 1604 microversion: 2.42 time: 0.105195 Oct 17 13:52:13.351793 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1939/3828] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:52:13 2022] GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf => generated 1604 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:52:13.602495 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7b9e88bf-fc07-42eb-af7c-e3465c37c3fd tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:13.605200 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7b9e88bf-fc07-42eb-af7c-e3465c37c3fd tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:13.621726 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7b9e88bf-fc07-42eb-af7c-e3465c37c3fd tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:13.622295 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7b9e88bf-fc07-42eb-af7c-e3465c37c3fd tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:13.622802 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7b9e88bf-fc07-42eb-af7c-e3465c37c3fd tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:13.623624 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7b9e88bf-fc07-42eb-af7c-e3465c37c3fd tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:13.624470 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7b9e88bf-fc07-42eb-af7c-e3465c37c3fd tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:13.624969 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7b9e88bf-fc07-42eb-af7c-e3465c37c3fd tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:13.659456 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7b9e88bf-fc07-42eb-af7c-e3465c37c3fd tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061215 Oct 17 13:52:13.660456 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1940/3829] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 13:52:13 2022] GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:52:14.140230 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c48024e5-5f91-4bd9-9017-2aa56d7d2f69 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd5421700>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:14.198699 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c48024e5-5f91-4bd9-9017-2aa56d7d2f69 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/images/3c7ada60-86b9-4516-9792-27def12788d5" status: 200 len: 661 microversion: 2.1 time: 0.062640 Oct 17 13:52:14.199669 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1941/3830] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:52:14 2022] GET /compute/v2.1/images/3c7ada60-86b9-4516-9792-27def12788d5 => generated 661 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:52:14.214379 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c72bbafe-cadb-4b51-9582-76fce24cd100 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd559bf70>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:14.271606 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c72bbafe-cadb-4b51-9582-76fce24cd100 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/images/3c7ada60-86b9-4516-9792-27def12788d5" status: 200 len: 661 microversion: 2.1 time: 0.058111 Oct 17 13:52:14.272465 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1942/3831] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:52:14 2022] GET /compute/v2.1/images/3c7ada60-86b9-4516-9792-27def12788d5 => generated 661 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:52:14.336554 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f3bc93ee-8f19-45a6-88e9-801059d3566e tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-450839717", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:52:14.389406 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-f3bc93ee-8f19-45a6-88e9-801059d3566e tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] validate_networks() for None {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:52:14.726017 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-f3bc93ee-8f19-45a6-88e9-801059d3566e tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:52:14.726636 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-f3bc93ee-8f19-45a6-88e9-801059d3566e tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:52:14.727108 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-f3bc93ee-8f19-45a6-88e9-801059d3566e tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:52:14.727811 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-f3bc93ee-8f19-45a6-88e9-801059d3566e tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:52:14.728448 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-f3bc93ee-8f19-45a6-88e9-801059d3566e tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:52:14.739080 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f3bc93ee-8f19-45a6-88e9-801059d3566e tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:14.739967 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f3bc93ee-8f19-45a6-88e9-801059d3566e tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:14.740458 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f3bc93ee-8f19-45a6-88e9-801059d3566e tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:14.741443 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f3bc93ee-8f19-45a6-88e9-801059d3566e tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:14.741983 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f3bc93ee-8f19-45a6-88e9-801059d3566e tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:14.742483 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f3bc93ee-8f19-45a6-88e9-801059d3566e tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:14.763993 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-f3bc93ee-8f19-45a6-88e9-801059d3566e tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Getting quotas for project 8fb1624a35d0403c9e5d09a17e79b7fb. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:52:14.771157 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-f3bc93ee-8f19-45a6-88e9-801059d3566e tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Getting quotas for user 79bfe589d0784bfc8ed1611c71cd4461 and project 8fb1624a35d0403c9e5d09a17e79b7fb. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:52:14.788912 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f3bc93ee-8f19-45a6-88e9-801059d3566e tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:52:14.791516 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f3bc93ee-8f19-45a6-88e9-801059d3566e tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] [instance: 419a7ac0-9332-481d-bc66-3ad5b6a9db81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:52:14.846867 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f3bc93ee-8f19-45a6-88e9-801059d3566e tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.520687 Oct 17 13:52:14.859019 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1943/3832] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:52:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 13:52:14.865330 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-aa4839b7-dc16-460c-8b56-5c821ed476b3 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:14.866167 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-aa4839b7-dc16-460c-8b56-5c821ed476b3 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] [instance: 531b762d-db7e-4911-af50-6b321b7706bf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:14.873109 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aa4839b7-dc16-460c-8b56-5c821ed476b3 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:14.873953 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aa4839b7-dc16-460c-8b56-5c821ed476b3 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:14.875115 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aa4839b7-dc16-460c-8b56-5c821ed476b3 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:14.876097 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aa4839b7-dc16-460c-8b56-5c821ed476b3 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:14.876745 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aa4839b7-dc16-460c-8b56-5c821ed476b3 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:14.877352 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aa4839b7-dc16-460c-8b56-5c821ed476b3 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:15.209587 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9de069f0-f52d-4ce3-9a57-6dc916abb6b3 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "POST /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.721023 Oct 17 13:52:15.215886 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1890/3833] 10.222.0.79 () {60 vars in 1323 bytes} [Mon Oct 17 13:52:06 2022] POST /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5/os-volume_attachments => generated 194 bytes in 8723 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:52:15.219414 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-30b7f114-c01a-4a48-845d-012bbcceb938 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:15.221880 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-30b7f114-c01a-4a48-845d-012bbcceb938 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:15.240774 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-30b7f114-c01a-4a48-845d-012bbcceb938 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:15.241509 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-30b7f114-c01a-4a48-845d-012bbcceb938 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:15.242080 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-30b7f114-c01a-4a48-845d-012bbcceb938 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:15.242925 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-30b7f114-c01a-4a48-845d-012bbcceb938 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:15.247735 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-30b7f114-c01a-4a48-845d-012bbcceb938 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:15.248375 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-30b7f114-c01a-4a48-845d-012bbcceb938 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:15.311771 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-30b7f114-c01a-4a48-845d-012bbcceb938 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.099699 Oct 17 13:52:15.325295 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1891/3834] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 13:52:15 2022] GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e/os-volume_attachments => generated 25 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:52:15.331724 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3f088764-a5a5-4cb7-b1a4-c0568b51e42f tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-2042682352", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:52:15.452457 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-3f088764-a5a5-4cb7-b1a4-c0568b51e42f tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] validate_networks() for None {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:52:15.691427 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-aa4839b7-dc16-460c-8b56-5c821ed476b3 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:15.705715 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-aa4839b7-dc16-460c-8b56-5c821ed476b3 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:15.707745 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-aa4839b7-dc16-460c-8b56-5c821ed476b3 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:15.709138 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-aa4839b7-dc16-460c-8b56-5c821ed476b3 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] 10.222.0.79 "GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf" status: 200 len: 1604 microversion: 2.42 time: 0.848699 Oct 17 13:52:15.710021 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1944/3835] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:52:14 2022] GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf => generated 1604 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:52:15.726140 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4fd9511d-3bc3-41fa-91a9-2dfb7ef6a06a tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:15.729324 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4fd9511d-3bc3-41fa-91a9-2dfb7ef6a06a tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:15.749876 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4fd9511d-3bc3-41fa-91a9-2dfb7ef6a06a tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:15.750916 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4fd9511d-3bc3-41fa-91a9-2dfb7ef6a06a tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:15.753538 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4fd9511d-3bc3-41fa-91a9-2dfb7ef6a06a tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:15.756127 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4fd9511d-3bc3-41fa-91a9-2dfb7ef6a06a tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:15.758350 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4fd9511d-3bc3-41fa-91a9-2dfb7ef6a06a tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:15.759756 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4fd9511d-3bc3-41fa-91a9-2dfb7ef6a06a tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:15.841184 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4fd9511d-3bc3-41fa-91a9-2dfb7ef6a06a tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:52:15.985954 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-3f088764-a5a5-4cb7-b1a4-c0568b51e42f tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:52:15.986439 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-3f088764-a5a5-4cb7-b1a4-c0568b51e42f tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:52:15.986936 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-3f088764-a5a5-4cb7-b1a4-c0568b51e42f tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:52:15.987373 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-3f088764-a5a5-4cb7-b1a4-c0568b51e42f tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:52:15.987790 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-3f088764-a5a5-4cb7-b1a4-c0568b51e42f tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:52:16.003046 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4fd9511d-3bc3-41fa-91a9-2dfb7ef6a06a tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "DELETE /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e" status: 204 len: 0 microversion: 2.1 time: 0.290810 Oct 17 13:52:16.005586 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1945/3836] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:52:15 2022] DELETE /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:52:16.022871 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d38e6cba-b818-4d40-b760-a85b8e6d04b5 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:16.025034 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f088764-a5a5-4cb7-b1a4-c0568b51e42f tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:16.029138 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f088764-a5a5-4cb7-b1a4-c0568b51e42f tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:16.030230 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d38e6cba-b818-4d40-b760-a85b8e6d04b5 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:16.032805 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f088764-a5a5-4cb7-b1a4-c0568b51e42f tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:16.038352 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f088764-a5a5-4cb7-b1a4-c0568b51e42f tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:16.039113 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f088764-a5a5-4cb7-b1a4-c0568b51e42f tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:16.042534 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f088764-a5a5-4cb7-b1a4-c0568b51e42f tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:16.058864 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d38e6cba-b818-4d40-b760-a85b8e6d04b5 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:16.060756 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d38e6cba-b818-4d40-b760-a85b8e6d04b5 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:16.063742 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d38e6cba-b818-4d40-b760-a85b8e6d04b5 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:16.065029 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d38e6cba-b818-4d40-b760-a85b8e6d04b5 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:16.068790 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d38e6cba-b818-4d40-b760-a85b8e6d04b5 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:16.069622 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d38e6cba-b818-4d40-b760-a85b8e6d04b5 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:16.127884 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-3f088764-a5a5-4cb7-b1a4-c0568b51e42f tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Getting quotas for project 8fb1624a35d0403c9e5d09a17e79b7fb. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:52:16.157654 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-3f088764-a5a5-4cb7-b1a4-c0568b51e42f tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Getting quotas for user 79bfe589d0784bfc8ed1611c71cd4461 and project 8fb1624a35d0403c9e5d09a17e79b7fb. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:52:16.193838 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3f088764-a5a5-4cb7-b1a4-c0568b51e42f tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:52:16.196805 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3f088764-a5a5-4cb7-b1a4-c0568b51e42f tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] [instance: 5fea9fdd-bc16-4923-bbf8-e0909cd3bcda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:52:16.276117 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3f088764-a5a5-4cb7-b1a4-c0568b51e42f tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.949502 Oct 17 13:52:16.278222 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1892/3837] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:52:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 952 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:52:16.308521 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4b3f67e9-76ce-4664-83ca-acde85865886 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:16.312068 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4b3f67e9-76ce-4664-83ca-acde85865886 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] [instance: 5fea9fdd-bc16-4923-bbf8-e0909cd3bcda] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:16.449170 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4b3f67e9-76ce-4664-83ca-acde85865886 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bfe589d0784bfc8ed1611c71cd4461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb1624a35d0403c9e5d09a17e79b7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:16.460019 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d38e6cba-b818-4d40-b760-a85b8e6d04b5 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:16.461566 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4b3f67e9-76ce-4664-83ca-acde85865886 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/servers/5fea9fdd-bc16-4923-bbf8-e0909cd3bcda" status: 200 len: 1218 microversion: 2.1 time: 0.162605 Oct 17 13:52:16.475203 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1893/3838] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:16 2022] GET /compute/v2.1/servers/5fea9fdd-bc16-4923-bbf8-e0909cd3bcda => generated 1218 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:16.475650 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d38e6cba-b818-4d40-b760-a85b8e6d04b5 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e" status: 200 len: 1683 microversion: 2.1 time: 0.457277 Oct 17 13:52:16.475650 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1946/3839] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:16 2022] GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e => generated 1683 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:16.741405 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bf7a9d00-38d1-44b5-9f85-de84a6a8d58c tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:16.742234 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-bf7a9d00-38d1-44b5-9f85-de84a6a8d58c tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] [instance: 531b762d-db7e-4911-af50-6b321b7706bf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:16.756066 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bf7a9d00-38d1-44b5-9f85-de84a6a8d58c tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:16.758498 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bf7a9d00-38d1-44b5-9f85-de84a6a8d58c tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:16.759260 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bf7a9d00-38d1-44b5-9f85-de84a6a8d58c tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:16.768121 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bf7a9d00-38d1-44b5-9f85-de84a6a8d58c tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:16.768908 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bf7a9d00-38d1-44b5-9f85-de84a6a8d58c tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:16.774881 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bf7a9d00-38d1-44b5-9f85-de84a6a8d58c tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:17.176070 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-bf7a9d00-38d1-44b5-9f85-de84a6a8d58c tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:17.192973 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-bf7a9d00-38d1-44b5-9f85-de84a6a8d58c tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:17.195085 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-bf7a9d00-38d1-44b5-9f85-de84a6a8d58c tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:17.199376 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-bf7a9d00-38d1-44b5-9f85-de84a6a8d58c tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] 10.222.0.79 "GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf" status: 200 len: 1604 microversion: 2.42 time: 0.462966 Oct 17 13:52:17.221277 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1894/3840] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:52:16 2022] GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf => generated 1604 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:52:17.494654 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d7c5dfb9-e55c-423f-8ea6-8d31c3d4898e tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:17.497579 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8905ed6c-f15c-470b-b61f-2d8b3399abde tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:17.498985 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d7c5dfb9-e55c-423f-8ea6-8d31c3d4898e tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:17.501136 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8905ed6c-f15c-470b-b61f-2d8b3399abde tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] [instance: 5fea9fdd-bc16-4923-bbf8-e0909cd3bcda] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:17.537237 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d7c5dfb9-e55c-423f-8ea6-8d31c3d4898e tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:17.537880 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d7c5dfb9-e55c-423f-8ea6-8d31c3d4898e tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:17.538332 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d7c5dfb9-e55c-423f-8ea6-8d31c3d4898e tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:17.540732 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8905ed6c-f15c-470b-b61f-2d8b3399abde tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:17.541231 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8905ed6c-f15c-470b-b61f-2d8b3399abde tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:17.541714 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8905ed6c-f15c-470b-b61f-2d8b3399abde tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:17.542394 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8905ed6c-f15c-470b-b61f-2d8b3399abde tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:17.543019 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8905ed6c-f15c-470b-b61f-2d8b3399abde tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:17.543477 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8905ed6c-f15c-470b-b61f-2d8b3399abde tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:17.549762 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d7c5dfb9-e55c-423f-8ea6-8d31c3d4898e tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:17.550261 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d7c5dfb9-e55c-423f-8ea6-8d31c3d4898e tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:17.550704 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d7c5dfb9-e55c-423f-8ea6-8d31c3d4898e tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:17.779323 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8905ed6c-f15c-470b-b61f-2d8b3399abde tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bfe589d0784bfc8ed1611c71cd4461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb1624a35d0403c9e5d09a17e79b7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:17.792318 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8905ed6c-f15c-470b-b61f-2d8b3399abde tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/servers/5fea9fdd-bc16-4923-bbf8-e0909cd3bcda" status: 200 len: 1214 microversion: 2.1 time: 0.306162 Oct 17 13:52:17.801023 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1947/3841] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:17 2022] GET /compute/v2.1/servers/5fea9fdd-bc16-4923-bbf8-e0909cd3bcda => generated 1214 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:18.016107 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d7c5dfb9-e55c-423f-8ea6-8d31c3d4898e tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:18.025804 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d7c5dfb9-e55c-423f-8ea6-8d31c3d4898e tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e" status: 200 len: 1683 microversion: 2.1 time: 0.535327 Oct 17 13:52:18.028217 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1895/3842] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:17 2022] GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e => generated 1683 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:18.238381 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e0a37766-72d7-4a95-8cdc-ced683105d42 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:18.239982 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e0a37766-72d7-4a95-8cdc-ced683105d42 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] [instance: 531b762d-db7e-4911-af50-6b321b7706bf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:18.250965 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e0a37766-72d7-4a95-8cdc-ced683105d42 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:18.252581 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e0a37766-72d7-4a95-8cdc-ced683105d42 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:18.253243 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e0a37766-72d7-4a95-8cdc-ced683105d42 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:18.254342 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e0a37766-72d7-4a95-8cdc-ced683105d42 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:18.256436 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e0a37766-72d7-4a95-8cdc-ced683105d42 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:18.257110 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e0a37766-72d7-4a95-8cdc-ced683105d42 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:18.286369 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:52:18.488369 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e0a37766-72d7-4a95-8cdc-ced683105d42 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:18.507536 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e0a37766-72d7-4a95-8cdc-ced683105d42 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:18.509197 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e0a37766-72d7-4a95-8cdc-ced683105d42 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:18.510642 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e0a37766-72d7-4a95-8cdc-ced683105d42 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] 10.222.0.79 "GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf" status: 200 len: 1604 microversion: 2.42 time: 0.281180 Oct 17 13:52:18.513349 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1948/3843] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:52:18 2022] GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf => generated 1604 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:52:18.825937 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3dbb20b2-3f82-4ee5-95c4-537d7abea062 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:18.828392 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3dbb20b2-3f82-4ee5-95c4-537d7abea062 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] [instance: 5fea9fdd-bc16-4923-bbf8-e0909cd3bcda] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:18.843556 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3dbb20b2-3f82-4ee5-95c4-537d7abea062 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:18.845211 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3dbb20b2-3f82-4ee5-95c4-537d7abea062 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:18.847017 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3dbb20b2-3f82-4ee5-95c4-537d7abea062 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:18.859605 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3dbb20b2-3f82-4ee5-95c4-537d7abea062 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:18.860628 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3dbb20b2-3f82-4ee5-95c4-537d7abea062 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:18.861493 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3dbb20b2-3f82-4ee5-95c4-537d7abea062 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:18.990052 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3dbb20b2-3f82-4ee5-95c4-537d7abea062 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bfe589d0784bfc8ed1611c71cd4461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb1624a35d0403c9e5d09a17e79b7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:19.002546 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3dbb20b2-3f82-4ee5-95c4-537d7abea062 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/servers/5fea9fdd-bc16-4923-bbf8-e0909cd3bcda" status: 200 len: 1276 microversion: 2.1 time: 0.179607 Oct 17 13:52:19.003205 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1896/3844] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:18 2022] GET /compute/v2.1/servers/5fea9fdd-bc16-4923-bbf8-e0909cd3bcda => generated 1276 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:19.050014 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-83dc13c0-435c-41cf-bbff-789d58e82089 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:19.051011 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-83dc13c0-435c-41cf-bbff-789d58e82089 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:19.058770 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-83dc13c0-435c-41cf-bbff-789d58e82089 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:19.059508 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-83dc13c0-435c-41cf-bbff-789d58e82089 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:19.060160 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-83dc13c0-435c-41cf-bbff-789d58e82089 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:19.061333 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-83dc13c0-435c-41cf-bbff-789d58e82089 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:19.062076 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-83dc13c0-435c-41cf-bbff-789d58e82089 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:19.062798 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-83dc13c0-435c-41cf-bbff-789d58e82089 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:19.266570 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-83dc13c0-435c-41cf-bbff-789d58e82089 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:19.274528 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-83dc13c0-435c-41cf-bbff-789d58e82089 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e" status: 200 len: 1683 microversion: 2.1 time: 0.228407 Oct 17 13:52:19.290755 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1949/3845] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:19 2022] GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e => generated 1683 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:19.547372 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-61162175-c972-4df7-a535-4eb18e344e26 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:19.548790 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-61162175-c972-4df7-a535-4eb18e344e26 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] [instance: 531b762d-db7e-4911-af50-6b321b7706bf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:19.563805 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-61162175-c972-4df7-a535-4eb18e344e26 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:19.565985 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-61162175-c972-4df7-a535-4eb18e344e26 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:19.569532 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-61162175-c972-4df7-a535-4eb18e344e26 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:19.571591 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-61162175-c972-4df7-a535-4eb18e344e26 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:19.573052 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-61162175-c972-4df7-a535-4eb18e344e26 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:19.573804 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-61162175-c972-4df7-a535-4eb18e344e26 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:19.616572 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:52:19.684347 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-61162175-c972-4df7-a535-4eb18e344e26 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:19.700069 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-61162175-c972-4df7-a535-4eb18e344e26 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:19.704525 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-61162175-c972-4df7-a535-4eb18e344e26 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:19.706886 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-61162175-c972-4df7-a535-4eb18e344e26 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] 10.222.0.79 "GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf" status: 200 len: 1604 microversion: 2.42 time: 0.168015 Oct 17 13:52:19.709333 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1897/3846] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:52:19 2022] GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf => generated 1604 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:52:19.847541 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-455e16cf-6b38-4a0b-9926-6dd668d9ef7d req-320bfbbb-4beb-4462-9b73-f6207d597899 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "419a7ac0-9332-481d-bc66-3ad5b6a9db81", "tag": "8c4e8542-c161-4443-8115-64e41c66a3fe"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:52:19.862438 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-455e16cf-6b38-4a0b-9926-6dd668d9ef7d req-320bfbbb-4beb-4462-9b73-f6207d597899 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:19.863345 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-455e16cf-6b38-4a0b-9926-6dd668d9ef7d req-320bfbbb-4beb-4462-9b73-f6207d597899 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:19.863923 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-455e16cf-6b38-4a0b-9926-6dd668d9ef7d req-320bfbbb-4beb-4462-9b73-f6207d597899 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:19.882233 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-455e16cf-6b38-4a0b-9926-6dd668d9ef7d req-320bfbbb-4beb-4462-9b73-f6207d597899 service nova] Creating event network-changed:8c4e8542-c161-4443-8115-64e41c66a3fe for instance 419a7ac0-9332-481d-bc66-3ad5b6a9db81 on n-h2-854247-14 Oct 17 13:52:19.888161 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-455e16cf-6b38-4a0b-9926-6dd668d9ef7d req-320bfbbb-4beb-4462-9b73-f6207d597899 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048918 Oct 17 13:52:19.889822 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1950/3847] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:52:20.028232 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-89e42b47-ff26-441d-976a-a2a4822e48f2 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:20.029122 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-89e42b47-ff26-441d-976a-a2a4822e48f2 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] [instance: 5fea9fdd-bc16-4923-bbf8-e0909cd3bcda] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:20.040348 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-89e42b47-ff26-441d-976a-a2a4822e48f2 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:20.040948 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-89e42b47-ff26-441d-976a-a2a4822e48f2 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:20.041480 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-89e42b47-ff26-441d-976a-a2a4822e48f2 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:20.042344 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-89e42b47-ff26-441d-976a-a2a4822e48f2 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:20.042832 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-89e42b47-ff26-441d-976a-a2a4822e48f2 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:20.043491 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-89e42b47-ff26-441d-976a-a2a4822e48f2 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:20.140987 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-89e42b47-ff26-441d-976a-a2a4822e48f2 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bfe589d0784bfc8ed1611c71cd4461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb1624a35d0403c9e5d09a17e79b7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:20.152528 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-89e42b47-ff26-441d-976a-a2a4822e48f2 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/servers/5fea9fdd-bc16-4923-bbf8-e0909cd3bcda" status: 200 len: 1276 microversion: 2.1 time: 0.130150 Oct 17 13:52:20.153372 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1898/3848] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:20 2022] GET /compute/v2.1/servers/5fea9fdd-bc16-4923-bbf8-e0909cd3bcda => generated 1276 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:20.298988 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2bc47dc4-15d7-4fac-b11b-eea785479282 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:20.299737 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2bc47dc4-15d7-4fac-b11b-eea785479282 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:20.313589 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2bc47dc4-15d7-4fac-b11b-eea785479282 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:20.319640 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2bc47dc4-15d7-4fac-b11b-eea785479282 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:20.320299 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2bc47dc4-15d7-4fac-b11b-eea785479282 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:20.325654 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2bc47dc4-15d7-4fac-b11b-eea785479282 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:20.326302 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2bc47dc4-15d7-4fac-b11b-eea785479282 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:20.327001 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2bc47dc4-15d7-4fac-b11b-eea785479282 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:20.439624 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-a534128b-397c-4ae7-94a8-03d55b07fc96 req-6b6d5284-69e7-4bd6-92cd-971be89386ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e", "name": "network-vif-deleted", "tag": "8cc688d9-f7d0-40a2-ad9e-33689003bb82"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:52:20.470714 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-a534128b-397c-4ae7-94a8-03d55b07fc96 req-6b6d5284-69e7-4bd6-92cd-971be89386ce service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:20.473713 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-a534128b-397c-4ae7-94a8-03d55b07fc96 req-6b6d5284-69e7-4bd6-92cd-971be89386ce service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:20.474218 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-a534128b-397c-4ae7-94a8-03d55b07fc96 req-6b6d5284-69e7-4bd6-92cd-971be89386ce service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:20.501197 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-a534128b-397c-4ae7-94a8-03d55b07fc96 req-6b6d5284-69e7-4bd6-92cd-971be89386ce service nova] Creating event network-vif-deleted:8cc688d9-f7d0-40a2-ad9e-33689003bb82 for instance 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e on n-h1-854247-14 Oct 17 13:52:20.513333 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-a534128b-397c-4ae7-94a8-03d55b07fc96 req-6b6d5284-69e7-4bd6-92cd-971be89386ce service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077616 Oct 17 13:52:20.519194 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1899/3849] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:52:20.612508 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2bc47dc4-15d7-4fac-b11b-eea785479282 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:20.626001 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2bc47dc4-15d7-4fac-b11b-eea785479282 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e" status: 200 len: 1615 microversion: 2.1 time: 0.331739 Oct 17 13:52:20.631997 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1951/3850] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:20 2022] GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e => generated 1615 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:20.737466 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8f1546e5-2650-477d-bdfa-176d29c696cc tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:20.738190 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8f1546e5-2650-477d-bdfa-176d29c696cc tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] [instance: 531b762d-db7e-4911-af50-6b321b7706bf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:20.758486 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8f1546e5-2650-477d-bdfa-176d29c696cc tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:20.774167 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8f1546e5-2650-477d-bdfa-176d29c696cc tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:20.775969 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8f1546e5-2650-477d-bdfa-176d29c696cc tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:20.776767 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8f1546e5-2650-477d-bdfa-176d29c696cc tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:20.777247 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8f1546e5-2650-477d-bdfa-176d29c696cc tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:20.777675 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8f1546e5-2650-477d-bdfa-176d29c696cc tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:21.176742 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4e7e790f-3c0d-47fa-9ee3-46f7f1d1632f tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:21.177969 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4e7e790f-3c0d-47fa-9ee3-46f7f1d1632f tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] [instance: 5fea9fdd-bc16-4923-bbf8-e0909cd3bcda] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:21.190905 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4e7e790f-3c0d-47fa-9ee3-46f7f1d1632f tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:21.195989 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4e7e790f-3c0d-47fa-9ee3-46f7f1d1632f tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:21.201848 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4e7e790f-3c0d-47fa-9ee3-46f7f1d1632f tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:21.203572 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4e7e790f-3c0d-47fa-9ee3-46f7f1d1632f tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:21.204381 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4e7e790f-3c0d-47fa-9ee3-46f7f1d1632f tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:21.205089 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4e7e790f-3c0d-47fa-9ee3-46f7f1d1632f tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:21.453222 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8f1546e5-2650-477d-bdfa-176d29c696cc tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:21.469370 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8f1546e5-2650-477d-bdfa-176d29c696cc tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:21.470805 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8f1546e5-2650-477d-bdfa-176d29c696cc tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:21.472039 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8f1546e5-2650-477d-bdfa-176d29c696cc tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] 10.222.0.79 "GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf" status: 200 len: 1604 microversion: 2.42 time: 0.741685 Oct 17 13:52:21.479504 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1900/3851] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:52:20 2022] GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf => generated 1604 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:52:21.649532 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8fc29b83-6d27-4fc1-8466-b9ea5a92c176 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:21.650052 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8fc29b83-6d27-4fc1-8466-b9ea5a92c176 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:21.653768 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4e7e790f-3c0d-47fa-9ee3-46f7f1d1632f tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bfe589d0784bfc8ed1611c71cd4461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb1624a35d0403c9e5d09a17e79b7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:21.656693 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8fc29b83-6d27-4fc1-8466-b9ea5a92c176 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:21.657178 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8fc29b83-6d27-4fc1-8466-b9ea5a92c176 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:21.657615 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8fc29b83-6d27-4fc1-8466-b9ea5a92c176 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:21.658314 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8fc29b83-6d27-4fc1-8466-b9ea5a92c176 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:21.658755 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8fc29b83-6d27-4fc1-8466-b9ea5a92c176 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:21.659388 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8fc29b83-6d27-4fc1-8466-b9ea5a92c176 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:21.662498 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4e7e790f-3c0d-47fa-9ee3-46f7f1d1632f tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/servers/5fea9fdd-bc16-4923-bbf8-e0909cd3bcda" status: 200 len: 1318 microversion: 2.1 time: 0.491274 Oct 17 13:52:21.678783 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1952/3852] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:21 2022] GET /compute/v2.1/servers/5fea9fdd-bc16-4923-bbf8-e0909cd3bcda => generated 1318 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:52:21.695414 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-8fc29b83-6d27-4fc1-8466-b9ea5a92c176 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] HTTP exception thrown: Instance 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e could not be found. Oct 17 13:52:21.697383 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8fc29b83-6d27-4fc1-8466-b9ea5a92c176 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Request method failure captured: Oct 17 13:52:21.697383 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e HTTP/1.1 Oct 17 13:52:21.697383 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:52:21.697383 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:52:21.697383 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:52:21.697383 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:52:21.697383 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:52:21.697383 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:52:21.697383 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:52:21.697383 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:52:21.697383 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTV0JL7NQSDQqh4ZMvkCDXT2fwovcCgk-nxK1nRG4B-HeC5OA7y2_TQv_yPRGTaQ-3zvHufQBJMrO1ZhsIWZZ0ugPMuvlokQmhLWi-H9zySFSYK0iM1qNABohwKQ4S7v-F2ZGFUB1jMKnP05ShlKiL4M8_7Jns7W8GDQtoUfjwQ0M1Lk Oct 17 13:52:21.697383 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:52:21.697383 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:52:21.697383 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:52:21.697383 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:52:21.697383 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:52:21.697383 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:52:21.697383 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 4acd31ce63b64ac3a05b76d4a9fdf7c0 Oct 17 13:52:21.697383 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-AttachVolumeNegativeTest-1792618646 Oct 17 13:52:21.697383 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:52:21.697383 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:52:21.697383 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4acd31ce63b64ac3a05b76d4a9fdf7c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4acd31ce63b64ac3a05b76d4a9fdf7c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4acd31ce63b64ac3a05b76d4a9fdf7c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4acd31ce63b64ac3a05b76d4a9fdf7c0", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:52:21.697383 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-AttachVolumeNegativeTest-1792618646 Oct 17 13:52:21.697383 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 4acd31ce63b64ac3a05b76d4a9fdf7c0 Oct 17 13:52:21.697383 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1792618646 Oct 17 13:52:21.697383 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-AttachVolumeNegativeTest-1792618646-project Oct 17 13:52:21.697383 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:52:21.697383 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:52:21.697383 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: c7a7b9b048234fd2926739e3f08400b0 Oct 17 13:52:21.697383 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-AttachVolumeNegativeTest-1792618646-project Oct 17 13:52:21.697383 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:52:21.697383 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e could not be found. Oct 17 13:52:21.697383 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e'} Oct 17 13:52:21.697383 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:52:21.697383 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:52:21.697383 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:52:21.697383 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:52:21.697383 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:52:21.697383 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:52:21.697383 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:52:21.697383 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:52:21.697383 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:52:21.697383 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:52:21.697383 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e could not be found. Oct 17 13:52:21.697383 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:52:21.697383 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:52:21.697383 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:52:21.697383 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:52:21.697383 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:52:21.697383 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:52:21.697383 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:52:21.697383 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:52:21.697383 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:52:21.697383 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:52:21.697383 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:52:21.697383 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:52:21.697383 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:52:21.697383 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:52:21.697383 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:52:21.697383 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:52:21.697383 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e could not be found. Oct 17 13:52:21.697383 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:52:21.697383 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:52:21.697383 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:52:21.703685 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:52:21.703685 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:52:21.703685 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:52:21.703685 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:52:21.703685 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:52:21.703685 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e could not be found. Oct 17 13:52:21.703685 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:52:21.703685 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8fc29b83-6d27-4fc1-8466-b9ea5a92c176 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Returning 404 to user: Instance 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:52:21.703685 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8fc29b83-6d27-4fc1-8466-b9ea5a92c176 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e" status: 404 len: 111 microversion: 2.1 time: 0.053480 Oct 17 13:52:21.703685 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1901/3853] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:21 2022] GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:52:21.708658 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4b3e0b55-c58b-454c-950d-da21610ad319 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '.version_select at 0x7f7cd53fbee0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:21.781841 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4b3e0b55-c58b-454c-950d-da21610ad319 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1556615056" status: 202 len: 0 microversion: 2.1 time: 0.077238 Oct 17 13:52:21.782522 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1953/3854] 10.222.0.79 () {58 vars in 1221 bytes} [Mon Oct 17 13:52:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1556615056 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:52:22.352105 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-16087033-5dbb-4306-8abc-c33ffd7aa3ba tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:22.352961 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-16087033-5dbb-4306-8abc-c33ffd7aa3ba tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:22.367422 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-16087033-5dbb-4306-8abc-c33ffd7aa3ba tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:22.368191 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-16087033-5dbb-4306-8abc-c33ffd7aa3ba tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:22.370766 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-16087033-5dbb-4306-8abc-c33ffd7aa3ba tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:22.372872 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-16087033-5dbb-4306-8abc-c33ffd7aa3ba tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:22.378584 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-16087033-5dbb-4306-8abc-c33ffd7aa3ba tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:22.379489 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-16087033-5dbb-4306-8abc-c33ffd7aa3ba tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:22.502554 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7efe577a-54b4-438b-8852-3a48d91dbbf9 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:22.503382 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7efe577a-54b4-438b-8852-3a48d91dbbf9 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] [instance: 531b762d-db7e-4911-af50-6b321b7706bf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:22.525633 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7efe577a-54b4-438b-8852-3a48d91dbbf9 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:22.527282 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7efe577a-54b4-438b-8852-3a48d91dbbf9 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:22.528977 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7efe577a-54b4-438b-8852-3a48d91dbbf9 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:22.530272 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7efe577a-54b4-438b-8852-3a48d91dbbf9 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:22.531765 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7efe577a-54b4-438b-8852-3a48d91dbbf9 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:22.533578 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7efe577a-54b4-438b-8852-3a48d91dbbf9 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:22.583406 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7efe577a-54b4-438b-8852-3a48d91dbbf9 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:22.584318 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7efe577a-54b4-438b-8852-3a48d91dbbf9 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:22.584943 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7efe577a-54b4-438b-8852-3a48d91dbbf9 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:22.585588 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-7efe577a-54b4-438b-8852-3a48d91dbbf9 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lazy-loading 'fault' on Instance uuid 531b762d-db7e-4911-af50-6b321b7706bf {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:52:22.695902 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7efe577a-54b4-438b-8852-3a48d91dbbf9 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:22.725103 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7efe577a-54b4-438b-8852-3a48d91dbbf9 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:22.729688 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7efe577a-54b4-438b-8852-3a48d91dbbf9 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5670d6402d734aa9b1200a337000839d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '114d3f1fdbf74c649b48882f8aa177f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:22.733206 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7efe577a-54b4-438b-8852-3a48d91dbbf9 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] 10.222.0.79 "GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf" status: 200 len: 1609 microversion: 2.42 time: 0.234622 Oct 17 13:52:22.736208 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1954/3855] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:52:22 2022] GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf => generated 1609 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:52:22.763402 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-094a1594-9e2e-43cf-918c-f772f165f163 req-b313e6f9-ef87-430f-b9ba-ae0fcc0b6b5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fea9fdd-bc16-4923-bbf8-e0909cd3bcda", "tag": "9a6b33a5-082e-4c10-8994-0c42a775e094"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:52:22.785903 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-094a1594-9e2e-43cf-918c-f772f165f163 req-b313e6f9-ef87-430f-b9ba-ae0fcc0b6b5a service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:22.787395 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-094a1594-9e2e-43cf-918c-f772f165f163 req-b313e6f9-ef87-430f-b9ba-ae0fcc0b6b5a service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:22.788064 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-094a1594-9e2e-43cf-918c-f772f165f163 req-b313e6f9-ef87-430f-b9ba-ae0fcc0b6b5a service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:22.832535 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-094a1594-9e2e-43cf-918c-f772f165f163 req-b313e6f9-ef87-430f-b9ba-ae0fcc0b6b5a service nova] Creating event network-changed:9a6b33a5-082e-4c10-8994-0c42a775e094 for instance 5fea9fdd-bc16-4923-bbf8-e0909cd3bcda on n-h1-854247-14 Oct 17 13:52:22.852671 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-094a1594-9e2e-43cf-918c-f772f165f163 req-b313e6f9-ef87-430f-b9ba-ae0fcc0b6b5a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113840 Oct 17 13:52:22.853322 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1955/3856] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:52:22.872837 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d0576f66-76f5-4048-baaa-710458cc753b tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:22.876605 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d0576f66-76f5-4048-baaa-710458cc753b tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] [instance: 5fea9fdd-bc16-4923-bbf8-e0909cd3bcda] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:22.907574 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d0576f66-76f5-4048-baaa-710458cc753b tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:22.910548 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d0576f66-76f5-4048-baaa-710458cc753b tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:22.912164 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d0576f66-76f5-4048-baaa-710458cc753b tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:22.914263 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d0576f66-76f5-4048-baaa-710458cc753b tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:22.916420 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d0576f66-76f5-4048-baaa-710458cc753b tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:22.917985 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d0576f66-76f5-4048-baaa-710458cc753b tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:23.063335 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-16087033-5dbb-4306-8abc-c33ffd7aa3ba tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:23.083390 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-16087033-5dbb-4306-8abc-c33ffd7aa3ba tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1666 microversion: 2.1 time: 0.726609 Oct 17 13:52:23.084045 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1902/3857] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:22 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1666 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:23.108533 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-01083f64-4a5e-4c74-9f74-72871a72df32 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:23.109400 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-01083f64-4a5e-4c74-9f74-72871a72df32 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:23.119914 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-01083f64-4a5e-4c74-9f74-72871a72df32 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:23.120661 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-01083f64-4a5e-4c74-9f74-72871a72df32 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:23.121409 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-01083f64-4a5e-4c74-9f74-72871a72df32 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:23.122312 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-01083f64-4a5e-4c74-9f74-72871a72df32 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:23.122902 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-01083f64-4a5e-4c74-9f74-72871a72df32 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:23.123610 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-01083f64-4a5e-4c74-9f74-72871a72df32 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:23.396709 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d0576f66-76f5-4048-baaa-710458cc753b tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bfe589d0784bfc8ed1611c71cd4461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb1624a35d0403c9e5d09a17e79b7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:23.407873 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d0576f66-76f5-4048-baaa-710458cc753b tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/servers/5fea9fdd-bc16-4923-bbf8-e0909cd3bcda" status: 200 len: 1318 microversion: 2.1 time: 0.542951 Oct 17 13:52:23.409352 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1956/3858] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:22 2022] GET /compute/v2.1/servers/5fea9fdd-bc16-4923-bbf8-e0909cd3bcda => generated 1318 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:23.421745 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-01083f64-4a5e-4c74-9f74-72871a72df32 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:23.429987 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-01083f64-4a5e-4c74-9f74-72871a72df32 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1666 microversion: 2.1 time: 0.325635 Oct 17 13:52:23.431146 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1903/3859] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:23 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1666 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:23.454178 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9f0254f9-ccb0-43db-904c-47d76b84c593 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:23.455069 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9f0254f9-ccb0-43db-904c-47d76b84c593 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:23.461427 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9f0254f9-ccb0-43db-904c-47d76b84c593 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:23.462142 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9f0254f9-ccb0-43db-904c-47d76b84c593 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:23.462728 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9f0254f9-ccb0-43db-904c-47d76b84c593 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:23.463615 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9f0254f9-ccb0-43db-904c-47d76b84c593 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:23.464219 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9f0254f9-ccb0-43db-904c-47d76b84c593 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:23.464792 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9f0254f9-ccb0-43db-904c-47d76b84c593 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:23.680351 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e6c97542-7adb-4039-97b4-c2fd4c4ed418 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Action: 'create', calling method: .version_select at 0x7f7cd4744430>, body: {"keypair": {"name": "tempest-keypair-344482103", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCyfkFyQkPFbkEUfq+R3lit5+2RhNUuyb7ALSd/ueKnEFHFkLBpwv1bZQgTxgnI736ajzrxTJy1o+K05/JUSyKwhmnK/zf9XR1giZ1FRGcJV9NKHUlWis2AKBy3O4jjFpg=="}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:52:23.698128 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-e6c97542-7adb-4039-97b4-c2fd4c4ed418 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Getting quotas for project 4acd31ce63b64ac3a05b76d4a9fdf7c0. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:52:23.705128 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-e6c97542-7adb-4039-97b4-c2fd4c4ed418 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Getting quotas for user c7a7b9b048234fd2926739e3f08400b0 and project 4acd31ce63b64ac3a05b76d4a9fdf7c0. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:52:23.712038 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9f0254f9-ccb0-43db-904c-47d76b84c593 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:23.725960 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9f0254f9-ccb0-43db-904c-47d76b84c593 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1666 microversion: 2.1 time: 0.275779 Oct 17 13:52:23.727220 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1957/3860] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:23 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1666 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:23.753877 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-80c136f7-03e4-4f0d-8791-ba73c43aaa47 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-383451452"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:52:23.757277 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-80c136f7-03e4-4f0d-8791-ba73c43aaa47 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:23.765492 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e6c97542-7adb-4039-97b4-c2fd4c4ed418 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.089146 Oct 17 13:52:23.769149 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1904/3861] 10.222.0.79 () {60 vars in 1159 bytes} [Mon Oct 17 13:52:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:52:23.777401 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-80c136f7-03e4-4f0d-8791-ba73c43aaa47 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:23.778612 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-80c136f7-03e4-4f0d-8791-ba73c43aaa47 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:23.779339 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-80c136f7-03e4-4f0d-8791-ba73c43aaa47 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:23.780455 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-80c136f7-03e4-4f0d-8791-ba73c43aaa47 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:23.781199 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-80c136f7-03e4-4f0d-8791-ba73c43aaa47 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:23.782566 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ceb5eca8-4c69-4eea-b2f6-602fc3712c52 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:23.783588 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-80c136f7-03e4-4f0d-8791-ba73c43aaa47 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:23.786422 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ceb5eca8-4c69-4eea-b2f6-602fc3712c52 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] [instance: 531b762d-db7e-4911-af50-6b321b7706bf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:23.804555 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ceb5eca8-4c69-4eea-b2f6-602fc3712c52 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:23.805545 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ceb5eca8-4c69-4eea-b2f6-602fc3712c52 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:23.806205 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ceb5eca8-4c69-4eea-b2f6-602fc3712c52 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:23.807247 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ceb5eca8-4c69-4eea-b2f6-602fc3712c52 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:23.809058 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ceb5eca8-4c69-4eea-b2f6-602fc3712c52 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:23.810413 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ceb5eca8-4c69-4eea-b2f6-602fc3712c52 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:23.833918 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-ceb5eca8-4c69-4eea-b2f6-602fc3712c52 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] HTTP exception thrown: Instance 531b762d-db7e-4911-af50-6b321b7706bf could not be found. Oct 17 13:52:23.836182 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ceb5eca8-4c69-4eea-b2f6-602fc3712c52 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Request method failure captured: Oct 17 13:52:23.836182 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf HTTP/1.1 Oct 17 13:52:23.836182 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:52:23.836182 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:52:23.836182 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:52:23.836182 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:52:23.836182 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:52:23.836182 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:52:23.836182 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:52:23.836182 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:52:23.836182 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVyM0Y-slKGat2PStw0CDPgT4JAtNVW3ev8WmnmahhGjNqt158NKsdoBiFyH2UplWsyfguEQ9LeevADYmex-PV4fmwPLXORsXqFX7-c2lf_oA2fe9Badk8AXSJ0eLyo9jalHDf_Osir_PWsa_UbGjlVDwERuId6OWHOYEjP_boFUDfQ Oct 17 13:52:23.836182 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:52:23.836182 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:52:23.836182 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:52:23.836182 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:52:23.836182 n-d-854247-14 devstack@n-api.service[127017]: X-Openstack-Nova-Api-Version: 2.42 Oct 17 13:52:23.836182 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:52:23.836182 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:52:23.836182 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 114d3f1fdbf74c649b48882f8aa177f9 Oct 17 13:52:23.836182 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-541328333 Oct 17 13:52:23.836182 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:52:23.836182 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:52:23.836182 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/114d3f1fdbf74c649b48882f8aa177f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/114d3f1fdbf74c649b48882f8aa177f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/114d3f1fdbf74c649b48882f8aa177f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_114d3f1fdbf74c649b48882f8aa177f9", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:52:23.836182 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-TaggedBootDevicesTest_v242-541328333 Oct 17 13:52:23.836182 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 114d3f1fdbf74c649b48882f8aa177f9 Oct 17 13:52:23.836182 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-541328333 Oct 17 13:52:23.836182 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-TaggedBootDevicesTest_v242-541328333-project Oct 17 13:52:23.836182 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:52:23.836182 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:52:23.836182 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 5670d6402d734aa9b1200a337000839d Oct 17 13:52:23.836182 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-TaggedBootDevicesTest_v242-541328333-project Oct 17 13:52:23.836182 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:52:23.836182 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 531b762d-db7e-4911-af50-6b321b7706bf could not be found. Oct 17 13:52:23.836182 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '531b762d-db7e-4911-af50-6b321b7706bf'} Oct 17 13:52:23.836182 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:52:23.836182 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:52:23.836182 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:52:23.836182 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:52:23.836182 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:52:23.836182 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:52:23.836182 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:52:23.836182 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:52:23.836182 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:52:23.836182 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:52:23.836182 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 531b762d-db7e-4911-af50-6b321b7706bf could not be found. Oct 17 13:52:23.836182 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:52:23.836182 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:52:23.836182 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:52:23.836182 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:52:23.836182 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:52:23.836182 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:52:23.836182 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:52:23.836182 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:52:23.836182 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:52:23.836182 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:52:23.836182 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:52:23.836182 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:52:23.836182 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:52:23.836182 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:52:23.836182 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:52:23.836182 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:52:23.836182 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 531b762d-db7e-4911-af50-6b321b7706bf could not be found. Oct 17 13:52:23.836182 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:52:23.836182 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:52:23.839609 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:52:23.839609 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:52:23.839609 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:52:23.839609 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:52:23.839609 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:52:23.839609 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:52:23.839609 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 531b762d-db7e-4911-af50-6b321b7706bf could not be found. Oct 17 13:52:23.839609 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:52:23.842736 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ceb5eca8-4c69-4eea-b2f6-602fc3712c52 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Returning 404 to user: Instance 531b762d-db7e-4911-af50-6b321b7706bf could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:52:23.844353 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ceb5eca8-4c69-4eea-b2f6-602fc3712c52 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] 10.222.0.79 "GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf" status: 404 len: 111 microversion: 2.42 time: 0.073700 Oct 17 13:52:23.846008 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1905/3862] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:52:23 2022] GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:52:23.863634 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e7f08cfb-11ef-41ce-a6bc-6c4dded44580 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Calling method '.version_select at 0x7f7cd9884e50>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:23.921711 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e7f08cfb-11ef-41ce-a6bc-6c4dded44580 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1338624573" status: 204 len: 0 microversion: 2.42 time: 0.067673 Oct 17 13:52:23.922511 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1906/3863] 10.222.0.79 () {60 vars in 1262 bytes} [Mon Oct 17 13:52:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1338624573 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:52:24.130591 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-80c136f7-03e4-4f0d-8791-ba73c43aaa47 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "POST /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d/action" status: 202 len: 0 microversion: 2.1 time: 0.381885 Oct 17 13:52:24.131870 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1958/3864] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:52:23 2022] POST /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d/action => generated 0 bytes in 384 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 17 13:52:24.442355 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8cd70942-b102-4a42-a1d2-cdf153f407d4 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:24.444559 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8cd70942-b102-4a42-a1d2-cdf153f407d4 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] [instance: 5fea9fdd-bc16-4923-bbf8-e0909cd3bcda] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:24.461922 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8cd70942-b102-4a42-a1d2-cdf153f407d4 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:24.463657 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8cd70942-b102-4a42-a1d2-cdf153f407d4 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:24.464648 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8cd70942-b102-4a42-a1d2-cdf153f407d4 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:24.465943 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8cd70942-b102-4a42-a1d2-cdf153f407d4 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:24.466760 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8cd70942-b102-4a42-a1d2-cdf153f407d4 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:24.469853 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8cd70942-b102-4a42-a1d2-cdf153f407d4 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:24.814396 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8cd70942-b102-4a42-a1d2-cdf153f407d4 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bfe589d0784bfc8ed1611c71cd4461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb1624a35d0403c9e5d09a17e79b7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:24.831685 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8cd70942-b102-4a42-a1d2-cdf153f407d4 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/servers/5fea9fdd-bc16-4923-bbf8-e0909cd3bcda" status: 200 len: 1318 microversion: 2.1 time: 0.394916 Oct 17 13:52:24.832410 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1907/3865] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:24 2022] GET /compute/v2.1/servers/5fea9fdd-bc16-4923-bbf8-e0909cd3bcda => generated 1318 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:25.854661 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:52:25.855681 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=6 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:52:25.861190 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f559bc8b-a632-4b6b-896f-7f6e5154c162 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:25.861934 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f559bc8b-a632-4b6b-896f-7f6e5154c162 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] [instance: 5fea9fdd-bc16-4923-bbf8-e0909cd3bcda] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:25.877405 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f559bc8b-a632-4b6b-896f-7f6e5154c162 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:25.881482 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f559bc8b-a632-4b6b-896f-7f6e5154c162 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:25.884480 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f559bc8b-a632-4b6b-896f-7f6e5154c162 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:25.885644 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f559bc8b-a632-4b6b-896f-7f6e5154c162 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:25.886265 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f559bc8b-a632-4b6b-896f-7f6e5154c162 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:25.886988 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f559bc8b-a632-4b6b-896f-7f6e5154c162 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:26.214085 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f559bc8b-a632-4b6b-896f-7f6e5154c162 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bfe589d0784bfc8ed1611c71cd4461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb1624a35d0403c9e5d09a17e79b7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:26.222113 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f559bc8b-a632-4b6b-896f-7f6e5154c162 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/servers/5fea9fdd-bc16-4923-bbf8-e0909cd3bcda" status: 200 len: 1318 microversion: 2.1 time: 0.369130 Oct 17 13:52:26.222711 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1959/3866] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:25 2022] GET /compute/v2.1/servers/5fea9fdd-bc16-4923-bbf8-e0909cd3bcda => generated 1318 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:26.638179 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-84b32e93-f1eb-4369-ae75-d1c1b3242baf tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1270596742", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eb9b1c95-6d02-4d66-9e16-313080ea7e89"}], "security_groups": [{"name": "tempest-securitygroup--1105155605"}], "key_name": "tempest-keypair-344482103", "user_data": "}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:52:26.687809 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:52:26.688783 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:52:27.231793 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-81dbe1af-4c59-4ba7-9c90-7751177068ee req-fe12acf3-2787-4494-a8a3-68cbe69993bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "419a7ac0-9332-481d-bc66-3ad5b6a9db81", "name": "network-vif-plugged", "status": "completed", "tag": "8c4e8542-c161-4443-8115-64e41c66a3fe"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:52:27.249438 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:52:27.260245 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-81dbe1af-4c59-4ba7-9c90-7751177068ee req-fe12acf3-2787-4494-a8a3-68cbe69993bf service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:27.260865 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-81dbe1af-4c59-4ba7-9c90-7751177068ee req-fe12acf3-2787-4494-a8a3-68cbe69993bf service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:27.261536 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-81dbe1af-4c59-4ba7-9c90-7751177068ee req-fe12acf3-2787-4494-a8a3-68cbe69993bf service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:27.284633 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-81dbe1af-4c59-4ba7-9c90-7751177068ee req-fe12acf3-2787-4494-a8a3-68cbe69993bf service nova] Creating event network-vif-plugged:8c4e8542-c161-4443-8115-64e41c66a3fe for instance 419a7ac0-9332-481d-bc66-3ad5b6a9db81 on n-h2-854247-14 Oct 17 13:52:27.304966 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-81dbe1af-4c59-4ba7-9c90-7751177068ee req-fe12acf3-2787-4494-a8a3-68cbe69993bf service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077825 Oct 17 13:52:27.315184 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1960/3867] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:52:27.318193 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-84b32e93-f1eb-4369-ae75-d1c1b3242baf tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] validate_networks() for [('eb9b1c95-6d02-4d66-9e16-313080ea7e89', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:52:27.321829 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-725f9269-74c0-47d3-bf01-430dcf5b6a8a tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:27.322537 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-725f9269-74c0-47d3-bf01-430dcf5b6a8a tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] [instance: 5fea9fdd-bc16-4923-bbf8-e0909cd3bcda] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:27.341440 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-725f9269-74c0-47d3-bf01-430dcf5b6a8a tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:27.341988 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-725f9269-74c0-47d3-bf01-430dcf5b6a8a tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:27.342473 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-725f9269-74c0-47d3-bf01-430dcf5b6a8a tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:27.343233 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-725f9269-74c0-47d3-bf01-430dcf5b6a8a tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:27.355933 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-725f9269-74c0-47d3-bf01-430dcf5b6a8a tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:27.356378 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-725f9269-74c0-47d3-bf01-430dcf5b6a8a tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:27.802225 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-725f9269-74c0-47d3-bf01-430dcf5b6a8a tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bfe589d0784bfc8ed1611c71cd4461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb1624a35d0403c9e5d09a17e79b7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:27.811213 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-725f9269-74c0-47d3-bf01-430dcf5b6a8a tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/servers/5fea9fdd-bc16-4923-bbf8-e0909cd3bcda" status: 200 len: 1318 microversion: 2.1 time: 0.494457 Oct 17 13:52:27.814007 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1961/3868] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:27 2022] GET /compute/v2.1/servers/5fea9fdd-bc16-4923-bbf8-e0909cd3bcda => generated 1318 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:28.188476 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b6238601-0bbf-462d-b687-b2187de8da4a tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:28.189258 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b6238601-0bbf-462d-b687-b2187de8da4a tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:28.201045 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b6238601-0bbf-462d-b687-b2187de8da4a tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:28.201901 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b6238601-0bbf-462d-b687-b2187de8da4a tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:28.202607 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b6238601-0bbf-462d-b687-b2187de8da4a tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:28.203605 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b6238601-0bbf-462d-b687-b2187de8da4a tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:28.204669 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b6238601-0bbf-462d-b687-b2187de8da4a tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:28.205324 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b6238601-0bbf-462d-b687-b2187de8da4a tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:28.251045 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b6238601-0bbf-462d-b687-b2187de8da4a tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:52:28.423463 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b6238601-0bbf-462d-b687-b2187de8da4a tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "DELETE /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 204 len: 0 microversion: 2.32 time: 0.603591 Oct 17 13:52:28.434060 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1962/3869] 10.222.0.79 () {60 vars in 1280 bytes} [Mon Oct 17 13:52:27 2022] DELETE /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:52:28.445235 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6af942a7-d8d6-4333-b14e-fb9f0bb87be1 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:28.445986 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6af942a7-d8d6-4333-b14e-fb9f0bb87be1 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:28.465229 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6af942a7-d8d6-4333-b14e-fb9f0bb87be1 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:28.465791 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6af942a7-d8d6-4333-b14e-fb9f0bb87be1 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:28.466233 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6af942a7-d8d6-4333-b14e-fb9f0bb87be1 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:28.469898 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6af942a7-d8d6-4333-b14e-fb9f0bb87be1 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:28.470410 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6af942a7-d8d6-4333-b14e-fb9f0bb87be1 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:28.470850 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6af942a7-d8d6-4333-b14e-fb9f0bb87be1 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:28.519400 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-84b32e93-f1eb-4369-ae75-d1c1b3242baf tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:52:28.519921 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-84b32e93-f1eb-4369-ae75-d1c1b3242baf tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:52:28.520437 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-84b32e93-f1eb-4369-ae75-d1c1b3242baf tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:52:28.520896 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-84b32e93-f1eb-4369-ae75-d1c1b3242baf tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:52:28.521314 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-84b32e93-f1eb-4369-ae75-d1c1b3242baf tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:52:28.540076 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-84b32e93-f1eb-4369-ae75-d1c1b3242baf tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:28.540577 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-84b32e93-f1eb-4369-ae75-d1c1b3242baf tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:28.541015 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-84b32e93-f1eb-4369-ae75-d1c1b3242baf tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:28.551132 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-84b32e93-f1eb-4369-ae75-d1c1b3242baf tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:28.551890 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-84b32e93-f1eb-4369-ae75-d1c1b3242baf tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:28.552677 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-84b32e93-f1eb-4369-ae75-d1c1b3242baf tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:28.602267 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-84b32e93-f1eb-4369-ae75-d1c1b3242baf tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Getting quotas for project 4acd31ce63b64ac3a05b76d4a9fdf7c0. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:52:28.618111 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-84b32e93-f1eb-4369-ae75-d1c1b3242baf tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Getting quotas for user c7a7b9b048234fd2926739e3f08400b0 and project 4acd31ce63b64ac3a05b76d4a9fdf7c0. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:52:28.657409 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-84b32e93-f1eb-4369-ae75-d1c1b3242baf tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:52:28.661727 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-84b32e93-f1eb-4369-ae75-d1c1b3242baf tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 90bfb179-c8b6-4810-a981-33b78a19b62c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:52:28.796516 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-84b32e93-f1eb-4369-ae75-d1c1b3242baf tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.160595 Oct 17 13:52:28.801084 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1908/3870] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:52:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 2168 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:52:28.822369 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d17f1bec-c30f-481c-8793-8673cf24e90e tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:28.822745 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d17f1bec-c30f-481c-8793-8673cf24e90e tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 90bfb179-c8b6-4810-a981-33b78a19b62c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:28.966577 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d17f1bec-c30f-481c-8793-8673cf24e90e tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:28.976312 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d17f1bec-c30f-481c-8793-8673cf24e90e tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c" status: 200 len: 1241 microversion: 2.1 time: 0.167406 Oct 17 13:52:28.992281 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1909/3871] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:28 2022] GET /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c => generated 1241 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:28.992281 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3d9d6c56-c7ba-48b2-95bd-4d000bdb3b60 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:28.992281 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3d9d6c56-c7ba-48b2-95bd-4d000bdb3b60 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] [instance: 5fea9fdd-bc16-4923-bbf8-e0909cd3bcda] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:29.001125 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6af942a7-d8d6-4333-b14e-fb9f0bb87be1 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:29.004453 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3d9d6c56-c7ba-48b2-95bd-4d000bdb3b60 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:29.005126 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3d9d6c56-c7ba-48b2-95bd-4d000bdb3b60 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:29.005708 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3d9d6c56-c7ba-48b2-95bd-4d000bdb3b60 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:29.006562 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3d9d6c56-c7ba-48b2-95bd-4d000bdb3b60 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:29.008601 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3d9d6c56-c7ba-48b2-95bd-4d000bdb3b60 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:29.009584 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3d9d6c56-c7ba-48b2-95bd-4d000bdb3b60 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:29.023206 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6af942a7-d8d6-4333-b14e-fb9f0bb87be1 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:29.026698 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6af942a7-d8d6-4333-b14e-fb9f0bb87be1 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:29.031119 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6af942a7-d8d6-4333-b14e-fb9f0bb87be1 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 2955 microversion: 2.32 time: 0.595511 Oct 17 13:52:29.048807 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1963/3872] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:52:28 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 2955 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:52:29.455330 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3d9d6c56-c7ba-48b2-95bd-4d000bdb3b60 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bfe589d0784bfc8ed1611c71cd4461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb1624a35d0403c9e5d09a17e79b7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:29.459426 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-3529a0f4-0b6d-4082-bff0-d8a70b66f928 req-512c91c9-fad9-439f-a2a9-126f4a74f302 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fea9fdd-bc16-4923-bbf8-e0909cd3bcda", "name": "network-vif-plugged", "status": "completed", "tag": "9a6b33a5-082e-4c10-8994-0c42a775e094"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:52:29.468723 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3d9d6c56-c7ba-48b2-95bd-4d000bdb3b60 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/servers/5fea9fdd-bc16-4923-bbf8-e0909cd3bcda" status: 200 len: 1318 microversion: 2.1 time: 0.485568 Oct 17 13:52:29.470555 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1910/3873] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:28 2022] GET /compute/v2.1/servers/5fea9fdd-bc16-4923-bbf8-e0909cd3bcda => generated 1318 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:29.505699 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-3529a0f4-0b6d-4082-bff0-d8a70b66f928 req-512c91c9-fad9-439f-a2a9-126f4a74f302 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:29.507932 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-3529a0f4-0b6d-4082-bff0-d8a70b66f928 req-512c91c9-fad9-439f-a2a9-126f4a74f302 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:29.508599 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-3529a0f4-0b6d-4082-bff0-d8a70b66f928 req-512c91c9-fad9-439f-a2a9-126f4a74f302 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:29.523915 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5df256fd-a2bb-4bcc-ab35-fa89f4d2bca3 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:29.525489 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5df256fd-a2bb-4bcc-ab35-fa89f4d2bca3 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 3197da72-e924-4f50-8c93-c3f3ff98e084] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:29.544958 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5df256fd-a2bb-4bcc-ab35-fa89f4d2bca3 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:29.548968 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5df256fd-a2bb-4bcc-ab35-fa89f4d2bca3 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:29.549570 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5df256fd-a2bb-4bcc-ab35-fa89f4d2bca3 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:29.550816 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5df256fd-a2bb-4bcc-ab35-fa89f4d2bca3 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:29.551393 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5df256fd-a2bb-4bcc-ab35-fa89f4d2bca3 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:29.552034 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5df256fd-a2bb-4bcc-ab35-fa89f4d2bca3 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:29.571349 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-3529a0f4-0b6d-4082-bff0-d8a70b66f928 req-512c91c9-fad9-439f-a2a9-126f4a74f302 service nova] Creating event network-vif-plugged:9a6b33a5-082e-4c10-8994-0c42a775e094 for instance 5fea9fdd-bc16-4923-bbf8-e0909cd3bcda on n-h1-854247-14 Oct 17 13:52:29.586914 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-3529a0f4-0b6d-4082-bff0-d8a70b66f928 req-512c91c9-fad9-439f-a2a9-126f4a74f302 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132748 Oct 17 13:52:29.588005 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1964/3874] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:52:29.758198 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-5df256fd-a2bb-4bcc-ab35-fa89f4d2bca3 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lazy-loading 'services' on Instance uuid 3197da72-e924-4f50-8c93-c3f3ff98e084 {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:52:29.920999 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5df256fd-a2bb-4bcc-ab35-fa89f4d2bca3 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084/os-volume_attachments/77d7b55b-2e3d-411c-a86b-6aad4731ff76" status: 202 len: 0 microversion: 2.1 time: 0.401537 Oct 17 13:52:29.922599 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1911/3875] 10.222.0.79 () {58 vars in 1416 bytes} [Mon Oct 17 13:52:29 2022] DELETE /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084/os-volume_attachments/77d7b55b-2e3d-411c-a86b-6aad4731ff76 => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:52:29.932944 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-45ebd600-5133-4b41-bac1-9e00520494fa tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:29.936104 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-45ebd600-5133-4b41-bac1-9e00520494fa tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 3197da72-e924-4f50-8c93-c3f3ff98e084] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:29.944952 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-45ebd600-5133-4b41-bac1-9e00520494fa tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:29.945685 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-45ebd600-5133-4b41-bac1-9e00520494fa tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:29.947092 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-45ebd600-5133-4b41-bac1-9e00520494fa tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:29.948038 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-45ebd600-5133-4b41-bac1-9e00520494fa tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:29.948640 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-45ebd600-5133-4b41-bac1-9e00520494fa tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:29.949213 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-45ebd600-5133-4b41-bac1-9e00520494fa tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:29.974845 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:52:30.000013 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-45ebd600-5133-4b41-bac1-9e00520494fa tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071309 Oct 17 13:52:30.003243 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ae909c07-673f-4637-802e-e851d5d596f7 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:30.004130 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ae909c07-673f-4637-802e-e851d5d596f7 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 90bfb179-c8b6-4810-a981-33b78a19b62c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:30.005207 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1965/3876] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 13:52:29 2022] GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:52:30.031630 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae909c07-673f-4637-802e-e851d5d596f7 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:30.032132 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae909c07-673f-4637-802e-e851d5d596f7 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:30.032573 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae909c07-673f-4637-802e-e851d5d596f7 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:30.033295 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae909c07-673f-4637-802e-e851d5d596f7 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:30.035314 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae909c07-673f-4637-802e-e851d5d596f7 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:30.035749 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae909c07-673f-4637-802e-e851d5d596f7 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:30.071893 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fd00a863-dcd9-424d-a101-3dca18fe4071 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:30.072502 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-fd00a863-dcd9-424d-a101-3dca18fe4071 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:30.110869 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fd00a863-dcd9-424d-a101-3dca18fe4071 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:30.119153 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fd00a863-dcd9-424d-a101-3dca18fe4071 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:30.119981 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fd00a863-dcd9-424d-a101-3dca18fe4071 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:30.120910 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fd00a863-dcd9-424d-a101-3dca18fe4071 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:30.123318 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fd00a863-dcd9-424d-a101-3dca18fe4071 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:30.127259 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fd00a863-dcd9-424d-a101-3dca18fe4071 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:30.176431 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ae909c07-673f-4637-802e-e851d5d596f7 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:30.189916 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ae909c07-673f-4637-802e-e851d5d596f7 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c" status: 200 len: 1237 microversion: 2.1 time: 0.193197 Oct 17 13:52:30.190831 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1912/3877] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:29 2022] GET /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c => generated 1237 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:30.497828 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8ac33575-d06a-492c-a1d3-f4e96fed5f2e tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:30.499021 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8ac33575-d06a-492c-a1d3-f4e96fed5f2e tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] [instance: 5fea9fdd-bc16-4923-bbf8-e0909cd3bcda] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:30.516777 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8ac33575-d06a-492c-a1d3-f4e96fed5f2e tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:30.522227 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8ac33575-d06a-492c-a1d3-f4e96fed5f2e tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:30.522906 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8ac33575-d06a-492c-a1d3-f4e96fed5f2e tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:30.526049 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8ac33575-d06a-492c-a1d3-f4e96fed5f2e tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:30.527323 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8ac33575-d06a-492c-a1d3-f4e96fed5f2e tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:30.529369 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8ac33575-d06a-492c-a1d3-f4e96fed5f2e tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:31.037414 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8ac33575-d06a-492c-a1d3-f4e96fed5f2e tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bfe589d0784bfc8ed1611c71cd4461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb1624a35d0403c9e5d09a17e79b7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:31.053855 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8ac33575-d06a-492c-a1d3-f4e96fed5f2e tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/servers/5fea9fdd-bc16-4923-bbf8-e0909cd3bcda" status: 200 len: 1318 microversion: 2.1 time: 0.562967 Oct 17 13:52:31.072731 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1913/3878] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:30 2022] GET /compute/v2.1/servers/5fea9fdd-bc16-4923-bbf8-e0909cd3bcda => generated 1318 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:31.081551 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fd00a863-dcd9-424d-a101-3dca18fe4071 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:31.093961 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-04d2407d-3790-45d2-96be-7a29272524f6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:31.098552 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fd00a863-dcd9-424d-a101-3dca18fe4071 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:31.103137 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-04d2407d-3790-45d2-96be-7a29272524f6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 3197da72-e924-4f50-8c93-c3f3ff98e084] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:31.103911 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fd00a863-dcd9-424d-a101-3dca18fe4071 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:31.105571 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fd00a863-dcd9-424d-a101-3dca18fe4071 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 2955 microversion: 2.32 time: 1.038342 Oct 17 13:52:31.109118 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1966/3879] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:52:30 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 2955 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:52:31.115980 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-04d2407d-3790-45d2-96be-7a29272524f6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:31.116768 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-04d2407d-3790-45d2-96be-7a29272524f6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:31.117419 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-04d2407d-3790-45d2-96be-7a29272524f6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:31.118344 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-04d2407d-3790-45d2-96be-7a29272524f6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:31.118895 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-04d2407d-3790-45d2-96be-7a29272524f6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:31.119597 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-04d2407d-3790-45d2-96be-7a29272524f6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:31.208853 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-04d2407d-3790-45d2-96be-7a29272524f6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.130477 Oct 17 13:52:31.209658 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1914/3880] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 13:52:31 2022] GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:52:31.221590 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ddcc2e77-1588-4505-b9e6-88b20be3f607 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:31.222659 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ddcc2e77-1588-4505-b9e6-88b20be3f607 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 90bfb179-c8b6-4810-a981-33b78a19b62c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:31.233504 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ddcc2e77-1588-4505-b9e6-88b20be3f607 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:31.234327 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ddcc2e77-1588-4505-b9e6-88b20be3f607 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:31.235112 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ddcc2e77-1588-4505-b9e6-88b20be3f607 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:31.265205 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ddcc2e77-1588-4505-b9e6-88b20be3f607 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:31.266058 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ddcc2e77-1588-4505-b9e6-88b20be3f607 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:31.267947 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ddcc2e77-1588-4505-b9e6-88b20be3f607 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:31.546119 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ddcc2e77-1588-4505-b9e6-88b20be3f607 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:31.569975 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ddcc2e77-1588-4505-b9e6-88b20be3f607 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c" status: 200 len: 1301 microversion: 2.1 time: 0.352416 Oct 17 13:52:31.573752 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1967/3881] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:31 2022] GET /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c => generated 1301 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:52:31.628837 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-00553821-089e-489e-a350-d36aa287c201 req-7dfa41ca-d17a-4eb5-ab13-2ec8555b9d0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96dd349a-6476-4a7d-8f55-ea10e3b1e05d", "name": "network-vif-plugged", "status": "completed", "tag": "fa985869-a190-4726-b04f-7d06a5c193e1"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:52:31.655671 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-00553821-089e-489e-a350-d36aa287c201 req-7dfa41ca-d17a-4eb5-ab13-2ec8555b9d0e service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:31.656246 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-00553821-089e-489e-a350-d36aa287c201 req-7dfa41ca-d17a-4eb5-ab13-2ec8555b9d0e service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:31.657296 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-00553821-089e-489e-a350-d36aa287c201 req-7dfa41ca-d17a-4eb5-ab13-2ec8555b9d0e service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:31.671827 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-00553821-089e-489e-a350-d36aa287c201 req-7dfa41ca-d17a-4eb5-ab13-2ec8555b9d0e service nova] Creating event network-vif-plugged:fa985869-a190-4726-b04f-7d06a5c193e1 for instance 96dd349a-6476-4a7d-8f55-ea10e3b1e05d on n-h2-854247-14 Oct 17 13:52:31.678357 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-00553821-089e-489e-a350-d36aa287c201 req-7dfa41ca-d17a-4eb5-ab13-2ec8555b9d0e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055174 Oct 17 13:52:31.679582 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1915/3882] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:52:32.079485 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5038799b-f6ef-488c-8f3a-808fbfabc999 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:32.080469 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5038799b-f6ef-488c-8f3a-808fbfabc999 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] [instance: 5fea9fdd-bc16-4923-bbf8-e0909cd3bcda] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:32.098495 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5038799b-f6ef-488c-8f3a-808fbfabc999 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:32.100305 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5038799b-f6ef-488c-8f3a-808fbfabc999 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:32.102156 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5038799b-f6ef-488c-8f3a-808fbfabc999 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:32.103148 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5038799b-f6ef-488c-8f3a-808fbfabc999 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:32.108703 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5038799b-f6ef-488c-8f3a-808fbfabc999 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:32.109536 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5038799b-f6ef-488c-8f3a-808fbfabc999 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:32.143924 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7536826e-6cde-4e38-8d2e-0b3aab6fa158 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:32.145033 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7536826e-6cde-4e38-8d2e-0b3aab6fa158 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:32.170691 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7536826e-6cde-4e38-8d2e-0b3aab6fa158 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:32.171626 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7536826e-6cde-4e38-8d2e-0b3aab6fa158 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:32.172485 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7536826e-6cde-4e38-8d2e-0b3aab6fa158 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:32.180678 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7536826e-6cde-4e38-8d2e-0b3aab6fa158 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:32.182631 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7536826e-6cde-4e38-8d2e-0b3aab6fa158 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:32.184219 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7536826e-6cde-4e38-8d2e-0b3aab6fa158 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:32.887802 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5038799b-f6ef-488c-8f3a-808fbfabc999 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bfe589d0784bfc8ed1611c71cd4461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb1624a35d0403c9e5d09a17e79b7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:32.899603 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5038799b-f6ef-488c-8f3a-808fbfabc999 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/servers/5fea9fdd-bc16-4923-bbf8-e0909cd3bcda" status: 200 len: 1318 microversion: 2.1 time: 0.826161 Oct 17 13:52:32.909603 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1968/3883] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:32 2022] GET /compute/v2.1/servers/5fea9fdd-bc16-4923-bbf8-e0909cd3bcda => generated 1318 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:32.917231 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7536826e-6cde-4e38-8d2e-0b3aab6fa158 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:32.923156 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2b97650e-9b68-4d8d-a575-e5ff7bd5f68c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:32.926066 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2b97650e-9b68-4d8d-a575-e5ff7bd5f68c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 3197da72-e924-4f50-8c93-c3f3ff98e084] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:32.937442 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7536826e-6cde-4e38-8d2e-0b3aab6fa158 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:32.938972 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7536826e-6cde-4e38-8d2e-0b3aab6fa158 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:32.940579 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7536826e-6cde-4e38-8d2e-0b3aab6fa158 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 2955 microversion: 2.32 time: 0.806944 Oct 17 13:52:32.945273 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2b97650e-9b68-4d8d-a575-e5ff7bd5f68c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:32.948701 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2b97650e-9b68-4d8d-a575-e5ff7bd5f68c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:32.949543 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2b97650e-9b68-4d8d-a575-e5ff7bd5f68c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:32.952017 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2b97650e-9b68-4d8d-a575-e5ff7bd5f68c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:32.952668 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2b97650e-9b68-4d8d-a575-e5ff7bd5f68c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:32.953249 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2b97650e-9b68-4d8d-a575-e5ff7bd5f68c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:32.957747 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1916/3884] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:52:32 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 2955 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:52:32.976296 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8593bb5b-2e63-4544-92fd-6feca8592fd1 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:32.977291 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8593bb5b-2e63-4544-92fd-6feca8592fd1 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 90bfb179-c8b6-4810-a981-33b78a19b62c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:32.989015 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8593bb5b-2e63-4544-92fd-6feca8592fd1 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:32.989514 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8593bb5b-2e63-4544-92fd-6feca8592fd1 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:32.989954 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8593bb5b-2e63-4544-92fd-6feca8592fd1 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:32.990659 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8593bb5b-2e63-4544-92fd-6feca8592fd1 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:32.991108 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8593bb5b-2e63-4544-92fd-6feca8592fd1 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:32.991617 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8593bb5b-2e63-4544-92fd-6feca8592fd1 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:33.029079 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2b97650e-9b68-4d8d-a575-e5ff7bd5f68c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117575 Oct 17 13:52:33.036973 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1969/3885] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 13:52:32 2022] GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:52:33.042858 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-34a2b638-167f-4539-8bc3-e195a86228a9 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:33.043433 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-34a2b638-167f-4539-8bc3-e195a86228a9 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] [instance: 531b762d-db7e-4911-af50-6b321b7706bf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:33.051436 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-34a2b638-167f-4539-8bc3-e195a86228a9 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:33.051946 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-34a2b638-167f-4539-8bc3-e195a86228a9 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:33.052406 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-34a2b638-167f-4539-8bc3-e195a86228a9 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:33.053285 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-34a2b638-167f-4539-8bc3-e195a86228a9 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:33.053818 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-34a2b638-167f-4539-8bc3-e195a86228a9 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:33.054306 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-34a2b638-167f-4539-8bc3-e195a86228a9 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:33.074897 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-34a2b638-167f-4539-8bc3-e195a86228a9 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] HTTP exception thrown: Instance 531b762d-db7e-4911-af50-6b321b7706bf could not be found. Oct 17 13:52:33.077281 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-34a2b638-167f-4539-8bc3-e195a86228a9 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Request method failure captured: Oct 17 13:52:33.077281 n-d-854247-14 devstack@n-api.service[127016]: request: DELETE /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf HTTP/1.1 Oct 17 13:52:33.077281 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:52:33.077281 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:52:33.077281 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:52:33.077281 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:52:33.077281 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:52:33.077281 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:52:33.077281 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:52:33.077281 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:52:33.077281 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVyM0Y-slKGat2PStw0CDPgT4JAtNVW3ev8WmnmahhGjNqt158NKsdoBiFyH2UplWsyfguEQ9LeevADYmex-PV4fmwPLXORsXqFX7-c2lf_oA2fe9Badk8AXSJ0eLyo9jalHDf_Osir_PWsa_UbGjlVDwERuId6OWHOYEjP_boFUDfQ Oct 17 13:52:33.077281 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:52:33.077281 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:52:33.077281 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:52:33.077281 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:52:33.077281 n-d-854247-14 devstack@n-api.service[127016]: X-Openstack-Nova-Api-Version: 2.42 Oct 17 13:52:33.077281 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:52:33.077281 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:52:33.077281 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 114d3f1fdbf74c649b48882f8aa177f9 Oct 17 13:52:33.077281 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-541328333 Oct 17 13:52:33.077281 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:52:33.077281 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:52:33.077281 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/114d3f1fdbf74c649b48882f8aa177f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/114d3f1fdbf74c649b48882f8aa177f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/114d3f1fdbf74c649b48882f8aa177f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_114d3f1fdbf74c649b48882f8aa177f9", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:52:33.077281 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-TaggedBootDevicesTest_v242-541328333 Oct 17 13:52:33.077281 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 114d3f1fdbf74c649b48882f8aa177f9 Oct 17 13:52:33.077281 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-541328333 Oct 17 13:52:33.077281 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-TaggedBootDevicesTest_v242-541328333-project Oct 17 13:52:33.077281 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:52:33.077281 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:52:33.077281 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 5670d6402d734aa9b1200a337000839d Oct 17 13:52:33.077281 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-TaggedBootDevicesTest_v242-541328333-project Oct 17 13:52:33.077281 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:52:33.077281 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 531b762d-db7e-4911-af50-6b321b7706bf could not be found. Oct 17 13:52:33.077281 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '531b762d-db7e-4911-af50-6b321b7706bf'} Oct 17 13:52:33.077281 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:52:33.077281 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:52:33.077281 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:52:33.077281 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:52:33.077281 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:52:33.077281 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:52:33.077281 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:52:33.077281 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:52:33.077281 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:52:33.077281 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:52:33.077281 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 531b762d-db7e-4911-af50-6b321b7706bf could not be found. Oct 17 13:52:33.077281 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:52:33.077281 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:52:33.077281 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:52:33.077281 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:52:33.077281 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:52:33.077281 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:52:33.077281 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:52:33.077281 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:52:33.077281 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:52:33.077281 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:52:33.077281 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:52:33.077281 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:52:33.077281 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:52:33.077281 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:52:33.077281 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:52:33.077281 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:52:33.077281 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:52:33.077281 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:52:33.081047 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 531b762d-db7e-4911-af50-6b321b7706bf could not be found. Oct 17 13:52:33.081047 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:52:33.081047 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:52:33.081047 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:52:33.081047 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:52:33.081047 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:52:33.081047 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:52:33.081047 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:52:33.081047 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:52:33.081047 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 531b762d-db7e-4911-af50-6b321b7706bf could not be found. Oct 17 13:52:33.081047 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:52:33.084009 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-34a2b638-167f-4539-8bc3-e195a86228a9 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Returning 404 to user: Instance 531b762d-db7e-4911-af50-6b321b7706bf could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:52:33.085045 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-34a2b638-167f-4539-8bc3-e195a86228a9 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] 10.222.0.79 "DELETE /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf" status: 404 len: 111 microversion: 2.42 time: 0.046938 Oct 17 13:52:33.085750 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1970/3886] 10.222.0.79 () {60 vars in 1280 bytes} [Mon Oct 17 13:52:33 2022] DELETE /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:52:33.126592 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d222ddba-eac0-44d0-8369-80f9b8420f55 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:33.129854 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d222ddba-eac0-44d0-8369-80f9b8420f55 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] [instance: 531b762d-db7e-4911-af50-6b321b7706bf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:33.143936 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d222ddba-eac0-44d0-8369-80f9b8420f55 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:33.144668 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d222ddba-eac0-44d0-8369-80f9b8420f55 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:33.145360 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d222ddba-eac0-44d0-8369-80f9b8420f55 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:33.147325 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d222ddba-eac0-44d0-8369-80f9b8420f55 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:33.147950 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d222ddba-eac0-44d0-8369-80f9b8420f55 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:33.148652 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d222ddba-eac0-44d0-8369-80f9b8420f55 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:33.170069 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-d222ddba-eac0-44d0-8369-80f9b8420f55 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] HTTP exception thrown: Instance 531b762d-db7e-4911-af50-6b321b7706bf could not be found. Oct 17 13:52:33.171961 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d222ddba-eac0-44d0-8369-80f9b8420f55 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Request method failure captured: Oct 17 13:52:33.171961 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf HTTP/1.1 Oct 17 13:52:33.171961 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:52:33.171961 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:52:33.171961 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:52:33.171961 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:52:33.171961 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:52:33.171961 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:52:33.171961 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:52:33.171961 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:52:33.171961 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVyM0Y-slKGat2PStw0CDPgT4JAtNVW3ev8WmnmahhGjNqt158NKsdoBiFyH2UplWsyfguEQ9LeevADYmex-PV4fmwPLXORsXqFX7-c2lf_oA2fe9Badk8AXSJ0eLyo9jalHDf_Osir_PWsa_UbGjlVDwERuId6OWHOYEjP_boFUDfQ Oct 17 13:52:33.171961 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:52:33.171961 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:52:33.171961 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:52:33.171961 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:52:33.171961 n-d-854247-14 devstack@n-api.service[127016]: X-Openstack-Nova-Api-Version: 2.42 Oct 17 13:52:33.171961 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:52:33.171961 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:52:33.171961 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 114d3f1fdbf74c649b48882f8aa177f9 Oct 17 13:52:33.171961 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-541328333 Oct 17 13:52:33.171961 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:52:33.171961 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:52:33.171961 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/114d3f1fdbf74c649b48882f8aa177f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/114d3f1fdbf74c649b48882f8aa177f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/114d3f1fdbf74c649b48882f8aa177f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_114d3f1fdbf74c649b48882f8aa177f9", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:52:33.171961 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-TaggedBootDevicesTest_v242-541328333 Oct 17 13:52:33.171961 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 114d3f1fdbf74c649b48882f8aa177f9 Oct 17 13:52:33.171961 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-541328333 Oct 17 13:52:33.171961 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-TaggedBootDevicesTest_v242-541328333-project Oct 17 13:52:33.171961 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:52:33.171961 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:52:33.171961 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 5670d6402d734aa9b1200a337000839d Oct 17 13:52:33.171961 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-TaggedBootDevicesTest_v242-541328333-project Oct 17 13:52:33.171961 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:52:33.171961 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 531b762d-db7e-4911-af50-6b321b7706bf could not be found. Oct 17 13:52:33.171961 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '531b762d-db7e-4911-af50-6b321b7706bf'} Oct 17 13:52:33.171961 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:52:33.171961 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:52:33.171961 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:52:33.171961 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:52:33.171961 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:52:33.171961 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:52:33.171961 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:52:33.171961 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:52:33.171961 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:52:33.171961 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:52:33.171961 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 531b762d-db7e-4911-af50-6b321b7706bf could not be found. Oct 17 13:52:33.171961 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:52:33.171961 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:52:33.171961 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:52:33.171961 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:52:33.171961 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:52:33.171961 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:52:33.171961 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:52:33.171961 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:52:33.171961 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:52:33.171961 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:52:33.171961 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:52:33.171961 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:52:33.171961 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:52:33.171961 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:52:33.171961 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:52:33.171961 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:52:33.171961 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 531b762d-db7e-4911-af50-6b321b7706bf could not be found. Oct 17 13:52:33.171961 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:52:33.171961 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:52:33.176637 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:52:33.176637 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:52:33.176637 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:52:33.176637 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:52:33.176637 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:52:33.176637 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:52:33.176637 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 531b762d-db7e-4911-af50-6b321b7706bf could not be found. Oct 17 13:52:33.176637 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:52:33.179845 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d222ddba-eac0-44d0-8369-80f9b8420f55 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] Returning 404 to user: Instance 531b762d-db7e-4911-af50-6b321b7706bf could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:52:33.180913 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d222ddba-eac0-44d0-8369-80f9b8420f55 tempest-TaggedBootDevicesTest_v242-541328333 tempest-TaggedBootDevicesTest_v242-541328333-project] 10.222.0.79 "GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf" status: 404 len: 111 microversion: 2.42 time: 0.061964 Oct 17 13:52:33.185056 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1971/3887] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:52:33 2022] GET /compute/v2.1/servers/531b762d-db7e-4911-af50-6b321b7706bf => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:52:33.510174 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8593bb5b-2e63-4544-92fd-6feca8592fd1 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:33.529274 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8593bb5b-2e63-4544-92fd-6feca8592fd1 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c" status: 200 len: 1367 microversion: 2.1 time: 0.568481 Oct 17 13:52:33.530667 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1917/3888] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:32 2022] GET /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c => generated 1367 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:33.937198 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e9dadcc8-1b95-442b-aa1a-17d217a8adaf tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:33.938101 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e9dadcc8-1b95-442b-aa1a-17d217a8adaf tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] [instance: 5fea9fdd-bc16-4923-bbf8-e0909cd3bcda] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:33.950462 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9dadcc8-1b95-442b-aa1a-17d217a8adaf tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:33.950984 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9dadcc8-1b95-442b-aa1a-17d217a8adaf tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:33.953247 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9dadcc8-1b95-442b-aa1a-17d217a8adaf tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:33.953968 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9dadcc8-1b95-442b-aa1a-17d217a8adaf tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:33.954434 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9dadcc8-1b95-442b-aa1a-17d217a8adaf tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:33.954853 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9dadcc8-1b95-442b-aa1a-17d217a8adaf tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:33.981591 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bd63729d-4703-4f53-8d12-a5f4897174b7 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:33.986669 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-bd63729d-4703-4f53-8d12-a5f4897174b7 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:34.006586 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bd63729d-4703-4f53-8d12-a5f4897174b7 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:34.007074 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bd63729d-4703-4f53-8d12-a5f4897174b7 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:34.009193 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bd63729d-4703-4f53-8d12-a5f4897174b7 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:34.022149 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bd63729d-4703-4f53-8d12-a5f4897174b7 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:34.022663 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bd63729d-4703-4f53-8d12-a5f4897174b7 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:34.023115 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bd63729d-4703-4f53-8d12-a5f4897174b7 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:35.158234 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e9dadcc8-1b95-442b-aa1a-17d217a8adaf tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bfe589d0784bfc8ed1611c71cd4461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb1624a35d0403c9e5d09a17e79b7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:35.166443 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e9dadcc8-1b95-442b-aa1a-17d217a8adaf tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/servers/5fea9fdd-bc16-4923-bbf8-e0909cd3bcda" status: 200 len: 1468 microversion: 2.1 time: 1.235487 Oct 17 13:52:35.189025 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1972/3889] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:33 2022] GET /compute/v2.1/servers/5fea9fdd-bc16-4923-bbf8-e0909cd3bcda => generated 1468 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:35.211925 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-bd63729d-4703-4f53-8d12-a5f4897174b7 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:35.222052 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-bd63729d-4703-4f53-8d12-a5f4897174b7 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:35.223534 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-bd63729d-4703-4f53-8d12-a5f4897174b7 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:35.233278 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d605c3d8-0a4b-4208-9023-83cf072b6601 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:35.243700 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d605c3d8-0a4b-4208-9023-83cf072b6601 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 3197da72-e924-4f50-8c93-c3f3ff98e084] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:35.245985 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-bd63729d-4703-4f53-8d12-a5f4897174b7 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 2934 microversion: 2.32 time: 1.263371 Oct 17 13:52:35.249334 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1918/3890] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:52:33 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 2934 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:52:35.254458 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-69e7b77b-fbb6-4edc-9d51-85779649c668 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:35.267551 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-69e7b77b-fbb6-4edc-9d51-85779649c668 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 90bfb179-c8b6-4810-a981-33b78a19b62c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:35.268734 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d605c3d8-0a4b-4208-9023-83cf072b6601 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:35.269354 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d605c3d8-0a4b-4208-9023-83cf072b6601 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:35.271034 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d605c3d8-0a4b-4208-9023-83cf072b6601 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:35.273305 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d605c3d8-0a4b-4208-9023-83cf072b6601 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:35.273845 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d605c3d8-0a4b-4208-9023-83cf072b6601 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:35.274292 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d605c3d8-0a4b-4208-9023-83cf072b6601 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:35.288047 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69e7b77b-fbb6-4edc-9d51-85779649c668 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:35.289328 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69e7b77b-fbb6-4edc-9d51-85779649c668 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:35.289787 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69e7b77b-fbb6-4edc-9d51-85779649c668 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:35.290500 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69e7b77b-fbb6-4edc-9d51-85779649c668 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:35.291116 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69e7b77b-fbb6-4edc-9d51-85779649c668 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:35.293047 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69e7b77b-fbb6-4edc-9d51-85779649c668 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:35.357330 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d605c3d8-0a4b-4208-9023-83cf072b6601 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.166769 Oct 17 13:52:35.357983 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1973/3891] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 13:52:35 2022] GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084/os-volume_attachments => generated 197 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:52:35.367437 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4e347e00-3aee-4e79-afd6-f5541b5778c9 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:35.370270 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4e347e00-3aee-4e79-afd6-f5541b5778c9 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] [instance: 419a7ac0-9332-481d-bc66-3ad5b6a9db81] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:35.383811 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4e347e00-3aee-4e79-afd6-f5541b5778c9 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:35.384308 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4e347e00-3aee-4e79-afd6-f5541b5778c9 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:35.384749 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4e347e00-3aee-4e79-afd6-f5541b5778c9 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:35.391130 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4e347e00-3aee-4e79-afd6-f5541b5778c9 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:35.391652 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4e347e00-3aee-4e79-afd6-f5541b5778c9 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:35.392103 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4e347e00-3aee-4e79-afd6-f5541b5778c9 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:35.895609 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4e347e00-3aee-4e79-afd6-f5541b5778c9 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bfe589d0784bfc8ed1611c71cd4461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb1624a35d0403c9e5d09a17e79b7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:35.916973 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4e347e00-3aee-4e79-afd6-f5541b5778c9 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/servers/419a7ac0-9332-481d-bc66-3ad5b6a9db81" status: 200 len: 1466 microversion: 2.1 time: 0.556923 Oct 17 13:52:35.922267 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1974/3892] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:35 2022] GET /compute/v2.1/servers/419a7ac0-9332-481d-bc66-3ad5b6a9db81 => generated 1466 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:35.929406 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a1af9129-0982-4aeb-965c-8a4d75584762 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:35.932582 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a1af9129-0982-4aeb-965c-8a4d75584762 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:35.943612 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a1af9129-0982-4aeb-965c-8a4d75584762 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:35.945752 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a1af9129-0982-4aeb-965c-8a4d75584762 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:35.947270 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a1af9129-0982-4aeb-965c-8a4d75584762 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:35.949008 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a1af9129-0982-4aeb-965c-8a4d75584762 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:35.950351 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a1af9129-0982-4aeb-965c-8a4d75584762 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:35.951516 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a1af9129-0982-4aeb-965c-8a4d75584762 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:35.984772 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-69e7b77b-fbb6-4edc-9d51-85779649c668 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:35.987487 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:52:36.004221 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-69e7b77b-fbb6-4edc-9d51-85779649c668 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c" status: 200 len: 1367 microversion: 2.1 time: 0.753445 Oct 17 13:52:36.005501 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1919/3893] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:35 2022] GET /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c => generated 1367 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:36.023937 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-791430b6-258f-4cca-b3e5-e5551f1de365 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-140182818"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:52:36.027277 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-791430b6-258f-4cca-b3e5-e5551f1de365 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] [instance: 419a7ac0-9332-481d-bc66-3ad5b6a9db81] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:36.035418 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-791430b6-258f-4cca-b3e5-e5551f1de365 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:36.036395 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-791430b6-258f-4cca-b3e5-e5551f1de365 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:36.037034 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-791430b6-258f-4cca-b3e5-e5551f1de365 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:36.038014 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-791430b6-258f-4cca-b3e5-e5551f1de365 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:36.038676 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-791430b6-258f-4cca-b3e5-e5551f1de365 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:36.039361 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-791430b6-258f-4cca-b3e5-e5551f1de365 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:36.048615 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a1af9129-0982-4aeb-965c-8a4d75584762 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124906 Oct 17 13:52:36.049428 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1975/3894] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 13:52:35 2022] GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:52:36.063971 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-73390905-ffdd-479d-b659-b530c1032c9c tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:36.064840 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-73390905-ffdd-479d-b659-b530c1032c9c tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:36.076025 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-73390905-ffdd-479d-b659-b530c1032c9c tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:36.076833 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-73390905-ffdd-479d-b659-b530c1032c9c tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:36.077549 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-73390905-ffdd-479d-b659-b530c1032c9c tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:36.078516 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-73390905-ffdd-479d-b659-b530c1032c9c tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:36.080060 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-73390905-ffdd-479d-b659-b530c1032c9c tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:36.081198 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-73390905-ffdd-479d-b659-b530c1032c9c tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:36.126703 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-73390905-ffdd-479d-b659-b530c1032c9c tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5/os-volume_attachments/a926cc62-2fec-45a4-abdb-8cd1eee8ff64" status: 200 len: 194 microversion: 2.1 time: 0.069607 Oct 17 13:52:36.128213 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1976/3895] 10.222.0.79 () {58 vars in 1413 bytes} [Mon Oct 17 13:52:36 2022] GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5/os-volume_attachments/a926cc62-2fec-45a4-abdb-8cd1eee8ff64 => generated 194 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:52:36.276853 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3bab18aa-a313-4476-b821-b3d104c0765f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:36.277614 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3bab18aa-a313-4476-b821-b3d104c0765f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:36.316995 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3bab18aa-a313-4476-b821-b3d104c0765f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:36.318450 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3bab18aa-a313-4476-b821-b3d104c0765f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:36.323338 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3bab18aa-a313-4476-b821-b3d104c0765f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:36.328847 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3bab18aa-a313-4476-b821-b3d104c0765f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:36.334042 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3bab18aa-a313-4476-b821-b3d104c0765f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:36.334931 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3bab18aa-a313-4476-b821-b3d104c0765f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:36.514078 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-791430b6-258f-4cca-b3e5-e5551f1de365 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "POST /compute/v2.1/servers/419a7ac0-9332-481d-bc66-3ad5b6a9db81/action" status: 202 len: 0 microversion: 2.1 time: 0.506803 Oct 17 13:52:36.525187 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1920/3896] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:52:36 2022] POST /compute/v2.1/servers/419a7ac0-9332-481d-bc66-3ad5b6a9db81/action => generated 0 bytes in 519 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 17 13:52:36.536259 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-bbe82d24-48e2-4945-b5a7-e6bb3a0289bc req-92fcb958-b419-475d-aafc-085eb1097a6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2", "name": "network-vif-deleted", "tag": "fac894e0-9d90-47af-ad82-0c669f0a03f4"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:52:36.562693 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-bbe82d24-48e2-4945-b5a7-e6bb3a0289bc req-92fcb958-b419-475d-aafc-085eb1097a6d service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:36.565075 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-bbe82d24-48e2-4945-b5a7-e6bb3a0289bc req-92fcb958-b419-475d-aafc-085eb1097a6d service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:36.566848 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-bbe82d24-48e2-4945-b5a7-e6bb3a0289bc req-92fcb958-b419-475d-aafc-085eb1097a6d service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:36.587390 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-bbe82d24-48e2-4945-b5a7-e6bb3a0289bc req-92fcb958-b419-475d-aafc-085eb1097a6d service nova] Creating event network-vif-deleted:fac894e0-9d90-47af-ad82-0c669f0a03f4 for instance 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 on n-h1-854247-14 Oct 17 13:52:36.594160 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-bbe82d24-48e2-4945-b5a7-e6bb3a0289bc req-92fcb958-b419-475d-aafc-085eb1097a6d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062967 Oct 17 13:52:36.597410 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1921/3897] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:52:36.622945 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2aeb0197-1a3b-465b-a462-71e72ec34210 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:36.638607 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2aeb0197-1a3b-465b-a462-71e72ec34210 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 3197da72-e924-4f50-8c93-c3f3ff98e084] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:36.658510 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2aeb0197-1a3b-465b-a462-71e72ec34210 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:36.661301 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2aeb0197-1a3b-465b-a462-71e72ec34210 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:36.669517 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2aeb0197-1a3b-465b-a462-71e72ec34210 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:36.672055 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2aeb0197-1a3b-465b-a462-71e72ec34210 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:36.673822 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2aeb0197-1a3b-465b-a462-71e72ec34210 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:36.677104 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2aeb0197-1a3b-465b-a462-71e72ec34210 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:36.810977 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2aeb0197-1a3b-465b-a462-71e72ec34210 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.209608 Oct 17 13:52:36.822679 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1922/3898] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 13:52:36 2022] GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084/os-volume_attachments => generated 197 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:52:36.850602 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a4143dc1-7b0c-4a62-bc02-804be8aee945 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd477f550>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:37.004765 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a4143dc1-7b0c-4a62-bc02-804be8aee945 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/images/fb733fa0-36d1-4ec5-a621-b863abdc6233" status: 200 len: 1452 microversion: 2.1 time: 0.180598 Oct 17 13:52:37.014162 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1923/3899] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:52:36 2022] GET /compute/v2.1/images/fb733fa0-36d1-4ec5-a621-b863abdc6233 => generated 1452 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:37.032676 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-c133f3df-8c4a-4dc5-be5a-2d8180e971c8 req-2fd2f4d4-431b-47cd-8891-c5b24151c9ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2", "name": "network-vif-unplugged", "status": "completed", "tag": "09cd6d52-dd88-453b-97c9-b02b47bbb3bb"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:52:37.125846 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-c133f3df-8c4a-4dc5-be5a-2d8180e971c8 req-2fd2f4d4-431b-47cd-8891-c5b24151c9ee service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:37.126343 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-c133f3df-8c4a-4dc5-be5a-2d8180e971c8 req-2fd2f4d4-431b-47cd-8891-c5b24151c9ee service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:37.126785 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-c133f3df-8c4a-4dc5-be5a-2d8180e971c8 req-2fd2f4d4-431b-47cd-8891-c5b24151c9ee service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:37.202372 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-c133f3df-8c4a-4dc5-be5a-2d8180e971c8 req-2fd2f4d4-431b-47cd-8891-c5b24151c9ee service nova] Creating event network-vif-unplugged:09cd6d52-dd88-453b-97c9-b02b47bbb3bb for instance 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 on n-h1-854247-14 Oct 17 13:52:37.220408 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-c133f3df-8c4a-4dc5-be5a-2d8180e971c8 req-2fd2f4d4-431b-47cd-8891-c5b24151c9ee service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.204016 Oct 17 13:52:37.222137 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1924/3900] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:52:37.236167 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c7846cfe-fb58-49df-8435-a9ddd85cb5d2 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:37.237114 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c7846cfe-fb58-49df-8435-a9ddd85cb5d2 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 90bfb179-c8b6-4810-a981-33b78a19b62c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:37.244196 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7846cfe-fb58-49df-8435-a9ddd85cb5d2 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:37.244939 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7846cfe-fb58-49df-8435-a9ddd85cb5d2 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:37.245528 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7846cfe-fb58-49df-8435-a9ddd85cb5d2 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:37.246423 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7846cfe-fb58-49df-8435-a9ddd85cb5d2 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:37.247027 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7846cfe-fb58-49df-8435-a9ddd85cb5d2 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:37.247627 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7846cfe-fb58-49df-8435-a9ddd85cb5d2 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:37.805694 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3bab18aa-a313-4476-b821-b3d104c0765f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:37.830018 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3bab18aa-a313-4476-b821-b3d104c0765f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:37.837701 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3bab18aa-a313-4476-b821-b3d104c0765f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:37.845852 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3bab18aa-a313-4476-b821-b3d104c0765f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 2866 microversion: 2.32 time: 1.566946 Oct 17 13:52:37.848400 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1977/3901] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:52:36 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 2866 bytes in 1577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:52:37.860277 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-fd4eba41-8d4d-4a76-92eb-f62f6bc518b4 req-60c2fd3e-7f6c-4fc3-93fc-bc0d28d0e748 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90bfb179-c8b6-4810-a981-33b78a19b62c", "tag": "04de9280-0f5a-42ac-a484-a51a7ba1e205"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:52:37.920439 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-fd4eba41-8d4d-4a76-92eb-f62f6bc518b4 req-60c2fd3e-7f6c-4fc3-93fc-bc0d28d0e748 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:37.927072 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-fd4eba41-8d4d-4a76-92eb-f62f6bc518b4 req-60c2fd3e-7f6c-4fc3-93fc-bc0d28d0e748 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:37.929969 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-fd4eba41-8d4d-4a76-92eb-f62f6bc518b4 req-60c2fd3e-7f6c-4fc3-93fc-bc0d28d0e748 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:37.978551 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-fd4eba41-8d4d-4a76-92eb-f62f6bc518b4 req-60c2fd3e-7f6c-4fc3-93fc-bc0d28d0e748 service nova] Creating event network-changed:04de9280-0f5a-42ac-a484-a51a7ba1e205 for instance 90bfb179-c8b6-4810-a981-33b78a19b62c on n-h2-854247-14 Oct 17 13:52:37.994575 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-fd4eba41-8d4d-4a76-92eb-f62f6bc518b4 req-60c2fd3e-7f6c-4fc3-93fc-bc0d28d0e748 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144470 Oct 17 13:52:38.005797 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1978/3902] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:52:38.017720 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-00600c54-047d-4175-8063-b372d4423e5c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:38.022976 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-00600c54-047d-4175-8063-b372d4423e5c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 3197da72-e924-4f50-8c93-c3f3ff98e084] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:38.033868 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-00600c54-047d-4175-8063-b372d4423e5c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:38.034610 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-00600c54-047d-4175-8063-b372d4423e5c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:38.035864 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-00600c54-047d-4175-8063-b372d4423e5c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:38.037551 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-00600c54-047d-4175-8063-b372d4423e5c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:38.038269 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-00600c54-047d-4175-8063-b372d4423e5c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:38.040019 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-00600c54-047d-4175-8063-b372d4423e5c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:38.135460 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-00600c54-047d-4175-8063-b372d4423e5c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127841 Oct 17 13:52:38.142709 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1979/3903] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 13:52:38 2022] GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:52:38.154133 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-88237772-0611-4091-aedf-b5836122a4dd tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd544d4c0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:38.205150 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c7846cfe-fb58-49df-8435-a9ddd85cb5d2 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:38.222874 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c7846cfe-fb58-49df-8435-a9ddd85cb5d2 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c" status: 200 len: 1367 microversion: 2.1 time: 0.999000 Oct 17 13:52:38.223524 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1925/3904] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:37 2022] GET /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c => generated 1367 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:38.251639 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-88237772-0611-4091-aedf-b5836122a4dd tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/images/fb733fa0-36d1-4ec5-a621-b863abdc6233" status: 200 len: 1452 microversion: 2.1 time: 0.108987 Oct 17 13:52:38.253178 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1980/3905] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:52:38 2022] GET /compute/v2.1/images/fb733fa0-36d1-4ec5-a621-b863abdc6233 => generated 1452 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:38.641654 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-b05ae3fc-8aad-43df-8b15-939f1194c035 req-145dc3ae-ce7a-41fa-a7a1-55125581fe9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2", "name": "network-vif-deleted", "tag": "8fdca276-a9c8-4e30-8e15-4fc42ba37e91"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:52:38.649941 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:52:38.665810 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-b05ae3fc-8aad-43df-8b15-939f1194c035 req-145dc3ae-ce7a-41fa-a7a1-55125581fe9e service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:38.666676 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-b05ae3fc-8aad-43df-8b15-939f1194c035 req-145dc3ae-ce7a-41fa-a7a1-55125581fe9e service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:38.671985 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-b05ae3fc-8aad-43df-8b15-939f1194c035 req-145dc3ae-ce7a-41fa-a7a1-55125581fe9e service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:38.726108 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-b05ae3fc-8aad-43df-8b15-939f1194c035 req-145dc3ae-ce7a-41fa-a7a1-55125581fe9e service nova] Creating event network-vif-deleted:8fdca276-a9c8-4e30-8e15-4fc42ba37e91 for instance 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 on n-h1-854247-14 Oct 17 13:52:38.748968 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-b05ae3fc-8aad-43df-8b15-939f1194c035 req-145dc3ae-ce7a-41fa-a7a1-55125581fe9e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111412 Oct 17 13:52:38.755095 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1926/3906] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:52:38.887871 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b881f7f7-d38d-4a49-a968-82b72c246d95 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:38.890634 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b881f7f7-d38d-4a49-a968-82b72c246d95 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:38.910272 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b881f7f7-d38d-4a49-a968-82b72c246d95 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:38.913374 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b881f7f7-d38d-4a49-a968-82b72c246d95 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:38.914493 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b881f7f7-d38d-4a49-a968-82b72c246d95 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:38.916260 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b881f7f7-d38d-4a49-a968-82b72c246d95 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:38.919530 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b881f7f7-d38d-4a49-a968-82b72c246d95 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:38.920590 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b881f7f7-d38d-4a49-a968-82b72c246d95 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:39.150221 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bf417a76-9582-451b-bd6c-10f4c8779566 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:39.152612 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-bf417a76-9582-451b-bd6c-10f4c8779566 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 3197da72-e924-4f50-8c93-c3f3ff98e084] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:39.159129 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=20 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:52:39.179858 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bf417a76-9582-451b-bd6c-10f4c8779566 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:39.181158 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bf417a76-9582-451b-bd6c-10f4c8779566 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:39.185318 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bf417a76-9582-451b-bd6c-10f4c8779566 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:39.197670 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bf417a76-9582-451b-bd6c-10f4c8779566 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:39.201260 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bf417a76-9582-451b-bd6c-10f4c8779566 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:39.201945 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bf417a76-9582-451b-bd6c-10f4c8779566 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:39.309284 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-bf417a76-9582-451b-bd6c-10f4c8779566 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.163140 Oct 17 13:52:39.325290 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1927/3907] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 13:52:39 2022] GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084/os-volume_attachments => generated 197 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:52:39.342443 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-a8cac0e4-392c-4d73-b3b8-03c638e7db50 req-6f85a509-0dd8-406b-a342-44e165951c6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2", "name": "network-vif-unplugged", "status": "completed", "tag": "d03d577d-51fe-4dfb-b7f2-e27b813faec8"}, {"server_uuid": "6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2", "name": "network-vif-unplugged", "status": "completed", "tag": "c69dd4d3-7f9e-45b5-92dc-71c0e0407b40"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:52:39.369721 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-a8cac0e4-392c-4d73-b3b8-03c638e7db50 req-6f85a509-0dd8-406b-a342-44e165951c6c service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:39.370209 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-a8cac0e4-392c-4d73-b3b8-03c638e7db50 req-6f85a509-0dd8-406b-a342-44e165951c6c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:39.370642 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-a8cac0e4-392c-4d73-b3b8-03c638e7db50 req-6f85a509-0dd8-406b-a342-44e165951c6c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:39.371444 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b881f7f7-d38d-4a49-a968-82b72c246d95 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:39.384306 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b881f7f7-d38d-4a49-a968-82b72c246d95 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:39.386635 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b881f7f7-d38d-4a49-a968-82b72c246d95 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:39.392106 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b881f7f7-d38d-4a49-a968-82b72c246d95 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 2591 microversion: 2.32 time: 0.510253 Oct 17 13:52:39.393282 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1981/3908] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:52:38 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 2591 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:52:39.426123 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fd59e016-2d91-4ef8-9862-81d0e30409b9 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:39.426436 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-a8cac0e4-392c-4d73-b3b8-03c638e7db50 req-6f85a509-0dd8-406b-a342-44e165951c6c service nova] Creating event network-vif-unplugged:d03d577d-51fe-4dfb-b7f2-e27b813faec8 for instance 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 on n-h1-854247-14 Oct 17 13:52:39.427149 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-a8cac0e4-392c-4d73-b3b8-03c638e7db50 req-6f85a509-0dd8-406b-a342-44e165951c6c service nova] Creating event network-vif-unplugged:c69dd4d3-7f9e-45b5-92dc-71c0e0407b40 for instance 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 on n-h1-854247-14 Oct 17 13:52:39.427916 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-fd59e016-2d91-4ef8-9862-81d0e30409b9 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 90bfb179-c8b6-4810-a981-33b78a19b62c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:39.433679 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-a8cac0e4-392c-4d73-b3b8-03c638e7db50 req-6f85a509-0dd8-406b-a342-44e165951c6c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.097313 Oct 17 13:52:39.439639 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1928/3909] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:52:39.446435 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-eb31bb9a-7f63-4afa-ad8b-685c7cde7695 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd59bac10>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:39.450239 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fd59e016-2d91-4ef8-9862-81d0e30409b9 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:39.453608 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fd59e016-2d91-4ef8-9862-81d0e30409b9 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:39.455951 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fd59e016-2d91-4ef8-9862-81d0e30409b9 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:39.458936 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fd59e016-2d91-4ef8-9862-81d0e30409b9 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:39.459592 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fd59e016-2d91-4ef8-9862-81d0e30409b9 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:39.462427 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fd59e016-2d91-4ef8-9862-81d0e30409b9 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:39.543411 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-eb31bb9a-7f63-4afa-ad8b-685c7cde7695 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/images/fb733fa0-36d1-4ec5-a621-b863abdc6233" status: 200 len: 1452 microversion: 2.1 time: 0.102201 Oct 17 13:52:39.545138 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1929/3910] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:52:39 2022] GET /compute/v2.1/images/fb733fa0-36d1-4ec5-a621-b863abdc6233 => generated 1452 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:39.556802 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5d6b40c4-bbb1-4f7c-a1b0-785553d6e47e tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c649a299-3496-4d42-b923-464ea50e14de"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:52:39.569120 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5d6b40c4-bbb1-4f7c-a1b0-785553d6e47e tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:39.604719 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5d6b40c4-bbb1-4f7c-a1b0-785553d6e47e tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:39.605597 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5d6b40c4-bbb1-4f7c-a1b0-785553d6e47e tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:39.608420 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5d6b40c4-bbb1-4f7c-a1b0-785553d6e47e tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:39.610937 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5d6b40c4-bbb1-4f7c-a1b0-785553d6e47e tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:39.615333 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5d6b40c4-bbb1-4f7c-a1b0-785553d6e47e tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:39.615333 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5d6b40c4-bbb1-4f7c-a1b0-785553d6e47e tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:39.717222 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fd59e016-2d91-4ef8-9862-81d0e30409b9 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:39.729874 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fd59e016-2d91-4ef8-9862-81d0e30409b9 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c" status: 200 len: 1367 microversion: 2.1 time: 0.335136 Oct 17 13:52:39.748281 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1982/3911] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:39 2022] GET /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c => generated 1367 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:40.331674 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cabfb64d-e6df-4d26-9b1d-1388a4b64840 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:40.335936 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cabfb64d-e6df-4d26-9b1d-1388a4b64840 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 3197da72-e924-4f50-8c93-c3f3ff98e084] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:40.371574 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cabfb64d-e6df-4d26-9b1d-1388a4b64840 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:40.377796 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cabfb64d-e6df-4d26-9b1d-1388a4b64840 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:40.379783 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cabfb64d-e6df-4d26-9b1d-1388a4b64840 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:40.384588 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cabfb64d-e6df-4d26-9b1d-1388a4b64840 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:40.387886 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cabfb64d-e6df-4d26-9b1d-1388a4b64840 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:40.391283 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cabfb64d-e6df-4d26-9b1d-1388a4b64840 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:40.398931 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5d6b40c4-bbb1-4f7c-a1b0-785553d6e47e tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "POST /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.851808 Oct 17 13:52:40.402488 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1930/3912] 10.222.0.79 () {60 vars in 1323 bytes} [Mon Oct 17 13:52:39 2022] POST /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5/os-volume_attachments => generated 194 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:52:40.452384 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-142fa1f5-75d2-481c-8fca-1ac1d5c0105e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:40.471182 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-142fa1f5-75d2-481c-8fca-1ac1d5c0105e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:40.486830 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-142fa1f5-75d2-481c-8fca-1ac1d5c0105e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:40.492211 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-142fa1f5-75d2-481c-8fca-1ac1d5c0105e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:40.492694 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-142fa1f5-75d2-481c-8fca-1ac1d5c0105e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:40.493470 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-142fa1f5-75d2-481c-8fca-1ac1d5c0105e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:40.493943 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-142fa1f5-75d2-481c-8fca-1ac1d5c0105e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:40.494375 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-142fa1f5-75d2-481c-8fca-1ac1d5c0105e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:40.522668 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cabfb64d-e6df-4d26-9b1d-1388a4b64840 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.193314 Oct 17 13:52:40.526220 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1983/3913] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 13:52:40 2022] GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084/os-volume_attachments => generated 197 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:52:40.559049 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cc3d31b4-1d23-4cf9-9bf5-eb678b464a73 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd546aaf0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:40.645698 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cc3d31b4-1d23-4cf9-9bf5-eb678b464a73 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/images/fb733fa0-36d1-4ec5-a621-b863abdc6233" status: 200 len: 1452 microversion: 2.1 time: 0.090504 Oct 17 13:52:40.646608 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1984/3914] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:52:40 2022] GET /compute/v2.1/images/fb733fa0-36d1-4ec5-a621-b863abdc6233 => generated 1452 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:52:40.758518 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-610dacd3-fcdc-4b32-b643-e03c713724a4 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:40.766483 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-610dacd3-fcdc-4b32-b643-e03c713724a4 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 90bfb179-c8b6-4810-a981-33b78a19b62c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:40.785747 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-610dacd3-fcdc-4b32-b643-e03c713724a4 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:40.789309 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-610dacd3-fcdc-4b32-b643-e03c713724a4 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:40.793563 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-610dacd3-fcdc-4b32-b643-e03c713724a4 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:40.799645 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-610dacd3-fcdc-4b32-b643-e03c713724a4 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:40.806385 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-610dacd3-fcdc-4b32-b643-e03c713724a4 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:40.814893 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-610dacd3-fcdc-4b32-b643-e03c713724a4 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:41.181299 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-142fa1f5-75d2-481c-8fca-1ac1d5c0105e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:41.213040 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-142fa1f5-75d2-481c-8fca-1ac1d5c0105e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:41.221126 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-142fa1f5-75d2-481c-8fca-1ac1d5c0105e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:41.239068 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-142fa1f5-75d2-481c-8fca-1ac1d5c0105e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 2544 microversion: 2.32 time: 0.795760 Oct 17 13:52:41.243336 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1931/3915] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:52:40 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 2544 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:52:41.258213 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-fa6f56bf-696d-4cd7-92f3-ef4036ac1500 req-5a329a28-e839-49a6-87ce-5851ef4b3d74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2", "name": "network-vif-deleted", "tag": "09cd6d52-dd88-453b-97c9-b02b47bbb3bb"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:52:41.290887 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-610dacd3-fcdc-4b32-b643-e03c713724a4 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:41.311698 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-610dacd3-fcdc-4b32-b643-e03c713724a4 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c" status: 200 len: 1367 microversion: 2.1 time: 0.556374 Oct 17 13:52:41.314467 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1985/3916] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:40 2022] GET /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c => generated 1367 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:41.328136 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-fa6f56bf-696d-4cd7-92f3-ef4036ac1500 req-5a329a28-e839-49a6-87ce-5851ef4b3d74 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:41.336332 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-fa6f56bf-696d-4cd7-92f3-ef4036ac1500 req-5a329a28-e839-49a6-87ce-5851ef4b3d74 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:41.339410 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-fa6f56bf-696d-4cd7-92f3-ef4036ac1500 req-5a329a28-e839-49a6-87ce-5851ef4b3d74 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:41.398112 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-fa6f56bf-696d-4cd7-92f3-ef4036ac1500 req-5a329a28-e839-49a6-87ce-5851ef4b3d74 service nova] Creating event network-vif-deleted:09cd6d52-dd88-453b-97c9-b02b47bbb3bb for instance 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 on n-h1-854247-14 Oct 17 13:52:41.418315 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-fa6f56bf-696d-4cd7-92f3-ef4036ac1500 req-5a329a28-e839-49a6-87ce-5851ef4b3d74 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171738 Oct 17 13:52:41.422006 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1932/3917] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:52:41.540557 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-80e453cb-8444-44b1-ad00-95d7a0d6286e tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:41.543269 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-80e453cb-8444-44b1-ad00-95d7a0d6286e tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 3197da72-e924-4f50-8c93-c3f3ff98e084] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:41.570328 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-80e453cb-8444-44b1-ad00-95d7a0d6286e tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:41.572553 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-80e453cb-8444-44b1-ad00-95d7a0d6286e tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:41.573133 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-80e453cb-8444-44b1-ad00-95d7a0d6286e tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:41.574014 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-80e453cb-8444-44b1-ad00-95d7a0d6286e tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:41.579643 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-80e453cb-8444-44b1-ad00-95d7a0d6286e tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:41.580491 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-80e453cb-8444-44b1-ad00-95d7a0d6286e tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:41.598513 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=100 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:52:41.666187 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ac7788ea-db42-4936-8aa3-408c62800878 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd9a59040>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:41.756039 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-80e453cb-8444-44b1-ad00-95d7a0d6286e tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.220910 Oct 17 13:52:41.778657 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1986/3918] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 13:52:41 2022] GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084/os-volume_attachments => generated 25 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:52:42.017358 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d30ec987-3b43-485c-b119-3e151bdd7e98 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:52:42.020055 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d30ec987-3b43-485c-b119-3e151bdd7e98 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 68363fdf-f661-4b7c-abdc-7a8a85efa83a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:42.045611 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d30ec987-3b43-485c-b119-3e151bdd7e98 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:42.046256 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d30ec987-3b43-485c-b119-3e151bdd7e98 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:42.047801 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d30ec987-3b43-485c-b119-3e151bdd7e98 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:42.048659 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d30ec987-3b43-485c-b119-3e151bdd7e98 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:42.055866 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d30ec987-3b43-485c-b119-3e151bdd7e98 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:42.056459 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d30ec987-3b43-485c-b119-3e151bdd7e98 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:42.167808 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-d30ec987-3b43-485c-b119-3e151bdd7e98 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] HTTP exception thrown: Cannot 'reboot' instance 68363fdf-f661-4b7c-abdc-7a8a85efa83a while it is in vm_state rescued Oct 17 13:52:42.179330 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d30ec987-3b43-485c-b119-3e151bdd7e98 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Request method failure captured: Oct 17 13:52:42.179330 n-d-854247-14 devstack@n-api.service[127016]: request: POST /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a/action HTTP/1.1 Oct 17 13:52:42.179330 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:52:42.179330 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:52:42.179330 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:52:42.179330 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 28 Oct 17 13:52:42.179330 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:52:42.179330 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:52:42.179330 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:52:42.179330 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:52:42.179330 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTV0lGewBAd5oX7RsuswRRrYdH_s7fnCDLNRSaJQAxErmqZOT5QT6523TfZqZvgb4tWrIGVLDqv0foQ4mpFwe91mdGAxx6JOfjpLIqY8Vnvh6NrynvpuS4ywkAJAwUfpPeJ0dauW6Gj_xg5-jDhUd1iFTLiSXh_-SOzh7_iyTjRI7Ovs Oct 17 13:52:42.179330 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:52:42.179330 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:52:42.179330 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:52:42.179330 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:52:42.179330 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:52:42.179330 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:52:42.179330 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 08068aeba86c4e718ba1e25c68fd3259 Oct 17 13:52:42.179330 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1627831718 Oct 17 13:52:42.179330 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:52:42.179330 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:52:42.179330 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/08068aeba86c4e718ba1e25c68fd3259"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/08068aeba86c4e718ba1e25c68fd3259"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/08068aeba86c4e718ba1e25c68fd3259"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_08068aeba86c4e718ba1e25c68fd3259", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:52:42.179330 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1627831718 Oct 17 13:52:42.179330 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 08068aeba86c4e718ba1e25c68fd3259 Oct 17 13:52:42.179330 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1627831718 Oct 17 13:52:42.179330 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServerRescueNegativeTestJSON-1627831718-project Oct 17 13:52:42.179330 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:52:42.179330 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:52:42.179330 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: d56b91ce42894bafac5ddb16ad6f037b Oct 17 13:52:42.179330 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1627831718-project Oct 17 13:52:42.179330 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:52:42.179330 n-d-854247-14 devstack@n-api.service[127016]: {"reboot": {"type": "HARD"}} Oct 17 13:52:42.179330 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:52:42.179330 n-d-854247-14 devstack@n-api.service[127016]: exception: Cannot 'reboot' instance 68363fdf-f661-4b7c-abdc-7a8a85efa83a while it is in vm_state rescued Oct 17 13:52:42.179330 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '68363fdf-f661-4b7c-abdc-7a8a85efa83a', 'body': {'reboot': {'type': 'HARD'}}} Oct 17 13:52:42.179330 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:52:42.179330 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:52:42.179330 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 17 13:52:42.179330 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 17 13:52:42.179330 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 13:52:42.179330 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:52:42.179330 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 17 13:52:42.179330 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 17 13:52:42.179330 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 13:52:42.179330 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 13:52:42.179330 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 68363fdf-f661-4b7c-abdc-7a8a85efa83a in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 17 13:52:42.179330 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:52:42.179330 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:52:42.179330 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:52:42.179330 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:52:42.179330 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:52:42.179330 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:52:42.179330 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:52:42.179330 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:52:42.179330 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:52:42.179330 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:52:42.179330 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:52:42.179330 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:52:42.179330 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 17 13:52:42.179330 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 17 13:52:42.179330 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 13:52:42.179330 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 13:52:42.183557 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 68363fdf-f661-4b7c-abdc-7a8a85efa83a while it is in vm_state rescued Oct 17 13:52:42.183557 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:52:42.183557 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:52:42.183557 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:52:42.183557 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:52:42.183557 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:52:42.183557 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:52:42.183557 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:52:42.183557 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:52:42.183557 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 68363fdf-f661-4b7c-abdc-7a8a85efa83a while it is in vm_state rescued Oct 17 13:52:42.183557 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:52:42.185007 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d30ec987-3b43-485c-b119-3e151bdd7e98 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Returning 409 to user: Cannot 'reboot' instance 68363fdf-f661-4b7c-abdc-7a8a85efa83a while it is in vm_state rescued {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:52:42.188619 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d30ec987-3b43-485c-b119-3e151bdd7e98 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "POST /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a/action" status: 409 len: 145 microversion: 2.1 time: 0.177394 Oct 17 13:52:42.195885 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1987/3919] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:52:42 2022] POST /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a/action => generated 145 bytes in 185 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:52:42.215708 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-701a2fa9-3134-41b9-961f-ad3fe70e4697 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:52:42.235085 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-701a2fa9-3134-41b9-961f-ad3fe70e4697 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 68363fdf-f661-4b7c-abdc-7a8a85efa83a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:42.267009 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-701a2fa9-3134-41b9-961f-ad3fe70e4697 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:42.269406 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-701a2fa9-3134-41b9-961f-ad3fe70e4697 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:42.274341 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-701a2fa9-3134-41b9-961f-ad3fe70e4697 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:42.277887 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-701a2fa9-3134-41b9-961f-ad3fe70e4697 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:42.280546 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-701a2fa9-3134-41b9-961f-ad3fe70e4697 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:42.281704 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-701a2fa9-3134-41b9-961f-ad3fe70e4697 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:42.393027 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-701a2fa9-3134-41b9-961f-ad3fe70e4697 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] HTTP exception thrown: Cannot 'rebuild' instance 68363fdf-f661-4b7c-abdc-7a8a85efa83a while it is in vm_state rescued Oct 17 13:52:42.399643 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-701a2fa9-3134-41b9-961f-ad3fe70e4697 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Request method failure captured: Oct 17 13:52:42.399643 n-d-854247-14 devstack@n-api.service[127016]: request: POST /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a/action HTTP/1.1 Oct 17 13:52:42.399643 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:52:42.399643 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:52:42.399643 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:52:42.399643 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 65 Oct 17 13:52:42.399643 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:52:42.399643 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:52:42.399643 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:52:42.399643 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:52:42.399643 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTV0lGewBAd5oX7RsuswRRrYdH_s7fnCDLNRSaJQAxErmqZOT5QT6523TfZqZvgb4tWrIGVLDqv0foQ4mpFwe91mdGAxx6JOfjpLIqY8Vnvh6NrynvpuS4ywkAJAwUfpPeJ0dauW6Gj_xg5-jDhUd1iFTLiSXh_-SOzh7_iyTjRI7Ovs Oct 17 13:52:42.399643 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:52:42.399643 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:52:42.399643 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:52:42.399643 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:52:42.399643 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:52:42.399643 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:52:42.399643 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 08068aeba86c4e718ba1e25c68fd3259 Oct 17 13:52:42.399643 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1627831718 Oct 17 13:52:42.399643 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:52:42.399643 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:52:42.399643 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/08068aeba86c4e718ba1e25c68fd3259"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/08068aeba86c4e718ba1e25c68fd3259"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/08068aeba86c4e718ba1e25c68fd3259"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_08068aeba86c4e718ba1e25c68fd3259", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:52:42.399643 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1627831718 Oct 17 13:52:42.399643 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 08068aeba86c4e718ba1e25c68fd3259 Oct 17 13:52:42.399643 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1627831718 Oct 17 13:52:42.399643 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServerRescueNegativeTestJSON-1627831718-project Oct 17 13:52:42.399643 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:52:42.399643 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:52:42.399643 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: d56b91ce42894bafac5ddb16ad6f037b Oct 17 13:52:42.399643 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1627831718-project Oct 17 13:52:42.399643 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 13:52:42.399643 n-d-854247-14 devstack@n-api.service[127016]: {"rebuild": {"imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07"}} Oct 17 13:52:42.399643 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:52:42.399643 n-d-854247-14 devstack@n-api.service[127016]: exception: Cannot 'rebuild' instance 68363fdf-f661-4b7c-abdc-7a8a85efa83a while it is in vm_state rescued Oct 17 13:52:42.399643 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '68363fdf-f661-4b7c-abdc-7a8a85efa83a', 'body': {'rebuild': {'imageRef': '0743b21b-a6ff-4d02-897c-eabb68c3ba07'}}} Oct 17 13:52:42.399643 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:52:42.399643 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:52:42.399643 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 17 13:52:42.399643 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 17 13:52:42.399643 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 17 13:52:42.399643 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 13:52:42.399643 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 17 13:52:42.399643 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 13:52:42.399643 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 13:52:42.399643 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:52:42.399643 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 13:52:42.399643 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 13:52:42.399643 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 68363fdf-f661-4b7c-abdc-7a8a85efa83a in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 17 13:52:42.399643 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:52:42.399643 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:52:42.399643 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:52:42.399643 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:52:42.399643 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:52:42.399643 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:52:42.399643 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:52:42.399643 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:52:42.399643 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:52:42.399643 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:52:42.399643 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:52:42.399643 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:52:42.399643 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:52:42.399643 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:52:42.399643 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:52:42.403885 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:52:42.403885 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 17 13:52:42.403885 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 17 13:52:42.403885 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 17 13:52:42.403885 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 13:52:42.403885 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 13:52:42.403885 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 68363fdf-f661-4b7c-abdc-7a8a85efa83a while it is in vm_state rescued Oct 17 13:52:42.403885 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:52:42.403885 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:52:42.403885 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:52:42.403885 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:52:42.403885 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:52:42.403885 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:52:42.403885 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:52:42.403885 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:52:42.403885 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 68363fdf-f661-4b7c-abdc-7a8a85efa83a while it is in vm_state rescued Oct 17 13:52:42.403885 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:52:42.417123 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-701a2fa9-3134-41b9-961f-ad3fe70e4697 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Returning 409 to user: Cannot 'rebuild' instance 68363fdf-f661-4b7c-abdc-7a8a85efa83a while it is in vm_state rescued {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:52:42.418021 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-701a2fa9-3134-41b9-961f-ad3fe70e4697 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "POST /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a/action" status: 409 len: 146 microversion: 2.1 time: 0.217390 Oct 17 13:52:42.418633 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1988/3920] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:52:42 2022] POST /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a/action => generated 146 bytes in 219 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:52:42.427923 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4a749931-09a1-494b-8be5-ffbcf1c62180 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:42.428544 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4a749931-09a1-494b-8be5-ffbcf1c62180 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:42.446847 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4a749931-09a1-494b-8be5-ffbcf1c62180 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:42.447379 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4a749931-09a1-494b-8be5-ffbcf1c62180 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:42.447819 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4a749931-09a1-494b-8be5-ffbcf1c62180 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:42.448530 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4a749931-09a1-494b-8be5-ffbcf1c62180 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:42.448989 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4a749931-09a1-494b-8be5-ffbcf1c62180 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:42.449415 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4a749931-09a1-494b-8be5-ffbcf1c62180 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:42.729770 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4a749931-09a1-494b-8be5-ffbcf1c62180 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:42.753254 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4a749931-09a1-494b-8be5-ffbcf1c62180 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:42.758172 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4a749931-09a1-494b-8be5-ffbcf1c62180 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:42.763468 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4a749931-09a1-494b-8be5-ffbcf1c62180 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 2211 microversion: 2.32 time: 0.343313 Oct 17 13:52:42.765488 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1989/3921] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:52:42 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 2211 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:52:42.772125 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b3949cfb-9645-4208-b5ae-ee3fbe6d6443 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:42.778584 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b3949cfb-9645-4208-b5ae-ee3fbe6d6443 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 90bfb179-c8b6-4810-a981-33b78a19b62c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:42.794473 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b3949cfb-9645-4208-b5ae-ee3fbe6d6443 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:42.796457 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b3949cfb-9645-4208-b5ae-ee3fbe6d6443 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:42.798481 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b3949cfb-9645-4208-b5ae-ee3fbe6d6443 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:42.802829 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b3949cfb-9645-4208-b5ae-ee3fbe6d6443 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:42.803725 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b3949cfb-9645-4208-b5ae-ee3fbe6d6443 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:42.804762 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b3949cfb-9645-4208-b5ae-ee3fbe6d6443 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:43.193462 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b3949cfb-9645-4208-b5ae-ee3fbe6d6443 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:43.208114 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b3949cfb-9645-4208-b5ae-ee3fbe6d6443 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c" status: 200 len: 1367 microversion: 2.1 time: 0.436403 Oct 17 13:52:43.227906 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1990/3922] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:42 2022] GET /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c => generated 1367 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:43.248481 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-afbf6a48-1e4a-4c55-8f93-5d7c2bbebae2 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:43.249091 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-afbf6a48-1e4a-4c55-8f93-5d7c2bbebae2 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 3197da72-e924-4f50-8c93-c3f3ff98e084] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:43.262857 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-afbf6a48-1e4a-4c55-8f93-5d7c2bbebae2 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:43.266377 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-afbf6a48-1e4a-4c55-8f93-5d7c2bbebae2 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:43.266912 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-afbf6a48-1e4a-4c55-8f93-5d7c2bbebae2 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:43.267715 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-afbf6a48-1e4a-4c55-8f93-5d7c2bbebae2 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:43.268192 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-afbf6a48-1e4a-4c55-8f93-5d7c2bbebae2 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:43.268631 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-afbf6a48-1e4a-4c55-8f93-5d7c2bbebae2 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:43.342596 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-afbf6a48-1e4a-4c55-8f93-5d7c2bbebae2 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 3197da72-e924-4f50-8c93-c3f3ff98e084] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:52:43.601285 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-afbf6a48-1e4a-4c55-8f93-5d7c2bbebae2 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084" status: 204 len: 0 microversion: 2.1 time: 0.366739 Oct 17 13:52:43.602190 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1991/3923] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:52:43 2022] DELETE /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:52:43.618569 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-a0919184-93e3-47d0-97d0-677674a6655f req-b53985d5-e22b-4140-85cc-55b7953d836f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2", "name": "network-vif-deleted", "tag": "d03d577d-51fe-4dfb-b7f2-e27b813faec8"}, {"server_uuid": "6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2", "name": "network-vif-deleted", "tag": "c69dd4d3-7f9e-45b5-92dc-71c0e0407b40"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:52:43.651982 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-a0919184-93e3-47d0-97d0-677674a6655f req-b53985d5-e22b-4140-85cc-55b7953d836f service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:43.652741 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-a0919184-93e3-47d0-97d0-677674a6655f req-b53985d5-e22b-4140-85cc-55b7953d836f service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:43.653424 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-a0919184-93e3-47d0-97d0-677674a6655f req-b53985d5-e22b-4140-85cc-55b7953d836f service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:43.684402 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-a0919184-93e3-47d0-97d0-677674a6655f req-b53985d5-e22b-4140-85cc-55b7953d836f service nova] Creating event network-vif-deleted:d03d577d-51fe-4dfb-b7f2-e27b813faec8 for instance 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 on n-h1-854247-14 Oct 17 13:52:43.686737 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-a0919184-93e3-47d0-97d0-677674a6655f req-b53985d5-e22b-4140-85cc-55b7953d836f service nova] Creating event network-vif-deleted:c69dd4d3-7f9e-45b5-92dc-71c0e0407b40 for instance 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 on n-h1-854247-14 Oct 17 13:52:43.702831 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-a0919184-93e3-47d0-97d0-677674a6655f req-b53985d5-e22b-4140-85cc-55b7953d836f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.094087 Oct 17 13:52:43.705242 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1992/3924] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:52:43.719818 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b4e8729b-ff9a-4b95-8bd8-3e0f39a2a3c7 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:43.720579 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b4e8729b-ff9a-4b95-8bd8-3e0f39a2a3c7 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 3197da72-e924-4f50-8c93-c3f3ff98e084] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:43.736404 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b4e8729b-ff9a-4b95-8bd8-3e0f39a2a3c7 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:43.737587 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b4e8729b-ff9a-4b95-8bd8-3e0f39a2a3c7 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:43.738784 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b4e8729b-ff9a-4b95-8bd8-3e0f39a2a3c7 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:43.739987 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b4e8729b-ff9a-4b95-8bd8-3e0f39a2a3c7 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:43.740448 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b4e8729b-ff9a-4b95-8bd8-3e0f39a2a3c7 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:43.740883 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b4e8729b-ff9a-4b95-8bd8-3e0f39a2a3c7 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:44.017742 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b4e8729b-ff9a-4b95-8bd8-3e0f39a2a3c7 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:44.055473 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b4e8729b-ff9a-4b95-8bd8-3e0f39a2a3c7 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084" status: 200 len: 1689 microversion: 2.1 time: 0.345282 Oct 17 13:52:44.076864 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1993/3925] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:43 2022] GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084 => generated 1689 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:44.089716 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-174e3e8c-3dbe-4415-86a0-6656fb6910e6 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:44.092070 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-174e3e8c-3dbe-4415-86a0-6656fb6910e6 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:44.108915 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-174e3e8c-3dbe-4415-86a0-6656fb6910e6 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:44.109447 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-174e3e8c-3dbe-4415-86a0-6656fb6910e6 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:44.111723 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-174e3e8c-3dbe-4415-86a0-6656fb6910e6 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:44.113367 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-174e3e8c-3dbe-4415-86a0-6656fb6910e6 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:44.115010 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-174e3e8c-3dbe-4415-86a0-6656fb6910e6 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:44.115588 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-174e3e8c-3dbe-4415-86a0-6656fb6910e6 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:44.329231 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-174e3e8c-3dbe-4415-86a0-6656fb6910e6 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:44.343188 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-174e3e8c-3dbe-4415-86a0-6656fb6910e6 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:44.359092 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-174e3e8c-3dbe-4415-86a0-6656fb6910e6 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:44.366044 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-174e3e8c-3dbe-4415-86a0-6656fb6910e6 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1604 microversion: 2.32 time: 0.284706 Oct 17 13:52:44.376933 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1994/3926] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:52:44 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1604 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:52:44.390964 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-b4401013-a493-4496-80d4-87ae3b649c08 req-8891e4b5-bfbc-4f80-8e5f-28b56cdf0481 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "419a7ac0-9332-481d-bc66-3ad5b6a9db81", "name": "network-vif-plugged", "status": "completed", "tag": "8c4e8542-c161-4443-8115-64e41c66a3fe"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:52:44.428193 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-b4401013-a493-4496-80d4-87ae3b649c08 req-8891e4b5-bfbc-4f80-8e5f-28b56cdf0481 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:44.432318 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-b4401013-a493-4496-80d4-87ae3b649c08 req-8891e4b5-bfbc-4f80-8e5f-28b56cdf0481 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:44.434216 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-b4401013-a493-4496-80d4-87ae3b649c08 req-8891e4b5-bfbc-4f80-8e5f-28b56cdf0481 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:44.489081 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-b4401013-a493-4496-80d4-87ae3b649c08 req-8891e4b5-bfbc-4f80-8e5f-28b56cdf0481 service nova] Creating event network-vif-plugged:8c4e8542-c161-4443-8115-64e41c66a3fe for instance 419a7ac0-9332-481d-bc66-3ad5b6a9db81 on n-h2-854247-14 Oct 17 13:52:44.513171 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-b4401013-a493-4496-80d4-87ae3b649c08 req-8891e4b5-bfbc-4f80-8e5f-28b56cdf0481 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143169 Oct 17 13:52:44.524044 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1995/3927] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:52:44.543666 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0e181f66-9037-4501-af1e-6c4f2bb21803 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:44.544729 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0e181f66-9037-4501-af1e-6c4f2bb21803 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 90bfb179-c8b6-4810-a981-33b78a19b62c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:44.556075 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0e181f66-9037-4501-af1e-6c4f2bb21803 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:44.558201 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0e181f66-9037-4501-af1e-6c4f2bb21803 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:44.559263 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0e181f66-9037-4501-af1e-6c4f2bb21803 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:44.560653 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0e181f66-9037-4501-af1e-6c4f2bb21803 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:44.562743 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0e181f66-9037-4501-af1e-6c4f2bb21803 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:44.563332 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0e181f66-9037-4501-af1e-6c4f2bb21803 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:44.921025 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0e181f66-9037-4501-af1e-6c4f2bb21803 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:44.931544 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0e181f66-9037-4501-af1e-6c4f2bb21803 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c" status: 200 len: 1367 microversion: 2.1 time: 0.403141 Oct 17 13:52:44.944370 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1996/3928] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:44 2022] GET /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c => generated 1367 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:45.085994 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-62b772bf-2a8d-48c5-a3c2-3d53cbb4de68 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:45.086698 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-62b772bf-2a8d-48c5-a3c2-3d53cbb4de68 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 3197da72-e924-4f50-8c93-c3f3ff98e084] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:45.103667 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-62b772bf-2a8d-48c5-a3c2-3d53cbb4de68 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:45.104176 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-62b772bf-2a8d-48c5-a3c2-3d53cbb4de68 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:45.106238 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-62b772bf-2a8d-48c5-a3c2-3d53cbb4de68 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:45.107379 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-62b772bf-2a8d-48c5-a3c2-3d53cbb4de68 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:45.107668 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-62b772bf-2a8d-48c5-a3c2-3d53cbb4de68 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:45.111080 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-62b772bf-2a8d-48c5-a3c2-3d53cbb4de68 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:45.462704 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-62b772bf-2a8d-48c5-a3c2-3d53cbb4de68 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:45.470936 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-62b772bf-2a8d-48c5-a3c2-3d53cbb4de68 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084" status: 200 len: 1689 microversion: 2.1 time: 0.390414 Oct 17 13:52:45.475758 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1997/3929] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:45 2022] GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084 => generated 1689 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:45.491421 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b6d27f5e-dd27-488d-8e59-b4fe2f8cf699 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:45.492045 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b6d27f5e-dd27-488d-8e59-b4fe2f8cf699 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:45.517250 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b6d27f5e-dd27-488d-8e59-b4fe2f8cf699 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:45.517502 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b6d27f5e-dd27-488d-8e59-b4fe2f8cf699 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:45.517942 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b6d27f5e-dd27-488d-8e59-b4fe2f8cf699 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:45.518658 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b6d27f5e-dd27-488d-8e59-b4fe2f8cf699 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:45.519111 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b6d27f5e-dd27-488d-8e59-b4fe2f8cf699 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:45.519558 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b6d27f5e-dd27-488d-8e59-b4fe2f8cf699 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:45.694667 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b6d27f5e-dd27-488d-8e59-b4fe2f8cf699 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:45.716721 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b6d27f5e-dd27-488d-8e59-b4fe2f8cf699 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:45.722616 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b6d27f5e-dd27-488d-8e59-b4fe2f8cf699 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:45.724336 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b6d27f5e-dd27-488d-8e59-b4fe2f8cf699 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1604 microversion: 2.32 time: 0.247539 Oct 17 13:52:45.727324 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1998/3930] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:52:45 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1604 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:52:45.957910 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-24a2085d-0434-4692-ae11-2c349110fd08 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:45.957910 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-24a2085d-0434-4692-ae11-2c349110fd08 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 90bfb179-c8b6-4810-a981-33b78a19b62c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:45.967205 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-24a2085d-0434-4692-ae11-2c349110fd08 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:45.970017 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-24a2085d-0434-4692-ae11-2c349110fd08 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:45.970017 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-24a2085d-0434-4692-ae11-2c349110fd08 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:45.970017 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-24a2085d-0434-4692-ae11-2c349110fd08 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:45.970017 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-24a2085d-0434-4692-ae11-2c349110fd08 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:45.970017 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-24a2085d-0434-4692-ae11-2c349110fd08 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:46.301392 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-24a2085d-0434-4692-ae11-2c349110fd08 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:46.312965 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-24a2085d-0434-4692-ae11-2c349110fd08 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c" status: 200 len: 1367 microversion: 2.1 time: 0.360376 Oct 17 13:52:46.314191 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 1999/3931] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:45 2022] GET /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c => generated 1367 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:46.501704 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-43ce588f-5f59-43ef-9f6b-6971f8e96576 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:46.501704 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-43ce588f-5f59-43ef-9f6b-6971f8e96576 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 3197da72-e924-4f50-8c93-c3f3ff98e084] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:46.521643 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-43ce588f-5f59-43ef-9f6b-6971f8e96576 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:46.522739 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-43ce588f-5f59-43ef-9f6b-6971f8e96576 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:46.523871 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-43ce588f-5f59-43ef-9f6b-6971f8e96576 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:46.524639 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-43ce588f-5f59-43ef-9f6b-6971f8e96576 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:46.525097 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-43ce588f-5f59-43ef-9f6b-6971f8e96576 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:46.539691 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-43ce588f-5f59-43ef-9f6b-6971f8e96576 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:46.836778 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-43ce588f-5f59-43ef-9f6b-6971f8e96576 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:46.849618 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-43ce588f-5f59-43ef-9f6b-6971f8e96576 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084" status: 200 len: 1689 microversion: 2.1 time: 0.353760 Oct 17 13:52:46.850860 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2000/3932] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:46 2022] GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084 => generated 1689 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:52:46.864216 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-0264096d-6c6f-4575-b248-4f83c4becb77 req-1e3d7f62-d80e-4a66-a0d9-568af8b57660 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90bfb179-c8b6-4810-a981-33b78a19b62c", "name": "network-vif-plugged", "status": "completed", "tag": "04de9280-0f5a-42ac-a484-a51a7ba1e205"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:52:46.876647 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-0264096d-6c6f-4575-b248-4f83c4becb77 req-1e3d7f62-d80e-4a66-a0d9-568af8b57660 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:46.877377 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-0264096d-6c6f-4575-b248-4f83c4becb77 req-1e3d7f62-d80e-4a66-a0d9-568af8b57660 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:46.877953 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-0264096d-6c6f-4575-b248-4f83c4becb77 req-1e3d7f62-d80e-4a66-a0d9-568af8b57660 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:46.906474 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-0264096d-6c6f-4575-b248-4f83c4becb77 req-1e3d7f62-d80e-4a66-a0d9-568af8b57660 service nova] Creating event network-vif-plugged:04de9280-0f5a-42ac-a484-a51a7ba1e205 for instance 90bfb179-c8b6-4810-a981-33b78a19b62c on n-h2-854247-14 Oct 17 13:52:46.925564 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-0264096d-6c6f-4575-b248-4f83c4becb77 req-1e3d7f62-d80e-4a66-a0d9-568af8b57660 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072916 Oct 17 13:52:46.929260 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2001/3933] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:52:46.944471 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-74a81a6e-b692-4562-9bf7-85b11c7f19b6 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:46.945602 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-74a81a6e-b692-4562-9bf7-85b11c7f19b6 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:46.976130 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-74a81a6e-b692-4562-9bf7-85b11c7f19b6 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:46.976767 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-74a81a6e-b692-4562-9bf7-85b11c7f19b6 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:46.984278 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-74a81a6e-b692-4562-9bf7-85b11c7f19b6 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:46.985288 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-74a81a6e-b692-4562-9bf7-85b11c7f19b6 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:46.986003 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-74a81a6e-b692-4562-9bf7-85b11c7f19b6 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:46.986511 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-74a81a6e-b692-4562-9bf7-85b11c7f19b6 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:47.144819 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-74a81a6e-b692-4562-9bf7-85b11c7f19b6 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:47.169728 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-74a81a6e-b692-4562-9bf7-85b11c7f19b6 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:47.171447 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-74a81a6e-b692-4562-9bf7-85b11c7f19b6 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:47.172721 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-74a81a6e-b692-4562-9bf7-85b11c7f19b6 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1604 microversion: 2.32 time: 0.242263 Oct 17 13:52:47.173503 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2002/3934] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:52:46 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1604 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:52:47.340661 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8e86749f-716f-4f20-8ee6-1de7905d026d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:47.341338 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8e86749f-716f-4f20-8ee6-1de7905d026d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 90bfb179-c8b6-4810-a981-33b78a19b62c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:47.354692 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8e86749f-716f-4f20-8ee6-1de7905d026d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:47.355129 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8e86749f-716f-4f20-8ee6-1de7905d026d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:47.355648 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8e86749f-716f-4f20-8ee6-1de7905d026d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:47.356382 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8e86749f-716f-4f20-8ee6-1de7905d026d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:47.356877 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8e86749f-716f-4f20-8ee6-1de7905d026d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:47.357306 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8e86749f-716f-4f20-8ee6-1de7905d026d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:47.720930 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8e86749f-716f-4f20-8ee6-1de7905d026d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:47.724089 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:52:47.742930 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8e86749f-716f-4f20-8ee6-1de7905d026d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c" status: 200 len: 1367 microversion: 2.1 time: 0.406116 Oct 17 13:52:47.744276 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2003/3935] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:47 2022] GET /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c => generated 1367 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:47.878808 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-df251984-dc0c-49d6-b831-df4a79cf897f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:47.879903 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-df251984-dc0c-49d6-b831-df4a79cf897f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 3197da72-e924-4f50-8c93-c3f3ff98e084] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:47.891560 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df251984-dc0c-49d6-b831-df4a79cf897f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:47.892459 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df251984-dc0c-49d6-b831-df4a79cf897f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:47.893104 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df251984-dc0c-49d6-b831-df4a79cf897f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:47.894025 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df251984-dc0c-49d6-b831-df4a79cf897f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:47.894678 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df251984-dc0c-49d6-b831-df4a79cf897f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:47.895377 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df251984-dc0c-49d6-b831-df4a79cf897f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:48.201791 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-df251984-dc0c-49d6-b831-df4a79cf897f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:48.216486 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-df251984-dc0c-49d6-b831-df4a79cf897f tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084" status: 200 len: 1689 microversion: 2.1 time: 0.341414 Oct 17 13:52:48.223771 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2004/3936] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:47 2022] GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084 => generated 1689 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:52:48.233820 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e7a06efe-5041-4706-aae8-a00325ce528e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:48.234437 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e7a06efe-5041-4706-aae8-a00325ce528e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:48.253835 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7a06efe-5041-4706-aae8-a00325ce528e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:48.254334 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7a06efe-5041-4706-aae8-a00325ce528e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:48.255501 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7a06efe-5041-4706-aae8-a00325ce528e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:48.257440 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7a06efe-5041-4706-aae8-a00325ce528e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:48.257912 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7a06efe-5041-4706-aae8-a00325ce528e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:48.265010 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7a06efe-5041-4706-aae8-a00325ce528e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:48.458847 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e7a06efe-5041-4706-aae8-a00325ce528e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:48.472305 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e7a06efe-5041-4706-aae8-a00325ce528e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:48.480930 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e7a06efe-5041-4706-aae8-a00325ce528e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:48.482652 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e7a06efe-5041-4706-aae8-a00325ce528e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1604 microversion: 2.32 time: 0.258036 Oct 17 13:52:48.493319 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2005/3937] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:52:48 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1604 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:52:48.773832 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f1053c58-32e2-4b04-8d37-50696afa8af9 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:48.774572 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f1053c58-32e2-4b04-8d37-50696afa8af9 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 90bfb179-c8b6-4810-a981-33b78a19b62c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:48.792671 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:52:48.798333 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1053c58-32e2-4b04-8d37-50696afa8af9 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:48.799381 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1053c58-32e2-4b04-8d37-50696afa8af9 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:48.806544 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1053c58-32e2-4b04-8d37-50696afa8af9 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:48.807534 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1053c58-32e2-4b04-8d37-50696afa8af9 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:48.808208 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1053c58-32e2-4b04-8d37-50696afa8af9 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:48.809582 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1053c58-32e2-4b04-8d37-50696afa8af9 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:49.222575 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f1053c58-32e2-4b04-8d37-50696afa8af9 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:49.243790 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f1053c58-32e2-4b04-8d37-50696afa8af9 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c" status: 200 len: 1557 microversion: 2.1 time: 0.469990 Oct 17 13:52:49.245672 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2006/3938] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:48 2022] GET /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c => generated 1557 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:49.260077 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-c76919f8-c3f2-42da-b1f3-1a3a97c4a9ef req-6461d723-02ea-40ef-980e-6420b731fbca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3197da72-e924-4f50-8c93-c3f3ff98e084", "name": "network-vif-deleted", "tag": "ae63042f-2479-46ef-8b31-2a573c0b051b"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:52:49.284532 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-c76919f8-c3f2-42da-b1f3-1a3a97c4a9ef req-6461d723-02ea-40ef-980e-6420b731fbca service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:49.286703 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-c76919f8-c3f2-42da-b1f3-1a3a97c4a9ef req-6461d723-02ea-40ef-980e-6420b731fbca service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:49.287372 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-c76919f8-c3f2-42da-b1f3-1a3a97c4a9ef req-6461d723-02ea-40ef-980e-6420b731fbca service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:49.326198 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-c76919f8-c3f2-42da-b1f3-1a3a97c4a9ef req-6461d723-02ea-40ef-980e-6420b731fbca service nova] Creating event network-vif-deleted:ae63042f-2479-46ef-8b31-2a573c0b051b for instance 3197da72-e924-4f50-8c93-c3f3ff98e084 on n-h1-854247-14 Oct 17 13:52:49.339418 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-c76919f8-c3f2-42da-b1f3-1a3a97c4a9ef req-6461d723-02ea-40ef-980e-6420b731fbca service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092261 Oct 17 13:52:49.343304 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2007/3939] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:52:49.354705 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-47859cfe-64cf-4938-abb1-32fdbe6cc9f6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:49.356810 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-47859cfe-64cf-4938-abb1-32fdbe6cc9f6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 3197da72-e924-4f50-8c93-c3f3ff98e084] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:49.365194 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-47859cfe-64cf-4938-abb1-32fdbe6cc9f6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:49.365731 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-47859cfe-64cf-4938-abb1-32fdbe6cc9f6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:49.366168 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-47859cfe-64cf-4938-abb1-32fdbe6cc9f6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:49.366879 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-47859cfe-64cf-4938-abb1-32fdbe6cc9f6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:49.367363 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-47859cfe-64cf-4938-abb1-32fdbe6cc9f6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:49.367789 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-47859cfe-64cf-4938-abb1-32fdbe6cc9f6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:49.405610 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-47859cfe-64cf-4938-abb1-32fdbe6cc9f6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:49.406155 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-47859cfe-64cf-4938-abb1-32fdbe6cc9f6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:49.407211 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-47859cfe-64cf-4938-abb1-32fdbe6cc9f6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:49.407211 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-47859cfe-64cf-4938-abb1-32fdbe6cc9f6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lazy-loading 'fault' on Instance uuid 3197da72-e924-4f50-8c93-c3f3ff98e084 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:52:49.494424 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-47859cfe-64cf-4938-abb1-32fdbe6cc9f6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:49.507883 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-47859cfe-64cf-4938-abb1-32fdbe6cc9f6 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084" status: 200 len: 1334 microversion: 2.1 time: 0.163123 Oct 17 13:52:49.508822 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2008/3940] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:49 2022] GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084 => generated 1334 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:49.514049 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ad164909-a29a-4daa-8821-f8adef078483 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:49.516488 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ad164909-a29a-4daa-8821-f8adef078483 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 90bfb179-c8b6-4810-a981-33b78a19b62c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:49.533599 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ad164909-a29a-4daa-8821-f8adef078483 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:49.535582 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ad164909-a29a-4daa-8821-f8adef078483 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:49.536173 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ad164909-a29a-4daa-8821-f8adef078483 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:49.538145 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ad164909-a29a-4daa-8821-f8adef078483 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:49.538701 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ad164909-a29a-4daa-8821-f8adef078483 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:49.541229 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ad164909-a29a-4daa-8821-f8adef078483 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:49.708122 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ad164909-a29a-4daa-8821-f8adef078483 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.198220 Oct 17 13:52:49.708712 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2009/3941] 10.222.0.79 () {58 vars in 1275 bytes} [Mon Oct 17 13:52:49 2022] GET /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c/os-interface => generated 284 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:52:49.713486 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5161c36e-9345-43b6-b3ff-cdf77800ee24 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:49.714091 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5161c36e-9345-43b6-b3ff-cdf77800ee24 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:49.727358 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5161c36e-9345-43b6-b3ff-cdf77800ee24 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:49.727801 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5161c36e-9345-43b6-b3ff-cdf77800ee24 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:49.728211 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5161c36e-9345-43b6-b3ff-cdf77800ee24 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:49.728925 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5161c36e-9345-43b6-b3ff-cdf77800ee24 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:49.729382 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5161c36e-9345-43b6-b3ff-cdf77800ee24 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:49.730172 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5161c36e-9345-43b6-b3ff-cdf77800ee24 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:49.870398 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5161c36e-9345-43b6-b3ff-cdf77800ee24 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:49.883794 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5161c36e-9345-43b6-b3ff-cdf77800ee24 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:49.886054 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5161c36e-9345-43b6-b3ff-cdf77800ee24 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:49.887362 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5161c36e-9345-43b6-b3ff-cdf77800ee24 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1604 microversion: 2.32 time: 0.177583 Oct 17 13:52:49.899250 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2010/3942] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:52:49 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1604 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:52:50.536276 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-be27237f-bdda-4c6a-9486-70a2bc022ead tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:50.538483 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-be27237f-bdda-4c6a-9486-70a2bc022ead tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 3197da72-e924-4f50-8c93-c3f3ff98e084] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:50.550055 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be27237f-bdda-4c6a-9486-70a2bc022ead tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:50.553830 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be27237f-bdda-4c6a-9486-70a2bc022ead tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:50.556937 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be27237f-bdda-4c6a-9486-70a2bc022ead tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:50.558252 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be27237f-bdda-4c6a-9486-70a2bc022ead tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:50.560103 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be27237f-bdda-4c6a-9486-70a2bc022ead tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:50.561224 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be27237f-bdda-4c6a-9486-70a2bc022ead tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:50.604636 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-be27237f-bdda-4c6a-9486-70a2bc022ead tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] HTTP exception thrown: Instance 3197da72-e924-4f50-8c93-c3f3ff98e084 could not be found. Oct 17 13:52:50.609112 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-be27237f-bdda-4c6a-9486-70a2bc022ead tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Request method failure captured: Oct 17 13:52:50.609112 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084 HTTP/1.1 Oct 17 13:52:50.609112 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:52:50.609112 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:52:50.609112 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:52:50.609112 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:52:50.609112 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:52:50.609112 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:52:50.609112 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:52:50.609112 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:52:50.609112 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTV0lGewBAd5oX7RsuswRRrYdH_s7fnCDLNRSaJQAxErmqZOT5QT6523TfZqZvgb4tWrIGVLDqv0foQ4mpFwe91mdGAxx6JOfjpLIqY8Vnvh6NrynvpuS4ywkAJAwUfpPeJ0dauW6Gj_xg5-jDhUd1iFTLiSXh_-SOzh7_iyTjRI7Ovs Oct 17 13:52:50.609112 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:52:50.609112 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:52:50.609112 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:52:50.609112 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:52:50.609112 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:52:50.609112 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:52:50.609112 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 08068aeba86c4e718ba1e25c68fd3259 Oct 17 13:52:50.609112 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1627831718 Oct 17 13:52:50.609112 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:52:50.609112 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:52:50.609112 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/08068aeba86c4e718ba1e25c68fd3259"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/08068aeba86c4e718ba1e25c68fd3259"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/08068aeba86c4e718ba1e25c68fd3259"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_08068aeba86c4e718ba1e25c68fd3259", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:52:50.609112 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1627831718 Oct 17 13:52:50.609112 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 08068aeba86c4e718ba1e25c68fd3259 Oct 17 13:52:50.609112 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1627831718 Oct 17 13:52:50.609112 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServerRescueNegativeTestJSON-1627831718-project Oct 17 13:52:50.609112 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:52:50.609112 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:52:50.609112 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: d56b91ce42894bafac5ddb16ad6f037b Oct 17 13:52:50.609112 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1627831718-project Oct 17 13:52:50.609112 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:52:50.609112 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 3197da72-e924-4f50-8c93-c3f3ff98e084 could not be found. Oct 17 13:52:50.609112 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '3197da72-e924-4f50-8c93-c3f3ff98e084'} Oct 17 13:52:50.609112 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:52:50.609112 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:52:50.609112 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:52:50.609112 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:52:50.609112 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:52:50.609112 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:52:50.609112 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:52:50.609112 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:52:50.609112 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:52:50.609112 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:52:50.609112 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3197da72-e924-4f50-8c93-c3f3ff98e084 could not be found. Oct 17 13:52:50.609112 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:52:50.609112 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:52:50.609112 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:52:50.609112 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:52:50.609112 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:52:50.609112 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:52:50.609112 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:52:50.609112 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:52:50.609112 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:52:50.609112 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:52:50.609112 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:52:50.609112 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:52:50.609112 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:52:50.609112 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:52:50.609112 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:52:50.609112 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:52:50.609112 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3197da72-e924-4f50-8c93-c3f3ff98e084 could not be found. Oct 17 13:52:50.609112 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:52:50.609112 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:52:50.613511 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:52:50.613511 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:52:50.613511 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:52:50.613511 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:52:50.613511 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:52:50.613511 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:52:50.613511 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3197da72-e924-4f50-8c93-c3f3ff98e084 could not be found. Oct 17 13:52:50.613511 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:52:50.619793 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-be27237f-bdda-4c6a-9486-70a2bc022ead tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Returning 404 to user: Instance 3197da72-e924-4f50-8c93-c3f3ff98e084 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:52:50.621024 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-be27237f-bdda-4c6a-9486-70a2bc022ead tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084" status: 404 len: 111 microversion: 2.1 time: 0.088672 Oct 17 13:52:50.625236 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2011/3943] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:50 2022] GET /compute/v2.1/servers/3197da72-e924-4f50-8c93-c3f3ff98e084 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:52:50.633677 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d642881e-14d8-46eb-add1-58de71928307 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '.version_select at 0x7f7cd55a7a60>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:50.677215 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d642881e-14d8-46eb-add1-58de71928307 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-235574990" status: 202 len: 0 microversion: 2.1 time: 0.047246 Oct 17 13:52:50.679065 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2012/3944] 10.222.0.79 () {58 vars in 1218 bytes} [Mon Oct 17 13:52:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-235574990 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:52:50.928532 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ce0f1742-7957-441b-a723-f1f7adc52024 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:50.929390 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ce0f1742-7957-441b-a723-f1f7adc52024 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:50.957786 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ce0f1742-7957-441b-a723-f1f7adc52024 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:50.958540 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ce0f1742-7957-441b-a723-f1f7adc52024 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:50.959829 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ce0f1742-7957-441b-a723-f1f7adc52024 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:50.961952 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ce0f1742-7957-441b-a723-f1f7adc52024 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:50.972978 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ce0f1742-7957-441b-a723-f1f7adc52024 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:50.975776 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ce0f1742-7957-441b-a723-f1f7adc52024 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:51.327337 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:52:51.343114 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ce0f1742-7957-441b-a723-f1f7adc52024 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:51.361401 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ce0f1742-7957-441b-a723-f1f7adc52024 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:51.362898 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ce0f1742-7957-441b-a723-f1f7adc52024 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:51.370385 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ce0f1742-7957-441b-a723-f1f7adc52024 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1604 microversion: 2.32 time: 0.446792 Oct 17 13:52:51.381829 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2013/3945] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:52:50 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1604 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:52:51.389373 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:52:52.340803 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-984579aa-ceaa-4bc9-a314-5f09db5f996a req-099efb22-cb6e-48c4-8b70-245908f92f68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90bfb179-c8b6-4810-a981-33b78a19b62c", "tag": "04de9280-0f5a-42ac-a484-a51a7ba1e205"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:52:52.392750 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-984579aa-ceaa-4bc9-a314-5f09db5f996a req-099efb22-cb6e-48c4-8b70-245908f92f68 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:52.393241 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-984579aa-ceaa-4bc9-a314-5f09db5f996a req-099efb22-cb6e-48c4-8b70-245908f92f68 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:52.393688 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-984579aa-ceaa-4bc9-a314-5f09db5f996a req-099efb22-cb6e-48c4-8b70-245908f92f68 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:52.433137 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-984579aa-ceaa-4bc9-a314-5f09db5f996a req-099efb22-cb6e-48c4-8b70-245908f92f68 service nova] Creating event network-changed:04de9280-0f5a-42ac-a484-a51a7ba1e205 for instance 90bfb179-c8b6-4810-a981-33b78a19b62c on n-h2-854247-14 Oct 17 13:52:52.443930 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-984579aa-ceaa-4bc9-a314-5f09db5f996a req-099efb22-cb6e-48c4-8b70-245908f92f68 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106798 Oct 17 13:52:52.444780 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2014/3946] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:52:52.451936 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b2a6f7b1-9288-4669-86e1-c63644f170fa tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:52.452912 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b2a6f7b1-9288-4669-86e1-c63644f170fa tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:52.459781 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b2a6f7b1-9288-4669-86e1-c63644f170fa tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:52.460483 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b2a6f7b1-9288-4669-86e1-c63644f170fa tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:52.461056 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b2a6f7b1-9288-4669-86e1-c63644f170fa tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:52.461940 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b2a6f7b1-9288-4669-86e1-c63644f170fa tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:52.462543 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b2a6f7b1-9288-4669-86e1-c63644f170fa tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:52.463113 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b2a6f7b1-9288-4669-86e1-c63644f170fa tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:53.214385 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b2a6f7b1-9288-4669-86e1-c63644f170fa tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:53.235593 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b2a6f7b1-9288-4669-86e1-c63644f170fa tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:53.237044 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b2a6f7b1-9288-4669-86e1-c63644f170fa tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:53.244287 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b2a6f7b1-9288-4669-86e1-c63644f170fa tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1604 microversion: 2.32 time: 0.791101 Oct 17 13:52:53.249061 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2015/3947] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:52:52 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1604 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:52:54.270862 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-688e0854-019d-46ff-a659-c9a77e80bd5f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:54.271800 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-688e0854-019d-46ff-a659-c9a77e80bd5f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:54.289507 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-688e0854-019d-46ff-a659-c9a77e80bd5f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:54.290817 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-688e0854-019d-46ff-a659-c9a77e80bd5f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:54.292575 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-688e0854-019d-46ff-a659-c9a77e80bd5f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:54.293951 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-688e0854-019d-46ff-a659-c9a77e80bd5f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:54.295978 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-688e0854-019d-46ff-a659-c9a77e80bd5f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:54.299069 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-688e0854-019d-46ff-a659-c9a77e80bd5f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:54.473503 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-688e0854-019d-46ff-a659-c9a77e80bd5f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:54.490154 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-688e0854-019d-46ff-a659-c9a77e80bd5f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:54.493555 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-688e0854-019d-46ff-a659-c9a77e80bd5f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:54.499341 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-688e0854-019d-46ff-a659-c9a77e80bd5f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1604 microversion: 2.32 time: 0.232400 Oct 17 13:52:54.510510 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2016/3948] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:52:54 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1604 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:52:54.528652 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e0c3d0bf-4384-4c1d-bc58-390a089e95ea tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:54.529700 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e0c3d0bf-4384-4c1d-bc58-390a089e95ea tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:54.544394 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e0c3d0bf-4384-4c1d-bc58-390a089e95ea tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:54.545392 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e0c3d0bf-4384-4c1d-bc58-390a089e95ea tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:54.545967 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e0c3d0bf-4384-4c1d-bc58-390a089e95ea tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:54.546974 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e0c3d0bf-4384-4c1d-bc58-390a089e95ea tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:54.548465 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e0c3d0bf-4384-4c1d-bc58-390a089e95ea tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:54.552248 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e0c3d0bf-4384-4c1d-bc58-390a089e95ea tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:54.600538 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ac7788ea-db42-4936-8aa3-408c62800878 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/images/fb733fa0-36d1-4ec5-a621-b863abdc6233" status: 200 len: 1452 microversion: 2.1 time: 12.939233 Oct 17 13:52:54.611976 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1933/3949] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:52:41 2022] GET /compute/v2.1/images/fb733fa0-36d1-4ec5-a621-b863abdc6233 => generated 1452 bytes in 12951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:54.760916 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e0c3d0bf-4384-4c1d-bc58-390a089e95ea tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:54.772964 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e0c3d0bf-4384-4c1d-bc58-390a089e95ea tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1679 microversion: 2.1 time: 0.248586 Oct 17 13:52:54.773563 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2017/3950] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:54 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1679 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:52:55.531880 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-de5d360d-6415-4a7a-a6b5-748dc1bf1166 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:55.533196 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-de5d360d-6415-4a7a-a6b5-748dc1bf1166 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:55.539492 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-de5d360d-6415-4a7a-a6b5-748dc1bf1166 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:55.540020 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-de5d360d-6415-4a7a-a6b5-748dc1bf1166 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:55.540364 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-de5d360d-6415-4a7a-a6b5-748dc1bf1166 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:55.541082 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-de5d360d-6415-4a7a-a6b5-748dc1bf1166 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:55.541567 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-de5d360d-6415-4a7a-a6b5-748dc1bf1166 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:55.541990 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-de5d360d-6415-4a7a-a6b5-748dc1bf1166 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:55.620047 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1c4490e8-c7b2-4a1d-9795-b2151935fbd1 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd55a7700>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:55.645896 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-de5d360d-6415-4a7a-a6b5-748dc1bf1166 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:55.662136 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-de5d360d-6415-4a7a-a6b5-748dc1bf1166 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:55.664494 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-de5d360d-6415-4a7a-a6b5-748dc1bf1166 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:55.667260 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-de5d360d-6415-4a7a-a6b5-748dc1bf1166 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1604 microversion: 2.32 time: 0.139898 Oct 17 13:52:55.679213 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1934/3951] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:52:55 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1604 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:52:55.691773 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1c4490e8-c7b2-4a1d-9795-b2151935fbd1 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/images/fb733fa0-36d1-4ec5-a621-b863abdc6233" status: 200 len: 1452 microversion: 2.1 time: 0.077654 Oct 17 13:52:55.692665 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2018/3952] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:52:55 2022] GET /compute/v2.1/images/fb733fa0-36d1-4ec5-a621-b863abdc6233 => generated 1452 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:52:55.801239 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d2cadec6-f76f-4048-a5e4-eb75c19d8739 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:55.802027 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d2cadec6-f76f-4048-a5e4-eb75c19d8739 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:55.811999 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d2cadec6-f76f-4048-a5e4-eb75c19d8739 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:55.813118 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d2cadec6-f76f-4048-a5e4-eb75c19d8739 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:55.813698 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d2cadec6-f76f-4048-a5e4-eb75c19d8739 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:55.815247 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d2cadec6-f76f-4048-a5e4-eb75c19d8739 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:55.816151 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d2cadec6-f76f-4048-a5e4-eb75c19d8739 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:55.817186 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d2cadec6-f76f-4048-a5e4-eb75c19d8739 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:55.973162 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d2cadec6-f76f-4048-a5e4-eb75c19d8739 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:55.984285 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d2cadec6-f76f-4048-a5e4-eb75c19d8739 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1666 microversion: 2.1 time: 0.188199 Oct 17 13:52:55.986174 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1935/3953] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:55 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1666 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:56.015139 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a08718d1-e38c-4a8d-8637-95e699966a1c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1017565696"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:52:56.017638 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a08718d1-e38c-4a8d-8637-95e699966a1c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:56.031835 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a08718d1-e38c-4a8d-8637-95e699966a1c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:56.032912 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a08718d1-e38c-4a8d-8637-95e699966a1c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:56.033934 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a08718d1-e38c-4a8d-8637-95e699966a1c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:56.034879 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a08718d1-e38c-4a8d-8637-95e699966a1c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:56.035424 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a08718d1-e38c-4a8d-8637-95e699966a1c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:56.036054 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a08718d1-e38c-4a8d-8637-95e699966a1c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:56.325920 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a08718d1-e38c-4a8d-8637-95e699966a1c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "POST /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d/action" status: 202 len: 0 microversion: 2.1 time: 0.314827 Oct 17 13:52:56.330270 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2019/3954] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:52:56 2022] POST /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d/action => generated 0 bytes in 318 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 17 13:52:56.700059 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-37f81688-1019-419e-95cb-40b3bb6ddf2f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:56.700821 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-37f81688-1019-419e-95cb-40b3bb6ddf2f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:56.709569 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-940297b9-e6f7-4251-94a7-90e86e6b8f35 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd4f9e5e0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:56.710590 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-37f81688-1019-419e-95cb-40b3bb6ddf2f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:56.711083 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-37f81688-1019-419e-95cb-40b3bb6ddf2f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:56.711560 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-37f81688-1019-419e-95cb-40b3bb6ddf2f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:56.712265 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-37f81688-1019-419e-95cb-40b3bb6ddf2f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:56.712713 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-37f81688-1019-419e-95cb-40b3bb6ddf2f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:56.713138 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-37f81688-1019-419e-95cb-40b3bb6ddf2f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:56.762559 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-940297b9-e6f7-4251-94a7-90e86e6b8f35 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/images/fb733fa0-36d1-4ec5-a621-b863abdc6233" status: 200 len: 1452 microversion: 2.1 time: 0.057962 Oct 17 13:52:56.771470 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2020/3955] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:52:56 2022] GET /compute/v2.1/images/fb733fa0-36d1-4ec5-a621-b863abdc6233 => generated 1452 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:56.820315 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-37f81688-1019-419e-95cb-40b3bb6ddf2f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:56.833078 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-37f81688-1019-419e-95cb-40b3bb6ddf2f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:56.834905 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-37f81688-1019-419e-95cb-40b3bb6ddf2f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:56.837355 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-37f81688-1019-419e-95cb-40b3bb6ddf2f tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1604 microversion: 2.32 time: 0.141063 Oct 17 13:52:56.846392 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1936/3956] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:52:56 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1604 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:52:57.779618 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-eac539c4-7f7e-4d4d-8e19-532a401ea1b1 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd98634c0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:57.830360 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-eac539c4-7f7e-4d4d-8e19-532a401ea1b1 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/images/fb733fa0-36d1-4ec5-a621-b863abdc6233" status: 200 len: 1452 microversion: 2.1 time: 0.056128 Oct 17 13:52:57.830956 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2021/3957] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:52:57 2022] GET /compute/v2.1/images/fb733fa0-36d1-4ec5-a621-b863abdc6233 => generated 1452 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:57.876288 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6e673e23-cbc6-4213-8afe-10abab3c424c tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:57.877556 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6e673e23-cbc6-4213-8afe-10abab3c424c tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:57.884016 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6e673e23-cbc6-4213-8afe-10abab3c424c tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:57.884673 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6e673e23-cbc6-4213-8afe-10abab3c424c tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:57.885248 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6e673e23-cbc6-4213-8afe-10abab3c424c tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:57.886107 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6e673e23-cbc6-4213-8afe-10abab3c424c tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:57.901441 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6e673e23-cbc6-4213-8afe-10abab3c424c tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:57.902376 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6e673e23-cbc6-4213-8afe-10abab3c424c tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:57.992475 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6e673e23-cbc6-4213-8afe-10abab3c424c tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:58.002620 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6e673e23-cbc6-4213-8afe-10abab3c424c tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:58.004295 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6e673e23-cbc6-4213-8afe-10abab3c424c tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:58.005785 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6e673e23-cbc6-4213-8afe-10abab3c424c tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1604 microversion: 2.32 time: 0.142769 Oct 17 13:52:58.035508 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1937/3958] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:52:57 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1604 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:52:58.855908 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6204b53c-4939-4355-9793-391bd30aba22 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd98611f0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:58.912507 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6204b53c-4939-4355-9793-391bd30aba22 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/images/fb733fa0-36d1-4ec5-a621-b863abdc6233" status: 200 len: 1452 microversion: 2.1 time: 0.060430 Oct 17 13:52:58.921197 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2022/3959] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:52:58 2022] GET /compute/v2.1/images/fb733fa0-36d1-4ec5-a621-b863abdc6233 => generated 1452 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:59.046362 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6e109869-26ac-42b4-830c-a8f9edea79ff tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:59.046992 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6e109869-26ac-42b4-830c-a8f9edea79ff tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:59.070233 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6e109869-26ac-42b4-830c-a8f9edea79ff tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:59.071098 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6e109869-26ac-42b4-830c-a8f9edea79ff tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:59.071894 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6e109869-26ac-42b4-830c-a8f9edea79ff tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:59.072803 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6e109869-26ac-42b4-830c-a8f9edea79ff tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:59.073449 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6e109869-26ac-42b4-830c-a8f9edea79ff tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:59.075870 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6e109869-26ac-42b4-830c-a8f9edea79ff tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:59.171119 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6e109869-26ac-42b4-830c-a8f9edea79ff tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:59.181237 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6e109869-26ac-42b4-830c-a8f9edea79ff tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:59.182682 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6e109869-26ac-42b4-830c-a8f9edea79ff tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:59.183922 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6e109869-26ac-42b4-830c-a8f9edea79ff tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1604 microversion: 2.32 time: 0.143746 Oct 17 13:52:59.187360 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1938/3960] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:52:59 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1604 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:52:59.554396 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-e1d70a02-d24e-45af-8001-1f6690fd548c req-ad5ae0fa-ea83-4c8f-b357-cb08c81fffb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96dd349a-6476-4a7d-8f55-ea10e3b1e05d", "name": "network-vif-unplugged", "status": "completed", "tag": "fa985869-a190-4726-b04f-7d06a5c193e1"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:52:59.573312 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-e1d70a02-d24e-45af-8001-1f6690fd548c req-ad5ae0fa-ea83-4c8f-b357-cb08c81fffb0 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:59.579751 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-e1d70a02-d24e-45af-8001-1f6690fd548c req-ad5ae0fa-ea83-4c8f-b357-cb08c81fffb0 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:59.580311 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-e1d70a02-d24e-45af-8001-1f6690fd548c req-ad5ae0fa-ea83-4c8f-b357-cb08c81fffb0 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:59.593575 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-e1d70a02-d24e-45af-8001-1f6690fd548c req-ad5ae0fa-ea83-4c8f-b357-cb08c81fffb0 service nova] Creating event network-vif-unplugged:fa985869-a190-4726-b04f-7d06a5c193e1 for instance 96dd349a-6476-4a7d-8f55-ea10e3b1e05d on n-h2-854247-14 Oct 17 13:52:59.599980 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-e1d70a02-d24e-45af-8001-1f6690fd548c req-ad5ae0fa-ea83-4c8f-b357-cb08c81fffb0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049432 Oct 17 13:52:59.601773 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2023/3961] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:52:59.932441 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0995c739-4dc3-479c-8d93-1b9e55461fc3 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd464ee50>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:00.001619 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0995c739-4dc3-479c-8d93-1b9e55461fc3 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/images/fb733fa0-36d1-4ec5-a621-b863abdc6233" status: 200 len: 1461 microversion: 2.1 time: 0.074233 Oct 17 13:53:00.002371 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1939/3962] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:52:59 2022] GET /compute/v2.1/images/fb733fa0-36d1-4ec5-a621-b863abdc6233 => generated 1461 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:00.032869 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-06228735-d15f-4bb0-b67a-216eeba7029d tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd98adee0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:00.095930 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-06228735-d15f-4bb0-b67a-216eeba7029d tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/images/fb733fa0-36d1-4ec5-a621-b863abdc6233" status: 200 len: 1461 microversion: 2.1 time: 0.071554 Oct 17 13:53:00.097777 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2024/3963] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:53:00 2022] GET /compute/v2.1/images/fb733fa0-36d1-4ec5-a621-b863abdc6233 => generated 1461 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:00.111851 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ab3c93ab-a135-42e9-9b9e-9c83c73c8e5d tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:00.113064 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ab3c93ab-a135-42e9-9b9e-9c83c73c8e5d tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] [instance: 419a7ac0-9332-481d-bc66-3ad5b6a9db81] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:00.120251 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ab3c93ab-a135-42e9-9b9e-9c83c73c8e5d tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:00.120739 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ab3c93ab-a135-42e9-9b9e-9c83c73c8e5d tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:00.121186 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ab3c93ab-a135-42e9-9b9e-9c83c73c8e5d tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:00.122005 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ab3c93ab-a135-42e9-9b9e-9c83c73c8e5d tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:00.122640 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ab3c93ab-a135-42e9-9b9e-9c83c73c8e5d tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:00.123073 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ab3c93ab-a135-42e9-9b9e-9c83c73c8e5d tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:00.217002 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0b6899de-de35-45a4-bfaf-0dcbb794a056 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:00.218193 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0b6899de-de35-45a4-bfaf-0dcbb794a056 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:00.225805 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0b6899de-de35-45a4-bfaf-0dcbb794a056 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:00.226532 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0b6899de-de35-45a4-bfaf-0dcbb794a056 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:00.227119 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0b6899de-de35-45a4-bfaf-0dcbb794a056 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:00.228001 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0b6899de-de35-45a4-bfaf-0dcbb794a056 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:00.228604 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0b6899de-de35-45a4-bfaf-0dcbb794a056 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:00.229180 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0b6899de-de35-45a4-bfaf-0dcbb794a056 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:00.303679 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ab3c93ab-a135-42e9-9b9e-9c83c73c8e5d tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bfe589d0784bfc8ed1611c71cd4461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb1624a35d0403c9e5d09a17e79b7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:00.313230 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ab3c93ab-a135-42e9-9b9e-9c83c73c8e5d tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/servers/419a7ac0-9332-481d-bc66-3ad5b6a9db81" status: 200 len: 1466 microversion: 2.1 time: 0.206249 Oct 17 13:53:00.329719 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1940/3964] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:00 2022] GET /compute/v2.1/servers/419a7ac0-9332-481d-bc66-3ad5b6a9db81 => generated 1466 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:00.341535 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0315fdca-78d6-48eb-b5dc-9e0f4b7ff832 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-556095502"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:53:00.346810 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0315fdca-78d6-48eb-b5dc-9e0f4b7ff832 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] [instance: 5fea9fdd-bc16-4923-bbf8-e0909cd3bcda] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:00.349485 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0b6899de-de35-45a4-bfaf-0dcbb794a056 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:00.360568 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0315fdca-78d6-48eb-b5dc-9e0f4b7ff832 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:00.361267 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0315fdca-78d6-48eb-b5dc-9e0f4b7ff832 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:00.361903 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0315fdca-78d6-48eb-b5dc-9e0f4b7ff832 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:00.362798 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0315fdca-78d6-48eb-b5dc-9e0f4b7ff832 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:00.364003 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0315fdca-78d6-48eb-b5dc-9e0f4b7ff832 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:00.364196 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0b6899de-de35-45a4-bfaf-0dcbb794a056 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:00.364920 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0315fdca-78d6-48eb-b5dc-9e0f4b7ff832 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:00.365663 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0b6899de-de35-45a4-bfaf-0dcbb794a056 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:00.372749 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0b6899de-de35-45a4-bfaf-0dcbb794a056 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1604 microversion: 2.32 time: 0.162706 Oct 17 13:53:00.373817 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2025/3965] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:53:00 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1604 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:53:00.681677 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0315fdca-78d6-48eb-b5dc-9e0f4b7ff832 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "POST /compute/v2.1/servers/5fea9fdd-bc16-4923-bbf8-e0909cd3bcda/action" status: 202 len: 0 microversion: 2.1 time: 0.334642 Oct 17 13:53:00.683472 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1941/3966] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:53:00 2022] POST /compute/v2.1/servers/5fea9fdd-bc16-4923-bbf8-e0909cd3bcda/action => generated 0 bytes in 347 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 17 13:53:00.695518 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2bd42a02-fec0-4244-bc60-39af0301f06e tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd98adc10>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:00.758727 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2bd42a02-fec0-4244-bc60-39af0301f06e tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/images/778e673f-3171-46f0-a680-e9214da228fb" status: 200 len: 1452 microversion: 2.1 time: 0.068510 Oct 17 13:53:00.759351 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2026/3967] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:53:00 2022] GET /compute/v2.1/images/778e673f-3171-46f0-a680-e9214da228fb => generated 1452 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:01.401925 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-89d5e1b5-b5f2-4fa5-88ed-d5548d475a56 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:01.408630 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-89d5e1b5-b5f2-4fa5-88ed-d5548d475a56 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:01.425402 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-89d5e1b5-b5f2-4fa5-88ed-d5548d475a56 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:01.427463 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-89d5e1b5-b5f2-4fa5-88ed-d5548d475a56 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:01.428217 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-89d5e1b5-b5f2-4fa5-88ed-d5548d475a56 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:01.434656 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-89d5e1b5-b5f2-4fa5-88ed-d5548d475a56 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:01.435649 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-89d5e1b5-b5f2-4fa5-88ed-d5548d475a56 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:01.436308 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-89d5e1b5-b5f2-4fa5-88ed-d5548d475a56 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:01.525584 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-89d5e1b5-b5f2-4fa5-88ed-d5548d475a56 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:01.543950 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-89d5e1b5-b5f2-4fa5-88ed-d5548d475a56 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:01.545790 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-89d5e1b5-b5f2-4fa5-88ed-d5548d475a56 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:01.547471 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-89d5e1b5-b5f2-4fa5-88ed-d5548d475a56 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1604 microversion: 2.32 time: 0.151595 Oct 17 13:53:01.548379 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1942/3968] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:53:01 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1604 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:53:01.620586 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-a207caf7-a4c2-4304-8793-af9165430521 req-217d72df-a72e-45d5-99cc-2b265324b1d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96dd349a-6476-4a7d-8f55-ea10e3b1e05d", "name": "network-vif-plugged", "status": "completed", "tag": "fa985869-a190-4726-b04f-7d06a5c193e1"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:53:01.643742 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-a207caf7-a4c2-4304-8793-af9165430521 req-217d72df-a72e-45d5-99cc-2b265324b1d3 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:01.644233 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-a207caf7-a4c2-4304-8793-af9165430521 req-217d72df-a72e-45d5-99cc-2b265324b1d3 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:01.644674 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-a207caf7-a4c2-4304-8793-af9165430521 req-217d72df-a72e-45d5-99cc-2b265324b1d3 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:01.676972 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-a207caf7-a4c2-4304-8793-af9165430521 req-217d72df-a72e-45d5-99cc-2b265324b1d3 service nova] Creating event network-vif-plugged:fa985869-a190-4726-b04f-7d06a5c193e1 for instance 96dd349a-6476-4a7d-8f55-ea10e3b1e05d on n-h2-854247-14 Oct 17 13:53:01.683605 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-a207caf7-a4c2-4304-8793-af9165430521 req-217d72df-a72e-45d5-99cc-2b265324b1d3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066740 Oct 17 13:53:01.685882 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2027/3969] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:53:01.778472 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e109c8d2-b60d-4beb-8d21-384829d84157 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd9903040>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:01.849180 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e109c8d2-b60d-4beb-8d21-384829d84157 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/images/778e673f-3171-46f0-a680-e9214da228fb" status: 200 len: 1452 microversion: 2.1 time: 0.075632 Oct 17 13:53:01.859782 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1943/3970] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:53:01 2022] GET /compute/v2.1/images/778e673f-3171-46f0-a680-e9214da228fb => generated 1452 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:02.582045 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e6978728-5131-436a-a16f-3a834405871e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:02.585458 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e6978728-5131-436a-a16f-3a834405871e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:02.599524 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e6978728-5131-436a-a16f-3a834405871e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:02.602729 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e6978728-5131-436a-a16f-3a834405871e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:02.603412 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e6978728-5131-436a-a16f-3a834405871e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:02.604167 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e6978728-5131-436a-a16f-3a834405871e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:02.604650 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e6978728-5131-436a-a16f-3a834405871e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:02.605085 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e6978728-5131-436a-a16f-3a834405871e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:02.722754 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e6978728-5131-436a-a16f-3a834405871e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:02.735552 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e6978728-5131-436a-a16f-3a834405871e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:02.738735 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e6978728-5131-436a-a16f-3a834405871e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:02.740256 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e6978728-5131-436a-a16f-3a834405871e tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1604 microversion: 2.32 time: 0.162742 Oct 17 13:53:02.757211 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2028/3971] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:53:02 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1604 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:53:02.867088 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-915c5a03-4462-4276-94e3-2213a264622f tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd9a5fca0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:02.929310 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-915c5a03-4462-4276-94e3-2213a264622f tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/images/778e673f-3171-46f0-a680-e9214da228fb" status: 200 len: 1452 microversion: 2.1 time: 0.067174 Oct 17 13:53:02.938513 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1944/3972] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:53:02 2022] GET /compute/v2.1/images/778e673f-3171-46f0-a680-e9214da228fb => generated 1452 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:03.700540 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-038ed4bf-f095-4366-b382-2647361fd72c req-f09aeb8e-a94e-4032-823c-6e661c3c19ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "419a7ac0-9332-481d-bc66-3ad5b6a9db81", "name": "network-vif-unplugged", "status": "completed", "tag": "8c4e8542-c161-4443-8115-64e41c66a3fe"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:53:03.729013 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-038ed4bf-f095-4366-b382-2647361fd72c req-f09aeb8e-a94e-4032-823c-6e661c3c19ea service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:03.729649 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-038ed4bf-f095-4366-b382-2647361fd72c req-f09aeb8e-a94e-4032-823c-6e661c3c19ea service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:03.729948 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-038ed4bf-f095-4366-b382-2647361fd72c req-f09aeb8e-a94e-4032-823c-6e661c3c19ea service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:03.756876 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-038ed4bf-f095-4366-b382-2647361fd72c req-f09aeb8e-a94e-4032-823c-6e661c3c19ea service nova] Creating event network-vif-unplugged:8c4e8542-c161-4443-8115-64e41c66a3fe for instance 419a7ac0-9332-481d-bc66-3ad5b6a9db81 on n-h2-854247-14 Oct 17 13:53:03.763046 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-038ed4bf-f095-4366-b382-2647361fd72c req-f09aeb8e-a94e-4032-823c-6e661c3c19ea service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066340 Oct 17 13:53:03.763701 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2029/3973] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:53:03.774380 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0b073bbc-1ca1-4373-bf81-1dcee0483267 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:03.775374 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0b073bbc-1ca1-4373-bf81-1dcee0483267 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:03.786994 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0b073bbc-1ca1-4373-bf81-1dcee0483267 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:03.787526 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0b073bbc-1ca1-4373-bf81-1dcee0483267 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:03.787965 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0b073bbc-1ca1-4373-bf81-1dcee0483267 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:03.788697 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0b073bbc-1ca1-4373-bf81-1dcee0483267 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:03.791232 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0b073bbc-1ca1-4373-bf81-1dcee0483267 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:03.794389 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0b073bbc-1ca1-4373-bf81-1dcee0483267 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:03.913836 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0b073bbc-1ca1-4373-bf81-1dcee0483267 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:03.925601 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0b073bbc-1ca1-4373-bf81-1dcee0483267 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:03.927609 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0b073bbc-1ca1-4373-bf81-1dcee0483267 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:03.928978 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0b073bbc-1ca1-4373-bf81-1dcee0483267 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1604 microversion: 2.32 time: 0.158612 Oct 17 13:53:03.929531 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1945/3974] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:53:03 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1604 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:53:03.959399 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8c2ce811-2bde-4672-9820-1078d6bd2ddc tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd981d4c0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:04.046216 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8c2ce811-2bde-4672-9820-1078d6bd2ddc tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/images/778e673f-3171-46f0-a680-e9214da228fb" status: 200 len: 1452 microversion: 2.1 time: 0.103684 Oct 17 13:53:04.047121 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2030/3975] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:53:03 2022] GET /compute/v2.1/images/778e673f-3171-46f0-a680-e9214da228fb => generated 1452 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:04.669055 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f516aca2-e291-4617-bd78-3106261b146b tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:04.672401 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f516aca2-e291-4617-bd78-3106261b146b tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:04.685068 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f516aca2-e291-4617-bd78-3106261b146b tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:04.687363 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f516aca2-e291-4617-bd78-3106261b146b tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:04.688549 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f516aca2-e291-4617-bd78-3106261b146b tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:04.689045 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f516aca2-e291-4617-bd78-3106261b146b tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:04.690573 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f516aca2-e291-4617-bd78-3106261b146b tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:04.691575 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f516aca2-e291-4617-bd78-3106261b146b tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:04.790110 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f516aca2-e291-4617-bd78-3106261b146b tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.125120 Oct 17 13:53:04.790705 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1946/3976] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 13:53:04 2022] GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5/os-volume_attachments => generated 371 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:53:04.940793 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-11d7e453-456d-4707-99a5-66594fd1edb4 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:04.941848 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-11d7e453-456d-4707-99a5-66594fd1edb4 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:04.960592 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2c9bc297-5ce6-4115-8237-4232b6e08318 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:04.962000 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2c9bc297-5ce6-4115-8237-4232b6e08318 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:04.965851 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-11d7e453-456d-4707-99a5-66594fd1edb4 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:04.966340 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-11d7e453-456d-4707-99a5-66594fd1edb4 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:04.966865 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-11d7e453-456d-4707-99a5-66594fd1edb4 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:04.970971 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-11d7e453-456d-4707-99a5-66594fd1edb4 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:04.971506 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-11d7e453-456d-4707-99a5-66594fd1edb4 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:04.971953 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-11d7e453-456d-4707-99a5-66594fd1edb4 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:04.975887 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2c9bc297-5ce6-4115-8237-4232b6e08318 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:04.977724 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2c9bc297-5ce6-4115-8237-4232b6e08318 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:04.978659 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:53:04.980844 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2c9bc297-5ce6-4115-8237-4232b6e08318 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:04.980844 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2c9bc297-5ce6-4115-8237-4232b6e08318 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:04.981077 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2c9bc297-5ce6-4115-8237-4232b6e08318 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:04.984470 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2c9bc297-5ce6-4115-8237-4232b6e08318 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:05.077203 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2c9bc297-5ce6-4115-8237-4232b6e08318 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:05.087337 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2c9bc297-5ce6-4115-8237-4232b6e08318 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:05.097084 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2c9bc297-5ce6-4115-8237-4232b6e08318 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:05.098822 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-11d7e453-456d-4707-99a5-66594fd1edb4 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5/os-volume_attachments/a926cc62-2fec-45a4-abdb-8cd1eee8ff64" status: 200 len: 194 microversion: 2.1 time: 0.165374 Oct 17 13:53:05.108784 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2c9bc297-5ce6-4115-8237-4232b6e08318 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1604 microversion: 2.32 time: 0.142283 Oct 17 13:53:05.109844 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1947/3977] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:53:04 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1604 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:53:05.113015 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2031/3978] 10.222.0.79 () {58 vars in 1413 bytes} [Mon Oct 17 13:53:04 2022] GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5/os-volume_attachments/a926cc62-2fec-45a4-abdb-8cd1eee8ff64 => generated 194 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:53:05.114906 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a938c729-7737-424d-9aa5-176805b245b9 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd9a22a60>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:05.126441 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-250c94c3-fae6-4e41-bed8-ba80d061a7e9 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:05.126951 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-250c94c3-fae6-4e41-bed8-ba80d061a7e9 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:05.165578 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-250c94c3-fae6-4e41-bed8-ba80d061a7e9 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:05.165683 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-250c94c3-fae6-4e41-bed8-ba80d061a7e9 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:05.166133 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-250c94c3-fae6-4e41-bed8-ba80d061a7e9 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:05.166863 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-250c94c3-fae6-4e41-bed8-ba80d061a7e9 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:05.167359 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-250c94c3-fae6-4e41-bed8-ba80d061a7e9 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:05.167790 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-250c94c3-fae6-4e41-bed8-ba80d061a7e9 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:05.324842 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-250c94c3-fae6-4e41-bed8-ba80d061a7e9 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lazy-loading 'services' on Instance uuid bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:53:05.549781 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-250c94c3-fae6-4e41-bed8-ba80d061a7e9 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "DELETE /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5/os-volume_attachments/a926cc62-2fec-45a4-abdb-8cd1eee8ff64" status: 202 len: 0 microversion: 2.1 time: 0.429233 Oct 17 13:53:05.550768 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2032/3979] 10.222.0.79 () {58 vars in 1416 bytes} [Mon Oct 17 13:53:05 2022] DELETE /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5/os-volume_attachments/a926cc62-2fec-45a4-abdb-8cd1eee8ff64 => generated 0 bytes in 431 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:53:06.141048 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e6217654-6035-4d36-8faf-3a127b430817 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:06.142615 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e6217654-6035-4d36-8faf-3a127b430817 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:06.159634 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e6217654-6035-4d36-8faf-3a127b430817 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:06.160521 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e6217654-6035-4d36-8faf-3a127b430817 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:06.161163 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e6217654-6035-4d36-8faf-3a127b430817 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:06.162093 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e6217654-6035-4d36-8faf-3a127b430817 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:06.162740 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e6217654-6035-4d36-8faf-3a127b430817 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:06.163384 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e6217654-6035-4d36-8faf-3a127b430817 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:06.345882 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e6217654-6035-4d36-8faf-3a127b430817 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:06.375101 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e6217654-6035-4d36-8faf-3a127b430817 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:06.391626 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e6217654-6035-4d36-8faf-3a127b430817 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:06.393091 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e6217654-6035-4d36-8faf-3a127b430817 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1604 microversion: 2.32 time: 0.258021 Oct 17 13:53:06.406295 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2033/3980] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:53:06 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1604 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:53:06.905574 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-e7cc9d99-cffe-4d54-867e-d2dc5e139e91 req-cd8225bd-4663-4b18-8fa3-ce63ae95ce90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fea9fdd-bc16-4923-bbf8-e0909cd3bcda", "name": "network-vif-plugged", "status": "completed", "tag": "9a6b33a5-082e-4c10-8994-0c42a775e094"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:53:06.927408 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-e7cc9d99-cffe-4d54-867e-d2dc5e139e91 req-cd8225bd-4663-4b18-8fa3-ce63ae95ce90 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:06.929463 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-e7cc9d99-cffe-4d54-867e-d2dc5e139e91 req-cd8225bd-4663-4b18-8fa3-ce63ae95ce90 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:06.929924 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-e7cc9d99-cffe-4d54-867e-d2dc5e139e91 req-cd8225bd-4663-4b18-8fa3-ce63ae95ce90 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:06.987330 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-e7cc9d99-cffe-4d54-867e-d2dc5e139e91 req-cd8225bd-4663-4b18-8fa3-ce63ae95ce90 service nova] Creating event network-vif-plugged:9a6b33a5-082e-4c10-8994-0c42a775e094 for instance 5fea9fdd-bc16-4923-bbf8-e0909cd3bcda on n-h1-854247-14 Oct 17 13:53:07.005246 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-e7cc9d99-cffe-4d54-867e-d2dc5e139e91 req-cd8225bd-4663-4b18-8fa3-ce63ae95ce90 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100663 Oct 17 13:53:07.009686 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2034/3981] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:53:07.438614 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-46b99aa4-c939-4201-9fc8-5eefa7df85ab tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:07.441210 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-46b99aa4-c939-4201-9fc8-5eefa7df85ab tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:07.475799 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-46b99aa4-c939-4201-9fc8-5eefa7df85ab tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:07.478896 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-46b99aa4-c939-4201-9fc8-5eefa7df85ab tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:07.479377 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-46b99aa4-c939-4201-9fc8-5eefa7df85ab tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:07.480111 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-46b99aa4-c939-4201-9fc8-5eefa7df85ab tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:07.480559 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-46b99aa4-c939-4201-9fc8-5eefa7df85ab tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:07.481045 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-46b99aa4-c939-4201-9fc8-5eefa7df85ab tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:07.631878 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-46b99aa4-c939-4201-9fc8-5eefa7df85ab tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:07.642473 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-46b99aa4-c939-4201-9fc8-5eefa7df85ab tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:07.644064 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-46b99aa4-c939-4201-9fc8-5eefa7df85ab tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:07.645314 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-46b99aa4-c939-4201-9fc8-5eefa7df85ab tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1604 microversion: 2.32 time: 0.214886 Oct 17 13:53:07.645918 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2035/3982] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:53:07 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1604 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:53:08.679360 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-bc82e04e-a305-40df-9b2a-1d8bdeb19bc5 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:08.680080 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-bc82e04e-a305-40df-9b2a-1d8bdeb19bc5 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:08.701866 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bc82e04e-a305-40df-9b2a-1d8bdeb19bc5 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:08.702401 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bc82e04e-a305-40df-9b2a-1d8bdeb19bc5 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:08.702853 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bc82e04e-a305-40df-9b2a-1d8bdeb19bc5 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:08.715845 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bc82e04e-a305-40df-9b2a-1d8bdeb19bc5 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:08.716365 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bc82e04e-a305-40df-9b2a-1d8bdeb19bc5 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:08.716824 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bc82e04e-a305-40df-9b2a-1d8bdeb19bc5 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:08.875967 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-bc82e04e-a305-40df-9b2a-1d8bdeb19bc5 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:08.891758 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-bc82e04e-a305-40df-9b2a-1d8bdeb19bc5 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:08.893663 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-bc82e04e-a305-40df-9b2a-1d8bdeb19bc5 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:08.895084 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-bc82e04e-a305-40df-9b2a-1d8bdeb19bc5 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1604 microversion: 2.32 time: 0.220029 Oct 17 13:53:08.899843 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2036/3983] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:53:08 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1604 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:53:09.946360 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-85601641-55be-4f4d-847c-d64e5720b6db tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:09.947819 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-85601641-55be-4f4d-847c-d64e5720b6db tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:09.955682 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-85601641-55be-4f4d-847c-d64e5720b6db tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:09.956546 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-85601641-55be-4f4d-847c-d64e5720b6db tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:09.957204 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-85601641-55be-4f4d-847c-d64e5720b6db tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:09.958141 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-85601641-55be-4f4d-847c-d64e5720b6db tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:09.958814 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-85601641-55be-4f4d-847c-d64e5720b6db tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:09.959471 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-85601641-55be-4f4d-847c-d64e5720b6db tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:10.082809 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-85601641-55be-4f4d-847c-d64e5720b6db tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:10.093900 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-85601641-55be-4f4d-847c-d64e5720b6db tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:10.097634 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-85601641-55be-4f4d-847c-d64e5720b6db tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:10.099889 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-85601641-55be-4f4d-847c-d64e5720b6db tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1604 microversion: 2.32 time: 0.159287 Oct 17 13:53:10.101087 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2037/3984] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:53:09 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1604 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:53:11.132420 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cf057d1e-d86e-437b-a0b6-39e91828ee18 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:11.133069 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cf057d1e-d86e-437b-a0b6-39e91828ee18 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:11.169025 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cf057d1e-d86e-437b-a0b6-39e91828ee18 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:11.169655 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cf057d1e-d86e-437b-a0b6-39e91828ee18 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:11.177069 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cf057d1e-d86e-437b-a0b6-39e91828ee18 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:11.177997 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cf057d1e-d86e-437b-a0b6-39e91828ee18 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:11.178460 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cf057d1e-d86e-437b-a0b6-39e91828ee18 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:11.178905 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cf057d1e-d86e-437b-a0b6-39e91828ee18 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:11.347196 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cf057d1e-d86e-437b-a0b6-39e91828ee18 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:11.362340 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cf057d1e-d86e-437b-a0b6-39e91828ee18 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:11.365167 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cf057d1e-d86e-437b-a0b6-39e91828ee18 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:11.374842 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cf057d1e-d86e-437b-a0b6-39e91828ee18 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1604 microversion: 2.32 time: 0.249182 Oct 17 13:53:11.376082 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2038/3985] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:53:11 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1604 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:53:12.407579 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5b586dfd-fb3a-40e4-8e1c-a0a36931b14a tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:12.408229 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5b586dfd-fb3a-40e4-8e1c-a0a36931b14a tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:12.421319 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5b586dfd-fb3a-40e4-8e1c-a0a36931b14a tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:12.421818 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5b586dfd-fb3a-40e4-8e1c-a0a36931b14a tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:12.422261 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5b586dfd-fb3a-40e4-8e1c-a0a36931b14a tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:12.422982 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5b586dfd-fb3a-40e4-8e1c-a0a36931b14a tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:12.428739 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5b586dfd-fb3a-40e4-8e1c-a0a36931b14a tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:12.429196 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5b586dfd-fb3a-40e4-8e1c-a0a36931b14a tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:12.573981 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5b586dfd-fb3a-40e4-8e1c-a0a36931b14a tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:12.587873 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5b586dfd-fb3a-40e4-8e1c-a0a36931b14a tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:12.589337 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5b586dfd-fb3a-40e4-8e1c-a0a36931b14a tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:12.591232 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5b586dfd-fb3a-40e4-8e1c-a0a36931b14a tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1604 microversion: 2.32 time: 0.189090 Oct 17 13:53:12.608860 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2039/3986] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:53:12 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1604 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:53:13.621778 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cdc4882b-c074-4ba1-84fe-998efc86b521 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:13.623570 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cdc4882b-c074-4ba1-84fe-998efc86b521 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:13.638195 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cdc4882b-c074-4ba1-84fe-998efc86b521 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:13.640056 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cdc4882b-c074-4ba1-84fe-998efc86b521 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:13.640723 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cdc4882b-c074-4ba1-84fe-998efc86b521 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:13.643616 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cdc4882b-c074-4ba1-84fe-998efc86b521 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:13.644308 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cdc4882b-c074-4ba1-84fe-998efc86b521 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:13.644956 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cdc4882b-c074-4ba1-84fe-998efc86b521 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:13.757174 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cdc4882b-c074-4ba1-84fe-998efc86b521 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:13.775939 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cdc4882b-c074-4ba1-84fe-998efc86b521 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:13.778264 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cdc4882b-c074-4ba1-84fe-998efc86b521 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:13.780112 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cdc4882b-c074-4ba1-84fe-998efc86b521 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1604 microversion: 2.32 time: 0.164013 Oct 17 13:53:13.801811 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2040/3987] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:53:13 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1604 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:53:14.808231 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4e0d923b-b26a-435d-977b-02ae02c916ad tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:14.809401 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4e0d923b-b26a-435d-977b-02ae02c916ad tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:14.825979 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4e0d923b-b26a-435d-977b-02ae02c916ad tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:14.826477 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4e0d923b-b26a-435d-977b-02ae02c916ad tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:14.826917 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4e0d923b-b26a-435d-977b-02ae02c916ad tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:14.827664 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4e0d923b-b26a-435d-977b-02ae02c916ad tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:14.828117 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4e0d923b-b26a-435d-977b-02ae02c916ad tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:14.828540 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4e0d923b-b26a-435d-977b-02ae02c916ad tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:14.950158 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4e0d923b-b26a-435d-977b-02ae02c916ad tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:14.968609 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4e0d923b-b26a-435d-977b-02ae02c916ad tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:14.971399 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4e0d923b-b26a-435d-977b-02ae02c916ad tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:14.974713 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-4e0d923b-b26a-435d-977b-02ae02c916ad tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lazy-loading 'fault' on Instance uuid 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:53:14.976437 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=22 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:53:15.076615 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4e0d923b-b26a-435d-977b-02ae02c916ad tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:15.081634 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:53:15.095320 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4e0d923b-b26a-435d-977b-02ae02c916ad tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:15.095320 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4e0d923b-b26a-435d-977b-02ae02c916ad tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e02c176dc1a6460882ca3969d52c195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbeaa08d8384042a26c865a2efba214', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:15.095320 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4e0d923b-b26a-435d-977b-02ae02c916ad tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 200 len: 1609 microversion: 2.32 time: 0.290640 Oct 17 13:53:15.117989 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2041/3988] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:53:14 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 1609 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:53:16.126298 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-000e1c59-08b2-49d1-9edd-09780fba88a7 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:16.126914 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-000e1c59-08b2-49d1-9edd-09780fba88a7 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:16.145353 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-000e1c59-08b2-49d1-9edd-09780fba88a7 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:16.145845 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-000e1c59-08b2-49d1-9edd-09780fba88a7 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:16.146283 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-000e1c59-08b2-49d1-9edd-09780fba88a7 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:16.146995 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-000e1c59-08b2-49d1-9edd-09780fba88a7 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:16.147481 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-000e1c59-08b2-49d1-9edd-09780fba88a7 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:16.147901 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-000e1c59-08b2-49d1-9edd-09780fba88a7 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:16.225130 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-000e1c59-08b2-49d1-9edd-09780fba88a7 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] HTTP exception thrown: Instance 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 could not be found. Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-000e1c59-08b2-49d1-9edd-09780fba88a7 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Request method failure captured: Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 HTTP/1.1 Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVyomfvbOy6S2rpnoh5-yHaZQOoWWGGkc9XAhTfkiAaHU8Bq-7OTtRnYRa_7jsQYNX1M9Env1-vRByaZlfV7jfe9V8Z-p2Ct4sa7iO0yWjI07xW_vABQr8G-2zhbR4WLJW3ukuXTCLvFE4SZVXP1tpCEtIo-LGSTulT2fce1IJR4uqk Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: X-Openstack-Nova-Api-Version: 2.32 Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: cfbeaa08d8384042a26c865a2efba214 Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-TaggedBootDevicesTest-273679803 Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cfbeaa08d8384042a26c865a2efba214"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/cfbeaa08d8384042a26c865a2efba214"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cfbeaa08d8384042a26c865a2efba214"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_cfbeaa08d8384042a26c865a2efba214", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-TaggedBootDevicesTest-273679803 Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: cfbeaa08d8384042a26c865a2efba214 Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-TaggedBootDevicesTest-273679803 Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-TaggedBootDevicesTest-273679803-project Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: e02c176dc1a6460882ca3969d52c195b Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-TaggedBootDevicesTest-273679803-project Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 could not be found. Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2'} Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 could not be found. Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 could not be found. Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:53:16.226867 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:53:16.231285 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:53:16.231285 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:53:16.231285 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:53:16.231285 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:53:16.231285 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:53:16.231285 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 could not be found. Oct 17 13:53:16.231285 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:53:16.231285 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-000e1c59-08b2-49d1-9edd-09780fba88a7 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Returning 404 to user: Instance 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:53:16.231285 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-000e1c59-08b2-49d1-9edd-09780fba88a7 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 404 len: 111 microversion: 2.32 time: 0.106321 Oct 17 13:53:16.232548 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2042/3989] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:53:16 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:53:16.256088 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ff56c757-d520-4302-9073-e00f2f13c917 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '.version_select at 0x7f7cd9882b80>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:16.311951 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ff56c757-d520-4302-9073-e00f2f13c917 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1248928397" status: 204 len: 0 microversion: 2.32 time: 0.078207 Oct 17 13:53:16.312545 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2043/3990] 10.222.0.79 () {60 vars in 1262 bytes} [Mon Oct 17 13:53:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1248928397 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:53:16.775813 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a938c729-7737-424d-9aa5-176805b245b9 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/images/778e673f-3171-46f0-a680-e9214da228fb" status: 200 len: 1452 microversion: 2.1 time: 11.664702 Oct 17 13:53:16.776429 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1948/3991] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:53:05 2022] GET /compute/v2.1/images/778e673f-3171-46f0-a680-e9214da228fb => generated 1452 bytes in 11666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:16.898129 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-bf4578d4-ed81-43a6-8ccd-92fc70917a94 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:16.898811 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-bf4578d4-ed81-43a6-8ccd-92fc70917a94 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:16.909509 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bf4578d4-ed81-43a6-8ccd-92fc70917a94 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:16.910033 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bf4578d4-ed81-43a6-8ccd-92fc70917a94 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:16.910474 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bf4578d4-ed81-43a6-8ccd-92fc70917a94 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:16.911246 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bf4578d4-ed81-43a6-8ccd-92fc70917a94 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:16.911714 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bf4578d4-ed81-43a6-8ccd-92fc70917a94 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:16.921680 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bf4578d4-ed81-43a6-8ccd-92fc70917a94 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:17.151034 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-bf4578d4-ed81-43a6-8ccd-92fc70917a94 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:17.160845 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-bf4578d4-ed81-43a6-8ccd-92fc70917a94 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1679 microversion: 2.1 time: 0.267202 Oct 17 13:53:17.161441 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2044/3992] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:16 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1679 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:17.791473 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9da25e15-49b8-4e4e-abb0-fcca6a08e144 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd9903790>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:17.872006 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9da25e15-49b8-4e4e-abb0-fcca6a08e144 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/images/778e673f-3171-46f0-a680-e9214da228fb" status: 200 len: 1452 microversion: 2.1 time: 0.084356 Oct 17 13:53:17.877401 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1949/3993] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:53:17 2022] GET /compute/v2.1/images/778e673f-3171-46f0-a680-e9214da228fb => generated 1452 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:18.190634 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fa8ab297-3b45-4265-aaa6-4b198e0ff3c9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:18.191311 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-fa8ab297-3b45-4265-aaa6-4b198e0ff3c9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:18.213802 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fa8ab297-3b45-4265-aaa6-4b198e0ff3c9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:18.215213 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fa8ab297-3b45-4265-aaa6-4b198e0ff3c9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:18.215826 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fa8ab297-3b45-4265-aaa6-4b198e0ff3c9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:18.216735 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fa8ab297-3b45-4265-aaa6-4b198e0ff3c9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:18.217358 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fa8ab297-3b45-4265-aaa6-4b198e0ff3c9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:18.217777 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fa8ab297-3b45-4265-aaa6-4b198e0ff3c9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:18.626872 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fa8ab297-3b45-4265-aaa6-4b198e0ff3c9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:18.642193 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fa8ab297-3b45-4265-aaa6-4b198e0ff3c9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1666 microversion: 2.1 time: 0.455708 Oct 17 13:53:18.647318 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2045/3994] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:18 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1666 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:18.669432 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-34c315c2-fb3c-465f-959c-3adf8e9dd38c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1007425619"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:53:18.671947 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-34c315c2-fb3c-465f-959c-3adf8e9dd38c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:18.683160 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-34c315c2-fb3c-465f-959c-3adf8e9dd38c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:18.683904 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-34c315c2-fb3c-465f-959c-3adf8e9dd38c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:18.684493 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-34c315c2-fb3c-465f-959c-3adf8e9dd38c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:18.685384 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-34c315c2-fb3c-465f-959c-3adf8e9dd38c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:18.685984 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-34c315c2-fb3c-465f-959c-3adf8e9dd38c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:18.686560 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-34c315c2-fb3c-465f-959c-3adf8e9dd38c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:18.887264 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-84946b5c-adb1-4352-8703-9f4447c9f5da tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd4f8fb80>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:19.046193 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-84946b5c-adb1-4352-8703-9f4447c9f5da tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/images/778e673f-3171-46f0-a680-e9214da228fb" status: 200 len: 1452 microversion: 2.1 time: 0.161972 Oct 17 13:53:19.047605 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2046/3995] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:53:18 2022] GET /compute/v2.1/images/778e673f-3171-46f0-a680-e9214da228fb => generated 1452 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:53:19.086620 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-34c315c2-fb3c-465f-959c-3adf8e9dd38c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "POST /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d/action" status: 202 len: 0 microversion: 2.1 time: 0.421958 Oct 17 13:53:19.096530 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1950/3996] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:53:18 2022] POST /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d/action => generated 0 bytes in 431 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 17 13:53:19.111093 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9afab7de-d7e8-4124-a7e3-320eb9394d59 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:19.112039 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9afab7de-d7e8-4124-a7e3-320eb9394d59 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:19.115326 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=72,nova_api:DELETE=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:53:19.130382 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9afab7de-d7e8-4124-a7e3-320eb9394d59 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:19.131102 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9afab7de-d7e8-4124-a7e3-320eb9394d59 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:19.133886 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9afab7de-d7e8-4124-a7e3-320eb9394d59 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:19.134699 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9afab7de-d7e8-4124-a7e3-320eb9394d59 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:19.135198 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9afab7de-d7e8-4124-a7e3-320eb9394d59 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:19.137585 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9afab7de-d7e8-4124-a7e3-320eb9394d59 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:19.599856 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9afab7de-d7e8-4124-a7e3-320eb9394d59 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:19.608077 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9afab7de-d7e8-4124-a7e3-320eb9394d59 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1676 microversion: 2.1 time: 0.508519 Oct 17 13:53:19.625459 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2047/3997] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:19 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1676 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:20.064067 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-96a156e8-0447-4551-9d37-c61c2830166f tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd5225820>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:20.139271 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-96a156e8-0447-4551-9d37-c61c2830166f tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/images/778e673f-3171-46f0-a680-e9214da228fb" status: 200 len: 1452 microversion: 2.1 time: 0.080662 Oct 17 13:53:20.140140 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1951/3998] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:53:20 2022] GET /compute/v2.1/images/778e673f-3171-46f0-a680-e9214da228fb => generated 1452 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:20.345163 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2df683a8-266b-4055-ab6c-cdff8450811d tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:20.345931 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2df683a8-266b-4055-ab6c-cdff8450811d tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 68363fdf-f661-4b7c-abdc-7a8a85efa83a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:20.356582 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2df683a8-266b-4055-ab6c-cdff8450811d tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:20.362865 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2df683a8-266b-4055-ab6c-cdff8450811d tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:20.364821 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2df683a8-266b-4055-ab6c-cdff8450811d tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:20.368100 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2df683a8-266b-4055-ab6c-cdff8450811d tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:20.368836 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2df683a8-266b-4055-ab6c-cdff8450811d tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:20.370276 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2df683a8-266b-4055-ab6c-cdff8450811d tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:20.468822 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2df683a8-266b-4055-ab6c-cdff8450811d tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 68363fdf-f661-4b7c-abdc-7a8a85efa83a] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:53:20.588939 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:53:20.636076 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f8c4dec0-7311-459c-b034-7d9fce940a87 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:20.637190 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f8c4dec0-7311-459c-b034-7d9fce940a87 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:20.653084 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f8c4dec0-7311-459c-b034-7d9fce940a87 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:20.661678 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f8c4dec0-7311-459c-b034-7d9fce940a87 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:20.664837 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f8c4dec0-7311-459c-b034-7d9fce940a87 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:20.666248 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f8c4dec0-7311-459c-b034-7d9fce940a87 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:20.670094 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f8c4dec0-7311-459c-b034-7d9fce940a87 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:20.673216 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f8c4dec0-7311-459c-b034-7d9fce940a87 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:20.732846 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2df683a8-266b-4055-ab6c-cdff8450811d tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "DELETE /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a" status: 204 len: 0 microversion: 2.1 time: 0.391133 Oct 17 13:53:20.733899 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2048/3999] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:53:20 2022] DELETE /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:53:20.742805 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-785e717f-080e-4201-aee1-7eb3d25e949c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:20.744201 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-785e717f-080e-4201-aee1-7eb3d25e949c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 68363fdf-f661-4b7c-abdc-7a8a85efa83a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:20.757074 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-785e717f-080e-4201-aee1-7eb3d25e949c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:20.757634 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-785e717f-080e-4201-aee1-7eb3d25e949c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:20.758131 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-785e717f-080e-4201-aee1-7eb3d25e949c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:20.758908 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-785e717f-080e-4201-aee1-7eb3d25e949c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:20.759398 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-785e717f-080e-4201-aee1-7eb3d25e949c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:20.759879 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-785e717f-080e-4201-aee1-7eb3d25e949c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:21.664620 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-785e717f-080e-4201-aee1-7eb3d25e949c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:21.675925 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-785e717f-080e-4201-aee1-7eb3d25e949c tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a" status: 200 len: 1508 microversion: 2.1 time: 0.937683 Oct 17 13:53:21.685862 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2049/4000] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:20 2022] GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a => generated 1508 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:53:21.691107 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e6bbf17b-969c-4695-bb4b-6d300d46e027 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd463e670>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:21.709199 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f8c4dec0-7311-459c-b034-7d9fce940a87 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:21.719620 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f8c4dec0-7311-459c-b034-7d9fce940a87 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1684 microversion: 2.1 time: 1.087399 Oct 17 13:53:21.728322 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1952/4001] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:20 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1684 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:21.733593 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-7e81b73c-662c-4fac-8e96-c8bef889b109 req-c4d4e954-64e2-4c83-9e66-3f80dd0d44e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96dd349a-6476-4a7d-8f55-ea10e3b1e05d", "name": "network-vif-unplugged", "status": "completed", "tag": "fa985869-a190-4726-b04f-7d06a5c193e1"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:53:21.782352 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-7e81b73c-662c-4fac-8e96-c8bef889b109 req-c4d4e954-64e2-4c83-9e66-3f80dd0d44e0 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:21.784966 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-7e81b73c-662c-4fac-8e96-c8bef889b109 req-c4d4e954-64e2-4c83-9e66-3f80dd0d44e0 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:21.788390 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-7e81b73c-662c-4fac-8e96-c8bef889b109 req-c4d4e954-64e2-4c83-9e66-3f80dd0d44e0 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:21.831623 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e6bbf17b-969c-4695-bb4b-6d300d46e027 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/images/778e673f-3171-46f0-a680-e9214da228fb" status: 200 len: 1452 microversion: 2.1 time: 0.144575 Oct 17 13:53:21.840726 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2050/4002] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:53:21 2022] GET /compute/v2.1/images/778e673f-3171-46f0-a680-e9214da228fb => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:21.841970 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-7e81b73c-662c-4fac-8e96-c8bef889b109 req-c4d4e954-64e2-4c83-9e66-3f80dd0d44e0 service nova] Creating event network-vif-unplugged:fa985869-a190-4726-b04f-7d06a5c193e1 for instance 96dd349a-6476-4a7d-8f55-ea10e3b1e05d on n-h2-854247-14 Oct 17 13:53:21.876007 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-7e81b73c-662c-4fac-8e96-c8bef889b109 req-c4d4e954-64e2-4c83-9e66-3f80dd0d44e0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.136944 Oct 17 13:53:21.878928 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1953/4003] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:53:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:53:22.748594 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b4dbee1e-058f-4c1e-afe5-2cb89ef8cef1 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:22.749306 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b4dbee1e-058f-4c1e-afe5-2cb89ef8cef1 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:22.765596 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b4dbee1e-058f-4c1e-afe5-2cb89ef8cef1 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:22.772694 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b4dbee1e-058f-4c1e-afe5-2cb89ef8cef1 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:22.773151 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b4dbee1e-058f-4c1e-afe5-2cb89ef8cef1 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:22.773904 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b4dbee1e-058f-4c1e-afe5-2cb89ef8cef1 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:22.774364 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b4dbee1e-058f-4c1e-afe5-2cb89ef8cef1 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:22.774787 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b4dbee1e-058f-4c1e-afe5-2cb89ef8cef1 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:23.147748 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-96597e01-eac6-4604-9377-f70666de411a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:23.148270 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-96597e01-eac6-4604-9377-f70666de411a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 68363fdf-f661-4b7c-abdc-7a8a85efa83a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:23.163848 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-96597e01-eac6-4604-9377-f70666de411a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:23.165884 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-96597e01-eac6-4604-9377-f70666de411a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:23.165884 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-96597e01-eac6-4604-9377-f70666de411a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:23.165884 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-96597e01-eac6-4604-9377-f70666de411a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:23.166205 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-96597e01-eac6-4604-9377-f70666de411a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:23.166549 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-96597e01-eac6-4604-9377-f70666de411a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:23.606542 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b4dbee1e-058f-4c1e-afe5-2cb89ef8cef1 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:23.615551 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b4dbee1e-058f-4c1e-afe5-2cb89ef8cef1 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1684 microversion: 2.1 time: 0.872212 Oct 17 13:53:23.620083 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1954/4004] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:22 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1684 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:53:23.654074 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c990e000-68f8-4ee6-8f88-6b0fe870bff7 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd9a29dc0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:23.751979 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c990e000-68f8-4ee6-8f88-6b0fe870bff7 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/images/778e673f-3171-46f0-a680-e9214da228fb" status: 200 len: 1452 microversion: 2.1 time: 0.127281 Oct 17 13:53:23.752975 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1955/4005] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:53:23 2022] GET /compute/v2.1/images/778e673f-3171-46f0-a680-e9214da228fb => generated 1452 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:23.820274 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-96597e01-eac6-4604-9377-f70666de411a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:23.835010 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-96597e01-eac6-4604-9377-f70666de411a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a" status: 200 len: 1508 microversion: 2.1 time: 1.130801 Oct 17 13:53:23.835823 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2051/4006] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:22 2022] GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a => generated 1508 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:24.647414 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b0ccd303-e22a-44f4-b1ac-b5c987fdb3e8 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:24.648322 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b0ccd303-e22a-44f4-b1ac-b5c987fdb3e8 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:24.662053 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b0ccd303-e22a-44f4-b1ac-b5c987fdb3e8 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:24.662543 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b0ccd303-e22a-44f4-b1ac-b5c987fdb3e8 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:24.662983 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b0ccd303-e22a-44f4-b1ac-b5c987fdb3e8 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:24.663727 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b0ccd303-e22a-44f4-b1ac-b5c987fdb3e8 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:24.664176 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b0ccd303-e22a-44f4-b1ac-b5c987fdb3e8 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:24.664603 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b0ccd303-e22a-44f4-b1ac-b5c987fdb3e8 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:24.768637 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0d82e8e2-d11f-4efa-86e1-a317084482ee tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd99034c0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:24.831233 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0d82e8e2-d11f-4efa-86e1-a317084482ee tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/images/778e673f-3171-46f0-a680-e9214da228fb" status: 200 len: 1452 microversion: 2.1 time: 0.066434 Oct 17 13:53:24.835472 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2052/4007] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:53:24 2022] GET /compute/v2.1/images/778e673f-3171-46f0-a680-e9214da228fb => generated 1452 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:24.858479 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-84130d8b-5744-4362-9afa-ad4c5c6a04ad tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:24.860652 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-84130d8b-5744-4362-9afa-ad4c5c6a04ad tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 68363fdf-f661-4b7c-abdc-7a8a85efa83a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:24.877952 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-84130d8b-5744-4362-9afa-ad4c5c6a04ad tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:24.878689 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-84130d8b-5744-4362-9afa-ad4c5c6a04ad tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:24.879388 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-84130d8b-5744-4362-9afa-ad4c5c6a04ad tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:24.880334 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-84130d8b-5744-4362-9afa-ad4c5c6a04ad tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:24.880990 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-84130d8b-5744-4362-9afa-ad4c5c6a04ad tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:24.881635 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-84130d8b-5744-4362-9afa-ad4c5c6a04ad tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:25.190705 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b0ccd303-e22a-44f4-b1ac-b5c987fdb3e8 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:25.213136 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b0ccd303-e22a-44f4-b1ac-b5c987fdb3e8 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1684 microversion: 2.1 time: 0.574937 Oct 17 13:53:25.227727 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1956/4008] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:24 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1684 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:25.235645 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3a90cb0f-53cc-436a-bce9-7d068f881569 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:25.236457 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3a90cb0f-53cc-436a-bce9-7d068f881569 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:25.243557 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3a90cb0f-53cc-436a-bce9-7d068f881569 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:25.244335 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3a90cb0f-53cc-436a-bce9-7d068f881569 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:25.244927 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3a90cb0f-53cc-436a-bce9-7d068f881569 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:25.245837 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3a90cb0f-53cc-436a-bce9-7d068f881569 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:25.246446 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3a90cb0f-53cc-436a-bce9-7d068f881569 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:25.247024 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3a90cb0f-53cc-436a-bce9-7d068f881569 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:25.262465 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-3a90cb0f-53cc-436a-bce9-7d068f881569 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] HTTP exception thrown: Instance 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 could not be found. Oct 17 13:53:25.264509 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3a90cb0f-53cc-436a-bce9-7d068f881569 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Request method failure captured: Oct 17 13:53:25.264509 n-d-854247-14 devstack@n-api.service[127017]: request: DELETE /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 HTTP/1.1 Oct 17 13:53:25.264509 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:53:25.264509 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:53:25.264509 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:53:25.264509 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:53:25.264509 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:53:25.264509 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:53:25.264509 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:53:25.264509 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:53:25.264509 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVyomfvbOy6S2rpnoh5-yHaZQOoWWGGkc9XAhTfkiAaHU8Bq-7OTtRnYRa_7jsQYNX1M9Env1-vRByaZlfV7jfe9V8Z-p2Ct4sa7iO0yWjI07xW_vABQr8G-2zhbR4WLJW3ukuXTCLvFE4SZVXP1tpCEtIo-LGSTulT2fce1IJR4uqk Oct 17 13:53:25.264509 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:53:25.264509 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:53:25.264509 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:53:25.264509 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:53:25.264509 n-d-854247-14 devstack@n-api.service[127017]: X-Openstack-Nova-Api-Version: 2.32 Oct 17 13:53:25.264509 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:53:25.264509 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:53:25.264509 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: cfbeaa08d8384042a26c865a2efba214 Oct 17 13:53:25.264509 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-TaggedBootDevicesTest-273679803 Oct 17 13:53:25.264509 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:53:25.264509 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:53:25.264509 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cfbeaa08d8384042a26c865a2efba214"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/cfbeaa08d8384042a26c865a2efba214"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cfbeaa08d8384042a26c865a2efba214"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_cfbeaa08d8384042a26c865a2efba214", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:53:25.264509 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-TaggedBootDevicesTest-273679803 Oct 17 13:53:25.264509 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: cfbeaa08d8384042a26c865a2efba214 Oct 17 13:53:25.264509 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-TaggedBootDevicesTest-273679803 Oct 17 13:53:25.264509 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-TaggedBootDevicesTest-273679803-project Oct 17 13:53:25.264509 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:53:25.264509 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:53:25.264509 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: e02c176dc1a6460882ca3969d52c195b Oct 17 13:53:25.264509 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-TaggedBootDevicesTest-273679803-project Oct 17 13:53:25.264509 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:53:25.264509 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 could not be found. Oct 17 13:53:25.264509 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2'} Oct 17 13:53:25.264509 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:53:25.264509 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:53:25.264509 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:53:25.264509 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:53:25.264509 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:53:25.264509 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:53:25.264509 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:53:25.264509 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:53:25.264509 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:53:25.264509 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:53:25.264509 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 could not be found. Oct 17 13:53:25.264509 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:53:25.264509 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:53:25.264509 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:53:25.264509 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:53:25.264509 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:53:25.264509 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:53:25.264509 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:53:25.264509 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:53:25.264509 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:53:25.264509 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:53:25.264509 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:53:25.264509 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:53:25.264509 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:53:25.264509 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:53:25.264509 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:53:25.264509 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:53:25.264509 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:53:25.264509 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:53:25.268192 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 could not be found. Oct 17 13:53:25.268192 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:53:25.268192 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:53:25.268192 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:53:25.268192 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:53:25.268192 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:53:25.268192 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:53:25.268192 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:53:25.268192 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:53:25.268192 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 could not be found. Oct 17 13:53:25.268192 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:53:25.270510 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3a90cb0f-53cc-436a-bce9-7d068f881569 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Returning 404 to user: Instance 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:53:25.271991 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3a90cb0f-53cc-436a-bce9-7d068f881569 tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "DELETE /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 404 len: 111 microversion: 2.32 time: 0.043109 Oct 17 13:53:25.273219 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1957/4009] 10.222.0.79 () {60 vars in 1280 bytes} [Mon Oct 17 13:53:25 2022] DELETE /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:53:25.283014 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a9b948d5-884a-4b2e-9a33-ec15051c918a tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:25.284728 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a9b948d5-884a-4b2e-9a33-ec15051c918a tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] [instance: 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:25.300811 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a9b948d5-884a-4b2e-9a33-ec15051c918a tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:25.301314 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a9b948d5-884a-4b2e-9a33-ec15051c918a tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:25.302576 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a9b948d5-884a-4b2e-9a33-ec15051c918a tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:25.303623 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a9b948d5-884a-4b2e-9a33-ec15051c918a tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:25.304123 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a9b948d5-884a-4b2e-9a33-ec15051c918a tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:25.304550 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a9b948d5-884a-4b2e-9a33-ec15051c918a tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:25.331139 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-a9b948d5-884a-4b2e-9a33-ec15051c918a tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] HTTP exception thrown: Instance 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 could not be found. Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a9b948d5-884a-4b2e-9a33-ec15051c918a tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Request method failure captured: Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 HTTP/1.1 Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVyomfvbOy6S2rpnoh5-yHaZQOoWWGGkc9XAhTfkiAaHU8Bq-7OTtRnYRa_7jsQYNX1M9Env1-vRByaZlfV7jfe9V8Z-p2Ct4sa7iO0yWjI07xW_vABQr8G-2zhbR4WLJW3ukuXTCLvFE4SZVXP1tpCEtIo-LGSTulT2fce1IJR4uqk Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: X-Openstack-Nova-Api-Version: 2.32 Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: cfbeaa08d8384042a26c865a2efba214 Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-TaggedBootDevicesTest-273679803 Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cfbeaa08d8384042a26c865a2efba214"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/cfbeaa08d8384042a26c865a2efba214"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cfbeaa08d8384042a26c865a2efba214"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_cfbeaa08d8384042a26c865a2efba214", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-TaggedBootDevicesTest-273679803 Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: cfbeaa08d8384042a26c865a2efba214 Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-TaggedBootDevicesTest-273679803 Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-TaggedBootDevicesTest-273679803-project Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: e02c176dc1a6460882ca3969d52c195b Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-TaggedBootDevicesTest-273679803-project Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 could not be found. Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2'} Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 could not be found. Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 could not be found. Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:53:25.333290 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:53:25.336881 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:53:25.336881 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:53:25.336881 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:53:25.336881 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:53:25.336881 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:53:25.336881 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 could not be found. Oct 17 13:53:25.336881 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:53:25.347620 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a9b948d5-884a-4b2e-9a33-ec15051c918a tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] Returning 404 to user: Instance 6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:53:25.348762 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a9b948d5-884a-4b2e-9a33-ec15051c918a tempest-TaggedBootDevicesTest-273679803 tempest-TaggedBootDevicesTest-273679803-project] 10.222.0.79 "GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2" status: 404 len: 111 microversion: 2.32 time: 0.070611 Oct 17 13:53:25.349566 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1958/4010] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:53:25 2022] GET /compute/v2.1/servers/6e2db4d1-124b-4ef5-9b1f-bc72ea0fcaf2 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:53:25.362766 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-babfa6e1-c5a0-40cb-9ae2-aa97ce41cfd2 req-f901fbd6-cade-42f6-a352-e28faaad06be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68363fdf-f661-4b7c-abdc-7a8a85efa83a", "name": "network-vif-deleted", "tag": "911f2c55-5cc0-40f4-bc39-8c329a19fc67"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:53:25.374413 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-babfa6e1-c5a0-40cb-9ae2-aa97ce41cfd2 req-f901fbd6-cade-42f6-a352-e28faaad06be service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:25.375145 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-babfa6e1-c5a0-40cb-9ae2-aa97ce41cfd2 req-f901fbd6-cade-42f6-a352-e28faaad06be service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:25.376826 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-babfa6e1-c5a0-40cb-9ae2-aa97ce41cfd2 req-f901fbd6-cade-42f6-a352-e28faaad06be service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:25.410790 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-babfa6e1-c5a0-40cb-9ae2-aa97ce41cfd2 req-f901fbd6-cade-42f6-a352-e28faaad06be service nova] Creating event network-vif-deleted:911f2c55-5cc0-40f4-bc39-8c329a19fc67 for instance 68363fdf-f661-4b7c-abdc-7a8a85efa83a on n-h2-854247-14 Oct 17 13:53:25.423875 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-babfa6e1-c5a0-40cb-9ae2-aa97ce41cfd2 req-f901fbd6-cade-42f6-a352-e28faaad06be service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066863 Oct 17 13:53:25.425305 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1959/4011] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:53:25.459121 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-31686ee6-57b3-44cf-b06f-f861a545097c tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:25.463045 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-31686ee6-57b3-44cf-b06f-f861a545097c tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:25.488608 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-31686ee6-57b3-44cf-b06f-f861a545097c tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:25.489441 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-31686ee6-57b3-44cf-b06f-f861a545097c tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:25.489947 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-84130d8b-5744-4362-9afa-ad4c5c6a04ad tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:25.490388 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-31686ee6-57b3-44cf-b06f-f861a545097c tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:25.494250 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-31686ee6-57b3-44cf-b06f-f861a545097c tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:25.494898 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-31686ee6-57b3-44cf-b06f-f861a545097c tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:25.496991 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-31686ee6-57b3-44cf-b06f-f861a545097c tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:25.509225 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-84130d8b-5744-4362-9afa-ad4c5c6a04ad tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a" status: 200 len: 1508 microversion: 2.1 time: 0.655165 Oct 17 13:53:25.523690 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2053/4012] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:24 2022] GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a => generated 1508 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:25.597172 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-31686ee6-57b3-44cf-b06f-f861a545097c tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5/os-volume_attachments/c649a299-3496-4d42-b923-464ea50e14de" status: 200 len: 194 microversion: 2.1 time: 0.170300 Oct 17 13:53:25.598382 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1960/4013] 10.222.0.79 () {58 vars in 1413 bytes} [Mon Oct 17 13:53:25 2022] GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5/os-volume_attachments/c649a299-3496-4d42-b923-464ea50e14de => generated 194 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:53:25.610041 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-43a0a410-8643-45f9-8164-cda77a5eb56d tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:25.610535 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-43a0a410-8643-45f9-8164-cda77a5eb56d tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:25.626295 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-43a0a410-8643-45f9-8164-cda77a5eb56d tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:25.626795 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-43a0a410-8643-45f9-8164-cda77a5eb56d tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:25.627263 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-43a0a410-8643-45f9-8164-cda77a5eb56d tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:25.628162 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-43a0a410-8643-45f9-8164-cda77a5eb56d tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:25.629261 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-43a0a410-8643-45f9-8164-cda77a5eb56d tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:25.630622 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-43a0a410-8643-45f9-8164-cda77a5eb56d tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:25.838631 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-43a0a410-8643-45f9-8164-cda77a5eb56d tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lazy-loading 'services' on Instance uuid bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:53:25.851750 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-455f10b1-8e9e-4a4b-ba82-d945748adfd7 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd9903700>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:25.933700 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-455f10b1-8e9e-4a4b-ba82-d945748adfd7 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/images/778e673f-3171-46f0-a680-e9214da228fb" status: 200 len: 1461 microversion: 2.1 time: 0.086985 Oct 17 13:53:25.937528 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1961/4014] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:53:25 2022] GET /compute/v2.1/images/778e673f-3171-46f0-a680-e9214da228fb => generated 1461 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:25.960982 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0639d0a7-1e82-4373-9064-cbb58ec491aa tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd9a22040>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:26.033798 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0639d0a7-1e82-4373-9064-cbb58ec491aa tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/images/778e673f-3171-46f0-a680-e9214da228fb" status: 200 len: 1461 microversion: 2.1 time: 0.087853 Oct 17 13:53:26.035914 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1962/4015] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:53:25 2022] GET /compute/v2.1/images/778e673f-3171-46f0-a680-e9214da228fb => generated 1461 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:26.061386 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f7dbdab3-9223-4437-a560-e920a9b7c197 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:26.062263 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f7dbdab3-9223-4437-a560-e920a9b7c197 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] [instance: 5fea9fdd-bc16-4923-bbf8-e0909cd3bcda] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:26.065734 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-43a0a410-8643-45f9-8164-cda77a5eb56d tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "DELETE /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5/os-volume_attachments/c649a299-3496-4d42-b923-464ea50e14de" status: 202 len: 0 microversion: 2.1 time: 0.459351 Oct 17 13:53:26.066980 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2054/4016] 10.222.0.79 () {58 vars in 1416 bytes} [Mon Oct 17 13:53:25 2022] DELETE /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5/os-volume_attachments/c649a299-3496-4d42-b923-464ea50e14de => generated 0 bytes in 462 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:53:26.075483 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f7dbdab3-9223-4437-a560-e920a9b7c197 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:26.075980 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f7dbdab3-9223-4437-a560-e920a9b7c197 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:26.076607 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f7dbdab3-9223-4437-a560-e920a9b7c197 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:26.078378 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f7dbdab3-9223-4437-a560-e920a9b7c197 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:26.078986 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f7dbdab3-9223-4437-a560-e920a9b7c197 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:26.083962 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f7dbdab3-9223-4437-a560-e920a9b7c197 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:26.148005 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-ffaa98ae-7c46-4589-8917-718d143ee89a req-9d95519b-1dc0-45b9-b7c0-9d8b1491a1da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96dd349a-6476-4a7d-8f55-ea10e3b1e05d", "name": "network-vif-plugged", "status": "completed", "tag": "fa985869-a190-4726-b04f-7d06a5c193e1"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:53:26.177247 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-ffaa98ae-7c46-4589-8917-718d143ee89a req-9d95519b-1dc0-45b9-b7c0-9d8b1491a1da service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:26.178273 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-ffaa98ae-7c46-4589-8917-718d143ee89a req-9d95519b-1dc0-45b9-b7c0-9d8b1491a1da service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:26.180762 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-ffaa98ae-7c46-4589-8917-718d143ee89a req-9d95519b-1dc0-45b9-b7c0-9d8b1491a1da service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:26.223106 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-ffaa98ae-7c46-4589-8917-718d143ee89a req-9d95519b-1dc0-45b9-b7c0-9d8b1491a1da service nova] Creating event network-vif-plugged:fa985869-a190-4726-b04f-7d06a5c193e1 for instance 96dd349a-6476-4a7d-8f55-ea10e3b1e05d on n-h2-854247-14 Oct 17 13:53:26.272857 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-ffaa98ae-7c46-4589-8917-718d143ee89a req-9d95519b-1dc0-45b9-b7c0-9d8b1491a1da service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131087 Oct 17 13:53:26.273493 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2055/4017] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:53:26.296110 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-32391f0f-be93-44aa-b471-8f505d4af1d2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:26.296780 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-32391f0f-be93-44aa-b471-8f505d4af1d2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:26.306459 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-32391f0f-be93-44aa-b471-8f505d4af1d2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:26.306960 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-32391f0f-be93-44aa-b471-8f505d4af1d2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:26.307440 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-32391f0f-be93-44aa-b471-8f505d4af1d2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:26.308217 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-32391f0f-be93-44aa-b471-8f505d4af1d2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:26.308671 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-32391f0f-be93-44aa-b471-8f505d4af1d2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:26.309087 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-32391f0f-be93-44aa-b471-8f505d4af1d2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:26.552794 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f7dbdab3-9223-4437-a560-e920a9b7c197 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bfe589d0784bfc8ed1611c71cd4461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb1624a35d0403c9e5d09a17e79b7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:26.565322 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f7dbdab3-9223-4437-a560-e920a9b7c197 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/servers/5fea9fdd-bc16-4923-bbf8-e0909cd3bcda" status: 200 len: 1468 microversion: 2.1 time: 0.507890 Oct 17 13:53:26.574028 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1963/4018] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:26 2022] GET /compute/v2.1/servers/5fea9fdd-bc16-4923-bbf8-e0909cd3bcda => generated 1468 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:53:26.592047 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-226d897e-021d-44dc-a8f3-ca610d85ca09 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:26.592899 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-226d897e-021d-44dc-a8f3-ca610d85ca09 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 68363fdf-f661-4b7c-abdc-7a8a85efa83a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:26.601542 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-226d897e-021d-44dc-a8f3-ca610d85ca09 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:26.602104 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-226d897e-021d-44dc-a8f3-ca610d85ca09 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:26.617613 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-226d897e-021d-44dc-a8f3-ca610d85ca09 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:26.617613 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-226d897e-021d-44dc-a8f3-ca610d85ca09 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:26.617613 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-226d897e-021d-44dc-a8f3-ca610d85ca09 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:26.618297 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-226d897e-021d-44dc-a8f3-ca610d85ca09 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:26.639393 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-226d897e-021d-44dc-a8f3-ca610d85ca09 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] HTTP exception thrown: Instance 68363fdf-f661-4b7c-abdc-7a8a85efa83a could not be found. Oct 17 13:53:26.644379 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-226d897e-021d-44dc-a8f3-ca610d85ca09 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Request method failure captured: Oct 17 13:53:26.644379 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a HTTP/1.1 Oct 17 13:53:26.644379 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:53:26.644379 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:53:26.644379 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:53:26.644379 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:53:26.644379 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:53:26.644379 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:53:26.644379 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:53:26.644379 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:53:26.644379 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTV0lGewBAd5oX7RsuswRRrYdH_s7fnCDLNRSaJQAxErmqZOT5QT6523TfZqZvgb4tWrIGVLDqv0foQ4mpFwe91mdGAxx6JOfjpLIqY8Vnvh6NrynvpuS4ywkAJAwUfpPeJ0dauW6Gj_xg5-jDhUd1iFTLiSXh_-SOzh7_iyTjRI7Ovs Oct 17 13:53:26.644379 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:53:26.644379 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:53:26.644379 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:53:26.644379 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:53:26.644379 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:53:26.644379 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:53:26.644379 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 08068aeba86c4e718ba1e25c68fd3259 Oct 17 13:53:26.644379 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1627831718 Oct 17 13:53:26.644379 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:53:26.644379 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:53:26.644379 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/08068aeba86c4e718ba1e25c68fd3259"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/08068aeba86c4e718ba1e25c68fd3259"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/08068aeba86c4e718ba1e25c68fd3259"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_08068aeba86c4e718ba1e25c68fd3259", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:53:26.644379 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1627831718 Oct 17 13:53:26.644379 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 08068aeba86c4e718ba1e25c68fd3259 Oct 17 13:53:26.644379 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1627831718 Oct 17 13:53:26.644379 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServerRescueNegativeTestJSON-1627831718-project Oct 17 13:53:26.644379 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:53:26.644379 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:53:26.644379 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: d56b91ce42894bafac5ddb16ad6f037b Oct 17 13:53:26.644379 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1627831718-project Oct 17 13:53:26.644379 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:53:26.644379 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 68363fdf-f661-4b7c-abdc-7a8a85efa83a could not be found. Oct 17 13:53:26.644379 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '68363fdf-f661-4b7c-abdc-7a8a85efa83a'} Oct 17 13:53:26.644379 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:53:26.644379 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:53:26.644379 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:53:26.644379 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:53:26.644379 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:53:26.644379 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:53:26.644379 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:53:26.644379 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:53:26.644379 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:53:26.644379 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:53:26.644379 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68363fdf-f661-4b7c-abdc-7a8a85efa83a could not be found. Oct 17 13:53:26.644379 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:53:26.644379 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:53:26.644379 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:53:26.644379 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:53:26.644379 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:53:26.644379 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:53:26.644379 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:53:26.644379 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:53:26.644379 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:53:26.644379 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:53:26.644379 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:53:26.644379 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:53:26.644379 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:53:26.644379 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:53:26.644379 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:53:26.644379 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:53:26.644379 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68363fdf-f661-4b7c-abdc-7a8a85efa83a could not be found. Oct 17 13:53:26.644379 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:53:26.644379 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:53:26.647782 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:53:26.647782 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:53:26.647782 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:53:26.647782 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:53:26.647782 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:53:26.647782 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:53:26.647782 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68363fdf-f661-4b7c-abdc-7a8a85efa83a could not be found. Oct 17 13:53:26.647782 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:53:26.647782 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-226d897e-021d-44dc-a8f3-ca610d85ca09 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Returning 404 to user: Instance 68363fdf-f661-4b7c-abdc-7a8a85efa83a could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:53:26.647782 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-226d897e-021d-44dc-a8f3-ca610d85ca09 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a" status: 404 len: 111 microversion: 2.1 time: 0.070663 Oct 17 13:53:26.647782 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1964/4019] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:26 2022] GET /compute/v2.1/servers/68363fdf-f661-4b7c-abdc-7a8a85efa83a => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:53:26.653550 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ce4ec57f-7f64-43ca-a816-edd64762d150 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1582714794"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:53:26.666110 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ce4ec57f-7f64-43ca-a816-edd64762d150 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] [instance: 419a7ac0-9332-481d-bc66-3ad5b6a9db81] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:26.674455 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ce4ec57f-7f64-43ca-a816-edd64762d150 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:26.680535 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ce4ec57f-7f64-43ca-a816-edd64762d150 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:26.681175 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ce4ec57f-7f64-43ca-a816-edd64762d150 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:26.682042 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ce4ec57f-7f64-43ca-a816-edd64762d150 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:26.682617 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ce4ec57f-7f64-43ca-a816-edd64762d150 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:26.683228 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ce4ec57f-7f64-43ca-a816-edd64762d150 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:27.138960 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ce4ec57f-7f64-43ca-a816-edd64762d150 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "POST /compute/v2.1/servers/419a7ac0-9332-481d-bc66-3ad5b6a9db81/action" status: 202 len: 0 microversion: 2.1 time: 0.490780 Oct 17 13:53:27.141589 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1965/4020] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:53:26 2022] POST /compute/v2.1/servers/419a7ac0-9332-481d-bc66-3ad5b6a9db81/action => generated 0 bytes in 494 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 17 13:53:27.149777 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e085261c-cafe-4297-a36a-bf3a0ee48c7d tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:27.156279 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e085261c-cafe-4297-a36a-bf3a0ee48c7d tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 33de8199-8f00-40eb-9b95-b7ab5289dbe3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:27.169140 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e085261c-cafe-4297-a36a-bf3a0ee48c7d tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:27.173260 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e085261c-cafe-4297-a36a-bf3a0ee48c7d tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:27.173722 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e085261c-cafe-4297-a36a-bf3a0ee48c7d tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:27.174471 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e085261c-cafe-4297-a36a-bf3a0ee48c7d tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:27.174930 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e085261c-cafe-4297-a36a-bf3a0ee48c7d tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:27.175450 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e085261c-cafe-4297-a36a-bf3a0ee48c7d tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:27.242741 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e085261c-cafe-4297-a36a-bf3a0ee48c7d tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 33de8199-8f00-40eb-9b95-b7ab5289dbe3] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:53:27.243320 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-32391f0f-be93-44aa-b471-8f505d4af1d2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:27.254673 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-32391f0f-be93-44aa-b471-8f505d4af1d2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1679 microversion: 2.1 time: 0.972234 Oct 17 13:53:27.255938 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2056/4021] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:26 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1679 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:27.260811 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7a7e540d-53ca-41ec-b622-63770dd692ac tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd982a9d0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:27.360466 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7a7e540d-53ca-41ec-b622-63770dd692ac tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/images/1c87bf9a-af5f-491c-829a-c8ee2c5ec23e" status: 200 len: 1453 microversion: 2.1 time: 0.100041 Oct 17 13:53:27.363504 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2057/4022] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:53:27 2022] GET /compute/v2.1/images/1c87bf9a-af5f-491c-829a-c8ee2c5ec23e => generated 1453 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:27.529191 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e085261c-cafe-4297-a36a-bf3a0ee48c7d tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "DELETE /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3" status: 204 len: 0 microversion: 2.1 time: 0.385826 Oct 17 13:53:27.530261 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1966/4023] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:53:27 2022] DELETE /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:53:27.538312 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0dbf08e2-70b5-436e-8cff-defe8b46ecec tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:27.538925 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0dbf08e2-70b5-436e-8cff-defe8b46ecec tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 33de8199-8f00-40eb-9b95-b7ab5289dbe3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:27.554065 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0dbf08e2-70b5-436e-8cff-defe8b46ecec tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:27.554462 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0dbf08e2-70b5-436e-8cff-defe8b46ecec tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:27.554891 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0dbf08e2-70b5-436e-8cff-defe8b46ecec tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:27.555630 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0dbf08e2-70b5-436e-8cff-defe8b46ecec tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:27.556080 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0dbf08e2-70b5-436e-8cff-defe8b46ecec tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:27.556503 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0dbf08e2-70b5-436e-8cff-defe8b46ecec tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:27.852877 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0dbf08e2-70b5-436e-8cff-defe8b46ecec tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:27.873499 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0dbf08e2-70b5-436e-8cff-defe8b46ecec tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3" status: 200 len: 1523 microversion: 2.1 time: 0.337367 Oct 17 13:53:27.875007 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2058/4024] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:27 2022] GET /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3 => generated 1523 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:28.278575 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-89388074-1f68-47b6-87e2-1903743d8874 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:28.280029 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-89388074-1f68-47b6-87e2-1903743d8874 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:28.290906 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-89388074-1f68-47b6-87e2-1903743d8874 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:28.297770 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-89388074-1f68-47b6-87e2-1903743d8874 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:28.298387 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-89388074-1f68-47b6-87e2-1903743d8874 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:28.299310 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-89388074-1f68-47b6-87e2-1903743d8874 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:28.300165 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-89388074-1f68-47b6-87e2-1903743d8874 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:28.300747 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-89388074-1f68-47b6-87e2-1903743d8874 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:28.378864 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b1ce2241-1de0-4f67-8dd4-7cc7711b3a77 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd9861670>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:28.481504 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b1ce2241-1de0-4f67-8dd4-7cc7711b3a77 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/images/1c87bf9a-af5f-491c-829a-c8ee2c5ec23e" status: 200 len: 1453 microversion: 2.1 time: 0.102832 Oct 17 13:53:28.492731 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2059/4025] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:53:28 2022] GET /compute/v2.1/images/1c87bf9a-af5f-491c-829a-c8ee2c5ec23e => generated 1453 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:53:28.618334 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-89388074-1f68-47b6-87e2-1903743d8874 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:28.627667 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-89388074-1f68-47b6-87e2-1903743d8874 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1679 microversion: 2.1 time: 0.353283 Oct 17 13:53:28.629974 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1967/4026] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:28 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1679 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:28.901238 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f69008ab-24aa-42dc-9ed1-1729bd64188a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:28.904986 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f69008ab-24aa-42dc-9ed1-1729bd64188a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 33de8199-8f00-40eb-9b95-b7ab5289dbe3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:28.912599 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f69008ab-24aa-42dc-9ed1-1729bd64188a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:28.913093 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f69008ab-24aa-42dc-9ed1-1729bd64188a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:28.913555 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f69008ab-24aa-42dc-9ed1-1729bd64188a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:28.914227 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f69008ab-24aa-42dc-9ed1-1729bd64188a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:28.915045 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f69008ab-24aa-42dc-9ed1-1729bd64188a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:28.915575 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f69008ab-24aa-42dc-9ed1-1729bd64188a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:29.141851 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f69008ab-24aa-42dc-9ed1-1729bd64188a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:29.151046 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f69008ab-24aa-42dc-9ed1-1729bd64188a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3" status: 200 len: 1523 microversion: 2.1 time: 0.254225 Oct 17 13:53:29.171738 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2060/4027] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:28 2022] GET /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3 => generated 1523 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:29.499961 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-98f8a943-e409-4ab3-8ac3-70c5663397d3 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd9a22160>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:29.641152 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-98f8a943-e409-4ab3-8ac3-70c5663397d3 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/images/1c87bf9a-af5f-491c-829a-c8ee2c5ec23e" status: 200 len: 1453 microversion: 2.1 time: 0.146380 Oct 17 13:53:29.642159 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1968/4028] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:53:29 2022] GET /compute/v2.1/images/1c87bf9a-af5f-491c-829a-c8ee2c5ec23e => generated 1453 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:29.654155 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cd8d609f-338a-4ffe-88c3-803ed8fb0527 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:29.654974 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cd8d609f-338a-4ffe-88c3-803ed8fb0527 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:29.662947 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cd8d609f-338a-4ffe-88c3-803ed8fb0527 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:29.678806 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cd8d609f-338a-4ffe-88c3-803ed8fb0527 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:29.679426 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cd8d609f-338a-4ffe-88c3-803ed8fb0527 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:29.680283 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cd8d609f-338a-4ffe-88c3-803ed8fb0527 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:29.681011 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cd8d609f-338a-4ffe-88c3-803ed8fb0527 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:29.684035 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cd8d609f-338a-4ffe-88c3-803ed8fb0527 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:30.019106 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cd8d609f-338a-4ffe-88c3-803ed8fb0527 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:30.033794 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cd8d609f-338a-4ffe-88c3-803ed8fb0527 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1679 microversion: 2.1 time: 0.383707 Oct 17 13:53:30.034394 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2061/4029] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:29 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1679 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:30.184715 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5868a860-8164-4a0e-8df0-3961c12302f7 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:30.185358 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5868a860-8164-4a0e-8df0-3961c12302f7 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 33de8199-8f00-40eb-9b95-b7ab5289dbe3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:30.216357 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5868a860-8164-4a0e-8df0-3961c12302f7 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:30.216862 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5868a860-8164-4a0e-8df0-3961c12302f7 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:30.217309 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5868a860-8164-4a0e-8df0-3961c12302f7 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:30.218044 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5868a860-8164-4a0e-8df0-3961c12302f7 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:30.218508 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5868a860-8164-4a0e-8df0-3961c12302f7 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:30.218939 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5868a860-8164-4a0e-8df0-3961c12302f7 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:30.515221 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5868a860-8164-4a0e-8df0-3961c12302f7 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:30.526243 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5868a860-8164-4a0e-8df0-3961c12302f7 tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3" status: 200 len: 1523 microversion: 2.1 time: 0.346507 Oct 17 13:53:30.526887 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1969/4030] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:30 2022] GET /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3 => generated 1523 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:30.657890 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-12769e1e-5e26-4f13-896c-6295fcb30999 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd4f8fb80>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:30.791881 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-12769e1e-5e26-4f13-896c-6295fcb30999 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/images/1c87bf9a-af5f-491c-829a-c8ee2c5ec23e" status: 200 len: 1453 microversion: 2.1 time: 0.137051 Oct 17 13:53:30.792943 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2062/4031] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:53:30 2022] GET /compute/v2.1/images/1c87bf9a-af5f-491c-829a-c8ee2c5ec23e => generated 1453 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:31.061523 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7f9f0288-80b7-4832-9613-bb4de91e8248 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:31.062259 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7f9f0288-80b7-4832-9613-bb4de91e8248 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:31.094552 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7f9f0288-80b7-4832-9613-bb4de91e8248 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:31.101310 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7f9f0288-80b7-4832-9613-bb4de91e8248 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:31.103201 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7f9f0288-80b7-4832-9613-bb4de91e8248 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:31.114026 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7f9f0288-80b7-4832-9613-bb4de91e8248 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:31.115096 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7f9f0288-80b7-4832-9613-bb4de91e8248 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:31.115837 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7f9f0288-80b7-4832-9613-bb4de91e8248 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:31.145907 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:53:31.222972 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-3c9a9d7b-104f-4ca6-933f-ff286b787033 req-41dca5b8-d88c-48c0-8c44-e5ee296a2d3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fea9fdd-bc16-4923-bbf8-e0909cd3bcda", "name": "network-vif-unplugged", "status": "completed", "tag": "9a6b33a5-082e-4c10-8994-0c42a775e094"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:53:31.244780 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-3c9a9d7b-104f-4ca6-933f-ff286b787033 req-41dca5b8-d88c-48c0-8c44-e5ee296a2d3f service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:31.245813 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-3c9a9d7b-104f-4ca6-933f-ff286b787033 req-41dca5b8-d88c-48c0-8c44-e5ee296a2d3f service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:31.246470 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-3c9a9d7b-104f-4ca6-933f-ff286b787033 req-41dca5b8-d88c-48c0-8c44-e5ee296a2d3f service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:31.262251 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-3c9a9d7b-104f-4ca6-933f-ff286b787033 req-41dca5b8-d88c-48c0-8c44-e5ee296a2d3f service nova] Creating event network-vif-unplugged:9a6b33a5-082e-4c10-8994-0c42a775e094 for instance 5fea9fdd-bc16-4923-bbf8-e0909cd3bcda on n-h1-854247-14 Oct 17 13:53:31.268797 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-3c9a9d7b-104f-4ca6-933f-ff286b787033 req-41dca5b8-d88c-48c0-8c44-e5ee296a2d3f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051672 Oct 17 13:53:31.270007 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2063/4032] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:53:31.514650 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7f9f0288-80b7-4832-9613-bb4de91e8248 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:31.527102 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7f9f0288-80b7-4832-9613-bb4de91e8248 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1679 microversion: 2.1 time: 0.468913 Oct 17 13:53:31.529022 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1970/4033] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:31 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1679 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:31.556421 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9e481306-93fa-447e-84a4-d966b9b4ebee tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:31.557395 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9e481306-93fa-447e-84a4-d966b9b4ebee tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 33de8199-8f00-40eb-9b95-b7ab5289dbe3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:31.588055 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9e481306-93fa-447e-84a4-d966b9b4ebee tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:31.588667 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9e481306-93fa-447e-84a4-d966b9b4ebee tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:31.593119 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9e481306-93fa-447e-84a4-d966b9b4ebee tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:31.598061 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9e481306-93fa-447e-84a4-d966b9b4ebee tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:31.600786 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9e481306-93fa-447e-84a4-d966b9b4ebee tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:31.601875 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9e481306-93fa-447e-84a4-d966b9b4ebee tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:31.809940 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bfa89945-06f1-40e1-8465-c007ae97a6bf tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd5225a60>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:31.936988 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-bfa89945-06f1-40e1-8465-c007ae97a6bf tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/images/1c87bf9a-af5f-491c-829a-c8ee2c5ec23e" status: 200 len: 1453 microversion: 2.1 time: 0.132536 Oct 17 13:53:31.939319 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1971/4034] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:53:31 2022] GET /compute/v2.1/images/1c87bf9a-af5f-491c-829a-c8ee2c5ec23e => generated 1453 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:32.068523 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9e481306-93fa-447e-84a4-d966b9b4ebee tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:32.079142 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9e481306-93fa-447e-84a4-d966b9b4ebee tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3" status: 200 len: 1523 microversion: 2.1 time: 0.528874 Oct 17 13:53:32.082732 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2064/4035] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:31 2022] GET /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3 => generated 1523 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:53:32.560099 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-96e7ed69-df34-4774-b7a6-f2e19c1634e2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:32.560919 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-96e7ed69-df34-4774-b7a6-f2e19c1634e2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:32.583901 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-96e7ed69-df34-4774-b7a6-f2e19c1634e2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:32.594285 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-96e7ed69-df34-4774-b7a6-f2e19c1634e2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:32.596551 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-96e7ed69-df34-4774-b7a6-f2e19c1634e2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:32.601196 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-96e7ed69-df34-4774-b7a6-f2e19c1634e2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:32.602081 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-96e7ed69-df34-4774-b7a6-f2e19c1634e2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:32.602775 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-96e7ed69-df34-4774-b7a6-f2e19c1634e2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:32.848993 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-1c32874f-9ed9-48cf-a52f-6b7be5e904b6 req-9bd7467f-4ae6-47c2-bbde-a382bd50f77b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33de8199-8f00-40eb-9b95-b7ab5289dbe3", "name": "network-vif-deleted", "tag": "2205d7dd-1b32-4750-962d-deadba8d5369"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:53:32.877316 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-1c32874f-9ed9-48cf-a52f-6b7be5e904b6 req-9bd7467f-4ae6-47c2-bbde-a382bd50f77b service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:32.890321 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-1c32874f-9ed9-48cf-a52f-6b7be5e904b6 req-9bd7467f-4ae6-47c2-bbde-a382bd50f77b service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:32.891029 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-1c32874f-9ed9-48cf-a52f-6b7be5e904b6 req-9bd7467f-4ae6-47c2-bbde-a382bd50f77b service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:32.932262 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-1c32874f-9ed9-48cf-a52f-6b7be5e904b6 req-9bd7467f-4ae6-47c2-bbde-a382bd50f77b service nova] Creating event network-vif-deleted:2205d7dd-1b32-4750-962d-deadba8d5369 for instance 33de8199-8f00-40eb-9b95-b7ab5289dbe3 on n-h2-854247-14 Oct 17 13:53:32.936550 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-96e7ed69-df34-4774-b7a6-f2e19c1634e2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:32.948932 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-1c32874f-9ed9-48cf-a52f-6b7be5e904b6 req-9bd7467f-4ae6-47c2-bbde-a382bd50f77b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104250 Oct 17 13:53:32.950125 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2065/4036] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:53:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:53:32.962330 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-96e7ed69-df34-4774-b7a6-f2e19c1634e2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1679 microversion: 2.1 time: 0.409774 Oct 17 13:53:32.969257 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1972/4037] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:32 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1679 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:32.975721 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5013b295-e304-4660-a354-24d4deb5d19f tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd541aee0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:33.041301 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5013b295-e304-4660-a354-24d4deb5d19f tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/images/1c87bf9a-af5f-491c-829a-c8ee2c5ec23e" status: 200 len: 1453 microversion: 2.1 time: 0.089654 Oct 17 13:53:33.041907 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2066/4038] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:53:32 2022] GET /compute/v2.1/images/1c87bf9a-af5f-491c-829a-c8ee2c5ec23e => generated 1453 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:33.115739 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-62ee1e77-4bca-46e8-bf17-74b7c75a1cbb tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:33.116613 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-62ee1e77-4bca-46e8-bf17-74b7c75a1cbb tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 33de8199-8f00-40eb-9b95-b7ab5289dbe3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:33.131595 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-62ee1e77-4bca-46e8-bf17-74b7c75a1cbb tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:33.134591 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-62ee1e77-4bca-46e8-bf17-74b7c75a1cbb tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:33.136186 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-62ee1e77-4bca-46e8-bf17-74b7c75a1cbb tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:33.138837 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-62ee1e77-4bca-46e8-bf17-74b7c75a1cbb tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:33.142202 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-62ee1e77-4bca-46e8-bf17-74b7c75a1cbb tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:33.142886 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-62ee1e77-4bca-46e8-bf17-74b7c75a1cbb tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:33.231503 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-62ee1e77-4bca-46e8-bf17-74b7c75a1cbb tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:33.232005 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-62ee1e77-4bca-46e8-bf17-74b7c75a1cbb tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:33.232453 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-62ee1e77-4bca-46e8-bf17-74b7c75a1cbb tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:33.232921 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-62ee1e77-4bca-46e8-bf17-74b7c75a1cbb tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lazy-loading 'fault' on Instance uuid 33de8199-8f00-40eb-9b95-b7ab5289dbe3 {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:53:33.347378 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-62ee1e77-4bca-46e8-bf17-74b7c75a1cbb tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd56b91ce42894bafac5ddb16ad6f037b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08068aeba86c4e718ba1e25c68fd3259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:33.357288 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-62ee1e77-4bca-46e8-bf17-74b7c75a1cbb tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3" status: 200 len: 1312 microversion: 2.1 time: 0.247149 Oct 17 13:53:33.365827 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1973/4039] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:33 2022] GET /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3 => generated 1312 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:33.996905 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c02527ff-8399-4cfa-b25b-0036940fd4ed tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:33.998216 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c02527ff-8399-4cfa-b25b-0036940fd4ed tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:34.038665 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c02527ff-8399-4cfa-b25b-0036940fd4ed tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:34.040114 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c02527ff-8399-4cfa-b25b-0036940fd4ed tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:34.045544 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c02527ff-8399-4cfa-b25b-0036940fd4ed tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:34.049602 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c02527ff-8399-4cfa-b25b-0036940fd4ed tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:34.051407 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c02527ff-8399-4cfa-b25b-0036940fd4ed tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:34.052067 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c02527ff-8399-4cfa-b25b-0036940fd4ed tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:34.057921 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-98345e60-db6e-46a8-a76f-060f53e24cdf tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd5a24ee0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:34.157476 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-98345e60-db6e-46a8-a76f-060f53e24cdf tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/images/1c87bf9a-af5f-491c-829a-c8ee2c5ec23e" status: 200 len: 1453 microversion: 2.1 time: 0.104461 Oct 17 13:53:34.172769 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1974/4040] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:53:34 2022] GET /compute/v2.1/images/1c87bf9a-af5f-491c-829a-c8ee2c5ec23e => generated 1453 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:53:34.392062 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0dc1b1d8-098c-4879-b987-537e865bf79a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:34.392630 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0dc1b1d8-098c-4879-b987-537e865bf79a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] [instance: 33de8199-8f00-40eb-9b95-b7ab5289dbe3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:34.414101 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0dc1b1d8-098c-4879-b987-537e865bf79a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:34.421573 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0dc1b1d8-098c-4879-b987-537e865bf79a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:34.421799 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0dc1b1d8-098c-4879-b987-537e865bf79a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:34.422431 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0dc1b1d8-098c-4879-b987-537e865bf79a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:34.425030 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0dc1b1d8-098c-4879-b987-537e865bf79a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:34.425485 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0dc1b1d8-098c-4879-b987-537e865bf79a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:34.482832 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-0dc1b1d8-098c-4879-b987-537e865bf79a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] HTTP exception thrown: Instance 33de8199-8f00-40eb-9b95-b7ab5289dbe3 could not be found. Oct 17 13:53:34.484678 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0dc1b1d8-098c-4879-b987-537e865bf79a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Request method failure captured: Oct 17 13:53:34.484678 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3 HTTP/1.1 Oct 17 13:53:34.484678 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:53:34.484678 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:53:34.484678 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:53:34.484678 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:53:34.484678 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:53:34.484678 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:53:34.484678 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:53:34.484678 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:53:34.484678 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTV0lGewBAd5oX7RsuswRRrYdH_s7fnCDLNRSaJQAxErmqZOT5QT6523TfZqZvgb4tWrIGVLDqv0foQ4mpFwe91mdGAxx6JOfjpLIqY8Vnvh6NrynvpuS4ywkAJAwUfpPeJ0dauW6Gj_xg5-jDhUd1iFTLiSXh_-SOzh7_iyTjRI7Ovs Oct 17 13:53:34.484678 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:53:34.484678 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:53:34.484678 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:53:34.484678 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:53:34.484678 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:53:34.484678 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:53:34.484678 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 08068aeba86c4e718ba1e25c68fd3259 Oct 17 13:53:34.484678 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1627831718 Oct 17 13:53:34.484678 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:53:34.484678 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:53:34.484678 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/08068aeba86c4e718ba1e25c68fd3259"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/08068aeba86c4e718ba1e25c68fd3259"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/08068aeba86c4e718ba1e25c68fd3259"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_08068aeba86c4e718ba1e25c68fd3259", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:53:34.484678 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1627831718 Oct 17 13:53:34.484678 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 08068aeba86c4e718ba1e25c68fd3259 Oct 17 13:53:34.484678 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1627831718 Oct 17 13:53:34.484678 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServerRescueNegativeTestJSON-1627831718-project Oct 17 13:53:34.484678 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:53:34.484678 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:53:34.484678 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: d56b91ce42894bafac5ddb16ad6f037b Oct 17 13:53:34.484678 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1627831718-project Oct 17 13:53:34.484678 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:53:34.484678 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 33de8199-8f00-40eb-9b95-b7ab5289dbe3 could not be found. Oct 17 13:53:34.484678 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '33de8199-8f00-40eb-9b95-b7ab5289dbe3'} Oct 17 13:53:34.484678 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:53:34.484678 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:53:34.484678 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:53:34.484678 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:53:34.484678 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:53:34.484678 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:53:34.484678 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:53:34.484678 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:53:34.484678 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:53:34.484678 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:53:34.484678 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33de8199-8f00-40eb-9b95-b7ab5289dbe3 could not be found. Oct 17 13:53:34.484678 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:53:34.484678 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:53:34.484678 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:53:34.484678 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:53:34.484678 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:53:34.484678 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:53:34.484678 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:53:34.484678 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:53:34.484678 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:53:34.484678 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:53:34.484678 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:53:34.484678 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:53:34.484678 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:53:34.484678 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:53:34.484678 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:53:34.484678 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:53:34.484678 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33de8199-8f00-40eb-9b95-b7ab5289dbe3 could not be found. Oct 17 13:53:34.484678 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:53:34.484678 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:53:34.490892 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:53:34.490892 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:53:34.490892 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:53:34.490892 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:53:34.490892 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:53:34.490892 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:53:34.490892 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33de8199-8f00-40eb-9b95-b7ab5289dbe3 could not be found. Oct 17 13:53:34.490892 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:53:34.490892 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0dc1b1d8-098c-4879-b987-537e865bf79a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] Returning 404 to user: Instance 33de8199-8f00-40eb-9b95-b7ab5289dbe3 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:53:34.490892 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0dc1b1d8-098c-4879-b987-537e865bf79a tempest-ServerRescueNegativeTestJSON-1627831718 tempest-ServerRescueNegativeTestJSON-1627831718-project] 10.222.0.79 "GET /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3" status: 404 len: 111 microversion: 2.1 time: 0.100097 Oct 17 13:53:34.490892 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1975/4041] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:34 2022] GET /compute/v2.1/servers/33de8199-8f00-40eb-9b95-b7ab5289dbe3 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:53:35.173730 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-fcbfd145-1b54-470d-8861-b099ecaee307 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd49045e0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:35.642849 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-fcbfd145-1b54-470d-8861-b099ecaee307 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/images/1c87bf9a-af5f-491c-829a-c8ee2c5ec23e" status: 200 len: 1453 microversion: 2.1 time: 0.473065 Oct 17 13:53:35.653224 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1976/4042] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:53:35 2022] GET /compute/v2.1/images/1c87bf9a-af5f-491c-829a-c8ee2c5ec23e => generated 1453 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:36.207625 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c02527ff-8399-4cfa-b25b-0036940fd4ed tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:36.216161 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c02527ff-8399-4cfa-b25b-0036940fd4ed tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1679 microversion: 2.1 time: 2.225629 Oct 17 13:53:36.225924 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-fdc3afe5-881a-4c51-a545-a1c4ce6cb52c tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:36.227006 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-fdc3afe5-881a-4c51-a545-a1c4ce6cb52c tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 90bfb179-c8b6-4810-a981-33b78a19b62c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:36.228989 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2067/4043] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:33 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1679 bytes in 2239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:36.248543 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fdc3afe5-881a-4c51-a545-a1c4ce6cb52c tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:36.252391 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fdc3afe5-881a-4c51-a545-a1c4ce6cb52c tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:36.253358 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fdc3afe5-881a-4c51-a545-a1c4ce6cb52c tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:36.254448 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fdc3afe5-881a-4c51-a545-a1c4ce6cb52c tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:36.257031 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fdc3afe5-881a-4c51-a545-a1c4ce6cb52c tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:36.259964 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fdc3afe5-881a-4c51-a545-a1c4ce6cb52c tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:36.272159 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-be5689c9-0085-45e1-9f10-21b7ae5c8144 req-d997b3bd-60d1-4b2d-bb9e-5f1b6d16270e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "419a7ac0-9332-481d-bc66-3ad5b6a9db81", "name": "network-vif-plugged", "status": "completed", "tag": "8c4e8542-c161-4443-8115-64e41c66a3fe"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:53:36.304841 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-be5689c9-0085-45e1-9f10-21b7ae5c8144 req-d997b3bd-60d1-4b2d-bb9e-5f1b6d16270e service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:36.307515 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-be5689c9-0085-45e1-9f10-21b7ae5c8144 req-d997b3bd-60d1-4b2d-bb9e-5f1b6d16270e service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:36.313746 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-be5689c9-0085-45e1-9f10-21b7ae5c8144 req-d997b3bd-60d1-4b2d-bb9e-5f1b6d16270e service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:36.336294 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-fdc3afe5-881a-4c51-a545-a1c4ce6cb52c tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c/ips" status: 200 len: 150 microversion: 2.1 time: 0.679439 Oct 17 13:53:36.339746 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1977/4044] 10.222.0.79 () {58 vars in 1248 bytes} [Mon Oct 17 13:53:35 2022] GET /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c/ips => generated 150 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:53:36.356262 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-be5689c9-0085-45e1-9f10-21b7ae5c8144 req-d997b3bd-60d1-4b2d-bb9e-5f1b6d16270e service nova] Creating event network-vif-plugged:8c4e8542-c161-4443-8115-64e41c66a3fe for instance 419a7ac0-9332-481d-bc66-3ad5b6a9db81 on n-h2-854247-14 Oct 17 13:53:36.376084 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-be5689c9-0085-45e1-9f10-21b7ae5c8144 req-d997b3bd-60d1-4b2d-bb9e-5f1b6d16270e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107759 Oct 17 13:53:36.380894 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2068/4045] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:53:36.660619 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ff9c0d53-80b5-4ed1-b15e-927f310efcc0 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd4957d30>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:36.749088 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c0dd10be-aa1d-46c9-b42a-4d3d151a1594 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:36.751567 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c0dd10be-aa1d-46c9-b42a-4d3d151a1594 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:36.779837 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c0dd10be-aa1d-46c9-b42a-4d3d151a1594 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:36.780335 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c0dd10be-aa1d-46c9-b42a-4d3d151a1594 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:36.785714 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c0dd10be-aa1d-46c9-b42a-4d3d151a1594 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:36.787699 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c0dd10be-aa1d-46c9-b42a-4d3d151a1594 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:36.791770 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c0dd10be-aa1d-46c9-b42a-4d3d151a1594 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:36.795780 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c0dd10be-aa1d-46c9-b42a-4d3d151a1594 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:36.955103 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c0dd10be-aa1d-46c9-b42a-4d3d151a1594 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.211046 Oct 17 13:53:36.955738 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2069/4046] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 13:53:36 2022] GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5/os-volume_attachments => generated 25 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:53:37.251446 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9ed488de-7a87-4dd4-9550-c41d2ff18d25 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:37.252210 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9ed488de-7a87-4dd4-9550-c41d2ff18d25 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:37.266477 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9ed488de-7a87-4dd4-9550-c41d2ff18d25 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:37.266961 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9ed488de-7a87-4dd4-9550-c41d2ff18d25 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:37.267426 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9ed488de-7a87-4dd4-9550-c41d2ff18d25 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:37.268136 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9ed488de-7a87-4dd4-9550-c41d2ff18d25 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:37.268943 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9ed488de-7a87-4dd4-9550-c41d2ff18d25 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:37.269064 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9ed488de-7a87-4dd4-9550-c41d2ff18d25 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:38.352567 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9ed488de-7a87-4dd4-9550-c41d2ff18d25 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:38.376773 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9ed488de-7a87-4dd4-9550-c41d2ff18d25 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1679 microversion: 2.1 time: 1.129252 Oct 17 13:53:38.395588 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2070/4047] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:37 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1679 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:53:38.412883 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8582a39a-7291-4fb4-b931-fbf5724216fc tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:38.415328 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8582a39a-7291-4fb4-b931-fbf5724216fc tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:38.440049 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8582a39a-7291-4fb4-b931-fbf5724216fc tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:38.447983 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8582a39a-7291-4fb4-b931-fbf5724216fc tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:38.450319 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8582a39a-7291-4fb4-b931-fbf5724216fc tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:38.451906 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8582a39a-7291-4fb4-b931-fbf5724216fc tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:38.452520 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8582a39a-7291-4fb4-b931-fbf5724216fc tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:38.455415 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8582a39a-7291-4fb4-b931-fbf5724216fc tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:38.550675 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8582a39a-7291-4fb4-b931-fbf5724216fc tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.153598 Oct 17 13:53:38.580589 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2071/4048] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 13:53:38 2022] GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5/os-volume_attachments => generated 25 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:53:38.729238 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4446de15-408c-434d-897a-4fb94480dd89 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:38.730095 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4446de15-408c-434d-897a-4fb94480dd89 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:38.737066 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4446de15-408c-434d-897a-4fb94480dd89 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:38.737865 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4446de15-408c-434d-897a-4fb94480dd89 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:38.738518 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4446de15-408c-434d-897a-4fb94480dd89 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:38.739491 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4446de15-408c-434d-897a-4fb94480dd89 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:38.740159 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4446de15-408c-434d-897a-4fb94480dd89 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:38.740879 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4446de15-408c-434d-897a-4fb94480dd89 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:38.781891 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4446de15-408c-434d-897a-4fb94480dd89 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:53:38.799670 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:53:38.925838 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4446de15-408c-434d-897a-4fb94480dd89 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "DELETE /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5" status: 204 len: 0 microversion: 2.1 time: 0.203023 Oct 17 13:53:38.930522 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2072/4049] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:53:38 2022] DELETE /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 13:53:38.937908 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8ca5aede-8238-449b-9ef1-f644d0511217 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:38.938906 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8ca5aede-8238-449b-9ef1-f644d0511217 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:38.946852 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8ca5aede-8238-449b-9ef1-f644d0511217 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:38.948354 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8ca5aede-8238-449b-9ef1-f644d0511217 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:38.949555 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8ca5aede-8238-449b-9ef1-f644d0511217 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:38.950536 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8ca5aede-8238-449b-9ef1-f644d0511217 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:38.951216 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8ca5aede-8238-449b-9ef1-f644d0511217 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:38.952144 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8ca5aede-8238-449b-9ef1-f644d0511217 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:39.544177 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8ca5aede-8238-449b-9ef1-f644d0511217 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683d18db860a4d60ab3eeba2a372b2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11973b8e1d8a4af8add65726e8ba7c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:39.559818 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8ca5aede-8238-449b-9ef1-f644d0511217 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5" status: 200 len: 1672 microversion: 2.1 time: 0.623282 Oct 17 13:53:39.560704 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2073/4050] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:38 2022] GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5 => generated 1672 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:39.574837 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c3ec5712-0f48-4284-8e4f-45d1289df8d3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:39.583457 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c3ec5712-0f48-4284-8e4f-45d1289df8d3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:39.611210 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c3ec5712-0f48-4284-8e4f-45d1289df8d3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:39.615492 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c3ec5712-0f48-4284-8e4f-45d1289df8d3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:39.616395 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c3ec5712-0f48-4284-8e4f-45d1289df8d3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:39.617333 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c3ec5712-0f48-4284-8e4f-45d1289df8d3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:39.617966 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c3ec5712-0f48-4284-8e4f-45d1289df8d3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:39.618558 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c3ec5712-0f48-4284-8e4f-45d1289df8d3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:40.843031 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c3ec5712-0f48-4284-8e4f-45d1289df8d3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:40.853039 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c3ec5712-0f48-4284-8e4f-45d1289df8d3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1679 microversion: 2.1 time: 1.284468 Oct 17 13:53:40.863823 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2074/4051] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:39 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1679 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:40.872751 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0490639d-bb2b-4480-93b2-18532d72acd8 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:40.882841 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0490639d-bb2b-4480-93b2-18532d72acd8 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:40.903367 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0490639d-bb2b-4480-93b2-18532d72acd8 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:40.910856 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0490639d-bb2b-4480-93b2-18532d72acd8 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:40.912053 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0490639d-bb2b-4480-93b2-18532d72acd8 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:40.919462 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0490639d-bb2b-4480-93b2-18532d72acd8 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:40.927745 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0490639d-bb2b-4480-93b2-18532d72acd8 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:40.928470 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0490639d-bb2b-4480-93b2-18532d72acd8 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:42.878226 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0490639d-bb2b-4480-93b2-18532d72acd8 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683d18db860a4d60ab3eeba2a372b2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11973b8e1d8a4af8add65726e8ba7c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:42.889011 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0490639d-bb2b-4480-93b2-18532d72acd8 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5" status: 200 len: 1672 microversion: 2.1 time: 2.022943 Oct 17 13:53:42.889606 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2075/4052] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:40 2022] GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5 => generated 1672 bytes in 2025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:42.920744 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3cddcec5-6a9e-4fe8-aee9-9caba119049c tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a7ce18e7-7d8e-426a-8d78-c4060c6a3218"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:53:42.947070 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3cddcec5-6a9e-4fe8-aee9-9caba119049c tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 90bfb179-c8b6-4810-a981-33b78a19b62c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:42.973342 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3cddcec5-6a9e-4fe8-aee9-9caba119049c tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:42.982371 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3cddcec5-6a9e-4fe8-aee9-9caba119049c tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:42.983080 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3cddcec5-6a9e-4fe8-aee9-9caba119049c tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:42.983903 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3cddcec5-6a9e-4fe8-aee9-9caba119049c tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:42.988117 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3cddcec5-6a9e-4fe8-aee9-9caba119049c tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:42.988573 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3cddcec5-6a9e-4fe8-aee9-9caba119049c tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:43.696266 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3cddcec5-6a9e-4fe8-aee9-9caba119049c tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "POST /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.805377 Oct 17 13:53:43.696905 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2076/4053] 10.222.0.79 () {60 vars in 1323 bytes} [Mon Oct 17 13:53:42 2022] POST /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c/os-volume_attachments => generated 194 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:53:43.734593 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-156734f5-0e44-4829-94e2-1c37162d373b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:43.748066 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-156734f5-0e44-4829-94e2-1c37162d373b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:43.772020 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-156734f5-0e44-4829-94e2-1c37162d373b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:43.779598 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-156734f5-0e44-4829-94e2-1c37162d373b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:43.780231 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-156734f5-0e44-4829-94e2-1c37162d373b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:43.783755 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-156734f5-0e44-4829-94e2-1c37162d373b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:43.789153 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-156734f5-0e44-4829-94e2-1c37162d373b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:43.790476 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-156734f5-0e44-4829-94e2-1c37162d373b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:44.678461 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-156734f5-0e44-4829-94e2-1c37162d373b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:44.691643 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-156734f5-0e44-4829-94e2-1c37162d373b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1679 microversion: 2.1 time: 0.978680 Oct 17 13:53:44.698016 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2077/4054] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:43 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1679 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:44.712536 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c00df36d-73df-4569-9547-6b7db412f12f tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:44.715891 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c00df36d-73df-4569-9547-6b7db412f12f tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:44.737579 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c00df36d-73df-4569-9547-6b7db412f12f tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:44.744587 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c00df36d-73df-4569-9547-6b7db412f12f tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:44.745633 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c00df36d-73df-4569-9547-6b7db412f12f tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:44.746701 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c00df36d-73df-4569-9547-6b7db412f12f tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:44.748599 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c00df36d-73df-4569-9547-6b7db412f12f tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:44.755152 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c00df36d-73df-4569-9547-6b7db412f12f tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:45.180395 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c00df36d-73df-4569-9547-6b7db412f12f tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683d18db860a4d60ab3eeba2a372b2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11973b8e1d8a4af8add65726e8ba7c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:45.201713 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c00df36d-73df-4569-9547-6b7db412f12f tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5" status: 200 len: 1672 microversion: 2.1 time: 0.492254 Oct 17 13:53:45.202411 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2078/4055] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:44 2022] GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5 => generated 1672 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:45.224577 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-9fd238b1-115d-4a1e-8668-0635b3843a19 req-6c59206e-366b-4649-b3fe-2bff733d0c76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5", "name": "network-vif-unplugged", "status": "completed", "tag": "f4683ce3-d22f-48db-8109-19e7698684bb"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:53:45.267015 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-9fd238b1-115d-4a1e-8668-0635b3843a19 req-6c59206e-366b-4649-b3fe-2bff733d0c76 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:45.267531 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-9fd238b1-115d-4a1e-8668-0635b3843a19 req-6c59206e-366b-4649-b3fe-2bff733d0c76 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:45.267958 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-9fd238b1-115d-4a1e-8668-0635b3843a19 req-6c59206e-366b-4649-b3fe-2bff733d0c76 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:45.319720 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-9fd238b1-115d-4a1e-8668-0635b3843a19 req-6c59206e-366b-4649-b3fe-2bff733d0c76 service nova] Creating event network-vif-unplugged:f4683ce3-d22f-48db-8109-19e7698684bb for instance bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5 on n-h2-854247-14 Oct 17 13:53:45.334750 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-9fd238b1-115d-4a1e-8668-0635b3843a19 req-6c59206e-366b-4649-b3fe-2bff733d0c76 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.127953 Oct 17 13:53:45.335413 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2079/4056] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:53:45.721670 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-07305eab-b20a-46e9-b69b-60b7d70505aa tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:45.723122 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-07305eab-b20a-46e9-b69b-60b7d70505aa tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:45.742604 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-07305eab-b20a-46e9-b69b-60b7d70505aa tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:45.743189 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-07305eab-b20a-46e9-b69b-60b7d70505aa tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:45.744023 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-07305eab-b20a-46e9-b69b-60b7d70505aa tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:45.748481 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-07305eab-b20a-46e9-b69b-60b7d70505aa tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:45.752421 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-07305eab-b20a-46e9-b69b-60b7d70505aa tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:45.754294 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-07305eab-b20a-46e9-b69b-60b7d70505aa tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:46.243465 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:53:46.318108 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=22 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:53:46.442990 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-07305eab-b20a-46e9-b69b-60b7d70505aa tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:46.462395 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-07305eab-b20a-46e9-b69b-60b7d70505aa tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1679 microversion: 2.1 time: 0.745197 Oct 17 13:53:46.464434 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2080/4057] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:45 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1679 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:53:46.469780 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b99ba527-e374-4c20-8940-822c2e8be67d tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:46.470597 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b99ba527-e374-4c20-8940-822c2e8be67d tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:46.487414 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b99ba527-e374-4c20-8940-822c2e8be67d tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:46.489795 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b99ba527-e374-4c20-8940-822c2e8be67d tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:46.491088 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b99ba527-e374-4c20-8940-822c2e8be67d tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:46.492751 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b99ba527-e374-4c20-8940-822c2e8be67d tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:46.494233 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b99ba527-e374-4c20-8940-822c2e8be67d tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:46.495944 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b99ba527-e374-4c20-8940-822c2e8be67d tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:46.935190 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b99ba527-e374-4c20-8940-822c2e8be67d tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683d18db860a4d60ab3eeba2a372b2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11973b8e1d8a4af8add65726e8ba7c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:46.959099 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b99ba527-e374-4c20-8940-822c2e8be67d tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5" status: 200 len: 1606 microversion: 2.1 time: 0.493180 Oct 17 13:53:46.971972 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2081/4058] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:46 2022] GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5 => generated 1606 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:47.079253 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-b7599c60-acdf-4f48-8d9f-a4f1429ad1f4 req-978068df-93de-476f-a36a-15861321faee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5", "name": "network-vif-deleted", "tag": "f4683ce3-d22f-48db-8109-19e7698684bb"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:53:47.125283 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-b7599c60-acdf-4f48-8d9f-a4f1429ad1f4 req-978068df-93de-476f-a36a-15861321faee service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:47.127838 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-b7599c60-acdf-4f48-8d9f-a4f1429ad1f4 req-978068df-93de-476f-a36a-15861321faee service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:47.130181 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-b7599c60-acdf-4f48-8d9f-a4f1429ad1f4 req-978068df-93de-476f-a36a-15861321faee service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:47.158036 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-b7599c60-acdf-4f48-8d9f-a4f1429ad1f4 req-978068df-93de-476f-a36a-15861321faee service nova] Creating event network-vif-deleted:f4683ce3-d22f-48db-8109-19e7698684bb for instance bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5 on n-h2-854247-14 Oct 17 13:53:47.168959 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-b7599c60-acdf-4f48-8d9f-a4f1429ad1f4 req-978068df-93de-476f-a36a-15861321faee service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101841 Oct 17 13:53:47.177986 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2082/4059] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:53:47.489848 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-66ea1e50-7ffb-40b4-9556-be6a42486c4e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:47.493777 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-66ea1e50-7ffb-40b4-9556-be6a42486c4e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:47.530609 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-66ea1e50-7ffb-40b4-9556-be6a42486c4e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:47.542106 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-66ea1e50-7ffb-40b4-9556-be6a42486c4e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:47.546477 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-66ea1e50-7ffb-40b4-9556-be6a42486c4e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:47.547505 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-66ea1e50-7ffb-40b4-9556-be6a42486c4e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:47.548191 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-66ea1e50-7ffb-40b4-9556-be6a42486c4e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:47.548862 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-66ea1e50-7ffb-40b4-9556-be6a42486c4e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:47.966528 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-66ea1e50-7ffb-40b4-9556-be6a42486c4e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:47.983349 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-66ea1e50-7ffb-40b4-9556-be6a42486c4e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1679 microversion: 2.1 time: 0.498733 Oct 17 13:53:47.986904 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2083/4060] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:47 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1679 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:48.005446 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a572fa5d-c671-4446-b788-fa744ec88a38 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:48.006337 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a572fa5d-c671-4446-b788-fa744ec88a38 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:48.016945 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a572fa5d-c671-4446-b788-fa744ec88a38 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:48.023507 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a572fa5d-c671-4446-b788-fa744ec88a38 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:48.025118 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a572fa5d-c671-4446-b788-fa744ec88a38 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:48.034129 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a572fa5d-c671-4446-b788-fa744ec88a38 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:48.036641 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a572fa5d-c671-4446-b788-fa744ec88a38 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:48.037516 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a572fa5d-c671-4446-b788-fa744ec88a38 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:48.183048 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a572fa5d-c671-4446-b788-fa744ec88a38 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:48.184526 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a572fa5d-c671-4446-b788-fa744ec88a38 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:48.185590 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a572fa5d-c671-4446-b788-fa744ec88a38 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:48.186059 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-a572fa5d-c671-4446-b788-fa744ec88a38 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lazy-loading 'fault' on Instance uuid bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:53:48.311844 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a572fa5d-c671-4446-b788-fa744ec88a38 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '683d18db860a4d60ab3eeba2a372b2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11973b8e1d8a4af8add65726e8ba7c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:48.319981 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a572fa5d-c671-4446-b788-fa744ec88a38 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5" status: 200 len: 1328 microversion: 2.1 time: 0.318399 Oct 17 13:53:48.328599 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2084/4061] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:48 2022] GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5 => generated 1328 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:49.014439 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-208d8a57-a7b5-484d-aea7-4068f9b31ef4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:49.016232 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-208d8a57-a7b5-484d-aea7-4068f9b31ef4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:49.032002 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-208d8a57-a7b5-484d-aea7-4068f9b31ef4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:49.036518 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-208d8a57-a7b5-484d-aea7-4068f9b31ef4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:49.038201 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-208d8a57-a7b5-484d-aea7-4068f9b31ef4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:49.040072 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-208d8a57-a7b5-484d-aea7-4068f9b31ef4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:49.045157 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-208d8a57-a7b5-484d-aea7-4068f9b31ef4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:49.047690 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-208d8a57-a7b5-484d-aea7-4068f9b31ef4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:49.899406 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-208d8a57-a7b5-484d-aea7-4068f9b31ef4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:49.927547 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-208d8a57-a7b5-484d-aea7-4068f9b31ef4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1679 microversion: 2.1 time: 0.917375 Oct 17 13:53:49.942822 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2085/4062] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:49 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1679 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:53:49.950616 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-06a6b235-a5f9-4ac4-903b-42016b998b8d tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:49.970617 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-06a6b235-a5f9-4ac4-903b-42016b998b8d tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:49.980408 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:53:50.041133 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-06a6b235-a5f9-4ac4-903b-42016b998b8d tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:50.042968 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-06a6b235-a5f9-4ac4-903b-42016b998b8d tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:50.050471 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-06a6b235-a5f9-4ac4-903b-42016b998b8d tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:50.061308 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-06a6b235-a5f9-4ac4-903b-42016b998b8d tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:50.065562 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-06a6b235-a5f9-4ac4-903b-42016b998b8d tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:50.066159 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-06a6b235-a5f9-4ac4-903b-42016b998b8d tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:50.130695 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-06a6b235-a5f9-4ac4-903b-42016b998b8d tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] HTTP exception thrown: Instance bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5 could not be found. Oct 17 13:53:50.135696 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-06a6b235-a5f9-4ac4-903b-42016b998b8d tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Request method failure captured: Oct 17 13:53:50.135696 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5 HTTP/1.1 Oct 17 13:53:50.135696 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:53:50.135696 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:53:50.135696 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:53:50.135696 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:53:50.135696 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:53:50.135696 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:53:50.135696 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:53:50.135696 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:53:50.135696 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVzj7ySRjNRGWeLZhuOn9q-1zQEMM4cm4f1Hd3un42c2zlaS1Crq4DnN26vS4u-r9RlLxn9BBcFV2T6QJYLkUmK8IYzpajU2f5b8Nv4JJmW6GJSH7eSOWEJIthN2nve8_TpMYj0RwNzzlkurCU_UZmVG-U7xXVbyvUUBd_Ch7Kacuyc Oct 17 13:53:50.135696 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:53:50.135696 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:53:50.135696 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:53:50.135696 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:53:50.135696 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:53:50.135696 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:53:50.135696 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 11973b8e1d8a4af8add65726e8ba7c83 Oct 17 13:53:50.135696 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-AttachVolumeTestJSON-829991168 Oct 17 13:53:50.135696 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:53:50.135696 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:53:50.135696 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/11973b8e1d8a4af8add65726e8ba7c83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/11973b8e1d8a4af8add65726e8ba7c83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/11973b8e1d8a4af8add65726e8ba7c83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_11973b8e1d8a4af8add65726e8ba7c83", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:53:50.135696 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-AttachVolumeTestJSON-829991168 Oct 17 13:53:50.135696 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 11973b8e1d8a4af8add65726e8ba7c83 Oct 17 13:53:50.135696 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-AttachVolumeTestJSON-829991168 Oct 17 13:53:50.135696 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-AttachVolumeTestJSON-829991168-project Oct 17 13:53:50.135696 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:53:50.135696 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:53:50.135696 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 683d18db860a4d60ab3eeba2a372b2c5 Oct 17 13:53:50.135696 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-AttachVolumeTestJSON-829991168-project Oct 17 13:53:50.135696 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:53:50.135696 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5 could not be found. Oct 17 13:53:50.135696 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5'} Oct 17 13:53:50.135696 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:53:50.135696 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:53:50.135696 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:53:50.135696 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:53:50.135696 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:53:50.135696 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:53:50.135696 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:53:50.135696 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:53:50.135696 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:53:50.135696 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:53:50.135696 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5 could not be found. Oct 17 13:53:50.135696 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:53:50.135696 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:53:50.135696 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:53:50.135696 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:53:50.135696 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:53:50.135696 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:53:50.135696 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:53:50.135696 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:53:50.135696 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:53:50.135696 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:53:50.135696 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:53:50.135696 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:53:50.135696 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:53:50.135696 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:53:50.135696 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:53:50.135696 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:53:50.135696 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5 could not be found. Oct 17 13:53:50.135696 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:53:50.135696 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:53:50.135696 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:53:50.142198 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:53:50.142198 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:53:50.142198 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:53:50.142198 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:53:50.142198 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:53:50.142198 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5 could not be found. Oct 17 13:53:50.142198 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:53:50.167935 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-06a6b235-a5f9-4ac4-903b-42016b998b8d tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Returning 404 to user: Instance bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:53:50.171662 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-06a6b235-a5f9-4ac4-903b-42016b998b8d tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5" status: 404 len: 111 microversion: 2.1 time: 0.227258 Oct 17 13:53:50.178872 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2086/4063] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:49 2022] GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5 => generated 111 bytes in 235 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:53:50.185386 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-49f8c16e-982b-44e6-82a0-44817d7682cb tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '.version_select at 0x7f7cd4609af0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:50.249496 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-49f8c16e-982b-44e6-82a0-44817d7682cb tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2081898665" status: 202 len: 0 microversion: 2.1 time: 0.068303 Oct 17 13:53:50.253839 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2087/4064] 10.222.0.79 () {58 vars in 1221 bytes} [Mon Oct 17 13:53:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2081898665 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:53:50.966697 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-714909f1-a71d-4e4d-82b3-c1ce82492a33 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:50.967656 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-714909f1-a71d-4e4d-82b3-c1ce82492a33 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:50.990546 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-714909f1-a71d-4e4d-82b3-c1ce82492a33 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:50.991191 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-714909f1-a71d-4e4d-82b3-c1ce82492a33 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:50.992851 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-714909f1-a71d-4e4d-82b3-c1ce82492a33 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:50.996755 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-714909f1-a71d-4e4d-82b3-c1ce82492a33 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:50.997636 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-714909f1-a71d-4e4d-82b3-c1ce82492a33 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:51.000802 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-714909f1-a71d-4e4d-82b3-c1ce82492a33 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:52.253615 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-714909f1-a71d-4e4d-82b3-c1ce82492a33 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:52.268355 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-714909f1-a71d-4e4d-82b3-c1ce82492a33 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1679 microversion: 2.1 time: 1.306265 Oct 17 13:53:52.273081 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2088/4065] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:50 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1679 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:53:53.299400 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-64ab9bae-92e2-43c4-bc38-f86c62491083 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:53.300770 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-64ab9bae-92e2-43c4-bc38-f86c62491083 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:53.323841 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-64ab9bae-92e2-43c4-bc38-f86c62491083 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:53.331587 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-64ab9bae-92e2-43c4-bc38-f86c62491083 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:53.343552 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-64ab9bae-92e2-43c4-bc38-f86c62491083 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:53.349680 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-64ab9bae-92e2-43c4-bc38-f86c62491083 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:53.350405 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-64ab9bae-92e2-43c4-bc38-f86c62491083 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:53.351018 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-64ab9bae-92e2-43c4-bc38-f86c62491083 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:53.441016 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:53:55.487314 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-64ab9bae-92e2-43c4-bc38-f86c62491083 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:55.497776 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-64ab9bae-92e2-43c4-bc38-f86c62491083 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1679 microversion: 2.1 time: 2.202428 Oct 17 13:53:55.513496 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2089/4066] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:53 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1679 bytes in 2218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:53:56.527802 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1a436fbd-46a4-4d5e-b1ca-a25681722811 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:56.529546 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-1a436fbd-46a4-4d5e-b1ca-a25681722811 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:56.610656 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1a436fbd-46a4-4d5e-b1ca-a25681722811 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:56.611886 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1a436fbd-46a4-4d5e-b1ca-a25681722811 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:56.612774 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1a436fbd-46a4-4d5e-b1ca-a25681722811 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:56.613700 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1a436fbd-46a4-4d5e-b1ca-a25681722811 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:56.614360 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1a436fbd-46a4-4d5e-b1ca-a25681722811 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:56.614944 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1a436fbd-46a4-4d5e-b1ca-a25681722811 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:57.266819 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-1a436fbd-46a4-4d5e-b1ca-a25681722811 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:57.312857 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1a436fbd-46a4-4d5e-b1ca-a25681722811 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1679 microversion: 2.1 time: 0.790312 Oct 17 13:53:57.330642 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2090/4067] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:56 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1679 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:58.366875 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fccc5734-d1f6-4760-8dac-35d8c314911c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:58.372692 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-fccc5734-d1f6-4760-8dac-35d8c314911c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:58.413712 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fccc5734-d1f6-4760-8dac-35d8c314911c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:58.422479 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fccc5734-d1f6-4760-8dac-35d8c314911c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:58.425351 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fccc5734-d1f6-4760-8dac-35d8c314911c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:58.428307 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fccc5734-d1f6-4760-8dac-35d8c314911c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:58.429319 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fccc5734-d1f6-4760-8dac-35d8c314911c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:58.430109 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fccc5734-d1f6-4760-8dac-35d8c314911c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:59.164955 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fccc5734-d1f6-4760-8dac-35d8c314911c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:59.174907 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fccc5734-d1f6-4760-8dac-35d8c314911c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1679 microversion: 2.1 time: 0.815664 Oct 17 13:53:59.178973 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2091/4068] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:58 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1679 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:00.207599 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3200e0e6-0593-41c0-bc1a-090bfe2c1f7e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:00.208280 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3200e0e6-0593-41c0-bc1a-090bfe2c1f7e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:00.227565 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3200e0e6-0593-41c0-bc1a-090bfe2c1f7e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:00.228106 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3200e0e6-0593-41c0-bc1a-090bfe2c1f7e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:00.228637 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3200e0e6-0593-41c0-bc1a-090bfe2c1f7e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:00.233635 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3200e0e6-0593-41c0-bc1a-090bfe2c1f7e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:00.237692 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3200e0e6-0593-41c0-bc1a-090bfe2c1f7e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:00.238223 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3200e0e6-0593-41c0-bc1a-090bfe2c1f7e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:00.734533 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ff9c0d53-80b5-4ed1-b15e-927f310efcc0 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/images/1c87bf9a-af5f-491c-829a-c8ee2c5ec23e" status: 200 len: 1453 microversion: 2.1 time: 24.077901 Oct 17 13:54:00.735389 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1978/4069] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:53:36 2022] GET /compute/v2.1/images/1c87bf9a-af5f-491c-829a-c8ee2c5ec23e => generated 1453 bytes in 24079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:00.801651 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3200e0e6-0593-41c0-bc1a-090bfe2c1f7e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:00.809919 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3200e0e6-0593-41c0-bc1a-090bfe2c1f7e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1679 microversion: 2.1 time: 0.606858 Oct 17 13:54:00.813957 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2092/4070] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:00 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1679 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:54:01.753472 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0cedf6db-39cc-475e-b54f-b59d07e8afcf tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd53f1430>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:01.841644 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3b7d90fa-1b72-4e54-be5e-d5ea3684317e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:01.843124 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3b7d90fa-1b72-4e54-be5e-d5ea3684317e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:01.869552 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3b7d90fa-1b72-4e54-be5e-d5ea3684317e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:01.878491 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3b7d90fa-1b72-4e54-be5e-d5ea3684317e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:01.879388 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3b7d90fa-1b72-4e54-be5e-d5ea3684317e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:01.890044 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3b7d90fa-1b72-4e54-be5e-d5ea3684317e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:01.891845 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3b7d90fa-1b72-4e54-be5e-d5ea3684317e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:01.896261 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3b7d90fa-1b72-4e54-be5e-d5ea3684317e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:02.467422 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3b7d90fa-1b72-4e54-be5e-d5ea3684317e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:02.478033 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3b7d90fa-1b72-4e54-be5e-d5ea3684317e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1666 microversion: 2.1 time: 0.641788 Oct 17 13:54:02.483725 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2093/4071] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:01 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1666 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:54:03.137719 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d2d5c4a4-562c-416f-b61e-d527f7acd93d tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1025145797", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": "none"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:54:03.616433 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0cedf6db-39cc-475e-b54f-b59d07e8afcf tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/images/1c87bf9a-af5f-491c-829a-c8ee2c5ec23e" status: 200 len: 1453 microversion: 2.1 time: 1.869541 Oct 17 13:54:03.625534 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1979/4072] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:54:01 2022] GET /compute/v2.1/images/1c87bf9a-af5f-491c-829a-c8ee2c5ec23e => generated 1453 bytes in 1871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:03.694630 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-252bdb75-108b-4a7f-9b4c-65bcf06acec9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:03.695325 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-252bdb75-108b-4a7f-9b4c-65bcf06acec9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:03.713525 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-d2d5c4a4-562c-416f-b61e-d527f7acd93d tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:54:03.714260 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-d2d5c4a4-562c-416f-b61e-d527f7acd93d tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:54:03.714628 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-252bdb75-108b-4a7f-9b4c-65bcf06acec9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:03.715854 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-d2d5c4a4-562c-416f-b61e-d527f7acd93d tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:54:03.716447 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-d2d5c4a4-562c-416f-b61e-d527f7acd93d tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:54:03.717031 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-d2d5c4a4-562c-416f-b61e-d527f7acd93d tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:54:03.718220 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-252bdb75-108b-4a7f-9b4c-65bcf06acec9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:03.727070 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-252bdb75-108b-4a7f-9b4c-65bcf06acec9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:03.728093 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-252bdb75-108b-4a7f-9b4c-65bcf06acec9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:03.728740 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-252bdb75-108b-4a7f-9b4c-65bcf06acec9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:03.731509 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-252bdb75-108b-4a7f-9b4c-65bcf06acec9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:03.740192 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d2d5c4a4-562c-416f-b61e-d527f7acd93d tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:03.740908 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d2d5c4a4-562c-416f-b61e-d527f7acd93d tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:03.741518 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d2d5c4a4-562c-416f-b61e-d527f7acd93d tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:03.743135 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d2d5c4a4-562c-416f-b61e-d527f7acd93d tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:03.746326 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d2d5c4a4-562c-416f-b61e-d527f7acd93d tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:03.746968 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d2d5c4a4-562c-416f-b61e-d527f7acd93d tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:03.788942 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-d2d5c4a4-562c-416f-b61e-d527f7acd93d tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Getting quotas for project c84a797e25df4f94bd63e0f486f63408. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:54:03.795394 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-d2d5c4a4-562c-416f-b61e-d527f7acd93d tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Getting quotas for user 1364a32d181d432fb01b09be9e54d35b and project c84a797e25df4f94bd63e0f486f63408. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:54:03.809459 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d2d5c4a4-562c-416f-b61e-d527f7acd93d tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:54:03.812109 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d2d5c4a4-562c-416f-b61e-d527f7acd93d tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] [instance: 656925d8-a071-49b4-92b0-b74039bc96dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:54:03.934779 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d2d5c4a4-562c-416f-b61e-d527f7acd93d tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 1.092905 Oct 17 13:54:03.942678 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2094/4073] 10.222.0.79 () {62 vars in 1188 bytes} [Mon Oct 17 13:54:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1097 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 13:54:03.951041 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b679ac3b-cf01-47e1-81a0-38934d29fb90 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:03.954801 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b679ac3b-cf01-47e1-81a0-38934d29fb90 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] [instance: 656925d8-a071-49b4-92b0-b74039bc96dc] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:05.446656 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b679ac3b-cf01-47e1-81a0-38934d29fb90 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:05.463150 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b679ac3b-cf01-47e1-81a0-38934d29fb90 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:05.472523 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b679ac3b-cf01-47e1-81a0-38934d29fb90 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:05.479821 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b679ac3b-cf01-47e1-81a0-38934d29fb90 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] 10.222.0.79 "GET /compute/v2.1/servers/656925d8-a071-49b4-92b0-b74039bc96dc" status: 200 len: 1278 microversion: 2.57 time: 1.533590 Oct 17 13:54:05.481761 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2095/4074] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:03 2022] GET /compute/v2.1/servers/656925d8-a071-49b4-92b0-b74039bc96dc => generated 1278 bytes in 1538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:54:05.507682 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-52486809-74dc-4aa3-af6d-ba4f87fab891 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd459e160>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:05.602609 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-52486809-74dc-4aa3-af6d-ba4f87fab891 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/images/1c87bf9a-af5f-491c-829a-c8ee2c5ec23e" status: 200 len: 1453 microversion: 2.1 time: 0.119610 Oct 17 13:54:05.605522 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2096/4075] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:54:05 2022] GET /compute/v2.1/images/1c87bf9a-af5f-491c-829a-c8ee2c5ec23e => generated 1453 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:05.616327 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-b32fda93-5c1f-45a6-a9b6-8af356ca08ff req-07a0d623-7daa-4e91-bb48-286b0c34dab6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96dd349a-6476-4a7d-8f55-ea10e3b1e05d", "name": "network-vif-unplugged", "status": "completed", "tag": "fa985869-a190-4726-b04f-7d06a5c193e1"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:54:05.641852 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-b32fda93-5c1f-45a6-a9b6-8af356ca08ff req-07a0d623-7daa-4e91-bb48-286b0c34dab6 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:05.642750 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-b32fda93-5c1f-45a6-a9b6-8af356ca08ff req-07a0d623-7daa-4e91-bb48-286b0c34dab6 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:05.643961 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-b32fda93-5c1f-45a6-a9b6-8af356ca08ff req-07a0d623-7daa-4e91-bb48-286b0c34dab6 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:05.670805 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-b32fda93-5c1f-45a6-a9b6-8af356ca08ff req-07a0d623-7daa-4e91-bb48-286b0c34dab6 service nova] Creating event network-vif-unplugged:fa985869-a190-4726-b04f-7d06a5c193e1 for instance 96dd349a-6476-4a7d-8f55-ea10e3b1e05d on n-h2-854247-14 Oct 17 13:54:05.683342 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-b32fda93-5c1f-45a6-a9b6-8af356ca08ff req-07a0d623-7daa-4e91-bb48-286b0c34dab6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076212 Oct 17 13:54:05.689149 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2097/4076] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:54:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:54:05.756603 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-252bdb75-108b-4a7f-9b4c-65bcf06acec9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:05.767805 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-252bdb75-108b-4a7f-9b4c-65bcf06acec9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1666 microversion: 2.1 time: 2.077546 Oct 17 13:54:05.779686 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1980/4077] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:03 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1666 bytes in 2088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:06.512075 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7d96dd41-6b57-43be-8823-0088fc76f58e tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:06.513531 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7d96dd41-6b57-43be-8823-0088fc76f58e tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] [instance: 656925d8-a071-49b4-92b0-b74039bc96dc] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:06.547200 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7d96dd41-6b57-43be-8823-0088fc76f58e tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:06.557000 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7d96dd41-6b57-43be-8823-0088fc76f58e tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:06.566994 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7d96dd41-6b57-43be-8823-0088fc76f58e tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:06.568420 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7d96dd41-6b57-43be-8823-0088fc76f58e tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:06.571593 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7d96dd41-6b57-43be-8823-0088fc76f58e tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:06.572775 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7d96dd41-6b57-43be-8823-0088fc76f58e tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:06.628995 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b6c2b480-e650-4783-9f0f-adb6fc93114a tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd5a1d310>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:06.829257 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7d96dd41-6b57-43be-8823-0088fc76f58e tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:06.859342 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7d96dd41-6b57-43be-8823-0088fc76f58e tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:06.863033 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7d96dd41-6b57-43be-8823-0088fc76f58e tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:06.882456 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7d96dd41-6b57-43be-8823-0088fc76f58e tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] 10.222.0.79 "GET /compute/v2.1/servers/656925d8-a071-49b4-92b0-b74039bc96dc" status: 200 len: 1336 microversion: 2.57 time: 0.377984 Oct 17 13:54:06.913538 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2098/4078] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:06 2022] GET /compute/v2.1/servers/656925d8-a071-49b4-92b0-b74039bc96dc => generated 1336 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:54:07.916509 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-795a19c2-f8a1-4849-bf12-9954eb83a07f tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:07.918254 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-795a19c2-f8a1-4849-bf12-9954eb83a07f tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] [instance: 656925d8-a071-49b4-92b0-b74039bc96dc] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:07.937097 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-795a19c2-f8a1-4849-bf12-9954eb83a07f tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:07.941467 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-795a19c2-f8a1-4849-bf12-9954eb83a07f tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:07.941467 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-795a19c2-f8a1-4849-bf12-9954eb83a07f tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:07.941467 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-795a19c2-f8a1-4849-bf12-9954eb83a07f tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:07.941467 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-795a19c2-f8a1-4849-bf12-9954eb83a07f tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:07.941467 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-795a19c2-f8a1-4849-bf12-9954eb83a07f tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:08.248454 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-795a19c2-f8a1-4849-bf12-9954eb83a07f tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:08.266958 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-795a19c2-f8a1-4849-bf12-9954eb83a07f tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:08.272140 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-795a19c2-f8a1-4849-bf12-9954eb83a07f tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:08.273786 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-795a19c2-f8a1-4849-bf12-9954eb83a07f tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] 10.222.0.79 "GET /compute/v2.1/servers/656925d8-a071-49b4-92b0-b74039bc96dc" status: 200 len: 1336 microversion: 2.57 time: 0.361467 Oct 17 13:54:08.288549 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2099/4079] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:07 2022] GET /compute/v2.1/servers/656925d8-a071-49b4-92b0-b74039bc96dc => generated 1336 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:54:08.791403 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-792f44d3-548d-4fff-9aff-8c61b15bc14d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:08.792393 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-792f44d3-548d-4fff-9aff-8c61b15bc14d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:08.805889 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b6c2b480-e650-4783-9f0f-adb6fc93114a tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/images/1c87bf9a-af5f-491c-829a-c8ee2c5ec23e" status: 200 len: 1453 microversion: 2.1 time: 2.180273 Oct 17 13:54:08.806531 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1981/4080] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:54:06 2022] GET /compute/v2.1/images/1c87bf9a-af5f-491c-829a-c8ee2c5ec23e => generated 1453 bytes in 2183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:54:08.808911 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-792f44d3-548d-4fff-9aff-8c61b15bc14d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:08.811720 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-792f44d3-548d-4fff-9aff-8c61b15bc14d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:08.818005 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-792f44d3-548d-4fff-9aff-8c61b15bc14d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:08.819937 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-792f44d3-548d-4fff-9aff-8c61b15bc14d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:08.823853 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-792f44d3-548d-4fff-9aff-8c61b15bc14d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:08.830082 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-792f44d3-548d-4fff-9aff-8c61b15bc14d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:09.315946 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f2be5f59-f116-4f45-9667-fe159f310e25 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:09.322012 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f2be5f59-f116-4f45-9667-fe159f310e25 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] [instance: 656925d8-a071-49b4-92b0-b74039bc96dc] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:09.374042 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f2be5f59-f116-4f45-9667-fe159f310e25 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:09.374978 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f2be5f59-f116-4f45-9667-fe159f310e25 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:09.377976 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f2be5f59-f116-4f45-9667-fe159f310e25 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:09.380203 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f2be5f59-f116-4f45-9667-fe159f310e25 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:09.382241 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f2be5f59-f116-4f45-9667-fe159f310e25 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:09.385402 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f2be5f59-f116-4f45-9667-fe159f310e25 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:09.637833 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-792f44d3-548d-4fff-9aff-8c61b15bc14d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:09.676685 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-792f44d3-548d-4fff-9aff-8c61b15bc14d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1666 microversion: 2.1 time: 0.889348 Oct 17 13:54:09.678524 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2100/4081] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:08 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1666 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:09.706183 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-bf170fc8-32f9-4a67-90a3-76e6e1d9d7b6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:09.707063 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-bf170fc8-32f9-4a67-90a3-76e6e1d9d7b6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:09.720923 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bf170fc8-32f9-4a67-90a3-76e6e1d9d7b6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:09.721814 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bf170fc8-32f9-4a67-90a3-76e6e1d9d7b6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:09.722612 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bf170fc8-32f9-4a67-90a3-76e6e1d9d7b6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:09.724649 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bf170fc8-32f9-4a67-90a3-76e6e1d9d7b6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:09.739698 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bf170fc8-32f9-4a67-90a3-76e6e1d9d7b6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:09.740599 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bf170fc8-32f9-4a67-90a3-76e6e1d9d7b6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:09.744018 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f2be5f59-f116-4f45-9667-fe159f310e25 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:09.770767 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f2be5f59-f116-4f45-9667-fe159f310e25 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:09.772436 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f2be5f59-f116-4f45-9667-fe159f310e25 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:09.773927 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f2be5f59-f116-4f45-9667-fe159f310e25 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] 10.222.0.79 "GET /compute/v2.1/servers/656925d8-a071-49b4-92b0-b74039bc96dc" status: 200 len: 1357 microversion: 2.57 time: 0.471460 Oct 17 13:54:09.790661 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1982/4082] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:09 2022] GET /compute/v2.1/servers/656925d8-a071-49b4-92b0-b74039bc96dc => generated 1357 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:54:09.808985 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-187358ef-980c-429e-b5a9-317d3be7dbe7 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:54:09.833214 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-187358ef-980c-429e-b5a9-317d3be7dbe7 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] [instance: 656925d8-a071-49b4-92b0-b74039bc96dc] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:09.851010 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-187358ef-980c-429e-b5a9-317d3be7dbe7 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:09.854012 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-187358ef-980c-429e-b5a9-317d3be7dbe7 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:09.856885 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-187358ef-980c-429e-b5a9-317d3be7dbe7 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:09.857904 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-187358ef-980c-429e-b5a9-317d3be7dbe7 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:09.858517 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-187358ef-980c-429e-b5a9-317d3be7dbe7 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:09.859658 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-187358ef-980c-429e-b5a9-317d3be7dbe7 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:10.033293 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-187358ef-980c-429e-b5a9-317d3be7dbe7 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:54:10.033726 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-187358ef-980c-429e-b5a9-317d3be7dbe7 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:54:10.034263 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-187358ef-980c-429e-b5a9-317d3be7dbe7 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:54:10.036749 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-187358ef-980c-429e-b5a9-317d3be7dbe7 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:54:10.037191 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-187358ef-980c-429e-b5a9-317d3be7dbe7 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:54:10.249095 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-187358ef-980c-429e-b5a9-317d3be7dbe7 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] [instance: 656925d8-a071-49b4-92b0-b74039bc96dc] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:10.253098 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-bf170fc8-32f9-4a67-90a3-76e6e1d9d7b6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:10.263315 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-bf170fc8-32f9-4a67-90a3-76e6e1d9d7b6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1666 microversion: 2.1 time: 0.562658 Oct 17 13:54:10.269212 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2101/4083] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:09 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1666 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:54:10.271680 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-187358ef-980c-429e-b5a9-317d3be7dbe7 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:10.272189 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-187358ef-980c-429e-b5a9-317d3be7dbe7 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:10.272630 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-187358ef-980c-429e-b5a9-317d3be7dbe7 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:10.273347 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-187358ef-980c-429e-b5a9-317d3be7dbe7 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:10.273799 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-187358ef-980c-429e-b5a9-317d3be7dbe7 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:10.274222 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-187358ef-980c-429e-b5a9-317d3be7dbe7 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:10.280130 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f479c420-0c9b-4257-8d2d-9aa76fe02631 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd46df3a0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:10.340865 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-187358ef-980c-429e-b5a9-317d3be7dbe7 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] 10.222.0.79 "POST /compute/v2.1/servers/656925d8-a071-49b4-92b0-b74039bc96dc/action" status: 202 len: 1138 microversion: 2.57 time: 0.536366 Oct 17 13:54:10.342176 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1983/4084] 10.222.0.79 () {62 vars in 1320 bytes} [Mon Oct 17 13:54:09 2022] POST /compute/v2.1/servers/656925d8-a071-49b4-92b0-b74039bc96dc/action => generated 1138 bytes in 539 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Oct 17 13:54:10.350253 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e59222a3-a456-4644-867d-ad96b8a52647 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:10.351278 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e59222a3-a456-4644-867d-ad96b8a52647 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:10.358394 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e59222a3-a456-4644-867d-ad96b8a52647 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:10.359133 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e59222a3-a456-4644-867d-ad96b8a52647 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:10.360069 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e59222a3-a456-4644-867d-ad96b8a52647 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:10.361444 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e59222a3-a456-4644-867d-ad96b8a52647 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:10.362398 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e59222a3-a456-4644-867d-ad96b8a52647 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:10.364650 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e59222a3-a456-4644-867d-ad96b8a52647 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:10.403814 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f479c420-0c9b-4257-8d2d-9aa76fe02631 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/images/1c87bf9a-af5f-491c-829a-c8ee2c5ec23e" status: 200 len: 1462 microversion: 2.1 time: 0.131061 Oct 17 13:54:10.408544 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2102/4085] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:54:10 2022] GET /compute/v2.1/images/1c87bf9a-af5f-491c-829a-c8ee2c5ec23e => generated 1462 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:10.426898 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f3442c1e-2170-4869-8f09-1798a950273f tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:10.431358 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f3442c1e-2170-4869-8f09-1798a950273f tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] [instance: 656925d8-a071-49b4-92b0-b74039bc96dc] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:10.481129 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f3442c1e-2170-4869-8f09-1798a950273f tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:10.481623 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f3442c1e-2170-4869-8f09-1798a950273f tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:10.502107 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f3442c1e-2170-4869-8f09-1798a950273f tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:10.503274 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f3442c1e-2170-4869-8f09-1798a950273f tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:10.520229 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f3442c1e-2170-4869-8f09-1798a950273f tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:10.529020 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f3442c1e-2170-4869-8f09-1798a950273f tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:10.635892 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e59222a3-a456-4644-867d-ad96b8a52647 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:10.653973 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e59222a3-a456-4644-867d-ad96b8a52647 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1666 microversion: 2.1 time: 0.310247 Oct 17 13:54:10.655112 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1984/4086] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:10 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1666 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:10.660819 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-934f6b8a-d4cd-4878-907d-59a5f7315853 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd9a22700>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:10.736455 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f3442c1e-2170-4869-8f09-1798a950273f tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:10.754189 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f3442c1e-2170-4869-8f09-1798a950273f tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:10.756011 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f3442c1e-2170-4869-8f09-1798a950273f tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:10.757258 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f3442c1e-2170-4869-8f09-1798a950273f tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] 10.222.0.79 "GET /compute/v2.1/servers/656925d8-a071-49b4-92b0-b74039bc96dc" status: 200 len: 1366 microversion: 2.57 time: 0.347482 Oct 17 13:54:10.762487 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2103/4087] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:10 2022] GET /compute/v2.1/servers/656925d8-a071-49b4-92b0-b74039bc96dc => generated 1366 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:54:10.763124 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-934f6b8a-d4cd-4878-907d-59a5f7315853 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/images/1c87bf9a-af5f-491c-829a-c8ee2c5ec23e" status: 200 len: 1462 microversion: 2.1 time: 0.104878 Oct 17 13:54:10.773609 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1985/4088] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:54:10 2022] GET /compute/v2.1/images/1c87bf9a-af5f-491c-829a-c8ee2c5ec23e => generated 1462 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:10.802088 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ec841a55-0637-4335-9507-21de4a1cebbd tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:54:10.809490 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ec841a55-0637-4335-9507-21de4a1cebbd tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:10.827208 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ec841a55-0637-4335-9507-21de4a1cebbd tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:10.827753 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ec841a55-0637-4335-9507-21de4a1cebbd tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:10.828210 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ec841a55-0637-4335-9507-21de4a1cebbd tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:10.828955 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ec841a55-0637-4335-9507-21de4a1cebbd tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:10.831883 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ec841a55-0637-4335-9507-21de4a1cebbd tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:10.832390 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ec841a55-0637-4335-9507-21de4a1cebbd tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:11.005949 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ec841a55-0637-4335-9507-21de4a1cebbd tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "POST /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d/action" status: 202 len: 0 microversion: 2.1 time: 0.230453 Oct 17 13:54:11.014214 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1986/4089] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:54:10 2022] POST /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:54:11.037579 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-441cafed-4a42-4d82-b293-66ae32e4faf0 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:11.038716 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-441cafed-4a42-4d82-b293-66ae32e4faf0 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] [instance: 419a7ac0-9332-481d-bc66-3ad5b6a9db81] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:11.058109 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-441cafed-4a42-4d82-b293-66ae32e4faf0 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:11.059465 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-441cafed-4a42-4d82-b293-66ae32e4faf0 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:11.061754 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-441cafed-4a42-4d82-b293-66ae32e4faf0 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:11.064415 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-441cafed-4a42-4d82-b293-66ae32e4faf0 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:11.066449 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-441cafed-4a42-4d82-b293-66ae32e4faf0 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:11.067710 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-441cafed-4a42-4d82-b293-66ae32e4faf0 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:11.089931 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-241fca80-5096-4492-a519-49dc07ed1589 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1102540259", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "972f7955-62ea-4b08-b16f-d902110830e1"}]}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:54:11.218727 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-241fca80-5096-4492-a519-49dc07ed1589 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] validate_networks() for [('972f7955-62ea-4b08-b16f-d902110830e1', None, None, None, None, None)] {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:54:11.866692 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-441cafed-4a42-4d82-b293-66ae32e4faf0 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bfe589d0784bfc8ed1611c71cd4461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb1624a35d0403c9e5d09a17e79b7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:11.887366 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-441cafed-4a42-4d82-b293-66ae32e4faf0 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/servers/419a7ac0-9332-481d-bc66-3ad5b6a9db81" status: 200 len: 1466 microversion: 2.1 time: 0.871467 Oct 17 13:54:11.899863 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1987/4090] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:11 2022] GET /compute/v2.1/servers/419a7ac0-9332-481d-bc66-3ad5b6a9db81 => generated 1466 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:11.912913 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2508e919-d064-46af-88ac-261865b16644 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:11.916151 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2508e919-d064-46af-88ac-261865b16644 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:11.931337 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2508e919-d064-46af-88ac-261865b16644 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:11.932196 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2508e919-d064-46af-88ac-261865b16644 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:11.932786 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2508e919-d064-46af-88ac-261865b16644 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:11.933669 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2508e919-d064-46af-88ac-261865b16644 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:11.934268 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2508e919-d064-46af-88ac-261865b16644 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:11.934834 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2508e919-d064-46af-88ac-261865b16644 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:12.598241 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2508e919-d064-46af-88ac-261865b16644 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:12.623849 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2508e919-d064-46af-88ac-261865b16644 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1668 microversion: 2.1 time: 0.722679 Oct 17 13:54:12.627141 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1988/4091] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:11 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1668 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:12.646903 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-946cbd83-092e-4788-b838-ddbb777097da tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:12.647693 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-946cbd83-092e-4788-b838-ddbb777097da tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] [instance: 656925d8-a071-49b4-92b0-b74039bc96dc] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:12.665108 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-946cbd83-092e-4788-b838-ddbb777097da tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:12.665877 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-946cbd83-092e-4788-b838-ddbb777097da tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:12.666709 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-946cbd83-092e-4788-b838-ddbb777097da tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:12.667274 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-946cbd83-092e-4788-b838-ddbb777097da tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:12.667837 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-946cbd83-092e-4788-b838-ddbb777097da tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:12.668480 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-946cbd83-092e-4788-b838-ddbb777097da tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:12.966991 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-241fca80-5096-4492-a519-49dc07ed1589 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:54:12.968442 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-241fca80-5096-4492-a519-49dc07ed1589 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:54:12.969265 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-241fca80-5096-4492-a519-49dc07ed1589 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:54:12.969842 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-241fca80-5096-4492-a519-49dc07ed1589 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:54:12.970413 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-241fca80-5096-4492-a519-49dc07ed1589 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:54:12.974033 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-946cbd83-092e-4788-b838-ddbb777097da tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:12.990185 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-946cbd83-092e-4788-b838-ddbb777097da tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:12.992254 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-946cbd83-092e-4788-b838-ddbb777097da tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:12.994549 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-946cbd83-092e-4788-b838-ddbb777097da tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] 10.222.0.79 "GET /compute/v2.1/servers/656925d8-a071-49b4-92b0-b74039bc96dc" status: 200 len: 1366 microversion: 2.57 time: 0.365882 Oct 17 13:54:13.006575 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-241fca80-5096-4492-a519-49dc07ed1589 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:13.007901 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-241fca80-5096-4492-a519-49dc07ed1589 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:13.009047 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-241fca80-5096-4492-a519-49dc07ed1589 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:13.009301 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1989/4092] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:12 2022] GET /compute/v2.1/servers/656925d8-a071-49b4-92b0-b74039bc96dc => generated 1366 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:54:13.011601 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-241fca80-5096-4492-a519-49dc07ed1589 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:13.013765 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-241fca80-5096-4492-a519-49dc07ed1589 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:13.014418 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-241fca80-5096-4492-a519-49dc07ed1589 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:13.028315 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d7fba348-26db-434f-932c-86a42994c7d8 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd53f14c0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:13.074392 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-241fca80-5096-4492-a519-49dc07ed1589 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Getting quotas for project a23d1c84c66c43bc9daf9d3028663f94. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:54:13.100623 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-241fca80-5096-4492-a519-49dc07ed1589 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Getting quotas for user fb634956c1764e508400b08750ecc9b2 and project a23d1c84c66c43bc9daf9d3028663f94. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:54:13.154691 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-241fca80-5096-4492-a519-49dc07ed1589 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:54:13.157138 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-241fca80-5096-4492-a519-49dc07ed1589 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] [instance: b54d449b-422b-4ca0-8183-02eb28c30747] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:54:13.270108 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d7fba348-26db-434f-932c-86a42994c7d8 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/images?changes-since=2022-10-17T13%3A52%3A13Z" status: 200 len: 2372 microversion: 2.1 time: 0.259250 Oct 17 13:54:13.272183 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1990/4093] 10.222.0.79 () {58 vars in 1199 bytes} [Mon Oct 17 13:54:13 2022] GET /compute/v2.1/images?changes-since=2022-10-17T13%3A52%3A13Z => generated 2372 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:13.278020 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f7f881df-2e1a-4b8c-b47d-b9092218c59b tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:13.280161 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f7f881df-2e1a-4b8c-b47d-b9092218c59b tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 90bfb179-c8b6-4810-a981-33b78a19b62c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:13.289237 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f7f881df-2e1a-4b8c-b47d-b9092218c59b tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:13.289866 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f7f881df-2e1a-4b8c-b47d-b9092218c59b tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:13.290433 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f7f881df-2e1a-4b8c-b47d-b9092218c59b tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:13.291572 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f7f881df-2e1a-4b8c-b47d-b9092218c59b tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:13.292432 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f7f881df-2e1a-4b8c-b47d-b9092218c59b tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:13.293128 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f7f881df-2e1a-4b8c-b47d-b9092218c59b tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:13.324170 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-241fca80-5096-4492-a519-49dc07ed1589 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.559541 Oct 17 13:54:13.327621 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2104/4094] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:54:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:54:13.332540 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1fdc2e42-6a6b-43f1-bc84-b2c18936fcc0 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd4609820>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:13.499809 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1fdc2e42-6a6b-43f1-bc84-b2c18936fcc0 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-944792419" status: 200 len: 484 microversion: 2.1 time: 0.169921 Oct 17 13:54:13.500712 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2105/4095] 10.222.0.79 () {58 vars in 1229 bytes} [Mon Oct 17 13:54:13 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-944792419 => generated 484 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:54:13.507519 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-43a15604-bf80-4ae1-943c-d81103c58acf tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:13.509262 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-43a15604-bf80-4ae1-943c-d81103c58acf tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] [instance: b54d449b-422b-4ca0-8183-02eb28c30747] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:13.522040 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-f7f881df-2e1a-4b8c-b47d-b9092218c59b tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lazy-loading 'services' on Instance uuid 90bfb179-c8b6-4810-a981-33b78a19b62c {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:54:13.652075 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-43a15604-bf80-4ae1-943c-d81103c58acf tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb634956c1764e508400b08750ecc9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23d1c84c66c43bc9daf9d3028663f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:13.662003 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-43a15604-bf80-4ae1-943c-d81103c58acf tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] 10.222.0.79 "GET /compute/v2.1/servers/b54d449b-422b-4ca0-8183-02eb28c30747" status: 200 len: 1214 microversion: 2.1 time: 0.159417 Oct 17 13:54:13.668677 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2106/4096] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:13 2022] GET /compute/v2.1/servers/b54d449b-422b-4ca0-8183-02eb28c30747 => generated 1214 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:13.678164 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3b28bc6d-83fc-49df-8f1d-88136912aff0 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd55a7af0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:13.706612 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f7f881df-2e1a-4b8c-b47d-b9092218c59b tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "DELETE /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c/os-volume_attachments/a7ce18e7-7d8e-426a-8d78-c4060c6a3218" status: 202 len: 0 microversion: 2.1 time: 0.432686 Oct 17 13:54:13.707302 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1991/4097] 10.222.0.79 () {58 vars in 1416 bytes} [Mon Oct 17 13:54:13 2022] DELETE /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c/os-volume_attachments/a7ce18e7-7d8e-426a-8d78-c4060c6a3218 => generated 0 bytes in 435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:54:13.718296 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3c0d7575-2ce0-40fc-b15f-bc6693e3fd71 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:13.718959 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3c0d7575-2ce0-40fc-b15f-bc6693e3fd71 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:13.727930 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3c0d7575-2ce0-40fc-b15f-bc6693e3fd71 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:13.728712 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3c0d7575-2ce0-40fc-b15f-bc6693e3fd71 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:13.729137 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3c0d7575-2ce0-40fc-b15f-bc6693e3fd71 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:13.730109 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3c0d7575-2ce0-40fc-b15f-bc6693e3fd71 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:13.730562 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3c0d7575-2ce0-40fc-b15f-bc6693e3fd71 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:13.731065 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3c0d7575-2ce0-40fc-b15f-bc6693e3fd71 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:13.766505 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-3c0d7575-2ce0-40fc-b15f-bc6693e3fd71 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] HTTP exception thrown: Instance bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5 could not be found. Oct 17 13:54:13.769013 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3c0d7575-2ce0-40fc-b15f-bc6693e3fd71 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Request method failure captured: Oct 17 13:54:13.769013 n-d-854247-14 devstack@n-api.service[127017]: request: DELETE /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5 HTTP/1.1 Oct 17 13:54:13.769013 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:54:13.769013 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:54:13.769013 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:54:13.769013 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:54:13.769013 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:54:13.769013 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:54:13.769013 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:54:13.769013 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:54:13.769013 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVzj7ySRjNRGWeLZhuOn9q-1zQEMM4cm4f1Hd3un42c2zlaS1Crq4DnN26vS4u-r9RlLxn9BBcFV2T6QJYLkUmK8IYzpajU2f5b8Nv4JJmW6GJSH7eSOWEJIthN2nve8_TpMYj0RwNzzlkurCU_UZmVG-U7xXVbyvUUBd_Ch7Kacuyc Oct 17 13:54:13.769013 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:54:13.769013 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:54:13.769013 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:54:13.769013 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:54:13.769013 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:54:13.769013 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:54:13.769013 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 11973b8e1d8a4af8add65726e8ba7c83 Oct 17 13:54:13.769013 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-AttachVolumeTestJSON-829991168 Oct 17 13:54:13.769013 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:54:13.769013 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:54:13.769013 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/11973b8e1d8a4af8add65726e8ba7c83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/11973b8e1d8a4af8add65726e8ba7c83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/11973b8e1d8a4af8add65726e8ba7c83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_11973b8e1d8a4af8add65726e8ba7c83", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:54:13.769013 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-AttachVolumeTestJSON-829991168 Oct 17 13:54:13.769013 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 11973b8e1d8a4af8add65726e8ba7c83 Oct 17 13:54:13.769013 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-AttachVolumeTestJSON-829991168 Oct 17 13:54:13.769013 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-AttachVolumeTestJSON-829991168-project Oct 17 13:54:13.769013 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:54:13.769013 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:54:13.769013 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 683d18db860a4d60ab3eeba2a372b2c5 Oct 17 13:54:13.769013 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-AttachVolumeTestJSON-829991168-project Oct 17 13:54:13.769013 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:54:13.769013 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5 could not be found. Oct 17 13:54:13.769013 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5'} Oct 17 13:54:13.769013 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:54:13.769013 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:54:13.769013 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:54:13.769013 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:54:13.769013 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:54:13.769013 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:54:13.769013 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:54:13.769013 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:54:13.769013 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:54:13.769013 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:54:13.769013 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5 could not be found. Oct 17 13:54:13.769013 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:13.769013 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:54:13.769013 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:13.769013 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:54:13.769013 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:54:13.769013 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:54:13.769013 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:54:13.769013 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:54:13.769013 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:54:13.769013 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:54:13.769013 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:54:13.769013 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:54:13.769013 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:54:13.769013 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:54:13.769013 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:54:13.769013 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:54:13.769013 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:54:13.769013 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:54:13.773453 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5 could not be found. Oct 17 13:54:13.773453 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:13.773453 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:54:13.773453 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:13.773453 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:54:13.773453 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:54:13.773453 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:54:13.773453 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:54:13.773453 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:54:13.773453 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5 could not be found. Oct 17 13:54:13.773453 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:13.773453 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3c0d7575-2ce0-40fc-b15f-bc6693e3fd71 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Returning 404 to user: Instance bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:54:13.773453 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3c0d7575-2ce0-40fc-b15f-bc6693e3fd71 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "DELETE /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5" status: 404 len: 111 microversion: 2.1 time: 0.058513 Oct 17 13:54:13.776832 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1992/4098] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:54:13 2022] DELETE /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:54:13.881930 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f960daf8-0658-4a06-9e7e-bc9e5647cad2 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1734704181", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "9068fc20-d8de-44b1-b99e-5b00162400d0"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:54:13.918132 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3b28bc6d-83fc-49df-8f1d-88136912aff0 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/images?server=419a7ac0-9332-481d-bc66-3ad5b6a9db81" status: 200 len: 957 microversion: 2.1 time: 0.248157 Oct 17 13:54:13.923596 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2107/4099] 10.222.0.79 () {58 vars in 1209 bytes} [Mon Oct 17 13:54:13 2022] GET /compute/v2.1/images?server=419a7ac0-9332-481d-bc66-3ad5b6a9db81 => generated 957 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:54:13.950401 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-64aa8067-3b44-4e64-9101-cd512ddc7b5a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:13.951034 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-64aa8067-3b44-4e64-9101-cd512ddc7b5a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:13.975736 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-64aa8067-3b44-4e64-9101-cd512ddc7b5a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:13.976397 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-64aa8067-3b44-4e64-9101-cd512ddc7b5a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:13.976641 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-64aa8067-3b44-4e64-9101-cd512ddc7b5a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:13.979345 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-64aa8067-3b44-4e64-9101-cd512ddc7b5a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:13.983132 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-64aa8067-3b44-4e64-9101-cd512ddc7b5a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:13.984390 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-64aa8067-3b44-4e64-9101-cd512ddc7b5a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:14.012391 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-f960daf8-0658-4a06-9e7e-bc9e5647cad2 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] validate_networks() for [('9068fc20-d8de-44b1-b99e-5b00162400d0', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:54:14.783497 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-64aa8067-3b44-4e64-9101-cd512ddc7b5a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:14.803746 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-64aa8067-3b44-4e64-9101-cd512ddc7b5a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1668 microversion: 2.1 time: 0.869330 Oct 17 13:54:14.804374 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2108/4100] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:13 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1668 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:14.841276 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d0f42ece-aba9-47c5-9eaa-53961e5ca83b tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:14.849519 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d0f42ece-aba9-47c5-9eaa-53961e5ca83b tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 90bfb179-c8b6-4810-a981-33b78a19b62c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:14.864203 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d0f42ece-aba9-47c5-9eaa-53961e5ca83b tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:14.864695 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d0f42ece-aba9-47c5-9eaa-53961e5ca83b tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:14.865129 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d0f42ece-aba9-47c5-9eaa-53961e5ca83b tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:14.865832 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d0f42ece-aba9-47c5-9eaa-53961e5ca83b tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:14.866282 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d0f42ece-aba9-47c5-9eaa-53961e5ca83b tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:14.866697 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d0f42ece-aba9-47c5-9eaa-53961e5ca83b tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:14.940604 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d0f42ece-aba9-47c5-9eaa-53961e5ca83b tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134586 Oct 17 13:54:14.951629 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2109/4101] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 13:54:14 2022] GET /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:54:14.956891 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ae3f55ac-38cd-479c-be4c-494a90122514 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:14.957760 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ae3f55ac-38cd-479c-be4c-494a90122514 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:14.968901 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ae3f55ac-38cd-479c-be4c-494a90122514 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:14.980164 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ae3f55ac-38cd-479c-be4c-494a90122514 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:14.981608 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ae3f55ac-38cd-479c-be4c-494a90122514 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:14.984707 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ae3f55ac-38cd-479c-be4c-494a90122514 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:14.985394 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ae3f55ac-38cd-479c-be4c-494a90122514 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:14.986051 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ae3f55ac-38cd-479c-be4c-494a90122514 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:15.022661 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-ae3f55ac-38cd-479c-be4c-494a90122514 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] HTTP exception thrown: Instance bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5 could not be found. Oct 17 13:54:15.024865 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ae3f55ac-38cd-479c-be4c-494a90122514 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Request method failure captured: Oct 17 13:54:15.024865 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5 HTTP/1.1 Oct 17 13:54:15.024865 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:54:15.024865 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:54:15.024865 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:54:15.024865 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:54:15.024865 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:54:15.024865 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:54:15.024865 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:54:15.024865 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:54:15.024865 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTVzj7ySRjNRGWeLZhuOn9q-1zQEMM4cm4f1Hd3un42c2zlaS1Crq4DnN26vS4u-r9RlLxn9BBcFV2T6QJYLkUmK8IYzpajU2f5b8Nv4JJmW6GJSH7eSOWEJIthN2nve8_TpMYj0RwNzzlkurCU_UZmVG-U7xXVbyvUUBd_Ch7Kacuyc Oct 17 13:54:15.024865 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:54:15.024865 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:54:15.024865 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:54:15.024865 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:54:15.024865 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:54:15.024865 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:54:15.024865 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 11973b8e1d8a4af8add65726e8ba7c83 Oct 17 13:54:15.024865 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-AttachVolumeTestJSON-829991168 Oct 17 13:54:15.024865 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:54:15.024865 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:54:15.024865 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/11973b8e1d8a4af8add65726e8ba7c83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/11973b8e1d8a4af8add65726e8ba7c83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/11973b8e1d8a4af8add65726e8ba7c83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_11973b8e1d8a4af8add65726e8ba7c83", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:54:15.024865 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-AttachVolumeTestJSON-829991168 Oct 17 13:54:15.024865 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 11973b8e1d8a4af8add65726e8ba7c83 Oct 17 13:54:15.024865 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-AttachVolumeTestJSON-829991168 Oct 17 13:54:15.024865 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-AttachVolumeTestJSON-829991168-project Oct 17 13:54:15.024865 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:54:15.024865 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:54:15.024865 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 683d18db860a4d60ab3eeba2a372b2c5 Oct 17 13:54:15.024865 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-AttachVolumeTestJSON-829991168-project Oct 17 13:54:15.024865 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:54:15.024865 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5 could not be found. Oct 17 13:54:15.024865 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5'} Oct 17 13:54:15.024865 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:54:15.024865 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:54:15.024865 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:54:15.024865 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:54:15.024865 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:54:15.024865 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:54:15.024865 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:54:15.024865 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:54:15.024865 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:54:15.024865 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:54:15.024865 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5 could not be found. Oct 17 13:54:15.024865 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:54:15.024865 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:54:15.024865 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:54:15.024865 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:54:15.024865 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:54:15.024865 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:54:15.024865 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:54:15.024865 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:54:15.024865 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:54:15.024865 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:54:15.024865 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:54:15.024865 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:54:15.024865 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:54:15.024865 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:54:15.024865 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:54:15.024865 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:54:15.024865 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5 could not be found. Oct 17 13:54:15.024865 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:54:15.024865 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:54:15.024865 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:54:15.028693 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:54:15.028693 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:54:15.028693 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:54:15.028693 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:54:15.028693 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:54:15.028693 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5 could not be found. Oct 17 13:54:15.028693 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:54:15.038836 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ae3f55ac-38cd-479c-be4c-494a90122514 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Returning 404 to user: Instance bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:54:15.042128 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ae3f55ac-38cd-479c-be4c-494a90122514 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5" status: 404 len: 111 microversion: 2.1 time: 0.089140 Oct 17 13:54:15.043746 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2110/4102] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:14 2022] GET /compute/v2.1/servers/bcf9ad52-97d9-4a7f-aa45-c58a1b1943b5 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:54:15.063423 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b6eddd2a-024d-4457-9cce-f7ce6b6371f8 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd45b5160>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:15.148678 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b6eddd2a-024d-4457-9cce-f7ce6b6371f8 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.79%2Fcompute%2Fv2.1%2Fservers%2F5fea9fdd-bc16-4923-bbf8-e0909cd3bcda" status: 200 len: 484 microversion: 2.1 time: 0.098628 Oct 17 13:54:15.159250 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2111/4103] 10.222.0.79 () {58 vars in 1317 bytes} [Mon Oct 17 13:54:15 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.79%2Fcompute%2Fv2.1%2Fservers%2F5fea9fdd-bc16-4923-bbf8-e0909cd3bcda => generated 484 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:54:15.164693 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7366b1ea-6df2-47bb-94cb-05cafb917b06 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:15.169538 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7366b1ea-6df2-47bb-94cb-05cafb917b06 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] [instance: 656925d8-a071-49b4-92b0-b74039bc96dc] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:15.188776 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7366b1ea-6df2-47bb-94cb-05cafb917b06 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:15.189681 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7366b1ea-6df2-47bb-94cb-05cafb917b06 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:15.191052 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7366b1ea-6df2-47bb-94cb-05cafb917b06 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:15.192753 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7366b1ea-6df2-47bb-94cb-05cafb917b06 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:15.195327 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7366b1ea-6df2-47bb-94cb-05cafb917b06 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:15.196475 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7366b1ea-6df2-47bb-94cb-05cafb917b06 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:15.471140 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7366b1ea-6df2-47bb-94cb-05cafb917b06 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:15.487641 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7366b1ea-6df2-47bb-94cb-05cafb917b06 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:15.489439 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7366b1ea-6df2-47bb-94cb-05cafb917b06 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:15.490900 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7366b1ea-6df2-47bb-94cb-05cafb917b06 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] 10.222.0.79 "GET /compute/v2.1/servers/656925d8-a071-49b4-92b0-b74039bc96dc" status: 200 len: 1366 microversion: 2.57 time: 0.330250 Oct 17 13:54:15.493772 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2112/4104] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:15 2022] GET /compute/v2.1/servers/656925d8-a071-49b4-92b0-b74039bc96dc => generated 1366 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:54:15.498787 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-0be1dfd0-58df-45d2-aa81-45a254de0b25 req-1e81e616-6c56-4dba-a176-4d2e5832cdf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "419a7ac0-9332-481d-bc66-3ad5b6a9db81", "name": "network-vif-unplugged", "status": "completed", "tag": "8c4e8542-c161-4443-8115-64e41c66a3fe"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:54:15.527057 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-0be1dfd0-58df-45d2-aa81-45a254de0b25 req-1e81e616-6c56-4dba-a176-4d2e5832cdf1 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:15.527617 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-0be1dfd0-58df-45d2-aa81-45a254de0b25 req-1e81e616-6c56-4dba-a176-4d2e5832cdf1 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:15.527988 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-0be1dfd0-58df-45d2-aa81-45a254de0b25 req-1e81e616-6c56-4dba-a176-4d2e5832cdf1 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:15.546354 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-0be1dfd0-58df-45d2-aa81-45a254de0b25 req-1e81e616-6c56-4dba-a176-4d2e5832cdf1 service nova] Creating event network-vif-unplugged:8c4e8542-c161-4443-8115-64e41c66a3fe for instance 419a7ac0-9332-481d-bc66-3ad5b6a9db81 on n-h2-854247-14 Oct 17 13:54:15.575741 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-0be1dfd0-58df-45d2-aa81-45a254de0b25 req-1e81e616-6c56-4dba-a176-4d2e5832cdf1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080380 Oct 17 13:54:15.578668 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2113/4105] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:54:15.591897 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5029503c-f95c-4793-aac2-679b09cf069b tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:15.595214 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5029503c-f95c-4793-aac2-679b09cf069b tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] [instance: b54d449b-422b-4ca0-8183-02eb28c30747] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:15.611129 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5029503c-f95c-4793-aac2-679b09cf069b tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:15.611855 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5029503c-f95c-4793-aac2-679b09cf069b tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:15.612433 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5029503c-f95c-4793-aac2-679b09cf069b tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:15.613302 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5029503c-f95c-4793-aac2-679b09cf069b tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:15.613913 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5029503c-f95c-4793-aac2-679b09cf069b tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:15.615140 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5029503c-f95c-4793-aac2-679b09cf069b tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:15.769672 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-f960daf8-0658-4a06-9e7e-bc9e5647cad2 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:54:15.770151 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-f960daf8-0658-4a06-9e7e-bc9e5647cad2 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:54:15.770565 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-f960daf8-0658-4a06-9e7e-bc9e5647cad2 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:54:15.771129 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-f960daf8-0658-4a06-9e7e-bc9e5647cad2 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:54:15.771570 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-f960daf8-0658-4a06-9e7e-bc9e5647cad2 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:54:15.793567 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f960daf8-0658-4a06-9e7e-bc9e5647cad2 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:15.796330 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f960daf8-0658-4a06-9e7e-bc9e5647cad2 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:15.798355 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f960daf8-0658-4a06-9e7e-bc9e5647cad2 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:15.800473 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f960daf8-0658-4a06-9e7e-bc9e5647cad2 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:15.801012 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f960daf8-0658-4a06-9e7e-bc9e5647cad2 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:15.802090 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f960daf8-0658-4a06-9e7e-bc9e5647cad2 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:15.835630 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5029503c-f95c-4793-aac2-679b09cf069b tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb634956c1764e508400b08750ecc9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23d1c84c66c43bc9daf9d3028663f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:15.844620 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5029503c-f95c-4793-aac2-679b09cf069b tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] 10.222.0.79 "GET /compute/v2.1/servers/b54d449b-422b-4ca0-8183-02eb28c30747" status: 200 len: 1266 microversion: 2.1 time: 0.264360 Oct 17 13:54:15.846685 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2114/4106] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:15 2022] GET /compute/v2.1/servers/b54d449b-422b-4ca0-8183-02eb28c30747 => generated 1266 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:15.857178 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-75f1e1c2-bbfb-4c0d-a6ea-ddc4bce140a7 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd5465790>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:15.884383 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-f960daf8-0658-4a06-9e7e-bc9e5647cad2 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Getting quotas for project 132e34c2ebdd41548f0915fa502b0c4b. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:54:15.901813 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-f960daf8-0658-4a06-9e7e-bc9e5647cad2 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Getting quotas for user 9958ae6fcf04486ba0de669284420b37 and project 132e34c2ebdd41548f0915fa502b0c4b. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:54:15.933552 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f960daf8-0658-4a06-9e7e-bc9e5647cad2 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:54:15.938267 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f960daf8-0658-4a06-9e7e-bc9e5647cad2 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] [instance: 3cf7e278-5294-4b2e-9b46-8981392d5764] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:54:16.047017 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-75f1e1c2-bbfb-4c0d-a6ea-ddc4bce140a7 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.79%2Fcompute%2Fservers%2F5fea9fdd-bc16-4923-bbf8-e0909cd3bcda" status: 200 len: 484 microversion: 2.1 time: 0.198792 Oct 17 13:54:16.048347 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2115/4107] 10.222.0.79 () {58 vars in 1303 bytes} [Mon Oct 17 13:54:15 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.79%2Fcompute%2Fservers%2F5fea9fdd-bc16-4923-bbf8-e0909cd3bcda => generated 484 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:54:16.057942 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f960daf8-0658-4a06-9e7e-bc9e5647cad2 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 2.271007 Oct 17 13:54:16.058853 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1993/4108] 10.222.0.79 () {62 vars in 1188 bytes} [Mon Oct 17 13:54:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2282 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 13:54:16.060845 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-73c69c0f-baaa-4997-bbe2-d366386244c4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:16.064466 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-73c69c0f-baaa-4997-bbe2-d366386244c4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:16.066153 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-82ae8a3a-4248-4b30-9bf3-4366d5145e08 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:16.075319 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-82ae8a3a-4248-4b30-9bf3-4366d5145e08 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 90bfb179-c8b6-4810-a981-33b78a19b62c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:16.080496 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-73c69c0f-baaa-4997-bbe2-d366386244c4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:16.081223 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-73c69c0f-baaa-4997-bbe2-d366386244c4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:16.082837 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-73c69c0f-baaa-4997-bbe2-d366386244c4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:16.083818 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-73c69c0f-baaa-4997-bbe2-d366386244c4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:16.085445 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-73c69c0f-baaa-4997-bbe2-d366386244c4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:16.088599 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-73c69c0f-baaa-4997-bbe2-d366386244c4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:16.104549 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82ae8a3a-4248-4b30-9bf3-4366d5145e08 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:16.105983 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82ae8a3a-4248-4b30-9bf3-4366d5145e08 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:16.107026 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82ae8a3a-4248-4b30-9bf3-4366d5145e08 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:16.107970 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82ae8a3a-4248-4b30-9bf3-4366d5145e08 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:16.109210 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82ae8a3a-4248-4b30-9bf3-4366d5145e08 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:16.109793 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82ae8a3a-4248-4b30-9bf3-4366d5145e08 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:16.169195 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-82ae8a3a-4248-4b30-9bf3-4366d5145e08 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108672 Oct 17 13:54:16.170741 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1994/4109] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 13:54:16 2022] GET /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:54:16.176530 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2f7c6b2c-63a6-49ff-8c94-53e86ca3c30d tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd53f1430>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:16.412788 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-73c69c0f-baaa-4997-bbe2-d366386244c4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:16.420689 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2f7c6b2c-63a6-49ff-8c94-53e86ca3c30d tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3277 microversion: 2.1 time: 0.248369 Oct 17 13:54:16.422816 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-73c69c0f-baaa-4997-bbe2-d366386244c4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1666 microversion: 2.1 time: 0.373257 Oct 17 13:54:16.428729 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2116/4110] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:16 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1666 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:16.442390 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-369d8a3c-57e4-4bff-92e4-c9d5593ae1f9 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:16.442689 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1995/4111] 10.222.0.79 () {58 vars in 1149 bytes} [Mon Oct 17 13:54:16 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3277 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:16.443022 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-369d8a3c-57e4-4bff-92e4-c9d5593ae1f9 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] [instance: 3cf7e278-5294-4b2e-9b46-8981392d5764] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:16.454995 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-09d2f233-4bf7-4e07-8168-62ababb2bca3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:54:16.457333 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-09d2f233-4bf7-4e07-8168-62ababb2bca3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:16.473264 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-09d2f233-4bf7-4e07-8168-62ababb2bca3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:16.473763 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-09d2f233-4bf7-4e07-8168-62ababb2bca3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:16.474202 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-09d2f233-4bf7-4e07-8168-62ababb2bca3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:16.474904 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-09d2f233-4bf7-4e07-8168-62ababb2bca3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:16.482920 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-09d2f233-4bf7-4e07-8168-62ababb2bca3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:16.483644 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-09d2f233-4bf7-4e07-8168-62ababb2bca3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:16.560182 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-09d2f233-4bf7-4e07-8168-62ababb2bca3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "POST /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d/action" status: 200 len: 322 microversion: 2.1 time: 0.110942 Oct 17 13:54:16.560754 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1996/4112] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:54:16 2022] POST /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d/action => generated 322 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:54:16.572690 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2c11861a-14e8-4e6e-b00e-748773671d13 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd5ca50d0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:16.598726 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-369d8a3c-57e4-4bff-92e4-c9d5593ae1f9 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958ae6fcf04486ba0de669284420b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132e34c2ebdd41548f0915fa502b0c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:16.610347 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-369d8a3c-57e4-4bff-92e4-c9d5593ae1f9 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9958ae6fcf04486ba0de669284420b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132e34c2ebdd41548f0915fa502b0c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:16.613142 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-369d8a3c-57e4-4bff-92e4-c9d5593ae1f9 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9958ae6fcf04486ba0de669284420b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132e34c2ebdd41548f0915fa502b0c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:16.614881 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-369d8a3c-57e4-4bff-92e4-c9d5593ae1f9 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] 10.222.0.79 "GET /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764" status: 200 len: 1262 microversion: 2.26 time: 0.183682 Oct 17 13:54:16.615963 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2117/4113] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:16 2022] GET /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764 => generated 1262 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:54:16.622958 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9c3c04a7-1421-4e04-8d61-11c7b48d4608 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:16.623907 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9c3c04a7-1421-4e04-8d61-11c7b48d4608 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] [instance: 656925d8-a071-49b4-92b0-b74039bc96dc] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:16.632103 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c3c04a7-1421-4e04-8d61-11c7b48d4608 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:16.633097 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c3c04a7-1421-4e04-8d61-11c7b48d4608 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:16.633731 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c3c04a7-1421-4e04-8d61-11c7b48d4608 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:16.634702 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c3c04a7-1421-4e04-8d61-11c7b48d4608 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:16.635753 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c3c04a7-1421-4e04-8d61-11c7b48d4608 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:16.636368 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c3c04a7-1421-4e04-8d61-11c7b48d4608 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:16.661759 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=100 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:54:16.721549 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2c11861a-14e8-4e6e-b00e-748773671d13 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1429 microversion: 2.1 time: 0.152923 Oct 17 13:54:16.722192 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1997/4114] 10.222.0.79 () {58 vars in 1149 bytes} [Mon Oct 17 13:54:16 2022] GET /compute/v2.1/images?type=snapshot => generated 1429 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:16.742239 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9c3c04a7-1421-4e04-8d61-11c7b48d4608 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:16.753457 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9c3c04a7-1421-4e04-8d61-11c7b48d4608 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:16.755524 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9c3c04a7-1421-4e04-8d61-11c7b48d4608 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:16.757139 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9c3c04a7-1421-4e04-8d61-11c7b48d4608 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] 10.222.0.79 "GET /compute/v2.1/servers/656925d8-a071-49b4-92b0-b74039bc96dc" status: 200 len: 1366 microversion: 2.57 time: 0.139719 Oct 17 13:54:16.758411 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2118/4115] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:16 2022] GET /compute/v2.1/servers/656925d8-a071-49b4-92b0-b74039bc96dc => generated 1366 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:54:16.759252 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6787dcdc-5356-4984-9ce8-e144f817309c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:16.760784 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6787dcdc-5356-4984-9ce8-e144f817309c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:16.764663 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-dc1080f0-edc5-4110-8e03-ba3c91eef95d tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd5465ee0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:16.791940 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6787dcdc-5356-4984-9ce8-e144f817309c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:16.792557 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6787dcdc-5356-4984-9ce8-e144f817309c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:16.793601 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6787dcdc-5356-4984-9ce8-e144f817309c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:16.794356 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6787dcdc-5356-4984-9ce8-e144f817309c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:16.794812 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6787dcdc-5356-4984-9ce8-e144f817309c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:16.795258 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6787dcdc-5356-4984-9ce8-e144f817309c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:16.841323 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-dc1080f0-edc5-4110-8e03-ba3c91eef95d tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.079201 Oct 17 13:54:16.842068 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2119/4116] 10.222.0.79 () {58 vars in 1137 bytes} [Mon Oct 17 13:54:16 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:54:16.855611 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b49e20ad-d534-4816-9653-a1d6d477cc82 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd544d700>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:17.128305 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b49e20ad-d534-4816-9653-a1d6d477cc82 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/images/detail?changes-since=2022-10-17T13%3A52%3A09Z" status: 200 len: 6324 microversion: 2.1 time: 0.276908 Oct 17 13:54:17.131382 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2120/4117] 10.222.0.79 () {58 vars in 1220 bytes} [Mon Oct 17 13:54:16 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-17T13%3A52%3A09Z => generated 6324 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:54:17.147768 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-65a27d96-ca80-47ab-97b0-3640f39059a4 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:17.148554 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-65a27d96-ca80-47ab-97b0-3640f39059a4 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] [instance: b54d449b-422b-4ca0-8183-02eb28c30747] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:17.158631 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-65a27d96-ca80-47ab-97b0-3640f39059a4 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:17.163766 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-65a27d96-ca80-47ab-97b0-3640f39059a4 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:17.169224 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-65a27d96-ca80-47ab-97b0-3640f39059a4 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:17.170720 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-65a27d96-ca80-47ab-97b0-3640f39059a4 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:17.170849 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6787dcdc-5356-4984-9ce8-e144f817309c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:17.171579 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-65a27d96-ca80-47ab-97b0-3640f39059a4 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:17.172205 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-65a27d96-ca80-47ab-97b0-3640f39059a4 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:17.190214 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6787dcdc-5356-4984-9ce8-e144f817309c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1666 microversion: 2.1 time: 0.452119 Oct 17 13:54:17.191077 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1998/4118] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:16 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1666 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:17.201160 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3143878b-d689-4d55-902e-8d58c7acc104 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd9884820>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:17.272406 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3143878b-d689-4d55-902e-8d58c7acc104 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-944792419" status: 200 len: 664 microversion: 2.1 time: 0.079942 Oct 17 13:54:17.273128 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 1999/4119] 10.222.0.79 () {58 vars in 1250 bytes} [Mon Oct 17 13:54:17 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-944792419 => generated 664 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:54:17.294754 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-65a27d96-ca80-47ab-97b0-3640f39059a4 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb634956c1764e508400b08750ecc9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23d1c84c66c43bc9daf9d3028663f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:17.297437 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-57e81405-de31-40b5-9213-e021598a05d6 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:17.300813 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-57e81405-de31-40b5-9213-e021598a05d6 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 90bfb179-c8b6-4810-a981-33b78a19b62c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:17.304090 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-65a27d96-ca80-47ab-97b0-3640f39059a4 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] 10.222.0.79 "GET /compute/v2.1/servers/b54d449b-422b-4ca0-8183-02eb28c30747" status: 200 len: 1272 microversion: 2.1 time: 0.171194 Oct 17 13:54:17.304951 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2121/4120] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:17 2022] GET /compute/v2.1/servers/b54d449b-422b-4ca0-8183-02eb28c30747 => generated 1272 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:17.310587 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-57e81405-de31-40b5-9213-e021598a05d6 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:17.311400 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-57e81405-de31-40b5-9213-e021598a05d6 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:17.311994 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-57e81405-de31-40b5-9213-e021598a05d6 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:17.313387 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-57e81405-de31-40b5-9213-e021598a05d6 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:17.314478 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-57e81405-de31-40b5-9213-e021598a05d6 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:17.315484 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-57e81405-de31-40b5-9213-e021598a05d6 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:17.315944 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cb20d7b5-a1e7-457f-95f1-5f066cd8248e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:17.316688 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cb20d7b5-a1e7-457f-95f1-5f066cd8248e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:17.327596 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb20d7b5-a1e7-457f-95f1-5f066cd8248e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:17.328171 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb20d7b5-a1e7-457f-95f1-5f066cd8248e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:17.328707 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb20d7b5-a1e7-457f-95f1-5f066cd8248e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:17.329522 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb20d7b5-a1e7-457f-95f1-5f066cd8248e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:17.330071 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb20d7b5-a1e7-457f-95f1-5f066cd8248e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:17.330591 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb20d7b5-a1e7-457f-95f1-5f066cd8248e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:17.350880 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:54:17.363653 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-57e81405-de31-40b5-9213-e021598a05d6 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073068 Oct 17 13:54:17.364781 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2000/4121] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 13:54:17 2022] GET /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:54:17.370314 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9a31d983-ef9f-415a-9e74-5214cc90eb34 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd9a5fca0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:17.442467 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9a31d983-ef9f-415a-9e74-5214cc90eb34 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.79%2Fcompute%2Fv2.1%2Fservers%2F5fea9fdd-bc16-4923-bbf8-e0909cd3bcda" status: 200 len: 1464 microversion: 2.1 time: 0.076052 Oct 17 13:54:17.448241 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2001/4122] 10.222.0.79 () {58 vars in 1338 bytes} [Mon Oct 17 13:54:17 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.79%2Fcompute%2Fv2.1%2Fservers%2F5fea9fdd-bc16-4923-bbf8-e0909cd3bcda => generated 1464 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:17.464701 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8099630e-8a28-487e-9703-a6c5a38c151d tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd563e670>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:17.539342 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8099630e-8a28-487e-9703-a6c5a38c151d tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.79%2Fcompute%2Fservers%2F5fea9fdd-bc16-4923-bbf8-e0909cd3bcda" status: 200 len: 1464 microversion: 2.1 time: 0.078094 Oct 17 13:54:17.549089 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2002/4123] 10.222.0.79 () {58 vars in 1324 bytes} [Mon Oct 17 13:54:17 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.79%2Fcompute%2Fservers%2F5fea9fdd-bc16-4923-bbf8-e0909cd3bcda => generated 1464 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:17.558935 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d6eb552c-4852-42d2-a400-a42d813cc9c0 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd5225c10>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:17.735777 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d6eb552c-4852-42d2-a400-a42d813cc9c0 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7099 microversion: 2.1 time: 0.181581 Oct 17 13:54:17.738029 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cb20d7b5-a1e7-457f-95f1-5f066cd8248e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:17.742103 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2003/4124] 10.222.0.79 () {58 vars in 1170 bytes} [Mon Oct 17 13:54:17 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7099 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:54:17.755277 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cb20d7b5-a1e7-457f-95f1-5f066cd8248e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1666 microversion: 2.1 time: 0.446954 Oct 17 13:54:17.757918 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2122/4125] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:17 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1666 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:17.771193 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bbbce359-2f15-4d12-b7b3-8706511f8298 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:17.771193 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-bbbce359-2f15-4d12-b7b3-8706511f8298 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] [instance: 3cf7e278-5294-4b2e-9b46-8981392d5764] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:17.778546 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bbbce359-2f15-4d12-b7b3-8706511f8298 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:17.780599 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bbbce359-2f15-4d12-b7b3-8706511f8298 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:17.780599 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bbbce359-2f15-4d12-b7b3-8706511f8298 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:17.780816 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bbbce359-2f15-4d12-b7b3-8706511f8298 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:17.782276 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bbbce359-2f15-4d12-b7b3-8706511f8298 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:17.782276 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bbbce359-2f15-4d12-b7b3-8706511f8298 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:17.784167 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-091de97c-b2b8-40ae-8c29-a64211b8371b tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd5567f70>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:17.884711 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-bbbce359-2f15-4d12-b7b3-8706511f8298 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958ae6fcf04486ba0de669284420b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132e34c2ebdd41548f0915fa502b0c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:17.894469 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-bbbce359-2f15-4d12-b7b3-8706511f8298 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9958ae6fcf04486ba0de669284420b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132e34c2ebdd41548f0915fa502b0c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:17.896145 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-bbbce359-2f15-4d12-b7b3-8706511f8298 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9958ae6fcf04486ba0de669284420b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132e34c2ebdd41548f0915fa502b0c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:17.897298 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-bbbce359-2f15-4d12-b7b3-8706511f8298 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] 10.222.0.79 "GET /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764" status: 200 len: 1314 microversion: 2.26 time: 0.153858 Oct 17 13:54:17.910525 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-091de97c-b2b8-40ae-8c29-a64211b8371b tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4369 microversion: 2.1 time: 0.140936 Oct 17 13:54:17.911591 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2123/4126] 10.222.0.79 () {58 vars in 1170 bytes} [Mon Oct 17 13:54:17 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4369 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:17.912866 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2004/4127] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:17 2022] GET /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:54:17.917498 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-df9b2d45-866c-450f-b65b-2e16237716c8 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:17.918113 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-df9b2d45-866c-450f-b65b-2e16237716c8 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] [instance: 656925d8-a071-49b4-92b0-b74039bc96dc] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:17.919094 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-93527ff8-8246-4d30-a7d3-8c024c56baea tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:17.919917 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-93527ff8-8246-4d30-a7d3-8c024c56baea tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:17.926732 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-93527ff8-8246-4d30-a7d3-8c024c56baea tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:17.928681 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-93527ff8-8246-4d30-a7d3-8c024c56baea tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:17.929231 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-93527ff8-8246-4d30-a7d3-8c024c56baea tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:17.931270 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-93527ff8-8246-4d30-a7d3-8c024c56baea tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:17.933780 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-93527ff8-8246-4d30-a7d3-8c024c56baea tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:17.934328 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-93527ff8-8246-4d30-a7d3-8c024c56baea tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:17.941414 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-df9b2d45-866c-450f-b65b-2e16237716c8 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:17.941902 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-df9b2d45-866c-450f-b65b-2e16237716c8 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:17.942329 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-df9b2d45-866c-450f-b65b-2e16237716c8 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:17.943037 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-df9b2d45-866c-450f-b65b-2e16237716c8 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:17.943504 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-df9b2d45-866c-450f-b65b-2e16237716c8 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:17.943923 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-df9b2d45-866c-450f-b65b-2e16237716c8 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:18.055354 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-df9b2d45-866c-450f-b65b-2e16237716c8 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:18.083014 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-df9b2d45-866c-450f-b65b-2e16237716c8 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:18.094622 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-df9b2d45-866c-450f-b65b-2e16237716c8 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:18.094622 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-df9b2d45-866c-450f-b65b-2e16237716c8 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] 10.222.0.79 "GET /compute/v2.1/servers/656925d8-a071-49b4-92b0-b74039bc96dc" status: 200 len: 1366 microversion: 2.57 time: 0.176673 Oct 17 13:54:18.094622 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2005/4128] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:17 2022] GET /compute/v2.1/servers/656925d8-a071-49b4-92b0-b74039bc96dc => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:54:18.099520 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-524b1e62-41e9-4472-b940-c71a1c40d58b tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd9a14040>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:18.197913 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-524b1e62-41e9-4472-b940-c71a1c40d58b tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/images/0743b21b-a6ff-4d02-897c-eabb68c3ba07" status: 200 len: 784 microversion: 2.1 time: 0.102492 Oct 17 13:54:18.200075 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2006/4129] 10.222.0.79 () {58 vars in 1233 bytes} [Mon Oct 17 13:54:18 2022] GET /compute/v2.1/images/0743b21b-a6ff-4d02-897c-eabb68c3ba07 => generated 784 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:54:18.228056 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e688d595-6490-42a4-80f0-8beeb6cdf22f tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd9a29af0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:18.235457 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-93527ff8-8246-4d30-a7d3-8c024c56baea tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:18.247448 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-93527ff8-8246-4d30-a7d3-8c024c56baea tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1666 microversion: 2.1 time: 0.332935 Oct 17 13:54:18.249991 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2124/4130] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:17 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1666 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:18.278047 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-be156961-f3a6-45bc-81c8-8538afe3b6a0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:18.279813 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-be156961-f3a6-45bc-81c8-8538afe3b6a0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:18.290744 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be156961-f3a6-45bc-81c8-8538afe3b6a0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:18.294466 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be156961-f3a6-45bc-81c8-8538afe3b6a0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:18.296190 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be156961-f3a6-45bc-81c8-8538afe3b6a0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:18.300106 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be156961-f3a6-45bc-81c8-8538afe3b6a0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:18.300856 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be156961-f3a6-45bc-81c8-8538afe3b6a0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:18.302543 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be156961-f3a6-45bc-81c8-8538afe3b6a0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:18.435890 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e688d595-6490-42a4-80f0-8beeb6cdf22f tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1609 microversion: 2.1 time: 0.222355 Oct 17 13:54:18.449922 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2007/4131] 10.222.0.79 () {58 vars in 1158 bytes} [Mon Oct 17 13:54:18 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1609 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:18.461107 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e58c32df-4dcb-45a6-99e3-d8558521f683 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:18.463248 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e58c32df-4dcb-45a6-99e3-d8558521f683 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] [instance: b54d449b-422b-4ca0-8183-02eb28c30747] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:18.479954 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e58c32df-4dcb-45a6-99e3-d8558521f683 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:18.480475 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e58c32df-4dcb-45a6-99e3-d8558521f683 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:18.483682 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e58c32df-4dcb-45a6-99e3-d8558521f683 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:18.484470 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e58c32df-4dcb-45a6-99e3-d8558521f683 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:18.485103 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e58c32df-4dcb-45a6-99e3-d8558521f683 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:18.485948 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e58c32df-4dcb-45a6-99e3-d8558521f683 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:18.621251 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e58c32df-4dcb-45a6-99e3-d8558521f683 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb634956c1764e508400b08750ecc9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23d1c84c66c43bc9daf9d3028663f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:18.636508 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e58c32df-4dcb-45a6-99e3-d8558521f683 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] 10.222.0.79 "GET /compute/v2.1/servers/b54d449b-422b-4ca0-8183-02eb28c30747" status: 200 len: 1272 microversion: 2.1 time: 0.184879 Oct 17 13:54:18.655352 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-be156961-f3a6-45bc-81c8-8538afe3b6a0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:18.661925 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2008/4132] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:18 2022] GET /compute/v2.1/servers/b54d449b-422b-4ca0-8183-02eb28c30747 => generated 1272 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:18.670823 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-be156961-f3a6-45bc-81c8-8538afe3b6a0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1666 microversion: 2.1 time: 0.397169 Oct 17 13:54:18.672151 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2125/4133] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:18 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1666 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:18.675740 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4ff02af8-ccaf-4e92-83c4-4e4d7ae8ffea tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:18.678078 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4ff02af8-ccaf-4e92-83c4-4e4d7ae8ffea tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 90bfb179-c8b6-4810-a981-33b78a19b62c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:18.687032 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9c67a40e-5021-4db9-b2ce-7c2110b3a947 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd98a5820>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:18.693988 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4ff02af8-ccaf-4e92-83c4-4e4d7ae8ffea tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:18.697778 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4ff02af8-ccaf-4e92-83c4-4e4d7ae8ffea tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:18.698405 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4ff02af8-ccaf-4e92-83c4-4e4d7ae8ffea tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:18.700851 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4ff02af8-ccaf-4e92-83c4-4e4d7ae8ffea tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:18.714205 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4ff02af8-ccaf-4e92-83c4-4e4d7ae8ffea tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:18.716422 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4ff02af8-ccaf-4e92-83c4-4e4d7ae8ffea tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:18.797255 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4ff02af8-ccaf-4e92-83c4-4e4d7ae8ffea tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133843 Oct 17 13:54:18.798442 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2009/4134] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 13:54:18 2022] GET /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:54:18.901280 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0598ae54-49fa-40bf-9a3d-3e6491531ea3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1822027018", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "1d5948d6-f169-4d00-b98f-07daff8883f9"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:54:18.985520 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-0598ae54-49fa-40bf-9a3d-3e6491531ea3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] validate_networks() for [('1d5948d6-f169-4d00-b98f-07daff8883f9', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:54:19.480261 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9c67a40e-5021-4db9-b2ce-7c2110b3a947 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "DELETE /compute/v2.1/images/1c87bf9a-af5f-491c-829a-c8ee2c5ec23e" status: 204 len: 0 microversion: 2.1 time: 0.806436 Oct 17 13:54:19.483867 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2126/4135] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:18 2022] DELETE /compute/v2.1/images/1c87bf9a-af5f-491c-829a-c8ee2c5ec23e => generated 0 bytes in 808 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:54:19.486491 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cb586fb9-1e3c-47a3-b1bb-b3ec49293d2f tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:19.487295 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cb586fb9-1e3c-47a3-b1bb-b3ec49293d2f tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] [instance: 3cf7e278-5294-4b2e-9b46-8981392d5764] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:19.500200 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb586fb9-1e3c-47a3-b1bb-b3ec49293d2f tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:19.502342 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb586fb9-1e3c-47a3-b1bb-b3ec49293d2f tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:19.505313 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb586fb9-1e3c-47a3-b1bb-b3ec49293d2f tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:19.506259 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb586fb9-1e3c-47a3-b1bb-b3ec49293d2f tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:19.508842 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb586fb9-1e3c-47a3-b1bb-b3ec49293d2f tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:19.509479 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb586fb9-1e3c-47a3-b1bb-b3ec49293d2f tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:19.647674 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cb586fb9-1e3c-47a3-b1bb-b3ec49293d2f tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958ae6fcf04486ba0de669284420b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132e34c2ebdd41548f0915fa502b0c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:19.661904 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cb586fb9-1e3c-47a3-b1bb-b3ec49293d2f tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9958ae6fcf04486ba0de669284420b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132e34c2ebdd41548f0915fa502b0c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:19.663705 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cb586fb9-1e3c-47a3-b1bb-b3ec49293d2f tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9958ae6fcf04486ba0de669284420b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132e34c2ebdd41548f0915fa502b0c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:19.667396 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cb586fb9-1e3c-47a3-b1bb-b3ec49293d2f tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] 10.222.0.79 "GET /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764" status: 200 len: 1320 microversion: 2.26 time: 0.185079 Oct 17 13:54:19.668150 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2127/4136] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:19 2022] GET /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764 => generated 1320 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:54:19.677143 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a4ec16e6-9901-41d0-83ed-5eadff383a0e tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:19.689786 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a4ec16e6-9901-41d0-83ed-5eadff383a0e tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] [instance: 656925d8-a071-49b4-92b0-b74039bc96dc] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:19.704480 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:54:19.706452 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a4ec16e6-9901-41d0-83ed-5eadff383a0e tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:19.707353 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a4ec16e6-9901-41d0-83ed-5eadff383a0e tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:19.707968 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a4ec16e6-9901-41d0-83ed-5eadff383a0e tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:19.708961 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a4ec16e6-9901-41d0-83ed-5eadff383a0e tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:19.711096 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a4ec16e6-9901-41d0-83ed-5eadff383a0e tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:19.711893 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a4ec16e6-9901-41d0-83ed-5eadff383a0e tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:19.812394 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a4ec16e6-9901-41d0-83ed-5eadff383a0e tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:19.842801 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a4ec16e6-9901-41d0-83ed-5eadff383a0e tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:19.844277 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a4ec16e6-9901-41d0-83ed-5eadff383a0e tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:19.845464 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a4ec16e6-9901-41d0-83ed-5eadff383a0e tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] 10.222.0.79 "GET /compute/v2.1/servers/656925d8-a071-49b4-92b0-b74039bc96dc" status: 200 len: 1366 microversion: 2.57 time: 0.172551 Oct 17 13:54:19.850955 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2128/4137] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:19 2022] GET /compute/v2.1/servers/656925d8-a071-49b4-92b0-b74039bc96dc => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:54:19.863056 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ab198d4f-4512-48d9-8b4d-79f72da86a85 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd98a5310>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:19.899871 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-0598ae54-49fa-40bf-9a3d-3e6491531ea3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:54:19.900586 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-0598ae54-49fa-40bf-9a3d-3e6491531ea3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:54:19.901280 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-0598ae54-49fa-40bf-9a3d-3e6491531ea3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:54:19.902238 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-0598ae54-49fa-40bf-9a3d-3e6491531ea3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:54:19.902771 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-0598ae54-49fa-40bf-9a3d-3e6491531ea3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:54:19.928777 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0598ae54-49fa-40bf-9a3d-3e6491531ea3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:19.929466 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0598ae54-49fa-40bf-9a3d-3e6491531ea3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:19.930116 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0598ae54-49fa-40bf-9a3d-3e6491531ea3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:19.941278 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0598ae54-49fa-40bf-9a3d-3e6491531ea3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:19.941861 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0598ae54-49fa-40bf-9a3d-3e6491531ea3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:19.944161 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0598ae54-49fa-40bf-9a3d-3e6491531ea3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:19.996231 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-0598ae54-49fa-40bf-9a3d-3e6491531ea3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Getting quotas for project 45371f66db35454fbe896194e75afd6e. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:54:20.007204 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-0598ae54-49fa-40bf-9a3d-3e6491531ea3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Getting quotas for user c9382b34782f44e2818a26ecadc3f386 and project 45371f66db35454fbe896194e75afd6e. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:54:20.043671 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0598ae54-49fa-40bf-9a3d-3e6491531ea3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:54:20.047636 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0598ae54-49fa-40bf-9a3d-3e6491531ea3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 051c9371-d3e2-4166-bed5-c73dc77ec977] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:54:20.179074 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0598ae54-49fa-40bf-9a3d-3e6491531ea3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.281133 Oct 17 13:54:20.182281 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2010/4138] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:54:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1287 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:54:20.191599 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9be34876-4ce0-4bdc-b6c8-eafbd97cbef9 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:20.196997 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9be34876-4ce0-4bdc-b6c8-eafbd97cbef9 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] [instance: b54d449b-422b-4ca0-8183-02eb28c30747] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:20.221453 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9be34876-4ce0-4bdc-b6c8-eafbd97cbef9 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:20.222221 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9be34876-4ce0-4bdc-b6c8-eafbd97cbef9 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:20.222871 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9be34876-4ce0-4bdc-b6c8-eafbd97cbef9 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:20.224015 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9be34876-4ce0-4bdc-b6c8-eafbd97cbef9 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:20.246203 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9be34876-4ce0-4bdc-b6c8-eafbd97cbef9 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:20.249721 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9be34876-4ce0-4bdc-b6c8-eafbd97cbef9 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:20.651033 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9be34876-4ce0-4bdc-b6c8-eafbd97cbef9 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb634956c1764e508400b08750ecc9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23d1c84c66c43bc9daf9d3028663f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:20.666257 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9be34876-4ce0-4bdc-b6c8-eafbd97cbef9 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] 10.222.0.79 "GET /compute/v2.1/servers/b54d449b-422b-4ca0-8183-02eb28c30747" status: 200 len: 1314 microversion: 2.1 time: 0.481300 Oct 17 13:54:20.667322 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2011/4139] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:20 2022] GET /compute/v2.1/servers/b54d449b-422b-4ca0-8183-02eb28c30747 => generated 1314 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:20.698515 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d290c9c7-069f-4931-9b7c-be82c6913547 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:20.709010 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d290c9c7-069f-4931-9b7c-be82c6913547 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 90bfb179-c8b6-4810-a981-33b78a19b62c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:20.736285 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d290c9c7-069f-4931-9b7c-be82c6913547 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:20.736673 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d290c9c7-069f-4931-9b7c-be82c6913547 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:20.739147 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ab198d4f-4512-48d9-8b4d-79f72da86a85 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "DELETE /compute/v2.1/images/778e673f-3171-46f0-a680-e9214da228fb" status: 204 len: 0 microversion: 2.1 time: 0.887032 Oct 17 13:54:20.742611 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2129/4140] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:19 2022] DELETE /compute/v2.1/images/778e673f-3171-46f0-a680-e9214da228fb => generated 0 bytes in 888 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:54:20.742838 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d290c9c7-069f-4931-9b7c-be82c6913547 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:20.744963 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d290c9c7-069f-4931-9b7c-be82c6913547 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:20.746389 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-72195d2e-d95f-4c49-9e39-dd29cb4d0f18 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:20.747016 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-72195d2e-d95f-4c49-9e39-dd29cb4d0f18 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 051c9371-d3e2-4166-bed5-c73dc77ec977] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:20.747616 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d290c9c7-069f-4931-9b7c-be82c6913547 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:20.748095 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d290c9c7-069f-4931-9b7c-be82c6913547 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:20.858223 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d290c9c7-069f-4931-9b7c-be82c6913547 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.188905 Oct 17 13:54:20.858833 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2012/4141] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 13:54:20 2022] GET /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c/os-volume_attachments => generated 197 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:54:20.868199 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-88855719-e635-4437-9ba7-3177674e953f tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:20.878192 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-88855719-e635-4437-9ba7-3177674e953f tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] [instance: 3cf7e278-5294-4b2e-9b46-8981392d5764] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:20.894216 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-72195d2e-d95f-4c49-9e39-dd29cb4d0f18 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:20.894434 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-88855719-e635-4437-9ba7-3177674e953f tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:20.894983 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-88855719-e635-4437-9ba7-3177674e953f tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:20.895536 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-88855719-e635-4437-9ba7-3177674e953f tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:20.896282 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-88855719-e635-4437-9ba7-3177674e953f tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:20.896740 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-88855719-e635-4437-9ba7-3177674e953f tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:20.897171 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-88855719-e635-4437-9ba7-3177674e953f tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:20.917401 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-72195d2e-d95f-4c49-9e39-dd29cb4d0f18 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977" status: 200 len: 1215 microversion: 2.1 time: 0.175751 Oct 17 13:54:20.923937 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2130/4142] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:20 2022] GET /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977 => generated 1215 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:20.936806 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6d7afb7b-7e78-44f4-80f9-4770ae9e3452 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd4609ee0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:21.615030 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-88855719-e635-4437-9ba7-3177674e953f tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958ae6fcf04486ba0de669284420b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132e34c2ebdd41548f0915fa502b0c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:21.641000 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-88855719-e635-4437-9ba7-3177674e953f tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9958ae6fcf04486ba0de669284420b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132e34c2ebdd41548f0915fa502b0c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:21.642589 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-88855719-e635-4437-9ba7-3177674e953f tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9958ae6fcf04486ba0de669284420b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132e34c2ebdd41548f0915fa502b0c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:21.643850 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-88855719-e635-4437-9ba7-3177674e953f tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] 10.222.0.79 "GET /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764" status: 200 len: 1362 microversion: 2.26 time: 0.781508 Oct 17 13:54:21.675191 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2013/4143] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:20 2022] GET /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764 => generated 1362 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:54:21.692241 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7ca49cca-79f5-417c-b730-853934e78125 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:21.700429 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7ca49cca-79f5-417c-b730-853934e78125 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] [instance: 656925d8-a071-49b4-92b0-b74039bc96dc] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:21.734201 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7ca49cca-79f5-417c-b730-853934e78125 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:21.734708 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7ca49cca-79f5-417c-b730-853934e78125 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:21.738043 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7ca49cca-79f5-417c-b730-853934e78125 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:21.741313 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7ca49cca-79f5-417c-b730-853934e78125 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:21.741805 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7ca49cca-79f5-417c-b730-853934e78125 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:21.742249 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7ca49cca-79f5-417c-b730-853934e78125 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:21.953797 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6d7afb7b-7e78-44f4-80f9-4770ae9e3452 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "DELETE /compute/v2.1/images/fb733fa0-36d1-4ec5-a621-b863abdc6233" status: 204 len: 0 microversion: 2.1 time: 1.027873 Oct 17 13:54:21.955629 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2131/4144] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:20 2022] DELETE /compute/v2.1/images/fb733fa0-36d1-4ec5-a621-b863abdc6233 => generated 0 bytes in 1031 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:54:21.964078 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-48f03893-144e-4c76-9435-ba7111974e6c tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:21.964930 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-48f03893-144e-4c76-9435-ba7111974e6c tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] [instance: b54d449b-422b-4ca0-8183-02eb28c30747] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:22.007993 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48f03893-144e-4c76-9435-ba7111974e6c tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:22.010600 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48f03893-144e-4c76-9435-ba7111974e6c tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:22.015922 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48f03893-144e-4c76-9435-ba7111974e6c tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:22.018952 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48f03893-144e-4c76-9435-ba7111974e6c tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:22.020389 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48f03893-144e-4c76-9435-ba7111974e6c tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:22.021148 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48f03893-144e-4c76-9435-ba7111974e6c tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:22.047482 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7ca49cca-79f5-417c-b730-853934e78125 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:22.079509 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7ca49cca-79f5-417c-b730-853934e78125 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:22.081648 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7ca49cca-79f5-417c-b730-853934e78125 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:22.082919 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7ca49cca-79f5-417c-b730-853934e78125 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] 10.222.0.79 "GET /compute/v2.1/servers/656925d8-a071-49b4-92b0-b74039bc96dc" status: 200 len: 1366 microversion: 2.57 time: 0.417773 Oct 17 13:54:22.097270 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2014/4145] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:21 2022] GET /compute/v2.1/servers/656925d8-a071-49b4-92b0-b74039bc96dc => generated 1366 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:54:22.111139 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5f9441c3-c634-4682-95bd-10d60a33d5e3 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:22.115477 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5f9441c3-c634-4682-95bd-10d60a33d5e3 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 90bfb179-c8b6-4810-a981-33b78a19b62c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:22.132261 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5f9441c3-c634-4682-95bd-10d60a33d5e3 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:22.132820 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5f9441c3-c634-4682-95bd-10d60a33d5e3 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:22.135762 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5f9441c3-c634-4682-95bd-10d60a33d5e3 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:22.137525 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5f9441c3-c634-4682-95bd-10d60a33d5e3 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:22.138306 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5f9441c3-c634-4682-95bd-10d60a33d5e3 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:22.138910 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5f9441c3-c634-4682-95bd-10d60a33d5e3 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:22.182379 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5f9441c3-c634-4682-95bd-10d60a33d5e3 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083949 Oct 17 13:54:22.183642 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2015/4146] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 13:54:22 2022] GET /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:54:22.189797 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-abc6b2dd-195b-4c9e-aa62-2a579c4c333a tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:22.191116 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-abc6b2dd-195b-4c9e-aa62-2a579c4c333a tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] [instance: 5fea9fdd-bc16-4923-bbf8-e0909cd3bcda] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:22.197605 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-abc6b2dd-195b-4c9e-aa62-2a579c4c333a tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:22.198694 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-abc6b2dd-195b-4c9e-aa62-2a579c4c333a tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:22.199750 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-abc6b2dd-195b-4c9e-aa62-2a579c4c333a tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:22.200671 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-abc6b2dd-195b-4c9e-aa62-2a579c4c333a tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:22.201512 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-abc6b2dd-195b-4c9e-aa62-2a579c4c333a tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:22.202131 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-abc6b2dd-195b-4c9e-aa62-2a579c4c333a tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:22.234901 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-abc6b2dd-195b-4c9e-aa62-2a579c4c333a tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] [instance: 5fea9fdd-bc16-4923-bbf8-e0909cd3bcda] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:54:22.376879 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-abc6b2dd-195b-4c9e-aa62-2a579c4c333a tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "DELETE /compute/v2.1/servers/5fea9fdd-bc16-4923-bbf8-e0909cd3bcda" status: 204 len: 0 microversion: 2.1 time: 0.191710 Oct 17 13:54:22.377490 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2016/4147] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:54:22 2022] DELETE /compute/v2.1/servers/5fea9fdd-bc16-4923-bbf8-e0909cd3bcda => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:54:22.398004 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f74ca468-b0d4-4dd4-9f31-5f3984c4a22a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:22.404094 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f74ca468-b0d4-4dd4-9f31-5f3984c4a22a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 051c9371-d3e2-4166-bed5-c73dc77ec977] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:22.406133 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-48f03893-144e-4c76-9435-ba7111974e6c tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb634956c1764e508400b08750ecc9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23d1c84c66c43bc9daf9d3028663f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:22.417902 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-48f03893-144e-4c76-9435-ba7111974e6c tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] 10.222.0.79 "GET /compute/v2.1/servers/b54d449b-422b-4ca0-8183-02eb28c30747" status: 200 len: 1314 microversion: 2.1 time: 0.460005 Oct 17 13:54:22.427403 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2132/4148] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:21 2022] GET /compute/v2.1/servers/b54d449b-422b-4ca0-8183-02eb28c30747 => generated 1314 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:22.433556 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f74ca468-b0d4-4dd4-9f31-5f3984c4a22a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:22.441658 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f74ca468-b0d4-4dd4-9f31-5f3984c4a22a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:22.442463 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f74ca468-b0d4-4dd4-9f31-5f3984c4a22a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:22.443639 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f74ca468-b0d4-4dd4-9f31-5f3984c4a22a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:22.443935 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b549e2cc-7669-4b8b-b4e0-10a640437354 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:22.444981 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b549e2cc-7669-4b8b-b4e0-10a640437354 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] [instance: 5fea9fdd-bc16-4923-bbf8-e0909cd3bcda] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:22.445689 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f74ca468-b0d4-4dd4-9f31-5f3984c4a22a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:22.448761 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f74ca468-b0d4-4dd4-9f31-5f3984c4a22a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:22.482413 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b549e2cc-7669-4b8b-b4e0-10a640437354 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:22.486387 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b549e2cc-7669-4b8b-b4e0-10a640437354 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:22.487699 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b549e2cc-7669-4b8b-b4e0-10a640437354 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:22.488685 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b549e2cc-7669-4b8b-b4e0-10a640437354 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:22.490556 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b549e2cc-7669-4b8b-b4e0-10a640437354 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:22.490556 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b549e2cc-7669-4b8b-b4e0-10a640437354 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:22.640809 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f74ca468-b0d4-4dd4-9f31-5f3984c4a22a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:22.650317 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f74ca468-b0d4-4dd4-9f31-5f3984c4a22a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977" status: 200 len: 1267 microversion: 2.1 time: 0.271109 Oct 17 13:54:22.652160 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2017/4149] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:22 2022] GET /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977 => generated 1267 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:22.694843 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-147c8c33-ad37-4201-85ee-35b911114667 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:22.695834 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-147c8c33-ad37-4201-85ee-35b911114667 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] [instance: 3cf7e278-5294-4b2e-9b46-8981392d5764] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:22.702851 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-147c8c33-ad37-4201-85ee-35b911114667 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:22.703664 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-147c8c33-ad37-4201-85ee-35b911114667 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:22.704287 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-147c8c33-ad37-4201-85ee-35b911114667 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:22.705207 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-147c8c33-ad37-4201-85ee-35b911114667 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:22.705839 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-147c8c33-ad37-4201-85ee-35b911114667 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:22.706454 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-147c8c33-ad37-4201-85ee-35b911114667 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:22.854851 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b549e2cc-7669-4b8b-b4e0-10a640437354 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bfe589d0784bfc8ed1611c71cd4461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb1624a35d0403c9e5d09a17e79b7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:22.863905 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b549e2cc-7669-4b8b-b4e0-10a640437354 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/servers/5fea9fdd-bc16-4923-bbf8-e0909cd3bcda" status: 200 len: 1474 microversion: 2.1 time: 0.435055 Oct 17 13:54:22.876226 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2133/4150] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:22 2022] GET /compute/v2.1/servers/5fea9fdd-bc16-4923-bbf8-e0909cd3bcda => generated 1474 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:22.960971 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-147c8c33-ad37-4201-85ee-35b911114667 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958ae6fcf04486ba0de669284420b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132e34c2ebdd41548f0915fa502b0c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:22.973845 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-147c8c33-ad37-4201-85ee-35b911114667 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9958ae6fcf04486ba0de669284420b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132e34c2ebdd41548f0915fa502b0c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:22.975297 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-147c8c33-ad37-4201-85ee-35b911114667 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9958ae6fcf04486ba0de669284420b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132e34c2ebdd41548f0915fa502b0c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:22.976489 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-147c8c33-ad37-4201-85ee-35b911114667 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] 10.222.0.79 "GET /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764" status: 200 len: 1362 microversion: 2.26 time: 0.286044 Oct 17 13:54:22.977305 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2018/4151] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:22 2022] GET /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764 => generated 1362 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:54:23.042072 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=4 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:54:23.097236 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-71840c46-0de3-4600-8cc1-dd32aecbcfc2 req-4390930b-46d7-4795-ae9e-4cf21a157867 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cf7e278-5294-4b2e-9b46-8981392d5764", "tag": "5f311b5b-8ecb-49ae-8938-b8137f8c070a"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:54:23.118930 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-927b4ad1-1694-434d-a9b1-cfa15b5da1c0 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:23.119826 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-927b4ad1-1694-434d-a9b1-cfa15b5da1c0 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] [instance: 656925d8-a071-49b4-92b0-b74039bc96dc] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:23.121674 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-71840c46-0de3-4600-8cc1-dd32aecbcfc2 req-4390930b-46d7-4795-ae9e-4cf21a157867 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:23.122173 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-71840c46-0de3-4600-8cc1-dd32aecbcfc2 req-4390930b-46d7-4795-ae9e-4cf21a157867 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:23.126963 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-71840c46-0de3-4600-8cc1-dd32aecbcfc2 req-4390930b-46d7-4795-ae9e-4cf21a157867 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:23.133068 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-927b4ad1-1694-434d-a9b1-cfa15b5da1c0 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:23.133926 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-927b4ad1-1694-434d-a9b1-cfa15b5da1c0 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:23.134716 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-927b4ad1-1694-434d-a9b1-cfa15b5da1c0 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:23.137628 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-927b4ad1-1694-434d-a9b1-cfa15b5da1c0 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:23.138318 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-927b4ad1-1694-434d-a9b1-cfa15b5da1c0 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:23.139379 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-927b4ad1-1694-434d-a9b1-cfa15b5da1c0 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:23.156600 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-71840c46-0de3-4600-8cc1-dd32aecbcfc2 req-4390930b-46d7-4795-ae9e-4cf21a157867 service nova] Creating event network-changed:5f311b5b-8ecb-49ae-8938-b8137f8c070a for instance 3cf7e278-5294-4b2e-9b46-8981392d5764 on n-h2-854247-14 Oct 17 13:54:23.166399 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-71840c46-0de3-4600-8cc1-dd32aecbcfc2 req-4390930b-46d7-4795-ae9e-4cf21a157867 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.183009 Oct 17 13:54:23.167538 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2134/4152] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:54:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:54:23.191335 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-5b93b043-f400-4913-99e3-82928283c2e2 req-6d478055-afb9-4e26-a7e9-39f071cafae2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b54d449b-422b-4ca0-8183-02eb28c30747", "tag": "84634b90-4e9f-4e18-95d8-de0aeebec3e7"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:54:23.205667 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-5b93b043-f400-4913-99e3-82928283c2e2 req-6d478055-afb9-4e26-a7e9-39f071cafae2 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:23.206409 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-5b93b043-f400-4913-99e3-82928283c2e2 req-6d478055-afb9-4e26-a7e9-39f071cafae2 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:23.207050 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-5b93b043-f400-4913-99e3-82928283c2e2 req-6d478055-afb9-4e26-a7e9-39f071cafae2 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:23.223011 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-5b93b043-f400-4913-99e3-82928283c2e2 req-6d478055-afb9-4e26-a7e9-39f071cafae2 service nova] Creating event network-changed:84634b90-4e9f-4e18-95d8-de0aeebec3e7 for instance b54d449b-422b-4ca0-8183-02eb28c30747 on n-h1-854247-14 Oct 17 13:54:23.241754 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-5b93b043-f400-4913-99e3-82928283c2e2 req-6d478055-afb9-4e26-a7e9-39f071cafae2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058339 Oct 17 13:54:23.243969 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2135/4153] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:54:23.269159 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cb95d292-e399-4bfd-b857-8d1709e01115 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:23.272164 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cb95d292-e399-4bfd-b857-8d1709e01115 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 90bfb179-c8b6-4810-a981-33b78a19b62c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:23.280247 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb95d292-e399-4bfd-b857-8d1709e01115 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:23.281279 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb95d292-e399-4bfd-b857-8d1709e01115 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:23.281922 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb95d292-e399-4bfd-b857-8d1709e01115 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:23.283403 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb95d292-e399-4bfd-b857-8d1709e01115 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:23.284040 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb95d292-e399-4bfd-b857-8d1709e01115 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:23.284832 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb95d292-e399-4bfd-b857-8d1709e01115 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:23.327998 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-927b4ad1-1694-434d-a9b1-cfa15b5da1c0 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:23.338849 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-927b4ad1-1694-434d-a9b1-cfa15b5da1c0 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:23.340280 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cb95d292-e399-4bfd-b857-8d1709e01115 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094706 Oct 17 13:54:23.341212 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-927b4ad1-1694-434d-a9b1-cfa15b5da1c0 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:23.341685 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2136/4154] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 13:54:23 2022] GET /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:54:23.347734 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-927b4ad1-1694-434d-a9b1-cfa15b5da1c0 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] 10.222.0.79 "GET /compute/v2.1/servers/656925d8-a071-49b4-92b0-b74039bc96dc" status: 200 len: 1366 microversion: 2.57 time: 0.237500 Oct 17 13:54:23.348894 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2019/4155] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:23 2022] GET /compute/v2.1/servers/656925d8-a071-49b4-92b0-b74039bc96dc => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:54:23.450558 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5cf12ae7-6709-4aba-ae96-271775544cb0 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:23.451506 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5cf12ae7-6709-4aba-ae96-271775544cb0 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] [instance: b54d449b-422b-4ca0-8183-02eb28c30747] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:23.460546 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5cf12ae7-6709-4aba-ae96-271775544cb0 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:23.461775 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5cf12ae7-6709-4aba-ae96-271775544cb0 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:23.463746 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5cf12ae7-6709-4aba-ae96-271775544cb0 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:23.466495 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5cf12ae7-6709-4aba-ae96-271775544cb0 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:23.467328 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5cf12ae7-6709-4aba-ae96-271775544cb0 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:23.469896 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5cf12ae7-6709-4aba-ae96-271775544cb0 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:23.675248 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9039b683-5c5a-4bca-8851-361daeb814f0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:23.677378 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9039b683-5c5a-4bca-8851-361daeb814f0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 051c9371-d3e2-4166-bed5-c73dc77ec977] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:23.693758 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9039b683-5c5a-4bca-8851-361daeb814f0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:23.699796 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9039b683-5c5a-4bca-8851-361daeb814f0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:23.700960 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9039b683-5c5a-4bca-8851-361daeb814f0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:23.701878 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9039b683-5c5a-4bca-8851-361daeb814f0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:23.702486 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9039b683-5c5a-4bca-8851-361daeb814f0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:23.703061 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9039b683-5c5a-4bca-8851-361daeb814f0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:23.723646 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5cf12ae7-6709-4aba-ae96-271775544cb0 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb634956c1764e508400b08750ecc9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23d1c84c66c43bc9daf9d3028663f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:23.734587 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5cf12ae7-6709-4aba-ae96-271775544cb0 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] 10.222.0.79 "GET /compute/v2.1/servers/b54d449b-422b-4ca0-8183-02eb28c30747" status: 200 len: 1314 microversion: 2.1 time: 0.288863 Oct 17 13:54:23.735826 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2137/4156] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:23 2022] GET /compute/v2.1/servers/b54d449b-422b-4ca0-8183-02eb28c30747 => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:23.891870 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c7b47f3c-1f00-442d-b10a-a2b593f56e85 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:23.902326 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c7b47f3c-1f00-442d-b10a-a2b593f56e85 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] [instance: 5fea9fdd-bc16-4923-bbf8-e0909cd3bcda] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:23.939768 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c7b47f3c-1f00-442d-b10a-a2b593f56e85 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:23.944090 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c7b47f3c-1f00-442d-b10a-a2b593f56e85 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:23.945126 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c7b47f3c-1f00-442d-b10a-a2b593f56e85 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:23.946469 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c7b47f3c-1f00-442d-b10a-a2b593f56e85 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:23.947669 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c7b47f3c-1f00-442d-b10a-a2b593f56e85 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:23.948329 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c7b47f3c-1f00-442d-b10a-a2b593f56e85 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:24.165886 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9039b683-5c5a-4bca-8851-361daeb814f0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:24.174613 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9039b683-5c5a-4bca-8851-361daeb814f0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977" status: 200 len: 1275 microversion: 2.1 time: 0.503408 Oct 17 13:54:24.191418 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2020/4157] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:23 2022] GET /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977 => generated 1275 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:54:24.215143 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-16230bc0-d163-4cbe-907f-7bd4cd24e26f tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:24.216130 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-16230bc0-d163-4cbe-907f-7bd4cd24e26f tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] [instance: 3cf7e278-5294-4b2e-9b46-8981392d5764] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:24.231651 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:54:24.233841 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-16230bc0-d163-4cbe-907f-7bd4cd24e26f tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:24.235458 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-16230bc0-d163-4cbe-907f-7bd4cd24e26f tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:24.237406 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-16230bc0-d163-4cbe-907f-7bd4cd24e26f tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:24.239851 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-16230bc0-d163-4cbe-907f-7bd4cd24e26f tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:24.240535 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-16230bc0-d163-4cbe-907f-7bd4cd24e26f tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:24.242328 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-16230bc0-d163-4cbe-907f-7bd4cd24e26f tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:24.258759 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:54:24.414603 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c7b47f3c-1f00-442d-b10a-a2b593f56e85 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bfe589d0784bfc8ed1611c71cd4461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb1624a35d0403c9e5d09a17e79b7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:24.436775 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c7b47f3c-1f00-442d-b10a-a2b593f56e85 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/servers/5fea9fdd-bc16-4923-bbf8-e0909cd3bcda" status: 200 len: 1474 microversion: 2.1 time: 0.551072 Oct 17 13:54:24.450537 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2138/4158] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:23 2022] GET /compute/v2.1/servers/5fea9fdd-bc16-4923-bbf8-e0909cd3bcda => generated 1474 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:24.450537 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-420f02ab-1c50-4e77-9973-04dcfd66f2e0 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:24.450537 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-420f02ab-1c50-4e77-9973-04dcfd66f2e0 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 90bfb179-c8b6-4810-a981-33b78a19b62c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:24.466868 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-420f02ab-1c50-4e77-9973-04dcfd66f2e0 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:24.467832 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-420f02ab-1c50-4e77-9973-04dcfd66f2e0 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:24.468445 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-420f02ab-1c50-4e77-9973-04dcfd66f2e0 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:24.469357 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-420f02ab-1c50-4e77-9973-04dcfd66f2e0 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:24.469918 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-420f02ab-1c50-4e77-9973-04dcfd66f2e0 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:24.470753 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-420f02ab-1c50-4e77-9973-04dcfd66f2e0 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:24.534140 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-420f02ab-1c50-4e77-9973-04dcfd66f2e0 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.094766 Oct 17 13:54:24.535330 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2139/4159] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 13:54:24 2022] GET /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c/os-volume_attachments => generated 25 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:54:24.546183 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4618bb35-593e-4ff2-a37c-532011adcac0 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:24.546921 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4618bb35-593e-4ff2-a37c-532011adcac0 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] [instance: 656925d8-a071-49b4-92b0-b74039bc96dc] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:24.566475 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4618bb35-593e-4ff2-a37c-532011adcac0 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:24.566475 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4618bb35-593e-4ff2-a37c-532011adcac0 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:24.566475 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4618bb35-593e-4ff2-a37c-532011adcac0 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:24.567242 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4618bb35-593e-4ff2-a37c-532011adcac0 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:24.569364 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4618bb35-593e-4ff2-a37c-532011adcac0 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:24.570419 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4618bb35-593e-4ff2-a37c-532011adcac0 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:24.582469 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-16230bc0-d163-4cbe-907f-7bd4cd24e26f tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958ae6fcf04486ba0de669284420b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132e34c2ebdd41548f0915fa502b0c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:24.594164 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-16230bc0-d163-4cbe-907f-7bd4cd24e26f tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9958ae6fcf04486ba0de669284420b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132e34c2ebdd41548f0915fa502b0c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:24.599458 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-16230bc0-d163-4cbe-907f-7bd4cd24e26f tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9958ae6fcf04486ba0de669284420b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132e34c2ebdd41548f0915fa502b0c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:24.603116 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-16230bc0-d163-4cbe-907f-7bd4cd24e26f tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] 10.222.0.79 "GET /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764" status: 200 len: 1362 microversion: 2.26 time: 0.406810 Oct 17 13:54:24.604912 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2021/4160] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:24 2022] GET /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764 => generated 1362 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:54:24.648049 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9f7431d4-7e45-4802-993a-330a1d63ef1c tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:24.648795 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9f7431d4-7e45-4802-993a-330a1d63ef1c tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 90bfb179-c8b6-4810-a981-33b78a19b62c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:24.655938 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f7431d4-7e45-4802-993a-330a1d63ef1c tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:24.656623 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f7431d4-7e45-4802-993a-330a1d63ef1c tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:24.657212 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f7431d4-7e45-4802-993a-330a1d63ef1c tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:24.658069 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f7431d4-7e45-4802-993a-330a1d63ef1c tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:24.658692 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f7431d4-7e45-4802-993a-330a1d63ef1c tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:24.659324 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f7431d4-7e45-4802-993a-330a1d63ef1c tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:24.699908 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9f7431d4-7e45-4802-993a-330a1d63ef1c tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 90bfb179-c8b6-4810-a981-33b78a19b62c] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:54:24.743895 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4618bb35-593e-4ff2-a37c-532011adcac0 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:24.757983 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4618bb35-593e-4ff2-a37c-532011adcac0 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:24.760122 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4618bb35-593e-4ff2-a37c-532011adcac0 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:24.763949 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4618bb35-593e-4ff2-a37c-532011adcac0 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] 10.222.0.79 "GET /compute/v2.1/servers/656925d8-a071-49b4-92b0-b74039bc96dc" status: 200 len: 1366 microversion: 2.57 time: 0.224961 Oct 17 13:54:24.775201 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2140/4161] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:24 2022] GET /compute/v2.1/servers/656925d8-a071-49b4-92b0-b74039bc96dc => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:54:24.784292 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6b198f99-bab6-4c2b-859b-e8904e5d66ee tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:24.786204 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6b198f99-bab6-4c2b-859b-e8904e5d66ee tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] [instance: b54d449b-422b-4ca0-8183-02eb28c30747] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:24.808429 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6b198f99-bab6-4c2b-859b-e8904e5d66ee tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:24.810356 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6b198f99-bab6-4c2b-859b-e8904e5d66ee tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:24.810849 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6b198f99-bab6-4c2b-859b-e8904e5d66ee tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:24.811874 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6b198f99-bab6-4c2b-859b-e8904e5d66ee tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:24.812258 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6b198f99-bab6-4c2b-859b-e8904e5d66ee tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:24.823421 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6b198f99-bab6-4c2b-859b-e8904e5d66ee tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:24.876077 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9f7431d4-7e45-4802-993a-330a1d63ef1c tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "DELETE /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c" status: 204 len: 0 microversion: 2.1 time: 0.231521 Oct 17 13:54:24.877452 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2022/4162] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:54:24 2022] DELETE /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:54:24.890519 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c2b14b0b-8e03-4082-827b-580b6d9db773 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:24.891899 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c2b14b0b-8e03-4082-827b-580b6d9db773 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 90bfb179-c8b6-4810-a981-33b78a19b62c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:24.902729 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c2b14b0b-8e03-4082-827b-580b6d9db773 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:24.903891 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c2b14b0b-8e03-4082-827b-580b6d9db773 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:24.904519 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c2b14b0b-8e03-4082-827b-580b6d9db773 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:24.905478 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c2b14b0b-8e03-4082-827b-580b6d9db773 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:24.906248 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c2b14b0b-8e03-4082-827b-580b6d9db773 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:24.907026 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c2b14b0b-8e03-4082-827b-580b6d9db773 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:25.220451 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6b198f99-bab6-4c2b-859b-e8904e5d66ee tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb634956c1764e508400b08750ecc9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23d1c84c66c43bc9daf9d3028663f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:25.238656 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6b198f99-bab6-4c2b-859b-e8904e5d66ee tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] 10.222.0.79 "GET /compute/v2.1/servers/b54d449b-422b-4ca0-8183-02eb28c30747" status: 200 len: 1314 microversion: 2.1 time: 0.471616 Oct 17 13:54:25.239312 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2141/4163] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:24 2022] GET /compute/v2.1/servers/b54d449b-422b-4ca0-8183-02eb28c30747 => generated 1314 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:25.265354 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-af9485dd-b60a-4423-9f5a-1f9253c9479b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:25.266866 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-af9485dd-b60a-4423-9f5a-1f9253c9479b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 051c9371-d3e2-4166-bed5-c73dc77ec977] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:25.276646 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af9485dd-b60a-4423-9f5a-1f9253c9479b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:25.277068 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c2b14b0b-8e03-4082-827b-580b6d9db773 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:25.277688 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af9485dd-b60a-4423-9f5a-1f9253c9479b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:25.278305 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af9485dd-b60a-4423-9f5a-1f9253c9479b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:25.279241 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af9485dd-b60a-4423-9f5a-1f9253c9479b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:25.279881 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af9485dd-b60a-4423-9f5a-1f9253c9479b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:25.280474 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af9485dd-b60a-4423-9f5a-1f9253c9479b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:25.286239 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c2b14b0b-8e03-4082-827b-580b6d9db773 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c" status: 200 len: 1682 microversion: 2.1 time: 0.402008 Oct 17 13:54:25.289390 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2023/4164] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:24 2022] GET /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c => generated 1682 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:25.410728 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-9fca20ad-7bac-4b48-986a-a1dd2b23ba76 req-b6b6e770-4dd7-421b-acaa-51ef6c0d375c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fea9fdd-bc16-4923-bbf8-e0909cd3bcda", "name": "network-vif-deleted", "tag": "9a6b33a5-082e-4c10-8994-0c42a775e094"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:54:25.432261 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-9fca20ad-7bac-4b48-986a-a1dd2b23ba76 req-b6b6e770-4dd7-421b-acaa-51ef6c0d375c service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:25.432751 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-9fca20ad-7bac-4b48-986a-a1dd2b23ba76 req-b6b6e770-4dd7-421b-acaa-51ef6c0d375c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:25.433391 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-9fca20ad-7bac-4b48-986a-a1dd2b23ba76 req-b6b6e770-4dd7-421b-acaa-51ef6c0d375c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:25.451039 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-9fca20ad-7bac-4b48-986a-a1dd2b23ba76 req-b6b6e770-4dd7-421b-acaa-51ef6c0d375c service nova] Creating event network-vif-deleted:9a6b33a5-082e-4c10-8994-0c42a775e094 for instance 5fea9fdd-bc16-4923-bbf8-e0909cd3bcda on n-h1-854247-14 Oct 17 13:54:25.462513 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-af9485dd-b60a-4423-9f5a-1f9253c9479b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:25.472848 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-af9485dd-b60a-4423-9f5a-1f9253c9479b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977" status: 200 len: 1273 microversion: 2.1 time: 0.230892 Oct 17 13:54:25.473641 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2142/4165] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:25 2022] GET /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977 => generated 1273 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:25.474505 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-9fca20ad-7bac-4b48-986a-a1dd2b23ba76 req-b6b6e770-4dd7-421b-acaa-51ef6c0d375c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067233 Oct 17 13:54:25.475435 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2024/4166] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:54:25.482937 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-bf7f45a3-9318-4432-9d23-49471fdfc141 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:25.483580 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-bf7f45a3-9318-4432-9d23-49471fdfc141 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] [instance: 5fea9fdd-bc16-4923-bbf8-e0909cd3bcda] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:25.490028 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bf7f45a3-9318-4432-9d23-49471fdfc141 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:25.490815 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bf7f45a3-9318-4432-9d23-49471fdfc141 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:25.491568 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bf7f45a3-9318-4432-9d23-49471fdfc141 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:25.492454 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bf7f45a3-9318-4432-9d23-49471fdfc141 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:25.492914 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bf7f45a3-9318-4432-9d23-49471fdfc141 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:25.493431 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bf7f45a3-9318-4432-9d23-49471fdfc141 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:25.526430 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=100 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:54:25.584022 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-bf7f45a3-9318-4432-9d23-49471fdfc141 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bfe589d0784bfc8ed1611c71cd4461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb1624a35d0403c9e5d09a17e79b7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:25.596413 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-bf7f45a3-9318-4432-9d23-49471fdfc141 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/servers/5fea9fdd-bc16-4923-bbf8-e0909cd3bcda" status: 200 len: 1303 microversion: 2.1 time: 0.121547 Oct 17 13:54:25.597588 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2143/4167] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:25 2022] GET /compute/v2.1/servers/5fea9fdd-bc16-4923-bbf8-e0909cd3bcda => generated 1303 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:25.630565 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-377df2fa-9591-45c5-ad4a-ebb19ab6a73a tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:25.631460 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-377df2fa-9591-45c5-ad4a-ebb19ab6a73a tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] [instance: 3cf7e278-5294-4b2e-9b46-8981392d5764] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:25.639105 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-377df2fa-9591-45c5-ad4a-ebb19ab6a73a tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:25.643459 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-377df2fa-9591-45c5-ad4a-ebb19ab6a73a tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:25.659366 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-377df2fa-9591-45c5-ad4a-ebb19ab6a73a tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:25.664338 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-377df2fa-9591-45c5-ad4a-ebb19ab6a73a tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:25.665048 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-377df2fa-9591-45c5-ad4a-ebb19ab6a73a tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:25.666278 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-377df2fa-9591-45c5-ad4a-ebb19ab6a73a tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:25.794220 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9a50bb2c-eb74-4116-9743-4fa60b97da38 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:25.794850 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9a50bb2c-eb74-4116-9743-4fa60b97da38 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] [instance: 656925d8-a071-49b4-92b0-b74039bc96dc] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:25.809904 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9a50bb2c-eb74-4116-9743-4fa60b97da38 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:25.810412 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9a50bb2c-eb74-4116-9743-4fa60b97da38 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:25.810852 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9a50bb2c-eb74-4116-9743-4fa60b97da38 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:25.811608 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9a50bb2c-eb74-4116-9743-4fa60b97da38 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:25.812067 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9a50bb2c-eb74-4116-9743-4fa60b97da38 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:25.812491 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9a50bb2c-eb74-4116-9743-4fa60b97da38 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:26.005853 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9a50bb2c-eb74-4116-9743-4fa60b97da38 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:26.023659 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9a50bb2c-eb74-4116-9743-4fa60b97da38 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:26.031325 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9a50bb2c-eb74-4116-9743-4fa60b97da38 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:26.032101 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-377df2fa-9591-45c5-ad4a-ebb19ab6a73a tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958ae6fcf04486ba0de669284420b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132e34c2ebdd41548f0915fa502b0c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:26.032626 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9a50bb2c-eb74-4116-9743-4fa60b97da38 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] 10.222.0.79 "GET /compute/v2.1/servers/656925d8-a071-49b4-92b0-b74039bc96dc" status: 200 len: 1366 microversion: 2.57 time: 0.242639 Oct 17 13:54:26.039677 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2144/4168] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:25 2022] GET /compute/v2.1/servers/656925d8-a071-49b4-92b0-b74039bc96dc => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:54:26.043938 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-377df2fa-9591-45c5-ad4a-ebb19ab6a73a tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9958ae6fcf04486ba0de669284420b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132e34c2ebdd41548f0915fa502b0c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:26.045718 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-377df2fa-9591-45c5-ad4a-ebb19ab6a73a tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9958ae6fcf04486ba0de669284420b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132e34c2ebdd41548f0915fa502b0c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:26.047431 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-377df2fa-9591-45c5-ad4a-ebb19ab6a73a tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] 10.222.0.79 "GET /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764" status: 200 len: 1362 microversion: 2.26 time: 0.421082 Oct 17 13:54:26.048466 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2025/4169] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:25 2022] GET /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764 => generated 1362 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:54:26.261754 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-81d5ccb3-9fac-46b8-a607-f4b37371ef82 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:26.262370 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-81d5ccb3-9fac-46b8-a607-f4b37371ef82 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] [instance: b54d449b-422b-4ca0-8183-02eb28c30747] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:26.277505 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-81d5ccb3-9fac-46b8-a607-f4b37371ef82 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:26.278455 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-81d5ccb3-9fac-46b8-a607-f4b37371ef82 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:26.285719 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-81d5ccb3-9fac-46b8-a607-f4b37371ef82 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:26.286624 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-81d5ccb3-9fac-46b8-a607-f4b37371ef82 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:26.293096 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-81d5ccb3-9fac-46b8-a607-f4b37371ef82 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:26.297057 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-81d5ccb3-9fac-46b8-a607-f4b37371ef82 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:26.316881 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f942ed62-9228-47fe-9057-7ad8caff5ad6 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:26.317720 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f942ed62-9228-47fe-9057-7ad8caff5ad6 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 90bfb179-c8b6-4810-a981-33b78a19b62c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:26.331982 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f942ed62-9228-47fe-9057-7ad8caff5ad6 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:26.332870 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f942ed62-9228-47fe-9057-7ad8caff5ad6 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:26.333566 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f942ed62-9228-47fe-9057-7ad8caff5ad6 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:26.334399 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f942ed62-9228-47fe-9057-7ad8caff5ad6 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:26.334965 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f942ed62-9228-47fe-9057-7ad8caff5ad6 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:26.336190 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f942ed62-9228-47fe-9057-7ad8caff5ad6 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:26.589925 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-81d5ccb3-9fac-46b8-a607-f4b37371ef82 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb634956c1764e508400b08750ecc9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23d1c84c66c43bc9daf9d3028663f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:26.609854 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-81d5ccb3-9fac-46b8-a607-f4b37371ef82 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] 10.222.0.79 "GET /compute/v2.1/servers/b54d449b-422b-4ca0-8183-02eb28c30747" status: 200 len: 1314 microversion: 2.1 time: 0.351948 Oct 17 13:54:26.610464 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2145/4170] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:26 2022] GET /compute/v2.1/servers/b54d449b-422b-4ca0-8183-02eb28c30747 => generated 1314 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:26.615467 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5305c429-d115-4ff2-8025-914883d88428 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:26.616278 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5305c429-d115-4ff2-8025-914883d88428 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 051c9371-d3e2-4166-bed5-c73dc77ec977] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:26.637053 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5305c429-d115-4ff2-8025-914883d88428 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:26.637760 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5305c429-d115-4ff2-8025-914883d88428 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:26.638356 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5305c429-d115-4ff2-8025-914883d88428 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:26.639273 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5305c429-d115-4ff2-8025-914883d88428 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:26.639877 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5305c429-d115-4ff2-8025-914883d88428 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:26.640446 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5305c429-d115-4ff2-8025-914883d88428 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:26.707220 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f942ed62-9228-47fe-9057-7ad8caff5ad6 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:26.715816 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f942ed62-9228-47fe-9057-7ad8caff5ad6 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c" status: 200 len: 1682 microversion: 2.1 time: 0.403230 Oct 17 13:54:26.734895 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2026/4171] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:26 2022] GET /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c => generated 1682 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:26.734895 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ca089035-1329-49ac-b4e5-9f4bcf10747a tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:26.734895 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ca089035-1329-49ac-b4e5-9f4bcf10747a tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] [instance: 5fea9fdd-bc16-4923-bbf8-e0909cd3bcda] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:26.742696 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ca089035-1329-49ac-b4e5-9f4bcf10747a tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:26.743471 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ca089035-1329-49ac-b4e5-9f4bcf10747a tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:26.744625 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ca089035-1329-49ac-b4e5-9f4bcf10747a tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:26.745807 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ca089035-1329-49ac-b4e5-9f4bcf10747a tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:26.746501 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ca089035-1329-49ac-b4e5-9f4bcf10747a tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:26.747900 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ca089035-1329-49ac-b4e5-9f4bcf10747a tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:26.782537 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-ca089035-1329-49ac-b4e5-9f4bcf10747a tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] HTTP exception thrown: Instance 5fea9fdd-bc16-4923-bbf8-e0909cd3bcda could not be found. Oct 17 13:54:26.787871 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ca089035-1329-49ac-b4e5-9f4bcf10747a tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Request method failure captured: Oct 17 13:54:26.787871 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/5fea9fdd-bc16-4923-bbf8-e0909cd3bcda HTTP/1.1 Oct 17 13:54:26.787871 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:54:26.787871 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:54:26.787871 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:54:26.787871 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:54:26.787871 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:54:26.787871 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:54:26.787871 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:54:26.787871 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:54:26.787871 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTV4IH2a3qOGXTk_dwQZ0Ycm_wPgomL0oTIuWb1BLSpIJHbVi0PFm3_eUMz5hm9uNNNrgBPLVI_0jIJGBwaKzCfNxhBGHd-JF4f7z2RCHqzG0gH5PetbeN1EUab4BhxhIhX0BLRhOUKh7pijA04unL3pjRZaTMZ3CFapZiq3QLEEppvg Oct 17 13:54:26.787871 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:54:26.787871 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:54:26.787871 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:54:26.787871 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:54:26.787871 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:54:26.787871 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:54:26.787871 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 8fb1624a35d0403c9e5d09a17e79b7fb Oct 17 13:54:26.787871 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ListImageFiltersTestJSON-977467871 Oct 17 13:54:26.787871 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:54:26.787871 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:54:26.787871 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8fb1624a35d0403c9e5d09a17e79b7fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8fb1624a35d0403c9e5d09a17e79b7fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8fb1624a35d0403c9e5d09a17e79b7fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8fb1624a35d0403c9e5d09a17e79b7fb", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:54:26.787871 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ListImageFiltersTestJSON-977467871 Oct 17 13:54:26.787871 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 8fb1624a35d0403c9e5d09a17e79b7fb Oct 17 13:54:26.787871 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-977467871 Oct 17 13:54:26.787871 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ListImageFiltersTestJSON-977467871-project Oct 17 13:54:26.787871 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:54:26.787871 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:54:26.787871 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 79bfe589d0784bfc8ed1611c71cd4461 Oct 17 13:54:26.787871 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ListImageFiltersTestJSON-977467871-project Oct 17 13:54:26.787871 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:54:26.787871 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 5fea9fdd-bc16-4923-bbf8-e0909cd3bcda could not be found. Oct 17 13:54:26.787871 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '5fea9fdd-bc16-4923-bbf8-e0909cd3bcda'} Oct 17 13:54:26.787871 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:54:26.787871 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:54:26.787871 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:54:26.787871 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:54:26.787871 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:54:26.787871 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:54:26.787871 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:54:26.787871 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:54:26.787871 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:54:26.787871 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:54:26.787871 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fea9fdd-bc16-4923-bbf8-e0909cd3bcda could not be found. Oct 17 13:54:26.787871 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:26.787871 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:54:26.787871 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:26.787871 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:54:26.787871 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:54:26.787871 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:54:26.787871 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:54:26.787871 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:54:26.787871 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:54:26.787871 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:54:26.787871 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:54:26.787871 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:54:26.787871 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:54:26.787871 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:54:26.787871 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:54:26.787871 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:54:26.787871 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fea9fdd-bc16-4923-bbf8-e0909cd3bcda could not be found. Oct 17 13:54:26.787871 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:26.787871 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:54:26.787871 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:26.792632 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:54:26.792632 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:54:26.792632 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:54:26.792632 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:54:26.792632 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:54:26.792632 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fea9fdd-bc16-4923-bbf8-e0909cd3bcda could not be found. Oct 17 13:54:26.792632 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:26.793522 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ca089035-1329-49ac-b4e5-9f4bcf10747a tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Returning 404 to user: Instance 5fea9fdd-bc16-4923-bbf8-e0909cd3bcda could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:54:26.794711 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ca089035-1329-49ac-b4e5-9f4bcf10747a tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/servers/5fea9fdd-bc16-4923-bbf8-e0909cd3bcda" status: 404 len: 111 microversion: 2.1 time: 0.067892 Oct 17 13:54:26.795049 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2027/4172] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:26 2022] GET /compute/v2.1/servers/5fea9fdd-bc16-4923-bbf8-e0909cd3bcda => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:54:26.808860 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c9a02cae-a3f9-4bac-a75a-4728e2c8208d tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:26.809537 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c9a02cae-a3f9-4bac-a75a-4728e2c8208d tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] [instance: 419a7ac0-9332-481d-bc66-3ad5b6a9db81] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:26.819258 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c9a02cae-a3f9-4bac-a75a-4728e2c8208d tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:26.819898 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c9a02cae-a3f9-4bac-a75a-4728e2c8208d tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:26.820486 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c9a02cae-a3f9-4bac-a75a-4728e2c8208d tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:26.822862 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c9a02cae-a3f9-4bac-a75a-4728e2c8208d tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:26.823545 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c9a02cae-a3f9-4bac-a75a-4728e2c8208d tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:26.824544 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c9a02cae-a3f9-4bac-a75a-4728e2c8208d tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:26.859018 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c9a02cae-a3f9-4bac-a75a-4728e2c8208d tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] [instance: 419a7ac0-9332-481d-bc66-3ad5b6a9db81] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:54:27.025139 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c9a02cae-a3f9-4bac-a75a-4728e2c8208d tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "DELETE /compute/v2.1/servers/419a7ac0-9332-481d-bc66-3ad5b6a9db81" status: 204 len: 0 microversion: 2.1 time: 0.225374 Oct 17 13:54:27.025741 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2028/4173] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:54:26 2022] DELETE /compute/v2.1/servers/419a7ac0-9332-481d-bc66-3ad5b6a9db81 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:54:27.034592 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-512d7855-221c-47e2-a261-b337b65829e7 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:27.035354 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-512d7855-221c-47e2-a261-b337b65829e7 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] [instance: 419a7ac0-9332-481d-bc66-3ad5b6a9db81] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:27.042208 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-512d7855-221c-47e2-a261-b337b65829e7 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:27.042791 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-512d7855-221c-47e2-a261-b337b65829e7 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:27.043281 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-512d7855-221c-47e2-a261-b337b65829e7 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:27.043982 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-512d7855-221c-47e2-a261-b337b65829e7 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:27.044437 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-512d7855-221c-47e2-a261-b337b65829e7 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:27.044860 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-512d7855-221c-47e2-a261-b337b65829e7 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:27.171533 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5305c429-d115-4ff2-8025-914883d88428 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:27.186685 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5305c429-d115-4ff2-8025-914883d88428 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977" status: 200 len: 1315 microversion: 2.1 time: 0.573463 Oct 17 13:54:27.188784 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2146/4174] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:26 2022] GET /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977 => generated 1315 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:27.201975 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-132c89d2-6675-40cc-a616-2c8085cfe8f2 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:27.204631 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-132c89d2-6675-40cc-a616-2c8085cfe8f2 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] [instance: 656925d8-a071-49b4-92b0-b74039bc96dc] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:27.219817 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-132c89d2-6675-40cc-a616-2c8085cfe8f2 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:27.222764 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-132c89d2-6675-40cc-a616-2c8085cfe8f2 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:27.223538 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-132c89d2-6675-40cc-a616-2c8085cfe8f2 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:27.226888 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-132c89d2-6675-40cc-a616-2c8085cfe8f2 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:27.227797 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-132c89d2-6675-40cc-a616-2c8085cfe8f2 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:27.229017 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-132c89d2-6675-40cc-a616-2c8085cfe8f2 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:27.373626 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-132c89d2-6675-40cc-a616-2c8085cfe8f2 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:27.385933 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-132c89d2-6675-40cc-a616-2c8085cfe8f2 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:27.388650 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-132c89d2-6675-40cc-a616-2c8085cfe8f2 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:27.390441 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-132c89d2-6675-40cc-a616-2c8085cfe8f2 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] 10.222.0.79 "GET /compute/v2.1/servers/656925d8-a071-49b4-92b0-b74039bc96dc" status: 200 len: 1366 microversion: 2.57 time: 0.199959 Oct 17 13:54:27.404822 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2147/4175] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:27 2022] GET /compute/v2.1/servers/656925d8-a071-49b4-92b0-b74039bc96dc => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:54:27.421250 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e183ef32-ea2a-4a46-a862-704d70e74d01 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:27.422438 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e183ef32-ea2a-4a46-a862-704d70e74d01 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] [instance: 3cf7e278-5294-4b2e-9b46-8981392d5764] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:27.442152 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e183ef32-ea2a-4a46-a862-704d70e74d01 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:27.442912 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e183ef32-ea2a-4a46-a862-704d70e74d01 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:27.445114 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e183ef32-ea2a-4a46-a862-704d70e74d01 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:27.447010 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e183ef32-ea2a-4a46-a862-704d70e74d01 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:27.447991 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e183ef32-ea2a-4a46-a862-704d70e74d01 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:27.449347 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e183ef32-ea2a-4a46-a862-704d70e74d01 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:27.456730 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-512d7855-221c-47e2-a261-b337b65829e7 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bfe589d0784bfc8ed1611c71cd4461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb1624a35d0403c9e5d09a17e79b7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:27.469945 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-512d7855-221c-47e2-a261-b337b65829e7 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/servers/419a7ac0-9332-481d-bc66-3ad5b6a9db81" status: 200 len: 1472 microversion: 2.1 time: 0.439473 Oct 17 13:54:27.485155 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2029/4176] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:27 2022] GET /compute/v2.1/servers/419a7ac0-9332-481d-bc66-3ad5b6a9db81 => generated 1472 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:27.535120 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a55b148b-d4b9-4c8a-983d-a300bd983096 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:27.535859 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a55b148b-d4b9-4c8a-983d-a300bd983096 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: a2994495-366a-446f-b7a6-16340911e17c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:27.553191 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a55b148b-d4b9-4c8a-983d-a300bd983096 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:27.553893 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a55b148b-d4b9-4c8a-983d-a300bd983096 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:27.554490 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a55b148b-d4b9-4c8a-983d-a300bd983096 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:27.555391 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a55b148b-d4b9-4c8a-983d-a300bd983096 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:27.556066 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a55b148b-d4b9-4c8a-983d-a300bd983096 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:27.556643 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a55b148b-d4b9-4c8a-983d-a300bd983096 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:27.571592 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-a55b148b-d4b9-4c8a-983d-a300bd983096 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] HTTP exception thrown: Instance a2994495-366a-446f-b7a6-16340911e17c could not be found. Oct 17 13:54:27.573697 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a55b148b-d4b9-4c8a-983d-a300bd983096 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Request method failure captured: Oct 17 13:54:27.573697 n-d-854247-14 devstack@n-api.service[127017]: request: DELETE /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c HTTP/1.1 Oct 17 13:54:27.573697 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:54:27.573697 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:54:27.573697 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:54:27.573697 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:54:27.573697 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:54:27.573697 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:54:27.573697 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:54:27.573697 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:54:27.573697 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVzj7ySRjNRGWeLZhuOn9q-1zQEMM4cm4f1Hd3un42c2zlaS1Crq4DnN26vS4u-r9RlLxn9BBcFV2T6QJYLkUmK8IYzpajU2f5b8Nv4JJmW6GJSH7eSOWEJIthN2nve8_TpMYj0RwNzzlkurCU_UZmVG-U7xXVbyvUUBd_Ch7Kacuyc Oct 17 13:54:27.573697 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:54:27.573697 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:54:27.573697 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:54:27.573697 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:54:27.573697 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:54:27.573697 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:54:27.573697 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 11973b8e1d8a4af8add65726e8ba7c83 Oct 17 13:54:27.573697 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-AttachVolumeTestJSON-829991168 Oct 17 13:54:27.573697 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:54:27.573697 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:54:27.573697 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/11973b8e1d8a4af8add65726e8ba7c83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/11973b8e1d8a4af8add65726e8ba7c83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/11973b8e1d8a4af8add65726e8ba7c83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_11973b8e1d8a4af8add65726e8ba7c83", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:54:27.573697 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-AttachVolumeTestJSON-829991168 Oct 17 13:54:27.573697 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 11973b8e1d8a4af8add65726e8ba7c83 Oct 17 13:54:27.573697 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-AttachVolumeTestJSON-829991168 Oct 17 13:54:27.573697 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-AttachVolumeTestJSON-829991168-project Oct 17 13:54:27.573697 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:54:27.573697 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:54:27.573697 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 683d18db860a4d60ab3eeba2a372b2c5 Oct 17 13:54:27.573697 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-AttachVolumeTestJSON-829991168-project Oct 17 13:54:27.573697 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:54:27.573697 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance a2994495-366a-446f-b7a6-16340911e17c could not be found. Oct 17 13:54:27.573697 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'a2994495-366a-446f-b7a6-16340911e17c'} Oct 17 13:54:27.573697 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:54:27.573697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:54:27.573697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:54:27.573697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:54:27.573697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:54:27.573697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:54:27.573697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:54:27.573697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:54:27.573697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:54:27.573697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:54:27.573697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2994495-366a-446f-b7a6-16340911e17c could not be found. Oct 17 13:54:27.573697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:27.573697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:54:27.573697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:27.573697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:54:27.573697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:54:27.573697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:54:27.573697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:54:27.573697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:54:27.573697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:54:27.573697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:54:27.573697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:54:27.573697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:54:27.573697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:54:27.573697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:54:27.573697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:54:27.573697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:54:27.573697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:54:27.573697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:54:27.577513 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2994495-366a-446f-b7a6-16340911e17c could not be found. Oct 17 13:54:27.577513 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:27.577513 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:54:27.577513 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:27.577513 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:54:27.577513 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:54:27.577513 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:54:27.577513 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:54:27.577513 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:54:27.577513 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2994495-366a-446f-b7a6-16340911e17c could not be found. Oct 17 13:54:27.577513 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:27.579257 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a55b148b-d4b9-4c8a-983d-a300bd983096 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Returning 404 to user: Instance a2994495-366a-446f-b7a6-16340911e17c could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:54:27.580333 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a55b148b-d4b9-4c8a-983d-a300bd983096 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c" status: 404 len: 111 microversion: 2.1 time: 0.058755 Oct 17 13:54:27.581427 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2030/4177] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:54:27 2022] DELETE /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:54:27.589744 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bdc74627-d1ac-4742-ab93-407396037732 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:27.591930 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-bdc74627-d1ac-4742-ab93-407396037732 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] [instance: a2994495-366a-446f-b7a6-16340911e17c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:27.604033 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bdc74627-d1ac-4742-ab93-407396037732 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:27.604817 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bdc74627-d1ac-4742-ab93-407396037732 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:27.605321 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bdc74627-d1ac-4742-ab93-407396037732 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:27.606234 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bdc74627-d1ac-4742-ab93-407396037732 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:27.606690 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bdc74627-d1ac-4742-ab93-407396037732 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:27.607112 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bdc74627-d1ac-4742-ab93-407396037732 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:27.631553 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-bdc74627-d1ac-4742-ab93-407396037732 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] HTTP exception thrown: Instance a2994495-366a-446f-b7a6-16340911e17c could not be found. Oct 17 13:54:27.633493 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bdc74627-d1ac-4742-ab93-407396037732 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Request method failure captured: Oct 17 13:54:27.633493 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c HTTP/1.1 Oct 17 13:54:27.633493 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:54:27.633493 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:54:27.633493 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:54:27.633493 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:54:27.633493 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:54:27.633493 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:54:27.633493 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:54:27.633493 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:54:27.633493 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTVzj7ySRjNRGWeLZhuOn9q-1zQEMM4cm4f1Hd3un42c2zlaS1Crq4DnN26vS4u-r9RlLxn9BBcFV2T6QJYLkUmK8IYzpajU2f5b8Nv4JJmW6GJSH7eSOWEJIthN2nve8_TpMYj0RwNzzlkurCU_UZmVG-U7xXVbyvUUBd_Ch7Kacuyc Oct 17 13:54:27.633493 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:54:27.633493 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:54:27.633493 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:54:27.633493 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:54:27.633493 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:54:27.633493 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:54:27.633493 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 11973b8e1d8a4af8add65726e8ba7c83 Oct 17 13:54:27.633493 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-AttachVolumeTestJSON-829991168 Oct 17 13:54:27.633493 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:54:27.633493 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:54:27.633493 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/11973b8e1d8a4af8add65726e8ba7c83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/11973b8e1d8a4af8add65726e8ba7c83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/11973b8e1d8a4af8add65726e8ba7c83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_11973b8e1d8a4af8add65726e8ba7c83", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:54:27.633493 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-AttachVolumeTestJSON-829991168 Oct 17 13:54:27.633493 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 11973b8e1d8a4af8add65726e8ba7c83 Oct 17 13:54:27.633493 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-AttachVolumeTestJSON-829991168 Oct 17 13:54:27.633493 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-AttachVolumeTestJSON-829991168-project Oct 17 13:54:27.633493 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:54:27.633493 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:54:27.633493 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 683d18db860a4d60ab3eeba2a372b2c5 Oct 17 13:54:27.633493 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-AttachVolumeTestJSON-829991168-project Oct 17 13:54:27.633493 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:54:27.633493 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance a2994495-366a-446f-b7a6-16340911e17c could not be found. Oct 17 13:54:27.633493 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'a2994495-366a-446f-b7a6-16340911e17c'} Oct 17 13:54:27.633493 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:54:27.633493 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:54:27.633493 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:54:27.633493 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:54:27.633493 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:54:27.633493 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:54:27.633493 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:54:27.633493 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:54:27.633493 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:54:27.633493 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:54:27.633493 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2994495-366a-446f-b7a6-16340911e17c could not be found. Oct 17 13:54:27.633493 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:27.633493 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:54:27.633493 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:27.633493 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:54:27.633493 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:54:27.633493 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:54:27.633493 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:54:27.633493 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:54:27.633493 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:54:27.633493 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:54:27.633493 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:54:27.633493 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:54:27.633493 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:54:27.633493 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:54:27.633493 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:54:27.633493 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:54:27.633493 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2994495-366a-446f-b7a6-16340911e17c could not be found. Oct 17 13:54:27.633493 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:27.633493 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:54:27.633493 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:27.637239 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:54:27.637239 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:54:27.637239 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:54:27.637239 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:54:27.637239 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:54:27.637239 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2994495-366a-446f-b7a6-16340911e17c could not be found. Oct 17 13:54:27.637239 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:27.639498 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bdc74627-d1ac-4742-ab93-407396037732 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] Returning 404 to user: Instance a2994495-366a-446f-b7a6-16340911e17c could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:54:27.640588 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-bdc74627-d1ac-4742-ab93-407396037732 tempest-AttachVolumeTestJSON-829991168 tempest-AttachVolumeTestJSON-829991168-project] 10.222.0.79 "GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c" status: 404 len: 111 microversion: 2.1 time: 0.054765 Oct 17 13:54:27.641669 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2031/4178] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:27 2022] GET /compute/v2.1/servers/a2994495-366a-446f-b7a6-16340911e17c => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:54:27.649887 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-acbde516-6609-40e0-8d2f-b8a5b9ffa9ce tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:27.650975 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-acbde516-6609-40e0-8d2f-b8a5b9ffa9ce tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] [instance: b54d449b-422b-4ca0-8183-02eb28c30747] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:27.657409 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-acbde516-6609-40e0-8d2f-b8a5b9ffa9ce tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:27.658171 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-acbde516-6609-40e0-8d2f-b8a5b9ffa9ce tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:27.659180 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-acbde516-6609-40e0-8d2f-b8a5b9ffa9ce tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:27.660409 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-acbde516-6609-40e0-8d2f-b8a5b9ffa9ce tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:27.661718 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-acbde516-6609-40e0-8d2f-b8a5b9ffa9ce tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:27.662377 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-acbde516-6609-40e0-8d2f-b8a5b9ffa9ce tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:27.871093 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e183ef32-ea2a-4a46-a862-704d70e74d01 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958ae6fcf04486ba0de669284420b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132e34c2ebdd41548f0915fa502b0c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:27.882194 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e183ef32-ea2a-4a46-a862-704d70e74d01 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9958ae6fcf04486ba0de669284420b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132e34c2ebdd41548f0915fa502b0c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:27.883914 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e183ef32-ea2a-4a46-a862-704d70e74d01 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9958ae6fcf04486ba0de669284420b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132e34c2ebdd41548f0915fa502b0c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:27.890907 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e183ef32-ea2a-4a46-a862-704d70e74d01 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] 10.222.0.79 "GET /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764" status: 200 len: 1362 microversion: 2.26 time: 0.484353 Oct 17 13:54:27.903505 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2148/4179] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:27 2022] GET /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764 => generated 1362 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:54:27.907362 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a26959b9-9daa-435c-82fa-cc5f05820a67 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:27.908403 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a26959b9-9daa-435c-82fa-cc5f05820a67 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 90bfb179-c8b6-4810-a981-33b78a19b62c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:27.916200 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a26959b9-9daa-435c-82fa-cc5f05820a67 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:27.916969 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a26959b9-9daa-435c-82fa-cc5f05820a67 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:27.917581 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a26959b9-9daa-435c-82fa-cc5f05820a67 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:27.918688 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a26959b9-9daa-435c-82fa-cc5f05820a67 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:27.919675 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a26959b9-9daa-435c-82fa-cc5f05820a67 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:27.920391 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a26959b9-9daa-435c-82fa-cc5f05820a67 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:28.202200 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-acbde516-6609-40e0-8d2f-b8a5b9ffa9ce tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb634956c1764e508400b08750ecc9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23d1c84c66c43bc9daf9d3028663f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:28.219971 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-acbde516-6609-40e0-8d2f-b8a5b9ffa9ce tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] 10.222.0.79 "GET /compute/v2.1/servers/b54d449b-422b-4ca0-8183-02eb28c30747" status: 200 len: 1314 microversion: 2.1 time: 0.570956 Oct 17 13:54:28.230571 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2032/4180] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:27 2022] GET /compute/v2.1/servers/b54d449b-422b-4ca0-8183-02eb28c30747 => generated 1314 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:28.235940 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-c4727edc-5c97-4650-9990-7c37094fcc7a req-09abde42-edb5-45eb-a35e-c1da354544fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "051c9371-d3e2-4166-bed5-c73dc77ec977", "tag": "b42d1dd8-cfa2-4ce4-947c-6010f321b0df"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:54:28.260101 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-c4727edc-5c97-4650-9990-7c37094fcc7a req-09abde42-edb5-45eb-a35e-c1da354544fa service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:28.260822 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-c4727edc-5c97-4650-9990-7c37094fcc7a req-09abde42-edb5-45eb-a35e-c1da354544fa service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:28.265531 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-c4727edc-5c97-4650-9990-7c37094fcc7a req-09abde42-edb5-45eb-a35e-c1da354544fa service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:28.317863 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-c4727edc-5c97-4650-9990-7c37094fcc7a req-09abde42-edb5-45eb-a35e-c1da354544fa service nova] Creating event network-changed:b42d1dd8-cfa2-4ce4-947c-6010f321b0df for instance 051c9371-d3e2-4166-bed5-c73dc77ec977 on n-h1-854247-14 Oct 17 13:54:28.337199 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-c4727edc-5c97-4650-9990-7c37094fcc7a req-09abde42-edb5-45eb-a35e-c1da354544fa service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114082 Oct 17 13:54:28.338580 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2033/4181] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:54:28.362876 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a8487446-616b-4ee5-9b54-25134d4e453d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:28.364725 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a8487446-616b-4ee5-9b54-25134d4e453d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 051c9371-d3e2-4166-bed5-c73dc77ec977] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:28.388735 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a8487446-616b-4ee5-9b54-25134d4e453d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:28.392577 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a8487446-616b-4ee5-9b54-25134d4e453d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:28.393579 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a8487446-616b-4ee5-9b54-25134d4e453d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:28.409420 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a8487446-616b-4ee5-9b54-25134d4e453d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:28.410502 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a8487446-616b-4ee5-9b54-25134d4e453d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:28.411265 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a8487446-616b-4ee5-9b54-25134d4e453d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:28.430904 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a26959b9-9daa-435c-82fa-cc5f05820a67 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:28.440063 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a26959b9-9daa-435c-82fa-cc5f05820a67 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c" status: 200 len: 1682 microversion: 2.1 time: 0.547468 Oct 17 13:54:28.440838 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2149/4182] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:27 2022] GET /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c => generated 1682 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:28.445501 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2039c507-720e-4c8b-840a-381041f03f25 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:28.446479 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2039c507-720e-4c8b-840a-381041f03f25 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] [instance: 656925d8-a071-49b4-92b0-b74039bc96dc] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:28.452883 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2039c507-720e-4c8b-840a-381041f03f25 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:28.457230 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2039c507-720e-4c8b-840a-381041f03f25 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:28.457887 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2039c507-720e-4c8b-840a-381041f03f25 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:28.458757 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2039c507-720e-4c8b-840a-381041f03f25 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:28.459858 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2039c507-720e-4c8b-840a-381041f03f25 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:28.460439 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2039c507-720e-4c8b-840a-381041f03f25 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:28.715352 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2039c507-720e-4c8b-840a-381041f03f25 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:28.729346 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2039c507-720e-4c8b-840a-381041f03f25 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:28.731139 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2039c507-720e-4c8b-840a-381041f03f25 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:28.735617 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2039c507-720e-4c8b-840a-381041f03f25 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] 10.222.0.79 "GET /compute/v2.1/servers/656925d8-a071-49b4-92b0-b74039bc96dc" status: 200 len: 1366 microversion: 2.57 time: 0.291883 Oct 17 13:54:28.736940 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2150/4183] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:28 2022] GET /compute/v2.1/servers/656925d8-a071-49b4-92b0-b74039bc96dc => generated 1366 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:54:28.753984 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fce29f95-ff6c-4968-b61b-759d00fcda36 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:28.755259 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-fce29f95-ff6c-4968-b61b-759d00fcda36 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] [instance: 419a7ac0-9332-481d-bc66-3ad5b6a9db81] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:28.768497 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fce29f95-ff6c-4968-b61b-759d00fcda36 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:28.769575 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fce29f95-ff6c-4968-b61b-759d00fcda36 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:28.770719 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fce29f95-ff6c-4968-b61b-759d00fcda36 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:28.771993 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fce29f95-ff6c-4968-b61b-759d00fcda36 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:28.772878 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fce29f95-ff6c-4968-b61b-759d00fcda36 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:28.774786 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fce29f95-ff6c-4968-b61b-759d00fcda36 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:29.435608 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a8487446-616b-4ee5-9b54-25134d4e453d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:29.466846 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a8487446-616b-4ee5-9b54-25134d4e453d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977" status: 200 len: 1315 microversion: 2.1 time: 1.125580 Oct 17 13:54:29.485961 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2034/4184] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:28 2022] GET /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977 => generated 1315 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:29.500633 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-476d6b78-1557-43f5-8aa9-ab2a6d5add2c tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:29.501609 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-476d6b78-1557-43f5-8aa9-ab2a6d5add2c tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] [instance: 3cf7e278-5294-4b2e-9b46-8981392d5764] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:29.513184 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-476d6b78-1557-43f5-8aa9-ab2a6d5add2c tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:29.514419 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-476d6b78-1557-43f5-8aa9-ab2a6d5add2c tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:29.515760 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-476d6b78-1557-43f5-8aa9-ab2a6d5add2c tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:29.516681 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-476d6b78-1557-43f5-8aa9-ab2a6d5add2c tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:29.517285 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-476d6b78-1557-43f5-8aa9-ab2a6d5add2c tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:29.517857 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-476d6b78-1557-43f5-8aa9-ab2a6d5add2c tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:29.798169 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fce29f95-ff6c-4968-b61b-759d00fcda36 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bfe589d0784bfc8ed1611c71cd4461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb1624a35d0403c9e5d09a17e79b7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:29.809431 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fce29f95-ff6c-4968-b61b-759d00fcda36 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/servers/419a7ac0-9332-481d-bc66-3ad5b6a9db81" status: 200 len: 1472 microversion: 2.1 time: 1.071168 Oct 17 13:54:29.810120 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2151/4185] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:28 2022] GET /compute/v2.1/servers/419a7ac0-9332-481d-bc66-3ad5b6a9db81 => generated 1472 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:29.821208 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d237dda7-9e5e-451b-a060-10134584ab42 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:29.822130 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d237dda7-9e5e-451b-a060-10134584ab42 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] [instance: b54d449b-422b-4ca0-8183-02eb28c30747] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:29.831744 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d237dda7-9e5e-451b-a060-10134584ab42 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:29.832238 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d237dda7-9e5e-451b-a060-10134584ab42 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:29.832667 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d237dda7-9e5e-451b-a060-10134584ab42 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:29.833372 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d237dda7-9e5e-451b-a060-10134584ab42 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:29.833998 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d237dda7-9e5e-451b-a060-10134584ab42 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:29.834580 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d237dda7-9e5e-451b-a060-10134584ab42 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:29.969052 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=4 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:54:30.027468 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=12 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:54:30.122345 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-476d6b78-1557-43f5-8aa9-ab2a6d5add2c tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958ae6fcf04486ba0de669284420b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132e34c2ebdd41548f0915fa502b0c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:30.136809 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-476d6b78-1557-43f5-8aa9-ab2a6d5add2c tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9958ae6fcf04486ba0de669284420b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132e34c2ebdd41548f0915fa502b0c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:30.138706 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-476d6b78-1557-43f5-8aa9-ab2a6d5add2c tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9958ae6fcf04486ba0de669284420b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132e34c2ebdd41548f0915fa502b0c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:30.140152 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-476d6b78-1557-43f5-8aa9-ab2a6d5add2c tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] 10.222.0.79 "GET /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764" status: 200 len: 1362 microversion: 2.26 time: 0.650216 Oct 17 13:54:30.141420 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2035/4186] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:29 2022] GET /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764 => generated 1362 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:54:30.147735 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8d2c7037-03a0-4b2a-8ff2-ea170e72ea8a tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:30.148788 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8d2c7037-03a0-4b2a-8ff2-ea170e72ea8a tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 90bfb179-c8b6-4810-a981-33b78a19b62c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:30.157457 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8d2c7037-03a0-4b2a-8ff2-ea170e72ea8a tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:30.158556 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8d2c7037-03a0-4b2a-8ff2-ea170e72ea8a tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:30.159895 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8d2c7037-03a0-4b2a-8ff2-ea170e72ea8a tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:30.161199 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8d2c7037-03a0-4b2a-8ff2-ea170e72ea8a tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:30.161892 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8d2c7037-03a0-4b2a-8ff2-ea170e72ea8a tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:30.163531 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8d2c7037-03a0-4b2a-8ff2-ea170e72ea8a tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:30.344492 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8d2c7037-03a0-4b2a-8ff2-ea170e72ea8a tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:30.358465 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8d2c7037-03a0-4b2a-8ff2-ea170e72ea8a tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c" status: 200 len: 1614 microversion: 2.1 time: 0.215466 Oct 17 13:54:30.359442 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2036/4187] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:30 2022] GET /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c => generated 1614 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:30.365130 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a5d7a4f9-e6a5-4f71-bbbe-009ce17aab77 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:30.366306 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a5d7a4f9-e6a5-4f71-bbbe-009ce17aab77 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] [instance: 656925d8-a071-49b4-92b0-b74039bc96dc] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:30.377786 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a5d7a4f9-e6a5-4f71-bbbe-009ce17aab77 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:30.378560 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a5d7a4f9-e6a5-4f71-bbbe-009ce17aab77 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:30.378719 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a5d7a4f9-e6a5-4f71-bbbe-009ce17aab77 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:30.379487 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a5d7a4f9-e6a5-4f71-bbbe-009ce17aab77 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:30.379938 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a5d7a4f9-e6a5-4f71-bbbe-009ce17aab77 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:30.380367 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a5d7a4f9-e6a5-4f71-bbbe-009ce17aab77 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:30.421233 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d237dda7-9e5e-451b-a060-10134584ab42 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb634956c1764e508400b08750ecc9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23d1c84c66c43bc9daf9d3028663f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:30.434284 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d237dda7-9e5e-451b-a060-10134584ab42 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] 10.222.0.79 "GET /compute/v2.1/servers/b54d449b-422b-4ca0-8183-02eb28c30747" status: 200 len: 1314 microversion: 2.1 time: 0.622940 Oct 17 13:54:30.435191 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2152/4188] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:29 2022] GET /compute/v2.1/servers/b54d449b-422b-4ca0-8183-02eb28c30747 => generated 1314 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:30.525641 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a5d7a4f9-e6a5-4f71-bbbe-009ce17aab77 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:30.532753 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:54:30.551080 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a5d7a4f9-e6a5-4f71-bbbe-009ce17aab77 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:30.557213 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a5d7a4f9-e6a5-4f71-bbbe-009ce17aab77 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:30.558694 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a5d7a4f9-e6a5-4f71-bbbe-009ce17aab77 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] 10.222.0.79 "GET /compute/v2.1/servers/656925d8-a071-49b4-92b0-b74039bc96dc" status: 200 len: 1366 microversion: 2.57 time: 0.197761 Oct 17 13:54:30.559453 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2037/4189] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:30 2022] GET /compute/v2.1/servers/656925d8-a071-49b4-92b0-b74039bc96dc => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:54:30.572401 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c0e2bae5-e3e1-4490-95b7-e592a7515297 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:30.575934 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c0e2bae5-e3e1-4490-95b7-e592a7515297 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 051c9371-d3e2-4166-bed5-c73dc77ec977] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:30.594407 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c0e2bae5-e3e1-4490-95b7-e592a7515297 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:30.595110 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c0e2bae5-e3e1-4490-95b7-e592a7515297 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:30.596162 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c0e2bae5-e3e1-4490-95b7-e592a7515297 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:30.597127 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c0e2bae5-e3e1-4490-95b7-e592a7515297 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:30.597819 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c0e2bae5-e3e1-4490-95b7-e592a7515297 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:30.598410 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c0e2bae5-e3e1-4490-95b7-e592a7515297 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:30.650649 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-e419d2e1-6546-41d1-835f-c649624f41f2 req-4ad2b5db-10f6-49c5-9b04-e1d6615aef71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cf7e278-5294-4b2e-9b46-8981392d5764", "name": "network-vif-plugged", "status": "completed", "tag": "5f311b5b-8ecb-49ae-8938-b8137f8c070a"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:54:30.692962 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-e419d2e1-6546-41d1-835f-c649624f41f2 req-4ad2b5db-10f6-49c5-9b04-e1d6615aef71 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:30.698321 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-e419d2e1-6546-41d1-835f-c649624f41f2 req-4ad2b5db-10f6-49c5-9b04-e1d6615aef71 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:30.700610 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-e419d2e1-6546-41d1-835f-c649624f41f2 req-4ad2b5db-10f6-49c5-9b04-e1d6615aef71 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:30.726509 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-e419d2e1-6546-41d1-835f-c649624f41f2 req-4ad2b5db-10f6-49c5-9b04-e1d6615aef71 service nova] Creating event network-vif-plugged:5f311b5b-8ecb-49ae-8938-b8137f8c070a for instance 3cf7e278-5294-4b2e-9b46-8981392d5764 on n-h2-854247-14 Oct 17 13:54:30.738013 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-e419d2e1-6546-41d1-835f-c649624f41f2 req-4ad2b5db-10f6-49c5-9b04-e1d6615aef71 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.281131 Oct 17 13:54:30.751015 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2153/4190] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:54:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:54:30.766704 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-37d9987e-c367-4c51-b550-94a15530c0e3 req-54dc32ce-4064-4ff8-9744-20156b182d86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90bfb179-c8b6-4810-a981-33b78a19b62c", "name": "network-vif-deleted", "tag": "04de9280-0f5a-42ac-a484-a51a7ba1e205"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:54:30.793701 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-37d9987e-c367-4c51-b550-94a15530c0e3 req-54dc32ce-4064-4ff8-9744-20156b182d86 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:30.795442 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-37d9987e-c367-4c51-b550-94a15530c0e3 req-54dc32ce-4064-4ff8-9744-20156b182d86 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:30.796550 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-37d9987e-c367-4c51-b550-94a15530c0e3 req-54dc32ce-4064-4ff8-9744-20156b182d86 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:30.829227 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-37d9987e-c367-4c51-b550-94a15530c0e3 req-54dc32ce-4064-4ff8-9744-20156b182d86 service nova] Creating event network-vif-deleted:04de9280-0f5a-42ac-a484-a51a7ba1e205 for instance 90bfb179-c8b6-4810-a981-33b78a19b62c on n-h2-854247-14 Oct 17 13:54:30.835151 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-37d9987e-c367-4c51-b550-94a15530c0e3 req-54dc32ce-4064-4ff8-9744-20156b182d86 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082214 Oct 17 13:54:30.836034 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2154/4191] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:54:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:54:30.841770 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3fb4ea07-b680-4494-9e9f-8b90177dc832 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:30.842721 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3fb4ea07-b680-4494-9e9f-8b90177dc832 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] [instance: 419a7ac0-9332-481d-bc66-3ad5b6a9db81] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:30.849149 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3fb4ea07-b680-4494-9e9f-8b90177dc832 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:30.849640 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3fb4ea07-b680-4494-9e9f-8b90177dc832 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:30.850076 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3fb4ea07-b680-4494-9e9f-8b90177dc832 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:30.850995 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3fb4ea07-b680-4494-9e9f-8b90177dc832 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:30.851477 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3fb4ea07-b680-4494-9e9f-8b90177dc832 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:30.851908 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3fb4ea07-b680-4494-9e9f-8b90177dc832 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:30.917046 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=20 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:54:31.235416 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c0e2bae5-e3e1-4490-95b7-e592a7515297 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:31.244957 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c0e2bae5-e3e1-4490-95b7-e592a7515297 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977" status: 200 len: 1315 microversion: 2.1 time: 0.680363 Oct 17 13:54:31.269204 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2038/4192] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:30 2022] GET /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977 => generated 1315 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:31.275220 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-963cacec-3edf-4e7c-aa20-4bb25dcd0c84 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:31.276257 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-963cacec-3edf-4e7c-aa20-4bb25dcd0c84 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] [instance: 3cf7e278-5294-4b2e-9b46-8981392d5764] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:31.298474 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-963cacec-3edf-4e7c-aa20-4bb25dcd0c84 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:31.299696 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-963cacec-3edf-4e7c-aa20-4bb25dcd0c84 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:31.300643 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-963cacec-3edf-4e7c-aa20-4bb25dcd0c84 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:31.301859 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-963cacec-3edf-4e7c-aa20-4bb25dcd0c84 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:31.302962 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-963cacec-3edf-4e7c-aa20-4bb25dcd0c84 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:31.304086 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-963cacec-3edf-4e7c-aa20-4bb25dcd0c84 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:31.483441 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3fb4ea07-b680-4494-9e9f-8b90177dc832 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bfe589d0784bfc8ed1611c71cd4461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb1624a35d0403c9e5d09a17e79b7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:31.497678 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3fb4ea07-b680-4494-9e9f-8b90177dc832 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/servers/419a7ac0-9332-481d-bc66-3ad5b6a9db81" status: 200 len: 1472 microversion: 2.1 time: 0.659960 Oct 17 13:54:31.498533 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2155/4193] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:30 2022] GET /compute/v2.1/servers/419a7ac0-9332-481d-bc66-3ad5b6a9db81 => generated 1472 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:31.553269 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c020ce2a-05f6-4e9f-a20a-e7cc8253c954 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:31.553905 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c020ce2a-05f6-4e9f-a20a-e7cc8253c954 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 90bfb179-c8b6-4810-a981-33b78a19b62c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:31.561661 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c020ce2a-05f6-4e9f-a20a-e7cc8253c954 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:31.562158 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c020ce2a-05f6-4e9f-a20a-e7cc8253c954 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:31.563666 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c020ce2a-05f6-4e9f-a20a-e7cc8253c954 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:31.563666 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c020ce2a-05f6-4e9f-a20a-e7cc8253c954 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:31.564121 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c020ce2a-05f6-4e9f-a20a-e7cc8253c954 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:31.564548 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c020ce2a-05f6-4e9f-a20a-e7cc8253c954 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:31.607537 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c020ce2a-05f6-4e9f-a20a-e7cc8253c954 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:31.608031 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c020ce2a-05f6-4e9f-a20a-e7cc8253c954 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:31.608650 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c020ce2a-05f6-4e9f-a20a-e7cc8253c954 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:31.609260 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-c020ce2a-05f6-4e9f-a20a-e7cc8253c954 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lazy-loading 'fault' on Instance uuid 90bfb179-c8b6-4810-a981-33b78a19b62c {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:54:32.020556 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c020ce2a-05f6-4e9f-a20a-e7cc8253c954 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7a7b9b048234fd2926739e3f08400b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4acd31ce63b64ac3a05b76d4a9fdf7c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:32.031545 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c020ce2a-05f6-4e9f-a20a-e7cc8253c954 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c" status: 200 len: 1331 microversion: 2.1 time: 0.515633 Oct 17 13:54:32.032531 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2156/4194] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:31 2022] GET /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c => generated 1331 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:32.053533 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-403bcecf-3296-44d4-aeab-69019402bc9b tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:32.054181 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-403bcecf-3296-44d4-aeab-69019402bc9b tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] [instance: b54d449b-422b-4ca0-8183-02eb28c30747] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:32.066726 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-403bcecf-3296-44d4-aeab-69019402bc9b tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:32.067284 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-403bcecf-3296-44d4-aeab-69019402bc9b tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:32.067725 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-403bcecf-3296-44d4-aeab-69019402bc9b tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:32.075234 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-403bcecf-3296-44d4-aeab-69019402bc9b tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:32.076430 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-403bcecf-3296-44d4-aeab-69019402bc9b tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:32.080546 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-403bcecf-3296-44d4-aeab-69019402bc9b tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:32.125674 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-963cacec-3edf-4e7c-aa20-4bb25dcd0c84 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958ae6fcf04486ba0de669284420b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132e34c2ebdd41548f0915fa502b0c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:32.138973 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-963cacec-3edf-4e7c-aa20-4bb25dcd0c84 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9958ae6fcf04486ba0de669284420b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132e34c2ebdd41548f0915fa502b0c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:32.144014 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-963cacec-3edf-4e7c-aa20-4bb25dcd0c84 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9958ae6fcf04486ba0de669284420b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132e34c2ebdd41548f0915fa502b0c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:32.145556 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-963cacec-3edf-4e7c-aa20-4bb25dcd0c84 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] 10.222.0.79 "GET /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764" status: 200 len: 1362 microversion: 2.26 time: 0.875117 Oct 17 13:54:32.147274 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2039/4195] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:31 2022] GET /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764 => generated 1362 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:54:32.159390 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b42791c5-5a76-4057-be57-f9029b852c8f tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:32.160666 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b42791c5-5a76-4057-be57-f9029b852c8f tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] [instance: 656925d8-a071-49b4-92b0-b74039bc96dc] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:32.167904 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b42791c5-5a76-4057-be57-f9029b852c8f tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:32.168538 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b42791c5-5a76-4057-be57-f9029b852c8f tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:32.169280 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b42791c5-5a76-4057-be57-f9029b852c8f tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:32.170202 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b42791c5-5a76-4057-be57-f9029b852c8f tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:32.170866 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b42791c5-5a76-4057-be57-f9029b852c8f tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:32.171723 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b42791c5-5a76-4057-be57-f9029b852c8f tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:32.286851 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b42791c5-5a76-4057-be57-f9029b852c8f tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:32.309536 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b42791c5-5a76-4057-be57-f9029b852c8f tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:32.310977 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b42791c5-5a76-4057-be57-f9029b852c8f tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:32.312217 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b42791c5-5a76-4057-be57-f9029b852c8f tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] 10.222.0.79 "GET /compute/v2.1/servers/656925d8-a071-49b4-92b0-b74039bc96dc" status: 200 len: 1366 microversion: 2.57 time: 0.163776 Oct 17 13:54:32.313588 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2040/4196] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:32 2022] GET /compute/v2.1/servers/656925d8-a071-49b4-92b0-b74039bc96dc => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:54:32.318643 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d038e889-f421-43ec-9a99-67b788d96da4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:32.319453 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d038e889-f421-43ec-9a99-67b788d96da4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 051c9371-d3e2-4166-bed5-c73dc77ec977] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:32.326223 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d038e889-f421-43ec-9a99-67b788d96da4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:32.326903 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d038e889-f421-43ec-9a99-67b788d96da4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:32.327568 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d038e889-f421-43ec-9a99-67b788d96da4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:32.328421 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d038e889-f421-43ec-9a99-67b788d96da4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:32.329062 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d038e889-f421-43ec-9a99-67b788d96da4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:32.330322 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d038e889-f421-43ec-9a99-67b788d96da4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:32.529523 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-403bcecf-3296-44d4-aeab-69019402bc9b tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb634956c1764e508400b08750ecc9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23d1c84c66c43bc9daf9d3028663f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:32.538673 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-403bcecf-3296-44d4-aeab-69019402bc9b tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] 10.222.0.79 "GET /compute/v2.1/servers/b54d449b-422b-4ca0-8183-02eb28c30747" status: 200 len: 1314 microversion: 2.1 time: 0.489190 Oct 17 13:54:32.539694 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2157/4197] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:32 2022] GET /compute/v2.1/servers/b54d449b-422b-4ca0-8183-02eb28c30747 => generated 1314 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:32.545587 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d4e097ef-3885-4696-9dfe-68b253e131ba tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:32.546195 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d4e097ef-3885-4696-9dfe-68b253e131ba tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] [instance: 419a7ac0-9332-481d-bc66-3ad5b6a9db81] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:32.552375 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d4e097ef-3885-4696-9dfe-68b253e131ba tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:32.553220 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d4e097ef-3885-4696-9dfe-68b253e131ba tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:32.561343 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d4e097ef-3885-4696-9dfe-68b253e131ba tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:32.562215 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d4e097ef-3885-4696-9dfe-68b253e131ba tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:32.563218 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d4e097ef-3885-4696-9dfe-68b253e131ba tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:32.564090 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d4e097ef-3885-4696-9dfe-68b253e131ba tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:32.615685 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d038e889-f421-43ec-9a99-67b788d96da4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:32.622011 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d4e097ef-3885-4696-9dfe-68b253e131ba tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:32.622526 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d4e097ef-3885-4696-9dfe-68b253e131ba tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:32.622952 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d4e097ef-3885-4696-9dfe-68b253e131ba tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:32.623440 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-d4e097ef-3885-4696-9dfe-68b253e131ba tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lazy-loading 'fault' on Instance uuid 419a7ac0-9332-481d-bc66-3ad5b6a9db81 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:54:32.625631 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d038e889-f421-43ec-9a99-67b788d96da4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977" status: 200 len: 1315 microversion: 2.1 time: 0.310823 Oct 17 13:54:32.639578 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2041/4198] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:32 2022] GET /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977 => generated 1315 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:32.723581 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d4e097ef-3885-4696-9dfe-68b253e131ba tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79bfe589d0784bfc8ed1611c71cd4461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb1624a35d0403c9e5d09a17e79b7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:32.733620 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d4e097ef-3885-4696-9dfe-68b253e131ba tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/servers/419a7ac0-9332-481d-bc66-3ad5b6a9db81" status: 200 len: 1307 microversion: 2.1 time: 0.192244 Oct 17 13:54:32.736951 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2158/4199] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:32 2022] GET /compute/v2.1/servers/419a7ac0-9332-481d-bc66-3ad5b6a9db81 => generated 1307 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:32.826855 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-fb6692b2-371f-40f5-be4f-a04fca37ad46 req-d374518f-a893-456a-8ace-a97fe24e202c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b54d449b-422b-4ca0-8183-02eb28c30747", "name": "network-vif-plugged", "status": "completed", "tag": "84634b90-4e9f-4e18-95d8-de0aeebec3e7"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:54:32.848400 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-fb6692b2-371f-40f5-be4f-a04fca37ad46 req-d374518f-a893-456a-8ace-a97fe24e202c service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:32.850668 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-fb6692b2-371f-40f5-be4f-a04fca37ad46 req-d374518f-a893-456a-8ace-a97fe24e202c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:32.851386 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-fb6692b2-371f-40f5-be4f-a04fca37ad46 req-d374518f-a893-456a-8ace-a97fe24e202c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:32.874114 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-fb6692b2-371f-40f5-be4f-a04fca37ad46 req-d374518f-a893-456a-8ace-a97fe24e202c service nova] Creating event network-vif-plugged:84634b90-4e9f-4e18-95d8-de0aeebec3e7 for instance b54d449b-422b-4ca0-8183-02eb28c30747 on n-h1-854247-14 Oct 17 13:54:32.894647 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-fb6692b2-371f-40f5-be4f-a04fca37ad46 req-d374518f-a893-456a-8ace-a97fe24e202c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072266 Oct 17 13:54:32.895674 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2042/4200] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:54:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:54:32.912513 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-a4e52745-8fcb-4679-8e53-837fadbd6a78 req-5766a4b3-5b5e-4e3b-9247-f622a637ddff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "419a7ac0-9332-481d-bc66-3ad5b6a9db81", "name": "network-vif-deleted", "tag": "8c4e8542-c161-4443-8115-64e41c66a3fe"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:54:32.927096 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-a4e52745-8fcb-4679-8e53-837fadbd6a78 req-5766a4b3-5b5e-4e3b-9247-f622a637ddff service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:32.928775 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-a4e52745-8fcb-4679-8e53-837fadbd6a78 req-5766a4b3-5b5e-4e3b-9247-f622a637ddff service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:32.929584 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-a4e52745-8fcb-4679-8e53-837fadbd6a78 req-5766a4b3-5b5e-4e3b-9247-f622a637ddff service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:32.960400 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-a4e52745-8fcb-4679-8e53-837fadbd6a78 req-5766a4b3-5b5e-4e3b-9247-f622a637ddff service nova] Creating event network-vif-deleted:8c4e8542-c161-4443-8115-64e41c66a3fe for instance 419a7ac0-9332-481d-bc66-3ad5b6a9db81 on n-h2-854247-14 Oct 17 13:54:32.967787 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-a4e52745-8fcb-4679-8e53-837fadbd6a78 req-5766a4b3-5b5e-4e3b-9247-f622a637ddff service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060349 Oct 17 13:54:32.968772 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2159/4201] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:54:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:54:33.069517 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-32341ba4-13fc-43c4-a927-123a3c93632d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:33.074173 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-32341ba4-13fc-43c4-a927-123a3c93632d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 90bfb179-c8b6-4810-a981-33b78a19b62c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:33.092621 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-32341ba4-13fc-43c4-a927-123a3c93632d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:33.093315 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-32341ba4-13fc-43c4-a927-123a3c93632d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:33.093829 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-32341ba4-13fc-43c4-a927-123a3c93632d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:33.094711 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-32341ba4-13fc-43c4-a927-123a3c93632d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:33.095444 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-32341ba4-13fc-43c4-a927-123a3c93632d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:33.096444 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-32341ba4-13fc-43c4-a927-123a3c93632d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:33.115814 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-32341ba4-13fc-43c4-a927-123a3c93632d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] HTTP exception thrown: Instance 90bfb179-c8b6-4810-a981-33b78a19b62c could not be found. Oct 17 13:54:33.118744 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-32341ba4-13fc-43c4-a927-123a3c93632d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Request method failure captured: Oct 17 13:54:33.118744 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c HTTP/1.1 Oct 17 13:54:33.118744 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:54:33.118744 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:54:33.118744 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:54:33.118744 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:54:33.118744 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:54:33.118744 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:54:33.118744 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:54:33.118744 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:54:33.118744 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTV0JL7NQSDQqh4ZMvkCDXT2fwovcCgk-nxK1nRG4B-HeC5OA7y2_TQv_yPRGTaQ-3zvHufQBJMrO1ZhsIWZZ0ugPMuvlokQmhLWi-H9zySFSYK0iM1qNABohwKQ4S7v-F2ZGFUB1jMKnP05ShlKiL4M8_7Jns7W8GDQtoUfjwQ0M1Lk Oct 17 13:54:33.118744 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:54:33.118744 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:54:33.118744 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:54:33.118744 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:54:33.118744 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:54:33.118744 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:54:33.118744 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 4acd31ce63b64ac3a05b76d4a9fdf7c0 Oct 17 13:54:33.118744 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-AttachVolumeNegativeTest-1792618646 Oct 17 13:54:33.118744 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:54:33.118744 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:54:33.118744 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4acd31ce63b64ac3a05b76d4a9fdf7c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4acd31ce63b64ac3a05b76d4a9fdf7c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4acd31ce63b64ac3a05b76d4a9fdf7c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4acd31ce63b64ac3a05b76d4a9fdf7c0", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:54:33.118744 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-AttachVolumeNegativeTest-1792618646 Oct 17 13:54:33.118744 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 4acd31ce63b64ac3a05b76d4a9fdf7c0 Oct 17 13:54:33.118744 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1792618646 Oct 17 13:54:33.118744 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-AttachVolumeNegativeTest-1792618646-project Oct 17 13:54:33.118744 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:54:33.118744 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:54:33.118744 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: c7a7b9b048234fd2926739e3f08400b0 Oct 17 13:54:33.118744 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-AttachVolumeNegativeTest-1792618646-project Oct 17 13:54:33.118744 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:54:33.118744 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 90bfb179-c8b6-4810-a981-33b78a19b62c could not be found. Oct 17 13:54:33.118744 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '90bfb179-c8b6-4810-a981-33b78a19b62c'} Oct 17 13:54:33.118744 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:54:33.118744 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:54:33.118744 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:54:33.118744 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:54:33.118744 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:54:33.118744 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:54:33.118744 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:54:33.118744 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:54:33.118744 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:54:33.118744 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:54:33.118744 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90bfb179-c8b6-4810-a981-33b78a19b62c could not be found. Oct 17 13:54:33.118744 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:33.118744 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:54:33.118744 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:33.118744 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:54:33.118744 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:54:33.118744 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:54:33.118744 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:54:33.118744 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:54:33.118744 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:54:33.118744 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:54:33.118744 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:54:33.118744 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:54:33.118744 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:54:33.118744 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:54:33.118744 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:54:33.118744 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:54:33.118744 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90bfb179-c8b6-4810-a981-33b78a19b62c could not be found. Oct 17 13:54:33.118744 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:33.118744 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:54:33.118744 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:33.122605 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:54:33.122605 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:54:33.122605 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:54:33.122605 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:54:33.122605 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:54:33.122605 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90bfb179-c8b6-4810-a981-33b78a19b62c could not be found. Oct 17 13:54:33.122605 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:33.122605 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-32341ba4-13fc-43c4-a927-123a3c93632d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Returning 404 to user: Instance 90bfb179-c8b6-4810-a981-33b78a19b62c could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:54:33.122605 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-32341ba4-13fc-43c4-a927-123a3c93632d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c" status: 404 len: 111 microversion: 2.1 time: 0.059915 Oct 17 13:54:33.125900 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2043/4202] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:33 2022] GET /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:54:33.135567 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-98d05439-b07c-4d7c-876c-c95c8953ca84 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '.version_select at 0x7f7cd42dd0d0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:33.159609 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-98d05439-b07c-4d7c-876c-c95c8953ca84 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-344482103" status: 202 len: 0 microversion: 2.1 time: 0.031729 Oct 17 13:54:33.162124 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2160/4203] 10.222.0.79 () {58 vars in 1218 bytes} [Mon Oct 17 13:54:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-344482103 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:54:33.179048 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-793571af-200a-4660-b2bd-30fa27277283 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:33.183842 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-793571af-200a-4660-b2bd-30fa27277283 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] [instance: 3cf7e278-5294-4b2e-9b46-8981392d5764] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:33.194243 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-793571af-200a-4660-b2bd-30fa27277283 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:33.195625 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-793571af-200a-4660-b2bd-30fa27277283 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:33.196315 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-793571af-200a-4660-b2bd-30fa27277283 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:33.197473 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-793571af-200a-4660-b2bd-30fa27277283 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:33.200066 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-793571af-200a-4660-b2bd-30fa27277283 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:33.205348 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-793571af-200a-4660-b2bd-30fa27277283 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:33.365505 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4743fe8c-50b0-477a-8dbe-54977a97925d tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:33.372411 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4743fe8c-50b0-477a-8dbe-54977a97925d tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] [instance: 656925d8-a071-49b4-92b0-b74039bc96dc] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:33.390492 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4743fe8c-50b0-477a-8dbe-54977a97925d tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:33.390985 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4743fe8c-50b0-477a-8dbe-54977a97925d tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:33.391449 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4743fe8c-50b0-477a-8dbe-54977a97925d tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:33.397055 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4743fe8c-50b0-477a-8dbe-54977a97925d tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:33.398285 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4743fe8c-50b0-477a-8dbe-54977a97925d tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:33.400141 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4743fe8c-50b0-477a-8dbe-54977a97925d tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:33.542310 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4743fe8c-50b0-477a-8dbe-54977a97925d tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:33.557945 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-793571af-200a-4660-b2bd-30fa27277283 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958ae6fcf04486ba0de669284420b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132e34c2ebdd41548f0915fa502b0c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:33.562227 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4743fe8c-50b0-477a-8dbe-54977a97925d tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:33.574280 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4743fe8c-50b0-477a-8dbe-54977a97925d tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:33.578922 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4743fe8c-50b0-477a-8dbe-54977a97925d tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] 10.222.0.79 "GET /compute/v2.1/servers/656925d8-a071-49b4-92b0-b74039bc96dc" status: 200 len: 1366 microversion: 2.57 time: 0.235384 Oct 17 13:54:33.579760 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2161/4204] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:33 2022] GET /compute/v2.1/servers/656925d8-a071-49b4-92b0-b74039bc96dc => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:54:33.580869 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-793571af-200a-4660-b2bd-30fa27277283 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9958ae6fcf04486ba0de669284420b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132e34c2ebdd41548f0915fa502b0c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:33.582389 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-793571af-200a-4660-b2bd-30fa27277283 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9958ae6fcf04486ba0de669284420b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132e34c2ebdd41548f0915fa502b0c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:33.587317 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-793571af-200a-4660-b2bd-30fa27277283 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] 10.222.0.79 "GET /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764" status: 200 len: 1545 microversion: 2.26 time: 0.415347 Oct 17 13:54:33.589023 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2044/4205] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:33 2022] GET /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764 => generated 1545 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:54:33.591805 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-505d2683-c012-44d6-84fe-5d4d0780cdcd tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:33.592489 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-505d2683-c012-44d6-84fe-5d4d0780cdcd tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] [instance: b54d449b-422b-4ca0-8183-02eb28c30747] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:33.606554 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-505d2683-c012-44d6-84fe-5d4d0780cdcd tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:33.622074 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-505d2683-c012-44d6-84fe-5d4d0780cdcd tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:33.622514 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-505d2683-c012-44d6-84fe-5d4d0780cdcd tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:33.623294 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-505d2683-c012-44d6-84fe-5d4d0780cdcd tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:33.623748 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-505d2683-c012-44d6-84fe-5d4d0780cdcd tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:33.625476 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-505d2683-c012-44d6-84fe-5d4d0780cdcd tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:33.626544 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-07009592-83ca-4de6-8110-2e4fb9146a32 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Calling method '.version_select at 0x7f7cd615fee0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:33.644875 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-07009592-83ca-4de6-8110-2e4fb9146a32 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:33.645372 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-07009592-83ca-4de6-8110-2e4fb9146a32 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:33.645983 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-07009592-83ca-4de6-8110-2e4fb9146a32 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:33.646667 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-07009592-83ca-4de6-8110-2e4fb9146a32 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] [instance: 3cf7e278-5294-4b2e-9b46-8981392d5764] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:33.654806 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-07009592-83ca-4de6-8110-2e4fb9146a32 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:33.655550 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-07009592-83ca-4de6-8110-2e4fb9146a32 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:33.657494 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-07009592-83ca-4de6-8110-2e4fb9146a32 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:33.657892 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=100 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:54:33.659482 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-07009592-83ca-4de6-8110-2e4fb9146a32 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:33.660274 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-07009592-83ca-4de6-8110-2e4fb9146a32 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:33.660707 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-07009592-83ca-4de6-8110-2e4fb9146a32 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:33.695535 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-07009592-83ca-4de6-8110-2e4fb9146a32 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:33.697108 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-07009592-83ca-4de6-8110-2e4fb9146a32 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:33.697570 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-07009592-83ca-4de6-8110-2e4fb9146a32 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:33.719988 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-07009592-83ca-4de6-8110-2e4fb9146a32 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:33.721017 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-07009592-83ca-4de6-8110-2e4fb9146a32 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:33.722313 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-07009592-83ca-4de6-8110-2e4fb9146a32 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:33.770133 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-07009592-83ca-4de6-8110-2e4fb9146a32 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lazy-loading 'flavor' on Instance uuid 3cf7e278-5294-4b2e-9b46-8981392d5764 {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:54:33.786278 n-d-854247-14 devstack@n-api.service[127017]: ERROR oslo.messaging._drivers.impl_rabbit [None req-07009592-83ca-4de6-8110-2e4fb9146a32 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] [db279165-5189-40f8-9e6f-0af7f7bfcb49] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 13:54:33.914353 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-505d2683-c012-44d6-84fe-5d4d0780cdcd tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb634956c1764e508400b08750ecc9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23d1c84c66c43bc9daf9d3028663f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:33.934145 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-505d2683-c012-44d6-84fe-5d4d0780cdcd tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] 10.222.0.79 "GET /compute/v2.1/servers/b54d449b-422b-4ca0-8183-02eb28c30747" status: 200 len: 1314 microversion: 2.1 time: 0.351919 Oct 17 13:54:33.934755 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2162/4206] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:33 2022] GET /compute/v2.1/servers/b54d449b-422b-4ca0-8183-02eb28c30747 => generated 1314 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:33.945850 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a469bb84-a9b2-4ea7-b8bb-6d2bc3527393 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:33.946976 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a469bb84-a9b2-4ea7-b8bb-6d2bc3527393 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 051c9371-d3e2-4166-bed5-c73dc77ec977] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:33.962549 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a469bb84-a9b2-4ea7-b8bb-6d2bc3527393 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:33.963059 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a469bb84-a9b2-4ea7-b8bb-6d2bc3527393 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:33.963533 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a469bb84-a9b2-4ea7-b8bb-6d2bc3527393 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:33.964260 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a469bb84-a9b2-4ea7-b8bb-6d2bc3527393 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:33.968455 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a469bb84-a9b2-4ea7-b8bb-6d2bc3527393 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:33.969214 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a469bb84-a9b2-4ea7-b8bb-6d2bc3527393 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:34.300407 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a469bb84-a9b2-4ea7-b8bb-6d2bc3527393 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:34.310972 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a469bb84-a9b2-4ea7-b8bb-6d2bc3527393 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977" status: 200 len: 1315 microversion: 2.1 time: 0.370700 Oct 17 13:54:34.328094 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2163/4207] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:33 2022] GET /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977 => generated 1315 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:34.345065 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7f6879b2-2aae-4049-bce6-9cc72463faf4 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:34.345985 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7f6879b2-2aae-4049-bce6-9cc72463faf4 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] [instance: 419a7ac0-9332-481d-bc66-3ad5b6a9db81] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:34.353892 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7f6879b2-2aae-4049-bce6-9cc72463faf4 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:34.354375 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7f6879b2-2aae-4049-bce6-9cc72463faf4 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:34.354806 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7f6879b2-2aae-4049-bce6-9cc72463faf4 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:34.356277 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7f6879b2-2aae-4049-bce6-9cc72463faf4 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:34.356884 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7f6879b2-2aae-4049-bce6-9cc72463faf4 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:34.357670 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7f6879b2-2aae-4049-bce6-9cc72463faf4 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:34.378202 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-7f6879b2-2aae-4049-bce6-9cc72463faf4 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] HTTP exception thrown: Instance 419a7ac0-9332-481d-bc66-3ad5b6a9db81 could not be found. Oct 17 13:54:34.380432 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7f6879b2-2aae-4049-bce6-9cc72463faf4 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Request method failure captured: Oct 17 13:54:34.380432 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/419a7ac0-9332-481d-bc66-3ad5b6a9db81 HTTP/1.1 Oct 17 13:54:34.380432 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:54:34.380432 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:54:34.380432 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:54:34.380432 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:54:34.380432 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:54:34.380432 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:54:34.380432 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:54:34.380432 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:54:34.380432 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTV4IH2a3qOGXTk_dwQZ0Ycm_wPgomL0oTIuWb1BLSpIJHbVi0PFm3_eUMz5hm9uNNNrgBPLVI_0jIJGBwaKzCfNxhBGHd-JF4f7z2RCHqzG0gH5PetbeN1EUab4BhxhIhX0BLRhOUKh7pijA04unL3pjRZaTMZ3CFapZiq3QLEEppvg Oct 17 13:54:34.380432 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:54:34.380432 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:54:34.380432 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:54:34.380432 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:54:34.380432 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:54:34.380432 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:54:34.380432 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 8fb1624a35d0403c9e5d09a17e79b7fb Oct 17 13:54:34.380432 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ListImageFiltersTestJSON-977467871 Oct 17 13:54:34.380432 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:54:34.380432 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:54:34.380432 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8fb1624a35d0403c9e5d09a17e79b7fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/8fb1624a35d0403c9e5d09a17e79b7fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/8fb1624a35d0403c9e5d09a17e79b7fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_8fb1624a35d0403c9e5d09a17e79b7fb", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:54:34.380432 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ListImageFiltersTestJSON-977467871 Oct 17 13:54:34.380432 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 8fb1624a35d0403c9e5d09a17e79b7fb Oct 17 13:54:34.380432 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-977467871 Oct 17 13:54:34.380432 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ListImageFiltersTestJSON-977467871-project Oct 17 13:54:34.380432 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:54:34.380432 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:54:34.380432 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 79bfe589d0784bfc8ed1611c71cd4461 Oct 17 13:54:34.380432 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ListImageFiltersTestJSON-977467871-project Oct 17 13:54:34.380432 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:54:34.380432 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 419a7ac0-9332-481d-bc66-3ad5b6a9db81 could not be found. Oct 17 13:54:34.380432 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '419a7ac0-9332-481d-bc66-3ad5b6a9db81'} Oct 17 13:54:34.380432 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:54:34.380432 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:54:34.380432 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:54:34.380432 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:54:34.380432 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:54:34.380432 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:54:34.380432 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:54:34.380432 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:54:34.380432 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:54:34.380432 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:54:34.380432 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 419a7ac0-9332-481d-bc66-3ad5b6a9db81 could not be found. Oct 17 13:54:34.380432 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:54:34.380432 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:54:34.380432 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:54:34.380432 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:54:34.380432 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:54:34.380432 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:54:34.380432 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:54:34.380432 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:54:34.380432 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:54:34.380432 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:54:34.380432 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:54:34.380432 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:54:34.380432 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:54:34.380432 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:54:34.380432 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:54:34.380432 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:54:34.380432 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 419a7ac0-9332-481d-bc66-3ad5b6a9db81 could not be found. Oct 17 13:54:34.380432 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:54:34.380432 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:54:34.380432 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:54:34.386775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:54:34.386775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:54:34.386775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:54:34.386775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:54:34.386775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:54:34.386775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 419a7ac0-9332-481d-bc66-3ad5b6a9db81 could not be found. Oct 17 13:54:34.386775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:54:34.389516 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7f6879b2-2aae-4049-bce6-9cc72463faf4 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Returning 404 to user: Instance 419a7ac0-9332-481d-bc66-3ad5b6a9db81 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:54:34.401182 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7f6879b2-2aae-4049-bce6-9cc72463faf4 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "GET /compute/v2.1/servers/419a7ac0-9332-481d-bc66-3ad5b6a9db81" status: 404 len: 111 microversion: 2.1 time: 0.071233 Oct 17 13:54:34.402660 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2164/4208] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:34 2022] GET /compute/v2.1/servers/419a7ac0-9332-481d-bc66-3ad5b6a9db81 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:54:34.411454 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a2d8fc48-3202-479d-8ff3-50bade826124 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd46e70d0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:34.808044 n-d-854247-14 devstack@n-api.service[127017]: INFO oslo.messaging._drivers.impl_rabbit [None req-07009592-83ca-4de6-8110-2e4fb9146a32 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] [db279165-5189-40f8-9e6f-0af7f7bfcb49] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 48640. Oct 17 13:54:34.824319 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-07009592-83ca-4de6-8110-2e4fb9146a32 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] 10.222.0.79 "PUT /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764/tags/tempest-tag-387330659" status: 201 len: 0 microversion: 2.26 time: 1.202556 Oct 17 13:54:34.829018 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2045/4209] 10.222.0.79 () {62 vars in 1377 bytes} [Mon Oct 17 13:54:33 2022] PUT /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764/tags/tempest-tag-387330659 => generated 0 bytes in 1208 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 17 13:54:34.837249 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-993d89c5-fdc3-4ae1-8c9c-4865d02c2bf5 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:34.838457 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-993d89c5-fdc3-4ae1-8c9c-4865d02c2bf5 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] [instance: 656925d8-a071-49b4-92b0-b74039bc96dc] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:34.848818 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-993d89c5-fdc3-4ae1-8c9c-4865d02c2bf5 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:34.849518 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-993d89c5-fdc3-4ae1-8c9c-4865d02c2bf5 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:34.850139 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-993d89c5-fdc3-4ae1-8c9c-4865d02c2bf5 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:34.851038 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-993d89c5-fdc3-4ae1-8c9c-4865d02c2bf5 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:34.851696 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-993d89c5-fdc3-4ae1-8c9c-4865d02c2bf5 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:34.852352 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-993d89c5-fdc3-4ae1-8c9c-4865d02c2bf5 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:35.045052 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a2d8fc48-3202-479d-8ff3-50bade826124 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "DELETE /compute/v2.1/images/3c7ada60-86b9-4516-9792-27def12788d5" status: 204 len: 0 microversion: 2.1 time: 0.638210 Oct 17 13:54:35.046447 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2165/4210] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:34 2022] DELETE /compute/v2.1/images/3c7ada60-86b9-4516-9792-27def12788d5 => generated 0 bytes in 640 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 13:54:35.054590 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6240979d-4bbf-41e9-9d45-e149f3673afd tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Calling method '.version_select at 0x7f7cd42dd550>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:35.092901 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6240979d-4bbf-41e9-9d45-e149f3673afd tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:35.093956 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6240979d-4bbf-41e9-9d45-e149f3673afd tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:35.095192 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6240979d-4bbf-41e9-9d45-e149f3673afd tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:35.105343 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-993d89c5-fdc3-4ae1-8c9c-4865d02c2bf5 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:35.120395 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-993d89c5-fdc3-4ae1-8c9c-4865d02c2bf5 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:35.122148 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-993d89c5-fdc3-4ae1-8c9c-4865d02c2bf5 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:35.125178 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-993d89c5-fdc3-4ae1-8c9c-4865d02c2bf5 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] 10.222.0.79 "GET /compute/v2.1/servers/656925d8-a071-49b4-92b0-b74039bc96dc" status: 200 len: 1366 microversion: 2.57 time: 0.294614 Oct 17 13:54:35.145445 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6240979d-4bbf-41e9-9d45-e149f3673afd tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] 10.222.0.79 "GET /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764/tags/tempest-tag-387330659" status: 204 len: 0 microversion: 2.26 time: 0.097429 Oct 17 13:54:35.147394 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2166/4211] 10.222.0.79 () {60 vars in 1358 bytes} [Mon Oct 17 13:54:35 2022] GET /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764/tags/tempest-tag-387330659 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:54:35.150849 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2046/4212] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:34 2022] GET /compute/v2.1/servers/656925d8-a071-49b4-92b0-b74039bc96dc => generated 1366 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:54:35.159553 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-08732c1c-fc43-41d8-99ad-8383ea3efb49 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:35.162129 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-efc7ac83-68cf-45b3-93b2-5bc119c96ff1 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd53f14c0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:35.164918 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-08732c1c-fc43-41d8-99ad-8383ea3efb49 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] [instance: b54d449b-422b-4ca0-8183-02eb28c30747] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:35.179670 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-08732c1c-fc43-41d8-99ad-8383ea3efb49 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:35.181803 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-08732c1c-fc43-41d8-99ad-8383ea3efb49 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:35.183217 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-08732c1c-fc43-41d8-99ad-8383ea3efb49 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:35.187200 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-08732c1c-fc43-41d8-99ad-8383ea3efb49 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:35.188144 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-08732c1c-fc43-41d8-99ad-8383ea3efb49 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:35.188702 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-08732c1c-fc43-41d8-99ad-8383ea3efb49 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:35.651324 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-08732c1c-fc43-41d8-99ad-8383ea3efb49 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb634956c1764e508400b08750ecc9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23d1c84c66c43bc9daf9d3028663f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:35.665145 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-08732c1c-fc43-41d8-99ad-8383ea3efb49 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] 10.222.0.79 "GET /compute/v2.1/servers/b54d449b-422b-4ca0-8183-02eb28c30747" status: 200 len: 1498 microversion: 2.1 time: 0.514362 Oct 17 13:54:35.666988 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2167/4213] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:35 2022] GET /compute/v2.1/servers/b54d449b-422b-4ca0-8183-02eb28c30747 => generated 1498 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:35.682712 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-47abf20a-b846-4955-8ce8-4123a2371022 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Calling method '.version_select at 0x7f7cd9882670>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:35.699772 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-efc7ac83-68cf-45b3-93b2-5bc119c96ff1 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "DELETE /compute/v2.1/images/cc4ed12d-5901-47a8-8c62-890e6368f280" status: 204 len: 0 microversion: 2.1 time: 0.543795 Oct 17 13:54:35.700628 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2047/4214] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:35 2022] DELETE /compute/v2.1/images/cc4ed12d-5901-47a8-8c62-890e6368f280 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:54:35.712764 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-47abf20a-b846-4955-8ce8-4123a2371022 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:35.713340 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-4e3ac1a7-bf37-4881-a0c6-8a5923b082d8 req-2338ae82-0efb-45b2-b8f0-b87b903b93a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "051c9371-d3e2-4166-bed5-c73dc77ec977", "name": "network-vif-plugged", "status": "completed", "tag": "b42d1dd8-cfa2-4ce4-947c-6010f321b0df"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:54:35.714096 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-47abf20a-b846-4955-8ce8-4123a2371022 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:35.716443 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-47abf20a-b846-4955-8ce8-4123a2371022 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:35.717574 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-47abf20a-b846-4955-8ce8-4123a2371022 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] [instance: 3cf7e278-5294-4b2e-9b46-8981392d5764] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:35.729935 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-47abf20a-b846-4955-8ce8-4123a2371022 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:35.730435 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-47abf20a-b846-4955-8ce8-4123a2371022 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:35.731454 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-47abf20a-b846-4955-8ce8-4123a2371022 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:35.732514 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-47abf20a-b846-4955-8ce8-4123a2371022 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:35.732984 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-47abf20a-b846-4955-8ce8-4123a2371022 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:35.733404 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-47abf20a-b846-4955-8ce8-4123a2371022 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:35.738692 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-4e3ac1a7-bf37-4881-a0c6-8a5923b082d8 req-2338ae82-0efb-45b2-b8f0-b87b903b93a6 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:35.740862 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-4e3ac1a7-bf37-4881-a0c6-8a5923b082d8 req-2338ae82-0efb-45b2-b8f0-b87b903b93a6 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:35.742930 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-4e3ac1a7-bf37-4881-a0c6-8a5923b082d8 req-2338ae82-0efb-45b2-b8f0-b87b903b93a6 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:35.785193 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-4e3ac1a7-bf37-4881-a0c6-8a5923b082d8 req-2338ae82-0efb-45b2-b8f0-b87b903b93a6 service nova] Creating event network-vif-plugged:b42d1dd8-cfa2-4ce4-947c-6010f321b0df for instance 051c9371-d3e2-4166-bed5-c73dc77ec977 on n-h1-854247-14 Oct 17 13:54:35.798186 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-4e3ac1a7-bf37-4881-a0c6-8a5923b082d8 req-2338ae82-0efb-45b2-b8f0-b87b903b93a6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096112 Oct 17 13:54:35.802994 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2048/4215] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:54:35.813038 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-47abf20a-b846-4955-8ce8-4123a2371022 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:35.815856 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-096f5d35-1af4-401a-a90b-c2c58f5bcdbb tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:35.816574 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-096f5d35-1af4-401a-a90b-c2c58f5bcdbb tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 051c9371-d3e2-4166-bed5-c73dc77ec977] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:35.818739 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-47abf20a-b846-4955-8ce8-4123a2371022 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:35.819220 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-47abf20a-b846-4955-8ce8-4123a2371022 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:35.832969 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-096f5d35-1af4-401a-a90b-c2c58f5bcdbb tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:35.838097 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-096f5d35-1af4-401a-a90b-c2c58f5bcdbb tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:35.855824 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-096f5d35-1af4-401a-a90b-c2c58f5bcdbb tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:35.861044 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-096f5d35-1af4-401a-a90b-c2c58f5bcdbb tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:35.862217 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-096f5d35-1af4-401a-a90b-c2c58f5bcdbb tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:35.863037 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-096f5d35-1af4-401a-a90b-c2c58f5bcdbb tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:35.874156 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-47abf20a-b846-4955-8ce8-4123a2371022 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lazy-loading 'flavor' on Instance uuid 3cf7e278-5294-4b2e-9b46-8981392d5764 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:54:35.922334 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-47abf20a-b846-4955-8ce8-4123a2371022 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764/tags" status: 204 len: 0 microversion: 2.26 time: 0.250395 Oct 17 13:54:35.923967 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2168/4216] 10.222.0.79 () {60 vars in 1295 bytes} [Mon Oct 17 13:54:35 2022] DELETE /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764/tags => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:54:35.933326 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-41c03cd2-f8ce-416f-9a44-b79559d06309 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] Calling method '.version_select at 0x7f7cd981d310>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:36.219523 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-096f5d35-1af4-401a-a90b-c2c58f5bcdbb tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:36.228135 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-096f5d35-1af4-401a-a90b-c2c58f5bcdbb tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977" status: 200 len: 1315 microversion: 2.1 time: 0.423307 Oct 17 13:54:36.228927 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2049/4217] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:35 2022] GET /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977 => generated 1315 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:36.245480 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ceac744b-f8bf-428a-81a1-d8ca1fdb88cb tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Calling method '.version_select at 0x7f7cd54c7310>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:36.261733 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ceac744b-f8bf-428a-81a1-d8ca1fdb88cb tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:36.262233 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ceac744b-f8bf-428a-81a1-d8ca1fdb88cb tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:36.262671 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ceac744b-f8bf-428a-81a1-d8ca1fdb88cb tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:36.284874 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ceac744b-f8bf-428a-81a1-d8ca1fdb88cb tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] 10.222.0.79 "GET /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764/tags" status: 200 len: 12 microversion: 2.26 time: 0.043766 Oct 17 13:54:36.285718 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2050/4218] 10.222.0.79 () {60 vars in 1292 bytes} [Mon Oct 17 13:54:36 2022] GET /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764/tags => generated 12 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:36.294414 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7963e738-c8a3-4ee5-a76f-537d229a3b23 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:36.297019 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7963e738-c8a3-4ee5-a76f-537d229a3b23 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] [instance: 656925d8-a071-49b4-92b0-b74039bc96dc] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:36.311619 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7963e738-c8a3-4ee5-a76f-537d229a3b23 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:36.312665 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7963e738-c8a3-4ee5-a76f-537d229a3b23 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:36.313415 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7963e738-c8a3-4ee5-a76f-537d229a3b23 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:36.316022 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7963e738-c8a3-4ee5-a76f-537d229a3b23 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:36.316732 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7963e738-c8a3-4ee5-a76f-537d229a3b23 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:36.317450 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7963e738-c8a3-4ee5-a76f-537d229a3b23 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:36.427101 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-41c03cd2-f8ce-416f-9a44-b79559d06309 tempest-ListImageFiltersTestJSON-977467871 tempest-ListImageFiltersTestJSON-977467871-project] 10.222.0.79 "DELETE /compute/v2.1/images/a226dc23-d66a-4cb3-856f-8e9c429ce665" status: 204 len: 0 microversion: 2.1 time: 0.501541 Oct 17 13:54:36.428042 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2169/4219] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:35 2022] DELETE /compute/v2.1/images/a226dc23-d66a-4cb3-856f-8e9c429ce665 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:54:36.443638 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-20bbaef4-5f47-461d-b2fb-bd9e5b81e4b4 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Calling method '.version_select at 0x7f7cd440f0d0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:36.471355 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-20bbaef4-5f47-461d-b2fb-bd9e5b81e4b4 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:36.472089 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7963e738-c8a3-4ee5-a76f-537d229a3b23 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:36.479031 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-20bbaef4-5f47-461d-b2fb-bd9e5b81e4b4 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:36.479666 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-20bbaef4-5f47-461d-b2fb-bd9e5b81e4b4 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:36.484424 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-20bbaef4-5f47-461d-b2fb-bd9e5b81e4b4 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] [instance: 3cf7e278-5294-4b2e-9b46-8981392d5764] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:36.488651 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7963e738-c8a3-4ee5-a76f-537d229a3b23 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:36.493101 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7963e738-c8a3-4ee5-a76f-537d229a3b23 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:36.497713 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7963e738-c8a3-4ee5-a76f-537d229a3b23 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] 10.222.0.79 "GET /compute/v2.1/servers/656925d8-a071-49b4-92b0-b74039bc96dc" status: 200 len: 1366 microversion: 2.57 time: 0.210561 Oct 17 13:54:36.501026 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2051/4220] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:36 2022] GET /compute/v2.1/servers/656925d8-a071-49b4-92b0-b74039bc96dc => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:54:36.507127 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-20bbaef4-5f47-461d-b2fb-bd9e5b81e4b4 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:36.510519 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-20bbaef4-5f47-461d-b2fb-bd9e5b81e4b4 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:36.510975 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-20bbaef4-5f47-461d-b2fb-bd9e5b81e4b4 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:36.514009 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-20bbaef4-5f47-461d-b2fb-bd9e5b81e4b4 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:36.516247 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-20bbaef4-5f47-461d-b2fb-bd9e5b81e4b4 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:36.516247 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-20bbaef4-5f47-461d-b2fb-bd9e5b81e4b4 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:36.586188 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-20bbaef4-5f47-461d-b2fb-bd9e5b81e4b4 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:36.587306 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-20bbaef4-5f47-461d-b2fb-bd9e5b81e4b4 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:36.611399 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-20bbaef4-5f47-461d-b2fb-bd9e5b81e4b4 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:36.652213 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-20bbaef4-5f47-461d-b2fb-bd9e5b81e4b4 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:36.653650 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-20bbaef4-5f47-461d-b2fb-bd9e5b81e4b4 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:36.654737 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-20bbaef4-5f47-461d-b2fb-bd9e5b81e4b4 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:36.736755 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-20bbaef4-5f47-461d-b2fb-bd9e5b81e4b4 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lazy-loading 'flavor' on Instance uuid 3cf7e278-5294-4b2e-9b46-8981392d5764 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:54:36.783813 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-20bbaef4-5f47-461d-b2fb-bd9e5b81e4b4 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] 10.222.0.79 "PUT /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764/tags/tempest-tag-1954882995" status: 201 len: 0 microversion: 2.26 time: 0.354106 Oct 17 13:54:36.787488 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2170/4221] 10.222.0.79 () {62 vars in 1380 bytes} [Mon Oct 17 13:54:36 2022] PUT /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764/tags/tempest-tag-1954882995 => generated 0 bytes in 359 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 17 13:54:36.801326 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ba6e6d8e-e9f4-4293-98e3-a5fad53cf6c4 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Calling method '.version_select at 0x7f7cd56054c0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:36.826730 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ba6e6d8e-e9f4-4293-98e3-a5fad53cf6c4 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:36.828986 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ba6e6d8e-e9f4-4293-98e3-a5fad53cf6c4 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:36.829561 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ba6e6d8e-e9f4-4293-98e3-a5fad53cf6c4 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:36.855860 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ba6e6d8e-e9f4-4293-98e3-a5fad53cf6c4 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] 10.222.0.79 "GET /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764/tags" status: 200 len: 36 microversion: 2.26 time: 0.063756 Oct 17 13:54:36.856418 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2052/4222] 10.222.0.79 () {60 vars in 1292 bytes} [Mon Oct 17 13:54:36 2022] GET /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764/tags => generated 36 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:36.868527 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-654d0365-1ff2-48c9-bb80-9bdfd5e65cbc tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Calling method '.version_select at 0x7f7cd981d160>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:36.915314 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-654d0365-1ff2-48c9-bb80-9bdfd5e65cbc tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:36.923861 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-654d0365-1ff2-48c9-bb80-9bdfd5e65cbc tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:36.924423 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-654d0365-1ff2-48c9-bb80-9bdfd5e65cbc tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:36.924938 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-654d0365-1ff2-48c9-bb80-9bdfd5e65cbc tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] [instance: 3cf7e278-5294-4b2e-9b46-8981392d5764] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:36.937924 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-654d0365-1ff2-48c9-bb80-9bdfd5e65cbc tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:36.942388 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-654d0365-1ff2-48c9-bb80-9bdfd5e65cbc tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:36.946679 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-654d0365-1ff2-48c9-bb80-9bdfd5e65cbc tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:36.947737 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-654d0365-1ff2-48c9-bb80-9bdfd5e65cbc tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:36.948394 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-654d0365-1ff2-48c9-bb80-9bdfd5e65cbc tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:36.949074 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-654d0365-1ff2-48c9-bb80-9bdfd5e65cbc tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:37.016362 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-654d0365-1ff2-48c9-bb80-9bdfd5e65cbc tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:37.018674 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-654d0365-1ff2-48c9-bb80-9bdfd5e65cbc tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:37.024311 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-654d0365-1ff2-48c9-bb80-9bdfd5e65cbc tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:37.056139 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-654d0365-1ff2-48c9-bb80-9bdfd5e65cbc tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lazy-loading 'flavor' on Instance uuid 3cf7e278-5294-4b2e-9b46-8981392d5764 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:54:37.077218 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-654d0365-1ff2-48c9-bb80-9bdfd5e65cbc tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764/tags/tempest-tag-1954882995" status: 204 len: 0 microversion: 2.26 time: 0.213376 Oct 17 13:54:37.078289 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2171/4223] 10.222.0.79 () {60 vars in 1364 bytes} [Mon Oct 17 13:54:36 2022] DELETE /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764/tags/tempest-tag-1954882995 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:54:37.089174 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-344dae0e-2d2e-412b-ba95-2064ef854df1 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Calling method '.version_select at 0x7f7cd9a22700>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:37.118158 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-344dae0e-2d2e-412b-ba95-2064ef854df1 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:37.118713 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-344dae0e-2d2e-412b-ba95-2064ef854df1 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:37.120994 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-344dae0e-2d2e-412b-ba95-2064ef854df1 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:37.154070 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-344dae0e-2d2e-412b-ba95-2064ef854df1 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] 10.222.0.79 "GET /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764/tags" status: 200 len: 12 microversion: 2.26 time: 0.070129 Oct 17 13:54:37.163613 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2053/4224] 10.222.0.79 () {60 vars in 1292 bytes} [Mon Oct 17 13:54:37 2022] GET /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764/tags => generated 12 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:37.169472 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4d67073f-de78-43e2-8b55-5e0361bfbaab tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Calling method '.version_select at 0x7f7cd440f040>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:37.206932 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d67073f-de78-43e2-8b55-5e0361bfbaab tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:37.209935 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d67073f-de78-43e2-8b55-5e0361bfbaab tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:37.214017 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d67073f-de78-43e2-8b55-5e0361bfbaab tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:37.217953 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4d67073f-de78-43e2-8b55-5e0361bfbaab tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] [instance: 3cf7e278-5294-4b2e-9b46-8981392d5764] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:37.242518 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d67073f-de78-43e2-8b55-5e0361bfbaab tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:37.242767 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d67073f-de78-43e2-8b55-5e0361bfbaab tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:37.246388 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d67073f-de78-43e2-8b55-5e0361bfbaab tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:37.248249 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d67073f-de78-43e2-8b55-5e0361bfbaab tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:37.248760 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d67073f-de78-43e2-8b55-5e0361bfbaab tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:37.249202 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d67073f-de78-43e2-8b55-5e0361bfbaab tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:37.254092 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-cbf2ad76-f62e-4980-86af-2af162c95890 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:37.254836 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-cbf2ad76-f62e-4980-86af-2af162c95890 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 051c9371-d3e2-4166-bed5-c73dc77ec977] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:37.268879 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cbf2ad76-f62e-4980-86af-2af162c95890 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:37.272614 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cbf2ad76-f62e-4980-86af-2af162c95890 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:37.275703 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cbf2ad76-f62e-4980-86af-2af162c95890 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:37.276583 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cbf2ad76-f62e-4980-86af-2af162c95890 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:37.277615 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cbf2ad76-f62e-4980-86af-2af162c95890 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:37.281649 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cbf2ad76-f62e-4980-86af-2af162c95890 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:37.313749 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d67073f-de78-43e2-8b55-5e0361bfbaab tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:37.314246 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d67073f-de78-43e2-8b55-5e0361bfbaab tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:37.314884 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d67073f-de78-43e2-8b55-5e0361bfbaab tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:37.350712 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-4d67073f-de78-43e2-8b55-5e0361bfbaab tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lazy-loading 'flavor' on Instance uuid 3cf7e278-5294-4b2e-9b46-8981392d5764 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:54:37.399330 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4d67073f-de78-43e2-8b55-5e0361bfbaab tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764/tags" status: 204 len: 0 microversion: 2.26 time: 0.238089 Oct 17 13:54:37.407875 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2172/4225] 10.222.0.79 () {60 vars in 1295 bytes} [Mon Oct 17 13:54:37 2022] DELETE /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764/tags => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:54:37.427479 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5aebf8b4-f4e6-4a76-a571-844179754212 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Calling method '.version_select at 0x7f7cd42dddc0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:37.441347 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5aebf8b4-f4e6-4a76-a571-844179754212 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:37.443028 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5aebf8b4-f4e6-4a76-a571-844179754212 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:37.445446 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5aebf8b4-f4e6-4a76-a571-844179754212 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:37.446345 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5aebf8b4-f4e6-4a76-a571-844179754212 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] [instance: 3cf7e278-5294-4b2e-9b46-8981392d5764] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:37.467848 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:54:37.498783 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5aebf8b4-f4e6-4a76-a571-844179754212 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:37.504727 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5aebf8b4-f4e6-4a76-a571-844179754212 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:37.505257 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5aebf8b4-f4e6-4a76-a571-844179754212 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:37.506016 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5aebf8b4-f4e6-4a76-a571-844179754212 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:37.511530 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5aebf8b4-f4e6-4a76-a571-844179754212 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:37.512235 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5aebf8b4-f4e6-4a76-a571-844179754212 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:37.648775 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5aebf8b4-f4e6-4a76-a571-844179754212 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:37.651460 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5aebf8b4-f4e6-4a76-a571-844179754212 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:37.653188 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5aebf8b4-f4e6-4a76-a571-844179754212 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:37.705322 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5aebf8b4-f4e6-4a76-a571-844179754212 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:37.708506 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5aebf8b4-f4e6-4a76-a571-844179754212 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:37.713028 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5aebf8b4-f4e6-4a76-a571-844179754212 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:37.775739 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-5aebf8b4-f4e6-4a76-a571-844179754212 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lazy-loading 'flavor' on Instance uuid 3cf7e278-5294-4b2e-9b46-8981392d5764 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:54:37.800140 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5aebf8b4-f4e6-4a76-a571-844179754212 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] 10.222.0.79 "PUT /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764/tags/tempest-tag-1776168445" status: 201 len: 0 microversion: 2.26 time: 0.390599 Oct 17 13:54:37.805058 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2173/4226] 10.222.0.79 () {62 vars in 1380 bytes} [Mon Oct 17 13:54:37 2022] PUT /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764/tags/tempest-tag-1776168445 => generated 0 bytes in 396 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 17 13:54:37.816998 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-401369b4-9617-454f-8dff-d8c2973f7d76 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:37.817699 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-401369b4-9617-454f-8dff-d8c2973f7d76 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] [instance: 656925d8-a071-49b4-92b0-b74039bc96dc] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:37.836945 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-401369b4-9617-454f-8dff-d8c2973f7d76 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:37.837769 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-401369b4-9617-454f-8dff-d8c2973f7d76 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:37.838376 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-401369b4-9617-454f-8dff-d8c2973f7d76 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:37.839315 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-401369b4-9617-454f-8dff-d8c2973f7d76 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:37.839908 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-401369b4-9617-454f-8dff-d8c2973f7d76 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:37.840472 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-401369b4-9617-454f-8dff-d8c2973f7d76 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:37.920715 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-cbf2ad76-f62e-4980-86af-2af162c95890 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:37.940016 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-cbf2ad76-f62e-4980-86af-2af162c95890 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977" status: 200 len: 1315 microversion: 2.1 time: 0.691460 Oct 17 13:54:37.945160 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2054/4227] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:37 2022] GET /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977 => generated 1315 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:54:37.959891 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c7b1fe06-9c54-40bc-b78b-150491f0756d tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Calling method '.version_select at 0x7f7cd579d8b0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:38.012246 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7b1fe06-9c54-40bc-b78b-150491f0756d tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:38.013181 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7b1fe06-9c54-40bc-b78b-150491f0756d tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:38.018612 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7b1fe06-9c54-40bc-b78b-150491f0756d tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:38.025668 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c7b1fe06-9c54-40bc-b78b-150491f0756d tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] [instance: 3cf7e278-5294-4b2e-9b46-8981392d5764] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:38.041312 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7b1fe06-9c54-40bc-b78b-150491f0756d tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:38.042540 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7b1fe06-9c54-40bc-b78b-150491f0756d tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:38.043241 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7b1fe06-9c54-40bc-b78b-150491f0756d tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:38.044167 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7b1fe06-9c54-40bc-b78b-150491f0756d tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:38.046463 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7b1fe06-9c54-40bc-b78b-150491f0756d tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:38.047364 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7b1fe06-9c54-40bc-b78b-150491f0756d tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:38.109424 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7b1fe06-9c54-40bc-b78b-150491f0756d tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:38.110341 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7b1fe06-9c54-40bc-b78b-150491f0756d tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:38.111006 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7b1fe06-9c54-40bc-b78b-150491f0756d tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:38.124790 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7b1fe06-9c54-40bc-b78b-150491f0756d tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:38.125676 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7b1fe06-9c54-40bc-b78b-150491f0756d tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:38.126819 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7b1fe06-9c54-40bc-b78b-150491f0756d tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:38.130408 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-401369b4-9617-454f-8dff-d8c2973f7d76 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:38.150295 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-401369b4-9617-454f-8dff-d8c2973f7d76 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:38.160100 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:54:38.162225 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-401369b4-9617-454f-8dff-d8c2973f7d76 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:38.171996 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-401369b4-9617-454f-8dff-d8c2973f7d76 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] 10.222.0.79 "GET /compute/v2.1/servers/656925d8-a071-49b4-92b0-b74039bc96dc" status: 200 len: 1372 microversion: 2.57 time: 0.359506 Oct 17 13:54:38.182125 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2174/4228] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:37 2022] GET /compute/v2.1/servers/656925d8-a071-49b4-92b0-b74039bc96dc => generated 1372 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:54:38.192546 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-c7b1fe06-9c54-40bc-b78b-150491f0756d tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lazy-loading 'flavor' on Instance uuid 3cf7e278-5294-4b2e-9b46-8981392d5764 {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:54:38.249666 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c7b1fe06-9c54-40bc-b78b-150491f0756d tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] 10.222.0.79 "PUT /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764/tags/tempest-tag-220213872" status: 201 len: 0 microversion: 2.26 time: 0.300886 Oct 17 13:54:38.250509 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2055/4229] 10.222.0.79 () {62 vars in 1377 bytes} [Mon Oct 17 13:54:37 2022] PUT /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764/tags/tempest-tag-220213872 => generated 0 bytes in 305 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 17 13:54:38.260667 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d21bc473-8d2a-4693-90dd-14da143e98c2 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Calling method '.version_select at 0x7f7cd463e940>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:38.269819 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d21bc473-8d2a-4693-90dd-14da143e98c2 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:38.270305 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d21bc473-8d2a-4693-90dd-14da143e98c2 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:38.270734 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d21bc473-8d2a-4693-90dd-14da143e98c2 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:38.280824 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d21bc473-8d2a-4693-90dd-14da143e98c2 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] [instance: 3cf7e278-5294-4b2e-9b46-8981392d5764] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:38.315400 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d21bc473-8d2a-4693-90dd-14da143e98c2 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:38.319357 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d21bc473-8d2a-4693-90dd-14da143e98c2 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:38.319357 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d21bc473-8d2a-4693-90dd-14da143e98c2 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:38.334585 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d21bc473-8d2a-4693-90dd-14da143e98c2 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:38.338692 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d21bc473-8d2a-4693-90dd-14da143e98c2 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:38.341366 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d21bc473-8d2a-4693-90dd-14da143e98c2 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:38.404224 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d21bc473-8d2a-4693-90dd-14da143e98c2 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:38.405406 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d21bc473-8d2a-4693-90dd-14da143e98c2 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:38.406230 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d21bc473-8d2a-4693-90dd-14da143e98c2 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:38.444514 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-d21bc473-8d2a-4693-90dd-14da143e98c2 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lazy-loading 'flavor' on Instance uuid 3cf7e278-5294-4b2e-9b46-8981392d5764 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:54:38.490211 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d21bc473-8d2a-4693-90dd-14da143e98c2 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764/tags" status: 204 len: 0 microversion: 2.26 time: 0.234000 Oct 17 13:54:38.497139 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2175/4230] 10.222.0.79 () {60 vars in 1295 bytes} [Mon Oct 17 13:54:38 2022] DELETE /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764/tags => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:54:38.509241 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-061c3efb-5016-463f-85f3-0e925eca8b10 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Calling method '.version_select at 0x7f7cd5699670>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:38.540515 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-061c3efb-5016-463f-85f3-0e925eca8b10 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:38.542395 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-061c3efb-5016-463f-85f3-0e925eca8b10 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:38.545191 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-061c3efb-5016-463f-85f3-0e925eca8b10 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:38.584374 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-061c3efb-5016-463f-85f3-0e925eca8b10 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] 10.222.0.79 "GET /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764/tags" status: 200 len: 12 microversion: 2.26 time: 0.082733 Oct 17 13:54:38.588495 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2056/4231] 10.222.0.79 () {60 vars in 1292 bytes} [Mon Oct 17 13:54:38 2022] GET /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764/tags => generated 12 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:54:38.599457 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-af0f83db-e6cd-4fda-a16e-c5104878312b tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Calling method '.version_select at 0x7f7cd42bb0d0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:38.622942 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af0f83db-e6cd-4fda-a16e-c5104878312b tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:38.625216 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af0f83db-e6cd-4fda-a16e-c5104878312b tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:38.629589 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af0f83db-e6cd-4fda-a16e-c5104878312b tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:38.630187 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-af0f83db-e6cd-4fda-a16e-c5104878312b tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] [instance: 3cf7e278-5294-4b2e-9b46-8981392d5764] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:38.643546 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af0f83db-e6cd-4fda-a16e-c5104878312b tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:38.647814 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af0f83db-e6cd-4fda-a16e-c5104878312b tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:38.648351 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af0f83db-e6cd-4fda-a16e-c5104878312b tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:38.650622 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af0f83db-e6cd-4fda-a16e-c5104878312b tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:38.651935 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af0f83db-e6cd-4fda-a16e-c5104878312b tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:38.655088 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af0f83db-e6cd-4fda-a16e-c5104878312b tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:38.669928 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=90,nova_cell1:DELETE=4,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:54:38.742994 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af0f83db-e6cd-4fda-a16e-c5104878312b tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:38.748025 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af0f83db-e6cd-4fda-a16e-c5104878312b tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:38.748796 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af0f83db-e6cd-4fda-a16e-c5104878312b tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:38.786799 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-af0f83db-e6cd-4fda-a16e-c5104878312b tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lazy-loading 'flavor' on Instance uuid 3cf7e278-5294-4b2e-9b46-8981392d5764 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:54:38.815567 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-af0f83db-e6cd-4fda-a16e-c5104878312b tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764/tags" status: 204 len: 0 microversion: 2.26 time: 0.220402 Oct 17 13:54:38.816604 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2176/4232] 10.222.0.79 () {60 vars in 1295 bytes} [Mon Oct 17 13:54:38 2022] DELETE /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764/tags => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:54:38.827840 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e641aa4c-4464-4537-894c-c3b059fc3b62 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Calling method '.version_select at 0x7f7cd5605f70>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:38.840404 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e641aa4c-4464-4537-894c-c3b059fc3b62 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:38.841307 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e641aa4c-4464-4537-894c-c3b059fc3b62 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:38.842679 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e641aa4c-4464-4537-894c-c3b059fc3b62 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:38.843486 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e641aa4c-4464-4537-894c-c3b059fc3b62 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] [instance: 3cf7e278-5294-4b2e-9b46-8981392d5764] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:38.852444 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e641aa4c-4464-4537-894c-c3b059fc3b62 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:38.853746 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e641aa4c-4464-4537-894c-c3b059fc3b62 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:38.855636 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e641aa4c-4464-4537-894c-c3b059fc3b62 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:38.856808 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e641aa4c-4464-4537-894c-c3b059fc3b62 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:38.857570 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e641aa4c-4464-4537-894c-c3b059fc3b62 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:38.858418 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e641aa4c-4464-4537-894c-c3b059fc3b62 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:38.907706 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e641aa4c-4464-4537-894c-c3b059fc3b62 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:38.908933 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e641aa4c-4464-4537-894c-c3b059fc3b62 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:38.909686 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e641aa4c-4464-4537-894c-c3b059fc3b62 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:38.924898 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e641aa4c-4464-4537-894c-c3b059fc3b62 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:38.926199 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e641aa4c-4464-4537-894c-c3b059fc3b62 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:38.927265 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e641aa4c-4464-4537-894c-c3b059fc3b62 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:38.982247 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3a50892b-3d74-41e5-af6b-4fe7a1317e6c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:38.983895 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3a50892b-3d74-41e5-af6b-4fe7a1317e6c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 051c9371-d3e2-4166-bed5-c73dc77ec977] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:39.008198 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-e641aa4c-4464-4537-894c-c3b059fc3b62 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lazy-loading 'flavor' on Instance uuid 3cf7e278-5294-4b2e-9b46-8981392d5764 {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:54:39.010535 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3a50892b-3d74-41e5-af6b-4fe7a1317e6c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:39.019556 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3a50892b-3d74-41e5-af6b-4fe7a1317e6c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:39.020186 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3a50892b-3d74-41e5-af6b-4fe7a1317e6c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:39.024377 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3a50892b-3d74-41e5-af6b-4fe7a1317e6c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:39.027394 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3a50892b-3d74-41e5-af6b-4fe7a1317e6c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:39.028856 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3a50892b-3d74-41e5-af6b-4fe7a1317e6c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:39.064277 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e641aa4c-4464-4537-894c-c3b059fc3b62 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] 10.222.0.79 "PUT /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764/tags/tempest-tag-1581730688" status: 201 len: 0 microversion: 2.26 time: 0.241210 Oct 17 13:54:39.074168 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2057/4233] 10.222.0.79 () {62 vars in 1380 bytes} [Mon Oct 17 13:54:38 2022] PUT /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764/tags/tempest-tag-1581730688 => generated 0 bytes in 252 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 17 13:54:39.108527 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b9567933-10f1-4787-908e-92b558124f39 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Calling method '.version_select at 0x7f7cd5ca5160>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:39.156657 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b9567933-10f1-4787-908e-92b558124f39 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:39.159846 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b9567933-10f1-4787-908e-92b558124f39 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:39.160433 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b9567933-10f1-4787-908e-92b558124f39 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:39.161510 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b9567933-10f1-4787-908e-92b558124f39 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] [instance: 3cf7e278-5294-4b2e-9b46-8981392d5764] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:39.180516 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b9567933-10f1-4787-908e-92b558124f39 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:39.181287 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b9567933-10f1-4787-908e-92b558124f39 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:39.182651 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b9567933-10f1-4787-908e-92b558124f39 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:39.184712 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b9567933-10f1-4787-908e-92b558124f39 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:39.186751 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b9567933-10f1-4787-908e-92b558124f39 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:39.189998 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b9567933-10f1-4787-908e-92b558124f39 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:39.265638 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b9567933-10f1-4787-908e-92b558124f39 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:39.266148 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b9567933-10f1-4787-908e-92b558124f39 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:39.266580 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b9567933-10f1-4787-908e-92b558124f39 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:39.293031 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b9567933-10f1-4787-908e-92b558124f39 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:39.293534 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b9567933-10f1-4787-908e-92b558124f39 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:39.293976 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b9567933-10f1-4787-908e-92b558124f39 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:39.344990 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-b9567933-10f1-4787-908e-92b558124f39 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lazy-loading 'flavor' on Instance uuid 3cf7e278-5294-4b2e-9b46-8981392d5764 {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:54:39.365212 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b9567933-10f1-4787-908e-92b558124f39 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] 10.222.0.79 "PUT /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764/tags/tempest-tag-2046179988" status: 201 len: 0 microversion: 2.26 time: 0.286748 Oct 17 13:54:39.366199 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2058/4234] 10.222.0.79 () {62 vars in 1380 bytes} [Mon Oct 17 13:54:39 2022] PUT /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764/tags/tempest-tag-2046179988 => generated 0 bytes in 288 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 17 13:54:39.372377 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b2296029-6664-46b2-abf8-bbb0c160bee5 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:39.373015 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b2296029-6664-46b2-abf8-bbb0c160bee5 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] [instance: 656925d8-a071-49b4-92b0-b74039bc96dc] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:39.379491 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b2296029-6664-46b2-abf8-bbb0c160bee5 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:39.379980 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b2296029-6664-46b2-abf8-bbb0c160bee5 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:39.380418 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b2296029-6664-46b2-abf8-bbb0c160bee5 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:39.381130 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b2296029-6664-46b2-abf8-bbb0c160bee5 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:39.381782 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b2296029-6664-46b2-abf8-bbb0c160bee5 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:39.382533 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b2296029-6664-46b2-abf8-bbb0c160bee5 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:39.903996 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b2296029-6664-46b2-abf8-bbb0c160bee5 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:39.922073 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b2296029-6664-46b2-abf8-bbb0c160bee5 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:39.924065 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b2296029-6664-46b2-abf8-bbb0c160bee5 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:39.925368 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b2296029-6664-46b2-abf8-bbb0c160bee5 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] 10.222.0.79 "GET /compute/v2.1/servers/656925d8-a071-49b4-92b0-b74039bc96dc" status: 200 len: 1372 microversion: 2.57 time: 0.558021 Oct 17 13:54:39.929364 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2059/4235] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:39 2022] GET /compute/v2.1/servers/656925d8-a071-49b4-92b0-b74039bc96dc => generated 1372 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:54:39.943958 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6c295421-cad5-4bac-ad97-09dbe64ceeb2 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Action: 'update_all', calling method: .version_select at 0x7f7cd56053a0>, body: {"tags": ["tempest-tag-535949652", "tempest-tag-1875727588"]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:54:39.971282 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6c295421-cad5-4bac-ad97-09dbe64ceeb2 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:39.972156 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6c295421-cad5-4bac-ad97-09dbe64ceeb2 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:39.972770 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6c295421-cad5-4bac-ad97-09dbe64ceeb2 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:39.973527 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6c295421-cad5-4bac-ad97-09dbe64ceeb2 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] [instance: 3cf7e278-5294-4b2e-9b46-8981392d5764] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:39.976266 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3a50892b-3d74-41e5-af6b-4fe7a1317e6c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:39.987141 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3a50892b-3d74-41e5-af6b-4fe7a1317e6c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977" status: 200 len: 1501 microversion: 2.1 time: 1.023108 Oct 17 13:54:39.988312 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2177/4236] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:38 2022] GET /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977 => generated 1501 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:39.991675 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6c295421-cad5-4bac-ad97-09dbe64ceeb2 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:39.992178 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6c295421-cad5-4bac-ad97-09dbe64ceeb2 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:39.994778 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6c295421-cad5-4bac-ad97-09dbe64ceeb2 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:39.995628 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6c295421-cad5-4bac-ad97-09dbe64ceeb2 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:39.996103 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6c295421-cad5-4bac-ad97-09dbe64ceeb2 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:39.996541 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6c295421-cad5-4bac-ad97-09dbe64ceeb2 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:40.012789 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-edf70814-dee6-43c1-bba1-437920380e05 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:54:40.024474 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-edf70814-dee6-43c1-bba1-437920380e05 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:40.026368 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-edf70814-dee6-43c1-bba1-437920380e05 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:40.028040 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-edf70814-dee6-43c1-bba1-437920380e05 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:40.051001 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6c295421-cad5-4bac-ad97-09dbe64ceeb2 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:40.052381 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6c295421-cad5-4bac-ad97-09dbe64ceeb2 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:40.054074 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6c295421-cad5-4bac-ad97-09dbe64ceeb2 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:40.072984 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-edf70814-dee6-43c1-bba1-437920380e05 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 051c9371-d3e2-4166-bed5-c73dc77ec977] Going to try to stop instance {{(pid=127016) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 17 13:54:40.128189 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-6c295421-cad5-4bac-ad97-09dbe64ceeb2 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lazy-loading 'flavor' on Instance uuid 3cf7e278-5294-4b2e-9b46-8981392d5764 {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:54:40.168241 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6c295421-cad5-4bac-ad97-09dbe64ceeb2 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] 10.222.0.79 "PUT /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764/tags" status: 200 len: 61 microversion: 2.26 time: 0.228774 Oct 17 13:54:40.171297 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2060/4237] 10.222.0.79 () {62 vars in 1312 bytes} [Mon Oct 17 13:54:39 2022] PUT /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764/tags => generated 61 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:40.207320 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-edf70814-dee6-43c1-bba1-437920380e05 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "POST /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977/action" status: 202 len: 0 microversion: 2.1 time: 0.198692 Oct 17 13:54:40.221301 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2178/4238] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:54:40 2022] POST /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:54:40.236953 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9e4cc391-acb5-4e89-9723-aee7e77952a5 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Calling method '.version_select at 0x7f7cd42dd4c0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:40.267499 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9e4cc391-acb5-4e89-9723-aee7e77952a5 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:40.268144 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9e4cc391-acb5-4e89-9723-aee7e77952a5 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:40.268585 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9e4cc391-acb5-4e89-9723-aee7e77952a5 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:40.313065 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9e4cc391-acb5-4e89-9723-aee7e77952a5 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] 10.222.0.79 "GET /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764/tags" status: 200 len: 61 microversion: 2.26 time: 0.082672 Oct 17 13:54:40.314919 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2179/4239] 10.222.0.79 () {60 vars in 1292 bytes} [Mon Oct 17 13:54:40 2022] GET /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764/tags => generated 61 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:40.334603 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-22bb2a1d-bedf-400c-a4b7-1e86c9f8c9fc tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:40.338096 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-22bb2a1d-bedf-400c-a4b7-1e86c9f8c9fc tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 051c9371-d3e2-4166-bed5-c73dc77ec977] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:40.354101 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-22bb2a1d-bedf-400c-a4b7-1e86c9f8c9fc tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:40.354891 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-22bb2a1d-bedf-400c-a4b7-1e86c9f8c9fc tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:40.357804 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-22bb2a1d-bedf-400c-a4b7-1e86c9f8c9fc tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:40.359601 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-22bb2a1d-bedf-400c-a4b7-1e86c9f8c9fc tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:40.366000 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-22bb2a1d-bedf-400c-a4b7-1e86c9f8c9fc tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:40.366709 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-22bb2a1d-bedf-400c-a4b7-1e86c9f8c9fc tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:40.609088 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0ef978e3-30d3-452d-a9bd-a527400918cc tempest-AbsoluteLimitsTestJSON-1497198132 tempest-AbsoluteLimitsTestJSON-1497198132-project] Calling method '.version_select at 0x7f7cd55f79d0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:40.641568 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:54:40.672100 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-22bb2a1d-bedf-400c-a4b7-1e86c9f8c9fc tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:40.691048 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-22bb2a1d-bedf-400c-a4b7-1e86c9f8c9fc tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977" status: 200 len: 1511 microversion: 2.1 time: 0.373841 Oct 17 13:54:40.692862 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0ef978e3-30d3-452d-a9bd-a527400918cc tempest-AbsoluteLimitsTestJSON-1497198132 tempest-AbsoluteLimitsTestJSON-1497198132-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:40.700214 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0ef978e3-30d3-452d-a9bd-a527400918cc tempest-AbsoluteLimitsTestJSON-1497198132 tempest-AbsoluteLimitsTestJSON-1497198132-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:40.701654 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0ef978e3-30d3-452d-a9bd-a527400918cc tempest-AbsoluteLimitsTestJSON-1497198132 tempest-AbsoluteLimitsTestJSON-1497198132-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:40.702505 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0ef978e3-30d3-452d-a9bd-a527400918cc tempest-AbsoluteLimitsTestJSON-1497198132 tempest-AbsoluteLimitsTestJSON-1497198132-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:40.703972 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2180/4240] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:40 2022] GET /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977 => generated 1511 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:40.712031 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0ef978e3-30d3-452d-a9bd-a527400918cc tempest-AbsoluteLimitsTestJSON-1497198132 tempest-AbsoluteLimitsTestJSON-1497198132-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:40.713444 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0ef978e3-30d3-452d-a9bd-a527400918cc tempest-AbsoluteLimitsTestJSON-1497198132 tempest-AbsoluteLimitsTestJSON-1497198132-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:40.721206 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-841e91f4-861d-4fb6-824d-34a1c1997d9a tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Calling method '.version_select at 0x7f7cd440f8b0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:40.741383 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-841e91f4-861d-4fb6-824d-34a1c1997d9a tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:40.741873 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-841e91f4-861d-4fb6-824d-34a1c1997d9a tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:40.742310 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-841e91f4-861d-4fb6-824d-34a1c1997d9a tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:40.747647 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-841e91f4-861d-4fb6-824d-34a1c1997d9a tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] [instance: 3cf7e278-5294-4b2e-9b46-8981392d5764] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:40.754046 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0ef978e3-30d3-452d-a9bd-a527400918cc tempest-AbsoluteLimitsTestJSON-1497198132 tempest-AbsoluteLimitsTestJSON-1497198132-project] 10.222.0.79 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.581116 Oct 17 13:54:40.755024 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2061/4241] 10.222.0.79 () {58 vars in 1122 bytes} [Mon Oct 17 13:54:40 2022] GET /compute/v2.1/limits => generated 511 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:54:40.762386 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-841e91f4-861d-4fb6-824d-34a1c1997d9a tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:40.766303 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-841e91f4-861d-4fb6-824d-34a1c1997d9a tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:40.771034 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-841e91f4-861d-4fb6-824d-34a1c1997d9a tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:40.777046 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-841e91f4-861d-4fb6-824d-34a1c1997d9a tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:40.779112 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-841e91f4-861d-4fb6-824d-34a1c1997d9a tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:40.780508 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-841e91f4-861d-4fb6-824d-34a1c1997d9a tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:40.855191 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-841e91f4-861d-4fb6-824d-34a1c1997d9a tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:40.856453 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-841e91f4-861d-4fb6-824d-34a1c1997d9a tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:40.857151 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-841e91f4-861d-4fb6-824d-34a1c1997d9a tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:40.893484 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-841e91f4-861d-4fb6-824d-34a1c1997d9a tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lazy-loading 'flavor' on Instance uuid 3cf7e278-5294-4b2e-9b46-8981392d5764 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:54:40.934389 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-841e91f4-861d-4fb6-824d-34a1c1997d9a tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764/tags" status: 204 len: 0 microversion: 2.26 time: 0.226594 Oct 17 13:54:40.935979 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2181/4242] 10.222.0.79 () {60 vars in 1295 bytes} [Mon Oct 17 13:54:40 2022] DELETE /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764/tags => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:54:40.947468 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-efb892ea-2ffe-44cf-8b06-5bf7c164b22c tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:40.951313 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-efb892ea-2ffe-44cf-8b06-5bf7c164b22c tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] [instance: 3cf7e278-5294-4b2e-9b46-8981392d5764] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:40.971918 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-efb892ea-2ffe-44cf-8b06-5bf7c164b22c tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:40.972389 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-efb892ea-2ffe-44cf-8b06-5bf7c164b22c tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:40.976187 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-efb892ea-2ffe-44cf-8b06-5bf7c164b22c tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:40.978545 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-dd92f90d-11f4-49d4-b984-bd7147d06000 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:40.979771 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-efb892ea-2ffe-44cf-8b06-5bf7c164b22c tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:40.981590 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-dd92f90d-11f4-49d4-b984-bd7147d06000 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] [instance: 656925d8-a071-49b4-92b0-b74039bc96dc] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:40.983225 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-efb892ea-2ffe-44cf-8b06-5bf7c164b22c tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:40.984441 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-efb892ea-2ffe-44cf-8b06-5bf7c164b22c tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:41.008113 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dd92f90d-11f4-49d4-b984-bd7147d06000 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:41.012372 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dd92f90d-11f4-49d4-b984-bd7147d06000 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:41.012890 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dd92f90d-11f4-49d4-b984-bd7147d06000 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:41.017878 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dd92f90d-11f4-49d4-b984-bd7147d06000 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:41.018466 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dd92f90d-11f4-49d4-b984-bd7147d06000 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:41.018924 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dd92f90d-11f4-49d4-b984-bd7147d06000 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:41.069044 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-efb892ea-2ffe-44cf-8b06-5bf7c164b22c tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] [instance: 3cf7e278-5294-4b2e-9b46-8981392d5764] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:54:41.202274 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-dd92f90d-11f4-49d4-b984-bd7147d06000 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:41.216378 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-dd92f90d-11f4-49d4-b984-bd7147d06000 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:41.217823 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-dd92f90d-11f4-49d4-b984-bd7147d06000 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:41.221892 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-dd92f90d-11f4-49d4-b984-bd7147d06000 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] 10.222.0.79 "GET /compute/v2.1/servers/656925d8-a071-49b4-92b0-b74039bc96dc" status: 200 len: 1357 microversion: 2.57 time: 0.265812 Oct 17 13:54:41.249473 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2182/4243] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:40 2022] GET /compute/v2.1/servers/656925d8-a071-49b4-92b0-b74039bc96dc => generated 1357 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:54:41.277227 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6cd994be-e7e6-4ed5-8284-67d9e6fc1ab6 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:41.278594 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6cd994be-e7e6-4ed5-8284-67d9e6fc1ab6 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] [instance: 656925d8-a071-49b4-92b0-b74039bc96dc] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:41.294631 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6cd994be-e7e6-4ed5-8284-67d9e6fc1ab6 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:41.295467 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6cd994be-e7e6-4ed5-8284-67d9e6fc1ab6 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:41.300010 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6cd994be-e7e6-4ed5-8284-67d9e6fc1ab6 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:41.301250 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6cd994be-e7e6-4ed5-8284-67d9e6fc1ab6 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:41.302143 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6cd994be-e7e6-4ed5-8284-67d9e6fc1ab6 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:41.302835 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6cd994be-e7e6-4ed5-8284-67d9e6fc1ab6 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:41.343841 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-efb892ea-2ffe-44cf-8b06-5bf7c164b22c tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764" status: 204 len: 0 microversion: 2.26 time: 0.401283 Oct 17 13:54:41.344555 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2062/4244] 10.222.0.79 () {60 vars in 1280 bytes} [Mon Oct 17 13:54:40 2022] DELETE /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:54:41.356279 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-53d94b76-8535-4935-905d-6a413bfb4dfe tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:41.359105 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-53d94b76-8535-4935-905d-6a413bfb4dfe tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] [instance: 3cf7e278-5294-4b2e-9b46-8981392d5764] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:41.372123 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-53d94b76-8535-4935-905d-6a413bfb4dfe tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:41.372988 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-53d94b76-8535-4935-905d-6a413bfb4dfe tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:41.373637 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-53d94b76-8535-4935-905d-6a413bfb4dfe tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:41.375400 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-53d94b76-8535-4935-905d-6a413bfb4dfe tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:41.376250 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-53d94b76-8535-4935-905d-6a413bfb4dfe tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:41.376952 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-53d94b76-8535-4935-905d-6a413bfb4dfe tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:41.398023 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6cd994be-e7e6-4ed5-8284-67d9e6fc1ab6 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] [instance: 656925d8-a071-49b4-92b0-b74039bc96dc] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:54:41.614173 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6cd994be-e7e6-4ed5-8284-67d9e6fc1ab6 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] 10.222.0.79 "DELETE /compute/v2.1/servers/656925d8-a071-49b4-92b0-b74039bc96dc" status: 204 len: 0 microversion: 2.57 time: 0.349212 Oct 17 13:54:41.614981 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2183/4245] 10.222.0.79 () {60 vars in 1280 bytes} [Mon Oct 17 13:54:41 2022] DELETE /compute/v2.1/servers/656925d8-a071-49b4-92b0-b74039bc96dc => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:54:41.624912 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5c7cc33e-a569-4d9a-93ff-3b1576a44eb9 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:41.631355 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5c7cc33e-a569-4d9a-93ff-3b1576a44eb9 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] [instance: 656925d8-a071-49b4-92b0-b74039bc96dc] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:41.642078 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5c7cc33e-a569-4d9a-93ff-3b1576a44eb9 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:41.642820 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5c7cc33e-a569-4d9a-93ff-3b1576a44eb9 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:41.643450 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5c7cc33e-a569-4d9a-93ff-3b1576a44eb9 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:41.644724 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5c7cc33e-a569-4d9a-93ff-3b1576a44eb9 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:41.645448 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5c7cc33e-a569-4d9a-93ff-3b1576a44eb9 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:41.646180 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5c7cc33e-a569-4d9a-93ff-3b1576a44eb9 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:41.773880 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-53d94b76-8535-4935-905d-6a413bfb4dfe tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958ae6fcf04486ba0de669284420b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132e34c2ebdd41548f0915fa502b0c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:41.788001 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-53d94b76-8535-4935-905d-6a413bfb4dfe tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9958ae6fcf04486ba0de669284420b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132e34c2ebdd41548f0915fa502b0c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:41.791569 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-53d94b76-8535-4935-905d-6a413bfb4dfe tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9958ae6fcf04486ba0de669284420b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132e34c2ebdd41548f0915fa502b0c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:41.797751 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-53d94b76-8535-4935-905d-6a413bfb4dfe tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] 10.222.0.79 "GET /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764" status: 200 len: 1551 microversion: 2.26 time: 0.447558 Oct 17 13:54:41.814983 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2063/4246] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:41 2022] GET /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764 => generated 1551 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:54:41.837619 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7e4745f0-cbaf-48c9-9735-4d3d3592e938 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:41.838256 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7e4745f0-cbaf-48c9-9735-4d3d3592e938 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 051c9371-d3e2-4166-bed5-c73dc77ec977] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:41.844624 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7e4745f0-cbaf-48c9-9735-4d3d3592e938 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:41.844989 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5c7cc33e-a569-4d9a-93ff-3b1576a44eb9 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:41.845124 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7e4745f0-cbaf-48c9-9735-4d3d3592e938 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:41.846214 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7e4745f0-cbaf-48c9-9735-4d3d3592e938 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:41.847429 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7e4745f0-cbaf-48c9-9735-4d3d3592e938 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:41.848099 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7e4745f0-cbaf-48c9-9735-4d3d3592e938 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:41.848688 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7e4745f0-cbaf-48c9-9735-4d3d3592e938 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:41.859372 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5c7cc33e-a569-4d9a-93ff-3b1576a44eb9 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:41.865384 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5c7cc33e-a569-4d9a-93ff-3b1576a44eb9 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:41.867687 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5c7cc33e-a569-4d9a-93ff-3b1576a44eb9 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] 10.222.0.79 "GET /compute/v2.1/servers/656925d8-a071-49b4-92b0-b74039bc96dc" status: 200 len: 1363 microversion: 2.57 time: 0.246826 Oct 17 13:54:41.868794 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2184/4247] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:41 2022] GET /compute/v2.1/servers/656925d8-a071-49b4-92b0-b74039bc96dc => generated 1363 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:54:42.084397 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7e4745f0-cbaf-48c9-9735-4d3d3592e938 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:42.128834 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7e4745f0-cbaf-48c9-9735-4d3d3592e938 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977" status: 200 len: 1511 microversion: 2.1 time: 0.311853 Oct 17 13:54:42.130806 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2064/4248] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:41 2022] GET /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977 => generated 1511 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:42.190005 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4252196d-4a97-401e-9fc4-730b6303fc98 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:42.191093 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4252196d-4a97-401e-9fc4-730b6303fc98 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] [instance: b54d449b-422b-4ca0-8183-02eb28c30747] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:42.212581 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4252196d-4a97-401e-9fc4-730b6303fc98 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:42.213070 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4252196d-4a97-401e-9fc4-730b6303fc98 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:42.213505 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4252196d-4a97-401e-9fc4-730b6303fc98 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:42.214213 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4252196d-4a97-401e-9fc4-730b6303fc98 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:42.214657 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4252196d-4a97-401e-9fc4-730b6303fc98 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:42.215077 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4252196d-4a97-401e-9fc4-730b6303fc98 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:42.293561 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4252196d-4a97-401e-9fc4-730b6303fc98 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] [instance: b54d449b-422b-4ca0-8183-02eb28c30747] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:54:42.506464 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-cf63a748-12e2-453f-88d2-b8f06a7328b7 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:42.506988 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-cf63a748-12e2-453f-88d2-b8f06a7328b7 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 90bfb179-c8b6-4810-a981-33b78a19b62c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:42.512467 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4252196d-4a97-401e-9fc4-730b6303fc98 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] 10.222.0.79 "DELETE /compute/v2.1/servers/b54d449b-422b-4ca0-8183-02eb28c30747" status: 204 len: 0 microversion: 2.1 time: 0.326468 Oct 17 13:54:42.516361 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2185/4249] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:54:42 2022] DELETE /compute/v2.1/servers/b54d449b-422b-4ca0-8183-02eb28c30747 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:54:42.520429 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cf63a748-12e2-453f-88d2-b8f06a7328b7 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:42.520941 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cf63a748-12e2-453f-88d2-b8f06a7328b7 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:42.521346 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cf63a748-12e2-453f-88d2-b8f06a7328b7 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:42.522040 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cf63a748-12e2-453f-88d2-b8f06a7328b7 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:42.522215 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-16905254-a46f-44ae-967c-a9ac265cf63a tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:42.522482 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cf63a748-12e2-453f-88d2-b8f06a7328b7 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:42.523768 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-16905254-a46f-44ae-967c-a9ac265cf63a tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] [instance: b54d449b-422b-4ca0-8183-02eb28c30747] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:42.530721 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cf63a748-12e2-453f-88d2-b8f06a7328b7 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:42.539999 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-16905254-a46f-44ae-967c-a9ac265cf63a tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:42.540731 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-16905254-a46f-44ae-967c-a9ac265cf63a tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:42.541356 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-16905254-a46f-44ae-967c-a9ac265cf63a tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:42.542941 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-16905254-a46f-44ae-967c-a9ac265cf63a tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:42.545869 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-16905254-a46f-44ae-967c-a9ac265cf63a tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:42.546562 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-16905254-a46f-44ae-967c-a9ac265cf63a tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:42.561417 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-cf63a748-12e2-453f-88d2-b8f06a7328b7 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] HTTP exception thrown: Instance 90bfb179-c8b6-4810-a981-33b78a19b62c could not be found. Oct 17 13:54:42.565506 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-cf63a748-12e2-453f-88d2-b8f06a7328b7 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Request method failure captured: Oct 17 13:54:42.565506 n-d-854247-14 devstack@n-api.service[127017]: request: DELETE /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c HTTP/1.1 Oct 17 13:54:42.565506 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:54:42.565506 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:54:42.565506 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:54:42.565506 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:54:42.565506 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:54:42.565506 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:54:42.565506 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:54:42.565506 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:54:42.565506 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTV0JL7NQSDQqh4ZMvkCDXT2fwovcCgk-nxK1nRG4B-HeC5OA7y2_TQv_yPRGTaQ-3zvHufQBJMrO1ZhsIWZZ0ugPMuvlokQmhLWi-H9zySFSYK0iM1qNABohwKQ4S7v-F2ZGFUB1jMKnP05ShlKiL4M8_7Jns7W8GDQtoUfjwQ0M1Lk Oct 17 13:54:42.565506 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:54:42.565506 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:54:42.565506 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:54:42.565506 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:54:42.565506 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:54:42.565506 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:54:42.565506 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 4acd31ce63b64ac3a05b76d4a9fdf7c0 Oct 17 13:54:42.565506 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-AttachVolumeNegativeTest-1792618646 Oct 17 13:54:42.565506 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:54:42.565506 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:54:42.565506 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4acd31ce63b64ac3a05b76d4a9fdf7c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4acd31ce63b64ac3a05b76d4a9fdf7c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4acd31ce63b64ac3a05b76d4a9fdf7c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4acd31ce63b64ac3a05b76d4a9fdf7c0", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:54:42.565506 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-AttachVolumeNegativeTest-1792618646 Oct 17 13:54:42.565506 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 4acd31ce63b64ac3a05b76d4a9fdf7c0 Oct 17 13:54:42.565506 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1792618646 Oct 17 13:54:42.565506 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-AttachVolumeNegativeTest-1792618646-project Oct 17 13:54:42.565506 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:54:42.565506 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:54:42.565506 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: c7a7b9b048234fd2926739e3f08400b0 Oct 17 13:54:42.565506 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-AttachVolumeNegativeTest-1792618646-project Oct 17 13:54:42.565506 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:54:42.565506 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 90bfb179-c8b6-4810-a981-33b78a19b62c could not be found. Oct 17 13:54:42.565506 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '90bfb179-c8b6-4810-a981-33b78a19b62c'} Oct 17 13:54:42.565506 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:54:42.565506 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:54:42.565506 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:54:42.565506 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:54:42.565506 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:54:42.565506 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:54:42.565506 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:54:42.565506 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:54:42.565506 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:54:42.565506 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:54:42.565506 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90bfb179-c8b6-4810-a981-33b78a19b62c could not be found. Oct 17 13:54:42.565506 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:42.565506 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:54:42.565506 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:42.565506 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:54:42.565506 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:54:42.565506 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:54:42.565506 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:54:42.565506 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:54:42.565506 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:54:42.565506 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:54:42.565506 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:54:42.565506 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:54:42.565506 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:54:42.565506 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:54:42.565506 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:54:42.565506 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:54:42.565506 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:54:42.565506 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:54:42.571658 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90bfb179-c8b6-4810-a981-33b78a19b62c could not be found. Oct 17 13:54:42.571658 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:42.571658 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:54:42.571658 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:42.571658 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:54:42.571658 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:54:42.571658 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:54:42.571658 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:54:42.571658 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:54:42.571658 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90bfb179-c8b6-4810-a981-33b78a19b62c could not be found. Oct 17 13:54:42.571658 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:42.571658 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-cf63a748-12e2-453f-88d2-b8f06a7328b7 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Returning 404 to user: Instance 90bfb179-c8b6-4810-a981-33b78a19b62c could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:54:42.571658 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-cf63a748-12e2-453f-88d2-b8f06a7328b7 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "DELETE /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c" status: 404 len: 111 microversion: 2.1 time: 0.064913 Oct 17 13:54:42.577196 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2065/4250] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:54:42 2022] DELETE /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:54:42.580207 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d7d84e47-45ba-4bcc-b1ba-bb847e258906 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:42.580831 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d7d84e47-45ba-4bcc-b1ba-bb847e258906 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 90bfb179-c8b6-4810-a981-33b78a19b62c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:42.594873 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d7d84e47-45ba-4bcc-b1ba-bb847e258906 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:42.601295 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d7d84e47-45ba-4bcc-b1ba-bb847e258906 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:42.601787 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d7d84e47-45ba-4bcc-b1ba-bb847e258906 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:42.605392 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d7d84e47-45ba-4bcc-b1ba-bb847e258906 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:42.606223 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d7d84e47-45ba-4bcc-b1ba-bb847e258906 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:42.606976 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d7d84e47-45ba-4bcc-b1ba-bb847e258906 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:42.658425 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-d7d84e47-45ba-4bcc-b1ba-bb847e258906 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] HTTP exception thrown: Instance 90bfb179-c8b6-4810-a981-33b78a19b62c could not be found. Oct 17 13:54:42.665639 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d7d84e47-45ba-4bcc-b1ba-bb847e258906 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Request method failure captured: Oct 17 13:54:42.665639 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c HTTP/1.1 Oct 17 13:54:42.665639 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:54:42.665639 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:54:42.665639 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:54:42.665639 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:54:42.665639 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:54:42.665639 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:54:42.665639 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:54:42.665639 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:54:42.665639 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTV0JL7NQSDQqh4ZMvkCDXT2fwovcCgk-nxK1nRG4B-HeC5OA7y2_TQv_yPRGTaQ-3zvHufQBJMrO1ZhsIWZZ0ugPMuvlokQmhLWi-H9zySFSYK0iM1qNABohwKQ4S7v-F2ZGFUB1jMKnP05ShlKiL4M8_7Jns7W8GDQtoUfjwQ0M1Lk Oct 17 13:54:42.665639 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:54:42.665639 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:54:42.665639 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:54:42.665639 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:54:42.665639 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:54:42.665639 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:54:42.665639 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 4acd31ce63b64ac3a05b76d4a9fdf7c0 Oct 17 13:54:42.665639 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-AttachVolumeNegativeTest-1792618646 Oct 17 13:54:42.665639 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:54:42.665639 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:54:42.665639 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4acd31ce63b64ac3a05b76d4a9fdf7c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4acd31ce63b64ac3a05b76d4a9fdf7c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4acd31ce63b64ac3a05b76d4a9fdf7c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4acd31ce63b64ac3a05b76d4a9fdf7c0", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:54:42.665639 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-AttachVolumeNegativeTest-1792618646 Oct 17 13:54:42.665639 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 4acd31ce63b64ac3a05b76d4a9fdf7c0 Oct 17 13:54:42.665639 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1792618646 Oct 17 13:54:42.665639 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-AttachVolumeNegativeTest-1792618646-project Oct 17 13:54:42.665639 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:54:42.665639 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:54:42.665639 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: c7a7b9b048234fd2926739e3f08400b0 Oct 17 13:54:42.665639 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-AttachVolumeNegativeTest-1792618646-project Oct 17 13:54:42.665639 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:54:42.665639 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 90bfb179-c8b6-4810-a981-33b78a19b62c could not be found. Oct 17 13:54:42.665639 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '90bfb179-c8b6-4810-a981-33b78a19b62c'} Oct 17 13:54:42.665639 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:54:42.665639 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:54:42.665639 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:54:42.665639 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:54:42.665639 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:54:42.665639 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:54:42.665639 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:54:42.665639 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:54:42.665639 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:54:42.665639 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:54:42.665639 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90bfb179-c8b6-4810-a981-33b78a19b62c could not be found. Oct 17 13:54:42.665639 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:42.665639 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:54:42.665639 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:42.665639 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:54:42.665639 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:54:42.665639 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:54:42.665639 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:54:42.665639 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:54:42.665639 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:54:42.665639 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:54:42.665639 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:54:42.665639 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:54:42.665639 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:54:42.665639 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:54:42.665639 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:54:42.665639 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:54:42.665639 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90bfb179-c8b6-4810-a981-33b78a19b62c could not be found. Oct 17 13:54:42.665639 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:42.665639 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:54:42.665639 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:42.669500 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:54:42.669500 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:54:42.669500 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:54:42.669500 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:54:42.669500 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:54:42.669500 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90bfb179-c8b6-4810-a981-33b78a19b62c could not be found. Oct 17 13:54:42.669500 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:42.687966 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d7d84e47-45ba-4bcc-b1ba-bb847e258906 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Returning 404 to user: Instance 90bfb179-c8b6-4810-a981-33b78a19b62c could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:54:42.689364 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d7d84e47-45ba-4bcc-b1ba-bb847e258906 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c" status: 404 len: 111 microversion: 2.1 time: 0.113090 Oct 17 13:54:42.699563 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2066/4251] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:42 2022] GET /compute/v2.1/servers/90bfb179-c8b6-4810-a981-33b78a19b62c => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:54:42.831343 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e3c292cd-5a20-4a12-9f7c-96197cab6991 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:42.832297 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e3c292cd-5a20-4a12-9f7c-96197cab6991 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] [instance: 3cf7e278-5294-4b2e-9b46-8981392d5764] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:42.845965 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e3c292cd-5a20-4a12-9f7c-96197cab6991 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:42.850720 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e3c292cd-5a20-4a12-9f7c-96197cab6991 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:42.851642 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e3c292cd-5a20-4a12-9f7c-96197cab6991 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:42.854269 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-16905254-a46f-44ae-967c-a9ac265cf63a tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb634956c1764e508400b08750ecc9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23d1c84c66c43bc9daf9d3028663f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:42.854817 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e3c292cd-5a20-4a12-9f7c-96197cab6991 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:42.855650 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e3c292cd-5a20-4a12-9f7c-96197cab6991 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:42.857784 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e3c292cd-5a20-4a12-9f7c-96197cab6991 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:42.867781 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-16905254-a46f-44ae-967c-a9ac265cf63a tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] 10.222.0.79 "GET /compute/v2.1/servers/b54d449b-422b-4ca0-8183-02eb28c30747" status: 200 len: 1504 microversion: 2.1 time: 0.349334 Oct 17 13:54:42.868941 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2186/4252] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:42 2022] GET /compute/v2.1/servers/b54d449b-422b-4ca0-8183-02eb28c30747 => generated 1504 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:42.900598 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f8351a39-fd90-4429-a698-8e733ab1c863 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:42.902798 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f8351a39-fd90-4429-a698-8e733ab1c863 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] [instance: 656925d8-a071-49b4-92b0-b74039bc96dc] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:42.923255 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f8351a39-fd90-4429-a698-8e733ab1c863 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:42.927093 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f8351a39-fd90-4429-a698-8e733ab1c863 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:42.927924 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f8351a39-fd90-4429-a698-8e733ab1c863 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:42.929384 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f8351a39-fd90-4429-a698-8e733ab1c863 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:42.930601 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f8351a39-fd90-4429-a698-8e733ab1c863 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:42.931487 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f8351a39-fd90-4429-a698-8e733ab1c863 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:43.192624 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f8351a39-fd90-4429-a698-8e733ab1c863 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:43.198541 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=92,nova_cell1:DELETE=2,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:54:43.214422 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f8351a39-fd90-4429-a698-8e733ab1c863 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:43.216410 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f8351a39-fd90-4429-a698-8e733ab1c863 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:43.218959 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f8351a39-fd90-4429-a698-8e733ab1c863 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] 10.222.0.79 "GET /compute/v2.1/servers/656925d8-a071-49b4-92b0-b74039bc96dc" status: 200 len: 1363 microversion: 2.57 time: 0.325501 Oct 17 13:54:43.232398 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2187/4253] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:42 2022] GET /compute/v2.1/servers/656925d8-a071-49b4-92b0-b74039bc96dc => generated 1363 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:54:43.627361 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e3c292cd-5a20-4a12-9f7c-96197cab6991 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958ae6fcf04486ba0de669284420b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132e34c2ebdd41548f0915fa502b0c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:43.645330 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e3c292cd-5a20-4a12-9f7c-96197cab6991 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9958ae6fcf04486ba0de669284420b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132e34c2ebdd41548f0915fa502b0c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:43.648072 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e3c292cd-5a20-4a12-9f7c-96197cab6991 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9958ae6fcf04486ba0de669284420b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132e34c2ebdd41548f0915fa502b0c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:43.653141 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e3c292cd-5a20-4a12-9f7c-96197cab6991 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] 10.222.0.79 "GET /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764" status: 200 len: 1551 microversion: 2.26 time: 0.825536 Oct 17 13:54:43.655223 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2067/4254] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:42 2022] GET /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764 => generated 1551 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:54:43.666555 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-992a6cc1-6465-404f-8969-fbd9670b8bfa tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:43.668415 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-992a6cc1-6465-404f-8969-fbd9670b8bfa tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 051c9371-d3e2-4166-bed5-c73dc77ec977] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:43.689920 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-992a6cc1-6465-404f-8969-fbd9670b8bfa tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:43.692414 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-992a6cc1-6465-404f-8969-fbd9670b8bfa tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:43.693061 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-992a6cc1-6465-404f-8969-fbd9670b8bfa tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:43.695095 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-992a6cc1-6465-404f-8969-fbd9670b8bfa tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:43.696971 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-992a6cc1-6465-404f-8969-fbd9670b8bfa tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:43.697623 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-992a6cc1-6465-404f-8969-fbd9670b8bfa tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:43.751794 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=90,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=4,nova_cell1:RELEASE=2,nova_cell1:DELETE=1,nova_cell1:UPDATE=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:54:43.993569 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-697f43e4-b1d0-4d13-bf99-6756844afe9a tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-998612558", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "3f2529cd-826e-4c98-933e-847df0496456"}]}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:54:44.136162 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-697f43e4-b1d0-4d13-bf99-6756844afe9a tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] validate_networks() for [('3f2529cd-826e-4c98-933e-847df0496456', None, None, None, None, None)] {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:54:44.193540 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-992a6cc1-6465-404f-8969-fbd9670b8bfa tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:44.206126 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-992a6cc1-6465-404f-8969-fbd9670b8bfa tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977" status: 200 len: 1511 microversion: 2.1 time: 0.549603 Oct 17 13:54:44.206725 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2068/4255] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:43 2022] GET /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977 => generated 1511 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:44.248458 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c5f8d5dc-8acf-477e-a3a2-6d5c641f0845 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:44.249304 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c5f8d5dc-8acf-477e-a3a2-6d5c641f0845 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] [instance: b54d449b-422b-4ca0-8183-02eb28c30747] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:44.264950 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c5f8d5dc-8acf-477e-a3a2-6d5c641f0845 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:44.266243 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c5f8d5dc-8acf-477e-a3a2-6d5c641f0845 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:44.266690 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c5f8d5dc-8acf-477e-a3a2-6d5c641f0845 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:44.269770 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c5f8d5dc-8acf-477e-a3a2-6d5c641f0845 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:44.271849 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c5f8d5dc-8acf-477e-a3a2-6d5c641f0845 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:44.272597 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c5f8d5dc-8acf-477e-a3a2-6d5c641f0845 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:44.656567 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c5f8d5dc-8acf-477e-a3a2-6d5c641f0845 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb634956c1764e508400b08750ecc9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23d1c84c66c43bc9daf9d3028663f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:44.667297 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c5f8d5dc-8acf-477e-a3a2-6d5c641f0845 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] 10.222.0.79 "GET /compute/v2.1/servers/b54d449b-422b-4ca0-8183-02eb28c30747" status: 200 len: 1504 microversion: 2.1 time: 0.439206 Oct 17 13:54:44.672657 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2069/4256] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:44 2022] GET /compute/v2.1/servers/b54d449b-422b-4ca0-8183-02eb28c30747 => generated 1504 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:44.684681 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5ac6393c-a206-4593-bdd0-fd0de18bd5a4 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:44.685703 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5ac6393c-a206-4593-bdd0-fd0de18bd5a4 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] [instance: 656925d8-a071-49b4-92b0-b74039bc96dc] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:44.702475 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5ac6393c-a206-4593-bdd0-fd0de18bd5a4 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:44.703542 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5ac6393c-a206-4593-bdd0-fd0de18bd5a4 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:44.704218 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5ac6393c-a206-4593-bdd0-fd0de18bd5a4 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:44.705159 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5ac6393c-a206-4593-bdd0-fd0de18bd5a4 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:44.708854 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5ac6393c-a206-4593-bdd0-fd0de18bd5a4 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:44.709650 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5ac6393c-a206-4593-bdd0-fd0de18bd5a4 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:44.968083 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5ac6393c-a206-4593-bdd0-fd0de18bd5a4 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:44.992834 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5ac6393c-a206-4593-bdd0-fd0de18bd5a4 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:44.993397 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5ac6393c-a206-4593-bdd0-fd0de18bd5a4 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1364a32d181d432fb01b09be9e54d35b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84a797e25df4f94bd63e0f486f63408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:45.001768 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5ac6393c-a206-4593-bdd0-fd0de18bd5a4 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] 10.222.0.79 "GET /compute/v2.1/servers/656925d8-a071-49b4-92b0-b74039bc96dc" status: 200 len: 1363 microversion: 2.57 time: 0.326991 Oct 17 13:54:45.002803 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2070/4257] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:44 2022] GET /compute/v2.1/servers/656925d8-a071-49b4-92b0-b74039bc96dc => generated 1363 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:54:45.011338 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-43d9f8e8-fb97-457e-9d7d-cb283aec2fd9 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:45.013264 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-43d9f8e8-fb97-457e-9d7d-cb283aec2fd9 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] [instance: 3cf7e278-5294-4b2e-9b46-8981392d5764] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:45.026537 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-43d9f8e8-fb97-457e-9d7d-cb283aec2fd9 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:45.031539 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-43d9f8e8-fb97-457e-9d7d-cb283aec2fd9 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:45.032388 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-43d9f8e8-fb97-457e-9d7d-cb283aec2fd9 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:45.033605 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-43d9f8e8-fb97-457e-9d7d-cb283aec2fd9 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:45.034811 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-43d9f8e8-fb97-457e-9d7d-cb283aec2fd9 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:45.037205 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-43d9f8e8-fb97-457e-9d7d-cb283aec2fd9 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:45.506039 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-43d9f8e8-fb97-457e-9d7d-cb283aec2fd9 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958ae6fcf04486ba0de669284420b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132e34c2ebdd41548f0915fa502b0c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:45.541307 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-43d9f8e8-fb97-457e-9d7d-cb283aec2fd9 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9958ae6fcf04486ba0de669284420b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132e34c2ebdd41548f0915fa502b0c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:45.542903 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-43d9f8e8-fb97-457e-9d7d-cb283aec2fd9 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9958ae6fcf04486ba0de669284420b37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '132e34c2ebdd41548f0915fa502b0c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:45.554935 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-43d9f8e8-fb97-457e-9d7d-cb283aec2fd9 tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] 10.222.0.79 "GET /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764" status: 200 len: 1347 microversion: 2.26 time: 0.549965 Oct 17 13:54:45.568232 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2071/4258] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:45 2022] GET /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764 => generated 1347 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:54:45.590545 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-408de5cc-d435-4e11-ab04-3359a00b2795 req-23c01785-80db-43f2-a4d7-9263dd9d2d13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cf7e278-5294-4b2e-9b46-8981392d5764", "name": "network-vif-deleted", "tag": "5f311b5b-8ecb-49ae-8938-b8137f8c070a"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:54:45.606231 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-408de5cc-d435-4e11-ab04-3359a00b2795 req-23c01785-80db-43f2-a4d7-9263dd9d2d13 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:45.607074 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-408de5cc-d435-4e11-ab04-3359a00b2795 req-23c01785-80db-43f2-a4d7-9263dd9d2d13 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:45.607690 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-408de5cc-d435-4e11-ab04-3359a00b2795 req-23c01785-80db-43f2-a4d7-9263dd9d2d13 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:45.627138 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-697f43e4-b1d0-4d13-bf99-6756844afe9a tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:54:45.628876 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-697f43e4-b1d0-4d13-bf99-6756844afe9a tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:54:45.629795 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-697f43e4-b1d0-4d13-bf99-6756844afe9a tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:54:45.630398 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-697f43e4-b1d0-4d13-bf99-6756844afe9a tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:54:45.631032 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-697f43e4-b1d0-4d13-bf99-6756844afe9a tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:54:45.652079 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-697f43e4-b1d0-4d13-bf99-6756844afe9a tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:45.652870 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-697f43e4-b1d0-4d13-bf99-6756844afe9a tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:45.653611 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-408de5cc-d435-4e11-ab04-3359a00b2795 req-23c01785-80db-43f2-a4d7-9263dd9d2d13 service nova] Creating event network-vif-deleted:5f311b5b-8ecb-49ae-8938-b8137f8c070a for instance 3cf7e278-5294-4b2e-9b46-8981392d5764 on n-h2-854247-14 Oct 17 13:54:45.654170 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-697f43e4-b1d0-4d13-bf99-6756844afe9a tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:45.655131 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-697f43e4-b1d0-4d13-bf99-6756844afe9a tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:45.655800 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-697f43e4-b1d0-4d13-bf99-6756844afe9a tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:45.656394 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-697f43e4-b1d0-4d13-bf99-6756844afe9a tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:45.673248 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-408de5cc-d435-4e11-ab04-3359a00b2795 req-23c01785-80db-43f2-a4d7-9263dd9d2d13 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103186 Oct 17 13:54:45.676771 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2072/4259] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:54:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:54:45.690950 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9a3d1b80-410b-4290-86d5-0e6617974966 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:45.695725 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9a3d1b80-410b-4290-86d5-0e6617974966 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 051c9371-d3e2-4166-bed5-c73dc77ec977] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:45.714109 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9a3d1b80-410b-4290-86d5-0e6617974966 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:45.715646 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9a3d1b80-410b-4290-86d5-0e6617974966 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:45.715994 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-697f43e4-b1d0-4d13-bf99-6756844afe9a tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Getting quotas for project 3a4cc8d4a7a8463eb099756488bca536. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:54:45.716921 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9a3d1b80-410b-4290-86d5-0e6617974966 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:45.717738 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9a3d1b80-410b-4290-86d5-0e6617974966 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:45.720389 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9a3d1b80-410b-4290-86d5-0e6617974966 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:45.720927 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9a3d1b80-410b-4290-86d5-0e6617974966 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:45.736158 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-697f43e4-b1d0-4d13-bf99-6756844afe9a tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Getting quotas for user 6618084b720b47f9b56b29849f0cc995 and project 3a4cc8d4a7a8463eb099756488bca536. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:54:45.798646 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-697f43e4-b1d0-4d13-bf99-6756844afe9a tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:54:45.817284 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-697f43e4-b1d0-4d13-bf99-6756844afe9a tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] [instance: 5eca5e25-1250-4f67-9a40-cc806333cb16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:54:45.939714 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-697f43e4-b1d0-4d13-bf99-6756844afe9a tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.705343 Oct 17 13:54:45.941054 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2188/4260] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:54:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:54:45.955488 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d44270ff-0c35-4b02-bb49-bac7b27d9235 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:45.956197 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d44270ff-0c35-4b02-bb49-bac7b27d9235 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] [instance: b54d449b-422b-4ca0-8183-02eb28c30747] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:45.971323 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d44270ff-0c35-4b02-bb49-bac7b27d9235 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:45.972496 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d44270ff-0c35-4b02-bb49-bac7b27d9235 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:45.974115 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d44270ff-0c35-4b02-bb49-bac7b27d9235 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:45.975023 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d44270ff-0c35-4b02-bb49-bac7b27d9235 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:45.975620 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d44270ff-0c35-4b02-bb49-bac7b27d9235 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:45.976158 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d44270ff-0c35-4b02-bb49-bac7b27d9235 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:46.371794 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9a3d1b80-410b-4290-86d5-0e6617974966 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:46.382082 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9a3d1b80-410b-4290-86d5-0e6617974966 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977" status: 200 len: 1511 microversion: 2.1 time: 0.701720 Oct 17 13:54:46.387783 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2073/4261] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:45 2022] GET /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977 => generated 1511 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:46.400117 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-92996a54-a23a-4031-8c20-05aebee44373 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:46.404907 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-92996a54-a23a-4031-8c20-05aebee44373 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] [instance: 5eca5e25-1250-4f67-9a40-cc806333cb16] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:46.550095 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-92996a54-a23a-4031-8c20-05aebee44373 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6618084b720b47f9b56b29849f0cc995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4cc8d4a7a8463eb099756488bca536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:46.562919 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-92996a54-a23a-4031-8c20-05aebee44373 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] 10.222.0.79 "GET /compute/v2.1/servers/5eca5e25-1250-4f67-9a40-cc806333cb16" status: 200 len: 1216 microversion: 2.1 time: 0.173558 Oct 17 13:54:46.565314 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2074/4262] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:46 2022] GET /compute/v2.1/servers/5eca5e25-1250-4f67-9a40-cc806333cb16 => generated 1216 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:46.581443 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f3d56a58-193f-4cad-b718-b5b78997a554 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:46.583029 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f3d56a58-193f-4cad-b718-b5b78997a554 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] [instance: 656925d8-a071-49b4-92b0-b74039bc96dc] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:46.607144 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f3d56a58-193f-4cad-b718-b5b78997a554 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:46.610044 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f3d56a58-193f-4cad-b718-b5b78997a554 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:46.610611 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f3d56a58-193f-4cad-b718-b5b78997a554 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:46.615931 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f3d56a58-193f-4cad-b718-b5b78997a554 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:46.616313 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f3d56a58-193f-4cad-b718-b5b78997a554 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:46.616755 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f3d56a58-193f-4cad-b718-b5b78997a554 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:46.652777 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d44270ff-0c35-4b02-bb49-bac7b27d9235 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb634956c1764e508400b08750ecc9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23d1c84c66c43bc9daf9d3028663f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:46.662315 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d44270ff-0c35-4b02-bb49-bac7b27d9235 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] 10.222.0.79 "GET /compute/v2.1/servers/b54d449b-422b-4ca0-8183-02eb28c30747" status: 200 len: 1504 microversion: 2.1 time: 0.719923 Oct 17 13:54:46.666233 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2189/4263] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:45 2022] GET /compute/v2.1/servers/b54d449b-422b-4ca0-8183-02eb28c30747 => generated 1504 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:46.693390 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f2da277b-a04f-4c78-857d-40e88f88b88f tempest-VolumesTestJSON-59672609 tempest-VolumesTestJSON-59672609-project] Calling method '.version_select at 0x7f7cd45b4820>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:46.693531 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-f3d56a58-193f-4cad-b718-b5b78997a554 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] HTTP exception thrown: Instance 656925d8-a071-49b4-92b0-b74039bc96dc could not be found. Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f3d56a58-193f-4cad-b718-b5b78997a554 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Request method failure captured: Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/656925d8-a071-49b4-92b0-b74039bc96dc HTTP/1.1 Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTV56zOH62TaDXxGJp5AOVJQ2Y65GhS7GW8BDoaQAsCBo-bZeYmSep-E7J4o_X7uqkloPp-kcFUrTlkMnln7qBzMliXLAYm_7NoQVfdl4fGbk-B7v_uHjwiAlGSmPG_S5k1nJ0T4xBWPkHUB748m-WcVkvKm4nsd-w1JhPWE1ANObU0k Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: X-Openstack-Nova-Api-Version: 2.57 Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: c84a797e25df4f94bd63e0f486f63408 Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServerShowV257Test-2039820798 Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c84a797e25df4f94bd63e0f486f63408"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c84a797e25df4f94bd63e0f486f63408"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c84a797e25df4f94bd63e0f486f63408"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c84a797e25df4f94bd63e0f486f63408", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServerShowV257Test-2039820798 Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: c84a797e25df4f94bd63e0f486f63408 Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServerShowV257Test-2039820798 Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServerShowV257Test-2039820798-project Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 1364a32d181d432fb01b09be9e54d35b Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServerShowV257Test-2039820798-project Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 656925d8-a071-49b4-92b0-b74039bc96dc could not be found. Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '656925d8-a071-49b4-92b0-b74039bc96dc'} Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 656925d8-a071-49b4-92b0-b74039bc96dc could not be found. Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 656925d8-a071-49b4-92b0-b74039bc96dc could not be found. Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:54:46.695127 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:46.699873 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:54:46.699873 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:54:46.699873 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:54:46.699873 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:54:46.699873 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:54:46.699873 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 656925d8-a071-49b4-92b0-b74039bc96dc could not be found. Oct 17 13:54:46.699873 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:46.699873 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f3d56a58-193f-4cad-b718-b5b78997a554 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] Returning 404 to user: Instance 656925d8-a071-49b4-92b0-b74039bc96dc could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:54:46.700961 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f3d56a58-193f-4cad-b718-b5b78997a554 tempest-ServerShowV257Test-2039820798 tempest-ServerShowV257Test-2039820798-project] 10.222.0.79 "GET /compute/v2.1/servers/656925d8-a071-49b4-92b0-b74039bc96dc" status: 404 len: 111 microversion: 2.57 time: 0.133966 Oct 17 13:54:46.703641 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2075/4264] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:46 2022] GET /compute/v2.1/servers/656925d8-a071-49b4-92b0-b74039bc96dc => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:54:46.712603 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-fea32efe-1d09-4970-9464-12332c702aad tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:46.713484 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-fea32efe-1d09-4970-9464-12332c702aad tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] [instance: 3cf7e278-5294-4b2e-9b46-8981392d5764] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:46.721479 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fea32efe-1d09-4970-9464-12332c702aad tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:46.722189 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fea32efe-1d09-4970-9464-12332c702aad tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:46.722899 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fea32efe-1d09-4970-9464-12332c702aad tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:46.725877 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fea32efe-1d09-4970-9464-12332c702aad tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:46.726611 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fea32efe-1d09-4970-9464-12332c702aad tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:46.727545 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fea32efe-1d09-4970-9464-12332c702aad tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:46.748566 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-fea32efe-1d09-4970-9464-12332c702aad tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] HTTP exception thrown: Instance 3cf7e278-5294-4b2e-9b46-8981392d5764 could not be found. Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-fea32efe-1d09-4970-9464-12332c702aad tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Request method failure captured: Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764 HTTP/1.1 Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTV6FcN8GAPrewk6_zD-8wYsTjXEkMCWOBqkU5xbhhpkuBNsj_7q5_RhYgStHoHcBbN7xXhhBc-8F2-gUiTxJFEGWDnZh7OEDCU_p-0vbLkAgv5EvGxTEVzE0NXxAugJRvwO5fDmIs6a38htyZQCJ00-dEv-sptMxhOag22iQHjAUvrI Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: X-Openstack-Nova-Api-Version: 2.26 Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 132e34c2ebdd41548f0915fa502b0c4b Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServerTagsTestJSON-1317978021 Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/132e34c2ebdd41548f0915fa502b0c4b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/132e34c2ebdd41548f0915fa502b0c4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/132e34c2ebdd41548f0915fa502b0c4b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_132e34c2ebdd41548f0915fa502b0c4b", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServerTagsTestJSON-1317978021 Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 132e34c2ebdd41548f0915fa502b0c4b Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServerTagsTestJSON-1317978021 Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServerTagsTestJSON-1317978021-project Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 9958ae6fcf04486ba0de669284420b37 Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServerTagsTestJSON-1317978021-project Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 3cf7e278-5294-4b2e-9b46-8981392d5764 could not be found. Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '3cf7e278-5294-4b2e-9b46-8981392d5764'} Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cf7e278-5294-4b2e-9b46-8981392d5764 could not be found. Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cf7e278-5294-4b2e-9b46-8981392d5764 could not be found. Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:54:46.751754 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:46.757359 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:54:46.757359 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:54:46.757359 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:54:46.757359 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:54:46.757359 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:54:46.757359 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cf7e278-5294-4b2e-9b46-8981392d5764 could not be found. Oct 17 13:54:46.757359 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:46.760116 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-fea32efe-1d09-4970-9464-12332c702aad tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] Returning 404 to user: Instance 3cf7e278-5294-4b2e-9b46-8981392d5764 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:54:46.762038 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-fea32efe-1d09-4970-9464-12332c702aad tempest-ServerTagsTestJSON-1317978021 tempest-ServerTagsTestJSON-1317978021-project] 10.222.0.79 "GET /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764" status: 404 len: 111 microversion: 2.26 time: 0.057406 Oct 17 13:54:46.762740 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2076/4265] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:46 2022] GET /compute/v2.1/servers/3cf7e278-5294-4b2e-9b46-8981392d5764 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:54:46.841885 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f2da277b-a04f-4c78-857d-40e88f88b88f tempest-VolumesTestJSON-59672609 tempest-VolumesTestJSON-59672609-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/b0641960-16a8-41f3-bb07-4fabac2d0eb2" status: 200 len: 351 microversion: 2.1 time: 0.171943 Oct 17 13:54:46.843196 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2190/4266] 10.222.0.79 () {58 vars in 1245 bytes} [Mon Oct 17 13:54:46 2022] GET /compute/v2.1/os-volumes/b0641960-16a8-41f3-bb07-4fabac2d0eb2 => generated 351 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:54:47.417337 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-358c167a-5a33-49d4-9cd6-5f399635b3ec tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:47.419370 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-358c167a-5a33-49d4-9cd6-5f399635b3ec tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 051c9371-d3e2-4166-bed5-c73dc77ec977] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:47.458303 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-358c167a-5a33-49d4-9cd6-5f399635b3ec tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:47.460420 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-358c167a-5a33-49d4-9cd6-5f399635b3ec tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:47.468734 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-358c167a-5a33-49d4-9cd6-5f399635b3ec tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:47.469964 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-358c167a-5a33-49d4-9cd6-5f399635b3ec tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:47.470836 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-358c167a-5a33-49d4-9cd6-5f399635b3ec tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:47.471536 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-358c167a-5a33-49d4-9cd6-5f399635b3ec tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:47.597079 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4fd79279-3e57-4a5d-a594-f55946412ae4 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:47.597079 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4fd79279-3e57-4a5d-a594-f55946412ae4 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] [instance: 5eca5e25-1250-4f67-9a40-cc806333cb16] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:47.611024 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4fd79279-3e57-4a5d-a594-f55946412ae4 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:47.611540 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4fd79279-3e57-4a5d-a594-f55946412ae4 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:47.616792 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4fd79279-3e57-4a5d-a594-f55946412ae4 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:47.619705 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4fd79279-3e57-4a5d-a594-f55946412ae4 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:47.620412 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4fd79279-3e57-4a5d-a594-f55946412ae4 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:47.621059 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4fd79279-3e57-4a5d-a594-f55946412ae4 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:47.795008 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4fd79279-3e57-4a5d-a594-f55946412ae4 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6618084b720b47f9b56b29849f0cc995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4cc8d4a7a8463eb099756488bca536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:47.810048 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4fd79279-3e57-4a5d-a594-f55946412ae4 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] 10.222.0.79 "GET /compute/v2.1/servers/5eca5e25-1250-4f67-9a40-cc806333cb16" status: 200 len: 1268 microversion: 2.1 time: 0.213741 Oct 17 13:54:47.813962 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2191/4267] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:47 2022] GET /compute/v2.1/servers/5eca5e25-1250-4f67-9a40-cc806333cb16 => generated 1268 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:47.819150 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2f9e0039-7e21-4309-9aad-86923777829f tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:47.824358 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2f9e0039-7e21-4309-9aad-86923777829f tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] [instance: b54d449b-422b-4ca0-8183-02eb28c30747] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:47.839606 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2f9e0039-7e21-4309-9aad-86923777829f tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:47.840508 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2f9e0039-7e21-4309-9aad-86923777829f tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:47.841389 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2f9e0039-7e21-4309-9aad-86923777829f tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:47.842480 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2f9e0039-7e21-4309-9aad-86923777829f tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:47.843085 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2f9e0039-7e21-4309-9aad-86923777829f tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:47.843721 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2f9e0039-7e21-4309-9aad-86923777829f tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:47.907382 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2f9e0039-7e21-4309-9aad-86923777829f tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:47.908281 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2f9e0039-7e21-4309-9aad-86923777829f tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:47.908894 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2f9e0039-7e21-4309-9aad-86923777829f tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:47.909622 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-2f9e0039-7e21-4309-9aad-86923777829f tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lazy-loading 'fault' on Instance uuid b54d449b-422b-4ca0-8183-02eb28c30747 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:54:48.047973 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-358c167a-5a33-49d4-9cd6-5f399635b3ec tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:48.072565 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2f9e0039-7e21-4309-9aad-86923777829f tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb634956c1764e508400b08750ecc9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23d1c84c66c43bc9daf9d3028663f94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:48.074608 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-358c167a-5a33-49d4-9cd6-5f399635b3ec tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977" status: 200 len: 1511 microversion: 2.1 time: 0.665432 Oct 17 13:54:48.080600 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2077/4268] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:47 2022] GET /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977 => generated 1511 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:48.090758 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-3370089d-5ac6-4867-9ad1-e0720595661a req-cd0ed65e-a95f-43d1-89cd-0a2079629d99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b54d449b-422b-4ca0-8183-02eb28c30747", "name": "network-vif-deleted", "tag": "84634b90-4e9f-4e18-95d8-de0aeebec3e7"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:54:48.122285 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2f9e0039-7e21-4309-9aad-86923777829f tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] 10.222.0.79 "GET /compute/v2.1/servers/b54d449b-422b-4ca0-8183-02eb28c30747" status: 200 len: 1304 microversion: 2.1 time: 0.307025 Oct 17 13:54:48.123416 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2192/4269] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:47 2022] GET /compute/v2.1/servers/b54d449b-422b-4ca0-8183-02eb28c30747 => generated 1304 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:48.125316 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-3370089d-5ac6-4867-9ad1-e0720595661a req-cd0ed65e-a95f-43d1-89cd-0a2079629d99 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:48.125807 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-3370089d-5ac6-4867-9ad1-e0720595661a req-cd0ed65e-a95f-43d1-89cd-0a2079629d99 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:48.126238 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-3370089d-5ac6-4867-9ad1-e0720595661a req-cd0ed65e-a95f-43d1-89cd-0a2079629d99 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:48.158555 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-3370089d-5ac6-4867-9ad1-e0720595661a req-cd0ed65e-a95f-43d1-89cd-0a2079629d99 service nova] Creating event network-vif-deleted:84634b90-4e9f-4e18-95d8-de0aeebec3e7 for instance b54d449b-422b-4ca0-8183-02eb28c30747 on n-h1-854247-14 Oct 17 13:54:48.173511 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-3370089d-5ac6-4867-9ad1-e0720595661a req-cd0ed65e-a95f-43d1-89cd-0a2079629d99 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091557 Oct 17 13:54:48.174845 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2078/4270] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:54:48.840655 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-16d6fd3e-ff00-442b-a4a3-b5e462ca579b tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:48.841918 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-16d6fd3e-ff00-442b-a4a3-b5e462ca579b tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] [instance: 5eca5e25-1250-4f67-9a40-cc806333cb16] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:48.857886 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-16d6fd3e-ff00-442b-a4a3-b5e462ca579b tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:48.860866 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-16d6fd3e-ff00-442b-a4a3-b5e462ca579b tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:48.861367 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-16d6fd3e-ff00-442b-a4a3-b5e462ca579b tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:48.862116 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-16d6fd3e-ff00-442b-a4a3-b5e462ca579b tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:48.862596 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-16d6fd3e-ff00-442b-a4a3-b5e462ca579b tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:48.863008 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-16d6fd3e-ff00-442b-a4a3-b5e462ca579b tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:48.886133 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9f83379b-ee21-4394-8e8f-6b31b423d868 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:48.886966 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9f83379b-ee21-4394-8e8f-6b31b423d868 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:48.901880 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f83379b-ee21-4394-8e8f-6b31b423d868 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:48.902830 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f83379b-ee21-4394-8e8f-6b31b423d868 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:48.904994 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f83379b-ee21-4394-8e8f-6b31b423d868 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:48.906223 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f83379b-ee21-4394-8e8f-6b31b423d868 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:48.907122 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f83379b-ee21-4394-8e8f-6b31b423d868 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:48.909024 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f83379b-ee21-4394-8e8f-6b31b423d868 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:48.943887 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-9f83379b-ee21-4394-8e8f-6b31b423d868 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] HTTP exception thrown: Instance 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e could not be found. Oct 17 13:54:48.946754 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9f83379b-ee21-4394-8e8f-6b31b423d868 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Request method failure captured: Oct 17 13:54:48.946754 n-d-854247-14 devstack@n-api.service[127017]: request: DELETE /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e HTTP/1.1 Oct 17 13:54:48.946754 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:54:48.946754 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:54:48.946754 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:54:48.946754 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:54:48.946754 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:54:48.946754 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:54:48.946754 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:54:48.946754 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:54:48.946754 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTV0JL7NQSDQqh4ZMvkCDXT2fwovcCgk-nxK1nRG4B-HeC5OA7y2_TQv_yPRGTaQ-3zvHufQBJMrO1ZhsIWZZ0ugPMuvlokQmhLWi-H9zySFSYK0iM1qNABohwKQ4S7v-F2ZGFUB1jMKnP05ShlKiL4M8_7Jns7W8GDQtoUfjwQ0M1Lk Oct 17 13:54:48.946754 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:54:48.946754 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:54:48.946754 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:54:48.946754 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:54:48.946754 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:54:48.946754 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:54:48.946754 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 4acd31ce63b64ac3a05b76d4a9fdf7c0 Oct 17 13:54:48.946754 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-AttachVolumeNegativeTest-1792618646 Oct 17 13:54:48.946754 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:54:48.946754 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:54:48.946754 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4acd31ce63b64ac3a05b76d4a9fdf7c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4acd31ce63b64ac3a05b76d4a9fdf7c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4acd31ce63b64ac3a05b76d4a9fdf7c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4acd31ce63b64ac3a05b76d4a9fdf7c0", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:54:48.946754 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-AttachVolumeNegativeTest-1792618646 Oct 17 13:54:48.946754 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 4acd31ce63b64ac3a05b76d4a9fdf7c0 Oct 17 13:54:48.946754 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1792618646 Oct 17 13:54:48.946754 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-AttachVolumeNegativeTest-1792618646-project Oct 17 13:54:48.946754 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:54:48.946754 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:54:48.946754 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: c7a7b9b048234fd2926739e3f08400b0 Oct 17 13:54:48.946754 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-AttachVolumeNegativeTest-1792618646-project Oct 17 13:54:48.946754 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:54:48.946754 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e could not be found. Oct 17 13:54:48.946754 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e'} Oct 17 13:54:48.946754 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:54:48.946754 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:54:48.946754 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:54:48.946754 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:54:48.946754 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:54:48.946754 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:54:48.946754 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:54:48.946754 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:54:48.946754 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:54:48.946754 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:54:48.946754 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e could not be found. Oct 17 13:54:48.946754 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:48.946754 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:54:48.946754 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:48.946754 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:54:48.946754 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:54:48.946754 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:54:48.946754 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:54:48.946754 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:54:48.946754 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:54:48.946754 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:54:48.946754 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:54:48.946754 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:54:48.946754 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:54:48.946754 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:54:48.946754 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:54:48.946754 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:54:48.946754 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:54:48.946754 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:54:48.950519 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e could not be found. Oct 17 13:54:48.950519 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:48.950519 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:54:48.950519 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:48.950519 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:54:48.950519 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:54:48.950519 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:54:48.950519 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:54:48.950519 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:54:48.950519 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e could not be found. Oct 17 13:54:48.950519 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:48.952137 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9f83379b-ee21-4394-8e8f-6b31b423d868 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Returning 404 to user: Instance 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:54:48.953238 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9f83379b-ee21-4394-8e8f-6b31b423d868 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "DELETE /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e" status: 404 len: 111 microversion: 2.1 time: 0.072340 Oct 17 13:54:48.956899 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2079/4271] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:54:48 2022] DELETE /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:54:48.970264 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-00f6f069-bfd6-40c6-bbae-a5a767b6ef47 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:48.971249 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-00f6f069-bfd6-40c6-bbae-a5a767b6ef47 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:48.982749 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-00f6f069-bfd6-40c6-bbae-a5a767b6ef47 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:48.984571 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-00f6f069-bfd6-40c6-bbae-a5a767b6ef47 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:48.985093 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-00f6f069-bfd6-40c6-bbae-a5a767b6ef47 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:48.987155 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-00f6f069-bfd6-40c6-bbae-a5a767b6ef47 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:48.991066 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-00f6f069-bfd6-40c6-bbae-a5a767b6ef47 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:48.992045 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-00f6f069-bfd6-40c6-bbae-a5a767b6ef47 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:49.027153 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-00f6f069-bfd6-40c6-bbae-a5a767b6ef47 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] HTTP exception thrown: Instance 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e could not be found. Oct 17 13:54:49.033537 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-00f6f069-bfd6-40c6-bbae-a5a767b6ef47 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Request method failure captured: Oct 17 13:54:49.033537 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e HTTP/1.1 Oct 17 13:54:49.033537 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:54:49.033537 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:54:49.033537 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:54:49.033537 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:54:49.033537 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:54:49.033537 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:54:49.033537 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:54:49.033537 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:54:49.033537 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTV0JL7NQSDQqh4ZMvkCDXT2fwovcCgk-nxK1nRG4B-HeC5OA7y2_TQv_yPRGTaQ-3zvHufQBJMrO1ZhsIWZZ0ugPMuvlokQmhLWi-H9zySFSYK0iM1qNABohwKQ4S7v-F2ZGFUB1jMKnP05ShlKiL4M8_7Jns7W8GDQtoUfjwQ0M1Lk Oct 17 13:54:49.033537 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:54:49.033537 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:54:49.033537 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:54:49.033537 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:54:49.033537 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:54:49.033537 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:54:49.033537 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 4acd31ce63b64ac3a05b76d4a9fdf7c0 Oct 17 13:54:49.033537 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-AttachVolumeNegativeTest-1792618646 Oct 17 13:54:49.033537 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:54:49.033537 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:54:49.033537 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4acd31ce63b64ac3a05b76d4a9fdf7c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4acd31ce63b64ac3a05b76d4a9fdf7c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4acd31ce63b64ac3a05b76d4a9fdf7c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4acd31ce63b64ac3a05b76d4a9fdf7c0", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:54:49.033537 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-AttachVolumeNegativeTest-1792618646 Oct 17 13:54:49.033537 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 4acd31ce63b64ac3a05b76d4a9fdf7c0 Oct 17 13:54:49.033537 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1792618646 Oct 17 13:54:49.033537 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-AttachVolumeNegativeTest-1792618646-project Oct 17 13:54:49.033537 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:54:49.033537 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:54:49.033537 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: c7a7b9b048234fd2926739e3f08400b0 Oct 17 13:54:49.033537 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-AttachVolumeNegativeTest-1792618646-project Oct 17 13:54:49.033537 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:54:49.033537 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e could not be found. Oct 17 13:54:49.033537 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e'} Oct 17 13:54:49.033537 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:54:49.033537 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:54:49.033537 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:54:49.033537 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:54:49.033537 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:54:49.033537 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:54:49.033537 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:54:49.033537 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:54:49.033537 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:54:49.033537 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:54:49.033537 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e could not be found. Oct 17 13:54:49.033537 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:49.033537 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:54:49.033537 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:49.033537 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:54:49.033537 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:54:49.033537 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:54:49.033537 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:54:49.033537 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:54:49.033537 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:54:49.033537 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:54:49.033537 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:54:49.033537 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:54:49.033537 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:54:49.033537 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:54:49.033537 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:54:49.033537 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:54:49.033537 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e could not be found. Oct 17 13:54:49.033537 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:49.033537 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:54:49.033537 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:49.037510 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:54:49.037510 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:54:49.037510 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:54:49.037510 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:54:49.037510 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:54:49.037510 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e could not be found. Oct 17 13:54:49.037510 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:49.040089 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-00f6f069-bfd6-40c6-bbae-a5a767b6ef47 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Returning 404 to user: Instance 2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:54:49.042398 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-00f6f069-bfd6-40c6-bbae-a5a767b6ef47 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e" status: 404 len: 111 microversion: 2.1 time: 0.084205 Oct 17 13:54:49.047349 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2080/4272] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:48 2022] GET /compute/v2.1/servers/2d3c46c5-bb57-4af1-9aa5-9dedccb84a0e => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:54:49.058460 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e26546ff-b830-4118-b88a-207b7269fab3 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:49.059077 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e26546ff-b830-4118-b88a-207b7269fab3 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 972070b6-59ae-472d-9dfb-75051a0d7701] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:49.075869 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e26546ff-b830-4118-b88a-207b7269fab3 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:49.078901 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e26546ff-b830-4118-b88a-207b7269fab3 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:49.079852 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e26546ff-b830-4118-b88a-207b7269fab3 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:49.080819 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e26546ff-b830-4118-b88a-207b7269fab3 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:49.084450 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e26546ff-b830-4118-b88a-207b7269fab3 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:49.085196 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e26546ff-b830-4118-b88a-207b7269fab3 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:49.139117 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-e26546ff-b830-4118-b88a-207b7269fab3 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] HTTP exception thrown: Instance 972070b6-59ae-472d-9dfb-75051a0d7701 could not be found. Oct 17 13:54:49.144604 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-16d6fd3e-ff00-442b-a4a3-b5e462ca579b tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6618084b720b47f9b56b29849f0cc995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4cc8d4a7a8463eb099756488bca536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:49.146640 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e26546ff-b830-4118-b88a-207b7269fab3 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Request method failure captured: Oct 17 13:54:49.146640 n-d-854247-14 devstack@n-api.service[127017]: request: DELETE /compute/v2.1/servers/972070b6-59ae-472d-9dfb-75051a0d7701 HTTP/1.1 Oct 17 13:54:49.146640 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:54:49.146640 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:54:49.146640 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:54:49.146640 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:54:49.146640 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:54:49.146640 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:54:49.146640 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:54:49.146640 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:54:49.146640 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTV0JL7NQSDQqh4ZMvkCDXT2fwovcCgk-nxK1nRG4B-HeC5OA7y2_TQv_yPRGTaQ-3zvHufQBJMrO1ZhsIWZZ0ugPMuvlokQmhLWi-H9zySFSYK0iM1qNABohwKQ4S7v-F2ZGFUB1jMKnP05ShlKiL4M8_7Jns7W8GDQtoUfjwQ0M1Lk Oct 17 13:54:49.146640 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:54:49.146640 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:54:49.146640 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:54:49.146640 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:54:49.146640 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:54:49.146640 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:54:49.146640 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 4acd31ce63b64ac3a05b76d4a9fdf7c0 Oct 17 13:54:49.146640 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-AttachVolumeNegativeTest-1792618646 Oct 17 13:54:49.146640 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:54:49.146640 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:54:49.146640 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4acd31ce63b64ac3a05b76d4a9fdf7c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4acd31ce63b64ac3a05b76d4a9fdf7c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4acd31ce63b64ac3a05b76d4a9fdf7c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4acd31ce63b64ac3a05b76d4a9fdf7c0", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:54:49.146640 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-AttachVolumeNegativeTest-1792618646 Oct 17 13:54:49.146640 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 4acd31ce63b64ac3a05b76d4a9fdf7c0 Oct 17 13:54:49.146640 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1792618646 Oct 17 13:54:49.146640 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-AttachVolumeNegativeTest-1792618646-project Oct 17 13:54:49.146640 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:54:49.146640 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:54:49.146640 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: c7a7b9b048234fd2926739e3f08400b0 Oct 17 13:54:49.146640 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-AttachVolumeNegativeTest-1792618646-project Oct 17 13:54:49.146640 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:54:49.146640 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 972070b6-59ae-472d-9dfb-75051a0d7701 could not be found. Oct 17 13:54:49.146640 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '972070b6-59ae-472d-9dfb-75051a0d7701'} Oct 17 13:54:49.146640 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:54:49.146640 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:54:49.146640 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:54:49.146640 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:54:49.146640 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:54:49.146640 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:54:49.146640 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:54:49.146640 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:54:49.146640 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:54:49.146640 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:54:49.146640 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 972070b6-59ae-472d-9dfb-75051a0d7701 could not be found. Oct 17 13:54:49.146640 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:49.146640 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:54:49.146640 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:49.146640 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:54:49.146640 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:54:49.146640 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:54:49.146640 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:54:49.146640 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:54:49.146640 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:54:49.146640 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:54:49.146640 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:54:49.146640 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:54:49.146640 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:54:49.146640 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:54:49.146640 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:54:49.146640 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:54:49.146640 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:54:49.146640 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:54:49.152043 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 972070b6-59ae-472d-9dfb-75051a0d7701 could not be found. Oct 17 13:54:49.152043 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:49.152043 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:54:49.152043 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:49.152043 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:54:49.152043 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:54:49.152043 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:54:49.152043 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:54:49.152043 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:54:49.152043 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 972070b6-59ae-472d-9dfb-75051a0d7701 could not be found. Oct 17 13:54:49.152043 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:49.152043 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e26546ff-b830-4118-b88a-207b7269fab3 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Returning 404 to user: Instance 972070b6-59ae-472d-9dfb-75051a0d7701 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:54:49.152043 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e26546ff-b830-4118-b88a-207b7269fab3 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "DELETE /compute/v2.1/servers/972070b6-59ae-472d-9dfb-75051a0d7701" status: 404 len: 111 microversion: 2.1 time: 0.094867 Oct 17 13:54:49.155010 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2081/4273] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:54:49 2022] DELETE /compute/v2.1/servers/972070b6-59ae-472d-9dfb-75051a0d7701 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:54:49.165918 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-652dfa18-b9c6-4705-950d-188c609aec48 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:49.166810 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-652dfa18-b9c6-4705-950d-188c609aec48 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 051c9371-d3e2-4166-bed5-c73dc77ec977] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:49.176406 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-16d6fd3e-ff00-442b-a4a3-b5e462ca579b tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] 10.222.0.79 "GET /compute/v2.1/servers/5eca5e25-1250-4f67-9a40-cc806333cb16" status: 200 len: 1274 microversion: 2.1 time: 0.337075 Oct 17 13:54:49.182976 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-652dfa18-b9c6-4705-950d-188c609aec48 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:49.184124 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-652dfa18-b9c6-4705-950d-188c609aec48 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:49.186270 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-652dfa18-b9c6-4705-950d-188c609aec48 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:49.188650 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-652dfa18-b9c6-4705-950d-188c609aec48 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:49.188847 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2193/4274] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:48 2022] GET /compute/v2.1/servers/5eca5e25-1250-4f67-9a40-cc806333cb16 => generated 1274 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:49.204932 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-652dfa18-b9c6-4705-950d-188c609aec48 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:49.204932 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-652dfa18-b9c6-4705-950d-188c609aec48 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:49.248726 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-53c43956-e371-4dc8-b808-f8e000cac9a9 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:49.253744 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-53c43956-e371-4dc8-b808-f8e000cac9a9 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] [instance: b54d449b-422b-4ca0-8183-02eb28c30747] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:49.273635 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-53c43956-e371-4dc8-b808-f8e000cac9a9 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:49.276345 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-53c43956-e371-4dc8-b808-f8e000cac9a9 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:49.279927 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-53c43956-e371-4dc8-b808-f8e000cac9a9 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:49.283051 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-53c43956-e371-4dc8-b808-f8e000cac9a9 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:49.283587 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-53c43956-e371-4dc8-b808-f8e000cac9a9 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:49.285393 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-53c43956-e371-4dc8-b808-f8e000cac9a9 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:49.333542 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-53c43956-e371-4dc8-b808-f8e000cac9a9 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] HTTP exception thrown: Instance b54d449b-422b-4ca0-8183-02eb28c30747 could not be found. Oct 17 13:54:49.339295 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-53c43956-e371-4dc8-b808-f8e000cac9a9 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Request method failure captured: Oct 17 13:54:49.339295 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/b54d449b-422b-4ca0-8183-02eb28c30747 HTTP/1.1 Oct 17 13:54:49.339295 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:54:49.339295 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:54:49.339295 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:54:49.339295 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:54:49.339295 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:54:49.339295 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:54:49.339295 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:54:49.339295 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:54:49.339295 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTV583EzLJRb9eI3jYRAyIuwl9qgW4NDY2mjLSEKJ-4q0zfd4sH0TWu0evtLb8Q60_mGV4JUvKOf7E9YtcEkUxV9VofoGl8FycnBqHvkwe8COonw_zbhQW2zmKq226hs3Wiul1VcorRTRREuLLzZaeea0BUYu8Qt-vk4Mj_UZlNlkIpY Oct 17 13:54:49.339295 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:54:49.339295 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:54:49.339295 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:54:49.339295 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:54:49.339295 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:54:49.339295 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:54:49.339295 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: a23d1c84c66c43bc9daf9d3028663f94 Oct 17 13:54:49.339295 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-VolumesActionsTest-1292263761 Oct 17 13:54:49.339295 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:54:49.339295 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:54:49.339295 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a23d1c84c66c43bc9daf9d3028663f94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a23d1c84c66c43bc9daf9d3028663f94"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a23d1c84c66c43bc9daf9d3028663f94"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a23d1c84c66c43bc9daf9d3028663f94", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:54:49.339295 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-VolumesActionsTest-1292263761 Oct 17 13:54:49.339295 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: a23d1c84c66c43bc9daf9d3028663f94 Oct 17 13:54:49.339295 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-VolumesActionsTest-1292263761 Oct 17 13:54:49.339295 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-VolumesActionsTest-1292263761-project Oct 17 13:54:49.339295 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:54:49.339295 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:54:49.339295 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: fb634956c1764e508400b08750ecc9b2 Oct 17 13:54:49.339295 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-VolumesActionsTest-1292263761-project Oct 17 13:54:49.339295 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:54:49.339295 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance b54d449b-422b-4ca0-8183-02eb28c30747 could not be found. Oct 17 13:54:49.339295 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'b54d449b-422b-4ca0-8183-02eb28c30747'} Oct 17 13:54:49.339295 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:54:49.339295 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:54:49.339295 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:54:49.339295 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:54:49.339295 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:54:49.339295 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:54:49.339295 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:54:49.339295 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:54:49.339295 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:54:49.339295 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:54:49.339295 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b54d449b-422b-4ca0-8183-02eb28c30747 could not be found. Oct 17 13:54:49.339295 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:54:49.339295 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:54:49.339295 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:54:49.339295 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:54:49.339295 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:54:49.339295 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:54:49.339295 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:54:49.339295 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:54:49.339295 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:54:49.339295 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:54:49.339295 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:54:49.339295 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:54:49.339295 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:54:49.339295 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:54:49.339295 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:54:49.339295 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:54:49.339295 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b54d449b-422b-4ca0-8183-02eb28c30747 could not be found. Oct 17 13:54:49.339295 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:54:49.339295 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:54:49.339295 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:54:49.344360 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:54:49.344360 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:54:49.344360 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:54:49.344360 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:54:49.344360 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:54:49.344360 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b54d449b-422b-4ca0-8183-02eb28c30747 could not be found. Oct 17 13:54:49.344360 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:54:49.348260 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-53c43956-e371-4dc8-b808-f8e000cac9a9 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] Returning 404 to user: Instance b54d449b-422b-4ca0-8183-02eb28c30747 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:54:49.349624 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-53c43956-e371-4dc8-b808-f8e000cac9a9 tempest-VolumesActionsTest-1292263761 tempest-VolumesActionsTest-1292263761-project] 10.222.0.79 "GET /compute/v2.1/servers/b54d449b-422b-4ca0-8183-02eb28c30747" status: 404 len: 111 microversion: 2.1 time: 0.135432 Oct 17 13:54:49.352107 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2194/4275] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:49 2022] GET /compute/v2.1/servers/b54d449b-422b-4ca0-8183-02eb28c30747 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:54:49.366954 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-49cabc6d-4b7c-4d7f-ab90-e7d979f79937 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:49.367848 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-49cabc6d-4b7c-4d7f-ab90-e7d979f79937 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 972070b6-59ae-472d-9dfb-75051a0d7701] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:49.386155 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-49cabc6d-4b7c-4d7f-ab90-e7d979f79937 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:49.389922 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-49cabc6d-4b7c-4d7f-ab90-e7d979f79937 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:49.390713 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-49cabc6d-4b7c-4d7f-ab90-e7d979f79937 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:49.392848 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-49cabc6d-4b7c-4d7f-ab90-e7d979f79937 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:49.394079 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-49cabc6d-4b7c-4d7f-ab90-e7d979f79937 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:49.396510 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-49cabc6d-4b7c-4d7f-ab90-e7d979f79937 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:49.431152 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-49cabc6d-4b7c-4d7f-ab90-e7d979f79937 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] HTTP exception thrown: Instance 972070b6-59ae-472d-9dfb-75051a0d7701 could not be found. Oct 17 13:54:49.434015 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-49cabc6d-4b7c-4d7f-ab90-e7d979f79937 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Request method failure captured: Oct 17 13:54:49.434015 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/972070b6-59ae-472d-9dfb-75051a0d7701 HTTP/1.1 Oct 17 13:54:49.434015 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:54:49.434015 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:54:49.434015 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:54:49.434015 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:54:49.434015 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:54:49.434015 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:54:49.434015 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:54:49.434015 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:54:49.434015 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTV0JL7NQSDQqh4ZMvkCDXT2fwovcCgk-nxK1nRG4B-HeC5OA7y2_TQv_yPRGTaQ-3zvHufQBJMrO1ZhsIWZZ0ugPMuvlokQmhLWi-H9zySFSYK0iM1qNABohwKQ4S7v-F2ZGFUB1jMKnP05ShlKiL4M8_7Jns7W8GDQtoUfjwQ0M1Lk Oct 17 13:54:49.434015 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:54:49.434015 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:54:49.434015 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:54:49.434015 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:54:49.434015 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:54:49.434015 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:54:49.434015 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 4acd31ce63b64ac3a05b76d4a9fdf7c0 Oct 17 13:54:49.434015 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-AttachVolumeNegativeTest-1792618646 Oct 17 13:54:49.434015 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:54:49.434015 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:54:49.434015 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4acd31ce63b64ac3a05b76d4a9fdf7c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4acd31ce63b64ac3a05b76d4a9fdf7c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4acd31ce63b64ac3a05b76d4a9fdf7c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4acd31ce63b64ac3a05b76d4a9fdf7c0", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:54:49.434015 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-AttachVolumeNegativeTest-1792618646 Oct 17 13:54:49.434015 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 4acd31ce63b64ac3a05b76d4a9fdf7c0 Oct 17 13:54:49.434015 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1792618646 Oct 17 13:54:49.434015 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-AttachVolumeNegativeTest-1792618646-project Oct 17 13:54:49.434015 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:54:49.434015 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:54:49.434015 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: c7a7b9b048234fd2926739e3f08400b0 Oct 17 13:54:49.434015 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-AttachVolumeNegativeTest-1792618646-project Oct 17 13:54:49.434015 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:54:49.434015 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 972070b6-59ae-472d-9dfb-75051a0d7701 could not be found. Oct 17 13:54:49.434015 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '972070b6-59ae-472d-9dfb-75051a0d7701'} Oct 17 13:54:49.434015 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:54:49.434015 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:54:49.434015 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:54:49.434015 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:54:49.434015 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:54:49.434015 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:54:49.434015 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:54:49.434015 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:54:49.434015 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:54:49.434015 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:54:49.434015 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 972070b6-59ae-472d-9dfb-75051a0d7701 could not be found. Oct 17 13:54:49.434015 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:54:49.434015 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:54:49.434015 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:54:49.434015 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:54:49.434015 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:54:49.434015 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:54:49.434015 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:54:49.434015 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:54:49.434015 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:54:49.434015 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:54:49.434015 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:54:49.434015 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:54:49.434015 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:54:49.434015 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:54:49.434015 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:54:49.434015 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:54:49.434015 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 972070b6-59ae-472d-9dfb-75051a0d7701 could not be found. Oct 17 13:54:49.434015 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:54:49.434015 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:54:49.434015 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:54:49.440920 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:54:49.440920 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:54:49.440920 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:54:49.440920 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:54:49.440920 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:54:49.440920 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 972070b6-59ae-472d-9dfb-75051a0d7701 could not be found. Oct 17 13:54:49.440920 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:54:49.446248 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-49cabc6d-4b7c-4d7f-ab90-e7d979f79937 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Returning 404 to user: Instance 972070b6-59ae-472d-9dfb-75051a0d7701 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:54:49.447426 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-49cabc6d-4b7c-4d7f-ab90-e7d979f79937 tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/972070b6-59ae-472d-9dfb-75051a0d7701" status: 404 len: 111 microversion: 2.1 time: 0.084511 Oct 17 13:54:49.472803 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2195/4276] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:49 2022] GET /compute/v2.1/servers/972070b6-59ae-472d-9dfb-75051a0d7701 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:54:49.658553 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-652dfa18-b9c6-4705-950d-188c609aec48 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:49.671572 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-652dfa18-b9c6-4705-950d-188c609aec48 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977" status: 200 len: 1511 microversion: 2.1 time: 0.514269 Oct 17 13:54:49.673385 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2082/4277] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:49 2022] GET /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977 => generated 1511 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:50.214815 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2d0206a3-4128-45e5-bddf-1365963d73d4 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:50.216760 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2d0206a3-4128-45e5-bddf-1365963d73d4 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] [instance: 5eca5e25-1250-4f67-9a40-cc806333cb16] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:50.234877 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2d0206a3-4128-45e5-bddf-1365963d73d4 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:50.236939 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2d0206a3-4128-45e5-bddf-1365963d73d4 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:50.239656 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2d0206a3-4128-45e5-bddf-1365963d73d4 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:50.241818 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2d0206a3-4128-45e5-bddf-1365963d73d4 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:50.242931 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2d0206a3-4128-45e5-bddf-1365963d73d4 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:50.245692 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2d0206a3-4128-45e5-bddf-1365963d73d4 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:50.387278 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2d0206a3-4128-45e5-bddf-1365963d73d4 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6618084b720b47f9b56b29849f0cc995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4cc8d4a7a8463eb099756488bca536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:50.401945 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2d0206a3-4128-45e5-bddf-1365963d73d4 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] 10.222.0.79 "GET /compute/v2.1/servers/5eca5e25-1250-4f67-9a40-cc806333cb16" status: 200 len: 1274 microversion: 2.1 time: 0.190772 Oct 17 13:54:50.404397 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2196/4278] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:50 2022] GET /compute/v2.1/servers/5eca5e25-1250-4f67-9a40-cc806333cb16 => generated 1274 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:50.707462 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-cc3033b9-8870-4431-9964-31491e6c3d6e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:50.708098 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-cc3033b9-8870-4431-9964-31491e6c3d6e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 051c9371-d3e2-4166-bed5-c73dc77ec977] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:50.737617 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:54:50.742031 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cc3033b9-8870-4431-9964-31491e6c3d6e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:50.745790 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cc3033b9-8870-4431-9964-31491e6c3d6e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:50.747457 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cc3033b9-8870-4431-9964-31491e6c3d6e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:50.749937 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cc3033b9-8870-4431-9964-31491e6c3d6e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:50.752787 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cc3033b9-8870-4431-9964-31491e6c3d6e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:50.753244 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cc3033b9-8870-4431-9964-31491e6c3d6e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:51.244740 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-68111c7b-acfc-49dd-8b95-790dd15cd173 tempest-QuotasTestJSON-735909370 tempest-QuotasTestJSON-735909370-project] Calling method '.version_select at 0x7f7cd42a3040>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:51.389972 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-68111c7b-acfc-49dd-8b95-790dd15cd173 tempest-QuotasTestJSON-735909370 tempest-QuotasTestJSON-735909370-project] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/1938542f77ab4cce8e8282e3398ca433/defaults" status: 200 len: 371 microversion: 2.1 time: 0.548159 Oct 17 13:54:51.390567 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2197/4279] 10.222.0.79 () {58 vars in 1269 bytes} [Mon Oct 17 13:54:50 2022] GET /compute/v2.1/os-quota-sets/1938542f77ab4cce8e8282e3398ca433/defaults => generated 371 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:54:51.403508 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f7b29643-97c4-423c-9e96-a836cd39b3ef tempest-VolumesTestJSON-59672609 tempest-VolumesTestJSON-59672609-project] Calling method '.version_select at 0x7f7cd42a3280>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:51.522677 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f7b29643-97c4-423c-9e96-a836cd39b3ef tempest-VolumesTestJSON-59672609 tempest-VolumesTestJSON-59672609-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/0cf2688a-389e-4a97-b06e-a8a29ebc0759" status: 200 len: 350 microversion: 2.1 time: 0.128674 Oct 17 13:54:51.523298 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2198/4280] 10.222.0.79 () {58 vars in 1245 bytes} [Mon Oct 17 13:54:51 2022] GET /compute/v2.1/os-volumes/0cf2688a-389e-4a97-b06e-a8a29ebc0759 => generated 350 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:54:51.530074 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8aba3404-0d5d-4841-98d9-e1727ccca8b5 tempest-QuotasTestJSON-735909370 tempest-QuotasTestJSON-735909370-project] Calling method '.version_select at 0x7f7cd42a3dc0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:51.676982 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8aba3404-0d5d-4841-98d9-e1727ccca8b5 tempest-QuotasTestJSON-735909370 tempest-QuotasTestJSON-735909370-project] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/1938542f77ab4cce8e8282e3398ca433" status: 200 len: 371 microversion: 2.1 time: 0.152242 Oct 17 13:54:51.687103 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2199/4281] 10.222.0.79 () {58 vars in 1242 bytes} [Mon Oct 17 13:54:51 2022] GET /compute/v2.1/os-quota-sets/1938542f77ab4cce8e8282e3398ca433 => generated 371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:54:51.696642 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1867d9c0-73fa-4dd2-a538-0d9f407f0f08 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:51.697272 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-1867d9c0-73fa-4dd2-a538-0d9f407f0f08 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] [instance: 5eca5e25-1250-4f67-9a40-cc806333cb16] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:51.715902 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1867d9c0-73fa-4dd2-a538-0d9f407f0f08 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:51.717652 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1867d9c0-73fa-4dd2-a538-0d9f407f0f08 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:51.719414 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1867d9c0-73fa-4dd2-a538-0d9f407f0f08 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:51.720227 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1867d9c0-73fa-4dd2-a538-0d9f407f0f08 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:51.723946 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1867d9c0-73fa-4dd2-a538-0d9f407f0f08 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:51.724693 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1867d9c0-73fa-4dd2-a538-0d9f407f0f08 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:52.199311 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-cc3033b9-8870-4431-9964-31491e6c3d6e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:52.226258 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-cc3033b9-8870-4431-9964-31491e6c3d6e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977" status: 200 len: 1511 microversion: 2.1 time: 1.509286 Oct 17 13:54:52.227268 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2083/4282] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:50 2022] GET /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977 => generated 1511 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:52.258031 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8ff502a9-0777-4bcb-a7fd-fd8566ef9280 tempest-QuotasTestJSON-735909370 tempest-QuotasTestJSON-735909370-project] Calling method '.version_select at 0x7f7cd98d0b80>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:52.259866 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-1867d9c0-73fa-4dd2-a538-0d9f407f0f08 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6618084b720b47f9b56b29849f0cc995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4cc8d4a7a8463eb099756488bca536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:52.273536 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1867d9c0-73fa-4dd2-a538-0d9f407f0f08 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] 10.222.0.79 "GET /compute/v2.1/servers/5eca5e25-1250-4f67-9a40-cc806333cb16" status: 200 len: 1316 microversion: 2.1 time: 0.590681 Oct 17 13:54:52.276220 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2200/4283] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:51 2022] GET /compute/v2.1/servers/5eca5e25-1250-4f67-9a40-cc806333cb16 => generated 1316 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:52.455542 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8ff502a9-0777-4bcb-a7fd-fd8566ef9280 tempest-QuotasTestJSON-735909370 tempest-QuotasTestJSON-735909370-project] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/1938542f77ab4cce8e8282e3398ca433/defaults" status: 200 len: 371 microversion: 2.1 time: 0.226279 Oct 17 13:54:52.456158 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2084/4284] 10.222.0.79 () {58 vars in 1269 bytes} [Mon Oct 17 13:54:52 2022] GET /compute/v2.1/os-quota-sets/1938542f77ab4cce8e8282e3398ca433/defaults => generated 371 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:54:52.474444 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b21a78c9-b515-45b6-a179-f1f4f330de56 tempest-QuotasTestJSON-735909370 tempest-QuotasTestJSON-735909370-project] Calling method '.version_select at 0x7f7cd42320d0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:52.605394 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b21a78c9-b515-45b6-a179-f1f4f330de56 tempest-QuotasTestJSON-735909370 tempest-QuotasTestJSON-735909370-project] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/1938542f77ab4cce8e8282e3398ca433" status: 200 len: 371 microversion: 2.1 time: 0.135094 Oct 17 13:54:52.619723 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-716dfb84-ecf7-49bd-927d-1d7883dd32f7 tempest-QuotasTestJSON-735909370 tempest-QuotasTestJSON-735909370-project] Calling method '.version_select at 0x7f7cd55d9f70>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:52.626206 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2201/4285] 10.222.0.79 () {58 vars in 1242 bytes} [Mon Oct 17 13:54:52 2022] GET /compute/v2.1/os-quota-sets/1938542f77ab4cce8e8282e3398ca433 => generated 371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:54:52.790646 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-716dfb84-ecf7-49bd-927d-1d7883dd32f7 tempest-QuotasTestJSON-735909370 tempest-QuotasTestJSON-735909370-project] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/1938542f77ab4cce8e8282e3398ca433?user_id=89b701b3239847eabc31d64ab32027ef" status: 200 len: 371 microversion: 2.1 time: 0.175664 Oct 17 13:54:52.793483 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2085/4286] 10.222.0.79 () {58 vars in 1323 bytes} [Mon Oct 17 13:54:52 2022] GET /compute/v2.1/os-quota-sets/1938542f77ab4cce8e8282e3398ca433?user_id=89b701b3239847eabc31d64ab32027ef => generated 371 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:54:52.938591 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-2a90d4ed-5619-420d-a7ab-231dcbef24f1 req-d3742385-752c-4efc-8e11-8042ff6723ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5eca5e25-1250-4f67-9a40-cc806333cb16", "tag": "7aff2611-21dc-469f-9f1f-a2f4877289f1"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:54:52.971884 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-2a90d4ed-5619-420d-a7ab-231dcbef24f1 req-d3742385-752c-4efc-8e11-8042ff6723ab service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:52.973587 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-2a90d4ed-5619-420d-a7ab-231dcbef24f1 req-d3742385-752c-4efc-8e11-8042ff6723ab service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:52.975468 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-2a90d4ed-5619-420d-a7ab-231dcbef24f1 req-d3742385-752c-4efc-8e11-8042ff6723ab service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:53.015152 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-2a90d4ed-5619-420d-a7ab-231dcbef24f1 req-d3742385-752c-4efc-8e11-8042ff6723ab service nova] Creating event network-changed:7aff2611-21dc-469f-9f1f-a2f4877289f1 for instance 5eca5e25-1250-4f67-9a40-cc806333cb16 on n-h2-854247-14 Oct 17 13:54:53.032517 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-2a90d4ed-5619-420d-a7ab-231dcbef24f1 req-d3742385-752c-4efc-8e11-8042ff6723ab service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099457 Oct 17 13:54:53.035333 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2202/4287] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:54:53.254338 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9870c803-7e6c-491c-b282-6157e57f36bd tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:53.256390 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9870c803-7e6c-491c-b282-6157e57f36bd tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 051c9371-d3e2-4166-bed5-c73dc77ec977] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:53.279641 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9870c803-7e6c-491c-b282-6157e57f36bd tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:53.280530 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9870c803-7e6c-491c-b282-6157e57f36bd tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:53.281144 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9870c803-7e6c-491c-b282-6157e57f36bd tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:53.287045 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9870c803-7e6c-491c-b282-6157e57f36bd tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:53.287902 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9870c803-7e6c-491c-b282-6157e57f36bd tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:53.289151 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9870c803-7e6c-491c-b282-6157e57f36bd tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:53.304191 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-17487719-e6db-4f19-b97c-0c11f7e9a8d6 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:53.305505 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-17487719-e6db-4f19-b97c-0c11f7e9a8d6 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] [instance: 5eca5e25-1250-4f67-9a40-cc806333cb16] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:53.333595 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-17487719-e6db-4f19-b97c-0c11f7e9a8d6 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:53.334376 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-17487719-e6db-4f19-b97c-0c11f7e9a8d6 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:53.338628 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-17487719-e6db-4f19-b97c-0c11f7e9a8d6 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:53.348397 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-17487719-e6db-4f19-b97c-0c11f7e9a8d6 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:53.349227 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-17487719-e6db-4f19-b97c-0c11f7e9a8d6 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:53.350299 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-17487719-e6db-4f19-b97c-0c11f7e9a8d6 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:53.813302 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9870c803-7e6c-491c-b282-6157e57f36bd tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:53.825554 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9870c803-7e6c-491c-b282-6157e57f36bd tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977" status: 200 len: 1511 microversion: 2.1 time: 0.574345 Oct 17 13:54:53.826676 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2086/4288] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:53 2022] GET /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977 => generated 1511 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:53.842568 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-17487719-e6db-4f19-b97c-0c11f7e9a8d6 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6618084b720b47f9b56b29849f0cc995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4cc8d4a7a8463eb099756488bca536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:53.854635 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-17487719-e6db-4f19-b97c-0c11f7e9a8d6 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] 10.222.0.79 "GET /compute/v2.1/servers/5eca5e25-1250-4f67-9a40-cc806333cb16" status: 200 len: 1316 microversion: 2.1 time: 0.556937 Oct 17 13:54:53.863567 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2203/4289] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:53 2022] GET /compute/v2.1/servers/5eca5e25-1250-4f67-9a40-cc806333cb16 => generated 1316 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:54:54.616653 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f6d950b3-aff0-4764-8621-29046076b97d tempest-VolumesTestJSON-59672609 tempest-VolumesTestJSON-59672609-project] Calling method '.version_select at 0x7f7cd5615820>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:54.742407 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f6d950b3-aff0-4764-8621-29046076b97d tempest-VolumesTestJSON-59672609 tempest-VolumesTestJSON-59672609-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/db15b110-a69c-40e7-9ec9-9d1cfac1bdea" status: 200 len: 351 microversion: 2.1 time: 0.129464 Oct 17 13:54:54.743060 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2087/4290] 10.222.0.79 () {58 vars in 1245 bytes} [Mon Oct 17 13:54:54 2022] GET /compute/v2.1/os-volumes/db15b110-a69c-40e7-9ec9-9d1cfac1bdea => generated 351 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:54:54.756578 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b5a17eaf-6486-4dc2-b83c-b6ba6f1a328d tempest-VolumesTestJSON-59672609 tempest-VolumesTestJSON-59672609-project] Calling method '.version_select at 0x7f7cd4290e50>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:54.853998 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-da3857c3-6bbf-4ff9-bec7-614040d5662f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:54.855143 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-da3857c3-6bbf-4ff9-bec7-614040d5662f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 051c9371-d3e2-4166-bed5-c73dc77ec977] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:54.864222 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-da3857c3-6bbf-4ff9-bec7-614040d5662f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:54.865462 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-da3857c3-6bbf-4ff9-bec7-614040d5662f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:54.867284 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-da3857c3-6bbf-4ff9-bec7-614040d5662f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:54.868427 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-da3857c3-6bbf-4ff9-bec7-614040d5662f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:54.869123 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-da3857c3-6bbf-4ff9-bec7-614040d5662f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:54.869788 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-da3857c3-6bbf-4ff9-bec7-614040d5662f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:55.003345 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b5a17eaf-6486-4dc2-b83c-b6ba6f1a328d tempest-VolumesTestJSON-59672609 tempest-VolumesTestJSON-59672609-project] 10.222.0.79 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.250587 Oct 17 13:54:55.004632 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2204/4291] 10.222.0.79 () {58 vars in 1134 bytes} [Mon Oct 17 13:54:54 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:55.021023 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-33f89103-0511-4f0d-8454-8d2b96e24cad tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:55.025393 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-33f89103-0511-4f0d-8454-8d2b96e24cad tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] [instance: 5eca5e25-1250-4f67-9a40-cc806333cb16] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:55.040870 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-33f89103-0511-4f0d-8454-8d2b96e24cad tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:55.048951 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-33f89103-0511-4f0d-8454-8d2b96e24cad tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:55.050086 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-33f89103-0511-4f0d-8454-8d2b96e24cad tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:55.052491 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-33f89103-0511-4f0d-8454-8d2b96e24cad tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:55.055402 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-33f89103-0511-4f0d-8454-8d2b96e24cad tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:55.058352 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-33f89103-0511-4f0d-8454-8d2b96e24cad tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:55.680866 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:54:55.756010 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-33f89103-0511-4f0d-8454-8d2b96e24cad tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6618084b720b47f9b56b29849f0cc995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4cc8d4a7a8463eb099756488bca536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:55.772785 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-33f89103-0511-4f0d-8454-8d2b96e24cad tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] 10.222.0.79 "GET /compute/v2.1/servers/5eca5e25-1250-4f67-9a40-cc806333cb16" status: 200 len: 1316 microversion: 2.1 time: 0.766390 Oct 17 13:54:55.780474 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2205/4292] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:55 2022] GET /compute/v2.1/servers/5eca5e25-1250-4f67-9a40-cc806333cb16 => generated 1316 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:55.808313 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b06140c4-a04e-40a8-9597-32176d335143 tempest-VolumesTestJSON-59672609 tempest-VolumesTestJSON-59672609-project] Calling method '.version_select at 0x7f7cd643ddc0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:55.815451 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-da3857c3-6bbf-4ff9-bec7-614040d5662f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:55.836832 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-da3857c3-6bbf-4ff9-bec7-614040d5662f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977" status: 200 len: 1511 microversion: 2.1 time: 0.977644 Oct 17 13:54:55.841949 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2088/4293] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:54 2022] GET /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977 => generated 1511 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:54:56.055672 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b06140c4-a04e-40a8-9597-32176d335143 tempest-VolumesTestJSON-59672609 tempest-VolumesTestJSON-59672609-project] 10.222.0.79 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.273716 Oct 17 13:54:56.058051 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2206/4294] 10.222.0.79 () {58 vars in 1149 bytes} [Mon Oct 17 13:54:55 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:54:56.075155 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-94756cb0-679b-4d3f-9599-4a264ba7fcd4 tempest-VolumesTestJSON-59672609 tempest-VolumesTestJSON-59672609-project] Calling method '.version_select at 0x7f7cd59e3a60>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:56.326145 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-94756cb0-679b-4d3f-9599-4a264ba7fcd4 tempest-VolumesTestJSON-59672609 tempest-VolumesTestJSON-59672609-project] 10.222.0.79 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.255595 Oct 17 13:54:56.345834 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7f517b27-5bc1-4398-994b-44e663ea27dc tempest-VolumesTestJSON-59672609 tempest-VolumesTestJSON-59672609-project] Calling method '.version_select at 0x7f7cd42a3040>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:56.347040 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2089/4295] 10.222.0.79 () {58 vars in 1134 bytes} [Mon Oct 17 13:54:56 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:56.528204 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7f517b27-5bc1-4398-994b-44e663ea27dc tempest-VolumesTestJSON-59672609 tempest-VolumesTestJSON-59672609-project] 10.222.0.79 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.186157 Oct 17 13:54:56.528919 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2207/4296] 10.222.0.79 () {58 vars in 1167 bytes} [Mon Oct 17 13:54:56 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:54:56.546258 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ee9a6b55-da67-469b-b6db-032220d607fa tempest-VolumesTestJSON-59672609 tempest-VolumesTestJSON-59672609-project] Calling method '.version_select at 0x7f7cd55f7940>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:56.697330 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ee9a6b55-da67-469b-b6db-032220d607fa tempest-VolumesTestJSON-59672609 tempest-VolumesTestJSON-59672609-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.155035 Oct 17 13:54:56.708239 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2090/4297] 10.222.0.79 () {58 vars in 1170 bytes} [Mon Oct 17 13:54:56 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:54:56.716276 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9cf15730-9ad6-4c00-a1ab-7db9c128b842 tempest-VolumesTestJSON-59672609 tempest-VolumesTestJSON-59672609-project] Calling method '.version_select at 0x7f7cd42901f0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:56.798273 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d0e8da19-ceb3-40ba-ae5c-d9ce3f89f639 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:56.798898 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d0e8da19-ceb3-40ba-ae5c-d9ce3f89f639 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] [instance: 5eca5e25-1250-4f67-9a40-cc806333cb16] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:56.811054 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d0e8da19-ceb3-40ba-ae5c-d9ce3f89f639 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:56.822501 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d0e8da19-ceb3-40ba-ae5c-d9ce3f89f639 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:56.823113 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d0e8da19-ceb3-40ba-ae5c-d9ce3f89f639 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:56.828008 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d0e8da19-ceb3-40ba-ae5c-d9ce3f89f639 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:56.833138 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d0e8da19-ceb3-40ba-ae5c-d9ce3f89f639 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:56.835377 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d0e8da19-ceb3-40ba-ae5c-d9ce3f89f639 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:56.898591 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9cf15730-9ad6-4c00-a1ab-7db9c128b842 tempest-VolumesTestJSON-59672609 tempest-VolumesTestJSON-59672609-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.187402 Oct 17 13:54:56.899407 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2208/4298] 10.222.0.79 () {58 vars in 1155 bytes} [Mon Oct 17 13:54:56 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:56.922909 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-199499fe-8d91-4e12-8df4-441cd1f19d9b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:56.923561 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-199499fe-8d91-4e12-8df4-441cd1f19d9b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 051c9371-d3e2-4166-bed5-c73dc77ec977] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:56.957480 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-199499fe-8d91-4e12-8df4-441cd1f19d9b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:56.957985 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-199499fe-8d91-4e12-8df4-441cd1f19d9b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:56.958420 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-199499fe-8d91-4e12-8df4-441cd1f19d9b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:56.959128 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-199499fe-8d91-4e12-8df4-441cd1f19d9b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:56.971428 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-199499fe-8d91-4e12-8df4-441cd1f19d9b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:56.972167 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-199499fe-8d91-4e12-8df4-441cd1f19d9b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:57.733369 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d0e8da19-ceb3-40ba-ae5c-d9ce3f89f639 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6618084b720b47f9b56b29849f0cc995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4cc8d4a7a8463eb099756488bca536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:57.746873 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d0e8da19-ceb3-40ba-ae5c-d9ce3f89f639 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] 10.222.0.79 "GET /compute/v2.1/servers/5eca5e25-1250-4f67-9a40-cc806333cb16" status: 200 len: 1316 microversion: 2.1 time: 0.952551 Oct 17 13:54:57.748115 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2091/4299] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:56 2022] GET /compute/v2.1/servers/5eca5e25-1250-4f67-9a40-cc806333cb16 => generated 1316 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:57.762154 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ffa1a32f-4029-4980-aec1-07342af6395b tempest-VolumesTestJSON-59672609 tempest-VolumesTestJSON-59672609-project] Calling method '.version_select at 0x7f7cd98d0b80>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:57.927412 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ffa1a32f-4029-4980-aec1-07342af6395b tempest-VolumesTestJSON-59672609 tempest-VolumesTestJSON-59672609-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.177743 Oct 17 13:54:57.928570 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2092/4300] 10.222.0.79 () {58 vars in 1188 bytes} [Mon Oct 17 13:54:57 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:54:57.934241 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6c90a004-df85-4473-a651-97834d650f1d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:57.934760 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6c90a004-df85-4473-a651-97834d650f1d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 10690310-b856-4f6e-a4ea-1b771f45a75f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:57.961744 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6c90a004-df85-4473-a651-97834d650f1d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:57.962239 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6c90a004-df85-4473-a651-97834d650f1d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:57.962681 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6c90a004-df85-4473-a651-97834d650f1d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:57.967537 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6c90a004-df85-4473-a651-97834d650f1d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:57.968083 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6c90a004-df85-4473-a651-97834d650f1d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:57.968535 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6c90a004-df85-4473-a651-97834d650f1d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:58.009989 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-6c90a004-df85-4473-a651-97834d650f1d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] HTTP exception thrown: Instance 10690310-b856-4f6e-a4ea-1b771f45a75f could not be found. Oct 17 13:54:58.011982 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6c90a004-df85-4473-a651-97834d650f1d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Request method failure captured: Oct 17 13:54:58.011982 n-d-854247-14 devstack@n-api.service[127017]: request: DELETE /compute/v2.1/servers/10690310-b856-4f6e-a4ea-1b771f45a75f HTTP/1.1 Oct 17 13:54:58.011982 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:54:58.011982 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:54:58.011982 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:54:58.011982 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:54:58.011982 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:54:58.011982 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:54:58.011982 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:54:58.011982 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:54:58.011982 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTV0JL7NQSDQqh4ZMvkCDXT2fwovcCgk-nxK1nRG4B-HeC5OA7y2_TQv_yPRGTaQ-3zvHufQBJMrO1ZhsIWZZ0ugPMuvlokQmhLWi-H9zySFSYK0iM1qNABohwKQ4S7v-F2ZGFUB1jMKnP05ShlKiL4M8_7Jns7W8GDQtoUfjwQ0M1Lk Oct 17 13:54:58.011982 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:54:58.011982 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:54:58.011982 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:54:58.011982 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:54:58.011982 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:54:58.011982 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:54:58.011982 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 4acd31ce63b64ac3a05b76d4a9fdf7c0 Oct 17 13:54:58.011982 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-AttachVolumeNegativeTest-1792618646 Oct 17 13:54:58.011982 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:54:58.011982 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:54:58.011982 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4acd31ce63b64ac3a05b76d4a9fdf7c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4acd31ce63b64ac3a05b76d4a9fdf7c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4acd31ce63b64ac3a05b76d4a9fdf7c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4acd31ce63b64ac3a05b76d4a9fdf7c0", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:54:58.011982 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-AttachVolumeNegativeTest-1792618646 Oct 17 13:54:58.011982 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 4acd31ce63b64ac3a05b76d4a9fdf7c0 Oct 17 13:54:58.011982 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1792618646 Oct 17 13:54:58.011982 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-AttachVolumeNegativeTest-1792618646-project Oct 17 13:54:58.011982 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:54:58.011982 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:54:58.011982 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: c7a7b9b048234fd2926739e3f08400b0 Oct 17 13:54:58.011982 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-AttachVolumeNegativeTest-1792618646-project Oct 17 13:54:58.011982 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:54:58.011982 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 10690310-b856-4f6e-a4ea-1b771f45a75f could not be found. Oct 17 13:54:58.011982 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '10690310-b856-4f6e-a4ea-1b771f45a75f'} Oct 17 13:54:58.011982 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:54:58.011982 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:54:58.011982 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:54:58.011982 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:54:58.011982 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:54:58.011982 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:54:58.011982 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:54:58.011982 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:54:58.011982 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:54:58.011982 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:54:58.011982 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10690310-b856-4f6e-a4ea-1b771f45a75f could not be found. Oct 17 13:54:58.011982 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:58.011982 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:54:58.011982 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:58.011982 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:54:58.011982 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:54:58.011982 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:54:58.011982 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:54:58.011982 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:54:58.011982 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:54:58.011982 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:54:58.011982 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:54:58.011982 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:54:58.011982 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:54:58.011982 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:54:58.011982 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:54:58.011982 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:54:58.011982 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:54:58.011982 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:54:58.016587 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10690310-b856-4f6e-a4ea-1b771f45a75f could not be found. Oct 17 13:54:58.016587 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:58.016587 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:54:58.016587 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:58.016587 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:54:58.016587 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:54:58.016587 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:54:58.016587 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:54:58.016587 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:54:58.016587 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10690310-b856-4f6e-a4ea-1b771f45a75f could not be found. Oct 17 13:54:58.016587 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:58.016587 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6c90a004-df85-4473-a651-97834d650f1d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Returning 404 to user: Instance 10690310-b856-4f6e-a4ea-1b771f45a75f could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:54:58.018665 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6c90a004-df85-4473-a651-97834d650f1d tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "DELETE /compute/v2.1/servers/10690310-b856-4f6e-a4ea-1b771f45a75f" status: 404 len: 111 microversion: 2.1 time: 0.083838 Oct 17 13:54:58.019308 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2093/4301] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:54:57 2022] DELETE /compute/v2.1/servers/10690310-b856-4f6e-a4ea-1b771f45a75f => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:54:58.031095 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d617e91e-435f-4b28-b99f-70df6ed313b4 tempest-VolumesTestJSON-59672609 tempest-VolumesTestJSON-59672609-project] Calling method '.version_select at 0x7f7cd5b01b80>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:58.404629 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d617e91e-435f-4b28-b99f-70df6ed313b4 tempest-VolumesTestJSON-59672609 tempest-VolumesTestJSON-59672609-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.384208 Oct 17 13:54:58.416025 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2094/4302] 10.222.0.79 () {58 vars in 1155 bytes} [Mon Oct 17 13:54:58 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:58.428739 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-492f467c-b42a-4fb2-bfb1-4ace3e58491c tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:58.428889 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-492f467c-b42a-4fb2-bfb1-4ace3e58491c tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] [instance: 10690310-b856-4f6e-a4ea-1b771f45a75f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:58.457713 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-492f467c-b42a-4fb2-bfb1-4ace3e58491c tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:58.458216 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-492f467c-b42a-4fb2-bfb1-4ace3e58491c tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:58.458690 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-492f467c-b42a-4fb2-bfb1-4ace3e58491c tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:58.463622 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-492f467c-b42a-4fb2-bfb1-4ace3e58491c tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:58.464110 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-492f467c-b42a-4fb2-bfb1-4ace3e58491c tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:58.464591 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-492f467c-b42a-4fb2-bfb1-4ace3e58491c tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:58.497122 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-492f467c-b42a-4fb2-bfb1-4ace3e58491c tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] HTTP exception thrown: Instance 10690310-b856-4f6e-a4ea-1b771f45a75f could not be found. Oct 17 13:54:58.498697 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-492f467c-b42a-4fb2-bfb1-4ace3e58491c tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Request method failure captured: Oct 17 13:54:58.498697 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/10690310-b856-4f6e-a4ea-1b771f45a75f HTTP/1.1 Oct 17 13:54:58.498697 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:54:58.498697 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:54:58.498697 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:54:58.498697 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:54:58.498697 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:54:58.498697 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:54:58.498697 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:54:58.498697 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:54:58.498697 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTV0JL7NQSDQqh4ZMvkCDXT2fwovcCgk-nxK1nRG4B-HeC5OA7y2_TQv_yPRGTaQ-3zvHufQBJMrO1ZhsIWZZ0ugPMuvlokQmhLWi-H9zySFSYK0iM1qNABohwKQ4S7v-F2ZGFUB1jMKnP05ShlKiL4M8_7Jns7W8GDQtoUfjwQ0M1Lk Oct 17 13:54:58.498697 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:54:58.498697 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:54:58.498697 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:54:58.498697 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:54:58.498697 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:54:58.498697 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:54:58.498697 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 4acd31ce63b64ac3a05b76d4a9fdf7c0 Oct 17 13:54:58.498697 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-AttachVolumeNegativeTest-1792618646 Oct 17 13:54:58.498697 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:54:58.498697 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:54:58.498697 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4acd31ce63b64ac3a05b76d4a9fdf7c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4acd31ce63b64ac3a05b76d4a9fdf7c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4acd31ce63b64ac3a05b76d4a9fdf7c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4acd31ce63b64ac3a05b76d4a9fdf7c0", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:54:58.498697 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-AttachVolumeNegativeTest-1792618646 Oct 17 13:54:58.498697 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 4acd31ce63b64ac3a05b76d4a9fdf7c0 Oct 17 13:54:58.498697 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1792618646 Oct 17 13:54:58.498697 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-AttachVolumeNegativeTest-1792618646-project Oct 17 13:54:58.498697 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:54:58.498697 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:54:58.498697 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: c7a7b9b048234fd2926739e3f08400b0 Oct 17 13:54:58.498697 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-AttachVolumeNegativeTest-1792618646-project Oct 17 13:54:58.498697 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:54:58.498697 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 10690310-b856-4f6e-a4ea-1b771f45a75f could not be found. Oct 17 13:54:58.498697 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '10690310-b856-4f6e-a4ea-1b771f45a75f'} Oct 17 13:54:58.498697 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:54:58.498697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:54:58.498697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:54:58.498697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:54:58.498697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:54:58.498697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:54:58.498697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:54:58.498697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:54:58.498697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:54:58.498697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:54:58.498697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10690310-b856-4f6e-a4ea-1b771f45a75f could not be found. Oct 17 13:54:58.498697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:58.498697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:54:58.498697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:58.498697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:54:58.498697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:54:58.498697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:54:58.498697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:54:58.498697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:54:58.498697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:54:58.498697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:54:58.498697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:54:58.498697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:54:58.498697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:54:58.498697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:54:58.498697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:54:58.498697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:54:58.498697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10690310-b856-4f6e-a4ea-1b771f45a75f could not be found. Oct 17 13:54:58.498697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:58.498697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:54:58.498697 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:58.502451 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:54:58.502451 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:54:58.502451 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:54:58.502451 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:54:58.502451 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:54:58.502451 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10690310-b856-4f6e-a4ea-1b771f45a75f could not be found. Oct 17 13:54:58.502451 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:54:58.502451 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-492f467c-b42a-4fb2-bfb1-4ace3e58491c tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] Returning 404 to user: Instance 10690310-b856-4f6e-a4ea-1b771f45a75f could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:54:58.503964 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-492f467c-b42a-4fb2-bfb1-4ace3e58491c tempest-AttachVolumeNegativeTest-1792618646 tempest-AttachVolumeNegativeTest-1792618646-project] 10.222.0.79 "GET /compute/v2.1/servers/10690310-b856-4f6e-a4ea-1b771f45a75f" status: 404 len: 111 microversion: 2.1 time: 0.097470 Oct 17 13:54:58.504695 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2095/4303] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:58 2022] GET /compute/v2.1/servers/10690310-b856-4f6e-a4ea-1b771f45a75f => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:54:58.772701 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-cd929ee7-87ec-4775-8a22-e3b0c4239253 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:58.773555 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-cd929ee7-87ec-4775-8a22-e3b0c4239253 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] [instance: 5eca5e25-1250-4f67-9a40-cc806333cb16] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:58.786716 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cd929ee7-87ec-4775-8a22-e3b0c4239253 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:58.787267 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cd929ee7-87ec-4775-8a22-e3b0c4239253 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:58.789610 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cd929ee7-87ec-4775-8a22-e3b0c4239253 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:58.790367 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cd929ee7-87ec-4775-8a22-e3b0c4239253 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:58.791128 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cd929ee7-87ec-4775-8a22-e3b0c4239253 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:58.793153 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cd929ee7-87ec-4775-8a22-e3b0c4239253 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:58.957585 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-199499fe-8d91-4e12-8df4-441cd1f19d9b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:58.979152 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-199499fe-8d91-4e12-8df4-441cd1f19d9b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977" status: 200 len: 1511 microversion: 2.1 time: 2.072867 Oct 17 13:54:58.980037 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2209/4304] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:56 2022] GET /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977 => generated 1511 bytes in 2080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:00.003117 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-319f5e01-e5c5-4f99-99ed-d396d526cebe tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:00.004481 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-319f5e01-e5c5-4f99-99ed-d396d526cebe tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 051c9371-d3e2-4166-bed5-c73dc77ec977] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:00.015422 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:55:00.037800 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-319f5e01-e5c5-4f99-99ed-d396d526cebe tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:00.038893 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-319f5e01-e5c5-4f99-99ed-d396d526cebe tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:00.039560 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-319f5e01-e5c5-4f99-99ed-d396d526cebe tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:00.040838 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-319f5e01-e5c5-4f99-99ed-d396d526cebe tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:00.047159 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-319f5e01-e5c5-4f99-99ed-d396d526cebe tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:00.047911 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-319f5e01-e5c5-4f99-99ed-d396d526cebe tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:00.429588 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-cd929ee7-87ec-4775-8a22-e3b0c4239253 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6618084b720b47f9b56b29849f0cc995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4cc8d4a7a8463eb099756488bca536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:00.448807 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-cd929ee7-87ec-4775-8a22-e3b0c4239253 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] 10.222.0.79 "GET /compute/v2.1/servers/5eca5e25-1250-4f67-9a40-cc806333cb16" status: 200 len: 1316 microversion: 2.1 time: 1.681090 Oct 17 13:55:00.452187 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2096/4305] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:58 2022] GET /compute/v2.1/servers/5eca5e25-1250-4f67-9a40-cc806333cb16 => generated 1316 bytes in 1685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:55:01.077749 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-319f5e01-e5c5-4f99-99ed-d396d526cebe tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:01.106064 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-319f5e01-e5c5-4f99-99ed-d396d526cebe tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977" status: 200 len: 1511 microversion: 2.1 time: 1.104344 Oct 17 13:55:01.108309 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2210/4306] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:59 2022] GET /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977 => generated 1511 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:55:01.492414 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4e6c9eb5-b2b3-487f-b429-9930fd6bfad6 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:01.493877 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4e6c9eb5-b2b3-487f-b429-9930fd6bfad6 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] [instance: 5eca5e25-1250-4f67-9a40-cc806333cb16] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:01.522335 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4e6c9eb5-b2b3-487f-b429-9930fd6bfad6 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:01.523300 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4e6c9eb5-b2b3-487f-b429-9930fd6bfad6 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:01.523977 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4e6c9eb5-b2b3-487f-b429-9930fd6bfad6 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:01.525040 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4e6c9eb5-b2b3-487f-b429-9930fd6bfad6 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:01.525905 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4e6c9eb5-b2b3-487f-b429-9930fd6bfad6 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:01.526543 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4e6c9eb5-b2b3-487f-b429-9930fd6bfad6 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:02.133658 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4697ac3d-98e7-4cbe-b77e-27ab2f8883f7 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:02.135504 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4697ac3d-98e7-4cbe-b77e-27ab2f8883f7 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 051c9371-d3e2-4166-bed5-c73dc77ec977] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:02.152660 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4697ac3d-98e7-4cbe-b77e-27ab2f8883f7 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:02.153434 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4697ac3d-98e7-4cbe-b77e-27ab2f8883f7 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:02.154052 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4697ac3d-98e7-4cbe-b77e-27ab2f8883f7 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:02.156194 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4697ac3d-98e7-4cbe-b77e-27ab2f8883f7 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:02.158050 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4697ac3d-98e7-4cbe-b77e-27ab2f8883f7 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:02.158655 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4697ac3d-98e7-4cbe-b77e-27ab2f8883f7 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:02.586945 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=10 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:55:02.763368 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4e6c9eb5-b2b3-487f-b429-9930fd6bfad6 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6618084b720b47f9b56b29849f0cc995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4cc8d4a7a8463eb099756488bca536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:02.780226 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4e6c9eb5-b2b3-487f-b429-9930fd6bfad6 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] 10.222.0.79 "GET /compute/v2.1/servers/5eca5e25-1250-4f67-9a40-cc806333cb16" status: 200 len: 1316 microversion: 2.1 time: 1.303424 Oct 17 13:55:02.783560 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4697ac3d-98e7-4cbe-b77e-27ab2f8883f7 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:02.793355 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2097/4307] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:01 2022] GET /compute/v2.1/servers/5eca5e25-1250-4f67-9a40-cc806333cb16 => generated 1316 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:02.799237 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4697ac3d-98e7-4cbe-b77e-27ab2f8883f7 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977" status: 200 len: 1511 microversion: 2.1 time: 0.665829 Oct 17 13:55:02.803495 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2211/4308] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:02 2022] GET /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977 => generated 1511 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:02.804859 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-54f896f1-3216-4b13-9dda-656f3f171306 req-f7130084-176e-409f-bdfc-715f499f1f36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5eca5e25-1250-4f67-9a40-cc806333cb16", "name": "network-vif-plugged", "status": "completed", "tag": "7aff2611-21dc-469f-9f1f-a2f4877289f1"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:55:02.815669 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=8 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:55:02.819769 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-54f896f1-3216-4b13-9dda-656f3f171306 req-f7130084-176e-409f-bdfc-715f499f1f36 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:02.820962 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-54f896f1-3216-4b13-9dda-656f3f171306 req-f7130084-176e-409f-bdfc-715f499f1f36 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:02.822451 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-54f896f1-3216-4b13-9dda-656f3f171306 req-f7130084-176e-409f-bdfc-715f499f1f36 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:02.873210 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-54f896f1-3216-4b13-9dda-656f3f171306 req-f7130084-176e-409f-bdfc-715f499f1f36 service nova] Creating event network-vif-plugged:7aff2611-21dc-469f-9f1f-a2f4877289f1 for instance 5eca5e25-1250-4f67-9a40-cc806333cb16 on n-h2-854247-14 Oct 17 13:55:02.886638 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-54f896f1-3216-4b13-9dda-656f3f171306 req-f7130084-176e-409f-bdfc-715f499f1f36 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086510 Oct 17 13:55:02.888530 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2098/4309] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:55:03.519715 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e6880594-3afe-4c1e-8c29-4b3a261614c6 tempest-SecurityGroupRulesTestJSON-1760789412 tempest-SecurityGroupRulesTestJSON-1760789412-project] Action: 'create', calling method: .version_select at 0x7f7cd42441f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1323904623", "description": "tempest-description-140148115"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:55:03.805640 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4559844d-eb23-46b9-b6fe-d9e60bb9a4d3 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:03.806972 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4559844d-eb23-46b9-b6fe-d9e60bb9a4d3 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] [instance: 5eca5e25-1250-4f67-9a40-cc806333cb16] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:03.824931 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4559844d-eb23-46b9-b6fe-d9e60bb9a4d3 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:03.829573 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4559844d-eb23-46b9-b6fe-d9e60bb9a4d3 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:03.830631 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4559844d-eb23-46b9-b6fe-d9e60bb9a4d3 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:03.833972 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4559844d-eb23-46b9-b6fe-d9e60bb9a4d3 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:03.835266 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4559844d-eb23-46b9-b6fe-d9e60bb9a4d3 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:03.840262 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4559844d-eb23-46b9-b6fe-d9e60bb9a4d3 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:03.880412 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e6880594-3afe-4c1e-8c29-4b3a261614c6 tempest-SecurityGroupRulesTestJSON-1760789412 tempest-SecurityGroupRulesTestJSON-1760789412-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.021312 Oct 17 13:55:03.889757 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2212/4310] 10.222.0.79 () {60 vars in 1180 bytes} [Mon Oct 17 13:55:02 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:55:03.894824 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8f5c29cc-8210-49b2-a103-33cb44bd7a77 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:03.895478 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8f5c29cc-8210-49b2-a103-33cb44bd7a77 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 051c9371-d3e2-4166-bed5-c73dc77ec977] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:03.906867 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8f5c29cc-8210-49b2-a103-33cb44bd7a77 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:03.914451 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8f5c29cc-8210-49b2-a103-33cb44bd7a77 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:03.916092 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8f5c29cc-8210-49b2-a103-33cb44bd7a77 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:03.918246 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8f5c29cc-8210-49b2-a103-33cb44bd7a77 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:03.921465 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8f5c29cc-8210-49b2-a103-33cb44bd7a77 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:03.922135 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8f5c29cc-8210-49b2-a103-33cb44bd7a77 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:03.926534 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=100 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:55:04.496436 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8f5c29cc-8210-49b2-a103-33cb44bd7a77 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:04.515337 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8f5c29cc-8210-49b2-a103-33cb44bd7a77 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977" status: 200 len: 1511 microversion: 2.1 time: 0.616722 Oct 17 13:55:04.517791 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2213/4311] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:03 2022] GET /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977 => generated 1511 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:04.539539 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4559844d-eb23-46b9-b6fe-d9e60bb9a4d3 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6618084b720b47f9b56b29849f0cc995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4cc8d4a7a8463eb099756488bca536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:04.550884 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4559844d-eb23-46b9-b6fe-d9e60bb9a4d3 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] 10.222.0.79 "GET /compute/v2.1/servers/5eca5e25-1250-4f67-9a40-cc806333cb16" status: 200 len: 1316 microversion: 2.1 time: 0.748601 Oct 17 13:55:04.551419 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-51f61f61-800a-4a7b-820c-44b8021acda6 tempest-SecurityGroupRulesTestJSON-1760789412 tempest-SecurityGroupRulesTestJSON-1760789412-project] Action: 'create', calling method: .version_select at 0x7f7cd423fa60>, body: {"security_group_rule": {"parent_group_id": "e950c166-2f9f-4d3e-8635-0a3a991e3b63", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:55:04.556394 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2099/4312] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:03 2022] GET /compute/v2.1/servers/5eca5e25-1250-4f67-9a40-cc806333cb16 => generated 1316 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:55:05.205012 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-51f61f61-800a-4a7b-820c-44b8021acda6 tempest-SecurityGroupRulesTestJSON-1760789412 tempest-SecurityGroupRulesTestJSON-1760789412-project] 10.222.0.79 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.678591 Oct 17 13:55:05.205613 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2214/4313] 10.222.0.79 () {60 vars in 1195 bytes} [Mon Oct 17 13:55:04 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:55:05.221148 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-73b784c0-53a4-4dc3-99e0-21922de375b0 tempest-SecurityGroupRulesTestJSON-1760789412 tempest-SecurityGroupRulesTestJSON-1760789412-project] Action: 'create', calling method: .version_select at 0x7f7cd55e9820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1338199685", "description": "tempest-description-2122385621"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:55:05.545586 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fe5a29ac-6c49-4194-a7ef-7111e187a9b9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:05.546361 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-fe5a29ac-6c49-4194-a7ef-7111e187a9b9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 051c9371-d3e2-4166-bed5-c73dc77ec977] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:05.570805 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe5a29ac-6c49-4194-a7ef-7111e187a9b9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:05.578747 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe5a29ac-6c49-4194-a7ef-7111e187a9b9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:05.581464 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe5a29ac-6c49-4194-a7ef-7111e187a9b9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:05.597469 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe5a29ac-6c49-4194-a7ef-7111e187a9b9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:05.601799 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe5a29ac-6c49-4194-a7ef-7111e187a9b9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:05.607353 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe5a29ac-6c49-4194-a7ef-7111e187a9b9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:05.691510 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-73b784c0-53a4-4dc3-99e0-21922de375b0 tempest-SecurityGroupRulesTestJSON-1760789412 tempest-SecurityGroupRulesTestJSON-1760789412-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.475832 Oct 17 13:55:05.692636 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2100/4314] 10.222.0.79 () {60 vars in 1180 bytes} [Mon Oct 17 13:55:05 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:55:05.698219 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-97c1cf93-0c4d-41b7-8786-72fe668b9191 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:05.699304 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-97c1cf93-0c4d-41b7-8786-72fe668b9191 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] [instance: 5eca5e25-1250-4f67-9a40-cc806333cb16] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:05.753045 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-97c1cf93-0c4d-41b7-8786-72fe668b9191 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:05.759058 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-97c1cf93-0c4d-41b7-8786-72fe668b9191 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:05.767522 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-97c1cf93-0c4d-41b7-8786-72fe668b9191 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:05.779114 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-97c1cf93-0c4d-41b7-8786-72fe668b9191 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:05.782451 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-97c1cf93-0c4d-41b7-8786-72fe668b9191 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:05.782913 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-97c1cf93-0c4d-41b7-8786-72fe668b9191 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:06.377941 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-97c1cf93-0c4d-41b7-8786-72fe668b9191 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6618084b720b47f9b56b29849f0cc995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4cc8d4a7a8463eb099756488bca536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:06.388918 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-97c1cf93-0c4d-41b7-8786-72fe668b9191 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] 10.222.0.79 "GET /compute/v2.1/servers/5eca5e25-1250-4f67-9a40-cc806333cb16" status: 200 len: 1506 microversion: 2.1 time: 0.695093 Oct 17 13:55:06.389510 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2101/4315] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:05 2022] GET /compute/v2.1/servers/5eca5e25-1250-4f67-9a40-cc806333cb16 => generated 1506 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:06.432784 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fe5a29ac-6c49-4194-a7ef-7111e187a9b9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:06.444684 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fe5a29ac-6c49-4194-a7ef-7111e187a9b9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977" status: 200 len: 1511 microversion: 2.1 time: 0.904598 Oct 17 13:55:06.446816 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8dd33466-8d35-4308-80d6-54a614e70d95 tempest-SecurityGroupRulesTestJSON-1760789412 tempest-SecurityGroupRulesTestJSON-1760789412-project] Action: 'create', calling method: .version_select at 0x7f7cd55f7a60>, body: {"security_group_rule": {"parent_group_id": "5811c12d-9179-4506-8653-d91b158a4552", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:55:06.453060 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2215/4316] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:05 2022] GET /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977 => generated 1511 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:06.477490 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e01d81c2-4cab-4f60-8680-f347db5c8b1c tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:06.478257 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e01d81c2-4cab-4f60-8680-f347db5c8b1c tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] [instance: 5eca5e25-1250-4f67-9a40-cc806333cb16] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:06.485748 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e01d81c2-4cab-4f60-8680-f347db5c8b1c tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:06.486100 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e01d81c2-4cab-4f60-8680-f347db5c8b1c tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:06.486541 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e01d81c2-4cab-4f60-8680-f347db5c8b1c tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:06.494185 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e01d81c2-4cab-4f60-8680-f347db5c8b1c tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:06.494942 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e01d81c2-4cab-4f60-8680-f347db5c8b1c tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:06.495643 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e01d81c2-4cab-4f60-8680-f347db5c8b1c tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:06.605019 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e01d81c2-4cab-4f60-8680-f347db5c8b1c tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] 10.222.0.79 "GET /compute/v2.1/servers/5eca5e25-1250-4f67-9a40-cc806333cb16/ips" status: 200 len: 110 microversion: 2.1 time: 0.150750 Oct 17 13:55:06.615423 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2216/4317] 10.222.0.79 () {58 vars in 1248 bytes} [Mon Oct 17 13:55:06 2022] GET /compute/v2.1/servers/5eca5e25-1250-4f67-9a40-cc806333cb16/ips => generated 110 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:55:06.660152 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4eb729c6-8aaa-4559-86f2-9939fb462277 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:06.660838 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4eb729c6-8aaa-4559-86f2-9939fb462277 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] [instance: 5eca5e25-1250-4f67-9a40-cc806333cb16] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:06.672683 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4eb729c6-8aaa-4559-86f2-9939fb462277 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:06.673365 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4eb729c6-8aaa-4559-86f2-9939fb462277 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:06.674453 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4eb729c6-8aaa-4559-86f2-9939fb462277 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:06.676300 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4eb729c6-8aaa-4559-86f2-9939fb462277 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:06.679658 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4eb729c6-8aaa-4559-86f2-9939fb462277 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:06.680963 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4eb729c6-8aaa-4559-86f2-9939fb462277 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:06.768887 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4eb729c6-8aaa-4559-86f2-9939fb462277 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] 10.222.0.79 "GET /compute/v2.1/servers/5eca5e25-1250-4f67-9a40-cc806333cb16/ips" status: 200 len: 110 microversion: 2.1 time: 0.149746 Oct 17 13:55:06.770593 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2217/4318] 10.222.0.79 () {58 vars in 1248 bytes} [Mon Oct 17 13:55:06 2022] GET /compute/v2.1/servers/5eca5e25-1250-4f67-9a40-cc806333cb16/ips => generated 110 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:55:06.783522 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-19a7cba6-97a5-4ec4-a84a-2d44c77d6dbf tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:06.789919 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-19a7cba6-97a5-4ec4-a84a-2d44c77d6dbf tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] [instance: 5eca5e25-1250-4f67-9a40-cc806333cb16] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:06.812823 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-19a7cba6-97a5-4ec4-a84a-2d44c77d6dbf tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:06.813332 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-19a7cba6-97a5-4ec4-a84a-2d44c77d6dbf tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:06.813767 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-19a7cba6-97a5-4ec4-a84a-2d44c77d6dbf tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:06.814484 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-19a7cba6-97a5-4ec4-a84a-2d44c77d6dbf tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:06.821069 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-19a7cba6-97a5-4ec4-a84a-2d44c77d6dbf tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:06.821537 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-19a7cba6-97a5-4ec4-a84a-2d44c77d6dbf tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:06.888915 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=100 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:55:06.923099 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-19a7cba6-97a5-4ec4-a84a-2d44c77d6dbf tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] 10.222.0.79 "GET /compute/v2.1/servers/5eca5e25-1250-4f67-9a40-cc806333cb16/ips/tempest-ServerAddressesTestJSON-2039729103-network" status: 200 len: 95 microversion: 2.1 time: 0.144497 Oct 17 13:55:06.927846 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2218/4319] 10.222.0.79 () {58 vars in 1401 bytes} [Mon Oct 17 13:55:06 2022] GET /compute/v2.1/servers/5eca5e25-1250-4f67-9a40-cc806333cb16/ips/tempest-ServerAddressesTestJSON-2039729103-network => generated 95 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:55:06.950591 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8d79d2a8-45c8-4bd0-9aa6-56654dbd530f tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:06.958742 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8d79d2a8-45c8-4bd0-9aa6-56654dbd530f tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] [instance: 5eca5e25-1250-4f67-9a40-cc806333cb16] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:06.985549 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8d79d2a8-45c8-4bd0-9aa6-56654dbd530f tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:06.987033 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8d79d2a8-45c8-4bd0-9aa6-56654dbd530f tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:06.989211 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8d79d2a8-45c8-4bd0-9aa6-56654dbd530f tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:06.993439 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8d79d2a8-45c8-4bd0-9aa6-56654dbd530f tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:06.995504 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8d79d2a8-45c8-4bd0-9aa6-56654dbd530f tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:06.997517 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8d79d2a8-45c8-4bd0-9aa6-56654dbd530f tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:07.121657 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8d79d2a8-45c8-4bd0-9aa6-56654dbd530f tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] [instance: 5eca5e25-1250-4f67-9a40-cc806333cb16] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:55:07.146748 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8dd33466-8d35-4308-80d6-54a614e70d95 tempest-SecurityGroupRulesTestJSON-1760789412 tempest-SecurityGroupRulesTestJSON-1760789412-project] 10.222.0.79 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.726108 Oct 17 13:55:07.155525 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2102/4320] 10.222.0.79 () {60 vars in 1195 bytes} [Mon Oct 17 13:55:06 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:55:07.172862 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3c2d53e7-0252-45b0-8d4d-1176eb54b827 tempest-SecurityGroupRulesTestJSON-1760789412 tempest-SecurityGroupRulesTestJSON-1760789412-project] Action: 'create', calling method: .version_select at 0x7f7cd5455310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-27578426", "description": "tempest-description-2064758502"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:55:07.357167 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8d79d2a8-45c8-4bd0-9aa6-56654dbd530f tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] 10.222.0.79 "DELETE /compute/v2.1/servers/5eca5e25-1250-4f67-9a40-cc806333cb16" status: 204 len: 0 microversion: 2.1 time: 0.420788 Oct 17 13:55:07.358657 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2219/4321] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:55:06 2022] DELETE /compute/v2.1/servers/5eca5e25-1250-4f67-9a40-cc806333cb16 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:55:07.371526 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3b6e3a60-a304-4c33-83f5-c2bac04163d4 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:07.372910 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3b6e3a60-a304-4c33-83f5-c2bac04163d4 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] [instance: 5eca5e25-1250-4f67-9a40-cc806333cb16] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:07.385941 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3b6e3a60-a304-4c33-83f5-c2bac04163d4 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:07.386799 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3b6e3a60-a304-4c33-83f5-c2bac04163d4 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:07.387668 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3b6e3a60-a304-4c33-83f5-c2bac04163d4 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:07.388643 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3b6e3a60-a304-4c33-83f5-c2bac04163d4 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:07.390253 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3b6e3a60-a304-4c33-83f5-c2bac04163d4 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:07.391141 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3b6e3a60-a304-4c33-83f5-c2bac04163d4 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:07.595914 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3c2d53e7-0252-45b0-8d4d-1176eb54b827 tempest-SecurityGroupRulesTestJSON-1760789412 tempest-SecurityGroupRulesTestJSON-1760789412-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.438194 Oct 17 13:55:07.606362 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2103/4322] 10.222.0.79 () {60 vars in 1180 bytes} [Mon Oct 17 13:55:07 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:55:07.612420 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-db41293b-5a49-4041-a5b6-27ca18aaa6f9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:07.613280 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-db41293b-5a49-4041-a5b6-27ca18aaa6f9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 051c9371-d3e2-4166-bed5-c73dc77ec977] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:07.632962 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db41293b-5a49-4041-a5b6-27ca18aaa6f9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:07.633904 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db41293b-5a49-4041-a5b6-27ca18aaa6f9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:07.634544 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db41293b-5a49-4041-a5b6-27ca18aaa6f9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:07.637213 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db41293b-5a49-4041-a5b6-27ca18aaa6f9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:07.638329 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db41293b-5a49-4041-a5b6-27ca18aaa6f9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:07.638948 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db41293b-5a49-4041-a5b6-27ca18aaa6f9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:08.405196 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3b6e3a60-a304-4c33-83f5-c2bac04163d4 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6618084b720b47f9b56b29849f0cc995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4cc8d4a7a8463eb099756488bca536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:08.422828 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3b6e3a60-a304-4c33-83f5-c2bac04163d4 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] 10.222.0.79 "GET /compute/v2.1/servers/5eca5e25-1250-4f67-9a40-cc806333cb16" status: 200 len: 1512 microversion: 2.1 time: 1.057541 Oct 17 13:55:08.423602 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2220/4323] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:07 2022] GET /compute/v2.1/servers/5eca5e25-1250-4f67-9a40-cc806333cb16 => generated 1512 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:08.435230 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-76dad107-753c-436a-9a20-5548637b0d99 tempest-SecurityGroupRulesTestJSON-1760789412 tempest-SecurityGroupRulesTestJSON-1760789412-project] Action: 'create', calling method: .version_select at 0x7f7cd45b4ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1584443981", "description": "tempest-description-1945825073"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:55:08.518139 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-db41293b-5a49-4041-a5b6-27ca18aaa6f9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:08.526745 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-db41293b-5a49-4041-a5b6-27ca18aaa6f9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977" status: 200 len: 1488 microversion: 2.1 time: 0.918997 Oct 17 13:55:08.539841 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2104/4324] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:07 2022] GET /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977 => generated 1488 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:08.564774 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-491de68e-5dad-402f-9246-0e47a3e9c9fa tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:55:08.571580 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-491de68e-5dad-402f-9246-0e47a3e9c9fa tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:08.578605 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-491de68e-5dad-402f-9246-0e47a3e9c9fa tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:08.579438 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-491de68e-5dad-402f-9246-0e47a3e9c9fa tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:08.580347 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-491de68e-5dad-402f-9246-0e47a3e9c9fa tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:08.581967 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-491de68e-5dad-402f-9246-0e47a3e9c9fa tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:08.582658 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-491de68e-5dad-402f-9246-0e47a3e9c9fa tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:08.583327 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-491de68e-5dad-402f-9246-0e47a3e9c9fa tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:08.648844 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-491de68e-5dad-402f-9246-0e47a3e9c9fa tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "POST /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d/action" status: 200 len: 171 microversion: 2.1 time: 0.088111 Oct 17 13:55:08.656103 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2105/4325] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:55:08 2022] POST /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d/action => generated 171 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:55:08.670443 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9f092e90-c9c3-49f6-b1c1-6dd396da248e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:08.672974 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9f092e90-c9c3-49f6-b1c1-6dd396da248e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:08.693336 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f092e90-c9c3-49f6-b1c1-6dd396da248e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:08.695029 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f092e90-c9c3-49f6-b1c1-6dd396da248e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:08.696351 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f092e90-c9c3-49f6-b1c1-6dd396da248e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:08.698702 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f092e90-c9c3-49f6-b1c1-6dd396da248e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:08.699504 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f092e90-c9c3-49f6-b1c1-6dd396da248e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:08.700174 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f092e90-c9c3-49f6-b1c1-6dd396da248e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:09.176790 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9f092e90-c9c3-49f6-b1c1-6dd396da248e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:09.201516 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9f092e90-c9c3-49f6-b1c1-6dd396da248e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1666 microversion: 2.1 time: 0.542735 Oct 17 13:55:09.203832 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2106/4326] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:08 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1666 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:09.238104 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d924fdc6-9e58-4291-b81e-2d088b88b860 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:09.239025 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d924fdc6-9e58-4291-b81e-2d088b88b860 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:09.246576 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d924fdc6-9e58-4291-b81e-2d088b88b860 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:09.247462 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d924fdc6-9e58-4291-b81e-2d088b88b860 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:09.248169 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d924fdc6-9e58-4291-b81e-2d088b88b860 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:09.249121 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d924fdc6-9e58-4291-b81e-2d088b88b860 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:09.259866 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d924fdc6-9e58-4291-b81e-2d088b88b860 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:09.260731 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d924fdc6-9e58-4291-b81e-2d088b88b860 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:09.374039 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-76dad107-753c-436a-9a20-5548637b0d99 tempest-SecurityGroupRulesTestJSON-1760789412 tempest-SecurityGroupRulesTestJSON-1760789412-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.946118 Oct 17 13:55:09.375088 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2221/4327] 10.222.0.79 () {60 vars in 1180 bytes} [Mon Oct 17 13:55:08 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:55:09.389277 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c730f485-0b46-4cab-9f08-f9dd09913047 tempest-SecurityGroupRulesTestJSON-1760789412 tempest-SecurityGroupRulesTestJSON-1760789412-project] Action: 'create', calling method: .version_select at 0x7f7cd4232700>, body: {"security_group_rule": {"parent_group_id": "ff9c9835-8087-441f-a522-dc8206300963", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "2bdae840-c434-4c20-b0dc-1c28fa25ba0e"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:55:09.969093 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d924fdc6-9e58-4291-b81e-2d088b88b860 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:09.998805 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d924fdc6-9e58-4291-b81e-2d088b88b860 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1666 microversion: 2.1 time: 0.764525 Oct 17 13:55:10.007596 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2107/4328] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:09 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1666 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:55:10.039321 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0226a06d-5d3a-455a-87b6-b1c6120a8b60 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:10.056202 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0226a06d-5d3a-455a-87b6-b1c6120a8b60 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] [instance: 5eca5e25-1250-4f67-9a40-cc806333cb16] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:10.075926 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0226a06d-5d3a-455a-87b6-b1c6120a8b60 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:10.088562 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0226a06d-5d3a-455a-87b6-b1c6120a8b60 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:10.089614 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0226a06d-5d3a-455a-87b6-b1c6120a8b60 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:10.091759 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0226a06d-5d3a-455a-87b6-b1c6120a8b60 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:10.092656 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0226a06d-5d3a-455a-87b6-b1c6120a8b60 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:10.094748 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0226a06d-5d3a-455a-87b6-b1c6120a8b60 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:10.880446 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0226a06d-5d3a-455a-87b6-b1c6120a8b60 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6618084b720b47f9b56b29849f0cc995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4cc8d4a7a8463eb099756488bca536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:10.894141 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0226a06d-5d3a-455a-87b6-b1c6120a8b60 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] 10.222.0.79 "GET /compute/v2.1/servers/5eca5e25-1250-4f67-9a40-cc806333cb16" status: 200 len: 1512 microversion: 2.1 time: 0.879561 Oct 17 13:55:10.894783 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2108/4329] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:10 2022] GET /compute/v2.1/servers/5eca5e25-1250-4f67-9a40-cc806333cb16 => generated 1512 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:10.911941 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-98a9c201-473a-4da5-939b-5228e6a173a6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:10.914055 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-98a9c201-473a-4da5-939b-5228e6a173a6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:10.928320 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:55:10.930950 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-98a9c201-473a-4da5-939b-5228e6a173a6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:10.937299 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-98a9c201-473a-4da5-939b-5228e6a173a6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:10.937806 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-98a9c201-473a-4da5-939b-5228e6a173a6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:10.938750 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-98a9c201-473a-4da5-939b-5228e6a173a6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:10.941662 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-98a9c201-473a-4da5-939b-5228e6a173a6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:10.944388 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-98a9c201-473a-4da5-939b-5228e6a173a6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:11.939572 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c730f485-0b46-4cab-9f08-f9dd09913047 tempest-SecurityGroupRulesTestJSON-1760789412 tempest-SecurityGroupRulesTestJSON-1760789412-project] 10.222.0.79 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 2.554215 Oct 17 13:55:11.940232 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2222/4330] 10.222.0.79 () {60 vars in 1195 bytes} [Mon Oct 17 13:55:09 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 2556 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:55:11.945753 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0e7ba8f0-9c02-4724-83c6-30fd4b530972 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:11.946612 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0e7ba8f0-9c02-4724-83c6-30fd4b530972 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] [instance: 5eca5e25-1250-4f67-9a40-cc806333cb16] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:11.969415 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0e7ba8f0-9c02-4724-83c6-30fd4b530972 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:11.988974 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0e7ba8f0-9c02-4724-83c6-30fd4b530972 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:11.992906 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0e7ba8f0-9c02-4724-83c6-30fd4b530972 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:11.996684 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0e7ba8f0-9c02-4724-83c6-30fd4b530972 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:12.006190 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0e7ba8f0-9c02-4724-83c6-30fd4b530972 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:12.012951 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0e7ba8f0-9c02-4724-83c6-30fd4b530972 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:12.135350 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-98a9c201-473a-4da5-939b-5228e6a173a6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:12.151664 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-98a9c201-473a-4da5-939b-5228e6a173a6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1666 microversion: 2.1 time: 1.254166 Oct 17 13:55:12.152525 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2109/4331] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:10 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1666 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:12.178901 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1d31197b-f665-4f80-aa35-0b93effa5e97 tempest-SecurityGroupRulesTestJSON-1760789412 tempest-SecurityGroupRulesTestJSON-1760789412-project] Action: 'create', calling method: .version_select at 0x7f7cd5605d30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-953077034", "description": "tempest-description-200289580"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:55:12.263635 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0e7ba8f0-9c02-4724-83c6-30fd4b530972 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6618084b720b47f9b56b29849f0cc995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4cc8d4a7a8463eb099756488bca536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:12.278415 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0e7ba8f0-9c02-4724-83c6-30fd4b530972 tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] 10.222.0.79 "GET /compute/v2.1/servers/5eca5e25-1250-4f67-9a40-cc806333cb16" status: 200 len: 1470 microversion: 2.1 time: 0.337101 Oct 17 13:55:12.284209 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2223/4332] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:11 2022] GET /compute/v2.1/servers/5eca5e25-1250-4f67-9a40-cc806333cb16 => generated 1470 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:12.290976 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-022b4adc-7a39-4159-857c-dfaabae34ab8 req-ea8fcd11-b0b7-43e3-bc35-0ed278df1bf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5eca5e25-1250-4f67-9a40-cc806333cb16", "name": "network-vif-deleted", "tag": "7aff2611-21dc-469f-9f1f-a2f4877289f1"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:55:12.326572 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-022b4adc-7a39-4159-857c-dfaabae34ab8 req-ea8fcd11-b0b7-43e3-bc35-0ed278df1bf0 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:12.326993 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-022b4adc-7a39-4159-857c-dfaabae34ab8 req-ea8fcd11-b0b7-43e3-bc35-0ed278df1bf0 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:12.327459 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-022b4adc-7a39-4159-857c-dfaabae34ab8 req-ea8fcd11-b0b7-43e3-bc35-0ed278df1bf0 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:12.364918 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-022b4adc-7a39-4159-857c-dfaabae34ab8 req-ea8fcd11-b0b7-43e3-bc35-0ed278df1bf0 service nova] Creating event network-vif-deleted:7aff2611-21dc-469f-9f1f-a2f4877289f1 for instance 5eca5e25-1250-4f67-9a40-cc806333cb16 on n-h2-854247-14 Oct 17 13:55:12.381175 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-022b4adc-7a39-4159-857c-dfaabae34ab8 req-ea8fcd11-b0b7-43e3-bc35-0ed278df1bf0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095078 Oct 17 13:55:12.383968 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2224/4333] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:55:12.395154 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-859e413e-7630-474c-9e86-092f51db2ba0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:12.400093 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-859e413e-7630-474c-9e86-092f51db2ba0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:12.416574 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-859e413e-7630-474c-9e86-092f51db2ba0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:12.417793 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-859e413e-7630-474c-9e86-092f51db2ba0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:12.418404 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-859e413e-7630-474c-9e86-092f51db2ba0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:12.419319 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-859e413e-7630-474c-9e86-092f51db2ba0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:12.425542 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-859e413e-7630-474c-9e86-092f51db2ba0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:12.427435 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-859e413e-7630-474c-9e86-092f51db2ba0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:12.884095 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1d31197b-f665-4f80-aa35-0b93effa5e97 tempest-SecurityGroupRulesTestJSON-1760789412 tempest-SecurityGroupRulesTestJSON-1760789412-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.730105 Oct 17 13:55:12.885669 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2110/4334] 10.222.0.79 () {60 vars in 1180 bytes} [Mon Oct 17 13:55:12 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:55:12.889432 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-859e413e-7630-474c-9e86-092f51db2ba0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:12.899072 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-859e413e-7630-474c-9e86-092f51db2ba0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1666 microversion: 2.1 time: 0.513672 Oct 17 13:55:12.899805 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6ef3f4a9-7e9e-4e8b-a385-1ec4377689ba tempest-SecurityGroupRulesTestJSON-1760789412 tempest-SecurityGroupRulesTestJSON-1760789412-project] Action: 'create', calling method: .version_select at 0x7f7cd5536d30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1534620290", "description": "tempest-description-957509430"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:55:12.916787 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2225/4335] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:12 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1666 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:13.213712 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-48b86f5a-27f1-4d34-ad31-5da17bf55d7f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1525990542", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "1d5948d6-f169-4d00-b98f-07daff8883f9"}]}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:55:13.277709 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6ef3f4a9-7e9e-4e8b-a385-1ec4377689ba tempest-SecurityGroupRulesTestJSON-1760789412 tempest-SecurityGroupRulesTestJSON-1760789412-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.383366 Oct 17 13:55:13.278637 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2111/4336] 10.222.0.79 () {60 vars in 1180 bytes} [Mon Oct 17 13:55:12 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:55:13.292086 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7b572a22-7919-4eeb-917b-b0f3098d1d35 tempest-SecurityGroupRulesTestJSON-1760789412 tempest-SecurityGroupRulesTestJSON-1760789412-project] Action: 'create', calling method: .version_select at 0x7f7cd556b9d0>, body: {"security_group_rule": {"parent_group_id": "ed2ef44d-c645-49f0-af0b-5a6e049b63ce", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "9bbadf08-cb60-42c7-b18b-5f0cfbe0bd0a"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:55:13.321167 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-48b86f5a-27f1-4d34-ad31-5da17bf55d7f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] validate_networks() for [('1d5948d6-f169-4d00-b98f-07daff8883f9', None, None, None, None, None)] {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:55:14.299529 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-48b86f5a-27f1-4d34-ad31-5da17bf55d7f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:55:14.300210 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-48b86f5a-27f1-4d34-ad31-5da17bf55d7f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:55:14.300407 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-48b86f5a-27f1-4d34-ad31-5da17bf55d7f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:55:14.300994 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-48b86f5a-27f1-4d34-ad31-5da17bf55d7f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:55:14.301560 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-48b86f5a-27f1-4d34-ad31-5da17bf55d7f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:55:14.323449 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48b86f5a-27f1-4d34-ad31-5da17bf55d7f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:14.324229 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48b86f5a-27f1-4d34-ad31-5da17bf55d7f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:14.324813 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48b86f5a-27f1-4d34-ad31-5da17bf55d7f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:14.325701 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48b86f5a-27f1-4d34-ad31-5da17bf55d7f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:14.326317 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48b86f5a-27f1-4d34-ad31-5da17bf55d7f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:14.326905 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48b86f5a-27f1-4d34-ad31-5da17bf55d7f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:14.372101 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-48b86f5a-27f1-4d34-ad31-5da17bf55d7f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Getting quotas for project 45371f66db35454fbe896194e75afd6e. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:55:14.378524 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-48b86f5a-27f1-4d34-ad31-5da17bf55d7f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Getting quotas for user c9382b34782f44e2818a26ecadc3f386 and project 45371f66db35454fbe896194e75afd6e. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:55:14.399197 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-48b86f5a-27f1-4d34-ad31-5da17bf55d7f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:55:14.402021 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-48b86f5a-27f1-4d34-ad31-5da17bf55d7f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:55:14.484662 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-48b86f5a-27f1-4d34-ad31-5da17bf55d7f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.274801 Oct 17 13:55:14.485336 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2226/4337] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:55:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1276 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:55:14.496904 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1a0637ec-fb58-44d5-8924-7180a96d835c tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:14.498348 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-1a0637ec-fb58-44d5-8924-7180a96d835c tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] [instance: 5eca5e25-1250-4f67-9a40-cc806333cb16] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:14.506704 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1a0637ec-fb58-44d5-8924-7180a96d835c tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:14.508104 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1a0637ec-fb58-44d5-8924-7180a96d835c tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:14.508801 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1a0637ec-fb58-44d5-8924-7180a96d835c tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:14.509694 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1a0637ec-fb58-44d5-8924-7180a96d835c tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:14.527218 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1a0637ec-fb58-44d5-8924-7180a96d835c tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:14.530801 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1a0637ec-fb58-44d5-8924-7180a96d835c tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:14.554353 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-1a0637ec-fb58-44d5-8924-7180a96d835c tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] HTTP exception thrown: Instance 5eca5e25-1250-4f67-9a40-cc806333cb16 could not be found. Oct 17 13:55:14.556744 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1a0637ec-fb58-44d5-8924-7180a96d835c tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Request method failure captured: Oct 17 13:55:14.556744 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/5eca5e25-1250-4f67-9a40-cc806333cb16 HTTP/1.1 Oct 17 13:55:14.556744 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:55:14.556744 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:55:14.556744 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:55:14.556744 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:55:14.556744 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:55:14.556744 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:55:14.556744 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:55:14.556744 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:55:14.556744 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTV6i0cfrtCaycvZvPkOw9gvgBVazIuV4Ctyf53qj-K9LXRrOZxUOJm6Pe26J7lhsUb0AwmUv2DPvzh2_BuvJ9DeW9b4yEYdbJyoYj5sV1wCqBV3O2nkp05nNd3flU6rR-urFLg2675iDJIi5HyYoe6G-RlEdELVHVi3csm7iGQPVWdE Oct 17 13:55:14.556744 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:55:14.556744 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:55:14.556744 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:55:14.556744 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:55:14.556744 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:55:14.556744 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:55:14.556744 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 3a4cc8d4a7a8463eb099756488bca536 Oct 17 13:55:14.556744 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServerAddressesTestJSON-892902997 Oct 17 13:55:14.556744 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:55:14.556744 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:55:14.556744 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3a4cc8d4a7a8463eb099756488bca536"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/3a4cc8d4a7a8463eb099756488bca536"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3a4cc8d4a7a8463eb099756488bca536"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_3a4cc8d4a7a8463eb099756488bca536", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:55:14.556744 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServerAddressesTestJSON-892902997 Oct 17 13:55:14.556744 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 3a4cc8d4a7a8463eb099756488bca536 Oct 17 13:55:14.556744 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServerAddressesTestJSON-892902997 Oct 17 13:55:14.556744 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServerAddressesTestJSON-892902997-project Oct 17 13:55:14.556744 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:55:14.556744 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:55:14.556744 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 6618084b720b47f9b56b29849f0cc995 Oct 17 13:55:14.556744 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServerAddressesTestJSON-892902997-project Oct 17 13:55:14.556744 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:55:14.556744 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 5eca5e25-1250-4f67-9a40-cc806333cb16 could not be found. Oct 17 13:55:14.556744 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '5eca5e25-1250-4f67-9a40-cc806333cb16'} Oct 17 13:55:14.556744 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:55:14.556744 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:55:14.556744 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:55:14.556744 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:55:14.556744 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:55:14.556744 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:55:14.556744 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:55:14.556744 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:55:14.556744 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:55:14.556744 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:55:14.556744 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5eca5e25-1250-4f67-9a40-cc806333cb16 could not be found. Oct 17 13:55:14.556744 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:55:14.556744 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:55:14.556744 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:55:14.556744 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:55:14.556744 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:55:14.556744 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:55:14.556744 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:55:14.556744 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:55:14.556744 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:55:14.556744 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:55:14.556744 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:55:14.556744 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:55:14.556744 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:55:14.556744 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:55:14.556744 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:55:14.556744 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:55:14.556744 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5eca5e25-1250-4f67-9a40-cc806333cb16 could not be found. Oct 17 13:55:14.556744 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:55:14.556744 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:55:14.556744 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:55:14.562043 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:55:14.562043 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:55:14.562043 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:55:14.562043 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:55:14.562043 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:55:14.562043 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5eca5e25-1250-4f67-9a40-cc806333cb16 could not be found. Oct 17 13:55:14.562043 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:55:14.563981 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1a0637ec-fb58-44d5-8924-7180a96d835c tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] Returning 404 to user: Instance 5eca5e25-1250-4f67-9a40-cc806333cb16 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:55:14.565236 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1a0637ec-fb58-44d5-8924-7180a96d835c tempest-ServerAddressesTestJSON-892902997 tempest-ServerAddressesTestJSON-892902997-project] 10.222.0.79 "GET /compute/v2.1/servers/5eca5e25-1250-4f67-9a40-cc806333cb16" status: 404 len: 111 microversion: 2.1 time: 0.072503 Oct 17 13:55:14.566453 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2227/4338] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:14 2022] GET /compute/v2.1/servers/5eca5e25-1250-4f67-9a40-cc806333cb16 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:55:14.573855 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0a297e5d-f3f9-47ae-9f2f-f509bfd76f76 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:14.575655 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0a297e5d-f3f9-47ae-9f2f-f509bfd76f76 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:14.706684 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0a297e5d-f3f9-47ae-9f2f-f509bfd76f76 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:14.723545 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0a297e5d-f3f9-47ae-9f2f-f509bfd76f76 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6" status: 200 len: 1215 microversion: 2.1 time: 0.152159 Oct 17 13:55:14.728212 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2228/4339] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:14 2022] GET /compute/v2.1/servers/c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6 => generated 1215 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:14.840412 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7b572a22-7919-4eeb-917b-b0f3098d1d35 tempest-SecurityGroupRulesTestJSON-1760789412 tempest-SecurityGroupRulesTestJSON-1760789412-project] 10.222.0.79 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.552367 Oct 17 13:55:14.841751 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2112/4340] 10.222.0.79 () {60 vars in 1195 bytes} [Mon Oct 17 13:55:13 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1554 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:55:14.856158 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-11ef6a8e-06a1-4e88-98dd-8f2e5b0258f0 tempest-SecurityGroupRulesTestJSON-1760789412 tempest-SecurityGroupRulesTestJSON-1760789412-project] Calling method '.version_select at 0x7f7cd4244160>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:15.569117 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-11ef6a8e-06a1-4e88-98dd-8f2e5b0258f0 tempest-SecurityGroupRulesTestJSON-1760789412 tempest-SecurityGroupRulesTestJSON-1760789412-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/9bbadf08-cb60-42c7-b18b-5f0cfbe0bd0a" status: 202 len: 0 microversion: 2.1 time: 0.719358 Oct 17 13:55:15.571600 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2229/4341] 10.222.0.79 () {58 vars in 1272 bytes} [Mon Oct 17 13:55:14 2022] DELETE /compute/v2.1/os-security-groups/9bbadf08-cb60-42c7-b18b-5f0cfbe0bd0a => generated 0 bytes in 722 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:55:15.580528 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3c40d48d-d2bf-43cc-8bf7-5a258fc2158b tempest-SecurityGroupRulesTestJSON-1760789412 tempest-SecurityGroupRulesTestJSON-1760789412-project] Calling method '.version_select at 0x7f7cd5b018b0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:15.748877 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5c4dad68-8087-4f52-b422-d4dda4d8fda7 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:15.749628 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5c4dad68-8087-4f52-b422-d4dda4d8fda7 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:15.757360 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5c4dad68-8087-4f52-b422-d4dda4d8fda7 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:15.765708 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5c4dad68-8087-4f52-b422-d4dda4d8fda7 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:15.765708 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5c4dad68-8087-4f52-b422-d4dda4d8fda7 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:15.766506 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5c4dad68-8087-4f52-b422-d4dda4d8fda7 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:15.766973 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5c4dad68-8087-4f52-b422-d4dda4d8fda7 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:15.767417 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5c4dad68-8087-4f52-b422-d4dda4d8fda7 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:15.792099 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3c40d48d-d2bf-43cc-8bf7-5a258fc2158b tempest-SecurityGroupRulesTestJSON-1760789412 tempest-SecurityGroupRulesTestJSON-1760789412-project] 10.222.0.79 "GET /compute/v2.1/os-security-groups/ed2ef44d-c645-49f0-af0b-5a6e049b63ce" status: 200 len: 246 microversion: 2.1 time: 0.216270 Oct 17 13:55:15.792696 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2113/4342] 10.222.0.79 () {58 vars in 1269 bytes} [Mon Oct 17 13:55:15 2022] GET /compute/v2.1/os-security-groups/ed2ef44d-c645-49f0-af0b-5a6e049b63ce => generated 246 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:55:15.811295 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5965f6f0-727e-48b9-b0fb-79dfcc7f902c tempest-SecurityGroupRulesTestJSON-1760789412 tempest-SecurityGroupRulesTestJSON-1760789412-project] Action: 'create', calling method: .version_select at 0x7f7cd573edc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-584115376", "description": "tempest-description-179225688"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:55:16.121228 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5c4dad68-8087-4f52-b422-d4dda4d8fda7 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:16.134433 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5c4dad68-8087-4f52-b422-d4dda4d8fda7 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6" status: 200 len: 1211 microversion: 2.1 time: 0.389462 Oct 17 13:55:16.140100 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2230/4343] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:15 2022] GET /compute/v2.1/servers/c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6 => generated 1211 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:55:16.313508 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5965f6f0-727e-48b9-b0fb-79dfcc7f902c tempest-SecurityGroupRulesTestJSON-1760789412 tempest-SecurityGroupRulesTestJSON-1760789412-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.507719 Oct 17 13:55:16.314148 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2114/4344] 10.222.0.79 () {60 vars in 1180 bytes} [Mon Oct 17 13:55:15 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:55:16.330683 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d1ec40a8-c675-4398-b15e-b3d278f1109d tempest-SecurityGroupRulesTestJSON-1760789412 tempest-SecurityGroupRulesTestJSON-1760789412-project] Action: 'create', calling method: .version_select at 0x7f7cd425ec10>, body: {"security_group_rule": {"parent_group_id": "0270bedb-a9b4-4ba3-bcf1-bf481f2eeeba", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:55:17.161894 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1eac1db2-4070-4d8f-87e7-380cc79beac0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:17.162610 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1eac1db2-4070-4d8f-87e7-380cc79beac0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:17.182345 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1eac1db2-4070-4d8f-87e7-380cc79beac0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:17.182829 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1eac1db2-4070-4d8f-87e7-380cc79beac0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:17.183283 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1eac1db2-4070-4d8f-87e7-380cc79beac0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:17.192871 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1eac1db2-4070-4d8f-87e7-380cc79beac0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:17.193366 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1eac1db2-4070-4d8f-87e7-380cc79beac0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:17.201007 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1eac1db2-4070-4d8f-87e7-380cc79beac0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:17.525114 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1eac1db2-4070-4d8f-87e7-380cc79beac0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:17.533598 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1eac1db2-4070-4d8f-87e7-380cc79beac0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6" status: 200 len: 1273 microversion: 2.1 time: 0.375427 Oct 17 13:55:17.557489 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2115/4345] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:17 2022] GET /compute/v2.1/servers/c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6 => generated 1273 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:17.796060 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d1ec40a8-c675-4398-b15e-b3d278f1109d tempest-SecurityGroupRulesTestJSON-1760789412 tempest-SecurityGroupRulesTestJSON-1760789412-project] 10.222.0.79 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.471301 Oct 17 13:55:17.796805 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2231/4346] 10.222.0.79 () {60 vars in 1195 bytes} [Mon Oct 17 13:55:16 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:55:17.809135 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8283a6d3-d68a-4de8-be74-c13b8efd8154 tempest-SecurityGroupRulesTestJSON-1760789412 tempest-SecurityGroupRulesTestJSON-1760789412-project] Action: 'create', calling method: .version_select at 0x7f7cd420ed30>, body: {"security_group_rule": {"parent_group_id": "0270bedb-a9b4-4ba3-bcf1-bf481f2eeeba", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:55:17.859547 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-00c1f614-62a8-48ad-9c18-c3a570da5fde tempest-VolumesSnapshotsTestJSON-343945759 tempest-VolumesSnapshotsTestJSON-343945759-project] Action: 'create', calling method: .version_select at 0x7f7cd5b018b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1221918578"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:55:18.613005 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-00c1f614-62a8-48ad-9c18-c3a570da5fde tempest-VolumesSnapshotsTestJSON-343945759 tempest-VolumesSnapshotsTestJSON-343945759-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.054199 Oct 17 13:55:18.614342 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2116/4347] 10.222.0.79 () {60 vars in 1155 bytes} [Mon Oct 17 13:55:17 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1056 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 17 13:55:18.619290 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-72a51fe8-ec57-4848-8d26-f91b90eeea11 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:18.620095 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-72a51fe8-ec57-4848-8d26-f91b90eeea11 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:18.654906 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-72a51fe8-ec57-4848-8d26-f91b90eeea11 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:18.664519 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-72a51fe8-ec57-4848-8d26-f91b90eeea11 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:18.665276 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-72a51fe8-ec57-4848-8d26-f91b90eeea11 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:18.666343 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-72a51fe8-ec57-4848-8d26-f91b90eeea11 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:18.668156 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-72a51fe8-ec57-4848-8d26-f91b90eeea11 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:18.669122 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-72a51fe8-ec57-4848-8d26-f91b90eeea11 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:18.933620 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-72a51fe8-ec57-4848-8d26-f91b90eeea11 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:18.958041 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-72a51fe8-ec57-4848-8d26-f91b90eeea11 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6" status: 200 len: 1273 microversion: 2.1 time: 0.342442 Oct 17 13:55:18.959009 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2117/4348] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:18 2022] GET /compute/v2.1/servers/c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6 => generated 1273 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:18.977463 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-767c9744-cdb4-4157-836f-6f7232aeef77 tempest-VolumesSnapshotsTestJSON-343945759 tempest-VolumesSnapshotsTestJSON-343945759-project] Calling method '.version_select at 0x7f7cd4993b80>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:19.127973 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-767c9744-cdb4-4157-836f-6f7232aeef77 tempest-VolumesSnapshotsTestJSON-343945759 tempest-VolumesSnapshotsTestJSON-343945759-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/777e614a-08d8-466f-8939-98fabb1036e8" status: 200 len: 345 microversion: 2.1 time: 0.165784 Oct 17 13:55:19.128630 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2118/4349] 10.222.0.79 () {58 vars in 1245 bytes} [Mon Oct 17 13:55:18 2022] GET /compute/v2.1/os-volumes/777e614a-08d8-466f-8939-98fabb1036e8 => generated 345 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:55:19.394766 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8283a6d3-d68a-4de8-be74-c13b8efd8154 tempest-SecurityGroupRulesTestJSON-1760789412 tempest-SecurityGroupRulesTestJSON-1760789412-project] 10.222.0.79 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 1.589742 Oct 17 13:55:19.396325 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2232/4350] 10.222.0.79 () {60 vars in 1195 bytes} [Mon Oct 17 13:55:17 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 1592 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:55:19.408577 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9e960742-d21c-4abe-b4be-0c810d7e2d30 tempest-SecurityGroupRulesTestJSON-1760789412 tempest-SecurityGroupRulesTestJSON-1760789412-project] Calling method '.version_select at 0x7f7cd4993dc0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:19.587715 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9e960742-d21c-4abe-b4be-0c810d7e2d30 tempest-SecurityGroupRulesTestJSON-1760789412 tempest-SecurityGroupRulesTestJSON-1760789412-project] 10.222.0.79 "GET /compute/v2.1/os-security-groups/0270bedb-a9b4-4ba3-bcf1-bf481f2eeeba" status: 200 len: 663 microversion: 2.1 time: 0.182792 Oct 17 13:55:19.588979 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2119/4351] 10.222.0.79 () {58 vars in 1269 bytes} [Mon Oct 17 13:55:19 2022] GET /compute/v2.1/os-security-groups/0270bedb-a9b4-4ba3-bcf1-bf481f2eeeba => generated 663 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:55:19.603440 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4a5c7200-dbf6-4773-803f-029a87f11ca3 tempest-SecurityGroupRulesTestJSON-1760789412 tempest-SecurityGroupRulesTestJSON-1760789412-project] Calling method '.version_select at 0x7f7cd425e160>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:19.980945 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bbc475e1-06f2-40d3-a575-f961be144c75 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:19.981577 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-bbc475e1-06f2-40d3-a575-f961be144c75 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:20.002102 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bbc475e1-06f2-40d3-a575-f961be144c75 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:20.002607 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bbc475e1-06f2-40d3-a575-f961be144c75 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:20.007450 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bbc475e1-06f2-40d3-a575-f961be144c75 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:20.009409 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bbc475e1-06f2-40d3-a575-f961be144c75 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:20.014822 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bbc475e1-06f2-40d3-a575-f961be144c75 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:20.015728 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bbc475e1-06f2-40d3-a575-f961be144c75 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:20.669218 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-bbc475e1-06f2-40d3-a575-f961be144c75 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:20.696106 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-bbc475e1-06f2-40d3-a575-f961be144c75 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6" status: 200 len: 1315 microversion: 2.1 time: 0.719219 Oct 17 13:55:20.705211 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2120/4352] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:19 2022] GET /compute/v2.1/servers/c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6 => generated 1315 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:55:20.722136 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4a5c7200-dbf6-4773-803f-029a87f11ca3 tempest-SecurityGroupRulesTestJSON-1760789412 tempest-SecurityGroupRulesTestJSON-1760789412-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-group-rules/0e169bd9-9e0c-45cd-927b-6a9ee886541b" status: 202 len: 0 microversion: 2.1 time: 1.123670 Oct 17 13:55:20.723681 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2233/4353] 10.222.0.79 () {58 vars in 1287 bytes} [Mon Oct 17 13:55:19 2022] DELETE /compute/v2.1/os-security-group-rules/0e169bd9-9e0c-45cd-927b-6a9ee886541b => generated 0 bytes in 1126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:55:20.736327 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d29d491b-e369-48d4-94cc-34e7d4e8741e tempest-SecurityGroupRulesTestJSON-1760789412 tempest-SecurityGroupRulesTestJSON-1760789412-project] Calling method '.version_select at 0x7f7cd4244040>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:20.752493 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f9c9a0c5-94c4-47f3-bbd0-ec16e5d13990 tempest-VolumesSnapshotsTestJSON-343945759 tempest-VolumesSnapshotsTestJSON-343945759-project] Calling method '.version_select at 0x7f7cd616b670>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:20.952739 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f9c9a0c5-94c4-47f3-bbd0-ec16e5d13990 tempest-VolumesSnapshotsTestJSON-343945759 tempest-VolumesSnapshotsTestJSON-343945759-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/777e614a-08d8-466f-8939-98fabb1036e8" status: 200 len: 345 microversion: 2.1 time: 0.246086 Oct 17 13:55:20.953324 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2121/4354] 10.222.0.79 () {58 vars in 1245 bytes} [Mon Oct 17 13:55:20 2022] GET /compute/v2.1/os-volumes/777e614a-08d8-466f-8939-98fabb1036e8 => generated 345 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:55:21.728863 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3fa978a6-e17e-4ec1-973c-5e098056bbd6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:21.731053 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3fa978a6-e17e-4ec1-973c-5e098056bbd6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:21.756235 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3fa978a6-e17e-4ec1-973c-5e098056bbd6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:21.757261 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3fa978a6-e17e-4ec1-973c-5e098056bbd6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:21.757816 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3fa978a6-e17e-4ec1-973c-5e098056bbd6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:21.760274 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3fa978a6-e17e-4ec1-973c-5e098056bbd6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:21.760665 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3fa978a6-e17e-4ec1-973c-5e098056bbd6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:21.761105 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3fa978a6-e17e-4ec1-973c-5e098056bbd6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:22.588612 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d29d491b-e369-48d4-94cc-34e7d4e8741e tempest-SecurityGroupRulesTestJSON-1760789412 tempest-SecurityGroupRulesTestJSON-1760789412-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/0270bedb-a9b4-4ba3-bcf1-bf481f2eeeba" status: 202 len: 0 microversion: 2.1 time: 1.856472 Oct 17 13:55:22.589218 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2234/4355] 10.222.0.79 () {58 vars in 1272 bytes} [Mon Oct 17 13:55:20 2022] DELETE /compute/v2.1/os-security-groups/0270bedb-a9b4-4ba3-bcf1-bf481f2eeeba => generated 0 bytes in 1858 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:55:22.602038 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-eb6b7cd4-46b0-4f48-83c7-d3404c32f9c3 tempest-VolumesSnapshotsTestJSON-343945759 tempest-VolumesSnapshotsTestJSON-343945759-project] Calling method '.version_select at 0x7f7cd54a0280>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:22.763917 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-eb6b7cd4-46b0-4f48-83c7-d3404c32f9c3 tempest-VolumesSnapshotsTestJSON-343945759 tempest-VolumesSnapshotsTestJSON-343945759-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/777e614a-08d8-466f-8939-98fabb1036e8" status: 200 len: 346 microversion: 2.1 time: 0.170520 Oct 17 13:55:22.764695 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2235/4356] 10.222.0.79 () {58 vars in 1245 bytes} [Mon Oct 17 13:55:22 2022] GET /compute/v2.1/os-volumes/777e614a-08d8-466f-8939-98fabb1036e8 => generated 346 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:55:22.769551 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c6109ba6-8ee3-4c0a-b24c-7066409743ef tempest-SecurityGroupRulesTestJSON-1760789412 tempest-SecurityGroupRulesTestJSON-1760789412-project] Calling method '.version_select at 0x7f7cd420cdc0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:22.864259 n-d-854247-14 devstack@n-api.service[127016]: DEBUG neutronclient.v2_0.client [None req-c6109ba6-8ee3-4c0a-b24c-7066409743ef tempest-SecurityGroupRulesTestJSON-1760789412 tempest-SecurityGroupRulesTestJSON-1760789412-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9bbadf08-cb60-42c7-b18b-5f0cfbe0bd0a does not exist", "detail": ""}} {{(pid=127016) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 13:55:22.865218 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.security_group_api [None req-c6109ba6-8ee3-4c0a-b24c-7066409743ef tempest-SecurityGroupRulesTestJSON-1760789412 tempest-SecurityGroupRulesTestJSON-1760789412-project] Neutron security group 9bbadf08-cb60-42c7-b18b-5f0cfbe0bd0a not found {{(pid=127016) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 17 13:55:22.866551 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-c6109ba6-8ee3-4c0a-b24c-7066409743ef tempest-SecurityGroupRulesTestJSON-1760789412 tempest-SecurityGroupRulesTestJSON-1760789412-project] HTTP exception thrown: Security group 9bbadf08-cb60-42c7-b18b-5f0cfbe0bd0a does not exist Oct 17 13:55:22.866551 n-d-854247-14 devstack@n-api.service[127016]: Neutron server returns request_ids: ['req-85c5a3b5-eb55-4b45-bc3a-715621dee2e0'] Oct 17 13:55:22.869217 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c6109ba6-8ee3-4c0a-b24c-7066409743ef tempest-SecurityGroupRulesTestJSON-1760789412 tempest-SecurityGroupRulesTestJSON-1760789412-project] Request method failure captured: Oct 17 13:55:22.869217 n-d-854247-14 devstack@n-api.service[127016]: request: DELETE /compute/v2.1/os-security-groups/9bbadf08-cb60-42c7-b18b-5f0cfbe0bd0a HTTP/1.1 Oct 17 13:55:22.869217 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:55:22.869217 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:55:22.869217 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:55:22.869217 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:55:22.869217 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:55:22.869217 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:55:22.869217 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:55:22.869217 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:55:22.869217 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTV62QJLBHua37Z5E5I1xGLjGtx9z1-gROv5twErG1CBCfGm78DTNxbq63oT5WUCTIG6l60nmbdQAFDm5TNE7bT7NoqhDa2MktxsJ2VPwaPEwU_EZPb6tu4dJpAgzS2UzYXlOzjwhAscllmFVG4MmGvNVQM9Oe5utV_amKd3aU1NfF8c Oct 17 13:55:22.869217 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:55:22.869217 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:55:22.869217 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:55:22.869217 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:55:22.869217 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:55:22.869217 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:55:22.869217 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 0c213a76b2bc4dcb9abebb92304297a1 Oct 17 13:55:22.869217 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1760789412 Oct 17 13:55:22.869217 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:55:22.869217 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:55:22.869217 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0c213a76b2bc4dcb9abebb92304297a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0c213a76b2bc4dcb9abebb92304297a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0c213a76b2bc4dcb9abebb92304297a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0c213a76b2bc4dcb9abebb92304297a1", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:55:22.869217 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1760789412 Oct 17 13:55:22.869217 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 0c213a76b2bc4dcb9abebb92304297a1 Oct 17 13:55:22.869217 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1760789412 Oct 17 13:55:22.869217 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-SecurityGroupRulesTestJSON-1760789412-project Oct 17 13:55:22.869217 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:55:22.869217 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:55:22.869217 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: dc92826373864c3b828d0c24524a26c6 Oct 17 13:55:22.869217 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1760789412-project Oct 17 13:55:22.869217 n-d-854247-14 devstack@n-api.service[127016]: method: Oct 17 13:55:22.869217 n-d-854247-14 devstack@n-api.service[127016]: exception: Security group 9bbadf08-cb60-42c7-b18b-5f0cfbe0bd0a does not exist Oct 17 13:55:22.869217 n-d-854247-14 devstack@n-api.service[127016]: Neutron server returns request_ids: ['req-85c5a3b5-eb55-4b45-bc3a-715621dee2e0'] Oct 17 13:55:22.869217 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '9bbadf08-cb60-42c7-b18b-5f0cfbe0bd0a'} Oct 17 13:55:22.869217 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:55:22.869217 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:55:22.869217 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 17 13:55:22.869217 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 17 13:55:22.869217 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:55:22.869217 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:55:22.869217 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 17 13:55:22.869217 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 17 13:55:22.869217 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:55:22.869217 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:55:22.869217 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 13:55:22.869217 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 13:55:22.869217 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:55:22.869217 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:55:22.869217 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 13:55:22.869217 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 13:55:22.869217 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:55:22.869217 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:55:22.869217 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 13:55:22.869217 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 13:55:22.869217 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:55:22.869217 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:55:22.869217 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 13:55:22.869217 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 13:55:22.869217 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 13:55:22.869217 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 13:55:22.869217 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9bbadf08-cb60-42c7-b18b-5f0cfbe0bd0a does not exist Oct 17 13:55:22.873621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-85c5a3b5-eb55-4b45-bc3a-715621dee2e0'] Oct 17 13:55:22.873621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:55:22.873621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:55:22.873621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:55:22.873621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:55:22.873621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 17 13:55:22.873621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 17 13:55:22.873621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 17 13:55:22.873621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 13:55:22.873621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9bbadf08-cb60-42c7-b18b-5f0cfbe0bd0a does not exist Oct 17 13:55:22.873621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-85c5a3b5-eb55-4b45-bc3a-715621dee2e0'] Oct 17 13:55:22.873621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:55:22.873621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:55:22.873621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:55:22.873621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:55:22.873621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:55:22.873621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:55:22.873621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:55:22.873621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:55:22.873621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:55:22.873621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:55:22.873621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:55:22.873621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:55:22.873621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 17 13:55:22.873621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 17 13:55:22.873621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9bbadf08-cb60-42c7-b18b-5f0cfbe0bd0a does not exist Oct 17 13:55:22.873621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-85c5a3b5-eb55-4b45-bc3a-715621dee2e0'] Oct 17 13:55:22.873621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:55:22.873621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:55:22.873621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:55:22.873621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:55:22.873621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:55:22.873621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:55:22.873621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:55:22.873621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:55:22.873621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9bbadf08-cb60-42c7-b18b-5f0cfbe0bd0a does not exist Oct 17 13:55:22.873621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-85c5a3b5-eb55-4b45-bc3a-715621dee2e0'] Oct 17 13:55:22.873621 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:55:22.878259 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c6109ba6-8ee3-4c0a-b24c-7066409743ef tempest-SecurityGroupRulesTestJSON-1760789412 tempest-SecurityGroupRulesTestJSON-1760789412-project] Returning 404 to user: Security group 9bbadf08-cb60-42c7-b18b-5f0cfbe0bd0a does not exist Oct 17 13:55:22.878259 n-d-854247-14 devstack@n-api.service[127016]: Neutron server returns request_ids: ['req-85c5a3b5-eb55-4b45-bc3a-715621dee2e0'] {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:55:22.879709 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c6109ba6-8ee3-4c0a-b24c-7066409743ef tempest-SecurityGroupRulesTestJSON-1760789412 tempest-SecurityGroupRulesTestJSON-1760789412-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/9bbadf08-cb60-42c7-b18b-5f0cfbe0bd0a" status: 404 len: 194 microversion: 2.1 time: 0.113819 Oct 17 13:55:22.880465 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2236/4357] 10.222.0.79 () {58 vars in 1272 bytes} [Mon Oct 17 13:55:22 2022] DELETE /compute/v2.1/os-security-groups/9bbadf08-cb60-42c7-b18b-5f0cfbe0bd0a => generated 194 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:55:22.892487 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4025dc8e-9901-401d-b2a9-4bb420f37dc3 tempest-VolumesSnapshotsTestJSON-343945759 tempest-VolumesSnapshotsTestJSON-343945759-project] Action: 'create', calling method: .version_select at 0x7f7cd425ec10>, body: {"snapshot": {"volume_id": "777e614a-08d8-466f-8939-98fabb1036e8", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1078338922"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:55:22.936975 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3fa978a6-e17e-4ec1-973c-5e098056bbd6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:22.958707 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3fa978a6-e17e-4ec1-973c-5e098056bbd6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6" status: 200 len: 1315 microversion: 2.1 time: 1.223717 Oct 17 13:55:22.960449 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2122/4358] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:21 2022] GET /compute/v2.1/servers/c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6 => generated 1315 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:55:22.982107 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d69e285a-1c5e-475f-8bdc-0b868725fde2 tempest-SecurityGroupRulesTestJSON-1760789412 tempest-SecurityGroupRulesTestJSON-1760789412-project] Calling method '.version_select at 0x7f7cd4993160>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:23.410399 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4025dc8e-9901-401d-b2a9-4bb420f37dc3 tempest-VolumesSnapshotsTestJSON-343945759 tempest-VolumesSnapshotsTestJSON-343945759-project] 10.222.0.79 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.528607 Oct 17 13:55:23.411319 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2237/4359] 10.222.0.79 () {60 vars in 1162 bytes} [Mon Oct 17 13:55:22 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:55:23.424829 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-237b5841-2b22-4d94-8b9a-c95466f6ba85 tempest-VolumesSnapshotsTestJSON-343945759 tempest-VolumesSnapshotsTestJSON-343945759-project] Calling method '.version_select at 0x7f7cd45b4b80>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:23.587336 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-237b5841-2b22-4d94-8b9a-c95466f6ba85 tempest-VolumesSnapshotsTestJSON-343945759 tempest-VolumesSnapshotsTestJSON-343945759-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/51f46bb4-af14-483c-803b-8ad85b669549" status: 200 len: 287 microversion: 2.1 time: 0.166909 Oct 17 13:55:23.595991 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2238/4360] 10.222.0.79 () {58 vars in 1251 bytes} [Mon Oct 17 13:55:23 2022] GET /compute/v2.1/os-snapshots/51f46bb4-af14-483c-803b-8ad85b669549 => generated 287 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:55:23.602482 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b236c2ef-6f4e-41f2-9835-07f233e408e9 tempest-VolumesSnapshotsTestJSON-343945759 tempest-VolumesSnapshotsTestJSON-343945759-project] Calling method '.version_select at 0x7f7cd420eaf0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:23.713612 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b236c2ef-6f4e-41f2-9835-07f233e408e9 tempest-VolumesSnapshotsTestJSON-343945759 tempest-VolumesSnapshotsTestJSON-343945759-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.116423 Oct 17 13:55:23.714196 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2239/4361] 10.222.0.79 () {58 vars in 1140 bytes} [Mon Oct 17 13:55:23 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:55:23.729034 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a47fbb55-4bed-44ea-a84f-c3bf88f110a0 tempest-VolumesSnapshotsTestJSON-343945759 tempest-VolumesSnapshotsTestJSON-343945759-project] Calling method '.version_select at 0x7f7cd440ff70>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:23.798127 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a47fbb55-4bed-44ea-a84f-c3bf88f110a0 tempest-VolumesSnapshotsTestJSON-343945759 tempest-VolumesSnapshotsTestJSON-343945759-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/51f46bb4-af14-483c-803b-8ad85b669549" status: 200 len: 287 microversion: 2.1 time: 0.073724 Oct 17 13:55:23.803385 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2240/4362] 10.222.0.79 () {58 vars in 1251 bytes} [Mon Oct 17 13:55:23 2022] GET /compute/v2.1/os-snapshots/51f46bb4-af14-483c-803b-8ad85b669549 => generated 287 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:55:23.933123 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d69e285a-1c5e-475f-8bdc-0b868725fde2 tempest-SecurityGroupRulesTestJSON-1760789412 tempest-SecurityGroupRulesTestJSON-1760789412-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/ed2ef44d-c645-49f0-af0b-5a6e049b63ce" status: 202 len: 0 microversion: 2.1 time: 0.971401 Oct 17 13:55:23.933948 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2123/4363] 10.222.0.79 () {58 vars in 1272 bytes} [Mon Oct 17 13:55:22 2022] DELETE /compute/v2.1/os-security-groups/ed2ef44d-c645-49f0-af0b-5a6e049b63ce => generated 0 bytes in 973 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:55:23.943490 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cd4779da-ce31-46ed-b6bf-9fc2eae31088 tempest-SecurityGroupRulesTestJSON-1760789412 tempest-SecurityGroupRulesTestJSON-1760789412-project] Calling method '.version_select at 0x7f7cd4244310>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:23.989894 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-760832a1-6eb6-4331-a3af-5c3618a31b85 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:23.992560 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-760832a1-6eb6-4331-a3af-5c3618a31b85 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:24.005166 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-760832a1-6eb6-4331-a3af-5c3618a31b85 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:24.008804 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-760832a1-6eb6-4331-a3af-5c3618a31b85 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:24.010451 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-760832a1-6eb6-4331-a3af-5c3618a31b85 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:24.014406 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-760832a1-6eb6-4331-a3af-5c3618a31b85 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:24.015138 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-760832a1-6eb6-4331-a3af-5c3618a31b85 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:24.016022 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-760832a1-6eb6-4331-a3af-5c3618a31b85 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:24.349704 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:55:24.575961 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-760832a1-6eb6-4331-a3af-5c3618a31b85 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:24.587655 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-760832a1-6eb6-4331-a3af-5c3618a31b85 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6" status: 200 len: 1315 microversion: 2.1 time: 0.604704 Oct 17 13:55:24.590580 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2124/4364] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:23 2022] GET /compute/v2.1/servers/c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6 => generated 1315 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:24.713359 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=8 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:55:24.786428 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cd4779da-ce31-46ed-b6bf-9fc2eae31088 tempest-SecurityGroupRulesTestJSON-1760789412 tempest-SecurityGroupRulesTestJSON-1760789412-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/2bdae840-c434-4c20-b0dc-1c28fa25ba0e" status: 202 len: 0 microversion: 2.1 time: 0.846899 Oct 17 13:55:24.792121 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2241/4365] 10.222.0.79 () {58 vars in 1272 bytes} [Mon Oct 17 13:55:23 2022] DELETE /compute/v2.1/os-security-groups/2bdae840-c434-4c20-b0dc-1c28fa25ba0e => generated 0 bytes in 853 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:55:24.799128 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b8c8027b-6a2c-4fb1-a496-2ba961c46a4e tempest-SecurityGroupRulesTestJSON-1760789412 tempest-SecurityGroupRulesTestJSON-1760789412-project] Calling method '.version_select at 0x7f7cd4244940>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:25.251992 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b8c8027b-6a2c-4fb1-a496-2ba961c46a4e tempest-SecurityGroupRulesTestJSON-1760789412 tempest-SecurityGroupRulesTestJSON-1760789412-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/ff9c9835-8087-441f-a522-dc8206300963" status: 202 len: 0 microversion: 2.1 time: 0.458678 Oct 17 13:55:25.252607 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2242/4366] 10.222.0.79 () {58 vars in 1272 bytes} [Mon Oct 17 13:55:24 2022] DELETE /compute/v2.1/os-security-groups/ff9c9835-8087-441f-a522-dc8206300963 => generated 0 bytes in 460 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:55:25.266352 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3866fa35-d28d-44c6-b135-9755da6c8afc tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1992235434", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "57c5839d-0220-4c16-a56e-f44ad4323cc7"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:55:25.268720 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-351a6d6d-3723-4422-b758-909383442638 tempest-VolumesSnapshotsTestJSON-343945759 tempest-VolumesSnapshotsTestJSON-343945759-project] Calling method '.version_select at 0x7f7cd420ca60>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:25.397395 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-351a6d6d-3723-4422-b758-909383442638 tempest-VolumesSnapshotsTestJSON-343945759 tempest-VolumesSnapshotsTestJSON-343945759-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/51f46bb4-af14-483c-803b-8ad85b669549" status: 200 len: 287 microversion: 2.1 time: 0.136649 Oct 17 13:55:25.401926 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2243/4367] 10.222.0.79 () {58 vars in 1251 bytes} [Mon Oct 17 13:55:25 2022] GET /compute/v2.1/os-snapshots/51f46bb4-af14-483c-803b-8ad85b669549 => generated 287 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:55:25.412335 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-b0c8d7a5-127e-4a6e-bc1c-821367d93c00 req-c4c4fa08-539c-44b1-950f-e89228d0d3ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6", "tag": "d95e5b6e-63a7-4bcb-81ab-a9ec138f839a"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:55:25.438448 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-3866fa35-d28d-44c6-b135-9755da6c8afc tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] validate_networks() for [('57c5839d-0220-4c16-a56e-f44ad4323cc7', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:55:25.456884 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-b0c8d7a5-127e-4a6e-bc1c-821367d93c00 req-c4c4fa08-539c-44b1-950f-e89228d0d3ff service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:25.458650 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-b0c8d7a5-127e-4a6e-bc1c-821367d93c00 req-c4c4fa08-539c-44b1-950f-e89228d0d3ff service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:25.459520 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-b0c8d7a5-127e-4a6e-bc1c-821367d93c00 req-c4c4fa08-539c-44b1-950f-e89228d0d3ff service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:25.495106 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-b0c8d7a5-127e-4a6e-bc1c-821367d93c00 req-c4c4fa08-539c-44b1-950f-e89228d0d3ff service nova] Creating event network-changed:d95e5b6e-63a7-4bcb-81ab-a9ec138f839a for instance c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6 on n-h2-854247-14 Oct 17 13:55:25.505603 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-b0c8d7a5-127e-4a6e-bc1c-821367d93c00 req-c4c4fa08-539c-44b1-950f-e89228d0d3ff service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102229 Oct 17 13:55:25.507261 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2244/4368] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:55:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:55:25.524434 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3decccf0-f68a-4cf8-93ce-cad3d85b6587 tempest-SecurityGroupRulesTestJSON-1760789412 tempest-SecurityGroupRulesTestJSON-1760789412-project] Calling method '.version_select at 0x7f7cd42441f0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:27.539323 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3decccf0-f68a-4cf8-93ce-cad3d85b6587 tempest-SecurityGroupRulesTestJSON-1760789412 tempest-SecurityGroupRulesTestJSON-1760789412-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/5811c12d-9179-4506-8653-d91b158a4552" status: 202 len: 0 microversion: 2.1 time: 2.027503 Oct 17 13:55:27.542936 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2245/4369] 10.222.0.79 () {58 vars in 1272 bytes} [Mon Oct 17 13:55:25 2022] DELETE /compute/v2.1/os-security-groups/5811c12d-9179-4506-8653-d91b158a4552 => generated 0 bytes in 2035 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:55:27.548652 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ec46f957-a758-408f-9e7c-c2ae8670f0fd tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:27.550368 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ec46f957-a758-408f-9e7c-c2ae8670f0fd tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:27.577284 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ec46f957-a758-408f-9e7c-c2ae8670f0fd tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:27.591882 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ec46f957-a758-408f-9e7c-c2ae8670f0fd tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:27.593942 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ec46f957-a758-408f-9e7c-c2ae8670f0fd tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:27.597639 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ec46f957-a758-408f-9e7c-c2ae8670f0fd tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:27.602869 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ec46f957-a758-408f-9e7c-c2ae8670f0fd tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:27.605444 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ec46f957-a758-408f-9e7c-c2ae8670f0fd tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:28.126795 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-3866fa35-d28d-44c6-b135-9755da6c8afc tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:55:28.127804 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-3866fa35-d28d-44c6-b135-9755da6c8afc tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:55:28.128560 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-3866fa35-d28d-44c6-b135-9755da6c8afc tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:55:28.129069 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-3866fa35-d28d-44c6-b135-9755da6c8afc tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:55:28.129544 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-3866fa35-d28d-44c6-b135-9755da6c8afc tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:55:28.153507 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3866fa35-d28d-44c6-b135-9755da6c8afc tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:28.154862 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3866fa35-d28d-44c6-b135-9755da6c8afc tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:28.156670 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3866fa35-d28d-44c6-b135-9755da6c8afc tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:28.157627 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3866fa35-d28d-44c6-b135-9755da6c8afc tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:28.160612 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3866fa35-d28d-44c6-b135-9755da6c8afc tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:28.161267 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3866fa35-d28d-44c6-b135-9755da6c8afc tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:28.197518 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ec46f957-a758-408f-9e7c-c2ae8670f0fd tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:28.213399 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ec46f957-a758-408f-9e7c-c2ae8670f0fd tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6" status: 200 len: 1315 microversion: 2.1 time: 0.668842 Oct 17 13:55:28.217257 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2246/4370] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:27 2022] GET /compute/v2.1/servers/c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6 => generated 1315 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:28.227606 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-3866fa35-d28d-44c6-b135-9755da6c8afc tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Getting quotas for project 4fa57e8772684c93a406f3d01da2af88. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:55:28.230480 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-351200b3-0525-4898-99db-939be7c4f897 tempest-VolumesSnapshotsTestJSON-343945759 tempest-VolumesSnapshotsTestJSON-343945759-project] Calling method '.version_select at 0x7f7cd42dd8b0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:28.242688 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-3866fa35-d28d-44c6-b135-9755da6c8afc tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Getting quotas for user d78348abc02a4bb892902b0dd3bcfd6a and project 4fa57e8772684c93a406f3d01da2af88. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:55:28.265531 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3866fa35-d28d-44c6-b135-9755da6c8afc tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:55:28.268406 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3866fa35-d28d-44c6-b135-9755da6c8afc tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: fffaf6e3-13e1-4aed-898d-a09feff6f82b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:55:28.329203 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-351200b3-0525-4898-99db-939be7c4f897 tempest-VolumesSnapshotsTestJSON-343945759 tempest-VolumesSnapshotsTestJSON-343945759-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/51f46bb4-af14-483c-803b-8ad85b669549" status: 200 len: 288 microversion: 2.1 time: 0.109611 Oct 17 13:55:28.337717 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2247/4371] 10.222.0.79 () {58 vars in 1251 bytes} [Mon Oct 17 13:55:28 2022] GET /compute/v2.1/os-snapshots/51f46bb4-af14-483c-803b-8ad85b669549 => generated 288 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:55:28.344587 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-69644aeb-d6f9-4998-8e5b-74ca3cf8d517 tempest-SecurityGroupRulesTestJSON-1760789412 tempest-SecurityGroupRulesTestJSON-1760789412-project] Calling method '.version_select at 0x7f7cd4232dc0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:28.375965 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3866fa35-d28d-44c6-b135-9755da6c8afc tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.783437 Oct 17 13:55:28.377246 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2125/4372] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:55:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 3785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:55:28.383886 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d4258223-3152-4324-b0ea-972feeb2c1ac tempest-VolumesSnapshotsTestJSON-343945759 tempest-VolumesSnapshotsTestJSON-343945759-project] Calling method '.version_select at 0x7f7cd5699550>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:28.503697 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d4258223-3152-4324-b0ea-972feeb2c1ac tempest-VolumesSnapshotsTestJSON-343945759 tempest-VolumesSnapshotsTestJSON-343945759-project] 10.222.0.79 "DELETE /compute/v2.1/os-snapshots/51f46bb4-af14-483c-803b-8ad85b669549" status: 202 len: 0 microversion: 2.1 time: 0.123829 Oct 17 13:55:28.509435 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2126/4373] 10.222.0.79 () {58 vars in 1254 bytes} [Mon Oct 17 13:55:28 2022] DELETE /compute/v2.1/os-snapshots/51f46bb4-af14-483c-803b-8ad85b669549 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:55:28.518324 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-713ff689-ef77-44d6-96c8-dbb5e5dbe202 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:28.523552 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-713ff689-ef77-44d6-96c8-dbb5e5dbe202 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: fffaf6e3-13e1-4aed-898d-a09feff6f82b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:28.931558 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-713ff689-ef77-44d6-96c8-dbb5e5dbe202 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:28.941502 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-713ff689-ef77-44d6-96c8-dbb5e5dbe202 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/fffaf6e3-13e1-4aed-898d-a09feff6f82b" status: 200 len: 1193 microversion: 2.1 time: 0.430698 Oct 17 13:55:28.942111 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2127/4374] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:28 2022] GET /compute/v2.1/servers/fffaf6e3-13e1-4aed-898d-a09feff6f82b => generated 1193 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:28.977133 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7c20f9f2-230d-4956-9cdb-2683feaa4cde tempest-VolumesSnapshotsTestJSON-343945759 tempest-VolumesSnapshotsTestJSON-343945759-project] Calling method '.version_select at 0x7f7cd556f5e0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:29.068591 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7c20f9f2-230d-4956-9cdb-2683feaa4cde tempest-VolumesSnapshotsTestJSON-343945759 tempest-VolumesSnapshotsTestJSON-343945759-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/51f46bb4-af14-483c-803b-8ad85b669549" status: 200 len: 287 microversion: 2.1 time: 0.104616 Oct 17 13:55:29.073807 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2128/4375] 10.222.0.79 () {58 vars in 1251 bytes} [Mon Oct 17 13:55:28 2022] GET /compute/v2.1/os-snapshots/51f46bb4-af14-483c-803b-8ad85b669549 => generated 287 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:55:29.242306 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d4046e56-46fe-4aee-889f-efb423759e3b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:29.242969 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d4046e56-46fe-4aee-889f-efb423759e3b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:29.254234 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d4046e56-46fe-4aee-889f-efb423759e3b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:29.254728 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d4046e56-46fe-4aee-889f-efb423759e3b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:29.255226 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d4046e56-46fe-4aee-889f-efb423759e3b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:29.266745 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d4046e56-46fe-4aee-889f-efb423759e3b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:29.268315 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d4046e56-46fe-4aee-889f-efb423759e3b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:29.269174 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d4046e56-46fe-4aee-889f-efb423759e3b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:29.572542 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-69644aeb-d6f9-4998-8e5b-74ca3cf8d517 tempest-SecurityGroupRulesTestJSON-1760789412 tempest-SecurityGroupRulesTestJSON-1760789412-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/e950c166-2f9f-4d3e-8635-0a3a991e3b63" status: 202 len: 0 microversion: 2.1 time: 1.233243 Oct 17 13:55:29.573822 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2248/4376] 10.222.0.79 () {58 vars in 1272 bytes} [Mon Oct 17 13:55:28 2022] DELETE /compute/v2.1/os-security-groups/e950c166-2f9f-4d3e-8635-0a3a991e3b63 => generated 0 bytes in 1235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:55:29.884238 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d4046e56-46fe-4aee-889f-efb423759e3b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:29.892689 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d4046e56-46fe-4aee-889f-efb423759e3b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6" status: 200 len: 1315 microversion: 2.1 time: 0.654490 Oct 17 13:55:29.893322 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2129/4377] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:29 2022] GET /compute/v2.1/servers/c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6 => generated 1315 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:29.969141 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9280c3fe-ad9d-4540-94fe-e2833397c7fc tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:29.971303 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9280c3fe-ad9d-4540-94fe-e2833397c7fc tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: fffaf6e3-13e1-4aed-898d-a09feff6f82b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:29.998266 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9280c3fe-ad9d-4540-94fe-e2833397c7fc tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:30.000835 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9280c3fe-ad9d-4540-94fe-e2833397c7fc tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:30.001748 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9280c3fe-ad9d-4540-94fe-e2833397c7fc tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:30.007710 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9280c3fe-ad9d-4540-94fe-e2833397c7fc tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:30.011305 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9280c3fe-ad9d-4540-94fe-e2833397c7fc tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:30.013184 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9280c3fe-ad9d-4540-94fe-e2833397c7fc tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:30.084830 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7340be45-1803-41c4-a2c4-82a900c5ae25 tempest-VolumesSnapshotsTestJSON-343945759 tempest-VolumesSnapshotsTestJSON-343945759-project] Calling method '.version_select at 0x7f7cd981ac10>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:30.202685 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7340be45-1803-41c4-a2c4-82a900c5ae25 tempest-VolumesSnapshotsTestJSON-343945759 tempest-VolumesSnapshotsTestJSON-343945759-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/51f46bb4-af14-483c-803b-8ad85b669549" status: 200 len: 287 microversion: 2.1 time: 0.125624 Oct 17 13:55:30.206285 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2130/4378] 10.222.0.79 () {58 vars in 1251 bytes} [Mon Oct 17 13:55:30 2022] GET /compute/v2.1/os-snapshots/51f46bb4-af14-483c-803b-8ad85b669549 => generated 287 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:55:30.303954 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9280c3fe-ad9d-4540-94fe-e2833397c7fc tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:30.322906 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9280c3fe-ad9d-4540-94fe-e2833397c7fc tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/fffaf6e3-13e1-4aed-898d-a09feff6f82b" status: 200 len: 1189 microversion: 2.1 time: 0.355836 Oct 17 13:55:30.336247 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2249/4379] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:29 2022] GET /compute/v2.1/servers/fffaf6e3-13e1-4aed-898d-a09feff6f82b => generated 1189 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:30.920769 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-04fbc46b-c20b-4bb8-b6f5-ee834656d909 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:30.922023 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-04fbc46b-c20b-4bb8-b6f5-ee834656d909 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:30.950441 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-04fbc46b-c20b-4bb8-b6f5-ee834656d909 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:30.956828 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-04fbc46b-c20b-4bb8-b6f5-ee834656d909 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:30.957661 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-04fbc46b-c20b-4bb8-b6f5-ee834656d909 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:30.965258 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-04fbc46b-c20b-4bb8-b6f5-ee834656d909 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:30.966656 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-04fbc46b-c20b-4bb8-b6f5-ee834656d909 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:30.967510 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-04fbc46b-c20b-4bb8-b6f5-ee834656d909 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:31.220111 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-83cba3fd-381c-4166-8740-a953036845db tempest-VolumesSnapshotsTestJSON-343945759 tempest-VolumesSnapshotsTestJSON-343945759-project] Calling method '.version_select at 0x7f7cd432e310>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:31.314197 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-83cba3fd-381c-4166-8740-a953036845db tempest-VolumesSnapshotsTestJSON-343945759 tempest-VolumesSnapshotsTestJSON-343945759-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/51f46bb4-af14-483c-803b-8ad85b669549" status: 200 len: 287 microversion: 2.1 time: 0.101641 Oct 17 13:55:31.314868 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2250/4380] 10.222.0.79 () {58 vars in 1251 bytes} [Mon Oct 17 13:55:31 2022] GET /compute/v2.1/os-snapshots/51f46bb4-af14-483c-803b-8ad85b669549 => generated 287 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:55:31.358189 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d807275f-c225-410e-9428-29cb4cb70101 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:31.358967 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d807275f-c225-410e-9428-29cb4cb70101 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: fffaf6e3-13e1-4aed-898d-a09feff6f82b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:31.380366 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:55:31.386108 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d807275f-c225-410e-9428-29cb4cb70101 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:31.386789 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d807275f-c225-410e-9428-29cb4cb70101 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:31.390102 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d807275f-c225-410e-9428-29cb4cb70101 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:31.391313 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d807275f-c225-410e-9428-29cb4cb70101 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:31.391890 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d807275f-c225-410e-9428-29cb4cb70101 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:31.392874 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d807275f-c225-410e-9428-29cb4cb70101 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:31.850749 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d807275f-c225-410e-9428-29cb4cb70101 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:31.852546 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-04fbc46b-c20b-4bb8-b6f5-ee834656d909 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:31.862268 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-04fbc46b-c20b-4bb8-b6f5-ee834656d909 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6" status: 200 len: 1315 microversion: 2.1 time: 0.946240 Oct 17 13:55:31.862866 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2131/4381] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:30 2022] GET /compute/v2.1/servers/c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6 => generated 1315 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:31.865123 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d807275f-c225-410e-9428-29cb4cb70101 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/fffaf6e3-13e1-4aed-898d-a09feff6f82b" status: 200 len: 1251 microversion: 2.1 time: 0.518276 Oct 17 13:55:31.865728 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2251/4382] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:31 2022] GET /compute/v2.1/servers/fffaf6e3-13e1-4aed-898d-a09feff6f82b => generated 1251 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:32.328846 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-97bc363b-886e-441d-8be0-4fe18fa933c1 tempest-VolumesSnapshotsTestJSON-343945759 tempest-VolumesSnapshotsTestJSON-343945759-project] Calling method '.version_select at 0x7f7cd4a16a60>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:32.388027 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-97bc363b-886e-441d-8be0-4fe18fa933c1 tempest-VolumesSnapshotsTestJSON-343945759 tempest-VolumesSnapshotsTestJSON-343945759-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/51f46bb4-af14-483c-803b-8ad85b669549" status: 200 len: 287 microversion: 2.1 time: 0.063175 Oct 17 13:55:32.393696 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2132/4383] 10.222.0.79 () {58 vars in 1251 bytes} [Mon Oct 17 13:55:32 2022] GET /compute/v2.1/os-snapshots/51f46bb4-af14-483c-803b-8ad85b669549 => generated 287 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:55:32.502342 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-28b84610-0c16-4848-b885-dac1199dd6c3 req-cecd42c8-0d19-4851-8860-05ce6fb653cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6", "name": "network-vif-plugged", "status": "completed", "tag": "d95e5b6e-63a7-4bcb-81ab-a9ec138f839a"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:55:32.525510 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-28b84610-0c16-4848-b885-dac1199dd6c3 req-cecd42c8-0d19-4851-8860-05ce6fb653cc service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:32.525510 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-28b84610-0c16-4848-b885-dac1199dd6c3 req-cecd42c8-0d19-4851-8860-05ce6fb653cc service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:32.527749 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-28b84610-0c16-4848-b885-dac1199dd6c3 req-cecd42c8-0d19-4851-8860-05ce6fb653cc service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:32.558574 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-28b84610-0c16-4848-b885-dac1199dd6c3 req-cecd42c8-0d19-4851-8860-05ce6fb653cc service nova] Creating event network-vif-plugged:d95e5b6e-63a7-4bcb-81ab-a9ec138f839a for instance c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6 on n-h2-854247-14 Oct 17 13:55:32.577504 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-28b84610-0c16-4848-b885-dac1199dd6c3 req-cecd42c8-0d19-4851-8860-05ce6fb653cc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079079 Oct 17 13:55:32.578203 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2252/4384] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:55:32.892811 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f4e2ffc7-023f-4503-a824-a0c3861b49fb tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:32.897246 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d3f4cbde-9f94-444f-9057-4527a48be3fb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:32.898158 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f4e2ffc7-023f-4503-a824-a0c3861b49fb tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:32.899054 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d3f4cbde-9f94-444f-9057-4527a48be3fb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: fffaf6e3-13e1-4aed-898d-a09feff6f82b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:32.919018 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d3f4cbde-9f94-444f-9057-4527a48be3fb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:32.919849 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d3f4cbde-9f94-444f-9057-4527a48be3fb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:32.920507 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d3f4cbde-9f94-444f-9057-4527a48be3fb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:32.920833 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f4e2ffc7-023f-4503-a824-a0c3861b49fb tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:32.921757 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d3f4cbde-9f94-444f-9057-4527a48be3fb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:32.923522 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f4e2ffc7-023f-4503-a824-a0c3861b49fb tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:32.925576 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d3f4cbde-9f94-444f-9057-4527a48be3fb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:32.925717 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f4e2ffc7-023f-4503-a824-a0c3861b49fb tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:32.925816 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d3f4cbde-9f94-444f-9057-4527a48be3fb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:32.925907 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f4e2ffc7-023f-4503-a824-a0c3861b49fb tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:32.931433 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f4e2ffc7-023f-4503-a824-a0c3861b49fb tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:32.932463 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f4e2ffc7-023f-4503-a824-a0c3861b49fb tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:33.436492 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d3f4cbde-9f94-444f-9057-4527a48be3fb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:33.453073 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d3f4cbde-9f94-444f-9057-4527a48be3fb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/fffaf6e3-13e1-4aed-898d-a09feff6f82b" status: 200 len: 1293 microversion: 2.1 time: 0.563704 Oct 17 13:55:33.469058 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2253/4385] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:32 2022] GET /compute/v2.1/servers/fffaf6e3-13e1-4aed-898d-a09feff6f82b => generated 1293 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:33.490453 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9609ac4f-2add-44d3-b52b-5c3b2187a725 tempest-VolumesSnapshotsTestJSON-343945759 tempest-VolumesSnapshotsTestJSON-343945759-project] Calling method '.version_select at 0x7f7cd423f280>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:33.536611 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f4e2ffc7-023f-4503-a824-a0c3861b49fb tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:33.539014 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-9609ac4f-2add-44d3-b52b-5c3b2187a725 tempest-VolumesSnapshotsTestJSON-343945759 tempest-VolumesSnapshotsTestJSON-343945759-project] HTTP exception thrown: Snapshot 51f46bb4-af14-483c-803b-8ad85b669549 could not be found. Oct 17 13:55:33.555001 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9609ac4f-2add-44d3-b52b-5c3b2187a725 tempest-VolumesSnapshotsTestJSON-343945759 tempest-VolumesSnapshotsTestJSON-343945759-project] Request method failure captured: Oct 17 13:55:33.555001 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/os-snapshots/51f46bb4-af14-483c-803b-8ad85b669549 HTTP/1.1 Oct 17 13:55:33.555001 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:55:33.555001 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:55:33.555001 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:55:33.555001 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:55:33.555001 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:55:33.555001 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:55:33.555001 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:55:33.555001 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:55:33.555001 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTV7FG3B84XH3OE_ZVxIptYBQQXnHzjI8BHXaYRa3N5hZYPb0ecS8PFif7O--aW4JmmkFH-32E14x8tqOCcy7PmP6NGAjeM1FbofX9fIe2DAmlJdSjg8WR2UORl4l6jXbXo2aGh-KaVexpPvdQyTWJGJuNmyIAtbsLg6ul5HQG7Kr9fo Oct 17 13:55:33.555001 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:55:33.555001 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:55:33.555001 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:55:33.555001 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:55:33.555001 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:55:33.555001 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:55:33.555001 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 4b97c1ffe23a4e1894c89e7b2ccf33a8 Oct 17 13:55:33.555001 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-343945759 Oct 17 13:55:33.555001 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:55:33.555001 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:55:33.555001 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4b97c1ffe23a4e1894c89e7b2ccf33a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4b97c1ffe23a4e1894c89e7b2ccf33a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4b97c1ffe23a4e1894c89e7b2ccf33a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4b97c1ffe23a4e1894c89e7b2ccf33a8", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:55:33.555001 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-VolumesSnapshotsTestJSON-343945759 Oct 17 13:55:33.555001 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 4b97c1ffe23a4e1894c89e7b2ccf33a8 Oct 17 13:55:33.555001 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-343945759 Oct 17 13:55:33.555001 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-VolumesSnapshotsTestJSON-343945759-project Oct 17 13:55:33.555001 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:55:33.555001 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:55:33.555001 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 46fbf0f7b5dd490482993172cd67e5b9 Oct 17 13:55:33.555001 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-VolumesSnapshotsTestJSON-343945759-project Oct 17 13:55:33.555001 n-d-854247-14 devstack@n-api.service[127016]: method: Oct 17 13:55:33.555001 n-d-854247-14 devstack@n-api.service[127016]: exception: Snapshot 51f46bb4-af14-483c-803b-8ad85b669549 could not be found. Oct 17 13:55:33.555001 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '51f46bb4-af14-483c-803b-8ad85b669549'} Oct 17 13:55:33.555001 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:55:33.555001 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:55:33.555001 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 17 13:55:33.555001 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 17 13:55:33.555001 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 17 13:55:33.555001 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 17 13:55:33.555001 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 17 13:55:33.555001 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 17 13:55:33.555001 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 13:55:33.555001 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 13:55:33.555001 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 13:55:33.555001 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 13:55:33.555001 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 13:55:33.555001 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 13:55:33.555001 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 13:55:33.555001 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 13:55:33.555001 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 51f46bb4-af14-483c-803b-8ad85b669549 could not be found. (HTTP 404) (Request-ID: req-b2c72a75-221f-40df-8f6f-c5a0dd332752) Oct 17 13:55:33.555001 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:55:33.555001 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:55:33.555001 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:55:33.555001 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:55:33.555001 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 17 13:55:33.555001 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 17 13:55:33.555001 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 13:55:33.555001 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 13:55:33.555001 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 17 13:55:33.555001 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 17 13:55:33.555001 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 13:55:33.555001 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 13:55:33.558686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 17 13:55:33.558686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 17 13:55:33.558686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 17 13:55:33.558686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 17 13:55:33.558686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 17 13:55:33.558686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 17 13:55:33.558686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 13:55:33.558686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 13:55:33.558686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 13:55:33.558686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 13:55:33.558686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 13:55:33.558686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 13:55:33.558686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 13:55:33.558686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 13:55:33.558686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 51f46bb4-af14-483c-803b-8ad85b669549 could not be found. Oct 17 13:55:33.558686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:55:33.558686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:55:33.558686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:55:33.558686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:55:33.558686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:55:33.558686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:55:33.558686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:55:33.558686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:55:33.558686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:55:33.558686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:55:33.558686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:55:33.558686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:55:33.558686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 17 13:55:33.558686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:55:33.558686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 51f46bb4-af14-483c-803b-8ad85b669549 could not be found. Oct 17 13:55:33.558686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:55:33.558686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:55:33.558686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:55:33.558686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:55:33.558686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:55:33.558686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:55:33.558686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:55:33.558686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:55:33.558686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 51f46bb4-af14-483c-803b-8ad85b669549 could not be found. Oct 17 13:55:33.558686 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:55:33.558686 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9609ac4f-2add-44d3-b52b-5c3b2187a725 tempest-VolumesSnapshotsTestJSON-343945759 tempest-VolumesSnapshotsTestJSON-343945759-project] Returning 404 to user: Snapshot 51f46bb4-af14-483c-803b-8ad85b669549 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:55:33.558686 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9609ac4f-2add-44d3-b52b-5c3b2187a725 tempest-VolumesSnapshotsTestJSON-343945759 tempest-VolumesSnapshotsTestJSON-343945759-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/51f46bb4-af14-483c-803b-8ad85b669549" status: 404 len: 111 microversion: 2.1 time: 0.085440 Oct 17 13:55:33.558686 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2254/4386] 10.222.0.79 () {58 vars in 1251 bytes} [Mon Oct 17 13:55:33 2022] GET /compute/v2.1/os-snapshots/51f46bb4-af14-483c-803b-8ad85b669549 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:55:33.565199 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f4e2ffc7-023f-4503-a824-a0c3861b49fb tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6" status: 200 len: 1315 microversion: 2.1 time: 0.672691 Oct 17 13:55:33.565845 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2133/4387] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:32 2022] GET /compute/v2.1/servers/c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6 => generated 1315 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:33.570348 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3262f39a-ffe9-4b12-84e8-e903ae29e87c tempest-VolumesSnapshotsTestJSON-343945759 tempest-VolumesSnapshotsTestJSON-343945759-project] Calling method '.version_select at 0x7f7cd4609670>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:33.694687 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3262f39a-ffe9-4b12-84e8-e903ae29e87c tempest-VolumesSnapshotsTestJSON-343945759 tempest-VolumesSnapshotsTestJSON-343945759-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/777e614a-08d8-466f-8939-98fabb1036e8" status: 202 len: 0 microversion: 2.1 time: 0.132149 Oct 17 13:55:33.695554 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2255/4388] 10.222.0.79 () {58 vars in 1248 bytes} [Mon Oct 17 13:55:33 2022] DELETE /compute/v2.1/os-volumes/777e614a-08d8-466f-8939-98fabb1036e8 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:55:33.704770 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-57c11b49-7dd9-4925-8b95-9a1da7341e94 tempest-VolumesSnapshotsTestJSON-343945759 tempest-VolumesSnapshotsTestJSON-343945759-project] Calling method '.version_select at 0x7f7cd57301f0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:33.824467 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-57c11b49-7dd9-4925-8b95-9a1da7341e94 tempest-VolumesSnapshotsTestJSON-343945759 tempest-VolumesSnapshotsTestJSON-343945759-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/777e614a-08d8-466f-8939-98fabb1036e8" status: 200 len: 345 microversion: 2.1 time: 0.124252 Oct 17 13:55:33.826677 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2134/4389] 10.222.0.79 () {58 vars in 1245 bytes} [Mon Oct 17 13:55:33 2022] GET /compute/v2.1/os-volumes/777e614a-08d8-466f-8939-98fabb1036e8 => generated 345 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:55:34.489270 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d824377e-0155-48cc-a07a-b8b8e7da0b29 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:34.490800 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d824377e-0155-48cc-a07a-b8b8e7da0b29 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: fffaf6e3-13e1-4aed-898d-a09feff6f82b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:34.510489 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d824377e-0155-48cc-a07a-b8b8e7da0b29 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:34.511190 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d824377e-0155-48cc-a07a-b8b8e7da0b29 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:34.513143 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d824377e-0155-48cc-a07a-b8b8e7da0b29 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:34.515279 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d824377e-0155-48cc-a07a-b8b8e7da0b29 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:34.518584 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d824377e-0155-48cc-a07a-b8b8e7da0b29 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:34.519291 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d824377e-0155-48cc-a07a-b8b8e7da0b29 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:34.607836 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ee96e4a2-ff17-4909-980b-3fd43e78484f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:34.608456 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ee96e4a2-ff17-4909-980b-3fd43e78484f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:34.627908 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ee96e4a2-ff17-4909-980b-3fd43e78484f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:34.630203 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ee96e4a2-ff17-4909-980b-3fd43e78484f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:34.636740 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ee96e4a2-ff17-4909-980b-3fd43e78484f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:34.644701 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ee96e4a2-ff17-4909-980b-3fd43e78484f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:34.647285 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ee96e4a2-ff17-4909-980b-3fd43e78484f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:34.653171 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ee96e4a2-ff17-4909-980b-3fd43e78484f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:34.735043 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=93 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:55:35.780409 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d824377e-0155-48cc-a07a-b8b8e7da0b29 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:35.792649 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d824377e-0155-48cc-a07a-b8b8e7da0b29 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/fffaf6e3-13e1-4aed-898d-a09feff6f82b" status: 200 len: 1293 microversion: 2.1 time: 1.313436 Oct 17 13:55:35.795263 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2256/4390] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:34 2022] GET /compute/v2.1/servers/fffaf6e3-13e1-4aed-898d-a09feff6f82b => generated 1293 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:35.813125 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4e01e9f5-0b6d-4a2a-9055-5875dbb73967 tempest-VolumesSnapshotsTestJSON-343945759 tempest-VolumesSnapshotsTestJSON-343945759-project] Calling method '.version_select at 0x7f7cd423ff70>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:35.888149 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4e01e9f5-0b6d-4a2a-9055-5875dbb73967 tempest-VolumesSnapshotsTestJSON-343945759 tempest-VolumesSnapshotsTestJSON-343945759-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/777e614a-08d8-466f-8939-98fabb1036e8" status: 200 len: 345 microversion: 2.1 time: 0.088487 Oct 17 13:55:35.888149 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2257/4391] 10.222.0.79 () {58 vars in 1245 bytes} [Mon Oct 17 13:55:35 2022] GET /compute/v2.1/os-volumes/777e614a-08d8-466f-8939-98fabb1036e8 => generated 345 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:55:35.945431 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ee96e4a2-ff17-4909-980b-3fd43e78484f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:35.970912 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ee96e4a2-ff17-4909-980b-3fd43e78484f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6" status: 200 len: 1502 microversion: 2.1 time: 1.359676 Oct 17 13:55:35.971645 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2135/4392] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:34 2022] GET /compute/v2.1/servers/c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6 => generated 1502 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:35.997137 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d6f1da2d-3280-4544-9798-863a967bea60 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:55:35.999851 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d6f1da2d-3280-4544-9798-863a967bea60 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:36.028688 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d6f1da2d-3280-4544-9798-863a967bea60 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:36.029178 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d6f1da2d-3280-4544-9798-863a967bea60 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:36.029624 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d6f1da2d-3280-4544-9798-863a967bea60 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:36.033588 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d6f1da2d-3280-4544-9798-863a967bea60 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:36.034539 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d6f1da2d-3280-4544-9798-863a967bea60 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:36.034982 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d6f1da2d-3280-4544-9798-863a967bea60 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:36.134212 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d6f1da2d-3280-4544-9798-863a967bea60 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "POST /compute/v2.1/servers/c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6/action" status: 200 len: 14 microversion: 2.1 time: 0.143962 Oct 17 13:55:36.139290 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2258/4393] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:55:35 2022] POST /compute/v2.1/servers/c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6/action => generated 14 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:55:36.593679 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-ac241c16-616c-4493-aebc-9021690c0c1f req-b6204e80-07cf-4089-9774-484911754be4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fffaf6e3-13e1-4aed-898d-a09feff6f82b", "tag": "4ce71f0a-cae6-4335-97ec-ceab15cbf618"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:55:36.656708 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-ac241c16-616c-4493-aebc-9021690c0c1f req-b6204e80-07cf-4089-9774-484911754be4 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:36.664694 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-ac241c16-616c-4493-aebc-9021690c0c1f req-b6204e80-07cf-4089-9774-484911754be4 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:36.665986 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-ac241c16-616c-4493-aebc-9021690c0c1f req-b6204e80-07cf-4089-9774-484911754be4 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:36.699766 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-ac241c16-616c-4493-aebc-9021690c0c1f req-b6204e80-07cf-4089-9774-484911754be4 service nova] Creating event network-changed:4ce71f0a-cae6-4335-97ec-ceab15cbf618 for instance fffaf6e3-13e1-4aed-898d-a09feff6f82b on n-h1-854247-14 Oct 17 13:55:36.711887 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-ac241c16-616c-4493-aebc-9021690c0c1f req-b6204e80-07cf-4089-9774-484911754be4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125419 Oct 17 13:55:36.714385 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2136/4394] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:55:36.821356 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-85f48cfe-1964-4939-9ea7-1fd082dc6aa2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:36.822089 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-85f48cfe-1964-4939-9ea7-1fd082dc6aa2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: fffaf6e3-13e1-4aed-898d-a09feff6f82b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:36.838293 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-85f48cfe-1964-4939-9ea7-1fd082dc6aa2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:36.846114 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-85f48cfe-1964-4939-9ea7-1fd082dc6aa2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:36.846114 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-85f48cfe-1964-4939-9ea7-1fd082dc6aa2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:36.849114 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-85f48cfe-1964-4939-9ea7-1fd082dc6aa2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:36.849606 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-85f48cfe-1964-4939-9ea7-1fd082dc6aa2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:36.850066 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-85f48cfe-1964-4939-9ea7-1fd082dc6aa2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:36.903026 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:55:36.903663 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-93a6bc04-5ef9-4dfc-a4a2-6335ae81286e tempest-VolumesSnapshotsTestJSON-343945759 tempest-VolumesSnapshotsTestJSON-343945759-project] Calling method '.version_select at 0x7f7cd616b670>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:37.050644 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-93a6bc04-5ef9-4dfc-a4a2-6335ae81286e tempest-VolumesSnapshotsTestJSON-343945759 tempest-VolumesSnapshotsTestJSON-343945759-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/777e614a-08d8-466f-8939-98fabb1036e8" status: 200 len: 345 microversion: 2.1 time: 0.153204 Oct 17 13:55:37.058251 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2137/4395] 10.222.0.79 () {58 vars in 1245 bytes} [Mon Oct 17 13:55:36 2022] GET /compute/v2.1/os-volumes/777e614a-08d8-466f-8939-98fabb1036e8 => generated 345 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:55:37.147293 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-91a28f85-ecd4-4616-a72f-46b1413e3585 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:55:37.149902 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-91a28f85-ecd4-4616-a72f-46b1413e3585 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:37.176621 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-91a28f85-ecd4-4616-a72f-46b1413e3585 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:37.177130 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-91a28f85-ecd4-4616-a72f-46b1413e3585 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:37.177575 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-91a28f85-ecd4-4616-a72f-46b1413e3585 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:37.178526 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-91a28f85-ecd4-4616-a72f-46b1413e3585 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:37.188408 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-91a28f85-ecd4-4616-a72f-46b1413e3585 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:37.188975 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-91a28f85-ecd4-4616-a72f-46b1413e3585 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:37.290703 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-91a28f85-ecd4-4616-a72f-46b1413e3585 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "POST /compute/v2.1/servers/c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6/action" status: 200 len: 14 microversion: 2.1 time: 0.147979 Oct 17 13:55:37.299884 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2138/4396] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:55:37 2022] POST /compute/v2.1/servers/c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6/action => generated 14 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:55:37.691593 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-85f48cfe-1964-4939-9ea7-1fd082dc6aa2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:37.703896 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-85f48cfe-1964-4939-9ea7-1fd082dc6aa2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/fffaf6e3-13e1-4aed-898d-a09feff6f82b" status: 200 len: 1293 microversion: 2.1 time: 0.887689 Oct 17 13:55:37.705041 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2259/4397] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:36 2022] GET /compute/v2.1/servers/fffaf6e3-13e1-4aed-898d-a09feff6f82b => generated 1293 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:38.075520 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-33fa8721-32c3-4bbb-833b-2f808693665b tempest-VolumesSnapshotsTestJSON-343945759 tempest-VolumesSnapshotsTestJSON-343945759-project] Calling method '.version_select at 0x7f7cd55d91f0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:38.143932 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-33fa8721-32c3-4bbb-833b-2f808693665b tempest-VolumesSnapshotsTestJSON-343945759 tempest-VolumesSnapshotsTestJSON-343945759-project] HTTP exception thrown: Volume 777e614a-08d8-466f-8939-98fabb1036e8 could not be found. Oct 17 13:55:38.165634 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-33fa8721-32c3-4bbb-833b-2f808693665b tempest-VolumesSnapshotsTestJSON-343945759 tempest-VolumesSnapshotsTestJSON-343945759-project] Request method failure captured: Oct 17 13:55:38.165634 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/os-volumes/777e614a-08d8-466f-8939-98fabb1036e8 HTTP/1.1 Oct 17 13:55:38.165634 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:55:38.165634 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:55:38.165634 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:55:38.165634 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:55:38.165634 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:55:38.165634 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:55:38.165634 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:55:38.165634 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:55:38.165634 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTV7FG3B84XH3OE_ZVxIptYBQQXnHzjI8BHXaYRa3N5hZYPb0ecS8PFif7O--aW4JmmkFH-32E14x8tqOCcy7PmP6NGAjeM1FbofX9fIe2DAmlJdSjg8WR2UORl4l6jXbXo2aGh-KaVexpPvdQyTWJGJuNmyIAtbsLg6ul5HQG7Kr9fo Oct 17 13:55:38.165634 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:55:38.165634 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:55:38.165634 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:55:38.165634 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:55:38.165634 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:55:38.165634 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:55:38.165634 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 4b97c1ffe23a4e1894c89e7b2ccf33a8 Oct 17 13:55:38.165634 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-343945759 Oct 17 13:55:38.165634 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:55:38.165634 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:55:38.165634 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4b97c1ffe23a4e1894c89e7b2ccf33a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4b97c1ffe23a4e1894c89e7b2ccf33a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4b97c1ffe23a4e1894c89e7b2ccf33a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4b97c1ffe23a4e1894c89e7b2ccf33a8", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:55:38.165634 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-VolumesSnapshotsTestJSON-343945759 Oct 17 13:55:38.165634 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 4b97c1ffe23a4e1894c89e7b2ccf33a8 Oct 17 13:55:38.165634 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-343945759 Oct 17 13:55:38.165634 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-VolumesSnapshotsTestJSON-343945759-project Oct 17 13:55:38.165634 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:55:38.165634 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:55:38.165634 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 46fbf0f7b5dd490482993172cd67e5b9 Oct 17 13:55:38.165634 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-VolumesSnapshotsTestJSON-343945759-project Oct 17 13:55:38.165634 n-d-854247-14 devstack@n-api.service[127017]: method: Oct 17 13:55:38.165634 n-d-854247-14 devstack@n-api.service[127017]: exception: Volume 777e614a-08d8-466f-8939-98fabb1036e8 could not be found. Oct 17 13:55:38.165634 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '777e614a-08d8-466f-8939-98fabb1036e8'} Oct 17 13:55:38.165634 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:55:38.165634 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:55:38.165634 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 13:55:38.165634 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 13:55:38.165634 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 13:55:38.165634 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 13:55:38.165634 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 13:55:38.165634 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 13:55:38.165634 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 13:55:38.165634 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 13:55:38.165634 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 13:55:38.165634 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 13:55:38.165634 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 13:55:38.165634 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 13:55:38.165634 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 13:55:38.165634 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 13:55:38.165634 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 777e614a-08d8-466f-8939-98fabb1036e8 could not be found. (HTTP 404) (Request-ID: req-24839f95-4ce2-4b70-bb5a-91d00ebdd564) Oct 17 13:55:38.165634 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:55:38.165634 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:55:38.165634 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:55:38.165634 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:55:38.165634 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 17 13:55:38.165634 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 17 13:55:38.165634 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 13:55:38.165634 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 13:55:38.165634 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 13:55:38.165634 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 13:55:38.165634 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 13:55:38.165634 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 13:55:38.165634 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 13:55:38.169399 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 13:55:38.169399 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 13:55:38.169399 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 13:55:38.169399 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 13:55:38.169399 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 13:55:38.169399 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 13:55:38.169399 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 13:55:38.169399 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 13:55:38.169399 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 13:55:38.169399 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 13:55:38.169399 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 13:55:38.169399 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 13:55:38.169399 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 13:55:38.169399 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 777e614a-08d8-466f-8939-98fabb1036e8 could not be found. Oct 17 13:55:38.169399 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:55:38.169399 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:55:38.169399 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:55:38.169399 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:55:38.169399 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:55:38.169399 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:55:38.169399 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:55:38.169399 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:55:38.169399 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:55:38.169399 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:55:38.169399 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:55:38.169399 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:55:38.169399 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 17 13:55:38.169399 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:55:38.169399 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 777e614a-08d8-466f-8939-98fabb1036e8 could not be found. Oct 17 13:55:38.169399 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:55:38.169399 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:55:38.169399 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:55:38.169399 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:55:38.169399 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:55:38.169399 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:55:38.169399 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:55:38.169399 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:55:38.169399 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 777e614a-08d8-466f-8939-98fabb1036e8 could not be found. Oct 17 13:55:38.169399 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:55:38.169399 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-33fa8721-32c3-4bbb-833b-2f808693665b tempest-VolumesSnapshotsTestJSON-343945759 tempest-VolumesSnapshotsTestJSON-343945759-project] Returning 404 to user: Volume 777e614a-08d8-466f-8939-98fabb1036e8 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:55:38.169399 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-33fa8721-32c3-4bbb-833b-2f808693665b tempest-VolumesSnapshotsTestJSON-343945759 tempest-VolumesSnapshotsTestJSON-343945759-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/777e614a-08d8-466f-8939-98fabb1036e8" status: 404 len: 109 microversion: 2.1 time: 0.104933 Oct 17 13:55:38.169399 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2139/4398] 10.222.0.79 () {58 vars in 1245 bytes} [Mon Oct 17 13:55:38 2022] GET /compute/v2.1/os-volumes/777e614a-08d8-466f-8939-98fabb1036e8 => generated 109 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:55:38.179223 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-df4e6727-5e15-4502-88a1-dcdb78501b7c tempest-VolumesSnapshotsTestJSON-343945759 tempest-VolumesSnapshotsTestJSON-343945759-project] Calling method '.version_select at 0x7f7cd420e5e0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:38.230775 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-df4e6727-5e15-4502-88a1-dcdb78501b7c tempest-VolumesSnapshotsTestJSON-343945759 tempest-VolumesSnapshotsTestJSON-343945759-project] HTTP exception thrown: Volume 777e614a-08d8-466f-8939-98fabb1036e8 could not be found. Oct 17 13:55:38.232925 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-df4e6727-5e15-4502-88a1-dcdb78501b7c tempest-VolumesSnapshotsTestJSON-343945759 tempest-VolumesSnapshotsTestJSON-343945759-project] Request method failure captured: Oct 17 13:55:38.232925 n-d-854247-14 devstack@n-api.service[127016]: request: DELETE /compute/v2.1/os-volumes/777e614a-08d8-466f-8939-98fabb1036e8 HTTP/1.1 Oct 17 13:55:38.232925 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:55:38.232925 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:55:38.232925 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:55:38.232925 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:55:38.232925 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:55:38.232925 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:55:38.232925 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:55:38.232925 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:55:38.232925 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTV7FG3B84XH3OE_ZVxIptYBQQXnHzjI8BHXaYRa3N5hZYPb0ecS8PFif7O--aW4JmmkFH-32E14x8tqOCcy7PmP6NGAjeM1FbofX9fIe2DAmlJdSjg8WR2UORl4l6jXbXo2aGh-KaVexpPvdQyTWJGJuNmyIAtbsLg6ul5HQG7Kr9fo Oct 17 13:55:38.232925 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:55:38.232925 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:55:38.232925 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:55:38.232925 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:55:38.232925 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:55:38.232925 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:55:38.232925 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 4b97c1ffe23a4e1894c89e7b2ccf33a8 Oct 17 13:55:38.232925 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-343945759 Oct 17 13:55:38.232925 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:55:38.232925 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:55:38.232925 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4b97c1ffe23a4e1894c89e7b2ccf33a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4b97c1ffe23a4e1894c89e7b2ccf33a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4b97c1ffe23a4e1894c89e7b2ccf33a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4b97c1ffe23a4e1894c89e7b2ccf33a8", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:55:38.232925 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-VolumesSnapshotsTestJSON-343945759 Oct 17 13:55:38.232925 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 4b97c1ffe23a4e1894c89e7b2ccf33a8 Oct 17 13:55:38.232925 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-343945759 Oct 17 13:55:38.232925 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-VolumesSnapshotsTestJSON-343945759-project Oct 17 13:55:38.232925 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:55:38.232925 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:55:38.232925 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 46fbf0f7b5dd490482993172cd67e5b9 Oct 17 13:55:38.232925 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-VolumesSnapshotsTestJSON-343945759-project Oct 17 13:55:38.232925 n-d-854247-14 devstack@n-api.service[127016]: method: Oct 17 13:55:38.232925 n-d-854247-14 devstack@n-api.service[127016]: exception: Volume 777e614a-08d8-466f-8939-98fabb1036e8 could not be found. Oct 17 13:55:38.232925 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '777e614a-08d8-466f-8939-98fabb1036e8'} Oct 17 13:55:38.232925 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:55:38.232925 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:55:38.232925 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 13:55:38.232925 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 13:55:38.232925 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 17 13:55:38.232925 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 17 13:55:38.232925 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 17 13:55:38.232925 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 17 13:55:38.232925 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 17 13:55:38.232925 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 17 13:55:38.232925 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 17 13:55:38.232925 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 17 13:55:38.232925 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 13:55:38.232925 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 13:55:38.232925 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 13:55:38.232925 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 13:55:38.232925 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 777e614a-08d8-466f-8939-98fabb1036e8 could not be found. (HTTP 404) (Request-ID: req-9f86c66d-f05a-400a-8859-e2e99bd8e033) Oct 17 13:55:38.232925 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:55:38.232925 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:55:38.232925 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:55:38.232925 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:55:38.232925 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 17 13:55:38.232925 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 17 13:55:38.232925 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 13:55:38.232925 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 13:55:38.232925 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 13:55:38.232925 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 13:55:38.232925 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 13:55:38.232925 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 13:55:38.232925 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 13:55:38.236986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 13:55:38.236986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 17 13:55:38.236986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 17 13:55:38.236986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 17 13:55:38.236986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 17 13:55:38.236986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 17 13:55:38.236986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 17 13:55:38.236986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 17 13:55:38.236986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 17 13:55:38.236986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 13:55:38.236986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 13:55:38.236986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 13:55:38.236986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 13:55:38.236986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 777e614a-08d8-466f-8939-98fabb1036e8 could not be found. Oct 17 13:55:38.236986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:55:38.236986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:55:38.236986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:55:38.236986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:55:38.236986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:55:38.236986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:55:38.236986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:55:38.236986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:55:38.236986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:55:38.236986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:55:38.236986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:55:38.236986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:55:38.236986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 17 13:55:38.236986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:55:38.236986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 777e614a-08d8-466f-8939-98fabb1036e8 could not be found. Oct 17 13:55:38.236986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:55:38.236986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:55:38.236986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:55:38.236986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:55:38.236986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:55:38.236986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:55:38.236986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:55:38.236986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:55:38.236986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 777e614a-08d8-466f-8939-98fabb1036e8 could not be found. Oct 17 13:55:38.236986 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:55:38.236986 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-df4e6727-5e15-4502-88a1-dcdb78501b7c tempest-VolumesSnapshotsTestJSON-343945759 tempest-VolumesSnapshotsTestJSON-343945759-project] Returning 404 to user: Volume 777e614a-08d8-466f-8939-98fabb1036e8 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:55:38.236986 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-df4e6727-5e15-4502-88a1-dcdb78501b7c tempest-VolumesSnapshotsTestJSON-343945759 tempest-VolumesSnapshotsTestJSON-343945759-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/777e614a-08d8-466f-8939-98fabb1036e8" status: 404 len: 109 microversion: 2.1 time: 0.060014 Oct 17 13:55:38.236986 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2260/4399] 10.222.0.79 () {58 vars in 1248 bytes} [Mon Oct 17 13:55:38 2022] DELETE /compute/v2.1/os-volumes/777e614a-08d8-466f-8939-98fabb1036e8 => generated 109 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:55:38.243632 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:55:38.247048 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-37ed65a3-035f-4f0a-acdf-c5111c87bfa9 tempest-VolumesSnapshotsTestJSON-343945759 tempest-VolumesSnapshotsTestJSON-343945759-project] Calling method '.version_select at 0x7f7cd56993a0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:38.304131 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6300a79a-5d87-466e-a757-6da4d6ca5a9f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:55:38.306683 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6300a79a-5d87-466e-a757-6da4d6ca5a9f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:38.319298 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6300a79a-5d87-466e-a757-6da4d6ca5a9f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:38.323054 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-37ed65a3-035f-4f0a-acdf-c5111c87bfa9 tempest-VolumesSnapshotsTestJSON-343945759 tempest-VolumesSnapshotsTestJSON-343945759-project] HTTP exception thrown: Volume 777e614a-08d8-466f-8939-98fabb1036e8 could not be found. Oct 17 13:55:38.325940 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6300a79a-5d87-466e-a757-6da4d6ca5a9f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:38.326751 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6300a79a-5d87-466e-a757-6da4d6ca5a9f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:38.327835 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-37ed65a3-035f-4f0a-acdf-c5111c87bfa9 tempest-VolumesSnapshotsTestJSON-343945759 tempest-VolumesSnapshotsTestJSON-343945759-project] Request method failure captured: Oct 17 13:55:38.327835 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/os-volumes/777e614a-08d8-466f-8939-98fabb1036e8 HTTP/1.1 Oct 17 13:55:38.327835 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:55:38.327835 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:55:38.327835 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:55:38.327835 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:55:38.327835 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:55:38.327835 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:55:38.327835 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:55:38.327835 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:55:38.327835 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTV7FG3B84XH3OE_ZVxIptYBQQXnHzjI8BHXaYRa3N5hZYPb0ecS8PFif7O--aW4JmmkFH-32E14x8tqOCcy7PmP6NGAjeM1FbofX9fIe2DAmlJdSjg8WR2UORl4l6jXbXo2aGh-KaVexpPvdQyTWJGJuNmyIAtbsLg6ul5HQG7Kr9fo Oct 17 13:55:38.327835 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:55:38.327835 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:55:38.327835 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:55:38.327835 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:55:38.327835 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:55:38.327835 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:55:38.327835 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 4b97c1ffe23a4e1894c89e7b2ccf33a8 Oct 17 13:55:38.327835 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-343945759 Oct 17 13:55:38.327835 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:55:38.327835 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:55:38.327835 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4b97c1ffe23a4e1894c89e7b2ccf33a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4b97c1ffe23a4e1894c89e7b2ccf33a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4b97c1ffe23a4e1894c89e7b2ccf33a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4b97c1ffe23a4e1894c89e7b2ccf33a8", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:55:38.327835 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-VolumesSnapshotsTestJSON-343945759 Oct 17 13:55:38.327835 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 4b97c1ffe23a4e1894c89e7b2ccf33a8 Oct 17 13:55:38.327835 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-343945759 Oct 17 13:55:38.327835 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-VolumesSnapshotsTestJSON-343945759-project Oct 17 13:55:38.327835 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:55:38.327835 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:55:38.327835 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 46fbf0f7b5dd490482993172cd67e5b9 Oct 17 13:55:38.327835 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-VolumesSnapshotsTestJSON-343945759-project Oct 17 13:55:38.327835 n-d-854247-14 devstack@n-api.service[127017]: method: Oct 17 13:55:38.327835 n-d-854247-14 devstack@n-api.service[127017]: exception: Volume 777e614a-08d8-466f-8939-98fabb1036e8 could not be found. Oct 17 13:55:38.327835 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '777e614a-08d8-466f-8939-98fabb1036e8'} Oct 17 13:55:38.327835 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:55:38.327835 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:55:38.327835 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 13:55:38.327835 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 13:55:38.327835 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 13:55:38.327835 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 13:55:38.327835 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 13:55:38.327835 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 13:55:38.327835 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 13:55:38.327835 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 13:55:38.327835 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 13:55:38.327835 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 13:55:38.327835 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 13:55:38.327835 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 13:55:38.327835 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 13:55:38.327835 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 13:55:38.327835 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 777e614a-08d8-466f-8939-98fabb1036e8 could not be found. (HTTP 404) (Request-ID: req-a032d2dc-3324-4698-9831-da8c4bebe1c4) Oct 17 13:55:38.327835 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:55:38.327835 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:55:38.327835 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:55:38.327835 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:55:38.327835 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 17 13:55:38.327835 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 17 13:55:38.327835 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 13:55:38.327835 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 13:55:38.327835 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 13:55:38.327835 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 13:55:38.327835 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 13:55:38.327835 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 13:55:38.327835 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 13:55:38.332318 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 13:55:38.332318 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 13:55:38.332318 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 13:55:38.332318 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 13:55:38.332318 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 13:55:38.332318 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 13:55:38.332318 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 13:55:38.332318 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 13:55:38.332318 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 13:55:38.332318 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 13:55:38.332318 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 13:55:38.332318 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 13:55:38.332318 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 13:55:38.332318 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 777e614a-08d8-466f-8939-98fabb1036e8 could not be found. Oct 17 13:55:38.332318 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:55:38.332318 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:55:38.332318 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:55:38.332318 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:55:38.332318 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:55:38.332318 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:55:38.332318 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:55:38.332318 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:55:38.332318 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:55:38.332318 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:55:38.332318 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:55:38.332318 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:55:38.332318 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 17 13:55:38.332318 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:55:38.332318 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 777e614a-08d8-466f-8939-98fabb1036e8 could not be found. Oct 17 13:55:38.332318 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:55:38.332318 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:55:38.332318 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:55:38.332318 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:55:38.332318 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:55:38.332318 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:55:38.332318 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:55:38.332318 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:55:38.332318 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 777e614a-08d8-466f-8939-98fabb1036e8 could not be found. Oct 17 13:55:38.332318 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:55:38.339882 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6300a79a-5d87-466e-a757-6da4d6ca5a9f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:38.341200 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-37ed65a3-035f-4f0a-acdf-c5111c87bfa9 tempest-VolumesSnapshotsTestJSON-343945759 tempest-VolumesSnapshotsTestJSON-343945759-project] Returning 404 to user: Volume 777e614a-08d8-466f-8939-98fabb1036e8 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:55:38.341355 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6300a79a-5d87-466e-a757-6da4d6ca5a9f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:38.341355 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6300a79a-5d87-466e-a757-6da4d6ca5a9f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:38.341655 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-37ed65a3-035f-4f0a-acdf-c5111c87bfa9 tempest-VolumesSnapshotsTestJSON-343945759 tempest-VolumesSnapshotsTestJSON-343945759-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/777e614a-08d8-466f-8939-98fabb1036e8" status: 404 len: 109 microversion: 2.1 time: 0.090268 Oct 17 13:55:38.341655 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2140/4400] 10.222.0.79 () {58 vars in 1245 bytes} [Mon Oct 17 13:55:38 2022] GET /compute/v2.1/os-volumes/777e614a-08d8-466f-8939-98fabb1036e8 => generated 109 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:55:38.403643 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6300a79a-5d87-466e-a757-6da4d6ca5a9f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "POST /compute/v2.1/servers/c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6/action" status: 200 len: 14 microversion: 2.1 time: 0.105082 Oct 17 13:55:38.404756 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2261/4401] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:55:38 2022] POST /compute/v2.1/servers/c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 17 13:55:38.735741 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6375c751-5bf7-4280-87ff-984ab03251f0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:38.736748 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6375c751-5bf7-4280-87ff-984ab03251f0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: fffaf6e3-13e1-4aed-898d-a09feff6f82b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:38.751917 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6375c751-5bf7-4280-87ff-984ab03251f0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:38.753625 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6375c751-5bf7-4280-87ff-984ab03251f0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:38.755576 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6375c751-5bf7-4280-87ff-984ab03251f0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:38.757502 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6375c751-5bf7-4280-87ff-984ab03251f0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:38.759739 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6375c751-5bf7-4280-87ff-984ab03251f0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:38.762229 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6375c751-5bf7-4280-87ff-984ab03251f0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:38.946255 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=8 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:55:39.420537 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-91e806c4-7e2d-4815-935a-95239dc9acfc tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:55:39.435022 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-91e806c4-7e2d-4815-935a-95239dc9acfc tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:39.454769 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-91e806c4-7e2d-4815-935a-95239dc9acfc tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:39.455262 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-91e806c4-7e2d-4815-935a-95239dc9acfc tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:39.455800 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-91e806c4-7e2d-4815-935a-95239dc9acfc tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:39.456400 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-91e806c4-7e2d-4815-935a-95239dc9acfc tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:39.456846 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-91e806c4-7e2d-4815-935a-95239dc9acfc tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:39.470926 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-91e806c4-7e2d-4815-935a-95239dc9acfc tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:39.571532 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-91e806c4-7e2d-4815-935a-95239dc9acfc tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "POST /compute/v2.1/servers/c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6/action" status: 200 len: 14 microversion: 2.1 time: 0.159791 Oct 17 13:55:39.578289 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2262/4402] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:55:39 2022] POST /compute/v2.1/servers/c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6/action => generated 14 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:55:39.692863 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6375c751-5bf7-4280-87ff-984ab03251f0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:39.703153 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6375c751-5bf7-4280-87ff-984ab03251f0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/fffaf6e3-13e1-4aed-898d-a09feff6f82b" status: 200 len: 1293 microversion: 2.1 time: 0.973198 Oct 17 13:55:39.713657 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2141/4403] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:38 2022] GET /compute/v2.1/servers/fffaf6e3-13e1-4aed-898d-a09feff6f82b => generated 1293 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:40.584637 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6ec39992-a1a3-488f-b81c-2cabc55fd732 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:55:40.588607 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6ec39992-a1a3-488f-b81c-2cabc55fd732 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:40.618629 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6ec39992-a1a3-488f-b81c-2cabc55fd732 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:40.621324 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6ec39992-a1a3-488f-b81c-2cabc55fd732 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:40.624705 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6ec39992-a1a3-488f-b81c-2cabc55fd732 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:40.628011 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6ec39992-a1a3-488f-b81c-2cabc55fd732 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:40.628515 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6ec39992-a1a3-488f-b81c-2cabc55fd732 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:40.628956 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6ec39992-a1a3-488f-b81c-2cabc55fd732 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:40.736537 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6ec39992-a1a3-488f-b81c-2cabc55fd732 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "POST /compute/v2.1/servers/c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6/action" status: 200 len: 14 microversion: 2.1 time: 0.157678 Oct 17 13:55:40.740271 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2263/4404] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:55:40 2022] POST /compute/v2.1/servers/c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6/action => generated 14 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:55:40.740647 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5150ec64-af39-4798-8ae3-bc0e5aca999e tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:40.740647 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5150ec64-af39-4798-8ae3-bc0e5aca999e tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: fffaf6e3-13e1-4aed-898d-a09feff6f82b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:40.767422 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5150ec64-af39-4798-8ae3-bc0e5aca999e tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:40.768177 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5150ec64-af39-4798-8ae3-bc0e5aca999e tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:40.768794 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5150ec64-af39-4798-8ae3-bc0e5aca999e tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:40.769691 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5150ec64-af39-4798-8ae3-bc0e5aca999e tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:40.780006 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5150ec64-af39-4798-8ae3-bc0e5aca999e tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:40.780708 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5150ec64-af39-4798-8ae3-bc0e5aca999e tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:41.750111 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4d92c571-9ab2-48af-b6ef-e5da44128576 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:55:41.754023 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4d92c571-9ab2-48af-b6ef-e5da44128576 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:41.780756 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d92c571-9ab2-48af-b6ef-e5da44128576 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:41.781777 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d92c571-9ab2-48af-b6ef-e5da44128576 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:41.782382 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d92c571-9ab2-48af-b6ef-e5da44128576 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:41.788627 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d92c571-9ab2-48af-b6ef-e5da44128576 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:41.792054 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d92c571-9ab2-48af-b6ef-e5da44128576 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:41.793753 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d92c571-9ab2-48af-b6ef-e5da44128576 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:41.897495 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4d92c571-9ab2-48af-b6ef-e5da44128576 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "POST /compute/v2.1/servers/c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6/action" status: 200 len: 14 microversion: 2.1 time: 0.140297 Oct 17 13:55:41.901026 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2264/4405] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:55:41 2022] POST /compute/v2.1/servers/c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6/action => generated 14 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:55:42.689456 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5150ec64-af39-4798-8ae3-bc0e5aca999e tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:42.702591 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5150ec64-af39-4798-8ae3-bc0e5aca999e tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/fffaf6e3-13e1-4aed-898d-a09feff6f82b" status: 200 len: 1293 microversion: 2.1 time: 1.967954 Oct 17 13:55:42.703399 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2142/4406] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:40 2022] GET /compute/v2.1/servers/fffaf6e3-13e1-4aed-898d-a09feff6f82b => generated 1293 bytes in 1969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:42.910125 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e3564ee9-8574-4bc6-8515-e22b83e9a53e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:55:42.914292 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e3564ee9-8574-4bc6-8515-e22b83e9a53e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:42.930392 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e3564ee9-8574-4bc6-8515-e22b83e9a53e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:42.932697 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e3564ee9-8574-4bc6-8515-e22b83e9a53e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:42.935940 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e3564ee9-8574-4bc6-8515-e22b83e9a53e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:42.936919 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e3564ee9-8574-4bc6-8515-e22b83e9a53e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:42.937615 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e3564ee9-8574-4bc6-8515-e22b83e9a53e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:42.938144 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e3564ee9-8574-4bc6-8515-e22b83e9a53e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:43.009406 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e3564ee9-8574-4bc6-8515-e22b83e9a53e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "POST /compute/v2.1/servers/c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6/action" status: 200 len: 14 microversion: 2.1 time: 0.103635 Oct 17 13:55:43.013641 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2265/4407] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:55:42 2022] POST /compute/v2.1/servers/c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:55:43.726871 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-14440d3d-516b-4d9f-91eb-7b96b8b4b8a0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:43.728843 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-14440d3d-516b-4d9f-91eb-7b96b8b4b8a0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: fffaf6e3-13e1-4aed-898d-a09feff6f82b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:43.731965 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:55:43.745346 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-14440d3d-516b-4d9f-91eb-7b96b8b4b8a0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:43.746180 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-14440d3d-516b-4d9f-91eb-7b96b8b4b8a0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:43.747681 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-14440d3d-516b-4d9f-91eb-7b96b8b4b8a0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:43.748484 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-14440d3d-516b-4d9f-91eb-7b96b8b4b8a0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:43.757643 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-14440d3d-516b-4d9f-91eb-7b96b8b4b8a0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:43.758181 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-14440d3d-516b-4d9f-91eb-7b96b8b4b8a0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:44.023594 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-63cfb633-c6f8-434f-88ac-b1eee35bc397 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:55:44.026857 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-63cfb633-c6f8-434f-88ac-b1eee35bc397 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:44.049896 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-63cfb633-c6f8-434f-88ac-b1eee35bc397 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:44.057293 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-63cfb633-c6f8-434f-88ac-b1eee35bc397 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:44.058383 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-63cfb633-c6f8-434f-88ac-b1eee35bc397 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:44.060435 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-63cfb633-c6f8-434f-88ac-b1eee35bc397 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:44.062902 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-63cfb633-c6f8-434f-88ac-b1eee35bc397 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:44.064096 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-63cfb633-c6f8-434f-88ac-b1eee35bc397 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:44.117218 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-14440d3d-516b-4d9f-91eb-7b96b8b4b8a0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:44.131621 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-14440d3d-516b-4d9f-91eb-7b96b8b4b8a0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/fffaf6e3-13e1-4aed-898d-a09feff6f82b" status: 200 len: 1293 microversion: 2.1 time: 0.408617 Oct 17 13:55:44.133370 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2143/4408] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:43 2022] GET /compute/v2.1/servers/fffaf6e3-13e1-4aed-898d-a09feff6f82b => generated 1293 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:44.159759 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-63cfb633-c6f8-434f-88ac-b1eee35bc397 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "POST /compute/v2.1/servers/c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6/action" status: 200 len: 14 microversion: 2.1 time: 0.141668 Oct 17 13:55:44.163216 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2266/4409] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:55:44 2022] POST /compute/v2.1/servers/c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6/action => generated 14 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 17 13:55:45.160088 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2b6c4848-e05d-4a00-9685-607999026c6c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:45.161245 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2b6c4848-e05d-4a00-9685-607999026c6c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: fffaf6e3-13e1-4aed-898d-a09feff6f82b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:45.173680 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-75a2eede-2c33-44c2-8269-5159bccade8d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:55:45.178498 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-75a2eede-2c33-44c2-8269-5159bccade8d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:45.204687 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2b6c4848-e05d-4a00-9685-607999026c6c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:45.205561 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2b6c4848-e05d-4a00-9685-607999026c6c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:45.210700 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2b6c4848-e05d-4a00-9685-607999026c6c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:45.213587 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2b6c4848-e05d-4a00-9685-607999026c6c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:45.216529 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-75a2eede-2c33-44c2-8269-5159bccade8d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:45.221203 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2b6c4848-e05d-4a00-9685-607999026c6c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:45.221960 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2b6c4848-e05d-4a00-9685-607999026c6c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:45.226616 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-75a2eede-2c33-44c2-8269-5159bccade8d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:45.231197 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-75a2eede-2c33-44c2-8269-5159bccade8d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:45.233506 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-75a2eede-2c33-44c2-8269-5159bccade8d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:45.238292 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-75a2eede-2c33-44c2-8269-5159bccade8d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:45.238292 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-75a2eede-2c33-44c2-8269-5159bccade8d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:45.371699 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-75a2eede-2c33-44c2-8269-5159bccade8d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "POST /compute/v2.1/servers/c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6/action" status: 200 len: 14 microversion: 2.1 time: 0.202660 Oct 17 13:55:45.373118 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2267/4410] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:55:45 2022] POST /compute/v2.1/servers/c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6/action => generated 14 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:55:45.576752 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-8bf52a5c-e0e3-4dc0-a2d4-b0199f33a026 req-e28f9762-743a-434b-ac6a-0536ec5b135b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fffaf6e3-13e1-4aed-898d-a09feff6f82b", "name": "network-vif-plugged", "status": "completed", "tag": "4ce71f0a-cae6-4335-97ec-ceab15cbf618"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:55:45.598107 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-8bf52a5c-e0e3-4dc0-a2d4-b0199f33a026 req-e28f9762-743a-434b-ac6a-0536ec5b135b service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:45.603305 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-8bf52a5c-e0e3-4dc0-a2d4-b0199f33a026 req-e28f9762-743a-434b-ac6a-0536ec5b135b service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:45.604102 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-8bf52a5c-e0e3-4dc0-a2d4-b0199f33a026 req-e28f9762-743a-434b-ac6a-0536ec5b135b service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:45.636163 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-8bf52a5c-e0e3-4dc0-a2d4-b0199f33a026 req-e28f9762-743a-434b-ac6a-0536ec5b135b service nova] Creating event network-vif-plugged:4ce71f0a-cae6-4335-97ec-ceab15cbf618 for instance fffaf6e3-13e1-4aed-898d-a09feff6f82b on n-h1-854247-14 Oct 17 13:55:45.650505 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-8bf52a5c-e0e3-4dc0-a2d4-b0199f33a026 req-e28f9762-743a-434b-ac6a-0536ec5b135b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075904 Oct 17 13:55:45.654781 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2268/4411] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:55:45.935569 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2b6c4848-e05d-4a00-9685-607999026c6c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:45.951957 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2b6c4848-e05d-4a00-9685-607999026c6c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/fffaf6e3-13e1-4aed-898d-a09feff6f82b" status: 200 len: 1293 microversion: 2.1 time: 0.795095 Oct 17 13:55:45.954481 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2144/4412] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:45 2022] GET /compute/v2.1/servers/fffaf6e3-13e1-4aed-898d-a09feff6f82b => generated 1293 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:46.387829 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-06892124-11b4-4ea3-ad2b-ba3183ee867c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:55:46.392305 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-06892124-11b4-4ea3-ad2b-ba3183ee867c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:46.405142 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-06892124-11b4-4ea3-ad2b-ba3183ee867c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:46.406059 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-06892124-11b4-4ea3-ad2b-ba3183ee867c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:46.407046 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-06892124-11b4-4ea3-ad2b-ba3183ee867c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:46.419359 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-06892124-11b4-4ea3-ad2b-ba3183ee867c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:46.424653 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-06892124-11b4-4ea3-ad2b-ba3183ee867c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:46.427712 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-06892124-11b4-4ea3-ad2b-ba3183ee867c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:46.553458 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-06892124-11b4-4ea3-ad2b-ba3183ee867c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "POST /compute/v2.1/servers/c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6/action" status: 200 len: 8205 microversion: 2.1 time: 0.172853 Oct 17 13:55:46.555700 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2269/4413] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:55:46 2022] POST /compute/v2.1/servers/c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6/action => generated 8205 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:46.569457 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-70a54d3c-6a51-40a7-8228-8e6018ceabcc tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:46.570887 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-70a54d3c-6a51-40a7-8228-8e6018ceabcc tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:46.586140 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70a54d3c-6a51-40a7-8228-8e6018ceabcc tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:46.588113 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70a54d3c-6a51-40a7-8228-8e6018ceabcc tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:46.588942 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70a54d3c-6a51-40a7-8228-8e6018ceabcc tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:46.591596 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70a54d3c-6a51-40a7-8228-8e6018ceabcc tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:46.595989 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70a54d3c-6a51-40a7-8228-8e6018ceabcc tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:46.596697 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70a54d3c-6a51-40a7-8228-8e6018ceabcc tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:46.982282 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4e1fc3f0-e09e-437f-a271-101ab4215ddd tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:46.983003 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4e1fc3f0-e09e-437f-a271-101ab4215ddd tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: fffaf6e3-13e1-4aed-898d-a09feff6f82b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:47.005558 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4e1fc3f0-e09e-437f-a271-101ab4215ddd tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:47.007835 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4e1fc3f0-e09e-437f-a271-101ab4215ddd tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:47.008307 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4e1fc3f0-e09e-437f-a271-101ab4215ddd tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:47.010971 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4e1fc3f0-e09e-437f-a271-101ab4215ddd tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:47.011484 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4e1fc3f0-e09e-437f-a271-101ab4215ddd tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:47.013955 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4e1fc3f0-e09e-437f-a271-101ab4215ddd tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:47.112520 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-70a54d3c-6a51-40a7-8228-8e6018ceabcc tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:47.132574 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-70a54d3c-6a51-40a7-8228-8e6018ceabcc tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1666 microversion: 2.1 time: 0.568995 Oct 17 13:55:47.134912 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2145/4414] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:46 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1666 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:47.164407 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7f1094f0-49da-44c4-9f08-521fe216977c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:47.165308 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7f1094f0-49da-44c4-9f08-521fe216977c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:47.187230 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7f1094f0-49da-44c4-9f08-521fe216977c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:47.187726 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7f1094f0-49da-44c4-9f08-521fe216977c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:47.188156 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7f1094f0-49da-44c4-9f08-521fe216977c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:47.199904 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7f1094f0-49da-44c4-9f08-521fe216977c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:47.201352 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7f1094f0-49da-44c4-9f08-521fe216977c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:47.201799 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7f1094f0-49da-44c4-9f08-521fe216977c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:48.269575 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4e1fc3f0-e09e-437f-a271-101ab4215ddd tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:48.288092 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4e1fc3f0-e09e-437f-a271-101ab4215ddd tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/fffaf6e3-13e1-4aed-898d-a09feff6f82b" status: 200 len: 1293 microversion: 2.1 time: 1.310954 Oct 17 13:55:48.304041 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2270/4415] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:46 2022] GET /compute/v2.1/servers/fffaf6e3-13e1-4aed-898d-a09feff6f82b => generated 1293 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:55:48.376127 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7f1094f0-49da-44c4-9f08-521fe216977c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:48.391091 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7f1094f0-49da-44c4-9f08-521fe216977c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1666 microversion: 2.1 time: 1.230559 Oct 17 13:55:48.394522 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2146/4416] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:47 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1666 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:55:48.417817 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cf8a5218-c004-48d0-b2ef-496c9f0c5c70 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:48.419009 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cf8a5218-c004-48d0-b2ef-496c9f0c5c70 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:48.426779 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cf8a5218-c004-48d0-b2ef-496c9f0c5c70 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:48.427200 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cf8a5218-c004-48d0-b2ef-496c9f0c5c70 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:48.427629 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cf8a5218-c004-48d0-b2ef-496c9f0c5c70 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:48.428807 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cf8a5218-c004-48d0-b2ef-496c9f0c5c70 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:48.429412 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cf8a5218-c004-48d0-b2ef-496c9f0c5c70 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:48.429846 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cf8a5218-c004-48d0-b2ef-496c9f0c5c70 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:48.687784 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cf8a5218-c004-48d0-b2ef-496c9f0c5c70 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:48.700545 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cf8a5218-c004-48d0-b2ef-496c9f0c5c70 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1666 microversion: 2.1 time: 0.286924 Oct 17 13:55:48.705235 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2271/4417] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:48 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1666 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:48.732176 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-825f169c-4c66-4fbd-a8b5-4404f6ab1e13 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:48.732878 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-825f169c-4c66-4fbd-a8b5-4404f6ab1e13 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:48.743180 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-825f169c-4c66-4fbd-a8b5-4404f6ab1e13 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:48.743801 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-825f169c-4c66-4fbd-a8b5-4404f6ab1e13 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:48.744464 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-825f169c-4c66-4fbd-a8b5-4404f6ab1e13 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:48.745434 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-825f169c-4c66-4fbd-a8b5-4404f6ab1e13 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:48.746607 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-825f169c-4c66-4fbd-a8b5-4404f6ab1e13 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:48.747283 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-825f169c-4c66-4fbd-a8b5-4404f6ab1e13 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:49.130710 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-825f169c-4c66-4fbd-a8b5-4404f6ab1e13 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:49.152292 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-825f169c-4c66-4fbd-a8b5-4404f6ab1e13 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1666 microversion: 2.1 time: 0.424030 Oct 17 13:55:49.154653 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2147/4418] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:48 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1666 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:49.178137 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-eeb6390f-ca3b-43d5-91db-8d864cd90a7f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:55:49.178971 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-eeb6390f-ca3b-43d5-91db-8d864cd90a7f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:49.190968 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eeb6390f-ca3b-43d5-91db-8d864cd90a7f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:49.194341 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eeb6390f-ca3b-43d5-91db-8d864cd90a7f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:49.195041 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eeb6390f-ca3b-43d5-91db-8d864cd90a7f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:49.198006 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eeb6390f-ca3b-43d5-91db-8d864cd90a7f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:49.199540 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eeb6390f-ca3b-43d5-91db-8d864cd90a7f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:49.200614 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eeb6390f-ca3b-43d5-91db-8d864cd90a7f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:49.280203 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-eeb6390f-ca3b-43d5-91db-8d864cd90a7f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Locking {{(pid=127017) lock /opt/stack/nova/nova/compute/api.py:4845}} Oct 17 13:55:49.372156 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-eeb6390f-ca3b-43d5-91db-8d864cd90a7f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "POST /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d/action" status: 202 len: 0 microversion: 2.1 time: 0.200546 Oct 17 13:55:49.373919 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2148/4419] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:55:49 2022] POST /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:55:49.381764 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b2b39fa3-aed6-4071-88e6-b2f39217d98b tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:49.383517 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b2b39fa3-aed6-4071-88e6-b2f39217d98b tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: fffaf6e3-13e1-4aed-898d-a09feff6f82b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:49.392841 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b2b39fa3-aed6-4071-88e6-b2f39217d98b tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:49.393615 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b2b39fa3-aed6-4071-88e6-b2f39217d98b tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:49.394532 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b2b39fa3-aed6-4071-88e6-b2f39217d98b tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:49.395521 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b2b39fa3-aed6-4071-88e6-b2f39217d98b tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:49.396132 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b2b39fa3-aed6-4071-88e6-b2f39217d98b tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:49.396783 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b2b39fa3-aed6-4071-88e6-b2f39217d98b tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:49.518652 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-85102e32-04ab-454e-aaf4-3eb3e63960e5 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1665327627", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "c98d76e4-30db-4d93-9fcb-8988da705504"}]}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:55:49.593866 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b2b39fa3-aed6-4071-88e6-b2f39217d98b tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:49.607875 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b2b39fa3-aed6-4071-88e6-b2f39217d98b tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/fffaf6e3-13e1-4aed-898d-a09feff6f82b" status: 200 len: 1474 microversion: 2.1 time: 0.228402 Oct 17 13:55:49.624935 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2149/4420] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:49 2022] GET /compute/v2.1/servers/fffaf6e3-13e1-4aed-898d-a09feff6f82b => generated 1474 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:49.624935 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-34fc92b1-a20a-4d5e-a028-e0d0d9bb70d2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:49.624935 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-34fc92b1-a20a-4d5e-a028-e0d0d9bb70d2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:49.625527 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-34fc92b1-a20a-4d5e-a028-e0d0d9bb70d2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:49.641569 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-34fc92b1-a20a-4d5e-a028-e0d0d9bb70d2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:49.642364 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-34fc92b1-a20a-4d5e-a028-e0d0d9bb70d2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:49.643588 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-34fc92b1-a20a-4d5e-a028-e0d0d9bb70d2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:49.644243 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-34fc92b1-a20a-4d5e-a028-e0d0d9bb70d2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:49.644678 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-34fc92b1-a20a-4d5e-a028-e0d0d9bb70d2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:49.646458 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-85102e32-04ab-454e-aaf4-3eb3e63960e5 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] validate_networks() for [('c98d76e4-30db-4d93-9fcb-8988da705504', None, None, None, None, None)] {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:55:50.023803 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-34fc92b1-a20a-4d5e-a028-e0d0d9bb70d2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:50.036819 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-34fc92b1-a20a-4d5e-a028-e0d0d9bb70d2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1666 microversion: 2.1 time: 0.423673 Oct 17 13:55:50.040857 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2150/4421] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:49 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1666 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:50.064684 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-82c89398-edc3-4af2-9be0-8c150e566f6c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:55:50.076182 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82c89398-edc3-4af2-9be0-8c150e566f6c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:50.079830 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82c89398-edc3-4af2-9be0-8c150e566f6c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:50.080606 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82c89398-edc3-4af2-9be0-8c150e566f6c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:50.143893 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-82c89398-edc3-4af2-9be0-8c150e566f6c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] HTTP exception thrown: Instance 96dd349a-6476-4a7d-8f55-ea10e3b1e05d is locked Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-82c89398-edc3-4af2-9be0-8c150e566f6c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Request method failure captured: Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: request: POST /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d/action HTTP/1.1 Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 15 Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTV3d-N_EWyrXl_-ZTSAdolghE5oRFAiaYrRKtyahJLuH4Zuc1PUgzCd73YN56SLIjM6miTpzCnqqJsn0BnrpuTYHk5E8J5lGILVtffaMFsULUCEEbYJyYFLHPoFVhrk6yfNnfYA84mZ9NkF5HFg6duIruC8u2pcezDZ7UQon3qHG7VE Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 45371f66db35454fbe896194e75afd6e Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServerActionsTestJSON-845020662 Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/45371f66db35454fbe896194e75afd6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/45371f66db35454fbe896194e75afd6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/45371f66db35454fbe896194e75afd6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_45371f66db35454fbe896194e75afd6e", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServerActionsTestJSON-845020662 Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 45371f66db35454fbe896194e75afd6e Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServerActionsTestJSON-845020662 Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServerActionsTestJSON-845020662-project Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: c9382b34782f44e2818a26ecadc3f386 Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServerActionsTestJSON-845020662-project Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: {"os-stop": {}} Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 96dd349a-6476-4a7d-8f55-ea10e3b1e05d is locked Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '96dd349a-6476-4a7d-8f55-ea10e3b1e05d', 'body': {'os-stop': {}}} Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 96dd349a-6476-4a7d-8f55-ea10e3b1e05d is locked Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 96dd349a-6476-4a7d-8f55-ea10e3b1e05d is locked Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96dd349a-6476-4a7d-8f55-ea10e3b1e05d is locked Oct 17 13:55:50.146716 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:55:50.155601 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-82c89398-edc3-4af2-9be0-8c150e566f6c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Returning 409 to user: Instance 96dd349a-6476-4a7d-8f55-ea10e3b1e05d is locked {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:55:50.157118 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-82c89398-edc3-4af2-9be0-8c150e566f6c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "POST /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d/action" status: 409 len: 107 microversion: 2.1 time: 0.096954 Oct 17 13:55:50.158666 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2151/4422] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:55:50 2022] POST /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d/action => generated 107 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 17 13:55:50.168440 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-99bfc1d5-87f5-404b-9f8f-cccedab80629 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:55:50.173775 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-99bfc1d5-87f5-404b-9f8f-cccedab80629 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:50.191936 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-99bfc1d5-87f5-404b-9f8f-cccedab80629 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:50.193262 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-99bfc1d5-87f5-404b-9f8f-cccedab80629 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:50.193945 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-99bfc1d5-87f5-404b-9f8f-cccedab80629 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:50.196001 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-99bfc1d5-87f5-404b-9f8f-cccedab80629 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:50.196484 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-99bfc1d5-87f5-404b-9f8f-cccedab80629 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:50.198988 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-99bfc1d5-87f5-404b-9f8f-cccedab80629 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:50.271788 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:55:50.284915 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-99bfc1d5-87f5-404b-9f8f-cccedab80629 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Unlocking {{(pid=127017) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 17 13:55:50.353009 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-99bfc1d5-87f5-404b-9f8f-cccedab80629 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "POST /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d/action" status: 202 len: 0 microversion: 2.1 time: 0.188301 Oct 17 13:55:50.359146 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2152/4423] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:55:50 2022] POST /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:55:50.366514 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-57c76307-916f-4f39-96b3-e24680cfaafc tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-293286392", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:55:50.436114 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-57c76307-916f-4f39-96b3-e24680cfaafc tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] validate_networks() for [('57c5839d-0220-4c16-a56e-f44ad4323cc7', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:55:51.246480 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-57c76307-916f-4f39-96b3-e24680cfaafc tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:55:51.247266 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-57c76307-916f-4f39-96b3-e24680cfaafc tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:55:51.247947 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-57c76307-916f-4f39-96b3-e24680cfaafc tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:55:51.248539 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-57c76307-916f-4f39-96b3-e24680cfaafc tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:55:51.249281 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-57c76307-916f-4f39-96b3-e24680cfaafc tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:55:51.263497 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-57c76307-916f-4f39-96b3-e24680cfaafc tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:51.266780 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-57c76307-916f-4f39-96b3-e24680cfaafc tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:51.280149 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-57c76307-916f-4f39-96b3-e24680cfaafc tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:51.282028 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-57c76307-916f-4f39-96b3-e24680cfaafc tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:51.282699 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-57c76307-916f-4f39-96b3-e24680cfaafc tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:51.284784 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-57c76307-916f-4f39-96b3-e24680cfaafc tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:51.307871 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-57c76307-916f-4f39-96b3-e24680cfaafc tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Getting quotas for project 4fa57e8772684c93a406f3d01da2af88. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:55:51.314872 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-57c76307-916f-4f39-96b3-e24680cfaafc tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Getting quotas for user d78348abc02a4bb892902b0dd3bcfd6a and project 4fa57e8772684c93a406f3d01da2af88. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:55:51.332034 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-57c76307-916f-4f39-96b3-e24680cfaafc tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:55:51.335694 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-57c76307-916f-4f39-96b3-e24680cfaafc tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: a985a669-c5cf-450a-a3b8-66dd4dd8ab31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:55:51.405283 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-57c76307-916f-4f39-96b3-e24680cfaafc tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.043408 Oct 17 13:55:51.408800 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2153/4424] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:55:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1048 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:55:51.420488 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ac444ac2-2545-4ffa-af59-6e5cfadb7073 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:55:51.433717 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac444ac2-2545-4ffa-af59-6e5cfadb7073 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:51.434455 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac444ac2-2545-4ffa-af59-6e5cfadb7073 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:51.436498 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac444ac2-2545-4ffa-af59-6e5cfadb7073 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:51.465723 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ac444ac2-2545-4ffa-af59-6e5cfadb7073 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Going to try to stop instance {{(pid=127017) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 17 13:55:51.540719 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ac444ac2-2545-4ffa-af59-6e5cfadb7073 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "POST /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d/action" status: 202 len: 0 microversion: 2.1 time: 0.128636 Oct 17 13:55:51.545223 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-85102e32-04ab-454e-aaf4-3eb3e63960e5 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:55:51.545721 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-85102e32-04ab-454e-aaf4-3eb3e63960e5 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:55:51.546482 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-85102e32-04ab-454e-aaf4-3eb3e63960e5 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:55:51.547106 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-85102e32-04ab-454e-aaf4-3eb3e63960e5 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:55:51.547814 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-85102e32-04ab-454e-aaf4-3eb3e63960e5 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:55:51.552442 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2154/4425] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:55:51 2022] POST /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:55:51.562363 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-85102e32-04ab-454e-aaf4-3eb3e63960e5 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:51.563608 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-85102e32-04ab-454e-aaf4-3eb3e63960e5 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:51.564265 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-85102e32-04ab-454e-aaf4-3eb3e63960e5 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:51.565286 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-85102e32-04ab-454e-aaf4-3eb3e63960e5 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:51.565951 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-85102e32-04ab-454e-aaf4-3eb3e63960e5 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:51.566766 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-85102e32-04ab-454e-aaf4-3eb3e63960e5 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:51.571065 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-20eda389-e9bd-431c-8063-1e4f6744383e tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:51.571695 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-20eda389-e9bd-431c-8063-1e4f6744383e tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: a985a669-c5cf-450a-a3b8-66dd4dd8ab31] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:51.591961 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-85102e32-04ab-454e-aaf4-3eb3e63960e5 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Getting quotas for project e1ef8cf901924235beeab76a20741180. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:55:51.599939 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-85102e32-04ab-454e-aaf4-3eb3e63960e5 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Getting quotas for user e1a07b4d2c6145539910d48178ab6b0d and project e1ef8cf901924235beeab76a20741180. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:55:51.619036 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-85102e32-04ab-454e-aaf4-3eb3e63960e5 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:55:51.624476 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-85102e32-04ab-454e-aaf4-3eb3e63960e5 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] [instance: 77db743f-e8aa-4d5b-abf3-394df55824e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:55:51.640422 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-20eda389-e9bd-431c-8063-1e4f6744383e tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: a985a669-c5cf-450a-a3b8-66dd4dd8ab31] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:55:51.735097 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-85102e32-04ab-454e-aaf4-3eb3e63960e5 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.870741 Oct 17 13:55:51.738014 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2272/4426] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:55:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 2875 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:55:51.750968 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f01d886b-0639-45c5-8b35-3d78a8444426 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:51.751822 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f01d886b-0639-45c5-8b35-3d78a8444426 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:51.777779 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f01d886b-0639-45c5-8b35-3d78a8444426 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:51.778429 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f01d886b-0639-45c5-8b35-3d78a8444426 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:51.778836 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f01d886b-0639-45c5-8b35-3d78a8444426 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:51.779634 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f01d886b-0639-45c5-8b35-3d78a8444426 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:51.780058 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f01d886b-0639-45c5-8b35-3d78a8444426 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:51.780493 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f01d886b-0639-45c5-8b35-3d78a8444426 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:52.020913 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f01d886b-0639-45c5-8b35-3d78a8444426 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:52.041742 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f01d886b-0639-45c5-8b35-3d78a8444426 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1676 microversion: 2.1 time: 0.301874 Oct 17 13:55:52.042925 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2273/4427] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:51 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1676 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:52.057745 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-078bafad-b5e1-48b4-a2f0-3f3e230e67aa tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:52.058812 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-078bafad-b5e1-48b4-a2f0-3f3e230e67aa tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] [instance: 77db743f-e8aa-4d5b-abf3-394df55824e9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:52.189599 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-078bafad-b5e1-48b4-a2f0-3f3e230e67aa tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a07b4d2c6145539910d48178ab6b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ef8cf901924235beeab76a20741180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:52.200254 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-078bafad-b5e1-48b4-a2f0-3f3e230e67aa tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] 10.222.0.79 "GET /compute/v2.1/servers/77db743f-e8aa-4d5b-abf3-394df55824e9" status: 200 len: 1216 microversion: 2.1 time: 0.147732 Oct 17 13:55:52.215787 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2274/4428] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:52 2022] GET /compute/v2.1/servers/77db743f-e8aa-4d5b-abf3-394df55824e9 => generated 1216 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:52.433949 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.scheduler.client.report [None req-20eda389-e9bd-431c-8063-1e4f6744383e tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Deleted allocations for instance a985a669-c5cf-450a-a3b8-66dd4dd8ab31 Oct 17 13:55:52.443591 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.compute.api [None req-20eda389-e9bd-431c-8063-1e4f6744383e tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: a985a669-c5cf-450a-a3b8-66dd4dd8ab31] Instance Mapping does not exist while attempting local delete cleanup. Oct 17 13:55:52.445247 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-20eda389-e9bd-431c-8063-1e4f6744383e tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a985a669-c5cf-450a-a3b8-66dd4dd8ab31" status: 204 len: 0 microversion: 2.1 time: 0.888771 Oct 17 13:55:52.450297 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2155/4429] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:55:51 2022] DELETE /compute/v2.1/servers/a985a669-c5cf-450a-a3b8-66dd4dd8ab31 => generated 0 bytes in 891 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:55:52.455092 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7aabbd70-6be6-425b-9809-a71a8b1c1059 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:52.455985 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7aabbd70-6be6-425b-9809-a71a8b1c1059 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: a985a669-c5cf-450a-a3b8-66dd4dd8ab31] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:52.494548 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-7aabbd70-6be6-425b-9809-a71a8b1c1059 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] HTTP exception thrown: Instance a985a669-c5cf-450a-a3b8-66dd4dd8ab31 could not be found. Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7aabbd70-6be6-425b-9809-a71a8b1c1059 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Request method failure captured: Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/a985a669-c5cf-450a-a3b8-66dd4dd8ab31 HTTP/1.1 Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTV7LY5HyKXIBiWDJCG3V5sT42rtCOx1a0oRMtoibd5F_sflHwMTlRe9Y_uOa1HxVMLf4skT3kvoUZ584fC2ohAV2v8XUvXrQcJEEPLKlU8mLvFkUN1JC352BF9fy9_Q0qQLABy1MIy7jPkSZI0xF-7yfpY_h22PPPDKIkDzzcK6D9CQ Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 4fa57e8772684c93a406f3d01da2af88 Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServersTestJSON-749544598 Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4fa57e8772684c93a406f3d01da2af88", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServersTestJSON-749544598 Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 4fa57e8772684c93a406f3d01da2af88 Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServersTestJSON-749544598 Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServersTestJSON-749544598-project Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: d78348abc02a4bb892902b0dd3bcfd6a Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServersTestJSON-749544598-project Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance a985a669-c5cf-450a-a3b8-66dd4dd8ab31 could not be found. Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'a985a669-c5cf-450a-a3b8-66dd4dd8ab31'} Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a985a669-c5cf-450a-a3b8-66dd4dd8ab31 could not be found. Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a985a669-c5cf-450a-a3b8-66dd4dd8ab31 could not be found. Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:55:52.509395 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:55:52.513661 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:55:52.513661 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:55:52.513661 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a985a669-c5cf-450a-a3b8-66dd4dd8ab31 could not be found. Oct 17 13:55:52.513661 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:55:52.519589 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7aabbd70-6be6-425b-9809-a71a8b1c1059 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Returning 404 to user: Instance a985a669-c5cf-450a-a3b8-66dd4dd8ab31 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:55:52.520568 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7aabbd70-6be6-425b-9809-a71a8b1c1059 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/a985a669-c5cf-450a-a3b8-66dd4dd8ab31" status: 404 len: 111 microversion: 2.1 time: 0.070179 Oct 17 13:55:52.532870 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2275/4430] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:52 2022] GET /compute/v2.1/servers/a985a669-c5cf-450a-a3b8-66dd4dd8ab31 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:55:53.069503 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-415702b3-1a56-4c16-8846-28613f8a984c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:53.070132 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-415702b3-1a56-4c16-8846-28613f8a984c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:53.089016 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-415702b3-1a56-4c16-8846-28613f8a984c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:53.093505 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-415702b3-1a56-4c16-8846-28613f8a984c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:53.094247 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-415702b3-1a56-4c16-8846-28613f8a984c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:53.097899 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-415702b3-1a56-4c16-8846-28613f8a984c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:53.098392 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-415702b3-1a56-4c16-8846-28613f8a984c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:53.098827 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-415702b3-1a56-4c16-8846-28613f8a984c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:53.230235 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d94b7d91-fa0c-4763-96b4-cfe2e2444d7d tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:53.230858 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d94b7d91-fa0c-4763-96b4-cfe2e2444d7d tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] [instance: 77db743f-e8aa-4d5b-abf3-394df55824e9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:53.251032 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d94b7d91-fa0c-4763-96b4-cfe2e2444d7d tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:53.251556 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d94b7d91-fa0c-4763-96b4-cfe2e2444d7d tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:53.252000 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d94b7d91-fa0c-4763-96b4-cfe2e2444d7d tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:53.252725 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d94b7d91-fa0c-4763-96b4-cfe2e2444d7d tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:53.253189 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d94b7d91-fa0c-4763-96b4-cfe2e2444d7d tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:53.253613 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d94b7d91-fa0c-4763-96b4-cfe2e2444d7d tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:53.644277 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d94b7d91-fa0c-4763-96b4-cfe2e2444d7d tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a07b4d2c6145539910d48178ab6b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ef8cf901924235beeab76a20741180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:53.665976 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d94b7d91-fa0c-4763-96b4-cfe2e2444d7d tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] 10.222.0.79 "GET /compute/v2.1/servers/77db743f-e8aa-4d5b-abf3-394df55824e9" status: 200 len: 1220 microversion: 2.1 time: 0.440724 Oct 17 13:55:53.679160 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2276/4431] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:53 2022] GET /compute/v2.1/servers/77db743f-e8aa-4d5b-abf3-394df55824e9 => generated 1220 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:53.700587 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2d7b4ad2-7120-4d39-8b7c-bcb241f36b75 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1215192005", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "57c5839d-0220-4c16-a56e-f44ad4323cc7"}]}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:55:53.836641 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-415702b3-1a56-4c16-8846-28613f8a984c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:53.856035 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-415702b3-1a56-4c16-8846-28613f8a984c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1676 microversion: 2.1 time: 0.784075 Oct 17 13:55:53.859057 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2156/4432] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:53 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1676 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:53.872413 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-2d7b4ad2-7120-4d39-8b7c-bcb241f36b75 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] validate_networks() for [('57c5839d-0220-4c16-a56e-f44ad4323cc7', None, None, None, None, None)] {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:55:54.702919 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-94528022-e64b-44a4-81ba-dc96d2c6639e tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:54.704292 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-94528022-e64b-44a4-81ba-dc96d2c6639e tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] [instance: 77db743f-e8aa-4d5b-abf3-394df55824e9] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:54.725701 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-94528022-e64b-44a4-81ba-dc96d2c6639e tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:54.731748 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-94528022-e64b-44a4-81ba-dc96d2c6639e tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:54.734734 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-94528022-e64b-44a4-81ba-dc96d2c6639e tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:54.743248 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-94528022-e64b-44a4-81ba-dc96d2c6639e tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:54.745139 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-94528022-e64b-44a4-81ba-dc96d2c6639e tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:54.746248 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-94528022-e64b-44a4-81ba-dc96d2c6639e tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:55.306078 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-94528022-e64b-44a4-81ba-dc96d2c6639e tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a07b4d2c6145539910d48178ab6b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ef8cf901924235beeab76a20741180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:55.320712 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-94528022-e64b-44a4-81ba-dc96d2c6639e tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] 10.222.0.79 "GET /compute/v2.1/servers/77db743f-e8aa-4d5b-abf3-394df55824e9" status: 200 len: 1274 microversion: 2.1 time: 0.621324 Oct 17 13:55:55.321492 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2157/4433] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:54 2022] GET /compute/v2.1/servers/77db743f-e8aa-4d5b-abf3-394df55824e9 => generated 1274 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:55.336108 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7fa4c9ac-cd2b-4ac2-ab8c-33f2576b89a1 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:55.366897 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7fa4c9ac-cd2b-4ac2-ab8c-33f2576b89a1 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:55.390254 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7fa4c9ac-cd2b-4ac2-ab8c-33f2576b89a1 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:55.395323 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7fa4c9ac-cd2b-4ac2-ab8c-33f2576b89a1 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:55.397781 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7fa4c9ac-cd2b-4ac2-ab8c-33f2576b89a1 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:55.398713 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7fa4c9ac-cd2b-4ac2-ab8c-33f2576b89a1 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:55.403775 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7fa4c9ac-cd2b-4ac2-ab8c-33f2576b89a1 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:55.405398 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7fa4c9ac-cd2b-4ac2-ab8c-33f2576b89a1 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:55.731594 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7fa4c9ac-cd2b-4ac2-ab8c-33f2576b89a1 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:55.741225 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7fa4c9ac-cd2b-4ac2-ab8c-33f2576b89a1 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1676 microversion: 2.1 time: 0.408909 Oct 17 13:55:55.744383 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2158/4434] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:55 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1676 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:56.014703 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-2d7b4ad2-7120-4d39-8b7c-bcb241f36b75 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:55:56.015157 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-2d7b4ad2-7120-4d39-8b7c-bcb241f36b75 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:55:56.015643 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-2d7b4ad2-7120-4d39-8b7c-bcb241f36b75 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:55:56.016052 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-2d7b4ad2-7120-4d39-8b7c-bcb241f36b75 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:55:56.016459 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-2d7b4ad2-7120-4d39-8b7c-bcb241f36b75 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:55:56.037749 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2d7b4ad2-7120-4d39-8b7c-bcb241f36b75 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:56.038255 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2d7b4ad2-7120-4d39-8b7c-bcb241f36b75 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:56.038681 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2d7b4ad2-7120-4d39-8b7c-bcb241f36b75 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:56.039904 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2d7b4ad2-7120-4d39-8b7c-bcb241f36b75 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:56.041546 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2d7b4ad2-7120-4d39-8b7c-bcb241f36b75 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:56.044367 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2d7b4ad2-7120-4d39-8b7c-bcb241f36b75 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:56.119435 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-2d7b4ad2-7120-4d39-8b7c-bcb241f36b75 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Getting quotas for project 4fa57e8772684c93a406f3d01da2af88. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:55:56.134970 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-2d7b4ad2-7120-4d39-8b7c-bcb241f36b75 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Getting quotas for user d78348abc02a4bb892902b0dd3bcfd6a and project 4fa57e8772684c93a406f3d01da2af88. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:55:56.179256 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2d7b4ad2-7120-4d39-8b7c-bcb241f36b75 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:55:56.182669 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2d7b4ad2-7120-4d39-8b7c-bcb241f36b75 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: e9096e2e-d971-4866-ae12-472b3d9909ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:55:56.295441 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2d7b4ad2-7120-4d39-8b7c-bcb241f36b75 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.614615 Oct 17 13:55:56.296956 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2277/4435] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:55:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:55:56.307688 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-601fc783-5cfd-40f0-ad2c-320d9839d42d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:56.308301 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-601fc783-5cfd-40f0-ad2c-320d9839d42d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: e9096e2e-d971-4866-ae12-472b3d9909ea] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:56.347273 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5d221f6f-2608-4aea-8ff3-485c6021662e tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:56.347897 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5d221f6f-2608-4aea-8ff3-485c6021662e tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] [instance: 77db743f-e8aa-4d5b-abf3-394df55824e9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:56.359221 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5d221f6f-2608-4aea-8ff3-485c6021662e tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:56.360319 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5d221f6f-2608-4aea-8ff3-485c6021662e tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:56.371794 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5d221f6f-2608-4aea-8ff3-485c6021662e tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:56.372842 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5d221f6f-2608-4aea-8ff3-485c6021662e tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:56.374406 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5d221f6f-2608-4aea-8ff3-485c6021662e tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:56.375096 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5d221f6f-2608-4aea-8ff3-485c6021662e tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:56.661686 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-601fc783-5cfd-40f0-ad2c-320d9839d42d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:56.675094 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-601fc783-5cfd-40f0-ad2c-320d9839d42d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/e9096e2e-d971-4866-ae12-472b3d9909ea" status: 200 len: 1221 microversion: 2.1 time: 0.368453 Oct 17 13:55:56.681037 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5d221f6f-2608-4aea-8ff3-485c6021662e tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a07b4d2c6145539910d48178ab6b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ef8cf901924235beeab76a20741180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:56.704496 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2159/4436] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:56 2022] GET /compute/v2.1/servers/e9096e2e-d971-4866-ae12-472b3d9909ea => generated 1221 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:56.708111 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5d221f6f-2608-4aea-8ff3-485c6021662e tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] 10.222.0.79 "GET /compute/v2.1/servers/77db743f-e8aa-4d5b-abf3-394df55824e9" status: 200 len: 1274 microversion: 2.1 time: 0.364701 Oct 17 13:55:56.708841 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2278/4437] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:56 2022] GET /compute/v2.1/servers/77db743f-e8aa-4d5b-abf3-394df55824e9 => generated 1274 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:55:56.769750 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0bef60b9-5252-451b-aeaa-2ddb67d6268e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:56.770373 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0bef60b9-5252-451b-aeaa-2ddb67d6268e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:56.778814 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0bef60b9-5252-451b-aeaa-2ddb67d6268e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:56.779407 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0bef60b9-5252-451b-aeaa-2ddb67d6268e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:56.779757 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0bef60b9-5252-451b-aeaa-2ddb67d6268e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:56.780506 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0bef60b9-5252-451b-aeaa-2ddb67d6268e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:56.780956 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0bef60b9-5252-451b-aeaa-2ddb67d6268e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:56.798570 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0bef60b9-5252-451b-aeaa-2ddb67d6268e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:57.363548 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0bef60b9-5252-451b-aeaa-2ddb67d6268e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:57.376999 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0bef60b9-5252-451b-aeaa-2ddb67d6268e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1676 microversion: 2.1 time: 0.610931 Oct 17 13:55:57.383765 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2160/4438] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:56 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1676 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:57.736499 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0d4ab7f3-d7b1-49c1-862d-5123c103b9c0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:57.737816 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0d4ab7f3-d7b1-49c1-862d-5123c103b9c0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: e9096e2e-d971-4866-ae12-472b3d9909ea] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:57.738315 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d410093c-463f-4e5d-88f1-d33e6a80b3a9 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:57.743076 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d410093c-463f-4e5d-88f1-d33e6a80b3a9 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] [instance: 77db743f-e8aa-4d5b-abf3-394df55824e9] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:57.746861 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0d4ab7f3-d7b1-49c1-862d-5123c103b9c0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:57.748273 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0d4ab7f3-d7b1-49c1-862d-5123c103b9c0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:57.748905 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0d4ab7f3-d7b1-49c1-862d-5123c103b9c0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:57.750728 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0d4ab7f3-d7b1-49c1-862d-5123c103b9c0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:57.751387 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0d4ab7f3-d7b1-49c1-862d-5123c103b9c0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:57.753882 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0d4ab7f3-d7b1-49c1-862d-5123c103b9c0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:57.760602 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d410093c-463f-4e5d-88f1-d33e6a80b3a9 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:57.761115 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d410093c-463f-4e5d-88f1-d33e6a80b3a9 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:57.761544 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d410093c-463f-4e5d-88f1-d33e6a80b3a9 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:57.764991 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d410093c-463f-4e5d-88f1-d33e6a80b3a9 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:57.767284 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d410093c-463f-4e5d-88f1-d33e6a80b3a9 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:57.767878 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d410093c-463f-4e5d-88f1-d33e6a80b3a9 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:57.906265 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0d4ab7f3-d7b1-49c1-862d-5123c103b9c0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:57.933623 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0d4ab7f3-d7b1-49c1-862d-5123c103b9c0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/e9096e2e-d971-4866-ae12-472b3d9909ea" status: 200 len: 1217 microversion: 2.1 time: 0.203269 Oct 17 13:55:57.960367 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2279/4439] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:57 2022] GET /compute/v2.1/servers/e9096e2e-d971-4866-ae12-472b3d9909ea => generated 1217 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:58.098618 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d410093c-463f-4e5d-88f1-d33e6a80b3a9 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a07b4d2c6145539910d48178ab6b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ef8cf901924235beeab76a20741180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:58.108952 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d410093c-463f-4e5d-88f1-d33e6a80b3a9 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] 10.222.0.79 "GET /compute/v2.1/servers/77db743f-e8aa-4d5b-abf3-394df55824e9" status: 200 len: 1316 microversion: 2.1 time: 0.374965 Oct 17 13:55:58.109826 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2161/4440] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:57 2022] GET /compute/v2.1/servers/77db743f-e8aa-4d5b-abf3-394df55824e9 => generated 1316 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:55:58.421253 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-99fb4fc3-5a0a-4147-8b38-fb134bebb1b4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:58.422509 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-99fb4fc3-5a0a-4147-8b38-fb134bebb1b4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:58.437353 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-99fb4fc3-5a0a-4147-8b38-fb134bebb1b4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:58.438254 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-99fb4fc3-5a0a-4147-8b38-fb134bebb1b4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:58.439078 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-99fb4fc3-5a0a-4147-8b38-fb134bebb1b4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:58.440040 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-99fb4fc3-5a0a-4147-8b38-fb134bebb1b4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:58.440875 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-99fb4fc3-5a0a-4147-8b38-fb134bebb1b4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:58.441581 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-99fb4fc3-5a0a-4147-8b38-fb134bebb1b4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:58.566312 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0f1192a0-e12b-4c9c-9180-3ba7437ca907 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1578087458", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "536c8c49-8501-4c2f-bf93-136c7f68a48c"}]}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:55:58.658057 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-0f1192a0-e12b-4c9c-9180-3ba7437ca907 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] validate_networks() for [('536c8c49-8501-4c2f-bf93-136c7f68a48c', None, None, None, None, None)] {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:55:59.237844 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-99fb4fc3-5a0a-4147-8b38-fb134bebb1b4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:59.247185 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-99fb4fc3-5a0a-4147-8b38-fb134bebb1b4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1676 microversion: 2.1 time: 0.840476 Oct 17 13:55:59.259966 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2162/4441] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:58 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1676 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:59.275043 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8190c24d-cc59-44bb-bda1-792347eabe9b tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:59.275937 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8190c24d-cc59-44bb-bda1-792347eabe9b tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: e9096e2e-d971-4866-ae12-472b3d9909ea] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:59.283373 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8190c24d-cc59-44bb-bda1-792347eabe9b tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:59.285819 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8190c24d-cc59-44bb-bda1-792347eabe9b tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:59.286543 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8190c24d-cc59-44bb-bda1-792347eabe9b tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:59.287622 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8190c24d-cc59-44bb-bda1-792347eabe9b tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:59.291946 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8190c24d-cc59-44bb-bda1-792347eabe9b tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:59.293060 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8190c24d-cc59-44bb-bda1-792347eabe9b tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:59.431609 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8190c24d-cc59-44bb-bda1-792347eabe9b tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:59.447585 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8190c24d-cc59-44bb-bda1-792347eabe9b tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/e9096e2e-d971-4866-ae12-472b3d9909ea" status: 200 len: 1279 microversion: 2.1 time: 0.185433 Oct 17 13:55:59.448183 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2163/4442] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:59 2022] GET /compute/v2.1/servers/e9096e2e-d971-4866-ae12-472b3d9909ea => generated 1279 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:59.461013 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-20ad709a-f227-46f3-8541-3be6609024f2 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:59.465307 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-20ad709a-f227-46f3-8541-3be6609024f2 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] [instance: 77db743f-e8aa-4d5b-abf3-394df55824e9] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:59.482806 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-20ad709a-f227-46f3-8541-3be6609024f2 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:59.483356 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-20ad709a-f227-46f3-8541-3be6609024f2 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:59.486337 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-20ad709a-f227-46f3-8541-3be6609024f2 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:59.487082 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-20ad709a-f227-46f3-8541-3be6609024f2 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:59.488783 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-20ad709a-f227-46f3-8541-3be6609024f2 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:59.489330 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-20ad709a-f227-46f3-8541-3be6609024f2 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:59.894431 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-20ad709a-f227-46f3-8541-3be6609024f2 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a07b4d2c6145539910d48178ab6b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ef8cf901924235beeab76a20741180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:59.905834 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-20ad709a-f227-46f3-8541-3be6609024f2 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] 10.222.0.79 "GET /compute/v2.1/servers/77db743f-e8aa-4d5b-abf3-394df55824e9" status: 200 len: 1316 microversion: 2.1 time: 0.455359 Oct 17 13:55:59.915452 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2164/4443] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:59 2022] GET /compute/v2.1/servers/77db743f-e8aa-4d5b-abf3-394df55824e9 => generated 1316 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:59.930004 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-b1e15d69-9487-4295-b029-5aa2fdae9b6b req-2ebcde44-c8b7-48bb-afd8-0246fc8fbd79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77db743f-e8aa-4d5b-abf3-394df55824e9", "tag": "4ccf1ed7-bb9d-464d-a737-8e9673812233"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:55:59.945828 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-b1e15d69-9487-4295-b029-5aa2fdae9b6b req-2ebcde44-c8b7-48bb-afd8-0246fc8fbd79 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:59.946708 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-b1e15d69-9487-4295-b029-5aa2fdae9b6b req-2ebcde44-c8b7-48bb-afd8-0246fc8fbd79 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:59.947404 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-b1e15d69-9487-4295-b029-5aa2fdae9b6b req-2ebcde44-c8b7-48bb-afd8-0246fc8fbd79 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:59.960815 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-b1e15d69-9487-4295-b029-5aa2fdae9b6b req-2ebcde44-c8b7-48bb-afd8-0246fc8fbd79 service nova] Creating event network-changed:4ccf1ed7-bb9d-464d-a737-8e9673812233 for instance 77db743f-e8aa-4d5b-abf3-394df55824e9 on n-h1-854247-14 Oct 17 13:55:59.967567 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-b1e15d69-9487-4295-b029-5aa2fdae9b6b req-2ebcde44-c8b7-48bb-afd8-0246fc8fbd79 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043073 Oct 17 13:55:59.968416 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2165/4444] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:56:00.287136 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4756258f-4ab7-46da-a53f-20081ba7883f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:00.288112 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4756258f-4ab7-46da-a53f-20081ba7883f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:00.297741 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4756258f-4ab7-46da-a53f-20081ba7883f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:00.299140 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4756258f-4ab7-46da-a53f-20081ba7883f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:00.300057 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4756258f-4ab7-46da-a53f-20081ba7883f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:00.304463 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4756258f-4ab7-46da-a53f-20081ba7883f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:00.309208 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4756258f-4ab7-46da-a53f-20081ba7883f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:00.310294 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4756258f-4ab7-46da-a53f-20081ba7883f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:00.312732 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-0f1192a0-e12b-4c9c-9180-3ba7437ca907 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:56:00.313211 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-0f1192a0-e12b-4c9c-9180-3ba7437ca907 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:56:00.313611 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-0f1192a0-e12b-4c9c-9180-3ba7437ca907 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:56:00.314020 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-0f1192a0-e12b-4c9c-9180-3ba7437ca907 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:56:00.314429 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-0f1192a0-e12b-4c9c-9180-3ba7437ca907 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:56:00.335685 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0f1192a0-e12b-4c9c-9180-3ba7437ca907 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:00.336493 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0f1192a0-e12b-4c9c-9180-3ba7437ca907 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:00.337206 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0f1192a0-e12b-4c9c-9180-3ba7437ca907 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:00.338142 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0f1192a0-e12b-4c9c-9180-3ba7437ca907 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:00.338786 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0f1192a0-e12b-4c9c-9180-3ba7437ca907 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:00.339425 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0f1192a0-e12b-4c9c-9180-3ba7437ca907 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:00.367140 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-0f1192a0-e12b-4c9c-9180-3ba7437ca907 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Getting quotas for project 0821e5beffdd41c2ad2adbd1d03cde71. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:56:00.373870 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-0f1192a0-e12b-4c9c-9180-3ba7437ca907 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Getting quotas for user ab8baeba1d494df5bb9cf4d7289410b9 and project 0821e5beffdd41c2ad2adbd1d03cde71. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:56:00.389012 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0f1192a0-e12b-4c9c-9180-3ba7437ca907 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:56:00.391455 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0f1192a0-e12b-4c9c-9180-3ba7437ca907 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: d3018df0-e202-4fa2-91ad-e9fe210ea9ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:56:00.471353 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0f1192a0-e12b-4c9c-9180-3ba7437ca907 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.509714 Oct 17 13:56:00.472335 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2280/4445] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:55:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 2511 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:56:00.477263 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b7d981f9-0c77-4e36-8599-42a542f4d772 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:00.477877 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b7d981f9-0c77-4e36-8599-42a542f4d772 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: e9096e2e-d971-4866-ae12-472b3d9909ea] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:00.484457 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b7d981f9-0c77-4e36-8599-42a542f4d772 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:00.485145 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b7d981f9-0c77-4e36-8599-42a542f4d772 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:00.485955 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b7d981f9-0c77-4e36-8599-42a542f4d772 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:00.487115 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b7d981f9-0c77-4e36-8599-42a542f4d772 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:00.487748 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b7d981f9-0c77-4e36-8599-42a542f4d772 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:00.488636 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b7d981f9-0c77-4e36-8599-42a542f4d772 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:00.703715 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b7d981f9-0c77-4e36-8599-42a542f4d772 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:00.714939 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b7d981f9-0c77-4e36-8599-42a542f4d772 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/e9096e2e-d971-4866-ae12-472b3d9909ea" status: 200 len: 1279 microversion: 2.1 time: 0.241423 Oct 17 13:56:00.731212 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2281/4446] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:00 2022] GET /compute/v2.1/servers/e9096e2e-d971-4866-ae12-472b3d9909ea => generated 1279 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:00.731212 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d704a88c-92d3-4798-a35f-618a373476e0 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:00.731212 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d704a88c-92d3-4798-a35f-618a373476e0 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: d3018df0-e202-4fa2-91ad-e9fe210ea9ad] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:00.749550 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:56:00.792937 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4756258f-4ab7-46da-a53f-20081ba7883f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:00.803625 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4756258f-4ab7-46da-a53f-20081ba7883f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1676 microversion: 2.1 time: 0.521159 Oct 17 13:56:00.823101 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2166/4447] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:00 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1676 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:00.906530 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d704a88c-92d3-4798-a35f-618a373476e0 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:00.916464 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d704a88c-92d3-4798-a35f-618a373476e0 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/d3018df0-e202-4fa2-91ad-e9fe210ea9ad" status: 200 len: 1215 microversion: 2.1 time: 0.193896 Oct 17 13:56:00.922238 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2282/4448] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:00 2022] GET /compute/v2.1/servers/d3018df0-e202-4fa2-91ad-e9fe210ea9ad => generated 1215 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:00.934362 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2152616a-937f-4b7c-9885-61191e14c95e tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:00.935452 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2152616a-937f-4b7c-9885-61191e14c95e tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] [instance: 77db743f-e8aa-4d5b-abf3-394df55824e9] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:00.949936 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2152616a-937f-4b7c-9885-61191e14c95e tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:00.950673 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2152616a-937f-4b7c-9885-61191e14c95e tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:00.951345 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2152616a-937f-4b7c-9885-61191e14c95e tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:00.952266 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2152616a-937f-4b7c-9885-61191e14c95e tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:00.952937 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2152616a-937f-4b7c-9885-61191e14c95e tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:00.953561 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2152616a-937f-4b7c-9885-61191e14c95e tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:01.297271 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:56:01.404588 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2152616a-937f-4b7c-9885-61191e14c95e tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a07b4d2c6145539910d48178ab6b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ef8cf901924235beeab76a20741180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:01.422263 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2152616a-937f-4b7c-9885-61191e14c95e tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] 10.222.0.79 "GET /compute/v2.1/servers/77db743f-e8aa-4d5b-abf3-394df55824e9" status: 200 len: 1316 microversion: 2.1 time: 0.491809 Oct 17 13:56:01.423461 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2167/4449] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:00 2022] GET /compute/v2.1/servers/77db743f-e8aa-4d5b-abf3-394df55824e9 => generated 1316 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:01.746469 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7c42f5ab-4ad2-4868-ab62-bd60cea7133f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:01.747087 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7c42f5ab-4ad2-4868-ab62-bd60cea7133f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: e9096e2e-d971-4866-ae12-472b3d9909ea] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:01.764561 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7c42f5ab-4ad2-4868-ab62-bd60cea7133f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:01.767326 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7c42f5ab-4ad2-4868-ab62-bd60cea7133f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:01.771627 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7c42f5ab-4ad2-4868-ab62-bd60cea7133f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:01.774092 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7c42f5ab-4ad2-4868-ab62-bd60cea7133f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:01.775108 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7c42f5ab-4ad2-4868-ab62-bd60cea7133f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:01.787615 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7c42f5ab-4ad2-4868-ab62-bd60cea7133f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:01.830649 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-71532fa5-7cc8-475d-9e4c-8f643b8406e8 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:01.832103 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-71532fa5-7cc8-475d-9e4c-8f643b8406e8 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:01.843479 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-71532fa5-7cc8-475d-9e4c-8f643b8406e8 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:01.849398 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-71532fa5-7cc8-475d-9e4c-8f643b8406e8 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:01.850074 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-71532fa5-7cc8-475d-9e4c-8f643b8406e8 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:01.851049 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-71532fa5-7cc8-475d-9e4c-8f643b8406e8 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:01.851744 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-71532fa5-7cc8-475d-9e4c-8f643b8406e8 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:01.852411 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-71532fa5-7cc8-475d-9e4c-8f643b8406e8 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:02.234413 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7c42f5ab-4ad2-4868-ab62-bd60cea7133f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:02.250301 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7c42f5ab-4ad2-4868-ab62-bd60cea7133f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/e9096e2e-d971-4866-ae12-472b3d9909ea" status: 200 len: 1321 microversion: 2.1 time: 0.508946 Oct 17 13:56:02.268715 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2283/4450] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:01 2022] GET /compute/v2.1/servers/e9096e2e-d971-4866-ae12-472b3d9909ea => generated 1321 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:56:02.269715 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-71532fa5-7cc8-475d-9e4c-8f643b8406e8 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:02.276406 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-74b65c51-04e2-4945-b22c-fe5369a5f8a4 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:02.276820 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-71532fa5-7cc8-475d-9e4c-8f643b8406e8 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1676 microversion: 2.1 time: 0.450357 Oct 17 13:56:02.277739 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2168/4451] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:01 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1676 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:02.278507 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-74b65c51-04e2-4945-b22c-fe5369a5f8a4 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: d3018df0-e202-4fa2-91ad-e9fe210ea9ad] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:02.296139 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-74b65c51-04e2-4945-b22c-fe5369a5f8a4 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:02.298025 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-74b65c51-04e2-4945-b22c-fe5369a5f8a4 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:02.298570 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-74b65c51-04e2-4945-b22c-fe5369a5f8a4 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:02.300185 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-74b65c51-04e2-4945-b22c-fe5369a5f8a4 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:02.300754 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-74b65c51-04e2-4945-b22c-fe5369a5f8a4 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:02.305704 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-74b65c51-04e2-4945-b22c-fe5369a5f8a4 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:02.451487 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ade00b79-53f8-4007-a441-e765fae963ac tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:02.452223 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ade00b79-53f8-4007-a441-e765fae963ac tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] [instance: 77db743f-e8aa-4d5b-abf3-394df55824e9] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:02.459084 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ade00b79-53f8-4007-a441-e765fae963ac tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:02.459600 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ade00b79-53f8-4007-a441-e765fae963ac tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:02.460037 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ade00b79-53f8-4007-a441-e765fae963ac tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:02.460740 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ade00b79-53f8-4007-a441-e765fae963ac tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:02.461188 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ade00b79-53f8-4007-a441-e765fae963ac tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:02.461605 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ade00b79-53f8-4007-a441-e765fae963ac tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:02.886824 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-74b65c51-04e2-4945-b22c-fe5369a5f8a4 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:02.897065 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-74b65c51-04e2-4945-b22c-fe5369a5f8a4 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/d3018df0-e202-4fa2-91ad-e9fe210ea9ad" status: 200 len: 1211 microversion: 2.1 time: 0.632761 Oct 17 13:56:02.897670 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2284/4452] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:02 2022] GET /compute/v2.1/servers/d3018df0-e202-4fa2-91ad-e9fe210ea9ad => generated 1211 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:03.282461 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-633e3c6f-4817-4add-aae6-df0b5763fc8c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:03.283088 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-633e3c6f-4817-4add-aae6-df0b5763fc8c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: e9096e2e-d971-4866-ae12-472b3d9909ea] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:03.304571 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-633e3c6f-4817-4add-aae6-df0b5763fc8c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:03.305078 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-633e3c6f-4817-4add-aae6-df0b5763fc8c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:03.305528 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-633e3c6f-4817-4add-aae6-df0b5763fc8c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:03.313237 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-633e3c6f-4817-4add-aae6-df0b5763fc8c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:03.315762 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-633e3c6f-4817-4add-aae6-df0b5763fc8c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:03.317070 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-633e3c6f-4817-4add-aae6-df0b5763fc8c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:03.349533 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=100 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:56:03.758874 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ade00b79-53f8-4007-a441-e765fae963ac tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a07b4d2c6145539910d48178ab6b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ef8cf901924235beeab76a20741180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:03.768495 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ade00b79-53f8-4007-a441-e765fae963ac tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] 10.222.0.79 "GET /compute/v2.1/servers/77db743f-e8aa-4d5b-abf3-394df55824e9" status: 200 len: 1316 microversion: 2.1 time: 1.321230 Oct 17 13:56:03.769095 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2169/4453] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:02 2022] GET /compute/v2.1/servers/77db743f-e8aa-4d5b-abf3-394df55824e9 => generated 1316 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:56:03.786049 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2ca9abf4-082e-41c8-9f4e-d3bf8c826dc8 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:03.786049 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2ca9abf4-082e-41c8-9f4e-d3bf8c826dc8 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:03.798650 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2ca9abf4-082e-41c8-9f4e-d3bf8c826dc8 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:03.799143 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2ca9abf4-082e-41c8-9f4e-d3bf8c826dc8 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:03.799611 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2ca9abf4-082e-41c8-9f4e-d3bf8c826dc8 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:03.803544 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2ca9abf4-082e-41c8-9f4e-d3bf8c826dc8 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:03.804062 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2ca9abf4-082e-41c8-9f4e-d3bf8c826dc8 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:03.804507 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2ca9abf4-082e-41c8-9f4e-d3bf8c826dc8 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:03.813427 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:56:04.159121 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-633e3c6f-4817-4add-aae6-df0b5763fc8c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:04.170522 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-633e3c6f-4817-4add-aae6-df0b5763fc8c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/e9096e2e-d971-4866-ae12-472b3d9909ea" status: 200 len: 1321 microversion: 2.1 time: 0.892577 Oct 17 13:56:04.173394 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2285/4454] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:03 2022] GET /compute/v2.1/servers/e9096e2e-d971-4866-ae12-472b3d9909ea => generated 1321 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:56:04.182137 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-bae0e298-b767-4b25-bbb9-ced0f105d7f3 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:04.183186 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-bae0e298-b767-4b25-bbb9-ced0f105d7f3 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: d3018df0-e202-4fa2-91ad-e9fe210ea9ad] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:04.200945 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bae0e298-b767-4b25-bbb9-ced0f105d7f3 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:04.205513 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bae0e298-b767-4b25-bbb9-ced0f105d7f3 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:04.206842 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bae0e298-b767-4b25-bbb9-ced0f105d7f3 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:04.219870 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bae0e298-b767-4b25-bbb9-ced0f105d7f3 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:04.221174 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bae0e298-b767-4b25-bbb9-ced0f105d7f3 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:04.225531 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bae0e298-b767-4b25-bbb9-ced0f105d7f3 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:04.321039 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2ca9abf4-082e-41c8-9f4e-d3bf8c826dc8 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:04.337526 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2ca9abf4-082e-41c8-9f4e-d3bf8c826dc8 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1653 microversion: 2.1 time: 0.561124 Oct 17 13:56:04.338534 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2170/4455] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:03 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1653 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:04.367986 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3a9fcdb5-f69e-4941-9f8c-300665642d29 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:56:04.377070 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3a9fcdb5-f69e-4941-9f8c-300665642d29 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:04.380399 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3a9fcdb5-f69e-4941-9f8c-300665642d29 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:04.381449 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3a9fcdb5-f69e-4941-9f8c-300665642d29 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:04.439266 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3a9fcdb5-f69e-4941-9f8c-300665642d29 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Going to try to start instance {{(pid=127017) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 17 13:56:04.523096 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3a9fcdb5-f69e-4941-9f8c-300665642d29 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "POST /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d/action" status: 202 len: 0 microversion: 2.1 time: 0.158265 Oct 17 13:56:04.526626 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2171/4456] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:56:04 2022] POST /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:56:04.538416 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9838f570-c8a4-415a-880c-bc872bb6689f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:04.542049 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9838f570-c8a4-415a-880c-bc872bb6689f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:04.552157 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9838f570-c8a4-415a-880c-bc872bb6689f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:04.553159 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9838f570-c8a4-415a-880c-bc872bb6689f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:04.553832 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9838f570-c8a4-415a-880c-bc872bb6689f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:04.554845 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9838f570-c8a4-415a-880c-bc872bb6689f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:04.555555 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9838f570-c8a4-415a-880c-bc872bb6689f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:04.556166 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9838f570-c8a4-415a-880c-bc872bb6689f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:04.580760 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-bae0e298-b767-4b25-bbb9-ced0f105d7f3 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:04.595812 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-bae0e298-b767-4b25-bbb9-ced0f105d7f3 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/d3018df0-e202-4fa2-91ad-e9fe210ea9ad" status: 200 len: 1273 microversion: 2.1 time: 0.419591 Oct 17 13:56:04.612799 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2286/4457] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:04 2022] GET /compute/v2.1/servers/d3018df0-e202-4fa2-91ad-e9fe210ea9ad => generated 1273 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:04.712285 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-8f3508a7-dac0-4811-9ee9-87fbbde220a5 req-dcd8ef2b-ca58-4045-b892-0efd3e427623 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9096e2e-d971-4866-ae12-472b3d9909ea", "tag": "3a28c114-5ce8-4a21-8122-28774d8eeb48"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:56:04.735198 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-8f3508a7-dac0-4811-9ee9-87fbbde220a5 req-dcd8ef2b-ca58-4045-b892-0efd3e427623 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:04.735706 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-8f3508a7-dac0-4811-9ee9-87fbbde220a5 req-dcd8ef2b-ca58-4045-b892-0efd3e427623 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:04.736161 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-8f3508a7-dac0-4811-9ee9-87fbbde220a5 req-dcd8ef2b-ca58-4045-b892-0efd3e427623 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:04.765822 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-8f3508a7-dac0-4811-9ee9-87fbbde220a5 req-dcd8ef2b-ca58-4045-b892-0efd3e427623 service nova] Creating event network-changed:3a28c114-5ce8-4a21-8122-28774d8eeb48 for instance e9096e2e-d971-4866-ae12-472b3d9909ea on n-h2-854247-14 Oct 17 13:56:04.777047 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-8f3508a7-dac0-4811-9ee9-87fbbde220a5 req-dcd8ef2b-ca58-4045-b892-0efd3e427623 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073696 Oct 17 13:56:04.780070 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2287/4458] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:56:04.795110 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-20be8481-22ed-4ff7-b202-b97c2d1d542c tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:04.796012 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-20be8481-22ed-4ff7-b202-b97c2d1d542c tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] [instance: 77db743f-e8aa-4d5b-abf3-394df55824e9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:04.816769 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-20be8481-22ed-4ff7-b202-b97c2d1d542c tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:04.819472 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-20be8481-22ed-4ff7-b202-b97c2d1d542c tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:04.820160 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-20be8481-22ed-4ff7-b202-b97c2d1d542c tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:04.820998 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-20be8481-22ed-4ff7-b202-b97c2d1d542c tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:04.822198 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-20be8481-22ed-4ff7-b202-b97c2d1d542c tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:04.822863 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-20be8481-22ed-4ff7-b202-b97c2d1d542c tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:05.137413 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9838f570-c8a4-415a-880c-bc872bb6689f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:05.157304 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9838f570-c8a4-415a-880c-bc872bb6689f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1662 microversion: 2.1 time: 0.626345 Oct 17 13:56:05.158900 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2172/4459] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:04 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1662 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:56:05.198935 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8683ae2f-f010-40ed-95eb-e3d6f5282694 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:05.199863 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8683ae2f-f010-40ed-95eb-e3d6f5282694 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: e9096e2e-d971-4866-ae12-472b3d9909ea] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:05.217278 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8683ae2f-f010-40ed-95eb-e3d6f5282694 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:05.219484 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8683ae2f-f010-40ed-95eb-e3d6f5282694 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:05.223890 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8683ae2f-f010-40ed-95eb-e3d6f5282694 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:05.225103 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8683ae2f-f010-40ed-95eb-e3d6f5282694 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:05.227371 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8683ae2f-f010-40ed-95eb-e3d6f5282694 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:05.228288 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8683ae2f-f010-40ed-95eb-e3d6f5282694 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:05.354187 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-20be8481-22ed-4ff7-b202-b97c2d1d542c tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a07b4d2c6145539910d48178ab6b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ef8cf901924235beeab76a20741180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:05.367112 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-20be8481-22ed-4ff7-b202-b97c2d1d542c tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] 10.222.0.79 "GET /compute/v2.1/servers/77db743f-e8aa-4d5b-abf3-394df55824e9" status: 200 len: 1316 microversion: 2.1 time: 0.575056 Oct 17 13:56:05.369884 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2288/4460] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:04 2022] GET /compute/v2.1/servers/77db743f-e8aa-4d5b-abf3-394df55824e9 => generated 1316 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:05.495948 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-344104bd-d548-41a0-92b9-887214d228d2 req-81c3dec3-1301-47bd-80db-6c572a6d7e9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77db743f-e8aa-4d5b-abf3-394df55824e9", "name": "network-vif-plugged", "status": "completed", "tag": "4ccf1ed7-bb9d-464d-a737-8e9673812233"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:56:05.518781 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-344104bd-d548-41a0-92b9-887214d228d2 req-81c3dec3-1301-47bd-80db-6c572a6d7e9b service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:05.521740 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-344104bd-d548-41a0-92b9-887214d228d2 req-81c3dec3-1301-47bd-80db-6c572a6d7e9b service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:05.522232 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-344104bd-d548-41a0-92b9-887214d228d2 req-81c3dec3-1301-47bd-80db-6c572a6d7e9b service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:05.562334 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-344104bd-d548-41a0-92b9-887214d228d2 req-81c3dec3-1301-47bd-80db-6c572a6d7e9b service nova] Creating event network-vif-plugged:4ccf1ed7-bb9d-464d-a737-8e9673812233 for instance 77db743f-e8aa-4d5b-abf3-394df55824e9 on n-h1-854247-14 Oct 17 13:56:05.572248 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-344104bd-d548-41a0-92b9-887214d228d2 req-81c3dec3-1301-47bd-80db-6c572a6d7e9b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080065 Oct 17 13:56:05.572868 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2289/4461] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:56:05.632239 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5b128202-7f7e-4ff9-9509-5b852a287c4e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:05.633005 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5b128202-7f7e-4ff9-9509-5b852a287c4e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: d3018df0-e202-4fa2-91ad-e9fe210ea9ad] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:05.646875 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5b128202-7f7e-4ff9-9509-5b852a287c4e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:05.647425 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5b128202-7f7e-4ff9-9509-5b852a287c4e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:05.648051 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5b128202-7f7e-4ff9-9509-5b852a287c4e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:05.648971 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5b128202-7f7e-4ff9-9509-5b852a287c4e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:05.649427 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5b128202-7f7e-4ff9-9509-5b852a287c4e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:05.652215 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5b128202-7f7e-4ff9-9509-5b852a287c4e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:06.095062 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8683ae2f-f010-40ed-95eb-e3d6f5282694 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:06.103595 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8683ae2f-f010-40ed-95eb-e3d6f5282694 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/e9096e2e-d971-4866-ae12-472b3d9909ea" status: 200 len: 1321 microversion: 2.1 time: 0.909236 Oct 17 13:56:06.107896 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2173/4462] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:05 2022] GET /compute/v2.1/servers/e9096e2e-d971-4866-ae12-472b3d9909ea => generated 1321 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:56:06.118537 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5b128202-7f7e-4ff9-9509-5b852a287c4e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:06.133846 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5b128202-7f7e-4ff9-9509-5b852a287c4e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/d3018df0-e202-4fa2-91ad-e9fe210ea9ad" status: 200 len: 1315 microversion: 2.1 time: 0.509163 Oct 17 13:56:06.134562 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2290/4463] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:05 2022] GET /compute/v2.1/servers/d3018df0-e202-4fa2-91ad-e9fe210ea9ad => generated 1315 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:56:06.189292 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ca633362-eba8-4a45-8485-8a3af10a71d5 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:06.190574 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ca633362-eba8-4a45-8485-8a3af10a71d5 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:06.200902 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ca633362-eba8-4a45-8485-8a3af10a71d5 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:06.201392 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ca633362-eba8-4a45-8485-8a3af10a71d5 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:06.201857 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ca633362-eba8-4a45-8485-8a3af10a71d5 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:06.202561 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ca633362-eba8-4a45-8485-8a3af10a71d5 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:06.203010 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ca633362-eba8-4a45-8485-8a3af10a71d5 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:06.209075 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ca633362-eba8-4a45-8485-8a3af10a71d5 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:06.393004 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a93bbd72-ac5a-4f3e-ab5a-c53e57ab7656 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:06.393763 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a93bbd72-ac5a-4f3e-ab5a-c53e57ab7656 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] [instance: 77db743f-e8aa-4d5b-abf3-394df55824e9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:06.428089 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a93bbd72-ac5a-4f3e-ab5a-c53e57ab7656 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:06.435812 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a93bbd72-ac5a-4f3e-ab5a-c53e57ab7656 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:06.436332 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a93bbd72-ac5a-4f3e-ab5a-c53e57ab7656 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:06.441032 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a93bbd72-ac5a-4f3e-ab5a-c53e57ab7656 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:06.445115 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a93bbd72-ac5a-4f3e-ab5a-c53e57ab7656 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:06.445868 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a93bbd72-ac5a-4f3e-ab5a-c53e57ab7656 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:06.505353 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ca633362-eba8-4a45-8485-8a3af10a71d5 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:06.519805 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ca633362-eba8-4a45-8485-8a3af10a71d5 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1662 microversion: 2.1 time: 0.335401 Oct 17 13:56:06.534622 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2174/4464] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:06 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1662 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:06.684688 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a93bbd72-ac5a-4f3e-ab5a-c53e57ab7656 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a07b4d2c6145539910d48178ab6b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ef8cf901924235beeab76a20741180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:06.699092 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a93bbd72-ac5a-4f3e-ab5a-c53e57ab7656 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] 10.222.0.79 "GET /compute/v2.1/servers/77db743f-e8aa-4d5b-abf3-394df55824e9" status: 200 len: 1316 microversion: 2.1 time: 0.310371 Oct 17 13:56:06.699888 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2291/4465] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:06 2022] GET /compute/v2.1/servers/77db743f-e8aa-4d5b-abf3-394df55824e9 => generated 1316 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:56:06.726369 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=10 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:56:07.068388 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-068f6b86-7933-403f-8ae0-56f587a79b28 req-1674004d-ee48-40fa-a91c-adafac8e7855 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3018df0-e202-4fa2-91ad-e9fe210ea9ad", "tag": "32c486f9-d843-4988-9968-efea776471d9"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:56:07.090103 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-068f6b86-7933-403f-8ae0-56f587a79b28 req-1674004d-ee48-40fa-a91c-adafac8e7855 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:07.092828 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-068f6b86-7933-403f-8ae0-56f587a79b28 req-1674004d-ee48-40fa-a91c-adafac8e7855 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:07.094367 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-068f6b86-7933-403f-8ae0-56f587a79b28 req-1674004d-ee48-40fa-a91c-adafac8e7855 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:07.116770 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-068f6b86-7933-403f-8ae0-56f587a79b28 req-1674004d-ee48-40fa-a91c-adafac8e7855 service nova] Creating event network-changed:32c486f9-d843-4988-9968-efea776471d9 for instance d3018df0-e202-4fa2-91ad-e9fe210ea9ad on n-h1-854247-14 Oct 17 13:56:07.137623 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-35a3495d-e598-4f30-ab10-885e09a42186 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:07.139571 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-35a3495d-e598-4f30-ab10-885e09a42186 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: e9096e2e-d971-4866-ae12-472b3d9909ea] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:07.153386 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-068f6b86-7933-403f-8ae0-56f587a79b28 req-1674004d-ee48-40fa-a91c-adafac8e7855 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.405602 Oct 17 13:56:07.154755 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2175/4466] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:56:07.172008 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-35a3495d-e598-4f30-ab10-885e09a42186 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:07.174448 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-35a3495d-e598-4f30-ab10-885e09a42186 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:07.174928 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-35a3495d-e598-4f30-ab10-885e09a42186 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:07.187371 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-35a3495d-e598-4f30-ab10-885e09a42186 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:07.188687 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f1cfaf16-c272-46fb-bfd8-a8a66b4ff7ee tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:07.191279 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f1cfaf16-c272-46fb-bfd8-a8a66b4ff7ee tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: d3018df0-e202-4fa2-91ad-e9fe210ea9ad] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:07.192294 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-35a3495d-e598-4f30-ab10-885e09a42186 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:07.195934 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-35a3495d-e598-4f30-ab10-885e09a42186 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:07.235096 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f1cfaf16-c272-46fb-bfd8-a8a66b4ff7ee tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:07.241485 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f1cfaf16-c272-46fb-bfd8-a8a66b4ff7ee tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:07.244327 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f1cfaf16-c272-46fb-bfd8-a8a66b4ff7ee tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:07.245215 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f1cfaf16-c272-46fb-bfd8-a8a66b4ff7ee tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:07.246457 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f1cfaf16-c272-46fb-bfd8-a8a66b4ff7ee tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:07.246930 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f1cfaf16-c272-46fb-bfd8-a8a66b4ff7ee tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:07.942443 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f1cfaf16-c272-46fb-bfd8-a8a66b4ff7ee tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:07.956029 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f1cfaf16-c272-46fb-bfd8-a8a66b4ff7ee tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/d3018df0-e202-4fa2-91ad-e9fe210ea9ad" status: 200 len: 1315 microversion: 2.1 time: 0.794930 Oct 17 13:56:07.965687 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2176/4467] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:07 2022] GET /compute/v2.1/servers/d3018df0-e202-4fa2-91ad-e9fe210ea9ad => generated 1315 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:07.980169 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c3f23026-eb1f-4ad1-a61c-7ee078ca9fd9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:07.980795 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c3f23026-eb1f-4ad1-a61c-7ee078ca9fd9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:08.003268 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c3f23026-eb1f-4ad1-a61c-7ee078ca9fd9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:08.003770 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c3f23026-eb1f-4ad1-a61c-7ee078ca9fd9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:08.004207 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c3f23026-eb1f-4ad1-a61c-7ee078ca9fd9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:08.004924 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c3f23026-eb1f-4ad1-a61c-7ee078ca9fd9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:08.005397 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c3f23026-eb1f-4ad1-a61c-7ee078ca9fd9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:08.005857 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c3f23026-eb1f-4ad1-a61c-7ee078ca9fd9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:08.030967 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-35a3495d-e598-4f30-ab10-885e09a42186 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:08.042463 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-35a3495d-e598-4f30-ab10-885e09a42186 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/e9096e2e-d971-4866-ae12-472b3d9909ea" status: 200 len: 1321 microversion: 2.1 time: 0.914531 Oct 17 13:56:08.043058 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2292/4468] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:07 2022] GET /compute/v2.1/servers/e9096e2e-d971-4866-ae12-472b3d9909ea => generated 1321 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:08.059655 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0988afa2-a3ed-4ce9-86f9-2dc5ec181d5b tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:08.068095 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0988afa2-a3ed-4ce9-86f9-2dc5ec181d5b tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] [instance: 77db743f-e8aa-4d5b-abf3-394df55824e9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:08.087505 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0988afa2-a3ed-4ce9-86f9-2dc5ec181d5b tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:08.097918 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0988afa2-a3ed-4ce9-86f9-2dc5ec181d5b tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:08.099603 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0988afa2-a3ed-4ce9-86f9-2dc5ec181d5b tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:08.100861 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0988afa2-a3ed-4ce9-86f9-2dc5ec181d5b tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:08.101580 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0988afa2-a3ed-4ce9-86f9-2dc5ec181d5b tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:08.102135 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0988afa2-a3ed-4ce9-86f9-2dc5ec181d5b tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:08.450100 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c3f23026-eb1f-4ad1-a61c-7ee078ca9fd9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:08.469692 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c3f23026-eb1f-4ad1-a61c-7ee078ca9fd9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1666 microversion: 2.1 time: 0.502673 Oct 17 13:56:08.474969 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2177/4469] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:07 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1666 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:08.497697 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b9e7165d-c734-4461-ad97-a1081ca0954d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:08.498322 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b9e7165d-c734-4461-ad97-a1081ca0954d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:08.510315 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b9e7165d-c734-4461-ad97-a1081ca0954d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:08.513343 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b9e7165d-c734-4461-ad97-a1081ca0954d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:08.514089 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b9e7165d-c734-4461-ad97-a1081ca0954d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:08.516060 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b9e7165d-c734-4461-ad97-a1081ca0954d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:08.517952 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b9e7165d-c734-4461-ad97-a1081ca0954d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:08.519696 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b9e7165d-c734-4461-ad97-a1081ca0954d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:08.546358 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0988afa2-a3ed-4ce9-86f9-2dc5ec181d5b tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a07b4d2c6145539910d48178ab6b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ef8cf901924235beeab76a20741180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:08.555962 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0988afa2-a3ed-4ce9-86f9-2dc5ec181d5b tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] 10.222.0.79 "GET /compute/v2.1/servers/77db743f-e8aa-4d5b-abf3-394df55824e9" status: 200 len: 1504 microversion: 2.1 time: 0.505201 Oct 17 13:56:08.584775 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2293/4470] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:08 2022] GET /compute/v2.1/servers/77db743f-e8aa-4d5b-abf3-394df55824e9 => generated 1504 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:08.603367 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1f099b9a-f761-4c8b-8194-a088320018c6 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:08.606520 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-1f099b9a-f761-4c8b-8194-a088320018c6 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] [instance: 77db743f-e8aa-4d5b-abf3-394df55824e9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:08.626758 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1f099b9a-f761-4c8b-8194-a088320018c6 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:08.629141 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1f099b9a-f761-4c8b-8194-a088320018c6 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:08.635549 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1f099b9a-f761-4c8b-8194-a088320018c6 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:08.636505 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1f099b9a-f761-4c8b-8194-a088320018c6 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:08.639198 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1f099b9a-f761-4c8b-8194-a088320018c6 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:08.644039 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1f099b9a-f761-4c8b-8194-a088320018c6 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:08.770614 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b9e7165d-c734-4461-ad97-a1081ca0954d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:08.782491 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b9e7165d-c734-4461-ad97-a1081ca0954d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1666 microversion: 2.1 time: 0.289426 Oct 17 13:56:08.783189 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2178/4471] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:08 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1666 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:56:08.807063 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-694365cb-b251-448b-a576-050d1b0036d9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:56:08.807493 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-694365cb-b251-448b-a576-050d1b0036d9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:08.820156 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-694365cb-b251-448b-a576-050d1b0036d9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:08.820720 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-694365cb-b251-448b-a576-050d1b0036d9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:08.821165 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-694365cb-b251-448b-a576-050d1b0036d9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:08.821874 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-694365cb-b251-448b-a576-050d1b0036d9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:08.822321 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-694365cb-b251-448b-a576-050d1b0036d9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:08.822734 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-694365cb-b251-448b-a576-050d1b0036d9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:08.831080 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1f099b9a-f761-4c8b-8194-a088320018c6 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] 10.222.0.79 "DELETE /compute/v2.1/servers/77db743f-e8aa-4d5b-abf3-394df55824e9/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.242014 Oct 17 13:56:08.833132 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2294/4472] 10.222.0.79 () {58 vars in 1296 bytes} [Mon Oct 17 13:56:08 2022] DELETE /compute/v2.1/servers/77db743f-e8aa-4d5b-abf3-394df55824e9/os-server-password => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:56:08.844977 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cc62dfc7-cefd-4a89-906c-ea350c7adf85 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:08.845688 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cc62dfc7-cefd-4a89-906c-ea350c7adf85 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] [instance: 77db743f-e8aa-4d5b-abf3-394df55824e9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:08.855432 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cc62dfc7-cefd-4a89-906c-ea350c7adf85 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:08.856313 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cc62dfc7-cefd-4a89-906c-ea350c7adf85 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:08.857048 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cc62dfc7-cefd-4a89-906c-ea350c7adf85 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:08.857913 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cc62dfc7-cefd-4a89-906c-ea350c7adf85 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:08.858813 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cc62dfc7-cefd-4a89-906c-ea350c7adf85 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:08.859437 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cc62dfc7-cefd-4a89-906c-ea350c7adf85 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:08.891588 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cc62dfc7-cefd-4a89-906c-ea350c7adf85 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] 10.222.0.79 "GET /compute/v2.1/servers/77db743f-e8aa-4d5b-abf3-394df55824e9/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.051992 Oct 17 13:56:08.893237 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2295/4473] 10.222.0.79 () {58 vars in 1293 bytes} [Mon Oct 17 13:56:08 2022] GET /compute/v2.1/servers/77db743f-e8aa-4d5b-abf3-394df55824e9/os-server-password => generated 16 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:56:08.908507 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-446dae29-e994-4bfa-9c1f-91e478a03ba3 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:08.909310 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-446dae29-e994-4bfa-9c1f-91e478a03ba3 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] [instance: 77db743f-e8aa-4d5b-abf3-394df55824e9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:08.919580 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-446dae29-e994-4bfa-9c1f-91e478a03ba3 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:08.920562 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-446dae29-e994-4bfa-9c1f-91e478a03ba3 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:08.921336 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-446dae29-e994-4bfa-9c1f-91e478a03ba3 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:08.922868 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-446dae29-e994-4bfa-9c1f-91e478a03ba3 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:08.923892 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-446dae29-e994-4bfa-9c1f-91e478a03ba3 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:08.924531 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-446dae29-e994-4bfa-9c1f-91e478a03ba3 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:08.934183 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-694365cb-b251-448b-a576-050d1b0036d9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Unlocking {{(pid=127017) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 17 13:56:08.989174 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-446dae29-e994-4bfa-9c1f-91e478a03ba3 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] [instance: 77db743f-e8aa-4d5b-abf3-394df55824e9] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:56:09.051336 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-694365cb-b251-448b-a576-050d1b0036d9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "POST /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d/action" status: 202 len: 0 microversion: 2.1 time: 0.248170 Oct 17 13:56:09.053073 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2179/4474] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:56:08 2022] POST /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:56:09.064927 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ff8d9a6a-199e-4ebf-9128-6cbb99e75394 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:09.066820 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ff8d9a6a-199e-4ebf-9128-6cbb99e75394 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: d3018df0-e202-4fa2-91ad-e9fe210ea9ad] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:09.079226 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:56:09.084052 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ff8d9a6a-199e-4ebf-9128-6cbb99e75394 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:09.086140 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ff8d9a6a-199e-4ebf-9128-6cbb99e75394 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:09.086888 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ff8d9a6a-199e-4ebf-9128-6cbb99e75394 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:09.091676 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ff8d9a6a-199e-4ebf-9128-6cbb99e75394 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:09.092702 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ff8d9a6a-199e-4ebf-9128-6cbb99e75394 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:09.093518 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ff8d9a6a-199e-4ebf-9128-6cbb99e75394 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:09.210240 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-446dae29-e994-4bfa-9c1f-91e478a03ba3 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] 10.222.0.79 "DELETE /compute/v2.1/servers/77db743f-e8aa-4d5b-abf3-394df55824e9" status: 204 len: 0 microversion: 2.1 time: 0.308755 Oct 17 13:56:09.212447 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2296/4475] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:56:08 2022] DELETE /compute/v2.1/servers/77db743f-e8aa-4d5b-abf3-394df55824e9 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:56:09.221966 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e33fbf4b-3f85-4e53-b1e7-977e3b8a1b97 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:09.224541 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e33fbf4b-3f85-4e53-b1e7-977e3b8a1b97 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:09.237916 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e33fbf4b-3f85-4e53-b1e7-977e3b8a1b97 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:09.241564 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e33fbf4b-3f85-4e53-b1e7-977e3b8a1b97 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:09.242228 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e33fbf4b-3f85-4e53-b1e7-977e3b8a1b97 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:09.245125 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e33fbf4b-3f85-4e53-b1e7-977e3b8a1b97 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:09.245780 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e33fbf4b-3f85-4e53-b1e7-977e3b8a1b97 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:09.248500 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e33fbf4b-3f85-4e53-b1e7-977e3b8a1b97 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:09.494725 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e33fbf4b-3f85-4e53-b1e7-977e3b8a1b97 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:09.506984 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e33fbf4b-3f85-4e53-b1e7-977e3b8a1b97 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1666 microversion: 2.1 time: 0.291883 Oct 17 13:56:09.509306 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2297/4476] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:09 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1666 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:09.529273 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-dc443626-979c-4015-8268-a34ca8209142 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:09.530043 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-dc443626-979c-4015-8268-a34ca8209142 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: e9096e2e-d971-4866-ae12-472b3d9909ea] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:09.544103 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc443626-979c-4015-8268-a34ca8209142 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:09.545514 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc443626-979c-4015-8268-a34ca8209142 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:09.545949 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc443626-979c-4015-8268-a34ca8209142 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:09.550279 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc443626-979c-4015-8268-a34ca8209142 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:09.553190 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc443626-979c-4015-8268-a34ca8209142 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:09.553190 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc443626-979c-4015-8268-a34ca8209142 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:09.581068 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ff8d9a6a-199e-4ebf-9128-6cbb99e75394 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:09.597220 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ff8d9a6a-199e-4ebf-9128-6cbb99e75394 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/d3018df0-e202-4fa2-91ad-e9fe210ea9ad" status: 200 len: 1315 microversion: 2.1 time: 0.537053 Oct 17 13:56:09.598969 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2180/4477] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:09 2022] GET /compute/v2.1/servers/d3018df0-e202-4fa2-91ad-e9fe210ea9ad => generated 1315 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:09.615572 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7defb5ed-f147-4f60-8cd9-9e2be1247b8b tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:09.617756 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7defb5ed-f147-4f60-8cd9-9e2be1247b8b tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] [instance: 77db743f-e8aa-4d5b-abf3-394df55824e9] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:09.638893 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7defb5ed-f147-4f60-8cd9-9e2be1247b8b tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:09.641051 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7defb5ed-f147-4f60-8cd9-9e2be1247b8b tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:09.642354 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7defb5ed-f147-4f60-8cd9-9e2be1247b8b tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:09.645022 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7defb5ed-f147-4f60-8cd9-9e2be1247b8b tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:09.646035 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7defb5ed-f147-4f60-8cd9-9e2be1247b8b tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:09.649126 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7defb5ed-f147-4f60-8cd9-9e2be1247b8b tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:09.846335 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-dc443626-979c-4015-8268-a34ca8209142 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:09.854462 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-dc443626-979c-4015-8268-a34ca8209142 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/e9096e2e-d971-4866-ae12-472b3d9909ea" status: 200 len: 1321 microversion: 2.1 time: 0.344085 Oct 17 13:56:09.872313 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2298/4478] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:09 2022] GET /compute/v2.1/servers/e9096e2e-d971-4866-ae12-472b3d9909ea => generated 1321 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:09.881001 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-700faed2-2746-4911-86ba-af11453f0920 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:09.881845 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-700faed2-2746-4911-86ba-af11453f0920 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:09.888462 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-700faed2-2746-4911-86ba-af11453f0920 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:09.889275 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-700faed2-2746-4911-86ba-af11453f0920 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:09.889911 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-700faed2-2746-4911-86ba-af11453f0920 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:09.890969 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-700faed2-2746-4911-86ba-af11453f0920 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:09.892387 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-700faed2-2746-4911-86ba-af11453f0920 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:09.893001 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-700faed2-2746-4911-86ba-af11453f0920 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:09.959934 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7defb5ed-f147-4f60-8cd9-9e2be1247b8b tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a07b4d2c6145539910d48178ab6b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ef8cf901924235beeab76a20741180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:09.973249 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7defb5ed-f147-4f60-8cd9-9e2be1247b8b tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] 10.222.0.79 "GET /compute/v2.1/servers/77db743f-e8aa-4d5b-abf3-394df55824e9" status: 200 len: 1510 microversion: 2.1 time: 0.368801 Oct 17 13:56:09.975389 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2181/4479] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:09 2022] GET /compute/v2.1/servers/77db743f-e8aa-4d5b-abf3-394df55824e9 => generated 1510 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:10.097425 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-700faed2-2746-4911-86ba-af11453f0920 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:10.128283 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-700faed2-2746-4911-86ba-af11453f0920 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1666 microversion: 2.1 time: 0.254625 Oct 17 13:56:10.156742 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-396de788-5adb-4173-8b51-183c48710705 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:10.157363 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-396de788-5adb-4173-8b51-183c48710705 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:10.162270 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2299/4480] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:09 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1666 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:10.169498 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-396de788-5adb-4173-8b51-183c48710705 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:10.170024 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-396de788-5adb-4173-8b51-183c48710705 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:10.170472 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-396de788-5adb-4173-8b51-183c48710705 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:10.171285 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-396de788-5adb-4173-8b51-183c48710705 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:10.171686 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-396de788-5adb-4173-8b51-183c48710705 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:10.172111 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-396de788-5adb-4173-8b51-183c48710705 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:10.388047 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-396de788-5adb-4173-8b51-183c48710705 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:10.402232 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-396de788-5adb-4173-8b51-183c48710705 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1666 microversion: 2.1 time: 0.249972 Oct 17 13:56:10.403464 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2182/4481] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:10 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1666 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:10.428291 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-34791424-15c0-4cad-935c-37297d7e1561 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:56:10.429134 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-34791424-15c0-4cad-935c-37297d7e1561 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:10.441340 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=6 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:56:10.444679 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-34791424-15c0-4cad-935c-37297d7e1561 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:10.446255 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-34791424-15c0-4cad-935c-37297d7e1561 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:10.446703 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-34791424-15c0-4cad-935c-37297d7e1561 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:10.447456 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-34791424-15c0-4cad-935c-37297d7e1561 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:10.451347 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-34791424-15c0-4cad-935c-37297d7e1561 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:10.453977 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-34791424-15c0-4cad-935c-37297d7e1561 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:10.549956 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:56:10.587011 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-34791424-15c0-4cad-935c-37297d7e1561 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "POST /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d/action" status: 202 len: 0 microversion: 2.1 time: 0.162783 Oct 17 13:56:10.602741 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-53b8b760-2a27-4019-b319-c96e911d253b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:10.607887 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-53b8b760-2a27-4019-b319-c96e911d253b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:10.619382 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2300/4482] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:56:10 2022] POST /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:56:10.627500 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-53b8b760-2a27-4019-b319-c96e911d253b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:10.632490 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-53b8b760-2a27-4019-b319-c96e911d253b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:10.634692 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-53b8b760-2a27-4019-b319-c96e911d253b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:10.636700 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-53b8b760-2a27-4019-b319-c96e911d253b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:10.639514 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-53b8b760-2a27-4019-b319-c96e911d253b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:10.640655 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c02cc54f-b06e-4b6b-b6fe-bc5759ceb632 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:10.641189 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-53b8b760-2a27-4019-b319-c96e911d253b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:10.643849 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c02cc54f-b06e-4b6b-b6fe-bc5759ceb632 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: d3018df0-e202-4fa2-91ad-e9fe210ea9ad] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:10.660190 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c02cc54f-b06e-4b6b-b6fe-bc5759ceb632 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:10.661088 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c02cc54f-b06e-4b6b-b6fe-bc5759ceb632 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:10.663143 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c02cc54f-b06e-4b6b-b6fe-bc5759ceb632 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:10.669454 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c02cc54f-b06e-4b6b-b6fe-bc5759ceb632 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:10.670168 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c02cc54f-b06e-4b6b-b6fe-bc5759ceb632 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:10.673960 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c02cc54f-b06e-4b6b-b6fe-bc5759ceb632 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:10.912125 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=22 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:56:11.331354 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-53b8b760-2a27-4019-b319-c96e911d253b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:11.338156 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:56:11.345018 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-53b8b760-2a27-4019-b319-c96e911d253b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1671 microversion: 2.1 time: 0.750245 Oct 17 13:56:11.355224 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2183/4483] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:10 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1671 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:11.355224 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8900b8a2-c92b-4d33-9959-3392773ae397 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:11.359620 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8900b8a2-c92b-4d33-9959-3392773ae397 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: e9096e2e-d971-4866-ae12-472b3d9909ea] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:11.369273 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8900b8a2-c92b-4d33-9959-3392773ae397 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:11.371674 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8900b8a2-c92b-4d33-9959-3392773ae397 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:11.377773 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8900b8a2-c92b-4d33-9959-3392773ae397 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:11.378949 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8900b8a2-c92b-4d33-9959-3392773ae397 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:11.384414 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c02cc54f-b06e-4b6b-b6fe-bc5759ceb632 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:11.388779 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8900b8a2-c92b-4d33-9959-3392773ae397 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:11.393584 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c02cc54f-b06e-4b6b-b6fe-bc5759ceb632 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/d3018df0-e202-4fa2-91ad-e9fe210ea9ad" status: 200 len: 1315 microversion: 2.1 time: 0.770713 Oct 17 13:56:11.394321 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8900b8a2-c92b-4d33-9959-3392773ae397 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:11.402610 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2301/4484] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:10 2022] GET /compute/v2.1/servers/d3018df0-e202-4fa2-91ad-e9fe210ea9ad => generated 1315 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:11.415544 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-43a264fa-7a23-4daa-958d-9321a4fe5165 req-0b501796-0a5c-4f9c-8ad1-cc1618c666bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9096e2e-d971-4866-ae12-472b3d9909ea", "name": "network-vif-plugged", "status": "completed", "tag": "3a28c114-5ce8-4a21-8122-28774d8eeb48"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:56:11.458603 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-43a264fa-7a23-4daa-958d-9321a4fe5165 req-0b501796-0a5c-4f9c-8ad1-cc1618c666bc service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:11.459257 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-43a264fa-7a23-4daa-958d-9321a4fe5165 req-0b501796-0a5c-4f9c-8ad1-cc1618c666bc service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:11.459541 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-43a264fa-7a23-4daa-958d-9321a4fe5165 req-0b501796-0a5c-4f9c-8ad1-cc1618c666bc service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:11.519285 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-43a264fa-7a23-4daa-958d-9321a4fe5165 req-0b501796-0a5c-4f9c-8ad1-cc1618c666bc service nova] Creating event network-vif-plugged:3a28c114-5ce8-4a21-8122-28774d8eeb48 for instance e9096e2e-d971-4866-ae12-472b3d9909ea on n-h2-854247-14 Oct 17 13:56:11.537597 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-43a264fa-7a23-4daa-958d-9321a4fe5165 req-0b501796-0a5c-4f9c-8ad1-cc1618c666bc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133431 Oct 17 13:56:11.540416 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2302/4485] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:56:11.546089 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-168ae34e-d314-4a11-b777-b76c4442f05e tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:11.556030 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-168ae34e-d314-4a11-b777-b76c4442f05e tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] [instance: 77db743f-e8aa-4d5b-abf3-394df55824e9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:11.570916 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-168ae34e-d314-4a11-b777-b76c4442f05e tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:11.576042 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-168ae34e-d314-4a11-b777-b76c4442f05e tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:11.576685 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-168ae34e-d314-4a11-b777-b76c4442f05e tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:11.577570 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-168ae34e-d314-4a11-b777-b76c4442f05e tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:11.578172 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-168ae34e-d314-4a11-b777-b76c4442f05e tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:11.578741 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-168ae34e-d314-4a11-b777-b76c4442f05e tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:11.848658 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8900b8a2-c92b-4d33-9959-3392773ae397 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:11.863666 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8900b8a2-c92b-4d33-9959-3392773ae397 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/e9096e2e-d971-4866-ae12-472b3d9909ea" status: 200 len: 1321 microversion: 2.1 time: 0.516632 Oct 17 13:56:11.871686 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2184/4486] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:11 2022] GET /compute/v2.1/servers/e9096e2e-d971-4866-ae12-472b3d9909ea => generated 1321 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:12.034993 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-168ae34e-d314-4a11-b777-b76c4442f05e tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a07b4d2c6145539910d48178ab6b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ef8cf901924235beeab76a20741180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:12.047945 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-168ae34e-d314-4a11-b777-b76c4442f05e tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] 10.222.0.79 "GET /compute/v2.1/servers/77db743f-e8aa-4d5b-abf3-394df55824e9" status: 200 len: 1510 microversion: 2.1 time: 0.506075 Oct 17 13:56:12.048780 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2303/4487] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:11 2022] GET /compute/v2.1/servers/77db743f-e8aa-4d5b-abf3-394df55824e9 => generated 1510 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:12.346454 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-aefc3ffc-3d44-4472-92ab-0f4672cb7161 req-29ba1e72-d494-4965-91bd-44dc29107ddb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77db743f-e8aa-4d5b-abf3-394df55824e9", "name": "network-vif-deleted", "tag": "4ccf1ed7-bb9d-464d-a737-8e9673812233"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:56:12.364989 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-aefc3ffc-3d44-4472-92ab-0f4672cb7161 req-29ba1e72-d494-4965-91bd-44dc29107ddb service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:12.372803 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-539521b2-ec6b-47a2-977a-a12199216387 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:12.373456 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-539521b2-ec6b-47a2-977a-a12199216387 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:12.376877 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-aefc3ffc-3d44-4472-92ab-0f4672cb7161 req-29ba1e72-d494-4965-91bd-44dc29107ddb service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:12.382205 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-aefc3ffc-3d44-4472-92ab-0f4672cb7161 req-29ba1e72-d494-4965-91bd-44dc29107ddb service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:12.392832 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-539521b2-ec6b-47a2-977a-a12199216387 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:12.394209 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-539521b2-ec6b-47a2-977a-a12199216387 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:12.396094 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-539521b2-ec6b-47a2-977a-a12199216387 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:12.399836 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-539521b2-ec6b-47a2-977a-a12199216387 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:12.400493 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-539521b2-ec6b-47a2-977a-a12199216387 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:12.403951 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-539521b2-ec6b-47a2-977a-a12199216387 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:12.422221 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-aefc3ffc-3d44-4472-92ab-0f4672cb7161 req-29ba1e72-d494-4965-91bd-44dc29107ddb service nova] Creating event network-vif-deleted:4ccf1ed7-bb9d-464d-a737-8e9673812233 for instance 77db743f-e8aa-4d5b-abf3-394df55824e9 on n-h1-854247-14 Oct 17 13:56:12.452603 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-aefc3ffc-3d44-4472-92ab-0f4672cb7161 req-29ba1e72-d494-4965-91bd-44dc29107ddb service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107356 Oct 17 13:56:12.453638 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2185/4488] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:56:12.472853 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6dd8bed3-8ef7-427a-81dc-9f72026d5c8e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:12.473910 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6dd8bed3-8ef7-427a-81dc-9f72026d5c8e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: d3018df0-e202-4fa2-91ad-e9fe210ea9ad] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:12.493879 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6dd8bed3-8ef7-427a-81dc-9f72026d5c8e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:12.500896 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6dd8bed3-8ef7-427a-81dc-9f72026d5c8e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:12.501561 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6dd8bed3-8ef7-427a-81dc-9f72026d5c8e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:12.503326 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6dd8bed3-8ef7-427a-81dc-9f72026d5c8e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:12.510082 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6dd8bed3-8ef7-427a-81dc-9f72026d5c8e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:12.510798 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6dd8bed3-8ef7-427a-81dc-9f72026d5c8e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:12.819009 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-539521b2-ec6b-47a2-977a-a12199216387 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:12.834750 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-539521b2-ec6b-47a2-977a-a12199216387 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1651 microversion: 2.1 time: 0.466176 Oct 17 13:56:12.835765 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2304/4489] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:12 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1651 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:56:12.862185 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9336abbd-6ad9-4a82-af3e-356b1019f1d0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:56:12.863750 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9336abbd-6ad9-4a82-af3e-356b1019f1d0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:12.871850 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9336abbd-6ad9-4a82-af3e-356b1019f1d0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:12.874324 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9336abbd-6ad9-4a82-af3e-356b1019f1d0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:12.876537 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9336abbd-6ad9-4a82-af3e-356b1019f1d0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:12.882538 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6dd8bed3-8ef7-427a-81dc-9f72026d5c8e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:12.892380 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6dd8bed3-8ef7-427a-81dc-9f72026d5c8e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/d3018df0-e202-4fa2-91ad-e9fe210ea9ad" status: 200 len: 1315 microversion: 2.1 time: 0.437523 Oct 17 13:56:12.892822 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9336abbd-6ad9-4a82-af3e-356b1019f1d0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:12.894989 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9336abbd-6ad9-4a82-af3e-356b1019f1d0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:12.896518 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9336abbd-6ad9-4a82-af3e-356b1019f1d0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:12.901761 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2186/4490] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:12 2022] GET /compute/v2.1/servers/d3018df0-e202-4fa2-91ad-e9fe210ea9ad => generated 1315 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:12.922960 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-208d2680-c533-4a33-bf09-3ed91750fda4 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:12.923850 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-208d2680-c533-4a33-bf09-3ed91750fda4 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: e9096e2e-d971-4866-ae12-472b3d9909ea] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:12.930594 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-208d2680-c533-4a33-bf09-3ed91750fda4 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:12.940189 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-208d2680-c533-4a33-bf09-3ed91750fda4 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:12.940640 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-208d2680-c533-4a33-bf09-3ed91750fda4 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:12.941384 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-208d2680-c533-4a33-bf09-3ed91750fda4 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:12.941849 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-208d2680-c533-4a33-bf09-3ed91750fda4 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:12.942274 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-208d2680-c533-4a33-bf09-3ed91750fda4 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:13.078527 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9336abbd-6ad9-4a82-af3e-356b1019f1d0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "POST /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d/action" status: 202 len: 0 microversion: 2.1 time: 0.219938 Oct 17 13:56:13.083317 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2305/4491] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:56:12 2022] POST /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:56:13.088336 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3763c5b5-7e15-45f9-a90b-767f605850ea tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:13.089429 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3763c5b5-7e15-45f9-a90b-767f605850ea tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] [instance: 77db743f-e8aa-4d5b-abf3-394df55824e9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:13.097937 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3763c5b5-7e15-45f9-a90b-767f605850ea tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:13.098925 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3763c5b5-7e15-45f9-a90b-767f605850ea tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:13.099885 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3763c5b5-7e15-45f9-a90b-767f605850ea tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:13.101620 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3763c5b5-7e15-45f9-a90b-767f605850ea tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:13.102429 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3763c5b5-7e15-45f9-a90b-767f605850ea tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:13.103436 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3763c5b5-7e15-45f9-a90b-767f605850ea tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:13.153640 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3763c5b5-7e15-45f9-a90b-767f605850ea tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:13.155303 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3763c5b5-7e15-45f9-a90b-767f605850ea tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:13.156018 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3763c5b5-7e15-45f9-a90b-767f605850ea tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:13.157019 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-3763c5b5-7e15-45f9-a90b-767f605850ea tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lazy-loading 'fault' on Instance uuid 77db743f-e8aa-4d5b-abf3-394df55824e9 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:56:13.278285 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3763c5b5-7e15-45f9-a90b-767f605850ea tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1a07b4d2c6145539910d48178ab6b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1ef8cf901924235beeab76a20741180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:13.295093 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3763c5b5-7e15-45f9-a90b-767f605850ea tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] 10.222.0.79 "GET /compute/v2.1/servers/77db743f-e8aa-4d5b-abf3-394df55824e9" status: 200 len: 1306 microversion: 2.1 time: 0.212831 Oct 17 13:56:13.296699 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2306/4492] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:13 2022] GET /compute/v2.1/servers/77db743f-e8aa-4d5b-abf3-394df55824e9 => generated 1306 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:13.302983 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-372b4a7b-fb45-4824-b90a-7f70ac2b5b6d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:13.304549 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-372b4a7b-fb45-4824-b90a-7f70ac2b5b6d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:13.322949 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-372b4a7b-fb45-4824-b90a-7f70ac2b5b6d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:13.323353 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-372b4a7b-fb45-4824-b90a-7f70ac2b5b6d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:13.323882 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-372b4a7b-fb45-4824-b90a-7f70ac2b5b6d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:13.324820 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-372b4a7b-fb45-4824-b90a-7f70ac2b5b6d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:13.325909 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-372b4a7b-fb45-4824-b90a-7f70ac2b5b6d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:13.326572 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-372b4a7b-fb45-4824-b90a-7f70ac2b5b6d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:13.346464 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-208d2680-c533-4a33-bf09-3ed91750fda4 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:13.357389 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-208d2680-c533-4a33-bf09-3ed91750fda4 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/e9096e2e-d971-4866-ae12-472b3d9909ea" status: 200 len: 1321 microversion: 2.1 time: 0.454084 Oct 17 13:56:13.359283 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2187/4493] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:12 2022] GET /compute/v2.1/servers/e9096e2e-d971-4866-ae12-472b3d9909ea => generated 1321 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:13.566477 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-cf5ab8ce-2d33-48e7-b134-0277eb865949 req-94e22cf7-4cc6-4c8a-beae-8983fc164516 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3018df0-e202-4fa2-91ad-e9fe210ea9ad", "name": "network-vif-plugged", "status": "completed", "tag": "32c486f9-d843-4988-9968-efea776471d9"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:56:13.588245 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-cf5ab8ce-2d33-48e7-b134-0277eb865949 req-94e22cf7-4cc6-4c8a-beae-8983fc164516 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:13.589120 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-cf5ab8ce-2d33-48e7-b134-0277eb865949 req-94e22cf7-4cc6-4c8a-beae-8983fc164516 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:13.590184 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-cf5ab8ce-2d33-48e7-b134-0277eb865949 req-94e22cf7-4cc6-4c8a-beae-8983fc164516 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:13.592157 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-372b4a7b-fb45-4824-b90a-7f70ac2b5b6d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:13.601013 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-372b4a7b-fb45-4824-b90a-7f70ac2b5b6d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1658 microversion: 2.1 time: 0.302930 Oct 17 13:56:13.601795 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2307/4494] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:13 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1658 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:13.609695 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-cf5ab8ce-2d33-48e7-b134-0277eb865949 req-94e22cf7-4cc6-4c8a-beae-8983fc164516 service nova] Creating event network-vif-plugged:32c486f9-d843-4988-9968-efea776471d9 for instance d3018df0-e202-4fa2-91ad-e9fe210ea9ad on n-h1-854247-14 Oct 17 13:56:13.616160 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-cf5ab8ce-2d33-48e7-b134-0277eb865949 req-94e22cf7-4cc6-4c8a-beae-8983fc164516 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055068 Oct 17 13:56:13.617099 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2188/4495] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:56:13.929300 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-10593b60-f109-4f60-910a-89e94a53a1b9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:13.930908 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-10593b60-f109-4f60-910a-89e94a53a1b9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: d3018df0-e202-4fa2-91ad-e9fe210ea9ad] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:13.938500 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-10593b60-f109-4f60-910a-89e94a53a1b9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:13.939362 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-10593b60-f109-4f60-910a-89e94a53a1b9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:13.939808 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-10593b60-f109-4f60-910a-89e94a53a1b9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:13.940935 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-10593b60-f109-4f60-910a-89e94a53a1b9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:13.941605 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-10593b60-f109-4f60-910a-89e94a53a1b9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:13.942029 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-10593b60-f109-4f60-910a-89e94a53a1b9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:14.108005 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-10593b60-f109-4f60-910a-89e94a53a1b9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:14.116396 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-10593b60-f109-4f60-910a-89e94a53a1b9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/d3018df0-e202-4fa2-91ad-e9fe210ea9ad" status: 200 len: 1315 microversion: 2.1 time: 0.191463 Oct 17 13:56:14.117221 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2308/4496] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:13 2022] GET /compute/v2.1/servers/d3018df0-e202-4fa2-91ad-e9fe210ea9ad => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:14.323091 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-002fe8c0-956a-4637-b69c-42cb82d689b0 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:14.324815 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-002fe8c0-956a-4637-b69c-42cb82d689b0 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] [instance: 77db743f-e8aa-4d5b-abf3-394df55824e9] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:14.334500 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-002fe8c0-956a-4637-b69c-42cb82d689b0 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:14.335369 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-002fe8c0-956a-4637-b69c-42cb82d689b0 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:14.336118 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-002fe8c0-956a-4637-b69c-42cb82d689b0 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:14.337415 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-002fe8c0-956a-4637-b69c-42cb82d689b0 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:14.338256 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-002fe8c0-956a-4637-b69c-42cb82d689b0 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:14.338893 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-002fe8c0-956a-4637-b69c-42cb82d689b0 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:14.360512 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-002fe8c0-956a-4637-b69c-42cb82d689b0 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] HTTP exception thrown: Instance 77db743f-e8aa-4d5b-abf3-394df55824e9 could not be found. Oct 17 13:56:14.360512 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-002fe8c0-956a-4637-b69c-42cb82d689b0 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Request method failure captured: Oct 17 13:56:14.360512 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/77db743f-e8aa-4d5b-abf3-394df55824e9 HTTP/1.1 Oct 17 13:56:14.360512 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:56:14.360512 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:56:14.360512 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:56:14.360512 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:56:14.360512 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:56:14.360512 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:56:14.360512 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:56:14.360512 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:56:14.360512 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTV7kburcZym62atEX4F_kSPnFHTpvpWqpWc3OO94PFI_M0BGg8dB1DFMHJoFm4YeNtqYvGXKueUxjRQpB1g3b_7T2XRwUfL88cmonpmknArC9LfGEpuDOCx0qn3n3zWB-D_IDSVfw10fBHoeoCKoww_ZBmjMTTLFOsAUv4qffOFTNAA Oct 17 13:56:14.360512 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:56:14.360512 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:56:14.360512 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:56:14.360512 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:56:14.360512 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:56:14.360512 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:56:14.360512 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: e1ef8cf901924235beeab76a20741180 Oct 17 13:56:14.360512 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServerPasswordTestJSON-1911989532 Oct 17 13:56:14.360512 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:56:14.360512 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:56:14.360512 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e1ef8cf901924235beeab76a20741180"}]}, {"type": "tempest-type-757843761", "name": "tempest-service-527072566", "endpoints": [{"region": "tempest-region-1530587473", "publicURL": "https://url-594098419.com"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/e1ef8cf901924235beeab76a20741180"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "tempest-type-1549021290", "name": "tempest-service-1797883724", "endpoints": [{"region": "tempest-region-85075699", "internalURL": "https://url-259507820.com"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e1ef8cf901924235beeab76a20741180"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_e1ef8cf901924235beeab76a20741180", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:56:14.360512 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServerPasswordTestJSON-1911989532 Oct 17 13:56:14.360512 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: e1ef8cf901924235beeab76a20741180 Oct 17 13:56:14.360512 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1911989532 Oct 17 13:56:14.360512 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServerPasswordTestJSON-1911989532-project Oct 17 13:56:14.360512 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:56:14.360512 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:56:14.360512 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: e1a07b4d2c6145539910d48178ab6b0d Oct 17 13:56:14.360512 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServerPasswordTestJSON-1911989532-project Oct 17 13:56:14.360512 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:56:14.360512 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 77db743f-e8aa-4d5b-abf3-394df55824e9 could not be found. Oct 17 13:56:14.360512 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '77db743f-e8aa-4d5b-abf3-394df55824e9'} Oct 17 13:56:14.360512 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:56:14.360512 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:56:14.360512 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:56:14.360512 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:56:14.360512 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:56:14.360512 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:56:14.360512 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:56:14.360512 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:56:14.360512 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:56:14.360512 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:56:14.360512 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77db743f-e8aa-4d5b-abf3-394df55824e9 could not be found. Oct 17 13:56:14.360512 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:56:14.360512 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:56:14.360512 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:56:14.360512 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:56:14.360512 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:56:14.360512 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:56:14.360512 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:56:14.360512 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:56:14.360512 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:56:14.360512 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:56:14.360512 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:56:14.360512 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:56:14.360512 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:56:14.364198 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:56:14.364198 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:56:14.364198 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:56:14.364198 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77db743f-e8aa-4d5b-abf3-394df55824e9 could not be found. Oct 17 13:56:14.364198 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:56:14.364198 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:56:14.364198 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:56:14.364198 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:56:14.364198 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:56:14.364198 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:56:14.364198 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:56:14.364198 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:56:14.364198 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77db743f-e8aa-4d5b-abf3-394df55824e9 could not be found. Oct 17 13:56:14.364198 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:56:14.364198 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-002fe8c0-956a-4637-b69c-42cb82d689b0 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] Returning 404 to user: Instance 77db743f-e8aa-4d5b-abf3-394df55824e9 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:56:14.364198 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-002fe8c0-956a-4637-b69c-42cb82d689b0 tempest-ServerPasswordTestJSON-1911989532 tempest-ServerPasswordTestJSON-1911989532-project] 10.222.0.79 "GET /compute/v2.1/servers/77db743f-e8aa-4d5b-abf3-394df55824e9" status: 404 len: 111 microversion: 2.1 time: 0.040031 Oct 17 13:56:14.364198 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2189/4497] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:14 2022] GET /compute/v2.1/servers/77db743f-e8aa-4d5b-abf3-394df55824e9 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:56:14.384334 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9e046654-aa08-45ae-a2aa-a8980a5ff42f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:14.384334 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9e046654-aa08-45ae-a2aa-a8980a5ff42f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: e9096e2e-d971-4866-ae12-472b3d9909ea] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:14.390370 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9e046654-aa08-45ae-a2aa-a8980a5ff42f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:14.390858 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9e046654-aa08-45ae-a2aa-a8980a5ff42f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:14.391398 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9e046654-aa08-45ae-a2aa-a8980a5ff42f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:14.392032 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9e046654-aa08-45ae-a2aa-a8980a5ff42f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:14.392484 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9e046654-aa08-45ae-a2aa-a8980a5ff42f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:14.392904 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9e046654-aa08-45ae-a2aa-a8980a5ff42f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:14.627774 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a3be0016-9fe2-47c5-acfb-086cfd2acab3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:14.628608 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a3be0016-9fe2-47c5-acfb-086cfd2acab3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:14.643302 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a3be0016-9fe2-47c5-acfb-086cfd2acab3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:14.645473 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a3be0016-9fe2-47c5-acfb-086cfd2acab3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:14.646104 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a3be0016-9fe2-47c5-acfb-086cfd2acab3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:14.646939 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a3be0016-9fe2-47c5-acfb-086cfd2acab3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:14.647423 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a3be0016-9fe2-47c5-acfb-086cfd2acab3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:14.652059 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a3be0016-9fe2-47c5-acfb-086cfd2acab3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:14.733217 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9e046654-aa08-45ae-a2aa-a8980a5ff42f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:14.744711 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9e046654-aa08-45ae-a2aa-a8980a5ff42f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/e9096e2e-d971-4866-ae12-472b3d9909ea" status: 200 len: 1502 microversion: 2.1 time: 0.366492 Oct 17 13:56:14.745262 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2309/4498] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:14 2022] GET /compute/v2.1/servers/e9096e2e-d971-4866-ae12-472b3d9909ea => generated 1502 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:14.768090 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cf5f66b9-7cc9-4a62-a02e-7af2fb3e052d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:14.769047 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cf5f66b9-7cc9-4a62-a02e-7af2fb3e052d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: e9096e2e-d971-4866-ae12-472b3d9909ea] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:14.776097 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cf5f66b9-7cc9-4a62-a02e-7af2fb3e052d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:14.776914 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cf5f66b9-7cc9-4a62-a02e-7af2fb3e052d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:14.777628 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cf5f66b9-7cc9-4a62-a02e-7af2fb3e052d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:14.778470 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cf5f66b9-7cc9-4a62-a02e-7af2fb3e052d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:14.779020 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cf5f66b9-7cc9-4a62-a02e-7af2fb3e052d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:14.779822 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cf5f66b9-7cc9-4a62-a02e-7af2fb3e052d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:15.094660 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a3be0016-9fe2-47c5-acfb-086cfd2acab3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:15.111907 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a3be0016-9fe2-47c5-acfb-086cfd2acab3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1666 microversion: 2.1 time: 0.488138 Oct 17 13:56:15.115976 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cf5f66b9-7cc9-4a62-a02e-7af2fb3e052d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:15.116502 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2190/4499] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:14 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1666 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:56:15.130324 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cf5f66b9-7cc9-4a62-a02e-7af2fb3e052d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/e9096e2e-d971-4866-ae12-472b3d9909ea" status: 200 len: 1502 microversion: 2.1 time: 0.364561 Oct 17 13:56:15.132436 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2310/4500] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:14 2022] GET /compute/v2.1/servers/e9096e2e-d971-4866-ae12-472b3d9909ea => generated 1502 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:15.139188 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d751331a-3be5-4e0e-8277-1e1fc0b70918 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:15.141893 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d751331a-3be5-4e0e-8277-1e1fc0b70918 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:15.143461 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f49ca872-19bb-4505-aaa8-c2936d68c326 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:15.144021 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f49ca872-19bb-4505-aaa8-c2936d68c326 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: d3018df0-e202-4fa2-91ad-e9fe210ea9ad] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:15.157605 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f49ca872-19bb-4505-aaa8-c2936d68c326 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:15.158103 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f49ca872-19bb-4505-aaa8-c2936d68c326 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:15.158541 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f49ca872-19bb-4505-aaa8-c2936d68c326 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:15.159280 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f49ca872-19bb-4505-aaa8-c2936d68c326 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:15.159735 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f49ca872-19bb-4505-aaa8-c2936d68c326 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:15.160156 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f49ca872-19bb-4505-aaa8-c2936d68c326 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:15.160585 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d751331a-3be5-4e0e-8277-1e1fc0b70918 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:15.166284 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d751331a-3be5-4e0e-8277-1e1fc0b70918 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:15.168317 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d751331a-3be5-4e0e-8277-1e1fc0b70918 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:15.169763 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d751331a-3be5-4e0e-8277-1e1fc0b70918 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:15.172119 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d751331a-3be5-4e0e-8277-1e1fc0b70918 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:15.173336 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d751331a-3be5-4e0e-8277-1e1fc0b70918 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:15.540389 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f49ca872-19bb-4505-aaa8-c2936d68c326 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:15.551996 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f49ca872-19bb-4505-aaa8-c2936d68c326 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/d3018df0-e202-4fa2-91ad-e9fe210ea9ad" status: 200 len: 1502 microversion: 2.1 time: 0.414701 Oct 17 13:56:15.574639 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2311/4501] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:15 2022] GET /compute/v2.1/servers/d3018df0-e202-4fa2-91ad-e9fe210ea9ad => generated 1502 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:15.582391 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-53b8c159-c24d-4e1b-8042-e205bce29340 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:15.585294 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-53b8c159-c24d-4e1b-8042-e205bce29340 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: e9096e2e-d971-4866-ae12-472b3d9909ea] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:15.601772 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-53b8c159-c24d-4e1b-8042-e205bce29340 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:15.605873 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-53b8c159-c24d-4e1b-8042-e205bce29340 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:15.607443 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-53b8c159-c24d-4e1b-8042-e205bce29340 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:15.609469 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-53b8c159-c24d-4e1b-8042-e205bce29340 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:15.611006 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-53b8c159-c24d-4e1b-8042-e205bce29340 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:15.611855 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-53b8c159-c24d-4e1b-8042-e205bce29340 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:15.684763 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-53b8c159-c24d-4e1b-8042-e205bce29340 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: e9096e2e-d971-4866-ae12-472b3d9909ea] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:56:15.872111 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-53b8c159-c24d-4e1b-8042-e205bce29340 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "DELETE /compute/v2.1/servers/e9096e2e-d971-4866-ae12-472b3d9909ea" status: 204 len: 0 microversion: 2.1 time: 0.295178 Oct 17 13:56:15.873263 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2312/4502] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:56:15 2022] DELETE /compute/v2.1/servers/e9096e2e-d971-4866-ae12-472b3d9909ea => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:56:15.884717 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f8ecf3f2-293f-4e44-b41f-1f26d09b0c2f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:15.889109 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f8ecf3f2-293f-4e44-b41f-1f26d09b0c2f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: d3018df0-e202-4fa2-91ad-e9fe210ea9ad] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:15.905249 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f8ecf3f2-293f-4e44-b41f-1f26d09b0c2f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:15.906109 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f8ecf3f2-293f-4e44-b41f-1f26d09b0c2f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:15.912349 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f8ecf3f2-293f-4e44-b41f-1f26d09b0c2f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:15.914944 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f8ecf3f2-293f-4e44-b41f-1f26d09b0c2f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:15.915958 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f8ecf3f2-293f-4e44-b41f-1f26d09b0c2f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:15.917386 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f8ecf3f2-293f-4e44-b41f-1f26d09b0c2f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:15.978345 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f8ecf3f2-293f-4e44-b41f-1f26d09b0c2f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: d3018df0-e202-4fa2-91ad-e9fe210ea9ad] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:56:16.022661 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:56:16.194772 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f8ecf3f2-293f-4e44-b41f-1f26d09b0c2f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "DELETE /compute/v2.1/servers/d3018df0-e202-4fa2-91ad-e9fe210ea9ad" status: 204 len: 0 microversion: 2.1 time: 0.318050 Oct 17 13:56:16.200512 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2313/4503] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:56:15 2022] DELETE /compute/v2.1/servers/d3018df0-e202-4fa2-91ad-e9fe210ea9ad => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:56:16.206659 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-10f95ed9-a8bb-4db4-a8cb-5191cb0622ff tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:16.208875 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-10f95ed9-a8bb-4db4-a8cb-5191cb0622ff tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: e9096e2e-d971-4866-ae12-472b3d9909ea] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:16.233356 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-10f95ed9-a8bb-4db4-a8cb-5191cb0622ff tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:16.234572 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-10f95ed9-a8bb-4db4-a8cb-5191cb0622ff tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:16.235846 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-10f95ed9-a8bb-4db4-a8cb-5191cb0622ff tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:16.239665 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-10f95ed9-a8bb-4db4-a8cb-5191cb0622ff tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:16.243141 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-10f95ed9-a8bb-4db4-a8cb-5191cb0622ff tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:16.244008 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-10f95ed9-a8bb-4db4-a8cb-5191cb0622ff tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:16.332117 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d751331a-3be5-4e0e-8277-1e1fc0b70918 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:16.348173 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d751331a-3be5-4e0e-8277-1e1fc0b70918 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1666 microversion: 2.1 time: 1.213788 Oct 17 13:56:16.348777 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2191/4504] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:15 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1666 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:16.378388 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9bc7bd6c-64f9-4aad-8d1d-5d226adff258 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:16.388330 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9bc7bd6c-64f9-4aad-8d1d-5d226adff258 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: d3018df0-e202-4fa2-91ad-e9fe210ea9ad] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:16.404424 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9bc7bd6c-64f9-4aad-8d1d-5d226adff258 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:16.405113 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9bc7bd6c-64f9-4aad-8d1d-5d226adff258 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:16.405829 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9bc7bd6c-64f9-4aad-8d1d-5d226adff258 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:16.407574 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9bc7bd6c-64f9-4aad-8d1d-5d226adff258 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:16.410502 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9bc7bd6c-64f9-4aad-8d1d-5d226adff258 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:16.411208 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9bc7bd6c-64f9-4aad-8d1d-5d226adff258 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:16.887900 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-10f95ed9-a8bb-4db4-a8cb-5191cb0622ff tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:16.909035 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-10f95ed9-a8bb-4db4-a8cb-5191cb0622ff tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/e9096e2e-d971-4866-ae12-472b3d9909ea" status: 200 len: 1508 microversion: 2.1 time: 0.706975 Oct 17 13:56:16.909967 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2314/4505] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:16 2022] GET /compute/v2.1/servers/e9096e2e-d971-4866-ae12-472b3d9909ea => generated 1508 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:16.915337 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5a208e1d-ac41-4ba1-a828-8eb9b1e181b0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:16.916294 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5a208e1d-ac41-4ba1-a828-8eb9b1e181b0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:16.928585 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5a208e1d-ac41-4ba1-a828-8eb9b1e181b0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:16.929410 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5a208e1d-ac41-4ba1-a828-8eb9b1e181b0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:16.930091 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5a208e1d-ac41-4ba1-a828-8eb9b1e181b0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:16.933288 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5a208e1d-ac41-4ba1-a828-8eb9b1e181b0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:16.933983 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5a208e1d-ac41-4ba1-a828-8eb9b1e181b0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:16.934963 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5a208e1d-ac41-4ba1-a828-8eb9b1e181b0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:16.992439 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9bc7bd6c-64f9-4aad-8d1d-5d226adff258 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:17.002391 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9bc7bd6c-64f9-4aad-8d1d-5d226adff258 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/d3018df0-e202-4fa2-91ad-e9fe210ea9ad" status: 200 len: 1508 microversion: 2.1 time: 0.641508 Oct 17 13:56:17.002943 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2192/4506] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:16 2022] GET /compute/v2.1/servers/d3018df0-e202-4fa2-91ad-e9fe210ea9ad => generated 1508 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:17.174469 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5a208e1d-ac41-4ba1-a828-8eb9b1e181b0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:17.187283 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5a208e1d-ac41-4ba1-a828-8eb9b1e181b0 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1666 microversion: 2.1 time: 0.275951 Oct 17 13:56:17.188901 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2315/4507] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:16 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1666 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:17.211472 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a736085a-5381-4873-a6c1-4bce32e9775c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:17.212018 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a736085a-5381-4873-a6c1-4bce32e9775c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:17.218859 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a736085a-5381-4873-a6c1-4bce32e9775c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:17.219622 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a736085a-5381-4873-a6c1-4bce32e9775c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:17.220234 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a736085a-5381-4873-a6c1-4bce32e9775c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:17.221167 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a736085a-5381-4873-a6c1-4bce32e9775c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:17.221832 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a736085a-5381-4873-a6c1-4bce32e9775c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:17.222507 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a736085a-5381-4873-a6c1-4bce32e9775c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:17.836997 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a736085a-5381-4873-a6c1-4bce32e9775c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:17.855751 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a736085a-5381-4873-a6c1-4bce32e9775c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1666 microversion: 2.1 time: 0.647021 Oct 17 13:56:17.856243 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2193/4508] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:17 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1666 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:17.887846 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2079c634-491f-4457-b8a8-71a130b0b721 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:17.888739 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2079c634-491f-4457-b8a8-71a130b0b721 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:17.896811 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2079c634-491f-4457-b8a8-71a130b0b721 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:17.897414 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2079c634-491f-4457-b8a8-71a130b0b721 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:17.898106 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2079c634-491f-4457-b8a8-71a130b0b721 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:17.899770 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2079c634-491f-4457-b8a8-71a130b0b721 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:17.900478 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2079c634-491f-4457-b8a8-71a130b0b721 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:17.901509 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2079c634-491f-4457-b8a8-71a130b0b721 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:17.945468 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-dd5e88fd-d5eb-450a-9cbd-b2d3b40561f2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:17.946814 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-dd5e88fd-d5eb-450a-9cbd-b2d3b40561f2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: e9096e2e-d971-4866-ae12-472b3d9909ea] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:17.975564 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dd5e88fd-d5eb-450a-9cbd-b2d3b40561f2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:17.977990 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dd5e88fd-d5eb-450a-9cbd-b2d3b40561f2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:17.978960 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dd5e88fd-d5eb-450a-9cbd-b2d3b40561f2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:17.981423 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dd5e88fd-d5eb-450a-9cbd-b2d3b40561f2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:17.983700 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dd5e88fd-d5eb-450a-9cbd-b2d3b40561f2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:17.984666 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dd5e88fd-d5eb-450a-9cbd-b2d3b40561f2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:18.846633 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2079c634-491f-4457-b8a8-71a130b0b721 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:18.866207 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2079c634-491f-4457-b8a8-71a130b0b721 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1666 microversion: 2.1 time: 0.986382 Oct 17 13:56:18.867227 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2316/4509] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:17 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1666 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:18.888637 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b5b3204a-092b-4bc0-883a-e9c6a01976eb tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:18.893414 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b5b3204a-092b-4bc0-883a-e9c6a01976eb tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: d3018df0-e202-4fa2-91ad-e9fe210ea9ad] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:18.905021 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b5b3204a-092b-4bc0-883a-e9c6a01976eb tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:18.905781 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b5b3204a-092b-4bc0-883a-e9c6a01976eb tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:18.906360 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b5b3204a-092b-4bc0-883a-e9c6a01976eb tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:18.907298 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b5b3204a-092b-4bc0-883a-e9c6a01976eb tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:18.908037 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b5b3204a-092b-4bc0-883a-e9c6a01976eb tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:18.908684 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b5b3204a-092b-4bc0-883a-e9c6a01976eb tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:19.032406 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-dd5e88fd-d5eb-450a-9cbd-b2d3b40561f2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:19.052850 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-dd5e88fd-d5eb-450a-9cbd-b2d3b40561f2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/e9096e2e-d971-4866-ae12-472b3d9909ea" status: 200 len: 1508 microversion: 2.1 time: 1.123456 Oct 17 13:56:19.054838 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2194/4510] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:17 2022] GET /compute/v2.1/servers/e9096e2e-d971-4866-ae12-472b3d9909ea => generated 1508 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:19.065598 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-43f5e0e8-3089-4b2c-9025-5edae6aeb3cd tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:19.070451 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-43f5e0e8-3089-4b2c-9025-5edae6aeb3cd tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:19.124782 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-43f5e0e8-3089-4b2c-9025-5edae6aeb3cd tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:19.126149 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-43f5e0e8-3089-4b2c-9025-5edae6aeb3cd tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:19.126149 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-43f5e0e8-3089-4b2c-9025-5edae6aeb3cd tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:19.126589 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-43f5e0e8-3089-4b2c-9025-5edae6aeb3cd tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:19.136390 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-43f5e0e8-3089-4b2c-9025-5edae6aeb3cd tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:19.137487 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-43f5e0e8-3089-4b2c-9025-5edae6aeb3cd tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:19.696306 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b5b3204a-092b-4bc0-883a-e9c6a01976eb tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:19.720417 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b5b3204a-092b-4bc0-883a-e9c6a01976eb tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/d3018df0-e202-4fa2-91ad-e9fe210ea9ad" status: 200 len: 1508 microversion: 2.1 time: 0.851352 Oct 17 13:56:19.723140 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2317/4511] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:18 2022] GET /compute/v2.1/servers/d3018df0-e202-4fa2-91ad-e9fe210ea9ad => generated 1508 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:19.743231 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-47451e48-8589-452a-a834-91affb245d7e req-8c538c52-7ba6-4a41-8161-44238b5cfd2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3018df0-e202-4fa2-91ad-e9fe210ea9ad", "name": "network-vif-deleted", "tag": "32c486f9-d843-4988-9968-efea776471d9"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:56:19.781623 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-47451e48-8589-452a-a834-91affb245d7e req-8c538c52-7ba6-4a41-8161-44238b5cfd2d service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:19.782844 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-47451e48-8589-452a-a834-91affb245d7e req-8c538c52-7ba6-4a41-8161-44238b5cfd2d service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:19.783327 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-47451e48-8589-452a-a834-91affb245d7e req-8c538c52-7ba6-4a41-8161-44238b5cfd2d service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:19.817310 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-47451e48-8589-452a-a834-91affb245d7e req-8c538c52-7ba6-4a41-8161-44238b5cfd2d service nova] Creating event network-vif-deleted:32c486f9-d843-4988-9968-efea776471d9 for instance d3018df0-e202-4fa2-91ad-e9fe210ea9ad on n-h1-854247-14 Oct 17 13:56:19.831728 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-47451e48-8589-452a-a834-91affb245d7e req-8c538c52-7ba6-4a41-8161-44238b5cfd2d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106547 Oct 17 13:56:19.836734 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2318/4512] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:56:19.901127 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-43f5e0e8-3089-4b2c-9025-5edae6aeb3cd tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:19.911968 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-43f5e0e8-3089-4b2c-9025-5edae6aeb3cd tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1666 microversion: 2.1 time: 0.855734 Oct 17 13:56:19.915987 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2195/4513] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:19 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1666 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:20.083956 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1f8bf563-7058-4d63-aa5d-24ff195de9f7 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:20.084773 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-1f8bf563-7058-4d63-aa5d-24ff195de9f7 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: e9096e2e-d971-4866-ae12-472b3d9909ea] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:20.104598 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1f8bf563-7058-4d63-aa5d-24ff195de9f7 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:20.106498 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1f8bf563-7058-4d63-aa5d-24ff195de9f7 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:20.107764 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1f8bf563-7058-4d63-aa5d-24ff195de9f7 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:20.110150 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1f8bf563-7058-4d63-aa5d-24ff195de9f7 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:20.113792 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1f8bf563-7058-4d63-aa5d-24ff195de9f7 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:20.115944 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1f8bf563-7058-4d63-aa5d-24ff195de9f7 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:20.597277 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-1f8bf563-7058-4d63-aa5d-24ff195de9f7 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:20.610380 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1f8bf563-7058-4d63-aa5d-24ff195de9f7 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/e9096e2e-d971-4866-ae12-472b3d9909ea" status: 200 len: 1306 microversion: 2.1 time: 0.531394 Oct 17 13:56:20.613873 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2319/4514] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:20 2022] GET /compute/v2.1/servers/e9096e2e-d971-4866-ae12-472b3d9909ea => generated 1306 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:20.750162 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-78157f50-4bd2-4637-a82e-f050978a03b5 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:20.750989 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-78157f50-4bd2-4637-a82e-f050978a03b5 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: d3018df0-e202-4fa2-91ad-e9fe210ea9ad] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:20.763782 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-78157f50-4bd2-4637-a82e-f050978a03b5 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:20.765283 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-78157f50-4bd2-4637-a82e-f050978a03b5 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:20.766539 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-78157f50-4bd2-4637-a82e-f050978a03b5 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:20.768646 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-78157f50-4bd2-4637-a82e-f050978a03b5 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:20.781146 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-78157f50-4bd2-4637-a82e-f050978a03b5 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:20.784269 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-78157f50-4bd2-4637-a82e-f050978a03b5 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:20.819717 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-78157f50-4bd2-4637-a82e-f050978a03b5 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] HTTP exception thrown: Instance d3018df0-e202-4fa2-91ad-e9fe210ea9ad could not be found. Oct 17 13:56:20.822000 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-78157f50-4bd2-4637-a82e-f050978a03b5 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Request method failure captured: Oct 17 13:56:20.822000 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/d3018df0-e202-4fa2-91ad-e9fe210ea9ad HTTP/1.1 Oct 17 13:56:20.822000 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:56:20.822000 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:56:20.822000 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:56:20.822000 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:56:20.822000 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:56:20.822000 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:56:20.822000 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:56:20.822000 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:56:20.822000 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTV7tIaoYPgUdHiXX4NOkSSz-a4-puhL4AhnfvtJYmPyZ3fJvZDePMat9BASboFCn4C3QP9Vix9f7JprJ7jGUAeFojqdhpTvVML9HYK6oQI67GVbo4xYwR8dQKhVTSdcdIj_O_mmBimo8N7A_DyW-iY_pgxFAaVGSJ3vOytCqm8fGt3Q Oct 17 13:56:20.822000 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:56:20.822000 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:56:20.822000 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:56:20.822000 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:56:20.822000 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:56:20.822000 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:56:20.822000 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 0821e5beffdd41c2ad2adbd1d03cde71 Oct 17 13:56:20.822000 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-DeleteServersTestJSON-930683239 Oct 17 13:56:20.822000 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:56:20.822000 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:56:20.822000 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "tempest-type-757843761", "name": "tempest-service-527072566", "endpoints": [{"region": "tempest-region-1530587473", "publicURL": "https://url-594098419.com"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "tempest-type-1549021290", "name": "tempest-service-1797883724", "endpoints": [{"region": "tempest-region-85075699", "internalURL": "https://url-259507820.com"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0821e5beffdd41c2ad2adbd1d03cde71", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "tempest-type-1413520904", "name": "tempest-service-1708200528", "endpoints": []}] Oct 17 13:56:20.822000 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-DeleteServersTestJSON-930683239 Oct 17 13:56:20.822000 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 0821e5beffdd41c2ad2adbd1d03cde71 Oct 17 13:56:20.822000 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-DeleteServersTestJSON-930683239 Oct 17 13:56:20.822000 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-DeleteServersTestJSON-930683239-project Oct 17 13:56:20.822000 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:56:20.822000 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:56:20.822000 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: ab8baeba1d494df5bb9cf4d7289410b9 Oct 17 13:56:20.822000 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-DeleteServersTestJSON-930683239-project Oct 17 13:56:20.822000 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:56:20.822000 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance d3018df0-e202-4fa2-91ad-e9fe210ea9ad could not be found. Oct 17 13:56:20.822000 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'd3018df0-e202-4fa2-91ad-e9fe210ea9ad'} Oct 17 13:56:20.822000 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:56:20.822000 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:56:20.822000 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:56:20.822000 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:56:20.822000 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:56:20.822000 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:56:20.822000 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:56:20.822000 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:56:20.822000 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:56:20.822000 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:56:20.822000 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3018df0-e202-4fa2-91ad-e9fe210ea9ad could not be found. Oct 17 13:56:20.822000 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:56:20.822000 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:56:20.822000 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:56:20.822000 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:56:20.822000 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:56:20.822000 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:56:20.822000 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:56:20.822000 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:56:20.822000 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:56:20.822000 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:56:20.822000 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:56:20.822000 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:56:20.822000 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:56:20.822000 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:56:20.822000 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:56:20.826084 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:56:20.826084 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3018df0-e202-4fa2-91ad-e9fe210ea9ad could not be found. Oct 17 13:56:20.826084 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:56:20.826084 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:56:20.826084 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:56:20.826084 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:56:20.826084 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:56:20.826084 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:56:20.826084 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:56:20.826084 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:56:20.826084 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3018df0-e202-4fa2-91ad-e9fe210ea9ad could not be found. Oct 17 13:56:20.826084 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:56:20.828591 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-78157f50-4bd2-4637-a82e-f050978a03b5 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Returning 404 to user: Instance d3018df0-e202-4fa2-91ad-e9fe210ea9ad could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:56:20.829613 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-78157f50-4bd2-4637-a82e-f050978a03b5 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/d3018df0-e202-4fa2-91ad-e9fe210ea9ad" status: 404 len: 111 microversion: 2.1 time: 0.085901 Oct 17 13:56:20.831347 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2196/4515] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:20 2022] GET /compute/v2.1/servers/d3018df0-e202-4fa2-91ad-e9fe210ea9ad => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:56:21.293471 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ed3689dc-6038-4ab4-b7ce-12f7391f9134 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1115257241", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "536c8c49-8501-4c2f-bf93-136c7f68a48c"}]}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:56:21.382005 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-ed3689dc-6038-4ab4-b7ce-12f7391f9134 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] validate_networks() for [('536c8c49-8501-4c2f-bf93-136c7f68a48c', None, None, None, None, None)] {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:56:21.645265 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0d3f8f34-a6ae-414b-a297-75d3766fec7d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:21.646677 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0d3f8f34-a6ae-414b-a297-75d3766fec7d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: e9096e2e-d971-4866-ae12-472b3d9909ea] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:21.672909 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0d3f8f34-a6ae-414b-a297-75d3766fec7d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:21.675562 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0d3f8f34-a6ae-414b-a297-75d3766fec7d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:21.677468 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0d3f8f34-a6ae-414b-a297-75d3766fec7d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:21.681541 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0d3f8f34-a6ae-414b-a297-75d3766fec7d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:21.682664 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0d3f8f34-a6ae-414b-a297-75d3766fec7d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:21.685500 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0d3f8f34-a6ae-414b-a297-75d3766fec7d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:21.742596 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-0d3f8f34-a6ae-414b-a297-75d3766fec7d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] HTTP exception thrown: Instance e9096e2e-d971-4866-ae12-472b3d9909ea could not be found. Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0d3f8f34-a6ae-414b-a297-75d3766fec7d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Request method failure captured: Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/e9096e2e-d971-4866-ae12-472b3d9909ea HTTP/1.1 Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTV7LY5HyKXIBiWDJCG3V5sT42rtCOx1a0oRMtoibd5F_sflHwMTlRe9Y_uOa1HxVMLf4skT3kvoUZ584fC2ohAV2v8XUvXrQcJEEPLKlU8mLvFkUN1JC352BF9fy9_Q0qQLABy1MIy7jPkSZI0xF-7yfpY_h22PPPDKIkDzzcK6D9CQ Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 4fa57e8772684c93a406f3d01da2af88 Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServersTestJSON-749544598 Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4fa57e8772684c93a406f3d01da2af88", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServersTestJSON-749544598 Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 4fa57e8772684c93a406f3d01da2af88 Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServersTestJSON-749544598 Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServersTestJSON-749544598-project Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: d78348abc02a4bb892902b0dd3bcfd6a Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServersTestJSON-749544598-project Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance e9096e2e-d971-4866-ae12-472b3d9909ea could not be found. Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'e9096e2e-d971-4866-ae12-472b3d9909ea'} Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9096e2e-d971-4866-ae12-472b3d9909ea could not be found. Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9096e2e-d971-4866-ae12-472b3d9909ea could not be found. Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:56:21.750358 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:56:21.758210 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:56:21.758210 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:56:21.758210 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:56:21.758210 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:56:21.758210 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9096e2e-d971-4866-ae12-472b3d9909ea could not be found. Oct 17 13:56:21.758210 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:56:21.768536 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0d3f8f34-a6ae-414b-a297-75d3766fec7d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Returning 404 to user: Instance e9096e2e-d971-4866-ae12-472b3d9909ea could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:56:21.772416 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0d3f8f34-a6ae-414b-a297-75d3766fec7d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/e9096e2e-d971-4866-ae12-472b3d9909ea" status: 404 len: 111 microversion: 2.1 time: 0.135419 Oct 17 13:56:21.777049 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2197/4516] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:21 2022] GET /compute/v2.1/servers/e9096e2e-d971-4866-ae12-472b3d9909ea => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:56:21.796254 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f59e43cc-e25c-4d6a-af99-6cf3e274c053 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Action: 'create', calling method: .version_select at 0x7f7cd49bb8b0>, body: {"keypair": {"name": "tempest-key-416480651", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItJSICjgdA7WNpMe/s9sbfbGTmFuCxeuqmX9He45XlnGCLLqKMLZXEKsIQuBehpd36Dx+lwZ1bqmDrc61Gdr8vTx1cf1pTWPdVGjOpl+3YzDop6b1p9/Tl23C1RYPrchA=="}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:56:21.830466 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-f59e43cc-e25c-4d6a-af99-6cf3e274c053 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Getting quotas for project 4fa57e8772684c93a406f3d01da2af88. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:56:21.840235 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-f59e43cc-e25c-4d6a-af99-6cf3e274c053 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Getting quotas for user d78348abc02a4bb892902b0dd3bcfd6a and project 4fa57e8772684c93a406f3d01da2af88. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:56:21.900541 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f59e43cc-e25c-4d6a-af99-6cf3e274c053 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.113199 Oct 17 13:56:21.907269 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2198/4517] 10.222.0.79 () {60 vars in 1159 bytes} [Mon Oct 17 13:56:21 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:56:21.913429 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ce47ce6b-006d-4823-b66c-cd8d5b9b192c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '.version_select at 0x7f7cd49bbc10>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:21.917907 n-d-854247-14 devstack@n-api.service[127017]: WARNING oslo_db.sqlalchemy.utils [None req-ce47ce6b-006d-4823-b66c-cd8d5b9b192c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 17 13:56:21.925030 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ce47ce6b-006d-4823-b66c-cd8d5b9b192c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.016562 Oct 17 13:56:21.926355 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2199/4518] 10.222.0.79 () {58 vars in 1137 bytes} [Mon Oct 17 13:56:21 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:56:21.947675 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-3c827c6c-7ef4-47ff-b0b5-6d03c474de86 req-7966705a-fdac-4f31-b006-b243d887d565 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9096e2e-d971-4866-ae12-472b3d9909ea", "name": "network-vif-deleted", "tag": "3a28c114-5ce8-4a21-8122-28774d8eeb48"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:56:21.959251 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-3c827c6c-7ef4-47ff-b0b5-6d03c474de86 req-7966705a-fdac-4f31-b006-b243d887d565 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:21.960243 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-3c827c6c-7ef4-47ff-b0b5-6d03c474de86 req-7966705a-fdac-4f31-b006-b243d887d565 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:21.960923 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-3c827c6c-7ef4-47ff-b0b5-6d03c474de86 req-7966705a-fdac-4f31-b006-b243d887d565 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:21.975206 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-3c827c6c-7ef4-47ff-b0b5-6d03c474de86 req-7966705a-fdac-4f31-b006-b243d887d565 service nova] Creating event network-vif-deleted:3a28c114-5ce8-4a21-8122-28774d8eeb48 for instance e9096e2e-d971-4866-ae12-472b3d9909ea on n-h2-854247-14 Oct 17 13:56:21.981792 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-3c827c6c-7ef4-47ff-b0b5-6d03c474de86 req-7966705a-fdac-4f31-b006-b243d887d565 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040722 Oct 17 13:56:21.983577 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2200/4519] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:56:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:56:22.288898 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-72468ccf-5951-4b2f-84db-b2c7be925600 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-37769767", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "key_name": "tempest-key-416480651", "networks": [{"uuid": "57c5839d-0220-4c16-a56e-f44ad4323cc7"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:56:22.386512 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-72468ccf-5951-4b2f-84db-b2c7be925600 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] validate_networks() for [('57c5839d-0220-4c16-a56e-f44ad4323cc7', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:56:22.712738 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-ed3689dc-6038-4ab4-b7ce-12f7391f9134 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:56:22.724697 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-ed3689dc-6038-4ab4-b7ce-12f7391f9134 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:56:22.725207 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-ed3689dc-6038-4ab4-b7ce-12f7391f9134 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:56:22.725619 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-ed3689dc-6038-4ab4-b7ce-12f7391f9134 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:56:22.728463 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-ed3689dc-6038-4ab4-b7ce-12f7391f9134 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:56:22.749311 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ed3689dc-6038-4ab4-b7ce-12f7391f9134 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:22.750393 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ed3689dc-6038-4ab4-b7ce-12f7391f9134 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:22.751048 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ed3689dc-6038-4ab4-b7ce-12f7391f9134 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:22.752047 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ed3689dc-6038-4ab4-b7ce-12f7391f9134 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:22.753078 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ed3689dc-6038-4ab4-b7ce-12f7391f9134 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:22.753771 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ed3689dc-6038-4ab4-b7ce-12f7391f9134 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:22.770886 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:56:22.777231 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-ed3689dc-6038-4ab4-b7ce-12f7391f9134 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Getting quotas for project 0821e5beffdd41c2ad2adbd1d03cde71. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:56:22.800342 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-ed3689dc-6038-4ab4-b7ce-12f7391f9134 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Getting quotas for user ab8baeba1d494df5bb9cf4d7289410b9 and project 0821e5beffdd41c2ad2adbd1d03cde71. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:56:22.826954 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ed3689dc-6038-4ab4-b7ce-12f7391f9134 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:56:22.835532 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ed3689dc-6038-4ab4-b7ce-12f7391f9134 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 2660a6f7-5d40-4205-ad68-abf319f1c4c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:56:22.956996 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ed3689dc-6038-4ab4-b7ce-12f7391f9134 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.667368 Oct 17 13:56:22.959577 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2320/4520] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:56:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:56:22.984845 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7b814e38-16bc-44f2-a0a9-a04a5e2500ed tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:22.990128 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7b814e38-16bc-44f2-a0a9-a04a5e2500ed tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 2660a6f7-5d40-4205-ad68-abf319f1c4c3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:23.290047 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-72468ccf-5951-4b2f-84db-b2c7be925600 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:56:23.290706 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-72468ccf-5951-4b2f-84db-b2c7be925600 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:56:23.290940 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-72468ccf-5951-4b2f-84db-b2c7be925600 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:56:23.291415 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-72468ccf-5951-4b2f-84db-b2c7be925600 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:56:23.294083 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-72468ccf-5951-4b2f-84db-b2c7be925600 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:56:23.312808 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-72468ccf-5951-4b2f-84db-b2c7be925600 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:23.319060 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7b814e38-16bc-44f2-a0a9-a04a5e2500ed tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:23.330118 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-72468ccf-5951-4b2f-84db-b2c7be925600 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:23.333331 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-72468ccf-5951-4b2f-84db-b2c7be925600 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:23.334296 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-72468ccf-5951-4b2f-84db-b2c7be925600 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:23.334764 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-72468ccf-5951-4b2f-84db-b2c7be925600 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:23.335209 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-72468ccf-5951-4b2f-84db-b2c7be925600 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:23.336444 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7b814e38-16bc-44f2-a0a9-a04a5e2500ed tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/2660a6f7-5d40-4205-ad68-abf319f1c4c3" status: 200 len: 1215 microversion: 2.1 time: 0.364501 Oct 17 13:56:23.337087 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2321/4521] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:22 2022] GET /compute/v2.1/servers/2660a6f7-5d40-4205-ad68-abf319f1c4c3 => generated 1215 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:23.389775 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-72468ccf-5951-4b2f-84db-b2c7be925600 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Getting quotas for project 4fa57e8772684c93a406f3d01da2af88. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:56:23.398177 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-72468ccf-5951-4b2f-84db-b2c7be925600 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Getting quotas for user d78348abc02a4bb892902b0dd3bcfd6a and project 4fa57e8772684c93a406f3d01da2af88. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:56:23.412307 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-72468ccf-5951-4b2f-84db-b2c7be925600 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:56:23.418714 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-72468ccf-5951-4b2f-84db-b2c7be925600 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: d9e53a8a-357e-4587-a2a2-289135b37879] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:56:23.548823 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-72468ccf-5951-4b2f-84db-b2c7be925600 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.264912 Oct 17 13:56:23.550150 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2201/4522] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:56:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1267 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:56:23.562023 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-bd6dae52-a7d3-47b2-bc92-cfe1659e8270 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:23.563036 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-bd6dae52-a7d3-47b2-bc92-cfe1659e8270 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: d9e53a8a-357e-4587-a2a2-289135b37879] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:23.687048 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-bd6dae52-a7d3-47b2-bc92-cfe1659e8270 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:23.695658 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-bd6dae52-a7d3-47b2-bc92-cfe1659e8270 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/d9e53a8a-357e-4587-a2a2-289135b37879" status: 200 len: 1226 microversion: 2.1 time: 0.137604 Oct 17 13:56:23.696275 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2322/4523] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:23 2022] GET /compute/v2.1/servers/d9e53a8a-357e-4587-a2a2-289135b37879 => generated 1226 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:24.364901 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e1262a8e-7fc5-4740-aeed-d39b82ca6596 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:24.365685 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e1262a8e-7fc5-4740-aeed-d39b82ca6596 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 2660a6f7-5d40-4205-ad68-abf319f1c4c3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:24.381857 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e1262a8e-7fc5-4740-aeed-d39b82ca6596 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:24.382263 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e1262a8e-7fc5-4740-aeed-d39b82ca6596 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:24.382703 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e1262a8e-7fc5-4740-aeed-d39b82ca6596 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:24.383625 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e1262a8e-7fc5-4740-aeed-d39b82ca6596 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:24.384239 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e1262a8e-7fc5-4740-aeed-d39b82ca6596 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:24.384831 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e1262a8e-7fc5-4740-aeed-d39b82ca6596 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:24.490209 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e1262a8e-7fc5-4740-aeed-d39b82ca6596 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:24.499523 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e1262a8e-7fc5-4740-aeed-d39b82ca6596 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/2660a6f7-5d40-4205-ad68-abf319f1c4c3" status: 200 len: 1267 microversion: 2.1 time: 0.141349 Oct 17 13:56:24.503432 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2202/4524] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:24 2022] GET /compute/v2.1/servers/2660a6f7-5d40-4205-ad68-abf319f1c4c3 => generated 1267 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:24.720946 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f7076fee-a482-43cc-a7df-9f16091c165d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:24.721589 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f7076fee-a482-43cc-a7df-9f16091c165d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: d9e53a8a-357e-4587-a2a2-289135b37879] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:24.729251 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f7076fee-a482-43cc-a7df-9f16091c165d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:24.730129 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f7076fee-a482-43cc-a7df-9f16091c165d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:24.730574 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f7076fee-a482-43cc-a7df-9f16091c165d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:24.731299 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f7076fee-a482-43cc-a7df-9f16091c165d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:24.732085 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f7076fee-a482-43cc-a7df-9f16091c165d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:24.732809 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f7076fee-a482-43cc-a7df-9f16091c165d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:24.856859 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f7076fee-a482-43cc-a7df-9f16091c165d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:24.868956 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f7076fee-a482-43cc-a7df-9f16091c165d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/d9e53a8a-357e-4587-a2a2-289135b37879" status: 200 len: 1222 microversion: 2.1 time: 0.151559 Oct 17 13:56:24.871106 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2323/4525] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:24 2022] GET /compute/v2.1/servers/d9e53a8a-357e-4587-a2a2-289135b37879 => generated 1222 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:25.528242 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-af5ed197-5f7e-4d27-bfce-b7f8ad140192 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:25.529479 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-af5ed197-5f7e-4d27-bfce-b7f8ad140192 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 2660a6f7-5d40-4205-ad68-abf319f1c4c3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:25.539229 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-af5ed197-5f7e-4d27-bfce-b7f8ad140192 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:25.540133 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-af5ed197-5f7e-4d27-bfce-b7f8ad140192 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:25.541773 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-af5ed197-5f7e-4d27-bfce-b7f8ad140192 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:25.542721 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-af5ed197-5f7e-4d27-bfce-b7f8ad140192 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:25.543191 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-af5ed197-5f7e-4d27-bfce-b7f8ad140192 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:25.543656 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-af5ed197-5f7e-4d27-bfce-b7f8ad140192 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:25.644566 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-af5ed197-5f7e-4d27-bfce-b7f8ad140192 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:25.653303 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-af5ed197-5f7e-4d27-bfce-b7f8ad140192 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/2660a6f7-5d40-4205-ad68-abf319f1c4c3" status: 200 len: 1273 microversion: 2.1 time: 0.130810 Oct 17 13:56:25.654219 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2203/4526] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:25 2022] GET /compute/v2.1/servers/2660a6f7-5d40-4205-ad68-abf319f1c4c3 => generated 1273 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:25.895081 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-22900f5d-25d7-406b-ad76-216f17614035 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:25.895833 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-22900f5d-25d7-406b-ad76-216f17614035 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: d9e53a8a-357e-4587-a2a2-289135b37879] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:25.906386 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-22900f5d-25d7-406b-ad76-216f17614035 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:25.906780 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-22900f5d-25d7-406b-ad76-216f17614035 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:25.909787 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-22900f5d-25d7-406b-ad76-216f17614035 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:25.910898 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-22900f5d-25d7-406b-ad76-216f17614035 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:25.914311 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-22900f5d-25d7-406b-ad76-216f17614035 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:25.915359 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-22900f5d-25d7-406b-ad76-216f17614035 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:26.018915 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-22900f5d-25d7-406b-ad76-216f17614035 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:26.030167 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-22900f5d-25d7-406b-ad76-216f17614035 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/d9e53a8a-357e-4587-a2a2-289135b37879" status: 200 len: 1284 microversion: 2.1 time: 0.139256 Oct 17 13:56:26.032398 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2324/4527] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:25 2022] GET /compute/v2.1/servers/d9e53a8a-357e-4587-a2a2-289135b37879 => generated 1284 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:56:26.679326 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bcdbaff2-e083-4115-979b-83f130891b90 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:26.680115 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-bcdbaff2-e083-4115-979b-83f130891b90 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 2660a6f7-5d40-4205-ad68-abf319f1c4c3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:26.694379 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bcdbaff2-e083-4115-979b-83f130891b90 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:26.697840 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bcdbaff2-e083-4115-979b-83f130891b90 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:26.699087 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bcdbaff2-e083-4115-979b-83f130891b90 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:26.701616 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bcdbaff2-e083-4115-979b-83f130891b90 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:26.702278 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bcdbaff2-e083-4115-979b-83f130891b90 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:26.702813 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bcdbaff2-e083-4115-979b-83f130891b90 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:27.040114 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-bcdbaff2-e083-4115-979b-83f130891b90 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:27.054404 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-bcdbaff2-e083-4115-979b-83f130891b90 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/2660a6f7-5d40-4205-ad68-abf319f1c4c3" status: 200 len: 1315 microversion: 2.1 time: 0.378293 Oct 17 13:56:27.055352 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2204/4528] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:26 2022] GET /compute/v2.1/servers/2660a6f7-5d40-4205-ad68-abf319f1c4c3 => generated 1315 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:27.067742 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-da2bca2f-3edb-426e-a21b-bf48d06753f4 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:27.067742 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-da2bca2f-3edb-426e-a21b-bf48d06753f4 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: d9e53a8a-357e-4587-a2a2-289135b37879] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:27.069381 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-da2bca2f-3edb-426e-a21b-bf48d06753f4 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:27.069873 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-da2bca2f-3edb-426e-a21b-bf48d06753f4 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:27.070566 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-da2bca2f-3edb-426e-a21b-bf48d06753f4 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:27.073090 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-da2bca2f-3edb-426e-a21b-bf48d06753f4 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:27.073732 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-da2bca2f-3edb-426e-a21b-bf48d06753f4 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:27.078789 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-da2bca2f-3edb-426e-a21b-bf48d06753f4 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:27.379999 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-da2bca2f-3edb-426e-a21b-bf48d06753f4 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:27.392596 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-da2bca2f-3edb-426e-a21b-bf48d06753f4 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/d9e53a8a-357e-4587-a2a2-289135b37879" status: 200 len: 1326 microversion: 2.1 time: 0.342349 Oct 17 13:56:27.406626 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2325/4529] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:27 2022] GET /compute/v2.1/servers/d9e53a8a-357e-4587-a2a2-289135b37879 => generated 1326 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:56:27.492345 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-c44b460b-2266-4a64-be40-e432454f3fd8 req-ae226382-3b83-4deb-a7c4-f6a8201e62ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2660a6f7-5d40-4205-ad68-abf319f1c4c3", "tag": "2b36567f-3803-44d6-9cc1-ca49ea27ee25"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:56:27.511257 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-c44b460b-2266-4a64-be40-e432454f3fd8 req-ae226382-3b83-4deb-a7c4-f6a8201e62ed service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:27.511738 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-c44b460b-2266-4a64-be40-e432454f3fd8 req-ae226382-3b83-4deb-a7c4-f6a8201e62ed service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:27.512169 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-c44b460b-2266-4a64-be40-e432454f3fd8 req-ae226382-3b83-4deb-a7c4-f6a8201e62ed service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:27.525996 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-c44b460b-2266-4a64-be40-e432454f3fd8 req-ae226382-3b83-4deb-a7c4-f6a8201e62ed service nova] Creating event network-changed:2b36567f-3803-44d6-9cc1-ca49ea27ee25 for instance 2660a6f7-5d40-4205-ad68-abf319f1c4c3 on n-h1-854247-14 Oct 17 13:56:27.531648 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-c44b460b-2266-4a64-be40-e432454f3fd8 req-ae226382-3b83-4deb-a7c4-f6a8201e62ed service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048491 Oct 17 13:56:27.532687 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2205/4530] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:56:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:56:27.604289 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-d4289420-cce1-4a34-b04b-ad78e7ada591 req-b781ec61-585a-4761-9fcf-252df78133fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9e53a8a-357e-4587-a2a2-289135b37879", "tag": "ce89ac88-a413-4505-b234-3128a92e1c14"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:56:27.625077 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-d4289420-cce1-4a34-b04b-ad78e7ada591 req-b781ec61-585a-4761-9fcf-252df78133fc service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:27.625563 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-d4289420-cce1-4a34-b04b-ad78e7ada591 req-b781ec61-585a-4761-9fcf-252df78133fc service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:27.630999 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-d4289420-cce1-4a34-b04b-ad78e7ada591 req-b781ec61-585a-4761-9fcf-252df78133fc service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:27.654646 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-d4289420-cce1-4a34-b04b-ad78e7ada591 req-b781ec61-585a-4761-9fcf-252df78133fc service nova] Creating event network-changed:ce89ac88-a413-4505-b234-3128a92e1c14 for instance d9e53a8a-357e-4587-a2a2-289135b37879 on n-h1-854247-14 Oct 17 13:56:27.662023 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-d4289420-cce1-4a34-b04b-ad78e7ada591 req-b781ec61-585a-4761-9fcf-252df78133fc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062744 Oct 17 13:56:27.662652 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2326/4531] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:56:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:56:28.083667 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-dc29800b-9382-45a1-a7c2-253ec676e7f4 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:28.111481 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-dc29800b-9382-45a1-a7c2-253ec676e7f4 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 2660a6f7-5d40-4205-ad68-abf319f1c4c3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:28.123981 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dc29800b-9382-45a1-a7c2-253ec676e7f4 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:28.125452 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dc29800b-9382-45a1-a7c2-253ec676e7f4 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:28.125905 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dc29800b-9382-45a1-a7c2-253ec676e7f4 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:28.127019 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dc29800b-9382-45a1-a7c2-253ec676e7f4 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:28.127148 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dc29800b-9382-45a1-a7c2-253ec676e7f4 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:28.127513 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dc29800b-9382-45a1-a7c2-253ec676e7f4 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:28.284825 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-dc29800b-9382-45a1-a7c2-253ec676e7f4 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:28.292858 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-dc29800b-9382-45a1-a7c2-253ec676e7f4 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/2660a6f7-5d40-4205-ad68-abf319f1c4c3" status: 200 len: 1315 microversion: 2.1 time: 0.214477 Oct 17 13:56:28.293437 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2206/4532] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:28 2022] GET /compute/v2.1/servers/2660a6f7-5d40-4205-ad68-abf319f1c4c3 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:28.422957 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8a0d592e-55cf-47ff-95b0-77e628da5195 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:28.424143 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8a0d592e-55cf-47ff-95b0-77e628da5195 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: d9e53a8a-357e-4587-a2a2-289135b37879] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:28.431454 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8a0d592e-55cf-47ff-95b0-77e628da5195 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:28.432025 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8a0d592e-55cf-47ff-95b0-77e628da5195 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:28.432808 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8a0d592e-55cf-47ff-95b0-77e628da5195 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:28.433701 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8a0d592e-55cf-47ff-95b0-77e628da5195 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:28.434643 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8a0d592e-55cf-47ff-95b0-77e628da5195 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:28.435074 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8a0d592e-55cf-47ff-95b0-77e628da5195 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:28.576534 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8a0d592e-55cf-47ff-95b0-77e628da5195 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:28.587365 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8a0d592e-55cf-47ff-95b0-77e628da5195 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/d9e53a8a-357e-4587-a2a2-289135b37879" status: 200 len: 1326 microversion: 2.1 time: 0.170696 Oct 17 13:56:28.598850 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2327/4533] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:28 2022] GET /compute/v2.1/servers/d9e53a8a-357e-4587-a2a2-289135b37879 => generated 1326 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:29.320757 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a1626f74-af65-481e-bfc3-58768227588d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:29.323346 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a1626f74-af65-481e-bfc3-58768227588d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 2660a6f7-5d40-4205-ad68-abf319f1c4c3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:29.337114 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a1626f74-af65-481e-bfc3-58768227588d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:29.337909 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a1626f74-af65-481e-bfc3-58768227588d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:29.338666 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a1626f74-af65-481e-bfc3-58768227588d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:29.339679 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a1626f74-af65-481e-bfc3-58768227588d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:29.340476 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a1626f74-af65-481e-bfc3-58768227588d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:29.341697 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a1626f74-af65-481e-bfc3-58768227588d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:29.612718 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f1b956f1-42b4-4f22-86aa-80a4f4296b16 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:29.613600 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f1b956f1-42b4-4f22-86aa-80a4f4296b16 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: d9e53a8a-357e-4587-a2a2-289135b37879] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:29.622929 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1b956f1-42b4-4f22-86aa-80a4f4296b16 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:29.624981 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1b956f1-42b4-4f22-86aa-80a4f4296b16 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:29.625538 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1b956f1-42b4-4f22-86aa-80a4f4296b16 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:29.626359 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1b956f1-42b4-4f22-86aa-80a4f4296b16 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:29.627037 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1b956f1-42b4-4f22-86aa-80a4f4296b16 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:29.627716 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1b956f1-42b4-4f22-86aa-80a4f4296b16 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:29.786444 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a1626f74-af65-481e-bfc3-58768227588d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:29.794258 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=100 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:56:29.797283 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a1626f74-af65-481e-bfc3-58768227588d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/2660a6f7-5d40-4205-ad68-abf319f1c4c3" status: 200 len: 1315 microversion: 2.1 time: 0.484392 Oct 17 13:56:29.819569 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2207/4534] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:29 2022] GET /compute/v2.1/servers/2660a6f7-5d40-4205-ad68-abf319f1c4c3 => generated 1315 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:30.255857 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f1b956f1-42b4-4f22-86aa-80a4f4296b16 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:30.280096 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f1b956f1-42b4-4f22-86aa-80a4f4296b16 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/d9e53a8a-357e-4587-a2a2-289135b37879" status: 200 len: 1326 microversion: 2.1 time: 0.672694 Oct 17 13:56:30.301180 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2328/4535] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:29 2022] GET /compute/v2.1/servers/d9e53a8a-357e-4587-a2a2-289135b37879 => generated 1326 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:56:30.827129 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f1ef98a6-89a4-4e2c-9388-7bb4b3cdc595 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:30.827824 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f1ef98a6-89a4-4e2c-9388-7bb4b3cdc595 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 2660a6f7-5d40-4205-ad68-abf319f1c4c3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:30.840180 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f1ef98a6-89a4-4e2c-9388-7bb4b3cdc595 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:30.843786 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f1ef98a6-89a4-4e2c-9388-7bb4b3cdc595 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:30.844410 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f1ef98a6-89a4-4e2c-9388-7bb4b3cdc595 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:30.845377 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f1ef98a6-89a4-4e2c-9388-7bb4b3cdc595 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:30.846091 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f1ef98a6-89a4-4e2c-9388-7bb4b3cdc595 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:30.846736 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f1ef98a6-89a4-4e2c-9388-7bb4b3cdc595 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:31.253495 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f1ef98a6-89a4-4e2c-9388-7bb4b3cdc595 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:31.272776 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f1ef98a6-89a4-4e2c-9388-7bb4b3cdc595 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/2660a6f7-5d40-4205-ad68-abf319f1c4c3" status: 200 len: 1315 microversion: 2.1 time: 0.449858 Oct 17 13:56:31.274061 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2208/4536] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:30 2022] GET /compute/v2.1/servers/2660a6f7-5d40-4205-ad68-abf319f1c4c3 => generated 1315 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:56:31.306262 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d9a2a9b7-aba7-43f0-8c3f-f25596f51ad2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:31.307624 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d9a2a9b7-aba7-43f0-8c3f-f25596f51ad2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: d9e53a8a-357e-4587-a2a2-289135b37879] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:31.322419 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d9a2a9b7-aba7-43f0-8c3f-f25596f51ad2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:31.323367 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d9a2a9b7-aba7-43f0-8c3f-f25596f51ad2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:31.324093 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d9a2a9b7-aba7-43f0-8c3f-f25596f51ad2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:31.325011 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d9a2a9b7-aba7-43f0-8c3f-f25596f51ad2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:31.325848 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d9a2a9b7-aba7-43f0-8c3f-f25596f51ad2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:31.328772 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d9a2a9b7-aba7-43f0-8c3f-f25596f51ad2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:31.652544 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d9a2a9b7-aba7-43f0-8c3f-f25596f51ad2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:31.662141 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d9a2a9b7-aba7-43f0-8c3f-f25596f51ad2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/d9e53a8a-357e-4587-a2a2-289135b37879" status: 200 len: 1326 microversion: 2.1 time: 0.358474 Oct 17 13:56:31.663210 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2329/4537] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:31 2022] GET /compute/v2.1/servers/d9e53a8a-357e-4587-a2a2-289135b37879 => generated 1326 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:32.300583 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b2515ece-25bc-4f4d-b07b-1e41391c03f9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:32.303240 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b2515ece-25bc-4f4d-b07b-1e41391c03f9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 2660a6f7-5d40-4205-ad68-abf319f1c4c3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:32.316167 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b2515ece-25bc-4f4d-b07b-1e41391c03f9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:32.317594 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b2515ece-25bc-4f4d-b07b-1e41391c03f9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:32.318733 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b2515ece-25bc-4f4d-b07b-1e41391c03f9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:32.320007 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b2515ece-25bc-4f4d-b07b-1e41391c03f9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:32.320937 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b2515ece-25bc-4f4d-b07b-1e41391c03f9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:32.321633 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b2515ece-25bc-4f4d-b07b-1e41391c03f9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:32.545347 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b2515ece-25bc-4f4d-b07b-1e41391c03f9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:32.562856 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b2515ece-25bc-4f4d-b07b-1e41391c03f9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/2660a6f7-5d40-4205-ad68-abf319f1c4c3" status: 200 len: 1315 microversion: 2.1 time: 0.267412 Oct 17 13:56:32.565933 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2209/4538] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:32 2022] GET /compute/v2.1/servers/2660a6f7-5d40-4205-ad68-abf319f1c4c3 => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:32.689597 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f4081d95-c940-4e09-849e-562a49ac98b5 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:32.691088 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f4081d95-c940-4e09-849e-562a49ac98b5 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: d9e53a8a-357e-4587-a2a2-289135b37879] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:32.701723 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f4081d95-c940-4e09-849e-562a49ac98b5 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:32.702433 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f4081d95-c940-4e09-849e-562a49ac98b5 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:32.703058 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f4081d95-c940-4e09-849e-562a49ac98b5 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:32.703951 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f4081d95-c940-4e09-849e-562a49ac98b5 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:32.704648 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f4081d95-c940-4e09-849e-562a49ac98b5 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:32.705547 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f4081d95-c940-4e09-849e-562a49ac98b5 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:32.776911 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:56:32.923810 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f4081d95-c940-4e09-849e-562a49ac98b5 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:32.935086 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f4081d95-c940-4e09-849e-562a49ac98b5 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/d9e53a8a-357e-4587-a2a2-289135b37879" status: 200 len: 1326 microversion: 2.1 time: 0.252643 Oct 17 13:56:32.938315 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2330/4539] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:32 2022] GET /compute/v2.1/servers/d9e53a8a-357e-4587-a2a2-289135b37879 => generated 1326 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:33.592376 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1343a7cb-2a5c-4eb0-9434-86b8e704509f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:33.593630 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1343a7cb-2a5c-4eb0-9434-86b8e704509f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 2660a6f7-5d40-4205-ad68-abf319f1c4c3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:33.601334 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:56:33.602257 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=10 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:56:33.603929 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1343a7cb-2a5c-4eb0-9434-86b8e704509f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:33.604577 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1343a7cb-2a5c-4eb0-9434-86b8e704509f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:33.605170 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1343a7cb-2a5c-4eb0-9434-86b8e704509f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:33.606035 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1343a7cb-2a5c-4eb0-9434-86b8e704509f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:33.606768 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1343a7cb-2a5c-4eb0-9434-86b8e704509f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:33.607846 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1343a7cb-2a5c-4eb0-9434-86b8e704509f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:33.840596 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-e17483b1-08f1-4ca1-8a4d-98c477d55f20 req-d8b1f125-ee77-43c5-b785-784720243f59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9e53a8a-357e-4587-a2a2-289135b37879", "name": "network-vif-plugged", "status": "completed", "tag": "ce89ac88-a413-4505-b234-3128a92e1c14"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:56:33.855049 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=10 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:56:33.858904 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-e17483b1-08f1-4ca1-8a4d-98c477d55f20 req-d8b1f125-ee77-43c5-b785-784720243f59 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:33.862246 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-e17483b1-08f1-4ca1-8a4d-98c477d55f20 req-d8b1f125-ee77-43c5-b785-784720243f59 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:33.864623 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-e17483b1-08f1-4ca1-8a4d-98c477d55f20 req-d8b1f125-ee77-43c5-b785-784720243f59 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:33.897277 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-e17483b1-08f1-4ca1-8a4d-98c477d55f20 req-d8b1f125-ee77-43c5-b785-784720243f59 service nova] Creating event network-vif-plugged:ce89ac88-a413-4505-b234-3128a92e1c14 for instance d9e53a8a-357e-4587-a2a2-289135b37879 on n-h1-854247-14 Oct 17 13:56:33.911837 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-e17483b1-08f1-4ca1-8a4d-98c477d55f20 req-d8b1f125-ee77-43c5-b785-784720243f59 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075250 Oct 17 13:56:33.913523 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1343a7cb-2a5c-4eb0-9434-86b8e704509f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:33.914825 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2331/4540] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:56:33.927698 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1343a7cb-2a5c-4eb0-9434-86b8e704509f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/2660a6f7-5d40-4205-ad68-abf319f1c4c3" status: 200 len: 1315 microversion: 2.1 time: 0.340108 Oct 17 13:56:33.929116 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2210/4541] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:33 2022] GET /compute/v2.1/servers/2660a6f7-5d40-4205-ad68-abf319f1c4c3 => generated 1315 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:33.961043 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4c0b78fb-b9f4-43b9-849d-b59b4ecd58b5 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:33.962616 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4c0b78fb-b9f4-43b9-849d-b59b4ecd58b5 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: d9e53a8a-357e-4587-a2a2-289135b37879] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:33.974020 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4c0b78fb-b9f4-43b9-849d-b59b4ecd58b5 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:33.975582 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4c0b78fb-b9f4-43b9-849d-b59b4ecd58b5 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:33.977327 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4c0b78fb-b9f4-43b9-849d-b59b4ecd58b5 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:33.979635 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4c0b78fb-b9f4-43b9-849d-b59b4ecd58b5 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:33.980306 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4c0b78fb-b9f4-43b9-849d-b59b4ecd58b5 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:33.984036 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4c0b78fb-b9f4-43b9-849d-b59b4ecd58b5 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:34.317461 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4c0b78fb-b9f4-43b9-849d-b59b4ecd58b5 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:34.329223 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4c0b78fb-b9f4-43b9-849d-b59b4ecd58b5 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/d9e53a8a-357e-4587-a2a2-289135b37879" status: 200 len: 1326 microversion: 2.1 time: 0.374246 Oct 17 13:56:34.331265 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2332/4542] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:33 2022] GET /compute/v2.1/servers/d9e53a8a-357e-4587-a2a2-289135b37879 => generated 1326 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:34.955637 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5584797f-53a9-40b0-abb1-56b09c372934 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:34.957884 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5584797f-53a9-40b0-abb1-56b09c372934 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 2660a6f7-5d40-4205-ad68-abf319f1c4c3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:34.970634 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5584797f-53a9-40b0-abb1-56b09c372934 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:34.971721 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5584797f-53a9-40b0-abb1-56b09c372934 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:34.972388 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5584797f-53a9-40b0-abb1-56b09c372934 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:34.973505 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5584797f-53a9-40b0-abb1-56b09c372934 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:34.974363 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5584797f-53a9-40b0-abb1-56b09c372934 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:34.975050 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5584797f-53a9-40b0-abb1-56b09c372934 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:35.361343 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7e58e352-9604-4092-af7f-61687ebbe826 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:35.362318 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7e58e352-9604-4092-af7f-61687ebbe826 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: d9e53a8a-357e-4587-a2a2-289135b37879] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:35.382749 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7e58e352-9604-4092-af7f-61687ebbe826 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:35.384030 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7e58e352-9604-4092-af7f-61687ebbe826 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:35.384869 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7e58e352-9604-4092-af7f-61687ebbe826 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:35.387054 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7e58e352-9604-4092-af7f-61687ebbe826 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:35.388730 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7e58e352-9604-4092-af7f-61687ebbe826 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:35.389500 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7e58e352-9604-4092-af7f-61687ebbe826 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:35.455626 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5584797f-53a9-40b0-abb1-56b09c372934 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:35.483975 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5584797f-53a9-40b0-abb1-56b09c372934 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/2660a6f7-5d40-4205-ad68-abf319f1c4c3" status: 200 len: 1315 microversion: 2.1 time: 0.520098 Oct 17 13:56:35.489738 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2211/4543] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:34 2022] GET /compute/v2.1/servers/2660a6f7-5d40-4205-ad68-abf319f1c4c3 => generated 1315 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:56:35.914086 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7e58e352-9604-4092-af7f-61687ebbe826 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:35.930564 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:56:35.942493 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-9e74bf29-9153-44b3-9824-77e8de342ef5 req-d5cea5ad-e57e-4d72-920f-aac743ed2af6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2660a6f7-5d40-4205-ad68-abf319f1c4c3", "name": "network-vif-plugged", "status": "completed", "tag": "2b36567f-3803-44d6-9cc1-ca49ea27ee25"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:56:35.985084 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7e58e352-9604-4092-af7f-61687ebbe826 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/d9e53a8a-357e-4587-a2a2-289135b37879" status: 200 len: 1326 microversion: 2.1 time: 0.630349 Oct 17 13:56:35.986353 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-9e74bf29-9153-44b3-9824-77e8de342ef5 req-d5cea5ad-e57e-4d72-920f-aac743ed2af6 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:36.003531 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2333/4544] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:35 2022] GET /compute/v2.1/servers/d9e53a8a-357e-4587-a2a2-289135b37879 => generated 1326 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:36.006882 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-9e74bf29-9153-44b3-9824-77e8de342ef5 req-d5cea5ad-e57e-4d72-920f-aac743ed2af6 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:36.008127 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-9e74bf29-9153-44b3-9824-77e8de342ef5 req-d5cea5ad-e57e-4d72-920f-aac743ed2af6 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:36.049676 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-9e74bf29-9153-44b3-9824-77e8de342ef5 req-d5cea5ad-e57e-4d72-920f-aac743ed2af6 service nova] Creating event network-vif-plugged:2b36567f-3803-44d6-9cc1-ca49ea27ee25 for instance 2660a6f7-5d40-4205-ad68-abf319f1c4c3 on n-h1-854247-14 Oct 17 13:56:36.057891 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-9e74bf29-9153-44b3-9824-77e8de342ef5 req-d5cea5ad-e57e-4d72-920f-aac743ed2af6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120944 Oct 17 13:56:36.074822 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2212/4545] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:56:36.520014 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b4e89ff0-f25a-4361-9297-0525a4143b00 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:36.520969 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b4e89ff0-f25a-4361-9297-0525a4143b00 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 2660a6f7-5d40-4205-ad68-abf319f1c4c3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:36.537418 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b4e89ff0-f25a-4361-9297-0525a4143b00 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:36.538032 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b4e89ff0-f25a-4361-9297-0525a4143b00 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:36.538416 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b4e89ff0-f25a-4361-9297-0525a4143b00 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:36.539074 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b4e89ff0-f25a-4361-9297-0525a4143b00 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:36.539562 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b4e89ff0-f25a-4361-9297-0525a4143b00 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:36.539991 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b4e89ff0-f25a-4361-9297-0525a4143b00 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:36.788663 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b4e89ff0-f25a-4361-9297-0525a4143b00 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:36.800967 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b4e89ff0-f25a-4361-9297-0525a4143b00 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/2660a6f7-5d40-4205-ad68-abf319f1c4c3" status: 200 len: 1315 microversion: 2.1 time: 0.286738 Oct 17 13:56:36.802283 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2334/4546] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:36 2022] GET /compute/v2.1/servers/2660a6f7-5d40-4205-ad68-abf319f1c4c3 => generated 1315 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:37.016135 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c71dc1d5-25ef-43b1-90ee-c7582d4a066f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:37.016977 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c71dc1d5-25ef-43b1-90ee-c7582d4a066f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: d9e53a8a-357e-4587-a2a2-289135b37879] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:37.032949 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c71dc1d5-25ef-43b1-90ee-c7582d4a066f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:37.033662 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c71dc1d5-25ef-43b1-90ee-c7582d4a066f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:37.034774 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c71dc1d5-25ef-43b1-90ee-c7582d4a066f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:37.036731 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c71dc1d5-25ef-43b1-90ee-c7582d4a066f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:37.039385 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c71dc1d5-25ef-43b1-90ee-c7582d4a066f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:37.041227 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c71dc1d5-25ef-43b1-90ee-c7582d4a066f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:37.361993 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c71dc1d5-25ef-43b1-90ee-c7582d4a066f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:37.374344 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c71dc1d5-25ef-43b1-90ee-c7582d4a066f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/d9e53a8a-357e-4587-a2a2-289135b37879" status: 200 len: 1508 microversion: 2.1 time: 0.364902 Oct 17 13:56:37.376939 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2335/4547] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:37 2022] GET /compute/v2.1/servers/d9e53a8a-357e-4587-a2a2-289135b37879 => generated 1508 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:56:37.404632 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b1e6ae9d-fda2-4fbc-9d7a-70d60659934c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:37.405798 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b1e6ae9d-fda2-4fbc-9d7a-70d60659934c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: d9e53a8a-357e-4587-a2a2-289135b37879] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:37.414933 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b1e6ae9d-fda2-4fbc-9d7a-70d60659934c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:37.416074 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b1e6ae9d-fda2-4fbc-9d7a-70d60659934c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:37.416755 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b1e6ae9d-fda2-4fbc-9d7a-70d60659934c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:37.418748 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b1e6ae9d-fda2-4fbc-9d7a-70d60659934c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:37.424809 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b1e6ae9d-fda2-4fbc-9d7a-70d60659934c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:37.425488 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b1e6ae9d-fda2-4fbc-9d7a-70d60659934c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:37.533504 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-cfea19b3-48b8-4eff-ae08-4a5c251a4d2d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1770278650", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:56:37.613011 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-cfea19b3-48b8-4eff-ae08-4a5c251a4d2d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] validate_networks() for [('b49f903b-f4c7-4e7e-b00e-fad95121a23e', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:56:37.672239 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b1e6ae9d-fda2-4fbc-9d7a-70d60659934c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:37.684053 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b1e6ae9d-fda2-4fbc-9d7a-70d60659934c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/d9e53a8a-357e-4587-a2a2-289135b37879" status: 200 len: 1508 microversion: 2.1 time: 0.283051 Oct 17 13:56:37.710872 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2336/4548] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:37 2022] GET /compute/v2.1/servers/d9e53a8a-357e-4587-a2a2-289135b37879 => generated 1508 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:56:37.747305 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-27687076-29d6-4372-a1a6-da8f35805dd3 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:37.749668 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-27687076-29d6-4372-a1a6-da8f35805dd3 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: d9e53a8a-357e-4587-a2a2-289135b37879] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:37.764794 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-27687076-29d6-4372-a1a6-da8f35805dd3 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:37.765301 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-27687076-29d6-4372-a1a6-da8f35805dd3 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:37.765766 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-27687076-29d6-4372-a1a6-da8f35805dd3 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:37.766493 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-27687076-29d6-4372-a1a6-da8f35805dd3 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:37.768830 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-27687076-29d6-4372-a1a6-da8f35805dd3 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:37.769320 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-27687076-29d6-4372-a1a6-da8f35805dd3 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:37.800613 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-27687076-29d6-4372-a1a6-da8f35805dd3 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: d9e53a8a-357e-4587-a2a2-289135b37879] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:56:37.916608 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-27687076-29d6-4372-a1a6-da8f35805dd3 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "DELETE /compute/v2.1/servers/d9e53a8a-357e-4587-a2a2-289135b37879" status: 204 len: 0 microversion: 2.1 time: 0.201869 Oct 17 13:56:37.917849 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2337/4549] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:56:37 2022] DELETE /compute/v2.1/servers/d9e53a8a-357e-4587-a2a2-289135b37879 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:56:37.925577 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a2e2339a-9fbf-4222-b860-5f12ea29e518 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:37.926834 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a2e2339a-9fbf-4222-b860-5f12ea29e518 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 2660a6f7-5d40-4205-ad68-abf319f1c4c3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:37.935551 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a2e2339a-9fbf-4222-b860-5f12ea29e518 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:37.936386 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a2e2339a-9fbf-4222-b860-5f12ea29e518 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:37.936976 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a2e2339a-9fbf-4222-b860-5f12ea29e518 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:37.937904 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a2e2339a-9fbf-4222-b860-5f12ea29e518 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:37.938526 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a2e2339a-9fbf-4222-b860-5f12ea29e518 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:37.939114 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a2e2339a-9fbf-4222-b860-5f12ea29e518 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:38.397776 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a2e2339a-9fbf-4222-b860-5f12ea29e518 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:38.405729 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a2e2339a-9fbf-4222-b860-5f12ea29e518 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/2660a6f7-5d40-4205-ad68-abf319f1c4c3" status: 200 len: 1503 microversion: 2.1 time: 0.485993 Oct 17 13:56:38.406309 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2338/4550] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:37 2022] GET /compute/v2.1/servers/2660a6f7-5d40-4205-ad68-abf319f1c4c3 => generated 1503 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:38.430339 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-636e4f12-a178-4a70-afec-ac6e02c7a694 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:38.431075 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-636e4f12-a178-4a70-afec-ac6e02c7a694 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: d9e53a8a-357e-4587-a2a2-289135b37879] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:38.451445 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-636e4f12-a178-4a70-afec-ac6e02c7a694 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:38.452360 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-636e4f12-a178-4a70-afec-ac6e02c7a694 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:38.453264 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-636e4f12-a178-4a70-afec-ac6e02c7a694 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:38.453489 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-636e4f12-a178-4a70-afec-ac6e02c7a694 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:38.453943 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-636e4f12-a178-4a70-afec-ac6e02c7a694 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:38.454374 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-636e4f12-a178-4a70-afec-ac6e02c7a694 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:38.822896 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-cfea19b3-48b8-4eff-ae08-4a5c251a4d2d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:56:38.823481 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-cfea19b3-48b8-4eff-ae08-4a5c251a4d2d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:56:38.824100 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-cfea19b3-48b8-4eff-ae08-4a5c251a4d2d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:56:38.825994 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-cfea19b3-48b8-4eff-ae08-4a5c251a4d2d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:56:38.827949 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-cfea19b3-48b8-4eff-ae08-4a5c251a4d2d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:56:38.890502 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cfea19b3-48b8-4eff-ae08-4a5c251a4d2d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:38.890661 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cfea19b3-48b8-4eff-ae08-4a5c251a4d2d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:38.891022 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cfea19b3-48b8-4eff-ae08-4a5c251a4d2d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:38.900932 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cfea19b3-48b8-4eff-ae08-4a5c251a4d2d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:38.901551 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cfea19b3-48b8-4eff-ae08-4a5c251a4d2d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:38.905110 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cfea19b3-48b8-4eff-ae08-4a5c251a4d2d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:38.996307 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-cfea19b3-48b8-4eff-ae08-4a5c251a4d2d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Getting quotas for project f5cd6550628148f9b0ae1907967da048. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:56:39.020805 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-cfea19b3-48b8-4eff-ae08-4a5c251a4d2d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Getting quotas for user 6e0edd4df0ec4a079ab988b186fedf00 and project f5cd6550628148f9b0ae1907967da048. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:56:39.033946 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:56:39.079775 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-cfea19b3-48b8-4eff-ae08-4a5c251a4d2d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:56:39.105947 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-cfea19b3-48b8-4eff-ae08-4a5c251a4d2d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: 70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:56:39.233918 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-cfea19b3-48b8-4eff-ae08-4a5c251a4d2d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.382697 Oct 17 13:56:39.239336 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2213/4551] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:56:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 2389 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:56:39.257035 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f11249bd-57cd-414a-a7a8-6161e397bc41 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:39.259422 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f11249bd-57cd-414a-a7a8-6161e397bc41 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: 70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:39.474725 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f11249bd-57cd-414a-a7a8-6161e397bc41 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:39.486220 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f11249bd-57cd-414a-a7a8-6161e397bc41 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63" status: 200 len: 1214 microversion: 2.1 time: 0.236321 Oct 17 13:56:39.487079 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2214/4552] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:39 2022] GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63 => generated 1214 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:39.513458 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-636e4f12-a178-4a70-afec-ac6e02c7a694 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:39.527805 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-636e4f12-a178-4a70-afec-ac6e02c7a694 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/d9e53a8a-357e-4587-a2a2-289135b37879" status: 200 len: 1514 microversion: 2.1 time: 1.113553 Oct 17 13:56:39.528606 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2339/4553] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:38 2022] GET /compute/v2.1/servers/d9e53a8a-357e-4587-a2a2-289135b37879 => generated 1514 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:40.511368 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-db38aeb2-b187-4d6a-8939-e7514501803f tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:40.511981 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-db38aeb2-b187-4d6a-8939-e7514501803f tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: 70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:40.538608 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db38aeb2-b187-4d6a-8939-e7514501803f tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:40.565050 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-06142a46-1789-4fa8-af56-bba34959cd58 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:40.566252 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-06142a46-1789-4fa8-af56-bba34959cd58 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: d9e53a8a-357e-4587-a2a2-289135b37879] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:40.576098 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db38aeb2-b187-4d6a-8939-e7514501803f tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:40.587904 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db38aeb2-b187-4d6a-8939-e7514501803f tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.044s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:40.596727 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db38aeb2-b187-4d6a-8939-e7514501803f tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:40.601145 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db38aeb2-b187-4d6a-8939-e7514501803f tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:40.607540 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db38aeb2-b187-4d6a-8939-e7514501803f tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:40.615250 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-06142a46-1789-4fa8-af56-bba34959cd58 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:40.615829 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-06142a46-1789-4fa8-af56-bba34959cd58 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:40.616277 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-06142a46-1789-4fa8-af56-bba34959cd58 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:40.617005 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-06142a46-1789-4fa8-af56-bba34959cd58 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:40.617459 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-06142a46-1789-4fa8-af56-bba34959cd58 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:40.618037 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-06142a46-1789-4fa8-af56-bba34959cd58 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:40.900868 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-db38aeb2-b187-4d6a-8939-e7514501803f tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:40.908908 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-db38aeb2-b187-4d6a-8939-e7514501803f tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63" status: 200 len: 1210 microversion: 2.1 time: 0.403071 Oct 17 13:56:40.924801 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2215/4554] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:40 2022] GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63 => generated 1210 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:40.929478 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-f4594688-573f-4b69-8410-5e87d11410e6 req-c3416f5c-5f2b-404e-a117-38242b5c1f2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9e53a8a-357e-4587-a2a2-289135b37879", "name": "network-vif-deleted", "tag": "ce89ac88-a413-4505-b234-3128a92e1c14"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:56:40.933874 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-06142a46-1789-4fa8-af56-bba34959cd58 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:40.949206 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-06142a46-1789-4fa8-af56-bba34959cd58 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/d9e53a8a-357e-4587-a2a2-289135b37879" status: 200 len: 1472 microversion: 2.1 time: 0.397116 Oct 17 13:56:40.956294 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-f4594688-573f-4b69-8410-5e87d11410e6 req-c3416f5c-5f2b-404e-a117-38242b5c1f2b service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:40.961676 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-f4594688-573f-4b69-8410-5e87d11410e6 req-c3416f5c-5f2b-404e-a117-38242b5c1f2b service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:40.962227 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-f4594688-573f-4b69-8410-5e87d11410e6 req-c3416f5c-5f2b-404e-a117-38242b5c1f2b service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:40.964149 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2340/4555] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:40 2022] GET /compute/v2.1/servers/d9e53a8a-357e-4587-a2a2-289135b37879 => generated 1472 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:41.024780 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-f4594688-573f-4b69-8410-5e87d11410e6 req-c3416f5c-5f2b-404e-a117-38242b5c1f2b service nova] Creating event network-vif-deleted:ce89ac88-a413-4505-b234-3128a92e1c14 for instance d9e53a8a-357e-4587-a2a2-289135b37879 on n-h1-854247-14 Oct 17 13:56:41.035120 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-f4594688-573f-4b69-8410-5e87d11410e6 req-c3416f5c-5f2b-404e-a117-38242b5c1f2b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109506 Oct 17 13:56:41.037333 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2216/4556] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:56:41.939429 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9a27ebf4-7d9b-4387-8cc4-9ed38356fa8e tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:41.940135 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9a27ebf4-7d9b-4387-8cc4-9ed38356fa8e tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: 70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:41.957823 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9a27ebf4-7d9b-4387-8cc4-9ed38356fa8e tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:41.958981 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9a27ebf4-7d9b-4387-8cc4-9ed38356fa8e tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:41.960009 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9a27ebf4-7d9b-4387-8cc4-9ed38356fa8e tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:41.960881 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9a27ebf4-7d9b-4387-8cc4-9ed38356fa8e tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:41.964214 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9a27ebf4-7d9b-4387-8cc4-9ed38356fa8e tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:41.965428 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9a27ebf4-7d9b-4387-8cc4-9ed38356fa8e tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:41.986371 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e942f3a1-51cb-4657-96f3-b6978da1d16c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:41.988025 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e942f3a1-51cb-4657-96f3-b6978da1d16c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: d9e53a8a-357e-4587-a2a2-289135b37879] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:42.004694 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e942f3a1-51cb-4657-96f3-b6978da1d16c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:42.005201 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e942f3a1-51cb-4657-96f3-b6978da1d16c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:42.007952 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e942f3a1-51cb-4657-96f3-b6978da1d16c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:42.010615 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e942f3a1-51cb-4657-96f3-b6978da1d16c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:42.012024 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e942f3a1-51cb-4657-96f3-b6978da1d16c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:42.014347 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e942f3a1-51cb-4657-96f3-b6978da1d16c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:42.069288 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e942f3a1-51cb-4657-96f3-b6978da1d16c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:42.070371 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e942f3a1-51cb-4657-96f3-b6978da1d16c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:42.070966 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e942f3a1-51cb-4657-96f3-b6978da1d16c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:42.071590 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-e942f3a1-51cb-4657-96f3-b6978da1d16c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lazy-loading 'fault' on Instance uuid d9e53a8a-357e-4587-a2a2-289135b37879 {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:56:42.162648 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9a27ebf4-7d9b-4387-8cc4-9ed38356fa8e tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:42.177264 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9a27ebf4-7d9b-4387-8cc4-9ed38356fa8e tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63" status: 200 len: 1272 microversion: 2.1 time: 0.241758 Oct 17 13:56:42.192794 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2341/4557] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:41 2022] GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63 => generated 1272 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:42.217400 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e942f3a1-51cb-4657-96f3-b6978da1d16c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:42.230914 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e942f3a1-51cb-4657-96f3-b6978da1d16c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/d9e53a8a-357e-4587-a2a2-289135b37879" status: 200 len: 1316 microversion: 2.1 time: 0.251833 Oct 17 13:56:42.231868 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2217/4558] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:41 2022] GET /compute/v2.1/servers/d9e53a8a-357e-4587-a2a2-289135b37879 => generated 1316 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:56:42.322878 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-05a1aadc-1ebb-4fc0-93b1-914331d66f60 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a6c5373-259f-4029-aa7e-05d830f71eff"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:56:42.325652 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-05a1aadc-1ebb-4fc0-93b1-914331d66f60 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 2660a6f7-5d40-4205-ad68-abf319f1c4c3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:42.333757 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-05a1aadc-1ebb-4fc0-93b1-914331d66f60 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:42.334699 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-05a1aadc-1ebb-4fc0-93b1-914331d66f60 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:42.335240 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-05a1aadc-1ebb-4fc0-93b1-914331d66f60 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:42.336308 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-05a1aadc-1ebb-4fc0-93b1-914331d66f60 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:42.337050 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-05a1aadc-1ebb-4fc0-93b1-914331d66f60 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:42.337820 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-05a1aadc-1ebb-4fc0-93b1-914331d66f60 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:42.872163 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-05a1aadc-1ebb-4fc0-93b1-914331d66f60 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "POST /compute/v2.1/servers/2660a6f7-5d40-4205-ad68-abf319f1c4c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.554284 Oct 17 13:56:42.873291 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2342/4559] 10.222.0.79 () {60 vars in 1323 bytes} [Mon Oct 17 13:56:42 2022] POST /compute/v2.1/servers/2660a6f7-5d40-4205-ad68-abf319f1c4c3/os-volume_attachments => generated 194 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:56:43.206231 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ba392a96-8b05-4e1c-acb9-812609e656d8 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:43.207799 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ba392a96-8b05-4e1c-acb9-812609e656d8 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: 70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:43.222765 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ba392a96-8b05-4e1c-acb9-812609e656d8 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:43.235144 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ba392a96-8b05-4e1c-acb9-812609e656d8 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:43.237288 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ba392a96-8b05-4e1c-acb9-812609e656d8 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:43.241315 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ba392a96-8b05-4e1c-acb9-812609e656d8 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:43.245089 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ba392a96-8b05-4e1c-acb9-812609e656d8 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:43.246531 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ba392a96-8b05-4e1c-acb9-812609e656d8 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:43.482585 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-109abc43-5c6d-430c-b561-82b80128bbc6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:56:43.486258 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-109abc43-5c6d-430c-b561-82b80128bbc6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:43.514822 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-109abc43-5c6d-430c-b561-82b80128bbc6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:43.515674 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-109abc43-5c6d-430c-b561-82b80128bbc6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:43.516355 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-109abc43-5c6d-430c-b561-82b80128bbc6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:43.521814 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-109abc43-5c6d-430c-b561-82b80128bbc6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:43.522618 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-109abc43-5c6d-430c-b561-82b80128bbc6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:43.523316 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-109abc43-5c6d-430c-b561-82b80128bbc6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:43.603696 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ba392a96-8b05-4e1c-acb9-812609e656d8 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:43.612659 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ba392a96-8b05-4e1c-acb9-812609e656d8 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63" status: 200 len: 1314 microversion: 2.1 time: 0.412580 Oct 17 13:56:43.619936 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2343/4560] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:43 2022] GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63 => generated 1314 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:56:43.632223 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e4dde3a0-885b-47ad-a18a-d6f80540911c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:43.633072 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e4dde3a0-885b-47ad-a18a-d6f80540911c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: d9e53a8a-357e-4587-a2a2-289135b37879] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:43.646359 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e4dde3a0-885b-47ad-a18a-d6f80540911c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:43.647299 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e4dde3a0-885b-47ad-a18a-d6f80540911c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:43.650911 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e4dde3a0-885b-47ad-a18a-d6f80540911c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:43.651854 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e4dde3a0-885b-47ad-a18a-d6f80540911c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:43.652551 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e4dde3a0-885b-47ad-a18a-d6f80540911c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:43.653168 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e4dde3a0-885b-47ad-a18a-d6f80540911c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:43.677441 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-e4dde3a0-885b-47ad-a18a-d6f80540911c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] HTTP exception thrown: Instance d9e53a8a-357e-4587-a2a2-289135b37879 could not be found. Oct 17 13:56:43.682731 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-109abc43-5c6d-430c-b561-82b80128bbc6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "POST /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d/action" status: 202 len: 0 microversion: 2.1 time: 0.765009 Oct 17 13:56:43.684803 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2218/4561] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:56:42 2022] POST /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d/action => generated 0 bytes in 768 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e4dde3a0-885b-47ad-a18a-d6f80540911c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Request method failure captured: Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/d9e53a8a-357e-4587-a2a2-289135b37879 HTTP/1.1 Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTV7LY5HyKXIBiWDJCG3V5sT42rtCOx1a0oRMtoibd5F_sflHwMTlRe9Y_uOa1HxVMLf4skT3kvoUZ584fC2ohAV2v8XUvXrQcJEEPLKlU8mLvFkUN1JC352BF9fy9_Q0qQLABy1MIy7jPkSZI0xF-7yfpY_h22PPPDKIkDzzcK6D9CQ Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 4fa57e8772684c93a406f3d01da2af88 Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServersTestJSON-749544598 Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4fa57e8772684c93a406f3d01da2af88", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServersTestJSON-749544598 Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 4fa57e8772684c93a406f3d01da2af88 Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServersTestJSON-749544598 Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServersTestJSON-749544598-project Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: d78348abc02a4bb892902b0dd3bcfd6a Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServersTestJSON-749544598-project Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance d9e53a8a-357e-4587-a2a2-289135b37879 could not be found. Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'd9e53a8a-357e-4587-a2a2-289135b37879'} Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9e53a8a-357e-4587-a2a2-289135b37879 could not be found. Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9e53a8a-357e-4587-a2a2-289135b37879 could not be found. Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:56:43.689235 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:56:43.695092 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:56:43.695092 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:56:43.695092 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:56:43.695092 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:56:43.695092 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9e53a8a-357e-4587-a2a2-289135b37879 could not be found. Oct 17 13:56:43.695092 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:56:43.695092 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e4dde3a0-885b-47ad-a18a-d6f80540911c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Returning 404 to user: Instance d9e53a8a-357e-4587-a2a2-289135b37879 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:56:43.695092 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e4dde3a0-885b-47ad-a18a-d6f80540911c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/d9e53a8a-357e-4587-a2a2-289135b37879" status: 404 len: 111 microversion: 2.1 time: 0.062405 Oct 17 13:56:43.695092 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2344/4562] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:43 2022] GET /compute/v2.1/servers/d9e53a8a-357e-4587-a2a2-289135b37879 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:56:43.699965 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-18e8776f-4ad6-42dc-be50-d7b82675ebbf tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '.version_select at 0x7f7cd41b0670>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:43.704845 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ce6b295b-97b0-4271-8089-3e01d66f4964 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:43.705852 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ce6b295b-97b0-4271-8089-3e01d66f4964 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:43.716137 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ce6b295b-97b0-4271-8089-3e01d66f4964 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:43.717435 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ce6b295b-97b0-4271-8089-3e01d66f4964 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:43.718378 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ce6b295b-97b0-4271-8089-3e01d66f4964 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:43.719555 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ce6b295b-97b0-4271-8089-3e01d66f4964 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:43.720258 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ce6b295b-97b0-4271-8089-3e01d66f4964 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:43.720928 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ce6b295b-97b0-4271-8089-3e01d66f4964 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:43.746026 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-18e8776f-4ad6-42dc-be50-d7b82675ebbf tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-key-416480651" status: 202 len: 0 microversion: 2.1 time: 0.049979 Oct 17 13:56:43.746992 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2345/4563] 10.222.0.79 () {58 vars in 1206 bytes} [Mon Oct 17 13:56:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-416480651 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:56:44.127035 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7afbd276-15d8-4352-97b3-ebd59c169bf2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-487607560", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "57c5839d-0220-4c16-a56e-f44ad4323cc7"}]}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:56:44.152613 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ce6b295b-97b0-4271-8089-3e01d66f4964 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:44.161546 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ce6b295b-97b0-4271-8089-3e01d66f4964 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1668 microversion: 2.1 time: 0.472330 Oct 17 13:56:44.180731 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2219/4564] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:43 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1668 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:44.199810 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-7afbd276-15d8-4352-97b3-ebd59c169bf2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] validate_networks() for [('57c5839d-0220-4c16-a56e-f44ad4323cc7', None, None, None, None, None)] {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:56:44.641937 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b4ff883e-7b71-41c0-b3f7-963da201750d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:44.642564 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b4ff883e-7b71-41c0-b3f7-963da201750d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: 70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:44.655477 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b4ff883e-7b71-41c0-b3f7-963da201750d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:44.657205 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b4ff883e-7b71-41c0-b3f7-963da201750d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:44.657910 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b4ff883e-7b71-41c0-b3f7-963da201750d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:44.658886 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b4ff883e-7b71-41c0-b3f7-963da201750d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:44.659622 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b4ff883e-7b71-41c0-b3f7-963da201750d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:44.660256 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b4ff883e-7b71-41c0-b3f7-963da201750d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:45.476030 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b4ff883e-7b71-41c0-b3f7-963da201750d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:45.483880 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b4ff883e-7b71-41c0-b3f7-963da201750d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63" status: 200 len: 1314 microversion: 2.1 time: 0.845831 Oct 17 13:56:45.484449 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2220/4565] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:44 2022] GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63 => generated 1314 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:56:45.519355 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-48dd905a-fa2d-45b5-abdf-06f036735fa5 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:45.520267 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-48dd905a-fa2d-45b5-abdf-06f036735fa5 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:45.529238 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48dd905a-fa2d-45b5-abdf-06f036735fa5 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:45.529896 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48dd905a-fa2d-45b5-abdf-06f036735fa5 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:45.530477 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48dd905a-fa2d-45b5-abdf-06f036735fa5 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:45.544208 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48dd905a-fa2d-45b5-abdf-06f036735fa5 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:45.544942 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48dd905a-fa2d-45b5-abdf-06f036735fa5 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:45.545529 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48dd905a-fa2d-45b5-abdf-06f036735fa5 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:46.148162 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-7afbd276-15d8-4352-97b3-ebd59c169bf2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:56:46.148709 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-7afbd276-15d8-4352-97b3-ebd59c169bf2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:56:46.149105 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-7afbd276-15d8-4352-97b3-ebd59c169bf2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:56:46.149520 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-7afbd276-15d8-4352-97b3-ebd59c169bf2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:56:46.149930 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-7afbd276-15d8-4352-97b3-ebd59c169bf2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:56:46.166691 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7afbd276-15d8-4352-97b3-ebd59c169bf2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:46.167088 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7afbd276-15d8-4352-97b3-ebd59c169bf2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:46.167551 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7afbd276-15d8-4352-97b3-ebd59c169bf2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:46.168886 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7afbd276-15d8-4352-97b3-ebd59c169bf2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:46.169643 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7afbd276-15d8-4352-97b3-ebd59c169bf2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:46.174190 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7afbd276-15d8-4352-97b3-ebd59c169bf2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:46.267554 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-7afbd276-15d8-4352-97b3-ebd59c169bf2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Getting quotas for project 4fa57e8772684c93a406f3d01da2af88. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:56:46.274974 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-7afbd276-15d8-4352-97b3-ebd59c169bf2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Getting quotas for user d78348abc02a4bb892902b0dd3bcfd6a and project 4fa57e8772684c93a406f3d01da2af88. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:56:46.308793 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7afbd276-15d8-4352-97b3-ebd59c169bf2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:56:46.312829 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7afbd276-15d8-4352-97b3-ebd59c169bf2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: a48e28ae-e228-462b-81eb-95f712dc0800] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:56:46.401673 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7afbd276-15d8-4352-97b3-ebd59c169bf2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.278500 Oct 17 13:56:46.407930 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2346/4566] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:56:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2286 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:56:46.424949 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-cf943942-427e-4a56-8eaa-88fb26d07ad6 req-78dad2a1-b74e-4be9-9408-93cceee5db56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63", "tag": "8db93f70-b338-4752-a078-bf880d8f65a4"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:56:46.463605 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-cf943942-427e-4a56-8eaa-88fb26d07ad6 req-78dad2a1-b74e-4be9-9408-93cceee5db56 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:46.464307 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-cf943942-427e-4a56-8eaa-88fb26d07ad6 req-78dad2a1-b74e-4be9-9408-93cceee5db56 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:46.464755 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-cf943942-427e-4a56-8eaa-88fb26d07ad6 req-78dad2a1-b74e-4be9-9408-93cceee5db56 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:46.508574 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-cf943942-427e-4a56-8eaa-88fb26d07ad6 req-78dad2a1-b74e-4be9-9408-93cceee5db56 service nova] Creating event network-changed:8db93f70-b338-4752-a078-bf880d8f65a4 for instance 70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63 on n-h2-854247-14 Oct 17 13:56:46.521859 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-cf943942-427e-4a56-8eaa-88fb26d07ad6 req-78dad2a1-b74e-4be9-9408-93cceee5db56 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108829 Oct 17 13:56:46.522735 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2347/4567] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:56:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:56:46.538368 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a3d25583-e4aa-489d-9003-bc51080586c8 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:46.539943 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a3d25583-e4aa-489d-9003-bc51080586c8 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: a48e28ae-e228-462b-81eb-95f712dc0800] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:46.620700 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-48dd905a-fa2d-45b5-abdf-06f036735fa5 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:46.635008 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-48dd905a-fa2d-45b5-abdf-06f036735fa5 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1668 microversion: 2.1 time: 1.129208 Oct 17 13:56:46.643337 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2221/4568] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:45 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1668 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:46.762174 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a3d25583-e4aa-489d-9003-bc51080586c8 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:46.772316 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a3d25583-e4aa-489d-9003-bc51080586c8 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/a48e28ae-e228-462b-81eb-95f712dc0800" status: 200 len: 1208 microversion: 2.1 time: 0.246736 Oct 17 13:56:46.773990 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2348/4569] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:46 2022] GET /compute/v2.1/servers/a48e28ae-e228-462b-81eb-95f712dc0800 => generated 1208 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:46.786748 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e8dbd77e-5097-42b2-8405-102e1655bb6d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:46.787575 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e8dbd77e-5097-42b2-8405-102e1655bb6d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: 70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:46.798063 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e8dbd77e-5097-42b2-8405-102e1655bb6d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:46.798761 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e8dbd77e-5097-42b2-8405-102e1655bb6d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:46.799387 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e8dbd77e-5097-42b2-8405-102e1655bb6d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:46.800673 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e8dbd77e-5097-42b2-8405-102e1655bb6d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:46.801382 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e8dbd77e-5097-42b2-8405-102e1655bb6d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:46.801957 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e8dbd77e-5097-42b2-8405-102e1655bb6d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:46.995865 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c831e4fd-d1b7-45c9-9731-e984880f0eaf tempest-PortsAdminExtendedAttrsIpV6TestJSON-154951155 tempest-PortsAdminExtendedAttrsIpV6TestJSON-154951155-project-admin] Calling method '.version_select at 0x7f7cd46f7e50>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:46.998197 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c831e4fd-d1b7-45c9-9731-e984880f0eaf tempest-PortsAdminExtendedAttrsIpV6TestJSON-154951155 tempest-PortsAdminExtendedAttrsIpV6TestJSON-154951155-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:46.998937 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c831e4fd-d1b7-45c9-9731-e984880f0eaf tempest-PortsAdminExtendedAttrsIpV6TestJSON-154951155 tempest-PortsAdminExtendedAttrsIpV6TestJSON-154951155-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:46.999630 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c831e4fd-d1b7-45c9-9731-e984880f0eaf tempest-PortsAdminExtendedAttrsIpV6TestJSON-154951155 tempest-PortsAdminExtendedAttrsIpV6TestJSON-154951155-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:47.049775 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c831e4fd-d1b7-45c9-9731-e984880f0eaf tempest-PortsAdminExtendedAttrsIpV6TestJSON-154951155 tempest-PortsAdminExtendedAttrsIpV6TestJSON-154951155-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:47.052434 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c831e4fd-d1b7-45c9-9731-e984880f0eaf tempest-PortsAdminExtendedAttrsIpV6TestJSON-154951155 tempest-PortsAdminExtendedAttrsIpV6TestJSON-154951155-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:47.054466 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c831e4fd-d1b7-45c9-9731-e984880f0eaf tempest-PortsAdminExtendedAttrsIpV6TestJSON-154951155 tempest-PortsAdminExtendedAttrsIpV6TestJSON-154951155-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:47.085703 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c831e4fd-d1b7-45c9-9731-e984880f0eaf tempest-PortsAdminExtendedAttrsIpV6TestJSON-154951155 tempest-PortsAdminExtendedAttrsIpV6TestJSON-154951155-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:47.087271 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c831e4fd-d1b7-45c9-9731-e984880f0eaf tempest-PortsAdminExtendedAttrsIpV6TestJSON-154951155 tempest-PortsAdminExtendedAttrsIpV6TestJSON-154951155-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:47.089999 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c831e4fd-d1b7-45c9-9731-e984880f0eaf tempest-PortsAdminExtendedAttrsIpV6TestJSON-154951155 tempest-PortsAdminExtendedAttrsIpV6TestJSON-154951155-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:47.113081 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c831e4fd-d1b7-45c9-9731-e984880f0eaf tempest-PortsAdminExtendedAttrsIpV6TestJSON-154951155 tempest-PortsAdminExtendedAttrsIpV6TestJSON-154951155-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.468344 Oct 17 13:56:47.116984 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2222/4570] 10.222.0.79 () {58 vars in 1146 bytes} [Mon Oct 17 13:56:46 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:56:47.581723 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e8dbd77e-5097-42b2-8405-102e1655bb6d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:47.590489 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e8dbd77e-5097-42b2-8405-102e1655bb6d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63" status: 200 len: 1314 microversion: 2.1 time: 0.814985 Oct 17 13:56:47.593830 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2349/4571] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:46 2022] GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63 => generated 1314 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:47.658495 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8a87b958-8919-4c68-a96e-7eeb7006d90b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:47.660029 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8a87b958-8919-4c68-a96e-7eeb7006d90b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:47.672100 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8a87b958-8919-4c68-a96e-7eeb7006d90b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:47.674052 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8a87b958-8919-4c68-a96e-7eeb7006d90b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:47.676992 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8a87b958-8919-4c68-a96e-7eeb7006d90b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:47.678205 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8a87b958-8919-4c68-a96e-7eeb7006d90b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:47.680469 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8a87b958-8919-4c68-a96e-7eeb7006d90b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:47.683683 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8a87b958-8919-4c68-a96e-7eeb7006d90b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:47.796846 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-274f91d0-9ed4-4860-a26d-86230ee23755 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:47.817725 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-274f91d0-9ed4-4860-a26d-86230ee23755 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: a48e28ae-e228-462b-81eb-95f712dc0800] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:47.837289 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-274f91d0-9ed4-4860-a26d-86230ee23755 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:47.840393 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-274f91d0-9ed4-4860-a26d-86230ee23755 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:47.841091 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-274f91d0-9ed4-4860-a26d-86230ee23755 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:47.843194 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-274f91d0-9ed4-4860-a26d-86230ee23755 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:47.846326 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-274f91d0-9ed4-4860-a26d-86230ee23755 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:47.848639 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-274f91d0-9ed4-4860-a26d-86230ee23755 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:48.032896 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-274f91d0-9ed4-4860-a26d-86230ee23755 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:48.045659 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-274f91d0-9ed4-4860-a26d-86230ee23755 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/a48e28ae-e228-462b-81eb-95f712dc0800" status: 200 len: 1260 microversion: 2.1 time: 0.252955 Oct 17 13:56:48.048411 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2350/4572] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:47 2022] GET /compute/v2.1/servers/a48e28ae-e228-462b-81eb-95f712dc0800 => generated 1260 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:48.081610 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8a87b958-8919-4c68-a96e-7eeb7006d90b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:48.111951 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8a87b958-8919-4c68-a96e-7eeb7006d90b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1666 microversion: 2.1 time: 0.457740 Oct 17 13:56:48.114875 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2223/4573] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:47 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1666 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:48.622858 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3b56058a-8b15-42df-bd39-add73b81115b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:48.623497 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3b56058a-8b15-42df-bd39-add73b81115b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: 70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:48.626540 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:56:48.641917 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3b56058a-8b15-42df-bd39-add73b81115b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:48.642423 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3b56058a-8b15-42df-bd39-add73b81115b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:48.650863 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3b56058a-8b15-42df-bd39-add73b81115b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:48.651718 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3b56058a-8b15-42df-bd39-add73b81115b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:48.652352 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3b56058a-8b15-42df-bd39-add73b81115b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:48.653793 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3b56058a-8b15-42df-bd39-add73b81115b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:48.709467 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:56:49.074507 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-dc14a9fa-51de-446f-a34a-13f2453099fb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:49.075131 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-dc14a9fa-51de-446f-a34a-13f2453099fb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: a48e28ae-e228-462b-81eb-95f712dc0800] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:49.085506 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3b56058a-8b15-42df-bd39-add73b81115b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:49.096530 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3b56058a-8b15-42df-bd39-add73b81115b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63" status: 200 len: 1314 microversion: 2.1 time: 0.478347 Oct 17 13:56:49.097395 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2351/4574] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:48 2022] GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63 => generated 1314 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:49.111813 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:56:49.117532 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dc14a9fa-51de-446f-a34a-13f2453099fb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:49.118445 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dc14a9fa-51de-446f-a34a-13f2453099fb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:49.121866 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dc14a9fa-51de-446f-a34a-13f2453099fb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:49.122865 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dc14a9fa-51de-446f-a34a-13f2453099fb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:49.125961 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dc14a9fa-51de-446f-a34a-13f2453099fb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:49.126431 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dc14a9fa-51de-446f-a34a-13f2453099fb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:49.292589 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-dc14a9fa-51de-446f-a34a-13f2453099fb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:49.309066 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-dc14a9fa-51de-446f-a34a-13f2453099fb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/a48e28ae-e228-462b-81eb-95f712dc0800" status: 200 len: 1266 microversion: 2.1 time: 0.238990 Oct 17 13:56:49.313455 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2224/4575] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:49 2022] GET /compute/v2.1/servers/a48e28ae-e228-462b-81eb-95f712dc0800 => generated 1266 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:56:50.122077 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a67ade9b-238e-4cf9-9d0c-769e325aa319 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:50.122839 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a67ade9b-238e-4cf9-9d0c-769e325aa319 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: 70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:50.144280 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a67ade9b-238e-4cf9-9d0c-769e325aa319 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:50.145053 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a67ade9b-238e-4cf9-9d0c-769e325aa319 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:50.148672 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a67ade9b-238e-4cf9-9d0c-769e325aa319 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:50.151402 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a67ade9b-238e-4cf9-9d0c-769e325aa319 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:50.153499 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a67ade9b-238e-4cf9-9d0c-769e325aa319 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:50.155223 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a67ade9b-238e-4cf9-9d0c-769e325aa319 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:50.337374 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-18fe6064-6102-40aa-aa22-8fec05724951 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:50.338814 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-18fe6064-6102-40aa-aa22-8fec05724951 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: a48e28ae-e228-462b-81eb-95f712dc0800] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:50.347625 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=8 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:56:50.356846 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-18fe6064-6102-40aa-aa22-8fec05724951 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:50.357952 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-18fe6064-6102-40aa-aa22-8fec05724951 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:50.360126 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-18fe6064-6102-40aa-aa22-8fec05724951 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:50.361378 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-18fe6064-6102-40aa-aa22-8fec05724951 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:50.363105 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-18fe6064-6102-40aa-aa22-8fec05724951 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:50.365532 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-18fe6064-6102-40aa-aa22-8fec05724951 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:51.087385 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a67ade9b-238e-4cf9-9d0c-769e325aa319 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:51.098953 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a67ade9b-238e-4cf9-9d0c-769e325aa319 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63" status: 200 len: 1314 microversion: 2.1 time: 0.981566 Oct 17 13:56:51.100819 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2352/4576] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:50 2022] GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63 => generated 1314 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:51.569623 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-18fe6064-6102-40aa-aa22-8fec05724951 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:51.578254 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-18fe6064-6102-40aa-aa22-8fec05724951 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/a48e28ae-e228-462b-81eb-95f712dc0800" status: 200 len: 1308 microversion: 2.1 time: 1.245768 Oct 17 13:56:51.609366 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2225/4577] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:50 2022] GET /compute/v2.1/servers/a48e28ae-e228-462b-81eb-95f712dc0800 => generated 1308 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:51.921652 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-ce333166-36f0-49f4-983d-5ccb9060009f req-f989c1ca-21d1-426e-a561-b9a459d21fb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a48e28ae-e228-462b-81eb-95f712dc0800", "tag": "3950fed2-52c1-4cc0-b5ed-4eb1fd9675ee"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:56:51.937059 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-ce333166-36f0-49f4-983d-5ccb9060009f req-f989c1ca-21d1-426e-a561-b9a459d21fb6 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:51.937540 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-ce333166-36f0-49f4-983d-5ccb9060009f req-f989c1ca-21d1-426e-a561-b9a459d21fb6 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:51.941293 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-ce333166-36f0-49f4-983d-5ccb9060009f req-f989c1ca-21d1-426e-a561-b9a459d21fb6 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:51.974767 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-ce333166-36f0-49f4-983d-5ccb9060009f req-f989c1ca-21d1-426e-a561-b9a459d21fb6 service nova] Creating event network-changed:3950fed2-52c1-4cc0-b5ed-4eb1fd9675ee for instance a48e28ae-e228-462b-81eb-95f712dc0800 on n-h1-854247-14 Oct 17 13:56:51.985395 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-ce333166-36f0-49f4-983d-5ccb9060009f req-f989c1ca-21d1-426e-a561-b9a459d21fb6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068322 Oct 17 13:56:51.986719 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2353/4578] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:56:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:56:52.124459 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a3734e21-baa4-4cd2-9f5a-bbe3d09f3c2b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:52.125314 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a3734e21-baa4-4cd2-9f5a-bbe3d09f3c2b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: 70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:52.134337 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a3734e21-baa4-4cd2-9f5a-bbe3d09f3c2b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:52.134835 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a3734e21-baa4-4cd2-9f5a-bbe3d09f3c2b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:52.135311 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a3734e21-baa4-4cd2-9f5a-bbe3d09f3c2b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:52.136017 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a3734e21-baa4-4cd2-9f5a-bbe3d09f3c2b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:52.136468 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a3734e21-baa4-4cd2-9f5a-bbe3d09f3c2b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:52.137092 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a3734e21-baa4-4cd2-9f5a-bbe3d09f3c2b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:52.187083 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:56:52.430704 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a3734e21-baa4-4cd2-9f5a-bbe3d09f3c2b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:52.443288 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a3734e21-baa4-4cd2-9f5a-bbe3d09f3c2b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63" status: 200 len: 1314 microversion: 2.1 time: 0.322205 Oct 17 13:56:52.445496 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2226/4579] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:52 2022] GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63 => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:52.608834 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-bc53aea0-a2b7-421d-b938-723c5445be30 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:52.609853 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-bc53aea0-a2b7-421d-b938-723c5445be30 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: a48e28ae-e228-462b-81eb-95f712dc0800] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:52.625999 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bc53aea0-a2b7-421d-b938-723c5445be30 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:52.628707 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bc53aea0-a2b7-421d-b938-723c5445be30 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:52.631748 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bc53aea0-a2b7-421d-b938-723c5445be30 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:52.633496 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bc53aea0-a2b7-421d-b938-723c5445be30 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:52.635761 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bc53aea0-a2b7-421d-b938-723c5445be30 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:52.636394 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bc53aea0-a2b7-421d-b938-723c5445be30 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:52.875644 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-e2af85c5-88a5-4858-8e60-0a8796affa37 req-62180884-8f1f-4abb-9e32-c8357c1e66f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63", "name": "network-vif-plugged", "status": "completed", "tag": "8db93f70-b338-4752-a078-bf880d8f65a4"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:56:52.896596 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-e2af85c5-88a5-4858-8e60-0a8796affa37 req-62180884-8f1f-4abb-9e32-c8357c1e66f2 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:52.901424 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-bc53aea0-a2b7-421d-b938-723c5445be30 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:52.904136 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-e2af85c5-88a5-4858-8e60-0a8796affa37 req-62180884-8f1f-4abb-9e32-c8357c1e66f2 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:52.905041 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-e2af85c5-88a5-4858-8e60-0a8796affa37 req-62180884-8f1f-4abb-9e32-c8357c1e66f2 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:52.913277 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-bc53aea0-a2b7-421d-b938-723c5445be30 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/a48e28ae-e228-462b-81eb-95f712dc0800" status: 200 len: 1308 microversion: 2.1 time: 0.312492 Oct 17 13:56:52.928723 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2354/4580] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:52 2022] GET /compute/v2.1/servers/a48e28ae-e228-462b-81eb-95f712dc0800 => generated 1308 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:52.947433 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-e2af85c5-88a5-4858-8e60-0a8796affa37 req-62180884-8f1f-4abb-9e32-c8357c1e66f2 service nova] Creating event network-vif-plugged:8db93f70-b338-4752-a078-bf880d8f65a4 for instance 70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63 on n-h2-854247-14 Oct 17 13:56:52.953266 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-e2af85c5-88a5-4858-8e60-0a8796affa37 req-62180884-8f1f-4abb-9e32-c8357c1e66f2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081774 Oct 17 13:56:52.954629 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2227/4581] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:56:53.471325 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-de2c1dfe-d36c-42e0-9e41-85500c262240 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:53.472177 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-de2c1dfe-d36c-42e0-9e41-85500c262240 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: 70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:53.479447 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-de2c1dfe-d36c-42e0-9e41-85500c262240 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:53.480179 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-de2c1dfe-d36c-42e0-9e41-85500c262240 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:53.480610 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-de2c1dfe-d36c-42e0-9e41-85500c262240 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:53.482430 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-de2c1dfe-d36c-42e0-9e41-85500c262240 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:53.483056 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-de2c1dfe-d36c-42e0-9e41-85500c262240 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:53.483662 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-de2c1dfe-d36c-42e0-9e41-85500c262240 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:53.700287 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-de2c1dfe-d36c-42e0-9e41-85500c262240 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:53.711770 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-de2c1dfe-d36c-42e0-9e41-85500c262240 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63" status: 200 len: 1314 microversion: 2.1 time: 0.245688 Oct 17 13:56:53.712879 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2355/4582] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:53 2022] GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63 => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:53.941244 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3396f900-228e-4c49-8f90-db50b6a32dde tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:53.942262 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3396f900-228e-4c49-8f90-db50b6a32dde tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: a48e28ae-e228-462b-81eb-95f712dc0800] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:53.955865 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3396f900-228e-4c49-8f90-db50b6a32dde tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:53.958416 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3396f900-228e-4c49-8f90-db50b6a32dde tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:53.959037 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3396f900-228e-4c49-8f90-db50b6a32dde tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:53.960075 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3396f900-228e-4c49-8f90-db50b6a32dde tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:53.960209 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3396f900-228e-4c49-8f90-db50b6a32dde tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:53.960622 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3396f900-228e-4c49-8f90-db50b6a32dde tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:54.246501 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3396f900-228e-4c49-8f90-db50b6a32dde tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:54.278626 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3396f900-228e-4c49-8f90-db50b6a32dde tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/a48e28ae-e228-462b-81eb-95f712dc0800" status: 200 len: 1308 microversion: 2.1 time: 0.341662 Oct 17 13:56:54.295191 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2228/4583] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:53 2022] GET /compute/v2.1/servers/a48e28ae-e228-462b-81eb-95f712dc0800 => generated 1308 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:54.735855 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-964a84e5-0122-4f49-9446-dd98311ebeee tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:54.737099 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-964a84e5-0122-4f49-9446-dd98311ebeee tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: 70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:54.756072 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-964a84e5-0122-4f49-9446-dd98311ebeee tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:54.756925 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-964a84e5-0122-4f49-9446-dd98311ebeee tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:54.757638 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-964a84e5-0122-4f49-9446-dd98311ebeee tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:54.758546 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-964a84e5-0122-4f49-9446-dd98311ebeee tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:54.759255 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-964a84e5-0122-4f49-9446-dd98311ebeee tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:54.759742 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-964a84e5-0122-4f49-9446-dd98311ebeee tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:54.918203 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-964a84e5-0122-4f49-9446-dd98311ebeee tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:54.928164 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-964a84e5-0122-4f49-9446-dd98311ebeee tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63" status: 200 len: 1499 microversion: 2.1 time: 0.196414 Oct 17 13:56:54.929289 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2356/4584] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:54 2022] GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63 => generated 1499 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:54.954844 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4861cd9b-a338-4a33-8a7f-0f200b4d5b61 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:56:54.957816 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4861cd9b-a338-4a33-8a7f-0f200b4d5b61 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: 70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:54.965032 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4861cd9b-a338-4a33-8a7f-0f200b4d5b61 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:54.966019 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4861cd9b-a338-4a33-8a7f-0f200b4d5b61 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:54.966460 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4861cd9b-a338-4a33-8a7f-0f200b4d5b61 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:54.967149 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4861cd9b-a338-4a33-8a7f-0f200b4d5b61 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:54.967614 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4861cd9b-a338-4a33-8a7f-0f200b4d5b61 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:54.968028 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4861cd9b-a338-4a33-8a7f-0f200b4d5b61 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:54.997681 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-4861cd9b-a338-4a33-8a7f-0f200b4d5b61 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lazy-loading 'flavor' on Instance uuid 70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63 {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:56:55.119515 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4861cd9b-a338-4a33-8a7f-0f200b4d5b61 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "POST /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63/action" status: 200 len: 32 microversion: 2.1 time: 0.166748 Oct 17 13:56:55.131331 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2ecee956-a539-4aab-8823-665be00facc4 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:55.131965 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2229/4585] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:56:54 2022] POST /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63/action => generated 32 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:56:55.132100 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2ecee956-a539-4aab-8823-665be00facc4 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: 70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:55.139599 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2ecee956-a539-4aab-8823-665be00facc4 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:55.140941 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2ecee956-a539-4aab-8823-665be00facc4 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:55.141669 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2ecee956-a539-4aab-8823-665be00facc4 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:55.142610 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2ecee956-a539-4aab-8823-665be00facc4 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:55.143333 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2ecee956-a539-4aab-8823-665be00facc4 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:55.144039 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2ecee956-a539-4aab-8823-665be00facc4 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:55.308749 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3c0bb999-9b2e-4a63-b3b5-da28ca6b17ab tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:55.310172 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3c0bb999-9b2e-4a63-b3b5-da28ca6b17ab tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: a48e28ae-e228-462b-81eb-95f712dc0800] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:55.318761 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3c0bb999-9b2e-4a63-b3b5-da28ca6b17ab tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:55.319711 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3c0bb999-9b2e-4a63-b3b5-da28ca6b17ab tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:55.320316 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3c0bb999-9b2e-4a63-b3b5-da28ca6b17ab tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:55.321184 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3c0bb999-9b2e-4a63-b3b5-da28ca6b17ab tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:55.321625 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3c0bb999-9b2e-4a63-b3b5-da28ca6b17ab tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:55.322410 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3c0bb999-9b2e-4a63-b3b5-da28ca6b17ab tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:55.453432 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2ecee956-a539-4aab-8823-665be00facc4 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:55.462305 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2ecee956-a539-4aab-8823-665be00facc4 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63" status: 200 len: 1505 microversion: 2.1 time: 0.336312 Oct 17 13:56:55.462870 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2357/4586] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:55 2022] GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63 => generated 1505 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:56:55.617707 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3c0bb999-9b2e-4a63-b3b5-da28ca6b17ab tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:55.626168 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3c0bb999-9b2e-4a63-b3b5-da28ca6b17ab tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/a48e28ae-e228-462b-81eb-95f712dc0800" status: 200 len: 1308 microversion: 2.1 time: 0.323539 Oct 17 13:56:55.626761 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2230/4587] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:55 2022] GET /compute/v2.1/servers/a48e28ae-e228-462b-81eb-95f712dc0800 => generated 1308 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:56:56.488324 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f7015aff-fb8f-454c-90b5-218db881fa68 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:56.489625 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f7015aff-fb8f-454c-90b5-218db881fa68 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: 70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:56.496919 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:56:56.499545 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f7015aff-fb8f-454c-90b5-218db881fa68 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:56.500726 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f7015aff-fb8f-454c-90b5-218db881fa68 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:56.501355 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f7015aff-fb8f-454c-90b5-218db881fa68 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:56.502613 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f7015aff-fb8f-454c-90b5-218db881fa68 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:56.503434 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f7015aff-fb8f-454c-90b5-218db881fa68 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:56.504431 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f7015aff-fb8f-454c-90b5-218db881fa68 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:56.650730 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-35c28c73-683d-40d1-98ec-6e7aca776796 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:56.651574 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-35c28c73-683d-40d1-98ec-6e7aca776796 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: a48e28ae-e228-462b-81eb-95f712dc0800] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:56.659597 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-35c28c73-683d-40d1-98ec-6e7aca776796 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:56.660694 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-35c28c73-683d-40d1-98ec-6e7aca776796 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:56.661306 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-35c28c73-683d-40d1-98ec-6e7aca776796 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:56.662317 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-35c28c73-683d-40d1-98ec-6e7aca776796 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:56.662918 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-35c28c73-683d-40d1-98ec-6e7aca776796 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:56.663509 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-35c28c73-683d-40d1-98ec-6e7aca776796 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:56.675868 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f7015aff-fb8f-454c-90b5-218db881fa68 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:56.686722 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f7015aff-fb8f-454c-90b5-218db881fa68 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63" status: 200 len: 1505 microversion: 2.1 time: 0.202808 Oct 17 13:56:56.689250 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2358/4588] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:56 2022] GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63 => generated 1505 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:56.833182 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-35c28c73-683d-40d1-98ec-6e7aca776796 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:56.845518 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-35c28c73-683d-40d1-98ec-6e7aca776796 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/a48e28ae-e228-462b-81eb-95f712dc0800" status: 200 len: 1308 microversion: 2.1 time: 0.199459 Oct 17 13:56:56.846101 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2231/4589] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:56 2022] GET /compute/v2.1/servers/a48e28ae-e228-462b-81eb-95f712dc0800 => generated 1308 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:56:57.471802 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7a077c82-43c0-42f5-b867-0f79460bc1cf tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:57.472847 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7a077c82-43c0-42f5-b867-0f79460bc1cf tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 2660a6f7-5d40-4205-ad68-abf319f1c4c3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:57.475610 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=8 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:56:57.481733 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7a077c82-43c0-42f5-b867-0f79460bc1cf tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:57.482340 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7a077c82-43c0-42f5-b867-0f79460bc1cf tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:57.483038 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7a077c82-43c0-42f5-b867-0f79460bc1cf tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:57.483852 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7a077c82-43c0-42f5-b867-0f79460bc1cf tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:57.484371 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7a077c82-43c0-42f5-b867-0f79460bc1cf tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:57.484865 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7a077c82-43c0-42f5-b867-0f79460bc1cf tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:57.514311 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7a077c82-43c0-42f5-b867-0f79460bc1cf tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 2660a6f7-5d40-4205-ad68-abf319f1c4c3] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:56:57.685460 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7a077c82-43c0-42f5-b867-0f79460bc1cf tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "DELETE /compute/v2.1/servers/2660a6f7-5d40-4205-ad68-abf319f1c4c3" status: 204 len: 0 microversion: 2.1 time: 0.218679 Oct 17 13:56:57.689648 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2359/4590] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:56:57 2022] DELETE /compute/v2.1/servers/2660a6f7-5d40-4205-ad68-abf319f1c4c3 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:56:57.698365 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f6ec82b7-fd86-4531-8a49-460b9f62b4b4 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:57.699733 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f6ec82b7-fd86-4531-8a49-460b9f62b4b4 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 2660a6f7-5d40-4205-ad68-abf319f1c4c3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:57.712849 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4dac8da9-d8d8-470f-a2e0-bbedf4dea97b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:57.714243 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4dac8da9-d8d8-470f-a2e0-bbedf4dea97b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: 70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:57.715988 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f6ec82b7-fd86-4531-8a49-460b9f62b4b4 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:57.716664 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f6ec82b7-fd86-4531-8a49-460b9f62b4b4 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:57.717270 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f6ec82b7-fd86-4531-8a49-460b9f62b4b4 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:57.718135 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f6ec82b7-fd86-4531-8a49-460b9f62b4b4 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:57.722436 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f6ec82b7-fd86-4531-8a49-460b9f62b4b4 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:57.723381 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f6ec82b7-fd86-4531-8a49-460b9f62b4b4 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:57.723542 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4dac8da9-d8d8-470f-a2e0-bbedf4dea97b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:57.724646 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4dac8da9-d8d8-470f-a2e0-bbedf4dea97b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:57.730008 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4dac8da9-d8d8-470f-a2e0-bbedf4dea97b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:57.730844 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4dac8da9-d8d8-470f-a2e0-bbedf4dea97b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:57.731392 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4dac8da9-d8d8-470f-a2e0-bbedf4dea97b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:57.731829 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4dac8da9-d8d8-470f-a2e0-bbedf4dea97b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:58.045827 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4dac8da9-d8d8-470f-a2e0-bbedf4dea97b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:58.059276 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4dac8da9-d8d8-470f-a2e0-bbedf4dea97b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63" status: 200 len: 1505 microversion: 2.1 time: 0.351038 Oct 17 13:56:58.061490 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2360/4591] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:57 2022] GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63 => generated 1505 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:56:58.068934 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-fbe489f2-c2b6-4424-a61e-719c2ed9f239 req-309f70ab-ea1a-43a3-85ed-86b547e475a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a48e28ae-e228-462b-81eb-95f712dc0800", "name": "network-vif-plugged", "status": "completed", "tag": "3950fed2-52c1-4cc0-b5ed-4eb1fd9675ee"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:56:58.083665 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-fbe489f2-c2b6-4424-a61e-719c2ed9f239 req-309f70ab-ea1a-43a3-85ed-86b547e475a5 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:58.084278 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-fbe489f2-c2b6-4424-a61e-719c2ed9f239 req-309f70ab-ea1a-43a3-85ed-86b547e475a5 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:58.085194 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-fbe489f2-c2b6-4424-a61e-719c2ed9f239 req-309f70ab-ea1a-43a3-85ed-86b547e475a5 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:58.107522 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-fbe489f2-c2b6-4424-a61e-719c2ed9f239 req-309f70ab-ea1a-43a3-85ed-86b547e475a5 service nova] Creating event network-vif-plugged:3950fed2-52c1-4cc0-b5ed-4eb1fd9675ee for instance a48e28ae-e228-462b-81eb-95f712dc0800 on n-h1-854247-14 Oct 17 13:56:58.114121 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-fbe489f2-c2b6-4424-a61e-719c2ed9f239 req-309f70ab-ea1a-43a3-85ed-86b547e475a5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050555 Oct 17 13:56:58.114729 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f6ec82b7-fd86-4531-8a49-460b9f62b4b4 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:58.116282 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2361/4592] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:56:58.125023 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-50ec3335-3440-4cfb-92e5-8831295d4143 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:58.126193 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-50ec3335-3440-4cfb-92e5-8831295d4143 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: a48e28ae-e228-462b-81eb-95f712dc0800] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:58.127116 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f6ec82b7-fd86-4531-8a49-460b9f62b4b4 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/2660a6f7-5d40-4205-ad68-abf319f1c4c3" status: 200 len: 1555 microversion: 2.1 time: 0.431995 Oct 17 13:56:58.127763 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2232/4593] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:57 2022] GET /compute/v2.1/servers/2660a6f7-5d40-4205-ad68-abf319f1c4c3 => generated 1555 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:58.134681 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-50ec3335-3440-4cfb-92e5-8831295d4143 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:58.135344 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-50ec3335-3440-4cfb-92e5-8831295d4143 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:58.135844 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-50ec3335-3440-4cfb-92e5-8831295d4143 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:58.136610 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-50ec3335-3440-4cfb-92e5-8831295d4143 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:58.137230 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-50ec3335-3440-4cfb-92e5-8831295d4143 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:58.137843 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-50ec3335-3440-4cfb-92e5-8831295d4143 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:58.290891 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-50ec3335-3440-4cfb-92e5-8831295d4143 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:58.299120 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-50ec3335-3440-4cfb-92e5-8831295d4143 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/a48e28ae-e228-462b-81eb-95f712dc0800" status: 200 len: 1308 microversion: 2.1 time: 0.179684 Oct 17 13:56:58.299720 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2362/4594] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:58 2022] GET /compute/v2.1/servers/a48e28ae-e228-462b-81eb-95f712dc0800 => generated 1308 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:59.088970 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-cccba051-1c97-4862-80b9-542531be8678 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:59.090314 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-cccba051-1c97-4862-80b9-542531be8678 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: 70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:59.099670 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cccba051-1c97-4862-80b9-542531be8678 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:59.103304 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cccba051-1c97-4862-80b9-542531be8678 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:59.109833 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cccba051-1c97-4862-80b9-542531be8678 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:59.111103 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cccba051-1c97-4862-80b9-542531be8678 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:59.111757 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cccba051-1c97-4862-80b9-542531be8678 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:59.112177 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cccba051-1c97-4862-80b9-542531be8678 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:59.153929 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9c525a13-7905-4d27-9ebb-f01d1f23b9f0 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:59.154531 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9c525a13-7905-4d27-9ebb-f01d1f23b9f0 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 2660a6f7-5d40-4205-ad68-abf319f1c4c3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:59.163689 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c525a13-7905-4d27-9ebb-f01d1f23b9f0 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:59.164173 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c525a13-7905-4d27-9ebb-f01d1f23b9f0 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:59.164602 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c525a13-7905-4d27-9ebb-f01d1f23b9f0 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:59.165304 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c525a13-7905-4d27-9ebb-f01d1f23b9f0 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:59.166004 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c525a13-7905-4d27-9ebb-f01d1f23b9f0 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:59.166579 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c525a13-7905-4d27-9ebb-f01d1f23b9f0 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:59.397084 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-cccba051-1c97-4862-80b9-542531be8678 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:59.405948 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-cccba051-1c97-4862-80b9-542531be8678 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63" status: 200 len: 1505 microversion: 2.1 time: 0.321794 Oct 17 13:56:59.406771 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2233/4595] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:59 2022] GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63 => generated 1505 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:59.412341 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b68f8186-9e06-424b-a4d9-5f4a1f7b4de9 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:59.412958 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b68f8186-9e06-424b-a4d9-5f4a1f7b4de9 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: a48e28ae-e228-462b-81eb-95f712dc0800] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:59.419319 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b68f8186-9e06-424b-a4d9-5f4a1f7b4de9 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:59.419807 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b68f8186-9e06-424b-a4d9-5f4a1f7b4de9 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:59.420239 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b68f8186-9e06-424b-a4d9-5f4a1f7b4de9 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:59.421592 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b68f8186-9e06-424b-a4d9-5f4a1f7b4de9 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:59.422046 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b68f8186-9e06-424b-a4d9-5f4a1f7b4de9 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:59.422689 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b68f8186-9e06-424b-a4d9-5f4a1f7b4de9 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:59.446088 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9c525a13-7905-4d27-9ebb-f01d1f23b9f0 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:59.456816 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9c525a13-7905-4d27-9ebb-f01d1f23b9f0 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/2660a6f7-5d40-4205-ad68-abf319f1c4c3" status: 200 len: 1555 microversion: 2.1 time: 0.306853 Oct 17 13:56:59.461410 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2363/4596] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:59 2022] GET /compute/v2.1/servers/2660a6f7-5d40-4205-ad68-abf319f1c4c3 => generated 1555 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:59.715269 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b68f8186-9e06-424b-a4d9-5f4a1f7b4de9 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:59.729622 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b68f8186-9e06-424b-a4d9-5f4a1f7b4de9 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/a48e28ae-e228-462b-81eb-95f712dc0800" status: 200 len: 1308 microversion: 2.1 time: 0.321590 Oct 17 13:56:59.743413 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2234/4597] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:59 2022] GET /compute/v2.1/servers/a48e28ae-e228-462b-81eb-95f712dc0800 => generated 1308 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:00.433783 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2c2fa693-3ae2-4bc0-b5fb-4746c19a75e2 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:00.434463 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2c2fa693-3ae2-4bc0-b5fb-4746c19a75e2 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: 70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:00.453220 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2c2fa693-3ae2-4bc0-b5fb-4746c19a75e2 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:00.455906 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2c2fa693-3ae2-4bc0-b5fb-4746c19a75e2 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:00.459309 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2c2fa693-3ae2-4bc0-b5fb-4746c19a75e2 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:00.460364 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2c2fa693-3ae2-4bc0-b5fb-4746c19a75e2 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:00.465258 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2c2fa693-3ae2-4bc0-b5fb-4746c19a75e2 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:00.466002 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2c2fa693-3ae2-4bc0-b5fb-4746c19a75e2 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:00.484789 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d6ba6f3d-e974-4803-b284-e2368f08fccb tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:00.485547 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d6ba6f3d-e974-4803-b284-e2368f08fccb tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 2660a6f7-5d40-4205-ad68-abf319f1c4c3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:00.503401 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d6ba6f3d-e974-4803-b284-e2368f08fccb tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:00.504118 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d6ba6f3d-e974-4803-b284-e2368f08fccb tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:00.505633 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d6ba6f3d-e974-4803-b284-e2368f08fccb tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:00.513788 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d6ba6f3d-e974-4803-b284-e2368f08fccb tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:00.517045 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d6ba6f3d-e974-4803-b284-e2368f08fccb tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:00.517939 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d6ba6f3d-e974-4803-b284-e2368f08fccb tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:00.753903 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d6ba6f3d-e974-4803-b284-e2368f08fccb tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:00.766657 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d6ba6f3d-e974-4803-b284-e2368f08fccb tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/2660a6f7-5d40-4205-ad68-abf319f1c4c3" status: 200 len: 1513 microversion: 2.1 time: 0.286213 Oct 17 13:57:00.768120 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2235/4598] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:00 2022] GET /compute/v2.1/servers/2660a6f7-5d40-4205-ad68-abf319f1c4c3 => generated 1513 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:00.780622 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-f7e59616-95b6-4c45-8528-11f5ae375b21 req-d00a8edf-085b-4201-87bc-85e639d5ac6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2660a6f7-5d40-4205-ad68-abf319f1c4c3", "name": "network-vif-deleted", "tag": "2b36567f-3803-44d6-9cc1-ca49ea27ee25"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:57:00.813898 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-f7e59616-95b6-4c45-8528-11f5ae375b21 req-d00a8edf-085b-4201-87bc-85e639d5ac6f service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:00.814395 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-f7e59616-95b6-4c45-8528-11f5ae375b21 req-d00a8edf-085b-4201-87bc-85e639d5ac6f service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:00.814830 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-f7e59616-95b6-4c45-8528-11f5ae375b21 req-d00a8edf-085b-4201-87bc-85e639d5ac6f service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:00.836505 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2c2fa693-3ae2-4bc0-b5fb-4746c19a75e2 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:00.844996 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2c2fa693-3ae2-4bc0-b5fb-4746c19a75e2 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63" status: 200 len: 1505 microversion: 2.1 time: 0.417207 Oct 17 13:57:00.847873 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-f7e59616-95b6-4c45-8528-11f5ae375b21 req-d00a8edf-085b-4201-87bc-85e639d5ac6f service nova] Creating event network-vif-deleted:2b36567f-3803-44d6-9cc1-ca49ea27ee25 for instance 2660a6f7-5d40-4205-ad68-abf319f1c4c3 on n-h1-854247-14 Oct 17 13:57:00.860773 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2364/4599] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:00 2022] GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63 => generated 1505 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:00.864636 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-f7e59616-95b6-4c45-8528-11f5ae375b21 req-d00a8edf-085b-4201-87bc-85e639d5ac6f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093415 Oct 17 13:57:00.867124 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2236/4600] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:57:00.878845 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-966796bd-c721-44a0-9c0c-a29ff8f91bc2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:00.885305 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-966796bd-c721-44a0-9c0c-a29ff8f91bc2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: a48e28ae-e228-462b-81eb-95f712dc0800] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:00.899253 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-966796bd-c721-44a0-9c0c-a29ff8f91bc2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:00.900355 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-966796bd-c721-44a0-9c0c-a29ff8f91bc2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:00.900948 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-966796bd-c721-44a0-9c0c-a29ff8f91bc2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:00.903837 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-966796bd-c721-44a0-9c0c-a29ff8f91bc2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:00.904449 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-966796bd-c721-44a0-9c0c-a29ff8f91bc2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:00.906338 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-966796bd-c721-44a0-9c0c-a29ff8f91bc2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:01.240208 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-966796bd-c721-44a0-9c0c-a29ff8f91bc2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:01.250386 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-966796bd-c721-44a0-9c0c-a29ff8f91bc2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/a48e28ae-e228-462b-81eb-95f712dc0800" status: 200 len: 1490 microversion: 2.1 time: 0.388477 Oct 17 13:57:01.250986 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2365/4601] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:00 2022] GET /compute/v2.1/servers/a48e28ae-e228-462b-81eb-95f712dc0800 => generated 1490 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:01.408944 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6ea302a0-e15c-4ff3-b55e-7722432e255c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-487607560", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "57c5839d-0220-4c16-a56e-f44ad4323cc7"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:57:01.498289 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-6ea302a0-e15c-4ff3-b55e-7722432e255c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] validate_networks() for [('57c5839d-0220-4c16-a56e-f44ad4323cc7', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:57:01.790686 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ef4bc42d-d527-4d31-9ace-3c9d818b9dbb tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:01.791978 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ef4bc42d-d527-4d31-9ace-3c9d818b9dbb tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 2660a6f7-5d40-4205-ad68-abf319f1c4c3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:01.809460 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ef4bc42d-d527-4d31-9ace-3c9d818b9dbb tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:01.811924 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ef4bc42d-d527-4d31-9ace-3c9d818b9dbb tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:01.813031 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ef4bc42d-d527-4d31-9ace-3c9d818b9dbb tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:01.818440 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ef4bc42d-d527-4d31-9ace-3c9d818b9dbb tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:01.818974 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ef4bc42d-d527-4d31-9ace-3c9d818b9dbb tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:01.820752 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ef4bc42d-d527-4d31-9ace-3c9d818b9dbb tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:01.948266 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ef4bc42d-d527-4d31-9ace-3c9d818b9dbb tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:01.959762 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ef4bc42d-d527-4d31-9ace-3c9d818b9dbb tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/2660a6f7-5d40-4205-ad68-abf319f1c4c3" status: 200 len: 1346 microversion: 2.1 time: 0.172910 Oct 17 13:57:01.976156 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2366/4602] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:01 2022] GET /compute/v2.1/servers/2660a6f7-5d40-4205-ad68-abf319f1c4c3 => generated 1346 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:01.990800 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2e4488ef-fb47-4fa9-a7ee-c16eaf1e3ec8 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:01.991695 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2e4488ef-fb47-4fa9-a7ee-c16eaf1e3ec8 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: 70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:02.000674 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2e4488ef-fb47-4fa9-a7ee-c16eaf1e3ec8 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:02.001596 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2e4488ef-fb47-4fa9-a7ee-c16eaf1e3ec8 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:02.002318 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2e4488ef-fb47-4fa9-a7ee-c16eaf1e3ec8 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:02.003454 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2e4488ef-fb47-4fa9-a7ee-c16eaf1e3ec8 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:02.004219 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2e4488ef-fb47-4fa9-a7ee-c16eaf1e3ec8 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:02.004949 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2e4488ef-fb47-4fa9-a7ee-c16eaf1e3ec8 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:02.451622 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-6ea302a0-e15c-4ff3-b55e-7722432e255c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:57:02.455093 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-6ea302a0-e15c-4ff3-b55e-7722432e255c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:57:02.455964 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-6ea302a0-e15c-4ff3-b55e-7722432e255c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:57:02.457023 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-6ea302a0-e15c-4ff3-b55e-7722432e255c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:57:02.458841 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-6ea302a0-e15c-4ff3-b55e-7722432e255c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:57:02.473747 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6ea302a0-e15c-4ff3-b55e-7722432e255c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:02.475915 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6ea302a0-e15c-4ff3-b55e-7722432e255c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:02.476610 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6ea302a0-e15c-4ff3-b55e-7722432e255c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:02.477599 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6ea302a0-e15c-4ff3-b55e-7722432e255c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:02.479158 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6ea302a0-e15c-4ff3-b55e-7722432e255c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:02.479841 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6ea302a0-e15c-4ff3-b55e-7722432e255c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:02.511832 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-6ea302a0-e15c-4ff3-b55e-7722432e255c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Getting quotas for project 4fa57e8772684c93a406f3d01da2af88. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:57:02.519931 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-6ea302a0-e15c-4ff3-b55e-7722432e255c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Getting quotas for user d78348abc02a4bb892902b0dd3bcfd6a and project 4fa57e8772684c93a406f3d01da2af88. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:57:02.533821 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2e4488ef-fb47-4fa9-a7ee-c16eaf1e3ec8 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:02.536275 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:57:02.552080 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2e4488ef-fb47-4fa9-a7ee-c16eaf1e3ec8 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63" status: 200 len: 1505 microversion: 2.1 time: 0.570863 Oct 17 13:57:02.564120 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2367/4603] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:01 2022] GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63 => generated 1505 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:02.586236 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6ea302a0-e15c-4ff3-b55e-7722432e255c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:57:02.591144 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6ea302a0-e15c-4ff3-b55e-7722432e255c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: 3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:57:02.654895 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6ea302a0-e15c-4ff3-b55e-7722432e255c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.251719 Oct 17 13:57:02.657416 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2237/4604] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:57:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1254 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:57:02.668333 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-764bbd5c-3c6c-4a92-982f-4b6fa0465969 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:02.669215 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-764bbd5c-3c6c-4a92-982f-4b6fa0465969 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: 3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:02.797388 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-764bbd5c-3c6c-4a92-982f-4b6fa0465969 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:02.809781 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-764bbd5c-3c6c-4a92-982f-4b6fa0465969 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4" status: 200 len: 1208 microversion: 2.1 time: 0.145027 Oct 17 13:57:02.826268 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2368/4605] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:02 2022] GET /compute/v2.1/servers/3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4 => generated 1208 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:57:02.988790 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-997c43dd-a8ca-4244-9162-d92b690ef27b tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:02.990813 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-997c43dd-a8ca-4244-9162-d92b690ef27b tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 2660a6f7-5d40-4205-ad68-abf319f1c4c3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:03.001823 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-997c43dd-a8ca-4244-9162-d92b690ef27b tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:03.002918 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-997c43dd-a8ca-4244-9162-d92b690ef27b tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:03.003601 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-997c43dd-a8ca-4244-9162-d92b690ef27b tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:03.005531 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-997c43dd-a8ca-4244-9162-d92b690ef27b tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:03.006350 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-997c43dd-a8ca-4244-9162-d92b690ef27b tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:03.007413 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-997c43dd-a8ca-4244-9162-d92b690ef27b tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:03.153208 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-997c43dd-a8ca-4244-9162-d92b690ef27b tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:03.165630 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-997c43dd-a8ca-4244-9162-d92b690ef27b tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/2660a6f7-5d40-4205-ad68-abf319f1c4c3" status: 200 len: 1346 microversion: 2.1 time: 0.181661 Oct 17 13:57:03.166833 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2238/4606] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:02 2022] GET /compute/v2.1/servers/2660a6f7-5d40-4205-ad68-abf319f1c4c3 => generated 1346 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:03.588694 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-36196e10-ca25-4fe3-9af9-3be0113bdda7 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:03.589548 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-36196e10-ca25-4fe3-9af9-3be0113bdda7 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: 70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:03.836173 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6b2be0bb-9aa1-455b-ba20-80d433060b67 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:03.836802 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6b2be0bb-9aa1-455b-ba20-80d433060b67 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: 3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:03.851725 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6b2be0bb-9aa1-455b-ba20-80d433060b67 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:03.852223 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6b2be0bb-9aa1-455b-ba20-80d433060b67 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:03.852667 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6b2be0bb-9aa1-455b-ba20-80d433060b67 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:03.853386 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6b2be0bb-9aa1-455b-ba20-80d433060b67 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:03.853848 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6b2be0bb-9aa1-455b-ba20-80d433060b67 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:03.854276 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6b2be0bb-9aa1-455b-ba20-80d433060b67 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:04.047820 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6b2be0bb-9aa1-455b-ba20-80d433060b67 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:04.060873 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6b2be0bb-9aa1-455b-ba20-80d433060b67 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4" status: 200 len: 1260 microversion: 2.1 time: 0.230541 Oct 17 13:57:04.061728 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2239/4607] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:03 2022] GET /compute/v2.1/servers/3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4 => generated 1260 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:04.153726 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-36196e10-ca25-4fe3-9af9-3be0113bdda7 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:04.163306 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-36196e10-ca25-4fe3-9af9-3be0113bdda7 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:04.163782 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-36196e10-ca25-4fe3-9af9-3be0113bdda7 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:04.164541 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-36196e10-ca25-4fe3-9af9-3be0113bdda7 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:04.165652 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-36196e10-ca25-4fe3-9af9-3be0113bdda7 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:04.167929 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-36196e10-ca25-4fe3-9af9-3be0113bdda7 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:04.195090 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-14e8e2f0-bb27-4f1d-8e56-486239780f86 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:04.196063 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-14e8e2f0-bb27-4f1d-8e56-486239780f86 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 2660a6f7-5d40-4205-ad68-abf319f1c4c3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:04.209173 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-14e8e2f0-bb27-4f1d-8e56-486239780f86 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:04.209845 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-14e8e2f0-bb27-4f1d-8e56-486239780f86 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:04.210444 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-14e8e2f0-bb27-4f1d-8e56-486239780f86 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:04.211341 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-14e8e2f0-bb27-4f1d-8e56-486239780f86 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:04.211976 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-14e8e2f0-bb27-4f1d-8e56-486239780f86 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:04.224175 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-14e8e2f0-bb27-4f1d-8e56-486239780f86 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:04.348689 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-14e8e2f0-bb27-4f1d-8e56-486239780f86 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:04.368900 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-14e8e2f0-bb27-4f1d-8e56-486239780f86 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/2660a6f7-5d40-4205-ad68-abf319f1c4c3" status: 200 len: 1346 microversion: 2.1 time: 0.179066 Oct 17 13:57:04.369803 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2240/4608] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:04 2022] GET /compute/v2.1/servers/2660a6f7-5d40-4205-ad68-abf319f1c4c3 => generated 1346 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:04.427662 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-36196e10-ca25-4fe3-9af9-3be0113bdda7 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:04.438660 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-36196e10-ca25-4fe3-9af9-3be0113bdda7 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63" status: 200 len: 1505 microversion: 2.1 time: 0.854492 Oct 17 13:57:04.452111 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2369/4609] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:03 2022] GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63 => generated 1505 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:05.089725 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ef404445-8334-4366-9a4c-45265109f292 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:05.090955 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ef404445-8334-4366-9a4c-45265109f292 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: 3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:05.105427 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ef404445-8334-4366-9a4c-45265109f292 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:05.107062 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ef404445-8334-4366-9a4c-45265109f292 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:05.112959 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ef404445-8334-4366-9a4c-45265109f292 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:05.115453 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ef404445-8334-4366-9a4c-45265109f292 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:05.116348 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ef404445-8334-4366-9a4c-45265109f292 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:05.117126 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ef404445-8334-4366-9a4c-45265109f292 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:05.284639 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ef404445-8334-4366-9a4c-45265109f292 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:05.304432 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ef404445-8334-4366-9a4c-45265109f292 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4" status: 200 len: 1266 microversion: 2.1 time: 0.219817 Oct 17 13:57:05.305193 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2241/4610] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:05 2022] GET /compute/v2.1/servers/3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4 => generated 1266 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:57:05.398739 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1f5d3614-44ac-436c-9e07-1942bdd206ad tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:05.401126 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-1f5d3614-44ac-436c-9e07-1942bdd206ad tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 2660a6f7-5d40-4205-ad68-abf319f1c4c3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:05.413744 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1f5d3614-44ac-436c-9e07-1942bdd206ad tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:05.417374 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1f5d3614-44ac-436c-9e07-1942bdd206ad tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:05.420252 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1f5d3614-44ac-436c-9e07-1942bdd206ad tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:05.422022 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1f5d3614-44ac-436c-9e07-1942bdd206ad tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:05.424506 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1f5d3614-44ac-436c-9e07-1942bdd206ad tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:05.426792 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1f5d3614-44ac-436c-9e07-1942bdd206ad tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:05.464316 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-33978bb8-d7fa-4a6e-ad85-abef55db7549 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:05.464933 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-33978bb8-d7fa-4a6e-ad85-abef55db7549 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: 70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:05.478005 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-33978bb8-d7fa-4a6e-ad85-abef55db7549 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:05.478743 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-33978bb8-d7fa-4a6e-ad85-abef55db7549 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:05.479407 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-33978bb8-d7fa-4a6e-ad85-abef55db7549 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:05.480339 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-33978bb8-d7fa-4a6e-ad85-abef55db7549 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:05.481908 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-33978bb8-d7fa-4a6e-ad85-abef55db7549 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:05.483304 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-33978bb8-d7fa-4a6e-ad85-abef55db7549 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:05.661336 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-1f5d3614-44ac-436c-9e07-1942bdd206ad tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:05.677564 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1f5d3614-44ac-436c-9e07-1942bdd206ad tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/2660a6f7-5d40-4205-ad68-abf319f1c4c3" status: 200 len: 1346 microversion: 2.1 time: 0.282833 Oct 17 13:57:05.708714 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2370/4611] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:05 2022] GET /compute/v2.1/servers/2660a6f7-5d40-4205-ad68-abf319f1c4c3 => generated 1346 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:06.126326 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-33978bb8-d7fa-4a6e-ad85-abef55db7549 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:06.138928 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:57:06.147649 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-33978bb8-d7fa-4a6e-ad85-abef55db7549 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63" status: 200 len: 1505 microversion: 2.1 time: 0.685723 Oct 17 13:57:06.148900 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2242/4612] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:05 2022] GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63 => generated 1505 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:06.331414 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-799356f2-5c82-471e-a802-feb25773c5d4 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:06.337628 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-799356f2-5c82-471e-a802-feb25773c5d4 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: 3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:06.355457 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-799356f2-5c82-471e-a802-feb25773c5d4 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:06.356209 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-799356f2-5c82-471e-a802-feb25773c5d4 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:06.356866 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-799356f2-5c82-471e-a802-feb25773c5d4 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:06.358916 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-799356f2-5c82-471e-a802-feb25773c5d4 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:06.359580 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-799356f2-5c82-471e-a802-feb25773c5d4 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:06.360159 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-799356f2-5c82-471e-a802-feb25773c5d4 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:06.538749 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-799356f2-5c82-471e-a802-feb25773c5d4 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:06.552723 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-799356f2-5c82-471e-a802-feb25773c5d4 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4" status: 200 len: 1266 microversion: 2.1 time: 0.225196 Oct 17 13:57:06.557792 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2371/4613] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:06 2022] GET /compute/v2.1/servers/3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4 => generated 1266 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:06.733887 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-304c0f3a-f69a-4a7d-9b09-a95a23178e21 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:06.735265 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-304c0f3a-f69a-4a7d-9b09-a95a23178e21 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 2660a6f7-5d40-4205-ad68-abf319f1c4c3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:06.746051 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-304c0f3a-f69a-4a7d-9b09-a95a23178e21 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:06.746995 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-304c0f3a-f69a-4a7d-9b09-a95a23178e21 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:06.747873 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-304c0f3a-f69a-4a7d-9b09-a95a23178e21 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:06.750109 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-304c0f3a-f69a-4a7d-9b09-a95a23178e21 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:06.750109 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-304c0f3a-f69a-4a7d-9b09-a95a23178e21 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:06.750574 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-304c0f3a-f69a-4a7d-9b09-a95a23178e21 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:07.113945 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-304c0f3a-f69a-4a7d-9b09-a95a23178e21 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:07.123552 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-304c0f3a-f69a-4a7d-9b09-a95a23178e21 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/2660a6f7-5d40-4205-ad68-abf319f1c4c3" status: 200 len: 1346 microversion: 2.1 time: 0.395450 Oct 17 13:57:07.130180 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2243/4614] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:06 2022] GET /compute/v2.1/servers/2660a6f7-5d40-4205-ad68-abf319f1c4c3 => generated 1346 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:07.172735 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4486a403-7004-49cb-a4bd-a76b017fd733 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:07.173620 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4486a403-7004-49cb-a4bd-a76b017fd733 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: 70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:07.181742 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4486a403-7004-49cb-a4bd-a76b017fd733 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:07.182475 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4486a403-7004-49cb-a4bd-a76b017fd733 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:07.183452 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4486a403-7004-49cb-a4bd-a76b017fd733 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:07.187281 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4486a403-7004-49cb-a4bd-a76b017fd733 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:07.187977 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4486a403-7004-49cb-a4bd-a76b017fd733 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:07.188561 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4486a403-7004-49cb-a4bd-a76b017fd733 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:07.580897 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3c704613-b18c-4840-8e4c-adf8a29f35d4 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:07.581514 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3c704613-b18c-4840-8e4c-adf8a29f35d4 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: 3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:07.588342 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4486a403-7004-49cb-a4bd-a76b017fd733 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:07.609291 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4486a403-7004-49cb-a4bd-a76b017fd733 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63" status: 200 len: 1505 microversion: 2.1 time: 0.436776 Oct 17 13:57:07.611008 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3c704613-b18c-4840-8e4c-adf8a29f35d4 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:07.612863 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3c704613-b18c-4840-8e4c-adf8a29f35d4 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:07.613084 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2372/4615] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:07 2022] GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63 => generated 1505 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:07.616248 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3c704613-b18c-4840-8e4c-adf8a29f35d4 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:07.618326 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3c704613-b18c-4840-8e4c-adf8a29f35d4 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:07.618814 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3c704613-b18c-4840-8e4c-adf8a29f35d4 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:07.619240 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3c704613-b18c-4840-8e4c-adf8a29f35d4 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:08.128332 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3c704613-b18c-4840-8e4c-adf8a29f35d4 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:08.141392 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3c704613-b18c-4840-8e4c-adf8a29f35d4 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4" status: 200 len: 1308 microversion: 2.1 time: 0.564702 Oct 17 13:57:08.143817 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2244/4616] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:07 2022] GET /compute/v2.1/servers/3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4 => generated 1308 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:57:08.161047 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-00a1cbef-df94-455f-9654-afccb26f15b6 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:08.162002 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-00a1cbef-df94-455f-9654-afccb26f15b6 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 2660a6f7-5d40-4205-ad68-abf319f1c4c3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:08.170431 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-00a1cbef-df94-455f-9654-afccb26f15b6 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:08.178023 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-00a1cbef-df94-455f-9654-afccb26f15b6 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:08.178211 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-00a1cbef-df94-455f-9654-afccb26f15b6 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:08.179146 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-00a1cbef-df94-455f-9654-afccb26f15b6 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:08.179968 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-00a1cbef-df94-455f-9654-afccb26f15b6 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:08.180687 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-00a1cbef-df94-455f-9654-afccb26f15b6 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:08.255747 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-00a1cbef-df94-455f-9654-afccb26f15b6 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:08.256539 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-00a1cbef-df94-455f-9654-afccb26f15b6 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:08.259507 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-00a1cbef-df94-455f-9654-afccb26f15b6 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:08.260750 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-00a1cbef-df94-455f-9654-afccb26f15b6 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lazy-loading 'fault' on Instance uuid 2660a6f7-5d40-4205-ad68-abf319f1c4c3 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:57:08.367618 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-00a1cbef-df94-455f-9654-afccb26f15b6 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:08.396214 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-00a1cbef-df94-455f-9654-afccb26f15b6 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/2660a6f7-5d40-4205-ad68-abf319f1c4c3" status: 200 len: 1351 microversion: 2.1 time: 0.239281 Oct 17 13:57:08.397285 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2373/4617] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:08 2022] GET /compute/v2.1/servers/2660a6f7-5d40-4205-ad68-abf319f1c4c3 => generated 1351 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:08.637072 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-80e80365-9771-4247-8f5a-de9ce2c5f44b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:08.637884 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-80e80365-9771-4247-8f5a-de9ce2c5f44b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: 70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:08.645749 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-80e80365-9771-4247-8f5a-de9ce2c5f44b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:08.646781 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-80e80365-9771-4247-8f5a-de9ce2c5f44b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:08.647496 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-80e80365-9771-4247-8f5a-de9ce2c5f44b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:08.648434 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-80e80365-9771-4247-8f5a-de9ce2c5f44b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:08.649095 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-80e80365-9771-4247-8f5a-de9ce2c5f44b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:08.649746 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-80e80365-9771-4247-8f5a-de9ce2c5f44b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:08.957076 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-1940aa10-7e7c-4b62-9b84-38500e01bb2f req-35bbe1ca-08d5-4a2b-9a52-75ac5be012b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4", "tag": "fe567be9-30b4-4da2-b072-3a957287bd60"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:57:08.970677 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-1940aa10-7e7c-4b62-9b84-38500e01bb2f req-35bbe1ca-08d5-4a2b-9a52-75ac5be012b0 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:08.971182 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-1940aa10-7e7c-4b62-9b84-38500e01bb2f req-35bbe1ca-08d5-4a2b-9a52-75ac5be012b0 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:08.971806 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-1940aa10-7e7c-4b62-9b84-38500e01bb2f req-35bbe1ca-08d5-4a2b-9a52-75ac5be012b0 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:08.976614 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-80e80365-9771-4247-8f5a-de9ce2c5f44b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:08.986325 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-80e80365-9771-4247-8f5a-de9ce2c5f44b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63" status: 200 len: 1505 microversion: 2.1 time: 0.353777 Oct 17 13:57:08.987679 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-1940aa10-7e7c-4b62-9b84-38500e01bb2f req-35bbe1ca-08d5-4a2b-9a52-75ac5be012b0 service nova] Creating event network-changed:fe567be9-30b4-4da2-b072-3a957287bd60 for instance 3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4 on n-h2-854247-14 Oct 17 13:57:08.991656 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2245/4618] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:08 2022] GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63 => generated 1505 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:08.996158 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-1940aa10-7e7c-4b62-9b84-38500e01bb2f req-35bbe1ca-08d5-4a2b-9a52-75ac5be012b0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042806 Oct 17 13:57:08.997247 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2374/4619] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:57:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:57:09.169192 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d5c81a2d-1315-41db-84b5-6417243d2b31 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:09.170437 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d5c81a2d-1315-41db-84b5-6417243d2b31 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: 3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:09.177979 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d5c81a2d-1315-41db-84b5-6417243d2b31 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:09.178750 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d5c81a2d-1315-41db-84b5-6417243d2b31 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:09.179379 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d5c81a2d-1315-41db-84b5-6417243d2b31 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:09.180249 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d5c81a2d-1315-41db-84b5-6417243d2b31 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:09.180861 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d5c81a2d-1315-41db-84b5-6417243d2b31 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:09.181445 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d5c81a2d-1315-41db-84b5-6417243d2b31 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:09.421353 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-774eff47-43be-4d3b-a318-e698e61b0276 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:09.422145 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-774eff47-43be-4d3b-a318-e698e61b0276 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 2660a6f7-5d40-4205-ad68-abf319f1c4c3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:09.432085 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-774eff47-43be-4d3b-a318-e698e61b0276 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:09.432576 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-774eff47-43be-4d3b-a318-e698e61b0276 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:09.433376 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-774eff47-43be-4d3b-a318-e698e61b0276 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:09.434500 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-774eff47-43be-4d3b-a318-e698e61b0276 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:09.435097 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-774eff47-43be-4d3b-a318-e698e61b0276 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:09.435548 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-774eff47-43be-4d3b-a318-e698e61b0276 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:09.457017 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-774eff47-43be-4d3b-a318-e698e61b0276 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] HTTP exception thrown: Instance 2660a6f7-5d40-4205-ad68-abf319f1c4c3 could not be found. Oct 17 13:57:09.458909 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-774eff47-43be-4d3b-a318-e698e61b0276 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Request method failure captured: Oct 17 13:57:09.458909 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/2660a6f7-5d40-4205-ad68-abf319f1c4c3 HTTP/1.1 Oct 17 13:57:09.458909 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:57:09.458909 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:57:09.458909 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:57:09.458909 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:57:09.458909 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:57:09.458909 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:57:09.458909 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:57:09.458909 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:57:09.458909 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTV7tIaoYPgUdHiXX4NOkSSz-a4-puhL4AhnfvtJYmPyZ3fJvZDePMat9BASboFCn4C3QP9Vix9f7JprJ7jGUAeFojqdhpTvVML9HYK6oQI67GVbo4xYwR8dQKhVTSdcdIj_O_mmBimo8N7A_DyW-iY_pgxFAaVGSJ3vOytCqm8fGt3Q Oct 17 13:57:09.458909 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:57:09.458909 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:57:09.458909 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:57:09.458909 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:57:09.458909 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:57:09.458909 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:57:09.458909 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 0821e5beffdd41c2ad2adbd1d03cde71 Oct 17 13:57:09.458909 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-DeleteServersTestJSON-930683239 Oct 17 13:57:09.458909 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:57:09.458909 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:57:09.458909 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "tempest-type-757843761", "name": "tempest-service-527072566", "endpoints": [{"region": "tempest-region-1530587473", "publicURL": "https://url-594098419.com"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "tempest-type-1549021290", "name": "tempest-service-1797883724", "endpoints": [{"region": "tempest-region-85075699", "internalURL": "https://url-259507820.com"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0821e5beffdd41c2ad2adbd1d03cde71", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "tempest-type-1413520904", "name": "tempest-service-1708200528", "endpoints": []}] Oct 17 13:57:09.458909 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-DeleteServersTestJSON-930683239 Oct 17 13:57:09.458909 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 0821e5beffdd41c2ad2adbd1d03cde71 Oct 17 13:57:09.458909 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-DeleteServersTestJSON-930683239 Oct 17 13:57:09.458909 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-DeleteServersTestJSON-930683239-project Oct 17 13:57:09.458909 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:57:09.458909 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:57:09.458909 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: ab8baeba1d494df5bb9cf4d7289410b9 Oct 17 13:57:09.458909 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-DeleteServersTestJSON-930683239-project Oct 17 13:57:09.458909 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:57:09.458909 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 2660a6f7-5d40-4205-ad68-abf319f1c4c3 could not be found. Oct 17 13:57:09.458909 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '2660a6f7-5d40-4205-ad68-abf319f1c4c3'} Oct 17 13:57:09.458909 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:57:09.458909 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:57:09.458909 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:57:09.458909 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:57:09.458909 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:57:09.458909 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:57:09.458909 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:57:09.458909 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:57:09.458909 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:57:09.458909 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:57:09.458909 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2660a6f7-5d40-4205-ad68-abf319f1c4c3 could not be found. Oct 17 13:57:09.458909 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:57:09.458909 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:57:09.458909 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:57:09.458909 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:57:09.458909 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:57:09.458909 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:57:09.458909 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:57:09.458909 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:57:09.458909 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:57:09.458909 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:57:09.458909 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:57:09.458909 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:57:09.458909 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:57:09.458909 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:57:09.458909 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:57:09.466795 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:57:09.466795 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2660a6f7-5d40-4205-ad68-abf319f1c4c3 could not be found. Oct 17 13:57:09.466795 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:57:09.466795 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:57:09.466795 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:57:09.466795 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:57:09.466795 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:57:09.466795 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:57:09.466795 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:57:09.466795 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:57:09.466795 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2660a6f7-5d40-4205-ad68-abf319f1c4c3 could not be found. Oct 17 13:57:09.466795 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:57:09.466795 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-774eff47-43be-4d3b-a318-e698e61b0276 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Returning 404 to user: Instance 2660a6f7-5d40-4205-ad68-abf319f1c4c3 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:57:09.466795 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-774eff47-43be-4d3b-a318-e698e61b0276 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/2660a6f7-5d40-4205-ad68-abf319f1c4c3" status: 404 len: 111 microversion: 2.1 time: 0.044165 Oct 17 13:57:09.466795 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2375/4620] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:09 2022] GET /compute/v2.1/servers/2660a6f7-5d40-4205-ad68-abf319f1c4c3 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:57:09.615151 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9d4a8c34-2edd-41ed-a4c5-e17623cce101 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:09.617619 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9d4a8c34-2edd-41ed-a4c5-e17623cce101 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 2660a6f7-5d40-4205-ad68-abf319f1c4c3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:09.624502 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9d4a8c34-2edd-41ed-a4c5-e17623cce101 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:09.624998 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9d4a8c34-2edd-41ed-a4c5-e17623cce101 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:09.625425 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9d4a8c34-2edd-41ed-a4c5-e17623cce101 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:09.626302 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9d4a8c34-2edd-41ed-a4c5-e17623cce101 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:09.626752 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9d4a8c34-2edd-41ed-a4c5-e17623cce101 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:09.627204 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9d4a8c34-2edd-41ed-a4c5-e17623cce101 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:09.641144 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-9d4a8c34-2edd-41ed-a4c5-e17623cce101 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] HTTP exception thrown: Instance 2660a6f7-5d40-4205-ad68-abf319f1c4c3 could not be found. Oct 17 13:57:09.642667 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9d4a8c34-2edd-41ed-a4c5-e17623cce101 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Request method failure captured: Oct 17 13:57:09.642667 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/2660a6f7-5d40-4205-ad68-abf319f1c4c3/os-volume_attachments HTTP/1.1 Oct 17 13:57:09.642667 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:57:09.642667 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:57:09.642667 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:57:09.642667 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:57:09.642667 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:57:09.642667 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:57:09.642667 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:57:09.642667 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:57:09.642667 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTV7tIaoYPgUdHiXX4NOkSSz-a4-puhL4AhnfvtJYmPyZ3fJvZDePMat9BASboFCn4C3QP9Vix9f7JprJ7jGUAeFojqdhpTvVML9HYK6oQI67GVbo4xYwR8dQKhVTSdcdIj_O_mmBimo8N7A_DyW-iY_pgxFAaVGSJ3vOytCqm8fGt3Q Oct 17 13:57:09.642667 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:57:09.642667 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:57:09.642667 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:57:09.642667 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:57:09.642667 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:57:09.642667 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:57:09.642667 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 0821e5beffdd41c2ad2adbd1d03cde71 Oct 17 13:57:09.642667 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-DeleteServersTestJSON-930683239 Oct 17 13:57:09.642667 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:57:09.642667 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:57:09.642667 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "tempest-type-757843761", "name": "tempest-service-527072566", "endpoints": [{"region": "tempest-region-1530587473", "publicURL": "https://url-594098419.com"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "tempest-type-1549021290", "name": "tempest-service-1797883724", "endpoints": [{"region": "tempest-region-85075699", "internalURL": "https://url-259507820.com"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0821e5beffdd41c2ad2adbd1d03cde71", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "tempest-type-1413520904", "name": "tempest-service-1708200528", "endpoints": []}] Oct 17 13:57:09.642667 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-DeleteServersTestJSON-930683239 Oct 17 13:57:09.642667 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 0821e5beffdd41c2ad2adbd1d03cde71 Oct 17 13:57:09.642667 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-DeleteServersTestJSON-930683239 Oct 17 13:57:09.642667 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-DeleteServersTestJSON-930683239-project Oct 17 13:57:09.642667 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:57:09.642667 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:57:09.642667 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: ab8baeba1d494df5bb9cf4d7289410b9 Oct 17 13:57:09.642667 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-DeleteServersTestJSON-930683239-project Oct 17 13:57:09.642667 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:57:09.642667 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 2660a6f7-5d40-4205-ad68-abf319f1c4c3 could not be found. Oct 17 13:57:09.642667 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'server_id': '2660a6f7-5d40-4205-ad68-abf319f1c4c3'} Oct 17 13:57:09.642667 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:57:09.642667 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:57:09.642667 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:57:09.642667 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:57:09.642667 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:57:09.642667 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:57:09.642667 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:57:09.642667 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:57:09.642667 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:57:09.642667 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:57:09.642667 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2660a6f7-5d40-4205-ad68-abf319f1c4c3 could not be found. Oct 17 13:57:09.642667 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:57:09.642667 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:57:09.642667 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:57:09.642667 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:57:09.642667 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:57:09.642667 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:57:09.642667 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:57:09.642667 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:57:09.642667 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:57:09.642667 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:57:09.642667 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 13:57:09.642667 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:57:09.642667 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 13:57:09.642667 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:57:09.642667 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 17 13:57:09.650317 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 17 13:57:09.650317 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:57:09.650317 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:57:09.650317 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2660a6f7-5d40-4205-ad68-abf319f1c4c3 could not be found. Oct 17 13:57:09.650317 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:57:09.650317 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:57:09.650317 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:57:09.650317 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:57:09.650317 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:57:09.650317 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:57:09.650317 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:57:09.650317 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:57:09.650317 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2660a6f7-5d40-4205-ad68-abf319f1c4c3 could not be found. Oct 17 13:57:09.650317 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:57:09.650317 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9d4a8c34-2edd-41ed-a4c5-e17623cce101 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Returning 404 to user: Instance 2660a6f7-5d40-4205-ad68-abf319f1c4c3 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:57:09.650317 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9d4a8c34-2edd-41ed-a4c5-e17623cce101 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/2660a6f7-5d40-4205-ad68-abf319f1c4c3/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.037414 Oct 17 13:57:09.650317 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2376/4621] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 13:57:09 2022] GET /compute/v2.1/servers/2660a6f7-5d40-4205-ad68-abf319f1c4c3/os-volume_attachments => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:57:09.778247 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d5c81a2d-1315-41db-84b5-6417243d2b31 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:09.787081 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d5c81a2d-1315-41db-84b5-6417243d2b31 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4" status: 200 len: 1308 microversion: 2.1 time: 0.621636 Oct 17 13:57:09.803955 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2246/4622] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:09 2022] GET /compute/v2.1/servers/3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4 => generated 1308 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:09.909990 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-de98f87d-ccff-4831-99e2-fcd28d252879 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1499406121", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "536c8c49-8501-4c2f-bf93-136c7f68a48c"}]}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:57:09.983514 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-de98f87d-ccff-4831-99e2-fcd28d252879 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] validate_networks() for [('536c8c49-8501-4c2f-bf93-136c7f68a48c', None, None, None, None, None)] {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:57:10.018219 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2fef4c86-f344-4c95-acf8-83634d0d20a2 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:10.019236 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2fef4c86-f344-4c95-acf8-83634d0d20a2 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: 70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:10.028758 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=6 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:57:10.040159 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2fef4c86-f344-4c95-acf8-83634d0d20a2 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:10.040667 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2fef4c86-f344-4c95-acf8-83634d0d20a2 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:10.041103 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2fef4c86-f344-4c95-acf8-83634d0d20a2 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:10.042047 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2fef4c86-f344-4c95-acf8-83634d0d20a2 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:10.042666 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2fef4c86-f344-4c95-acf8-83634d0d20a2 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:10.043458 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2fef4c86-f344-4c95-acf8-83634d0d20a2 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:10.449618 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2fef4c86-f344-4c95-acf8-83634d0d20a2 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:10.462209 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2fef4c86-f344-4c95-acf8-83634d0d20a2 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63" status: 200 len: 1505 microversion: 2.1 time: 0.451451 Oct 17 13:57:10.463629 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2247/4623] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:10 2022] GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63 => generated 1505 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:10.815097 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1d5dddac-e093-4299-a291-fa8291dfc467 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:10.816689 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1d5dddac-e093-4299-a291-fa8291dfc467 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: 3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:10.824916 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1d5dddac-e093-4299-a291-fa8291dfc467 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:10.825665 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1d5dddac-e093-4299-a291-fa8291dfc467 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:10.826444 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1d5dddac-e093-4299-a291-fa8291dfc467 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:10.827456 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1d5dddac-e093-4299-a291-fa8291dfc467 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:10.828644 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1d5dddac-e093-4299-a291-fa8291dfc467 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:10.829275 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1d5dddac-e093-4299-a291-fa8291dfc467 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:10.890019 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-de98f87d-ccff-4831-99e2-fcd28d252879 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:57:10.890733 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-de98f87d-ccff-4831-99e2-fcd28d252879 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:57:10.891639 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-de98f87d-ccff-4831-99e2-fcd28d252879 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:57:10.892488 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-de98f87d-ccff-4831-99e2-fcd28d252879 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:57:10.893113 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-de98f87d-ccff-4831-99e2-fcd28d252879 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:57:10.906835 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-de98f87d-ccff-4831-99e2-fcd28d252879 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:10.907883 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-de98f87d-ccff-4831-99e2-fcd28d252879 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:10.908535 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-de98f87d-ccff-4831-99e2-fcd28d252879 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:10.910413 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-de98f87d-ccff-4831-99e2-fcd28d252879 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:10.911481 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-de98f87d-ccff-4831-99e2-fcd28d252879 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:10.912495 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-de98f87d-ccff-4831-99e2-fcd28d252879 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:10.943674 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-de98f87d-ccff-4831-99e2-fcd28d252879 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Getting quotas for project 0821e5beffdd41c2ad2adbd1d03cde71. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:57:10.951750 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-de98f87d-ccff-4831-99e2-fcd28d252879 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Getting quotas for user ab8baeba1d494df5bb9cf4d7289410b9 and project 0821e5beffdd41c2ad2adbd1d03cde71. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:57:10.968608 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-de98f87d-ccff-4831-99e2-fcd28d252879 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:57:10.973607 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-de98f87d-ccff-4831-99e2-fcd28d252879 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 3938cdd3-ee9e-4f8f-9a06-0439165b8638] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:57:11.064625 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1d5dddac-e093-4299-a291-fa8291dfc467 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:11.077464 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-de98f87d-ccff-4831-99e2-fcd28d252879 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.169390 Oct 17 13:57:11.084241 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2377/4624] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:57:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1174 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:57:11.094625 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ae645be3-a51a-429c-8ba3-ecf95c24444d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:11.095306 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ae645be3-a51a-429c-8ba3-ecf95c24444d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 3938cdd3-ee9e-4f8f-9a06-0439165b8638] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:11.113221 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1d5dddac-e093-4299-a291-fa8291dfc467 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4" status: 200 len: 1308 microversion: 2.1 time: 0.299708 Oct 17 13:57:11.114844 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2248/4625] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:10 2022] GET /compute/v2.1/servers/3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4 => generated 1308 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:11.237121 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ae645be3-a51a-429c-8ba3-ecf95c24444d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:11.251297 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ae645be3-a51a-429c-8ba3-ecf95c24444d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/3938cdd3-ee9e-4f8f-9a06-0439165b8638" status: 200 len: 1215 microversion: 2.1 time: 0.161238 Oct 17 13:57:11.252124 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2378/4626] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:11 2022] GET /compute/v2.1/servers/3938cdd3-ee9e-4f8f-9a06-0439165b8638 => generated 1215 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:57:11.275920 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7078b7bb-21bf-44f7-9a6b-a92b5cbaeb48 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:11.277435 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7078b7bb-21bf-44f7-9a6b-a92b5cbaeb48 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 3938cdd3-ee9e-4f8f-9a06-0439165b8638] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:11.303944 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7078b7bb-21bf-44f7-9a6b-a92b5cbaeb48 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 3938cdd3-ee9e-4f8f-9a06-0439165b8638] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:57:11.401379 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7078b7bb-21bf-44f7-9a6b-a92b5cbaeb48 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3938cdd3-ee9e-4f8f-9a06-0439165b8638" status: 204 len: 0 microversion: 2.1 time: 0.129354 Oct 17 13:57:11.401379 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2249/4627] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:57:11 2022] DELETE /compute/v2.1/servers/3938cdd3-ee9e-4f8f-9a06-0439165b8638 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:57:11.408916 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-30583476-cc78-45da-8317-d882e9f88b94 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:11.409529 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-30583476-cc78-45da-8317-d882e9f88b94 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 3938cdd3-ee9e-4f8f-9a06-0439165b8638] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:11.433532 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-30583476-cc78-45da-8317-d882e9f88b94 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] HTTP exception thrown: Instance 3938cdd3-ee9e-4f8f-9a06-0439165b8638 could not be found. Oct 17 13:57:11.441579 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-30583476-cc78-45da-8317-d882e9f88b94 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Request method failure captured: Oct 17 13:57:11.441579 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/3938cdd3-ee9e-4f8f-9a06-0439165b8638 HTTP/1.1 Oct 17 13:57:11.441579 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:57:11.441579 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:57:11.441579 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:57:11.441579 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:57:11.441579 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:57:11.441579 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:57:11.441579 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:57:11.441579 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:57:11.441579 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTV7tIaoYPgUdHiXX4NOkSSz-a4-puhL4AhnfvtJYmPyZ3fJvZDePMat9BASboFCn4C3QP9Vix9f7JprJ7jGUAeFojqdhpTvVML9HYK6oQI67GVbo4xYwR8dQKhVTSdcdIj_O_mmBimo8N7A_DyW-iY_pgxFAaVGSJ3vOytCqm8fGt3Q Oct 17 13:57:11.441579 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:57:11.441579 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:57:11.441579 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:57:11.441579 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:57:11.441579 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:57:11.441579 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:57:11.441579 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 0821e5beffdd41c2ad2adbd1d03cde71 Oct 17 13:57:11.441579 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-DeleteServersTestJSON-930683239 Oct 17 13:57:11.441579 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:57:11.441579 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:57:11.441579 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "tempest-type-757843761", "name": "tempest-service-527072566", "endpoints": [{"region": "tempest-region-1530587473", "publicURL": "https://url-594098419.com"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "tempest-type-1549021290", "name": "tempest-service-1797883724", "endpoints": [{"region": "tempest-region-85075699", "internalURL": "https://url-259507820.com"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0821e5beffdd41c2ad2adbd1d03cde71", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "tempest-type-1413520904", "name": "tempest-service-1708200528", "endpoints": []}] Oct 17 13:57:11.441579 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-DeleteServersTestJSON-930683239 Oct 17 13:57:11.441579 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 0821e5beffdd41c2ad2adbd1d03cde71 Oct 17 13:57:11.441579 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-DeleteServersTestJSON-930683239 Oct 17 13:57:11.441579 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-DeleteServersTestJSON-930683239-project Oct 17 13:57:11.441579 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:57:11.441579 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:57:11.441579 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: ab8baeba1d494df5bb9cf4d7289410b9 Oct 17 13:57:11.441579 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-DeleteServersTestJSON-930683239-project Oct 17 13:57:11.441579 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:57:11.441579 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 3938cdd3-ee9e-4f8f-9a06-0439165b8638 could not be found. Oct 17 13:57:11.441579 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '3938cdd3-ee9e-4f8f-9a06-0439165b8638'} Oct 17 13:57:11.441579 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:57:11.441579 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:57:11.441579 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2932, in _get_instance Oct 17 13:57:11.441579 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Oct 17 13:57:11.441579 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:57:11.441579 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:57:11.441579 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Oct 17 13:57:11.441579 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 17 13:57:11.441579 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 13:57:11.441579 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 13:57:11.441579 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Oct 17 13:57:11.441579 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Oct 17 13:57:11.441579 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance 3938cdd3-ee9e-4f8f-9a06-0439165b8638 Oct 17 13:57:11.441579 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:57:11.441579 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:57:11.441579 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:57:11.441579 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:57:11.441579 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:57:11.441579 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:57:11.441579 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:57:11.441579 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:57:11.441579 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Oct 17 13:57:11.441579 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 13:57:11.441579 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3938cdd3-ee9e-4f8f-9a06-0439165b8638 could not be found. Oct 17 13:57:11.441579 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:57:11.445775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:57:11.445775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:57:11.445775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:57:11.445775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:57:11.445775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:57:11.445775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:57:11.445775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:57:11.445775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:57:11.445775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:57:11.445775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:57:11.445775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:57:11.445775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:57:11.445775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:57:11.445775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:57:11.445775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:57:11.445775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3938cdd3-ee9e-4f8f-9a06-0439165b8638 could not be found. Oct 17 13:57:11.445775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:57:11.445775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:57:11.445775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:57:11.445775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:57:11.445775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:57:11.445775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:57:11.445775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:57:11.445775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:57:11.445775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3938cdd3-ee9e-4f8f-9a06-0439165b8638 could not be found. Oct 17 13:57:11.445775 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:57:11.445775 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-30583476-cc78-45da-8317-d882e9f88b94 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Returning 404 to user: Instance 3938cdd3-ee9e-4f8f-9a06-0439165b8638 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:57:11.445775 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-30583476-cc78-45da-8317-d882e9f88b94 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/3938cdd3-ee9e-4f8f-9a06-0439165b8638" status: 404 len: 111 microversion: 2.1 time: 0.038785 Oct 17 13:57:11.449772 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2379/4628] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:11 2022] GET /compute/v2.1/servers/3938cdd3-ee9e-4f8f-9a06-0439165b8638 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:57:11.485865 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-eddbf900-abdb-4b67-99f3-3649eb38e5b1 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:11.486672 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-eddbf900-abdb-4b67-99f3-3649eb38e5b1 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: 70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:11.500013 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eddbf900-abdb-4b67-99f3-3649eb38e5b1 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:11.500619 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eddbf900-abdb-4b67-99f3-3649eb38e5b1 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:11.500936 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eddbf900-abdb-4b67-99f3-3649eb38e5b1 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:11.501641 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eddbf900-abdb-4b67-99f3-3649eb38e5b1 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:11.502084 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eddbf900-abdb-4b67-99f3-3649eb38e5b1 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:11.502701 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eddbf900-abdb-4b67-99f3-3649eb38e5b1 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:11.633689 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7af12011-afca-4b19-beb0-c637ea21fd24 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2003328921", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "536c8c49-8501-4c2f-bf93-136c7f68a48c"}]}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:57:11.740088 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-7af12011-afca-4b19-beb0-c637ea21fd24 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] validate_networks() for [('536c8c49-8501-4c2f-bf93-136c7f68a48c', None, None, None, None, None)] {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:57:12.407376 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-eddbf900-abdb-4b67-99f3-3649eb38e5b1 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:12.423032 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-eddbf900-abdb-4b67-99f3-3649eb38e5b1 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63" status: 200 len: 1505 microversion: 2.1 time: 0.940965 Oct 17 13:57:12.423667 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2250/4629] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:11 2022] GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63 => generated 1505 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:12.435564 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8aba3ebb-707c-4d0f-a81a-2f5fa7da919e tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:12.435564 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8aba3ebb-707c-4d0f-a81a-2f5fa7da919e tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: 3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:12.451906 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8aba3ebb-707c-4d0f-a81a-2f5fa7da919e tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:12.452472 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8aba3ebb-707c-4d0f-a81a-2f5fa7da919e tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:12.452890 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8aba3ebb-707c-4d0f-a81a-2f5fa7da919e tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:12.453556 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8aba3ebb-707c-4d0f-a81a-2f5fa7da919e tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:12.454001 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8aba3ebb-707c-4d0f-a81a-2f5fa7da919e tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:12.454985 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8aba3ebb-707c-4d0f-a81a-2f5fa7da919e tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:12.497701 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:57:12.964285 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8aba3ebb-707c-4d0f-a81a-2f5fa7da919e tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:12.978075 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8aba3ebb-707c-4d0f-a81a-2f5fa7da919e tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4" status: 200 len: 1308 microversion: 2.1 time: 0.553267 Oct 17 13:57:12.979038 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2251/4630] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:12 2022] GET /compute/v2.1/servers/3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4 => generated 1308 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:13.256906 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-7af12011-afca-4b19-beb0-c637ea21fd24 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:57:13.257505 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-7af12011-afca-4b19-beb0-c637ea21fd24 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:57:13.257774 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-7af12011-afca-4b19-beb0-c637ea21fd24 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:57:13.258919 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-7af12011-afca-4b19-beb0-c637ea21fd24 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:57:13.259537 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-7af12011-afca-4b19-beb0-c637ea21fd24 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:57:13.274621 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7af12011-afca-4b19-beb0-c637ea21fd24 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:13.275670 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7af12011-afca-4b19-beb0-c637ea21fd24 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:13.276866 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7af12011-afca-4b19-beb0-c637ea21fd24 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:13.277836 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7af12011-afca-4b19-beb0-c637ea21fd24 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:13.278431 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7af12011-afca-4b19-beb0-c637ea21fd24 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:13.279273 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7af12011-afca-4b19-beb0-c637ea21fd24 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:13.305438 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-7af12011-afca-4b19-beb0-c637ea21fd24 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Getting quotas for project 0821e5beffdd41c2ad2adbd1d03cde71. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:57:13.325988 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-7af12011-afca-4b19-beb0-c637ea21fd24 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Getting quotas for user ab8baeba1d494df5bb9cf4d7289410b9 and project 0821e5beffdd41c2ad2adbd1d03cde71. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:57:13.343764 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7af12011-afca-4b19-beb0-c637ea21fd24 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:57:13.346917 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7af12011-afca-4b19-beb0-c637ea21fd24 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 5d10ac72-2710-41c8-82a4-f648ed80d727] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:57:13.382384 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:57:13.412829 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7af12011-afca-4b19-beb0-c637ea21fd24 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.785790 Oct 17 13:57:13.414082 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2380/4631] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:57:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:57:13.432575 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-06f9ac4b-cc23-4931-80d4-b3569b140ccc tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:13.433944 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-06f9ac4b-cc23-4931-80d4-b3569b140ccc tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 5d10ac72-2710-41c8-82a4-f648ed80d727] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:13.451530 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-24ef3517-19d2-481a-9b27-ec42f2b1c693 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:13.452202 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-24ef3517-19d2-481a-9b27-ec42f2b1c693 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: 70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:13.464678 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-24ef3517-19d2-481a-9b27-ec42f2b1c693 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:13.466313 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-24ef3517-19d2-481a-9b27-ec42f2b1c693 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:13.466778 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-24ef3517-19d2-481a-9b27-ec42f2b1c693 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:13.467551 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-24ef3517-19d2-481a-9b27-ec42f2b1c693 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:13.469246 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-24ef3517-19d2-481a-9b27-ec42f2b1c693 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:13.469684 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-24ef3517-19d2-481a-9b27-ec42f2b1c693 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:13.527626 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-06f9ac4b-cc23-4931-80d4-b3569b140ccc tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:13.540359 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-06f9ac4b-cc23-4931-80d4-b3569b140ccc tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/5d10ac72-2710-41c8-82a4-f648ed80d727" status: 200 len: 1215 microversion: 2.1 time: 0.117640 Oct 17 13:57:13.544234 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2252/4632] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:13 2022] GET /compute/v2.1/servers/5d10ac72-2710-41c8-82a4-f648ed80d727 => generated 1215 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:13.773968 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-24ef3517-19d2-481a-9b27-ec42f2b1c693 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:13.783037 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-24ef3517-19d2-481a-9b27-ec42f2b1c693 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63" status: 200 len: 1505 microversion: 2.1 time: 0.337041 Oct 17 13:57:13.787070 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2381/4633] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:13 2022] GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63 => generated 1505 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:57:14.003540 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3ed5d337-fe30-47da-a3cc-811e2cb6bdf8 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:14.004953 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3ed5d337-fe30-47da-a3cc-811e2cb6bdf8 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: 3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:14.012013 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3ed5d337-fe30-47da-a3cc-811e2cb6bdf8 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:14.012636 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3ed5d337-fe30-47da-a3cc-811e2cb6bdf8 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:14.013176 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3ed5d337-fe30-47da-a3cc-811e2cb6bdf8 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:14.013982 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3ed5d337-fe30-47da-a3cc-811e2cb6bdf8 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:14.014489 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3ed5d337-fe30-47da-a3cc-811e2cb6bdf8 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:14.015366 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3ed5d337-fe30-47da-a3cc-811e2cb6bdf8 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:14.244972 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3ed5d337-fe30-47da-a3cc-811e2cb6bdf8 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:14.254324 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3ed5d337-fe30-47da-a3cc-811e2cb6bdf8 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4" status: 200 len: 1308 microversion: 2.1 time: 0.255764 Oct 17 13:57:14.255380 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2253/4634] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:13 2022] GET /compute/v2.1/servers/3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4 => generated 1308 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:14.564806 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-58d08793-067e-4839-86d2-2f521f819733 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:14.565565 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-58d08793-067e-4839-86d2-2f521f819733 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 5d10ac72-2710-41c8-82a4-f648ed80d727] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:14.574307 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-58d08793-067e-4839-86d2-2f521f819733 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:14.574785 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-58d08793-067e-4839-86d2-2f521f819733 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:14.575254 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-58d08793-067e-4839-86d2-2f521f819733 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:14.576308 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-58d08793-067e-4839-86d2-2f521f819733 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:14.576944 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-58d08793-067e-4839-86d2-2f521f819733 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:14.577753 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-58d08793-067e-4839-86d2-2f521f819733 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:14.664692 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-58d08793-067e-4839-86d2-2f521f819733 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:14.674777 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-58d08793-067e-4839-86d2-2f521f819733 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/5d10ac72-2710-41c8-82a4-f648ed80d727" status: 200 len: 1267 microversion: 2.1 time: 0.114318 Oct 17 13:57:14.676283 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2382/4635] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:14 2022] GET /compute/v2.1/servers/5d10ac72-2710-41c8-82a4-f648ed80d727 => generated 1267 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:57:14.808501 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c2cd6a95-de9e-4a3e-86af-bb2877794777 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:14.809114 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c2cd6a95-de9e-4a3e-86af-bb2877794777 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: 70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:14.816336 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c2cd6a95-de9e-4a3e-86af-bb2877794777 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:14.816841 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c2cd6a95-de9e-4a3e-86af-bb2877794777 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:14.817248 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c2cd6a95-de9e-4a3e-86af-bb2877794777 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:14.817939 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c2cd6a95-de9e-4a3e-86af-bb2877794777 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:14.828513 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c2cd6a95-de9e-4a3e-86af-bb2877794777 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:14.829010 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c2cd6a95-de9e-4a3e-86af-bb2877794777 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:15.013263 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-32df0acb-95dd-4b5b-8e3b-383e9510a9a4 req-37c7c1f8-f919-4cf1-85cb-596bb1046cec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4", "name": "network-vif-plugged", "status": "completed", "tag": "fe567be9-30b4-4da2-b072-3a957287bd60"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:57:15.032670 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-32df0acb-95dd-4b5b-8e3b-383e9510a9a4 req-37c7c1f8-f919-4cf1-85cb-596bb1046cec service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:15.033418 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-32df0acb-95dd-4b5b-8e3b-383e9510a9a4 req-37c7c1f8-f919-4cf1-85cb-596bb1046cec service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:15.034085 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-32df0acb-95dd-4b5b-8e3b-383e9510a9a4 req-37c7c1f8-f919-4cf1-85cb-596bb1046cec service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:15.063703 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-32df0acb-95dd-4b5b-8e3b-383e9510a9a4 req-37c7c1f8-f919-4cf1-85cb-596bb1046cec service nova] Creating event network-vif-plugged:fe567be9-30b4-4da2-b072-3a957287bd60 for instance 3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4 on n-h2-854247-14 Oct 17 13:57:15.076883 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-32df0acb-95dd-4b5b-8e3b-383e9510a9a4 req-37c7c1f8-f919-4cf1-85cb-596bb1046cec service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065500 Oct 17 13:57:15.078276 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2383/4636] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:57:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:57:15.282958 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e74de849-6e98-46a9-bd58-7fdd26aa5a31 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:15.284348 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e74de849-6e98-46a9-bd58-7fdd26aa5a31 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: 3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:15.296877 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e74de849-6e98-46a9-bd58-7fdd26aa5a31 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:15.298816 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e74de849-6e98-46a9-bd58-7fdd26aa5a31 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:15.303066 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e74de849-6e98-46a9-bd58-7fdd26aa5a31 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:15.304905 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e74de849-6e98-46a9-bd58-7fdd26aa5a31 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:15.305629 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e74de849-6e98-46a9-bd58-7fdd26aa5a31 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:15.306292 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e74de849-6e98-46a9-bd58-7fdd26aa5a31 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:15.435072 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c2cd6a95-de9e-4a3e-86af-bb2877794777 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:15.459661 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c2cd6a95-de9e-4a3e-86af-bb2877794777 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63" status: 200 len: 1505 microversion: 2.1 time: 0.655748 Oct 17 13:57:15.464060 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2254/4637] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:14 2022] GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63 => generated 1505 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:15.703060 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-33f0a3f0-7b98-4017-8163-819683fd54c5 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:15.703910 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-33f0a3f0-7b98-4017-8163-819683fd54c5 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 5d10ac72-2710-41c8-82a4-f648ed80d727] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:15.715491 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-33f0a3f0-7b98-4017-8163-819683fd54c5 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:15.716175 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-33f0a3f0-7b98-4017-8163-819683fd54c5 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:15.718264 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-33f0a3f0-7b98-4017-8163-819683fd54c5 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:15.719182 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-33f0a3f0-7b98-4017-8163-819683fd54c5 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:15.721272 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-33f0a3f0-7b98-4017-8163-819683fd54c5 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:15.722779 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-33f0a3f0-7b98-4017-8163-819683fd54c5 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:15.879679 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-33f0a3f0-7b98-4017-8163-819683fd54c5 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:15.889776 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e74de849-6e98-46a9-bd58-7fdd26aa5a31 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:15.898480 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-33f0a3f0-7b98-4017-8163-819683fd54c5 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/5d10ac72-2710-41c8-82a4-f648ed80d727" status: 200 len: 1273 microversion: 2.1 time: 0.200060 Oct 17 13:57:15.898906 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2255/4638] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:15 2022] GET /compute/v2.1/servers/5d10ac72-2710-41c8-82a4-f648ed80d727 => generated 1273 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:15.903766 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e74de849-6e98-46a9-bd58-7fdd26aa5a31 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4" status: 200 len: 1308 microversion: 2.1 time: 0.625469 Oct 17 13:57:15.904346 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2384/4639] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:15 2022] GET /compute/v2.1/servers/3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4 => generated 1308 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:57:16.490540 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d8e14c07-5ffc-4786-afff-7a9c4b955342 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:16.491150 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d8e14c07-5ffc-4786-afff-7a9c4b955342 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: 70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:16.508417 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d8e14c07-5ffc-4786-afff-7a9c4b955342 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:16.509041 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d8e14c07-5ffc-4786-afff-7a9c4b955342 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:16.509498 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d8e14c07-5ffc-4786-afff-7a9c4b955342 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:16.510248 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d8e14c07-5ffc-4786-afff-7a9c4b955342 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:16.510709 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d8e14c07-5ffc-4786-afff-7a9c4b955342 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:16.511143 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d8e14c07-5ffc-4786-afff-7a9c4b955342 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:16.904164 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d8e14c07-5ffc-4786-afff-7a9c4b955342 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:16.916203 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d8e14c07-5ffc-4786-afff-7a9c4b955342 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63" status: 200 len: 1505 microversion: 2.1 time: 0.430906 Oct 17 13:57:16.924305 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f073f5d5-92cc-44a4-a77c-fb76889a523c tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:16.925441 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f073f5d5-92cc-44a4-a77c-fb76889a523c tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 5d10ac72-2710-41c8-82a4-f648ed80d727] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:16.937575 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2256/4640] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:16 2022] GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63 => generated 1505 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:16.963960 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-475274a7-a261-4d9a-9233-2e7bfc6c4199 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:16.964084 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f073f5d5-92cc-44a4-a77c-fb76889a523c tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:16.964084 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f073f5d5-92cc-44a4-a77c-fb76889a523c tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:16.964084 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f073f5d5-92cc-44a4-a77c-fb76889a523c tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:16.964084 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f073f5d5-92cc-44a4-a77c-fb76889a523c tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:16.964084 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f073f5d5-92cc-44a4-a77c-fb76889a523c tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:16.964084 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f073f5d5-92cc-44a4-a77c-fb76889a523c tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:16.964577 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-475274a7-a261-4d9a-9233-2e7bfc6c4199 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: 3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:16.974977 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-475274a7-a261-4d9a-9233-2e7bfc6c4199 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:16.977317 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-475274a7-a261-4d9a-9233-2e7bfc6c4199 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:16.977820 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-475274a7-a261-4d9a-9233-2e7bfc6c4199 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:16.983373 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-475274a7-a261-4d9a-9233-2e7bfc6c4199 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:16.983373 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-475274a7-a261-4d9a-9233-2e7bfc6c4199 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:16.983373 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-475274a7-a261-4d9a-9233-2e7bfc6c4199 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:17.154651 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f073f5d5-92cc-44a4-a77c-fb76889a523c tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:17.165629 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f073f5d5-92cc-44a4-a77c-fb76889a523c tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/5d10ac72-2710-41c8-82a4-f648ed80d727" status: 200 len: 1273 microversion: 2.1 time: 0.247574 Oct 17 13:57:17.166840 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2385/4641] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:16 2022] GET /compute/v2.1/servers/5d10ac72-2710-41c8-82a4-f648ed80d727 => generated 1273 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:57:17.527386 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-475274a7-a261-4d9a-9233-2e7bfc6c4199 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:17.540680 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-475274a7-a261-4d9a-9233-2e7bfc6c4199 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4" status: 200 len: 1308 microversion: 2.1 time: 0.602881 Oct 17 13:57:17.542536 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2257/4642] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:16 2022] GET /compute/v2.1/servers/3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4 => generated 1308 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:17.961467 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-513a2437-a487-4334-bb87-07df201c6096 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:17.963046 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-513a2437-a487-4334-bb87-07df201c6096 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: 70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:17.973918 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-513a2437-a487-4334-bb87-07df201c6096 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:17.974825 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-513a2437-a487-4334-bb87-07df201c6096 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:17.975460 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-513a2437-a487-4334-bb87-07df201c6096 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:17.976352 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-513a2437-a487-4334-bb87-07df201c6096 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:17.976962 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-513a2437-a487-4334-bb87-07df201c6096 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:17.978247 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-513a2437-a487-4334-bb87-07df201c6096 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:18.194239 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a0b1a68c-2258-42c3-9d53-0f14239bad3b tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:18.195800 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a0b1a68c-2258-42c3-9d53-0f14239bad3b tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 5d10ac72-2710-41c8-82a4-f648ed80d727] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:18.203994 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a0b1a68c-2258-42c3-9d53-0f14239bad3b tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:18.205105 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a0b1a68c-2258-42c3-9d53-0f14239bad3b tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:18.205943 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a0b1a68c-2258-42c3-9d53-0f14239bad3b tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:18.207053 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a0b1a68c-2258-42c3-9d53-0f14239bad3b tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:18.207793 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a0b1a68c-2258-42c3-9d53-0f14239bad3b tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:18.208486 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a0b1a68c-2258-42c3-9d53-0f14239bad3b tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:18.562109 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-513a2437-a487-4334-bb87-07df201c6096 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:18.580275 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-513a2437-a487-4334-bb87-07df201c6096 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63" status: 200 len: 1505 microversion: 2.1 time: 0.619934 Oct 17 13:57:18.583705 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2386/4643] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:17 2022] GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63 => generated 1505 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:18.595532 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-18793b56-771b-48a7-a126-839148c555a6 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:18.596499 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-18793b56-771b-48a7-a126-839148c555a6 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: 3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:18.604714 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-18793b56-771b-48a7-a126-839148c555a6 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:18.606168 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-18793b56-771b-48a7-a126-839148c555a6 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:18.606854 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-18793b56-771b-48a7-a126-839148c555a6 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:18.607842 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-18793b56-771b-48a7-a126-839148c555a6 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:18.609946 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-18793b56-771b-48a7-a126-839148c555a6 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:18.610649 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-18793b56-771b-48a7-a126-839148c555a6 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:18.812229 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a0b1a68c-2258-42c3-9d53-0f14239bad3b tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:18.822381 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a0b1a68c-2258-42c3-9d53-0f14239bad3b tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/5d10ac72-2710-41c8-82a4-f648ed80d727" status: 200 len: 1315 microversion: 2.1 time: 0.632146 Oct 17 13:57:18.823431 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2258/4644] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:18 2022] GET /compute/v2.1/servers/5d10ac72-2710-41c8-82a4-f648ed80d727 => generated 1315 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:57:19.198332 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-18793b56-771b-48a7-a126-839148c555a6 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:19.210831 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-18793b56-771b-48a7-a126-839148c555a6 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4" status: 200 len: 1489 microversion: 2.1 time: 0.625197 Oct 17 13:57:19.212897 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2387/4645] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:18 2022] GET /compute/v2.1/servers/3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4 => generated 1489 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:19.243609 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8bff3308-0ecd-4364-9a5f-053f8040dd84 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:19.245092 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8bff3308-0ecd-4364-9a5f-053f8040dd84 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: a48e28ae-e228-462b-81eb-95f712dc0800] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:19.253119 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8bff3308-0ecd-4364-9a5f-053f8040dd84 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:19.254133 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8bff3308-0ecd-4364-9a5f-053f8040dd84 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:19.254760 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8bff3308-0ecd-4364-9a5f-053f8040dd84 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:19.255672 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8bff3308-0ecd-4364-9a5f-053f8040dd84 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:19.256297 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8bff3308-0ecd-4364-9a5f-053f8040dd84 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:19.257028 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8bff3308-0ecd-4364-9a5f-053f8040dd84 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:19.610495 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-37d3a8ff-7741-44d6-b13c-1eddf72af83a tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:19.611653 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-37d3a8ff-7741-44d6-b13c-1eddf72af83a tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: 70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:19.621738 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-37d3a8ff-7741-44d6-b13c-1eddf72af83a tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:19.622665 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-37d3a8ff-7741-44d6-b13c-1eddf72af83a tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:19.624212 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-37d3a8ff-7741-44d6-b13c-1eddf72af83a tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:19.625319 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-37d3a8ff-7741-44d6-b13c-1eddf72af83a tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:19.625998 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-37d3a8ff-7741-44d6-b13c-1eddf72af83a tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:19.629547 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-37d3a8ff-7741-44d6-b13c-1eddf72af83a tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:19.928157 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8bff3308-0ecd-4364-9a5f-053f8040dd84 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:19.945627 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8bff3308-0ecd-4364-9a5f-053f8040dd84 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/a48e28ae-e228-462b-81eb-95f712dc0800" status: 200 len: 1490 microversion: 2.1 time: 0.708862 Oct 17 13:57:19.947946 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2259/4646] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:19 2022] GET /compute/v2.1/servers/a48e28ae-e228-462b-81eb-95f712dc0800 => generated 1490 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:19.963102 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d5215195-6bc4-4ff2-a187-fbe13d54756d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:19.966351 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d5215195-6bc4-4ff2-a187-fbe13d54756d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 5d10ac72-2710-41c8-82a4-f648ed80d727] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:20.000881 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d5215195-6bc4-4ff2-a187-fbe13d54756d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:20.001758 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d5215195-6bc4-4ff2-a187-fbe13d54756d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:20.002429 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d5215195-6bc4-4ff2-a187-fbe13d54756d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:20.004700 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d5215195-6bc4-4ff2-a187-fbe13d54756d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:20.005671 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d5215195-6bc4-4ff2-a187-fbe13d54756d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:20.006148 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d5215195-6bc4-4ff2-a187-fbe13d54756d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:20.036489 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-37d3a8ff-7741-44d6-b13c-1eddf72af83a tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:20.057050 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-37d3a8ff-7741-44d6-b13c-1eddf72af83a tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63" status: 200 len: 1505 microversion: 2.1 time: 0.454251 Oct 17 13:57:20.061059 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2388/4647] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:19 2022] GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63 => generated 1505 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:20.066345 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-edffbbd6-1b2d-4713-b51e-14e6ebd9ed1f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:20.067577 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-edffbbd6-1b2d-4713-b51e-14e6ebd9ed1f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: 3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:20.074364 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-edffbbd6-1b2d-4713-b51e-14e6ebd9ed1f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:20.075086 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-edffbbd6-1b2d-4713-b51e-14e6ebd9ed1f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:20.075732 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-edffbbd6-1b2d-4713-b51e-14e6ebd9ed1f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:20.076749 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-edffbbd6-1b2d-4713-b51e-14e6ebd9ed1f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:20.077493 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-edffbbd6-1b2d-4713-b51e-14e6ebd9ed1f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:20.078099 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-edffbbd6-1b2d-4713-b51e-14e6ebd9ed1f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:20.574507 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d5215195-6bc4-4ff2-a187-fbe13d54756d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:20.588267 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d5215195-6bc4-4ff2-a187-fbe13d54756d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/5d10ac72-2710-41c8-82a4-f648ed80d727" status: 200 len: 1315 microversion: 2.1 time: 0.634892 Oct 17 13:57:20.588901 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2260/4648] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:19 2022] GET /compute/v2.1/servers/5d10ac72-2710-41c8-82a4-f648ed80d727 => generated 1315 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:20.629618 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-749356e6-8917-4840-b738-3bf09cea292a req-8b2355ca-4901-4eb8-a0c7-27d20b29cfe8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d10ac72-2710-41c8-82a4-f648ed80d727", "tag": "bd7f9054-4f10-48e3-8792-ac110bee45c6"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:57:20.661503 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-749356e6-8917-4840-b738-3bf09cea292a req-8b2355ca-4901-4eb8-a0c7-27d20b29cfe8 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:20.665206 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-749356e6-8917-4840-b738-3bf09cea292a req-8b2355ca-4901-4eb8-a0c7-27d20b29cfe8 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:20.665946 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-749356e6-8917-4840-b738-3bf09cea292a req-8b2355ca-4901-4eb8-a0c7-27d20b29cfe8 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:20.695296 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-749356e6-8917-4840-b738-3bf09cea292a req-8b2355ca-4901-4eb8-a0c7-27d20b29cfe8 service nova] Creating event network-changed:bd7f9054-4f10-48e3-8792-ac110bee45c6 for instance 5d10ac72-2710-41c8-82a4-f648ed80d727 on n-h1-854247-14 Oct 17 13:57:20.704471 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-749356e6-8917-4840-b738-3bf09cea292a req-8b2355ca-4901-4eb8-a0c7-27d20b29cfe8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080269 Oct 17 13:57:20.708467 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2261/4649] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:57:20.723100 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-edffbbd6-1b2d-4713-b51e-14e6ebd9ed1f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:20.739479 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-edffbbd6-1b2d-4713-b51e-14e6ebd9ed1f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4" status: 200 len: 1489 microversion: 2.1 time: 0.674435 Oct 17 13:57:20.740123 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2389/4650] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:20 2022] GET /compute/v2.1/servers/3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4 => generated 1489 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:20.772160 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-51ecf4ef-0301-4716-9be1-5410739a644d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:20.772761 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-51ecf4ef-0301-4716-9be1-5410739a644d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: 3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:20.790110 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-51ecf4ef-0301-4716-9be1-5410739a644d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:20.792290 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-51ecf4ef-0301-4716-9be1-5410739a644d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:20.792923 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-51ecf4ef-0301-4716-9be1-5410739a644d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:20.793836 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-51ecf4ef-0301-4716-9be1-5410739a644d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:20.799323 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-51ecf4ef-0301-4716-9be1-5410739a644d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:20.799962 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-51ecf4ef-0301-4716-9be1-5410739a644d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:20.824077 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=100 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:57:20.860075 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-51ecf4ef-0301-4716-9be1-5410739a644d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: 3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:57:21.017853 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-51ecf4ef-0301-4716-9be1-5410739a644d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4" status: 204 len: 0 microversion: 2.1 time: 0.252645 Oct 17 13:57:21.034420 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2262/4651] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:57:20 2022] DELETE /compute/v2.1/servers/3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:57:21.036304 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a5649b72-0c39-4e50-a94c-f6f06dee7193 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:21.037389 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a5649b72-0c39-4e50-a94c-f6f06dee7193 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: 3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:21.055503 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a5649b72-0c39-4e50-a94c-f6f06dee7193 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:21.056007 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a5649b72-0c39-4e50-a94c-f6f06dee7193 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:21.056451 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a5649b72-0c39-4e50-a94c-f6f06dee7193 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:21.057171 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a5649b72-0c39-4e50-a94c-f6f06dee7193 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:21.057969 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a5649b72-0c39-4e50-a94c-f6f06dee7193 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:21.062317 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a5649b72-0c39-4e50-a94c-f6f06dee7193 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:21.085570 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-61f2c7fe-7c56-4855-95f1-43d534f276c3 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:21.086293 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-61f2c7fe-7c56-4855-95f1-43d534f276c3 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: 70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:21.098328 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-61f2c7fe-7c56-4855-95f1-43d534f276c3 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:21.099220 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-61f2c7fe-7c56-4855-95f1-43d534f276c3 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:21.102315 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-61f2c7fe-7c56-4855-95f1-43d534f276c3 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:21.103330 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-61f2c7fe-7c56-4855-95f1-43d534f276c3 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:21.104697 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-61f2c7fe-7c56-4855-95f1-43d534f276c3 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:21.106525 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-61f2c7fe-7c56-4855-95f1-43d534f276c3 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:21.581154 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-61f2c7fe-7c56-4855-95f1-43d534f276c3 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:21.584617 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a5649b72-0c39-4e50-a94c-f6f06dee7193 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:21.593315 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a5649b72-0c39-4e50-a94c-f6f06dee7193 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4" status: 200 len: 1495 microversion: 2.1 time: 0.566278 Oct 17 13:57:21.595485 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2390/4652] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:21 2022] GET /compute/v2.1/servers/3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4 => generated 1495 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:57:21.605359 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-61f2c7fe-7c56-4855-95f1-43d534f276c3 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63" status: 200 len: 1505 microversion: 2.1 time: 0.513583 Oct 17 13:57:21.607071 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-763b4ee2-0bf4-44e6-84e7-1814f2a0eb4d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:21.607400 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2263/4653] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:21 2022] GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63 => generated 1505 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:21.608644 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-763b4ee2-0bf4-44e6-84e7-1814f2a0eb4d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:21.627644 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-35aabee2-b2dc-4e07-83e6-b8d07532ba04 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:21.630083 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-35aabee2-b2dc-4e07-83e6-b8d07532ba04 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 5d10ac72-2710-41c8-82a4-f648ed80d727] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:21.635810 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-763b4ee2-0bf4-44e6-84e7-1814f2a0eb4d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:21.638013 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-763b4ee2-0bf4-44e6-84e7-1814f2a0eb4d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:21.640288 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-763b4ee2-0bf4-44e6-84e7-1814f2a0eb4d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:21.643527 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-763b4ee2-0bf4-44e6-84e7-1814f2a0eb4d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:21.645137 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-763b4ee2-0bf4-44e6-84e7-1814f2a0eb4d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:21.646888 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-35aabee2-b2dc-4e07-83e6-b8d07532ba04 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:21.647403 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-763b4ee2-0bf4-44e6-84e7-1814f2a0eb4d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:21.650715 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-35aabee2-b2dc-4e07-83e6-b8d07532ba04 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:21.651263 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-35aabee2-b2dc-4e07-83e6-b8d07532ba04 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:21.652109 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-35aabee2-b2dc-4e07-83e6-b8d07532ba04 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:21.652632 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-35aabee2-b2dc-4e07-83e6-b8d07532ba04 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:21.656578 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-35aabee2-b2dc-4e07-83e6-b8d07532ba04 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:21.689248 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=100 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:57:22.117941 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-35aabee2-b2dc-4e07-83e6-b8d07532ba04 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:22.134659 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-763b4ee2-0bf4-44e6-84e7-1814f2a0eb4d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:22.156836 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-35aabee2-b2dc-4e07-83e6-b8d07532ba04 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/5d10ac72-2710-41c8-82a4-f648ed80d727" status: 200 len: 1315 microversion: 2.1 time: 0.543875 Oct 17 13:57:22.157443 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2264/4654] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:21 2022] GET /compute/v2.1/servers/5d10ac72-2710-41c8-82a4-f648ed80d727 => generated 1315 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:57:22.168497 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-763b4ee2-0bf4-44e6-84e7-1814f2a0eb4d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1666 microversion: 2.1 time: 0.571088 Oct 17 13:57:22.169130 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2391/4655] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:21 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1666 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:22.198792 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-78f88e3e-e7d0-4131-85f9-1894e8e26e75 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:22.199764 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-78f88e3e-e7d0-4131-85f9-1894e8e26e75 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:22.211675 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-78f88e3e-e7d0-4131-85f9-1894e8e26e75 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:22.212208 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-78f88e3e-e7d0-4131-85f9-1894e8e26e75 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:22.212636 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-78f88e3e-e7d0-4131-85f9-1894e8e26e75 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:22.213337 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-78f88e3e-e7d0-4131-85f9-1894e8e26e75 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:22.213804 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-78f88e3e-e7d0-4131-85f9-1894e8e26e75 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:22.214269 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-78f88e3e-e7d0-4131-85f9-1894e8e26e75 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:22.443426 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-78f88e3e-e7d0-4131-85f9-1894e8e26e75 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:22.461839 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-78f88e3e-e7d0-4131-85f9-1894e8e26e75 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1666 microversion: 2.1 time: 0.266884 Oct 17 13:57:22.462816 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2265/4656] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:22 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1666 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:22.486875 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cdd8ca30-761a-4e8e-bf5d-b6f64bfa155f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:22.487527 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cdd8ca30-761a-4e8e-bf5d-b6f64bfa155f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:22.494339 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cdd8ca30-761a-4e8e-bf5d-b6f64bfa155f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:22.494829 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cdd8ca30-761a-4e8e-bf5d-b6f64bfa155f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:22.495298 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cdd8ca30-761a-4e8e-bf5d-b6f64bfa155f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:22.496039 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cdd8ca30-761a-4e8e-bf5d-b6f64bfa155f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:22.496484 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cdd8ca30-761a-4e8e-bf5d-b6f64bfa155f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:22.497087 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cdd8ca30-761a-4e8e-bf5d-b6f64bfa155f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:22.621111 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-cd887c6d-7cce-4c9a-9c52-424e3e22fdb6 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:22.623633 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-cd887c6d-7cce-4c9a-9c52-424e3e22fdb6 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: 3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:22.635497 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cd887c6d-7cce-4c9a-9c52-424e3e22fdb6 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:22.636170 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cd887c6d-7cce-4c9a-9c52-424e3e22fdb6 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:22.636711 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cd887c6d-7cce-4c9a-9c52-424e3e22fdb6 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:22.637708 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cd887c6d-7cce-4c9a-9c52-424e3e22fdb6 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:22.638285 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cd887c6d-7cce-4c9a-9c52-424e3e22fdb6 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:22.639131 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cd887c6d-7cce-4c9a-9c52-424e3e22fdb6 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:23.154682 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cdd8ca30-761a-4e8e-bf5d-b6f64bfa155f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:23.169364 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cdd8ca30-761a-4e8e-bf5d-b6f64bfa155f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1666 microversion: 2.1 time: 0.685620 Oct 17 13:57:23.188428 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2392/4657] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:22 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1666 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:23.199786 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b96bffa9-959a-43ff-b6de-41a41c0cd082 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:23.200748 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b96bffa9-959a-43ff-b6de-41a41c0cd082 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: 70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:23.223177 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b96bffa9-959a-43ff-b6de-41a41c0cd082 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:23.225753 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b96bffa9-959a-43ff-b6de-41a41c0cd082 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:23.226426 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b96bffa9-959a-43ff-b6de-41a41c0cd082 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:23.227841 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b96bffa9-959a-43ff-b6de-41a41c0cd082 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:23.230476 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b96bffa9-959a-43ff-b6de-41a41c0cd082 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:23.232498 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b96bffa9-959a-43ff-b6de-41a41c0cd082 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:23.294918 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=4 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:57:23.346385 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=16 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:57:23.534100 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=10 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:57:23.769831 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-cd887c6d-7cce-4c9a-9c52-424e3e22fdb6 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:23.783125 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-cd887c6d-7cce-4c9a-9c52-424e3e22fdb6 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4" status: 200 len: 1495 microversion: 2.1 time: 1.166595 Oct 17 13:57:23.785617 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2266/4658] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:22 2022] GET /compute/v2.1/servers/3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4 => generated 1495 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:57:23.805855 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9d93f0e6-32da-4feb-ae96-013d734c0229 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:23.806953 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9d93f0e6-32da-4feb-ae96-013d734c0229 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 5d10ac72-2710-41c8-82a4-f648ed80d727] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:23.822916 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9d93f0e6-32da-4feb-ae96-013d734c0229 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:23.823852 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9d93f0e6-32da-4feb-ae96-013d734c0229 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:23.824472 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9d93f0e6-32da-4feb-ae96-013d734c0229 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:23.825437 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9d93f0e6-32da-4feb-ae96-013d734c0229 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:23.826689 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9d93f0e6-32da-4feb-ae96-013d734c0229 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:23.827295 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9d93f0e6-32da-4feb-ae96-013d734c0229 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:23.965882 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b96bffa9-959a-43ff-b6de-41a41c0cd082 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:23.975393 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b96bffa9-959a-43ff-b6de-41a41c0cd082 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63" status: 200 len: 1505 microversion: 2.1 time: 0.785458 Oct 17 13:57:23.976260 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2393/4659] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:23 2022] GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63 => generated 1505 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:23.996768 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fdff676a-13c1-46ea-9355-38ce521918f1 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:23.997431 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-fdff676a-13c1-46ea-9355-38ce521918f1 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:24.003843 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fdff676a-13c1-46ea-9355-38ce521918f1 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:24.004347 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fdff676a-13c1-46ea-9355-38ce521918f1 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:24.004780 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fdff676a-13c1-46ea-9355-38ce521918f1 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:24.005702 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fdff676a-13c1-46ea-9355-38ce521918f1 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:24.006339 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fdff676a-13c1-46ea-9355-38ce521918f1 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:24.006936 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fdff676a-13c1-46ea-9355-38ce521918f1 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:24.489831 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9d93f0e6-32da-4feb-ae96-013d734c0229 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:24.503475 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9d93f0e6-32da-4feb-ae96-013d734c0229 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/5d10ac72-2710-41c8-82a4-f648ed80d727" status: 200 len: 1315 microversion: 2.1 time: 0.715401 Oct 17 13:57:24.506556 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2267/4660] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:23 2022] GET /compute/v2.1/servers/5d10ac72-2710-41c8-82a4-f648ed80d727 => generated 1315 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:24.653602 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fdff676a-13c1-46ea-9355-38ce521918f1 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:24.668051 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fdff676a-13c1-46ea-9355-38ce521918f1 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1666 microversion: 2.1 time: 0.675388 Oct 17 13:57:24.679317 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2394/4661] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:23 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1666 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:24.808269 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-51561bbb-92f2-4ff1-96d1-35a571e73e8a tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:24.809707 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-51561bbb-92f2-4ff1-96d1-35a571e73e8a tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: 3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:24.819509 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-51561bbb-92f2-4ff1-96d1-35a571e73e8a tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:24.829926 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-51561bbb-92f2-4ff1-96d1-35a571e73e8a tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:24.831062 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-51561bbb-92f2-4ff1-96d1-35a571e73e8a tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:24.833024 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-51561bbb-92f2-4ff1-96d1-35a571e73e8a tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:24.833745 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-51561bbb-92f2-4ff1-96d1-35a571e73e8a tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:24.834502 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-51561bbb-92f2-4ff1-96d1-35a571e73e8a tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:24.855728 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-59c06a8f-f396-4668-bd95-fd55f93e6c3b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1528246175", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "1d5948d6-f169-4d00-b98f-07daff8883f9"}]}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:57:24.984030 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-59c06a8f-f396-4668-bd95-fd55f93e6c3b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] validate_networks() for [('1d5948d6-f169-4d00-b98f-07daff8883f9', None, None, None, None, None)] {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:57:25.042092 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-51561bbb-92f2-4ff1-96d1-35a571e73e8a tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:25.074747 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-51561bbb-92f2-4ff1-96d1-35a571e73e8a tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4" status: 200 len: 1453 microversion: 2.1 time: 0.270550 Oct 17 13:57:25.078197 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2268/4662] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:24 2022] GET /compute/v2.1/servers/3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4 => generated 1453 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:57:25.111975 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-30e55cf7-9360-4d0d-accf-a8b81daa1400 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:25.118359 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-30e55cf7-9360-4d0d-accf-a8b81daa1400 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: 70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:25.136539 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-30e55cf7-9360-4d0d-accf-a8b81daa1400 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:25.137422 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-30e55cf7-9360-4d0d-accf-a8b81daa1400 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:25.138572 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-30e55cf7-9360-4d0d-accf-a8b81daa1400 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:25.139578 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-30e55cf7-9360-4d0d-accf-a8b81daa1400 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:25.140183 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-30e55cf7-9360-4d0d-accf-a8b81daa1400 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:25.140897 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-30e55cf7-9360-4d0d-accf-a8b81daa1400 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:25.666242 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-30e55cf7-9360-4d0d-accf-a8b81daa1400 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:25.676165 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-30e55cf7-9360-4d0d-accf-a8b81daa1400 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63" status: 200 len: 1505 microversion: 2.1 time: 0.591875 Oct 17 13:57:25.677208 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2269/4663] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:25 2022] GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63 => generated 1505 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:25.684012 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-a1752c2e-e36b-4e8c-83b4-d3e0aa4f3227 req-91c016e9-685c-4e42-8bbe-e92be86b0f56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4", "name": "network-vif-deleted", "tag": "fe567be9-30b4-4da2-b072-3a957287bd60"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:57:25.698297 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-a1752c2e-e36b-4e8c-83b4-d3e0aa4f3227 req-91c016e9-685c-4e42-8bbe-e92be86b0f56 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:25.699917 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-a1752c2e-e36b-4e8c-83b4-d3e0aa4f3227 req-91c016e9-685c-4e42-8bbe-e92be86b0f56 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:25.700470 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-a1752c2e-e36b-4e8c-83b4-d3e0aa4f3227 req-91c016e9-685c-4e42-8bbe-e92be86b0f56 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:25.717994 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-a1752c2e-e36b-4e8c-83b4-d3e0aa4f3227 req-91c016e9-685c-4e42-8bbe-e92be86b0f56 service nova] Creating event network-vif-deleted:fe567be9-30b4-4da2-b072-3a957287bd60 for instance 3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4 on n-h2-854247-14 Oct 17 13:57:25.728189 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-a1752c2e-e36b-4e8c-83b4-d3e0aa4f3227 req-91c016e9-685c-4e42-8bbe-e92be86b0f56 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049336 Oct 17 13:57:25.730311 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2270/4664] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:57:25.738487 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-fcb5792a-a7b5-4320-a61d-d03511a31f1e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:25.740126 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-fcb5792a-a7b5-4320-a61d-d03511a31f1e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 5d10ac72-2710-41c8-82a4-f648ed80d727] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:25.752191 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fcb5792a-a7b5-4320-a61d-d03511a31f1e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:25.753115 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fcb5792a-a7b5-4320-a61d-d03511a31f1e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:25.754688 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fcb5792a-a7b5-4320-a61d-d03511a31f1e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:25.755554 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fcb5792a-a7b5-4320-a61d-d03511a31f1e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:25.756553 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fcb5792a-a7b5-4320-a61d-d03511a31f1e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:25.757234 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fcb5792a-a7b5-4320-a61d-d03511a31f1e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:26.341760 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-fcb5792a-a7b5-4320-a61d-d03511a31f1e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:26.351153 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-fcb5792a-a7b5-4320-a61d-d03511a31f1e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/5d10ac72-2710-41c8-82a4-f648ed80d727" status: 200 len: 1315 microversion: 2.1 time: 0.619040 Oct 17 13:57:26.351764 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2271/4665] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:25 2022] GET /compute/v2.1/servers/5d10ac72-2710-41c8-82a4-f648ed80d727 => generated 1315 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:26.356835 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9187f407-6758-49bf-9217-88d1acef3619 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:26.358225 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9187f407-6758-49bf-9217-88d1acef3619 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: 3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:26.367473 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9187f407-6758-49bf-9217-88d1acef3619 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:26.367963 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9187f407-6758-49bf-9217-88d1acef3619 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:26.368469 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9187f407-6758-49bf-9217-88d1acef3619 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:26.369369 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9187f407-6758-49bf-9217-88d1acef3619 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:26.369781 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9187f407-6758-49bf-9217-88d1acef3619 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:26.370377 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9187f407-6758-49bf-9217-88d1acef3619 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:26.385210 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-59c06a8f-f396-4668-bd95-fd55f93e6c3b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:57:26.385943 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-59c06a8f-f396-4668-bd95-fd55f93e6c3b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:57:26.386246 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-9187f407-6758-49bf-9217-88d1acef3619 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] HTTP exception thrown: Instance 3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4 could not be found. Oct 17 13:57:26.386537 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-59c06a8f-f396-4668-bd95-fd55f93e6c3b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:57:26.387014 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-59c06a8f-f396-4668-bd95-fd55f93e6c3b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:57:26.387521 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-59c06a8f-f396-4668-bd95-fd55f93e6c3b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9187f407-6758-49bf-9217-88d1acef3619 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Request method failure captured: Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4 HTTP/1.1 Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTV7LY5HyKXIBiWDJCG3V5sT42rtCOx1a0oRMtoibd5F_sflHwMTlRe9Y_uOa1HxVMLf4skT3kvoUZ584fC2ohAV2v8XUvXrQcJEEPLKlU8mLvFkUN1JC352BF9fy9_Q0qQLABy1MIy7jPkSZI0xF-7yfpY_h22PPPDKIkDzzcK6D9CQ Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 4fa57e8772684c93a406f3d01da2af88 Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServersTestJSON-749544598 Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4fa57e8772684c93a406f3d01da2af88", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServersTestJSON-749544598 Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 4fa57e8772684c93a406f3d01da2af88 Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServersTestJSON-749544598 Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServersTestJSON-749544598-project Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: d78348abc02a4bb892902b0dd3bcfd6a Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServersTestJSON-749544598-project Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4 could not be found. Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4'} Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4 could not be found. Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4 could not be found. Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:57:26.387945 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:57:26.394449 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:57:26.394449 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:57:26.394449 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:57:26.394449 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:57:26.394449 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4 could not be found. Oct 17 13:57:26.394449 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:57:26.394449 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9187f407-6758-49bf-9217-88d1acef3619 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Returning 404 to user: Instance 3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:57:26.394449 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9187f407-6758-49bf-9217-88d1acef3619 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4" status: 404 len: 111 microversion: 2.1 time: 0.036323 Oct 17 13:57:26.394449 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2272/4666] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:26 2022] GET /compute/v2.1/servers/3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:57:26.395709 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-2f1fac16-d4bc-4063-938c-31941a986de3 req-c89096c9-8fa5-44b2-8dad-f15a8b7c6e07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d10ac72-2710-41c8-82a4-f648ed80d727", "name": "network-vif-plugged", "status": "completed", "tag": "bd7f9054-4f10-48e3-8792-ac110bee45c6"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:57:26.403621 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-59c06a8f-f396-4668-bd95-fd55f93e6c3b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:26.404448 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-59c06a8f-f396-4668-bd95-fd55f93e6c3b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:26.404950 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-59c06a8f-f396-4668-bd95-fd55f93e6c3b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:26.405616 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-2f1fac16-d4bc-4063-938c-31941a986de3 req-c89096c9-8fa5-44b2-8dad-f15a8b7c6e07 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:26.405790 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-59c06a8f-f396-4668-bd95-fd55f93e6c3b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:26.406115 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-2f1fac16-d4bc-4063-938c-31941a986de3 req-c89096c9-8fa5-44b2-8dad-f15a8b7c6e07 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:26.406502 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-2f1fac16-d4bc-4063-938c-31941a986de3 req-c89096c9-8fa5-44b2-8dad-f15a8b7c6e07 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:26.406655 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-59c06a8f-f396-4668-bd95-fd55f93e6c3b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:26.407147 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-59c06a8f-f396-4668-bd95-fd55f93e6c3b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:26.418860 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-2f1fac16-d4bc-4063-938c-31941a986de3 req-c89096c9-8fa5-44b2-8dad-f15a8b7c6e07 service nova] Creating event network-vif-plugged:bd7f9054-4f10-48e3-8792-ac110bee45c6 for instance 5d10ac72-2710-41c8-82a4-f648ed80d727 on n-h1-854247-14 Oct 17 13:57:26.424602 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-2f1fac16-d4bc-4063-938c-31941a986de3 req-c89096c9-8fa5-44b2-8dad-f15a8b7c6e07 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033273 Oct 17 13:57:26.425208 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2273/4667] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:57:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:57:26.427293 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-59c06a8f-f396-4668-bd95-fd55f93e6c3b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Getting quotas for project 45371f66db35454fbe896194e75afd6e. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:57:26.433549 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-59c06a8f-f396-4668-bd95-fd55f93e6c3b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Getting quotas for user c9382b34782f44e2818a26ecadc3f386 and project 45371f66db35454fbe896194e75afd6e. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:57:26.434751 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-904ea156-516b-40d7-a24e-7a7ddf1f1d07 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:26.435570 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-904ea156-516b-40d7-a24e-7a7ddf1f1d07 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: a48e28ae-e228-462b-81eb-95f712dc0800] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:26.443196 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-904ea156-516b-40d7-a24e-7a7ddf1f1d07 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:26.444009 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-904ea156-516b-40d7-a24e-7a7ddf1f1d07 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:26.444437 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-904ea156-516b-40d7-a24e-7a7ddf1f1d07 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:26.445311 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-904ea156-516b-40d7-a24e-7a7ddf1f1d07 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:26.445766 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-904ea156-516b-40d7-a24e-7a7ddf1f1d07 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:26.446182 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-904ea156-516b-40d7-a24e-7a7ddf1f1d07 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:26.467882 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-59c06a8f-f396-4668-bd95-fd55f93e6c3b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:57:26.470411 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-59c06a8f-f396-4668-bd95-fd55f93e6c3b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:57:26.490922 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-904ea156-516b-40d7-a24e-7a7ddf1f1d07 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: a48e28ae-e228-462b-81eb-95f712dc0800] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:57:26.525130 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-59c06a8f-f396-4668-bd95-fd55f93e6c3b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.673450 Oct 17 13:57:26.526098 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2395/4668] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:57:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:57:26.551294 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-364e3760-b853-45c3-b320-6e5df6449586 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:26.553041 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-364e3760-b853-45c3-b320-6e5df6449586 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:26.618155 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-904ea156-516b-40d7-a24e-7a7ddf1f1d07 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a48e28ae-e228-462b-81eb-95f712dc0800" status: 204 len: 0 microversion: 2.1 time: 0.187690 Oct 17 13:57:26.619124 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2274/4669] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:57:26 2022] DELETE /compute/v2.1/servers/a48e28ae-e228-462b-81eb-95f712dc0800 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:57:26.638553 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-aab6d7c4-2957-409e-94fb-823997dd3fbb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:26.642029 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-aab6d7c4-2957-409e-94fb-823997dd3fbb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: a48e28ae-e228-462b-81eb-95f712dc0800] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:26.644577 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-364e3760-b853-45c3-b320-6e5df6449586 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:26.656255 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-364e3760-b853-45c3-b320-6e5df6449586 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4" status: 200 len: 1215 microversion: 2.1 time: 0.122721 Oct 17 13:57:26.657222 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2396/4670] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:26 2022] GET /compute/v2.1/servers/aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4 => generated 1215 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:26.658049 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aab6d7c4-2957-409e-94fb-823997dd3fbb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:26.658692 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aab6d7c4-2957-409e-94fb-823997dd3fbb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:26.659959 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aab6d7c4-2957-409e-94fb-823997dd3fbb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:26.661138 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aab6d7c4-2957-409e-94fb-823997dd3fbb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:26.661681 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aab6d7c4-2957-409e-94fb-823997dd3fbb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:26.662183 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aab6d7c4-2957-409e-94fb-823997dd3fbb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:26.702268 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d61280c3-edc7-4955-8af9-ac256f73b3eb tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:26.703277 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d61280c3-edc7-4955-8af9-ac256f73b3eb tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: 70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:26.711633 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d61280c3-edc7-4955-8af9-ac256f73b3eb tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:26.712483 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d61280c3-edc7-4955-8af9-ac256f73b3eb tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:26.713310 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d61280c3-edc7-4955-8af9-ac256f73b3eb tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:26.714259 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d61280c3-edc7-4955-8af9-ac256f73b3eb tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:26.716044 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d61280c3-edc7-4955-8af9-ac256f73b3eb tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:26.716644 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d61280c3-edc7-4955-8af9-ac256f73b3eb tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:26.968769 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-aab6d7c4-2957-409e-94fb-823997dd3fbb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:26.982074 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-aab6d7c4-2957-409e-94fb-823997dd3fbb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/a48e28ae-e228-462b-81eb-95f712dc0800" status: 200 len: 1496 microversion: 2.1 time: 0.353016 Oct 17 13:57:26.984045 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2275/4671] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:26 2022] GET /compute/v2.1/servers/a48e28ae-e228-462b-81eb-95f712dc0800 => generated 1496 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:27.010421 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d61280c3-edc7-4955-8af9-ac256f73b3eb tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:27.019907 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d61280c3-edc7-4955-8af9-ac256f73b3eb tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63" status: 200 len: 1485 microversion: 2.1 time: 0.322168 Oct 17 13:57:27.021427 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2397/4672] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:26 2022] GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63 => generated 1485 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:27.199839 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-fcdfe121-7407-4386-91c0-0571eb2c753b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-630788266", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:57:27.293059 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-fcdfe121-7407-4386-91c0-0571eb2c753b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] validate_networks() for [('b49f903b-f4c7-4e7e-b00e-fad95121a23e', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:57:27.378033 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2a26ac0b-f90f-47a8-8fa6-b0f1c5a8b22a tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:27.379103 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2a26ac0b-f90f-47a8-8fa6-b0f1c5a8b22a tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 5d10ac72-2710-41c8-82a4-f648ed80d727] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:27.397851 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2a26ac0b-f90f-47a8-8fa6-b0f1c5a8b22a tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:27.398532 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2a26ac0b-f90f-47a8-8fa6-b0f1c5a8b22a tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:27.398893 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2a26ac0b-f90f-47a8-8fa6-b0f1c5a8b22a tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:27.400176 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2a26ac0b-f90f-47a8-8fa6-b0f1c5a8b22a tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:27.401363 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2a26ac0b-f90f-47a8-8fa6-b0f1c5a8b22a tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:27.401926 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2a26ac0b-f90f-47a8-8fa6-b0f1c5a8b22a tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:27.750921 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2a26ac0b-f90f-47a8-8fa6-b0f1c5a8b22a tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:27.761282 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2a26ac0b-f90f-47a8-8fa6-b0f1c5a8b22a tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/5d10ac72-2710-41c8-82a4-f648ed80d727" status: 200 len: 1315 microversion: 2.1 time: 0.389581 Oct 17 13:57:27.762533 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2398/4673] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:27 2022] GET /compute/v2.1/servers/5d10ac72-2710-41c8-82a4-f648ed80d727 => generated 1315 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:57:27.780764 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-366cb365-baf9-438d-9e32-5682654b1b60 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:27.781641 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-366cb365-baf9-438d-9e32-5682654b1b60 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:27.794006 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-366cb365-baf9-438d-9e32-5682654b1b60 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:27.794532 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-366cb365-baf9-438d-9e32-5682654b1b60 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:27.794976 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-366cb365-baf9-438d-9e32-5682654b1b60 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:27.795798 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-366cb365-baf9-438d-9e32-5682654b1b60 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:27.796253 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-366cb365-baf9-438d-9e32-5682654b1b60 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:27.796692 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-366cb365-baf9-438d-9e32-5682654b1b60 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:27.990332 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-366cb365-baf9-438d-9e32-5682654b1b60 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:28.001675 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-366cb365-baf9-438d-9e32-5682654b1b60 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4" status: 200 len: 1267 microversion: 2.1 time: 0.237302 Oct 17 13:57:28.002270 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2399/4674] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:27 2022] GET /compute/v2.1/servers/aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4 => generated 1267 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:28.014116 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1acdb4ed-c52b-41a0-9889-3507cf399e18 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:28.015567 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-1acdb4ed-c52b-41a0-9889-3507cf399e18 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: a48e28ae-e228-462b-81eb-95f712dc0800] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:28.033737 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1acdb4ed-c52b-41a0-9889-3507cf399e18 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:28.034506 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1acdb4ed-c52b-41a0-9889-3507cf399e18 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:28.035191 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1acdb4ed-c52b-41a0-9889-3507cf399e18 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:28.036086 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1acdb4ed-c52b-41a0-9889-3507cf399e18 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:28.036700 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1acdb4ed-c52b-41a0-9889-3507cf399e18 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:28.037272 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1acdb4ed-c52b-41a0-9889-3507cf399e18 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:28.645457 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-fcdfe121-7407-4386-91c0-0571eb2c753b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:57:28.645966 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-fcdfe121-7407-4386-91c0-0571eb2c753b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:57:28.646431 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-fcdfe121-7407-4386-91c0-0571eb2c753b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:57:28.646837 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-1acdb4ed-c52b-41a0-9889-3507cf399e18 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:28.647322 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-fcdfe121-7407-4386-91c0-0571eb2c753b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:57:28.647322 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-fcdfe121-7407-4386-91c0-0571eb2c753b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:57:28.660932 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fcdfe121-7407-4386-91c0-0571eb2c753b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:28.661343 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fcdfe121-7407-4386-91c0-0571eb2c753b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:28.661956 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fcdfe121-7407-4386-91c0-0571eb2c753b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:28.663049 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1acdb4ed-c52b-41a0-9889-3507cf399e18 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/a48e28ae-e228-462b-81eb-95f712dc0800" status: 200 len: 1496 microversion: 2.1 time: 0.655615 Oct 17 13:57:28.663523 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fcdfe121-7407-4386-91c0-0571eb2c753b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:28.664846 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fcdfe121-7407-4386-91c0-0571eb2c753b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:28.664846 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fcdfe121-7407-4386-91c0-0571eb2c753b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:28.666026 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2400/4675] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:28 2022] GET /compute/v2.1/servers/a48e28ae-e228-462b-81eb-95f712dc0800 => generated 1496 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:28.693493 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-fcdfe121-7407-4386-91c0-0571eb2c753b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Getting quotas for project f5cd6550628148f9b0ae1907967da048. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:57:28.700151 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-fcdfe121-7407-4386-91c0-0571eb2c753b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Getting quotas for user 6e0edd4df0ec4a079ab988b186fedf00 and project f5cd6550628148f9b0ae1907967da048. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:57:28.714272 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-fcdfe121-7407-4386-91c0-0571eb2c753b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:57:28.716914 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-fcdfe121-7407-4386-91c0-0571eb2c753b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: cdde7779-a327-416c-863c-cd50d4d11c47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:57:28.745431 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:57:28.785883 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-fcdfe121-7407-4386-91c0-0571eb2c753b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.596950 Oct 17 13:57:28.786888 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2276/4676] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:57:27 2022] POST /compute/v2.1/servers => generated 383 bytes in 1599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:57:28.790412 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8fd3f4af-3b05-4e38-81c8-560e50350447 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:28.791411 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8fd3f4af-3b05-4e38-81c8-560e50350447 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 5d10ac72-2710-41c8-82a4-f648ed80d727] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:28.799419 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4fa3f03b-2d63-44c2-898a-83117a33d905 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:28.801639 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4fa3f03b-2d63-44c2-898a-83117a33d905 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: cdde7779-a327-416c-863c-cd50d4d11c47] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:28.804869 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8fd3f4af-3b05-4e38-81c8-560e50350447 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:28.805622 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8fd3f4af-3b05-4e38-81c8-560e50350447 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:28.807084 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8fd3f4af-3b05-4e38-81c8-560e50350447 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:28.808643 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8fd3f4af-3b05-4e38-81c8-560e50350447 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:28.809270 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8fd3f4af-3b05-4e38-81c8-560e50350447 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:28.810435 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8fd3f4af-3b05-4e38-81c8-560e50350447 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:28.913086 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4fa3f03b-2d63-44c2-898a-83117a33d905 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:28.921642 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4fa3f03b-2d63-44c2-898a-83117a33d905 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47" status: 200 len: 1213 microversion: 2.1 time: 0.126296 Oct 17 13:57:28.922694 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2277/4677] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:28 2022] GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47 => generated 1213 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:57:29.029934 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e6291607-11a9-4eaf-bf9c-5742d3a401c7 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:29.030559 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e6291607-11a9-4eaf-bf9c-5742d3a401c7 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:29.038427 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e6291607-11a9-4eaf-bf9c-5742d3a401c7 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:29.038915 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e6291607-11a9-4eaf-bf9c-5742d3a401c7 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:29.039375 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e6291607-11a9-4eaf-bf9c-5742d3a401c7 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:29.043113 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e6291607-11a9-4eaf-bf9c-5742d3a401c7 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:29.045097 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e6291607-11a9-4eaf-bf9c-5742d3a401c7 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:29.048811 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e6291607-11a9-4eaf-bf9c-5742d3a401c7 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:29.270317 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e6291607-11a9-4eaf-bf9c-5742d3a401c7 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:29.279599 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e6291607-11a9-4eaf-bf9c-5742d3a401c7 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4" status: 200 len: 1273 microversion: 2.1 time: 0.253675 Oct 17 13:57:29.283925 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2278/4678] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:29 2022] GET /compute/v2.1/servers/aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4 => generated 1273 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:29.304294 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-a56b591e-b283-47aa-9093-f23bea80e84b req-8a4fef32-cc15-4edc-acb2-756261633646 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a48e28ae-e228-462b-81eb-95f712dc0800", "name": "network-vif-deleted", "tag": "3950fed2-52c1-4cc0-b5ed-4eb1fd9675ee"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:57:29.331815 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-a56b591e-b283-47aa-9093-f23bea80e84b req-8a4fef32-cc15-4edc-acb2-756261633646 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:29.332631 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-a56b591e-b283-47aa-9093-f23bea80e84b req-8a4fef32-cc15-4edc-acb2-756261633646 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:29.333217 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-a56b591e-b283-47aa-9093-f23bea80e84b req-8a4fef32-cc15-4edc-acb2-756261633646 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:29.348463 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8fd3f4af-3b05-4e38-81c8-560e50350447 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:29.361933 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:57:29.362975 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8fd3f4af-3b05-4e38-81c8-560e50350447 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/5d10ac72-2710-41c8-82a4-f648ed80d727" status: 200 len: 1315 microversion: 2.1 time: 0.580051 Oct 17 13:57:29.363957 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-a56b591e-b283-47aa-9093-f23bea80e84b req-8a4fef32-cc15-4edc-acb2-756261633646 service nova] Creating event network-vif-deleted:3950fed2-52c1-4cc0-b5ed-4eb1fd9675ee for instance a48e28ae-e228-462b-81eb-95f712dc0800 on n-h1-854247-14 Oct 17 13:57:29.364340 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2401/4679] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:28 2022] GET /compute/v2.1/servers/5d10ac72-2710-41c8-82a4-f648ed80d727 => generated 1315 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:29.385879 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-a56b591e-b283-47aa-9093-f23bea80e84b req-8a4fef32-cc15-4edc-acb2-756261633646 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083346 Oct 17 13:57:29.388556 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2279/4680] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:57:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:57:29.693336 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-416a7995-0bea-4846-ae10-b90b2d7b09e5 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:29.694936 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-416a7995-0bea-4846-ae10-b90b2d7b09e5 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: a48e28ae-e228-462b-81eb-95f712dc0800] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:29.704699 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-416a7995-0bea-4846-ae10-b90b2d7b09e5 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:29.705449 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-416a7995-0bea-4846-ae10-b90b2d7b09e5 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:29.706046 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-416a7995-0bea-4846-ae10-b90b2d7b09e5 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:29.707229 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-416a7995-0bea-4846-ae10-b90b2d7b09e5 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:29.708064 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-416a7995-0bea-4846-ae10-b90b2d7b09e5 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:29.713658 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-416a7995-0bea-4846-ae10-b90b2d7b09e5 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:29.762646 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-416a7995-0bea-4846-ae10-b90b2d7b09e5 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:29.763144 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-416a7995-0bea-4846-ae10-b90b2d7b09e5 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:29.763607 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-416a7995-0bea-4846-ae10-b90b2d7b09e5 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:29.764061 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-416a7995-0bea-4846-ae10-b90b2d7b09e5 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lazy-loading 'fault' on Instance uuid a48e28ae-e228-462b-81eb-95f712dc0800 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:57:29.952559 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e9b3b908-920a-4da9-9da6-b973e1ab12e1 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:29.953598 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e9b3b908-920a-4da9-9da6-b973e1ab12e1 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: cdde7779-a327-416c-863c-cd50d4d11c47] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:29.961571 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e9b3b908-920a-4da9-9da6-b973e1ab12e1 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:29.962146 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e9b3b908-920a-4da9-9da6-b973e1ab12e1 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:29.962742 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e9b3b908-920a-4da9-9da6-b973e1ab12e1 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:29.963859 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e9b3b908-920a-4da9-9da6-b973e1ab12e1 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:29.964508 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e9b3b908-920a-4da9-9da6-b973e1ab12e1 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:29.965139 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e9b3b908-920a-4da9-9da6-b973e1ab12e1 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:29.996978 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-416a7995-0bea-4846-ae10-b90b2d7b09e5 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:30.005288 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-416a7995-0bea-4846-ae10-b90b2d7b09e5 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/a48e28ae-e228-462b-81eb-95f712dc0800" status: 200 len: 1298 microversion: 2.1 time: 0.316138 Oct 17 13:57:30.011159 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2402/4681] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:29 2022] GET /compute/v2.1/servers/a48e28ae-e228-462b-81eb-95f712dc0800 => generated 1298 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:30.174052 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e9b3b908-920a-4da9-9da6-b973e1ab12e1 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:30.184188 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e9b3b908-920a-4da9-9da6-b973e1ab12e1 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47" status: 200 len: 1209 microversion: 2.1 time: 0.241596 Oct 17 13:57:30.189968 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2280/4682] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:29 2022] GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47 => generated 1209 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:57:30.309137 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a22a950f-80b7-40c3-a85e-8bbe68958a20 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:30.310023 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a22a950f-80b7-40c3-a85e-8bbe68958a20 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:30.319863 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a22a950f-80b7-40c3-a85e-8bbe68958a20 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:30.320929 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a22a950f-80b7-40c3-a85e-8bbe68958a20 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:30.321523 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a22a950f-80b7-40c3-a85e-8bbe68958a20 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:30.322377 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a22a950f-80b7-40c3-a85e-8bbe68958a20 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:30.323368 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a22a950f-80b7-40c3-a85e-8bbe68958a20 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:30.323938 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a22a950f-80b7-40c3-a85e-8bbe68958a20 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:30.388242 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3b0705f4-3885-4f9d-9b1a-f7f4d10c7c03 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:30.389255 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3b0705f4-3885-4f9d-9b1a-f7f4d10c7c03 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 5d10ac72-2710-41c8-82a4-f648ed80d727] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:30.405166 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3b0705f4-3885-4f9d-9b1a-f7f4d10c7c03 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:30.405941 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3b0705f4-3885-4f9d-9b1a-f7f4d10c7c03 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:30.406763 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3b0705f4-3885-4f9d-9b1a-f7f4d10c7c03 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:30.409983 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3b0705f4-3885-4f9d-9b1a-f7f4d10c7c03 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:30.412355 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3b0705f4-3885-4f9d-9b1a-f7f4d10c7c03 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:30.412796 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3b0705f4-3885-4f9d-9b1a-f7f4d10c7c03 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:30.492935 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a22a950f-80b7-40c3-a85e-8bbe68958a20 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:30.500796 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a22a950f-80b7-40c3-a85e-8bbe68958a20 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4" status: 200 len: 1273 microversion: 2.1 time: 0.197821 Oct 17 13:57:30.501527 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2403/4683] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:30 2022] GET /compute/v2.1/servers/aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4 => generated 1273 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:57:30.892115 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3b0705f4-3885-4f9d-9b1a-f7f4d10c7c03 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:30.904799 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3b0705f4-3885-4f9d-9b1a-f7f4d10c7c03 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/5d10ac72-2710-41c8-82a4-f648ed80d727" status: 200 len: 1502 microversion: 2.1 time: 0.521441 Oct 17 13:57:30.907584 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2281/4684] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:30 2022] GET /compute/v2.1/servers/5d10ac72-2710-41c8-82a4-f648ed80d727 => generated 1502 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:30.934073 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-aabc80c8-38b6-4258-a670-eff5e9ca6322 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:57:30.934668 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-aabc80c8-38b6-4258-a670-eff5e9ca6322 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 5d10ac72-2710-41c8-82a4-f648ed80d727] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:30.948103 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aabc80c8-38b6-4258-a670-eff5e9ca6322 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:30.949418 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aabc80c8-38b6-4258-a670-eff5e9ca6322 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:30.949871 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aabc80c8-38b6-4258-a670-eff5e9ca6322 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:30.967896 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aabc80c8-38b6-4258-a670-eff5e9ca6322 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:30.968860 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aabc80c8-38b6-4258-a670-eff5e9ca6322 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:30.970712 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aabc80c8-38b6-4258-a670-eff5e9ca6322 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:31.037686 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b9ae2741-d46a-4e2a-b77a-0048336a3907 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:31.045413 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b9ae2741-d46a-4e2a-b77a-0048336a3907 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: a48e28ae-e228-462b-81eb-95f712dc0800] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:31.062163 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b9ae2741-d46a-4e2a-b77a-0048336a3907 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:31.066921 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b9ae2741-d46a-4e2a-b77a-0048336a3907 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:31.068082 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b9ae2741-d46a-4e2a-b77a-0048336a3907 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:31.068988 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b9ae2741-d46a-4e2a-b77a-0048336a3907 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:31.069595 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b9ae2741-d46a-4e2a-b77a-0048336a3907 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:31.070168 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b9ae2741-d46a-4e2a-b77a-0048336a3907 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:31.087941 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-b9ae2741-d46a-4e2a-b77a-0048336a3907 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] HTTP exception thrown: Instance a48e28ae-e228-462b-81eb-95f712dc0800 could not be found. Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b9ae2741-d46a-4e2a-b77a-0048336a3907 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Request method failure captured: Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/a48e28ae-e228-462b-81eb-95f712dc0800 HTTP/1.1 Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTV7LY5HyKXIBiWDJCG3V5sT42rtCOx1a0oRMtoibd5F_sflHwMTlRe9Y_uOa1HxVMLf4skT3kvoUZ584fC2ohAV2v8XUvXrQcJEEPLKlU8mLvFkUN1JC352BF9fy9_Q0qQLABy1MIy7jPkSZI0xF-7yfpY_h22PPPDKIkDzzcK6D9CQ Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 4fa57e8772684c93a406f3d01da2af88 Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServersTestJSON-749544598 Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4fa57e8772684c93a406f3d01da2af88", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServersTestJSON-749544598 Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 4fa57e8772684c93a406f3d01da2af88 Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServersTestJSON-749544598 Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServersTestJSON-749544598-project Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: d78348abc02a4bb892902b0dd3bcfd6a Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServersTestJSON-749544598-project Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance a48e28ae-e228-462b-81eb-95f712dc0800 could not be found. Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'a48e28ae-e228-462b-81eb-95f712dc0800'} Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a48e28ae-e228-462b-81eb-95f712dc0800 could not be found. Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a48e28ae-e228-462b-81eb-95f712dc0800 could not be found. Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:57:31.090093 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:57:31.095220 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:57:31.095220 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:57:31.095220 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:57:31.095220 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:57:31.095220 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a48e28ae-e228-462b-81eb-95f712dc0800 could not be found. Oct 17 13:57:31.095220 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:57:31.108311 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-aabc80c8-38b6-4258-a670-eff5e9ca6322 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "POST /compute/v2.1/servers/5d10ac72-2710-41c8-82a4-f648ed80d727/action" status: 202 len: 0 microversion: 2.1 time: 0.179084 Oct 17 13:57:31.109460 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2404/4685] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:57:30 2022] POST /compute/v2.1/servers/5d10ac72-2710-41c8-82a4-f648ed80d727/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:57:31.110002 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b9ae2741-d46a-4e2a-b77a-0048336a3907 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Returning 404 to user: Instance a48e28ae-e228-462b-81eb-95f712dc0800 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:57:31.111113 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b9ae2741-d46a-4e2a-b77a-0048336a3907 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/a48e28ae-e228-462b-81eb-95f712dc0800" status: 404 len: 111 microversion: 2.1 time: 0.077657 Oct 17 13:57:31.113293 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2282/4686] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:31 2022] GET /compute/v2.1/servers/a48e28ae-e228-462b-81eb-95f712dc0800 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:57:31.122593 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e17e744b-3a3e-4ed6-861f-c29a788950fe tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:31.123722 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e17e744b-3a3e-4ed6-861f-c29a788950fe tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 5d10ac72-2710-41c8-82a4-f648ed80d727] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:31.133512 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e17e744b-3a3e-4ed6-861f-c29a788950fe tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:31.134299 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e17e744b-3a3e-4ed6-861f-c29a788950fe tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:31.136637 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e17e744b-3a3e-4ed6-861f-c29a788950fe tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:31.138047 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e17e744b-3a3e-4ed6-861f-c29a788950fe tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:31.138553 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e17e744b-3a3e-4ed6-861f-c29a788950fe tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:31.139221 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e17e744b-3a3e-4ed6-861f-c29a788950fe tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:31.213301 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2dc85e86-02b2-426e-bcae-f1264de6e9d1 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:31.214068 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2dc85e86-02b2-426e-bcae-f1264de6e9d1 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: cdde7779-a327-416c-863c-cd50d4d11c47] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:31.226469 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2dc85e86-02b2-426e-bcae-f1264de6e9d1 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:31.227885 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2dc85e86-02b2-426e-bcae-f1264de6e9d1 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:31.228323 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2dc85e86-02b2-426e-bcae-f1264de6e9d1 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:31.233126 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2dc85e86-02b2-426e-bcae-f1264de6e9d1 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:31.233631 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2dc85e86-02b2-426e-bcae-f1264de6e9d1 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:31.234221 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2dc85e86-02b2-426e-bcae-f1264de6e9d1 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:31.563664 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2dc85e86-02b2-426e-bcae-f1264de6e9d1 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:31.580822 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2dc85e86-02b2-426e-bcae-f1264de6e9d1 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47" status: 200 len: 1271 microversion: 2.1 time: 0.372086 Oct 17 13:57:31.584706 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2283/4687] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:31 2022] GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47 => generated 1271 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:57:31.594518 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-20ccb1ec-f4e4-4eca-80cd-2ae8e5560092 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1981316696", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "57c5839d-0220-4c16-a56e-f44ad4323cc7"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:57:31.680409 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e17e744b-3a3e-4ed6-861f-c29a788950fe tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:31.697109 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e17e744b-3a3e-4ed6-861f-c29a788950fe tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/5d10ac72-2710-41c8-82a4-f648ed80d727" status: 200 len: 1507 microversion: 2.1 time: 0.582023 Oct 17 13:57:31.712342 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2405/4688] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:31 2022] GET /compute/v2.1/servers/5d10ac72-2710-41c8-82a4-f648ed80d727 => generated 1507 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:31.719099 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-20ccb1ec-f4e4-4eca-80cd-2ae8e5560092 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] validate_networks() for [('57c5839d-0220-4c16-a56e-f44ad4323cc7', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:57:31.734068 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e92fb902-53cd-4623-868d-1360813fa590 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:31.735213 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e92fb902-53cd-4623-868d-1360813fa590 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:31.741799 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e92fb902-53cd-4623-868d-1360813fa590 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:31.742547 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e92fb902-53cd-4623-868d-1360813fa590 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:31.743132 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e92fb902-53cd-4623-868d-1360813fa590 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:31.744153 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e92fb902-53cd-4623-868d-1360813fa590 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:31.745604 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e92fb902-53cd-4623-868d-1360813fa590 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:31.746204 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e92fb902-53cd-4623-868d-1360813fa590 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:32.374432 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e92fb902-53cd-4623-868d-1360813fa590 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:32.385194 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e92fb902-53cd-4623-868d-1360813fa590 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4" status: 200 len: 1315 microversion: 2.1 time: 0.680313 Oct 17 13:57:32.386223 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2406/4689] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:31 2022] GET /compute/v2.1/servers/aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4 => generated 1315 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:32.611113 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6ee6771a-83db-4d24-a4b3-364c9572998e tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:32.611941 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6ee6771a-83db-4d24-a4b3-364c9572998e tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: cdde7779-a327-416c-863c-cd50d4d11c47] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:32.636131 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6ee6771a-83db-4d24-a4b3-364c9572998e tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:32.636941 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6ee6771a-83db-4d24-a4b3-364c9572998e tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:32.637643 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6ee6771a-83db-4d24-a4b3-364c9572998e tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:32.638635 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6ee6771a-83db-4d24-a4b3-364c9572998e tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:32.639312 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6ee6771a-83db-4d24-a4b3-364c9572998e tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:32.639867 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6ee6771a-83db-4d24-a4b3-364c9572998e tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:32.717391 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-20ccb1ec-f4e4-4eca-80cd-2ae8e5560092 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:57:32.719430 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-20ccb1ec-f4e4-4eca-80cd-2ae8e5560092 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:57:32.721169 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-20ccb1ec-f4e4-4eca-80cd-2ae8e5560092 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:57:32.736063 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-20ccb1ec-f4e4-4eca-80cd-2ae8e5560092 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:57:32.736063 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-20ccb1ec-f4e4-4eca-80cd-2ae8e5560092 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:57:32.758762 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-20ccb1ec-f4e4-4eca-80cd-2ae8e5560092 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:32.760977 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-20ccb1ec-f4e4-4eca-80cd-2ae8e5560092 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:32.763081 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-20ccb1ec-f4e4-4eca-80cd-2ae8e5560092 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:32.764243 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-20ccb1ec-f4e4-4eca-80cd-2ae8e5560092 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:32.768435 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-20ccb1ec-f4e4-4eca-80cd-2ae8e5560092 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:32.770435 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-20ccb1ec-f4e4-4eca-80cd-2ae8e5560092 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:32.777150 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6ee6771a-83db-4d24-a4b3-364c9572998e tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:32.788980 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6ee6771a-83db-4d24-a4b3-364c9572998e tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47" status: 200 len: 1271 microversion: 2.1 time: 0.182782 Oct 17 13:57:32.793185 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2407/4690] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:32 2022] GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47 => generated 1271 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:57:32.803222 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0fb70fff-a441-4c93-a107-10cba68e22cf tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:32.804523 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0fb70fff-a441-4c93-a107-10cba68e22cf tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 5d10ac72-2710-41c8-82a4-f648ed80d727] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:32.813294 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-20ccb1ec-f4e4-4eca-80cd-2ae8e5560092 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Getting quotas for project 4fa57e8772684c93a406f3d01da2af88. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:57:32.820321 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0fb70fff-a441-4c93-a107-10cba68e22cf tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:32.821024 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0fb70fff-a441-4c93-a107-10cba68e22cf tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:32.821813 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0fb70fff-a441-4c93-a107-10cba68e22cf tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:32.823419 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0fb70fff-a441-4c93-a107-10cba68e22cf tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:32.827833 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0fb70fff-a441-4c93-a107-10cba68e22cf tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:32.828461 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0fb70fff-a441-4c93-a107-10cba68e22cf tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:32.834305 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:57:32.835602 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-20ccb1ec-f4e4-4eca-80cd-2ae8e5560092 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Getting quotas for user d78348abc02a4bb892902b0dd3bcfd6a and project 4fa57e8772684c93a406f3d01da2af88. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:57:32.859077 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-20ccb1ec-f4e4-4eca-80cd-2ae8e5560092 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:57:32.861487 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-20ccb1ec-f4e4-4eca-80cd-2ae8e5560092 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: 6f299338-e34f-459f-9194-37909af20428] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:57:32.953783 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-20ccb1ec-f4e4-4eca-80cd-2ae8e5560092 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.366008 Oct 17 13:57:32.966579 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2284/4691] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:57:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1372 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:57:32.984669 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a03f100d-e36e-42ab-a535-15ecc836a63d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:32.991207 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a03f100d-e36e-42ab-a535-15ecc836a63d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: 6f299338-e34f-459f-9194-37909af20428] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:33.654208 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a03f100d-e36e-42ab-a535-15ecc836a63d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:33.665418 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a03f100d-e36e-42ab-a535-15ecc836a63d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/6f299338-e34f-459f-9194-37909af20428" status: 200 len: 1209 microversion: 2.1 time: 0.695088 Oct 17 13:57:33.666047 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2285/4692] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:32 2022] GET /compute/v2.1/servers/6f299338-e34f-459f-9194-37909af20428 => generated 1209 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:33.677783 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bcf560d5-d023-4af5-b109-cf4743b5b94b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:33.678660 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-bcf560d5-d023-4af5-b109-cf4743b5b94b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:33.690508 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bcf560d5-d023-4af5-b109-cf4743b5b94b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:33.691617 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bcf560d5-d023-4af5-b109-cf4743b5b94b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:33.692267 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bcf560d5-d023-4af5-b109-cf4743b5b94b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:33.693422 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bcf560d5-d023-4af5-b109-cf4743b5b94b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:33.694044 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bcf560d5-d023-4af5-b109-cf4743b5b94b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:33.694628 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bcf560d5-d023-4af5-b109-cf4743b5b94b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:33.990329 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0fb70fff-a441-4c93-a107-10cba68e22cf tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:34.013590 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0fb70fff-a441-4c93-a107-10cba68e22cf tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/5d10ac72-2710-41c8-82a4-f648ed80d727" status: 200 len: 1487 microversion: 2.1 time: 1.218120 Oct 17 13:57:34.020928 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2408/4693] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:32 2022] GET /compute/v2.1/servers/5d10ac72-2710-41c8-82a4-f648ed80d727 => generated 1487 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:34.026317 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-86928ce5-b002-42e1-b717-40e0b8b8c6f6 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:34.027129 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-86928ce5-b002-42e1-b717-40e0b8b8c6f6 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: cdde7779-a327-416c-863c-cd50d4d11c47] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:34.044202 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-86928ce5-b002-42e1-b717-40e0b8b8c6f6 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:34.044401 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-86928ce5-b002-42e1-b717-40e0b8b8c6f6 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:34.044677 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-86928ce5-b002-42e1-b717-40e0b8b8c6f6 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:34.047485 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-86928ce5-b002-42e1-b717-40e0b8b8c6f6 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:34.050164 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-86928ce5-b002-42e1-b717-40e0b8b8c6f6 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:34.051328 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-86928ce5-b002-42e1-b717-40e0b8b8c6f6 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:34.294929 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-bcf560d5-d023-4af5-b109-cf4743b5b94b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:34.303773 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-bcf560d5-d023-4af5-b109-cf4743b5b94b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4" status: 200 len: 1315 microversion: 2.1 time: 0.635607 Oct 17 13:57:34.305901 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2286/4694] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:33 2022] GET /compute/v2.1/servers/aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4 => generated 1315 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:34.313802 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-374eda73-c000-479d-aac5-fdc299822790 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:34.314709 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-374eda73-c000-479d-aac5-fdc299822790 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 5d10ac72-2710-41c8-82a4-f648ed80d727] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:34.325933 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-374eda73-c000-479d-aac5-fdc299822790 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:34.326401 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-374eda73-c000-479d-aac5-fdc299822790 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:34.326835 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-374eda73-c000-479d-aac5-fdc299822790 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:34.328379 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-374eda73-c000-479d-aac5-fdc299822790 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:34.328785 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-374eda73-c000-479d-aac5-fdc299822790 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:34.329204 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-374eda73-c000-479d-aac5-fdc299822790 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:34.360130 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-374eda73-c000-479d-aac5-fdc299822790 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 5d10ac72-2710-41c8-82a4-f648ed80d727] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:57:34.386716 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-86928ce5-b002-42e1-b717-40e0b8b8c6f6 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:34.400455 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-86928ce5-b002-42e1-b717-40e0b8b8c6f6 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47" status: 200 len: 1313 microversion: 2.1 time: 0.377845 Oct 17 13:57:34.401215 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2409/4695] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:34 2022] GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47 => generated 1313 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:34.468030 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-374eda73-c000-479d-aac5-fdc299822790 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "DELETE /compute/v2.1/servers/5d10ac72-2710-41c8-82a4-f648ed80d727" status: 204 len: 0 microversion: 2.1 time: 0.158302 Oct 17 13:57:34.468502 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2287/4696] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:57:34 2022] DELETE /compute/v2.1/servers/5d10ac72-2710-41c8-82a4-f648ed80d727 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:57:34.477057 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a21824eb-d8d5-4db7-a529-52c89c96872f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:34.477994 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a21824eb-d8d5-4db7-a529-52c89c96872f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 5d10ac72-2710-41c8-82a4-f648ed80d727] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:34.484912 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a21824eb-d8d5-4db7-a529-52c89c96872f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:34.485412 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a21824eb-d8d5-4db7-a529-52c89c96872f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:34.486017 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a21824eb-d8d5-4db7-a529-52c89c96872f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:34.486900 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a21824eb-d8d5-4db7-a529-52c89c96872f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:34.487556 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a21824eb-d8d5-4db7-a529-52c89c96872f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:34.488023 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a21824eb-d8d5-4db7-a529-52c89c96872f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:34.543159 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-9393ecdd-20c6-4575-8ebd-9395e95d1351 req-0bdbbd60-11e8-4cc9-b26c-3ff734cd6b5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4", "tag": "55f82612-9d0b-4e45-9fd0-6a5fbb10343f"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:57:34.560424 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-9393ecdd-20c6-4575-8ebd-9395e95d1351 req-0bdbbd60-11e8-4cc9-b26c-3ff734cd6b5e service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:34.561167 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-9393ecdd-20c6-4575-8ebd-9395e95d1351 req-0bdbbd60-11e8-4cc9-b26c-3ff734cd6b5e service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:34.561864 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-9393ecdd-20c6-4575-8ebd-9395e95d1351 req-0bdbbd60-11e8-4cc9-b26c-3ff734cd6b5e service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:34.574870 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-9393ecdd-20c6-4575-8ebd-9395e95d1351 req-0bdbbd60-11e8-4cc9-b26c-3ff734cd6b5e service nova] Creating event network-changed:55f82612-9d0b-4e45-9fd0-6a5fbb10343f for instance aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4 on n-h2-854247-14 Oct 17 13:57:34.580118 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-9393ecdd-20c6-4575-8ebd-9395e95d1351 req-0bdbbd60-11e8-4cc9-b26c-3ff734cd6b5e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041324 Oct 17 13:57:34.581185 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2288/4697] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:57:34.693740 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-cde8eaa1-7c34-43e3-baac-b606555c03e6 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:34.707988 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-cde8eaa1-7c34-43e3-baac-b606555c03e6 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: 6f299338-e34f-459f-9194-37909af20428] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:34.718434 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cde8eaa1-7c34-43e3-baac-b606555c03e6 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:34.719121 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cde8eaa1-7c34-43e3-baac-b606555c03e6 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:34.720079 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cde8eaa1-7c34-43e3-baac-b606555c03e6 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:34.721243 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cde8eaa1-7c34-43e3-baac-b606555c03e6 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:34.721839 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cde8eaa1-7c34-43e3-baac-b606555c03e6 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:34.722623 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cde8eaa1-7c34-43e3-baac-b606555c03e6 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:34.802085 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a21824eb-d8d5-4db7-a529-52c89c96872f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:34.810772 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a21824eb-d8d5-4db7-a529-52c89c96872f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/5d10ac72-2710-41c8-82a4-f648ed80d727" status: 200 len: 1493 microversion: 2.1 time: 0.337806 Oct 17 13:57:34.828022 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2410/4698] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:34 2022] GET /compute/v2.1/servers/5d10ac72-2710-41c8-82a4-f648ed80d727 => generated 1493 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:34.834048 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-cde8eaa1-7c34-43e3-baac-b606555c03e6 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:34.844321 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-cde8eaa1-7c34-43e3-baac-b606555c03e6 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/6f299338-e34f-459f-9194-37909af20428" status: 200 len: 1269 microversion: 2.1 time: 0.157053 Oct 17 13:57:34.860122 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2289/4699] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:34 2022] GET /compute/v2.1/servers/6f299338-e34f-459f-9194-37909af20428 => generated 1269 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:35.330114 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f9317c74-96c5-4da3-bec2-a734116790ba tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:35.330923 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f9317c74-96c5-4da3-bec2-a734116790ba tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:35.366207 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f9317c74-96c5-4da3-bec2-a734116790ba tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:35.371846 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f9317c74-96c5-4da3-bec2-a734116790ba tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:35.373124 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f9317c74-96c5-4da3-bec2-a734116790ba tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:35.375109 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f9317c74-96c5-4da3-bec2-a734116790ba tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:35.378438 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f9317c74-96c5-4da3-bec2-a734116790ba tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:35.381076 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f9317c74-96c5-4da3-bec2-a734116790ba tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:35.425052 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e173ce52-de09-486b-bda5-ba733a27067c tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:35.425861 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e173ce52-de09-486b-bda5-ba733a27067c tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: cdde7779-a327-416c-863c-cd50d4d11c47] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:35.437679 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e173ce52-de09-486b-bda5-ba733a27067c tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:35.438184 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e173ce52-de09-486b-bda5-ba733a27067c tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:35.438616 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e173ce52-de09-486b-bda5-ba733a27067c tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:35.448496 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e173ce52-de09-486b-bda5-ba733a27067c tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:35.450466 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e173ce52-de09-486b-bda5-ba733a27067c tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:35.451103 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e173ce52-de09-486b-bda5-ba733a27067c tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:36.007201 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f9317c74-96c5-4da3-bec2-a734116790ba tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:36.018506 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f9317c74-96c5-4da3-bec2-a734116790ba tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4" status: 200 len: 1315 microversion: 2.1 time: 0.693223 Oct 17 13:57:36.027269 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2411/4700] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:35 2022] GET /compute/v2.1/servers/aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4 => generated 1315 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:36.027269 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-eb3a45e5-4971-4857-9d63-2eaf293037f3 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:36.027269 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-eb3a45e5-4971-4857-9d63-2eaf293037f3 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 5d10ac72-2710-41c8-82a4-f648ed80d727] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:36.035180 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eb3a45e5-4971-4857-9d63-2eaf293037f3 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:36.035740 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eb3a45e5-4971-4857-9d63-2eaf293037f3 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:36.036410 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eb3a45e5-4971-4857-9d63-2eaf293037f3 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:36.037252 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eb3a45e5-4971-4857-9d63-2eaf293037f3 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:36.037755 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eb3a45e5-4971-4857-9d63-2eaf293037f3 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:36.038353 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eb3a45e5-4971-4857-9d63-2eaf293037f3 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:36.142662 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e173ce52-de09-486b-bda5-ba733a27067c tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:36.153907 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e173ce52-de09-486b-bda5-ba733a27067c tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47" status: 200 len: 1313 microversion: 2.1 time: 0.733234 Oct 17 13:57:36.154874 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2290/4701] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:35 2022] GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47 => generated 1313 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:57:36.162326 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1c5b0364-1392-4180-a43c-cf20a534bcda tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:36.163547 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1c5b0364-1392-4180-a43c-cf20a534bcda tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: 6f299338-e34f-459f-9194-37909af20428] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:36.171654 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c5b0364-1392-4180-a43c-cf20a534bcda tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:36.172492 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c5b0364-1392-4180-a43c-cf20a534bcda tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:36.173453 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c5b0364-1392-4180-a43c-cf20a534bcda tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:36.174475 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c5b0364-1392-4180-a43c-cf20a534bcda tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:36.175366 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c5b0364-1392-4180-a43c-cf20a534bcda tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:36.175999 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c5b0364-1392-4180-a43c-cf20a534bcda tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:36.384632 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1c5b0364-1392-4180-a43c-cf20a534bcda tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:36.393530 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1c5b0364-1392-4180-a43c-cf20a534bcda tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/6f299338-e34f-459f-9194-37909af20428" status: 200 len: 1267 microversion: 2.1 time: 0.237220 Oct 17 13:57:36.394205 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2291/4702] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:36 2022] GET /compute/v2.1/servers/6f299338-e34f-459f-9194-37909af20428 => generated 1267 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:36.400284 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-68742665-3004-45dd-8f84-288cb9d2b2cd req-15a59ccf-18f8-4cd6-9b59-4ee81cbde4c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdde7779-a327-416c-863c-cd50d4d11c47", "tag": "0e8cffbc-51aa-45f8-b83f-60caf9b44c13"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:57:36.411618 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-68742665-3004-45dd-8f84-288cb9d2b2cd req-15a59ccf-18f8-4cd6-9b59-4ee81cbde4c3 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:36.412370 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-68742665-3004-45dd-8f84-288cb9d2b2cd req-15a59ccf-18f8-4cd6-9b59-4ee81cbde4c3 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:36.412960 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-68742665-3004-45dd-8f84-288cb9d2b2cd req-15a59ccf-18f8-4cd6-9b59-4ee81cbde4c3 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:36.418240 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:57:36.425655 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-68742665-3004-45dd-8f84-288cb9d2b2cd req-15a59ccf-18f8-4cd6-9b59-4ee81cbde4c3 service nova] Creating event network-changed:0e8cffbc-51aa-45f8-b83f-60caf9b44c13 for instance cdde7779-a327-416c-863c-cd50d4d11c47 on n-h1-854247-14 Oct 17 13:57:36.431564 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-68742665-3004-45dd-8f84-288cb9d2b2cd req-15a59ccf-18f8-4cd6-9b59-4ee81cbde4c3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035933 Oct 17 13:57:36.432809 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2292/4703] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:57:36.651476 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=8 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:57:36.892271 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-eb3a45e5-4971-4857-9d63-2eaf293037f3 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:36.903824 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-eb3a45e5-4971-4857-9d63-2eaf293037f3 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/5d10ac72-2710-41c8-82a4-f648ed80d727" status: 200 len: 1493 microversion: 2.1 time: 0.882225 Oct 17 13:57:36.904642 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2412/4704] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:36 2022] GET /compute/v2.1/servers/5d10ac72-2710-41c8-82a4-f648ed80d727 => generated 1493 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:37.048723 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b0daac91-7a18-4ca0-aa4a-f57cfbb0aa0a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:37.049812 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b0daac91-7a18-4ca0-aa4a-f57cfbb0aa0a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:37.060534 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b0daac91-7a18-4ca0-aa4a-f57cfbb0aa0a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:37.062317 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b0daac91-7a18-4ca0-aa4a-f57cfbb0aa0a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:37.062999 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b0daac91-7a18-4ca0-aa4a-f57cfbb0aa0a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:37.063993 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b0daac91-7a18-4ca0-aa4a-f57cfbb0aa0a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:37.064671 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b0daac91-7a18-4ca0-aa4a-f57cfbb0aa0a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:37.066091 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b0daac91-7a18-4ca0-aa4a-f57cfbb0aa0a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:37.181111 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5f09746f-46c6-4953-8ed5-ffd1d61334b1 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:37.183120 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5f09746f-46c6-4953-8ed5-ffd1d61334b1 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: cdde7779-a327-416c-863c-cd50d4d11c47] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:37.193989 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5f09746f-46c6-4953-8ed5-ffd1d61334b1 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:37.195126 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5f09746f-46c6-4953-8ed5-ffd1d61334b1 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:37.195860 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5f09746f-46c6-4953-8ed5-ffd1d61334b1 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:37.196783 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5f09746f-46c6-4953-8ed5-ffd1d61334b1 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:37.197656 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5f09746f-46c6-4953-8ed5-ffd1d61334b1 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:37.198824 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5f09746f-46c6-4953-8ed5-ffd1d61334b1 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:38.349832 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b0daac91-7a18-4ca0-aa4a-f57cfbb0aa0a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:38.358218 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b0daac91-7a18-4ca0-aa4a-f57cfbb0aa0a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4" status: 200 len: 1315 microversion: 2.1 time: 1.315653 Oct 17 13:57:38.373789 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2293/4705] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:37 2022] GET /compute/v2.1/servers/aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4 => generated 1315 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:38.385329 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b2adb10c-f068-4889-8583-1eaab80c820f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:38.386342 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b2adb10c-f068-4889-8583-1eaab80c820f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: 6f299338-e34f-459f-9194-37909af20428] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:38.409144 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b2adb10c-f068-4889-8583-1eaab80c820f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:38.410175 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b2adb10c-f068-4889-8583-1eaab80c820f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:38.411021 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b2adb10c-f068-4889-8583-1eaab80c820f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:38.411993 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b2adb10c-f068-4889-8583-1eaab80c820f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:38.412652 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b2adb10c-f068-4889-8583-1eaab80c820f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:38.413276 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b2adb10c-f068-4889-8583-1eaab80c820f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:38.561562 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5f09746f-46c6-4953-8ed5-ffd1d61334b1 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:38.577981 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5f09746f-46c6-4953-8ed5-ffd1d61334b1 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47" status: 200 len: 1313 microversion: 2.1 time: 1.402761 Oct 17 13:57:38.578833 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2413/4706] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:37 2022] GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47 => generated 1313 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:57:38.593023 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5dca4b92-62a7-484f-b2c8-a53e63863733 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:38.594204 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5dca4b92-62a7-484f-b2c8-a53e63863733 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 5d10ac72-2710-41c8-82a4-f648ed80d727] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:38.610921 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5dca4b92-62a7-484f-b2c8-a53e63863733 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:38.612179 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5dca4b92-62a7-484f-b2c8-a53e63863733 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:38.612709 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5dca4b92-62a7-484f-b2c8-a53e63863733 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:38.613496 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5dca4b92-62a7-484f-b2c8-a53e63863733 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:38.614036 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5dca4b92-62a7-484f-b2c8-a53e63863733 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:38.614470 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5dca4b92-62a7-484f-b2c8-a53e63863733 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:38.689471 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5dca4b92-62a7-484f-b2c8-a53e63863733 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:38.691222 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5dca4b92-62a7-484f-b2c8-a53e63863733 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:38.692428 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5dca4b92-62a7-484f-b2c8-a53e63863733 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:38.693375 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-5dca4b92-62a7-484f-b2c8-a53e63863733 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lazy-loading 'fault' on Instance uuid 5d10ac72-2710-41c8-82a4-f648ed80d727 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:57:38.882628 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5dca4b92-62a7-484f-b2c8-a53e63863733 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:38.894058 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5dca4b92-62a7-484f-b2c8-a53e63863733 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/5d10ac72-2710-41c8-82a4-f648ed80d727" status: 200 len: 1305 microversion: 2.1 time: 0.312354 Oct 17 13:57:38.894682 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2414/4707] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:38 2022] GET /compute/v2.1/servers/5d10ac72-2710-41c8-82a4-f648ed80d727 => generated 1305 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:38.909922 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-0267797d-fb69-4a2d-8c16-5b8ac2b346ca req-8e5f1e93-c56c-4c9e-8a3f-5cd4f3cd438c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d10ac72-2710-41c8-82a4-f648ed80d727", "name": "network-vif-deleted", "tag": "bd7f9054-4f10-48e3-8792-ac110bee45c6"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:57:38.950016 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-0267797d-fb69-4a2d-8c16-5b8ac2b346ca req-8e5f1e93-c56c-4c9e-8a3f-5cd4f3cd438c service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:38.953037 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-0267797d-fb69-4a2d-8c16-5b8ac2b346ca req-8e5f1e93-c56c-4c9e-8a3f-5cd4f3cd438c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:38.953852 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-0267797d-fb69-4a2d-8c16-5b8ac2b346ca req-8e5f1e93-c56c-4c9e-8a3f-5cd4f3cd438c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:38.987708 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-0267797d-fb69-4a2d-8c16-5b8ac2b346ca req-8e5f1e93-c56c-4c9e-8a3f-5cd4f3cd438c service nova] Creating event network-vif-deleted:bd7f9054-4f10-48e3-8792-ac110bee45c6 for instance 5d10ac72-2710-41c8-82a4-f648ed80d727 on n-h1-854247-14 Oct 17 13:57:38.994530 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-0267797d-fb69-4a2d-8c16-5b8ac2b346ca req-8e5f1e93-c56c-4c9e-8a3f-5cd4f3cd438c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097874 Oct 17 13:57:38.995905 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2415/4708] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:57:39.110296 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b2adb10c-f068-4889-8583-1eaab80c820f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:39.129134 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b2adb10c-f068-4889-8583-1eaab80c820f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/6f299338-e34f-459f-9194-37909af20428" status: 200 len: 1309 microversion: 2.1 time: 0.753754 Oct 17 13:57:39.143228 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2294/4709] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:38 2022] GET /compute/v2.1/servers/6f299338-e34f-459f-9194-37909af20428 => generated 1309 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:39.388004 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-33b38b83-0548-43f3-b8c4-7a036a61f421 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:39.392076 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-33b38b83-0548-43f3-b8c4-7a036a61f421 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:39.413208 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-33b38b83-0548-43f3-b8c4-7a036a61f421 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:39.416509 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-33b38b83-0548-43f3-b8c4-7a036a61f421 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:39.417159 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-33b38b83-0548-43f3-b8c4-7a036a61f421 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:39.420197 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-33b38b83-0548-43f3-b8c4-7a036a61f421 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:39.420905 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-33b38b83-0548-43f3-b8c4-7a036a61f421 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:39.421533 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-33b38b83-0548-43f3-b8c4-7a036a61f421 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:39.604612 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-50080f2e-3c63-491f-a88a-8f6b392c1519 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:39.605092 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-50080f2e-3c63-491f-a88a-8f6b392c1519 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: cdde7779-a327-416c-863c-cd50d4d11c47] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:39.618563 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-50080f2e-3c63-491f-a88a-8f6b392c1519 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:39.619533 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-50080f2e-3c63-491f-a88a-8f6b392c1519 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:39.619975 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-50080f2e-3c63-491f-a88a-8f6b392c1519 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:39.620690 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-50080f2e-3c63-491f-a88a-8f6b392c1519 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:39.621144 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-50080f2e-3c63-491f-a88a-8f6b392c1519 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:39.621564 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-50080f2e-3c63-491f-a88a-8f6b392c1519 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:40.000094 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-33b38b83-0548-43f3-b8c4-7a036a61f421 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:40.014336 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-33b38b83-0548-43f3-b8c4-7a036a61f421 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4" status: 200 len: 1315 microversion: 2.1 time: 0.636341 Oct 17 13:57:40.015198 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2416/4710] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:39 2022] GET /compute/v2.1/servers/aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4 => generated 1315 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:40.020317 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-45bb19be-318b-4f7b-854c-23dbcf560400 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:40.021481 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-45bb19be-318b-4f7b-854c-23dbcf560400 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 5d10ac72-2710-41c8-82a4-f648ed80d727] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:40.028597 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-45bb19be-318b-4f7b-854c-23dbcf560400 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:40.029421 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-45bb19be-318b-4f7b-854c-23dbcf560400 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:40.030082 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-45bb19be-318b-4f7b-854c-23dbcf560400 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:40.031195 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-45bb19be-318b-4f7b-854c-23dbcf560400 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:40.032669 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-45bb19be-318b-4f7b-854c-23dbcf560400 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:40.033481 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-45bb19be-318b-4f7b-854c-23dbcf560400 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:40.050122 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-45bb19be-318b-4f7b-854c-23dbcf560400 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] HTTP exception thrown: Instance 5d10ac72-2710-41c8-82a4-f648ed80d727 could not be found. Oct 17 13:57:40.052395 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-45bb19be-318b-4f7b-854c-23dbcf560400 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Request method failure captured: Oct 17 13:57:40.052395 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/5d10ac72-2710-41c8-82a4-f648ed80d727 HTTP/1.1 Oct 17 13:57:40.052395 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:57:40.052395 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:57:40.052395 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:57:40.052395 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:57:40.052395 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:57:40.052395 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:57:40.052395 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:57:40.052395 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:57:40.052395 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTV7tIaoYPgUdHiXX4NOkSSz-a4-puhL4AhnfvtJYmPyZ3fJvZDePMat9BASboFCn4C3QP9Vix9f7JprJ7jGUAeFojqdhpTvVML9HYK6oQI67GVbo4xYwR8dQKhVTSdcdIj_O_mmBimo8N7A_DyW-iY_pgxFAaVGSJ3vOytCqm8fGt3Q Oct 17 13:57:40.052395 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:57:40.052395 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:57:40.052395 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:57:40.052395 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:57:40.052395 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:57:40.052395 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:57:40.052395 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 0821e5beffdd41c2ad2adbd1d03cde71 Oct 17 13:57:40.052395 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-DeleteServersTestJSON-930683239 Oct 17 13:57:40.052395 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:57:40.052395 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:57:40.052395 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "tempest-type-757843761", "name": "tempest-service-527072566", "endpoints": [{"region": "tempest-region-1530587473", "publicURL": "https://url-594098419.com"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "tempest-type-1549021290", "name": "tempest-service-1797883724", "endpoints": [{"region": "tempest-region-85075699", "internalURL": "https://url-259507820.com"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0821e5beffdd41c2ad2adbd1d03cde71", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "tempest-type-1413520904", "name": "tempest-service-1708200528", "endpoints": []}] Oct 17 13:57:40.052395 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-DeleteServersTestJSON-930683239 Oct 17 13:57:40.052395 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 0821e5beffdd41c2ad2adbd1d03cde71 Oct 17 13:57:40.052395 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-DeleteServersTestJSON-930683239 Oct 17 13:57:40.052395 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-DeleteServersTestJSON-930683239-project Oct 17 13:57:40.052395 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:57:40.052395 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:57:40.052395 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: ab8baeba1d494df5bb9cf4d7289410b9 Oct 17 13:57:40.052395 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-DeleteServersTestJSON-930683239-project Oct 17 13:57:40.052395 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:57:40.052395 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 5d10ac72-2710-41c8-82a4-f648ed80d727 could not be found. Oct 17 13:57:40.052395 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '5d10ac72-2710-41c8-82a4-f648ed80d727'} Oct 17 13:57:40.052395 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:57:40.052395 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:57:40.052395 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:57:40.052395 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:57:40.052395 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:57:40.052395 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:57:40.052395 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:57:40.052395 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:57:40.052395 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:57:40.052395 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:57:40.052395 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d10ac72-2710-41c8-82a4-f648ed80d727 could not be found. Oct 17 13:57:40.052395 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:57:40.052395 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:57:40.052395 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:57:40.052395 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:57:40.052395 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:57:40.052395 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:57:40.052395 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:57:40.052395 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:57:40.052395 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:57:40.052395 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:57:40.052395 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:57:40.052395 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:57:40.052395 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:57:40.052395 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:57:40.052395 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:57:40.057675 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:57:40.057675 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d10ac72-2710-41c8-82a4-f648ed80d727 could not be found. Oct 17 13:57:40.057675 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:57:40.057675 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:57:40.057675 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:57:40.057675 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:57:40.057675 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:57:40.057675 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:57:40.057675 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:57:40.057675 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:57:40.057675 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d10ac72-2710-41c8-82a4-f648ed80d727 could not be found. Oct 17 13:57:40.057675 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:57:40.060471 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-45bb19be-318b-4f7b-854c-23dbcf560400 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Returning 404 to user: Instance 5d10ac72-2710-41c8-82a4-f648ed80d727 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:57:40.062328 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-45bb19be-318b-4f7b-854c-23dbcf560400 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/5d10ac72-2710-41c8-82a4-f648ed80d727" status: 404 len: 111 microversion: 2.1 time: 0.045833 Oct 17 13:57:40.063819 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2417/4711] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:40 2022] GET /compute/v2.1/servers/5d10ac72-2710-41c8-82a4-f648ed80d727 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:57:40.086875 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-50080f2e-3c63-491f-a88a-8f6b392c1519 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:40.109368 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-50080f2e-3c63-491f-a88a-8f6b392c1519 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47" status: 200 len: 1313 microversion: 2.1 time: 0.508864 Oct 17 13:57:40.109969 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2295/4712] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:39 2022] GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47 => generated 1313 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:40.153713 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3ccfd343-ad53-4654-b456-df3c343ae52c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:40.155220 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3ccfd343-ad53-4654-b456-df3c343ae52c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: 6f299338-e34f-459f-9194-37909af20428] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:40.167784 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3ccfd343-ad53-4654-b456-df3c343ae52c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:40.168509 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3ccfd343-ad53-4654-b456-df3c343ae52c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:40.169025 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3ccfd343-ad53-4654-b456-df3c343ae52c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:40.169874 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3ccfd343-ad53-4654-b456-df3c343ae52c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:40.170615 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3ccfd343-ad53-4654-b456-df3c343ae52c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:40.171113 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3ccfd343-ad53-4654-b456-df3c343ae52c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:40.240603 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f06327b7-0566-453f-976a-8f4c4d7f23fe tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1417481233", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "536c8c49-8501-4c2f-bf93-136c7f68a48c"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:57:40.315774 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-f06327b7-0566-453f-976a-8f4c4d7f23fe tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] validate_networks() for [('536c8c49-8501-4c2f-bf93-136c7f68a48c', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:57:40.931926 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3ccfd343-ad53-4654-b456-df3c343ae52c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:40.950576 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3ccfd343-ad53-4654-b456-df3c343ae52c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/6f299338-e34f-459f-9194-37909af20428" status: 200 len: 1309 microversion: 2.1 time: 0.801539 Oct 17 13:57:40.951976 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2418/4713] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:40 2022] GET /compute/v2.1/servers/6f299338-e34f-459f-9194-37909af20428 => generated 1309 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:41.030881 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-403831a1-4b0b-44ef-a1b3-ac606955775b req-c5672754-2013-451c-90bb-8189941bb97f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f299338-e34f-459f-9194-37909af20428", "tag": "b6bcf3d2-8ea1-415a-b1be-565554199c6f"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:57:41.049074 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=94 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:57:41.060443 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-403831a1-4b0b-44ef-a1b3-ac606955775b req-c5672754-2013-451c-90bb-8189941bb97f service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:41.063185 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-403831a1-4b0b-44ef-a1b3-ac606955775b req-c5672754-2013-451c-90bb-8189941bb97f service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:41.064056 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-403831a1-4b0b-44ef-a1b3-ac606955775b req-c5672754-2013-451c-90bb-8189941bb97f service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:41.129541 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-403831a1-4b0b-44ef-a1b3-ac606955775b req-c5672754-2013-451c-90bb-8189941bb97f service nova] Creating event network-changed:b6bcf3d2-8ea1-415a-b1be-565554199c6f for instance 6f299338-e34f-459f-9194-37909af20428 on n-h1-854247-14 Oct 17 13:57:41.146174 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-403831a1-4b0b-44ef-a1b3-ac606955775b req-c5672754-2013-451c-90bb-8189941bb97f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121616 Oct 17 13:57:41.149166 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2419/4714] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:57:41.172384 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f86d574c-0cb3-480a-91eb-94f0ff990ffb tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:41.173774 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f86d574c-0cb3-480a-91eb-94f0ff990ffb tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:41.188395 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f86d574c-0cb3-480a-91eb-94f0ff990ffb tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:41.191719 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f86d574c-0cb3-480a-91eb-94f0ff990ffb tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:41.194513 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f86d574c-0cb3-480a-91eb-94f0ff990ffb tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:41.195415 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f86d574c-0cb3-480a-91eb-94f0ff990ffb tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:41.195957 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f86d574c-0cb3-480a-91eb-94f0ff990ffb tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:41.196389 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f86d574c-0cb3-480a-91eb-94f0ff990ffb tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:41.545947 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f86d574c-0cb3-480a-91eb-94f0ff990ffb tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:41.554276 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f86d574c-0cb3-480a-91eb-94f0ff990ffb tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4" status: 200 len: 1315 microversion: 2.1 time: 0.403597 Oct 17 13:57:41.568358 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2420/4715] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:41 2022] GET /compute/v2.1/servers/aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4 => generated 1315 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:41.578783 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-37df6503-6d0e-425d-9e0f-55445a842c60 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:41.579676 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-37df6503-6d0e-425d-9e0f-55445a842c60 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: cdde7779-a327-416c-863c-cd50d4d11c47] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:41.586409 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-37df6503-6d0e-425d-9e0f-55445a842c60 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:41.587252 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-37df6503-6d0e-425d-9e0f-55445a842c60 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:41.587931 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-37df6503-6d0e-425d-9e0f-55445a842c60 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:41.588858 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-37df6503-6d0e-425d-9e0f-55445a842c60 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:41.589515 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-37df6503-6d0e-425d-9e0f-55445a842c60 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:41.590153 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-37df6503-6d0e-425d-9e0f-55445a842c60 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:41.936456 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-f06327b7-0566-453f-976a-8f4c4d7f23fe tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:57:41.938983 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-f06327b7-0566-453f-976a-8f4c4d7f23fe tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:57:41.938983 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-f06327b7-0566-453f-976a-8f4c4d7f23fe tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:57:41.938983 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-f06327b7-0566-453f-976a-8f4c4d7f23fe tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:57:41.938983 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-f06327b7-0566-453f-976a-8f4c4d7f23fe tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:57:41.955514 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f06327b7-0566-453f-976a-8f4c4d7f23fe tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:41.956017 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f06327b7-0566-453f-976a-8f4c4d7f23fe tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:41.956630 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f06327b7-0566-453f-976a-8f4c4d7f23fe tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:41.957566 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f06327b7-0566-453f-976a-8f4c4d7f23fe tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:41.958035 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f06327b7-0566-453f-976a-8f4c4d7f23fe tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:41.958463 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f06327b7-0566-453f-976a-8f4c4d7f23fe tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:42.005481 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-f06327b7-0566-453f-976a-8f4c4d7f23fe tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Getting quotas for project 0821e5beffdd41c2ad2adbd1d03cde71. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:57:42.011809 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-f06327b7-0566-453f-976a-8f4c4d7f23fe tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Getting quotas for user ab8baeba1d494df5bb9cf4d7289410b9 and project 0821e5beffdd41c2ad2adbd1d03cde71. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:57:42.026144 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f06327b7-0566-453f-976a-8f4c4d7f23fe tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:57:42.028869 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f06327b7-0566-453f-976a-8f4c4d7f23fe tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 6d2bbd26-cb90-4e90-881f-a9346ee3002a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:57:42.083680 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f06327b7-0566-453f-976a-8f4c4d7f23fe tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.851951 Oct 17 13:57:42.085050 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2296/4716] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:57:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1854 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 13:57:42.091008 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-3a45738b-6232-4426-99e2-46225830b556 req-ed06fcda-ec60-47c6-902c-6503503fb2c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4", "name": "network-vif-plugged", "status": "completed", "tag": "55f82612-9d0b-4e45-9fd0-6a5fbb10343f"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:57:42.106669 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-3a45738b-6232-4426-99e2-46225830b556 req-ed06fcda-ec60-47c6-902c-6503503fb2c1 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:42.107401 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-3a45738b-6232-4426-99e2-46225830b556 req-ed06fcda-ec60-47c6-902c-6503503fb2c1 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:42.108053 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-3a45738b-6232-4426-99e2-46225830b556 req-ed06fcda-ec60-47c6-902c-6503503fb2c1 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:42.124004 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-3a45738b-6232-4426-99e2-46225830b556 req-ed06fcda-ec60-47c6-902c-6503503fb2c1 service nova] Creating event network-vif-plugged:55f82612-9d0b-4e45-9fd0-6a5fbb10343f for instance aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4 on n-h2-854247-14 Oct 17 13:57:42.131746 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-3a45738b-6232-4426-99e2-46225830b556 req-ed06fcda-ec60-47c6-902c-6503503fb2c1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045245 Oct 17 13:57:42.132972 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2297/4717] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:57:42.138708 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3f8db7a1-69b1-4d8c-a3b4-954eda68ee01 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:42.139877 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3f8db7a1-69b1-4d8c-a3b4-954eda68ee01 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: 6f299338-e34f-459f-9194-37909af20428] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:42.143065 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-37df6503-6d0e-425d-9e0f-55445a842c60 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:42.148491 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f8db7a1-69b1-4d8c-a3b4-954eda68ee01 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:42.149173 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f8db7a1-69b1-4d8c-a3b4-954eda68ee01 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:42.149848 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f8db7a1-69b1-4d8c-a3b4-954eda68ee01 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:42.150706 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f8db7a1-69b1-4d8c-a3b4-954eda68ee01 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:42.151364 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f8db7a1-69b1-4d8c-a3b4-954eda68ee01 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:42.151492 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-37df6503-6d0e-425d-9e0f-55445a842c60 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47" status: 200 len: 1313 microversion: 2.1 time: 0.581656 Oct 17 13:57:42.152235 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2421/4718] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:41 2022] GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47 => generated 1313 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:42.152529 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f8db7a1-69b1-4d8c-a3b4-954eda68ee01 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:42.208787 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-50a17851-c475-474f-89bf-c63166115ba5 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:42.209543 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-50a17851-c475-474f-89bf-c63166115ba5 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 6d2bbd26-cb90-4e90-881f-a9346ee3002a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:42.693044 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-50a17851-c475-474f-89bf-c63166115ba5 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:42.709506 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-50a17851-c475-474f-89bf-c63166115ba5 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a" status: 200 len: 1215 microversion: 2.1 time: 0.522755 Oct 17 13:57:42.711433 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2422/4719] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:42 2022] GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a => generated 1215 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:42.722922 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f6c04b05-09d8-4ee2-8bb8-5a66d023fddd tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:42.726528 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f6c04b05-09d8-4ee2-8bb8-5a66d023fddd tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:42.744016 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f6c04b05-09d8-4ee2-8bb8-5a66d023fddd tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:42.744557 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f6c04b05-09d8-4ee2-8bb8-5a66d023fddd tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:42.745575 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f6c04b05-09d8-4ee2-8bb8-5a66d023fddd tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:42.746746 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f6c04b05-09d8-4ee2-8bb8-5a66d023fddd tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:42.747871 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f6c04b05-09d8-4ee2-8bb8-5a66d023fddd tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:42.748473 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f6c04b05-09d8-4ee2-8bb8-5a66d023fddd tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:43.066943 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3f8db7a1-69b1-4d8c-a3b4-954eda68ee01 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:43.091805 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f6c04b05-09d8-4ee2-8bb8-5a66d023fddd tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:43.102063 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f6c04b05-09d8-4ee2-8bb8-5a66d023fddd tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4" status: 200 len: 1315 microversion: 2.1 time: 0.388166 Oct 17 13:57:43.107004 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3f8db7a1-69b1-4d8c-a3b4-954eda68ee01 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/6f299338-e34f-459f-9194-37909af20428" status: 200 len: 1309 microversion: 2.1 time: 0.963474 Oct 17 13:57:43.109989 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2298/4720] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:42 2022] GET /compute/v2.1/servers/6f299338-e34f-459f-9194-37909af20428 => generated 1309 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:43.115584 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2423/4721] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:42 2022] GET /compute/v2.1/servers/aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4 => generated 1315 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:43.180691 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9a465983-4f1e-40f1-ae13-b23f76c64ade tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:43.181328 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9a465983-4f1e-40f1-ae13-b23f76c64ade tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: cdde7779-a327-416c-863c-cd50d4d11c47] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:43.193400 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9a465983-4f1e-40f1-ae13-b23f76c64ade tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:43.194114 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9a465983-4f1e-40f1-ae13-b23f76c64ade tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:43.194561 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9a465983-4f1e-40f1-ae13-b23f76c64ade tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:43.195940 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9a465983-4f1e-40f1-ae13-b23f76c64ade tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:43.196651 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9a465983-4f1e-40f1-ae13-b23f76c64ade tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:43.197165 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9a465983-4f1e-40f1-ae13-b23f76c64ade tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:43.646030 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9a465983-4f1e-40f1-ae13-b23f76c64ade tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:43.652719 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:57:43.655810 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9a465983-4f1e-40f1-ae13-b23f76c64ade tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47" status: 200 len: 1313 microversion: 2.1 time: 0.481400 Oct 17 13:57:43.673069 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2299/4722] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:43 2022] GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47 => generated 1313 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:43.735464 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-820286c0-41ef-45cc-90f2-bd0b1da81a14 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:43.736895 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-820286c0-41ef-45cc-90f2-bd0b1da81a14 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 6d2bbd26-cb90-4e90-881f-a9346ee3002a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:43.748075 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-820286c0-41ef-45cc-90f2-bd0b1da81a14 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:43.749560 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-820286c0-41ef-45cc-90f2-bd0b1da81a14 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:43.752487 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-820286c0-41ef-45cc-90f2-bd0b1da81a14 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:43.753619 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-820286c0-41ef-45cc-90f2-bd0b1da81a14 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:43.756249 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-820286c0-41ef-45cc-90f2-bd0b1da81a14 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:43.756935 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-820286c0-41ef-45cc-90f2-bd0b1da81a14 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:43.963927 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-820286c0-41ef-45cc-90f2-bd0b1da81a14 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:43.984854 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-820286c0-41ef-45cc-90f2-bd0b1da81a14 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a" status: 200 len: 1211 microversion: 2.1 time: 0.253503 Oct 17 13:57:43.987471 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2424/4723] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:43 2022] GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a => generated 1211 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:44.133214 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-df46715e-d261-41e5-853c-ef9f16adcc41 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:44.133855 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-df46715e-d261-41e5-853c-ef9f16adcc41 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: 6f299338-e34f-459f-9194-37909af20428] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:44.134384 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d2d1eb04-0a6a-4aed-a35d-7024d447cb00 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:44.135089 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d2d1eb04-0a6a-4aed-a35d-7024d447cb00 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:44.146728 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d2d1eb04-0a6a-4aed-a35d-7024d447cb00 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:44.147763 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df46715e-d261-41e5-853c-ef9f16adcc41 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:44.148297 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df46715e-d261-41e5-853c-ef9f16adcc41 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:44.148752 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df46715e-d261-41e5-853c-ef9f16adcc41 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:44.149652 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d2d1eb04-0a6a-4aed-a35d-7024d447cb00 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:44.151030 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d2d1eb04-0a6a-4aed-a35d-7024d447cb00 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:44.151238 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df46715e-d261-41e5-853c-ef9f16adcc41 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:44.151621 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df46715e-d261-41e5-853c-ef9f16adcc41 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:44.152063 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df46715e-d261-41e5-853c-ef9f16adcc41 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:44.154146 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d2d1eb04-0a6a-4aed-a35d-7024d447cb00 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:44.155051 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d2d1eb04-0a6a-4aed-a35d-7024d447cb00 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:44.158055 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d2d1eb04-0a6a-4aed-a35d-7024d447cb00 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:44.696451 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d2d1eb04-0a6a-4aed-a35d-7024d447cb00 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:44.716146 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d2d1eb04-0a6a-4aed-a35d-7024d447cb00 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4" status: 200 len: 1315 microversion: 2.1 time: 0.593271 Oct 17 13:57:44.716923 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2300/4724] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:44 2022] GET /compute/v2.1/servers/aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4 => generated 1315 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:44.724813 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-77053a74-5646-456c-9fa4-bafe71066088 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:44.725690 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-77053a74-5646-456c-9fa4-bafe71066088 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: cdde7779-a327-416c-863c-cd50d4d11c47] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:44.733641 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-77053a74-5646-456c-9fa4-bafe71066088 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:44.734663 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-77053a74-5646-456c-9fa4-bafe71066088 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:44.735426 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-77053a74-5646-456c-9fa4-bafe71066088 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:44.736538 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-77053a74-5646-456c-9fa4-bafe71066088 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:44.737055 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-77053a74-5646-456c-9fa4-bafe71066088 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:44.737528 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-77053a74-5646-456c-9fa4-bafe71066088 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:45.201512 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-df46715e-d261-41e5-853c-ef9f16adcc41 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:45.216393 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-df46715e-d261-41e5-853c-ef9f16adcc41 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/6f299338-e34f-459f-9194-37909af20428" status: 200 len: 1309 microversion: 2.1 time: 1.089100 Oct 17 13:57:45.217625 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2425/4725] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:44 2022] GET /compute/v2.1/servers/6f299338-e34f-459f-9194-37909af20428 => generated 1309 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:45.227007 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-6e3bdb4f-3f53-43b7-804d-6969e0061865 req-99a3e95a-376f-40d2-af22-fa2bdce28b58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdde7779-a327-416c-863c-cd50d4d11c47", "name": "network-vif-plugged", "status": "completed", "tag": "0e8cffbc-51aa-45f8-b83f-60caf9b44c13"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:57:45.249571 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-6e3bdb4f-3f53-43b7-804d-6969e0061865 req-99a3e95a-376f-40d2-af22-fa2bdce28b58 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:45.250537 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-6e3bdb4f-3f53-43b7-804d-6969e0061865 req-99a3e95a-376f-40d2-af22-fa2bdce28b58 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:45.250924 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-6e3bdb4f-3f53-43b7-804d-6969e0061865 req-99a3e95a-376f-40d2-af22-fa2bdce28b58 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:45.264268 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-6e3bdb4f-3f53-43b7-804d-6969e0061865 req-99a3e95a-376f-40d2-af22-fa2bdce28b58 service nova] Creating event network-vif-plugged:0e8cffbc-51aa-45f8-b83f-60caf9b44c13 for instance cdde7779-a327-416c-863c-cd50d4d11c47 on n-h1-854247-14 Oct 17 13:57:45.275667 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-6e3bdb4f-3f53-43b7-804d-6969e0061865 req-99a3e95a-376f-40d2-af22-fa2bdce28b58 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056329 Oct 17 13:57:45.279910 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2426/4726] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:57:45.285948 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-392125b4-1787-4336-9bb8-1f88225c96cf tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:45.287280 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-392125b4-1787-4336-9bb8-1f88225c96cf tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 6d2bbd26-cb90-4e90-881f-a9346ee3002a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:45.296345 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-392125b4-1787-4336-9bb8-1f88225c96cf tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:45.297333 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-392125b4-1787-4336-9bb8-1f88225c96cf tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:45.297992 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-392125b4-1787-4336-9bb8-1f88225c96cf tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:45.299058 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-392125b4-1787-4336-9bb8-1f88225c96cf tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:45.300071 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-392125b4-1787-4336-9bb8-1f88225c96cf tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:45.300726 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-392125b4-1787-4336-9bb8-1f88225c96cf tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:45.559848 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-392125b4-1787-4336-9bb8-1f88225c96cf tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:45.572939 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-392125b4-1787-4336-9bb8-1f88225c96cf tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a" status: 200 len: 1273 microversion: 2.1 time: 0.290925 Oct 17 13:57:45.595276 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2427/4727] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:45 2022] GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a => generated 1273 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:45.609485 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-77053a74-5646-456c-9fa4-bafe71066088 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:45.619491 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-77053a74-5646-456c-9fa4-bafe71066088 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47" status: 200 len: 1313 microversion: 2.1 time: 0.900641 Oct 17 13:57:45.628028 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2301/4728] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:44 2022] GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47 => generated 1313 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:45.741741 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d68c3e21-398b-47d0-bb88-1b986af5ecf4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:45.742645 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d68c3e21-398b-47d0-bb88-1b986af5ecf4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:45.750710 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d68c3e21-398b-47d0-bb88-1b986af5ecf4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:45.751849 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d68c3e21-398b-47d0-bb88-1b986af5ecf4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:45.752578 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d68c3e21-398b-47d0-bb88-1b986af5ecf4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:45.753578 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d68c3e21-398b-47d0-bb88-1b986af5ecf4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:45.754473 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d68c3e21-398b-47d0-bb88-1b986af5ecf4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:45.755510 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d68c3e21-398b-47d0-bb88-1b986af5ecf4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:45.761420 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=100 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:57:46.071666 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d68c3e21-398b-47d0-bb88-1b986af5ecf4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:46.080133 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d68c3e21-398b-47d0-bb88-1b986af5ecf4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4" status: 200 len: 1501 microversion: 2.1 time: 0.343841 Oct 17 13:57:46.080725 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2428/4729] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:45 2022] GET /compute/v2.1/servers/aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4 => generated 1501 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:46.110077 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7db89a5c-1ffd-4429-b298-d46242e51d48 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:57:46.110607 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7db89a5c-1ffd-4429-b298-d46242e51d48 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:46.119585 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7db89a5c-1ffd-4429-b298-d46242e51d48 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:46.120079 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7db89a5c-1ffd-4429-b298-d46242e51d48 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:46.120526 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7db89a5c-1ffd-4429-b298-d46242e51d48 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:46.121226 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7db89a5c-1ffd-4429-b298-d46242e51d48 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:46.125946 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7db89a5c-1ffd-4429-b298-d46242e51d48 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:46.133830 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7db89a5c-1ffd-4429-b298-d46242e51d48 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:46.249270 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e2cecb61-8e53-4770-a589-0062030043e9 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:46.249898 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e2cecb61-8e53-4770-a589-0062030043e9 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: 6f299338-e34f-459f-9194-37909af20428] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:46.258664 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e2cecb61-8e53-4770-a589-0062030043e9 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:46.259194 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e2cecb61-8e53-4770-a589-0062030043e9 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:46.259628 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e2cecb61-8e53-4770-a589-0062030043e9 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:46.260344 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e2cecb61-8e53-4770-a589-0062030043e9 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:46.260804 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e2cecb61-8e53-4770-a589-0062030043e9 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:46.261232 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e2cecb61-8e53-4770-a589-0062030043e9 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:47.043990 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.network.security_group_api [None req-7db89a5c-1ffd-4429-b298-d46242e51d48 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Removing security group 848a240e-bd30-46b9-b2ba-ed1d5aada37e from port 55f82612-9d0b-4e45-9fd0-6a5fbb10343f Oct 17 13:57:47.315828 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e2cecb61-8e53-4770-a589-0062030043e9 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:47.328358 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e2cecb61-8e53-4770-a589-0062030043e9 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/6f299338-e34f-459f-9194-37909af20428" status: 200 len: 1309 microversion: 2.1 time: 1.083844 Oct 17 13:57:47.328963 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2429/4730] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:46 2022] GET /compute/v2.1/servers/6f299338-e34f-459f-9194-37909af20428 => generated 1309 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:47.357995 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2591da96-6d3e-463c-9d12-6c778172ec7d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:47.358607 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2591da96-6d3e-463c-9d12-6c778172ec7d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 6d2bbd26-cb90-4e90-881f-a9346ee3002a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:47.389191 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2591da96-6d3e-463c-9d12-6c778172ec7d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:47.389712 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2591da96-6d3e-463c-9d12-6c778172ec7d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:47.390154 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2591da96-6d3e-463c-9d12-6c778172ec7d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:47.390876 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2591da96-6d3e-463c-9d12-6c778172ec7d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:47.391389 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2591da96-6d3e-463c-9d12-6c778172ec7d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:47.392021 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2591da96-6d3e-463c-9d12-6c778172ec7d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:47.863075 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2591da96-6d3e-463c-9d12-6c778172ec7d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:47.930701 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2591da96-6d3e-463c-9d12-6c778172ec7d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a" status: 200 len: 1315 microversion: 2.1 time: 0.582326 Oct 17 13:57:47.936620 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2430/4731] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:47 2022] GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a => generated 1315 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:47.966000 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c50b0e4d-f335-4fdd-ae2a-bc544eebf2bb tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:47.969193 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c50b0e4d-f335-4fdd-ae2a-bc544eebf2bb tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: cdde7779-a327-416c-863c-cd50d4d11c47] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:47.999506 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c50b0e4d-f335-4fdd-ae2a-bc544eebf2bb tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:48.000851 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c50b0e4d-f335-4fdd-ae2a-bc544eebf2bb tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:48.001850 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c50b0e4d-f335-4fdd-ae2a-bc544eebf2bb tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:48.007427 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c50b0e4d-f335-4fdd-ae2a-bc544eebf2bb tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:48.009819 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c50b0e4d-f335-4fdd-ae2a-bc544eebf2bb tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:48.011149 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c50b0e4d-f335-4fdd-ae2a-bc544eebf2bb tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:48.220752 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7db89a5c-1ffd-4429-b298-d46242e51d48 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "POST /compute/v2.1/servers/aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4/action" status: 202 len: 0 microversion: 2.1 time: 2.117519 Oct 17 13:57:48.221363 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2302/4732] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:57:46 2022] POST /compute/v2.1/servers/aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4/action => generated 0 bytes in 2119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:57:48.226844 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-4ee61ea1-2cfb-42f4-987b-418021048145 req-8636dc73-1337-4aea-9909-4e502c84d1f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f299338-e34f-459f-9194-37909af20428", "name": "network-vif-plugged", "status": "completed", "tag": "b6bcf3d2-8ea1-415a-b1be-565554199c6f"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:57:48.238872 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-4ee61ea1-2cfb-42f4-987b-418021048145 req-8636dc73-1337-4aea-9909-4e502c84d1f5 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:48.239584 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-4ee61ea1-2cfb-42f4-987b-418021048145 req-8636dc73-1337-4aea-9909-4e502c84d1f5 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:48.240188 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-4ee61ea1-2cfb-42f4-987b-418021048145 req-8636dc73-1337-4aea-9909-4e502c84d1f5 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:48.255356 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-4ee61ea1-2cfb-42f4-987b-418021048145 req-8636dc73-1337-4aea-9909-4e502c84d1f5 service nova] Creating event network-vif-plugged:b6bcf3d2-8ea1-415a-b1be-565554199c6f for instance 6f299338-e34f-459f-9194-37909af20428 on n-h1-854247-14 Oct 17 13:57:48.261578 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-4ee61ea1-2cfb-42f4-987b-418021048145 req-8636dc73-1337-4aea-9909-4e502c84d1f5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038671 Oct 17 13:57:48.262476 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2303/4733] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:57:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:57:48.269001 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-28682908-8a94-4431-9e0a-be990edb4f4f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:48.269972 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-28682908-8a94-4431-9e0a-be990edb4f4f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:48.277249 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-28682908-8a94-4431-9e0a-be990edb4f4f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:48.278143 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-28682908-8a94-4431-9e0a-be990edb4f4f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:48.278882 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-28682908-8a94-4431-9e0a-be990edb4f4f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:48.279910 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-28682908-8a94-4431-9e0a-be990edb4f4f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:48.280664 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-28682908-8a94-4431-9e0a-be990edb4f4f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:48.281892 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-28682908-8a94-4431-9e0a-be990edb4f4f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:48.835985 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-28682908-8a94-4431-9e0a-be990edb4f4f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:48.848234 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-28682908-8a94-4431-9e0a-be990edb4f4f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4" status: 200 len: 1459 microversion: 2.1 time: 0.580973 Oct 17 13:57:48.851209 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2304/4734] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:48 2022] GET /compute/v2.1/servers/aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4 => generated 1459 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:48.869177 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c50b0e4d-f335-4fdd-ae2a-bc544eebf2bb tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:48.873947 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-8c542230-5182-4b9c-8550-522012b92e8c req-7334b6fd-ec25-4bb0-8ebb-4ca352a47f6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4", "tag": "55f82612-9d0b-4e45-9fd0-6a5fbb10343f"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:57:48.884076 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c50b0e4d-f335-4fdd-ae2a-bc544eebf2bb tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47" status: 200 len: 1498 microversion: 2.1 time: 0.941589 Oct 17 13:57:48.884668 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2431/4735] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:47 2022] GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47 => generated 1498 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:48.889261 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e07c5810-9bfc-47b8-be4d-27a7a72f01ca tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:48.898470 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-8c542230-5182-4b9c-8550-522012b92e8c req-7334b6fd-ec25-4bb0-8ebb-4ca352a47f6a service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:48.899607 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e07c5810-9bfc-47b8-be4d-27a7a72f01ca tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: 6f299338-e34f-459f-9194-37909af20428] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:48.900066 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-8c542230-5182-4b9c-8550-522012b92e8c req-7334b6fd-ec25-4bb0-8ebb-4ca352a47f6a service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:48.900691 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-8c542230-5182-4b9c-8550-522012b92e8c req-7334b6fd-ec25-4bb0-8ebb-4ca352a47f6a service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:48.906711 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e07c5810-9bfc-47b8-be4d-27a7a72f01ca tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:48.907366 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e07c5810-9bfc-47b8-be4d-27a7a72f01ca tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:48.908058 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e07c5810-9bfc-47b8-be4d-27a7a72f01ca tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:48.908986 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e07c5810-9bfc-47b8-be4d-27a7a72f01ca tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:48.909820 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e07c5810-9bfc-47b8-be4d-27a7a72f01ca tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:48.914513 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e07c5810-9bfc-47b8-be4d-27a7a72f01ca tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:48.920500 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-8c542230-5182-4b9c-8550-522012b92e8c req-7334b6fd-ec25-4bb0-8ebb-4ca352a47f6a service nova] Creating event network-changed:55f82612-9d0b-4e45-9fd0-6a5fbb10343f for instance aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4 on n-h2-854247-14 Oct 17 13:57:48.932862 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-8c542230-5182-4b9c-8550-522012b92e8c req-7334b6fd-ec25-4bb0-8ebb-4ca352a47f6a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069546 Oct 17 13:57:48.934254 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2305/4736] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:57:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:57:48.940752 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7d6ec720-48da-4daa-97c2-c7ea4070a9e9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:48.942032 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7d6ec720-48da-4daa-97c2-c7ea4070a9e9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:48.989464 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7d6ec720-48da-4daa-97c2-c7ea4070a9e9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:48.991502 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7d6ec720-48da-4daa-97c2-c7ea4070a9e9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:48.993283 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7d6ec720-48da-4daa-97c2-c7ea4070a9e9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:48.996222 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7d6ec720-48da-4daa-97c2-c7ea4070a9e9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:48.998932 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7d6ec720-48da-4daa-97c2-c7ea4070a9e9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:49.003838 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7d6ec720-48da-4daa-97c2-c7ea4070a9e9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:49.490757 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e07c5810-9bfc-47b8-be4d-27a7a72f01ca tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:49.507086 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e07c5810-9bfc-47b8-be4d-27a7a72f01ca tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/6f299338-e34f-459f-9194-37909af20428" status: 200 len: 1309 microversion: 2.1 time: 0.620867 Oct 17 13:57:49.509399 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2432/4737] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:48 2022] GET /compute/v2.1/servers/6f299338-e34f-459f-9194-37909af20428 => generated 1309 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:49.518755 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-430fa87f-dcc3-41c3-af2a-a34796d9a0ca tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:57:49.535671 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7d6ec720-48da-4daa-97c2-c7ea4070a9e9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:49.536957 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-430fa87f-dcc3-41c3-af2a-a34796d9a0ca tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: cdde7779-a327-416c-863c-cd50d4d11c47] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:49.545752 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-430fa87f-dcc3-41c3-af2a-a34796d9a0ca tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:49.546799 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7d6ec720-48da-4daa-97c2-c7ea4070a9e9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1666 microversion: 2.1 time: 0.611153 Oct 17 13:57:49.547203 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-430fa87f-dcc3-41c3-af2a-a34796d9a0ca tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:49.549819 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2306/4738] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:48 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1666 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:49.558321 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-430fa87f-dcc3-41c3-af2a-a34796d9a0ca tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:49.562518 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d3ab5f28-0872-4653-8df5-a2fc0a662ee6 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:49.563364 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d3ab5f28-0872-4653-8df5-a2fc0a662ee6 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 6d2bbd26-cb90-4e90-881f-a9346ee3002a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:49.568858 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-430fa87f-dcc3-41c3-af2a-a34796d9a0ca tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:49.571274 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-430fa87f-dcc3-41c3-af2a-a34796d9a0ca tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:49.571958 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-430fa87f-dcc3-41c3-af2a-a34796d9a0ca tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:49.576735 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:57:49.588735 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d3ab5f28-0872-4653-8df5-a2fc0a662ee6 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:49.589236 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d3ab5f28-0872-4653-8df5-a2fc0a662ee6 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:49.589671 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d3ab5f28-0872-4653-8df5-a2fc0a662ee6 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:49.590385 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d3ab5f28-0872-4653-8df5-a2fc0a662ee6 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:49.590826 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d3ab5f28-0872-4653-8df5-a2fc0a662ee6 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:49.591467 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d3ab5f28-0872-4653-8df5-a2fc0a662ee6 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:49.622415 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-430fa87f-dcc3-41c3-af2a-a34796d9a0ca tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lazy-loading 'flavor' on Instance uuid cdde7779-a327-416c-863c-cd50d4d11c47 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:57:49.796680 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-430fa87f-dcc3-41c3-af2a-a34796d9a0ca tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "POST /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47/action" status: 200 len: 32 microversion: 2.1 time: 0.273273 Oct 17 13:57:49.802434 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2433/4739] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:57:49 2022] POST /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47/action => generated 32 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:57:49.817554 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-734be198-6a78-44ca-8f6d-b5f3e0d34040 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:49.821817 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-734be198-6a78-44ca-8f6d-b5f3e0d34040 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:49.850044 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-734be198-6a78-44ca-8f6d-b5f3e0d34040 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:49.850843 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-734be198-6a78-44ca-8f6d-b5f3e0d34040 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:49.851589 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-734be198-6a78-44ca-8f6d-b5f3e0d34040 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:49.853288 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-734be198-6a78-44ca-8f6d-b5f3e0d34040 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:49.853748 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-734be198-6a78-44ca-8f6d-b5f3e0d34040 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:49.854178 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-734be198-6a78-44ca-8f6d-b5f3e0d34040 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:49.961187 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d3ab5f28-0872-4653-8df5-a2fc0a662ee6 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:49.975339 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d3ab5f28-0872-4653-8df5-a2fc0a662ee6 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a" status: 200 len: 1315 microversion: 2.1 time: 0.419162 Oct 17 13:57:49.978218 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2307/4740] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:49 2022] GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a => generated 1315 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:49.997207 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-66365e8a-255a-48ff-af52-c9cd513f3ccb tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:49.998929 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-66365e8a-255a-48ff-af52-c9cd513f3ccb tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: cdde7779-a327-416c-863c-cd50d4d11c47] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:50.026551 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-66365e8a-255a-48ff-af52-c9cd513f3ccb tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:50.041184 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-66365e8a-255a-48ff-af52-c9cd513f3ccb tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:50.042294 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-66365e8a-255a-48ff-af52-c9cd513f3ccb tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:50.043348 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-66365e8a-255a-48ff-af52-c9cd513f3ccb tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:50.044644 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-66365e8a-255a-48ff-af52-c9cd513f3ccb tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:50.045488 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-66365e8a-255a-48ff-af52-c9cd513f3ccb tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:50.479758 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-734be198-6a78-44ca-8f6d-b5f3e0d34040 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:50.511846 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-734be198-6a78-44ca-8f6d-b5f3e0d34040 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1666 microversion: 2.1 time: 0.712897 Oct 17 13:57:50.513499 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2434/4741] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:49 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1666 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:50.564356 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-977ff240-c622-4578-92b4-0950b492b211 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:50.565769 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-977ff240-c622-4578-92b4-0950b492b211 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: 6f299338-e34f-459f-9194-37909af20428] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:50.585599 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-977ff240-c622-4578-92b4-0950b492b211 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:50.586967 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-977ff240-c622-4578-92b4-0950b492b211 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:50.587825 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-977ff240-c622-4578-92b4-0950b492b211 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:50.589066 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-977ff240-c622-4578-92b4-0950b492b211 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:50.591143 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-977ff240-c622-4578-92b4-0950b492b211 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:50.592193 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-977ff240-c622-4578-92b4-0950b492b211 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:50.633738 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-66365e8a-255a-48ff-af52-c9cd513f3ccb tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:50.642951 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-66365e8a-255a-48ff-af52-c9cd513f3ccb tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47" status: 200 len: 1504 microversion: 2.1 time: 0.659704 Oct 17 13:57:50.656051 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2308/4742] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:49 2022] GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47 => generated 1504 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:50.676843 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-fdfb48f6-2ead-4f0f-92d8-90763ee31e2d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:50.677988 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-fdfb48f6-2ead-4f0f-92d8-90763ee31e2d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:50.689073 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fdfb48f6-2ead-4f0f-92d8-90763ee31e2d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:50.689832 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fdfb48f6-2ead-4f0f-92d8-90763ee31e2d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:50.690583 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fdfb48f6-2ead-4f0f-92d8-90763ee31e2d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:50.699099 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fdfb48f6-2ead-4f0f-92d8-90763ee31e2d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:50.699622 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fdfb48f6-2ead-4f0f-92d8-90763ee31e2d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:50.700063 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fdfb48f6-2ead-4f0f-92d8-90763ee31e2d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:51.203333 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-977ff240-c622-4578-92b4-0950b492b211 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:51.205373 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-fdfb48f6-2ead-4f0f-92d8-90763ee31e2d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:51.217094 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-977ff240-c622-4578-92b4-0950b492b211 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/6f299338-e34f-459f-9194-37909af20428" status: 200 len: 1491 microversion: 2.1 time: 0.671563 Oct 17 13:57:51.218422 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2435/4743] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:50 2022] GET /compute/v2.1/servers/6f299338-e34f-459f-9194-37909af20428 => generated 1491 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:51.222277 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-fdfb48f6-2ead-4f0f-92d8-90763ee31e2d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1666 microversion: 2.1 time: 0.563831 Oct 17 13:57:51.239798 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2309/4744] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:50 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1666 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:51.249395 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6d06b7ca-9a47-4ac3-931a-b122bfd8780d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:51.250038 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-773fd02b-3775-4ee7-a0dc-4a924edb81da req-5c3babbc-db9e-4a1c-a32a-01ae26616db5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d2bbd26-cb90-4e90-881f-a9346ee3002a", "tag": "7709c35f-ab2e-4e7f-8507-786eb35a55e3"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:57:51.252022 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6d06b7ca-9a47-4ac3-931a-b122bfd8780d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 6d2bbd26-cb90-4e90-881f-a9346ee3002a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:51.265154 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6d06b7ca-9a47-4ac3-931a-b122bfd8780d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:51.266157 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6d06b7ca-9a47-4ac3-931a-b122bfd8780d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:51.266604 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6d06b7ca-9a47-4ac3-931a-b122bfd8780d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:51.267473 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6d06b7ca-9a47-4ac3-931a-b122bfd8780d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:51.267931 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6d06b7ca-9a47-4ac3-931a-b122bfd8780d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:51.268360 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6d06b7ca-9a47-4ac3-931a-b122bfd8780d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:51.290322 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-773fd02b-3775-4ee7-a0dc-4a924edb81da req-5c3babbc-db9e-4a1c-a32a-01ae26616db5 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:51.290976 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-773fd02b-3775-4ee7-a0dc-4a924edb81da req-5c3babbc-db9e-4a1c-a32a-01ae26616db5 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:51.291526 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-773fd02b-3775-4ee7-a0dc-4a924edb81da req-5c3babbc-db9e-4a1c-a32a-01ae26616db5 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:51.321096 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-773fd02b-3775-4ee7-a0dc-4a924edb81da req-5c3babbc-db9e-4a1c-a32a-01ae26616db5 service nova] Creating event network-changed:7709c35f-ab2e-4e7f-8507-786eb35a55e3 for instance 6d2bbd26-cb90-4e90-881f-a9346ee3002a on n-h2-854247-14 Oct 17 13:57:51.331533 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-773fd02b-3775-4ee7-a0dc-4a924edb81da req-5c3babbc-db9e-4a1c-a32a-01ae26616db5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105313 Oct 17 13:57:51.338983 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2310/4745] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:57:51.346795 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3d48cc2a-7f09-4be8-85fb-8cf6cb3691f6 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:57:51.352992 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3d48cc2a-7f09-4be8-85fb-8cf6cb3691f6 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: 6f299338-e34f-459f-9194-37909af20428] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:51.369253 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3d48cc2a-7f09-4be8-85fb-8cf6cb3691f6 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:51.369910 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3d48cc2a-7f09-4be8-85fb-8cf6cb3691f6 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:51.370430 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3d48cc2a-7f09-4be8-85fb-8cf6cb3691f6 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:51.372705 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3d48cc2a-7f09-4be8-85fb-8cf6cb3691f6 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:51.373981 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3d48cc2a-7f09-4be8-85fb-8cf6cb3691f6 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:51.374627 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3d48cc2a-7f09-4be8-85fb-8cf6cb3691f6 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:51.484158 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3d48cc2a-7f09-4be8-85fb-8cf6cb3691f6 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "PUT /compute/v2.1/servers/6f299338-e34f-459f-9194-37909af20428" status: 200 len: 1086 microversion: 2.1 time: 0.142911 Oct 17 13:57:51.485210 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2311/4746] 10.222.0.79 () {60 vars in 1256 bytes} [Mon Oct 17 13:57:51 2022] PUT /compute/v2.1/servers/6f299338-e34f-459f-9194-37909af20428 => generated 1086 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:51.491381 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-26654a64-4136-4027-bfc9-a9b51785154a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:51.492438 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-26654a64-4136-4027-bfc9-a9b51785154a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:51.499421 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-26654a64-4136-4027-bfc9-a9b51785154a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:51.500031 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-26654a64-4136-4027-bfc9-a9b51785154a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:51.500703 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-26654a64-4136-4027-bfc9-a9b51785154a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:51.501591 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-26654a64-4136-4027-bfc9-a9b51785154a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:51.502205 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-26654a64-4136-4027-bfc9-a9b51785154a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:51.502670 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-26654a64-4136-4027-bfc9-a9b51785154a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:51.643327 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6d06b7ca-9a47-4ac3-931a-b122bfd8780d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:51.652417 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6d06b7ca-9a47-4ac3-931a-b122bfd8780d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a" status: 200 len: 1315 microversion: 2.1 time: 0.432723 Oct 17 13:57:51.656656 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2436/4747] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:51 2022] GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a => generated 1315 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:51.665944 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-02d8b693-c929-4a85-8280-29bd4874793d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:51.666868 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-02d8b693-c929-4a85-8280-29bd4874793d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: 6f299338-e34f-459f-9194-37909af20428] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:51.674101 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-02d8b693-c929-4a85-8280-29bd4874793d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:51.674926 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-02d8b693-c929-4a85-8280-29bd4874793d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:51.675559 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-02d8b693-c929-4a85-8280-29bd4874793d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:51.676473 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-02d8b693-c929-4a85-8280-29bd4874793d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:51.677101 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-02d8b693-c929-4a85-8280-29bd4874793d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:51.677707 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-02d8b693-c929-4a85-8280-29bd4874793d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:51.849880 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-26654a64-4136-4027-bfc9-a9b51785154a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:51.859440 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-26654a64-4136-4027-bfc9-a9b51785154a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1666 microversion: 2.1 time: 0.372402 Oct 17 13:57:51.860217 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2312/4748] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:51 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1666 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:51.865616 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d6aac73c-856f-47d0-9c4a-367832619dff tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:51.866223 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d6aac73c-856f-47d0-9c4a-367832619dff tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: cdde7779-a327-416c-863c-cd50d4d11c47] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:51.880324 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-02d8b693-c929-4a85-8280-29bd4874793d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:51.882643 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d6aac73c-856f-47d0-9c4a-367832619dff tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:51.883479 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d6aac73c-856f-47d0-9c4a-367832619dff tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:51.884816 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d6aac73c-856f-47d0-9c4a-367832619dff tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:51.885889 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d6aac73c-856f-47d0-9c4a-367832619dff tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:51.886505 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d6aac73c-856f-47d0-9c4a-367832619dff tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:51.887084 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d6aac73c-856f-47d0-9c4a-367832619dff tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:51.903804 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-02d8b693-c929-4a85-8280-29bd4874793d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/6f299338-e34f-459f-9194-37909af20428" status: 200 len: 1512 microversion: 2.1 time: 0.245668 Oct 17 13:57:51.905179 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2437/4749] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:51 2022] GET /compute/v2.1/servers/6f299338-e34f-459f-9194-37909af20428 => generated 1512 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:51.932244 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a4a19fee-47fc-4649-a622-4053b9732db2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:51.933254 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a4a19fee-47fc-4649-a622-4053b9732db2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: 6f299338-e34f-459f-9194-37909af20428] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:51.941399 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a4a19fee-47fc-4649-a622-4053b9732db2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:51.942309 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a4a19fee-47fc-4649-a622-4053b9732db2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:51.943194 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a4a19fee-47fc-4649-a622-4053b9732db2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:51.944467 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a4a19fee-47fc-4649-a622-4053b9732db2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:51.945165 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a4a19fee-47fc-4649-a622-4053b9732db2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:51.946146 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a4a19fee-47fc-4649-a622-4053b9732db2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:51.983601 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=6 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:57:52.020695 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=22 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:57:52.219536 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d6aac73c-856f-47d0-9c4a-367832619dff tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:52.245090 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d6aac73c-856f-47d0-9c4a-367832619dff tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47" status: 200 len: 1504 microversion: 2.1 time: 0.383601 Oct 17 13:57:52.248236 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2313/4750] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:51 2022] GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47 => generated 1504 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:52.254095 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9d083d57-1b69-4267-a31d-b79ad7784ca5 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-246070980", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "1d5948d6-f169-4d00-b98f-07daff8883f9"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:57:52.279489 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a4a19fee-47fc-4649-a622-4053b9732db2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:52.289096 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a4a19fee-47fc-4649-a622-4053b9732db2 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/6f299338-e34f-459f-9194-37909af20428" status: 200 len: 1512 microversion: 2.1 time: 0.362360 Oct 17 13:57:52.290964 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2438/4751] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:51 2022] GET /compute/v2.1/servers/6f299338-e34f-459f-9194-37909af20428 => generated 1512 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:57:52.320661 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-48f68183-cf36-4bd9-aa1d-d6b55b903bfb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:52.322313 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-48f68183-cf36-4bd9-aa1d-d6b55b903bfb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: 6f299338-e34f-459f-9194-37909af20428] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:52.352643 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-9d083d57-1b69-4267-a31d-b79ad7784ca5 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] validate_networks() for [('1d5948d6-f169-4d00-b98f-07daff8883f9', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:57:52.360728 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48f68183-cf36-4bd9-aa1d-d6b55b903bfb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:52.366393 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48f68183-cf36-4bd9-aa1d-d6b55b903bfb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:52.366947 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48f68183-cf36-4bd9-aa1d-d6b55b903bfb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:52.369665 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48f68183-cf36-4bd9-aa1d-d6b55b903bfb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:52.371673 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48f68183-cf36-4bd9-aa1d-d6b55b903bfb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:52.373217 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48f68183-cf36-4bd9-aa1d-d6b55b903bfb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:52.414050 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-48f68183-cf36-4bd9-aa1d-d6b55b903bfb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: 6f299338-e34f-459f-9194-37909af20428] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:57:52.577053 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-48f68183-cf36-4bd9-aa1d-d6b55b903bfb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "DELETE /compute/v2.1/servers/6f299338-e34f-459f-9194-37909af20428" status: 204 len: 0 microversion: 2.1 time: 0.263573 Oct 17 13:57:52.577603 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2439/4752] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:57:52 2022] DELETE /compute/v2.1/servers/6f299338-e34f-459f-9194-37909af20428 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 13:57:52.595581 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e9e83e6a-c74f-4dfd-9663-8c8bcc544bf5 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:52.597203 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e9e83e6a-c74f-4dfd-9663-8c8bcc544bf5 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: 6f299338-e34f-459f-9194-37909af20428] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:52.609014 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9e83e6a-c74f-4dfd-9663-8c8bcc544bf5 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:52.609774 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9e83e6a-c74f-4dfd-9663-8c8bcc544bf5 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:52.610297 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9e83e6a-c74f-4dfd-9663-8c8bcc544bf5 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:52.611250 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9e83e6a-c74f-4dfd-9663-8c8bcc544bf5 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:52.613098 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9e83e6a-c74f-4dfd-9663-8c8bcc544bf5 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:52.613800 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9e83e6a-c74f-4dfd-9663-8c8bcc544bf5 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:52.703768 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:57:53.022980 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e9e83e6a-c74f-4dfd-9663-8c8bcc544bf5 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:53.035530 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e9e83e6a-c74f-4dfd-9663-8c8bcc544bf5 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/6f299338-e34f-459f-9194-37909af20428" status: 200 len: 1518 microversion: 2.1 time: 0.449743 Oct 17 13:57:53.036609 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2440/4753] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:52 2022] GET /compute/v2.1/servers/6f299338-e34f-459f-9194-37909af20428 => generated 1518 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:53.041672 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-71dcb2e7-34ad-4b4b-9ff9-9302a5925b08 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:53.042285 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-71dcb2e7-34ad-4b4b-9ff9-9302a5925b08 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 6d2bbd26-cb90-4e90-881f-a9346ee3002a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:53.049635 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-71dcb2e7-34ad-4b4b-9ff9-9302a5925b08 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:53.050403 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-71dcb2e7-34ad-4b4b-9ff9-9302a5925b08 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:53.050981 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-71dcb2e7-34ad-4b4b-9ff9-9302a5925b08 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:53.051897 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-71dcb2e7-34ad-4b4b-9ff9-9302a5925b08 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:53.052353 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-71dcb2e7-34ad-4b4b-9ff9-9302a5925b08 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:53.052778 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-71dcb2e7-34ad-4b4b-9ff9-9302a5925b08 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:53.056157 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:57:53.231216 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-9d083d57-1b69-4267-a31d-b79ad7784ca5 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:57:53.233384 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-9d083d57-1b69-4267-a31d-b79ad7784ca5 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:57:53.234256 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-9d083d57-1b69-4267-a31d-b79ad7784ca5 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:57:53.234845 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-9d083d57-1b69-4267-a31d-b79ad7784ca5 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:57:53.235436 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-9d083d57-1b69-4267-a31d-b79ad7784ca5 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:57:53.247945 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9d083d57-1b69-4267-a31d-b79ad7784ca5 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:53.248428 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9d083d57-1b69-4267-a31d-b79ad7784ca5 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:53.248860 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9d083d57-1b69-4267-a31d-b79ad7784ca5 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:53.249583 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9d083d57-1b69-4267-a31d-b79ad7784ca5 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:53.250029 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9d083d57-1b69-4267-a31d-b79ad7784ca5 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:53.250447 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9d083d57-1b69-4267-a31d-b79ad7784ca5 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:53.270001 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-9d083d57-1b69-4267-a31d-b79ad7784ca5 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Getting quotas for project 45371f66db35454fbe896194e75afd6e. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:57:53.275978 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-9d083d57-1b69-4267-a31d-b79ad7784ca5 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Getting quotas for user c9382b34782f44e2818a26ecadc3f386 and project 45371f66db35454fbe896194e75afd6e. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:57:53.290787 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9d083d57-1b69-4267-a31d-b79ad7784ca5 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:57:53.293708 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9d083d57-1b69-4267-a31d-b79ad7784ca5 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: ad70195b-4a02-4a69-b6da-1f19fc3a51cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:57:53.345308 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9d083d57-1b69-4267-a31d-b79ad7784ca5 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.095640 Oct 17 13:57:53.346011 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2314/4754] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:57:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1097 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:57:53.351129 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-aa64b8f9-03ad-4e81-9dc9-ce8ae623d944 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:53.352050 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-aa64b8f9-03ad-4e81-9dc9-ce8ae623d944 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: cdde7779-a327-416c-863c-cd50d4d11c47] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:53.359281 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aa64b8f9-03ad-4e81-9dc9-ce8ae623d944 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:53.360003 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aa64b8f9-03ad-4e81-9dc9-ce8ae623d944 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:53.360623 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aa64b8f9-03ad-4e81-9dc9-ce8ae623d944 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:53.361496 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aa64b8f9-03ad-4e81-9dc9-ce8ae623d944 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:53.362103 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aa64b8f9-03ad-4e81-9dc9-ce8ae623d944 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:53.362950 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aa64b8f9-03ad-4e81-9dc9-ce8ae623d944 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:53.383379 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-71dcb2e7-34ad-4b4b-9ff9-9302a5925b08 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:53.394920 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-71dcb2e7-34ad-4b4b-9ff9-9302a5925b08 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a" status: 200 len: 1315 microversion: 2.1 time: 0.356953 Oct 17 13:57:53.396561 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2441/4755] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:53 2022] GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a => generated 1315 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:53.417336 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8e958d6d-c902-45ac-9e54-ebf37cb049d6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:53.418697 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8e958d6d-c902-45ac-9e54-ebf37cb049d6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: ad70195b-4a02-4a69-b6da-1f19fc3a51cd] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:53.548473 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8e958d6d-c902-45ac-9e54-ebf37cb049d6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:53.560020 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8e958d6d-c902-45ac-9e54-ebf37cb049d6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd" status: 200 len: 1214 microversion: 2.1 time: 0.146107 Oct 17 13:57:53.561168 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2442/4756] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:53 2022] GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd => generated 1214 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:54.059267 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fe658386-7650-4bb0-951b-3b9bbc303bcd tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:54.060657 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-fe658386-7650-4bb0-951b-3b9bbc303bcd tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: 6f299338-e34f-459f-9194-37909af20428] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:54.075708 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe658386-7650-4bb0-951b-3b9bbc303bcd tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:54.076207 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe658386-7650-4bb0-951b-3b9bbc303bcd tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:54.076645 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe658386-7650-4bb0-951b-3b9bbc303bcd tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:54.077365 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe658386-7650-4bb0-951b-3b9bbc303bcd tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:54.077823 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe658386-7650-4bb0-951b-3b9bbc303bcd tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:54.078250 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe658386-7650-4bb0-951b-3b9bbc303bcd tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:54.151526 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-aa64b8f9-03ad-4e81-9dc9-ce8ae623d944 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:54.163770 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-aa64b8f9-03ad-4e81-9dc9-ce8ae623d944 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47" status: 200 len: 1504 microversion: 2.1 time: 0.816196 Oct 17 13:57:54.190102 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2315/4757] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:53 2022] GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47 => generated 1504 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:54.418545 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2c764088-7125-415d-aa6e-505a80d553a7 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:54.419247 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2c764088-7125-415d-aa6e-505a80d553a7 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 6d2bbd26-cb90-4e90-881f-a9346ee3002a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:54.431062 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2c764088-7125-415d-aa6e-505a80d553a7 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:54.431626 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2c764088-7125-415d-aa6e-505a80d553a7 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:54.432446 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2c764088-7125-415d-aa6e-505a80d553a7 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:54.437937 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2c764088-7125-415d-aa6e-505a80d553a7 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:54.438797 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2c764088-7125-415d-aa6e-505a80d553a7 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:54.439226 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2c764088-7125-415d-aa6e-505a80d553a7 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:54.664681 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fe658386-7650-4bb0-951b-3b9bbc303bcd tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:54.674237 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fe658386-7650-4bb0-951b-3b9bbc303bcd tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/6f299338-e34f-459f-9194-37909af20428" status: 200 len: 1518 microversion: 2.1 time: 0.619380 Oct 17 13:57:54.692946 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2443/4758] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:54 2022] GET /compute/v2.1/servers/6f299338-e34f-459f-9194-37909af20428 => generated 1518 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:57:54.713085 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c1b35c15-2566-4176-8dfc-c31e32a15bca tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:54.713679 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c1b35c15-2566-4176-8dfc-c31e32a15bca tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: ad70195b-4a02-4a69-b6da-1f19fc3a51cd] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:54.722164 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1b35c15-2566-4176-8dfc-c31e32a15bca tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:54.722670 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1b35c15-2566-4176-8dfc-c31e32a15bca tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:54.723110 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1b35c15-2566-4176-8dfc-c31e32a15bca tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:54.723871 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1b35c15-2566-4176-8dfc-c31e32a15bca tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:54.724348 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1b35c15-2566-4176-8dfc-c31e32a15bca tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:54.724757 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1b35c15-2566-4176-8dfc-c31e32a15bca tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:54.877840 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2c764088-7125-415d-aa6e-505a80d553a7 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:54.888376 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2c764088-7125-415d-aa6e-505a80d553a7 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a" status: 200 len: 1315 microversion: 2.1 time: 0.473652 Oct 17 13:57:54.890182 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2316/4759] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:54 2022] GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a => generated 1315 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:57:54.921018 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c1b35c15-2566-4176-8dfc-c31e32a15bca tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:54.932159 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c1b35c15-2566-4176-8dfc-c31e32a15bca tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd" status: 200 len: 1266 microversion: 2.1 time: 0.237376 Oct 17 13:57:54.948051 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2444/4760] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:54 2022] GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd => generated 1266 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:55.187717 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5d8e2a1e-1e88-4f86-af32-d11292f2e0cf tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:55.188323 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5d8e2a1e-1e88-4f86-af32-d11292f2e0cf tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: cdde7779-a327-416c-863c-cd50d4d11c47] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:55.200893 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5d8e2a1e-1e88-4f86-af32-d11292f2e0cf tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:55.201380 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5d8e2a1e-1e88-4f86-af32-d11292f2e0cf tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:55.201996 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5d8e2a1e-1e88-4f86-af32-d11292f2e0cf tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:55.203821 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5d8e2a1e-1e88-4f86-af32-d11292f2e0cf tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:55.204852 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5d8e2a1e-1e88-4f86-af32-d11292f2e0cf tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:55.205568 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5d8e2a1e-1e88-4f86-af32-d11292f2e0cf tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:55.248066 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-dcfc9c0a-5ecd-425b-a431-4f118f0b484f req-0f15fd30-31b1-4f48-ae11-d464e39b85dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f299338-e34f-459f-9194-37909af20428", "name": "network-vif-deleted", "tag": "b6bcf3d2-8ea1-415a-b1be-565554199c6f"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:57:55.277029 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-dcfc9c0a-5ecd-425b-a431-4f118f0b484f req-0f15fd30-31b1-4f48-ae11-d464e39b85dd service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:55.281663 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-dcfc9c0a-5ecd-425b-a431-4f118f0b484f req-0f15fd30-31b1-4f48-ae11-d464e39b85dd service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:55.282919 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-dcfc9c0a-5ecd-425b-a431-4f118f0b484f req-0f15fd30-31b1-4f48-ae11-d464e39b85dd service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:55.368507 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-dcfc9c0a-5ecd-425b-a431-4f118f0b484f req-0f15fd30-31b1-4f48-ae11-d464e39b85dd service nova] Creating event network-vif-deleted:b6bcf3d2-8ea1-415a-b1be-565554199c6f for instance 6f299338-e34f-459f-9194-37909af20428 on n-h1-854247-14 Oct 17 13:57:55.384408 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-dcfc9c0a-5ecd-425b-a431-4f118f0b484f req-0f15fd30-31b1-4f48-ae11-d464e39b85dd service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136167 Oct 17 13:57:55.386778 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2445/4761] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:57:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:57:55.704850 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ed8dabd4-4d35-470a-af24-8ca5019f8bff tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:55.706442 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ed8dabd4-4d35-470a-af24-8ca5019f8bff tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: 6f299338-e34f-459f-9194-37909af20428] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:55.718541 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ed8dabd4-4d35-470a-af24-8ca5019f8bff tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:55.719457 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ed8dabd4-4d35-470a-af24-8ca5019f8bff tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:55.720300 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ed8dabd4-4d35-470a-af24-8ca5019f8bff tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:55.722668 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ed8dabd4-4d35-470a-af24-8ca5019f8bff tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:55.724210 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ed8dabd4-4d35-470a-af24-8ca5019f8bff tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:55.724872 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ed8dabd4-4d35-470a-af24-8ca5019f8bff tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:55.788253 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ed8dabd4-4d35-470a-af24-8ca5019f8bff tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:55.791358 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ed8dabd4-4d35-470a-af24-8ca5019f8bff tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:55.794308 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ed8dabd4-4d35-470a-af24-8ca5019f8bff tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:55.797555 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-ed8dabd4-4d35-470a-af24-8ca5019f8bff tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lazy-loading 'fault' on Instance uuid 6f299338-e34f-459f-9194-37909af20428 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:57:55.810097 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5d8e2a1e-1e88-4f86-af32-d11292f2e0cf tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:55.826471 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5d8e2a1e-1e88-4f86-af32-d11292f2e0cf tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47" status: 200 len: 1504 microversion: 2.1 time: 0.641509 Oct 17 13:57:55.828210 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2317/4762] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:55 2022] GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47 => generated 1504 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:55.887638 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ed8dabd4-4d35-470a-af24-8ca5019f8bff tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:55.905056 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ed8dabd4-4d35-470a-af24-8ca5019f8bff tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/6f299338-e34f-459f-9194-37909af20428" status: 200 len: 1320 microversion: 2.1 time: 0.205942 Oct 17 13:57:55.908047 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2446/4763] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:55 2022] GET /compute/v2.1/servers/6f299338-e34f-459f-9194-37909af20428 => generated 1320 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:55.918464 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-53d9f1be-7bb9-4187-9274-08aeb964d0bb tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:55.919679 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-53d9f1be-7bb9-4187-9274-08aeb964d0bb tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 6d2bbd26-cb90-4e90-881f-a9346ee3002a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:55.945080 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-53d9f1be-7bb9-4187-9274-08aeb964d0bb tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:55.945924 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-53d9f1be-7bb9-4187-9274-08aeb964d0bb tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:55.946609 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-53d9f1be-7bb9-4187-9274-08aeb964d0bb tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:55.947562 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-53d9f1be-7bb9-4187-9274-08aeb964d0bb tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:55.948217 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-53d9f1be-7bb9-4187-9274-08aeb964d0bb tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:55.948848 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-53d9f1be-7bb9-4187-9274-08aeb964d0bb tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:55.984800 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b1a0c25a-bc5f-4119-bcf7-4916821a3a7c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:55.996579 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b1a0c25a-bc5f-4119-bcf7-4916821a3a7c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: ad70195b-4a02-4a69-b6da-1f19fc3a51cd] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:56.003864 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b1a0c25a-bc5f-4119-bcf7-4916821a3a7c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:56.004724 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b1a0c25a-bc5f-4119-bcf7-4916821a3a7c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:56.005729 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b1a0c25a-bc5f-4119-bcf7-4916821a3a7c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:56.007145 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b1a0c25a-bc5f-4119-bcf7-4916821a3a7c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:56.007856 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b1a0c25a-bc5f-4119-bcf7-4916821a3a7c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:56.008513 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b1a0c25a-bc5f-4119-bcf7-4916821a3a7c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:56.230941 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b1a0c25a-bc5f-4119-bcf7-4916821a3a7c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:56.244612 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b1a0c25a-bc5f-4119-bcf7-4916821a3a7c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd" status: 200 len: 1272 microversion: 2.1 time: 0.291068 Oct 17 13:57:56.245904 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2447/4764] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:55 2022] GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd => generated 1272 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:56.336953 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-53d9f1be-7bb9-4187-9274-08aeb964d0bb tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:56.345906 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:57:56.353382 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-53d9f1be-7bb9-4187-9274-08aeb964d0bb tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a" status: 200 len: 1315 microversion: 2.1 time: 0.441664 Oct 17 13:57:56.370289 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2318/4765] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:55 2022] GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a => generated 1315 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:57:56.857293 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c3f6e9bc-97c8-4f75-b3f7-3abd9651f505 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:56.859112 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c3f6e9bc-97c8-4f75-b3f7-3abd9651f505 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: cdde7779-a327-416c-863c-cd50d4d11c47] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:56.877882 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c3f6e9bc-97c8-4f75-b3f7-3abd9651f505 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:56.879060 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c3f6e9bc-97c8-4f75-b3f7-3abd9651f505 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:56.881767 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c3f6e9bc-97c8-4f75-b3f7-3abd9651f505 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:56.883581 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c3f6e9bc-97c8-4f75-b3f7-3abd9651f505 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:56.885917 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c3f6e9bc-97c8-4f75-b3f7-3abd9651f505 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:56.886622 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c3f6e9bc-97c8-4f75-b3f7-3abd9651f505 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:56.935900 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f07ceb10-2e41-4ea0-aca2-ab8adaa8afd0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:56.937366 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f07ceb10-2e41-4ea0-aca2-ab8adaa8afd0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: 6f299338-e34f-459f-9194-37909af20428] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:56.954131 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f07ceb10-2e41-4ea0-aca2-ab8adaa8afd0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:56.956660 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f07ceb10-2e41-4ea0-aca2-ab8adaa8afd0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:56.958765 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f07ceb10-2e41-4ea0-aca2-ab8adaa8afd0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:56.963807 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f07ceb10-2e41-4ea0-aca2-ab8adaa8afd0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:56.964623 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f07ceb10-2e41-4ea0-aca2-ab8adaa8afd0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:56.967697 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f07ceb10-2e41-4ea0-aca2-ab8adaa8afd0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:57.008304 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-f07ceb10-2e41-4ea0-aca2-ab8adaa8afd0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] HTTP exception thrown: Instance 6f299338-e34f-459f-9194-37909af20428 could not be found. Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f07ceb10-2e41-4ea0-aca2-ab8adaa8afd0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Request method failure captured: Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/6f299338-e34f-459f-9194-37909af20428 HTTP/1.1 Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTV7LY5HyKXIBiWDJCG3V5sT42rtCOx1a0oRMtoibd5F_sflHwMTlRe9Y_uOa1HxVMLf4skT3kvoUZ584fC2ohAV2v8XUvXrQcJEEPLKlU8mLvFkUN1JC352BF9fy9_Q0qQLABy1MIy7jPkSZI0xF-7yfpY_h22PPPDKIkDzzcK6D9CQ Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 4fa57e8772684c93a406f3d01da2af88 Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServersTestJSON-749544598 Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4fa57e8772684c93a406f3d01da2af88", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServersTestJSON-749544598 Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 4fa57e8772684c93a406f3d01da2af88 Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServersTestJSON-749544598 Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServersTestJSON-749544598-project Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: d78348abc02a4bb892902b0dd3bcfd6a Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServersTestJSON-749544598-project Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 6f299338-e34f-459f-9194-37909af20428 could not be found. Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '6f299338-e34f-459f-9194-37909af20428'} Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f299338-e34f-459f-9194-37909af20428 could not be found. Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f299338-e34f-459f-9194-37909af20428 could not be found. Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:57:57.012902 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:57:57.019030 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:57:57.019030 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:57:57.019030 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:57:57.019030 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:57:57.019030 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f299338-e34f-459f-9194-37909af20428 could not be found. Oct 17 13:57:57.019030 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:57:57.019030 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f07ceb10-2e41-4ea0-aca2-ab8adaa8afd0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Returning 404 to user: Instance 6f299338-e34f-459f-9194-37909af20428 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:57:57.019030 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f07ceb10-2e41-4ea0-aca2-ab8adaa8afd0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/6f299338-e34f-459f-9194-37909af20428" status: 404 len: 111 microversion: 2.1 time: 0.088153 Oct 17 13:57:57.021954 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2319/4766] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:56 2022] GET /compute/v2.1/servers/6f299338-e34f-459f-9194-37909af20428 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:57:57.199024 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a82c71c5-54b2-4911-8e0a-93683fc4ed95 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1460599411", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "57c5839d-0220-4c16-a56e-f44ad4323cc7"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:57:57.260920 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-a82c71c5-54b2-4911-8e0a-93683fc4ed95 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] validate_networks() for [('57c5839d-0220-4c16-a56e-f44ad4323cc7', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:57:57.792139 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c3f6e9bc-97c8-4f75-b3f7-3abd9651f505 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:57.807904 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c3f6e9bc-97c8-4f75-b3f7-3abd9651f505 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47" status: 200 len: 1504 microversion: 2.1 time: 0.958097 Oct 17 13:57:57.810884 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2448/4767] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:56 2022] GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47 => generated 1504 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:57.818857 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-aa0a054c-00c8-45cc-bcfc-03d8f8b39e58 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:57.819491 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-aa0a054c-00c8-45cc-bcfc-03d8f8b39e58 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: ad70195b-4a02-4a69-b6da-1f19fc3a51cd] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:57.838190 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aa0a054c-00c8-45cc-bcfc-03d8f8b39e58 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:57.838744 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aa0a054c-00c8-45cc-bcfc-03d8f8b39e58 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:57.839230 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aa0a054c-00c8-45cc-bcfc-03d8f8b39e58 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:57.840111 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aa0a054c-00c8-45cc-bcfc-03d8f8b39e58 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:57.840748 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aa0a054c-00c8-45cc-bcfc-03d8f8b39e58 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:57.841412 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aa0a054c-00c8-45cc-bcfc-03d8f8b39e58 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:58.258316 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-aa0a054c-00c8-45cc-bcfc-03d8f8b39e58 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:58.294398 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-aa0a054c-00c8-45cc-bcfc-03d8f8b39e58 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd" status: 200 len: 1314 microversion: 2.1 time: 0.482062 Oct 17 13:57:58.298359 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2449/4768] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:57 2022] GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd => generated 1314 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:58.306282 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b33d15ca-fb5e-4c44-b8f0-eda45c7cf45f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:58.308002 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b33d15ca-fb5e-4c44-b8f0-eda45c7cf45f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 6d2bbd26-cb90-4e90-881f-a9346ee3002a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:58.315768 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b33d15ca-fb5e-4c44-b8f0-eda45c7cf45f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:58.316617 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b33d15ca-fb5e-4c44-b8f0-eda45c7cf45f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:58.317311 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b33d15ca-fb5e-4c44-b8f0-eda45c7cf45f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:58.318267 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b33d15ca-fb5e-4c44-b8f0-eda45c7cf45f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:58.318945 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b33d15ca-fb5e-4c44-b8f0-eda45c7cf45f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:58.319653 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b33d15ca-fb5e-4c44-b8f0-eda45c7cf45f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:58.689431 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b33d15ca-fb5e-4c44-b8f0-eda45c7cf45f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:58.700243 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b33d15ca-fb5e-4c44-b8f0-eda45c7cf45f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a" status: 200 len: 1315 microversion: 2.1 time: 0.400185 Oct 17 13:57:58.722314 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2450/4769] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:58 2022] GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a => generated 1315 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:58.735785 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-dc87807e-928f-4e40-87a8-79045b10723a req-4c8f087c-2892-4c7d-adc4-dc7be5cb274c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d2bbd26-cb90-4e90-881f-a9346ee3002a", "name": "network-vif-plugged", "status": "completed", "tag": "7709c35f-ab2e-4e7f-8507-786eb35a55e3"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:57:58.775731 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-dc87807e-928f-4e40-87a8-79045b10723a req-4c8f087c-2892-4c7d-adc4-dc7be5cb274c service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:58.776406 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-dc87807e-928f-4e40-87a8-79045b10723a req-4c8f087c-2892-4c7d-adc4-dc7be5cb274c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:58.776995 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-dc87807e-928f-4e40-87a8-79045b10723a req-4c8f087c-2892-4c7d-adc4-dc7be5cb274c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:58.799065 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-dc87807e-928f-4e40-87a8-79045b10723a req-4c8f087c-2892-4c7d-adc4-dc7be5cb274c service nova] Creating event network-vif-plugged:7709c35f-ab2e-4e7f-8507-786eb35a55e3 for instance 6d2bbd26-cb90-4e90-881f-a9346ee3002a on n-h2-854247-14 Oct 17 13:57:58.814976 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-dc87807e-928f-4e40-87a8-79045b10723a req-4c8f087c-2892-4c7d-adc4-dc7be5cb274c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081038 Oct 17 13:57:58.816331 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2451/4770] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:57:58.821442 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-a82c71c5-54b2-4911-8e0a-93683fc4ed95 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:57:58.822793 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-a82c71c5-54b2-4911-8e0a-93683fc4ed95 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:57:58.823446 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-a82c71c5-54b2-4911-8e0a-93683fc4ed95 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:57:58.825044 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-a82c71c5-54b2-4911-8e0a-93683fc4ed95 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:57:58.825781 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-a82c71c5-54b2-4911-8e0a-93683fc4ed95 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:57:58.842960 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a82c71c5-54b2-4911-8e0a-93683fc4ed95 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:58.846022 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2bbff73b-3680-4946-8f37-5e577e6b26b0 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:58.846676 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a82c71c5-54b2-4911-8e0a-93683fc4ed95 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:58.847949 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a82c71c5-54b2-4911-8e0a-93683fc4ed95 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:58.850298 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a82c71c5-54b2-4911-8e0a-93683fc4ed95 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:58.851464 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2bbff73b-3680-4946-8f37-5e577e6b26b0 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: cdde7779-a327-416c-863c-cd50d4d11c47] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:58.852765 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a82c71c5-54b2-4911-8e0a-93683fc4ed95 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:58.854431 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a82c71c5-54b2-4911-8e0a-93683fc4ed95 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:58.868490 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2bbff73b-3680-4946-8f37-5e577e6b26b0 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:58.869671 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2bbff73b-3680-4946-8f37-5e577e6b26b0 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:58.871696 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2bbff73b-3680-4946-8f37-5e577e6b26b0 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:58.875731 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2bbff73b-3680-4946-8f37-5e577e6b26b0 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:58.876547 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2bbff73b-3680-4946-8f37-5e577e6b26b0 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:58.877009 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2bbff73b-3680-4946-8f37-5e577e6b26b0 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:58.902762 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-a82c71c5-54b2-4911-8e0a-93683fc4ed95 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Getting quotas for project 4fa57e8772684c93a406f3d01da2af88. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:57:58.910977 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-a82c71c5-54b2-4911-8e0a-93683fc4ed95 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Getting quotas for user d78348abc02a4bb892902b0dd3bcfd6a and project 4fa57e8772684c93a406f3d01da2af88. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:57:58.925740 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a82c71c5-54b2-4911-8e0a-93683fc4ed95 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:57:58.928425 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a82c71c5-54b2-4911-8e0a-93683fc4ed95 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: c7875373-8b55-4b5a-b6be-9ce42c255eef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:57:58.992381 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a82c71c5-54b2-4911-8e0a-93683fc4ed95 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.797797 Oct 17 13:57:58.999550 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2320/4771] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:57:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:57:59.006037 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1b24029b-5869-479d-80dd-03e87a8b3eae tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:59.006909 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1b24029b-5869-479d-80dd-03e87a8b3eae tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: c7875373-8b55-4b5a-b6be-9ce42c255eef] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:59.118425 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1b24029b-5869-479d-80dd-03e87a8b3eae tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:59.126897 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1b24029b-5869-479d-80dd-03e87a8b3eae tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef" status: 200 len: 1209 microversion: 2.1 time: 0.125825 Oct 17 13:57:59.127785 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2321/4772] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:58 2022] GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef => generated 1209 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:59.286170 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2bbff73b-3680-4946-8f37-5e577e6b26b0 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:59.316086 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2bbff73b-3680-4946-8f37-5e577e6b26b0 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47" status: 200 len: 1504 microversion: 2.1 time: 0.473475 Oct 17 13:57:59.318872 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2452/4773] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:58 2022] GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47 => generated 1504 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:59.337331 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5a2a8c31-14a2-407e-b732-aba40ade1199 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:59.338358 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5a2a8c31-14a2-407e-b732-aba40ade1199 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: ad70195b-4a02-4a69-b6da-1f19fc3a51cd] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:59.339876 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-9a883a9f-4998-41cc-b04c-74acc147211a req-bcf9275a-0aab-4686-9827-920c7644da7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad70195b-4a02-4a69-b6da-1f19fc3a51cd", "tag": "6f5c8902-466c-4ca2-9d94-db58249199e2"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:57:59.354365 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-9a883a9f-4998-41cc-b04c-74acc147211a req-bcf9275a-0aab-4686-9827-920c7644da7a service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:59.355282 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-9a883a9f-4998-41cc-b04c-74acc147211a req-bcf9275a-0aab-4686-9827-920c7644da7a service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:59.356058 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-9a883a9f-4998-41cc-b04c-74acc147211a req-bcf9275a-0aab-4686-9827-920c7644da7a service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:59.357275 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5a2a8c31-14a2-407e-b732-aba40ade1199 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:59.357777 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5a2a8c31-14a2-407e-b732-aba40ade1199 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:59.358220 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5a2a8c31-14a2-407e-b732-aba40ade1199 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:59.358940 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5a2a8c31-14a2-407e-b732-aba40ade1199 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:59.359430 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5a2a8c31-14a2-407e-b732-aba40ade1199 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:59.359888 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5a2a8c31-14a2-407e-b732-aba40ade1199 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:59.371926 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-9a883a9f-4998-41cc-b04c-74acc147211a req-bcf9275a-0aab-4686-9827-920c7644da7a service nova] Creating event network-changed:6f5c8902-466c-4ca2-9d94-db58249199e2 for instance ad70195b-4a02-4a69-b6da-1f19fc3a51cd on n-h1-854247-14 Oct 17 13:57:59.379250 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-9a883a9f-4998-41cc-b04c-74acc147211a req-bcf9275a-0aab-4686-9827-920c7644da7a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051099 Oct 17 13:57:59.380568 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2322/4774] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:57:59.657507 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5a2a8c31-14a2-407e-b732-aba40ade1199 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:59.669231 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5a2a8c31-14a2-407e-b732-aba40ade1199 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd" status: 200 len: 1314 microversion: 2.1 time: 0.335922 Oct 17 13:57:59.669853 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2453/4775] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:59 2022] GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd => generated 1314 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:57:59.730449 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-682f3977-2c39-4bcb-9a23-2595011275de tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:59.731679 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-682f3977-2c39-4bcb-9a23-2595011275de tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 6d2bbd26-cb90-4e90-881f-a9346ee3002a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:59.739279 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-682f3977-2c39-4bcb-9a23-2595011275de tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:59.741582 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-682f3977-2c39-4bcb-9a23-2595011275de tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:59.742219 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-682f3977-2c39-4bcb-9a23-2595011275de tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:59.743108 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-682f3977-2c39-4bcb-9a23-2595011275de tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:59.743800 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-682f3977-2c39-4bcb-9a23-2595011275de tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:59.744415 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-682f3977-2c39-4bcb-9a23-2595011275de tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:00.040558 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-682f3977-2c39-4bcb-9a23-2595011275de tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:00.072102 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-682f3977-2c39-4bcb-9a23-2595011275de tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a" status: 200 len: 1315 microversion: 2.1 time: 0.346810 Oct 17 13:58:00.096823 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2323/4776] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:59 2022] GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a => generated 1315 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:00.150400 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-40809eac-1574-4909-9a93-03606a8f5542 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:00.151099 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-40809eac-1574-4909-9a93-03606a8f5542 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: c7875373-8b55-4b5a-b6be-9ce42c255eef] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:00.163099 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-40809eac-1574-4909-9a93-03606a8f5542 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:00.164010 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-40809eac-1574-4909-9a93-03606a8f5542 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:00.165987 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-40809eac-1574-4909-9a93-03606a8f5542 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:00.170997 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-40809eac-1574-4909-9a93-03606a8f5542 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:00.171851 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-40809eac-1574-4909-9a93-03606a8f5542 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:00.172550 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-40809eac-1574-4909-9a93-03606a8f5542 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:00.344373 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-03324f8a-d403-49a0-8ee4-5fc218778c0b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:00.345356 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-03324f8a-d403-49a0-8ee4-5fc218778c0b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: cdde7779-a327-416c-863c-cd50d4d11c47] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:00.356664 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-03324f8a-d403-49a0-8ee4-5fc218778c0b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:00.357189 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-03324f8a-d403-49a0-8ee4-5fc218778c0b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:00.357623 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-03324f8a-d403-49a0-8ee4-5fc218778c0b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:00.358332 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-03324f8a-d403-49a0-8ee4-5fc218778c0b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:00.358833 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-03324f8a-d403-49a0-8ee4-5fc218778c0b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:00.359302 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-03324f8a-d403-49a0-8ee4-5fc218778c0b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:00.419876 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-40809eac-1574-4909-9a93-03606a8f5542 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:00.432750 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-40809eac-1574-4909-9a93-03606a8f5542 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef" status: 200 len: 1261 microversion: 2.1 time: 0.286326 Oct 17 13:58:00.434858 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2454/4777] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:00 2022] GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef => generated 1261 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:00.694113 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d2b692e3-5b08-4da2-8526-ca0e104b1a39 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:00.694926 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d2b692e3-5b08-4da2-8526-ca0e104b1a39 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: ad70195b-4a02-4a69-b6da-1f19fc3a51cd] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:00.705764 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d2b692e3-5b08-4da2-8526-ca0e104b1a39 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:00.707250 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d2b692e3-5b08-4da2-8526-ca0e104b1a39 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:00.707864 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d2b692e3-5b08-4da2-8526-ca0e104b1a39 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:00.708760 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d2b692e3-5b08-4da2-8526-ca0e104b1a39 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:00.709383 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d2b692e3-5b08-4da2-8526-ca0e104b1a39 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:00.710141 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d2b692e3-5b08-4da2-8526-ca0e104b1a39 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:00.837305 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-03324f8a-d403-49a0-8ee4-5fc218778c0b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:00.848990 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-03324f8a-d403-49a0-8ee4-5fc218778c0b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47" status: 200 len: 1504 microversion: 2.1 time: 0.510728 Oct 17 13:58:00.850098 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2324/4778] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:00 2022] GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47 => generated 1504 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:58:01.102314 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-27680a41-e3c2-4bfc-8f3b-21dedd7ed63e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:01.120787 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-27680a41-e3c2-4bfc-8f3b-21dedd7ed63e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 6d2bbd26-cb90-4e90-881f-a9346ee3002a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:01.129130 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d2b692e3-5b08-4da2-8526-ca0e104b1a39 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:01.140748 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d2b692e3-5b08-4da2-8526-ca0e104b1a39 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd" status: 200 len: 1314 microversion: 2.1 time: 0.451122 Oct 17 13:58:01.142112 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2455/4779] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:00 2022] GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd => generated 1314 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:58:01.162991 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-27680a41-e3c2-4bfc-8f3b-21dedd7ed63e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:01.164455 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-27680a41-e3c2-4bfc-8f3b-21dedd7ed63e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:01.164455 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-27680a41-e3c2-4bfc-8f3b-21dedd7ed63e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:01.165086 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-27680a41-e3c2-4bfc-8f3b-21dedd7ed63e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:01.165556 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-27680a41-e3c2-4bfc-8f3b-21dedd7ed63e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:01.165988 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-27680a41-e3c2-4bfc-8f3b-21dedd7ed63e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:01.458484 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-48750f3a-5cb0-4a3f-8bff-40904a03370b tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:01.459093 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-48750f3a-5cb0-4a3f-8bff-40904a03370b tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: c7875373-8b55-4b5a-b6be-9ce42c255eef] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:01.466133 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48750f3a-5cb0-4a3f-8bff-40904a03370b tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:01.466618 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48750f3a-5cb0-4a3f-8bff-40904a03370b tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:01.467066 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48750f3a-5cb0-4a3f-8bff-40904a03370b tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:01.467800 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48750f3a-5cb0-4a3f-8bff-40904a03370b tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:01.468273 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48750f3a-5cb0-4a3f-8bff-40904a03370b tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:01.468692 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48750f3a-5cb0-4a3f-8bff-40904a03370b tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:01.845755 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-48750f3a-5cb0-4a3f-8bff-40904a03370b tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:01.858772 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-48750f3a-5cb0-4a3f-8bff-40904a03370b tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef" status: 200 len: 1269 microversion: 2.1 time: 0.404297 Oct 17 13:58:01.859778 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2456/4780] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:01 2022] GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef => generated 1269 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:58:01.876916 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0bd9883a-3efe-4ddb-af82-3f6e8fba55b8 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:01.878059 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0bd9883a-3efe-4ddb-af82-3f6e8fba55b8 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: cdde7779-a327-416c-863c-cd50d4d11c47] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:01.884795 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0bd9883a-3efe-4ddb-af82-3f6e8fba55b8 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:01.885988 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0bd9883a-3efe-4ddb-af82-3f6e8fba55b8 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:01.886683 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0bd9883a-3efe-4ddb-af82-3f6e8fba55b8 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:01.887937 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0bd9883a-3efe-4ddb-af82-3f6e8fba55b8 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:01.888692 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0bd9883a-3efe-4ddb-af82-3f6e8fba55b8 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:01.889181 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0bd9883a-3efe-4ddb-af82-3f6e8fba55b8 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:02.060450 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-27680a41-e3c2-4bfc-8f3b-21dedd7ed63e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:02.070401 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-27680a41-e3c2-4bfc-8f3b-21dedd7ed63e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a" status: 200 len: 1503 microversion: 2.1 time: 0.971685 Oct 17 13:58:02.071346 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2325/4781] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:01 2022] GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a => generated 1503 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:58:02.094046 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c08c06c2-04cb-49c9-b4d1-b29efd7bedd8 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:58:02.094917 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c08c06c2-04cb-49c9-b4d1-b29efd7bedd8 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 6d2bbd26-cb90-4e90-881f-a9346ee3002a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:02.111639 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c08c06c2-04cb-49c9-b4d1-b29efd7bedd8 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:02.113186 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c08c06c2-04cb-49c9-b4d1-b29efd7bedd8 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:02.114271 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c08c06c2-04cb-49c9-b4d1-b29efd7bedd8 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:02.115486 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c08c06c2-04cb-49c9-b4d1-b29efd7bedd8 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:02.117452 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c08c06c2-04cb-49c9-b4d1-b29efd7bedd8 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:02.118198 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c08c06c2-04cb-49c9-b4d1-b29efd7bedd8 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:02.155250 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-c08c06c2-04cb-49c9-b4d1-b29efd7bedd8 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lazy-loading 'flavor' on Instance uuid 6d2bbd26-cb90-4e90-881f-a9346ee3002a {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:58:02.392378 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0bd9883a-3efe-4ddb-af82-3f6e8fba55b8 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:02.401488 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0bd9883a-3efe-4ddb-af82-3f6e8fba55b8 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47" status: 200 len: 1504 microversion: 2.1 time: 0.531772 Oct 17 13:58:02.418777 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2457/4782] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:01 2022] GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47 => generated 1504 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:58:02.424239 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d2e8ccce-7d4c-4634-9d33-ab906eed3527 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:02.424818 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d2e8ccce-7d4c-4634-9d33-ab906eed3527 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: ad70195b-4a02-4a69-b6da-1f19fc3a51cd] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:02.431947 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d2e8ccce-7d4c-4634-9d33-ab906eed3527 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:02.432718 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d2e8ccce-7d4c-4634-9d33-ab906eed3527 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:02.433311 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d2e8ccce-7d4c-4634-9d33-ab906eed3527 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:02.434184 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d2e8ccce-7d4c-4634-9d33-ab906eed3527 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:02.434800 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d2e8ccce-7d4c-4634-9d33-ab906eed3527 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:02.435421 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d2e8ccce-7d4c-4634-9d33-ab906eed3527 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:02.436070 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c08c06c2-04cb-49c9-b4d1-b29efd7bedd8 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "POST /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a/action" status: 202 len: 0 microversion: 2.1 time: 0.346694 Oct 17 13:58:02.441867 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2326/4783] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:58:02 2022] POST /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a/action => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:58:02.448253 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-07dc5013-3bc3-4a7b-99a6-48458d7d265f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:02.448971 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-07dc5013-3bc3-4a7b-99a6-48458d7d265f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 6d2bbd26-cb90-4e90-881f-a9346ee3002a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:02.455901 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-07dc5013-3bc3-4a7b-99a6-48458d7d265f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:02.458524 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-07dc5013-3bc3-4a7b-99a6-48458d7d265f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:02.459144 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-07dc5013-3bc3-4a7b-99a6-48458d7d265f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:02.460066 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-07dc5013-3bc3-4a7b-99a6-48458d7d265f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:02.460679 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-07dc5013-3bc3-4a7b-99a6-48458d7d265f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:02.461393 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-07dc5013-3bc3-4a7b-99a6-48458d7d265f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:03.027239 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d2e8ccce-7d4c-4634-9d33-ab906eed3527 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:03.042195 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d2e8ccce-7d4c-4634-9d33-ab906eed3527 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd" status: 200 len: 1314 microversion: 2.1 time: 0.621958 Oct 17 13:58:03.045131 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2458/4784] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:02 2022] GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd => generated 1314 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:03.059749 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5bbaff33-384f-4d66-afbb-fb94f6b78e0c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:03.060646 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5bbaff33-384f-4d66-afbb-fb94f6b78e0c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: c7875373-8b55-4b5a-b6be-9ce42c255eef] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:03.069292 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5bbaff33-384f-4d66-afbb-fb94f6b78e0c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:03.071547 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5bbaff33-384f-4d66-afbb-fb94f6b78e0c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:03.072006 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5bbaff33-384f-4d66-afbb-fb94f6b78e0c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:03.075538 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5bbaff33-384f-4d66-afbb-fb94f6b78e0c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:03.076033 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5bbaff33-384f-4d66-afbb-fb94f6b78e0c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:03.076617 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5bbaff33-384f-4d66-afbb-fb94f6b78e0c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:03.083839 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-07dc5013-3bc3-4a7b-99a6-48458d7d265f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:03.105940 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-07dc5013-3bc3-4a7b-99a6-48458d7d265f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a" status: 200 len: 1509 microversion: 2.1 time: 0.662567 Oct 17 13:58:03.107674 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2327/4785] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:02 2022] GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a => generated 1509 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:03.427838 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5d3cc8b7-19c3-48e3-bbf1-293fb0e866a7 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:03.430155 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5d3cc8b7-19c3-48e3-bbf1-293fb0e866a7 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: cdde7779-a327-416c-863c-cd50d4d11c47] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:03.439796 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5d3cc8b7-19c3-48e3-bbf1-293fb0e866a7 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:03.441108 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5d3cc8b7-19c3-48e3-bbf1-293fb0e866a7 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:03.441820 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5d3cc8b7-19c3-48e3-bbf1-293fb0e866a7 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:03.442796 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5d3cc8b7-19c3-48e3-bbf1-293fb0e866a7 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:03.443446 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5d3cc8b7-19c3-48e3-bbf1-293fb0e866a7 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:03.444227 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5d3cc8b7-19c3-48e3-bbf1-293fb0e866a7 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:03.558068 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:58:03.593604 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5bbaff33-384f-4d66-afbb-fb94f6b78e0c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:03.596963 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=100 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:58:03.606555 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5bbaff33-384f-4d66-afbb-fb94f6b78e0c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef" status: 200 len: 1309 microversion: 2.1 time: 0.562428 Oct 17 13:58:03.609374 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2459/4786] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:03 2022] GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef => generated 1309 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:03.812687 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5d3cc8b7-19c3-48e3-bbf1-293fb0e866a7 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:03.824497 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5d3cc8b7-19c3-48e3-bbf1-293fb0e866a7 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47" status: 200 len: 1504 microversion: 2.1 time: 0.402173 Oct 17 13:58:03.825778 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2328/4787] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:03 2022] GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47 => generated 1504 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:58:04.074246 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-580b74ab-fbdf-4bc2-be50-6763793a1e40 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:04.074948 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-580b74ab-fbdf-4bc2-be50-6763793a1e40 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: ad70195b-4a02-4a69-b6da-1f19fc3a51cd] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:04.091157 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-580b74ab-fbdf-4bc2-be50-6763793a1e40 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:04.091992 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-580b74ab-fbdf-4bc2-be50-6763793a1e40 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:04.092993 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-580b74ab-fbdf-4bc2-be50-6763793a1e40 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:04.093885 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-580b74ab-fbdf-4bc2-be50-6763793a1e40 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:04.095972 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-580b74ab-fbdf-4bc2-be50-6763793a1e40 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:04.096662 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-580b74ab-fbdf-4bc2-be50-6763793a1e40 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:04.130180 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-08cd7747-2be0-48fa-8b88-6d107c7c6625 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:04.130781 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-08cd7747-2be0-48fa-8b88-6d107c7c6625 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 6d2bbd26-cb90-4e90-881f-a9346ee3002a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:04.139571 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-08cd7747-2be0-48fa-8b88-6d107c7c6625 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:04.140170 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-08cd7747-2be0-48fa-8b88-6d107c7c6625 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:04.141415 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-08cd7747-2be0-48fa-8b88-6d107c7c6625 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:04.144431 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-08cd7747-2be0-48fa-8b88-6d107c7c6625 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:04.145033 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-08cd7747-2be0-48fa-8b88-6d107c7c6625 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:04.147060 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-08cd7747-2be0-48fa-8b88-6d107c7c6625 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:04.515094 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-580b74ab-fbdf-4bc2-be50-6763793a1e40 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:04.524216 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-580b74ab-fbdf-4bc2-be50-6763793a1e40 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd" status: 200 len: 1314 microversion: 2.1 time: 0.456664 Oct 17 13:58:04.525400 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2460/4788] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:04 2022] GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd => generated 1314 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:04.563840 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-08cd7747-2be0-48fa-8b88-6d107c7c6625 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:04.577080 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-08cd7747-2be0-48fa-8b88-6d107c7c6625 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a" status: 200 len: 1509 microversion: 2.1 time: 0.450746 Oct 17 13:58:04.578635 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2329/4789] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:04 2022] GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a => generated 1509 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:58:04.636101 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a08f2da0-8c58-4106-9e13-e594e8b2d58c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:04.637003 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a08f2da0-8c58-4106-9e13-e594e8b2d58c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: c7875373-8b55-4b5a-b6be-9ce42c255eef] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:04.645511 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a08f2da0-8c58-4106-9e13-e594e8b2d58c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:04.648402 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a08f2da0-8c58-4106-9e13-e594e8b2d58c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:04.649043 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a08f2da0-8c58-4106-9e13-e594e8b2d58c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:04.650324 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a08f2da0-8c58-4106-9e13-e594e8b2d58c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:04.650955 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a08f2da0-8c58-4106-9e13-e594e8b2d58c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:04.652433 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a08f2da0-8c58-4106-9e13-e594e8b2d58c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:04.835666 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a08f2da0-8c58-4106-9e13-e594e8b2d58c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:04.843915 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a08f2da0-8c58-4106-9e13-e594e8b2d58c tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef" status: 200 len: 1309 microversion: 2.1 time: 0.213325 Oct 17 13:58:04.844775 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2461/4790] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:04 2022] GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef => generated 1309 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:04.866129 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7d8451bd-dde4-4458-982a-da63b6ae7c81 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:04.867417 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7d8451bd-dde4-4458-982a-da63b6ae7c81 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: cdde7779-a327-416c-863c-cd50d4d11c47] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:04.875378 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7d8451bd-dde4-4458-982a-da63b6ae7c81 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:04.876366 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7d8451bd-dde4-4458-982a-da63b6ae7c81 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:04.876985 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7d8451bd-dde4-4458-982a-da63b6ae7c81 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:04.878069 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7d8451bd-dde4-4458-982a-da63b6ae7c81 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:04.878846 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7d8451bd-dde4-4458-982a-da63b6ae7c81 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:04.880262 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7d8451bd-dde4-4458-982a-da63b6ae7c81 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:04.902868 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-b7b0da87-4f57-449a-bda5-038e18def3b5 req-c08e97ed-3226-412e-9b6d-d12faba63bdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7875373-8b55-4b5a-b6be-9ce42c255eef", "tag": "46f8b925-bc30-40e7-9af9-4f13a6c24f9c"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:58:04.927272 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-b7b0da87-4f57-449a-bda5-038e18def3b5 req-c08e97ed-3226-412e-9b6d-d12faba63bdd service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:04.927869 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-b7b0da87-4f57-449a-bda5-038e18def3b5 req-c08e97ed-3226-412e-9b6d-d12faba63bdd service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:04.928454 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-b7b0da87-4f57-449a-bda5-038e18def3b5 req-c08e97ed-3226-412e-9b6d-d12faba63bdd service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:04.952488 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-b7b0da87-4f57-449a-bda5-038e18def3b5 req-c08e97ed-3226-412e-9b6d-d12faba63bdd service nova] Creating event network-changed:46f8b925-bc30-40e7-9af9-4f13a6c24f9c for instance c7875373-8b55-4b5a-b6be-9ce42c255eef on n-h1-854247-14 Oct 17 13:58:04.968053 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-b7b0da87-4f57-449a-bda5-038e18def3b5 req-c08e97ed-3226-412e-9b6d-d12faba63bdd service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070931 Oct 17 13:58:04.968983 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2462/4791] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:58:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:58:05.057127 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7d8451bd-dde4-4458-982a-da63b6ae7c81 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:05.068884 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7d8451bd-dde4-4458-982a-da63b6ae7c81 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47" status: 200 len: 1504 microversion: 2.1 time: 0.209090 Oct 17 13:58:05.070304 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2330/4792] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:04 2022] GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47 => generated 1504 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:05.555605 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9d7ab9ad-2e81-4d76-9464-a66cb32a2256 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:05.558554 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9d7ab9ad-2e81-4d76-9464-a66cb32a2256 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: ad70195b-4a02-4a69-b6da-1f19fc3a51cd] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:05.565588 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:58:05.568538 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9d7ab9ad-2e81-4d76-9464-a66cb32a2256 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:05.569117 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9d7ab9ad-2e81-4d76-9464-a66cb32a2256 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:05.569834 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9d7ab9ad-2e81-4d76-9464-a66cb32a2256 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:05.570493 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9d7ab9ad-2e81-4d76-9464-a66cb32a2256 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:05.571152 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9d7ab9ad-2e81-4d76-9464-a66cb32a2256 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:05.571679 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9d7ab9ad-2e81-4d76-9464-a66cb32a2256 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:05.603043 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6c626ddb-9824-4a18-a829-4e5d259f0c65 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:05.604484 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6c626ddb-9824-4a18-a829-4e5d259f0c65 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 6d2bbd26-cb90-4e90-881f-a9346ee3002a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:05.613596 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6c626ddb-9824-4a18-a829-4e5d259f0c65 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:05.614204 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6c626ddb-9824-4a18-a829-4e5d259f0c65 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:05.614824 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6c626ddb-9824-4a18-a829-4e5d259f0c65 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:05.615665 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6c626ddb-9824-4a18-a829-4e5d259f0c65 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:05.616563 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6c626ddb-9824-4a18-a829-4e5d259f0c65 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:05.617239 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6c626ddb-9824-4a18-a829-4e5d259f0c65 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:06.443640 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6c626ddb-9824-4a18-a829-4e5d259f0c65 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:06.459038 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6c626ddb-9824-4a18-a829-4e5d259f0c65 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a" status: 200 len: 1509 microversion: 2.1 time: 0.856741 Oct 17 13:58:06.464973 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9d7ab9ad-2e81-4d76-9464-a66cb32a2256 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:06.468852 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2331/4793] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:05 2022] GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a => generated 1509 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:58:06.490310 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9d7ab9ad-2e81-4d76-9464-a66cb32a2256 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd" status: 200 len: 1314 microversion: 2.1 time: 0.945277 Oct 17 13:58:06.495264 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2463/4794] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:05 2022] GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd => generated 1314 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:06.499812 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c913c227-ae83-414d-8d6a-50acc876703a tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:06.503712 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c913c227-ae83-414d-8d6a-50acc876703a tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: c7875373-8b55-4b5a-b6be-9ce42c255eef] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:06.508276 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5cf5ad1f-9f5b-4368-b2ac-2c6b8b4f2908 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:06.510090 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5cf5ad1f-9f5b-4368-b2ac-2c6b8b4f2908 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: cdde7779-a327-416c-863c-cd50d4d11c47] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:06.518217 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c913c227-ae83-414d-8d6a-50acc876703a tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:06.520888 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c913c227-ae83-414d-8d6a-50acc876703a tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:06.522124 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c913c227-ae83-414d-8d6a-50acc876703a tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:06.523504 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c913c227-ae83-414d-8d6a-50acc876703a tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:06.525786 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c913c227-ae83-414d-8d6a-50acc876703a tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:06.527564 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c913c227-ae83-414d-8d6a-50acc876703a tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:06.528031 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5cf5ad1f-9f5b-4368-b2ac-2c6b8b4f2908 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:06.530275 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5cf5ad1f-9f5b-4368-b2ac-2c6b8b4f2908 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:06.536329 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5cf5ad1f-9f5b-4368-b2ac-2c6b8b4f2908 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:06.537471 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5cf5ad1f-9f5b-4368-b2ac-2c6b8b4f2908 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:06.538168 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5cf5ad1f-9f5b-4368-b2ac-2c6b8b4f2908 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:06.538827 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5cf5ad1f-9f5b-4368-b2ac-2c6b8b4f2908 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:06.937834 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5cf5ad1f-9f5b-4368-b2ac-2c6b8b4f2908 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:06.948307 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c913c227-ae83-414d-8d6a-50acc876703a tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:06.952001 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5cf5ad1f-9f5b-4368-b2ac-2c6b8b4f2908 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47" status: 200 len: 1504 microversion: 2.1 time: 0.451185 Oct 17 13:58:06.953120 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2464/4795] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:06 2022] GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47 => generated 1504 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:06.958014 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c913c227-ae83-414d-8d6a-50acc876703a tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef" status: 200 len: 1309 microversion: 2.1 time: 0.487755 Oct 17 13:58:06.961901 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2332/4796] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:06 2022] GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef => generated 1309 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:06.962291 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-1e5e701d-32a2-4b08-86b5-bf3c51c10465 req-a09813db-4ee6-4737-910e-58b8fa79440d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad70195b-4a02-4a69-b6da-1f19fc3a51cd", "name": "network-vif-plugged", "status": "completed", "tag": "6f5c8902-466c-4ca2-9d94-db58249199e2"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:58:06.972199 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-1e5e701d-32a2-4b08-86b5-bf3c51c10465 req-a09813db-4ee6-4737-910e-58b8fa79440d service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:06.972820 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-1e5e701d-32a2-4b08-86b5-bf3c51c10465 req-a09813db-4ee6-4737-910e-58b8fa79440d service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:06.973332 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-1e5e701d-32a2-4b08-86b5-bf3c51c10465 req-a09813db-4ee6-4737-910e-58b8fa79440d service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:06.995068 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-1e5e701d-32a2-4b08-86b5-bf3c51c10465 req-a09813db-4ee6-4737-910e-58b8fa79440d service nova] Creating event network-vif-plugged:6f5c8902-466c-4ca2-9d94-db58249199e2 for instance ad70195b-4a02-4a69-b6da-1f19fc3a51cd on n-h1-854247-14 Oct 17 13:58:07.002996 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-1e5e701d-32a2-4b08-86b5-bf3c51c10465 req-a09813db-4ee6-4737-910e-58b8fa79440d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046126 Oct 17 13:58:07.008370 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2465/4797] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:58:07.483555 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4bc6d1ab-ac44-4006-ba15-143c899e3fd3 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:07.484983 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4bc6d1ab-ac44-4006-ba15-143c899e3fd3 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 6d2bbd26-cb90-4e90-881f-a9346ee3002a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:07.493352 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4bc6d1ab-ac44-4006-ba15-143c899e3fd3 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:07.494133 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4bc6d1ab-ac44-4006-ba15-143c899e3fd3 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:07.494721 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4bc6d1ab-ac44-4006-ba15-143c899e3fd3 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:07.495906 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4bc6d1ab-ac44-4006-ba15-143c899e3fd3 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:07.496514 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4bc6d1ab-ac44-4006-ba15-143c899e3fd3 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:07.497130 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4bc6d1ab-ac44-4006-ba15-143c899e3fd3 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:07.520970 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5d03df82-671b-485f-b794-d5d93e2d872f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:07.522046 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5d03df82-671b-485f-b794-d5d93e2d872f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: ad70195b-4a02-4a69-b6da-1f19fc3a51cd] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:07.533033 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5d03df82-671b-485f-b794-d5d93e2d872f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:07.533524 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5d03df82-671b-485f-b794-d5d93e2d872f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:07.534151 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5d03df82-671b-485f-b794-d5d93e2d872f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:07.535315 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5d03df82-671b-485f-b794-d5d93e2d872f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:07.535774 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5d03df82-671b-485f-b794-d5d93e2d872f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:07.536197 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5d03df82-671b-485f-b794-d5d93e2d872f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:07.945201 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4bc6d1ab-ac44-4006-ba15-143c899e3fd3 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:07.954455 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4bc6d1ab-ac44-4006-ba15-143c899e3fd3 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a" status: 200 len: 1509 microversion: 2.1 time: 0.474792 Oct 17 13:58:07.958163 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5d03df82-671b-485f-b794-d5d93e2d872f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:07.982902 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5d03df82-671b-485f-b794-d5d93e2d872f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd" status: 200 len: 1314 microversion: 2.1 time: 0.467085 Oct 17 13:58:07.997540 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2466/4798] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:07 2022] GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd => generated 1314 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:08.010052 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2e6171b6-937d-437f-9b03-bae08a6ad592 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:08.010206 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2333/4799] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:07 2022] GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a => generated 1509 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:08.010701 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2e6171b6-937d-437f-9b03-bae08a6ad592 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: cdde7779-a327-416c-863c-cd50d4d11c47] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:08.018806 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2e6171b6-937d-437f-9b03-bae08a6ad592 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:08.019648 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2e6171b6-937d-437f-9b03-bae08a6ad592 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:08.020106 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2e6171b6-937d-437f-9b03-bae08a6ad592 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:08.020839 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2e6171b6-937d-437f-9b03-bae08a6ad592 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:08.021481 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2e6171b6-937d-437f-9b03-bae08a6ad592 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:08.021919 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2e6171b6-937d-437f-9b03-bae08a6ad592 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:08.028471 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-63c0473b-d20a-4d02-8b9e-0e0391bb8c39 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:08.030657 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-63c0473b-d20a-4d02-8b9e-0e0391bb8c39 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: c7875373-8b55-4b5a-b6be-9ce42c255eef] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:08.051046 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-63c0473b-d20a-4d02-8b9e-0e0391bb8c39 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:08.063624 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-63c0473b-d20a-4d02-8b9e-0e0391bb8c39 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:08.064431 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-63c0473b-d20a-4d02-8b9e-0e0391bb8c39 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:08.064893 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-63c0473b-d20a-4d02-8b9e-0e0391bb8c39 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:08.065430 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-63c0473b-d20a-4d02-8b9e-0e0391bb8c39 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:08.070639 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-63c0473b-d20a-4d02-8b9e-0e0391bb8c39 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:08.550900 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2e6171b6-937d-437f-9b03-bae08a6ad592 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:08.555501 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-63c0473b-d20a-4d02-8b9e-0e0391bb8c39 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:08.567104 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-63c0473b-d20a-4d02-8b9e-0e0391bb8c39 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef" status: 200 len: 1309 microversion: 2.1 time: 0.555185 Oct 17 13:58:08.582818 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2334/4800] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:08 2022] GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef => generated 1309 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:08.586231 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2e6171b6-937d-437f-9b03-bae08a6ad592 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47" status: 200 len: 1504 microversion: 2.1 time: 0.587323 Oct 17 13:58:08.593635 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2467/4801] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:07 2022] GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47 => generated 1504 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:08.982033 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-430822b5-90cf-41e8-9f0f-ccc586b85c8c tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:08.982735 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-430822b5-90cf-41e8-9f0f-ccc586b85c8c tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 6d2bbd26-cb90-4e90-881f-a9346ee3002a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:08.985650 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=4 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:58:08.998362 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-430822b5-90cf-41e8-9f0f-ccc586b85c8c tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:08.999220 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-430822b5-90cf-41e8-9f0f-ccc586b85c8c tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:08.999897 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-430822b5-90cf-41e8-9f0f-ccc586b85c8c tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:09.000775 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-430822b5-90cf-41e8-9f0f-ccc586b85c8c tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:09.001483 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-430822b5-90cf-41e8-9f0f-ccc586b85c8c tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:09.002063 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-430822b5-90cf-41e8-9f0f-ccc586b85c8c tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:09.013155 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6f494153-84e7-4416-a566-447f27a4e07d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:09.014080 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6f494153-84e7-4416-a566-447f27a4e07d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: ad70195b-4a02-4a69-b6da-1f19fc3a51cd] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:09.027066 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6f494153-84e7-4416-a566-447f27a4e07d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:09.027800 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6f494153-84e7-4416-a566-447f27a4e07d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:09.028358 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6f494153-84e7-4416-a566-447f27a4e07d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:09.029477 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6f494153-84e7-4416-a566-447f27a4e07d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:09.030054 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6f494153-84e7-4416-a566-447f27a4e07d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:09.032172 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6f494153-84e7-4416-a566-447f27a4e07d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:09.126409 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=14 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:58:09.503664 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6f494153-84e7-4416-a566-447f27a4e07d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:09.517111 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6f494153-84e7-4416-a566-447f27a4e07d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd" status: 200 len: 1314 microversion: 2.1 time: 0.508099 Oct 17 13:58:09.518416 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2468/4802] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:09 2022] GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd => generated 1314 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:09.554514 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-430822b5-90cf-41e8-9f0f-ccc586b85c8c tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:09.563027 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-430822b5-90cf-41e8-9f0f-ccc586b85c8c tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a" status: 200 len: 1509 microversion: 2.1 time: 0.584969 Oct 17 13:58:09.564218 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2335/4803] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:08 2022] GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a => generated 1509 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:09.595994 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9b53b2a3-d26b-4bc8-84cf-64410827b7f7 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:09.598817 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9b53b2a3-d26b-4bc8-84cf-64410827b7f7 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: c7875373-8b55-4b5a-b6be-9ce42c255eef] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:09.616054 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-de127db7-0086-4e5f-85a8-2b319893cdd3 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:09.617079 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-de127db7-0086-4e5f-85a8-2b319893cdd3 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: cdde7779-a327-416c-863c-cd50d4d11c47] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:09.632906 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-de127db7-0086-4e5f-85a8-2b319893cdd3 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:09.634365 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-de127db7-0086-4e5f-85a8-2b319893cdd3 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:09.637265 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9b53b2a3-d26b-4bc8-84cf-64410827b7f7 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:09.637592 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-de127db7-0086-4e5f-85a8-2b319893cdd3 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:09.638277 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9b53b2a3-d26b-4bc8-84cf-64410827b7f7 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:09.639394 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9b53b2a3-d26b-4bc8-84cf-64410827b7f7 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:09.639957 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-de127db7-0086-4e5f-85a8-2b319893cdd3 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:09.640587 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-de127db7-0086-4e5f-85a8-2b319893cdd3 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:09.642373 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9b53b2a3-d26b-4bc8-84cf-64410827b7f7 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:09.642958 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-de127db7-0086-4e5f-85a8-2b319893cdd3 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:09.643729 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9b53b2a3-d26b-4bc8-84cf-64410827b7f7 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:09.647279 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9b53b2a3-d26b-4bc8-84cf-64410827b7f7 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:09.700103 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:58:10.449552 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9b53b2a3-d26b-4bc8-84cf-64410827b7f7 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:10.453933 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-de127db7-0086-4e5f-85a8-2b319893cdd3 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:10.461370 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9b53b2a3-d26b-4bc8-84cf-64410827b7f7 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef" status: 200 len: 1309 microversion: 2.1 time: 0.873035 Oct 17 13:58:10.476574 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2469/4804] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:09 2022] GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef => generated 1309 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:10.479726 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-de127db7-0086-4e5f-85a8-2b319893cdd3 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47" status: 200 len: 1504 microversion: 2.1 time: 0.869264 Oct 17 13:58:10.514984 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2336/4805] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:09 2022] GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47 => generated 1504 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:10.544114 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ce04ac3a-cb2c-4e53-b7ff-dfa1f454377f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:10.544974 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ce04ac3a-cb2c-4e53-b7ff-dfa1f454377f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: ad70195b-4a02-4a69-b6da-1f19fc3a51cd] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:10.555733 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ce04ac3a-cb2c-4e53-b7ff-dfa1f454377f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:10.556415 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ce04ac3a-cb2c-4e53-b7ff-dfa1f454377f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:10.557797 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ce04ac3a-cb2c-4e53-b7ff-dfa1f454377f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:10.558777 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ce04ac3a-cb2c-4e53-b7ff-dfa1f454377f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:10.559474 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ce04ac3a-cb2c-4e53-b7ff-dfa1f454377f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:10.560182 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ce04ac3a-cb2c-4e53-b7ff-dfa1f454377f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:10.590944 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-55e3ac34-26eb-4e9f-848e-1cee32c2523f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:10.592068 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-55e3ac34-26eb-4e9f-848e-1cee32c2523f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 6d2bbd26-cb90-4e90-881f-a9346ee3002a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:10.606486 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-55e3ac34-26eb-4e9f-848e-1cee32c2523f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:10.607874 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-55e3ac34-26eb-4e9f-848e-1cee32c2523f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:10.608555 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-55e3ac34-26eb-4e9f-848e-1cee32c2523f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:10.609581 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-55e3ac34-26eb-4e9f-848e-1cee32c2523f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:10.610310 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-55e3ac34-26eb-4e9f-848e-1cee32c2523f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:10.611087 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-55e3ac34-26eb-4e9f-848e-1cee32c2523f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:11.150517 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-55e3ac34-26eb-4e9f-848e-1cee32c2523f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:11.160510 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-55e3ac34-26eb-4e9f-848e-1cee32c2523f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a" status: 200 len: 1509 microversion: 2.1 time: 0.577743 Oct 17 13:58:11.161126 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2337/4806] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:10 2022] GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a => generated 1509 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:11.176131 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-322ed282-9d25-4fe7-9585-c341479d8dbb req-5679e192-db2a-4c30-8d82-55aff2c7f68c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7875373-8b55-4b5a-b6be-9ce42c255eef", "name": "network-vif-plugged", "status": "completed", "tag": "46f8b925-bc30-40e7-9af9-4f13a6c24f9c"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:58:11.177969 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ce04ac3a-cb2c-4e53-b7ff-dfa1f454377f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:11.200476 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-322ed282-9d25-4fe7-9585-c341479d8dbb req-5679e192-db2a-4c30-8d82-55aff2c7f68c service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:11.203808 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-322ed282-9d25-4fe7-9585-c341479d8dbb req-5679e192-db2a-4c30-8d82-55aff2c7f68c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:11.204803 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-322ed282-9d25-4fe7-9585-c341479d8dbb req-5679e192-db2a-4c30-8d82-55aff2c7f68c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:11.211588 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ce04ac3a-cb2c-4e53-b7ff-dfa1f454377f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd" status: 200 len: 1500 microversion: 2.1 time: 0.673882 Oct 17 13:58:11.216277 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2470/4807] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:10 2022] GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd => generated 1500 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:11.234857 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-322ed282-9d25-4fe7-9585-c341479d8dbb req-5679e192-db2a-4c30-8d82-55aff2c7f68c service nova] Creating event network-vif-plugged:46f8b925-bc30-40e7-9af9-4f13a6c24f9c for instance c7875373-8b55-4b5a-b6be-9ce42c255eef on n-h1-854247-14 Oct 17 13:58:11.240414 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c56a82b4-9fdf-4b88-bda6-8d195a13ede3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:58:11.241394 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c56a82b4-9fdf-4b88-bda6-8d195a13ede3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: ad70195b-4a02-4a69-b6da-1f19fc3a51cd] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:11.248887 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-322ed282-9d25-4fe7-9585-c341479d8dbb req-5679e192-db2a-4c30-8d82-55aff2c7f68c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085182 Oct 17 13:58:11.254580 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c56a82b4-9fdf-4b88-bda6-8d195a13ede3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:11.257600 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c56a82b4-9fdf-4b88-bda6-8d195a13ede3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:11.258824 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c56a82b4-9fdf-4b88-bda6-8d195a13ede3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:11.260965 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c56a82b4-9fdf-4b88-bda6-8d195a13ede3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:11.261607 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c56a82b4-9fdf-4b88-bda6-8d195a13ede3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:11.262200 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c56a82b4-9fdf-4b88-bda6-8d195a13ede3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:11.266718 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2338/4808] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:58:11.353201 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c56a82b4-9fdf-4b88-bda6-8d195a13ede3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "POST /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd/action" status: 202 len: 0 microversion: 2.1 time: 0.115728 Oct 17 13:58:11.357164 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2471/4809] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:58:11 2022] POST /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:58:11.373579 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9bf95089-769c-4100-9ec7-c8904cead735 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:11.374531 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9bf95089-769c-4100-9ec7-c8904cead735 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: ad70195b-4a02-4a69-b6da-1f19fc3a51cd] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:11.387324 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9bf95089-769c-4100-9ec7-c8904cead735 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:11.388950 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9bf95089-769c-4100-9ec7-c8904cead735 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:11.389600 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9bf95089-769c-4100-9ec7-c8904cead735 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:11.390841 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9bf95089-769c-4100-9ec7-c8904cead735 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:11.391783 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9bf95089-769c-4100-9ec7-c8904cead735 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:11.392884 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9bf95089-769c-4100-9ec7-c8904cead735 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:11.488256 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-39b95616-5886-4a13-9962-295e8c20fc3d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:11.489143 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-39b95616-5886-4a13-9962-295e8c20fc3d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: c7875373-8b55-4b5a-b6be-9ce42c255eef] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:11.499726 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-39b95616-5886-4a13-9962-295e8c20fc3d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:11.502777 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-39b95616-5886-4a13-9962-295e8c20fc3d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:11.509586 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-39b95616-5886-4a13-9962-295e8c20fc3d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:11.510801 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-39b95616-5886-4a13-9962-295e8c20fc3d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:11.511648 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-39b95616-5886-4a13-9962-295e8c20fc3d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:11.512341 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-39b95616-5886-4a13-9962-295e8c20fc3d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:11.864302 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9bf95089-769c-4100-9ec7-c8904cead735 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:11.883954 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-39b95616-5886-4a13-9962-295e8c20fc3d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:11.896822 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-39b95616-5886-4a13-9962-295e8c20fc3d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef" status: 200 len: 1309 microversion: 2.1 time: 0.414362 Oct 17 13:58:11.897241 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2472/4810] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:11 2022] GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef => generated 1309 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:11.904437 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9bf95089-769c-4100-9ec7-c8904cead735 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd" status: 200 len: 1505 microversion: 2.1 time: 0.544716 Oct 17 13:58:11.906039 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2339/4811] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:11 2022] GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd => generated 1505 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:11.918120 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-da2a79cf-2eb9-4494-95aa-99d146c896b3 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:11.918749 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-da2a79cf-2eb9-4494-95aa-99d146c896b3 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: cdde7779-a327-416c-863c-cd50d4d11c47] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:11.927118 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-da2a79cf-2eb9-4494-95aa-99d146c896b3 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:11.927648 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-da2a79cf-2eb9-4494-95aa-99d146c896b3 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:11.928326 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-da2a79cf-2eb9-4494-95aa-99d146c896b3 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:11.929841 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-da2a79cf-2eb9-4494-95aa-99d146c896b3 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:11.930486 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-da2a79cf-2eb9-4494-95aa-99d146c896b3 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:11.931091 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-da2a79cf-2eb9-4494-95aa-99d146c896b3 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:12.191900 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-aa7dd877-023d-4796-bc9c-9f81c0ff07ba tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:12.195439 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-aa7dd877-023d-4796-bc9c-9f81c0ff07ba tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 6d2bbd26-cb90-4e90-881f-a9346ee3002a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:12.202458 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aa7dd877-023d-4796-bc9c-9f81c0ff07ba tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:12.203453 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aa7dd877-023d-4796-bc9c-9f81c0ff07ba tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:12.204158 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aa7dd877-023d-4796-bc9c-9f81c0ff07ba tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:12.205051 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aa7dd877-023d-4796-bc9c-9f81c0ff07ba tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:12.205910 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aa7dd877-023d-4796-bc9c-9f81c0ff07ba tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:12.206498 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aa7dd877-023d-4796-bc9c-9f81c0ff07ba tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:12.414600 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-da2a79cf-2eb9-4494-95aa-99d146c896b3 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:12.430788 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-da2a79cf-2eb9-4494-95aa-99d146c896b3 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47" status: 200 len: 1484 microversion: 2.1 time: 0.517288 Oct 17 13:58:12.434134 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2473/4812] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:11 2022] GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47 => generated 1484 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:12.464586 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-dc492cc1-baf4-45c9-8d83-1cf056b15f4d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:58:12.466125 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-dc492cc1-baf4-45c9-8d83-1cf056b15f4d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: cdde7779-a327-416c-863c-cd50d4d11c47] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:12.474306 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc492cc1-baf4-45c9-8d83-1cf056b15f4d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:12.475154 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc492cc1-baf4-45c9-8d83-1cf056b15f4d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:12.475760 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc492cc1-baf4-45c9-8d83-1cf056b15f4d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:12.476764 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc492cc1-baf4-45c9-8d83-1cf056b15f4d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:12.477797 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc492cc1-baf4-45c9-8d83-1cf056b15f4d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:12.478478 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc492cc1-baf4-45c9-8d83-1cf056b15f4d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:12.612627 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-dc492cc1-baf4-45c9-8d83-1cf056b15f4d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "POST /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47/action" status: 202 len: 0 microversion: 2.1 time: 0.151258 Oct 17 13:58:12.616778 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2474/4813] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:58:12 2022] POST /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:58:12.637265 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-01813788-28a3-4e9d-b3ae-817222afab4b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:12.639310 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-01813788-28a3-4e9d-b3ae-817222afab4b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: cdde7779-a327-416c-863c-cd50d4d11c47] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:12.659531 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-01813788-28a3-4e9d-b3ae-817222afab4b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:12.660403 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-01813788-28a3-4e9d-b3ae-817222afab4b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:12.661187 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-01813788-28a3-4e9d-b3ae-817222afab4b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:12.662928 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-01813788-28a3-4e9d-b3ae-817222afab4b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:12.663671 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-01813788-28a3-4e9d-b3ae-817222afab4b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:12.664213 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-01813788-28a3-4e9d-b3ae-817222afab4b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:12.677929 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-aa7dd877-023d-4796-bc9c-9f81c0ff07ba tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:12.691143 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-aa7dd877-023d-4796-bc9c-9f81c0ff07ba tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a" status: 200 len: 1509 microversion: 2.1 time: 0.501941 Oct 17 13:58:12.692062 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2340/4814] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:12 2022] GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a => generated 1509 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:12.925031 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d161e0ab-6403-4982-a6d5-6f117e9bf042 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:12.925870 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d161e0ab-6403-4982-a6d5-6f117e9bf042 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: c7875373-8b55-4b5a-b6be-9ce42c255eef] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:12.934736 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d161e0ab-6403-4982-a6d5-6f117e9bf042 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:12.935466 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d161e0ab-6403-4982-a6d5-6f117e9bf042 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:12.936060 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d161e0ab-6403-4982-a6d5-6f117e9bf042 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:12.936948 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d161e0ab-6403-4982-a6d5-6f117e9bf042 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:12.937581 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d161e0ab-6403-4982-a6d5-6f117e9bf042 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:12.938161 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d161e0ab-6403-4982-a6d5-6f117e9bf042 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:13.189986 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-01813788-28a3-4e9d-b3ae-817222afab4b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:13.193170 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:58:13.203970 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-01813788-28a3-4e9d-b3ae-817222afab4b tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47" status: 200 len: 1492 microversion: 2.1 time: 0.583528 Oct 17 13:58:13.204805 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2475/4815] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:12 2022] GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47 => generated 1492 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:13.210873 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-30e9464d-eb85-491b-82d8-8e639a25d463 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:13.211515 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-30e9464d-eb85-491b-82d8-8e639a25d463 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: ad70195b-4a02-4a69-b6da-1f19fc3a51cd] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:13.238499 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-30e9464d-eb85-491b-82d8-8e639a25d463 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:13.240900 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-30e9464d-eb85-491b-82d8-8e639a25d463 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:13.242548 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-30e9464d-eb85-491b-82d8-8e639a25d463 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:13.250560 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-30e9464d-eb85-491b-82d8-8e639a25d463 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:13.251343 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-30e9464d-eb85-491b-82d8-8e639a25d463 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:13.252829 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-30e9464d-eb85-491b-82d8-8e639a25d463 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:13.328492 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d161e0ab-6403-4982-a6d5-6f117e9bf042 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:13.343894 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d161e0ab-6403-4982-a6d5-6f117e9bf042 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef" status: 200 len: 1490 microversion: 2.1 time: 0.423831 Oct 17 13:58:13.344476 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2341/4816] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:12 2022] GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef => generated 1490 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:13.366683 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-766b7e7d-d580-4d03-86c9-86f7e4ac866d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1957052986"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:58:13.370688 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-766b7e7d-d580-4d03-86c9-86f7e4ac866d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: c7875373-8b55-4b5a-b6be-9ce42c255eef] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:13.376690 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:58:13.379581 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-766b7e7d-d580-4d03-86c9-86f7e4ac866d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:13.380342 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-766b7e7d-d580-4d03-86c9-86f7e4ac866d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:13.381000 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-766b7e7d-d580-4d03-86c9-86f7e4ac866d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:13.382038 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-766b7e7d-d580-4d03-86c9-86f7e4ac866d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:13.382910 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-766b7e7d-d580-4d03-86c9-86f7e4ac866d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:13.383718 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-766b7e7d-d580-4d03-86c9-86f7e4ac866d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:13.536947 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-766b7e7d-d580-4d03-86c9-86f7e4ac866d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "PUT /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef" status: 200 len: 1075 microversion: 2.1 time: 0.174122 Oct 17 13:58:13.552542 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2342/4817] 10.222.0.79 () {60 vars in 1256 bytes} [Mon Oct 17 13:58:13 2022] PUT /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef => generated 1075 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:58:13.558282 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f6c4a696-5e40-4dc2-8006-18203e07dfbd tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:13.558900 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f6c4a696-5e40-4dc2-8006-18203e07dfbd tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: c7875373-8b55-4b5a-b6be-9ce42c255eef] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:13.573564 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f6c4a696-5e40-4dc2-8006-18203e07dfbd tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:13.573908 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f6c4a696-5e40-4dc2-8006-18203e07dfbd tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:13.574343 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f6c4a696-5e40-4dc2-8006-18203e07dfbd tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:13.575042 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f6c4a696-5e40-4dc2-8006-18203e07dfbd tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:13.575526 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f6c4a696-5e40-4dc2-8006-18203e07dfbd tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:13.575946 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f6c4a696-5e40-4dc2-8006-18203e07dfbd tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:13.720138 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-30e9464d-eb85-491b-82d8-8e639a25d463 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:13.732757 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-30e9464d-eb85-491b-82d8-8e639a25d463 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd" status: 200 len: 1485 microversion: 2.1 time: 0.525821 Oct 17 13:58:13.734518 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2476/4818] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:13 2022] GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd => generated 1485 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:13.751010 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ce49bda5-04f0-40b7-95b7-0a454ce25c54 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:13.752104 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ce49bda5-04f0-40b7-95b7-0a454ce25c54 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 6d2bbd26-cb90-4e90-881f-a9346ee3002a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:13.760868 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ce49bda5-04f0-40b7-95b7-0a454ce25c54 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:13.761875 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ce49bda5-04f0-40b7-95b7-0a454ce25c54 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:13.762417 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ce49bda5-04f0-40b7-95b7-0a454ce25c54 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:13.763455 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ce49bda5-04f0-40b7-95b7-0a454ce25c54 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:13.764024 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ce49bda5-04f0-40b7-95b7-0a454ce25c54 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:13.764669 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ce49bda5-04f0-40b7-95b7-0a454ce25c54 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:13.984169 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f6c4a696-5e40-4dc2-8006-18203e07dfbd tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:13.993191 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f6c4a696-5e40-4dc2-8006-18203e07dfbd tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef" status: 200 len: 1501 microversion: 2.1 time: 0.439131 Oct 17 13:58:14.003150 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2343/4819] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:13 2022] GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef => generated 1501 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:58:14.009170 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-10799104-0ba7-45b7-9508-6b09277c6d84 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:58:14.010079 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-10799104-0ba7-45b7-9508-6b09277c6d84 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: ad70195b-4a02-4a69-b6da-1f19fc3a51cd] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:14.017230 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-10799104-0ba7-45b7-9508-6b09277c6d84 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:14.017933 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-10799104-0ba7-45b7-9508-6b09277c6d84 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:14.018790 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-10799104-0ba7-45b7-9508-6b09277c6d84 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:14.020257 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-10799104-0ba7-45b7-9508-6b09277c6d84 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:14.020731 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-10799104-0ba7-45b7-9508-6b09277c6d84 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:14.021147 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-10799104-0ba7-45b7-9508-6b09277c6d84 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:14.051886 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-10799104-0ba7-45b7-9508-6b09277c6d84 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lazy-loading 'flavor' on Instance uuid ad70195b-4a02-4a69-b6da-1f19fc3a51cd {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:58:14.202033 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ce49bda5-04f0-40b7-95b7-0a454ce25c54 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:14.222031 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ce49bda5-04f0-40b7-95b7-0a454ce25c54 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a" status: 200 len: 1509 microversion: 2.1 time: 0.481275 Oct 17 13:58:14.223527 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2477/4820] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:13 2022] GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a => generated 1509 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:14.233074 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-856a9cf1-2fb1-40a1-8357-c1b84b247a81 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:14.234810 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-856a9cf1-2fb1-40a1-8357-c1b84b247a81 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: c7875373-8b55-4b5a-b6be-9ce42c255eef] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:14.248005 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-856a9cf1-2fb1-40a1-8357-c1b84b247a81 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:14.251251 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-856a9cf1-2fb1-40a1-8357-c1b84b247a81 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:14.253110 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-856a9cf1-2fb1-40a1-8357-c1b84b247a81 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:14.254784 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-856a9cf1-2fb1-40a1-8357-c1b84b247a81 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:14.257714 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-856a9cf1-2fb1-40a1-8357-c1b84b247a81 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:14.259124 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-856a9cf1-2fb1-40a1-8357-c1b84b247a81 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:14.414253 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-10799104-0ba7-45b7-9508-6b09277c6d84 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "POST /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd/action" status: 202 len: 0 microversion: 2.1 time: 0.409122 Oct 17 13:58:14.415963 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2344/4821] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:58:14 2022] POST /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd/action => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:58:14.431950 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-762f0d5b-458a-42d8-88ca-754505e114fa tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:14.432765 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-762f0d5b-458a-42d8-88ca-754505e114fa tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: cdde7779-a327-416c-863c-cd50d4d11c47] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:14.445234 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-762f0d5b-458a-42d8-88ca-754505e114fa tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:14.445719 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-762f0d5b-458a-42d8-88ca-754505e114fa tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:14.447590 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-762f0d5b-458a-42d8-88ca-754505e114fa tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:14.448720 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-762f0d5b-458a-42d8-88ca-754505e114fa tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:14.449172 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-762f0d5b-458a-42d8-88ca-754505e114fa tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:14.449594 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-762f0d5b-458a-42d8-88ca-754505e114fa tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:14.644846 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-856a9cf1-2fb1-40a1-8357-c1b84b247a81 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:14.663660 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-856a9cf1-2fb1-40a1-8357-c1b84b247a81 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef" status: 200 len: 1501 microversion: 2.1 time: 0.432060 Oct 17 13:58:14.664658 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2478/4822] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:14 2022] GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef => generated 1501 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:14.669762 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-af4fff51-0a77-4192-8d43-02567d760f6b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:14.670669 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-af4fff51-0a77-4192-8d43-02567d760f6b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: ad70195b-4a02-4a69-b6da-1f19fc3a51cd] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:14.679050 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af4fff51-0a77-4192-8d43-02567d760f6b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:14.679050 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af4fff51-0a77-4192-8d43-02567d760f6b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:14.679050 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af4fff51-0a77-4192-8d43-02567d760f6b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:14.679705 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af4fff51-0a77-4192-8d43-02567d760f6b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:14.680612 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af4fff51-0a77-4192-8d43-02567d760f6b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:14.682309 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af4fff51-0a77-4192-8d43-02567d760f6b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:14.791280 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-762f0d5b-458a-42d8-88ca-754505e114fa tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:14.807458 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-762f0d5b-458a-42d8-88ca-754505e114fa tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47" status: 200 len: 1492 microversion: 2.1 time: 0.383843 Oct 17 13:58:14.809478 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2345/4823] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:14 2022] GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47 => generated 1492 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:14.816571 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0e121c03-52d0-46e9-a1e5-6c5f5a84d558 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:58:14.833883 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0e121c03-52d0-46e9-a1e5-6c5f5a84d558 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:14.834971 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0e121c03-52d0-46e9-a1e5-6c5f5a84d558 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:14.835489 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0e121c03-52d0-46e9-a1e5-6c5f5a84d558 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:14.868830 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0e121c03-52d0-46e9-a1e5-6c5f5a84d558 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: c7875373-8b55-4b5a-b6be-9ce42c255eef] Going to try to stop instance {{(pid=127017) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 17 13:58:14.920433 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-af4fff51-0a77-4192-8d43-02567d760f6b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:14.935365 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-af4fff51-0a77-4192-8d43-02567d760f6b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd" status: 200 len: 1491 microversion: 2.1 time: 0.269198 Oct 17 13:58:14.937040 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0e121c03-52d0-46e9-a1e5-6c5f5a84d558 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "POST /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef/action" status: 202 len: 0 microversion: 2.1 time: 0.125332 Oct 17 13:58:14.939846 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2346/4824] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:58:14 2022] POST /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:58:14.943361 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2479/4825] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:14 2022] GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd => generated 1491 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:14.951987 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8d998f42-a21d-464e-b885-b93c19b02b0e tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:14.957285 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8d998f42-a21d-464e-b885-b93c19b02b0e tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: c7875373-8b55-4b5a-b6be-9ce42c255eef] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:14.965528 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8d998f42-a21d-464e-b885-b93c19b02b0e tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:14.966065 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8d998f42-a21d-464e-b885-b93c19b02b0e tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:14.966503 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8d998f42-a21d-464e-b885-b93c19b02b0e tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:14.967653 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8d998f42-a21d-464e-b885-b93c19b02b0e tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:14.968103 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8d998f42-a21d-464e-b885-b93c19b02b0e tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:14.968528 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8d998f42-a21d-464e-b885-b93c19b02b0e tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:15.220159 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8d998f42-a21d-464e-b885-b93c19b02b0e tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:15.230332 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8d998f42-a21d-464e-b885-b93c19b02b0e tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef" status: 200 len: 1511 microversion: 2.1 time: 0.284310 Oct 17 13:58:15.244337 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2480/4826] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:14 2022] GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef => generated 1511 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:58:15.252939 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-54a759a2-f44c-4294-be35-46f7ae9a077f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:15.253643 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-54a759a2-f44c-4294-be35-46f7ae9a077f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 6d2bbd26-cb90-4e90-881f-a9346ee3002a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:15.262657 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-54a759a2-f44c-4294-be35-46f7ae9a077f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:15.264763 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-54a759a2-f44c-4294-be35-46f7ae9a077f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:15.267928 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-54a759a2-f44c-4294-be35-46f7ae9a077f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:15.268719 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-54a759a2-f44c-4294-be35-46f7ae9a077f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:15.269181 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-54a759a2-f44c-4294-be35-46f7ae9a077f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:15.269593 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-54a759a2-f44c-4294-be35-46f7ae9a077f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:15.593880 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-54a759a2-f44c-4294-be35-46f7ae9a077f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:15.605497 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-54a759a2-f44c-4294-be35-46f7ae9a077f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a" status: 200 len: 1509 microversion: 2.1 time: 0.360507 Oct 17 13:58:15.607911 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2347/4827] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:15 2022] GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a => generated 1509 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:58:15.835239 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ba928d5c-b7ee-48a6-bdd5-077fa1e9c281 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:15.836508 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ba928d5c-b7ee-48a6-bdd5-077fa1e9c281 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: cdde7779-a327-416c-863c-cd50d4d11c47] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:15.860197 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ba928d5c-b7ee-48a6-bdd5-077fa1e9c281 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:15.867694 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ba928d5c-b7ee-48a6-bdd5-077fa1e9c281 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:15.872442 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ba928d5c-b7ee-48a6-bdd5-077fa1e9c281 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:15.874259 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ba928d5c-b7ee-48a6-bdd5-077fa1e9c281 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:15.874973 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ba928d5c-b7ee-48a6-bdd5-077fa1e9c281 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:15.875918 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ba928d5c-b7ee-48a6-bdd5-077fa1e9c281 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:15.962456 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e43c3771-e11f-438d-9a2f-6acff9034947 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:15.963503 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e43c3771-e11f-438d-9a2f-6acff9034947 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: ad70195b-4a02-4a69-b6da-1f19fc3a51cd] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:15.975328 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e43c3771-e11f-438d-9a2f-6acff9034947 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:15.976342 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e43c3771-e11f-438d-9a2f-6acff9034947 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:15.983753 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e43c3771-e11f-438d-9a2f-6acff9034947 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:15.985615 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e43c3771-e11f-438d-9a2f-6acff9034947 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:15.986614 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e43c3771-e11f-438d-9a2f-6acff9034947 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:15.987438 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e43c3771-e11f-438d-9a2f-6acff9034947 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:16.389562 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ba928d5c-b7ee-48a6-bdd5-077fa1e9c281 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:16.405708 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ba928d5c-b7ee-48a6-bdd5-077fa1e9c281 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47" status: 200 len: 1492 microversion: 2.1 time: 0.579026 Oct 17 13:58:16.412543 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e43c3771-e11f-438d-9a2f-6acff9034947 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:16.423444 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2481/4828] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:15 2022] GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47 => generated 1492 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:16.425317 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e43c3771-e11f-438d-9a2f-6acff9034947 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd" status: 200 len: 1512 microversion: 2.1 time: 0.466985 Oct 17 13:58:16.427530 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2348/4829] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:15 2022] GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd => generated 1512 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:58:16.441815 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-76c71090-49a7-46b6-8985-6539b5219456 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:16.443558 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-76c71090-49a7-46b6-8985-6539b5219456 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: c7875373-8b55-4b5a-b6be-9ce42c255eef] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:16.451453 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-76c71090-49a7-46b6-8985-6539b5219456 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:16.452278 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-76c71090-49a7-46b6-8985-6539b5219456 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:16.453282 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-76c71090-49a7-46b6-8985-6539b5219456 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:16.454934 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-76c71090-49a7-46b6-8985-6539b5219456 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:16.456048 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-76c71090-49a7-46b6-8985-6539b5219456 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:16.456915 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-76c71090-49a7-46b6-8985-6539b5219456 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:16.629622 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4e186d62-fe4d-4d80-94da-34d9303ab55a tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:16.630242 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4e186d62-fe4d-4d80-94da-34d9303ab55a tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 6d2bbd26-cb90-4e90-881f-a9346ee3002a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:16.640578 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4e186d62-fe4d-4d80-94da-34d9303ab55a tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:16.642424 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4e186d62-fe4d-4d80-94da-34d9303ab55a tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:16.643512 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4e186d62-fe4d-4d80-94da-34d9303ab55a tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:16.644947 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4e186d62-fe4d-4d80-94da-34d9303ab55a tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:16.645595 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4e186d62-fe4d-4d80-94da-34d9303ab55a tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:16.646192 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4e186d62-fe4d-4d80-94da-34d9303ab55a tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:16.646797 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-76c71090-49a7-46b6-8985-6539b5219456 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:16.656892 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-76c71090-49a7-46b6-8985-6539b5219456 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef" status: 200 len: 1511 microversion: 2.1 time: 0.222296 Oct 17 13:58:16.657532 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2482/4830] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:16 2022] GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef => generated 1511 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:17.254633 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4e186d62-fe4d-4d80-94da-34d9303ab55a tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:17.268433 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4e186d62-fe4d-4d80-94da-34d9303ab55a tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a" status: 200 len: 1509 microversion: 2.1 time: 0.641218 Oct 17 13:58:17.271891 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2349/4831] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:16 2022] GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a => generated 1509 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:17.436991 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d0b431c0-a54a-4862-9644-32a162cd1b7c tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:17.437644 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d0b431c0-a54a-4862-9644-32a162cd1b7c tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: cdde7779-a327-416c-863c-cd50d4d11c47] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:17.453338 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d626f324-6546-4783-84ac-ee6cff175e7f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:17.455213 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d626f324-6546-4783-84ac-ee6cff175e7f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: ad70195b-4a02-4a69-b6da-1f19fc3a51cd] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:17.464602 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d0b431c0-a54a-4862-9644-32a162cd1b7c tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:17.465479 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d0b431c0-a54a-4862-9644-32a162cd1b7c tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:17.466685 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d0b431c0-a54a-4862-9644-32a162cd1b7c tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:17.467462 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d626f324-6546-4783-84ac-ee6cff175e7f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:17.468481 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d0b431c0-a54a-4862-9644-32a162cd1b7c tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:17.469115 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d626f324-6546-4783-84ac-ee6cff175e7f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:17.469696 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d626f324-6546-4783-84ac-ee6cff175e7f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:17.470346 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d0b431c0-a54a-4862-9644-32a162cd1b7c tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:17.471381 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d626f324-6546-4783-84ac-ee6cff175e7f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:17.474304 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d0b431c0-a54a-4862-9644-32a162cd1b7c tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:17.481231 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d626f324-6546-4783-84ac-ee6cff175e7f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:17.481947 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d626f324-6546-4783-84ac-ee6cff175e7f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:17.496554 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:58:17.886796 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d626f324-6546-4783-84ac-ee6cff175e7f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:17.903923 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d626f324-6546-4783-84ac-ee6cff175e7f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd" status: 200 len: 1512 microversion: 2.1 time: 0.455559 Oct 17 13:58:17.904509 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2350/4832] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:17 2022] GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd => generated 1512 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:58:17.906685 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d0b431c0-a54a-4862-9644-32a162cd1b7c tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:17.923869 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7953880f-e116-486b-8c2c-b8e7f6fd7ced tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:17.924636 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7953880f-e116-486b-8c2c-b8e7f6fd7ced tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: c7875373-8b55-4b5a-b6be-9ce42c255eef] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:17.943212 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d0b431c0-a54a-4862-9644-32a162cd1b7c tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47" status: 200 len: 1498 microversion: 2.1 time: 0.496239 Oct 17 13:58:17.943212 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2483/4833] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:17 2022] GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47 => generated 1498 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:17.943670 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7953880f-e116-486b-8c2c-b8e7f6fd7ced tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:17.943670 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7953880f-e116-486b-8c2c-b8e7f6fd7ced tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:17.943670 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7953880f-e116-486b-8c2c-b8e7f6fd7ced tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:17.943670 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7953880f-e116-486b-8c2c-b8e7f6fd7ced tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:17.943670 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7953880f-e116-486b-8c2c-b8e7f6fd7ced tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:17.943670 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7953880f-e116-486b-8c2c-b8e7f6fd7ced tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:17.958021 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a3c15e6a-3e49-4273-9053-8632f040457e tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:17.958501 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a3c15e6a-3e49-4273-9053-8632f040457e tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: cdde7779-a327-416c-863c-cd50d4d11c47] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:17.970932 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a3c15e6a-3e49-4273-9053-8632f040457e tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:17.974413 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a3c15e6a-3e49-4273-9053-8632f040457e tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:17.976161 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a3c15e6a-3e49-4273-9053-8632f040457e tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:17.981377 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a3c15e6a-3e49-4273-9053-8632f040457e tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:17.981869 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a3c15e6a-3e49-4273-9053-8632f040457e tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:17.982409 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a3c15e6a-3e49-4273-9053-8632f040457e tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:18.029676 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a3c15e6a-3e49-4273-9053-8632f040457e tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: cdde7779-a327-416c-863c-cd50d4d11c47] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:58:18.185265 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a3c15e6a-3e49-4273-9053-8632f040457e tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "DELETE /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47" status: 204 len: 0 microversion: 2.1 time: 0.231682 Oct 17 13:58:18.190493 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2484/4834] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:58:17 2022] DELETE /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 13:58:18.198524 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cc4635e5-d939-4721-b119-a5aae5d04968 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:18.200358 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cc4635e5-d939-4721-b119-a5aae5d04968 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: cdde7779-a327-416c-863c-cd50d4d11c47] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:18.210144 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cc4635e5-d939-4721-b119-a5aae5d04968 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:18.211273 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cc4635e5-d939-4721-b119-a5aae5d04968 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:18.211956 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cc4635e5-d939-4721-b119-a5aae5d04968 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:18.212884 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cc4635e5-d939-4721-b119-a5aae5d04968 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:18.213974 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cc4635e5-d939-4721-b119-a5aae5d04968 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:18.214705 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cc4635e5-d939-4721-b119-a5aae5d04968 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:18.350891 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7953880f-e116-486b-8c2c-b8e7f6fd7ced tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:18.367754 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7953880f-e116-486b-8c2c-b8e7f6fd7ced tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef" status: 200 len: 1511 microversion: 2.1 time: 0.458857 Oct 17 13:58:18.381157 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2351/4835] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:17 2022] GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef => generated 1511 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:18.412048 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7fa4497f-62bc-4315-8610-2106b463b6bb tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:18.414377 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7fa4497f-62bc-4315-8610-2106b463b6bb tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 6d2bbd26-cb90-4e90-881f-a9346ee3002a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:18.421816 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7fa4497f-62bc-4315-8610-2106b463b6bb tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:18.422454 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7fa4497f-62bc-4315-8610-2106b463b6bb tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:18.423155 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7fa4497f-62bc-4315-8610-2106b463b6bb tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:18.424266 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7fa4497f-62bc-4315-8610-2106b463b6bb tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:18.424977 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7fa4497f-62bc-4315-8610-2106b463b6bb tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:18.425706 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7fa4497f-62bc-4315-8610-2106b463b6bb tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:18.684778 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7fa4497f-62bc-4315-8610-2106b463b6bb tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:18.693123 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cc4635e5-d939-4721-b119-a5aae5d04968 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:18.694306 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7fa4497f-62bc-4315-8610-2106b463b6bb tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a" status: 200 len: 1509 microversion: 2.1 time: 0.298338 Oct 17 13:58:18.709188 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2352/4836] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:18 2022] GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a => generated 1509 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:18.722342 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cc4635e5-d939-4721-b119-a5aae5d04968 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47" status: 200 len: 1504 microversion: 2.1 time: 0.529939 Oct 17 13:58:18.723010 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2485/4837] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:18 2022] GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47 => generated 1504 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:18.947691 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-441f2416-da0b-404b-8570-80554d6c6513 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:18.952613 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-441f2416-da0b-404b-8570-80554d6c6513 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: ad70195b-4a02-4a69-b6da-1f19fc3a51cd] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:18.972404 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-441f2416-da0b-404b-8570-80554d6c6513 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:18.973390 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-441f2416-da0b-404b-8570-80554d6c6513 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:18.978303 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-441f2416-da0b-404b-8570-80554d6c6513 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:18.980538 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-441f2416-da0b-404b-8570-80554d6c6513 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:18.982682 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-441f2416-da0b-404b-8570-80554d6c6513 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:18.983300 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-441f2416-da0b-404b-8570-80554d6c6513 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:19.415984 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-56f2bb8c-07b0-4212-ab96-67deb51dfdf3 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:19.416594 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-56f2bb8c-07b0-4212-ab96-67deb51dfdf3 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: c7875373-8b55-4b5a-b6be-9ce42c255eef] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:19.427007 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-56f2bb8c-07b0-4212-ab96-67deb51dfdf3 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:19.428743 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-56f2bb8c-07b0-4212-ab96-67deb51dfdf3 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:19.430019 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-56f2bb8c-07b0-4212-ab96-67deb51dfdf3 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:19.432245 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-56f2bb8c-07b0-4212-ab96-67deb51dfdf3 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:19.436472 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-56f2bb8c-07b0-4212-ab96-67deb51dfdf3 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:19.438163 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-56f2bb8c-07b0-4212-ab96-67deb51dfdf3 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:19.499676 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-441f2416-da0b-404b-8570-80554d6c6513 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:19.513384 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-441f2416-da0b-404b-8570-80554d6c6513 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd" status: 200 len: 1507 microversion: 2.1 time: 0.585696 Oct 17 13:58:19.514795 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2353/4838] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:18 2022] GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd => generated 1507 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:19.722240 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d4de1607-58ba-425a-a1e6-d355347340e9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:19.723787 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d4de1607-58ba-425a-a1e6-d355347340e9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 6d2bbd26-cb90-4e90-881f-a9346ee3002a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:19.734440 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d4de1607-58ba-425a-a1e6-d355347340e9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:19.736403 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d4de1607-58ba-425a-a1e6-d355347340e9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:19.738421 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d4de1607-58ba-425a-a1e6-d355347340e9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:19.739565 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d4de1607-58ba-425a-a1e6-d355347340e9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:19.740265 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d4de1607-58ba-425a-a1e6-d355347340e9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:19.745132 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d4de1607-58ba-425a-a1e6-d355347340e9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:19.763094 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-56f2bb8c-07b0-4212-ab96-67deb51dfdf3 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:19.771618 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-56f2bb8c-07b0-4212-ab96-67deb51dfdf3 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef" status: 200 len: 1511 microversion: 2.1 time: 0.361221 Oct 17 13:58:19.772216 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2486/4839] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:19 2022] GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef => generated 1511 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:19.792346 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-213462d0-a9c7-477e-81d1-90ca0f9b9cfc tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:19.792967 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-213462d0-a9c7-477e-81d1-90ca0f9b9cfc tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: cdde7779-a327-416c-863c-cd50d4d11c47] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:19.800982 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-213462d0-a9c7-477e-81d1-90ca0f9b9cfc tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:19.801768 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-213462d0-a9c7-477e-81d1-90ca0f9b9cfc tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:19.802383 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-213462d0-a9c7-477e-81d1-90ca0f9b9cfc tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:19.803096 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-213462d0-a9c7-477e-81d1-90ca0f9b9cfc tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:19.803739 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-213462d0-a9c7-477e-81d1-90ca0f9b9cfc tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:19.804336 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-213462d0-a9c7-477e-81d1-90ca0f9b9cfc tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:20.211758 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d4de1607-58ba-425a-a1e6-d355347340e9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:20.220263 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d4de1607-58ba-425a-a1e6-d355347340e9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a" status: 200 len: 1509 microversion: 2.1 time: 0.503538 Oct 17 13:58:20.220884 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2354/4840] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:19 2022] GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a => generated 1509 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:58:20.265075 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-213462d0-a9c7-477e-81d1-90ca0f9b9cfc tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:20.280969 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-213462d0-a9c7-477e-81d1-90ca0f9b9cfc tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47" status: 200 len: 1504 microversion: 2.1 time: 0.496440 Oct 17 13:58:20.283699 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2487/4841] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:19 2022] GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47 => generated 1504 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:20.539775 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0f67cce0-bcb8-4def-ade1-cb88c775822c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:20.540832 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0f67cce0-bcb8-4def-ade1-cb88c775822c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: ad70195b-4a02-4a69-b6da-1f19fc3a51cd] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:20.552707 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0f67cce0-bcb8-4def-ade1-cb88c775822c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:20.555011 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0f67cce0-bcb8-4def-ade1-cb88c775822c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:20.559670 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0f67cce0-bcb8-4def-ade1-cb88c775822c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:20.560663 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0f67cce0-bcb8-4def-ade1-cb88c775822c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:20.561461 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0f67cce0-bcb8-4def-ade1-cb88c775822c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:20.562103 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0f67cce0-bcb8-4def-ade1-cb88c775822c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:20.789002 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-fc3af4bd-b223-430b-a26f-be27226adab7 req-031d70c5-99c7-4b0c-82e5-0f48b2c3c67c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad70195b-4a02-4a69-b6da-1f19fc3a51cd", "name": "network-vif-plugged", "status": "completed", "tag": "6f5c8902-466c-4ca2-9d94-db58249199e2"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:58:20.828853 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-fc3af4bd-b223-430b-a26f-be27226adab7 req-031d70c5-99c7-4b0c-82e5-0f48b2c3c67c service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:20.829570 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-fc3af4bd-b223-430b-a26f-be27226adab7 req-031d70c5-99c7-4b0c-82e5-0f48b2c3c67c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:20.830198 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-fc3af4bd-b223-430b-a26f-be27226adab7 req-031d70c5-99c7-4b0c-82e5-0f48b2c3c67c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:20.865953 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-fc3af4bd-b223-430b-a26f-be27226adab7 req-031d70c5-99c7-4b0c-82e5-0f48b2c3c67c service nova] Creating event network-vif-plugged:6f5c8902-466c-4ca2-9d94-db58249199e2 for instance ad70195b-4a02-4a69-b6da-1f19fc3a51cd on n-h1-854247-14 Oct 17 13:58:20.888369 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-fc3af4bd-b223-430b-a26f-be27226adab7 req-031d70c5-99c7-4b0c-82e5-0f48b2c3c67c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099130 Oct 17 13:58:20.892631 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2488/4842] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:58:20.899257 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4dbdcf82-0310-4c27-b3ad-4516aaef74b8 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:20.905245 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4dbdcf82-0310-4c27-b3ad-4516aaef74b8 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: c7875373-8b55-4b5a-b6be-9ce42c255eef] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:20.916215 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0f67cce0-bcb8-4def-ade1-cb88c775822c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:20.928777 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4dbdcf82-0310-4c27-b3ad-4516aaef74b8 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:20.932992 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0f67cce0-bcb8-4def-ade1-cb88c775822c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd" status: 200 len: 1507 microversion: 2.1 time: 0.397299 Oct 17 13:58:20.948420 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4dbdcf82-0310-4c27-b3ad-4516aaef74b8 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:20.948420 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4dbdcf82-0310-4c27-b3ad-4516aaef74b8 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:20.948420 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4dbdcf82-0310-4c27-b3ad-4516aaef74b8 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:20.948420 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4dbdcf82-0310-4c27-b3ad-4516aaef74b8 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:20.948420 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4dbdcf82-0310-4c27-b3ad-4516aaef74b8 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:20.959234 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2355/4843] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:20 2022] GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd => generated 1507 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:21.244176 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-edafae8f-c5ba-48fd-be96-b3f743292122 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:21.244797 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-edafae8f-c5ba-48fd-be96-b3f743292122 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 6d2bbd26-cb90-4e90-881f-a9346ee3002a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:21.256466 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-edafae8f-c5ba-48fd-be96-b3f743292122 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:21.258583 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-edafae8f-c5ba-48fd-be96-b3f743292122 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:21.261655 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-edafae8f-c5ba-48fd-be96-b3f743292122 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:21.263712 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-edafae8f-c5ba-48fd-be96-b3f743292122 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:21.264397 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-edafae8f-c5ba-48fd-be96-b3f743292122 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:21.265420 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-edafae8f-c5ba-48fd-be96-b3f743292122 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:21.825174 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4dbdcf82-0310-4c27-b3ad-4516aaef74b8 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:21.850680 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4dbdcf82-0310-4c27-b3ad-4516aaef74b8 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef" status: 200 len: 1511 microversion: 2.1 time: 0.956401 Oct 17 13:58:21.851559 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2489/4844] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:20 2022] GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef => generated 1511 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:21.875298 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-de3bfe93-1a04-4555-a247-0bcece4551aa tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:21.877818 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-de3bfe93-1a04-4555-a247-0bcece4551aa tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: cdde7779-a327-416c-863c-cd50d4d11c47] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:21.906647 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-de3bfe93-1a04-4555-a247-0bcece4551aa tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:21.910994 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-de3bfe93-1a04-4555-a247-0bcece4551aa tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:21.913761 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-de3bfe93-1a04-4555-a247-0bcece4551aa tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:21.917365 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-de3bfe93-1a04-4555-a247-0bcece4551aa tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:21.920485 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-de3bfe93-1a04-4555-a247-0bcece4551aa tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:21.925516 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-de3bfe93-1a04-4555-a247-0bcece4551aa tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:22.377921 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-de3bfe93-1a04-4555-a247-0bcece4551aa tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:22.387013 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-edafae8f-c5ba-48fd-be96-b3f743292122 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:22.395776 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-edafae8f-c5ba-48fd-be96-b3f743292122 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a" status: 200 len: 1509 microversion: 2.1 time: 1.155622 Oct 17 13:58:22.396352 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2356/4845] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:21 2022] GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a => generated 1509 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:22.403783 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-de3bfe93-1a04-4555-a247-0bcece4551aa tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47" status: 200 len: 1462 microversion: 2.1 time: 0.547432 Oct 17 13:58:22.406003 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2490/4846] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:21 2022] GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47 => generated 1462 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:22.419209 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7da7a82d-5651-4124-87ec-e2b914060fcf tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:22.419209 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7da7a82d-5651-4124-87ec-e2b914060fcf tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: ad70195b-4a02-4a69-b6da-1f19fc3a51cd] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:22.455714 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7da7a82d-5651-4124-87ec-e2b914060fcf tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:22.456339 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7da7a82d-5651-4124-87ec-e2b914060fcf tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:22.456800 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7da7a82d-5651-4124-87ec-e2b914060fcf tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:22.457554 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7da7a82d-5651-4124-87ec-e2b914060fcf tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:22.458005 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7da7a82d-5651-4124-87ec-e2b914060fcf tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:22.458433 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7da7a82d-5651-4124-87ec-e2b914060fcf tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:22.783936 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-3455cb85-de8a-4cf4-8a38-9dd20f9fde02 req-a275730f-e23d-46d1-860b-9d86aa1ea885 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdde7779-a327-416c-863c-cd50d4d11c47", "name": "network-vif-deleted", "tag": "0e8cffbc-51aa-45f8-b83f-60caf9b44c13"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:58:22.859733 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-3455cb85-de8a-4cf4-8a38-9dd20f9fde02 req-a275730f-e23d-46d1-860b-9d86aa1ea885 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:22.862388 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-3455cb85-de8a-4cf4-8a38-9dd20f9fde02 req-a275730f-e23d-46d1-860b-9d86aa1ea885 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:22.862926 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-3455cb85-de8a-4cf4-8a38-9dd20f9fde02 req-a275730f-e23d-46d1-860b-9d86aa1ea885 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:22.911297 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-3455cb85-de8a-4cf4-8a38-9dd20f9fde02 req-a275730f-e23d-46d1-860b-9d86aa1ea885 service nova] Creating event network-vif-deleted:0e8cffbc-51aa-45f8-b83f-60caf9b44c13 for instance cdde7779-a327-416c-863c-cd50d4d11c47 on n-h1-854247-14 Oct 17 13:58:22.913603 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7da7a82d-5651-4124-87ec-e2b914060fcf tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:22.921895 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7da7a82d-5651-4124-87ec-e2b914060fcf tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd" status: 200 len: 1507 microversion: 2.1 time: 0.520270 Oct 17 13:58:22.932012 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-3455cb85-de8a-4cf4-8a38-9dd20f9fde02 req-a275730f-e23d-46d1-860b-9d86aa1ea885 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164745 Oct 17 13:58:22.932649 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2491/4847] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:58:22.936333 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2357/4848] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:22 2022] GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd => generated 1507 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:22.965094 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b25437f9-f843-44b5-a593-88c24648f6de tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:22.967871 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b25437f9-f843-44b5-a593-88c24648f6de tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: c7875373-8b55-4b5a-b6be-9ce42c255eef] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:22.995805 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b25437f9-f843-44b5-a593-88c24648f6de tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:22.996732 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b25437f9-f843-44b5-a593-88c24648f6de tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:22.997492 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b25437f9-f843-44b5-a593-88c24648f6de tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:23.003270 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b25437f9-f843-44b5-a593-88c24648f6de tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:23.006938 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b25437f9-f843-44b5-a593-88c24648f6de tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:23.008075 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b25437f9-f843-44b5-a593-88c24648f6de tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:23.018277 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:58:23.342056 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b25437f9-f843-44b5-a593-88c24648f6de tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:23.350879 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b25437f9-f843-44b5-a593-88c24648f6de tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef" status: 200 len: 1511 microversion: 2.1 time: 0.416959 Oct 17 13:58:23.373914 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2492/4849] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:22 2022] GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef => generated 1511 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:23.423663 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-11ca074d-8c2f-4dc0-847f-fdca35d20d49 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:23.428228 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-11ca074d-8c2f-4dc0-847f-fdca35d20d49 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 6d2bbd26-cb90-4e90-881f-a9346ee3002a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:23.431922 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-be176af8-b0b1-434e-af8b-9419560ac176 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:23.432168 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-be176af8-b0b1-434e-af8b-9419560ac176 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: cdde7779-a327-416c-863c-cd50d4d11c47] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:23.439856 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-11ca074d-8c2f-4dc0-847f-fdca35d20d49 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:23.440534 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be176af8-b0b1-434e-af8b-9419560ac176 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:23.440827 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-11ca074d-8c2f-4dc0-847f-fdca35d20d49 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:23.441146 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be176af8-b0b1-434e-af8b-9419560ac176 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:23.441589 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be176af8-b0b1-434e-af8b-9419560ac176 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:23.441738 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-11ca074d-8c2f-4dc0-847f-fdca35d20d49 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:23.442318 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be176af8-b0b1-434e-af8b-9419560ac176 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:23.442757 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be176af8-b0b1-434e-af8b-9419560ac176 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:23.449279 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be176af8-b0b1-434e-af8b-9419560ac176 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:23.449750 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-11ca074d-8c2f-4dc0-847f-fdca35d20d49 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:23.450719 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-11ca074d-8c2f-4dc0-847f-fdca35d20d49 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:23.452110 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-11ca074d-8c2f-4dc0-847f-fdca35d20d49 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:23.577253 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be176af8-b0b1-434e-af8b-9419560ac176 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:23.581460 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be176af8-b0b1-434e-af8b-9419560ac176 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:23.582274 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be176af8-b0b1-434e-af8b-9419560ac176 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:23.582855 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-be176af8-b0b1-434e-af8b-9419560ac176 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lazy-loading 'fault' on Instance uuid cdde7779-a327-416c-863c-cd50d4d11c47 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:58:24.641288 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-be176af8-b0b1-434e-af8b-9419560ac176 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:24.652475 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-be176af8-b0b1-434e-af8b-9419560ac176 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47" status: 200 len: 1303 microversion: 2.1 time: 1.225140 Oct 17 13:58:24.657884 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2493/4850] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:23 2022] GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47 => generated 1303 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:24.677197 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fd62f5bc-f0cc-4ddb-aecc-3f7e40d6dc39 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:24.678451 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-fd62f5bc-f0cc-4ddb-aecc-3f7e40d6dc39 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: ad70195b-4a02-4a69-b6da-1f19fc3a51cd] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:24.688873 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fd62f5bc-f0cc-4ddb-aecc-3f7e40d6dc39 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:24.689778 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fd62f5bc-f0cc-4ddb-aecc-3f7e40d6dc39 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:24.690459 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fd62f5bc-f0cc-4ddb-aecc-3f7e40d6dc39 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:24.691767 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fd62f5bc-f0cc-4ddb-aecc-3f7e40d6dc39 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:24.692444 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fd62f5bc-f0cc-4ddb-aecc-3f7e40d6dc39 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:24.693027 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fd62f5bc-f0cc-4ddb-aecc-3f7e40d6dc39 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:24.817345 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-11ca074d-8c2f-4dc0-847f-fdca35d20d49 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:24.831845 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-11ca074d-8c2f-4dc0-847f-fdca35d20d49 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a" status: 200 len: 1509 microversion: 2.1 time: 1.412395 Oct 17 13:58:24.838449 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2358/4851] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:23 2022] GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a => generated 1509 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:24.858027 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-577778fe-5e55-4092-bbea-0e4db73c6924 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:24.859839 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-577778fe-5e55-4092-bbea-0e4db73c6924 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: c7875373-8b55-4b5a-b6be-9ce42c255eef] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:24.866453 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-577778fe-5e55-4092-bbea-0e4db73c6924 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:24.868096 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-577778fe-5e55-4092-bbea-0e4db73c6924 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:24.868714 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-577778fe-5e55-4092-bbea-0e4db73c6924 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:24.869589 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-577778fe-5e55-4092-bbea-0e4db73c6924 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:24.870199 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-577778fe-5e55-4092-bbea-0e4db73c6924 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:24.870784 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-577778fe-5e55-4092-bbea-0e4db73c6924 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:24.922860 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fd62f5bc-f0cc-4ddb-aecc-3f7e40d6dc39 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:24.936232 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fd62f5bc-f0cc-4ddb-aecc-3f7e40d6dc39 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd" status: 200 len: 1507 microversion: 2.1 time: 0.275505 Oct 17 13:58:24.939608 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2494/4852] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:24 2022] GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd => generated 1507 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:25.687046 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-441da41c-0984-4165-b996-9c523537f78d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:25.688103 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-441da41c-0984-4165-b996-9c523537f78d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: cdde7779-a327-416c-863c-cd50d4d11c47] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:25.697289 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-441da41c-0984-4165-b996-9c523537f78d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:25.706355 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-441da41c-0984-4165-b996-9c523537f78d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:25.707267 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-441da41c-0984-4165-b996-9c523537f78d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:25.708311 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-441da41c-0984-4165-b996-9c523537f78d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:25.709039 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-441da41c-0984-4165-b996-9c523537f78d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:25.709940 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-441da41c-0984-4165-b996-9c523537f78d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:25.734280 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-441da41c-0984-4165-b996-9c523537f78d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] HTTP exception thrown: Instance cdde7779-a327-416c-863c-cd50d4d11c47 could not be found. Oct 17 13:58:25.736340 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-441da41c-0984-4165-b996-9c523537f78d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Request method failure captured: Oct 17 13:58:25.736340 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47 HTTP/1.1 Oct 17 13:58:25.736340 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:58:25.736340 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:58:25.736340 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:58:25.736340 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:58:25.736340 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:58:25.736340 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:58:25.736340 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:58:25.736340 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:58:25.736340 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTV8UthrFKkKhwhhRLtmpkapbeFBs1cRjOOAcJ6FVEQz5zfMt32jfBmweouc2NR2g9oCRX0KHS7sGohyuaYt5uOERdlIdc51xI_6Iz1wlpEz3_hpWAAOyJCXP_rrHxi--42sWot_aydVZahFZN_Hc19c_16zQHamdTaKSUAxdfJ3zk0M Oct 17 13:58:25.736340 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:58:25.736340 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:58:25.736340 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:58:25.736340 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:58:25.736340 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:58:25.736340 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:58:25.736340 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: f5cd6550628148f9b0ae1907967da048 Oct 17 13:58:25.736340 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServerRescueTestJSON-1264941338 Oct 17 13:58:25.736340 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:58:25.736340 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:58:25.736340 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f5cd6550628148f9b0ae1907967da048"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f5cd6550628148f9b0ae1907967da048"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f5cd6550628148f9b0ae1907967da048"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f5cd6550628148f9b0ae1907967da048", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:58:25.736340 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServerRescueTestJSON-1264941338 Oct 17 13:58:25.736340 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: f5cd6550628148f9b0ae1907967da048 Oct 17 13:58:25.736340 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServerRescueTestJSON-1264941338 Oct 17 13:58:25.736340 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServerRescueTestJSON-1264941338-project Oct 17 13:58:25.736340 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:58:25.736340 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:58:25.736340 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 6e0edd4df0ec4a079ab988b186fedf00 Oct 17 13:58:25.736340 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServerRescueTestJSON-1264941338-project Oct 17 13:58:25.736340 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:58:25.736340 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance cdde7779-a327-416c-863c-cd50d4d11c47 could not be found. Oct 17 13:58:25.736340 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'cdde7779-a327-416c-863c-cd50d4d11c47'} Oct 17 13:58:25.736340 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:58:25.736340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:58:25.736340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:58:25.736340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:58:25.736340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:58:25.736340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:58:25.736340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:58:25.736340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:58:25.736340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:58:25.736340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:58:25.736340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdde7779-a327-416c-863c-cd50d4d11c47 could not be found. Oct 17 13:58:25.736340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:58:25.736340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:58:25.736340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:58:25.736340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:58:25.736340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:58:25.736340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:58:25.736340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:58:25.736340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:58:25.736340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:58:25.736340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:58:25.736340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:58:25.736340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:58:25.736340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:58:25.736340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:58:25.736340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:58:25.736340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:58:25.736340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdde7779-a327-416c-863c-cd50d4d11c47 could not be found. Oct 17 13:58:25.736340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:58:25.736340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:58:25.736340 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:58:25.742131 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:58:25.742131 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:58:25.742131 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:58:25.742131 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:58:25.742131 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:58:25.742131 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdde7779-a327-416c-863c-cd50d4d11c47 could not be found. Oct 17 13:58:25.742131 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:58:25.743657 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-441da41c-0984-4165-b996-9c523537f78d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Returning 404 to user: Instance cdde7779-a327-416c-863c-cd50d4d11c47 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:58:25.744726 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-441da41c-0984-4165-b996-9c523537f78d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47" status: 404 len: 111 microversion: 2.1 time: 0.062760 Oct 17 13:58:25.745481 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2495/4853] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:25 2022] GET /compute/v2.1/servers/cdde7779-a327-416c-863c-cd50d4d11c47 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:58:25.754357 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1014699b-6e5f-479d-b41f-023bacb5cfb1 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:25.755092 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-1014699b-6e5f-479d-b41f-023bacb5cfb1 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: 70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:25.762612 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1014699b-6e5f-479d-b41f-023bacb5cfb1 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:25.763571 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1014699b-6e5f-479d-b41f-023bacb5cfb1 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:25.764186 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1014699b-6e5f-479d-b41f-023bacb5cfb1 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:25.765102 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1014699b-6e5f-479d-b41f-023bacb5cfb1 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:25.767744 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1014699b-6e5f-479d-b41f-023bacb5cfb1 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:25.768490 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1014699b-6e5f-479d-b41f-023bacb5cfb1 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:25.859459 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-1014699b-6e5f-479d-b41f-023bacb5cfb1 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: 70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:58:26.018169 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-577778fe-5e55-4092-bbea-0e4db73c6924 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:26.027205 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-577778fe-5e55-4092-bbea-0e4db73c6924 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef" status: 200 len: 1511 microversion: 2.1 time: 1.183022 Oct 17 13:58:26.027786 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2359/4854] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:24 2022] GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef => generated 1511 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:26.051472 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0410b67a-87af-4c8e-bc25-39dab6a6fdc5 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:26.052112 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0410b67a-87af-4c8e-bc25-39dab6a6fdc5 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 6d2bbd26-cb90-4e90-881f-a9346ee3002a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:26.081971 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0410b67a-87af-4c8e-bc25-39dab6a6fdc5 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:26.082834 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0410b67a-87af-4c8e-bc25-39dab6a6fdc5 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:26.083396 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0410b67a-87af-4c8e-bc25-39dab6a6fdc5 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:26.084134 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0410b67a-87af-4c8e-bc25-39dab6a6fdc5 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:26.084597 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0410b67a-87af-4c8e-bc25-39dab6a6fdc5 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:26.085026 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0410b67a-87af-4c8e-bc25-39dab6a6fdc5 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:26.103149 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1014699b-6e5f-479d-b41f-023bacb5cfb1 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "DELETE /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63" status: 204 len: 0 microversion: 2.1 time: 0.352903 Oct 17 13:58:26.104384 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2496/4855] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:58:25 2022] DELETE /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:58:26.117557 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4e6e5f36-38c5-4869-968c-1c7033b62a14 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:26.118953 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4e6e5f36-38c5-4869-968c-1c7033b62a14 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: ad70195b-4a02-4a69-b6da-1f19fc3a51cd] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:26.143236 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4e6e5f36-38c5-4869-968c-1c7033b62a14 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:26.147906 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4e6e5f36-38c5-4869-968c-1c7033b62a14 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:26.149830 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4e6e5f36-38c5-4869-968c-1c7033b62a14 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:26.150971 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4e6e5f36-38c5-4869-968c-1c7033b62a14 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:26.153904 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4e6e5f36-38c5-4869-968c-1c7033b62a14 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:26.157126 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4e6e5f36-38c5-4869-968c-1c7033b62a14 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:26.924230 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0410b67a-87af-4c8e-bc25-39dab6a6fdc5 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:26.928301 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4e6e5f36-38c5-4869-968c-1c7033b62a14 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:26.937888 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0410b67a-87af-4c8e-bc25-39dab6a6fdc5 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a" status: 200 len: 1509 microversion: 2.1 time: 0.903425 Oct 17 13:58:26.941289 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4e6e5f36-38c5-4869-968c-1c7033b62a14 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd" status: 200 len: 1507 microversion: 2.1 time: 0.835264 Oct 17 13:58:26.946713 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2497/4856] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:26 2022] GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd => generated 1507 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:26.959576 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4d447e5a-b86a-4801-bc52-77434a237de4 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:26.961266 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4d447e5a-b86a-4801-bc52-77434a237de4 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: 70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:26.975913 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2360/4857] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:26 2022] GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a => generated 1509 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:26.977596 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d447e5a-b86a-4801-bc52-77434a237de4 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:26.979009 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d447e5a-b86a-4801-bc52-77434a237de4 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:26.981035 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d447e5a-b86a-4801-bc52-77434a237de4 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:26.984483 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d447e5a-b86a-4801-bc52-77434a237de4 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:26.984483 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d447e5a-b86a-4801-bc52-77434a237de4 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:26.984483 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d447e5a-b86a-4801-bc52-77434a237de4 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:27.065698 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-be075946-c806-4079-8ff2-c48e0134a1eb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:27.066987 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-be075946-c806-4079-8ff2-c48e0134a1eb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: c7875373-8b55-4b5a-b6be-9ce42c255eef] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:27.077953 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-be075946-c806-4079-8ff2-c48e0134a1eb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:27.078741 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-be075946-c806-4079-8ff2-c48e0134a1eb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:27.079841 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-be075946-c806-4079-8ff2-c48e0134a1eb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:27.081547 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-be075946-c806-4079-8ff2-c48e0134a1eb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:27.082888 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-be075946-c806-4079-8ff2-c48e0134a1eb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:27.085146 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-be075946-c806-4079-8ff2-c48e0134a1eb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:27.561473 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4d447e5a-b86a-4801-bc52-77434a237de4 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:27.576490 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4d447e5a-b86a-4801-bc52-77434a237de4 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63" status: 200 len: 1491 microversion: 2.1 time: 0.628234 Oct 17 13:58:27.579384 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2498/4858] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:26 2022] GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63 => generated 1491 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:27.670214 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-be075946-c806-4079-8ff2-c48e0134a1eb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:27.685310 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-be075946-c806-4079-8ff2-c48e0134a1eb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef" status: 200 len: 1511 microversion: 2.1 time: 0.624226 Oct 17 13:58:27.685903 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2361/4859] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:27 2022] GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef => generated 1511 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:58:27.972905 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0058ff69-099c-4a4f-986a-5d225dab3155 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:27.973584 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0058ff69-099c-4a4f-986a-5d225dab3155 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: ad70195b-4a02-4a69-b6da-1f19fc3a51cd] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:27.984369 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0058ff69-099c-4a4f-986a-5d225dab3155 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:27.987921 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0058ff69-099c-4a4f-986a-5d225dab3155 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:27.988650 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0058ff69-099c-4a4f-986a-5d225dab3155 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:27.990469 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0058ff69-099c-4a4f-986a-5d225dab3155 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:27.992324 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0058ff69-099c-4a4f-986a-5d225dab3155 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:27.993203 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0058ff69-099c-4a4f-986a-5d225dab3155 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:27.994243 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4ed0f0b1-1566-4752-a1f5-b3840eabf0d0 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:27.994882 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4ed0f0b1-1566-4752-a1f5-b3840eabf0d0 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 6d2bbd26-cb90-4e90-881f-a9346ee3002a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:28.013387 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4ed0f0b1-1566-4752-a1f5-b3840eabf0d0 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:28.013884 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4ed0f0b1-1566-4752-a1f5-b3840eabf0d0 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:28.014667 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4ed0f0b1-1566-4752-a1f5-b3840eabf0d0 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:28.016613 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4ed0f0b1-1566-4752-a1f5-b3840eabf0d0 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:28.017275 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4ed0f0b1-1566-4752-a1f5-b3840eabf0d0 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:28.017984 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4ed0f0b1-1566-4752-a1f5-b3840eabf0d0 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:28.599845 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0058ff69-099c-4a4f-986a-5d225dab3155 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:28.610290 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0058ff69-099c-4a4f-986a-5d225dab3155 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd" status: 200 len: 1507 microversion: 2.1 time: 0.644068 Oct 17 13:58:28.612135 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4ed0f0b1-1566-4752-a1f5-b3840eabf0d0 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:28.629019 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2499/4860] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:27 2022] GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd => generated 1507 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:28.634288 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b1d327de-6bf3-42e8-9553-72478d58aaef tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:28.637733 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4ed0f0b1-1566-4752-a1f5-b3840eabf0d0 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a" status: 200 len: 1509 microversion: 2.1 time: 0.652784 Oct 17 13:58:28.642062 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2362/4861] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:27 2022] GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a => generated 1509 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:28.656020 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b1d327de-6bf3-42e8-9553-72478d58aaef tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: 70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:28.684686 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b1d327de-6bf3-42e8-9553-72478d58aaef tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:28.685522 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b1d327de-6bf3-42e8-9553-72478d58aaef tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:28.686132 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b1d327de-6bf3-42e8-9553-72478d58aaef tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:28.699462 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b1d327de-6bf3-42e8-9553-72478d58aaef tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:28.700495 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b1d327de-6bf3-42e8-9553-72478d58aaef tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:28.701127 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b1d327de-6bf3-42e8-9553-72478d58aaef tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:28.712831 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-437c2ae7-f77e-4023-b95b-6c43bde90198 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:28.713818 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-437c2ae7-f77e-4023-b95b-6c43bde90198 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: c7875373-8b55-4b5a-b6be-9ce42c255eef] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:28.729537 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-437c2ae7-f77e-4023-b95b-6c43bde90198 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:28.730679 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-437c2ae7-f77e-4023-b95b-6c43bde90198 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:28.731359 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-437c2ae7-f77e-4023-b95b-6c43bde90198 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:28.732306 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-437c2ae7-f77e-4023-b95b-6c43bde90198 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:28.732970 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-437c2ae7-f77e-4023-b95b-6c43bde90198 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:28.733600 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-437c2ae7-f77e-4023-b95b-6c43bde90198 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:29.426044 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b1d327de-6bf3-42e8-9553-72478d58aaef tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:29.432389 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-437c2ae7-f77e-4023-b95b-6c43bde90198 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:29.439931 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b1d327de-6bf3-42e8-9553-72478d58aaef tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63" status: 200 len: 1491 microversion: 2.1 time: 0.809430 Oct 17 13:58:29.447143 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-437c2ae7-f77e-4023-b95b-6c43bde90198 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef" status: 200 len: 1511 microversion: 2.1 time: 0.738134 Oct 17 13:58:29.448391 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2363/4862] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:28 2022] GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef => generated 1511 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:29.464593 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2500/4863] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:28 2022] GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63 => generated 1491 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:29.650150 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8dc2bd8e-6845-4450-814e-4e7d9920b3f7 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:29.650895 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8dc2bd8e-6845-4450-814e-4e7d9920b3f7 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: ad70195b-4a02-4a69-b6da-1f19fc3a51cd] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:29.665790 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8dc2bd8e-6845-4450-814e-4e7d9920b3f7 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:29.666204 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8dc2bd8e-6845-4450-814e-4e7d9920b3f7 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:29.666546 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-54bddc29-a346-4cc8-946c-f8ded1177593 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:29.666708 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8dc2bd8e-6845-4450-814e-4e7d9920b3f7 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:29.667394 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8dc2bd8e-6845-4450-814e-4e7d9920b3f7 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:29.667853 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8dc2bd8e-6845-4450-814e-4e7d9920b3f7 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:29.668280 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8dc2bd8e-6845-4450-814e-4e7d9920b3f7 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:29.668854 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-54bddc29-a346-4cc8-946c-f8ded1177593 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 6d2bbd26-cb90-4e90-881f-a9346ee3002a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:29.756240 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-54bddc29-a346-4cc8-946c-f8ded1177593 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:29.757249 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-54bddc29-a346-4cc8-946c-f8ded1177593 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:29.757943 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-54bddc29-a346-4cc8-946c-f8ded1177593 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:29.801624 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-54bddc29-a346-4cc8-946c-f8ded1177593 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:29.802130 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-54bddc29-a346-4cc8-946c-f8ded1177593 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:29.802583 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-54bddc29-a346-4cc8-946c-f8ded1177593 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:30.478339 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8dc2bd8e-6845-4450-814e-4e7d9920b3f7 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:30.482498 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-54bddc29-a346-4cc8-946c-f8ded1177593 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:30.503952 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-54bddc29-a346-4cc8-946c-f8ded1177593 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a" status: 200 len: 1530 microversion: 2.1 time: 0.831984 Oct 17 13:58:30.504920 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8dc2bd8e-6845-4450-814e-4e7d9920b3f7 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd" status: 200 len: 1507 microversion: 2.1 time: 0.849245 Oct 17 13:58:30.505263 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2501/4864] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:29 2022] GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a => generated 1530 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:30.506237 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2364/4865] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:29 2022] GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd => generated 1507 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:30.520695 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-673df2a0-b04d-4660-b152-1cfe91e25d85 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:30.523523 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-673df2a0-b04d-4660-b152-1cfe91e25d85 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: 70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:30.525647 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-b88c2c0f-8f84-4fa0-98fc-67e36d99f410 req-d6e7f68d-bc5d-4735-bb9f-93be1c5d9fd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63", "name": "network-vif-deleted", "tag": "8db93f70-b338-4752-a078-bf880d8f65a4"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:58:30.546655 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-b88c2c0f-8f84-4fa0-98fc-67e36d99f410 req-d6e7f68d-bc5d-4735-bb9f-93be1c5d9fd6 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:30.550703 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-673df2a0-b04d-4660-b152-1cfe91e25d85 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:30.551477 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-673df2a0-b04d-4660-b152-1cfe91e25d85 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:30.551883 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-b88c2c0f-8f84-4fa0-98fc-67e36d99f410 req-d6e7f68d-bc5d-4735-bb9f-93be1c5d9fd6 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:30.552515 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-b88c2c0f-8f84-4fa0-98fc-67e36d99f410 req-d6e7f68d-bc5d-4735-bb9f-93be1c5d9fd6 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:30.554801 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-673df2a0-b04d-4660-b152-1cfe91e25d85 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:30.556702 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-673df2a0-b04d-4660-b152-1cfe91e25d85 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:30.563953 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-673df2a0-b04d-4660-b152-1cfe91e25d85 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:30.566592 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-673df2a0-b04d-4660-b152-1cfe91e25d85 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:30.574764 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-b88c2c0f-8f84-4fa0-98fc-67e36d99f410 req-d6e7f68d-bc5d-4735-bb9f-93be1c5d9fd6 service nova] Creating event network-vif-deleted:8db93f70-b338-4752-a078-bf880d8f65a4 for instance 70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63 on n-h2-854247-14 Oct 17 13:58:30.587966 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-b88c2c0f-8f84-4fa0-98fc-67e36d99f410 req-d6e7f68d-bc5d-4735-bb9f-93be1c5d9fd6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071947 Oct 17 13:58:30.589953 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2502/4866] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:58:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:58:30.602656 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c32b997e-b6f6-4771-98c8-3e0d1692a5e4 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:30.608171 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c32b997e-b6f6-4771-98c8-3e0d1692a5e4 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: c7875373-8b55-4b5a-b6be-9ce42c255eef] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:30.618511 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c32b997e-b6f6-4771-98c8-3e0d1692a5e4 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:30.619265 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c32b997e-b6f6-4771-98c8-3e0d1692a5e4 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:30.619904 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c32b997e-b6f6-4771-98c8-3e0d1692a5e4 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:30.620797 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c32b997e-b6f6-4771-98c8-3e0d1692a5e4 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:30.621419 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c32b997e-b6f6-4771-98c8-3e0d1692a5e4 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:30.622008 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c32b997e-b6f6-4771-98c8-3e0d1692a5e4 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:30.820226 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-673df2a0-b04d-4660-b152-1cfe91e25d85 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e0edd4df0ec4a079ab988b186fedf00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cd6550628148f9b0ae1907967da048', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:30.829641 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-673df2a0-b04d-4660-b152-1cfe91e25d85 tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63" status: 200 len: 1285 microversion: 2.1 time: 0.322090 Oct 17 13:58:30.838141 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2365/4867] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:30 2022] GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63 => generated 1285 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:31.028293 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c32b997e-b6f6-4771-98c8-3e0d1692a5e4 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:31.048720 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c32b997e-b6f6-4771-98c8-3e0d1692a5e4 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef" status: 200 len: 1511 microversion: 2.1 time: 0.455971 Oct 17 13:58:31.053680 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2503/4868] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:30 2022] GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef => generated 1511 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:31.538853 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e0952d42-9cfb-4ff9-8dd6-c5efb0dd1623 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:31.539598 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1cc9ff38-225c-4d2e-900b-2f8455d5e15d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:31.539817 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1cc9ff38-225c-4d2e-900b-2f8455d5e15d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: ad70195b-4a02-4a69-b6da-1f19fc3a51cd] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:31.541565 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e0952d42-9cfb-4ff9-8dd6-c5efb0dd1623 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 6d2bbd26-cb90-4e90-881f-a9346ee3002a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:31.562053 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e0952d42-9cfb-4ff9-8dd6-c5efb0dd1623 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:31.565294 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e0952d42-9cfb-4ff9-8dd6-c5efb0dd1623 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:31.567565 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1cc9ff38-225c-4d2e-900b-2f8455d5e15d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:31.569194 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1cc9ff38-225c-4d2e-900b-2f8455d5e15d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:31.569702 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e0952d42-9cfb-4ff9-8dd6-c5efb0dd1623 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:31.571602 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e0952d42-9cfb-4ff9-8dd6-c5efb0dd1623 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:31.574460 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1cc9ff38-225c-4d2e-900b-2f8455d5e15d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:31.577255 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e0952d42-9cfb-4ff9-8dd6-c5efb0dd1623 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:31.579541 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1cc9ff38-225c-4d2e-900b-2f8455d5e15d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:31.581786 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1cc9ff38-225c-4d2e-900b-2f8455d5e15d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:31.583562 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e0952d42-9cfb-4ff9-8dd6-c5efb0dd1623 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:31.586396 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1cc9ff38-225c-4d2e-900b-2f8455d5e15d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:32.345845 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e0952d42-9cfb-4ff9-8dd6-c5efb0dd1623 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:32.373305 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e0952d42-9cfb-4ff9-8dd6-c5efb0dd1623 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a" status: 200 len: 1525 microversion: 2.1 time: 0.843821 Oct 17 13:58:32.376625 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2504/4869] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:31 2022] GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a => generated 1525 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:32.390837 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e6baddba-9d8e-4df1-a20b-4065a58da75d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:32.393738 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e6baddba-9d8e-4df1-a20b-4065a58da75d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] [instance: 70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:32.418418 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e6baddba-9d8e-4df1-a20b-4065a58da75d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:32.420443 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e6baddba-9d8e-4df1-a20b-4065a58da75d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:32.421139 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e6baddba-9d8e-4df1-a20b-4065a58da75d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:32.423223 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e6baddba-9d8e-4df1-a20b-4065a58da75d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:32.427811 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e6baddba-9d8e-4df1-a20b-4065a58da75d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:32.428495 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e6baddba-9d8e-4df1-a20b-4065a58da75d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:32.461003 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1cc9ff38-225c-4d2e-900b-2f8455d5e15d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:32.465673 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=100 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:58:32.469744 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-e6baddba-9d8e-4df1-a20b-4065a58da75d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] HTTP exception thrown: Instance 70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63 could not be found. Oct 17 13:58:32.473468 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e6baddba-9d8e-4df1-a20b-4065a58da75d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Request method failure captured: Oct 17 13:58:32.473468 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63 HTTP/1.1 Oct 17 13:58:32.473468 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:58:32.473468 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:58:32.473468 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:58:32.473468 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:58:32.473468 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:58:32.473468 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:58:32.473468 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:58:32.473468 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:58:32.473468 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTV8UthrFKkKhwhhRLtmpkapbeFBs1cRjOOAcJ6FVEQz5zfMt32jfBmweouc2NR2g9oCRX0KHS7sGohyuaYt5uOERdlIdc51xI_6Iz1wlpEz3_hpWAAOyJCXP_rrHxi--42sWot_aydVZahFZN_Hc19c_16zQHamdTaKSUAxdfJ3zk0M Oct 17 13:58:32.473468 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:58:32.473468 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:58:32.473468 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:58:32.473468 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:58:32.473468 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:58:32.473468 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:58:32.473468 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: f5cd6550628148f9b0ae1907967da048 Oct 17 13:58:32.473468 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServerRescueTestJSON-1264941338 Oct 17 13:58:32.473468 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:58:32.473468 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:58:32.473468 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f5cd6550628148f9b0ae1907967da048"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f5cd6550628148f9b0ae1907967da048"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f5cd6550628148f9b0ae1907967da048"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f5cd6550628148f9b0ae1907967da048", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:58:32.473468 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServerRescueTestJSON-1264941338 Oct 17 13:58:32.473468 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: f5cd6550628148f9b0ae1907967da048 Oct 17 13:58:32.473468 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServerRescueTestJSON-1264941338 Oct 17 13:58:32.473468 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServerRescueTestJSON-1264941338-project Oct 17 13:58:32.473468 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:58:32.473468 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:58:32.473468 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 6e0edd4df0ec4a079ab988b186fedf00 Oct 17 13:58:32.473468 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServerRescueTestJSON-1264941338-project Oct 17 13:58:32.473468 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:58:32.473468 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63 could not be found. Oct 17 13:58:32.473468 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63'} Oct 17 13:58:32.473468 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:58:32.473468 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:58:32.473468 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:58:32.473468 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:58:32.473468 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:58:32.473468 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:58:32.473468 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:58:32.473468 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:58:32.473468 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:58:32.473468 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:58:32.473468 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63 could not be found. Oct 17 13:58:32.473468 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:58:32.473468 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:58:32.473468 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:58:32.473468 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:58:32.473468 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:58:32.473468 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:58:32.473468 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:58:32.473468 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:58:32.473468 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:58:32.473468 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:58:32.473468 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:58:32.473468 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:58:32.473468 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:58:32.473468 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:58:32.473468 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:58:32.473468 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:58:32.473468 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63 could not be found. Oct 17 13:58:32.473468 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:58:32.473468 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:58:32.473468 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:58:32.483864 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:58:32.483864 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:58:32.483864 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:58:32.483864 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:58:32.483864 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:58:32.483864 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63 could not be found. Oct 17 13:58:32.483864 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:58:32.487607 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1cc9ff38-225c-4d2e-900b-2f8455d5e15d tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd" status: 200 len: 1507 microversion: 2.1 time: 0.961949 Oct 17 13:58:32.489303 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e6baddba-9d8e-4df1-a20b-4065a58da75d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] Returning 404 to user: Instance 70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:58:32.491879 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2366/4870] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:31 2022] GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd => generated 1507 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:32.496694 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e6baddba-9d8e-4df1-a20b-4065a58da75d tempest-ServerRescueTestJSON-1264941338 tempest-ServerRescueTestJSON-1264941338-project] 10.222.0.79 "GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63" status: 404 len: 111 microversion: 2.1 time: 0.114924 Oct 17 13:58:32.497777 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2505/4871] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:32 2022] GET /compute/v2.1/servers/70f5bbd4-ac71-44aa-8222-1cf1dc4b6a63 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:58:32.510341 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1d5e4b44-ac21-4e12-a4ec-f8d835bc8396 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:32.511399 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1d5e4b44-ac21-4e12-a4ec-f8d835bc8396 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: c7875373-8b55-4b5a-b6be-9ce42c255eef] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:32.525875 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1d5e4b44-ac21-4e12-a4ec-f8d835bc8396 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:32.527448 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1d5e4b44-ac21-4e12-a4ec-f8d835bc8396 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:32.528748 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1d5e4b44-ac21-4e12-a4ec-f8d835bc8396 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:32.529978 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1d5e4b44-ac21-4e12-a4ec-f8d835bc8396 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:32.533233 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1d5e4b44-ac21-4e12-a4ec-f8d835bc8396 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:32.534016 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1d5e4b44-ac21-4e12-a4ec-f8d835bc8396 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:33.403669 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-16622bc6-0631-4147-a70b-638051720eea tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:33.405013 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-16622bc6-0631-4147-a70b-638051720eea tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 6d2bbd26-cb90-4e90-881f-a9346ee3002a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:33.408589 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:58:33.419921 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-16622bc6-0631-4147-a70b-638051720eea tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:33.423181 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-16622bc6-0631-4147-a70b-638051720eea tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:33.423833 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-16622bc6-0631-4147-a70b-638051720eea tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:33.424821 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-16622bc6-0631-4147-a70b-638051720eea tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:33.426458 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-16622bc6-0631-4147-a70b-638051720eea tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:33.427721 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-16622bc6-0631-4147-a70b-638051720eea tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:33.447185 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1d5e4b44-ac21-4e12-a4ec-f8d835bc8396 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:33.458869 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1d5e4b44-ac21-4e12-a4ec-f8d835bc8396 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef" status: 200 len: 1511 microversion: 2.1 time: 0.962767 Oct 17 13:58:33.478952 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2367/4872] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:32 2022] GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef => generated 1511 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:33.520318 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-530b9fb4-3092-4840-96d1-2afcc6507a1f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:33.522183 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-530b9fb4-3092-4840-96d1-2afcc6507a1f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: ad70195b-4a02-4a69-b6da-1f19fc3a51cd] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:33.544091 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-530b9fb4-3092-4840-96d1-2afcc6507a1f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:33.544602 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-530b9fb4-3092-4840-96d1-2afcc6507a1f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:33.545044 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-530b9fb4-3092-4840-96d1-2afcc6507a1f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:33.545767 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-530b9fb4-3092-4840-96d1-2afcc6507a1f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:33.546216 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-530b9fb4-3092-4840-96d1-2afcc6507a1f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:33.546634 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-530b9fb4-3092-4840-96d1-2afcc6507a1f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:34.069833 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-16622bc6-0631-4147-a70b-638051720eea tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:34.098659 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-16622bc6-0631-4147-a70b-638051720eea tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a" status: 200 len: 1525 microversion: 2.1 time: 0.699106 Oct 17 13:58:34.099429 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2506/4873] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:33 2022] GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a => generated 1525 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:34.221988 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-8b499a69-9797-4c18-a419-de5c4d13608e req-ede99764-8f17-4444-9e3a-a1ac0f28bd3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d2bbd26-cb90-4e90-881f-a9346ee3002a", "name": "network-vif-plugged", "status": "completed", "tag": "7709c35f-ab2e-4e7f-8507-786eb35a55e3"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:58:34.261047 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-8b499a69-9797-4c18-a419-de5c4d13608e req-ede99764-8f17-4444-9e3a-a1ac0f28bd3f service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:34.261854 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-8b499a69-9797-4c18-a419-de5c4d13608e req-ede99764-8f17-4444-9e3a-a1ac0f28bd3f service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:34.262515 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-8b499a69-9797-4c18-a419-de5c4d13608e req-ede99764-8f17-4444-9e3a-a1ac0f28bd3f service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:34.296606 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-8b499a69-9797-4c18-a419-de5c4d13608e req-ede99764-8f17-4444-9e3a-a1ac0f28bd3f service nova] Creating event network-vif-plugged:7709c35f-ab2e-4e7f-8507-786eb35a55e3 for instance 6d2bbd26-cb90-4e90-881f-a9346ee3002a on n-h2-854247-14 Oct 17 13:58:34.312065 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-8b499a69-9797-4c18-a419-de5c4d13608e req-ede99764-8f17-4444-9e3a-a1ac0f28bd3f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097237 Oct 17 13:58:34.313386 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2507/4874] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:58:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:58:34.486733 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-41e7a913-01ac-40bf-91bd-619ed6082fb1 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:34.490452 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-41e7a913-01ac-40bf-91bd-619ed6082fb1 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: c7875373-8b55-4b5a-b6be-9ce42c255eef] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:34.512804 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-41e7a913-01ac-40bf-91bd-619ed6082fb1 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:34.516081 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-41e7a913-01ac-40bf-91bd-619ed6082fb1 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:34.518016 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-41e7a913-01ac-40bf-91bd-619ed6082fb1 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:34.520760 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-41e7a913-01ac-40bf-91bd-619ed6082fb1 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:34.521520 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-41e7a913-01ac-40bf-91bd-619ed6082fb1 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:34.524063 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-41e7a913-01ac-40bf-91bd-619ed6082fb1 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:34.578660 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-530b9fb4-3092-4840-96d1-2afcc6507a1f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:34.594055 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-530b9fb4-3092-4840-96d1-2afcc6507a1f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd" status: 200 len: 1507 microversion: 2.1 time: 1.079845 Oct 17 13:58:34.597607 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2368/4875] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:33 2022] GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd => generated 1507 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:58:35.135248 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-543a9845-ac66-4562-a66a-71d01ced4af8 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:35.135965 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-543a9845-ac66-4562-a66a-71d01ced4af8 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 6d2bbd26-cb90-4e90-881f-a9346ee3002a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:35.163533 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-543a9845-ac66-4562-a66a-71d01ced4af8 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:35.164518 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-543a9845-ac66-4562-a66a-71d01ced4af8 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:35.173387 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-543a9845-ac66-4562-a66a-71d01ced4af8 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:35.174413 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-543a9845-ac66-4562-a66a-71d01ced4af8 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:35.174942 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-543a9845-ac66-4562-a66a-71d01ced4af8 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:35.175455 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-543a9845-ac66-4562-a66a-71d01ced4af8 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:36.088478 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-543a9845-ac66-4562-a66a-71d01ced4af8 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:36.101769 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-543a9845-ac66-4562-a66a-71d01ced4af8 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a" status: 200 len: 1525 microversion: 2.1 time: 0.968997 Oct 17 13:58:36.102369 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2369/4876] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:35 2022] GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a => generated 1525 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:58:36.121226 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8067571b-7909-4693-b4e9-26c9e16503ac tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:36.123456 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8067571b-7909-4693-b4e9-26c9e16503ac tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: ad70195b-4a02-4a69-b6da-1f19fc3a51cd] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:36.145148 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8067571b-7909-4693-b4e9-26c9e16503ac tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:36.149550 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8067571b-7909-4693-b4e9-26c9e16503ac tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:36.150108 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8067571b-7909-4693-b4e9-26c9e16503ac tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:36.150952 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8067571b-7909-4693-b4e9-26c9e16503ac tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:36.151555 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8067571b-7909-4693-b4e9-26c9e16503ac tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:36.152073 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8067571b-7909-4693-b4e9-26c9e16503ac tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:36.228114 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-41e7a913-01ac-40bf-91bd-619ed6082fb1 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:36.238220 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-41e7a913-01ac-40bf-91bd-619ed6082fb1 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef" status: 200 len: 1511 microversion: 2.1 time: 1.757667 Oct 17 13:58:36.240009 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2508/4877] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:34 2022] GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef => generated 1511 bytes in 1761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:36.393353 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8067571b-7909-4693-b4e9-26c9e16503ac tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:36.403636 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8067571b-7909-4693-b4e9-26c9e16503ac tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd" status: 200 len: 1507 microversion: 2.1 time: 0.299053 Oct 17 13:58:36.411584 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2370/4878] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:36 2022] GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd => generated 1507 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:37.196258 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-886f8e3a-bc43-46a5-a8c9-c80fad8b8323 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:37.197297 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-886f8e3a-bc43-46a5-a8c9-c80fad8b8323 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 6d2bbd26-cb90-4e90-881f-a9346ee3002a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:37.231108 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-886f8e3a-bc43-46a5-a8c9-c80fad8b8323 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:37.234843 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-886f8e3a-bc43-46a5-a8c9-c80fad8b8323 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:37.235704 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-886f8e3a-bc43-46a5-a8c9-c80fad8b8323 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:37.238713 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-886f8e3a-bc43-46a5-a8c9-c80fad8b8323 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:37.239212 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-886f8e3a-bc43-46a5-a8c9-c80fad8b8323 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:37.239655 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-886f8e3a-bc43-46a5-a8c9-c80fad8b8323 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:37.269465 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3789616c-2ff6-4756-bc94-205f7d66563b tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:37.270239 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3789616c-2ff6-4756-bc94-205f7d66563b tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: c7875373-8b55-4b5a-b6be-9ce42c255eef] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:37.296587 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3789616c-2ff6-4756-bc94-205f7d66563b tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:37.297952 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3789616c-2ff6-4756-bc94-205f7d66563b tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:37.299697 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3789616c-2ff6-4756-bc94-205f7d66563b tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:37.300579 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3789616c-2ff6-4756-bc94-205f7d66563b tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:37.304088 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3789616c-2ff6-4756-bc94-205f7d66563b tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:37.304660 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3789616c-2ff6-4756-bc94-205f7d66563b tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:37.312711 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:58:37.862596 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-886f8e3a-bc43-46a5-a8c9-c80fad8b8323 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:37.879583 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-886f8e3a-bc43-46a5-a8c9-c80fad8b8323 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a" status: 200 len: 1525 microversion: 2.1 time: 0.687446 Oct 17 13:58:37.880897 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2509/4879] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:37 2022] GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a => generated 1525 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:37.887202 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c19cdf4a-dc95-4d04-a453-59d6b0503b1f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:37.900172 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c19cdf4a-dc95-4d04-a453-59d6b0503b1f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: ad70195b-4a02-4a69-b6da-1f19fc3a51cd] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:37.907633 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c19cdf4a-dc95-4d04-a453-59d6b0503b1f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:37.908427 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c19cdf4a-dc95-4d04-a453-59d6b0503b1f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:37.915455 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c19cdf4a-dc95-4d04-a453-59d6b0503b1f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:37.916573 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c19cdf4a-dc95-4d04-a453-59d6b0503b1f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:37.917244 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c19cdf4a-dc95-4d04-a453-59d6b0503b1f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:37.917849 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c19cdf4a-dc95-4d04-a453-59d6b0503b1f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:38.109439 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3789616c-2ff6-4756-bc94-205f7d66563b tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:38.124636 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3789616c-2ff6-4756-bc94-205f7d66563b tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef" status: 200 len: 1511 microversion: 2.1 time: 0.861197 Oct 17 13:58:38.127710 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2371/4880] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:37 2022] GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef => generated 1511 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:58:38.544400 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c19cdf4a-dc95-4d04-a453-59d6b0503b1f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:38.553407 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c19cdf4a-dc95-4d04-a453-59d6b0503b1f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd" status: 200 len: 1507 microversion: 2.1 time: 0.671188 Oct 17 13:58:38.554325 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2510/4881] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:37 2022] GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd => generated 1507 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:38.911278 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-69341d70-cedd-4857-a482-91b98a93e96c tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:38.912225 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-69341d70-cedd-4857-a482-91b98a93e96c tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 6d2bbd26-cb90-4e90-881f-a9346ee3002a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:38.942887 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69341d70-cedd-4857-a482-91b98a93e96c tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:38.946770 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69341d70-cedd-4857-a482-91b98a93e96c tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:38.948419 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69341d70-cedd-4857-a482-91b98a93e96c tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:38.951609 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69341d70-cedd-4857-a482-91b98a93e96c tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:38.952101 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69341d70-cedd-4857-a482-91b98a93e96c tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:38.957110 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69341d70-cedd-4857-a482-91b98a93e96c tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:39.155204 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9ffc2ea0-179a-4394-9692-8157aac54726 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:39.156016 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9ffc2ea0-179a-4394-9692-8157aac54726 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: c7875373-8b55-4b5a-b6be-9ce42c255eef] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:39.166888 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9ffc2ea0-179a-4394-9692-8157aac54726 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:39.167428 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9ffc2ea0-179a-4394-9692-8157aac54726 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:39.167868 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9ffc2ea0-179a-4394-9692-8157aac54726 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:39.170675 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9ffc2ea0-179a-4394-9692-8157aac54726 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:39.170675 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9ffc2ea0-179a-4394-9692-8157aac54726 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:39.170675 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9ffc2ea0-179a-4394-9692-8157aac54726 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:39.815830 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-69341d70-cedd-4857-a482-91b98a93e96c tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:39.830266 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-69341d70-cedd-4857-a482-91b98a93e96c tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a" status: 200 len: 1525 microversion: 2.1 time: 0.924061 Oct 17 13:58:39.836385 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2372/4882] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:38 2022] GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a => generated 1525 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:39.862076 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8eb05add-de88-42b7-bf90-391e6af90b70 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:39.863291 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8eb05add-de88-42b7-bf90-391e6af90b70 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: ad70195b-4a02-4a69-b6da-1f19fc3a51cd] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:39.901056 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8eb05add-de88-42b7-bf90-391e6af90b70 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:39.901668 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8eb05add-de88-42b7-bf90-391e6af90b70 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:39.902155 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8eb05add-de88-42b7-bf90-391e6af90b70 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:39.903413 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8eb05add-de88-42b7-bf90-391e6af90b70 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:39.903923 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8eb05add-de88-42b7-bf90-391e6af90b70 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:39.904361 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8eb05add-de88-42b7-bf90-391e6af90b70 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:39.940377 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9ffc2ea0-179a-4394-9692-8157aac54726 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:39.954274 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9ffc2ea0-179a-4394-9692-8157aac54726 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef" status: 200 len: 1511 microversion: 2.1 time: 0.799496 Oct 17 13:58:39.966791 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2511/4883] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:39 2022] GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef => generated 1511 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:40.317184 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8eb05add-de88-42b7-bf90-391e6af90b70 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:40.334043 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8eb05add-de88-42b7-bf90-391e6af90b70 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd" status: 200 len: 1507 microversion: 2.1 time: 0.491858 Oct 17 13:58:40.351363 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2373/4884] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:39 2022] GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd => generated 1507 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:40.862438 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4cdfaf41-773a-4128-8950-93dc47fdfb57 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:40.864328 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4cdfaf41-773a-4128-8950-93dc47fdfb57 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 6d2bbd26-cb90-4e90-881f-a9346ee3002a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:40.880383 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4cdfaf41-773a-4128-8950-93dc47fdfb57 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:40.881683 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4cdfaf41-773a-4128-8950-93dc47fdfb57 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:40.883589 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4cdfaf41-773a-4128-8950-93dc47fdfb57 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:40.893492 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4cdfaf41-773a-4128-8950-93dc47fdfb57 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:40.894508 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4cdfaf41-773a-4128-8950-93dc47fdfb57 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:40.895369 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4cdfaf41-773a-4128-8950-93dc47fdfb57 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:40.983921 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-cf4ea994-aa9e-4a43-99b4-0fa4335b6e83 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:40.985376 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-cf4ea994-aa9e-4a43-99b4-0fa4335b6e83 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: c7875373-8b55-4b5a-b6be-9ce42c255eef] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:41.003500 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cf4ea994-aa9e-4a43-99b4-0fa4335b6e83 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:41.007947 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cf4ea994-aa9e-4a43-99b4-0fa4335b6e83 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:41.009487 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cf4ea994-aa9e-4a43-99b4-0fa4335b6e83 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:41.011766 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cf4ea994-aa9e-4a43-99b4-0fa4335b6e83 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:41.020748 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cf4ea994-aa9e-4a43-99b4-0fa4335b6e83 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:41.021983 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cf4ea994-aa9e-4a43-99b4-0fa4335b6e83 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:41.430549 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4cdfaf41-773a-4128-8950-93dc47fdfb57 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:41.449120 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4cdfaf41-773a-4128-8950-93dc47fdfb57 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a" status: 200 len: 1525 microversion: 2.1 time: 0.595795 Oct 17 13:58:41.450380 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2512/4885] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:40 2022] GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a => generated 1525 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:41.455554 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3badecbf-0617-43ec-bc0c-b4c801249a6a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:41.468090 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3badecbf-0617-43ec-bc0c-b4c801249a6a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: ad70195b-4a02-4a69-b6da-1f19fc3a51cd] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:41.477097 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3badecbf-0617-43ec-bc0c-b4c801249a6a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:41.477887 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3badecbf-0617-43ec-bc0c-b4c801249a6a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:41.478488 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3badecbf-0617-43ec-bc0c-b4c801249a6a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:41.479454 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3badecbf-0617-43ec-bc0c-b4c801249a6a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:41.487001 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3badecbf-0617-43ec-bc0c-b4c801249a6a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:41.487851 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3badecbf-0617-43ec-bc0c-b4c801249a6a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:42.244083 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-cf4ea994-aa9e-4a43-99b4-0fa4335b6e83 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:42.262068 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-cf4ea994-aa9e-4a43-99b4-0fa4335b6e83 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef" status: 200 len: 1511 microversion: 2.1 time: 1.280470 Oct 17 13:58:42.265252 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2374/4886] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:40 2022] GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef => generated 1511 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:42.473983 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1b2a7013-26ec-4601-b1dc-5807e7357542 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:42.475306 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1b2a7013-26ec-4601-b1dc-5807e7357542 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 6d2bbd26-cb90-4e90-881f-a9346ee3002a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:42.498589 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1b2a7013-26ec-4601-b1dc-5807e7357542 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:42.511611 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1b2a7013-26ec-4601-b1dc-5807e7357542 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:42.532957 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1b2a7013-26ec-4601-b1dc-5807e7357542 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:42.533933 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1b2a7013-26ec-4601-b1dc-5807e7357542 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:42.534434 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1b2a7013-26ec-4601-b1dc-5807e7357542 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:42.534880 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1b2a7013-26ec-4601-b1dc-5807e7357542 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:42.838817 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3badecbf-0617-43ec-bc0c-b4c801249a6a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:42.848957 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3badecbf-0617-43ec-bc0c-b4c801249a6a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd" status: 200 len: 1507 microversion: 2.1 time: 1.397267 Oct 17 13:58:42.889517 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2513/4887] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:41 2022] GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd => generated 1507 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:43.293684 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a5bb7066-e6f3-4b76-905b-8f019b1a5f7f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:43.294720 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a5bb7066-e6f3-4b76-905b-8f019b1a5f7f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: c7875373-8b55-4b5a-b6be-9ce42c255eef] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:43.304418 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a5bb7066-e6f3-4b76-905b-8f019b1a5f7f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:43.315519 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a5bb7066-e6f3-4b76-905b-8f019b1a5f7f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:43.319154 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a5bb7066-e6f3-4b76-905b-8f019b1a5f7f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:43.320374 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a5bb7066-e6f3-4b76-905b-8f019b1a5f7f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:43.321575 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a5bb7066-e6f3-4b76-905b-8f019b1a5f7f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:43.329361 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a5bb7066-e6f3-4b76-905b-8f019b1a5f7f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:44.416151 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1b2a7013-26ec-4601-b1dc-5807e7357542 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:44.425720 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1b2a7013-26ec-4601-b1dc-5807e7357542 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a" status: 200 len: 1525 microversion: 2.1 time: 1.956422 Oct 17 13:58:44.431697 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2375/4888] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:42 2022] GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a => generated 1525 bytes in 1963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:58:44.450055 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ebc2aa56-bf49-4ac0-bf3a-eacc7438c9b9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:44.451104 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ebc2aa56-bf49-4ac0-bf3a-eacc7438c9b9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: ad70195b-4a02-4a69-b6da-1f19fc3a51cd] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:44.462732 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=67 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:58:44.470210 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ebc2aa56-bf49-4ac0-bf3a-eacc7438c9b9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:44.471500 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ebc2aa56-bf49-4ac0-bf3a-eacc7438c9b9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:44.472374 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ebc2aa56-bf49-4ac0-bf3a-eacc7438c9b9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:44.473351 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ebc2aa56-bf49-4ac0-bf3a-eacc7438c9b9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:44.474040 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ebc2aa56-bf49-4ac0-bf3a-eacc7438c9b9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:44.478388 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ebc2aa56-bf49-4ac0-bf3a-eacc7438c9b9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:44.658757 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a5bb7066-e6f3-4b76-905b-8f019b1a5f7f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:44.673907 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a5bb7066-e6f3-4b76-905b-8f019b1a5f7f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef" status: 200 len: 1488 microversion: 2.1 time: 1.382636 Oct 17 13:58:44.674715 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2514/4889] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:43 2022] GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef => generated 1488 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:44.698267 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3e2b4161-05af-4d2d-ae2b-f4297a608173 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-25112261"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:58:44.701123 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3e2b4161-05af-4d2d-ae2b-f4297a608173 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: c7875373-8b55-4b5a-b6be-9ce42c255eef] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:44.708011 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3e2b4161-05af-4d2d-ae2b-f4297a608173 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:44.708792 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3e2b4161-05af-4d2d-ae2b-f4297a608173 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:44.709402 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3e2b4161-05af-4d2d-ae2b-f4297a608173 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:44.710352 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3e2b4161-05af-4d2d-ae2b-f4297a608173 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:44.710987 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3e2b4161-05af-4d2d-ae2b-f4297a608173 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:44.711607 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3e2b4161-05af-4d2d-ae2b-f4297a608173 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:44.795157 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3e2b4161-05af-4d2d-ae2b-f4297a608173 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "PUT /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef" status: 200 len: 1059 microversion: 2.1 time: 0.101290 Oct 17 13:58:44.810717 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2515/4890] 10.222.0.79 () {60 vars in 1256 bytes} [Mon Oct 17 13:58:44 2022] PUT /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef => generated 1059 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:44.816927 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-73247d96-155a-4074-92d7-c09af1a63008 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:44.822771 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-73247d96-155a-4074-92d7-c09af1a63008 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: c7875373-8b55-4b5a-b6be-9ce42c255eef] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:44.837259 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-73247d96-155a-4074-92d7-c09af1a63008 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:44.838061 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-73247d96-155a-4074-92d7-c09af1a63008 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:44.838655 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-73247d96-155a-4074-92d7-c09af1a63008 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:44.841707 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-73247d96-155a-4074-92d7-c09af1a63008 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:44.842361 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-73247d96-155a-4074-92d7-c09af1a63008 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:44.843662 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-73247d96-155a-4074-92d7-c09af1a63008 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:45.202535 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ebc2aa56-bf49-4ac0-bf3a-eacc7438c9b9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:45.214558 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ebc2aa56-bf49-4ac0-bf3a-eacc7438c9b9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd" status: 200 len: 1507 microversion: 2.1 time: 0.777317 Oct 17 13:58:45.215487 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2376/4891] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:44 2022] GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd => generated 1507 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:45.453458 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-76df601e-574e-4743-abe1-4d7403213acf tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:45.454280 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-76df601e-574e-4743-abe1-4d7403213acf tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 6d2bbd26-cb90-4e90-881f-a9346ee3002a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:45.466990 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-76df601e-574e-4743-abe1-4d7403213acf tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:45.469593 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-76df601e-574e-4743-abe1-4d7403213acf tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:45.470214 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-76df601e-574e-4743-abe1-4d7403213acf tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:45.470803 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-76df601e-574e-4743-abe1-4d7403213acf tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:45.471312 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-76df601e-574e-4743-abe1-4d7403213acf tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:45.471887 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-76df601e-574e-4743-abe1-4d7403213acf tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:45.679712 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-73247d96-155a-4074-92d7-c09af1a63008 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:45.688192 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-73247d96-155a-4074-92d7-c09af1a63008 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef" status: 200 len: 1486 microversion: 2.1 time: 0.875447 Oct 17 13:58:45.699544 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2516/4892] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:44 2022] GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef => generated 1486 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:45.726266 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c6fe096e-d56f-4d24-9de8-65ab1fef7c09 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:45.726890 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c6fe096e-d56f-4d24-9de8-65ab1fef7c09 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: c7875373-8b55-4b5a-b6be-9ce42c255eef] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:45.736223 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c6fe096e-d56f-4d24-9de8-65ab1fef7c09 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:45.739749 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c6fe096e-d56f-4d24-9de8-65ab1fef7c09 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:45.740228 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c6fe096e-d56f-4d24-9de8-65ab1fef7c09 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:45.740968 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c6fe096e-d56f-4d24-9de8-65ab1fef7c09 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:45.741426 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c6fe096e-d56f-4d24-9de8-65ab1fef7c09 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:45.741844 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c6fe096e-d56f-4d24-9de8-65ab1fef7c09 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:46.111311 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-76df601e-574e-4743-abe1-4d7403213acf tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:46.130204 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-76df601e-574e-4743-abe1-4d7403213acf tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a" status: 200 len: 1525 microversion: 2.1 time: 0.681182 Oct 17 13:58:46.146939 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2377/4893] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:45 2022] GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a => generated 1525 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:46.240460 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-138e0e93-7be0-44b4-bd0e-993191745473 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:46.241379 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-138e0e93-7be0-44b4-bd0e-993191745473 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: ad70195b-4a02-4a69-b6da-1f19fc3a51cd] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:46.253209 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-138e0e93-7be0-44b4-bd0e-993191745473 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:46.258315 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-138e0e93-7be0-44b4-bd0e-993191745473 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:46.258979 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-138e0e93-7be0-44b4-bd0e-993191745473 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:46.259915 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-138e0e93-7be0-44b4-bd0e-993191745473 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:46.263004 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-138e0e93-7be0-44b4-bd0e-993191745473 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:46.263663 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-138e0e93-7be0-44b4-bd0e-993191745473 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:46.709045 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c6fe096e-d56f-4d24-9de8-65ab1fef7c09 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:46.720183 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c6fe096e-d56f-4d24-9de8-65ab1fef7c09 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef" status: 200 len: 1486 microversion: 2.1 time: 0.997937 Oct 17 13:58:46.724109 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2517/4894] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:45 2022] GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef => generated 1486 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:58:46.754270 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9b1d7122-aea4-4393-9e57-e8004b818b9f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:46.755068 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9b1d7122-aea4-4393-9e57-e8004b818b9f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: c7875373-8b55-4b5a-b6be-9ce42c255eef] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:46.775823 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9b1d7122-aea4-4393-9e57-e8004b818b9f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:46.778218 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9b1d7122-aea4-4393-9e57-e8004b818b9f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:46.781507 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9b1d7122-aea4-4393-9e57-e8004b818b9f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:46.783765 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9b1d7122-aea4-4393-9e57-e8004b818b9f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:46.785343 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9b1d7122-aea4-4393-9e57-e8004b818b9f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:46.787227 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9b1d7122-aea4-4393-9e57-e8004b818b9f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:46.881053 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9b1d7122-aea4-4393-9e57-e8004b818b9f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: c7875373-8b55-4b5a-b6be-9ce42c255eef] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:58:47.188044 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-138e0e93-7be0-44b4-bd0e-993191745473 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:47.215554 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-138e0e93-7be0-44b4-bd0e-993191745473 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd" status: 200 len: 1504 microversion: 2.1 time: 0.981267 Oct 17 13:58:47.216753 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9b1d7122-aea4-4393-9e57-e8004b818b9f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef" status: 204 len: 0 microversion: 2.1 time: 0.467124 Oct 17 13:58:47.222610 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2518/4895] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:58:46 2022] DELETE /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef => generated 0 bytes in 469 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 13:58:47.232440 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-44db606e-5a19-40fb-a1ff-437dd58c1bb0 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:47.232440 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-44db606e-5a19-40fb-a1ff-437dd58c1bb0 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 6d2bbd26-cb90-4e90-881f-a9346ee3002a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:47.241128 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-44db606e-5a19-40fb-a1ff-437dd58c1bb0 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:47.241795 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2378/4896] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:46 2022] GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd => generated 1504 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:58:47.249568 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2aab7c16-5bda-4153-9e47-66a4ffa23a11 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:47.251513 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2aab7c16-5bda-4153-9e47-66a4ffa23a11 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: c7875373-8b55-4b5a-b6be-9ce42c255eef] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:47.252541 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-44db606e-5a19-40fb-a1ff-437dd58c1bb0 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:47.253874 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-44db606e-5a19-40fb-a1ff-437dd58c1bb0 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:47.254920 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-44db606e-5a19-40fb-a1ff-437dd58c1bb0 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:47.258194 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-44db606e-5a19-40fb-a1ff-437dd58c1bb0 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:47.258874 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-44db606e-5a19-40fb-a1ff-437dd58c1bb0 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:47.284792 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2aab7c16-5bda-4153-9e47-66a4ffa23a11 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:47.285826 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2aab7c16-5bda-4153-9e47-66a4ffa23a11 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:47.290634 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2aab7c16-5bda-4153-9e47-66a4ffa23a11 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:47.291421 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2aab7c16-5bda-4153-9e47-66a4ffa23a11 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:47.295811 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2aab7c16-5bda-4153-9e47-66a4ffa23a11 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:47.296344 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2aab7c16-5bda-4153-9e47-66a4ffa23a11 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:48.141599 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-44db606e-5a19-40fb-a1ff-437dd58c1bb0 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:48.149380 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-44db606e-5a19-40fb-a1ff-437dd58c1bb0 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a" status: 200 len: 1525 microversion: 2.1 time: 0.930485 Oct 17 13:58:48.154125 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2519/4897] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:47 2022] GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a => generated 1525 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:48.201945 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2aab7c16-5bda-4153-9e47-66a4ffa23a11 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:48.227611 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2aab7c16-5bda-4153-9e47-66a4ffa23a11 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef" status: 200 len: 1492 microversion: 2.1 time: 0.984300 Oct 17 13:58:48.231233 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2379/4898] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:47 2022] GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef => generated 1492 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:48.252997 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-152db0ec-2b76-45d0-afbf-e6819c1c84b3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:48.254558 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-152db0ec-2b76-45d0-afbf-e6819c1c84b3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: ad70195b-4a02-4a69-b6da-1f19fc3a51cd] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:48.287346 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-152db0ec-2b76-45d0-afbf-e6819c1c84b3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:48.287865 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-152db0ec-2b76-45d0-afbf-e6819c1c84b3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:48.288328 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-152db0ec-2b76-45d0-afbf-e6819c1c84b3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:48.289071 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-152db0ec-2b76-45d0-afbf-e6819c1c84b3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:48.291515 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-152db0ec-2b76-45d0-afbf-e6819c1c84b3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:48.293069 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-152db0ec-2b76-45d0-afbf-e6819c1c84b3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:48.672682 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-152db0ec-2b76-45d0-afbf-e6819c1c84b3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:48.687229 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-152db0ec-2b76-45d0-afbf-e6819c1c84b3 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd" status: 200 len: 1504 microversion: 2.1 time: 0.438218 Oct 17 13:58:48.692045 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2520/4899] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:48 2022] GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd => generated 1504 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:48.958350 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-7155e71b-ba90-42c3-92b7-988481a1edf7 req-d08a7376-1d22-4654-942c-1b404b465a27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad70195b-4a02-4a69-b6da-1f19fc3a51cd", "name": "network-vif-unplugged", "status": "completed", "tag": "6f5c8902-466c-4ca2-9d94-db58249199e2"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:58:48.979994 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-7155e71b-ba90-42c3-92b7-988481a1edf7 req-d08a7376-1d22-4654-942c-1b404b465a27 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:48.980790 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-7155e71b-ba90-42c3-92b7-988481a1edf7 req-d08a7376-1d22-4654-942c-1b404b465a27 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:48.982419 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-7155e71b-ba90-42c3-92b7-988481a1edf7 req-d08a7376-1d22-4654-942c-1b404b465a27 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:49.023840 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-7155e71b-ba90-42c3-92b7-988481a1edf7 req-d08a7376-1d22-4654-942c-1b404b465a27 service nova] Creating event network-vif-unplugged:6f5c8902-466c-4ca2-9d94-db58249199e2 for instance ad70195b-4a02-4a69-b6da-1f19fc3a51cd on n-h1-854247-14 Oct 17 13:58:49.039834 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-7155e71b-ba90-42c3-92b7-988481a1edf7 req-d08a7376-1d22-4654-942c-1b404b465a27 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087567 Oct 17 13:58:49.042213 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2380/4900] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:58:49.187147 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f827ec45-2ffc-4ee3-a533-f1bfe94fec18 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:49.188294 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f827ec45-2ffc-4ee3-a533-f1bfe94fec18 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 6d2bbd26-cb90-4e90-881f-a9346ee3002a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:49.212474 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f827ec45-2ffc-4ee3-a533-f1bfe94fec18 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:49.219426 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f827ec45-2ffc-4ee3-a533-f1bfe94fec18 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:49.223790 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f827ec45-2ffc-4ee3-a533-f1bfe94fec18 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:49.227575 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f827ec45-2ffc-4ee3-a533-f1bfe94fec18 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:49.228076 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f827ec45-2ffc-4ee3-a533-f1bfe94fec18 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:49.232193 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f827ec45-2ffc-4ee3-a533-f1bfe94fec18 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:49.257159 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b549fbb4-3445-4079-ab12-e47791b93ad0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:49.258285 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b549fbb4-3445-4079-ab12-e47791b93ad0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: c7875373-8b55-4b5a-b6be-9ce42c255eef] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:49.301667 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b549fbb4-3445-4079-ab12-e47791b93ad0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:49.303748 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b549fbb4-3445-4079-ab12-e47791b93ad0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:49.305172 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b549fbb4-3445-4079-ab12-e47791b93ad0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:49.306351 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b549fbb4-3445-4079-ab12-e47791b93ad0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:49.314497 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b549fbb4-3445-4079-ab12-e47791b93ad0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:49.316532 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b549fbb4-3445-4079-ab12-e47791b93ad0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:50.763578 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b549fbb4-3445-4079-ab12-e47791b93ad0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:50.766959 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f827ec45-2ffc-4ee3-a533-f1bfe94fec18 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:50.772547 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b549fbb4-3445-4079-ab12-e47791b93ad0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef" status: 200 len: 1492 microversion: 2.1 time: 1.521538 Oct 17 13:58:50.781572 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2381/4901] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:49 2022] GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef => generated 1492 bytes in 1532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:50.786765 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-76da2491-9268-421f-a5d3-ef9abf8148fc tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:50.794563 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f827ec45-2ffc-4ee3-a533-f1bfe94fec18 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a" status: 200 len: 1525 microversion: 2.1 time: 1.613335 Oct 17 13:58:50.796059 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2521/4902] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:49 2022] GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a => generated 1525 bytes in 1616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:50.808106 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-76da2491-9268-421f-a5d3-ef9abf8148fc tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: ad70195b-4a02-4a69-b6da-1f19fc3a51cd] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:50.832142 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-76da2491-9268-421f-a5d3-ef9abf8148fc tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:50.832636 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-76da2491-9268-421f-a5d3-ef9abf8148fc tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:50.833069 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-76da2491-9268-421f-a5d3-ef9abf8148fc tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:50.833778 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-76da2491-9268-421f-a5d3-ef9abf8148fc tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:50.834223 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-76da2491-9268-421f-a5d3-ef9abf8148fc tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:50.834637 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-76da2491-9268-421f-a5d3-ef9abf8148fc tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:51.497399 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-76da2491-9268-421f-a5d3-ef9abf8148fc tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:51.506861 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-76da2491-9268-421f-a5d3-ef9abf8148fc tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd" status: 200 len: 1447 microversion: 2.1 time: 0.723928 Oct 17 13:58:51.508620 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2382/4903] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:50 2022] GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd => generated 1447 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:51.531864 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-665ac963-0a3d-4198-84d1-b6bae678afee tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:51.532695 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-665ac963-0a3d-4198-84d1-b6bae678afee tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:51.544725 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-665ac963-0a3d-4198-84d1-b6bae678afee tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:51.545473 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-665ac963-0a3d-4198-84d1-b6bae678afee tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:51.546072 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-665ac963-0a3d-4198-84d1-b6bae678afee tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:51.547055 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-665ac963-0a3d-4198-84d1-b6bae678afee tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:51.547805 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-665ac963-0a3d-4198-84d1-b6bae678afee tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:51.548392 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-665ac963-0a3d-4198-84d1-b6bae678afee tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:51.810326 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e742162d-11e5-4c24-94e3-9a8f4e52b919 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:51.811635 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e742162d-11e5-4c24-94e3-9a8f4e52b919 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: c7875373-8b55-4b5a-b6be-9ce42c255eef] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:51.831721 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e742162d-11e5-4c24-94e3-9a8f4e52b919 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:51.832424 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e742162d-11e5-4c24-94e3-9a8f4e52b919 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:51.833179 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e742162d-11e5-4c24-94e3-9a8f4e52b919 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:51.834207 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e742162d-11e5-4c24-94e3-9a8f4e52b919 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:51.837332 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e742162d-11e5-4c24-94e3-9a8f4e52b919 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:51.838026 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e742162d-11e5-4c24-94e3-9a8f4e52b919 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:52.020348 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e742162d-11e5-4c24-94e3-9a8f4e52b919 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:52.027265 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-665ac963-0a3d-4198-84d1-b6bae678afee tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:52.035022 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e742162d-11e5-4c24-94e3-9a8f4e52b919 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef" status: 200 len: 1450 microversion: 2.1 time: 0.229151 Oct 17 13:58:52.039200 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2383/4904] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:51 2022] GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef => generated 1450 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:52.040890 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-665ac963-0a3d-4198-84d1-b6bae678afee tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1666 microversion: 2.1 time: 0.513471 Oct 17 13:58:52.063667 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b0b784b8-66e4-42fc-958d-1df5525cda56 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:52.065804 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b0b784b8-66e4-42fc-958d-1df5525cda56 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 6d2bbd26-cb90-4e90-881f-a9346ee3002a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:52.082494 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2522/4905] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:51 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1666 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:52.104583 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ce882c7e-0bd1-41ce-a0c4-d2081d35896a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:52.107025 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b0b784b8-66e4-42fc-958d-1df5525cda56 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:52.107908 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b0b784b8-66e4-42fc-958d-1df5525cda56 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:52.109242 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b0b784b8-66e4-42fc-958d-1df5525cda56 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:52.109850 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ce882c7e-0bd1-41ce-a0c4-d2081d35896a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:52.110788 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b0b784b8-66e4-42fc-958d-1df5525cda56 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:52.111592 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b0b784b8-66e4-42fc-958d-1df5525cda56 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:52.112322 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b0b784b8-66e4-42fc-958d-1df5525cda56 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:52.118424 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=100 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:58:52.122283 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ce882c7e-0bd1-41ce-a0c4-d2081d35896a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:52.122841 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ce882c7e-0bd1-41ce-a0c4-d2081d35896a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:52.124315 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ce882c7e-0bd1-41ce-a0c4-d2081d35896a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:52.125557 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ce882c7e-0bd1-41ce-a0c4-d2081d35896a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:52.126138 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ce882c7e-0bd1-41ce-a0c4-d2081d35896a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:52.126987 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ce882c7e-0bd1-41ce-a0c4-d2081d35896a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:52.579723 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ce882c7e-0bd1-41ce-a0c4-d2081d35896a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:52.604151 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:58:52.618991 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b0b784b8-66e4-42fc-958d-1df5525cda56 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:52.627490 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ce882c7e-0bd1-41ce-a0c4-d2081d35896a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1666 microversion: 2.1 time: 0.539367 Oct 17 13:58:52.632194 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2523/4906] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:52 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1666 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:52.633408 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b0b784b8-66e4-42fc-958d-1df5525cda56 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a" status: 200 len: 1525 microversion: 2.1 time: 0.584341 Oct 17 13:58:52.634190 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2384/4907] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:52 2022] GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a => generated 1525 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:52.649370 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-2a4ebf3f-5c7c-4cc4-acc3-03f55d7c1017 req-e055942a-ccc2-4d34-97a8-15dc1339e717 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7875373-8b55-4b5a-b6be-9ce42c255eef", "name": "network-vif-deleted", "tag": "46f8b925-bc30-40e7-9af9-4f13a6c24f9c"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:58:52.676820 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-be31fe4e-b53a-457a-b140-d1ca1b48e619 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:52.677680 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-be31fe4e-b53a-457a-b140-d1ca1b48e619 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:52.690320 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-be31fe4e-b53a-457a-b140-d1ca1b48e619 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:52.691574 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-be31fe4e-b53a-457a-b140-d1ca1b48e619 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:52.692205 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-be31fe4e-b53a-457a-b140-d1ca1b48e619 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:52.693103 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-be31fe4e-b53a-457a-b140-d1ca1b48e619 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:52.700414 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-be31fe4e-b53a-457a-b140-d1ca1b48e619 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:52.701464 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-be31fe4e-b53a-457a-b140-d1ca1b48e619 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:52.725123 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-2a4ebf3f-5c7c-4cc4-acc3-03f55d7c1017 req-e055942a-ccc2-4d34-97a8-15dc1339e717 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:52.728853 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-2a4ebf3f-5c7c-4cc4-acc3-03f55d7c1017 req-e055942a-ccc2-4d34-97a8-15dc1339e717 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:52.730608 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-2a4ebf3f-5c7c-4cc4-acc3-03f55d7c1017 req-e055942a-ccc2-4d34-97a8-15dc1339e717 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:52.763086 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-2a4ebf3f-5c7c-4cc4-acc3-03f55d7c1017 req-e055942a-ccc2-4d34-97a8-15dc1339e717 service nova] Creating event network-vif-deleted:46f8b925-bc30-40e7-9af9-4f13a6c24f9c for instance c7875373-8b55-4b5a-b6be-9ce42c255eef on n-h1-854247-14 Oct 17 13:58:52.782607 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-2a4ebf3f-5c7c-4cc4-acc3-03f55d7c1017 req-e055942a-ccc2-4d34-97a8-15dc1339e717 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148465 Oct 17 13:58:52.791362 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2524/4908] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:58:53.069401 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a61aeec3-6ad0-4cd8-8793-3256ea1364d0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:53.070793 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a61aeec3-6ad0-4cd8-8793-3256ea1364d0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: c7875373-8b55-4b5a-b6be-9ce42c255eef] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:53.085329 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a61aeec3-6ad0-4cd8-8793-3256ea1364d0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:53.092774 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a61aeec3-6ad0-4cd8-8793-3256ea1364d0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:53.096340 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a61aeec3-6ad0-4cd8-8793-3256ea1364d0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:53.097829 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a61aeec3-6ad0-4cd8-8793-3256ea1364d0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:53.101803 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a61aeec3-6ad0-4cd8-8793-3256ea1364d0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:53.104633 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a61aeec3-6ad0-4cd8-8793-3256ea1364d0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:53.143104 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-be31fe4e-b53a-457a-b140-d1ca1b48e619 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:53.151701 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-be31fe4e-b53a-457a-b140-d1ca1b48e619 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1666 microversion: 2.1 time: 0.478944 Oct 17 13:58:53.167234 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2385/4909] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:52 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1666 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:53.183395 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4561d240-369b-417c-aefe-551596cc48d1 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:53.184142 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4561d240-369b-417c-aefe-551596cc48d1 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:53.196116 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4561d240-369b-417c-aefe-551596cc48d1 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:53.196774 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4561d240-369b-417c-aefe-551596cc48d1 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:53.197351 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4561d240-369b-417c-aefe-551596cc48d1 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:53.198072 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4561d240-369b-417c-aefe-551596cc48d1 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:53.203384 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4561d240-369b-417c-aefe-551596cc48d1 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:53.204012 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4561d240-369b-417c-aefe-551596cc48d1 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:53.235073 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a61aeec3-6ad0-4cd8-8793-3256ea1364d0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:53.243813 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a61aeec3-6ad0-4cd8-8793-3256ea1364d0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:53.244562 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a61aeec3-6ad0-4cd8-8793-3256ea1364d0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:53.252825 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-a61aeec3-6ad0-4cd8-8793-3256ea1364d0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lazy-loading 'fault' on Instance uuid c7875373-8b55-4b5a-b6be-9ce42c255eef {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:58:53.418701 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a61aeec3-6ad0-4cd8-8793-3256ea1364d0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:53.443971 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a61aeec3-6ad0-4cd8-8793-3256ea1364d0 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef" status: 200 len: 1308 microversion: 2.1 time: 0.378916 Oct 17 13:58:53.449591 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2525/4910] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:53 2022] GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef => generated 1308 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:53.660941 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-55ea56c7-dd48-412e-8f21-cbbba380b368 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:53.661176 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-55ea56c7-dd48-412e-8f21-cbbba380b368 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 6d2bbd26-cb90-4e90-881f-a9346ee3002a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:53.677178 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-55ea56c7-dd48-412e-8f21-cbbba380b368 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:53.677316 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-55ea56c7-dd48-412e-8f21-cbbba380b368 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:53.677862 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-55ea56c7-dd48-412e-8f21-cbbba380b368 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:53.678829 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-55ea56c7-dd48-412e-8f21-cbbba380b368 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:53.679573 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-55ea56c7-dd48-412e-8f21-cbbba380b368 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:53.680207 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-55ea56c7-dd48-412e-8f21-cbbba380b368 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:53.791592 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4561d240-369b-417c-aefe-551596cc48d1 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:53.804055 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4561d240-369b-417c-aefe-551596cc48d1 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1666 microversion: 2.1 time: 0.625714 Oct 17 13:58:53.815639 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2386/4911] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:53 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1666 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:58:53.827531 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4d585cab-7998-4340-8a3f-995bb7606d13 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:58:53.839590 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4d585cab-7998-4340-8a3f-995bb7606d13 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:53.840492 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4d585cab-7998-4340-8a3f-995bb7606d13 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:53.841446 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4d585cab-7998-4340-8a3f-995bb7606d13 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:53.890125 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4d585cab-7998-4340-8a3f-995bb7606d13 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Going to try to stop instance {{(pid=127017) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 17 13:58:53.949687 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4d585cab-7998-4340-8a3f-995bb7606d13 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "POST /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d/action" status: 202 len: 0 microversion: 2.1 time: 0.125336 Oct 17 13:58:53.955798 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2387/4912] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:58:53 2022] POST /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:58:53.978918 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a6692d43-f5f6-40e9-9acc-8c6a5cb2f5ed tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:53.981028 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a6692d43-f5f6-40e9-9acc-8c6a5cb2f5ed tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:53.990505 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a6692d43-f5f6-40e9-9acc-8c6a5cb2f5ed tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:53.991439 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a6692d43-f5f6-40e9-9acc-8c6a5cb2f5ed tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:53.992113 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a6692d43-f5f6-40e9-9acc-8c6a5cb2f5ed tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:53.993184 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a6692d43-f5f6-40e9-9acc-8c6a5cb2f5ed tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:53.993780 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a6692d43-f5f6-40e9-9acc-8c6a5cb2f5ed tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:53.994356 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a6692d43-f5f6-40e9-9acc-8c6a5cb2f5ed tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:54.220987 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-55ea56c7-dd48-412e-8f21-cbbba380b368 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:54.229404 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-55ea56c7-dd48-412e-8f21-cbbba380b368 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a" status: 200 len: 1525 microversion: 2.1 time: 0.574532 Oct 17 13:58:54.230008 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2526/4913] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:53 2022] GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a => generated 1525 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:54.444449 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a6692d43-f5f6-40e9-9acc-8c6a5cb2f5ed tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:54.467455 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a6692d43-f5f6-40e9-9acc-8c6a5cb2f5ed tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1676 microversion: 2.1 time: 0.509398 Oct 17 13:58:54.481094 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2388/4914] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:53 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1676 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:54.498960 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-49a6e58a-d3d7-4018-9d32-1e92e499f730 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:54.500613 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-49a6e58a-d3d7-4018-9d32-1e92e499f730 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: c7875373-8b55-4b5a-b6be-9ce42c255eef] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:54.514109 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-49a6e58a-d3d7-4018-9d32-1e92e499f730 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:54.516875 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-49a6e58a-d3d7-4018-9d32-1e92e499f730 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:54.518509 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-49a6e58a-d3d7-4018-9d32-1e92e499f730 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:54.520251 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-49a6e58a-d3d7-4018-9d32-1e92e499f730 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:54.521649 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-49a6e58a-d3d7-4018-9d32-1e92e499f730 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:54.522289 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-49a6e58a-d3d7-4018-9d32-1e92e499f730 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:54.556855 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-49a6e58a-d3d7-4018-9d32-1e92e499f730 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] HTTP exception thrown: Instance c7875373-8b55-4b5a-b6be-9ce42c255eef could not be found. Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-49a6e58a-d3d7-4018-9d32-1e92e499f730 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Request method failure captured: Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef HTTP/1.1 Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTV7LY5HyKXIBiWDJCG3V5sT42rtCOx1a0oRMtoibd5F_sflHwMTlRe9Y_uOa1HxVMLf4skT3kvoUZ584fC2ohAV2v8XUvXrQcJEEPLKlU8mLvFkUN1JC352BF9fy9_Q0qQLABy1MIy7jPkSZI0xF-7yfpY_h22PPPDKIkDzzcK6D9CQ Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 4fa57e8772684c93a406f3d01da2af88 Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServersTestJSON-749544598 Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4fa57e8772684c93a406f3d01da2af88", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServersTestJSON-749544598 Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 4fa57e8772684c93a406f3d01da2af88 Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServersTestJSON-749544598 Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServersTestJSON-749544598-project Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: d78348abc02a4bb892902b0dd3bcfd6a Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServersTestJSON-749544598-project Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance c7875373-8b55-4b5a-b6be-9ce42c255eef could not be found. Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'c7875373-8b55-4b5a-b6be-9ce42c255eef'} Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7875373-8b55-4b5a-b6be-9ce42c255eef could not be found. Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7875373-8b55-4b5a-b6be-9ce42c255eef could not be found. Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:58:54.560422 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:58:54.566526 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:58:54.566526 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:58:54.566526 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:58:54.566526 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:58:54.566526 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7875373-8b55-4b5a-b6be-9ce42c255eef could not be found. Oct 17 13:58:54.566526 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:58:54.566526 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-49a6e58a-d3d7-4018-9d32-1e92e499f730 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Returning 404 to user: Instance c7875373-8b55-4b5a-b6be-9ce42c255eef could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:58:54.566526 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-49a6e58a-d3d7-4018-9d32-1e92e499f730 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef" status: 404 len: 111 microversion: 2.1 time: 0.071947 Oct 17 13:58:54.571579 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2527/4915] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:54 2022] GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:58:54.576258 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-756156ab-ffe1-46ca-adec-7a434859462a tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:54.577013 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-756156ab-ffe1-46ca-adec-7a434859462a tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: c7875373-8b55-4b5a-b6be-9ce42c255eef] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:54.587124 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-756156ab-ffe1-46ca-adec-7a434859462a tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:54.589509 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-756156ab-ffe1-46ca-adec-7a434859462a tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:54.589951 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-756156ab-ffe1-46ca-adec-7a434859462a tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:54.590664 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-756156ab-ffe1-46ca-adec-7a434859462a tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:54.591647 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-756156ab-ffe1-46ca-adec-7a434859462a tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:54.592071 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-756156ab-ffe1-46ca-adec-7a434859462a tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:54.618021 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-756156ab-ffe1-46ca-adec-7a434859462a tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] HTTP exception thrown: Instance c7875373-8b55-4b5a-b6be-9ce42c255eef could not be found. Oct 17 13:58:54.627281 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-756156ab-ffe1-46ca-adec-7a434859462a tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Request method failure captured: Oct 17 13:58:54.627281 n-d-854247-14 devstack@n-api.service[127017]: request: DELETE /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef HTTP/1.1 Oct 17 13:58:54.627281 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:58:54.627281 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:58:54.627281 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:58:54.627281 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:58:54.627281 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:58:54.627281 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:58:54.627281 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:58:54.627281 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:58:54.627281 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTV7LY5HyKXIBiWDJCG3V5sT42rtCOx1a0oRMtoibd5F_sflHwMTlRe9Y_uOa1HxVMLf4skT3kvoUZ584fC2ohAV2v8XUvXrQcJEEPLKlU8mLvFkUN1JC352BF9fy9_Q0qQLABy1MIy7jPkSZI0xF-7yfpY_h22PPPDKIkDzzcK6D9CQ Oct 17 13:58:54.627281 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:58:54.627281 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:58:54.627281 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:58:54.627281 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:58:54.627281 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:58:54.627281 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:58:54.627281 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 4fa57e8772684c93a406f3d01da2af88 Oct 17 13:58:54.627281 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServersTestJSON-749544598 Oct 17 13:58:54.627281 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:58:54.627281 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:58:54.627281 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4fa57e8772684c93a406f3d01da2af88", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:58:54.627281 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServersTestJSON-749544598 Oct 17 13:58:54.627281 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 4fa57e8772684c93a406f3d01da2af88 Oct 17 13:58:54.627281 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServersTestJSON-749544598 Oct 17 13:58:54.627281 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServersTestJSON-749544598-project Oct 17 13:58:54.627281 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:58:54.627281 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:58:54.627281 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: d78348abc02a4bb892902b0dd3bcfd6a Oct 17 13:58:54.627281 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServersTestJSON-749544598-project Oct 17 13:58:54.627281 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:58:54.627281 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance c7875373-8b55-4b5a-b6be-9ce42c255eef could not be found. Oct 17 13:58:54.627281 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'c7875373-8b55-4b5a-b6be-9ce42c255eef'} Oct 17 13:58:54.627281 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:58:54.627281 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:58:54.627281 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:58:54.627281 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:58:54.627281 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:58:54.627281 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:58:54.627281 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:58:54.627281 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:58:54.627281 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:58:54.627281 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:58:54.627281 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7875373-8b55-4b5a-b6be-9ce42c255eef could not be found. Oct 17 13:58:54.627281 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:58:54.627281 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:58:54.627281 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:58:54.627281 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:58:54.627281 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:58:54.627281 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:58:54.627281 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:58:54.627281 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:58:54.627281 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:58:54.627281 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:58:54.627281 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:58:54.627281 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:58:54.627281 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:58:54.627281 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:58:54.627281 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:58:54.627281 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:58:54.627281 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:58:54.627281 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:58:54.627281 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7875373-8b55-4b5a-b6be-9ce42c255eef could not be found. Oct 17 13:58:54.639671 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:58:54.639671 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:58:54.639671 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:58:54.639671 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:58:54.639671 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:58:54.639671 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:58:54.639671 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:58:54.639671 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:58:54.639671 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7875373-8b55-4b5a-b6be-9ce42c255eef could not be found. Oct 17 13:58:54.639671 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:58:54.639671 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-756156ab-ffe1-46ca-adec-7a434859462a tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Returning 404 to user: Instance c7875373-8b55-4b5a-b6be-9ce42c255eef could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:58:54.639671 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-756156ab-ffe1-46ca-adec-7a434859462a tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef" status: 404 len: 111 microversion: 2.1 time: 0.058845 Oct 17 13:58:54.639671 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2389/4916] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:58:54 2022] DELETE /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:58:54.642949 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f13060b6-9df4-490c-bdb7-dd3bd6fc261d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:54.642949 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f13060b6-9df4-490c-bdb7-dd3bd6fc261d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: c7875373-8b55-4b5a-b6be-9ce42c255eef] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:54.651110 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f13060b6-9df4-490c-bdb7-dd3bd6fc261d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:54.653720 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f13060b6-9df4-490c-bdb7-dd3bd6fc261d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:54.654143 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f13060b6-9df4-490c-bdb7-dd3bd6fc261d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:54.657068 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f13060b6-9df4-490c-bdb7-dd3bd6fc261d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:54.657623 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f13060b6-9df4-490c-bdb7-dd3bd6fc261d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:54.659256 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f13060b6-9df4-490c-bdb7-dd3bd6fc261d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:54.689629 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-f13060b6-9df4-490c-bdb7-dd3bd6fc261d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] HTTP exception thrown: Instance c7875373-8b55-4b5a-b6be-9ce42c255eef could not be found. Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f13060b6-9df4-490c-bdb7-dd3bd6fc261d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Request method failure captured: Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef HTTP/1.1 Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTV7LY5HyKXIBiWDJCG3V5sT42rtCOx1a0oRMtoibd5F_sflHwMTlRe9Y_uOa1HxVMLf4skT3kvoUZ584fC2ohAV2v8XUvXrQcJEEPLKlU8mLvFkUN1JC352BF9fy9_Q0qQLABy1MIy7jPkSZI0xF-7yfpY_h22PPPDKIkDzzcK6D9CQ Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 4fa57e8772684c93a406f3d01da2af88 Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServersTestJSON-749544598 Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4fa57e8772684c93a406f3d01da2af88", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServersTestJSON-749544598 Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 4fa57e8772684c93a406f3d01da2af88 Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServersTestJSON-749544598 Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServersTestJSON-749544598-project Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: d78348abc02a4bb892902b0dd3bcfd6a Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServersTestJSON-749544598-project Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance c7875373-8b55-4b5a-b6be-9ce42c255eef could not be found. Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'c7875373-8b55-4b5a-b6be-9ce42c255eef'} Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7875373-8b55-4b5a-b6be-9ce42c255eef could not be found. Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7875373-8b55-4b5a-b6be-9ce42c255eef could not be found. Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:58:54.700730 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:58:54.709539 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:58:54.709539 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:58:54.709539 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:58:54.709539 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:58:54.709539 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7875373-8b55-4b5a-b6be-9ce42c255eef could not be found. Oct 17 13:58:54.709539 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:58:54.709539 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f13060b6-9df4-490c-bdb7-dd3bd6fc261d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Returning 404 to user: Instance c7875373-8b55-4b5a-b6be-9ce42c255eef could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:58:54.709539 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f13060b6-9df4-490c-bdb7-dd3bd6fc261d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef" status: 404 len: 111 microversion: 2.1 time: 0.066043 Oct 17 13:58:54.709539 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2528/4917] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:54 2022] GET /compute/v2.1/servers/c7875373-8b55-4b5a-b6be-9ce42c255eef => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:58:54.717429 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e0b876b4-e1be-4ba2-85ee-3f71d9fd2fa9 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:54.718110 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e0b876b4-e1be-4ba2-85ee-3f71d9fd2fa9 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: 6f299338-e34f-459f-9194-37909af20428] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:54.735948 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e0b876b4-e1be-4ba2-85ee-3f71d9fd2fa9 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:54.738056 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e0b876b4-e1be-4ba2-85ee-3f71d9fd2fa9 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:54.743515 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e0b876b4-e1be-4ba2-85ee-3f71d9fd2fa9 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:54.751095 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e0b876b4-e1be-4ba2-85ee-3f71d9fd2fa9 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:54.752007 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e0b876b4-e1be-4ba2-85ee-3f71d9fd2fa9 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:54.753138 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e0b876b4-e1be-4ba2-85ee-3f71d9fd2fa9 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:54.785278 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-e0b876b4-e1be-4ba2-85ee-3f71d9fd2fa9 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] HTTP exception thrown: Instance 6f299338-e34f-459f-9194-37909af20428 could not be found. Oct 17 13:58:54.794110 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e0b876b4-e1be-4ba2-85ee-3f71d9fd2fa9 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Request method failure captured: Oct 17 13:58:54.794110 n-d-854247-14 devstack@n-api.service[127017]: request: DELETE /compute/v2.1/servers/6f299338-e34f-459f-9194-37909af20428 HTTP/1.1 Oct 17 13:58:54.794110 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:58:54.794110 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:58:54.794110 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:58:54.794110 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:58:54.794110 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:58:54.794110 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:58:54.794110 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:58:54.794110 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:58:54.794110 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTV7LY5HyKXIBiWDJCG3V5sT42rtCOx1a0oRMtoibd5F_sflHwMTlRe9Y_uOa1HxVMLf4skT3kvoUZ584fC2ohAV2v8XUvXrQcJEEPLKlU8mLvFkUN1JC352BF9fy9_Q0qQLABy1MIy7jPkSZI0xF-7yfpY_h22PPPDKIkDzzcK6D9CQ Oct 17 13:58:54.794110 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:58:54.794110 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:58:54.794110 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:58:54.794110 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:58:54.794110 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:58:54.794110 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:58:54.794110 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 4fa57e8772684c93a406f3d01da2af88 Oct 17 13:58:54.794110 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServersTestJSON-749544598 Oct 17 13:58:54.794110 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:58:54.794110 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:58:54.794110 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4fa57e8772684c93a406f3d01da2af88", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:58:54.794110 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServersTestJSON-749544598 Oct 17 13:58:54.794110 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 4fa57e8772684c93a406f3d01da2af88 Oct 17 13:58:54.794110 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServersTestJSON-749544598 Oct 17 13:58:54.794110 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServersTestJSON-749544598-project Oct 17 13:58:54.794110 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:58:54.794110 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:58:54.794110 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: d78348abc02a4bb892902b0dd3bcfd6a Oct 17 13:58:54.794110 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServersTestJSON-749544598-project Oct 17 13:58:54.794110 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:58:54.794110 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 6f299338-e34f-459f-9194-37909af20428 could not be found. Oct 17 13:58:54.794110 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '6f299338-e34f-459f-9194-37909af20428'} Oct 17 13:58:54.794110 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:58:54.794110 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:58:54.794110 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:58:54.794110 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:58:54.794110 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:58:54.794110 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:58:54.794110 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:58:54.794110 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:58:54.794110 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:58:54.794110 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:58:54.794110 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f299338-e34f-459f-9194-37909af20428 could not be found. Oct 17 13:58:54.794110 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:58:54.794110 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:58:54.794110 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:58:54.794110 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:58:54.794110 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:58:54.794110 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:58:54.794110 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:58:54.794110 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:58:54.794110 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:58:54.794110 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:58:54.794110 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:58:54.794110 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:58:54.794110 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:58:54.794110 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:58:54.794110 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:58:54.794110 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:58:54.794110 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:58:54.794110 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:58:54.794110 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f299338-e34f-459f-9194-37909af20428 could not be found. Oct 17 13:58:54.800287 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:58:54.800287 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:58:54.800287 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:58:54.800287 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:58:54.800287 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:58:54.800287 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:58:54.800287 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:58:54.800287 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:58:54.800287 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f299338-e34f-459f-9194-37909af20428 could not be found. Oct 17 13:58:54.800287 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:58:54.800287 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e0b876b4-e1be-4ba2-85ee-3f71d9fd2fa9 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Returning 404 to user: Instance 6f299338-e34f-459f-9194-37909af20428 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:58:54.801877 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e0b876b4-e1be-4ba2-85ee-3f71d9fd2fa9 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "DELETE /compute/v2.1/servers/6f299338-e34f-459f-9194-37909af20428" status: 404 len: 111 microversion: 2.1 time: 0.090431 Oct 17 13:58:54.807991 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2390/4918] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:58:54 2022] DELETE /compute/v2.1/servers/6f299338-e34f-459f-9194-37909af20428 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:58:54.817122 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a72c7e49-3c1a-4dd7-a719-1aff5bf070a6 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:54.817819 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a72c7e49-3c1a-4dd7-a719-1aff5bf070a6 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: 6f299338-e34f-459f-9194-37909af20428] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:54.826068 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a72c7e49-3c1a-4dd7-a719-1aff5bf070a6 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:54.826554 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a72c7e49-3c1a-4dd7-a719-1aff5bf070a6 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:54.826991 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a72c7e49-3c1a-4dd7-a719-1aff5bf070a6 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:54.827731 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a72c7e49-3c1a-4dd7-a719-1aff5bf070a6 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:54.828181 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a72c7e49-3c1a-4dd7-a719-1aff5bf070a6 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:54.828600 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a72c7e49-3c1a-4dd7-a719-1aff5bf070a6 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:54.851870 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-a72c7e49-3c1a-4dd7-a719-1aff5bf070a6 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] HTTP exception thrown: Instance 6f299338-e34f-459f-9194-37909af20428 could not be found. Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a72c7e49-3c1a-4dd7-a719-1aff5bf070a6 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Request method failure captured: Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/6f299338-e34f-459f-9194-37909af20428 HTTP/1.1 Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTV7LY5HyKXIBiWDJCG3V5sT42rtCOx1a0oRMtoibd5F_sflHwMTlRe9Y_uOa1HxVMLf4skT3kvoUZ584fC2ohAV2v8XUvXrQcJEEPLKlU8mLvFkUN1JC352BF9fy9_Q0qQLABy1MIy7jPkSZI0xF-7yfpY_h22PPPDKIkDzzcK6D9CQ Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 4fa57e8772684c93a406f3d01da2af88 Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServersTestJSON-749544598 Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4fa57e8772684c93a406f3d01da2af88", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServersTestJSON-749544598 Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 4fa57e8772684c93a406f3d01da2af88 Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServersTestJSON-749544598 Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServersTestJSON-749544598-project Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: d78348abc02a4bb892902b0dd3bcfd6a Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServersTestJSON-749544598-project Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 6f299338-e34f-459f-9194-37909af20428 could not be found. Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '6f299338-e34f-459f-9194-37909af20428'} Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f299338-e34f-459f-9194-37909af20428 could not be found. Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f299338-e34f-459f-9194-37909af20428 could not be found. Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:58:54.854158 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:58:54.860798 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:58:54.860798 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:58:54.860798 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:58:54.860798 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:58:54.860798 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f299338-e34f-459f-9194-37909af20428 could not be found. Oct 17 13:58:54.860798 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:58:54.860798 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a72c7e49-3c1a-4dd7-a719-1aff5bf070a6 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Returning 404 to user: Instance 6f299338-e34f-459f-9194-37909af20428 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:58:54.860798 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a72c7e49-3c1a-4dd7-a719-1aff5bf070a6 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/6f299338-e34f-459f-9194-37909af20428" status: 404 len: 111 microversion: 2.1 time: 0.044549 Oct 17 13:58:54.861656 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2529/4919] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:54 2022] GET /compute/v2.1/servers/6f299338-e34f-459f-9194-37909af20428 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:58:54.869345 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f02f37ea-f7f5-410e-8787-0945c2292999 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:54.869717 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f02f37ea-f7f5-410e-8787-0945c2292999 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: 3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:54.879744 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f02f37ea-f7f5-410e-8787-0945c2292999 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:54.881731 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f02f37ea-f7f5-410e-8787-0945c2292999 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:54.882356 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f02f37ea-f7f5-410e-8787-0945c2292999 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:54.883153 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f02f37ea-f7f5-410e-8787-0945c2292999 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:54.885675 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f02f37ea-f7f5-410e-8787-0945c2292999 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:54.886324 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f02f37ea-f7f5-410e-8787-0945c2292999 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:54.921884 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-f02f37ea-f7f5-410e-8787-0945c2292999 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] HTTP exception thrown: Instance 3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4 could not be found. Oct 17 13:58:54.924563 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f02f37ea-f7f5-410e-8787-0945c2292999 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Request method failure captured: Oct 17 13:58:54.924563 n-d-854247-14 devstack@n-api.service[127017]: request: DELETE /compute/v2.1/servers/3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4 HTTP/1.1 Oct 17 13:58:54.924563 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:58:54.924563 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:58:54.924563 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:58:54.924563 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:58:54.924563 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:58:54.924563 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:58:54.924563 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:58:54.924563 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:58:54.924563 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTV7LY5HyKXIBiWDJCG3V5sT42rtCOx1a0oRMtoibd5F_sflHwMTlRe9Y_uOa1HxVMLf4skT3kvoUZ584fC2ohAV2v8XUvXrQcJEEPLKlU8mLvFkUN1JC352BF9fy9_Q0qQLABy1MIy7jPkSZI0xF-7yfpY_h22PPPDKIkDzzcK6D9CQ Oct 17 13:58:54.924563 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:58:54.924563 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:58:54.924563 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:58:54.924563 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:58:54.924563 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:58:54.924563 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:58:54.924563 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 4fa57e8772684c93a406f3d01da2af88 Oct 17 13:58:54.924563 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServersTestJSON-749544598 Oct 17 13:58:54.924563 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:58:54.924563 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:58:54.924563 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4fa57e8772684c93a406f3d01da2af88", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:58:54.924563 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServersTestJSON-749544598 Oct 17 13:58:54.924563 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 4fa57e8772684c93a406f3d01da2af88 Oct 17 13:58:54.924563 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServersTestJSON-749544598 Oct 17 13:58:54.924563 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServersTestJSON-749544598-project Oct 17 13:58:54.924563 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:58:54.924563 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:58:54.924563 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: d78348abc02a4bb892902b0dd3bcfd6a Oct 17 13:58:54.924563 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServersTestJSON-749544598-project Oct 17 13:58:54.924563 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:58:54.924563 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4 could not be found. Oct 17 13:58:54.924563 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4'} Oct 17 13:58:54.924563 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:58:54.924563 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:58:54.924563 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:58:54.924563 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:58:54.924563 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:58:54.924563 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:58:54.924563 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:58:54.924563 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:58:54.924563 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:58:54.924563 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:58:54.924563 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4 could not be found. Oct 17 13:58:54.924563 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:58:54.924563 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:58:54.924563 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:58:54.924563 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:58:54.924563 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:58:54.924563 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:58:54.924563 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:58:54.924563 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:58:54.924563 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:58:54.924563 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:58:54.924563 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:58:54.924563 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:58:54.924563 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:58:54.924563 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:58:54.924563 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:58:54.924563 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:58:54.924563 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:58:54.924563 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:58:54.924563 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4 could not be found. Oct 17 13:58:54.929011 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:58:54.929011 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:58:54.929011 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:58:54.929011 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:58:54.929011 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:58:54.929011 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:58:54.929011 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:58:54.929011 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:58:54.929011 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4 could not be found. Oct 17 13:58:54.929011 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:58:54.936040 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f02f37ea-f7f5-410e-8787-0945c2292999 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Returning 404 to user: Instance 3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:58:54.937381 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f02f37ea-f7f5-410e-8787-0945c2292999 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4" status: 404 len: 111 microversion: 2.1 time: 0.072511 Oct 17 13:58:54.941902 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2391/4920] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:58:54 2022] DELETE /compute/v2.1/servers/3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:58:54.946985 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d0e7a2bc-cef1-455c-bc4e-c4a461ec0784 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:54.947704 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d0e7a2bc-cef1-455c-bc4e-c4a461ec0784 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: 3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:54.955037 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d0e7a2bc-cef1-455c-bc4e-c4a461ec0784 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:54.956159 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d0e7a2bc-cef1-455c-bc4e-c4a461ec0784 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:54.956855 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d0e7a2bc-cef1-455c-bc4e-c4a461ec0784 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:54.957795 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d0e7a2bc-cef1-455c-bc4e-c4a461ec0784 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:54.958508 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d0e7a2bc-cef1-455c-bc4e-c4a461ec0784 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:54.959158 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d0e7a2bc-cef1-455c-bc4e-c4a461ec0784 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:54.975065 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-d0e7a2bc-cef1-455c-bc4e-c4a461ec0784 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] HTTP exception thrown: Instance 3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4 could not be found. Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d0e7a2bc-cef1-455c-bc4e-c4a461ec0784 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Request method failure captured: Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4 HTTP/1.1 Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTV7LY5HyKXIBiWDJCG3V5sT42rtCOx1a0oRMtoibd5F_sflHwMTlRe9Y_uOa1HxVMLf4skT3kvoUZ584fC2ohAV2v8XUvXrQcJEEPLKlU8mLvFkUN1JC352BF9fy9_Q0qQLABy1MIy7jPkSZI0xF-7yfpY_h22PPPDKIkDzzcK6D9CQ Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 4fa57e8772684c93a406f3d01da2af88 Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServersTestJSON-749544598 Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4fa57e8772684c93a406f3d01da2af88", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServersTestJSON-749544598 Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 4fa57e8772684c93a406f3d01da2af88 Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServersTestJSON-749544598 Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServersTestJSON-749544598-project Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: d78348abc02a4bb892902b0dd3bcfd6a Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServersTestJSON-749544598-project Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4 could not be found. Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4'} Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4 could not be found. Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4 could not be found. Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:58:54.977260 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:58:54.981890 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:58:54.981890 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:58:54.981890 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:58:54.981890 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:58:54.981890 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4 could not be found. Oct 17 13:58:54.981890 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:58:54.985911 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d0e7a2bc-cef1-455c-bc4e-c4a461ec0784 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Returning 404 to user: Instance 3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:58:54.987648 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d0e7a2bc-cef1-455c-bc4e-c4a461ec0784 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4" status: 404 len: 111 microversion: 2.1 time: 0.044771 Oct 17 13:58:54.991711 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2530/4921] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:54 2022] GET /compute/v2.1/servers/3ffdf2e1-547b-4f5b-8bb3-801f4153bbc4 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:58:54.997091 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ea588679-ee76-4c3c-a84b-7c26e3059780 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:54.997590 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ea588679-ee76-4c3c-a84b-7c26e3059780 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: a48e28ae-e228-462b-81eb-95f712dc0800] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:55.003973 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ea588679-ee76-4c3c-a84b-7c26e3059780 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:55.004669 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ea588679-ee76-4c3c-a84b-7c26e3059780 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:55.005288 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ea588679-ee76-4c3c-a84b-7c26e3059780 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:55.006496 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ea588679-ee76-4c3c-a84b-7c26e3059780 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:55.007103 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ea588679-ee76-4c3c-a84b-7c26e3059780 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:55.007699 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ea588679-ee76-4c3c-a84b-7c26e3059780 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:55.024783 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-ea588679-ee76-4c3c-a84b-7c26e3059780 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] HTTP exception thrown: Instance a48e28ae-e228-462b-81eb-95f712dc0800 could not be found. Oct 17 13:58:55.034662 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ea588679-ee76-4c3c-a84b-7c26e3059780 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Request method failure captured: Oct 17 13:58:55.034662 n-d-854247-14 devstack@n-api.service[127017]: request: DELETE /compute/v2.1/servers/a48e28ae-e228-462b-81eb-95f712dc0800 HTTP/1.1 Oct 17 13:58:55.034662 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:58:55.034662 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:58:55.034662 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:58:55.034662 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:58:55.034662 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:58:55.034662 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:58:55.034662 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:58:55.034662 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:58:55.034662 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTV7LY5HyKXIBiWDJCG3V5sT42rtCOx1a0oRMtoibd5F_sflHwMTlRe9Y_uOa1HxVMLf4skT3kvoUZ584fC2ohAV2v8XUvXrQcJEEPLKlU8mLvFkUN1JC352BF9fy9_Q0qQLABy1MIy7jPkSZI0xF-7yfpY_h22PPPDKIkDzzcK6D9CQ Oct 17 13:58:55.034662 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:58:55.034662 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:58:55.034662 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:58:55.034662 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:58:55.034662 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:58:55.034662 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:58:55.034662 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 4fa57e8772684c93a406f3d01da2af88 Oct 17 13:58:55.034662 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServersTestJSON-749544598 Oct 17 13:58:55.034662 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:58:55.034662 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:58:55.034662 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4fa57e8772684c93a406f3d01da2af88", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:58:55.034662 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServersTestJSON-749544598 Oct 17 13:58:55.034662 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 4fa57e8772684c93a406f3d01da2af88 Oct 17 13:58:55.034662 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServersTestJSON-749544598 Oct 17 13:58:55.034662 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServersTestJSON-749544598-project Oct 17 13:58:55.034662 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:58:55.034662 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:58:55.034662 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: d78348abc02a4bb892902b0dd3bcfd6a Oct 17 13:58:55.034662 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServersTestJSON-749544598-project Oct 17 13:58:55.034662 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:58:55.034662 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance a48e28ae-e228-462b-81eb-95f712dc0800 could not be found. Oct 17 13:58:55.034662 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'a48e28ae-e228-462b-81eb-95f712dc0800'} Oct 17 13:58:55.034662 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:58:55.034662 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:58:55.034662 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:58:55.034662 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:58:55.034662 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:58:55.034662 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:58:55.034662 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:58:55.034662 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:58:55.034662 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:58:55.034662 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:58:55.034662 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a48e28ae-e228-462b-81eb-95f712dc0800 could not be found. Oct 17 13:58:55.034662 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:58:55.034662 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:58:55.034662 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:58:55.034662 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:58:55.034662 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:58:55.034662 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:58:55.034662 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:58:55.034662 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:58:55.034662 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:58:55.034662 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:58:55.034662 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:58:55.034662 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:58:55.034662 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:58:55.034662 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:58:55.034662 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:58:55.034662 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:58:55.034662 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:58:55.034662 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:58:55.034662 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a48e28ae-e228-462b-81eb-95f712dc0800 could not be found. Oct 17 13:58:55.039542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:58:55.039542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:58:55.039542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:58:55.039542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:58:55.039542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:58:55.039542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:58:55.039542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:58:55.039542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:58:55.039542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a48e28ae-e228-462b-81eb-95f712dc0800 could not be found. Oct 17 13:58:55.039542 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:58:55.042462 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ea588679-ee76-4c3c-a84b-7c26e3059780 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Returning 404 to user: Instance a48e28ae-e228-462b-81eb-95f712dc0800 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:58:55.043592 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ea588679-ee76-4c3c-a84b-7c26e3059780 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a48e28ae-e228-462b-81eb-95f712dc0800" status: 404 len: 111 microversion: 2.1 time: 0.050890 Oct 17 13:58:55.044655 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2392/4922] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:58:54 2022] DELETE /compute/v2.1/servers/a48e28ae-e228-462b-81eb-95f712dc0800 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:58:55.054090 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7b764b47-a3af-47bf-9c30-6d5a9977df27 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:55.054870 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7b764b47-a3af-47bf-9c30-6d5a9977df27 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: a48e28ae-e228-462b-81eb-95f712dc0800] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:55.061839 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7b764b47-a3af-47bf-9c30-6d5a9977df27 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:55.062575 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7b764b47-a3af-47bf-9c30-6d5a9977df27 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:55.063228 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7b764b47-a3af-47bf-9c30-6d5a9977df27 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:55.064153 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7b764b47-a3af-47bf-9c30-6d5a9977df27 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:55.065057 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7b764b47-a3af-47bf-9c30-6d5a9977df27 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:55.067270 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7b764b47-a3af-47bf-9c30-6d5a9977df27 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:55.083444 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-7b764b47-a3af-47bf-9c30-6d5a9977df27 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] HTTP exception thrown: Instance a48e28ae-e228-462b-81eb-95f712dc0800 could not be found. Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7b764b47-a3af-47bf-9c30-6d5a9977df27 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Request method failure captured: Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/a48e28ae-e228-462b-81eb-95f712dc0800 HTTP/1.1 Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTV7LY5HyKXIBiWDJCG3V5sT42rtCOx1a0oRMtoibd5F_sflHwMTlRe9Y_uOa1HxVMLf4skT3kvoUZ584fC2ohAV2v8XUvXrQcJEEPLKlU8mLvFkUN1JC352BF9fy9_Q0qQLABy1MIy7jPkSZI0xF-7yfpY_h22PPPDKIkDzzcK6D9CQ Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 4fa57e8772684c93a406f3d01da2af88 Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServersTestJSON-749544598 Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4fa57e8772684c93a406f3d01da2af88", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServersTestJSON-749544598 Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 4fa57e8772684c93a406f3d01da2af88 Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServersTestJSON-749544598 Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServersTestJSON-749544598-project Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: d78348abc02a4bb892902b0dd3bcfd6a Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServersTestJSON-749544598-project Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance a48e28ae-e228-462b-81eb-95f712dc0800 could not be found. Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'a48e28ae-e228-462b-81eb-95f712dc0800'} Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a48e28ae-e228-462b-81eb-95f712dc0800 could not be found. Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a48e28ae-e228-462b-81eb-95f712dc0800 could not be found. Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:58:55.085364 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:58:55.089902 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:58:55.089902 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:58:55.089902 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:58:55.089902 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:58:55.089902 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a48e28ae-e228-462b-81eb-95f712dc0800 could not be found. Oct 17 13:58:55.089902 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:58:55.091597 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7b764b47-a3af-47bf-9c30-6d5a9977df27 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Returning 404 to user: Instance a48e28ae-e228-462b-81eb-95f712dc0800 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:58:55.092684 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7b764b47-a3af-47bf-9c30-6d5a9977df27 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/a48e28ae-e228-462b-81eb-95f712dc0800" status: 404 len: 111 microversion: 2.1 time: 0.044118 Oct 17 13:58:55.097793 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2531/4923] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:55 2022] GET /compute/v2.1/servers/a48e28ae-e228-462b-81eb-95f712dc0800 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:58:55.103114 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9c76f1c3-fc5b-42f4-ad13-52243371dabd tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:55.103824 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9c76f1c3-fc5b-42f4-ad13-52243371dabd tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: d9e53a8a-357e-4587-a2a2-289135b37879] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:55.111940 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9c76f1c3-fc5b-42f4-ad13-52243371dabd tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:55.113159 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9c76f1c3-fc5b-42f4-ad13-52243371dabd tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:55.113773 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9c76f1c3-fc5b-42f4-ad13-52243371dabd tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:55.114754 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9c76f1c3-fc5b-42f4-ad13-52243371dabd tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:55.115397 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9c76f1c3-fc5b-42f4-ad13-52243371dabd tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:55.115971 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9c76f1c3-fc5b-42f4-ad13-52243371dabd tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:55.134534 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-9c76f1c3-fc5b-42f4-ad13-52243371dabd tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] HTTP exception thrown: Instance d9e53a8a-357e-4587-a2a2-289135b37879 could not be found. Oct 17 13:58:55.136587 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9c76f1c3-fc5b-42f4-ad13-52243371dabd tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Request method failure captured: Oct 17 13:58:55.136587 n-d-854247-14 devstack@n-api.service[127017]: request: DELETE /compute/v2.1/servers/d9e53a8a-357e-4587-a2a2-289135b37879 HTTP/1.1 Oct 17 13:58:55.136587 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:58:55.136587 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:58:55.136587 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:58:55.136587 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:58:55.136587 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:58:55.136587 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:58:55.136587 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:58:55.136587 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:58:55.136587 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTV7LY5HyKXIBiWDJCG3V5sT42rtCOx1a0oRMtoibd5F_sflHwMTlRe9Y_uOa1HxVMLf4skT3kvoUZ584fC2ohAV2v8XUvXrQcJEEPLKlU8mLvFkUN1JC352BF9fy9_Q0qQLABy1MIy7jPkSZI0xF-7yfpY_h22PPPDKIkDzzcK6D9CQ Oct 17 13:58:55.136587 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:58:55.136587 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:58:55.136587 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:58:55.136587 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:58:55.136587 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:58:55.136587 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:58:55.136587 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 4fa57e8772684c93a406f3d01da2af88 Oct 17 13:58:55.136587 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServersTestJSON-749544598 Oct 17 13:58:55.136587 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:58:55.136587 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:58:55.136587 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4fa57e8772684c93a406f3d01da2af88", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:58:55.136587 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServersTestJSON-749544598 Oct 17 13:58:55.136587 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 4fa57e8772684c93a406f3d01da2af88 Oct 17 13:58:55.136587 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServersTestJSON-749544598 Oct 17 13:58:55.136587 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServersTestJSON-749544598-project Oct 17 13:58:55.136587 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:58:55.136587 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:58:55.136587 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: d78348abc02a4bb892902b0dd3bcfd6a Oct 17 13:58:55.136587 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServersTestJSON-749544598-project Oct 17 13:58:55.136587 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:58:55.136587 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance d9e53a8a-357e-4587-a2a2-289135b37879 could not be found. Oct 17 13:58:55.136587 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'd9e53a8a-357e-4587-a2a2-289135b37879'} Oct 17 13:58:55.136587 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:58:55.136587 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:58:55.136587 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:58:55.136587 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:58:55.136587 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:58:55.136587 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:58:55.136587 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:58:55.136587 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:58:55.136587 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:58:55.136587 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:58:55.136587 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9e53a8a-357e-4587-a2a2-289135b37879 could not be found. Oct 17 13:58:55.136587 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:58:55.136587 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:58:55.136587 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:58:55.136587 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:58:55.136587 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:58:55.136587 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:58:55.136587 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:58:55.136587 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:58:55.136587 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:58:55.136587 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:58:55.136587 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:58:55.136587 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:58:55.136587 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:58:55.136587 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:58:55.136587 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:58:55.136587 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:58:55.136587 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:58:55.136587 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:58:55.136587 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9e53a8a-357e-4587-a2a2-289135b37879 could not be found. Oct 17 13:58:55.141446 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:58:55.141446 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:58:55.141446 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:58:55.141446 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:58:55.141446 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:58:55.141446 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:58:55.141446 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:58:55.141446 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:58:55.141446 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9e53a8a-357e-4587-a2a2-289135b37879 could not be found. Oct 17 13:58:55.141446 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:58:55.141446 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9c76f1c3-fc5b-42f4-ad13-52243371dabd tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Returning 404 to user: Instance d9e53a8a-357e-4587-a2a2-289135b37879 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:58:55.141446 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9c76f1c3-fc5b-42f4-ad13-52243371dabd tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "DELETE /compute/v2.1/servers/d9e53a8a-357e-4587-a2a2-289135b37879" status: 404 len: 111 microversion: 2.1 time: 0.042369 Oct 17 13:58:55.144621 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2393/4924] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:58:55 2022] DELETE /compute/v2.1/servers/d9e53a8a-357e-4587-a2a2-289135b37879 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:58:55.151244 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e101db78-758f-488d-ab1e-af547d65d29a tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:55.152153 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e101db78-758f-488d-ab1e-af547d65d29a tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: d9e53a8a-357e-4587-a2a2-289135b37879] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:55.167333 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e101db78-758f-488d-ab1e-af547d65d29a tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:55.168572 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e101db78-758f-488d-ab1e-af547d65d29a tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:55.169925 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e101db78-758f-488d-ab1e-af547d65d29a tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:55.170879 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e101db78-758f-488d-ab1e-af547d65d29a tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:55.171591 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e101db78-758f-488d-ab1e-af547d65d29a tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:55.172239 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e101db78-758f-488d-ab1e-af547d65d29a tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:55.197208 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-e101db78-758f-488d-ab1e-af547d65d29a tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] HTTP exception thrown: Instance d9e53a8a-357e-4587-a2a2-289135b37879 could not be found. Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e101db78-758f-488d-ab1e-af547d65d29a tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Request method failure captured: Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/d9e53a8a-357e-4587-a2a2-289135b37879 HTTP/1.1 Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTV7LY5HyKXIBiWDJCG3V5sT42rtCOx1a0oRMtoibd5F_sflHwMTlRe9Y_uOa1HxVMLf4skT3kvoUZ584fC2ohAV2v8XUvXrQcJEEPLKlU8mLvFkUN1JC352BF9fy9_Q0qQLABy1MIy7jPkSZI0xF-7yfpY_h22PPPDKIkDzzcK6D9CQ Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 4fa57e8772684c93a406f3d01da2af88 Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServersTestJSON-749544598 Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4fa57e8772684c93a406f3d01da2af88", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServersTestJSON-749544598 Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 4fa57e8772684c93a406f3d01da2af88 Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServersTestJSON-749544598 Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServersTestJSON-749544598-project Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: d78348abc02a4bb892902b0dd3bcfd6a Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServersTestJSON-749544598-project Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance d9e53a8a-357e-4587-a2a2-289135b37879 could not be found. Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'd9e53a8a-357e-4587-a2a2-289135b37879'} Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9e53a8a-357e-4587-a2a2-289135b37879 could not be found. Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9e53a8a-357e-4587-a2a2-289135b37879 could not be found. Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:58:55.200565 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:58:55.207635 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:58:55.207635 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:58:55.207635 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:58:55.207635 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:58:55.207635 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9e53a8a-357e-4587-a2a2-289135b37879 could not be found. Oct 17 13:58:55.207635 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:58:55.207635 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e101db78-758f-488d-ab1e-af547d65d29a tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Returning 404 to user: Instance d9e53a8a-357e-4587-a2a2-289135b37879 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:58:55.207635 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e101db78-758f-488d-ab1e-af547d65d29a tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/d9e53a8a-357e-4587-a2a2-289135b37879" status: 404 len: 111 microversion: 2.1 time: 0.058953 Oct 17 13:58:55.210945 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2532/4925] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:55 2022] GET /compute/v2.1/servers/d9e53a8a-357e-4587-a2a2-289135b37879 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:58:55.215001 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6489339c-b52d-4ec4-b112-b6ffb1d7606f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:55.216106 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6489339c-b52d-4ec4-b112-b6ffb1d7606f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: e9096e2e-d971-4866-ae12-472b3d9909ea] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:55.223680 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6489339c-b52d-4ec4-b112-b6ffb1d7606f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:55.224227 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6489339c-b52d-4ec4-b112-b6ffb1d7606f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:55.224664 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6489339c-b52d-4ec4-b112-b6ffb1d7606f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:55.225472 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6489339c-b52d-4ec4-b112-b6ffb1d7606f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:55.226129 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6489339c-b52d-4ec4-b112-b6ffb1d7606f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:55.226715 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6489339c-b52d-4ec4-b112-b6ffb1d7606f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:55.247225 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-6489339c-b52d-4ec4-b112-b6ffb1d7606f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] HTTP exception thrown: Instance e9096e2e-d971-4866-ae12-472b3d9909ea could not be found. Oct 17 13:58:55.250629 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6489339c-b52d-4ec4-b112-b6ffb1d7606f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Request method failure captured: Oct 17 13:58:55.250629 n-d-854247-14 devstack@n-api.service[127017]: request: DELETE /compute/v2.1/servers/e9096e2e-d971-4866-ae12-472b3d9909ea HTTP/1.1 Oct 17 13:58:55.250629 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:58:55.250629 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:58:55.250629 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:58:55.250629 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:58:55.250629 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:58:55.250629 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:58:55.250629 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:58:55.250629 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:58:55.250629 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTV7LY5HyKXIBiWDJCG3V5sT42rtCOx1a0oRMtoibd5F_sflHwMTlRe9Y_uOa1HxVMLf4skT3kvoUZ584fC2ohAV2v8XUvXrQcJEEPLKlU8mLvFkUN1JC352BF9fy9_Q0qQLABy1MIy7jPkSZI0xF-7yfpY_h22PPPDKIkDzzcK6D9CQ Oct 17 13:58:55.250629 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:58:55.250629 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:58:55.250629 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:58:55.250629 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:58:55.250629 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:58:55.250629 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:58:55.250629 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 4fa57e8772684c93a406f3d01da2af88 Oct 17 13:58:55.250629 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServersTestJSON-749544598 Oct 17 13:58:55.250629 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:58:55.250629 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:58:55.250629 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4fa57e8772684c93a406f3d01da2af88", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:58:55.250629 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServersTestJSON-749544598 Oct 17 13:58:55.250629 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 4fa57e8772684c93a406f3d01da2af88 Oct 17 13:58:55.250629 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServersTestJSON-749544598 Oct 17 13:58:55.250629 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServersTestJSON-749544598-project Oct 17 13:58:55.250629 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:58:55.250629 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:58:55.250629 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: d78348abc02a4bb892902b0dd3bcfd6a Oct 17 13:58:55.250629 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServersTestJSON-749544598-project Oct 17 13:58:55.250629 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:58:55.250629 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance e9096e2e-d971-4866-ae12-472b3d9909ea could not be found. Oct 17 13:58:55.250629 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'e9096e2e-d971-4866-ae12-472b3d9909ea'} Oct 17 13:58:55.250629 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:58:55.250629 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:58:55.250629 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:58:55.250629 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:58:55.250629 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:58:55.250629 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:58:55.250629 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:58:55.250629 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:58:55.250629 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:58:55.250629 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:58:55.250629 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9096e2e-d971-4866-ae12-472b3d9909ea could not be found. Oct 17 13:58:55.250629 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:58:55.250629 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:58:55.250629 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:58:55.250629 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:58:55.250629 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:58:55.250629 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:58:55.250629 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:58:55.250629 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:58:55.250629 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:58:55.250629 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:58:55.250629 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:58:55.250629 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:58:55.250629 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:58:55.250629 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:58:55.250629 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:58:55.250629 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:58:55.250629 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:58:55.250629 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:58:55.250629 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9096e2e-d971-4866-ae12-472b3d9909ea could not be found. Oct 17 13:58:55.260301 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:58:55.260301 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:58:55.260301 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:58:55.260301 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:58:55.260301 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:58:55.260301 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:58:55.260301 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:58:55.260301 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:58:55.260301 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9096e2e-d971-4866-ae12-472b3d9909ea could not be found. Oct 17 13:58:55.260301 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:58:55.260301 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6489339c-b52d-4ec4-b112-b6ffb1d7606f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Returning 404 to user: Instance e9096e2e-d971-4866-ae12-472b3d9909ea could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:58:55.260301 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6489339c-b52d-4ec4-b112-b6ffb1d7606f tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "DELETE /compute/v2.1/servers/e9096e2e-d971-4866-ae12-472b3d9909ea" status: 404 len: 111 microversion: 2.1 time: 0.049449 Oct 17 13:58:55.263707 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2394/4926] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:58:55 2022] DELETE /compute/v2.1/servers/e9096e2e-d971-4866-ae12-472b3d9909ea => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:58:55.265425 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b3c429cf-80eb-4c11-b838-85ea60edeeb7 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:55.266049 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b3c429cf-80eb-4c11-b838-85ea60edeeb7 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 6d2bbd26-cb90-4e90-881f-a9346ee3002a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:55.271488 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-90b28155-e398-4a23-b0bc-95d77960a043 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:55.272116 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-90b28155-e398-4a23-b0bc-95d77960a043 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: e9096e2e-d971-4866-ae12-472b3d9909ea] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:55.278252 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b3c429cf-80eb-4c11-b838-85ea60edeeb7 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:55.278754 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b3c429cf-80eb-4c11-b838-85ea60edeeb7 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:55.278946 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-90b28155-e398-4a23-b0bc-95d77960a043 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:55.279216 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b3c429cf-80eb-4c11-b838-85ea60edeeb7 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:55.279966 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-90b28155-e398-4a23-b0bc-95d77960a043 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:55.280591 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-90b28155-e398-4a23-b0bc-95d77960a043 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:55.281469 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-90b28155-e398-4a23-b0bc-95d77960a043 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:55.282081 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-90b28155-e398-4a23-b0bc-95d77960a043 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:55.282777 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-90b28155-e398-4a23-b0bc-95d77960a043 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:55.283438 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b3c429cf-80eb-4c11-b838-85ea60edeeb7 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:55.283932 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b3c429cf-80eb-4c11-b838-85ea60edeeb7 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:55.284359 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b3c429cf-80eb-4c11-b838-85ea60edeeb7 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:55.306293 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-90b28155-e398-4a23-b0bc-95d77960a043 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] HTTP exception thrown: Instance e9096e2e-d971-4866-ae12-472b3d9909ea could not be found. Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-90b28155-e398-4a23-b0bc-95d77960a043 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Request method failure captured: Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/e9096e2e-d971-4866-ae12-472b3d9909ea HTTP/1.1 Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTV7LY5HyKXIBiWDJCG3V5sT42rtCOx1a0oRMtoibd5F_sflHwMTlRe9Y_uOa1HxVMLf4skT3kvoUZ584fC2ohAV2v8XUvXrQcJEEPLKlU8mLvFkUN1JC352BF9fy9_Q0qQLABy1MIy7jPkSZI0xF-7yfpY_h22PPPDKIkDzzcK6D9CQ Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 4fa57e8772684c93a406f3d01da2af88 Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServersTestJSON-749544598 Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4fa57e8772684c93a406f3d01da2af88", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServersTestJSON-749544598 Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 4fa57e8772684c93a406f3d01da2af88 Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServersTestJSON-749544598 Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServersTestJSON-749544598-project Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: d78348abc02a4bb892902b0dd3bcfd6a Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServersTestJSON-749544598-project Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance e9096e2e-d971-4866-ae12-472b3d9909ea could not be found. Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'e9096e2e-d971-4866-ae12-472b3d9909ea'} Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9096e2e-d971-4866-ae12-472b3d9909ea could not be found. Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9096e2e-d971-4866-ae12-472b3d9909ea could not be found. Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:58:55.308427 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:58:55.313187 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:58:55.313187 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:58:55.313187 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:58:55.313187 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:58:55.313187 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9096e2e-d971-4866-ae12-472b3d9909ea could not be found. Oct 17 13:58:55.313187 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:58:55.315752 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-90b28155-e398-4a23-b0bc-95d77960a043 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Returning 404 to user: Instance e9096e2e-d971-4866-ae12-472b3d9909ea could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:58:55.316877 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-90b28155-e398-4a23-b0bc-95d77960a043 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/e9096e2e-d971-4866-ae12-472b3d9909ea" status: 404 len: 111 microversion: 2.1 time: 0.052186 Oct 17 13:58:55.318004 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2395/4927] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:55 2022] GET /compute/v2.1/servers/e9096e2e-d971-4866-ae12-472b3d9909ea => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:58:55.327465 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d7cd5e66-745f-4de1-a19a-772262efc122 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:55.327972 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d7cd5e66-745f-4de1-a19a-772262efc122 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: a985a669-c5cf-450a-a3b8-66dd4dd8ab31] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:55.338610 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-d7cd5e66-745f-4de1-a19a-772262efc122 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] HTTP exception thrown: Instance a985a669-c5cf-450a-a3b8-66dd4dd8ab31 could not be found. Oct 17 13:58:55.342532 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d7cd5e66-745f-4de1-a19a-772262efc122 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Request method failure captured: Oct 17 13:58:55.342532 n-d-854247-14 devstack@n-api.service[127017]: request: DELETE /compute/v2.1/servers/a985a669-c5cf-450a-a3b8-66dd4dd8ab31 HTTP/1.1 Oct 17 13:58:55.342532 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:58:55.342532 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:58:55.342532 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:58:55.342532 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:58:55.342532 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:58:55.342532 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:58:55.342532 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:58:55.342532 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:58:55.342532 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTV7LY5HyKXIBiWDJCG3V5sT42rtCOx1a0oRMtoibd5F_sflHwMTlRe9Y_uOa1HxVMLf4skT3kvoUZ584fC2ohAV2v8XUvXrQcJEEPLKlU8mLvFkUN1JC352BF9fy9_Q0qQLABy1MIy7jPkSZI0xF-7yfpY_h22PPPDKIkDzzcK6D9CQ Oct 17 13:58:55.342532 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:58:55.342532 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:58:55.342532 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:58:55.342532 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:58:55.342532 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:58:55.342532 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:58:55.342532 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 4fa57e8772684c93a406f3d01da2af88 Oct 17 13:58:55.342532 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServersTestJSON-749544598 Oct 17 13:58:55.342532 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:58:55.342532 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:58:55.342532 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4fa57e8772684c93a406f3d01da2af88", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:58:55.342532 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServersTestJSON-749544598 Oct 17 13:58:55.342532 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 4fa57e8772684c93a406f3d01da2af88 Oct 17 13:58:55.342532 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServersTestJSON-749544598 Oct 17 13:58:55.342532 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServersTestJSON-749544598-project Oct 17 13:58:55.342532 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:58:55.342532 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:58:55.342532 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: d78348abc02a4bb892902b0dd3bcfd6a Oct 17 13:58:55.342532 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServersTestJSON-749544598-project Oct 17 13:58:55.342532 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:58:55.342532 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance a985a669-c5cf-450a-a3b8-66dd4dd8ab31 could not be found. Oct 17 13:58:55.342532 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'a985a669-c5cf-450a-a3b8-66dd4dd8ab31'} Oct 17 13:58:55.342532 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:58:55.342532 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:58:55.342532 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:58:55.342532 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:58:55.342532 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:58:55.342532 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:58:55.342532 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 13:58:55.342532 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 13:58:55.342532 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a985a669-c5cf-450a-a3b8-66dd4dd8ab31 could not be found. Oct 17 13:58:55.342532 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:58:55.342532 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:58:55.342532 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:58:55.342532 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:58:55.342532 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:58:55.342532 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:58:55.342532 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:58:55.342532 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:58:55.342532 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:58:55.342532 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:58:55.342532 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:58:55.342532 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:58:55.342532 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:58:55.342532 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:58:55.342532 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:58:55.342532 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:58:55.342532 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:58:55.342532 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:58:55.342532 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a985a669-c5cf-450a-a3b8-66dd4dd8ab31 could not be found. Oct 17 13:58:55.342532 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:58:55.342532 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:58:55.342532 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:58:55.347517 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:58:55.347517 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:58:55.347517 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:58:55.347517 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:58:55.347517 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:58:55.347517 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a985a669-c5cf-450a-a3b8-66dd4dd8ab31 could not be found. Oct 17 13:58:55.347517 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:58:55.347517 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d7cd5e66-745f-4de1-a19a-772262efc122 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Returning 404 to user: Instance a985a669-c5cf-450a-a3b8-66dd4dd8ab31 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:58:55.347517 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d7cd5e66-745f-4de1-a19a-772262efc122 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a985a669-c5cf-450a-a3b8-66dd4dd8ab31" status: 404 len: 111 microversion: 2.1 time: 0.020180 Oct 17 13:58:55.347517 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2396/4928] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:58:55 2022] DELETE /compute/v2.1/servers/a985a669-c5cf-450a-a3b8-66dd4dd8ab31 => generated 111 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:58:55.352599 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1881f18e-6376-4f12-a799-f77e3e094ac3 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:55.353220 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1881f18e-6376-4f12-a799-f77e3e094ac3 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: a985a669-c5cf-450a-a3b8-66dd4dd8ab31] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:55.361696 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-1881f18e-6376-4f12-a799-f77e3e094ac3 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] HTTP exception thrown: Instance a985a669-c5cf-450a-a3b8-66dd4dd8ab31 could not be found. Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1881f18e-6376-4f12-a799-f77e3e094ac3 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Request method failure captured: Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/a985a669-c5cf-450a-a3b8-66dd4dd8ab31 HTTP/1.1 Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTV7LY5HyKXIBiWDJCG3V5sT42rtCOx1a0oRMtoibd5F_sflHwMTlRe9Y_uOa1HxVMLf4skT3kvoUZ584fC2ohAV2v8XUvXrQcJEEPLKlU8mLvFkUN1JC352BF9fy9_Q0qQLABy1MIy7jPkSZI0xF-7yfpY_h22PPPDKIkDzzcK6D9CQ Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 4fa57e8772684c93a406f3d01da2af88 Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServersTestJSON-749544598 Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4fa57e8772684c93a406f3d01da2af88", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServersTestJSON-749544598 Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 4fa57e8772684c93a406f3d01da2af88 Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServersTestJSON-749544598 Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServersTestJSON-749544598-project Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: d78348abc02a4bb892902b0dd3bcfd6a Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServersTestJSON-749544598-project Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance a985a669-c5cf-450a-a3b8-66dd4dd8ab31 could not be found. Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'a985a669-c5cf-450a-a3b8-66dd4dd8ab31'} Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a985a669-c5cf-450a-a3b8-66dd4dd8ab31 could not be found. Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a985a669-c5cf-450a-a3b8-66dd4dd8ab31 could not be found. Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:58:55.363257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:58:55.367976 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:58:55.367976 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:58:55.367976 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a985a669-c5cf-450a-a3b8-66dd4dd8ab31 could not be found. Oct 17 13:58:55.367976 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:58:55.367976 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1881f18e-6376-4f12-a799-f77e3e094ac3 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Returning 404 to user: Instance a985a669-c5cf-450a-a3b8-66dd4dd8ab31 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:58:55.367976 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1881f18e-6376-4f12-a799-f77e3e094ac3 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/a985a669-c5cf-450a-a3b8-66dd4dd8ab31" status: 404 len: 111 microversion: 2.1 time: 0.016778 Oct 17 13:58:55.367976 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2397/4929] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:55 2022] GET /compute/v2.1/servers/a985a669-c5cf-450a-a3b8-66dd4dd8ab31 => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:58:55.379729 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-579c5de9-b3a4-4f76-8334-b94c6b57b513 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:55.379729 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-579c5de9-b3a4-4f76-8334-b94c6b57b513 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: fffaf6e3-13e1-4aed-898d-a09feff6f82b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:55.388926 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-579c5de9-b3a4-4f76-8334-b94c6b57b513 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:55.389420 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-579c5de9-b3a4-4f76-8334-b94c6b57b513 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:55.389858 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-579c5de9-b3a4-4f76-8334-b94c6b57b513 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:55.390777 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-579c5de9-b3a4-4f76-8334-b94c6b57b513 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:55.391449 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-579c5de9-b3a4-4f76-8334-b94c6b57b513 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:55.392189 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-579c5de9-b3a4-4f76-8334-b94c6b57b513 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:55.423327 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-579c5de9-b3a4-4f76-8334-b94c6b57b513 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: fffaf6e3-13e1-4aed-898d-a09feff6f82b] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:58:55.511096 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b3c429cf-80eb-4c11-b838-85ea60edeeb7 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:55.523860 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b3c429cf-80eb-4c11-b838-85ea60edeeb7 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a" status: 200 len: 1507 microversion: 2.1 time: 0.266492 Oct 17 13:58:55.524670 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2533/4930] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:55 2022] GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a => generated 1507 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:58:55.534986 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5d36ce7b-93d9-4f44-be6d-8641260219c4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:55.535634 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5d36ce7b-93d9-4f44-be6d-8641260219c4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:55.555451 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5d36ce7b-93d9-4f44-be6d-8641260219c4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:55.556918 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5d36ce7b-93d9-4f44-be6d-8641260219c4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:55.557487 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5d36ce7b-93d9-4f44-be6d-8641260219c4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:55.558356 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5d36ce7b-93d9-4f44-be6d-8641260219c4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:55.558915 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5d36ce7b-93d9-4f44-be6d-8641260219c4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:55.559705 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5d36ce7b-93d9-4f44-be6d-8641260219c4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:55.620914 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-579c5de9-b3a4-4f76-8334-b94c6b57b513 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "DELETE /compute/v2.1/servers/fffaf6e3-13e1-4aed-898d-a09feff6f82b" status: 204 len: 0 microversion: 2.1 time: 0.249613 Oct 17 13:58:55.625023 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2398/4931] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:58:55 2022] DELETE /compute/v2.1/servers/fffaf6e3-13e1-4aed-898d-a09feff6f82b => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:58:55.635075 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-39bb56fb-2bfa-4262-829d-05d43887debb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:55.636320 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-39bb56fb-2bfa-4262-829d-05d43887debb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: fffaf6e3-13e1-4aed-898d-a09feff6f82b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:55.644138 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-39bb56fb-2bfa-4262-829d-05d43887debb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:55.644631 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-39bb56fb-2bfa-4262-829d-05d43887debb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:55.645064 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-39bb56fb-2bfa-4262-829d-05d43887debb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:55.645903 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-39bb56fb-2bfa-4262-829d-05d43887debb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:55.646355 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-39bb56fb-2bfa-4262-829d-05d43887debb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:55.646775 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-39bb56fb-2bfa-4262-829d-05d43887debb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:55.856989 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5d36ce7b-93d9-4f44-be6d-8641260219c4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:55.871848 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5d36ce7b-93d9-4f44-be6d-8641260219c4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1676 microversion: 2.1 time: 0.343876 Oct 17 13:58:55.896396 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2534/4932] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:55 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1676 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:55.950122 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-39bb56fb-2bfa-4262-829d-05d43887debb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:55.970265 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-39bb56fb-2bfa-4262-829d-05d43887debb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/fffaf6e3-13e1-4aed-898d-a09feff6f82b" status: 200 len: 1480 microversion: 2.1 time: 0.339431 Oct 17 13:58:55.973924 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2399/4933] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:55 2022] GET /compute/v2.1/servers/fffaf6e3-13e1-4aed-898d-a09feff6f82b => generated 1480 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:56.547896 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3ccfb6ad-27a8-4d19-9668-754f3e7d95ec tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:56.548610 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3ccfb6ad-27a8-4d19-9668-754f3e7d95ec tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 6d2bbd26-cb90-4e90-881f-a9346ee3002a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:56.567558 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3ccfb6ad-27a8-4d19-9668-754f3e7d95ec tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:56.568067 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3ccfb6ad-27a8-4d19-9668-754f3e7d95ec tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:56.568517 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3ccfb6ad-27a8-4d19-9668-754f3e7d95ec tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:56.569256 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3ccfb6ad-27a8-4d19-9668-754f3e7d95ec tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:56.573760 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3ccfb6ad-27a8-4d19-9668-754f3e7d95ec tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:56.574218 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3ccfb6ad-27a8-4d19-9668-754f3e7d95ec tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:56.900988 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-db62c4d6-e021-429f-8069-a9dd15ae30aa tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:56.901812 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-db62c4d6-e021-429f-8069-a9dd15ae30aa tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:56.933658 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db62c4d6-e021-429f-8069-a9dd15ae30aa tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:56.934849 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db62c4d6-e021-429f-8069-a9dd15ae30aa tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:56.935946 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db62c4d6-e021-429f-8069-a9dd15ae30aa tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:56.936985 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db62c4d6-e021-429f-8069-a9dd15ae30aa tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:56.937675 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db62c4d6-e021-429f-8069-a9dd15ae30aa tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:56.938348 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db62c4d6-e021-429f-8069-a9dd15ae30aa tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:57.286377 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3ccfb6ad-27a8-4d19-9668-754f3e7d95ec tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:57.301180 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3ccfb6ad-27a8-4d19-9668-754f3e7d95ec tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a" status: 200 len: 1507 microversion: 2.1 time: 0.753361 Oct 17 13:58:57.303132 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2535/4934] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:56 2022] GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a => generated 1507 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:57.315823 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-76f870a0-f158-40fa-9772-f0c79375b8cb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:57.318729 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-76f870a0-f158-40fa-9772-f0c79375b8cb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: fffaf6e3-13e1-4aed-898d-a09feff6f82b] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:57.329876 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-76f870a0-f158-40fa-9772-f0c79375b8cb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:57.331338 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-76f870a0-f158-40fa-9772-f0c79375b8cb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:57.332346 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-76f870a0-f158-40fa-9772-f0c79375b8cb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:57.333952 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-76f870a0-f158-40fa-9772-f0c79375b8cb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:57.334973 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-76f870a0-f158-40fa-9772-f0c79375b8cb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:57.336151 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-76f870a0-f158-40fa-9772-f0c79375b8cb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:58.344444 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-db62c4d6-e021-429f-8069-a9dd15ae30aa tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:58.362537 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-db62c4d6-e021-429f-8069-a9dd15ae30aa tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1676 microversion: 2.1 time: 1.462724 Oct 17 13:58:58.364491 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2400/4935] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:56 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1676 bytes in 1469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:58:58.407085 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-78e47e22-a753-4954-9db3-99a1fc1f9b4b tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:58.407954 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-78e47e22-a753-4954-9db3-99a1fc1f9b4b tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 6d2bbd26-cb90-4e90-881f-a9346ee3002a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:58.420630 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-78e47e22-a753-4954-9db3-99a1fc1f9b4b tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:58.425907 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-78e47e22-a753-4954-9db3-99a1fc1f9b4b tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:58.426693 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-78e47e22-a753-4954-9db3-99a1fc1f9b4b tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:58.428660 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-78e47e22-a753-4954-9db3-99a1fc1f9b4b tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:58.429767 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-78e47e22-a753-4954-9db3-99a1fc1f9b4b tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:58.430940 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-78e47e22-a753-4954-9db3-99a1fc1f9b4b tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:58.558230 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-76f870a0-f158-40fa-9772-f0c79375b8cb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:58.568239 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-76f870a0-f158-40fa-9772-f0c79375b8cb tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/fffaf6e3-13e1-4aed-898d-a09feff6f82b" status: 200 len: 1480 microversion: 2.1 time: 1.263969 Oct 17 13:58:58.569412 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2536/4936] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:57 2022] GET /compute/v2.1/servers/fffaf6e3-13e1-4aed-898d-a09feff6f82b => generated 1480 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:58.908544 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-78e47e22-a753-4954-9db3-99a1fc1f9b4b tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:58.917816 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-78e47e22-a753-4954-9db3-99a1fc1f9b4b tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a" status: 200 len: 1450 microversion: 2.1 time: 0.542438 Oct 17 13:58:58.927565 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2401/4937] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:58 2022] GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a => generated 1450 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:58.943646 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5b7d66dc-471c-4cda-9d78-e22e99d75b3f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:58.944638 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5b7d66dc-471c-4cda-9d78-e22e99d75b3f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 6d2bbd26-cb90-4e90-881f-a9346ee3002a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:58.952832 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5b7d66dc-471c-4cda-9d78-e22e99d75b3f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:58.953855 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5b7d66dc-471c-4cda-9d78-e22e99d75b3f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:58.954768 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5b7d66dc-471c-4cda-9d78-e22e99d75b3f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:58.956153 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5b7d66dc-471c-4cda-9d78-e22e99d75b3f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:58.957659 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5b7d66dc-471c-4cda-9d78-e22e99d75b3f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:58.958356 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5b7d66dc-471c-4cda-9d78-e22e99d75b3f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:58.991381 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5b7d66dc-471c-4cda-9d78-e22e99d75b3f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 6d2bbd26-cb90-4e90-881f-a9346ee3002a] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:58:58.998705 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.compute.api [None req-5b7d66dc-471c-4cda-9d78-e22e99d75b3f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 6d2bbd26-cb90-4e90-881f-a9346ee3002a] Working on deleting snapshot adeb8ff8-05aa-49aa-84a1-6594f8e6cd6b from shelved instance... Oct 17 13:58:59.213052 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-c54f9735-09bc-4a63-871c-5d06db7c70bb req-c1cda338-84e9-44ee-a790-65d38f89bad8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fffaf6e3-13e1-4aed-898d-a09feff6f82b", "name": "network-vif-deleted", "tag": "4ce71f0a-cae6-4335-97ec-ceab15cbf618"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:58:59.230272 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-c54f9735-09bc-4a63-871c-5d06db7c70bb req-c1cda338-84e9-44ee-a790-65d38f89bad8 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:59.238676 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-c54f9735-09bc-4a63-871c-5d06db7c70bb req-c1cda338-84e9-44ee-a790-65d38f89bad8 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:59.239480 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-c54f9735-09bc-4a63-871c-5d06db7c70bb req-c1cda338-84e9-44ee-a790-65d38f89bad8 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:59.265885 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-c54f9735-09bc-4a63-871c-5d06db7c70bb req-c1cda338-84e9-44ee-a790-65d38f89bad8 service nova] Creating event network-vif-deleted:4ce71f0a-cae6-4335-97ec-ceab15cbf618 for instance fffaf6e3-13e1-4aed-898d-a09feff6f82b on n-h1-854247-14 Oct 17 13:58:59.282761 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-c54f9735-09bc-4a63-871c-5d06db7c70bb req-c1cda338-84e9-44ee-a790-65d38f89bad8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074340 Oct 17 13:58:59.284621 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2402/4938] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:58:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:58:59.393120 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-17e0527b-3d06-4502-b14f-bc2a91abbc29 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:59.394708 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-17e0527b-3d06-4502-b14f-bc2a91abbc29 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:59.409074 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-17e0527b-3d06-4502-b14f-bc2a91abbc29 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:59.410029 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-17e0527b-3d06-4502-b14f-bc2a91abbc29 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:59.410733 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-17e0527b-3d06-4502-b14f-bc2a91abbc29 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:59.413907 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-17e0527b-3d06-4502-b14f-bc2a91abbc29 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:59.414869 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-17e0527b-3d06-4502-b14f-bc2a91abbc29 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:59.415745 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-17e0527b-3d06-4502-b14f-bc2a91abbc29 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:59.786974 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-17e0527b-3d06-4502-b14f-bc2a91abbc29 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:59.796527 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-17e0527b-3d06-4502-b14f-bc2a91abbc29 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1676 microversion: 2.1 time: 0.408396 Oct 17 13:58:59.797465 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2403/4939] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:59 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1676 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:58:59.810871 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-aab17e64-bd50-4c96-9cc0-33d590cf1ed7 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:59.811985 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-aab17e64-bd50-4c96-9cc0-33d590cf1ed7 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: fffaf6e3-13e1-4aed-898d-a09feff6f82b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:59.825355 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aab17e64-bd50-4c96-9cc0-33d590cf1ed7 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:59.826125 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aab17e64-bd50-4c96-9cc0-33d590cf1ed7 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:59.826723 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aab17e64-bd50-4c96-9cc0-33d590cf1ed7 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:59.827679 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aab17e64-bd50-4c96-9cc0-33d590cf1ed7 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:59.829055 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aab17e64-bd50-4c96-9cc0-33d590cf1ed7 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:59.829798 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aab17e64-bd50-4c96-9cc0-33d590cf1ed7 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:59.965218 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aab17e64-bd50-4c96-9cc0-33d590cf1ed7 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:59.969144 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aab17e64-bd50-4c96-9cc0-33d590cf1ed7 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:59.969811 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aab17e64-bd50-4c96-9cc0-33d590cf1ed7 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:59.989582 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-aab17e64-bd50-4c96-9cc0-33d590cf1ed7 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lazy-loading 'fault' on Instance uuid fffaf6e3-13e1-4aed-898d-a09feff6f82b {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:59:00.259953 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-aab17e64-bd50-4c96-9cc0-33d590cf1ed7 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd78348abc02a4bb892902b0dd3bcfd6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa57e8772684c93a406f3d01da2af88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:00.271275 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-aab17e64-bd50-4c96-9cc0-33d590cf1ed7 tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/fffaf6e3-13e1-4aed-898d-a09feff6f82b" status: 200 len: 1283 microversion: 2.1 time: 0.468160 Oct 17 13:59:00.272232 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2404/4940] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:59 2022] GET /compute/v2.1/servers/fffaf6e3-13e1-4aed-898d-a09feff6f82b => generated 1283 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:00.351795 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-9fb66407-1b10-476c-9df2-351f7240769a req-b5c67986-8fad-44d9-8054-4bddc7baa4bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d2bbd26-cb90-4e90-881f-a9346ee3002a", "name": "network-vif-unplugged", "status": "completed", "tag": "7709c35f-ab2e-4e7f-8507-786eb35a55e3"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:59:00.368800 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-9fb66407-1b10-476c-9df2-351f7240769a req-b5c67986-8fad-44d9-8054-4bddc7baa4bb service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:00.369814 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-9fb66407-1b10-476c-9df2-351f7240769a req-b5c67986-8fad-44d9-8054-4bddc7baa4bb service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:00.370555 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-9fb66407-1b10-476c-9df2-351f7240769a req-b5c67986-8fad-44d9-8054-4bddc7baa4bb service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:00.386043 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:59:00.389497 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.compute.server_external_events [req-9fb66407-1b10-476c-9df2-351f7240769a req-b5c67986-8fad-44d9-8054-4bddc7baa4bb service nova] Unable to find a host for instance 6d2bbd26-cb90-4e90-881f-a9346ee3002a. Dropping event network-vif-unplugged {{(pid=127017) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 17 13:59:00.405125 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-9fb66407-1b10-476c-9df2-351f7240769a req-b5c67986-8fad-44d9-8054-4bddc7baa4bb service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.056826 Oct 17 13:59:00.410005 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2405/4941] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:59:00 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 75 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 17 13:59:00.424809 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5b7d66dc-471c-4cda-9d78-e22e99d75b3f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 6d2bbd26-cb90-4e90-881f-a9346ee3002a] Doing local delete in cell 23debefa-f967-4de1-8ea3-1fa7cc16392a(cell1) {{(pid=127016) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 17 13:59:00.425564 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5b7d66dc-471c-4cda-9d78-e22e99d75b3f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:00.426268 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5b7d66dc-471c-4cda-9d78-e22e99d75b3f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:00.433045 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5b7d66dc-471c-4cda-9d78-e22e99d75b3f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:00.433984 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.compute.api [None req-5b7d66dc-471c-4cda-9d78-e22e99d75b3f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 6d2bbd26-cb90-4e90-881f-a9346ee3002a] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 17 13:59:00.444534 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-5b7d66dc-471c-4cda-9d78-e22e99d75b3f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 6d2bbd26-cb90-4e90-881f-a9346ee3002a] deallocate_for_instance() {{(pid=127016) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 17 13:59:00.826554 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-fa402877-398e-4347-b113-d7567fdf8f87 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:00.827440 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-fa402877-398e-4347-b113-d7567fdf8f87 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:00.845650 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fa402877-398e-4347-b113-d7567fdf8f87 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:00.846351 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fa402877-398e-4347-b113-d7567fdf8f87 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:00.849550 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fa402877-398e-4347-b113-d7567fdf8f87 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:00.850499 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fa402877-398e-4347-b113-d7567fdf8f87 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:00.853426 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fa402877-398e-4347-b113-d7567fdf8f87 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:00.854575 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fa402877-398e-4347-b113-d7567fdf8f87 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:01.797996 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-fa402877-398e-4347-b113-d7567fdf8f87 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:01.808890 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-fa402877-398e-4347-b113-d7567fdf8f87 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1676 microversion: 2.1 time: 0.987714 Oct 17 13:59:01.810637 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2406/4942] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:00 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1676 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:59:01.816338 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-996f4f3f-572c-4244-a1e3-e03affa8c48d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:01.817549 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-996f4f3f-572c-4244-a1e3-e03affa8c48d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] [instance: fffaf6e3-13e1-4aed-898d-a09feff6f82b] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:01.829080 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-996f4f3f-572c-4244-a1e3-e03affa8c48d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:01.830036 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-996f4f3f-572c-4244-a1e3-e03affa8c48d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:01.831023 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-996f4f3f-572c-4244-a1e3-e03affa8c48d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:01.832163 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-996f4f3f-572c-4244-a1e3-e03affa8c48d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:01.832946 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-996f4f3f-572c-4244-a1e3-e03affa8c48d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:01.833714 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-996f4f3f-572c-4244-a1e3-e03affa8c48d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:01.863979 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-996f4f3f-572c-4244-a1e3-e03affa8c48d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] HTTP exception thrown: Instance fffaf6e3-13e1-4aed-898d-a09feff6f82b could not be found. Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-996f4f3f-572c-4244-a1e3-e03affa8c48d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Request method failure captured: Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/fffaf6e3-13e1-4aed-898d-a09feff6f82b HTTP/1.1 Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTV7LY5HyKXIBiWDJCG3V5sT42rtCOx1a0oRMtoibd5F_sflHwMTlRe9Y_uOa1HxVMLf4skT3kvoUZ584fC2ohAV2v8XUvXrQcJEEPLKlU8mLvFkUN1JC352BF9fy9_Q0qQLABy1MIy7jPkSZI0xF-7yfpY_h22PPPDKIkDzzcK6D9CQ Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 4fa57e8772684c93a406f3d01da2af88 Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServersTestJSON-749544598 Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4fa57e8772684c93a406f3d01da2af88"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4fa57e8772684c93a406f3d01da2af88", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServersTestJSON-749544598 Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 4fa57e8772684c93a406f3d01da2af88 Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServersTestJSON-749544598 Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServersTestJSON-749544598-project Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: d78348abc02a4bb892902b0dd3bcfd6a Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServersTestJSON-749544598-project Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance fffaf6e3-13e1-4aed-898d-a09feff6f82b could not be found. Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'fffaf6e3-13e1-4aed-898d-a09feff6f82b'} Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fffaf6e3-13e1-4aed-898d-a09feff6f82b could not be found. Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fffaf6e3-13e1-4aed-898d-a09feff6f82b could not be found. Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:59:01.866176 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:59:01.870810 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:59:01.870810 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:59:01.870810 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:59:01.870810 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:59:01.870810 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fffaf6e3-13e1-4aed-898d-a09feff6f82b could not be found. Oct 17 13:59:01.870810 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:59:01.870810 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-996f4f3f-572c-4244-a1e3-e03affa8c48d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] Returning 404 to user: Instance fffaf6e3-13e1-4aed-898d-a09feff6f82b could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:59:01.870810 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-996f4f3f-572c-4244-a1e3-e03affa8c48d tempest-ServersTestJSON-749544598 tempest-ServersTestJSON-749544598-project] 10.222.0.79 "GET /compute/v2.1/servers/fffaf6e3-13e1-4aed-898d-a09feff6f82b" status: 404 len: 111 microversion: 2.1 time: 0.057613 Oct 17 13:59:01.883604 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2407/4943] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:01 2022] GET /compute/v2.1/servers/fffaf6e3-13e1-4aed-898d-a09feff6f82b => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:59:02.838961 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-78977fbe-3014-494a-821a-43b30bf131b7 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:02.839695 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-78977fbe-3014-494a-821a-43b30bf131b7 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:02.849856 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-78977fbe-3014-494a-821a-43b30bf131b7 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:02.850341 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-78977fbe-3014-494a-821a-43b30bf131b7 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:02.850775 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-78977fbe-3014-494a-821a-43b30bf131b7 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:02.851511 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-78977fbe-3014-494a-821a-43b30bf131b7 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:02.851954 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-78977fbe-3014-494a-821a-43b30bf131b7 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:02.855216 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-78977fbe-3014-494a-821a-43b30bf131b7 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:03.608644 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-78977fbe-3014-494a-821a-43b30bf131b7 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:03.627231 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-78977fbe-3014-494a-821a-43b30bf131b7 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1676 microversion: 2.1 time: 0.792710 Oct 17 13:59:03.629447 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2408/4944] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:02 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1676 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:03.670286 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-5b7d66dc-471c-4cda-9d78-e22e99d75b3f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 6d2bbd26-cb90-4e90-881f-a9346ee3002a] Updating instance_info_cache with network_info: [] {{(pid=127016) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 17 13:59:03.680159 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-3c808733-0059-4b3b-8c19-62d0051ff226 req-c55c19a4-232e-4a43-81aa-9ee862fd8af8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d2bbd26-cb90-4e90-881f-a9346ee3002a", "name": "network-vif-deleted", "tag": "7709c35f-ab2e-4e7f-8507-786eb35a55e3"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:59:03.691946 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-3c808733-0059-4b3b-8c19-62d0051ff226 req-c55c19a4-232e-4a43-81aa-9ee862fd8af8 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:03.692437 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-3c808733-0059-4b3b-8c19-62d0051ff226 req-c55c19a4-232e-4a43-81aa-9ee862fd8af8 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:03.692873 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-3c808733-0059-4b3b-8c19-62d0051ff226 req-c55c19a4-232e-4a43-81aa-9ee862fd8af8 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:03.707029 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.compute.server_external_events [req-3c808733-0059-4b3b-8c19-62d0051ff226 req-c55c19a4-232e-4a43-81aa-9ee862fd8af8 service nova] Unable to find a host for instance 6d2bbd26-cb90-4e90-881f-a9346ee3002a. Dropping event network-vif-deleted {{(pid=127017) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 17 13:59:03.732589 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-3c808733-0059-4b3b-8c19-62d0051ff226 req-c55c19a4-232e-4a43-81aa-9ee862fd8af8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.057000 Oct 17 13:59:03.733684 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2409/4945] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 59 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 17 13:59:04.151144 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:59:04.381549 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5b7d66dc-471c-4cda-9d78-e22e99d75b3f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "DELETE /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a" status: 204 len: 0 microversion: 2.1 time: 5.441314 Oct 17 13:59:04.383704 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2537/4946] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:58:58 2022] DELETE /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a => generated 0 bytes in 5446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 13:59:04.392069 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a7f36960-9b2d-4d2c-bdce-b80c57f83404 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:04.393390 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a7f36960-9b2d-4d2c-bdce-b80c57f83404 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 6d2bbd26-cb90-4e90-881f-a9346ee3002a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:04.411830 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a7f36960-9b2d-4d2c-bdce-b80c57f83404 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:04.425453 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a7f36960-9b2d-4d2c-bdce-b80c57f83404 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:04.426192 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a7f36960-9b2d-4d2c-bdce-b80c57f83404 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:04.427139 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a7f36960-9b2d-4d2c-bdce-b80c57f83404 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:04.427788 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a7f36960-9b2d-4d2c-bdce-b80c57f83404 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:04.435891 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a7f36960-9b2d-4d2c-bdce-b80c57f83404 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:04.490548 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-a7f36960-9b2d-4d2c-bdce-b80c57f83404 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] HTTP exception thrown: Instance 6d2bbd26-cb90-4e90-881f-a9346ee3002a could not be found. Oct 17 13:59:04.492227 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a7f36960-9b2d-4d2c-bdce-b80c57f83404 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Request method failure captured: Oct 17 13:59:04.492227 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a HTTP/1.1 Oct 17 13:59:04.492227 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:59:04.492227 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:59:04.492227 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:59:04.492227 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:59:04.492227 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:59:04.492227 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:59:04.492227 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:59:04.492227 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:59:04.492227 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTV7tIaoYPgUdHiXX4NOkSSz-a4-puhL4AhnfvtJYmPyZ3fJvZDePMat9BASboFCn4C3QP9Vix9f7JprJ7jGUAeFojqdhpTvVML9HYK6oQI67GVbo4xYwR8dQKhVTSdcdIj_O_mmBimo8N7A_DyW-iY_pgxFAaVGSJ3vOytCqm8fGt3Q Oct 17 13:59:04.492227 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:59:04.492227 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:59:04.492227 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:59:04.492227 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:59:04.492227 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:59:04.492227 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:59:04.492227 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 0821e5beffdd41c2ad2adbd1d03cde71 Oct 17 13:59:04.492227 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-DeleteServersTestJSON-930683239 Oct 17 13:59:04.492227 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:59:04.492227 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:59:04.492227 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "tempest-type-757843761", "name": "tempest-service-527072566", "endpoints": [{"region": "tempest-region-1530587473", "publicURL": "https://url-594098419.com"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "tempest-type-1549021290", "name": "tempest-service-1797883724", "endpoints": [{"region": "tempest-region-85075699", "internalURL": "https://url-259507820.com"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0821e5beffdd41c2ad2adbd1d03cde71", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "tempest-type-1413520904", "name": "tempest-service-1708200528", "endpoints": []}] Oct 17 13:59:04.492227 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-DeleteServersTestJSON-930683239 Oct 17 13:59:04.492227 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 0821e5beffdd41c2ad2adbd1d03cde71 Oct 17 13:59:04.492227 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-DeleteServersTestJSON-930683239 Oct 17 13:59:04.492227 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-DeleteServersTestJSON-930683239-project Oct 17 13:59:04.492227 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:59:04.492227 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:59:04.492227 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: ab8baeba1d494df5bb9cf4d7289410b9 Oct 17 13:59:04.492227 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-DeleteServersTestJSON-930683239-project Oct 17 13:59:04.492227 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:59:04.492227 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 6d2bbd26-cb90-4e90-881f-a9346ee3002a could not be found. Oct 17 13:59:04.492227 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '6d2bbd26-cb90-4e90-881f-a9346ee3002a'} Oct 17 13:59:04.492227 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:59:04.492227 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:59:04.492227 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:59:04.492227 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:59:04.492227 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:59:04.492227 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:59:04.492227 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:59:04.492227 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:59:04.492227 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:59:04.492227 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:59:04.492227 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d2bbd26-cb90-4e90-881f-a9346ee3002a could not be found. Oct 17 13:59:04.492227 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:59:04.492227 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:59:04.492227 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:59:04.492227 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:59:04.492227 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:59:04.492227 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:59:04.492227 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:59:04.492227 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:59:04.492227 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:59:04.492227 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:59:04.492227 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:59:04.492227 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:59:04.492227 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:59:04.492227 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:59:04.492227 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:59:04.499147 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:59:04.499147 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d2bbd26-cb90-4e90-881f-a9346ee3002a could not be found. Oct 17 13:59:04.499147 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:59:04.499147 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:59:04.499147 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:59:04.499147 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:59:04.499147 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:59:04.499147 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:59:04.499147 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:59:04.499147 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:59:04.499147 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d2bbd26-cb90-4e90-881f-a9346ee3002a could not be found. Oct 17 13:59:04.499147 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:59:04.499147 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a7f36960-9b2d-4d2c-bdce-b80c57f83404 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Returning 404 to user: Instance 6d2bbd26-cb90-4e90-881f-a9346ee3002a could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:59:04.499147 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a7f36960-9b2d-4d2c-bdce-b80c57f83404 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a" status: 404 len: 111 microversion: 2.1 time: 0.106054 Oct 17 13:59:04.499147 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2410/4947] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:04 2022] GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:59:04.655687 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9b453e55-a2bb-401b-96ab-08c062d95667 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:04.657282 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9b453e55-a2bb-401b-96ab-08c062d95667 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:04.697358 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9b453e55-a2bb-401b-96ab-08c062d95667 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:04.701607 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9b453e55-a2bb-401b-96ab-08c062d95667 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:04.702113 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9b453e55-a2bb-401b-96ab-08c062d95667 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:04.702876 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9b453e55-a2bb-401b-96ab-08c062d95667 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:04.720392 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9b453e55-a2bb-401b-96ab-08c062d95667 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:04.720972 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9b453e55-a2bb-401b-96ab-08c062d95667 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:04.774408 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:59:04.897367 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-937ef2ef-8064-4e0f-937c-44dc9f6b3306 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1285602264", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "536c8c49-8501-4c2f-bf93-136c7f68a48c"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:59:05.002332 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-937ef2ef-8064-4e0f-937c-44dc9f6b3306 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] validate_networks() for [('536c8c49-8501-4c2f-bf93-136c7f68a48c', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:59:05.549677 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9b453e55-a2bb-401b-96ab-08c062d95667 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:05.571624 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9b453e55-a2bb-401b-96ab-08c062d95667 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1653 microversion: 2.1 time: 0.916620 Oct 17 13:59:05.573137 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2538/4948] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:04 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1653 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:05.596744 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-222e6ece-92bd-4afc-a935-3810641226a5 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:59:05.606039 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-222e6ece-92bd-4afc-a935-3810641226a5 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:05.606756 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-222e6ece-92bd-4afc-a935-3810641226a5 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:05.607425 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-222e6ece-92bd-4afc-a935-3810641226a5 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:05.664591 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-222e6ece-92bd-4afc-a935-3810641226a5 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Going to try to start instance {{(pid=127016) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 17 13:59:05.761245 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-222e6ece-92bd-4afc-a935-3810641226a5 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "POST /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d/action" status: 202 len: 0 microversion: 2.1 time: 0.168770 Oct 17 13:59:05.765356 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2539/4949] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:59:05 2022] POST /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:59:05.783849 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f967ffaf-425e-4a9f-ab23-bcf925fcc1ea tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:05.784940 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f967ffaf-425e-4a9f-ab23-bcf925fcc1ea tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:05.792198 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f967ffaf-425e-4a9f-ab23-bcf925fcc1ea tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:05.793044 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f967ffaf-425e-4a9f-ab23-bcf925fcc1ea tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:05.793689 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f967ffaf-425e-4a9f-ab23-bcf925fcc1ea tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:05.794628 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f967ffaf-425e-4a9f-ab23-bcf925fcc1ea tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:05.795343 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f967ffaf-425e-4a9f-ab23-bcf925fcc1ea tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:05.796061 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f967ffaf-425e-4a9f-ab23-bcf925fcc1ea tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:06.524815 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f967ffaf-425e-4a9f-ab23-bcf925fcc1ea tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:06.548780 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f967ffaf-425e-4a9f-ab23-bcf925fcc1ea tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1662 microversion: 2.1 time: 0.781497 Oct 17 13:59:06.550664 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2540/4950] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:05 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1662 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:07.097979 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-937ef2ef-8064-4e0f-937c-44dc9f6b3306 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:59:07.099128 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-937ef2ef-8064-4e0f-937c-44dc9f6b3306 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:59:07.099865 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-937ef2ef-8064-4e0f-937c-44dc9f6b3306 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:59:07.100513 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-937ef2ef-8064-4e0f-937c-44dc9f6b3306 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:59:07.101146 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-937ef2ef-8064-4e0f-937c-44dc9f6b3306 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:59:07.116299 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-937ef2ef-8064-4e0f-937c-44dc9f6b3306 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:07.119190 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-937ef2ef-8064-4e0f-937c-44dc9f6b3306 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:07.123954 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-937ef2ef-8064-4e0f-937c-44dc9f6b3306 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:07.124964 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-937ef2ef-8064-4e0f-937c-44dc9f6b3306 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:07.125408 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-937ef2ef-8064-4e0f-937c-44dc9f6b3306 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:07.125901 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-937ef2ef-8064-4e0f-937c-44dc9f6b3306 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:07.167934 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-937ef2ef-8064-4e0f-937c-44dc9f6b3306 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Getting quotas for project 0821e5beffdd41c2ad2adbd1d03cde71. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:59:07.182398 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-937ef2ef-8064-4e0f-937c-44dc9f6b3306 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Getting quotas for user ab8baeba1d494df5bb9cf4d7289410b9 and project 0821e5beffdd41c2ad2adbd1d03cde71. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:59:07.221729 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-937ef2ef-8064-4e0f-937c-44dc9f6b3306 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:59:07.225258 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-937ef2ef-8064-4e0f-937c-44dc9f6b3306 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: b681678a-4240-4b9b-929b-65d09606a07c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:59:07.355533 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-937ef2ef-8064-4e0f-937c-44dc9f6b3306 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.461989 Oct 17 13:59:07.359313 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2411/4951] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:59:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2467 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:59:07.382213 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f4fd3100-2a95-436a-8e53-19e7dc47f309 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:07.382791 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f4fd3100-2a95-436a-8e53-19e7dc47f309 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: b681678a-4240-4b9b-929b-65d09606a07c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:07.575811 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-12a44163-dfc9-437e-b48a-921df7d8b4e8 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:07.576987 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-12a44163-dfc9-437e-b48a-921df7d8b4e8 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:07.616481 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-12a44163-dfc9-437e-b48a-921df7d8b4e8 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:07.620900 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-12a44163-dfc9-437e-b48a-921df7d8b4e8 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:07.621381 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-12a44163-dfc9-437e-b48a-921df7d8b4e8 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:07.626340 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-12a44163-dfc9-437e-b48a-921df7d8b4e8 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:07.626948 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-12a44163-dfc9-437e-b48a-921df7d8b4e8 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:07.633278 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-12a44163-dfc9-437e-b48a-921df7d8b4e8 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:07.709755 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f4fd3100-2a95-436a-8e53-19e7dc47f309 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:07.720639 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f4fd3100-2a95-436a-8e53-19e7dc47f309 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c" status: 200 len: 1215 microversion: 2.1 time: 0.350806 Oct 17 13:59:07.729490 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2541/4952] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:07 2022] GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c => generated 1215 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:08.757845 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-791d66e5-0cc4-4193-8104-6b320d8b6638 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:08.758627 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-791d66e5-0cc4-4193-8104-6b320d8b6638 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: b681678a-4240-4b9b-929b-65d09606a07c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:08.780063 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-791d66e5-0cc4-4193-8104-6b320d8b6638 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:08.782607 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-791d66e5-0cc4-4193-8104-6b320d8b6638 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:08.784509 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-791d66e5-0cc4-4193-8104-6b320d8b6638 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:08.788392 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-791d66e5-0cc4-4193-8104-6b320d8b6638 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:08.788900 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-791d66e5-0cc4-4193-8104-6b320d8b6638 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:08.791477 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-791d66e5-0cc4-4193-8104-6b320d8b6638 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:09.331285 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-791d66e5-0cc4-4193-8104-6b320d8b6638 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:09.353728 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-791d66e5-0cc4-4193-8104-6b320d8b6638 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c" status: 200 len: 1211 microversion: 2.1 time: 0.601174 Oct 17 13:59:09.354908 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2542/4953] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:08 2022] GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c => generated 1211 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:09.433275 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-12a44163-dfc9-437e-b48a-921df7d8b4e8 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:09.443093 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-12a44163-dfc9-437e-b48a-921df7d8b4e8 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1662 microversion: 2.1 time: 1.873765 Oct 17 13:59:09.452975 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2412/4954] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:07 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1662 bytes in 1884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:10.378777 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9d850652-8700-4394-9042-4a217c616eb6 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:10.379445 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9d850652-8700-4394-9042-4a217c616eb6 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: b681678a-4240-4b9b-929b-65d09606a07c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:10.394753 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9d850652-8700-4394-9042-4a217c616eb6 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:10.395275 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9d850652-8700-4394-9042-4a217c616eb6 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:10.395705 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9d850652-8700-4394-9042-4a217c616eb6 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:10.396594 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9d850652-8700-4394-9042-4a217c616eb6 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:10.397202 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9d850652-8700-4394-9042-4a217c616eb6 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:10.397772 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9d850652-8700-4394-9042-4a217c616eb6 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:10.479664 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-cbe94f51-1871-4ce9-a321-0841b8e396ac tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:10.480262 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-cbe94f51-1871-4ce9-a321-0841b8e396ac tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:10.493076 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cbe94f51-1871-4ce9-a321-0841b8e396ac tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:10.493576 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cbe94f51-1871-4ce9-a321-0841b8e396ac tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:10.494004 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cbe94f51-1871-4ce9-a321-0841b8e396ac tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:10.494702 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cbe94f51-1871-4ce9-a321-0841b8e396ac tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:10.495148 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cbe94f51-1871-4ce9-a321-0841b8e396ac tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:10.495592 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cbe94f51-1871-4ce9-a321-0841b8e396ac tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:11.656732 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-cbe94f51-1871-4ce9-a321-0841b8e396ac tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:11.670555 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-cbe94f51-1871-4ce9-a321-0841b8e396ac tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1666 microversion: 2.1 time: 1.194957 Oct 17 13:59:11.692520 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2413/4955] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:10 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1666 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:59:11.731263 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9d850652-8700-4394-9042-4a217c616eb6 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:11.739025 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9423316e-1082-4c42-adb0-2ab8b646f0ae tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:11.743769 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9423316e-1082-4c42-adb0-2ab8b646f0ae tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:11.752753 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9d850652-8700-4394-9042-4a217c616eb6 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c" status: 200 len: 1315 microversion: 2.1 time: 1.378485 Oct 17 13:59:11.763118 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9423316e-1082-4c42-adb0-2ab8b646f0ae tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:11.763628 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9423316e-1082-4c42-adb0-2ab8b646f0ae tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:11.764058 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9423316e-1082-4c42-adb0-2ab8b646f0ae tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:11.765283 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9423316e-1082-4c42-adb0-2ab8b646f0ae tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:11.765283 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9423316e-1082-4c42-adb0-2ab8b646f0ae tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:11.765596 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9423316e-1082-4c42-adb0-2ab8b646f0ae tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:11.770085 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2543/4956] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:10 2022] GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c => generated 1315 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:12.673176 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9423316e-1082-4c42-adb0-2ab8b646f0ae tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:12.690126 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9423316e-1082-4c42-adb0-2ab8b646f0ae tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1666 microversion: 2.1 time: 0.975116 Oct 17 13:59:12.691405 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2414/4957] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:11 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1666 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:12.724148 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fae1941c-bbe7-4f88-bd3c-60585a4e0654 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:12.724996 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-fae1941c-bbe7-4f88-bd3c-60585a4e0654 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:12.736814 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fae1941c-bbe7-4f88-bd3c-60585a4e0654 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:12.741766 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fae1941c-bbe7-4f88-bd3c-60585a4e0654 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:12.744110 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fae1941c-bbe7-4f88-bd3c-60585a4e0654 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:12.746413 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fae1941c-bbe7-4f88-bd3c-60585a4e0654 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:12.747051 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fae1941c-bbe7-4f88-bd3c-60585a4e0654 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:12.747708 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fae1941c-bbe7-4f88-bd3c-60585a4e0654 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:12.788222 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-cc3cdafb-3e74-4d0c-abd2-7c01179b6b4b tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:12.788851 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-cc3cdafb-3e74-4d0c-abd2-7c01179b6b4b tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: b681678a-4240-4b9b-929b-65d09606a07c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:12.802559 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:59:12.808980 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cc3cdafb-3e74-4d0c-abd2-7c01179b6b4b tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:12.809752 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cc3cdafb-3e74-4d0c-abd2-7c01179b6b4b tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:12.813044 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cc3cdafb-3e74-4d0c-abd2-7c01179b6b4b tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:12.814539 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cc3cdafb-3e74-4d0c-abd2-7c01179b6b4b tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:12.815216 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cc3cdafb-3e74-4d0c-abd2-7c01179b6b4b tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:12.815815 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cc3cdafb-3e74-4d0c-abd2-7c01179b6b4b tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:13.345311 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fae1941c-bbe7-4f88-bd3c-60585a4e0654 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:13.355107 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fae1941c-bbe7-4f88-bd3c-60585a4e0654 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1666 microversion: 2.1 time: 0.634999 Oct 17 13:59:13.360209 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2544/4958] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:12 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1666 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:13.390131 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4d14690b-b48c-4380-b1b9-f412359ab1d2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:13.391222 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4d14690b-b48c-4380-b1b9-f412359ab1d2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:13.407118 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d14690b-b48c-4380-b1b9-f412359ab1d2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:13.407878 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d14690b-b48c-4380-b1b9-f412359ab1d2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:13.410060 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d14690b-b48c-4380-b1b9-f412359ab1d2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:13.418300 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d14690b-b48c-4380-b1b9-f412359ab1d2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:13.424141 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d14690b-b48c-4380-b1b9-f412359ab1d2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:13.427639 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d14690b-b48c-4380-b1b9-f412359ab1d2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:13.653150 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-cc3cdafb-3e74-4d0c-abd2-7c01179b6b4b tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:13.675676 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-cc3cdafb-3e74-4d0c-abd2-7c01179b6b4b tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c" status: 200 len: 1315 microversion: 2.1 time: 0.891093 Oct 17 13:59:13.680030 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2415/4959] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:12 2022] GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c => generated 1315 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:13.865575 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4d14690b-b48c-4380-b1b9-f412359ab1d2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:13.874966 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4d14690b-b48c-4380-b1b9-f412359ab1d2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1666 microversion: 2.1 time: 0.489332 Oct 17 13:59:13.884051 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2545/4960] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:13 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1666 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:59:13.920639 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bda5f954-fd00-424a-95d0-431122c906c1 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:13.921599 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-bda5f954-fd00-424a-95d0-431122c906c1 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:13.959870 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bda5f954-fd00-424a-95d0-431122c906c1 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:13.960519 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bda5f954-fd00-424a-95d0-431122c906c1 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:13.960974 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bda5f954-fd00-424a-95d0-431122c906c1 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:13.961733 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bda5f954-fd00-424a-95d0-431122c906c1 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:13.962196 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bda5f954-fd00-424a-95d0-431122c906c1 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:13.962632 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bda5f954-fd00-424a-95d0-431122c906c1 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:14.719437 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6f265dd2-d4cc-47e5-b370-8eb315d826cd tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:14.723949 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6f265dd2-d4cc-47e5-b370-8eb315d826cd tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: b681678a-4240-4b9b-929b-65d09606a07c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:14.746041 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6f265dd2-d4cc-47e5-b370-8eb315d826cd tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:14.746544 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6f265dd2-d4cc-47e5-b370-8eb315d826cd tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:14.755295 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6f265dd2-d4cc-47e5-b370-8eb315d826cd tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:14.756262 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6f265dd2-d4cc-47e5-b370-8eb315d826cd tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:14.756758 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6f265dd2-d4cc-47e5-b370-8eb315d826cd tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:14.757203 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6f265dd2-d4cc-47e5-b370-8eb315d826cd tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:15.989423 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-bda5f954-fd00-424a-95d0-431122c906c1 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:16.001947 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-bda5f954-fd00-424a-95d0-431122c906c1 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1666 microversion: 2.1 time: 2.085082 Oct 17 13:59:16.009712 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2416/4961] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:13 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1666 bytes in 2094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:16.035199 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b87aa6e1-6006-4858-ba2e-1dc0c29f8390 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:59:16.036755 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b87aa6e1-6006-4858-ba2e-1dc0c29f8390 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:16.048889 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b87aa6e1-6006-4858-ba2e-1dc0c29f8390 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:16.064033 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b87aa6e1-6006-4858-ba2e-1dc0c29f8390 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:16.065359 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b87aa6e1-6006-4858-ba2e-1dc0c29f8390 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:16.066268 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b87aa6e1-6006-4858-ba2e-1dc0c29f8390 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:16.066862 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b87aa6e1-6006-4858-ba2e-1dc0c29f8390 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:16.067441 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b87aa6e1-6006-4858-ba2e-1dc0c29f8390 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:16.112165 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-b87aa6e1-6006-4858-ba2e-1dc0c29f8390 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lazy-loading 'flavor' on Instance uuid 96dd349a-6476-4a7d-8f55-ea10e3b1e05d {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:59:16.193436 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6f265dd2-d4cc-47e5-b370-8eb315d826cd tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:16.214421 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6f265dd2-d4cc-47e5-b370-8eb315d826cd tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c" status: 200 len: 1315 microversion: 2.1 time: 1.508878 Oct 17 13:59:16.228281 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2546/4962] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:14 2022] GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c => generated 1315 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:16.292917 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b87aa6e1-6006-4858-ba2e-1dc0c29f8390 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "POST /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d/action" status: 202 len: 0 microversion: 2.1 time: 0.262439 Oct 17 13:59:16.297218 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2417/4963] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:59:16 2022] POST /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:59:16.302658 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-266208bd-45c6-448b-b442-6a932339407f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:16.303501 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-266208bd-45c6-448b-b442-6a932339407f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:16.319050 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-266208bd-45c6-448b-b442-6a932339407f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:16.319602 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-266208bd-45c6-448b-b442-6a932339407f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:16.320055 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-266208bd-45c6-448b-b442-6a932339407f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:16.320796 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-266208bd-45c6-448b-b442-6a932339407f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:16.332012 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-266208bd-45c6-448b-b442-6a932339407f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:16.332777 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-266208bd-45c6-448b-b442-6a932339407f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:16.919231 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-266208bd-45c6-448b-b442-6a932339407f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:16.930190 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-266208bd-45c6-448b-b442-6a932339407f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1674 microversion: 2.1 time: 0.631545 Oct 17 13:59:16.940070 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2547/4964] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:16 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1674 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:17.050224 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-2d863283-48ed-40fe-a555-6eabefed289a req-7d3a0e71-5f81-4fa8-a48e-4a6920ad423e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b681678a-4240-4b9b-929b-65d09606a07c", "tag": "8c256d92-39ac-4a69-a1a4-94b93e3ae39d"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:59:17.117711 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-2d863283-48ed-40fe-a555-6eabefed289a req-7d3a0e71-5f81-4fa8-a48e-4a6920ad423e service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:17.118213 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-2d863283-48ed-40fe-a555-6eabefed289a req-7d3a0e71-5f81-4fa8-a48e-4a6920ad423e service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:17.118656 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-2d863283-48ed-40fe-a555-6eabefed289a req-7d3a0e71-5f81-4fa8-a48e-4a6920ad423e service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:17.152862 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:59:17.155422 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-2d863283-48ed-40fe-a555-6eabefed289a req-7d3a0e71-5f81-4fa8-a48e-4a6920ad423e service nova] Creating event network-changed:8c256d92-39ac-4a69-a1a4-94b93e3ae39d for instance b681678a-4240-4b9b-929b-65d09606a07c on n-h1-854247-14 Oct 17 13:59:17.178988 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-2d863283-48ed-40fe-a555-6eabefed289a req-7d3a0e71-5f81-4fa8-a48e-4a6920ad423e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132763 Oct 17 13:59:17.180748 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2418/4965] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:59:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:59:17.242224 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ed15530b-8393-4ad7-a9e6-732f097c0a73 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:17.242888 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ed15530b-8393-4ad7-a9e6-732f097c0a73 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: b681678a-4240-4b9b-929b-65d09606a07c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:17.250413 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ed15530b-8393-4ad7-a9e6-732f097c0a73 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:17.250933 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ed15530b-8393-4ad7-a9e6-732f097c0a73 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:17.251321 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ed15530b-8393-4ad7-a9e6-732f097c0a73 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:17.252075 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ed15530b-8393-4ad7-a9e6-732f097c0a73 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:17.262772 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ed15530b-8393-4ad7-a9e6-732f097c0a73 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:17.263581 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ed15530b-8393-4ad7-a9e6-732f097c0a73 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:17.715490 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:59:17.748087 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ed15530b-8393-4ad7-a9e6-732f097c0a73 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:17.775233 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ed15530b-8393-4ad7-a9e6-732f097c0a73 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c" status: 200 len: 1315 microversion: 2.1 time: 0.531797 Oct 17 13:59:17.779302 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2548/4966] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:17 2022] GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c => generated 1315 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:17.963737 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-864d0e86-0bbd-4757-8ca6-a81a1679f2fa tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:17.964866 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-864d0e86-0bbd-4757-8ca6-a81a1679f2fa tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:17.980566 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=6 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:59:17.984849 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-864d0e86-0bbd-4757-8ca6-a81a1679f2fa tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:17.986735 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-864d0e86-0bbd-4757-8ca6-a81a1679f2fa tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:17.987466 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-864d0e86-0bbd-4757-8ca6-a81a1679f2fa tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:17.988517 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-864d0e86-0bbd-4757-8ca6-a81a1679f2fa tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:17.991067 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-864d0e86-0bbd-4757-8ca6-a81a1679f2fa tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:17.991807 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-864d0e86-0bbd-4757-8ca6-a81a1679f2fa tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:18.641791 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-864d0e86-0bbd-4757-8ca6-a81a1679f2fa tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:18.652480 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-864d0e86-0bbd-4757-8ca6-a81a1679f2fa tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1657 microversion: 2.1 time: 0.693784 Oct 17 13:59:18.654695 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2419/4967] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:17 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1657 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:18.680007 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a41dccb0-eb4d-42be-97fe-ef7decdbccf2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:59:18.681570 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a41dccb0-eb4d-42be-97fe-ef7decdbccf2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:18.688488 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a41dccb0-eb4d-42be-97fe-ef7decdbccf2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:18.689582 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a41dccb0-eb4d-42be-97fe-ef7decdbccf2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:18.690242 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a41dccb0-eb4d-42be-97fe-ef7decdbccf2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:18.691233 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a41dccb0-eb4d-42be-97fe-ef7decdbccf2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:18.691868 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a41dccb0-eb4d-42be-97fe-ef7decdbccf2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:18.692449 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a41dccb0-eb4d-42be-97fe-ef7decdbccf2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:18.802294 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1d3647bc-ad0c-4c45-a5cd-6802612843bf tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:18.802910 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1d3647bc-ad0c-4c45-a5cd-6802612843bf tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: b681678a-4240-4b9b-929b-65d09606a07c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:18.820843 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1d3647bc-ad0c-4c45-a5cd-6802612843bf tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:18.822658 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1d3647bc-ad0c-4c45-a5cd-6802612843bf tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:18.823324 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1d3647bc-ad0c-4c45-a5cd-6802612843bf tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:18.825216 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1d3647bc-ad0c-4c45-a5cd-6802612843bf tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:18.826857 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1d3647bc-ad0c-4c45-a5cd-6802612843bf tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:18.831239 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1d3647bc-ad0c-4c45-a5cd-6802612843bf tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:18.835906 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a41dccb0-eb4d-42be-97fe-ef7decdbccf2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "POST /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d/action" status: 202 len: 0 microversion: 2.1 time: 0.156139 Oct 17 13:59:18.837670 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2549/4968] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:59:18 2022] POST /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:59:18.851861 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-96ddda3f-3454-4a8f-8602-2b9e075c5b0b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:18.853743 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-96ddda3f-3454-4a8f-8602-2b9e075c5b0b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:18.884394 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-96ddda3f-3454-4a8f-8602-2b9e075c5b0b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:18.891150 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-96ddda3f-3454-4a8f-8602-2b9e075c5b0b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:18.893974 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-96ddda3f-3454-4a8f-8602-2b9e075c5b0b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:18.894785 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-96ddda3f-3454-4a8f-8602-2b9e075c5b0b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:18.897022 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-96ddda3f-3454-4a8f-8602-2b9e075c5b0b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:18.898679 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-96ddda3f-3454-4a8f-8602-2b9e075c5b0b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:19.511559 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1d3647bc-ad0c-4c45-a5cd-6802612843bf tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:19.525681 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1d3647bc-ad0c-4c45-a5cd-6802612843bf tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c" status: 200 len: 1315 microversion: 2.1 time: 0.724883 Oct 17 13:59:19.526688 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2420/4969] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:18 2022] GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c => generated 1315 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:19.648528 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-96ddda3f-3454-4a8f-8602-2b9e075c5b0b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:19.659760 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-96ddda3f-3454-4a8f-8602-2b9e075c5b0b tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1663 microversion: 2.1 time: 0.816951 Oct 17 13:59:19.660717 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2550/4970] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:18 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1663 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:20.553067 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-cb0a1d55-c126-4037-b3ce-2e2cc4316a69 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:20.553896 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-cb0a1d55-c126-4037-b3ce-2e2cc4316a69 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: b681678a-4240-4b9b-929b-65d09606a07c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:20.578049 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cb0a1d55-c126-4037-b3ce-2e2cc4316a69 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:20.578804 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cb0a1d55-c126-4037-b3ce-2e2cc4316a69 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:20.580785 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cb0a1d55-c126-4037-b3ce-2e2cc4316a69 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:20.582843 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cb0a1d55-c126-4037-b3ce-2e2cc4316a69 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:20.585249 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cb0a1d55-c126-4037-b3ce-2e2cc4316a69 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:20.585870 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cb0a1d55-c126-4037-b3ce-2e2cc4316a69 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:20.686390 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1044ea62-ebd5-4a43-a752-85aca8ae61c6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:20.687118 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-1044ea62-ebd5-4a43-a752-85aca8ae61c6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:20.698912 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1044ea62-ebd5-4a43-a752-85aca8ae61c6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:20.701406 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1044ea62-ebd5-4a43-a752-85aca8ae61c6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:20.701979 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1044ea62-ebd5-4a43-a752-85aca8ae61c6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:20.702826 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1044ea62-ebd5-4a43-a752-85aca8ae61c6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:20.710362 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1044ea62-ebd5-4a43-a752-85aca8ae61c6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:20.710933 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1044ea62-ebd5-4a43-a752-85aca8ae61c6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:21.377876 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-cb0a1d55-c126-4037-b3ce-2e2cc4316a69 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:21.382015 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-1044ea62-ebd5-4a43-a752-85aca8ae61c6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:21.396573 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-cb0a1d55-c126-4037-b3ce-2e2cc4316a69 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c" status: 200 len: 1315 microversion: 2.1 time: 0.848444 Oct 17 13:59:21.397680 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2421/4971] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:20 2022] GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c => generated 1315 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:21.401043 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1044ea62-ebd5-4a43-a752-85aca8ae61c6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1663 microversion: 2.1 time: 0.718414 Oct 17 13:59:21.420925 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2551/4972] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:20 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1663 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:59:21.882636 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2eb1e072-ac35-4e3a-8d82-427be5c987d2 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-927309063", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "1ed7a70d-5705-4549-9e5e-8e1edfd35ee5"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:59:21.957212 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-2eb1e072-ac35-4e3a-8d82-427be5c987d2 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] validate_networks() for [('1ed7a70d-5705-4549-9e5e-8e1edfd35ee5', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:59:22.420116 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ec00c4eb-05ad-4a4c-96f5-45ae98e74f9e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:22.420912 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ec00c4eb-05ad-4a4c-96f5-45ae98e74f9e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: b681678a-4240-4b9b-929b-65d09606a07c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:22.429394 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ec00c4eb-05ad-4a4c-96f5-45ae98e74f9e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:22.430603 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ec00c4eb-05ad-4a4c-96f5-45ae98e74f9e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:22.432677 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ec00c4eb-05ad-4a4c-96f5-45ae98e74f9e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:22.433723 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ec00c4eb-05ad-4a4c-96f5-45ae98e74f9e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:22.434487 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ec00c4eb-05ad-4a4c-96f5-45ae98e74f9e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:22.435150 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ec00c4eb-05ad-4a4c-96f5-45ae98e74f9e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:23.270999 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ec00c4eb-05ad-4a4c-96f5-45ae98e74f9e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:23.283000 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ec00c4eb-05ad-4a4c-96f5-45ae98e74f9e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c" status: 200 len: 1315 microversion: 2.1 time: 0.865325 Oct 17 13:59:23.298542 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2552/4973] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:22 2022] GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c => generated 1315 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:59:23.315437 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3e06aba2-fc23-4088-a482-7f84abbb0cd4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:23.316133 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3e06aba2-fc23-4088-a482-7f84abbb0cd4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:23.329617 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3e06aba2-fc23-4088-a482-7f84abbb0cd4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:23.340422 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3e06aba2-fc23-4088-a482-7f84abbb0cd4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:23.341102 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3e06aba2-fc23-4088-a482-7f84abbb0cd4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:23.342021 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3e06aba2-fc23-4088-a482-7f84abbb0cd4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:23.342633 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3e06aba2-fc23-4088-a482-7f84abbb0cd4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:23.343489 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3e06aba2-fc23-4088-a482-7f84abbb0cd4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:23.409811 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-2eb1e072-ac35-4e3a-8d82-427be5c987d2 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:59:23.410502 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-2eb1e072-ac35-4e3a-8d82-427be5c987d2 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:59:23.411073 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-2eb1e072-ac35-4e3a-8d82-427be5c987d2 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:59:23.412107 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-2eb1e072-ac35-4e3a-8d82-427be5c987d2 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:59:23.412603 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-2eb1e072-ac35-4e3a-8d82-427be5c987d2 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:59:23.435037 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2eb1e072-ac35-4e3a-8d82-427be5c987d2 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:23.440555 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2eb1e072-ac35-4e3a-8d82-427be5c987d2 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:23.441460 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2eb1e072-ac35-4e3a-8d82-427be5c987d2 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:23.442567 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2eb1e072-ac35-4e3a-8d82-427be5c987d2 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:23.443144 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2eb1e072-ac35-4e3a-8d82-427be5c987d2 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:23.443767 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2eb1e072-ac35-4e3a-8d82-427be5c987d2 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:23.496760 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-2eb1e072-ac35-4e3a-8d82-427be5c987d2 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Getting quotas for project c009a4e5e1e246e5b32da4f60e08eb19. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:59:23.515994 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-2eb1e072-ac35-4e3a-8d82-427be5c987d2 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Getting quotas for user 68a33f07ba9f4343ab9c263839d0e567 and project c009a4e5e1e246e5b32da4f60e08eb19. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:59:23.548828 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2eb1e072-ac35-4e3a-8d82-427be5c987d2 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:59:23.551259 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2eb1e072-ac35-4e3a-8d82-427be5c987d2 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] [instance: aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:59:23.749585 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2eb1e072-ac35-4e3a-8d82-427be5c987d2 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.350494 Oct 17 13:59:23.756431 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2422/4974] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 13:59:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2356 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:59:23.785859 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4404f7d2-30cd-4f56-9ed9-8c574e70fd2c tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:23.786514 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4404f7d2-30cd-4f56-9ed9-8c574e70fd2c tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] [instance: aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:23.836271 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3e06aba2-fc23-4088-a482-7f84abbb0cd4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:23.846709 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3e06aba2-fc23-4088-a482-7f84abbb0cd4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1666 microversion: 2.1 time: 0.546822 Oct 17 13:59:23.855714 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2553/4975] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:23 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1666 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:23.881365 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d9c1913a-4fb8-4f4b-aed0-1e0e5f05e863 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:23.882068 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d9c1913a-4fb8-4f4b-aed0-1e0e5f05e863 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:23.896097 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d9c1913a-4fb8-4f4b-aed0-1e0e5f05e863 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:23.900239 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d9c1913a-4fb8-4f4b-aed0-1e0e5f05e863 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:23.903013 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d9c1913a-4fb8-4f4b-aed0-1e0e5f05e863 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:23.908066 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d9c1913a-4fb8-4f4b-aed0-1e0e5f05e863 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:23.909580 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d9c1913a-4fb8-4f4b-aed0-1e0e5f05e863 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:23.910270 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d9c1913a-4fb8-4f4b-aed0-1e0e5f05e863 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:23.924325 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:59:23.932043 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4404f7d2-30cd-4f56-9ed9-8c574e70fd2c tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a33f07ba9f4343ab9c263839d0e567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c009a4e5e1e246e5b32da4f60e08eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:23.943644 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4404f7d2-30cd-4f56-9ed9-8c574e70fd2c tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] 10.222.0.79 "GET /compute/v2.1/servers/aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6" status: 200 len: 1227 microversion: 2.1 time: 0.174851 Oct 17 13:59:23.946284 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2423/4976] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:23 2022] GET /compute/v2.1/servers/aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6 => generated 1227 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:24.323870 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-277c031e-3971-4daa-80a5-6ffee51cb978 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:24.324610 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-277c031e-3971-4daa-80a5-6ffee51cb978 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: b681678a-4240-4b9b-929b-65d09606a07c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:24.345732 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-277c031e-3971-4daa-80a5-6ffee51cb978 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:24.347642 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-277c031e-3971-4daa-80a5-6ffee51cb978 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:24.348862 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-277c031e-3971-4daa-80a5-6ffee51cb978 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:24.351587 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-277c031e-3971-4daa-80a5-6ffee51cb978 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:24.352073 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-277c031e-3971-4daa-80a5-6ffee51cb978 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:24.352510 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-277c031e-3971-4daa-80a5-6ffee51cb978 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:24.578340 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d9c1913a-4fb8-4f4b-aed0-1e0e5f05e863 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:24.616971 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d9c1913a-4fb8-4f4b-aed0-1e0e5f05e863 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1666 microversion: 2.1 time: 0.739451 Oct 17 13:59:24.623145 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2554/4977] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:23 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1666 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:59:24.649446 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ac090f44-4532-4195-bc4f-1bc66c6de8fb tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:24.650191 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ac090f44-4532-4195-bc4f-1bc66c6de8fb tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: ad70195b-4a02-4a69-b6da-1f19fc3a51cd] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:24.666802 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ac090f44-4532-4195-bc4f-1bc66c6de8fb tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:24.667617 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ac090f44-4532-4195-bc4f-1bc66c6de8fb tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:24.670323 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ac090f44-4532-4195-bc4f-1bc66c6de8fb tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:24.671072 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ac090f44-4532-4195-bc4f-1bc66c6de8fb tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:24.671806 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ac090f44-4532-4195-bc4f-1bc66c6de8fb tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:24.672213 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ac090f44-4532-4195-bc4f-1bc66c6de8fb tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:24.745288 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ac090f44-4532-4195-bc4f-1bc66c6de8fb tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: ad70195b-4a02-4a69-b6da-1f19fc3a51cd] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:59:24.765244 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.compute.api [None req-ac090f44-4532-4195-bc4f-1bc66c6de8fb tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: ad70195b-4a02-4a69-b6da-1f19fc3a51cd] Working on deleting snapshot 79c04da8-4404-478b-8610-115f0e43aa04 from shelved instance... Oct 17 13:59:25.204754 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-277c031e-3971-4daa-80a5-6ffee51cb978 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:25.214145 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-277c031e-3971-4daa-80a5-6ffee51cb978 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c" status: 200 len: 1315 microversion: 2.1 time: 0.903672 Oct 17 13:59:25.220432 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2424/4978] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:24 2022] GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c => generated 1315 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:25.226642 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-974e2ca7-d833-402d-b8c2-0578400439f5 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:25.229840 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-974e2ca7-d833-402d-b8c2-0578400439f5 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] [instance: aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:25.240860 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-974e2ca7-d833-402d-b8c2-0578400439f5 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:25.247833 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-974e2ca7-d833-402d-b8c2-0578400439f5 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:25.248549 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-974e2ca7-d833-402d-b8c2-0578400439f5 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:25.249741 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-974e2ca7-d833-402d-b8c2-0578400439f5 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:25.250988 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-974e2ca7-d833-402d-b8c2-0578400439f5 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:25.251616 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-974e2ca7-d833-402d-b8c2-0578400439f5 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:25.376628 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-974e2ca7-d833-402d-b8c2-0578400439f5 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a33f07ba9f4343ab9c263839d0e567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c009a4e5e1e246e5b32da4f60e08eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:25.381240 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:59:25.398611 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-974e2ca7-d833-402d-b8c2-0578400439f5 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] 10.222.0.79 "GET /compute/v2.1/servers/aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6" status: 200 len: 1223 microversion: 2.1 time: 0.176932 Oct 17 13:59:25.400986 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2425/4979] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:25 2022] GET /compute/v2.1/servers/aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6 => generated 1223 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:25.772911 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ee3c78cd-d837-40f5-9bec-3a9659d9b83a tempest-ComputeTenantNetworksTest-78426828 tempest-ComputeTenantNetworksTest-78426828-project] Calling method '.version_select at 0x7f7cd45d5b80>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:26.036831 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ac090f44-4532-4195-bc4f-1bc66c6de8fb tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: ad70195b-4a02-4a69-b6da-1f19fc3a51cd] Doing local delete in cell 23debefa-f967-4de1-8ea3-1fa7cc16392a(cell1) {{(pid=127016) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 17 13:59:26.038739 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ac090f44-4532-4195-bc4f-1bc66c6de8fb tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:26.041790 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ac090f44-4532-4195-bc4f-1bc66c6de8fb tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:26.042519 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ac090f44-4532-4195-bc4f-1bc66c6de8fb tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:26.043315 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.compute.api [None req-ac090f44-4532-4195-bc4f-1bc66c6de8fb tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: ad70195b-4a02-4a69-b6da-1f19fc3a51cd] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 17 13:59:26.054853 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-ac090f44-4532-4195-bc4f-1bc66c6de8fb tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: ad70195b-4a02-4a69-b6da-1f19fc3a51cd] deallocate_for_instance() {{(pid=127016) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 17 13:59:26.528152 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ee3c78cd-d837-40f5-9bec-3a9659d9b83a tempest-ComputeTenantNetworksTest-78426828 tempest-ComputeTenantNetworksTest-78426828-project] 10.222.0.79 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 1.125860 Oct 17 13:59:26.535573 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2426/4980] 10.222.0.79 () {58 vars in 1158 bytes} [Mon Oct 17 13:59:25 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:59:26.541000 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b6b8c076-df5e-40b9-8006-2af1d35f80f5 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:26.541800 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b6b8c076-df5e-40b9-8006-2af1d35f80f5 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: b681678a-4240-4b9b-929b-65d09606a07c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:26.553916 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b6b8c076-df5e-40b9-8006-2af1d35f80f5 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:26.560814 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b6b8c076-df5e-40b9-8006-2af1d35f80f5 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:26.561486 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b6b8c076-df5e-40b9-8006-2af1d35f80f5 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:26.562714 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b6b8c076-df5e-40b9-8006-2af1d35f80f5 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:26.563382 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b6b8c076-df5e-40b9-8006-2af1d35f80f5 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:26.564019 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b6b8c076-df5e-40b9-8006-2af1d35f80f5 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:27.325047 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b6b8c076-df5e-40b9-8006-2af1d35f80f5 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:27.340023 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b6b8c076-df5e-40b9-8006-2af1d35f80f5 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c" status: 200 len: 1315 microversion: 2.1 time: 0.802654 Oct 17 13:59:27.353062 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2427/4981] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:26 2022] GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c => generated 1315 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:27.359077 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ef664fb1-3850-4c51-9596-423ce93909e8 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:27.360381 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ef664fb1-3850-4c51-9596-423ce93909e8 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] [instance: aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:27.373757 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ef664fb1-3850-4c51-9596-423ce93909e8 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:27.376005 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ef664fb1-3850-4c51-9596-423ce93909e8 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:27.377328 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ef664fb1-3850-4c51-9596-423ce93909e8 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:27.379071 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ef664fb1-3850-4c51-9596-423ce93909e8 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:27.380275 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ef664fb1-3850-4c51-9596-423ce93909e8 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:27.382607 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ef664fb1-3850-4c51-9596-423ce93909e8 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:27.537395 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-ac090f44-4532-4195-bc4f-1bc66c6de8fb tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: ad70195b-4a02-4a69-b6da-1f19fc3a51cd] Updating instance_info_cache with network_info: [] {{(pid=127016) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 17 13:59:27.579628 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ef664fb1-3850-4c51-9596-423ce93909e8 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a33f07ba9f4343ab9c263839d0e567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c009a4e5e1e246e5b32da4f60e08eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:27.592840 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ef664fb1-3850-4c51-9596-423ce93909e8 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] 10.222.0.79 "GET /compute/v2.1/servers/aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6" status: 200 len: 1285 microversion: 2.1 time: 0.238234 Oct 17 13:59:27.608427 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2428/4982] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:27 2022] GET /compute/v2.1/servers/aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6 => generated 1285 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:27.610521 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7c9bef7c-96d6-4c85-be53-acaab3ee9136 tempest-ComputeTenantNetworksTest-78426828 tempest-ComputeTenantNetworksTest-78426828-project] Calling method '.version_select at 0x7f7cd44fac10>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:27.823336 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ac090f44-4532-4195-bc4f-1bc66c6de8fb tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "DELETE /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd" status: 204 len: 0 microversion: 2.1 time: 3.177947 Oct 17 13:59:27.827923 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2555/4983] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:59:24 2022] DELETE /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd => generated 0 bytes in 3181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:59:27.853941 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-0025bb6f-6bf6-458a-916e-56bb4c4081f2 req-31a99c55-c218-45bc-abbf-2cbc76041349 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b681678a-4240-4b9b-929b-65d09606a07c", "name": "network-vif-plugged", "status": "completed", "tag": "8c256d92-39ac-4a69-a1a4-94b93e3ae39d"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:59:27.868270 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-0025bb6f-6bf6-458a-916e-56bb4c4081f2 req-31a99c55-c218-45bc-abbf-2cbc76041349 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:27.868846 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-0025bb6f-6bf6-458a-916e-56bb4c4081f2 req-31a99c55-c218-45bc-abbf-2cbc76041349 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:27.869343 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-0025bb6f-6bf6-458a-916e-56bb4c4081f2 req-31a99c55-c218-45bc-abbf-2cbc76041349 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:27.882527 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-0025bb6f-6bf6-458a-916e-56bb4c4081f2 req-31a99c55-c218-45bc-abbf-2cbc76041349 service nova] Creating event network-vif-plugged:8c256d92-39ac-4a69-a1a4-94b93e3ae39d for instance b681678a-4240-4b9b-929b-65d09606a07c on n-h1-854247-14 Oct 17 13:59:27.888792 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-0025bb6f-6bf6-458a-916e-56bb4c4081f2 req-31a99c55-c218-45bc-abbf-2cbc76041349 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062074 Oct 17 13:59:27.893342 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2556/4984] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:59:28.005562 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-2fa09bd1-9207-4bae-91f6-1f157c55260f req-2ec3ed32-abf1-4677-99e1-e437ef78e416 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad70195b-4a02-4a69-b6da-1f19fc3a51cd", "name": "network-vif-deleted", "tag": "6f5c8902-466c-4ca2-9d94-db58249199e2"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:59:28.024939 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-2fa09bd1-9207-4bae-91f6-1f157c55260f req-2ec3ed32-abf1-4677-99e1-e437ef78e416 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:28.025842 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-2fa09bd1-9207-4bae-91f6-1f157c55260f req-2ec3ed32-abf1-4677-99e1-e437ef78e416 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:28.026563 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-2fa09bd1-9207-4bae-91f6-1f157c55260f req-2ec3ed32-abf1-4677-99e1-e437ef78e416 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:28.040045 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.compute.server_external_events [req-2fa09bd1-9207-4bae-91f6-1f157c55260f req-2ec3ed32-abf1-4677-99e1-e437ef78e416 service nova] Unable to find a host for instance ad70195b-4a02-4a69-b6da-1f19fc3a51cd. Dropping event network-vif-deleted {{(pid=127016) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 17 13:59:28.041312 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-2fa09bd1-9207-4bae-91f6-1f157c55260f req-2ec3ed32-abf1-4677-99e1-e437ef78e416 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.148619 Oct 17 13:59:28.043087 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2557/4985] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 153 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 17 13:59:28.050121 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a3fae899-4c7b-45ea-8e32-f4ef6500d227 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:28.051203 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a3fae899-4c7b-45ea-8e32-f4ef6500d227 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: ad70195b-4a02-4a69-b6da-1f19fc3a51cd] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:28.054866 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7c9bef7c-96d6-4c85-be53-acaab3ee9136 tempest-ComputeTenantNetworksTest-78426828 tempest-ComputeTenantNetworksTest-78426828-project] 10.222.0.79 "GET /compute/v2.1/os-tenant-networks/431ac512-e0ba-44f1-95f3-eaf6ae90332e" status: 200 len: 140 microversion: 2.1 time: 0.460289 Oct 17 13:59:28.055854 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2429/4986] 10.222.0.79 () {58 vars in 1269 bytes} [Mon Oct 17 13:59:27 2022] GET /compute/v2.1/os-tenant-networks/431ac512-e0ba-44f1-95f3-eaf6ae90332e => generated 140 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:59:28.063536 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a3fae899-4c7b-45ea-8e32-f4ef6500d227 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:28.064393 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a3fae899-4c7b-45ea-8e32-f4ef6500d227 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:28.065080 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a3fae899-4c7b-45ea-8e32-f4ef6500d227 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:28.067203 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a3fae899-4c7b-45ea-8e32-f4ef6500d227 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:28.067902 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a3fae899-4c7b-45ea-8e32-f4ef6500d227 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:28.068707 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a3fae899-4c7b-45ea-8e32-f4ef6500d227 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:28.084099 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-a3fae899-4c7b-45ea-8e32-f4ef6500d227 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] HTTP exception thrown: Instance ad70195b-4a02-4a69-b6da-1f19fc3a51cd could not be found. Oct 17 13:59:28.086193 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a3fae899-4c7b-45ea-8e32-f4ef6500d227 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Request method failure captured: Oct 17 13:59:28.086193 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd HTTP/1.1 Oct 17 13:59:28.086193 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:59:28.086193 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:59:28.086193 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:59:28.086193 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:59:28.086193 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:59:28.086193 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:59:28.086193 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:59:28.086193 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:59:28.086193 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTV3d-N_EWyrXl_-ZTSAdolghE5oRFAiaYrRKtyahJLuH4Zuc1PUgzCd73YN56SLIjM6miTpzCnqqJsn0BnrpuTYHk5E8J5lGILVtffaMFsULUCEEbYJyYFLHPoFVhrk6yfNnfYA84mZ9NkF5HFg6duIruC8u2pcezDZ7UQon3qHG7VE Oct 17 13:59:28.086193 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:59:28.086193 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:59:28.086193 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:59:28.086193 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:59:28.086193 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:59:28.086193 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:59:28.086193 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 45371f66db35454fbe896194e75afd6e Oct 17 13:59:28.086193 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServerActionsTestJSON-845020662 Oct 17 13:59:28.086193 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:59:28.086193 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:59:28.086193 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/45371f66db35454fbe896194e75afd6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/45371f66db35454fbe896194e75afd6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/45371f66db35454fbe896194e75afd6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_45371f66db35454fbe896194e75afd6e", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:59:28.086193 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServerActionsTestJSON-845020662 Oct 17 13:59:28.086193 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 45371f66db35454fbe896194e75afd6e Oct 17 13:59:28.086193 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServerActionsTestJSON-845020662 Oct 17 13:59:28.086193 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServerActionsTestJSON-845020662-project Oct 17 13:59:28.086193 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:59:28.086193 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:59:28.086193 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: c9382b34782f44e2818a26ecadc3f386 Oct 17 13:59:28.086193 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServerActionsTestJSON-845020662-project Oct 17 13:59:28.086193 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:59:28.086193 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance ad70195b-4a02-4a69-b6da-1f19fc3a51cd could not be found. Oct 17 13:59:28.086193 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'ad70195b-4a02-4a69-b6da-1f19fc3a51cd'} Oct 17 13:59:28.086193 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:59:28.086193 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:59:28.086193 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:59:28.086193 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:59:28.086193 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:59:28.086193 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:59:28.086193 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:59:28.086193 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:59:28.086193 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:59:28.086193 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:59:28.086193 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad70195b-4a02-4a69-b6da-1f19fc3a51cd could not be found. Oct 17 13:59:28.086193 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:59:28.086193 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:59:28.086193 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:59:28.086193 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:59:28.086193 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:59:28.086193 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:59:28.086193 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:59:28.086193 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:59:28.086193 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:59:28.086193 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:59:28.086193 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:59:28.086193 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:59:28.086193 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:59:28.086193 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:59:28.086193 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:59:28.086193 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:59:28.086193 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad70195b-4a02-4a69-b6da-1f19fc3a51cd could not be found. Oct 17 13:59:28.086193 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:59:28.086193 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:59:28.086193 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:59:28.091026 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:59:28.091026 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:59:28.091026 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:59:28.091026 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:59:28.091026 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:59:28.091026 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad70195b-4a02-4a69-b6da-1f19fc3a51cd could not be found. Oct 17 13:59:28.091026 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:59:28.093741 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a3fae899-4c7b-45ea-8e32-f4ef6500d227 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Returning 404 to user: Instance ad70195b-4a02-4a69-b6da-1f19fc3a51cd could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:59:28.094921 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a3fae899-4c7b-45ea-8e32-f4ef6500d227 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd" status: 404 len: 111 microversion: 2.1 time: 0.050541 Oct 17 13:59:28.095820 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2558/4987] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:28 2022] GET /compute/v2.1/servers/ad70195b-4a02-4a69-b6da-1f19fc3a51cd => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:59:28.104291 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-49449380-b0a0-4a57-8e7e-13544806d400 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:28.104736 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-49449380-b0a0-4a57-8e7e-13544806d400 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:28.118313 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-49449380-b0a0-4a57-8e7e-13544806d400 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:28.118313 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-49449380-b0a0-4a57-8e7e-13544806d400 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:28.118313 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-49449380-b0a0-4a57-8e7e-13544806d400 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:28.118593 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-49449380-b0a0-4a57-8e7e-13544806d400 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:28.118975 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-49449380-b0a0-4a57-8e7e-13544806d400 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:28.119607 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-49449380-b0a0-4a57-8e7e-13544806d400 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:28.152370 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-49449380-b0a0-4a57-8e7e-13544806d400 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:59:28.274424 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-49449380-b0a0-4a57-8e7e-13544806d400 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "DELETE /compute/v2.1/servers/aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4" status: 204 len: 0 microversion: 2.1 time: 0.174051 Oct 17 13:59:28.282307 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2430/4988] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:59:28 2022] DELETE /compute/v2.1/servers/aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:59:28.288855 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e0233713-0a21-4580-8faa-f1cd22ff3df2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:28.290200 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e0233713-0a21-4580-8faa-f1cd22ff3df2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:28.297900 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e0233713-0a21-4580-8faa-f1cd22ff3df2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:28.298859 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e0233713-0a21-4580-8faa-f1cd22ff3df2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:28.299725 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e0233713-0a21-4580-8faa-f1cd22ff3df2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:28.300927 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e0233713-0a21-4580-8faa-f1cd22ff3df2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:28.301591 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e0233713-0a21-4580-8faa-f1cd22ff3df2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:28.302335 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e0233713-0a21-4580-8faa-f1cd22ff3df2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:28.377376 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-067bba56-1842-47a8-9d15-525a35b20bc2 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:28.378294 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-067bba56-1842-47a8-9d15-525a35b20bc2 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: b681678a-4240-4b9b-929b-65d09606a07c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:28.389235 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-067bba56-1842-47a8-9d15-525a35b20bc2 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:28.391046 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-067bba56-1842-47a8-9d15-525a35b20bc2 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:28.399632 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-067bba56-1842-47a8-9d15-525a35b20bc2 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:28.399632 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-067bba56-1842-47a8-9d15-525a35b20bc2 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:28.399632 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-067bba56-1842-47a8-9d15-525a35b20bc2 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:28.399632 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-067bba56-1842-47a8-9d15-525a35b20bc2 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:28.697398 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e0233713-0a21-4580-8faa-f1cd22ff3df2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:28.712770 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e0233713-0a21-4580-8faa-f1cd22ff3df2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4" status: 200 len: 1465 microversion: 2.1 time: 0.426838 Oct 17 13:59:28.731206 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2559/4989] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:28 2022] GET /compute/v2.1/servers/aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4 => generated 1465 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:28.731642 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8b11619b-ba67-4702-92a4-cdce4ba099b5 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:28.736602 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8b11619b-ba67-4702-92a4-cdce4ba099b5 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] [instance: aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:28.763686 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8b11619b-ba67-4702-92a4-cdce4ba099b5 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:28.764730 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8b11619b-ba67-4702-92a4-cdce4ba099b5 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:28.767203 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8b11619b-ba67-4702-92a4-cdce4ba099b5 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:28.768164 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8b11619b-ba67-4702-92a4-cdce4ba099b5 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:28.772178 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8b11619b-ba67-4702-92a4-cdce4ba099b5 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:28.774038 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8b11619b-ba67-4702-92a4-cdce4ba099b5 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:29.313963 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-067bba56-1842-47a8-9d15-525a35b20bc2 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:29.327576 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-067bba56-1842-47a8-9d15-525a35b20bc2 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c" status: 200 len: 1315 microversion: 2.1 time: 0.955194 Oct 17 13:59:29.333233 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2431/4990] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:28 2022] GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c => generated 1315 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:29.373357 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8b11619b-ba67-4702-92a4-cdce4ba099b5 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a33f07ba9f4343ab9c263839d0e567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c009a4e5e1e246e5b32da4f60e08eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:29.406494 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8b11619b-ba67-4702-92a4-cdce4ba099b5 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] 10.222.0.79 "GET /compute/v2.1/servers/aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6" status: 200 len: 1327 microversion: 2.1 time: 0.683268 Oct 17 13:59:29.408008 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2560/4991] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:28 2022] GET /compute/v2.1/servers/aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6 => generated 1327 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:29.745479 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-34ae0d0e-42d7-444b-88a3-af82eee3d1d8 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:29.745479 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-34ae0d0e-42d7-444b-88a3-af82eee3d1d8 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:29.760152 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-34ae0d0e-42d7-444b-88a3-af82eee3d1d8 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:29.760684 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-34ae0d0e-42d7-444b-88a3-af82eee3d1d8 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:29.761117 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-34ae0d0e-42d7-444b-88a3-af82eee3d1d8 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:29.762210 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-34ae0d0e-42d7-444b-88a3-af82eee3d1d8 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:29.762661 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-34ae0d0e-42d7-444b-88a3-af82eee3d1d8 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:29.764563 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-34ae0d0e-42d7-444b-88a3-af82eee3d1d8 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:30.243695 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-34ae0d0e-42d7-444b-88a3-af82eee3d1d8 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:30.251893 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-34ae0d0e-42d7-444b-88a3-af82eee3d1d8 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4" status: 200 len: 1465 microversion: 2.1 time: 0.511228 Oct 17 13:59:30.256709 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2432/4992] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:29 2022] GET /compute/v2.1/servers/aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4 => generated 1465 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:30.360076 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e40228e7-f71a-4201-b577-3f7376002ab1 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:30.360815 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e40228e7-f71a-4201-b577-3f7376002ab1 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: b681678a-4240-4b9b-929b-65d09606a07c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:30.407215 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e40228e7-f71a-4201-b577-3f7376002ab1 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:30.410055 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e40228e7-f71a-4201-b577-3f7376002ab1 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:30.410567 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e40228e7-f71a-4201-b577-3f7376002ab1 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:30.411360 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e40228e7-f71a-4201-b577-3f7376002ab1 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:30.411822 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e40228e7-f71a-4201-b577-3f7376002ab1 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:30.415519 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e40228e7-f71a-4201-b577-3f7376002ab1 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:30.430907 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-838cbd6a-a83d-41a7-9673-2a797647178a tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:30.431643 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-838cbd6a-a83d-41a7-9673-2a797647178a tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] [instance: aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:30.445706 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-838cbd6a-a83d-41a7-9673-2a797647178a tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:30.449175 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-838cbd6a-a83d-41a7-9673-2a797647178a tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:30.449627 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-838cbd6a-a83d-41a7-9673-2a797647178a tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:30.450578 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-838cbd6a-a83d-41a7-9673-2a797647178a tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:30.450810 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-838cbd6a-a83d-41a7-9673-2a797647178a tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:30.451271 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-838cbd6a-a83d-41a7-9673-2a797647178a tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:31.782065 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e40228e7-f71a-4201-b577-3f7376002ab1 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:31.799337 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e40228e7-f71a-4201-b577-3f7376002ab1 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c" status: 200 len: 1502 microversion: 2.1 time: 1.443570 Oct 17 13:59:31.802127 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2561/4993] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:30 2022] GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c => generated 1502 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:31.829058 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-dbcc7e1b-8d81-458f-95b4-f5ed0c6104a7 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:31.832025 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-dbcc7e1b-8d81-458f-95b4-f5ed0c6104a7 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:31.846091 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dbcc7e1b-8d81-458f-95b4-f5ed0c6104a7 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:31.846636 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dbcc7e1b-8d81-458f-95b4-f5ed0c6104a7 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:31.847081 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dbcc7e1b-8d81-458f-95b4-f5ed0c6104a7 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:31.849642 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dbcc7e1b-8d81-458f-95b4-f5ed0c6104a7 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:31.850527 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dbcc7e1b-8d81-458f-95b4-f5ed0c6104a7 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:31.850527 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dbcc7e1b-8d81-458f-95b4-f5ed0c6104a7 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:31.909086 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-838cbd6a-a83d-41a7-9673-2a797647178a tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a33f07ba9f4343ab9c263839d0e567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c009a4e5e1e246e5b32da4f60e08eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:31.917619 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-838cbd6a-a83d-41a7-9673-2a797647178a tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] 10.222.0.79 "GET /compute/v2.1/servers/aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6" status: 200 len: 1327 microversion: 2.1 time: 1.490811 Oct 17 13:59:31.931198 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2433/4994] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:30 2022] GET /compute/v2.1/servers/aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6 => generated 1327 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:31.931198 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ae570204-d3ba-43e5-bf38-923fcfa3d436 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:59:31.960642 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae570204-d3ba-43e5-bf38-923fcfa3d436 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:31.961124 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae570204-d3ba-43e5-bf38-923fcfa3d436 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:31.961560 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae570204-d3ba-43e5-bf38-923fcfa3d436 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:32.020772 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ae570204-d3ba-43e5-bf38-923fcfa3d436 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: b681678a-4240-4b9b-929b-65d09606a07c] Going to try to stop instance {{(pid=127017) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 17 13:59:32.143080 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ae570204-d3ba-43e5-bf38-923fcfa3d436 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "POST /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c/action" status: 202 len: 0 microversion: 2.1 time: 0.223218 Oct 17 13:59:32.148139 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2434/4995] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 13:59:31 2022] POST /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:59:32.162783 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-93192f22-ca7b-46ef-81e6-9e003bb740d9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:32.163499 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-93192f22-ca7b-46ef-81e6-9e003bb740d9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: b681678a-4240-4b9b-929b-65d09606a07c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:32.180574 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-93192f22-ca7b-46ef-81e6-9e003bb740d9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:32.181072 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-93192f22-ca7b-46ef-81e6-9e003bb740d9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:32.181498 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-93192f22-ca7b-46ef-81e6-9e003bb740d9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:32.194779 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-93192f22-ca7b-46ef-81e6-9e003bb740d9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:32.195582 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-93192f22-ca7b-46ef-81e6-9e003bb740d9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:32.196217 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-93192f22-ca7b-46ef-81e6-9e003bb740d9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:32.393713 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-dbcc7e1b-8d81-458f-95b4-f5ed0c6104a7 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:32.402779 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-dbcc7e1b-8d81-458f-95b4-f5ed0c6104a7 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4" status: 200 len: 1465 microversion: 2.1 time: 0.581506 Oct 17 13:59:32.415668 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2562/4996] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:31 2022] GET /compute/v2.1/servers/aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4 => generated 1465 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:32.897562 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-93192f22-ca7b-46ef-81e6-9e003bb740d9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:32.906484 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-93192f22-ca7b-46ef-81e6-9e003bb740d9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c" status: 200 len: 1512 microversion: 2.1 time: 0.756796 Oct 17 13:59:32.909696 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2435/4997] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:32 2022] GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c => generated 1512 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:32.943659 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-65f2aa90-80a6-4a91-b0e0-f372610d2f5d req-c5b60731-1bc7-4b5e-8322-b73f7ea66980 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4", "name": "network-vif-deleted", "tag": "55f82612-9d0b-4e45-9fd0-6a5fbb10343f"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:59:32.950880 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-beabf139-bc77-4876-9b82-951eefbdf08f tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:32.954492 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-beabf139-bc77-4876-9b82-951eefbdf08f tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] [instance: aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:32.970742 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-65f2aa90-80a6-4a91-b0e0-f372610d2f5d req-c5b60731-1bc7-4b5e-8322-b73f7ea66980 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:32.974626 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-beabf139-bc77-4876-9b82-951eefbdf08f tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:32.978348 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-65f2aa90-80a6-4a91-b0e0-f372610d2f5d req-c5b60731-1bc7-4b5e-8322-b73f7ea66980 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:32.979264 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-beabf139-bc77-4876-9b82-951eefbdf08f tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:32.981589 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-65f2aa90-80a6-4a91-b0e0-f372610d2f5d req-c5b60731-1bc7-4b5e-8322-b73f7ea66980 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:32.981922 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-beabf139-bc77-4876-9b82-951eefbdf08f tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:32.983571 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-beabf139-bc77-4876-9b82-951eefbdf08f tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:32.988796 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-beabf139-bc77-4876-9b82-951eefbdf08f tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:32.992444 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-beabf139-bc77-4876-9b82-951eefbdf08f tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:33.026935 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-65f2aa90-80a6-4a91-b0e0-f372610d2f5d req-c5b60731-1bc7-4b5e-8322-b73f7ea66980 service nova] Creating event network-vif-deleted:55f82612-9d0b-4e45-9fd0-6a5fbb10343f for instance aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4 on n-h2-854247-14 Oct 17 13:59:33.049842 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-65f2aa90-80a6-4a91-b0e0-f372610d2f5d req-c5b60731-1bc7-4b5e-8322-b73f7ea66980 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113226 Oct 17 13:59:33.077449 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2563/4998] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:59:33.444573 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-94e2f7fe-c3fc-46e2-888d-0815cf66eea4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:33.445510 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-94e2f7fe-c3fc-46e2-888d-0815cf66eea4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:33.462694 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94e2f7fe-c3fc-46e2-888d-0815cf66eea4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:33.463452 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94e2f7fe-c3fc-46e2-888d-0815cf66eea4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:33.464597 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:59:33.466144 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94e2f7fe-c3fc-46e2-888d-0815cf66eea4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:33.467093 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94e2f7fe-c3fc-46e2-888d-0815cf66eea4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:33.468017 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94e2f7fe-c3fc-46e2-888d-0815cf66eea4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:33.468649 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94e2f7fe-c3fc-46e2-888d-0815cf66eea4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:33.543828 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94e2f7fe-c3fc-46e2-888d-0815cf66eea4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:33.550569 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94e2f7fe-c3fc-46e2-888d-0815cf66eea4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:33.551138 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94e2f7fe-c3fc-46e2-888d-0815cf66eea4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:33.551739 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-94e2f7fe-c3fc-46e2-888d-0815cf66eea4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lazy-loading 'fault' on Instance uuid aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:59:33.637704 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-beabf139-bc77-4876-9b82-951eefbdf08f tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a33f07ba9f4343ab9c263839d0e567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c009a4e5e1e246e5b32da4f60e08eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:33.647918 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-beabf139-bc77-4876-9b82-951eefbdf08f tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] 10.222.0.79 "GET /compute/v2.1/servers/aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6" status: 200 len: 1327 microversion: 2.1 time: 0.707988 Oct 17 13:59:33.658125 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2436/4999] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:32 2022] GET /compute/v2.1/servers/aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6 => generated 1327 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:33.667966 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-94e2f7fe-c3fc-46e2-888d-0815cf66eea4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:33.681819 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-94e2f7fe-c3fc-46e2-888d-0815cf66eea4 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4" status: 200 len: 1305 microversion: 2.1 time: 0.242742 Oct 17 13:59:33.683203 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2564/5000] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:33 2022] GET /compute/v2.1/servers/aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4 => generated 1305 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:33.941789 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=8 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:59:33.949953 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-bd3612c2-8f16-464c-9a0f-3dbf228b43ba tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:33.950855 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-bd3612c2-8f16-464c-9a0f-3dbf228b43ba tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: b681678a-4240-4b9b-929b-65d09606a07c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:33.978509 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bd3612c2-8f16-464c-9a0f-3dbf228b43ba tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:33.979021 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bd3612c2-8f16-464c-9a0f-3dbf228b43ba tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:33.989724 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bd3612c2-8f16-464c-9a0f-3dbf228b43ba tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:33.991132 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bd3612c2-8f16-464c-9a0f-3dbf228b43ba tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:33.991973 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bd3612c2-8f16-464c-9a0f-3dbf228b43ba tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:34.002239 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bd3612c2-8f16-464c-9a0f-3dbf228b43ba tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:34.061878 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b51f73c9-c0ad-4e50-b9e3-dcbbe5f2d20b tempest-VolumesGetTestJSON-1132741687 tempest-VolumesGetTestJSON-1132741687-project] Action: 'create', calling method: .version_select at 0x7f7cd459eaf0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1366475450", "metadata": {"Type": "work"}}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:59:34.594060 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-bd3612c2-8f16-464c-9a0f-3dbf228b43ba tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:34.602689 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-bd3612c2-8f16-464c-9a0f-3dbf228b43ba tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c" status: 200 len: 1512 microversion: 2.1 time: 0.669314 Oct 17 13:59:34.619536 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2565/5001] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:33 2022] GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c => generated 1512 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:34.700133 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-45ce7540-1712-40ec-8e67-4942764d74d9 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:34.701772 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-45ce7540-1712-40ec-8e67-4942764d74d9 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] [instance: aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:34.707494 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:59:34.731731 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-45ce7540-1712-40ec-8e67-4942764d74d9 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:34.734658 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-45ce7540-1712-40ec-8e67-4942764d74d9 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:34.735483 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-45ce7540-1712-40ec-8e67-4942764d74d9 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:34.741144 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-45ce7540-1712-40ec-8e67-4942764d74d9 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:34.743527 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-45ce7540-1712-40ec-8e67-4942764d74d9 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:34.745159 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-45ce7540-1712-40ec-8e67-4942764d74d9 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:34.983152 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b51f73c9-c0ad-4e50-b9e3-dcbbe5f2d20b tempest-VolumesGetTestJSON-1132741687 tempest-VolumesGetTestJSON-1132741687-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.218513 Oct 17 13:59:34.984872 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2437/5002] 10.222.0.79 () {60 vars in 1156 bytes} [Mon Oct 17 13:59:33 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1221 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 17 13:59:35.006339 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d8d30c58-26e7-48b8-ae0c-8e0fcdd2204a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:35.008635 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d8d30c58-26e7-48b8-ae0c-8e0fcdd2204a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:35.020166 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d8d30c58-26e7-48b8-ae0c-8e0fcdd2204a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:35.037157 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d8d30c58-26e7-48b8-ae0c-8e0fcdd2204a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:35.038084 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d8d30c58-26e7-48b8-ae0c-8e0fcdd2204a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:35.040092 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d8d30c58-26e7-48b8-ae0c-8e0fcdd2204a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:35.040912 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d8d30c58-26e7-48b8-ae0c-8e0fcdd2204a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:35.041541 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d8d30c58-26e7-48b8-ae0c-8e0fcdd2204a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:35.067376 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-d8d30c58-26e7-48b8-ae0c-8e0fcdd2204a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] HTTP exception thrown: Instance aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4 could not be found. Oct 17 13:59:35.069734 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d8d30c58-26e7-48b8-ae0c-8e0fcdd2204a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Request method failure captured: Oct 17 13:59:35.069734 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4 HTTP/1.1 Oct 17 13:59:35.069734 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:59:35.069734 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:59:35.069734 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:59:35.069734 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:59:35.069734 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:59:35.069734 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:59:35.069734 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:59:35.069734 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:59:35.069734 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTV3d-N_EWyrXl_-ZTSAdolghE5oRFAiaYrRKtyahJLuH4Zuc1PUgzCd73YN56SLIjM6miTpzCnqqJsn0BnrpuTYHk5E8J5lGILVtffaMFsULUCEEbYJyYFLHPoFVhrk6yfNnfYA84mZ9NkF5HFg6duIruC8u2pcezDZ7UQon3qHG7VE Oct 17 13:59:35.069734 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:59:35.069734 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:59:35.069734 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:59:35.069734 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:59:35.069734 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:59:35.069734 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:59:35.069734 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 45371f66db35454fbe896194e75afd6e Oct 17 13:59:35.069734 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServerActionsTestJSON-845020662 Oct 17 13:59:35.069734 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:59:35.069734 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:59:35.069734 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/45371f66db35454fbe896194e75afd6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/45371f66db35454fbe896194e75afd6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/45371f66db35454fbe896194e75afd6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_45371f66db35454fbe896194e75afd6e", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:59:35.069734 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServerActionsTestJSON-845020662 Oct 17 13:59:35.069734 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 45371f66db35454fbe896194e75afd6e Oct 17 13:59:35.069734 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServerActionsTestJSON-845020662 Oct 17 13:59:35.069734 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServerActionsTestJSON-845020662-project Oct 17 13:59:35.069734 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:59:35.069734 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:59:35.069734 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: c9382b34782f44e2818a26ecadc3f386 Oct 17 13:59:35.069734 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServerActionsTestJSON-845020662-project Oct 17 13:59:35.069734 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:59:35.069734 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4 could not be found. Oct 17 13:59:35.069734 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4'} Oct 17 13:59:35.069734 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:59:35.069734 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:59:35.069734 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:59:35.069734 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:59:35.069734 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:59:35.069734 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:59:35.069734 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:59:35.069734 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:59:35.069734 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:59:35.069734 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:59:35.069734 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4 could not be found. Oct 17 13:59:35.069734 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:59:35.069734 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:59:35.069734 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:59:35.069734 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:59:35.069734 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:59:35.069734 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:59:35.069734 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:59:35.069734 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:59:35.069734 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:59:35.069734 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:59:35.069734 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:59:35.069734 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:59:35.069734 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:59:35.069734 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:59:35.069734 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:59:35.069734 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:59:35.069734 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4 could not be found. Oct 17 13:59:35.069734 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:59:35.069734 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:59:35.069734 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:59:35.075206 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:59:35.075206 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:59:35.075206 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:59:35.075206 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:59:35.075206 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:59:35.075206 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4 could not be found. Oct 17 13:59:35.075206 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:59:35.077806 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d8d30c58-26e7-48b8-ae0c-8e0fcdd2204a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Returning 404 to user: Instance aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:59:35.078848 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d8d30c58-26e7-48b8-ae0c-8e0fcdd2204a tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4" status: 404 len: 111 microversion: 2.1 time: 0.091542 Oct 17 13:59:35.080311 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2438/5003] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:34 2022] GET /compute/v2.1/servers/aff13b72-673e-4ef4-b7fb-5a3d8bb27ca4 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:59:35.085528 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-07920651-978c-4c4d-84e7-7c189eed507a tempest-VolumesGetTestJSON-1132741687 tempest-VolumesGetTestJSON-1132741687-project] Calling method '.version_select at 0x7f7cd456b040>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:35.244519 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-07920651-978c-4c4d-84e7-7c189eed507a tempest-VolumesGetTestJSON-1132741687 tempest-VolumesGetTestJSON-1132741687-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/ad7ec4a7-e5c1-4d80-ac47-e43b1cd60be4" status: 200 len: 353 microversion: 2.1 time: 0.162882 Oct 17 13:59:35.245358 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2439/5004] 10.222.0.79 () {58 vars in 1245 bytes} [Mon Oct 17 13:59:35 2022] GET /compute/v2.1/os-volumes/ad7ec4a7-e5c1-4d80-ac47-e43b1cd60be4 => generated 353 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:59:35.250358 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5b65add3-1d86-4375-b626-27afd6d1abf9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:35.251464 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5b65add3-1d86-4375-b626-27afd6d1abf9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:35.271680 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5b65add3-1d86-4375-b626-27afd6d1abf9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:35.272106 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5b65add3-1d86-4375-b626-27afd6d1abf9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:35.272546 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5b65add3-1d86-4375-b626-27afd6d1abf9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:35.273259 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5b65add3-1d86-4375-b626-27afd6d1abf9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:35.273710 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5b65add3-1d86-4375-b626-27afd6d1abf9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:35.274133 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5b65add3-1d86-4375-b626-27afd6d1abf9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:35.365840 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5b65add3-1d86-4375-b626-27afd6d1abf9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:59:35.537856 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-45ce7540-1712-40ec-8e67-4942764d74d9 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a33f07ba9f4343ab9c263839d0e567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c009a4e5e1e246e5b32da4f60e08eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:35.541078 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:59:35.557097 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-45ce7540-1712-40ec-8e67-4942764d74d9 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] 10.222.0.79 "GET /compute/v2.1/servers/aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6" status: 200 len: 1327 microversion: 2.1 time: 0.879961 Oct 17 13:59:35.573641 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2566/5005] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:34 2022] GET /compute/v2.1/servers/aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6 => generated 1327 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:59:35.580689 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-4468e77c-368e-4bcf-8951-91d7363cac1a req-e3a3a93c-6bfe-473d-b1ed-0cda6e221778 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6", "tag": "79d9df8e-1228-4152-bb7a-87a2b3734dd5"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:59:35.583808 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5b65add3-1d86-4375-b626-27afd6d1abf9 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6" status: 204 len: 0 microversion: 2.1 time: 0.336918 Oct 17 13:59:35.584930 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2440/5006] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:59:35 2022] DELETE /compute/v2.1/servers/c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:59:35.597953 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4fe94d97-9b96-4ecc-aeef-f416bf4ad3b8 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:35.601005 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4fe94d97-9b96-4ecc-aeef-f416bf4ad3b8 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:35.617930 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-4468e77c-368e-4bcf-8951-91d7363cac1a req-e3a3a93c-6bfe-473d-b1ed-0cda6e221778 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:35.618420 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-4468e77c-368e-4bcf-8951-91d7363cac1a req-e3a3a93c-6bfe-473d-b1ed-0cda6e221778 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:35.619680 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4fe94d97-9b96-4ecc-aeef-f416bf4ad3b8 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:35.620166 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4fe94d97-9b96-4ecc-aeef-f416bf4ad3b8 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:35.620592 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4fe94d97-9b96-4ecc-aeef-f416bf4ad3b8 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:35.621294 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4fe94d97-9b96-4ecc-aeef-f416bf4ad3b8 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:35.621738 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4fe94d97-9b96-4ecc-aeef-f416bf4ad3b8 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:35.622284 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4fe94d97-9b96-4ecc-aeef-f416bf4ad3b8 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:35.623067 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-4468e77c-368e-4bcf-8951-91d7363cac1a req-e3a3a93c-6bfe-473d-b1ed-0cda6e221778 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:35.670069 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-4468e77c-368e-4bcf-8951-91d7363cac1a req-e3a3a93c-6bfe-473d-b1ed-0cda6e221778 service nova] Creating event network-changed:79d9df8e-1228-4152-bb7a-87a2b3734dd5 for instance aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6 on n-h2-854247-14 Oct 17 13:59:35.683843 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-4468e77c-368e-4bcf-8951-91d7363cac1a req-e3a3a93c-6bfe-473d-b1ed-0cda6e221778 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108534 Oct 17 13:59:35.684691 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2567/5007] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:59:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:59:35.693519 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9d24925b-65ee-414b-964c-161c708cea9e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:35.695932 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9d24925b-65ee-414b-964c-161c708cea9e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: b681678a-4240-4b9b-929b-65d09606a07c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:35.710875 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9d24925b-65ee-414b-964c-161c708cea9e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:35.714868 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9d24925b-65ee-414b-964c-161c708cea9e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:35.715539 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9d24925b-65ee-414b-964c-161c708cea9e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:35.717936 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9d24925b-65ee-414b-964c-161c708cea9e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:35.718857 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9d24925b-65ee-414b-964c-161c708cea9e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:35.719521 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9d24925b-65ee-414b-964c-161c708cea9e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:36.302081 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9d24925b-65ee-414b-964c-161c708cea9e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:36.310968 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4fe94d97-9b96-4ecc-aeef-f416bf4ad3b8 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:36.311700 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9d24925b-65ee-414b-964c-161c708cea9e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c" status: 200 len: 1512 microversion: 2.1 time: 0.625468 Oct 17 13:59:36.312944 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2568/5008] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:35 2022] GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c => generated 1512 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:36.320705 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ecb47e87-5d95-4f69-aefd-6f0d8e1be6c3 tempest-VolumesGetTestJSON-1132741687 tempest-VolumesGetTestJSON-1132741687-project] Calling method '.version_select at 0x7f7cd98addc0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:36.326756 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4fe94d97-9b96-4ecc-aeef-f416bf4ad3b8 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6" status: 200 len: 1508 microversion: 2.1 time: 0.734911 Oct 17 13:59:36.327915 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2441/5009] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:35 2022] GET /compute/v2.1/servers/c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6 => generated 1508 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:36.407216 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ecb47e87-5d95-4f69-aefd-6f0d8e1be6c3 tempest-VolumesGetTestJSON-1132741687 tempest-VolumesGetTestJSON-1132741687-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/ad7ec4a7-e5c1-4d80-ac47-e43b1cd60be4" status: 200 len: 353 microversion: 2.1 time: 0.092282 Oct 17 13:59:36.409039 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2569/5010] 10.222.0.79 () {58 vars in 1245 bytes} [Mon Oct 17 13:59:36 2022] GET /compute/v2.1/os-volumes/ad7ec4a7-e5c1-4d80-ac47-e43b1cd60be4 => generated 353 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:59:36.582918 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-133dadb1-6e5c-455a-8345-51a9da1e13be tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:36.583590 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-133dadb1-6e5c-455a-8345-51a9da1e13be tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] [instance: aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:36.591781 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-133dadb1-6e5c-455a-8345-51a9da1e13be tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:36.597968 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-133dadb1-6e5c-455a-8345-51a9da1e13be tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:36.598659 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-133dadb1-6e5c-455a-8345-51a9da1e13be tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:36.599619 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-133dadb1-6e5c-455a-8345-51a9da1e13be tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:36.600064 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-133dadb1-6e5c-455a-8345-51a9da1e13be tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:36.600695 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-133dadb1-6e5c-455a-8345-51a9da1e13be tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:36.841175 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-133dadb1-6e5c-455a-8345-51a9da1e13be tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a33f07ba9f4343ab9c263839d0e567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c009a4e5e1e246e5b32da4f60e08eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:36.845556 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:59:36.850853 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-133dadb1-6e5c-455a-8345-51a9da1e13be tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] 10.222.0.79 "GET /compute/v2.1/servers/aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6" status: 200 len: 1327 microversion: 2.1 time: 0.273228 Oct 17 13:59:36.851966 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2442/5011] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:36 2022] GET /compute/v2.1/servers/aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6 => generated 1327 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:37.361745 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6626971b-936d-4d65-932b-6521c856b29c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:37.362713 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5131b42a-b5bc-43ce-97c5-6494951a32fa tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:37.364677 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6626971b-936d-4d65-932b-6521c856b29c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:37.365172 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5131b42a-b5bc-43ce-97c5-6494951a32fa tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: b681678a-4240-4b9b-929b-65d09606a07c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:37.379208 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6626971b-936d-4d65-932b-6521c856b29c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:37.384209 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5131b42a-b5bc-43ce-97c5-6494951a32fa tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:37.385191 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5131b42a-b5bc-43ce-97c5-6494951a32fa tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:37.385730 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6626971b-936d-4d65-932b-6521c856b29c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:37.385975 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5131b42a-b5bc-43ce-97c5-6494951a32fa tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:37.387110 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5131b42a-b5bc-43ce-97c5-6494951a32fa tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:37.387607 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6626971b-936d-4d65-932b-6521c856b29c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:37.388035 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5131b42a-b5bc-43ce-97c5-6494951a32fa tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:37.388615 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5131b42a-b5bc-43ce-97c5-6494951a32fa tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:37.389537 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6626971b-936d-4d65-932b-6521c856b29c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:37.390014 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6626971b-936d-4d65-932b-6521c856b29c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:37.391616 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6626971b-936d-4d65-932b-6521c856b29c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:37.753562 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6626971b-936d-4d65-932b-6521c856b29c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:37.770312 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6626971b-936d-4d65-932b-6521c856b29c tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6" status: 200 len: 1508 microversion: 2.1 time: 0.419665 Oct 17 13:59:37.770899 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2443/5012] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:37 2022] GET /compute/v2.1/servers/c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6 => generated 1508 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:37.775944 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d98250ab-64c9-4c23-8e66-3fb2ec16d94b tempest-VolumesGetTestJSON-1132741687 tempest-VolumesGetTestJSON-1132741687-project] Calling method '.version_select at 0x7f7cd459e0d0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:37.783353 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5131b42a-b5bc-43ce-97c5-6494951a32fa tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:37.799142 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5131b42a-b5bc-43ce-97c5-6494951a32fa tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c" status: 200 len: 1512 microversion: 2.1 time: 0.456928 Oct 17 13:59:37.804404 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2570/5013] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:37 2022] GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c => generated 1512 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:37.865265 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d98250ab-64c9-4c23-8e66-3fb2ec16d94b tempest-VolumesGetTestJSON-1132741687 tempest-VolumesGetTestJSON-1132741687-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/ad7ec4a7-e5c1-4d80-ac47-e43b1cd60be4" status: 200 len: 354 microversion: 2.1 time: 0.093075 Oct 17 13:59:37.866112 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2444/5014] 10.222.0.79 () {58 vars in 1245 bytes} [Mon Oct 17 13:59:37 2022] GET /compute/v2.1/os-volumes/ad7ec4a7-e5c1-4d80-ac47-e43b1cd60be4 => generated 354 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:59:37.875839 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c69d021b-ce07-4a89-ae6a-a52d13b68db0 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:37.876673 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c69d021b-ce07-4a89-ae6a-a52d13b68db0 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] [instance: aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:37.879284 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7d055ec2-304b-4e49-b267-905126edf9f1 tempest-VolumesGetTestJSON-1132741687 tempest-VolumesGetTestJSON-1132741687-project] Calling method '.version_select at 0x7f7cd456b4c0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:37.890856 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c69d021b-ce07-4a89-ae6a-a52d13b68db0 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:37.894967 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c69d021b-ce07-4a89-ae6a-a52d13b68db0 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:37.897128 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c69d021b-ce07-4a89-ae6a-a52d13b68db0 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:37.898965 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c69d021b-ce07-4a89-ae6a-a52d13b68db0 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:37.901488 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c69d021b-ce07-4a89-ae6a-a52d13b68db0 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:37.902052 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c69d021b-ce07-4a89-ae6a-a52d13b68db0 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:37.933563 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7d055ec2-304b-4e49-b267-905126edf9f1 tempest-VolumesGetTestJSON-1132741687 tempest-VolumesGetTestJSON-1132741687-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/ad7ec4a7-e5c1-4d80-ac47-e43b1cd60be4" status: 200 len: 354 microversion: 2.1 time: 0.058530 Oct 17 13:59:37.934315 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2445/5015] 10.222.0.79 () {58 vars in 1245 bytes} [Mon Oct 17 13:59:37 2022] GET /compute/v2.1/os-volumes/ad7ec4a7-e5c1-4d80-ac47-e43b1cd60be4 => generated 354 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:59:37.950693 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6e4536cd-788f-4efe-89f3-5d0d26aa420b tempest-VolumesGetTestJSON-1132741687 tempest-VolumesGetTestJSON-1132741687-project] Calling method '.version_select at 0x7f7cd45c0040>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:38.037177 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6e4536cd-788f-4efe-89f3-5d0d26aa420b tempest-VolumesGetTestJSON-1132741687 tempest-VolumesGetTestJSON-1132741687-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/ad7ec4a7-e5c1-4d80-ac47-e43b1cd60be4" status: 202 len: 0 microversion: 2.1 time: 0.090186 Oct 17 13:59:38.041497 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2446/5016] 10.222.0.79 () {58 vars in 1248 bytes} [Mon Oct 17 13:59:37 2022] DELETE /compute/v2.1/os-volumes/ad7ec4a7-e5c1-4d80-ac47-e43b1cd60be4 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:59:38.046595 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-23bdba88-c45e-406b-8e59-002f9413a767 tempest-VolumesGetTestJSON-1132741687 tempest-VolumesGetTestJSON-1132741687-project] Calling method '.version_select at 0x7f7cd456b280>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:38.172416 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-23bdba88-c45e-406b-8e59-002f9413a767 tempest-VolumesGetTestJSON-1132741687 tempest-VolumesGetTestJSON-1132741687-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/ad7ec4a7-e5c1-4d80-ac47-e43b1cd60be4" status: 200 len: 353 microversion: 2.1 time: 0.129725 Oct 17 13:59:38.173122 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2447/5017] 10.222.0.79 () {58 vars in 1245 bytes} [Mon Oct 17 13:59:38 2022] GET /compute/v2.1/os-volumes/ad7ec4a7-e5c1-4d80-ac47-e43b1cd60be4 => generated 353 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:59:38.600822 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c69d021b-ce07-4a89-ae6a-a52d13b68db0 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a33f07ba9f4343ab9c263839d0e567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c009a4e5e1e246e5b32da4f60e08eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:38.615849 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c69d021b-ce07-4a89-ae6a-a52d13b68db0 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] 10.222.0.79 "GET /compute/v2.1/servers/aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6" status: 200 len: 1327 microversion: 2.1 time: 0.741241 Oct 17 13:59:38.618229 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2571/5018] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:37 2022] GET /compute/v2.1/servers/aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6 => generated 1327 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:38.798899 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-04da482e-962f-4bad-beee-5d60a6cba962 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:38.800065 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-04da482e-962f-4bad-beee-5d60a6cba962 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:38.819015 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-04da482e-962f-4bad-beee-5d60a6cba962 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:38.819560 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-04da482e-962f-4bad-beee-5d60a6cba962 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:38.819999 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-04da482e-962f-4bad-beee-5d60a6cba962 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:38.820715 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-04da482e-962f-4bad-beee-5d60a6cba962 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:38.821183 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-04da482e-962f-4bad-beee-5d60a6cba962 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:38.828136 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-23ee7b55-d16d-41b0-9745-ab7ae0827513 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:38.828760 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-23ee7b55-d16d-41b0-9745-ab7ae0827513 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: b681678a-4240-4b9b-929b-65d09606a07c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:38.839947 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-04da482e-962f-4bad-beee-5d60a6cba962 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:38.847294 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-23ee7b55-d16d-41b0-9745-ab7ae0827513 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:38.851560 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-23ee7b55-d16d-41b0-9745-ab7ae0827513 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:38.852187 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-23ee7b55-d16d-41b0-9745-ab7ae0827513 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:38.853364 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-23ee7b55-d16d-41b0-9745-ab7ae0827513 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:38.855284 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-23ee7b55-d16d-41b0-9745-ab7ae0827513 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:38.855910 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-23ee7b55-d16d-41b0-9745-ab7ae0827513 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:40.116245 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-23ee7b55-d16d-41b0-9745-ab7ae0827513 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:40.125218 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-04da482e-962f-4bad-beee-5d60a6cba962 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:40.138129 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-23ee7b55-d16d-41b0-9745-ab7ae0827513 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c" status: 200 len: 1512 microversion: 2.1 time: 1.315047 Oct 17 13:59:40.139305 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2572/5019] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:38 2022] GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c => generated 1512 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:59:40.153180 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-83458163-a4d6-4cf4-8701-d381759f421c tempest-VolumesGetTestJSON-1132741687 tempest-VolumesGetTestJSON-1132741687-project] Calling method '.version_select at 0x7f7cd41fed30>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:40.175979 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-04da482e-962f-4bad-beee-5d60a6cba962 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6" status: 200 len: 1508 microversion: 2.1 time: 1.381620 Oct 17 13:59:40.185192 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2448/5020] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:38 2022] GET /compute/v2.1/servers/c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6 => generated 1508 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:40.208830 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3f7488be-23c9-4893-a46f-f453df3995b1 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:40.214802 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3f7488be-23c9-4893-a46f-f453df3995b1 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] [instance: aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:40.224580 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f7488be-23c9-4893-a46f-f453df3995b1 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:40.228010 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f7488be-23c9-4893-a46f-f453df3995b1 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:40.229784 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f7488be-23c9-4893-a46f-f453df3995b1 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:40.233102 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f7488be-23c9-4893-a46f-f453df3995b1 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:40.233701 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f7488be-23c9-4893-a46f-f453df3995b1 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:40.234237 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f7488be-23c9-4893-a46f-f453df3995b1 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:40.259632 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-83458163-a4d6-4cf4-8701-d381759f421c tempest-VolumesGetTestJSON-1132741687 tempest-VolumesGetTestJSON-1132741687-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/ad7ec4a7-e5c1-4d80-ac47-e43b1cd60be4" status: 200 len: 353 microversion: 2.1 time: 0.118428 Oct 17 13:59:40.260605 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2573/5021] 10.222.0.79 () {58 vars in 1245 bytes} [Mon Oct 17 13:59:40 2022] GET /compute/v2.1/os-volumes/ad7ec4a7-e5c1-4d80-ac47-e43b1cd60be4 => generated 353 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:59:40.612313 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-1a0aba9f-21c9-47ec-9074-325c3ea2358b req-5c5b0c09-8c48-45c1-be36-e78f9dedc64d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6", "name": "network-vif-deleted", "tag": "d95e5b6e-63a7-4bcb-81ab-a9ec138f839a"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:59:40.643647 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-1a0aba9f-21c9-47ec-9074-325c3ea2358b req-5c5b0c09-8c48-45c1-be36-e78f9dedc64d service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:40.644963 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-1a0aba9f-21c9-47ec-9074-325c3ea2358b req-5c5b0c09-8c48-45c1-be36-e78f9dedc64d service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:40.647088 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-1a0aba9f-21c9-47ec-9074-325c3ea2358b req-5c5b0c09-8c48-45c1-be36-e78f9dedc64d service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:40.686703 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-1a0aba9f-21c9-47ec-9074-325c3ea2358b req-5c5b0c09-8c48-45c1-be36-e78f9dedc64d service nova] Creating event network-vif-deleted:d95e5b6e-63a7-4bcb-81ab-a9ec138f839a for instance c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6 on n-h2-854247-14 Oct 17 13:59:40.693641 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-1a0aba9f-21c9-47ec-9074-325c3ea2358b req-5c5b0c09-8c48-45c1-be36-e78f9dedc64d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086635 Oct 17 13:59:40.694991 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2574/5022] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:59:40.872506 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3f7488be-23c9-4893-a46f-f453df3995b1 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a33f07ba9f4343ab9c263839d0e567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c009a4e5e1e246e5b32da4f60e08eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:40.884712 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3f7488be-23c9-4893-a46f-f453df3995b1 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] 10.222.0.79 "GET /compute/v2.1/servers/aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6" status: 200 len: 1327 microversion: 2.1 time: 0.698570 Oct 17 13:59:40.887301 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2449/5023] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:40 2022] GET /compute/v2.1/servers/aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6 => generated 1327 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:41.171018 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-659597a4-7e2e-4d16-947e-91b0446fb187 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:41.173328 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-659597a4-7e2e-4d16-947e-91b0446fb187 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: b681678a-4240-4b9b-929b-65d09606a07c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:41.190788 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-659597a4-7e2e-4d16-947e-91b0446fb187 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:41.191561 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-659597a4-7e2e-4d16-947e-91b0446fb187 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:41.193201 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-659597a4-7e2e-4d16-947e-91b0446fb187 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:41.194069 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-659597a4-7e2e-4d16-947e-91b0446fb187 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:41.194541 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-659597a4-7e2e-4d16-947e-91b0446fb187 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:41.202387 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3fe80421-c553-4c6c-a10b-9e1382653958 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:41.203773 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3fe80421-c553-4c6c-a10b-9e1382653958 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:41.208257 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-659597a4-7e2e-4d16-947e-91b0446fb187 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:41.216773 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3fe80421-c553-4c6c-a10b-9e1382653958 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:41.219535 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3fe80421-c553-4c6c-a10b-9e1382653958 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:41.222267 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3fe80421-c553-4c6c-a10b-9e1382653958 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:41.224023 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3fe80421-c553-4c6c-a10b-9e1382653958 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:41.226406 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3fe80421-c553-4c6c-a10b-9e1382653958 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:41.227069 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3fe80421-c553-4c6c-a10b-9e1382653958 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:41.308805 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3fe80421-c553-4c6c-a10b-9e1382653958 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:41.311451 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3fe80421-c553-4c6c-a10b-9e1382653958 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:41.315339 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3fe80421-c553-4c6c-a10b-9e1382653958 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:41.319664 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-3fe80421-c553-4c6c-a10b-9e1382653958 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lazy-loading 'fault' on Instance uuid c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6 {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:59:41.393376 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3fe80421-c553-4c6c-a10b-9e1382653958 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:41.402619 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3fe80421-c553-4c6c-a10b-9e1382653958 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6" status: 200 len: 1305 microversion: 2.1 time: 0.204619 Oct 17 13:59:41.411500 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2450/5024] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:41 2022] GET /compute/v2.1/servers/c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6 => generated 1305 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:59:41.423768 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-79fb2adc-167d-4296-b7bd-acbb8309a944 tempest-VolumesGetTestJSON-1132741687 tempest-VolumesGetTestJSON-1132741687-project] Calling method '.version_select at 0x7f7cd45c0670>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:41.540400 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-79fb2adc-167d-4296-b7bd-acbb8309a944 tempest-VolumesGetTestJSON-1132741687 tempest-VolumesGetTestJSON-1132741687-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/ad7ec4a7-e5c1-4d80-ac47-e43b1cd60be4" status: 200 len: 353 microversion: 2.1 time: 0.131817 Oct 17 13:59:41.541619 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2451/5025] 10.222.0.79 () {58 vars in 1245 bytes} [Mon Oct 17 13:59:41 2022] GET /compute/v2.1/os-volumes/ad7ec4a7-e5c1-4d80-ac47-e43b1cd60be4 => generated 353 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:59:41.616319 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-659597a4-7e2e-4d16-947e-91b0446fb187 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:41.630453 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-659597a4-7e2e-4d16-947e-91b0446fb187 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c" status: 200 len: 1512 microversion: 2.1 time: 0.467826 Oct 17 13:59:41.631238 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2575/5026] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:41 2022] GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c => generated 1512 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:41.913440 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d2fdca6d-3916-48a3-88bc-409b9ff2ffdb tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:41.914460 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d2fdca6d-3916-48a3-88bc-409b9ff2ffdb tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] [instance: aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:41.933900 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d2fdca6d-3916-48a3-88bc-409b9ff2ffdb tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:41.934417 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d2fdca6d-3916-48a3-88bc-409b9ff2ffdb tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:41.934858 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d2fdca6d-3916-48a3-88bc-409b9ff2ffdb tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:41.943972 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d2fdca6d-3916-48a3-88bc-409b9ff2ffdb tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:41.944746 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d2fdca6d-3916-48a3-88bc-409b9ff2ffdb tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:41.945357 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d2fdca6d-3916-48a3-88bc-409b9ff2ffdb tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:42.430373 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-726e0101-2a83-4eb7-81f6-4aececdfe67f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:42.430937 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-726e0101-2a83-4eb7-81f6-4aececdfe67f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:42.442671 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-726e0101-2a83-4eb7-81f6-4aececdfe67f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:42.443592 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-726e0101-2a83-4eb7-81f6-4aececdfe67f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:42.444911 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-726e0101-2a83-4eb7-81f6-4aececdfe67f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:42.445481 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-726e0101-2a83-4eb7-81f6-4aececdfe67f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:42.446407 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-726e0101-2a83-4eb7-81f6-4aececdfe67f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:42.447011 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-726e0101-2a83-4eb7-81f6-4aececdfe67f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:42.479672 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-726e0101-2a83-4eb7-81f6-4aececdfe67f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] HTTP exception thrown: Instance c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6 could not be found. Oct 17 13:59:42.483906 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-726e0101-2a83-4eb7-81f6-4aececdfe67f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Request method failure captured: Oct 17 13:59:42.483906 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6 HTTP/1.1 Oct 17 13:59:42.483906 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:59:42.483906 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:59:42.483906 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:59:42.483906 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:59:42.483906 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:59:42.483906 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:59:42.483906 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:59:42.483906 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:59:42.483906 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTV3d-N_EWyrXl_-ZTSAdolghE5oRFAiaYrRKtyahJLuH4Zuc1PUgzCd73YN56SLIjM6miTpzCnqqJsn0BnrpuTYHk5E8J5lGILVtffaMFsULUCEEbYJyYFLHPoFVhrk6yfNnfYA84mZ9NkF5HFg6duIruC8u2pcezDZ7UQon3qHG7VE Oct 17 13:59:42.483906 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:59:42.483906 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:59:42.483906 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:59:42.483906 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:59:42.483906 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:59:42.483906 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:59:42.483906 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 45371f66db35454fbe896194e75afd6e Oct 17 13:59:42.483906 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServerActionsTestJSON-845020662 Oct 17 13:59:42.483906 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:59:42.483906 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:59:42.483906 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/45371f66db35454fbe896194e75afd6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/45371f66db35454fbe896194e75afd6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/45371f66db35454fbe896194e75afd6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_45371f66db35454fbe896194e75afd6e", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:59:42.483906 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServerActionsTestJSON-845020662 Oct 17 13:59:42.483906 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 45371f66db35454fbe896194e75afd6e Oct 17 13:59:42.483906 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServerActionsTestJSON-845020662 Oct 17 13:59:42.483906 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServerActionsTestJSON-845020662-project Oct 17 13:59:42.483906 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:59:42.483906 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:59:42.483906 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: c9382b34782f44e2818a26ecadc3f386 Oct 17 13:59:42.483906 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServerActionsTestJSON-845020662-project Oct 17 13:59:42.483906 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:59:42.483906 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6 could not be found. Oct 17 13:59:42.483906 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6'} Oct 17 13:59:42.483906 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:59:42.483906 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:59:42.483906 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:59:42.483906 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:59:42.483906 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:59:42.483906 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:59:42.483906 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:59:42.483906 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:59:42.483906 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:59:42.483906 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:59:42.483906 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6 could not be found. Oct 17 13:59:42.483906 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:59:42.483906 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:59:42.483906 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:59:42.483906 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:59:42.483906 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:59:42.483906 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:59:42.483906 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:59:42.483906 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:59:42.483906 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:59:42.483906 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:59:42.483906 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:59:42.483906 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:59:42.483906 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:59:42.483906 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:59:42.483906 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:59:42.483906 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:59:42.483906 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6 could not be found. Oct 17 13:59:42.483906 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:59:42.483906 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:59:42.483906 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:59:42.489911 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:59:42.489911 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:59:42.489911 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:59:42.489911 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:59:42.489911 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:59:42.489911 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6 could not be found. Oct 17 13:59:42.489911 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:59:42.489911 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-726e0101-2a83-4eb7-81f6-4aececdfe67f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Returning 404 to user: Instance c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:59:42.489911 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-726e0101-2a83-4eb7-81f6-4aececdfe67f tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6" status: 404 len: 111 microversion: 2.1 time: 0.059645 Oct 17 13:59:42.489911 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2576/5027] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:42 2022] GET /compute/v2.1/servers/c3c0a567-0ef8-4a5a-ab29-52f14faf2cf6 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:59:42.504752 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0e24ff1a-d187-4d4d-960a-48693dbb17de tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:42.505282 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0e24ff1a-d187-4d4d-960a-48693dbb17de tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 051c9371-d3e2-4166-bed5-c73dc77ec977] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:42.513462 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d2fdca6d-3916-48a3-88bc-409b9ff2ffdb tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a33f07ba9f4343ab9c263839d0e567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c009a4e5e1e246e5b32da4f60e08eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:42.523974 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d2fdca6d-3916-48a3-88bc-409b9ff2ffdb tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] 10.222.0.79 "GET /compute/v2.1/servers/aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6" status: 200 len: 1327 microversion: 2.1 time: 0.616375 Oct 17 13:59:42.524575 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2452/5028] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:41 2022] GET /compute/v2.1/servers/aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6 => generated 1327 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:42.530507 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0e24ff1a-d187-4d4d-960a-48693dbb17de tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:42.531011 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0e24ff1a-d187-4d4d-960a-48693dbb17de tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:42.531488 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0e24ff1a-d187-4d4d-960a-48693dbb17de tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:42.549309 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0e24ff1a-d187-4d4d-960a-48693dbb17de tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:42.556612 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ce048e3b-be06-427b-8b95-aa7bcd4b8f76 tempest-VolumesGetTestJSON-1132741687 tempest-VolumesGetTestJSON-1132741687-project] Calling method '.version_select at 0x7f7cd459e700>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:42.558406 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0e24ff1a-d187-4d4d-960a-48693dbb17de tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:42.559001 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0e24ff1a-d187-4d4d-960a-48693dbb17de tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:42.604619 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0e24ff1a-d187-4d4d-960a-48693dbb17de tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 051c9371-d3e2-4166-bed5-c73dc77ec977] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:59:42.634489 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-ce048e3b-be06-427b-8b95-aa7bcd4b8f76 tempest-VolumesGetTestJSON-1132741687 tempest-VolumesGetTestJSON-1132741687-project] HTTP exception thrown: Volume ad7ec4a7-e5c1-4d80-ac47-e43b1cd60be4 could not be found. Oct 17 13:59:42.636691 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ce048e3b-be06-427b-8b95-aa7bcd4b8f76 tempest-VolumesGetTestJSON-1132741687 tempest-VolumesGetTestJSON-1132741687-project] Request method failure captured: Oct 17 13:59:42.636691 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/os-volumes/ad7ec4a7-e5c1-4d80-ac47-e43b1cd60be4 HTTP/1.1 Oct 17 13:59:42.636691 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:59:42.636691 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:59:42.636691 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:59:42.636691 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:59:42.636691 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:59:42.636691 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:59:42.636691 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:59:42.636691 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:59:42.636691 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTV_F9bxKOa__H0IfGjQVJaOXN0mdaEh5ZF06GCb7xaE4CtVVwsfUfz_YKzRFcfxLx32qYvFV7WFijY0ZcSCMrPLTaBH_dLVJPrOpCYa9oGBekwZpGWdEecBC-Ms45KUFAN76WZVVZbAjXr3s5I-wDnuFBzP3ecW9bBtpSDFr6WYBwDM Oct 17 13:59:42.636691 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:59:42.636691 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:59:42.636691 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:59:42.636691 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:59:42.636691 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:59:42.636691 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:59:42.636691 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: cb33743a0c65441bbd2506e260d4d497 Oct 17 13:59:42.636691 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-VolumesGetTestJSON-1132741687 Oct 17 13:59:42.636691 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:59:42.636691 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:59:42.636691 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cb33743a0c65441bbd2506e260d4d497"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/cb33743a0c65441bbd2506e260d4d497"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/cb33743a0c65441bbd2506e260d4d497"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_cb33743a0c65441bbd2506e260d4d497", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:59:42.636691 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-VolumesGetTestJSON-1132741687 Oct 17 13:59:42.636691 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: cb33743a0c65441bbd2506e260d4d497 Oct 17 13:59:42.636691 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-VolumesGetTestJSON-1132741687 Oct 17 13:59:42.636691 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-VolumesGetTestJSON-1132741687-project Oct 17 13:59:42.636691 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:59:42.636691 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:59:42.636691 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: a5584f969268469f89792ddd5ccdbc21 Oct 17 13:59:42.636691 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-VolumesGetTestJSON-1132741687-project Oct 17 13:59:42.636691 n-d-854247-14 devstack@n-api.service[127017]: method: Oct 17 13:59:42.636691 n-d-854247-14 devstack@n-api.service[127017]: exception: Volume ad7ec4a7-e5c1-4d80-ac47-e43b1cd60be4 could not be found. Oct 17 13:59:42.636691 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'ad7ec4a7-e5c1-4d80-ac47-e43b1cd60be4'} Oct 17 13:59:42.636691 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:59:42.636691 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:59:42.636691 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 13:59:42.636691 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 13:59:42.636691 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 13:59:42.636691 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 13:59:42.636691 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 13:59:42.636691 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 13:59:42.636691 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 13:59:42.636691 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 13:59:42.636691 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 13:59:42.636691 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 13:59:42.636691 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 13:59:42.636691 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 13:59:42.636691 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 13:59:42.636691 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 13:59:42.636691 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ad7ec4a7-e5c1-4d80-ac47-e43b1cd60be4 could not be found. (HTTP 404) (Request-ID: req-e7960c05-7cfb-4521-ac5a-ca7f6c9bf021) Oct 17 13:59:42.636691 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:59:42.636691 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:59:42.636691 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:59:42.636691 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:59:42.636691 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 17 13:59:42.636691 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 17 13:59:42.636691 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 13:59:42.636691 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 13:59:42.636691 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 13:59:42.636691 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 13:59:42.636691 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 13:59:42.636691 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 13:59:42.636691 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 13:59:42.642582 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 13:59:42.642582 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 13:59:42.642582 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 13:59:42.642582 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 13:59:42.642582 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 13:59:42.642582 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 13:59:42.642582 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 13:59:42.642582 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 13:59:42.642582 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 13:59:42.642582 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 13:59:42.642582 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 13:59:42.642582 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 13:59:42.642582 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 13:59:42.642582 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ad7ec4a7-e5c1-4d80-ac47-e43b1cd60be4 could not be found. Oct 17 13:59:42.642582 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:59:42.642582 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:59:42.642582 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:59:42.642582 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:59:42.642582 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:59:42.642582 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:59:42.642582 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:59:42.642582 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:59:42.642582 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:59:42.642582 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:59:42.642582 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:59:42.642582 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:59:42.642582 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 17 13:59:42.642582 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:59:42.642582 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ad7ec4a7-e5c1-4d80-ac47-e43b1cd60be4 could not be found. Oct 17 13:59:42.642582 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:59:42.642582 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:59:42.642582 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:59:42.642582 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:59:42.642582 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:59:42.642582 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:59:42.642582 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:59:42.642582 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:59:42.642582 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ad7ec4a7-e5c1-4d80-ac47-e43b1cd60be4 could not be found. Oct 17 13:59:42.642582 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:59:42.642582 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ce048e3b-be06-427b-8b95-aa7bcd4b8f76 tempest-VolumesGetTestJSON-1132741687 tempest-VolumesGetTestJSON-1132741687-project] Returning 404 to user: Volume ad7ec4a7-e5c1-4d80-ac47-e43b1cd60be4 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:59:42.642582 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ce048e3b-be06-427b-8b95-aa7bcd4b8f76 tempest-VolumesGetTestJSON-1132741687 tempest-VolumesGetTestJSON-1132741687-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/ad7ec4a7-e5c1-4d80-ac47-e43b1cd60be4" status: 404 len: 109 microversion: 2.1 time: 0.087223 Oct 17 13:59:42.642582 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2453/5029] 10.222.0.79 () {58 vars in 1245 bytes} [Mon Oct 17 13:59:42 2022] GET /compute/v2.1/os-volumes/ad7ec4a7-e5c1-4d80-ac47-e43b1cd60be4 => generated 109 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:59:42.655356 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ebf106c6-3098-45b7-9043-f37d6fea96ba tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:42.656007 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ebf106c6-3098-45b7-9043-f37d6fea96ba tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: b681678a-4240-4b9b-929b-65d09606a07c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:42.680622 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ebf106c6-3098-45b7-9043-f37d6fea96ba tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:42.681124 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ebf106c6-3098-45b7-9043-f37d6fea96ba tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:42.681565 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ebf106c6-3098-45b7-9043-f37d6fea96ba tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:42.690300 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ebf106c6-3098-45b7-9043-f37d6fea96ba tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:42.690807 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ebf106c6-3098-45b7-9043-f37d6fea96ba tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:42.691281 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ebf106c6-3098-45b7-9043-f37d6fea96ba tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:42.855933 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0e24ff1a-d187-4d4d-960a-48693dbb17de tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "DELETE /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977" status: 204 len: 0 microversion: 2.1 time: 0.361267 Oct 17 13:59:42.856839 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2577/5030] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:59:42 2022] DELETE /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:59:43.326802 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-20714edd-5c4a-4275-89de-65e8d6709604 req-8281ceca-219c-4fb5-aefd-464878ef3cd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6", "name": "network-vif-plugged", "status": "completed", "tag": "79d9df8e-1228-4152-bb7a-87a2b3734dd5"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:59:43.346395 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-20714edd-5c4a-4275-89de-65e8d6709604 req-8281ceca-219c-4fb5-aefd-464878ef3cd8 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:43.347154 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-20714edd-5c4a-4275-89de-65e8d6709604 req-8281ceca-219c-4fb5-aefd-464878ef3cd8 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:43.347822 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-20714edd-5c4a-4275-89de-65e8d6709604 req-8281ceca-219c-4fb5-aefd-464878ef3cd8 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:43.382888 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-20714edd-5c4a-4275-89de-65e8d6709604 req-8281ceca-219c-4fb5-aefd-464878ef3cd8 service nova] Creating event network-vif-plugged:79d9df8e-1228-4152-bb7a-87a2b3734dd5 for instance aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6 on n-h2-854247-14 Oct 17 13:59:43.389758 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-20714edd-5c4a-4275-89de-65e8d6709604 req-8281ceca-219c-4fb5-aefd-464878ef3cd8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.531465 Oct 17 13:59:43.390678 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2578/5031] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:59:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:59:43.400219 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-891e08b7-93d9-4e03-9850-d33390c67561 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:43.406259 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-891e08b7-93d9-4e03-9850-d33390c67561 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 051c9371-d3e2-4166-bed5-c73dc77ec977] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:43.421200 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-891e08b7-93d9-4e03-9850-d33390c67561 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:43.421703 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-891e08b7-93d9-4e03-9850-d33390c67561 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:43.422138 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-891e08b7-93d9-4e03-9850-d33390c67561 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:43.422930 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-891e08b7-93d9-4e03-9850-d33390c67561 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:43.423447 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-891e08b7-93d9-4e03-9850-d33390c67561 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:43.427341 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-891e08b7-93d9-4e03-9850-d33390c67561 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:43.597077 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ebf106c6-3098-45b7-9043-f37d6fea96ba tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:43.613998 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ebf106c6-3098-45b7-9043-f37d6fea96ba tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c" status: 200 len: 1512 microversion: 2.1 time: 0.963914 Oct 17 13:59:43.618397 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2454/5032] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:42 2022] GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c => generated 1512 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:59:43.648014 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4768e5b4-8e80-40ba-9d38-69810ebc358d tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:43.648014 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4768e5b4-8e80-40ba-9d38-69810ebc358d tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] [instance: aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:43.655224 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:59:43.657468 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4768e5b4-8e80-40ba-9d38-69810ebc358d tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:43.658238 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4768e5b4-8e80-40ba-9d38-69810ebc358d tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:43.659040 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4768e5b4-8e80-40ba-9d38-69810ebc358d tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:43.659886 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4768e5b4-8e80-40ba-9d38-69810ebc358d tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:43.660545 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4768e5b4-8e80-40ba-9d38-69810ebc358d tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:43.661277 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4768e5b4-8e80-40ba-9d38-69810ebc358d tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:44.183212 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-891e08b7-93d9-4e03-9850-d33390c67561 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:44.193832 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-891e08b7-93d9-4e03-9850-d33390c67561 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977" status: 200 len: 1494 microversion: 2.1 time: 0.801563 Oct 17 13:59:44.215746 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2579/5033] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:43 2022] GET /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977 => generated 1494 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:44.448398 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4768e5b4-8e80-40ba-9d38-69810ebc358d tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a33f07ba9f4343ab9c263839d0e567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c009a4e5e1e246e5b32da4f60e08eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:44.467689 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4768e5b4-8e80-40ba-9d38-69810ebc358d tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] 10.222.0.79 "GET /compute/v2.1/servers/aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6" status: 200 len: 1327 microversion: 2.1 time: 0.828957 Oct 17 13:59:44.469911 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2455/5034] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:43 2022] GET /compute/v2.1/servers/aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6 => generated 1327 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:44.638306 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-30e65992-7088-48fc-bb5e-a062fe053191 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:44.639077 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-30e65992-7088-48fc-bb5e-a062fe053191 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: b681678a-4240-4b9b-929b-65d09606a07c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:44.652313 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-30e65992-7088-48fc-bb5e-a062fe053191 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:44.652804 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-30e65992-7088-48fc-bb5e-a062fe053191 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:44.656854 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-30e65992-7088-48fc-bb5e-a062fe053191 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:44.657780 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-30e65992-7088-48fc-bb5e-a062fe053191 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:44.659759 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-30e65992-7088-48fc-bb5e-a062fe053191 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:44.660333 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-30e65992-7088-48fc-bb5e-a062fe053191 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:45.218334 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-562a4f40-a485-4353-9546-a192f5659408 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:45.224237 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-562a4f40-a485-4353-9546-a192f5659408 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 051c9371-d3e2-4166-bed5-c73dc77ec977] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:45.242095 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-562a4f40-a485-4353-9546-a192f5659408 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:45.242691 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-562a4f40-a485-4353-9546-a192f5659408 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:45.243212 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-562a4f40-a485-4353-9546-a192f5659408 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:45.244002 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-562a4f40-a485-4353-9546-a192f5659408 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:45.244519 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-562a4f40-a485-4353-9546-a192f5659408 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:45.245033 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-562a4f40-a485-4353-9546-a192f5659408 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:45.456570 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-30e65992-7088-48fc-bb5e-a062fe053191 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:45.470245 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-562a4f40-a485-4353-9546-a192f5659408 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:45.475875 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-30e65992-7088-48fc-bb5e-a062fe053191 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c" status: 200 len: 1512 microversion: 2.1 time: 0.840309 Oct 17 13:59:45.496059 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-562a4f40-a485-4353-9546-a192f5659408 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977" status: 200 len: 1452 microversion: 2.1 time: 0.281178 Oct 17 13:59:45.503477 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2456/5035] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:45 2022] GET /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977 => generated 1452 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:45.504250 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8b5b430d-5855-4373-8c74-900478ce52f4 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:45.505014 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8b5b430d-5855-4373-8c74-900478ce52f4 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] [instance: aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:45.505277 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2580/5036] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:44 2022] GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c => generated 1512 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:45.522421 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8b5b430d-5855-4373-8c74-900478ce52f4 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:45.523153 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8b5b430d-5855-4373-8c74-900478ce52f4 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:45.523821 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8b5b430d-5855-4373-8c74-900478ce52f4 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:45.524705 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8b5b430d-5855-4373-8c74-900478ce52f4 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:45.525529 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8b5b430d-5855-4373-8c74-900478ce52f4 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:45.526120 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8b5b430d-5855-4373-8c74-900478ce52f4 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:45.584817 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-b5d2db76-b0a0-457a-a63b-ac7077b304d7 req-f5e2b101-e58a-4c8d-880c-96d61860fc6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "051c9371-d3e2-4166-bed5-c73dc77ec977", "name": "network-vif-deleted", "tag": "b42d1dd8-cfa2-4ce4-947c-6010f321b0df"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:59:45.615181 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-b5d2db76-b0a0-457a-a63b-ac7077b304d7 req-f5e2b101-e58a-4c8d-880c-96d61860fc6f service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:45.615783 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-b5d2db76-b0a0-457a-a63b-ac7077b304d7 req-f5e2b101-e58a-4c8d-880c-96d61860fc6f service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:45.616220 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-b5d2db76-b0a0-457a-a63b-ac7077b304d7 req-f5e2b101-e58a-4c8d-880c-96d61860fc6f service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:45.649401 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-b5d2db76-b0a0-457a-a63b-ac7077b304d7 req-f5e2b101-e58a-4c8d-880c-96d61860fc6f service nova] Creating event network-vif-deleted:b42d1dd8-cfa2-4ce4-947c-6010f321b0df for instance 051c9371-d3e2-4166-bed5-c73dc77ec977 on n-h1-854247-14 Oct 17 13:59:45.654993 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-b5d2db76-b0a0-457a-a63b-ac7077b304d7 req-f5e2b101-e58a-4c8d-880c-96d61860fc6f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073844 Oct 17 13:59:45.664331 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2581/5037] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:59:45.884332 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8b5b430d-5855-4373-8c74-900478ce52f4 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a33f07ba9f4343ab9c263839d0e567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c009a4e5e1e246e5b32da4f60e08eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:45.894023 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8b5b430d-5855-4373-8c74-900478ce52f4 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] 10.222.0.79 "GET /compute/v2.1/servers/aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6" status: 200 len: 1526 microversion: 2.1 time: 0.393745 Oct 17 13:59:45.905385 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2457/5038] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:45 2022] GET /compute/v2.1/servers/aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6 => generated 1526 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:45.942841 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5c96b4b8-f4a0-4b24-bdcc-8daba6aa10e3 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:45.943633 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5c96b4b8-f4a0-4b24-bdcc-8daba6aa10e3 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] [instance: aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:45.972796 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5c96b4b8-f4a0-4b24-bdcc-8daba6aa10e3 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:45.973287 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5c96b4b8-f4a0-4b24-bdcc-8daba6aa10e3 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:45.981613 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5c96b4b8-f4a0-4b24-bdcc-8daba6aa10e3 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:45.982475 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5c96b4b8-f4a0-4b24-bdcc-8daba6aa10e3 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:45.983271 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5c96b4b8-f4a0-4b24-bdcc-8daba6aa10e3 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:45.983708 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5c96b4b8-f4a0-4b24-bdcc-8daba6aa10e3 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:46.298902 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5c96b4b8-f4a0-4b24-bdcc-8daba6aa10e3 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a33f07ba9f4343ab9c263839d0e567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c009a4e5e1e246e5b32da4f60e08eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:46.310484 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5c96b4b8-f4a0-4b24-bdcc-8daba6aa10e3 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] 10.222.0.79 "GET /compute/v2.1/servers/aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6" status: 200 len: 1526 microversion: 2.1 time: 0.380645 Oct 17 13:59:46.311078 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2582/5039] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:45 2022] GET /compute/v2.1/servers/aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6 => generated 1526 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:46.507559 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ac1f3ca1-862a-4732-b663-9dc7ff819778 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:46.509106 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ac1f3ca1-862a-4732-b663-9dc7ff819778 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: b681678a-4240-4b9b-929b-65d09606a07c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:46.529184 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ac1f3ca1-862a-4732-b663-9dc7ff819778 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:46.541831 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ac1f3ca1-862a-4732-b663-9dc7ff819778 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:46.542255 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ac1f3ca1-862a-4732-b663-9dc7ff819778 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:46.543272 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ac1f3ca1-862a-4732-b663-9dc7ff819778 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:46.545469 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ac1f3ca1-862a-4732-b663-9dc7ff819778 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:46.547098 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ac1f3ca1-862a-4732-b663-9dc7ff819778 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:47.040698 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ac1f3ca1-862a-4732-b663-9dc7ff819778 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:47.074549 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-32f9f797-1245-43af-85aa-421b0ffaba11 tempest-ServersNegativeTestMultiTenantJSON-2125601908 tempest-ServersNegativeTestMultiTenantJSON-2125601908-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:47.081498 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-32f9f797-1245-43af-85aa-421b0ffaba11 tempest-ServersNegativeTestMultiTenantJSON-2125601908 tempest-ServersNegativeTestMultiTenantJSON-2125601908-project] [instance: aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:47.085967 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ac1f3ca1-862a-4732-b663-9dc7ff819778 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c" status: 200 len: 1512 microversion: 2.1 time: 0.587082 Oct 17 13:59:47.094311 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-32f9f797-1245-43af-85aa-421b0ffaba11 tempest-ServersNegativeTestMultiTenantJSON-2125601908 tempest-ServersNegativeTestMultiTenantJSON-2125601908-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:47.095656 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2583/5040] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:46 2022] GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c => generated 1512 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:47.113923 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-32f9f797-1245-43af-85aa-421b0ffaba11 tempest-ServersNegativeTestMultiTenantJSON-2125601908 tempest-ServersNegativeTestMultiTenantJSON-2125601908-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:47.116302 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-32f9f797-1245-43af-85aa-421b0ffaba11 tempest-ServersNegativeTestMultiTenantJSON-2125601908 tempest-ServersNegativeTestMultiTenantJSON-2125601908-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:47.117274 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-32f9f797-1245-43af-85aa-421b0ffaba11 tempest-ServersNegativeTestMultiTenantJSON-2125601908 tempest-ServersNegativeTestMultiTenantJSON-2125601908-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:47.117908 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-32f9f797-1245-43af-85aa-421b0ffaba11 tempest-ServersNegativeTestMultiTenantJSON-2125601908 tempest-ServersNegativeTestMultiTenantJSON-2125601908-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:47.121979 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-32f9f797-1245-43af-85aa-421b0ffaba11 tempest-ServersNegativeTestMultiTenantJSON-2125601908 tempest-ServersNegativeTestMultiTenantJSON-2125601908-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:47.130801 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4471a062-619e-48b5-b481-3f6a66a73d11 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:47.139567 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4471a062-619e-48b5-b481-3f6a66a73d11 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 051c9371-d3e2-4166-bed5-c73dc77ec977] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:47.154688 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4471a062-619e-48b5-b481-3f6a66a73d11 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:47.155197 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4471a062-619e-48b5-b481-3f6a66a73d11 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:47.155625 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4471a062-619e-48b5-b481-3f6a66a73d11 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:47.161888 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-32f9f797-1245-43af-85aa-421b0ffaba11 tempest-ServersNegativeTestMultiTenantJSON-2125601908 tempest-ServersNegativeTestMultiTenantJSON-2125601908-project] HTTP exception thrown: Instance aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6 could not be found. Oct 17 13:59:47.164248 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4471a062-619e-48b5-b481-3f6a66a73d11 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:47.164474 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-32f9f797-1245-43af-85aa-421b0ffaba11 tempest-ServersNegativeTestMultiTenantJSON-2125601908 tempest-ServersNegativeTestMultiTenantJSON-2125601908-project] Request method failure captured: Oct 17 13:59:47.164474 n-d-854247-14 devstack@n-api.service[127017]: request: DELETE /compute/v2.1/servers/aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6 HTTP/1.1 Oct 17 13:59:47.164474 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:59:47.164474 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:59:47.164474 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:59:47.164474 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:59:47.164474 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:59:47.164474 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:59:47.164474 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:59:47.164474 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:59:47.164474 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTV-4FbV7amp0pSvcPESHt3ZGyzVLKeSjTwhAluMsZNtZhOTJRIq2Mf8qib9KyrWo7aKY3bZZsEnnpmwkZa3EfHQug1fs_BSYf9I7KAeawNA0WNMFP1-9B4mO2HrYGAS6gunOlTqzkBybDkRG0zC8dBs4MwHYhAh1BpxsVeBGXARgIVc Oct 17 13:59:47.164474 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:59:47.164474 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:59:47.164474 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:59:47.164474 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:59:47.164474 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:59:47.164474 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:59:47.164474 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 5c1a53610a9045f3bc1a3579cde97f7a Oct 17 13:59:47.164474 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-2125601908 Oct 17 13:59:47.164474 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:59:47.164474 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:59:47.164474 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5c1a53610a9045f3bc1a3579cde97f7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5c1a53610a9045f3bc1a3579cde97f7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5c1a53610a9045f3bc1a3579cde97f7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5c1a53610a9045f3bc1a3579cde97f7a", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:59:47.164474 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-2125601908 Oct 17 13:59:47.164474 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 5c1a53610a9045f3bc1a3579cde97f7a Oct 17 13:59:47.164474 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-2125601908 Oct 17 13:59:47.164474 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServersNegativeTestMultiTenantJSON-2125601908-project Oct 17 13:59:47.164474 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:59:47.164474 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:59:47.164474 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 9ac23a46af95472aa7e15d80c6e0ea99 Oct 17 13:59:47.164474 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-2125601908-project Oct 17 13:59:47.164474 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:59:47.164474 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6 could not be found. Oct 17 13:59:47.164474 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6'} Oct 17 13:59:47.164474 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:59:47.164474 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:59:47.164474 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:59:47.164474 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:59:47.164474 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:59:47.164474 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:59:47.164474 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:59:47.164474 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:59:47.164474 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:59:47.164474 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:59:47.164474 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6 could not be found. Oct 17 13:59:47.164474 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:59:47.164474 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:59:47.164474 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:59:47.164474 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:59:47.164474 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:59:47.164474 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:59:47.164474 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:59:47.164474 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:59:47.164474 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:59:47.164474 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:59:47.164474 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:59:47.164474 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:59:47.164474 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:59:47.164474 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:59:47.164474 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:59:47.164474 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:59:47.164474 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:59:47.164474 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:59:47.170067 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6 could not be found. Oct 17 13:59:47.170067 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:59:47.170067 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:59:47.170067 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:59:47.170067 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:59:47.170067 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:59:47.170067 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:59:47.170067 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:59:47.170067 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:59:47.170067 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6 could not be found. Oct 17 13:59:47.170067 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:59:47.171090 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4471a062-619e-48b5-b481-3f6a66a73d11 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:47.171090 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4471a062-619e-48b5-b481-3f6a66a73d11 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:47.172200 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-32f9f797-1245-43af-85aa-421b0ffaba11 tempest-ServersNegativeTestMultiTenantJSON-2125601908 tempest-ServersNegativeTestMultiTenantJSON-2125601908-project] Returning 404 to user: Instance aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:59:47.177219 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-32f9f797-1245-43af-85aa-421b0ffaba11 tempest-ServersNegativeTestMultiTenantJSON-2125601908 tempest-ServersNegativeTestMultiTenantJSON-2125601908-project] 10.222.0.79 "DELETE /compute/v2.1/servers/aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6" status: 404 len: 111 microversion: 2.1 time: 0.842481 Oct 17 13:59:47.178440 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2458/5041] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:59:46 2022] DELETE /compute/v2.1/servers/aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6 => generated 111 bytes in 845 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:59:47.189593 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d3b27a39-b65c-410a-b5a0-a93238d65707 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:47.191933 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d3b27a39-b65c-410a-b5a0-a93238d65707 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] [instance: aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:47.200555 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-4471a062-619e-48b5-b481-3f6a66a73d11 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] HTTP exception thrown: Instance 051c9371-d3e2-4166-bed5-c73dc77ec977 could not be found. Oct 17 13:59:47.204083 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4471a062-619e-48b5-b481-3f6a66a73d11 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Request method failure captured: Oct 17 13:59:47.204083 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977 HTTP/1.1 Oct 17 13:59:47.204083 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 13:59:47.204083 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 13:59:47.204083 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 13:59:47.204083 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 13:59:47.204083 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 13:59:47.204083 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 13:59:47.204083 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 13:59:47.204083 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 13:59:47.204083 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTV3d-N_EWyrXl_-ZTSAdolghE5oRFAiaYrRKtyahJLuH4Zuc1PUgzCd73YN56SLIjM6miTpzCnqqJsn0BnrpuTYHk5E8J5lGILVtffaMFsULUCEEbYJyYFLHPoFVhrk6yfNnfYA84mZ9NkF5HFg6duIruC8u2pcezDZ7UQon3qHG7VE Oct 17 13:59:47.204083 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 13:59:47.204083 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 13:59:47.204083 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 13:59:47.204083 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 13:59:47.204083 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 13:59:47.204083 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 13:59:47.204083 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 45371f66db35454fbe896194e75afd6e Oct 17 13:59:47.204083 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServerActionsTestJSON-845020662 Oct 17 13:59:47.204083 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 13:59:47.204083 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 13:59:47.204083 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/45371f66db35454fbe896194e75afd6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/45371f66db35454fbe896194e75afd6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/45371f66db35454fbe896194e75afd6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_45371f66db35454fbe896194e75afd6e", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:59:47.204083 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServerActionsTestJSON-845020662 Oct 17 13:59:47.204083 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 45371f66db35454fbe896194e75afd6e Oct 17 13:59:47.204083 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServerActionsTestJSON-845020662 Oct 17 13:59:47.204083 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServerActionsTestJSON-845020662-project Oct 17 13:59:47.204083 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 13:59:47.204083 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 13:59:47.204083 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: c9382b34782f44e2818a26ecadc3f386 Oct 17 13:59:47.204083 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServerActionsTestJSON-845020662-project Oct 17 13:59:47.204083 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 13:59:47.204083 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 051c9371-d3e2-4166-bed5-c73dc77ec977 could not be found. Oct 17 13:59:47.204083 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '051c9371-d3e2-4166-bed5-c73dc77ec977'} Oct 17 13:59:47.204083 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:59:47.204083 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:59:47.204083 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:59:47.204083 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:59:47.204083 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:59:47.204083 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:59:47.204083 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:59:47.204083 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:59:47.204083 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:59:47.204083 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:59:47.204083 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 051c9371-d3e2-4166-bed5-c73dc77ec977 could not be found. Oct 17 13:59:47.204083 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:59:47.204083 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:59:47.204083 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:59:47.204083 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:59:47.204083 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:59:47.204083 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:59:47.204083 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:59:47.204083 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:59:47.204083 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:59:47.204083 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:59:47.204083 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:59:47.204083 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:59:47.204083 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:59:47.204083 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:59:47.204083 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:59:47.204083 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:59:47.204083 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 051c9371-d3e2-4166-bed5-c73dc77ec977 could not be found. Oct 17 13:59:47.204083 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:59:47.204083 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:59:47.204083 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:59:47.213360 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:59:47.213360 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:59:47.213360 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:59:47.213360 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:59:47.213360 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:59:47.213360 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 051c9371-d3e2-4166-bed5-c73dc77ec977 could not be found. Oct 17 13:59:47.213360 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 13:59:47.214017 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d3b27a39-b65c-410a-b5a0-a93238d65707 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:47.214017 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d3b27a39-b65c-410a-b5a0-a93238d65707 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:47.214017 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d3b27a39-b65c-410a-b5a0-a93238d65707 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:47.214017 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d3b27a39-b65c-410a-b5a0-a93238d65707 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:47.214017 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d3b27a39-b65c-410a-b5a0-a93238d65707 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:47.214017 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d3b27a39-b65c-410a-b5a0-a93238d65707 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:47.220862 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4471a062-619e-48b5-b481-3f6a66a73d11 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Returning 404 to user: Instance 051c9371-d3e2-4166-bed5-c73dc77ec977 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:59:47.221940 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4471a062-619e-48b5-b481-3f6a66a73d11 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977" status: 404 len: 111 microversion: 2.1 time: 0.120520 Oct 17 13:59:47.222724 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2584/5042] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:47 2022] GET /compute/v2.1/servers/051c9371-d3e2-4166-bed5-c73dc77ec977 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:59:47.239107 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6339e4bc-6680-489d-ac81-7cdae50f33d6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:47.240035 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6339e4bc-6680-489d-ac81-7cdae50f33d6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:47.269215 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6339e4bc-6680-489d-ac81-7cdae50f33d6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:47.269723 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6339e4bc-6680-489d-ac81-7cdae50f33d6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:47.270163 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6339e4bc-6680-489d-ac81-7cdae50f33d6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:47.270886 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6339e4bc-6680-489d-ac81-7cdae50f33d6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:47.273660 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6339e4bc-6680-489d-ac81-7cdae50f33d6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:47.277309 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6339e4bc-6680-489d-ac81-7cdae50f33d6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:47.345491 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6339e4bc-6680-489d-ac81-7cdae50f33d6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:59:47.583750 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6339e4bc-6680-489d-ac81-7cdae50f33d6 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "DELETE /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 204 len: 0 microversion: 2.1 time: 0.356534 Oct 17 13:59:47.584562 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2585/5043] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:59:47 2022] DELETE /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:59:47.593125 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ee21e54a-9131-4a3e-96f3-c1379d07e0d2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:47.593858 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ee21e54a-9131-4a3e-96f3-c1379d07e0d2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:47.625379 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ee21e54a-9131-4a3e-96f3-c1379d07e0d2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:47.625910 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ee21e54a-9131-4a3e-96f3-c1379d07e0d2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:47.626355 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ee21e54a-9131-4a3e-96f3-c1379d07e0d2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:47.627262 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ee21e54a-9131-4a3e-96f3-c1379d07e0d2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:47.627709 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ee21e54a-9131-4a3e-96f3-c1379d07e0d2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:47.639874 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ee21e54a-9131-4a3e-96f3-c1379d07e0d2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:47.700102 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:59:47.842562 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d3b27a39-b65c-410a-b5a0-a93238d65707 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a33f07ba9f4343ab9c263839d0e567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c009a4e5e1e246e5b32da4f60e08eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:47.875548 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d3b27a39-b65c-410a-b5a0-a93238d65707 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] 10.222.0.79 "GET /compute/v2.1/servers/aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6" status: 200 len: 1526 microversion: 2.1 time: 0.689209 Oct 17 13:59:47.880031 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2459/5044] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:47 2022] GET /compute/v2.1/servers/aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6 => generated 1526 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:59:47.902943 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8065b88e-e246-40c6-b13d-3880d74d7ab7 tempest-ServersNegativeTestMultiTenantJSON-2125601908 tempest-ServersNegativeTestMultiTenantJSON-2125601908-project] Action: 'update', calling method: >, body: {"server": {"name": "aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6_new"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:59:47.906872 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8065b88e-e246-40c6-b13d-3880d74d7ab7 tempest-ServersNegativeTestMultiTenantJSON-2125601908 tempest-ServersNegativeTestMultiTenantJSON-2125601908-project] [instance: aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:47.919425 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8065b88e-e246-40c6-b13d-3880d74d7ab7 tempest-ServersNegativeTestMultiTenantJSON-2125601908 tempest-ServersNegativeTestMultiTenantJSON-2125601908-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:47.935548 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8065b88e-e246-40c6-b13d-3880d74d7ab7 tempest-ServersNegativeTestMultiTenantJSON-2125601908 tempest-ServersNegativeTestMultiTenantJSON-2125601908-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:47.936828 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8065b88e-e246-40c6-b13d-3880d74d7ab7 tempest-ServersNegativeTestMultiTenantJSON-2125601908 tempest-ServersNegativeTestMultiTenantJSON-2125601908-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:47.937759 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8065b88e-e246-40c6-b13d-3880d74d7ab7 tempest-ServersNegativeTestMultiTenantJSON-2125601908 tempest-ServersNegativeTestMultiTenantJSON-2125601908-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:47.938540 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8065b88e-e246-40c6-b13d-3880d74d7ab7 tempest-ServersNegativeTestMultiTenantJSON-2125601908 tempest-ServersNegativeTestMultiTenantJSON-2125601908-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:47.939306 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8065b88e-e246-40c6-b13d-3880d74d7ab7 tempest-ServersNegativeTestMultiTenantJSON-2125601908 tempest-ServersNegativeTestMultiTenantJSON-2125601908-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:47.963510 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-8065b88e-e246-40c6-b13d-3880d74d7ab7 tempest-ServersNegativeTestMultiTenantJSON-2125601908 tempest-ServersNegativeTestMultiTenantJSON-2125601908-project] HTTP exception thrown: Instance aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6 could not be found. Oct 17 13:59:47.965343 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8065b88e-e246-40c6-b13d-3880d74d7ab7 tempest-ServersNegativeTestMultiTenantJSON-2125601908 tempest-ServersNegativeTestMultiTenantJSON-2125601908-project] Request method failure captured: Oct 17 13:59:47.965343 n-d-854247-14 devstack@n-api.service[127017]: request: PUT /compute/v2.1/servers/aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6 HTTP/1.1 Oct 17 13:59:47.965343 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:59:47.965343 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:59:47.965343 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:59:47.965343 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 64 Oct 17 13:59:47.965343 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:59:47.965343 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:59:47.965343 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:59:47.965343 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:59:47.965343 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTV-4FbV7amp0pSvcPESHt3ZGyzVLKeSjTwhAluMsZNtZhOTJRIq2Mf8qib9KyrWo7aKY3bZZsEnnpmwkZa3EfHQug1fs_BSYf9I7KAeawNA0WNMFP1-9B4mO2HrYGAS6gunOlTqzkBybDkRG0zC8dBs4MwHYhAh1BpxsVeBGXARgIVc Oct 17 13:59:47.965343 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:59:47.965343 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:59:47.965343 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:59:47.965343 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:59:47.965343 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:59:47.965343 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:59:47.965343 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 5c1a53610a9045f3bc1a3579cde97f7a Oct 17 13:59:47.965343 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-2125601908 Oct 17 13:59:47.965343 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:59:47.965343 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:59:47.965343 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5c1a53610a9045f3bc1a3579cde97f7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5c1a53610a9045f3bc1a3579cde97f7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5c1a53610a9045f3bc1a3579cde97f7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5c1a53610a9045f3bc1a3579cde97f7a", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:59:47.965343 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-2125601908 Oct 17 13:59:47.965343 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 5c1a53610a9045f3bc1a3579cde97f7a Oct 17 13:59:47.965343 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-2125601908 Oct 17 13:59:47.965343 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServersNegativeTestMultiTenantJSON-2125601908-project Oct 17 13:59:47.965343 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:59:47.965343 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:59:47.965343 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 9ac23a46af95472aa7e15d80c6e0ea99 Oct 17 13:59:47.965343 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-2125601908-project Oct 17 13:59:47.965343 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 13:59:47.965343 n-d-854247-14 devstack@n-api.service[127017]: {"server": {"name": "aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6_new"}} Oct 17 13:59:47.965343 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:59:47.965343 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6 could not be found. Oct 17 13:59:47.965343 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6', 'body': {'server': {'name': 'aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6_new'}}} Oct 17 13:59:47.965343 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:59:47.965343 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:59:47.965343 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:59:47.965343 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:59:47.965343 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:59:47.965343 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:59:47.965343 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:59:47.965343 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:59:47.965343 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:59:47.965343 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:59:47.965343 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6 could not be found. Oct 17 13:59:47.965343 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:59:47.965343 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:59:47.965343 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:59:47.965343 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:59:47.965343 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:59:47.965343 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:59:47.965343 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:59:47.965343 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:59:47.965343 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:59:47.965343 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:59:47.965343 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:59:47.965343 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:59:47.965343 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:59:47.965343 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:59:47.965343 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:59:47.965343 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:59:47.965343 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 17 13:59:47.971149 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 17 13:59:47.971149 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 17 13:59:47.971149 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:59:47.971149 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:59:47.971149 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:59:47.971149 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:59:47.971149 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6 could not be found. Oct 17 13:59:47.971149 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:59:47.971149 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:59:47.971149 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:59:47.971149 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:59:47.971149 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:59:47.971149 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:59:47.971149 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:59:47.971149 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:59:47.971149 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6 could not be found. Oct 17 13:59:47.971149 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:59:47.971149 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8065b88e-e246-40c6-b13d-3880d74d7ab7 tempest-ServersNegativeTestMultiTenantJSON-2125601908 tempest-ServersNegativeTestMultiTenantJSON-2125601908-project] Returning 404 to user: Instance aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:59:47.972846 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8065b88e-e246-40c6-b13d-3880d74d7ab7 tempest-ServersNegativeTestMultiTenantJSON-2125601908 tempest-ServersNegativeTestMultiTenantJSON-2125601908-project] 10.222.0.79 "PUT /compute/v2.1/servers/aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6" status: 404 len: 111 microversion: 2.1 time: 0.074051 Oct 17 13:59:47.972846 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2460/5045] 10.222.0.79 () {60 vars in 1256 bytes} [Mon Oct 17 13:59:47 2022] PUT /compute/v2.1/servers/aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:59:47.982831 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6b5fc343-638a-42a8-ab77-64e432e4dc7b tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:47.990079 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6b5fc343-638a-42a8-ab77-64e432e4dc7b tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] [instance: aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:48.003377 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6b5fc343-638a-42a8-ab77-64e432e4dc7b tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:48.005108 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6b5fc343-638a-42a8-ab77-64e432e4dc7b tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:48.008929 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6b5fc343-638a-42a8-ab77-64e432e4dc7b tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:48.012935 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6b5fc343-638a-42a8-ab77-64e432e4dc7b tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:48.013754 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6b5fc343-638a-42a8-ab77-64e432e4dc7b tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:48.015363 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6b5fc343-638a-42a8-ab77-64e432e4dc7b tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:48.090715 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6b5fc343-638a-42a8-ab77-64e432e4dc7b tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] [instance: aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:59:48.263537 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6b5fc343-638a-42a8-ab77-64e432e4dc7b tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] 10.222.0.79 "DELETE /compute/v2.1/servers/aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6" status: 204 len: 0 microversion: 2.1 time: 0.285259 Oct 17 13:59:48.264373 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2461/5046] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 13:59:47 2022] DELETE /compute/v2.1/servers/aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 13:59:48.269704 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c18b3c3f-9727-4d45-b5ab-0d1674a1ea1b tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:48.270421 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c18b3c3f-9727-4d45-b5ab-0d1674a1ea1b tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: b681678a-4240-4b9b-929b-65d09606a07c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:48.276679 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c18b3c3f-9727-4d45-b5ab-0d1674a1ea1b tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:48.277874 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c18b3c3f-9727-4d45-b5ab-0d1674a1ea1b tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:48.277874 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c18b3c3f-9727-4d45-b5ab-0d1674a1ea1b tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:48.278401 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c18b3c3f-9727-4d45-b5ab-0d1674a1ea1b tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:48.278850 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c18b3c3f-9727-4d45-b5ab-0d1674a1ea1b tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:48.279352 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c18b3c3f-9727-4d45-b5ab-0d1674a1ea1b tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:48.753618 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ee21e54a-9131-4a3e-96f3-c1379d07e0d2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:48.756363 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c18b3c3f-9727-4d45-b5ab-0d1674a1ea1b tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:48.777072 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ee21e54a-9131-4a3e-96f3-c1379d07e0d2 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1672 microversion: 2.1 time: 1.188128 Oct 17 13:59:48.778072 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2586/5047] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:47 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1672 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:48.797914 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c18b3c3f-9727-4d45-b5ab-0d1674a1ea1b tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c" status: 200 len: 1512 microversion: 2.1 time: 0.532845 Oct 17 13:59:48.798511 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2462/5048] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:48 2022] GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c => generated 1512 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:48.800649 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9fe500db-1b1f-49df-b73d-e5870b4c0772 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:48.801531 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9fe500db-1b1f-49df-b73d-e5870b4c0772 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] [instance: aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:48.811503 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9fe500db-1b1f-49df-b73d-e5870b4c0772 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:48.812444 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9fe500db-1b1f-49df-b73d-e5870b4c0772 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:48.813088 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9fe500db-1b1f-49df-b73d-e5870b4c0772 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:48.814066 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9fe500db-1b1f-49df-b73d-e5870b4c0772 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:48.815262 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9fe500db-1b1f-49df-b73d-e5870b4c0772 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:48.815736 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9fe500db-1b1f-49df-b73d-e5870b4c0772 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:49.234684 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9fe500db-1b1f-49df-b73d-e5870b4c0772 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a33f07ba9f4343ab9c263839d0e567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c009a4e5e1e246e5b32da4f60e08eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:49.244552 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9fe500db-1b1f-49df-b73d-e5870b4c0772 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] 10.222.0.79 "GET /compute/v2.1/servers/aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6" status: 200 len: 1532 microversion: 2.1 time: 0.448720 Oct 17 13:59:49.261691 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2587/5049] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:48 2022] GET /compute/v2.1/servers/aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6 => generated 1532 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:49.804745 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8b2f6fad-5eb2-4604-8324-eac3b45eaa34 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:49.805746 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8b2f6fad-5eb2-4604-8324-eac3b45eaa34 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:49.813539 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8b2f6fad-5eb2-4604-8324-eac3b45eaa34 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:49.814496 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8b2f6fad-5eb2-4604-8324-eac3b45eaa34 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:49.815128 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8b2f6fad-5eb2-4604-8324-eac3b45eaa34 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:49.816012 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8b2f6fad-5eb2-4604-8324-eac3b45eaa34 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:49.816704 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8b2f6fad-5eb2-4604-8324-eac3b45eaa34 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:49.817294 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8b2f6fad-5eb2-4604-8324-eac3b45eaa34 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:49.827080 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7697bc34-fd9e-44af-a447-e093e389b657 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:49.827859 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7697bc34-fd9e-44af-a447-e093e389b657 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: b681678a-4240-4b9b-929b-65d09606a07c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:49.842789 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7697bc34-fd9e-44af-a447-e093e389b657 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:49.844442 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7697bc34-fd9e-44af-a447-e093e389b657 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:49.845138 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7697bc34-fd9e-44af-a447-e093e389b657 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:49.869415 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7697bc34-fd9e-44af-a447-e093e389b657 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:49.890483 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7697bc34-fd9e-44af-a447-e093e389b657 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.037s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:49.892022 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7697bc34-fd9e-44af-a447-e093e389b657 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:50.972914 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8b2f6fad-5eb2-4604-8324-eac3b45eaa34 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:50.984559 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8b2f6fad-5eb2-4604-8324-eac3b45eaa34 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1672 microversion: 2.1 time: 1.186912 Oct 17 13:59:50.987905 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2463/5050] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:49 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1672 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:51.005478 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e899002b-fba0-4c30-9d26-fc0072c711c9 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:51.006118 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e899002b-fba0-4c30-9d26-fc0072c711c9 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] [instance: aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:51.022865 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e899002b-fba0-4c30-9d26-fc0072c711c9 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:51.024837 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e899002b-fba0-4c30-9d26-fc0072c711c9 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:51.024837 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e899002b-fba0-4c30-9d26-fc0072c711c9 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:51.028760 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e899002b-fba0-4c30-9d26-fc0072c711c9 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:51.030122 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e899002b-fba0-4c30-9d26-fc0072c711c9 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:51.033471 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e899002b-fba0-4c30-9d26-fc0072c711c9 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:51.454114 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7697bc34-fd9e-44af-a447-e093e389b657 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:51.467714 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7697bc34-fd9e-44af-a447-e093e389b657 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c" status: 200 len: 1512 microversion: 2.1 time: 1.641834 Oct 17 13:59:51.471002 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2588/5051] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:49 2022] GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c => generated 1512 bytes in 1650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:51.642946 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e899002b-fba0-4c30-9d26-fc0072c711c9 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a33f07ba9f4343ab9c263839d0e567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c009a4e5e1e246e5b32da4f60e08eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:51.646688 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:59:51.652521 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e899002b-fba0-4c30-9d26-fc0072c711c9 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] 10.222.0.79 "GET /compute/v2.1/servers/aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6" status: 200 len: 1532 microversion: 2.1 time: 0.663151 Oct 17 13:59:51.652953 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2464/5052] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:50 2022] GET /compute/v2.1/servers/aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6 => generated 1532 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:52.013200 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-dd7486bc-9943-4414-9c85-44805782b020 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:52.013816 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-dd7486bc-9943-4414-9c85-44805782b020 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:52.024358 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dd7486bc-9943-4414-9c85-44805782b020 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:52.024835 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dd7486bc-9943-4414-9c85-44805782b020 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:52.027411 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dd7486bc-9943-4414-9c85-44805782b020 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:52.036834 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dd7486bc-9943-4414-9c85-44805782b020 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:52.037484 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dd7486bc-9943-4414-9c85-44805782b020 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:52.037928 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dd7486bc-9943-4414-9c85-44805782b020 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:52.494929 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2184e3e1-4823-4d2b-8110-ac0d7c0189ba tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:52.495651 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2184e3e1-4823-4d2b-8110-ac0d7c0189ba tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: b681678a-4240-4b9b-929b-65d09606a07c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:52.517644 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2184e3e1-4823-4d2b-8110-ac0d7c0189ba tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:52.518486 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2184e3e1-4823-4d2b-8110-ac0d7c0189ba tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:52.519597 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2184e3e1-4823-4d2b-8110-ac0d7c0189ba tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:52.520482 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2184e3e1-4823-4d2b-8110-ac0d7c0189ba tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:52.521181 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2184e3e1-4823-4d2b-8110-ac0d7c0189ba tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:52.521785 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2184e3e1-4823-4d2b-8110-ac0d7c0189ba tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:52.541074 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-dd7486bc-9943-4414-9c85-44805782b020 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:52.613717 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-dd7486bc-9943-4414-9c85-44805782b020 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1672 microversion: 2.1 time: 0.590365 Oct 17 13:59:52.622943 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2589/5053] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:52 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1672 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:52.681190 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1f146df2-a524-4640-958d-53008ce1a400 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:52.681808 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-1f146df2-a524-4640-958d-53008ce1a400 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] [instance: aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:52.697624 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1f146df2-a524-4640-958d-53008ce1a400 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:52.698325 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1f146df2-a524-4640-958d-53008ce1a400 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:52.698967 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1f146df2-a524-4640-958d-53008ce1a400 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:52.699988 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1f146df2-a524-4640-958d-53008ce1a400 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:52.701264 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1f146df2-a524-4640-958d-53008ce1a400 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:52.701921 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1f146df2-a524-4640-958d-53008ce1a400 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:53.031579 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-1f146df2-a524-4640-958d-53008ce1a400 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a33f07ba9f4343ab9c263839d0e567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c009a4e5e1e246e5b32da4f60e08eb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:53.046105 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1f146df2-a524-4640-958d-53008ce1a400 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] 10.222.0.79 "GET /compute/v2.1/servers/aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6" status: 200 len: 1490 microversion: 2.1 time: 0.369451 Oct 17 13:59:53.050368 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2590/5054] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:52 2022] GET /compute/v2.1/servers/aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6 => generated 1490 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:53.071440 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-1eeeca7a-6b21-405e-a33a-3fc234b21fff req-e75db741-8a51-4866-b061-9f9ffcb463df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6", "name": "network-vif-deleted", "tag": "79d9df8e-1228-4152-bb7a-87a2b3734dd5"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:59:53.093825 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-1eeeca7a-6b21-405e-a33a-3fc234b21fff req-e75db741-8a51-4866-b061-9f9ffcb463df service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:53.096662 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-1eeeca7a-6b21-405e-a33a-3fc234b21fff req-e75db741-8a51-4866-b061-9f9ffcb463df service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:53.097473 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-1eeeca7a-6b21-405e-a33a-3fc234b21fff req-e75db741-8a51-4866-b061-9f9ffcb463df service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:53.151019 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-1eeeca7a-6b21-405e-a33a-3fc234b21fff req-e75db741-8a51-4866-b061-9f9ffcb463df service nova] Creating event network-vif-deleted:79d9df8e-1228-4152-bb7a-87a2b3734dd5 for instance aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6 on n-h2-854247-14 Oct 17 13:59:53.182501 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-1eeeca7a-6b21-405e-a33a-3fc234b21fff req-e75db741-8a51-4866-b061-9f9ffcb463df service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128410 Oct 17 13:59:53.184673 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2591/5055] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:59:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:59:53.733341 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f5525fa5-d61d-482d-b7cd-c9b574b32c26 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:53.734947 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f5525fa5-d61d-482d-b7cd-c9b574b32c26 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:53.746283 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f5525fa5-d61d-482d-b7cd-c9b574b32c26 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:53.753715 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f5525fa5-d61d-482d-b7cd-c9b574b32c26 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:53.763839 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f5525fa5-d61d-482d-b7cd-c9b574b32c26 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:53.764884 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f5525fa5-d61d-482d-b7cd-c9b574b32c26 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:53.765642 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f5525fa5-d61d-482d-b7cd-c9b574b32c26 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:53.766241 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f5525fa5-d61d-482d-b7cd-c9b574b32c26 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:54.282819 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2184e3e1-4823-4d2b-8110-ac0d7c0189ba tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:54.299726 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2184e3e1-4823-4d2b-8110-ac0d7c0189ba tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c" status: 200 len: 1512 microversion: 2.1 time: 1.809851 Oct 17 13:59:54.300298 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2465/5056] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:52 2022] GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c => generated 1512 bytes in 1811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:59:54.307400 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-774d1a7d-eece-40ea-b74d-ddbe7797b320 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:54.316110 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-774d1a7d-eece-40ea-b74d-ddbe7797b320 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] [instance: aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:54.347529 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-774d1a7d-eece-40ea-b74d-ddbe7797b320 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:54.348058 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-774d1a7d-eece-40ea-b74d-ddbe7797b320 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:54.348504 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-774d1a7d-eece-40ea-b74d-ddbe7797b320 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:54.349222 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-774d1a7d-eece-40ea-b74d-ddbe7797b320 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:54.349671 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-774d1a7d-eece-40ea-b74d-ddbe7797b320 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:54.353017 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-774d1a7d-eece-40ea-b74d-ddbe7797b320 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:54.383143 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-774d1a7d-eece-40ea-b74d-ddbe7797b320 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] HTTP exception thrown: Instance aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6 could not be found. Oct 17 13:59:54.384873 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-774d1a7d-eece-40ea-b74d-ddbe7797b320 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Request method failure captured: Oct 17 13:59:54.384873 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6 HTTP/1.1 Oct 17 13:59:54.384873 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:59:54.384873 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:59:54.384873 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:59:54.384873 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:59:54.384873 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:59:54.384873 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:59:54.384873 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:59:54.384873 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:59:54.384873 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTV-o_PVkhFCrsopelhCpnO4nJQbRRekuN7Tc0pykiWLt6yg8ZtpIjQnSI04lsqwVLcIcxVVbUbvYldI4hiMhMBm9ZMz0o3an23hxmwwWT8NK6jt0-_eY7_DD5CW2SqwqawQsbvJ-zwFoH2OObxJkPZBOAarKiGkPcPNHQHphd7idtrM Oct 17 13:59:54.384873 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:59:54.384873 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:59:54.384873 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:59:54.384873 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:59:54.384873 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:59:54.384873 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:59:54.384873 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: c009a4e5e1e246e5b32da4f60e08eb19 Oct 17 13:59:54.384873 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1621419419 Oct 17 13:59:54.384873 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:59:54.384873 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:59:54.384873 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c009a4e5e1e246e5b32da4f60e08eb19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c009a4e5e1e246e5b32da4f60e08eb19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c009a4e5e1e246e5b32da4f60e08eb19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c009a4e5e1e246e5b32da4f60e08eb19", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:59:54.384873 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1621419419 Oct 17 13:59:54.384873 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: c009a4e5e1e246e5b32da4f60e08eb19 Oct 17 13:59:54.384873 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1621419419 Oct 17 13:59:54.384873 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1621419419-project Oct 17 13:59:54.384873 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:59:54.384873 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:59:54.384873 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 68a33f07ba9f4343ab9c263839d0e567 Oct 17 13:59:54.384873 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1621419419-project Oct 17 13:59:54.384873 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:59:54.384873 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6 could not be found. Oct 17 13:59:54.384873 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6'} Oct 17 13:59:54.384873 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:59:54.384873 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:59:54.384873 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:59:54.384873 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:59:54.384873 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:59:54.384873 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:59:54.384873 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:59:54.384873 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:59:54.384873 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:59:54.384873 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:59:54.384873 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6 could not be found. Oct 17 13:59:54.384873 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:59:54.384873 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:59:54.384873 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:59:54.384873 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:59:54.384873 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:59:54.384873 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:59:54.384873 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:59:54.384873 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:59:54.384873 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:59:54.384873 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:59:54.384873 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:59:54.384873 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:59:54.384873 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:59:54.384873 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:59:54.384873 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:59:54.384873 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:59:54.384873 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6 could not be found. Oct 17 13:59:54.384873 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:59:54.395995 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:59:54.395995 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:59:54.395995 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:59:54.395995 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:59:54.395995 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:59:54.395995 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:59:54.395995 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:59:54.395995 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6 could not be found. Oct 17 13:59:54.395995 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:59:54.395995 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-774d1a7d-eece-40ea-b74d-ddbe7797b320 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] Returning 404 to user: Instance aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:59:54.395995 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-774d1a7d-eece-40ea-b74d-ddbe7797b320 tempest-ServersNegativeTestMultiTenantJSON-1621419419 tempest-ServersNegativeTestMultiTenantJSON-1621419419-project] 10.222.0.79 "GET /compute/v2.1/servers/aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6" status: 404 len: 111 microversion: 2.1 time: 0.084786 Oct 17 13:59:54.395995 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2466/5057] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:54 2022] GET /compute/v2.1/servers/aa3f9d5d-aab6-4dfd-a96e-4d4349d607c6 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:59:54.425663 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f5525fa5-d61d-482d-b7cd-c9b574b32c26 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:54.435714 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f5525fa5-d61d-482d-b7cd-c9b574b32c26 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1605 microversion: 2.1 time: 0.706703 Oct 17 13:59:54.436764 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2592/5058] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:53 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1605 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:55.242783 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-81051d32-4d9a-4009-b632-0541317431f4 req-89ef24ab-7b98-4ac9-bd68-d6bceab9beaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96dd349a-6476-4a7d-8f55-ea10e3b1e05d", "name": "network-vif-deleted", "tag": "fa985869-a190-4726-b04f-7d06a5c193e1"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:59:55.280150 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-81051d32-4d9a-4009-b632-0541317431f4 req-89ef24ab-7b98-4ac9-bd68-d6bceab9beaf service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:55.280649 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-81051d32-4d9a-4009-b632-0541317431f4 req-89ef24ab-7b98-4ac9-bd68-d6bceab9beaf service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:55.286057 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-81051d32-4d9a-4009-b632-0541317431f4 req-89ef24ab-7b98-4ac9-bd68-d6bceab9beaf service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:55.324049 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b3363ced-f9a8-413c-9f09-4a2fefee1dc8 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:55.324686 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b3363ced-f9a8-413c-9f09-4a2fefee1dc8 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: b681678a-4240-4b9b-929b-65d09606a07c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:55.335037 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-81051d32-4d9a-4009-b632-0541317431f4 req-89ef24ab-7b98-4ac9-bd68-d6bceab9beaf service nova] Creating event network-vif-deleted:fa985869-a190-4726-b04f-7d06a5c193e1 for instance 96dd349a-6476-4a7d-8f55-ea10e3b1e05d on n-h2-854247-14 Oct 17 13:59:55.341539 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b3363ced-f9a8-413c-9f09-4a2fefee1dc8 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:55.342046 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b3363ced-f9a8-413c-9f09-4a2fefee1dc8 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:55.343351 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b3363ced-f9a8-413c-9f09-4a2fefee1dc8 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:55.346003 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b3363ced-f9a8-413c-9f09-4a2fefee1dc8 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:55.346678 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b3363ced-f9a8-413c-9f09-4a2fefee1dc8 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:55.349012 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b3363ced-f9a8-413c-9f09-4a2fefee1dc8 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:55.356669 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-81051d32-4d9a-4009-b632-0541317431f4 req-89ef24ab-7b98-4ac9-bd68-d6bceab9beaf service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117769 Oct 17 13:59:55.362345 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2467/5059] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 13:59:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:59:55.467020 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8f24e9d4-267d-4ab7-93d9-6ee94f26cf24 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:55.468240 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8f24e9d4-267d-4ab7-93d9-6ee94f26cf24 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:55.493303 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8f24e9d4-267d-4ab7-93d9-6ee94f26cf24 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:55.495826 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8f24e9d4-267d-4ab7-93d9-6ee94f26cf24 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:55.496471 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8f24e9d4-267d-4ab7-93d9-6ee94f26cf24 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:55.497488 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8f24e9d4-267d-4ab7-93d9-6ee94f26cf24 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:55.499567 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8f24e9d4-267d-4ab7-93d9-6ee94f26cf24 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:55.500133 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8f24e9d4-267d-4ab7-93d9-6ee94f26cf24 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:55.587227 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8f24e9d4-267d-4ab7-93d9-6ee94f26cf24 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:55.592520 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8f24e9d4-267d-4ab7-93d9-6ee94f26cf24 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:55.594328 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8f24e9d4-267d-4ab7-93d9-6ee94f26cf24 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:55.606118 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-8f24e9d4-267d-4ab7-93d9-6ee94f26cf24 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lazy-loading 'fault' on Instance uuid 96dd349a-6476-4a7d-8f55-ea10e3b1e05d {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:59:55.711672 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8f24e9d4-267d-4ab7-93d9-6ee94f26cf24 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9382b34782f44e2818a26ecadc3f386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45371f66db35454fbe896194e75afd6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:55.724862 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8f24e9d4-267d-4ab7-93d9-6ee94f26cf24 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 200 len: 1327 microversion: 2.1 time: 0.259956 Oct 17 13:59:55.726195 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2468/5060] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:55 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 1327 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:56.075021 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b3363ced-f9a8-413c-9f09-4a2fefee1dc8 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:56.120768 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b3363ced-f9a8-413c-9f09-4a2fefee1dc8 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c" status: 200 len: 1512 microversion: 2.1 time: 0.801066 Oct 17 13:59:56.147795 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2593/5061] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:55 2022] GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c => generated 1512 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:56.753170 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ddabd979-0953-4f50-b0ba-ff0e74fe9d55 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:56.754440 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ddabd979-0953-4f50-b0ba-ff0e74fe9d55 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] [instance: 96dd349a-6476-4a7d-8f55-ea10e3b1e05d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:56.775850 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ddabd979-0953-4f50-b0ba-ff0e74fe9d55 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:56.776995 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ddabd979-0953-4f50-b0ba-ff0e74fe9d55 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:56.778429 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ddabd979-0953-4f50-b0ba-ff0e74fe9d55 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:56.779683 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ddabd979-0953-4f50-b0ba-ff0e74fe9d55 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:56.781687 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ddabd979-0953-4f50-b0ba-ff0e74fe9d55 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:56.783121 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ddabd979-0953-4f50-b0ba-ff0e74fe9d55 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:56.828650 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-ddabd979-0953-4f50-b0ba-ff0e74fe9d55 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] HTTP exception thrown: Instance 96dd349a-6476-4a7d-8f55-ea10e3b1e05d could not be found. Oct 17 13:59:56.831767 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ddabd979-0953-4f50-b0ba-ff0e74fe9d55 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Request method failure captured: Oct 17 13:59:56.831767 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d HTTP/1.1 Oct 17 13:59:56.831767 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 13:59:56.831767 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 13:59:56.831767 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 13:59:56.831767 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 13:59:56.831767 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 13:59:56.831767 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 13:59:56.831767 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 13:59:56.831767 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 13:59:56.831767 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTV3d-N_EWyrXl_-ZTSAdolghE5oRFAiaYrRKtyahJLuH4Zuc1PUgzCd73YN56SLIjM6miTpzCnqqJsn0BnrpuTYHk5E8J5lGILVtffaMFsULUCEEbYJyYFLHPoFVhrk6yfNnfYA84mZ9NkF5HFg6duIruC8u2pcezDZ7UQon3qHG7VE Oct 17 13:59:56.831767 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 13:59:56.831767 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 13:59:56.831767 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 13:59:56.831767 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 13:59:56.831767 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 13:59:56.831767 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 13:59:56.831767 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 45371f66db35454fbe896194e75afd6e Oct 17 13:59:56.831767 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServerActionsTestJSON-845020662 Oct 17 13:59:56.831767 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 13:59:56.831767 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 13:59:56.831767 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/45371f66db35454fbe896194e75afd6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/45371f66db35454fbe896194e75afd6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/45371f66db35454fbe896194e75afd6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_45371f66db35454fbe896194e75afd6e", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 13:59:56.831767 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServerActionsTestJSON-845020662 Oct 17 13:59:56.831767 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 45371f66db35454fbe896194e75afd6e Oct 17 13:59:56.831767 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServerActionsTestJSON-845020662 Oct 17 13:59:56.831767 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServerActionsTestJSON-845020662-project Oct 17 13:59:56.831767 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 13:59:56.831767 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 13:59:56.831767 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: c9382b34782f44e2818a26ecadc3f386 Oct 17 13:59:56.831767 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServerActionsTestJSON-845020662-project Oct 17 13:59:56.831767 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 13:59:56.831767 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 96dd349a-6476-4a7d-8f55-ea10e3b1e05d could not be found. Oct 17 13:59:56.831767 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '96dd349a-6476-4a7d-8f55-ea10e3b1e05d'} Oct 17 13:59:56.831767 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:59:56.831767 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:59:56.831767 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:59:56.831767 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:59:56.831767 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:59:56.831767 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:59:56.831767 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:59:56.831767 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:59:56.831767 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:59:56.831767 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:59:56.831767 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96dd349a-6476-4a7d-8f55-ea10e3b1e05d could not be found. Oct 17 13:59:56.831767 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:59:56.831767 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:59:56.831767 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:59:56.831767 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:59:56.831767 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:59:56.831767 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:59:56.831767 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:59:56.831767 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:59:56.831767 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:59:56.831767 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:59:56.831767 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:59:56.831767 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:59:56.831767 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:59:56.831767 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:59:56.831767 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:59:56.831767 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:59:56.831767 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96dd349a-6476-4a7d-8f55-ea10e3b1e05d could not be found. Oct 17 13:59:56.831767 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:59:56.831767 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:59:56.831767 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:59:56.838966 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:59:56.838966 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:59:56.838966 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:59:56.838966 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:59:56.838966 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:59:56.838966 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96dd349a-6476-4a7d-8f55-ea10e3b1e05d could not be found. Oct 17 13:59:56.838966 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 13:59:56.838966 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ddabd979-0953-4f50-b0ba-ff0e74fe9d55 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Returning 404 to user: Instance 96dd349a-6476-4a7d-8f55-ea10e3b1e05d could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:59:56.838966 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ddabd979-0953-4f50-b0ba-ff0e74fe9d55 tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d" status: 404 len: 111 microversion: 2.1 time: 0.086623 Oct 17 13:59:56.843866 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0464751c-d5a9-42f9-85fa-f18ae743533e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] Calling method '.version_select at 0x7f7cd4f87700>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:56.856671 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2469/5062] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:56 2022] GET /compute/v2.1/servers/96dd349a-6476-4a7d-8f55-ea10e3b1e05d => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:59:56.874547 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0464751c-d5a9-42f9-85fa-f18ae743533e tempest-ServerActionsTestJSON-845020662 tempest-ServerActionsTestJSON-845020662-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-981586921" status: 202 len: 0 microversion: 2.1 time: 0.034367 Oct 17 13:59:56.879815 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2594/5063] 10.222.0.79 () {58 vars in 1218 bytes} [Mon Oct 17 13:59:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-981586921 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:59:57.161872 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-31c503d4-a82e-4317-a95d-ea2a7a88444f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:57.163359 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-31c503d4-a82e-4317-a95d-ea2a7a88444f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: b681678a-4240-4b9b-929b-65d09606a07c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:57.179404 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-31c503d4-a82e-4317-a95d-ea2a7a88444f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:57.181552 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-31c503d4-a82e-4317-a95d-ea2a7a88444f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:57.182762 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-31c503d4-a82e-4317-a95d-ea2a7a88444f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:57.184810 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-31c503d4-a82e-4317-a95d-ea2a7a88444f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:57.188451 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-31c503d4-a82e-4317-a95d-ea2a7a88444f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:57.189863 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-31c503d4-a82e-4317-a95d-ea2a7a88444f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:58.016694 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-31c503d4-a82e-4317-a95d-ea2a7a88444f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:58.034419 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-31c503d4-a82e-4317-a95d-ea2a7a88444f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c" status: 200 len: 1512 microversion: 2.1 time: 0.873756 Oct 17 13:59:58.036602 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2470/5064] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:57 2022] GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c => generated 1512 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:59.067671 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5f662207-448e-44d4-840f-225b441b2e87 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:59.068984 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5f662207-448e-44d4-840f-225b441b2e87 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: b681678a-4240-4b9b-929b-65d09606a07c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:59.092808 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5f662207-448e-44d4-840f-225b441b2e87 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:59.096107 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5f662207-448e-44d4-840f-225b441b2e87 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:59.097017 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5f662207-448e-44d4-840f-225b441b2e87 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:59.099235 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5f662207-448e-44d4-840f-225b441b2e87 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:59.100417 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5f662207-448e-44d4-840f-225b441b2e87 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:59.102900 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5f662207-448e-44d4-840f-225b441b2e87 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:00.216866 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5f662207-448e-44d4-840f-225b441b2e87 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:00.235782 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5f662207-448e-44d4-840f-225b441b2e87 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c" status: 200 len: 1489 microversion: 2.1 time: 1.173162 Oct 17 14:00:00.236531 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2595/5065] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:59 2022] GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c => generated 1489 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:00:00.263948 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a1caa550-41cf-4c3c-b077-92f3de6cb3a6 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:00.264608 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a1caa550-41cf-4c3c-b077-92f3de6cb3a6 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: b681678a-4240-4b9b-929b-65d09606a07c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:00.293843 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a1caa550-41cf-4c3c-b077-92f3de6cb3a6 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:00.296084 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a1caa550-41cf-4c3c-b077-92f3de6cb3a6 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:00.299184 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a1caa550-41cf-4c3c-b077-92f3de6cb3a6 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:00.300353 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a1caa550-41cf-4c3c-b077-92f3de6cb3a6 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:00.304264 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a1caa550-41cf-4c3c-b077-92f3de6cb3a6 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:00.305542 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a1caa550-41cf-4c3c-b077-92f3de6cb3a6 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:00.373460 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a1caa550-41cf-4c3c-b077-92f3de6cb3a6 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: b681678a-4240-4b9b-929b-65d09606a07c] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:00:00.568338 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a1caa550-41cf-4c3c-b077-92f3de6cb3a6 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "DELETE /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c" status: 204 len: 0 microversion: 2.1 time: 0.308511 Oct 17 14:00:00.569430 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2471/5066] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:00:00 2022] DELETE /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 14:00:00.579057 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2dcd1b70-a5f7-4d45-abb7-fce8f1c40263 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:00.579977 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2dcd1b70-a5f7-4d45-abb7-fce8f1c40263 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: b681678a-4240-4b9b-929b-65d09606a07c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:00.592095 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2dcd1b70-a5f7-4d45-abb7-fce8f1c40263 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:00.592841 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2dcd1b70-a5f7-4d45-abb7-fce8f1c40263 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:00.593509 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2dcd1b70-a5f7-4d45-abb7-fce8f1c40263 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:00.594475 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2dcd1b70-a5f7-4d45-abb7-fce8f1c40263 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:00.599577 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2dcd1b70-a5f7-4d45-abb7-fce8f1c40263 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:00.600351 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2dcd1b70-a5f7-4d45-abb7-fce8f1c40263 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:01.164683 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2dcd1b70-a5f7-4d45-abb7-fce8f1c40263 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:01.180591 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2dcd1b70-a5f7-4d45-abb7-fce8f1c40263 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c" status: 200 len: 1495 microversion: 2.1 time: 0.605434 Oct 17 14:00:01.185958 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2596/5067] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:00 2022] GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c => generated 1495 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:02.215910 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0346250f-5246-4075-a288-f308e6c173e9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:02.221037 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0346250f-5246-4075-a288-f308e6c173e9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: b681678a-4240-4b9b-929b-65d09606a07c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:02.230428 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0346250f-5246-4075-a288-f308e6c173e9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:02.232006 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0346250f-5246-4075-a288-f308e6c173e9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:02.232668 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0346250f-5246-4075-a288-f308e6c173e9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:02.233749 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0346250f-5246-4075-a288-f308e6c173e9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:02.234449 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0346250f-5246-4075-a288-f308e6c173e9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:02.235154 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0346250f-5246-4075-a288-f308e6c173e9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:03.019973 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0346250f-5246-4075-a288-f308e6c173e9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:03.035218 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0346250f-5246-4075-a288-f308e6c173e9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c" status: 200 len: 1495 microversion: 2.1 time: 0.824920 Oct 17 14:00:03.043764 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2472/5068] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:02 2022] GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c => generated 1495 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:03.414958 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-8fb279c4-dd95-47c6-a544-7f5bdca297a3 req-ea5a6aa3-95e7-49bf-8a09-0af25317c2d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b681678a-4240-4b9b-929b-65d09606a07c", "name": "network-vif-deleted", "tag": "8c256d92-39ac-4a69-a1a4-94b93e3ae39d"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:00:03.437669 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-8fb279c4-dd95-47c6-a544-7f5bdca297a3 req-ea5a6aa3-95e7-49bf-8a09-0af25317c2d2 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:03.438246 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-8fb279c4-dd95-47c6-a544-7f5bdca297a3 req-ea5a6aa3-95e7-49bf-8a09-0af25317c2d2 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:03.445324 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-8fb279c4-dd95-47c6-a544-7f5bdca297a3 req-ea5a6aa3-95e7-49bf-8a09-0af25317c2d2 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:03.506891 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-8fb279c4-dd95-47c6-a544-7f5bdca297a3 req-ea5a6aa3-95e7-49bf-8a09-0af25317c2d2 service nova] Creating event network-vif-deleted:8c256d92-39ac-4a69-a1a4-94b93e3ae39d for instance b681678a-4240-4b9b-929b-65d09606a07c on n-h1-854247-14 Oct 17 14:00:03.525298 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-8fb279c4-dd95-47c6-a544-7f5bdca297a3 req-ea5a6aa3-95e7-49bf-8a09-0af25317c2d2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114555 Oct 17 14:00:03.526439 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2597/5069] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:00:04.071650 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ec6bd891-c772-4362-8b16-60dd84db4c58 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:04.074576 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ec6bd891-c772-4362-8b16-60dd84db4c58 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: b681678a-4240-4b9b-929b-65d09606a07c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:04.105725 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ec6bd891-c772-4362-8b16-60dd84db4c58 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:04.106415 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ec6bd891-c772-4362-8b16-60dd84db4c58 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:04.111546 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ec6bd891-c772-4362-8b16-60dd84db4c58 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:04.114434 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ec6bd891-c772-4362-8b16-60dd84db4c58 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:04.115099 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ec6bd891-c772-4362-8b16-60dd84db4c58 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:04.115595 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ec6bd891-c772-4362-8b16-60dd84db4c58 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:04.228074 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ec6bd891-c772-4362-8b16-60dd84db4c58 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:04.228479 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ec6bd891-c772-4362-8b16-60dd84db4c58 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:04.232410 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ec6bd891-c772-4362-8b16-60dd84db4c58 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:04.233030 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-ec6bd891-c772-4362-8b16-60dd84db4c58 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lazy-loading 'fault' on Instance uuid b681678a-4240-4b9b-929b-65d09606a07c {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:00:04.365467 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ec6bd891-c772-4362-8b16-60dd84db4c58 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:04.382025 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ec6bd891-c772-4362-8b16-60dd84db4c58 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c" status: 200 len: 1305 microversion: 2.1 time: 0.316268 Oct 17 14:00:04.384029 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2473/5070] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:04 2022] GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c => generated 1305 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:05.407830 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d880ad0c-446b-4225-8c96-29f1b7e5010f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:05.408535 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d880ad0c-446b-4225-8c96-29f1b7e5010f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: b681678a-4240-4b9b-929b-65d09606a07c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:05.410984 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:00:05.430720 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d880ad0c-446b-4225-8c96-29f1b7e5010f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:05.446556 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d880ad0c-446b-4225-8c96-29f1b7e5010f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:05.447495 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d880ad0c-446b-4225-8c96-29f1b7e5010f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:05.448467 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d880ad0c-446b-4225-8c96-29f1b7e5010f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:05.449103 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d880ad0c-446b-4225-8c96-29f1b7e5010f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:05.454345 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d880ad0c-446b-4225-8c96-29f1b7e5010f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:05.525956 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-d880ad0c-446b-4225-8c96-29f1b7e5010f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] HTTP exception thrown: Instance b681678a-4240-4b9b-929b-65d09606a07c could not be found. Oct 17 14:00:05.534173 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d880ad0c-446b-4225-8c96-29f1b7e5010f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Request method failure captured: Oct 17 14:00:05.534173 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c HTTP/1.1 Oct 17 14:00:05.534173 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 14:00:05.534173 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 14:00:05.534173 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 14:00:05.534173 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 14:00:05.534173 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 14:00:05.534173 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 14:00:05.534173 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 14:00:05.534173 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 14:00:05.534173 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTV7tIaoYPgUdHiXX4NOkSSz-a4-puhL4AhnfvtJYmPyZ3fJvZDePMat9BASboFCn4C3QP9Vix9f7JprJ7jGUAeFojqdhpTvVML9HYK6oQI67GVbo4xYwR8dQKhVTSdcdIj_O_mmBimo8N7A_DyW-iY_pgxFAaVGSJ3vOytCqm8fGt3Q Oct 17 14:00:05.534173 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 14:00:05.534173 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 14:00:05.534173 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 14:00:05.534173 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 14:00:05.534173 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 14:00:05.534173 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 14:00:05.534173 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 0821e5beffdd41c2ad2adbd1d03cde71 Oct 17 14:00:05.534173 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-DeleteServersTestJSON-930683239 Oct 17 14:00:05.534173 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 14:00:05.534173 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 14:00:05.534173 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "tempest-type-757843761", "name": "tempest-service-527072566", "endpoints": [{"region": "tempest-region-1530587473", "publicURL": "https://url-594098419.com"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "tempest-type-1549021290", "name": "tempest-service-1797883724", "endpoints": [{"region": "tempest-region-85075699", "internalURL": "https://url-259507820.com"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0821e5beffdd41c2ad2adbd1d03cde71", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "tempest-type-1413520904", "name": "tempest-service-1708200528", "endpoints": []}] Oct 17 14:00:05.534173 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-DeleteServersTestJSON-930683239 Oct 17 14:00:05.534173 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 0821e5beffdd41c2ad2adbd1d03cde71 Oct 17 14:00:05.534173 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-DeleteServersTestJSON-930683239 Oct 17 14:00:05.534173 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-DeleteServersTestJSON-930683239-project Oct 17 14:00:05.534173 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 14:00:05.534173 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 14:00:05.534173 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: ab8baeba1d494df5bb9cf4d7289410b9 Oct 17 14:00:05.534173 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-DeleteServersTestJSON-930683239-project Oct 17 14:00:05.534173 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 14:00:05.534173 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance b681678a-4240-4b9b-929b-65d09606a07c could not be found. Oct 17 14:00:05.534173 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'b681678a-4240-4b9b-929b-65d09606a07c'} Oct 17 14:00:05.534173 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:00:05.534173 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:00:05.534173 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:00:05.534173 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:00:05.534173 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:00:05.534173 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:00:05.534173 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:00:05.534173 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:00:05.534173 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:00:05.534173 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:00:05.534173 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b681678a-4240-4b9b-929b-65d09606a07c could not be found. Oct 17 14:00:05.534173 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:00:05.534173 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:00:05.534173 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:00:05.534173 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:00:05.534173 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:00:05.534173 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:00:05.534173 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:00:05.534173 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:00:05.534173 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:00:05.534173 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:00:05.534173 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:00:05.534173 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:00:05.534173 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:00:05.534173 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:00:05.534173 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:00:05.537287 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:00:05.537287 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b681678a-4240-4b9b-929b-65d09606a07c could not be found. Oct 17 14:00:05.537287 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:00:05.537287 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:00:05.537287 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:00:05.537287 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:00:05.537287 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:00:05.537287 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:00:05.537287 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:00:05.537287 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:00:05.537287 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b681678a-4240-4b9b-929b-65d09606a07c could not be found. Oct 17 14:00:05.537287 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:00:05.544414 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d880ad0c-446b-4225-8c96-29f1b7e5010f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Returning 404 to user: Instance b681678a-4240-4b9b-929b-65d09606a07c could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:00:05.552429 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d880ad0c-446b-4225-8c96-29f1b7e5010f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c" status: 404 len: 111 microversion: 2.1 time: 0.148298 Oct 17 14:00:05.556838 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2598/5071] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:05 2022] GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:00:05.877186 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-256c4381-14c7-4892-8216-e25148666d9d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1809968333", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "536c8c49-8501-4c2f-bf93-136c7f68a48c"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:00:06.024381 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-256c4381-14c7-4892-8216-e25148666d9d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] validate_networks() for [('536c8c49-8501-4c2f-bf93-136c7f68a48c', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:00:07.511233 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-256c4381-14c7-4892-8216-e25148666d9d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:00:07.511877 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-256c4381-14c7-4892-8216-e25148666d9d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:00:07.512380 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-256c4381-14c7-4892-8216-e25148666d9d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:00:07.513080 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-256c4381-14c7-4892-8216-e25148666d9d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:00:07.513869 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-256c4381-14c7-4892-8216-e25148666d9d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:00:07.526320 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-256c4381-14c7-4892-8216-e25148666d9d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:07.527301 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-256c4381-14c7-4892-8216-e25148666d9d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:07.528130 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-256c4381-14c7-4892-8216-e25148666d9d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:07.529308 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-256c4381-14c7-4892-8216-e25148666d9d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:07.530278 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-256c4381-14c7-4892-8216-e25148666d9d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:07.531086 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-256c4381-14c7-4892-8216-e25148666d9d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:07.558975 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-256c4381-14c7-4892-8216-e25148666d9d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Getting quotas for project 0821e5beffdd41c2ad2adbd1d03cde71. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:00:07.566402 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-256c4381-14c7-4892-8216-e25148666d9d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Getting quotas for user ab8baeba1d494df5bb9cf4d7289410b9 and project 0821e5beffdd41c2ad2adbd1d03cde71. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:00:07.584411 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-256c4381-14c7-4892-8216-e25148666d9d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:00:07.588170 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-256c4381-14c7-4892-8216-e25148666d9d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 1f49fdf3-9197-4092-933e-9101437e0141] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:00:07.668285 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-256c4381-14c7-4892-8216-e25148666d9d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.797511 Oct 17 14:00:07.669111 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2474/5072] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 14:00:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1799 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:00:07.681318 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-49851d37-0cdb-413c-9a1d-a87828d449d3 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:07.681921 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-49851d37-0cdb-413c-9a1d-a87828d449d3 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 1f49fdf3-9197-4092-933e-9101437e0141] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:07.943912 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-49851d37-0cdb-413c-9a1d-a87828d449d3 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:07.961381 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-49851d37-0cdb-413c-9a1d-a87828d449d3 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/1f49fdf3-9197-4092-933e-9101437e0141" status: 200 len: 1215 microversion: 2.1 time: 0.280941 Oct 17 14:00:07.962074 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2599/5073] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:07 2022] GET /compute/v2.1/servers/1f49fdf3-9197-4092-933e-9101437e0141 => generated 1215 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:08.985619 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-48e8f192-3282-4766-8cd4-22e2ebd1eb16 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:08.986298 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-48e8f192-3282-4766-8cd4-22e2ebd1eb16 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 1f49fdf3-9197-4092-933e-9101437e0141] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:09.008604 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48e8f192-3282-4766-8cd4-22e2ebd1eb16 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:09.009292 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48e8f192-3282-4766-8cd4-22e2ebd1eb16 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:09.010730 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48e8f192-3282-4766-8cd4-22e2ebd1eb16 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:09.011702 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48e8f192-3282-4766-8cd4-22e2ebd1eb16 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:09.012294 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48e8f192-3282-4766-8cd4-22e2ebd1eb16 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:09.012864 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48e8f192-3282-4766-8cd4-22e2ebd1eb16 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:09.162400 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-48e8f192-3282-4766-8cd4-22e2ebd1eb16 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:09.175109 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-48e8f192-3282-4766-8cd4-22e2ebd1eb16 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/1f49fdf3-9197-4092-933e-9101437e0141" status: 200 len: 1267 microversion: 2.1 time: 0.193804 Oct 17 14:00:09.177406 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2475/5074] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:08 2022] GET /compute/v2.1/servers/1f49fdf3-9197-4092-933e-9101437e0141 => generated 1267 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:10.212944 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-999f7925-de8a-40e0-b0bd-631cac53178e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:10.214271 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-999f7925-de8a-40e0-b0bd-631cac53178e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 1f49fdf3-9197-4092-933e-9101437e0141] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:10.231999 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-999f7925-de8a-40e0-b0bd-631cac53178e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:10.244011 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-999f7925-de8a-40e0-b0bd-631cac53178e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:10.245802 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-999f7925-de8a-40e0-b0bd-631cac53178e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:10.246969 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-999f7925-de8a-40e0-b0bd-631cac53178e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:10.247704 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-999f7925-de8a-40e0-b0bd-631cac53178e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:10.248353 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-999f7925-de8a-40e0-b0bd-631cac53178e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:10.452113 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-999f7925-de8a-40e0-b0bd-631cac53178e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:10.465552 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-999f7925-de8a-40e0-b0bd-631cac53178e tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/1f49fdf3-9197-4092-933e-9101437e0141" status: 200 len: 1273 microversion: 2.1 time: 0.256988 Oct 17 14:00:10.469612 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2600/5075] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:10 2022] GET /compute/v2.1/servers/1f49fdf3-9197-4092-933e-9101437e0141 => generated 1273 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:11.495707 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-84a2741a-250b-4dd4-b536-610ff2467132 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:11.497036 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-84a2741a-250b-4dd4-b536-610ff2467132 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 1f49fdf3-9197-4092-933e-9101437e0141] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:11.511062 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-84a2741a-250b-4dd4-b536-610ff2467132 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:11.515064 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-84a2741a-250b-4dd4-b536-610ff2467132 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:11.516350 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-84a2741a-250b-4dd4-b536-610ff2467132 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:11.518459 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-84a2741a-250b-4dd4-b536-610ff2467132 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:11.520706 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-84a2741a-250b-4dd4-b536-610ff2467132 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:11.521405 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-84a2741a-250b-4dd4-b536-610ff2467132 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:11.680630 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-84a2741a-250b-4dd4-b536-610ff2467132 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:11.697290 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-84a2741a-250b-4dd4-b536-610ff2467132 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/1f49fdf3-9197-4092-933e-9101437e0141" status: 200 len: 1273 microversion: 2.1 time: 0.201191 Oct 17 14:00:11.698318 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2476/5076] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:11 2022] GET /compute/v2.1/servers/1f49fdf3-9197-4092-933e-9101437e0141 => generated 1273 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:12.725644 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-afa0e0ec-a6d3-4397-972e-a15938e3d580 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:12.732061 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-afa0e0ec-a6d3-4397-972e-a15938e3d580 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 1f49fdf3-9197-4092-933e-9101437e0141] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:12.738433 n-d-854247-14 devstack@n-api.service[127016]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 14:00:12.738880 n-d-854247-14 devstack@n-api.service[127016]: Mon Oct 17 14:00:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1f49fdf3-9197-4092-933e-9101437e0141 (ip 10.222.0.79) !!! Oct 17 14:00:12.743604 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-afa0e0ec-a6d3-4397-972e-a15938e3d580 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:12.744401 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-afa0e0ec-a6d3-4397-972e-a15938e3d580 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:12.747431 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-afa0e0ec-a6d3-4397-972e-a15938e3d580 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:12.748391 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-afa0e0ec-a6d3-4397-972e-a15938e3d580 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:12.749101 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-afa0e0ec-a6d3-4397-972e-a15938e3d580 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:12.753239 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-afa0e0ec-a6d3-4397-972e-a15938e3d580 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:14.316093 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-afa0e0ec-a6d3-4397-972e-a15938e3d580 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:14.330335 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-afa0e0ec-a6d3-4397-972e-a15938e3d580 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/1f49fdf3-9197-4092-933e-9101437e0141" status: 200 len: 1315 microversion: 2.1 time: 1.609104 Oct 17 14:00:14.331564 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2601/5077] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:12 2022] GET /compute/v2.1/servers/1f49fdf3-9197-4092-933e-9101437e0141 => generated 1315 bytes in 1612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:15.354496 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4214582e-6fd5-46b4-b176-3fa219f39fbd tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:15.355753 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4214582e-6fd5-46b4-b176-3fa219f39fbd tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 1f49fdf3-9197-4092-933e-9101437e0141] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:15.362635 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:00:15.372955 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4214582e-6fd5-46b4-b176-3fa219f39fbd tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:15.373468 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4214582e-6fd5-46b4-b176-3fa219f39fbd tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:15.379645 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4214582e-6fd5-46b4-b176-3fa219f39fbd tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:15.380834 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4214582e-6fd5-46b4-b176-3fa219f39fbd tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:15.381328 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4214582e-6fd5-46b4-b176-3fa219f39fbd tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:15.382042 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4214582e-6fd5-46b4-b176-3fa219f39fbd tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:16.019965 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4214582e-6fd5-46b4-b176-3fa219f39fbd tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:16.033695 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4214582e-6fd5-46b4-b176-3fa219f39fbd tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/1f49fdf3-9197-4092-933e-9101437e0141" status: 200 len: 1315 microversion: 2.1 time: 0.682104 Oct 17 14:00:16.035092 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2477/5078] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:15 2022] GET /compute/v2.1/servers/1f49fdf3-9197-4092-933e-9101437e0141 => generated 1315 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:16.976347 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-d1c82cb8-509c-4af0-bc2a-28b32b9b612a req-48beafc9-df3c-49bb-86ed-d523dcbe3a13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f49fdf3-9197-4092-933e-9101437e0141", "tag": "cb7c12d9-56bd-48a8-8f2d-355b16bfb6ac"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:00:16.999157 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-d1c82cb8-509c-4af0-bc2a-28b32b9b612a req-48beafc9-df3c-49bb-86ed-d523dcbe3a13 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:17.006467 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-d1c82cb8-509c-4af0-bc2a-28b32b9b612a req-48beafc9-df3c-49bb-86ed-d523dcbe3a13 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:17.007189 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-d1c82cb8-509c-4af0-bc2a-28b32b9b612a req-48beafc9-df3c-49bb-86ed-d523dcbe3a13 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:17.020695 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-d1c82cb8-509c-4af0-bc2a-28b32b9b612a req-48beafc9-df3c-49bb-86ed-d523dcbe3a13 service nova] Creating event network-changed:cb7c12d9-56bd-48a8-8f2d-355b16bfb6ac for instance 1f49fdf3-9197-4092-933e-9101437e0141 on n-h1-854247-14 Oct 17 14:00:17.026849 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-d1c82cb8-509c-4af0-bc2a-28b32b9b612a req-48beafc9-df3c-49bb-86ed-d523dcbe3a13 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054422 Oct 17 14:00:17.028269 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2602/5079] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:00:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:00:17.068694 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-13198188-bd97-4389-9fe1-634e6fe6e2aa tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:17.071838 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-13198188-bd97-4389-9fe1-634e6fe6e2aa tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 1f49fdf3-9197-4092-933e-9101437e0141] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:17.124077 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-13198188-bd97-4389-9fe1-634e6fe6e2aa tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:17.125997 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-13198188-bd97-4389-9fe1-634e6fe6e2aa tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:17.127404 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-13198188-bd97-4389-9fe1-634e6fe6e2aa tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:17.132062 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-13198188-bd97-4389-9fe1-634e6fe6e2aa tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:17.133007 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-13198188-bd97-4389-9fe1-634e6fe6e2aa tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:17.133670 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-13198188-bd97-4389-9fe1-634e6fe6e2aa tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:17.548350 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:00:17.574979 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=6 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:00:17.775120 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-13198188-bd97-4389-9fe1-634e6fe6e2aa tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:17.811771 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-13198188-bd97-4389-9fe1-634e6fe6e2aa tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/1f49fdf3-9197-4092-933e-9101437e0141" status: 200 len: 1315 microversion: 2.1 time: 0.739065 Oct 17 14:00:17.817798 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2478/5080] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:17 2022] GET /compute/v2.1/servers/1f49fdf3-9197-4092-933e-9101437e0141 => generated 1315 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:18.845671 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f8270669-f82e-4517-be21-f508c44801f1 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:18.846528 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f8270669-f82e-4517-be21-f508c44801f1 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 1f49fdf3-9197-4092-933e-9101437e0141] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:18.849277 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:00:18.867542 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f8270669-f82e-4517-be21-f508c44801f1 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:18.870472 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f8270669-f82e-4517-be21-f508c44801f1 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:18.872245 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f8270669-f82e-4517-be21-f508c44801f1 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:18.874587 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f8270669-f82e-4517-be21-f508c44801f1 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:18.875241 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f8270669-f82e-4517-be21-f508c44801f1 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:18.877381 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f8270669-f82e-4517-be21-f508c44801f1 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:18.943640 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=74 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:00:19.301007 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f8270669-f82e-4517-be21-f508c44801f1 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:19.324507 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f8270669-f82e-4517-be21-f508c44801f1 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/1f49fdf3-9197-4092-933e-9101437e0141" status: 200 len: 1315 microversion: 2.1 time: 0.482650 Oct 17 14:00:19.329900 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2603/5081] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:18 2022] GET /compute/v2.1/servers/1f49fdf3-9197-4092-933e-9101437e0141 => generated 1315 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:19.610018 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f90fd5a4-2445-48c6-a9ef-8ab2a998559f tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-99605144", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": "none"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:00:19.745240 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-f90fd5a4-2445-48c6-a9ef-8ab2a998559f tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:00:19.745668 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-f90fd5a4-2445-48c6-a9ef-8ab2a998559f tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:00:19.746145 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-f90fd5a4-2445-48c6-a9ef-8ab2a998559f tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:00:19.746556 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-f90fd5a4-2445-48c6-a9ef-8ab2a998559f tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:00:19.748508 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-f90fd5a4-2445-48c6-a9ef-8ab2a998559f tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:00:19.771544 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f90fd5a4-2445-48c6-a9ef-8ab2a998559f tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:19.772738 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f90fd5a4-2445-48c6-a9ef-8ab2a998559f tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:19.773544 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f90fd5a4-2445-48c6-a9ef-8ab2a998559f tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:19.778693 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f90fd5a4-2445-48c6-a9ef-8ab2a998559f tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:19.784251 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f90fd5a4-2445-48c6-a9ef-8ab2a998559f tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:19.786919 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f90fd5a4-2445-48c6-a9ef-8ab2a998559f tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:19.829767 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-f90fd5a4-2445-48c6-a9ef-8ab2a998559f tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Getting quotas for project 1d1f35bc495c48689756cfd569e9dc25. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:00:19.835906 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-f90fd5a4-2445-48c6-a9ef-8ab2a998559f tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Getting quotas for user fb8feae002fb44d48de7958c91cb5c63 and project 1d1f35bc495c48689756cfd569e9dc25. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:00:19.874937 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f90fd5a4-2445-48c6-a9ef-8ab2a998559f tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:00:19.877417 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f90fd5a4-2445-48c6-a9ef-8ab2a998559f tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] [instance: fe428bfd-3882-4ad6-a7bd-ac5f3d965a85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:00:19.992775 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f90fd5a4-2445-48c6-a9ef-8ab2a998559f tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.930070 Oct 17 14:00:19.996511 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2479/5082] 10.222.0.79 () {62 vars in 1188 bytes} [Mon Oct 17 14:00:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 935 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 17 14:00:20.009600 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-500a8cb2-2c8c-4d65-9436-e75d0cf61a48 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:20.010894 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-500a8cb2-2c8c-4d65-9436-e75d0cf61a48 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] [instance: fe428bfd-3882-4ad6-a7bd-ac5f3d965a85] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:20.352495 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-10598ac6-2662-482f-a8a2-53be043b570f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:20.361621 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-10598ac6-2662-482f-a8a2-53be043b570f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 1f49fdf3-9197-4092-933e-9101437e0141] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:20.373228 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-10598ac6-2662-482f-a8a2-53be043b570f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:20.374867 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-10598ac6-2662-482f-a8a2-53be043b570f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:20.376455 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-10598ac6-2662-482f-a8a2-53be043b570f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:20.377252 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-10598ac6-2662-482f-a8a2-53be043b570f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:20.383398 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-10598ac6-2662-482f-a8a2-53be043b570f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:20.384980 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-10598ac6-2662-482f-a8a2-53be043b570f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:20.389378 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-500a8cb2-2c8c-4d65-9436-e75d0cf61a48 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:20.419534 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-500a8cb2-2c8c-4d65-9436-e75d0cf61a48 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:20.426872 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-500a8cb2-2c8c-4d65-9436-e75d0cf61a48 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:20.435549 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-500a8cb2-2c8c-4d65-9436-e75d0cf61a48 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] 10.222.0.79 "GET /compute/v2.1/servers/fe428bfd-3882-4ad6-a7bd-ac5f3d965a85" status: 200 len: 1276 microversion: 2.47 time: 0.425726 Oct 17 14:00:20.452997 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2604/5083] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:00:20 2022] GET /compute/v2.1/servers/fe428bfd-3882-4ad6-a7bd-ac5f3d965a85 => generated 1276 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:00:20.770009 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ff1ddc79-0e4c-42c5-a29f-f574d3d37a17 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1746691841", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": "none"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:00:20.859568 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-ff1ddc79-0e4c-42c5-a29f-f574d3d37a17 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:00:20.860321 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-ff1ddc79-0e4c-42c5-a29f-f574d3d37a17 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:00:20.861032 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-ff1ddc79-0e4c-42c5-a29f-f574d3d37a17 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:00:20.861777 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-ff1ddc79-0e4c-42c5-a29f-f574d3d37a17 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:00:20.862412 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-ff1ddc79-0e4c-42c5-a29f-f574d3d37a17 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:00:20.910751 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ff1ddc79-0e4c-42c5-a29f-f574d3d37a17 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:20.913853 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ff1ddc79-0e4c-42c5-a29f-f574d3d37a17 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:20.923043 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ff1ddc79-0e4c-42c5-a29f-f574d3d37a17 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:20.924341 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ff1ddc79-0e4c-42c5-a29f-f574d3d37a17 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:20.926347 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ff1ddc79-0e4c-42c5-a29f-f574d3d37a17 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:20.927452 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ff1ddc79-0e4c-42c5-a29f-f574d3d37a17 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:21.046240 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-ff1ddc79-0e4c-42c5-a29f-f574d3d37a17 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Getting quotas for project 1d1f35bc495c48689756cfd569e9dc25. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:00:21.068622 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-ff1ddc79-0e4c-42c5-a29f-f574d3d37a17 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Getting quotas for user fb8feae002fb44d48de7958c91cb5c63 and project 1d1f35bc495c48689756cfd569e9dc25. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:00:21.137976 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ff1ddc79-0e4c-42c5-a29f-f574d3d37a17 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:00:21.156105 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ff1ddc79-0e4c-42c5-a29f-f574d3d37a17 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] [instance: a60fd17a-8d63-4615-a521-c33db4273aeb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:00:21.327896 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ff1ddc79-0e4c-42c5-a29f-f574d3d37a17 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.564195 Oct 17 14:00:21.331413 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2605/5084] 10.222.0.79 () {62 vars in 1188 bytes} [Mon Oct 17 14:00:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 17 14:00:21.393484 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-28f15c67-67bb-4181-92c4-36a8398d128a tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:00:21.412984 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-28f15c67-67bb-4181-92c4-36a8398d128a tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] [instance: a60fd17a-8d63-4615-a521-c33db4273aeb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:21.513610 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-28f15c67-67bb-4181-92c4-36a8398d128a tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] 10.222.0.79 "PUT /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb" status: 200 len: 992 microversion: 2.47 time: 0.162674 Oct 17 14:00:21.518276 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2606/5085] 10.222.0.79 () {62 vars in 1297 bytes} [Mon Oct 17 14:00:21 2022] PUT /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb => generated 992 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:00:21.541875 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8533c4e8-95c6-4d82-b595-7c6f7c55e679 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:21.542809 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8533c4e8-95c6-4d82-b595-7c6f7c55e679 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] [instance: a60fd17a-8d63-4615-a521-c33db4273aeb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:22.729545 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8533c4e8-95c6-4d82-b595-7c6f7c55e679 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:22.746691 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8533c4e8-95c6-4d82-b595-7c6f7c55e679 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:22.752646 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8533c4e8-95c6-4d82-b595-7c6f7c55e679 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:22.753895 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8533c4e8-95c6-4d82-b595-7c6f7c55e679 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] 10.222.0.79 "GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb" status: 200 len: 1278 microversion: 2.47 time: 1.217894 Oct 17 14:00:22.771203 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2607/5086] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:00:21 2022] GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb => generated 1278 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:00:22.783093 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-10598ac6-2662-482f-a8a2-53be043b570f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:22.792835 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:00:22.800643 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-10598ac6-2662-482f-a8a2-53be043b570f tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/1f49fdf3-9197-4092-933e-9101437e0141" status: 200 len: 1315 microversion: 2.1 time: 2.453365 Oct 17 14:00:22.805974 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2480/5087] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:20 2022] GET /compute/v2.1/servers/1f49fdf3-9197-4092-933e-9101437e0141 => generated 1315 bytes in 2461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:00:23.792100 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-91e3f6ab-979d-4a13-9ce7-1e837919e0a5 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:23.794266 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-91e3f6ab-979d-4a13-9ce7-1e837919e0a5 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] [instance: a60fd17a-8d63-4615-a521-c33db4273aeb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:23.820967 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-91e3f6ab-979d-4a13-9ce7-1e837919e0a5 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:23.821496 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-91e3f6ab-979d-4a13-9ce7-1e837919e0a5 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:23.821945 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-91e3f6ab-979d-4a13-9ce7-1e837919e0a5 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:23.827005 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-91e3f6ab-979d-4a13-9ce7-1e837919e0a5 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:23.828034 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-91e3f6ab-979d-4a13-9ce7-1e837919e0a5 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:23.845004 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d435cbfd-e268-4aef-a7dc-ac528b7f3ec9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:23.849788 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d435cbfd-e268-4aef-a7dc-ac528b7f3ec9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 1f49fdf3-9197-4092-933e-9101437e0141] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:23.859086 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-91e3f6ab-979d-4a13-9ce7-1e837919e0a5 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:23.877142 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d435cbfd-e268-4aef-a7dc-ac528b7f3ec9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:23.877655 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d435cbfd-e268-4aef-a7dc-ac528b7f3ec9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:23.878095 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d435cbfd-e268-4aef-a7dc-ac528b7f3ec9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:23.890481 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d435cbfd-e268-4aef-a7dc-ac528b7f3ec9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:23.895008 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d435cbfd-e268-4aef-a7dc-ac528b7f3ec9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:23.898178 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d435cbfd-e268-4aef-a7dc-ac528b7f3ec9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:24.090897 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-91e3f6ab-979d-4a13-9ce7-1e837919e0a5 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:24.109498 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-91e3f6ab-979d-4a13-9ce7-1e837919e0a5 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:24.120274 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-91e3f6ab-979d-4a13-9ce7-1e837919e0a5 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:24.135664 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-91e3f6ab-979d-4a13-9ce7-1e837919e0a5 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] 10.222.0.79 "GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb" status: 200 len: 1274 microversion: 2.47 time: 0.347234 Oct 17 14:00:24.136338 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2608/5088] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:00:23 2022] GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb => generated 1274 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:00:24.320435 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d435cbfd-e268-4aef-a7dc-ac528b7f3ec9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:24.334456 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d435cbfd-e268-4aef-a7dc-ac528b7f3ec9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/1f49fdf3-9197-4092-933e-9101437e0141" status: 200 len: 1315 microversion: 2.1 time: 0.503977 Oct 17 14:00:24.341269 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2481/5089] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:23 2022] GET /compute/v2.1/servers/1f49fdf3-9197-4092-933e-9101437e0141 => generated 1315 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:00:25.167337 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9729f126-d8c4-4490-a8f4-d714359b7dd7 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:25.168002 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9729f126-d8c4-4490-a8f4-d714359b7dd7 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] [instance: a60fd17a-8d63-4615-a521-c33db4273aeb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:25.181406 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9729f126-d8c4-4490-a8f4-d714359b7dd7 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:25.181913 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9729f126-d8c4-4490-a8f4-d714359b7dd7 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:25.196177 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9729f126-d8c4-4490-a8f4-d714359b7dd7 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:25.199074 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9729f126-d8c4-4490-a8f4-d714359b7dd7 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:25.206279 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9729f126-d8c4-4490-a8f4-d714359b7dd7 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:25.243849 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9729f126-d8c4-4490-a8f4-d714359b7dd7 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:25.363049 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1698d9dd-0229-48d8-ba02-5e920471e0de tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:25.364477 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1698d9dd-0229-48d8-ba02-5e920471e0de tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 1f49fdf3-9197-4092-933e-9101437e0141] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:25.379930 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1698d9dd-0229-48d8-ba02-5e920471e0de tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:25.380670 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1698d9dd-0229-48d8-ba02-5e920471e0de tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:25.381338 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1698d9dd-0229-48d8-ba02-5e920471e0de tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:25.382398 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1698d9dd-0229-48d8-ba02-5e920471e0de tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:25.383044 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1698d9dd-0229-48d8-ba02-5e920471e0de tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:25.383876 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1698d9dd-0229-48d8-ba02-5e920471e0de tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:25.505299 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9729f126-d8c4-4490-a8f4-d714359b7dd7 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:25.520790 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9729f126-d8c4-4490-a8f4-d714359b7dd7 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:25.523478 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9729f126-d8c4-4490-a8f4-d714359b7dd7 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:25.524840 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9729f126-d8c4-4490-a8f4-d714359b7dd7 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] 10.222.0.79 "GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb" status: 200 len: 1348 microversion: 2.47 time: 0.361597 Oct 17 14:00:25.526125 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2609/5090] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:00:25 2022] GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb => generated 1348 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:00:25.660043 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1698d9dd-0229-48d8-ba02-5e920471e0de tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:25.674379 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1698d9dd-0229-48d8-ba02-5e920471e0de tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/1f49fdf3-9197-4092-933e-9101437e0141" status: 200 len: 1315 microversion: 2.1 time: 0.318844 Oct 17 14:00:25.687849 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2482/5091] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:25 2022] GET /compute/v2.1/servers/1f49fdf3-9197-4092-933e-9101437e0141 => generated 1315 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:00:25.763002 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c7a8ee23-55d0-4e4b-82da-11539780bce6 tempest-ExtensionsTest-1344636832 tempest-ExtensionsTest-1344636832-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:25.764692 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c7a8ee23-55d0-4e4b-82da-11539780bce6 tempest-ExtensionsTest-1344636832 tempest-ExtensionsTest-1344636832-project] 10.222.0.79 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.237372 Oct 17 14:00:25.765555 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2610/5092] 10.222.0.79 () {58 vars in 1170 bytes} [Mon Oct 17 14:00:25 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:00:25.775819 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4b4b3385-785e-403b-ba57-9e5e08ff7fe7 tempest-ExtensionsTest-1344636832 tempest-ExtensionsTest-1344636832-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:25.778103 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4b4b3385-785e-403b-ba57-9e5e08ff7fe7 tempest-ExtensionsTest-1344636832 tempest-ExtensionsTest-1344636832-project] 10.222.0.79 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.006557 Oct 17 14:00:25.779392 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2483/5093] 10.222.0.79 () {58 vars in 1134 bytes} [Mon Oct 17 14:00:25 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:00:26.413756 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-bd063fbd-8dff-4479-a19f-90c911357ba7 req-2588c6e8-b394-4908-bf48-cc483122a70b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f49fdf3-9197-4092-933e-9101437e0141", "name": "network-vif-plugged", "status": "completed", "tag": "cb7c12d9-56bd-48a8-8f2d-355b16bfb6ac"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:00:26.446239 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-bd063fbd-8dff-4479-a19f-90c911357ba7 req-2588c6e8-b394-4908-bf48-cc483122a70b service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:26.461331 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-bd063fbd-8dff-4479-a19f-90c911357ba7 req-2588c6e8-b394-4908-bf48-cc483122a70b service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:26.462598 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-bd063fbd-8dff-4479-a19f-90c911357ba7 req-2588c6e8-b394-4908-bf48-cc483122a70b service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:26.481080 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-bd063fbd-8dff-4479-a19f-90c911357ba7 req-2588c6e8-b394-4908-bf48-cc483122a70b service nova] Creating event network-vif-plugged:cb7c12d9-56bd-48a8-8f2d-355b16bfb6ac for instance 1f49fdf3-9197-4092-933e-9101437e0141 on n-h1-854247-14 Oct 17 14:00:26.489543 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-bd063fbd-8dff-4479-a19f-90c911357ba7 req-2588c6e8-b394-4908-bf48-cc483122a70b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082806 Oct 17 14:00:26.490937 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2611/5094] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:00:26.555828 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f19321b7-2681-4c11-98f5-7caebf3894fb tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:26.557044 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f19321b7-2681-4c11-98f5-7caebf3894fb tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] [instance: a60fd17a-8d63-4615-a521-c33db4273aeb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:26.576763 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f19321b7-2681-4c11-98f5-7caebf3894fb tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:26.580898 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f19321b7-2681-4c11-98f5-7caebf3894fb tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:26.582189 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f19321b7-2681-4c11-98f5-7caebf3894fb tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:26.583120 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f19321b7-2681-4c11-98f5-7caebf3894fb tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:26.583774 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f19321b7-2681-4c11-98f5-7caebf3894fb tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:26.585863 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f19321b7-2681-4c11-98f5-7caebf3894fb tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:26.701742 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cf50570a-014d-4525-aa71-a890d5081efa tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:26.702821 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cf50570a-014d-4525-aa71-a890d5081efa tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 1f49fdf3-9197-4092-933e-9101437e0141] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:26.712841 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cf50570a-014d-4525-aa71-a890d5081efa tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:26.713626 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cf50570a-014d-4525-aa71-a890d5081efa tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:26.714592 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cf50570a-014d-4525-aa71-a890d5081efa tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:26.716045 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cf50570a-014d-4525-aa71-a890d5081efa tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:26.716662 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cf50570a-014d-4525-aa71-a890d5081efa tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:26.717457 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cf50570a-014d-4525-aa71-a890d5081efa tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:27.036677 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f19321b7-2681-4c11-98f5-7caebf3894fb tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:27.056564 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f19321b7-2681-4c11-98f5-7caebf3894fb tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:27.067592 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f19321b7-2681-4c11-98f5-7caebf3894fb tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:27.070553 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f19321b7-2681-4c11-98f5-7caebf3894fb tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] 10.222.0.79 "GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb" status: 200 len: 1336 microversion: 2.47 time: 0.520572 Oct 17 14:00:27.078676 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2484/5095] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:00:26 2022] GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb => generated 1336 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:00:27.382280 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cf50570a-014d-4525-aa71-a890d5081efa tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:27.392714 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cf50570a-014d-4525-aa71-a890d5081efa tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/1f49fdf3-9197-4092-933e-9101437e0141" status: 200 len: 1315 microversion: 2.1 time: 0.697950 Oct 17 14:00:27.393335 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2612/5096] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:26 2022] GET /compute/v2.1/servers/1f49fdf3-9197-4092-933e-9101437e0141 => generated 1315 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:28.107956 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d7d5db8e-5960-47e3-800e-bfc372836e3d tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:28.108722 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d7d5db8e-5960-47e3-800e-bfc372836e3d tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] [instance: a60fd17a-8d63-4615-a521-c33db4273aeb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:28.119822 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d7d5db8e-5960-47e3-800e-bfc372836e3d tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:28.120327 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d7d5db8e-5960-47e3-800e-bfc372836e3d tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:28.120781 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d7d5db8e-5960-47e3-800e-bfc372836e3d tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:28.121523 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d7d5db8e-5960-47e3-800e-bfc372836e3d tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:28.121984 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d7d5db8e-5960-47e3-800e-bfc372836e3d tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:28.133092 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d7d5db8e-5960-47e3-800e-bfc372836e3d tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:28.424498 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d7d5db8e-5960-47e3-800e-bfc372836e3d tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:28.430735 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a57775b3-bcdb-450c-b932-756268a34d9d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:28.432129 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a57775b3-bcdb-450c-b932-756268a34d9d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 1f49fdf3-9197-4092-933e-9101437e0141] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:28.449652 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d7d5db8e-5960-47e3-800e-bfc372836e3d tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:28.459242 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a57775b3-bcdb-450c-b932-756268a34d9d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:28.459774 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a57775b3-bcdb-450c-b932-756268a34d9d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:28.460169 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a57775b3-bcdb-450c-b932-756268a34d9d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:28.460530 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d7d5db8e-5960-47e3-800e-bfc372836e3d tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:28.462875 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a57775b3-bcdb-450c-b932-756268a34d9d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:28.463542 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a57775b3-bcdb-450c-b932-756268a34d9d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:28.463875 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d7d5db8e-5960-47e3-800e-bfc372836e3d tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] 10.222.0.79 "GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb" status: 200 len: 1357 microversion: 2.47 time: 0.358652 Oct 17 14:00:28.464640 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2485/5097] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:00:28 2022] GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb => generated 1357 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:00:28.465263 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a57775b3-bcdb-450c-b932-756268a34d9d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:28.498722 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b623865d-9791-44df-9457-d88114fc7f31 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:00:28.501961 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b623865d-9791-44df-9457-d88114fc7f31 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] [instance: a60fd17a-8d63-4615-a521-c33db4273aeb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:28.540285 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b623865d-9791-44df-9457-d88114fc7f31 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:28.540829 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b623865d-9791-44df-9457-d88114fc7f31 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:28.541288 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b623865d-9791-44df-9457-d88114fc7f31 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:28.550429 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b623865d-9791-44df-9457-d88114fc7f31 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:28.550933 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b623865d-9791-44df-9457-d88114fc7f31 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:28.551414 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b623865d-9791-44df-9457-d88114fc7f31 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:28.765271 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-b623865d-9791-44df-9457-d88114fc7f31 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:00:28.765703 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-b623865d-9791-44df-9457-d88114fc7f31 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:00:28.766415 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-b623865d-9791-44df-9457-d88114fc7f31 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:00:28.774155 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-b623865d-9791-44df-9457-d88114fc7f31 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:00:28.774701 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-b623865d-9791-44df-9457-d88114fc7f31 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:00:28.973625 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b623865d-9791-44df-9457-d88114fc7f31 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] [instance: a60fd17a-8d63-4615-a521-c33db4273aeb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:29.000723 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b623865d-9791-44df-9457-d88114fc7f31 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:29.009786 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b623865d-9791-44df-9457-d88114fc7f31 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:29.012785 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b623865d-9791-44df-9457-d88114fc7f31 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:29.013526 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b623865d-9791-44df-9457-d88114fc7f31 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:29.013997 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b623865d-9791-44df-9457-d88114fc7f31 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:29.014432 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b623865d-9791-44df-9457-d88114fc7f31 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:29.160542 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b623865d-9791-44df-9457-d88114fc7f31 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] 10.222.0.79 "POST /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb/action" status: 202 len: 1079 microversion: 2.47 time: 0.664183 Oct 17 14:00:29.173785 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2486/5098] 10.222.0.79 () {62 vars in 1319 bytes} [Mon Oct 17 14:00:28 2022] POST /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb/action => generated 1079 bytes in 680 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Oct 17 14:00:29.217097 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-089f3b76-ae6b-41af-a059-9192420eee04 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:29.218313 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-089f3b76-ae6b-41af-a059-9192420eee04 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] [instance: a60fd17a-8d63-4615-a521-c33db4273aeb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:29.231229 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-089f3b76-ae6b-41af-a059-9192420eee04 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:29.245193 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-089f3b76-ae6b-41af-a059-9192420eee04 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:29.246124 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-089f3b76-ae6b-41af-a059-9192420eee04 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:29.247099 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-089f3b76-ae6b-41af-a059-9192420eee04 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:29.250594 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-089f3b76-ae6b-41af-a059-9192420eee04 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:29.253213 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-089f3b76-ae6b-41af-a059-9192420eee04 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:29.366574 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a57775b3-bcdb-450c-b932-756268a34d9d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:29.378689 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a57775b3-bcdb-450c-b932-756268a34d9d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/1f49fdf3-9197-4092-933e-9101437e0141" status: 200 len: 1503 microversion: 2.1 time: 0.958966 Oct 17 14:00:29.393804 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2613/5099] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:28 2022] GET /compute/v2.1/servers/1f49fdf3-9197-4092-933e-9101437e0141 => generated 1503 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:29.412893 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-93f443f6-7f71-4be9-aeaa-792d1abd2e4d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:00:29.414562 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-93f443f6-7f71-4be9-aeaa-792d1abd2e4d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 1f49fdf3-9197-4092-933e-9101437e0141] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:29.460415 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-93f443f6-7f71-4be9-aeaa-792d1abd2e4d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:29.462370 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-93f443f6-7f71-4be9-aeaa-792d1abd2e4d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:29.463430 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-93f443f6-7f71-4be9-aeaa-792d1abd2e4d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:29.464319 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-93f443f6-7f71-4be9-aeaa-792d1abd2e4d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:29.465445 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-93f443f6-7f71-4be9-aeaa-792d1abd2e4d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:29.467787 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-93f443f6-7f71-4be9-aeaa-792d1abd2e4d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:29.481236 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-089f3b76-ae6b-41af-a059-9192420eee04 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:29.499851 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-089f3b76-ae6b-41af-a059-9192420eee04 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:29.504780 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-089f3b76-ae6b-41af-a059-9192420eee04 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:29.509515 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-089f3b76-ae6b-41af-a059-9192420eee04 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] 10.222.0.79 "GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb" status: 200 len: 1366 microversion: 2.47 time: 0.310669 Oct 17 14:00:29.527438 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2487/5100] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:00:29 2022] GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb => generated 1366 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:00:29.546364 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-93f443f6-7f71-4be9-aeaa-792d1abd2e4d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lazy-loading 'flavor' on Instance uuid 1f49fdf3-9197-4092-933e-9101437e0141 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:00:29.720285 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-93f443f6-7f71-4be9-aeaa-792d1abd2e4d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "POST /compute/v2.1/servers/1f49fdf3-9197-4092-933e-9101437e0141/action" status: 202 len: 0 microversion: 2.1 time: 0.317081 Oct 17 14:00:29.726171 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2614/5101] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:00:29 2022] POST /compute/v2.1/servers/1f49fdf3-9197-4092-933e-9101437e0141/action => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:00:29.731470 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9025d29f-9a75-4e25-a504-d12171effc15 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:29.731647 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9025d29f-9a75-4e25-a504-d12171effc15 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 1f49fdf3-9197-4092-933e-9101437e0141] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:29.744850 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9025d29f-9a75-4e25-a504-d12171effc15 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:29.745375 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9025d29f-9a75-4e25-a504-d12171effc15 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:29.755304 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9025d29f-9a75-4e25-a504-d12171effc15 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:29.756260 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9025d29f-9a75-4e25-a504-d12171effc15 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:29.756757 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9025d29f-9a75-4e25-a504-d12171effc15 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:29.757203 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9025d29f-9a75-4e25-a504-d12171effc15 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:29.820288 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:00:29.857599 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=6 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:00:30.085239 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9025d29f-9a75-4e25-a504-d12171effc15 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:30.096253 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9025d29f-9a75-4e25-a504-d12171effc15 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/1f49fdf3-9197-4092-933e-9101437e0141" status: 200 len: 1511 microversion: 2.1 time: 0.369849 Oct 17 14:00:30.096842 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2488/5102] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:29 2022] GET /compute/v2.1/servers/1f49fdf3-9197-4092-933e-9101437e0141 => generated 1511 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:00:30.544361 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4a29217d-dab8-4945-a220-272720530690 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:30.545890 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4a29217d-dab8-4945-a220-272720530690 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] [instance: a60fd17a-8d63-4615-a521-c33db4273aeb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:30.564251 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4a29217d-dab8-4945-a220-272720530690 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:30.565056 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4a29217d-dab8-4945-a220-272720530690 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:30.569498 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4a29217d-dab8-4945-a220-272720530690 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:30.569498 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4a29217d-dab8-4945-a220-272720530690 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:30.570044 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4a29217d-dab8-4945-a220-272720530690 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:30.570619 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4a29217d-dab8-4945-a220-272720530690 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:30.700073 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4a29217d-dab8-4945-a220-272720530690 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:30.710511 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4a29217d-dab8-4945-a220-272720530690 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:30.711996 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4a29217d-dab8-4945-a220-272720530690 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:30.713196 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4a29217d-dab8-4945-a220-272720530690 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] 10.222.0.79 "GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb" status: 200 len: 1366 microversion: 2.47 time: 0.174829 Oct 17 14:00:30.713767 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2615/5103] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:00:30 2022] GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:00:31.126031 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1eead309-d50c-4228-838d-453769fa966d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:31.133128 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1eead309-d50c-4228-838d-453769fa966d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 1f49fdf3-9197-4092-933e-9101437e0141] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:31.178319 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1eead309-d50c-4228-838d-453769fa966d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:31.178825 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1eead309-d50c-4228-838d-453769fa966d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:31.181248 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1eead309-d50c-4228-838d-453769fa966d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:31.182587 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1eead309-d50c-4228-838d-453769fa966d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:31.184376 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1eead309-d50c-4228-838d-453769fa966d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:31.185447 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1eead309-d50c-4228-838d-453769fa966d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:31.745229 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f771ffb8-e30e-470b-98f1-23ca8cc2bf4e tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:31.745863 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f771ffb8-e30e-470b-98f1-23ca8cc2bf4e tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] [instance: a60fd17a-8d63-4615-a521-c33db4273aeb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:31.748180 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:00:31.760797 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f771ffb8-e30e-470b-98f1-23ca8cc2bf4e tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:31.761294 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f771ffb8-e30e-470b-98f1-23ca8cc2bf4e tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:31.764905 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1eead309-d50c-4228-838d-453769fa966d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:31.768151 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f771ffb8-e30e-470b-98f1-23ca8cc2bf4e tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:31.769094 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f771ffb8-e30e-470b-98f1-23ca8cc2bf4e tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:31.769556 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f771ffb8-e30e-470b-98f1-23ca8cc2bf4e tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:31.770140 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f771ffb8-e30e-470b-98f1-23ca8cc2bf4e tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:31.775838 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1eead309-d50c-4228-838d-453769fa966d tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/1f49fdf3-9197-4092-933e-9101437e0141" status: 200 len: 1494 microversion: 2.1 time: 0.656418 Oct 17 14:00:31.776451 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2489/5104] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:31 2022] GET /compute/v2.1/servers/1f49fdf3-9197-4092-933e-9101437e0141 => generated 1494 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:31.802994 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c11c02c0-7275-4f84-bdcf-d59d673f4b27 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:31.803840 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c11c02c0-7275-4f84-bdcf-d59d673f4b27 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 1f49fdf3-9197-4092-933e-9101437e0141] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:31.820578 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c11c02c0-7275-4f84-bdcf-d59d673f4b27 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:31.821470 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c11c02c0-7275-4f84-bdcf-d59d673f4b27 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:31.822095 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c11c02c0-7275-4f84-bdcf-d59d673f4b27 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:31.822864 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c11c02c0-7275-4f84-bdcf-d59d673f4b27 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:31.823358 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c11c02c0-7275-4f84-bdcf-d59d673f4b27 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:31.823788 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c11c02c0-7275-4f84-bdcf-d59d673f4b27 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:31.880796 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c11c02c0-7275-4f84-bdcf-d59d673f4b27 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 1f49fdf3-9197-4092-933e-9101437e0141] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:00:31.909017 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f771ffb8-e30e-470b-98f1-23ca8cc2bf4e tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:31.924058 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f771ffb8-e30e-470b-98f1-23ca8cc2bf4e tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:31.925487 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f771ffb8-e30e-470b-98f1-23ca8cc2bf4e tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:31.927160 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f771ffb8-e30e-470b-98f1-23ca8cc2bf4e tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] 10.222.0.79 "GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb" status: 200 len: 1366 microversion: 2.47 time: 0.186017 Oct 17 14:00:31.928243 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2616/5105] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:00:31 2022] GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 14:00:32.032059 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c11c02c0-7275-4f84-bdcf-d59d673f4b27 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "DELETE /compute/v2.1/servers/1f49fdf3-9197-4092-933e-9101437e0141" status: 204 len: 0 microversion: 2.1 time: 0.228493 Oct 17 14:00:32.036018 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2490/5106] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:00:31 2022] DELETE /compute/v2.1/servers/1f49fdf3-9197-4092-933e-9101437e0141 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 14:00:32.047130 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-471395f1-cde1-4946-94d3-ecae073cdfb8 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:32.048666 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-471395f1-cde1-4946-94d3-ecae073cdfb8 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 1f49fdf3-9197-4092-933e-9101437e0141] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:32.063366 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-471395f1-cde1-4946-94d3-ecae073cdfb8 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:32.063822 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-471395f1-cde1-4946-94d3-ecae073cdfb8 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:32.064358 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-471395f1-cde1-4946-94d3-ecae073cdfb8 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:32.065623 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-471395f1-cde1-4946-94d3-ecae073cdfb8 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:32.066901 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-471395f1-cde1-4946-94d3-ecae073cdfb8 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:32.067822 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-471395f1-cde1-4946-94d3-ecae073cdfb8 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:32.683211 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-471395f1-cde1-4946-94d3-ecae073cdfb8 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:32.694519 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-471395f1-cde1-4946-94d3-ecae073cdfb8 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/1f49fdf3-9197-4092-933e-9101437e0141" status: 200 len: 1500 microversion: 2.1 time: 0.655330 Oct 17 14:00:32.695344 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2617/5107] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:32 2022] GET /compute/v2.1/servers/1f49fdf3-9197-4092-933e-9101437e0141 => generated 1500 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:32.961524 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5f1fd792-2f0e-4906-9796-43b947a5c6fb tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:32.962848 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5f1fd792-2f0e-4906-9796-43b947a5c6fb tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] [instance: a60fd17a-8d63-4615-a521-c33db4273aeb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:32.978032 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5f1fd792-2f0e-4906-9796-43b947a5c6fb tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:32.979948 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5f1fd792-2f0e-4906-9796-43b947a5c6fb tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:32.983934 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5f1fd792-2f0e-4906-9796-43b947a5c6fb tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:32.988773 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5f1fd792-2f0e-4906-9796-43b947a5c6fb tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:32.990117 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5f1fd792-2f0e-4906-9796-43b947a5c6fb tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:32.992378 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5f1fd792-2f0e-4906-9796-43b947a5c6fb tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:33.298349 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5f1fd792-2f0e-4906-9796-43b947a5c6fb tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:33.309135 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5f1fd792-2f0e-4906-9796-43b947a5c6fb tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:33.311994 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5f1fd792-2f0e-4906-9796-43b947a5c6fb tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:33.314453 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5f1fd792-2f0e-4906-9796-43b947a5c6fb tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] 10.222.0.79 "GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb" status: 200 len: 1366 microversion: 2.47 time: 0.361454 Oct 17 14:00:33.316127 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2491/5108] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:00:32 2022] GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb => generated 1366 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:00:33.721603 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-17d7ef61-00ac-4e2e-917b-1061ed5daca1 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:33.722333 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-17d7ef61-00ac-4e2e-917b-1061ed5daca1 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 1f49fdf3-9197-4092-933e-9101437e0141] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:33.731374 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=10 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:00:33.733563 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-17d7ef61-00ac-4e2e-917b-1061ed5daca1 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:33.738298 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-17d7ef61-00ac-4e2e-917b-1061ed5daca1 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:33.751328 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-17d7ef61-00ac-4e2e-917b-1061ed5daca1 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:33.752868 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-17d7ef61-00ac-4e2e-917b-1061ed5daca1 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:33.757009 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-17d7ef61-00ac-4e2e-917b-1061ed5daca1 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:33.757461 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-17d7ef61-00ac-4e2e-917b-1061ed5daca1 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:34.350250 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e71afaef-58fe-4d12-89f0-f73cf02e77f1 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:34.351748 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e71afaef-58fe-4d12-89f0-f73cf02e77f1 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] [instance: a60fd17a-8d63-4615-a521-c33db4273aeb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:34.362933 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e71afaef-58fe-4d12-89f0-f73cf02e77f1 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:34.365577 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e71afaef-58fe-4d12-89f0-f73cf02e77f1 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:34.366600 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e71afaef-58fe-4d12-89f0-f73cf02e77f1 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:34.368168 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e71afaef-58fe-4d12-89f0-f73cf02e77f1 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:34.368817 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e71afaef-58fe-4d12-89f0-f73cf02e77f1 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:34.369363 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e71afaef-58fe-4d12-89f0-f73cf02e77f1 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:34.402279 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-17d7ef61-00ac-4e2e-917b-1061ed5daca1 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:34.424603 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-17d7ef61-00ac-4e2e-917b-1061ed5daca1 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/1f49fdf3-9197-4092-933e-9101437e0141" status: 200 len: 1500 microversion: 2.1 time: 0.707758 Oct 17 14:00:34.426234 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2618/5109] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:33 2022] GET /compute/v2.1/servers/1f49fdf3-9197-4092-933e-9101437e0141 => generated 1500 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:34.540218 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e71afaef-58fe-4d12-89f0-f73cf02e77f1 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:34.552876 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e71afaef-58fe-4d12-89f0-f73cf02e77f1 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:34.556152 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e71afaef-58fe-4d12-89f0-f73cf02e77f1 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:34.560179 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e71afaef-58fe-4d12-89f0-f73cf02e77f1 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] 10.222.0.79 "GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb" status: 200 len: 1366 microversion: 2.47 time: 0.219093 Oct 17 14:00:34.560966 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2492/5110] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:00:34 2022] GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 14:00:35.058153 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-755c9384-4069-49b5-b39e-d767cc06f3cf req-173eab80-6fb6-47ee-8231-df2866b21ffe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f49fdf3-9197-4092-933e-9101437e0141", "name": "network-vif-deleted", "tag": "cb7c12d9-56bd-48a8-8f2d-355b16bfb6ac"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:00:35.109214 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-755c9384-4069-49b5-b39e-d767cc06f3cf req-173eab80-6fb6-47ee-8231-df2866b21ffe service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:35.110190 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-755c9384-4069-49b5-b39e-d767cc06f3cf req-173eab80-6fb6-47ee-8231-df2866b21ffe service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:35.112405 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-755c9384-4069-49b5-b39e-d767cc06f3cf req-173eab80-6fb6-47ee-8231-df2866b21ffe service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:35.156769 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-755c9384-4069-49b5-b39e-d767cc06f3cf req-173eab80-6fb6-47ee-8231-df2866b21ffe service nova] Creating event network-vif-deleted:cb7c12d9-56bd-48a8-8f2d-355b16bfb6ac for instance 1f49fdf3-9197-4092-933e-9101437e0141 on n-h1-854247-14 Oct 17 14:00:35.171971 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-755c9384-4069-49b5-b39e-d767cc06f3cf req-173eab80-6fb6-47ee-8231-df2866b21ffe service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122375 Oct 17 14:00:35.173485 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2619/5111] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:00:35.452846 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3476b0e9-494e-4acb-8afc-5145d5098821 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:35.454444 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3476b0e9-494e-4acb-8afc-5145d5098821 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 1f49fdf3-9197-4092-933e-9101437e0141] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:35.482808 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3476b0e9-494e-4acb-8afc-5145d5098821 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:35.485881 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3476b0e9-494e-4acb-8afc-5145d5098821 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:35.486583 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3476b0e9-494e-4acb-8afc-5145d5098821 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:35.488844 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3476b0e9-494e-4acb-8afc-5145d5098821 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:35.490404 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3476b0e9-494e-4acb-8afc-5145d5098821 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:35.497298 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3476b0e9-494e-4acb-8afc-5145d5098821 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:35.586772 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3476b0e9-494e-4acb-8afc-5145d5098821 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:35.588083 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3476b0e9-494e-4acb-8afc-5145d5098821 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:35.588591 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3476b0e9-494e-4acb-8afc-5145d5098821 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:35.589173 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-3476b0e9-494e-4acb-8afc-5145d5098821 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lazy-loading 'fault' on Instance uuid 1f49fdf3-9197-4092-933e-9101437e0141 {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:00:35.590116 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-052062d4-b340-4d17-b9ff-6dfe0eabb479 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:35.590845 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-052062d4-b340-4d17-b9ff-6dfe0eabb479 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] [instance: a60fd17a-8d63-4615-a521-c33db4273aeb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:35.601715 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:00:35.611794 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-052062d4-b340-4d17-b9ff-6dfe0eabb479 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:35.612397 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-052062d4-b340-4d17-b9ff-6dfe0eabb479 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:35.612845 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-052062d4-b340-4d17-b9ff-6dfe0eabb479 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:35.614536 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-052062d4-b340-4d17-b9ff-6dfe0eabb479 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:35.615001 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-052062d4-b340-4d17-b9ff-6dfe0eabb479 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:35.615461 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-052062d4-b340-4d17-b9ff-6dfe0eabb479 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:35.711384 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3476b0e9-494e-4acb-8afc-5145d5098821 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8baeba1d494df5bb9cf4d7289410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0821e5beffdd41c2ad2adbd1d03cde71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:35.720763 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3476b0e9-494e-4acb-8afc-5145d5098821 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/1f49fdf3-9197-4092-933e-9101437e0141" status: 200 len: 1305 microversion: 2.1 time: 0.271765 Oct 17 14:00:35.725206 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2493/5112] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:35 2022] GET /compute/v2.1/servers/1f49fdf3-9197-4092-933e-9101437e0141 => generated 1305 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:35.785893 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-052062d4-b340-4d17-b9ff-6dfe0eabb479 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:35.800787 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-052062d4-b340-4d17-b9ff-6dfe0eabb479 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:35.802523 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-052062d4-b340-4d17-b9ff-6dfe0eabb479 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:35.804064 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-052062d4-b340-4d17-b9ff-6dfe0eabb479 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] 10.222.0.79 "GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb" status: 200 len: 1366 microversion: 2.47 time: 0.218530 Oct 17 14:00:35.809303 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2620/5113] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:00:35 2022] GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 14:00:36.749253 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5ec5be9e-5944-4b0c-b9ca-986f84867c85 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:36.750704 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5ec5be9e-5944-4b0c-b9ca-986f84867c85 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 1f49fdf3-9197-4092-933e-9101437e0141] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:36.765926 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5ec5be9e-5944-4b0c-b9ca-986f84867c85 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:36.766890 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5ec5be9e-5944-4b0c-b9ca-986f84867c85 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:36.767566 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5ec5be9e-5944-4b0c-b9ca-986f84867c85 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:36.768430 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5ec5be9e-5944-4b0c-b9ca-986f84867c85 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:36.770445 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5ec5be9e-5944-4b0c-b9ca-986f84867c85 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:36.771055 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5ec5be9e-5944-4b0c-b9ca-986f84867c85 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:36.797066 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-5ec5be9e-5944-4b0c-b9ca-986f84867c85 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] HTTP exception thrown: Instance 1f49fdf3-9197-4092-933e-9101437e0141 could not be found. Oct 17 14:00:36.799898 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5ec5be9e-5944-4b0c-b9ca-986f84867c85 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Request method failure captured: Oct 17 14:00:36.799898 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/1f49fdf3-9197-4092-933e-9101437e0141 HTTP/1.1 Oct 17 14:00:36.799898 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 14:00:36.799898 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 14:00:36.799898 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 14:00:36.799898 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 14:00:36.799898 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 14:00:36.799898 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 14:00:36.799898 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 14:00:36.799898 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 14:00:36.799898 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTV7tIaoYPgUdHiXX4NOkSSz-a4-puhL4AhnfvtJYmPyZ3fJvZDePMat9BASboFCn4C3QP9Vix9f7JprJ7jGUAeFojqdhpTvVML9HYK6oQI67GVbo4xYwR8dQKhVTSdcdIj_O_mmBimo8N7A_DyW-iY_pgxFAaVGSJ3vOytCqm8fGt3Q Oct 17 14:00:36.799898 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 14:00:36.799898 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 14:00:36.799898 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 14:00:36.799898 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 14:00:36.799898 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 14:00:36.799898 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 14:00:36.799898 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 0821e5beffdd41c2ad2adbd1d03cde71 Oct 17 14:00:36.799898 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-DeleteServersTestJSON-930683239 Oct 17 14:00:36.799898 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 14:00:36.799898 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 14:00:36.799898 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "tempest-type-757843761", "name": "tempest-service-527072566", "endpoints": [{"region": "tempest-region-1530587473", "publicURL": "https://url-594098419.com"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "tempest-type-1549021290", "name": "tempest-service-1797883724", "endpoints": [{"region": "tempest-region-85075699", "internalURL": "https://url-259507820.com"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0821e5beffdd41c2ad2adbd1d03cde71", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "tempest-type-1413520904", "name": "tempest-service-1708200528", "endpoints": []}] Oct 17 14:00:36.799898 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-DeleteServersTestJSON-930683239 Oct 17 14:00:36.799898 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 0821e5beffdd41c2ad2adbd1d03cde71 Oct 17 14:00:36.799898 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-DeleteServersTestJSON-930683239 Oct 17 14:00:36.799898 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-DeleteServersTestJSON-930683239-project Oct 17 14:00:36.799898 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 14:00:36.799898 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 14:00:36.799898 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: ab8baeba1d494df5bb9cf4d7289410b9 Oct 17 14:00:36.799898 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-DeleteServersTestJSON-930683239-project Oct 17 14:00:36.799898 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 14:00:36.799898 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 1f49fdf3-9197-4092-933e-9101437e0141 could not be found. Oct 17 14:00:36.799898 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '1f49fdf3-9197-4092-933e-9101437e0141'} Oct 17 14:00:36.799898 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:00:36.799898 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:00:36.799898 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:00:36.799898 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:00:36.799898 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:00:36.799898 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:00:36.799898 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:00:36.799898 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:00:36.799898 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:00:36.799898 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:00:36.799898 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f49fdf3-9197-4092-933e-9101437e0141 could not be found. Oct 17 14:00:36.799898 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:00:36.799898 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:00:36.799898 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:00:36.799898 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:00:36.799898 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:00:36.799898 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:00:36.799898 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:00:36.799898 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:00:36.799898 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:00:36.799898 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:00:36.799898 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:00:36.799898 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:00:36.799898 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:00:36.799898 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:00:36.799898 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:00:36.803429 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:00:36.803429 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f49fdf3-9197-4092-933e-9101437e0141 could not be found. Oct 17 14:00:36.803429 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:00:36.803429 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:00:36.803429 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:00:36.803429 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:00:36.803429 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:00:36.803429 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:00:36.803429 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:00:36.803429 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:00:36.803429 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f49fdf3-9197-4092-933e-9101437e0141 could not be found. Oct 17 14:00:36.803429 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:00:36.805595 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5ec5be9e-5944-4b0c-b9ca-986f84867c85 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Returning 404 to user: Instance 1f49fdf3-9197-4092-933e-9101437e0141 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:00:36.807986 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5ec5be9e-5944-4b0c-b9ca-986f84867c85 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/1f49fdf3-9197-4092-933e-9101437e0141" status: 404 len: 111 microversion: 2.1 time: 0.062778 Oct 17 14:00:36.809461 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2494/5114] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:36 2022] GET /compute/v2.1/servers/1f49fdf3-9197-4092-933e-9101437e0141 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:00:36.824458 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f5137ef0-cd2e-4bf5-9b00-dbbf69b34b22 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:36.825671 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f5137ef0-cd2e-4bf5-9b00-dbbf69b34b22 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 1f49fdf3-9197-4092-933e-9101437e0141] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:36.840458 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f5137ef0-cd2e-4bf5-9b00-dbbf69b34b22 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:36.841216 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6378bd45-6fa7-4acb-9899-ae7a58f67124 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:36.841988 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f5137ef0-cd2e-4bf5-9b00-dbbf69b34b22 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:36.842812 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6378bd45-6fa7-4acb-9899-ae7a58f67124 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] [instance: a60fd17a-8d63-4615-a521-c33db4273aeb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:36.843474 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f5137ef0-cd2e-4bf5-9b00-dbbf69b34b22 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:36.846163 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f5137ef0-cd2e-4bf5-9b00-dbbf69b34b22 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:36.848328 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f5137ef0-cd2e-4bf5-9b00-dbbf69b34b22 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:36.848952 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f5137ef0-cd2e-4bf5-9b00-dbbf69b34b22 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:36.860145 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6378bd45-6fa7-4acb-9899-ae7a58f67124 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:36.862245 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6378bd45-6fa7-4acb-9899-ae7a58f67124 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:36.863417 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6378bd45-6fa7-4acb-9899-ae7a58f67124 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:36.865615 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6378bd45-6fa7-4acb-9899-ae7a58f67124 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:36.866949 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6378bd45-6fa7-4acb-9899-ae7a58f67124 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:36.868607 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6378bd45-6fa7-4acb-9899-ae7a58f67124 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:36.882059 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:00:36.885705 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-f5137ef0-cd2e-4bf5-9b00-dbbf69b34b22 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] HTTP exception thrown: Instance 1f49fdf3-9197-4092-933e-9101437e0141 could not be found. Oct 17 14:00:36.890382 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f5137ef0-cd2e-4bf5-9b00-dbbf69b34b22 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Request method failure captured: Oct 17 14:00:36.890382 n-d-854247-14 devstack@n-api.service[127016]: request: DELETE /compute/v2.1/servers/1f49fdf3-9197-4092-933e-9101437e0141 HTTP/1.1 Oct 17 14:00:36.890382 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 14:00:36.890382 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 14:00:36.890382 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 14:00:36.890382 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 14:00:36.890382 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 14:00:36.890382 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 14:00:36.890382 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 14:00:36.890382 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 14:00:36.890382 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTV7tIaoYPgUdHiXX4NOkSSz-a4-puhL4AhnfvtJYmPyZ3fJvZDePMat9BASboFCn4C3QP9Vix9f7JprJ7jGUAeFojqdhpTvVML9HYK6oQI67GVbo4xYwR8dQKhVTSdcdIj_O_mmBimo8N7A_DyW-iY_pgxFAaVGSJ3vOytCqm8fGt3Q Oct 17 14:00:36.890382 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 14:00:36.890382 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 14:00:36.890382 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 14:00:36.890382 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 14:00:36.890382 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 14:00:36.890382 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 14:00:36.890382 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 0821e5beffdd41c2ad2adbd1d03cde71 Oct 17 14:00:36.890382 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-DeleteServersTestJSON-930683239 Oct 17 14:00:36.890382 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 14:00:36.890382 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 14:00:36.890382 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "tempest-type-757843761", "name": "tempest-service-527072566", "endpoints": [{"region": "tempest-region-1530587473", "publicURL": "https://url-594098419.com"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "tempest-type-1549021290", "name": "tempest-service-1797883724", "endpoints": [{"region": "tempest-region-85075699", "internalURL": "https://url-259507820.com"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0821e5beffdd41c2ad2adbd1d03cde71", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "tempest-type-1413520904", "name": "tempest-service-1708200528", "endpoints": []}] Oct 17 14:00:36.890382 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-DeleteServersTestJSON-930683239 Oct 17 14:00:36.890382 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 0821e5beffdd41c2ad2adbd1d03cde71 Oct 17 14:00:36.890382 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-DeleteServersTestJSON-930683239 Oct 17 14:00:36.890382 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-DeleteServersTestJSON-930683239-project Oct 17 14:00:36.890382 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 14:00:36.890382 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 14:00:36.890382 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: ab8baeba1d494df5bb9cf4d7289410b9 Oct 17 14:00:36.890382 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-DeleteServersTestJSON-930683239-project Oct 17 14:00:36.890382 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 14:00:36.890382 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 1f49fdf3-9197-4092-933e-9101437e0141 could not be found. Oct 17 14:00:36.890382 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '1f49fdf3-9197-4092-933e-9101437e0141'} Oct 17 14:00:36.890382 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:00:36.890382 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:00:36.890382 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:00:36.890382 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:00:36.890382 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:00:36.890382 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:00:36.890382 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:00:36.890382 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:00:36.890382 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:00:36.890382 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:00:36.890382 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f49fdf3-9197-4092-933e-9101437e0141 could not be found. Oct 17 14:00:36.890382 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:00:36.890382 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:00:36.890382 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:00:36.890382 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:00:36.890382 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:00:36.890382 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:00:36.890382 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:00:36.890382 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:00:36.890382 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:00:36.890382 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:00:36.890382 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 14:00:36.890382 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 14:00:36.890382 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 14:00:36.890382 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 14:00:36.890382 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:00:36.894456 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:00:36.894456 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:00:36.894456 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:00:36.894456 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f49fdf3-9197-4092-933e-9101437e0141 could not be found. Oct 17 14:00:36.894456 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:00:36.894456 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:00:36.894456 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:00:36.894456 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:00:36.894456 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:00:36.894456 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:00:36.894456 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:00:36.894456 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:00:36.894456 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f49fdf3-9197-4092-933e-9101437e0141 could not be found. Oct 17 14:00:36.894456 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:00:36.897318 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f5137ef0-cd2e-4bf5-9b00-dbbf69b34b22 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Returning 404 to user: Instance 1f49fdf3-9197-4092-933e-9101437e0141 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:00:36.898496 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f5137ef0-cd2e-4bf5-9b00-dbbf69b34b22 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "DELETE /compute/v2.1/servers/1f49fdf3-9197-4092-933e-9101437e0141" status: 404 len: 111 microversion: 2.1 time: 0.080234 Oct 17 14:00:36.901209 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2621/5115] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:00:36 2022] DELETE /compute/v2.1/servers/1f49fdf3-9197-4092-933e-9101437e0141 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:00:36.912820 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4c120435-8b0f-4a55-a3e9-1f78748bb0c7 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:36.915415 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4c120435-8b0f-4a55-a3e9-1f78748bb0c7 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 1f49fdf3-9197-4092-933e-9101437e0141] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:36.932137 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4c120435-8b0f-4a55-a3e9-1f78748bb0c7 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:36.933973 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4c120435-8b0f-4a55-a3e9-1f78748bb0c7 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:36.935327 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4c120435-8b0f-4a55-a3e9-1f78748bb0c7 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:36.937201 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4c120435-8b0f-4a55-a3e9-1f78748bb0c7 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:36.939913 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4c120435-8b0f-4a55-a3e9-1f78748bb0c7 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:36.940470 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4c120435-8b0f-4a55-a3e9-1f78748bb0c7 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:36.970844 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-4c120435-8b0f-4a55-a3e9-1f78748bb0c7 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] HTTP exception thrown: Instance 1f49fdf3-9197-4092-933e-9101437e0141 could not be found. Oct 17 14:00:36.972867 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4c120435-8b0f-4a55-a3e9-1f78748bb0c7 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Request method failure captured: Oct 17 14:00:36.972867 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/1f49fdf3-9197-4092-933e-9101437e0141 HTTP/1.1 Oct 17 14:00:36.972867 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 14:00:36.972867 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 14:00:36.972867 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 14:00:36.972867 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 14:00:36.972867 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 14:00:36.972867 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 14:00:36.972867 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 14:00:36.972867 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 14:00:36.972867 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTV7tIaoYPgUdHiXX4NOkSSz-a4-puhL4AhnfvtJYmPyZ3fJvZDePMat9BASboFCn4C3QP9Vix9f7JprJ7jGUAeFojqdhpTvVML9HYK6oQI67GVbo4xYwR8dQKhVTSdcdIj_O_mmBimo8N7A_DyW-iY_pgxFAaVGSJ3vOytCqm8fGt3Q Oct 17 14:00:36.972867 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 14:00:36.972867 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 14:00:36.972867 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 14:00:36.972867 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 14:00:36.972867 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 14:00:36.972867 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 14:00:36.972867 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 0821e5beffdd41c2ad2adbd1d03cde71 Oct 17 14:00:36.972867 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-DeleteServersTestJSON-930683239 Oct 17 14:00:36.972867 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 14:00:36.972867 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 14:00:36.972867 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "tempest-type-757843761", "name": "tempest-service-527072566", "endpoints": [{"region": "tempest-region-1530587473", "publicURL": "https://url-594098419.com"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "tempest-type-1549021290", "name": "tempest-service-1797883724", "endpoints": [{"region": "tempest-region-85075699", "internalURL": "https://url-259507820.com"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0821e5beffdd41c2ad2adbd1d03cde71", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "tempest-type-1413520904", "name": "tempest-service-1708200528", "endpoints": []}] Oct 17 14:00:36.972867 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-DeleteServersTestJSON-930683239 Oct 17 14:00:36.972867 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 0821e5beffdd41c2ad2adbd1d03cde71 Oct 17 14:00:36.972867 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-DeleteServersTestJSON-930683239 Oct 17 14:00:36.972867 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-DeleteServersTestJSON-930683239-project Oct 17 14:00:36.972867 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 14:00:36.972867 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 14:00:36.972867 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: ab8baeba1d494df5bb9cf4d7289410b9 Oct 17 14:00:36.972867 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-DeleteServersTestJSON-930683239-project Oct 17 14:00:36.972867 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 14:00:36.972867 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 1f49fdf3-9197-4092-933e-9101437e0141 could not be found. Oct 17 14:00:36.972867 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '1f49fdf3-9197-4092-933e-9101437e0141'} Oct 17 14:00:36.972867 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:00:36.972867 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:00:36.972867 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:00:36.972867 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:00:36.972867 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:00:36.972867 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:00:36.972867 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:00:36.972867 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:00:36.972867 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:00:36.972867 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:00:36.972867 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f49fdf3-9197-4092-933e-9101437e0141 could not be found. Oct 17 14:00:36.972867 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:00:36.972867 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:00:36.972867 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:00:36.972867 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:00:36.972867 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:00:36.972867 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:00:36.972867 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:00:36.972867 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:00:36.972867 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:00:36.972867 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:00:36.972867 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:00:36.972867 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:00:36.972867 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:00:36.972867 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:00:36.972867 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:00:36.976220 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:00:36.976220 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f49fdf3-9197-4092-933e-9101437e0141 could not be found. Oct 17 14:00:36.976220 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:00:36.976220 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:00:36.976220 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:00:36.976220 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:00:36.976220 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:00:36.976220 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:00:36.976220 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:00:36.976220 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:00:36.976220 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f49fdf3-9197-4092-933e-9101437e0141 could not be found. Oct 17 14:00:36.976220 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:00:36.979241 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4c120435-8b0f-4a55-a3e9-1f78748bb0c7 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Returning 404 to user: Instance 1f49fdf3-9197-4092-933e-9101437e0141 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:00:36.980373 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4c120435-8b0f-4a55-a3e9-1f78748bb0c7 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/1f49fdf3-9197-4092-933e-9101437e0141" status: 404 len: 111 microversion: 2.1 time: 0.075654 Oct 17 14:00:36.981567 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2622/5116] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:36 2022] GET /compute/v2.1/servers/1f49fdf3-9197-4092-933e-9101437e0141 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:00:37.003418 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3510ced1-8473-48e9-be31-484851d37e8a tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:37.004865 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3510ced1-8473-48e9-be31-484851d37e8a tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: b681678a-4240-4b9b-929b-65d09606a07c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:37.021305 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3510ced1-8473-48e9-be31-484851d37e8a tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:37.023338 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3510ced1-8473-48e9-be31-484851d37e8a tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:37.024000 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3510ced1-8473-48e9-be31-484851d37e8a tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:37.025727 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3510ced1-8473-48e9-be31-484851d37e8a tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:37.029489 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3510ced1-8473-48e9-be31-484851d37e8a tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:37.030201 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3510ced1-8473-48e9-be31-484851d37e8a tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:37.066435 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-3510ced1-8473-48e9-be31-484851d37e8a tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] HTTP exception thrown: Instance b681678a-4240-4b9b-929b-65d09606a07c could not be found. Oct 17 14:00:37.073488 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3510ced1-8473-48e9-be31-484851d37e8a tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Request method failure captured: Oct 17 14:00:37.073488 n-d-854247-14 devstack@n-api.service[127016]: request: DELETE /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c HTTP/1.1 Oct 17 14:00:37.073488 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 14:00:37.073488 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 14:00:37.073488 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 14:00:37.073488 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 14:00:37.073488 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 14:00:37.073488 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 14:00:37.073488 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 14:00:37.073488 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 14:00:37.073488 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTV7tIaoYPgUdHiXX4NOkSSz-a4-puhL4AhnfvtJYmPyZ3fJvZDePMat9BASboFCn4C3QP9Vix9f7JprJ7jGUAeFojqdhpTvVML9HYK6oQI67GVbo4xYwR8dQKhVTSdcdIj_O_mmBimo8N7A_DyW-iY_pgxFAaVGSJ3vOytCqm8fGt3Q Oct 17 14:00:37.073488 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 14:00:37.073488 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 14:00:37.073488 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 14:00:37.073488 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 14:00:37.073488 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 14:00:37.073488 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 14:00:37.073488 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 0821e5beffdd41c2ad2adbd1d03cde71 Oct 17 14:00:37.073488 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-DeleteServersTestJSON-930683239 Oct 17 14:00:37.073488 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 14:00:37.073488 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 14:00:37.073488 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "tempest-type-757843761", "name": "tempest-service-527072566", "endpoints": [{"region": "tempest-region-1530587473", "publicURL": "https://url-594098419.com"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "tempest-type-1549021290", "name": "tempest-service-1797883724", "endpoints": [{"region": "tempest-region-85075699", "internalURL": "https://url-259507820.com"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0821e5beffdd41c2ad2adbd1d03cde71", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "tempest-type-1413520904", "name": "tempest-service-1708200528", "endpoints": []}] Oct 17 14:00:37.073488 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-DeleteServersTestJSON-930683239 Oct 17 14:00:37.073488 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 0821e5beffdd41c2ad2adbd1d03cde71 Oct 17 14:00:37.073488 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-DeleteServersTestJSON-930683239 Oct 17 14:00:37.073488 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-DeleteServersTestJSON-930683239-project Oct 17 14:00:37.073488 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 14:00:37.073488 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 14:00:37.073488 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: ab8baeba1d494df5bb9cf4d7289410b9 Oct 17 14:00:37.073488 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-DeleteServersTestJSON-930683239-project Oct 17 14:00:37.073488 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 14:00:37.073488 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance b681678a-4240-4b9b-929b-65d09606a07c could not be found. Oct 17 14:00:37.073488 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'b681678a-4240-4b9b-929b-65d09606a07c'} Oct 17 14:00:37.073488 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:00:37.073488 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:00:37.073488 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:00:37.073488 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:00:37.073488 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:00:37.073488 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:00:37.073488 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:00:37.073488 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:00:37.073488 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:00:37.073488 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:00:37.073488 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b681678a-4240-4b9b-929b-65d09606a07c could not be found. Oct 17 14:00:37.073488 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:00:37.073488 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:00:37.073488 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:00:37.073488 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:00:37.073488 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:00:37.073488 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:00:37.073488 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:00:37.073488 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:00:37.073488 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:00:37.073488 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:00:37.073488 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 14:00:37.073488 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 14:00:37.073488 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 14:00:37.073488 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 14:00:37.073488 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:00:37.076738 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:00:37.076738 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:00:37.076738 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:00:37.076738 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b681678a-4240-4b9b-929b-65d09606a07c could not be found. Oct 17 14:00:37.076738 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:00:37.076738 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:00:37.076738 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:00:37.076738 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:00:37.076738 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:00:37.076738 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:00:37.076738 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:00:37.076738 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:00:37.076738 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b681678a-4240-4b9b-929b-65d09606a07c could not be found. Oct 17 14:00:37.076738 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:00:37.080444 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3510ced1-8473-48e9-be31-484851d37e8a tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Returning 404 to user: Instance b681678a-4240-4b9b-929b-65d09606a07c could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:00:37.083779 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3510ced1-8473-48e9-be31-484851d37e8a tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "DELETE /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c" status: 404 len: 111 microversion: 2.1 time: 0.097521 Oct 17 14:00:37.085570 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2623/5117] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:00:36 2022] DELETE /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:00:37.116080 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0c1f0f12-8efa-4418-a278-597394c71bfe tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:37.116694 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0c1f0f12-8efa-4418-a278-597394c71bfe tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: b681678a-4240-4b9b-929b-65d09606a07c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:37.135410 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0c1f0f12-8efa-4418-a278-597394c71bfe tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:37.136979 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0c1f0f12-8efa-4418-a278-597394c71bfe tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:37.137697 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0c1f0f12-8efa-4418-a278-597394c71bfe tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:37.138694 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0c1f0f12-8efa-4418-a278-597394c71bfe tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:37.139618 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0c1f0f12-8efa-4418-a278-597394c71bfe tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:37.140274 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0c1f0f12-8efa-4418-a278-597394c71bfe tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:37.174200 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6378bd45-6fa7-4acb-9899-ae7a58f67124 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:37.182163 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-0c1f0f12-8efa-4418-a278-597394c71bfe tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] HTTP exception thrown: Instance b681678a-4240-4b9b-929b-65d09606a07c could not be found. Oct 17 14:00:37.184125 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0c1f0f12-8efa-4418-a278-597394c71bfe tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Request method failure captured: Oct 17 14:00:37.184125 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c HTTP/1.1 Oct 17 14:00:37.184125 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 14:00:37.184125 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 14:00:37.184125 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 14:00:37.184125 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 14:00:37.184125 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 14:00:37.184125 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 14:00:37.184125 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 14:00:37.184125 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 14:00:37.184125 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTV7tIaoYPgUdHiXX4NOkSSz-a4-puhL4AhnfvtJYmPyZ3fJvZDePMat9BASboFCn4C3QP9Vix9f7JprJ7jGUAeFojqdhpTvVML9HYK6oQI67GVbo4xYwR8dQKhVTSdcdIj_O_mmBimo8N7A_DyW-iY_pgxFAaVGSJ3vOytCqm8fGt3Q Oct 17 14:00:37.184125 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 14:00:37.184125 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 14:00:37.184125 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 14:00:37.184125 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 14:00:37.184125 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 14:00:37.184125 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 14:00:37.184125 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 0821e5beffdd41c2ad2adbd1d03cde71 Oct 17 14:00:37.184125 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-DeleteServersTestJSON-930683239 Oct 17 14:00:37.184125 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 14:00:37.184125 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 14:00:37.184125 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "tempest-type-757843761", "name": "tempest-service-527072566", "endpoints": [{"region": "tempest-region-1530587473", "publicURL": "https://url-594098419.com"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "tempest-type-1549021290", "name": "tempest-service-1797883724", "endpoints": [{"region": "tempest-region-85075699", "internalURL": "https://url-259507820.com"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0821e5beffdd41c2ad2adbd1d03cde71", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "tempest-type-1413520904", "name": "tempest-service-1708200528", "endpoints": []}] Oct 17 14:00:37.184125 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-DeleteServersTestJSON-930683239 Oct 17 14:00:37.184125 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 0821e5beffdd41c2ad2adbd1d03cde71 Oct 17 14:00:37.184125 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-DeleteServersTestJSON-930683239 Oct 17 14:00:37.184125 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-DeleteServersTestJSON-930683239-project Oct 17 14:00:37.184125 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 14:00:37.184125 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 14:00:37.184125 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: ab8baeba1d494df5bb9cf4d7289410b9 Oct 17 14:00:37.184125 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-DeleteServersTestJSON-930683239-project Oct 17 14:00:37.184125 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 14:00:37.184125 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance b681678a-4240-4b9b-929b-65d09606a07c could not be found. Oct 17 14:00:37.184125 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'b681678a-4240-4b9b-929b-65d09606a07c'} Oct 17 14:00:37.184125 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:00:37.184125 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:00:37.184125 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:00:37.184125 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:00:37.184125 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:00:37.184125 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:00:37.184125 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:00:37.184125 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:00:37.184125 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:00:37.184125 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:00:37.184125 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b681678a-4240-4b9b-929b-65d09606a07c could not be found. Oct 17 14:00:37.184125 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:00:37.184125 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:00:37.184125 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:00:37.184125 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:00:37.184125 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:00:37.184125 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:00:37.184125 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:00:37.184125 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:00:37.184125 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:00:37.184125 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:00:37.184125 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:00:37.184125 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:00:37.184125 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:00:37.184125 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:00:37.184125 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:00:37.187211 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:00:37.187211 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b681678a-4240-4b9b-929b-65d09606a07c could not be found. Oct 17 14:00:37.187211 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:00:37.187211 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:00:37.187211 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:00:37.187211 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:00:37.187211 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:00:37.187211 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:00:37.187211 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:00:37.187211 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:00:37.187211 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b681678a-4240-4b9b-929b-65d09606a07c could not be found. Oct 17 14:00:37.187211 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:00:37.190751 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0c1f0f12-8efa-4418-a278-597394c71bfe tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Returning 404 to user: Instance b681678a-4240-4b9b-929b-65d09606a07c could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:00:37.191935 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0c1f0f12-8efa-4418-a278-597394c71bfe tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c" status: 404 len: 111 microversion: 2.1 time: 0.095435 Oct 17 14:00:37.193640 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2624/5118] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:37 2022] GET /compute/v2.1/servers/b681678a-4240-4b9b-929b-65d09606a07c => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:00:37.195715 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6378bd45-6fa7-4acb-9899-ae7a58f67124 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:37.197452 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6378bd45-6fa7-4acb-9899-ae7a58f67124 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:37.198975 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6378bd45-6fa7-4acb-9899-ae7a58f67124 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] 10.222.0.79 "GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb" status: 200 len: 1366 microversion: 2.47 time: 0.365565 Oct 17 14:00:37.206867 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c5ad4ce2-e893-4002-9b59-2f480a8f3303 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:37.207402 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c5ad4ce2-e893-4002-9b59-2f480a8f3303 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 6d2bbd26-cb90-4e90-881f-a9346ee3002a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:37.208470 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2495/5119] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:00:36 2022] GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb => generated 1366 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 14:00:37.286575 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c5ad4ce2-e893-4002-9b59-2f480a8f3303 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:37.287227 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c5ad4ce2-e893-4002-9b59-2f480a8f3303 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:37.287697 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c5ad4ce2-e893-4002-9b59-2f480a8f3303 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:37.292967 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c5ad4ce2-e893-4002-9b59-2f480a8f3303 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:37.293477 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c5ad4ce2-e893-4002-9b59-2f480a8f3303 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:37.293937 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c5ad4ce2-e893-4002-9b59-2f480a8f3303 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:37.335440 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-c5ad4ce2-e893-4002-9b59-2f480a8f3303 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] HTTP exception thrown: Instance 6d2bbd26-cb90-4e90-881f-a9346ee3002a could not be found. Oct 17 14:00:37.337598 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c5ad4ce2-e893-4002-9b59-2f480a8f3303 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Request method failure captured: Oct 17 14:00:37.337598 n-d-854247-14 devstack@n-api.service[127016]: request: DELETE /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a HTTP/1.1 Oct 17 14:00:37.337598 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 14:00:37.337598 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 14:00:37.337598 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 14:00:37.337598 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 14:00:37.337598 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 14:00:37.337598 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 14:00:37.337598 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 14:00:37.337598 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 14:00:37.337598 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTV7tIaoYPgUdHiXX4NOkSSz-a4-puhL4AhnfvtJYmPyZ3fJvZDePMat9BASboFCn4C3QP9Vix9f7JprJ7jGUAeFojqdhpTvVML9HYK6oQI67GVbo4xYwR8dQKhVTSdcdIj_O_mmBimo8N7A_DyW-iY_pgxFAaVGSJ3vOytCqm8fGt3Q Oct 17 14:00:37.337598 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 14:00:37.337598 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 14:00:37.337598 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 14:00:37.337598 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 14:00:37.337598 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 14:00:37.337598 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 14:00:37.337598 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 0821e5beffdd41c2ad2adbd1d03cde71 Oct 17 14:00:37.337598 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-DeleteServersTestJSON-930683239 Oct 17 14:00:37.337598 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 14:00:37.337598 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 14:00:37.337598 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "tempest-type-757843761", "name": "tempest-service-527072566", "endpoints": [{"region": "tempest-region-1530587473", "publicURL": "https://url-594098419.com"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "tempest-type-1549021290", "name": "tempest-service-1797883724", "endpoints": [{"region": "tempest-region-85075699", "internalURL": "https://url-259507820.com"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0821e5beffdd41c2ad2adbd1d03cde71", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "tempest-type-1413520904", "name": "tempest-service-1708200528", "endpoints": []}] Oct 17 14:00:37.337598 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-DeleteServersTestJSON-930683239 Oct 17 14:00:37.337598 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 0821e5beffdd41c2ad2adbd1d03cde71 Oct 17 14:00:37.337598 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-DeleteServersTestJSON-930683239 Oct 17 14:00:37.337598 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-DeleteServersTestJSON-930683239-project Oct 17 14:00:37.337598 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 14:00:37.337598 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 14:00:37.337598 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: ab8baeba1d494df5bb9cf4d7289410b9 Oct 17 14:00:37.337598 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-DeleteServersTestJSON-930683239-project Oct 17 14:00:37.337598 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 14:00:37.337598 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 6d2bbd26-cb90-4e90-881f-a9346ee3002a could not be found. Oct 17 14:00:37.337598 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '6d2bbd26-cb90-4e90-881f-a9346ee3002a'} Oct 17 14:00:37.337598 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:00:37.337598 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:00:37.337598 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:00:37.337598 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:00:37.337598 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:00:37.337598 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:00:37.337598 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:00:37.337598 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:00:37.337598 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:00:37.337598 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:00:37.337598 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d2bbd26-cb90-4e90-881f-a9346ee3002a could not be found. Oct 17 14:00:37.337598 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:00:37.337598 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:00:37.337598 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:00:37.337598 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:00:37.337598 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:00:37.337598 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:00:37.337598 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:00:37.337598 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:00:37.337598 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:00:37.337598 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:00:37.337598 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 14:00:37.337598 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 14:00:37.337598 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 14:00:37.337598 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 14:00:37.337598 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:00:37.341859 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:00:37.341859 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:00:37.341859 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:00:37.341859 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d2bbd26-cb90-4e90-881f-a9346ee3002a could not be found. Oct 17 14:00:37.341859 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:00:37.341859 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:00:37.341859 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:00:37.341859 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:00:37.341859 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:00:37.341859 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:00:37.341859 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:00:37.341859 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:00:37.341859 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d2bbd26-cb90-4e90-881f-a9346ee3002a could not be found. Oct 17 14:00:37.341859 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:00:37.345127 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c5ad4ce2-e893-4002-9b59-2f480a8f3303 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Returning 404 to user: Instance 6d2bbd26-cb90-4e90-881f-a9346ee3002a could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:00:37.346236 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c5ad4ce2-e893-4002-9b59-2f480a8f3303 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "DELETE /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a" status: 404 len: 111 microversion: 2.1 time: 0.144217 Oct 17 14:00:37.350676 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2625/5120] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:00:37 2022] DELETE /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:00:37.355915 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-84c4a65c-d046-41d3-97bf-fbe9131ca709 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:37.356569 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-84c4a65c-d046-41d3-97bf-fbe9131ca709 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 6d2bbd26-cb90-4e90-881f-a9346ee3002a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:37.364639 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-84c4a65c-d046-41d3-97bf-fbe9131ca709 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:37.365151 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-84c4a65c-d046-41d3-97bf-fbe9131ca709 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:37.365606 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-84c4a65c-d046-41d3-97bf-fbe9131ca709 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:37.366382 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-84c4a65c-d046-41d3-97bf-fbe9131ca709 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:37.366775 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-84c4a65c-d046-41d3-97bf-fbe9131ca709 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:37.367259 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-84c4a65c-d046-41d3-97bf-fbe9131ca709 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:37.410876 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-84c4a65c-d046-41d3-97bf-fbe9131ca709 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] HTTP exception thrown: Instance 6d2bbd26-cb90-4e90-881f-a9346ee3002a could not be found. Oct 17 14:00:37.416533 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-84c4a65c-d046-41d3-97bf-fbe9131ca709 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Request method failure captured: Oct 17 14:00:37.416533 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a HTTP/1.1 Oct 17 14:00:37.416533 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 14:00:37.416533 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 14:00:37.416533 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 14:00:37.416533 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 14:00:37.416533 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 14:00:37.416533 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 14:00:37.416533 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 14:00:37.416533 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 14:00:37.416533 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTV7tIaoYPgUdHiXX4NOkSSz-a4-puhL4AhnfvtJYmPyZ3fJvZDePMat9BASboFCn4C3QP9Vix9f7JprJ7jGUAeFojqdhpTvVML9HYK6oQI67GVbo4xYwR8dQKhVTSdcdIj_O_mmBimo8N7A_DyW-iY_pgxFAaVGSJ3vOytCqm8fGt3Q Oct 17 14:00:37.416533 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 14:00:37.416533 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 14:00:37.416533 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 14:00:37.416533 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 14:00:37.416533 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 14:00:37.416533 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 14:00:37.416533 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 0821e5beffdd41c2ad2adbd1d03cde71 Oct 17 14:00:37.416533 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-DeleteServersTestJSON-930683239 Oct 17 14:00:37.416533 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 14:00:37.416533 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 14:00:37.416533 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "tempest-type-757843761", "name": "tempest-service-527072566", "endpoints": [{"region": "tempest-region-1530587473", "publicURL": "https://url-594098419.com"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "tempest-type-1549021290", "name": "tempest-service-1797883724", "endpoints": [{"region": "tempest-region-85075699", "internalURL": "https://url-259507820.com"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0821e5beffdd41c2ad2adbd1d03cde71", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "tempest-type-1413520904", "name": "tempest-service-1708200528", "endpoints": []}] Oct 17 14:00:37.416533 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-DeleteServersTestJSON-930683239 Oct 17 14:00:37.416533 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 0821e5beffdd41c2ad2adbd1d03cde71 Oct 17 14:00:37.416533 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-DeleteServersTestJSON-930683239 Oct 17 14:00:37.416533 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-DeleteServersTestJSON-930683239-project Oct 17 14:00:37.416533 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 14:00:37.416533 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 14:00:37.416533 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: ab8baeba1d494df5bb9cf4d7289410b9 Oct 17 14:00:37.416533 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-DeleteServersTestJSON-930683239-project Oct 17 14:00:37.416533 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 14:00:37.416533 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 6d2bbd26-cb90-4e90-881f-a9346ee3002a could not be found. Oct 17 14:00:37.416533 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '6d2bbd26-cb90-4e90-881f-a9346ee3002a'} Oct 17 14:00:37.416533 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:00:37.416533 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:00:37.416533 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:00:37.416533 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:00:37.416533 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:00:37.416533 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:00:37.416533 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:00:37.416533 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:00:37.416533 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:00:37.416533 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:00:37.416533 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d2bbd26-cb90-4e90-881f-a9346ee3002a could not be found. Oct 17 14:00:37.416533 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:00:37.416533 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:00:37.416533 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:00:37.416533 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:00:37.416533 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:00:37.416533 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:00:37.416533 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:00:37.416533 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:00:37.416533 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:00:37.416533 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:00:37.416533 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:00:37.416533 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:00:37.416533 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:00:37.416533 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:00:37.416533 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:00:37.419613 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:00:37.419613 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d2bbd26-cb90-4e90-881f-a9346ee3002a could not be found. Oct 17 14:00:37.419613 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:00:37.419613 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:00:37.419613 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:00:37.419613 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:00:37.419613 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:00:37.419613 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:00:37.419613 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:00:37.419613 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:00:37.419613 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d2bbd26-cb90-4e90-881f-a9346ee3002a could not be found. Oct 17 14:00:37.419613 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:00:37.425722 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-84c4a65c-d046-41d3-97bf-fbe9131ca709 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Returning 404 to user: Instance 6d2bbd26-cb90-4e90-881f-a9346ee3002a could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:00:37.427421 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-84c4a65c-d046-41d3-97bf-fbe9131ca709 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a" status: 404 len: 111 microversion: 2.1 time: 0.075610 Oct 17 14:00:37.428262 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2496/5121] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:37 2022] GET /compute/v2.1/servers/6d2bbd26-cb90-4e90-881f-a9346ee3002a => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:00:37.438492 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1cda040a-a80b-473e-b5b5-89bf8fda0022 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:37.439418 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-1cda040a-a80b-473e-b5b5-89bf8fda0022 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 5d10ac72-2710-41c8-82a4-f648ed80d727] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:37.451476 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1cda040a-a80b-473e-b5b5-89bf8fda0022 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:37.452343 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1cda040a-a80b-473e-b5b5-89bf8fda0022 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:37.453025 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1cda040a-a80b-473e-b5b5-89bf8fda0022 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:37.473581 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1cda040a-a80b-473e-b5b5-89bf8fda0022 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:37.475830 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1cda040a-a80b-473e-b5b5-89bf8fda0022 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:37.477154 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1cda040a-a80b-473e-b5b5-89bf8fda0022 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:37.538789 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-1cda040a-a80b-473e-b5b5-89bf8fda0022 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] HTTP exception thrown: Instance 5d10ac72-2710-41c8-82a4-f648ed80d727 could not be found. Oct 17 14:00:37.541489 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1cda040a-a80b-473e-b5b5-89bf8fda0022 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Request method failure captured: Oct 17 14:00:37.541489 n-d-854247-14 devstack@n-api.service[127016]: request: DELETE /compute/v2.1/servers/5d10ac72-2710-41c8-82a4-f648ed80d727 HTTP/1.1 Oct 17 14:00:37.541489 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 14:00:37.541489 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 14:00:37.541489 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 14:00:37.541489 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 14:00:37.541489 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 14:00:37.541489 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 14:00:37.541489 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 14:00:37.541489 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 14:00:37.541489 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTV7tIaoYPgUdHiXX4NOkSSz-a4-puhL4AhnfvtJYmPyZ3fJvZDePMat9BASboFCn4C3QP9Vix9f7JprJ7jGUAeFojqdhpTvVML9HYK6oQI67GVbo4xYwR8dQKhVTSdcdIj_O_mmBimo8N7A_DyW-iY_pgxFAaVGSJ3vOytCqm8fGt3Q Oct 17 14:00:37.541489 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 14:00:37.541489 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 14:00:37.541489 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 14:00:37.541489 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 14:00:37.541489 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 14:00:37.541489 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 14:00:37.541489 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 0821e5beffdd41c2ad2adbd1d03cde71 Oct 17 14:00:37.541489 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-DeleteServersTestJSON-930683239 Oct 17 14:00:37.541489 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 14:00:37.541489 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 14:00:37.541489 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "tempest-type-757843761", "name": "tempest-service-527072566", "endpoints": [{"region": "tempest-region-1530587473", "publicURL": "https://url-594098419.com"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "tempest-type-1549021290", "name": "tempest-service-1797883724", "endpoints": [{"region": "tempest-region-85075699", "internalURL": "https://url-259507820.com"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0821e5beffdd41c2ad2adbd1d03cde71", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "tempest-type-1413520904", "name": "tempest-service-1708200528", "endpoints": []}] Oct 17 14:00:37.541489 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-DeleteServersTestJSON-930683239 Oct 17 14:00:37.541489 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 0821e5beffdd41c2ad2adbd1d03cde71 Oct 17 14:00:37.541489 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-DeleteServersTestJSON-930683239 Oct 17 14:00:37.541489 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-DeleteServersTestJSON-930683239-project Oct 17 14:00:37.541489 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 14:00:37.541489 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 14:00:37.541489 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: ab8baeba1d494df5bb9cf4d7289410b9 Oct 17 14:00:37.541489 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-DeleteServersTestJSON-930683239-project Oct 17 14:00:37.541489 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 14:00:37.541489 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 5d10ac72-2710-41c8-82a4-f648ed80d727 could not be found. Oct 17 14:00:37.541489 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '5d10ac72-2710-41c8-82a4-f648ed80d727'} Oct 17 14:00:37.541489 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:00:37.541489 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:00:37.541489 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:00:37.541489 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:00:37.541489 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:00:37.541489 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:00:37.541489 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:00:37.541489 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:00:37.541489 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:00:37.541489 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:00:37.541489 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d10ac72-2710-41c8-82a4-f648ed80d727 could not be found. Oct 17 14:00:37.541489 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:00:37.541489 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:00:37.541489 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:00:37.541489 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:00:37.541489 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:00:37.541489 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:00:37.541489 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:00:37.541489 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:00:37.541489 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:00:37.541489 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:00:37.541489 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 14:00:37.541489 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 14:00:37.541489 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 14:00:37.541489 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 14:00:37.541489 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:00:37.544673 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:00:37.544673 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:00:37.544673 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:00:37.544673 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d10ac72-2710-41c8-82a4-f648ed80d727 could not be found. Oct 17 14:00:37.544673 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:00:37.544673 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:00:37.544673 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:00:37.544673 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:00:37.544673 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:00:37.544673 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:00:37.544673 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:00:37.544673 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:00:37.544673 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d10ac72-2710-41c8-82a4-f648ed80d727 could not be found. Oct 17 14:00:37.544673 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:00:37.548674 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1cda040a-a80b-473e-b5b5-89bf8fda0022 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Returning 404 to user: Instance 5d10ac72-2710-41c8-82a4-f648ed80d727 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:00:37.553610 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1cda040a-a80b-473e-b5b5-89bf8fda0022 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "DELETE /compute/v2.1/servers/5d10ac72-2710-41c8-82a4-f648ed80d727" status: 404 len: 111 microversion: 2.1 time: 0.116743 Oct 17 14:00:37.566318 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b75d82ff-2b82-4b3d-a300-ea10f71591da tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:37.568473 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b75d82ff-2b82-4b3d-a300-ea10f71591da tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 5d10ac72-2710-41c8-82a4-f648ed80d727] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:37.572461 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2626/5122] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:00:37 2022] DELETE /compute/v2.1/servers/5d10ac72-2710-41c8-82a4-f648ed80d727 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:00:37.582183 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b75d82ff-2b82-4b3d-a300-ea10f71591da tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:37.583999 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b75d82ff-2b82-4b3d-a300-ea10f71591da tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:37.587157 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b75d82ff-2b82-4b3d-a300-ea10f71591da tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:37.588567 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b75d82ff-2b82-4b3d-a300-ea10f71591da tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:37.590925 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b75d82ff-2b82-4b3d-a300-ea10f71591da tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:37.594308 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b75d82ff-2b82-4b3d-a300-ea10f71591da tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:37.654425 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-b75d82ff-2b82-4b3d-a300-ea10f71591da tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] HTTP exception thrown: Instance 5d10ac72-2710-41c8-82a4-f648ed80d727 could not be found. Oct 17 14:00:37.656191 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b75d82ff-2b82-4b3d-a300-ea10f71591da tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Request method failure captured: Oct 17 14:00:37.656191 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/5d10ac72-2710-41c8-82a4-f648ed80d727 HTTP/1.1 Oct 17 14:00:37.656191 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 14:00:37.656191 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 14:00:37.656191 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 14:00:37.656191 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 14:00:37.656191 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 14:00:37.656191 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 14:00:37.656191 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 14:00:37.656191 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 14:00:37.656191 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTV7tIaoYPgUdHiXX4NOkSSz-a4-puhL4AhnfvtJYmPyZ3fJvZDePMat9BASboFCn4C3QP9Vix9f7JprJ7jGUAeFojqdhpTvVML9HYK6oQI67GVbo4xYwR8dQKhVTSdcdIj_O_mmBimo8N7A_DyW-iY_pgxFAaVGSJ3vOytCqm8fGt3Q Oct 17 14:00:37.656191 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 14:00:37.656191 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 14:00:37.656191 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 14:00:37.656191 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 14:00:37.656191 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 14:00:37.656191 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 14:00:37.656191 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 0821e5beffdd41c2ad2adbd1d03cde71 Oct 17 14:00:37.656191 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-DeleteServersTestJSON-930683239 Oct 17 14:00:37.656191 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 14:00:37.656191 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 14:00:37.656191 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "tempest-type-757843761", "name": "tempest-service-527072566", "endpoints": [{"region": "tempest-region-1530587473", "publicURL": "https://url-594098419.com"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "tempest-type-1549021290", "name": "tempest-service-1797883724", "endpoints": [{"region": "tempest-region-85075699", "internalURL": "https://url-259507820.com"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0821e5beffdd41c2ad2adbd1d03cde71", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "tempest-type-1413520904", "name": "tempest-service-1708200528", "endpoints": []}] Oct 17 14:00:37.656191 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-DeleteServersTestJSON-930683239 Oct 17 14:00:37.656191 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 0821e5beffdd41c2ad2adbd1d03cde71 Oct 17 14:00:37.656191 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-DeleteServersTestJSON-930683239 Oct 17 14:00:37.656191 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-DeleteServersTestJSON-930683239-project Oct 17 14:00:37.656191 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 14:00:37.656191 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 14:00:37.656191 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: ab8baeba1d494df5bb9cf4d7289410b9 Oct 17 14:00:37.656191 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-DeleteServersTestJSON-930683239-project Oct 17 14:00:37.656191 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 14:00:37.656191 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 5d10ac72-2710-41c8-82a4-f648ed80d727 could not be found. Oct 17 14:00:37.656191 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '5d10ac72-2710-41c8-82a4-f648ed80d727'} Oct 17 14:00:37.656191 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:00:37.656191 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:00:37.656191 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:00:37.656191 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:00:37.656191 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:00:37.656191 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:00:37.656191 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:00:37.656191 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:00:37.656191 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:00:37.656191 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:00:37.656191 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d10ac72-2710-41c8-82a4-f648ed80d727 could not be found. Oct 17 14:00:37.656191 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:00:37.656191 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:00:37.656191 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:00:37.656191 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:00:37.656191 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:00:37.656191 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:00:37.656191 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:00:37.656191 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:00:37.656191 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:00:37.656191 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:00:37.656191 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:00:37.656191 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:00:37.656191 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:00:37.656191 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:00:37.656191 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:00:37.659721 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:00:37.659721 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d10ac72-2710-41c8-82a4-f648ed80d727 could not be found. Oct 17 14:00:37.659721 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:00:37.659721 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:00:37.659721 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:00:37.659721 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:00:37.659721 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:00:37.659721 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:00:37.659721 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:00:37.659721 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:00:37.659721 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d10ac72-2710-41c8-82a4-f648ed80d727 could not be found. Oct 17 14:00:37.659721 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:00:37.665559 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b75d82ff-2b82-4b3d-a300-ea10f71591da tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Returning 404 to user: Instance 5d10ac72-2710-41c8-82a4-f648ed80d727 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:00:37.666729 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b75d82ff-2b82-4b3d-a300-ea10f71591da tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/5d10ac72-2710-41c8-82a4-f648ed80d727" status: 404 len: 111 microversion: 2.1 time: 0.107706 Oct 17 14:00:37.677755 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5dd03eba-c020-4d22-9d5e-46211db17939 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:37.678614 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5dd03eba-c020-4d22-9d5e-46211db17939 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 3938cdd3-ee9e-4f8f-9a06-0439165b8638] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:37.684045 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2497/5123] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:37 2022] GET /compute/v2.1/servers/5d10ac72-2710-41c8-82a4-f648ed80d727 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:00:37.686703 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-5dd03eba-c020-4d22-9d5e-46211db17939 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] HTTP exception thrown: Instance 3938cdd3-ee9e-4f8f-9a06-0439165b8638 could not be found. Oct 17 14:00:37.689646 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5dd03eba-c020-4d22-9d5e-46211db17939 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Request method failure captured: Oct 17 14:00:37.689646 n-d-854247-14 devstack@n-api.service[127016]: request: DELETE /compute/v2.1/servers/3938cdd3-ee9e-4f8f-9a06-0439165b8638 HTTP/1.1 Oct 17 14:00:37.689646 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 14:00:37.689646 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 14:00:37.689646 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 14:00:37.689646 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 14:00:37.689646 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 14:00:37.689646 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 14:00:37.689646 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 14:00:37.689646 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 14:00:37.689646 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTV7tIaoYPgUdHiXX4NOkSSz-a4-puhL4AhnfvtJYmPyZ3fJvZDePMat9BASboFCn4C3QP9Vix9f7JprJ7jGUAeFojqdhpTvVML9HYK6oQI67GVbo4xYwR8dQKhVTSdcdIj_O_mmBimo8N7A_DyW-iY_pgxFAaVGSJ3vOytCqm8fGt3Q Oct 17 14:00:37.689646 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 14:00:37.689646 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 14:00:37.689646 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 14:00:37.689646 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 14:00:37.689646 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 14:00:37.689646 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 14:00:37.689646 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 0821e5beffdd41c2ad2adbd1d03cde71 Oct 17 14:00:37.689646 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-DeleteServersTestJSON-930683239 Oct 17 14:00:37.689646 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 14:00:37.689646 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 14:00:37.689646 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "tempest-type-757843761", "name": "tempest-service-527072566", "endpoints": [{"region": "tempest-region-1530587473", "publicURL": "https://url-594098419.com"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "tempest-type-1549021290", "name": "tempest-service-1797883724", "endpoints": [{"region": "tempest-region-85075699", "internalURL": "https://url-259507820.com"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0821e5beffdd41c2ad2adbd1d03cde71", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "tempest-type-1413520904", "name": "tempest-service-1708200528", "endpoints": []}] Oct 17 14:00:37.689646 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-DeleteServersTestJSON-930683239 Oct 17 14:00:37.689646 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 0821e5beffdd41c2ad2adbd1d03cde71 Oct 17 14:00:37.689646 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-DeleteServersTestJSON-930683239 Oct 17 14:00:37.689646 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-DeleteServersTestJSON-930683239-project Oct 17 14:00:37.689646 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 14:00:37.689646 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 14:00:37.689646 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: ab8baeba1d494df5bb9cf4d7289410b9 Oct 17 14:00:37.689646 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-DeleteServersTestJSON-930683239-project Oct 17 14:00:37.689646 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 14:00:37.689646 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 3938cdd3-ee9e-4f8f-9a06-0439165b8638 could not be found. Oct 17 14:00:37.689646 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '3938cdd3-ee9e-4f8f-9a06-0439165b8638'} Oct 17 14:00:37.689646 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:00:37.689646 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:00:37.689646 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:00:37.689646 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:00:37.689646 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:00:37.689646 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:00:37.689646 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 14:00:37.689646 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 14:00:37.689646 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3938cdd3-ee9e-4f8f-9a06-0439165b8638 could not be found. Oct 17 14:00:37.689646 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:00:37.689646 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:00:37.689646 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:00:37.689646 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:00:37.689646 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:00:37.689646 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:00:37.689646 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:00:37.689646 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:00:37.689646 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:00:37.689646 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:00:37.689646 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 14:00:37.689646 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 14:00:37.689646 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 14:00:37.689646 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 14:00:37.689646 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:00:37.689646 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:00:37.689646 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:00:37.692772 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:00:37.692772 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3938cdd3-ee9e-4f8f-9a06-0439165b8638 could not be found. Oct 17 14:00:37.692772 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:00:37.692772 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:00:37.692772 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:00:37.692772 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:00:37.692772 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:00:37.692772 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:00:37.692772 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:00:37.692772 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:00:37.692772 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3938cdd3-ee9e-4f8f-9a06-0439165b8638 could not be found. Oct 17 14:00:37.692772 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:00:37.695034 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5dd03eba-c020-4d22-9d5e-46211db17939 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Returning 404 to user: Instance 3938cdd3-ee9e-4f8f-9a06-0439165b8638 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:00:37.697311 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5dd03eba-c020-4d22-9d5e-46211db17939 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3938cdd3-ee9e-4f8f-9a06-0439165b8638" status: 404 len: 111 microversion: 2.1 time: 0.024436 Oct 17 14:00:37.708578 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2d58b4f5-5654-4a57-be3f-8500faf23340 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:37.709441 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2d58b4f5-5654-4a57-be3f-8500faf23340 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 3938cdd3-ee9e-4f8f-9a06-0439165b8638] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:37.711234 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2627/5124] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:00:37 2022] DELETE /compute/v2.1/servers/3938cdd3-ee9e-4f8f-9a06-0439165b8638 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:00:37.716291 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-2d58b4f5-5654-4a57-be3f-8500faf23340 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] HTTP exception thrown: Instance 3938cdd3-ee9e-4f8f-9a06-0439165b8638 could not be found. Oct 17 14:00:37.718196 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2d58b4f5-5654-4a57-be3f-8500faf23340 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Request method failure captured: Oct 17 14:00:37.718196 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/3938cdd3-ee9e-4f8f-9a06-0439165b8638 HTTP/1.1 Oct 17 14:00:37.718196 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 14:00:37.718196 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 14:00:37.718196 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 14:00:37.718196 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 14:00:37.718196 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 14:00:37.718196 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 14:00:37.718196 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 14:00:37.718196 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 14:00:37.718196 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTV7tIaoYPgUdHiXX4NOkSSz-a4-puhL4AhnfvtJYmPyZ3fJvZDePMat9BASboFCn4C3QP9Vix9f7JprJ7jGUAeFojqdhpTvVML9HYK6oQI67GVbo4xYwR8dQKhVTSdcdIj_O_mmBimo8N7A_DyW-iY_pgxFAaVGSJ3vOytCqm8fGt3Q Oct 17 14:00:37.718196 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 14:00:37.718196 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 14:00:37.718196 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 14:00:37.718196 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 14:00:37.718196 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 14:00:37.718196 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 14:00:37.718196 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 0821e5beffdd41c2ad2adbd1d03cde71 Oct 17 14:00:37.718196 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-DeleteServersTestJSON-930683239 Oct 17 14:00:37.718196 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 14:00:37.718196 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 14:00:37.718196 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "tempest-type-757843761", "name": "tempest-service-527072566", "endpoints": [{"region": "tempest-region-1530587473", "publicURL": "https://url-594098419.com"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "tempest-type-1549021290", "name": "tempest-service-1797883724", "endpoints": [{"region": "tempest-region-85075699", "internalURL": "https://url-259507820.com"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0821e5beffdd41c2ad2adbd1d03cde71", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "tempest-type-1413520904", "name": "tempest-service-1708200528", "endpoints": []}] Oct 17 14:00:37.718196 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-DeleteServersTestJSON-930683239 Oct 17 14:00:37.718196 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 0821e5beffdd41c2ad2adbd1d03cde71 Oct 17 14:00:37.718196 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-DeleteServersTestJSON-930683239 Oct 17 14:00:37.718196 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-DeleteServersTestJSON-930683239-project Oct 17 14:00:37.718196 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 14:00:37.718196 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 14:00:37.718196 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: ab8baeba1d494df5bb9cf4d7289410b9 Oct 17 14:00:37.718196 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-DeleteServersTestJSON-930683239-project Oct 17 14:00:37.718196 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 14:00:37.718196 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 3938cdd3-ee9e-4f8f-9a06-0439165b8638 could not be found. Oct 17 14:00:37.718196 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '3938cdd3-ee9e-4f8f-9a06-0439165b8638'} Oct 17 14:00:37.718196 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:00:37.718196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:00:37.718196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:00:37.718196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:00:37.718196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:00:37.718196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:00:37.718196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 14:00:37.718196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 14:00:37.718196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3938cdd3-ee9e-4f8f-9a06-0439165b8638 could not be found. Oct 17 14:00:37.718196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:00:37.718196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:00:37.718196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:00:37.718196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:00:37.718196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:00:37.718196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:00:37.718196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:00:37.718196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:00:37.718196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:00:37.718196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:00:37.718196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:00:37.718196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:00:37.718196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:00:37.718196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:00:37.718196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:00:37.718196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:00:37.718196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3938cdd3-ee9e-4f8f-9a06-0439165b8638 could not be found. Oct 17 14:00:37.721395 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:00:37.721395 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:00:37.721395 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:00:37.721395 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:00:37.721395 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:00:37.721395 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:00:37.721395 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:00:37.721395 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:00:37.721395 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3938cdd3-ee9e-4f8f-9a06-0439165b8638 could not be found. Oct 17 14:00:37.721395 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:00:37.724141 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2d58b4f5-5654-4a57-be3f-8500faf23340 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Returning 404 to user: Instance 3938cdd3-ee9e-4f8f-9a06-0439165b8638 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:00:37.725591 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2d58b4f5-5654-4a57-be3f-8500faf23340 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/3938cdd3-ee9e-4f8f-9a06-0439165b8638" status: 404 len: 111 microversion: 2.1 time: 0.021941 Oct 17 14:00:37.741147 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2498/5125] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:37 2022] GET /compute/v2.1/servers/3938cdd3-ee9e-4f8f-9a06-0439165b8638 => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:00:38.248660 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7d9286db-dbe9-4249-a934-f07ce48ffb88 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:38.249289 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7d9286db-dbe9-4249-a934-f07ce48ffb88 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] [instance: a60fd17a-8d63-4615-a521-c33db4273aeb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:38.270520 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7d9286db-dbe9-4249-a934-f07ce48ffb88 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:38.271031 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7d9286db-dbe9-4249-a934-f07ce48ffb88 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:38.277089 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7d9286db-dbe9-4249-a934-f07ce48ffb88 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:38.277921 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7d9286db-dbe9-4249-a934-f07ce48ffb88 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:38.278401 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7d9286db-dbe9-4249-a934-f07ce48ffb88 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:38.278845 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7d9286db-dbe9-4249-a934-f07ce48ffb88 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:38.439452 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7d9286db-dbe9-4249-a934-f07ce48ffb88 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:38.458648 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7d9286db-dbe9-4249-a934-f07ce48ffb88 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:38.460288 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7d9286db-dbe9-4249-a934-f07ce48ffb88 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:38.461688 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7d9286db-dbe9-4249-a934-f07ce48ffb88 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] 10.222.0.79 "GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb" status: 200 len: 1366 microversion: 2.47 time: 0.227880 Oct 17 14:00:38.467506 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2628/5126] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:00:38 2022] GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:00:39.503866 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b5c1fa83-fc48-4359-8915-8de2b6f6a791 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:39.505153 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b5c1fa83-fc48-4359-8915-8de2b6f6a791 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] [instance: a60fd17a-8d63-4615-a521-c33db4273aeb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:39.513875 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b5c1fa83-fc48-4359-8915-8de2b6f6a791 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:39.514710 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b5c1fa83-fc48-4359-8915-8de2b6f6a791 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:39.515544 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b5c1fa83-fc48-4359-8915-8de2b6f6a791 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:39.516719 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b5c1fa83-fc48-4359-8915-8de2b6f6a791 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:39.517288 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b5c1fa83-fc48-4359-8915-8de2b6f6a791 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:39.517915 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b5c1fa83-fc48-4359-8915-8de2b6f6a791 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:39.748062 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b5c1fa83-fc48-4359-8915-8de2b6f6a791 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:39.764688 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b5c1fa83-fc48-4359-8915-8de2b6f6a791 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:39.766292 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b5c1fa83-fc48-4359-8915-8de2b6f6a791 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:39.767562 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b5c1fa83-fc48-4359-8915-8de2b6f6a791 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] 10.222.0.79 "GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb" status: 200 len: 1366 microversion: 2.47 time: 0.269386 Oct 17 14:00:39.787241 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2499/5127] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:00:39 2022] GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb => generated 1366 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:00:40.806815 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5e4e024c-486a-45f6-a4f4-357f1296ddca tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:40.808553 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5e4e024c-486a-45f6-a4f4-357f1296ddca tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] [instance: a60fd17a-8d63-4615-a521-c33db4273aeb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:40.827708 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5e4e024c-486a-45f6-a4f4-357f1296ddca tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:40.828598 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5e4e024c-486a-45f6-a4f4-357f1296ddca tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:40.829857 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5e4e024c-486a-45f6-a4f4-357f1296ddca tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:40.832867 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5e4e024c-486a-45f6-a4f4-357f1296ddca tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:40.834032 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5e4e024c-486a-45f6-a4f4-357f1296ddca tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:40.835682 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5e4e024c-486a-45f6-a4f4-357f1296ddca tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:40.847917 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:00:40.995656 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5e4e024c-486a-45f6-a4f4-357f1296ddca tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:41.021277 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5e4e024c-486a-45f6-a4f4-357f1296ddca tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:41.025248 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5e4e024c-486a-45f6-a4f4-357f1296ddca tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:41.034735 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5e4e024c-486a-45f6-a4f4-357f1296ddca tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] 10.222.0.79 "GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb" status: 200 len: 1366 microversion: 2.47 time: 0.237830 Oct 17 14:00:41.043623 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2629/5128] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:00:40 2022] GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb => generated 1366 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:00:42.073464 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1f23fe4f-73e5-40ff-8945-cdc2bc6420cb tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:42.074724 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1f23fe4f-73e5-40ff-8945-cdc2bc6420cb tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] [instance: a60fd17a-8d63-4615-a521-c33db4273aeb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:42.088402 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1f23fe4f-73e5-40ff-8945-cdc2bc6420cb tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:42.090310 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1f23fe4f-73e5-40ff-8945-cdc2bc6420cb tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:42.091881 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1f23fe4f-73e5-40ff-8945-cdc2bc6420cb tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:42.093892 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1f23fe4f-73e5-40ff-8945-cdc2bc6420cb tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:42.097532 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1f23fe4f-73e5-40ff-8945-cdc2bc6420cb tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:42.099629 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1f23fe4f-73e5-40ff-8945-cdc2bc6420cb tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:42.242937 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1f23fe4f-73e5-40ff-8945-cdc2bc6420cb tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:42.260558 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1f23fe4f-73e5-40ff-8945-cdc2bc6420cb tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:42.262866 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1f23fe4f-73e5-40ff-8945-cdc2bc6420cb tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:42.265102 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1f23fe4f-73e5-40ff-8945-cdc2bc6420cb tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] 10.222.0.79 "GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb" status: 200 len: 1366 microversion: 2.47 time: 0.197824 Oct 17 14:00:42.266880 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2500/5129] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:00:42 2022] GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:00:43.294641 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3be6a0b5-730a-4c17-8871-9a9b733aafa1 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:43.296011 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3be6a0b5-730a-4c17-8871-9a9b733aafa1 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] [instance: a60fd17a-8d63-4615-a521-c33db4273aeb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:43.307234 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3be6a0b5-730a-4c17-8871-9a9b733aafa1 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:43.315588 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3be6a0b5-730a-4c17-8871-9a9b733aafa1 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:43.316267 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3be6a0b5-730a-4c17-8871-9a9b733aafa1 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:43.317168 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3be6a0b5-730a-4c17-8871-9a9b733aafa1 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:43.320133 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3be6a0b5-730a-4c17-8871-9a9b733aafa1 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:43.321368 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3be6a0b5-730a-4c17-8871-9a9b733aafa1 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:43.569661 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3be6a0b5-730a-4c17-8871-9a9b733aafa1 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:43.597939 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3be6a0b5-730a-4c17-8871-9a9b733aafa1 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:43.606133 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3be6a0b5-730a-4c17-8871-9a9b733aafa1 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:43.607785 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3be6a0b5-730a-4c17-8871-9a9b733aafa1 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] 10.222.0.79 "GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb" status: 200 len: 1366 microversion: 2.47 time: 0.317497 Oct 17 14:00:43.614209 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2630/5130] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:00:43 2022] GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb => generated 1366 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:00:44.645031 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6cd88c10-684f-41f5-b27f-acb9f1c480b2 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:44.646391 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6cd88c10-684f-41f5-b27f-acb9f1c480b2 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] [instance: a60fd17a-8d63-4615-a521-c33db4273aeb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:44.665734 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6cd88c10-684f-41f5-b27f-acb9f1c480b2 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:44.667281 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6cd88c10-684f-41f5-b27f-acb9f1c480b2 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:44.674673 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6cd88c10-684f-41f5-b27f-acb9f1c480b2 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:44.675840 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6cd88c10-684f-41f5-b27f-acb9f1c480b2 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:44.677221 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6cd88c10-684f-41f5-b27f-acb9f1c480b2 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:44.677902 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6cd88c10-684f-41f5-b27f-acb9f1c480b2 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:44.937736 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6cd88c10-684f-41f5-b27f-acb9f1c480b2 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:44.959330 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6cd88c10-684f-41f5-b27f-acb9f1c480b2 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:44.961456 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6cd88c10-684f-41f5-b27f-acb9f1c480b2 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:44.969387 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6cd88c10-684f-41f5-b27f-acb9f1c480b2 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] 10.222.0.79 "GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb" status: 200 len: 1366 microversion: 2.47 time: 0.329008 Oct 17 14:00:44.975300 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2501/5131] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:00:44 2022] GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb => generated 1366 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:00:45.999214 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-21b5831a-0969-402d-a266-c74642cfac42 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:46.000014 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-21b5831a-0969-402d-a266-c74642cfac42 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] [instance: a60fd17a-8d63-4615-a521-c33db4273aeb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:46.028569 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-21b5831a-0969-402d-a266-c74642cfac42 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:46.029354 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-21b5831a-0969-402d-a266-c74642cfac42 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:46.030118 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-21b5831a-0969-402d-a266-c74642cfac42 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:46.036408 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-21b5831a-0969-402d-a266-c74642cfac42 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:46.044951 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-21b5831a-0969-402d-a266-c74642cfac42 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:46.045992 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-21b5831a-0969-402d-a266-c74642cfac42 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:46.367856 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-21b5831a-0969-402d-a266-c74642cfac42 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:46.384707 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-21b5831a-0969-402d-a266-c74642cfac42 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:46.392132 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-21b5831a-0969-402d-a266-c74642cfac42 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:46.400853 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-21b5831a-0969-402d-a266-c74642cfac42 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] 10.222.0.79 "GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb" status: 200 len: 1366 microversion: 2.47 time: 0.405391 Oct 17 14:00:46.415197 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2631/5132] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:00:45 2022] GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb => generated 1366 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:00:47.173885 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-aad706b1-bb0e-4f59-97d7-9e1c4e9eb4e2 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Action: 'create', calling method: .version_select at 0x7f7cd44f64c0>, body: {"keypair": {"name": "tempest-keypair-516393464", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPL8JNU42phLZiHFj+SrYhKuvNT35vjojLvpOh5UUnHRYGIhfNhMT8zyzC/NCzFLuAKnAvHiCFr9le/HPQ0WWKiKV0XO4s6VgqgooGzWx6QGits7cbzr7di+Bmx7T1/SSw=="}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:00:47.181065 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:00:47.236294 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-aad706b1-bb0e-4f59-97d7-9e1c4e9eb4e2 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Getting quotas for project 6dcc0bf813dc4a4fa2fd7d6f5521ae85. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:00:47.263918 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-aad706b1-bb0e-4f59-97d7-9e1c4e9eb4e2 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Getting quotas for user 9c7ac3dcc4ff4dd2bb68738c72e9507f and project 6dcc0bf813dc4a4fa2fd7d6f5521ae85. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:00:47.313389 n-d-854247-14 devstack@n-api.service[127017]: ERROR oslo.messaging._drivers.impl_rabbit [None req-aad706b1-bb0e-4f59-97d7-9e1c4e9eb4e2 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [db279165-5189-40f8-9e6f-0af7f7bfcb49] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 14:00:47.433273 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ced34975-2b1e-4c20-9147-6bed6879726c tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:47.434582 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ced34975-2b1e-4c20-9147-6bed6879726c tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] [instance: a60fd17a-8d63-4615-a521-c33db4273aeb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:47.451262 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ced34975-2b1e-4c20-9147-6bed6879726c tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:47.452071 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ced34975-2b1e-4c20-9147-6bed6879726c tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:47.452825 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ced34975-2b1e-4c20-9147-6bed6879726c tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:47.453906 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ced34975-2b1e-4c20-9147-6bed6879726c tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:47.455021 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ced34975-2b1e-4c20-9147-6bed6879726c tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:47.455669 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ced34975-2b1e-4c20-9147-6bed6879726c tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:47.628546 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ced34975-2b1e-4c20-9147-6bed6879726c tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:47.644104 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ced34975-2b1e-4c20-9147-6bed6879726c tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:47.649726 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ced34975-2b1e-4c20-9147-6bed6879726c tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:47.650919 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ced34975-2b1e-4c20-9147-6bed6879726c tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] 10.222.0.79 "GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb" status: 200 len: 1366 microversion: 2.47 time: 0.222716 Oct 17 14:00:47.651945 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2632/5133] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:00:47 2022] GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:00:47.996728 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5919e776-ea75-44c9-a916-1f210528ef86 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:47.997427 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5919e776-ea75-44c9-a916-1f210528ef86 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 2660a6f7-5d40-4205-ad68-abf319f1c4c3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:48.011992 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5919e776-ea75-44c9-a916-1f210528ef86 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:48.012810 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5919e776-ea75-44c9-a916-1f210528ef86 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:48.013608 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5919e776-ea75-44c9-a916-1f210528ef86 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:48.014865 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5919e776-ea75-44c9-a916-1f210528ef86 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:48.016647 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5919e776-ea75-44c9-a916-1f210528ef86 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:48.019056 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5919e776-ea75-44c9-a916-1f210528ef86 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:48.065347 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-5919e776-ea75-44c9-a916-1f210528ef86 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] HTTP exception thrown: Instance 2660a6f7-5d40-4205-ad68-abf319f1c4c3 could not be found. Oct 17 14:00:48.066856 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5919e776-ea75-44c9-a916-1f210528ef86 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Request method failure captured: Oct 17 14:00:48.066856 n-d-854247-14 devstack@n-api.service[127016]: request: DELETE /compute/v2.1/servers/2660a6f7-5d40-4205-ad68-abf319f1c4c3 HTTP/1.1 Oct 17 14:00:48.066856 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 14:00:48.066856 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 14:00:48.066856 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 14:00:48.066856 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 14:00:48.066856 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 14:00:48.066856 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 14:00:48.066856 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 14:00:48.066856 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 14:00:48.066856 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTV7tIaoYPgUdHiXX4NOkSSz-a4-puhL4AhnfvtJYmPyZ3fJvZDePMat9BASboFCn4C3QP9Vix9f7JprJ7jGUAeFojqdhpTvVML9HYK6oQI67GVbo4xYwR8dQKhVTSdcdIj_O_mmBimo8N7A_DyW-iY_pgxFAaVGSJ3vOytCqm8fGt3Q Oct 17 14:00:48.066856 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 14:00:48.066856 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 14:00:48.066856 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 14:00:48.066856 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 14:00:48.066856 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 14:00:48.066856 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 14:00:48.066856 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 0821e5beffdd41c2ad2adbd1d03cde71 Oct 17 14:00:48.066856 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-DeleteServersTestJSON-930683239 Oct 17 14:00:48.066856 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 14:00:48.066856 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 14:00:48.066856 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "tempest-type-757843761", "name": "tempest-service-527072566", "endpoints": [{"region": "tempest-region-1530587473", "publicURL": "https://url-594098419.com"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "tempest-type-1549021290", "name": "tempest-service-1797883724", "endpoints": [{"region": "tempest-region-85075699", "internalURL": "https://url-259507820.com"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0821e5beffdd41c2ad2adbd1d03cde71", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "tempest-type-1413520904", "name": "tempest-service-1708200528", "endpoints": []}] Oct 17 14:00:48.066856 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-DeleteServersTestJSON-930683239 Oct 17 14:00:48.066856 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 0821e5beffdd41c2ad2adbd1d03cde71 Oct 17 14:00:48.066856 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-DeleteServersTestJSON-930683239 Oct 17 14:00:48.066856 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-DeleteServersTestJSON-930683239-project Oct 17 14:00:48.066856 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 14:00:48.066856 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 14:00:48.066856 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: ab8baeba1d494df5bb9cf4d7289410b9 Oct 17 14:00:48.066856 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-DeleteServersTestJSON-930683239-project Oct 17 14:00:48.066856 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 14:00:48.066856 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 2660a6f7-5d40-4205-ad68-abf319f1c4c3 could not be found. Oct 17 14:00:48.066856 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '2660a6f7-5d40-4205-ad68-abf319f1c4c3'} Oct 17 14:00:48.066856 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:00:48.066856 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:00:48.066856 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:00:48.066856 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:00:48.066856 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:00:48.066856 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:00:48.066856 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:00:48.066856 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:00:48.066856 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:00:48.066856 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:00:48.066856 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2660a6f7-5d40-4205-ad68-abf319f1c4c3 could not be found. Oct 17 14:00:48.066856 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:00:48.066856 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:00:48.066856 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:00:48.066856 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:00:48.066856 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:00:48.066856 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:00:48.066856 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:00:48.066856 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:00:48.066856 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:00:48.066856 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:00:48.066856 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 14:00:48.066856 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 14:00:48.066856 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 14:00:48.066856 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 14:00:48.066856 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:00:48.070344 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:00:48.070344 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:00:48.070344 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:00:48.070344 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2660a6f7-5d40-4205-ad68-abf319f1c4c3 could not be found. Oct 17 14:00:48.070344 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:00:48.070344 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:00:48.070344 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:00:48.070344 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:00:48.070344 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:00:48.070344 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:00:48.070344 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:00:48.070344 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:00:48.070344 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2660a6f7-5d40-4205-ad68-abf319f1c4c3 could not be found. Oct 17 14:00:48.070344 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:00:48.070344 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5919e776-ea75-44c9-a916-1f210528ef86 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Returning 404 to user: Instance 2660a6f7-5d40-4205-ad68-abf319f1c4c3 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:00:48.071620 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5919e776-ea75-44c9-a916-1f210528ef86 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "DELETE /compute/v2.1/servers/2660a6f7-5d40-4205-ad68-abf319f1c4c3" status: 404 len: 111 microversion: 2.1 time: 0.078721 Oct 17 14:00:48.072871 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2633/5134] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:00:47 2022] DELETE /compute/v2.1/servers/2660a6f7-5d40-4205-ad68-abf319f1c4c3 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:00:48.083590 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b5a6a63f-458a-4c60-954c-66e2a7dc98a9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:48.085461 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b5a6a63f-458a-4c60-954c-66e2a7dc98a9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: 2660a6f7-5d40-4205-ad68-abf319f1c4c3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:48.104341 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b5a6a63f-458a-4c60-954c-66e2a7dc98a9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:48.108663 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b5a6a63f-458a-4c60-954c-66e2a7dc98a9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:48.110727 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b5a6a63f-458a-4c60-954c-66e2a7dc98a9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:48.113687 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b5a6a63f-458a-4c60-954c-66e2a7dc98a9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:48.114979 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b5a6a63f-458a-4c60-954c-66e2a7dc98a9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:48.116886 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b5a6a63f-458a-4c60-954c-66e2a7dc98a9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:48.165076 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-b5a6a63f-458a-4c60-954c-66e2a7dc98a9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] HTTP exception thrown: Instance 2660a6f7-5d40-4205-ad68-abf319f1c4c3 could not be found. Oct 17 14:00:48.170619 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b5a6a63f-458a-4c60-954c-66e2a7dc98a9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Request method failure captured: Oct 17 14:00:48.170619 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/2660a6f7-5d40-4205-ad68-abf319f1c4c3 HTTP/1.1 Oct 17 14:00:48.170619 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 14:00:48.170619 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 14:00:48.170619 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 14:00:48.170619 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 14:00:48.170619 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 14:00:48.170619 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 14:00:48.170619 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 14:00:48.170619 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 14:00:48.170619 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTV7tIaoYPgUdHiXX4NOkSSz-a4-puhL4AhnfvtJYmPyZ3fJvZDePMat9BASboFCn4C3QP9Vix9f7JprJ7jGUAeFojqdhpTvVML9HYK6oQI67GVbo4xYwR8dQKhVTSdcdIj_O_mmBimo8N7A_DyW-iY_pgxFAaVGSJ3vOytCqm8fGt3Q Oct 17 14:00:48.170619 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 14:00:48.170619 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 14:00:48.170619 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 14:00:48.170619 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 14:00:48.170619 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 14:00:48.170619 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 14:00:48.170619 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 0821e5beffdd41c2ad2adbd1d03cde71 Oct 17 14:00:48.170619 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-DeleteServersTestJSON-930683239 Oct 17 14:00:48.170619 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 14:00:48.170619 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 14:00:48.170619 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "tempest-type-757843761", "name": "tempest-service-527072566", "endpoints": [{"region": "tempest-region-1530587473", "publicURL": "https://url-594098419.com"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "tempest-type-1549021290", "name": "tempest-service-1797883724", "endpoints": [{"region": "tempest-region-85075699", "internalURL": "https://url-259507820.com"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0821e5beffdd41c2ad2adbd1d03cde71", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "tempest-type-1413520904", "name": "tempest-service-1708200528", "endpoints": []}] Oct 17 14:00:48.170619 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-DeleteServersTestJSON-930683239 Oct 17 14:00:48.170619 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 0821e5beffdd41c2ad2adbd1d03cde71 Oct 17 14:00:48.170619 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-DeleteServersTestJSON-930683239 Oct 17 14:00:48.170619 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-DeleteServersTestJSON-930683239-project Oct 17 14:00:48.170619 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 14:00:48.170619 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 14:00:48.170619 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: ab8baeba1d494df5bb9cf4d7289410b9 Oct 17 14:00:48.170619 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-DeleteServersTestJSON-930683239-project Oct 17 14:00:48.170619 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 14:00:48.170619 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 2660a6f7-5d40-4205-ad68-abf319f1c4c3 could not be found. Oct 17 14:00:48.170619 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '2660a6f7-5d40-4205-ad68-abf319f1c4c3'} Oct 17 14:00:48.170619 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:00:48.170619 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:00:48.170619 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:00:48.170619 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:00:48.170619 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:00:48.170619 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:00:48.170619 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:00:48.170619 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:00:48.170619 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:00:48.170619 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:00:48.170619 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2660a6f7-5d40-4205-ad68-abf319f1c4c3 could not be found. Oct 17 14:00:48.170619 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:00:48.170619 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:00:48.170619 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:00:48.170619 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:00:48.170619 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:00:48.170619 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:00:48.170619 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:00:48.170619 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:00:48.170619 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:00:48.170619 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:00:48.170619 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:00:48.170619 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:00:48.170619 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:00:48.170619 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:00:48.170619 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:00:48.175029 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:00:48.175029 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2660a6f7-5d40-4205-ad68-abf319f1c4c3 could not be found. Oct 17 14:00:48.175029 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:00:48.175029 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:00:48.175029 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:00:48.175029 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:00:48.175029 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:00:48.175029 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:00:48.175029 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:00:48.175029 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:00:48.175029 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2660a6f7-5d40-4205-ad68-abf319f1c4c3 could not be found. Oct 17 14:00:48.175029 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:00:48.180646 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b5a6a63f-458a-4c60-954c-66e2a7dc98a9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Returning 404 to user: Instance 2660a6f7-5d40-4205-ad68-abf319f1c4c3 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:00:48.183804 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b5a6a63f-458a-4c60-954c-66e2a7dc98a9 tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/2660a6f7-5d40-4205-ad68-abf319f1c4c3" status: 404 len: 111 microversion: 2.1 time: 0.104855 Oct 17 14:00:48.190020 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2634/5135] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:48 2022] GET /compute/v2.1/servers/2660a6f7-5d40-4205-ad68-abf319f1c4c3 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:00:48.206394 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0685f615-25ff-4e06-9ab0-623a97364dab tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:48.208249 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0685f615-25ff-4e06-9ab0-623a97364dab tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: d3018df0-e202-4fa2-91ad-e9fe210ea9ad] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:48.222201 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0685f615-25ff-4e06-9ab0-623a97364dab tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:48.223911 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0685f615-25ff-4e06-9ab0-623a97364dab tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:48.224603 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0685f615-25ff-4e06-9ab0-623a97364dab tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:48.236487 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0685f615-25ff-4e06-9ab0-623a97364dab tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:48.239393 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0685f615-25ff-4e06-9ab0-623a97364dab tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:48.239974 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0685f615-25ff-4e06-9ab0-623a97364dab tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:48.281135 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-0685f615-25ff-4e06-9ab0-623a97364dab tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] HTTP exception thrown: Instance d3018df0-e202-4fa2-91ad-e9fe210ea9ad could not be found. Oct 17 14:00:48.284421 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0685f615-25ff-4e06-9ab0-623a97364dab tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Request method failure captured: Oct 17 14:00:48.284421 n-d-854247-14 devstack@n-api.service[127016]: request: DELETE /compute/v2.1/servers/d3018df0-e202-4fa2-91ad-e9fe210ea9ad HTTP/1.1 Oct 17 14:00:48.284421 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 14:00:48.284421 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 14:00:48.284421 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 14:00:48.284421 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 14:00:48.284421 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 14:00:48.284421 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 14:00:48.284421 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 14:00:48.284421 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 14:00:48.284421 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTV7tIaoYPgUdHiXX4NOkSSz-a4-puhL4AhnfvtJYmPyZ3fJvZDePMat9BASboFCn4C3QP9Vix9f7JprJ7jGUAeFojqdhpTvVML9HYK6oQI67GVbo4xYwR8dQKhVTSdcdIj_O_mmBimo8N7A_DyW-iY_pgxFAaVGSJ3vOytCqm8fGt3Q Oct 17 14:00:48.284421 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 14:00:48.284421 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 14:00:48.284421 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 14:00:48.284421 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 14:00:48.284421 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 14:00:48.284421 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 14:00:48.284421 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 0821e5beffdd41c2ad2adbd1d03cde71 Oct 17 14:00:48.284421 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-DeleteServersTestJSON-930683239 Oct 17 14:00:48.284421 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 14:00:48.284421 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 14:00:48.284421 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "tempest-type-757843761", "name": "tempest-service-527072566", "endpoints": [{"region": "tempest-region-1530587473", "publicURL": "https://url-594098419.com"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "tempest-type-1549021290", "name": "tempest-service-1797883724", "endpoints": [{"region": "tempest-region-85075699", "internalURL": "https://url-259507820.com"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0821e5beffdd41c2ad2adbd1d03cde71", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "tempest-type-1413520904", "name": "tempest-service-1708200528", "endpoints": []}] Oct 17 14:00:48.284421 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-DeleteServersTestJSON-930683239 Oct 17 14:00:48.284421 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 0821e5beffdd41c2ad2adbd1d03cde71 Oct 17 14:00:48.284421 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-DeleteServersTestJSON-930683239 Oct 17 14:00:48.284421 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-DeleteServersTestJSON-930683239-project Oct 17 14:00:48.284421 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 14:00:48.284421 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 14:00:48.284421 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: ab8baeba1d494df5bb9cf4d7289410b9 Oct 17 14:00:48.284421 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-DeleteServersTestJSON-930683239-project Oct 17 14:00:48.284421 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 14:00:48.284421 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance d3018df0-e202-4fa2-91ad-e9fe210ea9ad could not be found. Oct 17 14:00:48.284421 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'd3018df0-e202-4fa2-91ad-e9fe210ea9ad'} Oct 17 14:00:48.284421 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:00:48.284421 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:00:48.284421 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:00:48.284421 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:00:48.284421 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:00:48.284421 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:00:48.284421 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:00:48.284421 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:00:48.284421 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:00:48.284421 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:00:48.284421 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3018df0-e202-4fa2-91ad-e9fe210ea9ad could not be found. Oct 17 14:00:48.284421 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:00:48.284421 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:00:48.284421 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:00:48.284421 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:00:48.284421 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:00:48.284421 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:00:48.284421 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:00:48.284421 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:00:48.284421 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:00:48.284421 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:00:48.284421 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 14:00:48.284421 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 14:00:48.284421 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 14:00:48.284421 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 14:00:48.284421 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:00:48.287798 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:00:48.287798 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:00:48.287798 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:00:48.287798 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3018df0-e202-4fa2-91ad-e9fe210ea9ad could not be found. Oct 17 14:00:48.287798 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:00:48.287798 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:00:48.287798 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:00:48.287798 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:00:48.287798 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:00:48.287798 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:00:48.287798 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:00:48.287798 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:00:48.287798 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3018df0-e202-4fa2-91ad-e9fe210ea9ad could not be found. Oct 17 14:00:48.287798 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:00:48.288559 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0685f615-25ff-4e06-9ab0-623a97364dab tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Returning 404 to user: Instance d3018df0-e202-4fa2-91ad-e9fe210ea9ad could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:00:48.291949 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0685f615-25ff-4e06-9ab0-623a97364dab tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "DELETE /compute/v2.1/servers/d3018df0-e202-4fa2-91ad-e9fe210ea9ad" status: 404 len: 111 microversion: 2.1 time: 0.097158 Oct 17 14:00:48.297279 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2635/5136] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:00:48 2022] DELETE /compute/v2.1/servers/d3018df0-e202-4fa2-91ad-e9fe210ea9ad => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:00:48.311042 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-be528c82-5a88-4e5b-824a-82a44e5555aa tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:48.314366 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-be528c82-5a88-4e5b-824a-82a44e5555aa tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] [instance: d3018df0-e202-4fa2-91ad-e9fe210ea9ad] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:48.321059 n-d-854247-14 devstack@n-api.service[127017]: INFO oslo.messaging._drivers.impl_rabbit [None req-aad706b1-bb0e-4f59-97d7-9e1c4e9eb4e2 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [db279165-5189-40f8-9e6f-0af7f7bfcb49] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 58394. Oct 17 14:00:48.340015 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be528c82-5a88-4e5b-824a-82a44e5555aa tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:48.341788 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be528c82-5a88-4e5b-824a-82a44e5555aa tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:48.345501 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be528c82-5a88-4e5b-824a-82a44e5555aa tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:48.349531 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be528c82-5a88-4e5b-824a-82a44e5555aa tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:48.349908 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-aad706b1-bb0e-4f59-97d7-9e1c4e9eb4e2 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.827753 Oct 17 14:00:48.351055 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2502/5137] 10.222.0.79 () {62 vars in 1200 bytes} [Mon Oct 17 14:00:46 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1830 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 17 14:00:48.352062 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be528c82-5a88-4e5b-824a-82a44e5555aa tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:48.353759 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be528c82-5a88-4e5b-824a-82a44e5555aa tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:48.399232 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-be528c82-5a88-4e5b-824a-82a44e5555aa tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] HTTP exception thrown: Instance d3018df0-e202-4fa2-91ad-e9fe210ea9ad could not be found. Oct 17 14:00:48.401224 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-be528c82-5a88-4e5b-824a-82a44e5555aa tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Request method failure captured: Oct 17 14:00:48.401224 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/d3018df0-e202-4fa2-91ad-e9fe210ea9ad HTTP/1.1 Oct 17 14:00:48.401224 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 14:00:48.401224 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 14:00:48.401224 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 14:00:48.401224 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 14:00:48.401224 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 14:00:48.401224 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 14:00:48.401224 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 14:00:48.401224 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 14:00:48.401224 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTV7tIaoYPgUdHiXX4NOkSSz-a4-puhL4AhnfvtJYmPyZ3fJvZDePMat9BASboFCn4C3QP9Vix9f7JprJ7jGUAeFojqdhpTvVML9HYK6oQI67GVbo4xYwR8dQKhVTSdcdIj_O_mmBimo8N7A_DyW-iY_pgxFAaVGSJ3vOytCqm8fGt3Q Oct 17 14:00:48.401224 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 14:00:48.401224 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 14:00:48.401224 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 14:00:48.401224 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 14:00:48.401224 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 14:00:48.401224 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 14:00:48.401224 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 0821e5beffdd41c2ad2adbd1d03cde71 Oct 17 14:00:48.401224 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-DeleteServersTestJSON-930683239 Oct 17 14:00:48.401224 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 14:00:48.401224 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 14:00:48.401224 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "tempest-type-757843761", "name": "tempest-service-527072566", "endpoints": [{"region": "tempest-region-1530587473", "publicURL": "https://url-594098419.com"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "tempest-type-1549021290", "name": "tempest-service-1797883724", "endpoints": [{"region": "tempest-region-85075699", "internalURL": "https://url-259507820.com"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0821e5beffdd41c2ad2adbd1d03cde71"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0821e5beffdd41c2ad2adbd1d03cde71", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "tempest-type-1413520904", "name": "tempest-service-1708200528", "endpoints": []}] Oct 17 14:00:48.401224 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-DeleteServersTestJSON-930683239 Oct 17 14:00:48.401224 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 0821e5beffdd41c2ad2adbd1d03cde71 Oct 17 14:00:48.401224 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-DeleteServersTestJSON-930683239 Oct 17 14:00:48.401224 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-DeleteServersTestJSON-930683239-project Oct 17 14:00:48.401224 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 14:00:48.401224 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 14:00:48.401224 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: ab8baeba1d494df5bb9cf4d7289410b9 Oct 17 14:00:48.401224 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-DeleteServersTestJSON-930683239-project Oct 17 14:00:48.401224 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 14:00:48.401224 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance d3018df0-e202-4fa2-91ad-e9fe210ea9ad could not be found. Oct 17 14:00:48.401224 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'd3018df0-e202-4fa2-91ad-e9fe210ea9ad'} Oct 17 14:00:48.401224 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:00:48.401224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:00:48.401224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:00:48.401224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:00:48.401224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:00:48.401224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:00:48.401224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:00:48.401224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:00:48.401224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:00:48.401224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:00:48.401224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3018df0-e202-4fa2-91ad-e9fe210ea9ad could not be found. Oct 17 14:00:48.401224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:00:48.401224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:00:48.401224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:00:48.401224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:00:48.401224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:00:48.401224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:00:48.401224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:00:48.401224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:00:48.401224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:00:48.401224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:00:48.401224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:00:48.401224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:00:48.401224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:00:48.401224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:00:48.401224 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:00:48.405149 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:00:48.405149 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3018df0-e202-4fa2-91ad-e9fe210ea9ad could not be found. Oct 17 14:00:48.405149 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:00:48.405149 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:00:48.405149 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:00:48.405149 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:00:48.405149 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:00:48.405149 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:00:48.405149 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:00:48.405149 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:00:48.405149 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3018df0-e202-4fa2-91ad-e9fe210ea9ad could not be found. Oct 17 14:00:48.405149 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:00:48.407764 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-be528c82-5a88-4e5b-824a-82a44e5555aa tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] Returning 404 to user: Instance d3018df0-e202-4fa2-91ad-e9fe210ea9ad could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:00:48.409539 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-be528c82-5a88-4e5b-824a-82a44e5555aa tempest-DeleteServersTestJSON-930683239 tempest-DeleteServersTestJSON-930683239-project] 10.222.0.79 "GET /compute/v2.1/servers/d3018df0-e202-4fa2-91ad-e9fe210ea9ad" status: 404 len: 111 microversion: 2.1 time: 0.110548 Oct 17 14:00:48.414660 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2636/5138] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:48 2022] GET /compute/v2.1/servers/d3018df0-e202-4fa2-91ad-e9fe210ea9ad => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:00:48.678308 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-027faf9e-0d84-443c-b3c2-97465c909c5e tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:48.678970 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-027faf9e-0d84-443c-b3c2-97465c909c5e tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] [instance: a60fd17a-8d63-4615-a521-c33db4273aeb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:48.713931 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-027faf9e-0d84-443c-b3c2-97465c909c5e tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:48.716373 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-027faf9e-0d84-443c-b3c2-97465c909c5e tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:48.716979 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-027faf9e-0d84-443c-b3c2-97465c909c5e tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:48.718369 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-027faf9e-0d84-443c-b3c2-97465c909c5e tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:48.724691 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-027faf9e-0d84-443c-b3c2-97465c909c5e tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:48.731898 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-027faf9e-0d84-443c-b3c2-97465c909c5e tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:49.152147 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-027faf9e-0d84-443c-b3c2-97465c909c5e tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:49.167942 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-027faf9e-0d84-443c-b3c2-97465c909c5e tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:49.169773 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-027faf9e-0d84-443c-b3c2-97465c909c5e tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:49.172642 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-027faf9e-0d84-443c-b3c2-97465c909c5e tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] 10.222.0.79 "GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb" status: 200 len: 1366 microversion: 2.47 time: 0.498269 Oct 17 14:00:49.188271 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2503/5139] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:00:48 2022] GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb => generated 1366 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:00:50.206632 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b9b61e23-75f4-48a7-9c00-ff9fe1e7a3cf tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:50.208363 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b9b61e23-75f4-48a7-9c00-ff9fe1e7a3cf tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] [instance: a60fd17a-8d63-4615-a521-c33db4273aeb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:50.236012 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b9b61e23-75f4-48a7-9c00-ff9fe1e7a3cf tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:50.236813 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b9b61e23-75f4-48a7-9c00-ff9fe1e7a3cf tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:50.237541 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b9b61e23-75f4-48a7-9c00-ff9fe1e7a3cf tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:50.238435 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b9b61e23-75f4-48a7-9c00-ff9fe1e7a3cf tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:50.239120 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b9b61e23-75f4-48a7-9c00-ff9fe1e7a3cf tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:50.239722 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b9b61e23-75f4-48a7-9c00-ff9fe1e7a3cf tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:50.490168 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b9b61e23-75f4-48a7-9c00-ff9fe1e7a3cf tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:50.490168 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b9b61e23-75f4-48a7-9c00-ff9fe1e7a3cf tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:50.490168 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b9b61e23-75f4-48a7-9c00-ff9fe1e7a3cf tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:50.490168 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b9b61e23-75f4-48a7-9c00-ff9fe1e7a3cf tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] 10.222.0.79 "GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb" status: 200 len: 1366 microversion: 2.47 time: 0.249028 Oct 17 14:00:50.490168 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2637/5140] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:00:50 2022] GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb => generated 1366 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:00:51.480458 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9b9c407e-9c30-42f6-8a73-b821c2964e9c tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:51.481110 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9b9c407e-9c30-42f6-8a73-b821c2964e9c tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] [instance: a60fd17a-8d63-4615-a521-c33db4273aeb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:51.522471 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9b9c407e-9c30-42f6-8a73-b821c2964e9c tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:51.527966 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9b9c407e-9c30-42f6-8a73-b821c2964e9c tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:51.528445 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9b9c407e-9c30-42f6-8a73-b821c2964e9c tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:51.529224 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9b9c407e-9c30-42f6-8a73-b821c2964e9c tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:51.529695 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9b9c407e-9c30-42f6-8a73-b821c2964e9c tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:51.530131 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9b9c407e-9c30-42f6-8a73-b821c2964e9c tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:51.753301 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9b9c407e-9c30-42f6-8a73-b821c2964e9c tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:51.764259 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9b9c407e-9c30-42f6-8a73-b821c2964e9c tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:51.766415 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9b9c407e-9c30-42f6-8a73-b821c2964e9c tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:51.768601 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9b9c407e-9c30-42f6-8a73-b821c2964e9c tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] 10.222.0.79 "GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb" status: 200 len: 1366 microversion: 2.47 time: 0.294651 Oct 17 14:00:51.781848 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2504/5141] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:00:51 2022] GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb => generated 1366 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:00:52.802405 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-70dc7c6e-1a2d-460c-b029-7dd3fa85fdaa tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:52.803040 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-70dc7c6e-1a2d-460c-b029-7dd3fa85fdaa tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] [instance: a60fd17a-8d63-4615-a521-c33db4273aeb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:52.822104 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-70dc7c6e-1a2d-460c-b029-7dd3fa85fdaa tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:52.822625 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-70dc7c6e-1a2d-460c-b029-7dd3fa85fdaa tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:52.823072 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-70dc7c6e-1a2d-460c-b029-7dd3fa85fdaa tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:52.823858 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-70dc7c6e-1a2d-460c-b029-7dd3fa85fdaa tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:52.824280 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-70dc7c6e-1a2d-460c-b029-7dd3fa85fdaa tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:52.824906 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-70dc7c6e-1a2d-460c-b029-7dd3fa85fdaa tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:52.998063 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-70dc7c6e-1a2d-460c-b029-7dd3fa85fdaa tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:53.010221 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-70dc7c6e-1a2d-460c-b029-7dd3fa85fdaa tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:53.012271 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-70dc7c6e-1a2d-460c-b029-7dd3fa85fdaa tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:53.013879 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-70dc7c6e-1a2d-460c-b029-7dd3fa85fdaa tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] 10.222.0.79 "GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb" status: 200 len: 1366 microversion: 2.47 time: 0.215770 Oct 17 14:00:53.028543 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2638/5142] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:00:52 2022] GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:00:54.044713 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d8bae78d-20f2-44de-b63e-0bdd732826a7 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:54.046753 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d8bae78d-20f2-44de-b63e-0bdd732826a7 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] [instance: a60fd17a-8d63-4615-a521-c33db4273aeb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:54.064976 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d8bae78d-20f2-44de-b63e-0bdd732826a7 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:54.065471 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d8bae78d-20f2-44de-b63e-0bdd732826a7 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:54.065908 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d8bae78d-20f2-44de-b63e-0bdd732826a7 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:54.066628 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d8bae78d-20f2-44de-b63e-0bdd732826a7 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:54.067087 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d8bae78d-20f2-44de-b63e-0bdd732826a7 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:54.073069 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d8bae78d-20f2-44de-b63e-0bdd732826a7 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:54.305588 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d8bae78d-20f2-44de-b63e-0bdd732826a7 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:54.323260 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d8bae78d-20f2-44de-b63e-0bdd732826a7 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:54.324853 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d8bae78d-20f2-44de-b63e-0bdd732826a7 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:54.326181 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d8bae78d-20f2-44de-b63e-0bdd732826a7 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] 10.222.0.79 "GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb" status: 200 len: 1366 microversion: 2.47 time: 0.285416 Oct 17 14:00:54.326787 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2505/5143] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:00:54 2022] GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb => generated 1366 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:00:55.355531 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e20f8a4c-637f-4506-b35b-ca73a36c0026 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:55.356144 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e20f8a4c-637f-4506-b35b-ca73a36c0026 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] [instance: a60fd17a-8d63-4615-a521-c33db4273aeb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:55.380193 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-689d8271-4496-4d89-abc4-f0510fbd6099 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2111508104", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8e163913-4ce0-44d4-b8a6-1a267f1d3d7e"}], "security_groups": [{"name": "tempest-securitygroup--1348885047"}], "key_name": "tempest-keypair-516393464", "user_data": "}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:00:55.387550 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e20f8a4c-637f-4506-b35b-ca73a36c0026 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:55.388038 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e20f8a4c-637f-4506-b35b-ca73a36c0026 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:55.395422 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e20f8a4c-637f-4506-b35b-ca73a36c0026 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:55.396397 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e20f8a4c-637f-4506-b35b-ca73a36c0026 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:55.397003 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e20f8a4c-637f-4506-b35b-ca73a36c0026 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:55.397438 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e20f8a4c-637f-4506-b35b-ca73a36c0026 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:55.621812 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e20f8a4c-637f-4506-b35b-ca73a36c0026 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:55.636945 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e20f8a4c-637f-4506-b35b-ca73a36c0026 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:55.638747 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e20f8a4c-637f-4506-b35b-ca73a36c0026 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:55.641741 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e20f8a4c-637f-4506-b35b-ca73a36c0026 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] 10.222.0.79 "GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb" status: 200 len: 1366 microversion: 2.47 time: 0.290163 Oct 17 14:00:55.645188 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2639/5144] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:00:55 2022] GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb => generated 1366 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:00:55.874432 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-689d8271-4496-4d89-abc4-f0510fbd6099 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] validate_networks() for [('8e163913-4ce0-44d4-b8a6-1a267f1d3d7e', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:00:56.695798 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-13d9540f-6ca1-4d39-92e5-ed745712c7bd tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:56.697217 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-13d9540f-6ca1-4d39-92e5-ed745712c7bd tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] [instance: a60fd17a-8d63-4615-a521-c33db4273aeb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:56.711508 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-13d9540f-6ca1-4d39-92e5-ed745712c7bd tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:56.712530 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-13d9540f-6ca1-4d39-92e5-ed745712c7bd tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:56.713798 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-13d9540f-6ca1-4d39-92e5-ed745712c7bd tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:56.714947 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-13d9540f-6ca1-4d39-92e5-ed745712c7bd tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:56.715571 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-13d9540f-6ca1-4d39-92e5-ed745712c7bd tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:56.716145 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-13d9540f-6ca1-4d39-92e5-ed745712c7bd tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:56.854201 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-13d9540f-6ca1-4d39-92e5-ed745712c7bd tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:56.868489 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-13d9540f-6ca1-4d39-92e5-ed745712c7bd tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:56.872658 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-13d9540f-6ca1-4d39-92e5-ed745712c7bd tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:56.875910 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-13d9540f-6ca1-4d39-92e5-ed745712c7bd tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] 10.222.0.79 "GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb" status: 200 len: 1372 microversion: 2.47 time: 0.202928 Oct 17 14:00:56.899256 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2640/5145] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:00:56 2022] GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb => generated 1372 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 14:00:57.248528 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-689d8271-4496-4d89-abc4-f0510fbd6099 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:00:57.249018 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-689d8271-4496-4d89-abc4-f0510fbd6099 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:00:57.249829 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-689d8271-4496-4d89-abc4-f0510fbd6099 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:00:57.250834 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-689d8271-4496-4d89-abc4-f0510fbd6099 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:00:57.251530 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-689d8271-4496-4d89-abc4-f0510fbd6099 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:00:57.292537 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-689d8271-4496-4d89-abc4-f0510fbd6099 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:57.293246 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-689d8271-4496-4d89-abc4-f0510fbd6099 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:57.293706 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-689d8271-4496-4d89-abc4-f0510fbd6099 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:57.294545 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-689d8271-4496-4d89-abc4-f0510fbd6099 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:57.295032 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-689d8271-4496-4d89-abc4-f0510fbd6099 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:57.295482 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-689d8271-4496-4d89-abc4-f0510fbd6099 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:57.390154 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-689d8271-4496-4d89-abc4-f0510fbd6099 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Getting quotas for project 6dcc0bf813dc4a4fa2fd7d6f5521ae85. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:00:57.402247 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-689d8271-4496-4d89-abc4-f0510fbd6099 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Getting quotas for user 9c7ac3dcc4ff4dd2bb68738c72e9507f and project 6dcc0bf813dc4a4fa2fd7d6f5521ae85. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:00:57.443892 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-689d8271-4496-4d89-abc4-f0510fbd6099 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:00:57.450281 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-689d8271-4496-4d89-abc4-f0510fbd6099 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:00:57.607947 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-689d8271-4496-4d89-abc4-f0510fbd6099 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.219839 Oct 17 14:00:57.608897 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2506/5146] 10.222.0.79 () {62 vars in 1188 bytes} [Mon Oct 17 14:00:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 2234 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 17 14:00:57.622386 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-90007d55-3cd5-43df-b786-e9955416f36f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:57.623710 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-90007d55-3cd5-43df-b786-e9955416f36f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:57.881328 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-90007d55-3cd5-43df-b786-e9955416f36f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:57.897019 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-90007d55-3cd5-43df-b786-e9955416f36f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:57.904749 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-90007d55-3cd5-43df-b786-e9955416f36f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:57.910418 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-90007d55-3cd5-43df-b786-e9955416f36f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1281 microversion: 2.20 time: 0.292418 Oct 17 14:00:57.911926 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2641/5147] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:00:57 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1281 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 14:00:57.915094 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-be8c988f-6dcb-4bd1-9e29-5ecc85cb95ad tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:57.915757 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-be8c988f-6dcb-4bd1-9e29-5ecc85cb95ad tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] [instance: a60fd17a-8d63-4615-a521-c33db4273aeb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:57.937104 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-be8c988f-6dcb-4bd1-9e29-5ecc85cb95ad tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:57.937558 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-be8c988f-6dcb-4bd1-9e29-5ecc85cb95ad tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:57.938097 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-be8c988f-6dcb-4bd1-9e29-5ecc85cb95ad tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:57.939130 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-be8c988f-6dcb-4bd1-9e29-5ecc85cb95ad tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:57.939662 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-be8c988f-6dcb-4bd1-9e29-5ecc85cb95ad tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:57.940049 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-be8c988f-6dcb-4bd1-9e29-5ecc85cb95ad tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:58.239105 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-be8c988f-6dcb-4bd1-9e29-5ecc85cb95ad tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:58.286061 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-be8c988f-6dcb-4bd1-9e29-5ecc85cb95ad tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:58.297483 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-be8c988f-6dcb-4bd1-9e29-5ecc85cb95ad tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:58.299566 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-be8c988f-6dcb-4bd1-9e29-5ecc85cb95ad tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] 10.222.0.79 "GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb" status: 200 len: 1372 microversion: 2.47 time: 0.394567 Oct 17 14:00:58.300080 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2507/5148] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:00:57 2022] GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb => generated 1372 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:00:58.941590 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-10276744-7f7c-4503-bd5b-1c86bc87a411 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:58.942209 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-10276744-7f7c-4503-bd5b-1c86bc87a411 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:58.972435 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-10276744-7f7c-4503-bd5b-1c86bc87a411 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:58.980055 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-10276744-7f7c-4503-bd5b-1c86bc87a411 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:58.981907 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-10276744-7f7c-4503-bd5b-1c86bc87a411 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:58.982766 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-10276744-7f7c-4503-bd5b-1c86bc87a411 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:58.984155 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-10276744-7f7c-4503-bd5b-1c86bc87a411 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:58.986086 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-10276744-7f7c-4503-bd5b-1c86bc87a411 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:59.211739 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-10276744-7f7c-4503-bd5b-1c86bc87a411 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:59.225364 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-10276744-7f7c-4503-bd5b-1c86bc87a411 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:59.234257 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-10276744-7f7c-4503-bd5b-1c86bc87a411 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:59.241325 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-10276744-7f7c-4503-bd5b-1c86bc87a411 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1277 microversion: 2.20 time: 0.300900 Oct 17 14:00:59.242368 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2642/5149] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:00:58 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1277 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:00:59.348689 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ba42cea2-faa1-4950-a89f-e2acb8c5a276 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:59.349949 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ba42cea2-faa1-4950-a89f-e2acb8c5a276 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] [instance: a60fd17a-8d63-4615-a521-c33db4273aeb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:59.385345 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ba42cea2-faa1-4950-a89f-e2acb8c5a276 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:59.385797 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ba42cea2-faa1-4950-a89f-e2acb8c5a276 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:59.386254 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ba42cea2-faa1-4950-a89f-e2acb8c5a276 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:59.393399 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ba42cea2-faa1-4950-a89f-e2acb8c5a276 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:59.393952 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ba42cea2-faa1-4950-a89f-e2acb8c5a276 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:59.394717 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ba42cea2-faa1-4950-a89f-e2acb8c5a276 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:59.603479 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ba42cea2-faa1-4950-a89f-e2acb8c5a276 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:59.615632 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ba42cea2-faa1-4950-a89f-e2acb8c5a276 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:59.617440 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ba42cea2-faa1-4950-a89f-e2acb8c5a276 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:59.618891 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ba42cea2-faa1-4950-a89f-e2acb8c5a276 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] 10.222.0.79 "GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb" status: 200 len: 1357 microversion: 2.47 time: 0.295485 Oct 17 14:00:59.619990 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2508/5150] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:00:59 2022] GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb => generated 1357 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:00:59.658385 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a87e12e3-a7c7-4d75-8890-f81ddffb2652 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:59.667451 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a87e12e3-a7c7-4d75-8890-f81ddffb2652 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:59.668923 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a87e12e3-a7c7-4d75-8890-f81ddffb2652 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Searching by: {'deleted': False, 'project_id': '1d1f35bc495c48689756cfd569e9dc25'} {{(pid=127016) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 14:00:59.690661 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a87e12e3-a7c7-4d75-8890-f81ddffb2652 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:59.691499 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a87e12e3-a7c7-4d75-8890-f81ddffb2652 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:59.692277 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a87e12e3-a7c7-4d75-8890-f81ddffb2652 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:59.693773 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a87e12e3-a7c7-4d75-8890-f81ddffb2652 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:59.694460 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a87e12e3-a7c7-4d75-8890-f81ddffb2652 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:59.695124 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a87e12e3-a7c7-4d75-8890-f81ddffb2652 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:59.988717 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.multi_cell_list [None req-a87e12e3-a7c7-4d75-8890-f81ddffb2652 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127016) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 14:01:00.144630 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a87e12e3-a7c7-4d75-8890-f81ddffb2652 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:00.161138 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a87e12e3-a7c7-4d75-8890-f81ddffb2652 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:00.161637 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a87e12e3-a7c7-4d75-8890-f81ddffb2652 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:00.162081 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a87e12e3-a7c7-4d75-8890-f81ddffb2652 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:00.188177 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a87e12e3-a7c7-4d75-8890-f81ddffb2652 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:00.190673 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a87e12e3-a7c7-4d75-8890-f81ddffb2652 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:00.271220 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3f21c397-bcbd-4160-a58d-6b5bf00c90ad tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:00.271861 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3f21c397-bcbd-4160-a58d-6b5bf00c90ad tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:00.282336 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f21c397-bcbd-4160-a58d-6b5bf00c90ad tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:00.282840 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f21c397-bcbd-4160-a58d-6b5bf00c90ad tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:00.285585 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f21c397-bcbd-4160-a58d-6b5bf00c90ad tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:00.286397 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f21c397-bcbd-4160-a58d-6b5bf00c90ad tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:00.286870 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f21c397-bcbd-4160-a58d-6b5bf00c90ad tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:00.291616 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f21c397-bcbd-4160-a58d-6b5bf00c90ad tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:00.569327 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a87e12e3-a7c7-4d75-8890-f81ddffb2652 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] 10.222.0.79 "GET /compute/v2.1/servers/detail" status: 200 len: 2705 microversion: 2.47 time: 0.918590 Oct 17 14:01:00.571126 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2643/5151] 10.222.0.79 () {60 vars in 1187 bytes} [Mon Oct 17 14:00:59 2022] GET /compute/v2.1/servers/detail => generated 2705 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:01:00.587973 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3f21c397-bcbd-4160-a58d-6b5bf00c90ad tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:00.601543 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3f21c397-bcbd-4160-a58d-6b5bf00c90ad tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:00.602504 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1ac4cce1-0a78-49f7-bc73-3a2daf51e95b tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:00.603010 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-1ac4cce1-0a78-49f7-bc73-3a2daf51e95b tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] [instance: a60fd17a-8d63-4615-a521-c33db4273aeb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:00.603109 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3f21c397-bcbd-4160-a58d-6b5bf00c90ad tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:00.604193 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3f21c397-bcbd-4160-a58d-6b5bf00c90ad tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1339 microversion: 2.20 time: 0.337739 Oct 17 14:01:00.607493 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2509/5152] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:01:00 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1339 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:01:00.612247 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1ac4cce1-0a78-49f7-bc73-3a2daf51e95b tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:00.612748 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1ac4cce1-0a78-49f7-bc73-3a2daf51e95b tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:00.613192 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1ac4cce1-0a78-49f7-bc73-3a2daf51e95b tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:00.613911 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1ac4cce1-0a78-49f7-bc73-3a2daf51e95b tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:00.614366 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1ac4cce1-0a78-49f7-bc73-3a2daf51e95b tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:00.614817 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1ac4cce1-0a78-49f7-bc73-3a2daf51e95b tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:00.705841 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-1ac4cce1-0a78-49f7-bc73-3a2daf51e95b tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] [instance: a60fd17a-8d63-4615-a521-c33db4273aeb] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:01:00.895509 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1ac4cce1-0a78-49f7-bc73-3a2daf51e95b tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb" status: 204 len: 0 microversion: 2.47 time: 0.296813 Oct 17 14:01:00.896586 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2644/5153] 10.222.0.79 () {60 vars in 1280 bytes} [Mon Oct 17 14:01:00 2022] DELETE /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 17 14:01:00.905544 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-99ce5a3a-37e2-41fd-b3d8-5ec86cbee7d9 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:00.906191 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-99ce5a3a-37e2-41fd-b3d8-5ec86cbee7d9 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] [instance: a60fd17a-8d63-4615-a521-c33db4273aeb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:00.939462 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-99ce5a3a-37e2-41fd-b3d8-5ec86cbee7d9 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:00.939900 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-99ce5a3a-37e2-41fd-b3d8-5ec86cbee7d9 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:00.940340 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-99ce5a3a-37e2-41fd-b3d8-5ec86cbee7d9 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:00.941138 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-99ce5a3a-37e2-41fd-b3d8-5ec86cbee7d9 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:00.949861 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-99ce5a3a-37e2-41fd-b3d8-5ec86cbee7d9 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:00.950479 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-99ce5a3a-37e2-41fd-b3d8-5ec86cbee7d9 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:01.520063 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-99ce5a3a-37e2-41fd-b3d8-5ec86cbee7d9 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:01.536627 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-99ce5a3a-37e2-41fd-b3d8-5ec86cbee7d9 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:01.538430 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-99ce5a3a-37e2-41fd-b3d8-5ec86cbee7d9 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:01.539919 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-99ce5a3a-37e2-41fd-b3d8-5ec86cbee7d9 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] 10.222.0.79 "GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb" status: 200 len: 1363 microversion: 2.47 time: 0.638680 Oct 17 14:01:01.551156 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2510/5154] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:01:00 2022] GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb => generated 1363 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:01:01.637431 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-041a7ec9-f6ec-41c3-b82c-d68ce9434ea9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:01.639016 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-041a7ec9-f6ec-41c3-b82c-d68ce9434ea9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:01.669248 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-041a7ec9-f6ec-41c3-b82c-d68ce9434ea9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:01.670129 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-041a7ec9-f6ec-41c3-b82c-d68ce9434ea9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:01.670827 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-041a7ec9-f6ec-41c3-b82c-d68ce9434ea9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:01.673558 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-041a7ec9-f6ec-41c3-b82c-d68ce9434ea9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:01.675129 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-041a7ec9-f6ec-41c3-b82c-d68ce9434ea9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:01.675992 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-041a7ec9-f6ec-41c3-b82c-d68ce9434ea9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:01.883400 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-041a7ec9-f6ec-41c3-b82c-d68ce9434ea9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:01.894782 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-041a7ec9-f6ec-41c3-b82c-d68ce9434ea9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:01.901906 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-041a7ec9-f6ec-41c3-b82c-d68ce9434ea9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:01.903650 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-041a7ec9-f6ec-41c3-b82c-d68ce9434ea9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1339 microversion: 2.20 time: 0.271667 Oct 17 14:01:01.905875 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2645/5155] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:01:01 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1339 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:01:02.568601 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9ade6cdb-998e-4be8-a1a4-be7289182506 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:02.569237 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9ade6cdb-998e-4be8-a1a4-be7289182506 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] [instance: a60fd17a-8d63-4615-a521-c33db4273aeb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:02.589829 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9ade6cdb-998e-4be8-a1a4-be7289182506 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:02.590352 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9ade6cdb-998e-4be8-a1a4-be7289182506 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:02.590785 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9ade6cdb-998e-4be8-a1a4-be7289182506 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:02.591537 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9ade6cdb-998e-4be8-a1a4-be7289182506 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:02.591999 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9ade6cdb-998e-4be8-a1a4-be7289182506 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:02.592431 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9ade6cdb-998e-4be8-a1a4-be7289182506 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:02.859378 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9ade6cdb-998e-4be8-a1a4-be7289182506 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:02.869432 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9ade6cdb-998e-4be8-a1a4-be7289182506 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:02.870892 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9ade6cdb-998e-4be8-a1a4-be7289182506 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:02.879351 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9ade6cdb-998e-4be8-a1a4-be7289182506 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] 10.222.0.79 "GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb" status: 200 len: 1363 microversion: 2.47 time: 0.315002 Oct 17 14:01:02.883560 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2511/5156] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:01:02 2022] GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb => generated 1363 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:01:02.932998 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-acfafdcd-e020-48a9-bcc2-b40cf4521ce5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:02.933734 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-acfafdcd-e020-48a9-bcc2-b40cf4521ce5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:02.946275 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-acfafdcd-e020-48a9-bcc2-b40cf4521ce5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:02.946840 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-acfafdcd-e020-48a9-bcc2-b40cf4521ce5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:02.947718 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-acfafdcd-e020-48a9-bcc2-b40cf4521ce5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:02.948859 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-acfafdcd-e020-48a9-bcc2-b40cf4521ce5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:02.949599 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-acfafdcd-e020-48a9-bcc2-b40cf4521ce5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:02.950187 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-acfafdcd-e020-48a9-bcc2-b40cf4521ce5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:03.447913 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-acfafdcd-e020-48a9-bcc2-b40cf4521ce5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:03.464979 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-acfafdcd-e020-48a9-bcc2-b40cf4521ce5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:03.466427 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-acfafdcd-e020-48a9-bcc2-b40cf4521ce5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:03.480050 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-acfafdcd-e020-48a9-bcc2-b40cf4521ce5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1339 microversion: 2.20 time: 0.551104 Oct 17 14:01:03.495629 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2646/5157] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:01:02 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1339 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:01:03.908431 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-709f8fb9-7f22-409e-97cb-578ef33c8ce4 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:03.909061 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-709f8fb9-7f22-409e-97cb-578ef33c8ce4 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] [instance: a60fd17a-8d63-4615-a521-c33db4273aeb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:03.917249 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-709f8fb9-7f22-409e-97cb-578ef33c8ce4 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:03.917768 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-709f8fb9-7f22-409e-97cb-578ef33c8ce4 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:03.922379 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-709f8fb9-7f22-409e-97cb-578ef33c8ce4 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:03.923626 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-709f8fb9-7f22-409e-97cb-578ef33c8ce4 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:03.924302 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-709f8fb9-7f22-409e-97cb-578ef33c8ce4 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:03.925183 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-709f8fb9-7f22-409e-97cb-578ef33c8ce4 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:04.039091 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-709f8fb9-7f22-409e-97cb-578ef33c8ce4 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:04.039644 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-709f8fb9-7f22-409e-97cb-578ef33c8ce4 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:04.040102 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-709f8fb9-7f22-409e-97cb-578ef33c8ce4 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:04.040571 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-709f8fb9-7f22-409e-97cb-578ef33c8ce4 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lazy-loading 'fault' on Instance uuid a60fd17a-8d63-4615-a521-c33db4273aeb {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:01:04.278202 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-709f8fb9-7f22-409e-97cb-578ef33c8ce4 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:04.288357 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-709f8fb9-7f22-409e-97cb-578ef33c8ce4 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:04.290337 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-709f8fb9-7f22-409e-97cb-578ef33c8ce4 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:04.292296 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-709f8fb9-7f22-409e-97cb-578ef33c8ce4 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] 10.222.0.79 "GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb" status: 200 len: 1368 microversion: 2.47 time: 0.387813 Oct 17 14:01:04.293448 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2512/5158] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:01:03 2022] GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb => generated 1368 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:01:04.512198 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-be00ea7b-78ed-417b-8353-cab6466258ea tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:04.512794 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-be00ea7b-78ed-417b-8353-cab6466258ea tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:04.533277 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be00ea7b-78ed-417b-8353-cab6466258ea tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:04.541258 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be00ea7b-78ed-417b-8353-cab6466258ea tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:04.541720 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be00ea7b-78ed-417b-8353-cab6466258ea tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:04.542805 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be00ea7b-78ed-417b-8353-cab6466258ea tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:04.544031 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be00ea7b-78ed-417b-8353-cab6466258ea tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:04.544031 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be00ea7b-78ed-417b-8353-cab6466258ea tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:04.548770 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:01:05.233209 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-be00ea7b-78ed-417b-8353-cab6466258ea tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:05.256694 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-be00ea7b-78ed-417b-8353-cab6466258ea tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:05.258322 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-be00ea7b-78ed-417b-8353-cab6466258ea tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:05.259515 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-be00ea7b-78ed-417b-8353-cab6466258ea tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1407 microversion: 2.20 time: 0.753448 Oct 17 14:01:05.260085 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2647/5159] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:01:04 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1407 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:01:05.322510 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-56d34455-5638-4096-8ffa-a7774eeaba04 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:05.323208 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-56d34455-5638-4096-8ffa-a7774eeaba04 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] [instance: a60fd17a-8d63-4615-a521-c33db4273aeb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:05.331251 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-56d34455-5638-4096-8ffa-a7774eeaba04 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:05.332096 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-56d34455-5638-4096-8ffa-a7774eeaba04 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:05.332753 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-56d34455-5638-4096-8ffa-a7774eeaba04 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:05.333683 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-56d34455-5638-4096-8ffa-a7774eeaba04 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:05.334404 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-56d34455-5638-4096-8ffa-a7774eeaba04 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:05.335218 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-56d34455-5638-4096-8ffa-a7774eeaba04 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:05.358334 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-56d34455-5638-4096-8ffa-a7774eeaba04 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] HTTP exception thrown: Instance a60fd17a-8d63-4615-a521-c33db4273aeb could not be found. Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-56d34455-5638-4096-8ffa-a7774eeaba04 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Request method failure captured: Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb HTTP/1.1 Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTV_yWCngm2Lx2i7aJuIp91fNQ16XJH4E-_XCuHBJeWgX63tImpNxQp2NAvPDyRKxSbPmpTzjkqbgNa2e6tp0ThwViyjM3UmyYMa2BGbeJoKzxsuf9giN9dii9rNMDXDr2mNbB6emrDc_NgzMTyCaxfVhnaPEr0IfpXdTO6F4Ma51E68 Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: X-Openstack-Nova-Api-Version: 2.47 Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 1d1f35bc495c48689756cfd569e9dc25 Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServerShowV247Test-513516798 Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1d1f35bc495c48689756cfd569e9dc25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/1d1f35bc495c48689756cfd569e9dc25"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1d1f35bc495c48689756cfd569e9dc25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_1d1f35bc495c48689756cfd569e9dc25", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServerShowV247Test-513516798 Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 1d1f35bc495c48689756cfd569e9dc25 Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServerShowV247Test-513516798 Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServerShowV247Test-513516798-project Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: fb8feae002fb44d48de7958c91cb5c63 Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServerShowV247Test-513516798-project Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance a60fd17a-8d63-4615-a521-c33db4273aeb could not be found. Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'a60fd17a-8d63-4615-a521-c33db4273aeb'} Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a60fd17a-8d63-4615-a521-c33db4273aeb could not be found. Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a60fd17a-8d63-4615-a521-c33db4273aeb could not be found. Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:01:05.362601 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:01:05.366423 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:01:05.366423 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:01:05.366423 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:01:05.366423 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:01:05.366423 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:01:05.366423 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a60fd17a-8d63-4615-a521-c33db4273aeb could not be found. Oct 17 14:01:05.366423 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:01:05.378856 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-56d34455-5638-4096-8ffa-a7774eeaba04 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Returning 404 to user: Instance a60fd17a-8d63-4615-a521-c33db4273aeb could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:01:05.380160 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-56d34455-5638-4096-8ffa-a7774eeaba04 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] 10.222.0.79 "GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb" status: 404 len: 111 microversion: 2.47 time: 0.063771 Oct 17 14:01:05.390068 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-875c93a0-e8fd-4404-94d6-d79d88e0bb83 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:05.391385 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-875c93a0-e8fd-4404-94d6-d79d88e0bb83 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] [instance: fe428bfd-3882-4ad6-a7bd-ac5f3d965a85] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:05.395284 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2513/5160] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:01:05 2022] GET /compute/v2.1/servers/a60fd17a-8d63-4615-a521-c33db4273aeb => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 14:01:05.398843 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-875c93a0-e8fd-4404-94d6-d79d88e0bb83 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:05.399708 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-875c93a0-e8fd-4404-94d6-d79d88e0bb83 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:05.403813 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-875c93a0-e8fd-4404-94d6-d79d88e0bb83 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:05.404848 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-875c93a0-e8fd-4404-94d6-d79d88e0bb83 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:05.405531 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-875c93a0-e8fd-4404-94d6-d79d88e0bb83 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:05.406197 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-875c93a0-e8fd-4404-94d6-d79d88e0bb83 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:05.512744 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-875c93a0-e8fd-4404-94d6-d79d88e0bb83 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] [instance: fe428bfd-3882-4ad6-a7bd-ac5f3d965a85] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:01:05.727486 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:01:05.743099 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-875c93a0-e8fd-4404-94d6-d79d88e0bb83 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] 10.222.0.79 "DELETE /compute/v2.1/servers/fe428bfd-3882-4ad6-a7bd-ac5f3d965a85" status: 204 len: 0 microversion: 2.47 time: 0.356669 Oct 17 14:01:05.744646 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2648/5161] 10.222.0.79 () {60 vars in 1280 bytes} [Mon Oct 17 14:01:05 2022] DELETE /compute/v2.1/servers/fe428bfd-3882-4ad6-a7bd-ac5f3d965a85 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 14:01:05.752701 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4e313aca-4e93-4860-9472-1a1aacd3b88e tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:05.753331 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4e313aca-4e93-4860-9472-1a1aacd3b88e tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] [instance: fe428bfd-3882-4ad6-a7bd-ac5f3d965a85] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:05.770257 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4e313aca-4e93-4860-9472-1a1aacd3b88e tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:05.770756 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4e313aca-4e93-4860-9472-1a1aacd3b88e tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:05.771230 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4e313aca-4e93-4860-9472-1a1aacd3b88e tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:05.771948 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4e313aca-4e93-4860-9472-1a1aacd3b88e tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:05.783682 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4e313aca-4e93-4860-9472-1a1aacd3b88e tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:05.784433 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4e313aca-4e93-4860-9472-1a1aacd3b88e tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:06.044024 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4e313aca-4e93-4860-9472-1a1aacd3b88e tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:06.056030 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4e313aca-4e93-4860-9472-1a1aacd3b88e tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:06.063229 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4e313aca-4e93-4860-9472-1a1aacd3b88e tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:06.064604 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4e313aca-4e93-4860-9472-1a1aacd3b88e tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] 10.222.0.79 "GET /compute/v2.1/servers/fe428bfd-3882-4ad6-a7bd-ac5f3d965a85" status: 200 len: 1361 microversion: 2.47 time: 0.316104 Oct 17 14:01:06.069166 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2514/5162] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:01:05 2022] GET /compute/v2.1/servers/fe428bfd-3882-4ad6-a7bd-ac5f3d965a85 => generated 1361 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:01:06.287293 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5c6d89b7-bad0-4e44-a396-51d3f112d594 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:06.288015 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5c6d89b7-bad0-4e44-a396-51d3f112d594 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:06.331646 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5c6d89b7-bad0-4e44-a396-51d3f112d594 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:06.335077 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5c6d89b7-bad0-4e44-a396-51d3f112d594 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:06.338662 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5c6d89b7-bad0-4e44-a396-51d3f112d594 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:06.341549 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5c6d89b7-bad0-4e44-a396-51d3f112d594 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:06.342035 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5c6d89b7-bad0-4e44-a396-51d3f112d594 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:06.342541 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5c6d89b7-bad0-4e44-a396-51d3f112d594 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:06.857502 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5c6d89b7-bad0-4e44-a396-51d3f112d594 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:06.875183 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5c6d89b7-bad0-4e44-a396-51d3f112d594 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:06.900936 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5c6d89b7-bad0-4e44-a396-51d3f112d594 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:06.907630 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5c6d89b7-bad0-4e44-a396-51d3f112d594 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1407 microversion: 2.20 time: 0.626348 Oct 17 14:01:06.924196 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2649/5163] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:01:06 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1407 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:01:07.095289 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e3ff850e-bb4b-4fd9-b11a-7eab42411526 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:07.097767 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e3ff850e-bb4b-4fd9-b11a-7eab42411526 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] [instance: fe428bfd-3882-4ad6-a7bd-ac5f3d965a85] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:07.111631 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e3ff850e-bb4b-4fd9-b11a-7eab42411526 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:07.116853 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e3ff850e-bb4b-4fd9-b11a-7eab42411526 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:07.123443 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e3ff850e-bb4b-4fd9-b11a-7eab42411526 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:07.124540 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e3ff850e-bb4b-4fd9-b11a-7eab42411526 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:07.125137 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e3ff850e-bb4b-4fd9-b11a-7eab42411526 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:07.125736 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e3ff850e-bb4b-4fd9-b11a-7eab42411526 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:07.198696 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=94 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:01:07.286840 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e3ff850e-bb4b-4fd9-b11a-7eab42411526 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:07.313212 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e3ff850e-bb4b-4fd9-b11a-7eab42411526 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:07.317686 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e3ff850e-bb4b-4fd9-b11a-7eab42411526 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:07.318986 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e3ff850e-bb4b-4fd9-b11a-7eab42411526 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] 10.222.0.79 "GET /compute/v2.1/servers/fe428bfd-3882-4ad6-a7bd-ac5f3d965a85" status: 200 len: 1361 microversion: 2.47 time: 0.229743 Oct 17 14:01:07.331473 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2515/5164] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:01:07 2022] GET /compute/v2.1/servers/fe428bfd-3882-4ad6-a7bd-ac5f3d965a85 => generated 1361 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:01:07.672603 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-b1b3b256-3585-4fce-b83f-797372851444 req-987d1663-f44d-47d0-a6a6-b1596c3a478d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86508a39-65fa-4421-b31d-ffbc5fdee565", "tag": "be2d42c9-97a7-4933-9200-d27f76f73a39"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:01:07.699430 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-b1b3b256-3585-4fce-b83f-797372851444 req-987d1663-f44d-47d0-a6a6-b1596c3a478d service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:07.700103 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-b1b3b256-3585-4fce-b83f-797372851444 req-987d1663-f44d-47d0-a6a6-b1596c3a478d service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:07.700532 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-b1b3b256-3585-4fce-b83f-797372851444 req-987d1663-f44d-47d0-a6a6-b1596c3a478d service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:07.729516 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-b1b3b256-3585-4fce-b83f-797372851444 req-987d1663-f44d-47d0-a6a6-b1596c3a478d service nova] Creating event network-changed:be2d42c9-97a7-4933-9200-d27f76f73a39 for instance 86508a39-65fa-4421-b31d-ffbc5fdee565 on n-h1-854247-14 Oct 17 14:01:07.745495 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-b1b3b256-3585-4fce-b83f-797372851444 req-987d1663-f44d-47d0-a6a6-b1596c3a478d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076532 Oct 17 14:01:07.746608 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2650/5165] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:01:07.936632 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-286fca28-2921-413d-b5d1-517f5712caad tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:07.937885 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-286fca28-2921-413d-b5d1-517f5712caad tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:07.941306 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:01:07.948228 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=10 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:01:07.952152 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-286fca28-2921-413d-b5d1-517f5712caad tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:07.952668 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-286fca28-2921-413d-b5d1-517f5712caad tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:07.953069 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-286fca28-2921-413d-b5d1-517f5712caad tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:07.953991 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-286fca28-2921-413d-b5d1-517f5712caad tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:07.954626 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-286fca28-2921-413d-b5d1-517f5712caad tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:07.955050 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-286fca28-2921-413d-b5d1-517f5712caad tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:08.360631 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-84815c87-ac80-40e5-ae93-777b8d789d9b tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:08.362245 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-84815c87-ac80-40e5-ae93-777b8d789d9b tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] [instance: fe428bfd-3882-4ad6-a7bd-ac5f3d965a85] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:08.380518 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-84815c87-ac80-40e5-ae93-777b8d789d9b tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:08.381104 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-84815c87-ac80-40e5-ae93-777b8d789d9b tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:08.381707 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-84815c87-ac80-40e5-ae93-777b8d789d9b tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:08.382603 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-84815c87-ac80-40e5-ae93-777b8d789d9b tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:08.383153 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-84815c87-ac80-40e5-ae93-777b8d789d9b tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:08.383692 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-84815c87-ac80-40e5-ae93-777b8d789d9b tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:08.528447 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-84815c87-ac80-40e5-ae93-777b8d789d9b tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:08.528995 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-84815c87-ac80-40e5-ae93-777b8d789d9b tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:08.529433 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-84815c87-ac80-40e5-ae93-777b8d789d9b tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:08.529930 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-84815c87-ac80-40e5-ae93-777b8d789d9b tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lazy-loading 'fault' on Instance uuid fe428bfd-3882-4ad6-a7bd-ac5f3d965a85 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:01:08.919136 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-286fca28-2921-413d-b5d1-517f5712caad tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:08.936708 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-286fca28-2921-413d-b5d1-517f5712caad tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:08.939502 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-286fca28-2921-413d-b5d1-517f5712caad tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:08.942721 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-286fca28-2921-413d-b5d1-517f5712caad tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1407 microversion: 2.20 time: 1.010522 Oct 17 14:01:08.950365 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2516/5166] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:01:07 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1407 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:01:08.976200 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-84815c87-ac80-40e5-ae93-777b8d789d9b tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:08.991254 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-84815c87-ac80-40e5-ae93-777b8d789d9b tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:08.992698 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-84815c87-ac80-40e5-ae93-777b8d789d9b tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb8feae002fb44d48de7958c91cb5c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1f35bc495c48689756cfd569e9dc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:08.993900 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-84815c87-ac80-40e5-ae93-777b8d789d9b tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] 10.222.0.79 "GET /compute/v2.1/servers/fe428bfd-3882-4ad6-a7bd-ac5f3d965a85" status: 200 len: 1366 microversion: 2.47 time: 0.638842 Oct 17 14:01:08.994466 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2651/5167] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:01:08 2022] GET /compute/v2.1/servers/fe428bfd-3882-4ad6-a7bd-ac5f3d965a85 => generated 1366 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:01:09.976171 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-18c7702e-daee-4bcd-b1bb-188d930ae01b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:09.976939 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-18c7702e-daee-4bcd-b1bb-188d930ae01b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:09.987625 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-18c7702e-daee-4bcd-b1bb-188d930ae01b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:09.993276 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-18c7702e-daee-4bcd-b1bb-188d930ae01b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:09.993954 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-18c7702e-daee-4bcd-b1bb-188d930ae01b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:09.994970 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-18c7702e-daee-4bcd-b1bb-188d930ae01b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:09.995592 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-18c7702e-daee-4bcd-b1bb-188d930ae01b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:10.002994 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-18c7702e-daee-4bcd-b1bb-188d930ae01b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:10.022804 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-df02e351-408d-4e1b-b0c9-f99b96ac8247 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:10.024042 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-df02e351-408d-4e1b-b0c9-f99b96ac8247 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] [instance: fe428bfd-3882-4ad6-a7bd-ac5f3d965a85] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:10.033736 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:01:10.040188 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df02e351-408d-4e1b-b0c9-f99b96ac8247 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:10.040909 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df02e351-408d-4e1b-b0c9-f99b96ac8247 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:10.042240 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df02e351-408d-4e1b-b0c9-f99b96ac8247 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:10.044663 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df02e351-408d-4e1b-b0c9-f99b96ac8247 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:10.046197 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df02e351-408d-4e1b-b0c9-f99b96ac8247 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:10.048957 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df02e351-408d-4e1b-b0c9-f99b96ac8247 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:10.084828 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-df02e351-408d-4e1b-b0c9-f99b96ac8247 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] HTTP exception thrown: Instance fe428bfd-3882-4ad6-a7bd-ac5f3d965a85 could not be found. Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-df02e351-408d-4e1b-b0c9-f99b96ac8247 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Request method failure captured: Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/fe428bfd-3882-4ad6-a7bd-ac5f3d965a85 HTTP/1.1 Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTV_yWCngm2Lx2i7aJuIp91fNQ16XJH4E-_XCuHBJeWgX63tImpNxQp2NAvPDyRKxSbPmpTzjkqbgNa2e6tp0ThwViyjM3UmyYMa2BGbeJoKzxsuf9giN9dii9rNMDXDr2mNbB6emrDc_NgzMTyCaxfVhnaPEr0IfpXdTO6F4Ma51E68 Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: X-Openstack-Nova-Api-Version: 2.47 Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 1d1f35bc495c48689756cfd569e9dc25 Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServerShowV247Test-513516798 Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1d1f35bc495c48689756cfd569e9dc25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/1d1f35bc495c48689756cfd569e9dc25"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1d1f35bc495c48689756cfd569e9dc25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_1d1f35bc495c48689756cfd569e9dc25", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServerShowV247Test-513516798 Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 1d1f35bc495c48689756cfd569e9dc25 Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServerShowV247Test-513516798 Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServerShowV247Test-513516798-project Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: fb8feae002fb44d48de7958c91cb5c63 Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServerShowV247Test-513516798-project Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance fe428bfd-3882-4ad6-a7bd-ac5f3d965a85 could not be found. Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'fe428bfd-3882-4ad6-a7bd-ac5f3d965a85'} Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe428bfd-3882-4ad6-a7bd-ac5f3d965a85 could not be found. Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe428bfd-3882-4ad6-a7bd-ac5f3d965a85 could not be found. Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:01:10.095377 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:01:10.099049 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:01:10.099049 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:01:10.099049 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:01:10.099049 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:01:10.099049 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:01:10.099049 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe428bfd-3882-4ad6-a7bd-ac5f3d965a85 could not be found. Oct 17 14:01:10.099049 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:01:10.110877 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-df02e351-408d-4e1b-b0c9-f99b96ac8247 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] Returning 404 to user: Instance fe428bfd-3882-4ad6-a7bd-ac5f3d965a85 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:01:10.120529 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-df02e351-408d-4e1b-b0c9-f99b96ac8247 tempest-ServerShowV247Test-513516798 tempest-ServerShowV247Test-513516798-project] 10.222.0.79 "GET /compute/v2.1/servers/fe428bfd-3882-4ad6-a7bd-ac5f3d965a85" status: 404 len: 111 microversion: 2.47 time: 0.101512 Oct 17 14:01:10.121659 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2652/5168] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:01:10 2022] GET /compute/v2.1/servers/fe428bfd-3882-4ad6-a7bd-ac5f3d965a85 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 14:01:10.613113 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-18c7702e-daee-4bcd-b1bb-188d930ae01b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:10.627768 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-18c7702e-daee-4bcd-b1bb-188d930ae01b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:10.629785 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-18c7702e-daee-4bcd-b1bb-188d930ae01b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:10.632048 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-18c7702e-daee-4bcd-b1bb-188d930ae01b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1407 microversion: 2.20 time: 0.662359 Oct 17 14:01:10.635774 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2517/5169] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:01:09 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1407 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:01:11.659356 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6a13e6c1-a659-44ad-b331-5d20a4b13fc4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:11.659968 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6a13e6c1-a659-44ad-b331-5d20a4b13fc4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:11.663124 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=4 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:01:11.673467 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6a13e6c1-a659-44ad-b331-5d20a4b13fc4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:11.673952 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6a13e6c1-a659-44ad-b331-5d20a4b13fc4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:11.674381 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6a13e6c1-a659-44ad-b331-5d20a4b13fc4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:11.687008 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6a13e6c1-a659-44ad-b331-5d20a4b13fc4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:11.691578 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6a13e6c1-a659-44ad-b331-5d20a4b13fc4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:11.692286 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6a13e6c1-a659-44ad-b331-5d20a4b13fc4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:12.717782 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6a13e6c1-a659-44ad-b331-5d20a4b13fc4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:12.740761 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6a13e6c1-a659-44ad-b331-5d20a4b13fc4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:12.742849 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6a13e6c1-a659-44ad-b331-5d20a4b13fc4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:12.745090 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6a13e6c1-a659-44ad-b331-5d20a4b13fc4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1407 microversion: 2.20 time: 1.089267 Oct 17 14:01:12.757573 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2653/5170] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:01:11 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1407 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:01:13.757983 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-18c7702e-daee-4bcd-b1bb-188d930ae01b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:13.759201 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-18c7702e-daee-4bcd-b1bb-188d930ae01b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001601 Oct 17 14:01:13.760043 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2518/5171] 10.222.0.79 () {56 vars in 886 bytes} [Mon Oct 17 14:01:13 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 17 14:01:13.774186 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fc59b41c-54d9-4063-8f61-ed829e518e6b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:13.774913 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-fc59b41c-54d9-4063-8f61-ed829e518e6b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:13.789486 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fc59b41c-54d9-4063-8f61-ed829e518e6b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:13.790733 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fc59b41c-54d9-4063-8f61-ed829e518e6b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:13.791505 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fc59b41c-54d9-4063-8f61-ed829e518e6b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:13.792548 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fc59b41c-54d9-4063-8f61-ed829e518e6b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:13.803843 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fc59b41c-54d9-4063-8f61-ed829e518e6b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:13.804737 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fc59b41c-54d9-4063-8f61-ed829e518e6b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:14.058687 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fc59b41c-54d9-4063-8f61-ed829e518e6b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:14.073161 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fc59b41c-54d9-4063-8f61-ed829e518e6b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:14.080344 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fc59b41c-54d9-4063-8f61-ed829e518e6b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:14.081556 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fc59b41c-54d9-4063-8f61-ed829e518e6b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1407 microversion: 2.20 time: 0.311616 Oct 17 14:01:14.082672 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2654/5172] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:01:13 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1407 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:01:15.118544 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5c1b06a2-750d-42bb-b74f-4eadc7596b06 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:15.123858 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5c1b06a2-750d-42bb-b74f-4eadc7596b06 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:15.169591 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5c1b06a2-750d-42bb-b74f-4eadc7596b06 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:15.191674 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5c1b06a2-750d-42bb-b74f-4eadc7596b06 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:15.192284 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5c1b06a2-750d-42bb-b74f-4eadc7596b06 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:15.193063 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5c1b06a2-750d-42bb-b74f-4eadc7596b06 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:15.193809 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5c1b06a2-750d-42bb-b74f-4eadc7596b06 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:15.193937 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5c1b06a2-750d-42bb-b74f-4eadc7596b06 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:15.826207 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-ed270301-06df-400c-8622-028c263dc382 req-ea2d836c-48df-4956-8ae0-00fce70fb03c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86508a39-65fa-4421-b31d-ffbc5fdee565", "name": "network-vif-plugged", "status": "completed", "tag": "be2d42c9-97a7-4933-9200-d27f76f73a39"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:01:15.846197 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-ed270301-06df-400c-8622-028c263dc382 req-ea2d836c-48df-4956-8ae0-00fce70fb03c service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:15.846688 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-ed270301-06df-400c-8622-028c263dc382 req-ea2d836c-48df-4956-8ae0-00fce70fb03c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:15.847117 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-ed270301-06df-400c-8622-028c263dc382 req-ea2d836c-48df-4956-8ae0-00fce70fb03c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:15.871678 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-ed270301-06df-400c-8622-028c263dc382 req-ea2d836c-48df-4956-8ae0-00fce70fb03c service nova] Creating event network-vif-plugged:be2d42c9-97a7-4933-9200-d27f76f73a39 for instance 86508a39-65fa-4421-b31d-ffbc5fdee565 on n-h1-854247-14 Oct 17 14:01:15.890362 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-ed270301-06df-400c-8622-028c263dc382 req-ea2d836c-48df-4956-8ae0-00fce70fb03c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068631 Oct 17 14:01:15.891694 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2655/5173] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:01:16.545221 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5c1b06a2-750d-42bb-b74f-4eadc7596b06 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:16.560571 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5c1b06a2-750d-42bb-b74f-4eadc7596b06 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:16.562505 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5c1b06a2-750d-42bb-b74f-4eadc7596b06 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:16.566476 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5c1b06a2-750d-42bb-b74f-4eadc7596b06 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1407 microversion: 2.20 time: 1.459352 Oct 17 14:01:16.567082 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2519/5174] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:01:15 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1407 bytes in 1461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:01:17.605404 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-489821dd-a720-4d84-a8b6-693ae88c7169 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:17.606838 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-489821dd-a720-4d84-a8b6-693ae88c7169 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:17.633655 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-489821dd-a720-4d84-a8b6-693ae88c7169 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:17.634159 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-489821dd-a720-4d84-a8b6-693ae88c7169 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:17.634593 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-489821dd-a720-4d84-a8b6-693ae88c7169 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:17.635358 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-489821dd-a720-4d84-a8b6-693ae88c7169 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:17.635805 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-489821dd-a720-4d84-a8b6-693ae88c7169 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:17.636225 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-489821dd-a720-4d84-a8b6-693ae88c7169 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:18.361503 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-489821dd-a720-4d84-a8b6-693ae88c7169 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:18.372131 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-489821dd-a720-4d84-a8b6-693ae88c7169 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:18.378990 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-489821dd-a720-4d84-a8b6-693ae88c7169 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:18.382066 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-489821dd-a720-4d84-a8b6-693ae88c7169 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1407 microversion: 2.20 time: 0.783049 Oct 17 14:01:18.385252 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2656/5175] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:01:17 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1407 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:01:19.418760 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7626510e-3547-428b-9965-316bd1d64ae3 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:19.420569 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7626510e-3547-428b-9965-316bd1d64ae3 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:19.441428 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=4 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:01:19.444619 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7626510e-3547-428b-9965-316bd1d64ae3 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:19.448031 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7626510e-3547-428b-9965-316bd1d64ae3 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:19.448781 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7626510e-3547-428b-9965-316bd1d64ae3 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:19.461406 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7626510e-3547-428b-9965-316bd1d64ae3 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:19.462353 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7626510e-3547-428b-9965-316bd1d64ae3 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:19.472163 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7626510e-3547-428b-9965-316bd1d64ae3 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:21.176867 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7626510e-3547-428b-9965-316bd1d64ae3 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:21.192016 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7626510e-3547-428b-9965-316bd1d64ae3 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:21.193799 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7626510e-3547-428b-9965-316bd1d64ae3 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:21.201922 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7626510e-3547-428b-9965-316bd1d64ae3 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1599 microversion: 2.20 time: 1.789941 Oct 17 14:01:21.229244 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d7a3e5fa-cf61-43e7-93f6-e15740629425 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:21.231005 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d7a3e5fa-cf61-43e7-93f6-e15740629425 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:21.231319 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2520/5176] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:01:19 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1599 bytes in 1820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:01:21.241667 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d7a3e5fa-cf61-43e7-93f6-e15740629425 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:21.252981 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d7a3e5fa-cf61-43e7-93f6-e15740629425 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:21.253800 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d7a3e5fa-cf61-43e7-93f6-e15740629425 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:21.254589 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d7a3e5fa-cf61-43e7-93f6-e15740629425 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:21.255031 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d7a3e5fa-cf61-43e7-93f6-e15740629425 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:21.255736 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d7a3e5fa-cf61-43e7-93f6-e15740629425 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:21.778109 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d7a3e5fa-cf61-43e7-93f6-e15740629425 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.554200 Oct 17 14:01:21.779029 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2657/5177] 10.222.0.79 () {60 vars in 1316 bytes} [Mon Oct 17 14:01:21 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565/os-interface => generated 285 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 14:01:25.818472 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-fa38e714-ccca-466e-9db7-83c4ea33ba74 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1005801914", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "0e3011d7-4b7d-4afb-8521-83a1e1d61387"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:01:25.931602 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-fa38e714-ccca-466e-9db7-83c4ea33ba74 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] validate_networks() for [('0e3011d7-4b7d-4afb-8521-83a1e1d61387', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:01:26.961098 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-fa38e714-ccca-466e-9db7-83c4ea33ba74 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:01:26.961782 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-fa38e714-ccca-466e-9db7-83c4ea33ba74 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:01:26.961997 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-fa38e714-ccca-466e-9db7-83c4ea33ba74 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:01:26.962567 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-fa38e714-ccca-466e-9db7-83c4ea33ba74 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:01:26.963151 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-fa38e714-ccca-466e-9db7-83c4ea33ba74 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:01:26.989872 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fa38e714-ccca-466e-9db7-83c4ea33ba74 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:26.990363 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fa38e714-ccca-466e-9db7-83c4ea33ba74 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:26.990801 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fa38e714-ccca-466e-9db7-83c4ea33ba74 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:27.000225 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fa38e714-ccca-466e-9db7-83c4ea33ba74 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:27.000614 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fa38e714-ccca-466e-9db7-83c4ea33ba74 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:27.001060 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fa38e714-ccca-466e-9db7-83c4ea33ba74 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:27.049059 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-fa38e714-ccca-466e-9db7-83c4ea33ba74 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Getting quotas for project a7921f98c5ea430aaf7712b31ad3fe8b. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:01:27.064054 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-fa38e714-ccca-466e-9db7-83c4ea33ba74 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Getting quotas for user e0fa60836bb748ac9e9ceee8bcdc657a and project a7921f98c5ea430aaf7712b31ad3fe8b. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:01:27.082956 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-fa38e714-ccca-466e-9db7-83c4ea33ba74 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:01:27.085531 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-fa38e714-ccca-466e-9db7-83c4ea33ba74 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] [instance: d7f96ed0-3416-4367-ae7d-814c35c75e44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:01:27.182285 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-fa38e714-ccca-466e-9db7-83c4ea33ba74 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.609355 Oct 17 14:01:27.211352 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2521/5178] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 14:01:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:01:27.214172 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1df21389-5900-4a39-8f2c-07ad882027c8 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:27.214937 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-1df21389-5900-4a39-8f2c-07ad882027c8 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] [instance: d7f96ed0-3416-4367-ae7d-814c35c75e44] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:27.398858 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-1df21389-5900-4a39-8f2c-07ad882027c8 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0fa60836bb748ac9e9ceee8bcdc657a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7921f98c5ea430aaf7712b31ad3fe8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:27.411207 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1df21389-5900-4a39-8f2c-07ad882027c8 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] 10.222.0.79 "GET /compute/v2.1/servers/d7f96ed0-3416-4367-ae7d-814c35c75e44" status: 200 len: 1217 microversion: 2.1 time: 0.217300 Oct 17 14:01:27.431899 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2658/5179] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:01:27 2022] GET /compute/v2.1/servers/d7f96ed0-3416-4367-ae7d-814c35c75e44 => generated 1217 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:01:28.243535 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-696b8381-a1f2-4ce1-bff7-7868f773a953 req-c85fa984-07a9-4f55-ae34-de9b58352980 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86508a39-65fa-4421-b31d-ffbc5fdee565", "tag": "be2d42c9-97a7-4933-9200-d27f76f73a39"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:01:28.271389 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-696b8381-a1f2-4ce1-bff7-7868f773a953 req-c85fa984-07a9-4f55-ae34-de9b58352980 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:28.290924 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-696b8381-a1f2-4ce1-bff7-7868f773a953 req-c85fa984-07a9-4f55-ae34-de9b58352980 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:28.295832 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-696b8381-a1f2-4ce1-bff7-7868f773a953 req-c85fa984-07a9-4f55-ae34-de9b58352980 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:28.329144 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-696b8381-a1f2-4ce1-bff7-7868f773a953 req-c85fa984-07a9-4f55-ae34-de9b58352980 service nova] Creating event network-changed:be2d42c9-97a7-4933-9200-d27f76f73a39 for instance 86508a39-65fa-4421-b31d-ffbc5fdee565 on n-h1-854247-14 Oct 17 14:01:28.340756 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-696b8381-a1f2-4ce1-bff7-7868f773a953 req-c85fa984-07a9-4f55-ae34-de9b58352980 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.740372 Oct 17 14:01:28.342747 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2522/5180] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:01:28.450501 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f0198f1d-d54c-458d-9af4-71adc43358c7 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:28.454506 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f0198f1d-d54c-458d-9af4-71adc43358c7 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] [instance: d7f96ed0-3416-4367-ae7d-814c35c75e44] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:28.487087 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f0198f1d-d54c-458d-9af4-71adc43358c7 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:28.490006 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f0198f1d-d54c-458d-9af4-71adc43358c7 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:28.490468 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f0198f1d-d54c-458d-9af4-71adc43358c7 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:28.491249 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f0198f1d-d54c-458d-9af4-71adc43358c7 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:28.495635 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f0198f1d-d54c-458d-9af4-71adc43358c7 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:28.496095 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f0198f1d-d54c-458d-9af4-71adc43358c7 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:28.811359 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f0198f1d-d54c-458d-9af4-71adc43358c7 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0fa60836bb748ac9e9ceee8bcdc657a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7921f98c5ea430aaf7712b31ad3fe8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:28.822532 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f0198f1d-d54c-458d-9af4-71adc43358c7 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] 10.222.0.79 "GET /compute/v2.1/servers/d7f96ed0-3416-4367-ae7d-814c35c75e44" status: 200 len: 1221 microversion: 2.1 time: 0.383847 Oct 17 14:01:28.831943 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2659/5181] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:01:28 2022] GET /compute/v2.1/servers/d7f96ed0-3416-4367-ae7d-814c35c75e44 => generated 1221 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:01:29.858262 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b1b1eedf-6f0f-4dbc-a332-88c84e1b331f tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:29.860251 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b1b1eedf-6f0f-4dbc-a332-88c84e1b331f tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] [instance: d7f96ed0-3416-4367-ae7d-814c35c75e44] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:29.874902 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b1b1eedf-6f0f-4dbc-a332-88c84e1b331f tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:29.876186 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b1b1eedf-6f0f-4dbc-a332-88c84e1b331f tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:29.876838 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b1b1eedf-6f0f-4dbc-a332-88c84e1b331f tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:29.877910 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b1b1eedf-6f0f-4dbc-a332-88c84e1b331f tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:29.878580 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b1b1eedf-6f0f-4dbc-a332-88c84e1b331f tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:29.879242 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b1b1eedf-6f0f-4dbc-a332-88c84e1b331f tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:30.044974 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b1b1eedf-6f0f-4dbc-a332-88c84e1b331f tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0fa60836bb748ac9e9ceee8bcdc657a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7921f98c5ea430aaf7712b31ad3fe8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:30.060550 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b1b1eedf-6f0f-4dbc-a332-88c84e1b331f tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] 10.222.0.79 "GET /compute/v2.1/servers/d7f96ed0-3416-4367-ae7d-814c35c75e44" status: 200 len: 1275 microversion: 2.1 time: 0.207661 Oct 17 14:01:30.061315 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2523/5182] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:01:29 2022] GET /compute/v2.1/servers/d7f96ed0-3416-4367-ae7d-814c35c75e44 => generated 1275 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:01:31.092396 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-75f230f5-7e74-4f6e-a407-e9aba1d71558 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:31.093664 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-75f230f5-7e74-4f6e-a407-e9aba1d71558 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] [instance: d7f96ed0-3416-4367-ae7d-814c35c75e44] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:31.116921 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-75f230f5-7e74-4f6e-a407-e9aba1d71558 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:31.156046 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-75f230f5-7e74-4f6e-a407-e9aba1d71558 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.044s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:31.158383 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-75f230f5-7e74-4f6e-a407-e9aba1d71558 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:31.160141 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-75f230f5-7e74-4f6e-a407-e9aba1d71558 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:31.165681 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-75f230f5-7e74-4f6e-a407-e9aba1d71558 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:31.166630 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-75f230f5-7e74-4f6e-a407-e9aba1d71558 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:32.204611 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-75f230f5-7e74-4f6e-a407-e9aba1d71558 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0fa60836bb748ac9e9ceee8bcdc657a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7921f98c5ea430aaf7712b31ad3fe8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:32.217489 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-75f230f5-7e74-4f6e-a407-e9aba1d71558 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] 10.222.0.79 "GET /compute/v2.1/servers/d7f96ed0-3416-4367-ae7d-814c35c75e44" status: 200 len: 1317 microversion: 2.1 time: 1.127104 Oct 17 14:01:32.223626 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2660/5183] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:01:31 2022] GET /compute/v2.1/servers/d7f96ed0-3416-4367-ae7d-814c35c75e44 => generated 1317 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:01:33.250832 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-df64e51c-0d55-49cd-84a5-bccfd5d73ae5 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:33.251957 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-df64e51c-0d55-49cd-84a5-bccfd5d73ae5 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] [instance: d7f96ed0-3416-4367-ae7d-814c35c75e44] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:33.270119 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-df64e51c-0d55-49cd-84a5-bccfd5d73ae5 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:33.273658 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-df64e51c-0d55-49cd-84a5-bccfd5d73ae5 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:33.278137 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-df64e51c-0d55-49cd-84a5-bccfd5d73ae5 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:33.279321 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-df64e51c-0d55-49cd-84a5-bccfd5d73ae5 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:33.280391 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-df64e51c-0d55-49cd-84a5-bccfd5d73ae5 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:33.282486 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-df64e51c-0d55-49cd-84a5-bccfd5d73ae5 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:33.651221 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-df64e51c-0d55-49cd-84a5-bccfd5d73ae5 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0fa60836bb748ac9e9ceee8bcdc657a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7921f98c5ea430aaf7712b31ad3fe8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:33.661088 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-df64e51c-0d55-49cd-84a5-bccfd5d73ae5 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] 10.222.0.79 "GET /compute/v2.1/servers/d7f96ed0-3416-4367-ae7d-814c35c75e44" status: 200 len: 1317 microversion: 2.1 time: 0.419016 Oct 17 14:01:33.678672 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2524/5184] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:01:33 2022] GET /compute/v2.1/servers/d7f96ed0-3416-4367-ae7d-814c35c75e44 => generated 1317 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:01:34.146072 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-19e9c377-7bdb-403f-9607-c60696e586c6 req-a7c3cbf4-7146-41dd-b4e1-e3d9e0ea7bdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7f96ed0-3416-4367-ae7d-814c35c75e44", "tag": "eec5fb32-ca4f-4bdd-b733-c169f9763612"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:01:34.175817 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-19e9c377-7bdb-403f-9607-c60696e586c6 req-a7c3cbf4-7146-41dd-b4e1-e3d9e0ea7bdc service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:34.176674 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-19e9c377-7bdb-403f-9607-c60696e586c6 req-a7c3cbf4-7146-41dd-b4e1-e3d9e0ea7bdc service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:34.177418 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-19e9c377-7bdb-403f-9607-c60696e586c6 req-a7c3cbf4-7146-41dd-b4e1-e3d9e0ea7bdc service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:34.196462 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-19e9c377-7bdb-403f-9607-c60696e586c6 req-a7c3cbf4-7146-41dd-b4e1-e3d9e0ea7bdc service nova] Creating event network-changed:eec5fb32-ca4f-4bdd-b733-c169f9763612 for instance d7f96ed0-3416-4367-ae7d-814c35c75e44 on n-h2-854247-14 Oct 17 14:01:34.203719 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-19e9c377-7bdb-403f-9607-c60696e586c6 req-a7c3cbf4-7146-41dd-b4e1-e3d9e0ea7bdc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063401 Oct 17 14:01:34.205186 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2661/5185] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:01:34.732841 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e8251489-b017-461b-bc8c-90b3611aca09 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:34.733494 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e8251489-b017-461b-bc8c-90b3611aca09 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] [instance: d7f96ed0-3416-4367-ae7d-814c35c75e44] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:34.751270 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e8251489-b017-461b-bc8c-90b3611aca09 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:34.759700 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e8251489-b017-461b-bc8c-90b3611aca09 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:34.761113 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e8251489-b017-461b-bc8c-90b3611aca09 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:34.762973 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e8251489-b017-461b-bc8c-90b3611aca09 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:34.763493 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e8251489-b017-461b-bc8c-90b3611aca09 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:34.763929 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e8251489-b017-461b-bc8c-90b3611aca09 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:35.908787 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e8251489-b017-461b-bc8c-90b3611aca09 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0fa60836bb748ac9e9ceee8bcdc657a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7921f98c5ea430aaf7712b31ad3fe8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:35.928164 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e8251489-b017-461b-bc8c-90b3611aca09 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] 10.222.0.79 "GET /compute/v2.1/servers/d7f96ed0-3416-4367-ae7d-814c35c75e44" status: 200 len: 1317 microversion: 2.1 time: 1.229133 Oct 17 14:01:35.929104 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2525/5186] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:01:34 2022] GET /compute/v2.1/servers/d7f96ed0-3416-4367-ae7d-814c35c75e44 => generated 1317 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:01:36.957620 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e201f173-2951-4a06-81a8-07a368be5057 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:36.958955 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e201f173-2951-4a06-81a8-07a368be5057 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] [instance: d7f96ed0-3416-4367-ae7d-814c35c75e44] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:36.961990 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:01:36.968577 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e201f173-2951-4a06-81a8-07a368be5057 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:36.969946 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e201f173-2951-4a06-81a8-07a368be5057 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:36.970605 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e201f173-2951-4a06-81a8-07a368be5057 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:36.971562 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e201f173-2951-4a06-81a8-07a368be5057 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:36.972169 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e201f173-2951-4a06-81a8-07a368be5057 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:36.972788 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e201f173-2951-4a06-81a8-07a368be5057 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:36.984654 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:01:37.405010 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:01:38.072701 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e201f173-2951-4a06-81a8-07a368be5057 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0fa60836bb748ac9e9ceee8bcdc657a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7921f98c5ea430aaf7712b31ad3fe8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:38.089465 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e201f173-2951-4a06-81a8-07a368be5057 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] 10.222.0.79 "GET /compute/v2.1/servers/d7f96ed0-3416-4367-ae7d-814c35c75e44" status: 200 len: 1317 microversion: 2.1 time: 1.139838 Oct 17 14:01:38.109498 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2662/5187] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:01:36 2022] GET /compute/v2.1/servers/d7f96ed0-3416-4367-ae7d-814c35c75e44 => generated 1317 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:01:39.127212 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b8535e34-975b-46f4-b673-e178eefe0acb tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:39.128447 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b8535e34-975b-46f4-b673-e178eefe0acb tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] [instance: d7f96ed0-3416-4367-ae7d-814c35c75e44] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:39.138085 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:01:39.149040 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=6 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:01:39.154956 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b8535e34-975b-46f4-b673-e178eefe0acb tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:39.164067 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b8535e34-975b-46f4-b673-e178eefe0acb tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:39.164733 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b8535e34-975b-46f4-b673-e178eefe0acb tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:39.166293 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b8535e34-975b-46f4-b673-e178eefe0acb tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:39.166912 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b8535e34-975b-46f4-b673-e178eefe0acb tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:39.167735 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b8535e34-975b-46f4-b673-e178eefe0acb tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:39.182335 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=52 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:01:39.724191 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b8535e34-975b-46f4-b673-e178eefe0acb tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0fa60836bb748ac9e9ceee8bcdc657a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7921f98c5ea430aaf7712b31ad3fe8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:39.733692 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b8535e34-975b-46f4-b673-e178eefe0acb tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] 10.222.0.79 "GET /compute/v2.1/servers/d7f96ed0-3416-4367-ae7d-814c35c75e44" status: 200 len: 1317 microversion: 2.1 time: 0.613072 Oct 17 14:01:39.749857 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2526/5188] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:01:39 2022] GET /compute/v2.1/servers/d7f96ed0-3416-4367-ae7d-814c35c75e44 => generated 1317 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:01:40.759457 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9d94a695-ba79-4b4d-b858-451bb61ca41f tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:40.760073 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9d94a695-ba79-4b4d-b858-451bb61ca41f tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] [instance: d7f96ed0-3416-4367-ae7d-814c35c75e44] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:40.779543 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9d94a695-ba79-4b4d-b858-451bb61ca41f tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:40.780329 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9d94a695-ba79-4b4d-b858-451bb61ca41f tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:40.781054 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9d94a695-ba79-4b4d-b858-451bb61ca41f tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:40.783555 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9d94a695-ba79-4b4d-b858-451bb61ca41f tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:40.784223 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9d94a695-ba79-4b4d-b858-451bb61ca41f tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:40.791098 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9d94a695-ba79-4b4d-b858-451bb61ca41f tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:41.175836 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9d94a695-ba79-4b4d-b858-451bb61ca41f tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0fa60836bb748ac9e9ceee8bcdc657a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7921f98c5ea430aaf7712b31ad3fe8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:41.185652 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9d94a695-ba79-4b4d-b858-451bb61ca41f tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] 10.222.0.79 "GET /compute/v2.1/servers/d7f96ed0-3416-4367-ae7d-814c35c75e44" status: 200 len: 1317 microversion: 2.1 time: 0.429757 Oct 17 14:01:41.195708 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2663/5189] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:01:40 2022] GET /compute/v2.1/servers/d7f96ed0-3416-4367-ae7d-814c35c75e44 => generated 1317 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:01:42.211954 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-61d95e50-cbc1-4cb6-98f4-1c2df215be29 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:42.213139 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-61d95e50-cbc1-4cb6-98f4-1c2df215be29 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] [instance: d7f96ed0-3416-4367-ae7d-814c35c75e44] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:42.234384 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-61d95e50-cbc1-4cb6-98f4-1c2df215be29 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:42.235532 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-61d95e50-cbc1-4cb6-98f4-1c2df215be29 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:42.237178 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-61d95e50-cbc1-4cb6-98f4-1c2df215be29 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:42.239369 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-61d95e50-cbc1-4cb6-98f4-1c2df215be29 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:42.240864 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-61d95e50-cbc1-4cb6-98f4-1c2df215be29 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:42.243296 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-61d95e50-cbc1-4cb6-98f4-1c2df215be29 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:42.546178 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-ee55dd3c-1f61-4aab-aed2-9fc4cdcdecc2 req-35ee907f-c9db-4ab1-8498-35b3e5bd249e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7f96ed0-3416-4367-ae7d-814c35c75e44", "name": "network-vif-plugged", "status": "completed", "tag": "eec5fb32-ca4f-4bdd-b733-c169f9763612"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:01:42.566013 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-ee55dd3c-1f61-4aab-aed2-9fc4cdcdecc2 req-35ee907f-c9db-4ab1-8498-35b3e5bd249e service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:42.566504 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-ee55dd3c-1f61-4aab-aed2-9fc4cdcdecc2 req-35ee907f-c9db-4ab1-8498-35b3e5bd249e service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:42.566939 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-ee55dd3c-1f61-4aab-aed2-9fc4cdcdecc2 req-35ee907f-c9db-4ab1-8498-35b3e5bd249e service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:42.590446 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-ee55dd3c-1f61-4aab-aed2-9fc4cdcdecc2 req-35ee907f-c9db-4ab1-8498-35b3e5bd249e service nova] Creating event network-vif-plugged:eec5fb32-ca4f-4bdd-b733-c169f9763612 for instance d7f96ed0-3416-4367-ae7d-814c35c75e44 on n-h2-854247-14 Oct 17 14:01:42.608229 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-ee55dd3c-1f61-4aab-aed2-9fc4cdcdecc2 req-35ee907f-c9db-4ab1-8498-35b3e5bd249e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066056 Oct 17 14:01:42.611223 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2664/5190] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:01:42.866365 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-61d95e50-cbc1-4cb6-98f4-1c2df215be29 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0fa60836bb748ac9e9ceee8bcdc657a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7921f98c5ea430aaf7712b31ad3fe8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:42.880221 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-61d95e50-cbc1-4cb6-98f4-1c2df215be29 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] 10.222.0.79 "GET /compute/v2.1/servers/d7f96ed0-3416-4367-ae7d-814c35c75e44" status: 200 len: 1317 microversion: 2.1 time: 0.669293 Oct 17 14:01:42.888460 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2527/5191] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:01:42 2022] GET /compute/v2.1/servers/d7f96ed0-3416-4367-ae7d-814c35c75e44 => generated 1317 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:01:43.913609 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-172517c9-8ecf-4487-b7ad-ad1c2ff84fa4 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:43.914337 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-172517c9-8ecf-4487-b7ad-ad1c2ff84fa4 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] [instance: d7f96ed0-3416-4367-ae7d-814c35c75e44] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:43.929305 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-172517c9-8ecf-4487-b7ad-ad1c2ff84fa4 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:43.929515 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-172517c9-8ecf-4487-b7ad-ad1c2ff84fa4 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:43.929785 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-172517c9-8ecf-4487-b7ad-ad1c2ff84fa4 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:43.930512 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-172517c9-8ecf-4487-b7ad-ad1c2ff84fa4 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:43.930961 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-172517c9-8ecf-4487-b7ad-ad1c2ff84fa4 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:43.931946 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-172517c9-8ecf-4487-b7ad-ad1c2ff84fa4 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:44.570385 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-172517c9-8ecf-4487-b7ad-ad1c2ff84fa4 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0fa60836bb748ac9e9ceee8bcdc657a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7921f98c5ea430aaf7712b31ad3fe8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:44.582196 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-172517c9-8ecf-4487-b7ad-ad1c2ff84fa4 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] 10.222.0.79 "GET /compute/v2.1/servers/d7f96ed0-3416-4367-ae7d-814c35c75e44" status: 200 len: 1317 microversion: 2.1 time: 0.678333 Oct 17 14:01:44.583682 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2665/5192] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:01:43 2022] GET /compute/v2.1/servers/d7f96ed0-3416-4367-ae7d-814c35c75e44 => generated 1317 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:01:45.613659 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9cef7f29-0c7d-4435-ab30-806e22bc9f42 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:45.615088 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9cef7f29-0c7d-4435-ab30-806e22bc9f42 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] [instance: d7f96ed0-3416-4367-ae7d-814c35c75e44] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:45.638316 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9cef7f29-0c7d-4435-ab30-806e22bc9f42 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:45.638887 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9cef7f29-0c7d-4435-ab30-806e22bc9f42 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:45.640318 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9cef7f29-0c7d-4435-ab30-806e22bc9f42 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:45.641113 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9cef7f29-0c7d-4435-ab30-806e22bc9f42 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:45.641577 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9cef7f29-0c7d-4435-ab30-806e22bc9f42 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:45.642002 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9cef7f29-0c7d-4435-ab30-806e22bc9f42 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:46.153018 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9cef7f29-0c7d-4435-ab30-806e22bc9f42 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0fa60836bb748ac9e9ceee8bcdc657a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7921f98c5ea430aaf7712b31ad3fe8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:46.171394 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9cef7f29-0c7d-4435-ab30-806e22bc9f42 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] 10.222.0.79 "GET /compute/v2.1/servers/d7f96ed0-3416-4367-ae7d-814c35c75e44" status: 200 len: 1506 microversion: 2.1 time: 0.564665 Oct 17 14:01:46.172135 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2528/5193] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:01:45 2022] GET /compute/v2.1/servers/d7f96ed0-3416-4367-ae7d-814c35c75e44 => generated 1506 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:01:46.208567 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ce76f913-41ef-445e-8294-71759ce24bdb tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:46.209108 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ce76f913-41ef-445e-8294-71759ce24bdb tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] [instance: d7f96ed0-3416-4367-ae7d-814c35c75e44] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:46.228678 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ce76f913-41ef-445e-8294-71759ce24bdb tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:46.229421 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ce76f913-41ef-445e-8294-71759ce24bdb tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:46.230171 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ce76f913-41ef-445e-8294-71759ce24bdb tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:46.232717 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ce76f913-41ef-445e-8294-71759ce24bdb tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:46.233555 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ce76f913-41ef-445e-8294-71759ce24bdb tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:46.243937 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ce76f913-41ef-445e-8294-71759ce24bdb tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:46.326803 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ce76f913-41ef-445e-8294-71759ce24bdb tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'e0fa60836bb748ac9e9ceee8bcdc657a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7921f98c5ea430aaf7712b31ad3fe8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:46.329481 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ce76f913-41ef-445e-8294-71759ce24bdb tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] 10.222.0.79 "GET /compute/v2.1/servers/d7f96ed0-3416-4367-ae7d-814c35c75e44/os-instance-actions/req-fa38e714-ccca-466e-9db7-83c4ea33ba74" status: 200 len: 313 microversion: 2.1 time: 0.136404 Oct 17 14:01:46.330701 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2666/5194] 10.222.0.79 () {58 vars in 1419 bytes} [Mon Oct 17 14:01:46 2022] GET /compute/v2.1/servers/d7f96ed0-3416-4367-ae7d-814c35c75e44/os-instance-actions/req-fa38e714-ccca-466e-9db7-83c4ea33ba74 => generated 313 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:01:46.352355 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-82ce3b49-d3d6-4c82-a48f-a78b23b33d0a tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:01:46.362429 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-82ce3b49-d3d6-4c82-a48f-a78b23b33d0a tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] [instance: d7f96ed0-3416-4367-ae7d-814c35c75e44] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:46.385282 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82ce3b49-d3d6-4c82-a48f-a78b23b33d0a tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:46.385772 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82ce3b49-d3d6-4c82-a48f-a78b23b33d0a tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:46.388040 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82ce3b49-d3d6-4c82-a48f-a78b23b33d0a tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:46.389259 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82ce3b49-d3d6-4c82-a48f-a78b23b33d0a tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:46.397223 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82ce3b49-d3d6-4c82-a48f-a78b23b33d0a tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:46.397929 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82ce3b49-d3d6-4c82-a48f-a78b23b33d0a tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:46.681684 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-82ce3b49-d3d6-4c82-a48f-a78b23b33d0a tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] 10.222.0.79 "POST /compute/v2.1/servers/d7f96ed0-3416-4367-ae7d-814c35c75e44/action" status: 202 len: 0 microversion: 2.1 time: 0.340022 Oct 17 14:01:46.686528 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2529/5195] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:01:46 2022] POST /compute/v2.1/servers/d7f96ed0-3416-4367-ae7d-814c35c75e44/action => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 14:01:46.692710 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2c331787-e1e6-4f80-aedd-8f153e002348 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:46.693803 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2c331787-e1e6-4f80-aedd-8f153e002348 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] [instance: d7f96ed0-3416-4367-ae7d-814c35c75e44] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:46.704413 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2c331787-e1e6-4f80-aedd-8f153e002348 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:46.706187 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2c331787-e1e6-4f80-aedd-8f153e002348 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:46.707709 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2c331787-e1e6-4f80-aedd-8f153e002348 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:46.709991 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2c331787-e1e6-4f80-aedd-8f153e002348 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:46.710725 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2c331787-e1e6-4f80-aedd-8f153e002348 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:46.712796 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2c331787-e1e6-4f80-aedd-8f153e002348 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:47.400104 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2c331787-e1e6-4f80-aedd-8f153e002348 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0fa60836bb748ac9e9ceee8bcdc657a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7921f98c5ea430aaf7712b31ad3fe8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:47.417552 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2c331787-e1e6-4f80-aedd-8f153e002348 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] 10.222.0.79 "GET /compute/v2.1/servers/d7f96ed0-3416-4367-ae7d-814c35c75e44" status: 200 len: 1508 microversion: 2.1 time: 0.729637 Oct 17 14:01:47.418134 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2667/5196] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:01:46 2022] GET /compute/v2.1/servers/d7f96ed0-3416-4367-ae7d-814c35c75e44 => generated 1508 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:01:48.446043 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-df4e0e9a-d21d-4b75-aa79-6282a52ee41a tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:48.446840 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-df4e0e9a-d21d-4b75-aa79-6282a52ee41a tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] [instance: d7f96ed0-3416-4367-ae7d-814c35c75e44] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:48.464541 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-df4e0e9a-d21d-4b75-aa79-6282a52ee41a tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:48.465496 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-df4e0e9a-d21d-4b75-aa79-6282a52ee41a tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:48.467781 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-df4e0e9a-d21d-4b75-aa79-6282a52ee41a tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:48.469016 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-df4e0e9a-d21d-4b75-aa79-6282a52ee41a tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:48.470686 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-df4e0e9a-d21d-4b75-aa79-6282a52ee41a tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:48.473339 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-df4e0e9a-d21d-4b75-aa79-6282a52ee41a tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:48.963656 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-df4e0e9a-d21d-4b75-aa79-6282a52ee41a tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0fa60836bb748ac9e9ceee8bcdc657a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7921f98c5ea430aaf7712b31ad3fe8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:48.988279 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-df4e0e9a-d21d-4b75-aa79-6282a52ee41a tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] 10.222.0.79 "GET /compute/v2.1/servers/d7f96ed0-3416-4367-ae7d-814c35c75e44" status: 200 len: 1508 microversion: 2.1 time: 0.543062 Oct 17 14:01:48.989246 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2530/5197] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:01:48 2022] GET /compute/v2.1/servers/d7f96ed0-3416-4367-ae7d-814c35c75e44 => generated 1508 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:01:50.019957 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5dc6eb0d-ff92-43ea-b311-97ea031d5714 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:50.021380 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5dc6eb0d-ff92-43ea-b311-97ea031d5714 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] [instance: d7f96ed0-3416-4367-ae7d-814c35c75e44] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:50.029716 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5dc6eb0d-ff92-43ea-b311-97ea031d5714 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:50.030439 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5dc6eb0d-ff92-43ea-b311-97ea031d5714 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:50.034557 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5dc6eb0d-ff92-43ea-b311-97ea031d5714 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:50.035434 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5dc6eb0d-ff92-43ea-b311-97ea031d5714 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:50.036093 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5dc6eb0d-ff92-43ea-b311-97ea031d5714 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:50.038910 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5dc6eb0d-ff92-43ea-b311-97ea031d5714 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:50.480569 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5dc6eb0d-ff92-43ea-b311-97ea031d5714 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0fa60836bb748ac9e9ceee8bcdc657a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7921f98c5ea430aaf7712b31ad3fe8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:50.507299 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5dc6eb0d-ff92-43ea-b311-97ea031d5714 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] 10.222.0.79 "GET /compute/v2.1/servers/d7f96ed0-3416-4367-ae7d-814c35c75e44" status: 200 len: 1506 microversion: 2.1 time: 0.495939 Oct 17 14:01:50.509090 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2668/5198] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:01:50 2022] GET /compute/v2.1/servers/d7f96ed0-3416-4367-ae7d-814c35c75e44 => generated 1506 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:01:50.534523 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ccfc614f-924d-46d5-843d-807c5fed7ec8 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Calling method '.version_select at 0x7f7cd45c5af0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:50.535098 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ccfc614f-924d-46d5-843d-807c5fed7ec8 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] [instance: d7f96ed0-3416-4367-ae7d-814c35c75e44] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:50.538343 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:01:50.547765 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ccfc614f-924d-46d5-843d-807c5fed7ec8 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:50.550801 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ccfc614f-924d-46d5-843d-807c5fed7ec8 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:50.551286 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ccfc614f-924d-46d5-843d-807c5fed7ec8 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:50.552026 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ccfc614f-924d-46d5-843d-807c5fed7ec8 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:50.552482 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ccfc614f-924d-46d5-843d-807c5fed7ec8 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:50.552907 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ccfc614f-924d-46d5-843d-807c5fed7ec8 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:50.624814 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ccfc614f-924d-46d5-843d-807c5fed7ec8 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] 10.222.0.79 "GET /compute/v2.1/servers/d7f96ed0-3416-4367-ae7d-814c35c75e44/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.094444 Oct 17 14:01:50.647079 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2531/5199] 10.222.0.79 () {58 vars in 1296 bytes} [Mon Oct 17 14:01:50 2022] GET /compute/v2.1/servers/d7f96ed0-3416-4367-ae7d-814c35c75e44/os-instance-actions => generated 611 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:01:50.661969 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3f3a1c5d-d1ae-4d65-b5ce-67b0684311e1 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:50.662472 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3f3a1c5d-d1ae-4d65-b5ce-67b0684311e1 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] [instance: d7f96ed0-3416-4367-ae7d-814c35c75e44] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:50.673256 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3f3a1c5d-d1ae-4d65-b5ce-67b0684311e1 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:50.678301 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3f3a1c5d-d1ae-4d65-b5ce-67b0684311e1 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:50.679608 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3f3a1c5d-d1ae-4d65-b5ce-67b0684311e1 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:50.680858 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3f3a1c5d-d1ae-4d65-b5ce-67b0684311e1 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:50.681408 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3f3a1c5d-d1ae-4d65-b5ce-67b0684311e1 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:50.681936 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3f3a1c5d-d1ae-4d65-b5ce-67b0684311e1 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:50.781723 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3f3a1c5d-d1ae-4d65-b5ce-67b0684311e1 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] [instance: d7f96ed0-3416-4367-ae7d-814c35c75e44] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:01:51.007635 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3f3a1c5d-d1ae-4d65-b5ce-67b0684311e1 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] 10.222.0.79 "DELETE /compute/v2.1/servers/d7f96ed0-3416-4367-ae7d-814c35c75e44" status: 204 len: 0 microversion: 2.1 time: 0.350354 Oct 17 14:01:51.011449 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2669/5200] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:01:50 2022] DELETE /compute/v2.1/servers/d7f96ed0-3416-4367-ae7d-814c35c75e44 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:01:51.017635 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-645e3966-a004-4813-8477-c834ce75e382 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:51.018449 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-645e3966-a004-4813-8477-c834ce75e382 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] [instance: d7f96ed0-3416-4367-ae7d-814c35c75e44] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:51.026941 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-645e3966-a004-4813-8477-c834ce75e382 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:51.029619 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-645e3966-a004-4813-8477-c834ce75e382 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:51.032860 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-645e3966-a004-4813-8477-c834ce75e382 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:51.034078 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-645e3966-a004-4813-8477-c834ce75e382 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:51.036443 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-645e3966-a004-4813-8477-c834ce75e382 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:51.038370 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-645e3966-a004-4813-8477-c834ce75e382 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:51.587574 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-645e3966-a004-4813-8477-c834ce75e382 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0fa60836bb748ac9e9ceee8bcdc657a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7921f98c5ea430aaf7712b31ad3fe8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:51.602419 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-645e3966-a004-4813-8477-c834ce75e382 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] 10.222.0.79 "GET /compute/v2.1/servers/d7f96ed0-3416-4367-ae7d-814c35c75e44" status: 200 len: 1512 microversion: 2.1 time: 0.586292 Oct 17 14:01:51.629620 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2532/5201] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:01:51 2022] GET /compute/v2.1/servers/d7f96ed0-3416-4367-ae7d-814c35c75e44 => generated 1512 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:01:51.831327 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a802f446-a038-41f8-8234-59dc1d990bb8 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:51.832481 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a802f446-a038-41f8-8234-59dc1d990bb8 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:51.851810 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a802f446-a038-41f8-8234-59dc1d990bb8 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:51.852653 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a802f446-a038-41f8-8234-59dc1d990bb8 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:51.853128 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a802f446-a038-41f8-8234-59dc1d990bb8 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:51.853856 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a802f446-a038-41f8-8234-59dc1d990bb8 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:51.854305 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a802f446-a038-41f8-8234-59dc1d990bb8 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:51.854727 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a802f446-a038-41f8-8234-59dc1d990bb8 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:51.939983 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a802f446-a038-41f8-8234-59dc1d990bb8 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565/ips" status: 200 len: 151 microversion: 2.20 time: 0.110478 Oct 17 14:01:51.943206 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2670/5202] 10.222.0.79 () {60 vars in 1289 bytes} [Mon Oct 17 14:01:51 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565/ips => generated 151 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:01:52.636700 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5aeb93da-ee35-484b-83f0-7431d11576db tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:52.637511 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5aeb93da-ee35-484b-83f0-7431d11576db tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] [instance: d7f96ed0-3416-4367-ae7d-814c35c75e44] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:52.650162 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5aeb93da-ee35-484b-83f0-7431d11576db tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:52.657468 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5aeb93da-ee35-484b-83f0-7431d11576db tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:52.658042 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5aeb93da-ee35-484b-83f0-7431d11576db tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:52.662303 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5aeb93da-ee35-484b-83f0-7431d11576db tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:52.663019 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5aeb93da-ee35-484b-83f0-7431d11576db tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:52.663721 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5aeb93da-ee35-484b-83f0-7431d11576db tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:53.399112 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5aeb93da-ee35-484b-83f0-7431d11576db tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0fa60836bb748ac9e9ceee8bcdc657a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7921f98c5ea430aaf7712b31ad3fe8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:53.407771 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5aeb93da-ee35-484b-83f0-7431d11576db tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] 10.222.0.79 "GET /compute/v2.1/servers/d7f96ed0-3416-4367-ae7d-814c35c75e44" status: 200 len: 1512 microversion: 2.1 time: 0.775092 Oct 17 14:01:53.408363 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2533/5203] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:01:52 2022] GET /compute/v2.1/servers/d7f96ed0-3416-4367-ae7d-814c35c75e44 => generated 1512 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:01:54.436055 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cadbbe58-1586-4e81-b79d-8695c2bea94c tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:54.437379 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cadbbe58-1586-4e81-b79d-8695c2bea94c tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] [instance: d7f96ed0-3416-4367-ae7d-814c35c75e44] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:54.465779 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cadbbe58-1586-4e81-b79d-8695c2bea94c tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:54.467108 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cadbbe58-1586-4e81-b79d-8695c2bea94c tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:54.468401 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cadbbe58-1586-4e81-b79d-8695c2bea94c tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:54.469302 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cadbbe58-1586-4e81-b79d-8695c2bea94c tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:54.469770 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cadbbe58-1586-4e81-b79d-8695c2bea94c tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:54.472397 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cadbbe58-1586-4e81-b79d-8695c2bea94c tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:55.233273 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f5066451-9e64-420b-a2ee-9c3240dc69b3 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:01:55.233910 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f5066451-9e64-420b-a2ee-9c3240dc69b3 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:55.249294 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f5066451-9e64-420b-a2ee-9c3240dc69b3 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:55.249817 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f5066451-9e64-420b-a2ee-9c3240dc69b3 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:55.250265 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f5066451-9e64-420b-a2ee-9c3240dc69b3 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:55.250990 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f5066451-9e64-420b-a2ee-9c3240dc69b3 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:55.258705 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f5066451-9e64-420b-a2ee-9c3240dc69b3 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:55.259186 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f5066451-9e64-420b-a2ee-9c3240dc69b3 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:55.324794 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-f5066451-9e64-420b-a2ee-9c3240dc69b3 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lazy-loading 'flavor' on Instance uuid 86508a39-65fa-4421-b31d-ffbc5fdee565 {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:01:55.331800 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cadbbe58-1586-4e81-b79d-8695c2bea94c tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0fa60836bb748ac9e9ceee8bcdc657a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7921f98c5ea430aaf7712b31ad3fe8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:55.367559 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cadbbe58-1586-4e81-b79d-8695c2bea94c tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] 10.222.0.79 "GET /compute/v2.1/servers/d7f96ed0-3416-4367-ae7d-814c35c75e44" status: 200 len: 1512 microversion: 2.1 time: 0.932284 Oct 17 14:01:55.376728 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2671/5204] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:01:54 2022] GET /compute/v2.1/servers/d7f96ed0-3416-4367-ae7d-814c35c75e44 => generated 1512 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:01:55.427446 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-72e1c8b4-0c41-4f70-afe2-588bdf674516 req-73d206a7-a18e-4541-ad6f-c3388f187f2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7f96ed0-3416-4367-ae7d-814c35c75e44", "name": "network-vif-deleted", "tag": "eec5fb32-ca4f-4bdd-b733-c169f9763612"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:01:55.453209 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-72e1c8b4-0c41-4f70-afe2-588bdf674516 req-73d206a7-a18e-4541-ad6f-c3388f187f2d service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:55.458144 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-72e1c8b4-0c41-4f70-afe2-588bdf674516 req-73d206a7-a18e-4541-ad6f-c3388f187f2d service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:55.460061 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-72e1c8b4-0c41-4f70-afe2-588bdf674516 req-73d206a7-a18e-4541-ad6f-c3388f187f2d service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:55.528856 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-72e1c8b4-0c41-4f70-afe2-588bdf674516 req-73d206a7-a18e-4541-ad6f-c3388f187f2d service nova] Creating event network-vif-deleted:eec5fb32-ca4f-4bdd-b733-c169f9763612 for instance d7f96ed0-3416-4367-ae7d-814c35c75e44 on n-h2-854247-14 Oct 17 14:01:55.544630 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-72e1c8b4-0c41-4f70-afe2-588bdf674516 req-73d206a7-a18e-4541-ad6f-c3388f187f2d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121788 Oct 17 14:01:55.561597 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2672/5205] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:01:55.705302 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f5066451-9e64-420b-a2ee-9c3240dc69b3 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "POST /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565/action" status: 202 len: 0 microversion: 2.20 time: 0.476528 Oct 17 14:01:55.705940 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2534/5206] 10.222.0.79 () {62 vars in 1319 bytes} [Mon Oct 17 14:01:55 2022] POST /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565/action => generated 0 bytes in 479 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 17 14:01:55.715243 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7f80a67c-26fd-4c1a-9c1c-7c634bc374ad tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:55.716078 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7f80a67c-26fd-4c1a-9c1c-7c634bc374ad tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:55.753316 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7f80a67c-26fd-4c1a-9c1c-7c634bc374ad tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:55.755653 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7f80a67c-26fd-4c1a-9c1c-7c634bc374ad tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:55.756130 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7f80a67c-26fd-4c1a-9c1c-7c634bc374ad tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:55.760950 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7f80a67c-26fd-4c1a-9c1c-7c634bc374ad tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:55.761445 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7f80a67c-26fd-4c1a-9c1c-7c634bc374ad tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:55.761886 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7f80a67c-26fd-4c1a-9c1c-7c634bc374ad tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:56.282144 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7f80a67c-26fd-4c1a-9c1c-7c634bc374ad tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:56.298418 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7f80a67c-26fd-4c1a-9c1c-7c634bc374ad tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:56.300892 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7f80a67c-26fd-4c1a-9c1c-7c634bc374ad tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:56.304366 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7f80a67c-26fd-4c1a-9c1c-7c634bc374ad tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1723 microversion: 2.20 time: 0.592400 Oct 17 14:01:56.312479 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2673/5207] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:01:55 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1723 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:01:56.402135 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1030794f-e4e8-479c-aba9-52cbd48b2c32 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:56.402854 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1030794f-e4e8-479c-aba9-52cbd48b2c32 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] [instance: d7f96ed0-3416-4367-ae7d-814c35c75e44] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:56.414520 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1030794f-e4e8-479c-aba9-52cbd48b2c32 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:56.415215 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1030794f-e4e8-479c-aba9-52cbd48b2c32 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:56.427708 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1030794f-e4e8-479c-aba9-52cbd48b2c32 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:56.428887 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1030794f-e4e8-479c-aba9-52cbd48b2c32 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:56.429373 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1030794f-e4e8-479c-aba9-52cbd48b2c32 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:56.429810 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1030794f-e4e8-479c-aba9-52cbd48b2c32 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:56.472230 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-1030794f-e4e8-479c-aba9-52cbd48b2c32 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] HTTP exception thrown: Instance d7f96ed0-3416-4367-ae7d-814c35c75e44 could not be found. Oct 17 14:01:56.478196 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1030794f-e4e8-479c-aba9-52cbd48b2c32 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Request method failure captured: Oct 17 14:01:56.478196 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/d7f96ed0-3416-4367-ae7d-814c35c75e44 HTTP/1.1 Oct 17 14:01:56.478196 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 14:01:56.478196 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 14:01:56.478196 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 14:01:56.478196 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 14:01:56.478196 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 14:01:56.478196 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 14:01:56.478196 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 14:01:56.478196 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 14:01:56.478196 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTWA1CL8Oc55wVd3U-vUuoVMzO2GbNQuy3wvfMawDvTYOlUre1mEhXiNwz8O4L510o0EB9SCmGQglWHi0ZPVp93qiBRdgV4ShQ0YBwqdR0MUE_DTNlK7FU3yCgQybZK7DMuX6qrG_O294dhopqYCZmDO_oNZNIrV0RvNiL-QN7vRgI-8 Oct 17 14:01:56.478196 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 14:01:56.478196 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 14:01:56.478196 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 14:01:56.478196 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 14:01:56.478196 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 14:01:56.478196 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 14:01:56.478196 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: a7921f98c5ea430aaf7712b31ad3fe8b Oct 17 14:01:56.478196 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-InstanceActionsTestJSON-200583400 Oct 17 14:01:56.478196 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 14:01:56.478196 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 14:01:56.478196 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a7921f98c5ea430aaf7712b31ad3fe8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a7921f98c5ea430aaf7712b31ad3fe8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a7921f98c5ea430aaf7712b31ad3fe8b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a7921f98c5ea430aaf7712b31ad3fe8b", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:01:56.478196 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-InstanceActionsTestJSON-200583400 Oct 17 14:01:56.478196 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: a7921f98c5ea430aaf7712b31ad3fe8b Oct 17 14:01:56.478196 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-InstanceActionsTestJSON-200583400 Oct 17 14:01:56.478196 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-InstanceActionsTestJSON-200583400-project Oct 17 14:01:56.478196 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 14:01:56.478196 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 14:01:56.478196 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: e0fa60836bb748ac9e9ceee8bcdc657a Oct 17 14:01:56.478196 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-InstanceActionsTestJSON-200583400-project Oct 17 14:01:56.478196 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 14:01:56.478196 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance d7f96ed0-3416-4367-ae7d-814c35c75e44 could not be found. Oct 17 14:01:56.478196 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'd7f96ed0-3416-4367-ae7d-814c35c75e44'} Oct 17 14:01:56.478196 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:01:56.478196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:01:56.478196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:01:56.478196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:01:56.478196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:01:56.478196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:01:56.478196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:01:56.478196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:01:56.478196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:01:56.478196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:01:56.478196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7f96ed0-3416-4367-ae7d-814c35c75e44 could not be found. Oct 17 14:01:56.478196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:01:56.478196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:01:56.478196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:01:56.478196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:01:56.478196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:01:56.478196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:01:56.478196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:01:56.478196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:01:56.478196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:01:56.478196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:01:56.478196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:01:56.478196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:01:56.478196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:01:56.478196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:01:56.478196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:01:56.478196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:01:56.478196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7f96ed0-3416-4367-ae7d-814c35c75e44 could not be found. Oct 17 14:01:56.478196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:01:56.478196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:01:56.478196 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:01:56.483103 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:01:56.483103 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:01:56.483103 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:01:56.483103 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:01:56.483103 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:01:56.483103 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7f96ed0-3416-4367-ae7d-814c35c75e44 could not be found. Oct 17 14:01:56.483103 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:01:56.488383 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1030794f-e4e8-479c-aba9-52cbd48b2c32 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] Returning 404 to user: Instance d7f96ed0-3416-4367-ae7d-814c35c75e44 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:01:56.490286 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1030794f-e4e8-479c-aba9-52cbd48b2c32 tempest-InstanceActionsTestJSON-200583400 tempest-InstanceActionsTestJSON-200583400-project] 10.222.0.79 "GET /compute/v2.1/servers/d7f96ed0-3416-4367-ae7d-814c35c75e44" status: 404 len: 111 microversion: 2.1 time: 0.093092 Oct 17 14:01:56.492576 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2535/5208] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:01:56 2022] GET /compute/v2.1/servers/d7f96ed0-3416-4367-ae7d-814c35c75e44 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:01:57.341729 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9f633093-c87b-4e94-ab6a-99de2ce8008f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:57.342445 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9f633093-c87b-4e94-ab6a-99de2ce8008f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:57.349326 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9f633093-c87b-4e94-ab6a-99de2ce8008f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:57.360190 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9f633093-c87b-4e94-ab6a-99de2ce8008f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:57.361002 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9f633093-c87b-4e94-ab6a-99de2ce8008f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:57.362171 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9f633093-c87b-4e94-ab6a-99de2ce8008f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:57.362829 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9f633093-c87b-4e94-ab6a-99de2ce8008f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:57.363765 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9f633093-c87b-4e94-ab6a-99de2ce8008f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:57.964383 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9f633093-c87b-4e94-ab6a-99de2ce8008f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:57.978378 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9f633093-c87b-4e94-ab6a-99de2ce8008f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:57.980565 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9f633093-c87b-4e94-ab6a-99de2ce8008f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:57.982210 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9f633093-c87b-4e94-ab6a-99de2ce8008f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1723 microversion: 2.20 time: 0.644615 Oct 17 14:01:57.983503 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2674/5209] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:01:57 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1723 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:01:59.010841 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4c6c8870-b40a-4442-91db-1e6ab9aeab96 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:59.018336 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4c6c8870-b40a-4442-91db-1e6ab9aeab96 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:59.050233 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4c6c8870-b40a-4442-91db-1e6ab9aeab96 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:59.050233 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4c6c8870-b40a-4442-91db-1e6ab9aeab96 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:59.050233 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4c6c8870-b40a-4442-91db-1e6ab9aeab96 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:59.050233 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4c6c8870-b40a-4442-91db-1e6ab9aeab96 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:59.050233 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4c6c8870-b40a-4442-91db-1e6ab9aeab96 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:59.050233 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4c6c8870-b40a-4442-91db-1e6ab9aeab96 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:59.416380 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4c6c8870-b40a-4442-91db-1e6ab9aeab96 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:59.429279 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4c6c8870-b40a-4442-91db-1e6ab9aeab96 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:59.431635 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4c6c8870-b40a-4442-91db-1e6ab9aeab96 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:59.433173 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4c6c8870-b40a-4442-91db-1e6ab9aeab96 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1723 microversion: 2.20 time: 0.426561 Oct 17 14:01:59.433749 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2536/5210] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:01:59 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1723 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:02:00.459970 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b9e73400-6821-423e-a25b-6e14212b155d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:00.460697 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b9e73400-6821-423e-a25b-6e14212b155d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:00.477616 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b9e73400-6821-423e-a25b-6e14212b155d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:00.478313 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b9e73400-6821-423e-a25b-6e14212b155d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:00.480687 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b9e73400-6821-423e-a25b-6e14212b155d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:00.485152 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b9e73400-6821-423e-a25b-6e14212b155d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:00.487816 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b9e73400-6821-423e-a25b-6e14212b155d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:00.488264 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b9e73400-6821-423e-a25b-6e14212b155d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:00.861240 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b9e73400-6821-423e-a25b-6e14212b155d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:00.882740 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b9e73400-6821-423e-a25b-6e14212b155d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:00.886986 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b9e73400-6821-423e-a25b-6e14212b155d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:00.890651 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b9e73400-6821-423e-a25b-6e14212b155d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1723 microversion: 2.20 time: 0.434789 Oct 17 14:02:00.891254 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2675/5211] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:02:00 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1723 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:02:01.916574 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8a3e1a43-d2db-4ffb-8c60-86a1efa81c52 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:01.917941 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8a3e1a43-d2db-4ffb-8c60-86a1efa81c52 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:01.931518 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8a3e1a43-d2db-4ffb-8c60-86a1efa81c52 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:01.935687 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8a3e1a43-d2db-4ffb-8c60-86a1efa81c52 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:01.938166 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8a3e1a43-d2db-4ffb-8c60-86a1efa81c52 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:01.939206 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8a3e1a43-d2db-4ffb-8c60-86a1efa81c52 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:01.947927 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8a3e1a43-d2db-4ffb-8c60-86a1efa81c52 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:01.952945 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8a3e1a43-d2db-4ffb-8c60-86a1efa81c52 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:03.138079 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8a3e1a43-d2db-4ffb-8c60-86a1efa81c52 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:03.200797 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8a3e1a43-d2db-4ffb-8c60-86a1efa81c52 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:03.208331 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8a3e1a43-d2db-4ffb-8c60-86a1efa81c52 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:03.210044 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8a3e1a43-d2db-4ffb-8c60-86a1efa81c52 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1723 microversion: 2.20 time: 1.297476 Oct 17 14:02:03.216860 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2537/5212] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:02:01 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1723 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:02:04.248447 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f8d481bb-583d-4299-906a-4f49e7834000 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:04.250843 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f8d481bb-583d-4299-906a-4f49e7834000 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:04.271924 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f8d481bb-583d-4299-906a-4f49e7834000 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:04.272805 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f8d481bb-583d-4299-906a-4f49e7834000 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:04.276180 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f8d481bb-583d-4299-906a-4f49e7834000 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:04.279348 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f8d481bb-583d-4299-906a-4f49e7834000 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:04.281063 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f8d481bb-583d-4299-906a-4f49e7834000 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:04.281712 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f8d481bb-583d-4299-906a-4f49e7834000 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:05.010055 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f8d481bb-583d-4299-906a-4f49e7834000 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:05.041841 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f8d481bb-583d-4299-906a-4f49e7834000 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:05.056409 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f8d481bb-583d-4299-906a-4f49e7834000 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:05.059723 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f8d481bb-583d-4299-906a-4f49e7834000 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1723 microversion: 2.20 time: 0.818221 Oct 17 14:02:05.060334 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2676/5213] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:02:04 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1723 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:02:06.090551 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-92f4bfee-0acb-4ad3-a68e-9728ad7a493d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:06.091301 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-92f4bfee-0acb-4ad3-a68e-9728ad7a493d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:06.107737 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-92f4bfee-0acb-4ad3-a68e-9728ad7a493d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:06.108509 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-92f4bfee-0acb-4ad3-a68e-9728ad7a493d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:06.110921 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-92f4bfee-0acb-4ad3-a68e-9728ad7a493d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:06.114306 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-92f4bfee-0acb-4ad3-a68e-9728ad7a493d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:06.116168 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-92f4bfee-0acb-4ad3-a68e-9728ad7a493d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:06.118087 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-92f4bfee-0acb-4ad3-a68e-9728ad7a493d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:06.654123 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-92f4bfee-0acb-4ad3-a68e-9728ad7a493d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:06.694429 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-92f4bfee-0acb-4ad3-a68e-9728ad7a493d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:06.697239 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-92f4bfee-0acb-4ad3-a68e-9728ad7a493d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:06.706646 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-92f4bfee-0acb-4ad3-a68e-9728ad7a493d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1723 microversion: 2.20 time: 0.617666 Oct 17 14:02:06.708596 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2538/5214] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:02:06 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1723 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:02:07.743041 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2e4c8f79-a153-4053-93ed-b10cfb4bec80 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:07.743837 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2e4c8f79-a153-4053-93ed-b10cfb4bec80 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:07.748712 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:02:07.763136 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2e4c8f79-a153-4053-93ed-b10cfb4bec80 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:07.763657 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2e4c8f79-a153-4053-93ed-b10cfb4bec80 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:07.764091 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2e4c8f79-a153-4053-93ed-b10cfb4bec80 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:07.768212 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2e4c8f79-a153-4053-93ed-b10cfb4bec80 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:07.768923 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2e4c8f79-a153-4053-93ed-b10cfb4bec80 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:07.770200 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2e4c8f79-a153-4053-93ed-b10cfb4bec80 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:07.782320 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:02:08.349763 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2e4c8f79-a153-4053-93ed-b10cfb4bec80 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:08.365095 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2e4c8f79-a153-4053-93ed-b10cfb4bec80 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:08.368575 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2e4c8f79-a153-4053-93ed-b10cfb4bec80 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:08.370518 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2e4c8f79-a153-4053-93ed-b10cfb4bec80 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1723 microversion: 2.20 time: 0.637263 Oct 17 14:02:08.371941 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2677/5215] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:02:07 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1723 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:02:09.397809 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4e13b1b3-1007-4213-bebc-8d162f0706c4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:09.399464 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4e13b1b3-1007-4213-bebc-8d162f0706c4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:09.418276 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4e13b1b3-1007-4213-bebc-8d162f0706c4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:09.423225 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4e13b1b3-1007-4213-bebc-8d162f0706c4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:09.426346 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4e13b1b3-1007-4213-bebc-8d162f0706c4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:09.430089 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4e13b1b3-1007-4213-bebc-8d162f0706c4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:09.432868 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4e13b1b3-1007-4213-bebc-8d162f0706c4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:09.432868 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4e13b1b3-1007-4213-bebc-8d162f0706c4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:09.496596 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:02:09.837842 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4e13b1b3-1007-4213-bebc-8d162f0706c4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:09.847642 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4e13b1b3-1007-4213-bebc-8d162f0706c4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:09.849117 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4e13b1b3-1007-4213-bebc-8d162f0706c4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:09.861538 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4e13b1b3-1007-4213-bebc-8d162f0706c4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1723 microversion: 2.20 time: 0.463089 Oct 17 14:02:09.878151 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2539/5216] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:02:09 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1723 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 14:02:10.898593 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c18768d1-3f6b-465c-9205-fa43e33a733c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:10.899974 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c18768d1-3f6b-465c-9205-fa43e33a733c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:10.911777 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c18768d1-3f6b-465c-9205-fa43e33a733c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:10.911777 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c18768d1-3f6b-465c-9205-fa43e33a733c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:10.912890 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c18768d1-3f6b-465c-9205-fa43e33a733c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:10.913980 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c18768d1-3f6b-465c-9205-fa43e33a733c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:10.914538 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c18768d1-3f6b-465c-9205-fa43e33a733c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:10.915201 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c18768d1-3f6b-465c-9205-fa43e33a733c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:11.659036 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c18768d1-3f6b-465c-9205-fa43e33a733c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:11.675891 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c18768d1-3f6b-465c-9205-fa43e33a733c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:11.678806 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c18768d1-3f6b-465c-9205-fa43e33a733c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:11.685787 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c18768d1-3f6b-465c-9205-fa43e33a733c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1723 microversion: 2.20 time: 0.792868 Oct 17 14:02:11.688004 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2678/5217] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:02:10 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1723 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:02:12.713801 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f60af091-96f3-4509-b581-9bfa827e950d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:12.715938 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f60af091-96f3-4509-b581-9bfa827e950d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:12.775400 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f60af091-96f3-4509-b581-9bfa827e950d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:12.775863 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f60af091-96f3-4509-b581-9bfa827e950d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:12.776315 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f60af091-96f3-4509-b581-9bfa827e950d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:12.777058 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f60af091-96f3-4509-b581-9bfa827e950d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:12.787251 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f60af091-96f3-4509-b581-9bfa827e950d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:12.787251 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f60af091-96f3-4509-b581-9bfa827e950d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:13.346914 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f60af091-96f3-4509-b581-9bfa827e950d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:13.367049 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f60af091-96f3-4509-b581-9bfa827e950d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:13.372288 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f60af091-96f3-4509-b581-9bfa827e950d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:13.375797 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f60af091-96f3-4509-b581-9bfa827e950d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1744 microversion: 2.20 time: 0.668400 Oct 17 14:02:13.380595 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2540/5218] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:02:12 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1744 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:02:14.417141 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-edd8cbe2-dd80-4ea6-85ad-c6cad274afa7 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:14.421990 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-edd8cbe2-dd80-4ea6-85ad-c6cad274afa7 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:14.442796 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-edd8cbe2-dd80-4ea6-85ad-c6cad274afa7 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:14.445747 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-edd8cbe2-dd80-4ea6-85ad-c6cad274afa7 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:14.446930 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-edd8cbe2-dd80-4ea6-85ad-c6cad274afa7 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:14.448444 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-edd8cbe2-dd80-4ea6-85ad-c6cad274afa7 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:14.449937 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-edd8cbe2-dd80-4ea6-85ad-c6cad274afa7 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:14.451958 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-edd8cbe2-dd80-4ea6-85ad-c6cad274afa7 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:15.449647 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-edd8cbe2-dd80-4ea6-85ad-c6cad274afa7 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:15.469779 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-edd8cbe2-dd80-4ea6-85ad-c6cad274afa7 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:15.487186 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-edd8cbe2-dd80-4ea6-85ad-c6cad274afa7 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:15.491078 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-edd8cbe2-dd80-4ea6-85ad-c6cad274afa7 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1739 microversion: 2.20 time: 1.085155 Oct 17 14:02:15.518203 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2679/5219] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:02:14 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1739 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:02:16.528993 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-19cd3181-a26e-4b8f-94c1-c0d39cb9ae17 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:16.529749 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-19cd3181-a26e-4b8f-94c1-c0d39cb9ae17 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:16.551378 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-19cd3181-a26e-4b8f-94c1-c0d39cb9ae17 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:16.552561 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-19cd3181-a26e-4b8f-94c1-c0d39cb9ae17 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:16.553018 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-19cd3181-a26e-4b8f-94c1-c0d39cb9ae17 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:16.560567 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-19cd3181-a26e-4b8f-94c1-c0d39cb9ae17 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:16.561068 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-19cd3181-a26e-4b8f-94c1-c0d39cb9ae17 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:16.561503 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-19cd3181-a26e-4b8f-94c1-c0d39cb9ae17 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:16.844589 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-3378b07a-1799-443c-88e7-9ed278c3eb0c req-731d6792-1b4a-4a0c-8c33-df2656c146c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86508a39-65fa-4421-b31d-ffbc5fdee565", "name": "network-vif-plugged", "status": "completed", "tag": "be2d42c9-97a7-4933-9200-d27f76f73a39"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:02:16.870629 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-3378b07a-1799-443c-88e7-9ed278c3eb0c req-731d6792-1b4a-4a0c-8c33-df2656c146c4 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:16.875424 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-3378b07a-1799-443c-88e7-9ed278c3eb0c req-731d6792-1b4a-4a0c-8c33-df2656c146c4 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:16.876168 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-3378b07a-1799-443c-88e7-9ed278c3eb0c req-731d6792-1b4a-4a0c-8c33-df2656c146c4 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:16.898576 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-3378b07a-1799-443c-88e7-9ed278c3eb0c req-731d6792-1b4a-4a0c-8c33-df2656c146c4 service nova] Creating event network-vif-plugged:be2d42c9-97a7-4933-9200-d27f76f73a39 for instance 86508a39-65fa-4421-b31d-ffbc5fdee565 on n-h1-854247-14 Oct 17 14:02:16.922613 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-3378b07a-1799-443c-88e7-9ed278c3eb0c req-731d6792-1b4a-4a0c-8c33-df2656c146c4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081614 Oct 17 14:02:16.923986 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2680/5220] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:02:17.039502 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-19cd3181-a26e-4b8f-94c1-c0d39cb9ae17 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:17.058205 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-19cd3181-a26e-4b8f-94c1-c0d39cb9ae17 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:17.070882 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-19cd3181-a26e-4b8f-94c1-c0d39cb9ae17 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:17.072355 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-19cd3181-a26e-4b8f-94c1-c0d39cb9ae17 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1739 microversion: 2.20 time: 0.550027 Oct 17 14:02:17.087196 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2541/5221] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:02:16 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1739 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:02:18.106874 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e7a6eebf-6563-4cc4-a989-1aeab95b423f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:18.108437 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e7a6eebf-6563-4cc4-a989-1aeab95b423f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:18.120448 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7a6eebf-6563-4cc4-a989-1aeab95b423f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:18.138117 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7a6eebf-6563-4cc4-a989-1aeab95b423f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:18.139666 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7a6eebf-6563-4cc4-a989-1aeab95b423f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:18.142143 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7a6eebf-6563-4cc4-a989-1aeab95b423f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:18.145648 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7a6eebf-6563-4cc4-a989-1aeab95b423f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:18.146427 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7a6eebf-6563-4cc4-a989-1aeab95b423f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:18.980960 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e7a6eebf-6563-4cc4-a989-1aeab95b423f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:18.996940 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e7a6eebf-6563-4cc4-a989-1aeab95b423f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:19.000374 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e7a6eebf-6563-4cc4-a989-1aeab95b423f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:19.002594 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e7a6eebf-6563-4cc4-a989-1aeab95b423f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1739 microversion: 2.20 time: 0.900168 Oct 17 14:02:19.017311 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2681/5222] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:02:18 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1739 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:02:20.040929 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3b4620ba-9098-48cb-9100-015c8545c26e tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:20.043907 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3b4620ba-9098-48cb-9100-015c8545c26e tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:20.089420 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3b4620ba-9098-48cb-9100-015c8545c26e tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:20.091367 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3b4620ba-9098-48cb-9100-015c8545c26e tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:20.092063 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3b4620ba-9098-48cb-9100-015c8545c26e tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:20.094830 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3b4620ba-9098-48cb-9100-015c8545c26e tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:20.095603 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3b4620ba-9098-48cb-9100-015c8545c26e tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:20.096200 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3b4620ba-9098-48cb-9100-015c8545c26e tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:20.675484 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3b4620ba-9098-48cb-9100-015c8545c26e tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:20.688966 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3b4620ba-9098-48cb-9100-015c8545c26e tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:20.695362 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3b4620ba-9098-48cb-9100-015c8545c26e tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:20.696878 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3b4620ba-9098-48cb-9100-015c8545c26e tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1739 microversion: 2.20 time: 0.670652 Oct 17 14:02:20.703210 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2542/5223] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:02:20 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1739 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:02:21.738311 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-65c704fc-1a34-43b1-8d81-760fff4b8703 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:21.738933 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-65c704fc-1a34-43b1-8d81-760fff4b8703 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:21.754786 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-65c704fc-1a34-43b1-8d81-760fff4b8703 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:21.755312 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-65c704fc-1a34-43b1-8d81-760fff4b8703 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:21.755807 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-65c704fc-1a34-43b1-8d81-760fff4b8703 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:21.756474 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-65c704fc-1a34-43b1-8d81-760fff4b8703 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:21.756939 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-65c704fc-1a34-43b1-8d81-760fff4b8703 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:21.757372 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-65c704fc-1a34-43b1-8d81-760fff4b8703 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:22.837718 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-65c704fc-1a34-43b1-8d81-760fff4b8703 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:22.928032 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-65c704fc-1a34-43b1-8d81-760fff4b8703 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:22.930401 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-65c704fc-1a34-43b1-8d81-760fff4b8703 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:22.936559 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-65c704fc-1a34-43b1-8d81-760fff4b8703 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1739 microversion: 2.20 time: 1.202168 Oct 17 14:02:22.940238 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2682/5224] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:02:21 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1739 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:02:23.967271 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5a53f84c-ed56-4282-9bdf-122a7d4ca968 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:23.968743 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5a53f84c-ed56-4282-9bdf-122a7d4ca968 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:23.974999 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=24 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:02:23.994192 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5a53f84c-ed56-4282-9bdf-122a7d4ca968 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:23.995208 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5a53f84c-ed56-4282-9bdf-122a7d4ca968 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:23.995919 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5a53f84c-ed56-4282-9bdf-122a7d4ca968 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:23.996791 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5a53f84c-ed56-4282-9bdf-122a7d4ca968 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:23.997376 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5a53f84c-ed56-4282-9bdf-122a7d4ca968 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:23.997948 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5a53f84c-ed56-4282-9bdf-122a7d4ca968 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:24.477094 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5a53f84c-ed56-4282-9bdf-122a7d4ca968 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:24.490724 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5a53f84c-ed56-4282-9bdf-122a7d4ca968 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:24.495091 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5a53f84c-ed56-4282-9bdf-122a7d4ca968 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:24.503272 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5a53f84c-ed56-4282-9bdf-122a7d4ca968 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1739 microversion: 2.20 time: 0.536018 Oct 17 14:02:24.520689 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2543/5225] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:02:23 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1739 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:02:25.531837 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-50e65b61-7944-4f5b-9850-3eca31e38f4a tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:25.532466 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-50e65b61-7944-4f5b-9850-3eca31e38f4a tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:25.552364 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-50e65b61-7944-4f5b-9850-3eca31e38f4a tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:25.552926 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-50e65b61-7944-4f5b-9850-3eca31e38f4a tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:25.553719 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-50e65b61-7944-4f5b-9850-3eca31e38f4a tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:25.556684 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-50e65b61-7944-4f5b-9850-3eca31e38f4a tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:25.557135 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-50e65b61-7944-4f5b-9850-3eca31e38f4a tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:25.557542 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-50e65b61-7944-4f5b-9850-3eca31e38f4a tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:27.585635 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-50e65b61-7944-4f5b-9850-3eca31e38f4a tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:27.669113 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-50e65b61-7944-4f5b-9850-3eca31e38f4a tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:27.677041 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-50e65b61-7944-4f5b-9850-3eca31e38f4a tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:27.685703 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-50e65b61-7944-4f5b-9850-3eca31e38f4a tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1739 microversion: 2.20 time: 2.158068 Oct 17 14:02:27.688390 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2683/5226] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:02:25 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1739 bytes in 2161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:02:28.723326 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e8454e09-32fd-4cb1-97b7-310c822794e5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:28.724290 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e8454e09-32fd-4cb1-97b7-310c822794e5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:28.744577 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e8454e09-32fd-4cb1-97b7-310c822794e5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:28.747392 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e8454e09-32fd-4cb1-97b7-310c822794e5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:28.748116 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e8454e09-32fd-4cb1-97b7-310c822794e5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:28.754570 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e8454e09-32fd-4cb1-97b7-310c822794e5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:28.755405 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e8454e09-32fd-4cb1-97b7-310c822794e5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:28.757008 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e8454e09-32fd-4cb1-97b7-310c822794e5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:29.893851 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e8454e09-32fd-4cb1-97b7-310c822794e5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:29.904635 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e8454e09-32fd-4cb1-97b7-310c822794e5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:29.926230 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e8454e09-32fd-4cb1-97b7-310c822794e5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:29.927685 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e8454e09-32fd-4cb1-97b7-310c822794e5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1739 microversion: 2.20 time: 1.214975 Oct 17 14:02:29.935476 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2544/5227] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:02:28 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1739 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:02:30.959336 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-da60e44b-74d3-419d-b444-47bf9b3fc37e tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:30.960885 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-da60e44b-74d3-419d-b444-47bf9b3fc37e tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:30.976935 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-da60e44b-74d3-419d-b444-47bf9b3fc37e tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:30.977737 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-da60e44b-74d3-419d-b444-47bf9b3fc37e tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:30.980609 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-da60e44b-74d3-419d-b444-47bf9b3fc37e tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:30.981625 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-da60e44b-74d3-419d-b444-47bf9b3fc37e tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:30.982300 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-da60e44b-74d3-419d-b444-47bf9b3fc37e tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:30.984437 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-da60e44b-74d3-419d-b444-47bf9b3fc37e tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:32.250443 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1412da87-79f5-41f2-a421-f572ff4ed31b tempest-ServerGroup264TestJSON-680273720 tempest-ServerGroup264TestJSON-680273720-project] Action: 'create', calling method: .version_select at 0x7f7cd48cef70>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:02:32.293949 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-1412da87-79f5-41f2-a421-f572ff4ed31b tempest-ServerGroup264TestJSON-680273720 tempest-ServerGroup264TestJSON-680273720-project] Getting quotas for project 0b4b0e5518e645048f87269ed2d0e23a. Resources: {'server_groups'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:02:32.318019 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-1412da87-79f5-41f2-a421-f572ff4ed31b tempest-ServerGroup264TestJSON-680273720 tempest-ServerGroup264TestJSON-680273720-project] Getting quotas for user 5db8a937615149fcb49bd240ccc365f5 and project 0b4b0e5518e645048f87269ed2d0e23a. Resources: {'server_groups'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:02:32.426418 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-1412da87-79f5-41f2-a421-f572ff4ed31b tempest-ServerGroup264TestJSON-680273720 tempest-ServerGroup264TestJSON-680273720-project] Getting quotas for project 0b4b0e5518e645048f87269ed2d0e23a. Resources: {'server_groups'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:02:32.432828 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-1412da87-79f5-41f2-a421-f572ff4ed31b tempest-ServerGroup264TestJSON-680273720 tempest-ServerGroup264TestJSON-680273720-project] Getting quotas for user 5db8a937615149fcb49bd240ccc365f5 and project 0b4b0e5518e645048f87269ed2d0e23a. Resources: {'server_groups'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:02:32.447984 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1412da87-79f5-41f2-a421-f572ff4ed31b tempest-ServerGroup264TestJSON-680273720 tempest-ServerGroup264TestJSON-680273720-project] 10.222.0.79 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.531877 Oct 17 14:02:32.448932 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2545/5228] 10.222.0.79 () {62 vars in 1214 bytes} [Mon Oct 17 14:02:31 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 14:02:32.460469 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-fb16f9d8-572f-4c6d-a3e0-31767c69d1d5 tempest-ServerGroup264TestJSON-680273720 tempest-ServerGroup264TestJSON-680273720-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:32.471966 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-fb16f9d8-572f-4c6d-a3e0-31767c69d1d5 tempest-ServerGroup264TestJSON-680273720 tempest-ServerGroup264TestJSON-680273720-project] 10.222.0.79 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.015366 Oct 17 14:02:32.479020 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2546/5229] 10.222.0.79 () {60 vars in 1193 bytes} [Mon Oct 17 14:02:32 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:02:32.484634 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a6f30339-b1d6-4eca-bcec-630654f58faf tempest-ServerGroup264TestJSON-680273720 tempest-ServerGroup264TestJSON-680273720-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:32.494408 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a6f30339-b1d6-4eca-bcec-630654f58faf tempest-ServerGroup264TestJSON-680273720 tempest-ServerGroup264TestJSON-680273720-project] 10.222.0.79 "GET /compute/v2.1/os-server-groups/f6629754-bdbf-42cd-be57-5d550fa3bcb5" status: 200 len: 235 microversion: 2.64 time: 0.013978 Oct 17 14:02:32.501775 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2547/5230] 10.222.0.79 () {60 vars in 1304 bytes} [Mon Oct 17 14:02:32 2022] GET /compute/v2.1/os-server-groups/f6629754-bdbf-42cd-be57-5d550fa3bcb5 => generated 235 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:02:32.507881 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c7378d93-3666-4cb9-8bf4-ab225ce701ed tempest-ServerGroup264TestJSON-680273720 tempest-ServerGroup264TestJSON-680273720-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:32.549604 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c7378d93-3666-4cb9-8bf4-ab225ce701ed tempest-ServerGroup264TestJSON-680273720 tempest-ServerGroup264TestJSON-680273720-project] 10.222.0.79 "DELETE /compute/v2.1/os-server-groups/f6629754-bdbf-42cd-be57-5d550fa3bcb5" status: 204 len: 0 microversion: 2.64 time: 0.045719 Oct 17 14:02:32.555457 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2548/5231] 10.222.0.79 () {60 vars in 1307 bytes} [Mon Oct 17 14:02:32 2022] DELETE /compute/v2.1/os-server-groups/f6629754-bdbf-42cd-be57-5d550fa3bcb5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 14:02:32.561014 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-48798b6a-6a5a-49a5-a81f-e50793fd3769 tempest-ServerGroup264TestJSON-680273720 tempest-ServerGroup264TestJSON-680273720-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:32.569742 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-48798b6a-6a5a-49a5-a81f-e50793fd3769 tempest-ServerGroup264TestJSON-680273720 tempest-ServerGroup264TestJSON-680273720-project] HTTP exception thrown: Instance group f6629754-bdbf-42cd-be57-5d550fa3bcb5 could not be found. Oct 17 14:02:32.577448 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-48798b6a-6a5a-49a5-a81f-e50793fd3769 tempest-ServerGroup264TestJSON-680273720 tempest-ServerGroup264TestJSON-680273720-project] Request method failure captured: Oct 17 14:02:32.577448 n-d-854247-14 devstack@n-api.service[127017]: request: DELETE /compute/v2.1/os-server-groups/f6629754-bdbf-42cd-be57-5d550fa3bcb5 HTTP/1.1 Oct 17 14:02:32.577448 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 14:02:32.577448 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 14:02:32.577448 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 14:02:32.577448 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 14:02:32.577448 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 14:02:32.577448 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 14:02:32.577448 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 14:02:32.577448 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 14:02:32.577448 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTWB3opcFdNxhhQG2OMUBCcUpvyp4pzrTXM79rcJXfvKMTPpeMG9no6lfPdFFza6yTPwOUWKIcjZ6WlOTjFg-ozZOnXWL9yQM0eofb10o-H1ZIRCY9Q66ukoZxJXRuc5pPTzJMd0gqJY8ViqZ-QCgkgqq3SWYBkZyuaS4tnPSaPHEXSM Oct 17 14:02:32.577448 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 14:02:32.577448 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 14:02:32.577448 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 14:02:32.577448 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 14:02:32.577448 n-d-854247-14 devstack@n-api.service[127017]: X-Openstack-Nova-Api-Version: 2.64 Oct 17 14:02:32.577448 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 14:02:32.577448 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 14:02:32.577448 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 0b4b0e5518e645048f87269ed2d0e23a Oct 17 14:02:32.577448 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServerGroup264TestJSON-680273720 Oct 17 14:02:32.577448 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 14:02:32.577448 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 14:02:32.577448 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0b4b0e5518e645048f87269ed2d0e23a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0b4b0e5518e645048f87269ed2d0e23a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0b4b0e5518e645048f87269ed2d0e23a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0b4b0e5518e645048f87269ed2d0e23a", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:02:32.577448 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServerGroup264TestJSON-680273720 Oct 17 14:02:32.577448 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 0b4b0e5518e645048f87269ed2d0e23a Oct 17 14:02:32.577448 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServerGroup264TestJSON-680273720 Oct 17 14:02:32.577448 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServerGroup264TestJSON-680273720-project Oct 17 14:02:32.577448 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 14:02:32.577448 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 14:02:32.577448 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 5db8a937615149fcb49bd240ccc365f5 Oct 17 14:02:32.577448 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServerGroup264TestJSON-680273720-project Oct 17 14:02:32.577448 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 14:02:32.577448 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance group f6629754-bdbf-42cd-be57-5d550fa3bcb5 could not be found. Oct 17 14:02:32.577448 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'f6629754-bdbf-42cd-be57-5d550fa3bcb5'} Oct 17 14:02:32.577448 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:02:32.577448 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:02:32.577448 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 17 14:02:32.577448 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 17 14:02:32.577448 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 14:02:32.577448 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 14:02:32.577448 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 17 14:02:32.577448 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 17 14:02:32.577448 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 14:02:32.577448 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 14:02:32.577448 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 17 14:02:32.577448 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 17 14:02:32.577448 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group f6629754-bdbf-42cd-be57-5d550fa3bcb5 could not be found. Oct 17 14:02:32.577448 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:02:32.577448 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:02:32.577448 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:02:32.577448 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:02:32.577448 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:02:32.577448 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:02:32.577448 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:02:32.577448 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:02:32.577448 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:02:32.577448 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:02:32.577448 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 17 14:02:32.577448 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:02:32.577448 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group f6629754-bdbf-42cd-be57-5d550fa3bcb5 could not be found. Oct 17 14:02:32.577448 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:02:32.577448 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:02:32.577448 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:02:32.577448 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:02:32.584458 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:02:32.584458 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:02:32.584458 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:02:32.584458 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:02:32.584458 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group f6629754-bdbf-42cd-be57-5d550fa3bcb5 could not be found. Oct 17 14:02:32.584458 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:02:32.587351 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-48798b6a-6a5a-49a5-a81f-e50793fd3769 tempest-ServerGroup264TestJSON-680273720 tempest-ServerGroup264TestJSON-680273720-project] Returning 404 to user: Instance group f6629754-bdbf-42cd-be57-5d550fa3bcb5 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:02:32.588557 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-48798b6a-6a5a-49a5-a81f-e50793fd3769 tempest-ServerGroup264TestJSON-680273720 tempest-ServerGroup264TestJSON-680273720-project] 10.222.0.79 "DELETE /compute/v2.1/os-server-groups/f6629754-bdbf-42cd-be57-5d550fa3bcb5" status: 404 len: 117 microversion: 2.64 time: 0.031733 Oct 17 14:02:32.589382 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2549/5232] 10.222.0.79 () {60 vars in 1307 bytes} [Mon Oct 17 14:02:32 2022] DELETE /compute/v2.1/os-server-groups/f6629754-bdbf-42cd-be57-5d550fa3bcb5 => generated 117 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 14:02:33.071593 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-da60e44b-74d3-419d-b444-47bf9b3fc37e tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:33.081220 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-da60e44b-74d3-419d-b444-47bf9b3fc37e tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:33.088543 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-da60e44b-74d3-419d-b444-47bf9b3fc37e tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:33.093340 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-da60e44b-74d3-419d-b444-47bf9b3fc37e tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1739 microversion: 2.20 time: 2.139050 Oct 17 14:02:33.100178 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2684/5233] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:02:30 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1739 bytes in 2147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:02:34.139105 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-557b7ad9-1aa8-4845-9bc9-70438d5b1611 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:34.140468 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-557b7ad9-1aa8-4845-9bc9-70438d5b1611 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:34.155161 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-557b7ad9-1aa8-4845-9bc9-70438d5b1611 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:34.155949 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-557b7ad9-1aa8-4845-9bc9-70438d5b1611 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:34.156657 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-557b7ad9-1aa8-4845-9bc9-70438d5b1611 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:34.159062 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-557b7ad9-1aa8-4845-9bc9-70438d5b1611 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:34.166502 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-557b7ad9-1aa8-4845-9bc9-70438d5b1611 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:34.167546 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-557b7ad9-1aa8-4845-9bc9-70438d5b1611 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:34.872192 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-557b7ad9-1aa8-4845-9bc9-70438d5b1611 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:34.882262 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-557b7ad9-1aa8-4845-9bc9-70438d5b1611 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:34.888300 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-557b7ad9-1aa8-4845-9bc9-70438d5b1611 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:34.892232 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-557b7ad9-1aa8-4845-9bc9-70438d5b1611 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1739 microversion: 2.20 time: 0.756313 Oct 17 14:02:34.906873 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2550/5234] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:02:34 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1739 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 14:02:35.935188 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2bf8417b-58b1-411c-b041-7cf71b43bad9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:35.938888 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2bf8417b-58b1-411c-b041-7cf71b43bad9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:35.959332 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2bf8417b-58b1-411c-b041-7cf71b43bad9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:35.964385 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2bf8417b-58b1-411c-b041-7cf71b43bad9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:35.965099 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2bf8417b-58b1-411c-b041-7cf71b43bad9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:35.966017 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2bf8417b-58b1-411c-b041-7cf71b43bad9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:35.966617 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2bf8417b-58b1-411c-b041-7cf71b43bad9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:35.967274 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2bf8417b-58b1-411c-b041-7cf71b43bad9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:36.661357 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2bf8417b-58b1-411c-b041-7cf71b43bad9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:36.696623 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2bf8417b-58b1-411c-b041-7cf71b43bad9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:36.698757 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2bf8417b-58b1-411c-b041-7cf71b43bad9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:36.704343 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2bf8417b-58b1-411c-b041-7cf71b43bad9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1739 microversion: 2.20 time: 0.773234 Oct 17 14:02:36.708252 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2685/5235] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:02:35 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1739 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:02:37.734938 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a6ab20fd-d084-43ea-a3e5-e19a13c97089 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:37.735582 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a6ab20fd-d084-43ea-a3e5-e19a13c97089 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:37.750696 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a6ab20fd-d084-43ea-a3e5-e19a13c97089 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:37.751206 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a6ab20fd-d084-43ea-a3e5-e19a13c97089 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:37.751666 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a6ab20fd-d084-43ea-a3e5-e19a13c97089 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:37.767396 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a6ab20fd-d084-43ea-a3e5-e19a13c97089 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:37.769019 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a6ab20fd-d084-43ea-a3e5-e19a13c97089 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:37.769439 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a6ab20fd-d084-43ea-a3e5-e19a13c97089 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:38.427841 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a6ab20fd-d084-43ea-a3e5-e19a13c97089 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:38.449545 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a6ab20fd-d084-43ea-a3e5-e19a13c97089 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:38.450922 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a6ab20fd-d084-43ea-a3e5-e19a13c97089 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:38.454806 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a6ab20fd-d084-43ea-a3e5-e19a13c97089 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1739 microversion: 2.20 time: 0.723986 Oct 17 14:02:38.459764 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2551/5236] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:02:37 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1739 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:02:39.495645 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a00d0863-0d78-4ca2-84e8-ffab9a5bdbf6 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:39.496323 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a00d0863-0d78-4ca2-84e8-ffab9a5bdbf6 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:39.500723 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=18 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:02:39.524543 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a00d0863-0d78-4ca2-84e8-ffab9a5bdbf6 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:39.524543 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a00d0863-0d78-4ca2-84e8-ffab9a5bdbf6 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:39.524993 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a00d0863-0d78-4ca2-84e8-ffab9a5bdbf6 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:39.528772 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a00d0863-0d78-4ca2-84e8-ffab9a5bdbf6 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:39.530108 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a00d0863-0d78-4ca2-84e8-ffab9a5bdbf6 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:39.531583 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a00d0863-0d78-4ca2-84e8-ffab9a5bdbf6 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:39.624896 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=50 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:02:40.048342 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a00d0863-0d78-4ca2-84e8-ffab9a5bdbf6 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:40.065070 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a00d0863-0d78-4ca2-84e8-ffab9a5bdbf6 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:40.067057 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a00d0863-0d78-4ca2-84e8-ffab9a5bdbf6 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:40.068528 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a00d0863-0d78-4ca2-84e8-ffab9a5bdbf6 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1739 microversion: 2.20 time: 0.584182 Oct 17 14:02:40.072400 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2686/5237] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:02:39 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1739 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:02:41.102129 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f96f910d-8e87-4068-a53d-c9422127af59 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:41.103647 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f96f910d-8e87-4068-a53d-c9422127af59 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:41.116664 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f96f910d-8e87-4068-a53d-c9422127af59 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:41.122584 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f96f910d-8e87-4068-a53d-c9422127af59 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:41.123224 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f96f910d-8e87-4068-a53d-c9422127af59 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:41.124106 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f96f910d-8e87-4068-a53d-c9422127af59 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:41.135738 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f96f910d-8e87-4068-a53d-c9422127af59 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:41.136321 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f96f910d-8e87-4068-a53d-c9422127af59 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:41.141150 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=48 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:02:42.045441 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f96f910d-8e87-4068-a53d-c9422127af59 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:42.063866 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f96f910d-8e87-4068-a53d-c9422127af59 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:42.069712 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f96f910d-8e87-4068-a53d-c9422127af59 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:42.076167 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f96f910d-8e87-4068-a53d-c9422127af59 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1739 microversion: 2.20 time: 0.975179 Oct 17 14:02:42.078329 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2552/5238] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:02:41 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1739 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:02:43.113773 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-26cd96ab-b2e0-4d8b-8f68-7d0b16b5371d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:43.115351 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-26cd96ab-b2e0-4d8b-8f68-7d0b16b5371d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:43.131518 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-26cd96ab-b2e0-4d8b-8f68-7d0b16b5371d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:43.132592 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-26cd96ab-b2e0-4d8b-8f68-7d0b16b5371d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:43.133286 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-26cd96ab-b2e0-4d8b-8f68-7d0b16b5371d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:43.134278 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-26cd96ab-b2e0-4d8b-8f68-7d0b16b5371d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:43.134927 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-26cd96ab-b2e0-4d8b-8f68-7d0b16b5371d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:43.135913 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-26cd96ab-b2e0-4d8b-8f68-7d0b16b5371d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:43.659546 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-26cd96ab-b2e0-4d8b-8f68-7d0b16b5371d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:43.668097 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-26cd96ab-b2e0-4d8b-8f68-7d0b16b5371d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:43.669628 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-26cd96ab-b2e0-4d8b-8f68-7d0b16b5371d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:43.681783 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-26cd96ab-b2e0-4d8b-8f68-7d0b16b5371d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1721 microversion: 2.20 time: 0.573323 Oct 17 14:02:43.684715 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2687/5239] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:02:43 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1721 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:02:44.714262 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-132c9a3f-61d2-4834-90b0-4aa5cd9d2176 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:44.715116 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-132c9a3f-61d2-4834-90b0-4aa5cd9d2176 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:44.719729 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=8 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:02:44.730009 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-132c9a3f-61d2-4834-90b0-4aa5cd9d2176 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:44.731216 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-132c9a3f-61d2-4834-90b0-4aa5cd9d2176 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:44.731767 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-132c9a3f-61d2-4834-90b0-4aa5cd9d2176 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:44.732761 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-132c9a3f-61d2-4834-90b0-4aa5cd9d2176 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:44.733807 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-132c9a3f-61d2-4834-90b0-4aa5cd9d2176 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:44.734480 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-132c9a3f-61d2-4834-90b0-4aa5cd9d2176 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:45.441088 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-132c9a3f-61d2-4834-90b0-4aa5cd9d2176 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:45.449523 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-132c9a3f-61d2-4834-90b0-4aa5cd9d2176 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:45.462542 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-132c9a3f-61d2-4834-90b0-4aa5cd9d2176 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:45.473805 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-132c9a3f-61d2-4834-90b0-4aa5cd9d2176 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1721 microversion: 2.20 time: 0.764080 Oct 17 14:02:45.474775 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2553/5240] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:02:44 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1721 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:02:46.427843 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-988fd392-f9b6-40b2-b5d5-a481283e35e1 req-d79dad01-b9e9-42e9-994d-d0f042ad045d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86508a39-65fa-4421-b31d-ffbc5fdee565", "name": "network-vif-unplugged", "status": "completed", "tag": "be2d42c9-97a7-4933-9200-d27f76f73a39"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:02:46.449897 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-988fd392-f9b6-40b2-b5d5-a481283e35e1 req-d79dad01-b9e9-42e9-994d-d0f042ad045d service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:46.454201 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-988fd392-f9b6-40b2-b5d5-a481283e35e1 req-d79dad01-b9e9-42e9-994d-d0f042ad045d service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:46.454790 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-988fd392-f9b6-40b2-b5d5-a481283e35e1 req-d79dad01-b9e9-42e9-994d-d0f042ad045d service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:46.496349 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-988fd392-f9b6-40b2-b5d5-a481283e35e1 req-d79dad01-b9e9-42e9-994d-d0f042ad045d service nova] Creating event network-vif-unplugged:be2d42c9-97a7-4933-9200-d27f76f73a39 for instance 86508a39-65fa-4421-b31d-ffbc5fdee565 on n-h1-854247-14 Oct 17 14:02:46.507509 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-988fd392-f9b6-40b2-b5d5-a481283e35e1 req-d79dad01-b9e9-42e9-994d-d0f042ad045d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085387 Oct 17 14:02:46.508467 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2ec4cfde-2a5a-4727-bfa2-23c326e3e318 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:46.509383 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2688/5241] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:02:46.510112 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2ec4cfde-2a5a-4727-bfa2-23c326e3e318 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:46.521510 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2ec4cfde-2a5a-4727-bfa2-23c326e3e318 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:46.522001 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2ec4cfde-2a5a-4727-bfa2-23c326e3e318 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:46.522443 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2ec4cfde-2a5a-4727-bfa2-23c326e3e318 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:46.523155 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2ec4cfde-2a5a-4727-bfa2-23c326e3e318 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:46.523636 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2ec4cfde-2a5a-4727-bfa2-23c326e3e318 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:46.524059 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2ec4cfde-2a5a-4727-bfa2-23c326e3e318 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:47.142153 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2ec4cfde-2a5a-4727-bfa2-23c326e3e318 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:47.160669 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2ec4cfde-2a5a-4727-bfa2-23c326e3e318 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:47.164153 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2ec4cfde-2a5a-4727-bfa2-23c326e3e318 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:47.169469 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2ec4cfde-2a5a-4727-bfa2-23c326e3e318 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1724 microversion: 2.20 time: 0.664272 Oct 17 14:02:47.172550 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2554/5242] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:02:46 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1724 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 14:02:47.205143 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-350b4c04-c514-42f8-a4d6-259962dcc89b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c6b8e23f-99ea-4dd0-883d-a74eeaf6b89b"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:02:47.208040 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-350b4c04-c514-42f8-a4d6-259962dcc89b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:47.228845 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-350b4c04-c514-42f8-a4d6-259962dcc89b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:47.229802 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-350b4c04-c514-42f8-a4d6-259962dcc89b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:47.230292 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-350b4c04-c514-42f8-a4d6-259962dcc89b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:47.231023 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-350b4c04-c514-42f8-a4d6-259962dcc89b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:47.235705 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-350b4c04-c514-42f8-a4d6-259962dcc89b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:47.236179 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-350b4c04-c514-42f8-a4d6-259962dcc89b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:47.945902 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-350b4c04-c514-42f8-a4d6-259962dcc89b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "POST /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.744084 Oct 17 14:02:47.949086 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2689/5243] 10.222.0.79 () {62 vars in 1364 bytes} [Mon Oct 17 14:02:47 2022] POST /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565/os-volume_attachments => generated 188 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:02:48.157131 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c307f861-bd79-46ab-a54c-98293d4366de tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:02:48.158358 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c307f861-bd79-46ab-a54c-98293d4366de tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:48.168336 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c307f861-bd79-46ab-a54c-98293d4366de tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:48.169245 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c307f861-bd79-46ab-a54c-98293d4366de tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:48.169904 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c307f861-bd79-46ab-a54c-98293d4366de tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:48.170816 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c307f861-bd79-46ab-a54c-98293d4366de tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:48.171820 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c307f861-bd79-46ab-a54c-98293d4366de tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:48.172444 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c307f861-bd79-46ab-a54c-98293d4366de tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:48.299884 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c307f861-bd79-46ab-a54c-98293d4366de tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127017) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 17 14:02:48.457105 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c307f861-bd79-46ab-a54c-98293d4366de tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "POST /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565/action" status: 202 len: 0 microversion: 2.20 time: 0.306821 Oct 17 14:02:48.461348 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2555/5244] 10.222.0.79 () {62 vars in 1319 bytes} [Mon Oct 17 14:02:48 2022] POST /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:02:48.467608 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-da048956-32cd-4566-a783-b0567c12720c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:48.468319 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-da048956-32cd-4566-a783-b0567c12720c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:48.504768 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-da048956-32cd-4566-a783-b0567c12720c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:48.505360 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-da048956-32cd-4566-a783-b0567c12720c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:48.505808 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-da048956-32cd-4566-a783-b0567c12720c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:48.506563 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-da048956-32cd-4566-a783-b0567c12720c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:48.507014 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-da048956-32cd-4566-a783-b0567c12720c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:48.507454 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-da048956-32cd-4566-a783-b0567c12720c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:49.490267 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-da048956-32cd-4566-a783-b0567c12720c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:49.542175 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-da048956-32cd-4566-a783-b0567c12720c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:49.549670 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-da048956-32cd-4566-a783-b0567c12720c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:49.556563 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-da048956-32cd-4566-a783-b0567c12720c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1750 microversion: 2.20 time: 1.093616 Oct 17 14:02:49.558290 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2690/5245] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:02:48 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1750 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:02:50.587193 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9b7b1ee5-4e94-4e72-8d77-9d8d388a6781 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:50.588520 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9b7b1ee5-4e94-4e72-8d77-9d8d388a6781 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:50.602149 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9b7b1ee5-4e94-4e72-8d77-9d8d388a6781 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:50.602964 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9b7b1ee5-4e94-4e72-8d77-9d8d388a6781 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:50.603604 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9b7b1ee5-4e94-4e72-8d77-9d8d388a6781 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:50.605597 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9b7b1ee5-4e94-4e72-8d77-9d8d388a6781 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:50.606264 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9b7b1ee5-4e94-4e72-8d77-9d8d388a6781 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:50.607462 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9b7b1ee5-4e94-4e72-8d77-9d8d388a6781 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:51.278520 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9b7b1ee5-4e94-4e72-8d77-9d8d388a6781 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:51.295649 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9b7b1ee5-4e94-4e72-8d77-9d8d388a6781 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:51.297356 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9b7b1ee5-4e94-4e72-8d77-9d8d388a6781 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:51.300034 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9b7b1ee5-4e94-4e72-8d77-9d8d388a6781 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1750 microversion: 2.20 time: 0.717943 Oct 17 14:02:51.301073 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2556/5246] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:02:50 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1750 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:02:52.328529 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e9b96131-0868-4d2b-a643-6c4f6c81cdc8 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:52.329650 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e9b96131-0868-4d2b-a643-6c4f6c81cdc8 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:52.343693 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9b96131-0868-4d2b-a643-6c4f6c81cdc8 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:52.344168 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9b96131-0868-4d2b-a643-6c4f6c81cdc8 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:52.348015 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9b96131-0868-4d2b-a643-6c4f6c81cdc8 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:52.348015 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9b96131-0868-4d2b-a643-6c4f6c81cdc8 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:52.348452 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9b96131-0868-4d2b-a643-6c4f6c81cdc8 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:52.348875 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9b96131-0868-4d2b-a643-6c4f6c81cdc8 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:53.574611 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e9b96131-0868-4d2b-a643-6c4f6c81cdc8 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:53.592658 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e9b96131-0868-4d2b-a643-6c4f6c81cdc8 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:53.599978 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e9b96131-0868-4d2b-a643-6c4f6c81cdc8 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:53.607817 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e9b96131-0868-4d2b-a643-6c4f6c81cdc8 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1752 microversion: 2.20 time: 1.279149 Oct 17 14:02:53.610428 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2691/5247] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:02:52 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1752 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:02:54.643963 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-48cd35d1-9edd-49e0-b0cc-0039741a69ac tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:54.644484 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-48cd35d1-9edd-49e0-b0cc-0039741a69ac tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:54.647379 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=2,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:02:54.662055 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48cd35d1-9edd-49e0-b0cc-0039741a69ac tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:54.662548 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48cd35d1-9edd-49e0-b0cc-0039741a69ac tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:54.663227 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48cd35d1-9edd-49e0-b0cc-0039741a69ac tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:54.664162 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48cd35d1-9edd-49e0-b0cc-0039741a69ac tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:54.664795 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48cd35d1-9edd-49e0-b0cc-0039741a69ac tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:54.665367 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48cd35d1-9edd-49e0-b0cc-0039741a69ac tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:55.087887 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-48cd35d1-9edd-49e0-b0cc-0039741a69ac tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:55.100553 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-48cd35d1-9edd-49e0-b0cc-0039741a69ac tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:55.103299 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-48cd35d1-9edd-49e0-b0cc-0039741a69ac tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:55.104553 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-48cd35d1-9edd-49e0-b0cc-0039741a69ac tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1752 microversion: 2.20 time: 0.464799 Oct 17 14:02:55.108384 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2557/5248] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:02:54 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1752 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:02:56.132493 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f53e4411-098f-4d4a-981a-1994a51b8ff9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:56.132493 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f53e4411-098f-4d4a-981a-1994a51b8ff9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:56.139544 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f53e4411-098f-4d4a-981a-1994a51b8ff9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:56.140655 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f53e4411-098f-4d4a-981a-1994a51b8ff9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:56.141683 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f53e4411-098f-4d4a-981a-1994a51b8ff9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:56.142626 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f53e4411-098f-4d4a-981a-1994a51b8ff9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:56.143476 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f53e4411-098f-4d4a-981a-1994a51b8ff9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:56.144052 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f53e4411-098f-4d4a-981a-1994a51b8ff9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:56.614015 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f53e4411-098f-4d4a-981a-1994a51b8ff9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:56.630573 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f53e4411-098f-4d4a-981a-1994a51b8ff9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:56.634345 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f53e4411-098f-4d4a-981a-1994a51b8ff9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:56.637281 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f53e4411-098f-4d4a-981a-1994a51b8ff9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1752 microversion: 2.20 time: 0.509489 Oct 17 14:02:56.642860 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2692/5249] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:02:56 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1752 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:02:57.666425 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0d6bef44-2d83-4c53-84f8-59c5faf507b4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:57.667238 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0d6bef44-2d83-4c53-84f8-59c5faf507b4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:57.680721 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0d6bef44-2d83-4c53-84f8-59c5faf507b4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:57.681217 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0d6bef44-2d83-4c53-84f8-59c5faf507b4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:57.681655 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0d6bef44-2d83-4c53-84f8-59c5faf507b4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:57.682452 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0d6bef44-2d83-4c53-84f8-59c5faf507b4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:57.682909 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0d6bef44-2d83-4c53-84f8-59c5faf507b4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:57.687003 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0d6bef44-2d83-4c53-84f8-59c5faf507b4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:58.259241 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0d6bef44-2d83-4c53-84f8-59c5faf507b4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:58.276518 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0d6bef44-2d83-4c53-84f8-59c5faf507b4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:58.280810 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0d6bef44-2d83-4c53-84f8-59c5faf507b4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:58.283425 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0d6bef44-2d83-4c53-84f8-59c5faf507b4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1752 microversion: 2.20 time: 0.621273 Oct 17 14:02:58.288786 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2558/5250] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:02:57 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1752 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:02:59.314436 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-86904104-8bc3-43c4-baa3-439a953bcb71 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:59.315731 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-86904104-8bc3-43c4-baa3-439a953bcb71 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:59.333662 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-86904104-8bc3-43c4-baa3-439a953bcb71 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:59.334426 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-86904104-8bc3-43c4-baa3-439a953bcb71 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:59.341266 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-86904104-8bc3-43c4-baa3-439a953bcb71 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:59.342673 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-86904104-8bc3-43c4-baa3-439a953bcb71 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:59.343430 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-86904104-8bc3-43c4-baa3-439a953bcb71 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:59.344212 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-86904104-8bc3-43c4-baa3-439a953bcb71 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:59.993199 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-86904104-8bc3-43c4-baa3-439a953bcb71 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:00.018495 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-86904104-8bc3-43c4-baa3-439a953bcb71 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:00.023972 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-86904104-8bc3-43c4-baa3-439a953bcb71 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:00.026152 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-86904104-8bc3-43c4-baa3-439a953bcb71 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1752 microversion: 2.20 time: 0.715708 Oct 17 14:03:00.027060 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2693/5251] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:02:59 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1752 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:03:01.054026 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e4a424d3-c795-4626-b637-b38296ede153 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:01.054634 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e4a424d3-c795-4626-b637-b38296ede153 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:01.068480 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e4a424d3-c795-4626-b637-b38296ede153 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:01.069381 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e4a424d3-c795-4626-b637-b38296ede153 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:01.072049 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e4a424d3-c795-4626-b637-b38296ede153 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:01.074260 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e4a424d3-c795-4626-b637-b38296ede153 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:01.076348 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e4a424d3-c795-4626-b637-b38296ede153 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:01.078038 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e4a424d3-c795-4626-b637-b38296ede153 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:02.653301 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e4a424d3-c795-4626-b637-b38296ede153 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:02.669448 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e4a424d3-c795-4626-b637-b38296ede153 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:02.680447 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e4a424d3-c795-4626-b637-b38296ede153 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:02.681778 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e4a424d3-c795-4626-b637-b38296ede153 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1752 microversion: 2.20 time: 1.632636 Oct 17 14:03:02.686961 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2559/5252] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:03:01 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1752 bytes in 1638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:03:03.712530 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-08faa1ff-7171-4606-8b4e-3cfefaf4b4f9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:03.713697 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-08faa1ff-7171-4606-8b4e-3cfefaf4b4f9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:03.732236 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-08faa1ff-7171-4606-8b4e-3cfefaf4b4f9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:03.732998 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-08faa1ff-7171-4606-8b4e-3cfefaf4b4f9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:03.733516 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-08faa1ff-7171-4606-8b4e-3cfefaf4b4f9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:03.734272 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-08faa1ff-7171-4606-8b4e-3cfefaf4b4f9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:03.734717 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-08faa1ff-7171-4606-8b4e-3cfefaf4b4f9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:03.735133 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-08faa1ff-7171-4606-8b4e-3cfefaf4b4f9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:04.027408 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-08faa1ff-7171-4606-8b4e-3cfefaf4b4f9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:04.063276 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-08faa1ff-7171-4606-8b4e-3cfefaf4b4f9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:04.077857 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-08faa1ff-7171-4606-8b4e-3cfefaf4b4f9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:04.094225 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-08faa1ff-7171-4606-8b4e-3cfefaf4b4f9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1808 microversion: 2.20 time: 0.373859 Oct 17 14:03:04.095631 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2694/5253] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:03:03 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1808 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 14:03:05.126343 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b791203c-1d73-4195-930f-eb4227cf983b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:05.128206 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b791203c-1d73-4195-930f-eb4227cf983b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:05.140965 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b791203c-1d73-4195-930f-eb4227cf983b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:05.143554 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b791203c-1d73-4195-930f-eb4227cf983b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:05.144645 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b791203c-1d73-4195-930f-eb4227cf983b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:05.146375 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b791203c-1d73-4195-930f-eb4227cf983b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:05.151341 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b791203c-1d73-4195-930f-eb4227cf983b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:05.152106 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b791203c-1d73-4195-930f-eb4227cf983b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:05.659446 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3cffda66-8cbb-4faf-a20c-432cd3487103 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1321258676", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:03:05.729052 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-3cffda66-8cbb-4faf-a20c-432cd3487103 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] validate_networks() for [('8db88382-ec3d-4ebe-95fb-75ecb94d2fce', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:03:05.971034 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b791203c-1d73-4195-930f-eb4227cf983b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:05.985381 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b791203c-1d73-4195-930f-eb4227cf983b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:05.989174 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b791203c-1d73-4195-930f-eb4227cf983b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:05.991552 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b791203c-1d73-4195-930f-eb4227cf983b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1808 microversion: 2.20 time: 0.870877 Oct 17 14:03:05.993852 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2695/5254] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:03:05 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1808 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 14:03:07.020230 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-602f9d1e-83d5-4e7f-bffc-fc687da22417 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:07.021637 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-602f9d1e-83d5-4e7f-bffc-fc687da22417 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:07.042160 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-602f9d1e-83d5-4e7f-bffc-fc687da22417 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:07.042956 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-602f9d1e-83d5-4e7f-bffc-fc687da22417 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:07.044927 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-602f9d1e-83d5-4e7f-bffc-fc687da22417 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:07.046351 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-602f9d1e-83d5-4e7f-bffc-fc687da22417 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:07.050118 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-602f9d1e-83d5-4e7f-bffc-fc687da22417 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:07.050815 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-602f9d1e-83d5-4e7f-bffc-fc687da22417 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:07.846906 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-3cffda66-8cbb-4faf-a20c-432cd3487103 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:03:07.847516 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-3cffda66-8cbb-4faf-a20c-432cd3487103 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:03:07.847875 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-3cffda66-8cbb-4faf-a20c-432cd3487103 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:03:07.848294 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-3cffda66-8cbb-4faf-a20c-432cd3487103 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:03:07.848711 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-3cffda66-8cbb-4faf-a20c-432cd3487103 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:03:07.870343 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3cffda66-8cbb-4faf-a20c-432cd3487103 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:07.870860 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3cffda66-8cbb-4faf-a20c-432cd3487103 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:07.888293 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3cffda66-8cbb-4faf-a20c-432cd3487103 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:07.889239 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3cffda66-8cbb-4faf-a20c-432cd3487103 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:07.889805 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3cffda66-8cbb-4faf-a20c-432cd3487103 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:07.890488 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3cffda66-8cbb-4faf-a20c-432cd3487103 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:08.020456 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-3cffda66-8cbb-4faf-a20c-432cd3487103 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Getting quotas for project 0e4c1113905449dfaa64b18199faa2ad. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:03:08.048949 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-3cffda66-8cbb-4faf-a20c-432cd3487103 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Getting quotas for user ae278c3db5eb41dca0336a8edf10fab8 and project 0e4c1113905449dfaa64b18199faa2ad. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:03:08.121760 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3cffda66-8cbb-4faf-a20c-432cd3487103 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:03:08.125662 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3cffda66-8cbb-4faf-a20c-432cd3487103 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] [instance: 5c1e7d15-aff1-4439-be8c-af4e87a53fdd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:03:08.302677 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3cffda66-8cbb-4faf-a20c-432cd3487103 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.192149 Oct 17 14:03:08.305510 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2560/5255] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 14:03:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 3216 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:03:08.318294 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-86199d28-7ece-41e3-a3b1-06caf35d6dd8 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:08.320739 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-86199d28-7ece-41e3-a3b1-06caf35d6dd8 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] [instance: 5c1e7d15-aff1-4439-be8c-af4e87a53fdd] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:08.661788 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-86199d28-7ece-41e3-a3b1-06caf35d6dd8 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae278c3db5eb41dca0336a8edf10fab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4c1113905449dfaa64b18199faa2ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:08.685205 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-86199d28-7ece-41e3-a3b1-06caf35d6dd8 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] 10.222.0.79 "GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd" status: 200 len: 1223 microversion: 2.1 time: 0.370699 Oct 17 14:03:08.685799 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2561/5256] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:08 2022] GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd => generated 1223 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:08.745864 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-602f9d1e-83d5-4e7f-bffc-fc687da22417 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:08.768470 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-602f9d1e-83d5-4e7f-bffc-fc687da22417 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:08.770623 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-602f9d1e-83d5-4e7f-bffc-fc687da22417 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:08.787023 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-602f9d1e-83d5-4e7f-bffc-fc687da22417 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1808 microversion: 2.20 time: 1.770859 Oct 17 14:03:08.794081 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2696/5257] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:03:07 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1808 bytes in 1779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 14:03:09.717048 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ef28a018-7b2d-4004-b22e-83a48e971bbc tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:09.718756 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ef28a018-7b2d-4004-b22e-83a48e971bbc tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] [instance: 5c1e7d15-aff1-4439-be8c-af4e87a53fdd] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:09.830667 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4f0b67e2-bc0f-4db5-bc16-71b0e75c750b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:09.838535 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4f0b67e2-bc0f-4db5-bc16-71b0e75c750b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:09.856868 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=22 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:03:09.859250 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4f0b67e2-bc0f-4db5-bc16-71b0e75c750b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:09.861314 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4f0b67e2-bc0f-4db5-bc16-71b0e75c750b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:09.864904 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4f0b67e2-bc0f-4db5-bc16-71b0e75c750b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:09.866944 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4f0b67e2-bc0f-4db5-bc16-71b0e75c750b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:09.868794 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4f0b67e2-bc0f-4db5-bc16-71b0e75c750b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:09.869667 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4f0b67e2-bc0f-4db5-bc16-71b0e75c750b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:09.876761 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=71,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:03:11.299060 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ef28a018-7b2d-4004-b22e-83a48e971bbc tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae278c3db5eb41dca0336a8edf10fab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4c1113905449dfaa64b18199faa2ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:11.318769 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ef28a018-7b2d-4004-b22e-83a48e971bbc tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] 10.222.0.79 "GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd" status: 200 len: 1223 microversion: 2.1 time: 1.609843 Oct 17 14:03:11.333288 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2562/5258] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:09 2022] GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd => generated 1223 bytes in 1625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:12.102913 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4f0b67e2-bc0f-4db5-bc16-71b0e75c750b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:12.117381 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4f0b67e2-bc0f-4db5-bc16-71b0e75c750b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:12.121401 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4f0b67e2-bc0f-4db5-bc16-71b0e75c750b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:12.131034 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4f0b67e2-bc0f-4db5-bc16-71b0e75c750b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1808 microversion: 2.20 time: 2.307775 Oct 17 14:03:12.132246 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2697/5259] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:03:09 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1808 bytes in 2310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:03:12.347071 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7925b613-179b-4fd2-a62f-8d30398fd2de tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:12.348503 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7925b613-179b-4fd2-a62f-8d30398fd2de tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] [instance: 5c1e7d15-aff1-4439-be8c-af4e87a53fdd] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:12.358386 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7925b613-179b-4fd2-a62f-8d30398fd2de tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:12.359632 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7925b613-179b-4fd2-a62f-8d30398fd2de tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:12.360357 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7925b613-179b-4fd2-a62f-8d30398fd2de tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:12.361792 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7925b613-179b-4fd2-a62f-8d30398fd2de tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:12.363688 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7925b613-179b-4fd2-a62f-8d30398fd2de tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:12.364404 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7925b613-179b-4fd2-a62f-8d30398fd2de tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:12.378787 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:03:12.591821 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7925b613-179b-4fd2-a62f-8d30398fd2de tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae278c3db5eb41dca0336a8edf10fab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4c1113905449dfaa64b18199faa2ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:12.607936 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7925b613-179b-4fd2-a62f-8d30398fd2de tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] 10.222.0.79 "GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd" status: 200 len: 1281 microversion: 2.1 time: 0.265577 Oct 17 14:03:12.609900 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2563/5260] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:12 2022] GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd => generated 1281 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:03:13.164441 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8e0d9c19-c1c3-4cf1-9abf-6bc4586a96ab tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:13.165406 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8e0d9c19-c1c3-4cf1-9abf-6bc4586a96ab tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:13.210035 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8e0d9c19-c1c3-4cf1-9abf-6bc4586a96ab tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:13.221222 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8e0d9c19-c1c3-4cf1-9abf-6bc4586a96ab tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:13.222708 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8e0d9c19-c1c3-4cf1-9abf-6bc4586a96ab tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:13.224000 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8e0d9c19-c1c3-4cf1-9abf-6bc4586a96ab tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:13.224856 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8e0d9c19-c1c3-4cf1-9abf-6bc4586a96ab tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:13.227084 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8e0d9c19-c1c3-4cf1-9abf-6bc4586a96ab tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:13.637546 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-313d5640-33a6-49c3-8130-7d3d06ee9540 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:13.640079 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-313d5640-33a6-49c3-8130-7d3d06ee9540 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] [instance: 5c1e7d15-aff1-4439-be8c-af4e87a53fdd] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:13.681225 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-313d5640-33a6-49c3-8130-7d3d06ee9540 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:13.693096 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-313d5640-33a6-49c3-8130-7d3d06ee9540 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:13.694148 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-313d5640-33a6-49c3-8130-7d3d06ee9540 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:13.697517 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-313d5640-33a6-49c3-8130-7d3d06ee9540 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:13.698351 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-313d5640-33a6-49c3-8130-7d3d06ee9540 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:13.698887 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-313d5640-33a6-49c3-8130-7d3d06ee9540 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:15.084018 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8e0d9c19-c1c3-4cf1-9abf-6bc4586a96ab tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:15.121369 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8e0d9c19-c1c3-4cf1-9abf-6bc4586a96ab tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:15.130945 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8e0d9c19-c1c3-4cf1-9abf-6bc4586a96ab tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:15.137408 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8e0d9c19-c1c3-4cf1-9abf-6bc4586a96ab tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1808 microversion: 2.20 time: 1.975539 Oct 17 14:03:15.142093 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2698/5261] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:03:13 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1808 bytes in 1984 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:03:15.264895 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-313d5640-33a6-49c3-8130-7d3d06ee9540 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae278c3db5eb41dca0336a8edf10fab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4c1113905449dfaa64b18199faa2ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:15.311746 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-313d5640-33a6-49c3-8130-7d3d06ee9540 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] 10.222.0.79 "GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd" status: 200 len: 1323 microversion: 2.1 time: 1.646688 Oct 17 14:03:15.315566 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2564/5262] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:13 2022] GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd => generated 1323 bytes in 1684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:16.173028 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3d2c1f48-c6b0-4fc3-a490-5a2f2fe97b91 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:16.173727 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3d2c1f48-c6b0-4fc3-a490-5a2f2fe97b91 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:16.204601 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3d2c1f48-c6b0-4fc3-a490-5a2f2fe97b91 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:16.206861 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3d2c1f48-c6b0-4fc3-a490-5a2f2fe97b91 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:16.208997 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3d2c1f48-c6b0-4fc3-a490-5a2f2fe97b91 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:16.232177 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3d2c1f48-c6b0-4fc3-a490-5a2f2fe97b91 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:16.233063 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3d2c1f48-c6b0-4fc3-a490-5a2f2fe97b91 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:16.233559 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3d2c1f48-c6b0-4fc3-a490-5a2f2fe97b91 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:16.343485 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d816ef13-1963-4f4b-bbf3-4e1329fc80e8 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:16.345659 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d816ef13-1963-4f4b-bbf3-4e1329fc80e8 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] [instance: 5c1e7d15-aff1-4439-be8c-af4e87a53fdd] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:16.378490 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d816ef13-1963-4f4b-bbf3-4e1329fc80e8 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:16.385179 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d816ef13-1963-4f4b-bbf3-4e1329fc80e8 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:16.391420 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d816ef13-1963-4f4b-bbf3-4e1329fc80e8 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:16.399354 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d816ef13-1963-4f4b-bbf3-4e1329fc80e8 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:16.401836 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d816ef13-1963-4f4b-bbf3-4e1329fc80e8 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:16.405314 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d816ef13-1963-4f4b-bbf3-4e1329fc80e8 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:17.993693 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:03:18.383829 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d816ef13-1963-4f4b-bbf3-4e1329fc80e8 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae278c3db5eb41dca0336a8edf10fab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4c1113905449dfaa64b18199faa2ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:18.400543 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d816ef13-1963-4f4b-bbf3-4e1329fc80e8 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] 10.222.0.79 "GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd" status: 200 len: 1323 microversion: 2.1 time: 2.062548 Oct 17 14:03:18.401168 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2565/5263] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:16 2022] GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd => generated 1323 bytes in 2064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:03:18.405671 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3d2c1f48-c6b0-4fc3-a490-5a2f2fe97b91 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:18.425199 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3d2c1f48-c6b0-4fc3-a490-5a2f2fe97b91 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:18.429320 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3d2c1f48-c6b0-4fc3-a490-5a2f2fe97b91 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:18.430942 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3d2c1f48-c6b0-4fc3-a490-5a2f2fe97b91 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1808 microversion: 2.20 time: 2.264806 Oct 17 14:03:18.434477 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2699/5264] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:03:16 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1808 bytes in 2269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:03:19.432517 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b6802010-588a-4113-a58b-7f9acacac0d4 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:19.433149 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b6802010-588a-4113-a58b-7f9acacac0d4 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] [instance: 5c1e7d15-aff1-4439-be8c-af4e87a53fdd] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:19.461989 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9935980f-2e3f-46e0-9505-a2c6f21c45a5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:19.462527 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9935980f-2e3f-46e0-9505-a2c6f21c45a5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:19.472798 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b6802010-588a-4113-a58b-7f9acacac0d4 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:19.473297 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b6802010-588a-4113-a58b-7f9acacac0d4 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:19.473736 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b6802010-588a-4113-a58b-7f9acacac0d4 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:19.474447 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b6802010-588a-4113-a58b-7f9acacac0d4 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:19.474903 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b6802010-588a-4113-a58b-7f9acacac0d4 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:19.475354 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b6802010-588a-4113-a58b-7f9acacac0d4 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:19.480254 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9935980f-2e3f-46e0-9505-a2c6f21c45a5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:19.482550 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9935980f-2e3f-46e0-9505-a2c6f21c45a5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:19.483330 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9935980f-2e3f-46e0-9505-a2c6f21c45a5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:19.484619 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9935980f-2e3f-46e0-9505-a2c6f21c45a5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:19.485310 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9935980f-2e3f-46e0-9505-a2c6f21c45a5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:19.486456 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9935980f-2e3f-46e0-9505-a2c6f21c45a5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:20.898457 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b6802010-588a-4113-a58b-7f9acacac0d4 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae278c3db5eb41dca0336a8edf10fab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4c1113905449dfaa64b18199faa2ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:20.912849 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b6802010-588a-4113-a58b-7f9acacac0d4 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] 10.222.0.79 "GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd" status: 200 len: 1323 microversion: 2.1 time: 1.488786 Oct 17 14:03:20.915041 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2566/5265] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:19 2022] GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd => generated 1323 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:03:20.933543 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-094b6bb9-4065-4cde-8a30-690bc5766fe8 req-8f9fcf0a-38a6-4804-b1d9-5bf3e2cf3d32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c1e7d15-aff1-4439-be8c-af4e87a53fdd", "tag": "005c8f89-113c-42e8-b0c0-99f7c47dc5d9"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:03:20.957778 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-094b6bb9-4065-4cde-8a30-690bc5766fe8 req-8f9fcf0a-38a6-4804-b1d9-5bf3e2cf3d32 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:20.961402 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-094b6bb9-4065-4cde-8a30-690bc5766fe8 req-8f9fcf0a-38a6-4804-b1d9-5bf3e2cf3d32 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:20.963026 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-094b6bb9-4065-4cde-8a30-690bc5766fe8 req-8f9fcf0a-38a6-4804-b1d9-5bf3e2cf3d32 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:20.996222 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-094b6bb9-4065-4cde-8a30-690bc5766fe8 req-8f9fcf0a-38a6-4804-b1d9-5bf3e2cf3d32 service nova] Creating event network-changed:005c8f89-113c-42e8-b0c0-99f7c47dc5d9 for instance 5c1e7d15-aff1-4439-be8c-af4e87a53fdd on n-h2-854247-14 Oct 17 14:03:21.020263 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-094b6bb9-4065-4cde-8a30-690bc5766fe8 req-8f9fcf0a-38a6-4804-b1d9-5bf3e2cf3d32 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100595 Oct 17 14:03:21.021077 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2567/5266] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:03:21.435051 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9935980f-2e3f-46e0-9505-a2c6f21c45a5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:21.468747 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9935980f-2e3f-46e0-9505-a2c6f21c45a5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:21.474983 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9935980f-2e3f-46e0-9505-a2c6f21c45a5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:21.479395 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9935980f-2e3f-46e0-9505-a2c6f21c45a5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1808 microversion: 2.20 time: 2.020350 Oct 17 14:03:21.480076 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2700/5267] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:03:19 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1808 bytes in 2025 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 14:03:21.944082 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-71fc550a-bf9b-4ed1-903d-4ffe9b16107f tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:21.945413 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-71fc550a-bf9b-4ed1-903d-4ffe9b16107f tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] [instance: 5c1e7d15-aff1-4439-be8c-af4e87a53fdd] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:21.954622 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=10 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:03:21.964628 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-71fc550a-bf9b-4ed1-903d-4ffe9b16107f tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:21.965129 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-71fc550a-bf9b-4ed1-903d-4ffe9b16107f tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:21.965578 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-71fc550a-bf9b-4ed1-903d-4ffe9b16107f tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:21.973725 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-71fc550a-bf9b-4ed1-903d-4ffe9b16107f tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:21.974231 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-71fc550a-bf9b-4ed1-903d-4ffe9b16107f tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:21.974688 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-71fc550a-bf9b-4ed1-903d-4ffe9b16107f tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:22.509530 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cb845797-dbf1-4a27-99bc-c976afe1f1b3 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:22.510157 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cb845797-dbf1-4a27-99bc-c976afe1f1b3 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:22.523823 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb845797-dbf1-4a27-99bc-c976afe1f1b3 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:22.524334 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb845797-dbf1-4a27-99bc-c976afe1f1b3 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:22.524773 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb845797-dbf1-4a27-99bc-c976afe1f1b3 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:22.525501 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb845797-dbf1-4a27-99bc-c976afe1f1b3 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:22.525965 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb845797-dbf1-4a27-99bc-c976afe1f1b3 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:22.526386 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb845797-dbf1-4a27-99bc-c976afe1f1b3 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:22.758388 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-71fc550a-bf9b-4ed1-903d-4ffe9b16107f tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae278c3db5eb41dca0336a8edf10fab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4c1113905449dfaa64b18199faa2ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:22.767025 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-71fc550a-bf9b-4ed1-903d-4ffe9b16107f tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] 10.222.0.79 "GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd" status: 200 len: 1323 microversion: 2.1 time: 0.827203 Oct 17 14:03:22.783812 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2568/5268] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:21 2022] GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd => generated 1323 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:22.971637 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cb845797-dbf1-4a27-99bc-c976afe1f1b3 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:22.988123 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cb845797-dbf1-4a27-99bc-c976afe1f1b3 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:22.991156 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cb845797-dbf1-4a27-99bc-c976afe1f1b3 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:22.993301 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cb845797-dbf1-4a27-99bc-c976afe1f1b3 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1808 microversion: 2.20 time: 0.488166 Oct 17 14:03:23.010052 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2701/5269] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:03:22 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1808 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:03:23.797197 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-752b1e0e-67bc-4135-874c-df8cd42c6d84 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:23.797920 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-752b1e0e-67bc-4135-874c-df8cd42c6d84 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] [instance: 5c1e7d15-aff1-4439-be8c-af4e87a53fdd] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:23.820407 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-752b1e0e-67bc-4135-874c-df8cd42c6d84 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:23.821849 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-752b1e0e-67bc-4135-874c-df8cd42c6d84 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:23.823396 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-752b1e0e-67bc-4135-874c-df8cd42c6d84 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:23.826563 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-752b1e0e-67bc-4135-874c-df8cd42c6d84 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:23.830308 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-752b1e0e-67bc-4135-874c-df8cd42c6d84 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:23.832139 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-752b1e0e-67bc-4135-874c-df8cd42c6d84 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:24.024795 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-35878c44-fb18-4e01-a4c3-8b2e0a27fe3c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:24.025519 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-35878c44-fb18-4e01-a4c3-8b2e0a27fe3c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:24.043029 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-35878c44-fb18-4e01-a4c3-8b2e0a27fe3c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:24.046721 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-35878c44-fb18-4e01-a4c3-8b2e0a27fe3c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:24.047304 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-35878c44-fb18-4e01-a4c3-8b2e0a27fe3c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:24.051930 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-35878c44-fb18-4e01-a4c3-8b2e0a27fe3c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:24.055812 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-35878c44-fb18-4e01-a4c3-8b2e0a27fe3c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:24.056996 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-35878c44-fb18-4e01-a4c3-8b2e0a27fe3c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:24.582410 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-752b1e0e-67bc-4135-874c-df8cd42c6d84 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae278c3db5eb41dca0336a8edf10fab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4c1113905449dfaa64b18199faa2ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:24.602786 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-752b1e0e-67bc-4135-874c-df8cd42c6d84 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] 10.222.0.79 "GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd" status: 200 len: 1323 microversion: 2.1 time: 0.812492 Oct 17 14:03:24.603940 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2569/5270] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:23 2022] GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd => generated 1323 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:25.335609 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-35878c44-fb18-4e01-a4c3-8b2e0a27fe3c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:25.350518 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-35878c44-fb18-4e01-a4c3-8b2e0a27fe3c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:25.362437 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-35878c44-fb18-4e01-a4c3-8b2e0a27fe3c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:25.374605 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-35878c44-fb18-4e01-a4c3-8b2e0a27fe3c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1808 microversion: 2.20 time: 1.353988 Oct 17 14:03:25.408054 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2702/5271] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:03:24 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1808 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:03:25.636962 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a794c48b-f66e-4961-ae7d-8d9023d8ebc6 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:25.638916 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a794c48b-f66e-4961-ae7d-8d9023d8ebc6 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] [instance: 5c1e7d15-aff1-4439-be8c-af4e87a53fdd] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:25.643851 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:03:25.665117 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a794c48b-f66e-4961-ae7d-8d9023d8ebc6 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:25.670885 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a794c48b-f66e-4961-ae7d-8d9023d8ebc6 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:25.674494 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a794c48b-f66e-4961-ae7d-8d9023d8ebc6 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:25.675642 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a794c48b-f66e-4961-ae7d-8d9023d8ebc6 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:25.676959 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a794c48b-f66e-4961-ae7d-8d9023d8ebc6 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:25.680491 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a794c48b-f66e-4961-ae7d-8d9023d8ebc6 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:26.438542 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-52699fa5-621f-4052-ae53-ed571114ecea tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:26.439303 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-52699fa5-621f-4052-ae53-ed571114ecea tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:26.450081 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-52699fa5-621f-4052-ae53-ed571114ecea tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:26.455221 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-52699fa5-621f-4052-ae53-ed571114ecea tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:26.455981 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-52699fa5-621f-4052-ae53-ed571114ecea tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:26.456908 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-52699fa5-621f-4052-ae53-ed571114ecea tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:26.458592 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-52699fa5-621f-4052-ae53-ed571114ecea tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:26.461048 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-52699fa5-621f-4052-ae53-ed571114ecea tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:26.665443 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a794c48b-f66e-4961-ae7d-8d9023d8ebc6 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae278c3db5eb41dca0336a8edf10fab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4c1113905449dfaa64b18199faa2ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:26.683016 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a794c48b-f66e-4961-ae7d-8d9023d8ebc6 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] 10.222.0.79 "GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd" status: 200 len: 1323 microversion: 2.1 time: 1.051620 Oct 17 14:03:26.686145 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2570/5272] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:25 2022] GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd => generated 1323 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:27.057945 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-52699fa5-621f-4052-ae53-ed571114ecea tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:27.071704 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-52699fa5-621f-4052-ae53-ed571114ecea tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:27.077139 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-52699fa5-621f-4052-ae53-ed571114ecea tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:27.079710 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-52699fa5-621f-4052-ae53-ed571114ecea tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1808 microversion: 2.20 time: 0.645948 Oct 17 14:03:27.083713 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2703/5273] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:03:26 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1808 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:03:27.711131 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2d21a394-bd7f-48b8-a834-8535a5c4acd8 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:27.713022 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2d21a394-bd7f-48b8-a834-8535a5c4acd8 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] [instance: 5c1e7d15-aff1-4439-be8c-af4e87a53fdd] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:27.721977 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2d21a394-bd7f-48b8-a834-8535a5c4acd8 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:27.730971 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2d21a394-bd7f-48b8-a834-8535a5c4acd8 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:27.731819 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2d21a394-bd7f-48b8-a834-8535a5c4acd8 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:27.732648 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2d21a394-bd7f-48b8-a834-8535a5c4acd8 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:27.733243 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2d21a394-bd7f-48b8-a834-8535a5c4acd8 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:27.734147 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2d21a394-bd7f-48b8-a834-8535a5c4acd8 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:28.060407 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2d21a394-bd7f-48b8-a834-8535a5c4acd8 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae278c3db5eb41dca0336a8edf10fab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4c1113905449dfaa64b18199faa2ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:28.077564 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2d21a394-bd7f-48b8-a834-8535a5c4acd8 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] 10.222.0.79 "GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd" status: 200 len: 1323 microversion: 2.1 time: 0.371291 Oct 17 14:03:28.088670 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2571/5274] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:27 2022] GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd => generated 1323 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:28.110843 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-839b93eb-028d-496b-8e3a-e0cd4804be5c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:28.111501 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-839b93eb-028d-496b-8e3a-e0cd4804be5c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:28.121034 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-839b93eb-028d-496b-8e3a-e0cd4804be5c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:28.124814 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-839b93eb-028d-496b-8e3a-e0cd4804be5c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:28.125263 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-839b93eb-028d-496b-8e3a-e0cd4804be5c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:28.126358 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-839b93eb-028d-496b-8e3a-e0cd4804be5c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:28.126814 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-839b93eb-028d-496b-8e3a-e0cd4804be5c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:28.127265 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-839b93eb-028d-496b-8e3a-e0cd4804be5c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:28.466900 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-1bfb1460-60ba-4808-9d84-9b197e172bf5 req-49e43a9b-8423-4a8f-95de-5f658a164d03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c1e7d15-aff1-4439-be8c-af4e87a53fdd", "name": "network-vif-plugged", "status": "completed", "tag": "005c8f89-113c-42e8-b0c0-99f7c47dc5d9"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:03:28.481124 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-1bfb1460-60ba-4808-9d84-9b197e172bf5 req-49e43a9b-8423-4a8f-95de-5f658a164d03 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:28.482861 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-1bfb1460-60ba-4808-9d84-9b197e172bf5 req-49e43a9b-8423-4a8f-95de-5f658a164d03 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:28.483703 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-1bfb1460-60ba-4808-9d84-9b197e172bf5 req-49e43a9b-8423-4a8f-95de-5f658a164d03 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:28.497808 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-839b93eb-028d-496b-8e3a-e0cd4804be5c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:28.503419 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-1bfb1460-60ba-4808-9d84-9b197e172bf5 req-49e43a9b-8423-4a8f-95de-5f658a164d03 service nova] Creating event network-vif-plugged:005c8f89-113c-42e8-b0c0-99f7c47dc5d9 for instance 5c1e7d15-aff1-4439-be8c-af4e87a53fdd on n-h2-854247-14 Oct 17 14:03:28.510728 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-1bfb1460-60ba-4808-9d84-9b197e172bf5 req-49e43a9b-8423-4a8f-95de-5f658a164d03 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049037 Oct 17 14:03:28.512061 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2572/5275] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:03:28.519650 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-839b93eb-028d-496b-8e3a-e0cd4804be5c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:28.523045 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-839b93eb-028d-496b-8e3a-e0cd4804be5c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:28.525839 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-839b93eb-028d-496b-8e3a-e0cd4804be5c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1808 microversion: 2.20 time: 0.419822 Oct 17 14:03:28.530496 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2704/5276] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:03:28 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1808 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:03:29.106340 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-155dbb7c-eaf0-4ca6-9ef4-bd4b8cade0dc tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:29.117151 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-155dbb7c-eaf0-4ca6-9ef4-bd4b8cade0dc tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] [instance: 5c1e7d15-aff1-4439-be8c-af4e87a53fdd] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:29.132120 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-155dbb7c-eaf0-4ca6-9ef4-bd4b8cade0dc tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:29.132902 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-155dbb7c-eaf0-4ca6-9ef4-bd4b8cade0dc tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:29.133548 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-155dbb7c-eaf0-4ca6-9ef4-bd4b8cade0dc tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:29.134493 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-155dbb7c-eaf0-4ca6-9ef4-bd4b8cade0dc tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:29.140773 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-155dbb7c-eaf0-4ca6-9ef4-bd4b8cade0dc tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:29.141565 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-155dbb7c-eaf0-4ca6-9ef4-bd4b8cade0dc tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:29.513982 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-155dbb7c-eaf0-4ca6-9ef4-bd4b8cade0dc tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae278c3db5eb41dca0336a8edf10fab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4c1113905449dfaa64b18199faa2ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:29.526189 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-155dbb7c-eaf0-4ca6-9ef4-bd4b8cade0dc tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] 10.222.0.79 "GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd" status: 200 len: 1323 microversion: 2.1 time: 0.427432 Oct 17 14:03:29.532405 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2573/5277] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:29 2022] GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd => generated 1323 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:29.556465 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0dd82f57-960e-4d81-9af2-51d2131f9e0c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:29.558302 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0dd82f57-960e-4d81-9af2-51d2131f9e0c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:29.570346 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0dd82f57-960e-4d81-9af2-51d2131f9e0c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:29.573109 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0dd82f57-960e-4d81-9af2-51d2131f9e0c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:29.573723 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0dd82f57-960e-4d81-9af2-51d2131f9e0c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:29.576849 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0dd82f57-960e-4d81-9af2-51d2131f9e0c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:29.580930 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0dd82f57-960e-4d81-9af2-51d2131f9e0c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:29.582163 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0dd82f57-960e-4d81-9af2-51d2131f9e0c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:30.554890 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-dedbdef5-952c-48e0-9006-05823376a56e tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:30.556379 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-dedbdef5-952c-48e0-9006-05823376a56e tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] [instance: 5c1e7d15-aff1-4439-be8c-af4e87a53fdd] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:30.572028 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dedbdef5-952c-48e0-9006-05823376a56e tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:30.573661 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dedbdef5-952c-48e0-9006-05823376a56e tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:30.575313 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dedbdef5-952c-48e0-9006-05823376a56e tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:30.579413 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dedbdef5-952c-48e0-9006-05823376a56e tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:30.581438 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dedbdef5-952c-48e0-9006-05823376a56e tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:30.582819 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dedbdef5-952c-48e0-9006-05823376a56e tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:30.632610 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0dd82f57-960e-4d81-9af2-51d2131f9e0c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:30.659859 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0dd82f57-960e-4d81-9af2-51d2131f9e0c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:30.661625 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0dd82f57-960e-4d81-9af2-51d2131f9e0c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:30.672169 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0dd82f57-960e-4d81-9af2-51d2131f9e0c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1808 microversion: 2.20 time: 1.120105 Oct 17 14:03:30.691209 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2705/5278] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:03:29 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1808 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:03:31.131593 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-dedbdef5-952c-48e0-9006-05823376a56e tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae278c3db5eb41dca0336a8edf10fab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4c1113905449dfaa64b18199faa2ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:31.141997 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-dedbdef5-952c-48e0-9006-05823376a56e tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] 10.222.0.79 "GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd" status: 200 len: 1519 microversion: 2.1 time: 0.591751 Oct 17 14:03:31.142623 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2574/5279] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:30 2022] GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd => generated 1519 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:31.168503 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4d4e0995-d356-4545-ae98-0525b44bbe7b tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:03:31.170969 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4d4e0995-d356-4545-ae98-0525b44bbe7b tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] [instance: 5c1e7d15-aff1-4439-be8c-af4e87a53fdd] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:31.190961 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d4e0995-d356-4545-ae98-0525b44bbe7b tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:31.191499 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d4e0995-d356-4545-ae98-0525b44bbe7b tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:31.191942 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d4e0995-d356-4545-ae98-0525b44bbe7b tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:31.192650 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d4e0995-d356-4545-ae98-0525b44bbe7b tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:31.193105 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d4e0995-d356-4545-ae98-0525b44bbe7b tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:31.193746 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d4e0995-d356-4545-ae98-0525b44bbe7b tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:31.227819 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-4d4e0995-d356-4545-ae98-0525b44bbe7b tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lazy-loading 'flavor' on Instance uuid 5c1e7d15-aff1-4439-be8c-af4e87a53fdd {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:03:31.354473 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4d4e0995-d356-4545-ae98-0525b44bbe7b tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] 10.222.0.79 "POST /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd/action" status: 200 len: 32 microversion: 2.1 time: 0.189750 Oct 17 14:03:31.356935 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2706/5280] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:03:31 2022] POST /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd/action => generated 32 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 14:03:31.377948 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-89caec43-9fda-474d-898b-3918448ed610 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:31.381128 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-89caec43-9fda-474d-898b-3918448ed610 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] [instance: 5c1e7d15-aff1-4439-be8c-af4e87a53fdd] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:31.411255 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-89caec43-9fda-474d-898b-3918448ed610 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:31.411949 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-89caec43-9fda-474d-898b-3918448ed610 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:31.414208 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-89caec43-9fda-474d-898b-3918448ed610 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:31.414367 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-89caec43-9fda-474d-898b-3918448ed610 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:31.415786 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-89caec43-9fda-474d-898b-3918448ed610 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:31.416422 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-89caec43-9fda-474d-898b-3918448ed610 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:31.705148 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e0191657-9d62-4b90-bc5f-e11caf6be28e tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:31.705882 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e0191657-9d62-4b90-bc5f-e11caf6be28e tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:31.722711 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e0191657-9d62-4b90-bc5f-e11caf6be28e tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:31.723582 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e0191657-9d62-4b90-bc5f-e11caf6be28e tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:31.724198 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e0191657-9d62-4b90-bc5f-e11caf6be28e tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:31.725259 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e0191657-9d62-4b90-bc5f-e11caf6be28e tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:31.725876 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e0191657-9d62-4b90-bc5f-e11caf6be28e tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:31.726477 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e0191657-9d62-4b90-bc5f-e11caf6be28e tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:32.378878 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-89caec43-9fda-474d-898b-3918448ed610 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae278c3db5eb41dca0336a8edf10fab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4c1113905449dfaa64b18199faa2ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:32.388164 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-89caec43-9fda-474d-898b-3918448ed610 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] 10.222.0.79 "GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd" status: 200 len: 1525 microversion: 2.1 time: 1.024912 Oct 17 14:03:32.391987 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2575/5281] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:31 2022] GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd => generated 1525 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:32.470067 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e0191657-9d62-4b90-bc5f-e11caf6be28e tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:32.492297 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e0191657-9d62-4b90-bc5f-e11caf6be28e tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:32.495779 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e0191657-9d62-4b90-bc5f-e11caf6be28e tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:32.503746 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e0191657-9d62-4b90-bc5f-e11caf6be28e tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1808 microversion: 2.20 time: 0.801552 Oct 17 14:03:32.506603 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2707/5282] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:03:31 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1808 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 14:03:32.653242 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-0554c37b-6ec7-4653-81de-24ee6dab735c req-0423b983-1f29-4411-a2aa-d505650e7c16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86508a39-65fa-4421-b31d-ffbc5fdee565", "name": "network-vif-plugged", "status": "completed", "tag": "be2d42c9-97a7-4933-9200-d27f76f73a39"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:03:32.682249 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-0554c37b-6ec7-4653-81de-24ee6dab735c req-0423b983-1f29-4411-a2aa-d505650e7c16 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:32.684280 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-0554c37b-6ec7-4653-81de-24ee6dab735c req-0423b983-1f29-4411-a2aa-d505650e7c16 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:32.686166 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-0554c37b-6ec7-4653-81de-24ee6dab735c req-0423b983-1f29-4411-a2aa-d505650e7c16 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:32.719501 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-0554c37b-6ec7-4653-81de-24ee6dab735c req-0423b983-1f29-4411-a2aa-d505650e7c16 service nova] Creating event network-vif-plugged:be2d42c9-97a7-4933-9200-d27f76f73a39 for instance 86508a39-65fa-4421-b31d-ffbc5fdee565 on n-h1-854247-14 Oct 17 14:03:32.729532 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-0554c37b-6ec7-4653-81de-24ee6dab735c req-0423b983-1f29-4411-a2aa-d505650e7c16 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080440 Oct 17 14:03:32.733574 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2576/5283] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:03:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:03:33.414612 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b263507f-9066-4a7b-b31b-8ba3b79ecdb0 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:33.415979 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b263507f-9066-4a7b-b31b-8ba3b79ecdb0 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] [instance: 5c1e7d15-aff1-4439-be8c-af4e87a53fdd] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:33.449817 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b263507f-9066-4a7b-b31b-8ba3b79ecdb0 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:33.450667 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b263507f-9066-4a7b-b31b-8ba3b79ecdb0 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:33.455248 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b263507f-9066-4a7b-b31b-8ba3b79ecdb0 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:33.458127 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b263507f-9066-4a7b-b31b-8ba3b79ecdb0 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:33.458729 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b263507f-9066-4a7b-b31b-8ba3b79ecdb0 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:33.459306 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b263507f-9066-4a7b-b31b-8ba3b79ecdb0 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:33.538350 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-28ecab34-c04e-48b2-ae41-1b443ac30b83 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:33.539348 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-28ecab34-c04e-48b2-ae41-1b443ac30b83 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:33.560635 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-28ecab34-c04e-48b2-ae41-1b443ac30b83 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:33.565143 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-28ecab34-c04e-48b2-ae41-1b443ac30b83 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:33.565797 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-28ecab34-c04e-48b2-ae41-1b443ac30b83 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:33.567953 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-28ecab34-c04e-48b2-ae41-1b443ac30b83 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:33.575581 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-28ecab34-c04e-48b2-ae41-1b443ac30b83 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:33.576139 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-28ecab34-c04e-48b2-ae41-1b443ac30b83 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:34.079300 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b263507f-9066-4a7b-b31b-8ba3b79ecdb0 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae278c3db5eb41dca0336a8edf10fab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4c1113905449dfaa64b18199faa2ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:34.105062 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b263507f-9066-4a7b-b31b-8ba3b79ecdb0 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] 10.222.0.79 "GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd" status: 200 len: 1525 microversion: 2.1 time: 0.694822 Oct 17 14:03:34.107960 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2708/5284] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:33 2022] GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd => generated 1525 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:34.157856 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-28ecab34-c04e-48b2-ae41-1b443ac30b83 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:34.169414 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-28ecab34-c04e-48b2-ae41-1b443ac30b83 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:34.176859 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-28ecab34-c04e-48b2-ae41-1b443ac30b83 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:34.178624 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-28ecab34-c04e-48b2-ae41-1b443ac30b83 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1808 microversion: 2.20 time: 0.645867 Oct 17 14:03:34.183226 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2577/5285] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:03:33 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1808 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 14:03:35.130144 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7b3515c1-c231-42f3-ad39-5731256d4acc tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:35.130864 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7b3515c1-c231-42f3-ad39-5731256d4acc tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] [instance: 5c1e7d15-aff1-4439-be8c-af4e87a53fdd] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:35.152183 n-d-854247-14 devstack@n-api.service[127016]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 14:03:35.152313 n-d-854247-14 devstack@n-api.service[127016]: Mon Oct 17 14:03:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd (ip 10.222.0.79) !!! Oct 17 14:03:35.165088 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7b3515c1-c231-42f3-ad39-5731256d4acc tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:35.173197 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7b3515c1-c231-42f3-ad39-5731256d4acc tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:35.174266 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7b3515c1-c231-42f3-ad39-5731256d4acc tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:35.175037 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7b3515c1-c231-42f3-ad39-5731256d4acc tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:35.181299 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7b3515c1-c231-42f3-ad39-5731256d4acc tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:35.182828 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7b3515c1-c231-42f3-ad39-5731256d4acc tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:35.212397 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-392b512d-7900-405f-87c7-022d87b8a075 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:35.214079 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-392b512d-7900-405f-87c7-022d87b8a075 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:35.228895 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-392b512d-7900-405f-87c7-022d87b8a075 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:35.230531 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-392b512d-7900-405f-87c7-022d87b8a075 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:35.231200 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-392b512d-7900-405f-87c7-022d87b8a075 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:35.233181 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-392b512d-7900-405f-87c7-022d87b8a075 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:35.236562 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-392b512d-7900-405f-87c7-022d87b8a075 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:35.237208 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-392b512d-7900-405f-87c7-022d87b8a075 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:36.125009 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-392b512d-7900-405f-87c7-022d87b8a075 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:36.135951 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-392b512d-7900-405f-87c7-022d87b8a075 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:36.144866 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-392b512d-7900-405f-87c7-022d87b8a075 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:36.146261 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-392b512d-7900-405f-87c7-022d87b8a075 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1808 microversion: 2.20 time: 0.940092 Oct 17 14:03:36.150568 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2578/5286] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:03:35 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1808 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:03:36.361596 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7b3515c1-c231-42f3-ad39-5731256d4acc tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae278c3db5eb41dca0336a8edf10fab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4c1113905449dfaa64b18199faa2ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:36.380390 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7b3515c1-c231-42f3-ad39-5731256d4acc tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] 10.222.0.79 "GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd" status: 200 len: 1525 microversion: 2.1 time: 1.252615 Oct 17 14:03:36.393469 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2709/5287] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:35 2022] GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd => generated 1525 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:37.178939 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-eac48d97-025e-4aae-9414-666f657bf8e2 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:37.179644 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-eac48d97-025e-4aae-9414-666f657bf8e2 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:37.194107 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eac48d97-025e-4aae-9414-666f657bf8e2 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:37.194639 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eac48d97-025e-4aae-9414-666f657bf8e2 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:37.195003 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eac48d97-025e-4aae-9414-666f657bf8e2 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:37.195728 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eac48d97-025e-4aae-9414-666f657bf8e2 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:37.196174 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eac48d97-025e-4aae-9414-666f657bf8e2 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:37.196587 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eac48d97-025e-4aae-9414-666f657bf8e2 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:37.418249 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5dfbd781-5a72-4509-83ed-58a4b7edec3b tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:37.422575 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5dfbd781-5a72-4509-83ed-58a4b7edec3b tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] [instance: 5c1e7d15-aff1-4439-be8c-af4e87a53fdd] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:37.469218 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5dfbd781-5a72-4509-83ed-58a4b7edec3b tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:37.470410 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5dfbd781-5a72-4509-83ed-58a4b7edec3b tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:37.471067 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5dfbd781-5a72-4509-83ed-58a4b7edec3b tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:37.472135 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5dfbd781-5a72-4509-83ed-58a4b7edec3b tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:37.473000 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5dfbd781-5a72-4509-83ed-58a4b7edec3b tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:37.473666 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5dfbd781-5a72-4509-83ed-58a4b7edec3b tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:37.744172 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5dfbd781-5a72-4509-83ed-58a4b7edec3b tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae278c3db5eb41dca0336a8edf10fab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4c1113905449dfaa64b18199faa2ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:37.762664 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5dfbd781-5a72-4509-83ed-58a4b7edec3b tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] 10.222.0.79 "GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd" status: 200 len: 1525 microversion: 2.1 time: 0.358839 Oct 17 14:03:37.764635 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2710/5288] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:37 2022] GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd => generated 1525 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:37.782555 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-eac48d97-025e-4aae-9414-666f657bf8e2 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:37.794984 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-eac48d97-025e-4aae-9414-666f657bf8e2 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:37.796932 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-eac48d97-025e-4aae-9414-666f657bf8e2 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:37.798482 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-eac48d97-025e-4aae-9414-666f657bf8e2 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1795 microversion: 2.20 time: 0.625469 Oct 17 14:03:37.799327 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2579/5289] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:03:37 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1795 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:03:38.787294 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-63df331d-e6fd-409a-b725-cbdd3bf675a6 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:38.788502 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-63df331d-e6fd-409a-b725-cbdd3bf675a6 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] [instance: 5c1e7d15-aff1-4439-be8c-af4e87a53fdd] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:38.795074 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-63df331d-e6fd-409a-b725-cbdd3bf675a6 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:38.795882 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-63df331d-e6fd-409a-b725-cbdd3bf675a6 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:38.796556 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-63df331d-e6fd-409a-b725-cbdd3bf675a6 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:38.797458 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-63df331d-e6fd-409a-b725-cbdd3bf675a6 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:38.798082 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-63df331d-e6fd-409a-b725-cbdd3bf675a6 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:38.798659 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-63df331d-e6fd-409a-b725-cbdd3bf675a6 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:39.205963 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-63df331d-e6fd-409a-b725-cbdd3bf675a6 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae278c3db5eb41dca0336a8edf10fab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4c1113905449dfaa64b18199faa2ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:39.208610 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:03:39.222291 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-63df331d-e6fd-409a-b725-cbdd3bf675a6 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] 10.222.0.79 "GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd" status: 200 len: 1525 microversion: 2.1 time: 0.439843 Oct 17 14:03:39.243067 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2711/5290] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:38 2022] GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd => generated 1525 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:40.251036 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c564ae17-d124-4afc-8b46-c092d3041b7a tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:40.251709 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c564ae17-d124-4afc-8b46-c092d3041b7a tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] [instance: 5c1e7d15-aff1-4439-be8c-af4e87a53fdd] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:40.265165 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c564ae17-d124-4afc-8b46-c092d3041b7a tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:40.266266 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c564ae17-d124-4afc-8b46-c092d3041b7a tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:40.266880 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c564ae17-d124-4afc-8b46-c092d3041b7a tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:40.269955 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c564ae17-d124-4afc-8b46-c092d3041b7a tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:40.270949 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c564ae17-d124-4afc-8b46-c092d3041b7a tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:40.274002 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c564ae17-d124-4afc-8b46-c092d3041b7a tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:41.031490 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c564ae17-d124-4afc-8b46-c092d3041b7a tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae278c3db5eb41dca0336a8edf10fab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4c1113905449dfaa64b18199faa2ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:41.046004 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c564ae17-d124-4afc-8b46-c092d3041b7a tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] 10.222.0.79 "GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd" status: 200 len: 1525 microversion: 2.1 time: 0.799800 Oct 17 14:03:41.046598 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2580/5291] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:40 2022] GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd => generated 1525 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:03:42.069719 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8863a4d9-4473-4e89-9953-5f66abd801fb tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:42.070330 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8863a4d9-4473-4e89-9953-5f66abd801fb tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] [instance: 5c1e7d15-aff1-4439-be8c-af4e87a53fdd] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:42.073664 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=30 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:03:42.084301 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8863a4d9-4473-4e89-9953-5f66abd801fb tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:42.085052 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8863a4d9-4473-4e89-9953-5f66abd801fb tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:42.085643 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8863a4d9-4473-4e89-9953-5f66abd801fb tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:42.086499 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8863a4d9-4473-4e89-9953-5f66abd801fb tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:42.087084 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8863a4d9-4473-4e89-9953-5f66abd801fb tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:42.104074 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8863a4d9-4473-4e89-9953-5f66abd801fb tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:42.450885 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8863a4d9-4473-4e89-9953-5f66abd801fb tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae278c3db5eb41dca0336a8edf10fab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4c1113905449dfaa64b18199faa2ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:42.465658 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8863a4d9-4473-4e89-9953-5f66abd801fb tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] 10.222.0.79 "GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd" status: 200 len: 1525 microversion: 2.1 time: 0.399751 Oct 17 14:03:42.485388 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2712/5292] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:42 2022] GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd => generated 1525 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:43.499771 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c5d3000f-d4ab-4e3e-9cc3-e6724286141a tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:43.501334 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c5d3000f-d4ab-4e3e-9cc3-e6724286141a tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] [instance: 5c1e7d15-aff1-4439-be8c-af4e87a53fdd] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:43.520794 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c5d3000f-d4ab-4e3e-9cc3-e6724286141a tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:43.535987 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c5d3000f-d4ab-4e3e-9cc3-e6724286141a tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:43.536715 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c5d3000f-d4ab-4e3e-9cc3-e6724286141a tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:43.539507 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c5d3000f-d4ab-4e3e-9cc3-e6724286141a tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:43.544139 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c5d3000f-d4ab-4e3e-9cc3-e6724286141a tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:43.546747 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c5d3000f-d4ab-4e3e-9cc3-e6724286141a tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:43.615928 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=96 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:03:44.098739 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c5d3000f-d4ab-4e3e-9cc3-e6724286141a tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae278c3db5eb41dca0336a8edf10fab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4c1113905449dfaa64b18199faa2ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:44.111635 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c5d3000f-d4ab-4e3e-9cc3-e6724286141a tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] 10.222.0.79 "GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd" status: 200 len: 1525 microversion: 2.1 time: 0.623636 Oct 17 14:03:44.126544 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2581/5293] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:43 2022] GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd => generated 1525 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:45.146442 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2bffb689-2afc-45da-a6c5-e1a8abffcf9c tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:45.151397 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2bffb689-2afc-45da-a6c5-e1a8abffcf9c tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] [instance: 5c1e7d15-aff1-4439-be8c-af4e87a53fdd] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:45.173075 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2bffb689-2afc-45da-a6c5-e1a8abffcf9c tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:45.173567 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2bffb689-2afc-45da-a6c5-e1a8abffcf9c tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:45.174000 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2bffb689-2afc-45da-a6c5-e1a8abffcf9c tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:45.174715 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2bffb689-2afc-45da-a6c5-e1a8abffcf9c tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:45.175181 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2bffb689-2afc-45da-a6c5-e1a8abffcf9c tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:45.176797 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2bffb689-2afc-45da-a6c5-e1a8abffcf9c tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:45.649798 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2bffb689-2afc-45da-a6c5-e1a8abffcf9c tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae278c3db5eb41dca0336a8edf10fab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4c1113905449dfaa64b18199faa2ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:45.658484 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2bffb689-2afc-45da-a6c5-e1a8abffcf9c tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] 10.222.0.79 "GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd" status: 200 len: 1525 microversion: 2.1 time: 0.523030 Oct 17 14:03:45.663934 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2713/5294] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:45 2022] GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd => generated 1525 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:46.688123 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6fa9fa54-dc7a-4322-b413-900c08be4d7d tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:46.688750 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6fa9fa54-dc7a-4322-b413-900c08be4d7d tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] [instance: 5c1e7d15-aff1-4439-be8c-af4e87a53fdd] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:46.699861 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6fa9fa54-dc7a-4322-b413-900c08be4d7d tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:46.701951 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6fa9fa54-dc7a-4322-b413-900c08be4d7d tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:46.703030 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6fa9fa54-dc7a-4322-b413-900c08be4d7d tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:46.704424 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6fa9fa54-dc7a-4322-b413-900c08be4d7d tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:46.711979 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6fa9fa54-dc7a-4322-b413-900c08be4d7d tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:46.715435 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6fa9fa54-dc7a-4322-b413-900c08be4d7d tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:47.330833 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6fa9fa54-dc7a-4322-b413-900c08be4d7d tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae278c3db5eb41dca0336a8edf10fab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4c1113905449dfaa64b18199faa2ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:47.343809 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6fa9fa54-dc7a-4322-b413-900c08be4d7d tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] 10.222.0.79 "GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd" status: 200 len: 1525 microversion: 2.1 time: 0.659776 Oct 17 14:03:47.359696 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2582/5295] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:46 2022] GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd => generated 1525 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:48.366456 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-09795df8-3273-44a8-9421-0ca06d0a793a tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:48.368048 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-09795df8-3273-44a8-9421-0ca06d0a793a tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] [instance: 5c1e7d15-aff1-4439-be8c-af4e87a53fdd] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:48.381215 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-09795df8-3273-44a8-9421-0ca06d0a793a tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:48.382999 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-09795df8-3273-44a8-9421-0ca06d0a793a tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:48.384284 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-09795df8-3273-44a8-9421-0ca06d0a793a tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:48.386266 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-09795df8-3273-44a8-9421-0ca06d0a793a tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:48.387928 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-09795df8-3273-44a8-9421-0ca06d0a793a tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:48.389857 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-09795df8-3273-44a8-9421-0ca06d0a793a tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:48.783629 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-09795df8-3273-44a8-9421-0ca06d0a793a tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae278c3db5eb41dca0336a8edf10fab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4c1113905449dfaa64b18199faa2ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:48.800983 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-09795df8-3273-44a8-9421-0ca06d0a793a tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] 10.222.0.79 "GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd" status: 200 len: 1525 microversion: 2.1 time: 0.438558 Oct 17 14:03:48.823762 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2714/5296] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:48 2022] GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd => generated 1525 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:49.840081 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3e7287c2-8ba0-4ce2-b222-3051040456f2 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:49.840703 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3e7287c2-8ba0-4ce2-b222-3051040456f2 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] [instance: 5c1e7d15-aff1-4439-be8c-af4e87a53fdd] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:49.852152 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3e7287c2-8ba0-4ce2-b222-3051040456f2 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:49.852916 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3e7287c2-8ba0-4ce2-b222-3051040456f2 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:49.853524 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3e7287c2-8ba0-4ce2-b222-3051040456f2 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:49.854620 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3e7287c2-8ba0-4ce2-b222-3051040456f2 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:49.855279 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3e7287c2-8ba0-4ce2-b222-3051040456f2 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:49.855861 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3e7287c2-8ba0-4ce2-b222-3051040456f2 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:50.379827 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3e7287c2-8ba0-4ce2-b222-3051040456f2 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae278c3db5eb41dca0336a8edf10fab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4c1113905449dfaa64b18199faa2ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:50.405588 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3e7287c2-8ba0-4ce2-b222-3051040456f2 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] 10.222.0.79 "GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd" status: 200 len: 1525 microversion: 2.1 time: 0.563158 Oct 17 14:03:50.408308 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2583/5297] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:49 2022] GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd => generated 1525 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:51.434090 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f980b4d6-db35-4e87-838b-e40c81381d1f tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:51.435701 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f980b4d6-db35-4e87-838b-e40c81381d1f tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] [instance: 5c1e7d15-aff1-4439-be8c-af4e87a53fdd] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:51.466569 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f980b4d6-db35-4e87-838b-e40c81381d1f tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:51.469831 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f980b4d6-db35-4e87-838b-e40c81381d1f tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:51.472251 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f980b4d6-db35-4e87-838b-e40c81381d1f tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:51.476490 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f980b4d6-db35-4e87-838b-e40c81381d1f tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:51.478817 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f980b4d6-db35-4e87-838b-e40c81381d1f tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:51.479549 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f980b4d6-db35-4e87-838b-e40c81381d1f tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:51.880921 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f980b4d6-db35-4e87-838b-e40c81381d1f tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae278c3db5eb41dca0336a8edf10fab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4c1113905449dfaa64b18199faa2ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:51.900854 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f980b4d6-db35-4e87-838b-e40c81381d1f tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] 10.222.0.79 "GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd" status: 200 len: 1525 microversion: 2.1 time: 0.470353 Oct 17 14:03:51.905549 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2715/5298] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:51 2022] GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd => generated 1525 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:52.926853 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-edda9673-7b46-4dfd-8f60-11da604e3613 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:52.928506 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-edda9673-7b46-4dfd-8f60-11da604e3613 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] [instance: 5c1e7d15-aff1-4439-be8c-af4e87a53fdd] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:52.956061 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-edda9673-7b46-4dfd-8f60-11da604e3613 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:52.957007 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-edda9673-7b46-4dfd-8f60-11da604e3613 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:52.957754 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-edda9673-7b46-4dfd-8f60-11da604e3613 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:52.958660 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-edda9673-7b46-4dfd-8f60-11da604e3613 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:52.959449 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-edda9673-7b46-4dfd-8f60-11da604e3613 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:52.960096 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-edda9673-7b46-4dfd-8f60-11da604e3613 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:53.256003 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-edda9673-7b46-4dfd-8f60-11da604e3613 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae278c3db5eb41dca0336a8edf10fab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4c1113905449dfaa64b18199faa2ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:53.267961 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-edda9673-7b46-4dfd-8f60-11da604e3613 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] 10.222.0.79 "GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd" status: 200 len: 1525 microversion: 2.1 time: 0.345448 Oct 17 14:03:53.278052 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2584/5299] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:52 2022] GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd => generated 1525 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:54.306342 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-dc2cf552-f1d5-490c-8791-75e135be5ef1 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:54.307610 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-dc2cf552-f1d5-490c-8791-75e135be5ef1 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] [instance: 5c1e7d15-aff1-4439-be8c-af4e87a53fdd] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:54.318302 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc2cf552-f1d5-490c-8791-75e135be5ef1 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:54.321922 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc2cf552-f1d5-490c-8791-75e135be5ef1 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:54.323686 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc2cf552-f1d5-490c-8791-75e135be5ef1 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:54.325769 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc2cf552-f1d5-490c-8791-75e135be5ef1 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:54.327564 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc2cf552-f1d5-490c-8791-75e135be5ef1 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:54.328203 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc2cf552-f1d5-490c-8791-75e135be5ef1 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:55.590228 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-dc2cf552-f1d5-490c-8791-75e135be5ef1 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae278c3db5eb41dca0336a8edf10fab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4c1113905449dfaa64b18199faa2ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:55.600702 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-dc2cf552-f1d5-490c-8791-75e135be5ef1 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] 10.222.0.79 "GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd" status: 200 len: 1525 microversion: 2.1 time: 1.303906 Oct 17 14:03:55.601301 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2716/5300] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:54 2022] GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd => generated 1525 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:56.625505 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-cca335f4-a9aa-4c5e-afc1-c869de786cdc tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:56.626860 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-cca335f4-a9aa-4c5e-afc1-c869de786cdc tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] [instance: 5c1e7d15-aff1-4439-be8c-af4e87a53fdd] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:56.630217 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=30 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:03:56.651076 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cca335f4-a9aa-4c5e-afc1-c869de786cdc tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:56.652067 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cca335f4-a9aa-4c5e-afc1-c869de786cdc tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:56.652722 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cca335f4-a9aa-4c5e-afc1-c869de786cdc tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:56.653655 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cca335f4-a9aa-4c5e-afc1-c869de786cdc tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:56.657540 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cca335f4-a9aa-4c5e-afc1-c869de786cdc tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:56.658263 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cca335f4-a9aa-4c5e-afc1-c869de786cdc tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:57.326498 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-cca335f4-a9aa-4c5e-afc1-c869de786cdc tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae278c3db5eb41dca0336a8edf10fab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4c1113905449dfaa64b18199faa2ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:57.341901 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-cca335f4-a9aa-4c5e-afc1-c869de786cdc tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] 10.222.0.79 "GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd" status: 200 len: 1525 microversion: 2.1 time: 0.721195 Oct 17 14:03:57.343907 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2585/5301] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:56 2022] GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd => generated 1525 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:58.379395 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-042e1ebc-e6d0-42c3-82ad-1e457b5f43fc tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:58.383019 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-042e1ebc-e6d0-42c3-82ad-1e457b5f43fc tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] [instance: 5c1e7d15-aff1-4439-be8c-af4e87a53fdd] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:58.401001 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-042e1ebc-e6d0-42c3-82ad-1e457b5f43fc tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:58.402232 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-042e1ebc-e6d0-42c3-82ad-1e457b5f43fc tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:58.402872 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-042e1ebc-e6d0-42c3-82ad-1e457b5f43fc tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:58.405437 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-042e1ebc-e6d0-42c3-82ad-1e457b5f43fc tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:58.406810 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-042e1ebc-e6d0-42c3-82ad-1e457b5f43fc tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:58.409213 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-042e1ebc-e6d0-42c3-82ad-1e457b5f43fc tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:58.912370 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-042e1ebc-e6d0-42c3-82ad-1e457b5f43fc tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae278c3db5eb41dca0336a8edf10fab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4c1113905449dfaa64b18199faa2ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:58.926665 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-042e1ebc-e6d0-42c3-82ad-1e457b5f43fc tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] 10.222.0.79 "GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd" status: 200 len: 1525 microversion: 2.1 time: 0.563835 Oct 17 14:03:58.928631 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2717/5302] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:58 2022] GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd => generated 1525 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:59.955483 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7df67107-4e87-4d6b-81fa-eee8ace4c665 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:59.956796 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7df67107-4e87-4d6b-81fa-eee8ace4c665 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] [instance: 5c1e7d15-aff1-4439-be8c-af4e87a53fdd] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:59.971883 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7df67107-4e87-4d6b-81fa-eee8ace4c665 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:59.977022 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7df67107-4e87-4d6b-81fa-eee8ace4c665 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:59.979677 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7df67107-4e87-4d6b-81fa-eee8ace4c665 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:59.982474 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7df67107-4e87-4d6b-81fa-eee8ace4c665 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:59.985628 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7df67107-4e87-4d6b-81fa-eee8ace4c665 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:59.998913 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7df67107-4e87-4d6b-81fa-eee8ace4c665 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:00.480442 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7df67107-4e87-4d6b-81fa-eee8ace4c665 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae278c3db5eb41dca0336a8edf10fab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4c1113905449dfaa64b18199faa2ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:00.498136 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7df67107-4e87-4d6b-81fa-eee8ace4c665 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] 10.222.0.79 "GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd" status: 200 len: 1525 microversion: 2.1 time: 0.546485 Oct 17 14:04:00.501169 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2586/5303] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:59 2022] GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd => generated 1525 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:04:01.523739 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4b30825b-d0f4-4969-97db-2489be4197ed tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:01.524630 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4b30825b-d0f4-4969-97db-2489be4197ed tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] [instance: 5c1e7d15-aff1-4439-be8c-af4e87a53fdd] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:01.544345 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4b30825b-d0f4-4969-97db-2489be4197ed tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:01.544868 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4b30825b-d0f4-4969-97db-2489be4197ed tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:01.545320 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4b30825b-d0f4-4969-97db-2489be4197ed tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:01.546256 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4b30825b-d0f4-4969-97db-2489be4197ed tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:01.546725 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4b30825b-d0f4-4969-97db-2489be4197ed tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:01.547307 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4b30825b-d0f4-4969-97db-2489be4197ed tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:02.276179 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4b30825b-d0f4-4969-97db-2489be4197ed tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae278c3db5eb41dca0336a8edf10fab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4c1113905449dfaa64b18199faa2ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:02.297782 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4b30825b-d0f4-4969-97db-2489be4197ed tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] 10.222.0.79 "GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd" status: 200 len: 1505 microversion: 2.1 time: 0.777482 Oct 17 14:04:02.303316 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2718/5304] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:04:01 2022] GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd => generated 1505 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:04:02.327828 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bc219c35-c376-4117-8889-90701e6e50d3 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Action: 'create', calling method: .version_select at 0x7f7cd4581790>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1008287301", "description": "tempest-description-1415147806"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:04:03.252932 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-bc219c35-c376-4117-8889-90701e6e50d3 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] 10.222.0.79 "POST /compute/v2.1/os-security-groups" status: 200 len: 251 microversion: 2.1 time: 0.931902 Oct 17 14:04:03.268803 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2587/5305] 10.222.0.79 () {60 vars in 1180 bytes} [Mon Oct 17 14:04:02 2022] POST /compute/v2.1/os-security-groups => generated 251 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:04:03.272853 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-51c4daad-959a-4e9e-a941-603a2bf48833 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1008287301"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:04:03.274247 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-51c4daad-959a-4e9e-a941-603a2bf48833 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] [instance: 5c1e7d15-aff1-4439-be8c-af4e87a53fdd] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:03.298198 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-51c4daad-959a-4e9e-a941-603a2bf48833 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:03.299092 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-51c4daad-959a-4e9e-a941-603a2bf48833 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:03.299811 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-51c4daad-959a-4e9e-a941-603a2bf48833 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:03.301338 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-51c4daad-959a-4e9e-a941-603a2bf48833 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:03.302058 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-51c4daad-959a-4e9e-a941-603a2bf48833 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:03.302711 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-51c4daad-959a-4e9e-a941-603a2bf48833 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:03.664588 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.network.security_group_api [None req-51c4daad-959a-4e9e-a941-603a2bf48833 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Adding security group 8eb0c435-da40-4190-b586-8a6f631ac3a0 to port 005c8f89-113c-42e8-b0c0-99f7c47dc5d9 Oct 17 14:04:04.869061 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-51c4daad-959a-4e9e-a941-603a2bf48833 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] 10.222.0.79 "POST /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd/action" status: 202 len: 0 microversion: 2.1 time: 1.603545 Oct 17 14:04:04.874762 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2719/5306] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:04:03 2022] POST /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd/action => generated 0 bytes in 1611 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:04:04.889852 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b0949049-ef99-44c8-9e17-e71c9547987f tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1008287301"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:04:04.895032 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b0949049-ef99-44c8-9e17-e71c9547987f tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] [instance: 5c1e7d15-aff1-4439-be8c-af4e87a53fdd] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:04.899798 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-fdc06373-3f9c-4a58-9b53-b002999aeb7d req-11106148-21e9-4cdb-8b57-c39c444c0904 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c1e7d15-aff1-4439-be8c-af4e87a53fdd", "tag": "005c8f89-113c-42e8-b0c0-99f7c47dc5d9"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:04:04.923485 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b0949049-ef99-44c8-9e17-e71c9547987f tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:04.926418 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b0949049-ef99-44c8-9e17-e71c9547987f tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:04.927201 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b0949049-ef99-44c8-9e17-e71c9547987f tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:04.933882 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-fdc06373-3f9c-4a58-9b53-b002999aeb7d req-11106148-21e9-4cdb-8b57-c39c444c0904 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:04.935300 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b0949049-ef99-44c8-9e17-e71c9547987f tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:04.936017 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b0949049-ef99-44c8-9e17-e71c9547987f tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:04.937736 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b0949049-ef99-44c8-9e17-e71c9547987f tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:04.940103 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-fdc06373-3f9c-4a58-9b53-b002999aeb7d req-11106148-21e9-4cdb-8b57-c39c444c0904 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:04.943576 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-fdc06373-3f9c-4a58-9b53-b002999aeb7d req-11106148-21e9-4cdb-8b57-c39c444c0904 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:05.007043 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-fdc06373-3f9c-4a58-9b53-b002999aeb7d req-11106148-21e9-4cdb-8b57-c39c444c0904 service nova] Creating event network-changed:005c8f89-113c-42e8-b0c0-99f7c47dc5d9 for instance 5c1e7d15-aff1-4439-be8c-af4e87a53fdd on n-h2-854247-14 Oct 17 14:04:05.019052 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-fdc06373-3f9c-4a58-9b53-b002999aeb7d req-11106148-21e9-4cdb-8b57-c39c444c0904 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132158 Oct 17 14:04:05.020458 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2720/5307] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:04:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:04:05.505075 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.network.security_group_api [None req-b0949049-ef99-44c8-9e17-e71c9547987f tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Removing security group 8eb0c435-da40-4190-b586-8a6f631ac3a0 from port 005c8f89-113c-42e8-b0c0-99f7c47dc5d9 Oct 17 14:04:07.701386 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4b639283-c2f6-4d00-acda-3b8eb1183f0a tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:07.702095 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4b639283-c2f6-4d00-acda-3b8eb1183f0a tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:07.721056 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4b639283-c2f6-4d00-acda-3b8eb1183f0a tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:07.721496 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4b639283-c2f6-4d00-acda-3b8eb1183f0a tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:07.722109 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4b639283-c2f6-4d00-acda-3b8eb1183f0a tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:07.723130 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4b639283-c2f6-4d00-acda-3b8eb1183f0a tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:07.723764 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4b639283-c2f6-4d00-acda-3b8eb1183f0a tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:07.724349 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4b639283-c2f6-4d00-acda-3b8eb1183f0a tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:07.782777 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4b639283-c2f6-4d00-acda-3b8eb1183f0a tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565/os-volume_attachments/c6b8e23f-99ea-4dd0-883d-a74eeaf6b89b" status: 200 len: 194 microversion: 2.20 time: 0.086744 Oct 17 14:04:07.784081 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2721/5308] 10.222.0.79 () {60 vars in 1454 bytes} [Mon Oct 17 14:04:07 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565/os-volume_attachments/c6b8e23f-99ea-4dd0-883d-a74eeaf6b89b => generated 194 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 14:04:07.905516 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6b25a89f-930c-47da-b4f7-a87d7cf6f523 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:07.906439 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6b25a89f-930c-47da-b4f7-a87d7cf6f523 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:07.921165 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6b25a89f-930c-47da-b4f7-a87d7cf6f523 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:07.921909 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6b25a89f-930c-47da-b4f7-a87d7cf6f523 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:07.922514 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6b25a89f-930c-47da-b4f7-a87d7cf6f523 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:07.924294 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6b25a89f-930c-47da-b4f7-a87d7cf6f523 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:07.926999 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6b25a89f-930c-47da-b4f7-a87d7cf6f523 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:07.932419 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6b25a89f-930c-47da-b4f7-a87d7cf6f523 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:08.187885 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b0949049-ef99-44c8-9e17-e71c9547987f tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] 10.222.0.79 "POST /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd/action" status: 202 len: 0 microversion: 2.1 time: 3.305708 Oct 17 14:04:08.194375 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2588/5309] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:04:04 2022] POST /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd/action => generated 0 bytes in 3310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:04:08.194832 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-6b25a89f-930c-47da-b4f7-a87d7cf6f523 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lazy-loading 'services' on Instance uuid 86508a39-65fa-4421-b31d-ffbc5fdee565 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:04:08.200390 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7f99c75e-7e44-4809-9e5f-3cf6d98d4b14 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Action: 'create', calling method: .version_select at 0x7f7cd55e6700>, body: {"pool": null} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:04:08.434383 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6b25a89f-930c-47da-b4f7-a87d7cf6f523 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "DELETE /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565/os-volume_attachments/c6b8e23f-99ea-4dd0-883d-a74eeaf6b89b" status: 202 len: 0 microversion: 2.20 time: 0.533376 Oct 17 14:04:08.479388 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2722/5310] 10.222.0.79 () {60 vars in 1457 bytes} [Mon Oct 17 14:04:07 2022] DELETE /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565/os-volume_attachments/c6b8e23f-99ea-4dd0-883d-a74eeaf6b89b => generated 0 bytes in 563 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 17 14:04:08.515215 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-f34ff0bd-f1fd-4029-b9fd-6732716e193f req-59534cc9-69c5-4256-b6f2-8e96987662c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c1e7d15-aff1-4439-be8c-af4e87a53fdd", "tag": "005c8f89-113c-42e8-b0c0-99f7c47dc5d9"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:04:08.574119 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-f34ff0bd-f1fd-4029-b9fd-6732716e193f req-59534cc9-69c5-4256-b6f2-8e96987662c3 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:08.579228 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-f34ff0bd-f1fd-4029-b9fd-6732716e193f req-59534cc9-69c5-4256-b6f2-8e96987662c3 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:08.582345 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-f34ff0bd-f1fd-4029-b9fd-6732716e193f req-59534cc9-69c5-4256-b6f2-8e96987662c3 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:08.617562 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-f34ff0bd-f1fd-4029-b9fd-6732716e193f req-59534cc9-69c5-4256-b6f2-8e96987662c3 service nova] Creating event network-changed:005c8f89-113c-42e8-b0c0-99f7c47dc5d9 for instance 5c1e7d15-aff1-4439-be8c-af4e87a53fdd on n-h2-854247-14 Oct 17 14:04:08.632673 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-f34ff0bd-f1fd-4029-b9fd-6732716e193f req-59534cc9-69c5-4256-b6f2-8e96987662c3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149375 Oct 17 14:04:08.633667 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2723/5311] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:04:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:04:08.680373 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-073ea2cb-0905-4356-8800-ca795996bee5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:08.709155 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-073ea2cb-0905-4356-8800-ca795996bee5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:08.740945 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-073ea2cb-0905-4356-8800-ca795996bee5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:08.741440 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-073ea2cb-0905-4356-8800-ca795996bee5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:08.745913 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-073ea2cb-0905-4356-8800-ca795996bee5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:08.747309 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-073ea2cb-0905-4356-8800-ca795996bee5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:08.753842 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-073ea2cb-0905-4356-8800-ca795996bee5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:08.758755 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-073ea2cb-0905-4356-8800-ca795996bee5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:08.934121 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-073ea2cb-0905-4356-8800-ca795996bee5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.298862 Oct 17 14:04:08.944597 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2724/5312] 10.222.0.79 () {60 vars in 1343 bytes} [Mon Oct 17 14:04:08 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565/os-volume_attachments => generated 197 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:04:09.952352 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8001f502-8d27-448d-bdf8-0dc14b57352b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:09.955333 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8001f502-8d27-448d-bdf8-0dc14b57352b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:09.975906 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8001f502-8d27-448d-bdf8-0dc14b57352b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:09.977908 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8001f502-8d27-448d-bdf8-0dc14b57352b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:09.979443 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8001f502-8d27-448d-bdf8-0dc14b57352b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:09.991647 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8001f502-8d27-448d-bdf8-0dc14b57352b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:09.993752 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8001f502-8d27-448d-bdf8-0dc14b57352b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:09.997857 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8001f502-8d27-448d-bdf8-0dc14b57352b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:10.132460 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8001f502-8d27-448d-bdf8-0dc14b57352b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.184442 Oct 17 14:04:10.133589 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2725/5313] 10.222.0.79 () {60 vars in 1343 bytes} [Mon Oct 17 14:04:09 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565/os-volume_attachments => generated 197 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 14:04:11.146422 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-15db20de-269a-4077-985d-6ff5beb975dc tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:11.149547 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-15db20de-269a-4077-985d-6ff5beb975dc tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:11.165461 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-15db20de-269a-4077-985d-6ff5beb975dc tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:11.172261 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-15db20de-269a-4077-985d-6ff5beb975dc tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:11.172988 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-15db20de-269a-4077-985d-6ff5beb975dc tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:11.173519 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-15db20de-269a-4077-985d-6ff5beb975dc tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:11.173975 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-15db20de-269a-4077-985d-6ff5beb975dc tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:11.178325 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-15db20de-269a-4077-985d-6ff5beb975dc tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:11.332913 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-15db20de-269a-4077-985d-6ff5beb975dc tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.191531 Oct 17 14:04:11.334780 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2726/5314] 10.222.0.79 () {60 vars in 1343 bytes} [Mon Oct 17 14:04:11 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565/os-volume_attachments => generated 197 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:04:12.348991 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9f615aa5-b79a-4e9b-ba54-8cb502141857 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:12.351374 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9f615aa5-b79a-4e9b-ba54-8cb502141857 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:12.363407 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=30 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:04:12.368584 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9f615aa5-b79a-4e9b-ba54-8cb502141857 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:12.369186 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9f615aa5-b79a-4e9b-ba54-8cb502141857 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:12.369624 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9f615aa5-b79a-4e9b-ba54-8cb502141857 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:12.371755 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9f615aa5-b79a-4e9b-ba54-8cb502141857 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:12.375755 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9f615aa5-b79a-4e9b-ba54-8cb502141857 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:12.377216 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9f615aa5-b79a-4e9b-ba54-8cb502141857 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:12.390730 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:04:12.462583 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9f615aa5-b79a-4e9b-ba54-8cb502141857 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.117834 Oct 17 14:04:12.469457 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2727/5315] 10.222.0.79 () {60 vars in 1343 bytes} [Mon Oct 17 14:04:12 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:04:13.475670 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f8110513-2097-44f7-9d7f-197b0c141195 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:13.478738 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f8110513-2097-44f7-9d7f-197b0c141195 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:13.489254 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f8110513-2097-44f7-9d7f-197b0c141195 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:13.489748 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f8110513-2097-44f7-9d7f-197b0c141195 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:13.490190 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f8110513-2097-44f7-9d7f-197b0c141195 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:13.490900 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f8110513-2097-44f7-9d7f-197b0c141195 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:13.491385 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f8110513-2097-44f7-9d7f-197b0c141195 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:13.491809 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f8110513-2097-44f7-9d7f-197b0c141195 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:13.566203 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f8110513-2097-44f7-9d7f-197b0c141195 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.094621 Oct 17 14:04:13.566821 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2728/5316] 10.222.0.79 () {60 vars in 1343 bytes} [Mon Oct 17 14:04:13 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 14:04:14.579438 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6e3f5237-b86a-4f38-9d39-d0e508ec2589 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:14.582686 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6e3f5237-b86a-4f38-9d39-d0e508ec2589 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:14.617986 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6e3f5237-b86a-4f38-9d39-d0e508ec2589 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:14.618686 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6e3f5237-b86a-4f38-9d39-d0e508ec2589 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:14.619329 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6e3f5237-b86a-4f38-9d39-d0e508ec2589 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:14.621630 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6e3f5237-b86a-4f38-9d39-d0e508ec2589 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:14.624434 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6e3f5237-b86a-4f38-9d39-d0e508ec2589 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:14.627110 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6e3f5237-b86a-4f38-9d39-d0e508ec2589 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:14.793019 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6e3f5237-b86a-4f38-9d39-d0e508ec2589 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.218712 Oct 17 14:04:14.794343 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2729/5317] 10.222.0.79 () {60 vars in 1343 bytes} [Mon Oct 17 14:04:14 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565/os-volume_attachments => generated 197 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 14:04:14.901031 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=5 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:04:15.020528 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=39 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:04:15.806865 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7a6f211d-9d91-44c4-984b-347679f5f448 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:15.815586 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7a6f211d-9d91-44c4-984b-347679f5f448 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:15.837920 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7a6f211d-9d91-44c4-984b-347679f5f448 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:15.838414 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7a6f211d-9d91-44c4-984b-347679f5f448 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:15.838844 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7a6f211d-9d91-44c4-984b-347679f5f448 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:15.843766 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7a6f211d-9d91-44c4-984b-347679f5f448 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:15.844948 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7a6f211d-9d91-44c4-984b-347679f5f448 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:15.845537 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7a6f211d-9d91-44c4-984b-347679f5f448 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:15.933193 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7a6f211d-9d91-44c4-984b-347679f5f448 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.115510 Oct 17 14:04:15.934529 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2730/5318] 10.222.0.79 () {60 vars in 1343 bytes} [Mon Oct 17 14:04:15 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:04:16.658350 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7f99c75e-7e44-4809-9e5f-3cf6d98d4b14 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] 10.222.0.79 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 8.462067 Oct 17 14:04:16.660027 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2589/5319] 10.222.0.79 () {60 vars in 1170 bytes} [Mon Oct 17 14:04:08 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 8465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:04:16.672971 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a381e0d5-13e6-46ce-a995-f6d517a1f73e tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.0.153"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:04:16.676933 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a381e0d5-13e6-46ce-a995-f6d517a1f73e tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] [instance: 5c1e7d15-aff1-4439-be8c-af4e87a53fdd] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:16.697564 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a381e0d5-13e6-46ce-a995-f6d517a1f73e tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:16.704694 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a381e0d5-13e6-46ce-a995-f6d517a1f73e tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:16.706040 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a381e0d5-13e6-46ce-a995-f6d517a1f73e tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:16.708527 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a381e0d5-13e6-46ce-a995-f6d517a1f73e tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:16.710329 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a381e0d5-13e6-46ce-a995-f6d517a1f73e tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:16.714801 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a381e0d5-13e6-46ce-a995-f6d517a1f73e tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:16.819574 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a381e0d5-13e6-46ce-a995-f6d517a1f73e tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "refresh_cache-5c1e7d15-aff1-4439-be8c-af4e87a53fdd" {{(pid=127016) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 17 14:04:16.821936 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a381e0d5-13e6-46ce-a995-f6d517a1f73e tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquired lock "refresh_cache-5c1e7d15-aff1-4439-be8c-af4e87a53fdd" {{(pid=127016) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 17 14:04:16.956525 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ff149b39-e813-4956-a98d-1c7ac198c267 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:16.959533 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ff149b39-e813-4956-a98d-1c7ac198c267 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:16.986262 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ff149b39-e813-4956-a98d-1c7ac198c267 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:16.987925 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ff149b39-e813-4956-a98d-1c7ac198c267 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:16.988449 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ff149b39-e813-4956-a98d-1c7ac198c267 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:16.990744 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ff149b39-e813-4956-a98d-1c7ac198c267 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:16.991301 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ff149b39-e813-4956-a98d-1c7ac198c267 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:16.991742 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ff149b39-e813-4956-a98d-1c7ac198c267 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:17.083347 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ff149b39-e813-4956-a98d-1c7ac198c267 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.137889 Oct 17 14:04:17.085134 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2590/5320] 10.222.0.79 () {60 vars in 1343 bytes} [Mon Oct 17 14:04:16 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:04:18.100008 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bb702e48-9802-4b83-9ff2-ad3baaee7a57 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:18.131881 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-bb702e48-9802-4b83-9ff2-ad3baaee7a57 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:18.141111 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bb702e48-9802-4b83-9ff2-ad3baaee7a57 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:18.143807 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bb702e48-9802-4b83-9ff2-ad3baaee7a57 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:18.144443 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bb702e48-9802-4b83-9ff2-ad3baaee7a57 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:18.147251 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bb702e48-9802-4b83-9ff2-ad3baaee7a57 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:18.147891 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bb702e48-9802-4b83-9ff2-ad3baaee7a57 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:18.148496 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bb702e48-9802-4b83-9ff2-ad3baaee7a57 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:18.213563 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-bb702e48-9802-4b83-9ff2-ad3baaee7a57 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.121138 Oct 17 14:04:18.221190 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2591/5321] 10.222.0.79 () {60 vars in 1343 bytes} [Mon Oct 17 14:04:18 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 14:04:19.246092 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-26c18787-3e1f-4b38-b0cf-21c1401529ed tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:19.249867 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-26c18787-3e1f-4b38-b0cf-21c1401529ed tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:19.287386 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-26c18787-3e1f-4b38-b0cf-21c1401529ed tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:19.290532 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-26c18787-3e1f-4b38-b0cf-21c1401529ed tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:19.291047 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-26c18787-3e1f-4b38-b0cf-21c1401529ed tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:19.295241 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-26c18787-3e1f-4b38-b0cf-21c1401529ed tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:19.296514 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-26c18787-3e1f-4b38-b0cf-21c1401529ed tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:19.299036 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-26c18787-3e1f-4b38-b0cf-21c1401529ed tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:19.376753 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-26c18787-3e1f-4b38-b0cf-21c1401529ed tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.143598 Oct 17 14:04:19.377364 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2592/5322] 10.222.0.79 () {60 vars in 1343 bytes} [Mon Oct 17 14:04:19 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565/os-volume_attachments => generated 25 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:04:19.476470 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-97d0387b-93b1-4642-b62b-c6cb148dbd73 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:19.477305 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-97d0387b-93b1-4642-b62b-c6cb148dbd73 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:19.487014 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-97d0387b-93b1-4642-b62b-c6cb148dbd73 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:19.488281 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-97d0387b-93b1-4642-b62b-c6cb148dbd73 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:19.495045 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-97d0387b-93b1-4642-b62b-c6cb148dbd73 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:19.496349 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-97d0387b-93b1-4642-b62b-c6cb148dbd73 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:19.497353 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-97d0387b-93b1-4642-b62b-c6cb148dbd73 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:19.498863 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-97d0387b-93b1-4642-b62b-c6cb148dbd73 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:19.590739 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-97d0387b-93b1-4642-b62b-c6cb148dbd73 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:04:19.784040 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-97d0387b-93b1-4642-b62b-c6cb148dbd73 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "DELETE /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 204 len: 0 microversion: 2.20 time: 0.312791 Oct 17 14:04:19.792249 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2593/5323] 10.222.0.79 () {60 vars in 1280 bytes} [Mon Oct 17 14:04:19 2022] DELETE /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 17 14:04:19.801517 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b63ab050-ac95-4fa3-b1d3-d6185af766bc tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:19.802346 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b63ab050-ac95-4fa3-b1d3-d6185af766bc tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:19.820312 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b63ab050-ac95-4fa3-b1d3-d6185af766bc tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:19.820959 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b63ab050-ac95-4fa3-b1d3-d6185af766bc tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:19.821444 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b63ab050-ac95-4fa3-b1d3-d6185af766bc tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:19.822169 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b63ab050-ac95-4fa3-b1d3-d6185af766bc tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:19.822694 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b63ab050-ac95-4fa3-b1d3-d6185af766bc tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:19.823159 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b63ab050-ac95-4fa3-b1d3-d6185af766bc tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:20.339571 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b63ab050-ac95-4fa3-b1d3-d6185af766bc tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:20.355600 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b63ab050-ac95-4fa3-b1d3-d6185af766bc tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:20.363885 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b63ab050-ac95-4fa3-b1d3-d6185af766bc tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:20.374446 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b63ab050-ac95-4fa3-b1d3-d6185af766bc tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1723 microversion: 2.20 time: 0.578682 Oct 17 14:04:20.377513 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2594/5324] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:04:19 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1723 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:04:21.406886 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c2e0acfb-b7dd-4683-97d9-4690ee700650 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:21.407835 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c2e0acfb-b7dd-4683-97d9-4690ee700650 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:21.408603 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-a381e0d5-13e6-46ce-a995-f6d517a1f73e tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] [instance: 5c1e7d15-aff1-4439-be8c-af4e87a53fdd] Building network info cache for instance {{(pid=127016) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 17 14:04:21.425272 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c2e0acfb-b7dd-4683-97d9-4690ee700650 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:21.425777 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c2e0acfb-b7dd-4683-97d9-4690ee700650 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:21.431300 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c2e0acfb-b7dd-4683-97d9-4690ee700650 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:21.435443 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c2e0acfb-b7dd-4683-97d9-4690ee700650 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:21.438996 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c2e0acfb-b7dd-4683-97d9-4690ee700650 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:21.439566 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c2e0acfb-b7dd-4683-97d9-4690ee700650 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:22.246197 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c2e0acfb-b7dd-4683-97d9-4690ee700650 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:22.257001 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c2e0acfb-b7dd-4683-97d9-4690ee700650 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:22.269825 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c2e0acfb-b7dd-4683-97d9-4690ee700650 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:22.271093 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c2e0acfb-b7dd-4683-97d9-4690ee700650 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1723 microversion: 2.20 time: 0.872848 Oct 17 14:04:22.284249 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2595/5325] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:04:21 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1723 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:04:22.298833 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-b3cf56f5-bd2e-47d4-ae8a-537edf520a99 req-34396a92-e8c9-4a18-81e9-c5a534a0a0c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c1e7d15-aff1-4439-be8c-af4e87a53fdd", "tag": "005c8f89-113c-42e8-b0c0-99f7c47dc5d9"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:04:22.330065 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-b3cf56f5-bd2e-47d4-ae8a-537edf520a99 req-34396a92-e8c9-4a18-81e9-c5a534a0a0c4 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:22.330977 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-b3cf56f5-bd2e-47d4-ae8a-537edf520a99 req-34396a92-e8c9-4a18-81e9-c5a534a0a0c4 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:22.331805 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-b3cf56f5-bd2e-47d4-ae8a-537edf520a99 req-34396a92-e8c9-4a18-81e9-c5a534a0a0c4 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:22.367657 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-b3cf56f5-bd2e-47d4-ae8a-537edf520a99 req-34396a92-e8c9-4a18-81e9-c5a534a0a0c4 service nova] Creating event network-changed:005c8f89-113c-42e8-b0c0-99f7c47dc5d9 for instance 5c1e7d15-aff1-4439-be8c-af4e87a53fdd on n-h2-854247-14 Oct 17 14:04:22.377518 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-b3cf56f5-bd2e-47d4-ae8a-537edf520a99 req-34396a92-e8c9-4a18-81e9-c5a534a0a0c4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091948 Oct 17 14:04:22.378150 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2596/5326] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:04:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:04:23.324426 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d87131a3-9cd5-4e5b-b90f-49f1dab15644 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:23.326255 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d87131a3-9cd5-4e5b-b90f-49f1dab15644 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:23.335070 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d87131a3-9cd5-4e5b-b90f-49f1dab15644 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:23.335756 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d87131a3-9cd5-4e5b-b90f-49f1dab15644 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:23.336371 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d87131a3-9cd5-4e5b-b90f-49f1dab15644 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:23.337241 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d87131a3-9cd5-4e5b-b90f-49f1dab15644 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:23.337843 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d87131a3-9cd5-4e5b-b90f-49f1dab15644 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:23.338450 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d87131a3-9cd5-4e5b-b90f-49f1dab15644 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:25.049030 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-a381e0d5-13e6-46ce-a995-f6d517a1f73e tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] [instance: 5c1e7d15-aff1-4439-be8c-af4e87a53fdd] Updating instance_info_cache with network_info: [{"id": "005c8f89-113c-42e8-b0c0-99f7c47dc5d9", "address": "fa:16:3e:e2:8f:fa", "network": {"id": "8db88382-ec3d-4ebe-95fb-75ecb94d2fce", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1879028774-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.0.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "0e4c1113905449dfaa64b18199faa2ad", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap005c8f89-11", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127016) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 17 14:04:25.073094 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d87131a3-9cd5-4e5b-b90f-49f1dab15644 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:25.078069 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a381e0d5-13e6-46ce-a995-f6d517a1f73e tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Releasing lock "refresh_cache-5c1e7d15-aff1-4439-be8c-af4e87a53fdd" {{(pid=127016) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 17 14:04:25.080605 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a381e0d5-13e6-46ce-a995-f6d517a1f73e tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] 10.222.0.79 "POST /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd/action" status: 202 len: 0 microversion: 2.1 time: 8.412253 Oct 17 14:04:25.081599 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2731/5327] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:04:16 2022] POST /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd/action => generated 0 bytes in 8414 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 17 14:04:25.097852 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4f31e434-56fa-4fde-83a4-099359238349 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.0.153"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:04:25.107646 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d87131a3-9cd5-4e5b-b90f-49f1dab15644 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:25.116682 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d87131a3-9cd5-4e5b-b90f-49f1dab15644 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:25.129462 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d87131a3-9cd5-4e5b-b90f-49f1dab15644 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1723 microversion: 2.20 time: 1.814300 Oct 17 14:04:25.144536 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2597/5328] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:04:23 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1723 bytes in 1849 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:04:26.161639 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-da3e47ef-ebf8-45f6-8150-652a8a2c348c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:26.162571 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-da3e47ef-ebf8-45f6-8150-652a8a2c348c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:26.175933 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-da3e47ef-ebf8-45f6-8150-652a8a2c348c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:26.176420 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-da3e47ef-ebf8-45f6-8150-652a8a2c348c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:26.176857 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-da3e47ef-ebf8-45f6-8150-652a8a2c348c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:26.180089 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-da3e47ef-ebf8-45f6-8150-652a8a2c348c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:26.180554 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-da3e47ef-ebf8-45f6-8150-652a8a2c348c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:26.180993 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-da3e47ef-ebf8-45f6-8150-652a8a2c348c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:26.679072 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-da3e47ef-ebf8-45f6-8150-652a8a2c348c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:26.685366 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=9 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:04:26.700035 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-da3e47ef-ebf8-45f6-8150-652a8a2c348c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:26.702675 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-da3e47ef-ebf8-45f6-8150-652a8a2c348c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:26.704188 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-da3e47ef-ebf8-45f6-8150-652a8a2c348c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1655 microversion: 2.20 time: 0.548092 Oct 17 14:04:26.719297 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2598/5329] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:04:26 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1655 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:04:26.840147 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4f31e434-56fa-4fde-83a4-099359238349 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] [instance: 5c1e7d15-aff1-4439-be8c-af4e87a53fdd] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:26.847329 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4f31e434-56fa-4fde-83a4-099359238349 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:26.847973 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4f31e434-56fa-4fde-83a4-099359238349 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:26.848532 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4f31e434-56fa-4fde-83a4-099359238349 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:26.853273 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4f31e434-56fa-4fde-83a4-099359238349 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:26.855796 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4f31e434-56fa-4fde-83a4-099359238349 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:26.856418 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4f31e434-56fa-4fde-83a4-099359238349 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:27.718691 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4f31e434-56fa-4fde-83a4-099359238349 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "refresh_cache-5c1e7d15-aff1-4439-be8c-af4e87a53fdd" {{(pid=127016) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 17 14:04:27.719819 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4f31e434-56fa-4fde-83a4-099359238349 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquired lock "refresh_cache-5c1e7d15-aff1-4439-be8c-af4e87a53fdd" {{(pid=127016) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 17 14:04:27.742362 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-096d8258-1918-4411-9f2a-dbe0a0720b63 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:27.742951 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-096d8258-1918-4411-9f2a-dbe0a0720b63 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:27.776364 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-096d8258-1918-4411-9f2a-dbe0a0720b63 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:27.777295 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-096d8258-1918-4411-9f2a-dbe0a0720b63 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:27.780761 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-096d8258-1918-4411-9f2a-dbe0a0720b63 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:27.781776 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-096d8258-1918-4411-9f2a-dbe0a0720b63 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:27.782412 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-096d8258-1918-4411-9f2a-dbe0a0720b63 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:27.786621 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-096d8258-1918-4411-9f2a-dbe0a0720b63 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:28.683106 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-096d8258-1918-4411-9f2a-dbe0a0720b63 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:28.751699 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-096d8258-1918-4411-9f2a-dbe0a0720b63 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:28.756104 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-096d8258-1918-4411-9f2a-dbe0a0720b63 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:28.760554 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-096d8258-1918-4411-9f2a-dbe0a0720b63 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 200 len: 1655 microversion: 2.20 time: 1.028654 Oct 17 14:04:28.766089 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2599/5330] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:04:27 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 1655 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:04:29.162863 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-c13277f1-7307-4243-b9b7-9f934472a501 req-d8a22ccd-b6f9-43de-bffb-6a80a30928c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86508a39-65fa-4421-b31d-ffbc5fdee565", "name": "network-vif-deleted", "tag": "be2d42c9-97a7-4933-9200-d27f76f73a39"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:04:29.200035 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-c13277f1-7307-4243-b9b7-9f934472a501 req-d8a22ccd-b6f9-43de-bffb-6a80a30928c5 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:29.203679 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-c13277f1-7307-4243-b9b7-9f934472a501 req-d8a22ccd-b6f9-43de-bffb-6a80a30928c5 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:29.204142 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-c13277f1-7307-4243-b9b7-9f934472a501 req-d8a22ccd-b6f9-43de-bffb-6a80a30928c5 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:29.249459 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-c13277f1-7307-4243-b9b7-9f934472a501 req-d8a22ccd-b6f9-43de-bffb-6a80a30928c5 service nova] Creating event network-vif-deleted:be2d42c9-97a7-4933-9200-d27f76f73a39 for instance 86508a39-65fa-4421-b31d-ffbc5fdee565 on n-h1-854247-14 Oct 17 14:04:29.260813 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-c13277f1-7307-4243-b9b7-9f934472a501 req-d8a22ccd-b6f9-43de-bffb-6a80a30928c5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.493147 Oct 17 14:04:29.263987 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2600/5331] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:04:29.795707 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2457982b-6c2f-443a-ad34-ddfd34c75bac tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:29.796373 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2457982b-6c2f-443a-ad34-ddfd34c75bac tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:29.810373 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2457982b-6c2f-443a-ad34-ddfd34c75bac tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:29.813910 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2457982b-6c2f-443a-ad34-ddfd34c75bac tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:29.814338 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2457982b-6c2f-443a-ad34-ddfd34c75bac tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:29.824516 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2457982b-6c2f-443a-ad34-ddfd34c75bac tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:29.829075 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2457982b-6c2f-443a-ad34-ddfd34c75bac tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:29.829611 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2457982b-6c2f-443a-ad34-ddfd34c75bac tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:29.886513 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-2457982b-6c2f-443a-ad34-ddfd34c75bac tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] HTTP exception thrown: Instance 86508a39-65fa-4421-b31d-ffbc5fdee565 could not be found. Oct 17 14:04:29.899420 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2457982b-6c2f-443a-ad34-ddfd34c75bac tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Request method failure captured: Oct 17 14:04:29.899420 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 HTTP/1.1 Oct 17 14:04:29.899420 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 14:04:29.899420 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 14:04:29.899420 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 14:04:29.899420 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 14:04:29.899420 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 14:04:29.899420 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 14:04:29.899420 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 14:04:29.899420 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 14:04:29.899420 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTWAO_VmGva_BBT15wpCNnvALuvGOjT_SoMW3_Vm1bhAQtak3XB07mRAdCJ_wnCBHoN-a-s8oUf5FPUuQgdWnRliezSs4oZuT0viWVzkCyaLn2Yap1hTnnKbQ24FaQvsntpgmAcOy_-tJg5P1ZlCE29U0SXLNIrlJqLSqx_JACEZ6IFs Oct 17 14:04:29.899420 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 14:04:29.899420 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 14:04:29.899420 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 14:04:29.899420 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 14:04:29.899420 n-d-854247-14 devstack@n-api.service[127017]: X-Openstack-Nova-Api-Version: 2.20 Oct 17 14:04:29.899420 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 14:04:29.899420 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 14:04:29.899420 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 6dcc0bf813dc4a4fa2fd7d6f5521ae85 Oct 17 14:04:29.899420 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1066178867 Oct 17 14:04:29.899420 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 14:04:29.899420 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 14:04:29.899420 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6dcc0bf813dc4a4fa2fd7d6f5521ae85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6dcc0bf813dc4a4fa2fd7d6f5521ae85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6dcc0bf813dc4a4fa2fd7d6f5521ae85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6dcc0bf813dc4a4fa2fd7d6f5521ae85", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:04:29.899420 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1066178867 Oct 17 14:04:29.899420 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 6dcc0bf813dc4a4fa2fd7d6f5521ae85 Oct 17 14:04:29.899420 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1066178867 Oct 17 14:04:29.899420 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-AttachVolumeShelveTestJSON-1066178867-project Oct 17 14:04:29.899420 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 14:04:29.899420 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 14:04:29.899420 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 9c7ac3dcc4ff4dd2bb68738c72e9507f Oct 17 14:04:29.899420 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1066178867-project Oct 17 14:04:29.899420 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 14:04:29.899420 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 86508a39-65fa-4421-b31d-ffbc5fdee565 could not be found. Oct 17 14:04:29.899420 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '86508a39-65fa-4421-b31d-ffbc5fdee565'} Oct 17 14:04:29.899420 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:04:29.899420 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:04:29.899420 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:04:29.899420 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:04:29.899420 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:04:29.899420 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:04:29.899420 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:04:29.899420 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:04:29.899420 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:04:29.899420 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:04:29.899420 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86508a39-65fa-4421-b31d-ffbc5fdee565 could not be found. Oct 17 14:04:29.899420 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:04:29.899420 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:04:29.899420 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:04:29.899420 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:04:29.899420 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:04:29.899420 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:04:29.899420 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:04:29.899420 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:04:29.899420 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:04:29.899420 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:04:29.899420 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:04:29.899420 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:04:29.899420 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:04:29.899420 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:04:29.899420 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:04:29.899420 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:04:29.899420 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86508a39-65fa-4421-b31d-ffbc5fdee565 could not be found. Oct 17 14:04:29.899420 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:04:29.899420 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:04:29.905386 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:04:29.905386 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:04:29.905386 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:04:29.905386 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:04:29.905386 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:04:29.905386 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:04:29.905386 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86508a39-65fa-4421-b31d-ffbc5fdee565 could not be found. Oct 17 14:04:29.905386 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:04:29.906107 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2457982b-6c2f-443a-ad34-ddfd34c75bac tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Returning 404 to user: Instance 86508a39-65fa-4421-b31d-ffbc5fdee565 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:04:29.906800 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2457982b-6c2f-443a-ad34-ddfd34c75bac tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 404 len: 111 microversion: 2.20 time: 0.116235 Oct 17 14:04:29.907813 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2601/5332] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:04:29 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 17 14:04:29.913753 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-4f31e434-56fa-4fde-83a4-099359238349 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] [instance: 5c1e7d15-aff1-4439-be8c-af4e87a53fdd] Building network info cache for instance {{(pid=127016) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 17 14:04:29.941258 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d0736234-133b-4b0a-b1f8-f49b8f0e2697 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '.version_select at 0x7f7cd55d9790>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:29.980699 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d0736234-133b-4b0a-b1f8-f49b8f0e2697 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-516393464" status: 204 len: 0 microversion: 2.20 time: 0.056531 Oct 17 14:04:29.982384 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2602/5333] 10.222.0.79 () {60 vars in 1259 bytes} [Mon Oct 17 14:04:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-516393464 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 14:04:31.364039 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-7651be6c-cf79-46f0-896f-15888f69b069 req-da8e9d41-4cff-4545-aad6-8f326ea313c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c1e7d15-aff1-4439-be8c-af4e87a53fdd", "tag": "005c8f89-113c-42e8-b0c0-99f7c47dc5d9"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:04:31.382055 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-7651be6c-cf79-46f0-896f-15888f69b069 req-da8e9d41-4cff-4545-aad6-8f326ea313c8 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:31.382533 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-7651be6c-cf79-46f0-896f-15888f69b069 req-da8e9d41-4cff-4545-aad6-8f326ea313c8 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:31.382971 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-7651be6c-cf79-46f0-896f-15888f69b069 req-da8e9d41-4cff-4545-aad6-8f326ea313c8 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:31.404067 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-7651be6c-cf79-46f0-896f-15888f69b069 req-da8e9d41-4cff-4545-aad6-8f326ea313c8 service nova] Creating event network-changed:005c8f89-113c-42e8-b0c0-99f7c47dc5d9 for instance 5c1e7d15-aff1-4439-be8c-af4e87a53fdd on n-h2-854247-14 Oct 17 14:04:31.412601 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-7651be6c-cf79-46f0-896f-15888f69b069 req-da8e9d41-4cff-4545-aad6-8f326ea313c8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056094 Oct 17 14:04:31.416190 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2603/5334] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:04:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:04:31.727326 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-4f31e434-56fa-4fde-83a4-099359238349 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] [instance: 5c1e7d15-aff1-4439-be8c-af4e87a53fdd] Updating instance_info_cache with network_info: [{"id": "005c8f89-113c-42e8-b0c0-99f7c47dc5d9", "address": "fa:16:3e:e2:8f:fa", "network": {"id": "8db88382-ec3d-4ebe-95fb-75ecb94d2fce", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1879028774-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "0e4c1113905449dfaa64b18199faa2ad", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap005c8f89-11", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127016) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 17 14:04:31.751518 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4f31e434-56fa-4fde-83a4-099359238349 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Releasing lock "refresh_cache-5c1e7d15-aff1-4439-be8c-af4e87a53fdd" {{(pid=127016) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 17 14:04:31.752481 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4f31e434-56fa-4fde-83a4-099359238349 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] 10.222.0.79 "POST /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd/action" status: 202 len: 0 microversion: 2.1 time: 6.666538 Oct 17 14:04:31.756722 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2732/5335] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:04:25 2022] POST /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd/action => generated 0 bytes in 6668 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 17 14:04:31.763628 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-50b05170-39fe-4d36-8f09-17a31380e36b tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Calling method '.version_select at 0x7f7cd57820d0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:33.919515 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-de48cff9-7db1-4e34-97dd-81a449a2b94f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Action: 'create', calling method: .version_select at 0x7f7cd442d1f0>, body: {"keypair": {"name": "tempest-keypair-96458282", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbK9QoHReDNFSXZcbBcLDoy2j0OdcVCz7QdChCpi3M5q2JNTgvvtKt4l56XCvQ2uMNeZdU2n5aa5aZX/T4BZKcQpN6lHLCg8ElyH1s1McZqdUgT8pvvic49Ff+Z9Ojo9Q=="}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:04:33.990476 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-de48cff9-7db1-4e34-97dd-81a449a2b94f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Getting quotas for project 6dcc0bf813dc4a4fa2fd7d6f5521ae85. Resources: {'key_pairs'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:04:34.003722 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-de48cff9-7db1-4e34-97dd-81a449a2b94f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Getting quotas for user 9c7ac3dcc4ff4dd2bb68738c72e9507f and project 6dcc0bf813dc4a4fa2fd7d6f5521ae85. Resources: {'key_pairs'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:04:34.037235 n-d-854247-14 devstack@n-api.service[127016]: ERROR oslo.messaging._drivers.impl_rabbit [None req-de48cff9-7db1-4e34-97dd-81a449a2b94f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [86e7bf53-9882-42fa-9edd-bee9c5320b1e] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 14:04:35.047603 n-d-854247-14 devstack@n-api.service[127016]: INFO oslo.messaging._drivers.impl_rabbit [None req-de48cff9-7db1-4e34-97dd-81a449a2b94f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [86e7bf53-9882-42fa-9edd-bee9c5320b1e] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 35958. Oct 17 14:04:35.087684 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-de48cff9-7db1-4e34-97dd-81a449a2b94f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 1.170660 Oct 17 14:04:35.092481 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2733/5336] 10.222.0.79 () {62 vars in 1200 bytes} [Mon Oct 17 14:04:33 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 1182 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 17 14:04:35.954739 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-50b05170-39fe-4d36-8f09-17a31380e36b tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] 10.222.0.79 "DELETE /compute/v2.1/os-floating-ips/81ff0328-e15a-4551-a872-9fa0b184418e" status: 202 len: 0 microversion: 2.1 time: 4.196279 Oct 17 14:04:35.957026 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2604/5337] 10.222.0.79 () {58 vars in 1263 bytes} [Mon Oct 17 14:04:31 2022] DELETE /compute/v2.1/os-floating-ips/81ff0328-e15a-4551-a872-9fa0b184418e => generated 0 bytes in 4199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:04:35.966885 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-72bffc18-790c-4872-9a34-2d1e4d6c3af9 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Calling method '.version_select at 0x7f7cd449c8b0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:36.572229 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-72bffc18-790c-4872-9a34-2d1e4d6c3af9 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] 10.222.0.79 "DELETE /compute/v2.1/os-security-groups/8eb0c435-da40-4190-b586-8a6f631ac3a0" status: 202 len: 0 microversion: 2.1 time: 0.605911 Oct 17 14:04:36.573370 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2734/5338] 10.222.0.79 () {58 vars in 1272 bytes} [Mon Oct 17 14:04:35 2022] DELETE /compute/v2.1/os-security-groups/8eb0c435-da40-4190-b586-8a6f631ac3a0 => generated 0 bytes in 612 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:04:36.583049 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-649bd8f9-5f2b-4753-ad5f-7c2a8b3c9454 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:36.583845 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-649bd8f9-5f2b-4753-ad5f-7c2a8b3c9454 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] [instance: 5c1e7d15-aff1-4439-be8c-af4e87a53fdd] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:36.595723 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-649bd8f9-5f2b-4753-ad5f-7c2a8b3c9454 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:36.598310 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-649bd8f9-5f2b-4753-ad5f-7c2a8b3c9454 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:36.598874 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-649bd8f9-5f2b-4753-ad5f-7c2a8b3c9454 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:36.601215 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-649bd8f9-5f2b-4753-ad5f-7c2a8b3c9454 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:36.602026 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-649bd8f9-5f2b-4753-ad5f-7c2a8b3c9454 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:36.603665 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-649bd8f9-5f2b-4753-ad5f-7c2a8b3c9454 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:36.674193 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-649bd8f9-5f2b-4753-ad5f-7c2a8b3c9454 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] [instance: 5c1e7d15-aff1-4439-be8c-af4e87a53fdd] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:04:36.883654 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-649bd8f9-5f2b-4753-ad5f-7c2a8b3c9454 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] 10.222.0.79 "DELETE /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd" status: 204 len: 0 microversion: 2.1 time: 0.304828 Oct 17 14:04:36.884561 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2605/5339] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:04:36 2022] DELETE /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:04:36.900534 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6c8f401a-61af-4e97-80c5-c59c3c6136d1 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:36.901168 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6c8f401a-61af-4e97-80c5-c59c3c6136d1 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] [instance: 5c1e7d15-aff1-4439-be8c-af4e87a53fdd] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:36.917060 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6c8f401a-61af-4e97-80c5-c59c3c6136d1 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:36.918259 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6c8f401a-61af-4e97-80c5-c59c3c6136d1 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:36.922612 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6c8f401a-61af-4e97-80c5-c59c3c6136d1 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:36.924402 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6c8f401a-61af-4e97-80c5-c59c3c6136d1 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:36.925701 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6c8f401a-61af-4e97-80c5-c59c3c6136d1 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:36.927424 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6c8f401a-61af-4e97-80c5-c59c3c6136d1 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:37.296295 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6c8f401a-61af-4e97-80c5-c59c3c6136d1 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae278c3db5eb41dca0336a8edf10fab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4c1113905449dfaa64b18199faa2ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:37.314402 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6c8f401a-61af-4e97-80c5-c59c3c6136d1 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] 10.222.0.79 "GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd" status: 200 len: 1511 microversion: 2.1 time: 0.423862 Oct 17 14:04:37.317447 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2735/5340] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:04:36 2022] GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd => generated 1511 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:04:38.338765 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a2c6a640-f03c-45d8-a654-790d16403b12 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:38.339565 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a2c6a640-f03c-45d8-a654-790d16403b12 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] [instance: 5c1e7d15-aff1-4439-be8c-af4e87a53fdd] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:38.356067 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a2c6a640-f03c-45d8-a654-790d16403b12 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:38.357788 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a2c6a640-f03c-45d8-a654-790d16403b12 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:38.359774 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a2c6a640-f03c-45d8-a654-790d16403b12 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:38.361977 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a2c6a640-f03c-45d8-a654-790d16403b12 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:38.363609 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a2c6a640-f03c-45d8-a654-790d16403b12 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:38.364624 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a2c6a640-f03c-45d8-a654-790d16403b12 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:39.730936 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a2c6a640-f03c-45d8-a654-790d16403b12 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae278c3db5eb41dca0336a8edf10fab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4c1113905449dfaa64b18199faa2ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:39.739760 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a2c6a640-f03c-45d8-a654-790d16403b12 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] 10.222.0.79 "GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd" status: 200 len: 1511 microversion: 2.1 time: 1.405469 Oct 17 14:04:39.742927 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2606/5341] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:04:38 2022] GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd => generated 1511 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:04:40.773887 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-88459593-2b8a-4ea4-8c00-4f1d74804520 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:40.775140 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-88459593-2b8a-4ea4-8c00-4f1d74804520 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] [instance: 5c1e7d15-aff1-4439-be8c-af4e87a53fdd] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:40.792707 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-88459593-2b8a-4ea4-8c00-4f1d74804520 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:40.793215 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-88459593-2b8a-4ea4-8c00-4f1d74804520 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:40.793654 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-88459593-2b8a-4ea4-8c00-4f1d74804520 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:40.794372 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-88459593-2b8a-4ea4-8c00-4f1d74804520 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:40.795001 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-88459593-2b8a-4ea4-8c00-4f1d74804520 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:40.795773 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-88459593-2b8a-4ea4-8c00-4f1d74804520 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:41.479582 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-88459593-2b8a-4ea4-8c00-4f1d74804520 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae278c3db5eb41dca0336a8edf10fab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e4c1113905449dfaa64b18199faa2ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:41.498457 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-88459593-2b8a-4ea4-8c00-4f1d74804520 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] 10.222.0.79 "GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd" status: 200 len: 1511 microversion: 2.1 time: 0.728248 Oct 17 14:04:41.516591 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2736/5342] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:04:40 2022] GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd => generated 1511 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:04:41.711593 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-4be55a89-4383-42a4-b038-edf08986e9c1 req-8e0e295a-6db3-4eea-98f8-5e210c0ae710 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c1e7d15-aff1-4439-be8c-af4e87a53fdd", "name": "network-vif-deleted", "tag": "005c8f89-113c-42e8-b0c0-99f7c47dc5d9"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:04:41.755947 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-4be55a89-4383-42a4-b038-edf08986e9c1 req-8e0e295a-6db3-4eea-98f8-5e210c0ae710 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:41.760355 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-4be55a89-4383-42a4-b038-edf08986e9c1 req-8e0e295a-6db3-4eea-98f8-5e210c0ae710 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:41.761185 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-4be55a89-4383-42a4-b038-edf08986e9c1 req-8e0e295a-6db3-4eea-98f8-5e210c0ae710 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:41.782229 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-4be55a89-4383-42a4-b038-edf08986e9c1 req-8e0e295a-6db3-4eea-98f8-5e210c0ae710 service nova] Creating event network-vif-deleted:005c8f89-113c-42e8-b0c0-99f7c47dc5d9 for instance 5c1e7d15-aff1-4439-be8c-af4e87a53fdd on n-h2-854247-14 Oct 17 14:04:41.803192 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-4be55a89-4383-42a4-b038-edf08986e9c1 req-8e0e295a-6db3-4eea-98f8-5e210c0ae710 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095623 Oct 17 14:04:41.807409 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2607/5343] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:04:42.524468 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-94f750b9-dc1e-44a9-a3e5-9e6a4c0e8f05 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:42.525297 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-94f750b9-dc1e-44a9-a3e5-9e6a4c0e8f05 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] [instance: 5c1e7d15-aff1-4439-be8c-af4e87a53fdd] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:42.537027 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94f750b9-dc1e-44a9-a3e5-9e6a4c0e8f05 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:42.542905 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94f750b9-dc1e-44a9-a3e5-9e6a4c0e8f05 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:42.545712 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94f750b9-dc1e-44a9-a3e5-9e6a4c0e8f05 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:42.547944 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94f750b9-dc1e-44a9-a3e5-9e6a4c0e8f05 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:42.550994 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94f750b9-dc1e-44a9-a3e5-9e6a4c0e8f05 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:42.553151 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94f750b9-dc1e-44a9-a3e5-9e6a4c0e8f05 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:42.566256 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=52,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:04:42.600012 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-94f750b9-dc1e-44a9-a3e5-9e6a4c0e8f05 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] HTTP exception thrown: Instance 5c1e7d15-aff1-4439-be8c-af4e87a53fdd could not be found. Oct 17 14:04:42.605405 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-94f750b9-dc1e-44a9-a3e5-9e6a4c0e8f05 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Request method failure captured: Oct 17 14:04:42.605405 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd HTTP/1.1 Oct 17 14:04:42.605405 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 14:04:42.605405 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 14:04:42.605405 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 14:04:42.605405 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 14:04:42.605405 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 14:04:42.605405 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 14:04:42.605405 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 14:04:42.605405 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 14:04:42.605405 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTWCYA1fl7_F00DNdoKus4ggSMJRZGvyf1vRY0sXyRMcvUqq_-kGId9v-PLAO6_oppH8PLoM2LFN9uP3DvNIWx9F8IHHXumDTfpbWNmbaHEUYVLiqo6_XpGIVRS_oxdXB7UaptIEFjGyvOxA2DrvRtJtmatNB4cqkzT4mTS25ki7eO28 Oct 17 14:04:42.605405 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 14:04:42.605405 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 14:04:42.605405 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 14:04:42.605405 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 14:04:42.605405 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 14:04:42.605405 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 14:04:42.605405 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 0e4c1113905449dfaa64b18199faa2ad Oct 17 14:04:42.605405 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-766926133 Oct 17 14:04:42.605405 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 14:04:42.605405 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 14:04:42.605405 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0e4c1113905449dfaa64b18199faa2ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0e4c1113905449dfaa64b18199faa2ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0e4c1113905449dfaa64b18199faa2ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0e4c1113905449dfaa64b18199faa2ad", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:04:42.605405 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-766926133 Oct 17 14:04:42.605405 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 0e4c1113905449dfaa64b18199faa2ad Oct 17 14:04:42.605405 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-766926133 Oct 17 14:04:42.605405 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServerRescueTestJSONUnderV235-766926133-project Oct 17 14:04:42.605405 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 14:04:42.605405 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 14:04:42.605405 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: ae278c3db5eb41dca0336a8edf10fab8 Oct 17 14:04:42.605405 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-766926133-project Oct 17 14:04:42.605405 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 14:04:42.605405 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 5c1e7d15-aff1-4439-be8c-af4e87a53fdd could not be found. Oct 17 14:04:42.605405 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '5c1e7d15-aff1-4439-be8c-af4e87a53fdd'} Oct 17 14:04:42.605405 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:04:42.605405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:04:42.605405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:04:42.605405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:04:42.605405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:04:42.605405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:04:42.605405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:04:42.605405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:04:42.605405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:04:42.605405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:04:42.605405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c1e7d15-aff1-4439-be8c-af4e87a53fdd could not be found. Oct 17 14:04:42.605405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:04:42.605405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:04:42.605405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:04:42.605405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:04:42.605405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:04:42.605405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:04:42.605405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:04:42.605405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:04:42.605405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:04:42.605405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:04:42.605405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:04:42.605405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:04:42.605405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:04:42.605405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:04:42.605405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:04:42.605405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:04:42.605405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c1e7d15-aff1-4439-be8c-af4e87a53fdd could not be found. Oct 17 14:04:42.605405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:04:42.605405 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:04:42.609918 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:04:42.609918 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:04:42.609918 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:04:42.609918 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:04:42.609918 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:04:42.609918 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:04:42.609918 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c1e7d15-aff1-4439-be8c-af4e87a53fdd could not be found. Oct 17 14:04:42.609918 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:04:42.614269 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-94f750b9-dc1e-44a9-a3e5-9e6a4c0e8f05 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] Returning 404 to user: Instance 5c1e7d15-aff1-4439-be8c-af4e87a53fdd could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:04:42.616705 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-94f750b9-dc1e-44a9-a3e5-9e6a4c0e8f05 tempest-ServerRescueTestJSONUnderV235-766926133 tempest-ServerRescueTestJSONUnderV235-766926133-project] 10.222.0.79 "GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd" status: 404 len: 111 microversion: 2.1 time: 0.096986 Oct 17 14:04:42.618424 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2737/5344] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:04:42 2022] GET /compute/v2.1/servers/5c1e7d15-aff1-4439-be8c-af4e87a53fdd => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:04:43.381527 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9d3a452b-644b-414f-9d70-34e8806a4a0c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-900846686", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8e163913-4ce0-44d4-b8a6-1a267f1d3d7e"}], "security_groups": [{"name": "tempest-securitygroup--292127035"}], "key_name": "tempest-keypair-96458282", "user_data": "}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:04:43.872253 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-9d3a452b-644b-414f-9d70-34e8806a4a0c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] validate_networks() for [('8e163913-4ce0-44d4-b8a6-1a267f1d3d7e', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:04:45.956231 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-9d3a452b-644b-414f-9d70-34e8806a4a0c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:04:45.957428 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-9d3a452b-644b-414f-9d70-34e8806a4a0c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:04:45.958079 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-9d3a452b-644b-414f-9d70-34e8806a4a0c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:04:45.958996 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-9d3a452b-644b-414f-9d70-34e8806a4a0c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:04:45.960437 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-9d3a452b-644b-414f-9d70-34e8806a4a0c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:04:45.969706 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:04:45.990521 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9d3a452b-644b-414f-9d70-34e8806a4a0c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:45.992267 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9d3a452b-644b-414f-9d70-34e8806a4a0c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:45.992948 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9d3a452b-644b-414f-9d70-34e8806a4a0c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:45.997465 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9d3a452b-644b-414f-9d70-34e8806a4a0c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:45.998263 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9d3a452b-644b-414f-9d70-34e8806a4a0c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:45.999031 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9d3a452b-644b-414f-9d70-34e8806a4a0c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:46.033913 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:04:46.083457 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-9d3a452b-644b-414f-9d70-34e8806a4a0c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Getting quotas for project 6dcc0bf813dc4a4fa2fd7d6f5521ae85. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:04:46.111120 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-9d3a452b-644b-414f-9d70-34e8806a4a0c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Getting quotas for user 9c7ac3dcc4ff4dd2bb68738c72e9507f and project 6dcc0bf813dc4a4fa2fd7d6f5521ae85. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:04:46.129605 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9d3a452b-644b-414f-9d70-34e8806a4a0c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:04:46.132171 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9d3a452b-644b-414f-9d70-34e8806a4a0c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:04:46.247841 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9d3a452b-644b-414f-9d70-34e8806a4a0c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.871237 Oct 17 14:04:46.249591 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2608/5345] 10.222.0.79 () {62 vars in 1188 bytes} [Mon Oct 17 14:04:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 2874 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 14:04:46.261523 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-bb066a13-45ba-4b19-a320-108f2f0bb164 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:46.263118 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-bb066a13-45ba-4b19-a320-108f2f0bb164 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:46.273663 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=4 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:04:46.455090 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-bb066a13-45ba-4b19-a320-108f2f0bb164 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:46.473990 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-bb066a13-45ba-4b19-a320-108f2f0bb164 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:46.477024 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-bb066a13-45ba-4b19-a320-108f2f0bb164 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:46.479850 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-bb066a13-45ba-4b19-a320-108f2f0bb164 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1279 microversion: 2.20 time: 0.223245 Oct 17 14:04:46.484113 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2738/5346] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:04:46 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1279 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:04:47.512835 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-433f9e73-02f7-479d-b56c-575d349afc07 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:47.513621 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-433f9e73-02f7-479d-b56c-575d349afc07 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:47.739796 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-433f9e73-02f7-479d-b56c-575d349afc07 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:47.758640 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-433f9e73-02f7-479d-b56c-575d349afc07 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:47.763205 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-433f9e73-02f7-479d-b56c-575d349afc07 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:47.772781 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-433f9e73-02f7-479d-b56c-575d349afc07 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1279 microversion: 2.20 time: 0.263831 Oct 17 14:04:47.773777 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2609/5347] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:04:47 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1279 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:04:48.804431 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f57594c5-1840-430f-9d52-6c687a7c8fd7 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:48.806611 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f57594c5-1840-430f-9d52-6c687a7c8fd7 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:48.832073 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f57594c5-1840-430f-9d52-6c687a7c8fd7 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:48.835324 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f57594c5-1840-430f-9d52-6c687a7c8fd7 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:48.837245 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f57594c5-1840-430f-9d52-6c687a7c8fd7 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:48.840845 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f57594c5-1840-430f-9d52-6c687a7c8fd7 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:48.841720 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f57594c5-1840-430f-9d52-6c687a7c8fd7 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:48.844300 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f57594c5-1840-430f-9d52-6c687a7c8fd7 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:49.397230 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f57594c5-1840-430f-9d52-6c687a7c8fd7 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:49.423193 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f57594c5-1840-430f-9d52-6c687a7c8fd7 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:49.425031 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f57594c5-1840-430f-9d52-6c687a7c8fd7 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:49.426413 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f57594c5-1840-430f-9d52-6c687a7c8fd7 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1339 microversion: 2.20 time: 0.626966 Oct 17 14:04:49.427612 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2739/5348] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:04:48 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1339 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:04:50.453220 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7d6022fc-7062-40aa-8e43-cb933b7fe92b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:50.454593 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7d6022fc-7062-40aa-8e43-cb933b7fe92b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:50.483475 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7d6022fc-7062-40aa-8e43-cb933b7fe92b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:50.487686 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7d6022fc-7062-40aa-8e43-cb933b7fe92b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:50.488182 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7d6022fc-7062-40aa-8e43-cb933b7fe92b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:50.488949 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7d6022fc-7062-40aa-8e43-cb933b7fe92b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:50.489422 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7d6022fc-7062-40aa-8e43-cb933b7fe92b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:50.489853 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7d6022fc-7062-40aa-8e43-cb933b7fe92b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:50.678417 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7d6022fc-7062-40aa-8e43-cb933b7fe92b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:50.707880 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7d6022fc-7062-40aa-8e43-cb933b7fe92b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:50.712767 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7d6022fc-7062-40aa-8e43-cb933b7fe92b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:50.718489 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7d6022fc-7062-40aa-8e43-cb933b7fe92b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1337 microversion: 2.20 time: 0.269395 Oct 17 14:04:50.723758 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2610/5349] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:04:50 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1337 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:04:51.762378 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f484beb8-5bc4-4a06-9e4a-7c5550c35347 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:51.763082 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f484beb8-5bc4-4a06-9e4a-7c5550c35347 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:51.777942 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f484beb8-5bc4-4a06-9e4a-7c5550c35347 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:51.778980 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f484beb8-5bc4-4a06-9e4a-7c5550c35347 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:51.779821 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f484beb8-5bc4-4a06-9e4a-7c5550c35347 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:51.786388 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f484beb8-5bc4-4a06-9e4a-7c5550c35347 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:51.787922 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f484beb8-5bc4-4a06-9e4a-7c5550c35347 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:51.788638 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f484beb8-5bc4-4a06-9e4a-7c5550c35347 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:52.397998 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f484beb8-5bc4-4a06-9e4a-7c5550c35347 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:52.409088 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f484beb8-5bc4-4a06-9e4a-7c5550c35347 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:52.417111 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f484beb8-5bc4-4a06-9e4a-7c5550c35347 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:52.418768 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f484beb8-5bc4-4a06-9e4a-7c5550c35347 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1404 microversion: 2.20 time: 0.660834 Oct 17 14:04:52.426289 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2740/5350] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:04:51 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1404 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:04:53.453663 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-73e30515-503c-4c53-b536-8949fce29c15 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:53.455060 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-73e30515-503c-4c53-b536-8949fce29c15 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:53.470716 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-73e30515-503c-4c53-b536-8949fce29c15 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:53.471239 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-73e30515-503c-4c53-b536-8949fce29c15 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:53.471971 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-73e30515-503c-4c53-b536-8949fce29c15 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:53.472387 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-73e30515-503c-4c53-b536-8949fce29c15 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:53.472844 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-73e30515-503c-4c53-b536-8949fce29c15 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:53.483927 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-73e30515-503c-4c53-b536-8949fce29c15 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:54.334930 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-73e30515-503c-4c53-b536-8949fce29c15 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:54.398783 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-73e30515-503c-4c53-b536-8949fce29c15 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:54.410790 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-73e30515-503c-4c53-b536-8949fce29c15 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:54.413073 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-73e30515-503c-4c53-b536-8949fce29c15 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1404 microversion: 2.20 time: 0.963794 Oct 17 14:04:54.416977 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2611/5351] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:04:53 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1404 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:04:54.592181 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-aec90c56-b425-4b8e-9f38-ae9cae932aec req-ae340678-640c-4fb9-99e7-86ad715f55d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32c279ba-2f76-4986-be6d-1029602677ed", "tag": "b00489ac-2c3b-4d9e-843a-d9962aa3d085"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:04:54.630605 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-aec90c56-b425-4b8e-9f38-ae9cae932aec req-ae340678-640c-4fb9-99e7-86ad715f55d0 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:54.639906 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-aec90c56-b425-4b8e-9f38-ae9cae932aec req-ae340678-640c-4fb9-99e7-86ad715f55d0 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:54.641458 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-aec90c56-b425-4b8e-9f38-ae9cae932aec req-ae340678-640c-4fb9-99e7-86ad715f55d0 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:54.669808 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-aec90c56-b425-4b8e-9f38-ae9cae932aec req-ae340678-640c-4fb9-99e7-86ad715f55d0 service nova] Creating event network-changed:b00489ac-2c3b-4d9e-843a-d9962aa3d085 for instance 32c279ba-2f76-4986-be6d-1029602677ed on n-h2-854247-14 Oct 17 14:04:54.680905 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-aec90c56-b425-4b8e-9f38-ae9cae932aec req-ae340678-640c-4fb9-99e7-86ad715f55d0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097207 Oct 17 14:04:54.684004 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2612/5352] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:04:55.087153 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a997c32b-6319-415b-8e9e-bd9b56086a8d tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-723138133", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": "none"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:04:55.188496 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-a997c32b-6319-415b-8e9e-bd9b56086a8d tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:04:55.188937 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-a997c32b-6319-415b-8e9e-bd9b56086a8d tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:04:55.189414 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-a997c32b-6319-415b-8e9e-bd9b56086a8d tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:04:55.189823 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-a997c32b-6319-415b-8e9e-bd9b56086a8d tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:04:55.190235 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-a997c32b-6319-415b-8e9e-bd9b56086a8d tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:04:55.201967 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a997c32b-6319-415b-8e9e-bd9b56086a8d tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:55.202800 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a997c32b-6319-415b-8e9e-bd9b56086a8d tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:55.203373 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a997c32b-6319-415b-8e9e-bd9b56086a8d tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:55.204180 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a997c32b-6319-415b-8e9e-bd9b56086a8d tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:55.204643 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a997c32b-6319-415b-8e9e-bd9b56086a8d tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:55.204953 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a997c32b-6319-415b-8e9e-bd9b56086a8d tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:55.244586 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-a997c32b-6319-415b-8e9e-bd9b56086a8d tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Getting quotas for project 0c0185924cf640a892c0aa61fb6247e1. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:04:55.261492 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-a997c32b-6319-415b-8e9e-bd9b56086a8d tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Getting quotas for user cfb59b0445d0431dad295d108584abe1 and project 0c0185924cf640a892c0aa61fb6247e1. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:04:55.291936 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a997c32b-6319-415b-8e9e-bd9b56086a8d tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:04:55.294494 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a997c32b-6319-415b-8e9e-bd9b56086a8d tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] [instance: 98cedf8d-f6c2-41da-b3ae-438933b6ec00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:04:55.376587 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a997c32b-6319-415b-8e9e-bd9b56086a8d tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.906979 Oct 17 14:04:55.377888 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2741/5353] 10.222.0.79 () {62 vars in 1188 bytes} [Mon Oct 17 14:04:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 912 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 14:04:55.391404 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e18f7465-09ec-4056-aa19-34301b65b5ce tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:55.392536 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e18f7465-09ec-4056-aa19-34301b65b5ce tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] [instance: 98cedf8d-f6c2-41da-b3ae-438933b6ec00] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:55.443080 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c502e3f8-2299-41ea-afa0-e289fe65bf9f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:55.444537 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c502e3f8-2299-41ea-afa0-e289fe65bf9f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:55.460432 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c502e3f8-2299-41ea-afa0-e289fe65bf9f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:55.460931 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c502e3f8-2299-41ea-afa0-e289fe65bf9f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:55.461368 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c502e3f8-2299-41ea-afa0-e289fe65bf9f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:55.462080 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c502e3f8-2299-41ea-afa0-e289fe65bf9f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:55.462537 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c502e3f8-2299-41ea-afa0-e289fe65bf9f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:55.462957 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c502e3f8-2299-41ea-afa0-e289fe65bf9f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:55.534488 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e18f7465-09ec-4056-aa19-34301b65b5ce tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:55.545661 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e18f7465-09ec-4056-aa19-34301b65b5ce tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:55.549623 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e18f7465-09ec-4056-aa19-34301b65b5ce tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:55.551723 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e18f7465-09ec-4056-aa19-34301b65b5ce tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] 10.222.0.79 "GET /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00" status: 200 len: 1277 microversion: 2.54 time: 0.164717 Oct 17 14:04:55.554353 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2613/5354] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:04:55 2022] GET /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00 => generated 1277 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:04:55.856516 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c502e3f8-2299-41ea-afa0-e289fe65bf9f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:55.871343 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c502e3f8-2299-41ea-afa0-e289fe65bf9f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:55.875021 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c502e3f8-2299-41ea-afa0-e289fe65bf9f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:55.881014 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c502e3f8-2299-41ea-afa0-e289fe65bf9f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1404 microversion: 2.20 time: 0.440240 Oct 17 14:04:55.882547 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2742/5355] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:04:55 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1404 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:04:56.580563 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5cb4954b-014b-4cb6-8bba-f6b60c9554d9 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:56.581834 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5cb4954b-014b-4cb6-8bba-f6b60c9554d9 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] [instance: 98cedf8d-f6c2-41da-b3ae-438933b6ec00] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:56.585217 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:04:56.616537 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5cb4954b-014b-4cb6-8bba-f6b60c9554d9 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:56.616986 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5cb4954b-014b-4cb6-8bba-f6b60c9554d9 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:56.617432 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5cb4954b-014b-4cb6-8bba-f6b60c9554d9 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:56.618180 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5cb4954b-014b-4cb6-8bba-f6b60c9554d9 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:56.618655 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5cb4954b-014b-4cb6-8bba-f6b60c9554d9 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:56.619046 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5cb4954b-014b-4cb6-8bba-f6b60c9554d9 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:56.894490 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5cb4954b-014b-4cb6-8bba-f6b60c9554d9 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:56.910091 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-94ee650a-d990-4929-a2e9-b4adb3c402c0 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:56.910700 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-94ee650a-d990-4929-a2e9-b4adb3c402c0 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:56.910972 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5cb4954b-014b-4cb6-8bba-f6b60c9554d9 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:56.912720 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5cb4954b-014b-4cb6-8bba-f6b60c9554d9 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:56.914156 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5cb4954b-014b-4cb6-8bba-f6b60c9554d9 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] 10.222.0.79 "GET /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00" status: 200 len: 1273 microversion: 2.54 time: 0.339162 Oct 17 14:04:56.915332 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2614/5356] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:04:56 2022] GET /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00 => generated 1273 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:04:56.926575 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=4 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:04:56.939657 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94ee650a-d990-4929-a2e9-b4adb3c402c0 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:56.940536 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94ee650a-d990-4929-a2e9-b4adb3c402c0 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:56.941177 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94ee650a-d990-4929-a2e9-b4adb3c402c0 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:56.942099 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94ee650a-d990-4929-a2e9-b4adb3c402c0 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:56.942721 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94ee650a-d990-4929-a2e9-b4adb3c402c0 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:56.943347 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94ee650a-d990-4929-a2e9-b4adb3c402c0 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:57.384465 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-94ee650a-d990-4929-a2e9-b4adb3c402c0 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:57.393759 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-94ee650a-d990-4929-a2e9-b4adb3c402c0 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:57.395413 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-94ee650a-d990-4929-a2e9-b4adb3c402c0 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:57.396446 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-94ee650a-d990-4929-a2e9-b4adb3c402c0 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1404 microversion: 2.20 time: 0.491754 Oct 17 14:04:57.405058 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2743/5357] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:04:56 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1404 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:04:57.942459 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1547dbc3-793a-4ccc-8aa2-924f5835fb20 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:57.944090 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1547dbc3-793a-4ccc-8aa2-924f5835fb20 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] [instance: 98cedf8d-f6c2-41da-b3ae-438933b6ec00] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:57.954378 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1547dbc3-793a-4ccc-8aa2-924f5835fb20 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:57.958426 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1547dbc3-793a-4ccc-8aa2-924f5835fb20 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:57.958989 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1547dbc3-793a-4ccc-8aa2-924f5835fb20 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:57.960875 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1547dbc3-793a-4ccc-8aa2-924f5835fb20 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:57.964468 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1547dbc3-793a-4ccc-8aa2-924f5835fb20 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:57.965033 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1547dbc3-793a-4ccc-8aa2-924f5835fb20 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:58.235734 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1547dbc3-793a-4ccc-8aa2-924f5835fb20 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:58.244887 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1547dbc3-793a-4ccc-8aa2-924f5835fb20 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:58.255586 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1547dbc3-793a-4ccc-8aa2-924f5835fb20 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:58.261603 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1547dbc3-793a-4ccc-8aa2-924f5835fb20 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] 10.222.0.79 "GET /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00" status: 200 len: 1335 microversion: 2.54 time: 0.324647 Oct 17 14:04:58.271550 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2615/5358] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:04:57 2022] GET /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00 => generated 1335 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:04:58.437382 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-346e9dbe-2691-4116-b272-efe674c3d20b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:58.438248 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-346e9dbe-2691-4116-b272-efe674c3d20b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:58.452558 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-346e9dbe-2691-4116-b272-efe674c3d20b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:58.453793 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-346e9dbe-2691-4116-b272-efe674c3d20b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:58.455795 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-346e9dbe-2691-4116-b272-efe674c3d20b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:58.456791 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-346e9dbe-2691-4116-b272-efe674c3d20b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:58.460290 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-346e9dbe-2691-4116-b272-efe674c3d20b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:58.460876 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-346e9dbe-2691-4116-b272-efe674c3d20b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:59.272470 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-346e9dbe-2691-4116-b272-efe674c3d20b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:59.284433 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-346e9dbe-2691-4116-b272-efe674c3d20b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:59.286173 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-346e9dbe-2691-4116-b272-efe674c3d20b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:59.293839 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-01e25ed3-6bbc-4336-8012-b5b6ef143b7b tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:59.294463 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-01e25ed3-6bbc-4336-8012-b5b6ef143b7b tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] [instance: 98cedf8d-f6c2-41da-b3ae-438933b6ec00] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:59.296027 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-346e9dbe-2691-4116-b272-efe674c3d20b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1404 microversion: 2.20 time: 0.869921 Oct 17 14:04:59.296753 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2744/5359] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:04:58 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1404 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:04:59.307627 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-01e25ed3-6bbc-4336-8012-b5b6ef143b7b tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:59.312605 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-01e25ed3-6bbc-4336-8012-b5b6ef143b7b tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:59.313968 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-01e25ed3-6bbc-4336-8012-b5b6ef143b7b tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:59.314912 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-01e25ed3-6bbc-4336-8012-b5b6ef143b7b tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:59.315559 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-01e25ed3-6bbc-4336-8012-b5b6ef143b7b tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:59.319345 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-01e25ed3-6bbc-4336-8012-b5b6ef143b7b tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:59.568449 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-01e25ed3-6bbc-4336-8012-b5b6ef143b7b tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:59.582518 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-01e25ed3-6bbc-4336-8012-b5b6ef143b7b tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:59.584375 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-01e25ed3-6bbc-4336-8012-b5b6ef143b7b tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:59.585607 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-01e25ed3-6bbc-4336-8012-b5b6ef143b7b tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] 10.222.0.79 "GET /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00" status: 200 len: 1335 microversion: 2.54 time: 0.296504 Oct 17 14:04:59.592650 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2616/5360] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:04:59 2022] GET /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00 => generated 1335 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:05:00.332920 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-05213a6f-0a87-465f-b8d9-1b64c55d820f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:00.333515 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-05213a6f-0a87-465f-b8d9-1b64c55d820f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:00.355632 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-05213a6f-0a87-465f-b8d9-1b64c55d820f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:00.356158 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-05213a6f-0a87-465f-b8d9-1b64c55d820f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:00.356609 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-05213a6f-0a87-465f-b8d9-1b64c55d820f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:00.357346 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-05213a6f-0a87-465f-b8d9-1b64c55d820f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:00.357801 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-05213a6f-0a87-465f-b8d9-1b64c55d820f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:00.363606 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-05213a6f-0a87-465f-b8d9-1b64c55d820f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:00.617190 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6c44bead-2da4-45e6-9b2f-9c19b589ec7f tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:00.619736 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6c44bead-2da4-45e6-9b2f-9c19b589ec7f tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] [instance: 98cedf8d-f6c2-41da-b3ae-438933b6ec00] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:00.637536 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6c44bead-2da4-45e6-9b2f-9c19b589ec7f tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:00.638024 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6c44bead-2da4-45e6-9b2f-9c19b589ec7f tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:00.638464 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6c44bead-2da4-45e6-9b2f-9c19b589ec7f tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:00.639285 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6c44bead-2da4-45e6-9b2f-9c19b589ec7f tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:00.649334 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6c44bead-2da4-45e6-9b2f-9c19b589ec7f tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:00.654648 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6c44bead-2da4-45e6-9b2f-9c19b589ec7f tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:00.686595 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-05213a6f-0a87-465f-b8d9-1b64c55d820f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:00.698253 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-05213a6f-0a87-465f-b8d9-1b64c55d820f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:00.699693 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-05213a6f-0a87-465f-b8d9-1b64c55d820f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:00.714126 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-05213a6f-0a87-465f-b8d9-1b64c55d820f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1404 microversion: 2.20 time: 0.376058 Oct 17 14:05:00.714126 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2745/5361] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:05:00 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1404 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:05:00.824432 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6c44bead-2da4-45e6-9b2f-9c19b589ec7f tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:00.836561 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6c44bead-2da4-45e6-9b2f-9c19b589ec7f tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:00.838179 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6c44bead-2da4-45e6-9b2f-9c19b589ec7f tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:00.852709 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6c44bead-2da4-45e6-9b2f-9c19b589ec7f tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] 10.222.0.79 "GET /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00" status: 200 len: 1356 microversion: 2.54 time: 0.240177 Oct 17 14:05:00.853805 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2617/5362] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:05:00 2022] GET /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00 => generated 1356 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:05:00.881885 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-59ce8577-a47c-461a-8609-ab71de204a59 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Action: 'create', calling method: .version_select at 0x7f7cd41619d0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-770178707", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNslIe9P2jRTzOA9DCo47etw1qGz3c2hEqST5qLNxpOFw/9YDL+SGt4ftWXZ2ZaVcyWbaPbokv98yeR0mz1/khwzgrG3Ma5JSw0ELxWQgtdHlZiUyfm83NQ3hWzom7xhlg=="}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:05:00.898015 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-59ce8577-a47c-461a-8609-ab71de204a59 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Getting quotas for project 0c0185924cf640a892c0aa61fb6247e1. Resources: {'key_pairs'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:05:00.904048 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-59ce8577-a47c-461a-8609-ab71de204a59 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Getting quotas for user cfb59b0445d0431dad295d108584abe1 and project 0c0185924cf640a892c0aa61fb6247e1. Resources: {'key_pairs'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:05:00.958295 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-59ce8577-a47c-461a-8609-ab71de204a59 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.080164 Oct 17 14:05:00.959030 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2746/5363] 10.222.0.79 () {62 vars in 1200 bytes} [Mon Oct 17 14:05:00 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 82 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 17 14:05:00.971323 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3f634e63-e25f-44c0-8944-ceb2b14c4e89 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-770178707", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:05:00.975496 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3f634e63-e25f-44c0-8944-ceb2b14c4e89 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] [instance: 98cedf8d-f6c2-41da-b3ae-438933b6ec00] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:00.991873 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f634e63-e25f-44c0-8944-ceb2b14c4e89 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:00.992620 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f634e63-e25f-44c0-8944-ceb2b14c4e89 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:00.993259 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f634e63-e25f-44c0-8944-ceb2b14c4e89 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:01.000262 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f634e63-e25f-44c0-8944-ceb2b14c4e89 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:01.002282 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f634e63-e25f-44c0-8944-ceb2b14c4e89 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:01.002743 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f634e63-e25f-44c0-8944-ceb2b14c4e89 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:01.249965 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-3f634e63-e25f-44c0-8944-ceb2b14c4e89 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:05:01.250604 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-3f634e63-e25f-44c0-8944-ceb2b14c4e89 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:05:01.251762 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-3f634e63-e25f-44c0-8944-ceb2b14c4e89 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:05:01.252359 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-3f634e63-e25f-44c0-8944-ceb2b14c4e89 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:05:01.252945 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-3f634e63-e25f-44c0-8944-ceb2b14c4e89 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:05:01.390759 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3f634e63-e25f-44c0-8944-ceb2b14c4e89 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] [instance: 98cedf8d-f6c2-41da-b3ae-438933b6ec00] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:01.404138 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f634e63-e25f-44c0-8944-ceb2b14c4e89 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:01.405558 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f634e63-e25f-44c0-8944-ceb2b14c4e89 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:01.407072 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f634e63-e25f-44c0-8944-ceb2b14c4e89 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:01.408164 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f634e63-e25f-44c0-8944-ceb2b14c4e89 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:01.408821 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f634e63-e25f-44c0-8944-ceb2b14c4e89 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:01.409792 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f634e63-e25f-44c0-8944-ceb2b14c4e89 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:01.453072 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3f634e63-e25f-44c0-8944-ceb2b14c4e89 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] 10.222.0.79 "POST /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00/action" status: 202 len: 1138 microversion: 2.54 time: 0.486631 Oct 17 14:05:01.454528 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2618/5364] 10.222.0.79 () {62 vars in 1320 bytes} [Mon Oct 17 14:05:00 2022] POST /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00/action => generated 1138 bytes in 489 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 17 14:05:01.479068 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6fb45f73-821a-446f-93c0-37ed3c0ebd23 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:01.480633 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6fb45f73-821a-446f-93c0-37ed3c0ebd23 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] [instance: 98cedf8d-f6c2-41da-b3ae-438933b6ec00] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:01.490664 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6fb45f73-821a-446f-93c0-37ed3c0ebd23 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:01.491440 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6fb45f73-821a-446f-93c0-37ed3c0ebd23 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:01.492087 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6fb45f73-821a-446f-93c0-37ed3c0ebd23 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:01.492992 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6fb45f73-821a-446f-93c0-37ed3c0ebd23 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:01.494361 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6fb45f73-821a-446f-93c0-37ed3c0ebd23 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:01.495391 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6fb45f73-821a-446f-93c0-37ed3c0ebd23 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:01.632833 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6fb45f73-821a-446f-93c0-37ed3c0ebd23 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:01.645590 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6fb45f73-821a-446f-93c0-37ed3c0ebd23 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:01.650417 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6fb45f73-821a-446f-93c0-37ed3c0ebd23 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:01.653582 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6fb45f73-821a-446f-93c0-37ed3c0ebd23 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] 10.222.0.79 "GET /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00" status: 200 len: 1407 microversion: 2.54 time: 0.181248 Oct 17 14:05:01.655011 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2747/5365] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:05:01 2022] GET /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00 => generated 1407 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:05:01.742120 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-65e19f02-cc14-4b10-a2a7-d34305789150 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:01.743064 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-65e19f02-cc14-4b10-a2a7-d34305789150 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:01.765792 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-65e19f02-cc14-4b10-a2a7-d34305789150 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:01.766518 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-65e19f02-cc14-4b10-a2a7-d34305789150 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:01.766844 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-65e19f02-cc14-4b10-a2a7-d34305789150 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:01.767608 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-65e19f02-cc14-4b10-a2a7-d34305789150 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:01.768070 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-65e19f02-cc14-4b10-a2a7-d34305789150 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:01.771633 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-65e19f02-cc14-4b10-a2a7-d34305789150 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:02.180390 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-65e19f02-cc14-4b10-a2a7-d34305789150 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:02.193756 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-65e19f02-cc14-4b10-a2a7-d34305789150 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:02.198573 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-65e19f02-cc14-4b10-a2a7-d34305789150 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:02.200533 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-65e19f02-cc14-4b10-a2a7-d34305789150 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1404 microversion: 2.20 time: 0.464370 Oct 17 14:05:02.204762 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2619/5366] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:05:01 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1404 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:05:02.683141 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c78dc7be-ae49-478f-adcd-67b17d263f4c tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:02.683834 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c78dc7be-ae49-478f-adcd-67b17d263f4c tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] [instance: 98cedf8d-f6c2-41da-b3ae-438933b6ec00] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:02.708811 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c78dc7be-ae49-478f-adcd-67b17d263f4c tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:02.709612 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c78dc7be-ae49-478f-adcd-67b17d263f4c tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:02.713050 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c78dc7be-ae49-478f-adcd-67b17d263f4c tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:02.715895 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c78dc7be-ae49-478f-adcd-67b17d263f4c tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:02.718139 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c78dc7be-ae49-478f-adcd-67b17d263f4c tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:02.720369 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c78dc7be-ae49-478f-adcd-67b17d263f4c tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:03.075651 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c78dc7be-ae49-478f-adcd-67b17d263f4c tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:03.106039 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c78dc7be-ae49-478f-adcd-67b17d263f4c tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:03.125832 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c78dc7be-ae49-478f-adcd-67b17d263f4c tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:03.133907 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c78dc7be-ae49-478f-adcd-67b17d263f4c tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] 10.222.0.79 "GET /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00" status: 200 len: 1407 microversion: 2.54 time: 0.451824 Oct 17 14:05:03.134797 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2748/5367] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:05:02 2022] GET /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00 => generated 1407 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:05:03.233904 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3289f910-1f6d-487d-9089-843225af7291 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:03.235560 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3289f910-1f6d-487d-9089-843225af7291 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:03.248730 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3289f910-1f6d-487d-9089-843225af7291 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:03.249414 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3289f910-1f6d-487d-9089-843225af7291 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:03.251945 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3289f910-1f6d-487d-9089-843225af7291 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:03.252947 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3289f910-1f6d-487d-9089-843225af7291 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:03.253578 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3289f910-1f6d-487d-9089-843225af7291 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:03.255814 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3289f910-1f6d-487d-9089-843225af7291 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:03.657423 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-5f90a53c-56aa-46fd-8e82-a1b1407ad79a req-e098df9a-a36a-4a3e-ab7d-722d3ffd9846 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32c279ba-2f76-4986-be6d-1029602677ed", "name": "network-vif-plugged", "status": "completed", "tag": "b00489ac-2c3b-4d9e-843a-d9962aa3d085"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:05:03.688808 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-5f90a53c-56aa-46fd-8e82-a1b1407ad79a req-e098df9a-a36a-4a3e-ab7d-722d3ffd9846 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:03.689455 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-5f90a53c-56aa-46fd-8e82-a1b1407ad79a req-e098df9a-a36a-4a3e-ab7d-722d3ffd9846 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:03.689974 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-5f90a53c-56aa-46fd-8e82-a1b1407ad79a req-e098df9a-a36a-4a3e-ab7d-722d3ffd9846 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:03.690465 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3289f910-1f6d-487d-9089-843225af7291 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:03.719634 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3289f910-1f6d-487d-9089-843225af7291 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:03.726149 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3289f910-1f6d-487d-9089-843225af7291 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:03.728028 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3289f910-1f6d-487d-9089-843225af7291 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1404 microversion: 2.20 time: 0.501583 Oct 17 14:05:03.728160 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-5f90a53c-56aa-46fd-8e82-a1b1407ad79a req-e098df9a-a36a-4a3e-ab7d-722d3ffd9846 service nova] Creating event network-vif-plugged:b00489ac-2c3b-4d9e-843a-d9962aa3d085 for instance 32c279ba-2f76-4986-be6d-1029602677ed on n-h2-854247-14 Oct 17 14:05:03.731001 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2749/5368] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:05:03 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1404 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:05:03.745689 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-5f90a53c-56aa-46fd-8e82-a1b1407ad79a req-e098df9a-a36a-4a3e-ab7d-722d3ffd9846 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.679197 Oct 17 14:05:03.752171 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2620/5369] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:05:04.165451 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d87212fb-f254-4e70-a6a6-5bfe0711b553 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:04.166234 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d87212fb-f254-4e70-a6a6-5bfe0711b553 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] [instance: 98cedf8d-f6c2-41da-b3ae-438933b6ec00] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:04.179646 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d87212fb-f254-4e70-a6a6-5bfe0711b553 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:04.183285 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d87212fb-f254-4e70-a6a6-5bfe0711b553 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:04.184155 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d87212fb-f254-4e70-a6a6-5bfe0711b553 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:04.188271 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d87212fb-f254-4e70-a6a6-5bfe0711b553 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:04.190287 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d87212fb-f254-4e70-a6a6-5bfe0711b553 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:04.192080 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d87212fb-f254-4e70-a6a6-5bfe0711b553 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:04.578238 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d87212fb-f254-4e70-a6a6-5bfe0711b553 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:04.594759 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d87212fb-f254-4e70-a6a6-5bfe0711b553 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:04.599018 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d620f518-d99b-4e49-a7ab-44136f857164 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1075123217", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:05:04.599236 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d87212fb-f254-4e70-a6a6-5bfe0711b553 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:04.603092 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d87212fb-f254-4e70-a6a6-5bfe0711b553 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] 10.222.0.79 "GET /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00" status: 200 len: 1407 microversion: 2.54 time: 0.441393 Oct 17 14:05:04.604987 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2750/5370] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:05:04 2022] GET /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00 => generated 1407 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:05:04.727400 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-d620f518-d99b-4e49-a7ab-44136f857164 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] validate_networks() for None {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:05:04.761747 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e09ac035-6134-47f3-9d6e-8860a7b5cebe tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:04.762443 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e09ac035-6134-47f3-9d6e-8860a7b5cebe tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:04.774046 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e09ac035-6134-47f3-9d6e-8860a7b5cebe tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:04.778117 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e09ac035-6134-47f3-9d6e-8860a7b5cebe tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:04.778792 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e09ac035-6134-47f3-9d6e-8860a7b5cebe tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:04.779945 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e09ac035-6134-47f3-9d6e-8860a7b5cebe tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:04.782285 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e09ac035-6134-47f3-9d6e-8860a7b5cebe tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:04.783281 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e09ac035-6134-47f3-9d6e-8860a7b5cebe tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:05.217076 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:05:05.542753 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=10 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:05:05.918950 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e09ac035-6134-47f3-9d6e-8860a7b5cebe tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:05.937397 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e09ac035-6134-47f3-9d6e-8860a7b5cebe tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:05.941822 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e09ac035-6134-47f3-9d6e-8860a7b5cebe tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:05.943944 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e09ac035-6134-47f3-9d6e-8860a7b5cebe tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1404 microversion: 2.20 time: 1.186352 Oct 17 14:05:05.948235 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2751/5371] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:05:04 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1404 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:05:05.967547 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-caa4750f-9e72-4331-b21e-110f9696bb32 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:05.968233 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-caa4750f-9e72-4331-b21e-110f9696bb32 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] [instance: 98cedf8d-f6c2-41da-b3ae-438933b6ec00] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:05.978458 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-caa4750f-9e72-4331-b21e-110f9696bb32 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:05.978952 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-caa4750f-9e72-4331-b21e-110f9696bb32 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:05.979417 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-caa4750f-9e72-4331-b21e-110f9696bb32 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:05.980386 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-caa4750f-9e72-4331-b21e-110f9696bb32 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:05.980958 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-caa4750f-9e72-4331-b21e-110f9696bb32 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:05.982231 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-caa4750f-9e72-4331-b21e-110f9696bb32 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:06.087903 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-caa4750f-9e72-4331-b21e-110f9696bb32 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:06.107486 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-caa4750f-9e72-4331-b21e-110f9696bb32 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:06.109087 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-caa4750f-9e72-4331-b21e-110f9696bb32 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:06.110358 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-caa4750f-9e72-4331-b21e-110f9696bb32 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] 10.222.0.79 "GET /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00" status: 200 len: 1407 microversion: 2.54 time: 0.158877 Oct 17 14:05:06.110896 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2752/5372] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:05:05 2022] GET /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:05:06.190906 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-d620f518-d99b-4e49-a7ab-44136f857164 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:05:06.191388 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-d620f518-d99b-4e49-a7ab-44136f857164 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:05:06.191868 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-d620f518-d99b-4e49-a7ab-44136f857164 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:05:06.192461 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-d620f518-d99b-4e49-a7ab-44136f857164 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:05:06.193389 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-d620f518-d99b-4e49-a7ab-44136f857164 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:05:06.221844 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d620f518-d99b-4e49-a7ab-44136f857164 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:06.223009 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d620f518-d99b-4e49-a7ab-44136f857164 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:06.225561 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d620f518-d99b-4e49-a7ab-44136f857164 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:06.226824 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d620f518-d99b-4e49-a7ab-44136f857164 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:06.228786 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d620f518-d99b-4e49-a7ab-44136f857164 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:06.230957 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d620f518-d99b-4e49-a7ab-44136f857164 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:06.275237 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-d620f518-d99b-4e49-a7ab-44136f857164 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Getting quotas for project 0a0a677cf95f4c7e93534ae4e9dfd55b. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:05:06.281454 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-d620f518-d99b-4e49-a7ab-44136f857164 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Getting quotas for user 5a1985e2c6784e159b51a6895f9e428e and project 0a0a677cf95f4c7e93534ae4e9dfd55b. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:05:06.294741 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d620f518-d99b-4e49-a7ab-44136f857164 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:05:06.298188 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d620f518-d99b-4e49-a7ab-44136f857164 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] [instance: 23841bc8-e69b-40aa-abe2-31282ca6415d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:05:06.375069 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d620f518-d99b-4e49-a7ab-44136f857164 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.778569 Oct 17 14:05:06.375901 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2621/5373] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 14:05:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:05:06.387483 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-dfcb46cd-e980-413b-8980-f52b79e51b10 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:06.388100 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-dfcb46cd-e980-413b-8980-f52b79e51b10 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] [instance: 23841bc8-e69b-40aa-abe2-31282ca6415d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:06.516372 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-dfcb46cd-e980-413b-8980-f52b79e51b10 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1985e2c6784e159b51a6895f9e428e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0a677cf95f4c7e93534ae4e9dfd55b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:06.525326 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-dfcb46cd-e980-413b-8980-f52b79e51b10 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] 10.222.0.79 "GET /compute/v2.1/servers/23841bc8-e69b-40aa-abe2-31282ca6415d" status: 200 len: 1214 microversion: 2.1 time: 0.141653 Oct 17 14:05:06.544060 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2753/5374] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:05:06 2022] GET /compute/v2.1/servers/23841bc8-e69b-40aa-abe2-31282ca6415d => generated 1214 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:05:06.972887 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-840f2886-6020-42af-8f31-811adca38443 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:06.973503 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-840f2886-6020-42af-8f31-811adca38443 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:06.992237 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-840f2886-6020-42af-8f31-811adca38443 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:06.992784 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-840f2886-6020-42af-8f31-811adca38443 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:06.994119 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-840f2886-6020-42af-8f31-811adca38443 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:06.995443 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-840f2886-6020-42af-8f31-811adca38443 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:06.995905 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-840f2886-6020-42af-8f31-811adca38443 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:06.998035 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-840f2886-6020-42af-8f31-811adca38443 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:07.142070 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-24162c3f-9454-4e4b-8f91-11210add5968 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:07.143501 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-24162c3f-9454-4e4b-8f91-11210add5968 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] [instance: 98cedf8d-f6c2-41da-b3ae-438933b6ec00] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:07.161327 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-24162c3f-9454-4e4b-8f91-11210add5968 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:07.161899 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-24162c3f-9454-4e4b-8f91-11210add5968 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:07.162513 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-24162c3f-9454-4e4b-8f91-11210add5968 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:07.163596 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-24162c3f-9454-4e4b-8f91-11210add5968 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:07.164359 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-24162c3f-9454-4e4b-8f91-11210add5968 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:07.165076 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-24162c3f-9454-4e4b-8f91-11210add5968 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:07.310280 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-24162c3f-9454-4e4b-8f91-11210add5968 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:07.333429 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-24162c3f-9454-4e4b-8f91-11210add5968 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:07.340674 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-24162c3f-9454-4e4b-8f91-11210add5968 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:07.341941 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-24162c3f-9454-4e4b-8f91-11210add5968 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] 10.222.0.79 "GET /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00" status: 200 len: 1407 microversion: 2.54 time: 0.205506 Oct 17 14:05:07.355154 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2754/5375] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:05:07 2022] GET /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00 => generated 1407 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 14:05:07.390761 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-840f2886-6020-42af-8f31-811adca38443 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:07.407020 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-840f2886-6020-42af-8f31-811adca38443 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:07.409670 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-840f2886-6020-42af-8f31-811adca38443 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:07.410876 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-840f2886-6020-42af-8f31-811adca38443 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1596 microversion: 2.20 time: 0.442196 Oct 17 14:05:07.414036 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2622/5376] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:05:06 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1596 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:05:07.440503 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a01bd66a-4703-43a1-ab87-e5cc14e695f7 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:07.441025 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a01bd66a-4703-43a1-ab87-e5cc14e695f7 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:07.449304 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a01bd66a-4703-43a1-ab87-e5cc14e695f7 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:07.449791 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a01bd66a-4703-43a1-ab87-e5cc14e695f7 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:07.451037 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a01bd66a-4703-43a1-ab87-e5cc14e695f7 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:07.452203 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a01bd66a-4703-43a1-ab87-e5cc14e695f7 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:07.452677 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a01bd66a-4703-43a1-ab87-e5cc14e695f7 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:07.453099 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a01bd66a-4703-43a1-ab87-e5cc14e695f7 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:07.556732 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ab3bbf79-821f-41c5-997c-39b69f8a34fc tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:07.558157 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ab3bbf79-821f-41c5-997c-39b69f8a34fc tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] [instance: 23841bc8-e69b-40aa-abe2-31282ca6415d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:07.577318 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ab3bbf79-821f-41c5-997c-39b69f8a34fc tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:07.579030 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ab3bbf79-821f-41c5-997c-39b69f8a34fc tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:07.580329 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ab3bbf79-821f-41c5-997c-39b69f8a34fc tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:07.581311 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ab3bbf79-821f-41c5-997c-39b69f8a34fc tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:07.581962 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ab3bbf79-821f-41c5-997c-39b69f8a34fc tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:07.582661 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ab3bbf79-821f-41c5-997c-39b69f8a34fc tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:07.587525 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a01bd66a-4703-43a1-ab87-e5cc14e695f7 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.152434 Oct 17 14:05:07.588124 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2755/5377] 10.222.0.79 () {60 vars in 1316 bytes} [Mon Oct 17 14:05:07 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed/os-interface => generated 285 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:05:07.773054 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ab3bbf79-821f-41c5-997c-39b69f8a34fc tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1985e2c6784e159b51a6895f9e428e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0a677cf95f4c7e93534ae4e9dfd55b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:07.783957 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ab3bbf79-821f-41c5-997c-39b69f8a34fc tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] 10.222.0.79 "GET /compute/v2.1/servers/23841bc8-e69b-40aa-abe2-31282ca6415d" status: 200 len: 1210 microversion: 2.1 time: 0.234589 Oct 17 14:05:07.787184 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2623/5378] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:05:07 2022] GET /compute/v2.1/servers/23841bc8-e69b-40aa-abe2-31282ca6415d => generated 1210 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:05:08.373311 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4c2baceb-d3ca-49c2-9003-c2c7842770a9 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:08.374456 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4c2baceb-d3ca-49c2-9003-c2c7842770a9 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] [instance: 98cedf8d-f6c2-41da-b3ae-438933b6ec00] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:08.400090 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4c2baceb-d3ca-49c2-9003-c2c7842770a9 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:08.401362 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4c2baceb-d3ca-49c2-9003-c2c7842770a9 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:08.401709 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4c2baceb-d3ca-49c2-9003-c2c7842770a9 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:08.408583 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4c2baceb-d3ca-49c2-9003-c2c7842770a9 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:08.412441 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4c2baceb-d3ca-49c2-9003-c2c7842770a9 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:08.412938 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4c2baceb-d3ca-49c2-9003-c2c7842770a9 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:08.818817 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-55dfff25-77a3-4081-9464-16ee5cffc88a tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:08.820423 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-55dfff25-77a3-4081-9464-16ee5cffc88a tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] [instance: 23841bc8-e69b-40aa-abe2-31282ca6415d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:08.837641 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-55dfff25-77a3-4081-9464-16ee5cffc88a tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:08.838488 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-55dfff25-77a3-4081-9464-16ee5cffc88a tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:08.839135 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-55dfff25-77a3-4081-9464-16ee5cffc88a tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:08.840177 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-55dfff25-77a3-4081-9464-16ee5cffc88a tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:08.841264 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-55dfff25-77a3-4081-9464-16ee5cffc88a tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:08.842368 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-55dfff25-77a3-4081-9464-16ee5cffc88a tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:09.030666 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-55dfff25-77a3-4081-9464-16ee5cffc88a tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1985e2c6784e159b51a6895f9e428e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0a677cf95f4c7e93534ae4e9dfd55b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:09.053553 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-55dfff25-77a3-4081-9464-16ee5cffc88a tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] 10.222.0.79 "GET /compute/v2.1/servers/23841bc8-e69b-40aa-abe2-31282ca6415d" status: 200 len: 1272 microversion: 2.1 time: 0.241314 Oct 17 14:05:09.057907 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4c2baceb-d3ca-49c2-9003-c2c7842770a9 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:09.064557 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2624/5379] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:05:08 2022] GET /compute/v2.1/servers/23841bc8-e69b-40aa-abe2-31282ca6415d => generated 1272 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:05:09.074270 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4c2baceb-d3ca-49c2-9003-c2c7842770a9 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:09.075839 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4c2baceb-d3ca-49c2-9003-c2c7842770a9 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:09.077167 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4c2baceb-d3ca-49c2-9003-c2c7842770a9 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] 10.222.0.79 "GET /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00" status: 200 len: 1407 microversion: 2.54 time: 0.710957 Oct 17 14:05:09.088019 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2756/5380] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:05:08 2022] GET /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00 => generated 1407 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:05:10.090173 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e8d75da0-7d91-46aa-889c-e27a9cdb374e tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:10.090936 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e8d75da0-7d91-46aa-889c-e27a9cdb374e tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] [instance: 23841bc8-e69b-40aa-abe2-31282ca6415d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:10.108550 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e8d75da0-7d91-46aa-889c-e27a9cdb374e tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:10.111233 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e8d75da0-7d91-46aa-889c-e27a9cdb374e tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:10.111379 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e8d75da0-7d91-46aa-889c-e27a9cdb374e tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:10.112214 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e8d75da0-7d91-46aa-889c-e27a9cdb374e tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:10.112903 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e8d75da0-7d91-46aa-889c-e27a9cdb374e tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:10.115159 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e8d75da0-7d91-46aa-889c-e27a9cdb374e tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:10.125349 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-48c27393-7630-4ff9-9655-9f711462f3a1 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:10.127462 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-48c27393-7630-4ff9-9655-9f711462f3a1 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] [instance: 98cedf8d-f6c2-41da-b3ae-438933b6ec00] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:10.148986 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48c27393-7630-4ff9-9655-9f711462f3a1 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:10.151844 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48c27393-7630-4ff9-9655-9f711462f3a1 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:10.152823 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48c27393-7630-4ff9-9655-9f711462f3a1 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:10.153775 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48c27393-7630-4ff9-9655-9f711462f3a1 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:10.156172 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48c27393-7630-4ff9-9655-9f711462f3a1 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:10.157673 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48c27393-7630-4ff9-9655-9f711462f3a1 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:10.361514 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e8d75da0-7d91-46aa-889c-e27a9cdb374e tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1985e2c6784e159b51a6895f9e428e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0a677cf95f4c7e93534ae4e9dfd55b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:10.376507 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e8d75da0-7d91-46aa-889c-e27a9cdb374e tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] 10.222.0.79 "GET /compute/v2.1/servers/23841bc8-e69b-40aa-abe2-31282ca6415d" status: 200 len: 1272 microversion: 2.1 time: 0.290983 Oct 17 14:05:10.377642 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2625/5381] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:05:10 2022] GET /compute/v2.1/servers/23841bc8-e69b-40aa-abe2-31282ca6415d => generated 1272 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:05:10.527704 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-48c27393-7630-4ff9-9655-9f711462f3a1 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:10.537395 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-48c27393-7630-4ff9-9655-9f711462f3a1 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:10.544072 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-48c27393-7630-4ff9-9655-9f711462f3a1 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:10.550183 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-48c27393-7630-4ff9-9655-9f711462f3a1 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] 10.222.0.79 "GET /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00" status: 200 len: 1407 microversion: 2.54 time: 0.443990 Oct 17 14:05:10.550918 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2757/5382] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:05:10 2022] GET /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00 => generated 1407 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:05:11.401280 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-41a09ebb-3df8-4dd1-8c4c-e90d48721a97 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:11.402768 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-41a09ebb-3df8-4dd1-8c4c-e90d48721a97 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] [instance: 23841bc8-e69b-40aa-abe2-31282ca6415d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:11.430916 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-41a09ebb-3df8-4dd1-8c4c-e90d48721a97 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:11.431874 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-41a09ebb-3df8-4dd1-8c4c-e90d48721a97 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:11.432539 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-41a09ebb-3df8-4dd1-8c4c-e90d48721a97 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:11.433504 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-41a09ebb-3df8-4dd1-8c4c-e90d48721a97 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:11.436359 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-41a09ebb-3df8-4dd1-8c4c-e90d48721a97 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:11.441061 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-41a09ebb-3df8-4dd1-8c4c-e90d48721a97 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:11.582198 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3a26dcaa-f3cc-4834-b009-2eb742b63122 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:11.584525 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3a26dcaa-f3cc-4834-b009-2eb742b63122 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] [instance: 98cedf8d-f6c2-41da-b3ae-438933b6ec00] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:11.595707 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3a26dcaa-f3cc-4834-b009-2eb742b63122 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:11.596963 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3a26dcaa-f3cc-4834-b009-2eb742b63122 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:11.610056 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3a26dcaa-f3cc-4834-b009-2eb742b63122 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:11.610632 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3a26dcaa-f3cc-4834-b009-2eb742b63122 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:11.613799 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3a26dcaa-f3cc-4834-b009-2eb742b63122 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:11.615728 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3a26dcaa-f3cc-4834-b009-2eb742b63122 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:11.659958 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=100 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:05:11.879052 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3a26dcaa-f3cc-4834-b009-2eb742b63122 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:11.891290 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3a26dcaa-f3cc-4834-b009-2eb742b63122 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:11.898644 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3a26dcaa-f3cc-4834-b009-2eb742b63122 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:11.900418 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3a26dcaa-f3cc-4834-b009-2eb742b63122 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] 10.222.0.79 "GET /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00" status: 200 len: 1407 microversion: 2.54 time: 0.324101 Oct 17 14:05:11.917570 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2758/5383] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:05:11 2022] GET /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00 => generated 1407 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:05:11.929067 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-6f8d8e1e-fcfb-4dc0-b13d-f8b3a5eb1922 req-98aacb1b-37e8-4150-8cad-4ee5a0408104 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32c279ba-2f76-4986-be6d-1029602677ed", "tag": "b00489ac-2c3b-4d9e-843a-d9962aa3d085"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:05:11.946576 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-6f8d8e1e-fcfb-4dc0-b13d-f8b3a5eb1922 req-98aacb1b-37e8-4150-8cad-4ee5a0408104 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:11.948066 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-6f8d8e1e-fcfb-4dc0-b13d-f8b3a5eb1922 req-98aacb1b-37e8-4150-8cad-4ee5a0408104 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:11.948513 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-6f8d8e1e-fcfb-4dc0-b13d-f8b3a5eb1922 req-98aacb1b-37e8-4150-8cad-4ee5a0408104 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:11.976370 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-41a09ebb-3df8-4dd1-8c4c-e90d48721a97 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1985e2c6784e159b51a6895f9e428e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0a677cf95f4c7e93534ae4e9dfd55b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:11.979546 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-6f8d8e1e-fcfb-4dc0-b13d-f8b3a5eb1922 req-98aacb1b-37e8-4150-8cad-4ee5a0408104 service nova] Creating event network-changed:b00489ac-2c3b-4d9e-843a-d9962aa3d085 for instance 32c279ba-2f76-4986-be6d-1029602677ed on n-h2-854247-14 Oct 17 14:05:11.992686 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-6f8d8e1e-fcfb-4dc0-b13d-f8b3a5eb1922 req-98aacb1b-37e8-4150-8cad-4ee5a0408104 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072209 Oct 17 14:05:11.993426 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-41a09ebb-3df8-4dd1-8c4c-e90d48721a97 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] 10.222.0.79 "GET /compute/v2.1/servers/23841bc8-e69b-40aa-abe2-31282ca6415d" status: 200 len: 1272 microversion: 2.1 time: 0.594302 Oct 17 14:05:11.994548 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2759/5384] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:05:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:05:11.995496 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2626/5385] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:05:11 2022] GET /compute/v2.1/servers/23841bc8-e69b-40aa-abe2-31282ca6415d => generated 1272 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:05:12.937249 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e8f1dbfc-726f-4626-af57-f9e91b80c7af tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:12.938775 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e8f1dbfc-726f-4626-af57-f9e91b80c7af tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] [instance: 98cedf8d-f6c2-41da-b3ae-438933b6ec00] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:12.955091 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e8f1dbfc-726f-4626-af57-f9e91b80c7af tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:12.967467 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e8f1dbfc-726f-4626-af57-f9e91b80c7af tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:12.968187 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e8f1dbfc-726f-4626-af57-f9e91b80c7af tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:12.968982 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e8f1dbfc-726f-4626-af57-f9e91b80c7af tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:12.969452 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e8f1dbfc-726f-4626-af57-f9e91b80c7af tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:12.976072 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e8f1dbfc-726f-4626-af57-f9e91b80c7af tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:13.025045 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7210e853-5814-4d36-88cd-d5c481e9fb95 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:13.026755 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7210e853-5814-4d36-88cd-d5c481e9fb95 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] [instance: 23841bc8-e69b-40aa-abe2-31282ca6415d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:13.051240 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7210e853-5814-4d36-88cd-d5c481e9fb95 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:13.053679 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7210e853-5814-4d36-88cd-d5c481e9fb95 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:13.055771 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7210e853-5814-4d36-88cd-d5c481e9fb95 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:13.061007 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7210e853-5814-4d36-88cd-d5c481e9fb95 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:13.066338 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7210e853-5814-4d36-88cd-d5c481e9fb95 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:13.068584 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7210e853-5814-4d36-88cd-d5c481e9fb95 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:13.102434 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:05:13.178693 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e8f1dbfc-726f-4626-af57-f9e91b80c7af tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:13.192946 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e8f1dbfc-726f-4626-af57-f9e91b80c7af tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:13.194393 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e8f1dbfc-726f-4626-af57-f9e91b80c7af tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:13.210576 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e8f1dbfc-726f-4626-af57-f9e91b80c7af tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] 10.222.0.79 "GET /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00" status: 200 len: 1407 microversion: 2.54 time: 0.267006 Oct 17 14:05:13.214622 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2760/5386] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:05:12 2022] GET /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00 => generated 1407 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:05:14.049009 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7210e853-5814-4d36-88cd-d5c481e9fb95 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1985e2c6784e159b51a6895f9e428e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0a677cf95f4c7e93534ae4e9dfd55b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:14.064981 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7210e853-5814-4d36-88cd-d5c481e9fb95 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] 10.222.0.79 "GET /compute/v2.1/servers/23841bc8-e69b-40aa-abe2-31282ca6415d" status: 200 len: 1314 microversion: 2.1 time: 1.047895 Oct 17 14:05:14.065919 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2627/5387] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:05:13 2022] GET /compute/v2.1/servers/23841bc8-e69b-40aa-abe2-31282ca6415d => generated 1314 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:05:14.241445 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d7a4b29c-d370-4e7b-bf39-7cf8cf055145 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:14.242946 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d7a4b29c-d370-4e7b-bf39-7cf8cf055145 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] [instance: 98cedf8d-f6c2-41da-b3ae-438933b6ec00] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:14.255463 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d7a4b29c-d370-4e7b-bf39-7cf8cf055145 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:14.259228 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d7a4b29c-d370-4e7b-bf39-7cf8cf055145 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:14.261327 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d7a4b29c-d370-4e7b-bf39-7cf8cf055145 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:14.264606 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d7a4b29c-d370-4e7b-bf39-7cf8cf055145 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:14.266351 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d7a4b29c-d370-4e7b-bf39-7cf8cf055145 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:14.267058 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d7a4b29c-d370-4e7b-bf39-7cf8cf055145 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:14.690201 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d7a4b29c-d370-4e7b-bf39-7cf8cf055145 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:14.708669 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d7a4b29c-d370-4e7b-bf39-7cf8cf055145 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:14.712315 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d7a4b29c-d370-4e7b-bf39-7cf8cf055145 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:14.714413 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d7a4b29c-d370-4e7b-bf39-7cf8cf055145 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] 10.222.0.79 "GET /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00" status: 200 len: 1407 microversion: 2.54 time: 0.477597 Oct 17 14:05:14.716734 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2761/5388] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:05:14 2022] GET /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00 => generated 1407 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:05:15.093748 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-41caf916-2366-4b31-8bed-71c32d44f199 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:15.094764 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-41caf916-2366-4b31-8bed-71c32d44f199 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] [instance: 23841bc8-e69b-40aa-abe2-31282ca6415d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:15.111479 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-41caf916-2366-4b31-8bed-71c32d44f199 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:15.112369 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-41caf916-2366-4b31-8bed-71c32d44f199 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:15.113065 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-41caf916-2366-4b31-8bed-71c32d44f199 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:15.114193 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-41caf916-2366-4b31-8bed-71c32d44f199 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:15.114996 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-41caf916-2366-4b31-8bed-71c32d44f199 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:15.116347 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-41caf916-2366-4b31-8bed-71c32d44f199 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:15.743145 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2e87c1ec-ea65-41b1-a40d-83271b3157d0 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:15.744412 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2e87c1ec-ea65-41b1-a40d-83271b3157d0 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] [instance: 98cedf8d-f6c2-41da-b3ae-438933b6ec00] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:15.758385 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2e87c1ec-ea65-41b1-a40d-83271b3157d0 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:15.760920 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2e87c1ec-ea65-41b1-a40d-83271b3157d0 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:15.762197 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2e87c1ec-ea65-41b1-a40d-83271b3157d0 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:15.763098 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2e87c1ec-ea65-41b1-a40d-83271b3157d0 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:15.765420 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2e87c1ec-ea65-41b1-a40d-83271b3157d0 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:15.766216 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2e87c1ec-ea65-41b1-a40d-83271b3157d0 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:16.259731 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:05:16.265704 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-41caf916-2366-4b31-8bed-71c32d44f199 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1985e2c6784e159b51a6895f9e428e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0a677cf95f4c7e93534ae4e9dfd55b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:16.275485 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2e87c1ec-ea65-41b1-a40d-83271b3157d0 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:16.278986 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-41caf916-2366-4b31-8bed-71c32d44f199 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] 10.222.0.79 "GET /compute/v2.1/servers/23841bc8-e69b-40aa-abe2-31282ca6415d" status: 200 len: 1314 microversion: 2.1 time: 1.190770 Oct 17 14:05:16.284276 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2628/5389] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:05:15 2022] GET /compute/v2.1/servers/23841bc8-e69b-40aa-abe2-31282ca6415d => generated 1314 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:05:16.290902 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2e87c1ec-ea65-41b1-a40d-83271b3157d0 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:16.294217 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2e87c1ec-ea65-41b1-a40d-83271b3157d0 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:16.301450 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2e87c1ec-ea65-41b1-a40d-83271b3157d0 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] 10.222.0.79 "GET /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00" status: 200 len: 1407 microversion: 2.54 time: 0.558665 Oct 17 14:05:16.324077 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2762/5390] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:05:15 2022] GET /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00 => generated 1407 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:05:16.601663 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-81a25e7b-794c-4118-aca0-fc3b481a07cb req-1d2638b9-f942-449b-a3a1-fca4913d4458 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23841bc8-e69b-40aa-abe2-31282ca6415d", "tag": "1f5fee6d-0e3c-4034-af1b-c997d41664b4"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:05:16.626902 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=6 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:05:16.627929 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=6 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:05:16.630631 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-81a25e7b-794c-4118-aca0-fc3b481a07cb req-1d2638b9-f942-449b-a3a1-fca4913d4458 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:16.631316 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-81a25e7b-794c-4118-aca0-fc3b481a07cb req-1d2638b9-f942-449b-a3a1-fca4913d4458 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:16.631910 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-81a25e7b-794c-4118-aca0-fc3b481a07cb req-1d2638b9-f942-449b-a3a1-fca4913d4458 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:16.661587 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-81a25e7b-794c-4118-aca0-fc3b481a07cb req-1d2638b9-f942-449b-a3a1-fca4913d4458 service nova] Creating event network-changed:1f5fee6d-0e3c-4034-af1b-c997d41664b4 for instance 23841bc8-e69b-40aa-abe2-31282ca6415d on n-h2-854247-14 Oct 17 14:05:16.689894 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-81a25e7b-794c-4118-aca0-fc3b481a07cb req-1d2638b9-f942-449b-a3a1-fca4913d4458 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093213 Oct 17 14:05:16.690723 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2629/5391] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:05:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:05:17.307885 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=14 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:05:17.314953 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-df12c0d7-de67-4a13-a7c8-4bd8df7a7f97 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:17.315881 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-df12c0d7-de67-4a13-a7c8-4bd8df7a7f97 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] [instance: 23841bc8-e69b-40aa-abe2-31282ca6415d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:17.323579 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df12c0d7-de67-4a13-a7c8-4bd8df7a7f97 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:17.324211 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df12c0d7-de67-4a13-a7c8-4bd8df7a7f97 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:17.324718 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df12c0d7-de67-4a13-a7c8-4bd8df7a7f97 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:17.325868 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df12c0d7-de67-4a13-a7c8-4bd8df7a7f97 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:17.326396 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df12c0d7-de67-4a13-a7c8-4bd8df7a7f97 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:17.327897 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df12c0d7-de67-4a13-a7c8-4bd8df7a7f97 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:17.336084 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a69b6974-7d4e-4c05-aab0-347851acc32b tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:17.338169 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a69b6974-7d4e-4c05-aab0-347851acc32b tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] [instance: 98cedf8d-f6c2-41da-b3ae-438933b6ec00] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:17.352455 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a69b6974-7d4e-4c05-aab0-347851acc32b tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:17.357025 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a69b6974-7d4e-4c05-aab0-347851acc32b tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:17.358482 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a69b6974-7d4e-4c05-aab0-347851acc32b tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:17.359593 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a69b6974-7d4e-4c05-aab0-347851acc32b tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:17.360298 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a69b6974-7d4e-4c05-aab0-347851acc32b tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:17.360945 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a69b6974-7d4e-4c05-aab0-347851acc32b tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:17.646134 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a69b6974-7d4e-4c05-aab0-347851acc32b tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:17.654957 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a69b6974-7d4e-4c05-aab0-347851acc32b tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:17.657048 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a69b6974-7d4e-4c05-aab0-347851acc32b tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:17.658252 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a69b6974-7d4e-4c05-aab0-347851acc32b tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] 10.222.0.79 "GET /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00" status: 200 len: 1407 microversion: 2.54 time: 0.328205 Oct 17 14:05:17.658862 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2630/5392] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:05:17 2022] GET /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00 => generated 1407 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 14:05:17.841249 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-df12c0d7-de67-4a13-a7c8-4bd8df7a7f97 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1985e2c6784e159b51a6895f9e428e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0a677cf95f4c7e93534ae4e9dfd55b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:17.863643 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-df12c0d7-de67-4a13-a7c8-4bd8df7a7f97 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] 10.222.0.79 "GET /compute/v2.1/servers/23841bc8-e69b-40aa-abe2-31282ca6415d" status: 200 len: 1314 microversion: 2.1 time: 0.557505 Oct 17 14:05:17.865268 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2763/5393] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:05:17 2022] GET /compute/v2.1/servers/23841bc8-e69b-40aa-abe2-31282ca6415d => generated 1314 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:05:18.685204 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7426edb9-375c-42ec-a153-4075e7611b49 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:18.685817 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7426edb9-375c-42ec-a153-4075e7611b49 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] [instance: 98cedf8d-f6c2-41da-b3ae-438933b6ec00] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:18.697763 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7426edb9-375c-42ec-a153-4075e7611b49 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:18.700358 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7426edb9-375c-42ec-a153-4075e7611b49 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:18.700538 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7426edb9-375c-42ec-a153-4075e7611b49 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:18.701479 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7426edb9-375c-42ec-a153-4075e7611b49 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:18.704183 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7426edb9-375c-42ec-a153-4075e7611b49 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:18.704844 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7426edb9-375c-42ec-a153-4075e7611b49 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:18.901973 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4902f1c6-90b3-489c-9bcc-5957541fda00 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:18.902591 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4902f1c6-90b3-489c-9bcc-5957541fda00 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] [instance: 23841bc8-e69b-40aa-abe2-31282ca6415d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:18.915412 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7426edb9-375c-42ec-a153-4075e7611b49 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:18.934551 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7426edb9-375c-42ec-a153-4075e7611b49 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:18.955016 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7426edb9-375c-42ec-a153-4075e7611b49 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:18.958722 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7426edb9-375c-42ec-a153-4075e7611b49 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] 10.222.0.79 "GET /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00" status: 200 len: 1407 microversion: 2.54 time: 0.277438 Oct 17 14:05:18.961063 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4902f1c6-90b3-489c-9bcc-5957541fda00 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:18.961572 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4902f1c6-90b3-489c-9bcc-5957541fda00 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:18.962032 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2631/5394] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:05:18 2022] GET /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00 => generated 1407 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:05:18.962278 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4902f1c6-90b3-489c-9bcc-5957541fda00 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:18.963007 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4902f1c6-90b3-489c-9bcc-5957541fda00 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:18.963495 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4902f1c6-90b3-489c-9bcc-5957541fda00 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:18.963920 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4902f1c6-90b3-489c-9bcc-5957541fda00 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:19.695184 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4902f1c6-90b3-489c-9bcc-5957541fda00 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1985e2c6784e159b51a6895f9e428e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0a677cf95f4c7e93534ae4e9dfd55b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:19.710221 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4902f1c6-90b3-489c-9bcc-5957541fda00 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] 10.222.0.79 "GET /compute/v2.1/servers/23841bc8-e69b-40aa-abe2-31282ca6415d" status: 200 len: 1314 microversion: 2.1 time: 0.817427 Oct 17 14:05:19.711124 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2764/5395] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:05:18 2022] GET /compute/v2.1/servers/23841bc8-e69b-40aa-abe2-31282ca6415d => generated 1314 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:05:19.992607 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6eba7be5-144d-4728-8803-0fedc9a9ed69 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:19.994095 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6eba7be5-144d-4728-8803-0fedc9a9ed69 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] [instance: 98cedf8d-f6c2-41da-b3ae-438933b6ec00] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:20.016019 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6eba7be5-144d-4728-8803-0fedc9a9ed69 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:20.019068 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6eba7be5-144d-4728-8803-0fedc9a9ed69 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:20.019741 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6eba7be5-144d-4728-8803-0fedc9a9ed69 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:20.021890 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6eba7be5-144d-4728-8803-0fedc9a9ed69 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:20.022557 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6eba7be5-144d-4728-8803-0fedc9a9ed69 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:20.023816 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6eba7be5-144d-4728-8803-0fedc9a9ed69 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:20.207796 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6eba7be5-144d-4728-8803-0fedc9a9ed69 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:20.217562 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6eba7be5-144d-4728-8803-0fedc9a9ed69 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:20.219549 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6eba7be5-144d-4728-8803-0fedc9a9ed69 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:20.220935 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6eba7be5-144d-4728-8803-0fedc9a9ed69 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] 10.222.0.79 "GET /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00" status: 200 len: 1407 microversion: 2.54 time: 0.236552 Oct 17 14:05:20.223334 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2632/5396] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:05:19 2022] GET /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00 => generated 1407 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:05:20.733878 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7bcc7e3d-69c4-4ed9-8285-166e4f8b075f tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:20.735158 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7bcc7e3d-69c4-4ed9-8285-166e4f8b075f tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] [instance: 23841bc8-e69b-40aa-abe2-31282ca6415d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:20.748664 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7bcc7e3d-69c4-4ed9-8285-166e4f8b075f tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:20.749869 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7bcc7e3d-69c4-4ed9-8285-166e4f8b075f tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:20.752618 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7bcc7e3d-69c4-4ed9-8285-166e4f8b075f tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:20.753577 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7bcc7e3d-69c4-4ed9-8285-166e4f8b075f tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:20.756394 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7bcc7e3d-69c4-4ed9-8285-166e4f8b075f tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:20.759719 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7bcc7e3d-69c4-4ed9-8285-166e4f8b075f tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:21.108158 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7bcc7e3d-69c4-4ed9-8285-166e4f8b075f tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1985e2c6784e159b51a6895f9e428e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0a677cf95f4c7e93534ae4e9dfd55b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:21.133614 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7bcc7e3d-69c4-4ed9-8285-166e4f8b075f tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] 10.222.0.79 "GET /compute/v2.1/servers/23841bc8-e69b-40aa-abe2-31282ca6415d" status: 200 len: 1314 microversion: 2.1 time: 0.403723 Oct 17 14:05:21.136151 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2765/5397] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:05:20 2022] GET /compute/v2.1/servers/23841bc8-e69b-40aa-abe2-31282ca6415d => generated 1314 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:05:21.250696 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e511a147-833c-460b-b7ad-187e6bac8236 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:21.251920 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e511a147-833c-460b-b7ad-187e6bac8236 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] [instance: 98cedf8d-f6c2-41da-b3ae-438933b6ec00] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:21.264957 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e511a147-833c-460b-b7ad-187e6bac8236 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:21.265663 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e511a147-833c-460b-b7ad-187e6bac8236 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:21.266294 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e511a147-833c-460b-b7ad-187e6bac8236 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:21.267203 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e511a147-833c-460b-b7ad-187e6bac8236 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:21.267872 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e511a147-833c-460b-b7ad-187e6bac8236 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:21.268453 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e511a147-833c-460b-b7ad-187e6bac8236 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:21.369367 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e511a147-833c-460b-b7ad-187e6bac8236 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:21.379283 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e511a147-833c-460b-b7ad-187e6bac8236 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:21.380720 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e511a147-833c-460b-b7ad-187e6bac8236 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:21.381919 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e511a147-833c-460b-b7ad-187e6bac8236 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] 10.222.0.79 "GET /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00" status: 200 len: 1407 microversion: 2.54 time: 0.137419 Oct 17 14:05:21.399602 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2633/5398] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:05:21 2022] GET /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00 => generated 1407 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:05:22.160432 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1c933a8a-d6d0-433d-bbf6-a38c16dc1211 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:22.163395 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-1c933a8a-d6d0-433d-bbf6-a38c16dc1211 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] [instance: 23841bc8-e69b-40aa-abe2-31282ca6415d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:22.177960 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1c933a8a-d6d0-433d-bbf6-a38c16dc1211 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:22.179033 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1c933a8a-d6d0-433d-bbf6-a38c16dc1211 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:22.180116 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1c933a8a-d6d0-433d-bbf6-a38c16dc1211 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:22.181264 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1c933a8a-d6d0-433d-bbf6-a38c16dc1211 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:22.182136 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1c933a8a-d6d0-433d-bbf6-a38c16dc1211 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:22.183432 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1c933a8a-d6d0-433d-bbf6-a38c16dc1211 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:22.393733 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-1c933a8a-d6d0-433d-bbf6-a38c16dc1211 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1985e2c6784e159b51a6895f9e428e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0a677cf95f4c7e93534ae4e9dfd55b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:22.432575 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-69671a41-ee0a-442d-9f67-44cf28d6b282 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:22.433143 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-69671a41-ee0a-442d-9f67-44cf28d6b282 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] [instance: 98cedf8d-f6c2-41da-b3ae-438933b6ec00] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:22.477821 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1c933a8a-d6d0-433d-bbf6-a38c16dc1211 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] 10.222.0.79 "GET /compute/v2.1/servers/23841bc8-e69b-40aa-abe2-31282ca6415d" status: 200 len: 1314 microversion: 2.1 time: 0.316388 Oct 17 14:05:22.478754 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2766/5399] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:05:22 2022] GET /compute/v2.1/servers/23841bc8-e69b-40aa-abe2-31282ca6415d => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:05:22.480038 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69671a41-ee0a-442d-9f67-44cf28d6b282 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:22.485901 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69671a41-ee0a-442d-9f67-44cf28d6b282 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:22.486576 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69671a41-ee0a-442d-9f67-44cf28d6b282 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:22.488202 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69671a41-ee0a-442d-9f67-44cf28d6b282 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:22.488950 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69671a41-ee0a-442d-9f67-44cf28d6b282 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:22.490569 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69671a41-ee0a-442d-9f67-44cf28d6b282 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:22.605123 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-69671a41-ee0a-442d-9f67-44cf28d6b282 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:22.632574 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-69671a41-ee0a-442d-9f67-44cf28d6b282 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:22.634264 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-69671a41-ee0a-442d-9f67-44cf28d6b282 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:22.635970 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-69671a41-ee0a-442d-9f67-44cf28d6b282 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] 10.222.0.79 "GET /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00" status: 200 len: 1407 microversion: 2.54 time: 0.227012 Oct 17 14:05:22.638480 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2634/5400] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:05:22 2022] GET /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00 => generated 1407 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:05:23.117882 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-0d7b42b2-ef3b-4c7f-94d3-431ed97bf9de req-22738a16-4296-471c-a960-619020a7d543 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23841bc8-e69b-40aa-abe2-31282ca6415d", "name": "network-vif-plugged", "status": "completed", "tag": "1f5fee6d-0e3c-4034-af1b-c997d41664b4"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:05:23.132996 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-0d7b42b2-ef3b-4c7f-94d3-431ed97bf9de req-22738a16-4296-471c-a960-619020a7d543 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:23.133819 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-0d7b42b2-ef3b-4c7f-94d3-431ed97bf9de req-22738a16-4296-471c-a960-619020a7d543 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:23.134481 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-0d7b42b2-ef3b-4c7f-94d3-431ed97bf9de req-22738a16-4296-471c-a960-619020a7d543 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:23.162549 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-0d7b42b2-ef3b-4c7f-94d3-431ed97bf9de req-22738a16-4296-471c-a960-619020a7d543 service nova] Creating event network-vif-plugged:1f5fee6d-0e3c-4034-af1b-c997d41664b4 for instance 23841bc8-e69b-40aa-abe2-31282ca6415d on n-h2-854247-14 Oct 17 14:05:23.170524 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-0d7b42b2-ef3b-4c7f-94d3-431ed97bf9de req-22738a16-4296-471c-a960-619020a7d543 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057828 Oct 17 14:05:23.174898 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2767/5401] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:05:23.505840 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e30f1b19-5f37-4dd3-9324-714f6f4b6931 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:23.507727 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e30f1b19-5f37-4dd3-9324-714f6f4b6931 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] [instance: 23841bc8-e69b-40aa-abe2-31282ca6415d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:23.525445 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e30f1b19-5f37-4dd3-9324-714f6f4b6931 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:23.525953 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e30f1b19-5f37-4dd3-9324-714f6f4b6931 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:23.526715 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e30f1b19-5f37-4dd3-9324-714f6f4b6931 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:23.528897 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e30f1b19-5f37-4dd3-9324-714f6f4b6931 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:23.530952 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e30f1b19-5f37-4dd3-9324-714f6f4b6931 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:23.533314 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e30f1b19-5f37-4dd3-9324-714f6f4b6931 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:23.666107 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d95a2f5a-8419-4cae-9013-30b91e0672d8 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:23.666687 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d95a2f5a-8419-4cae-9013-30b91e0672d8 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] [instance: 98cedf8d-f6c2-41da-b3ae-438933b6ec00] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:23.678555 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d95a2f5a-8419-4cae-9013-30b91e0672d8 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:23.691950 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d95a2f5a-8419-4cae-9013-30b91e0672d8 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:23.692617 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d95a2f5a-8419-4cae-9013-30b91e0672d8 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:23.693552 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d95a2f5a-8419-4cae-9013-30b91e0672d8 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:23.694171 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d95a2f5a-8419-4cae-9013-30b91e0672d8 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:23.695259 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d95a2f5a-8419-4cae-9013-30b91e0672d8 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:23.750936 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e30f1b19-5f37-4dd3-9324-714f6f4b6931 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1985e2c6784e159b51a6895f9e428e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0a677cf95f4c7e93534ae4e9dfd55b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:23.759734 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e30f1b19-5f37-4dd3-9324-714f6f4b6931 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] 10.222.0.79 "GET /compute/v2.1/servers/23841bc8-e69b-40aa-abe2-31282ca6415d" status: 200 len: 1314 microversion: 2.1 time: 0.261056 Oct 17 14:05:23.760300 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2635/5402] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:05:23 2022] GET /compute/v2.1/servers/23841bc8-e69b-40aa-abe2-31282ca6415d => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:05:23.782285 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d95a2f5a-8419-4cae-9013-30b91e0672d8 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:23.791159 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d95a2f5a-8419-4cae-9013-30b91e0672d8 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:23.792706 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d95a2f5a-8419-4cae-9013-30b91e0672d8 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:23.793970 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d95a2f5a-8419-4cae-9013-30b91e0672d8 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] 10.222.0.79 "GET /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00" status: 200 len: 1407 microversion: 2.54 time: 0.133185 Oct 17 14:05:23.794641 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2768/5403] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:05:23 2022] GET /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00 => generated 1407 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 14:05:24.784785 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b1cffef5-c3d9-4526-b854-3c860a449cf6 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:24.787309 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b1cffef5-c3d9-4526-b854-3c860a449cf6 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] [instance: 23841bc8-e69b-40aa-abe2-31282ca6415d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:24.805025 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b1cffef5-c3d9-4526-b854-3c860a449cf6 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:24.807337 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b1cffef5-c3d9-4526-b854-3c860a449cf6 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:24.808796 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b1cffef5-c3d9-4526-b854-3c860a449cf6 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:24.812219 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b1cffef5-c3d9-4526-b854-3c860a449cf6 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:24.814615 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b1cffef5-c3d9-4526-b854-3c860a449cf6 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:24.816484 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b1cffef5-c3d9-4526-b854-3c860a449cf6 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:24.822524 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0f394dc5-1873-4842-a0d3-09e14d026603 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:24.823837 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0f394dc5-1873-4842-a0d3-09e14d026603 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] [instance: 98cedf8d-f6c2-41da-b3ae-438933b6ec00] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:24.852954 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0f394dc5-1873-4842-a0d3-09e14d026603 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:24.858802 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0f394dc5-1873-4842-a0d3-09e14d026603 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:24.862503 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0f394dc5-1873-4842-a0d3-09e14d026603 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:24.863575 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0f394dc5-1873-4842-a0d3-09e14d026603 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:24.866234 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0f394dc5-1873-4842-a0d3-09e14d026603 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:24.868412 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0f394dc5-1873-4842-a0d3-09e14d026603 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:25.118651 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0f394dc5-1873-4842-a0d3-09e14d026603 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:25.141737 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0f394dc5-1873-4842-a0d3-09e14d026603 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:25.143300 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0f394dc5-1873-4842-a0d3-09e14d026603 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:25.149420 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0f394dc5-1873-4842-a0d3-09e14d026603 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] 10.222.0.79 "GET /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00" status: 200 len: 1407 microversion: 2.54 time: 0.330005 Oct 17 14:05:25.150027 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2769/5404] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:05:24 2022] GET /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00 => generated 1407 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 14:05:25.232785 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b1cffef5-c3d9-4526-b854-3c860a449cf6 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1985e2c6784e159b51a6895f9e428e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0a677cf95f4c7e93534ae4e9dfd55b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:25.249741 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b1cffef5-c3d9-4526-b854-3c860a449cf6 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] 10.222.0.79 "GET /compute/v2.1/servers/23841bc8-e69b-40aa-abe2-31282ca6415d" status: 200 len: 1464 microversion: 2.1 time: 0.471564 Oct 17 14:05:25.250964 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2636/5405] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:05:24 2022] GET /compute/v2.1/servers/23841bc8-e69b-40aa-abe2-31282ca6415d => generated 1464 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:05:25.276406 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7fa74106-2857-45e6-9d8c-21c2560fa8cb tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "06f55d3e-34d3-4bdc-8b5d-6987c512059c", "device": "/dev/sdb"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:05:25.279489 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7fa74106-2857-45e6-9d8c-21c2560fa8cb tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] [instance: 23841bc8-e69b-40aa-abe2-31282ca6415d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:25.294332 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7fa74106-2857-45e6-9d8c-21c2560fa8cb tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:25.296574 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7fa74106-2857-45e6-9d8c-21c2560fa8cb tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:25.302569 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7fa74106-2857-45e6-9d8c-21c2560fa8cb tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:25.303882 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7fa74106-2857-45e6-9d8c-21c2560fa8cb tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:25.304429 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7fa74106-2857-45e6-9d8c-21c2560fa8cb tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:25.305103 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7fa74106-2857-45e6-9d8c-21c2560fa8cb tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:25.834581 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7fa74106-2857-45e6-9d8c-21c2560fa8cb tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] 10.222.0.79 "POST /compute/v2.1/servers/23841bc8-e69b-40aa-abe2-31282ca6415d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.560158 Oct 17 14:05:25.841975 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2770/5406] 10.222.0.79 () {60 vars in 1323 bytes} [Mon Oct 17 14:05:25 2022] POST /compute/v2.1/servers/23841bc8-e69b-40aa-abe2-31282ca6415d/os-volume_attachments => generated 194 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:05:26.176613 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-82bdb438-6fcf-4cfe-a767-6a2fbeb93609 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:26.178517 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-82bdb438-6fcf-4cfe-a767-6a2fbeb93609 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] [instance: 98cedf8d-f6c2-41da-b3ae-438933b6ec00] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:26.193977 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82bdb438-6fcf-4cfe-a767-6a2fbeb93609 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:26.203334 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82bdb438-6fcf-4cfe-a767-6a2fbeb93609 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:26.209342 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82bdb438-6fcf-4cfe-a767-6a2fbeb93609 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:26.212501 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82bdb438-6fcf-4cfe-a767-6a2fbeb93609 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:26.213832 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82bdb438-6fcf-4cfe-a767-6a2fbeb93609 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:26.217058 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82bdb438-6fcf-4cfe-a767-6a2fbeb93609 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:26.519874 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-82bdb438-6fcf-4cfe-a767-6a2fbeb93609 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:26.533162 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-82bdb438-6fcf-4cfe-a767-6a2fbeb93609 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:26.537344 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-82bdb438-6fcf-4cfe-a767-6a2fbeb93609 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:26.540092 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-82bdb438-6fcf-4cfe-a767-6a2fbeb93609 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] 10.222.0.79 "GET /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00" status: 200 len: 1407 microversion: 2.54 time: 0.368428 Oct 17 14:05:26.556206 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2637/5407] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:05:26 2022] GET /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00 => generated 1407 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:05:27.573161 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0aabc2bd-7d6d-4c0b-9822-ef1542243d7d tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:27.575296 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0aabc2bd-7d6d-4c0b-9822-ef1542243d7d tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] [instance: 98cedf8d-f6c2-41da-b3ae-438933b6ec00] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:27.585234 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:05:27.589891 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0aabc2bd-7d6d-4c0b-9822-ef1542243d7d tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:27.590686 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0aabc2bd-7d6d-4c0b-9822-ef1542243d7d tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:27.591859 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0aabc2bd-7d6d-4c0b-9822-ef1542243d7d tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:27.593066 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0aabc2bd-7d6d-4c0b-9822-ef1542243d7d tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:27.593935 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0aabc2bd-7d6d-4c0b-9822-ef1542243d7d tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:27.594990 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0aabc2bd-7d6d-4c0b-9822-ef1542243d7d tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:28.055964 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0aabc2bd-7d6d-4c0b-9822-ef1542243d7d tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:28.126255 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0aabc2bd-7d6d-4c0b-9822-ef1542243d7d tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:28.157250 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0aabc2bd-7d6d-4c0b-9822-ef1542243d7d tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:28.158908 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0aabc2bd-7d6d-4c0b-9822-ef1542243d7d tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] 10.222.0.79 "GET /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00" status: 200 len: 1407 microversion: 2.54 time: 0.593902 Oct 17 14:05:28.196048 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2771/5408] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:05:27 2022] GET /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00 => generated 1407 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:05:29.194289 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0689a9b8-3ce7-4dfa-a1ac-feed112e76f4 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:29.196387 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0689a9b8-3ce7-4dfa-a1ac-feed112e76f4 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] [instance: 98cedf8d-f6c2-41da-b3ae-438933b6ec00] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:29.212161 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0689a9b8-3ce7-4dfa-a1ac-feed112e76f4 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:29.214112 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0689a9b8-3ce7-4dfa-a1ac-feed112e76f4 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:29.214906 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0689a9b8-3ce7-4dfa-a1ac-feed112e76f4 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:29.217988 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0689a9b8-3ce7-4dfa-a1ac-feed112e76f4 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:29.219832 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0689a9b8-3ce7-4dfa-a1ac-feed112e76f4 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:29.220446 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0689a9b8-3ce7-4dfa-a1ac-feed112e76f4 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:29.437934 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0689a9b8-3ce7-4dfa-a1ac-feed112e76f4 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:29.459133 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0689a9b8-3ce7-4dfa-a1ac-feed112e76f4 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:29.476633 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0689a9b8-3ce7-4dfa-a1ac-feed112e76f4 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:29.480053 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0689a9b8-3ce7-4dfa-a1ac-feed112e76f4 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] 10.222.0.79 "GET /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00" status: 200 len: 1413 microversion: 2.54 time: 0.289780 Oct 17 14:05:29.484703 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2638/5409] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:05:29 2022] GET /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00 => generated 1413 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:05:30.512770 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-df596f7c-ff13-4f8e-abdb-1f998e9584ec tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:30.514766 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-df596f7c-ff13-4f8e-abdb-1f998e9584ec tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] [instance: 98cedf8d-f6c2-41da-b3ae-438933b6ec00] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:30.530545 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df596f7c-ff13-4f8e-abdb-1f998e9584ec tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:30.531067 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df596f7c-ff13-4f8e-abdb-1f998e9584ec tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:30.533745 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df596f7c-ff13-4f8e-abdb-1f998e9584ec tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:30.534753 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df596f7c-ff13-4f8e-abdb-1f998e9584ec tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:30.537923 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df596f7c-ff13-4f8e-abdb-1f998e9584ec tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:30.540238 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-df596f7c-ff13-4f8e-abdb-1f998e9584ec tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:31.776574 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-df596f7c-ff13-4f8e-abdb-1f998e9584ec tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:31.791501 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-df596f7c-ff13-4f8e-abdb-1f998e9584ec tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:31.796358 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-df596f7c-ff13-4f8e-abdb-1f998e9584ec tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:31.800549 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-df596f7c-ff13-4f8e-abdb-1f998e9584ec tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] 10.222.0.79 "GET /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00" status: 200 len: 1398 microversion: 2.54 time: 1.291961 Oct 17 14:05:31.821004 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2772/5410] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:05:30 2022] GET /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00 => generated 1398 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:05:31.838250 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e1062530-eb1b-46eb-8591-4ea98dd67ae6 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Calling method '.version_select at 0x7f7cd53f1b80>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:31.895450 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e1062530-eb1b-46eb-8591-4ea98dd67ae6 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-770178707" status: 204 len: 0 microversion: 2.54 time: 0.061515 Oct 17 14:05:31.897640 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2639/5411] 10.222.0.79 () {60 vars in 1316 bytes} [Mon Oct 17 14:05:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-770178707 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 14:05:31.910204 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-01c4e780-9c25-41cb-a66a-edc5888fea0b tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:31.910710 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-01c4e780-9c25-41cb-a66a-edc5888fea0b tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] [instance: 98cedf8d-f6c2-41da-b3ae-438933b6ec00] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:31.919028 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-01c4e780-9c25-41cb-a66a-edc5888fea0b tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:31.923293 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-01c4e780-9c25-41cb-a66a-edc5888fea0b tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:31.924372 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-01c4e780-9c25-41cb-a66a-edc5888fea0b tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:31.926447 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-01c4e780-9c25-41cb-a66a-edc5888fea0b tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:31.927268 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-01c4e780-9c25-41cb-a66a-edc5888fea0b tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:31.928600 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-01c4e780-9c25-41cb-a66a-edc5888fea0b tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:32.018610 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-01c4e780-9c25-41cb-a66a-edc5888fea0b tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] [instance: 98cedf8d-f6c2-41da-b3ae-438933b6ec00] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:05:32.163821 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:05:32.288814 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-01c4e780-9c25-41cb-a66a-edc5888fea0b tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] 10.222.0.79 "DELETE /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00" status: 204 len: 0 microversion: 2.54 time: 0.382384 Oct 17 14:05:32.296569 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2773/5412] 10.222.0.79 () {60 vars in 1280 bytes} [Mon Oct 17 14:05:31 2022] DELETE /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 14:05:32.303769 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3d4733af-a8e0-4d7f-884f-5566896c3bfb tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:32.304521 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3d4733af-a8e0-4d7f-884f-5566896c3bfb tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] [instance: 98cedf8d-f6c2-41da-b3ae-438933b6ec00] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:32.331607 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3d4733af-a8e0-4d7f-884f-5566896c3bfb tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:32.333479 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3d4733af-a8e0-4d7f-884f-5566896c3bfb tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:32.337775 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3d4733af-a8e0-4d7f-884f-5566896c3bfb tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:32.339532 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3d4733af-a8e0-4d7f-884f-5566896c3bfb tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:32.348812 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3d4733af-a8e0-4d7f-884f-5566896c3bfb tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:32.351362 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3d4733af-a8e0-4d7f-884f-5566896c3bfb tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:32.750623 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3d4733af-a8e0-4d7f-884f-5566896c3bfb tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:32.760368 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3d4733af-a8e0-4d7f-884f-5566896c3bfb tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:32.775791 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3d4733af-a8e0-4d7f-884f-5566896c3bfb tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:32.783985 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3d4733af-a8e0-4d7f-884f-5566896c3bfb tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] 10.222.0.79 "GET /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00" status: 200 len: 1404 microversion: 2.54 time: 0.481638 Oct 17 14:05:32.788376 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2640/5413] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:05:32 2022] GET /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00 => generated 1404 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 14:05:33.819068 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c0defaa2-3972-4a97-a291-5084f9184702 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:33.819836 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c0defaa2-3972-4a97-a291-5084f9184702 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] [instance: 98cedf8d-f6c2-41da-b3ae-438933b6ec00] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:33.848856 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c0defaa2-3972-4a97-a291-5084f9184702 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:33.849493 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c0defaa2-3972-4a97-a291-5084f9184702 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:33.851184 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c0defaa2-3972-4a97-a291-5084f9184702 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:33.851946 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c0defaa2-3972-4a97-a291-5084f9184702 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:33.853581 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c0defaa2-3972-4a97-a291-5084f9184702 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:33.860505 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c0defaa2-3972-4a97-a291-5084f9184702 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:34.078870 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c0defaa2-3972-4a97-a291-5084f9184702 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:34.123314 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c0defaa2-3972-4a97-a291-5084f9184702 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:34.129573 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c0defaa2-3972-4a97-a291-5084f9184702 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:34.132904 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c0defaa2-3972-4a97-a291-5084f9184702 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] 10.222.0.79 "GET /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00" status: 200 len: 1404 microversion: 2.54 time: 0.317215 Oct 17 14:05:34.159502 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2774/5414] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:05:33 2022] GET /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00 => generated 1404 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:05:35.160609 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-36d5d2ec-3b14-421d-aa8e-42e7c9b293ae tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:35.161870 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-36d5d2ec-3b14-421d-aa8e-42e7c9b293ae tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] [instance: 98cedf8d-f6c2-41da-b3ae-438933b6ec00] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:35.189014 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-36d5d2ec-3b14-421d-aa8e-42e7c9b293ae tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:35.193770 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-36d5d2ec-3b14-421d-aa8e-42e7c9b293ae tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:35.194894 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-36d5d2ec-3b14-421d-aa8e-42e7c9b293ae tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:35.195634 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-36d5d2ec-3b14-421d-aa8e-42e7c9b293ae tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:35.199464 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-36d5d2ec-3b14-421d-aa8e-42e7c9b293ae tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:35.200182 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-36d5d2ec-3b14-421d-aa8e-42e7c9b293ae tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:35.308591 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-36d5d2ec-3b14-421d-aa8e-42e7c9b293ae tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:35.309333 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-36d5d2ec-3b14-421d-aa8e-42e7c9b293ae tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:35.310261 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-36d5d2ec-3b14-421d-aa8e-42e7c9b293ae tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:35.311267 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-36d5d2ec-3b14-421d-aa8e-42e7c9b293ae tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lazy-loading 'fault' on Instance uuid 98cedf8d-f6c2-41da-b3ae-438933b6ec00 {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:05:35.537683 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-36d5d2ec-3b14-421d-aa8e-42e7c9b293ae tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:35.565048 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-36d5d2ec-3b14-421d-aa8e-42e7c9b293ae tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:35.589364 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-36d5d2ec-3b14-421d-aa8e-42e7c9b293ae tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfb59b0445d0431dad295d108584abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c0185924cf640a892c0aa61fb6247e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:35.599479 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-36d5d2ec-3b14-421d-aa8e-42e7c9b293ae tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] 10.222.0.79 "GET /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00" status: 200 len: 1409 microversion: 2.54 time: 0.440928 Oct 17 14:05:35.607572 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2641/5415] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:05:35 2022] GET /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00 => generated 1409 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:05:36.643892 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-48ef846a-b923-49ca-85d8-a811dc861237 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:36.645284 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-48ef846a-b923-49ca-85d8-a811dc861237 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] [instance: 98cedf8d-f6c2-41da-b3ae-438933b6ec00] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:36.676968 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48ef846a-b923-49ca-85d8-a811dc861237 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:36.687413 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48ef846a-b923-49ca-85d8-a811dc861237 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:36.688400 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48ef846a-b923-49ca-85d8-a811dc861237 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:36.692817 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48ef846a-b923-49ca-85d8-a811dc861237 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:36.694675 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48ef846a-b923-49ca-85d8-a811dc861237 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:36.696129 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48ef846a-b923-49ca-85d8-a811dc861237 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:36.742705 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-48ef846a-b923-49ca-85d8-a811dc861237 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] HTTP exception thrown: Instance 98cedf8d-f6c2-41da-b3ae-438933b6ec00 could not be found. Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-48ef846a-b923-49ca-85d8-a811dc861237 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Request method failure captured: Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00 HTTP/1.1 Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTWEGWyReg7_8tMNjvNcL-9zMaR8ySRYrbxxu2wz3gNtEj1yYkviZ6mPsoCAyPuj_na0yAAppVmTg0Bam8PbjXCRA_1S2Fqu1cbj5nqr9STXnYkLdbw9ruZ_YY2ICe04J7LsfUYuy-UVaUrxJAFLA8LECL67JR6ppmW5YVNwILrImSZ0 Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: X-Openstack-Nova-Api-Version: 2.54 Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 0c0185924cf640a892c0aa61fb6247e1 Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServerShowV254Test-1221123144 Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0c0185924cf640a892c0aa61fb6247e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0c0185924cf640a892c0aa61fb6247e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0c0185924cf640a892c0aa61fb6247e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0c0185924cf640a892c0aa61fb6247e1", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServerShowV254Test-1221123144 Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 0c0185924cf640a892c0aa61fb6247e1 Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServerShowV254Test-1221123144 Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServerShowV254Test-1221123144-project Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: cfb59b0445d0431dad295d108584abe1 Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServerShowV254Test-1221123144-project Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 98cedf8d-f6c2-41da-b3ae-438933b6ec00 could not be found. Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '98cedf8d-f6c2-41da-b3ae-438933b6ec00'} Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98cedf8d-f6c2-41da-b3ae-438933b6ec00 could not be found. Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98cedf8d-f6c2-41da-b3ae-438933b6ec00 could not be found. Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:05:36.744446 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:05:36.749527 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:05:36.749527 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:05:36.749527 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:05:36.749527 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:05:36.749527 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:05:36.749527 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98cedf8d-f6c2-41da-b3ae-438933b6ec00 could not be found. Oct 17 14:05:36.749527 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:05:36.749527 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-48ef846a-b923-49ca-85d8-a811dc861237 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Returning 404 to user: Instance 98cedf8d-f6c2-41da-b3ae-438933b6ec00 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:05:36.757715 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-48ef846a-b923-49ca-85d8-a811dc861237 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] 10.222.0.79 "GET /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00" status: 404 len: 111 microversion: 2.54 time: 0.109543 Oct 17 14:05:36.760329 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2775/5416] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:05:36 2022] GET /compute/v2.1/servers/98cedf8d-f6c2-41da-b3ae-438933b6ec00 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 14:05:40.315645 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-36d5d2ec-3b14-421d-aa8e-42e7c9b293ae tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:40.316833 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-36d5d2ec-3b14-421d-aa8e-42e7c9b293ae tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] 10.222.0.79 "GET /compute//" status: 200 len: 377 microversion: - time: 0.005902 Oct 17 14:05:40.317500 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2642/5417] 10.222.0.79 () {56 vars in 886 bytes} [Mon Oct 17 14:05:40 2022] GET /compute/ => generated 377 bytes in 7 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 17 14:05:40.326017 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-48ef846a-b923-49ca-85d8-a811dc861237 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:40.332895 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-48ef846a-b923-49ca-85d8-a811dc861237 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] 10.222.0.79 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.007331 Oct 17 14:05:40.349261 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2776/5418] 10.222.0.79 () {54 vars in 1035 bytes} [Mon Oct 17 14:05:40 2022] GET /compute/v2/ => generated 379 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Oct 17 14:05:40.350103 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-36d5d2ec-3b14-421d-aa8e-42e7c9b293ae tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:40.351709 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-36d5d2ec-3b14-421d-aa8e-42e7c9b293ae tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] 10.222.0.79 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.010351 Oct 17 14:05:40.352172 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2643/5419] 10.222.0.79 () {54 vars in 1041 bytes} [Mon Oct 17 14:05:40 2022] GET /compute/v2.1/ => generated 388 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:05:40.361620 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-48ef846a-b923-49ca-85d8-a811dc861237 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:40.362830 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-48ef846a-b923-49ca-85d8-a811dc861237 tempest-ServerShowV254Test-1221123144 tempest-ServerShowV254Test-1221123144-project] 10.222.0.79 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001663 Oct 17 14:05:40.371757 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2777/5420] 10.222.0.79 () {56 vars in 886 bytes} [Mon Oct 17 14:05:40 2022] GET /compute/ => generated 377 bytes in 10 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 17 14:05:43.103239 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-99d8eaa2-df4f-465c-8592-0b6fa8355281 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:43.104465 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-99d8eaa2-df4f-465c-8592-0b6fa8355281 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:43.123804 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-99d8eaa2-df4f-465c-8592-0b6fa8355281 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:43.126645 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-99d8eaa2-df4f-465c-8592-0b6fa8355281 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:43.127403 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-99d8eaa2-df4f-465c-8592-0b6fa8355281 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:43.128362 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-99d8eaa2-df4f-465c-8592-0b6fa8355281 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:43.131564 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-99d8eaa2-df4f-465c-8592-0b6fa8355281 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:43.132262 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-99d8eaa2-df4f-465c-8592-0b6fa8355281 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:43.188882 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-99d8eaa2-df4f-465c-8592-0b6fa8355281 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed/ips" status: 200 len: 152 microversion: 2.20 time: 0.088946 Oct 17 14:05:43.189510 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2644/5421] 10.222.0.79 () {60 vars in 1289 bytes} [Mon Oct 17 14:05:43 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed/ips => generated 152 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:05:44.254151 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c1df808f-b4b6-4ca5-8947-bf3621555794 tempest-VolumesNegativeTest-75945053 tempest-VolumesNegativeTest-75945053-project] Action: 'create', calling method: .version_select at 0x7f7cd40f21f0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-790219670", "metadata": {"Type": "work"}}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c1df808f-b4b6-4ca5-8947-bf3621555794 tempest-VolumesNegativeTest-75945053 tempest-VolumesNegativeTest-75945053-project] Request method failure captured: Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 121 Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTWE3WFx5OrLsrOLVBWFuoyoydjFiah_1a5OvUZoUrkoKtLsKWKBzHtqThemGnAVGGQ21InSScxRLkJqiDS06Vm4uD_-_NeHVpPHHTB69_hS0SwfT0xhu4oX8-9rgryYJHplIktAy9eaQckFA5f71QWDP1h7QbxVMhcFGD8jNNfSYJKg Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 25aed18b1fcf4dc1bbe678bbb5c70c0a Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-VolumesNegativeTest-75945053 Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/25aed18b1fcf4dc1bbe678bbb5c70c0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/25aed18b1fcf4dc1bbe678bbb5c70c0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/25aed18b1fcf4dc1bbe678bbb5c70c0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_25aed18b1fcf4dc1bbe678bbb5c70c0a", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-VolumesNegativeTest-75945053 Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 25aed18b1fcf4dc1bbe678bbb5c70c0a Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-VolumesNegativeTest-75945053 Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-VolumesNegativeTest-75945053-project Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: e42b4249ad0b46e2883fd46ef454df78 Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-VolumesNegativeTest-75945053-project Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-790219670", "metadata": {"Type": "work"}}} Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: method: Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-790219670', 'metadata': {'Type': 'work'}}}} Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise error Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi '#$%' Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 14:05:44.265017 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 14:05:44.269631 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 17 14:05:44.269631 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:05:44.269631 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:05:44.269631 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:05:44.269631 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:05:44.269631 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:05:44.269631 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:05:44.269631 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 14:05:44.269631 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 14:05:44.269631 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 17 14:05:44.269631 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:05:44.269631 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c1df808f-b4b6-4ca5-8947-bf3621555794 tempest-VolumesNegativeTest-75945053 tempest-VolumesNegativeTest-75945053-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:05:44.269631 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c1df808f-b4b6-4ca5-8947-bf3621555794 tempest-VolumesNegativeTest-75945053 tempest-VolumesNegativeTest-75945053-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.265620 Oct 17 14:05:44.270652 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2778/5422] 10.222.0.79 () {60 vars in 1156 bytes} [Mon Oct 17 14:05:44 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 267 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 14:05:44.288222 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-efe1f21b-76a1-4a21-aad1-830c02750903 tempest-VolumesNegativeTest-75945053 tempest-VolumesNegativeTest-75945053-project] Action: 'create', calling method: .version_select at 0x7f7cd54f8940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-419786244", "metadata": {"Type": "work"}}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-efe1f21b-76a1-4a21-aad1-830c02750903 tempest-VolumesNegativeTest-75945053 tempest-VolumesNegativeTest-75945053-project] Request method failure captured: Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 119 Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTWE3WFx5OrLsrOLVBWFuoyoydjFiah_1a5OvUZoUrkoKtLsKWKBzHtqThemGnAVGGQ21InSScxRLkJqiDS06Vm4uD_-_NeHVpPHHTB69_hS0SwfT0xhu4oX8-9rgryYJHplIktAy9eaQckFA5f71QWDP1h7QbxVMhcFGD8jNNfSYJKg Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 25aed18b1fcf4dc1bbe678bbb5c70c0a Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-VolumesNegativeTest-75945053 Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/25aed18b1fcf4dc1bbe678bbb5c70c0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/25aed18b1fcf4dc1bbe678bbb5c70c0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/25aed18b1fcf4dc1bbe678bbb5c70c0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_25aed18b1fcf4dc1bbe678bbb5c70c0a", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-VolumesNegativeTest-75945053 Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 25aed18b1fcf4dc1bbe678bbb5c70c0a Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-VolumesNegativeTest-75945053 Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-VolumesNegativeTest-75945053-project Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: e42b4249ad0b46e2883fd46ef454df78 Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-VolumesNegativeTest-75945053-project Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-419786244", "metadata": {"Type": "work"}}} Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: method: Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-419786244', 'metadata': {'Type': 'work'}}}} Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise error Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi '0' Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 14:05:44.299024 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 14:05:44.305000 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 17 14:05:44.305000 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:05:44.305000 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:05:44.305000 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:05:44.305000 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:05:44.305000 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:05:44.305000 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:05:44.305000 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 14:05:44.305000 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 14:05:44.305000 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 17 14:05:44.305000 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:05:44.305000 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-efe1f21b-76a1-4a21-aad1-830c02750903 tempest-VolumesNegativeTest-75945053 tempest-VolumesNegativeTest-75945053-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:05:44.305000 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-efe1f21b-76a1-4a21-aad1-830c02750903 tempest-VolumesNegativeTest-75945053 tempest-VolumesNegativeTest-75945053-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.025667 Oct 17 14:05:44.310983 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2645/5423] 10.222.0.79 () {60 vars in 1156 bytes} [Mon Oct 17 14:05:44 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 14:05:44.317250 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a914d785-d624-42a3-a72f-bc88f853e71d tempest-VolumesNegativeTest-75945053 tempest-VolumesNegativeTest-75945053-project] Action: 'create', calling method: .version_select at 0x7f7cd449c8b0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1992784920", "metadata": {"Type": "work"}}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a914d785-d624-42a3-a72f-bc88f853e71d tempest-VolumesNegativeTest-75945053 tempest-VolumesNegativeTest-75945053-project] Request method failure captured: Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 119 Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTWE3WFx5OrLsrOLVBWFuoyoydjFiah_1a5OvUZoUrkoKtLsKWKBzHtqThemGnAVGGQ21InSScxRLkJqiDS06Vm4uD_-_NeHVpPHHTB69_hS0SwfT0xhu4oX8-9rgryYJHplIktAy9eaQckFA5f71QWDP1h7QbxVMhcFGD8jNNfSYJKg Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 25aed18b1fcf4dc1bbe678bbb5c70c0a Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-VolumesNegativeTest-75945053 Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/25aed18b1fcf4dc1bbe678bbb5c70c0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/25aed18b1fcf4dc1bbe678bbb5c70c0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/25aed18b1fcf4dc1bbe678bbb5c70c0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_25aed18b1fcf4dc1bbe678bbb5c70c0a", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-VolumesNegativeTest-75945053 Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 25aed18b1fcf4dc1bbe678bbb5c70c0a Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-VolumesNegativeTest-75945053 Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-VolumesNegativeTest-75945053-project Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: e42b4249ad0b46e2883fd46ef454df78 Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-VolumesNegativeTest-75945053-project Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1992784920", "metadata": {"Type": "work"}}} Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: method: Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1992784920', 'metadata': {'Type': 'work'}}}} Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise error Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi '' Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 14:05:44.327053 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 14:05:44.331463 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 17 14:05:44.331463 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:05:44.331463 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:05:44.331463 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:05:44.331463 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:05:44.331463 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:05:44.331463 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:05:44.331463 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 14:05:44.331463 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 14:05:44.331463 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 17 14:05:44.331463 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:05:44.331463 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a914d785-d624-42a3-a72f-bc88f853e71d tempest-VolumesNegativeTest-75945053 tempest-VolumesNegativeTest-75945053-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:05:44.331463 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a914d785-d624-42a3-a72f-bc88f853e71d tempest-VolumesNegativeTest-75945053 tempest-VolumesNegativeTest-75945053-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.016415 Oct 17 14:05:44.333679 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2779/5424] 10.222.0.79 () {60 vars in 1156 bytes} [Mon Oct 17 14:05:44 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 17 14:05:44.345318 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ea49d4ea-6381-4082-afaa-559b117e580e tempest-VolumesNegativeTest-75945053 tempest-VolumesNegativeTest-75945053-project] Calling method '.version_select at 0x7f7cd4582e50>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:44.430743 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-ea49d4ea-6381-4082-afaa-559b117e580e tempest-VolumesNegativeTest-75945053 tempest-VolumesNegativeTest-75945053-project] HTTP exception thrown: Volume tempest-invalid-1159295195 could not be found. Oct 17 14:05:44.438967 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ea49d4ea-6381-4082-afaa-559b117e580e tempest-VolumesNegativeTest-75945053 tempest-VolumesNegativeTest-75945053-project] Request method failure captured: Oct 17 14:05:44.438967 n-d-854247-14 devstack@n-api.service[127017]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1159295195 HTTP/1.1 Oct 17 14:05:44.438967 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 14:05:44.438967 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 14:05:44.438967 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 14:05:44.438967 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 14:05:44.438967 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 14:05:44.438967 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 14:05:44.438967 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 14:05:44.438967 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 14:05:44.438967 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTWE3WFx5OrLsrOLVBWFuoyoydjFiah_1a5OvUZoUrkoKtLsKWKBzHtqThemGnAVGGQ21InSScxRLkJqiDS06Vm4uD_-_NeHVpPHHTB69_hS0SwfT0xhu4oX8-9rgryYJHplIktAy9eaQckFA5f71QWDP1h7QbxVMhcFGD8jNNfSYJKg Oct 17 14:05:44.438967 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 14:05:44.438967 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 14:05:44.438967 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 14:05:44.438967 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 14:05:44.438967 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 14:05:44.438967 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 14:05:44.438967 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 25aed18b1fcf4dc1bbe678bbb5c70c0a Oct 17 14:05:44.438967 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-VolumesNegativeTest-75945053 Oct 17 14:05:44.438967 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 14:05:44.438967 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 14:05:44.438967 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/25aed18b1fcf4dc1bbe678bbb5c70c0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/25aed18b1fcf4dc1bbe678bbb5c70c0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/25aed18b1fcf4dc1bbe678bbb5c70c0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_25aed18b1fcf4dc1bbe678bbb5c70c0a", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:05:44.438967 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-VolumesNegativeTest-75945053 Oct 17 14:05:44.438967 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 25aed18b1fcf4dc1bbe678bbb5c70c0a Oct 17 14:05:44.438967 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-VolumesNegativeTest-75945053 Oct 17 14:05:44.438967 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-VolumesNegativeTest-75945053-project Oct 17 14:05:44.438967 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 14:05:44.438967 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 14:05:44.438967 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: e42b4249ad0b46e2883fd46ef454df78 Oct 17 14:05:44.438967 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-VolumesNegativeTest-75945053-project Oct 17 14:05:44.438967 n-d-854247-14 devstack@n-api.service[127017]: method: Oct 17 14:05:44.438967 n-d-854247-14 devstack@n-api.service[127017]: exception: Volume tempest-invalid-1159295195 could not be found. Oct 17 14:05:44.438967 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'tempest-invalid-1159295195'} Oct 17 14:05:44.438967 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:05:44.438967 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:05:44.438967 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 14:05:44.438967 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 14:05:44.438967 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 17 14:05:44.438967 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 17 14:05:44.438967 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 17 14:05:44.438967 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 17 14:05:44.438967 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 17 14:05:44.438967 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 17 14:05:44.438967 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 17 14:05:44.438967 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 17 14:05:44.438967 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 14:05:44.438967 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 14:05:44.438967 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 14:05:44.438967 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 14:05:44.438967 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1159295195 could not be found. (HTTP 404) (Request-ID: req-7682a30e-66f3-4d55-a0df-39d149020781) Oct 17 14:05:44.438967 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:05:44.438967 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:05:44.438967 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:05:44.438967 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:05:44.438967 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 17 14:05:44.438967 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 17 14:05:44.438967 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 14:05:44.438967 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 14:05:44.438967 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 14:05:44.438967 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 14:05:44.438967 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 14:05:44.438967 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 14:05:44.438967 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 14:05:44.438967 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 14:05:44.443257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 17 14:05:44.443257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 17 14:05:44.443257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 17 14:05:44.443257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 17 14:05:44.443257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 17 14:05:44.443257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 17 14:05:44.443257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 17 14:05:44.443257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 17 14:05:44.443257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 14:05:44.443257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 14:05:44.443257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 14:05:44.443257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 14:05:44.443257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1159295195 could not be found. Oct 17 14:05:44.443257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:05:44.443257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:05:44.443257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:05:44.443257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:05:44.443257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:05:44.443257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:05:44.443257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:05:44.443257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:05:44.443257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 14:05:44.443257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 14:05:44.443257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:05:44.443257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:05:44.443257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 17 14:05:44.443257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:05:44.443257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1159295195 could not be found. Oct 17 14:05:44.443257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:05:44.443257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:05:44.443257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:05:44.443257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:05:44.443257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:05:44.443257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:05:44.443257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:05:44.443257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:05:44.443257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1159295195 could not be found. Oct 17 14:05:44.443257 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:05:44.443257 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ea49d4ea-6381-4082-afaa-559b117e580e tempest-VolumesNegativeTest-75945053 tempest-VolumesNegativeTest-75945053-project] Returning 404 to user: Volume tempest-invalid-1159295195 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:05:44.447873 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ea49d4ea-6381-4082-afaa-559b117e580e tempest-VolumesNegativeTest-75945053 tempest-VolumesNegativeTest-75945053-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1159295195" status: 404 len: 99 microversion: 2.1 time: 0.105540 Oct 17 14:05:44.447873 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2646/5425] 10.222.0.79 () {58 vars in 1218 bytes} [Mon Oct 17 14:05:44 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1159295195 => generated 99 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 14:05:44.454686 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a56b2a37-03d6-45a2-8a2d-7b31635888a8 tempest-VolumesNegativeTest-75945053 tempest-VolumesNegativeTest-75945053-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005070 Oct 17 14:05:44.455234 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2780/5426] 10.222.0.79 () {58 vars in 1140 bytes} [Mon Oct 17 14:05:44 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 17 14:05:44.490813 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5b7a43cf-a434-47f2-8820-73d5d13a2eb9 tempest-VolumesNegativeTest-75945053 tempest-VolumesNegativeTest-75945053-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.022869 Oct 17 14:05:44.501349 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2647/5427] 10.222.0.79 () {58 vars in 1137 bytes} [Mon Oct 17 14:05:44 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 17 14:05:44.503969 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6380e28f-44f1-4468-8df6-1ff4a88b3848 tempest-VolumesNegativeTest-75945053 tempest-VolumesNegativeTest-75945053-project] Calling method '.version_select at 0x7f7cd4f8f790>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:44.583294 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-6380e28f-44f1-4468-8df6-1ff4a88b3848 tempest-VolumesNegativeTest-75945053 tempest-VolumesNegativeTest-75945053-project] HTTP exception thrown: Volume d975aa90-01b1-42bd-9d51-f4089d039515 could not be found. Oct 17 14:05:44.586310 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6380e28f-44f1-4468-8df6-1ff4a88b3848 tempest-VolumesNegativeTest-75945053 tempest-VolumesNegativeTest-75945053-project] Request method failure captured: Oct 17 14:05:44.586310 n-d-854247-14 devstack@n-api.service[127016]: request: DELETE /compute/v2.1/os-volumes/d975aa90-01b1-42bd-9d51-f4089d039515 HTTP/1.1 Oct 17 14:05:44.586310 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 14:05:44.586310 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 14:05:44.586310 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 14:05:44.586310 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 14:05:44.586310 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 14:05:44.586310 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 14:05:44.586310 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 14:05:44.586310 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 14:05:44.586310 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTWE3WFx5OrLsrOLVBWFuoyoydjFiah_1a5OvUZoUrkoKtLsKWKBzHtqThemGnAVGGQ21InSScxRLkJqiDS06Vm4uD_-_NeHVpPHHTB69_hS0SwfT0xhu4oX8-9rgryYJHplIktAy9eaQckFA5f71QWDP1h7QbxVMhcFGD8jNNfSYJKg Oct 17 14:05:44.586310 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 14:05:44.586310 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 14:05:44.586310 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 14:05:44.586310 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 14:05:44.586310 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 14:05:44.586310 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 14:05:44.586310 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 25aed18b1fcf4dc1bbe678bbb5c70c0a Oct 17 14:05:44.586310 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-VolumesNegativeTest-75945053 Oct 17 14:05:44.586310 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 14:05:44.586310 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 14:05:44.586310 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/25aed18b1fcf4dc1bbe678bbb5c70c0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/25aed18b1fcf4dc1bbe678bbb5c70c0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/25aed18b1fcf4dc1bbe678bbb5c70c0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_25aed18b1fcf4dc1bbe678bbb5c70c0a", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:05:44.586310 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-VolumesNegativeTest-75945053 Oct 17 14:05:44.586310 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 25aed18b1fcf4dc1bbe678bbb5c70c0a Oct 17 14:05:44.586310 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-VolumesNegativeTest-75945053 Oct 17 14:05:44.586310 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-VolumesNegativeTest-75945053-project Oct 17 14:05:44.586310 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 14:05:44.586310 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 14:05:44.586310 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: e42b4249ad0b46e2883fd46ef454df78 Oct 17 14:05:44.586310 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-VolumesNegativeTest-75945053-project Oct 17 14:05:44.586310 n-d-854247-14 devstack@n-api.service[127016]: method: Oct 17 14:05:44.586310 n-d-854247-14 devstack@n-api.service[127016]: exception: Volume d975aa90-01b1-42bd-9d51-f4089d039515 could not be found. Oct 17 14:05:44.586310 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'd975aa90-01b1-42bd-9d51-f4089d039515'} Oct 17 14:05:44.586310 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:05:44.586310 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:05:44.586310 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 14:05:44.586310 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 14:05:44.586310 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 17 14:05:44.586310 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 17 14:05:44.586310 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 17 14:05:44.586310 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 17 14:05:44.586310 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 17 14:05:44.586310 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 17 14:05:44.586310 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 17 14:05:44.586310 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 17 14:05:44.586310 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 14:05:44.586310 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 14:05:44.586310 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 14:05:44.586310 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 14:05:44.586310 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d975aa90-01b1-42bd-9d51-f4089d039515 could not be found. (HTTP 404) (Request-ID: req-1915f65d-f3ee-4cd8-9070-75fd8a41cf8d) Oct 17 14:05:44.586310 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:05:44.586310 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:05:44.586310 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:05:44.586310 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:05:44.586310 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 17 14:05:44.586310 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 17 14:05:44.586310 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 14:05:44.586310 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 14:05:44.586310 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 14:05:44.586310 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 14:05:44.586310 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 14:05:44.586310 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 14:05:44.586310 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 14:05:44.591135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 14:05:44.591135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 17 14:05:44.591135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 17 14:05:44.591135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 17 14:05:44.591135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 17 14:05:44.591135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 17 14:05:44.591135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 17 14:05:44.591135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 17 14:05:44.591135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 17 14:05:44.591135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 14:05:44.591135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 14:05:44.591135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 14:05:44.591135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 14:05:44.591135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d975aa90-01b1-42bd-9d51-f4089d039515 could not be found. Oct 17 14:05:44.591135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:05:44.591135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:05:44.591135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:05:44.591135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:05:44.591135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:05:44.591135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:05:44.591135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:05:44.591135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:05:44.591135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 14:05:44.591135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 14:05:44.591135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:05:44.591135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:05:44.591135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 17 14:05:44.591135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:05:44.591135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d975aa90-01b1-42bd-9d51-f4089d039515 could not be found. Oct 17 14:05:44.591135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:05:44.591135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:05:44.591135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:05:44.591135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:05:44.591135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:05:44.591135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:05:44.591135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:05:44.591135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:05:44.591135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d975aa90-01b1-42bd-9d51-f4089d039515 could not be found. Oct 17 14:05:44.591135 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:05:44.602173 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6380e28f-44f1-4468-8df6-1ff4a88b3848 tempest-VolumesNegativeTest-75945053 tempest-VolumesNegativeTest-75945053-project] Returning 404 to user: Volume d975aa90-01b1-42bd-9d51-f4089d039515 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:05:44.603536 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6380e28f-44f1-4468-8df6-1ff4a88b3848 tempest-VolumesNegativeTest-75945053 tempest-VolumesNegativeTest-75945053-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/d975aa90-01b1-42bd-9d51-f4089d039515" status: 404 len: 109 microversion: 2.1 time: 0.104659 Oct 17 14:05:44.604855 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2781/5428] 10.222.0.79 () {58 vars in 1248 bytes} [Mon Oct 17 14:05:44 2022] DELETE /compute/v2.1/os-volumes/d975aa90-01b1-42bd-9d51-f4089d039515 => generated 109 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:05:44.638396 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b7736e31-c32b-40b7-8131-cacee936d0b3 tempest-VolumesNegativeTest-75945053 tempest-VolumesNegativeTest-75945053-project] Calling method '.version_select at 0x7f7cd5605550>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:44.711223 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-b7736e31-c32b-40b7-8131-cacee936d0b3 tempest-VolumesNegativeTest-75945053 tempest-VolumesNegativeTest-75945053-project] HTTP exception thrown: Volume 1ee46e7f-34f9-4197-a79b-229c270eab87 could not be found. Oct 17 14:05:44.713388 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b7736e31-c32b-40b7-8131-cacee936d0b3 tempest-VolumesNegativeTest-75945053 tempest-VolumesNegativeTest-75945053-project] Request method failure captured: Oct 17 14:05:44.713388 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/os-volumes/1ee46e7f-34f9-4197-a79b-229c270eab87 HTTP/1.1 Oct 17 14:05:44.713388 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 14:05:44.713388 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 14:05:44.713388 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 14:05:44.713388 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 14:05:44.713388 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 14:05:44.713388 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 14:05:44.713388 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 14:05:44.713388 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 14:05:44.713388 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTWE3WFx5OrLsrOLVBWFuoyoydjFiah_1a5OvUZoUrkoKtLsKWKBzHtqThemGnAVGGQ21InSScxRLkJqiDS06Vm4uD_-_NeHVpPHHTB69_hS0SwfT0xhu4oX8-9rgryYJHplIktAy9eaQckFA5f71QWDP1h7QbxVMhcFGD8jNNfSYJKg Oct 17 14:05:44.713388 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 14:05:44.713388 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 14:05:44.713388 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 14:05:44.713388 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 14:05:44.713388 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 14:05:44.713388 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 14:05:44.713388 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 25aed18b1fcf4dc1bbe678bbb5c70c0a Oct 17 14:05:44.713388 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-VolumesNegativeTest-75945053 Oct 17 14:05:44.713388 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 14:05:44.713388 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 14:05:44.713388 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/25aed18b1fcf4dc1bbe678bbb5c70c0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/25aed18b1fcf4dc1bbe678bbb5c70c0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/25aed18b1fcf4dc1bbe678bbb5c70c0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_25aed18b1fcf4dc1bbe678bbb5c70c0a", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:05:44.713388 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-VolumesNegativeTest-75945053 Oct 17 14:05:44.713388 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 25aed18b1fcf4dc1bbe678bbb5c70c0a Oct 17 14:05:44.713388 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-VolumesNegativeTest-75945053 Oct 17 14:05:44.713388 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-VolumesNegativeTest-75945053-project Oct 17 14:05:44.713388 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 14:05:44.713388 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 14:05:44.713388 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: e42b4249ad0b46e2883fd46ef454df78 Oct 17 14:05:44.713388 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-VolumesNegativeTest-75945053-project Oct 17 14:05:44.713388 n-d-854247-14 devstack@n-api.service[127017]: method: Oct 17 14:05:44.713388 n-d-854247-14 devstack@n-api.service[127017]: exception: Volume 1ee46e7f-34f9-4197-a79b-229c270eab87 could not be found. Oct 17 14:05:44.713388 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '1ee46e7f-34f9-4197-a79b-229c270eab87'} Oct 17 14:05:44.713388 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:05:44.713388 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:05:44.713388 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 14:05:44.713388 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 14:05:44.713388 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 14:05:44.713388 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 14:05:44.713388 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 14:05:44.713388 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 14:05:44.713388 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 14:05:44.713388 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 14:05:44.713388 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 14:05:44.713388 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 14:05:44.713388 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 14:05:44.713388 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 14:05:44.713388 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 14:05:44.713388 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 14:05:44.713388 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1ee46e7f-34f9-4197-a79b-229c270eab87 could not be found. (HTTP 404) (Request-ID: req-2eb9fb2c-2790-425e-999f-ca9c244e674e) Oct 17 14:05:44.713388 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:05:44.713388 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:05:44.713388 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:05:44.713388 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:05:44.713388 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 17 14:05:44.713388 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 17 14:05:44.713388 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 14:05:44.713388 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 14:05:44.713388 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 14:05:44.713388 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 14:05:44.713388 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 14:05:44.713388 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 14:05:44.713388 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 14:05:44.718498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 14:05:44.718498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 14:05:44.718498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 14:05:44.718498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 14:05:44.718498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 14:05:44.718498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 14:05:44.718498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 14:05:44.718498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 14:05:44.718498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 14:05:44.718498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 14:05:44.718498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 14:05:44.718498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 14:05:44.718498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 14:05:44.718498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1ee46e7f-34f9-4197-a79b-229c270eab87 could not be found. Oct 17 14:05:44.718498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:05:44.718498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:05:44.718498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:05:44.718498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:05:44.718498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:05:44.718498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:05:44.718498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:05:44.718498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:05:44.718498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 14:05:44.718498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 14:05:44.718498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:05:44.718498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:05:44.718498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 17 14:05:44.718498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:05:44.718498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1ee46e7f-34f9-4197-a79b-229c270eab87 could not be found. Oct 17 14:05:44.718498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:05:44.718498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:05:44.718498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:05:44.718498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:05:44.718498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:05:44.718498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:05:44.718498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:05:44.718498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:05:44.718498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1ee46e7f-34f9-4197-a79b-229c270eab87 could not be found. Oct 17 14:05:44.718498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:05:44.718498 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b7736e31-c32b-40b7-8131-cacee936d0b3 tempest-VolumesNegativeTest-75945053 tempest-VolumesNegativeTest-75945053-project] Returning 404 to user: Volume 1ee46e7f-34f9-4197-a79b-229c270eab87 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:05:44.718498 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b7736e31-c32b-40b7-8131-cacee936d0b3 tempest-VolumesNegativeTest-75945053 tempest-VolumesNegativeTest-75945053-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/1ee46e7f-34f9-4197-a79b-229c270eab87" status: 404 len: 109 microversion: 2.1 time: 0.102975 Oct 17 14:05:44.718498 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2648/5429] 10.222.0.79 () {58 vars in 1245 bytes} [Mon Oct 17 14:05:44 2022] GET /compute/v2.1/os-volumes/1ee46e7f-34f9-4197-a79b-229c270eab87 => generated 109 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:05:46.518625 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5bff5878-c05b-4e5a-b7a0-3b66cd2e32dd tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:05:46.520405 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5bff5878-c05b-4e5a-b7a0-3b66cd2e32dd tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:46.533677 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5bff5878-c05b-4e5a-b7a0-3b66cd2e32dd tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:46.536000 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5bff5878-c05b-4e5a-b7a0-3b66cd2e32dd tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:46.536677 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5bff5878-c05b-4e5a-b7a0-3b66cd2e32dd tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:46.539638 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5bff5878-c05b-4e5a-b7a0-3b66cd2e32dd tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:46.540298 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5bff5878-c05b-4e5a-b7a0-3b66cd2e32dd tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:46.541052 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5bff5878-c05b-4e5a-b7a0-3b66cd2e32dd tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:46.599086 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-5bff5878-c05b-4e5a-b7a0-3b66cd2e32dd tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lazy-loading 'flavor' on Instance uuid 32c279ba-2f76-4986-be6d-1029602677ed {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:05:47.104874 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5bff5878-c05b-4e5a-b7a0-3b66cd2e32dd tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "POST /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed/action" status: 202 len: 0 microversion: 2.20 time: 0.595233 Oct 17 14:05:47.105758 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2782/5430] 10.222.0.79 () {62 vars in 1319 bytes} [Mon Oct 17 14:05:46 2022] POST /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed/action => generated 0 bytes in 597 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:05:47.605695 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-aff2a82c-36da-4768-9bf2-8f08d79e7545 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:47.607045 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-aff2a82c-36da-4768-9bf2-8f08d79e7545 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:47.622819 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=31,nova_api:DELETE=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:05:47.653187 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aff2a82c-36da-4768-9bf2-8f08d79e7545 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:47.653789 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aff2a82c-36da-4768-9bf2-8f08d79e7545 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:47.654243 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aff2a82c-36da-4768-9bf2-8f08d79e7545 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:47.655127 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aff2a82c-36da-4768-9bf2-8f08d79e7545 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:47.662539 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aff2a82c-36da-4768-9bf2-8f08d79e7545 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:47.663066 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aff2a82c-36da-4768-9bf2-8f08d79e7545 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:47.704461 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=86 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:05:49.100184 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-aff2a82c-36da-4768-9bf2-8f08d79e7545 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:49.117918 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-aff2a82c-36da-4768-9bf2-8f08d79e7545 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:49.121371 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-aff2a82c-36da-4768-9bf2-8f08d79e7545 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:49.122924 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-aff2a82c-36da-4768-9bf2-8f08d79e7545 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1721 microversion: 2.20 time: 2.011645 Oct 17 14:05:49.125070 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2649/5431] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:05:47 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1721 bytes in 2015 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:05:50.156542 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0b0dd749-2858-4b5f-ac50-3bcca5fc6a65 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:50.159268 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0b0dd749-2858-4b5f-ac50-3bcca5fc6a65 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:50.168406 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0b0dd749-2858-4b5f-ac50-3bcca5fc6a65 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:50.169192 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0b0dd749-2858-4b5f-ac50-3bcca5fc6a65 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:50.169886 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0b0dd749-2858-4b5f-ac50-3bcca5fc6a65 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:50.171134 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0b0dd749-2858-4b5f-ac50-3bcca5fc6a65 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:50.172530 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0b0dd749-2858-4b5f-ac50-3bcca5fc6a65 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:50.173203 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0b0dd749-2858-4b5f-ac50-3bcca5fc6a65 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:51.153821 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0b0dd749-2858-4b5f-ac50-3bcca5fc6a65 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:51.194742 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0b0dd749-2858-4b5f-ac50-3bcca5fc6a65 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:51.196272 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0b0dd749-2858-4b5f-ac50-3bcca5fc6a65 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:51.204832 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0b0dd749-2858-4b5f-ac50-3bcca5fc6a65 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1721 microversion: 2.20 time: 1.054822 Oct 17 14:05:51.207686 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2783/5432] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:05:50 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1721 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:05:52.236410 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9e3b50c4-4c2f-4629-aaec-d1b351f8be11 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:52.237793 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9e3b50c4-4c2f-4629-aaec-d1b351f8be11 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:52.251946 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9e3b50c4-4c2f-4629-aaec-d1b351f8be11 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:52.252845 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9e3b50c4-4c2f-4629-aaec-d1b351f8be11 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:52.258525 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9e3b50c4-4c2f-4629-aaec-d1b351f8be11 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:52.260899 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9e3b50c4-4c2f-4629-aaec-d1b351f8be11 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:52.265813 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9e3b50c4-4c2f-4629-aaec-d1b351f8be11 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:52.267083 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9e3b50c4-4c2f-4629-aaec-d1b351f8be11 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:52.518291 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b60d1de4-15ff-4bc8-9034-5a1bad80f0ef tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Action: 'create', calling method: .version_select at 0x7f7cd45c0820>, body: {"keypair": {"name": "tempest-TestServerBasicOps-164864169", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7O1M7SQQU/t90A5Wu9duaecfHEYm9y9lzePWcb+I9sAKE/aCN7Ut6n1wqavY+X95qR92yxzzFWpldouPiX0aeBnvpZNzPMxWwCevHuzc3i9AxgD6BEiB8u9Me20qt+sA=="}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:05:52.569403 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-b60d1de4-15ff-4bc8-9034-5a1bad80f0ef tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Getting quotas for project f716902fd72e44a2b2b7d0ef78f40b72. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:05:52.601234 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-b60d1de4-15ff-4bc8-9034-5a1bad80f0ef tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Getting quotas for user 2a2ddceda0be42bf8cfe265f7a07d462 and project f716902fd72e44a2b2b7d0ef78f40b72. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:05:52.682056 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b60d1de4-15ff-4bc8-9034-5a1bad80f0ef tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.899483 Oct 17 14:05:52.693429 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2650/5433] 10.222.0.79 () {60 vars in 1159 bytes} [Mon Oct 17 14:05:51 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:05:54.254698 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9e3b50c4-4c2f-4629-aaec-d1b351f8be11 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:54.274364 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9e3b50c4-4c2f-4629-aaec-d1b351f8be11 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:54.280047 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9e3b50c4-4c2f-4629-aaec-d1b351f8be11 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:54.288952 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9e3b50c4-4c2f-4629-aaec-d1b351f8be11 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1721 microversion: 2.20 time: 2.055900 Oct 17 14:05:54.293867 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2784/5434] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:05:52 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1721 bytes in 2063 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:05:55.324304 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-005e2109-148d-4ae6-ba4e-9f746e19ffeb tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:55.326039 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-005e2109-148d-4ae6-ba4e-9f746e19ffeb tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:55.342965 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-005e2109-148d-4ae6-ba4e-9f746e19ffeb tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:55.344083 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-005e2109-148d-4ae6-ba4e-9f746e19ffeb tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:55.346316 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-005e2109-148d-4ae6-ba4e-9f746e19ffeb tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:55.349295 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-005e2109-148d-4ae6-ba4e-9f746e19ffeb tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:55.349918 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-005e2109-148d-4ae6-ba4e-9f746e19ffeb tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:55.352888 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-005e2109-148d-4ae6-ba4e-9f746e19ffeb tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:56.006512 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-24fb1b7b-7bea-457a-9fc5-a18908de2cb1 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-576105817", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-164864169", "security_groups": [{"name": "tempest-secgroup-smoke-1763161378"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "e44e18db-3acd-4b32-b1a2-12617702e615"}]}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:05:56.065228 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-005e2109-148d-4ae6-ba4e-9f746e19ffeb tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:56.081600 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-005e2109-148d-4ae6-ba4e-9f746e19ffeb tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:56.108097 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-005e2109-148d-4ae6-ba4e-9f746e19ffeb tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:56.109704 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-005e2109-148d-4ae6-ba4e-9f746e19ffeb tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1721 microversion: 2.20 time: 0.792888 Oct 17 14:05:56.126965 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2651/5435] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:05:55 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1721 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:05:56.410126 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-24fb1b7b-7bea-457a-9fc5-a18908de2cb1 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] validate_networks() for [('e44e18db-3acd-4b32-b1a2-12617702e615', None, None, None, None, None)] {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:05:57.152647 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f57f82e4-3dcc-43da-860b-85ba922fd6dd tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:57.155137 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f57f82e4-3dcc-43da-860b-85ba922fd6dd tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:57.177425 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f57f82e4-3dcc-43da-860b-85ba922fd6dd tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:57.178231 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f57f82e4-3dcc-43da-860b-85ba922fd6dd tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:57.179668 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f57f82e4-3dcc-43da-860b-85ba922fd6dd tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:57.180555 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f57f82e4-3dcc-43da-860b-85ba922fd6dd tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:57.181021 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f57f82e4-3dcc-43da-860b-85ba922fd6dd tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:57.181532 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f57f82e4-3dcc-43da-860b-85ba922fd6dd tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:57.826365 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:05:58.316755 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f57f82e4-3dcc-43da-860b-85ba922fd6dd tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:58.343416 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f57f82e4-3dcc-43da-860b-85ba922fd6dd tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:58.350263 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f57f82e4-3dcc-43da-860b-85ba922fd6dd tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:58.352452 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f57f82e4-3dcc-43da-860b-85ba922fd6dd tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1721 microversion: 2.20 time: 1.213715 Oct 17 14:05:58.380488 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2652/5436] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:05:57 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1721 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 14:05:58.632874 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-24fb1b7b-7bea-457a-9fc5-a18908de2cb1 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Getting quotas for project f716902fd72e44a2b2b7d0ef78f40b72. Resources: dict_keys(['metadata_items']) {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:05:58.665140 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-24fb1b7b-7bea-457a-9fc5-a18908de2cb1 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Getting quotas for user 2a2ddceda0be42bf8cfe265f7a07d462 and project f716902fd72e44a2b2b7d0ef78f40b72. Resources: dict_keys(['metadata_items']) {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:05:58.698791 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-24fb1b7b-7bea-457a-9fc5-a18908de2cb1 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:05:58.699375 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-24fb1b7b-7bea-457a-9fc5-a18908de2cb1 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:05:58.700557 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-24fb1b7b-7bea-457a-9fc5-a18908de2cb1 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:05:58.702390 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-24fb1b7b-7bea-457a-9fc5-a18908de2cb1 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:05:58.703263 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-24fb1b7b-7bea-457a-9fc5-a18908de2cb1 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:05:58.741337 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-24fb1b7b-7bea-457a-9fc5-a18908de2cb1 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:58.742156 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-24fb1b7b-7bea-457a-9fc5-a18908de2cb1 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:58.743234 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-24fb1b7b-7bea-457a-9fc5-a18908de2cb1 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:58.750496 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-24fb1b7b-7bea-457a-9fc5-a18908de2cb1 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:58.751241 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-24fb1b7b-7bea-457a-9fc5-a18908de2cb1 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:58.752734 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-24fb1b7b-7bea-457a-9fc5-a18908de2cb1 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:58.817021 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-24fb1b7b-7bea-457a-9fc5-a18908de2cb1 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Getting quotas for project f716902fd72e44a2b2b7d0ef78f40b72. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:05:58.853187 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-24fb1b7b-7bea-457a-9fc5-a18908de2cb1 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Getting quotas for user 2a2ddceda0be42bf8cfe265f7a07d462 and project f716902fd72e44a2b2b7d0ef78f40b72. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:05:58.906071 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-24fb1b7b-7bea-457a-9fc5-a18908de2cb1 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:05:58.916245 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-24fb1b7b-7bea-457a-9fc5-a18908de2cb1 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] [instance: b06b769b-4e30-480d-9a2f-e5f9b9fdeab2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:05:59.057421 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-24fb1b7b-7bea-457a-9fc5-a18908de2cb1 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.056368 Oct 17 14:05:59.059114 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2785/5437] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 14:05:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 3059 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 14:05:59.071899 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3203def7-45c7-44d4-9ffb-0cf3251c9b27 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:59.072974 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3203def7-45c7-44d4-9ffb-0cf3251c9b27 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] [instance: b06b769b-4e30-480d-9a2f-e5f9b9fdeab2] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:59.242761 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3203def7-45c7-44d4-9ffb-0cf3251c9b27 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ddceda0be42bf8cfe265f7a07d462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f716902fd72e44a2b2b7d0ef78f40b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:59.262097 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3203def7-45c7-44d4-9ffb-0cf3251c9b27 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] 10.222.0.79 "GET /compute/v2.1/servers/b06b769b-4e30-480d-9a2f-e5f9b9fdeab2" status: 200 len: 1301 microversion: 2.1 time: 0.195904 Oct 17 14:05:59.265677 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2653/5438] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:05:59 2022] GET /compute/v2.1/servers/b06b769b-4e30-480d-9a2f-e5f9b9fdeab2 => generated 1301 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:05:59.389892 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c72ff3ad-1317-46ef-97fd-9f65ba59e9fb tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:59.391039 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c72ff3ad-1317-46ef-97fd-9f65ba59e9fb tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:59.412001 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c72ff3ad-1317-46ef-97fd-9f65ba59e9fb tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:59.412722 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c72ff3ad-1317-46ef-97fd-9f65ba59e9fb tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:59.413322 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c72ff3ad-1317-46ef-97fd-9f65ba59e9fb tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:59.414173 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c72ff3ad-1317-46ef-97fd-9f65ba59e9fb tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:59.415021 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c72ff3ad-1317-46ef-97fd-9f65ba59e9fb tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:59.415507 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c72ff3ad-1317-46ef-97fd-9f65ba59e9fb tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:59.938727 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c72ff3ad-1317-46ef-97fd-9f65ba59e9fb tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:59.948669 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c72ff3ad-1317-46ef-97fd-9f65ba59e9fb tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:59.960313 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c72ff3ad-1317-46ef-97fd-9f65ba59e9fb tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:59.969351 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c72ff3ad-1317-46ef-97fd-9f65ba59e9fb tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1742 microversion: 2.20 time: 0.583877 Oct 17 14:05:59.973721 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2786/5439] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:05:59 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1742 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:06:00.296661 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-84115a45-b19e-4d37-a718-11cf5cf41cc0 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:00.300573 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-84115a45-b19e-4d37-a718-11cf5cf41cc0 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] [instance: b06b769b-4e30-480d-9a2f-e5f9b9fdeab2] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:00.565752 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-84115a45-b19e-4d37-a718-11cf5cf41cc0 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ddceda0be42bf8cfe265f7a07d462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f716902fd72e44a2b2b7d0ef78f40b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:00.573701 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-84115a45-b19e-4d37-a718-11cf5cf41cc0 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] 10.222.0.79 "GET /compute/v2.1/servers/b06b769b-4e30-480d-9a2f-e5f9b9fdeab2" status: 200 len: 1301 microversion: 2.1 time: 0.291004 Oct 17 14:06:00.577584 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2654/5440] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:06:00 2022] GET /compute/v2.1/servers/b06b769b-4e30-480d-9a2f-e5f9b9fdeab2 => generated 1301 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:06:01.003941 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b7199d99-99f7-4dda-83fe-3f418489adf3 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:01.009184 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b7199d99-99f7-4dda-83fe-3f418489adf3 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:01.044774 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b7199d99-99f7-4dda-83fe-3f418489adf3 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:01.045324 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b7199d99-99f7-4dda-83fe-3f418489adf3 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:01.045764 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b7199d99-99f7-4dda-83fe-3f418489adf3 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:01.046484 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b7199d99-99f7-4dda-83fe-3f418489adf3 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:01.047100 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b7199d99-99f7-4dda-83fe-3f418489adf3 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:01.068362 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b7199d99-99f7-4dda-83fe-3f418489adf3 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:01.604537 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-03e0a504-e33d-4f9d-9767-c151738d5640 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:01.605185 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-03e0a504-e33d-4f9d-9767-c151738d5640 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] [instance: b06b769b-4e30-480d-9a2f-e5f9b9fdeab2] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:01.658383 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-03e0a504-e33d-4f9d-9767-c151738d5640 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:01.659422 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-03e0a504-e33d-4f9d-9767-c151738d5640 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:01.666264 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-03e0a504-e33d-4f9d-9767-c151738d5640 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:01.667376 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-03e0a504-e33d-4f9d-9767-c151738d5640 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:01.673471 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-03e0a504-e33d-4f9d-9767-c151738d5640 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:01.675833 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-03e0a504-e33d-4f9d-9767-c151738d5640 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:02.248296 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b7199d99-99f7-4dda-83fe-3f418489adf3 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:02.259009 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b7199d99-99f7-4dda-83fe-3f418489adf3 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:02.263864 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b7199d99-99f7-4dda-83fe-3f418489adf3 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:02.267157 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b7199d99-99f7-4dda-83fe-3f418489adf3 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1737 microversion: 2.20 time: 1.268367 Oct 17 14:06:02.283975 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2787/5441] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:06:00 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1737 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:06:02.361313 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-03e0a504-e33d-4f9d-9767-c151738d5640 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ddceda0be42bf8cfe265f7a07d462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f716902fd72e44a2b2b7d0ef78f40b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:02.378321 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-03e0a504-e33d-4f9d-9767-c151738d5640 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] 10.222.0.79 "GET /compute/v2.1/servers/b06b769b-4e30-480d-9a2f-e5f9b9fdeab2" status: 200 len: 1361 microversion: 2.1 time: 0.778962 Oct 17 14:06:02.379612 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2655/5442] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:06:01 2022] GET /compute/v2.1/servers/b06b769b-4e30-480d-9a2f-e5f9b9fdeab2 => generated 1361 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:06:03.302394 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b8f2e48a-91fe-4cbc-872f-bff7f4ceec56 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:03.303414 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b8f2e48a-91fe-4cbc-872f-bff7f4ceec56 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:03.349974 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b8f2e48a-91fe-4cbc-872f-bff7f4ceec56 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:03.350497 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b8f2e48a-91fe-4cbc-872f-bff7f4ceec56 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:03.350947 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b8f2e48a-91fe-4cbc-872f-bff7f4ceec56 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:03.351726 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b8f2e48a-91fe-4cbc-872f-bff7f4ceec56 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:03.378428 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b8f2e48a-91fe-4cbc-872f-bff7f4ceec56 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:03.388547 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b8f2e48a-91fe-4cbc-872f-bff7f4ceec56 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:03.416509 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a179078c-a9e3-4c01-97b6-d7c2e21de843 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:03.418394 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a179078c-a9e3-4c01-97b6-d7c2e21de843 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] [instance: b06b769b-4e30-480d-9a2f-e5f9b9fdeab2] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:03.459725 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a179078c-a9e3-4c01-97b6-d7c2e21de843 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:03.460287 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a179078c-a9e3-4c01-97b6-d7c2e21de843 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:03.460748 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a179078c-a9e3-4c01-97b6-d7c2e21de843 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:03.475885 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a179078c-a9e3-4c01-97b6-d7c2e21de843 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:03.476385 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a179078c-a9e3-4c01-97b6-d7c2e21de843 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:03.478890 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a179078c-a9e3-4c01-97b6-d7c2e21de843 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:03.545597 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=52,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:06:03.952571 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a179078c-a9e3-4c01-97b6-d7c2e21de843 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ddceda0be42bf8cfe265f7a07d462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f716902fd72e44a2b2b7d0ef78f40b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:03.975342 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a179078c-a9e3-4c01-97b6-d7c2e21de843 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] 10.222.0.79 "GET /compute/v2.1/servers/b06b769b-4e30-480d-9a2f-e5f9b9fdeab2" status: 200 len: 1359 microversion: 2.1 time: 0.563560 Oct 17 14:06:03.980882 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2656/5443] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:06:03 2022] GET /compute/v2.1/servers/b06b769b-4e30-480d-9a2f-e5f9b9fdeab2 => generated 1359 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:06:03.994618 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-092a3bb8-0f18-4ded-903a-05afe062daa3 req-148bdea5-8b29-4a88-b193-604ba299a0a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32c279ba-2f76-4986-be6d-1029602677ed", "name": "network-vif-plugged", "status": "completed", "tag": "b00489ac-2c3b-4d9e-843a-d9962aa3d085"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:06:04.036359 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-092a3bb8-0f18-4ded-903a-05afe062daa3 req-148bdea5-8b29-4a88-b193-604ba299a0a3 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:04.041280 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-092a3bb8-0f18-4ded-903a-05afe062daa3 req-148bdea5-8b29-4a88-b193-604ba299a0a3 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:04.043230 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-092a3bb8-0f18-4ded-903a-05afe062daa3 req-148bdea5-8b29-4a88-b193-604ba299a0a3 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:04.103671 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-092a3bb8-0f18-4ded-903a-05afe062daa3 req-148bdea5-8b29-4a88-b193-604ba299a0a3 service nova] Creating event network-vif-plugged:b00489ac-2c3b-4d9e-843a-d9962aa3d085 for instance 32c279ba-2f76-4986-be6d-1029602677ed on n-h2-854247-14 Oct 17 14:06:04.121584 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-092a3bb8-0f18-4ded-903a-05afe062daa3 req-148bdea5-8b29-4a88-b193-604ba299a0a3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132835 Oct 17 14:06:04.123544 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2657/5444] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:06:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:06:04.251518 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b8f2e48a-91fe-4cbc-872f-bff7f4ceec56 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:04.268589 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b8f2e48a-91fe-4cbc-872f-bff7f4ceec56 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:04.276231 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b8f2e48a-91fe-4cbc-872f-bff7f4ceec56 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:04.281219 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b8f2e48a-91fe-4cbc-872f-bff7f4ceec56 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1737 microversion: 2.20 time: 0.983991 Oct 17 14:06:04.283049 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2788/5445] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:06:03 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1737 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:06:05.008957 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5968506e-3c44-4396-8eef-13311a681c14 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:05.010890 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5968506e-3c44-4396-8eef-13311a681c14 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] [instance: b06b769b-4e30-480d-9a2f-e5f9b9fdeab2] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:05.024769 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5968506e-3c44-4396-8eef-13311a681c14 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:05.028257 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5968506e-3c44-4396-8eef-13311a681c14 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:05.030422 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5968506e-3c44-4396-8eef-13311a681c14 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:05.033583 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5968506e-3c44-4396-8eef-13311a681c14 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:05.034407 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5968506e-3c44-4396-8eef-13311a681c14 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:05.035457 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5968506e-3c44-4396-8eef-13311a681c14 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:05.312354 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8b3f6f44-4e4b-4298-80cd-d53624845c71 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:05.313249 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8b3f6f44-4e4b-4298-80cd-d53624845c71 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:05.325546 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8b3f6f44-4e4b-4298-80cd-d53624845c71 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:05.326042 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8b3f6f44-4e4b-4298-80cd-d53624845c71 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:05.334913 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8b3f6f44-4e4b-4298-80cd-d53624845c71 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:05.335745 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8b3f6f44-4e4b-4298-80cd-d53624845c71 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:05.336244 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8b3f6f44-4e4b-4298-80cd-d53624845c71 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:05.336686 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8b3f6f44-4e4b-4298-80cd-d53624845c71 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:06.934741 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5968506e-3c44-4396-8eef-13311a681c14 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ddceda0be42bf8cfe265f7a07d462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f716902fd72e44a2b2b7d0ef78f40b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:06.943510 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5968506e-3c44-4396-8eef-13311a681c14 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] 10.222.0.79 "GET /compute/v2.1/servers/b06b769b-4e30-480d-9a2f-e5f9b9fdeab2" status: 200 len: 1427 microversion: 2.1 time: 1.939529 Oct 17 14:06:06.949408 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2658/5446] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:06:05 2022] GET /compute/v2.1/servers/b06b769b-4e30-480d-9a2f-e5f9b9fdeab2 => generated 1427 bytes in 1946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:06:06.953105 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8b3f6f44-4e4b-4298-80cd-d53624845c71 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:06.961745 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8b3f6f44-4e4b-4298-80cd-d53624845c71 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:06.969711 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8b3f6f44-4e4b-4298-80cd-d53624845c71 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:06.976854 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8b3f6f44-4e4b-4298-80cd-d53624845c71 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1737 microversion: 2.20 time: 1.668956 Oct 17 14:06:07.002128 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2789/5447] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:06:05 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1737 bytes in 1695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 14:06:07.525414 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-756f69c1-5a61-4a9d-b610-b3925a5156ba req-c8891ebe-7d92-4e89-a70f-4f4c25c9c959 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b06b769b-4e30-480d-9a2f-e5f9b9fdeab2", "tag": "05824010-0f55-4a59-9f98-90518d4247c6"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:06:07.559205 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-756f69c1-5a61-4a9d-b610-b3925a5156ba req-c8891ebe-7d92-4e89-a70f-4f4c25c9c959 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:07.563604 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-756f69c1-5a61-4a9d-b610-b3925a5156ba req-c8891ebe-7d92-4e89-a70f-4f4c25c9c959 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:07.567722 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-756f69c1-5a61-4a9d-b610-b3925a5156ba req-c8891ebe-7d92-4e89-a70f-4f4c25c9c959 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:07.606022 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-756f69c1-5a61-4a9d-b610-b3925a5156ba req-c8891ebe-7d92-4e89-a70f-4f4c25c9c959 service nova] Creating event network-changed:05824010-0f55-4a59-9f98-90518d4247c6 for instance b06b769b-4e30-480d-9a2f-e5f9b9fdeab2 on n-h1-854247-14 Oct 17 14:06:07.613454 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-756f69c1-5a61-4a9d-b610-b3925a5156ba req-c8891ebe-7d92-4e89-a70f-4f4c25c9c959 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091678 Oct 17 14:06:07.614074 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2659/5448] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:06:07.970550 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ddf04767-14c0-40f5-b712-c6225b4ec1bf tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:07.979652 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ddf04767-14c0-40f5-b712-c6225b4ec1bf tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] [instance: b06b769b-4e30-480d-9a2f-e5f9b9fdeab2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:08.008821 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6d600e5a-5789-422c-a32d-dd6f12a36110 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:08.009546 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6d600e5a-5789-422c-a32d-dd6f12a36110 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:08.015067 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ddf04767-14c0-40f5-b712-c6225b4ec1bf tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:08.018306 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ddf04767-14c0-40f5-b712-c6225b4ec1bf tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:08.023002 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ddf04767-14c0-40f5-b712-c6225b4ec1bf tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:08.025662 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ddf04767-14c0-40f5-b712-c6225b4ec1bf tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:08.027505 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ddf04767-14c0-40f5-b712-c6225b4ec1bf tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:08.030516 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ddf04767-14c0-40f5-b712-c6225b4ec1bf tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:08.037915 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6d600e5a-5789-422c-a32d-dd6f12a36110 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:08.038418 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6d600e5a-5789-422c-a32d-dd6f12a36110 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:08.038858 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6d600e5a-5789-422c-a32d-dd6f12a36110 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:08.039612 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6d600e5a-5789-422c-a32d-dd6f12a36110 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:08.040061 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6d600e5a-5789-422c-a32d-dd6f12a36110 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:08.041054 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6d600e5a-5789-422c-a32d-dd6f12a36110 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:08.583405 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ddf04767-14c0-40f5-b712-c6225b4ec1bf tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ddceda0be42bf8cfe265f7a07d462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f716902fd72e44a2b2b7d0ef78f40b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:08.591574 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ddf04767-14c0-40f5-b712-c6225b4ec1bf tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] 10.222.0.79 "GET /compute/v2.1/servers/b06b769b-4e30-480d-9a2f-e5f9b9fdeab2" status: 200 len: 1427 microversion: 2.1 time: 0.625024 Oct 17 14:06:08.592504 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2790/5449] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:06:07 2022] GET /compute/v2.1/servers/b06b769b-4e30-480d-9a2f-e5f9b9fdeab2 => generated 1427 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:06:09.024204 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6d600e5a-5789-422c-a32d-dd6f12a36110 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:09.036800 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6d600e5a-5789-422c-a32d-dd6f12a36110 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:09.038913 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6d600e5a-5789-422c-a32d-dd6f12a36110 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:09.040573 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6d600e5a-5789-422c-a32d-dd6f12a36110 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1737 microversion: 2.20 time: 1.037352 Oct 17 14:06:09.082576 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2660/5450] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:06:08 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1737 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 14:06:09.618656 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-01167dbd-da20-4263-8c38-547c42c926a2 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:09.620447 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-01167dbd-da20-4263-8c38-547c42c926a2 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] [instance: b06b769b-4e30-480d-9a2f-e5f9b9fdeab2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:09.623067 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:06:09.624586 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=10 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:06:09.636829 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-01167dbd-da20-4263-8c38-547c42c926a2 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:09.640691 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-01167dbd-da20-4263-8c38-547c42c926a2 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:09.643263 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-01167dbd-da20-4263-8c38-547c42c926a2 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:09.645180 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-01167dbd-da20-4263-8c38-547c42c926a2 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:09.646201 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-01167dbd-da20-4263-8c38-547c42c926a2 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:09.649236 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-01167dbd-da20-4263-8c38-547c42c926a2 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:10.010470 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-01167dbd-da20-4263-8c38-547c42c926a2 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ddceda0be42bf8cfe265f7a07d462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f716902fd72e44a2b2b7d0ef78f40b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:10.023437 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-01167dbd-da20-4263-8c38-547c42c926a2 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] 10.222.0.79 "GET /compute/v2.1/servers/b06b769b-4e30-480d-9a2f-e5f9b9fdeab2" status: 200 len: 1427 microversion: 2.1 time: 0.408954 Oct 17 14:06:10.025325 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2791/5451] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:06:09 2022] GET /compute/v2.1/servers/b06b769b-4e30-480d-9a2f-e5f9b9fdeab2 => generated 1427 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:06:10.094564 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ad321d6d-b1f9-4ac5-99d1-6a340a620705 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:10.095367 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ad321d6d-b1f9-4ac5-99d1-6a340a620705 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:10.111106 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ad321d6d-b1f9-4ac5-99d1-6a340a620705 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:10.115037 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ad321d6d-b1f9-4ac5-99d1-6a340a620705 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:10.117061 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ad321d6d-b1f9-4ac5-99d1-6a340a620705 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:10.120797 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ad321d6d-b1f9-4ac5-99d1-6a340a620705 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:10.125652 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ad321d6d-b1f9-4ac5-99d1-6a340a620705 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:10.126469 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ad321d6d-b1f9-4ac5-99d1-6a340a620705 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:10.490815 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ad321d6d-b1f9-4ac5-99d1-6a340a620705 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:10.505537 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ad321d6d-b1f9-4ac5-99d1-6a340a620705 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:10.507752 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ad321d6d-b1f9-4ac5-99d1-6a340a620705 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:10.510957 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ad321d6d-b1f9-4ac5-99d1-6a340a620705 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1737 microversion: 2.20 time: 0.420737 Oct 17 14:06:10.514791 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2661/5452] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:06:10 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1737 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:06:11.049122 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-99f93534-adb8-41b7-8615-0ad4a5d1239e tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:11.050804 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-99f93534-adb8-41b7-8615-0ad4a5d1239e tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] [instance: b06b769b-4e30-480d-9a2f-e5f9b9fdeab2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:11.064249 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-99f93534-adb8-41b7-8615-0ad4a5d1239e tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:11.073657 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-99f93534-adb8-41b7-8615-0ad4a5d1239e tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:11.074504 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-99f93534-adb8-41b7-8615-0ad4a5d1239e tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:11.085431 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-99f93534-adb8-41b7-8615-0ad4a5d1239e tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:11.086315 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-99f93534-adb8-41b7-8615-0ad4a5d1239e tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:11.086982 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-99f93534-adb8-41b7-8615-0ad4a5d1239e tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:11.432843 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-99f93534-adb8-41b7-8615-0ad4a5d1239e tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ddceda0be42bf8cfe265f7a07d462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f716902fd72e44a2b2b7d0ef78f40b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:11.449838 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-99f93534-adb8-41b7-8615-0ad4a5d1239e tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] 10.222.0.79 "GET /compute/v2.1/servers/b06b769b-4e30-480d-9a2f-e5f9b9fdeab2" status: 200 len: 1427 microversion: 2.1 time: 0.402565 Oct 17 14:06:11.459275 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2792/5453] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:06:11 2022] GET /compute/v2.1/servers/b06b769b-4e30-480d-9a2f-e5f9b9fdeab2 => generated 1427 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:06:11.546750 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c37084ce-e5ea-478d-8e76-618796b1e30b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:11.548893 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c37084ce-e5ea-478d-8e76-618796b1e30b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:11.559722 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=8 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:06:11.573565 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c37084ce-e5ea-478d-8e76-618796b1e30b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:11.576223 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c37084ce-e5ea-478d-8e76-618796b1e30b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:11.577141 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c37084ce-e5ea-478d-8e76-618796b1e30b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:11.579481 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c37084ce-e5ea-478d-8e76-618796b1e30b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:11.581829 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c37084ce-e5ea-478d-8e76-618796b1e30b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:11.582552 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c37084ce-e5ea-478d-8e76-618796b1e30b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:11.989885 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c37084ce-e5ea-478d-8e76-618796b1e30b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:12.004153 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c37084ce-e5ea-478d-8e76-618796b1e30b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:12.012957 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c37084ce-e5ea-478d-8e76-618796b1e30b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:12.017108 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c37084ce-e5ea-478d-8e76-618796b1e30b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1737 microversion: 2.20 time: 0.475115 Oct 17 14:06:12.041439 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2662/5454] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:06:11 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1737 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:06:12.483308 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ab83e723-c822-4cc5-9601-34f1656a69f1 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:12.485012 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ab83e723-c822-4cc5-9601-34f1656a69f1 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] [instance: b06b769b-4e30-480d-9a2f-e5f9b9fdeab2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:12.508120 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ab83e723-c822-4cc5-9601-34f1656a69f1 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:12.514041 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ab83e723-c822-4cc5-9601-34f1656a69f1 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:12.515086 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ab83e723-c822-4cc5-9601-34f1656a69f1 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:12.517081 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ab83e723-c822-4cc5-9601-34f1656a69f1 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:12.517862 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ab83e723-c822-4cc5-9601-34f1656a69f1 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:12.522727 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ab83e723-c822-4cc5-9601-34f1656a69f1 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:12.780751 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ab83e723-c822-4cc5-9601-34f1656a69f1 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ddceda0be42bf8cfe265f7a07d462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f716902fd72e44a2b2b7d0ef78f40b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:12.794293 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ab83e723-c822-4cc5-9601-34f1656a69f1 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] 10.222.0.79 "GET /compute/v2.1/servers/b06b769b-4e30-480d-9a2f-e5f9b9fdeab2" status: 200 len: 1427 microversion: 2.1 time: 0.316624 Oct 17 14:06:12.797413 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2793/5455] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:06:12 2022] GET /compute/v2.1/servers/b06b769b-4e30-480d-9a2f-e5f9b9fdeab2 => generated 1427 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:06:13.051228 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-30e426a6-e71f-4ed1-b5b6-761e7f087ece tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:13.053182 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-30e426a6-e71f-4ed1-b5b6-761e7f087ece tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:13.072583 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-30e426a6-e71f-4ed1-b5b6-761e7f087ece tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:13.074345 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-30e426a6-e71f-4ed1-b5b6-761e7f087ece tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:13.075303 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-30e426a6-e71f-4ed1-b5b6-761e7f087ece tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:13.077000 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-30e426a6-e71f-4ed1-b5b6-761e7f087ece tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:13.079903 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-30e426a6-e71f-4ed1-b5b6-761e7f087ece tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:13.081091 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-30e426a6-e71f-4ed1-b5b6-761e7f087ece tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:13.504043 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-30e426a6-e71f-4ed1-b5b6-761e7f087ece tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:13.521891 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-30e426a6-e71f-4ed1-b5b6-761e7f087ece tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:13.529148 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-30e426a6-e71f-4ed1-b5b6-761e7f087ece tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:13.536991 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-30e426a6-e71f-4ed1-b5b6-761e7f087ece tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1737 microversion: 2.20 time: 0.486561 Oct 17 14:06:13.538196 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2663/5456] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:06:13 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1737 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:06:13.822666 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-963f72cc-0975-4a58-9d0e-91c0ed926e1b tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:13.824058 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-963f72cc-0975-4a58-9d0e-91c0ed926e1b tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] [instance: b06b769b-4e30-480d-9a2f-e5f9b9fdeab2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:13.839471 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-963f72cc-0975-4a58-9d0e-91c0ed926e1b tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:13.844497 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-963f72cc-0975-4a58-9d0e-91c0ed926e1b tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:13.848745 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-963f72cc-0975-4a58-9d0e-91c0ed926e1b tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:13.849752 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-963f72cc-0975-4a58-9d0e-91c0ed926e1b tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:13.851689 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-963f72cc-0975-4a58-9d0e-91c0ed926e1b tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:13.853862 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-963f72cc-0975-4a58-9d0e-91c0ed926e1b tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:14.176376 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-963f72cc-0975-4a58-9d0e-91c0ed926e1b tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ddceda0be42bf8cfe265f7a07d462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f716902fd72e44a2b2b7d0ef78f40b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:14.190510 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-963f72cc-0975-4a58-9d0e-91c0ed926e1b tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] 10.222.0.79 "GET /compute/v2.1/servers/b06b769b-4e30-480d-9a2f-e5f9b9fdeab2" status: 200 len: 1427 microversion: 2.1 time: 0.368172 Oct 17 14:06:14.191496 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2794/5457] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:06:13 2022] GET /compute/v2.1/servers/b06b769b-4e30-480d-9a2f-e5f9b9fdeab2 => generated 1427 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:06:14.567232 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-13aebc82-8ac9-4115-addb-ba2aa2ce4ee5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:14.568127 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-13aebc82-8ac9-4115-addb-ba2aa2ce4ee5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:14.581807 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-13aebc82-8ac9-4115-addb-ba2aa2ce4ee5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:14.595709 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-13aebc82-8ac9-4115-addb-ba2aa2ce4ee5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:14.596570 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-13aebc82-8ac9-4115-addb-ba2aa2ce4ee5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:14.597804 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-13aebc82-8ac9-4115-addb-ba2aa2ce4ee5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:14.598285 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-13aebc82-8ac9-4115-addb-ba2aa2ce4ee5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:14.598716 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-13aebc82-8ac9-4115-addb-ba2aa2ce4ee5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:15.016095 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-13aebc82-8ac9-4115-addb-ba2aa2ce4ee5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:15.030820 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-13aebc82-8ac9-4115-addb-ba2aa2ce4ee5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:15.037312 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-13aebc82-8ac9-4115-addb-ba2aa2ce4ee5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:15.041838 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-13aebc82-8ac9-4115-addb-ba2aa2ce4ee5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1737 microversion: 2.20 time: 0.477656 Oct 17 14:06:15.045195 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2664/5458] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:06:14 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1737 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:06:15.163673 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-75f4e87b-de94-4f0a-be0b-4a33369039e7 req-42a0f5df-7bc5-4a93-988a-20eed15bc706 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b06b769b-4e30-480d-9a2f-e5f9b9fdeab2", "name": "network-vif-plugged", "status": "completed", "tag": "05824010-0f55-4a59-9f98-90518d4247c6"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:06:15.183397 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-75f4e87b-de94-4f0a-be0b-4a33369039e7 req-42a0f5df-7bc5-4a93-988a-20eed15bc706 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:15.184186 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-75f4e87b-de94-4f0a-be0b-4a33369039e7 req-42a0f5df-7bc5-4a93-988a-20eed15bc706 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:15.184808 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-75f4e87b-de94-4f0a-be0b-4a33369039e7 req-42a0f5df-7bc5-4a93-988a-20eed15bc706 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:15.200602 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-75f4e87b-de94-4f0a-be0b-4a33369039e7 req-42a0f5df-7bc5-4a93-988a-20eed15bc706 service nova] Creating event network-vif-plugged:05824010-0f55-4a59-9f98-90518d4247c6 for instance b06b769b-4e30-480d-9a2f-e5f9b9fdeab2 on n-h1-854247-14 Oct 17 14:06:15.219374 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c52ad83b-25e6-423e-8801-9606a941a7d5 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:15.220711 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c52ad83b-25e6-423e-8801-9606a941a7d5 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] [instance: b06b769b-4e30-480d-9a2f-e5f9b9fdeab2] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:15.233379 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c52ad83b-25e6-423e-8801-9606a941a7d5 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:15.234411 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-75f4e87b-de94-4f0a-be0b-4a33369039e7 req-42a0f5df-7bc5-4a93-988a-20eed15bc706 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072435 Oct 17 14:06:15.238633 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2795/5459] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:06:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:06:15.239738 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c52ad83b-25e6-423e-8801-9606a941a7d5 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:15.240377 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c52ad83b-25e6-423e-8801-9606a941a7d5 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:15.242805 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c52ad83b-25e6-423e-8801-9606a941a7d5 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:15.243520 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c52ad83b-25e6-423e-8801-9606a941a7d5 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:15.245069 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c52ad83b-25e6-423e-8801-9606a941a7d5 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:15.703608 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c52ad83b-25e6-423e-8801-9606a941a7d5 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ddceda0be42bf8cfe265f7a07d462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f716902fd72e44a2b2b7d0ef78f40b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:15.715242 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c52ad83b-25e6-423e-8801-9606a941a7d5 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] 10.222.0.79 "GET /compute/v2.1/servers/b06b769b-4e30-480d-9a2f-e5f9b9fdeab2" status: 200 len: 1427 microversion: 2.1 time: 0.500474 Oct 17 14:06:15.716452 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2665/5460] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:06:15 2022] GET /compute/v2.1/servers/b06b769b-4e30-480d-9a2f-e5f9b9fdeab2 => generated 1427 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:06:16.069582 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ae0965eb-40ce-48fd-a55e-f34b099bf3ee tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:16.070205 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ae0965eb-40ce-48fd-a55e-f34b099bf3ee tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:16.078103 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ae0965eb-40ce-48fd-a55e-f34b099bf3ee tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:16.078685 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ae0965eb-40ce-48fd-a55e-f34b099bf3ee tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:16.079013 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ae0965eb-40ce-48fd-a55e-f34b099bf3ee tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:16.079801 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ae0965eb-40ce-48fd-a55e-f34b099bf3ee tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:16.080260 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ae0965eb-40ce-48fd-a55e-f34b099bf3ee tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:16.080693 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ae0965eb-40ce-48fd-a55e-f34b099bf3ee tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:16.471278 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ae0965eb-40ce-48fd-a55e-f34b099bf3ee tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:16.486187 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ae0965eb-40ce-48fd-a55e-f34b099bf3ee tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:16.496302 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ae0965eb-40ce-48fd-a55e-f34b099bf3ee tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:16.497704 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ae0965eb-40ce-48fd-a55e-f34b099bf3ee tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1737 microversion: 2.20 time: 0.432538 Oct 17 14:06:16.498298 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2796/5461] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:06:16 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1737 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 14:06:16.744180 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-25d62868-4382-4359-bfea-a22455969cf2 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:16.744803 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-25d62868-4382-4359-bfea-a22455969cf2 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] [instance: b06b769b-4e30-480d-9a2f-e5f9b9fdeab2] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:16.759422 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-25d62868-4382-4359-bfea-a22455969cf2 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:16.759913 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-25d62868-4382-4359-bfea-a22455969cf2 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:16.760336 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-25d62868-4382-4359-bfea-a22455969cf2 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:16.764611 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-25d62868-4382-4359-bfea-a22455969cf2 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:16.769618 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-25d62868-4382-4359-bfea-a22455969cf2 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:16.771845 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-25d62868-4382-4359-bfea-a22455969cf2 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:17.113316 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-25d62868-4382-4359-bfea-a22455969cf2 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ddceda0be42bf8cfe265f7a07d462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f716902fd72e44a2b2b7d0ef78f40b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:17.127496 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-25d62868-4382-4359-bfea-a22455969cf2 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] 10.222.0.79 "GET /compute/v2.1/servers/b06b769b-4e30-480d-9a2f-e5f9b9fdeab2" status: 200 len: 1607 microversion: 2.1 time: 0.386839 Oct 17 14:06:17.128624 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2666/5462] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:06:16 2022] GET /compute/v2.1/servers/b06b769b-4e30-480d-9a2f-e5f9b9fdeab2 => generated 1607 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:06:17.160162 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6dff20c9-f136-4d06-b443-6f3718da4c65 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:17.160800 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6dff20c9-f136-4d06-b443-6f3718da4c65 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] [instance: b06b769b-4e30-480d-9a2f-e5f9b9fdeab2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:17.179920 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6dff20c9-f136-4d06-b443-6f3718da4c65 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:17.180426 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6dff20c9-f136-4d06-b443-6f3718da4c65 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:17.188101 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6dff20c9-f136-4d06-b443-6f3718da4c65 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:17.189150 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6dff20c9-f136-4d06-b443-6f3718da4c65 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:17.194945 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6dff20c9-f136-4d06-b443-6f3718da4c65 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:17.195430 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6dff20c9-f136-4d06-b443-6f3718da4c65 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:17.527943 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e9ff61b3-fb5f-4476-844c-fe661a9c1069 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:17.529217 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e9ff61b3-fb5f-4476-844c-fe661a9c1069 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:17.546620 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e9ff61b3-fb5f-4476-844c-fe661a9c1069 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:17.548767 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e9ff61b3-fb5f-4476-844c-fe661a9c1069 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:17.549589 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e9ff61b3-fb5f-4476-844c-fe661a9c1069 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:17.551151 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e9ff61b3-fb5f-4476-844c-fe661a9c1069 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:17.552122 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e9ff61b3-fb5f-4476-844c-fe661a9c1069 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:17.559796 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e9ff61b3-fb5f-4476-844c-fe661a9c1069 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:17.582115 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6dff20c9-f136-4d06-b443-6f3718da4c65 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ddceda0be42bf8cfe265f7a07d462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f716902fd72e44a2b2b7d0ef78f40b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:17.596395 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6dff20c9-f136-4d06-b443-6f3718da4c65 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] 10.222.0.79 "GET /compute/v2.1/servers/b06b769b-4e30-480d-9a2f-e5f9b9fdeab2" status: 200 len: 1607 microversion: 2.1 time: 0.446214 Oct 17 14:06:17.602327 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2797/5463] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:06:17 2022] GET /compute/v2.1/servers/b06b769b-4e30-480d-9a2f-e5f9b9fdeab2 => generated 1607 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:06:17.625986 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-912ff01b-7023-42e0-ac68-3dac9b431de0 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:17.627821 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-912ff01b-7023-42e0-ac68-3dac9b431de0 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] [instance: b06b769b-4e30-480d-9a2f-e5f9b9fdeab2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:17.639545 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-912ff01b-7023-42e0-ac68-3dac9b431de0 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:17.640884 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-912ff01b-7023-42e0-ac68-3dac9b431de0 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:17.642046 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-912ff01b-7023-42e0-ac68-3dac9b431de0 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:17.643429 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-912ff01b-7023-42e0-ac68-3dac9b431de0 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:17.644861 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-912ff01b-7023-42e0-ac68-3dac9b431de0 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:17.650086 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-912ff01b-7023-42e0-ac68-3dac9b431de0 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:18.109696 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-912ff01b-7023-42e0-ac68-3dac9b431de0 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ddceda0be42bf8cfe265f7a07d462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f716902fd72e44a2b2b7d0ef78f40b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:18.127842 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-912ff01b-7023-42e0-ac68-3dac9b431de0 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] 10.222.0.79 "GET /compute/v2.1/servers/b06b769b-4e30-480d-9a2f-e5f9b9fdeab2" status: 200 len: 1607 microversion: 2.1 time: 0.501494 Oct 17 14:06:18.132296 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2798/5464] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:06:17 2022] GET /compute/v2.1/servers/b06b769b-4e30-480d-9a2f-e5f9b9fdeab2 => generated 1607 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:06:18.180029 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e9ff61b3-fb5f-4476-844c-fe661a9c1069 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:18.182399 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=86 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:06:18.196037 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e9ff61b3-fb5f-4476-844c-fe661a9c1069 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:18.197786 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e9ff61b3-fb5f-4476-844c-fe661a9c1069 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:18.199305 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e9ff61b3-fb5f-4476-844c-fe661a9c1069 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1737 microversion: 2.20 time: 0.675539 Oct 17 14:06:18.202209 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2667/5465] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:06:17 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1737 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:06:19.233074 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-99d7a88c-c829-443c-a565-671108849a77 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:19.233808 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-99d7a88c-c829-443c-a565-671108849a77 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:19.250166 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-99d7a88c-c829-443c-a565-671108849a77 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:19.253259 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-99d7a88c-c829-443c-a565-671108849a77 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:19.253808 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-99d7a88c-c829-443c-a565-671108849a77 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:19.254572 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-99d7a88c-c829-443c-a565-671108849a77 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:19.255041 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-99d7a88c-c829-443c-a565-671108849a77 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:19.255517 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-99d7a88c-c829-443c-a565-671108849a77 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:19.607296 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-99d7a88c-c829-443c-a565-671108849a77 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:19.639072 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-99d7a88c-c829-443c-a565-671108849a77 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:19.648274 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-99d7a88c-c829-443c-a565-671108849a77 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:19.651399 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-99d7a88c-c829-443c-a565-671108849a77 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1737 microversion: 2.20 time: 0.422514 Oct 17 14:06:19.655555 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2799/5466] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:06:19 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1737 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:06:20.685433 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-fa90555f-8e4b-4cfb-906e-58325aafd818 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:20.686829 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-fa90555f-8e4b-4cfb-906e-58325aafd818 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:20.691619 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:06:20.724304 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fa90555f-8e4b-4cfb-906e-58325aafd818 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:20.735771 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fa90555f-8e4b-4cfb-906e-58325aafd818 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:20.736326 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fa90555f-8e4b-4cfb-906e-58325aafd818 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:20.737080 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fa90555f-8e4b-4cfb-906e-58325aafd818 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:20.742795 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fa90555f-8e4b-4cfb-906e-58325aafd818 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:20.745564 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fa90555f-8e4b-4cfb-906e-58325aafd818 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:21.273507 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-fa90555f-8e4b-4cfb-906e-58325aafd818 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:21.284774 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-fa90555f-8e4b-4cfb-906e-58325aafd818 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:21.286134 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-fa90555f-8e4b-4cfb-906e-58325aafd818 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:21.287581 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-fa90555f-8e4b-4cfb-906e-58325aafd818 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1737 microversion: 2.20 time: 0.606482 Oct 17 14:06:21.288167 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2668/5467] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:06:20 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1737 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:06:22.316641 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1c029ae2-39d5-4e31-8d55-2e730333d394 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:22.318117 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-1c029ae2-39d5-4e31-8d55-2e730333d394 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:22.333810 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1c029ae2-39d5-4e31-8d55-2e730333d394 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:22.334616 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1c029ae2-39d5-4e31-8d55-2e730333d394 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:22.336732 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1c029ae2-39d5-4e31-8d55-2e730333d394 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:22.338616 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1c029ae2-39d5-4e31-8d55-2e730333d394 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:22.339281 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1c029ae2-39d5-4e31-8d55-2e730333d394 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:22.340878 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1c029ae2-39d5-4e31-8d55-2e730333d394 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:22.853648 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-1c029ae2-39d5-4e31-8d55-2e730333d394 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:22.895424 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-1c029ae2-39d5-4e31-8d55-2e730333d394 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:22.900209 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-1c029ae2-39d5-4e31-8d55-2e730333d394 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:22.903487 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1c029ae2-39d5-4e31-8d55-2e730333d394 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1737 microversion: 2.20 time: 0.592188 Oct 17 14:06:22.908895 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2800/5468] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:06:22 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1737 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:06:23.884695 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-7476e72b-1f52-4feb-a9f1-545aa4b3552e req-9f00dc92-40cd-41cc-bcea-0894c8a5f85f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b06b769b-4e30-480d-9a2f-e5f9b9fdeab2", "tag": "05824010-0f55-4a59-9f98-90518d4247c6"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:06:23.913683 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-7476e72b-1f52-4feb-a9f1-545aa4b3552e req-9f00dc92-40cd-41cc-bcea-0894c8a5f85f service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:23.924171 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-7476e72b-1f52-4feb-a9f1-545aa4b3552e req-9f00dc92-40cd-41cc-bcea-0894c8a5f85f service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:23.926696 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-7476e72b-1f52-4feb-a9f1-545aa4b3552e req-9f00dc92-40cd-41cc-bcea-0894c8a5f85f service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:23.939947 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-40f3a8f0-f997-4f3f-8991-89f491bfeade tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:23.941329 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-40f3a8f0-f997-4f3f-8991-89f491bfeade tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:23.968724 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-40f3a8f0-f997-4f3f-8991-89f491bfeade tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:23.969139 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-40f3a8f0-f997-4f3f-8991-89f491bfeade tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:23.969592 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-40f3a8f0-f997-4f3f-8991-89f491bfeade tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:23.986441 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-40f3a8f0-f997-4f3f-8991-89f491bfeade tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:23.987136 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-40f3a8f0-f997-4f3f-8991-89f491bfeade tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:23.987614 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-40f3a8f0-f997-4f3f-8991-89f491bfeade tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:23.997287 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-7476e72b-1f52-4feb-a9f1-545aa4b3552e req-9f00dc92-40cd-41cc-bcea-0894c8a5f85f service nova] Creating event network-changed:05824010-0f55-4a59-9f98-90518d4247c6 for instance b06b769b-4e30-480d-9a2f-e5f9b9fdeab2 on n-h1-854247-14 Oct 17 14:06:24.011326 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-7476e72b-1f52-4feb-a9f1-545aa4b3552e req-9f00dc92-40cd-41cc-bcea-0894c8a5f85f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134219 Oct 17 14:06:24.012615 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2669/5469] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:06:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:06:24.967011 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-40f3a8f0-f997-4f3f-8991-89f491bfeade tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:24.978491 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-40f3a8f0-f997-4f3f-8991-89f491bfeade tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:24.999593 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-40f3a8f0-f997-4f3f-8991-89f491bfeade tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:25.001071 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-40f3a8f0-f997-4f3f-8991-89f491bfeade tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1737 microversion: 2.20 time: 1.065261 Oct 17 14:06:25.026858 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2801/5470] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:06:23 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1737 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 14:06:26.037304 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-97ffd2a8-289e-4b6b-8ee2-410842a7b3a8 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:26.038951 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-97ffd2a8-289e-4b6b-8ee2-410842a7b3a8 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:26.058742 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-97ffd2a8-289e-4b6b-8ee2-410842a7b3a8 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:26.073897 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-97ffd2a8-289e-4b6b-8ee2-410842a7b3a8 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:26.079249 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-97ffd2a8-289e-4b6b-8ee2-410842a7b3a8 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:26.104742 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-97ffd2a8-289e-4b6b-8ee2-410842a7b3a8 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:26.104742 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-97ffd2a8-289e-4b6b-8ee2-410842a7b3a8 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:26.104742 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-97ffd2a8-289e-4b6b-8ee2-410842a7b3a8 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:26.456176 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-97ffd2a8-289e-4b6b-8ee2-410842a7b3a8 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:26.474703 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-97ffd2a8-289e-4b6b-8ee2-410842a7b3a8 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:26.476955 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-97ffd2a8-289e-4b6b-8ee2-410842a7b3a8 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:26.479128 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-97ffd2a8-289e-4b6b-8ee2-410842a7b3a8 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1737 microversion: 2.20 time: 0.449372 Oct 17 14:06:26.481906 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2670/5471] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:06:26 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1737 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:06:27.512084 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9c64d767-5968-4660-b8fd-681c374a74b2 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:27.513842 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9c64d767-5968-4660-b8fd-681c374a74b2 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:27.531377 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c64d767-5968-4660-b8fd-681c374a74b2 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:27.531817 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c64d767-5968-4660-b8fd-681c374a74b2 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:27.532261 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c64d767-5968-4660-b8fd-681c374a74b2 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:27.561284 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c64d767-5968-4660-b8fd-681c374a74b2 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:27.562054 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c64d767-5968-4660-b8fd-681c374a74b2 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:27.564172 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c64d767-5968-4660-b8fd-681c374a74b2 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:28.042264 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9c64d767-5968-4660-b8fd-681c374a74b2 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:28.057851 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9c64d767-5968-4660-b8fd-681c374a74b2 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:28.059325 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9c64d767-5968-4660-b8fd-681c374a74b2 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:28.060554 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9c64d767-5968-4660-b8fd-681c374a74b2 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1737 microversion: 2.20 time: 0.552448 Oct 17 14:06:28.065547 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2802/5472] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:06:27 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1737 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:06:29.098220 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-02ec774b-8c8d-48ec-9f8b-4b075d417df9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:29.106995 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-02ec774b-8c8d-48ec-9f8b-4b075d417df9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:29.129523 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-02ec774b-8c8d-48ec-9f8b-4b075d417df9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:29.130289 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-02ec774b-8c8d-48ec-9f8b-4b075d417df9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:29.130921 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-02ec774b-8c8d-48ec-9f8b-4b075d417df9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:29.131851 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-02ec774b-8c8d-48ec-9f8b-4b075d417df9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:29.132463 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-02ec774b-8c8d-48ec-9f8b-4b075d417df9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:29.133053 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-02ec774b-8c8d-48ec-9f8b-4b075d417df9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:29.415209 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-02ec774b-8c8d-48ec-9f8b-4b075d417df9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:29.433556 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-02ec774b-8c8d-48ec-9f8b-4b075d417df9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:29.434946 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-02ec774b-8c8d-48ec-9f8b-4b075d417df9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:29.443074 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-02ec774b-8c8d-48ec-9f8b-4b075d417df9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1737 microversion: 2.20 time: 0.349787 Oct 17 14:06:29.443830 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2671/5473] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:06:29 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1737 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:06:30.474192 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0e85329c-04dd-4dd2-a876-b44af2916f62 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:30.475764 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0e85329c-04dd-4dd2-a876-b44af2916f62 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:30.485288 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:06:30.490587 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0e85329c-04dd-4dd2-a876-b44af2916f62 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:30.500089 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0e85329c-04dd-4dd2-a876-b44af2916f62 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:30.503400 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0e85329c-04dd-4dd2-a876-b44af2916f62 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:30.504417 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0e85329c-04dd-4dd2-a876-b44af2916f62 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:30.505085 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0e85329c-04dd-4dd2-a876-b44af2916f62 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:30.505734 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0e85329c-04dd-4dd2-a876-b44af2916f62 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:30.842325 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0e85329c-04dd-4dd2-a876-b44af2916f62 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:30.860112 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0e85329c-04dd-4dd2-a876-b44af2916f62 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:30.864722 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0e85329c-04dd-4dd2-a876-b44af2916f62 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:30.869564 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0e85329c-04dd-4dd2-a876-b44af2916f62 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1737 microversion: 2.20 time: 0.398671 Oct 17 14:06:30.873548 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2803/5474] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:06:30 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1737 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:06:31.898548 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-608a925c-1369-47aa-af70-3697c28c55b3 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:31.899909 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-608a925c-1369-47aa-af70-3697c28c55b3 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:31.912992 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-608a925c-1369-47aa-af70-3697c28c55b3 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:31.920415 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-608a925c-1369-47aa-af70-3697c28c55b3 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:31.921381 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-608a925c-1369-47aa-af70-3697c28c55b3 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:31.922856 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-608a925c-1369-47aa-af70-3697c28c55b3 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:31.923665 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-608a925c-1369-47aa-af70-3697c28c55b3 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:31.924653 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-608a925c-1369-47aa-af70-3697c28c55b3 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:32.389667 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-608a925c-1369-47aa-af70-3697c28c55b3 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:32.409644 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-608a925c-1369-47aa-af70-3697c28c55b3 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:32.414199 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-608a925c-1369-47aa-af70-3697c28c55b3 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:32.421433 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-608a925c-1369-47aa-af70-3697c28c55b3 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1737 microversion: 2.20 time: 0.527829 Oct 17 14:06:32.423737 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2672/5475] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:06:31 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1737 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:06:33.457726 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-42e26395-5fb2-43d4-be7e-6082aefaaffa tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:33.459063 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-42e26395-5fb2-43d4-be7e-6082aefaaffa tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:33.472502 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-42e26395-5fb2-43d4-be7e-6082aefaaffa tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:33.473785 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-42e26395-5fb2-43d4-be7e-6082aefaaffa tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:33.476331 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-42e26395-5fb2-43d4-be7e-6082aefaaffa tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:33.477534 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-42e26395-5fb2-43d4-be7e-6082aefaaffa tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:33.478398 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-42e26395-5fb2-43d4-be7e-6082aefaaffa tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:33.482163 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-42e26395-5fb2-43d4-be7e-6082aefaaffa tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:33.836596 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-42e26395-5fb2-43d4-be7e-6082aefaaffa tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:33.838907 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=96 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:06:33.851703 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-42e26395-5fb2-43d4-be7e-6082aefaaffa tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:33.854243 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-42e26395-5fb2-43d4-be7e-6082aefaaffa tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:33.860175 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-42e26395-5fb2-43d4-be7e-6082aefaaffa tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1719 microversion: 2.20 time: 0.402856 Oct 17 14:06:33.865853 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2804/5476] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:06:33 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1719 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:06:34.903007 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-76c20c1e-2382-4fa2-b3ef-c454c069596f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:34.907038 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-76c20c1e-2382-4fa2-b3ef-c454c069596f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:34.926269 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-76c20c1e-2382-4fa2-b3ef-c454c069596f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:34.927151 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-76c20c1e-2382-4fa2-b3ef-c454c069596f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:34.927971 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-76c20c1e-2382-4fa2-b3ef-c454c069596f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:34.931129 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-76c20c1e-2382-4fa2-b3ef-c454c069596f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:34.931645 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-76c20c1e-2382-4fa2-b3ef-c454c069596f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:34.932089 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-76c20c1e-2382-4fa2-b3ef-c454c069596f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:35.154044 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-76c20c1e-2382-4fa2-b3ef-c454c069596f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:35.168894 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-76c20c1e-2382-4fa2-b3ef-c454c069596f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:35.172040 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-76c20c1e-2382-4fa2-b3ef-c454c069596f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:35.176642 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-76c20c1e-2382-4fa2-b3ef-c454c069596f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1719 microversion: 2.20 time: 0.284248 Oct 17 14:06:35.181168 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2673/5477] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:06:34 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1719 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:06:36.218193 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a9d49e24-db5d-4f25-bd09-a30e568d5485 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:36.218193 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a9d49e24-db5d-4f25-bd09-a30e568d5485 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:36.225323 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a9d49e24-db5d-4f25-bd09-a30e568d5485 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:36.226154 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a9d49e24-db5d-4f25-bd09-a30e568d5485 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:36.226932 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a9d49e24-db5d-4f25-bd09-a30e568d5485 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:36.227698 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a9d49e24-db5d-4f25-bd09-a30e568d5485 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:36.228393 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a9d49e24-db5d-4f25-bd09-a30e568d5485 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:36.228831 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a9d49e24-db5d-4f25-bd09-a30e568d5485 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:36.419903 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a9d49e24-db5d-4f25-bd09-a30e568d5485 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:36.434772 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a9d49e24-db5d-4f25-bd09-a30e568d5485 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:36.438376 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a9d49e24-db5d-4f25-bd09-a30e568d5485 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:36.440219 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a9d49e24-db5d-4f25-bd09-a30e568d5485 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1662 microversion: 2.20 time: 0.231862 Oct 17 14:06:36.440897 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2805/5478] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:06:36 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1662 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 14:06:36.465395 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9eb13c13-8f92-42a3-80d1-a3c4d5de1ee4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c1a223fe-90e4-4452-9bdb-c635a8d2ae1b"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:06:36.474800 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9eb13c13-8f92-42a3-80d1-a3c4d5de1ee4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:36.482175 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9eb13c13-8f92-42a3-80d1-a3c4d5de1ee4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:36.482920 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9eb13c13-8f92-42a3-80d1-a3c4d5de1ee4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:36.483519 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9eb13c13-8f92-42a3-80d1-a3c4d5de1ee4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:36.484201 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9eb13c13-8f92-42a3-80d1-a3c4d5de1ee4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:36.484664 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9eb13c13-8f92-42a3-80d1-a3c4d5de1ee4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:36.485088 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9eb13c13-8f92-42a3-80d1-a3c4d5de1ee4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:36.920042 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9eb13c13-8f92-42a3-80d1-a3c4d5de1ee4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "POST /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.456549 Oct 17 14:06:36.920042 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2674/5479] 10.222.0.79 () {62 vars in 1364 bytes} [Mon Oct 17 14:06:36 2022] POST /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed/os-volume_attachments => generated 188 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:06:37.093651 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-8ac05b6e-f610-4442-80ed-2e654e44af08 req-bbef16aa-5da9-4361-a9bd-44affeb21acf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32c279ba-2f76-4986-be6d-1029602677ed", "name": "network-vif-unplugged", "status": "completed", "tag": "b00489ac-2c3b-4d9e-843a-d9962aa3d085"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:06:37.116136 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-8ac05b6e-f610-4442-80ed-2e654e44af08 req-bbef16aa-5da9-4361-a9bd-44affeb21acf service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:37.116692 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ec3cfd7f-1e24-471f-8493-a216231a73ac tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:37.117435 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ec3cfd7f-1e24-471f-8493-a216231a73ac tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:37.125011 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-8ac05b6e-f610-4442-80ed-2e654e44af08 req-bbef16aa-5da9-4361-a9bd-44affeb21acf service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:37.125726 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-8ac05b6e-f610-4442-80ed-2e654e44af08 req-bbef16aa-5da9-4361-a9bd-44affeb21acf service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:37.127752 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ec3cfd7f-1e24-471f-8493-a216231a73ac tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:37.129639 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ec3cfd7f-1e24-471f-8493-a216231a73ac tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:37.130368 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ec3cfd7f-1e24-471f-8493-a216231a73ac tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:37.131287 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ec3cfd7f-1e24-471f-8493-a216231a73ac tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:37.131898 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ec3cfd7f-1e24-471f-8493-a216231a73ac tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:37.132482 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ec3cfd7f-1e24-471f-8493-a216231a73ac tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:37.154998 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.compute.server_external_events [req-8ac05b6e-f610-4442-80ed-2e654e44af08 req-bbef16aa-5da9-4361-a9bd-44affeb21acf service nova] Unable to find a host for instance 32c279ba-2f76-4986-be6d-1029602677ed. Dropping event network-vif-unplugged {{(pid=127016) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 17 14:06:37.156616 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-8ac05b6e-f610-4442-80ed-2e654e44af08 req-bbef16aa-5da9-4361-a9bd-44affeb21acf service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.067914 Oct 17 14:06:37.159807 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2806/5480] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 72 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 17 14:06:37.453585 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ec3cfd7f-1e24-471f-8493-a216231a73ac tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "DELETE /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed/os-volume_attachments/c1a223fe-90e4-4452-9bdb-c635a8d2ae1b" status: 202 len: 0 microversion: 2.20 time: 0.343284 Oct 17 14:06:37.458268 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2675/5481] 10.222.0.79 () {60 vars in 1457 bytes} [Mon Oct 17 14:06:37 2022] DELETE /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed/os-volume_attachments/c1a223fe-90e4-4452-9bdb-c635a8d2ae1b => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 17 14:06:37.533835 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cd6fd310-9d7c-44de-9408-3359ddcf3d8d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:06:37.534440 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cd6fd310-9d7c-44de-9408-3359ddcf3d8d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:37.548922 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cd6fd310-9d7c-44de-9408-3359ddcf3d8d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:37.549701 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cd6fd310-9d7c-44de-9408-3359ddcf3d8d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:37.550324 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cd6fd310-9d7c-44de-9408-3359ddcf3d8d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:37.551303 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cd6fd310-9d7c-44de-9408-3359ddcf3d8d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:37.552058 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cd6fd310-9d7c-44de-9408-3359ddcf3d8d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:37.552966 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cd6fd310-9d7c-44de-9408-3359ddcf3d8d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:37.608893 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cd6fd310-9d7c-44de-9408-3359ddcf3d8d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127016) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 17 14:06:37.729120 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cd6fd310-9d7c-44de-9408-3359ddcf3d8d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "POST /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed/action" status: 202 len: 0 microversion: 2.20 time: 0.201030 Oct 17 14:06:37.740020 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6ccb9b40-7a56-45da-ba10-84a77a18d6f9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:37.740688 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6ccb9b40-7a56-45da-ba10-84a77a18d6f9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:37.745126 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2807/5482] 10.222.0.79 () {62 vars in 1319 bytes} [Mon Oct 17 14:06:37 2022] POST /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:06:37.750084 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6ccb9b40-7a56-45da-ba10-84a77a18d6f9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:37.750795 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6ccb9b40-7a56-45da-ba10-84a77a18d6f9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:37.751491 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6ccb9b40-7a56-45da-ba10-84a77a18d6f9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:37.752568 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6ccb9b40-7a56-45da-ba10-84a77a18d6f9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:37.754221 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6ccb9b40-7a56-45da-ba10-84a77a18d6f9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:37.755071 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6ccb9b40-7a56-45da-ba10-84a77a18d6f9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:37.928547 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6ccb9b40-7a56-45da-ba10-84a77a18d6f9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:37.940229 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6ccb9b40-7a56-45da-ba10-84a77a18d6f9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:37.941586 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6ccb9b40-7a56-45da-ba10-84a77a18d6f9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:37.942734 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6ccb9b40-7a56-45da-ba10-84a77a18d6f9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1670 microversion: 2.20 time: 0.207746 Oct 17 14:06:37.985343 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2676/5483] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:06:37 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1670 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:06:38.998763 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-385cd64e-05e7-446e-b3f4-495a58304b7d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:39.000070 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-385cd64e-05e7-446e-b3f4-495a58304b7d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:39.011871 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-385cd64e-05e7-446e-b3f4-495a58304b7d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:39.012867 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-385cd64e-05e7-446e-b3f4-495a58304b7d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:39.016264 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-385cd64e-05e7-446e-b3f4-495a58304b7d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:39.019839 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-385cd64e-05e7-446e-b3f4-495a58304b7d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:39.020704 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-385cd64e-05e7-446e-b3f4-495a58304b7d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:39.021306 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-385cd64e-05e7-446e-b3f4-495a58304b7d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:39.212151 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-385cd64e-05e7-446e-b3f4-495a58304b7d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:39.222528 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-385cd64e-05e7-446e-b3f4-495a58304b7d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:39.224128 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-385cd64e-05e7-446e-b3f4-495a58304b7d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:39.225364 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-385cd64e-05e7-446e-b3f4-495a58304b7d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1670 microversion: 2.20 time: 0.232227 Oct 17 14:06:39.227246 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2808/5484] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:06:38 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1670 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:06:40.254630 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-da709063-48d7-4c47-9bd8-24de1f813c89 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:40.255069 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-da709063-48d7-4c47-9bd8-24de1f813c89 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:40.267841 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-da709063-48d7-4c47-9bd8-24de1f813c89 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:40.268566 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-da709063-48d7-4c47-9bd8-24de1f813c89 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:40.276727 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-da709063-48d7-4c47-9bd8-24de1f813c89 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:40.280736 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-da709063-48d7-4c47-9bd8-24de1f813c89 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:40.281469 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-da709063-48d7-4c47-9bd8-24de1f813c89 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:40.282511 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-da709063-48d7-4c47-9bd8-24de1f813c89 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:40.729173 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-da709063-48d7-4c47-9bd8-24de1f813c89 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:40.739319 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-da709063-48d7-4c47-9bd8-24de1f813c89 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:40.740762 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-da709063-48d7-4c47-9bd8-24de1f813c89 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:40.742184 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-da709063-48d7-4c47-9bd8-24de1f813c89 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1728 microversion: 2.20 time: 0.494110 Oct 17 14:06:40.742763 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2677/5485] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:06:40 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1728 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:06:41.773434 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2f1a1a5a-5446-4565-9786-c8e03182922b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:41.774163 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2f1a1a5a-5446-4565-9786-c8e03182922b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:41.786002 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2f1a1a5a-5446-4565-9786-c8e03182922b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:41.786504 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2f1a1a5a-5446-4565-9786-c8e03182922b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:41.788419 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2f1a1a5a-5446-4565-9786-c8e03182922b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:41.789174 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2f1a1a5a-5446-4565-9786-c8e03182922b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:41.789638 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2f1a1a5a-5446-4565-9786-c8e03182922b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:41.790072 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2f1a1a5a-5446-4565-9786-c8e03182922b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:42.080060 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2f1a1a5a-5446-4565-9786-c8e03182922b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:42.101882 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2f1a1a5a-5446-4565-9786-c8e03182922b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:42.103362 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2f1a1a5a-5446-4565-9786-c8e03182922b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:42.115269 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2f1a1a5a-5446-4565-9786-c8e03182922b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1728 microversion: 2.20 time: 0.346560 Oct 17 14:06:42.127192 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2809/5486] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:06:41 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1728 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:06:43.147218 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-524ece55-81f3-483f-b05a-2d766b0d87a5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:43.147840 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-524ece55-81f3-483f-b05a-2d766b0d87a5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:43.174638 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-524ece55-81f3-483f-b05a-2d766b0d87a5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:43.175268 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-524ece55-81f3-483f-b05a-2d766b0d87a5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:43.175661 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-524ece55-81f3-483f-b05a-2d766b0d87a5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:43.176410 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-524ece55-81f3-483f-b05a-2d766b0d87a5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:43.181254 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-524ece55-81f3-483f-b05a-2d766b0d87a5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:43.181731 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-524ece55-81f3-483f-b05a-2d766b0d87a5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:43.873452 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-524ece55-81f3-483f-b05a-2d766b0d87a5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:43.897267 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-524ece55-81f3-483f-b05a-2d766b0d87a5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:43.902712 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-524ece55-81f3-483f-b05a-2d766b0d87a5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:43.904430 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-524ece55-81f3-483f-b05a-2d766b0d87a5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1728 microversion: 2.20 time: 0.764753 Oct 17 14:06:43.906966 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2678/5487] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:06:43 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1728 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:06:44.935651 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e85e77c7-c925-4758-b5af-4c73e86b2bb7 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:44.936419 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e85e77c7-c925-4758-b5af-4c73e86b2bb7 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:44.956349 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e85e77c7-c925-4758-b5af-4c73e86b2bb7 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:44.956871 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e85e77c7-c925-4758-b5af-4c73e86b2bb7 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:44.957316 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e85e77c7-c925-4758-b5af-4c73e86b2bb7 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:44.958059 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e85e77c7-c925-4758-b5af-4c73e86b2bb7 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:44.958516 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e85e77c7-c925-4758-b5af-4c73e86b2bb7 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:44.958942 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e85e77c7-c925-4758-b5af-4c73e86b2bb7 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:45.318618 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e85e77c7-c925-4758-b5af-4c73e86b2bb7 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:45.332531 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e85e77c7-c925-4758-b5af-4c73e86b2bb7 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:45.336985 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e85e77c7-c925-4758-b5af-4c73e86b2bb7 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:45.338225 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e85e77c7-c925-4758-b5af-4c73e86b2bb7 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1728 microversion: 2.20 time: 0.407462 Oct 17 14:06:45.344367 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2810/5488] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:06:44 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1728 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:06:46.372374 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a3c6f5a4-da5a-4ded-a25e-9fb9a8a7f7b4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:46.373861 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a3c6f5a4-da5a-4ded-a25e-9fb9a8a7f7b4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:46.386896 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a3c6f5a4-da5a-4ded-a25e-9fb9a8a7f7b4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:46.398837 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a3c6f5a4-da5a-4ded-a25e-9fb9a8a7f7b4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:46.401115 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a3c6f5a4-da5a-4ded-a25e-9fb9a8a7f7b4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:46.403647 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a3c6f5a4-da5a-4ded-a25e-9fb9a8a7f7b4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:46.404338 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a3c6f5a4-da5a-4ded-a25e-9fb9a8a7f7b4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:46.406778 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a3c6f5a4-da5a-4ded-a25e-9fb9a8a7f7b4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:46.821550 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a3c6f5a4-da5a-4ded-a25e-9fb9a8a7f7b4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:46.825290 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:06:46.836947 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a3c6f5a4-da5a-4ded-a25e-9fb9a8a7f7b4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:46.839357 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a3c6f5a4-da5a-4ded-a25e-9fb9a8a7f7b4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:46.850702 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a3c6f5a4-da5a-4ded-a25e-9fb9a8a7f7b4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1728 microversion: 2.20 time: 0.474989 Oct 17 14:06:46.859096 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2679/5489] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:06:46 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1728 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:06:47.879812 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a3f268bb-810d-420a-a76c-61d16b1fc46c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:47.881045 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a3f268bb-810d-420a-a76c-61d16b1fc46c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:47.907118 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a3f268bb-810d-420a-a76c-61d16b1fc46c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:47.908670 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a3f268bb-810d-420a-a76c-61d16b1fc46c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:47.923210 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a3f268bb-810d-420a-a76c-61d16b1fc46c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:47.925848 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a3f268bb-810d-420a-a76c-61d16b1fc46c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:47.926772 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a3f268bb-810d-420a-a76c-61d16b1fc46c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:47.929708 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a3f268bb-810d-420a-a76c-61d16b1fc46c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:48.280101 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a3f268bb-810d-420a-a76c-61d16b1fc46c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:48.297107 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a3f268bb-810d-420a-a76c-61d16b1fc46c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:48.299603 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a3f268bb-810d-420a-a76c-61d16b1fc46c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:48.303365 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a3f268bb-810d-420a-a76c-61d16b1fc46c tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1728 microversion: 2.20 time: 0.427609 Oct 17 14:06:48.307084 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2811/5490] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:06:47 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1728 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:06:49.338069 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ab7de8b3-819e-4aa6-a619-689fb97f7949 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:49.339875 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ab7de8b3-819e-4aa6-a619-689fb97f7949 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:49.370036 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ab7de8b3-819e-4aa6-a619-689fb97f7949 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:49.370036 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ab7de8b3-819e-4aa6-a619-689fb97f7949 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:49.376018 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ab7de8b3-819e-4aa6-a619-689fb97f7949 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:49.379224 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ab7de8b3-819e-4aa6-a619-689fb97f7949 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:49.380793 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ab7de8b3-819e-4aa6-a619-689fb97f7949 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:49.383557 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ab7de8b3-819e-4aa6-a619-689fb97f7949 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:49.823709 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ab7de8b3-819e-4aa6-a619-689fb97f7949 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:49.850820 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ab7de8b3-819e-4aa6-a619-689fb97f7949 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:49.854117 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ab7de8b3-819e-4aa6-a619-689fb97f7949 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:49.857662 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ab7de8b3-819e-4aa6-a619-689fb97f7949 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1728 microversion: 2.20 time: 0.527403 Oct 17 14:06:49.861363 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2680/5491] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:06:49 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1728 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:06:50.891905 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d41b5eb7-d7b4-4204-8797-78d18b4b52bf tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:50.893201 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d41b5eb7-d7b4-4204-8797-78d18b4b52bf tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:50.927952 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d41b5eb7-d7b4-4204-8797-78d18b4b52bf tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:50.928771 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d41b5eb7-d7b4-4204-8797-78d18b4b52bf tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:50.932589 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d41b5eb7-d7b4-4204-8797-78d18b4b52bf tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:50.933558 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d41b5eb7-d7b4-4204-8797-78d18b4b52bf tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:50.936347 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d41b5eb7-d7b4-4204-8797-78d18b4b52bf tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:50.939752 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d41b5eb7-d7b4-4204-8797-78d18b4b52bf tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:51.557728 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d41b5eb7-d7b4-4204-8797-78d18b4b52bf tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:51.585377 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d41b5eb7-d7b4-4204-8797-78d18b4b52bf tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:51.623857 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d41b5eb7-d7b4-4204-8797-78d18b4b52bf tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:51.637691 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d41b5eb7-d7b4-4204-8797-78d18b4b52bf tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1728 microversion: 2.20 time: 0.750749 Oct 17 14:06:51.649155 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2812/5492] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:06:50 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1728 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:06:52.689458 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9163efbe-a73b-42d6-b0bb-0e771f725e62 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:52.690547 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9163efbe-a73b-42d6-b0bb-0e771f725e62 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:52.697281 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=26 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:06:52.711969 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9163efbe-a73b-42d6-b0bb-0e771f725e62 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:52.712891 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9163efbe-a73b-42d6-b0bb-0e771f725e62 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:52.714253 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9163efbe-a73b-42d6-b0bb-0e771f725e62 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:52.719369 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9163efbe-a73b-42d6-b0bb-0e771f725e62 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:52.722122 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9163efbe-a73b-42d6-b0bb-0e771f725e62 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:52.730345 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9163efbe-a73b-42d6-b0bb-0e771f725e62 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:53.271127 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9163efbe-a73b-42d6-b0bb-0e771f725e62 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:53.286907 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9163efbe-a73b-42d6-b0bb-0e771f725e62 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:53.288756 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9163efbe-a73b-42d6-b0bb-0e771f725e62 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:53.290528 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9163efbe-a73b-42d6-b0bb-0e771f725e62 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1728 microversion: 2.20 time: 0.607901 Oct 17 14:06:53.291705 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2681/5493] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:06:52 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1728 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 14:06:54.246276 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b850ac6f-1451-4a37-b674-dcc5a2601bdf tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:54.247687 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b850ac6f-1451-4a37-b674-dcc5a2601bdf tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] [instance: b06b769b-4e30-480d-9a2f-e5f9b9fdeab2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:54.262224 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b850ac6f-1451-4a37-b674-dcc5a2601bdf tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:54.264807 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b850ac6f-1451-4a37-b674-dcc5a2601bdf tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:54.265271 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b850ac6f-1451-4a37-b674-dcc5a2601bdf tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:54.267527 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b850ac6f-1451-4a37-b674-dcc5a2601bdf tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:54.268376 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b850ac6f-1451-4a37-b674-dcc5a2601bdf tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:54.268922 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b850ac6f-1451-4a37-b674-dcc5a2601bdf tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:54.322608 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-755ae679-f082-4306-9570-7804838fd554 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:54.323890 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-755ae679-f082-4306-9570-7804838fd554 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:54.338920 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b850ac6f-1451-4a37-b674-dcc5a2601bdf tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] 10.222.0.79 "GET /compute/v2.1/servers/b06b769b-4e30-480d-9a2f-e5f9b9fdeab2/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.094079 Oct 17 14:06:54.340122 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2813/5494] 10.222.0.79 () {58 vars in 1293 bytes} [Mon Oct 17 14:06:54 2022] GET /compute/v2.1/servers/b06b769b-4e30-480d-9a2f-e5f9b9fdeab2/os-server-password => generated 116 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:06:54.343959 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-755ae679-f082-4306-9570-7804838fd554 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:54.346971 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-755ae679-f082-4306-9570-7804838fd554 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:54.347571 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-755ae679-f082-4306-9570-7804838fd554 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:54.348361 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-755ae679-f082-4306-9570-7804838fd554 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:54.348882 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-755ae679-f082-4306-9570-7804838fd554 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:54.349235 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-755ae679-f082-4306-9570-7804838fd554 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:54.673663 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-755ae679-f082-4306-9570-7804838fd554 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:54.691095 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-755ae679-f082-4306-9570-7804838fd554 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:54.692795 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-755ae679-f082-4306-9570-7804838fd554 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:54.694431 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-755ae679-f082-4306-9570-7804838fd554 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1728 microversion: 2.20 time: 0.378939 Oct 17 14:06:54.698318 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2682/5495] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:06:54 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1728 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:06:55.735526 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1d0cc21b-387e-4e38-aadc-b332c3e4d3d5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:55.736764 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-1d0cc21b-387e-4e38-aadc-b332c3e4d3d5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:55.750237 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1d0cc21b-387e-4e38-aadc-b332c3e4d3d5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:55.752043 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1d0cc21b-387e-4e38-aadc-b332c3e4d3d5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:55.752495 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1d0cc21b-387e-4e38-aadc-b332c3e4d3d5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:55.753254 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1d0cc21b-387e-4e38-aadc-b332c3e4d3d5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:55.753705 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1d0cc21b-387e-4e38-aadc-b332c3e4d3d5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:55.754124 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1d0cc21b-387e-4e38-aadc-b332c3e4d3d5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:55.989451 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-1d0cc21b-387e-4e38-aadc-b332c3e4d3d5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:55.999415 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-1d0cc21b-387e-4e38-aadc-b332c3e4d3d5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:56.000786 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-1d0cc21b-387e-4e38-aadc-b332c3e4d3d5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:56.002313 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1d0cc21b-387e-4e38-aadc-b332c3e4d3d5 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1728 microversion: 2.20 time: 0.271663 Oct 17 14:06:56.003233 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2814/5496] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:06:55 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1728 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:06:57.032883 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-eeae6ee4-298d-43c1-9955-1d1eaa53d2bb tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:57.035002 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-eeae6ee4-298d-43c1-9955-1d1eaa53d2bb tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:57.049995 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eeae6ee4-298d-43c1-9955-1d1eaa53d2bb tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:57.050824 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eeae6ee4-298d-43c1-9955-1d1eaa53d2bb tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:57.051469 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eeae6ee4-298d-43c1-9955-1d1eaa53d2bb tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:57.053847 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eeae6ee4-298d-43c1-9955-1d1eaa53d2bb tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:57.054785 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eeae6ee4-298d-43c1-9955-1d1eaa53d2bb tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:57.055813 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eeae6ee4-298d-43c1-9955-1d1eaa53d2bb tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:57.476710 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-eeae6ee4-298d-43c1-9955-1d1eaa53d2bb tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:57.493958 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-eeae6ee4-298d-43c1-9955-1d1eaa53d2bb tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:57.500419 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-eeae6ee4-298d-43c1-9955-1d1eaa53d2bb tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:57.502166 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-eeae6ee4-298d-43c1-9955-1d1eaa53d2bb tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1728 microversion: 2.20 time: 0.476792 Oct 17 14:06:57.508401 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2683/5497] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:06:57 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1728 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:06:58.530585 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6824d5ee-9297-4521-9bf9-e055450001db tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:58.531903 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6824d5ee-9297-4521-9bf9-e055450001db tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:58.541704 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6824d5ee-9297-4521-9bf9-e055450001db tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:58.543766 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6824d5ee-9297-4521-9bf9-e055450001db tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:58.545510 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6824d5ee-9297-4521-9bf9-e055450001db tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:58.546442 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6824d5ee-9297-4521-9bf9-e055450001db tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:58.549256 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6824d5ee-9297-4521-9bf9-e055450001db tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:58.550031 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6824d5ee-9297-4521-9bf9-e055450001db tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:58.733670 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6824d5ee-9297-4521-9bf9-e055450001db tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:58.743082 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6824d5ee-9297-4521-9bf9-e055450001db tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:58.744828 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6824d5ee-9297-4521-9bf9-e055450001db tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:58.746355 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6824d5ee-9297-4521-9bf9-e055450001db tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1728 microversion: 2.20 time: 0.220564 Oct 17 14:06:58.747112 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2815/5498] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:06:58 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1728 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 14:06:59.773661 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b17ad50a-62f1-44ee-b8b9-655fe65ff68a tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:59.774286 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b17ad50a-62f1-44ee-b8b9-655fe65ff68a tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:59.783638 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b17ad50a-62f1-44ee-b8b9-655fe65ff68a tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:59.783638 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b17ad50a-62f1-44ee-b8b9-655fe65ff68a tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:59.792723 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b17ad50a-62f1-44ee-b8b9-655fe65ff68a tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:59.792723 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b17ad50a-62f1-44ee-b8b9-655fe65ff68a tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:59.792723 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b17ad50a-62f1-44ee-b8b9-655fe65ff68a tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:59.792723 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b17ad50a-62f1-44ee-b8b9-655fe65ff68a tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:00.039103 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b17ad50a-62f1-44ee-b8b9-655fe65ff68a tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:00.050622 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b17ad50a-62f1-44ee-b8b9-655fe65ff68a tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:00.056328 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b17ad50a-62f1-44ee-b8b9-655fe65ff68a tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:00.058109 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b17ad50a-62f1-44ee-b8b9-655fe65ff68a tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1728 microversion: 2.20 time: 0.289049 Oct 17 14:07:00.067268 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2684/5499] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:06:59 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1728 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:07:01.092815 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-94397821-68af-4a44-b685-6501e28f01ff tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:01.094176 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-94397821-68af-4a44-b685-6501e28f01ff tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:01.110533 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:07:01.112860 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94397821-68af-4a44-b685-6501e28f01ff tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:01.113708 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94397821-68af-4a44-b685-6501e28f01ff tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:01.114315 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94397821-68af-4a44-b685-6501e28f01ff tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:01.115371 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94397821-68af-4a44-b685-6501e28f01ff tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:01.116039 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94397821-68af-4a44-b685-6501e28f01ff tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:01.116633 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94397821-68af-4a44-b685-6501e28f01ff tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:01.349927 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-a9cb4769-10d1-4bf7-8131-f8accaffc2d9 req-892b4348-e26a-4570-8da5-28f2df958411 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32c279ba-2f76-4986-be6d-1029602677ed", "name": "network-vif-plugged", "status": "completed", "tag": "b00489ac-2c3b-4d9e-843a-d9962aa3d085"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:07:01.374507 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-a9cb4769-10d1-4bf7-8131-f8accaffc2d9 req-892b4348-e26a-4570-8da5-28f2df958411 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:01.375486 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-a9cb4769-10d1-4bf7-8131-f8accaffc2d9 req-892b4348-e26a-4570-8da5-28f2df958411 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:01.376299 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-a9cb4769-10d1-4bf7-8131-f8accaffc2d9 req-892b4348-e26a-4570-8da5-28f2df958411 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:01.383344 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-94397821-68af-4a44-b685-6501e28f01ff tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:01.402379 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-94397821-68af-4a44-b685-6501e28f01ff tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:01.422445 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-94397821-68af-4a44-b685-6501e28f01ff tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:01.423232 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-94397821-68af-4a44-b685-6501e28f01ff tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1728 microversion: 2.20 time: 0.335004 Oct 17 14:07:01.439461 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2816/5500] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:07:01 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1728 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:07:01.439610 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-a9cb4769-10d1-4bf7-8131-f8accaffc2d9 req-892b4348-e26a-4570-8da5-28f2df958411 service nova] Creating event network-vif-plugged:b00489ac-2c3b-4d9e-843a-d9962aa3d085 for instance 32c279ba-2f76-4986-be6d-1029602677ed on n-h2-854247-14 Oct 17 14:07:01.443443 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-a9cb4769-10d1-4bf7-8131-f8accaffc2d9 req-892b4348-e26a-4570-8da5-28f2df958411 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100900 Oct 17 14:07:01.447080 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2685/5501] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:07:02.459631 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-bab28f30-a5dd-4566-bca1-7a8223c6fdf9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:02.461775 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-bab28f30-a5dd-4566-bca1-7a8223c6fdf9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:02.471551 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bab28f30-a5dd-4566-bca1-7a8223c6fdf9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:02.472300 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bab28f30-a5dd-4566-bca1-7a8223c6fdf9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:02.472996 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bab28f30-a5dd-4566-bca1-7a8223c6fdf9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:02.474641 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bab28f30-a5dd-4566-bca1-7a8223c6fdf9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:02.475299 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bab28f30-a5dd-4566-bca1-7a8223c6fdf9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:02.475920 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bab28f30-a5dd-4566-bca1-7a8223c6fdf9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:02.738864 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-bab28f30-a5dd-4566-bca1-7a8223c6fdf9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:02.757900 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-bab28f30-a5dd-4566-bca1-7a8223c6fdf9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:02.762275 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-bab28f30-a5dd-4566-bca1-7a8223c6fdf9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:02.765708 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-bab28f30-a5dd-4566-bca1-7a8223c6fdf9 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1728 microversion: 2.20 time: 0.314805 Oct 17 14:07:02.768137 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2817/5502] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:07:02 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1728 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:07:03.793847 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-93283b8a-1b19-43cb-9abf-36ff4e148206 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:03.795283 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-93283b8a-1b19-43cb-9abf-36ff4e148206 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:03.808784 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-93283b8a-1b19-43cb-9abf-36ff4e148206 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:03.810709 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-93283b8a-1b19-43cb-9abf-36ff4e148206 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:03.811610 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-93283b8a-1b19-43cb-9abf-36ff4e148206 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:03.814192 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-93283b8a-1b19-43cb-9abf-36ff4e148206 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:03.814654 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-93283b8a-1b19-43cb-9abf-36ff4e148206 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:03.816497 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-93283b8a-1b19-43cb-9abf-36ff4e148206 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:04.171777 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-93283b8a-1b19-43cb-9abf-36ff4e148206 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:04.185046 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-93283b8a-1b19-43cb-9abf-36ff4e148206 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:04.187587 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-93283b8a-1b19-43cb-9abf-36ff4e148206 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:04.189209 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-93283b8a-1b19-43cb-9abf-36ff4e148206 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1728 microversion: 2.20 time: 0.399864 Oct 17 14:07:04.199630 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2686/5503] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:07:03 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1728 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:07:05.220017 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-347466f0-f447-4035-89e7-c21455ec943b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:05.221644 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-347466f0-f447-4035-89e7-c21455ec943b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:05.230890 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-347466f0-f447-4035-89e7-c21455ec943b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:05.232382 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-347466f0-f447-4035-89e7-c21455ec943b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:05.232382 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-347466f0-f447-4035-89e7-c21455ec943b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:05.232567 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-347466f0-f447-4035-89e7-c21455ec943b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:05.233926 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-347466f0-f447-4035-89e7-c21455ec943b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:05.234867 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-347466f0-f447-4035-89e7-c21455ec943b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:05.397001 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-347466f0-f447-4035-89e7-c21455ec943b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:05.405754 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-347466f0-f447-4035-89e7-c21455ec943b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:05.407315 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-347466f0-f447-4035-89e7-c21455ec943b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:05.408398 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-347466f0-f447-4035-89e7-c21455ec943b tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1728 microversion: 2.20 time: 0.194618 Oct 17 14:07:05.411320 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2818/5504] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:07:05 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1728 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:07:06.438469 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-100fedac-07f5-4f4c-b782-390c0db7d872 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:06.439091 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-100fedac-07f5-4f4c-b782-390c0db7d872 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:06.454261 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-100fedac-07f5-4f4c-b782-390c0db7d872 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:06.454751 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-100fedac-07f5-4f4c-b782-390c0db7d872 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:06.455254 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-100fedac-07f5-4f4c-b782-390c0db7d872 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:06.455905 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-100fedac-07f5-4f4c-b782-390c0db7d872 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:06.458457 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-100fedac-07f5-4f4c-b782-390c0db7d872 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:06.458919 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-100fedac-07f5-4f4c-b782-390c0db7d872 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:06.631037 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-100fedac-07f5-4f4c-b782-390c0db7d872 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:06.643053 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-100fedac-07f5-4f4c-b782-390c0db7d872 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:06.644678 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-100fedac-07f5-4f4c-b782-390c0db7d872 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:06.645904 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-100fedac-07f5-4f4c-b782-390c0db7d872 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1728 microversion: 2.20 time: 0.211736 Oct 17 14:07:06.646469 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2687/5505] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:07:06 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1728 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:07:07.673602 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8fe834ba-5e51-4b98-8ce0-8e002f3eba1f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:07.674274 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8fe834ba-5e51-4b98-8ce0-8e002f3eba1f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:07.681768 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8fe834ba-5e51-4b98-8ce0-8e002f3eba1f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:07.682467 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8fe834ba-5e51-4b98-8ce0-8e002f3eba1f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:07.683098 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8fe834ba-5e51-4b98-8ce0-8e002f3eba1f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:07.684017 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8fe834ba-5e51-4b98-8ce0-8e002f3eba1f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:07.684653 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8fe834ba-5e51-4b98-8ce0-8e002f3eba1f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:07.685243 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8fe834ba-5e51-4b98-8ce0-8e002f3eba1f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:07.691108 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:07:07.877293 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8fe834ba-5e51-4b98-8ce0-8e002f3eba1f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:07.891435 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8fe834ba-5e51-4b98-8ce0-8e002f3eba1f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:07.896039 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8fe834ba-5e51-4b98-8ce0-8e002f3eba1f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:07.897696 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8fe834ba-5e51-4b98-8ce0-8e002f3eba1f tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1728 microversion: 2.20 time: 0.228180 Oct 17 14:07:07.912737 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2819/5506] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:07:07 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1728 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:07:08.928856 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b303e3df-845b-4bdc-9bd8-11f507505ca4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:08.929455 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b303e3df-845b-4bdc-9bd8-11f507505ca4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:08.940088 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b303e3df-845b-4bdc-9bd8-11f507505ca4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:08.941164 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b303e3df-845b-4bdc-9bd8-11f507505ca4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:08.941819 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b303e3df-845b-4bdc-9bd8-11f507505ca4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:08.942729 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b303e3df-845b-4bdc-9bd8-11f507505ca4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:08.943823 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b303e3df-845b-4bdc-9bd8-11f507505ca4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:08.944717 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b303e3df-845b-4bdc-9bd8-11f507505ca4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:09.152555 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b303e3df-845b-4bdc-9bd8-11f507505ca4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:09.161449 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b303e3df-845b-4bdc-9bd8-11f507505ca4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:09.163100 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b303e3df-845b-4bdc-9bd8-11f507505ca4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:09.164519 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b303e3df-845b-4bdc-9bd8-11f507505ca4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1728 microversion: 2.20 time: 0.240687 Oct 17 14:07:09.165719 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2688/5507] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:07:08 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1728 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:07:10.194378 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e187a9d3-116d-4e1f-89f3-fa7b6335728a tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:10.195692 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e187a9d3-116d-4e1f-89f3-fa7b6335728a tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:10.204085 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e187a9d3-116d-4e1f-89f3-fa7b6335728a tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:10.204939 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e187a9d3-116d-4e1f-89f3-fa7b6335728a tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:10.205401 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e187a9d3-116d-4e1f-89f3-fa7b6335728a tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:10.206606 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e187a9d3-116d-4e1f-89f3-fa7b6335728a tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:10.207341 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e187a9d3-116d-4e1f-89f3-fa7b6335728a tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:10.208006 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e187a9d3-116d-4e1f-89f3-fa7b6335728a tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:10.411776 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e187a9d3-116d-4e1f-89f3-fa7b6335728a tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:10.424974 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e187a9d3-116d-4e1f-89f3-fa7b6335728a tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:10.427224 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e187a9d3-116d-4e1f-89f3-fa7b6335728a tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:10.429708 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e187a9d3-116d-4e1f-89f3-fa7b6335728a tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1728 microversion: 2.20 time: 0.240620 Oct 17 14:07:10.434885 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2820/5508] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:07:10 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1728 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:07:11.456713 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6189aa13-8dc6-4ead-8dbf-8382d629b571 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:11.457993 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6189aa13-8dc6-4ead-8dbf-8382d629b571 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:11.473703 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6189aa13-8dc6-4ead-8dbf-8382d629b571 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:11.474449 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6189aa13-8dc6-4ead-8dbf-8382d629b571 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:11.475059 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6189aa13-8dc6-4ead-8dbf-8382d629b571 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:11.475952 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6189aa13-8dc6-4ead-8dbf-8382d629b571 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:11.476558 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6189aa13-8dc6-4ead-8dbf-8382d629b571 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:11.477170 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6189aa13-8dc6-4ead-8dbf-8382d629b571 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:11.656490 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6189aa13-8dc6-4ead-8dbf-8382d629b571 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:11.669632 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6189aa13-8dc6-4ead-8dbf-8382d629b571 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:11.669632 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6189aa13-8dc6-4ead-8dbf-8382d629b571 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:11.680844 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6189aa13-8dc6-4ead-8dbf-8382d629b571 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1728 microversion: 2.20 time: 0.216788 Oct 17 14:07:11.681649 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2689/5509] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:07:11 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1728 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:07:12.708314 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a2127fb7-e9e8-4b04-8bbc-4e2b8fc474a1 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:12.709074 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a2127fb7-e9e8-4b04-8bbc-4e2b8fc474a1 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:12.723751 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a2127fb7-e9e8-4b04-8bbc-4e2b8fc474a1 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:12.724255 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a2127fb7-e9e8-4b04-8bbc-4e2b8fc474a1 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:12.725218 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a2127fb7-e9e8-4b04-8bbc-4e2b8fc474a1 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:12.725951 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a2127fb7-e9e8-4b04-8bbc-4e2b8fc474a1 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:12.727611 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a2127fb7-e9e8-4b04-8bbc-4e2b8fc474a1 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:12.728037 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a2127fb7-e9e8-4b04-8bbc-4e2b8fc474a1 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:12.970711 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a2127fb7-e9e8-4b04-8bbc-4e2b8fc474a1 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:12.985436 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a2127fb7-e9e8-4b04-8bbc-4e2b8fc474a1 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:12.991851 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a2127fb7-e9e8-4b04-8bbc-4e2b8fc474a1 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:12.993233 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a2127fb7-e9e8-4b04-8bbc-4e2b8fc474a1 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1728 microversion: 2.20 time: 0.289300 Oct 17 14:07:12.996101 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2821/5510] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:07:12 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1728 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:07:14.022424 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3549cf4c-4035-49b8-b748-af52ada9fa20 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:14.023088 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3549cf4c-4035-49b8-b748-af52ada9fa20 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:14.030158 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3549cf4c-4035-49b8-b748-af52ada9fa20 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:14.030672 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3549cf4c-4035-49b8-b748-af52ada9fa20 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:14.031107 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3549cf4c-4035-49b8-b748-af52ada9fa20 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:14.031858 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3549cf4c-4035-49b8-b748-af52ada9fa20 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:14.032316 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3549cf4c-4035-49b8-b748-af52ada9fa20 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:14.032776 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3549cf4c-4035-49b8-b748-af52ada9fa20 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:14.230664 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3549cf4c-4035-49b8-b748-af52ada9fa20 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:14.242992 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3549cf4c-4035-49b8-b748-af52ada9fa20 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:14.245019 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3549cf4c-4035-49b8-b748-af52ada9fa20 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:14.246483 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3549cf4c-4035-49b8-b748-af52ada9fa20 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1715 microversion: 2.20 time: 0.228200 Oct 17 14:07:14.247864 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2690/5511] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:07:14 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1715 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:07:22.586154 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7ca7547c-30b3-4d63-a213-5c098ab9fc27 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:22.586765 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7ca7547c-30b3-4d63-a213-5c098ab9fc27 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] [instance: 23841bc8-e69b-40aa-abe2-31282ca6415d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:22.604518 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7ca7547c-30b3-4d63-a213-5c098ab9fc27 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:22.605193 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7ca7547c-30b3-4d63-a213-5c098ab9fc27 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:22.605739 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7ca7547c-30b3-4d63-a213-5c098ab9fc27 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:22.606733 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7ca7547c-30b3-4d63-a213-5c098ab9fc27 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:22.607504 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7ca7547c-30b3-4d63-a213-5c098ab9fc27 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:22.609150 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7ca7547c-30b3-4d63-a213-5c098ab9fc27 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:22.741354 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-7ca7547c-30b3-4d63-a213-5c098ab9fc27 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lazy-loading 'services' on Instance uuid 23841bc8-e69b-40aa-abe2-31282ca6415d {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:07:22.855521 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7ca7547c-30b3-4d63-a213-5c098ab9fc27 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] 10.222.0.79 "DELETE /compute/v2.1/servers/23841bc8-e69b-40aa-abe2-31282ca6415d/os-volume_attachments/06f55d3e-34d3-4bdc-8b5d-6987c512059c" status: 202 len: 0 microversion: 2.1 time: 0.273266 Oct 17 14:07:22.857820 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2822/5512] 10.222.0.79 () {58 vars in 1416 bytes} [Mon Oct 17 14:07:22 2022] DELETE /compute/v2.1/servers/23841bc8-e69b-40aa-abe2-31282ca6415d/os-volume_attachments/06f55d3e-34d3-4bdc-8b5d-6987c512059c => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:07:29.715240 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b20b42f2-b64a-4164-903a-7fb07b8dc63d tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:29.716659 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b20b42f2-b64a-4164-903a-7fb07b8dc63d tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] [instance: 23841bc8-e69b-40aa-abe2-31282ca6415d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:29.725044 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=19 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:07:29.725928 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=62 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:07:29.737411 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b20b42f2-b64a-4164-903a-7fb07b8dc63d tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:29.739869 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b20b42f2-b64a-4164-903a-7fb07b8dc63d tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:29.740481 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b20b42f2-b64a-4164-903a-7fb07b8dc63d tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:29.741408 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b20b42f2-b64a-4164-903a-7fb07b8dc63d tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:29.741833 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b20b42f2-b64a-4164-903a-7fb07b8dc63d tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:29.743691 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b20b42f2-b64a-4164-903a-7fb07b8dc63d tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:29.819447 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b20b42f2-b64a-4164-903a-7fb07b8dc63d tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] [instance: 23841bc8-e69b-40aa-abe2-31282ca6415d] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:07:29.983636 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b20b42f2-b64a-4164-903a-7fb07b8dc63d tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] 10.222.0.79 "DELETE /compute/v2.1/servers/23841bc8-e69b-40aa-abe2-31282ca6415d" status: 204 len: 0 microversion: 2.1 time: 0.270394 Oct 17 14:07:29.988954 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2691/5513] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:07:29 2022] DELETE /compute/v2.1/servers/23841bc8-e69b-40aa-abe2-31282ca6415d => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:07:29.997797 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d6bcd5cf-96ba-4901-b7c0-e86488a43966 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:29.999382 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d6bcd5cf-96ba-4901-b7c0-e86488a43966 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] [instance: 23841bc8-e69b-40aa-abe2-31282ca6415d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:30.008259 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d6bcd5cf-96ba-4901-b7c0-e86488a43966 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:30.008980 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d6bcd5cf-96ba-4901-b7c0-e86488a43966 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:30.009625 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d6bcd5cf-96ba-4901-b7c0-e86488a43966 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:30.010741 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d6bcd5cf-96ba-4901-b7c0-e86488a43966 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:30.011476 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d6bcd5cf-96ba-4901-b7c0-e86488a43966 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:30.012114 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d6bcd5cf-96ba-4901-b7c0-e86488a43966 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:30.233373 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d6bcd5cf-96ba-4901-b7c0-e86488a43966 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1985e2c6784e159b51a6895f9e428e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0a677cf95f4c7e93534ae4e9dfd55b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:30.256071 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d6bcd5cf-96ba-4901-b7c0-e86488a43966 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] 10.222.0.79 "GET /compute/v2.1/servers/23841bc8-e69b-40aa-abe2-31282ca6415d" status: 200 len: 1470 microversion: 2.1 time: 0.265362 Oct 17 14:07:30.271863 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2823/5514] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:07:29 2022] GET /compute/v2.1/servers/23841bc8-e69b-40aa-abe2-31282ca6415d => generated 1470 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:07:31.299358 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4d2b57a2-55dd-4f98-8cdd-5e3e738de2fe tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:31.301321 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4d2b57a2-55dd-4f98-8cdd-5e3e738de2fe tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] [instance: 23841bc8-e69b-40aa-abe2-31282ca6415d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:31.333590 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4d2b57a2-55dd-4f98-8cdd-5e3e738de2fe tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:31.337779 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4d2b57a2-55dd-4f98-8cdd-5e3e738de2fe tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:31.338808 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4d2b57a2-55dd-4f98-8cdd-5e3e738de2fe tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:31.341884 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4d2b57a2-55dd-4f98-8cdd-5e3e738de2fe tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:31.354132 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4d2b57a2-55dd-4f98-8cdd-5e3e738de2fe tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:31.354132 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4d2b57a2-55dd-4f98-8cdd-5e3e738de2fe tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:31.924914 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4d2b57a2-55dd-4f98-8cdd-5e3e738de2fe tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1985e2c6784e159b51a6895f9e428e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0a677cf95f4c7e93534ae4e9dfd55b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:31.933344 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4d2b57a2-55dd-4f98-8cdd-5e3e738de2fe tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] 10.222.0.79 "GET /compute/v2.1/servers/23841bc8-e69b-40aa-abe2-31282ca6415d" status: 200 len: 1470 microversion: 2.1 time: 0.646507 Oct 17 14:07:31.934423 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2692/5515] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:07:31 2022] GET /compute/v2.1/servers/23841bc8-e69b-40aa-abe2-31282ca6415d => generated 1470 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:07:32.652718 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-6561e31e-2a54-4f8e-bba7-2ad94e603338 req-5d7e54dc-8948-46e4-905a-c1b0ec6964ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23841bc8-e69b-40aa-abe2-31282ca6415d", "name": "network-vif-deleted", "tag": "1f5fee6d-0e3c-4034-af1b-c997d41664b4"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:07:32.660676 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=16 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:07:32.678834 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-6561e31e-2a54-4f8e-bba7-2ad94e603338 req-5d7e54dc-8948-46e4-905a-c1b0ec6964ad service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:32.679697 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-6561e31e-2a54-4f8e-bba7-2ad94e603338 req-5d7e54dc-8948-46e4-905a-c1b0ec6964ad service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:32.688013 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-6561e31e-2a54-4f8e-bba7-2ad94e603338 req-5d7e54dc-8948-46e4-905a-c1b0ec6964ad service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:32.701784 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-6561e31e-2a54-4f8e-bba7-2ad94e603338 req-5d7e54dc-8948-46e4-905a-c1b0ec6964ad service nova] Creating event network-vif-deleted:1f5fee6d-0e3c-4034-af1b-c997d41664b4 for instance 23841bc8-e69b-40aa-abe2-31282ca6415d on n-h2-854247-14 Oct 17 14:07:32.707882 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-6561e31e-2a54-4f8e-bba7-2ad94e603338 req-5d7e54dc-8948-46e4-905a-c1b0ec6964ad service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058608 Oct 17 14:07:32.709380 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2824/5516] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:07:32.959107 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-dbf6ba88-e2f2-408b-9c42-eba41a4dabee tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:32.961029 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-dbf6ba88-e2f2-408b-9c42-eba41a4dabee tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] [instance: 23841bc8-e69b-40aa-abe2-31282ca6415d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:32.978217 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dbf6ba88-e2f2-408b-9c42-eba41a4dabee tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:32.979431 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dbf6ba88-e2f2-408b-9c42-eba41a4dabee tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:32.981158 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dbf6ba88-e2f2-408b-9c42-eba41a4dabee tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:32.984407 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dbf6ba88-e2f2-408b-9c42-eba41a4dabee tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:32.985279 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dbf6ba88-e2f2-408b-9c42-eba41a4dabee tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:32.987780 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dbf6ba88-e2f2-408b-9c42-eba41a4dabee tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:33.084510 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dbf6ba88-e2f2-408b-9c42-eba41a4dabee tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:33.087802 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dbf6ba88-e2f2-408b-9c42-eba41a4dabee tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:33.088382 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dbf6ba88-e2f2-408b-9c42-eba41a4dabee tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:33.090489 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-dbf6ba88-e2f2-408b-9c42-eba41a4dabee tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lazy-loading 'fault' on Instance uuid 23841bc8-e69b-40aa-abe2-31282ca6415d {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:07:33.183567 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-dbf6ba88-e2f2-408b-9c42-eba41a4dabee tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1985e2c6784e159b51a6895f9e428e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0a677cf95f4c7e93534ae4e9dfd55b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:33.197384 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-dbf6ba88-e2f2-408b-9c42-eba41a4dabee tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] 10.222.0.79 "GET /compute/v2.1/servers/23841bc8-e69b-40aa-abe2-31282ca6415d" status: 200 len: 1304 microversion: 2.1 time: 0.242844 Oct 17 14:07:33.198715 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2693/5517] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:07:32 2022] GET /compute/v2.1/servers/23841bc8-e69b-40aa-abe2-31282ca6415d => generated 1304 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:07:34.228988 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-35338487-637f-4d12-a126-4cb2944eb855 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:34.230608 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-35338487-637f-4d12-a126-4cb2944eb855 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] [instance: 23841bc8-e69b-40aa-abe2-31282ca6415d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:34.242288 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-35338487-637f-4d12-a126-4cb2944eb855 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:34.243085 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-35338487-637f-4d12-a126-4cb2944eb855 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:34.243740 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-35338487-637f-4d12-a126-4cb2944eb855 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:34.244629 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-35338487-637f-4d12-a126-4cb2944eb855 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:34.247688 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-35338487-637f-4d12-a126-4cb2944eb855 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:34.248351 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-35338487-637f-4d12-a126-4cb2944eb855 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:34.262946 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-35338487-637f-4d12-a126-4cb2944eb855 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] HTTP exception thrown: Instance 23841bc8-e69b-40aa-abe2-31282ca6415d could not be found. Oct 17 14:07:34.267735 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-35338487-637f-4d12-a126-4cb2944eb855 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Request method failure captured: Oct 17 14:07:34.267735 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/23841bc8-e69b-40aa-abe2-31282ca6415d HTTP/1.1 Oct 17 14:07:34.267735 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 14:07:34.267735 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 14:07:34.267735 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 14:07:34.267735 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 14:07:34.267735 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 14:07:34.267735 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 14:07:34.267735 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 14:07:34.267735 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 14:07:34.267735 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTWEMZ0UZWivjcwNvcbKKJy1mktgJ7UFzpRpbpwbbKWs5-EISZMb84iX8x-_p-gkJ0B1nw9hgP_imoxmsDxf37L7HWTmQHMrhS7L_01fWANICukdouYJepq-YwAkZEU7ax3Hf3KPRT8umr3--eLK9GPIhqj-XSNTC8LoF25K1MGSDmdc Oct 17 14:07:34.267735 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 14:07:34.267735 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 14:07:34.267735 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 14:07:34.267735 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 14:07:34.267735 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 14:07:34.267735 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 14:07:34.267735 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 0a0a677cf95f4c7e93534ae4e9dfd55b Oct 17 14:07:34.267735 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-VolumesBackupsTest-828827102 Oct 17 14:07:34.267735 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 14:07:34.267735 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 14:07:34.267735 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0a0a677cf95f4c7e93534ae4e9dfd55b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/0a0a677cf95f4c7e93534ae4e9dfd55b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/0a0a677cf95f4c7e93534ae4e9dfd55b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_0a0a677cf95f4c7e93534ae4e9dfd55b", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:07:34.267735 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-VolumesBackupsTest-828827102 Oct 17 14:07:34.267735 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 0a0a677cf95f4c7e93534ae4e9dfd55b Oct 17 14:07:34.267735 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-VolumesBackupsTest-828827102 Oct 17 14:07:34.267735 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-VolumesBackupsTest-828827102-project Oct 17 14:07:34.267735 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 14:07:34.267735 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 14:07:34.267735 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 5a1985e2c6784e159b51a6895f9e428e Oct 17 14:07:34.267735 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-VolumesBackupsTest-828827102-project Oct 17 14:07:34.267735 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 14:07:34.267735 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 23841bc8-e69b-40aa-abe2-31282ca6415d could not be found. Oct 17 14:07:34.267735 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '23841bc8-e69b-40aa-abe2-31282ca6415d'} Oct 17 14:07:34.267735 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:07:34.267735 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:07:34.267735 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:07:34.267735 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:07:34.267735 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:07:34.267735 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:07:34.267735 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:07:34.267735 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:07:34.267735 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:07:34.267735 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:07:34.267735 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23841bc8-e69b-40aa-abe2-31282ca6415d could not be found. Oct 17 14:07:34.267735 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:07:34.267735 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:07:34.267735 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:07:34.267735 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:07:34.267735 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:07:34.267735 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:07:34.267735 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:07:34.267735 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:07:34.267735 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:07:34.267735 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:07:34.267735 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:07:34.267735 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:07:34.267735 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:07:34.267735 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:07:34.267735 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:07:34.267735 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:07:34.267735 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23841bc8-e69b-40aa-abe2-31282ca6415d could not be found. Oct 17 14:07:34.267735 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:07:34.267735 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:07:34.267735 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:07:34.284343 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:07:34.284343 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:07:34.284343 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:07:34.284343 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:07:34.284343 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:07:34.284343 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23841bc8-e69b-40aa-abe2-31282ca6415d could not be found. Oct 17 14:07:34.284343 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:07:34.289055 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-35338487-637f-4d12-a126-4cb2944eb855 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] Returning 404 to user: Instance 23841bc8-e69b-40aa-abe2-31282ca6415d could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:07:34.293320 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-35338487-637f-4d12-a126-4cb2944eb855 tempest-VolumesBackupsTest-828827102 tempest-VolumesBackupsTest-828827102-project] 10.222.0.79 "GET /compute/v2.1/servers/23841bc8-e69b-40aa-abe2-31282ca6415d" status: 404 len: 111 microversion: 2.1 time: 0.069174 Oct 17 14:07:34.294392 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2825/5518] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:07:34 2022] GET /compute/v2.1/servers/23841bc8-e69b-40aa-abe2-31282ca6415d => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:07:36.352546 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-26fa891e-3ebe-47c9-953a-978ab9bc05e4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:36.355424 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-26fa891e-3ebe-47c9-953a-978ab9bc05e4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:36.369770 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-26fa891e-3ebe-47c9-953a-978ab9bc05e4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:36.372545 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-26fa891e-3ebe-47c9-953a-978ab9bc05e4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:36.373466 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-26fa891e-3ebe-47c9-953a-978ab9bc05e4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:36.375621 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-26fa891e-3ebe-47c9-953a-978ab9bc05e4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:36.377715 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-26fa891e-3ebe-47c9-953a-978ab9bc05e4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:36.378405 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-26fa891e-3ebe-47c9-953a-978ab9bc05e4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:36.477081 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-26fa891e-3ebe-47c9-953a-978ab9bc05e4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.132285 Oct 17 14:07:36.480094 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2694/5519] 10.222.0.79 () {60 vars in 1343 bytes} [Mon Oct 17 14:07:36 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed/os-volume_attachments => generated 25 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:07:36.598458 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8875928f-b472-4c75-a866-dee4ac5e3c6d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:36.600784 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8875928f-b472-4c75-a866-dee4ac5e3c6d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:36.617485 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8875928f-b472-4c75-a866-dee4ac5e3c6d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:36.619840 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8875928f-b472-4c75-a866-dee4ac5e3c6d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:36.622648 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8875928f-b472-4c75-a866-dee4ac5e3c6d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:36.624355 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8875928f-b472-4c75-a866-dee4ac5e3c6d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:36.627036 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8875928f-b472-4c75-a866-dee4ac5e3c6d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:36.627604 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8875928f-b472-4c75-a866-dee4ac5e3c6d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:36.693001 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8875928f-b472-4c75-a866-dee4ac5e3c6d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:07:36.894151 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8875928f-b472-4c75-a866-dee4ac5e3c6d tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "DELETE /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 204 len: 0 microversion: 2.20 time: 0.306516 Oct 17 14:07:36.895699 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2826/5520] 10.222.0.79 () {60 vars in 1280 bytes} [Mon Oct 17 14:07:36 2022] DELETE /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 14:07:36.905376 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4bb1ec87-6e4e-469a-9976-0c43618edcde tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:36.906548 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4bb1ec87-6e4e-469a-9976-0c43618edcde tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:36.918332 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4bb1ec87-6e4e-469a-9976-0c43618edcde tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:36.918969 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4bb1ec87-6e4e-469a-9976-0c43618edcde tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:36.919440 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4bb1ec87-6e4e-469a-9976-0c43618edcde tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:36.920586 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4bb1ec87-6e4e-469a-9976-0c43618edcde tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:36.921048 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4bb1ec87-6e4e-469a-9976-0c43618edcde tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:36.921467 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4bb1ec87-6e4e-469a-9976-0c43618edcde tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:37.281324 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4bb1ec87-6e4e-469a-9976-0c43618edcde tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:37.292275 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4bb1ec87-6e4e-469a-9976-0c43618edcde tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:37.294048 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4bb1ec87-6e4e-469a-9976-0c43618edcde tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:37.295642 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4bb1ec87-6e4e-469a-9976-0c43618edcde tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1721 microversion: 2.20 time: 0.395316 Oct 17 14:07:37.297511 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2695/5521] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:07:36 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1721 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:07:38.330030 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2310b7bd-dc49-47b6-b359-7a016e3336f6 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:38.332428 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2310b7bd-dc49-47b6-b359-7a016e3336f6 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:38.366592 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2310b7bd-dc49-47b6-b359-7a016e3336f6 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:38.367587 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2310b7bd-dc49-47b6-b359-7a016e3336f6 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:38.368281 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2310b7bd-dc49-47b6-b359-7a016e3336f6 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:38.370190 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2310b7bd-dc49-47b6-b359-7a016e3336f6 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:38.374702 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2310b7bd-dc49-47b6-b359-7a016e3336f6 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:38.375382 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2310b7bd-dc49-47b6-b359-7a016e3336f6 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:38.388786 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:07:38.646185 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2310b7bd-dc49-47b6-b359-7a016e3336f6 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:38.655451 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2310b7bd-dc49-47b6-b359-7a016e3336f6 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:38.659680 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2310b7bd-dc49-47b6-b359-7a016e3336f6 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:38.665730 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2310b7bd-dc49-47b6-b359-7a016e3336f6 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1721 microversion: 2.20 time: 0.345059 Oct 17 14:07:38.666320 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2827/5522] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:07:38 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1721 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:07:39.712590 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a5055f3d-3f31-488e-a38c-09d9f0942fe7 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:39.713210 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a5055f3d-3f31-488e-a38c-09d9f0942fe7 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:39.747746 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a5055f3d-3f31-488e-a38c-09d9f0942fe7 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:39.748237 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a5055f3d-3f31-488e-a38c-09d9f0942fe7 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:39.748735 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a5055f3d-3f31-488e-a38c-09d9f0942fe7 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:39.749454 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a5055f3d-3f31-488e-a38c-09d9f0942fe7 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:39.749904 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a5055f3d-3f31-488e-a38c-09d9f0942fe7 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:39.750431 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a5055f3d-3f31-488e-a38c-09d9f0942fe7 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:40.187694 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a5055f3d-3f31-488e-a38c-09d9f0942fe7 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:40.203344 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a5055f3d-3f31-488e-a38c-09d9f0942fe7 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:40.204735 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a5055f3d-3f31-488e-a38c-09d9f0942fe7 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:40.205957 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a5055f3d-3f31-488e-a38c-09d9f0942fe7 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1721 microversion: 2.20 time: 0.513909 Oct 17 14:07:40.206533 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2696/5523] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:07:39 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1721 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:07:40.933436 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-e4cbc0f6-7690-45b7-b96b-9cfc435f292b req-e8bce293-9c68-420a-9b32-7d555702a46a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32c279ba-2f76-4986-be6d-1029602677ed", "name": "network-vif-deleted", "tag": "b00489ac-2c3b-4d9e-843a-d9962aa3d085"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:07:40.968559 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-e4cbc0f6-7690-45b7-b96b-9cfc435f292b req-e8bce293-9c68-420a-9b32-7d555702a46a service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:40.972662 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-e4cbc0f6-7690-45b7-b96b-9cfc435f292b req-e8bce293-9c68-420a-9b32-7d555702a46a service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:40.976302 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-e4cbc0f6-7690-45b7-b96b-9cfc435f292b req-e8bce293-9c68-420a-9b32-7d555702a46a service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:41.029323 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-e4cbc0f6-7690-45b7-b96b-9cfc435f292b req-e8bce293-9c68-420a-9b32-7d555702a46a service nova] Creating event network-vif-deleted:b00489ac-2c3b-4d9e-843a-d9962aa3d085 for instance 32c279ba-2f76-4986-be6d-1029602677ed on n-h2-854247-14 Oct 17 14:07:41.049074 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-e4cbc0f6-7690-45b7-b96b-9cfc435f292b req-e8bce293-9c68-420a-9b32-7d555702a46a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119143 Oct 17 14:07:41.052277 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2828/5524] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:07:41.257868 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a545d4b7-c6db-4b85-a21c-8ba9847e3e77 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:41.259435 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a545d4b7-c6db-4b85-a21c-8ba9847e3e77 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:41.271315 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a545d4b7-c6db-4b85-a21c-8ba9847e3e77 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:41.272421 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a545d4b7-c6db-4b85-a21c-8ba9847e3e77 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:41.273521 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a545d4b7-c6db-4b85-a21c-8ba9847e3e77 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:41.276126 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a545d4b7-c6db-4b85-a21c-8ba9847e3e77 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:41.278161 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a545d4b7-c6db-4b85-a21c-8ba9847e3e77 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:41.279031 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a545d4b7-c6db-4b85-a21c-8ba9847e3e77 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:41.410501 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a545d4b7-c6db-4b85-a21c-8ba9847e3e77 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:41.412789 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a545d4b7-c6db-4b85-a21c-8ba9847e3e77 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:41.422159 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a545d4b7-c6db-4b85-a21c-8ba9847e3e77 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:41.423836 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-a545d4b7-c6db-4b85-a21c-8ba9847e3e77 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lazy-loading 'fault' on Instance uuid 32c279ba-2f76-4986-be6d-1029602677ed {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:07:41.569266 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a545d4b7-c6db-4b85-a21c-8ba9847e3e77 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:41.578824 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a545d4b7-c6db-4b85-a21c-8ba9847e3e77 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:41.596498 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a545d4b7-c6db-4b85-a21c-8ba9847e3e77 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c7ac3dcc4ff4dd2bb68738c72e9507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc0bf813dc4a4fa2fd7d6f5521ae85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:41.599944 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a545d4b7-c6db-4b85-a21c-8ba9847e3e77 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 200 len: 1369 microversion: 2.20 time: 0.360858 Oct 17 14:07:41.609380 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2697/5525] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:07:41 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 1369 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 14:07:42.629599 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-658bd21b-6651-47db-b02c-d288b9a6da94 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:42.630331 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-658bd21b-6651-47db-b02c-d288b9a6da94 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:42.644605 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-658bd21b-6651-47db-b02c-d288b9a6da94 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:42.646420 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-658bd21b-6651-47db-b02c-d288b9a6da94 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:42.648386 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-658bd21b-6651-47db-b02c-d288b9a6da94 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:42.650653 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-658bd21b-6651-47db-b02c-d288b9a6da94 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:42.651878 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-658bd21b-6651-47db-b02c-d288b9a6da94 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:42.652789 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-658bd21b-6651-47db-b02c-d288b9a6da94 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:42.690671 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-658bd21b-6651-47db-b02c-d288b9a6da94 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] HTTP exception thrown: Instance 32c279ba-2f76-4986-be6d-1029602677ed could not be found. Oct 17 14:07:42.695850 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-658bd21b-6651-47db-b02c-d288b9a6da94 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Request method failure captured: Oct 17 14:07:42.695850 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed HTTP/1.1 Oct 17 14:07:42.695850 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 14:07:42.695850 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 14:07:42.695850 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 14:07:42.695850 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 14:07:42.695850 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 14:07:42.695850 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 14:07:42.695850 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 14:07:42.695850 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 14:07:42.695850 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTWAO_VmGva_BBT15wpCNnvALuvGOjT_SoMW3_Vm1bhAQtak3XB07mRAdCJ_wnCBHoN-a-s8oUf5FPUuQgdWnRliezSs4oZuT0viWVzkCyaLn2Yap1hTnnKbQ24FaQvsntpgmAcOy_-tJg5P1ZlCE29U0SXLNIrlJqLSqx_JACEZ6IFs Oct 17 14:07:42.695850 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 14:07:42.695850 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 14:07:42.695850 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 14:07:42.695850 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 14:07:42.695850 n-d-854247-14 devstack@n-api.service[127016]: X-Openstack-Nova-Api-Version: 2.20 Oct 17 14:07:42.695850 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 14:07:42.695850 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 14:07:42.695850 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 6dcc0bf813dc4a4fa2fd7d6f5521ae85 Oct 17 14:07:42.695850 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1066178867 Oct 17 14:07:42.695850 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 14:07:42.695850 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 14:07:42.695850 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6dcc0bf813dc4a4fa2fd7d6f5521ae85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6dcc0bf813dc4a4fa2fd7d6f5521ae85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6dcc0bf813dc4a4fa2fd7d6f5521ae85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6dcc0bf813dc4a4fa2fd7d6f5521ae85", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:07:42.695850 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1066178867 Oct 17 14:07:42.695850 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 6dcc0bf813dc4a4fa2fd7d6f5521ae85 Oct 17 14:07:42.695850 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1066178867 Oct 17 14:07:42.695850 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-AttachVolumeShelveTestJSON-1066178867-project Oct 17 14:07:42.695850 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 14:07:42.695850 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 14:07:42.695850 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 9c7ac3dcc4ff4dd2bb68738c72e9507f Oct 17 14:07:42.695850 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1066178867-project Oct 17 14:07:42.695850 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 14:07:42.695850 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 32c279ba-2f76-4986-be6d-1029602677ed could not be found. Oct 17 14:07:42.695850 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '32c279ba-2f76-4986-be6d-1029602677ed'} Oct 17 14:07:42.695850 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:07:42.695850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:07:42.695850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:07:42.695850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:07:42.695850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:07:42.695850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:07:42.695850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:07:42.695850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:07:42.695850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:07:42.695850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:07:42.695850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32c279ba-2f76-4986-be6d-1029602677ed could not be found. Oct 17 14:07:42.695850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:07:42.695850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:07:42.695850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:07:42.695850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:07:42.695850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:07:42.695850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:07:42.695850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:07:42.695850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:07:42.695850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:07:42.695850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:07:42.695850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:07:42.695850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:07:42.695850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:07:42.695850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:07:42.695850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:07:42.695850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:07:42.695850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32c279ba-2f76-4986-be6d-1029602677ed could not be found. Oct 17 14:07:42.695850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:07:42.695850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:07:42.702607 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:07:42.702607 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:07:42.702607 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:07:42.702607 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:07:42.702607 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:07:42.702607 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:07:42.702607 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32c279ba-2f76-4986-be6d-1029602677ed could not be found. Oct 17 14:07:42.702607 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:07:42.707260 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-658bd21b-6651-47db-b02c-d288b9a6da94 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Returning 404 to user: Instance 32c279ba-2f76-4986-be6d-1029602677ed could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:07:42.709210 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-658bd21b-6651-47db-b02c-d288b9a6da94 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 404 len: 111 microversion: 2.20 time: 0.085505 Oct 17 14:07:42.711714 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2829/5526] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:07:42 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 14:07:42.720462 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-469d1c6b-0061-4249-8dae-be7157af2df4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '.version_select at 0x7f7cd9a59ee0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:42.755531 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-469d1c6b-0061-4249-8dae-be7157af2df4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-96458282" status: 204 len: 0 microversion: 2.20 time: 0.039338 Oct 17 14:07:42.759609 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2698/5527] 10.222.0.79 () {60 vars in 1256 bytes} [Mon Oct 17 14:07:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-96458282 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 14:07:48.774502 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6ecb5b0e-0144-443d-83d4-1919318119c4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:48.775936 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6ecb5b0e-0144-443d-83d4-1919318119c4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:48.803311 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6ecb5b0e-0144-443d-83d4-1919318119c4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:48.804655 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6ecb5b0e-0144-443d-83d4-1919318119c4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:48.810105 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6ecb5b0e-0144-443d-83d4-1919318119c4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:48.812182 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6ecb5b0e-0144-443d-83d4-1919318119c4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:48.813585 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6ecb5b0e-0144-443d-83d4-1919318119c4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:48.815418 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6ecb5b0e-0144-443d-83d4-1919318119c4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:48.874196 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-6ecb5b0e-0144-443d-83d4-1919318119c4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] HTTP exception thrown: Instance 32c279ba-2f76-4986-be6d-1029602677ed could not be found. Oct 17 14:07:48.883451 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6ecb5b0e-0144-443d-83d4-1919318119c4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Request method failure captured: Oct 17 14:07:48.883451 n-d-854247-14 devstack@n-api.service[127016]: request: DELETE /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed HTTP/1.1 Oct 17 14:07:48.883451 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 14:07:48.883451 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 14:07:48.883451 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 14:07:48.883451 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 14:07:48.883451 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 14:07:48.883451 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 14:07:48.883451 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 14:07:48.883451 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 14:07:48.883451 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTWAO_VmGva_BBT15wpCNnvALuvGOjT_SoMW3_Vm1bhAQtak3XB07mRAdCJ_wnCBHoN-a-s8oUf5FPUuQgdWnRliezSs4oZuT0viWVzkCyaLn2Yap1hTnnKbQ24FaQvsntpgmAcOy_-tJg5P1ZlCE29U0SXLNIrlJqLSqx_JACEZ6IFs Oct 17 14:07:48.883451 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 14:07:48.883451 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 14:07:48.883451 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 14:07:48.883451 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 14:07:48.883451 n-d-854247-14 devstack@n-api.service[127016]: X-Openstack-Nova-Api-Version: 2.20 Oct 17 14:07:48.883451 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 14:07:48.883451 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 14:07:48.883451 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 6dcc0bf813dc4a4fa2fd7d6f5521ae85 Oct 17 14:07:48.883451 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1066178867 Oct 17 14:07:48.883451 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 14:07:48.883451 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 14:07:48.883451 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6dcc0bf813dc4a4fa2fd7d6f5521ae85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6dcc0bf813dc4a4fa2fd7d6f5521ae85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6dcc0bf813dc4a4fa2fd7d6f5521ae85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6dcc0bf813dc4a4fa2fd7d6f5521ae85", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:07:48.883451 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1066178867 Oct 17 14:07:48.883451 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 6dcc0bf813dc4a4fa2fd7d6f5521ae85 Oct 17 14:07:48.883451 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1066178867 Oct 17 14:07:48.883451 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-AttachVolumeShelveTestJSON-1066178867-project Oct 17 14:07:48.883451 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 14:07:48.883451 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 14:07:48.883451 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 9c7ac3dcc4ff4dd2bb68738c72e9507f Oct 17 14:07:48.883451 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1066178867-project Oct 17 14:07:48.883451 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 14:07:48.883451 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 32c279ba-2f76-4986-be6d-1029602677ed could not be found. Oct 17 14:07:48.883451 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '32c279ba-2f76-4986-be6d-1029602677ed'} Oct 17 14:07:48.883451 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:07:48.883451 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:07:48.883451 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:07:48.883451 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:07:48.883451 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:07:48.883451 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:07:48.883451 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:07:48.883451 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:07:48.883451 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:07:48.883451 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:07:48.883451 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32c279ba-2f76-4986-be6d-1029602677ed could not be found. Oct 17 14:07:48.883451 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:07:48.883451 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:07:48.883451 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:07:48.883451 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:07:48.883451 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:07:48.883451 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:07:48.883451 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:07:48.883451 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:07:48.883451 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:07:48.883451 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:07:48.883451 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 14:07:48.883451 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 14:07:48.883451 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 14:07:48.883451 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 14:07:48.883451 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:07:48.883451 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:07:48.883451 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:07:48.883451 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:07:48.888969 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32c279ba-2f76-4986-be6d-1029602677ed could not be found. Oct 17 14:07:48.888969 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:07:48.888969 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:07:48.888969 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:07:48.888969 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:07:48.888969 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:07:48.888969 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:07:48.888969 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:07:48.888969 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:07:48.888969 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32c279ba-2f76-4986-be6d-1029602677ed could not be found. Oct 17 14:07:48.888969 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:07:48.888969 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6ecb5b0e-0144-443d-83d4-1919318119c4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Returning 404 to user: Instance 32c279ba-2f76-4986-be6d-1029602677ed could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:07:48.888969 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6ecb5b0e-0144-443d-83d4-1919318119c4 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "DELETE /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 404 len: 111 microversion: 2.20 time: 0.116658 Oct 17 14:07:48.888969 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2830/5528] 10.222.0.79 () {60 vars in 1280 bytes} [Mon Oct 17 14:07:48 2022] DELETE /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 14:07:48.895130 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-69bdcbff-44ba-4680-b01a-1711af847ffd tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:48.896146 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-69bdcbff-44ba-4680-b01a-1711af847ffd tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 32c279ba-2f76-4986-be6d-1029602677ed] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:48.921103 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69bdcbff-44ba-4680-b01a-1711af847ffd tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:48.921629 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69bdcbff-44ba-4680-b01a-1711af847ffd tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:48.922177 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69bdcbff-44ba-4680-b01a-1711af847ffd tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:48.922992 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69bdcbff-44ba-4680-b01a-1711af847ffd tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:48.923563 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69bdcbff-44ba-4680-b01a-1711af847ffd tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:48.924077 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69bdcbff-44ba-4680-b01a-1711af847ffd tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:48.963088 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-69bdcbff-44ba-4680-b01a-1711af847ffd tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] HTTP exception thrown: Instance 32c279ba-2f76-4986-be6d-1029602677ed could not be found. Oct 17 14:07:48.979253 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-69bdcbff-44ba-4680-b01a-1711af847ffd tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Request method failure captured: Oct 17 14:07:48.979253 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed HTTP/1.1 Oct 17 14:07:48.979253 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 14:07:48.979253 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 14:07:48.979253 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 14:07:48.979253 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 14:07:48.979253 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 14:07:48.979253 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 14:07:48.979253 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 14:07:48.979253 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 14:07:48.979253 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTWAO_VmGva_BBT15wpCNnvALuvGOjT_SoMW3_Vm1bhAQtak3XB07mRAdCJ_wnCBHoN-a-s8oUf5FPUuQgdWnRliezSs4oZuT0viWVzkCyaLn2Yap1hTnnKbQ24FaQvsntpgmAcOy_-tJg5P1ZlCE29U0SXLNIrlJqLSqx_JACEZ6IFs Oct 17 14:07:48.979253 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 14:07:48.979253 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 14:07:48.979253 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 14:07:48.979253 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 14:07:48.979253 n-d-854247-14 devstack@n-api.service[127017]: X-Openstack-Nova-Api-Version: 2.20 Oct 17 14:07:48.979253 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 14:07:48.979253 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 14:07:48.979253 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 6dcc0bf813dc4a4fa2fd7d6f5521ae85 Oct 17 14:07:48.979253 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1066178867 Oct 17 14:07:48.979253 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 14:07:48.979253 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 14:07:48.979253 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6dcc0bf813dc4a4fa2fd7d6f5521ae85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6dcc0bf813dc4a4fa2fd7d6f5521ae85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6dcc0bf813dc4a4fa2fd7d6f5521ae85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6dcc0bf813dc4a4fa2fd7d6f5521ae85", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:07:48.979253 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1066178867 Oct 17 14:07:48.979253 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 6dcc0bf813dc4a4fa2fd7d6f5521ae85 Oct 17 14:07:48.979253 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1066178867 Oct 17 14:07:48.979253 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-AttachVolumeShelveTestJSON-1066178867-project Oct 17 14:07:48.979253 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 14:07:48.979253 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 14:07:48.979253 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 9c7ac3dcc4ff4dd2bb68738c72e9507f Oct 17 14:07:48.979253 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1066178867-project Oct 17 14:07:48.979253 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 14:07:48.979253 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 32c279ba-2f76-4986-be6d-1029602677ed could not be found. Oct 17 14:07:48.979253 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '32c279ba-2f76-4986-be6d-1029602677ed'} Oct 17 14:07:48.979253 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:07:48.979253 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:07:48.979253 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:07:48.979253 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:07:48.979253 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:07:48.979253 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:07:48.979253 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:07:48.979253 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:07:48.979253 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:07:48.979253 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:07:48.979253 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32c279ba-2f76-4986-be6d-1029602677ed could not be found. Oct 17 14:07:48.979253 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:07:48.979253 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:07:48.979253 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:07:48.979253 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:07:48.979253 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:07:48.979253 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:07:48.979253 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:07:48.979253 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:07:48.979253 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:07:48.979253 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:07:48.979253 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:07:48.979253 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:07:48.979253 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:07:48.979253 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:07:48.979253 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:07:48.979253 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:07:48.979253 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32c279ba-2f76-4986-be6d-1029602677ed could not be found. Oct 17 14:07:48.979253 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:07:48.979253 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:07:48.986005 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:07:48.986005 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:07:48.986005 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:07:48.986005 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:07:48.986005 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:07:48.986005 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:07:48.986005 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32c279ba-2f76-4986-be6d-1029602677ed could not be found. Oct 17 14:07:48.986005 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:07:48.986005 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-69bdcbff-44ba-4680-b01a-1711af847ffd tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Returning 404 to user: Instance 32c279ba-2f76-4986-be6d-1029602677ed could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:07:48.989137 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-69bdcbff-44ba-4680-b01a-1711af847ffd tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed" status: 404 len: 111 microversion: 2.20 time: 0.097059 Oct 17 14:07:48.991800 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2699/5529] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:07:48 2022] GET /compute/v2.1/servers/32c279ba-2f76-4986-be6d-1029602677ed => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 14:07:55.962151 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-436d5cc7-5311-48f8-a066-d2923cf334e8 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:55.963753 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-436d5cc7-5311-48f8-a066-d2923cf334e8 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:55.984668 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-436d5cc7-5311-48f8-a066-d2923cf334e8 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:55.987365 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-436d5cc7-5311-48f8-a066-d2923cf334e8 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:55.988012 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-436d5cc7-5311-48f8-a066-d2923cf334e8 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:55.990784 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-436d5cc7-5311-48f8-a066-d2923cf334e8 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:55.991456 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-436d5cc7-5311-48f8-a066-d2923cf334e8 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:55.992671 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-436d5cc7-5311-48f8-a066-d2923cf334e8 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:56.048196 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-436d5cc7-5311-48f8-a066-d2923cf334e8 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] HTTP exception thrown: Instance 86508a39-65fa-4421-b31d-ffbc5fdee565 could not be found. Oct 17 14:07:56.052167 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-436d5cc7-5311-48f8-a066-d2923cf334e8 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Request method failure captured: Oct 17 14:07:56.052167 n-d-854247-14 devstack@n-api.service[127016]: request: DELETE /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 HTTP/1.1 Oct 17 14:07:56.052167 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 14:07:56.052167 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 14:07:56.052167 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 14:07:56.052167 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 14:07:56.052167 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 14:07:56.052167 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 14:07:56.052167 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 14:07:56.052167 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 14:07:56.052167 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTWAO_VmGva_BBT15wpCNnvALuvGOjT_SoMW3_Vm1bhAQtak3XB07mRAdCJ_wnCBHoN-a-s8oUf5FPUuQgdWnRliezSs4oZuT0viWVzkCyaLn2Yap1hTnnKbQ24FaQvsntpgmAcOy_-tJg5P1ZlCE29U0SXLNIrlJqLSqx_JACEZ6IFs Oct 17 14:07:56.052167 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 14:07:56.052167 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 14:07:56.052167 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 14:07:56.052167 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 14:07:56.052167 n-d-854247-14 devstack@n-api.service[127016]: X-Openstack-Nova-Api-Version: 2.20 Oct 17 14:07:56.052167 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 14:07:56.052167 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 14:07:56.052167 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 6dcc0bf813dc4a4fa2fd7d6f5521ae85 Oct 17 14:07:56.052167 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1066178867 Oct 17 14:07:56.052167 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 14:07:56.052167 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 14:07:56.052167 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6dcc0bf813dc4a4fa2fd7d6f5521ae85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6dcc0bf813dc4a4fa2fd7d6f5521ae85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6dcc0bf813dc4a4fa2fd7d6f5521ae85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6dcc0bf813dc4a4fa2fd7d6f5521ae85", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:07:56.052167 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1066178867 Oct 17 14:07:56.052167 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 6dcc0bf813dc4a4fa2fd7d6f5521ae85 Oct 17 14:07:56.052167 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1066178867 Oct 17 14:07:56.052167 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-AttachVolumeShelveTestJSON-1066178867-project Oct 17 14:07:56.052167 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 14:07:56.052167 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 14:07:56.052167 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 9c7ac3dcc4ff4dd2bb68738c72e9507f Oct 17 14:07:56.052167 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1066178867-project Oct 17 14:07:56.052167 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 14:07:56.052167 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 86508a39-65fa-4421-b31d-ffbc5fdee565 could not be found. Oct 17 14:07:56.052167 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '86508a39-65fa-4421-b31d-ffbc5fdee565'} Oct 17 14:07:56.052167 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:07:56.052167 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:07:56.052167 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:07:56.052167 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:07:56.052167 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:07:56.052167 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:07:56.052167 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:07:56.052167 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:07:56.052167 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:07:56.052167 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:07:56.052167 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86508a39-65fa-4421-b31d-ffbc5fdee565 could not be found. Oct 17 14:07:56.052167 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:07:56.052167 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:07:56.052167 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:07:56.052167 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:07:56.052167 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:07:56.052167 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:07:56.052167 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:07:56.052167 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:07:56.052167 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:07:56.052167 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:07:56.052167 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 14:07:56.052167 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 14:07:56.052167 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 14:07:56.052167 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 14:07:56.052167 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:07:56.052167 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:07:56.052167 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:07:56.052167 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:07:56.057260 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86508a39-65fa-4421-b31d-ffbc5fdee565 could not be found. Oct 17 14:07:56.057260 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:07:56.057260 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:07:56.057260 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:07:56.057260 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:07:56.057260 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:07:56.057260 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:07:56.057260 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:07:56.057260 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:07:56.057260 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86508a39-65fa-4421-b31d-ffbc5fdee565 could not be found. Oct 17 14:07:56.057260 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:07:56.057260 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-436d5cc7-5311-48f8-a066-d2923cf334e8 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Returning 404 to user: Instance 86508a39-65fa-4421-b31d-ffbc5fdee565 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:07:56.057260 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-436d5cc7-5311-48f8-a066-d2923cf334e8 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "DELETE /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 404 len: 111 microversion: 2.20 time: 0.097636 Oct 17 14:07:56.062941 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2831/5530] 10.222.0.79 () {60 vars in 1280 bytes} [Mon Oct 17 14:07:55 2022] DELETE /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 14:07:56.064950 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-24e1290b-e7e5-42a9-83d7-b89d6b1581e2 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:56.065570 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-24e1290b-e7e5-42a9-83d7-b89d6b1581e2 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] [instance: 86508a39-65fa-4421-b31d-ffbc5fdee565] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:56.086099 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-24e1290b-e7e5-42a9-83d7-b89d6b1581e2 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:56.134451 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-24e1290b-e7e5-42a9-83d7-b89d6b1581e2 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:56.135226 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-24e1290b-e7e5-42a9-83d7-b89d6b1581e2 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.048s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:56.136015 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-24e1290b-e7e5-42a9-83d7-b89d6b1581e2 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:56.136495 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-24e1290b-e7e5-42a9-83d7-b89d6b1581e2 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:56.136926 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-24e1290b-e7e5-42a9-83d7-b89d6b1581e2 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:56.176140 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-24e1290b-e7e5-42a9-83d7-b89d6b1581e2 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] HTTP exception thrown: Instance 86508a39-65fa-4421-b31d-ffbc5fdee565 could not be found. Oct 17 14:07:56.178381 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-24e1290b-e7e5-42a9-83d7-b89d6b1581e2 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Request method failure captured: Oct 17 14:07:56.178381 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 HTTP/1.1 Oct 17 14:07:56.178381 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 14:07:56.178381 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 14:07:56.178381 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 14:07:56.178381 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 14:07:56.178381 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 14:07:56.178381 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 14:07:56.178381 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 14:07:56.178381 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 14:07:56.178381 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTWAO_VmGva_BBT15wpCNnvALuvGOjT_SoMW3_Vm1bhAQtak3XB07mRAdCJ_wnCBHoN-a-s8oUf5FPUuQgdWnRliezSs4oZuT0viWVzkCyaLn2Yap1hTnnKbQ24FaQvsntpgmAcOy_-tJg5P1ZlCE29U0SXLNIrlJqLSqx_JACEZ6IFs Oct 17 14:07:56.178381 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 14:07:56.178381 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 14:07:56.178381 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 14:07:56.178381 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 14:07:56.178381 n-d-854247-14 devstack@n-api.service[127017]: X-Openstack-Nova-Api-Version: 2.20 Oct 17 14:07:56.178381 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 14:07:56.178381 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 14:07:56.178381 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 6dcc0bf813dc4a4fa2fd7d6f5521ae85 Oct 17 14:07:56.178381 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1066178867 Oct 17 14:07:56.178381 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 14:07:56.178381 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 14:07:56.178381 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6dcc0bf813dc4a4fa2fd7d6f5521ae85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6dcc0bf813dc4a4fa2fd7d6f5521ae85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6dcc0bf813dc4a4fa2fd7d6f5521ae85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6dcc0bf813dc4a4fa2fd7d6f5521ae85", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:07:56.178381 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1066178867 Oct 17 14:07:56.178381 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 6dcc0bf813dc4a4fa2fd7d6f5521ae85 Oct 17 14:07:56.178381 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1066178867 Oct 17 14:07:56.178381 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-AttachVolumeShelveTestJSON-1066178867-project Oct 17 14:07:56.178381 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 14:07:56.178381 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 14:07:56.178381 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 9c7ac3dcc4ff4dd2bb68738c72e9507f Oct 17 14:07:56.178381 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1066178867-project Oct 17 14:07:56.178381 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 14:07:56.178381 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 86508a39-65fa-4421-b31d-ffbc5fdee565 could not be found. Oct 17 14:07:56.178381 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '86508a39-65fa-4421-b31d-ffbc5fdee565'} Oct 17 14:07:56.178381 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:07:56.178381 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:07:56.178381 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:07:56.178381 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:07:56.178381 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:07:56.178381 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:07:56.178381 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:07:56.178381 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:07:56.178381 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:07:56.178381 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:07:56.178381 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86508a39-65fa-4421-b31d-ffbc5fdee565 could not be found. Oct 17 14:07:56.178381 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:07:56.178381 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:07:56.178381 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:07:56.178381 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:07:56.178381 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:07:56.178381 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:07:56.178381 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:07:56.178381 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:07:56.178381 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:07:56.178381 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:07:56.178381 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:07:56.178381 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:07:56.178381 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:07:56.178381 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:07:56.178381 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:07:56.178381 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:07:56.178381 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86508a39-65fa-4421-b31d-ffbc5fdee565 could not be found. Oct 17 14:07:56.178381 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:07:56.178381 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:07:56.183742 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:07:56.183742 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:07:56.183742 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:07:56.183742 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:07:56.183742 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:07:56.183742 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:07:56.183742 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86508a39-65fa-4421-b31d-ffbc5fdee565 could not be found. Oct 17 14:07:56.183742 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:07:56.187066 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-24e1290b-e7e5-42a9-83d7-b89d6b1581e2 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] Returning 404 to user: Instance 86508a39-65fa-4421-b31d-ffbc5fdee565 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:07:56.188417 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-24e1290b-e7e5-42a9-83d7-b89d6b1581e2 tempest-AttachVolumeShelveTestJSON-1066178867 tempest-AttachVolumeShelveTestJSON-1066178867-project] 10.222.0.79 "GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565" status: 404 len: 111 microversion: 2.20 time: 0.127936 Oct 17 14:07:56.189669 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2700/5531] 10.222.0.79 () {60 vars in 1277 bytes} [Mon Oct 17 14:07:56 2022] GET /compute/v2.1/servers/86508a39-65fa-4421-b31d-ffbc5fdee565 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 14:08:14.574238 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-31d9e949-49c5-43f0-9e0e-42be339cfb99 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1513813278", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:08:14.622644 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:08:14.632126 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=13 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:08:14.671264 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-31d9e949-49c5-43f0-9e0e-42be339cfb99 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] validate_networks() for None {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:08:15.077969 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-31d9e949-49c5-43f0-9e0e-42be339cfb99 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:08:15.078767 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-31d9e949-49c5-43f0-9e0e-42be339cfb99 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:08:15.080909 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-31d9e949-49c5-43f0-9e0e-42be339cfb99 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:08:15.081586 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-31d9e949-49c5-43f0-9e0e-42be339cfb99 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:08:15.082264 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-31d9e949-49c5-43f0-9e0e-42be339cfb99 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:08:15.110424 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-31d9e949-49c5-43f0-9e0e-42be339cfb99 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:15.113899 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-31d9e949-49c5-43f0-9e0e-42be339cfb99 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:15.115863 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-31d9e949-49c5-43f0-9e0e-42be339cfb99 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:15.116883 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-31d9e949-49c5-43f0-9e0e-42be339cfb99 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:15.118098 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-31d9e949-49c5-43f0-9e0e-42be339cfb99 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:15.123278 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-31d9e949-49c5-43f0-9e0e-42be339cfb99 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:15.204730 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-31d9e949-49c5-43f0-9e0e-42be339cfb99 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Getting quotas for project 1faa883b2ab14ed881469dece627a213. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:08:15.204730 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-31d9e949-49c5-43f0-9e0e-42be339cfb99 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Getting quotas for user 4272c7d95cdd4390bdcbb07509370520 and project 1faa883b2ab14ed881469dece627a213. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:08:15.229844 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-31d9e949-49c5-43f0-9e0e-42be339cfb99 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:08:15.236411 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-31d9e949-49c5-43f0-9e0e-42be339cfb99 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] [instance: 3dfd3280-debb-4924-b9ac-af6178f0a601] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:08:15.334137 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-31d9e949-49c5-43f0-9e0e-42be339cfb99 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.764201 Oct 17 14:08:15.337528 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2832/5532] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 14:08:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:08:15.347922 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7435d2b6-9f4e-4686-b0bf-f8a65b804c96 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:08:15.349275 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7435d2b6-9f4e-4686-b0bf-f8a65b804c96 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] [instance: 3dfd3280-debb-4924-b9ac-af6178f0a601] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:08:15.370537 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:08:15.373135 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:08:15.595837 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7435d2b6-9f4e-4686-b0bf-f8a65b804c96 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4272c7d95cdd4390bdcbb07509370520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1faa883b2ab14ed881469dece627a213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:08:15.615627 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7435d2b6-9f4e-4686-b0bf-f8a65b804c96 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] 10.222.0.79 "GET /compute/v2.1/servers/3dfd3280-debb-4924-b9ac-af6178f0a601" status: 200 len: 1215 microversion: 2.1 time: 0.272002 Oct 17 14:08:15.616303 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2701/5533] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:08:15 2022] GET /compute/v2.1/servers/3dfd3280-debb-4924-b9ac-af6178f0a601 => generated 1215 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:08:16.652332 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-52d09cf0-d736-4046-a8b0-0c949961b99b tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:08:16.653760 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-52d09cf0-d736-4046-a8b0-0c949961b99b tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] [instance: 3dfd3280-debb-4924-b9ac-af6178f0a601] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:08:16.780632 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-52d09cf0-d736-4046-a8b0-0c949961b99b tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4272c7d95cdd4390bdcbb07509370520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1faa883b2ab14ed881469dece627a213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:08:16.795076 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-52d09cf0-d736-4046-a8b0-0c949961b99b tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] 10.222.0.79 "GET /compute/v2.1/servers/3dfd3280-debb-4924-b9ac-af6178f0a601" status: 200 len: 1215 microversion: 2.1 time: 0.152605 Oct 17 14:08:16.797451 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2833/5534] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:08:16 2022] GET /compute/v2.1/servers/3dfd3280-debb-4924-b9ac-af6178f0a601 => generated 1215 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:08:17.824223 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ed49eedc-a65e-4b09-9cbd-911e56fe15e5 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:08:17.825745 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ed49eedc-a65e-4b09-9cbd-911e56fe15e5 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] [instance: 3dfd3280-debb-4924-b9ac-af6178f0a601] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:08:17.940545 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ed49eedc-a65e-4b09-9cbd-911e56fe15e5 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4272c7d95cdd4390bdcbb07509370520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1faa883b2ab14ed881469dece627a213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:08:17.954844 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ed49eedc-a65e-4b09-9cbd-911e56fe15e5 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] 10.222.0.79 "GET /compute/v2.1/servers/3dfd3280-debb-4924-b9ac-af6178f0a601" status: 200 len: 1215 microversion: 2.1 time: 0.131747 Oct 17 14:08:17.958167 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2702/5535] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:08:17 2022] GET /compute/v2.1/servers/3dfd3280-debb-4924-b9ac-af6178f0a601 => generated 1215 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:08:18.986719 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e7d5ea75-99dc-46df-b9ec-35f90958c7b5 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:08:18.987518 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e7d5ea75-99dc-46df-b9ec-35f90958c7b5 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] [instance: 3dfd3280-debb-4924-b9ac-af6178f0a601] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:08:19.002359 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7d5ea75-99dc-46df-b9ec-35f90958c7b5 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:19.004040 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7d5ea75-99dc-46df-b9ec-35f90958c7b5 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:19.004665 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7d5ea75-99dc-46df-b9ec-35f90958c7b5 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:19.005739 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7d5ea75-99dc-46df-b9ec-35f90958c7b5 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:19.006314 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7d5ea75-99dc-46df-b9ec-35f90958c7b5 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:19.009708 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7d5ea75-99dc-46df-b9ec-35f90958c7b5 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:19.245018 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e7d5ea75-99dc-46df-b9ec-35f90958c7b5 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4272c7d95cdd4390bdcbb07509370520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1faa883b2ab14ed881469dece627a213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:08:19.292312 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e7d5ea75-99dc-46df-b9ec-35f90958c7b5 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] 10.222.0.79 "GET /compute/v2.1/servers/3dfd3280-debb-4924-b9ac-af6178f0a601" status: 200 len: 1211 microversion: 2.1 time: 0.318124 Oct 17 14:08:19.307197 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2834/5536] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:08:18 2022] GET /compute/v2.1/servers/3dfd3280-debb-4924-b9ac-af6178f0a601 => generated 1211 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:08:20.318407 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-11c2402c-0cfb-4f12-b3fd-a7c00a8368b5 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:08:20.319019 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-11c2402c-0cfb-4f12-b3fd-a7c00a8368b5 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] [instance: 3dfd3280-debb-4924-b9ac-af6178f0a601] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:08:20.333812 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-11c2402c-0cfb-4f12-b3fd-a7c00a8368b5 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:20.336849 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-11c2402c-0cfb-4f12-b3fd-a7c00a8368b5 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:20.337015 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-11c2402c-0cfb-4f12-b3fd-a7c00a8368b5 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:20.340125 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-11c2402c-0cfb-4f12-b3fd-a7c00a8368b5 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:20.341003 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-11c2402c-0cfb-4f12-b3fd-a7c00a8368b5 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:20.342502 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-11c2402c-0cfb-4f12-b3fd-a7c00a8368b5 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:20.529383 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-11c2402c-0cfb-4f12-b3fd-a7c00a8368b5 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4272c7d95cdd4390bdcbb07509370520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1faa883b2ab14ed881469dece627a213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:08:20.537748 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-11c2402c-0cfb-4f12-b3fd-a7c00a8368b5 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] 10.222.0.79 "GET /compute/v2.1/servers/3dfd3280-debb-4924-b9ac-af6178f0a601" status: 200 len: 1273 microversion: 2.1 time: 0.224636 Oct 17 14:08:20.542500 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2703/5537] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:08:20 2022] GET /compute/v2.1/servers/3dfd3280-debb-4924-b9ac-af6178f0a601 => generated 1273 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:08:21.568770 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4cede95e-8134-4213-8da1-fcc391673ff1 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:08:21.569710 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4cede95e-8134-4213-8da1-fcc391673ff1 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] [instance: 3dfd3280-debb-4924-b9ac-af6178f0a601] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:08:21.585030 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4cede95e-8134-4213-8da1-fcc391673ff1 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:21.587783 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4cede95e-8134-4213-8da1-fcc391673ff1 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:21.588266 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4cede95e-8134-4213-8da1-fcc391673ff1 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:21.589016 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4cede95e-8134-4213-8da1-fcc391673ff1 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:21.592099 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4cede95e-8134-4213-8da1-fcc391673ff1 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:21.594635 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4cede95e-8134-4213-8da1-fcc391673ff1 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:22.389940 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4cede95e-8134-4213-8da1-fcc391673ff1 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4272c7d95cdd4390bdcbb07509370520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1faa883b2ab14ed881469dece627a213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:08:22.403881 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4cede95e-8134-4213-8da1-fcc391673ff1 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] 10.222.0.79 "GET /compute/v2.1/servers/3dfd3280-debb-4924-b9ac-af6178f0a601" status: 200 len: 1315 microversion: 2.1 time: 0.841001 Oct 17 14:08:22.407253 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2835/5538] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:08:21 2022] GET /compute/v2.1/servers/3dfd3280-debb-4924-b9ac-af6178f0a601 => generated 1315 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:08:23.433960 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3179d746-f304-4d23-972d-cc16f912fe03 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:08:23.433960 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3179d746-f304-4d23-972d-cc16f912fe03 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] [instance: 3dfd3280-debb-4924-b9ac-af6178f0a601] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:08:23.443567 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3179d746-f304-4d23-972d-cc16f912fe03 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:23.444876 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3179d746-f304-4d23-972d-cc16f912fe03 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:23.446984 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3179d746-f304-4d23-972d-cc16f912fe03 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:23.449972 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3179d746-f304-4d23-972d-cc16f912fe03 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:23.450810 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3179d746-f304-4d23-972d-cc16f912fe03 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:23.451384 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3179d746-f304-4d23-972d-cc16f912fe03 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:24.082384 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3179d746-f304-4d23-972d-cc16f912fe03 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4272c7d95cdd4390bdcbb07509370520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1faa883b2ab14ed881469dece627a213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:08:24.097213 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3179d746-f304-4d23-972d-cc16f912fe03 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] 10.222.0.79 "GET /compute/v2.1/servers/3dfd3280-debb-4924-b9ac-af6178f0a601" status: 200 len: 1315 microversion: 2.1 time: 0.671953 Oct 17 14:08:24.098732 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2704/5539] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:08:23 2022] GET /compute/v2.1/servers/3dfd3280-debb-4924-b9ac-af6178f0a601 => generated 1315 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:08:24.592188 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-7e00427d-5cae-497a-89af-6d7ad8db0d34 req-4cd6916a-9d30-412a-a867-eae4031617b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dfd3280-debb-4924-b9ac-af6178f0a601", "tag": "23ffd3ec-b0e0-4e9f-8859-c22e8fc469dd"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:08:24.630802 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-7e00427d-5cae-497a-89af-6d7ad8db0d34 req-4cd6916a-9d30-412a-a867-eae4031617b4 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:24.631742 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-7e00427d-5cae-497a-89af-6d7ad8db0d34 req-4cd6916a-9d30-412a-a867-eae4031617b4 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:24.632675 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-7e00427d-5cae-497a-89af-6d7ad8db0d34 req-4cd6916a-9d30-412a-a867-eae4031617b4 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:24.679798 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-7e00427d-5cae-497a-89af-6d7ad8db0d34 req-4cd6916a-9d30-412a-a867-eae4031617b4 service nova] Creating event network-changed:23ffd3ec-b0e0-4e9f-8859-c22e8fc469dd for instance 3dfd3280-debb-4924-b9ac-af6178f0a601 on n-h2-854247-14 Oct 17 14:08:24.690037 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-7e00427d-5cae-497a-89af-6d7ad8db0d34 req-4cd6916a-9d30-412a-a867-eae4031617b4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107285 Oct 17 14:08:24.692910 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2836/5540] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:08:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:08:25.121079 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-85523966-14c6-4395-8af0-c38fcb927d67 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:08:25.122504 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-85523966-14c6-4395-8af0-c38fcb927d67 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] [instance: 3dfd3280-debb-4924-b9ac-af6178f0a601] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:08:25.138871 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-85523966-14c6-4395-8af0-c38fcb927d67 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:25.139769 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-85523966-14c6-4395-8af0-c38fcb927d67 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:25.140622 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-85523966-14c6-4395-8af0-c38fcb927d67 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:25.141510 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-85523966-14c6-4395-8af0-c38fcb927d67 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:25.142105 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-85523966-14c6-4395-8af0-c38fcb927d67 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:25.142698 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-85523966-14c6-4395-8af0-c38fcb927d67 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:25.690351 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-85523966-14c6-4395-8af0-c38fcb927d67 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4272c7d95cdd4390bdcbb07509370520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1faa883b2ab14ed881469dece627a213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:08:25.700728 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-85523966-14c6-4395-8af0-c38fcb927d67 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] 10.222.0.79 "GET /compute/v2.1/servers/3dfd3280-debb-4924-b9ac-af6178f0a601" status: 200 len: 1315 microversion: 2.1 time: 0.583541 Oct 17 14:08:25.702689 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2705/5541] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:08:25 2022] GET /compute/v2.1/servers/3dfd3280-debb-4924-b9ac-af6178f0a601 => generated 1315 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:08:26.735793 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-25e65d95-082d-4d2c-bac6-2aa2d7314971 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:08:26.737066 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-25e65d95-082d-4d2c-bac6-2aa2d7314971 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] [instance: 3dfd3280-debb-4924-b9ac-af6178f0a601] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:08:26.743744 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:08:26.746851 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-25e65d95-082d-4d2c-bac6-2aa2d7314971 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:26.747576 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-25e65d95-082d-4d2c-bac6-2aa2d7314971 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:26.748195 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-25e65d95-082d-4d2c-bac6-2aa2d7314971 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:26.749335 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-25e65d95-082d-4d2c-bac6-2aa2d7314971 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:26.749975 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-25e65d95-082d-4d2c-bac6-2aa2d7314971 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:26.750594 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-25e65d95-082d-4d2c-bac6-2aa2d7314971 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:26.813184 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=8 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:08:27.296359 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-25e65d95-082d-4d2c-bac6-2aa2d7314971 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4272c7d95cdd4390bdcbb07509370520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1faa883b2ab14ed881469dece627a213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:08:27.317397 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-25e65d95-082d-4d2c-bac6-2aa2d7314971 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] 10.222.0.79 "GET /compute/v2.1/servers/3dfd3280-debb-4924-b9ac-af6178f0a601" status: 200 len: 1315 microversion: 2.1 time: 0.587015 Oct 17 14:08:27.318231 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2837/5542] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:08:26 2022] GET /compute/v2.1/servers/3dfd3280-debb-4924-b9ac-af6178f0a601 => generated 1315 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:08:28.350111 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f131ccd5-ddb0-4654-b599-e94b944d6c5f tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:08:28.350645 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f131ccd5-ddb0-4654-b599-e94b944d6c5f tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] [instance: 3dfd3280-debb-4924-b9ac-af6178f0a601] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:08:28.361811 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=4 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:08:28.365943 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f131ccd5-ddb0-4654-b599-e94b944d6c5f tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:28.366458 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f131ccd5-ddb0-4654-b599-e94b944d6c5f tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:28.366888 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f131ccd5-ddb0-4654-b599-e94b944d6c5f tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:28.370693 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f131ccd5-ddb0-4654-b599-e94b944d6c5f tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:28.374745 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f131ccd5-ddb0-4654-b599-e94b944d6c5f tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:28.375463 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f131ccd5-ddb0-4654-b599-e94b944d6c5f tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:28.669908 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f131ccd5-ddb0-4654-b599-e94b944d6c5f tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4272c7d95cdd4390bdcbb07509370520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1faa883b2ab14ed881469dece627a213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:08:28.684874 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f131ccd5-ddb0-4654-b599-e94b944d6c5f tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] 10.222.0.79 "GET /compute/v2.1/servers/3dfd3280-debb-4924-b9ac-af6178f0a601" status: 200 len: 1315 microversion: 2.1 time: 0.338639 Oct 17 14:08:28.686371 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2706/5543] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:08:28 2022] GET /compute/v2.1/servers/3dfd3280-debb-4924-b9ac-af6178f0a601 => generated 1315 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:08:29.709696 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8dd76669-fe38-4690-85d9-8ae9e1f11c46 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:08:29.710982 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8dd76669-fe38-4690-85d9-8ae9e1f11c46 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] [instance: 3dfd3280-debb-4924-b9ac-af6178f0a601] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:08:29.728375 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8dd76669-fe38-4690-85d9-8ae9e1f11c46 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:29.729313 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8dd76669-fe38-4690-85d9-8ae9e1f11c46 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:29.730804 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8dd76669-fe38-4690-85d9-8ae9e1f11c46 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:29.733251 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8dd76669-fe38-4690-85d9-8ae9e1f11c46 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:29.735587 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8dd76669-fe38-4690-85d9-8ae9e1f11c46 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:29.738934 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8dd76669-fe38-4690-85d9-8ae9e1f11c46 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:30.284394 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8dd76669-fe38-4690-85d9-8ae9e1f11c46 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4272c7d95cdd4390bdcbb07509370520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1faa883b2ab14ed881469dece627a213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:08:30.294646 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8dd76669-fe38-4690-85d9-8ae9e1f11c46 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] 10.222.0.79 "GET /compute/v2.1/servers/3dfd3280-debb-4924-b9ac-af6178f0a601" status: 200 len: 1315 microversion: 2.1 time: 0.590003 Oct 17 14:08:30.295664 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2838/5544] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:08:29 2022] GET /compute/v2.1/servers/3dfd3280-debb-4924-b9ac-af6178f0a601 => generated 1315 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:08:31.320904 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ed9d6a18-5bbe-44ba-a865-f7561e05df3f tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:08:31.322890 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ed9d6a18-5bbe-44ba-a865-f7561e05df3f tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] [instance: 3dfd3280-debb-4924-b9ac-af6178f0a601] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:08:31.336667 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ed9d6a18-5bbe-44ba-a865-f7561e05df3f tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:31.337566 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ed9d6a18-5bbe-44ba-a865-f7561e05df3f tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:31.338378 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ed9d6a18-5bbe-44ba-a865-f7561e05df3f tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:31.339233 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ed9d6a18-5bbe-44ba-a865-f7561e05df3f tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:31.340413 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ed9d6a18-5bbe-44ba-a865-f7561e05df3f tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:31.342412 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ed9d6a18-5bbe-44ba-a865-f7561e05df3f tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:31.691748 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ed9d6a18-5bbe-44ba-a865-f7561e05df3f tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4272c7d95cdd4390bdcbb07509370520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1faa883b2ab14ed881469dece627a213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:08:31.702502 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ed9d6a18-5bbe-44ba-a865-f7561e05df3f tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] 10.222.0.79 "GET /compute/v2.1/servers/3dfd3280-debb-4924-b9ac-af6178f0a601" status: 200 len: 1315 microversion: 2.1 time: 0.386577 Oct 17 14:08:31.706077 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2707/5545] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:08:31 2022] GET /compute/v2.1/servers/3dfd3280-debb-4924-b9ac-af6178f0a601 => generated 1315 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:08:31.820493 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-f9e7edb9-d451-47d8-a78c-0c0c4ba61bd2 req-dc31a950-e79e-481a-87ef-b8e58bff7abc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dfd3280-debb-4924-b9ac-af6178f0a601", "name": "network-vif-plugged", "status": "completed", "tag": "23ffd3ec-b0e0-4e9f-8859-c22e8fc469dd"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:08:31.843048 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-f9e7edb9-d451-47d8-a78c-0c0c4ba61bd2 req-dc31a950-e79e-481a-87ef-b8e58bff7abc service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:31.843882 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-f9e7edb9-d451-47d8-a78c-0c0c4ba61bd2 req-dc31a950-e79e-481a-87ef-b8e58bff7abc service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:31.844906 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-f9e7edb9-d451-47d8-a78c-0c0c4ba61bd2 req-dc31a950-e79e-481a-87ef-b8e58bff7abc service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:31.862552 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-f9e7edb9-d451-47d8-a78c-0c0c4ba61bd2 req-dc31a950-e79e-481a-87ef-b8e58bff7abc service nova] Creating event network-vif-plugged:23ffd3ec-b0e0-4e9f-8859-c22e8fc469dd for instance 3dfd3280-debb-4924-b9ac-af6178f0a601 on n-h2-854247-14 Oct 17 14:08:31.870768 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-f9e7edb9-d451-47d8-a78c-0c0c4ba61bd2 req-dc31a950-e79e-481a-87ef-b8e58bff7abc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056956 Oct 17 14:08:31.872146 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2839/5546] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:08:32.728439 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8ac75889-7ed4-4758-9122-77856901442a tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:08:32.729064 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8ac75889-7ed4-4758-9122-77856901442a tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] [instance: 3dfd3280-debb-4924-b9ac-af6178f0a601] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:08:32.741431 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8ac75889-7ed4-4758-9122-77856901442a tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:32.743150 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8ac75889-7ed4-4758-9122-77856901442a tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:32.743150 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8ac75889-7ed4-4758-9122-77856901442a tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:32.751190 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8ac75889-7ed4-4758-9122-77856901442a tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:32.751999 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8ac75889-7ed4-4758-9122-77856901442a tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:32.752583 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8ac75889-7ed4-4758-9122-77856901442a tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:33.226017 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8ac75889-7ed4-4758-9122-77856901442a tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4272c7d95cdd4390bdcbb07509370520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1faa883b2ab14ed881469dece627a213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:08:33.243533 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8ac75889-7ed4-4758-9122-77856901442a tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] 10.222.0.79 "GET /compute/v2.1/servers/3dfd3280-debb-4924-b9ac-af6178f0a601" status: 200 len: 1315 microversion: 2.1 time: 0.518802 Oct 17 14:08:33.264409 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2708/5547] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:08:32 2022] GET /compute/v2.1/servers/3dfd3280-debb-4924-b9ac-af6178f0a601 => generated 1315 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:08:34.285160 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f5354e9a-0bb4-4117-93c9-7cae19c2da7c tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:08:34.287400 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f5354e9a-0bb4-4117-93c9-7cae19c2da7c tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] [instance: 3dfd3280-debb-4924-b9ac-af6178f0a601] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:08:34.305246 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f5354e9a-0bb4-4117-93c9-7cae19c2da7c tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:34.305735 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f5354e9a-0bb4-4117-93c9-7cae19c2da7c tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:34.306166 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f5354e9a-0bb4-4117-93c9-7cae19c2da7c tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:34.306898 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f5354e9a-0bb4-4117-93c9-7cae19c2da7c tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:34.308834 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f5354e9a-0bb4-4117-93c9-7cae19c2da7c tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:34.309430 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f5354e9a-0bb4-4117-93c9-7cae19c2da7c tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:34.680280 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f5354e9a-0bb4-4117-93c9-7cae19c2da7c tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4272c7d95cdd4390bdcbb07509370520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1faa883b2ab14ed881469dece627a213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:08:34.701343 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f5354e9a-0bb4-4117-93c9-7cae19c2da7c tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] 10.222.0.79 "GET /compute/v2.1/servers/3dfd3280-debb-4924-b9ac-af6178f0a601" status: 200 len: 1464 microversion: 2.1 time: 0.434405 Oct 17 14:08:34.702267 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2840/5548] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:08:34 2022] GET /compute/v2.1/servers/3dfd3280-debb-4924-b9ac-af6178f0a601 => generated 1464 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:08:34.782416 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ee24a1bd-5992-45e0-8b7d-422969ddfda7 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:08:34.783687 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ee24a1bd-5992-45e0-8b7d-422969ddfda7 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] [instance: 3dfd3280-debb-4924-b9ac-af6178f0a601] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:08:34.794243 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ee24a1bd-5992-45e0-8b7d-422969ddfda7 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:34.795094 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ee24a1bd-5992-45e0-8b7d-422969ddfda7 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:34.795829 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ee24a1bd-5992-45e0-8b7d-422969ddfda7 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:34.796870 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ee24a1bd-5992-45e0-8b7d-422969ddfda7 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:34.797533 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ee24a1bd-5992-45e0-8b7d-422969ddfda7 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:34.798424 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ee24a1bd-5992-45e0-8b7d-422969ddfda7 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:34.890486 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ee24a1bd-5992-45e0-8b7d-422969ddfda7 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] [instance: 3dfd3280-debb-4924-b9ac-af6178f0a601] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:08:35.063693 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ee24a1bd-5992-45e0-8b7d-422969ddfda7 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3dfd3280-debb-4924-b9ac-af6178f0a601" status: 204 len: 0 microversion: 2.1 time: 0.286135 Oct 17 14:08:35.066438 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2709/5549] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:08:34 2022] DELETE /compute/v2.1/servers/3dfd3280-debb-4924-b9ac-af6178f0a601 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:08:35.075280 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c98a2a6b-85d1-4d48-ad54-930f779e7876 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:08:35.076168 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c98a2a6b-85d1-4d48-ad54-930f779e7876 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] [instance: 3dfd3280-debb-4924-b9ac-af6178f0a601] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:08:35.089356 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c98a2a6b-85d1-4d48-ad54-930f779e7876 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:35.089865 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c98a2a6b-85d1-4d48-ad54-930f779e7876 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:35.090308 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c98a2a6b-85d1-4d48-ad54-930f779e7876 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:35.094236 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c98a2a6b-85d1-4d48-ad54-930f779e7876 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:35.095417 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c98a2a6b-85d1-4d48-ad54-930f779e7876 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:35.098017 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c98a2a6b-85d1-4d48-ad54-930f779e7876 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:35.722144 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c98a2a6b-85d1-4d48-ad54-930f779e7876 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4272c7d95cdd4390bdcbb07509370520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1faa883b2ab14ed881469dece627a213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:08:35.730132 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c98a2a6b-85d1-4d48-ad54-930f779e7876 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] 10.222.0.79 "GET /compute/v2.1/servers/3dfd3280-debb-4924-b9ac-af6178f0a601" status: 200 len: 1470 microversion: 2.1 time: 0.659338 Oct 17 14:08:35.735878 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2841/5550] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:08:35 2022] GET /compute/v2.1/servers/3dfd3280-debb-4924-b9ac-af6178f0a601 => generated 1470 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:08:36.766547 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-556193a7-fe8c-4aa8-8575-24d9bf7b0b4f tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:08:36.767239 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-556193a7-fe8c-4aa8-8575-24d9bf7b0b4f tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] [instance: 3dfd3280-debb-4924-b9ac-af6178f0a601] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:08:36.779578 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-556193a7-fe8c-4aa8-8575-24d9bf7b0b4f tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:36.780114 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-556193a7-fe8c-4aa8-8575-24d9bf7b0b4f tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:36.780803 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-556193a7-fe8c-4aa8-8575-24d9bf7b0b4f tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:36.781769 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-556193a7-fe8c-4aa8-8575-24d9bf7b0b4f tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:36.785810 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-556193a7-fe8c-4aa8-8575-24d9bf7b0b4f tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:36.794576 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-556193a7-fe8c-4aa8-8575-24d9bf7b0b4f tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:38.118576 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-556193a7-fe8c-4aa8-8575-24d9bf7b0b4f tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4272c7d95cdd4390bdcbb07509370520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1faa883b2ab14ed881469dece627a213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:08:38.132091 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-556193a7-fe8c-4aa8-8575-24d9bf7b0b4f tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] 10.222.0.79 "GET /compute/v2.1/servers/3dfd3280-debb-4924-b9ac-af6178f0a601" status: 200 len: 1470 microversion: 2.1 time: 1.375270 Oct 17 14:08:38.147690 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2710/5551] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:08:36 2022] GET /compute/v2.1/servers/3dfd3280-debb-4924-b9ac-af6178f0a601 => generated 1470 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:08:38.491356 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-ed2caf5e-4bba-4b89-b5a7-73a58a7e1e0e req-fba04095-f9f7-4c73-bbd3-74b265936233 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dfd3280-debb-4924-b9ac-af6178f0a601", "name": "network-vif-deleted", "tag": "23ffd3ec-b0e0-4e9f-8859-c22e8fc469dd"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:08:38.505736 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-ed2caf5e-4bba-4b89-b5a7-73a58a7e1e0e req-fba04095-f9f7-4c73-bbd3-74b265936233 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:38.506476 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-ed2caf5e-4bba-4b89-b5a7-73a58a7e1e0e req-fba04095-f9f7-4c73-bbd3-74b265936233 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:38.507093 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-ed2caf5e-4bba-4b89-b5a7-73a58a7e1e0e req-fba04095-f9f7-4c73-bbd3-74b265936233 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:38.530217 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-ed2caf5e-4bba-4b89-b5a7-73a58a7e1e0e req-fba04095-f9f7-4c73-bbd3-74b265936233 service nova] Creating event network-vif-deleted:23ffd3ec-b0e0-4e9f-8859-c22e8fc469dd for instance 3dfd3280-debb-4924-b9ac-af6178f0a601 on n-h2-854247-14 Oct 17 14:08:38.569824 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-ed2caf5e-4bba-4b89-b5a7-73a58a7e1e0e req-fba04095-f9f7-4c73-bbd3-74b265936233 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082964 Oct 17 14:08:38.575640 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2842/5552] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:08:39.164190 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c4549a22-7204-4a5c-94cc-8d530bafd149 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:08:39.165944 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c4549a22-7204-4a5c-94cc-8d530bafd149 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] [instance: 3dfd3280-debb-4924-b9ac-af6178f0a601] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:08:39.179772 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c4549a22-7204-4a5c-94cc-8d530bafd149 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:39.182486 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c4549a22-7204-4a5c-94cc-8d530bafd149 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:39.183306 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c4549a22-7204-4a5c-94cc-8d530bafd149 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:39.184188 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c4549a22-7204-4a5c-94cc-8d530bafd149 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:39.184956 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c4549a22-7204-4a5c-94cc-8d530bafd149 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:39.185522 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c4549a22-7204-4a5c-94cc-8d530bafd149 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:39.284620 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c4549a22-7204-4a5c-94cc-8d530bafd149 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:39.286346 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c4549a22-7204-4a5c-94cc-8d530bafd149 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:39.286733 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c4549a22-7204-4a5c-94cc-8d530bafd149 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:39.287432 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-c4549a22-7204-4a5c-94cc-8d530bafd149 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lazy-loading 'fault' on Instance uuid 3dfd3280-debb-4924-b9ac-af6178f0a601 {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:08:39.383954 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c4549a22-7204-4a5c-94cc-8d530bafd149 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4272c7d95cdd4390bdcbb07509370520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1faa883b2ab14ed881469dece627a213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:08:39.396410 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c4549a22-7204-4a5c-94cc-8d530bafd149 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] 10.222.0.79 "GET /compute/v2.1/servers/3dfd3280-debb-4924-b9ac-af6178f0a601" status: 200 len: 1305 microversion: 2.1 time: 0.236478 Oct 17 14:08:39.397586 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2711/5553] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:08:39 2022] GET /compute/v2.1/servers/3dfd3280-debb-4924-b9ac-af6178f0a601 => generated 1305 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:08:40.423558 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a743f577-fd65-4aa9-bec3-e0982bdde265 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:08:40.425114 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a743f577-fd65-4aa9-bec3-e0982bdde265 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] [instance: 3dfd3280-debb-4924-b9ac-af6178f0a601] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:08:40.441004 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a743f577-fd65-4aa9-bec3-e0982bdde265 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:40.443010 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a743f577-fd65-4aa9-bec3-e0982bdde265 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:40.443581 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a743f577-fd65-4aa9-bec3-e0982bdde265 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:40.453716 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a743f577-fd65-4aa9-bec3-e0982bdde265 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:08:40.454158 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a743f577-fd65-4aa9-bec3-e0982bdde265 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:08:40.454857 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a743f577-fd65-4aa9-bec3-e0982bdde265 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:08:40.490249 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-a743f577-fd65-4aa9-bec3-e0982bdde265 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] HTTP exception thrown: Instance 3dfd3280-debb-4924-b9ac-af6178f0a601 could not be found. Oct 17 14:08:40.495970 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a743f577-fd65-4aa9-bec3-e0982bdde265 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Request method failure captured: Oct 17 14:08:40.495970 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/3dfd3280-debb-4924-b9ac-af6178f0a601 HTTP/1.1 Oct 17 14:08:40.495970 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 14:08:40.495970 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 14:08:40.495970 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 14:08:40.495970 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 14:08:40.495970 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 14:08:40.495970 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 14:08:40.495970 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 14:08:40.495970 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 14:08:40.495970 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTWHKqoVZbabxoFeThYRIIKcZKVtXCcOfiBFVfjrVAqntEGjt0homtDYMtLI4LeH3gWggVIU1PSibSQMjDVoxTaPWnjlfvopJO9M8rZo6MkL5tC3BRyqaEbkhdJuBqOyWQTaQ6Kz0KgEhnVjagSvYo5-QUNxG0cEcWM9Gu_lLug77GV8 Oct 17 14:08:40.495970 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 14:08:40.495970 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 14:08:40.495970 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 14:08:40.495970 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 14:08:40.495970 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 14:08:40.495970 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 14:08:40.495970 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 1faa883b2ab14ed881469dece627a213 Oct 17 14:08:40.495970 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-VolumesNegativeTest-818125208 Oct 17 14:08:40.495970 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 14:08:40.495970 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 14:08:40.495970 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1faa883b2ab14ed881469dece627a213"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/1faa883b2ab14ed881469dece627a213"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1faa883b2ab14ed881469dece627a213"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_1faa883b2ab14ed881469dece627a213", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:08:40.495970 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-VolumesNegativeTest-818125208 Oct 17 14:08:40.495970 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 1faa883b2ab14ed881469dece627a213 Oct 17 14:08:40.495970 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-VolumesNegativeTest-818125208 Oct 17 14:08:40.495970 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-VolumesNegativeTest-818125208-project Oct 17 14:08:40.495970 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 14:08:40.495970 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 14:08:40.495970 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 4272c7d95cdd4390bdcbb07509370520 Oct 17 14:08:40.495970 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-VolumesNegativeTest-818125208-project Oct 17 14:08:40.495970 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 14:08:40.495970 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 3dfd3280-debb-4924-b9ac-af6178f0a601 could not be found. Oct 17 14:08:40.495970 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '3dfd3280-debb-4924-b9ac-af6178f0a601'} Oct 17 14:08:40.495970 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:08:40.495970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:08:40.495970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:08:40.495970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:08:40.495970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:08:40.495970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:08:40.495970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:08:40.495970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:08:40.495970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:08:40.495970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:08:40.495970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dfd3280-debb-4924-b9ac-af6178f0a601 could not be found. Oct 17 14:08:40.495970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:08:40.495970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:08:40.495970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:08:40.495970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:08:40.495970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:08:40.495970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:08:40.495970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:08:40.495970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:08:40.495970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:08:40.495970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:08:40.495970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:08:40.495970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:08:40.495970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:08:40.495970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:08:40.495970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:08:40.495970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:08:40.495970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dfd3280-debb-4924-b9ac-af6178f0a601 could not be found. Oct 17 14:08:40.495970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:08:40.495970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:08:40.495970 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:08:40.500379 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:08:40.500379 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:08:40.500379 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:08:40.500379 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:08:40.500379 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:08:40.500379 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dfd3280-debb-4924-b9ac-af6178f0a601 could not be found. Oct 17 14:08:40.500379 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:08:40.500379 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a743f577-fd65-4aa9-bec3-e0982bdde265 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] Returning 404 to user: Instance 3dfd3280-debb-4924-b9ac-af6178f0a601 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:08:40.504207 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a743f577-fd65-4aa9-bec3-e0982bdde265 tempest-VolumesNegativeTest-818125208 tempest-VolumesNegativeTest-818125208-project] 10.222.0.79 "GET /compute/v2.1/servers/3dfd3280-debb-4924-b9ac-af6178f0a601" status: 404 len: 111 microversion: 2.1 time: 0.085357 Oct 17 14:08:40.507612 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2843/5554] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:08:40 2022] GET /compute/v2.1/servers/3dfd3280-debb-4924-b9ac-af6178f0a601 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:09:20.143159 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:09:20.143931 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:09:20.416150 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-562be095-6455-44c6-827b-88beb9405a12 tempest-PortsAdminExtendedAttrsTestJSON-1817866067 tempest-PortsAdminExtendedAttrsTestJSON-1817866067-project-admin] Calling method '.version_select at 0x7f7cd98d0790>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:09:20.418362 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-562be095-6455-44c6-827b-88beb9405a12 tempest-PortsAdminExtendedAttrsTestJSON-1817866067 tempest-PortsAdminExtendedAttrsTestJSON-1817866067-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:20.418856 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-562be095-6455-44c6-827b-88beb9405a12 tempest-PortsAdminExtendedAttrsTestJSON-1817866067 tempest-PortsAdminExtendedAttrsTestJSON-1817866067-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:20.419331 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-562be095-6455-44c6-827b-88beb9405a12 tempest-PortsAdminExtendedAttrsTestJSON-1817866067 tempest-PortsAdminExtendedAttrsTestJSON-1817866067-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:20.447875 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-562be095-6455-44c6-827b-88beb9405a12 tempest-PortsAdminExtendedAttrsTestJSON-1817866067 tempest-PortsAdminExtendedAttrsTestJSON-1817866067-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:20.448367 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-562be095-6455-44c6-827b-88beb9405a12 tempest-PortsAdminExtendedAttrsTestJSON-1817866067 tempest-PortsAdminExtendedAttrsTestJSON-1817866067-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:20.448801 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-562be095-6455-44c6-827b-88beb9405a12 tempest-PortsAdminExtendedAttrsTestJSON-1817866067 tempest-PortsAdminExtendedAttrsTestJSON-1817866067-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:20.467267 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-562be095-6455-44c6-827b-88beb9405a12 tempest-PortsAdminExtendedAttrsTestJSON-1817866067 tempest-PortsAdminExtendedAttrsTestJSON-1817866067-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:20.467924 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-562be095-6455-44c6-827b-88beb9405a12 tempest-PortsAdminExtendedAttrsTestJSON-1817866067 tempest-PortsAdminExtendedAttrsTestJSON-1817866067-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:20.468426 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-562be095-6455-44c6-827b-88beb9405a12 tempest-PortsAdminExtendedAttrsTestJSON-1817866067 tempest-PortsAdminExtendedAttrsTestJSON-1817866067-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:20.477689 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-562be095-6455-44c6-827b-88beb9405a12 tempest-PortsAdminExtendedAttrsTestJSON-1817866067 tempest-PortsAdminExtendedAttrsTestJSON-1817866067-project-admin] 10.222.0.79 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.340173 Oct 17 14:09:20.508440 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2712/5555] 10.222.0.79 () {58 vars in 1146 bytes} [Mon Oct 17 14:09:20 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:09:34.880742 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:09:34.881424 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=46 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:09:35.203483 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-00f9832c-2d3e-4485-813c-ecfc3f417be9 tempest-TestAggregatesBasicOps-1430479572 tempest-TestAggregatesBasicOps-1430479572-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1504558072", "availability_zone": "foo_zone"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:09:35.207635 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.aggregate [None req-00f9832c-2d3e-4485-813c-ecfc3f417be9 tempest-TestAggregatesBasicOps-1430479572 tempest-TestAggregatesBasicOps-1430479572-project-admin] Generated uuid f03bf2fb-71dd-4f5b-bf95-0731d37a325e for aggregate {{(pid=127016) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 14:09:35.210063 n-d-854247-14 devstack@n-api.service[127016]: ERROR oslo.messaging._drivers.impl_rabbit [None req-00f9832c-2d3e-4485-813c-ecfc3f417be9 tempest-TestAggregatesBasicOps-1430479572 tempest-TestAggregatesBasicOps-1430479572-project-admin] [86e7bf53-9882-42fa-9edd-bee9c5320b1e] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 14:09:36.222105 n-d-854247-14 devstack@n-api.service[127016]: INFO oslo.messaging._drivers.impl_rabbit [None req-00f9832c-2d3e-4485-813c-ecfc3f417be9 tempest-TestAggregatesBasicOps-1430479572 tempest-TestAggregatesBasicOps-1430479572-project-admin] [86e7bf53-9882-42fa-9edd-bee9c5320b1e] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 46106. Oct 17 14:09:36.278536 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-00f9832c-2d3e-4485-813c-ecfc3f417be9 tempest-TestAggregatesBasicOps-1430479572 tempest-TestAggregatesBasicOps-1430479572-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 1.403325 Oct 17 14:09:36.280255 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2844/5556] 10.222.0.79 () {60 vars in 1164 bytes} [Mon Oct 17 14:09:34 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:09:36.290512 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=4 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:09:36.293865 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=6 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:09:36.302871 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-78324a9e-5927-492f-945e-ed87ee3a636b tempest-TestAggregatesBasicOps-1430479572 tempest-TestAggregatesBasicOps-1430479572-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:09:36.344671 n-d-854247-14 devstack@n-api.service[127017]: ERROR oslo.messaging._drivers.impl_rabbit [None req-78324a9e-5927-492f-945e-ed87ee3a636b tempest-TestAggregatesBasicOps-1430479572 tempest-TestAggregatesBasicOps-1430479572-project-admin] [d638aeb8-e90f-49a1-9b7b-4e0c418c5a74] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 14:09:37.352207 n-d-854247-14 devstack@n-api.service[127017]: INFO oslo.messaging._drivers.impl_rabbit [None req-78324a9e-5927-492f-945e-ed87ee3a636b tempest-TestAggregatesBasicOps-1430479572 tempest-TestAggregatesBasicOps-1430479572-project-admin] [d638aeb8-e90f-49a1-9b7b-4e0c418c5a74] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 46154. Oct 17 14:09:37.358967 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-78324a9e-5927-492f-945e-ed87ee3a636b tempest-TestAggregatesBasicOps-1430479572 tempest-TestAggregatesBasicOps-1430479572-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 1.071150 Oct 17 14:09:37.360933 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2713/5557] 10.222.0.79 () {60 vars in 1194 bytes} [Mon Oct 17 14:09:36 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:09:37.372684 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c0802082-67db-4edf-b5d6-3e9334645c1c tempest-TestAggregatesBasicOps-1430479572 tempest-TestAggregatesBasicOps-1430479572-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:09:37.378349 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c0802082-67db-4edf-b5d6-3e9334645c1c tempest-TestAggregatesBasicOps-1430479572 tempest-TestAggregatesBasicOps-1430479572-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:37.379914 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c0802082-67db-4edf-b5d6-3e9334645c1c tempest-TestAggregatesBasicOps-1430479572 tempest-TestAggregatesBasicOps-1430479572-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:37.383988 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c0802082-67db-4edf-b5d6-3e9334645c1c tempest-TestAggregatesBasicOps-1430479572 tempest-TestAggregatesBasicOps-1430479572-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:37.385192 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c0802082-67db-4edf-b5d6-3e9334645c1c tempest-TestAggregatesBasicOps-1430479572 tempest-TestAggregatesBasicOps-1430479572-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:37.385866 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c0802082-67db-4edf-b5d6-3e9334645c1c tempest-TestAggregatesBasicOps-1430479572 tempest-TestAggregatesBasicOps-1430479572-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:37.388286 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c0802082-67db-4edf-b5d6-3e9334645c1c tempest-TestAggregatesBasicOps-1430479572 tempest-TestAggregatesBasicOps-1430479572-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:37.451012 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c0802082-67db-4edf-b5d6-3e9334645c1c tempest-TestAggregatesBasicOps-1430479572 tempest-TestAggregatesBasicOps-1430479572-project-admin] 10.222.0.79 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.082004 Oct 17 14:09:37.455385 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2845/5558] 10.222.0.79 () {58 vars in 1176 bytes} [Mon Oct 17 14:09:37 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:09:37.464034 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3b795dc1-d791-4c5c-aa51-0c82a9a86d06 tempest-TestAggregatesBasicOps-1430479572 tempest-TestAggregatesBasicOps-1430479572-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:09:37.474548 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3b795dc1-d791-4c5c-aa51-0c82a9a86d06 tempest-TestAggregatesBasicOps-1430479572 tempest-TestAggregatesBasicOps-1430479572-project-admin] 10.222.0.79 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.014116 Oct 17 14:09:37.476020 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2714/5559] 10.222.0.79 () {58 vars in 1143 bytes} [Mon Oct 17 14:09:37 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:09:37.489239 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2f4d3247-a68c-4862-8f52-9f3f3098199b tempest-TestAggregatesBasicOps-1430479572 tempest-TestAggregatesBasicOps-1430479572-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854247-14"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:09:37.508391 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2f4d3247-a68c-4862-8f52-9f3f3098199b tempest-TestAggregatesBasicOps-1430479572 tempest-TestAggregatesBasicOps-1430479572-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:37.509993 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2f4d3247-a68c-4862-8f52-9f3f3098199b tempest-TestAggregatesBasicOps-1430479572 tempest-TestAggregatesBasicOps-1430479572-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:37.510537 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2f4d3247-a68c-4862-8f52-9f3f3098199b tempest-TestAggregatesBasicOps-1430479572 tempest-TestAggregatesBasicOps-1430479572-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:38.129672 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2f4d3247-a68c-4862-8f52-9f3f3098199b tempest-TestAggregatesBasicOps-1430479572 tempest-TestAggregatesBasicOps-1430479572-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 311 microversion: 2.1 time: 0.644945 Oct 17 14:09:38.130299 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2846/5560] 10.222.0.79 () {60 vars in 1194 bytes} [Mon Oct 17 14:09:37 2022] POST /compute/v2.1/os-aggregates/19/action => generated 311 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:09:38.147338 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-faa861b4-9a01-44d0-bb79-dc714cbede55 tempest-TestAggregatesBasicOps-1430479572 tempest-TestAggregatesBasicOps-1430479572-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:09:38.166144 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-faa861b4-9a01-44d0-bb79-dc714cbede55 tempest-TestAggregatesBasicOps-1430479572 tempest-TestAggregatesBasicOps-1430479572-project-admin] 10.222.0.79 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 311 microversion: 2.1 time: 0.027579 Oct 17 14:09:38.173504 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2715/5561] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Oct 17 14:09:38 2022] GET /compute/v2.1/os-aggregates/19 => generated 311 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:09:38.179440 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1188f11b-df64-422b-8888-d6df29aeb610 tempest-TestAggregatesBasicOps-1430479572 tempest-TestAggregatesBasicOps-1430479572-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-614799946", "availability_zone": "foo_zone"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:09:38.302831 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1188f11b-df64-422b-8888-d6df29aeb610 tempest-TestAggregatesBasicOps-1430479572 tempest-TestAggregatesBasicOps-1430479572-project-admin] 10.222.0.79 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.125654 Oct 17 14:09:38.305781 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2847/5562] 10.222.0.79 () {60 vars in 1173 bytes} [Mon Oct 17 14:09:38 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:09:38.319864 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ed2161e9-9811-4e91-b268-6457413b7d0b tempest-TestAggregatesBasicOps-1430479572 tempest-TestAggregatesBasicOps-1430479572-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:09:38.412000 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ed2161e9-9811-4e91-b268-6457413b7d0b tempest-TestAggregatesBasicOps-1430479572 tempest-TestAggregatesBasicOps-1430479572-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.099747 Oct 17 14:09:38.414193 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2716/5563] 10.222.0.79 () {60 vars in 1194 bytes} [Mon Oct 17 14:09:38 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:09:38.428679 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a7689242-b0c3-4dc9-b101-11b64bc384bc tempest-TestAggregatesBasicOps-1430479572 tempest-TestAggregatesBasicOps-1430479572-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:09:38.440756 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a7689242-b0c3-4dc9-b101-11b64bc384bc tempest-TestAggregatesBasicOps-1430479572 tempest-TestAggregatesBasicOps-1430479572-project-admin] 10.222.0.79 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.016651 Oct 17 14:09:38.448892 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2848/5564] 10.222.0.79 () {58 vars in 1152 bytes} [Mon Oct 17 14:09:38 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:09:38.464171 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-feae9837-e820-42a9-91a4-4e4912eb91ef tempest-TestAggregatesBasicOps-1430479572 tempest-TestAggregatesBasicOps-1430479572-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854247-14"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:09:38.508875 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-feae9837-e820-42a9-91a4-4e4912eb91ef tempest-TestAggregatesBasicOps-1430479572 tempest-TestAggregatesBasicOps-1430479572-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:38.515180 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-feae9837-e820-42a9-91a4-4e4912eb91ef tempest-TestAggregatesBasicOps-1430479572 tempest-TestAggregatesBasicOps-1430479572-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:38.517296 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-feae9837-e820-42a9-91a4-4e4912eb91ef tempest-TestAggregatesBasicOps-1430479572 tempest-TestAggregatesBasicOps-1430479572-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:39.075139 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-feae9837-e820-42a9-91a4-4e4912eb91ef tempest-TestAggregatesBasicOps-1430479572 tempest-TestAggregatesBasicOps-1430479572-project-admin] 10.222.0.79 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.621695 Oct 17 14:09:39.077160 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2717/5565] 10.222.0.79 () {60 vars in 1194 bytes} [Mon Oct 17 14:09:38 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:09:39.094488 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6e90dd3a-736b-451e-89b4-d3740579022c tempest-TestAggregatesBasicOps-1430479572 tempest-TestAggregatesBasicOps-1430479572-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:09:39.147900 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6e90dd3a-736b-451e-89b4-d3740579022c tempest-TestAggregatesBasicOps-1430479572 tempest-TestAggregatesBasicOps-1430479572-project-admin] 10.222.0.79 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.062618 Oct 17 14:09:39.151652 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2849/5566] 10.222.0.79 () {58 vars in 1155 bytes} [Mon Oct 17 14:09:39 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 14:10:11.688782 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=4 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:10:11.689936 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:10:11.694352 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3bec9986-8502-4005-a123-cf3103901ff4 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1368352669", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "539d4ff6-748f-4c4e-b115-ad48ff5c0a8a"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:10:12.105322 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-3bec9986-8502-4005-a123-cf3103901ff4 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] validate_networks() for [('539d4ff6-748f-4c4e-b115-ad48ff5c0a8a', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:10:13.021628 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-3bec9986-8502-4005-a123-cf3103901ff4 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:10:13.024162 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-3bec9986-8502-4005-a123-cf3103901ff4 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:10:13.024917 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-3bec9986-8502-4005-a123-cf3103901ff4 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:10:13.025539 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-3bec9986-8502-4005-a123-cf3103901ff4 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:10:13.026164 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-3bec9986-8502-4005-a123-cf3103901ff4 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:10:13.071799 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3bec9986-8502-4005-a123-cf3103901ff4 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:13.072496 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3bec9986-8502-4005-a123-cf3103901ff4 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:13.073226 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3bec9986-8502-4005-a123-cf3103901ff4 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:13.074096 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3bec9986-8502-4005-a123-cf3103901ff4 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:13.076098 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3bec9986-8502-4005-a123-cf3103901ff4 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:13.076707 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3bec9986-8502-4005-a123-cf3103901ff4 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:13.115587 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-3bec9986-8502-4005-a123-cf3103901ff4 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Getting quotas for project e5ad8699d06a4121971e32459e32c81d. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:10:13.126612 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-3bec9986-8502-4005-a123-cf3103901ff4 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Getting quotas for user aaae152014d74abc8cf631c72feb25a6 and project e5ad8699d06a4121971e32459e32c81d. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:10:13.150765 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3bec9986-8502-4005-a123-cf3103901ff4 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:10:13.155539 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3bec9986-8502-4005-a123-cf3103901ff4 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] [instance: 2d074012-fb86-4395-b8f5-3288f5677c84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:10:13.296904 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3bec9986-8502-4005-a123-cf3103901ff4 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.609242 Oct 17 14:10:13.304761 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2718/5567] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 14:10:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:10:13.306672 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:10:13.307849 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=6 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:10:13.308509 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:10:13.312886 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cb0f899f-44bc-4a08-922a-e570865000c0 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:13.313517 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cb0f899f-44bc-4a08-922a-e570865000c0 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] [instance: 2d074012-fb86-4395-b8f5-3288f5677c84] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:13.454084 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cb0f899f-44bc-4a08-922a-e570865000c0 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaae152014d74abc8cf631c72feb25a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5ad8699d06a4121971e32459e32c81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:10:13.467743 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cb0f899f-44bc-4a08-922a-e570865000c0 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] 10.222.0.79 "GET /compute/v2.1/servers/2d074012-fb86-4395-b8f5-3288f5677c84" status: 200 len: 1219 microversion: 2.1 time: 0.159788 Oct 17 14:10:13.468519 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2850/5568] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:10:13 2022] GET /compute/v2.1/servers/2d074012-fb86-4395-b8f5-3288f5677c84 => generated 1219 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:10:14.490914 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-95cf3bef-317e-4848-b167-95dac318faa8 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:14.491673 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-95cf3bef-317e-4848-b167-95dac318faa8 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] [instance: 2d074012-fb86-4395-b8f5-3288f5677c84] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:14.504017 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-95cf3bef-317e-4848-b167-95dac318faa8 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:14.504715 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-95cf3bef-317e-4848-b167-95dac318faa8 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:14.505347 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-95cf3bef-317e-4848-b167-95dac318faa8 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:14.506204 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-95cf3bef-317e-4848-b167-95dac318faa8 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:14.507298 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-95cf3bef-317e-4848-b167-95dac318faa8 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:14.507872 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-95cf3bef-317e-4848-b167-95dac318faa8 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:14.651530 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-95cf3bef-317e-4848-b167-95dac318faa8 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaae152014d74abc8cf631c72feb25a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5ad8699d06a4121971e32459e32c81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:10:14.661170 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-95cf3bef-317e-4848-b167-95dac318faa8 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] 10.222.0.79 "GET /compute/v2.1/servers/2d074012-fb86-4395-b8f5-3288f5677c84" status: 200 len: 1271 microversion: 2.1 time: 0.174295 Oct 17 14:10:14.662460 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2719/5569] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:10:14 2022] GET /compute/v2.1/servers/2d074012-fb86-4395-b8f5-3288f5677c84 => generated 1271 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:10:15.686239 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-870a822d-0286-40dd-9917-1247fbc4b651 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:15.686886 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-870a822d-0286-40dd-9917-1247fbc4b651 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] [instance: 2d074012-fb86-4395-b8f5-3288f5677c84] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:15.699102 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-870a822d-0286-40dd-9917-1247fbc4b651 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:15.702538 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-870a822d-0286-40dd-9917-1247fbc4b651 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:15.705522 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-870a822d-0286-40dd-9917-1247fbc4b651 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:15.706432 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-870a822d-0286-40dd-9917-1247fbc4b651 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:15.708709 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-870a822d-0286-40dd-9917-1247fbc4b651 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:15.716164 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-870a822d-0286-40dd-9917-1247fbc4b651 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:15.933465 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-870a822d-0286-40dd-9917-1247fbc4b651 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaae152014d74abc8cf631c72feb25a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5ad8699d06a4121971e32459e32c81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:10:15.963924 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-870a822d-0286-40dd-9917-1247fbc4b651 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] 10.222.0.79 "GET /compute/v2.1/servers/2d074012-fb86-4395-b8f5-3288f5677c84" status: 200 len: 1277 microversion: 2.1 time: 0.281691 Oct 17 14:10:15.964546 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2851/5570] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:10:15 2022] GET /compute/v2.1/servers/2d074012-fb86-4395-b8f5-3288f5677c84 => generated 1277 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:10:16.992102 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e2d9fe81-9992-48bb-9423-44d13cfabb0a tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:16.993498 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e2d9fe81-9992-48bb-9423-44d13cfabb0a tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] [instance: 2d074012-fb86-4395-b8f5-3288f5677c84] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:17.004837 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e2d9fe81-9992-48bb-9423-44d13cfabb0a tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:17.011062 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e2d9fe81-9992-48bb-9423-44d13cfabb0a tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:17.011825 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e2d9fe81-9992-48bb-9423-44d13cfabb0a tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:17.012735 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e2d9fe81-9992-48bb-9423-44d13cfabb0a tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:17.013374 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e2d9fe81-9992-48bb-9423-44d13cfabb0a tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:17.013965 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e2d9fe81-9992-48bb-9423-44d13cfabb0a tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:17.578644 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e2d9fe81-9992-48bb-9423-44d13cfabb0a tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaae152014d74abc8cf631c72feb25a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5ad8699d06a4121971e32459e32c81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:10:17.588311 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e2d9fe81-9992-48bb-9423-44d13cfabb0a tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] 10.222.0.79 "GET /compute/v2.1/servers/2d074012-fb86-4395-b8f5-3288f5677c84" status: 200 len: 1319 microversion: 2.1 time: 0.600735 Oct 17 14:10:17.589666 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2720/5571] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:10:16 2022] GET /compute/v2.1/servers/2d074012-fb86-4395-b8f5-3288f5677c84 => generated 1319 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:10:18.623374 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-52f406b5-2150-41b4-9309-876713e1a7d2 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:18.624530 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-52f406b5-2150-41b4-9309-876713e1a7d2 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] [instance: 2d074012-fb86-4395-b8f5-3288f5677c84] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:18.643900 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-52f406b5-2150-41b4-9309-876713e1a7d2 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:18.644685 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-52f406b5-2150-41b4-9309-876713e1a7d2 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:18.645128 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-52f406b5-2150-41b4-9309-876713e1a7d2 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:18.645961 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-52f406b5-2150-41b4-9309-876713e1a7d2 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:18.646832 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-52f406b5-2150-41b4-9309-876713e1a7d2 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:18.647425 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-52f406b5-2150-41b4-9309-876713e1a7d2 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:18.864900 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-acc4859e-d428-495b-a64b-d25009e98ad2 req-9158144c-e790-4e5c-9df5-4958edd7dae4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d074012-fb86-4395-b8f5-3288f5677c84", "tag": "cfdfb038-1f6f-428c-a4e2-dcbb66a93693"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:10:18.876481 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-acc4859e-d428-495b-a64b-d25009e98ad2 req-9158144c-e790-4e5c-9df5-4958edd7dae4 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:18.876962 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-acc4859e-d428-495b-a64b-d25009e98ad2 req-9158144c-e790-4e5c-9df5-4958edd7dae4 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:18.877390 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-acc4859e-d428-495b-a64b-d25009e98ad2 req-9158144c-e790-4e5c-9df5-4958edd7dae4 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:18.897120 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-acc4859e-d428-495b-a64b-d25009e98ad2 req-9158144c-e790-4e5c-9df5-4958edd7dae4 service nova] Creating event network-changed:cfdfb038-1f6f-428c-a4e2-dcbb66a93693 for instance 2d074012-fb86-4395-b8f5-3288f5677c84 on n-h2-854247-14 Oct 17 14:10:18.903116 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-acc4859e-d428-495b-a64b-d25009e98ad2 req-9158144c-e790-4e5c-9df5-4958edd7dae4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166002 Oct 17 14:10:18.904331 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2721/5572] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:10:18.925879 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-52f406b5-2150-41b4-9309-876713e1a7d2 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaae152014d74abc8cf631c72feb25a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5ad8699d06a4121971e32459e32c81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:10:18.937383 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-52f406b5-2150-41b4-9309-876713e1a7d2 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] 10.222.0.79 "GET /compute/v2.1/servers/2d074012-fb86-4395-b8f5-3288f5677c84" status: 200 len: 1319 microversion: 2.1 time: 0.327435 Oct 17 14:10:18.938884 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2852/5573] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:10:18 2022] GET /compute/v2.1/servers/2d074012-fb86-4395-b8f5-3288f5677c84 => generated 1319 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:10:19.962371 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6f697f84-e11d-4b4d-869d-736827bc6d67 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:19.963884 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6f697f84-e11d-4b4d-869d-736827bc6d67 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] [instance: 2d074012-fb86-4395-b8f5-3288f5677c84] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:19.982131 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6f697f84-e11d-4b4d-869d-736827bc6d67 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:19.982748 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6f697f84-e11d-4b4d-869d-736827bc6d67 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:19.983214 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6f697f84-e11d-4b4d-869d-736827bc6d67 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:19.984208 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6f697f84-e11d-4b4d-869d-736827bc6d67 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:19.984841 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6f697f84-e11d-4b4d-869d-736827bc6d67 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:19.985270 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6f697f84-e11d-4b4d-869d-736827bc6d67 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:20.370898 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6f697f84-e11d-4b4d-869d-736827bc6d67 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaae152014d74abc8cf631c72feb25a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5ad8699d06a4121971e32459e32c81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:10:20.391112 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6f697f84-e11d-4b4d-869d-736827bc6d67 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] 10.222.0.79 "GET /compute/v2.1/servers/2d074012-fb86-4395-b8f5-3288f5677c84" status: 200 len: 1319 microversion: 2.1 time: 0.433160 Oct 17 14:10:20.392412 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2722/5574] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:10:19 2022] GET /compute/v2.1/servers/2d074012-fb86-4395-b8f5-3288f5677c84 => generated 1319 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:10:21.419627 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-67051460-f8bb-47f5-9c97-1e45db5bcbf5 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:21.421051 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-67051460-f8bb-47f5-9c97-1e45db5bcbf5 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] [instance: 2d074012-fb86-4395-b8f5-3288f5677c84] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:21.441819 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-67051460-f8bb-47f5-9c97-1e45db5bcbf5 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:21.442319 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-67051460-f8bb-47f5-9c97-1e45db5bcbf5 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:21.442757 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-67051460-f8bb-47f5-9c97-1e45db5bcbf5 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:21.443619 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-67051460-f8bb-47f5-9c97-1e45db5bcbf5 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:21.444499 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-67051460-f8bb-47f5-9c97-1e45db5bcbf5 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:21.444931 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-67051460-f8bb-47f5-9c97-1e45db5bcbf5 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:21.637071 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-67051460-f8bb-47f5-9c97-1e45db5bcbf5 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaae152014d74abc8cf631c72feb25a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5ad8699d06a4121971e32459e32c81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:10:21.646713 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-67051460-f8bb-47f5-9c97-1e45db5bcbf5 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] 10.222.0.79 "GET /compute/v2.1/servers/2d074012-fb86-4395-b8f5-3288f5677c84" status: 200 len: 1319 microversion: 2.1 time: 0.232989 Oct 17 14:10:21.657366 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2853/5575] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:10:21 2022] GET /compute/v2.1/servers/2d074012-fb86-4395-b8f5-3288f5677c84 => generated 1319 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:10:22.670071 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-36c07d07-15cc-41b5-8593-f68d6777b3d7 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:22.670679 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-36c07d07-15cc-41b5-8593-f68d6777b3d7 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] [instance: 2d074012-fb86-4395-b8f5-3288f5677c84] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:22.678728 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-36c07d07-15cc-41b5-8593-f68d6777b3d7 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:22.681884 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-36c07d07-15cc-41b5-8593-f68d6777b3d7 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:22.687584 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-36c07d07-15cc-41b5-8593-f68d6777b3d7 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:22.690551 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-36c07d07-15cc-41b5-8593-f68d6777b3d7 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:22.691027 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-36c07d07-15cc-41b5-8593-f68d6777b3d7 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:22.691487 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-36c07d07-15cc-41b5-8593-f68d6777b3d7 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:22.914352 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-36c07d07-15cc-41b5-8593-f68d6777b3d7 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaae152014d74abc8cf631c72feb25a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5ad8699d06a4121971e32459e32c81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:10:22.926551 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-36c07d07-15cc-41b5-8593-f68d6777b3d7 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] 10.222.0.79 "GET /compute/v2.1/servers/2d074012-fb86-4395-b8f5-3288f5677c84" status: 200 len: 1319 microversion: 2.1 time: 0.260261 Oct 17 14:10:22.940836 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2723/5576] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:10:22 2022] GET /compute/v2.1/servers/2d074012-fb86-4395-b8f5-3288f5677c84 => generated 1319 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:10:23.950796 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0014ae85-2cac-4875-8033-c43fc9310ea8 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:23.951675 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0014ae85-2cac-4875-8033-c43fc9310ea8 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] [instance: 2d074012-fb86-4395-b8f5-3288f5677c84] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:23.955464 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:10:23.972981 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0014ae85-2cac-4875-8033-c43fc9310ea8 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:23.973482 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0014ae85-2cac-4875-8033-c43fc9310ea8 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:23.974777 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0014ae85-2cac-4875-8033-c43fc9310ea8 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:23.977809 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0014ae85-2cac-4875-8033-c43fc9310ea8 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:23.978818 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0014ae85-2cac-4875-8033-c43fc9310ea8 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:23.979309 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0014ae85-2cac-4875-8033-c43fc9310ea8 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:24.271297 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0014ae85-2cac-4875-8033-c43fc9310ea8 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaae152014d74abc8cf631c72feb25a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5ad8699d06a4121971e32459e32c81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:10:24.282563 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0014ae85-2cac-4875-8033-c43fc9310ea8 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] 10.222.0.79 "GET /compute/v2.1/servers/2d074012-fb86-4395-b8f5-3288f5677c84" status: 200 len: 1319 microversion: 2.1 time: 0.335862 Oct 17 14:10:24.283598 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2854/5577] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:10:23 2022] GET /compute/v2.1/servers/2d074012-fb86-4395-b8f5-3288f5677c84 => generated 1319 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:10:24.645898 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:10:24.647379 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=6 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:10:24.925536 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-bad0af60-66e9-4950-a37f-4a5e3c85fdb6 req-04bf1eb1-e83b-46fb-82fd-0e7c99e68b47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d074012-fb86-4395-b8f5-3288f5677c84", "name": "network-vif-plugged", "status": "completed", "tag": "cfdfb038-1f6f-428c-a4e2-dcbb66a93693"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:10:24.945894 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-bad0af60-66e9-4950-a37f-4a5e3c85fdb6 req-04bf1eb1-e83b-46fb-82fd-0e7c99e68b47 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:24.951066 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-bad0af60-66e9-4950-a37f-4a5e3c85fdb6 req-04bf1eb1-e83b-46fb-82fd-0e7c99e68b47 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:24.951797 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-bad0af60-66e9-4950-a37f-4a5e3c85fdb6 req-04bf1eb1-e83b-46fb-82fd-0e7c99e68b47 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:24.977363 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-bad0af60-66e9-4950-a37f-4a5e3c85fdb6 req-04bf1eb1-e83b-46fb-82fd-0e7c99e68b47 service nova] Creating event network-vif-plugged:cfdfb038-1f6f-428c-a4e2-dcbb66a93693 for instance 2d074012-fb86-4395-b8f5-3288f5677c84 on n-h2-854247-14 Oct 17 14:10:24.984456 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-bad0af60-66e9-4950-a37f-4a5e3c85fdb6 req-04bf1eb1-e83b-46fb-82fd-0e7c99e68b47 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.352208 Oct 17 14:10:24.985914 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2724/5578] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:10:25.310256 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5cd281d6-cd7d-4487-8849-81d8ec07e03e tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:25.313618 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5cd281d6-cd7d-4487-8849-81d8ec07e03e tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] [instance: 2d074012-fb86-4395-b8f5-3288f5677c84] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:25.331776 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5cd281d6-cd7d-4487-8849-81d8ec07e03e tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:25.336580 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5cd281d6-cd7d-4487-8849-81d8ec07e03e tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:25.337260 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5cd281d6-cd7d-4487-8849-81d8ec07e03e tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:25.340073 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5cd281d6-cd7d-4487-8849-81d8ec07e03e tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:25.340768 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5cd281d6-cd7d-4487-8849-81d8ec07e03e tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:25.344023 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5cd281d6-cd7d-4487-8849-81d8ec07e03e tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:25.648538 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5cd281d6-cd7d-4487-8849-81d8ec07e03e tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaae152014d74abc8cf631c72feb25a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5ad8699d06a4121971e32459e32c81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:10:25.661779 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5cd281d6-cd7d-4487-8849-81d8ec07e03e tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] 10.222.0.79 "GET /compute/v2.1/servers/2d074012-fb86-4395-b8f5-3288f5677c84" status: 200 len: 1319 microversion: 2.1 time: 0.355499 Oct 17 14:10:25.664255 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2855/5579] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:10:25 2022] GET /compute/v2.1/servers/2d074012-fb86-4395-b8f5-3288f5677c84 => generated 1319 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:10:26.698057 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8d4d92b6-5631-4778-86a3-b1346a23ee98 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:26.700121 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8d4d92b6-5631-4778-86a3-b1346a23ee98 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] [instance: 2d074012-fb86-4395-b8f5-3288f5677c84] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:26.723875 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8d4d92b6-5631-4778-86a3-b1346a23ee98 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:26.725150 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8d4d92b6-5631-4778-86a3-b1346a23ee98 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:26.725769 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8d4d92b6-5631-4778-86a3-b1346a23ee98 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:26.726679 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8d4d92b6-5631-4778-86a3-b1346a23ee98 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:26.727447 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8d4d92b6-5631-4778-86a3-b1346a23ee98 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:26.728020 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8d4d92b6-5631-4778-86a3-b1346a23ee98 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:27.229907 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8d4d92b6-5631-4778-86a3-b1346a23ee98 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaae152014d74abc8cf631c72feb25a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5ad8699d06a4121971e32459e32c81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:10:27.241651 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8d4d92b6-5631-4778-86a3-b1346a23ee98 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] 10.222.0.79 "GET /compute/v2.1/servers/2d074012-fb86-4395-b8f5-3288f5677c84" status: 200 len: 1508 microversion: 2.1 time: 0.553425 Oct 17 14:10:27.244931 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2725/5580] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:10:26 2022] GET /compute/v2.1/servers/2d074012-fb86-4395-b8f5-3288f5677c84 => generated 1508 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:10:57.784762 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=14 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:10:57.785707 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=30 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:10:57.996009 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-21d52827-8aec-4a12-b47b-09e56d040104 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e808c92b-69ff-455f-9654-0189c71ff7e5", "device": "/dev/sdb"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:10:58.000443 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-21d52827-8aec-4a12-b47b-09e56d040104 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] [instance: 2d074012-fb86-4395-b8f5-3288f5677c84] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:58.012980 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:10:58.013885 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=36 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:10:58.018608 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-21d52827-8aec-4a12-b47b-09e56d040104 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:58.019383 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-21d52827-8aec-4a12-b47b-09e56d040104 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:58.022956 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-21d52827-8aec-4a12-b47b-09e56d040104 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:58.023741 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-21d52827-8aec-4a12-b47b-09e56d040104 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:58.024203 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-21d52827-8aec-4a12-b47b-09e56d040104 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:58.024635 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-21d52827-8aec-4a12-b47b-09e56d040104 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:58.384734 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a46209f8-82ac-42b2-9725-f19ad2db1230 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:58.385230 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a46209f8-82ac-42b2-9725-f19ad2db1230 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] [instance: b06b769b-4e30-480d-9a2f-e5f9b9fdeab2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:58.400982 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a46209f8-82ac-42b2-9725-f19ad2db1230 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:58.401703 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a46209f8-82ac-42b2-9725-f19ad2db1230 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:58.402333 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a46209f8-82ac-42b2-9725-f19ad2db1230 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:58.403213 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a46209f8-82ac-42b2-9725-f19ad2db1230 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:58.403997 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a46209f8-82ac-42b2-9725-f19ad2db1230 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:58.404572 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a46209f8-82ac-42b2-9725-f19ad2db1230 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:58.466565 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a46209f8-82ac-42b2-9725-f19ad2db1230 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] [instance: b06b769b-4e30-480d-9a2f-e5f9b9fdeab2] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:10:58.527484 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-21d52827-8aec-4a12-b47b-09e56d040104 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] 10.222.0.79 "POST /compute/v2.1/servers/2d074012-fb86-4395-b8f5-3288f5677c84/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.534876 Oct 17 14:10:58.544534 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2726/5581] 10.222.0.79 () {60 vars in 1323 bytes} [Mon Oct 17 14:10:57 2022] POST /compute/v2.1/servers/2d074012-fb86-4395-b8f5-3288f5677c84/os-volume_attachments => generated 194 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:10:58.601665 n-d-854247-14 devstack@n-api.service[127016]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a46209f8-82ac-42b2-9725-f19ad2db1230 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] [a49208af-5c42-4786-92fe-dfe8c8f14593] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 14:10:59.609745 n-d-854247-14 devstack@n-api.service[127016]: INFO oslo.messaging._drivers.impl_rabbit [None req-a46209f8-82ac-42b2-9725-f19ad2db1230 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] [a49208af-5c42-4786-92fe-dfe8c8f14593] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 48316. Oct 17 14:10:59.648393 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a46209f8-82ac-42b2-9725-f19ad2db1230 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] 10.222.0.79 "DELETE /compute/v2.1/servers/b06b769b-4e30-480d-9a2f-e5f9b9fdeab2" status: 204 len: 0 microversion: 2.1 time: 1.864784 Oct 17 14:10:59.649663 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2856/5582] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:10:57 2022] DELETE /compute/v2.1/servers/b06b769b-4e30-480d-9a2f-e5f9b9fdeab2 => generated 0 bytes in 1867 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:10:59.660317 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3f6418d1-ff12-402f-8b69-be231e72f692 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:59.661758 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3f6418d1-ff12-402f-8b69-be231e72f692 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] [instance: b06b769b-4e30-480d-9a2f-e5f9b9fdeab2] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:59.682599 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f6418d1-ff12-402f-8b69-be231e72f692 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:59.685452 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f6418d1-ff12-402f-8b69-be231e72f692 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:59.686799 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f6418d1-ff12-402f-8b69-be231e72f692 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:59.701942 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f6418d1-ff12-402f-8b69-be231e72f692 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:59.704261 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f6418d1-ff12-402f-8b69-be231e72f692 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:59.705835 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f6418d1-ff12-402f-8b69-be231e72f692 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:00.295238 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3f6418d1-ff12-402f-8b69-be231e72f692 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ddceda0be42bf8cfe265f7a07d462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f716902fd72e44a2b2b7d0ef78f40b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:00.315760 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3f6418d1-ff12-402f-8b69-be231e72f692 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] 10.222.0.79 "GET /compute/v2.1/servers/b06b769b-4e30-480d-9a2f-e5f9b9fdeab2" status: 200 len: 1731 microversion: 2.1 time: 0.655028 Oct 17 14:11:00.317490 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2727/5583] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:10:59 2022] GET /compute/v2.1/servers/b06b769b-4e30-480d-9a2f-e5f9b9fdeab2 => generated 1731 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:11:01.346613 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-80f95826-809e-4832-8559-34d831b4c9a4 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:01.347464 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-80f95826-809e-4832-8559-34d831b4c9a4 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] [instance: b06b769b-4e30-480d-9a2f-e5f9b9fdeab2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:01.370255 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-80f95826-809e-4832-8559-34d831b4c9a4 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:01.371130 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-80f95826-809e-4832-8559-34d831b4c9a4 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:01.371866 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-80f95826-809e-4832-8559-34d831b4c9a4 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:01.372804 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-80f95826-809e-4832-8559-34d831b4c9a4 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:01.373582 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-80f95826-809e-4832-8559-34d831b4c9a4 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:01.374291 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-80f95826-809e-4832-8559-34d831b4c9a4 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:03.987329 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-80f95826-809e-4832-8559-34d831b4c9a4 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ddceda0be42bf8cfe265f7a07d462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f716902fd72e44a2b2b7d0ef78f40b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:04.005089 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-80f95826-809e-4832-8559-34d831b4c9a4 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] 10.222.0.79 "GET /compute/v2.1/servers/b06b769b-4e30-480d-9a2f-e5f9b9fdeab2" status: 200 len: 1731 microversion: 2.1 time: 2.659288 Oct 17 14:11:04.006649 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2857/5584] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:01 2022] GET /compute/v2.1/servers/b06b769b-4e30-480d-9a2f-e5f9b9fdeab2 => generated 1731 bytes in 2667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:11:05.035467 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bfff49cd-1a9f-4e57-b531-a117a053cd5f tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:05.036735 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-bfff49cd-1a9f-4e57-b531-a117a053cd5f tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] [instance: b06b769b-4e30-480d-9a2f-e5f9b9fdeab2] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:05.046534 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bfff49cd-1a9f-4e57-b531-a117a053cd5f tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:05.054611 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bfff49cd-1a9f-4e57-b531-a117a053cd5f tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:05.058147 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bfff49cd-1a9f-4e57-b531-a117a053cd5f tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:05.063530 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bfff49cd-1a9f-4e57-b531-a117a053cd5f tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:05.064074 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bfff49cd-1a9f-4e57-b531-a117a053cd5f tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:05.065611 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bfff49cd-1a9f-4e57-b531-a117a053cd5f tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:05.252125 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-bfff49cd-1a9f-4e57-b531-a117a053cd5f tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ddceda0be42bf8cfe265f7a07d462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f716902fd72e44a2b2b7d0ef78f40b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:05.270928 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-bfff49cd-1a9f-4e57-b531-a117a053cd5f tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] 10.222.0.79 "GET /compute/v2.1/servers/b06b769b-4e30-480d-9a2f-e5f9b9fdeab2" status: 200 len: 1663 microversion: 2.1 time: 0.237316 Oct 17 14:11:05.272559 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2728/5585] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:05 2022] GET /compute/v2.1/servers/b06b769b-4e30-480d-9a2f-e5f9b9fdeab2 => generated 1663 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:11:05.949316 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-8f4fe899-aa39-48e7-887d-5ef4f0b11fb4 req-1346e65e-8a79-4083-9f0d-1b4284e8882e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b06b769b-4e30-480d-9a2f-e5f9b9fdeab2", "name": "network-vif-deleted", "tag": "05824010-0f55-4a59-9f98-90518d4247c6"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:11:05.988482 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-8f4fe899-aa39-48e7-887d-5ef4f0b11fb4 req-1346e65e-8a79-4083-9f0d-1b4284e8882e service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:05.989021 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-8f4fe899-aa39-48e7-887d-5ef4f0b11fb4 req-1346e65e-8a79-4083-9f0d-1b4284e8882e service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:05.989495 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-8f4fe899-aa39-48e7-887d-5ef4f0b11fb4 req-1346e65e-8a79-4083-9f0d-1b4284e8882e service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:06.029443 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-8f4fe899-aa39-48e7-887d-5ef4f0b11fb4 req-1346e65e-8a79-4083-9f0d-1b4284e8882e service nova] Creating event network-vif-deleted:05824010-0f55-4a59-9f98-90518d4247c6 for instance b06b769b-4e30-480d-9a2f-e5f9b9fdeab2 on n-h1-854247-14 Oct 17 14:11:06.051280 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-8f4fe899-aa39-48e7-887d-5ef4f0b11fb4 req-1346e65e-8a79-4083-9f0d-1b4284e8882e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105964 Oct 17 14:11:06.057605 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2858/5586] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:11:06.304714 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4d6d3010-cf1b-4c00-8991-e20de4a570dc tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:06.307118 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4d6d3010-cf1b-4c00-8991-e20de4a570dc tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] [instance: b06b769b-4e30-480d-9a2f-e5f9b9fdeab2] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:06.329247 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4d6d3010-cf1b-4c00-8991-e20de4a570dc tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:06.331739 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4d6d3010-cf1b-4c00-8991-e20de4a570dc tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:06.332964 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4d6d3010-cf1b-4c00-8991-e20de4a570dc tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:06.334878 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4d6d3010-cf1b-4c00-8991-e20de4a570dc tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:06.336825 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4d6d3010-cf1b-4c00-8991-e20de4a570dc tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:06.340048 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4d6d3010-cf1b-4c00-8991-e20de4a570dc tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:06.412852 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4d6d3010-cf1b-4c00-8991-e20de4a570dc tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:06.413708 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4d6d3010-cf1b-4c00-8991-e20de4a570dc tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:06.414305 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4d6d3010-cf1b-4c00-8991-e20de4a570dc tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:06.415209 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-4d6d3010-cf1b-4c00-8991-e20de4a570dc tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lazy-loading 'fault' on Instance uuid b06b769b-4e30-480d-9a2f-e5f9b9fdeab2 {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:11:06.534324 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4d6d3010-cf1b-4c00-8991-e20de4a570dc tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a2ddceda0be42bf8cfe265f7a07d462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f716902fd72e44a2b2b7d0ef78f40b72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:06.549163 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4d6d3010-cf1b-4c00-8991-e20de4a570dc tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] 10.222.0.79 "GET /compute/v2.1/servers/b06b769b-4e30-480d-9a2f-e5f9b9fdeab2" status: 200 len: 1387 microversion: 2.1 time: 0.255270 Oct 17 14:11:06.552515 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2729/5587] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:06 2022] GET /compute/v2.1/servers/b06b769b-4e30-480d-9a2f-e5f9b9fdeab2 => generated 1387 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:11:07.585102 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4d4c2db8-44af-4a4a-9e83-0fa55a8fdb80 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:07.586722 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4d4c2db8-44af-4a4a-9e83-0fa55a8fdb80 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] [instance: b06b769b-4e30-480d-9a2f-e5f9b9fdeab2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:07.604775 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d4c2db8-44af-4a4a-9e83-0fa55a8fdb80 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:07.605534 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d4c2db8-44af-4a4a-9e83-0fa55a8fdb80 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:07.606151 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d4c2db8-44af-4a4a-9e83-0fa55a8fdb80 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:07.609637 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d4c2db8-44af-4a4a-9e83-0fa55a8fdb80 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:07.610312 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d4c2db8-44af-4a4a-9e83-0fa55a8fdb80 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:07.610909 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d4c2db8-44af-4a4a-9e83-0fa55a8fdb80 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:07.658097 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-4d4c2db8-44af-4a4a-9e83-0fa55a8fdb80 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] HTTP exception thrown: Instance b06b769b-4e30-480d-9a2f-e5f9b9fdeab2 could not be found. Oct 17 14:11:07.660450 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4d4c2db8-44af-4a4a-9e83-0fa55a8fdb80 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Request method failure captured: Oct 17 14:11:07.660450 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/b06b769b-4e30-480d-9a2f-e5f9b9fdeab2 HTTP/1.1 Oct 17 14:11:07.660450 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 14:11:07.660450 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 14:11:07.660450 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 14:11:07.660450 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 14:11:07.660450 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 14:11:07.660450 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 14:11:07.660450 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 14:11:07.660450 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 14:11:07.660450 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTWEtsy_0u6O5cT91Q0fcrn0rlmp9ZlR_ltaj4KQavakrA49dHqsJ1VxDCENLc4UftJyCWuMlAbE-4cQF_nSivNEwFI9nYkmv2lCx0s3oq4gOaO_mnP6rs1IMgbETuVKgakbJPOtiQ0cBqf9IvUbnfugvBEZKkIADxsvfN4HCIOOAi3k Oct 17 14:11:07.660450 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 14:11:07.660450 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 14:11:07.660450 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 14:11:07.660450 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 14:11:07.660450 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 14:11:07.660450 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 14:11:07.660450 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: f716902fd72e44a2b2b7d0ef78f40b72 Oct 17 14:11:07.660450 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-TestServerBasicOps-682885150 Oct 17 14:11:07.660450 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 14:11:07.660450 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 14:11:07.660450 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f716902fd72e44a2b2b7d0ef78f40b72"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f716902fd72e44a2b2b7d0ef78f40b72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f716902fd72e44a2b2b7d0ef78f40b72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f716902fd72e44a2b2b7d0ef78f40b72", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:11:07.660450 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-TestServerBasicOps-682885150 Oct 17 14:11:07.660450 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: f716902fd72e44a2b2b7d0ef78f40b72 Oct 17 14:11:07.660450 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-TestServerBasicOps-682885150 Oct 17 14:11:07.660450 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-TestServerBasicOps-682885150-project Oct 17 14:11:07.660450 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 14:11:07.660450 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 14:11:07.660450 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 2a2ddceda0be42bf8cfe265f7a07d462 Oct 17 14:11:07.660450 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-TestServerBasicOps-682885150-project Oct 17 14:11:07.660450 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 14:11:07.660450 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance b06b769b-4e30-480d-9a2f-e5f9b9fdeab2 could not be found. Oct 17 14:11:07.660450 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'b06b769b-4e30-480d-9a2f-e5f9b9fdeab2'} Oct 17 14:11:07.660450 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:11:07.660450 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:11:07.660450 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:11:07.660450 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:11:07.660450 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:11:07.660450 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:11:07.660450 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:11:07.660450 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:11:07.660450 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:11:07.660450 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:11:07.660450 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b06b769b-4e30-480d-9a2f-e5f9b9fdeab2 could not be found. Oct 17 14:11:07.660450 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:11:07.660450 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:11:07.660450 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:11:07.660450 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:11:07.660450 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:11:07.660450 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:11:07.660450 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:11:07.660450 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:11:07.660450 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:11:07.660450 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:11:07.660450 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:11:07.660450 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:11:07.660450 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:11:07.660450 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:11:07.660450 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:11:07.660450 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:11:07.660450 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b06b769b-4e30-480d-9a2f-e5f9b9fdeab2 could not be found. Oct 17 14:11:07.660450 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:11:07.660450 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:11:07.660450 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:11:07.670103 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:11:07.670103 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:11:07.670103 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:11:07.670103 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:11:07.670103 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:11:07.670103 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b06b769b-4e30-480d-9a2f-e5f9b9fdeab2 could not be found. Oct 17 14:11:07.670103 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:11:07.672625 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4d4c2db8-44af-4a4a-9e83-0fa55a8fdb80 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Returning 404 to user: Instance b06b769b-4e30-480d-9a2f-e5f9b9fdeab2 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:11:07.673681 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4d4c2db8-44af-4a4a-9e83-0fa55a8fdb80 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] 10.222.0.79 "GET /compute/v2.1/servers/b06b769b-4e30-480d-9a2f-e5f9b9fdeab2" status: 404 len: 111 microversion: 2.1 time: 0.096824 Oct 17 14:11:07.681980 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2859/5588] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:07 2022] GET /compute/v2.1/servers/b06b769b-4e30-480d-9a2f-e5f9b9fdeab2 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:11:08.471782 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-66597dd1-7390-4d57-84e0-4800785dadee tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1369116817", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "b66f1909-4555-43e7-abd3-6112185491c9"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:11:08.579948 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-66597dd1-7390-4d57-84e0-4800785dadee tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] validate_networks() for [('b66f1909-4555-43e7-abd3-6112185491c9', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:11:08.585996 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-50675e03-9ae6-4d1f-835e-7ea8044c4b6c tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:08.587210 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-50675e03-9ae6-4d1f-835e-7ea8044c4b6c tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] [instance: b06b769b-4e30-480d-9a2f-e5f9b9fdeab2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:08.596581 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-50675e03-9ae6-4d1f-835e-7ea8044c4b6c tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:08.597384 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-50675e03-9ae6-4d1f-835e-7ea8044c4b6c tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:08.598057 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-50675e03-9ae6-4d1f-835e-7ea8044c4b6c tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:08.598929 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-50675e03-9ae6-4d1f-835e-7ea8044c4b6c tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:08.599577 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-50675e03-9ae6-4d1f-835e-7ea8044c4b6c tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:08.600164 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-50675e03-9ae6-4d1f-835e-7ea8044c4b6c tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:08.618405 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-50675e03-9ae6-4d1f-835e-7ea8044c4b6c tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] HTTP exception thrown: Instance b06b769b-4e30-480d-9a2f-e5f9b9fdeab2 could not be found. Oct 17 14:11:08.620450 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-50675e03-9ae6-4d1f-835e-7ea8044c4b6c tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Request method failure captured: Oct 17 14:11:08.620450 n-d-854247-14 devstack@n-api.service[127016]: request: DELETE /compute/v2.1/servers/b06b769b-4e30-480d-9a2f-e5f9b9fdeab2 HTTP/1.1 Oct 17 14:11:08.620450 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 14:11:08.620450 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 14:11:08.620450 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 14:11:08.620450 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 14:11:08.620450 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 14:11:08.620450 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 14:11:08.620450 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 14:11:08.620450 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 14:11:08.620450 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTWEtsy_0u6O5cT91Q0fcrn0rlmp9ZlR_ltaj4KQavakrA49dHqsJ1VxDCENLc4UftJyCWuMlAbE-4cQF_nSivNEwFI9nYkmv2lCx0s3oq4gOaO_mnP6rs1IMgbETuVKgakbJPOtiQ0cBqf9IvUbnfugvBEZKkIADxsvfN4HCIOOAi3k Oct 17 14:11:08.620450 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 14:11:08.620450 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 14:11:08.620450 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 14:11:08.620450 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 14:11:08.620450 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 14:11:08.620450 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 14:11:08.620450 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: f716902fd72e44a2b2b7d0ef78f40b72 Oct 17 14:11:08.620450 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-TestServerBasicOps-682885150 Oct 17 14:11:08.620450 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 14:11:08.620450 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 14:11:08.620450 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f716902fd72e44a2b2b7d0ef78f40b72"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f716902fd72e44a2b2b7d0ef78f40b72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f716902fd72e44a2b2b7d0ef78f40b72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f716902fd72e44a2b2b7d0ef78f40b72", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:11:08.620450 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-TestServerBasicOps-682885150 Oct 17 14:11:08.620450 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: f716902fd72e44a2b2b7d0ef78f40b72 Oct 17 14:11:08.620450 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-TestServerBasicOps-682885150 Oct 17 14:11:08.620450 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-TestServerBasicOps-682885150-project Oct 17 14:11:08.620450 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 14:11:08.620450 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 14:11:08.620450 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 2a2ddceda0be42bf8cfe265f7a07d462 Oct 17 14:11:08.620450 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-TestServerBasicOps-682885150-project Oct 17 14:11:08.620450 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 14:11:08.620450 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance b06b769b-4e30-480d-9a2f-e5f9b9fdeab2 could not be found. Oct 17 14:11:08.620450 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'b06b769b-4e30-480d-9a2f-e5f9b9fdeab2'} Oct 17 14:11:08.620450 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:11:08.620450 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:11:08.620450 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:11:08.620450 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:11:08.620450 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:11:08.620450 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:11:08.620450 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:11:08.620450 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:11:08.620450 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:11:08.620450 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:11:08.620450 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b06b769b-4e30-480d-9a2f-e5f9b9fdeab2 could not be found. Oct 17 14:11:08.620450 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:11:08.620450 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:11:08.620450 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:11:08.620450 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:11:08.620450 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:11:08.620450 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:11:08.620450 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:11:08.620450 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:11:08.620450 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:11:08.620450 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:11:08.620450 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 14:11:08.620450 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 14:11:08.620450 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 14:11:08.620450 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 14:11:08.620450 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:11:08.620450 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:11:08.620450 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:11:08.620450 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:11:08.624858 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b06b769b-4e30-480d-9a2f-e5f9b9fdeab2 could not be found. Oct 17 14:11:08.624858 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:11:08.624858 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:11:08.624858 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:11:08.624858 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:11:08.624858 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:11:08.624858 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:11:08.624858 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:11:08.624858 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:11:08.624858 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b06b769b-4e30-480d-9a2f-e5f9b9fdeab2 could not be found. Oct 17 14:11:08.624858 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:11:08.626913 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-50675e03-9ae6-4d1f-835e-7ea8044c4b6c tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Returning 404 to user: Instance b06b769b-4e30-480d-9a2f-e5f9b9fdeab2 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:11:08.628014 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-50675e03-9ae6-4d1f-835e-7ea8044c4b6c tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] 10.222.0.79 "DELETE /compute/v2.1/servers/b06b769b-4e30-480d-9a2f-e5f9b9fdeab2" status: 404 len: 111 microversion: 2.1 time: 0.052070 Oct 17 14:11:08.629117 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2860/5589] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:11:08 2022] DELETE /compute/v2.1/servers/b06b769b-4e30-480d-9a2f-e5f9b9fdeab2 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 14:11:08.646077 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3b054d4f-3c12-4b65-825e-8cb2fc4ce026 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:08.648161 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3b054d4f-3c12-4b65-825e-8cb2fc4ce026 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] [instance: b06b769b-4e30-480d-9a2f-e5f9b9fdeab2] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:08.658933 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3b054d4f-3c12-4b65-825e-8cb2fc4ce026 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:08.659724 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3b054d4f-3c12-4b65-825e-8cb2fc4ce026 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:08.660341 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3b054d4f-3c12-4b65-825e-8cb2fc4ce026 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:08.661220 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3b054d4f-3c12-4b65-825e-8cb2fc4ce026 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:08.661832 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3b054d4f-3c12-4b65-825e-8cb2fc4ce026 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:08.662404 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3b054d4f-3c12-4b65-825e-8cb2fc4ce026 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:08.682166 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-3b054d4f-3c12-4b65-825e-8cb2fc4ce026 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] HTTP exception thrown: Instance b06b769b-4e30-480d-9a2f-e5f9b9fdeab2 could not be found. Oct 17 14:11:08.684152 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3b054d4f-3c12-4b65-825e-8cb2fc4ce026 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Request method failure captured: Oct 17 14:11:08.684152 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/b06b769b-4e30-480d-9a2f-e5f9b9fdeab2 HTTP/1.1 Oct 17 14:11:08.684152 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 14:11:08.684152 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 14:11:08.684152 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 14:11:08.684152 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 14:11:08.684152 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 14:11:08.684152 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 14:11:08.684152 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 14:11:08.684152 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 14:11:08.684152 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTWEtsy_0u6O5cT91Q0fcrn0rlmp9ZlR_ltaj4KQavakrA49dHqsJ1VxDCENLc4UftJyCWuMlAbE-4cQF_nSivNEwFI9nYkmv2lCx0s3oq4gOaO_mnP6rs1IMgbETuVKgakbJPOtiQ0cBqf9IvUbnfugvBEZKkIADxsvfN4HCIOOAi3k Oct 17 14:11:08.684152 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 14:11:08.684152 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 14:11:08.684152 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 14:11:08.684152 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 14:11:08.684152 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 14:11:08.684152 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 14:11:08.684152 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: f716902fd72e44a2b2b7d0ef78f40b72 Oct 17 14:11:08.684152 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-TestServerBasicOps-682885150 Oct 17 14:11:08.684152 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 14:11:08.684152 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 14:11:08.684152 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f716902fd72e44a2b2b7d0ef78f40b72"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f716902fd72e44a2b2b7d0ef78f40b72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f716902fd72e44a2b2b7d0ef78f40b72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f716902fd72e44a2b2b7d0ef78f40b72", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:11:08.684152 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-TestServerBasicOps-682885150 Oct 17 14:11:08.684152 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: f716902fd72e44a2b2b7d0ef78f40b72 Oct 17 14:11:08.684152 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-TestServerBasicOps-682885150 Oct 17 14:11:08.684152 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-TestServerBasicOps-682885150-project Oct 17 14:11:08.684152 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 14:11:08.684152 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 14:11:08.684152 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 2a2ddceda0be42bf8cfe265f7a07d462 Oct 17 14:11:08.684152 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-TestServerBasicOps-682885150-project Oct 17 14:11:08.684152 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 14:11:08.684152 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance b06b769b-4e30-480d-9a2f-e5f9b9fdeab2 could not be found. Oct 17 14:11:08.684152 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'b06b769b-4e30-480d-9a2f-e5f9b9fdeab2'} Oct 17 14:11:08.684152 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:11:08.684152 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:11:08.684152 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:11:08.684152 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:11:08.684152 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:11:08.684152 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:11:08.684152 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:11:08.684152 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:11:08.684152 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:11:08.684152 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:11:08.684152 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b06b769b-4e30-480d-9a2f-e5f9b9fdeab2 could not be found. Oct 17 14:11:08.684152 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:11:08.684152 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:11:08.684152 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:11:08.684152 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:11:08.684152 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:11:08.684152 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:11:08.684152 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:11:08.684152 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:11:08.684152 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:11:08.684152 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:11:08.684152 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:11:08.684152 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:11:08.684152 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:11:08.684152 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:11:08.684152 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:11:08.684152 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:11:08.684152 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b06b769b-4e30-480d-9a2f-e5f9b9fdeab2 could not be found. Oct 17 14:11:08.684152 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:11:08.684152 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:11:08.684152 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:11:08.689014 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:11:08.689014 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:11:08.689014 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:11:08.689014 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:11:08.689014 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:11:08.689014 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b06b769b-4e30-480d-9a2f-e5f9b9fdeab2 could not be found. Oct 17 14:11:08.689014 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:11:08.690561 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3b054d4f-3c12-4b65-825e-8cb2fc4ce026 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Returning 404 to user: Instance b06b769b-4e30-480d-9a2f-e5f9b9fdeab2 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:11:08.691640 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3b054d4f-3c12-4b65-825e-8cb2fc4ce026 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] 10.222.0.79 "GET /compute/v2.1/servers/b06b769b-4e30-480d-9a2f-e5f9b9fdeab2" status: 404 len: 111 microversion: 2.1 time: 0.053550 Oct 17 14:11:08.692711 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2861/5590] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:08 2022] GET /compute/v2.1/servers/b06b769b-4e30-480d-9a2f-e5f9b9fdeab2 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:11:08.931688 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d73b1f3e-4653-473f-bc13-770e3763d308 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] Calling method '.version_select at 0x7f7cd405a5e0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:08.978215 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d73b1f3e-4653-473f-bc13-770e3763d308 tempest-TestServerBasicOps-682885150 tempest-TestServerBasicOps-682885150-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-164864169" status: 202 len: 0 microversion: 2.1 time: 0.052584 Oct 17 14:11:08.981096 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2862/5591] 10.222.0.79 () {58 vars in 1251 bytes} [Mon Oct 17 14:11:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-164864169 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:11:09.883357 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-66597dd1-7390-4d57-84e0-4800785dadee tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:11:09.883919 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-66597dd1-7390-4d57-84e0-4800785dadee tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:11:09.884223 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-66597dd1-7390-4d57-84e0-4800785dadee tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:11:09.884883 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-66597dd1-7390-4d57-84e0-4800785dadee tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:11:09.885448 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-66597dd1-7390-4d57-84e0-4800785dadee tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:11:09.896570 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-66597dd1-7390-4d57-84e0-4800785dadee tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:09.897398 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-66597dd1-7390-4d57-84e0-4800785dadee tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:09.898231 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-66597dd1-7390-4d57-84e0-4800785dadee tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:09.899119 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-66597dd1-7390-4d57-84e0-4800785dadee tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:09.899795 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-66597dd1-7390-4d57-84e0-4800785dadee tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:09.900540 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-66597dd1-7390-4d57-84e0-4800785dadee tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:09.920732 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-66597dd1-7390-4d57-84e0-4800785dadee tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Getting quotas for project d80057063fe547e794e5ecf3c7cbfd00. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:11:09.926879 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-66597dd1-7390-4d57-84e0-4800785dadee tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Getting quotas for user 3992c95d133f4ed29587db77478c110c and project d80057063fe547e794e5ecf3c7cbfd00. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:11:09.943010 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-66597dd1-7390-4d57-84e0-4800785dadee tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:11:09.945346 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-66597dd1-7390-4d57-84e0-4800785dadee tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] [instance: 8c62a605-4dd5-411c-9ad6-7a3fe65b73c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:11:10.035241 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-66597dd1-7390-4d57-84e0-4800785dadee tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.567657 Oct 17 14:11:10.036905 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2730/5592] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 14:11:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:11:10.049622 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-69b5e521-cc03-42c9-aa3f-13995b685a93 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:10.051012 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-69b5e521-cc03-42c9-aa3f-13995b685a93 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] [instance: 8c62a605-4dd5-411c-9ad6-7a3fe65b73c5] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:10.176516 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-69b5e521-cc03-42c9-aa3f-13995b685a93 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3992c95d133f4ed29587db77478c110c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80057063fe547e794e5ecf3c7cbfd00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:10.192231 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-69b5e521-cc03-42c9-aa3f-13995b685a93 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] 10.222.0.79 "GET /compute/v2.1/servers/8c62a605-4dd5-411c-9ad6-7a3fe65b73c5" status: 200 len: 1214 microversion: 2.1 time: 0.147082 Oct 17 14:11:10.193883 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2863/5593] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:10 2022] GET /compute/v2.1/servers/8c62a605-4dd5-411c-9ad6-7a3fe65b73c5 => generated 1214 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:11:11.221244 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-fd569000-2dcc-4980-bff2-d1f708adf25e tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:11.221995 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-fd569000-2dcc-4980-bff2-d1f708adf25e tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] [instance: 8c62a605-4dd5-411c-9ad6-7a3fe65b73c5] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:11.236658 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fd569000-2dcc-4980-bff2-d1f708adf25e tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:11.240674 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fd569000-2dcc-4980-bff2-d1f708adf25e tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:11.242080 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fd569000-2dcc-4980-bff2-d1f708adf25e tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:11.242858 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fd569000-2dcc-4980-bff2-d1f708adf25e tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:11.247692 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fd569000-2dcc-4980-bff2-d1f708adf25e tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:11.248243 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fd569000-2dcc-4980-bff2-d1f708adf25e tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:11.497775 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-fd569000-2dcc-4980-bff2-d1f708adf25e tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3992c95d133f4ed29587db77478c110c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80057063fe547e794e5ecf3c7cbfd00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:11.514024 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-fd569000-2dcc-4980-bff2-d1f708adf25e tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] 10.222.0.79 "GET /compute/v2.1/servers/8c62a605-4dd5-411c-9ad6-7a3fe65b73c5" status: 200 len: 1210 microversion: 2.1 time: 0.295104 Oct 17 14:11:11.547442 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2731/5594] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:11 2022] GET /compute/v2.1/servers/8c62a605-4dd5-411c-9ad6-7a3fe65b73c5 => generated 1210 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:11:12.542317 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e9dd18ea-bacb-4a8c-8355-a04514687688 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:12.544043 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e9dd18ea-bacb-4a8c-8355-a04514687688 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] [instance: 8c62a605-4dd5-411c-9ad6-7a3fe65b73c5] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:12.560292 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9dd18ea-bacb-4a8c-8355-a04514687688 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:12.561005 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9dd18ea-bacb-4a8c-8355-a04514687688 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:12.568008 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9dd18ea-bacb-4a8c-8355-a04514687688 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:12.569200 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9dd18ea-bacb-4a8c-8355-a04514687688 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:12.572629 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9dd18ea-bacb-4a8c-8355-a04514687688 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:12.573307 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9dd18ea-bacb-4a8c-8355-a04514687688 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:12.742808 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e9dd18ea-bacb-4a8c-8355-a04514687688 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3992c95d133f4ed29587db77478c110c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80057063fe547e794e5ecf3c7cbfd00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:12.756076 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e9dd18ea-bacb-4a8c-8355-a04514687688 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] 10.222.0.79 "GET /compute/v2.1/servers/8c62a605-4dd5-411c-9ad6-7a3fe65b73c5" status: 200 len: 1272 microversion: 2.1 time: 0.217641 Oct 17 14:11:12.759627 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2864/5595] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:12 2022] GET /compute/v2.1/servers/8c62a605-4dd5-411c-9ad6-7a3fe65b73c5 => generated 1272 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:11:13.786689 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c3a2790e-da28-4b3b-a74f-59a68e95d350 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:13.787367 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c3a2790e-da28-4b3b-a74f-59a68e95d350 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] [instance: 8c62a605-4dd5-411c-9ad6-7a3fe65b73c5] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:13.802763 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c3a2790e-da28-4b3b-a74f-59a68e95d350 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:13.803335 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c3a2790e-da28-4b3b-a74f-59a68e95d350 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:13.807231 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c3a2790e-da28-4b3b-a74f-59a68e95d350 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:13.807231 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c3a2790e-da28-4b3b-a74f-59a68e95d350 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:13.807231 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c3a2790e-da28-4b3b-a74f-59a68e95d350 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:13.807231 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c3a2790e-da28-4b3b-a74f-59a68e95d350 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:14.660926 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c3a2790e-da28-4b3b-a74f-59a68e95d350 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3992c95d133f4ed29587db77478c110c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80057063fe547e794e5ecf3c7cbfd00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:14.677072 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c3a2790e-da28-4b3b-a74f-59a68e95d350 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] 10.222.0.79 "GET /compute/v2.1/servers/8c62a605-4dd5-411c-9ad6-7a3fe65b73c5" status: 200 len: 1314 microversion: 2.1 time: 0.898873 Oct 17 14:11:14.677594 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2732/5596] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:13 2022] GET /compute/v2.1/servers/8c62a605-4dd5-411c-9ad6-7a3fe65b73c5 => generated 1314 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:11:15.540370 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-1bbecca8-86c8-45c4-876c-6ee7b769d88f req-1e9450dd-c9f8-4c06-8fe3-59ac1810f088 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c62a605-4dd5-411c-9ad6-7a3fe65b73c5", "tag": "782d75f5-0f98-4d1d-8f41-6602161a4e58"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:11:15.582985 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-1bbecca8-86c8-45c4-876c-6ee7b769d88f req-1e9450dd-c9f8-4c06-8fe3-59ac1810f088 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:15.587965 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-1bbecca8-86c8-45c4-876c-6ee7b769d88f req-1e9450dd-c9f8-4c06-8fe3-59ac1810f088 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:15.588463 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-1bbecca8-86c8-45c4-876c-6ee7b769d88f req-1e9450dd-c9f8-4c06-8fe3-59ac1810f088 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:15.615859 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-1bbecca8-86c8-45c4-876c-6ee7b769d88f req-1e9450dd-c9f8-4c06-8fe3-59ac1810f088 service nova] Creating event network-changed:782d75f5-0f98-4d1d-8f41-6602161a4e58 for instance 8c62a605-4dd5-411c-9ad6-7a3fe65b73c5 on n-h1-854247-14 Oct 17 14:11:15.631009 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-1bbecca8-86c8-45c4-876c-6ee7b769d88f req-1e9450dd-c9f8-4c06-8fe3-59ac1810f088 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100250 Oct 17 14:11:15.631636 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2865/5597] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:11:15.709610 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-73e1fd72-ab8b-43e9-865f-2433a6598a57 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:15.710455 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-73e1fd72-ab8b-43e9-865f-2433a6598a57 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] [instance: 8c62a605-4dd5-411c-9ad6-7a3fe65b73c5] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:15.730213 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-73e1fd72-ab8b-43e9-865f-2433a6598a57 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:15.731302 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-73e1fd72-ab8b-43e9-865f-2433a6598a57 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:15.731906 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-73e1fd72-ab8b-43e9-865f-2433a6598a57 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:15.732854 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-73e1fd72-ab8b-43e9-865f-2433a6598a57 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:15.733867 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-73e1fd72-ab8b-43e9-865f-2433a6598a57 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:15.734450 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-73e1fd72-ab8b-43e9-865f-2433a6598a57 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:16.310826 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-73e1fd72-ab8b-43e9-865f-2433a6598a57 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3992c95d133f4ed29587db77478c110c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80057063fe547e794e5ecf3c7cbfd00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:16.353478 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-73e1fd72-ab8b-43e9-865f-2433a6598a57 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] 10.222.0.79 "GET /compute/v2.1/servers/8c62a605-4dd5-411c-9ad6-7a3fe65b73c5" status: 200 len: 1314 microversion: 2.1 time: 0.652638 Oct 17 14:11:16.354154 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2733/5598] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:15 2022] GET /compute/v2.1/servers/8c62a605-4dd5-411c-9ad6-7a3fe65b73c5 => generated 1314 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:11:17.382781 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6300f923-1070-4bf9-9adf-32daf26c07be tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:17.383342 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6300f923-1070-4bf9-9adf-32daf26c07be tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] [instance: 8c62a605-4dd5-411c-9ad6-7a3fe65b73c5] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:17.396249 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6300f923-1070-4bf9-9adf-32daf26c07be tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:17.397390 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6300f923-1070-4bf9-9adf-32daf26c07be tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:17.399007 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6300f923-1070-4bf9-9adf-32daf26c07be tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:17.399800 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6300f923-1070-4bf9-9adf-32daf26c07be tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:17.400270 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6300f923-1070-4bf9-9adf-32daf26c07be tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:17.400719 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6300f923-1070-4bf9-9adf-32daf26c07be tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:18.353642 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6300f923-1070-4bf9-9adf-32daf26c07be tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3992c95d133f4ed29587db77478c110c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80057063fe547e794e5ecf3c7cbfd00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:18.365017 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6300f923-1070-4bf9-9adf-32daf26c07be tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] 10.222.0.79 "GET /compute/v2.1/servers/8c62a605-4dd5-411c-9ad6-7a3fe65b73c5" status: 200 len: 1314 microversion: 2.1 time: 0.985355 Oct 17 14:11:18.375846 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2866/5599] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:17 2022] GET /compute/v2.1/servers/8c62a605-4dd5-411c-9ad6-7a3fe65b73c5 => generated 1314 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:11:19.406870 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ec5bd92a-f566-41b5-a822-0f3570ed3412 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:19.408155 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ec5bd92a-f566-41b5-a822-0f3570ed3412 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] [instance: 8c62a605-4dd5-411c-9ad6-7a3fe65b73c5] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:19.421261 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ec5bd92a-f566-41b5-a822-0f3570ed3412 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:19.424357 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ec5bd92a-f566-41b5-a822-0f3570ed3412 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:19.428025 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ec5bd92a-f566-41b5-a822-0f3570ed3412 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:19.429378 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ec5bd92a-f566-41b5-a822-0f3570ed3412 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:19.431804 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ec5bd92a-f566-41b5-a822-0f3570ed3412 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:19.435310 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ec5bd92a-f566-41b5-a822-0f3570ed3412 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:19.697130 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ec5bd92a-f566-41b5-a822-0f3570ed3412 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3992c95d133f4ed29587db77478c110c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80057063fe547e794e5ecf3c7cbfd00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:19.709225 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ec5bd92a-f566-41b5-a822-0f3570ed3412 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] 10.222.0.79 "GET /compute/v2.1/servers/8c62a605-4dd5-411c-9ad6-7a3fe65b73c5" status: 200 len: 1314 microversion: 2.1 time: 0.306938 Oct 17 14:11:19.709848 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2734/5600] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:19 2022] GET /compute/v2.1/servers/8c62a605-4dd5-411c-9ad6-7a3fe65b73c5 => generated 1314 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:11:20.735408 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cdada596-ec46-426d-bafc-ecca03dfb838 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:20.736045 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cdada596-ec46-426d-bafc-ecca03dfb838 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] [instance: 8c62a605-4dd5-411c-9ad6-7a3fe65b73c5] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:20.756291 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:11:20.763544 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cdada596-ec46-426d-bafc-ecca03dfb838 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:20.765834 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cdada596-ec46-426d-bafc-ecca03dfb838 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:20.768092 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cdada596-ec46-426d-bafc-ecca03dfb838 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:20.771411 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cdada596-ec46-426d-bafc-ecca03dfb838 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:20.772302 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cdada596-ec46-426d-bafc-ecca03dfb838 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:20.772925 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cdada596-ec46-426d-bafc-ecca03dfb838 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:21.477351 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cdada596-ec46-426d-bafc-ecca03dfb838 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3992c95d133f4ed29587db77478c110c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80057063fe547e794e5ecf3c7cbfd00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:21.491756 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cdada596-ec46-426d-bafc-ecca03dfb838 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] 10.222.0.79 "GET /compute/v2.1/servers/8c62a605-4dd5-411c-9ad6-7a3fe65b73c5" status: 200 len: 1314 microversion: 2.1 time: 0.762000 Oct 17 14:11:21.496725 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2867/5601] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:20 2022] GET /compute/v2.1/servers/8c62a605-4dd5-411c-9ad6-7a3fe65b73c5 => generated 1314 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:11:22.530281 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9fda8049-7113-4c44-8d27-23353b7a49a2 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:22.530943 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9fda8049-7113-4c44-8d27-23353b7a49a2 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] [instance: 8c62a605-4dd5-411c-9ad6-7a3fe65b73c5] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:22.538899 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:11:22.541854 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=6 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:11:22.554996 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9fda8049-7113-4c44-8d27-23353b7a49a2 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:22.555738 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9fda8049-7113-4c44-8d27-23353b7a49a2 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:22.556353 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9fda8049-7113-4c44-8d27-23353b7a49a2 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:22.557228 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9fda8049-7113-4c44-8d27-23353b7a49a2 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:22.557881 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9fda8049-7113-4c44-8d27-23353b7a49a2 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:22.558498 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9fda8049-7113-4c44-8d27-23353b7a49a2 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:22.920517 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9fda8049-7113-4c44-8d27-23353b7a49a2 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3992c95d133f4ed29587db77478c110c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80057063fe547e794e5ecf3c7cbfd00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:22.934222 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9fda8049-7113-4c44-8d27-23353b7a49a2 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] 10.222.0.79 "GET /compute/v2.1/servers/8c62a605-4dd5-411c-9ad6-7a3fe65b73c5" status: 200 len: 1314 microversion: 2.1 time: 0.410532 Oct 17 14:11:22.939653 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2735/5602] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:22 2022] GET /compute/v2.1/servers/8c62a605-4dd5-411c-9ad6-7a3fe65b73c5 => generated 1314 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:11:23.971299 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9fc932c4-5610-44de-b2a9-23647a95ebe1 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:23.973092 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9fc932c4-5610-44de-b2a9-23647a95ebe1 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] [instance: 8c62a605-4dd5-411c-9ad6-7a3fe65b73c5] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:23.987374 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9fc932c4-5610-44de-b2a9-23647a95ebe1 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:23.987374 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9fc932c4-5610-44de-b2a9-23647a95ebe1 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:23.987374 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9fc932c4-5610-44de-b2a9-23647a95ebe1 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:23.988177 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9fc932c4-5610-44de-b2a9-23647a95ebe1 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:23.991288 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9fc932c4-5610-44de-b2a9-23647a95ebe1 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:23.992013 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9fc932c4-5610-44de-b2a9-23647a95ebe1 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:24.109236 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-1ff2d1a8-3992-45d9-a617-656e59823c20 req-12a71f20-def0-4ae7-a894-478b7f271566 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c62a605-4dd5-411c-9ad6-7a3fe65b73c5", "name": "network-vif-plugged", "status": "completed", "tag": "782d75f5-0f98-4d1d-8f41-6602161a4e58"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:11:24.134225 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-1ff2d1a8-3992-45d9-a617-656e59823c20 req-12a71f20-def0-4ae7-a894-478b7f271566 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:24.135129 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-1ff2d1a8-3992-45d9-a617-656e59823c20 req-12a71f20-def0-4ae7-a894-478b7f271566 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:24.135893 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-1ff2d1a8-3992-45d9-a617-656e59823c20 req-12a71f20-def0-4ae7-a894-478b7f271566 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:24.157383 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-1ff2d1a8-3992-45d9-a617-656e59823c20 req-12a71f20-def0-4ae7-a894-478b7f271566 service nova] Creating event network-vif-plugged:782d75f5-0f98-4d1d-8f41-6602161a4e58 for instance 8c62a605-4dd5-411c-9ad6-7a3fe65b73c5 on n-h1-854247-14 Oct 17 14:11:24.172165 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-1ff2d1a8-3992-45d9-a617-656e59823c20 req-12a71f20-def0-4ae7-a894-478b7f271566 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066917 Oct 17 14:11:24.174896 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2736/5603] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:11:24.757678 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9fc932c4-5610-44de-b2a9-23647a95ebe1 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3992c95d133f4ed29587db77478c110c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80057063fe547e794e5ecf3c7cbfd00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:24.778596 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9fc932c4-5610-44de-b2a9-23647a95ebe1 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] 10.222.0.79 "GET /compute/v2.1/servers/8c62a605-4dd5-411c-9ad6-7a3fe65b73c5" status: 200 len: 1314 microversion: 2.1 time: 0.804351 Oct 17 14:11:24.782696 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2868/5604] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:23 2022] GET /compute/v2.1/servers/8c62a605-4dd5-411c-9ad6-7a3fe65b73c5 => generated 1314 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:11:25.808828 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-57ebf9d0-3420-4c79-9090-071f35728ee7 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:25.809545 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-57ebf9d0-3420-4c79-9090-071f35728ee7 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] [instance: 8c62a605-4dd5-411c-9ad6-7a3fe65b73c5] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:25.822907 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-57ebf9d0-3420-4c79-9090-071f35728ee7 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:25.824608 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-57ebf9d0-3420-4c79-9090-071f35728ee7 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:25.825019 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-57ebf9d0-3420-4c79-9090-071f35728ee7 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:25.827935 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-57ebf9d0-3420-4c79-9090-071f35728ee7 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:25.828815 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-57ebf9d0-3420-4c79-9090-071f35728ee7 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:25.831158 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-57ebf9d0-3420-4c79-9090-071f35728ee7 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:26.064928 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-57ebf9d0-3420-4c79-9090-071f35728ee7 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3992c95d133f4ed29587db77478c110c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80057063fe547e794e5ecf3c7cbfd00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:26.076576 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-57ebf9d0-3420-4c79-9090-071f35728ee7 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] 10.222.0.79 "GET /compute/v2.1/servers/8c62a605-4dd5-411c-9ad6-7a3fe65b73c5" status: 200 len: 1499 microversion: 2.1 time: 0.275042 Oct 17 14:11:26.077165 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2737/5605] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:25 2022] GET /compute/v2.1/servers/8c62a605-4dd5-411c-9ad6-7a3fe65b73c5 => generated 1499 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:11:26.831638 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-94915c97-ea0e-4612-81ca-ec147dbc3c2c tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:26.832223 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-94915c97-ea0e-4612-81ca-ec147dbc3c2c tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] [instance: 8c62a605-4dd5-411c-9ad6-7a3fe65b73c5] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:26.842700 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94915c97-ea0e-4612-81ca-ec147dbc3c2c tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:26.847465 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94915c97-ea0e-4612-81ca-ec147dbc3c2c tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:26.848087 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94915c97-ea0e-4612-81ca-ec147dbc3c2c tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:26.848865 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94915c97-ea0e-4612-81ca-ec147dbc3c2c tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:26.850186 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94915c97-ea0e-4612-81ca-ec147dbc3c2c tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:26.850883 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94915c97-ea0e-4612-81ca-ec147dbc3c2c tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:26.920084 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-94915c97-ea0e-4612-81ca-ec147dbc3c2c tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] [instance: 8c62a605-4dd5-411c-9ad6-7a3fe65b73c5] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:11:27.045554 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-94915c97-ea0e-4612-81ca-ec147dbc3c2c tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] 10.222.0.79 "DELETE /compute/v2.1/servers/8c62a605-4dd5-411c-9ad6-7a3fe65b73c5" status: 204 len: 0 microversion: 2.1 time: 0.219315 Oct 17 14:11:27.047096 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2869/5606] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:11:26 2022] DELETE /compute/v2.1/servers/8c62a605-4dd5-411c-9ad6-7a3fe65b73c5 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:11:27.058876 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4b2ad114-5d6e-4bdf-af56-b2cae0532ab3 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:27.059547 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4b2ad114-5d6e-4bdf-af56-b2cae0532ab3 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] [instance: 8c62a605-4dd5-411c-9ad6-7a3fe65b73c5] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:27.071474 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4b2ad114-5d6e-4bdf-af56-b2cae0532ab3 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:27.072164 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4b2ad114-5d6e-4bdf-af56-b2cae0532ab3 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:27.073863 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4b2ad114-5d6e-4bdf-af56-b2cae0532ab3 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:27.074764 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4b2ad114-5d6e-4bdf-af56-b2cae0532ab3 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:27.078719 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4b2ad114-5d6e-4bdf-af56-b2cae0532ab3 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:27.079401 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4b2ad114-5d6e-4bdf-af56-b2cae0532ab3 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:27.361824 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4b2ad114-5d6e-4bdf-af56-b2cae0532ab3 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3992c95d133f4ed29587db77478c110c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80057063fe547e794e5ecf3c7cbfd00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:27.373917 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4b2ad114-5d6e-4bdf-af56-b2cae0532ab3 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] 10.222.0.79 "GET /compute/v2.1/servers/8c62a605-4dd5-411c-9ad6-7a3fe65b73c5" status: 200 len: 1505 microversion: 2.1 time: 0.321891 Oct 17 14:11:27.378435 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2738/5607] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:27 2022] GET /compute/v2.1/servers/8c62a605-4dd5-411c-9ad6-7a3fe65b73c5 => generated 1505 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:11:28.402162 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8a431d9f-6a85-4008-aca0-c9a55f7d7629 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:28.403533 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8a431d9f-6a85-4008-aca0-c9a55f7d7629 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] [instance: 8c62a605-4dd5-411c-9ad6-7a3fe65b73c5] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:28.410759 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:11:28.412762 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8a431d9f-6a85-4008-aca0-c9a55f7d7629 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:28.413478 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8a431d9f-6a85-4008-aca0-c9a55f7d7629 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:28.414089 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8a431d9f-6a85-4008-aca0-c9a55f7d7629 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:28.414969 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8a431d9f-6a85-4008-aca0-c9a55f7d7629 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:28.415770 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8a431d9f-6a85-4008-aca0-c9a55f7d7629 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:28.416366 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8a431d9f-6a85-4008-aca0-c9a55f7d7629 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:28.455953 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:11:28.691225 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8a431d9f-6a85-4008-aca0-c9a55f7d7629 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3992c95d133f4ed29587db77478c110c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80057063fe547e794e5ecf3c7cbfd00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:28.719766 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8a431d9f-6a85-4008-aca0-c9a55f7d7629 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] 10.222.0.79 "GET /compute/v2.1/servers/8c62a605-4dd5-411c-9ad6-7a3fe65b73c5" status: 200 len: 1505 microversion: 2.1 time: 0.322263 Oct 17 14:11:28.723121 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2870/5608] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:28 2022] GET /compute/v2.1/servers/8c62a605-4dd5-411c-9ad6-7a3fe65b73c5 => generated 1505 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:11:29.097288 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-5e6731ce-8185-4c38-a272-655533871292 req-fcf7c8db-069d-4fff-97d5-815b50d4f404 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c62a605-4dd5-411c-9ad6-7a3fe65b73c5", "name": "network-vif-deleted", "tag": "782d75f5-0f98-4d1d-8f41-6602161a4e58"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:11:29.148724 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:11:29.155122 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-5e6731ce-8185-4c38-a272-655533871292 req-fcf7c8db-069d-4fff-97d5-815b50d4f404 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:29.159877 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-5e6731ce-8185-4c38-a272-655533871292 req-fcf7c8db-069d-4fff-97d5-815b50d4f404 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:29.160403 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-5e6731ce-8185-4c38-a272-655533871292 req-fcf7c8db-069d-4fff-97d5-815b50d4f404 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:29.167456 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:11:29.200336 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-5e6731ce-8185-4c38-a272-655533871292 req-fcf7c8db-069d-4fff-97d5-815b50d4f404 service nova] Creating event network-vif-deleted:782d75f5-0f98-4d1d-8f41-6602161a4e58 for instance 8c62a605-4dd5-411c-9ad6-7a3fe65b73c5 on n-h1-854247-14 Oct 17 14:11:29.215137 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-5e6731ce-8185-4c38-a272-655533871292 req-fcf7c8db-069d-4fff-97d5-815b50d4f404 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126202 Oct 17 14:11:29.219363 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2739/5609] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:11:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:11:29.748805 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-aa1c398b-2e8f-412a-a52d-e7d718f962bc tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:29.749496 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-aa1c398b-2e8f-412a-a52d-e7d718f962bc tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] [instance: 8c62a605-4dd5-411c-9ad6-7a3fe65b73c5] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:29.764800 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aa1c398b-2e8f-412a-a52d-e7d718f962bc tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:29.772844 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aa1c398b-2e8f-412a-a52d-e7d718f962bc tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:29.773951 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aa1c398b-2e8f-412a-a52d-e7d718f962bc tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:29.775545 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aa1c398b-2e8f-412a-a52d-e7d718f962bc tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:29.776035 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aa1c398b-2e8f-412a-a52d-e7d718f962bc tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:29.776878 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aa1c398b-2e8f-412a-a52d-e7d718f962bc tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:29.861721 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aa1c398b-2e8f-412a-a52d-e7d718f962bc tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:29.862455 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aa1c398b-2e8f-412a-a52d-e7d718f962bc tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:29.863706 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aa1c398b-2e8f-412a-a52d-e7d718f962bc tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:29.865443 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-aa1c398b-2e8f-412a-a52d-e7d718f962bc tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lazy-loading 'fault' on Instance uuid 8c62a605-4dd5-411c-9ad6-7a3fe65b73c5 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:11:29.984350 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-aa1c398b-2e8f-412a-a52d-e7d718f962bc tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3992c95d133f4ed29587db77478c110c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80057063fe547e794e5ecf3c7cbfd00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:29.992183 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-aa1c398b-2e8f-412a-a52d-e7d718f962bc tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] 10.222.0.79 "GET /compute/v2.1/servers/8c62a605-4dd5-411c-9ad6-7a3fe65b73c5" status: 200 len: 1304 microversion: 2.1 time: 0.247267 Oct 17 14:11:29.992986 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2871/5610] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:29 2022] GET /compute/v2.1/servers/8c62a605-4dd5-411c-9ad6-7a3fe65b73c5 => generated 1304 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:11:31.021564 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d29f78d6-0b2e-4ab0-94d5-6f2d8d6c836f tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:31.022640 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d29f78d6-0b2e-4ab0-94d5-6f2d8d6c836f tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] [instance: 8c62a605-4dd5-411c-9ad6-7a3fe65b73c5] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:31.031886 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d29f78d6-0b2e-4ab0-94d5-6f2d8d6c836f tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:31.032708 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d29f78d6-0b2e-4ab0-94d5-6f2d8d6c836f tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:31.033410 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d29f78d6-0b2e-4ab0-94d5-6f2d8d6c836f tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:31.034556 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d29f78d6-0b2e-4ab0-94d5-6f2d8d6c836f tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:31.046700 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d29f78d6-0b2e-4ab0-94d5-6f2d8d6c836f tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:31.047555 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d29f78d6-0b2e-4ab0-94d5-6f2d8d6c836f tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:31.070109 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-d29f78d6-0b2e-4ab0-94d5-6f2d8d6c836f tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] HTTP exception thrown: Instance 8c62a605-4dd5-411c-9ad6-7a3fe65b73c5 could not be found. Oct 17 14:11:31.071735 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d29f78d6-0b2e-4ab0-94d5-6f2d8d6c836f tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Request method failure captured: Oct 17 14:11:31.071735 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/8c62a605-4dd5-411c-9ad6-7a3fe65b73c5 HTTP/1.1 Oct 17 14:11:31.071735 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 14:11:31.071735 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 14:11:31.071735 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 14:11:31.071735 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 14:11:31.071735 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 14:11:31.071735 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 14:11:31.071735 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 14:11:31.071735 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 14:11:31.071735 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTWJ4BlNQmyIPeglHZLNtIWqa24eLIHAQusCZKneeoo9G8MX66yRy_OJnp-UnYyhFqTV5dVJRlVJEyiiSt5gJYurDZZqHF8s0on8vboAlJ-HJttz-exe0NjGP-YrDbQTzsrCui-BknFjkLzr0M33h_662gUrxyuunOeFwpmVs_oa-mxE Oct 17 14:11:31.071735 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 14:11:31.071735 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 14:11:31.071735 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 14:11:31.071735 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 14:11:31.071735 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 14:11:31.071735 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 14:11:31.071735 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: d80057063fe547e794e5ecf3c7cbfd00 Oct 17 14:11:31.071735 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-VolumesActionsTest-1118010255 Oct 17 14:11:31.071735 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 14:11:31.071735 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 14:11:31.071735 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d80057063fe547e794e5ecf3c7cbfd00"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d80057063fe547e794e5ecf3c7cbfd00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d80057063fe547e794e5ecf3c7cbfd00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d80057063fe547e794e5ecf3c7cbfd00", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:11:31.071735 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-VolumesActionsTest-1118010255 Oct 17 14:11:31.071735 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: d80057063fe547e794e5ecf3c7cbfd00 Oct 17 14:11:31.071735 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-VolumesActionsTest-1118010255 Oct 17 14:11:31.071735 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-VolumesActionsTest-1118010255-project Oct 17 14:11:31.071735 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 14:11:31.071735 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 14:11:31.071735 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 3992c95d133f4ed29587db77478c110c Oct 17 14:11:31.071735 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-VolumesActionsTest-1118010255-project Oct 17 14:11:31.071735 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 14:11:31.071735 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 8c62a605-4dd5-411c-9ad6-7a3fe65b73c5 could not be found. Oct 17 14:11:31.071735 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '8c62a605-4dd5-411c-9ad6-7a3fe65b73c5'} Oct 17 14:11:31.071735 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:11:31.071735 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:11:31.071735 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:11:31.071735 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:11:31.071735 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:11:31.071735 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:11:31.071735 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:11:31.071735 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:11:31.071735 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:11:31.071735 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:11:31.071735 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c62a605-4dd5-411c-9ad6-7a3fe65b73c5 could not be found. Oct 17 14:11:31.071735 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:11:31.071735 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:11:31.071735 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:11:31.071735 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:11:31.071735 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:11:31.071735 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:11:31.071735 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:11:31.071735 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:11:31.071735 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:11:31.071735 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:11:31.071735 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:11:31.071735 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:11:31.071735 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:11:31.071735 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:11:31.071735 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:11:31.071735 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:11:31.071735 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c62a605-4dd5-411c-9ad6-7a3fe65b73c5 could not be found. Oct 17 14:11:31.071735 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:11:31.071735 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:11:31.071735 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:11:31.077140 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:11:31.077140 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:11:31.077140 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:11:31.077140 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:11:31.077140 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:11:31.077140 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c62a605-4dd5-411c-9ad6-7a3fe65b73c5 could not be found. Oct 17 14:11:31.077140 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:11:31.077140 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d29f78d6-0b2e-4ab0-94d5-6f2d8d6c836f tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Returning 404 to user: Instance 8c62a605-4dd5-411c-9ad6-7a3fe65b73c5 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:11:31.077140 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d29f78d6-0b2e-4ab0-94d5-6f2d8d6c836f tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] 10.222.0.79 "GET /compute/v2.1/servers/8c62a605-4dd5-411c-9ad6-7a3fe65b73c5" status: 404 len: 111 microversion: 2.1 time: 0.059170 Oct 17 14:11:31.083761 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2740/5611] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:31 2022] GET /compute/v2.1/servers/8c62a605-4dd5-411c-9ad6-7a3fe65b73c5 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:11:31.277825 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c950e744-2e18-4e98-acf4-b3dbcc6a77b0 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1651171376", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "b66f1909-4555-43e7-abd3-6112185491c9"}]}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:11:31.349436 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-c950e744-2e18-4e98-acf4-b3dbcc6a77b0 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] validate_networks() for [('b66f1909-4555-43e7-abd3-6112185491c9', None, None, None, None, None)] {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:11:32.137076 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-c950e744-2e18-4e98-acf4-b3dbcc6a77b0 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:11:32.137791 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-c950e744-2e18-4e98-acf4-b3dbcc6a77b0 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:11:32.138634 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-c950e744-2e18-4e98-acf4-b3dbcc6a77b0 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:11:32.139278 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-c950e744-2e18-4e98-acf4-b3dbcc6a77b0 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:11:32.140628 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-c950e744-2e18-4e98-acf4-b3dbcc6a77b0 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:11:32.154010 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c950e744-2e18-4e98-acf4-b3dbcc6a77b0 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:32.154811 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c950e744-2e18-4e98-acf4-b3dbcc6a77b0 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:32.157001 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c950e744-2e18-4e98-acf4-b3dbcc6a77b0 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:32.158226 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c950e744-2e18-4e98-acf4-b3dbcc6a77b0 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:32.158994 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c950e744-2e18-4e98-acf4-b3dbcc6a77b0 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:32.160002 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c950e744-2e18-4e98-acf4-b3dbcc6a77b0 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:32.184155 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-c950e744-2e18-4e98-acf4-b3dbcc6a77b0 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Getting quotas for project d80057063fe547e794e5ecf3c7cbfd00. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:11:32.191972 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-c950e744-2e18-4e98-acf4-b3dbcc6a77b0 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Getting quotas for user 3992c95d133f4ed29587db77478c110c and project d80057063fe547e794e5ecf3c7cbfd00. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:11:32.220390 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c950e744-2e18-4e98-acf4-b3dbcc6a77b0 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:11:32.224344 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c950e744-2e18-4e98-acf4-b3dbcc6a77b0 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] [instance: dde46f51-ce50-4e1b-af0f-e233af2935b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:11:32.330830 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c950e744-2e18-4e98-acf4-b3dbcc6a77b0 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.063981 Oct 17 14:11:32.335066 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2872/5612] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 14:11:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1069 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:11:32.346926 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-16854790-d8cd-493f-93d3-4e8677353290 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:32.348267 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-16854790-d8cd-493f-93d3-4e8677353290 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] [instance: dde46f51-ce50-4e1b-af0f-e233af2935b3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:32.531883 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-16854790-d8cd-493f-93d3-4e8677353290 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3992c95d133f4ed29587db77478c110c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80057063fe547e794e5ecf3c7cbfd00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:32.541666 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-16854790-d8cd-493f-93d3-4e8677353290 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] 10.222.0.79 "GET /compute/v2.1/servers/dde46f51-ce50-4e1b-af0f-e233af2935b3" status: 200 len: 1214 microversion: 2.1 time: 0.199064 Oct 17 14:11:32.555803 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2741/5613] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:32 2022] GET /compute/v2.1/servers/dde46f51-ce50-4e1b-af0f-e233af2935b3 => generated 1214 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:11:33.569058 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-bab81f0c-8bb7-4dcd-b645-99441b2f571f tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:33.569669 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-bab81f0c-8bb7-4dcd-b645-99441b2f571f tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] [instance: dde46f51-ce50-4e1b-af0f-e233af2935b3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:33.580487 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bab81f0c-8bb7-4dcd-b645-99441b2f571f tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:33.580965 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bab81f0c-8bb7-4dcd-b645-99441b2f571f tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:33.581395 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bab81f0c-8bb7-4dcd-b645-99441b2f571f tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:33.582137 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bab81f0c-8bb7-4dcd-b645-99441b2f571f tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:33.582696 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bab81f0c-8bb7-4dcd-b645-99441b2f571f tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:33.583117 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bab81f0c-8bb7-4dcd-b645-99441b2f571f tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:33.676520 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-bab81f0c-8bb7-4dcd-b645-99441b2f571f tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3992c95d133f4ed29587db77478c110c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80057063fe547e794e5ecf3c7cbfd00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:33.687093 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-bab81f0c-8bb7-4dcd-b645-99441b2f571f tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] 10.222.0.79 "GET /compute/v2.1/servers/dde46f51-ce50-4e1b-af0f-e233af2935b3" status: 200 len: 1266 microversion: 2.1 time: 0.122182 Oct 17 14:11:33.703107 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2873/5614] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:33 2022] GET /compute/v2.1/servers/dde46f51-ce50-4e1b-af0f-e233af2935b3 => generated 1266 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:11:34.710369 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9f6840d7-30d2-40c4-8d37-4fcdecf3422b tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:34.710925 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9f6840d7-30d2-40c4-8d37-4fcdecf3422b tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] [instance: dde46f51-ce50-4e1b-af0f-e233af2935b3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:34.717738 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f6840d7-30d2-40c4-8d37-4fcdecf3422b tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:34.718577 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f6840d7-30d2-40c4-8d37-4fcdecf3422b tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:34.719353 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f6840d7-30d2-40c4-8d37-4fcdecf3422b tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:34.720217 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f6840d7-30d2-40c4-8d37-4fcdecf3422b tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:34.720811 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f6840d7-30d2-40c4-8d37-4fcdecf3422b tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:34.721377 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f6840d7-30d2-40c4-8d37-4fcdecf3422b tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:35.437297 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9f6840d7-30d2-40c4-8d37-4fcdecf3422b tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3992c95d133f4ed29587db77478c110c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80057063fe547e794e5ecf3c7cbfd00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:35.445814 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9f6840d7-30d2-40c4-8d37-4fcdecf3422b tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] 10.222.0.79 "GET /compute/v2.1/servers/dde46f51-ce50-4e1b-af0f-e233af2935b3" status: 200 len: 1314 microversion: 2.1 time: 0.739379 Oct 17 14:11:35.446532 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2742/5615] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:34 2022] GET /compute/v2.1/servers/dde46f51-ce50-4e1b-af0f-e233af2935b3 => generated 1314 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:11:35.835524 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2507c2d1-e67c-4506-befd-1c1a1c1d8b45 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:35.836004 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2507c2d1-e67c-4506-befd-1c1a1c1d8b45 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] [instance: 2d074012-fb86-4395-b8f5-3288f5677c84] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:35.849141 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2507c2d1-e67c-4506-befd-1c1a1c1d8b45 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:35.849734 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2507c2d1-e67c-4506-befd-1c1a1c1d8b45 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:35.850074 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2507c2d1-e67c-4506-befd-1c1a1c1d8b45 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:35.850772 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2507c2d1-e67c-4506-befd-1c1a1c1d8b45 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:35.851260 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2507c2d1-e67c-4506-befd-1c1a1c1d8b45 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:35.851674 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2507c2d1-e67c-4506-befd-1c1a1c1d8b45 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:35.949998 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-2507c2d1-e67c-4506-befd-1c1a1c1d8b45 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lazy-loading 'services' on Instance uuid 2d074012-fb86-4395-b8f5-3288f5677c84 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:11:36.115112 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2507c2d1-e67c-4506-befd-1c1a1c1d8b45 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] 10.222.0.79 "DELETE /compute/v2.1/servers/2d074012-fb86-4395-b8f5-3288f5677c84/os-volume_attachments/e808c92b-69ff-455f-9654-0189c71ff7e5" status: 202 len: 0 microversion: 2.1 time: 0.282858 Oct 17 14:11:36.120343 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2874/5616] 10.222.0.79 () {58 vars in 1416 bytes} [Mon Oct 17 14:11:35 2022] DELETE /compute/v2.1/servers/2d074012-fb86-4395-b8f5-3288f5677c84/os-volume_attachments/e808c92b-69ff-455f-9654-0189c71ff7e5 => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:11:36.278020 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-283d3e06-64a4-48ed-aff3-f5ef92a99934 req-5970467c-448a-431d-a2f0-acaeea2fad32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dde46f51-ce50-4e1b-af0f-e233af2935b3", "tag": "8bcdec62-f683-4630-b1cc-04d4d5c37cbb"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:11:36.290204 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-283d3e06-64a4-48ed-aff3-f5ef92a99934 req-5970467c-448a-431d-a2f0-acaeea2fad32 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:36.290752 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-283d3e06-64a4-48ed-aff3-f5ef92a99934 req-5970467c-448a-431d-a2f0-acaeea2fad32 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:36.291218 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-283d3e06-64a4-48ed-aff3-f5ef92a99934 req-5970467c-448a-431d-a2f0-acaeea2fad32 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:36.307055 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-283d3e06-64a4-48ed-aff3-f5ef92a99934 req-5970467c-448a-431d-a2f0-acaeea2fad32 service nova] Creating event network-changed:8bcdec62-f683-4630-b1cc-04d4d5c37cbb for instance dde46f51-ce50-4e1b-af0f-e233af2935b3 on n-h1-854247-14 Oct 17 14:11:36.316573 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-283d3e06-64a4-48ed-aff3-f5ef92a99934 req-5970467c-448a-431d-a2f0-acaeea2fad32 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042467 Oct 17 14:11:36.318057 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2743/5617] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:11:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:11:36.471884 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0e16a5c1-c579-4299-8f26-adb8c1687af7 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:36.473568 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0e16a5c1-c579-4299-8f26-adb8c1687af7 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] [instance: dde46f51-ce50-4e1b-af0f-e233af2935b3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:36.480505 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0e16a5c1-c579-4299-8f26-adb8c1687af7 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:36.481073 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0e16a5c1-c579-4299-8f26-adb8c1687af7 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:36.481584 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0e16a5c1-c579-4299-8f26-adb8c1687af7 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:36.482475 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0e16a5c1-c579-4299-8f26-adb8c1687af7 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:36.482926 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0e16a5c1-c579-4299-8f26-adb8c1687af7 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:36.483372 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0e16a5c1-c579-4299-8f26-adb8c1687af7 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:36.722034 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0e16a5c1-c579-4299-8f26-adb8c1687af7 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3992c95d133f4ed29587db77478c110c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80057063fe547e794e5ecf3c7cbfd00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:36.735452 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0e16a5c1-c579-4299-8f26-adb8c1687af7 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] 10.222.0.79 "GET /compute/v2.1/servers/dde46f51-ce50-4e1b-af0f-e233af2935b3" status: 200 len: 1314 microversion: 2.1 time: 0.268118 Oct 17 14:11:36.744969 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2875/5618] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:36 2022] GET /compute/v2.1/servers/dde46f51-ce50-4e1b-af0f-e233af2935b3 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:11:37.759621 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c5022296-5402-4edf-8c23-c6516ba1084b tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:37.760346 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c5022296-5402-4edf-8c23-c6516ba1084b tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] [instance: dde46f51-ce50-4e1b-af0f-e233af2935b3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:37.771415 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c5022296-5402-4edf-8c23-c6516ba1084b tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:37.777112 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c5022296-5402-4edf-8c23-c6516ba1084b tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:37.777564 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c5022296-5402-4edf-8c23-c6516ba1084b tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:37.778305 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c5022296-5402-4edf-8c23-c6516ba1084b tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:37.778762 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c5022296-5402-4edf-8c23-c6516ba1084b tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:37.779208 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c5022296-5402-4edf-8c23-c6516ba1084b tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:38.042328 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c5022296-5402-4edf-8c23-c6516ba1084b tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3992c95d133f4ed29587db77478c110c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80057063fe547e794e5ecf3c7cbfd00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:38.056250 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c5022296-5402-4edf-8c23-c6516ba1084b tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] 10.222.0.79 "GET /compute/v2.1/servers/dde46f51-ce50-4e1b-af0f-e233af2935b3" status: 200 len: 1314 microversion: 2.1 time: 0.301803 Oct 17 14:11:38.057571 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2744/5619] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:37 2022] GET /compute/v2.1/servers/dde46f51-ce50-4e1b-af0f-e233af2935b3 => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:11:39.081661 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-44b2c51d-a56a-4b12-a7ab-7864c0adec8c tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:39.082941 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-44b2c51d-a56a-4b12-a7ab-7864c0adec8c tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] [instance: dde46f51-ce50-4e1b-af0f-e233af2935b3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:39.091565 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-44b2c51d-a56a-4b12-a7ab-7864c0adec8c tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:39.092687 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-44b2c51d-a56a-4b12-a7ab-7864c0adec8c tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:39.093410 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-44b2c51d-a56a-4b12-a7ab-7864c0adec8c tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:39.095721 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-44b2c51d-a56a-4b12-a7ab-7864c0adec8c tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:39.096408 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-44b2c51d-a56a-4b12-a7ab-7864c0adec8c tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:39.097016 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-44b2c51d-a56a-4b12-a7ab-7864c0adec8c tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:39.325899 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-44b2c51d-a56a-4b12-a7ab-7864c0adec8c tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3992c95d133f4ed29587db77478c110c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80057063fe547e794e5ecf3c7cbfd00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:39.335973 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-44b2c51d-a56a-4b12-a7ab-7864c0adec8c tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] 10.222.0.79 "GET /compute/v2.1/servers/dde46f51-ce50-4e1b-af0f-e233af2935b3" status: 200 len: 1314 microversion: 2.1 time: 0.259167 Oct 17 14:11:39.360663 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2876/5620] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:39 2022] GET /compute/v2.1/servers/dde46f51-ce50-4e1b-af0f-e233af2935b3 => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:11:40.384297 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-03a6a823-926c-406f-9d4b-aab8fc699b23 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:40.384909 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-03a6a823-926c-406f-9d4b-aab8fc699b23 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] [instance: dde46f51-ce50-4e1b-af0f-e233af2935b3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:40.399494 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-03a6a823-926c-406f-9d4b-aab8fc699b23 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:40.400220 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-03a6a823-926c-406f-9d4b-aab8fc699b23 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:40.401013 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-03a6a823-926c-406f-9d4b-aab8fc699b23 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:40.401904 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-03a6a823-926c-406f-9d4b-aab8fc699b23 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:40.402528 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-03a6a823-926c-406f-9d4b-aab8fc699b23 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:40.403201 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-03a6a823-926c-406f-9d4b-aab8fc699b23 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:40.607981 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-03a6a823-926c-406f-9d4b-aab8fc699b23 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3992c95d133f4ed29587db77478c110c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80057063fe547e794e5ecf3c7cbfd00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:40.616748 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-03a6a823-926c-406f-9d4b-aab8fc699b23 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] 10.222.0.79 "GET /compute/v2.1/servers/dde46f51-ce50-4e1b-af0f-e233af2935b3" status: 200 len: 1314 microversion: 2.1 time: 0.243556 Oct 17 14:11:40.623254 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2745/5621] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:40 2022] GET /compute/v2.1/servers/dde46f51-ce50-4e1b-af0f-e233af2935b3 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:11:41.640999 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2ba29b52-a76f-43c0-8710-7ccafa4a0eab tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:41.642279 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2ba29b52-a76f-43c0-8710-7ccafa4a0eab tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] [instance: dde46f51-ce50-4e1b-af0f-e233af2935b3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:41.650436 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2ba29b52-a76f-43c0-8710-7ccafa4a0eab tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:41.650922 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2ba29b52-a76f-43c0-8710-7ccafa4a0eab tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:41.651369 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2ba29b52-a76f-43c0-8710-7ccafa4a0eab tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:41.652266 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2ba29b52-a76f-43c0-8710-7ccafa4a0eab tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:41.652719 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2ba29b52-a76f-43c0-8710-7ccafa4a0eab tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:41.653136 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2ba29b52-a76f-43c0-8710-7ccafa4a0eab tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:41.785465 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6d4f48bb-88c1-4884-bc02-ee6e6b6f37bc tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:41.786698 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6d4f48bb-88c1-4884-bc02-ee6e6b6f37bc tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] [instance: 2d074012-fb86-4395-b8f5-3288f5677c84] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:41.794634 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6d4f48bb-88c1-4884-bc02-ee6e6b6f37bc tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:41.795409 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6d4f48bb-88c1-4884-bc02-ee6e6b6f37bc tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:41.796080 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6d4f48bb-88c1-4884-bc02-ee6e6b6f37bc tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:41.797284 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6d4f48bb-88c1-4884-bc02-ee6e6b6f37bc tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:41.798150 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6d4f48bb-88c1-4884-bc02-ee6e6b6f37bc tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:41.799429 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6d4f48bb-88c1-4884-bc02-ee6e6b6f37bc tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:41.828549 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2ba29b52-a76f-43c0-8710-7ccafa4a0eab tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3992c95d133f4ed29587db77478c110c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80057063fe547e794e5ecf3c7cbfd00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:41.838459 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2ba29b52-a76f-43c0-8710-7ccafa4a0eab tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] 10.222.0.79 "GET /compute/v2.1/servers/dde46f51-ce50-4e1b-af0f-e233af2935b3" status: 200 len: 1314 microversion: 2.1 time: 0.201869 Oct 17 14:11:41.839662 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2877/5622] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:41 2022] GET /compute/v2.1/servers/dde46f51-ce50-4e1b-af0f-e233af2935b3 => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:11:41.855021 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6d4f48bb-88c1-4884-bc02-ee6e6b6f37bc tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] [instance: 2d074012-fb86-4395-b8f5-3288f5677c84] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:11:42.004300 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6d4f48bb-88c1-4884-bc02-ee6e6b6f37bc tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] 10.222.0.79 "DELETE /compute/v2.1/servers/2d074012-fb86-4395-b8f5-3288f5677c84" status: 204 len: 0 microversion: 2.1 time: 0.209381 Oct 17 14:11:42.008030 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2746/5623] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:11:41 2022] DELETE /compute/v2.1/servers/2d074012-fb86-4395-b8f5-3288f5677c84 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:11:42.025989 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b5fa8a53-ef63-40c4-9777-5a92b0b0cb35 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:42.026617 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b5fa8a53-ef63-40c4-9777-5a92b0b0cb35 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] [instance: 2d074012-fb86-4395-b8f5-3288f5677c84] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:42.034267 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b5fa8a53-ef63-40c4-9777-5a92b0b0cb35 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:42.035091 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b5fa8a53-ef63-40c4-9777-5a92b0b0cb35 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:42.035745 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b5fa8a53-ef63-40c4-9777-5a92b0b0cb35 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:42.036722 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b5fa8a53-ef63-40c4-9777-5a92b0b0cb35 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:42.037366 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b5fa8a53-ef63-40c4-9777-5a92b0b0cb35 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:42.038046 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b5fa8a53-ef63-40c4-9777-5a92b0b0cb35 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:42.170650 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:11:42.193502 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-144f1069-4f15-4690-9a6c-75d494d09563 req-73f40e9d-a490-4e82-8dea-01e968896277 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dde46f51-ce50-4e1b-af0f-e233af2935b3", "name": "network-vif-plugged", "status": "completed", "tag": "8bcdec62-f683-4630-b1cc-04d4d5c37cbb"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:11:42.205391 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-144f1069-4f15-4690-9a6c-75d494d09563 req-73f40e9d-a490-4e82-8dea-01e968896277 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:42.205891 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-144f1069-4f15-4690-9a6c-75d494d09563 req-73f40e9d-a490-4e82-8dea-01e968896277 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:42.206849 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=6 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:11:42.207341 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-144f1069-4f15-4690-9a6c-75d494d09563 req-73f40e9d-a490-4e82-8dea-01e968896277 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:42.224212 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-144f1069-4f15-4690-9a6c-75d494d09563 req-73f40e9d-a490-4e82-8dea-01e968896277 service nova] Creating event network-vif-plugged:8bcdec62-f683-4630-b1cc-04d4d5c37cbb for instance dde46f51-ce50-4e1b-af0f-e233af2935b3 on n-h1-854247-14 Oct 17 14:11:42.228804 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-144f1069-4f15-4690-9a6c-75d494d09563 req-73f40e9d-a490-4e82-8dea-01e968896277 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037715 Oct 17 14:11:42.228804 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2747/5624] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:11:42.268713 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b5fa8a53-ef63-40c4-9777-5a92b0b0cb35 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaae152014d74abc8cf631c72feb25a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5ad8699d06a4121971e32459e32c81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:42.278355 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b5fa8a53-ef63-40c4-9777-5a92b0b0cb35 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] 10.222.0.79 "GET /compute/v2.1/servers/2d074012-fb86-4395-b8f5-3288f5677c84" status: 200 len: 1514 microversion: 2.1 time: 0.259006 Oct 17 14:11:42.281967 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2878/5625] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:42 2022] GET /compute/v2.1/servers/2d074012-fb86-4395-b8f5-3288f5677c84 => generated 1514 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:11:42.860020 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:11:42.866323 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a7fe0762-cf28-4653-ad71-d5cdc8666fc6 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:42.867061 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a7fe0762-cf28-4653-ad71-d5cdc8666fc6 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] [instance: dde46f51-ce50-4e1b-af0f-e233af2935b3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:42.873821 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a7fe0762-cf28-4653-ad71-d5cdc8666fc6 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:42.874623 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a7fe0762-cf28-4653-ad71-d5cdc8666fc6 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:42.875058 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a7fe0762-cf28-4653-ad71-d5cdc8666fc6 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:42.875805 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a7fe0762-cf28-4653-ad71-d5cdc8666fc6 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:42.876266 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a7fe0762-cf28-4653-ad71-d5cdc8666fc6 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:42.876689 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a7fe0762-cf28-4653-ad71-d5cdc8666fc6 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:43.027346 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a7fe0762-cf28-4653-ad71-d5cdc8666fc6 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3992c95d133f4ed29587db77478c110c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80057063fe547e794e5ecf3c7cbfd00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:43.036074 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a7fe0762-cf28-4653-ad71-d5cdc8666fc6 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] 10.222.0.79 "GET /compute/v2.1/servers/dde46f51-ce50-4e1b-af0f-e233af2935b3" status: 200 len: 1314 microversion: 2.1 time: 0.177183 Oct 17 14:11:43.036888 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2748/5626] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:42 2022] GET /compute/v2.1/servers/dde46f51-ce50-4e1b-af0f-e233af2935b3 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:11:43.305628 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c942536d-a606-4da6-baed-3bdfa73985cd tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:43.306253 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c942536d-a606-4da6-baed-3bdfa73985cd tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] [instance: 2d074012-fb86-4395-b8f5-3288f5677c84] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:43.313815 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c942536d-a606-4da6-baed-3bdfa73985cd tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:43.314311 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c942536d-a606-4da6-baed-3bdfa73985cd tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:43.314909 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c942536d-a606-4da6-baed-3bdfa73985cd tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:43.315623 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c942536d-a606-4da6-baed-3bdfa73985cd tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:43.316082 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c942536d-a606-4da6-baed-3bdfa73985cd tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:43.316621 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c942536d-a606-4da6-baed-3bdfa73985cd tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:43.636284 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c942536d-a606-4da6-baed-3bdfa73985cd tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaae152014d74abc8cf631c72feb25a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5ad8699d06a4121971e32459e32c81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:43.645218 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c942536d-a606-4da6-baed-3bdfa73985cd tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] 10.222.0.79 "GET /compute/v2.1/servers/2d074012-fb86-4395-b8f5-3288f5677c84" status: 200 len: 1514 microversion: 2.1 time: 0.343933 Oct 17 14:11:43.647018 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2879/5627] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:43 2022] GET /compute/v2.1/servers/2d074012-fb86-4395-b8f5-3288f5677c84 => generated 1514 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:11:44.061294 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-708e077c-69d4-4f99-aab2-5fdb4d8b4056 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:44.062671 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-708e077c-69d4-4f99-aab2-5fdb4d8b4056 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] [instance: dde46f51-ce50-4e1b-af0f-e233af2935b3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:44.079247 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-1de104d8-5aa9-49d8-90aa-a24041737df7 req-2a190aa8-e5a0-4d9d-82b5-71f00a1b2a02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d074012-fb86-4395-b8f5-3288f5677c84", "name": "network-vif-deleted", "tag": "cfdfb038-1f6f-428c-a4e2-dcbb66a93693"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:11:44.088050 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-708e077c-69d4-4f99-aab2-5fdb4d8b4056 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:44.088781 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-708e077c-69d4-4f99-aab2-5fdb4d8b4056 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:44.089364 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-1de104d8-5aa9-49d8-90aa-a24041737df7 req-2a190aa8-e5a0-4d9d-82b5-71f00a1b2a02 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:44.089850 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-1de104d8-5aa9-49d8-90aa-a24041737df7 req-2a190aa8-e5a0-4d9d-82b5-71f00a1b2a02 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:44.090044 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-708e077c-69d4-4f99-aab2-5fdb4d8b4056 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:44.090275 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-1de104d8-5aa9-49d8-90aa-a24041737df7 req-2a190aa8-e5a0-4d9d-82b5-71f00a1b2a02 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:44.091286 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-708e077c-69d4-4f99-aab2-5fdb4d8b4056 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:44.091779 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-708e077c-69d4-4f99-aab2-5fdb4d8b4056 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:44.092305 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-708e077c-69d4-4f99-aab2-5fdb4d8b4056 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:44.115681 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-1de104d8-5aa9-49d8-90aa-a24041737df7 req-2a190aa8-e5a0-4d9d-82b5-71f00a1b2a02 service nova] Creating event network-vif-deleted:cfdfb038-1f6f-428c-a4e2-dcbb66a93693 for instance 2d074012-fb86-4395-b8f5-3288f5677c84 on n-h2-854247-14 Oct 17 14:11:44.122242 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-1de104d8-5aa9-49d8-90aa-a24041737df7 req-2a190aa8-e5a0-4d9d-82b5-71f00a1b2a02 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047021 Oct 17 14:11:44.127577 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2880/5628] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:11:44.331887 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-708e077c-69d4-4f99-aab2-5fdb4d8b4056 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3992c95d133f4ed29587db77478c110c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80057063fe547e794e5ecf3c7cbfd00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:44.342373 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-708e077c-69d4-4f99-aab2-5fdb4d8b4056 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] 10.222.0.79 "GET /compute/v2.1/servers/dde46f51-ce50-4e1b-af0f-e233af2935b3" status: 200 len: 1498 microversion: 2.1 time: 0.284956 Oct 17 14:11:44.343789 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2749/5629] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:44 2022] GET /compute/v2.1/servers/dde46f51-ce50-4e1b-af0f-e233af2935b3 => generated 1498 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:11:44.673188 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-34eb9284-9a51-42b4-b0b5-1d102fc4ce51 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:44.674514 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-34eb9284-9a51-42b4-b0b5-1d102fc4ce51 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] [instance: 2d074012-fb86-4395-b8f5-3288f5677c84] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:44.685099 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-34eb9284-9a51-42b4-b0b5-1d102fc4ce51 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:44.685592 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-34eb9284-9a51-42b4-b0b5-1d102fc4ce51 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:44.686032 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-34eb9284-9a51-42b4-b0b5-1d102fc4ce51 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:44.686755 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-34eb9284-9a51-42b4-b0b5-1d102fc4ce51 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:44.687367 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-34eb9284-9a51-42b4-b0b5-1d102fc4ce51 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:44.687821 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-34eb9284-9a51-42b4-b0b5-1d102fc4ce51 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:44.784227 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-34eb9284-9a51-42b4-b0b5-1d102fc4ce51 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:44.785844 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-34eb9284-9a51-42b4-b0b5-1d102fc4ce51 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:44.787521 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-34eb9284-9a51-42b4-b0b5-1d102fc4ce51 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:44.788583 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-34eb9284-9a51-42b4-b0b5-1d102fc4ce51 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lazy-loading 'fault' on Instance uuid 2d074012-fb86-4395-b8f5-3288f5677c84 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:11:44.844586 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-34eb9284-9a51-42b4-b0b5-1d102fc4ce51 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaae152014d74abc8cf631c72feb25a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5ad8699d06a4121971e32459e32c81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:44.853729 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-34eb9284-9a51-42b4-b0b5-1d102fc4ce51 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] 10.222.0.79 "GET /compute/v2.1/servers/2d074012-fb86-4395-b8f5-3288f5677c84" status: 200 len: 1309 microversion: 2.1 time: 0.185086 Oct 17 14:11:44.859902 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2881/5630] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:44 2022] GET /compute/v2.1/servers/2d074012-fb86-4395-b8f5-3288f5677c84 => generated 1309 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:11:44.960137 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d9df56b9-d6e7-4d6d-9a93-a85ef29765bb tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:44.960641 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d9df56b9-d6e7-4d6d-9a93-a85ef29765bb tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] [instance: dde46f51-ce50-4e1b-af0f-e233af2935b3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:44.967758 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d9df56b9-d6e7-4d6d-9a93-a85ef29765bb tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:44.968307 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d9df56b9-d6e7-4d6d-9a93-a85ef29765bb tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:44.968809 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d9df56b9-d6e7-4d6d-9a93-a85ef29765bb tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:44.969526 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d9df56b9-d6e7-4d6d-9a93-a85ef29765bb tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:44.970193 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d9df56b9-d6e7-4d6d-9a93-a85ef29765bb tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:44.970813 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d9df56b9-d6e7-4d6d-9a93-a85ef29765bb tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:45.030430 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d9df56b9-d6e7-4d6d-9a93-a85ef29765bb tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] [instance: dde46f51-ce50-4e1b-af0f-e233af2935b3] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:11:45.146067 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d9df56b9-d6e7-4d6d-9a93-a85ef29765bb tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] 10.222.0.79 "DELETE /compute/v2.1/servers/dde46f51-ce50-4e1b-af0f-e233af2935b3" status: 204 len: 0 microversion: 2.1 time: 0.189583 Oct 17 14:11:45.147043 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2750/5631] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:11:44 2022] DELETE /compute/v2.1/servers/dde46f51-ce50-4e1b-af0f-e233af2935b3 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:11:45.155714 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a80ff2cc-a3e1-4897-bc05-1c638e470327 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:45.156593 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a80ff2cc-a3e1-4897-bc05-1c638e470327 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] [instance: dde46f51-ce50-4e1b-af0f-e233af2935b3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:45.162848 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a80ff2cc-a3e1-4897-bc05-1c638e470327 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:45.163369 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a80ff2cc-a3e1-4897-bc05-1c638e470327 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:45.163800 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a80ff2cc-a3e1-4897-bc05-1c638e470327 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:45.164486 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a80ff2cc-a3e1-4897-bc05-1c638e470327 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:45.164929 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a80ff2cc-a3e1-4897-bc05-1c638e470327 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:45.165347 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a80ff2cc-a3e1-4897-bc05-1c638e470327 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:45.317510 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a80ff2cc-a3e1-4897-bc05-1c638e470327 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3992c95d133f4ed29587db77478c110c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80057063fe547e794e5ecf3c7cbfd00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:45.326311 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a80ff2cc-a3e1-4897-bc05-1c638e470327 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] 10.222.0.79 "GET /compute/v2.1/servers/dde46f51-ce50-4e1b-af0f-e233af2935b3" status: 200 len: 1504 microversion: 2.1 time: 0.174430 Oct 17 14:11:45.331462 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2882/5632] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:45 2022] GET /compute/v2.1/servers/dde46f51-ce50-4e1b-af0f-e233af2935b3 => generated 1504 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:11:45.880261 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-90303067-1cf7-4340-b558-91c383c84467 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:45.881263 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-90303067-1cf7-4340-b558-91c383c84467 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] [instance: 2d074012-fb86-4395-b8f5-3288f5677c84] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:45.887672 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-90303067-1cf7-4340-b558-91c383c84467 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:45.888170 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-90303067-1cf7-4340-b558-91c383c84467 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:45.888589 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-90303067-1cf7-4340-b558-91c383c84467 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:45.889282 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-90303067-1cf7-4340-b558-91c383c84467 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:45.889731 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-90303067-1cf7-4340-b558-91c383c84467 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:45.890206 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-90303067-1cf7-4340-b558-91c383c84467 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:45.904270 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-90303067-1cf7-4340-b558-91c383c84467 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] HTTP exception thrown: Instance 2d074012-fb86-4395-b8f5-3288f5677c84 could not be found. Oct 17 14:11:45.906164 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-90303067-1cf7-4340-b558-91c383c84467 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Request method failure captured: Oct 17 14:11:45.906164 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/2d074012-fb86-4395-b8f5-3288f5677c84 HTTP/1.1 Oct 17 14:11:45.906164 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 14:11:45.906164 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 14:11:45.906164 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 14:11:45.906164 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 14:11:45.906164 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 14:11:45.906164 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 14:11:45.906164 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 14:11:45.906164 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 14:11:45.906164 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTWHcWUYX7Iz8qSowC6VF7ekjMGEEAjMrjaxQCl3J6qTMuNfcmOudjqYHstIspbe_VcfELClhO4esQl_fAr-44qEWW4jZUACv2rKilgTmaRq4b--SZCg0vebdYGEcuP_07IfsyuCfioN5yAzc7L4WxfasaP43vlN_jlMWb98lBs3F6i8 Oct 17 14:11:45.906164 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 14:11:45.906164 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 14:11:45.906164 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 14:11:45.906164 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 14:11:45.906164 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 14:11:45.906164 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 14:11:45.906164 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: e5ad8699d06a4121971e32459e32c81d Oct 17 14:11:45.906164 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-VolumesSnapshotTestJSON-162656621 Oct 17 14:11:45.906164 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 14:11:45.906164 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 14:11:45.906164 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e5ad8699d06a4121971e32459e32c81d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/e5ad8699d06a4121971e32459e32c81d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e5ad8699d06a4121971e32459e32c81d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_e5ad8699d06a4121971e32459e32c81d", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:11:45.906164 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-VolumesSnapshotTestJSON-162656621 Oct 17 14:11:45.906164 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: e5ad8699d06a4121971e32459e32c81d Oct 17 14:11:45.906164 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-162656621 Oct 17 14:11:45.906164 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-VolumesSnapshotTestJSON-162656621-project Oct 17 14:11:45.906164 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 14:11:45.906164 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 14:11:45.906164 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: aaae152014d74abc8cf631c72feb25a6 Oct 17 14:11:45.906164 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-VolumesSnapshotTestJSON-162656621-project Oct 17 14:11:45.906164 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 14:11:45.906164 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 2d074012-fb86-4395-b8f5-3288f5677c84 could not be found. Oct 17 14:11:45.906164 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '2d074012-fb86-4395-b8f5-3288f5677c84'} Oct 17 14:11:45.906164 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:11:45.906164 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:11:45.906164 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:11:45.906164 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:11:45.906164 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:11:45.906164 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:11:45.906164 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:11:45.906164 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:11:45.906164 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:11:45.906164 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:11:45.906164 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d074012-fb86-4395-b8f5-3288f5677c84 could not be found. Oct 17 14:11:45.906164 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:11:45.906164 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:11:45.906164 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:11:45.906164 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:11:45.906164 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:11:45.906164 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:11:45.906164 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:11:45.906164 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:11:45.906164 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:11:45.906164 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:11:45.906164 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:11:45.906164 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:11:45.906164 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:11:45.906164 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:11:45.906164 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:11:45.906164 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:11:45.906164 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d074012-fb86-4395-b8f5-3288f5677c84 could not be found. Oct 17 14:11:45.906164 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:11:45.906164 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:11:45.906164 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:11:45.913986 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:11:45.913986 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:11:45.913986 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:11:45.913986 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:11:45.913986 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:11:45.913986 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d074012-fb86-4395-b8f5-3288f5677c84 could not be found. Oct 17 14:11:45.913986 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:11:45.913986 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-90303067-1cf7-4340-b558-91c383c84467 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Returning 404 to user: Instance 2d074012-fb86-4395-b8f5-3288f5677c84 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:11:45.913986 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-90303067-1cf7-4340-b558-91c383c84467 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] 10.222.0.79 "GET /compute/v2.1/servers/2d074012-fb86-4395-b8f5-3288f5677c84" status: 404 len: 111 microversion: 2.1 time: 0.031986 Oct 17 14:11:45.913986 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2751/5633] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:45 2022] GET /compute/v2.1/servers/2d074012-fb86-4395-b8f5-3288f5677c84 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:11:46.349747 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-266abaed-032e-4962-a192-d4df9a189bda tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:46.350367 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-266abaed-032e-4962-a192-d4df9a189bda tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] [instance: dde46f51-ce50-4e1b-af0f-e233af2935b3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:46.369676 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-266abaed-032e-4962-a192-d4df9a189bda tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:46.369906 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-266abaed-032e-4962-a192-d4df9a189bda tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:46.370500 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-266abaed-032e-4962-a192-d4df9a189bda tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:46.371626 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-266abaed-032e-4962-a192-d4df9a189bda tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:46.372317 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-266abaed-032e-4962-a192-d4df9a189bda tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:46.373304 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-266abaed-032e-4962-a192-d4df9a189bda tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:46.608754 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-266abaed-032e-4962-a192-d4df9a189bda tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3992c95d133f4ed29587db77478c110c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80057063fe547e794e5ecf3c7cbfd00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:46.617891 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-266abaed-032e-4962-a192-d4df9a189bda tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] 10.222.0.79 "GET /compute/v2.1/servers/dde46f51-ce50-4e1b-af0f-e233af2935b3" status: 200 len: 1504 microversion: 2.1 time: 0.272069 Oct 17 14:11:46.623768 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2883/5634] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:46 2022] GET /compute/v2.1/servers/dde46f51-ce50-4e1b-af0f-e233af2935b3 => generated 1504 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:11:47.136581 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-b531cd61-703a-4ce4-95ee-d41425440aad req-803744cd-ff84-404f-83ff-541a20c1127a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dde46f51-ce50-4e1b-af0f-e233af2935b3", "name": "network-vif-deleted", "tag": "8bcdec62-f683-4630-b1cc-04d4d5c37cbb"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:11:47.155014 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-b531cd61-703a-4ce4-95ee-d41425440aad req-803744cd-ff84-404f-83ff-541a20c1127a service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:47.155933 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-b531cd61-703a-4ce4-95ee-d41425440aad req-803744cd-ff84-404f-83ff-541a20c1127a service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:47.157545 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-b531cd61-703a-4ce4-95ee-d41425440aad req-803744cd-ff84-404f-83ff-541a20c1127a service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:47.197770 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-b531cd61-703a-4ce4-95ee-d41425440aad req-803744cd-ff84-404f-83ff-541a20c1127a service nova] Creating event network-vif-deleted:8bcdec62-f683-4630-b1cc-04d4d5c37cbb for instance dde46f51-ce50-4e1b-af0f-e233af2935b3 on n-h1-854247-14 Oct 17 14:11:47.206658 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-b531cd61-703a-4ce4-95ee-d41425440aad req-803744cd-ff84-404f-83ff-541a20c1127a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076234 Oct 17 14:11:47.207829 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2752/5635] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:11:47.646974 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ff1a1b3d-57da-4546-b20c-3c42466d800e tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:47.647630 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ff1a1b3d-57da-4546-b20c-3c42466d800e tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] [instance: dde46f51-ce50-4e1b-af0f-e233af2935b3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:47.655188 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ff1a1b3d-57da-4546-b20c-3c42466d800e tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:47.656086 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ff1a1b3d-57da-4546-b20c-3c42466d800e tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:47.656736 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ff1a1b3d-57da-4546-b20c-3c42466d800e tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:47.657653 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ff1a1b3d-57da-4546-b20c-3c42466d800e tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:47.658296 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ff1a1b3d-57da-4546-b20c-3c42466d800e tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:47.659017 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ff1a1b3d-57da-4546-b20c-3c42466d800e tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:47.760457 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ff1a1b3d-57da-4546-b20c-3c42466d800e tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:47.761049 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ff1a1b3d-57da-4546-b20c-3c42466d800e tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:47.761505 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ff1a1b3d-57da-4546-b20c-3c42466d800e tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:47.761950 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-ff1a1b3d-57da-4546-b20c-3c42466d800e tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lazy-loading 'fault' on Instance uuid dde46f51-ce50-4e1b-af0f-e233af2935b3 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:11:47.862081 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ff1a1b3d-57da-4546-b20c-3c42466d800e tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3992c95d133f4ed29587db77478c110c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80057063fe547e794e5ecf3c7cbfd00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:47.924683 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ff1a1b3d-57da-4546-b20c-3c42466d800e tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] 10.222.0.79 "GET /compute/v2.1/servers/dde46f51-ce50-4e1b-af0f-e233af2935b3" status: 200 len: 1304 microversion: 2.1 time: 0.281976 Oct 17 14:11:47.925825 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2884/5636] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:47 2022] GET /compute/v2.1/servers/dde46f51-ce50-4e1b-af0f-e233af2935b3 => generated 1304 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:11:48.957839 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-70f676a7-c04e-4f21-9510-cc44c6249553 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:48.959221 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-70f676a7-c04e-4f21-9510-cc44c6249553 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] [instance: dde46f51-ce50-4e1b-af0f-e233af2935b3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:48.975063 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70f676a7-c04e-4f21-9510-cc44c6249553 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:48.975927 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70f676a7-c04e-4f21-9510-cc44c6249553 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:48.976581 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70f676a7-c04e-4f21-9510-cc44c6249553 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:48.977623 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70f676a7-c04e-4f21-9510-cc44c6249553 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:48.978289 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70f676a7-c04e-4f21-9510-cc44c6249553 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:48.978936 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70f676a7-c04e-4f21-9510-cc44c6249553 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:48.998694 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-70f676a7-c04e-4f21-9510-cc44c6249553 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] HTTP exception thrown: Instance dde46f51-ce50-4e1b-af0f-e233af2935b3 could not be found. Oct 17 14:11:49.001692 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-70f676a7-c04e-4f21-9510-cc44c6249553 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Request method failure captured: Oct 17 14:11:49.001692 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/dde46f51-ce50-4e1b-af0f-e233af2935b3 HTTP/1.1 Oct 17 14:11:49.001692 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 14:11:49.001692 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 14:11:49.001692 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 14:11:49.001692 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 14:11:49.001692 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 14:11:49.001692 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 14:11:49.001692 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 14:11:49.001692 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 14:11:49.001692 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTWJ4BlNQmyIPeglHZLNtIWqa24eLIHAQusCZKneeoo9G8MX66yRy_OJnp-UnYyhFqTV5dVJRlVJEyiiSt5gJYurDZZqHF8s0on8vboAlJ-HJttz-exe0NjGP-YrDbQTzsrCui-BknFjkLzr0M33h_662gUrxyuunOeFwpmVs_oa-mxE Oct 17 14:11:49.001692 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 14:11:49.001692 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 14:11:49.001692 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 14:11:49.001692 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 14:11:49.001692 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 14:11:49.001692 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 14:11:49.001692 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: d80057063fe547e794e5ecf3c7cbfd00 Oct 17 14:11:49.001692 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-VolumesActionsTest-1118010255 Oct 17 14:11:49.001692 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 14:11:49.001692 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 14:11:49.001692 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d80057063fe547e794e5ecf3c7cbfd00"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d80057063fe547e794e5ecf3c7cbfd00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d80057063fe547e794e5ecf3c7cbfd00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d80057063fe547e794e5ecf3c7cbfd00", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:11:49.001692 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-VolumesActionsTest-1118010255 Oct 17 14:11:49.001692 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: d80057063fe547e794e5ecf3c7cbfd00 Oct 17 14:11:49.001692 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-VolumesActionsTest-1118010255 Oct 17 14:11:49.001692 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-VolumesActionsTest-1118010255-project Oct 17 14:11:49.001692 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 14:11:49.001692 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 14:11:49.001692 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 3992c95d133f4ed29587db77478c110c Oct 17 14:11:49.001692 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-VolumesActionsTest-1118010255-project Oct 17 14:11:49.001692 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 14:11:49.001692 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance dde46f51-ce50-4e1b-af0f-e233af2935b3 could not be found. Oct 17 14:11:49.001692 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'dde46f51-ce50-4e1b-af0f-e233af2935b3'} Oct 17 14:11:49.001692 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:11:49.001692 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:11:49.001692 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:11:49.001692 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:11:49.001692 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:11:49.001692 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:11:49.001692 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:11:49.001692 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:11:49.001692 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:11:49.001692 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:11:49.001692 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dde46f51-ce50-4e1b-af0f-e233af2935b3 could not be found. Oct 17 14:11:49.001692 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:11:49.001692 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:11:49.001692 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:11:49.001692 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:11:49.001692 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:11:49.001692 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:11:49.001692 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:11:49.001692 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:11:49.001692 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:11:49.001692 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:11:49.001692 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:11:49.001692 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:11:49.001692 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:11:49.001692 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:11:49.001692 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:11:49.001692 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:11:49.001692 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dde46f51-ce50-4e1b-af0f-e233af2935b3 could not be found. Oct 17 14:11:49.001692 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:11:49.001692 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:11:49.001692 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:11:49.005468 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:11:49.005468 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:11:49.005468 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:11:49.005468 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:11:49.005468 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:11:49.005468 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dde46f51-ce50-4e1b-af0f-e233af2935b3 could not be found. Oct 17 14:11:49.005468 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:11:49.007675 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-70f676a7-c04e-4f21-9510-cc44c6249553 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] Returning 404 to user: Instance dde46f51-ce50-4e1b-af0f-e233af2935b3 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:11:49.009033 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-70f676a7-c04e-4f21-9510-cc44c6249553 tempest-VolumesActionsTest-1118010255 tempest-VolumesActionsTest-1118010255-project] 10.222.0.79 "GET /compute/v2.1/servers/dde46f51-ce50-4e1b-af0f-e233af2935b3" status: 404 len: 111 microversion: 2.1 time: 0.056503 Oct 17 14:11:49.009931 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2753/5637] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:48 2022] GET /compute/v2.1/servers/dde46f51-ce50-4e1b-af0f-e233af2935b3 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:11:54.487508 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c6edbdaa-51eb-48ed-a6e5-6c0b27006355 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-347080233", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "539d4ff6-748f-4c4e-b115-ad48ff5c0a8a"}]}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:11:54.572344 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-c6edbdaa-51eb-48ed-a6e5-6c0b27006355 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] validate_networks() for [('539d4ff6-748f-4c4e-b115-ad48ff5c0a8a', None, None, None, None, None)] {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:11:55.115193 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-c6edbdaa-51eb-48ed-a6e5-6c0b27006355 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:11:55.116070 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-c6edbdaa-51eb-48ed-a6e5-6c0b27006355 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:11:55.116645 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-c6edbdaa-51eb-48ed-a6e5-6c0b27006355 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:11:55.117280 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-c6edbdaa-51eb-48ed-a6e5-6c0b27006355 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:11:55.118302 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-c6edbdaa-51eb-48ed-a6e5-6c0b27006355 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:11:55.135232 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c6edbdaa-51eb-48ed-a6e5-6c0b27006355 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:55.136007 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c6edbdaa-51eb-48ed-a6e5-6c0b27006355 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:55.136653 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c6edbdaa-51eb-48ed-a6e5-6c0b27006355 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:55.137657 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c6edbdaa-51eb-48ed-a6e5-6c0b27006355 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:55.138375 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c6edbdaa-51eb-48ed-a6e5-6c0b27006355 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:55.138979 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c6edbdaa-51eb-48ed-a6e5-6c0b27006355 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:55.163684 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-c6edbdaa-51eb-48ed-a6e5-6c0b27006355 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Getting quotas for project e5ad8699d06a4121971e32459e32c81d. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:11:55.169433 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-c6edbdaa-51eb-48ed-a6e5-6c0b27006355 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Getting quotas for user aaae152014d74abc8cf631c72feb25a6 and project e5ad8699d06a4121971e32459e32c81d. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:11:55.187459 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c6edbdaa-51eb-48ed-a6e5-6c0b27006355 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:11:55.191297 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c6edbdaa-51eb-48ed-a6e5-6c0b27006355 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] [instance: c1102d0c-2ac8-4e58-b019-daeb20912bcb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:11:55.274047 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c6edbdaa-51eb-48ed-a6e5-6c0b27006355 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.791967 Oct 17 14:11:55.281089 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2885/5638] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 14:11:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:11:55.288230 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0037de51-c326-4c2d-bee3-07a3b15c9e27 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:55.288857 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0037de51-c326-4c2d-bee3-07a3b15c9e27 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] [instance: c1102d0c-2ac8-4e58-b019-daeb20912bcb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:55.292518 n-d-854247-14 devstack@n-api.service[127017]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 14:11:55.292749 n-d-854247-14 devstack@n-api.service[127017]: Mon Oct 17 14:11:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c1102d0c-2ac8-4e58-b019-daeb20912bcb (ip 10.222.0.79) !!! Oct 17 14:11:55.399447 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0037de51-c326-4c2d-bee3-07a3b15c9e27 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaae152014d74abc8cf631c72feb25a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5ad8699d06a4121971e32459e32c81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:55.417053 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0037de51-c326-4c2d-bee3-07a3b15c9e27 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] 10.222.0.79 "GET /compute/v2.1/servers/c1102d0c-2ac8-4e58-b019-daeb20912bcb" status: 200 len: 1218 microversion: 2.1 time: 0.132624 Oct 17 14:11:55.420698 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2754/5639] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:55 2022] GET /compute/v2.1/servers/c1102d0c-2ac8-4e58-b019-daeb20912bcb => generated 1218 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:11:56.447399 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6c802f00-1a3d-4a56-b542-9082e283dbf7 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:56.448035 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6c802f00-1a3d-4a56-b542-9082e283dbf7 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] [instance: c1102d0c-2ac8-4e58-b019-daeb20912bcb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:56.458167 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6c802f00-1a3d-4a56-b542-9082e283dbf7 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:56.458662 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6c802f00-1a3d-4a56-b542-9082e283dbf7 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:56.459098 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6c802f00-1a3d-4a56-b542-9082e283dbf7 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:56.459860 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6c802f00-1a3d-4a56-b542-9082e283dbf7 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:56.460496 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6c802f00-1a3d-4a56-b542-9082e283dbf7 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:56.461097 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6c802f00-1a3d-4a56-b542-9082e283dbf7 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:56.572452 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6c802f00-1a3d-4a56-b542-9082e283dbf7 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaae152014d74abc8cf631c72feb25a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5ad8699d06a4121971e32459e32c81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:56.588782 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6c802f00-1a3d-4a56-b542-9082e283dbf7 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] 10.222.0.79 "GET /compute/v2.1/servers/c1102d0c-2ac8-4e58-b019-daeb20912bcb" status: 200 len: 1270 microversion: 2.1 time: 0.145289 Oct 17 14:11:56.600983 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2886/5640] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:56 2022] GET /compute/v2.1/servers/c1102d0c-2ac8-4e58-b019-daeb20912bcb => generated 1270 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:11:57.614324 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9580d3b9-b145-474d-a777-7dfdfad8c09e tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:57.615587 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9580d3b9-b145-474d-a777-7dfdfad8c09e tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] [instance: c1102d0c-2ac8-4e58-b019-daeb20912bcb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:57.630547 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9580d3b9-b145-474d-a777-7dfdfad8c09e tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:57.631236 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9580d3b9-b145-474d-a777-7dfdfad8c09e tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:57.631807 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9580d3b9-b145-474d-a777-7dfdfad8c09e tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:57.632679 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9580d3b9-b145-474d-a777-7dfdfad8c09e tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:57.633270 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9580d3b9-b145-474d-a777-7dfdfad8c09e tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:57.633833 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9580d3b9-b145-474d-a777-7dfdfad8c09e tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:58.148690 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9580d3b9-b145-474d-a777-7dfdfad8c09e tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaae152014d74abc8cf631c72feb25a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5ad8699d06a4121971e32459e32c81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:58.184205 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9580d3b9-b145-474d-a777-7dfdfad8c09e tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] 10.222.0.79 "GET /compute/v2.1/servers/c1102d0c-2ac8-4e58-b019-daeb20912bcb" status: 200 len: 1276 microversion: 2.1 time: 0.570075 Oct 17 14:11:58.196967 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2755/5641] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:57 2022] GET /compute/v2.1/servers/c1102d0c-2ac8-4e58-b019-daeb20912bcb => generated 1276 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:11:59.225655 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-970b6f44-e8b1-4659-9a5d-fb8d10822fe5 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:59.227125 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-970b6f44-e8b1-4659-9a5d-fb8d10822fe5 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] [instance: c1102d0c-2ac8-4e58-b019-daeb20912bcb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:59.234240 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=6 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:11:59.241132 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-970b6f44-e8b1-4659-9a5d-fb8d10822fe5 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:59.246143 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-970b6f44-e8b1-4659-9a5d-fb8d10822fe5 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:59.246843 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-970b6f44-e8b1-4659-9a5d-fb8d10822fe5 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:59.258210 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-970b6f44-e8b1-4659-9a5d-fb8d10822fe5 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:59.258210 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-970b6f44-e8b1-4659-9a5d-fb8d10822fe5 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:59.258210 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-970b6f44-e8b1-4659-9a5d-fb8d10822fe5 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:59.297082 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:11:59.550730 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-970b6f44-e8b1-4659-9a5d-fb8d10822fe5 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaae152014d74abc8cf631c72feb25a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5ad8699d06a4121971e32459e32c81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:59.565455 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-970b6f44-e8b1-4659-9a5d-fb8d10822fe5 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] 10.222.0.79 "GET /compute/v2.1/servers/c1102d0c-2ac8-4e58-b019-daeb20912bcb" status: 200 len: 1318 microversion: 2.1 time: 0.344361 Oct 17 14:11:59.568775 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2887/5642] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:59 2022] GET /compute/v2.1/servers/c1102d0c-2ac8-4e58-b019-daeb20912bcb => generated 1318 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:11:59.770768 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-0e7ab9e9-5089-47ba-ad5a-38fb870fee69 req-aa77290d-774c-4386-914b-16c7ad64228c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1102d0c-2ac8-4e58-b019-daeb20912bcb", "tag": "ae8e4103-98e5-45c6-a1a8-bff1c52b384c"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:11:59.805222 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-0e7ab9e9-5089-47ba-ad5a-38fb870fee69 req-aa77290d-774c-4386-914b-16c7ad64228c service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:59.807109 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-0e7ab9e9-5089-47ba-ad5a-38fb870fee69 req-aa77290d-774c-4386-914b-16c7ad64228c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:59.807985 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-0e7ab9e9-5089-47ba-ad5a-38fb870fee69 req-aa77290d-774c-4386-914b-16c7ad64228c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:59.825199 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-0e7ab9e9-5089-47ba-ad5a-38fb870fee69 req-aa77290d-774c-4386-914b-16c7ad64228c service nova] Creating event network-changed:ae8e4103-98e5-45c6-a1a8-bff1c52b384c for instance c1102d0c-2ac8-4e58-b019-daeb20912bcb on n-h1-854247-14 Oct 17 14:11:59.859612 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-0e7ab9e9-5089-47ba-ad5a-38fb870fee69 req-aa77290d-774c-4386-914b-16c7ad64228c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093055 Oct 17 14:11:59.865545 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2756/5643] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:11:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:12:00.591600 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a6225251-b845-4f2c-8c7a-6ce1cdc9d447 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:00.604755 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a6225251-b845-4f2c-8c7a-6ce1cdc9d447 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] [instance: c1102d0c-2ac8-4e58-b019-daeb20912bcb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:00.626009 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a6225251-b845-4f2c-8c7a-6ce1cdc9d447 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:00.628467 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a6225251-b845-4f2c-8c7a-6ce1cdc9d447 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:00.631498 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a6225251-b845-4f2c-8c7a-6ce1cdc9d447 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:00.633325 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a6225251-b845-4f2c-8c7a-6ce1cdc9d447 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:00.634246 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a6225251-b845-4f2c-8c7a-6ce1cdc9d447 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:00.636030 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a6225251-b845-4f2c-8c7a-6ce1cdc9d447 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:01.117372 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a6225251-b845-4f2c-8c7a-6ce1cdc9d447 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaae152014d74abc8cf631c72feb25a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5ad8699d06a4121971e32459e32c81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:01.127404 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a6225251-b845-4f2c-8c7a-6ce1cdc9d447 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] 10.222.0.79 "GET /compute/v2.1/servers/c1102d0c-2ac8-4e58-b019-daeb20912bcb" status: 200 len: 1318 microversion: 2.1 time: 0.541060 Oct 17 14:12:01.130476 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2888/5644] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:00 2022] GET /compute/v2.1/servers/c1102d0c-2ac8-4e58-b019-daeb20912bcb => generated 1318 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:12:02.157672 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f91b1ea1-7236-4932-b356-f085beb51fa7 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:02.159029 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f91b1ea1-7236-4932-b356-f085beb51fa7 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] [instance: c1102d0c-2ac8-4e58-b019-daeb20912bcb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:02.161127 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:12:02.176163 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f91b1ea1-7236-4932-b356-f085beb51fa7 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:02.178610 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f91b1ea1-7236-4932-b356-f085beb51fa7 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:02.179701 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f91b1ea1-7236-4932-b356-f085beb51fa7 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:02.180601 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f91b1ea1-7236-4932-b356-f085beb51fa7 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:02.181215 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f91b1ea1-7236-4932-b356-f085beb51fa7 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:02.182505 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f91b1ea1-7236-4932-b356-f085beb51fa7 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:02.244236 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:12:02.563305 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f91b1ea1-7236-4932-b356-f085beb51fa7 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaae152014d74abc8cf631c72feb25a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5ad8699d06a4121971e32459e32c81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:02.574439 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f91b1ea1-7236-4932-b356-f085beb51fa7 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] 10.222.0.79 "GET /compute/v2.1/servers/c1102d0c-2ac8-4e58-b019-daeb20912bcb" status: 200 len: 1318 microversion: 2.1 time: 0.422457 Oct 17 14:12:02.581319 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2757/5645] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:02 2022] GET /compute/v2.1/servers/c1102d0c-2ac8-4e58-b019-daeb20912bcb => generated 1318 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:12:03.610405 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-36db50eb-ffb1-4ddf-acba-b53be1c89678 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:03.612139 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-36db50eb-ffb1-4ddf-acba-b53be1c89678 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] [instance: c1102d0c-2ac8-4e58-b019-daeb20912bcb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:03.625867 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-36db50eb-ffb1-4ddf-acba-b53be1c89678 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:03.628036 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-36db50eb-ffb1-4ddf-acba-b53be1c89678 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:03.630347 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-36db50eb-ffb1-4ddf-acba-b53be1c89678 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:03.632275 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-36db50eb-ffb1-4ddf-acba-b53be1c89678 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:03.633592 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-36db50eb-ffb1-4ddf-acba-b53be1c89678 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:03.635716 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-36db50eb-ffb1-4ddf-acba-b53be1c89678 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:03.870309 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-36db50eb-ffb1-4ddf-acba-b53be1c89678 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaae152014d74abc8cf631c72feb25a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5ad8699d06a4121971e32459e32c81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:03.888063 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-36db50eb-ffb1-4ddf-acba-b53be1c89678 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] 10.222.0.79 "GET /compute/v2.1/servers/c1102d0c-2ac8-4e58-b019-daeb20912bcb" status: 200 len: 1318 microversion: 2.1 time: 0.282931 Oct 17 14:12:03.889179 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2889/5646] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:03 2022] GET /compute/v2.1/servers/c1102d0c-2ac8-4e58-b019-daeb20912bcb => generated 1318 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:12:04.916233 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2bf79fa5-8911-4117-9bcc-5a4f6e3636e9 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:04.916887 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2bf79fa5-8911-4117-9bcc-5a4f6e3636e9 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] [instance: c1102d0c-2ac8-4e58-b019-daeb20912bcb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:04.928484 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2bf79fa5-8911-4117-9bcc-5a4f6e3636e9 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:04.932354 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2bf79fa5-8911-4117-9bcc-5a4f6e3636e9 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:04.932892 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2bf79fa5-8911-4117-9bcc-5a4f6e3636e9 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:04.933829 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2bf79fa5-8911-4117-9bcc-5a4f6e3636e9 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:04.934367 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2bf79fa5-8911-4117-9bcc-5a4f6e3636e9 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:04.935656 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2bf79fa5-8911-4117-9bcc-5a4f6e3636e9 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:05.216584 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2bf79fa5-8911-4117-9bcc-5a4f6e3636e9 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaae152014d74abc8cf631c72feb25a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5ad8699d06a4121971e32459e32c81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:05.236138 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2bf79fa5-8911-4117-9bcc-5a4f6e3636e9 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] 10.222.0.79 "GET /compute/v2.1/servers/c1102d0c-2ac8-4e58-b019-daeb20912bcb" status: 200 len: 1318 microversion: 2.1 time: 0.321905 Oct 17 14:12:05.238672 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2758/5647] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:04 2022] GET /compute/v2.1/servers/c1102d0c-2ac8-4e58-b019-daeb20912bcb => generated 1318 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:12:06.266127 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fb8682ae-354c-4254-a75e-119cdc787c7f tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:06.268097 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-fb8682ae-354c-4254-a75e-119cdc787c7f tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] [instance: c1102d0c-2ac8-4e58-b019-daeb20912bcb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:06.275835 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:12:06.277208 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=6 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:12:06.296849 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fb8682ae-354c-4254-a75e-119cdc787c7f tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:06.301108 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fb8682ae-354c-4254-a75e-119cdc787c7f tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:06.304669 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fb8682ae-354c-4254-a75e-119cdc787c7f tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:06.312409 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-54e49b3d-f712-47a9-a203-fde3e9b1b4ec req-f1542b85-99aa-4ba4-b109-f70f4f7e7e56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1102d0c-2ac8-4e58-b019-daeb20912bcb", "name": "network-vif-plugged", "status": "completed", "tag": "ae8e4103-98e5-45c6-a1a8-bff1c52b384c"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:12:06.324279 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fb8682ae-354c-4254-a75e-119cdc787c7f tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:06.326037 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fb8682ae-354c-4254-a75e-119cdc787c7f tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:06.333101 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fb8682ae-354c-4254-a75e-119cdc787c7f tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:06.345614 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:12:06.355954 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-54e49b3d-f712-47a9-a203-fde3e9b1b4ec req-f1542b85-99aa-4ba4-b109-f70f4f7e7e56 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:06.356565 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-54e49b3d-f712-47a9-a203-fde3e9b1b4ec req-f1542b85-99aa-4ba4-b109-f70f4f7e7e56 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:06.357006 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-54e49b3d-f712-47a9-a203-fde3e9b1b4ec req-f1542b85-99aa-4ba4-b109-f70f4f7e7e56 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:06.388799 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-54e49b3d-f712-47a9-a203-fde3e9b1b4ec req-f1542b85-99aa-4ba4-b109-f70f4f7e7e56 service nova] Creating event network-vif-plugged:ae8e4103-98e5-45c6-a1a8-bff1c52b384c for instance c1102d0c-2ac8-4e58-b019-daeb20912bcb on n-h1-854247-14 Oct 17 14:12:06.394031 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-54e49b3d-f712-47a9-a203-fde3e9b1b4ec req-f1542b85-99aa-4ba4-b109-f70f4f7e7e56 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087254 Oct 17 14:12:06.398029 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2759/5648] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:12:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:12:06.827897 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fb8682ae-354c-4254-a75e-119cdc787c7f tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaae152014d74abc8cf631c72feb25a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5ad8699d06a4121971e32459e32c81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:06.838252 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fb8682ae-354c-4254-a75e-119cdc787c7f tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] 10.222.0.79 "GET /compute/v2.1/servers/c1102d0c-2ac8-4e58-b019-daeb20912bcb" status: 200 len: 1318 microversion: 2.1 time: 0.576932 Oct 17 14:12:06.844822 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2890/5649] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:06 2022] GET /compute/v2.1/servers/c1102d0c-2ac8-4e58-b019-daeb20912bcb => generated 1318 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:12:07.873003 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0da87623-4971-4014-ba0a-b69b417b621c tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:07.873745 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0da87623-4971-4014-ba0a-b69b417b621c tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] [instance: c1102d0c-2ac8-4e58-b019-daeb20912bcb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:07.897659 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0da87623-4971-4014-ba0a-b69b417b621c tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:07.899805 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0da87623-4971-4014-ba0a-b69b417b621c tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:07.901692 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0da87623-4971-4014-ba0a-b69b417b621c tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:07.904030 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0da87623-4971-4014-ba0a-b69b417b621c tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:07.907540 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0da87623-4971-4014-ba0a-b69b417b621c tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:07.910113 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0da87623-4971-4014-ba0a-b69b417b621c tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:08.148918 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0da87623-4971-4014-ba0a-b69b417b621c tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaae152014d74abc8cf631c72feb25a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5ad8699d06a4121971e32459e32c81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:08.158166 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0da87623-4971-4014-ba0a-b69b417b621c tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] 10.222.0.79 "GET /compute/v2.1/servers/c1102d0c-2ac8-4e58-b019-daeb20912bcb" status: 200 len: 1506 microversion: 2.1 time: 0.294286 Oct 17 14:12:08.164487 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2760/5650] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:07 2022] GET /compute/v2.1/servers/c1102d0c-2ac8-4e58-b019-daeb20912bcb => generated 1506 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:12:08.192155 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-094717ee-dbf4-45ad-948e-a1127be93489 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4046eec9-ac42-4233-ab40-cdaa757b58d4", "device": "/dev/sdb"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:12:08.197102 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-094717ee-dbf4-45ad-948e-a1127be93489 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] [instance: c1102d0c-2ac8-4e58-b019-daeb20912bcb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:08.208885 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-094717ee-dbf4-45ad-948e-a1127be93489 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:08.209674 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-094717ee-dbf4-45ad-948e-a1127be93489 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:08.214489 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-094717ee-dbf4-45ad-948e-a1127be93489 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:08.216261 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-094717ee-dbf4-45ad-948e-a1127be93489 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:08.217146 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-094717ee-dbf4-45ad-948e-a1127be93489 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:08.218551 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-094717ee-dbf4-45ad-948e-a1127be93489 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:08.683088 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-094717ee-dbf4-45ad-948e-a1127be93489 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] 10.222.0.79 "POST /compute/v2.1/servers/c1102d0c-2ac8-4e58-b019-daeb20912bcb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.496112 Oct 17 14:12:08.686902 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2891/5651] 10.222.0.79 () {60 vars in 1323 bytes} [Mon Oct 17 14:12:08 2022] POST /compute/v2.1/servers/c1102d0c-2ac8-4e58-b019-daeb20912bcb/os-volume_attachments => generated 194 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:12:33.536086 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-97a3dbec-6184-4e99-890b-96d4bbae083e tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:33.537253 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-97a3dbec-6184-4e99-890b-96d4bbae083e tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] [instance: c1102d0c-2ac8-4e58-b019-daeb20912bcb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:33.545757 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=7 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:12:33.547378 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=19 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:12:33.549402 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-97a3dbec-6184-4e99-890b-96d4bbae083e tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:33.550142 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-97a3dbec-6184-4e99-890b-96d4bbae083e tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:33.550726 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-97a3dbec-6184-4e99-890b-96d4bbae083e tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:33.551953 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-97a3dbec-6184-4e99-890b-96d4bbae083e tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:33.552876 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-97a3dbec-6184-4e99-890b-96d4bbae083e tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:33.553970 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-97a3dbec-6184-4e99-890b-96d4bbae083e tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:33.669484 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-97a3dbec-6184-4e99-890b-96d4bbae083e tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lazy-loading 'services' on Instance uuid c1102d0c-2ac8-4e58-b019-daeb20912bcb {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:12:33.778468 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-97a3dbec-6184-4e99-890b-96d4bbae083e tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c1102d0c-2ac8-4e58-b019-daeb20912bcb/os-volume_attachments/4046eec9-ac42-4233-ab40-cdaa757b58d4" status: 202 len: 0 microversion: 2.1 time: 0.247770 Oct 17 14:12:33.779722 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2761/5652] 10.222.0.79 () {58 vars in 1416 bytes} [Mon Oct 17 14:12:33 2022] DELETE /compute/v2.1/servers/c1102d0c-2ac8-4e58-b019-daeb20912bcb/os-volume_attachments/4046eec9-ac42-4233-ab40-cdaa757b58d4 => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:12:40.387424 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-45025ce1-ec0d-4893-83cc-7772acf7235e tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:40.387902 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-45025ce1-ec0d-4893-83cc-7772acf7235e tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] [instance: c1102d0c-2ac8-4e58-b019-daeb20912bcb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:40.391116 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=9 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:12:40.392231 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:12:40.402104 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-45025ce1-ec0d-4893-83cc-7772acf7235e tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:40.402773 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-45025ce1-ec0d-4893-83cc-7772acf7235e tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:40.403915 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-45025ce1-ec0d-4893-83cc-7772acf7235e tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:40.404665 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-45025ce1-ec0d-4893-83cc-7772acf7235e tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:40.405139 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-45025ce1-ec0d-4893-83cc-7772acf7235e tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:40.405572 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-45025ce1-ec0d-4893-83cc-7772acf7235e tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:40.457448 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-45025ce1-ec0d-4893-83cc-7772acf7235e tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] [instance: c1102d0c-2ac8-4e58-b019-daeb20912bcb] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:12:40.610355 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-45025ce1-ec0d-4893-83cc-7772acf7235e tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c1102d0c-2ac8-4e58-b019-daeb20912bcb" status: 204 len: 0 microversion: 2.1 time: 0.226782 Oct 17 14:12:40.611249 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2892/5653] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:12:40 2022] DELETE /compute/v2.1/servers/c1102d0c-2ac8-4e58-b019-daeb20912bcb => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:12:40.620482 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1d3b0bcd-195b-46fa-a0f9-fcca252b15c4 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:40.621841 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1d3b0bcd-195b-46fa-a0f9-fcca252b15c4 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] [instance: c1102d0c-2ac8-4e58-b019-daeb20912bcb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:40.635407 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1d3b0bcd-195b-46fa-a0f9-fcca252b15c4 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:40.636546 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1d3b0bcd-195b-46fa-a0f9-fcca252b15c4 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:40.639578 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1d3b0bcd-195b-46fa-a0f9-fcca252b15c4 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:40.640398 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1d3b0bcd-195b-46fa-a0f9-fcca252b15c4 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:40.640871 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1d3b0bcd-195b-46fa-a0f9-fcca252b15c4 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:40.641307 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1d3b0bcd-195b-46fa-a0f9-fcca252b15c4 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:40.819242 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1d3b0bcd-195b-46fa-a0f9-fcca252b15c4 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaae152014d74abc8cf631c72feb25a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5ad8699d06a4121971e32459e32c81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:40.830903 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1d3b0bcd-195b-46fa-a0f9-fcca252b15c4 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] 10.222.0.79 "GET /compute/v2.1/servers/c1102d0c-2ac8-4e58-b019-daeb20912bcb" status: 200 len: 1512 microversion: 2.1 time: 0.214719 Oct 17 14:12:40.831615 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2762/5654] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:40 2022] GET /compute/v2.1/servers/c1102d0c-2ac8-4e58-b019-daeb20912bcb => generated 1512 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:12:41.854674 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a86dc09a-6a31-4689-a456-dfa936896497 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:41.857266 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a86dc09a-6a31-4689-a456-dfa936896497 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] [instance: c1102d0c-2ac8-4e58-b019-daeb20912bcb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:41.867141 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a86dc09a-6a31-4689-a456-dfa936896497 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:41.868212 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a86dc09a-6a31-4689-a456-dfa936896497 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:41.868859 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a86dc09a-6a31-4689-a456-dfa936896497 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:41.869776 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a86dc09a-6a31-4689-a456-dfa936896497 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:41.870436 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a86dc09a-6a31-4689-a456-dfa936896497 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:41.871609 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a86dc09a-6a31-4689-a456-dfa936896497 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:42.033213 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a86dc09a-6a31-4689-a456-dfa936896497 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaae152014d74abc8cf631c72feb25a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5ad8699d06a4121971e32459e32c81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:42.050701 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a86dc09a-6a31-4689-a456-dfa936896497 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] 10.222.0.79 "GET /compute/v2.1/servers/c1102d0c-2ac8-4e58-b019-daeb20912bcb" status: 200 len: 1512 microversion: 2.1 time: 0.200204 Oct 17 14:12:42.053582 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2893/5655] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:41 2022] GET /compute/v2.1/servers/c1102d0c-2ac8-4e58-b019-daeb20912bcb => generated 1512 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:12:42.945439 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-fa000ede-6f9f-41e0-ac1d-c82fc51545ce req-c371a40b-1dc4-435b-b2d8-aa39345ef33e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1102d0c-2ac8-4e58-b019-daeb20912bcb", "name": "network-vif-deleted", "tag": "ae8e4103-98e5-45c6-a1a8-bff1c52b384c"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:12:42.960646 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-fa000ede-6f9f-41e0-ac1d-c82fc51545ce req-c371a40b-1dc4-435b-b2d8-aa39345ef33e service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:42.961387 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-fa000ede-6f9f-41e0-ac1d-c82fc51545ce req-c371a40b-1dc4-435b-b2d8-aa39345ef33e service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:42.962005 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-fa000ede-6f9f-41e0-ac1d-c82fc51545ce req-c371a40b-1dc4-435b-b2d8-aa39345ef33e service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:42.978625 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-fa000ede-6f9f-41e0-ac1d-c82fc51545ce req-c371a40b-1dc4-435b-b2d8-aa39345ef33e service nova] Creating event network-vif-deleted:ae8e4103-98e5-45c6-a1a8-bff1c52b384c for instance c1102d0c-2ac8-4e58-b019-daeb20912bcb on n-h1-854247-14 Oct 17 14:12:42.987234 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-fa000ede-6f9f-41e0-ac1d-c82fc51545ce req-c371a40b-1dc4-435b-b2d8-aa39345ef33e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045521 Oct 17 14:12:42.988525 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2763/5656] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:12:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:12:43.077735 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f379ee18-00a1-4c6e-b107-d3ed58069fe8 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:43.079138 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f379ee18-00a1-4c6e-b107-d3ed58069fe8 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] [instance: c1102d0c-2ac8-4e58-b019-daeb20912bcb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:43.086753 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f379ee18-00a1-4c6e-b107-d3ed58069fe8 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:43.087536 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f379ee18-00a1-4c6e-b107-d3ed58069fe8 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:43.096709 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f379ee18-00a1-4c6e-b107-d3ed58069fe8 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:43.097749 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f379ee18-00a1-4c6e-b107-d3ed58069fe8 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:43.112247 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f379ee18-00a1-4c6e-b107-d3ed58069fe8 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:43.113892 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f379ee18-00a1-4c6e-b107-d3ed58069fe8 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:43.170900 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f379ee18-00a1-4c6e-b107-d3ed58069fe8 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:43.171699 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f379ee18-00a1-4c6e-b107-d3ed58069fe8 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:43.172407 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f379ee18-00a1-4c6e-b107-d3ed58069fe8 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:43.173050 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-f379ee18-00a1-4c6e-b107-d3ed58069fe8 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lazy-loading 'fault' on Instance uuid c1102d0c-2ac8-4e58-b019-daeb20912bcb {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:12:43.225531 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f379ee18-00a1-4c6e-b107-d3ed58069fe8 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaae152014d74abc8cf631c72feb25a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5ad8699d06a4121971e32459e32c81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:43.234191 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f379ee18-00a1-4c6e-b107-d3ed58069fe8 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] 10.222.0.79 "GET /compute/v2.1/servers/c1102d0c-2ac8-4e58-b019-daeb20912bcb" status: 200 len: 1308 microversion: 2.1 time: 0.160489 Oct 17 14:12:43.235381 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2894/5657] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:43 2022] GET /compute/v2.1/servers/c1102d0c-2ac8-4e58-b019-daeb20912bcb => generated 1308 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:12:44.260574 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4366ef05-995a-4ce5-803e-184fe7694ac7 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:44.262819 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4366ef05-995a-4ce5-803e-184fe7694ac7 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] [instance: c1102d0c-2ac8-4e58-b019-daeb20912bcb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:44.277134 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4366ef05-995a-4ce5-803e-184fe7694ac7 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:44.277702 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4366ef05-995a-4ce5-803e-184fe7694ac7 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:44.278661 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4366ef05-995a-4ce5-803e-184fe7694ac7 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:44.279934 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4366ef05-995a-4ce5-803e-184fe7694ac7 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:44.281336 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4366ef05-995a-4ce5-803e-184fe7694ac7 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:44.282653 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4366ef05-995a-4ce5-803e-184fe7694ac7 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:44.305833 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-4366ef05-995a-4ce5-803e-184fe7694ac7 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] HTTP exception thrown: Instance c1102d0c-2ac8-4e58-b019-daeb20912bcb could not be found. Oct 17 14:12:44.307781 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4366ef05-995a-4ce5-803e-184fe7694ac7 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Request method failure captured: Oct 17 14:12:44.307781 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/c1102d0c-2ac8-4e58-b019-daeb20912bcb HTTP/1.1 Oct 17 14:12:44.307781 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 14:12:44.307781 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 14:12:44.307781 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 14:12:44.307781 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 14:12:44.307781 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 14:12:44.307781 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 14:12:44.307781 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 14:12:44.307781 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 14:12:44.307781 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTWHcWUYX7Iz8qSowC6VF7ekjMGEEAjMrjaxQCl3J6qTMuNfcmOudjqYHstIspbe_VcfELClhO4esQl_fAr-44qEWW4jZUACv2rKilgTmaRq4b--SZCg0vebdYGEcuP_07IfsyuCfioN5yAzc7L4WxfasaP43vlN_jlMWb98lBs3F6i8 Oct 17 14:12:44.307781 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 14:12:44.307781 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 14:12:44.307781 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 14:12:44.307781 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 14:12:44.307781 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 14:12:44.307781 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 14:12:44.307781 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: e5ad8699d06a4121971e32459e32c81d Oct 17 14:12:44.307781 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-VolumesSnapshotTestJSON-162656621 Oct 17 14:12:44.307781 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 14:12:44.307781 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 14:12:44.307781 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e5ad8699d06a4121971e32459e32c81d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/e5ad8699d06a4121971e32459e32c81d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/e5ad8699d06a4121971e32459e32c81d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_e5ad8699d06a4121971e32459e32c81d", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:12:44.307781 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-VolumesSnapshotTestJSON-162656621 Oct 17 14:12:44.307781 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: e5ad8699d06a4121971e32459e32c81d Oct 17 14:12:44.307781 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-162656621 Oct 17 14:12:44.307781 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-VolumesSnapshotTestJSON-162656621-project Oct 17 14:12:44.307781 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 14:12:44.307781 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 14:12:44.307781 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: aaae152014d74abc8cf631c72feb25a6 Oct 17 14:12:44.307781 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-VolumesSnapshotTestJSON-162656621-project Oct 17 14:12:44.307781 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 14:12:44.307781 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance c1102d0c-2ac8-4e58-b019-daeb20912bcb could not be found. Oct 17 14:12:44.307781 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'c1102d0c-2ac8-4e58-b019-daeb20912bcb'} Oct 17 14:12:44.307781 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:12:44.307781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:12:44.307781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:12:44.307781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:12:44.307781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:12:44.307781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:12:44.307781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:12:44.307781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:12:44.307781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:12:44.307781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:12:44.307781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1102d0c-2ac8-4e58-b019-daeb20912bcb could not be found. Oct 17 14:12:44.307781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:12:44.307781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:12:44.307781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:12:44.307781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:12:44.307781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:12:44.307781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:12:44.307781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:12:44.307781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:12:44.307781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:12:44.307781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:12:44.307781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:12:44.307781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:12:44.307781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:12:44.307781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:12:44.307781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:12:44.307781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:12:44.307781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1102d0c-2ac8-4e58-b019-daeb20912bcb could not be found. Oct 17 14:12:44.307781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:12:44.307781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:12:44.307781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:12:44.312825 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:12:44.312825 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:12:44.312825 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:12:44.312825 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:12:44.312825 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:12:44.312825 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1102d0c-2ac8-4e58-b019-daeb20912bcb could not be found. Oct 17 14:12:44.312825 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:12:44.313755 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4366ef05-995a-4ce5-803e-184fe7694ac7 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] Returning 404 to user: Instance c1102d0c-2ac8-4e58-b019-daeb20912bcb could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:12:44.314908 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4366ef05-995a-4ce5-803e-184fe7694ac7 tempest-VolumesSnapshotTestJSON-162656621 tempest-VolumesSnapshotTestJSON-162656621-project] 10.222.0.79 "GET /compute/v2.1/servers/c1102d0c-2ac8-4e58-b019-daeb20912bcb" status: 404 len: 111 microversion: 2.1 time: 0.060231 Oct 17 14:12:44.315669 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2764/5658] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:44 2022] GET /compute/v2.1/servers/c1102d0c-2ac8-4e58-b019-daeb20912bcb => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:13:24.184311 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cb2de800-da84-49b4-9f34-857c2f5ec4f9 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Action: 'create', calling method: .version_select at 0x7f7cd4126670>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-389440035", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIFgrwohXuDgL3Zsaw6q6FrYabiYuMPbrX70+d1lCVnZs+YK5PZJqNEM6htEnK7pTTP5nylNVR1hD8+Qr+wi6Hd5ZiVjHsqQ9R0faYt1UO3zNmLZ7n/1v67DLlojHubqeA=="}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:13:24.206711 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:13:24.211622 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:13:24.242004 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-cb2de800-da84-49b4-9f34-857c2f5ec4f9 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Getting quotas for project 1b981af0923d41809255f04ce299062f. Resources: {'key_pairs'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:13:24.269561 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-cb2de800-da84-49b4-9f34-857c2f5ec4f9 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Getting quotas for user 7fec3f9e6cb241549395b6375b43b22f and project 1b981af0923d41809255f04ce299062f. Resources: {'key_pairs'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:13:24.324035 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cb2de800-da84-49b4-9f34-857c2f5ec4f9 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.151100 Oct 17 14:13:24.325690 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2895/5659] 10.222.0.79 () {60 vars in 1159 bytes} [Mon Oct 17 14:13:24 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:13:27.085852 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=8 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:13:27.087691 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:13:27.092736 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9a678c66-8aa6-4668-94dc-bc2f56f97358 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-923571715", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "8bc43694-6f06-460b-b0d4-359239bac83e"}], "key_name": "tempest-TestNetworkBasicOps-389440035", "security_groups": [{"name": "tempest-secgroup-smoke-2112364275"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:13:27.348734 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-9a678c66-8aa6-4668-94dc-bc2f56f97358 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] validate_networks() for [('8bc43694-6f06-460b-b0d4-359239bac83e', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:13:28.340728 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-9a678c66-8aa6-4668-94dc-bc2f56f97358 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:13:28.341704 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-9a678c66-8aa6-4668-94dc-bc2f56f97358 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:13:28.343285 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-9a678c66-8aa6-4668-94dc-bc2f56f97358 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:13:28.343916 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-9a678c66-8aa6-4668-94dc-bc2f56f97358 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:13:28.344823 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-9a678c66-8aa6-4668-94dc-bc2f56f97358 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:13:28.358676 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9a678c66-8aa6-4668-94dc-bc2f56f97358 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:13:28.359406 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9a678c66-8aa6-4668-94dc-bc2f56f97358 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:13:28.360032 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9a678c66-8aa6-4668-94dc-bc2f56f97358 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:13:28.363046 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9a678c66-8aa6-4668-94dc-bc2f56f97358 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:13:28.363818 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9a678c66-8aa6-4668-94dc-bc2f56f97358 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:13:28.386200 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9a678c66-8aa6-4668-94dc-bc2f56f97358 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:13:28.469019 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-9a678c66-8aa6-4668-94dc-bc2f56f97358 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Getting quotas for project 1b981af0923d41809255f04ce299062f. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:13:28.490504 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-9a678c66-8aa6-4668-94dc-bc2f56f97358 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Getting quotas for user 7fec3f9e6cb241549395b6375b43b22f and project 1b981af0923d41809255f04ce299062f. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:13:28.514385 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9a678c66-8aa6-4668-94dc-bc2f56f97358 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:13:28.519026 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9a678c66-8aa6-4668-94dc-bc2f56f97358 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] [instance: 6dfa9a5b-dfb8-462c-9ddc-4289de89826e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:13:28.628347 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9a678c66-8aa6-4668-94dc-bc2f56f97358 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.542886 Oct 17 14:13:28.653672 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2765/5660] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 14:13:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 1570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:13:28.674155 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-92f1670f-0fab-4b27-ab44-9f6f910f4122 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:13:28.676606 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-92f1670f-0fab-4b27-ab44-9f6f910f4122 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] [instance: 6dfa9a5b-dfb8-462c-9ddc-4289de89826e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:13:28.810606 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-92f1670f-0fab-4b27-ab44-9f6f910f4122 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec3f9e6cb241549395b6375b43b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b981af0923d41809255f04ce299062f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:13:28.822210 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-92f1670f-0fab-4b27-ab44-9f6f910f4122 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] 10.222.0.79 "GET /compute/v2.1/servers/6dfa9a5b-dfb8-462c-9ddc-4289de89826e" status: 200 len: 1247 microversion: 2.1 time: 0.161061 Oct 17 14:13:28.826514 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2896/5661] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:13:28 2022] GET /compute/v2.1/servers/6dfa9a5b-dfb8-462c-9ddc-4289de89826e => generated 1247 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:13:29.861013 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1fbb1365-3fa0-4bf6-bbcc-2a1e0429abd3 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:13:29.862327 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1fbb1365-3fa0-4bf6-bbcc-2a1e0429abd3 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] [instance: 6dfa9a5b-dfb8-462c-9ddc-4289de89826e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:13:29.884242 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1fbb1365-3fa0-4bf6-bbcc-2a1e0429abd3 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:13:29.884983 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1fbb1365-3fa0-4bf6-bbcc-2a1e0429abd3 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:13:29.887231 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1fbb1365-3fa0-4bf6-bbcc-2a1e0429abd3 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:13:29.888178 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1fbb1365-3fa0-4bf6-bbcc-2a1e0429abd3 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:13:29.888843 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1fbb1365-3fa0-4bf6-bbcc-2a1e0429abd3 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:13:29.889843 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1fbb1365-3fa0-4bf6-bbcc-2a1e0429abd3 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:13:30.038345 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1fbb1365-3fa0-4bf6-bbcc-2a1e0429abd3 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec3f9e6cb241549395b6375b43b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b981af0923d41809255f04ce299062f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:13:30.051138 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1fbb1365-3fa0-4bf6-bbcc-2a1e0429abd3 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] 10.222.0.79 "GET /compute/v2.1/servers/6dfa9a5b-dfb8-462c-9ddc-4289de89826e" status: 200 len: 1243 microversion: 2.1 time: 0.197504 Oct 17 14:13:30.052107 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2766/5662] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:13:29 2022] GET /compute/v2.1/servers/6dfa9a5b-dfb8-462c-9ddc-4289de89826e => generated 1243 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:13:31.078953 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3fa9346a-9090-43c8-b27b-acd8092237eb tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:13:31.078953 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3fa9346a-9090-43c8-b27b-acd8092237eb tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] [instance: 6dfa9a5b-dfb8-462c-9ddc-4289de89826e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:13:31.086516 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3fa9346a-9090-43c8-b27b-acd8092237eb tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:13:31.087009 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3fa9346a-9090-43c8-b27b-acd8092237eb tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:13:31.098522 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3fa9346a-9090-43c8-b27b-acd8092237eb tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:13:31.100656 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3fa9346a-9090-43c8-b27b-acd8092237eb tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:13:31.105962 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3fa9346a-9090-43c8-b27b-acd8092237eb tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:13:31.106925 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3fa9346a-9090-43c8-b27b-acd8092237eb tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:13:31.265545 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3fa9346a-9090-43c8-b27b-acd8092237eb tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec3f9e6cb241549395b6375b43b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b981af0923d41809255f04ce299062f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:13:31.285191 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3fa9346a-9090-43c8-b27b-acd8092237eb tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] 10.222.0.79 "GET /compute/v2.1/servers/6dfa9a5b-dfb8-462c-9ddc-4289de89826e" status: 200 len: 1305 microversion: 2.1 time: 0.205810 Oct 17 14:13:31.286286 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2897/5663] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:13:31 2022] GET /compute/v2.1/servers/6dfa9a5b-dfb8-462c-9ddc-4289de89826e => generated 1305 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:13:32.314352 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-148e00f8-3aec-4cd1-935a-df3738485d03 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:13:32.314978 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-148e00f8-3aec-4cd1-935a-df3738485d03 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] [instance: 6dfa9a5b-dfb8-462c-9ddc-4289de89826e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:13:32.337045 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-148e00f8-3aec-4cd1-935a-df3738485d03 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:13:32.338244 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-148e00f8-3aec-4cd1-935a-df3738485d03 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:13:32.338878 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-148e00f8-3aec-4cd1-935a-df3738485d03 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:13:32.340502 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-148e00f8-3aec-4cd1-935a-df3738485d03 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:13:32.342418 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-148e00f8-3aec-4cd1-935a-df3738485d03 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:13:32.346706 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-148e00f8-3aec-4cd1-935a-df3738485d03 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:13:33.543460 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-148e00f8-3aec-4cd1-935a-df3738485d03 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec3f9e6cb241549395b6375b43b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b981af0923d41809255f04ce299062f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:13:33.557888 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-148e00f8-3aec-4cd1-935a-df3738485d03 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] 10.222.0.79 "GET /compute/v2.1/servers/6dfa9a5b-dfb8-462c-9ddc-4289de89826e" status: 200 len: 1373 microversion: 2.1 time: 1.248005 Oct 17 14:13:33.593270 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2767/5664] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:13:32 2022] GET /compute/v2.1/servers/6dfa9a5b-dfb8-462c-9ddc-4289de89826e => generated 1373 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:13:34.044687 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-f21dd1b2-4c4e-45cd-83e8-5a569958d07a req-35dd1540-e8f0-4614-88f6-8af9cbc146c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dfa9a5b-dfb8-462c-9ddc-4289de89826e", "tag": "bcbc48b3-854d-4498-bf6f-f4f11409ebc4"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:13:34.083552 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-f21dd1b2-4c4e-45cd-83e8-5a569958d07a req-35dd1540-e8f0-4614-88f6-8af9cbc146c9 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:13:34.084071 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-f21dd1b2-4c4e-45cd-83e8-5a569958d07a req-35dd1540-e8f0-4614-88f6-8af9cbc146c9 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:13:34.084506 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-f21dd1b2-4c4e-45cd-83e8-5a569958d07a req-35dd1540-e8f0-4614-88f6-8af9cbc146c9 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:13:34.108940 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-f21dd1b2-4c4e-45cd-83e8-5a569958d07a req-35dd1540-e8f0-4614-88f6-8af9cbc146c9 service nova] Creating event network-changed:bcbc48b3-854d-4498-bf6f-f4f11409ebc4 for instance 6dfa9a5b-dfb8-462c-9ddc-4289de89826e on n-h1-854247-14 Oct 17 14:13:34.115362 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-f21dd1b2-4c4e-45cd-83e8-5a569958d07a req-35dd1540-e8f0-4614-88f6-8af9cbc146c9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074559 Oct 17 14:13:34.116805 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2898/5665] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:13:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:13:34.623759 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1d559902-59d3-48e8-8b05-4f7f21757f4c tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:13:34.625391 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1d559902-59d3-48e8-8b05-4f7f21757f4c tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] [instance: 6dfa9a5b-dfb8-462c-9ddc-4289de89826e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:13:34.641514 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1d559902-59d3-48e8-8b05-4f7f21757f4c tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:13:34.644652 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1d559902-59d3-48e8-8b05-4f7f21757f4c tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:13:34.645901 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1d559902-59d3-48e8-8b05-4f7f21757f4c tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:13:34.646985 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1d559902-59d3-48e8-8b05-4f7f21757f4c tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:13:34.647762 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1d559902-59d3-48e8-8b05-4f7f21757f4c tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:13:34.663522 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1d559902-59d3-48e8-8b05-4f7f21757f4c tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:13:35.075205 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1d559902-59d3-48e8-8b05-4f7f21757f4c tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec3f9e6cb241549395b6375b43b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b981af0923d41809255f04ce299062f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:13:35.099327 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1d559902-59d3-48e8-8b05-4f7f21757f4c tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] 10.222.0.79 "GET /compute/v2.1/servers/6dfa9a5b-dfb8-462c-9ddc-4289de89826e" status: 200 len: 1373 microversion: 2.1 time: 0.482768 Oct 17 14:13:35.101044 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2768/5666] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:13:34 2022] GET /compute/v2.1/servers/6dfa9a5b-dfb8-462c-9ddc-4289de89826e => generated 1373 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:13:36.126351 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f9c71c6d-0c6b-48da-ae6a-543eeaaf01e6 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:13:36.127106 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f9c71c6d-0c6b-48da-ae6a-543eeaaf01e6 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] [instance: 6dfa9a5b-dfb8-462c-9ddc-4289de89826e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:13:36.139198 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f9c71c6d-0c6b-48da-ae6a-543eeaaf01e6 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:13:36.139924 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f9c71c6d-0c6b-48da-ae6a-543eeaaf01e6 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:13:36.140362 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f9c71c6d-0c6b-48da-ae6a-543eeaaf01e6 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:13:36.141258 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f9c71c6d-0c6b-48da-ae6a-543eeaaf01e6 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:13:36.141725 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f9c71c6d-0c6b-48da-ae6a-543eeaaf01e6 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:13:36.142158 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f9c71c6d-0c6b-48da-ae6a-543eeaaf01e6 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:13:36.896354 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f9c71c6d-0c6b-48da-ae6a-543eeaaf01e6 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec3f9e6cb241549395b6375b43b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b981af0923d41809255f04ce299062f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:13:36.905440 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f9c71c6d-0c6b-48da-ae6a-543eeaaf01e6 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] 10.222.0.79 "GET /compute/v2.1/servers/6dfa9a5b-dfb8-462c-9ddc-4289de89826e" status: 200 len: 1373 microversion: 2.1 time: 0.786039 Oct 17 14:13:36.912072 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2899/5667] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:13:36 2022] GET /compute/v2.1/servers/6dfa9a5b-dfb8-462c-9ddc-4289de89826e => generated 1373 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:13:37.929932 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-328fe7fd-f496-4b8e-a7d9-b29f535c08b3 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:13:37.931957 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-328fe7fd-f496-4b8e-a7d9-b29f535c08b3 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] [instance: 6dfa9a5b-dfb8-462c-9ddc-4289de89826e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:13:37.958823 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-328fe7fd-f496-4b8e-a7d9-b29f535c08b3 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:13:37.959789 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-328fe7fd-f496-4b8e-a7d9-b29f535c08b3 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:13:37.961240 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-328fe7fd-f496-4b8e-a7d9-b29f535c08b3 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:13:37.963393 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-328fe7fd-f496-4b8e-a7d9-b29f535c08b3 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:13:37.964033 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-328fe7fd-f496-4b8e-a7d9-b29f535c08b3 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:13:37.967844 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-328fe7fd-f496-4b8e-a7d9-b29f535c08b3 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:13:38.189824 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-328fe7fd-f496-4b8e-a7d9-b29f535c08b3 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec3f9e6cb241549395b6375b43b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b981af0923d41809255f04ce299062f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:13:38.199581 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-328fe7fd-f496-4b8e-a7d9-b29f535c08b3 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] 10.222.0.79 "GET /compute/v2.1/servers/6dfa9a5b-dfb8-462c-9ddc-4289de89826e" status: 200 len: 1373 microversion: 2.1 time: 0.274226 Oct 17 14:13:38.200809 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2769/5668] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:13:37 2022] GET /compute/v2.1/servers/6dfa9a5b-dfb8-462c-9ddc-4289de89826e => generated 1373 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:13:39.225321 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-916eaba2-6dd5-445c-aeaa-1ea7fa23e5d8 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:13:39.226381 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-916eaba2-6dd5-445c-aeaa-1ea7fa23e5d8 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] [instance: 6dfa9a5b-dfb8-462c-9ddc-4289de89826e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:13:39.232990 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=6 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:13:39.246525 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-916eaba2-6dd5-445c-aeaa-1ea7fa23e5d8 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:13:39.248852 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-916eaba2-6dd5-445c-aeaa-1ea7fa23e5d8 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:13:39.251897 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-916eaba2-6dd5-445c-aeaa-1ea7fa23e5d8 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:13:39.253334 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-916eaba2-6dd5-445c-aeaa-1ea7fa23e5d8 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:13:39.254098 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-916eaba2-6dd5-445c-aeaa-1ea7fa23e5d8 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:13:39.254848 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-916eaba2-6dd5-445c-aeaa-1ea7fa23e5d8 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:13:39.424302 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-916eaba2-6dd5-445c-aeaa-1ea7fa23e5d8 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec3f9e6cb241549395b6375b43b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b981af0923d41809255f04ce299062f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:13:39.435369 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-916eaba2-6dd5-445c-aeaa-1ea7fa23e5d8 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] 10.222.0.79 "GET /compute/v2.1/servers/6dfa9a5b-dfb8-462c-9ddc-4289de89826e" status: 200 len: 1373 microversion: 2.1 time: 0.215398 Oct 17 14:13:39.440582 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2900/5669] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:13:39 2022] GET /compute/v2.1/servers/6dfa9a5b-dfb8-462c-9ddc-4289de89826e => generated 1373 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:13:40.459671 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c1b6a153-c469-4fd9-b010-e626e5ef4d4d tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:13:40.460459 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c1b6a153-c469-4fd9-b010-e626e5ef4d4d tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] [instance: 6dfa9a5b-dfb8-462c-9ddc-4289de89826e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:13:40.462409 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:13:40.463072 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=6 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:13:40.470720 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c1b6a153-c469-4fd9-b010-e626e5ef4d4d tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:13:40.471234 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c1b6a153-c469-4fd9-b010-e626e5ef4d4d tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:13:40.471870 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c1b6a153-c469-4fd9-b010-e626e5ef4d4d tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:13:40.472603 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c1b6a153-c469-4fd9-b010-e626e5ef4d4d tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:13:40.473057 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c1b6a153-c469-4fd9-b010-e626e5ef4d4d tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:13:40.473481 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c1b6a153-c469-4fd9-b010-e626e5ef4d4d tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:13:40.633208 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c1b6a153-c469-4fd9-b010-e626e5ef4d4d tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec3f9e6cb241549395b6375b43b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b981af0923d41809255f04ce299062f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:13:40.642646 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c1b6a153-c469-4fd9-b010-e626e5ef4d4d tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] 10.222.0.79 "GET /compute/v2.1/servers/6dfa9a5b-dfb8-462c-9ddc-4289de89826e" status: 200 len: 1373 microversion: 2.1 time: 0.187635 Oct 17 14:13:40.656566 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2770/5670] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:13:40 2022] GET /compute/v2.1/servers/6dfa9a5b-dfb8-462c-9ddc-4289de89826e => generated 1373 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:13:40.792259 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-6f90668c-d617-4911-9402-8911ec08edab req-9bdd1a51-08b6-4ddc-a1fd-d0df60a01cf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dfa9a5b-dfb8-462c-9ddc-4289de89826e", "name": "network-vif-plugged", "status": "completed", "tag": "bcbc48b3-854d-4498-bf6f-f4f11409ebc4"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:13:40.810391 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-6f90668c-d617-4911-9402-8911ec08edab req-9bdd1a51-08b6-4ddc-a1fd-d0df60a01cf6 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:13:40.814916 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-6f90668c-d617-4911-9402-8911ec08edab req-9bdd1a51-08b6-4ddc-a1fd-d0df60a01cf6 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:13:40.815602 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-6f90668c-d617-4911-9402-8911ec08edab req-9bdd1a51-08b6-4ddc-a1fd-d0df60a01cf6 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:13:40.828186 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-6f90668c-d617-4911-9402-8911ec08edab req-9bdd1a51-08b6-4ddc-a1fd-d0df60a01cf6 service nova] Creating event network-vif-plugged:bcbc48b3-854d-4498-bf6f-f4f11409ebc4 for instance 6dfa9a5b-dfb8-462c-9ddc-4289de89826e on n-h1-854247-14 Oct 17 14:13:40.835829 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-6f90668c-d617-4911-9402-8911ec08edab req-9bdd1a51-08b6-4ddc-a1fd-d0df60a01cf6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048126 Oct 17 14:13:40.837208 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2901/5671] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:13:41.665889 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-606756c5-e803-4292-af81-8ac265f77fad tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:13:41.666489 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-606756c5-e803-4292-af81-8ac265f77fad tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] [instance: 6dfa9a5b-dfb8-462c-9ddc-4289de89826e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:13:41.674156 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-606756c5-e803-4292-af81-8ac265f77fad tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:13:41.674955 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-606756c5-e803-4292-af81-8ac265f77fad tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:13:41.675570 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-606756c5-e803-4292-af81-8ac265f77fad tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:13:41.676452 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-606756c5-e803-4292-af81-8ac265f77fad tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:13:41.677091 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-606756c5-e803-4292-af81-8ac265f77fad tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:13:41.677665 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-606756c5-e803-4292-af81-8ac265f77fad tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:13:41.873247 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-606756c5-e803-4292-af81-8ac265f77fad tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec3f9e6cb241549395b6375b43b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b981af0923d41809255f04ce299062f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:13:41.882320 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-606756c5-e803-4292-af81-8ac265f77fad tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] 10.222.0.79 "GET /compute/v2.1/servers/6dfa9a5b-dfb8-462c-9ddc-4289de89826e" status: 200 len: 1373 microversion: 2.1 time: 0.220201 Oct 17 14:13:41.884325 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2771/5672] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:13:41 2022] GET /compute/v2.1/servers/6dfa9a5b-dfb8-462c-9ddc-4289de89826e => generated 1373 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:13:42.909373 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a2b1c575-7480-452c-b916-b631c7d57bda tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:13:42.910081 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a2b1c575-7480-452c-b916-b631c7d57bda tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] [instance: 6dfa9a5b-dfb8-462c-9ddc-4289de89826e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:13:42.916779 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a2b1c575-7480-452c-b916-b631c7d57bda tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:13:42.917475 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a2b1c575-7480-452c-b916-b631c7d57bda tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:13:42.918065 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a2b1c575-7480-452c-b916-b631c7d57bda tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:13:42.918933 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a2b1c575-7480-452c-b916-b631c7d57bda tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:13:42.919581 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a2b1c575-7480-452c-b916-b631c7d57bda tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:13:42.919999 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a2b1c575-7480-452c-b916-b631c7d57bda tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:13:43.086373 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a2b1c575-7480-452c-b916-b631c7d57bda tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec3f9e6cb241549395b6375b43b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b981af0923d41809255f04ce299062f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:13:43.095902 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a2b1c575-7480-452c-b916-b631c7d57bda tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] 10.222.0.79 "GET /compute/v2.1/servers/6dfa9a5b-dfb8-462c-9ddc-4289de89826e" status: 200 len: 1545 microversion: 2.1 time: 0.192124 Oct 17 14:13:43.097249 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2902/5673] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:13:42 2022] GET /compute/v2.1/servers/6dfa9a5b-dfb8-462c-9ddc-4289de89826e => generated 1545 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:13:43.118954 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8d509f6c-70bf-4c4c-b29e-7f9123073d2d tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:13:43.119876 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8d509f6c-70bf-4c4c-b29e-7f9123073d2d tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] [instance: 6dfa9a5b-dfb8-462c-9ddc-4289de89826e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:13:43.130102 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8d509f6c-70bf-4c4c-b29e-7f9123073d2d tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:13:43.130612 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8d509f6c-70bf-4c4c-b29e-7f9123073d2d tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:13:43.131091 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8d509f6c-70bf-4c4c-b29e-7f9123073d2d tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:13:43.131842 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8d509f6c-70bf-4c4c-b29e-7f9123073d2d tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:13:43.132300 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8d509f6c-70bf-4c4c-b29e-7f9123073d2d tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:13:43.132723 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8d509f6c-70bf-4c4c-b29e-7f9123073d2d tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:13:43.314043 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8d509f6c-70bf-4c4c-b29e-7f9123073d2d tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec3f9e6cb241549395b6375b43b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b981af0923d41809255f04ce299062f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:13:43.323077 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8d509f6c-70bf-4c4c-b29e-7f9123073d2d tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] 10.222.0.79 "GET /compute/v2.1/servers/6dfa9a5b-dfb8-462c-9ddc-4289de89826e" status: 200 len: 1545 microversion: 2.1 time: 0.208009 Oct 17 14:13:43.323842 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2772/5674] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:13:43 2022] GET /compute/v2.1/servers/6dfa9a5b-dfb8-462c-9ddc-4289de89826e => generated 1545 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:13:45.806838 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-9343b858-43d2-456d-8466-507f033cee0f req-e3086008-1722-427f-b227-c2ea0c96437f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dfa9a5b-dfb8-462c-9ddc-4289de89826e", "tag": "bcbc48b3-854d-4498-bf6f-f4f11409ebc4"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:13:45.820235 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-9343b858-43d2-456d-8466-507f033cee0f req-e3086008-1722-427f-b227-c2ea0c96437f service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:13:45.821519 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-9343b858-43d2-456d-8466-507f033cee0f req-e3086008-1722-427f-b227-c2ea0c96437f service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:13:45.822115 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-9343b858-43d2-456d-8466-507f033cee0f req-e3086008-1722-427f-b227-c2ea0c96437f service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:13:45.835653 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-9343b858-43d2-456d-8466-507f033cee0f req-e3086008-1722-427f-b227-c2ea0c96437f service nova] Creating event network-changed:bcbc48b3-854d-4498-bf6f-f4f11409ebc4 for instance 6dfa9a5b-dfb8-462c-9ddc-4289de89826e on n-h1-854247-14 Oct 17 14:13:45.842744 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-9343b858-43d2-456d-8466-507f033cee0f req-e3086008-1722-427f-b227-c2ea0c96437f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040667 Oct 17 14:13:45.846178 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2903/5675] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:14:06.252842 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:14:06.254624 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=44 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:14:06.457501 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7eca0f03-7da8-491c-8dad-dcb9f875bb9c tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:06.459725 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7eca0f03-7da8-491c-8dad-dcb9f875bb9c tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:06.460291 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7eca0f03-7da8-491c-8dad-dcb9f875bb9c tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:06.460797 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7eca0f03-7da8-491c-8dad-dcb9f875bb9c tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:06.463114 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7eca0f03-7da8-491c-8dad-dcb9f875bb9c tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:06.463466 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7eca0f03-7da8-491c-8dad-dcb9f875bb9c tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:06.464106 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7eca0f03-7da8-491c-8dad-dcb9f875bb9c tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:06.494536 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7eca0f03-7da8-491c-8dad-dcb9f875bb9c tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] 10.222.0.79 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.247233 Oct 17 14:14:06.496024 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2773/5676] 10.222.0.79 () {58 vars in 1185 bytes} [Mon Oct 17 14:14:06 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:14:06.627387 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:14:06.628631 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=30 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:14:06.633505 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e710d190-6df2-495a-815a-34fbf7036af7 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-158196625", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "availability_zone": "nova:n-h1-854247-14", "networks": [{"uuid": "d06f3f75-ca93-40cb-9c82-67504b24d13c"}]}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:14:06.701035 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-e710d190-6df2-495a-815a-34fbf7036af7 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] validate_networks() for [('d06f3f75-ca93-40cb-9c82-67504b24d13c', None, None, None, None, None)] {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:14:06.934011 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f438bf11-b930-4b0b-af31-ab9513c705c5 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:14:06.936512 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f438bf11-b930-4b0b-af31-ab9513c705c5 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] [instance: 6dfa9a5b-dfb8-462c-9ddc-4289de89826e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:06.943205 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f438bf11-b930-4b0b-af31-ab9513c705c5 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:06.944015 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f438bf11-b930-4b0b-af31-ab9513c705c5 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:06.944662 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f438bf11-b930-4b0b-af31-ab9513c705c5 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:06.945802 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f438bf11-b930-4b0b-af31-ab9513c705c5 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:06.946466 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f438bf11-b930-4b0b-af31-ab9513c705c5 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:06.947094 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f438bf11-b930-4b0b-af31-ab9513c705c5 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:07.004359 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f438bf11-b930-4b0b-af31-ab9513c705c5 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] 10.222.0.79 "POST /compute/v2.1/servers/6dfa9a5b-dfb8-462c-9ddc-4289de89826e/action" status: 200 len: 24535 microversion: 2.1 time: 0.073823 Oct 17 14:14:07.006009 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2774/5677] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:14:06 2022] POST /compute/v2.1/servers/6dfa9a5b-dfb8-462c-9ddc-4289de89826e/action => generated 24535 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:14:07.118811 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-e710d190-6df2-495a-815a-34fbf7036af7 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:14:07.119694 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-e710d190-6df2-495a-815a-34fbf7036af7 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:14:07.120320 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-e710d190-6df2-495a-815a-34fbf7036af7 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:14:07.120895 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-e710d190-6df2-495a-815a-34fbf7036af7 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:14:07.121542 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-e710d190-6df2-495a-815a-34fbf7036af7 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:14:07.133331 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e710d190-6df2-495a-815a-34fbf7036af7 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:07.133841 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e710d190-6df2-495a-815a-34fbf7036af7 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:07.134291 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e710d190-6df2-495a-815a-34fbf7036af7 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:07.135036 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e710d190-6df2-495a-815a-34fbf7036af7 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:07.135526 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e710d190-6df2-495a-815a-34fbf7036af7 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:07.135953 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e710d190-6df2-495a-815a-34fbf7036af7 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:07.158369 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-e710d190-6df2-495a-815a-34fbf7036af7 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Getting quotas for project 6f4dded84add4006924e5c44bf2a0aaf. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:14:07.164637 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-e710d190-6df2-495a-815a-34fbf7036af7 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Getting quotas for user 48694cd9908e41f88b904c251fa4cf37 and project 6f4dded84add4006924e5c44bf2a0aaf. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:14:07.184361 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e710d190-6df2-495a-815a-34fbf7036af7 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:14:07.186863 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e710d190-6df2-495a-815a-34fbf7036af7 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] [instance: aac0e70b-f9ec-4242-bac2-8e8dc29bb460] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:14:07.241578 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e710d190-6df2-495a-815a-34fbf7036af7 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.616446 Oct 17 14:14:07.248688 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2904/5678] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 14:14:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:14:07.254901 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-352dbd28-4da9-4b62-998c-7f82e7e05b8d tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:07.256961 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-352dbd28-4da9-4b62-998c-7f82e7e05b8d tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] [instance: aac0e70b-f9ec-4242-bac2-8e8dc29bb460] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:07.335697 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-352dbd28-4da9-4b62-998c-7f82e7e05b8d tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/aac0e70b-f9ec-4242-bac2-8e8dc29bb460" status: 200 len: 1328 microversion: 2.1 time: 0.085732 Oct 17 14:14:07.336301 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2775/5679] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:07 2022] GET /compute/v2.1/servers/aac0e70b-f9ec-4242-bac2-8e8dc29bb460 => generated 1328 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:14:08.361488 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c0d68226-7a82-47d2-b5be-818254becf2d tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:08.362972 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c0d68226-7a82-47d2-b5be-818254becf2d tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] [instance: aac0e70b-f9ec-4242-bac2-8e8dc29bb460] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:08.377720 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c0d68226-7a82-47d2-b5be-818254becf2d tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:08.380401 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c0d68226-7a82-47d2-b5be-818254becf2d tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:08.381038 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c0d68226-7a82-47d2-b5be-818254becf2d tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:08.382124 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c0d68226-7a82-47d2-b5be-818254becf2d tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:08.382746 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c0d68226-7a82-47d2-b5be-818254becf2d tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:08.383522 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c0d68226-7a82-47d2-b5be-818254becf2d tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:08.529365 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c0d68226-7a82-47d2-b5be-818254becf2d tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/aac0e70b-f9ec-4242-bac2-8e8dc29bb460" status: 200 len: 1417 microversion: 2.1 time: 0.172849 Oct 17 14:14:08.530468 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2905/5680] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:08 2022] GET /compute/v2.1/servers/aac0e70b-f9ec-4242-bac2-8e8dc29bb460 => generated 1417 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:14:09.557022 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7e6aae65-db74-4975-ae1c-a88edf54ab4b tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:09.558114 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7e6aae65-db74-4975-ae1c-a88edf54ab4b tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] [instance: aac0e70b-f9ec-4242-bac2-8e8dc29bb460] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:09.573849 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7e6aae65-db74-4975-ae1c-a88edf54ab4b tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:09.574651 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7e6aae65-db74-4975-ae1c-a88edf54ab4b tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:09.575990 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7e6aae65-db74-4975-ae1c-a88edf54ab4b tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:09.578325 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7e6aae65-db74-4975-ae1c-a88edf54ab4b tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:09.580096 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7e6aae65-db74-4975-ae1c-a88edf54ab4b tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:09.580973 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7e6aae65-db74-4975-ae1c-a88edf54ab4b tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:10.033067 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7e6aae65-db74-4975-ae1c-a88edf54ab4b tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/aac0e70b-f9ec-4242-bac2-8e8dc29bb460" status: 200 len: 1465 microversion: 2.1 time: 0.474852 Oct 17 14:14:10.041830 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2776/5681] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:09 2022] GET /compute/v2.1/servers/aac0e70b-f9ec-4242-bac2-8e8dc29bb460 => generated 1465 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:14:11.045863 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-529c8d34-e1e8-4bc7-96b1-c8a0baac4241 req-e736147d-dc08-4ec2-8a18-77f91cc54a14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aac0e70b-f9ec-4242-bac2-8e8dc29bb460", "tag": "eaae01b2-12e3-43ca-b5b5-11d876691530"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:14:11.066800 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4bad16b5-d3f6-4549-8df4-c410079ddaaa tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:11.068465 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4bad16b5-d3f6-4549-8df4-c410079ddaaa tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] [instance: aac0e70b-f9ec-4242-bac2-8e8dc29bb460] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:11.080779 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4bad16b5-d3f6-4549-8df4-c410079ddaaa tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:11.083255 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-529c8d34-e1e8-4bc7-96b1-c8a0baac4241 req-e736147d-dc08-4ec2-8a18-77f91cc54a14 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:11.084095 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-529c8d34-e1e8-4bc7-96b1-c8a0baac4241 req-e736147d-dc08-4ec2-8a18-77f91cc54a14 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:11.084788 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-529c8d34-e1e8-4bc7-96b1-c8a0baac4241 req-e736147d-dc08-4ec2-8a18-77f91cc54a14 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:11.086198 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4bad16b5-d3f6-4549-8df4-c410079ddaaa tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:11.086946 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4bad16b5-d3f6-4549-8df4-c410079ddaaa tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:11.090204 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4bad16b5-d3f6-4549-8df4-c410079ddaaa tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:11.090977 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4bad16b5-d3f6-4549-8df4-c410079ddaaa tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:11.091692 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4bad16b5-d3f6-4549-8df4-c410079ddaaa tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:11.114557 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-529c8d34-e1e8-4bc7-96b1-c8a0baac4241 req-e736147d-dc08-4ec2-8a18-77f91cc54a14 service nova] Creating event network-changed:eaae01b2-12e3-43ca-b5b5-11d876691530 for instance aac0e70b-f9ec-4242-bac2-8e8dc29bb460 on n-h1-854247-14 Oct 17 14:14:11.128016 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-529c8d34-e1e8-4bc7-96b1-c8a0baac4241 req-e736147d-dc08-4ec2-8a18-77f91cc54a14 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085770 Oct 17 14:14:11.130339 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2906/5682] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:14:11.337183 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4bad16b5-d3f6-4549-8df4-c410079ddaaa tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/aac0e70b-f9ec-4242-bac2-8e8dc29bb460" status: 200 len: 1465 microversion: 2.1 time: 0.275914 Oct 17 14:14:11.338500 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2777/5683] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:11 2022] GET /compute/v2.1/servers/aac0e70b-f9ec-4242-bac2-8e8dc29bb460 => generated 1465 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:14:12.368657 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-81f8b1d6-262c-41e1-a333-42971b5e5cce tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:12.369361 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-81f8b1d6-262c-41e1-a333-42971b5e5cce tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] [instance: aac0e70b-f9ec-4242-bac2-8e8dc29bb460] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:12.376652 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-81f8b1d6-262c-41e1-a333-42971b5e5cce tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:12.377281 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-81f8b1d6-262c-41e1-a333-42971b5e5cce tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:12.377757 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-81f8b1d6-262c-41e1-a333-42971b5e5cce tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:12.378481 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-81f8b1d6-262c-41e1-a333-42971b5e5cce tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:12.378941 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-81f8b1d6-262c-41e1-a333-42971b5e5cce tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:12.379461 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-81f8b1d6-262c-41e1-a333-42971b5e5cce tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:12.536383 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-81f8b1d6-262c-41e1-a333-42971b5e5cce tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/aac0e70b-f9ec-4242-bac2-8e8dc29bb460" status: 200 len: 1465 microversion: 2.1 time: 0.173149 Oct 17 14:14:12.537019 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2907/5684] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:12 2022] GET /compute/v2.1/servers/aac0e70b-f9ec-4242-bac2-8e8dc29bb460 => generated 1465 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:14:13.572124 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-864aafba-da3d-4972-9fe4-955ac5bf7234 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:13.573359 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-864aafba-da3d-4972-9fe4-955ac5bf7234 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] [instance: aac0e70b-f9ec-4242-bac2-8e8dc29bb460] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:13.608060 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-864aafba-da3d-4972-9fe4-955ac5bf7234 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:13.608601 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-864aafba-da3d-4972-9fe4-955ac5bf7234 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:13.611755 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-864aafba-da3d-4972-9fe4-955ac5bf7234 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:13.616887 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-864aafba-da3d-4972-9fe4-955ac5bf7234 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:13.617785 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-864aafba-da3d-4972-9fe4-955ac5bf7234 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:13.619832 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-864aafba-da3d-4972-9fe4-955ac5bf7234 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:13.838806 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-864aafba-da3d-4972-9fe4-955ac5bf7234 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/aac0e70b-f9ec-4242-bac2-8e8dc29bb460" status: 200 len: 1465 microversion: 2.1 time: 0.282309 Oct 17 14:14:13.839416 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2778/5685] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:13 2022] GET /compute/v2.1/servers/aac0e70b-f9ec-4242-bac2-8e8dc29bb460 => generated 1465 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:14:14.861902 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0a623a00-1f23-4b68-ae44-e9a41dfce70e tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:14.863452 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0a623a00-1f23-4b68-ae44-e9a41dfce70e tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] [instance: aac0e70b-f9ec-4242-bac2-8e8dc29bb460] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:14.872549 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0a623a00-1f23-4b68-ae44-e9a41dfce70e tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:14.873454 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0a623a00-1f23-4b68-ae44-e9a41dfce70e tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:14.874356 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0a623a00-1f23-4b68-ae44-e9a41dfce70e tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:14.875418 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0a623a00-1f23-4b68-ae44-e9a41dfce70e tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:14.876393 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0a623a00-1f23-4b68-ae44-e9a41dfce70e tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:14.877039 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0a623a00-1f23-4b68-ae44-e9a41dfce70e tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:15.090752 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0a623a00-1f23-4b68-ae44-e9a41dfce70e tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/aac0e70b-f9ec-4242-bac2-8e8dc29bb460" status: 200 len: 1465 microversion: 2.1 time: 0.232808 Oct 17 14:14:15.092735 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2908/5686] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:14 2022] GET /compute/v2.1/servers/aac0e70b-f9ec-4242-bac2-8e8dc29bb460 => generated 1465 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:14:16.116185 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-70a905d7-4976-46b6-9a05-747c8d9f0bdb tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:16.117487 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-70a905d7-4976-46b6-9a05-747c8d9f0bdb tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] [instance: aac0e70b-f9ec-4242-bac2-8e8dc29bb460] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:16.124632 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70a905d7-4976-46b6-9a05-747c8d9f0bdb tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:16.125346 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70a905d7-4976-46b6-9a05-747c8d9f0bdb tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:16.126087 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70a905d7-4976-46b6-9a05-747c8d9f0bdb tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:16.126965 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70a905d7-4976-46b6-9a05-747c8d9f0bdb tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:16.127600 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70a905d7-4976-46b6-9a05-747c8d9f0bdb tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:16.128179 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70a905d7-4976-46b6-9a05-747c8d9f0bdb tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:16.284848 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-70a905d7-4976-46b6-9a05-747c8d9f0bdb tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/aac0e70b-f9ec-4242-bac2-8e8dc29bb460" status: 200 len: 1465 microversion: 2.1 time: 0.172308 Oct 17 14:14:16.285847 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2779/5687] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:16 2022] GET /compute/v2.1/servers/aac0e70b-f9ec-4242-bac2-8e8dc29bb460 => generated 1465 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:14:16.894699 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-a51ea123-bea7-4394-ba0f-e605cfa2c6b3 req-ca210bdc-6bfe-4549-aa0e-9d935c180749 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aac0e70b-f9ec-4242-bac2-8e8dc29bb460", "name": "network-vif-plugged", "status": "completed", "tag": "eaae01b2-12e3-43ca-b5b5-11d876691530"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:14:16.906724 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-a51ea123-bea7-4394-ba0f-e605cfa2c6b3 req-ca210bdc-6bfe-4549-aa0e-9d935c180749 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:16.908135 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-a51ea123-bea7-4394-ba0f-e605cfa2c6b3 req-ca210bdc-6bfe-4549-aa0e-9d935c180749 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:16.908871 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-a51ea123-bea7-4394-ba0f-e605cfa2c6b3 req-ca210bdc-6bfe-4549-aa0e-9d935c180749 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:16.931588 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-a51ea123-bea7-4394-ba0f-e605cfa2c6b3 req-ca210bdc-6bfe-4549-aa0e-9d935c180749 service nova] Creating event network-vif-plugged:eaae01b2-12e3-43ca-b5b5-11d876691530 for instance aac0e70b-f9ec-4242-bac2-8e8dc29bb460 on n-h1-854247-14 Oct 17 14:14:16.937327 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-a51ea123-bea7-4394-ba0f-e605cfa2c6b3 req-ca210bdc-6bfe-4549-aa0e-9d935c180749 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046811 Oct 17 14:14:16.938396 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2909/5688] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:14:17.310135 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9ff34567-5f99-48a3-acc0-4a7c06b4386e tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:17.311583 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9ff34567-5f99-48a3-acc0-4a7c06b4386e tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] [instance: aac0e70b-f9ec-4242-bac2-8e8dc29bb460] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:17.320083 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:14:17.323710 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9ff34567-5f99-48a3-acc0-4a7c06b4386e tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:17.325827 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9ff34567-5f99-48a3-acc0-4a7c06b4386e tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:17.325827 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9ff34567-5f99-48a3-acc0-4a7c06b4386e tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:17.326046 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9ff34567-5f99-48a3-acc0-4a7c06b4386e tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:17.326585 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9ff34567-5f99-48a3-acc0-4a7c06b4386e tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:17.328519 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9ff34567-5f99-48a3-acc0-4a7c06b4386e tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:17.340181 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:14:17.472824 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9ff34567-5f99-48a3-acc0-4a7c06b4386e tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/aac0e70b-f9ec-4242-bac2-8e8dc29bb460" status: 200 len: 1465 microversion: 2.1 time: 0.167524 Oct 17 14:14:17.487394 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2780/5689] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:17 2022] GET /compute/v2.1/servers/aac0e70b-f9ec-4242-bac2-8e8dc29bb460 => generated 1465 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:14:18.496848 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:14:18.497882 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=6 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:14:18.503092 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d1a0117d-6245-4029-a327-2c42b1585093 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:18.504090 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d1a0117d-6245-4029-a327-2c42b1585093 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] [instance: aac0e70b-f9ec-4242-bac2-8e8dc29bb460] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:18.513737 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d1a0117d-6245-4029-a327-2c42b1585093 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:18.514240 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d1a0117d-6245-4029-a327-2c42b1585093 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:18.514677 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d1a0117d-6245-4029-a327-2c42b1585093 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:18.515408 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d1a0117d-6245-4029-a327-2c42b1585093 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:18.515880 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d1a0117d-6245-4029-a327-2c42b1585093 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:18.516311 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d1a0117d-6245-4029-a327-2c42b1585093 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:18.668097 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d1a0117d-6245-4029-a327-2c42b1585093 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/aac0e70b-f9ec-4242-bac2-8e8dc29bb460" status: 200 len: 1650 microversion: 2.1 time: 0.172251 Oct 17 14:14:18.668998 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2910/5690] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:18 2022] GET /compute/v2.1/servers/aac0e70b-f9ec-4242-bac2-8e8dc29bb460 => generated 1650 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:14:18.691744 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2c4106b6-293c-4cdb-82fd-7251a191e68b tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:18.692372 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2c4106b6-293c-4cdb-82fd-7251a191e68b tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] [instance: aac0e70b-f9ec-4242-bac2-8e8dc29bb460] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:18.699735 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2c4106b6-293c-4cdb-82fd-7251a191e68b tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:18.700696 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2c4106b6-293c-4cdb-82fd-7251a191e68b tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:18.701410 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2c4106b6-293c-4cdb-82fd-7251a191e68b tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:18.702377 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2c4106b6-293c-4cdb-82fd-7251a191e68b tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:18.702813 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2c4106b6-293c-4cdb-82fd-7251a191e68b tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:18.703281 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2c4106b6-293c-4cdb-82fd-7251a191e68b tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:18.847979 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2c4106b6-293c-4cdb-82fd-7251a191e68b tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/aac0e70b-f9ec-4242-bac2-8e8dc29bb460" status: 200 len: 1650 microversion: 2.1 time: 0.160774 Oct 17 14:14:18.848546 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2781/5691] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:18 2022] GET /compute/v2.1/servers/aac0e70b-f9ec-4242-bac2-8e8dc29bb460 => generated 1650 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:14:18.870925 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0b8e247a-3f68-4be8-a026-5db38075ee91 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:18.871579 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0b8e247a-3f68-4be8-a026-5db38075ee91 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] [instance: aac0e70b-f9ec-4242-bac2-8e8dc29bb460] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:18.878332 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0b8e247a-3f68-4be8-a026-5db38075ee91 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:18.878815 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0b8e247a-3f68-4be8-a026-5db38075ee91 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:18.879327 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0b8e247a-3f68-4be8-a026-5db38075ee91 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:18.880032 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0b8e247a-3f68-4be8-a026-5db38075ee91 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:18.880486 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0b8e247a-3f68-4be8-a026-5db38075ee91 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:18.880917 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0b8e247a-3f68-4be8-a026-5db38075ee91 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:19.011091 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0b8e247a-3f68-4be8-a026-5db38075ee91 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/aac0e70b-f9ec-4242-bac2-8e8dc29bb460" status: 200 len: 1650 microversion: 2.1 time: 0.144018 Oct 17 14:14:19.011695 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2911/5692] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:18 2022] GET /compute/v2.1/servers/aac0e70b-f9ec-4242-bac2-8e8dc29bb460 => generated 1650 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:14:19.077531 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-61ea51a6-40fa-4c52-bde5-a85ccb5fd7ed tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-520058037", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "availability_zone": "nova:n-h2-854247-14", "networks": [{"uuid": "d06f3f75-ca93-40cb-9c82-67504b24d13c"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:14:19.143600 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-61ea51a6-40fa-4c52-bde5-a85ccb5fd7ed tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] validate_networks() for [('d06f3f75-ca93-40cb-9c82-67504b24d13c', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:14:19.895981 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-61ea51a6-40fa-4c52-bde5-a85ccb5fd7ed tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:14:19.896545 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-61ea51a6-40fa-4c52-bde5-a85ccb5fd7ed tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:14:19.896889 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-61ea51a6-40fa-4c52-bde5-a85ccb5fd7ed tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:14:19.897276 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-61ea51a6-40fa-4c52-bde5-a85ccb5fd7ed tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:14:19.897701 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-61ea51a6-40fa-4c52-bde5-a85ccb5fd7ed tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:14:19.913396 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-61ea51a6-40fa-4c52-bde5-a85ccb5fd7ed tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:19.914095 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-61ea51a6-40fa-4c52-bde5-a85ccb5fd7ed tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:19.914862 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-61ea51a6-40fa-4c52-bde5-a85ccb5fd7ed tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:19.915613 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-61ea51a6-40fa-4c52-bde5-a85ccb5fd7ed tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:19.916233 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-61ea51a6-40fa-4c52-bde5-a85ccb5fd7ed tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:19.916964 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-61ea51a6-40fa-4c52-bde5-a85ccb5fd7ed tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:19.937375 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-61ea51a6-40fa-4c52-bde5-a85ccb5fd7ed tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Getting quotas for project 6f4dded84add4006924e5c44bf2a0aaf. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:14:19.946883 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-61ea51a6-40fa-4c52-bde5-a85ccb5fd7ed tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Getting quotas for user 48694cd9908e41f88b904c251fa4cf37 and project 6f4dded84add4006924e5c44bf2a0aaf. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:14:19.978141 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-61ea51a6-40fa-4c52-bde5-a85ccb5fd7ed tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:14:19.982043 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-61ea51a6-40fa-4c52-bde5-a85ccb5fd7ed tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] [instance: cf9d3e3e-bc41-4c45-a191-62c655d914c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:14:20.040233 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-61ea51a6-40fa-4c52-bde5-a85ccb5fd7ed tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.966197 Oct 17 14:14:20.044090 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2782/5693] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 14:14:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 971 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:14:20.057033 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6d978761-3ab4-4ce9-b112-1c9c370bd727 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:20.060725 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6d978761-3ab4-4ce9-b112-1c9c370bd727 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] [instance: cf9d3e3e-bc41-4c45-a191-62c655d914c9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:20.145916 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6d978761-3ab4-4ce9-b112-1c9c370bd727 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/cf9d3e3e-bc41-4c45-a191-62c655d914c9" status: 200 len: 1328 microversion: 2.1 time: 0.093804 Oct 17 14:14:20.147088 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2912/5694] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:20 2022] GET /compute/v2.1/servers/cf9d3e3e-bc41-4c45-a191-62c655d914c9 => generated 1328 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:14:21.187257 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bbfc5b64-981e-416e-b316-44d9519f8c96 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:21.188838 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-bbfc5b64-981e-416e-b316-44d9519f8c96 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] [instance: cf9d3e3e-bc41-4c45-a191-62c655d914c9] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:21.202368 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bbfc5b64-981e-416e-b316-44d9519f8c96 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:21.203434 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bbfc5b64-981e-416e-b316-44d9519f8c96 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:21.205870 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bbfc5b64-981e-416e-b316-44d9519f8c96 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:21.206885 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bbfc5b64-981e-416e-b316-44d9519f8c96 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:21.209280 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bbfc5b64-981e-416e-b316-44d9519f8c96 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:21.209838 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bbfc5b64-981e-416e-b316-44d9519f8c96 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:21.333881 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-bbfc5b64-981e-416e-b316-44d9519f8c96 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/cf9d3e3e-bc41-4c45-a191-62c655d914c9" status: 200 len: 1417 microversion: 2.1 time: 0.150639 Oct 17 14:14:21.335047 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2783/5695] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:21 2022] GET /compute/v2.1/servers/cf9d3e3e-bc41-4c45-a191-62c655d914c9 => generated 1417 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:14:22.355514 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-26348f03-1f5f-41da-8f05-01bb92b8d212 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Action: 'create', calling method: .version_select at 0x7f7cd405af70>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1219970259", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHE5WA54505MdvPtlHVNqJcvWXg7oFkOJpZgJZmnT4kzUm90PKvrL8HHADi83ermU/XWQvIhdg5fvS2qxQ5B02NT+wgaJfSTqkgr72MbJUOssHY7fryUeeKCX7GCnnu7dg=="}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:14:22.357844 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f01e2f0a-d325-42f1-97a8-44188ebd19db tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:22.358484 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f01e2f0a-d325-42f1-97a8-44188ebd19db tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] [instance: cf9d3e3e-bc41-4c45-a191-62c655d914c9] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:22.374275 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f01e2f0a-d325-42f1-97a8-44188ebd19db tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:22.375089 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f01e2f0a-d325-42f1-97a8-44188ebd19db tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:22.375802 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f01e2f0a-d325-42f1-97a8-44188ebd19db tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:22.376683 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f01e2f0a-d325-42f1-97a8-44188ebd19db tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:22.377311 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f01e2f0a-d325-42f1-97a8-44188ebd19db tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:22.377892 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f01e2f0a-d325-42f1-97a8-44188ebd19db tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:22.430747 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-26348f03-1f5f-41da-8f05-01bb92b8d212 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Getting quotas for project 1b981af0923d41809255f04ce299062f. Resources: {'key_pairs'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:14:22.459616 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-26348f03-1f5f-41da-8f05-01bb92b8d212 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Getting quotas for user 7fec3f9e6cb241549395b6375b43b22f and project 1b981af0923d41809255f04ce299062f. Resources: {'key_pairs'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:14:22.614623 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-26348f03-1f5f-41da-8f05-01bb92b8d212 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.270037 Oct 17 14:14:22.615582 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2913/5696] 10.222.0.79 () {60 vars in 1159 bytes} [Mon Oct 17 14:14:22 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:14:22.930469 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f01e2f0a-d325-42f1-97a8-44188ebd19db tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/cf9d3e3e-bc41-4c45-a191-62c655d914c9" status: 200 len: 1465 microversion: 2.1 time: 0.575964 Oct 17 14:14:22.933993 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2784/5697] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:22 2022] GET /compute/v2.1/servers/cf9d3e3e-bc41-4c45-a191-62c655d914c9 => generated 1465 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:14:23.964916 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-be28f9d7-0cc8-47b4-bc23-a54911ac9e00 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:23.966149 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-be28f9d7-0cc8-47b4-bc23-a54911ac9e00 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] [instance: cf9d3e3e-bc41-4c45-a191-62c655d914c9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:23.974356 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be28f9d7-0cc8-47b4-bc23-a54911ac9e00 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:23.975784 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be28f9d7-0cc8-47b4-bc23-a54911ac9e00 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:23.976521 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be28f9d7-0cc8-47b4-bc23-a54911ac9e00 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:23.977479 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be28f9d7-0cc8-47b4-bc23-a54911ac9e00 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:23.978071 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be28f9d7-0cc8-47b4-bc23-a54911ac9e00 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:23.978637 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be28f9d7-0cc8-47b4-bc23-a54911ac9e00 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:24.288085 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-4b306c80-d763-4bf7-8fb3-b058cd68521a req-9de0af99-8eb3-49b4-b043-6c565ee5d57c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf9d3e3e-bc41-4c45-a191-62c655d914c9", "tag": "af50a37f-96c2-4ae8-a80a-20462ddf2843"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:14:24.311804 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-4b306c80-d763-4bf7-8fb3-b058cd68521a req-9de0af99-8eb3-49b4-b043-6c565ee5d57c service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:24.312203 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-4b306c80-d763-4bf7-8fb3-b058cd68521a req-9de0af99-8eb3-49b4-b043-6c565ee5d57c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:24.312631 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-4b306c80-d763-4bf7-8fb3-b058cd68521a req-9de0af99-8eb3-49b4-b043-6c565ee5d57c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:24.340183 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-4b306c80-d763-4bf7-8fb3-b058cd68521a req-9de0af99-8eb3-49b4-b043-6c565ee5d57c service nova] Creating event network-changed:af50a37f-96c2-4ae8-a80a-20462ddf2843 for instance cf9d3e3e-bc41-4c45-a191-62c655d914c9 on n-h2-854247-14 Oct 17 14:14:24.354568 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-4b306c80-d763-4bf7-8fb3-b058cd68521a req-9de0af99-8eb3-49b4-b043-6c565ee5d57c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068114 Oct 17 14:14:24.355998 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2785/5698] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:14:24.558880 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-be28f9d7-0cc8-47b4-bc23-a54911ac9e00 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/cf9d3e3e-bc41-4c45-a191-62c655d914c9" status: 200 len: 1465 microversion: 2.1 time: 0.597994 Oct 17 14:14:24.560096 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2914/5699] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:23 2022] GET /compute/v2.1/servers/cf9d3e3e-bc41-4c45-a191-62c655d914c9 => generated 1465 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:14:25.078627 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d9e1087e-9d0c-465b-80a6-c375acbe9737 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1316607041", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "b4fc5fa9-e7da-4370-a46d-07ef721378f0"}], "key_name": "tempest-TestNetworkBasicOps-1219970259", "security_groups": [{"name": "tempest-secgroup-smoke-1049769993"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:14:25.269554 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-d9e1087e-9d0c-465b-80a6-c375acbe9737 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] validate_networks() for [('b4fc5fa9-e7da-4370-a46d-07ef721378f0', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:14:25.588133 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-31023211-35d4-4573-9bfb-97bece33978a tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:25.588767 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-31023211-35d4-4573-9bfb-97bece33978a tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] [instance: cf9d3e3e-bc41-4c45-a191-62c655d914c9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:25.605587 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-31023211-35d4-4573-9bfb-97bece33978a tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:25.606542 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-31023211-35d4-4573-9bfb-97bece33978a tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:25.607425 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-31023211-35d4-4573-9bfb-97bece33978a tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:25.608319 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-31023211-35d4-4573-9bfb-97bece33978a tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:25.609052 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-31023211-35d4-4573-9bfb-97bece33978a tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:25.609679 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-31023211-35d4-4573-9bfb-97bece33978a tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:25.938361 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-31023211-35d4-4573-9bfb-97bece33978a tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/cf9d3e3e-bc41-4c45-a191-62c655d914c9" status: 200 len: 1465 microversion: 2.1 time: 0.354768 Oct 17 14:14:25.939932 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2915/5700] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:25 2022] GET /compute/v2.1/servers/cf9d3e3e-bc41-4c45-a191-62c655d914c9 => generated 1465 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:14:25.982723 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-d9e1087e-9d0c-465b-80a6-c375acbe9737 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:14:25.983842 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-d9e1087e-9d0c-465b-80a6-c375acbe9737 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:14:25.984468 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-d9e1087e-9d0c-465b-80a6-c375acbe9737 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:14:25.985061 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-d9e1087e-9d0c-465b-80a6-c375acbe9737 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:14:25.985627 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-d9e1087e-9d0c-465b-80a6-c375acbe9737 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:14:26.009730 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d9e1087e-9d0c-465b-80a6-c375acbe9737 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:26.010215 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d9e1087e-9d0c-465b-80a6-c375acbe9737 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:26.010643 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d9e1087e-9d0c-465b-80a6-c375acbe9737 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:26.012731 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d9e1087e-9d0c-465b-80a6-c375acbe9737 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:26.015831 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d9e1087e-9d0c-465b-80a6-c375acbe9737 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:26.018532 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d9e1087e-9d0c-465b-80a6-c375acbe9737 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:26.093981 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-d9e1087e-9d0c-465b-80a6-c375acbe9737 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Getting quotas for project 1b981af0923d41809255f04ce299062f. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:14:26.110491 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-d9e1087e-9d0c-465b-80a6-c375acbe9737 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Getting quotas for user 7fec3f9e6cb241549395b6375b43b22f and project 1b981af0923d41809255f04ce299062f. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:14:26.143401 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d9e1087e-9d0c-465b-80a6-c375acbe9737 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:14:26.146955 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d9e1087e-9d0c-465b-80a6-c375acbe9737 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] [instance: 5cf1340c-725a-48da-8be6-72dda0cae178] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:14:26.281548 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d9e1087e-9d0c-465b-80a6-c375acbe9737 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.207361 Oct 17 14:14:26.288822 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2786/5701] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 14:14:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 1215 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:14:26.294002 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d0875fed-0ca6-4b99-9787-51dac6ec176b tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:26.294896 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d0875fed-0ca6-4b99-9787-51dac6ec176b tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] [instance: 5cf1340c-725a-48da-8be6-72dda0cae178] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:26.418908 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d0875fed-0ca6-4b99-9787-51dac6ec176b tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec3f9e6cb241549395b6375b43b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b981af0923d41809255f04ce299062f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:14:26.429171 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d0875fed-0ca6-4b99-9787-51dac6ec176b tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] 10.222.0.79 "GET /compute/v2.1/servers/5cf1340c-725a-48da-8be6-72dda0cae178" status: 200 len: 1249 microversion: 2.1 time: 0.138357 Oct 17 14:14:26.431207 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2916/5702] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:26 2022] GET /compute/v2.1/servers/5cf1340c-725a-48da-8be6-72dda0cae178 => generated 1249 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:14:26.974308 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5bf02f72-4815-42f7-99d3-5cb7f123a908 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:26.974941 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5bf02f72-4815-42f7-99d3-5cb7f123a908 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] [instance: cf9d3e3e-bc41-4c45-a191-62c655d914c9] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:26.984204 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5bf02f72-4815-42f7-99d3-5cb7f123a908 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:26.984940 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5bf02f72-4815-42f7-99d3-5cb7f123a908 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:26.985300 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5bf02f72-4815-42f7-99d3-5cb7f123a908 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:26.986428 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5bf02f72-4815-42f7-99d3-5cb7f123a908 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:26.986888 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5bf02f72-4815-42f7-99d3-5cb7f123a908 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:26.987368 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5bf02f72-4815-42f7-99d3-5cb7f123a908 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:27.225560 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5bf02f72-4815-42f7-99d3-5cb7f123a908 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/cf9d3e3e-bc41-4c45-a191-62c655d914c9" status: 200 len: 1465 microversion: 2.1 time: 0.257315 Oct 17 14:14:27.227070 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2787/5703] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:26 2022] GET /compute/v2.1/servers/cf9d3e3e-bc41-4c45-a191-62c655d914c9 => generated 1465 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:14:27.458434 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-bbb43194-5f6a-405d-9cc9-22ca17594af0 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:27.459178 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-bbb43194-5f6a-405d-9cc9-22ca17594af0 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] [instance: 5cf1340c-725a-48da-8be6-72dda0cae178] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:27.480194 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bbb43194-5f6a-405d-9cc9-22ca17594af0 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:27.480781 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bbb43194-5f6a-405d-9cc9-22ca17594af0 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:27.481484 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bbb43194-5f6a-405d-9cc9-22ca17594af0 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:27.482274 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bbb43194-5f6a-405d-9cc9-22ca17594af0 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:27.482806 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bbb43194-5f6a-405d-9cc9-22ca17594af0 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:27.483335 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bbb43194-5f6a-405d-9cc9-22ca17594af0 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:27.674701 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-bbb43194-5f6a-405d-9cc9-22ca17594af0 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec3f9e6cb241549395b6375b43b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b981af0923d41809255f04ce299062f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:14:27.683696 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-bbb43194-5f6a-405d-9cc9-22ca17594af0 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] 10.222.0.79 "GET /compute/v2.1/servers/5cf1340c-725a-48da-8be6-72dda0cae178" status: 200 len: 1301 microversion: 2.1 time: 0.230271 Oct 17 14:14:27.692478 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2917/5704] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:27 2022] GET /compute/v2.1/servers/5cf1340c-725a-48da-8be6-72dda0cae178 => generated 1301 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:14:28.250683 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f2458a60-7688-4161-9c05-9d271953662a tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:28.251389 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f2458a60-7688-4161-9c05-9d271953662a tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] [instance: cf9d3e3e-bc41-4c45-a191-62c655d914c9] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:28.258166 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f2458a60-7688-4161-9c05-9d271953662a tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:28.258912 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f2458a60-7688-4161-9c05-9d271953662a tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:28.259384 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f2458a60-7688-4161-9c05-9d271953662a tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:28.260934 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f2458a60-7688-4161-9c05-9d271953662a tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:28.260934 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f2458a60-7688-4161-9c05-9d271953662a tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:28.260934 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f2458a60-7688-4161-9c05-9d271953662a tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:28.478247 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f2458a60-7688-4161-9c05-9d271953662a tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/cf9d3e3e-bc41-4c45-a191-62c655d914c9" status: 200 len: 1465 microversion: 2.1 time: 0.231291 Oct 17 14:14:28.493208 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2788/5705] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:28 2022] GET /compute/v2.1/servers/cf9d3e3e-bc41-4c45-a191-62c655d914c9 => generated 1465 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:14:28.717410 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-178fb1f1-6a97-43c3-9eb1-4a1d0d859410 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:28.718669 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-178fb1f1-6a97-43c3-9eb1-4a1d0d859410 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] [instance: 5cf1340c-725a-48da-8be6-72dda0cae178] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:28.728904 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-178fb1f1-6a97-43c3-9eb1-4a1d0d859410 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:28.733619 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-178fb1f1-6a97-43c3-9eb1-4a1d0d859410 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:28.735804 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-178fb1f1-6a97-43c3-9eb1-4a1d0d859410 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:28.741359 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-178fb1f1-6a97-43c3-9eb1-4a1d0d859410 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:28.742289 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-178fb1f1-6a97-43c3-9eb1-4a1d0d859410 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:28.742912 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-178fb1f1-6a97-43c3-9eb1-4a1d0d859410 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:29.043064 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-178fb1f1-6a97-43c3-9eb1-4a1d0d859410 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec3f9e6cb241549395b6375b43b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b981af0923d41809255f04ce299062f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:14:29.056095 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-178fb1f1-6a97-43c3-9eb1-4a1d0d859410 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] 10.222.0.79 "GET /compute/v2.1/servers/5cf1340c-725a-48da-8be6-72dda0cae178" status: 200 len: 1375 microversion: 2.1 time: 0.339936 Oct 17 14:14:29.067547 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2918/5706] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:28 2022] GET /compute/v2.1/servers/5cf1340c-725a-48da-8be6-72dda0cae178 => generated 1375 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:14:29.220489 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-01bd2562-9525-42ae-89f4-4fb4975f65fa req-7eefdf4e-5519-4b41-97bb-f0f3d347a6c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf9d3e3e-bc41-4c45-a191-62c655d914c9", "name": "network-vif-plugged", "status": "completed", "tag": "af50a37f-96c2-4ae8-a80a-20462ddf2843"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:14:29.246225 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-01bd2562-9525-42ae-89f4-4fb4975f65fa req-7eefdf4e-5519-4b41-97bb-f0f3d347a6c1 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:29.247107 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-01bd2562-9525-42ae-89f4-4fb4975f65fa req-7eefdf4e-5519-4b41-97bb-f0f3d347a6c1 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:29.247834 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-01bd2562-9525-42ae-89f4-4fb4975f65fa req-7eefdf4e-5519-4b41-97bb-f0f3d347a6c1 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:29.274656 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-01bd2562-9525-42ae-89f4-4fb4975f65fa req-7eefdf4e-5519-4b41-97bb-f0f3d347a6c1 service nova] Creating event network-vif-plugged:af50a37f-96c2-4ae8-a80a-20462ddf2843 for instance cf9d3e3e-bc41-4c45-a191-62c655d914c9 on n-h2-854247-14 Oct 17 14:14:29.287959 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-01bd2562-9525-42ae-89f4-4fb4975f65fa req-7eefdf4e-5519-4b41-97bb-f0f3d347a6c1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071687 Oct 17 14:14:29.291267 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2789/5707] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:14:29.505676 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f05ef6c1-0f54-4162-871d-cfa38fa7a1f6 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:29.506675 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f05ef6c1-0f54-4162-871d-cfa38fa7a1f6 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] [instance: cf9d3e3e-bc41-4c45-a191-62c655d914c9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:29.515031 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f05ef6c1-0f54-4162-871d-cfa38fa7a1f6 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:29.515778 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f05ef6c1-0f54-4162-871d-cfa38fa7a1f6 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:29.516737 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f05ef6c1-0f54-4162-871d-cfa38fa7a1f6 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:29.518280 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f05ef6c1-0f54-4162-871d-cfa38fa7a1f6 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:29.518971 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f05ef6c1-0f54-4162-871d-cfa38fa7a1f6 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:29.519639 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f05ef6c1-0f54-4162-871d-cfa38fa7a1f6 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:29.728538 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f05ef6c1-0f54-4162-871d-cfa38fa7a1f6 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/cf9d3e3e-bc41-4c45-a191-62c655d914c9" status: 200 len: 1465 microversion: 2.1 time: 0.227892 Oct 17 14:14:29.730234 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2919/5708] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:29 2022] GET /compute/v2.1/servers/cf9d3e3e-bc41-4c45-a191-62c655d914c9 => generated 1465 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:14:29.768658 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-cb4bb817-3da8-434f-82e9-2c4f1c029cc6 req-2bab0237-5e00-4c56-b108-cac01c06d442 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cf1340c-725a-48da-8be6-72dda0cae178", "tag": "382d97ed-55b7-40be-bd39-4f9aaf5e5600"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:14:29.789410 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-cb4bb817-3da8-434f-82e9-2c4f1c029cc6 req-2bab0237-5e00-4c56-b108-cac01c06d442 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:29.790510 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-cb4bb817-3da8-434f-82e9-2c4f1c029cc6 req-2bab0237-5e00-4c56-b108-cac01c06d442 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:29.791288 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-cb4bb817-3da8-434f-82e9-2c4f1c029cc6 req-2bab0237-5e00-4c56-b108-cac01c06d442 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:29.810308 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-cb4bb817-3da8-434f-82e9-2c4f1c029cc6 req-2bab0237-5e00-4c56-b108-cac01c06d442 service nova] Creating event network-changed:382d97ed-55b7-40be-bd39-4f9aaf5e5600 for instance 5cf1340c-725a-48da-8be6-72dda0cae178 on n-h2-854247-14 Oct 17 14:14:29.818319 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-cb4bb817-3da8-434f-82e9-2c4f1c029cc6 req-2bab0237-5e00-4c56-b108-cac01c06d442 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057334 Oct 17 14:14:29.819662 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2790/5709] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:14:30.083949 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-46d994dd-c851-49d8-9e7f-7be1fd9249c7 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:30.084677 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-46d994dd-c851-49d8-9e7f-7be1fd9249c7 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] [instance: 5cf1340c-725a-48da-8be6-72dda0cae178] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:30.108413 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-46d994dd-c851-49d8-9e7f-7be1fd9249c7 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:30.108923 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-46d994dd-c851-49d8-9e7f-7be1fd9249c7 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:30.109358 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-46d994dd-c851-49d8-9e7f-7be1fd9249c7 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:30.110446 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-46d994dd-c851-49d8-9e7f-7be1fd9249c7 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:30.111069 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-46d994dd-c851-49d8-9e7f-7be1fd9249c7 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:30.111604 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-46d994dd-c851-49d8-9e7f-7be1fd9249c7 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:30.352017 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-46d994dd-c851-49d8-9e7f-7be1fd9249c7 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec3f9e6cb241549395b6375b43b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b981af0923d41809255f04ce299062f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:14:30.362383 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-46d994dd-c851-49d8-9e7f-7be1fd9249c7 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] 10.222.0.79 "GET /compute/v2.1/servers/5cf1340c-725a-48da-8be6-72dda0cae178" status: 200 len: 1375 microversion: 2.1 time: 0.282667 Oct 17 14:14:30.363032 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2920/5710] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:30 2022] GET /compute/v2.1/servers/5cf1340c-725a-48da-8be6-72dda0cae178 => generated 1375 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:14:30.754221 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9d78e6f6-0df3-4ee3-b001-ed6f7f8ed29d tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:30.755079 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9d78e6f6-0df3-4ee3-b001-ed6f7f8ed29d tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] [instance: cf9d3e3e-bc41-4c45-a191-62c655d914c9] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:30.763898 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9d78e6f6-0df3-4ee3-b001-ed6f7f8ed29d tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:30.764899 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9d78e6f6-0df3-4ee3-b001-ed6f7f8ed29d tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:30.765541 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9d78e6f6-0df3-4ee3-b001-ed6f7f8ed29d tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:30.766757 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9d78e6f6-0df3-4ee3-b001-ed6f7f8ed29d tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:30.767556 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9d78e6f6-0df3-4ee3-b001-ed6f7f8ed29d tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:30.768355 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9d78e6f6-0df3-4ee3-b001-ed6f7f8ed29d tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:30.905907 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9d78e6f6-0df3-4ee3-b001-ed6f7f8ed29d tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/cf9d3e3e-bc41-4c45-a191-62c655d914c9" status: 200 len: 1650 microversion: 2.1 time: 0.157018 Oct 17 14:14:30.906388 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2791/5711] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:30 2022] GET /compute/v2.1/servers/cf9d3e3e-bc41-4c45-a191-62c655d914c9 => generated 1650 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:14:30.928899 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ecb4647e-454e-4765-8fb1-e8de8fc6cd3c tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:30.929489 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ecb4647e-454e-4765-8fb1-e8de8fc6cd3c tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] [instance: cf9d3e3e-bc41-4c45-a191-62c655d914c9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:30.936234 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ecb4647e-454e-4765-8fb1-e8de8fc6cd3c tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:30.936718 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ecb4647e-454e-4765-8fb1-e8de8fc6cd3c tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:30.937153 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ecb4647e-454e-4765-8fb1-e8de8fc6cd3c tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:30.937841 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ecb4647e-454e-4765-8fb1-e8de8fc6cd3c tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:30.938441 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ecb4647e-454e-4765-8fb1-e8de8fc6cd3c tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:30.939105 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ecb4647e-454e-4765-8fb1-e8de8fc6cd3c tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:31.066292 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ecb4647e-454e-4765-8fb1-e8de8fc6cd3c tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/cf9d3e3e-bc41-4c45-a191-62c655d914c9" status: 200 len: 1650 microversion: 2.1 time: 0.141227 Oct 17 14:14:31.066887 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2921/5712] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:30 2022] GET /compute/v2.1/servers/cf9d3e3e-bc41-4c45-a191-62c655d914c9 => generated 1650 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:14:31.088995 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d03d9512-a66e-47d9-8baf-3b9917186c25 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:31.089749 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d03d9512-a66e-47d9-8baf-3b9917186c25 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] [instance: cf9d3e3e-bc41-4c45-a191-62c655d914c9] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:31.096917 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d03d9512-a66e-47d9-8baf-3b9917186c25 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:31.097490 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d03d9512-a66e-47d9-8baf-3b9917186c25 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:31.098003 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d03d9512-a66e-47d9-8baf-3b9917186c25 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:31.099185 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d03d9512-a66e-47d9-8baf-3b9917186c25 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:31.099795 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d03d9512-a66e-47d9-8baf-3b9917186c25 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:31.100324 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d03d9512-a66e-47d9-8baf-3b9917186c25 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:31.231419 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d03d9512-a66e-47d9-8baf-3b9917186c25 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/cf9d3e3e-bc41-4c45-a191-62c655d914c9" status: 200 len: 1650 microversion: 2.1 time: 0.146731 Oct 17 14:14:31.231999 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2792/5713] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:31 2022] GET /compute/v2.1/servers/cf9d3e3e-bc41-4c45-a191-62c655d914c9 => generated 1650 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:14:31.254470 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-bca476e9-fd82-46dc-b5ab-6eba87e90dc1 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:31.255090 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-bca476e9-fd82-46dc-b5ab-6eba87e90dc1 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] [instance: cf9d3e3e-bc41-4c45-a191-62c655d914c9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:31.262943 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bca476e9-fd82-46dc-b5ab-6eba87e90dc1 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:31.263552 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bca476e9-fd82-46dc-b5ab-6eba87e90dc1 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:31.264057 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bca476e9-fd82-46dc-b5ab-6eba87e90dc1 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:31.264889 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bca476e9-fd82-46dc-b5ab-6eba87e90dc1 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:31.265406 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bca476e9-fd82-46dc-b5ab-6eba87e90dc1 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:31.265998 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bca476e9-fd82-46dc-b5ab-6eba87e90dc1 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:31.294151 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-bca476e9-fd82-46dc-b5ab-6eba87e90dc1 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] [instance: cf9d3e3e-bc41-4c45-a191-62c655d914c9] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:14:31.384062 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-bca476e9-fd82-46dc-b5ab-6eba87e90dc1 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] 10.222.0.79 "DELETE /compute/v2.1/servers/cf9d3e3e-bc41-4c45-a191-62c655d914c9" status: 204 len: 0 microversion: 2.1 time: 0.133407 Oct 17 14:14:31.395296 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2922/5714] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:14:31 2022] DELETE /compute/v2.1/servers/cf9d3e3e-bc41-4c45-a191-62c655d914c9 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:14:31.400289 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-286a8246-9329-41b9-98a8-b1aa704f825b tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:31.403412 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-286a8246-9329-41b9-98a8-b1aa704f825b tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] [instance: 5cf1340c-725a-48da-8be6-72dda0cae178] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:31.423416 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-286a8246-9329-41b9-98a8-b1aa704f825b tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:31.424301 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-286a8246-9329-41b9-98a8-b1aa704f825b tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:31.425245 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-286a8246-9329-41b9-98a8-b1aa704f825b tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:31.426910 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-286a8246-9329-41b9-98a8-b1aa704f825b tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:31.427743 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-286a8246-9329-41b9-98a8-b1aa704f825b tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:31.428223 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5c2d5039-0b69-4b85-be4d-6ecd3835542c tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:31.428671 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-286a8246-9329-41b9-98a8-b1aa704f825b tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:31.428965 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5c2d5039-0b69-4b85-be4d-6ecd3835542c tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] [instance: cf9d3e3e-bc41-4c45-a191-62c655d914c9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:31.444662 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5c2d5039-0b69-4b85-be4d-6ecd3835542c tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:31.445172 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5c2d5039-0b69-4b85-be4d-6ecd3835542c tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:31.448357 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5c2d5039-0b69-4b85-be4d-6ecd3835542c tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:31.449243 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5c2d5039-0b69-4b85-be4d-6ecd3835542c tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:31.449719 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5c2d5039-0b69-4b85-be4d-6ecd3835542c tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:31.450146 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5c2d5039-0b69-4b85-be4d-6ecd3835542c tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:31.668848 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-286a8246-9329-41b9-98a8-b1aa704f825b tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec3f9e6cb241549395b6375b43b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b981af0923d41809255f04ce299062f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:14:31.677769 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-286a8246-9329-41b9-98a8-b1aa704f825b tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] 10.222.0.79 "GET /compute/v2.1/servers/5cf1340c-725a-48da-8be6-72dda0cae178" status: 200 len: 1375 microversion: 2.1 time: 0.292569 Oct 17 14:14:31.691811 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:14:31.692044 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2793/5715] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:31 2022] GET /compute/v2.1/servers/5cf1340c-725a-48da-8be6-72dda0cae178 => generated 1375 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:14:31.694895 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5c2d5039-0b69-4b85-be4d-6ecd3835542c tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/cf9d3e3e-bc41-4c45-a191-62c655d914c9" status: 200 len: 1656 microversion: 2.1 time: 0.294787 Oct 17 14:14:31.695697 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2923/5716] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:31 2022] GET /compute/v2.1/servers/cf9d3e3e-bc41-4c45-a191-62c655d914c9 => generated 1656 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:14:32.702869 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b8e4639c-4e40-4389-a8b7-f0dc8df41c11 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:32.703518 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b8e4639c-4e40-4389-a8b7-f0dc8df41c11 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] [instance: 5cf1340c-725a-48da-8be6-72dda0cae178] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:32.710653 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b8e4639c-4e40-4389-a8b7-f0dc8df41c11 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:32.711140 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b8e4639c-4e40-4389-a8b7-f0dc8df41c11 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:32.711601 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b8e4639c-4e40-4389-a8b7-f0dc8df41c11 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:32.712309 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b8e4639c-4e40-4389-a8b7-f0dc8df41c11 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:32.712764 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b8e4639c-4e40-4389-a8b7-f0dc8df41c11 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:32.713186 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b8e4639c-4e40-4389-a8b7-f0dc8df41c11 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:32.723244 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e73c70f9-2e40-42c5-a0d8-720603c1fb15 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:32.724187 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e73c70f9-2e40-42c5-a0d8-720603c1fb15 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] [instance: cf9d3e3e-bc41-4c45-a191-62c655d914c9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:32.754985 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e73c70f9-2e40-42c5-a0d8-720603c1fb15 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:32.755770 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e73c70f9-2e40-42c5-a0d8-720603c1fb15 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:32.756360 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e73c70f9-2e40-42c5-a0d8-720603c1fb15 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:32.757159 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e73c70f9-2e40-42c5-a0d8-720603c1fb15 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:32.758473 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e73c70f9-2e40-42c5-a0d8-720603c1fb15 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:32.758998 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e73c70f9-2e40-42c5-a0d8-720603c1fb15 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:33.099895 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e73c70f9-2e40-42c5-a0d8-720603c1fb15 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/cf9d3e3e-bc41-4c45-a191-62c655d914c9" status: 200 len: 1656 microversion: 2.1 time: 0.384308 Oct 17 14:14:33.104183 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2924/5717] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:32 2022] GET /compute/v2.1/servers/cf9d3e3e-bc41-4c45-a191-62c655d914c9 => generated 1656 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:14:33.186769 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b8e4639c-4e40-4389-a8b7-f0dc8df41c11 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec3f9e6cb241549395b6375b43b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b981af0923d41809255f04ce299062f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:14:33.193123 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=100 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:14:33.199740 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b8e4639c-4e40-4389-a8b7-f0dc8df41c11 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] 10.222.0.79 "GET /compute/v2.1/servers/5cf1340c-725a-48da-8be6-72dda0cae178" status: 200 len: 1375 microversion: 2.1 time: 0.501314 Oct 17 14:14:33.200671 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2794/5718] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:32 2022] GET /compute/v2.1/servers/5cf1340c-725a-48da-8be6-72dda0cae178 => generated 1375 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:14:34.070370 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-1c7caff6-4a1c-4136-a949-12d84d831878 req-ed940d7a-4ad5-49d7-8350-4f7350532c9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf9d3e3e-bc41-4c45-a191-62c655d914c9", "name": "network-vif-deleted", "tag": "af50a37f-96c2-4ae8-a80a-20462ddf2843"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:14:34.108687 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-1c7caff6-4a1c-4136-a949-12d84d831878 req-ed940d7a-4ad5-49d7-8350-4f7350532c9f service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:34.109261 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-1c7caff6-4a1c-4136-a949-12d84d831878 req-ed940d7a-4ad5-49d7-8350-4f7350532c9f service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:34.109707 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-1c7caff6-4a1c-4136-a949-12d84d831878 req-ed940d7a-4ad5-49d7-8350-4f7350532c9f service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:34.130504 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e20a7a9b-bd8e-43ee-8eff-be06e098ec4e tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:34.133965 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e20a7a9b-bd8e-43ee-8eff-be06e098ec4e tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] [instance: cf9d3e3e-bc41-4c45-a191-62c655d914c9] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:34.145210 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-1c7caff6-4a1c-4136-a949-12d84d831878 req-ed940d7a-4ad5-49d7-8350-4f7350532c9f service nova] Creating event network-vif-deleted:af50a37f-96c2-4ae8-a80a-20462ddf2843 for instance cf9d3e3e-bc41-4c45-a191-62c655d914c9 on n-h2-854247-14 Oct 17 14:14:34.152654 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e20a7a9b-bd8e-43ee-8eff-be06e098ec4e tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:34.156075 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-1c7caff6-4a1c-4136-a949-12d84d831878 req-ed940d7a-4ad5-49d7-8350-4f7350532c9f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089565 Oct 17 14:14:34.163549 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2925/5719] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:14:34.165913 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e20a7a9b-bd8e-43ee-8eff-be06e098ec4e tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:34.166709 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e20a7a9b-bd8e-43ee-8eff-be06e098ec4e tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:34.167705 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e20a7a9b-bd8e-43ee-8eff-be06e098ec4e tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:34.168365 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e20a7a9b-bd8e-43ee-8eff-be06e098ec4e tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:34.168974 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e20a7a9b-bd8e-43ee-8eff-be06e098ec4e tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:34.226338 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-dfc8575f-e545-41c0-ba71-d653cc71fb42 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:34.227059 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-dfc8575f-e545-41c0-ba71-d653cc71fb42 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] [instance: 5cf1340c-725a-48da-8be6-72dda0cae178] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:34.237346 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dfc8575f-e545-41c0-ba71-d653cc71fb42 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:34.238203 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dfc8575f-e545-41c0-ba71-d653cc71fb42 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:34.238916 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dfc8575f-e545-41c0-ba71-d653cc71fb42 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:34.239960 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dfc8575f-e545-41c0-ba71-d653cc71fb42 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:34.240635 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dfc8575f-e545-41c0-ba71-d653cc71fb42 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:34.241274 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dfc8575f-e545-41c0-ba71-d653cc71fb42 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:34.306896 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e20a7a9b-bd8e-43ee-8eff-be06e098ec4e tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/cf9d3e3e-bc41-4c45-a191-62c655d914c9" status: 200 len: 1450 microversion: 2.1 time: 0.178286 Oct 17 14:14:34.331521 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2795/5720] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:34 2022] GET /compute/v2.1/servers/cf9d3e3e-bc41-4c45-a191-62c655d914c9 => generated 1450 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:14:34.461764 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-dfc8575f-e545-41c0-ba71-d653cc71fb42 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec3f9e6cb241549395b6375b43b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b981af0923d41809255f04ce299062f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:14:34.470544 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-dfc8575f-e545-41c0-ba71-d653cc71fb42 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] 10.222.0.79 "GET /compute/v2.1/servers/5cf1340c-725a-48da-8be6-72dda0cae178" status: 200 len: 1375 microversion: 2.1 time: 0.249575 Oct 17 14:14:34.471327 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2926/5721] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:34 2022] GET /compute/v2.1/servers/5cf1340c-725a-48da-8be6-72dda0cae178 => generated 1375 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:14:35.136461 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-80e459ff-48e6-44d0-8e4e-ee9faf961fc1 req-b7415232-8c21-4ef0-812f-97748f88b945 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cf1340c-725a-48da-8be6-72dda0cae178", "name": "network-vif-plugged", "status": "completed", "tag": "382d97ed-55b7-40be-bd39-4f9aaf5e5600"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:14:35.151286 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-80e459ff-48e6-44d0-8e4e-ee9faf961fc1 req-b7415232-8c21-4ef0-812f-97748f88b945 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:35.153402 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-80e459ff-48e6-44d0-8e4e-ee9faf961fc1 req-b7415232-8c21-4ef0-812f-97748f88b945 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:35.154569 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-80e459ff-48e6-44d0-8e4e-ee9faf961fc1 req-b7415232-8c21-4ef0-812f-97748f88b945 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:35.168735 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-80e459ff-48e6-44d0-8e4e-ee9faf961fc1 req-b7415232-8c21-4ef0-812f-97748f88b945 service nova] Creating event network-vif-plugged:382d97ed-55b7-40be-bd39-4f9aaf5e5600 for instance 5cf1340c-725a-48da-8be6-72dda0cae178 on n-h2-854247-14 Oct 17 14:14:35.182096 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-80e459ff-48e6-44d0-8e4e-ee9faf961fc1 req-b7415232-8c21-4ef0-812f-97748f88b945 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049438 Oct 17 14:14:35.182889 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2796/5722] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:14:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:14:35.338176 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5d84c948-3244-4717-8523-2a8bdfb5f619 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:35.339426 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5d84c948-3244-4717-8523-2a8bdfb5f619 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] [instance: cf9d3e3e-bc41-4c45-a191-62c655d914c9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:35.346287 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5d84c948-3244-4717-8523-2a8bdfb5f619 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:35.346677 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5d84c948-3244-4717-8523-2a8bdfb5f619 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:35.347387 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5d84c948-3244-4717-8523-2a8bdfb5f619 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:35.348073 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5d84c948-3244-4717-8523-2a8bdfb5f619 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:35.348526 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5d84c948-3244-4717-8523-2a8bdfb5f619 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:35.349015 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5d84c948-3244-4717-8523-2a8bdfb5f619 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:35.363204 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-5d84c948-3244-4717-8523-2a8bdfb5f619 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] HTTP exception thrown: Instance cf9d3e3e-bc41-4c45-a191-62c655d914c9 could not be found. Oct 17 14:14:35.364892 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5d84c948-3244-4717-8523-2a8bdfb5f619 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Request method failure captured: Oct 17 14:14:35.364892 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/cf9d3e3e-bc41-4c45-a191-62c655d914c9 HTTP/1.1 Oct 17 14:14:35.364892 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 14:14:35.364892 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 14:14:35.364892 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 14:14:35.364892 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 14:14:35.364892 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 14:14:35.364892 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 14:14:35.364892 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 14:14:35.364892 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 14:14:35.364892 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTWMuKQAhcqbqJKSOUavElpRkikhEWaWd4iXIJJXmgWa0HM1M22BxbkckiJiZg9OB_s1sK7KrGf4t1DqeAmVD_aisB273RfEJ8WiPWIdHhhnSVHP-HmeyyhnDhL28vXjOtyKmDPEakYQ6r_mBvlbVrOFBOdRSA4Eokigw0TyF27t5mhA Oct 17 14:14:35.364892 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 14:14:35.364892 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 14:14:35.364892 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 14:14:35.364892 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 14:14:35.364892 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 14:14:35.364892 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 14:14:35.364892 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 6f4dded84add4006924e5c44bf2a0aaf Oct 17 14:14:35.364892 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-TestServerMultinode-140284231 Oct 17 14:14:35.364892 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member,admin Oct 17 14:14:35.364892 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member,admin Oct 17 14:14:35.364892 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6f4dded84add4006924e5c44bf2a0aaf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6f4dded84add4006924e5c44bf2a0aaf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6f4dded84add4006924e5c44bf2a0aaf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6f4dded84add4006924e5c44bf2a0aaf", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:14:35.364892 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-TestServerMultinode-140284231 Oct 17 14:14:35.364892 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 6f4dded84add4006924e5c44bf2a0aaf Oct 17 14:14:35.364892 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-TestServerMultinode-140284231 Oct 17 14:14:35.364892 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-TestServerMultinode-140284231-project-admin Oct 17 14:14:35.364892 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 14:14:35.364892 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 14:14:35.364892 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 48694cd9908e41f88b904c251fa4cf37 Oct 17 14:14:35.364892 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-TestServerMultinode-140284231-project-admin Oct 17 14:14:35.364892 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 14:14:35.364892 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance cf9d3e3e-bc41-4c45-a191-62c655d914c9 could not be found. Oct 17 14:14:35.364892 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'cf9d3e3e-bc41-4c45-a191-62c655d914c9'} Oct 17 14:14:35.364892 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:14:35.364892 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:14:35.364892 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:14:35.364892 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:14:35.364892 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:14:35.364892 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:14:35.364892 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:14:35.364892 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:14:35.364892 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:14:35.364892 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:14:35.364892 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf9d3e3e-bc41-4c45-a191-62c655d914c9 could not be found. Oct 17 14:14:35.364892 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:14:35.364892 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:14:35.364892 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:14:35.364892 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:14:35.364892 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:14:35.364892 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:14:35.364892 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:14:35.364892 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:14:35.364892 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:14:35.364892 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:14:35.364892 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:14:35.364892 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:14:35.364892 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:14:35.364892 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:14:35.364892 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:14:35.364892 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:14:35.364892 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf9d3e3e-bc41-4c45-a191-62c655d914c9 could not be found. Oct 17 14:14:35.364892 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:14:35.364892 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:14:35.364892 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:14:35.369333 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:14:35.369333 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:14:35.369333 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:14:35.369333 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:14:35.369333 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:14:35.369333 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf9d3e3e-bc41-4c45-a191-62c655d914c9 could not be found. Oct 17 14:14:35.369333 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:14:35.369333 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5d84c948-3244-4717-8523-2a8bdfb5f619 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Returning 404 to user: Instance cf9d3e3e-bc41-4c45-a191-62c655d914c9 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:14:35.369333 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5d84c948-3244-4717-8523-2a8bdfb5f619 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/cf9d3e3e-bc41-4c45-a191-62c655d914c9" status: 404 len: 111 microversion: 2.1 time: 0.031926 Oct 17 14:14:35.369333 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2927/5723] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:35 2022] GET /compute/v2.1/servers/cf9d3e3e-bc41-4c45-a191-62c655d914c9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:14:35.375959 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-efe12daa-bc37-41dc-8fe4-abf027b3a2a6 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:35.376747 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-efe12daa-bc37-41dc-8fe4-abf027b3a2a6 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] [instance: aac0e70b-f9ec-4242-bac2-8e8dc29bb460] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:35.383522 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-efe12daa-bc37-41dc-8fe4-abf027b3a2a6 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:35.384015 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-efe12daa-bc37-41dc-8fe4-abf027b3a2a6 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:35.384449 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-efe12daa-bc37-41dc-8fe4-abf027b3a2a6 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:35.385369 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-efe12daa-bc37-41dc-8fe4-abf027b3a2a6 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:35.385822 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-efe12daa-bc37-41dc-8fe4-abf027b3a2a6 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:35.386240 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-efe12daa-bc37-41dc-8fe4-abf027b3a2a6 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:35.414205 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-efe12daa-bc37-41dc-8fe4-abf027b3a2a6 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] [instance: aac0e70b-f9ec-4242-bac2-8e8dc29bb460] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:14:35.494661 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3c6e9474-067f-44fe-99f6-832af1790a42 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:35.496215 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3c6e9474-067f-44fe-99f6-832af1790a42 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] [instance: 5cf1340c-725a-48da-8be6-72dda0cae178] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:35.504111 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3c6e9474-067f-44fe-99f6-832af1790a42 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:35.504930 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3c6e9474-067f-44fe-99f6-832af1790a42 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:35.505559 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3c6e9474-067f-44fe-99f6-832af1790a42 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:35.506870 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3c6e9474-067f-44fe-99f6-832af1790a42 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:35.518958 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3c6e9474-067f-44fe-99f6-832af1790a42 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:35.519977 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-efe12daa-bc37-41dc-8fe4-abf027b3a2a6 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] 10.222.0.79 "DELETE /compute/v2.1/servers/aac0e70b-f9ec-4242-bac2-8e8dc29bb460" status: 204 len: 0 microversion: 2.1 time: 0.146907 Oct 17 14:14:35.521354 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2797/5724] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:14:35 2022] DELETE /compute/v2.1/servers/aac0e70b-f9ec-4242-bac2-8e8dc29bb460 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:14:35.521661 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3c6e9474-067f-44fe-99f6-832af1790a42 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:35.559774 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ba6c587a-cb43-401a-8ce6-ad72d9e25e60 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:35.562772 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ba6c587a-cb43-401a-8ce6-ad72d9e25e60 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] [instance: aac0e70b-f9ec-4242-bac2-8e8dc29bb460] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:35.574537 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ba6c587a-cb43-401a-8ce6-ad72d9e25e60 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:35.575029 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ba6c587a-cb43-401a-8ce6-ad72d9e25e60 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:35.575875 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ba6c587a-cb43-401a-8ce6-ad72d9e25e60 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:35.576745 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ba6c587a-cb43-401a-8ce6-ad72d9e25e60 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:35.577395 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ba6c587a-cb43-401a-8ce6-ad72d9e25e60 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:35.579582 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ba6c587a-cb43-401a-8ce6-ad72d9e25e60 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:35.777007 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3c6e9474-067f-44fe-99f6-832af1790a42 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec3f9e6cb241549395b6375b43b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b981af0923d41809255f04ce299062f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:14:35.798626 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3c6e9474-067f-44fe-99f6-832af1790a42 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] 10.222.0.79 "GET /compute/v2.1/servers/5cf1340c-725a-48da-8be6-72dda0cae178" status: 200 len: 1375 microversion: 2.1 time: 0.308672 Oct 17 14:14:35.812366 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2928/5725] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:35 2022] GET /compute/v2.1/servers/5cf1340c-725a-48da-8be6-72dda0cae178 => generated 1375 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:14:35.818842 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ba6c587a-cb43-401a-8ce6-ad72d9e25e60 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/aac0e70b-f9ec-4242-bac2-8e8dc29bb460" status: 200 len: 1656 microversion: 2.1 time: 0.290063 Oct 17 14:14:35.819545 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2798/5726] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:35 2022] GET /compute/v2.1/servers/aac0e70b-f9ec-4242-bac2-8e8dc29bb460 => generated 1656 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:14:36.825257 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f2d36fa4-7e33-4e08-be1a-2072ebe4ee36 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:36.826147 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f2d36fa4-7e33-4e08-be1a-2072ebe4ee36 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] [instance: 5cf1340c-725a-48da-8be6-72dda0cae178] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:36.830762 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=8 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:14:36.831630 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:14:36.836153 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f2d36fa4-7e33-4e08-be1a-2072ebe4ee36 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:36.837215 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f2d36fa4-7e33-4e08-be1a-2072ebe4ee36 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:36.837862 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f2d36fa4-7e33-4e08-be1a-2072ebe4ee36 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:36.838818 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f2d36fa4-7e33-4e08-be1a-2072ebe4ee36 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:36.839506 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f2d36fa4-7e33-4e08-be1a-2072ebe4ee36 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:36.840267 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f2d36fa4-7e33-4e08-be1a-2072ebe4ee36 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:36.843419 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-264cdfe0-d2fe-4267-ab00-2911f021cc55 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:36.845649 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-264cdfe0-d2fe-4267-ab00-2911f021cc55 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] [instance: aac0e70b-f9ec-4242-bac2-8e8dc29bb460] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:36.863142 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=4 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:14:36.867125 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=12 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:14:36.873435 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:14:36.886878 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-264cdfe0-d2fe-4267-ab00-2911f021cc55 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:36.888209 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-264cdfe0-d2fe-4267-ab00-2911f021cc55 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:36.889789 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-264cdfe0-d2fe-4267-ab00-2911f021cc55 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:36.890698 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-264cdfe0-d2fe-4267-ab00-2911f021cc55 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:36.898158 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-264cdfe0-d2fe-4267-ab00-2911f021cc55 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:36.898772 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-264cdfe0-d2fe-4267-ab00-2911f021cc55 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:37.157827 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f2d36fa4-7e33-4e08-be1a-2072ebe4ee36 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec3f9e6cb241549395b6375b43b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b981af0923d41809255f04ce299062f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:14:37.170510 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f2d36fa4-7e33-4e08-be1a-2072ebe4ee36 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] 10.222.0.79 "GET /compute/v2.1/servers/5cf1340c-725a-48da-8be6-72dda0cae178" status: 200 len: 1547 microversion: 2.1 time: 0.349317 Oct 17 14:14:37.171680 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2929/5727] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:36 2022] GET /compute/v2.1/servers/5cf1340c-725a-48da-8be6-72dda0cae178 => generated 1547 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:14:37.201096 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-bc266745-9106-4320-a60c-592e08a399b9 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:37.201764 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-bc266745-9106-4320-a60c-592e08a399b9 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] [instance: 5cf1340c-725a-48da-8be6-72dda0cae178] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:37.216733 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bc266745-9106-4320-a60c-592e08a399b9 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:37.217142 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bc266745-9106-4320-a60c-592e08a399b9 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:37.218105 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bc266745-9106-4320-a60c-592e08a399b9 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:37.218853 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bc266745-9106-4320-a60c-592e08a399b9 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:37.219904 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bc266745-9106-4320-a60c-592e08a399b9 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:37.220567 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bc266745-9106-4320-a60c-592e08a399b9 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:37.265001 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-264cdfe0-d2fe-4267-ab00-2911f021cc55 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/aac0e70b-f9ec-4242-bac2-8e8dc29bb460" status: 200 len: 1656 microversion: 2.1 time: 0.425886 Oct 17 14:14:37.277957 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2799/5728] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:36 2022] GET /compute/v2.1/servers/aac0e70b-f9ec-4242-bac2-8e8dc29bb460 => generated 1656 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:14:37.607123 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-bc266745-9106-4320-a60c-592e08a399b9 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec3f9e6cb241549395b6375b43b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b981af0923d41809255f04ce299062f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:14:37.617516 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-bc266745-9106-4320-a60c-592e08a399b9 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] 10.222.0.79 "GET /compute/v2.1/servers/5cf1340c-725a-48da-8be6-72dda0cae178" status: 200 len: 1547 microversion: 2.1 time: 0.421898 Oct 17 14:14:37.618016 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2930/5729] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:37 2022] GET /compute/v2.1/servers/5cf1340c-725a-48da-8be6-72dda0cae178 => generated 1547 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:14:37.832289 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-e6c7225b-eaa6-4bd8-a632-6a59774604f9 req-2b10357f-21de-45da-8ed8-181d2e936316 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aac0e70b-f9ec-4242-bac2-8e8dc29bb460", "name": "network-vif-deleted", "tag": "eaae01b2-12e3-43ca-b5b5-11d876691530"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:14:37.842477 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-e6c7225b-eaa6-4bd8-a632-6a59774604f9 req-2b10357f-21de-45da-8ed8-181d2e936316 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:37.842953 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-e6c7225b-eaa6-4bd8-a632-6a59774604f9 req-2b10357f-21de-45da-8ed8-181d2e936316 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:37.843414 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-e6c7225b-eaa6-4bd8-a632-6a59774604f9 req-2b10357f-21de-45da-8ed8-181d2e936316 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:37.879549 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-e6c7225b-eaa6-4bd8-a632-6a59774604f9 req-2b10357f-21de-45da-8ed8-181d2e936316 service nova] Creating event network-vif-deleted:eaae01b2-12e3-43ca-b5b5-11d876691530 for instance aac0e70b-f9ec-4242-bac2-8e8dc29bb460 on n-h1-854247-14 Oct 17 14:14:37.890003 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-e6c7225b-eaa6-4bd8-a632-6a59774604f9 req-2b10357f-21de-45da-8ed8-181d2e936316 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063223 Oct 17 14:14:37.890975 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2800/5730] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:14:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:14:38.299872 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-771e50fe-da3e-4251-b9b2-27b99e22057a tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:38.301865 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-771e50fe-da3e-4251-b9b2-27b99e22057a tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] [instance: aac0e70b-f9ec-4242-bac2-8e8dc29bb460] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:38.314730 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-771e50fe-da3e-4251-b9b2-27b99e22057a tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:38.315969 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-771e50fe-da3e-4251-b9b2-27b99e22057a tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:38.317483 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-771e50fe-da3e-4251-b9b2-27b99e22057a tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:38.318481 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-771e50fe-da3e-4251-b9b2-27b99e22057a tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:38.319382 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-771e50fe-da3e-4251-b9b2-27b99e22057a tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:38.319824 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-771e50fe-da3e-4251-b9b2-27b99e22057a tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:38.362831 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-771e50fe-da3e-4251-b9b2-27b99e22057a tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:38.363455 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-771e50fe-da3e-4251-b9b2-27b99e22057a tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:38.364430 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-771e50fe-da3e-4251-b9b2-27b99e22057a tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:38.364898 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-771e50fe-da3e-4251-b9b2-27b99e22057a tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lazy-loading 'fault' on Instance uuid aac0e70b-f9ec-4242-bac2-8e8dc29bb460 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:14:38.426219 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-771e50fe-da3e-4251-b9b2-27b99e22057a tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/aac0e70b-f9ec-4242-bac2-8e8dc29bb460" status: 200 len: 1455 microversion: 2.1 time: 0.136163 Oct 17 14:14:38.427314 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2931/5731] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:38 2022] GET /compute/v2.1/servers/aac0e70b-f9ec-4242-bac2-8e8dc29bb460 => generated 1455 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:14:39.451396 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-02ff7371-fe1e-4471-8386-ce2512f533e2 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:39.454353 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-02ff7371-fe1e-4471-8386-ce2512f533e2 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] [instance: aac0e70b-f9ec-4242-bac2-8e8dc29bb460] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:39.460885 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-02ff7371-fe1e-4471-8386-ce2512f533e2 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:39.461668 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-02ff7371-fe1e-4471-8386-ce2512f533e2 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:39.462307 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-02ff7371-fe1e-4471-8386-ce2512f533e2 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:39.463246 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-02ff7371-fe1e-4471-8386-ce2512f533e2 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:39.463921 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-02ff7371-fe1e-4471-8386-ce2512f533e2 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:39.464531 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-02ff7371-fe1e-4471-8386-ce2512f533e2 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:39.479976 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-02ff7371-fe1e-4471-8386-ce2512f533e2 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] HTTP exception thrown: Instance aac0e70b-f9ec-4242-bac2-8e8dc29bb460 could not be found. Oct 17 14:14:39.482041 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-02ff7371-fe1e-4471-8386-ce2512f533e2 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Request method failure captured: Oct 17 14:14:39.482041 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/aac0e70b-f9ec-4242-bac2-8e8dc29bb460 HTTP/1.1 Oct 17 14:14:39.482041 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 14:14:39.482041 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 14:14:39.482041 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 14:14:39.482041 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 14:14:39.482041 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 14:14:39.482041 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 14:14:39.482041 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 14:14:39.482041 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 14:14:39.482041 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTWMuKQAhcqbqJKSOUavElpRkikhEWaWd4iXIJJXmgWa0HM1M22BxbkckiJiZg9OB_s1sK7KrGf4t1DqeAmVD_aisB273RfEJ8WiPWIdHhhnSVHP-HmeyyhnDhL28vXjOtyKmDPEakYQ6r_mBvlbVrOFBOdRSA4Eokigw0TyF27t5mhA Oct 17 14:14:39.482041 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 14:14:39.482041 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 14:14:39.482041 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 14:14:39.482041 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 14:14:39.482041 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 14:14:39.482041 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 14:14:39.482041 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 6f4dded84add4006924e5c44bf2a0aaf Oct 17 14:14:39.482041 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-TestServerMultinode-140284231 Oct 17 14:14:39.482041 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member,admin Oct 17 14:14:39.482041 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member,admin Oct 17 14:14:39.482041 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6f4dded84add4006924e5c44bf2a0aaf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6f4dded84add4006924e5c44bf2a0aaf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6f4dded84add4006924e5c44bf2a0aaf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6f4dded84add4006924e5c44bf2a0aaf", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:14:39.482041 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-TestServerMultinode-140284231 Oct 17 14:14:39.482041 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 6f4dded84add4006924e5c44bf2a0aaf Oct 17 14:14:39.482041 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-TestServerMultinode-140284231 Oct 17 14:14:39.482041 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-TestServerMultinode-140284231-project-admin Oct 17 14:14:39.482041 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 14:14:39.482041 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 14:14:39.482041 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 48694cd9908e41f88b904c251fa4cf37 Oct 17 14:14:39.482041 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-TestServerMultinode-140284231-project-admin Oct 17 14:14:39.482041 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 14:14:39.482041 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance aac0e70b-f9ec-4242-bac2-8e8dc29bb460 could not be found. Oct 17 14:14:39.482041 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'aac0e70b-f9ec-4242-bac2-8e8dc29bb460'} Oct 17 14:14:39.482041 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:14:39.482041 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:14:39.482041 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:14:39.482041 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:14:39.482041 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:14:39.482041 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:14:39.482041 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:14:39.482041 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:14:39.482041 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:14:39.482041 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:14:39.482041 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aac0e70b-f9ec-4242-bac2-8e8dc29bb460 could not be found. Oct 17 14:14:39.482041 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:14:39.482041 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:14:39.482041 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:14:39.482041 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:14:39.482041 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:14:39.482041 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:14:39.482041 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:14:39.482041 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:14:39.482041 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:14:39.482041 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:14:39.482041 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:14:39.482041 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:14:39.482041 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:14:39.482041 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:14:39.482041 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:14:39.482041 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:14:39.482041 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aac0e70b-f9ec-4242-bac2-8e8dc29bb460 could not be found. Oct 17 14:14:39.482041 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:14:39.482041 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:14:39.482041 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:14:39.486729 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:14:39.486729 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:14:39.486729 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:14:39.486729 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:14:39.486729 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:14:39.486729 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aac0e70b-f9ec-4242-bac2-8e8dc29bb460 could not be found. Oct 17 14:14:39.486729 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:14:39.490229 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-02ff7371-fe1e-4471-8386-ce2512f533e2 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] Returning 404 to user: Instance aac0e70b-f9ec-4242-bac2-8e8dc29bb460 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:14:39.491962 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-02ff7371-fe1e-4471-8386-ce2512f533e2 tempest-TestServerMultinode-140284231 tempest-TestServerMultinode-140284231-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/aac0e70b-f9ec-4242-bac2-8e8dc29bb460" status: 404 len: 111 microversion: 2.1 time: 0.045099 Oct 17 14:14:39.492785 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2801/5732] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:39 2022] GET /compute/v2.1/servers/aac0e70b-f9ec-4242-bac2-8e8dc29bb460 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:15:04.665658 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-15d4423a-5d09-434f-b4a7-ceba9e41ac69 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:15:04.666909 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-15d4423a-5d09-434f-b4a7-ceba9e41ac69 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] [instance: 5cf1340c-725a-48da-8be6-72dda0cae178] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:15:04.671015 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=7 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:15:04.683916 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=42 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:15:04.703230 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-15d4423a-5d09-434f-b4a7-ceba9e41ac69 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:04.703473 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-15d4423a-5d09-434f-b4a7-ceba9e41ac69 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:04.704295 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-15d4423a-5d09-434f-b4a7-ceba9e41ac69 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:04.704678 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-15d4423a-5d09-434f-b4a7-ceba9e41ac69 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:04.705243 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-15d4423a-5d09-434f-b4a7-ceba9e41ac69 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:04.705677 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-15d4423a-5d09-434f-b4a7-ceba9e41ac69 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:04.767889 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-15d4423a-5d09-434f-b4a7-ceba9e41ac69 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] [instance: 5cf1340c-725a-48da-8be6-72dda0cae178] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:15:04.962170 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-15d4423a-5d09-434f-b4a7-ceba9e41ac69 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] 10.222.0.79 "DELETE /compute/v2.1/servers/5cf1340c-725a-48da-8be6-72dda0cae178" status: 204 len: 0 microversion: 2.1 time: 0.299993 Oct 17 14:15:04.962849 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2932/5733] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:15:04 2022] DELETE /compute/v2.1/servers/5cf1340c-725a-48da-8be6-72dda0cae178 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:15:04.971841 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ea44cbd6-fbd6-4593-a3d1-838ae04ecf04 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:15:04.972469 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ea44cbd6-fbd6-4593-a3d1-838ae04ecf04 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] [instance: 5cf1340c-725a-48da-8be6-72dda0cae178] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:15:04.974991 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=5 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:15:04.975673 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:15:05.012040 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ea44cbd6-fbd6-4593-a3d1-838ae04ecf04 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:05.012569 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ea44cbd6-fbd6-4593-a3d1-838ae04ecf04 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:05.013028 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ea44cbd6-fbd6-4593-a3d1-838ae04ecf04 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:05.013785 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ea44cbd6-fbd6-4593-a3d1-838ae04ecf04 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:05.014243 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ea44cbd6-fbd6-4593-a3d1-838ae04ecf04 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:05.014675 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ea44cbd6-fbd6-4593-a3d1-838ae04ecf04 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:05.463598 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ea44cbd6-fbd6-4593-a3d1-838ae04ecf04 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec3f9e6cb241549395b6375b43b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b981af0923d41809255f04ce299062f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:15:05.474074 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ea44cbd6-fbd6-4593-a3d1-838ae04ecf04 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] 10.222.0.79 "GET /compute/v2.1/servers/5cf1340c-725a-48da-8be6-72dda0cae178" status: 200 len: 1553 microversion: 2.1 time: 0.506768 Oct 17 14:15:05.487565 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2802/5734] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:15:04 2022] GET /compute/v2.1/servers/5cf1340c-725a-48da-8be6-72dda0cae178 => generated 1553 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:15:06.513063 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f04dce09-39b8-456e-8a3d-7f82d08782d8 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:15:06.514569 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f04dce09-39b8-456e-8a3d-7f82d08782d8 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] [instance: 5cf1340c-725a-48da-8be6-72dda0cae178] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:15:06.525107 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f04dce09-39b8-456e-8a3d-7f82d08782d8 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:06.525990 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f04dce09-39b8-456e-8a3d-7f82d08782d8 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:06.526657 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f04dce09-39b8-456e-8a3d-7f82d08782d8 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:06.527783 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f04dce09-39b8-456e-8a3d-7f82d08782d8 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:06.528483 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f04dce09-39b8-456e-8a3d-7f82d08782d8 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:06.529117 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f04dce09-39b8-456e-8a3d-7f82d08782d8 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:06.914782 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f04dce09-39b8-456e-8a3d-7f82d08782d8 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec3f9e6cb241549395b6375b43b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b981af0923d41809255f04ce299062f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:15:06.923695 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f04dce09-39b8-456e-8a3d-7f82d08782d8 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] 10.222.0.79 "GET /compute/v2.1/servers/5cf1340c-725a-48da-8be6-72dda0cae178" status: 200 len: 1553 microversion: 2.1 time: 0.428243 Oct 17 14:15:06.925263 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2933/5735] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:15:06 2022] GET /compute/v2.1/servers/5cf1340c-725a-48da-8be6-72dda0cae178 => generated 1553 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:15:07.650028 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-fcf8160a-708b-4445-8137-71b7a33f4ebe req-2b3619c2-e029-45af-9015-533be0be8db7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cf1340c-725a-48da-8be6-72dda0cae178", "name": "network-vif-deleted", "tag": "382d97ed-55b7-40be-bd39-4f9aaf5e5600"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:15:07.680668 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-fcf8160a-708b-4445-8137-71b7a33f4ebe req-2b3619c2-e029-45af-9015-533be0be8db7 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:07.681877 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-fcf8160a-708b-4445-8137-71b7a33f4ebe req-2b3619c2-e029-45af-9015-533be0be8db7 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:07.682493 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-fcf8160a-708b-4445-8137-71b7a33f4ebe req-2b3619c2-e029-45af-9015-533be0be8db7 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:07.753162 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-fcf8160a-708b-4445-8137-71b7a33f4ebe req-2b3619c2-e029-45af-9015-533be0be8db7 service nova] Creating event network-vif-deleted:382d97ed-55b7-40be-bd39-4f9aaf5e5600 for instance 5cf1340c-725a-48da-8be6-72dda0cae178 on n-h2-854247-14 Oct 17 14:15:07.783575 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-fcf8160a-708b-4445-8137-71b7a33f4ebe req-2b3619c2-e029-45af-9015-533be0be8db7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131267 Oct 17 14:15:07.785609 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2803/5736] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:15:07.951105 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8acfcc12-bdcd-4436-a9fd-ffcfbd88538b tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:15:07.952725 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8acfcc12-bdcd-4436-a9fd-ffcfbd88538b tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] [instance: 5cf1340c-725a-48da-8be6-72dda0cae178] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:15:07.968629 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8acfcc12-bdcd-4436-a9fd-ffcfbd88538b tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:07.970500 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8acfcc12-bdcd-4436-a9fd-ffcfbd88538b tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:07.976748 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8acfcc12-bdcd-4436-a9fd-ffcfbd88538b tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:07.977733 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8acfcc12-bdcd-4436-a9fd-ffcfbd88538b tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:07.978371 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8acfcc12-bdcd-4436-a9fd-ffcfbd88538b tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:07.978973 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8acfcc12-bdcd-4436-a9fd-ffcfbd88538b tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:08.050329 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8acfcc12-bdcd-4436-a9fd-ffcfbd88538b tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:08.050842 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8acfcc12-bdcd-4436-a9fd-ffcfbd88538b tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:08.051332 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8acfcc12-bdcd-4436-a9fd-ffcfbd88538b tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:08.051790 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-8acfcc12-bdcd-4436-a9fd-ffcfbd88538b tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lazy-loading 'fault' on Instance uuid 5cf1340c-725a-48da-8be6-72dda0cae178 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:15:08.129129 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8acfcc12-bdcd-4436-a9fd-ffcfbd88538b tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec3f9e6cb241549395b6375b43b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b981af0923d41809255f04ce299062f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:15:08.140096 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8acfcc12-bdcd-4436-a9fd-ffcfbd88538b tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] 10.222.0.79 "GET /compute/v2.1/servers/5cf1340c-725a-48da-8be6-72dda0cae178" status: 200 len: 1339 microversion: 2.1 time: 0.195795 Oct 17 14:15:08.140706 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2934/5737] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:15:07 2022] GET /compute/v2.1/servers/5cf1340c-725a-48da-8be6-72dda0cae178 => generated 1339 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:15:09.165083 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-af095154-e145-4704-909a-81ba946870c9 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:15:09.166626 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-af095154-e145-4704-909a-81ba946870c9 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] [instance: 5cf1340c-725a-48da-8be6-72dda0cae178] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:15:09.174746 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-af095154-e145-4704-909a-81ba946870c9 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:09.175359 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-af095154-e145-4704-909a-81ba946870c9 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:09.175869 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-af095154-e145-4704-909a-81ba946870c9 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:09.176816 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-af095154-e145-4704-909a-81ba946870c9 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:09.177771 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-af095154-e145-4704-909a-81ba946870c9 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:09.178266 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-af095154-e145-4704-909a-81ba946870c9 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:09.193254 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-af095154-e145-4704-909a-81ba946870c9 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] HTTP exception thrown: Instance 5cf1340c-725a-48da-8be6-72dda0cae178 could not be found. Oct 17 14:15:09.195298 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-af095154-e145-4704-909a-81ba946870c9 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Request method failure captured: Oct 17 14:15:09.195298 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/5cf1340c-725a-48da-8be6-72dda0cae178 HTTP/1.1 Oct 17 14:15:09.195298 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 14:15:09.195298 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 14:15:09.195298 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 14:15:09.195298 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 14:15:09.195298 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 14:15:09.195298 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 14:15:09.195298 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 14:15:09.195298 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 14:15:09.195298 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTWL136FgU2IyEDjBQXa30vIK56h-gAs-SKuFxfZQPjvpnYb0fchfPhxn-AZuq9g5sqGxvAiLWxa_5cN2bhBM-VOY81IWWyRaJs7K7y1KhjG8uAMe6p4rqMTM4MaylNIBzf9OxEoejRTRfFdeCQK3-J45t1PP_EJOlX-_BuJfSWoKKTA Oct 17 14:15:09.195298 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 14:15:09.195298 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 14:15:09.195298 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 14:15:09.195298 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 14:15:09.195298 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 14:15:09.195298 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 14:15:09.195298 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 1b981af0923d41809255f04ce299062f Oct 17 14:15:09.195298 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-TestNetworkBasicOps-558238693 Oct 17 14:15:09.195298 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 14:15:09.195298 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 14:15:09.195298 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1b981af0923d41809255f04ce299062f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/1b981af0923d41809255f04ce299062f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1b981af0923d41809255f04ce299062f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_1b981af0923d41809255f04ce299062f", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:15:09.195298 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-TestNetworkBasicOps-558238693 Oct 17 14:15:09.195298 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 1b981af0923d41809255f04ce299062f Oct 17 14:15:09.195298 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-TestNetworkBasicOps-558238693 Oct 17 14:15:09.195298 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-TestNetworkBasicOps-558238693-project Oct 17 14:15:09.195298 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 14:15:09.195298 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 14:15:09.195298 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 7fec3f9e6cb241549395b6375b43b22f Oct 17 14:15:09.195298 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-TestNetworkBasicOps-558238693-project Oct 17 14:15:09.195298 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 14:15:09.195298 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 5cf1340c-725a-48da-8be6-72dda0cae178 could not be found. Oct 17 14:15:09.195298 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '5cf1340c-725a-48da-8be6-72dda0cae178'} Oct 17 14:15:09.195298 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:15:09.195298 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:15:09.195298 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:15:09.195298 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:15:09.195298 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:15:09.195298 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:15:09.195298 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:15:09.195298 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:15:09.195298 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:15:09.195298 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:15:09.195298 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cf1340c-725a-48da-8be6-72dda0cae178 could not be found. Oct 17 14:15:09.195298 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:15:09.195298 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:15:09.195298 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:15:09.195298 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:15:09.195298 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:15:09.195298 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:15:09.195298 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:15:09.195298 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:15:09.195298 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:15:09.195298 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:15:09.195298 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:15:09.195298 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:15:09.195298 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:15:09.195298 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:15:09.195298 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:15:09.195298 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:15:09.195298 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cf1340c-725a-48da-8be6-72dda0cae178 could not be found. Oct 17 14:15:09.195298 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:15:09.195298 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:15:09.195298 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:15:09.203480 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:15:09.203480 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:15:09.203480 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:15:09.203480 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:15:09.203480 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:15:09.203480 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cf1340c-725a-48da-8be6-72dda0cae178 could not be found. Oct 17 14:15:09.203480 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:15:09.203480 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-af095154-e145-4704-909a-81ba946870c9 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Returning 404 to user: Instance 5cf1340c-725a-48da-8be6-72dda0cae178 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:15:09.203480 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-af095154-e145-4704-909a-81ba946870c9 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] 10.222.0.79 "GET /compute/v2.1/servers/5cf1340c-725a-48da-8be6-72dda0cae178" status: 404 len: 111 microversion: 2.1 time: 0.036408 Oct 17 14:15:09.203480 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2804/5738] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:15:09 2022] GET /compute/v2.1/servers/5cf1340c-725a-48da-8be6-72dda0cae178 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:15:09.375498 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4e87ad3a-4a44-4e7e-8f3f-5041bbcaacb0 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Calling method '.version_select at 0x7f7cd4330e50>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:15:09.428359 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4e87ad3a-4a44-4e7e-8f3f-5041bbcaacb0 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1219970259" status: 202 len: 0 microversion: 2.1 time: 0.057023 Oct 17 14:15:09.433426 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2935/5739] 10.222.0.79 () {58 vars in 1257 bytes} [Mon Oct 17 14:15:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1219970259 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:15:11.722207 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b6299960-20d5-46d2-89da-6ecc7653f5df tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:15:11.723627 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b6299960-20d5-46d2-89da-6ecc7653f5df tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] [instance: 6dfa9a5b-dfb8-462c-9ddc-4289de89826e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:15:11.736051 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b6299960-20d5-46d2-89da-6ecc7653f5df tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:11.739774 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b6299960-20d5-46d2-89da-6ecc7653f5df tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:11.741819 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b6299960-20d5-46d2-89da-6ecc7653f5df tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:11.742784 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b6299960-20d5-46d2-89da-6ecc7653f5df tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:11.745892 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b6299960-20d5-46d2-89da-6ecc7653f5df tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:11.747924 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b6299960-20d5-46d2-89da-6ecc7653f5df tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:11.812281 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b6299960-20d5-46d2-89da-6ecc7653f5df tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] [instance: 6dfa9a5b-dfb8-462c-9ddc-4289de89826e] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:15:11.942126 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b6299960-20d5-46d2-89da-6ecc7653f5df tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] 10.222.0.79 "DELETE /compute/v2.1/servers/6dfa9a5b-dfb8-462c-9ddc-4289de89826e" status: 204 len: 0 microversion: 2.1 time: 0.223753 Oct 17 14:15:11.942923 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2805/5740] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:15:11 2022] DELETE /compute/v2.1/servers/6dfa9a5b-dfb8-462c-9ddc-4289de89826e => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:15:11.954192 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-decab848-48b9-4f2d-baf7-01753a85eff4 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:15:11.955261 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-decab848-48b9-4f2d-baf7-01753a85eff4 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] [instance: 6dfa9a5b-dfb8-462c-9ddc-4289de89826e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:15:11.964892 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-decab848-48b9-4f2d-baf7-01753a85eff4 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:11.965374 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-decab848-48b9-4f2d-baf7-01753a85eff4 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:11.966074 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-decab848-48b9-4f2d-baf7-01753a85eff4 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:11.967027 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-decab848-48b9-4f2d-baf7-01753a85eff4 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:11.967519 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-decab848-48b9-4f2d-baf7-01753a85eff4 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:11.967981 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-decab848-48b9-4f2d-baf7-01753a85eff4 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:12.057675 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-8fc991b3-4d9b-4d12-8322-a419d6de636e req-cd0620b7-3b56-4ea4-b040-cab66e5beb2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dfa9a5b-dfb8-462c-9ddc-4289de89826e", "tag": "bcbc48b3-854d-4498-bf6f-f4f11409ebc4"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:15:12.079582 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-8fc991b3-4d9b-4d12-8322-a419d6de636e req-cd0620b7-3b56-4ea4-b040-cab66e5beb2e service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:12.082163 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-8fc991b3-4d9b-4d12-8322-a419d6de636e req-cd0620b7-3b56-4ea4-b040-cab66e5beb2e service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:12.082896 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-8fc991b3-4d9b-4d12-8322-a419d6de636e req-cd0620b7-3b56-4ea4-b040-cab66e5beb2e service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:12.123671 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-8fc991b3-4d9b-4d12-8322-a419d6de636e req-cd0620b7-3b56-4ea4-b040-cab66e5beb2e service nova] Creating event network-changed:bcbc48b3-854d-4498-bf6f-f4f11409ebc4 for instance 6dfa9a5b-dfb8-462c-9ddc-4289de89826e on n-h1-854247-14 Oct 17 14:15:12.134150 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-8fc991b3-4d9b-4d12-8322-a419d6de636e req-cd0620b7-3b56-4ea4-b040-cab66e5beb2e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.382021 Oct 17 14:15:12.140418 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2936/5741] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:15:12.324970 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-decab848-48b9-4f2d-baf7-01753a85eff4 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec3f9e6cb241549395b6375b43b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b981af0923d41809255f04ce299062f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:15:12.334660 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-decab848-48b9-4f2d-baf7-01753a85eff4 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] 10.222.0.79 "GET /compute/v2.1/servers/6dfa9a5b-dfb8-462c-9ddc-4289de89826e" status: 200 len: 1668 microversion: 2.1 time: 0.386145 Oct 17 14:15:12.335857 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2806/5742] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:15:11 2022] GET /compute/v2.1/servers/6dfa9a5b-dfb8-462c-9ddc-4289de89826e => generated 1668 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:15:13.358832 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e4a23f5d-61c7-4230-88b5-59b57b169a72 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:15:13.359580 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e4a23f5d-61c7-4230-88b5-59b57b169a72 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] [instance: 6dfa9a5b-dfb8-462c-9ddc-4289de89826e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:15:13.380170 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e4a23f5d-61c7-4230-88b5-59b57b169a72 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:13.380703 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e4a23f5d-61c7-4230-88b5-59b57b169a72 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:13.381104 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e4a23f5d-61c7-4230-88b5-59b57b169a72 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:13.381827 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e4a23f5d-61c7-4230-88b5-59b57b169a72 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:13.382348 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e4a23f5d-61c7-4230-88b5-59b57b169a72 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:13.386764 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e4a23f5d-61c7-4230-88b5-59b57b169a72 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:13.649149 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e4a23f5d-61c7-4230-88b5-59b57b169a72 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec3f9e6cb241549395b6375b43b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b981af0923d41809255f04ce299062f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:15:13.669382 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e4a23f5d-61c7-4230-88b5-59b57b169a72 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] 10.222.0.79 "GET /compute/v2.1/servers/6dfa9a5b-dfb8-462c-9ddc-4289de89826e" status: 200 len: 1668 microversion: 2.1 time: 0.314721 Oct 17 14:15:13.672121 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2937/5743] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:15:13 2022] GET /compute/v2.1/servers/6dfa9a5b-dfb8-462c-9ddc-4289de89826e => generated 1668 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:15:14.152188 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-9c1f4e91-d0f9-44b3-8e9d-77e90045a7d4 req-78e838d9-1162-4be7-8d65-3d34b6399f50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dfa9a5b-dfb8-462c-9ddc-4289de89826e", "name": "network-vif-deleted", "tag": "bcbc48b3-854d-4498-bf6f-f4f11409ebc4"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:15:14.169828 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-9c1f4e91-d0f9-44b3-8e9d-77e90045a7d4 req-78e838d9-1162-4be7-8d65-3d34b6399f50 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:14.172210 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-9c1f4e91-d0f9-44b3-8e9d-77e90045a7d4 req-78e838d9-1162-4be7-8d65-3d34b6399f50 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:14.181740 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-9c1f4e91-d0f9-44b3-8e9d-77e90045a7d4 req-78e838d9-1162-4be7-8d65-3d34b6399f50 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:14.193010 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-9c1f4e91-d0f9-44b3-8e9d-77e90045a7d4 req-78e838d9-1162-4be7-8d65-3d34b6399f50 service nova] Creating event network-vif-deleted:bcbc48b3-854d-4498-bf6f-f4f11409ebc4 for instance 6dfa9a5b-dfb8-462c-9ddc-4289de89826e on n-h1-854247-14 Oct 17 14:15:14.203594 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-9c1f4e91-d0f9-44b3-8e9d-77e90045a7d4 req-78e838d9-1162-4be7-8d65-3d34b6399f50 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054865 Oct 17 14:15:14.204653 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2807/5744] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:15:14.705210 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c1f09085-a0c8-458c-95ac-6121e7c4af5a tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:15:14.705814 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c1f09085-a0c8-458c-95ac-6121e7c4af5a tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] [instance: 6dfa9a5b-dfb8-462c-9ddc-4289de89826e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:15:14.712307 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1f09085-a0c8-458c-95ac-6121e7c4af5a tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:14.712831 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1f09085-a0c8-458c-95ac-6121e7c4af5a tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:14.713289 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1f09085-a0c8-458c-95ac-6121e7c4af5a tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:14.713983 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1f09085-a0c8-458c-95ac-6121e7c4af5a tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:14.714476 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1f09085-a0c8-458c-95ac-6121e7c4af5a tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:14.715118 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1f09085-a0c8-458c-95ac-6121e7c4af5a tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:14.747488 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-c1f09085-a0c8-458c-95ac-6121e7c4af5a tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] HTTP exception thrown: Instance 6dfa9a5b-dfb8-462c-9ddc-4289de89826e could not be found. Oct 17 14:15:14.749626 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c1f09085-a0c8-458c-95ac-6121e7c4af5a tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Request method failure captured: Oct 17 14:15:14.749626 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/6dfa9a5b-dfb8-462c-9ddc-4289de89826e HTTP/1.1 Oct 17 14:15:14.749626 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 14:15:14.749626 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 14:15:14.749626 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 14:15:14.749626 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 14:15:14.749626 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 14:15:14.749626 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 14:15:14.749626 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 14:15:14.749626 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 14:15:14.749626 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTWL136FgU2IyEDjBQXa30vIK56h-gAs-SKuFxfZQPjvpnYb0fchfPhxn-AZuq9g5sqGxvAiLWxa_5cN2bhBM-VOY81IWWyRaJs7K7y1KhjG8uAMe6p4rqMTM4MaylNIBzf9OxEoejRTRfFdeCQK3-J45t1PP_EJOlX-_BuJfSWoKKTA Oct 17 14:15:14.749626 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 14:15:14.749626 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 14:15:14.749626 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 14:15:14.749626 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 14:15:14.749626 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 14:15:14.749626 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 14:15:14.749626 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 1b981af0923d41809255f04ce299062f Oct 17 14:15:14.749626 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-TestNetworkBasicOps-558238693 Oct 17 14:15:14.749626 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 14:15:14.749626 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 14:15:14.749626 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1b981af0923d41809255f04ce299062f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/1b981af0923d41809255f04ce299062f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1b981af0923d41809255f04ce299062f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_1b981af0923d41809255f04ce299062f", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:15:14.749626 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-TestNetworkBasicOps-558238693 Oct 17 14:15:14.749626 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 1b981af0923d41809255f04ce299062f Oct 17 14:15:14.749626 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-TestNetworkBasicOps-558238693 Oct 17 14:15:14.749626 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-TestNetworkBasicOps-558238693-project Oct 17 14:15:14.749626 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 14:15:14.749626 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 14:15:14.749626 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 7fec3f9e6cb241549395b6375b43b22f Oct 17 14:15:14.749626 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-TestNetworkBasicOps-558238693-project Oct 17 14:15:14.749626 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 14:15:14.749626 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 6dfa9a5b-dfb8-462c-9ddc-4289de89826e could not be found. Oct 17 14:15:14.749626 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '6dfa9a5b-dfb8-462c-9ddc-4289de89826e'} Oct 17 14:15:14.749626 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:15:14.749626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:15:14.749626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:15:14.749626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:15:14.749626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:15:14.749626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:15:14.749626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:15:14.749626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:15:14.749626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:15:14.749626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:15:14.749626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dfa9a5b-dfb8-462c-9ddc-4289de89826e could not be found. Oct 17 14:15:14.749626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:15:14.749626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:15:14.749626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:15:14.749626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:15:14.749626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:15:14.749626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:15:14.749626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:15:14.749626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:15:14.749626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:15:14.749626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:15:14.749626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:15:14.749626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:15:14.749626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:15:14.749626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:15:14.749626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:15:14.749626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:15:14.749626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dfa9a5b-dfb8-462c-9ddc-4289de89826e could not be found. Oct 17 14:15:14.749626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:15:14.749626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:15:14.749626 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:15:14.753985 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:15:14.753985 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:15:14.753985 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:15:14.753985 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:15:14.753985 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:15:14.753985 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dfa9a5b-dfb8-462c-9ddc-4289de89826e could not be found. Oct 17 14:15:14.753985 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:15:14.753985 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c1f09085-a0c8-458c-95ac-6121e7c4af5a tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Returning 404 to user: Instance 6dfa9a5b-dfb8-462c-9ddc-4289de89826e could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:15:14.753985 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c1f09085-a0c8-458c-95ac-6121e7c4af5a tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] 10.222.0.79 "GET /compute/v2.1/servers/6dfa9a5b-dfb8-462c-9ddc-4289de89826e" status: 404 len: 111 microversion: 2.1 time: 0.051170 Oct 17 14:15:14.753985 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2938/5745] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:15:14 2022] GET /compute/v2.1/servers/6dfa9a5b-dfb8-462c-9ddc-4289de89826e => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:15:14.945027 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-60da2eba-2861-4945-8765-536738847677 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Calling method '.version_select at 0x7f7cd5a1d160>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:15:14.950125 n-d-854247-14 devstack@n-api.service[127017]: ERROR oslo.messaging._drivers.impl_rabbit [None req-60da2eba-2861-4945-8765-536738847677 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] [db279165-5189-40f8-9e6f-0af7f7bfcb49] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 14:15:15.961601 n-d-854247-14 devstack@n-api.service[127017]: INFO oslo.messaging._drivers.impl_rabbit [None req-60da2eba-2861-4945-8765-536738847677 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] [db279165-5189-40f8-9e6f-0af7f7bfcb49] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 54460. Oct 17 14:15:16.000248 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-60da2eba-2861-4945-8765-536738847677 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-389440035" status: 202 len: 0 microversion: 2.1 time: 1.061119 Oct 17 14:15:16.002079 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2808/5746] 10.222.0.79 () {58 vars in 1254 bytes} [Mon Oct 17 14:15:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-389440035 => generated 0 bytes in 1063 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:15:26.539190 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f98934b2-818f-4dd3-bc69-35ddea4548d9 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Action: 'create', calling method: .version_select at 0x7f7cd43e4ca0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-321836029", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFvAMWj7hzGJOztYYnHAxG/M4kAuSqEKJgInh2LVmQH4Ov1/OIN86QtDQCiIIzYQAivwZBRUnjZuneNXLssJU+otZaN3fIo4B/8qG0r6WMzuI4Q0rD4f+Yz14SGq08ATA=="}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:15:26.558848 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:15:26.559840 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:15:26.584364 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-f98934b2-818f-4dd3-bc69-35ddea4548d9 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Getting quotas for project 1b981af0923d41809255f04ce299062f. Resources: {'key_pairs'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:15:26.608566 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-f98934b2-818f-4dd3-bc69-35ddea4548d9 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Getting quotas for user 7fec3f9e6cb241549395b6375b43b22f and project 1b981af0923d41809255f04ce299062f. Resources: {'key_pairs'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:15:26.673674 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f98934b2-818f-4dd3-bc69-35ddea4548d9 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.138928 Oct 17 14:15:26.674620 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2939/5747] 10.222.0.79 () {60 vars in 1159 bytes} [Mon Oct 17 14:15:26 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:15:28.445742 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-39920002-d444-4518-af89-92f5686cb7c3 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-810247208", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "65808d4b-8190-477a-a74c-2dc96033c7fa"}], "key_name": "tempest-TestNetworkBasicOps-321836029", "security_groups": [{"name": "tempest-secgroup-smoke-359966311"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:15:28.470519 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:15:28.473029 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:15:28.596943 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-39920002-d444-4518-af89-92f5686cb7c3 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] validate_networks() for [('65808d4b-8190-477a-a74c-2dc96033c7fa', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:15:28.907994 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0f0c5bb5-4e70-4b31-9e00-23aba3b321f6 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Action: 'create', calling method: .version_select at 0x7f7cd4370dc0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-107352835", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIEdMQ5HFCmnd85ZhMDfJ//mwViBq/0y2SmxduZKm/wjXFjxlsJqcuy+NimIJBqrW2prCwuxQLlwG0tC4p9XdrObv+c/eFDYpeaRE/graJkzxv8GD2uk/qQuh1bYMtmQcg=="}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:15:28.927136 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-0f0c5bb5-4e70-4b31-9e00-23aba3b321f6 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Getting quotas for project b8c8fe6f805f43798c9910296df4b8ab. Resources: {'key_pairs'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:15:28.934881 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-0f0c5bb5-4e70-4b31-9e00-23aba3b321f6 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Getting quotas for user 024275cf6f8d423992e61d92dea927ba and project b8c8fe6f805f43798c9910296df4b8ab. Resources: {'key_pairs'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:15:28.974641 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0f0c5bb5-4e70-4b31-9e00-23aba3b321f6 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.416934 Oct 17 14:15:28.976188 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2940/5748] 10.222.0.79 () {60 vars in 1159 bytes} [Mon Oct 17 14:15:28 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:15:29.308763 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-39920002-d444-4518-af89-92f5686cb7c3 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:15:29.309191 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-39920002-d444-4518-af89-92f5686cb7c3 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:15:29.309664 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-39920002-d444-4518-af89-92f5686cb7c3 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:15:29.310164 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-39920002-d444-4518-af89-92f5686cb7c3 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:15:29.310583 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-39920002-d444-4518-af89-92f5686cb7c3 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:15:29.324444 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-39920002-d444-4518-af89-92f5686cb7c3 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:29.325560 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-39920002-d444-4518-af89-92f5686cb7c3 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:29.326503 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-39920002-d444-4518-af89-92f5686cb7c3 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:29.328175 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-39920002-d444-4518-af89-92f5686cb7c3 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:29.329448 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-39920002-d444-4518-af89-92f5686cb7c3 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:29.330089 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-39920002-d444-4518-af89-92f5686cb7c3 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:29.351954 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-39920002-d444-4518-af89-92f5686cb7c3 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Getting quotas for project 1b981af0923d41809255f04ce299062f. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:15:29.358914 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-39920002-d444-4518-af89-92f5686cb7c3 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Getting quotas for user 7fec3f9e6cb241549395b6375b43b22f and project 1b981af0923d41809255f04ce299062f. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:15:29.375087 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-39920002-d444-4518-af89-92f5686cb7c3 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:15:29.379103 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-39920002-d444-4518-af89-92f5686cb7c3 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] [instance: bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:15:29.450074 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-39920002-d444-4518-af89-92f5686cb7c3 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.008291 Oct 17 14:15:29.452732 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2809/5749] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 14:15:28 2022] POST /compute/v2.1/servers => generated 405 bytes in 1012 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:15:29.465746 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-679791cf-fdfa-4b45-acba-3d2e8e5eeaf7 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:15:29.466384 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-679791cf-fdfa-4b45-acba-3d2e8e5eeaf7 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] [instance: bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:15:29.562891 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-679791cf-fdfa-4b45-acba-3d2e8e5eeaf7 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec3f9e6cb241549395b6375b43b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b981af0923d41809255f04ce299062f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:15:29.585859 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-679791cf-fdfa-4b45-acba-3d2e8e5eeaf7 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] 10.222.0.79 "GET /compute/v2.1/servers/bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4" status: 200 len: 1247 microversion: 2.1 time: 0.124207 Oct 17 14:15:29.587929 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2941/5750] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:15:29 2022] GET /compute/v2.1/servers/bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4 => generated 1247 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:15:30.611298 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9e6f820e-8665-4b5e-9cb5-52639b966fb5 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:15:30.612984 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9e6f820e-8665-4b5e-9cb5-52639b966fb5 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] [instance: bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:15:30.622734 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9e6f820e-8665-4b5e-9cb5-52639b966fb5 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:30.623424 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9e6f820e-8665-4b5e-9cb5-52639b966fb5 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:30.623947 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9e6f820e-8665-4b5e-9cb5-52639b966fb5 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:30.625299 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9e6f820e-8665-4b5e-9cb5-52639b966fb5 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:30.625822 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9e6f820e-8665-4b5e-9cb5-52639b966fb5 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:30.626388 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9e6f820e-8665-4b5e-9cb5-52639b966fb5 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:30.722410 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9e6f820e-8665-4b5e-9cb5-52639b966fb5 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec3f9e6cb241549395b6375b43b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b981af0923d41809255f04ce299062f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:15:30.732378 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9e6f820e-8665-4b5e-9cb5-52639b966fb5 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] 10.222.0.79 "GET /compute/v2.1/servers/bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4" status: 200 len: 1299 microversion: 2.1 time: 0.125681 Oct 17 14:15:30.734418 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2810/5751] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:15:30 2022] GET /compute/v2.1/servers/bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4 => generated 1299 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:15:31.757857 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8ed2d652-8091-478f-91fc-2708e9315016 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:15:31.759452 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8ed2d652-8091-478f-91fc-2708e9315016 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] [instance: bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:15:31.774815 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8ed2d652-8091-478f-91fc-2708e9315016 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:31.775465 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8ed2d652-8091-478f-91fc-2708e9315016 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:31.776470 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8ed2d652-8091-478f-91fc-2708e9315016 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:31.778136 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8ed2d652-8091-478f-91fc-2708e9315016 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:31.778772 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8ed2d652-8091-478f-91fc-2708e9315016 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:31.779382 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8ed2d652-8091-478f-91fc-2708e9315016 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:31.876467 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8ed2d652-8091-478f-91fc-2708e9315016 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec3f9e6cb241549395b6375b43b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b981af0923d41809255f04ce299062f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:15:31.884780 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8ed2d652-8091-478f-91fc-2708e9315016 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] 10.222.0.79 "GET /compute/v2.1/servers/bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4" status: 200 len: 1305 microversion: 2.1 time: 0.130838 Oct 17 14:15:31.885422 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2942/5752] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:15:31 2022] GET /compute/v2.1/servers/bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4 => generated 1305 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:15:32.910925 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3ac539c5-4298-4983-80c8-45ec24e51e69 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:15:32.911947 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3ac539c5-4298-4983-80c8-45ec24e51e69 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] [instance: bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:15:32.939767 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3ac539c5-4298-4983-80c8-45ec24e51e69 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:32.940946 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3ac539c5-4298-4983-80c8-45ec24e51e69 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:32.941483 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3ac539c5-4298-4983-80c8-45ec24e51e69 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:32.942289 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3ac539c5-4298-4983-80c8-45ec24e51e69 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:32.943394 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3ac539c5-4298-4983-80c8-45ec24e51e69 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:32.943825 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3ac539c5-4298-4983-80c8-45ec24e51e69 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:33.233087 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3ac539c5-4298-4983-80c8-45ec24e51e69 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec3f9e6cb241549395b6375b43b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b981af0923d41809255f04ce299062f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:15:33.244031 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3ac539c5-4298-4983-80c8-45ec24e51e69 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] 10.222.0.79 "GET /compute/v2.1/servers/bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4" status: 200 len: 1372 microversion: 2.1 time: 0.338433 Oct 17 14:15:33.244849 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2811/5753] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:15:32 2022] GET /compute/v2.1/servers/bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4 => generated 1372 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:15:33.544980 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-3b2031ab-bbdf-42aa-9196-98a317e6ddad req-0a24584e-0a92-4edc-a68a-5c70046e67c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4", "tag": "d4dbf868-d7f2-4cba-a29f-09c069c518b6"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:15:33.544980 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-3b2031ab-bbdf-42aa-9196-98a317e6ddad req-0a24584e-0a92-4edc-a68a-5c70046e67c2 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:33.544980 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-3b2031ab-bbdf-42aa-9196-98a317e6ddad req-0a24584e-0a92-4edc-a68a-5c70046e67c2 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:33.544980 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-3b2031ab-bbdf-42aa-9196-98a317e6ddad req-0a24584e-0a92-4edc-a68a-5c70046e67c2 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:33.544980 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-3b2031ab-bbdf-42aa-9196-98a317e6ddad req-0a24584e-0a92-4edc-a68a-5c70046e67c2 service nova] Creating event network-changed:d4dbf868-d7f2-4cba-a29f-09c069c518b6 for instance bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4 on n-h1-854247-14 Oct 17 14:15:33.544980 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-3b2031ab-bbdf-42aa-9196-98a317e6ddad req-0a24584e-0a92-4edc-a68a-5c70046e67c2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072563 Oct 17 14:15:33.548412 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2943/5754] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:15:34.267775 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ef25eb93-b489-46d4-b609-58beab06fb72 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:15:34.269253 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ef25eb93-b489-46d4-b609-58beab06fb72 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] [instance: bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:15:34.277489 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ef25eb93-b489-46d4-b609-58beab06fb72 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:34.279857 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ef25eb93-b489-46d4-b609-58beab06fb72 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:34.280540 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ef25eb93-b489-46d4-b609-58beab06fb72 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:34.281720 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ef25eb93-b489-46d4-b609-58beab06fb72 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:34.282521 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ef25eb93-b489-46d4-b609-58beab06fb72 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:34.283376 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ef25eb93-b489-46d4-b609-58beab06fb72 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:34.654513 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ef25eb93-b489-46d4-b609-58beab06fb72 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec3f9e6cb241549395b6375b43b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b981af0923d41809255f04ce299062f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:15:34.666209 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ef25eb93-b489-46d4-b609-58beab06fb72 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] 10.222.0.79 "GET /compute/v2.1/servers/bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4" status: 200 len: 1372 microversion: 2.1 time: 0.403183 Oct 17 14:15:34.667456 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2812/5755] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:15:34 2022] GET /compute/v2.1/servers/bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4 => generated 1372 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:15:35.689652 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ced1d9a5-ac84-40bc-870b-b91123a31570 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:15:35.691108 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ced1d9a5-ac84-40bc-870b-b91123a31570 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] [instance: bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:15:35.703990 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ced1d9a5-ac84-40bc-870b-b91123a31570 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:35.708035 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ced1d9a5-ac84-40bc-870b-b91123a31570 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:35.708841 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ced1d9a5-ac84-40bc-870b-b91123a31570 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:35.730272 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ced1d9a5-ac84-40bc-870b-b91123a31570 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:35.731037 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ced1d9a5-ac84-40bc-870b-b91123a31570 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:35.734877 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ced1d9a5-ac84-40bc-870b-b91123a31570 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:36.170490 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ced1d9a5-ac84-40bc-870b-b91123a31570 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec3f9e6cb241549395b6375b43b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b981af0923d41809255f04ce299062f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:15:36.185803 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ced1d9a5-ac84-40bc-870b-b91123a31570 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] 10.222.0.79 "GET /compute/v2.1/servers/bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4" status: 200 len: 1372 microversion: 2.1 time: 0.499370 Oct 17 14:15:36.186423 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2944/5756] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:15:35 2022] GET /compute/v2.1/servers/bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4 => generated 1372 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:15:37.216118 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e47578d9-2420-4ed5-a1d4-62d5d618e8ce tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:15:37.216896 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e47578d9-2420-4ed5-a1d4-62d5d618e8ce tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] [instance: bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:15:37.236705 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e47578d9-2420-4ed5-a1d4-62d5d618e8ce tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:37.238105 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e47578d9-2420-4ed5-a1d4-62d5d618e8ce tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:37.239610 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e47578d9-2420-4ed5-a1d4-62d5d618e8ce tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:37.242309 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e47578d9-2420-4ed5-a1d4-62d5d618e8ce tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:37.243602 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e47578d9-2420-4ed5-a1d4-62d5d618e8ce tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:37.244893 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e47578d9-2420-4ed5-a1d4-62d5d618e8ce tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:37.582745 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e47578d9-2420-4ed5-a1d4-62d5d618e8ce tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec3f9e6cb241549395b6375b43b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b981af0923d41809255f04ce299062f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:15:37.592467 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e47578d9-2420-4ed5-a1d4-62d5d618e8ce tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] 10.222.0.79 "GET /compute/v2.1/servers/bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4" status: 200 len: 1372 microversion: 2.1 time: 0.383483 Oct 17 14:15:37.593052 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2813/5757] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:15:37 2022] GET /compute/v2.1/servers/bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4 => generated 1372 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:15:37.811638 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8e5b877f-10aa-4a05-8825-49d3035b7a00 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1688728216", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "79b4ee00-4fac-4264-95fe-8810a72b8e80"}], "key_name": "tempest-TestNetworkAdvancedServerOps-107352835", "security_groups": [{"name": "tempest-secgroup-smoke-1722040788"}]}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:15:37.973722 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-8e5b877f-10aa-4a05-8825-49d3035b7a00 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] validate_networks() for [('79b4ee00-4fac-4264-95fe-8810a72b8e80', None, None, None, None, None)] {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:15:38.436643 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-8e5b877f-10aa-4a05-8825-49d3035b7a00 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:15:38.437062 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-8e5b877f-10aa-4a05-8825-49d3035b7a00 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:15:38.437524 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-8e5b877f-10aa-4a05-8825-49d3035b7a00 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:15:38.438103 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-8e5b877f-10aa-4a05-8825-49d3035b7a00 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:15:38.438869 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-8e5b877f-10aa-4a05-8825-49d3035b7a00 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:15:38.449897 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8e5b877f-10aa-4a05-8825-49d3035b7a00 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:38.450596 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8e5b877f-10aa-4a05-8825-49d3035b7a00 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:38.451379 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8e5b877f-10aa-4a05-8825-49d3035b7a00 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:38.452300 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8e5b877f-10aa-4a05-8825-49d3035b7a00 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:38.452917 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8e5b877f-10aa-4a05-8825-49d3035b7a00 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:38.453598 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8e5b877f-10aa-4a05-8825-49d3035b7a00 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:38.474520 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-8e5b877f-10aa-4a05-8825-49d3035b7a00 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Getting quotas for project b8c8fe6f805f43798c9910296df4b8ab. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:15:38.480460 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-8e5b877f-10aa-4a05-8825-49d3035b7a00 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Getting quotas for user 024275cf6f8d423992e61d92dea927ba and project b8c8fe6f805f43798c9910296df4b8ab. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:15:38.495864 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8e5b877f-10aa-4a05-8825-49d3035b7a00 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:15:38.498225 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8e5b877f-10aa-4a05-8825-49d3035b7a00 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 23cb6fcb-f328-4fe2-b890-4b33bad2c78a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:15:38.548826 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8e5b877f-10aa-4a05-8825-49d3035b7a00 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.741522 Oct 17 14:15:38.549784 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2945/5758] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 14:15:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:15:38.565747 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4621a2e1-cde5-4d1c-849a-dc21cc9e9579 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:15:38.567147 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4621a2e1-cde5-4d1c-849a-dc21cc9e9579 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 23cb6fcb-f328-4fe2-b890-4b33bad2c78a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:15:38.628598 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-54c2ac26-6372-4062-beb5-094fe0eab089 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:15:38.628981 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-54c2ac26-6372-4062-beb5-094fe0eab089 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] [instance: bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:15:38.641061 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4621a2e1-cde5-4d1c-849a-dc21cc9e9579 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:15:38.648757 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4621a2e1-cde5-4d1c-849a-dc21cc9e9579 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a" status: 200 len: 1266 microversion: 2.1 time: 0.090612 Oct 17 14:15:38.649472 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-54c2ac26-6372-4062-beb5-094fe0eab089 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:38.649970 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-54c2ac26-6372-4062-beb5-094fe0eab089 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:38.650624 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-54c2ac26-6372-4062-beb5-094fe0eab089 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:38.650758 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2814/5759] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:15:38 2022] GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:15:38.651955 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-54c2ac26-6372-4062-beb5-094fe0eab089 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:38.652593 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-54c2ac26-6372-4062-beb5-094fe0eab089 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:38.653024 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-54c2ac26-6372-4062-beb5-094fe0eab089 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:38.848376 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-54c2ac26-6372-4062-beb5-094fe0eab089 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec3f9e6cb241549395b6375b43b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b981af0923d41809255f04ce299062f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:15:38.858150 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-54c2ac26-6372-4062-beb5-094fe0eab089 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] 10.222.0.79 "GET /compute/v2.1/servers/bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4" status: 200 len: 1372 microversion: 2.1 time: 0.242846 Oct 17 14:15:38.872635 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2946/5760] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:15:38 2022] GET /compute/v2.1/servers/bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4 => generated 1372 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:15:39.383970 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:15:39.484219 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-19ca5a30-fa0d-4040-93a8-05f71af9aaf6 req-cbf7f828-f05f-47a9-bb9e-54ebf823c468 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4", "name": "network-vif-plugged", "status": "completed", "tag": "d4dbf868-d7f2-4cba-a29f-09c069c518b6"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:15:39.501616 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-19ca5a30-fa0d-4040-93a8-05f71af9aaf6 req-cbf7f828-f05f-47a9-bb9e-54ebf823c468 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:39.502280 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-19ca5a30-fa0d-4040-93a8-05f71af9aaf6 req-cbf7f828-f05f-47a9-bb9e-54ebf823c468 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:39.502790 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-19ca5a30-fa0d-4040-93a8-05f71af9aaf6 req-cbf7f828-f05f-47a9-bb9e-54ebf823c468 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:39.519444 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-19ca5a30-fa0d-4040-93a8-05f71af9aaf6 req-cbf7f828-f05f-47a9-bb9e-54ebf823c468 service nova] Creating event network-vif-plugged:d4dbf868-d7f2-4cba-a29f-09c069c518b6 for instance bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4 on n-h1-854247-14 Oct 17 14:15:39.525191 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-19ca5a30-fa0d-4040-93a8-05f71af9aaf6 req-cbf7f828-f05f-47a9-bb9e-54ebf823c468 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145847 Oct 17 14:15:39.525804 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2815/5761] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:15:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:15:39.684320 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e326a1d8-2b32-43f4-b3f2-2e1b9451bff9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:15:39.685362 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e326a1d8-2b32-43f4-b3f2-2e1b9451bff9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 23cb6fcb-f328-4fe2-b890-4b33bad2c78a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:15:39.699296 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e326a1d8-2b32-43f4-b3f2-2e1b9451bff9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:39.699925 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e326a1d8-2b32-43f4-b3f2-2e1b9451bff9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:39.701531 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e326a1d8-2b32-43f4-b3f2-2e1b9451bff9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:39.705813 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e326a1d8-2b32-43f4-b3f2-2e1b9451bff9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:39.707353 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e326a1d8-2b32-43f4-b3f2-2e1b9451bff9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:39.708004 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e326a1d8-2b32-43f4-b3f2-2e1b9451bff9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:39.807369 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e326a1d8-2b32-43f4-b3f2-2e1b9451bff9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:15:39.817269 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e326a1d8-2b32-43f4-b3f2-2e1b9451bff9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a" status: 200 len: 1318 microversion: 2.1 time: 0.137128 Oct 17 14:15:39.818352 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2947/5762] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:15:39 2022] GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a => generated 1318 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:15:39.886409 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e33c1455-120e-4e2a-8353-444e80148f8d tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:15:39.887241 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e33c1455-120e-4e2a-8353-444e80148f8d tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] [instance: bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:15:39.907037 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e33c1455-120e-4e2a-8353-444e80148f8d tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:39.907922 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e33c1455-120e-4e2a-8353-444e80148f8d tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:39.908530 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e33c1455-120e-4e2a-8353-444e80148f8d tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:39.909901 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e33c1455-120e-4e2a-8353-444e80148f8d tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:39.910959 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e33c1455-120e-4e2a-8353-444e80148f8d tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:39.911736 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e33c1455-120e-4e2a-8353-444e80148f8d tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:40.178138 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e33c1455-120e-4e2a-8353-444e80148f8d tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec3f9e6cb241549395b6375b43b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b981af0923d41809255f04ce299062f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:15:40.191415 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e33c1455-120e-4e2a-8353-444e80148f8d tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] 10.222.0.79 "GET /compute/v2.1/servers/bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4" status: 200 len: 1372 microversion: 2.1 time: 0.306831 Oct 17 14:15:40.192376 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2816/5763] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:15:39 2022] GET /compute/v2.1/servers/bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4 => generated 1372 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:15:40.846187 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2a1ac1e6-a816-4a2b-b761-13fbe03142c9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:15:40.847728 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2a1ac1e6-a816-4a2b-b761-13fbe03142c9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 23cb6fcb-f328-4fe2-b890-4b33bad2c78a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:15:40.855831 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2a1ac1e6-a816-4a2b-b761-13fbe03142c9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:40.856786 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2a1ac1e6-a816-4a2b-b761-13fbe03142c9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:40.857635 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2a1ac1e6-a816-4a2b-b761-13fbe03142c9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:40.860098 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2a1ac1e6-a816-4a2b-b761-13fbe03142c9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:40.861593 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2a1ac1e6-a816-4a2b-b761-13fbe03142c9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:40.862007 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2a1ac1e6-a816-4a2b-b761-13fbe03142c9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:41.099859 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2a1ac1e6-a816-4a2b-b761-13fbe03142c9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:15:41.109618 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2a1ac1e6-a816-4a2b-b761-13fbe03142c9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a" status: 200 len: 1392 microversion: 2.1 time: 0.269055 Oct 17 14:15:41.130286 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2948/5764] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:15:40 2022] GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a => generated 1392 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:15:41.221342 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c23ea24a-e362-4d63-9749-111ca7eea013 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:15:41.222857 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c23ea24a-e362-4d63-9749-111ca7eea013 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] [instance: bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:15:41.231123 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c23ea24a-e362-4d63-9749-111ca7eea013 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:41.231967 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c23ea24a-e362-4d63-9749-111ca7eea013 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:41.232680 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c23ea24a-e362-4d63-9749-111ca7eea013 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:41.233518 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c23ea24a-e362-4d63-9749-111ca7eea013 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:41.234279 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c23ea24a-e362-4d63-9749-111ca7eea013 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:41.234933 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c23ea24a-e362-4d63-9749-111ca7eea013 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:41.505313 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c23ea24a-e362-4d63-9749-111ca7eea013 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec3f9e6cb241549395b6375b43b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b981af0923d41809255f04ce299062f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:15:41.513753 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c23ea24a-e362-4d63-9749-111ca7eea013 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] 10.222.0.79 "GET /compute/v2.1/servers/bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4" status: 200 len: 1543 microversion: 2.1 time: 0.297248 Oct 17 14:15:41.527724 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2817/5765] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:15:41 2022] GET /compute/v2.1/servers/bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4 => generated 1543 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:15:41.537634 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c2bac684-50af-4d9e-8ca7-b3bb0efd55ab tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:15:41.538556 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c2bac684-50af-4d9e-8ca7-b3bb0efd55ab tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] [instance: bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:15:41.545258 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c2bac684-50af-4d9e-8ca7-b3bb0efd55ab tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:41.546018 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c2bac684-50af-4d9e-8ca7-b3bb0efd55ab tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:41.547181 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c2bac684-50af-4d9e-8ca7-b3bb0efd55ab tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:41.548541 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c2bac684-50af-4d9e-8ca7-b3bb0efd55ab tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:41.550012 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c2bac684-50af-4d9e-8ca7-b3bb0efd55ab tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:41.550633 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c2bac684-50af-4d9e-8ca7-b3bb0efd55ab tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:41.809584 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c2bac684-50af-4d9e-8ca7-b3bb0efd55ab tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec3f9e6cb241549395b6375b43b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b981af0923d41809255f04ce299062f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:15:41.819609 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c2bac684-50af-4d9e-8ca7-b3bb0efd55ab tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] 10.222.0.79 "GET /compute/v2.1/servers/bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4" status: 200 len: 1543 microversion: 2.1 time: 0.286000 Oct 17 14:15:41.820740 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2949/5766] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:15:41 2022] GET /compute/v2.1/servers/bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4 => generated 1543 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:15:42.136155 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-98bf58cb-900b-4f7b-b17b-3c7b2292ac40 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:15:42.137002 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-98bf58cb-900b-4f7b-b17b-3c7b2292ac40 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 23cb6fcb-f328-4fe2-b890-4b33bad2c78a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:15:42.144307 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-98bf58cb-900b-4f7b-b17b-3c7b2292ac40 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:42.145097 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-98bf58cb-900b-4f7b-b17b-3c7b2292ac40 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:42.146164 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-98bf58cb-900b-4f7b-b17b-3c7b2292ac40 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:42.147095 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-98bf58cb-900b-4f7b-b17b-3c7b2292ac40 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:42.147914 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-98bf58cb-900b-4f7b-b17b-3c7b2292ac40 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:42.148600 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-98bf58cb-900b-4f7b-b17b-3c7b2292ac40 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:42.489006 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-bb637380-164f-4fea-887b-092780135057 req-b99f42a8-7a5d-4130-9abf-a6918c84e888 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23cb6fcb-f328-4fe2-b890-4b33bad2c78a", "tag": "84607819-b683-4572-99ca-fc1431266e3d"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:15:42.501105 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-bb637380-164f-4fea-887b-092780135057 req-b99f42a8-7a5d-4130-9abf-a6918c84e888 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:42.504394 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-bb637380-164f-4fea-887b-092780135057 req-b99f42a8-7a5d-4130-9abf-a6918c84e888 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:42.506878 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-bb637380-164f-4fea-887b-092780135057 req-b99f42a8-7a5d-4130-9abf-a6918c84e888 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:42.526936 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-bb637380-164f-4fea-887b-092780135057 req-b99f42a8-7a5d-4130-9abf-a6918c84e888 service nova] Creating event network-changed:84607819-b683-4572-99ca-fc1431266e3d for instance 23cb6fcb-f328-4fe2-b890-4b33bad2c78a on n-h2-854247-14 Oct 17 14:15:42.534462 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-98bf58cb-900b-4f7b-b17b-3c7b2292ac40 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:15:42.542735 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-98bf58cb-900b-4f7b-b17b-3c7b2292ac40 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a" status: 200 len: 1392 microversion: 2.1 time: 0.412570 Oct 17 14:15:42.558502 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2818/5767] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:15:42 2022] GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a => generated 1392 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:15:42.559193 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-bb637380-164f-4fea-887b-092780135057 req-b99f42a8-7a5d-4130-9abf-a6918c84e888 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.217104 Oct 17 14:15:42.559193 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2950/5768] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:15:43.566384 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-84e5989c-01a6-4bcb-b2af-778886c831f9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:15:43.567004 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-84e5989c-01a6-4bcb-b2af-778886c831f9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 23cb6fcb-f328-4fe2-b890-4b33bad2c78a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:15:43.574291 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-84e5989c-01a6-4bcb-b2af-778886c831f9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:43.574980 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-84e5989c-01a6-4bcb-b2af-778886c831f9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:43.576488 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-84e5989c-01a6-4bcb-b2af-778886c831f9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:43.578156 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-84e5989c-01a6-4bcb-b2af-778886c831f9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:43.579723 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-84e5989c-01a6-4bcb-b2af-778886c831f9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:43.580162 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-84e5989c-01a6-4bcb-b2af-778886c831f9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:43.848353 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-84e5989c-01a6-4bcb-b2af-778886c831f9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:15:43.858122 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-84e5989c-01a6-4bcb-b2af-778886c831f9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a" status: 200 len: 1392 microversion: 2.1 time: 0.295621 Oct 17 14:15:43.858728 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2819/5769] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:15:43 2022] GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a => generated 1392 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:15:44.106627 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-e9be744b-6f11-4fea-80a1-20f03b10f306 req-238c6e43-037b-4476-91b8-9bb00f6ea152 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4", "tag": "d4dbf868-d7f2-4cba-a29f-09c069c518b6"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:15:44.131465 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-e9be744b-6f11-4fea-80a1-20f03b10f306 req-238c6e43-037b-4476-91b8-9bb00f6ea152 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:44.132065 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-e9be744b-6f11-4fea-80a1-20f03b10f306 req-238c6e43-037b-4476-91b8-9bb00f6ea152 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:44.132505 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-e9be744b-6f11-4fea-80a1-20f03b10f306 req-238c6e43-037b-4476-91b8-9bb00f6ea152 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:44.161599 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-e9be744b-6f11-4fea-80a1-20f03b10f306 req-238c6e43-037b-4476-91b8-9bb00f6ea152 service nova] Creating event network-changed:d4dbf868-d7f2-4cba-a29f-09c069c518b6 for instance bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4 on n-h1-854247-14 Oct 17 14:15:44.163740 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-e9be744b-6f11-4fea-80a1-20f03b10f306 req-238c6e43-037b-4476-91b8-9bb00f6ea152 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061137 Oct 17 14:15:44.164639 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2951/5770] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:15:44.881298 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ca348d48-52f0-4550-9a41-666e265b7a4f tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:15:44.882466 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ca348d48-52f0-4550-9a41-666e265b7a4f tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 23cb6fcb-f328-4fe2-b890-4b33bad2c78a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:15:44.892065 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ca348d48-52f0-4550-9a41-666e265b7a4f tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:44.892793 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ca348d48-52f0-4550-9a41-666e265b7a4f tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:44.893546 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ca348d48-52f0-4550-9a41-666e265b7a4f tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:44.894747 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ca348d48-52f0-4550-9a41-666e265b7a4f tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:44.895704 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ca348d48-52f0-4550-9a41-666e265b7a4f tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:44.896297 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ca348d48-52f0-4550-9a41-666e265b7a4f tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:45.045149 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ca348d48-52f0-4550-9a41-666e265b7a4f tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:15:45.054872 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ca348d48-52f0-4550-9a41-666e265b7a4f tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a" status: 200 len: 1392 microversion: 2.1 time: 0.177499 Oct 17 14:15:45.055894 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2820/5771] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:15:44 2022] GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a => generated 1392 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:15:46.078806 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9ecc8ac7-5e13-4d4e-ad83-119fe94a1f61 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:15:46.080146 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9ecc8ac7-5e13-4d4e-ad83-119fe94a1f61 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 23cb6fcb-f328-4fe2-b890-4b33bad2c78a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:15:46.087806 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9ecc8ac7-5e13-4d4e-ad83-119fe94a1f61 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:46.088302 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9ecc8ac7-5e13-4d4e-ad83-119fe94a1f61 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:46.088739 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9ecc8ac7-5e13-4d4e-ad83-119fe94a1f61 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:46.089448 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9ecc8ac7-5e13-4d4e-ad83-119fe94a1f61 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:46.089903 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9ecc8ac7-5e13-4d4e-ad83-119fe94a1f61 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:46.090323 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9ecc8ac7-5e13-4d4e-ad83-119fe94a1f61 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:46.228992 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9ecc8ac7-5e13-4d4e-ad83-119fe94a1f61 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:15:46.237760 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9ecc8ac7-5e13-4d4e-ad83-119fe94a1f61 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a" status: 200 len: 1392 microversion: 2.1 time: 0.163303 Oct 17 14:15:46.238361 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2952/5772] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:15:46 2022] GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:15:47.262392 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1641004b-3688-47bd-afec-57741bf696fa tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:15:47.263303 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1641004b-3688-47bd-afec-57741bf696fa tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 23cb6fcb-f328-4fe2-b890-4b33bad2c78a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:15:47.287093 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1641004b-3688-47bd-afec-57741bf696fa tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:47.287631 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1641004b-3688-47bd-afec-57741bf696fa tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:47.288107 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1641004b-3688-47bd-afec-57741bf696fa tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:47.288824 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1641004b-3688-47bd-afec-57741bf696fa tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:47.289278 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1641004b-3688-47bd-afec-57741bf696fa tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:47.289858 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1641004b-3688-47bd-afec-57741bf696fa tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:47.393456 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-2aac22d0-cbdf-4967-922f-4f1ac85f1b70 req-a85d8681-7761-4ff4-9bfb-0abef271f769 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23cb6fcb-f328-4fe2-b890-4b33bad2c78a", "name": "network-vif-plugged", "status": "completed", "tag": "84607819-b683-4572-99ca-fc1431266e3d"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:15:47.412782 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-2aac22d0-cbdf-4967-922f-4f1ac85f1b70 req-a85d8681-7761-4ff4-9bfb-0abef271f769 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:47.413391 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-2aac22d0-cbdf-4967-922f-4f1ac85f1b70 req-a85d8681-7761-4ff4-9bfb-0abef271f769 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:47.413997 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-2aac22d0-cbdf-4967-922f-4f1ac85f1b70 req-a85d8681-7761-4ff4-9bfb-0abef271f769 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:47.429580 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-2aac22d0-cbdf-4967-922f-4f1ac85f1b70 req-a85d8681-7761-4ff4-9bfb-0abef271f769 service nova] Creating event network-vif-plugged:84607819-b683-4572-99ca-fc1431266e3d for instance 23cb6fcb-f328-4fe2-b890-4b33bad2c78a on n-h2-854247-14 Oct 17 14:15:47.436179 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-2aac22d0-cbdf-4967-922f-4f1ac85f1b70 req-a85d8681-7761-4ff4-9bfb-0abef271f769 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058293 Oct 17 14:15:47.437598 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2953/5773] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:15:47.493163 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1641004b-3688-47bd-afec-57741bf696fa tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:15:47.502085 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1641004b-3688-47bd-afec-57741bf696fa tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a" status: 200 len: 1392 microversion: 2.1 time: 0.243980 Oct 17 14:15:47.503574 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2821/5774] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:15:47 2022] GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a => generated 1392 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:15:48.526261 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-767e810e-2f59-429c-bc9d-14e80ed5c5bc tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:15:48.526895 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-767e810e-2f59-429c-bc9d-14e80ed5c5bc tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 23cb6fcb-f328-4fe2-b890-4b33bad2c78a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:15:48.530066 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:15:48.530751 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=16 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:15:48.537749 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-767e810e-2f59-429c-bc9d-14e80ed5c5bc tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:48.538254 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-767e810e-2f59-429c-bc9d-14e80ed5c5bc tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:48.538678 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-767e810e-2f59-429c-bc9d-14e80ed5c5bc tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:48.539415 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-767e810e-2f59-429c-bc9d-14e80ed5c5bc tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:48.539875 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-767e810e-2f59-429c-bc9d-14e80ed5c5bc tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:48.540368 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-767e810e-2f59-429c-bc9d-14e80ed5c5bc tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:48.696704 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-767e810e-2f59-429c-bc9d-14e80ed5c5bc tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:15:48.705163 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-767e810e-2f59-429c-bc9d-14e80ed5c5bc tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a" status: 200 len: 1392 microversion: 2.1 time: 0.183276 Oct 17 14:15:48.705759 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2954/5775] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:15:48 2022] GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a => generated 1392 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:15:49.729954 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-40b8295e-26e7-48dd-a70e-6dc39641b267 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:15:49.730671 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-40b8295e-26e7-48dd-a70e-6dc39641b267 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 23cb6fcb-f328-4fe2-b890-4b33bad2c78a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:15:49.733661 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=8 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:15:49.740656 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-40b8295e-26e7-48dd-a70e-6dc39641b267 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:49.740912 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-40b8295e-26e7-48dd-a70e-6dc39641b267 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:49.741344 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-40b8295e-26e7-48dd-a70e-6dc39641b267 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:49.742071 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-40b8295e-26e7-48dd-a70e-6dc39641b267 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:49.742514 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-40b8295e-26e7-48dd-a70e-6dc39641b267 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:49.742913 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-40b8295e-26e7-48dd-a70e-6dc39641b267 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:49.903803 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-40b8295e-26e7-48dd-a70e-6dc39641b267 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:15:49.913786 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-40b8295e-26e7-48dd-a70e-6dc39641b267 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a" status: 200 len: 1563 microversion: 2.1 time: 0.187821 Oct 17 14:15:49.914704 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2822/5776] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:15:49 2022] GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a => generated 1563 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:15:49.942911 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-52595580-7e02-4fa2-a35a-480eb39b5395 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:15:49.943591 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-52595580-7e02-4fa2-a35a-480eb39b5395 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 23cb6fcb-f328-4fe2-b890-4b33bad2c78a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:15:49.950021 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-52595580-7e02-4fa2-a35a-480eb39b5395 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:49.950597 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-52595580-7e02-4fa2-a35a-480eb39b5395 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:49.951036 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-52595580-7e02-4fa2-a35a-480eb39b5395 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:49.951733 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-52595580-7e02-4fa2-a35a-480eb39b5395 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:49.952188 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-52595580-7e02-4fa2-a35a-480eb39b5395 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:49.952612 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-52595580-7e02-4fa2-a35a-480eb39b5395 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:50.120816 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-52595580-7e02-4fa2-a35a-480eb39b5395 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:15:50.129769 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-52595580-7e02-4fa2-a35a-480eb39b5395 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a" status: 200 len: 1563 microversion: 2.1 time: 0.192394 Oct 17 14:15:50.130729 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2955/5777] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:15:49 2022] GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a => generated 1563 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:15:51.885361 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8239ef0b-9a45-4fc1-b62c-c890262361e2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:15:51.885976 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8239ef0b-9a45-4fc1-b62c-c890262361e2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 23cb6fcb-f328-4fe2-b890-4b33bad2c78a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:15:51.889199 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-6e330bb7-f0f4-4cb8-b463-2a5adae8a6ac req-56eb71b1-3a88-4855-b3e7-0decd5db54c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23cb6fcb-f328-4fe2-b890-4b33bad2c78a", "tag": "84607819-b683-4572-99ca-fc1431266e3d"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:15:51.894286 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8239ef0b-9a45-4fc1-b62c-c890262361e2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:51.895080 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8239ef0b-9a45-4fc1-b62c-c890262361e2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:51.895759 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8239ef0b-9a45-4fc1-b62c-c890262361e2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:51.897132 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8239ef0b-9a45-4fc1-b62c-c890262361e2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:51.897803 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8239ef0b-9a45-4fc1-b62c-c890262361e2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:51.898437 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8239ef0b-9a45-4fc1-b62c-c890262361e2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:51.900349 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-6e330bb7-f0f4-4cb8-b463-2a5adae8a6ac req-56eb71b1-3a88-4855-b3e7-0decd5db54c8 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:51.900823 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-6e330bb7-f0f4-4cb8-b463-2a5adae8a6ac req-56eb71b1-3a88-4855-b3e7-0decd5db54c8 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:51.901245 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-6e330bb7-f0f4-4cb8-b463-2a5adae8a6ac req-56eb71b1-3a88-4855-b3e7-0decd5db54c8 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:51.918020 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-6e330bb7-f0f4-4cb8-b463-2a5adae8a6ac req-56eb71b1-3a88-4855-b3e7-0decd5db54c8 service nova] Creating event network-changed:84607819-b683-4572-99ca-fc1431266e3d for instance 23cb6fcb-f328-4fe2-b890-4b33bad2c78a on n-h2-854247-14 Oct 17 14:15:51.924343 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-6e330bb7-f0f4-4cb8-b463-2a5adae8a6ac req-56eb71b1-3a88-4855-b3e7-0decd5db54c8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038528 Oct 17 14:15:51.925356 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2956/5778] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:15:52.154732 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8239ef0b-9a45-4fc1-b62c-c890262361e2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:15:52.170093 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8239ef0b-9a45-4fc1-b62c-c890262361e2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a" status: 200 len: 1563 microversion: 2.1 time: 0.288370 Oct 17 14:15:52.184030 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2823/5779] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:15:51 2022] GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a => generated 1563 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:15:54.331488 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c1123925-0f1d-487a-900a-955775791757 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Action: 'create', calling method: .version_select at 0x7f7cd44848b0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-71525874", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+b61Wwze6fiKys0cIKgfkUEo3EM1NM2I2ewcOBgeqIEbFCKRVqO9YtDZ7l7h/qeIWAQEJwSDd39M19DjfNJorj9UixWH+2SPE91fV761OCa8ODpsIaoL6gWoklau5B2g=="}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:15:54.348504 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-c1123925-0f1d-487a-900a-955775791757 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Getting quotas for project 4eecf5c8d73944dabf3a0e0f64123745. Resources: {'key_pairs'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:15:54.354700 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-c1123925-0f1d-487a-900a-955775791757 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Getting quotas for user 880bf3983987453ba9c29d8b73159e53 and project 4eecf5c8d73944dabf3a0e0f64123745. Resources: {'key_pairs'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:15:54.382999 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c1123925-0f1d-487a-900a-955775791757 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.056886 Oct 17 14:15:54.383869 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2957/5780] 10.222.0.79 () {60 vars in 1159 bytes} [Mon Oct 17 14:15:54 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:15:55.462901 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-397f9ad7-bfaa-4ed2-9d84-4c7bb37a94b9 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-928447490", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "7dd7b061-9de4-486b-af67-3425ea69a967", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-71525874", "security_groups": [{"name": "tempest-secgroup-smoke-828582556"}], "networks": [{"uuid": "6eefa77f-2edf-4b2b-93ea-5fe787c44fe4"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:15:55.601476 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-397f9ad7-bfaa-4ed2-9d84-4c7bb37a94b9 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] validate_networks() for [('6eefa77f-2edf-4b2b-93ea-5fe787c44fe4', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:15:55.991954 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-397f9ad7-bfaa-4ed2-9d84-4c7bb37a94b9 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:15:55.992401 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-397f9ad7-bfaa-4ed2-9d84-4c7bb37a94b9 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:15:55.992860 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-397f9ad7-bfaa-4ed2-9d84-4c7bb37a94b9 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:15:55.993305 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-397f9ad7-bfaa-4ed2-9d84-4c7bb37a94b9 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:15:55.993715 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-397f9ad7-bfaa-4ed2-9d84-4c7bb37a94b9 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:15:56.003782 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-397f9ad7-bfaa-4ed2-9d84-4c7bb37a94b9 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:56.004272 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-397f9ad7-bfaa-4ed2-9d84-4c7bb37a94b9 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:56.004712 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-397f9ad7-bfaa-4ed2-9d84-4c7bb37a94b9 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:56.005432 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-397f9ad7-bfaa-4ed2-9d84-4c7bb37a94b9 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:56.005887 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-397f9ad7-bfaa-4ed2-9d84-4c7bb37a94b9 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:56.006312 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-397f9ad7-bfaa-4ed2-9d84-4c7bb37a94b9 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:56.024316 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-397f9ad7-bfaa-4ed2-9d84-4c7bb37a94b9 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Getting quotas for project 4eecf5c8d73944dabf3a0e0f64123745. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:15:56.029688 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-397f9ad7-bfaa-4ed2-9d84-4c7bb37a94b9 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Getting quotas for user 880bf3983987453ba9c29d8b73159e53 and project 4eecf5c8d73944dabf3a0e0f64123745. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:15:56.090024 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-397f9ad7-bfaa-4ed2-9d84-4c7bb37a94b9 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:15:56.092253 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-397f9ad7-bfaa-4ed2-9d84-4c7bb37a94b9 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] [instance: a05629df-accf-4f2f-9d9d-d7602cf69fd4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7dd7b061-9de4-486b-af67-3425ea69a967',volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:15:56.239879 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-397f9ad7-bfaa-4ed2-9d84-4c7bb37a94b9 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.781065 Oct 17 14:15:56.240539 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2824/5781] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 14:15:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:15:56.252854 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fb739103-b43e-4fce-b766-b41bf8e66a0c tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:15:56.253597 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-fb739103-b43e-4fce-b766-b41bf8e66a0c tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] [instance: a05629df-accf-4f2f-9d9d-d7602cf69fd4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:15:56.312036 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fb739103-b43e-4fce-b766-b41bf8e66a0c tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880bf3983987453ba9c29d8b73159e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eecf5c8d73944dabf3a0e0f64123745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:15:56.320259 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fb739103-b43e-4fce-b766-b41bf8e66a0c tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] 10.222.0.79 "GET /compute/v2.1/servers/a05629df-accf-4f2f-9d9d-d7602cf69fd4" status: 200 len: 1096 microversion: 2.1 time: 0.072303 Oct 17 14:15:56.320935 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2958/5782] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:15:56 2022] GET /compute/v2.1/servers/a05629df-accf-4f2f-9d9d-d7602cf69fd4 => generated 1096 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:15:57.345083 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1ae4e925-cf08-4ca7-aeb7-e3d465de3fe7 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:15:57.346514 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1ae4e925-cf08-4ca7-aeb7-e3d465de3fe7 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] [instance: a05629df-accf-4f2f-9d9d-d7602cf69fd4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:15:57.356966 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1ae4e925-cf08-4ca7-aeb7-e3d465de3fe7 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:57.357613 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1ae4e925-cf08-4ca7-aeb7-e3d465de3fe7 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:57.358181 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1ae4e925-cf08-4ca7-aeb7-e3d465de3fe7 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:57.358980 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1ae4e925-cf08-4ca7-aeb7-e3d465de3fe7 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:57.359548 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1ae4e925-cf08-4ca7-aeb7-e3d465de3fe7 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:57.360164 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1ae4e925-cf08-4ca7-aeb7-e3d465de3fe7 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:57.448340 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1ae4e925-cf08-4ca7-aeb7-e3d465de3fe7 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880bf3983987453ba9c29d8b73159e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eecf5c8d73944dabf3a0e0f64123745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:15:57.456975 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1ae4e925-cf08-4ca7-aeb7-e3d465de3fe7 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] 10.222.0.79 "GET /compute/v2.1/servers/a05629df-accf-4f2f-9d9d-d7602cf69fd4" status: 200 len: 1202 microversion: 2.1 time: 0.116733 Oct 17 14:15:57.457711 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2825/5783] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:15:57 2022] GET /compute/v2.1/servers/a05629df-accf-4f2f-9d9d-d7602cf69fd4 => generated 1202 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:15:58.482098 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f14800fa-60e0-4bb8-9618-29a1a4ddd83d tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:15:58.483362 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f14800fa-60e0-4bb8-9618-29a1a4ddd83d tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] [instance: a05629df-accf-4f2f-9d9d-d7602cf69fd4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:15:58.489362 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:15:58.491700 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f14800fa-60e0-4bb8-9618-29a1a4ddd83d tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:58.492404 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f14800fa-60e0-4bb8-9618-29a1a4ddd83d tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:58.493214 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f14800fa-60e0-4bb8-9618-29a1a4ddd83d tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:58.494112 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f14800fa-60e0-4bb8-9618-29a1a4ddd83d tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:58.494736 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f14800fa-60e0-4bb8-9618-29a1a4ddd83d tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:58.495397 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f14800fa-60e0-4bb8-9618-29a1a4ddd83d tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:58.501159 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=67 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:15:58.765937 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f14800fa-60e0-4bb8-9618-29a1a4ddd83d tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880bf3983987453ba9c29d8b73159e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eecf5c8d73944dabf3a0e0f64123745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:15:58.774778 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f14800fa-60e0-4bb8-9618-29a1a4ddd83d tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] 10.222.0.79 "GET /compute/v2.1/servers/a05629df-accf-4f2f-9d9d-d7602cf69fd4" status: 200 len: 1279 microversion: 2.1 time: 0.296819 Oct 17 14:15:58.775392 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2959/5784] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:15:58 2022] GET /compute/v2.1/servers/a05629df-accf-4f2f-9d9d-d7602cf69fd4 => generated 1279 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:15:59.182158 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-dd6533a2-d773-43f0-ad6f-ca1ae9795a55 req-34d38d1c-76bb-4196-8cca-bbcef14033f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a05629df-accf-4f2f-9d9d-d7602cf69fd4", "tag": "bc3c5aa2-8155-4ccb-b05d-983598a72fc7"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:15:59.193478 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=6 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:15:59.195519 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-dd6533a2-d773-43f0-ad6f-ca1ae9795a55 req-34d38d1c-76bb-4196-8cca-bbcef14033f5 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:59.196230 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-dd6533a2-d773-43f0-ad6f-ca1ae9795a55 req-34d38d1c-76bb-4196-8cca-bbcef14033f5 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:59.196778 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-dd6533a2-d773-43f0-ad6f-ca1ae9795a55 req-34d38d1c-76bb-4196-8cca-bbcef14033f5 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:59.208267 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=85 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:15:59.210910 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-dd6533a2-d773-43f0-ad6f-ca1ae9795a55 req-34d38d1c-76bb-4196-8cca-bbcef14033f5 service nova] Creating event network-changed:bc3c5aa2-8155-4ccb-b05d-983598a72fc7 for instance a05629df-accf-4f2f-9d9d-d7602cf69fd4 on n-h2-854247-14 Oct 17 14:15:59.216917 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-dd6533a2-d773-43f0-ad6f-ca1ae9795a55 req-34d38d1c-76bb-4196-8cca-bbcef14033f5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040937 Oct 17 14:15:59.217872 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2826/5785] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:15:59.798256 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-47691e92-082a-4f2f-b24b-99ee20ffda1e tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:15:59.799914 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-47691e92-082a-4f2f-b24b-99ee20ffda1e tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] [instance: a05629df-accf-4f2f-9d9d-d7602cf69fd4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:15:59.807907 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-47691e92-082a-4f2f-b24b-99ee20ffda1e tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:59.808563 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-47691e92-082a-4f2f-b24b-99ee20ffda1e tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:59.809125 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-47691e92-082a-4f2f-b24b-99ee20ffda1e tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:59.810165 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-47691e92-082a-4f2f-b24b-99ee20ffda1e tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:59.810829 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-47691e92-082a-4f2f-b24b-99ee20ffda1e tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:59.811311 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-47691e92-082a-4f2f-b24b-99ee20ffda1e tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:00.306380 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-47691e92-082a-4f2f-b24b-99ee20ffda1e tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880bf3983987453ba9c29d8b73159e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eecf5c8d73944dabf3a0e0f64123745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:00.315466 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-47691e92-082a-4f2f-b24b-99ee20ffda1e tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] 10.222.0.79 "GET /compute/v2.1/servers/a05629df-accf-4f2f-9d9d-d7602cf69fd4" status: 200 len: 1279 microversion: 2.1 time: 0.521059 Oct 17 14:16:00.316140 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2960/5786] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:15:59 2022] GET /compute/v2.1/servers/a05629df-accf-4f2f-9d9d-d7602cf69fd4 => generated 1279 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:16:01.340846 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-01c6d951-3acc-44bf-b2a9-80c75e536eaf tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:01.341730 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-01c6d951-3acc-44bf-b2a9-80c75e536eaf tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] [instance: a05629df-accf-4f2f-9d9d-d7602cf69fd4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:01.349192 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-01c6d951-3acc-44bf-b2a9-80c75e536eaf tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:01.349712 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-01c6d951-3acc-44bf-b2a9-80c75e536eaf tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:01.350152 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-01c6d951-3acc-44bf-b2a9-80c75e536eaf tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:01.350872 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-01c6d951-3acc-44bf-b2a9-80c75e536eaf tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:01.351349 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-01c6d951-3acc-44bf-b2a9-80c75e536eaf tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:01.351933 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-01c6d951-3acc-44bf-b2a9-80c75e536eaf tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:01.500010 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-01c6d951-3acc-44bf-b2a9-80c75e536eaf tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880bf3983987453ba9c29d8b73159e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eecf5c8d73944dabf3a0e0f64123745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:01.508360 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-01c6d951-3acc-44bf-b2a9-80c75e536eaf tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] 10.222.0.79 "GET /compute/v2.1/servers/a05629df-accf-4f2f-9d9d-d7602cf69fd4" status: 200 len: 1279 microversion: 2.1 time: 0.173675 Oct 17 14:16:01.508919 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2827/5787] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:01 2022] GET /compute/v2.1/servers/a05629df-accf-4f2f-9d9d-d7602cf69fd4 => generated 1279 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:16:02.534154 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-27bdad75-bfc4-4072-83a4-bd1fa145019b tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:02.534886 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-27bdad75-bfc4-4072-83a4-bd1fa145019b tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] [instance: a05629df-accf-4f2f-9d9d-d7602cf69fd4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:02.542250 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-27bdad75-bfc4-4072-83a4-bd1fa145019b tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:02.542735 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-27bdad75-bfc4-4072-83a4-bd1fa145019b tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:02.543196 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-27bdad75-bfc4-4072-83a4-bd1fa145019b tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:02.543926 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-27bdad75-bfc4-4072-83a4-bd1fa145019b tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:02.544373 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-27bdad75-bfc4-4072-83a4-bd1fa145019b tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:02.544799 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-27bdad75-bfc4-4072-83a4-bd1fa145019b tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:02.683115 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-27bdad75-bfc4-4072-83a4-bd1fa145019b tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880bf3983987453ba9c29d8b73159e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eecf5c8d73944dabf3a0e0f64123745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:02.691262 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-27bdad75-bfc4-4072-83a4-bd1fa145019b tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] 10.222.0.79 "GET /compute/v2.1/servers/a05629df-accf-4f2f-9d9d-d7602cf69fd4" status: 200 len: 1267 microversion: 2.1 time: 0.162885 Oct 17 14:16:02.691982 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2961/5788] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:02 2022] GET /compute/v2.1/servers/a05629df-accf-4f2f-9d9d-d7602cf69fd4 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:16:03.726671 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-713bc947-336b-46f2-90d1-0bc42d101e4c tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:03.727675 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-713bc947-336b-46f2-90d1-0bc42d101e4c tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] [instance: a05629df-accf-4f2f-9d9d-d7602cf69fd4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:03.739347 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-713bc947-336b-46f2-90d1-0bc42d101e4c tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:03.739757 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-713bc947-336b-46f2-90d1-0bc42d101e4c tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:03.740194 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-713bc947-336b-46f2-90d1-0bc42d101e4c tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:03.740884 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-713bc947-336b-46f2-90d1-0bc42d101e4c tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:03.741336 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-713bc947-336b-46f2-90d1-0bc42d101e4c tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:03.741758 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-713bc947-336b-46f2-90d1-0bc42d101e4c tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:03.880536 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-713bc947-336b-46f2-90d1-0bc42d101e4c tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880bf3983987453ba9c29d8b73159e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eecf5c8d73944dabf3a0e0f64123745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:03.888899 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-713bc947-336b-46f2-90d1-0bc42d101e4c tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] 10.222.0.79 "GET /compute/v2.1/servers/a05629df-accf-4f2f-9d9d-d7602cf69fd4" status: 200 len: 1267 microversion: 2.1 time: 0.169148 Oct 17 14:16:03.889485 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2828/5789] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:03 2022] GET /compute/v2.1/servers/a05629df-accf-4f2f-9d9d-d7602cf69fd4 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:16:04.916762 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-dc454b1d-8f61-43a2-9d6f-1ea78b78fce6 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:04.917359 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-dc454b1d-8f61-43a2-9d6f-1ea78b78fce6 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] [instance: a05629df-accf-4f2f-9d9d-d7602cf69fd4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:04.929268 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc454b1d-8f61-43a2-9d6f-1ea78b78fce6 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:04.930030 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc454b1d-8f61-43a2-9d6f-1ea78b78fce6 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:04.931008 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc454b1d-8f61-43a2-9d6f-1ea78b78fce6 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:04.932252 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc454b1d-8f61-43a2-9d6f-1ea78b78fce6 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:04.933017 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc454b1d-8f61-43a2-9d6f-1ea78b78fce6 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:04.933769 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dc454b1d-8f61-43a2-9d6f-1ea78b78fce6 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:05.072994 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-dc454b1d-8f61-43a2-9d6f-1ea78b78fce6 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880bf3983987453ba9c29d8b73159e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eecf5c8d73944dabf3a0e0f64123745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:05.084938 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-dc454b1d-8f61-43a2-9d6f-1ea78b78fce6 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] 10.222.0.79 "GET /compute/v2.1/servers/a05629df-accf-4f2f-9d9d-d7602cf69fd4" status: 200 len: 1267 microversion: 2.1 time: 0.175138 Oct 17 14:16:05.085559 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2962/5790] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:04 2022] GET /compute/v2.1/servers/a05629df-accf-4f2f-9d9d-d7602cf69fd4 => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:16:05.789483 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-75dfb243-dd5f-441e-a8be-7cdd2cacaf68 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:16:05.792702 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-75dfb243-dd5f-441e-a8be-7cdd2cacaf68 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] [instance: bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:05.802355 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-75dfb243-dd5f-441e-a8be-7cdd2cacaf68 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:05.802835 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-75dfb243-dd5f-441e-a8be-7cdd2cacaf68 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:05.803348 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-75dfb243-dd5f-441e-a8be-7cdd2cacaf68 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:05.804078 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-75dfb243-dd5f-441e-a8be-7cdd2cacaf68 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:05.804531 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-75dfb243-dd5f-441e-a8be-7cdd2cacaf68 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:05.804969 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-75dfb243-dd5f-441e-a8be-7cdd2cacaf68 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:05.857330 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-75dfb243-dd5f-441e-a8be-7cdd2cacaf68 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] 10.222.0.79 "POST /compute/v2.1/servers/bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4/action" status: 200 len: 24571 microversion: 2.1 time: 0.073619 Oct 17 14:16:05.857950 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2829/5791] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:16:05 2022] POST /compute/v2.1/servers/bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4/action => generated 24571 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:16:06.109321 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-46b3ed60-1b2f-48f7-880a-0538dee4f3e2 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:06.110688 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-46b3ed60-1b2f-48f7-880a-0538dee4f3e2 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] [instance: a05629df-accf-4f2f-9d9d-d7602cf69fd4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:06.121706 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-46b3ed60-1b2f-48f7-880a-0538dee4f3e2 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:06.122444 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-46b3ed60-1b2f-48f7-880a-0538dee4f3e2 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:06.123095 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-46b3ed60-1b2f-48f7-880a-0538dee4f3e2 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:06.124284 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-46b3ed60-1b2f-48f7-880a-0538dee4f3e2 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:06.124954 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-46b3ed60-1b2f-48f7-880a-0538dee4f3e2 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:06.125603 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-46b3ed60-1b2f-48f7-880a-0538dee4f3e2 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:06.275819 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-46b3ed60-1b2f-48f7-880a-0538dee4f3e2 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880bf3983987453ba9c29d8b73159e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eecf5c8d73944dabf3a0e0f64123745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:06.284226 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-46b3ed60-1b2f-48f7-880a-0538dee4f3e2 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] 10.222.0.79 "GET /compute/v2.1/servers/a05629df-accf-4f2f-9d9d-d7602cf69fd4" status: 200 len: 1267 microversion: 2.1 time: 0.179793 Oct 17 14:16:06.284826 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2963/5792] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:06 2022] GET /compute/v2.1/servers/a05629df-accf-4f2f-9d9d-d7602cf69fd4 => generated 1267 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:16:07.312256 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2f507bf6-691c-4d32-ba1e-4e5a91e3f9d3 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:07.313152 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2f507bf6-691c-4d32-ba1e-4e5a91e3f9d3 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] [instance: a05629df-accf-4f2f-9d9d-d7602cf69fd4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:07.316728 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:16:07.317827 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=6 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:16:07.334438 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2f507bf6-691c-4d32-ba1e-4e5a91e3f9d3 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:07.334924 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2f507bf6-691c-4d32-ba1e-4e5a91e3f9d3 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:07.335399 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2f507bf6-691c-4d32-ba1e-4e5a91e3f9d3 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:07.336101 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2f507bf6-691c-4d32-ba1e-4e5a91e3f9d3 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:07.336553 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2f507bf6-691c-4d32-ba1e-4e5a91e3f9d3 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:07.336977 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2f507bf6-691c-4d32-ba1e-4e5a91e3f9d3 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:07.477620 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2f507bf6-691c-4d32-ba1e-4e5a91e3f9d3 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880bf3983987453ba9c29d8b73159e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eecf5c8d73944dabf3a0e0f64123745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:07.485677 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2f507bf6-691c-4d32-ba1e-4e5a91e3f9d3 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] 10.222.0.79 "GET /compute/v2.1/servers/a05629df-accf-4f2f-9d9d-d7602cf69fd4" status: 200 len: 1267 microversion: 2.1 time: 0.181358 Oct 17 14:16:07.486251 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2830/5793] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:07 2022] GET /compute/v2.1/servers/a05629df-accf-4f2f-9d9d-d7602cf69fd4 => generated 1267 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:16:08.513462 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-27e291dc-9637-47cd-b12a-54bf25722708 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:08.514234 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-27e291dc-9637-47cd-b12a-54bf25722708 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] [instance: a05629df-accf-4f2f-9d9d-d7602cf69fd4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:08.517282 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=6 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:16:08.528001 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-27e291dc-9637-47cd-b12a-54bf25722708 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:08.528795 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-27e291dc-9637-47cd-b12a-54bf25722708 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:08.529484 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-27e291dc-9637-47cd-b12a-54bf25722708 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:08.530604 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-27e291dc-9637-47cd-b12a-54bf25722708 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:08.531358 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-27e291dc-9637-47cd-b12a-54bf25722708 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:08.532084 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-27e291dc-9637-47cd-b12a-54bf25722708 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:08.669205 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-27e291dc-9637-47cd-b12a-54bf25722708 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880bf3983987453ba9c29d8b73159e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eecf5c8d73944dabf3a0e0f64123745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:08.677937 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-27e291dc-9637-47cd-b12a-54bf25722708 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] 10.222.0.79 "GET /compute/v2.1/servers/a05629df-accf-4f2f-9d9d-d7602cf69fd4" status: 200 len: 1267 microversion: 2.1 time: 0.171250 Oct 17 14:16:08.678528 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2964/5794] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:08 2022] GET /compute/v2.1/servers/a05629df-accf-4f2f-9d9d-d7602cf69fd4 => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:16:09.702177 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1fd15040-077a-4347-8811-800450d896bb tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:09.702733 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1fd15040-077a-4347-8811-800450d896bb tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] [instance: a05629df-accf-4f2f-9d9d-d7602cf69fd4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:09.710274 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1fd15040-077a-4347-8811-800450d896bb tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:09.710764 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1fd15040-077a-4347-8811-800450d896bb tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:09.711194 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1fd15040-077a-4347-8811-800450d896bb tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:09.711965 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1fd15040-077a-4347-8811-800450d896bb tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:09.713028 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1fd15040-077a-4347-8811-800450d896bb tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:09.713460 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1fd15040-077a-4347-8811-800450d896bb tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:09.851131 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1fd15040-077a-4347-8811-800450d896bb tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880bf3983987453ba9c29d8b73159e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eecf5c8d73944dabf3a0e0f64123745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:09.859291 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1fd15040-077a-4347-8811-800450d896bb tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] 10.222.0.79 "GET /compute/v2.1/servers/a05629df-accf-4f2f-9d9d-d7602cf69fd4" status: 200 len: 1267 microversion: 2.1 time: 0.161239 Oct 17 14:16:09.859958 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2831/5795] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:09 2022] GET /compute/v2.1/servers/a05629df-accf-4f2f-9d9d-d7602cf69fd4 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:16:10.885802 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5837f60d-182f-417a-9c0f-093a6e1a4171 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:10.886750 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5837f60d-182f-417a-9c0f-093a6e1a4171 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] [instance: a05629df-accf-4f2f-9d9d-d7602cf69fd4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:10.897213 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5837f60d-182f-417a-9c0f-093a6e1a4171 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:10.897898 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5837f60d-182f-417a-9c0f-093a6e1a4171 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:10.898517 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5837f60d-182f-417a-9c0f-093a6e1a4171 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:10.899569 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5837f60d-182f-417a-9c0f-093a6e1a4171 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:10.900213 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5837f60d-182f-417a-9c0f-093a6e1a4171 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:10.901142 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5837f60d-182f-417a-9c0f-093a6e1a4171 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:11.046815 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5837f60d-182f-417a-9c0f-093a6e1a4171 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880bf3983987453ba9c29d8b73159e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eecf5c8d73944dabf3a0e0f64123745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:11.055301 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5837f60d-182f-417a-9c0f-093a6e1a4171 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] 10.222.0.79 "GET /compute/v2.1/servers/a05629df-accf-4f2f-9d9d-d7602cf69fd4" status: 200 len: 1267 microversion: 2.1 time: 0.175223 Oct 17 14:16:11.056222 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2965/5796] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:10 2022] GET /compute/v2.1/servers/a05629df-accf-4f2f-9d9d-d7602cf69fd4 => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:16:11.503534 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-755c152a-8de6-44e7-851e-9f6f93e4ad3c req-d76ee8cb-21bb-45b6-b015-9c4c01cf8bf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a05629df-accf-4f2f-9d9d-d7602cf69fd4", "name": "network-vif-plugged", "status": "completed", "tag": "bc3c5aa2-8155-4ccb-b05d-983598a72fc7"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:16:11.515586 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-755c152a-8de6-44e7-851e-9f6f93e4ad3c req-d76ee8cb-21bb-45b6-b015-9c4c01cf8bf2 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:11.516870 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-755c152a-8de6-44e7-851e-9f6f93e4ad3c req-d76ee8cb-21bb-45b6-b015-9c4c01cf8bf2 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:11.517309 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-755c152a-8de6-44e7-851e-9f6f93e4ad3c req-d76ee8cb-21bb-45b6-b015-9c4c01cf8bf2 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:11.530964 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-755c152a-8de6-44e7-851e-9f6f93e4ad3c req-d76ee8cb-21bb-45b6-b015-9c4c01cf8bf2 service nova] Creating event network-vif-plugged:bc3c5aa2-8155-4ccb-b05d-983598a72fc7 for instance a05629df-accf-4f2f-9d9d-d7602cf69fd4 on n-h2-854247-14 Oct 17 14:16:11.536983 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-755c152a-8de6-44e7-851e-9f6f93e4ad3c req-d76ee8cb-21bb-45b6-b015-9c4c01cf8bf2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036860 Oct 17 14:16:11.537781 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2832/5797] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:16:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:16:12.082617 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a08b073b-ce1e-4923-941a-8a34c0610ca4 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:12.083308 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a08b073b-ce1e-4923-941a-8a34c0610ca4 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] [instance: a05629df-accf-4f2f-9d9d-d7602cf69fd4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:12.090568 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a08b073b-ce1e-4923-941a-8a34c0610ca4 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:12.091079 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a08b073b-ce1e-4923-941a-8a34c0610ca4 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:12.091544 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a08b073b-ce1e-4923-941a-8a34c0610ca4 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:12.092242 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a08b073b-ce1e-4923-941a-8a34c0610ca4 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:12.092692 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a08b073b-ce1e-4923-941a-8a34c0610ca4 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:12.093141 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a08b073b-ce1e-4923-941a-8a34c0610ca4 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:12.244017 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a08b073b-ce1e-4923-941a-8a34c0610ca4 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880bf3983987453ba9c29d8b73159e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eecf5c8d73944dabf3a0e0f64123745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:12.252449 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a08b073b-ce1e-4923-941a-8a34c0610ca4 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] 10.222.0.79 "GET /compute/v2.1/servers/a05629df-accf-4f2f-9d9d-d7602cf69fd4" status: 200 len: 1267 microversion: 2.1 time: 0.176209 Oct 17 14:16:12.253020 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2966/5798] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:12 2022] GET /compute/v2.1/servers/a05629df-accf-4f2f-9d9d-d7602cf69fd4 => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:16:12.265060 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-83c67b41-6326-421f-b564-fa422cf01499 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:16:12.267400 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-83c67b41-6326-421f-b564-fa422cf01499 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] [instance: bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:12.274165 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-83c67b41-6326-421f-b564-fa422cf01499 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:12.274641 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-83c67b41-6326-421f-b564-fa422cf01499 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:12.275075 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-83c67b41-6326-421f-b564-fa422cf01499 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:12.275790 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-83c67b41-6326-421f-b564-fa422cf01499 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:12.276592 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-83c67b41-6326-421f-b564-fa422cf01499 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:12.276709 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-83c67b41-6326-421f-b564-fa422cf01499 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:12.337454 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-83c67b41-6326-421f-b564-fa422cf01499 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] 10.222.0.79 "POST /compute/v2.1/servers/bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4/action" status: 200 len: 32644 microversion: 2.1 time: 0.076002 Oct 17 14:16:12.338371 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2833/5799] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:16:12 2022] POST /compute/v2.1/servers/bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4/action => generated 32644 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:16:13.275842 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-dcdefa70-b8cd-44c7-8a67-59da3342eb91 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:13.276440 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-dcdefa70-b8cd-44c7-8a67-59da3342eb91 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] [instance: a05629df-accf-4f2f-9d9d-d7602cf69fd4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:13.283996 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dcdefa70-b8cd-44c7-8a67-59da3342eb91 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:13.284663 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dcdefa70-b8cd-44c7-8a67-59da3342eb91 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:13.284931 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dcdefa70-b8cd-44c7-8a67-59da3342eb91 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:13.285931 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dcdefa70-b8cd-44c7-8a67-59da3342eb91 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:13.286396 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dcdefa70-b8cd-44c7-8a67-59da3342eb91 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:13.286830 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dcdefa70-b8cd-44c7-8a67-59da3342eb91 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:13.408807 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c355aaba-fba1-494f-9436-ad3bfd5460c7 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:13.409626 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c355aaba-fba1-494f-9436-ad3bfd5460c7 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] [instance: bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:13.417436 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c355aaba-fba1-494f-9436-ad3bfd5460c7 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:13.417912 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c355aaba-fba1-494f-9436-ad3bfd5460c7 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:13.418337 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c355aaba-fba1-494f-9436-ad3bfd5460c7 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:13.419179 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c355aaba-fba1-494f-9436-ad3bfd5460c7 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:13.419646 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c355aaba-fba1-494f-9436-ad3bfd5460c7 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:13.420057 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c355aaba-fba1-494f-9436-ad3bfd5460c7 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:13.431249 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-dcdefa70-b8cd-44c7-8a67-59da3342eb91 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880bf3983987453ba9c29d8b73159e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eecf5c8d73944dabf3a0e0f64123745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:13.440789 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-dcdefa70-b8cd-44c7-8a67-59da3342eb91 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] 10.222.0.79 "GET /compute/v2.1/servers/a05629df-accf-4f2f-9d9d-d7602cf69fd4" status: 200 len: 1457 microversion: 2.1 time: 0.169075 Oct 17 14:16:13.441805 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2967/5800] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:13 2022] GET /compute/v2.1/servers/a05629df-accf-4f2f-9d9d-d7602cf69fd4 => generated 1457 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:16:13.447386 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-e7f7ebb8-2745-4d04-84fc-c9af0151697d req-a3ea90b9-478b-437c-8952-a2266b3cebc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4", "tag": "d4dbf868-d7f2-4cba-a29f-09c069c518b6"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:16:13.454942 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c355aaba-fba1-494f-9436-ad3bfd5460c7 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] [instance: bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:16:13.458955 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-e7f7ebb8-2745-4d04-84fc-c9af0151697d req-a3ea90b9-478b-437c-8952-a2266b3cebc6 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:13.459476 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-e7f7ebb8-2745-4d04-84fc-c9af0151697d req-a3ea90b9-478b-437c-8952-a2266b3cebc6 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:13.459909 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-e7f7ebb8-2745-4d04-84fc-c9af0151697d req-a3ea90b9-478b-437c-8952-a2266b3cebc6 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:13.471735 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-e7f7ebb8-2745-4d04-84fc-c9af0151697d req-a3ea90b9-478b-437c-8952-a2266b3cebc6 service nova] Creating event network-changed:d4dbf868-d7f2-4cba-a29f-09c069c518b6 for instance bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4 on n-h1-854247-14 Oct 17 14:16:13.477785 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-e7f7ebb8-2745-4d04-84fc-c9af0151697d req-a3ea90b9-478b-437c-8952-a2266b3cebc6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034230 Oct 17 14:16:13.478394 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2968/5801] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:16:13.484274 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d6bfbee7-6a32-433e-89db-a50c596394c2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:16:13.488016 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d6bfbee7-6a32-433e-89db-a50c596394c2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 23cb6fcb-f328-4fe2-b890-4b33bad2c78a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:13.494777 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d6bfbee7-6a32-433e-89db-a50c596394c2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:13.495585 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d6bfbee7-6a32-433e-89db-a50c596394c2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:13.496245 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d6bfbee7-6a32-433e-89db-a50c596394c2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:13.497178 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d6bfbee7-6a32-433e-89db-a50c596394c2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:13.498706 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d6bfbee7-6a32-433e-89db-a50c596394c2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:13.499815 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d6bfbee7-6a32-433e-89db-a50c596394c2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:13.562542 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c355aaba-fba1-494f-9436-ad3bfd5460c7 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] 10.222.0.79 "DELETE /compute/v2.1/servers/bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4" status: 204 len: 0 microversion: 2.1 time: 0.158010 Oct 17 14:16:13.563416 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2834/5802] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:16:13 2022] DELETE /compute/v2.1/servers/bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:16:13.568386 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-64bbfdd8-a09d-485f-aad9-8546eb3a578c tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:13.569092 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-64bbfdd8-a09d-485f-aad9-8546eb3a578c tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] [instance: a05629df-accf-4f2f-9d9d-d7602cf69fd4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:13.575241 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-64bbfdd8-a09d-485f-aad9-8546eb3a578c tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:13.575729 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-64bbfdd8-a09d-485f-aad9-8546eb3a578c tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:13.576168 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-64bbfdd8-a09d-485f-aad9-8546eb3a578c tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:13.576866 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-64bbfdd8-a09d-485f-aad9-8546eb3a578c tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:13.577474 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-64bbfdd8-a09d-485f-aad9-8546eb3a578c tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:13.578537 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-64bbfdd8-a09d-485f-aad9-8546eb3a578c tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:13.584983 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d6bfbee7-6a32-433e-89db-a50c596394c2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "POST /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a/action" status: 200 len: 24572 microversion: 2.1 time: 0.105094 Oct 17 14:16:13.592608 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2969/5803] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:16:13 2022] POST /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a/action => generated 24572 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:16:13.592608 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f1332fad-60fa-4ee1-88ab-2e3b651e7da1 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:13.594485 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f1332fad-60fa-4ee1-88ab-2e3b651e7da1 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] [instance: bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:13.601250 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1332fad-60fa-4ee1-88ab-2e3b651e7da1 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:13.601738 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1332fad-60fa-4ee1-88ab-2e3b651e7da1 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:13.602177 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1332fad-60fa-4ee1-88ab-2e3b651e7da1 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:13.602886 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1332fad-60fa-4ee1-88ab-2e3b651e7da1 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:13.603370 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1332fad-60fa-4ee1-88ab-2e3b651e7da1 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:13.603797 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1332fad-60fa-4ee1-88ab-2e3b651e7da1 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:13.788389 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-64bbfdd8-a09d-485f-aad9-8546eb3a578c tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880bf3983987453ba9c29d8b73159e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eecf5c8d73944dabf3a0e0f64123745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:13.797973 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-64bbfdd8-a09d-485f-aad9-8546eb3a578c tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] 10.222.0.79 "GET /compute/v2.1/servers/a05629df-accf-4f2f-9d9d-d7602cf69fd4" status: 200 len: 1457 microversion: 2.1 time: 0.233592 Oct 17 14:16:13.798917 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2835/5804] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:13 2022] GET /compute/v2.1/servers/a05629df-accf-4f2f-9d9d-d7602cf69fd4 => generated 1457 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:16:13.802521 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f1332fad-60fa-4ee1-88ab-2e3b651e7da1 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec3f9e6cb241549395b6375b43b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b981af0923d41809255f04ce299062f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:13.811632 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f1332fad-60fa-4ee1-88ab-2e3b651e7da1 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] 10.222.0.79 "GET /compute/v2.1/servers/bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4" status: 200 len: 1668 microversion: 2.1 time: 0.224745 Oct 17 14:16:13.812639 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2970/5805] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:13 2022] GET /compute/v2.1/servers/bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4 => generated 1668 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:16:14.837550 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-064b6000-8845-4332-af43-350c16795d63 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:14.838157 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-064b6000-8845-4332-af43-350c16795d63 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] [instance: bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:14.845923 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-064b6000-8845-4332-af43-350c16795d63 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:14.846521 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-064b6000-8845-4332-af43-350c16795d63 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:14.847035 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-064b6000-8845-4332-af43-350c16795d63 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:14.848359 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-064b6000-8845-4332-af43-350c16795d63 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:14.848900 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-064b6000-8845-4332-af43-350c16795d63 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:14.849391 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-064b6000-8845-4332-af43-350c16795d63 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:15.098872 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-064b6000-8845-4332-af43-350c16795d63 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec3f9e6cb241549395b6375b43b22f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b981af0923d41809255f04ce299062f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:15.110099 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-064b6000-8845-4332-af43-350c16795d63 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] 10.222.0.79 "GET /compute/v2.1/servers/bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4" status: 200 len: 1668 microversion: 2.1 time: 0.276716 Oct 17 14:16:15.126802 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2836/5806] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:14 2022] GET /compute/v2.1/servers/bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4 => generated 1668 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:16:15.485871 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-8137923e-2ca5-4957-8935-84ea3543a5b0 req-b73b4658-2a30-472d-bf68-9d5f1b65e768 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4", "name": "network-vif-deleted", "tag": "d4dbf868-d7f2-4cba-a29f-09c069c518b6"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:16:15.512353 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-8137923e-2ca5-4957-8935-84ea3543a5b0 req-b73b4658-2a30-472d-bf68-9d5f1b65e768 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:15.513169 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-8137923e-2ca5-4957-8935-84ea3543a5b0 req-b73b4658-2a30-472d-bf68-9d5f1b65e768 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:15.513704 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-8137923e-2ca5-4957-8935-84ea3543a5b0 req-b73b4658-2a30-472d-bf68-9d5f1b65e768 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:15.527144 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-8137923e-2ca5-4957-8935-84ea3543a5b0 req-b73b4658-2a30-472d-bf68-9d5f1b65e768 service nova] Creating event network-vif-deleted:d4dbf868-d7f2-4cba-a29f-09c069c518b6 for instance bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4 on n-h1-854247-14 Oct 17 14:16:15.566264 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-8137923e-2ca5-4957-8935-84ea3543a5b0 req-b73b4658-2a30-472d-bf68-9d5f1b65e768 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086141 Oct 17 14:16:15.571833 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2971/5807] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:16:16.134201 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-79d63df4-91c4-47fe-b2d1-418e88693e8d tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:16.135202 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-79d63df4-91c4-47fe-b2d1-418e88693e8d tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] [instance: bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:16.141778 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-79d63df4-91c4-47fe-b2d1-418e88693e8d tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:16.142442 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-79d63df4-91c4-47fe-b2d1-418e88693e8d tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:16.142877 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-79d63df4-91c4-47fe-b2d1-418e88693e8d tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:16.143757 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-79d63df4-91c4-47fe-b2d1-418e88693e8d tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:16.144200 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-79d63df4-91c4-47fe-b2d1-418e88693e8d tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:16.144764 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-79d63df4-91c4-47fe-b2d1-418e88693e8d tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:16.159743 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-79d63df4-91c4-47fe-b2d1-418e88693e8d tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] HTTP exception thrown: Instance bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4 could not be found. Oct 17 14:16:16.161498 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-79d63df4-91c4-47fe-b2d1-418e88693e8d tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Request method failure captured: Oct 17 14:16:16.161498 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4 HTTP/1.1 Oct 17 14:16:16.161498 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 14:16:16.161498 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 14:16:16.161498 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 14:16:16.161498 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 14:16:16.161498 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 14:16:16.161498 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 14:16:16.161498 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 14:16:16.161498 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 14:16:16.161498 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTWL136FgU2IyEDjBQXa30vIK56h-gAs-SKuFxfZQPjvpnYb0fchfPhxn-AZuq9g5sqGxvAiLWxa_5cN2bhBM-VOY81IWWyRaJs7K7y1KhjG8uAMe6p4rqMTM4MaylNIBzf9OxEoejRTRfFdeCQK3-J45t1PP_EJOlX-_BuJfSWoKKTA Oct 17 14:16:16.161498 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 14:16:16.161498 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 14:16:16.161498 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 14:16:16.161498 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 14:16:16.161498 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 14:16:16.161498 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 14:16:16.161498 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 1b981af0923d41809255f04ce299062f Oct 17 14:16:16.161498 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-TestNetworkBasicOps-558238693 Oct 17 14:16:16.161498 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 14:16:16.161498 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 14:16:16.161498 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1b981af0923d41809255f04ce299062f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/1b981af0923d41809255f04ce299062f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/1b981af0923d41809255f04ce299062f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_1b981af0923d41809255f04ce299062f", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:16:16.161498 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-TestNetworkBasicOps-558238693 Oct 17 14:16:16.161498 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 1b981af0923d41809255f04ce299062f Oct 17 14:16:16.161498 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-TestNetworkBasicOps-558238693 Oct 17 14:16:16.161498 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-TestNetworkBasicOps-558238693-project Oct 17 14:16:16.161498 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 14:16:16.161498 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 14:16:16.161498 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 7fec3f9e6cb241549395b6375b43b22f Oct 17 14:16:16.161498 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-TestNetworkBasicOps-558238693-project Oct 17 14:16:16.161498 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 14:16:16.161498 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4 could not be found. Oct 17 14:16:16.161498 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4'} Oct 17 14:16:16.161498 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:16:16.161498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:16:16.161498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:16:16.161498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:16:16.161498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:16:16.161498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:16:16.161498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:16:16.161498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:16:16.161498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:16:16.161498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:16:16.161498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4 could not be found. Oct 17 14:16:16.161498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:16:16.161498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:16:16.161498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:16:16.161498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:16:16.161498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:16:16.161498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:16:16.161498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:16:16.161498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:16:16.161498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:16:16.161498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:16:16.161498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:16:16.161498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:16:16.161498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:16:16.161498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:16:16.161498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:16:16.161498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:16:16.161498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4 could not be found. Oct 17 14:16:16.161498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:16:16.161498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:16:16.161498 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:16:16.170248 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:16:16.170248 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:16:16.170248 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:16:16.170248 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:16:16.170248 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:16:16.170248 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4 could not be found. Oct 17 14:16:16.170248 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:16:16.170248 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-79d63df4-91c4-47fe-b2d1-418e88693e8d tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Returning 404 to user: Instance bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:16:16.170248 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-79d63df4-91c4-47fe-b2d1-418e88693e8d tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] 10.222.0.79 "GET /compute/v2.1/servers/bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4" status: 404 len: 111 microversion: 2.1 time: 0.032744 Oct 17 14:16:16.170248 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2837/5808] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:16 2022] GET /compute/v2.1/servers/bf4e8ef2-1efb-4e87-bdd9-0e0bb3a7b3e4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:16:16.330816 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-cd32e666-28bd-4f7c-b20f-fdf1cd12a621 req-214c4f69-cddf-46b0-8381-b005ce49d080 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a05629df-accf-4f2f-9d9d-d7602cf69fd4", "tag": "bc3c5aa2-8155-4ccb-b05d-983598a72fc7"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:16:16.344325 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-cd32e666-28bd-4f7c-b20f-fdf1cd12a621 req-214c4f69-cddf-46b0-8381-b005ce49d080 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:16.344940 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-cd32e666-28bd-4f7c-b20f-fdf1cd12a621 req-214c4f69-cddf-46b0-8381-b005ce49d080 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:16.345896 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-cd32e666-28bd-4f7c-b20f-fdf1cd12a621 req-214c4f69-cddf-46b0-8381-b005ce49d080 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:16.358258 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-cd32e666-28bd-4f7c-b20f-fdf1cd12a621 req-214c4f69-cddf-46b0-8381-b005ce49d080 service nova] Creating event network-changed:bc3c5aa2-8155-4ccb-b05d-983598a72fc7 for instance a05629df-accf-4f2f-9d9d-d7602cf69fd4 on n-h2-854247-14 Oct 17 14:16:16.365735 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-cd32e666-28bd-4f7c-b20f-fdf1cd12a621 req-214c4f69-cddf-46b0-8381-b005ce49d080 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039417 Oct 17 14:16:16.367336 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2972/5809] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:16:16.416896 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-09b7d0b6-344d-4411-b5e8-eda68717b415 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] Calling method '.version_select at 0x7f7cd44f93a0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:16.451002 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-09b7d0b6-344d-4411-b5e8-eda68717b415 tempest-TestNetworkBasicOps-558238693 tempest-TestNetworkBasicOps-558238693-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-321836029" status: 202 len: 0 microversion: 2.1 time: 0.037846 Oct 17 14:16:16.451955 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2838/5810] 10.222.0.79 () {58 vars in 1254 bytes} [Mon Oct 17 14:16:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-321836029 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:16:18.384586 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-228742f5-b62b-487b-b2c3-4183a44dda7d req-380f2e9d-f416-48af-9dfb-fb87c4d9529a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a05629df-accf-4f2f-9d9d-d7602cf69fd4", "tag": "bc3c5aa2-8155-4ccb-b05d-983598a72fc7"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:16:18.399739 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-228742f5-b62b-487b-b2c3-4183a44dda7d req-380f2e9d-f416-48af-9dfb-fb87c4d9529a service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:18.400663 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-228742f5-b62b-487b-b2c3-4183a44dda7d req-380f2e9d-f416-48af-9dfb-fb87c4d9529a service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:18.401316 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-228742f5-b62b-487b-b2c3-4183a44dda7d req-380f2e9d-f416-48af-9dfb-fb87c4d9529a service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:18.418273 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-228742f5-b62b-487b-b2c3-4183a44dda7d req-380f2e9d-f416-48af-9dfb-fb87c4d9529a service nova] Creating event network-changed:bc3c5aa2-8155-4ccb-b05d-983598a72fc7 for instance a05629df-accf-4f2f-9d9d-d7602cf69fd4 on n-h2-854247-14 Oct 17 14:16:18.429451 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-228742f5-b62b-487b-b2c3-4183a44dda7d req-380f2e9d-f416-48af-9dfb-fb87c4d9529a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051022 Oct 17 14:16:18.430624 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2973/5811] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:16:20.452086 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-9291a73e-faa4-4377-9184-564ab8ab50e0 req-65bbe82e-914e-4e90-b79b-4ad12df1b760 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a05629df-accf-4f2f-9d9d-d7602cf69fd4", "tag": "bc3c5aa2-8155-4ccb-b05d-983598a72fc7"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:16:20.464054 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-9291a73e-faa4-4377-9184-564ab8ab50e0 req-65bbe82e-914e-4e90-b79b-4ad12df1b760 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:20.464520 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-9291a73e-faa4-4377-9184-564ab8ab50e0 req-65bbe82e-914e-4e90-b79b-4ad12df1b760 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:20.464958 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-9291a73e-faa4-4377-9184-564ab8ab50e0 req-65bbe82e-914e-4e90-b79b-4ad12df1b760 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:20.476391 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-9291a73e-faa4-4377-9184-564ab8ab50e0 req-65bbe82e-914e-4e90-b79b-4ad12df1b760 service nova] Creating event network-changed:bc3c5aa2-8155-4ccb-b05d-983598a72fc7 for instance a05629df-accf-4f2f-9d9d-d7602cf69fd4 on n-h2-854247-14 Oct 17 14:16:20.481714 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-9291a73e-faa4-4377-9184-564ab8ab50e0 req-65bbe82e-914e-4e90-b79b-4ad12df1b760 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034457 Oct 17 14:16:20.482496 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2839/5812] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:16:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:16:23.773162 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-85b9398b-327c-4a7b-b68b-7c993b2dc3e9 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Action: 'create', calling method: .version_select at 0x7f7cd4fce700>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-437691523", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLArpc+pgQDc9pbJalekXQOvLJyOZJKaMp/ce6kJWKxmGOSGOiKFvpmgZ9j+/Rrpd1I9lIdkh0zgJB/245PbTIyp+1mAxihLwigv/i+BrMMQC5cCuFOD4LVr+JohA8PCqQ=="}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:16:23.789686 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-85b9398b-327c-4a7b-b68b-7c993b2dc3e9 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Getting quotas for project b0587423d7f44899bac419cd4e883ec9. Resources: {'key_pairs'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:16:23.795991 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-85b9398b-327c-4a7b-b68b-7c993b2dc3e9 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Getting quotas for user 7557bdf83dd344f5b8f20ce3af781a71 and project b0587423d7f44899bac419cd4e883ec9. Resources: {'key_pairs'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:16:23.824571 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-85b9398b-327c-4a7b-b68b-7c993b2dc3e9 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.234983 Oct 17 14:16:23.825558 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2974/5813] 10.222.0.79 () {60 vars in 1159 bytes} [Mon Oct 17 14:16:23 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:16:24.474892 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-962d75fb-7abf-45ad-a665-62a846110b9b tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:24.475839 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-962d75fb-7abf-45ad-a665-62a846110b9b tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] [instance: 23cb6fcb-f328-4fe2-b890-4b33bad2c78a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:24.484723 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-962d75fb-7abf-45ad-a665-62a846110b9b tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:24.485409 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-962d75fb-7abf-45ad-a665-62a846110b9b tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:24.485909 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-962d75fb-7abf-45ad-a665-62a846110b9b tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:24.486669 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-962d75fb-7abf-45ad-a665-62a846110b9b tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:24.487113 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-962d75fb-7abf-45ad-a665-62a846110b9b tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:24.487748 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-962d75fb-7abf-45ad-a665-62a846110b9b tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:25.091661 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-962d75fb-7abf-45ad-a665-62a846110b9b tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a" status: 200 len: 1835 microversion: 2.1 time: 0.621451 Oct 17 14:16:25.093065 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2840/5814] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:24 2022] GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a => generated 1835 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:16:25.117199 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4696e3c7-f6fd-4aac-aed4-456b4641b7cd tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:25.118085 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4696e3c7-f6fd-4aac-aed4-456b4641b7cd tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 23cb6fcb-f328-4fe2-b890-4b33bad2c78a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:25.124490 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4696e3c7-f6fd-4aac-aed4-456b4641b7cd tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:25.124973 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4696e3c7-f6fd-4aac-aed4-456b4641b7cd tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:25.125414 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4696e3c7-f6fd-4aac-aed4-456b4641b7cd tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:25.126112 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4696e3c7-f6fd-4aac-aed4-456b4641b7cd tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:25.126570 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4696e3c7-f6fd-4aac-aed4-456b4641b7cd tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:25.126990 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4696e3c7-f6fd-4aac-aed4-456b4641b7cd tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:25.351820 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4696e3c7-f6fd-4aac-aed4-456b4641b7cd tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:25.360191 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4696e3c7-f6fd-4aac-aed4-456b4641b7cd tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a" status: 200 len: 1682 microversion: 2.1 time: 0.248010 Oct 17 14:16:25.360844 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2975/5815] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:25 2022] GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a => generated 1682 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:16:25.528301 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0e3f2bd3-f713-4d8d-ba15-b8c06c765e59 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:16:25.531432 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0e3f2bd3-f713-4d8d-ba15-b8c06c765e59 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 23cb6fcb-f328-4fe2-b890-4b33bad2c78a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:25.539101 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0e3f2bd3-f713-4d8d-ba15-b8c06c765e59 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:25.540011 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0e3f2bd3-f713-4d8d-ba15-b8c06c765e59 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:25.540513 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0e3f2bd3-f713-4d8d-ba15-b8c06c765e59 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:25.541309 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0e3f2bd3-f713-4d8d-ba15-b8c06c765e59 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:25.541956 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0e3f2bd3-f713-4d8d-ba15-b8c06c765e59 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:25.542382 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0e3f2bd3-f713-4d8d-ba15-b8c06c765e59 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:25.611066 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0e3f2bd3-f713-4d8d-ba15-b8c06c765e59 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "POST /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a/action" status: 200 len: 32647 microversion: 2.1 time: 0.086854 Oct 17 14:16:25.611927 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2841/5816] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:16:25 2022] POST /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a/action => generated 32647 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:16:25.763676 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5e59c082-789f-44f7-8021-a96eeb3a709d tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:16:25.764269 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5e59c082-789f-44f7-8021-a96eeb3a709d tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] [instance: 23cb6fcb-f328-4fe2-b890-4b33bad2c78a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:25.770822 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5e59c082-789f-44f7-8021-a96eeb3a709d tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:25.771429 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5e59c082-789f-44f7-8021-a96eeb3a709d tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:25.771939 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5e59c082-789f-44f7-8021-a96eeb3a709d tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:25.773169 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5e59c082-789f-44f7-8021-a96eeb3a709d tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:25.773648 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5e59c082-789f-44f7-8021-a96eeb3a709d tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:25.774118 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5e59c082-789f-44f7-8021-a96eeb3a709d tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:25.826487 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5e59c082-789f-44f7-8021-a96eeb3a709d tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '8c205e97c9c04ac0ab84ba84ce2cdb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bab2ec439240b6a313ae315103b1b3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:25.827187 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5e59c082-789f-44f7-8021-a96eeb3a709d tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] [instance: 23cb6fcb-f328-4fe2-b890-4b33bad2c78a] flavor_id is None. Assuming migration. {{(pid=127016) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 17 14:16:25.827644 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5e59c082-789f-44f7-8021-a96eeb3a709d tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] [instance: 23cb6fcb-f328-4fe2-b890-4b33bad2c78a] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=127016) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 17 14:16:26.095788 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5e59c082-789f-44f7-8021-a96eeb3a709d tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a/action" status: 202 len: 0 microversion: 2.1 time: 0.336129 Oct 17 14:16:26.096944 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2976/5817] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:16:25 2022] POST /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a/action => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:16:26.114334 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bbcd37c9-8be0-4715-a3c9-6f38bb531f8b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:26.115851 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-bbcd37c9-8be0-4715-a3c9-6f38bb531f8b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 23cb6fcb-f328-4fe2-b890-4b33bad2c78a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:26.123311 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bbcd37c9-8be0-4715-a3c9-6f38bb531f8b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:26.123869 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bbcd37c9-8be0-4715-a3c9-6f38bb531f8b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:26.124545 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bbcd37c9-8be0-4715-a3c9-6f38bb531f8b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:26.125296 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bbcd37c9-8be0-4715-a3c9-6f38bb531f8b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:26.125927 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bbcd37c9-8be0-4715-a3c9-6f38bb531f8b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:26.126350 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bbcd37c9-8be0-4715-a3c9-6f38bb531f8b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:26.319850 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-bbcd37c9-8be0-4715-a3c9-6f38bb531f8b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:26.330749 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-bbcd37c9-8be0-4715-a3c9-6f38bb531f8b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a" status: 200 len: 1691 microversion: 2.1 time: 0.229031 Oct 17 14:16:26.332178 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2842/5818] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:26 2022] GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a => generated 1691 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:16:27.357483 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-84e1dc01-86da-43c5-be5c-d2e8543f61d9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:27.358197 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-84e1dc01-86da-43c5-be5c-d2e8543f61d9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 23cb6fcb-f328-4fe2-b890-4b33bad2c78a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:27.376479 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-84e1dc01-86da-43c5-be5c-d2e8543f61d9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:27.377392 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-84e1dc01-86da-43c5-be5c-d2e8543f61d9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:27.380166 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-84e1dc01-86da-43c5-be5c-d2e8543f61d9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:27.381737 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-84e1dc01-86da-43c5-be5c-d2e8543f61d9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:27.382931 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-84e1dc01-86da-43c5-be5c-d2e8543f61d9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:27.385773 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-84e1dc01-86da-43c5-be5c-d2e8543f61d9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:27.588717 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-84e1dc01-86da-43c5-be5c-d2e8543f61d9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:27.598682 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-84e1dc01-86da-43c5-be5c-d2e8543f61d9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a" status: 200 len: 1691 microversion: 2.1 time: 0.246439 Oct 17 14:16:27.599574 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2977/5819] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:27 2022] GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a => generated 1691 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:16:28.629239 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c2c90dbd-646b-4c91-a1d3-871f26b2927b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:28.629879 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c2c90dbd-646b-4c91-a1d3-871f26b2927b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 23cb6fcb-f328-4fe2-b890-4b33bad2c78a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:28.639947 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c2c90dbd-646b-4c91-a1d3-871f26b2927b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:28.640743 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c2c90dbd-646b-4c91-a1d3-871f26b2927b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:28.641361 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c2c90dbd-646b-4c91-a1d3-871f26b2927b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:28.642238 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c2c90dbd-646b-4c91-a1d3-871f26b2927b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:28.643145 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c2c90dbd-646b-4c91-a1d3-871f26b2927b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:28.643769 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c2c90dbd-646b-4c91-a1d3-871f26b2927b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:28.836177 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c2c90dbd-646b-4c91-a1d3-871f26b2927b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:28.846544 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c2c90dbd-646b-4c91-a1d3-871f26b2927b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a" status: 200 len: 1691 microversion: 2.1 time: 0.226486 Oct 17 14:16:28.860253 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2843/5820] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:28 2022] GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a => generated 1691 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:16:29.872551 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d44cdc9e-94d2-4344-b4b3-d80f9eb73964 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:29.876518 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d44cdc9e-94d2-4344-b4b3-d80f9eb73964 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 23cb6fcb-f328-4fe2-b890-4b33bad2c78a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:29.884997 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:16:29.891921 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-348ea90c-8e6e-4d20-b829-5536c6f3a7dc tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1243284561-access_point-1486851577", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "26aa9192-a4a2-47b3-8f3a-ce5dd6bcb8f9"}], "key_name": "tempest-TestSecurityGroupsBasicOps-437691523", "security_groups": [{"name": "tempest-secgroup_access--1818655996"}, {"name": "tempest-secgroup_general--472137749"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:16:29.894127 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d44cdc9e-94d2-4344-b4b3-d80f9eb73964 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:29.894804 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d44cdc9e-94d2-4344-b4b3-d80f9eb73964 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:29.895344 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d44cdc9e-94d2-4344-b4b3-d80f9eb73964 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:29.896418 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d44cdc9e-94d2-4344-b4b3-d80f9eb73964 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:29.897113 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d44cdc9e-94d2-4344-b4b3-d80f9eb73964 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:29.897623 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d44cdc9e-94d2-4344-b4b3-d80f9eb73964 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:29.902721 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:16:30.129966 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d44cdc9e-94d2-4344-b4b3-d80f9eb73964 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:30.141512 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d44cdc9e-94d2-4344-b4b3-d80f9eb73964 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a" status: 200 len: 1696 microversion: 2.1 time: 0.273698 Oct 17 14:16:30.166940 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2978/5821] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:29 2022] GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a => generated 1696 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:16:30.184951 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-348ea90c-8e6e-4d20-b829-5536c6f3a7dc tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] validate_networks() for [('26aa9192-a4a2-47b3-8f3a-ce5dd6bcb8f9', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:16:30.616605 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-348ea90c-8e6e-4d20-b829-5536c6f3a7dc tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:16:30.617137 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-348ea90c-8e6e-4d20-b829-5536c6f3a7dc tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:16:30.617902 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-348ea90c-8e6e-4d20-b829-5536c6f3a7dc tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:16:30.618324 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-348ea90c-8e6e-4d20-b829-5536c6f3a7dc tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:16:30.618744 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-348ea90c-8e6e-4d20-b829-5536c6f3a7dc tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:16:30.628794 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-348ea90c-8e6e-4d20-b829-5536c6f3a7dc tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:30.629310 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-348ea90c-8e6e-4d20-b829-5536c6f3a7dc tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:30.629742 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-348ea90c-8e6e-4d20-b829-5536c6f3a7dc tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:30.630459 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-348ea90c-8e6e-4d20-b829-5536c6f3a7dc tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:30.631029 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-348ea90c-8e6e-4d20-b829-5536c6f3a7dc tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:30.631629 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-348ea90c-8e6e-4d20-b829-5536c6f3a7dc tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:30.652777 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-348ea90c-8e6e-4d20-b829-5536c6f3a7dc tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Getting quotas for project b0587423d7f44899bac419cd4e883ec9. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:16:30.658696 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-348ea90c-8e6e-4d20-b829-5536c6f3a7dc tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Getting quotas for user 7557bdf83dd344f5b8f20ce3af781a71 and project b0587423d7f44899bac419cd4e883ec9. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:16:30.675035 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-348ea90c-8e6e-4d20-b829-5536c6f3a7dc tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:16:30.677460 n-d-854247-14 devstack@n-api.service[127017]: WARNING nova.utils [None req-348ea90c-8e6e-4d20-b829-5536c6f3a7dc tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1243284561-access_point-1486851577 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1243284561-ac Oct 17 14:16:30.678385 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-348ea90c-8e6e-4d20-b829-5536c6f3a7dc tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] [instance: 3d0c26bc-24c7-43d1-a552-2d2aeb3590f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:16:30.735675 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-348ea90c-8e6e-4d20-b829-5536c6f3a7dc tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 0.848966 Oct 17 14:16:30.737200 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2844/5822] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 14:16:29 2022] POST /compute/v2.1/servers => generated 457 bytes in 851 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:16:30.747712 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0770bc8c-a9d8-4113-addf-7831a40b7d4b tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:30.748410 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0770bc8c-a9d8-4113-addf-7831a40b7d4b tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] [instance: 3d0c26bc-24c7-43d1-a552-2d2aeb3590f0] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:30.813152 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0770bc8c-a9d8-4113-addf-7831a40b7d4b tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7557bdf83dd344f5b8f20ce3af781a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0587423d7f44899bac419cd4e883ec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:30.822037 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0770bc8c-a9d8-4113-addf-7831a40b7d4b tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] 10.222.0.79 "GET /compute/v2.1/servers/3d0c26bc-24c7-43d1-a552-2d2aeb3590f0" status: 200 len: 1294 microversion: 2.1 time: 0.078341 Oct 17 14:16:30.823154 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2979/5823] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:30 2022] GET /compute/v2.1/servers/3d0c26bc-24c7-43d1-a552-2d2aeb3590f0 => generated 1294 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:16:31.173951 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c7305733-63e9-4e3e-978a-c5e8d511892b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:31.174565 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c7305733-63e9-4e3e-978a-c5e8d511892b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 23cb6fcb-f328-4fe2-b890-4b33bad2c78a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:31.182764 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7305733-63e9-4e3e-978a-c5e8d511892b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:31.183272 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7305733-63e9-4e3e-978a-c5e8d511892b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:31.183724 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7305733-63e9-4e3e-978a-c5e8d511892b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:31.184453 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7305733-63e9-4e3e-978a-c5e8d511892b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:31.184966 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7305733-63e9-4e3e-978a-c5e8d511892b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:31.185345 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7305733-63e9-4e3e-978a-c5e8d511892b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:31.344590 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c7305733-63e9-4e3e-978a-c5e8d511892b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:31.346939 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:16:31.357102 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c7305733-63e9-4e3e-978a-c5e8d511892b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a" status: 200 len: 1696 microversion: 2.1 time: 0.187199 Oct 17 14:16:31.367318 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2845/5824] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:31 2022] GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a => generated 1696 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:16:31.846184 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-edf65b1a-8948-4bad-ab5e-d20e31d80c4a tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:31.846900 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-edf65b1a-8948-4bad-ab5e-d20e31d80c4a tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] [instance: 3d0c26bc-24c7-43d1-a552-2d2aeb3590f0] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:31.856863 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-edf65b1a-8948-4bad-ab5e-d20e31d80c4a tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:31.857930 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-edf65b1a-8948-4bad-ab5e-d20e31d80c4a tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:31.858390 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-edf65b1a-8948-4bad-ab5e-d20e31d80c4a tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:31.860696 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-edf65b1a-8948-4bad-ab5e-d20e31d80c4a tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:31.861561 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-edf65b1a-8948-4bad-ab5e-d20e31d80c4a tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:31.862028 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-edf65b1a-8948-4bad-ab5e-d20e31d80c4a tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:31.998278 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-edf65b1a-8948-4bad-ab5e-d20e31d80c4a tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7557bdf83dd344f5b8f20ce3af781a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0587423d7f44899bac419cd4e883ec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:32.011665 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-edf65b1a-8948-4bad-ab5e-d20e31d80c4a tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] 10.222.0.79 "GET /compute/v2.1/servers/3d0c26bc-24c7-43d1-a552-2d2aeb3590f0" status: 200 len: 1354 microversion: 2.1 time: 0.169229 Oct 17 14:16:32.012740 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2980/5825] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:31 2022] GET /compute/v2.1/servers/3d0c26bc-24c7-43d1-a552-2d2aeb3590f0 => generated 1354 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:16:32.386634 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-596c1aad-1167-4cb5-8f90-b54a6a4dc20d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:32.387459 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-596c1aad-1167-4cb5-8f90-b54a6a4dc20d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 23cb6fcb-f328-4fe2-b890-4b33bad2c78a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:32.394819 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:16:32.397071 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-596c1aad-1167-4cb5-8f90-b54a6a4dc20d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:32.397717 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-596c1aad-1167-4cb5-8f90-b54a6a4dc20d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:32.398493 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-596c1aad-1167-4cb5-8f90-b54a6a4dc20d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:32.399977 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-596c1aad-1167-4cb5-8f90-b54a6a4dc20d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:32.400621 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-596c1aad-1167-4cb5-8f90-b54a6a4dc20d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:32.401411 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-596c1aad-1167-4cb5-8f90-b54a6a4dc20d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:32.570308 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-596c1aad-1167-4cb5-8f90-b54a6a4dc20d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:32.579805 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-596c1aad-1167-4cb5-8f90-b54a6a4dc20d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a" status: 200 len: 1696 microversion: 2.1 time: 0.197426 Oct 17 14:16:32.580368 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2846/5826] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:32 2022] GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a => generated 1696 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:16:33.040628 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7bdd1056-406b-425f-8ed0-664b7a9d0a2e tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:33.041089 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7bdd1056-406b-425f-8ed0-664b7a9d0a2e tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] [instance: 3d0c26bc-24c7-43d1-a552-2d2aeb3590f0] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:33.049130 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7bdd1056-406b-425f-8ed0-664b7a9d0a2e tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:33.049614 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7bdd1056-406b-425f-8ed0-664b7a9d0a2e tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:33.050048 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7bdd1056-406b-425f-8ed0-664b7a9d0a2e tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:33.050812 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7bdd1056-406b-425f-8ed0-664b7a9d0a2e tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:33.051285 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7bdd1056-406b-425f-8ed0-664b7a9d0a2e tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:33.051703 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7bdd1056-406b-425f-8ed0-664b7a9d0a2e tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:33.229805 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7bdd1056-406b-425f-8ed0-664b7a9d0a2e tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7557bdf83dd344f5b8f20ce3af781a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0587423d7f44899bac419cd4e883ec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:33.239817 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7bdd1056-406b-425f-8ed0-664b7a9d0a2e tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] 10.222.0.79 "GET /compute/v2.1/servers/3d0c26bc-24c7-43d1-a552-2d2aeb3590f0" status: 200 len: 1471 microversion: 2.1 time: 0.204819 Oct 17 14:16:33.240517 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2981/5827] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:33 2022] GET /compute/v2.1/servers/3d0c26bc-24c7-43d1-a552-2d2aeb3590f0 => generated 1471 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:16:33.604777 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-405add60-e509-41e6-91e5-9a17b970215e tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:33.605379 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-405add60-e509-41e6-91e5-9a17b970215e tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 23cb6fcb-f328-4fe2-b890-4b33bad2c78a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:33.612349 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-405add60-e509-41e6-91e5-9a17b970215e tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:33.613050 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-405add60-e509-41e6-91e5-9a17b970215e tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:33.613679 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-405add60-e509-41e6-91e5-9a17b970215e tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:33.614561 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-405add60-e509-41e6-91e5-9a17b970215e tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:33.615231 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-405add60-e509-41e6-91e5-9a17b970215e tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:33.615822 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-405add60-e509-41e6-91e5-9a17b970215e tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:33.769060 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-405add60-e509-41e6-91e5-9a17b970215e tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:33.778183 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-405add60-e509-41e6-91e5-9a17b970215e tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a" status: 200 len: 1696 microversion: 2.1 time: 0.178649 Oct 17 14:16:33.779969 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2847/5828] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:33 2022] GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a => generated 1696 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:16:33.892840 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-aab21fb4-68bc-46b3-a158-6fd4160339bd req-d5e86203-1d61-4178-abd7-4154cbfe51d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d0c26bc-24c7-43d1-a552-2d2aeb3590f0", "tag": "15941bb8-9645-43d7-8f65-311354b6ab89"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:16:33.909793 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-aab21fb4-68bc-46b3-a158-6fd4160339bd req-d5e86203-1d61-4178-abd7-4154cbfe51d7 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:33.910313 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-aab21fb4-68bc-46b3-a158-6fd4160339bd req-d5e86203-1d61-4178-abd7-4154cbfe51d7 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:33.910839 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-aab21fb4-68bc-46b3-a158-6fd4160339bd req-d5e86203-1d61-4178-abd7-4154cbfe51d7 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:33.933459 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-aab21fb4-68bc-46b3-a158-6fd4160339bd req-d5e86203-1d61-4178-abd7-4154cbfe51d7 service nova] Creating event network-changed:15941bb8-9645-43d7-8f65-311354b6ab89 for instance 3d0c26bc-24c7-43d1-a552-2d2aeb3590f0 on n-h1-854247-14 Oct 17 14:16:33.944234 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-aab21fb4-68bc-46b3-a158-6fd4160339bd req-d5e86203-1d61-4178-abd7-4154cbfe51d7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054949 Oct 17 14:16:33.945873 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2982/5829] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:16:34.265126 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-48c36102-aea9-425e-82c1-9d1ec42d36a8 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:34.265752 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-48c36102-aea9-425e-82c1-9d1ec42d36a8 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] [instance: 3d0c26bc-24c7-43d1-a552-2d2aeb3590f0] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:34.275390 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48c36102-aea9-425e-82c1-9d1ec42d36a8 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:34.276173 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48c36102-aea9-425e-82c1-9d1ec42d36a8 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:34.277142 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48c36102-aea9-425e-82c1-9d1ec42d36a8 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:34.278607 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48c36102-aea9-425e-82c1-9d1ec42d36a8 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:34.279229 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48c36102-aea9-425e-82c1-9d1ec42d36a8 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:34.279802 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48c36102-aea9-425e-82c1-9d1ec42d36a8 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:34.443402 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-48c36102-aea9-425e-82c1-9d1ec42d36a8 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7557bdf83dd344f5b8f20ce3af781a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0587423d7f44899bac419cd4e883ec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:34.451606 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-48c36102-aea9-425e-82c1-9d1ec42d36a8 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] 10.222.0.79 "GET /compute/v2.1/servers/3d0c26bc-24c7-43d1-a552-2d2aeb3590f0" status: 200 len: 1471 microversion: 2.1 time: 0.190440 Oct 17 14:16:34.452182 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2848/5830] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:34 2022] GET /compute/v2.1/servers/3d0c26bc-24c7-43d1-a552-2d2aeb3590f0 => generated 1471 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:16:34.809060 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-559fc134-3dc6-4622-a694-82fd1509f1ec tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:34.809839 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-559fc134-3dc6-4622-a694-82fd1509f1ec tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 23cb6fcb-f328-4fe2-b890-4b33bad2c78a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:34.817484 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-559fc134-3dc6-4622-a694-82fd1509f1ec tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:34.818013 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-559fc134-3dc6-4622-a694-82fd1509f1ec tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:34.818495 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-559fc134-3dc6-4622-a694-82fd1509f1ec tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:34.819296 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-559fc134-3dc6-4622-a694-82fd1509f1ec tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:34.819804 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-559fc134-3dc6-4622-a694-82fd1509f1ec tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:34.820272 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-559fc134-3dc6-4622-a694-82fd1509f1ec tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:34.962916 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-559fc134-3dc6-4622-a694-82fd1509f1ec tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:34.971079 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-559fc134-3dc6-4622-a694-82fd1509f1ec tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a" status: 200 len: 1696 microversion: 2.1 time: 0.168422 Oct 17 14:16:34.971693 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2983/5831] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:34 2022] GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a => generated 1696 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:16:35.475345 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-89fe27c9-e990-4c90-a5a2-21c8024c46b1 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:35.475959 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-89fe27c9-e990-4c90-a5a2-21c8024c46b1 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] [instance: 3d0c26bc-24c7-43d1-a552-2d2aeb3590f0] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:35.484439 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-89fe27c9-e990-4c90-a5a2-21c8024c46b1 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:35.484905 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-89fe27c9-e990-4c90-a5a2-21c8024c46b1 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:35.485363 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-89fe27c9-e990-4c90-a5a2-21c8024c46b1 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:35.486053 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-89fe27c9-e990-4c90-a5a2-21c8024c46b1 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:35.486676 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-89fe27c9-e990-4c90-a5a2-21c8024c46b1 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:35.487101 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-89fe27c9-e990-4c90-a5a2-21c8024c46b1 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:35.655645 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-89fe27c9-e990-4c90-a5a2-21c8024c46b1 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7557bdf83dd344f5b8f20ce3af781a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0587423d7f44899bac419cd4e883ec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:35.666498 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-89fe27c9-e990-4c90-a5a2-21c8024c46b1 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] 10.222.0.79 "GET /compute/v2.1/servers/3d0c26bc-24c7-43d1-a552-2d2aeb3590f0" status: 200 len: 1471 microversion: 2.1 time: 0.194668 Oct 17 14:16:35.672218 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2849/5832] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:35 2022] GET /compute/v2.1/servers/3d0c26bc-24c7-43d1-a552-2d2aeb3590f0 => generated 1471 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:16:35.995656 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-82ff8c81-bf6d-4b1a-9c39-763c304e5552 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:35.996288 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-82ff8c81-bf6d-4b1a-9c39-763c304e5552 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 23cb6fcb-f328-4fe2-b890-4b33bad2c78a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:36.004043 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-82ff8c81-bf6d-4b1a-9c39-763c304e5552 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:36.004482 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-82ff8c81-bf6d-4b1a-9c39-763c304e5552 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:36.004927 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-82ff8c81-bf6d-4b1a-9c39-763c304e5552 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:36.005634 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-82ff8c81-bf6d-4b1a-9c39-763c304e5552 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:36.006090 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-82ff8c81-bf6d-4b1a-9c39-763c304e5552 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:36.006514 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-82ff8c81-bf6d-4b1a-9c39-763c304e5552 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:36.149892 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-82ff8c81-bf6d-4b1a-9c39-763c304e5552 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:36.159227 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-82ff8c81-bf6d-4b1a-9c39-763c304e5552 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a" status: 200 len: 1696 microversion: 2.1 time: 0.167936 Oct 17 14:16:36.159990 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2984/5833] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:35 2022] GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a => generated 1696 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:16:36.696236 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f03c9b83-bc6b-4ec7-bce2-81ebc6c70d4a tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:36.696849 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f03c9b83-bc6b-4ec7-bce2-81ebc6c70d4a tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] [instance: 3d0c26bc-24c7-43d1-a552-2d2aeb3590f0] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:36.707159 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f03c9b83-bc6b-4ec7-bce2-81ebc6c70d4a tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:36.707934 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f03c9b83-bc6b-4ec7-bce2-81ebc6c70d4a tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:36.708364 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f03c9b83-bc6b-4ec7-bce2-81ebc6c70d4a tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:36.709408 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f03c9b83-bc6b-4ec7-bce2-81ebc6c70d4a tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:36.709942 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f03c9b83-bc6b-4ec7-bce2-81ebc6c70d4a tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:36.710705 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f03c9b83-bc6b-4ec7-bce2-81ebc6c70d4a tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:36.864673 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f03c9b83-bc6b-4ec7-bce2-81ebc6c70d4a tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7557bdf83dd344f5b8f20ce3af781a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0587423d7f44899bac419cd4e883ec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:36.873815 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f03c9b83-bc6b-4ec7-bce2-81ebc6c70d4a tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] 10.222.0.79 "GET /compute/v2.1/servers/3d0c26bc-24c7-43d1-a552-2d2aeb3590f0" status: 200 len: 1471 microversion: 2.1 time: 0.183705 Oct 17 14:16:36.874463 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2850/5834] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:36 2022] GET /compute/v2.1/servers/3d0c26bc-24c7-43d1-a552-2d2aeb3590f0 => generated 1471 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:16:37.184180 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fcf0f3d4-67a6-45af-9be4-97e07692ac44 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:37.184857 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-fcf0f3d4-67a6-45af-9be4-97e07692ac44 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 23cb6fcb-f328-4fe2-b890-4b33bad2c78a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:37.192490 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fcf0f3d4-67a6-45af-9be4-97e07692ac44 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:37.193138 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fcf0f3d4-67a6-45af-9be4-97e07692ac44 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:37.193636 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fcf0f3d4-67a6-45af-9be4-97e07692ac44 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:37.194494 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fcf0f3d4-67a6-45af-9be4-97e07692ac44 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:37.195249 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fcf0f3d4-67a6-45af-9be4-97e07692ac44 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:37.195737 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fcf0f3d4-67a6-45af-9be4-97e07692ac44 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:37.353996 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fcf0f3d4-67a6-45af-9be4-97e07692ac44 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:37.363035 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fcf0f3d4-67a6-45af-9be4-97e07692ac44 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a" status: 200 len: 1696 microversion: 2.1 time: 0.183143 Oct 17 14:16:37.363695 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2985/5835] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:37 2022] GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a => generated 1696 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:16:37.897768 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b480b2f2-28e8-4e18-b779-ce2290e8f6b3 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:37.898400 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b480b2f2-28e8-4e18-b779-ce2290e8f6b3 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] [instance: 3d0c26bc-24c7-43d1-a552-2d2aeb3590f0] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:37.907048 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b480b2f2-28e8-4e18-b779-ce2290e8f6b3 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:37.907927 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b480b2f2-28e8-4e18-b779-ce2290e8f6b3 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:37.908763 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b480b2f2-28e8-4e18-b779-ce2290e8f6b3 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:37.909978 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b480b2f2-28e8-4e18-b779-ce2290e8f6b3 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:37.910742 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b480b2f2-28e8-4e18-b779-ce2290e8f6b3 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:37.911343 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b480b2f2-28e8-4e18-b779-ce2290e8f6b3 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:38.072448 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b480b2f2-28e8-4e18-b779-ce2290e8f6b3 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7557bdf83dd344f5b8f20ce3af781a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0587423d7f44899bac419cd4e883ec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:38.080301 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b480b2f2-28e8-4e18-b779-ce2290e8f6b3 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] 10.222.0.79 "GET /compute/v2.1/servers/3d0c26bc-24c7-43d1-a552-2d2aeb3590f0" status: 200 len: 1471 microversion: 2.1 time: 0.186664 Oct 17 14:16:38.080885 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2851/5836] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:37 2022] GET /compute/v2.1/servers/3d0c26bc-24c7-43d1-a552-2d2aeb3590f0 => generated 1471 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:16:38.390350 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-58cd8e83-7810-4d33-9c47-da319fe2d4a5 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:38.390997 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-58cd8e83-7810-4d33-9c47-da319fe2d4a5 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 23cb6fcb-f328-4fe2-b890-4b33bad2c78a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:38.398310 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-58cd8e83-7810-4d33-9c47-da319fe2d4a5 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:38.398789 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-58cd8e83-7810-4d33-9c47-da319fe2d4a5 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:38.399222 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-58cd8e83-7810-4d33-9c47-da319fe2d4a5 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:38.400002 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-58cd8e83-7810-4d33-9c47-da319fe2d4a5 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:38.400454 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-58cd8e83-7810-4d33-9c47-da319fe2d4a5 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:38.400848 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-58cd8e83-7810-4d33-9c47-da319fe2d4a5 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:38.543996 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-58cd8e83-7810-4d33-9c47-da319fe2d4a5 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:38.557316 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-58cd8e83-7810-4d33-9c47-da319fe2d4a5 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a" status: 200 len: 1696 microversion: 2.1 time: 0.171362 Oct 17 14:16:38.558520 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2986/5837] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:38 2022] GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a => generated 1696 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:16:39.105006 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d44ed27c-d261-4b02-b1a0-6ab60c6c0e24 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:39.105785 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d44ed27c-d261-4b02-b1a0-6ab60c6c0e24 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] [instance: 3d0c26bc-24c7-43d1-a552-2d2aeb3590f0] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:39.114229 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d44ed27c-d261-4b02-b1a0-6ab60c6c0e24 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:39.114684 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d44ed27c-d261-4b02-b1a0-6ab60c6c0e24 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:39.115149 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d44ed27c-d261-4b02-b1a0-6ab60c6c0e24 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:39.115883 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d44ed27c-d261-4b02-b1a0-6ab60c6c0e24 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:39.116311 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d44ed27c-d261-4b02-b1a0-6ab60c6c0e24 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:39.116756 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d44ed27c-d261-4b02-b1a0-6ab60c6c0e24 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:39.269720 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d44ed27c-d261-4b02-b1a0-6ab60c6c0e24 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7557bdf83dd344f5b8f20ce3af781a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0587423d7f44899bac419cd4e883ec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:39.280492 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d44ed27c-d261-4b02-b1a0-6ab60c6c0e24 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] 10.222.0.79 "GET /compute/v2.1/servers/3d0c26bc-24c7-43d1-a552-2d2aeb3590f0" status: 200 len: 1471 microversion: 2.1 time: 0.180396 Oct 17 14:16:39.281118 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2852/5838] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:39 2022] GET /compute/v2.1/servers/3d0c26bc-24c7-43d1-a552-2d2aeb3590f0 => generated 1471 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:16:39.437036 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-d1538728-7867-4ea1-94fd-22aec6c94db0 req-fa45ebf2-ca67-4bb7-a045-552562fec832 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d0c26bc-24c7-43d1-a552-2d2aeb3590f0", "name": "network-vif-plugged", "status": "completed", "tag": "15941bb8-9645-43d7-8f65-311354b6ab89"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:16:39.449481 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-d1538728-7867-4ea1-94fd-22aec6c94db0 req-fa45ebf2-ca67-4bb7-a045-552562fec832 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:39.449981 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-d1538728-7867-4ea1-94fd-22aec6c94db0 req-fa45ebf2-ca67-4bb7-a045-552562fec832 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:39.450410 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-d1538728-7867-4ea1-94fd-22aec6c94db0 req-fa45ebf2-ca67-4bb7-a045-552562fec832 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:39.463028 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-d1538728-7867-4ea1-94fd-22aec6c94db0 req-fa45ebf2-ca67-4bb7-a045-552562fec832 service nova] Creating event network-vif-plugged:15941bb8-9645-43d7-8f65-311354b6ab89 for instance 3d0c26bc-24c7-43d1-a552-2d2aeb3590f0 on n-h1-854247-14 Oct 17 14:16:39.469190 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-d1538728-7867-4ea1-94fd-22aec6c94db0 req-fa45ebf2-ca67-4bb7-a045-552562fec832 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036726 Oct 17 14:16:39.470407 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2987/5839] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:16:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:16:39.582174 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0d0a2284-6096-4a78-86e4-985c0452feb7 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:39.582790 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0d0a2284-6096-4a78-86e4-985c0452feb7 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 23cb6fcb-f328-4fe2-b890-4b33bad2c78a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:39.589311 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0d0a2284-6096-4a78-86e4-985c0452feb7 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:39.589801 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0d0a2284-6096-4a78-86e4-985c0452feb7 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:39.590230 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0d0a2284-6096-4a78-86e4-985c0452feb7 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:39.590923 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0d0a2284-6096-4a78-86e4-985c0452feb7 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:39.591422 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0d0a2284-6096-4a78-86e4-985c0452feb7 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:39.591847 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0d0a2284-6096-4a78-86e4-985c0452feb7 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:39.732291 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0d0a2284-6096-4a78-86e4-985c0452feb7 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:39.740498 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0d0a2284-6096-4a78-86e4-985c0452feb7 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a" status: 200 len: 1696 microversion: 2.1 time: 0.162345 Oct 17 14:16:39.741086 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2853/5840] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:39 2022] GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a => generated 1696 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:16:40.305346 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cb380733-3761-4b61-9a3a-f06649697d4a tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:40.306494 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cb380733-3761-4b61-9a3a-f06649697d4a tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] [instance: 3d0c26bc-24c7-43d1-a552-2d2aeb3590f0] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:40.314273 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb380733-3761-4b61-9a3a-f06649697d4a tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:40.314767 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb380733-3761-4b61-9a3a-f06649697d4a tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:40.315231 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb380733-3761-4b61-9a3a-f06649697d4a tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:40.315936 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb380733-3761-4b61-9a3a-f06649697d4a tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:40.316549 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb380733-3761-4b61-9a3a-f06649697d4a tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:40.317017 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb380733-3761-4b61-9a3a-f06649697d4a tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:40.480598 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cb380733-3761-4b61-9a3a-f06649697d4a tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7557bdf83dd344f5b8f20ce3af781a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0587423d7f44899bac419cd4e883ec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:40.490226 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cb380733-3761-4b61-9a3a-f06649697d4a tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] 10.222.0.79 "GET /compute/v2.1/servers/3d0c26bc-24c7-43d1-a552-2d2aeb3590f0" status: 200 len: 1471 microversion: 2.1 time: 0.189982 Oct 17 14:16:40.495861 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2988/5841] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:40 2022] GET /compute/v2.1/servers/3d0c26bc-24c7-43d1-a552-2d2aeb3590f0 => generated 1471 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:16:40.763549 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f6f95082-d986-4ec9-9482-62fc64c8b415 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:40.764159 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f6f95082-d986-4ec9-9482-62fc64c8b415 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 23cb6fcb-f328-4fe2-b890-4b33bad2c78a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:40.767062 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:16:40.767763 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=6 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:16:40.774075 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f6f95082-d986-4ec9-9482-62fc64c8b415 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:40.774707 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f6f95082-d986-4ec9-9482-62fc64c8b415 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:40.775128 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f6f95082-d986-4ec9-9482-62fc64c8b415 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:40.775998 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f6f95082-d986-4ec9-9482-62fc64c8b415 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:40.776549 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f6f95082-d986-4ec9-9482-62fc64c8b415 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:40.777050 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f6f95082-d986-4ec9-9482-62fc64c8b415 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:40.962494 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f6f95082-d986-4ec9-9482-62fc64c8b415 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:40.971286 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f6f95082-d986-4ec9-9482-62fc64c8b415 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a" status: 200 len: 1696 microversion: 2.1 time: 0.211752 Oct 17 14:16:40.972016 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2854/5842] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:40 2022] GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a => generated 1696 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:16:41.514015 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-721c1c3e-fa5a-49ab-8fad-5fdf23107269 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:41.514853 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-721c1c3e-fa5a-49ab-8fad-5fdf23107269 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] [instance: 3d0c26bc-24c7-43d1-a552-2d2aeb3590f0] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:41.517199 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=6 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:16:41.523426 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-721c1c3e-fa5a-49ab-8fad-5fdf23107269 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:41.523898 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-721c1c3e-fa5a-49ab-8fad-5fdf23107269 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:41.524520 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-721c1c3e-fa5a-49ab-8fad-5fdf23107269 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:41.525198 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-721c1c3e-fa5a-49ab-8fad-5fdf23107269 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:41.525689 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-721c1c3e-fa5a-49ab-8fad-5fdf23107269 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:41.526112 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-721c1c3e-fa5a-49ab-8fad-5fdf23107269 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:41.558070 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-203fc5c8-7b59-4daa-a9fe-254ce55270b9 req-2b4ce7da-8527-4c41-975f-6ed576859c61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23cb6fcb-f328-4fe2-b890-4b33bad2c78a", "name": "network-vif-unplugged", "status": "completed", "tag": "84607819-b683-4572-99ca-fc1431266e3d"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:16:41.572331 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-203fc5c8-7b59-4daa-a9fe-254ce55270b9 req-2b4ce7da-8527-4c41-975f-6ed576859c61 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:41.573528 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-203fc5c8-7b59-4daa-a9fe-254ce55270b9 req-2b4ce7da-8527-4c41-975f-6ed576859c61 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:41.574964 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-203fc5c8-7b59-4daa-a9fe-254ce55270b9 req-2b4ce7da-8527-4c41-975f-6ed576859c61 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:41.592320 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-203fc5c8-7b59-4daa-a9fe-254ce55270b9 req-2b4ce7da-8527-4c41-975f-6ed576859c61 service nova] Creating event network-vif-unplugged:84607819-b683-4572-99ca-fc1431266e3d for instance 23cb6fcb-f328-4fe2-b890-4b33bad2c78a on n-h1-854247-14 Oct 17 14:16:41.608709 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [req-203fc5c8-7b59-4daa-a9fe-254ce55270b9 req-2b4ce7da-8527-4c41-975f-6ed576859c61 service nova] Instance 23cb6fcb-f328-4fe2-b890-4b33bad2c78a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854247-14', 'n-h1-854247-14'} {{(pid=127017) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 14:16:41.625750 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-203fc5c8-7b59-4daa-a9fe-254ce55270b9 req-2b4ce7da-8527-4c41-975f-6ed576859c61 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075042 Oct 17 14:16:41.626685 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2855/5843] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:16:41.692479 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-721c1c3e-fa5a-49ab-8fad-5fdf23107269 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7557bdf83dd344f5b8f20ce3af781a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0587423d7f44899bac419cd4e883ec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:41.701349 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-721c1c3e-fa5a-49ab-8fad-5fdf23107269 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] 10.222.0.79 "GET /compute/v2.1/servers/3d0c26bc-24c7-43d1-a552-2d2aeb3590f0" status: 200 len: 1643 microversion: 2.1 time: 0.191293 Oct 17 14:16:41.702419 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2989/5844] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:41 2022] GET /compute/v2.1/servers/3d0c26bc-24c7-43d1-a552-2d2aeb3590f0 => generated 1643 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:16:41.724823 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-60a14644-f3c1-47a0-947e-5f770b0a263d tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:41.725440 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-60a14644-f3c1-47a0-947e-5f770b0a263d tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] [instance: 3d0c26bc-24c7-43d1-a552-2d2aeb3590f0] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:41.732349 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-60a14644-f3c1-47a0-947e-5f770b0a263d tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:41.732907 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-60a14644-f3c1-47a0-947e-5f770b0a263d tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:41.733445 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-60a14644-f3c1-47a0-947e-5f770b0a263d tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:41.734173 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-60a14644-f3c1-47a0-947e-5f770b0a263d tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:41.734780 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-60a14644-f3c1-47a0-947e-5f770b0a263d tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:41.735260 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-60a14644-f3c1-47a0-947e-5f770b0a263d tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:41.884096 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-60a14644-f3c1-47a0-947e-5f770b0a263d tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7557bdf83dd344f5b8f20ce3af781a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0587423d7f44899bac419cd4e883ec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:41.892498 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-60a14644-f3c1-47a0-947e-5f770b0a263d tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] 10.222.0.79 "GET /compute/v2.1/servers/3d0c26bc-24c7-43d1-a552-2d2aeb3590f0" status: 200 len: 1643 microversion: 2.1 time: 0.172030 Oct 17 14:16:41.893106 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2856/5845] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:41 2022] GET /compute/v2.1/servers/3d0c26bc-24c7-43d1-a552-2d2aeb3590f0 => generated 1643 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:16:41.914410 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a0aece38-357c-47ee-b931-2d0dd768cb2f tempest-TestSecurityGroupsBasicOps-418240873 tempest-TestSecurityGroupsBasicOps-418240873-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:41.915109 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a0aece38-357c-47ee-b931-2d0dd768cb2f tempest-TestSecurityGroupsBasicOps-418240873 tempest-TestSecurityGroupsBasicOps-418240873-project-admin] [instance: 3d0c26bc-24c7-43d1-a552-2d2aeb3590f0] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:41.921948 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a0aece38-357c-47ee-b931-2d0dd768cb2f tempest-TestSecurityGroupsBasicOps-418240873 tempest-TestSecurityGroupsBasicOps-418240873-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:41.922278 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a0aece38-357c-47ee-b931-2d0dd768cb2f tempest-TestSecurityGroupsBasicOps-418240873 tempest-TestSecurityGroupsBasicOps-418240873-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:41.922720 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a0aece38-357c-47ee-b931-2d0dd768cb2f tempest-TestSecurityGroupsBasicOps-418240873 tempest-TestSecurityGroupsBasicOps-418240873-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:41.923526 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a0aece38-357c-47ee-b931-2d0dd768cb2f tempest-TestSecurityGroupsBasicOps-418240873 tempest-TestSecurityGroupsBasicOps-418240873-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:41.923988 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a0aece38-357c-47ee-b931-2d0dd768cb2f tempest-TestSecurityGroupsBasicOps-418240873 tempest-TestSecurityGroupsBasicOps-418240873-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:41.924422 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a0aece38-357c-47ee-b931-2d0dd768cb2f tempest-TestSecurityGroupsBasicOps-418240873 tempest-TestSecurityGroupsBasicOps-418240873-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:41.995105 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c87eae74-a6b2-451d-8d41-a4f18db1d55e tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:41.996038 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c87eae74-a6b2-451d-8d41-a4f18db1d55e tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 23cb6fcb-f328-4fe2-b890-4b33bad2c78a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:42.002443 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c87eae74-a6b2-451d-8d41-a4f18db1d55e tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:42.002930 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c87eae74-a6b2-451d-8d41-a4f18db1d55e tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:42.003714 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c87eae74-a6b2-451d-8d41-a4f18db1d55e tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:42.004262 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c87eae74-a6b2-451d-8d41-a4f18db1d55e tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:42.004793 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c87eae74-a6b2-451d-8d41-a4f18db1d55e tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:42.005277 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c87eae74-a6b2-451d-8d41-a4f18db1d55e tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:42.236684 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c87eae74-a6b2-451d-8d41-a4f18db1d55e tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:42.246035 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c87eae74-a6b2-451d-8d41-a4f18db1d55e tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a" status: 200 len: 1695 microversion: 2.1 time: 0.254917 Oct 17 14:16:42.248534 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2857/5846] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:41 2022] GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a => generated 1695 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:16:42.321748 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a0aece38-357c-47ee-b931-2d0dd768cb2f tempest-TestSecurityGroupsBasicOps-418240873 tempest-TestSecurityGroupsBasicOps-418240873-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/3d0c26bc-24c7-43d1-a552-2d2aeb3590f0" status: 200 len: 1796 microversion: 2.1 time: 0.411041 Oct 17 14:16:42.322728 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2990/5847] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:41 2022] GET /compute/v2.1/servers/3d0c26bc-24c7-43d1-a552-2d2aeb3590f0 => generated 1796 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:16:43.270253 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ad4f1dc0-5bc1-428c-b449-3bfd73ec0a6c tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:43.270869 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ad4f1dc0-5bc1-428c-b449-3bfd73ec0a6c tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 23cb6fcb-f328-4fe2-b890-4b33bad2c78a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:43.278015 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ad4f1dc0-5bc1-428c-b449-3bfd73ec0a6c tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:43.278640 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ad4f1dc0-5bc1-428c-b449-3bfd73ec0a6c tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:43.279073 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ad4f1dc0-5bc1-428c-b449-3bfd73ec0a6c tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:43.279951 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ad4f1dc0-5bc1-428c-b449-3bfd73ec0a6c tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:43.280543 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ad4f1dc0-5bc1-428c-b449-3bfd73ec0a6c tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:43.280987 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ad4f1dc0-5bc1-428c-b449-3bfd73ec0a6c tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:43.672683 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-a4372ca7-e132-47f8-b8b5-8c99f8b3930b req-dc4f5ef6-581f-45a8-a035-dc03aa5d4de1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23cb6fcb-f328-4fe2-b890-4b33bad2c78a", "tag": "84607819-b683-4572-99ca-fc1431266e3d"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:16:43.683820 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-a4372ca7-e132-47f8-b8b5-8c99f8b3930b req-dc4f5ef6-581f-45a8-a035-dc03aa5d4de1 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:43.684295 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-a4372ca7-e132-47f8-b8b5-8c99f8b3930b req-dc4f5ef6-581f-45a8-a035-dc03aa5d4de1 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:43.684725 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-a4372ca7-e132-47f8-b8b5-8c99f8b3930b req-dc4f5ef6-581f-45a8-a035-dc03aa5d4de1 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:43.699974 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-a4372ca7-e132-47f8-b8b5-8c99f8b3930b req-dc4f5ef6-581f-45a8-a035-dc03aa5d4de1 service nova] Creating event network-changed:84607819-b683-4572-99ca-fc1431266e3d for instance 23cb6fcb-f328-4fe2-b890-4b33bad2c78a on n-h1-854247-14 Oct 17 14:16:43.705473 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [req-a4372ca7-e132-47f8-b8b5-8c99f8b3930b req-dc4f5ef6-581f-45a8-a035-dc03aa5d4de1 service nova] Instance 23cb6fcb-f328-4fe2-b890-4b33bad2c78a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854247-14', 'n-h1-854247-14'} {{(pid=127016) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 14:16:43.716885 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-a4372ca7-e132-47f8-b8b5-8c99f8b3930b req-dc4f5ef6-581f-45a8-a035-dc03aa5d4de1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047951 Oct 17 14:16:43.717491 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2991/5848] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:16:43.851329 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ad4f1dc0-5bc1-428c-b449-3bfd73ec0a6c tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:43.860082 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ad4f1dc0-5bc1-428c-b449-3bfd73ec0a6c tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a" status: 200 len: 1693 microversion: 2.1 time: 0.593777 Oct 17 14:16:43.875629 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2858/5849] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:43 2022] GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a => generated 1693 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:16:44.883022 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-d6f788ca-6056-49b1-a182-8aeb77da1d18 req-730fa974-c498-483c-ab15-379ef629f7cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d0c26bc-24c7-43d1-a552-2d2aeb3590f0", "tag": "15941bb8-9645-43d7-8f65-311354b6ab89"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:16:44.885485 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2ecac233-f883-495c-8073-8d473ec461d6 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:44.886762 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2ecac233-f883-495c-8073-8d473ec461d6 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 23cb6fcb-f328-4fe2-b890-4b33bad2c78a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:44.893485 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-d6f788ca-6056-49b1-a182-8aeb77da1d18 req-730fa974-c498-483c-ab15-379ef629f7cb service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:44.893967 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-d6f788ca-6056-49b1-a182-8aeb77da1d18 req-730fa974-c498-483c-ab15-379ef629f7cb service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:44.894395 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-d6f788ca-6056-49b1-a182-8aeb77da1d18 req-730fa974-c498-483c-ab15-379ef629f7cb service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:44.896459 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2ecac233-f883-495c-8073-8d473ec461d6 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:44.897247 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2ecac233-f883-495c-8073-8d473ec461d6 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:44.897899 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2ecac233-f883-495c-8073-8d473ec461d6 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:44.898909 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2ecac233-f883-495c-8073-8d473ec461d6 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:44.899500 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2ecac233-f883-495c-8073-8d473ec461d6 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:44.900140 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2ecac233-f883-495c-8073-8d473ec461d6 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:44.906724 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-d6f788ca-6056-49b1-a182-8aeb77da1d18 req-730fa974-c498-483c-ab15-379ef629f7cb service nova] Creating event network-changed:15941bb8-9645-43d7-8f65-311354b6ab89 for instance 3d0c26bc-24c7-43d1-a552-2d2aeb3590f0 on n-h1-854247-14 Oct 17 14:16:44.911849 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-d6f788ca-6056-49b1-a182-8aeb77da1d18 req-730fa974-c498-483c-ab15-379ef629f7cb service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033949 Oct 17 14:16:44.915717 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2992/5850] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:16:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:16:45.050488 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2ecac233-f883-495c-8073-8d473ec461d6 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:45.059590 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2ecac233-f883-495c-8073-8d473ec461d6 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a" status: 200 len: 1690 microversion: 2.1 time: 0.179553 Oct 17 14:16:45.060293 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2859/5851] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:44 2022] GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a => generated 1690 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:16:45.083860 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5d53bb2e-c996-4399-8c76-1f05b8b8f2fc tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:16:45.084815 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5d53bb2e-c996-4399-8c76-1f05b8b8f2fc tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 23cb6fcb-f328-4fe2-b890-4b33bad2c78a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:45.092189 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5d53bb2e-c996-4399-8c76-1f05b8b8f2fc tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:45.094619 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5d53bb2e-c996-4399-8c76-1f05b8b8f2fc tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:45.095629 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5d53bb2e-c996-4399-8c76-1f05b8b8f2fc tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:45.096413 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5d53bb2e-c996-4399-8c76-1f05b8b8f2fc tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:45.096882 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5d53bb2e-c996-4399-8c76-1f05b8b8f2fc tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:45.097470 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5d53bb2e-c996-4399-8c76-1f05b8b8f2fc tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:45.171053 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5d53bb2e-c996-4399-8c76-1f05b8b8f2fc tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "POST /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a/action" status: 204 len: 0 microversion: 2.1 time: 0.091187 Oct 17 14:16:45.172407 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2993/5852] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:16:45 2022] POST /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a/action => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:16:45.180830 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-107b1374-0b35-4a7a-bf1e-18d8bb5ccf06 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:45.181804 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-107b1374-0b35-4a7a-bf1e-18d8bb5ccf06 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 23cb6fcb-f328-4fe2-b890-4b33bad2c78a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:45.188673 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-107b1374-0b35-4a7a-bf1e-18d8bb5ccf06 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:45.189522 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-107b1374-0b35-4a7a-bf1e-18d8bb5ccf06 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:45.190186 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-107b1374-0b35-4a7a-bf1e-18d8bb5ccf06 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:45.191552 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-107b1374-0b35-4a7a-bf1e-18d8bb5ccf06 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:45.192839 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-107b1374-0b35-4a7a-bf1e-18d8bb5ccf06 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:45.193518 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-107b1374-0b35-4a7a-bf1e-18d8bb5ccf06 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:45.614594 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-107b1374-0b35-4a7a-bf1e-18d8bb5ccf06 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:45.623822 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-107b1374-0b35-4a7a-bf1e-18d8bb5ccf06 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a" status: 200 len: 1690 microversion: 2.1 time: 0.446838 Oct 17 14:16:45.627574 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2860/5853] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:45 2022] GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a => generated 1690 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:16:46.656746 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3b3671c7-86c8-4aaf-be6c-a9e9befaef99 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:46.657459 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3b3671c7-86c8-4aaf-be6c-a9e9befaef99 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 23cb6fcb-f328-4fe2-b890-4b33bad2c78a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:46.664315 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3b3671c7-86c8-4aaf-be6c-a9e9befaef99 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:46.664800 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3b3671c7-86c8-4aaf-be6c-a9e9befaef99 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:46.665240 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3b3671c7-86c8-4aaf-be6c-a9e9befaef99 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:46.665945 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3b3671c7-86c8-4aaf-be6c-a9e9befaef99 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:46.666402 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3b3671c7-86c8-4aaf-be6c-a9e9befaef99 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:46.666828 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3b3671c7-86c8-4aaf-be6c-a9e9befaef99 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:46.808566 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3b3671c7-86c8-4aaf-be6c-a9e9befaef99 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:46.817390 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3b3671c7-86c8-4aaf-be6c-a9e9befaef99 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a" status: 200 len: 1690 microversion: 2.1 time: 0.166101 Oct 17 14:16:46.817968 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2994/5854] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:46 2022] GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a => generated 1690 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:16:47.478172 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-75251255-0d55-4217-9e1e-59b173e77aab req-0e96a608-ff75-4449-8233-9cc5fbdc06e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23cb6fcb-f328-4fe2-b890-4b33bad2c78a", "name": "network-vif-plugged", "status": "completed", "tag": "84607819-b683-4572-99ca-fc1431266e3d"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:16:47.489218 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-75251255-0d55-4217-9e1e-59b173e77aab req-0e96a608-ff75-4449-8233-9cc5fbdc06e5 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:47.489705 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-75251255-0d55-4217-9e1e-59b173e77aab req-0e96a608-ff75-4449-8233-9cc5fbdc06e5 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:47.490319 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-75251255-0d55-4217-9e1e-59b173e77aab req-0e96a608-ff75-4449-8233-9cc5fbdc06e5 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:47.502714 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-75251255-0d55-4217-9e1e-59b173e77aab req-0e96a608-ff75-4449-8233-9cc5fbdc06e5 service nova] Creating event network-vif-plugged:84607819-b683-4572-99ca-fc1431266e3d for instance 23cb6fcb-f328-4fe2-b890-4b33bad2c78a on n-h1-854247-14 Oct 17 14:16:47.508092 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-75251255-0d55-4217-9e1e-59b173e77aab req-0e96a608-ff75-4449-8233-9cc5fbdc06e5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033663 Oct 17 14:16:47.508709 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2861/5855] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:16:47.841543 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-37cb24bc-0ffb-4c65-8a03-7bc20f94090a tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:47.842132 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-37cb24bc-0ffb-4c65-8a03-7bc20f94090a tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 23cb6fcb-f328-4fe2-b890-4b33bad2c78a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:47.849659 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-37cb24bc-0ffb-4c65-8a03-7bc20f94090a tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:47.850146 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-37cb24bc-0ffb-4c65-8a03-7bc20f94090a tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:47.850587 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-37cb24bc-0ffb-4c65-8a03-7bc20f94090a tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:47.851323 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-37cb24bc-0ffb-4c65-8a03-7bc20f94090a tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:47.851777 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-37cb24bc-0ffb-4c65-8a03-7bc20f94090a tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:47.852204 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-37cb24bc-0ffb-4c65-8a03-7bc20f94090a tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:47.993972 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-37cb24bc-0ffb-4c65-8a03-7bc20f94090a tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:48.002518 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-37cb24bc-0ffb-4c65-8a03-7bc20f94090a tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a" status: 200 len: 1682 microversion: 2.1 time: 0.165078 Oct 17 14:16:48.003092 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2995/5856] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:47 2022] GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:16:52.488968 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-2c286ed6-97fb-4d97-a211-8b3155aa1a20 req-f6208ed8-17cd-4b2c-99b4-e3f46b073194 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a05629df-accf-4f2f-9d9d-d7602cf69fd4", "tag": "bc3c5aa2-8155-4ccb-b05d-983598a72fc7"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:16:52.494916 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-40e13d5c-a240-4df7-b89f-09da34fa974e tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:52.499623 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-40e13d5c-a240-4df7-b89f-09da34fa974e tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] [instance: a05629df-accf-4f2f-9d9d-d7602cf69fd4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:52.506004 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-2c286ed6-97fb-4d97-a211-8b3155aa1a20 req-f6208ed8-17cd-4b2c-99b4-e3f46b073194 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:52.506579 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-2c286ed6-97fb-4d97-a211-8b3155aa1a20 req-f6208ed8-17cd-4b2c-99b4-e3f46b073194 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:52.507066 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-2c286ed6-97fb-4d97-a211-8b3155aa1a20 req-f6208ed8-17cd-4b2c-99b4-e3f46b073194 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:52.507402 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-40e13d5c-a240-4df7-b89f-09da34fa974e tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:52.507912 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-40e13d5c-a240-4df7-b89f-09da34fa974e tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:52.508343 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-40e13d5c-a240-4df7-b89f-09da34fa974e tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:52.509046 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-40e13d5c-a240-4df7-b89f-09da34fa974e tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:52.509747 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-40e13d5c-a240-4df7-b89f-09da34fa974e tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:52.510217 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-40e13d5c-a240-4df7-b89f-09da34fa974e tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:52.520207 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-2c286ed6-97fb-4d97-a211-8b3155aa1a20 req-f6208ed8-17cd-4b2c-99b4-e3f46b073194 service nova] Creating event network-changed:bc3c5aa2-8155-4ccb-b05d-983598a72fc7 for instance a05629df-accf-4f2f-9d9d-d7602cf69fd4 on n-h2-854247-14 Oct 17 14:16:52.525717 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-2c286ed6-97fb-4d97-a211-8b3155aa1a20 req-f6208ed8-17cd-4b2c-99b4-e3f46b073194 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041119 Oct 17 14:16:52.526961 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2996/5857] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:16:52.544550 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-40e13d5c-a240-4df7-b89f-09da34fa974e tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] [instance: a05629df-accf-4f2f-9d9d-d7602cf69fd4] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:16:52.570801 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=100 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:16:52.639883 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-40e13d5c-a240-4df7-b89f-09da34fa974e tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a05629df-accf-4f2f-9d9d-d7602cf69fd4" status: 204 len: 0 microversion: 2.1 time: 0.156681 Oct 17 14:16:52.649804 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2862/5858] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:16:52 2022] DELETE /compute/v2.1/servers/a05629df-accf-4f2f-9d9d-d7602cf69fd4 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:16:52.654641 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-bc4f66dc-0cbc-49ee-8642-82ae68ffb94b tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:52.661160 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-bc4f66dc-0cbc-49ee-8642-82ae68ffb94b tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] [instance: a05629df-accf-4f2f-9d9d-d7602cf69fd4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:52.672321 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bc4f66dc-0cbc-49ee-8642-82ae68ffb94b tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:52.673183 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bc4f66dc-0cbc-49ee-8642-82ae68ffb94b tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:52.673622 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bc4f66dc-0cbc-49ee-8642-82ae68ffb94b tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:52.674868 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bc4f66dc-0cbc-49ee-8642-82ae68ffb94b tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:52.676164 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bc4f66dc-0cbc-49ee-8642-82ae68ffb94b tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:52.676734 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bc4f66dc-0cbc-49ee-8642-82ae68ffb94b tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:52.697436 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:16:52.830592 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-bc4f66dc-0cbc-49ee-8642-82ae68ffb94b tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880bf3983987453ba9c29d8b73159e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eecf5c8d73944dabf3a0e0f64123745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:52.839083 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-bc4f66dc-0cbc-49ee-8642-82ae68ffb94b tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] 10.222.0.79 "GET /compute/v2.1/servers/a05629df-accf-4f2f-9d9d-d7602cf69fd4" status: 200 len: 1582 microversion: 2.1 time: 0.191687 Oct 17 14:16:52.839697 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2997/5859] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:52 2022] GET /compute/v2.1/servers/a05629df-accf-4f2f-9d9d-d7602cf69fd4 => generated 1582 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:16:53.864819 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-719b3815-278a-4527-96b2-2eae3489ed19 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:53.865557 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-719b3815-278a-4527-96b2-2eae3489ed19 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] [instance: a05629df-accf-4f2f-9d9d-d7602cf69fd4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:53.872840 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-719b3815-278a-4527-96b2-2eae3489ed19 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:53.873326 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-719b3815-278a-4527-96b2-2eae3489ed19 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:53.873760 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-719b3815-278a-4527-96b2-2eae3489ed19 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:53.874425 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-719b3815-278a-4527-96b2-2eae3489ed19 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:53.874874 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-719b3815-278a-4527-96b2-2eae3489ed19 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:53.875527 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-719b3815-278a-4527-96b2-2eae3489ed19 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:54.044308 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-719b3815-278a-4527-96b2-2eae3489ed19 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880bf3983987453ba9c29d8b73159e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eecf5c8d73944dabf3a0e0f64123745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:54.052732 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-719b3815-278a-4527-96b2-2eae3489ed19 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] 10.222.0.79 "GET /compute/v2.1/servers/a05629df-accf-4f2f-9d9d-d7602cf69fd4" status: 200 len: 1582 microversion: 2.1 time: 0.192351 Oct 17 14:16:54.053312 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2863/5860] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:53 2022] GET /compute/v2.1/servers/a05629df-accf-4f2f-9d9d-d7602cf69fd4 => generated 1582 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:16:54.643541 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-f63b115b-8184-4dfd-9b02-df000d8eaf56 req-00979156-623c-409f-b42e-99a9f8a91377 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a05629df-accf-4f2f-9d9d-d7602cf69fd4", "name": "network-vif-deleted", "tag": "bc3c5aa2-8155-4ccb-b05d-983598a72fc7"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:16:54.656316 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-f63b115b-8184-4dfd-9b02-df000d8eaf56 req-00979156-623c-409f-b42e-99a9f8a91377 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:54.656804 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-f63b115b-8184-4dfd-9b02-df000d8eaf56 req-00979156-623c-409f-b42e-99a9f8a91377 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:54.657235 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-f63b115b-8184-4dfd-9b02-df000d8eaf56 req-00979156-623c-409f-b42e-99a9f8a91377 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:54.673227 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-f63b115b-8184-4dfd-9b02-df000d8eaf56 req-00979156-623c-409f-b42e-99a9f8a91377 service nova] Creating event network-vif-deleted:bc3c5aa2-8155-4ccb-b05d-983598a72fc7 for instance a05629df-accf-4f2f-9d9d-d7602cf69fd4 on n-h2-854247-14 Oct 17 14:16:54.678519 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-f63b115b-8184-4dfd-9b02-df000d8eaf56 req-00979156-623c-409f-b42e-99a9f8a91377 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038864 Oct 17 14:16:54.679378 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2998/5861] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:16:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:16:55.075759 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a4a5ba37-1d30-434d-8a74-343e60df3a4b tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:55.076341 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a4a5ba37-1d30-434d-8a74-343e60df3a4b tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] [instance: a05629df-accf-4f2f-9d9d-d7602cf69fd4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:55.083711 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a4a5ba37-1d30-434d-8a74-343e60df3a4b tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:55.084188 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a4a5ba37-1d30-434d-8a74-343e60df3a4b tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:55.084616 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a4a5ba37-1d30-434d-8a74-343e60df3a4b tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:55.085319 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a4a5ba37-1d30-434d-8a74-343e60df3a4b tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:55.085761 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a4a5ba37-1d30-434d-8a74-343e60df3a4b tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:55.086197 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a4a5ba37-1d30-434d-8a74-343e60df3a4b tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:55.152990 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a4a5ba37-1d30-434d-8a74-343e60df3a4b tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880bf3983987453ba9c29d8b73159e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eecf5c8d73944dabf3a0e0f64123745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:55.161244 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a4a5ba37-1d30-434d-8a74-343e60df3a4b tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] 10.222.0.79 "GET /compute/v2.1/servers/a05629df-accf-4f2f-9d9d-d7602cf69fd4" status: 200 len: 1227 microversion: 2.1 time: 0.089331 Oct 17 14:16:55.161722 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2864/5862] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:55 2022] GET /compute/v2.1/servers/a05629df-accf-4f2f-9d9d-d7602cf69fd4 => generated 1227 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:16:56.186622 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4fc77cef-81a2-4007-8c28-8454524f4904 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:56.187387 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4fc77cef-81a2-4007-8c28-8454524f4904 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] [instance: a05629df-accf-4f2f-9d9d-d7602cf69fd4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:56.195088 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4fc77cef-81a2-4007-8c28-8454524f4904 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:56.195610 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4fc77cef-81a2-4007-8c28-8454524f4904 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:56.196050 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4fc77cef-81a2-4007-8c28-8454524f4904 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:56.196747 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4fc77cef-81a2-4007-8c28-8454524f4904 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:56.197202 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4fc77cef-81a2-4007-8c28-8454524f4904 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:56.197890 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4fc77cef-81a2-4007-8c28-8454524f4904 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:56.265054 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4fc77cef-81a2-4007-8c28-8454524f4904 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880bf3983987453ba9c29d8b73159e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eecf5c8d73944dabf3a0e0f64123745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:56.274114 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4fc77cef-81a2-4007-8c28-8454524f4904 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] 10.222.0.79 "GET /compute/v2.1/servers/a05629df-accf-4f2f-9d9d-d7602cf69fd4" status: 200 len: 1227 microversion: 2.1 time: 0.093136 Oct 17 14:16:56.274776 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 2999/5863] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:56 2022] GET /compute/v2.1/servers/a05629df-accf-4f2f-9d9d-d7602cf69fd4 => generated 1227 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:16:57.297326 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-06facaea-5a63-4222-be61-e8b6714a16c3 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:57.297954 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-06facaea-5a63-4222-be61-e8b6714a16c3 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] [instance: a05629df-accf-4f2f-9d9d-d7602cf69fd4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:57.305336 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-06facaea-5a63-4222-be61-e8b6714a16c3 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:57.305825 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-06facaea-5a63-4222-be61-e8b6714a16c3 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:57.306731 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-06facaea-5a63-4222-be61-e8b6714a16c3 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:57.307448 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-06facaea-5a63-4222-be61-e8b6714a16c3 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:57.308204 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-06facaea-5a63-4222-be61-e8b6714a16c3 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:57.308663 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-06facaea-5a63-4222-be61-e8b6714a16c3 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:57.373250 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-06facaea-5a63-4222-be61-e8b6714a16c3 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880bf3983987453ba9c29d8b73159e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eecf5c8d73944dabf3a0e0f64123745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:57.383145 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-06facaea-5a63-4222-be61-e8b6714a16c3 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] 10.222.0.79 "GET /compute/v2.1/servers/a05629df-accf-4f2f-9d9d-d7602cf69fd4" status: 200 len: 1227 microversion: 2.1 time: 0.089722 Oct 17 14:16:57.384155 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2865/5864] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:57 2022] GET /compute/v2.1/servers/a05629df-accf-4f2f-9d9d-d7602cf69fd4 => generated 1227 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:16:58.406596 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-eaba244d-e7fa-4d04-affc-c9199169fa19 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:58.407233 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-eaba244d-e7fa-4d04-affc-c9199169fa19 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] [instance: a05629df-accf-4f2f-9d9d-d7602cf69fd4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:58.413839 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eaba244d-e7fa-4d04-affc-c9199169fa19 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:58.414329 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eaba244d-e7fa-4d04-affc-c9199169fa19 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:58.414764 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eaba244d-e7fa-4d04-affc-c9199169fa19 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:58.415517 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eaba244d-e7fa-4d04-affc-c9199169fa19 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:58.415960 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eaba244d-e7fa-4d04-affc-c9199169fa19 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:58.416390 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eaba244d-e7fa-4d04-affc-c9199169fa19 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:58.483055 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-eaba244d-e7fa-4d04-affc-c9199169fa19 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880bf3983987453ba9c29d8b73159e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eecf5c8d73944dabf3a0e0f64123745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:58.491539 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-eaba244d-e7fa-4d04-affc-c9199169fa19 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] 10.222.0.79 "GET /compute/v2.1/servers/a05629df-accf-4f2f-9d9d-d7602cf69fd4" status: 200 len: 1227 microversion: 2.1 time: 0.089162 Oct 17 14:16:58.492130 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3000/5865] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:58 2022] GET /compute/v2.1/servers/a05629df-accf-4f2f-9d9d-d7602cf69fd4 => generated 1227 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:16:59.515216 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6c40923b-1439-46cb-bb37-edc9db1adb73 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:59.515979 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6c40923b-1439-46cb-bb37-edc9db1adb73 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] [instance: a05629df-accf-4f2f-9d9d-d7602cf69fd4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:59.523926 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6c40923b-1439-46cb-bb37-edc9db1adb73 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:59.524409 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6c40923b-1439-46cb-bb37-edc9db1adb73 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:59.524857 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6c40923b-1439-46cb-bb37-edc9db1adb73 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:59.525562 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6c40923b-1439-46cb-bb37-edc9db1adb73 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:59.526007 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6c40923b-1439-46cb-bb37-edc9db1adb73 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:59.526432 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6c40923b-1439-46cb-bb37-edc9db1adb73 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:59.541456 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-6c40923b-1439-46cb-bb37-edc9db1adb73 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] HTTP exception thrown: Instance a05629df-accf-4f2f-9d9d-d7602cf69fd4 could not be found. Oct 17 14:16:59.543182 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6c40923b-1439-46cb-bb37-edc9db1adb73 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Request method failure captured: Oct 17 14:16:59.543182 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/a05629df-accf-4f2f-9d9d-d7602cf69fd4 HTTP/1.1 Oct 17 14:16:59.543182 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 14:16:59.543182 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 14:16:59.543182 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 14:16:59.543182 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 14:16:59.543182 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 14:16:59.543182 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 14:16:59.543182 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 14:16:59.543182 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 14:16:59.543182 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTWL-P5Ym5KTz9tMq-Z8_6e2lJRh3Wn7sRto7J0w9kQb16xvoZyH89ouSXZTNr4914pT2CrQcw8aFlAW7xqnD69SMBCVNKyRQb7bsazdvg_BtjTh4ISAK7jA9hVpp_JZM9gP_QDkQQ9cTBKJOGZaJ8Ryh9Q8yq1Ix7IrVYPt29xuMpDk Oct 17 14:16:59.543182 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 14:16:59.543182 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 14:16:59.543182 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 14:16:59.543182 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 14:16:59.543182 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 14:16:59.543182 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 14:16:59.543182 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 4eecf5c8d73944dabf3a0e0f64123745 Oct 17 14:16:59.543182 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-TestVolumeBackupRestore-954068130 Oct 17 14:16:59.543182 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 14:16:59.543182 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 14:16:59.543182 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4eecf5c8d73944dabf3a0e0f64123745"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4eecf5c8d73944dabf3a0e0f64123745"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4eecf5c8d73944dabf3a0e0f64123745"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4eecf5c8d73944dabf3a0e0f64123745", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:16:59.543182 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-TestVolumeBackupRestore-954068130 Oct 17 14:16:59.543182 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 4eecf5c8d73944dabf3a0e0f64123745 Oct 17 14:16:59.543182 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-TestVolumeBackupRestore-954068130 Oct 17 14:16:59.543182 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-TestVolumeBackupRestore-954068130-project Oct 17 14:16:59.543182 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 14:16:59.543182 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 14:16:59.543182 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 880bf3983987453ba9c29d8b73159e53 Oct 17 14:16:59.543182 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-TestVolumeBackupRestore-954068130-project Oct 17 14:16:59.543182 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 14:16:59.543182 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance a05629df-accf-4f2f-9d9d-d7602cf69fd4 could not be found. Oct 17 14:16:59.543182 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'a05629df-accf-4f2f-9d9d-d7602cf69fd4'} Oct 17 14:16:59.543182 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:16:59.543182 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:16:59.543182 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:16:59.543182 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:16:59.543182 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:16:59.543182 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:16:59.543182 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:16:59.543182 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:16:59.543182 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:16:59.543182 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:16:59.543182 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a05629df-accf-4f2f-9d9d-d7602cf69fd4 could not be found. Oct 17 14:16:59.543182 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:16:59.543182 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:16:59.543182 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:16:59.543182 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:16:59.543182 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:16:59.543182 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:16:59.543182 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:16:59.543182 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:16:59.543182 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:16:59.543182 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:16:59.543182 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:16:59.543182 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:16:59.543182 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:16:59.543182 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:16:59.543182 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:16:59.543182 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:16:59.543182 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a05629df-accf-4f2f-9d9d-d7602cf69fd4 could not be found. Oct 17 14:16:59.543182 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:16:59.543182 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:16:59.543182 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:16:59.548954 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:16:59.548954 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:16:59.548954 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:16:59.548954 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:16:59.548954 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:16:59.548954 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a05629df-accf-4f2f-9d9d-d7602cf69fd4 could not be found. Oct 17 14:16:59.548954 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:16:59.548954 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6c40923b-1439-46cb-bb37-edc9db1adb73 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Returning 404 to user: Instance a05629df-accf-4f2f-9d9d-d7602cf69fd4 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:16:59.548954 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6c40923b-1439-46cb-bb37-edc9db1adb73 tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] 10.222.0.79 "GET /compute/v2.1/servers/a05629df-accf-4f2f-9d9d-d7602cf69fd4" status: 404 len: 111 microversion: 2.1 time: 0.034166 Oct 17 14:16:59.548954 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2866/5866] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:59 2022] GET /compute/v2.1/servers/a05629df-accf-4f2f-9d9d-d7602cf69fd4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:16:59.710711 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fb0554b1-793e-4e65-8eaa-445ab251a36e tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] Calling method '.version_select at 0x7f7cd4cc8dc0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:59.735236 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fb0554b1-793e-4e65-8eaa-445ab251a36e tempest-TestVolumeBackupRestore-954068130 tempest-TestVolumeBackupRestore-954068130-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-71525874" status: 202 len: 0 microversion: 2.1 time: 0.028185 Oct 17 14:16:59.736675 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3001/5867] 10.222.0.79 () {58 vars in 1263 bytes} [Mon Oct 17 14:16:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-71525874 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:17:10.282622 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d20aee8d-e361-4313-bced-ccba90ca96c5 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:17:10.285843 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d20aee8d-e361-4313-bced-ccba90ca96c5 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 23cb6fcb-f328-4fe2-b890-4b33bad2c78a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:10.289197 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:17:10.290194 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:17:10.296934 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d20aee8d-e361-4313-bced-ccba90ca96c5 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:10.297760 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d20aee8d-e361-4313-bced-ccba90ca96c5 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:10.298218 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d20aee8d-e361-4313-bced-ccba90ca96c5 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:10.298932 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d20aee8d-e361-4313-bced-ccba90ca96c5 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:10.299404 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d20aee8d-e361-4313-bced-ccba90ca96c5 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:10.300090 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d20aee8d-e361-4313-bced-ccba90ca96c5 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:10.358637 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d20aee8d-e361-4313-bced-ccba90ca96c5 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "POST /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a/action" status: 200 len: 24578 microversion: 2.1 time: 0.079915 Oct 17 14:17:10.359300 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2867/5868] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:17:10 2022] POST /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a/action => generated 24578 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:17:16.583757 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=16 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:17:16.585485 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:17:16.592578 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-052a0c5b-a89d-4c77-8c0f-4203509b4f4a tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:16.593225 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-052a0c5b-a89d-4c77-8c0f-4203509b4f4a tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] [instance: 23cb6fcb-f328-4fe2-b890-4b33bad2c78a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:16.625739 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-052a0c5b-a89d-4c77-8c0f-4203509b4f4a tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:16.626591 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-052a0c5b-a89d-4c77-8c0f-4203509b4f4a tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:16.628109 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-052a0c5b-a89d-4c77-8c0f-4203509b4f4a tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:16.629096 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-052a0c5b-a89d-4c77-8c0f-4203509b4f4a tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:16.632927 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-052a0c5b-a89d-4c77-8c0f-4203509b4f4a tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:16.633633 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-052a0c5b-a89d-4c77-8c0f-4203509b4f4a tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:16.808954 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-052a0c5b-a89d-4c77-8c0f-4203509b4f4a tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a" status: 200 len: 1835 microversion: 2.1 time: 0.228900 Oct 17 14:17:16.809527 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3002/5869] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:16 2022] GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a => generated 1835 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:18.288378 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4c4cc628-a8fe-4d7f-9704-448b6220c769 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:18.288961 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4c4cc628-a8fe-4d7f-9704-448b6220c769 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 23cb6fcb-f328-4fe2-b890-4b33bad2c78a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:18.293113 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-f2eda381-6cdf-4263-88de-ae130c6f8458 req-21b75876-1484-47b0-a33e-fc0706f595e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23cb6fcb-f328-4fe2-b890-4b33bad2c78a", "tag": "84607819-b683-4572-99ca-fc1431266e3d"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:17:18.307152 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-f2eda381-6cdf-4263-88de-ae130c6f8458 req-21b75876-1484-47b0-a33e-fc0706f595e9 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:18.307867 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4c4cc628-a8fe-4d7f-9704-448b6220c769 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:18.308374 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4c4cc628-a8fe-4d7f-9704-448b6220c769 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:18.308522 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-f2eda381-6cdf-4263-88de-ae130c6f8458 req-21b75876-1484-47b0-a33e-fc0706f595e9 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:18.308813 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4c4cc628-a8fe-4d7f-9704-448b6220c769 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:18.309340 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-f2eda381-6cdf-4263-88de-ae130c6f8458 req-21b75876-1484-47b0-a33e-fc0706f595e9 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:18.309589 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4c4cc628-a8fe-4d7f-9704-448b6220c769 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:18.310166 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4c4cc628-a8fe-4d7f-9704-448b6220c769 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:18.310688 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4c4cc628-a8fe-4d7f-9704-448b6220c769 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:18.329531 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-f2eda381-6cdf-4263-88de-ae130c6f8458 req-21b75876-1484-47b0-a33e-fc0706f595e9 service nova] Creating event network-changed:84607819-b683-4572-99ca-fc1431266e3d for instance 23cb6fcb-f328-4fe2-b890-4b33bad2c78a on n-h1-854247-14 Oct 17 14:17:18.335559 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-f2eda381-6cdf-4263-88de-ae130c6f8458 req-21b75876-1484-47b0-a33e-fc0706f595e9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046893 Oct 17 14:17:18.336606 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3003/5870] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:17:18.361538 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4c4cc628-a8fe-4d7f-9704-448b6220c769 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 23cb6fcb-f328-4fe2-b890-4b33bad2c78a] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:17:18.468655 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4c4cc628-a8fe-4d7f-9704-448b6220c769 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "DELETE /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a" status: 204 len: 0 microversion: 2.1 time: 0.184623 Oct 17 14:17:18.469889 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2868/5871] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:17:18 2022] DELETE /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:17:18.479564 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-59316217-f270-4933-afc3-0d7aacc20f8a tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:18.480428 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-59316217-f270-4933-afc3-0d7aacc20f8a tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 23cb6fcb-f328-4fe2-b890-4b33bad2c78a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:18.487585 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-59316217-f270-4933-afc3-0d7aacc20f8a tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:18.488446 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-59316217-f270-4933-afc3-0d7aacc20f8a tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:18.489124 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-59316217-f270-4933-afc3-0d7aacc20f8a tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:18.489921 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-59316217-f270-4933-afc3-0d7aacc20f8a tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:18.490510 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-59316217-f270-4933-afc3-0d7aacc20f8a tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:18.491025 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-59316217-f270-4933-afc3-0d7aacc20f8a tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:18.654686 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-59316217-f270-4933-afc3-0d7aacc20f8a tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:18.662757 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-59316217-f270-4933-afc3-0d7aacc20f8a tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a" status: 200 len: 1688 microversion: 2.1 time: 0.188064 Oct 17 14:17:18.663455 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3004/5872] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:18 2022] GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a => generated 1688 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:19.698837 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0395eaae-e11d-484b-a65f-88bae62b6c4a tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:19.700665 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0395eaae-e11d-484b-a65f-88bae62b6c4a tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 23cb6fcb-f328-4fe2-b890-4b33bad2c78a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:19.744278 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0395eaae-e11d-484b-a65f-88bae62b6c4a tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:19.744809 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0395eaae-e11d-484b-a65f-88bae62b6c4a tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:19.745253 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0395eaae-e11d-484b-a65f-88bae62b6c4a tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:19.748855 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0395eaae-e11d-484b-a65f-88bae62b6c4a tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:19.755782 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0395eaae-e11d-484b-a65f-88bae62b6c4a tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:19.757649 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0395eaae-e11d-484b-a65f-88bae62b6c4a tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:20.494822 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0395eaae-e11d-484b-a65f-88bae62b6c4a tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:20.520991 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0395eaae-e11d-484b-a65f-88bae62b6c4a tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a" status: 200 len: 1688 microversion: 2.1 time: 0.831782 Oct 17 14:17:20.522468 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2869/5873] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:19 2022] GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a => generated 1688 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:21.209619 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-90b87ad3-65ea-4d0e-abf2-2a050cffa653 req-1790548f-e741-444b-95ba-85511315cbb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23cb6fcb-f328-4fe2-b890-4b33bad2c78a", "name": "network-vif-deleted", "tag": "84607819-b683-4572-99ca-fc1431266e3d"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:17:21.231617 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-90b87ad3-65ea-4d0e-abf2-2a050cffa653 req-1790548f-e741-444b-95ba-85511315cbb9 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:21.232398 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-90b87ad3-65ea-4d0e-abf2-2a050cffa653 req-1790548f-e741-444b-95ba-85511315cbb9 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:21.232825 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-90b87ad3-65ea-4d0e-abf2-2a050cffa653 req-1790548f-e741-444b-95ba-85511315cbb9 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:21.248989 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-90b87ad3-65ea-4d0e-abf2-2a050cffa653 req-1790548f-e741-444b-95ba-85511315cbb9 service nova] Creating event network-vif-deleted:84607819-b683-4572-99ca-fc1431266e3d for instance 23cb6fcb-f328-4fe2-b890-4b33bad2c78a on n-h1-854247-14 Oct 17 14:17:21.254319 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-90b87ad3-65ea-4d0e-abf2-2a050cffa653 req-1790548f-e741-444b-95ba-85511315cbb9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054148 Oct 17 14:17:21.255567 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3005/5874] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:17:21.549659 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e23c3181-cf9a-4349-99c1-9a55b32c3ed4 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:21.551445 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e23c3181-cf9a-4349-99c1-9a55b32c3ed4 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 23cb6fcb-f328-4fe2-b890-4b33bad2c78a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:21.560925 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e23c3181-cf9a-4349-99c1-9a55b32c3ed4 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:21.561820 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e23c3181-cf9a-4349-99c1-9a55b32c3ed4 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:21.562495 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e23c3181-cf9a-4349-99c1-9a55b32c3ed4 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:21.563503 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e23c3181-cf9a-4349-99c1-9a55b32c3ed4 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:21.564165 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e23c3181-cf9a-4349-99c1-9a55b32c3ed4 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:21.564809 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e23c3181-cf9a-4349-99c1-9a55b32c3ed4 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:21.610761 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e23c3181-cf9a-4349-99c1-9a55b32c3ed4 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:21.611585 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e23c3181-cf9a-4349-99c1-9a55b32c3ed4 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:21.612267 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e23c3181-cf9a-4349-99c1-9a55b32c3ed4 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:21.612899 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-e23c3181-cf9a-4349-99c1-9a55b32c3ed4 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lazy-loading 'fault' on Instance uuid 23cb6fcb-f328-4fe2-b890-4b33bad2c78a {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:17:22.080187 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e23c3181-cf9a-4349-99c1-9a55b32c3ed4 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:22.091522 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e23c3181-cf9a-4349-99c1-9a55b32c3ed4 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a" status: 200 len: 1356 microversion: 2.1 time: 0.548286 Oct 17 14:17:22.109330 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2870/5875] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:21 2022] GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a => generated 1356 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:23.119596 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-781475ed-75e6-47a9-8a04-fc518ca616eb tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:23.120448 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-781475ed-75e6-47a9-8a04-fc518ca616eb tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 23cb6fcb-f328-4fe2-b890-4b33bad2c78a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:23.126981 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-781475ed-75e6-47a9-8a04-fc518ca616eb tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:23.127808 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-781475ed-75e6-47a9-8a04-fc518ca616eb tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:23.128447 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-781475ed-75e6-47a9-8a04-fc518ca616eb tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:23.129158 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-781475ed-75e6-47a9-8a04-fc518ca616eb tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:23.129630 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-781475ed-75e6-47a9-8a04-fc518ca616eb tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:23.130018 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-781475ed-75e6-47a9-8a04-fc518ca616eb tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:23.147715 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-781475ed-75e6-47a9-8a04-fc518ca616eb tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] HTTP exception thrown: Instance 23cb6fcb-f328-4fe2-b890-4b33bad2c78a could not be found. Oct 17 14:17:23.149550 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-781475ed-75e6-47a9-8a04-fc518ca616eb tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Request method failure captured: Oct 17 14:17:23.149550 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a HTTP/1.1 Oct 17 14:17:23.149550 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 14:17:23.149550 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 14:17:23.149550 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 14:17:23.149550 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 14:17:23.149550 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 14:17:23.149550 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 14:17:23.149550 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 14:17:23.149550 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 14:17:23.149550 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTWN_WrnZNIuDTcmCFjSsEmdvqNJb4iEetQ3NxsmaqSa1gwOg9ZMQNLgw9m4eq9PNIu6JcojHQuHnBeD-_gAkuh_GorIQhe3sJ55RCndYbwHTO1kgdWN1Q2vFJpwxSY5RixlKnQqd0DcKtCXSNr1JwLh4U5fWK7dcxbe5fH3jeWLj4Sg Oct 17 14:17:23.149550 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 14:17:23.149550 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 14:17:23.149550 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 14:17:23.149550 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 14:17:23.149550 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 14:17:23.149550 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 14:17:23.149550 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: b8c8fe6f805f43798c9910296df4b8ab Oct 17 14:17:23.149550 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1095470143 Oct 17 14:17:23.149550 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 14:17:23.149550 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 14:17:23.149550 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b8c8fe6f805f43798c9910296df4b8ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b8c8fe6f805f43798c9910296df4b8ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b8c8fe6f805f43798c9910296df4b8ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b8c8fe6f805f43798c9910296df4b8ab", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:17:23.149550 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1095470143 Oct 17 14:17:23.149550 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: b8c8fe6f805f43798c9910296df4b8ab Oct 17 14:17:23.149550 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1095470143 Oct 17 14:17:23.149550 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-TestNetworkAdvancedServerOps-1095470143-project Oct 17 14:17:23.149550 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 14:17:23.149550 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 14:17:23.149550 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 024275cf6f8d423992e61d92dea927ba Oct 17 14:17:23.149550 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1095470143-project Oct 17 14:17:23.149550 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 14:17:23.149550 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 23cb6fcb-f328-4fe2-b890-4b33bad2c78a could not be found. Oct 17 14:17:23.149550 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '23cb6fcb-f328-4fe2-b890-4b33bad2c78a'} Oct 17 14:17:23.149550 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:17:23.149550 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:17:23.149550 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:17:23.149550 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:17:23.149550 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:17:23.149550 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:17:23.149550 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:17:23.149550 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:17:23.149550 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:17:23.149550 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:17:23.149550 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23cb6fcb-f328-4fe2-b890-4b33bad2c78a could not be found. Oct 17 14:17:23.149550 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:17:23.149550 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:17:23.149550 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:17:23.149550 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:17:23.149550 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:17:23.149550 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:17:23.149550 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:17:23.149550 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:17:23.149550 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:17:23.149550 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:17:23.149550 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:17:23.149550 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:17:23.149550 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:17:23.149550 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:17:23.149550 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:17:23.149550 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:17:23.149550 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23cb6fcb-f328-4fe2-b890-4b33bad2c78a could not be found. Oct 17 14:17:23.149550 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:17:23.149550 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:17:23.155442 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:17:23.155442 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:17:23.155442 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:17:23.155442 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:17:23.155442 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:17:23.155442 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:17:23.155442 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23cb6fcb-f328-4fe2-b890-4b33bad2c78a could not be found. Oct 17 14:17:23.155442 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:17:23.155442 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-781475ed-75e6-47a9-8a04-fc518ca616eb tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Returning 404 to user: Instance 23cb6fcb-f328-4fe2-b890-4b33bad2c78a could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:17:23.155442 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-781475ed-75e6-47a9-8a04-fc518ca616eb tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a" status: 404 len: 111 microversion: 2.1 time: 0.037397 Oct 17 14:17:23.156824 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3006/5876] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:23 2022] GET /compute/v2.1/servers/23cb6fcb-f328-4fe2-b890-4b33bad2c78a => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:17:27.775093 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7e5d9251-90a3-40e8-a8fb-e8f6d252228b tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1411207379", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "f664a497-fb14-4b29-8fa7-c2cf45da26de"}], "key_name": "tempest-TestSecurityGroupsBasicOps-437691523", "security_groups": []}, "os:scheduler_hints": {"different_host": ["3d0c26bc-24c7-43d1-a552-2d2aeb3590f0"]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:17:27.869718 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-7e5d9251-90a3-40e8-a8fb-e8f6d252228b tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] validate_networks() for [('f664a497-fb14-4b29-8fa7-c2cf45da26de', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:17:28.670275 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-7e5d9251-90a3-40e8-a8fb-e8f6d252228b tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:17:28.670698 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-7e5d9251-90a3-40e8-a8fb-e8f6d252228b tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:17:28.674539 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-7e5d9251-90a3-40e8-a8fb-e8f6d252228b tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:17:28.675033 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-7e5d9251-90a3-40e8-a8fb-e8f6d252228b tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:17:28.675648 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-7e5d9251-90a3-40e8-a8fb-e8f6d252228b tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:17:28.704455 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7e5d9251-90a3-40e8-a8fb-e8f6d252228b tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:28.705194 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7e5d9251-90a3-40e8-a8fb-e8f6d252228b tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:28.705881 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7e5d9251-90a3-40e8-a8fb-e8f6d252228b tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:28.707041 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7e5d9251-90a3-40e8-a8fb-e8f6d252228b tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:28.707469 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7e5d9251-90a3-40e8-a8fb-e8f6d252228b tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:28.707903 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7e5d9251-90a3-40e8-a8fb-e8f6d252228b tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:28.740063 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-7e5d9251-90a3-40e8-a8fb-e8f6d252228b tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Getting quotas for project b0587423d7f44899bac419cd4e883ec9. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:17:28.750023 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-7e5d9251-90a3-40e8-a8fb-e8f6d252228b tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Getting quotas for user 7557bdf83dd344f5b8f20ce3af781a71 and project b0587423d7f44899bac419cd4e883ec9. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:17:28.768630 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7e5d9251-90a3-40e8-a8fb-e8f6d252228b tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:17:28.771389 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7e5d9251-90a3-40e8-a8fb-e8f6d252228b tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] [instance: 88899717-00c2-4f38-bcdf-f29137dd5c15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:17:28.863157 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7e5d9251-90a3-40e8-a8fb-e8f6d252228b tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.092638 Oct 17 14:17:28.864982 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2871/5877] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 14:17:27 2022] POST /compute/v2.1/servers => generated 361 bytes in 1095 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 14:17:28.877301 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cf3e7326-d82f-4ebf-bb70-48dfb7473f77 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:28.877924 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cf3e7326-d82f-4ebf-bb70-48dfb7473f77 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] [instance: 88899717-00c2-4f38-bcdf-f29137dd5c15] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:28.977714 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cf3e7326-d82f-4ebf-bb70-48dfb7473f77 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7557bdf83dd344f5b8f20ce3af781a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0587423d7f44899bac419cd4e883ec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:29.008455 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cf3e7326-d82f-4ebf-bb70-48dfb7473f77 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] 10.222.0.79 "GET /compute/v2.1/servers/88899717-00c2-4f38-bcdf-f29137dd5c15" status: 200 len: 1241 microversion: 2.1 time: 0.118037 Oct 17 14:17:29.023195 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3007/5878] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:28 2022] GET /compute/v2.1/servers/88899717-00c2-4f38-bcdf-f29137dd5c15 => generated 1241 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:30.041766 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3ce87abc-36dd-4277-9f37-52784d871cc2 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:30.050344 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3ce87abc-36dd-4277-9f37-52784d871cc2 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] [instance: 88899717-00c2-4f38-bcdf-f29137dd5c15] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:30.067430 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3ce87abc-36dd-4277-9f37-52784d871cc2 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:30.068638 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3ce87abc-36dd-4277-9f37-52784d871cc2 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:30.069455 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3ce87abc-36dd-4277-9f37-52784d871cc2 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:30.070514 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3ce87abc-36dd-4277-9f37-52784d871cc2 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:30.071072 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3ce87abc-36dd-4277-9f37-52784d871cc2 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:30.072125 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3ce87abc-36dd-4277-9f37-52784d871cc2 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:30.235114 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3ce87abc-36dd-4277-9f37-52784d871cc2 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7557bdf83dd344f5b8f20ce3af781a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0587423d7f44899bac419cd4e883ec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:30.245298 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3ce87abc-36dd-4277-9f37-52784d871cc2 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] 10.222.0.79 "GET /compute/v2.1/servers/88899717-00c2-4f38-bcdf-f29137dd5c15" status: 200 len: 1293 microversion: 2.1 time: 0.213707 Oct 17 14:17:30.264466 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2872/5879] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:30 2022] GET /compute/v2.1/servers/88899717-00c2-4f38-bcdf-f29137dd5c15 => generated 1293 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:30.365750 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e6457f53-a71d-4be1-b0c6-74c80d9a5877 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '.version_select at 0x7f7cd541a1f0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:30.441584 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e6457f53-a71d-4be1-b0c6-74c80d9a5877 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-107352835" status: 202 len: 0 microversion: 2.1 time: 0.080572 Oct 17 14:17:30.446959 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3008/5880] 10.222.0.79 () {58 vars in 1281 bytes} [Mon Oct 17 14:17:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-107352835 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:17:30.489187 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-403ae0a8-9158-440b-87ea-e25c071e9250 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Action: 'create', calling method: .version_select at 0x7f7cd464ed30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1173205298", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLox93lMDx8AphQOpznO8VmDUwBiLxhc+Hy0QHPVykwMz9atbsyBLIyOVshkjIyZw7/HWybT4ECZcO9sBmwo8KXyZi4+bJY46Aviqt7pYbMxB2opc9iTAYWOn6qhV+wpA=="}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:17:30.510983 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-403ae0a8-9158-440b-87ea-e25c071e9250 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Getting quotas for project b8c8fe6f805f43798c9910296df4b8ab. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:17:30.520848 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-403ae0a8-9158-440b-87ea-e25c071e9250 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Getting quotas for user 024275cf6f8d423992e61d92dea927ba and project b8c8fe6f805f43798c9910296df4b8ab. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:17:30.584849 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-403ae0a8-9158-440b-87ea-e25c071e9250 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.101193 Oct 17 14:17:30.591603 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2873/5881] 10.222.0.79 () {60 vars in 1159 bytes} [Mon Oct 17 14:17:30 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:17:31.276649 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1adc1571-f5a6-4ddf-aace-166c35f31b5e tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:31.277284 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-1adc1571-f5a6-4ddf-aace-166c35f31b5e tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] [instance: 88899717-00c2-4f38-bcdf-f29137dd5c15] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:31.292328 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1adc1571-f5a6-4ddf-aace-166c35f31b5e tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:31.294565 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1adc1571-f5a6-4ddf-aace-166c35f31b5e tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:31.295093 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1adc1571-f5a6-4ddf-aace-166c35f31b5e tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:31.297378 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1adc1571-f5a6-4ddf-aace-166c35f31b5e tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:31.298205 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1adc1571-f5a6-4ddf-aace-166c35f31b5e tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:31.300140 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1adc1571-f5a6-4ddf-aace-166c35f31b5e tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:31.445178 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-1adc1571-f5a6-4ddf-aace-166c35f31b5e tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7557bdf83dd344f5b8f20ce3af781a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0587423d7f44899bac419cd4e883ec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:31.458012 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1adc1571-f5a6-4ddf-aace-166c35f31b5e tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] 10.222.0.79 "GET /compute/v2.1/servers/88899717-00c2-4f38-bcdf-f29137dd5c15" status: 200 len: 1299 microversion: 2.1 time: 0.187437 Oct 17 14:17:31.460315 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3009/5882] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:31 2022] GET /compute/v2.1/servers/88899717-00c2-4f38-bcdf-f29137dd5c15 => generated 1299 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:31.824451 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b93a55d0-8ac7-4ee5-8fdf-af497a39e058 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1488278586", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "7b48115b-a1ec-409b-a6ba-047f2957e74b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "60d947eb-1d2b-4fd8-9101-f9fb7c7e0088"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:17:31.986278 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-b93a55d0-8ac7-4ee5-8fdf-af497a39e058 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] validate_networks() for [('60d947eb-1d2b-4fd8-9101-f9fb7c7e0088', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:17:32.483862 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8814c5fa-ee76-4c90-bf11-529b6a5df9e6 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:32.484666 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8814c5fa-ee76-4c90-bf11-529b6a5df9e6 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] [instance: 88899717-00c2-4f38-bcdf-f29137dd5c15] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:32.495098 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8814c5fa-ee76-4c90-bf11-529b6a5df9e6 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:32.495898 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8814c5fa-ee76-4c90-bf11-529b6a5df9e6 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:32.496617 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8814c5fa-ee76-4c90-bf11-529b6a5df9e6 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:32.497574 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8814c5fa-ee76-4c90-bf11-529b6a5df9e6 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:32.498516 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8814c5fa-ee76-4c90-bf11-529b6a5df9e6 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:32.499267 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8814c5fa-ee76-4c90-bf11-529b6a5df9e6 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:32.692379 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8814c5fa-ee76-4c90-bf11-529b6a5df9e6 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7557bdf83dd344f5b8f20ce3af781a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0587423d7f44899bac419cd4e883ec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:32.718454 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8814c5fa-ee76-4c90-bf11-529b6a5df9e6 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] 10.222.0.79 "GET /compute/v2.1/servers/88899717-00c2-4f38-bcdf-f29137dd5c15" status: 200 len: 1299 microversion: 2.1 time: 0.238418 Oct 17 14:17:32.719312 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3010/5883] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:32 2022] GET /compute/v2.1/servers/88899717-00c2-4f38-bcdf-f29137dd5c15 => generated 1299 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:17:32.959110 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-b93a55d0-8ac7-4ee5-8fdf-af497a39e058 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:17:32.961207 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-b93a55d0-8ac7-4ee5-8fdf-af497a39e058 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:17:32.963620 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-b93a55d0-8ac7-4ee5-8fdf-af497a39e058 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:17:32.964310 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-b93a55d0-8ac7-4ee5-8fdf-af497a39e058 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:17:32.965452 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-b93a55d0-8ac7-4ee5-8fdf-af497a39e058 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:17:32.979911 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b93a55d0-8ac7-4ee5-8fdf-af497a39e058 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:32.981065 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b93a55d0-8ac7-4ee5-8fdf-af497a39e058 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:32.981788 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b93a55d0-8ac7-4ee5-8fdf-af497a39e058 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:32.983536 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b93a55d0-8ac7-4ee5-8fdf-af497a39e058 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:32.984419 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b93a55d0-8ac7-4ee5-8fdf-af497a39e058 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:32.985092 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b93a55d0-8ac7-4ee5-8fdf-af497a39e058 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:33.014740 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-b93a55d0-8ac7-4ee5-8fdf-af497a39e058 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Getting quotas for project 4ee70940341741cb8e31928b856de051. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:17:33.021044 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-b93a55d0-8ac7-4ee5-8fdf-af497a39e058 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Getting quotas for user 06a0e2dab7494a4682615a6269ac24f9 and project 4ee70940341741cb8e31928b856de051. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:17:33.152090 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b93a55d0-8ac7-4ee5-8fdf-af497a39e058 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:17:33.164266 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b93a55d0-8ac7-4ee5-8fdf-af497a39e058 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 7938058f-350c-458b-9d4e-8f1cc5397000] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7b48115b-a1ec-409b-a6ba-047f2957e74b',volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:17:33.422154 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b93a55d0-8ac7-4ee5-8fdf-af497a39e058 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.601759 Oct 17 14:17:33.426581 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2874/5884] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 14:17:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 14:17:33.445061 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-494d91fa-c4a3-4e9a-b55c-454921315e44 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:33.445701 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-494d91fa-c4a3-4e9a-b55c-454921315e44 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 7938058f-350c-458b-9d4e-8f1cc5397000] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:33.592248 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-494d91fa-c4a3-4e9a-b55c-454921315e44 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:33.613063 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-494d91fa-c4a3-4e9a-b55c-454921315e44 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/7938058f-350c-458b-9d4e-8f1cc5397000" status: 200 len: 1057 microversion: 2.1 time: 0.172649 Oct 17 14:17:33.615607 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3011/5885] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:33 2022] GET /compute/v2.1/servers/7938058f-350c-458b-9d4e-8f1cc5397000 => generated 1057 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:33.725041 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-0af418e5-47b1-4e32-9033-ba6c52df1123 req-9524456a-8fe4-4043-8c23-0eff877aa2dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88899717-00c2-4f38-bcdf-f29137dd5c15", "tag": "6654aa33-4513-4f5e-b642-56241d6394eb"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:17:33.742407 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a9aaeb3a-b37c-4886-953c-373bf92f480d tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:33.743467 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a9aaeb3a-b37c-4886-953c-373bf92f480d tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] [instance: 88899717-00c2-4f38-bcdf-f29137dd5c15] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:33.760161 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-0af418e5-47b1-4e32-9033-ba6c52df1123 req-9524456a-8fe4-4043-8c23-0eff877aa2dc service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:33.761013 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a9aaeb3a-b37c-4886-953c-373bf92f480d tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:33.761747 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a9aaeb3a-b37c-4886-953c-373bf92f480d tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:33.762452 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-0af418e5-47b1-4e32-9033-ba6c52df1123 req-9524456a-8fe4-4043-8c23-0eff877aa2dc service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:33.763125 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a9aaeb3a-b37c-4886-953c-373bf92f480d tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:33.763790 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-0af418e5-47b1-4e32-9033-ba6c52df1123 req-9524456a-8fe4-4043-8c23-0eff877aa2dc service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:33.764872 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a9aaeb3a-b37c-4886-953c-373bf92f480d tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:33.767753 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a9aaeb3a-b37c-4886-953c-373bf92f480d tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:33.768469 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a9aaeb3a-b37c-4886-953c-373bf92f480d tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:33.814681 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-0af418e5-47b1-4e32-9033-ba6c52df1123 req-9524456a-8fe4-4043-8c23-0eff877aa2dc service nova] Creating event network-changed:6654aa33-4513-4f5e-b642-56241d6394eb for instance 88899717-00c2-4f38-bcdf-f29137dd5c15 on n-h2-854247-14 Oct 17 14:17:33.824195 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-0af418e5-47b1-4e32-9033-ba6c52df1123 req-9524456a-8fe4-4043-8c23-0eff877aa2dc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101403 Oct 17 14:17:33.825773 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2875/5886] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:17:34.074640 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a9aaeb3a-b37c-4886-953c-373bf92f480d tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7557bdf83dd344f5b8f20ce3af781a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0587423d7f44899bac419cd4e883ec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:34.092922 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a9aaeb3a-b37c-4886-953c-373bf92f480d tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] 10.222.0.79 "GET /compute/v2.1/servers/88899717-00c2-4f38-bcdf-f29137dd5c15" status: 200 len: 1299 microversion: 2.1 time: 0.353379 Oct 17 14:17:34.098610 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3012/5887] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:33 2022] GET /compute/v2.1/servers/88899717-00c2-4f38-bcdf-f29137dd5c15 => generated 1299 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:17:34.639914 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c4c1d107-7e25-4879-ab89-36255955a19a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:34.640626 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c4c1d107-7e25-4879-ab89-36255955a19a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 7938058f-350c-458b-9d4e-8f1cc5397000] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:34.648728 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c4c1d107-7e25-4879-ab89-36255955a19a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:34.649497 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c4c1d107-7e25-4879-ab89-36255955a19a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:34.650115 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c4c1d107-7e25-4879-ab89-36255955a19a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:34.650994 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c4c1d107-7e25-4879-ab89-36255955a19a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:34.651634 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c4c1d107-7e25-4879-ab89-36255955a19a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:34.652220 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c4c1d107-7e25-4879-ab89-36255955a19a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:34.731142 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c4c1d107-7e25-4879-ab89-36255955a19a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:34.740861 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c4c1d107-7e25-4879-ab89-36255955a19a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/7938058f-350c-458b-9d4e-8f1cc5397000" status: 200 len: 1099 microversion: 2.1 time: 0.105342 Oct 17 14:17:34.742156 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2876/5888] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:34 2022] GET /compute/v2.1/servers/7938058f-350c-458b-9d4e-8f1cc5397000 => generated 1099 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:35.120598 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9e3e5ded-b8e8-4a0f-9913-eb15a8392d8d tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:35.121302 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9e3e5ded-b8e8-4a0f-9913-eb15a8392d8d tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] [instance: 88899717-00c2-4f38-bcdf-f29137dd5c15] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:35.131008 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9e3e5ded-b8e8-4a0f-9913-eb15a8392d8d tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:35.132105 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9e3e5ded-b8e8-4a0f-9913-eb15a8392d8d tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:35.132935 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9e3e5ded-b8e8-4a0f-9913-eb15a8392d8d tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:35.133947 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9e3e5ded-b8e8-4a0f-9913-eb15a8392d8d tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:35.134713 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9e3e5ded-b8e8-4a0f-9913-eb15a8392d8d tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:35.135532 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9e3e5ded-b8e8-4a0f-9913-eb15a8392d8d tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:35.769114 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e24079b2-d012-4157-98c3-564e2011abe8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:35.771733 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e24079b2-d012-4157-98c3-564e2011abe8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 7938058f-350c-458b-9d4e-8f1cc5397000] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:35.783864 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e24079b2-d012-4157-98c3-564e2011abe8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:35.796535 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e24079b2-d012-4157-98c3-564e2011abe8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:35.797095 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e24079b2-d012-4157-98c3-564e2011abe8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:35.805714 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e24079b2-d012-4157-98c3-564e2011abe8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:35.807097 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e24079b2-d012-4157-98c3-564e2011abe8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:35.807572 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e24079b2-d012-4157-98c3-564e2011abe8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:35.962973 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e24079b2-d012-4157-98c3-564e2011abe8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:35.979571 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e24079b2-d012-4157-98c3-564e2011abe8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/7938058f-350c-458b-9d4e-8f1cc5397000" status: 200 len: 1173 microversion: 2.1 time: 0.209092 Oct 17 14:17:35.980378 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2877/5889] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:35 2022] GET /compute/v2.1/servers/7938058f-350c-458b-9d4e-8f1cc5397000 => generated 1173 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:35.998176 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9e3e5ded-b8e8-4a0f-9913-eb15a8392d8d tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7557bdf83dd344f5b8f20ce3af781a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0587423d7f44899bac419cd4e883ec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:36.012054 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9e3e5ded-b8e8-4a0f-9913-eb15a8392d8d tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] 10.222.0.79 "GET /compute/v2.1/servers/88899717-00c2-4f38-bcdf-f29137dd5c15" status: 200 len: 1299 microversion: 2.1 time: 0.893107 Oct 17 14:17:36.015508 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3013/5890] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:35 2022] GET /compute/v2.1/servers/88899717-00c2-4f38-bcdf-f29137dd5c15 => generated 1299 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:37.007842 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-807b3a50-f165-42a2-84dd-e97dd6645bbf tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:37.009192 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-807b3a50-f165-42a2-84dd-e97dd6645bbf tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 7938058f-350c-458b-9d4e-8f1cc5397000] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:37.030321 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-807b3a50-f165-42a2-84dd-e97dd6645bbf tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:37.031052 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-807b3a50-f165-42a2-84dd-e97dd6645bbf tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:37.034696 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-807b3a50-f165-42a2-84dd-e97dd6645bbf tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:37.035757 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-807b3a50-f165-42a2-84dd-e97dd6645bbf tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:37.036461 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-807b3a50-f165-42a2-84dd-e97dd6645bbf tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:37.037088 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-807b3a50-f165-42a2-84dd-e97dd6645bbf tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:37.040836 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-74258444-77dc-484b-9faa-359d344246cf tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:37.041514 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-74258444-77dc-484b-9faa-359d344246cf tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] [instance: 88899717-00c2-4f38-bcdf-f29137dd5c15] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:37.058250 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-74258444-77dc-484b-9faa-359d344246cf tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:37.059537 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-74258444-77dc-484b-9faa-359d344246cf tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:37.059988 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-74258444-77dc-484b-9faa-359d344246cf tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:37.060729 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-74258444-77dc-484b-9faa-359d344246cf tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:37.064793 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-74258444-77dc-484b-9faa-359d344246cf tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:37.066542 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-74258444-77dc-484b-9faa-359d344246cf tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:37.269648 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-74258444-77dc-484b-9faa-359d344246cf tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7557bdf83dd344f5b8f20ce3af781a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0587423d7f44899bac419cd4e883ec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:37.284664 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-74258444-77dc-484b-9faa-359d344246cf tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] 10.222.0.79 "GET /compute/v2.1/servers/88899717-00c2-4f38-bcdf-f29137dd5c15" status: 200 len: 1299 microversion: 2.1 time: 0.247595 Oct 17 14:17:37.286258 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3014/5891] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:37 2022] GET /compute/v2.1/servers/88899717-00c2-4f38-bcdf-f29137dd5c15 => generated 1299 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:17:37.466202 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-807b3a50-f165-42a2-84dd-e97dd6645bbf tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:37.481049 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-807b3a50-f165-42a2-84dd-e97dd6645bbf tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/7938058f-350c-458b-9d4e-8f1cc5397000" status: 200 len: 1215 microversion: 2.1 time: 0.477853 Oct 17 14:17:37.482147 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2878/5892] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:37 2022] GET /compute/v2.1/servers/7938058f-350c-458b-9d4e-8f1cc5397000 => generated 1215 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:38.261268 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-4062bf5c-1bfb-4fe7-ac57-d3aeb518b1ca req-700b4543-bae4-4f21-93c5-e2f9932b34bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7938058f-350c-458b-9d4e-8f1cc5397000", "tag": "66bfea9f-9d6b-47e1-926b-bdbf6f85834a"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:17:38.301291 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-4062bf5c-1bfb-4fe7-ac57-d3aeb518b1ca req-700b4543-bae4-4f21-93c5-e2f9932b34bf service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:38.302117 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-4062bf5c-1bfb-4fe7-ac57-d3aeb518b1ca req-700b4543-bae4-4f21-93c5-e2f9932b34bf service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:38.302780 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-4062bf5c-1bfb-4fe7-ac57-d3aeb518b1ca req-700b4543-bae4-4f21-93c5-e2f9932b34bf service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:38.312544 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5eec75f4-f71b-4517-ae54-b63fac7d0c4a tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:38.313279 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5eec75f4-f71b-4517-ae54-b63fac7d0c4a tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] [instance: 88899717-00c2-4f38-bcdf-f29137dd5c15] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:38.320549 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-4062bf5c-1bfb-4fe7-ac57-d3aeb518b1ca req-700b4543-bae4-4f21-93c5-e2f9932b34bf service nova] Creating event network-changed:66bfea9f-9d6b-47e1-926b-bdbf6f85834a for instance 7938058f-350c-458b-9d4e-8f1cc5397000 on n-h1-854247-14 Oct 17 14:17:38.328727 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-4062bf5c-1bfb-4fe7-ac57-d3aeb518b1ca req-700b4543-bae4-4f21-93c5-e2f9932b34bf service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075850 Oct 17 14:17:38.331482 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3015/5893] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:17:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:17:38.337231 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5eec75f4-f71b-4517-ae54-b63fac7d0c4a tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:38.338380 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5eec75f4-f71b-4517-ae54-b63fac7d0c4a tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:38.341484 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5eec75f4-f71b-4517-ae54-b63fac7d0c4a tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:38.342446 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5eec75f4-f71b-4517-ae54-b63fac7d0c4a tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:38.343117 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5eec75f4-f71b-4517-ae54-b63fac7d0c4a tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:38.343799 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5eec75f4-f71b-4517-ae54-b63fac7d0c4a tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:38.508111 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-bba3930b-aa23-4871-83cf-8150437f7bc6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:38.509684 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-bba3930b-aa23-4871-83cf-8150437f7bc6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 7938058f-350c-458b-9d4e-8f1cc5397000] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:38.521014 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bba3930b-aa23-4871-83cf-8150437f7bc6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:38.525813 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bba3930b-aa23-4871-83cf-8150437f7bc6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:38.526458 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bba3930b-aa23-4871-83cf-8150437f7bc6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:38.527842 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bba3930b-aa23-4871-83cf-8150437f7bc6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:38.529193 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bba3930b-aa23-4871-83cf-8150437f7bc6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:38.530011 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bba3930b-aa23-4871-83cf-8150437f7bc6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:38.539876 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5eec75f4-f71b-4517-ae54-b63fac7d0c4a tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7557bdf83dd344f5b8f20ce3af781a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0587423d7f44899bac419cd4e883ec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:38.552175 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5eec75f4-f71b-4517-ae54-b63fac7d0c4a tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] 10.222.0.79 "GET /compute/v2.1/servers/88899717-00c2-4f38-bcdf-f29137dd5c15" status: 200 len: 1299 microversion: 2.1 time: 0.243232 Oct 17 14:17:38.555380 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2879/5894] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:38 2022] GET /compute/v2.1/servers/88899717-00c2-4f38-bcdf-f29137dd5c15 => generated 1299 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:38.945424 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-bba3930b-aa23-4871-83cf-8150437f7bc6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:38.953778 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-bba3930b-aa23-4871-83cf-8150437f7bc6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/7938058f-350c-458b-9d4e-8f1cc5397000" status: 200 len: 1215 microversion: 2.1 time: 0.451861 Oct 17 14:17:38.954712 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3016/5895] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:38 2022] GET /compute/v2.1/servers/7938058f-350c-458b-9d4e-8f1cc5397000 => generated 1215 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:39.577849 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4f4e29ea-da65-425f-8fd4-e591a8928a22 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:39.579115 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4f4e29ea-da65-425f-8fd4-e591a8928a22 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] [instance: 88899717-00c2-4f38-bcdf-f29137dd5c15] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:39.589106 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4f4e29ea-da65-425f-8fd4-e591a8928a22 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:39.591428 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4f4e29ea-da65-425f-8fd4-e591a8928a22 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:39.593503 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4f4e29ea-da65-425f-8fd4-e591a8928a22 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:39.594266 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4f4e29ea-da65-425f-8fd4-e591a8928a22 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:39.594737 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4f4e29ea-da65-425f-8fd4-e591a8928a22 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:39.595161 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4f4e29ea-da65-425f-8fd4-e591a8928a22 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:39.913642 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4f4e29ea-da65-425f-8fd4-e591a8928a22 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7557bdf83dd344f5b8f20ce3af781a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0587423d7f44899bac419cd4e883ec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:39.922738 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4f4e29ea-da65-425f-8fd4-e591a8928a22 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] 10.222.0.79 "GET /compute/v2.1/servers/88899717-00c2-4f38-bcdf-f29137dd5c15" status: 200 len: 1299 microversion: 2.1 time: 0.348715 Oct 17 14:17:39.925902 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2880/5896] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:39 2022] GET /compute/v2.1/servers/88899717-00c2-4f38-bcdf-f29137dd5c15 => generated 1299 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:39.985754 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-16b6ceff-675a-428e-af14-789d6381b3a4 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:39.987757 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-16b6ceff-675a-428e-af14-789d6381b3a4 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 7938058f-350c-458b-9d4e-8f1cc5397000] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:39.997483 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-16b6ceff-675a-428e-af14-789d6381b3a4 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:39.999944 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-16b6ceff-675a-428e-af14-789d6381b3a4 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:39.999944 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-16b6ceff-675a-428e-af14-789d6381b3a4 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:40.000802 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-16b6ceff-675a-428e-af14-789d6381b3a4 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:40.001547 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-16b6ceff-675a-428e-af14-789d6381b3a4 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:40.002200 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-16b6ceff-675a-428e-af14-789d6381b3a4 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:40.184960 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-c13a07d7-e7ab-44e0-94dd-7f83606d4747 req-e43f9224-ccc2-4dd4-abaa-354e02355085 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88899717-00c2-4f38-bcdf-f29137dd5c15", "name": "network-vif-plugged", "status": "completed", "tag": "6654aa33-4513-4f5e-b642-56241d6394eb"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:17:40.202308 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-c13a07d7-e7ab-44e0-94dd-7f83606d4747 req-e43f9224-ccc2-4dd4-abaa-354e02355085 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:40.204274 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-c13a07d7-e7ab-44e0-94dd-7f83606d4747 req-e43f9224-ccc2-4dd4-abaa-354e02355085 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:40.205066 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-c13a07d7-e7ab-44e0-94dd-7f83606d4747 req-e43f9224-ccc2-4dd4-abaa-354e02355085 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:40.227769 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-c13a07d7-e7ab-44e0-94dd-7f83606d4747 req-e43f9224-ccc2-4dd4-abaa-354e02355085 service nova] Creating event network-vif-plugged:6654aa33-4513-4f5e-b642-56241d6394eb for instance 88899717-00c2-4f38-bcdf-f29137dd5c15 on n-h2-854247-14 Oct 17 14:17:40.236295 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-c13a07d7-e7ab-44e0-94dd-7f83606d4747 req-e43f9224-ccc2-4dd4-abaa-354e02355085 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056061 Oct 17 14:17:40.238909 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2881/5897] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:17:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:17:40.277767 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-16b6ceff-675a-428e-af14-789d6381b3a4 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:40.289872 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-16b6ceff-675a-428e-af14-789d6381b3a4 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/7938058f-350c-458b-9d4e-8f1cc5397000" status: 200 len: 1215 microversion: 2.1 time: 0.314295 Oct 17 14:17:40.291120 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3017/5898] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:39 2022] GET /compute/v2.1/servers/7938058f-350c-458b-9d4e-8f1cc5397000 => generated 1215 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:40.336397 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e1c5d6ce-0cbe-4d8d-a512-18deacb04555 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-229839342", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "320135ac-5138-4f2d-bae4-0ee5eb326758"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1173205298", "security_groups": [{"name": "tempest-secgroup-smoke-481370974"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:17:40.367629 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:17:40.494183 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-e1c5d6ce-0cbe-4d8d-a512-18deacb04555 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] validate_networks() for [('320135ac-5138-4f2d-bae4-0ee5eb326758', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:17:40.951963 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fdddc99e-33d2-42e3-861c-bed78d6e8244 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:40.952828 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-fdddc99e-33d2-42e3-861c-bed78d6e8244 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] [instance: 88899717-00c2-4f38-bcdf-f29137dd5c15] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:40.963214 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fdddc99e-33d2-42e3-861c-bed78d6e8244 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:40.968524 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fdddc99e-33d2-42e3-861c-bed78d6e8244 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:40.968991 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fdddc99e-33d2-42e3-861c-bed78d6e8244 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:40.969933 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fdddc99e-33d2-42e3-861c-bed78d6e8244 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:40.970398 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fdddc99e-33d2-42e3-861c-bed78d6e8244 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:40.970838 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fdddc99e-33d2-42e3-861c-bed78d6e8244 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:40.987422 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-e1c5d6ce-0cbe-4d8d-a512-18deacb04555 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:17:40.987971 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-e1c5d6ce-0cbe-4d8d-a512-18deacb04555 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:17:40.988340 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-e1c5d6ce-0cbe-4d8d-a512-18deacb04555 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:17:40.988755 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-e1c5d6ce-0cbe-4d8d-a512-18deacb04555 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:17:40.989172 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-e1c5d6ce-0cbe-4d8d-a512-18deacb04555 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:17:41.012454 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e1c5d6ce-0cbe-4d8d-a512-18deacb04555 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:41.015419 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e1c5d6ce-0cbe-4d8d-a512-18deacb04555 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:41.016077 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e1c5d6ce-0cbe-4d8d-a512-18deacb04555 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:41.017243 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e1c5d6ce-0cbe-4d8d-a512-18deacb04555 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:41.017710 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e1c5d6ce-0cbe-4d8d-a512-18deacb04555 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:41.018137 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e1c5d6ce-0cbe-4d8d-a512-18deacb04555 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:41.050651 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:17:41.086660 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-e1c5d6ce-0cbe-4d8d-a512-18deacb04555 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Getting quotas for project b8c8fe6f805f43798c9910296df4b8ab. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:17:41.111321 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-e1c5d6ce-0cbe-4d8d-a512-18deacb04555 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Getting quotas for user 024275cf6f8d423992e61d92dea927ba and project b8c8fe6f805f43798c9910296df4b8ab. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:17:41.131307 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e1c5d6ce-0cbe-4d8d-a512-18deacb04555 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:17:41.135436 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e1c5d6ce-0cbe-4d8d-a512-18deacb04555 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e7405fc0-937a-4256-8d0c-95acd35ebc97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:17:41.148365 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fdddc99e-33d2-42e3-861c-bed78d6e8244 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7557bdf83dd344f5b8f20ce3af781a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0587423d7f44899bac419cd4e883ec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:41.160355 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fdddc99e-33d2-42e3-861c-bed78d6e8244 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] 10.222.0.79 "GET /compute/v2.1/servers/88899717-00c2-4f38-bcdf-f29137dd5c15" status: 200 len: 1299 microversion: 2.1 time: 0.213650 Oct 17 14:17:41.161261 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3018/5899] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:40 2022] GET /compute/v2.1/servers/88899717-00c2-4f38-bcdf-f29137dd5c15 => generated 1299 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:41.204520 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e1c5d6ce-0cbe-4d8d-a512-18deacb04555 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.877873 Oct 17 14:17:41.207367 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2882/5900] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 14:17:40 2022] POST /compute/v2.1/servers => generated 405 bytes in 882 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:17:41.218013 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-833ba867-fadd-4863-89cf-c60d837b6157 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:41.218881 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-833ba867-fadd-4863-89cf-c60d837b6157 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e7405fc0-937a-4256-8d0c-95acd35ebc97] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:41.291731 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-833ba867-fadd-4863-89cf-c60d837b6157 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:41.301306 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-833ba867-fadd-4863-89cf-c60d837b6157 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97" status: 200 len: 1266 microversion: 2.1 time: 0.087518 Oct 17 14:17:41.304094 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3019/5901] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:41 2022] GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97 => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:41.314745 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-574af9d8-7e95-4a7d-9816-5d3b3fc7d068 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:41.315429 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-574af9d8-7e95-4a7d-9816-5d3b3fc7d068 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 7938058f-350c-458b-9d4e-8f1cc5397000] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:41.330297 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-574af9d8-7e95-4a7d-9816-5d3b3fc7d068 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:41.330784 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-574af9d8-7e95-4a7d-9816-5d3b3fc7d068 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:41.331235 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-574af9d8-7e95-4a7d-9816-5d3b3fc7d068 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:41.333143 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-574af9d8-7e95-4a7d-9816-5d3b3fc7d068 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:41.333602 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-574af9d8-7e95-4a7d-9816-5d3b3fc7d068 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:41.335362 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-574af9d8-7e95-4a7d-9816-5d3b3fc7d068 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:41.617315 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-574af9d8-7e95-4a7d-9816-5d3b3fc7d068 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:41.650872 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-574af9d8-7e95-4a7d-9816-5d3b3fc7d068 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/7938058f-350c-458b-9d4e-8f1cc5397000" status: 200 len: 1215 microversion: 2.1 time: 0.331889 Oct 17 14:17:41.668790 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2883/5902] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:41 2022] GET /compute/v2.1/servers/7938058f-350c-458b-9d4e-8f1cc5397000 => generated 1215 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:17:42.185718 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-11c30af8-351f-499d-bd7d-bab55c8a3a36 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:42.187009 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-11c30af8-351f-499d-bd7d-bab55c8a3a36 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] [instance: 88899717-00c2-4f38-bcdf-f29137dd5c15] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:42.194768 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-11c30af8-351f-499d-bd7d-bab55c8a3a36 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:42.195543 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-11c30af8-351f-499d-bd7d-bab55c8a3a36 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:42.196142 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-11c30af8-351f-499d-bd7d-bab55c8a3a36 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:42.197024 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-11c30af8-351f-499d-bd7d-bab55c8a3a36 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:42.197757 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-11c30af8-351f-499d-bd7d-bab55c8a3a36 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:42.198358 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-11c30af8-351f-499d-bd7d-bab55c8a3a36 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:42.317155 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-11c30af8-351f-499d-bd7d-bab55c8a3a36 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7557bdf83dd344f5b8f20ce3af781a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0587423d7f44899bac419cd4e883ec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:42.327902 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2aa73d44-bc6b-4a99-b42f-a88573ee6899 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:42.330418 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2aa73d44-bc6b-4a99-b42f-a88573ee6899 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e7405fc0-937a-4256-8d0c-95acd35ebc97] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:42.345327 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-11c30af8-351f-499d-bd7d-bab55c8a3a36 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] 10.222.0.79 "GET /compute/v2.1/servers/88899717-00c2-4f38-bcdf-f29137dd5c15" status: 200 len: 1472 microversion: 2.1 time: 0.163782 Oct 17 14:17:42.365606 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2aa73d44-bc6b-4a99-b42f-a88573ee6899 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:42.366238 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2aa73d44-bc6b-4a99-b42f-a88573ee6899 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:42.366704 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2aa73d44-bc6b-4a99-b42f-a88573ee6899 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:42.367484 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2aa73d44-bc6b-4a99-b42f-a88573ee6899 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:42.367940 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2aa73d44-bc6b-4a99-b42f-a88573ee6899 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:42.368361 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2aa73d44-bc6b-4a99-b42f-a88573ee6899 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:42.372424 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3020/5903] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:42 2022] GET /compute/v2.1/servers/88899717-00c2-4f38-bcdf-f29137dd5c15 => generated 1472 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:42.379297 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-962bd76a-857b-4474-9591-201fca29de2c tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:42.379916 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-962bd76a-857b-4474-9591-201fca29de2c tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] [instance: 88899717-00c2-4f38-bcdf-f29137dd5c15] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:42.401185 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-962bd76a-857b-4474-9591-201fca29de2c tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:42.402333 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-962bd76a-857b-4474-9591-201fca29de2c tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:42.403034 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-962bd76a-857b-4474-9591-201fca29de2c tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:42.404273 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-962bd76a-857b-4474-9591-201fca29de2c tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:42.405152 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-962bd76a-857b-4474-9591-201fca29de2c tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:42.405893 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-962bd76a-857b-4474-9591-201fca29de2c tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:42.481019 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2aa73d44-bc6b-4a99-b42f-a88573ee6899 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:42.492774 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2aa73d44-bc6b-4a99-b42f-a88573ee6899 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97" status: 200 len: 1318 microversion: 2.1 time: 0.169384 Oct 17 14:17:42.495239 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2884/5904] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:42 2022] GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:42.558955 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-962bd76a-857b-4474-9591-201fca29de2c tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7557bdf83dd344f5b8f20ce3af781a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0587423d7f44899bac419cd4e883ec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:42.567608 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-962bd76a-857b-4474-9591-201fca29de2c tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] 10.222.0.79 "GET /compute/v2.1/servers/88899717-00c2-4f38-bcdf-f29137dd5c15" status: 200 len: 1472 microversion: 2.1 time: 0.193892 Oct 17 14:17:42.568202 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3021/5905] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:42 2022] GET /compute/v2.1/servers/88899717-00c2-4f38-bcdf-f29137dd5c15 => generated 1472 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:42.592013 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f5346fe4-cc54-4619-a665-1aa5d409ee57 tempest-TestSecurityGroupsBasicOps-418240873 tempest-TestSecurityGroupsBasicOps-418240873-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:42.592648 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f5346fe4-cc54-4619-a665-1aa5d409ee57 tempest-TestSecurityGroupsBasicOps-418240873 tempest-TestSecurityGroupsBasicOps-418240873-project-admin] [instance: 88899717-00c2-4f38-bcdf-f29137dd5c15] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:42.600206 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f5346fe4-cc54-4619-a665-1aa5d409ee57 tempest-TestSecurityGroupsBasicOps-418240873 tempest-TestSecurityGroupsBasicOps-418240873-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:42.600607 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f5346fe4-cc54-4619-a665-1aa5d409ee57 tempest-TestSecurityGroupsBasicOps-418240873 tempest-TestSecurityGroupsBasicOps-418240873-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:42.601112 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f5346fe4-cc54-4619-a665-1aa5d409ee57 tempest-TestSecurityGroupsBasicOps-418240873 tempest-TestSecurityGroupsBasicOps-418240873-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:42.602516 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f5346fe4-cc54-4619-a665-1aa5d409ee57 tempest-TestSecurityGroupsBasicOps-418240873 tempest-TestSecurityGroupsBasicOps-418240873-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:42.603140 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f5346fe4-cc54-4619-a665-1aa5d409ee57 tempest-TestSecurityGroupsBasicOps-418240873 tempest-TestSecurityGroupsBasicOps-418240873-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:42.603588 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f5346fe4-cc54-4619-a665-1aa5d409ee57 tempest-TestSecurityGroupsBasicOps-418240873 tempest-TestSecurityGroupsBasicOps-418240873-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:42.678083 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-36977e91-e148-40fb-9089-eb51adc7b117 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:42.678723 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-36977e91-e148-40fb-9089-eb51adc7b117 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 7938058f-350c-458b-9d4e-8f1cc5397000] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:42.700680 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-36977e91-e148-40fb-9089-eb51adc7b117 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:42.701967 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f5346fe4-cc54-4619-a665-1aa5d409ee57 tempest-TestSecurityGroupsBasicOps-418240873 tempest-TestSecurityGroupsBasicOps-418240873-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/88899717-00c2-4f38-bcdf-f29137dd5c15" status: 200 len: 1625 microversion: 2.1 time: 0.113772 Oct 17 14:17:42.702941 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-36977e91-e148-40fb-9089-eb51adc7b117 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:42.703421 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-36977e91-e148-40fb-9089-eb51adc7b117 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:42.704160 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-36977e91-e148-40fb-9089-eb51adc7b117 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:42.704624 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-36977e91-e148-40fb-9089-eb51adc7b117 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:42.705050 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-36977e91-e148-40fb-9089-eb51adc7b117 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:42.705298 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2885/5906] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:42 2022] GET /compute/v2.1/servers/88899717-00c2-4f38-bcdf-f29137dd5c15 => generated 1625 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:42.725644 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1c6ae62a-f6fb-4e96-919f-9f55495b26bd tempest-TestSecurityGroupsBasicOps-418240873 tempest-TestSecurityGroupsBasicOps-418240873-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:42.726712 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1c6ae62a-f6fb-4e96-919f-9f55495b26bd tempest-TestSecurityGroupsBasicOps-418240873 tempest-TestSecurityGroupsBasicOps-418240873-project-admin] [instance: 3d0c26bc-24c7-43d1-a552-2d2aeb3590f0] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:42.734742 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c6ae62a-f6fb-4e96-919f-9f55495b26bd tempest-TestSecurityGroupsBasicOps-418240873 tempest-TestSecurityGroupsBasicOps-418240873-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:42.735474 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c6ae62a-f6fb-4e96-919f-9f55495b26bd tempest-TestSecurityGroupsBasicOps-418240873 tempest-TestSecurityGroupsBasicOps-418240873-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:42.736109 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c6ae62a-f6fb-4e96-919f-9f55495b26bd tempest-TestSecurityGroupsBasicOps-418240873 tempest-TestSecurityGroupsBasicOps-418240873-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:42.737025 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c6ae62a-f6fb-4e96-919f-9f55495b26bd tempest-TestSecurityGroupsBasicOps-418240873 tempest-TestSecurityGroupsBasicOps-418240873-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:42.737640 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c6ae62a-f6fb-4e96-919f-9f55495b26bd tempest-TestSecurityGroupsBasicOps-418240873 tempest-TestSecurityGroupsBasicOps-418240873-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:42.738230 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c6ae62a-f6fb-4e96-919f-9f55495b26bd tempest-TestSecurityGroupsBasicOps-418240873 tempest-TestSecurityGroupsBasicOps-418240873-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:43.022068 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-36977e91-e148-40fb-9089-eb51adc7b117 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:43.030899 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-36977e91-e148-40fb-9089-eb51adc7b117 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/7938058f-350c-458b-9d4e-8f1cc5397000" status: 200 len: 1203 microversion: 2.1 time: 0.358040 Oct 17 14:17:43.032095 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3022/5907] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:42 2022] GET /compute/v2.1/servers/7938058f-350c-458b-9d4e-8f1cc5397000 => generated 1203 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:17:43.052920 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1c6ae62a-f6fb-4e96-919f-9f55495b26bd tempest-TestSecurityGroupsBasicOps-418240873 tempest-TestSecurityGroupsBasicOps-418240873-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/3d0c26bc-24c7-43d1-a552-2d2aeb3590f0" status: 200 len: 1915 microversion: 2.1 time: 0.331832 Oct 17 14:17:43.053563 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2886/5908] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:42 2022] GET /compute/v2.1/servers/3d0c26bc-24c7-43d1-a552-2d2aeb3590f0 => generated 1915 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:17:43.129446 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d85c9cc0-d3cd-4560-a3f3-98338da8c55c tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:43.129956 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d85c9cc0-d3cd-4560-a3f3-98338da8c55c tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] [instance: 88899717-00c2-4f38-bcdf-f29137dd5c15] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:43.136636 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d85c9cc0-d3cd-4560-a3f3-98338da8c55c tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:43.137123 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d85c9cc0-d3cd-4560-a3f3-98338da8c55c tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:43.137573 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d85c9cc0-d3cd-4560-a3f3-98338da8c55c tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:43.138288 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d85c9cc0-d3cd-4560-a3f3-98338da8c55c tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:43.138743 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d85c9cc0-d3cd-4560-a3f3-98338da8c55c tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:43.139188 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d85c9cc0-d3cd-4560-a3f3-98338da8c55c tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:43.191881 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d85c9cc0-d3cd-4560-a3f3-98338da8c55c tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] [instance: 88899717-00c2-4f38-bcdf-f29137dd5c15] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:17:43.253180 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:17:43.309225 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d85c9cc0-d3cd-4560-a3f3-98338da8c55c tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] 10.222.0.79 "DELETE /compute/v2.1/servers/88899717-00c2-4f38-bcdf-f29137dd5c15" status: 204 len: 0 microversion: 2.1 time: 0.183767 Oct 17 14:17:43.309840 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3023/5909] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:17:43 2022] DELETE /compute/v2.1/servers/88899717-00c2-4f38-bcdf-f29137dd5c15 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:17:43.321122 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-73198cec-2d09-435e-ba54-c129f2c6587b tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:43.321970 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-73198cec-2d09-435e-ba54-c129f2c6587b tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] [instance: 88899717-00c2-4f38-bcdf-f29137dd5c15] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:43.330084 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-73198cec-2d09-435e-ba54-c129f2c6587b tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:43.331392 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-73198cec-2d09-435e-ba54-c129f2c6587b tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:43.331874 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-73198cec-2d09-435e-ba54-c129f2c6587b tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:43.332596 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-73198cec-2d09-435e-ba54-c129f2c6587b tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:43.333220 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-73198cec-2d09-435e-ba54-c129f2c6587b tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:43.333647 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-73198cec-2d09-435e-ba54-c129f2c6587b tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:43.456271 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-73198cec-2d09-435e-ba54-c129f2c6587b tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7557bdf83dd344f5b8f20ce3af781a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0587423d7f44899bac419cd4e883ec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:43.466474 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-73198cec-2d09-435e-ba54-c129f2c6587b tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] 10.222.0.79 "GET /compute/v2.1/servers/88899717-00c2-4f38-bcdf-f29137dd5c15" status: 200 len: 1478 microversion: 2.1 time: 0.151798 Oct 17 14:17:43.467258 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2887/5910] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:43 2022] GET /compute/v2.1/servers/88899717-00c2-4f38-bcdf-f29137dd5c15 => generated 1478 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:43.517381 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-348b6ea6-6d28-45a5-92ed-10542c4dfbd3 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:43.518062 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-348b6ea6-6d28-45a5-92ed-10542c4dfbd3 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e7405fc0-937a-4256-8d0c-95acd35ebc97] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:43.524973 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-348b6ea6-6d28-45a5-92ed-10542c4dfbd3 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:43.525474 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-348b6ea6-6d28-45a5-92ed-10542c4dfbd3 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:43.525884 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-348b6ea6-6d28-45a5-92ed-10542c4dfbd3 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:43.526812 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-348b6ea6-6d28-45a5-92ed-10542c4dfbd3 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:43.527303 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-348b6ea6-6d28-45a5-92ed-10542c4dfbd3 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:43.527742 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-348b6ea6-6d28-45a5-92ed-10542c4dfbd3 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:43.633495 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-348b6ea6-6d28-45a5-92ed-10542c4dfbd3 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:43.645767 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-348b6ea6-6d28-45a5-92ed-10542c4dfbd3 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97" status: 200 len: 1324 microversion: 2.1 time: 0.132288 Oct 17 14:17:43.646958 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3024/5911] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:43 2022] GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97 => generated 1324 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:44.055140 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0efcbbe5-14b4-494f-b2a5-819baa5a6642 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:44.055712 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0efcbbe5-14b4-494f-b2a5-819baa5a6642 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 7938058f-350c-458b-9d4e-8f1cc5397000] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:44.062883 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0efcbbe5-14b4-494f-b2a5-819baa5a6642 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:44.063422 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0efcbbe5-14b4-494f-b2a5-819baa5a6642 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:44.063864 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0efcbbe5-14b4-494f-b2a5-819baa5a6642 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:44.064571 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0efcbbe5-14b4-494f-b2a5-819baa5a6642 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:44.065042 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0efcbbe5-14b4-494f-b2a5-819baa5a6642 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:44.065450 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0efcbbe5-14b4-494f-b2a5-819baa5a6642 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:44.202754 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0efcbbe5-14b4-494f-b2a5-819baa5a6642 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:44.215472 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0efcbbe5-14b4-494f-b2a5-819baa5a6642 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/7938058f-350c-458b-9d4e-8f1cc5397000" status: 200 len: 1203 microversion: 2.1 time: 0.164430 Oct 17 14:17:44.216255 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2888/5912] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:44 2022] GET /compute/v2.1/servers/7938058f-350c-458b-9d4e-8f1cc5397000 => generated 1203 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:44.491999 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d957e50b-df10-4cac-ab52-b581bb773c92 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:44.492745 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d957e50b-df10-4cac-ab52-b581bb773c92 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] [instance: 88899717-00c2-4f38-bcdf-f29137dd5c15] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:44.500547 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d957e50b-df10-4cac-ab52-b581bb773c92 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:44.501139 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d957e50b-df10-4cac-ab52-b581bb773c92 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:44.501716 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d957e50b-df10-4cac-ab52-b581bb773c92 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:44.502516 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d957e50b-df10-4cac-ab52-b581bb773c92 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:44.503077 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d957e50b-df10-4cac-ab52-b581bb773c92 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:44.503604 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d957e50b-df10-4cac-ab52-b581bb773c92 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:44.669103 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-367f5349-a330-4bd2-a15e-32df5b9cdc86 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:44.669917 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-367f5349-a330-4bd2-a15e-32df5b9cdc86 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e7405fc0-937a-4256-8d0c-95acd35ebc97] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:44.676931 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-367f5349-a330-4bd2-a15e-32df5b9cdc86 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:44.677422 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-367f5349-a330-4bd2-a15e-32df5b9cdc86 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:44.678281 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-367f5349-a330-4bd2-a15e-32df5b9cdc86 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:44.678985 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-367f5349-a330-4bd2-a15e-32df5b9cdc86 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:44.679455 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-367f5349-a330-4bd2-a15e-32df5b9cdc86 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:44.679872 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-367f5349-a330-4bd2-a15e-32df5b9cdc86 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:44.977996 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d957e50b-df10-4cac-ab52-b581bb773c92 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7557bdf83dd344f5b8f20ce3af781a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0587423d7f44899bac419cd4e883ec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:44.986214 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d957e50b-df10-4cac-ab52-b581bb773c92 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] 10.222.0.79 "GET /compute/v2.1/servers/88899717-00c2-4f38-bcdf-f29137dd5c15" status: 200 len: 1478 microversion: 2.1 time: 0.499341 Oct 17 14:17:44.986824 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3025/5913] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:44 2022] GET /compute/v2.1/servers/88899717-00c2-4f38-bcdf-f29137dd5c15 => generated 1478 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:45.238211 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-26fc9520-f0f7-4645-8c6d-ca8be73e306e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:45.238911 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-26fc9520-f0f7-4645-8c6d-ca8be73e306e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 7938058f-350c-458b-9d4e-8f1cc5397000] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:45.245889 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-26fc9520-f0f7-4645-8c6d-ca8be73e306e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:45.246376 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-26fc9520-f0f7-4645-8c6d-ca8be73e306e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:45.246806 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-26fc9520-f0f7-4645-8c6d-ca8be73e306e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:45.247538 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-26fc9520-f0f7-4645-8c6d-ca8be73e306e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:45.247988 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-26fc9520-f0f7-4645-8c6d-ca8be73e306e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:45.248408 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-26fc9520-f0f7-4645-8c6d-ca8be73e306e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:45.288420 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-367f5349-a330-4bd2-a15e-32df5b9cdc86 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:45.296214 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-367f5349-a330-4bd2-a15e-32df5b9cdc86 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97" status: 200 len: 1391 microversion: 2.1 time: 0.631132 Oct 17 14:17:45.296813 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2889/5914] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:44 2022] GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97 => generated 1391 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:45.589381 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-26fc9520-f0f7-4645-8c6d-ca8be73e306e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:45.598001 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-26fc9520-f0f7-4645-8c6d-ca8be73e306e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/7938058f-350c-458b-9d4e-8f1cc5397000" status: 200 len: 1203 microversion: 2.1 time: 0.363863 Oct 17 14:17:45.598578 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3026/5915] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:45 2022] GET /compute/v2.1/servers/7938058f-350c-458b-9d4e-8f1cc5397000 => generated 1203 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:45.867770 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-7e03f72c-af75-488d-8b6b-d8e7ae9201fd req-f7cac69d-ccb4-47ae-a33d-7883a145ec14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88899717-00c2-4f38-bcdf-f29137dd5c15", "name": "network-vif-deleted", "tag": "6654aa33-4513-4f5e-b642-56241d6394eb"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:17:45.886451 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-7e03f72c-af75-488d-8b6b-d8e7ae9201fd req-f7cac69d-ccb4-47ae-a33d-7883a145ec14 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:45.887185 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-7e03f72c-af75-488d-8b6b-d8e7ae9201fd req-f7cac69d-ccb4-47ae-a33d-7883a145ec14 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:45.887838 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-7e03f72c-af75-488d-8b6b-d8e7ae9201fd req-f7cac69d-ccb4-47ae-a33d-7883a145ec14 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:45.914275 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-7e03f72c-af75-488d-8b6b-d8e7ae9201fd req-f7cac69d-ccb4-47ae-a33d-7883a145ec14 service nova] Creating event network-vif-deleted:6654aa33-4513-4f5e-b642-56241d6394eb for instance 88899717-00c2-4f38-bcdf-f29137dd5c15 on n-h2-854247-14 Oct 17 14:17:45.920940 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-7e03f72c-af75-488d-8b6b-d8e7ae9201fd req-f7cac69d-ccb4-47ae-a33d-7883a145ec14 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058648 Oct 17 14:17:45.922086 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2890/5916] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:17:46.010317 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9dd36995-57da-44b5-98d2-9db25570bc1f tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:46.010946 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9dd36995-57da-44b5-98d2-9db25570bc1f tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] [instance: 88899717-00c2-4f38-bcdf-f29137dd5c15] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:46.019765 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9dd36995-57da-44b5-98d2-9db25570bc1f tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:46.020269 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9dd36995-57da-44b5-98d2-9db25570bc1f tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:46.020742 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9dd36995-57da-44b5-98d2-9db25570bc1f tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:46.027380 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9dd36995-57da-44b5-98d2-9db25570bc1f tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:46.029432 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9dd36995-57da-44b5-98d2-9db25570bc1f tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:46.029965 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9dd36995-57da-44b5-98d2-9db25570bc1f tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:46.066528 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9dd36995-57da-44b5-98d2-9db25570bc1f tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:46.067098 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9dd36995-57da-44b5-98d2-9db25570bc1f tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:46.067575 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9dd36995-57da-44b5-98d2-9db25570bc1f tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:46.068044 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-9dd36995-57da-44b5-98d2-9db25570bc1f tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lazy-loading 'fault' on Instance uuid 88899717-00c2-4f38-bcdf-f29137dd5c15 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:17:46.139810 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9dd36995-57da-44b5-98d2-9db25570bc1f tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7557bdf83dd344f5b8f20ce3af781a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0587423d7f44899bac419cd4e883ec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:46.149078 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9dd36995-57da-44b5-98d2-9db25570bc1f tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] 10.222.0.79 "GET /compute/v2.1/servers/88899717-00c2-4f38-bcdf-f29137dd5c15" status: 200 len: 1331 microversion: 2.1 time: 0.142972 Oct 17 14:17:46.149695 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3027/5917] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:46 2022] GET /compute/v2.1/servers/88899717-00c2-4f38-bcdf-f29137dd5c15 => generated 1331 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:46.320894 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2b2e8d01-6b8d-4dc6-a7d0-c5c058177bea tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:46.322465 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2b2e8d01-6b8d-4dc6-a7d0-c5c058177bea tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e7405fc0-937a-4256-8d0c-95acd35ebc97] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:46.330295 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2b2e8d01-6b8d-4dc6-a7d0-c5c058177bea tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:46.330786 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2b2e8d01-6b8d-4dc6-a7d0-c5c058177bea tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:46.331242 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2b2e8d01-6b8d-4dc6-a7d0-c5c058177bea tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:46.331963 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2b2e8d01-6b8d-4dc6-a7d0-c5c058177bea tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:46.332826 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2b2e8d01-6b8d-4dc6-a7d0-c5c058177bea tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:46.333279 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2b2e8d01-6b8d-4dc6-a7d0-c5c058177bea tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:46.553850 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2b2e8d01-6b8d-4dc6-a7d0-c5c058177bea tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:46.563029 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2b2e8d01-6b8d-4dc6-a7d0-c5c058177bea tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97" status: 200 len: 1391 microversion: 2.1 time: 0.247127 Oct 17 14:17:46.563753 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2891/5918] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:46 2022] GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97 => generated 1391 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:46.622047 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-68170a72-92a5-4744-a8ea-d9c2e5ddca18 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:46.622669 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-68170a72-92a5-4744-a8ea-d9c2e5ddca18 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 7938058f-350c-458b-9d4e-8f1cc5397000] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:46.629803 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-68170a72-92a5-4744-a8ea-d9c2e5ddca18 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:46.630275 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-68170a72-92a5-4744-a8ea-d9c2e5ddca18 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:46.630707 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-68170a72-92a5-4744-a8ea-d9c2e5ddca18 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:46.631634 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-68170a72-92a5-4744-a8ea-d9c2e5ddca18 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:46.632392 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-68170a72-92a5-4744-a8ea-d9c2e5ddca18 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:46.632851 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-68170a72-92a5-4744-a8ea-d9c2e5ddca18 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:46.775603 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-68170a72-92a5-4744-a8ea-d9c2e5ddca18 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:46.784007 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-68170a72-92a5-4744-a8ea-d9c2e5ddca18 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/7938058f-350c-458b-9d4e-8f1cc5397000" status: 200 len: 1203 microversion: 2.1 time: 0.165955 Oct 17 14:17:46.784590 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3028/5919] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:46 2022] GET /compute/v2.1/servers/7938058f-350c-458b-9d4e-8f1cc5397000 => generated 1203 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:47.177492 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a93f7a60-56ef-42e9-be25-73a8b47cfce8 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:47.178602 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a93f7a60-56ef-42e9-be25-73a8b47cfce8 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] [instance: 88899717-00c2-4f38-bcdf-f29137dd5c15] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:47.185765 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a93f7a60-56ef-42e9-be25-73a8b47cfce8 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:47.186249 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a93f7a60-56ef-42e9-be25-73a8b47cfce8 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:47.186679 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a93f7a60-56ef-42e9-be25-73a8b47cfce8 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:47.187414 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a93f7a60-56ef-42e9-be25-73a8b47cfce8 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:47.187858 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a93f7a60-56ef-42e9-be25-73a8b47cfce8 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:47.188274 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a93f7a60-56ef-42e9-be25-73a8b47cfce8 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:47.202662 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-a93f7a60-56ef-42e9-be25-73a8b47cfce8 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] HTTP exception thrown: Instance 88899717-00c2-4f38-bcdf-f29137dd5c15 could not be found. Oct 17 14:17:47.204346 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a93f7a60-56ef-42e9-be25-73a8b47cfce8 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Request method failure captured: Oct 17 14:17:47.204346 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/88899717-00c2-4f38-bcdf-f29137dd5c15 HTTP/1.1 Oct 17 14:17:47.204346 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 14:17:47.204346 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 14:17:47.204346 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 14:17:47.204346 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 14:17:47.204346 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 14:17:47.204346 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 14:17:47.204346 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 14:17:47.204346 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 14:17:47.204346 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTWO2JLD7z4cKw0IJXlhWWcVu1mKR4dLuF-qc_rCokC37wd-lYMD-6cQm-nvj9tQ_CpDv_-VaU_TjOB4e8Bxc-0uiZj3y2GRTtERnTP_1sFMoeUek06g3vKprjYvCbV0t2jXjHtxf7J3hvPujNEbNiJ1Wu18jeoGTvVpXpn_F6Od6_NY Oct 17 14:17:47.204346 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 14:17:47.204346 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 14:17:47.204346 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 14:17:47.204346 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 14:17:47.204346 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 14:17:47.204346 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 14:17:47.204346 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: b0587423d7f44899bac419cd4e883ec9 Oct 17 14:17:47.204346 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1243284561 Oct 17 14:17:47.204346 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 14:17:47.204346 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 14:17:47.204346 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b0587423d7f44899bac419cd4e883ec9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b0587423d7f44899bac419cd4e883ec9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b0587423d7f44899bac419cd4e883ec9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b0587423d7f44899bac419cd4e883ec9", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:17:47.204346 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1243284561 Oct 17 14:17:47.204346 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: b0587423d7f44899bac419cd4e883ec9 Oct 17 14:17:47.204346 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1243284561 Oct 17 14:17:47.204346 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-TestSecurityGroupsBasicOps-1243284561-project Oct 17 14:17:47.204346 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 14:17:47.204346 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 14:17:47.204346 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 7557bdf83dd344f5b8f20ce3af781a71 Oct 17 14:17:47.204346 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1243284561-project Oct 17 14:17:47.204346 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 14:17:47.204346 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 88899717-00c2-4f38-bcdf-f29137dd5c15 could not be found. Oct 17 14:17:47.204346 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '88899717-00c2-4f38-bcdf-f29137dd5c15'} Oct 17 14:17:47.204346 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:17:47.204346 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:17:47.204346 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:17:47.204346 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:17:47.204346 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:17:47.204346 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:17:47.204346 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:17:47.204346 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:17:47.204346 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:17:47.204346 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:17:47.204346 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88899717-00c2-4f38-bcdf-f29137dd5c15 could not be found. Oct 17 14:17:47.204346 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:17:47.204346 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:17:47.204346 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:17:47.204346 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:17:47.204346 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:17:47.204346 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:17:47.204346 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:17:47.204346 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:17:47.204346 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:17:47.204346 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:17:47.204346 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:17:47.204346 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:17:47.204346 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:17:47.204346 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:17:47.204346 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:17:47.204346 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:17:47.204346 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88899717-00c2-4f38-bcdf-f29137dd5c15 could not be found. Oct 17 14:17:47.204346 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:17:47.204346 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:17:47.207651 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:17:47.207651 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:17:47.207651 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:17:47.207651 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:17:47.207651 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:17:47.207651 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:17:47.207651 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88899717-00c2-4f38-bcdf-f29137dd5c15 could not be found. Oct 17 14:17:47.207651 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:17:47.207651 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a93f7a60-56ef-42e9-be25-73a8b47cfce8 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Returning 404 to user: Instance 88899717-00c2-4f38-bcdf-f29137dd5c15 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:17:47.207651 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a93f7a60-56ef-42e9-be25-73a8b47cfce8 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] 10.222.0.79 "GET /compute/v2.1/servers/88899717-00c2-4f38-bcdf-f29137dd5c15" status: 404 len: 111 microversion: 2.1 time: 0.035229 Oct 17 14:17:47.207651 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2892/5920] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:47 2022] GET /compute/v2.1/servers/88899717-00c2-4f38-bcdf-f29137dd5c15 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:17:47.586187 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ad8b2f74-2e6b-4c9f-aca2-d3aae01f791d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:47.586932 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ad8b2f74-2e6b-4c9f-aca2-d3aae01f791d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e7405fc0-937a-4256-8d0c-95acd35ebc97] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:47.589146 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=69,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:17:47.595303 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ad8b2f74-2e6b-4c9f-aca2-d3aae01f791d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:47.595851 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ad8b2f74-2e6b-4c9f-aca2-d3aae01f791d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:47.596327 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ad8b2f74-2e6b-4c9f-aca2-d3aae01f791d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:47.597039 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ad8b2f74-2e6b-4c9f-aca2-d3aae01f791d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:47.597494 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ad8b2f74-2e6b-4c9f-aca2-d3aae01f791d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:47.597918 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ad8b2f74-2e6b-4c9f-aca2-d3aae01f791d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:47.801407 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ad8b2f74-2e6b-4c9f-aca2-d3aae01f791d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:47.810795 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ad8b2f74-2e6b-4c9f-aca2-d3aae01f791d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97" status: 200 len: 1391 microversion: 2.1 time: 0.229018 Oct 17 14:17:47.810967 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f03e3e57-b0b4-4f3d-9ee7-9354bd45d1fb tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:47.812124 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3029/5921] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:47 2022] GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97 => generated 1391 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:47.825907 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f03e3e57-b0b4-4f3d-9ee7-9354bd45d1fb tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 7938058f-350c-458b-9d4e-8f1cc5397000] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:47.834280 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f03e3e57-b0b4-4f3d-9ee7-9354bd45d1fb tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:47.834853 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f03e3e57-b0b4-4f3d-9ee7-9354bd45d1fb tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:47.835598 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f03e3e57-b0b4-4f3d-9ee7-9354bd45d1fb tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:47.836304 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f03e3e57-b0b4-4f3d-9ee7-9354bd45d1fb tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:47.836752 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f03e3e57-b0b4-4f3d-9ee7-9354bd45d1fb tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:47.837133 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f03e3e57-b0b4-4f3d-9ee7-9354bd45d1fb tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:47.962531 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-60757e13-6013-49c4-9623-f69243cdf6f0 req-ef63a531-df93-429c-9aa2-a7c448e4a0b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7405fc0-937a-4256-8d0c-95acd35ebc97", "tag": "416db0e1-9273-4dba-a586-13951c2b8257"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:17:47.972506 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-60757e13-6013-49c4-9623-f69243cdf6f0 req-ef63a531-df93-429c-9aa2-a7c448e4a0b9 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:47.973139 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-60757e13-6013-49c4-9623-f69243cdf6f0 req-ef63a531-df93-429c-9aa2-a7c448e4a0b9 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:47.973711 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-60757e13-6013-49c4-9623-f69243cdf6f0 req-ef63a531-df93-429c-9aa2-a7c448e4a0b9 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:47.986785 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-60757e13-6013-49c4-9623-f69243cdf6f0 req-ef63a531-df93-429c-9aa2-a7c448e4a0b9 service nova] Creating event network-changed:416db0e1-9273-4dba-a586-13951c2b8257 for instance e7405fc0-937a-4256-8d0c-95acd35ebc97 on n-h2-854247-14 Oct 17 14:17:47.992192 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-60757e13-6013-49c4-9623-f69243cdf6f0 req-ef63a531-df93-429c-9aa2-a7c448e4a0b9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033594 Oct 17 14:17:47.992813 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3030/5922] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:17:48.110200 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f03e3e57-b0b4-4f3d-9ee7-9354bd45d1fb tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:48.118359 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f03e3e57-b0b4-4f3d-9ee7-9354bd45d1fb tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/7938058f-350c-458b-9d4e-8f1cc5397000" status: 200 len: 1203 microversion: 2.1 time: 0.312825 Oct 17 14:17:48.118947 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2893/5923] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:47 2022] GET /compute/v2.1/servers/7938058f-350c-458b-9d4e-8f1cc5397000 => generated 1203 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:48.836403 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2c01f9f7-10bb-477d-99e9-f47678d73f12 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:48.836965 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2c01f9f7-10bb-477d-99e9-f47678d73f12 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e7405fc0-937a-4256-8d0c-95acd35ebc97] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:48.844041 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2c01f9f7-10bb-477d-99e9-f47678d73f12 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:48.844537 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2c01f9f7-10bb-477d-99e9-f47678d73f12 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:48.844979 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2c01f9f7-10bb-477d-99e9-f47678d73f12 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:48.845698 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2c01f9f7-10bb-477d-99e9-f47678d73f12 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:48.846157 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2c01f9f7-10bb-477d-99e9-f47678d73f12 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:48.846583 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2c01f9f7-10bb-477d-99e9-f47678d73f12 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:49.142348 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f93ea57d-2115-49f1-a964-da703af85e4f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:49.143052 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f93ea57d-2115-49f1-a964-da703af85e4f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 7938058f-350c-458b-9d4e-8f1cc5397000] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:49.150773 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f93ea57d-2115-49f1-a964-da703af85e4f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:49.151303 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f93ea57d-2115-49f1-a964-da703af85e4f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:49.151746 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f93ea57d-2115-49f1-a964-da703af85e4f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:49.152457 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f93ea57d-2115-49f1-a964-da703af85e4f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:49.152915 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f93ea57d-2115-49f1-a964-da703af85e4f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:49.153342 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f93ea57d-2115-49f1-a964-da703af85e4f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:49.405111 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2c01f9f7-10bb-477d-99e9-f47678d73f12 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:49.415495 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2c01f9f7-10bb-477d-99e9-f47678d73f12 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97" status: 200 len: 1391 microversion: 2.1 time: 0.584531 Oct 17 14:17:49.416245 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3031/5924] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:48 2022] GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97 => generated 1391 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:49.438811 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f93ea57d-2115-49f1-a964-da703af85e4f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:49.447410 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f93ea57d-2115-49f1-a964-da703af85e4f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/7938058f-350c-458b-9d4e-8f1cc5397000" status: 200 len: 1203 microversion: 2.1 time: 0.309032 Oct 17 14:17:49.448126 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2894/5925] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:49 2022] GET /compute/v2.1/servers/7938058f-350c-458b-9d4e-8f1cc5397000 => generated 1203 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:50.440169 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-549787b2-38b2-4351-95a5-9264ab2f392c tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:50.441600 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-549787b2-38b2-4351-95a5-9264ab2f392c tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e7405fc0-937a-4256-8d0c-95acd35ebc97] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:50.449341 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-549787b2-38b2-4351-95a5-9264ab2f392c tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:50.449834 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-549787b2-38b2-4351-95a5-9264ab2f392c tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:50.450281 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-549787b2-38b2-4351-95a5-9264ab2f392c tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:50.450989 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-549787b2-38b2-4351-95a5-9264ab2f392c tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:50.451527 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-549787b2-38b2-4351-95a5-9264ab2f392c tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:50.452146 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-549787b2-38b2-4351-95a5-9264ab2f392c tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:50.470211 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d026b0cf-6ffc-4c29-8d8f-bfefeae98af6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:50.470810 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d026b0cf-6ffc-4c29-8d8f-bfefeae98af6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 7938058f-350c-458b-9d4e-8f1cc5397000] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:50.480842 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d026b0cf-6ffc-4c29-8d8f-bfefeae98af6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:50.481344 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d026b0cf-6ffc-4c29-8d8f-bfefeae98af6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:50.484359 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d026b0cf-6ffc-4c29-8d8f-bfefeae98af6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:50.485098 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d026b0cf-6ffc-4c29-8d8f-bfefeae98af6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:50.487730 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d026b0cf-6ffc-4c29-8d8f-bfefeae98af6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:50.488632 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d026b0cf-6ffc-4c29-8d8f-bfefeae98af6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:50.807200 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d026b0cf-6ffc-4c29-8d8f-bfefeae98af6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:50.815458 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d026b0cf-6ffc-4c29-8d8f-bfefeae98af6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/7938058f-350c-458b-9d4e-8f1cc5397000" status: 200 len: 1203 microversion: 2.1 time: 0.349099 Oct 17 14:17:50.828983 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2895/5926] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:50 2022] GET /compute/v2.1/servers/7938058f-350c-458b-9d4e-8f1cc5397000 => generated 1203 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:50.834936 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-86cdc6ab-f048-4e4c-a219-f0f9bcad841d req-0c9f1f82-a52e-45ee-abe9-cbf0a4c7c184 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7405fc0-937a-4256-8d0c-95acd35ebc97", "name": "network-vif-plugged", "status": "completed", "tag": "416db0e1-9273-4dba-a586-13951c2b8257"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:17:50.839417 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-549787b2-38b2-4351-95a5-9264ab2f392c tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:50.844834 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-86cdc6ab-f048-4e4c-a219-f0f9bcad841d req-0c9f1f82-a52e-45ee-abe9-cbf0a4c7c184 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:50.845308 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-86cdc6ab-f048-4e4c-a219-f0f9bcad841d req-0c9f1f82-a52e-45ee-abe9-cbf0a4c7c184 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:50.845740 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-86cdc6ab-f048-4e4c-a219-f0f9bcad841d req-0c9f1f82-a52e-45ee-abe9-cbf0a4c7c184 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:50.849879 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-549787b2-38b2-4351-95a5-9264ab2f392c tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97" status: 200 len: 1391 microversion: 2.1 time: 0.413783 Oct 17 14:17:50.852466 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3032/5927] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:50 2022] GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97 => generated 1391 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:50.863648 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-86cdc6ab-f048-4e4c-a219-f0f9bcad841d req-0c9f1f82-a52e-45ee-abe9-cbf0a4c7c184 service nova] Creating event network-vif-plugged:416db0e1-9273-4dba-a586-13951c2b8257 for instance e7405fc0-937a-4256-8d0c-95acd35ebc97 on n-h2-854247-14 Oct 17 14:17:50.869831 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-86cdc6ab-f048-4e4c-a219-f0f9bcad841d req-0c9f1f82-a52e-45ee-abe9-cbf0a4c7c184 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039271 Oct 17 14:17:50.870436 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2896/5928] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:17:51.842507 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3ac20306-f907-4407-bb8e-9960a9ca2ba0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:51.843141 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3ac20306-f907-4407-bb8e-9960a9ca2ba0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 7938058f-350c-458b-9d4e-8f1cc5397000] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:51.845429 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=6 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:17:51.860835 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3ac20306-f907-4407-bb8e-9960a9ca2ba0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:51.861328 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3ac20306-f907-4407-bb8e-9960a9ca2ba0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:51.864304 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3ac20306-f907-4407-bb8e-9960a9ca2ba0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:51.868822 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3ac20306-f907-4407-bb8e-9960a9ca2ba0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:51.869597 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3ac20306-f907-4407-bb8e-9960a9ca2ba0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:51.872004 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3ac20306-f907-4407-bb8e-9960a9ca2ba0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:51.874460 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4eb17779-39a3-4784-ba57-6df741e869e8 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:51.875180 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4eb17779-39a3-4784-ba57-6df741e869e8 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e7405fc0-937a-4256-8d0c-95acd35ebc97] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:51.884925 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=6 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:17:51.885908 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=22 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:17:51.888769 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4eb17779-39a3-4784-ba57-6df741e869e8 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:51.889332 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4eb17779-39a3-4784-ba57-6df741e869e8 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:51.889722 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4eb17779-39a3-4784-ba57-6df741e869e8 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:51.890498 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4eb17779-39a3-4784-ba57-6df741e869e8 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:51.891800 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4eb17779-39a3-4784-ba57-6df741e869e8 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:51.892385 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4eb17779-39a3-4784-ba57-6df741e869e8 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:52.191962 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3ac20306-f907-4407-bb8e-9960a9ca2ba0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:52.197783 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4eb17779-39a3-4784-ba57-6df741e869e8 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:52.208020 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4eb17779-39a3-4784-ba57-6df741e869e8 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97" status: 200 len: 1391 microversion: 2.1 time: 0.337887 Oct 17 14:17:52.209757 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2897/5929] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:51 2022] GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97 => generated 1391 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:17:52.213759 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3ac20306-f907-4407-bb8e-9960a9ca2ba0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/7938058f-350c-458b-9d4e-8f1cc5397000" status: 200 len: 1203 microversion: 2.1 time: 0.375388 Oct 17 14:17:52.222164 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3033/5930] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:51 2022] GET /compute/v2.1/servers/7938058f-350c-458b-9d4e-8f1cc5397000 => generated 1203 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:52.727994 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ea82fd07-c2bb-4766-b3ba-8320e75d18d8 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:52.728637 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ea82fd07-c2bb-4766-b3ba-8320e75d18d8 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] [instance: 3d0c26bc-24c7-43d1-a552-2d2aeb3590f0] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:52.731400 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-983b815f-f767-4c65-b78d-35749f63ef1a req-f2a31a99-a156-49ac-8988-04a633fda062 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d0c26bc-24c7-43d1-a552-2d2aeb3590f0", "tag": "15941bb8-9645-43d7-8f65-311354b6ab89"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:17:52.735729 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ea82fd07-c2bb-4766-b3ba-8320e75d18d8 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:52.736331 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ea82fd07-c2bb-4766-b3ba-8320e75d18d8 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:52.736866 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ea82fd07-c2bb-4766-b3ba-8320e75d18d8 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:52.737653 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ea82fd07-c2bb-4766-b3ba-8320e75d18d8 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:52.738210 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ea82fd07-c2bb-4766-b3ba-8320e75d18d8 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:52.738749 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ea82fd07-c2bb-4766-b3ba-8320e75d18d8 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:52.742009 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-983b815f-f767-4c65-b78d-35749f63ef1a req-f2a31a99-a156-49ac-8988-04a633fda062 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:52.742462 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-983b815f-f767-4c65-b78d-35749f63ef1a req-f2a31a99-a156-49ac-8988-04a633fda062 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:52.743332 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-983b815f-f767-4c65-b78d-35749f63ef1a req-f2a31a99-a156-49ac-8988-04a633fda062 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:52.756552 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-983b815f-f767-4c65-b78d-35749f63ef1a req-f2a31a99-a156-49ac-8988-04a633fda062 service nova] Creating event network-changed:15941bb8-9645-43d7-8f65-311354b6ab89 for instance 3d0c26bc-24c7-43d1-a552-2d2aeb3590f0 on n-h1-854247-14 Oct 17 14:17:52.762839 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-983b815f-f767-4c65-b78d-35749f63ef1a req-f2a31a99-a156-49ac-8988-04a633fda062 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036890 Oct 17 14:17:52.764266 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3034/5931] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:17:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:17:52.769743 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ea82fd07-c2bb-4766-b3ba-8320e75d18d8 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] [instance: 3d0c26bc-24c7-43d1-a552-2d2aeb3590f0] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:17:52.861454 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ea82fd07-c2bb-4766-b3ba-8320e75d18d8 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3d0c26bc-24c7-43d1-a552-2d2aeb3590f0" status: 204 len: 0 microversion: 2.1 time: 0.137633 Oct 17 14:17:52.862611 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2898/5932] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:17:52 2022] DELETE /compute/v2.1/servers/3d0c26bc-24c7-43d1-a552-2d2aeb3590f0 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:17:52.873739 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-43edd94f-2960-4d9f-8fde-7b4e03d7c776 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:52.874437 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-43edd94f-2960-4d9f-8fde-7b4e03d7c776 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] [instance: 3d0c26bc-24c7-43d1-a552-2d2aeb3590f0] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:52.881349 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-43edd94f-2960-4d9f-8fde-7b4e03d7c776 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:52.882102 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-43edd94f-2960-4d9f-8fde-7b4e03d7c776 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:52.882541 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-43edd94f-2960-4d9f-8fde-7b4e03d7c776 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:52.883329 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-43edd94f-2960-4d9f-8fde-7b4e03d7c776 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:52.883784 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-43edd94f-2960-4d9f-8fde-7b4e03d7c776 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:52.884232 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-43edd94f-2960-4d9f-8fde-7b4e03d7c776 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:52.931057 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-b92d4141-1032-43e6-a66f-b5f3749b0b25 req-04848bfc-c182-47a2-af8e-431f6cc09132 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7938058f-350c-458b-9d4e-8f1cc5397000", "name": "network-vif-plugged", "status": "completed", "tag": "66bfea9f-9d6b-47e1-926b-bdbf6f85834a"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:17:52.947554 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-b92d4141-1032-43e6-a66f-b5f3749b0b25 req-04848bfc-c182-47a2-af8e-431f6cc09132 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:52.948313 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-b92d4141-1032-43e6-a66f-b5f3749b0b25 req-04848bfc-c182-47a2-af8e-431f6cc09132 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:52.948874 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-b92d4141-1032-43e6-a66f-b5f3749b0b25 req-04848bfc-c182-47a2-af8e-431f6cc09132 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:52.964796 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-b92d4141-1032-43e6-a66f-b5f3749b0b25 req-04848bfc-c182-47a2-af8e-431f6cc09132 service nova] Creating event network-vif-plugged:66bfea9f-9d6b-47e1-926b-bdbf6f85834a for instance 7938058f-350c-458b-9d4e-8f1cc5397000 on n-h1-854247-14 Oct 17 14:17:52.970379 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-b92d4141-1032-43e6-a66f-b5f3749b0b25 req-04848bfc-c182-47a2-af8e-431f6cc09132 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043812 Oct 17 14:17:52.971323 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2899/5933] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:17:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:17:53.074415 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-43edd94f-2960-4d9f-8fde-7b4e03d7c776 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7557bdf83dd344f5b8f20ce3af781a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0587423d7f44899bac419cd4e883ec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:53.082531 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-43edd94f-2960-4d9f-8fde-7b4e03d7c776 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] 10.222.0.79 "GET /compute/v2.1/servers/3d0c26bc-24c7-43d1-a552-2d2aeb3590f0" status: 200 len: 1768 microversion: 2.1 time: 0.215081 Oct 17 14:17:53.083123 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3035/5934] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:52 2022] GET /compute/v2.1/servers/3d0c26bc-24c7-43d1-a552-2d2aeb3590f0 => generated 1768 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:17:53.235395 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2e253cef-07c2-41d4-8878-9dcb5cf8eb24 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:53.235395 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2e253cef-07c2-41d4-8878-9dcb5cf8eb24 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e7405fc0-937a-4256-8d0c-95acd35ebc97] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:53.242577 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2e253cef-07c2-41d4-8878-9dcb5cf8eb24 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:53.243327 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2e253cef-07c2-41d4-8878-9dcb5cf8eb24 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:53.243937 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2e253cef-07c2-41d4-8878-9dcb5cf8eb24 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:53.244734 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2e253cef-07c2-41d4-8878-9dcb5cf8eb24 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:53.245055 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9acba87f-cbcd-4ad1-9310-3e34d5303898 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:53.245520 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2e253cef-07c2-41d4-8878-9dcb5cf8eb24 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:53.245669 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9acba87f-cbcd-4ad1-9310-3e34d5303898 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 7938058f-350c-458b-9d4e-8f1cc5397000] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:53.246108 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2e253cef-07c2-41d4-8878-9dcb5cf8eb24 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:53.252162 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9acba87f-cbcd-4ad1-9310-3e34d5303898 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:53.252659 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9acba87f-cbcd-4ad1-9310-3e34d5303898 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:53.253143 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9acba87f-cbcd-4ad1-9310-3e34d5303898 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:53.254220 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9acba87f-cbcd-4ad1-9310-3e34d5303898 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:53.254686 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9acba87f-cbcd-4ad1-9310-3e34d5303898 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:53.255119 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9acba87f-cbcd-4ad1-9310-3e34d5303898 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:53.263599 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:17:53.474657 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2e253cef-07c2-41d4-8878-9dcb5cf8eb24 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:53.484257 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2e253cef-07c2-41d4-8878-9dcb5cf8eb24 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97" status: 200 len: 1562 microversion: 2.1 time: 0.254214 Oct 17 14:17:53.488548 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9acba87f-cbcd-4ad1-9310-3e34d5303898 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:53.497010 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9acba87f-cbcd-4ad1-9310-3e34d5303898 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/7938058f-350c-458b-9d4e-8f1cc5397000" status: 200 len: 1203 microversion: 2.1 time: 0.256291 Oct 17 14:17:53.497613 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3036/5935] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:53 2022] GET /compute/v2.1/servers/7938058f-350c-458b-9d4e-8f1cc5397000 => generated 1203 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:53.499654 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2900/5936] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:53 2022] GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97 => generated 1562 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:53.509859 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2869af61-67da-427b-9b80-1b2849b05461 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:53.510668 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2869af61-67da-427b-9b80-1b2849b05461 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e7405fc0-937a-4256-8d0c-95acd35ebc97] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:53.517636 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2869af61-67da-427b-9b80-1b2849b05461 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:53.518143 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2869af61-67da-427b-9b80-1b2849b05461 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:53.518574 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2869af61-67da-427b-9b80-1b2849b05461 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:53.519325 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2869af61-67da-427b-9b80-1b2849b05461 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:53.519872 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2869af61-67da-427b-9b80-1b2849b05461 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:53.520303 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2869af61-67da-427b-9b80-1b2849b05461 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:53.679602 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2869af61-67da-427b-9b80-1b2849b05461 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:53.688385 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2869af61-67da-427b-9b80-1b2849b05461 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97" status: 200 len: 1562 microversion: 2.1 time: 0.183751 Oct 17 14:17:53.688983 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3037/5937] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:53 2022] GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97 => generated 1562 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:17:54.108754 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-74ddae1f-83c4-4771-b4dd-096f85d842b1 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:54.109371 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-74ddae1f-83c4-4771-b4dd-096f85d842b1 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] [instance: 3d0c26bc-24c7-43d1-a552-2d2aeb3590f0] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:54.116792 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-74ddae1f-83c4-4771-b4dd-096f85d842b1 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:54.117275 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-74ddae1f-83c4-4771-b4dd-096f85d842b1 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:54.117697 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-74ddae1f-83c4-4771-b4dd-096f85d842b1 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:54.118383 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-74ddae1f-83c4-4771-b4dd-096f85d842b1 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:54.118823 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-74ddae1f-83c4-4771-b4dd-096f85d842b1 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:54.119225 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-74ddae1f-83c4-4771-b4dd-096f85d842b1 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:54.312988 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-74ddae1f-83c4-4771-b4dd-096f85d842b1 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7557bdf83dd344f5b8f20ce3af781a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0587423d7f44899bac419cd4e883ec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:54.326593 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-74ddae1f-83c4-4771-b4dd-096f85d842b1 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] 10.222.0.79 "GET /compute/v2.1/servers/3d0c26bc-24c7-43d1-a552-2d2aeb3590f0" status: 200 len: 1768 microversion: 2.1 time: 0.221647 Oct 17 14:17:54.327576 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2901/5938] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:54 2022] GET /compute/v2.1/servers/3d0c26bc-24c7-43d1-a552-2d2aeb3590f0 => generated 1768 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:17:54.522725 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-bb56be2a-2979-4c93-9bf0-1f40d84f951b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:54.523379 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-bb56be2a-2979-4c93-9bf0-1f40d84f951b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 7938058f-350c-458b-9d4e-8f1cc5397000] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:54.530698 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bb56be2a-2979-4c93-9bf0-1f40d84f951b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:54.531197 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bb56be2a-2979-4c93-9bf0-1f40d84f951b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:54.532368 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bb56be2a-2979-4c93-9bf0-1f40d84f951b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:54.533056 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bb56be2a-2979-4c93-9bf0-1f40d84f951b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:54.533679 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bb56be2a-2979-4c93-9bf0-1f40d84f951b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:54.534955 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bb56be2a-2979-4c93-9bf0-1f40d84f951b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:54.867788 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-84bc0175-4cab-43c5-8f08-7a23f00d37de req-d02aee5d-f158-4450-95ac-53c07e61df30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d0c26bc-24c7-43d1-a552-2d2aeb3590f0", "name": "network-vif-deleted", "tag": "15941bb8-9645-43d7-8f65-311354b6ab89"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:17:54.880145 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-84bc0175-4cab-43c5-8f08-7a23f00d37de req-d02aee5d-f158-4450-95ac-53c07e61df30 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:54.880626 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-84bc0175-4cab-43c5-8f08-7a23f00d37de req-d02aee5d-f158-4450-95ac-53c07e61df30 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:54.881125 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-84bc0175-4cab-43c5-8f08-7a23f00d37de req-d02aee5d-f158-4450-95ac-53c07e61df30 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:54.893810 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-84bc0175-4cab-43c5-8f08-7a23f00d37de req-d02aee5d-f158-4450-95ac-53c07e61df30 service nova] Creating event network-vif-deleted:15941bb8-9645-43d7-8f65-311354b6ab89 for instance 3d0c26bc-24c7-43d1-a552-2d2aeb3590f0 on n-h1-854247-14 Oct 17 14:17:54.899827 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-84bc0175-4cab-43c5-8f08-7a23f00d37de req-d02aee5d-f158-4450-95ac-53c07e61df30 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035913 Oct 17 14:17:54.900684 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2902/5939] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:17:55.194677 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-bb56be2a-2979-4c93-9bf0-1f40d84f951b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:55.204555 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-bb56be2a-2979-4c93-9bf0-1f40d84f951b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/7938058f-350c-458b-9d4e-8f1cc5397000" status: 200 len: 1203 microversion: 2.1 time: 0.686892 Oct 17 14:17:55.206529 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3038/5940] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:54 2022] GET /compute/v2.1/servers/7938058f-350c-458b-9d4e-8f1cc5397000 => generated 1203 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:55.356295 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e33a0aed-a7ce-4f2e-a9f9-acb40b03767b tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:55.357006 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e33a0aed-a7ce-4f2e-a9f9-acb40b03767b tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] [instance: 3d0c26bc-24c7-43d1-a552-2d2aeb3590f0] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:55.363426 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e33a0aed-a7ce-4f2e-a9f9-acb40b03767b tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:55.363916 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e33a0aed-a7ce-4f2e-a9f9-acb40b03767b tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:55.364356 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e33a0aed-a7ce-4f2e-a9f9-acb40b03767b tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:55.365058 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e33a0aed-a7ce-4f2e-a9f9-acb40b03767b tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:55.365508 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e33a0aed-a7ce-4f2e-a9f9-acb40b03767b tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:55.366183 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e33a0aed-a7ce-4f2e-a9f9-acb40b03767b tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:55.398941 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e33a0aed-a7ce-4f2e-a9f9-acb40b03767b tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:55.399379 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e33a0aed-a7ce-4f2e-a9f9-acb40b03767b tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:55.399853 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e33a0aed-a7ce-4f2e-a9f9-acb40b03767b tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:55.400296 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-e33a0aed-a7ce-4f2e-a9f9-acb40b03767b tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lazy-loading 'fault' on Instance uuid 3d0c26bc-24c7-43d1-a552-2d2aeb3590f0 {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:17:55.454519 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e33a0aed-a7ce-4f2e-a9f9-acb40b03767b tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7557bdf83dd344f5b8f20ce3af781a71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0587423d7f44899bac419cd4e883ec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:55.466123 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e33a0aed-a7ce-4f2e-a9f9-acb40b03767b tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] 10.222.0.79 "GET /compute/v2.1/servers/3d0c26bc-24c7-43d1-a552-2d2aeb3590f0" status: 200 len: 1535 microversion: 2.1 time: 0.115580 Oct 17 14:17:55.467105 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2903/5941] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:55 2022] GET /compute/v2.1/servers/3d0c26bc-24c7-43d1-a552-2d2aeb3590f0 => generated 1535 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:56.149391 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-37c39794-418c-4e1d-b3e8-17f990949e23 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:56.150034 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-37c39794-418c-4e1d-b3e8-17f990949e23 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e7405fc0-937a-4256-8d0c-95acd35ebc97] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:56.158694 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-9db99f5f-4653-4078-ac97-cdb7e8f4ce92 req-c5c21264-cc41-43d0-b009-3b7edcabfaec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7405fc0-937a-4256-8d0c-95acd35ebc97", "tag": "416db0e1-9273-4dba-a586-13951c2b8257"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:17:56.168513 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-37c39794-418c-4e1d-b3e8-17f990949e23 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:56.169131 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-9db99f5f-4653-4078-ac97-cdb7e8f4ce92 req-c5c21264-cc41-43d0-b009-3b7edcabfaec service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:56.169260 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-37c39794-418c-4e1d-b3e8-17f990949e23 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:56.169622 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-9db99f5f-4653-4078-ac97-cdb7e8f4ce92 req-c5c21264-cc41-43d0-b009-3b7edcabfaec service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:56.169763 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-37c39794-418c-4e1d-b3e8-17f990949e23 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:56.170338 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-37c39794-418c-4e1d-b3e8-17f990949e23 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:56.170572 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-9db99f5f-4653-4078-ac97-cdb7e8f4ce92 req-c5c21264-cc41-43d0-b009-3b7edcabfaec service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:56.170789 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-37c39794-418c-4e1d-b3e8-17f990949e23 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:56.171228 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-37c39794-418c-4e1d-b3e8-17f990949e23 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:56.182872 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-9db99f5f-4653-4078-ac97-cdb7e8f4ce92 req-c5c21264-cc41-43d0-b009-3b7edcabfaec service nova] Creating event network-changed:416db0e1-9273-4dba-a586-13951c2b8257 for instance e7405fc0-937a-4256-8d0c-95acd35ebc97 on n-h2-854247-14 Oct 17 14:17:56.188030 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-9db99f5f-4653-4078-ac97-cdb7e8f4ce92 req-c5c21264-cc41-43d0-b009-3b7edcabfaec service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032911 Oct 17 14:17:56.188938 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2904/5942] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:17:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:17:56.230669 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-251ba1be-f66d-49d8-b34a-fdbe6f424c7d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:56.230669 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-251ba1be-f66d-49d8-b34a-fdbe6f424c7d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 7938058f-350c-458b-9d4e-8f1cc5397000] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:56.235837 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-251ba1be-f66d-49d8-b34a-fdbe6f424c7d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:56.236329 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-251ba1be-f66d-49d8-b34a-fdbe6f424c7d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:56.236765 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-251ba1be-f66d-49d8-b34a-fdbe6f424c7d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:56.237467 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-251ba1be-f66d-49d8-b34a-fdbe6f424c7d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:56.238115 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-251ba1be-f66d-49d8-b34a-fdbe6f424c7d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:56.238540 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-251ba1be-f66d-49d8-b34a-fdbe6f424c7d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:56.474718 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-37c39794-418c-4e1d-b3e8-17f990949e23 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:56.485010 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-37c39794-418c-4e1d-b3e8-17f990949e23 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97" status: 200 len: 1562 microversion: 2.1 time: 0.338062 Oct 17 14:17:56.485587 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3039/5943] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:56 2022] GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97 => generated 1562 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:56.490750 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e21af0c7-131b-4d3d-b778-a83f8c16b76e tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:56.491551 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e21af0c7-131b-4d3d-b778-a83f8c16b76e tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] [instance: 3d0c26bc-24c7-43d1-a552-2d2aeb3590f0] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:56.497721 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e21af0c7-131b-4d3d-b778-a83f8c16b76e tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:56.498608 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e21af0c7-131b-4d3d-b778-a83f8c16b76e tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:56.499191 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e21af0c7-131b-4d3d-b778-a83f8c16b76e tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:56.500022 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e21af0c7-131b-4d3d-b778-a83f8c16b76e tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:56.500831 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e21af0c7-131b-4d3d-b778-a83f8c16b76e tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:56.501386 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e21af0c7-131b-4d3d-b778-a83f8c16b76e tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:56.513085 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-251ba1be-f66d-49d8-b34a-fdbe6f424c7d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:56.530062 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-251ba1be-f66d-49d8-b34a-fdbe6f424c7d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/7938058f-350c-458b-9d4e-8f1cc5397000" status: 200 len: 1391 microversion: 2.1 time: 0.305752 Oct 17 14:17:56.530903 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2905/5944] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:56 2022] GET /compute/v2.1/servers/7938058f-350c-458b-9d4e-8f1cc5397000 => generated 1391 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:17:56.536726 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-e21af0c7-131b-4d3d-b778-a83f8c16b76e tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] HTTP exception thrown: Instance 3d0c26bc-24c7-43d1-a552-2d2aeb3590f0 could not be found. Oct 17 14:17:56.538964 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e21af0c7-131b-4d3d-b778-a83f8c16b76e tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Request method failure captured: Oct 17 14:17:56.538964 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/3d0c26bc-24c7-43d1-a552-2d2aeb3590f0 HTTP/1.1 Oct 17 14:17:56.538964 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 14:17:56.538964 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 14:17:56.538964 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 14:17:56.538964 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 14:17:56.538964 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 14:17:56.538964 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 14:17:56.538964 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 14:17:56.538964 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 14:17:56.538964 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTWO2JLD7z4cKw0IJXlhWWcVu1mKR4dLuF-qc_rCokC37wd-lYMD-6cQm-nvj9tQ_CpDv_-VaU_TjOB4e8Bxc-0uiZj3y2GRTtERnTP_1sFMoeUek06g3vKprjYvCbV0t2jXjHtxf7J3hvPujNEbNiJ1Wu18jeoGTvVpXpn_F6Od6_NY Oct 17 14:17:56.538964 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 14:17:56.538964 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 14:17:56.538964 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 14:17:56.538964 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 14:17:56.538964 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 14:17:56.538964 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 14:17:56.538964 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: b0587423d7f44899bac419cd4e883ec9 Oct 17 14:17:56.538964 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1243284561 Oct 17 14:17:56.538964 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 14:17:56.538964 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 14:17:56.538964 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b0587423d7f44899bac419cd4e883ec9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b0587423d7f44899bac419cd4e883ec9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b0587423d7f44899bac419cd4e883ec9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b0587423d7f44899bac419cd4e883ec9", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:17:56.538964 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1243284561 Oct 17 14:17:56.538964 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: b0587423d7f44899bac419cd4e883ec9 Oct 17 14:17:56.538964 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1243284561 Oct 17 14:17:56.538964 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-TestSecurityGroupsBasicOps-1243284561-project Oct 17 14:17:56.538964 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 14:17:56.538964 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 14:17:56.538964 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 7557bdf83dd344f5b8f20ce3af781a71 Oct 17 14:17:56.538964 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1243284561-project Oct 17 14:17:56.538964 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 14:17:56.538964 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 3d0c26bc-24c7-43d1-a552-2d2aeb3590f0 could not be found. Oct 17 14:17:56.538964 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '3d0c26bc-24c7-43d1-a552-2d2aeb3590f0'} Oct 17 14:17:56.538964 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:17:56.538964 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:17:56.538964 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:17:56.538964 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:17:56.538964 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:17:56.538964 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:17:56.538964 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:17:56.538964 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:17:56.538964 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:17:56.538964 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:17:56.538964 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d0c26bc-24c7-43d1-a552-2d2aeb3590f0 could not be found. Oct 17 14:17:56.538964 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:17:56.538964 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:17:56.538964 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:17:56.538964 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:17:56.538964 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:17:56.538964 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:17:56.538964 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:17:56.538964 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:17:56.538964 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:17:56.538964 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:17:56.538964 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:17:56.538964 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:17:56.538964 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:17:56.538964 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:17:56.538964 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:17:56.538964 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:17:56.538964 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d0c26bc-24c7-43d1-a552-2d2aeb3590f0 could not be found. Oct 17 14:17:56.538964 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:17:56.538964 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:17:56.542597 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:17:56.542597 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:17:56.542597 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:17:56.542597 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:17:56.542597 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:17:56.542597 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:17:56.542597 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d0c26bc-24c7-43d1-a552-2d2aeb3590f0 could not be found. Oct 17 14:17:56.542597 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:17:56.543715 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e21af0c7-131b-4d3d-b778-a83f8c16b76e tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Returning 404 to user: Instance 3d0c26bc-24c7-43d1-a552-2d2aeb3590f0 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:17:56.550950 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e21af0c7-131b-4d3d-b778-a83f8c16b76e tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] 10.222.0.79 "GET /compute/v2.1/servers/3d0c26bc-24c7-43d1-a552-2d2aeb3590f0" status: 404 len: 111 microversion: 2.1 time: 0.064158 Oct 17 14:17:56.554412 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3040/5945] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:56 2022] GET /compute/v2.1/servers/3d0c26bc-24c7-43d1-a552-2d2aeb3590f0 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:17:56.559476 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-849a5337-34b6-46b6-9239-a2485fefc2e0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:56.560126 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-849a5337-34b6-46b6-9239-a2485fefc2e0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 7938058f-350c-458b-9d4e-8f1cc5397000] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:56.566452 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-849a5337-34b6-46b6-9239-a2485fefc2e0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:56.566952 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-849a5337-34b6-46b6-9239-a2485fefc2e0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:56.567418 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-849a5337-34b6-46b6-9239-a2485fefc2e0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:56.568452 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-849a5337-34b6-46b6-9239-a2485fefc2e0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:56.569210 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-849a5337-34b6-46b6-9239-a2485fefc2e0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:56.569990 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-849a5337-34b6-46b6-9239-a2485fefc2e0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:56.838821 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-849a5337-34b6-46b6-9239-a2485fefc2e0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:56.847471 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-849a5337-34b6-46b6-9239-a2485fefc2e0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/7938058f-350c-458b-9d4e-8f1cc5397000" status: 200 len: 1391 microversion: 2.1 time: 0.296474 Oct 17 14:17:56.848333 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2906/5946] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:56 2022] GET /compute/v2.1/servers/7938058f-350c-458b-9d4e-8f1cc5397000 => generated 1391 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:17:56.870128 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6975c408-237f-4780-8888-af9d73b426f6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:56.871014 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6975c408-237f-4780-8888-af9d73b426f6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 7938058f-350c-458b-9d4e-8f1cc5397000] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:56.878811 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6975c408-237f-4780-8888-af9d73b426f6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:56.878811 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6975c408-237f-4780-8888-af9d73b426f6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:56.879149 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6975c408-237f-4780-8888-af9d73b426f6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:56.879904 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6975c408-237f-4780-8888-af9d73b426f6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:56.880729 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6975c408-237f-4780-8888-af9d73b426f6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:56.880839 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6975c408-237f-4780-8888-af9d73b426f6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:57.157056 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6975c408-237f-4780-8888-af9d73b426f6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:57.169515 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:17:57.173526 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6975c408-237f-4780-8888-af9d73b426f6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/7938058f-350c-458b-9d4e-8f1cc5397000" status: 200 len: 1391 microversion: 2.1 time: 0.307425 Oct 17 14:17:57.174945 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3041/5947] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:56 2022] GET /compute/v2.1/servers/7938058f-350c-458b-9d4e-8f1cc5397000 => generated 1391 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:57.198534 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2393d40f-725a-472b-91ea-d8fa1820e6e6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:57.199353 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2393d40f-725a-472b-91ea-d8fa1820e6e6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 7938058f-350c-458b-9d4e-8f1cc5397000] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:57.205887 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2393d40f-725a-472b-91ea-d8fa1820e6e6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:57.206571 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2393d40f-725a-472b-91ea-d8fa1820e6e6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:57.207003 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2393d40f-725a-472b-91ea-d8fa1820e6e6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:57.207731 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2393d40f-725a-472b-91ea-d8fa1820e6e6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:57.208332 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2393d40f-725a-472b-91ea-d8fa1820e6e6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:57.208751 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2393d40f-725a-472b-91ea-d8fa1820e6e6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:57.241023 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2393d40f-725a-472b-91ea-d8fa1820e6e6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 7938058f-350c-458b-9d4e-8f1cc5397000] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:17:57.334727 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2393d40f-725a-472b-91ea-d8fa1820e6e6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "DELETE /compute/v2.1/servers/7938058f-350c-458b-9d4e-8f1cc5397000" status: 204 len: 0 microversion: 2.1 time: 0.139820 Oct 17 14:17:57.335807 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2907/5948] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:17:57 2022] DELETE /compute/v2.1/servers/7938058f-350c-458b-9d4e-8f1cc5397000 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:17:57.344642 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7b463da3-5cc0-4daa-ace5-e35c52ac5437 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:57.345253 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7b463da3-5cc0-4daa-ace5-e35c52ac5437 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 7938058f-350c-458b-9d4e-8f1cc5397000] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:57.352916 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7b463da3-5cc0-4daa-ace5-e35c52ac5437 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:57.353456 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7b463da3-5cc0-4daa-ace5-e35c52ac5437 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:57.353903 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7b463da3-5cc0-4daa-ace5-e35c52ac5437 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:57.355206 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7b463da3-5cc0-4daa-ace5-e35c52ac5437 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:57.355680 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7b463da3-5cc0-4daa-ace5-e35c52ac5437 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:57.356102 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7b463da3-5cc0-4daa-ace5-e35c52ac5437 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:57.493097 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7b463da3-5cc0-4daa-ace5-e35c52ac5437 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:57.501231 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7b463da3-5cc0-4daa-ace5-e35c52ac5437 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/7938058f-350c-458b-9d4e-8f1cc5397000" status: 200 len: 1397 microversion: 2.1 time: 0.160913 Oct 17 14:17:57.501836 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3042/5949] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:57 2022] GET /compute/v2.1/servers/7938058f-350c-458b-9d4e-8f1cc5397000 => generated 1397 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:58.525810 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ade447e7-0e60-44e5-9a8b-3662f72fe1e1 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:58.526509 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ade447e7-0e60-44e5-9a8b-3662f72fe1e1 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 7938058f-350c-458b-9d4e-8f1cc5397000] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:58.533554 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ade447e7-0e60-44e5-9a8b-3662f72fe1e1 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:58.534038 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ade447e7-0e60-44e5-9a8b-3662f72fe1e1 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:58.534712 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ade447e7-0e60-44e5-9a8b-3662f72fe1e1 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:58.535185 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ade447e7-0e60-44e5-9a8b-3662f72fe1e1 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:58.535632 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ade447e7-0e60-44e5-9a8b-3662f72fe1e1 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:58.536043 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ade447e7-0e60-44e5-9a8b-3662f72fe1e1 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:58.682899 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ade447e7-0e60-44e5-9a8b-3662f72fe1e1 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:58.694638 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ade447e7-0e60-44e5-9a8b-3662f72fe1e1 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/7938058f-350c-458b-9d4e-8f1cc5397000" status: 200 len: 1397 microversion: 2.1 time: 0.173162 Oct 17 14:17:58.695488 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2908/5950] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:58 2022] GET /compute/v2.1/servers/7938058f-350c-458b-9d4e-8f1cc5397000 => generated 1397 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:17:59.317865 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-2fc8403e-c59b-4e14-ac1e-5107134564d8 req-7c32f831-27dd-4851-9bf3-f0f1942cd347 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7938058f-350c-458b-9d4e-8f1cc5397000", "name": "network-vif-deleted", "tag": "66bfea9f-9d6b-47e1-926b-bdbf6f85834a"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:17:59.331436 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-2fc8403e-c59b-4e14-ac1e-5107134564d8 req-7c32f831-27dd-4851-9bf3-f0f1942cd347 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:59.332101 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-2fc8403e-c59b-4e14-ac1e-5107134564d8 req-7c32f831-27dd-4851-9bf3-f0f1942cd347 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:59.332774 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-2fc8403e-c59b-4e14-ac1e-5107134564d8 req-7c32f831-27dd-4851-9bf3-f0f1942cd347 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:59.348478 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-2fc8403e-c59b-4e14-ac1e-5107134564d8 req-7c32f831-27dd-4851-9bf3-f0f1942cd347 service nova] Creating event network-vif-deleted:66bfea9f-9d6b-47e1-926b-bdbf6f85834a for instance 7938058f-350c-458b-9d4e-8f1cc5397000 on n-h1-854247-14 Oct 17 14:17:59.360921 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-2fc8403e-c59b-4e14-ac1e-5107134564d8 req-7c32f831-27dd-4851-9bf3-f0f1942cd347 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047316 Oct 17 14:17:59.366103 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3043/5951] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:17:59.718769 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ce35f3fd-d4a4-44ef-aeca-510f170b6633 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:59.719734 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ce35f3fd-d4a4-44ef-aeca-510f170b6633 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 7938058f-350c-458b-9d4e-8f1cc5397000] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:59.731117 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ce35f3fd-d4a4-44ef-aeca-510f170b6633 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:59.734227 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ce35f3fd-d4a4-44ef-aeca-510f170b6633 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:59.734890 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ce35f3fd-d4a4-44ef-aeca-510f170b6633 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:59.735883 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ce35f3fd-d4a4-44ef-aeca-510f170b6633 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:59.737576 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ce35f3fd-d4a4-44ef-aeca-510f170b6633 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:59.738208 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ce35f3fd-d4a4-44ef-aeca-510f170b6633 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:59.887378 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ce35f3fd-d4a4-44ef-aeca-510f170b6633 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:59.903544 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ce35f3fd-d4a4-44ef-aeca-510f170b6633 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/7938058f-350c-458b-9d4e-8f1cc5397000" status: 200 len: 1188 microversion: 2.1 time: 0.188576 Oct 17 14:17:59.904881 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2909/5952] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:59 2022] GET /compute/v2.1/servers/7938058f-350c-458b-9d4e-8f1cc5397000 => generated 1188 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:18:00.834499 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-241eaaac-5e03-424e-b5f1-7bc314b60d00 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] Calling method '.version_select at 0x7f7cd4fb7940>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:00.857777 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-241eaaac-5e03-424e-b5f1-7bc314b60d00 tempest-TestSecurityGroupsBasicOps-1243284561 tempest-TestSecurityGroupsBasicOps-1243284561-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-437691523" status: 202 len: 0 microversion: 2.1 time: 0.028468 Oct 17 14:18:00.858694 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3044/5953] 10.222.0.79 () {58 vars in 1275 bytes} [Mon Oct 17 14:18:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-437691523 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:18:00.931408 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a4eed0f9-b001-489e-82ab-ce1c84766f19 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:00.932614 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a4eed0f9-b001-489e-82ab-ce1c84766f19 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 7938058f-350c-458b-9d4e-8f1cc5397000] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:00.941620 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a4eed0f9-b001-489e-82ab-ce1c84766f19 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:00.943591 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a4eed0f9-b001-489e-82ab-ce1c84766f19 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:00.945004 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a4eed0f9-b001-489e-82ab-ce1c84766f19 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:00.946096 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a4eed0f9-b001-489e-82ab-ce1c84766f19 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:00.946552 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a4eed0f9-b001-489e-82ab-ce1c84766f19 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:00.946975 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a4eed0f9-b001-489e-82ab-ce1c84766f19 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:01.062841 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a4eed0f9-b001-489e-82ab-ce1c84766f19 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:18:01.080425 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a4eed0f9-b001-489e-82ab-ce1c84766f19 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/7938058f-350c-458b-9d4e-8f1cc5397000" status: 200 len: 1188 microversion: 2.1 time: 0.153210 Oct 17 14:18:01.082603 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2910/5954] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:00 2022] GET /compute/v2.1/servers/7938058f-350c-458b-9d4e-8f1cc5397000 => generated 1188 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:18:02.108600 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5eae8424-6988-4f89-8fbd-c750c2a02bc1 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:02.109469 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5eae8424-6988-4f89-8fbd-c750c2a02bc1 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 7938058f-350c-458b-9d4e-8f1cc5397000] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:02.118242 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5eae8424-6988-4f89-8fbd-c750c2a02bc1 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:02.119040 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5eae8424-6988-4f89-8fbd-c750c2a02bc1 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:02.119675 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5eae8424-6988-4f89-8fbd-c750c2a02bc1 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:02.120602 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5eae8424-6988-4f89-8fbd-c750c2a02bc1 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:02.121236 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5eae8424-6988-4f89-8fbd-c750c2a02bc1 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:02.121838 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5eae8424-6988-4f89-8fbd-c750c2a02bc1 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:02.201635 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5eae8424-6988-4f89-8fbd-c750c2a02bc1 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:18:02.210456 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5eae8424-6988-4f89-8fbd-c750c2a02bc1 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/7938058f-350c-458b-9d4e-8f1cc5397000" status: 200 len: 1188 microversion: 2.1 time: 0.107874 Oct 17 14:18:02.211342 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3045/5955] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:02 2022] GET /compute/v2.1/servers/7938058f-350c-458b-9d4e-8f1cc5397000 => generated 1188 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:18:03.234052 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e1c2e737-2283-4406-bdbd-d62e06418e16 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:03.234575 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e1c2e737-2283-4406-bdbd-d62e06418e16 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 7938058f-350c-458b-9d4e-8f1cc5397000] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:03.242835 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e1c2e737-2283-4406-bdbd-d62e06418e16 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:03.243431 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e1c2e737-2283-4406-bdbd-d62e06418e16 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:03.244264 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e1c2e737-2283-4406-bdbd-d62e06418e16 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:03.245073 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e1c2e737-2283-4406-bdbd-d62e06418e16 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:03.245721 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e1c2e737-2283-4406-bdbd-d62e06418e16 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:03.246154 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e1c2e737-2283-4406-bdbd-d62e06418e16 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:03.316701 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e1c2e737-2283-4406-bdbd-d62e06418e16 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:18:03.327713 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e1c2e737-2283-4406-bdbd-d62e06418e16 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/7938058f-350c-458b-9d4e-8f1cc5397000" status: 200 len: 1188 microversion: 2.1 time: 0.096915 Oct 17 14:18:03.328339 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2911/5956] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:03 2022] GET /compute/v2.1/servers/7938058f-350c-458b-9d4e-8f1cc5397000 => generated 1188 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:18:04.353226 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-63ad0831-08de-412c-b409-9ee841b3e0ef tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:04.353875 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-63ad0831-08de-412c-b409-9ee841b3e0ef tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 7938058f-350c-458b-9d4e-8f1cc5397000] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:04.362827 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-63ad0831-08de-412c-b409-9ee841b3e0ef tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:04.363349 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-63ad0831-08de-412c-b409-9ee841b3e0ef tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:04.363783 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-63ad0831-08de-412c-b409-9ee841b3e0ef tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:04.364481 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-63ad0831-08de-412c-b409-9ee841b3e0ef tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:04.364929 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-63ad0831-08de-412c-b409-9ee841b3e0ef tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:04.365347 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-63ad0831-08de-412c-b409-9ee841b3e0ef tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:04.381370 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-63ad0831-08de-412c-b409-9ee841b3e0ef tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] HTTP exception thrown: Instance 7938058f-350c-458b-9d4e-8f1cc5397000 could not be found. Oct 17 14:18:04.383143 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-63ad0831-08de-412c-b409-9ee841b3e0ef tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Request method failure captured: Oct 17 14:18:04.383143 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/7938058f-350c-458b-9d4e-8f1cc5397000 HTTP/1.1 Oct 17 14:18:04.383143 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 14:18:04.383143 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 14:18:04.383143 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 14:18:04.383143 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 14:18:04.383143 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 14:18:04.383143 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 14:18:04.383143 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 14:18:04.383143 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 14:18:04.383143 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTWPt4q6KhJtaXfApyhSZ1uS2Yi83dufn15X2GOm5u94F5E_Yj644GYsWZT8YBgl1aUBmYfKlHMjXq-eb8c2HF1REfW755J7WOOs8k3QRgUHhfiijXEH0YeKQjwZvCrEKlD9sd8dyp1v8diPQXXtSf-PHzqWEcTzJgPsJ95on9ZJE1Jo Oct 17 14:18:04.383143 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 14:18:04.383143 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 14:18:04.383143 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 14:18:04.383143 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 14:18:04.383143 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 14:18:04.383143 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 14:18:04.383143 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 4ee70940341741cb8e31928b856de051 Oct 17 14:18:04.383143 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-TestVolumeBootPattern-2135999385 Oct 17 14:18:04.383143 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 14:18:04.383143 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 14:18:04.383143 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4ee70940341741cb8e31928b856de051"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4ee70940341741cb8e31928b856de051"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4ee70940341741cb8e31928b856de051"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4ee70940341741cb8e31928b856de051", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:18:04.383143 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-TestVolumeBootPattern-2135999385 Oct 17 14:18:04.383143 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 4ee70940341741cb8e31928b856de051 Oct 17 14:18:04.383143 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-TestVolumeBootPattern-2135999385 Oct 17 14:18:04.383143 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-TestVolumeBootPattern-2135999385-project Oct 17 14:18:04.383143 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 14:18:04.383143 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 14:18:04.383143 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 06a0e2dab7494a4682615a6269ac24f9 Oct 17 14:18:04.383143 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-TestVolumeBootPattern-2135999385-project Oct 17 14:18:04.383143 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 14:18:04.383143 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 7938058f-350c-458b-9d4e-8f1cc5397000 could not be found. Oct 17 14:18:04.383143 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '7938058f-350c-458b-9d4e-8f1cc5397000'} Oct 17 14:18:04.383143 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:18:04.383143 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:18:04.383143 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:18:04.383143 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:18:04.383143 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:18:04.383143 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:18:04.383143 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:18:04.383143 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:18:04.383143 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:18:04.383143 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:18:04.383143 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7938058f-350c-458b-9d4e-8f1cc5397000 could not be found. Oct 17 14:18:04.383143 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:18:04.383143 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:18:04.383143 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:18:04.383143 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:18:04.383143 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:18:04.383143 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:18:04.383143 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:18:04.383143 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:18:04.383143 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:18:04.383143 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:18:04.383143 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:18:04.383143 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:18:04.383143 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:18:04.383143 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:18:04.383143 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:18:04.383143 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:18:04.383143 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7938058f-350c-458b-9d4e-8f1cc5397000 could not be found. Oct 17 14:18:04.383143 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:18:04.383143 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:18:04.383143 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:18:04.386560 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:18:04.386560 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:18:04.386560 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:18:04.386560 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:18:04.386560 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:18:04.386560 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7938058f-350c-458b-9d4e-8f1cc5397000 could not be found. Oct 17 14:18:04.386560 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:18:04.386560 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-63ad0831-08de-412c-b409-9ee841b3e0ef tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Returning 404 to user: Instance 7938058f-350c-458b-9d4e-8f1cc5397000 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:18:04.386560 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-63ad0831-08de-412c-b409-9ee841b3e0ef tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/7938058f-350c-458b-9d4e-8f1cc5397000" status: 404 len: 111 microversion: 2.1 time: 0.037028 Oct 17 14:18:04.386560 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3046/5957] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:04 2022] GET /compute/v2.1/servers/7938058f-350c-458b-9d4e-8f1cc5397000 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:18:09.438311 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d7a27ecc-a3d5-4785-8121-ad30c758366c tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-23904704", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "8fbe7158-e111-4585-9c02-52e4576de29c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "60d947eb-1d2b-4fd8-9101-f9fb7c7e0088"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:18:09.512469 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-d7a27ecc-a3d5-4785-8121-ad30c758366c tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] validate_networks() for [('60d947eb-1d2b-4fd8-9101-f9fb7c7e0088', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:18:09.896377 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-d7a27ecc-a3d5-4785-8121-ad30c758366c tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:18:09.896798 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-d7a27ecc-a3d5-4785-8121-ad30c758366c tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:18:09.897267 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-d7a27ecc-a3d5-4785-8121-ad30c758366c tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:18:09.897699 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-d7a27ecc-a3d5-4785-8121-ad30c758366c tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:18:09.898116 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-d7a27ecc-a3d5-4785-8121-ad30c758366c tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:18:09.907769 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d7a27ecc-a3d5-4785-8121-ad30c758366c tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:09.908256 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d7a27ecc-a3d5-4785-8121-ad30c758366c tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:09.908695 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d7a27ecc-a3d5-4785-8121-ad30c758366c tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:09.909417 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d7a27ecc-a3d5-4785-8121-ad30c758366c tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:09.909869 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d7a27ecc-a3d5-4785-8121-ad30c758366c tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:09.910290 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d7a27ecc-a3d5-4785-8121-ad30c758366c tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:09.927938 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-d7a27ecc-a3d5-4785-8121-ad30c758366c tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Getting quotas for project 4ee70940341741cb8e31928b856de051. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:18:09.934390 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-d7a27ecc-a3d5-4785-8121-ad30c758366c tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Getting quotas for user 06a0e2dab7494a4682615a6269ac24f9 and project 4ee70940341741cb8e31928b856de051. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:18:09.943342 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:18:09.995113 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d7a27ecc-a3d5-4785-8121-ad30c758366c tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:18:09.997182 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d7a27ecc-a3d5-4785-8121-ad30c758366c tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: c1bf5f3f-567c-476b-92b0-25280b3ab967] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8fbe7158-e111-4585-9c02-52e4576de29c',volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:18:10.140354 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d7a27ecc-a3d5-4785-8121-ad30c758366c tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.706056 Oct 17 14:18:10.141179 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2912/5958] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 14:18:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:18:10.152669 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-15e41a8d-aaec-4a73-a00f-ff49b7aa77a7 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:10.153207 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-15e41a8d-aaec-4a73-a00f-ff49b7aa77a7 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: c1bf5f3f-567c-476b-92b0-25280b3ab967] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:10.208630 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-15e41a8d-aaec-4a73-a00f-ff49b7aa77a7 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:18:10.217076 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-15e41a8d-aaec-4a73-a00f-ff49b7aa77a7 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/c1bf5f3f-567c-476b-92b0-25280b3ab967" status: 200 len: 1055 microversion: 2.1 time: 0.068454 Oct 17 14:18:10.217648 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3047/5959] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:10 2022] GET /compute/v2.1/servers/c1bf5f3f-567c-476b-92b0-25280b3ab967 => generated 1055 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:18:11.241239 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2678ba53-bed5-4572-980f-f24817316851 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:11.242422 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2678ba53-bed5-4572-980f-f24817316851 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: c1bf5f3f-567c-476b-92b0-25280b3ab967] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:11.249484 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2678ba53-bed5-4572-980f-f24817316851 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:11.250097 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2678ba53-bed5-4572-980f-f24817316851 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:11.250736 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2678ba53-bed5-4572-980f-f24817316851 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:11.251241 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2678ba53-bed5-4572-980f-f24817316851 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:11.251813 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2678ba53-bed5-4572-980f-f24817316851 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:11.252141 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2678ba53-bed5-4572-980f-f24817316851 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:11.354109 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2678ba53-bed5-4572-980f-f24817316851 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:18:11.363592 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2678ba53-bed5-4572-980f-f24817316851 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/c1bf5f3f-567c-476b-92b0-25280b3ab967" status: 200 len: 1171 microversion: 2.1 time: 0.127395 Oct 17 14:18:11.364408 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2913/5960] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:11 2022] GET /compute/v2.1/servers/c1bf5f3f-567c-476b-92b0-25280b3ab967 => generated 1171 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:18:12.388138 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1882b867-ffed-4fe3-858c-3e820111757c tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:12.389320 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-1882b867-ffed-4fe3-858c-3e820111757c tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: c1bf5f3f-567c-476b-92b0-25280b3ab967] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:12.396228 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1882b867-ffed-4fe3-858c-3e820111757c tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:12.396945 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1882b867-ffed-4fe3-858c-3e820111757c tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:12.397349 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1882b867-ffed-4fe3-858c-3e820111757c tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:12.398200 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1882b867-ffed-4fe3-858c-3e820111757c tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:12.398805 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1882b867-ffed-4fe3-858c-3e820111757c tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:12.399395 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1882b867-ffed-4fe3-858c-3e820111757c tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:12.607528 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-1882b867-ffed-4fe3-858c-3e820111757c tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:18:12.615932 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1882b867-ffed-4fe3-858c-3e820111757c tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/c1bf5f3f-567c-476b-92b0-25280b3ab967" status: 200 len: 1213 microversion: 2.1 time: 0.231680 Oct 17 14:18:12.616751 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3048/5961] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:12 2022] GET /compute/v2.1/servers/c1bf5f3f-567c-476b-92b0-25280b3ab967 => generated 1213 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:18:12.670972 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-9a3d2db4-b62d-40ea-9b2d-48a8575591f0 req-4af8fcb3-bfb5-424d-8f03-dc0b389585b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1bf5f3f-567c-476b-92b0-25280b3ab967", "tag": "f61939f2-d88f-4767-9dd6-6e0debbf428f"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:18:12.696431 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-9a3d2db4-b62d-40ea-9b2d-48a8575591f0 req-4af8fcb3-bfb5-424d-8f03-dc0b389585b9 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:12.696945 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-9a3d2db4-b62d-40ea-9b2d-48a8575591f0 req-4af8fcb3-bfb5-424d-8f03-dc0b389585b9 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:12.698792 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-9a3d2db4-b62d-40ea-9b2d-48a8575591f0 req-4af8fcb3-bfb5-424d-8f03-dc0b389585b9 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:12.712854 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-9a3d2db4-b62d-40ea-9b2d-48a8575591f0 req-4af8fcb3-bfb5-424d-8f03-dc0b389585b9 service nova] Creating event network-changed:f61939f2-d88f-4767-9dd6-6e0debbf428f for instance c1bf5f3f-567c-476b-92b0-25280b3ab967 on n-h1-854247-14 Oct 17 14:18:12.719872 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-9a3d2db4-b62d-40ea-9b2d-48a8575591f0 req-4af8fcb3-bfb5-424d-8f03-dc0b389585b9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057477 Oct 17 14:18:12.720661 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2914/5962] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:18:13.639887 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-58cd9821-c414-4001-bfc9-b8aa8e0dab2e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:13.640662 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-58cd9821-c414-4001-bfc9-b8aa8e0dab2e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: c1bf5f3f-567c-476b-92b0-25280b3ab967] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:13.647861 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-58cd9821-c414-4001-bfc9-b8aa8e0dab2e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:13.648495 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-58cd9821-c414-4001-bfc9-b8aa8e0dab2e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:13.649034 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-58cd9821-c414-4001-bfc9-b8aa8e0dab2e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:13.649844 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-58cd9821-c414-4001-bfc9-b8aa8e0dab2e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:13.650414 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-58cd9821-c414-4001-bfc9-b8aa8e0dab2e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:13.651052 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-58cd9821-c414-4001-bfc9-b8aa8e0dab2e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:13.870935 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-58cd9821-c414-4001-bfc9-b8aa8e0dab2e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:18:13.879455 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-58cd9821-c414-4001-bfc9-b8aa8e0dab2e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/c1bf5f3f-567c-476b-92b0-25280b3ab967" status: 200 len: 1213 microversion: 2.1 time: 0.243549 Oct 17 14:18:13.887573 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3049/5963] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:13 2022] GET /compute/v2.1/servers/c1bf5f3f-567c-476b-92b0-25280b3ab967 => generated 1213 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:18:14.903487 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-60a8b013-f1c9-4a78-b896-17d47d576940 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:14.904184 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-60a8b013-f1c9-4a78-b896-17d47d576940 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: c1bf5f3f-567c-476b-92b0-25280b3ab967] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:14.911698 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-60a8b013-f1c9-4a78-b896-17d47d576940 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:14.912185 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-60a8b013-f1c9-4a78-b896-17d47d576940 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:14.912622 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-60a8b013-f1c9-4a78-b896-17d47d576940 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:14.913318 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-60a8b013-f1c9-4a78-b896-17d47d576940 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:14.913770 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-60a8b013-f1c9-4a78-b896-17d47d576940 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:14.914193 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-60a8b013-f1c9-4a78-b896-17d47d576940 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:15.048687 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-60a8b013-f1c9-4a78-b896-17d47d576940 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:18:15.057776 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-60a8b013-f1c9-4a78-b896-17d47d576940 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/c1bf5f3f-567c-476b-92b0-25280b3ab967" status: 200 len: 1213 microversion: 2.1 time: 0.158803 Oct 17 14:18:15.058371 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2915/5964] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:14 2022] GET /compute/v2.1/servers/c1bf5f3f-567c-476b-92b0-25280b3ab967 => generated 1213 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:18:16.081563 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9176905f-b12a-434a-a5b4-ad4a90b243af tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:16.082379 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9176905f-b12a-434a-a5b4-ad4a90b243af tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: c1bf5f3f-567c-476b-92b0-25280b3ab967] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:16.089898 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9176905f-b12a-434a-a5b4-ad4a90b243af tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:16.090390 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9176905f-b12a-434a-a5b4-ad4a90b243af tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:16.090828 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9176905f-b12a-434a-a5b4-ad4a90b243af tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:16.091588 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9176905f-b12a-434a-a5b4-ad4a90b243af tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:16.092042 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9176905f-b12a-434a-a5b4-ad4a90b243af tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:16.102940 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9176905f-b12a-434a-a5b4-ad4a90b243af tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:16.262719 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9176905f-b12a-434a-a5b4-ad4a90b243af tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:18:16.270658 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9176905f-b12a-434a-a5b4-ad4a90b243af tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/c1bf5f3f-567c-476b-92b0-25280b3ab967" status: 200 len: 1213 microversion: 2.1 time: 0.193290 Oct 17 14:18:16.271267 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3050/5965] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:16 2022] GET /compute/v2.1/servers/c1bf5f3f-567c-476b-92b0-25280b3ab967 => generated 1213 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:18:17.294371 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f9e934b2-3619-457d-9b7a-ac3b159a1479 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:17.294995 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f9e934b2-3619-457d-9b7a-ac3b159a1479 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: c1bf5f3f-567c-476b-92b0-25280b3ab967] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:17.302301 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f9e934b2-3619-457d-9b7a-ac3b159a1479 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:17.302785 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f9e934b2-3619-457d-9b7a-ac3b159a1479 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:17.303213 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f9e934b2-3619-457d-9b7a-ac3b159a1479 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:17.303927 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f9e934b2-3619-457d-9b7a-ac3b159a1479 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:17.304370 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f9e934b2-3619-457d-9b7a-ac3b159a1479 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:17.304789 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f9e934b2-3619-457d-9b7a-ac3b159a1479 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:17.435354 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f9e934b2-3619-457d-9b7a-ac3b159a1479 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:18:17.443583 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f9e934b2-3619-457d-9b7a-ac3b159a1479 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/c1bf5f3f-567c-476b-92b0-25280b3ab967" status: 200 len: 1201 microversion: 2.1 time: 0.153416 Oct 17 14:18:17.444192 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2916/5966] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:17 2022] GET /compute/v2.1/servers/c1bf5f3f-567c-476b-92b0-25280b3ab967 => generated 1201 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:18:17.790830 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-eaccfc0e-b612-4875-8b7b-938434d222e1 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:18:17.793417 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-eaccfc0e-b612-4875-8b7b-938434d222e1 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e7405fc0-937a-4256-8d0c-95acd35ebc97] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:17.796294 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:18:17.802347 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eaccfc0e-b612-4875-8b7b-938434d222e1 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:17.802849 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eaccfc0e-b612-4875-8b7b-938434d222e1 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:17.803314 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eaccfc0e-b612-4875-8b7b-938434d222e1 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:17.804019 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eaccfc0e-b612-4875-8b7b-938434d222e1 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:17.804473 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eaccfc0e-b612-4875-8b7b-938434d222e1 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:17.804868 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eaccfc0e-b612-4875-8b7b-938434d222e1 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:17.858851 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-eaccfc0e-b612-4875-8b7b-938434d222e1 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "POST /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97/action" status: 200 len: 24571 microversion: 2.1 time: 0.071856 Oct 17 14:18:17.859539 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3051/5967] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:18:17 2022] POST /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97/action => generated 24571 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:18:18.473036 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2776f33f-2aa2-4678-b90b-d0b92eb12a27 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:18.473782 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2776f33f-2aa2-4678-b90b-d0b92eb12a27 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: c1bf5f3f-567c-476b-92b0-25280b3ab967] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:18.484410 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2776f33f-2aa2-4678-b90b-d0b92eb12a27 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:18.485163 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2776f33f-2aa2-4678-b90b-d0b92eb12a27 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:18.485775 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2776f33f-2aa2-4678-b90b-d0b92eb12a27 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:18.486848 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2776f33f-2aa2-4678-b90b-d0b92eb12a27 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:18.487613 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2776f33f-2aa2-4678-b90b-d0b92eb12a27 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:18.488236 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2776f33f-2aa2-4678-b90b-d0b92eb12a27 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:18.623753 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2776f33f-2aa2-4678-b90b-d0b92eb12a27 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:18:18.626135 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:18:18.634116 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2776f33f-2aa2-4678-b90b-d0b92eb12a27 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/c1bf5f3f-567c-476b-92b0-25280b3ab967" status: 200 len: 1201 microversion: 2.1 time: 0.167541 Oct 17 14:18:18.634743 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2917/5968] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:18 2022] GET /compute/v2.1/servers/c1bf5f3f-567c-476b-92b0-25280b3ab967 => generated 1201 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:18:19.662412 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-78188bf5-d421-4868-abd0-ae1c253bff95 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:19.663262 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-78188bf5-d421-4868-abd0-ae1c253bff95 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: c1bf5f3f-567c-476b-92b0-25280b3ab967] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:19.672738 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-78188bf5-d421-4868-abd0-ae1c253bff95 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:19.673178 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-78188bf5-d421-4868-abd0-ae1c253bff95 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:19.673619 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-78188bf5-d421-4868-abd0-ae1c253bff95 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:19.674324 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-78188bf5-d421-4868-abd0-ae1c253bff95 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:19.674784 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-78188bf5-d421-4868-abd0-ae1c253bff95 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:19.675213 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-78188bf5-d421-4868-abd0-ae1c253bff95 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:19.818879 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-78188bf5-d421-4868-abd0-ae1c253bff95 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:18:19.827718 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-78188bf5-d421-4868-abd0-ae1c253bff95 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/c1bf5f3f-567c-476b-92b0-25280b3ab967" status: 200 len: 1201 microversion: 2.1 time: 0.172833 Oct 17 14:18:19.828298 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3052/5969] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:19 2022] GET /compute/v2.1/servers/c1bf5f3f-567c-476b-92b0-25280b3ab967 => generated 1201 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:18:20.851134 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ea6a0952-3727-4d8c-9719-641e398b78d8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:20.851766 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ea6a0952-3727-4d8c-9719-641e398b78d8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: c1bf5f3f-567c-476b-92b0-25280b3ab967] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:20.854453 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:18:20.855115 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=6 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:18:20.862190 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ea6a0952-3727-4d8c-9719-641e398b78d8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:20.862676 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ea6a0952-3727-4d8c-9719-641e398b78d8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:20.863102 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ea6a0952-3727-4d8c-9719-641e398b78d8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:20.863817 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ea6a0952-3727-4d8c-9719-641e398b78d8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:20.864319 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ea6a0952-3727-4d8c-9719-641e398b78d8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:20.864759 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ea6a0952-3727-4d8c-9719-641e398b78d8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:21.008699 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ea6a0952-3727-4d8c-9719-641e398b78d8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:18:21.016996 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ea6a0952-3727-4d8c-9719-641e398b78d8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/c1bf5f3f-567c-476b-92b0-25280b3ab967" status: 200 len: 1201 microversion: 2.1 time: 0.170220 Oct 17 14:18:21.017573 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2918/5970] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:20 2022] GET /compute/v2.1/servers/c1bf5f3f-567c-476b-92b0-25280b3ab967 => generated 1201 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:18:22.043066 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9fba05dc-e060-43ee-924b-bc665a350203 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:22.043935 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9fba05dc-e060-43ee-924b-bc665a350203 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: c1bf5f3f-567c-476b-92b0-25280b3ab967] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:22.047405 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:18:22.058203 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9fba05dc-e060-43ee-924b-bc665a350203 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:22.058886 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9fba05dc-e060-43ee-924b-bc665a350203 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:22.059565 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9fba05dc-e060-43ee-924b-bc665a350203 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:22.060535 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9fba05dc-e060-43ee-924b-bc665a350203 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:22.061373 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9fba05dc-e060-43ee-924b-bc665a350203 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:22.061795 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9fba05dc-e060-43ee-924b-bc665a350203 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:22.208647 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9fba05dc-e060-43ee-924b-bc665a350203 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:18:22.217980 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9fba05dc-e060-43ee-924b-bc665a350203 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/c1bf5f3f-567c-476b-92b0-25280b3ab967" status: 200 len: 1201 microversion: 2.1 time: 0.180326 Oct 17 14:18:22.218571 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3053/5971] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:22 2022] GET /compute/v2.1/servers/c1bf5f3f-567c-476b-92b0-25280b3ab967 => generated 1201 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:18:23.240650 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-eab556be-708e-414a-8c98-8bffd9217206 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:23.241286 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-eab556be-708e-414a-8c98-8bffd9217206 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: c1bf5f3f-567c-476b-92b0-25280b3ab967] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:23.249287 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eab556be-708e-414a-8c98-8bffd9217206 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:23.249777 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eab556be-708e-414a-8c98-8bffd9217206 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:23.250194 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eab556be-708e-414a-8c98-8bffd9217206 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:23.250875 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eab556be-708e-414a-8c98-8bffd9217206 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:23.251348 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eab556be-708e-414a-8c98-8bffd9217206 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:23.251760 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eab556be-708e-414a-8c98-8bffd9217206 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:23.394855 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-eab556be-708e-414a-8c98-8bffd9217206 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:18:23.403329 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-eab556be-708e-414a-8c98-8bffd9217206 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/c1bf5f3f-567c-476b-92b0-25280b3ab967" status: 200 len: 1201 microversion: 2.1 time: 0.166547 Oct 17 14:18:23.403894 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2919/5972] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:23 2022] GET /compute/v2.1/servers/c1bf5f3f-567c-476b-92b0-25280b3ab967 => generated 1201 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:18:24.349427 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1df15d49-0f5a-4829-b2c4-748c90535c74 tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:24.350027 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-1df15d49-0f5a-4829-b2c4-748c90535c74 tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] [instance: e7405fc0-937a-4256-8d0c-95acd35ebc97] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:24.356470 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1df15d49-0f5a-4829-b2c4-748c90535c74 tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:24.356959 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1df15d49-0f5a-4829-b2c4-748c90535c74 tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:24.357365 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1df15d49-0f5a-4829-b2c4-748c90535c74 tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:24.358162 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1df15d49-0f5a-4829-b2c4-748c90535c74 tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:24.358618 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1df15d49-0f5a-4829-b2c4-748c90535c74 tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:24.359038 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1df15d49-0f5a-4829-b2c4-748c90535c74 tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:24.426835 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9098bd6e-2b2c-456e-b15c-0d9aa9fd9ff6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:24.427665 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9098bd6e-2b2c-456e-b15c-0d9aa9fd9ff6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: c1bf5f3f-567c-476b-92b0-25280b3ab967] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:24.435755 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9098bd6e-2b2c-456e-b15c-0d9aa9fd9ff6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:24.436289 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9098bd6e-2b2c-456e-b15c-0d9aa9fd9ff6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:24.437345 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9098bd6e-2b2c-456e-b15c-0d9aa9fd9ff6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:24.438425 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9098bd6e-2b2c-456e-b15c-0d9aa9fd9ff6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:24.438869 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9098bd6e-2b2c-456e-b15c-0d9aa9fd9ff6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:24.439308 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9098bd6e-2b2c-456e-b15c-0d9aa9fd9ff6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:24.505873 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1df15d49-0f5a-4829-b2c4-748c90535c74 tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97" status: 200 len: 1834 microversion: 2.1 time: 0.161238 Oct 17 14:18:24.506460 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3054/5973] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:24 2022] GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97 => generated 1834 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:18:24.528037 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-41853d16-89e4-4323-8ac9-909dbe02e94b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:24.528645 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-41853d16-89e4-4323-8ac9-909dbe02e94b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e7405fc0-937a-4256-8d0c-95acd35ebc97] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:24.534924 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-41853d16-89e4-4323-8ac9-909dbe02e94b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:24.535438 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-41853d16-89e4-4323-8ac9-909dbe02e94b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:24.535866 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-41853d16-89e4-4323-8ac9-909dbe02e94b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:24.536572 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-41853d16-89e4-4323-8ac9-909dbe02e94b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:24.537018 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-41853d16-89e4-4323-8ac9-909dbe02e94b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:24.537438 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-41853d16-89e4-4323-8ac9-909dbe02e94b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:24.595141 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9098bd6e-2b2c-456e-b15c-0d9aa9fd9ff6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:18:24.603442 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9098bd6e-2b2c-456e-b15c-0d9aa9fd9ff6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/c1bf5f3f-567c-476b-92b0-25280b3ab967" status: 200 len: 1201 microversion: 2.1 time: 0.181277 Oct 17 14:18:24.604079 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2920/5974] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:24 2022] GET /compute/v2.1/servers/c1bf5f3f-567c-476b-92b0-25280b3ab967 => generated 1201 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:18:24.682287 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-41853d16-89e4-4323-8ac9-909dbe02e94b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:18:24.690533 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-41853d16-89e4-4323-8ac9-909dbe02e94b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97" status: 200 len: 1681 microversion: 2.1 time: 0.166340 Oct 17 14:18:24.691083 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3055/5975] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:24 2022] GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97 => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:18:24.800384 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-19760de1-1c7c-4ac0-96ab-d7e44ed551eb tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:18:24.802628 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-19760de1-1c7c-4ac0-96ab-d7e44ed551eb tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e7405fc0-937a-4256-8d0c-95acd35ebc97] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:24.809207 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-19760de1-1c7c-4ac0-96ab-d7e44ed551eb tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:24.809697 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-19760de1-1c7c-4ac0-96ab-d7e44ed551eb tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:24.810139 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-19760de1-1c7c-4ac0-96ab-d7e44ed551eb tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:24.810807 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-19760de1-1c7c-4ac0-96ab-d7e44ed551eb tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:24.811301 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-19760de1-1c7c-4ac0-96ab-d7e44ed551eb tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:24.811728 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-19760de1-1c7c-4ac0-96ab-d7e44ed551eb tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:24.861897 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-19760de1-1c7c-4ac0-96ab-d7e44ed551eb tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "POST /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97/action" status: 200 len: 32646 microversion: 2.1 time: 0.065974 Oct 17 14:18:24.862459 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2921/5976] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:18:24 2022] POST /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97/action => generated 32646 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:18:25.042321 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5e505f6e-f3de-461d-8ee8-7bf21f0bd186 tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:18:25.043091 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5e505f6e-f3de-461d-8ee8-7bf21f0bd186 tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] [instance: e7405fc0-937a-4256-8d0c-95acd35ebc97] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:25.052683 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5e505f6e-f3de-461d-8ee8-7bf21f0bd186 tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:25.053335 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5e505f6e-f3de-461d-8ee8-7bf21f0bd186 tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:25.053921 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5e505f6e-f3de-461d-8ee8-7bf21f0bd186 tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:25.054848 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5e505f6e-f3de-461d-8ee8-7bf21f0bd186 tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:25.055600 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5e505f6e-f3de-461d-8ee8-7bf21f0bd186 tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:25.056175 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5e505f6e-f3de-461d-8ee8-7bf21f0bd186 tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:25.089072 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5e505f6e-f3de-461d-8ee8-7bf21f0bd186 tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '8c205e97c9c04ac0ab84ba84ce2cdb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21bab2ec439240b6a313ae315103b1b3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:18:25.089654 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5e505f6e-f3de-461d-8ee8-7bf21f0bd186 tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] [instance: e7405fc0-937a-4256-8d0c-95acd35ebc97] flavor_id is None. Assuming migration. {{(pid=127016) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 17 14:18:25.090089 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5e505f6e-f3de-461d-8ee8-7bf21f0bd186 tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] [instance: e7405fc0-937a-4256-8d0c-95acd35ebc97] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=127016) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 17 14:18:25.211734 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5e505f6e-f3de-461d-8ee8-7bf21f0bd186 tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97/action" status: 202 len: 0 microversion: 2.1 time: 0.174641 Oct 17 14:18:25.212345 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3056/5977] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:18:25 2022] POST /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:18:25.221549 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e28e4788-0963-473f-824d-009a6d2e9257 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:25.222278 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e28e4788-0963-473f-824d-009a6d2e9257 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e7405fc0-937a-4256-8d0c-95acd35ebc97] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:25.229630 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e28e4788-0963-473f-824d-009a6d2e9257 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:25.230105 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e28e4788-0963-473f-824d-009a6d2e9257 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:25.230534 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e28e4788-0963-473f-824d-009a6d2e9257 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:25.231245 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e28e4788-0963-473f-824d-009a6d2e9257 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:25.231692 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e28e4788-0963-473f-824d-009a6d2e9257 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:25.232106 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e28e4788-0963-473f-824d-009a6d2e9257 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:25.370845 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e28e4788-0963-473f-824d-009a6d2e9257 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:18:25.379054 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e28e4788-0963-473f-824d-009a6d2e9257 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97" status: 200 len: 1690 microversion: 2.1 time: 0.162115 Oct 17 14:18:25.379654 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2922/5978] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:25 2022] GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97 => generated 1690 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:18:25.626910 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5c447dc4-589c-4f1b-90ae-4e8ee157e78f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:25.627597 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5c447dc4-589c-4f1b-90ae-4e8ee157e78f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: c1bf5f3f-567c-476b-92b0-25280b3ab967] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:25.634798 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5c447dc4-589c-4f1b-90ae-4e8ee157e78f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:25.635308 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5c447dc4-589c-4f1b-90ae-4e8ee157e78f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:25.635771 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5c447dc4-589c-4f1b-90ae-4e8ee157e78f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:25.636547 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5c447dc4-589c-4f1b-90ae-4e8ee157e78f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:25.636886 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5c447dc4-589c-4f1b-90ae-4e8ee157e78f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:25.637302 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5c447dc4-589c-4f1b-90ae-4e8ee157e78f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:25.780048 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5c447dc4-589c-4f1b-90ae-4e8ee157e78f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:18:25.789665 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5c447dc4-589c-4f1b-90ae-4e8ee157e78f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/c1bf5f3f-567c-476b-92b0-25280b3ab967" status: 200 len: 1201 microversion: 2.1 time: 0.167455 Oct 17 14:18:25.790253 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3057/5979] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:25 2022] GET /compute/v2.1/servers/c1bf5f3f-567c-476b-92b0-25280b3ab967 => generated 1201 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:18:26.069912 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-28eee1e8-f353-485e-96dd-7281474d9d62 req-af03b6a2-16da-4291-b929-be0388067031 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1bf5f3f-567c-476b-92b0-25280b3ab967", "name": "network-vif-plugged", "status": "completed", "tag": "f61939f2-d88f-4767-9dd6-6e0debbf428f"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:18:26.082023 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-28eee1e8-f353-485e-96dd-7281474d9d62 req-af03b6a2-16da-4291-b929-be0388067031 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:26.082516 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-28eee1e8-f353-485e-96dd-7281474d9d62 req-af03b6a2-16da-4291-b929-be0388067031 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:26.082950 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-28eee1e8-f353-485e-96dd-7281474d9d62 req-af03b6a2-16da-4291-b929-be0388067031 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:26.098081 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-28eee1e8-f353-485e-96dd-7281474d9d62 req-af03b6a2-16da-4291-b929-be0388067031 service nova] Creating event network-vif-plugged:f61939f2-d88f-4767-9dd6-6e0debbf428f for instance c1bf5f3f-567c-476b-92b0-25280b3ab967 on n-h1-854247-14 Oct 17 14:18:26.107457 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-28eee1e8-f353-485e-96dd-7281474d9d62 req-af03b6a2-16da-4291-b929-be0388067031 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040177 Oct 17 14:18:26.108843 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2923/5980] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:18:26.403465 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4d1e25c3-2697-4b79-9fdd-6fc430051858 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:26.404487 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4d1e25c3-2697-4b79-9fdd-6fc430051858 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e7405fc0-937a-4256-8d0c-95acd35ebc97] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:26.413003 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d1e25c3-2697-4b79-9fdd-6fc430051858 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:26.413559 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d1e25c3-2697-4b79-9fdd-6fc430051858 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:26.414047 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d1e25c3-2697-4b79-9fdd-6fc430051858 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:26.415365 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d1e25c3-2697-4b79-9fdd-6fc430051858 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:26.415881 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d1e25c3-2697-4b79-9fdd-6fc430051858 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:26.416912 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d1e25c3-2697-4b79-9fdd-6fc430051858 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:26.557349 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4d1e25c3-2697-4b79-9fdd-6fc430051858 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:18:26.566052 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4d1e25c3-2697-4b79-9fdd-6fc430051858 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97" status: 200 len: 1690 microversion: 2.1 time: 0.167655 Oct 17 14:18:26.566636 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3058/5981] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:26 2022] GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97 => generated 1690 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:18:26.816975 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6fa70cb3-7969-4ce6-bac5-bbcfa8a610a5 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:26.817843 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6fa70cb3-7969-4ce6-bac5-bbcfa8a610a5 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: c1bf5f3f-567c-476b-92b0-25280b3ab967] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:26.824441 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6fa70cb3-7969-4ce6-bac5-bbcfa8a610a5 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:26.824928 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6fa70cb3-7969-4ce6-bac5-bbcfa8a610a5 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:26.825393 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6fa70cb3-7969-4ce6-bac5-bbcfa8a610a5 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:26.826092 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6fa70cb3-7969-4ce6-bac5-bbcfa8a610a5 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:26.826545 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6fa70cb3-7969-4ce6-bac5-bbcfa8a610a5 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:26.826966 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6fa70cb3-7969-4ce6-bac5-bbcfa8a610a5 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:27.044125 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6fa70cb3-7969-4ce6-bac5-bbcfa8a610a5 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:18:27.053580 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6fa70cb3-7969-4ce6-bac5-bbcfa8a610a5 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/c1bf5f3f-567c-476b-92b0-25280b3ab967" status: 200 len: 1201 microversion: 2.1 time: 0.242997 Oct 17 14:18:27.054162 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2924/5982] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:26 2022] GET /compute/v2.1/servers/c1bf5f3f-567c-476b-92b0-25280b3ab967 => generated 1201 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:18:27.594213 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5d85a74e-77b7-4abd-bdfa-e13d75017249 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:27.595030 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5d85a74e-77b7-4abd-bdfa-e13d75017249 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e7405fc0-937a-4256-8d0c-95acd35ebc97] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:27.606826 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5d85a74e-77b7-4abd-bdfa-e13d75017249 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:27.607676 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5d85a74e-77b7-4abd-bdfa-e13d75017249 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:27.608401 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5d85a74e-77b7-4abd-bdfa-e13d75017249 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:27.609604 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5d85a74e-77b7-4abd-bdfa-e13d75017249 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:27.610465 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5d85a74e-77b7-4abd-bdfa-e13d75017249 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:27.611236 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5d85a74e-77b7-4abd-bdfa-e13d75017249 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:27.614097 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:18:27.766708 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5d85a74e-77b7-4abd-bdfa-e13d75017249 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:18:27.775213 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5d85a74e-77b7-4abd-bdfa-e13d75017249 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97" status: 200 len: 1695 microversion: 2.1 time: 0.187980 Oct 17 14:18:27.775797 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3059/5983] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:27 2022] GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97 => generated 1695 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:18:28.081900 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-05a8f49f-e293-496a-b853-562c727816b4 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:28.083123 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-05a8f49f-e293-496a-b853-562c727816b4 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: c1bf5f3f-567c-476b-92b0-25280b3ab967] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:28.093557 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-05a8f49f-e293-496a-b853-562c727816b4 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:28.094572 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-05a8f49f-e293-496a-b853-562c727816b4 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:28.095478 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-05a8f49f-e293-496a-b853-562c727816b4 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:28.096823 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-05a8f49f-e293-496a-b853-562c727816b4 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:28.097279 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-05a8f49f-e293-496a-b853-562c727816b4 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:28.097706 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-05a8f49f-e293-496a-b853-562c727816b4 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:28.244861 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-05a8f49f-e293-496a-b853-562c727816b4 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:18:28.255197 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-05a8f49f-e293-496a-b853-562c727816b4 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/c1bf5f3f-567c-476b-92b0-25280b3ab967" status: 200 len: 1388 microversion: 2.1 time: 0.179906 Oct 17 14:18:28.255789 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2925/5984] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:28 2022] GET /compute/v2.1/servers/c1bf5f3f-567c-476b-92b0-25280b3ab967 => generated 1388 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:18:28.287558 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-13aa9a43-2471-4606-a098-d09d07560150 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:28.288296 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-13aa9a43-2471-4606-a098-d09d07560150 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: c1bf5f3f-567c-476b-92b0-25280b3ab967] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:28.295023 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-13aa9a43-2471-4606-a098-d09d07560150 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:28.295532 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-13aa9a43-2471-4606-a098-d09d07560150 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:28.295968 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-13aa9a43-2471-4606-a098-d09d07560150 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:28.296666 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-13aa9a43-2471-4606-a098-d09d07560150 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:28.297115 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-13aa9a43-2471-4606-a098-d09d07560150 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:28.297539 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-13aa9a43-2471-4606-a098-d09d07560150 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:28.430681 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-13aa9a43-2471-4606-a098-d09d07560150 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:18:28.439921 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-13aa9a43-2471-4606-a098-d09d07560150 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/c1bf5f3f-567c-476b-92b0-25280b3ab967" status: 200 len: 1388 microversion: 2.1 time: 0.156847 Oct 17 14:18:28.440494 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3060/5985] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:28 2022] GET /compute/v2.1/servers/c1bf5f3f-567c-476b-92b0-25280b3ab967 => generated 1388 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:18:28.462186 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8ee6c913-ebb3-4691-824f-260f8bc060a0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:28.462822 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8ee6c913-ebb3-4691-824f-260f8bc060a0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: c1bf5f3f-567c-476b-92b0-25280b3ab967] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:28.469020 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8ee6c913-ebb3-4691-824f-260f8bc060a0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:28.469517 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8ee6c913-ebb3-4691-824f-260f8bc060a0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:28.469919 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8ee6c913-ebb3-4691-824f-260f8bc060a0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:28.470605 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8ee6c913-ebb3-4691-824f-260f8bc060a0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:28.471058 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8ee6c913-ebb3-4691-824f-260f8bc060a0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:28.471501 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8ee6c913-ebb3-4691-824f-260f8bc060a0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:28.618439 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8ee6c913-ebb3-4691-824f-260f8bc060a0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:18:28.626340 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8ee6c913-ebb3-4691-824f-260f8bc060a0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/c1bf5f3f-567c-476b-92b0-25280b3ab967" status: 200 len: 1388 microversion: 2.1 time: 0.168026 Oct 17 14:18:28.627037 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2926/5986] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:28 2022] GET /compute/v2.1/servers/c1bf5f3f-567c-476b-92b0-25280b3ab967 => generated 1388 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:18:28.648384 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c1957bc5-8acf-4660-8e3c-f9c57969562f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:28.648882 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c1957bc5-8acf-4660-8e3c-f9c57969562f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: c1bf5f3f-567c-476b-92b0-25280b3ab967] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:28.655654 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1957bc5-8acf-4660-8e3c-f9c57969562f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:28.656134 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1957bc5-8acf-4660-8e3c-f9c57969562f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:28.656562 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1957bc5-8acf-4660-8e3c-f9c57969562f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:28.657274 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1957bc5-8acf-4660-8e3c-f9c57969562f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:28.657718 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1957bc5-8acf-4660-8e3c-f9c57969562f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:28.658137 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1957bc5-8acf-4660-8e3c-f9c57969562f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:28.684335 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c1957bc5-8acf-4660-8e3c-f9c57969562f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: c1bf5f3f-567c-476b-92b0-25280b3ab967] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:18:28.767279 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c1957bc5-8acf-4660-8e3c-f9c57969562f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c1bf5f3f-567c-476b-92b0-25280b3ab967" status: 204 len: 0 microversion: 2.1 time: 0.122524 Oct 17 14:18:28.771009 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3061/5987] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:18:28 2022] DELETE /compute/v2.1/servers/c1bf5f3f-567c-476b-92b0-25280b3ab967 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:18:28.779583 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2e9b0879-2fc8-4d16-bd17-b2d403d229a0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:28.780383 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2e9b0879-2fc8-4d16-bd17-b2d403d229a0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: c1bf5f3f-567c-476b-92b0-25280b3ab967] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:28.787572 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2e9b0879-2fc8-4d16-bd17-b2d403d229a0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:28.788047 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2e9b0879-2fc8-4d16-bd17-b2d403d229a0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:28.788526 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2e9b0879-2fc8-4d16-bd17-b2d403d229a0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:28.789194 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2e9b0879-2fc8-4d16-bd17-b2d403d229a0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:28.789641 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2e9b0879-2fc8-4d16-bd17-b2d403d229a0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:28.790054 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2e9b0879-2fc8-4d16-bd17-b2d403d229a0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:28.808041 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e7b78a37-6b61-4d04-80c5-26f709c112c1 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:28.808741 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e7b78a37-6b61-4d04-80c5-26f709c112c1 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e7405fc0-937a-4256-8d0c-95acd35ebc97] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:28.814969 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7b78a37-6b61-4d04-80c5-26f709c112c1 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:28.815479 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7b78a37-6b61-4d04-80c5-26f709c112c1 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:28.815909 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7b78a37-6b61-4d04-80c5-26f709c112c1 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:28.816597 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7b78a37-6b61-4d04-80c5-26f709c112c1 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:28.817045 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7b78a37-6b61-4d04-80c5-26f709c112c1 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:28.817489 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7b78a37-6b61-4d04-80c5-26f709c112c1 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:28.969530 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2e9b0879-2fc8-4d16-bd17-b2d403d229a0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:18:28.978011 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2e9b0879-2fc8-4d16-bd17-b2d403d229a0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/c1bf5f3f-567c-476b-92b0-25280b3ab967" status: 200 len: 1394 microversion: 2.1 time: 0.205679 Oct 17 14:18:28.978583 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2927/5988] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:28 2022] GET /compute/v2.1/servers/c1bf5f3f-567c-476b-92b0-25280b3ab967 => generated 1394 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:18:29.000600 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e7b78a37-6b61-4d04-80c5-26f709c112c1 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:18:29.009374 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e7b78a37-6b61-4d04-80c5-26f709c112c1 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97" status: 200 len: 1695 microversion: 2.1 time: 0.206028 Oct 17 14:18:29.009919 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3062/5989] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:28 2022] GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97 => generated 1695 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:18:30.003823 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-60a23736-876c-4a72-923b-b4c0089e3370 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:30.004665 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-60a23736-876c-4a72-923b-b4c0089e3370 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: c1bf5f3f-567c-476b-92b0-25280b3ab967] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:30.014144 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-60a23736-876c-4a72-923b-b4c0089e3370 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:30.014875 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-60a23736-876c-4a72-923b-b4c0089e3370 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:30.015540 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-60a23736-876c-4a72-923b-b4c0089e3370 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:30.016496 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-60a23736-876c-4a72-923b-b4c0089e3370 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:30.017347 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-60a23736-876c-4a72-923b-b4c0089e3370 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:30.017859 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-60a23736-876c-4a72-923b-b4c0089e3370 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:30.032827 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-bba930e1-c183-46ad-97c9-78f22578aa4a tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:30.033805 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-bba930e1-c183-46ad-97c9-78f22578aa4a tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e7405fc0-937a-4256-8d0c-95acd35ebc97] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:30.040957 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bba930e1-c183-46ad-97c9-78f22578aa4a tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:30.041447 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bba930e1-c183-46ad-97c9-78f22578aa4a tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:30.041878 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bba930e1-c183-46ad-97c9-78f22578aa4a tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:30.042549 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bba930e1-c183-46ad-97c9-78f22578aa4a tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:30.043032 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bba930e1-c183-46ad-97c9-78f22578aa4a tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:30.043481 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bba930e1-c183-46ad-97c9-78f22578aa4a tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:30.252179 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-60a23736-876c-4a72-923b-b4c0089e3370 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:18:30.260530 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-60a23736-876c-4a72-923b-b4c0089e3370 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/c1bf5f3f-567c-476b-92b0-25280b3ab967" status: 200 len: 1394 microversion: 2.1 time: 0.262259 Oct 17 14:18:30.265266 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2928/5990] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:29 2022] GET /compute/v2.1/servers/c1bf5f3f-567c-476b-92b0-25280b3ab967 => generated 1394 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:18:30.286075 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-bba930e1-c183-46ad-97c9-78f22578aa4a tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:18:30.294345 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-bba930e1-c183-46ad-97c9-78f22578aa4a tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97" status: 200 len: 1695 microversion: 2.1 time: 0.265676 Oct 17 14:18:30.294930 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3063/5991] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:30 2022] GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97 => generated 1695 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:18:30.722452 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-5d33161d-d2dc-4651-b484-13ca1deb0256 req-ef663599-6c36-454b-9f6e-dc532af79ab7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1bf5f3f-567c-476b-92b0-25280b3ab967", "name": "network-vif-deleted", "tag": "f61939f2-d88f-4767-9dd6-6e0debbf428f"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:18:30.736745 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-5d33161d-d2dc-4651-b484-13ca1deb0256 req-ef663599-6c36-454b-9f6e-dc532af79ab7 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:30.737366 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-5d33161d-d2dc-4651-b484-13ca1deb0256 req-ef663599-6c36-454b-9f6e-dc532af79ab7 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:30.737806 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-5d33161d-d2dc-4651-b484-13ca1deb0256 req-ef663599-6c36-454b-9f6e-dc532af79ab7 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:30.755230 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-5d33161d-d2dc-4651-b484-13ca1deb0256 req-ef663599-6c36-454b-9f6e-dc532af79ab7 service nova] Creating event network-vif-deleted:f61939f2-d88f-4767-9dd6-6e0debbf428f for instance c1bf5f3f-567c-476b-92b0-25280b3ab967 on n-h1-854247-14 Oct 17 14:18:30.761124 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-5d33161d-d2dc-4651-b484-13ca1deb0256 req-ef663599-6c36-454b-9f6e-dc532af79ab7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044818 Oct 17 14:18:30.762043 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2929/5992] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:18:31.289254 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ba1624c5-6733-4afa-b088-410aa6e67fa0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:31.289881 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ba1624c5-6733-4afa-b088-410aa6e67fa0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: c1bf5f3f-567c-476b-92b0-25280b3ab967] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:31.297159 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ba1624c5-6733-4afa-b088-410aa6e67fa0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:31.297647 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ba1624c5-6733-4afa-b088-410aa6e67fa0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:31.298089 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ba1624c5-6733-4afa-b088-410aa6e67fa0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:31.298813 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ba1624c5-6733-4afa-b088-410aa6e67fa0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:31.299281 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ba1624c5-6733-4afa-b088-410aa6e67fa0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:31.299709 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ba1624c5-6733-4afa-b088-410aa6e67fa0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:31.320086 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8450c446-fc78-41e0-9045-58f981a877b6 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:31.320818 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8450c446-fc78-41e0-9045-58f981a877b6 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e7405fc0-937a-4256-8d0c-95acd35ebc97] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:31.327415 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8450c446-fc78-41e0-9045-58f981a877b6 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:31.327897 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8450c446-fc78-41e0-9045-58f981a877b6 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:31.328366 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8450c446-fc78-41e0-9045-58f981a877b6 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:31.329049 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8450c446-fc78-41e0-9045-58f981a877b6 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:31.329617 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8450c446-fc78-41e0-9045-58f981a877b6 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:31.330047 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8450c446-fc78-41e0-9045-58f981a877b6 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:31.365193 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ba1624c5-6733-4afa-b088-410aa6e67fa0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:18:31.374521 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ba1624c5-6733-4afa-b088-410aa6e67fa0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/c1bf5f3f-567c-476b-92b0-25280b3ab967" status: 200 len: 1186 microversion: 2.1 time: 0.089127 Oct 17 14:18:31.376047 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3064/5993] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:31 2022] GET /compute/v2.1/servers/c1bf5f3f-567c-476b-92b0-25280b3ab967 => generated 1186 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:18:31.469244 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8450c446-fc78-41e0-9045-58f981a877b6 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:18:31.477848 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8450c446-fc78-41e0-9045-58f981a877b6 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97" status: 200 len: 1695 microversion: 2.1 time: 0.163316 Oct 17 14:18:31.478416 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2930/5994] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:31 2022] GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97 => generated 1695 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:18:32.403666 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f74b8997-5c88-4e11-b234-4401db49f4f5 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:32.404232 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f74b8997-5c88-4e11-b234-4401db49f4f5 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: c1bf5f3f-567c-476b-92b0-25280b3ab967] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:32.412111 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f74b8997-5c88-4e11-b234-4401db49f4f5 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:32.412615 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f74b8997-5c88-4e11-b234-4401db49f4f5 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:32.413062 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f74b8997-5c88-4e11-b234-4401db49f4f5 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:32.413783 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f74b8997-5c88-4e11-b234-4401db49f4f5 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:32.414239 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f74b8997-5c88-4e11-b234-4401db49f4f5 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:32.414635 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f74b8997-5c88-4e11-b234-4401db49f4f5 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:32.480881 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f74b8997-5c88-4e11-b234-4401db49f4f5 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:18:32.489545 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f74b8997-5c88-4e11-b234-4401db49f4f5 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/c1bf5f3f-567c-476b-92b0-25280b3ab967" status: 200 len: 1186 microversion: 2.1 time: 0.090003 Oct 17 14:18:32.490097 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3065/5995] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:32 2022] GET /compute/v2.1/servers/c1bf5f3f-567c-476b-92b0-25280b3ab967 => generated 1186 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:18:32.503543 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8e022c3c-ff78-40d8-ae9b-1a2b70af38b3 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:32.504349 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8e022c3c-ff78-40d8-ae9b-1a2b70af38b3 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e7405fc0-937a-4256-8d0c-95acd35ebc97] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:32.511770 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8e022c3c-ff78-40d8-ae9b-1a2b70af38b3 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:32.512367 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8e022c3c-ff78-40d8-ae9b-1a2b70af38b3 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:32.512898 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8e022c3c-ff78-40d8-ae9b-1a2b70af38b3 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:32.513585 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8e022c3c-ff78-40d8-ae9b-1a2b70af38b3 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:32.514035 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8e022c3c-ff78-40d8-ae9b-1a2b70af38b3 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:32.514454 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8e022c3c-ff78-40d8-ae9b-1a2b70af38b3 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:32.649791 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8e022c3c-ff78-40d8-ae9b-1a2b70af38b3 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:18:32.657953 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8e022c3c-ff78-40d8-ae9b-1a2b70af38b3 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97" status: 200 len: 1695 microversion: 2.1 time: 0.158318 Oct 17 14:18:32.658461 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2931/5996] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:32 2022] GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97 => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:18:33.513717 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3e4e0c48-5410-423c-922f-6bb1d5c5e053 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:33.514299 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3e4e0c48-5410-423c-922f-6bb1d5c5e053 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: c1bf5f3f-567c-476b-92b0-25280b3ab967] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:33.522047 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3e4e0c48-5410-423c-922f-6bb1d5c5e053 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:33.522540 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3e4e0c48-5410-423c-922f-6bb1d5c5e053 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:33.522971 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3e4e0c48-5410-423c-922f-6bb1d5c5e053 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:33.523707 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3e4e0c48-5410-423c-922f-6bb1d5c5e053 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:33.524155 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3e4e0c48-5410-423c-922f-6bb1d5c5e053 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:33.524580 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3e4e0c48-5410-423c-922f-6bb1d5c5e053 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:33.590073 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3e4e0c48-5410-423c-922f-6bb1d5c5e053 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:18:33.598283 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3e4e0c48-5410-423c-922f-6bb1d5c5e053 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/c1bf5f3f-567c-476b-92b0-25280b3ab967" status: 200 len: 1186 microversion: 2.1 time: 0.088592 Oct 17 14:18:33.598839 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3066/5997] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:33 2022] GET /compute/v2.1/servers/c1bf5f3f-567c-476b-92b0-25280b3ab967 => generated 1186 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:18:33.681860 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4e07d271-f167-4588-91d0-f59b45f15202 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:33.682814 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4e07d271-f167-4588-91d0-f59b45f15202 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e7405fc0-937a-4256-8d0c-95acd35ebc97] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:33.690280 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4e07d271-f167-4588-91d0-f59b45f15202 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:33.690772 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4e07d271-f167-4588-91d0-f59b45f15202 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:33.691200 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4e07d271-f167-4588-91d0-f59b45f15202 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:33.691933 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4e07d271-f167-4588-91d0-f59b45f15202 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:33.692386 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4e07d271-f167-4588-91d0-f59b45f15202 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:33.692807 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4e07d271-f167-4588-91d0-f59b45f15202 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:33.829084 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4e07d271-f167-4588-91d0-f59b45f15202 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:18:33.837374 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4e07d271-f167-4588-91d0-f59b45f15202 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97" status: 200 len: 1695 microversion: 2.1 time: 0.159482 Oct 17 14:18:33.837987 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2932/5998] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:33 2022] GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97 => generated 1695 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:18:34.621915 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5412c7da-23d1-452a-9564-d6c4aba0b806 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:34.622503 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5412c7da-23d1-452a-9564-d6c4aba0b806 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: c1bf5f3f-567c-476b-92b0-25280b3ab967] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:34.630437 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5412c7da-23d1-452a-9564-d6c4aba0b806 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:34.630930 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5412c7da-23d1-452a-9564-d6c4aba0b806 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:34.631398 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5412c7da-23d1-452a-9564-d6c4aba0b806 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:34.632110 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5412c7da-23d1-452a-9564-d6c4aba0b806 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:34.632572 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5412c7da-23d1-452a-9564-d6c4aba0b806 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:34.632999 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5412c7da-23d1-452a-9564-d6c4aba0b806 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:34.704125 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5412c7da-23d1-452a-9564-d6c4aba0b806 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:18:34.713036 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5412c7da-23d1-452a-9564-d6c4aba0b806 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/c1bf5f3f-567c-476b-92b0-25280b3ab967" status: 200 len: 1186 microversion: 2.1 time: 0.095159 Oct 17 14:18:34.722961 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3067/5999] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:34 2022] GET /compute/v2.1/servers/c1bf5f3f-567c-476b-92b0-25280b3ab967 => generated 1186 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:18:34.863221 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-13f441d7-3b1e-4e69-8362-22d47cf18af2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:34.864482 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-13f441d7-3b1e-4e69-8362-22d47cf18af2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e7405fc0-937a-4256-8d0c-95acd35ebc97] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:34.872188 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-13f441d7-3b1e-4e69-8362-22d47cf18af2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:34.873209 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-13f441d7-3b1e-4e69-8362-22d47cf18af2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:34.873835 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-13f441d7-3b1e-4e69-8362-22d47cf18af2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:34.874971 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-13f441d7-3b1e-4e69-8362-22d47cf18af2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:34.875596 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-13f441d7-3b1e-4e69-8362-22d47cf18af2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:34.877146 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-13f441d7-3b1e-4e69-8362-22d47cf18af2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:35.019829 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-13f441d7-3b1e-4e69-8362-22d47cf18af2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:18:35.028057 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-13f441d7-3b1e-4e69-8362-22d47cf18af2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97" status: 200 len: 1695 microversion: 2.1 time: 0.170748 Oct 17 14:18:35.028732 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2933/6000] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:34 2022] GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97 => generated 1695 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:18:35.741099 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5306f04c-6238-43b0-8985-451e04a4b537 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:35.741832 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5306f04c-6238-43b0-8985-451e04a4b537 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: c1bf5f3f-567c-476b-92b0-25280b3ab967] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:35.752416 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5306f04c-6238-43b0-8985-451e04a4b537 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:35.752903 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5306f04c-6238-43b0-8985-451e04a4b537 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:35.753365 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5306f04c-6238-43b0-8985-451e04a4b537 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:35.754074 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5306f04c-6238-43b0-8985-451e04a4b537 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:35.754554 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5306f04c-6238-43b0-8985-451e04a4b537 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:35.754978 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5306f04c-6238-43b0-8985-451e04a4b537 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:35.770085 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-5306f04c-6238-43b0-8985-451e04a4b537 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] HTTP exception thrown: Instance c1bf5f3f-567c-476b-92b0-25280b3ab967 could not be found. Oct 17 14:18:35.771858 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5306f04c-6238-43b0-8985-451e04a4b537 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Request method failure captured: Oct 17 14:18:35.771858 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/c1bf5f3f-567c-476b-92b0-25280b3ab967 HTTP/1.1 Oct 17 14:18:35.771858 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 14:18:35.771858 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 14:18:35.771858 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 14:18:35.771858 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 14:18:35.771858 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 14:18:35.771858 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 14:18:35.771858 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 14:18:35.771858 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 14:18:35.771858 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTWPt4q6KhJtaXfApyhSZ1uS2Yi83dufn15X2GOm5u94F5E_Yj644GYsWZT8YBgl1aUBmYfKlHMjXq-eb8c2HF1REfW755J7WOOs8k3QRgUHhfiijXEH0YeKQjwZvCrEKlD9sd8dyp1v8diPQXXtSf-PHzqWEcTzJgPsJ95on9ZJE1Jo Oct 17 14:18:35.771858 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 14:18:35.771858 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 14:18:35.771858 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 14:18:35.771858 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 14:18:35.771858 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 14:18:35.771858 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 14:18:35.771858 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 4ee70940341741cb8e31928b856de051 Oct 17 14:18:35.771858 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-TestVolumeBootPattern-2135999385 Oct 17 14:18:35.771858 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 14:18:35.771858 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 14:18:35.771858 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4ee70940341741cb8e31928b856de051"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4ee70940341741cb8e31928b856de051"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4ee70940341741cb8e31928b856de051"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4ee70940341741cb8e31928b856de051", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:18:35.771858 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-TestVolumeBootPattern-2135999385 Oct 17 14:18:35.771858 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 4ee70940341741cb8e31928b856de051 Oct 17 14:18:35.771858 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-TestVolumeBootPattern-2135999385 Oct 17 14:18:35.771858 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-TestVolumeBootPattern-2135999385-project Oct 17 14:18:35.771858 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 14:18:35.771858 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 14:18:35.771858 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 06a0e2dab7494a4682615a6269ac24f9 Oct 17 14:18:35.771858 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-TestVolumeBootPattern-2135999385-project Oct 17 14:18:35.771858 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 14:18:35.771858 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance c1bf5f3f-567c-476b-92b0-25280b3ab967 could not be found. Oct 17 14:18:35.771858 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'c1bf5f3f-567c-476b-92b0-25280b3ab967'} Oct 17 14:18:35.771858 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:18:35.771858 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:18:35.771858 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:18:35.771858 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:18:35.771858 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:18:35.771858 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:18:35.771858 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:18:35.771858 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:18:35.771858 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:18:35.771858 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:18:35.771858 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1bf5f3f-567c-476b-92b0-25280b3ab967 could not be found. Oct 17 14:18:35.771858 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:18:35.771858 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:18:35.771858 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:18:35.771858 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:18:35.771858 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:18:35.771858 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:18:35.771858 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:18:35.771858 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:18:35.771858 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:18:35.771858 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:18:35.771858 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:18:35.771858 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:18:35.771858 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:18:35.771858 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:18:35.771858 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:18:35.771858 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:18:35.771858 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1bf5f3f-567c-476b-92b0-25280b3ab967 could not be found. Oct 17 14:18:35.771858 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:18:35.771858 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:18:35.771858 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:18:35.778886 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:18:35.778886 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:18:35.778886 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:18:35.778886 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:18:35.778886 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:18:35.778886 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1bf5f3f-567c-476b-92b0-25280b3ab967 could not be found. Oct 17 14:18:35.778886 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:18:35.778886 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5306f04c-6238-43b0-8985-451e04a4b537 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Returning 404 to user: Instance c1bf5f3f-567c-476b-92b0-25280b3ab967 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:18:35.778886 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5306f04c-6238-43b0-8985-451e04a4b537 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/c1bf5f3f-567c-476b-92b0-25280b3ab967" status: 404 len: 111 microversion: 2.1 time: 0.039206 Oct 17 14:18:35.778886 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3068/6001] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:35 2022] GET /compute/v2.1/servers/c1bf5f3f-567c-476b-92b0-25280b3ab967 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:18:36.051634 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-68e8caf6-9d74-4b59-804e-6bab9d218504 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:36.052356 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-68e8caf6-9d74-4b59-804e-6bab9d218504 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e7405fc0-937a-4256-8d0c-95acd35ebc97] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:36.060204 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-68e8caf6-9d74-4b59-804e-6bab9d218504 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:36.060634 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-68e8caf6-9d74-4b59-804e-6bab9d218504 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:36.061074 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-68e8caf6-9d74-4b59-804e-6bab9d218504 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:36.061778 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-68e8caf6-9d74-4b59-804e-6bab9d218504 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:36.062221 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-68e8caf6-9d74-4b59-804e-6bab9d218504 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:36.062644 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-68e8caf6-9d74-4b59-804e-6bab9d218504 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:36.198812 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-68e8caf6-9d74-4b59-804e-6bab9d218504 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:18:36.207381 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-68e8caf6-9d74-4b59-804e-6bab9d218504 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97" status: 200 len: 1695 microversion: 2.1 time: 0.159828 Oct 17 14:18:36.208176 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2934/6002] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:36 2022] GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97 => generated 1695 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:18:37.232120 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a80904e4-92a9-43de-a144-b22cb3a7601c tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:37.232681 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a80904e4-92a9-43de-a144-b22cb3a7601c tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e7405fc0-937a-4256-8d0c-95acd35ebc97] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:37.240336 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a80904e4-92a9-43de-a144-b22cb3a7601c tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:37.240834 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a80904e4-92a9-43de-a144-b22cb3a7601c tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:37.241339 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a80904e4-92a9-43de-a144-b22cb3a7601c tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:37.241961 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a80904e4-92a9-43de-a144-b22cb3a7601c tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:37.242836 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a80904e4-92a9-43de-a144-b22cb3a7601c tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:37.243537 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a80904e4-92a9-43de-a144-b22cb3a7601c tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:37.629144 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a80904e4-92a9-43de-a144-b22cb3a7601c tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:18:37.637265 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a80904e4-92a9-43de-a144-b22cb3a7601c tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97" status: 200 len: 1695 microversion: 2.1 time: 0.409461 Oct 17 14:18:37.637830 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3069/6003] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:37 2022] GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97 => generated 1695 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:18:38.662399 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9c7fa0c6-b054-42bf-a920-d116ecebf33f tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:38.662992 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9c7fa0c6-b054-42bf-a920-d116ecebf33f tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e7405fc0-937a-4256-8d0c-95acd35ebc97] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:38.670657 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9c7fa0c6-b054-42bf-a920-d116ecebf33f tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:38.671140 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9c7fa0c6-b054-42bf-a920-d116ecebf33f tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:38.671630 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9c7fa0c6-b054-42bf-a920-d116ecebf33f tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:38.672326 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9c7fa0c6-b054-42bf-a920-d116ecebf33f tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:38.672761 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9c7fa0c6-b054-42bf-a920-d116ecebf33f tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:38.673235 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9c7fa0c6-b054-42bf-a920-d116ecebf33f tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:38.812161 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9c7fa0c6-b054-42bf-a920-d116ecebf33f tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:18:38.820523 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9c7fa0c6-b054-42bf-a920-d116ecebf33f tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97" status: 200 len: 1695 microversion: 2.1 time: 0.162225 Oct 17 14:18:38.821096 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2935/6004] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:38 2022] GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97 => generated 1695 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:18:39.754021 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-5a3211a3-1e16-4c99-8ffb-51a88da65099 req-647fc128-f8c6-439a-bd7a-ae21677b6df3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7405fc0-937a-4256-8d0c-95acd35ebc97", "name": "network-vif-unplugged", "status": "completed", "tag": "416db0e1-9273-4dba-a586-13951c2b8257"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:18:39.767686 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-5a3211a3-1e16-4c99-8ffb-51a88da65099 req-647fc128-f8c6-439a-bd7a-ae21677b6df3 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:39.768342 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-5a3211a3-1e16-4c99-8ffb-51a88da65099 req-647fc128-f8c6-439a-bd7a-ae21677b6df3 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:39.768850 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-5a3211a3-1e16-4c99-8ffb-51a88da65099 req-647fc128-f8c6-439a-bd7a-ae21677b6df3 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:39.782819 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-5a3211a3-1e16-4c99-8ffb-51a88da65099 req-647fc128-f8c6-439a-bd7a-ae21677b6df3 service nova] Creating event network-vif-unplugged:416db0e1-9273-4dba-a586-13951c2b8257 for instance e7405fc0-937a-4256-8d0c-95acd35ebc97 on n-h1-854247-14 Oct 17 14:18:39.790248 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [req-5a3211a3-1e16-4c99-8ffb-51a88da65099 req-647fc128-f8c6-439a-bd7a-ae21677b6df3 service nova] Instance e7405fc0-937a-4256-8d0c-95acd35ebc97 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854247-14', 'n-h1-854247-14'} {{(pid=127016) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 14:18:39.808390 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-5a3211a3-1e16-4c99-8ffb-51a88da65099 req-647fc128-f8c6-439a-bd7a-ae21677b6df3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058396 Oct 17 14:18:39.809642 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3070/6005] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:18:39.844303 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8791ff0e-e711-4af3-b17e-ccd3310666b9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:39.845659 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8791ff0e-e711-4af3-b17e-ccd3310666b9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e7405fc0-937a-4256-8d0c-95acd35ebc97] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:39.853080 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8791ff0e-e711-4af3-b17e-ccd3310666b9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:39.853725 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8791ff0e-e711-4af3-b17e-ccd3310666b9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:39.854453 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8791ff0e-e711-4af3-b17e-ccd3310666b9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:39.855774 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8791ff0e-e711-4af3-b17e-ccd3310666b9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:39.856355 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8791ff0e-e711-4af3-b17e-ccd3310666b9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:39.856936 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8791ff0e-e711-4af3-b17e-ccd3310666b9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:39.860231 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=100 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:18:40.140477 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8791ff0e-e711-4af3-b17e-ccd3310666b9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:18:40.148679 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8791ff0e-e711-4af3-b17e-ccd3310666b9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97" status: 200 len: 1694 microversion: 2.1 time: 0.308204 Oct 17 14:18:40.149258 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2936/6006] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:39 2022] GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97 => generated 1694 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:18:41.174897 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-73b4b695-ab39-4283-a7b7-f5be497b0e6e tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:41.175871 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-73b4b695-ab39-4283-a7b7-f5be497b0e6e tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e7405fc0-937a-4256-8d0c-95acd35ebc97] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:41.182930 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-73b4b695-ab39-4283-a7b7-f5be497b0e6e tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:41.183656 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-73b4b695-ab39-4283-a7b7-f5be497b0e6e tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:41.184210 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-73b4b695-ab39-4283-a7b7-f5be497b0e6e tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:41.185062 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-73b4b695-ab39-4283-a7b7-f5be497b0e6e tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:41.185612 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-73b4b695-ab39-4283-a7b7-f5be497b0e6e tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:41.186130 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-73b4b695-ab39-4283-a7b7-f5be497b0e6e tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:41.350547 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-73b4b695-ab39-4283-a7b7-f5be497b0e6e tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:18:41.359650 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-73b4b695-ab39-4283-a7b7-f5be497b0e6e tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97" status: 200 len: 1694 microversion: 2.1 time: 0.190100 Oct 17 14:18:41.360580 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3071/6007] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:41 2022] GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97 => generated 1694 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:18:41.837370 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-66b9b5cb-1974-467c-b515-53cfdd77b7c7 req-40c4db93-f64e-4e98-9073-82f2c09270b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7405fc0-937a-4256-8d0c-95acd35ebc97", "tag": "416db0e1-9273-4dba-a586-13951c2b8257"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:18:41.843299 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:18:41.849746 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-66b9b5cb-1974-467c-b515-53cfdd77b7c7 req-40c4db93-f64e-4e98-9073-82f2c09270b0 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:41.850218 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-66b9b5cb-1974-467c-b515-53cfdd77b7c7 req-40c4db93-f64e-4e98-9073-82f2c09270b0 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:41.850646 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-66b9b5cb-1974-467c-b515-53cfdd77b7c7 req-40c4db93-f64e-4e98-9073-82f2c09270b0 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:41.862933 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-66b9b5cb-1974-467c-b515-53cfdd77b7c7 req-40c4db93-f64e-4e98-9073-82f2c09270b0 service nova] Creating event network-changed:416db0e1-9273-4dba-a586-13951c2b8257 for instance e7405fc0-937a-4256-8d0c-95acd35ebc97 on n-h1-854247-14 Oct 17 14:18:41.868557 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [req-66b9b5cb-1974-467c-b515-53cfdd77b7c7 req-40c4db93-f64e-4e98-9073-82f2c09270b0 service nova] Instance e7405fc0-937a-4256-8d0c-95acd35ebc97 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854247-14', 'n-h1-854247-14'} {{(pid=127017) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 14:18:41.879815 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-66b9b5cb-1974-467c-b515-53cfdd77b7c7 req-40c4db93-f64e-4e98-9073-82f2c09270b0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046081 Oct 17 14:18:41.880415 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2937/6008] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:18:42.383472 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5955b178-b580-4cd3-aab6-2d37539d4027 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:42.384771 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5955b178-b580-4cd3-aab6-2d37539d4027 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e7405fc0-937a-4256-8d0c-95acd35ebc97] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:42.392307 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5955b178-b580-4cd3-aab6-2d37539d4027 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:42.392895 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5955b178-b580-4cd3-aab6-2d37539d4027 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:42.393549 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5955b178-b580-4cd3-aab6-2d37539d4027 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:42.394482 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5955b178-b580-4cd3-aab6-2d37539d4027 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:42.395148 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5955b178-b580-4cd3-aab6-2d37539d4027 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:42.395687 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5955b178-b580-4cd3-aab6-2d37539d4027 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:42.625550 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5955b178-b580-4cd3-aab6-2d37539d4027 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:18:42.634555 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5955b178-b580-4cd3-aab6-2d37539d4027 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97" status: 200 len: 1692 microversion: 2.1 time: 0.255000 Oct 17 14:18:42.651552 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3072/6009] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:42 2022] GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97 => generated 1692 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:18:43.660278 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-78015b34-99f5-47d2-a392-a261890bbd2d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:43.661115 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-78015b34-99f5-47d2-a392-a261890bbd2d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e7405fc0-937a-4256-8d0c-95acd35ebc97] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:43.667653 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-78015b34-99f5-47d2-a392-a261890bbd2d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:43.668135 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-78015b34-99f5-47d2-a392-a261890bbd2d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:43.668585 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-78015b34-99f5-47d2-a392-a261890bbd2d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:43.669280 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-78015b34-99f5-47d2-a392-a261890bbd2d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:43.669726 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-78015b34-99f5-47d2-a392-a261890bbd2d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:43.670383 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-78015b34-99f5-47d2-a392-a261890bbd2d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:43.806589 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-78015b34-99f5-47d2-a392-a261890bbd2d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:18:43.815081 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-78015b34-99f5-47d2-a392-a261890bbd2d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97" status: 200 len: 1689 microversion: 2.1 time: 0.160437 Oct 17 14:18:43.815874 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2938/6010] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:43 2022] GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97 => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:18:43.838652 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6acb580b-e0a3-43ae-8b2c-6334db05e9b8 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:18:43.839241 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6acb580b-e0a3-43ae-8b2c-6334db05e9b8 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e7405fc0-937a-4256-8d0c-95acd35ebc97] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:43.846818 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6acb580b-e0a3-43ae-8b2c-6334db05e9b8 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:43.847516 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6acb580b-e0a3-43ae-8b2c-6334db05e9b8 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:43.847963 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6acb580b-e0a3-43ae-8b2c-6334db05e9b8 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:43.848678 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6acb580b-e0a3-43ae-8b2c-6334db05e9b8 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:43.849131 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6acb580b-e0a3-43ae-8b2c-6334db05e9b8 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:43.849560 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6acb580b-e0a3-43ae-8b2c-6334db05e9b8 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:43.951436 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:18:43.980697 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6acb580b-e0a3-43ae-8b2c-6334db05e9b8 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "POST /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97/action" status: 202 len: 0 microversion: 2.1 time: 0.145823 Oct 17 14:18:43.981591 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3073/6011] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:18:43 2022] POST /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:18:43.990006 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-73e653d5-46ee-458b-897a-536d05700cd3 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:43.990870 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-73e653d5-46ee-458b-897a-536d05700cd3 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e7405fc0-937a-4256-8d0c-95acd35ebc97] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:43.997950 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-73e653d5-46ee-458b-897a-536d05700cd3 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:43.998435 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-73e653d5-46ee-458b-897a-536d05700cd3 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:43.998940 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-73e653d5-46ee-458b-897a-536d05700cd3 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:43.999744 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-73e653d5-46ee-458b-897a-536d05700cd3 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:44.000271 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-73e653d5-46ee-458b-897a-536d05700cd3 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:44.000740 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-73e653d5-46ee-458b-897a-536d05700cd3 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:44.243079 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-73e653d5-46ee-458b-897a-536d05700cd3 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:18:44.254274 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-73e653d5-46ee-458b-897a-536d05700cd3 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97" status: 200 len: 1688 microversion: 2.1 time: 0.268424 Oct 17 14:18:44.271760 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2939/6012] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:43 2022] GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97 => generated 1688 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:18:45.281417 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f5431ab7-b6bb-4fbd-abba-8decc29caf39 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:45.282129 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f5431ab7-b6bb-4fbd-abba-8decc29caf39 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e7405fc0-937a-4256-8d0c-95acd35ebc97] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:45.290337 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f5431ab7-b6bb-4fbd-abba-8decc29caf39 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:45.290828 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f5431ab7-b6bb-4fbd-abba-8decc29caf39 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:45.291309 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f5431ab7-b6bb-4fbd-abba-8decc29caf39 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:45.292017 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f5431ab7-b6bb-4fbd-abba-8decc29caf39 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:45.293075 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f5431ab7-b6bb-4fbd-abba-8decc29caf39 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:45.293075 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f5431ab7-b6bb-4fbd-abba-8decc29caf39 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:45.441862 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f5431ab7-b6bb-4fbd-abba-8decc29caf39 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:18:45.452713 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f5431ab7-b6bb-4fbd-abba-8decc29caf39 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97" status: 200 len: 1688 microversion: 2.1 time: 0.176080 Oct 17 14:18:45.453306 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3074/6013] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:45 2022] GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97 => generated 1688 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:18:46.206838 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-59cd4a06-29bf-43cf-a5de-aaa854df97db req-20ecca5a-1650-4007-b648-645c55a385c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7405fc0-937a-4256-8d0c-95acd35ebc97", "name": "network-vif-plugged", "status": "completed", "tag": "416db0e1-9273-4dba-a586-13951c2b8257"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:18:46.222431 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-59cd4a06-29bf-43cf-a5de-aaa854df97db req-20ecca5a-1650-4007-b648-645c55a385c7 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:46.224864 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-59cd4a06-29bf-43cf-a5de-aaa854df97db req-20ecca5a-1650-4007-b648-645c55a385c7 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:46.225778 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-59cd4a06-29bf-43cf-a5de-aaa854df97db req-20ecca5a-1650-4007-b648-645c55a385c7 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:46.243186 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-59cd4a06-29bf-43cf-a5de-aaa854df97db req-20ecca5a-1650-4007-b648-645c55a385c7 service nova] Creating event network-vif-plugged:416db0e1-9273-4dba-a586-13951c2b8257 for instance e7405fc0-937a-4256-8d0c-95acd35ebc97 on n-h1-854247-14 Oct 17 14:18:46.250760 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [req-59cd4a06-29bf-43cf-a5de-aaa854df97db req-20ecca5a-1650-4007-b648-645c55a385c7 service nova] Instance e7405fc0-937a-4256-8d0c-95acd35ebc97 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854247-14', 'n-h1-854247-14'} {{(pid=127017) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 14:18:46.267038 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-59cd4a06-29bf-43cf-a5de-aaa854df97db req-20ecca5a-1650-4007-b648-645c55a385c7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064522 Oct 17 14:18:46.269316 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2940/6014] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:18:46.476242 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a2c8bb66-6820-454f-8897-3e35b18d41a5 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:46.476889 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a2c8bb66-6820-454f-8897-3e35b18d41a5 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e7405fc0-937a-4256-8d0c-95acd35ebc97] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:46.484221 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a2c8bb66-6820-454f-8897-3e35b18d41a5 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:46.484726 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a2c8bb66-6820-454f-8897-3e35b18d41a5 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:46.485154 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a2c8bb66-6820-454f-8897-3e35b18d41a5 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:46.486326 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a2c8bb66-6820-454f-8897-3e35b18d41a5 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:46.486869 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a2c8bb66-6820-454f-8897-3e35b18d41a5 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:46.487330 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a2c8bb66-6820-454f-8897-3e35b18d41a5 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:46.665694 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a2c8bb66-6820-454f-8897-3e35b18d41a5 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:18:46.673923 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a2c8bb66-6820-454f-8897-3e35b18d41a5 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97" status: 200 len: 1688 microversion: 2.1 time: 0.201568 Oct 17 14:18:46.674686 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3075/6015] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:46 2022] GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97 => generated 1688 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:18:47.308618 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-09aea3e4-3659-46fe-ac72-920cd78181bd req-3f811def-4f3a-4513-81f4-1a7de6da26f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7405fc0-937a-4256-8d0c-95acd35ebc97", "name": "network-vif-unplugged", "status": "completed", "tag": "416db0e1-9273-4dba-a586-13951c2b8257"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:18:47.320654 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-09aea3e4-3659-46fe-ac72-920cd78181bd req-3f811def-4f3a-4513-81f4-1a7de6da26f3 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:47.321226 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-09aea3e4-3659-46fe-ac72-920cd78181bd req-3f811def-4f3a-4513-81f4-1a7de6da26f3 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:47.321725 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-09aea3e4-3659-46fe-ac72-920cd78181bd req-3f811def-4f3a-4513-81f4-1a7de6da26f3 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:47.334762 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-09aea3e4-3659-46fe-ac72-920cd78181bd req-3f811def-4f3a-4513-81f4-1a7de6da26f3 service nova] Creating event network-vif-unplugged:416db0e1-9273-4dba-a586-13951c2b8257 for instance e7405fc0-937a-4256-8d0c-95acd35ebc97 on n-h2-854247-14 Oct 17 14:18:47.341861 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [req-09aea3e4-3659-46fe-ac72-920cd78181bd req-3f811def-4f3a-4513-81f4-1a7de6da26f3 service nova] Instance e7405fc0-937a-4256-8d0c-95acd35ebc97 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854247-14', 'n-h2-854247-14'} {{(pid=127017) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 14:18:47.353204 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-09aea3e4-3659-46fe-ac72-920cd78181bd req-3f811def-4f3a-4513-81f4-1a7de6da26f3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050249 Oct 17 14:18:47.353814 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2941/6016] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:18:47.699046 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6a9d8ce9-83ad-4c36-a2ad-8b6c1dad3d16 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:47.700249 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6a9d8ce9-83ad-4c36-a2ad-8b6c1dad3d16 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e7405fc0-937a-4256-8d0c-95acd35ebc97] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:47.708134 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6a9d8ce9-83ad-4c36-a2ad-8b6c1dad3d16 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:47.709154 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6a9d8ce9-83ad-4c36-a2ad-8b6c1dad3d16 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:47.709592 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6a9d8ce9-83ad-4c36-a2ad-8b6c1dad3d16 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:47.710496 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6a9d8ce9-83ad-4c36-a2ad-8b6c1dad3d16 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:47.711129 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6a9d8ce9-83ad-4c36-a2ad-8b6c1dad3d16 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:47.712049 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6a9d8ce9-83ad-4c36-a2ad-8b6c1dad3d16 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:47.968892 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6a9d8ce9-83ad-4c36-a2ad-8b6c1dad3d16 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:18:47.980196 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6a9d8ce9-83ad-4c36-a2ad-8b6c1dad3d16 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97" status: 200 len: 1688 microversion: 2.1 time: 0.285904 Oct 17 14:18:47.981116 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3076/6017] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:47 2022] GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97 => generated 1688 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:18:49.004064 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7813d438-9ef7-4e7a-a21c-abb4718579ad tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:49.004759 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7813d438-9ef7-4e7a-a21c-abb4718579ad tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e7405fc0-937a-4256-8d0c-95acd35ebc97] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:49.012158 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7813d438-9ef7-4e7a-a21c-abb4718579ad tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:49.012645 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7813d438-9ef7-4e7a-a21c-abb4718579ad tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:49.013102 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7813d438-9ef7-4e7a-a21c-abb4718579ad tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:49.013794 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7813d438-9ef7-4e7a-a21c-abb4718579ad tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:49.014269 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7813d438-9ef7-4e7a-a21c-abb4718579ad tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:49.014793 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7813d438-9ef7-4e7a-a21c-abb4718579ad tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:49.155149 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7813d438-9ef7-4e7a-a21c-abb4718579ad tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:18:49.163718 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7813d438-9ef7-4e7a-a21c-abb4718579ad tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97" status: 200 len: 1688 microversion: 2.1 time: 0.163975 Oct 17 14:18:49.164299 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2942/6018] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:48 2022] GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97 => generated 1688 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:18:49.379307 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-3acd3b71-86fd-4c12-aa41-39ab2e0f5b28 req-a76aa316-9df0-4a43-9434-358923540ad3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7405fc0-937a-4256-8d0c-95acd35ebc97", "tag": "416db0e1-9273-4dba-a586-13951c2b8257"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:18:49.384902 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:18:49.391155 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-3acd3b71-86fd-4c12-aa41-39ab2e0f5b28 req-a76aa316-9df0-4a43-9434-358923540ad3 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:49.391674 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-3acd3b71-86fd-4c12-aa41-39ab2e0f5b28 req-a76aa316-9df0-4a43-9434-358923540ad3 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:49.391865 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-3acd3b71-86fd-4c12-aa41-39ab2e0f5b28 req-a76aa316-9df0-4a43-9434-358923540ad3 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:49.407692 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-3acd3b71-86fd-4c12-aa41-39ab2e0f5b28 req-a76aa316-9df0-4a43-9434-358923540ad3 service nova] Creating event network-changed:416db0e1-9273-4dba-a586-13951c2b8257 for instance e7405fc0-937a-4256-8d0c-95acd35ebc97 on n-h2-854247-14 Oct 17 14:18:49.414308 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [req-3acd3b71-86fd-4c12-aa41-39ab2e0f5b28 req-a76aa316-9df0-4a43-9434-358923540ad3 service nova] Instance e7405fc0-937a-4256-8d0c-95acd35ebc97 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854247-14', 'n-h2-854247-14'} {{(pid=127016) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 14:18:49.425952 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-3acd3b71-86fd-4c12-aa41-39ab2e0f5b28 req-a76aa316-9df0-4a43-9434-358923540ad3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052492 Oct 17 14:18:49.426583 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3077/6019] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:18:50.188106 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-18c29cda-1d3f-42e6-948f-75ffe288fd01 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:50.189334 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-18c29cda-1d3f-42e6-948f-75ffe288fd01 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e7405fc0-937a-4256-8d0c-95acd35ebc97] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:50.198415 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-18c29cda-1d3f-42e6-948f-75ffe288fd01 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:50.199145 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-18c29cda-1d3f-42e6-948f-75ffe288fd01 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:50.199745 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-18c29cda-1d3f-42e6-948f-75ffe288fd01 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:50.200628 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-18c29cda-1d3f-42e6-948f-75ffe288fd01 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:50.201226 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-18c29cda-1d3f-42e6-948f-75ffe288fd01 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:50.201803 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-18c29cda-1d3f-42e6-948f-75ffe288fd01 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:50.766152 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-18c29cda-1d3f-42e6-948f-75ffe288fd01 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:18:50.774769 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-18c29cda-1d3f-42e6-948f-75ffe288fd01 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97" status: 200 len: 1681 microversion: 2.1 time: 0.590941 Oct 17 14:18:50.775625 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2943/6020] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:50 2022] GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97 => generated 1681 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:18:52.244127 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-650290c9-9b07-49eb-8da3-e9e727d0e762 req-80443d1a-254a-4358-af4b-e0c5d70b7bbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7405fc0-937a-4256-8d0c-95acd35ebc97", "name": "network-vif-plugged", "status": "completed", "tag": "416db0e1-9273-4dba-a586-13951c2b8257"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:18:52.264305 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-650290c9-9b07-49eb-8da3-e9e727d0e762 req-80443d1a-254a-4358-af4b-e0c5d70b7bbb service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:52.264882 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-650290c9-9b07-49eb-8da3-e9e727d0e762 req-80443d1a-254a-4358-af4b-e0c5d70b7bbb service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:52.265323 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-650290c9-9b07-49eb-8da3-e9e727d0e762 req-80443d1a-254a-4358-af4b-e0c5d70b7bbb service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:52.279529 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-650290c9-9b07-49eb-8da3-e9e727d0e762 req-80443d1a-254a-4358-af4b-e0c5d70b7bbb service nova] Creating event network-vif-plugged:416db0e1-9273-4dba-a586-13951c2b8257 for instance e7405fc0-937a-4256-8d0c-95acd35ebc97 on n-h2-854247-14 Oct 17 14:18:52.284666 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-650290c9-9b07-49eb-8da3-e9e727d0e762 req-80443d1a-254a-4358-af4b-e0c5d70b7bbb service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047876 Oct 17 14:18:52.285593 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3078/6021] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:18:57.991271 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-dc4a76df-1130-42fd-b798-58737be05e85 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1618498592", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "ba95d596-8244-4027-8662-cdc1b58ad615", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "60d947eb-1d2b-4fd8-9101-f9fb7c7e0088"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:18:58.082700 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-dc4a76df-1130-42fd-b798-58737be05e85 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] validate_networks() for [('60d947eb-1d2b-4fd8-9101-f9fb7c7e0088', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:18:58.478311 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-dc4a76df-1130-42fd-b798-58737be05e85 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:18:58.478737 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-dc4a76df-1130-42fd-b798-58737be05e85 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:18:58.479215 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-dc4a76df-1130-42fd-b798-58737be05e85 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:18:58.479655 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-dc4a76df-1130-42fd-b798-58737be05e85 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:18:58.480071 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-dc4a76df-1130-42fd-b798-58737be05e85 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:18:58.490003 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dc4a76df-1130-42fd-b798-58737be05e85 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:58.490702 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dc4a76df-1130-42fd-b798-58737be05e85 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:58.491199 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dc4a76df-1130-42fd-b798-58737be05e85 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:58.491970 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dc4a76df-1130-42fd-b798-58737be05e85 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:58.492465 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dc4a76df-1130-42fd-b798-58737be05e85 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:58.492894 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dc4a76df-1130-42fd-b798-58737be05e85 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:58.510530 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-dc4a76df-1130-42fd-b798-58737be05e85 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Getting quotas for project 4ee70940341741cb8e31928b856de051. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:18:58.516116 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-dc4a76df-1130-42fd-b798-58737be05e85 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Getting quotas for user 06a0e2dab7494a4682615a6269ac24f9 and project 4ee70940341741cb8e31928b856de051. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:18:58.529552 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-dc4a76df-1130-42fd-b798-58737be05e85 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:18:58.531669 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-dc4a76df-1130-42fd-b798-58737be05e85 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 8afddca2-dfeb-4ec2-862c-3267d4d0186c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='ba95d596-8244-4027-8662-cdc1b58ad615',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:18:58.611070 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-dc4a76df-1130-42fd-b798-58737be05e85 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.623799 Oct 17 14:18:58.611777 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2944/6022] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 14:18:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:18:58.624021 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-364017dc-0fd5-42b6-b5ac-e4625268f595 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:58.624726 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-364017dc-0fd5-42b6-b5ac-e4625268f595 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 8afddca2-dfeb-4ec2-862c-3267d4d0186c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:58.687120 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-364017dc-0fd5-42b6-b5ac-e4625268f595 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:18:58.694405 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-364017dc-0fd5-42b6-b5ac-e4625268f595 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c" status: 200 len: 1057 microversion: 2.1 time: 0.074712 Oct 17 14:18:58.694989 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3079/6023] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:58 2022] GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c => generated 1057 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:18:59.717950 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-acb84c90-5e39-48c6-af1a-d1768e466d7e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:59.719346 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-acb84c90-5e39-48c6-af1a-d1768e466d7e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 8afddca2-dfeb-4ec2-862c-3267d4d0186c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:59.726645 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-acb84c90-5e39-48c6-af1a-d1768e466d7e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:59.727127 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-acb84c90-5e39-48c6-af1a-d1768e466d7e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:59.727708 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-acb84c90-5e39-48c6-af1a-d1768e466d7e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:59.728569 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-acb84c90-5e39-48c6-af1a-d1768e466d7e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:59.729190 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-acb84c90-5e39-48c6-af1a-d1768e466d7e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:59.729616 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-acb84c90-5e39-48c6-af1a-d1768e466d7e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:59.813587 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-acb84c90-5e39-48c6-af1a-d1768e466d7e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:18:59.822016 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-acb84c90-5e39-48c6-af1a-d1768e466d7e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c" status: 200 len: 1127 microversion: 2.1 time: 0.109035 Oct 17 14:18:59.822619 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2945/6024] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:59 2022] GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c => generated 1127 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:19:00.846524 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-601a3e99-f152-40ae-ac7c-7007c2081fc0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:00.847807 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-601a3e99-f152-40ae-ac7c-7007c2081fc0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 8afddca2-dfeb-4ec2-862c-3267d4d0186c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:00.857726 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-601a3e99-f152-40ae-ac7c-7007c2081fc0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:00.858229 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-601a3e99-f152-40ae-ac7c-7007c2081fc0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:00.858671 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-601a3e99-f152-40ae-ac7c-7007c2081fc0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:00.859439 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-601a3e99-f152-40ae-ac7c-7007c2081fc0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:00.860120 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-601a3e99-f152-40ae-ac7c-7007c2081fc0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:00.860583 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-601a3e99-f152-40ae-ac7c-7007c2081fc0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:01.073733 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-601a3e99-f152-40ae-ac7c-7007c2081fc0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:01.082201 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-601a3e99-f152-40ae-ac7c-7007c2081fc0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c" status: 200 len: 1169 microversion: 2.1 time: 0.239789 Oct 17 14:19:01.082904 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3080/6025] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:00 2022] GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c => generated 1169 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:19:01.217247 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-397361a9-ed7d-45e5-9ede-b47de5907f08 req-93a6ba73-550f-4e2a-9079-6aa6fcf55c86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8afddca2-dfeb-4ec2-862c-3267d4d0186c", "tag": "0300fec4-82e8-49a5-ad7a-7f54bd853cbf"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:19:01.235982 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-397361a9-ed7d-45e5-9ede-b47de5907f08 req-93a6ba73-550f-4e2a-9079-6aa6fcf55c86 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:01.236762 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-397361a9-ed7d-45e5-9ede-b47de5907f08 req-93a6ba73-550f-4e2a-9079-6aa6fcf55c86 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:01.237436 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-397361a9-ed7d-45e5-9ede-b47de5907f08 req-93a6ba73-550f-4e2a-9079-6aa6fcf55c86 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:01.249524 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-397361a9-ed7d-45e5-9ede-b47de5907f08 req-93a6ba73-550f-4e2a-9079-6aa6fcf55c86 service nova] Creating event network-changed:0300fec4-82e8-49a5-ad7a-7f54bd853cbf for instance 8afddca2-dfeb-4ec2-862c-3267d4d0186c on n-h1-854247-14 Oct 17 14:19:01.255920 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-397361a9-ed7d-45e5-9ede-b47de5907f08 req-93a6ba73-550f-4e2a-9079-6aa6fcf55c86 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049998 Oct 17 14:19:01.257009 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2946/6026] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:19:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:19:02.106449 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e6607ca4-81e4-42b6-a88c-996a50d83be1 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:02.107068 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e6607ca4-81e4-42b6-a88c-996a50d83be1 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 8afddca2-dfeb-4ec2-862c-3267d4d0186c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:02.115985 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e6607ca4-81e4-42b6-a88c-996a50d83be1 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:02.116506 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e6607ca4-81e4-42b6-a88c-996a50d83be1 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:02.116944 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e6607ca4-81e4-42b6-a88c-996a50d83be1 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:02.117929 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e6607ca4-81e4-42b6-a88c-996a50d83be1 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:02.119054 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e6607ca4-81e4-42b6-a88c-996a50d83be1 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:02.119769 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e6607ca4-81e4-42b6-a88c-996a50d83be1 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:02.286792 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e6607ca4-81e4-42b6-a88c-996a50d83be1 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:02.295025 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e6607ca4-81e4-42b6-a88c-996a50d83be1 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c" status: 200 len: 1169 microversion: 2.1 time: 0.193797 Oct 17 14:19:02.295687 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3081/6027] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:02 2022] GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c => generated 1169 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:19:03.327670 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e729daef-b3bf-40b4-b12b-9cc08e459393 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:03.329698 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e729daef-b3bf-40b4-b12b-9cc08e459393 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 8afddca2-dfeb-4ec2-862c-3267d4d0186c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:03.352822 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e729daef-b3bf-40b4-b12b-9cc08e459393 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:03.354221 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e729daef-b3bf-40b4-b12b-9cc08e459393 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:03.355090 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e729daef-b3bf-40b4-b12b-9cc08e459393 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:03.357039 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e729daef-b3bf-40b4-b12b-9cc08e459393 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:03.357544 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e729daef-b3bf-40b4-b12b-9cc08e459393 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:03.358106 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e729daef-b3bf-40b4-b12b-9cc08e459393 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:03.601340 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e729daef-b3bf-40b4-b12b-9cc08e459393 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:03.611348 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e729daef-b3bf-40b4-b12b-9cc08e459393 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c" status: 200 len: 1169 microversion: 2.1 time: 0.296431 Oct 17 14:19:03.623691 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2947/6028] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:03 2022] GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c => generated 1169 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:19:04.636524 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fc0d9e55-f553-4dab-9f29-8932700437eb tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:04.637217 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-fc0d9e55-f553-4dab-9f29-8932700437eb tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 8afddca2-dfeb-4ec2-862c-3267d4d0186c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:04.645102 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fc0d9e55-f553-4dab-9f29-8932700437eb tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:04.645934 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fc0d9e55-f553-4dab-9f29-8932700437eb tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:04.646710 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fc0d9e55-f553-4dab-9f29-8932700437eb tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:04.647708 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fc0d9e55-f553-4dab-9f29-8932700437eb tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:04.648099 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fc0d9e55-f553-4dab-9f29-8932700437eb tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:04.648547 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fc0d9e55-f553-4dab-9f29-8932700437eb tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:04.841239 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fc0d9e55-f553-4dab-9f29-8932700437eb tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:04.857753 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fc0d9e55-f553-4dab-9f29-8932700437eb tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c" status: 200 len: 1169 microversion: 2.1 time: 0.224873 Oct 17 14:19:04.858642 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3082/6029] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:04 2022] GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c => generated 1169 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:19:05.884392 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-dfbdbb87-5c18-4ecb-b260-a74cd78efa71 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:05.884941 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-dfbdbb87-5c18-4ecb-b260-a74cd78efa71 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 8afddca2-dfeb-4ec2-862c-3267d4d0186c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:05.895373 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dfbdbb87-5c18-4ecb-b260-a74cd78efa71 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:05.895981 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dfbdbb87-5c18-4ecb-b260-a74cd78efa71 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:05.897514 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dfbdbb87-5c18-4ecb-b260-a74cd78efa71 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:05.898458 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dfbdbb87-5c18-4ecb-b260-a74cd78efa71 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:05.898932 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dfbdbb87-5c18-4ecb-b260-a74cd78efa71 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:05.899404 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dfbdbb87-5c18-4ecb-b260-a74cd78efa71 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:06.064970 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-dfbdbb87-5c18-4ecb-b260-a74cd78efa71 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:06.074252 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-dfbdbb87-5c18-4ecb-b260-a74cd78efa71 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c" status: 200 len: 1169 microversion: 2.1 time: 0.196145 Oct 17 14:19:06.087189 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2948/6030] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:05 2022] GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c => generated 1169 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:19:07.098292 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b20f780a-10f8-43f5-a640-68d97beb2a3e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:07.098928 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b20f780a-10f8-43f5-a640-68d97beb2a3e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 8afddca2-dfeb-4ec2-862c-3267d4d0186c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:07.106384 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b20f780a-10f8-43f5-a640-68d97beb2a3e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:07.106833 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b20f780a-10f8-43f5-a640-68d97beb2a3e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:07.107306 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b20f780a-10f8-43f5-a640-68d97beb2a3e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:07.108012 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b20f780a-10f8-43f5-a640-68d97beb2a3e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:07.108626 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b20f780a-10f8-43f5-a640-68d97beb2a3e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:07.109238 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b20f780a-10f8-43f5-a640-68d97beb2a3e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:07.248879 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b20f780a-10f8-43f5-a640-68d97beb2a3e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:07.257255 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b20f780a-10f8-43f5-a640-68d97beb2a3e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c" status: 200 len: 1169 microversion: 2.1 time: 0.163556 Oct 17 14:19:07.257911 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3083/6031] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:07 2022] GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c => generated 1169 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:19:08.284249 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c7040bdd-2e48-42bf-84b5-42f36872b8e5 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:08.285243 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c7040bdd-2e48-42bf-84b5-42f36872b8e5 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 8afddca2-dfeb-4ec2-862c-3267d4d0186c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:08.296823 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7040bdd-2e48-42bf-84b5-42f36872b8e5 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:08.297657 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7040bdd-2e48-42bf-84b5-42f36872b8e5 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:08.298369 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7040bdd-2e48-42bf-84b5-42f36872b8e5 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:08.299585 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7040bdd-2e48-42bf-84b5-42f36872b8e5 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:08.300324 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7040bdd-2e48-42bf-84b5-42f36872b8e5 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:08.301013 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7040bdd-2e48-42bf-84b5-42f36872b8e5 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:08.440592 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c7040bdd-2e48-42bf-84b5-42f36872b8e5 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:08.449025 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c7040bdd-2e48-42bf-84b5-42f36872b8e5 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c" status: 200 len: 1169 microversion: 2.1 time: 0.171335 Oct 17 14:19:08.449620 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2949/6032] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:08 2022] GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c => generated 1169 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:19:09.472678 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f4b6622a-6cdd-4e9c-8caf-7a41ba94ed91 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:09.473269 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f4b6622a-6cdd-4e9c-8caf-7a41ba94ed91 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 8afddca2-dfeb-4ec2-862c-3267d4d0186c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:09.476336 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:19:09.482343 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f4b6622a-6cdd-4e9c-8caf-7a41ba94ed91 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:09.482836 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f4b6622a-6cdd-4e9c-8caf-7a41ba94ed91 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:09.483339 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f4b6622a-6cdd-4e9c-8caf-7a41ba94ed91 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:09.483994 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f4b6622a-6cdd-4e9c-8caf-7a41ba94ed91 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:09.484588 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f4b6622a-6cdd-4e9c-8caf-7a41ba94ed91 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:09.485017 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f4b6622a-6cdd-4e9c-8caf-7a41ba94ed91 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:09.634444 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f4b6622a-6cdd-4e9c-8caf-7a41ba94ed91 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:09.642118 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f4b6622a-6cdd-4e9c-8caf-7a41ba94ed91 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c" status: 200 len: 1169 microversion: 2.1 time: 0.173410 Oct 17 14:19:09.642693 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3084/6033] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:09 2022] GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c => generated 1169 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:19:10.665475 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2da1799e-f595-4aff-83c7-baf81c537a76 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:10.666100 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2da1799e-f595-4aff-83c7-baf81c537a76 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 8afddca2-dfeb-4ec2-862c-3267d4d0186c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:10.668156 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:19:10.668858 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=6 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:19:10.675556 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2da1799e-f595-4aff-83c7-baf81c537a76 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:10.676032 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2da1799e-f595-4aff-83c7-baf81c537a76 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:10.676547 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2da1799e-f595-4aff-83c7-baf81c537a76 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:10.677254 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2da1799e-f595-4aff-83c7-baf81c537a76 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:10.677721 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2da1799e-f595-4aff-83c7-baf81c537a76 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:10.678132 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2da1799e-f595-4aff-83c7-baf81c537a76 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:10.681045 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=70 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:19:11.086427 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2da1799e-f595-4aff-83c7-baf81c537a76 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:11.095298 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2da1799e-f595-4aff-83c7-baf81c537a76 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c" status: 200 len: 1169 microversion: 2.1 time: 0.433222 Oct 17 14:19:11.095298 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2950/6034] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:10 2022] GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c => generated 1169 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:19:12.117966 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3cb1d6ae-d675-42eb-9329-135108040099 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:12.118638 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3cb1d6ae-d675-42eb-9329-135108040099 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 8afddca2-dfeb-4ec2-862c-3267d4d0186c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:12.126174 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3cb1d6ae-d675-42eb-9329-135108040099 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:12.126713 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3cb1d6ae-d675-42eb-9329-135108040099 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:12.127315 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3cb1d6ae-d675-42eb-9329-135108040099 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:12.127899 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3cb1d6ae-d675-42eb-9329-135108040099 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:12.128348 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3cb1d6ae-d675-42eb-9329-135108040099 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:12.128763 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3cb1d6ae-d675-42eb-9329-135108040099 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:12.266179 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3cb1d6ae-d675-42eb-9329-135108040099 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:12.274545 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3cb1d6ae-d675-42eb-9329-135108040099 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c" status: 200 len: 1169 microversion: 2.1 time: 0.160877 Oct 17 14:19:12.275323 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3085/6035] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:12 2022] GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c => generated 1169 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:19:13.298126 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7405d2e4-7534-4a13-8f81-1fe26ab9ae74 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:13.298731 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7405d2e4-7534-4a13-8f81-1fe26ab9ae74 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 8afddca2-dfeb-4ec2-862c-3267d4d0186c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:13.301668 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:19:13.308944 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7405d2e4-7534-4a13-8f81-1fe26ab9ae74 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:13.309445 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7405d2e4-7534-4a13-8f81-1fe26ab9ae74 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:13.309928 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7405d2e4-7534-4a13-8f81-1fe26ab9ae74 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:13.310647 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7405d2e4-7534-4a13-8f81-1fe26ab9ae74 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:13.311095 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7405d2e4-7534-4a13-8f81-1fe26ab9ae74 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:13.311572 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7405d2e4-7534-4a13-8f81-1fe26ab9ae74 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:13.453796 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7405d2e4-7534-4a13-8f81-1fe26ab9ae74 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:13.462080 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7405d2e4-7534-4a13-8f81-1fe26ab9ae74 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c" status: 200 len: 1169 microversion: 2.1 time: 0.168205 Oct 17 14:19:13.462640 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2951/6036] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:13 2022] GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c => generated 1169 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:19:14.485346 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2819badc-f53e-4370-ac12-74f95cd0a8d5 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:14.486060 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2819badc-f53e-4370-ac12-74f95cd0a8d5 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 8afddca2-dfeb-4ec2-862c-3267d4d0186c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:14.493410 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2819badc-f53e-4370-ac12-74f95cd0a8d5 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:14.493897 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2819badc-f53e-4370-ac12-74f95cd0a8d5 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:14.494326 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2819badc-f53e-4370-ac12-74f95cd0a8d5 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:14.495021 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2819badc-f53e-4370-ac12-74f95cd0a8d5 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:14.495501 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2819badc-f53e-4370-ac12-74f95cd0a8d5 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:14.495966 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2819badc-f53e-4370-ac12-74f95cd0a8d5 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:14.632892 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2819badc-f53e-4370-ac12-74f95cd0a8d5 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:14.642005 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2819badc-f53e-4370-ac12-74f95cd0a8d5 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c" status: 200 len: 1203 microversion: 2.1 time: 0.160713 Oct 17 14:19:14.642589 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3086/6037] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:14 2022] GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c => generated 1203 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:19:15.008809 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-24eb4455-781e-4820-8d5d-d0d513335b98 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:19:15.011081 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-24eb4455-781e-4820-8d5d-d0d513335b98 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e7405fc0-937a-4256-8d0c-95acd35ebc97] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:15.018371 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-24eb4455-781e-4820-8d5d-d0d513335b98 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:15.018860 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-24eb4455-781e-4820-8d5d-d0d513335b98 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:15.019338 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-24eb4455-781e-4820-8d5d-d0d513335b98 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:15.020032 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-24eb4455-781e-4820-8d5d-d0d513335b98 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:15.020483 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-24eb4455-781e-4820-8d5d-d0d513335b98 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:15.020909 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-24eb4455-781e-4820-8d5d-d0d513335b98 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:15.077669 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-24eb4455-781e-4820-8d5d-d0d513335b98 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "POST /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97/action" status: 200 len: 63052 microversion: 2.1 time: 0.072611 Oct 17 14:19:15.078326 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2952/6038] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:19:15 2022] POST /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97/action => generated 63052 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:19:15.666840 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cc277f1d-d582-4c8a-872a-f72486beb39f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:15.667505 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cc277f1d-d582-4c8a-872a-f72486beb39f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 8afddca2-dfeb-4ec2-862c-3267d4d0186c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:15.674910 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cc277f1d-d582-4c8a-872a-f72486beb39f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:15.675445 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cc277f1d-d582-4c8a-872a-f72486beb39f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:15.675884 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cc277f1d-d582-4c8a-872a-f72486beb39f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:15.676591 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cc277f1d-d582-4c8a-872a-f72486beb39f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:15.677045 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cc277f1d-d582-4c8a-872a-f72486beb39f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:15.677468 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cc277f1d-d582-4c8a-872a-f72486beb39f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:15.682293 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:19:15.818902 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cc277f1d-d582-4c8a-872a-f72486beb39f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:15.827119 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cc277f1d-d582-4c8a-872a-f72486beb39f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c" status: 200 len: 1203 microversion: 2.1 time: 0.164798 Oct 17 14:19:15.827731 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3087/6039] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:15 2022] GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c => generated 1203 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:19:16.854286 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f247fe0d-f977-4aa5-82f2-97ecd26b054d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:16.855282 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f247fe0d-f977-4aa5-82f2-97ecd26b054d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 8afddca2-dfeb-4ec2-862c-3267d4d0186c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:16.865001 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f247fe0d-f977-4aa5-82f2-97ecd26b054d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:16.865637 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f247fe0d-f977-4aa5-82f2-97ecd26b054d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:16.866218 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f247fe0d-f977-4aa5-82f2-97ecd26b054d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:16.867133 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f247fe0d-f977-4aa5-82f2-97ecd26b054d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:16.867770 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f247fe0d-f977-4aa5-82f2-97ecd26b054d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:16.868328 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f247fe0d-f977-4aa5-82f2-97ecd26b054d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:17.006989 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f247fe0d-f977-4aa5-82f2-97ecd26b054d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:17.015268 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f247fe0d-f977-4aa5-82f2-97ecd26b054d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c" status: 200 len: 1203 microversion: 2.1 time: 0.167221 Oct 17 14:19:17.015835 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2953/6040] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:16 2022] GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c => generated 1203 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:19:18.040975 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3909b394-4453-4b00-9fc1-f33d99820540 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:18.041902 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3909b394-4453-4b00-9fc1-f33d99820540 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 8afddca2-dfeb-4ec2-862c-3267d4d0186c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:18.051631 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3909b394-4453-4b00-9fc1-f33d99820540 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:18.052265 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3909b394-4453-4b00-9fc1-f33d99820540 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:18.053124 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3909b394-4453-4b00-9fc1-f33d99820540 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:18.053824 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3909b394-4453-4b00-9fc1-f33d99820540 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:18.054272 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3909b394-4453-4b00-9fc1-f33d99820540 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:18.054673 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3909b394-4453-4b00-9fc1-f33d99820540 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:18.191272 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3909b394-4453-4b00-9fc1-f33d99820540 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:18.200097 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3909b394-4453-4b00-9fc1-f33d99820540 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c" status: 200 len: 1203 microversion: 2.1 time: 0.164600 Oct 17 14:19:18.200679 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3088/6041] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:18 2022] GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c => generated 1203 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:19:19.225966 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-77b47b16-8f59-4b8d-8e39-5057398f7d97 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:19.226640 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-77b47b16-8f59-4b8d-8e39-5057398f7d97 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 8afddca2-dfeb-4ec2-862c-3267d4d0186c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:19.234723 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-77b47b16-8f59-4b8d-8e39-5057398f7d97 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:19.235208 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-77b47b16-8f59-4b8d-8e39-5057398f7d97 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:19.235686 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-77b47b16-8f59-4b8d-8e39-5057398f7d97 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:19.236382 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-77b47b16-8f59-4b8d-8e39-5057398f7d97 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:19.237248 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-77b47b16-8f59-4b8d-8e39-5057398f7d97 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:19.237680 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-77b47b16-8f59-4b8d-8e39-5057398f7d97 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:19.376473 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-77b47b16-8f59-4b8d-8e39-5057398f7d97 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:19.387057 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-77b47b16-8f59-4b8d-8e39-5057398f7d97 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c" status: 200 len: 1203 microversion: 2.1 time: 0.167477 Oct 17 14:19:19.387639 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2954/6042] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:19 2022] GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c => generated 1203 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:19:20.414055 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2c67485a-6f29-4b8a-a990-d9ef24d152c8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:20.414612 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2c67485a-6f29-4b8a-a990-d9ef24d152c8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 8afddca2-dfeb-4ec2-862c-3267d4d0186c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:20.417441 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=26 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:19:20.423385 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2c67485a-6f29-4b8a-a990-d9ef24d152c8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:20.423865 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2c67485a-6f29-4b8a-a990-d9ef24d152c8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:20.424293 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2c67485a-6f29-4b8a-a990-d9ef24d152c8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:20.424985 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2c67485a-6f29-4b8a-a990-d9ef24d152c8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:20.425426 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2c67485a-6f29-4b8a-a990-d9ef24d152c8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:20.425844 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2c67485a-6f29-4b8a-a990-d9ef24d152c8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:20.576155 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2c67485a-6f29-4b8a-a990-d9ef24d152c8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:20.584874 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2c67485a-6f29-4b8a-a990-d9ef24d152c8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c" status: 200 len: 1203 microversion: 2.1 time: 0.177367 Oct 17 14:19:20.585473 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3089/6043] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:20 2022] GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c => generated 1203 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:19:21.299378 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d031b864-09d8-4d1b-ae70-b567f125767c tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:21.300345 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d031b864-09d8-4d1b-ae70-b567f125767c tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] [instance: e7405fc0-937a-4256-8d0c-95acd35ebc97] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:21.312781 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d031b864-09d8-4d1b-ae70-b567f125767c tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:21.313520 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d031b864-09d8-4d1b-ae70-b567f125767c tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:21.314378 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d031b864-09d8-4d1b-ae70-b567f125767c tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:21.315597 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d031b864-09d8-4d1b-ae70-b567f125767c tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:21.316295 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d031b864-09d8-4d1b-ae70-b567f125767c tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:21.316958 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d031b864-09d8-4d1b-ae70-b567f125767c tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:21.458333 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d031b864-09d8-4d1b-ae70-b567f125767c tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97" status: 200 len: 1834 microversion: 2.1 time: 0.165129 Oct 17 14:19:21.459248 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2955/6044] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:21 2022] GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97 => generated 1834 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:19:21.608201 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4855c7ab-856f-443d-9718-19c124019a49 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:21.608808 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4855c7ab-856f-443d-9718-19c124019a49 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 8afddca2-dfeb-4ec2-862c-3267d4d0186c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:21.616312 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4855c7ab-856f-443d-9718-19c124019a49 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:21.616812 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4855c7ab-856f-443d-9718-19c124019a49 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:21.617252 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4855c7ab-856f-443d-9718-19c124019a49 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:21.617968 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4855c7ab-856f-443d-9718-19c124019a49 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:21.618425 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4855c7ab-856f-443d-9718-19c124019a49 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:21.618840 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4855c7ab-856f-443d-9718-19c124019a49 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:21.753528 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4855c7ab-856f-443d-9718-19c124019a49 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:21.762354 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4855c7ab-856f-443d-9718-19c124019a49 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c" status: 200 len: 1203 microversion: 2.1 time: 0.158098 Oct 17 14:19:21.763235 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3090/6045] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:21 2022] GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c => generated 1203 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:19:22.726577 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d624547a-a027-4813-a9dd-76794e61f84d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:22.727090 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d624547a-a027-4813-a9dd-76794e61f84d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e7405fc0-937a-4256-8d0c-95acd35ebc97] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:22.732246 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-5a20d82f-dfd3-4ff9-89af-cce69f7fc8a4 req-f49bfd36-e886-4058-afb0-f5e0eb1e34f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7405fc0-937a-4256-8d0c-95acd35ebc97", "tag": "416db0e1-9273-4dba-a586-13951c2b8257"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:19:22.742668 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d624547a-a027-4813-a9dd-76794e61f84d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:22.743077 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d624547a-a027-4813-a9dd-76794e61f84d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:22.743564 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d624547a-a027-4813-a9dd-76794e61f84d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:22.744281 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d624547a-a027-4813-a9dd-76794e61f84d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:22.744715 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d624547a-a027-4813-a9dd-76794e61f84d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:22.745153 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d624547a-a027-4813-a9dd-76794e61f84d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:22.746904 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-5a20d82f-dfd3-4ff9-89af-cce69f7fc8a4 req-f49bfd36-e886-4058-afb0-f5e0eb1e34f2 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:22.747427 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-5a20d82f-dfd3-4ff9-89af-cce69f7fc8a4 req-f49bfd36-e886-4058-afb0-f5e0eb1e34f2 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:22.747848 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-5a20d82f-dfd3-4ff9-89af-cce69f7fc8a4 req-f49bfd36-e886-4058-afb0-f5e0eb1e34f2 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:22.759678 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-5a20d82f-dfd3-4ff9-89af-cce69f7fc8a4 req-f49bfd36-e886-4058-afb0-f5e0eb1e34f2 service nova] Creating event network-changed:416db0e1-9273-4dba-a586-13951c2b8257 for instance e7405fc0-937a-4256-8d0c-95acd35ebc97 on n-h2-854247-14 Oct 17 14:19:22.764892 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-5a20d82f-dfd3-4ff9-89af-cce69f7fc8a4 req-f49bfd36-e886-4058-afb0-f5e0eb1e34f2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036388 Oct 17 14:19:22.765709 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3091/6046] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:19:22.773661 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d624547a-a027-4813-a9dd-76794e61f84d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e7405fc0-937a-4256-8d0c-95acd35ebc97] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:19:22.786198 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b7002dd3-79ad-4438-a406-7b4756d4ae56 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:22.787208 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b7002dd3-79ad-4438-a406-7b4756d4ae56 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 8afddca2-dfeb-4ec2-862c-3267d4d0186c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:22.794062 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b7002dd3-79ad-4438-a406-7b4756d4ae56 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:22.794815 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b7002dd3-79ad-4438-a406-7b4756d4ae56 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:22.795439 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b7002dd3-79ad-4438-a406-7b4756d4ae56 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:22.796315 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b7002dd3-79ad-4438-a406-7b4756d4ae56 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:22.796915 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b7002dd3-79ad-4438-a406-7b4756d4ae56 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:22.797486 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b7002dd3-79ad-4438-a406-7b4756d4ae56 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:22.880291 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d624547a-a027-4813-a9dd-76794e61f84d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "DELETE /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97" status: 204 len: 0 microversion: 2.1 time: 0.157496 Oct 17 14:19:22.882492 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2956/6047] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:19:22 2022] DELETE /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:19:22.891553 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-afd974b0-9cd7-4300-a860-77f49f6ee3b4 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:22.892235 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-afd974b0-9cd7-4300-a860-77f49f6ee3b4 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e7405fc0-937a-4256-8d0c-95acd35ebc97] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:22.898824 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-afd974b0-9cd7-4300-a860-77f49f6ee3b4 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:22.899356 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-afd974b0-9cd7-4300-a860-77f49f6ee3b4 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:22.899798 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-afd974b0-9cd7-4300-a860-77f49f6ee3b4 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:22.900513 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-afd974b0-9cd7-4300-a860-77f49f6ee3b4 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:22.900967 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-afd974b0-9cd7-4300-a860-77f49f6ee3b4 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:22.901565 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-afd974b0-9cd7-4300-a860-77f49f6ee3b4 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:23.069995 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b7002dd3-79ad-4438-a406-7b4756d4ae56 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:23.078799 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b7002dd3-79ad-4438-a406-7b4756d4ae56 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c" status: 200 len: 1203 microversion: 2.1 time: 0.296660 Oct 17 14:19:23.079547 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3092/6048] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:22 2022] GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c => generated 1203 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:19:23.122641 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-afd974b0-9cd7-4300-a860-77f49f6ee3b4 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:23.130826 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-afd974b0-9cd7-4300-a860-77f49f6ee3b4 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97" status: 200 len: 1687 microversion: 2.1 time: 0.243804 Oct 17 14:19:23.131473 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2957/6049] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:22 2022] GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97 => generated 1687 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:19:24.108931 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-bd469023-f926-4a58-a508-c63a0ed5df08 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:24.109497 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-bd469023-f926-4a58-a508-c63a0ed5df08 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 8afddca2-dfeb-4ec2-862c-3267d4d0186c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:24.117037 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bd469023-f926-4a58-a508-c63a0ed5df08 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:24.117524 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bd469023-f926-4a58-a508-c63a0ed5df08 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:24.117969 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bd469023-f926-4a58-a508-c63a0ed5df08 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:24.118671 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bd469023-f926-4a58-a508-c63a0ed5df08 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:24.119123 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bd469023-f926-4a58-a508-c63a0ed5df08 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:24.119567 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bd469023-f926-4a58-a508-c63a0ed5df08 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:24.154200 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-35dcabbd-3dc9-4056-9ce8-a7fe0a15f410 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:24.154913 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-35dcabbd-3dc9-4056-9ce8-a7fe0a15f410 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e7405fc0-937a-4256-8d0c-95acd35ebc97] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:24.162790 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-35dcabbd-3dc9-4056-9ce8-a7fe0a15f410 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:24.163290 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-35dcabbd-3dc9-4056-9ce8-a7fe0a15f410 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:24.163816 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-35dcabbd-3dc9-4056-9ce8-a7fe0a15f410 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:24.165248 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-35dcabbd-3dc9-4056-9ce8-a7fe0a15f410 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:24.165716 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-35dcabbd-3dc9-4056-9ce8-a7fe0a15f410 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:24.166137 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-35dcabbd-3dc9-4056-9ce8-a7fe0a15f410 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:24.508826 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-bd469023-f926-4a58-a508-c63a0ed5df08 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:24.518746 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-bd469023-f926-4a58-a508-c63a0ed5df08 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c" status: 200 len: 1203 microversion: 2.1 time: 0.413737 Oct 17 14:19:24.520136 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3093/6050] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:24 2022] GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c => generated 1203 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:19:24.526310 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-2cda9779-6fcf-485d-9918-9e71cadfd306 req-e8f897a0-2884-4b68-9015-c472ef9b8ca7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8afddca2-dfeb-4ec2-862c-3267d4d0186c", "name": "network-vif-plugged", "status": "completed", "tag": "0300fec4-82e8-49a5-ad7a-7f54bd853cbf"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:19:24.536169 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-2cda9779-6fcf-485d-9918-9e71cadfd306 req-e8f897a0-2884-4b68-9015-c472ef9b8ca7 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:24.536647 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-2cda9779-6fcf-485d-9918-9e71cadfd306 req-e8f897a0-2884-4b68-9015-c472ef9b8ca7 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:24.537079 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-2cda9779-6fcf-485d-9918-9e71cadfd306 req-e8f897a0-2884-4b68-9015-c472ef9b8ca7 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:24.549265 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-2cda9779-6fcf-485d-9918-9e71cadfd306 req-e8f897a0-2884-4b68-9015-c472ef9b8ca7 service nova] Creating event network-vif-plugged:0300fec4-82e8-49a5-ad7a-7f54bd853cbf for instance 8afddca2-dfeb-4ec2-862c-3267d4d0186c on n-h1-854247-14 Oct 17 14:19:24.554551 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-2cda9779-6fcf-485d-9918-9e71cadfd306 req-e8f897a0-2884-4b68-9015-c472ef9b8ca7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032104 Oct 17 14:19:24.555381 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3094/6051] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:19:24.585165 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-35dcabbd-3dc9-4056-9ce8-a7fe0a15f410 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:24.594076 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-35dcabbd-3dc9-4056-9ce8-a7fe0a15f410 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97" status: 200 len: 1687 microversion: 2.1 time: 0.443695 Oct 17 14:19:24.594845 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2958/6052] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:24 2022] GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97 => generated 1687 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:19:25.302333 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-c2a41450-2244-436a-a8cc-3bba6eec216a req-bcf0ebdf-2b86-401d-be1c-ada60dedd6bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7405fc0-937a-4256-8d0c-95acd35ebc97", "name": "network-vif-deleted", "tag": "416db0e1-9273-4dba-a586-13951c2b8257"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:19:25.313009 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-c2a41450-2244-436a-a8cc-3bba6eec216a req-bcf0ebdf-2b86-401d-be1c-ada60dedd6bc service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:25.313480 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-c2a41450-2244-436a-a8cc-3bba6eec216a req-bcf0ebdf-2b86-401d-be1c-ada60dedd6bc service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:25.313896 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-c2a41450-2244-436a-a8cc-3bba6eec216a req-bcf0ebdf-2b86-401d-be1c-ada60dedd6bc service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:25.325663 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-c2a41450-2244-436a-a8cc-3bba6eec216a req-bcf0ebdf-2b86-401d-be1c-ada60dedd6bc service nova] Creating event network-vif-deleted:416db0e1-9273-4dba-a586-13951c2b8257 for instance e7405fc0-937a-4256-8d0c-95acd35ebc97 on n-h2-854247-14 Oct 17 14:19:25.330661 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-c2a41450-2244-436a-a8cc-3bba6eec216a req-bcf0ebdf-2b86-401d-be1c-ada60dedd6bc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033417 Oct 17 14:19:25.331281 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3095/6053] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:19:25.542610 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a0b7007d-bbf0-4870-9828-5d3b8a151ef3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:25.543221 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a0b7007d-bbf0-4870-9828-5d3b8a151ef3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 8afddca2-dfeb-4ec2-862c-3267d4d0186c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:25.550773 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a0b7007d-bbf0-4870-9828-5d3b8a151ef3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:25.551295 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a0b7007d-bbf0-4870-9828-5d3b8a151ef3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:25.551735 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a0b7007d-bbf0-4870-9828-5d3b8a151ef3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:25.552421 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a0b7007d-bbf0-4870-9828-5d3b8a151ef3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:25.553053 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a0b7007d-bbf0-4870-9828-5d3b8a151ef3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:25.553543 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a0b7007d-bbf0-4870-9828-5d3b8a151ef3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:25.619432 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-77ddd159-67ad-41e7-b79f-0b994933d4f6 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:25.620426 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-77ddd159-67ad-41e7-b79f-0b994933d4f6 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e7405fc0-937a-4256-8d0c-95acd35ebc97] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:25.627366 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-77ddd159-67ad-41e7-b79f-0b994933d4f6 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:25.627872 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-77ddd159-67ad-41e7-b79f-0b994933d4f6 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:25.628301 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-77ddd159-67ad-41e7-b79f-0b994933d4f6 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:25.629000 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-77ddd159-67ad-41e7-b79f-0b994933d4f6 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:25.629426 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-77ddd159-67ad-41e7-b79f-0b994933d4f6 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:25.630015 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-77ddd159-67ad-41e7-b79f-0b994933d4f6 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:25.679440 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-77ddd159-67ad-41e7-b79f-0b994933d4f6 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:25.679934 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-77ddd159-67ad-41e7-b79f-0b994933d4f6 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:25.680540 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-77ddd159-67ad-41e7-b79f-0b994933d4f6 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:25.681003 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-77ddd159-67ad-41e7-b79f-0b994933d4f6 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lazy-loading 'fault' on Instance uuid e7405fc0-937a-4256-8d0c-95acd35ebc97 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:19:25.697202 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a0b7007d-bbf0-4870-9828-5d3b8a151ef3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:25.715804 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a0b7007d-bbf0-4870-9828-5d3b8a151ef3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c" status: 200 len: 1203 microversion: 2.1 time: 0.176913 Oct 17 14:19:25.717241 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2959/6054] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:25 2022] GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c => generated 1203 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:19:25.735085 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-77ddd159-67ad-41e7-b79f-0b994933d4f6 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:25.744980 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-77ddd159-67ad-41e7-b79f-0b994933d4f6 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97" status: 200 len: 1356 microversion: 2.1 time: 0.130431 Oct 17 14:19:25.745682 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3096/6055] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:25 2022] GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97 => generated 1356 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:19:26.744195 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d4b1eb16-4e1b-4113-b8ac-76f55d79d824 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:26.744830 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d4b1eb16-4e1b-4113-b8ac-76f55d79d824 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 8afddca2-dfeb-4ec2-862c-3267d4d0186c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:26.752564 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d4b1eb16-4e1b-4113-b8ac-76f55d79d824 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:26.753070 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d4b1eb16-4e1b-4113-b8ac-76f55d79d824 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:26.753527 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d4b1eb16-4e1b-4113-b8ac-76f55d79d824 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:26.754249 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d4b1eb16-4e1b-4113-b8ac-76f55d79d824 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:26.754716 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d4b1eb16-4e1b-4113-b8ac-76f55d79d824 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:26.755155 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d4b1eb16-4e1b-4113-b8ac-76f55d79d824 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:26.771361 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-af79ed1f-4077-40ce-9a60-7bf5b80f30ca tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:26.771955 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-af79ed1f-4077-40ce-9a60-7bf5b80f30ca tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e7405fc0-937a-4256-8d0c-95acd35ebc97] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:26.779975 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af79ed1f-4077-40ce-9a60-7bf5b80f30ca tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:26.780489 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af79ed1f-4077-40ce-9a60-7bf5b80f30ca tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:26.780937 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af79ed1f-4077-40ce-9a60-7bf5b80f30ca tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:26.781666 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af79ed1f-4077-40ce-9a60-7bf5b80f30ca tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:26.782170 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af79ed1f-4077-40ce-9a60-7bf5b80f30ca tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:26.782785 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af79ed1f-4077-40ce-9a60-7bf5b80f30ca tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:26.797314 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-af79ed1f-4077-40ce-9a60-7bf5b80f30ca tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] HTTP exception thrown: Instance e7405fc0-937a-4256-8d0c-95acd35ebc97 could not be found. Oct 17 14:19:26.799216 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-af79ed1f-4077-40ce-9a60-7bf5b80f30ca tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Request method failure captured: Oct 17 14:19:26.799216 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97 HTTP/1.1 Oct 17 14:19:26.799216 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 14:19:26.799216 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 14:19:26.799216 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 14:19:26.799216 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 14:19:26.799216 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 14:19:26.799216 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 14:19:26.799216 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 14:19:26.799216 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 14:19:26.799216 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTWN_WrnZNIuDTcmCFjSsEmdvqNJb4iEetQ3NxsmaqSa1gwOg9ZMQNLgw9m4eq9PNIu6JcojHQuHnBeD-_gAkuh_GorIQhe3sJ55RCndYbwHTO1kgdWN1Q2vFJpwxSY5RixlKnQqd0DcKtCXSNr1JwLh4U5fWK7dcxbe5fH3jeWLj4Sg Oct 17 14:19:26.799216 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 14:19:26.799216 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 14:19:26.799216 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 14:19:26.799216 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 14:19:26.799216 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 14:19:26.799216 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 14:19:26.799216 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: b8c8fe6f805f43798c9910296df4b8ab Oct 17 14:19:26.799216 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1095470143 Oct 17 14:19:26.799216 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 14:19:26.799216 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 14:19:26.799216 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b8c8fe6f805f43798c9910296df4b8ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b8c8fe6f805f43798c9910296df4b8ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b8c8fe6f805f43798c9910296df4b8ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b8c8fe6f805f43798c9910296df4b8ab", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:19:26.799216 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1095470143 Oct 17 14:19:26.799216 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: b8c8fe6f805f43798c9910296df4b8ab Oct 17 14:19:26.799216 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1095470143 Oct 17 14:19:26.799216 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-TestNetworkAdvancedServerOps-1095470143-project Oct 17 14:19:26.799216 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 14:19:26.799216 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 14:19:26.799216 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 024275cf6f8d423992e61d92dea927ba Oct 17 14:19:26.799216 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1095470143-project Oct 17 14:19:26.799216 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 14:19:26.799216 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance e7405fc0-937a-4256-8d0c-95acd35ebc97 could not be found. Oct 17 14:19:26.799216 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'e7405fc0-937a-4256-8d0c-95acd35ebc97'} Oct 17 14:19:26.799216 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:19:26.799216 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:19:26.799216 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:19:26.799216 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:19:26.799216 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:19:26.799216 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:19:26.799216 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:19:26.799216 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:19:26.799216 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:19:26.799216 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:19:26.799216 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7405fc0-937a-4256-8d0c-95acd35ebc97 could not be found. Oct 17 14:19:26.799216 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:19:26.799216 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:19:26.799216 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:19:26.799216 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:19:26.799216 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:19:26.799216 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:19:26.799216 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:19:26.799216 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:19:26.799216 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:19:26.799216 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:19:26.799216 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:19:26.799216 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:19:26.799216 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:19:26.799216 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:19:26.799216 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:19:26.799216 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:19:26.799216 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7405fc0-937a-4256-8d0c-95acd35ebc97 could not be found. Oct 17 14:19:26.799216 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:19:26.799216 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:19:26.802855 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:19:26.802855 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:19:26.802855 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:19:26.802855 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:19:26.802855 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:19:26.802855 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:19:26.802855 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7405fc0-937a-4256-8d0c-95acd35ebc97 could not be found. Oct 17 14:19:26.802855 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:19:26.802855 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-af79ed1f-4077-40ce-9a60-7bf5b80f30ca tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Returning 404 to user: Instance e7405fc0-937a-4256-8d0c-95acd35ebc97 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:19:26.802855 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-af79ed1f-4077-40ce-9a60-7bf5b80f30ca tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97" status: 404 len: 111 microversion: 2.1 time: 0.033301 Oct 17 14:19:26.802855 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3097/6056] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:26 2022] GET /compute/v2.1/servers/e7405fc0-937a-4256-8d0c-95acd35ebc97 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:19:26.900277 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d4b1eb16-4e1b-4113-b8ac-76f55d79d824 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:26.911013 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d4b1eb16-4e1b-4113-b8ac-76f55d79d824 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c" status: 200 len: 1391 microversion: 2.1 time: 0.170959 Oct 17 14:19:26.911777 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2960/6057] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:26 2022] GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c => generated 1391 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:19:26.934349 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-41df18ec-6d78-4559-a504-afc9d6453a49 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:26.934956 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-41df18ec-6d78-4559-a504-afc9d6453a49 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 8afddca2-dfeb-4ec2-862c-3267d4d0186c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:26.941219 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-41df18ec-6d78-4559-a504-afc9d6453a49 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:26.941694 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-41df18ec-6d78-4559-a504-afc9d6453a49 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:26.942122 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-41df18ec-6d78-4559-a504-afc9d6453a49 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:26.942804 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-41df18ec-6d78-4559-a504-afc9d6453a49 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:26.943281 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-41df18ec-6d78-4559-a504-afc9d6453a49 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:26.943691 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-41df18ec-6d78-4559-a504-afc9d6453a49 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:27.077902 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-41df18ec-6d78-4559-a504-afc9d6453a49 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:27.087011 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-41df18ec-6d78-4559-a504-afc9d6453a49 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c" status: 200 len: 1391 microversion: 2.1 time: 0.156818 Oct 17 14:19:27.088182 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3098/6058] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:26 2022] GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:19:27.109796 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-445a7d9e-38fb-4b42-9cbc-731833b43c53 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:27.110410 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-445a7d9e-38fb-4b42-9cbc-731833b43c53 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 8afddca2-dfeb-4ec2-862c-3267d4d0186c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:27.116941 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-445a7d9e-38fb-4b42-9cbc-731833b43c53 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:27.117564 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-445a7d9e-38fb-4b42-9cbc-731833b43c53 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:27.117994 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-445a7d9e-38fb-4b42-9cbc-731833b43c53 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:27.118726 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-445a7d9e-38fb-4b42-9cbc-731833b43c53 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:27.119194 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-445a7d9e-38fb-4b42-9cbc-731833b43c53 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:27.119625 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-445a7d9e-38fb-4b42-9cbc-731833b43c53 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:27.263597 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-445a7d9e-38fb-4b42-9cbc-731833b43c53 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:27.271773 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-445a7d9e-38fb-4b42-9cbc-731833b43c53 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c" status: 200 len: 1391 microversion: 2.1 time: 0.165930 Oct 17 14:19:27.274853 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2961/6059] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:27 2022] GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c => generated 1391 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:19:27.359084 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-71bc11c6-8722-4e3b-b579-42823454e794 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:27.359617 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-71bc11c6-8722-4e3b-b579-42823454e794 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 8afddca2-dfeb-4ec2-862c-3267d4d0186c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:27.366293 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-71bc11c6-8722-4e3b-b579-42823454e794 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:27.366839 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-71bc11c6-8722-4e3b-b579-42823454e794 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:27.367300 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-71bc11c6-8722-4e3b-b579-42823454e794 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:27.367997 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-71bc11c6-8722-4e3b-b579-42823454e794 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:27.368446 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-71bc11c6-8722-4e3b-b579-42823454e794 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:27.368863 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-71bc11c6-8722-4e3b-b579-42823454e794 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:27.395828 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-71bc11c6-8722-4e3b-b579-42823454e794 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 8afddca2-dfeb-4ec2-862c-3267d4d0186c] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:19:27.481195 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-71bc11c6-8722-4e3b-b579-42823454e794 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "DELETE /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c" status: 204 len: 0 microversion: 2.1 time: 0.125859 Oct 17 14:19:27.482078 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3099/6060] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:19:27 2022] DELETE /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:19:27.491239 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-40c72de3-6d8e-4f79-905d-943f24bf784c tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:27.491893 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-40c72de3-6d8e-4f79-905d-943f24bf784c tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 8afddca2-dfeb-4ec2-862c-3267d4d0186c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:27.497840 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-40c72de3-6d8e-4f79-905d-943f24bf784c tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:27.498329 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-40c72de3-6d8e-4f79-905d-943f24bf784c tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:27.498759 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-40c72de3-6d8e-4f79-905d-943f24bf784c tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:27.499486 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-40c72de3-6d8e-4f79-905d-943f24bf784c tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:27.499937 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-40c72de3-6d8e-4f79-905d-943f24bf784c tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:27.500358 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-40c72de3-6d8e-4f79-905d-943f24bf784c tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:27.629062 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-40c72de3-6d8e-4f79-905d-943f24bf784c tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:27.637511 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-40c72de3-6d8e-4f79-905d-943f24bf784c tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c" status: 200 len: 1397 microversion: 2.1 time: 0.150491 Oct 17 14:19:27.638108 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2962/6061] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:27 2022] GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c => generated 1397 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:19:28.662497 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-29a26e46-0284-4bd0-9e1c-8ce598fc2943 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:28.664055 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-29a26e46-0284-4bd0-9e1c-8ce598fc2943 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 8afddca2-dfeb-4ec2-862c-3267d4d0186c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:28.670480 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-29a26e46-0284-4bd0-9e1c-8ce598fc2943 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:28.670972 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-29a26e46-0284-4bd0-9e1c-8ce598fc2943 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:28.671437 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-29a26e46-0284-4bd0-9e1c-8ce598fc2943 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:28.672164 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-29a26e46-0284-4bd0-9e1c-8ce598fc2943 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:28.672620 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-29a26e46-0284-4bd0-9e1c-8ce598fc2943 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:28.673046 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-29a26e46-0284-4bd0-9e1c-8ce598fc2943 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:28.832846 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-29a26e46-0284-4bd0-9e1c-8ce598fc2943 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:28.842593 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-29a26e46-0284-4bd0-9e1c-8ce598fc2943 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c" status: 200 len: 1397 microversion: 2.1 time: 0.185092 Oct 17 14:19:28.859733 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3100/6062] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:28 2022] GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c => generated 1397 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:19:29.488435 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-99ce3a47-f787-4e15-a447-d618935e22f9 req-a97fc0ca-b6c0-43c1-8852-768b679cb7aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8afddca2-dfeb-4ec2-862c-3267d4d0186c", "name": "network-vif-deleted", "tag": "0300fec4-82e8-49a5-ad7a-7f54bd853cbf"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:19:29.503924 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-99ce3a47-f787-4e15-a447-d618935e22f9 req-a97fc0ca-b6c0-43c1-8852-768b679cb7aa service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:29.504875 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-99ce3a47-f787-4e15-a447-d618935e22f9 req-a97fc0ca-b6c0-43c1-8852-768b679cb7aa service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:29.505655 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-99ce3a47-f787-4e15-a447-d618935e22f9 req-a97fc0ca-b6c0-43c1-8852-768b679cb7aa service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:29.527506 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-99ce3a47-f787-4e15-a447-d618935e22f9 req-a97fc0ca-b6c0-43c1-8852-768b679cb7aa service nova] Creating event network-vif-deleted:0300fec4-82e8-49a5-ad7a-7f54bd853cbf for instance 8afddca2-dfeb-4ec2-862c-3267d4d0186c on n-h1-854247-14 Oct 17 14:19:29.535348 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-99ce3a47-f787-4e15-a447-d618935e22f9 req-a97fc0ca-b6c0-43c1-8852-768b679cb7aa service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051729 Oct 17 14:19:29.536885 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2963/6063] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:19:29.869767 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4709ab91-9ce8-47dd-9e34-06cfd514b20f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:29.871155 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4709ab91-9ce8-47dd-9e34-06cfd514b20f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 8afddca2-dfeb-4ec2-862c-3267d4d0186c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:29.878571 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4709ab91-9ce8-47dd-9e34-06cfd514b20f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:29.879000 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4709ab91-9ce8-47dd-9e34-06cfd514b20f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:29.879872 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4709ab91-9ce8-47dd-9e34-06cfd514b20f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:29.880802 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4709ab91-9ce8-47dd-9e34-06cfd514b20f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:29.881662 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4709ab91-9ce8-47dd-9e34-06cfd514b20f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:29.882449 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4709ab91-9ce8-47dd-9e34-06cfd514b20f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:29.971408 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4709ab91-9ce8-47dd-9e34-06cfd514b20f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:29.993219 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4709ab91-9ce8-47dd-9e34-06cfd514b20f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c" status: 200 len: 1188 microversion: 2.1 time: 0.126235 Oct 17 14:19:29.996094 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3101/6064] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:29 2022] GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c => generated 1188 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:19:30.152200 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-73d2edf0-3b7a-43ce-881e-4a823de9006e tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '.version_select at 0x7f7cd46eddc0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:30.176600 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-73d2edf0-3b7a-43ce-881e-4a823de9006e tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1173205298" status: 202 len: 0 microversion: 2.1 time: 0.029958 Oct 17 14:19:30.177662 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2964/6065] 10.222.0.79 () {58 vars in 1284 bytes} [Mon Oct 17 14:19:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1173205298 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:19:30.212204 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-069ccc2b-3a70-44a1-903f-54cef1e1f60a tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Action: 'create', calling method: .version_select at 0x7f7cd546a820>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-677819581", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJHAeQ5RiOo0Tga1frxBsUrLMVCcRqOmRnPFCNUwW52bIafyCVmLWznf/8czEWYG/P3ItJrRBnVMNmAGSrxgr9MKDWebBKjsl39BYPGBobh1q9Xa1dPZgG+QSByjT0uZg=="}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:19:30.228475 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-069ccc2b-3a70-44a1-903f-54cef1e1f60a tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Getting quotas for project b8c8fe6f805f43798c9910296df4b8ab. Resources: {'key_pairs'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:19:30.233701 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-069ccc2b-3a70-44a1-903f-54cef1e1f60a tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Getting quotas for user 024275cf6f8d423992e61d92dea927ba and project b8c8fe6f805f43798c9910296df4b8ab. Resources: {'key_pairs'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:19:30.258720 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-069ccc2b-3a70-44a1-903f-54cef1e1f60a tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.050688 Oct 17 14:19:30.259501 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3102/6066] 10.222.0.79 () {60 vars in 1159 bytes} [Mon Oct 17 14:19:30 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:19:31.021235 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-eb90db9e-c908-43ef-8366-c4e34b6d6a5e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:31.021980 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-eb90db9e-c908-43ef-8366-c4e34b6d6a5e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 8afddca2-dfeb-4ec2-862c-3267d4d0186c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:31.030065 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eb90db9e-c908-43ef-8366-c4e34b6d6a5e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:31.030557 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eb90db9e-c908-43ef-8366-c4e34b6d6a5e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:31.030995 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eb90db9e-c908-43ef-8366-c4e34b6d6a5e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:31.031769 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eb90db9e-c908-43ef-8366-c4e34b6d6a5e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:31.032215 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eb90db9e-c908-43ef-8366-c4e34b6d6a5e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:31.032642 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eb90db9e-c908-43ef-8366-c4e34b6d6a5e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:31.109788 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-eb90db9e-c908-43ef-8366-c4e34b6d6a5e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:31.129855 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-eb90db9e-c908-43ef-8366-c4e34b6d6a5e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c" status: 200 len: 1188 microversion: 2.1 time: 0.112439 Oct 17 14:19:31.131070 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2965/6067] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:31 2022] GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c => generated 1188 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:19:32.154959 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d736b40f-a884-40b3-ad9e-45202968bc9f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:32.155793 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d736b40f-a884-40b3-ad9e-45202968bc9f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 8afddca2-dfeb-4ec2-862c-3267d4d0186c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:32.163391 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d736b40f-a884-40b3-ad9e-45202968bc9f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:32.164014 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d736b40f-a884-40b3-ad9e-45202968bc9f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:32.164450 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d736b40f-a884-40b3-ad9e-45202968bc9f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:32.165358 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d736b40f-a884-40b3-ad9e-45202968bc9f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:32.165817 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d736b40f-a884-40b3-ad9e-45202968bc9f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:32.166228 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d736b40f-a884-40b3-ad9e-45202968bc9f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:32.248989 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d736b40f-a884-40b3-ad9e-45202968bc9f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:32.260077 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d736b40f-a884-40b3-ad9e-45202968bc9f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c" status: 200 len: 1188 microversion: 2.1 time: 0.109914 Oct 17 14:19:32.266558 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3103/6068] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:32 2022] GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c => generated 1188 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:19:33.290076 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a8e98ce5-3372-45d1-9fe0-88e94dc39bd0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:33.291585 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a8e98ce5-3372-45d1-9fe0-88e94dc39bd0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 8afddca2-dfeb-4ec2-862c-3267d4d0186c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:33.302525 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a8e98ce5-3372-45d1-9fe0-88e94dc39bd0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:33.303346 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a8e98ce5-3372-45d1-9fe0-88e94dc39bd0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:33.304257 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a8e98ce5-3372-45d1-9fe0-88e94dc39bd0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:33.305203 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a8e98ce5-3372-45d1-9fe0-88e94dc39bd0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:33.305846 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a8e98ce5-3372-45d1-9fe0-88e94dc39bd0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:33.306449 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a8e98ce5-3372-45d1-9fe0-88e94dc39bd0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:33.417718 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a8e98ce5-3372-45d1-9fe0-88e94dc39bd0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:33.434839 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a8e98ce5-3372-45d1-9fe0-88e94dc39bd0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c" status: 200 len: 1188 microversion: 2.1 time: 0.155197 Oct 17 14:19:33.436696 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2966/6069] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:33 2022] GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c => generated 1188 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:19:34.459011 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b15169a6-9e82-4c61-b1a2-8e490509efd6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:34.459751 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b15169a6-9e82-4c61-b1a2-8e490509efd6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 8afddca2-dfeb-4ec2-862c-3267d4d0186c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:34.477064 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b15169a6-9e82-4c61-b1a2-8e490509efd6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:34.477737 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b15169a6-9e82-4c61-b1a2-8e490509efd6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:34.478286 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b15169a6-9e82-4c61-b1a2-8e490509efd6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:34.479134 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b15169a6-9e82-4c61-b1a2-8e490509efd6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:34.481117 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b15169a6-9e82-4c61-b1a2-8e490509efd6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:34.482641 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b15169a6-9e82-4c61-b1a2-8e490509efd6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:34.571010 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b15169a6-9e82-4c61-b1a2-8e490509efd6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:34.571886 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b15169a6-9e82-4c61-b1a2-8e490509efd6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:34.572522 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b15169a6-9e82-4c61-b1a2-8e490509efd6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:34.573188 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-b15169a6-9e82-4c61-b1a2-8e490509efd6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lazy-loading 'fault' on Instance uuid 8afddca2-dfeb-4ec2-862c-3267d4d0186c {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:19:34.637661 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b15169a6-9e82-4c61-b1a2-8e490509efd6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:34.646411 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b15169a6-9e82-4c61-b1a2-8e490509efd6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c" status: 200 len: 1147 microversion: 2.1 time: 0.192151 Oct 17 14:19:34.650484 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3104/6070] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:34 2022] GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c => generated 1147 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:19:35.676125 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ad2bf1ed-7b10-46dd-834f-dbf3c187854c tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:35.678284 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ad2bf1ed-7b10-46dd-834f-dbf3c187854c tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 8afddca2-dfeb-4ec2-862c-3267d4d0186c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:35.687784 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ad2bf1ed-7b10-46dd-834f-dbf3c187854c tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:35.688521 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ad2bf1ed-7b10-46dd-834f-dbf3c187854c tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:35.689146 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ad2bf1ed-7b10-46dd-834f-dbf3c187854c tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:35.690058 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ad2bf1ed-7b10-46dd-834f-dbf3c187854c tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:35.690666 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ad2bf1ed-7b10-46dd-834f-dbf3c187854c tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:35.691814 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ad2bf1ed-7b10-46dd-834f-dbf3c187854c tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:35.709612 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:19:35.712505 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-ad2bf1ed-7b10-46dd-834f-dbf3c187854c tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] HTTP exception thrown: Instance 8afddca2-dfeb-4ec2-862c-3267d4d0186c could not be found. Oct 17 14:19:35.714775 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ad2bf1ed-7b10-46dd-834f-dbf3c187854c tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Request method failure captured: Oct 17 14:19:35.714775 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c HTTP/1.1 Oct 17 14:19:35.714775 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 14:19:35.714775 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 14:19:35.714775 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 14:19:35.714775 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 14:19:35.714775 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 14:19:35.714775 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 14:19:35.714775 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 14:19:35.714775 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 14:19:35.714775 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTWPt4q6KhJtaXfApyhSZ1uS2Yi83dufn15X2GOm5u94F5E_Yj644GYsWZT8YBgl1aUBmYfKlHMjXq-eb8c2HF1REfW755J7WOOs8k3QRgUHhfiijXEH0YeKQjwZvCrEKlD9sd8dyp1v8diPQXXtSf-PHzqWEcTzJgPsJ95on9ZJE1Jo Oct 17 14:19:35.714775 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 14:19:35.714775 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 14:19:35.714775 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 14:19:35.714775 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 14:19:35.714775 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 14:19:35.714775 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 14:19:35.714775 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 4ee70940341741cb8e31928b856de051 Oct 17 14:19:35.714775 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-TestVolumeBootPattern-2135999385 Oct 17 14:19:35.714775 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 14:19:35.714775 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 14:19:35.714775 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4ee70940341741cb8e31928b856de051"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4ee70940341741cb8e31928b856de051"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4ee70940341741cb8e31928b856de051"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4ee70940341741cb8e31928b856de051", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:19:35.714775 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-TestVolumeBootPattern-2135999385 Oct 17 14:19:35.714775 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 4ee70940341741cb8e31928b856de051 Oct 17 14:19:35.714775 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-TestVolumeBootPattern-2135999385 Oct 17 14:19:35.714775 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-TestVolumeBootPattern-2135999385-project Oct 17 14:19:35.714775 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 14:19:35.714775 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 14:19:35.714775 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 06a0e2dab7494a4682615a6269ac24f9 Oct 17 14:19:35.714775 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-TestVolumeBootPattern-2135999385-project Oct 17 14:19:35.714775 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 14:19:35.714775 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 8afddca2-dfeb-4ec2-862c-3267d4d0186c could not be found. Oct 17 14:19:35.714775 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '8afddca2-dfeb-4ec2-862c-3267d4d0186c'} Oct 17 14:19:35.714775 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:19:35.714775 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:19:35.714775 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:19:35.714775 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:19:35.714775 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:19:35.714775 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:19:35.714775 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:19:35.714775 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:19:35.714775 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:19:35.714775 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:19:35.714775 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8afddca2-dfeb-4ec2-862c-3267d4d0186c could not be found. Oct 17 14:19:35.714775 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:19:35.714775 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:19:35.714775 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:19:35.714775 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:19:35.714775 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:19:35.714775 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:19:35.714775 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:19:35.714775 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:19:35.714775 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:19:35.714775 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:19:35.714775 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:19:35.714775 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:19:35.714775 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:19:35.714775 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:19:35.714775 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:19:35.714775 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:19:35.714775 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8afddca2-dfeb-4ec2-862c-3267d4d0186c could not be found. Oct 17 14:19:35.714775 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:19:35.714775 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:19:35.714775 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:19:35.718009 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:19:35.718009 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:19:35.718009 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:19:35.718009 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:19:35.718009 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:19:35.718009 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8afddca2-dfeb-4ec2-862c-3267d4d0186c could not be found. Oct 17 14:19:35.718009 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:19:35.720714 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ad2bf1ed-7b10-46dd-834f-dbf3c187854c tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Returning 404 to user: Instance 8afddca2-dfeb-4ec2-862c-3267d4d0186c could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:19:35.721938 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ad2bf1ed-7b10-46dd-834f-dbf3c187854c tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c" status: 404 len: 111 microversion: 2.1 time: 0.051492 Oct 17 14:19:35.723117 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2967/6071] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:35 2022] GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:19:37.332338 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4ffed030-43b1-4201-b541-8da4c156c9ee tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-297033326", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "b62a6d27-a0ec-4e2f-a136-7073406681e1"}], "key_name": "tempest-TestNetworkAdvancedServerOps-677819581", "security_groups": [{"name": "tempest-secgroup-smoke-1900295432"}]}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:19:37.468352 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-4ffed030-43b1-4201-b541-8da4c156c9ee tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] validate_networks() for [('b62a6d27-a0ec-4e2f-a136-7073406681e1', None, None, None, None, None)] {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:19:37.938657 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ba7e7309-f1a9-4f79-97ab-b9bac79982f3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:37.939925 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ba7e7309-f1a9-4f79-97ab-b9bac79982f3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 8afddca2-dfeb-4ec2-862c-3267d4d0186c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:37.950148 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ba7e7309-f1a9-4f79-97ab-b9bac79982f3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:37.951072 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ba7e7309-f1a9-4f79-97ab-b9bac79982f3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:37.951759 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ba7e7309-f1a9-4f79-97ab-b9bac79982f3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:37.952801 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ba7e7309-f1a9-4f79-97ab-b9bac79982f3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:37.953633 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ba7e7309-f1a9-4f79-97ab-b9bac79982f3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:37.954265 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ba7e7309-f1a9-4f79-97ab-b9bac79982f3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:37.977811 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-ba7e7309-f1a9-4f79-97ab-b9bac79982f3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] HTTP exception thrown: Instance 8afddca2-dfeb-4ec2-862c-3267d4d0186c could not be found. Oct 17 14:19:37.983006 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ba7e7309-f1a9-4f79-97ab-b9bac79982f3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Request method failure captured: Oct 17 14:19:37.983006 n-d-854247-14 devstack@n-api.service[127017]: request: DELETE /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c HTTP/1.1 Oct 17 14:19:37.983006 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 14:19:37.983006 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 14:19:37.983006 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 14:19:37.983006 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 14:19:37.983006 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 14:19:37.983006 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 14:19:37.983006 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 14:19:37.983006 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 14:19:37.983006 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTWPt4q6KhJtaXfApyhSZ1uS2Yi83dufn15X2GOm5u94F5E_Yj644GYsWZT8YBgl1aUBmYfKlHMjXq-eb8c2HF1REfW755J7WOOs8k3QRgUHhfiijXEH0YeKQjwZvCrEKlD9sd8dyp1v8diPQXXtSf-PHzqWEcTzJgPsJ95on9ZJE1Jo Oct 17 14:19:37.983006 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 14:19:37.983006 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 14:19:37.983006 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 14:19:37.983006 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 14:19:37.983006 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 14:19:37.983006 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 14:19:37.983006 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 4ee70940341741cb8e31928b856de051 Oct 17 14:19:37.983006 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-TestVolumeBootPattern-2135999385 Oct 17 14:19:37.983006 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 14:19:37.983006 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 14:19:37.983006 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4ee70940341741cb8e31928b856de051"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4ee70940341741cb8e31928b856de051"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4ee70940341741cb8e31928b856de051"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4ee70940341741cb8e31928b856de051", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:19:37.983006 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-TestVolumeBootPattern-2135999385 Oct 17 14:19:37.983006 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 4ee70940341741cb8e31928b856de051 Oct 17 14:19:37.983006 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-TestVolumeBootPattern-2135999385 Oct 17 14:19:37.983006 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-TestVolumeBootPattern-2135999385-project Oct 17 14:19:37.983006 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 14:19:37.983006 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 14:19:37.983006 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 06a0e2dab7494a4682615a6269ac24f9 Oct 17 14:19:37.983006 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-TestVolumeBootPattern-2135999385-project Oct 17 14:19:37.983006 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 14:19:37.983006 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 8afddca2-dfeb-4ec2-862c-3267d4d0186c could not be found. Oct 17 14:19:37.983006 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '8afddca2-dfeb-4ec2-862c-3267d4d0186c'} Oct 17 14:19:37.983006 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:19:37.983006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:19:37.983006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:19:37.983006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:19:37.983006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:19:37.983006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:19:37.983006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:19:37.983006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:19:37.983006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:19:37.983006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:19:37.983006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8afddca2-dfeb-4ec2-862c-3267d4d0186c could not be found. Oct 17 14:19:37.983006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:19:37.983006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:19:37.983006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:19:37.983006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:19:37.983006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:19:37.983006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:19:37.983006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:19:37.983006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:19:37.983006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:19:37.983006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:19:37.983006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 14:19:37.983006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 14:19:37.983006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 14:19:37.983006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 14:19:37.983006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:19:37.983006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:19:37.983006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:19:37.983006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:19:37.986441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8afddca2-dfeb-4ec2-862c-3267d4d0186c could not be found. Oct 17 14:19:37.986441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:19:37.986441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:19:37.986441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:19:37.986441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:19:37.986441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:19:37.986441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:19:37.986441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:19:37.986441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:19:37.986441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8afddca2-dfeb-4ec2-862c-3267d4d0186c could not be found. Oct 17 14:19:37.986441 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:19:37.988922 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ba7e7309-f1a9-4f79-97ab-b9bac79982f3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Returning 404 to user: Instance 8afddca2-dfeb-4ec2-862c-3267d4d0186c could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:19:37.991599 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ba7e7309-f1a9-4f79-97ab-b9bac79982f3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "DELETE /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c" status: 404 len: 111 microversion: 2.1 time: 0.056616 Oct 17 14:19:37.992686 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2968/6072] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:19:37 2022] DELETE /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 14:19:37.997744 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-4ffed030-43b1-4201-b541-8da4c156c9ee tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:19:37.998167 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-4ffed030-43b1-4201-b541-8da4c156c9ee tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:19:37.998855 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-4ffed030-43b1-4201-b541-8da4c156c9ee tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:19:37.999423 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-4ffed030-43b1-4201-b541-8da4c156c9ee tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:19:38.000123 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-4ffed030-43b1-4201-b541-8da4c156c9ee tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:19:38.001530 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7713b861-4673-46d8-923c-efd2b3f4a874 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:38.002408 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7713b861-4673-46d8-923c-efd2b3f4a874 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 8afddca2-dfeb-4ec2-862c-3267d4d0186c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:38.008983 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7713b861-4673-46d8-923c-efd2b3f4a874 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:38.009598 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7713b861-4673-46d8-923c-efd2b3f4a874 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:38.010168 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7713b861-4673-46d8-923c-efd2b3f4a874 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:38.010996 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7713b861-4673-46d8-923c-efd2b3f4a874 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:38.011616 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7713b861-4673-46d8-923c-efd2b3f4a874 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:38.012070 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4ffed030-43b1-4201-b541-8da4c156c9ee tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:38.012186 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7713b861-4673-46d8-923c-efd2b3f4a874 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:38.012783 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4ffed030-43b1-4201-b541-8da4c156c9ee tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:38.013361 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4ffed030-43b1-4201-b541-8da4c156c9ee tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:38.014246 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4ffed030-43b1-4201-b541-8da4c156c9ee tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:38.015041 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4ffed030-43b1-4201-b541-8da4c156c9ee tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:38.015507 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4ffed030-43b1-4201-b541-8da4c156c9ee tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:38.024784 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:19:38.029563 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-7713b861-4673-46d8-923c-efd2b3f4a874 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] HTTP exception thrown: Instance 8afddca2-dfeb-4ec2-862c-3267d4d0186c could not be found. Oct 17 14:19:38.031144 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7713b861-4673-46d8-923c-efd2b3f4a874 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Request method failure captured: Oct 17 14:19:38.031144 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c HTTP/1.1 Oct 17 14:19:38.031144 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 14:19:38.031144 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 14:19:38.031144 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 14:19:38.031144 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 14:19:38.031144 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 14:19:38.031144 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 14:19:38.031144 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 14:19:38.031144 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 14:19:38.031144 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTWPt4q6KhJtaXfApyhSZ1uS2Yi83dufn15X2GOm5u94F5E_Yj644GYsWZT8YBgl1aUBmYfKlHMjXq-eb8c2HF1REfW755J7WOOs8k3QRgUHhfiijXEH0YeKQjwZvCrEKlD9sd8dyp1v8diPQXXtSf-PHzqWEcTzJgPsJ95on9ZJE1Jo Oct 17 14:19:38.031144 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 14:19:38.031144 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 14:19:38.031144 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 14:19:38.031144 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 14:19:38.031144 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 14:19:38.031144 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 14:19:38.031144 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 4ee70940341741cb8e31928b856de051 Oct 17 14:19:38.031144 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-TestVolumeBootPattern-2135999385 Oct 17 14:19:38.031144 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 14:19:38.031144 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 14:19:38.031144 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4ee70940341741cb8e31928b856de051"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4ee70940341741cb8e31928b856de051"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4ee70940341741cb8e31928b856de051"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4ee70940341741cb8e31928b856de051", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:19:38.031144 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-TestVolumeBootPattern-2135999385 Oct 17 14:19:38.031144 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 4ee70940341741cb8e31928b856de051 Oct 17 14:19:38.031144 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-TestVolumeBootPattern-2135999385 Oct 17 14:19:38.031144 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-TestVolumeBootPattern-2135999385-project Oct 17 14:19:38.031144 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 14:19:38.031144 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 14:19:38.031144 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 06a0e2dab7494a4682615a6269ac24f9 Oct 17 14:19:38.031144 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-TestVolumeBootPattern-2135999385-project Oct 17 14:19:38.031144 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 14:19:38.031144 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 8afddca2-dfeb-4ec2-862c-3267d4d0186c could not be found. Oct 17 14:19:38.031144 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '8afddca2-dfeb-4ec2-862c-3267d4d0186c'} Oct 17 14:19:38.031144 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:19:38.031144 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:19:38.031144 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:19:38.031144 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:19:38.031144 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:19:38.031144 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:19:38.031144 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:19:38.031144 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:19:38.031144 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:19:38.031144 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:19:38.031144 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8afddca2-dfeb-4ec2-862c-3267d4d0186c could not be found. Oct 17 14:19:38.031144 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:19:38.031144 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:19:38.031144 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:19:38.031144 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:19:38.031144 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:19:38.031144 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:19:38.031144 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:19:38.031144 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:19:38.031144 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:19:38.031144 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:19:38.031144 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:19:38.031144 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:19:38.031144 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:19:38.031144 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:19:38.031144 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:19:38.031144 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:19:38.031144 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8afddca2-dfeb-4ec2-862c-3267d4d0186c could not be found. Oct 17 14:19:38.031144 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:19:38.031144 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:19:38.031144 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:19:38.034553 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:19:38.034553 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:19:38.034553 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:19:38.034553 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:19:38.034553 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:19:38.034553 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8afddca2-dfeb-4ec2-862c-3267d4d0186c could not be found. Oct 17 14:19:38.034553 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:19:38.034553 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7713b861-4673-46d8-923c-efd2b3f4a874 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Returning 404 to user: Instance 8afddca2-dfeb-4ec2-862c-3267d4d0186c could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:19:38.034553 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7713b861-4673-46d8-923c-efd2b3f4a874 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c" status: 404 len: 111 microversion: 2.1 time: 0.036314 Oct 17 14:19:38.034553 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2969/6073] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:37 2022] GET /compute/v2.1/servers/8afddca2-dfeb-4ec2-862c-3267d4d0186c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 14:19:38.041913 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-4ffed030-43b1-4201-b541-8da4c156c9ee tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Getting quotas for project b8c8fe6f805f43798c9910296df4b8ab. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:19:38.048431 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-4ffed030-43b1-4201-b541-8da4c156c9ee tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Getting quotas for user 024275cf6f8d423992e61d92dea927ba and project b8c8fe6f805f43798c9910296df4b8ab. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:19:38.064534 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4ffed030-43b1-4201-b541-8da4c156c9ee tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:19:38.066978 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4ffed030-43b1-4201-b541-8da4c156c9ee tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 96fea6e9-fc3f-4f05-84c8-d3d1b95827de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:19:38.150550 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4ffed030-43b1-4201-b541-8da4c156c9ee tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.822162 Oct 17 14:19:38.152375 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3105/6074] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 14:19:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:19:38.166854 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-07ffa109-b66d-4775-81f0-c2857730b256 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:38.167740 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-07ffa109-b66d-4775-81f0-c2857730b256 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 96fea6e9-fc3f-4f05-84c8-d3d1b95827de] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:38.243154 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-07ffa109-b66d-4775-81f0-c2857730b256 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:38.256110 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-07ffa109-b66d-4775-81f0-c2857730b256 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de" status: 200 len: 1265 microversion: 2.1 time: 0.094982 Oct 17 14:19:38.256736 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2970/6075] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:38 2022] GET /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de => generated 1265 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:19:39.280205 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-346cd259-c89f-486f-98c1-da271ef4abef tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:39.281591 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-346cd259-c89f-486f-98c1-da271ef4abef tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 96fea6e9-fc3f-4f05-84c8-d3d1b95827de] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:39.289343 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-346cd259-c89f-486f-98c1-da271ef4abef tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:39.290073 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-346cd259-c89f-486f-98c1-da271ef4abef tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:39.290761 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-346cd259-c89f-486f-98c1-da271ef4abef tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:39.291646 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-346cd259-c89f-486f-98c1-da271ef4abef tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:39.292233 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-346cd259-c89f-486f-98c1-da271ef4abef tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:39.292797 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-346cd259-c89f-486f-98c1-da271ef4abef tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:39.428582 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-346cd259-c89f-486f-98c1-da271ef4abef tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:39.442735 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-346cd259-c89f-486f-98c1-da271ef4abef tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de" status: 200 len: 1317 microversion: 2.1 time: 0.164139 Oct 17 14:19:39.472447 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3106/6076] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:39 2022] GET /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:19:40.469154 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e73d9c7f-5a3e-4854-aa1a-dd032353b2d4 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:40.469797 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e73d9c7f-5a3e-4854-aa1a-dd032353b2d4 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 96fea6e9-fc3f-4f05-84c8-d3d1b95827de] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:40.499134 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e73d9c7f-5a3e-4854-aa1a-dd032353b2d4 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:40.499887 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e73d9c7f-5a3e-4854-aa1a-dd032353b2d4 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:40.500493 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e73d9c7f-5a3e-4854-aa1a-dd032353b2d4 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:40.501384 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e73d9c7f-5a3e-4854-aa1a-dd032353b2d4 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:40.502088 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e73d9c7f-5a3e-4854-aa1a-dd032353b2d4 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:40.502417 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e73d9c7f-5a3e-4854-aa1a-dd032353b2d4 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:40.761402 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e73d9c7f-5a3e-4854-aa1a-dd032353b2d4 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:40.772769 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e73d9c7f-5a3e-4854-aa1a-dd032353b2d4 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de" status: 200 len: 1391 microversion: 2.1 time: 0.305809 Oct 17 14:19:40.773603 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2971/6077] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:40 2022] GET /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de => generated 1391 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:19:41.154912 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-f8182510-864c-495b-97c0-91f5f1e7233c req-0d7d5f0c-fb6a-479b-9a98-089d2a54ef57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96fea6e9-fc3f-4f05-84c8-d3d1b95827de", "tag": "55a75d23-87ee-4f6d-87ad-bdd8b1f942cc"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:19:41.174440 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-f8182510-864c-495b-97c0-91f5f1e7233c req-0d7d5f0c-fb6a-479b-9a98-089d2a54ef57 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:41.174936 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-f8182510-864c-495b-97c0-91f5f1e7233c req-0d7d5f0c-fb6a-479b-9a98-089d2a54ef57 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:41.175395 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-f8182510-864c-495b-97c0-91f5f1e7233c req-0d7d5f0c-fb6a-479b-9a98-089d2a54ef57 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:41.195525 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-f8182510-864c-495b-97c0-91f5f1e7233c req-0d7d5f0c-fb6a-479b-9a98-089d2a54ef57 service nova] Creating event network-changed:55a75d23-87ee-4f6d-87ad-bdd8b1f942cc for instance 96fea6e9-fc3f-4f05-84c8-d3d1b95827de on n-h1-854247-14 Oct 17 14:19:41.202928 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-f8182510-864c-495b-97c0-91f5f1e7233c req-0d7d5f0c-fb6a-479b-9a98-089d2a54ef57 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055317 Oct 17 14:19:41.204668 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3107/6078] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:19:41.796063 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0ac25d02-3d44-46e3-b81a-55f558fbb96d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:41.796704 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0ac25d02-3d44-46e3-b81a-55f558fbb96d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 96fea6e9-fc3f-4f05-84c8-d3d1b95827de] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:41.804274 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0ac25d02-3d44-46e3-b81a-55f558fbb96d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:41.804832 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0ac25d02-3d44-46e3-b81a-55f558fbb96d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:41.805276 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0ac25d02-3d44-46e3-b81a-55f558fbb96d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:41.806157 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0ac25d02-3d44-46e3-b81a-55f558fbb96d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:41.806813 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0ac25d02-3d44-46e3-b81a-55f558fbb96d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:41.807270 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0ac25d02-3d44-46e3-b81a-55f558fbb96d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:41.957104 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0ac25d02-3d44-46e3-b81a-55f558fbb96d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:41.965178 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0ac25d02-3d44-46e3-b81a-55f558fbb96d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de" status: 200 len: 1391 microversion: 2.1 time: 0.173232 Oct 17 14:19:41.965781 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2972/6079] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:41 2022] GET /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de => generated 1391 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:19:42.990244 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-54a65925-aca8-4253-92f4-a618285b5e06 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:42.991097 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-54a65925-aca8-4253-92f4-a618285b5e06 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 96fea6e9-fc3f-4f05-84c8-d3d1b95827de] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:42.997761 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-54a65925-aca8-4253-92f4-a618285b5e06 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:42.998253 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-54a65925-aca8-4253-92f4-a618285b5e06 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:42.998694 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-54a65925-aca8-4253-92f4-a618285b5e06 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:42.999648 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-54a65925-aca8-4253-92f4-a618285b5e06 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:43.000250 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-54a65925-aca8-4253-92f4-a618285b5e06 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:43.000684 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-54a65925-aca8-4253-92f4-a618285b5e06 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:43.145723 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-54a65925-aca8-4253-92f4-a618285b5e06 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:43.153846 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-54a65925-aca8-4253-92f4-a618285b5e06 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de" status: 200 len: 1391 microversion: 2.1 time: 0.169569 Oct 17 14:19:43.167384 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3108/6080] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:42 2022] GET /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de => generated 1391 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:19:44.178948 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c9a652b6-4c55-401e-b2d1-199cedbfcfa2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:44.179540 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c9a652b6-4c55-401e-b2d1-199cedbfcfa2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 96fea6e9-fc3f-4f05-84c8-d3d1b95827de] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:44.181987 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:19:44.189690 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c9a652b6-4c55-401e-b2d1-199cedbfcfa2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:44.190296 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c9a652b6-4c55-401e-b2d1-199cedbfcfa2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:44.190754 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c9a652b6-4c55-401e-b2d1-199cedbfcfa2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:44.191514 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c9a652b6-4c55-401e-b2d1-199cedbfcfa2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:44.191965 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c9a652b6-4c55-401e-b2d1-199cedbfcfa2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:44.192387 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c9a652b6-4c55-401e-b2d1-199cedbfcfa2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:44.334688 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c9a652b6-4c55-401e-b2d1-199cedbfcfa2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:44.343236 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c9a652b6-4c55-401e-b2d1-199cedbfcfa2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de" status: 200 len: 1391 microversion: 2.1 time: 0.169962 Oct 17 14:19:44.344165 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2973/6081] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:44 2022] GET /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de => generated 1391 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:19:45.366200 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9dc2be17-fc37-4d58-a7e5-a3a92983b1df tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:45.366908 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9dc2be17-fc37-4d58-a7e5-a3a92983b1df tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 96fea6e9-fc3f-4f05-84c8-d3d1b95827de] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:45.374320 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9dc2be17-fc37-4d58-a7e5-a3a92983b1df tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:45.374811 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9dc2be17-fc37-4d58-a7e5-a3a92983b1df tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:45.375267 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9dc2be17-fc37-4d58-a7e5-a3a92983b1df tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:45.375974 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9dc2be17-fc37-4d58-a7e5-a3a92983b1df tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:45.376447 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9dc2be17-fc37-4d58-a7e5-a3a92983b1df tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:45.376855 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9dc2be17-fc37-4d58-a7e5-a3a92983b1df tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:45.525319 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9dc2be17-fc37-4d58-a7e5-a3a92983b1df tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:45.533772 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9dc2be17-fc37-4d58-a7e5-a3a92983b1df tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de" status: 200 len: 1391 microversion: 2.1 time: 0.171511 Oct 17 14:19:45.534681 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3109/6082] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:45 2022] GET /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de => generated 1391 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:19:46.505249 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-ff9ee863-fb05-4870-b82e-4c21634338a0 req-e9b346ed-0e6a-421d-9700-8cea22f7545c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96fea6e9-fc3f-4f05-84c8-d3d1b95827de", "name": "network-vif-plugged", "status": "completed", "tag": "55a75d23-87ee-4f6d-87ad-bdd8b1f942cc"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:19:46.520937 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-ff9ee863-fb05-4870-b82e-4c21634338a0 req-e9b346ed-0e6a-421d-9700-8cea22f7545c service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:46.521589 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-ff9ee863-fb05-4870-b82e-4c21634338a0 req-e9b346ed-0e6a-421d-9700-8cea22f7545c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:46.522090 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-ff9ee863-fb05-4870-b82e-4c21634338a0 req-e9b346ed-0e6a-421d-9700-8cea22f7545c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:46.534447 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-ff9ee863-fb05-4870-b82e-4c21634338a0 req-e9b346ed-0e6a-421d-9700-8cea22f7545c service nova] Creating event network-vif-plugged:55a75d23-87ee-4f6d-87ad-bdd8b1f942cc for instance 96fea6e9-fc3f-4f05-84c8-d3d1b95827de on n-h1-854247-14 Oct 17 14:19:46.540489 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-ff9ee863-fb05-4870-b82e-4c21634338a0 req-e9b346ed-0e6a-421d-9700-8cea22f7545c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039374 Oct 17 14:19:46.541165 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2974/6083] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:19:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:19:46.559056 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-90a3838c-ef3d-4c5a-a313-ce587c694ea2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:46.560614 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-90a3838c-ef3d-4c5a-a313-ce587c694ea2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 96fea6e9-fc3f-4f05-84c8-d3d1b95827de] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:46.584501 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-90a3838c-ef3d-4c5a-a313-ce587c694ea2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:46.585021 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-90a3838c-ef3d-4c5a-a313-ce587c694ea2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:46.585614 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-90a3838c-ef3d-4c5a-a313-ce587c694ea2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:46.587506 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-90a3838c-ef3d-4c5a-a313-ce587c694ea2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:46.588594 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-90a3838c-ef3d-4c5a-a313-ce587c694ea2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:46.589212 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-90a3838c-ef3d-4c5a-a313-ce587c694ea2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:46.787417 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-90a3838c-ef3d-4c5a-a313-ce587c694ea2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:46.795437 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-90a3838c-ef3d-4c5a-a313-ce587c694ea2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de" status: 200 len: 1391 microversion: 2.1 time: 0.242125 Oct 17 14:19:46.796020 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3110/6084] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:46 2022] GET /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de => generated 1391 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:19:47.822743 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3a728d7b-e1c4-4e2b-83fa-15b708596c42 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:47.823767 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3a728d7b-e1c4-4e2b-83fa-15b708596c42 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 96fea6e9-fc3f-4f05-84c8-d3d1b95827de] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:47.830600 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3a728d7b-e1c4-4e2b-83fa-15b708596c42 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:47.831380 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3a728d7b-e1c4-4e2b-83fa-15b708596c42 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:47.831825 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3a728d7b-e1c4-4e2b-83fa-15b708596c42 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:47.832531 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3a728d7b-e1c4-4e2b-83fa-15b708596c42 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:47.832987 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3a728d7b-e1c4-4e2b-83fa-15b708596c42 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:47.833403 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3a728d7b-e1c4-4e2b-83fa-15b708596c42 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:47.971897 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3a728d7b-e1c4-4e2b-83fa-15b708596c42 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:47.980486 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3a728d7b-e1c4-4e2b-83fa-15b708596c42 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de" status: 200 len: 1562 microversion: 2.1 time: 0.166026 Oct 17 14:19:47.981474 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2975/6085] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:47 2022] GET /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de => generated 1562 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:19:48.004258 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-acd71151-9025-446a-b0c9-5f2e29587acf tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:48.004969 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-acd71151-9025-446a-b0c9-5f2e29587acf tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 96fea6e9-fc3f-4f05-84c8-d3d1b95827de] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:48.012464 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-acd71151-9025-446a-b0c9-5f2e29587acf tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:48.012948 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-acd71151-9025-446a-b0c9-5f2e29587acf tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:48.013380 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-acd71151-9025-446a-b0c9-5f2e29587acf tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:48.014071 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-acd71151-9025-446a-b0c9-5f2e29587acf tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:48.014533 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-acd71151-9025-446a-b0c9-5f2e29587acf tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:48.014948 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-acd71151-9025-446a-b0c9-5f2e29587acf tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:48.033893 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:19:48.059225 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=10 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:19:48.162445 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-acd71151-9025-446a-b0c9-5f2e29587acf tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:48.170901 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-acd71151-9025-446a-b0c9-5f2e29587acf tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de" status: 200 len: 1562 microversion: 2.1 time: 0.170600 Oct 17 14:19:48.171517 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3111/6086] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:47 2022] GET /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de => generated 1562 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:19:50.218321 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f0510c47-024e-47fe-aaea-13f0c17a0b89 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:50.219968 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f0510c47-024e-47fe-aaea-13f0c17a0b89 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 96fea6e9-fc3f-4f05-84c8-d3d1b95827de] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:50.221894 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-68b826ce-f8e2-496d-947b-ed4af2391721 req-612bf71a-8993-4c58-8653-44dd59b1da61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96fea6e9-fc3f-4f05-84c8-d3d1b95827de", "tag": "55a75d23-87ee-4f6d-87ad-bdd8b1f942cc"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:19:50.222329 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:19:50.229591 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f0510c47-024e-47fe-aaea-13f0c17a0b89 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:50.230409 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f0510c47-024e-47fe-aaea-13f0c17a0b89 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:50.230913 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f0510c47-024e-47fe-aaea-13f0c17a0b89 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:50.231729 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f0510c47-024e-47fe-aaea-13f0c17a0b89 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:50.232258 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f0510c47-024e-47fe-aaea-13f0c17a0b89 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:50.232772 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f0510c47-024e-47fe-aaea-13f0c17a0b89 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:50.236211 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-68b826ce-f8e2-496d-947b-ed4af2391721 req-612bf71a-8993-4c58-8653-44dd59b1da61 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:50.236888 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-68b826ce-f8e2-496d-947b-ed4af2391721 req-612bf71a-8993-4c58-8653-44dd59b1da61 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:50.237480 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-68b826ce-f8e2-496d-947b-ed4af2391721 req-612bf71a-8993-4c58-8653-44dd59b1da61 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:50.251626 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-68b826ce-f8e2-496d-947b-ed4af2391721 req-612bf71a-8993-4c58-8653-44dd59b1da61 service nova] Creating event network-changed:55a75d23-87ee-4f6d-87ad-bdd8b1f942cc for instance 96fea6e9-fc3f-4f05-84c8-d3d1b95827de on n-h1-854247-14 Oct 17 14:19:50.263366 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-68b826ce-f8e2-496d-947b-ed4af2391721 req-612bf71a-8993-4c58-8653-44dd59b1da61 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045403 Oct 17 14:19:50.267098 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3112/6087] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:19:50.525108 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f0510c47-024e-47fe-aaea-13f0c17a0b89 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:50.537568 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f0510c47-024e-47fe-aaea-13f0c17a0b89 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de" status: 200 len: 1562 microversion: 2.1 time: 0.323060 Oct 17 14:19:50.539525 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2976/6088] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:50 2022] GET /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de => generated 1562 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:19:58.907106 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2ed52abc-1e91-4f51-8531-cccf8a9a5d11 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1334323759", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "bb530d6b-34cc-48da-a60b-3fc1d64a8aa0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "60d947eb-1d2b-4fd8-9101-f9fb7c7e0088"}]}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:19:58.917087 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:19:58.971381 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-2ed52abc-1e91-4f51-8531-cccf8a9a5d11 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] validate_networks() for [('60d947eb-1d2b-4fd8-9101-f9fb7c7e0088', None, None, None, None, None)] {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:19:59.359390 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-2ed52abc-1e91-4f51-8531-cccf8a9a5d11 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:19:59.359819 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-2ed52abc-1e91-4f51-8531-cccf8a9a5d11 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:19:59.360341 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-2ed52abc-1e91-4f51-8531-cccf8a9a5d11 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:19:59.360759 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-2ed52abc-1e91-4f51-8531-cccf8a9a5d11 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:19:59.361164 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-2ed52abc-1e91-4f51-8531-cccf8a9a5d11 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:19:59.370506 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2ed52abc-1e91-4f51-8531-cccf8a9a5d11 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:59.371073 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2ed52abc-1e91-4f51-8531-cccf8a9a5d11 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:59.371541 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2ed52abc-1e91-4f51-8531-cccf8a9a5d11 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:59.372278 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2ed52abc-1e91-4f51-8531-cccf8a9a5d11 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:59.372732 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2ed52abc-1e91-4f51-8531-cccf8a9a5d11 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:59.373153 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2ed52abc-1e91-4f51-8531-cccf8a9a5d11 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:59.390653 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-2ed52abc-1e91-4f51-8531-cccf8a9a5d11 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Getting quotas for project 4ee70940341741cb8e31928b856de051. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:19:59.396200 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-2ed52abc-1e91-4f51-8531-cccf8a9a5d11 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Getting quotas for user 06a0e2dab7494a4682615a6269ac24f9 and project 4ee70940341741cb8e31928b856de051. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:19:59.458788 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2ed52abc-1e91-4f51-8531-cccf8a9a5d11 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:19:59.461218 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2ed52abc-1e91-4f51-8531-cccf8a9a5d11 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: e9324873-d141-4cb6-adca-4187bf085284] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bb530d6b-34cc-48da-a60b-3fc1d64a8aa0',volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:19:59.598530 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2ed52abc-1e91-4f51-8531-cccf8a9a5d11 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.696812 Oct 17 14:19:59.599235 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3113/6089] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 14:19:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:19:59.610810 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-aaec977c-646e-44a7-acf6-184a52c9167e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:59.611504 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-aaec977c-646e-44a7-acf6-184a52c9167e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: e9324873-d141-4cb6-adca-4187bf085284] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:59.669881 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-aaec977c-646e-44a7-acf6-184a52c9167e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:59.677152 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-aaec977c-646e-44a7-acf6-184a52c9167e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/e9324873-d141-4cb6-adca-4187bf085284" status: 200 len: 1071 microversion: 2.1 time: 0.070557 Oct 17 14:19:59.677720 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2977/6090] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:59 2022] GET /compute/v2.1/servers/e9324873-d141-4cb6-adca-4187bf085284 => generated 1071 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:00.701790 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-542c85c3-4537-45df-8803-63abbc24acf6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:00.702444 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-542c85c3-4537-45df-8803-63abbc24acf6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: e9324873-d141-4cb6-adca-4187bf085284] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:00.711007 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-542c85c3-4537-45df-8803-63abbc24acf6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:00.711603 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-542c85c3-4537-45df-8803-63abbc24acf6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:00.712271 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-542c85c3-4537-45df-8803-63abbc24acf6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:00.713038 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-542c85c3-4537-45df-8803-63abbc24acf6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:00.713582 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-542c85c3-4537-45df-8803-63abbc24acf6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:00.714059 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-542c85c3-4537-45df-8803-63abbc24acf6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:00.810211 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-542c85c3-4537-45df-8803-63abbc24acf6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:00.819562 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-542c85c3-4537-45df-8803-63abbc24acf6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/e9324873-d141-4cb6-adca-4187bf085284" status: 200 len: 1187 microversion: 2.1 time: 0.122609 Oct 17 14:20:00.820331 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3114/6091] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:00 2022] GET /compute/v2.1/servers/e9324873-d141-4cb6-adca-4187bf085284 => generated 1187 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:01.844407 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e6369fe2-e090-4107-b1bd-564e16fc4eea tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:01.845637 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e6369fe2-e090-4107-b1bd-564e16fc4eea tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: e9324873-d141-4cb6-adca-4187bf085284] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:01.847463 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=37 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:20:01.857372 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e6369fe2-e090-4107-b1bd-564e16fc4eea tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:01.858113 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e6369fe2-e090-4107-b1bd-564e16fc4eea tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:01.858829 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e6369fe2-e090-4107-b1bd-564e16fc4eea tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:01.860420 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e6369fe2-e090-4107-b1bd-564e16fc4eea tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:01.861030 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e6369fe2-e090-4107-b1bd-564e16fc4eea tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:01.861601 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e6369fe2-e090-4107-b1bd-564e16fc4eea tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:02.068019 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e6369fe2-e090-4107-b1bd-564e16fc4eea tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:02.076560 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e6369fe2-e090-4107-b1bd-564e16fc4eea tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/e9324873-d141-4cb6-adca-4187bf085284" status: 200 len: 1229 microversion: 2.1 time: 0.236326 Oct 17 14:20:02.077636 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2978/6092] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:01 2022] GET /compute/v2.1/servers/e9324873-d141-4cb6-adca-4187bf085284 => generated 1229 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:02.131374 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-8a1433c9-abc0-43c6-97ed-1ca9226a1af9 req-44092a68-cb8b-4529-a0d8-014f98c22425 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9324873-d141-4cb6-adca-4187bf085284", "tag": "9f42ddec-983a-4fff-9c8c-2877f536edc1"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:20:02.148379 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-8a1433c9-abc0-43c6-97ed-1ca9226a1af9 req-44092a68-cb8b-4529-a0d8-014f98c22425 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:02.149233 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-8a1433c9-abc0-43c6-97ed-1ca9226a1af9 req-44092a68-cb8b-4529-a0d8-014f98c22425 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:02.149874 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-8a1433c9-abc0-43c6-97ed-1ca9226a1af9 req-44092a68-cb8b-4529-a0d8-014f98c22425 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:02.163834 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-8a1433c9-abc0-43c6-97ed-1ca9226a1af9 req-44092a68-cb8b-4529-a0d8-014f98c22425 service nova] Creating event network-changed:9f42ddec-983a-4fff-9c8c-2877f536edc1 for instance e9324873-d141-4cb6-adca-4187bf085284 on n-h2-854247-14 Oct 17 14:20:02.169305 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-8a1433c9-abc0-43c6-97ed-1ca9226a1af9 req-44092a68-cb8b-4529-a0d8-014f98c22425 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041797 Oct 17 14:20:02.172572 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3115/6093] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:20:03.101300 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c30e8000-202b-4343-8494-6af3d9e46313 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:03.101923 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c30e8000-202b-4343-8494-6af3d9e46313 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: e9324873-d141-4cb6-adca-4187bf085284] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:03.110013 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c30e8000-202b-4343-8494-6af3d9e46313 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:03.110525 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c30e8000-202b-4343-8494-6af3d9e46313 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:03.110961 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c30e8000-202b-4343-8494-6af3d9e46313 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:03.111697 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c30e8000-202b-4343-8494-6af3d9e46313 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:03.112145 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c30e8000-202b-4343-8494-6af3d9e46313 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:03.112572 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c30e8000-202b-4343-8494-6af3d9e46313 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:03.252795 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c30e8000-202b-4343-8494-6af3d9e46313 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:03.275368 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c30e8000-202b-4343-8494-6af3d9e46313 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/e9324873-d141-4cb6-adca-4187bf085284" status: 200 len: 1229 microversion: 2.1 time: 0.178003 Oct 17 14:20:03.275943 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2979/6094] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:03 2022] GET /compute/v2.1/servers/e9324873-d141-4cb6-adca-4187bf085284 => generated 1229 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:04.300618 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2eacf4de-37b5-443b-839b-688f961d148b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:04.301287 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2eacf4de-37b5-443b-839b-688f961d148b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: e9324873-d141-4cb6-adca-4187bf085284] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:04.309891 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2eacf4de-37b5-443b-839b-688f961d148b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:04.310641 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2eacf4de-37b5-443b-839b-688f961d148b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:04.311302 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2eacf4de-37b5-443b-839b-688f961d148b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:04.312385 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2eacf4de-37b5-443b-839b-688f961d148b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:04.313045 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2eacf4de-37b5-443b-839b-688f961d148b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:04.313632 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2eacf4de-37b5-443b-839b-688f961d148b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:04.450745 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2eacf4de-37b5-443b-839b-688f961d148b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:04.459399 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2eacf4de-37b5-443b-839b-688f961d148b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/e9324873-d141-4cb6-adca-4187bf085284" status: 200 len: 1229 microversion: 2.1 time: 0.163983 Oct 17 14:20:04.460088 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3116/6095] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:04 2022] GET /compute/v2.1/servers/e9324873-d141-4cb6-adca-4187bf085284 => generated 1229 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:05.482586 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1d21a09a-86b9-4625-9f60-cf04fa08180b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:05.483442 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1d21a09a-86b9-4625-9f60-cf04fa08180b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: e9324873-d141-4cb6-adca-4187bf085284] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:05.490951 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1d21a09a-86b9-4625-9f60-cf04fa08180b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:05.491483 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1d21a09a-86b9-4625-9f60-cf04fa08180b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:05.491938 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1d21a09a-86b9-4625-9f60-cf04fa08180b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:05.492644 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1d21a09a-86b9-4625-9f60-cf04fa08180b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:05.493100 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1d21a09a-86b9-4625-9f60-cf04fa08180b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:05.493527 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1d21a09a-86b9-4625-9f60-cf04fa08180b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:05.637661 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1d21a09a-86b9-4625-9f60-cf04fa08180b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:05.645841 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1d21a09a-86b9-4625-9f60-cf04fa08180b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/e9324873-d141-4cb6-adca-4187bf085284" status: 200 len: 1229 microversion: 2.1 time: 0.167632 Oct 17 14:20:05.646748 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2980/6096] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:05 2022] GET /compute/v2.1/servers/e9324873-d141-4cb6-adca-4187bf085284 => generated 1229 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:06.672408 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-dd3b3cde-cb0a-4e62-a95d-29909f42908f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:06.673083 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-dd3b3cde-cb0a-4e62-a95d-29909f42908f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: e9324873-d141-4cb6-adca-4187bf085284] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:06.684764 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dd3b3cde-cb0a-4e62-a95d-29909f42908f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:06.685385 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dd3b3cde-cb0a-4e62-a95d-29909f42908f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:06.685961 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dd3b3cde-cb0a-4e62-a95d-29909f42908f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:06.686932 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dd3b3cde-cb0a-4e62-a95d-29909f42908f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:06.687633 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dd3b3cde-cb0a-4e62-a95d-29909f42908f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:06.688185 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dd3b3cde-cb0a-4e62-a95d-29909f42908f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:06.833983 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-dd3b3cde-cb0a-4e62-a95d-29909f42908f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:06.844154 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-dd3b3cde-cb0a-4e62-a95d-29909f42908f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/e9324873-d141-4cb6-adca-4187bf085284" status: 200 len: 1217 microversion: 2.1 time: 0.178622 Oct 17 14:20:06.844748 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3117/6097] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:06 2022] GET /compute/v2.1/servers/e9324873-d141-4cb6-adca-4187bf085284 => generated 1217 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:07.871713 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3bd2773f-9052-4a21-8b45-79b0e93f928b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:07.872767 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3bd2773f-9052-4a21-8b45-79b0e93f928b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: e9324873-d141-4cb6-adca-4187bf085284] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:07.885270 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3bd2773f-9052-4a21-8b45-79b0e93f928b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:07.886086 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3bd2773f-9052-4a21-8b45-79b0e93f928b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:07.886821 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3bd2773f-9052-4a21-8b45-79b0e93f928b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:07.888193 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3bd2773f-9052-4a21-8b45-79b0e93f928b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:07.888648 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3bd2773f-9052-4a21-8b45-79b0e93f928b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:07.889088 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3bd2773f-9052-4a21-8b45-79b0e93f928b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:08.054981 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3bd2773f-9052-4a21-8b45-79b0e93f928b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:08.063467 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3bd2773f-9052-4a21-8b45-79b0e93f928b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/e9324873-d141-4cb6-adca-4187bf085284" status: 200 len: 1217 microversion: 2.1 time: 0.198307 Oct 17 14:20:08.078600 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2981/6098] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:07 2022] GET /compute/v2.1/servers/e9324873-d141-4cb6-adca-4187bf085284 => generated 1217 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:09.088434 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-62935a02-7573-4f7a-aec3-0092c67c116e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:09.089108 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-62935a02-7573-4f7a-aec3-0092c67c116e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: e9324873-d141-4cb6-adca-4187bf085284] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:09.096926 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-62935a02-7573-4f7a-aec3-0092c67c116e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:09.097417 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-62935a02-7573-4f7a-aec3-0092c67c116e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:09.097854 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-62935a02-7573-4f7a-aec3-0092c67c116e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:09.098565 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-62935a02-7573-4f7a-aec3-0092c67c116e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:09.099022 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-62935a02-7573-4f7a-aec3-0092c67c116e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:09.099471 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-62935a02-7573-4f7a-aec3-0092c67c116e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:09.102311 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=58 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:20:09.242909 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-62935a02-7573-4f7a-aec3-0092c67c116e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:09.252709 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-62935a02-7573-4f7a-aec3-0092c67c116e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/e9324873-d141-4cb6-adca-4187bf085284" status: 200 len: 1217 microversion: 2.1 time: 0.169616 Oct 17 14:20:09.253307 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3118/6099] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:09 2022] GET /compute/v2.1/servers/e9324873-d141-4cb6-adca-4187bf085284 => generated 1217 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:10.280594 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bd1cff5c-5506-41ce-8592-6d6c6ec339f8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:10.281551 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-bd1cff5c-5506-41ce-8592-6d6c6ec339f8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: e9324873-d141-4cb6-adca-4187bf085284] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:10.285943 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:20:10.295048 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bd1cff5c-5506-41ce-8592-6d6c6ec339f8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:10.295560 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bd1cff5c-5506-41ce-8592-6d6c6ec339f8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:10.295986 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bd1cff5c-5506-41ce-8592-6d6c6ec339f8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:10.296684 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bd1cff5c-5506-41ce-8592-6d6c6ec339f8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:10.297142 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bd1cff5c-5506-41ce-8592-6d6c6ec339f8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:10.297561 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bd1cff5c-5506-41ce-8592-6d6c6ec339f8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:10.445758 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-bd1cff5c-5506-41ce-8592-6d6c6ec339f8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:10.455470 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-bd1cff5c-5506-41ce-8592-6d6c6ec339f8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/e9324873-d141-4cb6-adca-4187bf085284" status: 200 len: 1217 microversion: 2.1 time: 0.181808 Oct 17 14:20:10.456037 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2982/6100] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:10 2022] GET /compute/v2.1/servers/e9324873-d141-4cb6-adca-4187bf085284 => generated 1217 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:11.489770 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0c6c7881-73e0-4619-99e0-25486e376466 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:11.490599 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0c6c7881-73e0-4619-99e0-25486e376466 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: e9324873-d141-4cb6-adca-4187bf085284] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:11.493044 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:20:11.494061 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=6 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:20:11.503146 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0c6c7881-73e0-4619-99e0-25486e376466 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:11.503672 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0c6c7881-73e0-4619-99e0-25486e376466 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:11.504091 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0c6c7881-73e0-4619-99e0-25486e376466 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:11.504791 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0c6c7881-73e0-4619-99e0-25486e376466 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:11.505248 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0c6c7881-73e0-4619-99e0-25486e376466 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:11.505679 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0c6c7881-73e0-4619-99e0-25486e376466 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:11.649983 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0c6c7881-73e0-4619-99e0-25486e376466 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:11.663285 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0c6c7881-73e0-4619-99e0-25486e376466 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/e9324873-d141-4cb6-adca-4187bf085284" status: 200 len: 1217 microversion: 2.1 time: 0.178410 Oct 17 14:20:11.664180 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3119/6101] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:11 2022] GET /compute/v2.1/servers/e9324873-d141-4cb6-adca-4187bf085284 => generated 1217 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:11.877752 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d555be9e-142e-4940-89a1-84dd43fdbb1d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:20:11.879967 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d555be9e-142e-4940-89a1-84dd43fdbb1d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 96fea6e9-fc3f-4f05-84c8-d3d1b95827de] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:11.887389 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d555be9e-142e-4940-89a1-84dd43fdbb1d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:11.887882 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d555be9e-142e-4940-89a1-84dd43fdbb1d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:11.888315 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d555be9e-142e-4940-89a1-84dd43fdbb1d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:11.889009 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d555be9e-142e-4940-89a1-84dd43fdbb1d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:11.889452 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d555be9e-142e-4940-89a1-84dd43fdbb1d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:11.889869 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d555be9e-142e-4940-89a1-84dd43fdbb1d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:11.952764 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d555be9e-142e-4940-89a1-84dd43fdbb1d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "POST /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de/action" status: 200 len: 24568 microversion: 2.1 time: 0.079115 Oct 17 14:20:11.953412 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2983/6102] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:20:11 2022] POST /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de/action => generated 24568 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:20:12.695473 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8146d37e-0ce9-46bd-b0bf-44a5df9589ea tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:12.696373 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8146d37e-0ce9-46bd-b0bf-44a5df9589ea tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: e9324873-d141-4cb6-adca-4187bf085284] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:12.704196 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8146d37e-0ce9-46bd-b0bf-44a5df9589ea tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:12.704846 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8146d37e-0ce9-46bd-b0bf-44a5df9589ea tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:12.705340 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8146d37e-0ce9-46bd-b0bf-44a5df9589ea tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:12.706059 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8146d37e-0ce9-46bd-b0bf-44a5df9589ea tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:12.706512 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8146d37e-0ce9-46bd-b0bf-44a5df9589ea tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:12.706926 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8146d37e-0ce9-46bd-b0bf-44a5df9589ea tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:12.841832 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8146d37e-0ce9-46bd-b0bf-44a5df9589ea tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:12.853261 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8146d37e-0ce9-46bd-b0bf-44a5df9589ea tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/e9324873-d141-4cb6-adca-4187bf085284" status: 200 len: 1217 microversion: 2.1 time: 0.165199 Oct 17 14:20:12.854102 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3120/6103] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:12 2022] GET /compute/v2.1/servers/e9324873-d141-4cb6-adca-4187bf085284 => generated 1217 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:13.889963 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-31d75c6d-1c77-4fe3-936d-54b78e436013 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:13.891136 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-31d75c6d-1c77-4fe3-936d-54b78e436013 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: e9324873-d141-4cb6-adca-4187bf085284] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:13.900259 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-31d75c6d-1c77-4fe3-936d-54b78e436013 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:13.900746 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-31d75c6d-1c77-4fe3-936d-54b78e436013 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:13.901181 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-31d75c6d-1c77-4fe3-936d-54b78e436013 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:13.901882 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-31d75c6d-1c77-4fe3-936d-54b78e436013 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:13.902336 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-31d75c6d-1c77-4fe3-936d-54b78e436013 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:13.902768 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-31d75c6d-1c77-4fe3-936d-54b78e436013 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:14.448484 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-31d75c6d-1c77-4fe3-936d-54b78e436013 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:14.456772 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-31d75c6d-1c77-4fe3-936d-54b78e436013 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/e9324873-d141-4cb6-adca-4187bf085284" status: 200 len: 1217 microversion: 2.1 time: 0.574046 Oct 17 14:20:14.457366 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2984/6104] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:13 2022] GET /compute/v2.1/servers/e9324873-d141-4cb6-adca-4187bf085284 => generated 1217 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:15.481020 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-36ba4227-f57e-43ef-98d1-9b00234653c7 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:15.481569 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-36ba4227-f57e-43ef-98d1-9b00234653c7 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: e9324873-d141-4cb6-adca-4187bf085284] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:15.491280 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-36ba4227-f57e-43ef-98d1-9b00234653c7 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:15.491777 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-36ba4227-f57e-43ef-98d1-9b00234653c7 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:15.492214 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-36ba4227-f57e-43ef-98d1-9b00234653c7 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:15.492925 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-36ba4227-f57e-43ef-98d1-9b00234653c7 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:15.493371 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-36ba4227-f57e-43ef-98d1-9b00234653c7 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:15.493796 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-36ba4227-f57e-43ef-98d1-9b00234653c7 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:15.634110 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-36ba4227-f57e-43ef-98d1-9b00234653c7 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:15.642728 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-36ba4227-f57e-43ef-98d1-9b00234653c7 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/e9324873-d141-4cb6-adca-4187bf085284" status: 200 len: 1217 microversion: 2.1 time: 0.166486 Oct 17 14:20:15.643509 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3121/6105] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:15 2022] GET /compute/v2.1/servers/e9324873-d141-4cb6-adca-4187bf085284 => generated 1217 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:16.666314 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4228c36d-bc80-4aee-a414-dbdc503457f9 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:16.666944 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4228c36d-bc80-4aee-a414-dbdc503457f9 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: e9324873-d141-4cb6-adca-4187bf085284] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:16.674893 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=26 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:20:16.679133 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4228c36d-bc80-4aee-a414-dbdc503457f9 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:16.679710 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4228c36d-bc80-4aee-a414-dbdc503457f9 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:16.680152 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4228c36d-bc80-4aee-a414-dbdc503457f9 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:16.681073 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4228c36d-bc80-4aee-a414-dbdc503457f9 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:16.681533 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4228c36d-bc80-4aee-a414-dbdc503457f9 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:16.681962 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4228c36d-bc80-4aee-a414-dbdc503457f9 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:16.697476 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-ff939ce9-4458-4cb3-a8fb-208b1dcb48b8 req-e1cda1d7-474c-4482-b7b0-57294712860a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9324873-d141-4cb6-adca-4187bf085284", "name": "network-vif-plugged", "status": "completed", "tag": "9f42ddec-983a-4fff-9c8c-2877f536edc1"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:20:16.710487 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-ff939ce9-4458-4cb3-a8fb-208b1dcb48b8 req-e1cda1d7-474c-4482-b7b0-57294712860a service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:16.711235 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-ff939ce9-4458-4cb3-a8fb-208b1dcb48b8 req-e1cda1d7-474c-4482-b7b0-57294712860a service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:16.711672 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-ff939ce9-4458-4cb3-a8fb-208b1dcb48b8 req-e1cda1d7-474c-4482-b7b0-57294712860a service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:16.724644 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-ff939ce9-4458-4cb3-a8fb-208b1dcb48b8 req-e1cda1d7-474c-4482-b7b0-57294712860a service nova] Creating event network-vif-plugged:9f42ddec-983a-4fff-9c8c-2877f536edc1 for instance e9324873-d141-4cb6-adca-4187bf085284 on n-h2-854247-14 Oct 17 14:20:16.730260 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-ff939ce9-4458-4cb3-a8fb-208b1dcb48b8 req-e1cda1d7-474c-4482-b7b0-57294712860a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036610 Oct 17 14:20:16.733760 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3122/6106] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:20:16.854800 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4228c36d-bc80-4aee-a414-dbdc503457f9 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:16.863379 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4228c36d-bc80-4aee-a414-dbdc503457f9 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/e9324873-d141-4cb6-adca-4187bf085284" status: 200 len: 1217 microversion: 2.1 time: 0.201024 Oct 17 14:20:16.863974 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2985/6107] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:16 2022] GET /compute/v2.1/servers/e9324873-d141-4cb6-adca-4187bf085284 => generated 1217 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:17.887691 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0cd4cbbf-4f7d-4131-a660-d4e7f7471f15 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:17.888388 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0cd4cbbf-4f7d-4131-a660-d4e7f7471f15 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: e9324873-d141-4cb6-adca-4187bf085284] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:17.894987 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0cd4cbbf-4f7d-4131-a660-d4e7f7471f15 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:17.895491 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0cd4cbbf-4f7d-4131-a660-d4e7f7471f15 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:17.895931 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0cd4cbbf-4f7d-4131-a660-d4e7f7471f15 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:17.896633 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0cd4cbbf-4f7d-4131-a660-d4e7f7471f15 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:17.897082 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0cd4cbbf-4f7d-4131-a660-d4e7f7471f15 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:17.897492 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0cd4cbbf-4f7d-4131-a660-d4e7f7471f15 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:18.045709 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0cd4cbbf-4f7d-4131-a660-d4e7f7471f15 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:18.054934 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0cd4cbbf-4f7d-4131-a660-d4e7f7471f15 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/e9324873-d141-4cb6-adca-4187bf085284" status: 200 len: 1217 microversion: 2.1 time: 0.172408 Oct 17 14:20:18.055570 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3123/6108] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:17 2022] GET /compute/v2.1/servers/e9324873-d141-4cb6-adca-4187bf085284 => generated 1217 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:19.082483 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bc03ead7-a2ad-40a0-9e75-e312dbad3023 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:19.083101 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-bc03ead7-a2ad-40a0-9e75-e312dbad3023 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: e9324873-d141-4cb6-adca-4187bf085284] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:19.090790 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bc03ead7-a2ad-40a0-9e75-e312dbad3023 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:19.091331 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bc03ead7-a2ad-40a0-9e75-e312dbad3023 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:19.091795 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bc03ead7-a2ad-40a0-9e75-e312dbad3023 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:19.092543 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bc03ead7-a2ad-40a0-9e75-e312dbad3023 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:19.093024 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bc03ead7-a2ad-40a0-9e75-e312dbad3023 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:19.093472 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bc03ead7-a2ad-40a0-9e75-e312dbad3023 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:19.233864 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-bc03ead7-a2ad-40a0-9e75-e312dbad3023 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:19.242151 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-bc03ead7-a2ad-40a0-9e75-e312dbad3023 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/e9324873-d141-4cb6-adca-4187bf085284" status: 200 len: 1405 microversion: 2.1 time: 0.165971 Oct 17 14:20:19.242703 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2986/6109] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:19 2022] GET /compute/v2.1/servers/e9324873-d141-4cb6-adca-4187bf085284 => generated 1405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:19.264631 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b046a24e-68a8-4edb-ba78-60301d523969 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:19.265287 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b046a24e-68a8-4edb-ba78-60301d523969 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: e9324873-d141-4cb6-adca-4187bf085284] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:19.272846 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b046a24e-68a8-4edb-ba78-60301d523969 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:19.273335 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b046a24e-68a8-4edb-ba78-60301d523969 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:19.273773 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b046a24e-68a8-4edb-ba78-60301d523969 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:19.274471 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b046a24e-68a8-4edb-ba78-60301d523969 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:19.274924 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b046a24e-68a8-4edb-ba78-60301d523969 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:19.275382 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b046a24e-68a8-4edb-ba78-60301d523969 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:19.418403 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b046a24e-68a8-4edb-ba78-60301d523969 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:19.426878 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b046a24e-68a8-4edb-ba78-60301d523969 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/e9324873-d141-4cb6-adca-4187bf085284" status: 200 len: 1405 microversion: 2.1 time: 0.166309 Oct 17 14:20:19.427540 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3124/6110] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:19 2022] GET /compute/v2.1/servers/e9324873-d141-4cb6-adca-4187bf085284 => generated 1405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:19.458008 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a3774631-966b-4ca2-a28b-98437c8285e6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1679291281"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:20:19.461774 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a3774631-966b-4ca2-a28b-98437c8285e6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: e9324873-d141-4cb6-adca-4187bf085284] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:19.471641 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a3774631-966b-4ca2-a28b-98437c8285e6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:19.472515 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a3774631-966b-4ca2-a28b-98437c8285e6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:19.472961 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a3774631-966b-4ca2-a28b-98437c8285e6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:19.473686 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a3774631-966b-4ca2-a28b-98437c8285e6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:19.474139 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a3774631-966b-4ca2-a28b-98437c8285e6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:19.474590 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a3774631-966b-4ca2-a28b-98437c8285e6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:19.583371 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.compute.api [None req-a3774631-966b-4ca2-a28b-98437c8285e6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: e9324873-d141-4cb6-adca-4187bf085284] Attempting to quiesce instance before volume snapshot. Oct 17 14:20:19.649511 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.compute.api [None req-a3774631-966b-4ca2-a28b-98437c8285e6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: e9324873-d141-4cb6-adca-4187bf085284] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 17 14:20:19.728246 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a3774631-966b-4ca2-a28b-98437c8285e6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: e9324873-d141-4cb6-adca-4187bf085284] Creating snapshot from volume bb530d6b-34cc-48da-a60b-3fc1d64a8aa0. {{(pid=127017) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 17 14:20:20.598853 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a3774631-966b-4ca2-a28b-98437c8285e6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "POST /compute/v2.1/servers/e9324873-d141-4cb6-adca-4187bf085284/action" status: 202 len: 0 microversion: 2.1 time: 1.147517 Oct 17 14:20:20.599813 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2987/6111] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:20:19 2022] POST /compute/v2.1/servers/e9324873-d141-4cb6-adca-4187bf085284/action => generated 0 bytes in 1149 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 17 14:20:21.768869 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-caf866a0-c4d1-44a5-8272-9e750dc80557 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-34915359", "imageRef": "99dc895b-5af4-49fc-a205-f927ca562a13", "flavorRef": "452", "networks": [{"uuid": "60d947eb-1d2b-4fd8-9101-f9fb7c7e0088"}]}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:20:21.834810 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-caf866a0-c4d1-44a5-8272-9e750dc80557 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] validate_networks() for [('60d947eb-1d2b-4fd8-9101-f9fb7c7e0088', None, None, None, None, None)] {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:20:22.231830 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-caf866a0-c4d1-44a5-8272-9e750dc80557 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:20:22.232250 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-caf866a0-c4d1-44a5-8272-9e750dc80557 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:20:22.232721 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-caf866a0-c4d1-44a5-8272-9e750dc80557 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:20:22.233128 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-caf866a0-c4d1-44a5-8272-9e750dc80557 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:20:22.233536 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-caf866a0-c4d1-44a5-8272-9e750dc80557 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:20:22.242563 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-caf866a0-c4d1-44a5-8272-9e750dc80557 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:22.243039 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-caf866a0-c4d1-44a5-8272-9e750dc80557 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:22.243508 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-caf866a0-c4d1-44a5-8272-9e750dc80557 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:22.244236 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-caf866a0-c4d1-44a5-8272-9e750dc80557 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:22.244651 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-caf866a0-c4d1-44a5-8272-9e750dc80557 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:22.245076 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-caf866a0-c4d1-44a5-8272-9e750dc80557 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:22.262582 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-caf866a0-c4d1-44a5-8272-9e750dc80557 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Getting quotas for project 4ee70940341741cb8e31928b856de051. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:20:22.268064 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-caf866a0-c4d1-44a5-8272-9e750dc80557 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Getting quotas for user 06a0e2dab7494a4682615a6269ac24f9 and project 4ee70940341741cb8e31928b856de051. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:20:22.280991 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-caf866a0-c4d1-44a5-8272-9e750dc80557 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:20:22.283599 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-caf866a0-c4d1-44a5-8272-9e750dc80557 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 37ac4563-7872-4787-8d42-87b04550bcd9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='1e8c47c5-db7d-4bf8-8c6a-de493cf03170',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:20:22.365209 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-caf866a0-c4d1-44a5-8272-9e750dc80557 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.600529 Oct 17 14:20:22.366069 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3125/6112] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 14:20:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:20:22.378850 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c0ad7566-bbe6-4f99-8d44-e63a913bd91e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:22.379632 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c0ad7566-bbe6-4f99-8d44-e63a913bd91e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 37ac4563-7872-4787-8d42-87b04550bcd9] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:22.442908 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c0ad7566-bbe6-4f99-8d44-e63a913bd91e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:22.450147 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c0ad7566-bbe6-4f99-8d44-e63a913bd91e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9" status: 200 len: 1228 microversion: 2.1 time: 0.076679 Oct 17 14:20:22.450733 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2988/6113] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:22 2022] GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9 => generated 1228 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:22.997254 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5c376547-6aba-4936-8db1-8befd9a1909b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:22.997907 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5c376547-6aba-4936-8db1-8befd9a1909b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 96fea6e9-fc3f-4f05-84c8-d3d1b95827de] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:23.005564 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5c376547-6aba-4936-8db1-8befd9a1909b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:23.006045 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5c376547-6aba-4936-8db1-8befd9a1909b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:23.006481 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5c376547-6aba-4936-8db1-8befd9a1909b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:23.007204 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5c376547-6aba-4936-8db1-8befd9a1909b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:23.007655 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5c376547-6aba-4936-8db1-8befd9a1909b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:23.008098 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5c376547-6aba-4936-8db1-8befd9a1909b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:23.150742 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5c376547-6aba-4936-8db1-8befd9a1909b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:23.158716 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5c376547-6aba-4936-8db1-8befd9a1909b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de" status: 200 len: 1681 microversion: 2.1 time: 0.165529 Oct 17 14:20:23.159628 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3126/6114] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:22 2022] GET /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:23.260817 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-939910ef-303a-4d90-bc8e-e42edb2d692e tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:20:23.263022 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-939910ef-303a-4d90-bc8e-e42edb2d692e tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 96fea6e9-fc3f-4f05-84c8-d3d1b95827de] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:23.269593 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-939910ef-303a-4d90-bc8e-e42edb2d692e tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:23.270094 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-939910ef-303a-4d90-bc8e-e42edb2d692e tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:23.270546 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-939910ef-303a-4d90-bc8e-e42edb2d692e tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:23.271275 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-939910ef-303a-4d90-bc8e-e42edb2d692e tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:23.271743 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-939910ef-303a-4d90-bc8e-e42edb2d692e tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:23.272180 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-939910ef-303a-4d90-bc8e-e42edb2d692e tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:23.377664 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-939910ef-303a-4d90-bc8e-e42edb2d692e tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "POST /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de/action" status: 200 len: 32640 microversion: 2.1 time: 0.120710 Oct 17 14:20:23.378492 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2989/6115] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:20:23 2022] POST /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de/action => generated 32640 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:20:23.474130 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-641b387a-a281-4de3-b2fc-9d40eaf50e73 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:23.475524 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-641b387a-a281-4de3-b2fc-9d40eaf50e73 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 37ac4563-7872-4787-8d42-87b04550bcd9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:23.482095 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-641b387a-a281-4de3-b2fc-9d40eaf50e73 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:23.483270 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-641b387a-a281-4de3-b2fc-9d40eaf50e73 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:23.483715 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-641b387a-a281-4de3-b2fc-9d40eaf50e73 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:23.484456 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-641b387a-a281-4de3-b2fc-9d40eaf50e73 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:23.484993 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-641b387a-a281-4de3-b2fc-9d40eaf50e73 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:23.485466 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-641b387a-a281-4de3-b2fc-9d40eaf50e73 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:23.543755 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d9f9a696-66db-4ca1-8ca7-ef8653132d30 tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:23.544633 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d9f9a696-66db-4ca1-8ca7-ef8653132d30 tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] [instance: 96fea6e9-fc3f-4f05-84c8-d3d1b95827de] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:23.552747 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d9f9a696-66db-4ca1-8ca7-ef8653132d30 tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:23.553420 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d9f9a696-66db-4ca1-8ca7-ef8653132d30 tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:23.554162 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d9f9a696-66db-4ca1-8ca7-ef8653132d30 tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:23.554896 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d9f9a696-66db-4ca1-8ca7-ef8653132d30 tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:23.555657 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d9f9a696-66db-4ca1-8ca7-ef8653132d30 tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:23.556103 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d9f9a696-66db-4ca1-8ca7-ef8653132d30 tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:23.586208 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-641b387a-a281-4de3-b2fc-9d40eaf50e73 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:23.595908 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-641b387a-a281-4de3-b2fc-9d40eaf50e73 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9" status: 200 len: 1288 microversion: 2.1 time: 0.125856 Oct 17 14:20:23.599219 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3127/6116] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:23 2022] GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9 => generated 1288 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:23.778967 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d9f9a696-66db-4ca1-8ca7-ef8653132d30 tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de" status: 200 len: 1834 microversion: 2.1 time: 0.240087 Oct 17 14:20:23.779938 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2990/6117] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:23 2022] GET /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de => generated 1834 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:20:23.812191 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4678911c-2bbc-4d68-a23d-0a2134f03fe2 tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:20:23.815100 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4678911c-2bbc-4d68-a23d-0a2134f03fe2 tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] [instance: 96fea6e9-fc3f-4f05-84c8-d3d1b95827de] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:23.822289 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4678911c-2bbc-4d68-a23d-0a2134f03fe2 tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:23.823051 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4678911c-2bbc-4d68-a23d-0a2134f03fe2 tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:23.823507 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4678911c-2bbc-4d68-a23d-0a2134f03fe2 tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:23.824249 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4678911c-2bbc-4d68-a23d-0a2134f03fe2 tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:23.824701 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4678911c-2bbc-4d68-a23d-0a2134f03fe2 tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:23.825104 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4678911c-2bbc-4d68-a23d-0a2134f03fe2 tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:23.853035 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-4678911c-2bbc-4d68-a23d-0a2134f03fe2 tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Lazy-loading 'flavor' on Instance uuid 96fea6e9-fc3f-4f05-84c8-d3d1b95827de {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:20:23.866490 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4678911c-2bbc-4d68-a23d-0a2134f03fe2 tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] [instance: 96fea6e9-fc3f-4f05-84c8-d3d1b95827de] Going to try to live migrate instance to another host {{(pid=127016) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 17 14:20:24.619977 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-328ddebd-cc6c-4737-a1d6-29c725700e6e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:24.621170 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-328ddebd-cc6c-4737-a1d6-29c725700e6e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 37ac4563-7872-4787-8d42-87b04550bcd9] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:24.629753 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-328ddebd-cc6c-4737-a1d6-29c725700e6e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:24.630646 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-328ddebd-cc6c-4737-a1d6-29c725700e6e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:24.631350 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-328ddebd-cc6c-4737-a1d6-29c725700e6e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:24.632477 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-328ddebd-cc6c-4737-a1d6-29c725700e6e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:24.634249 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-328ddebd-cc6c-4737-a1d6-29c725700e6e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:24.634879 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-328ddebd-cc6c-4737-a1d6-29c725700e6e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:24.881854 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-328ddebd-cc6c-4737-a1d6-29c725700e6e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:24.904566 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-328ddebd-cc6c-4737-a1d6-29c725700e6e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9" status: 200 len: 1340 microversion: 2.1 time: 0.288580 Oct 17 14:20:24.905164 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2991/6118] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:24 2022] GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9 => generated 1340 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:25.453586 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-fc97caf0-c1b0-4195-8e46-e84b85046598 req-8264b7e9-4b16-4dac-b4e3-c9550d1008e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37ac4563-7872-4787-8d42-87b04550bcd9", "tag": "36e365c2-2bff-4bc1-b49e-ad6454cbb811"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:20:25.465898 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-fc97caf0-c1b0-4195-8e46-e84b85046598 req-8264b7e9-4b16-4dac-b4e3-c9550d1008e6 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:25.466390 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-fc97caf0-c1b0-4195-8e46-e84b85046598 req-8264b7e9-4b16-4dac-b4e3-c9550d1008e6 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:25.466828 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-fc97caf0-c1b0-4195-8e46-e84b85046598 req-8264b7e9-4b16-4dac-b4e3-c9550d1008e6 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:25.478325 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-fc97caf0-c1b0-4195-8e46-e84b85046598 req-8264b7e9-4b16-4dac-b4e3-c9550d1008e6 service nova] Creating event network-changed:36e365c2-2bff-4bc1-b49e-ad6454cbb811 for instance 37ac4563-7872-4787-8d42-87b04550bcd9 on n-h1-854247-14 Oct 17 14:20:25.483452 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-fc97caf0-c1b0-4195-8e46-e84b85046598 req-8264b7e9-4b16-4dac-b4e3-c9550d1008e6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034665 Oct 17 14:20:25.484246 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2992/6119] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:20:25.931868 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e113b76a-0c9f-4170-855e-42f422cce11d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:25.933675 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e113b76a-0c9f-4170-855e-42f422cce11d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 37ac4563-7872-4787-8d42-87b04550bcd9] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:25.937013 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4678911c-2bbc-4d68-a23d-0a2134f03fe2 tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de/action" status: 202 len: 0 microversion: 2.1 time: 2.129161 Oct 17 14:20:25.941730 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3128/6120] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:20:23 2022] POST /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de/action => generated 0 bytes in 2132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:20:25.947835 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-79b712f3-4075-4adc-95d2-295302a7d401 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:25.948385 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-79b712f3-4075-4adc-95d2-295302a7d401 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 96fea6e9-fc3f-4f05-84c8-d3d1b95827de] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:25.948789 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e113b76a-0c9f-4170-855e-42f422cce11d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:25.949453 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e113b76a-0c9f-4170-855e-42f422cce11d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:25.950057 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e113b76a-0c9f-4170-855e-42f422cce11d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:25.950930 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e113b76a-0c9f-4170-855e-42f422cce11d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:25.951576 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e113b76a-0c9f-4170-855e-42f422cce11d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:25.952172 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e113b76a-0c9f-4170-855e-42f422cce11d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:25.959293 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-79b712f3-4075-4adc-95d2-295302a7d401 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:25.965426 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-79b712f3-4075-4adc-95d2-295302a7d401 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:25.965931 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-79b712f3-4075-4adc-95d2-295302a7d401 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:25.968877 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-79b712f3-4075-4adc-95d2-295302a7d401 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:25.969545 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-79b712f3-4075-4adc-95d2-295302a7d401 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:25.969994 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-79b712f3-4075-4adc-95d2-295302a7d401 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:26.318227 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e113b76a-0c9f-4170-855e-42f422cce11d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:26.327227 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e113b76a-0c9f-4170-855e-42f422cce11d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9" status: 200 len: 1340 microversion: 2.1 time: 0.400157 Oct 17 14:20:26.338686 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2993/6121] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:25 2022] GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9 => generated 1340 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:26.406639 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-79b712f3-4075-4adc-95d2-295302a7d401 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:26.417108 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-79b712f3-4075-4adc-95d2-295302a7d401 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de" status: 200 len: 1691 microversion: 2.1 time: 0.473191 Oct 17 14:20:26.417679 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3129/6122] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:25 2022] GET /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de => generated 1691 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:27.358714 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-978ba0fb-d172-4a9b-94db-8f1c6b7aabb3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:27.359613 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-978ba0fb-d172-4a9b-94db-8f1c6b7aabb3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 37ac4563-7872-4787-8d42-87b04550bcd9] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:27.370028 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-978ba0fb-d172-4a9b-94db-8f1c6b7aabb3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:27.370028 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-978ba0fb-d172-4a9b-94db-8f1c6b7aabb3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:27.372603 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-978ba0fb-d172-4a9b-94db-8f1c6b7aabb3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:27.372603 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-978ba0fb-d172-4a9b-94db-8f1c6b7aabb3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:27.372603 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-978ba0fb-d172-4a9b-94db-8f1c6b7aabb3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:27.373066 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-978ba0fb-d172-4a9b-94db-8f1c6b7aabb3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:27.442794 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-41136fc0-e0a0-4725-a8ff-ddceaf59e5ca tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:27.444309 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-41136fc0-e0a0-4725-a8ff-ddceaf59e5ca tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 96fea6e9-fc3f-4f05-84c8-d3d1b95827de] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:27.452824 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-41136fc0-e0a0-4725-a8ff-ddceaf59e5ca tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:27.453727 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-41136fc0-e0a0-4725-a8ff-ddceaf59e5ca tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:27.454423 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-41136fc0-e0a0-4725-a8ff-ddceaf59e5ca tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:27.455283 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-41136fc0-e0a0-4725-a8ff-ddceaf59e5ca tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:27.455953 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-41136fc0-e0a0-4725-a8ff-ddceaf59e5ca tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:27.456909 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-41136fc0-e0a0-4725-a8ff-ddceaf59e5ca tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:27.880247 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-978ba0fb-d172-4a9b-94db-8f1c6b7aabb3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:27.882700 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:20:27.891408 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-978ba0fb-d172-4a9b-94db-8f1c6b7aabb3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9" status: 200 len: 1340 microversion: 2.1 time: 0.541251 Oct 17 14:20:27.892149 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2994/6123] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:27 2022] GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9 => generated 1340 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:27.895113 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-41136fc0-e0a0-4725-a8ff-ddceaf59e5ca tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:27.905728 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-41136fc0-e0a0-4725-a8ff-ddceaf59e5ca tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de" status: 200 len: 1691 microversion: 2.1 time: 0.467331 Oct 17 14:20:27.915899 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3130/6124] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:27 2022] GET /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de => generated 1691 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:28.194661 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-14064414-5cc0-4f3b-af76-9d5e49b7317d req-ca2e076d-1f55-4f8c-ac5a-8487c640dcc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96fea6e9-fc3f-4f05-84c8-d3d1b95827de", "name": "network-vif-unplugged", "status": "completed", "tag": "55a75d23-87ee-4f6d-87ad-bdd8b1f942cc"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:20:28.217530 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-14064414-5cc0-4f3b-af76-9d5e49b7317d req-ca2e076d-1f55-4f8c-ac5a-8487c640dcc7 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:28.218036 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-14064414-5cc0-4f3b-af76-9d5e49b7317d req-ca2e076d-1f55-4f8c-ac5a-8487c640dcc7 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:28.218489 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-14064414-5cc0-4f3b-af76-9d5e49b7317d req-ca2e076d-1f55-4f8c-ac5a-8487c640dcc7 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:28.236825 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-14064414-5cc0-4f3b-af76-9d5e49b7317d req-ca2e076d-1f55-4f8c-ac5a-8487c640dcc7 service nova] Creating event network-vif-unplugged:55a75d23-87ee-4f6d-87ad-bdd8b1f942cc for instance 96fea6e9-fc3f-4f05-84c8-d3d1b95827de on n-h1-854247-14 Oct 17 14:20:28.246878 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-14064414-5cc0-4f3b-af76-9d5e49b7317d req-ca2e076d-1f55-4f8c-ac5a-8487c640dcc7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057815 Oct 17 14:20:28.246878 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2995/6125] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:20:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:20:28.923246 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-24bcff5c-777e-490a-9ff9-85e0a6cad12d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:28.926471 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-24bcff5c-777e-490a-9ff9-85e0a6cad12d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 37ac4563-7872-4787-8d42-87b04550bcd9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:28.935477 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-24bcff5c-777e-490a-9ff9-85e0a6cad12d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:28.936836 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-24bcff5c-777e-490a-9ff9-85e0a6cad12d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:28.937458 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-24bcff5c-777e-490a-9ff9-85e0a6cad12d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:28.938779 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-24bcff5c-777e-490a-9ff9-85e0a6cad12d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:28.939533 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-24bcff5c-777e-490a-9ff9-85e0a6cad12d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:28.940153 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-24bcff5c-777e-490a-9ff9-85e0a6cad12d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:29.053965 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5c1c3c45-d9f5-4632-a0a9-69be482746bc tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:29.055062 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5c1c3c45-d9f5-4632-a0a9-69be482746bc tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 96fea6e9-fc3f-4f05-84c8-d3d1b95827de] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:29.063484 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5c1c3c45-d9f5-4632-a0a9-69be482746bc tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:29.064464 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5c1c3c45-d9f5-4632-a0a9-69be482746bc tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:29.065174 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5c1c3c45-d9f5-4632-a0a9-69be482746bc tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:29.066592 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5c1c3c45-d9f5-4632-a0a9-69be482746bc tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:29.067581 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5c1c3c45-d9f5-4632-a0a9-69be482746bc tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:29.068762 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5c1c3c45-d9f5-4632-a0a9-69be482746bc tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:29.286843 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-24bcff5c-777e-490a-9ff9-85e0a6cad12d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:29.311577 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-24bcff5c-777e-490a-9ff9-85e0a6cad12d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9" status: 200 len: 1340 microversion: 2.1 time: 0.393311 Oct 17 14:20:29.315951 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3131/6126] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:28 2022] GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9 => generated 1340 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:29.360130 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5c1c3c45-d9f5-4632-a0a9-69be482746bc tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:29.372061 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5c1c3c45-d9f5-4632-a0a9-69be482746bc tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de" status: 200 len: 1691 microversion: 2.1 time: 0.428550 Oct 17 14:20:29.383357 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2996/6127] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:28 2022] GET /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de => generated 1691 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:20:30.266321 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-bbd9b906-db0a-4469-a9cf-0ceaac22658d req-73d73f2a-e421-490d-bcce-2a3c2f98f79c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96fea6e9-fc3f-4f05-84c8-d3d1b95827de", "tag": "55a75d23-87ee-4f6d-87ad-bdd8b1f942cc"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:20:30.273365 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=6 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:20:30.280870 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-bbd9b906-db0a-4469-a9cf-0ceaac22658d req-73d73f2a-e421-490d-bcce-2a3c2f98f79c service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:30.281353 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-bbd9b906-db0a-4469-a9cf-0ceaac22658d req-73d73f2a-e421-490d-bcce-2a3c2f98f79c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:30.281744 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-bbd9b906-db0a-4469-a9cf-0ceaac22658d req-73d73f2a-e421-490d-bcce-2a3c2f98f79c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:30.296841 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-bbd9b906-db0a-4469-a9cf-0ceaac22658d req-73d73f2a-e421-490d-bcce-2a3c2f98f79c service nova] Creating event network-changed:55a75d23-87ee-4f6d-87ad-bdd8b1f942cc for instance 96fea6e9-fc3f-4f05-84c8-d3d1b95827de on n-h1-854247-14 Oct 17 14:20:30.304278 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-bbd9b906-db0a-4469-a9cf-0ceaac22658d req-73d73f2a-e421-490d-bcce-2a3c2f98f79c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041806 Oct 17 14:20:30.304911 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3132/6128] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:20:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:20:30.362291 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-65d571d7-891d-4ce6-86c1-184683067848 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:30.363097 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-65d571d7-891d-4ce6-86c1-184683067848 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 37ac4563-7872-4787-8d42-87b04550bcd9] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:30.371880 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-65d571d7-891d-4ce6-86c1-184683067848 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:30.372362 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-65d571d7-891d-4ce6-86c1-184683067848 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:30.372807 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-65d571d7-891d-4ce6-86c1-184683067848 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:30.373658 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-65d571d7-891d-4ce6-86c1-184683067848 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:30.374388 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-65d571d7-891d-4ce6-86c1-184683067848 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:30.374817 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-65d571d7-891d-4ce6-86c1-184683067848 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:30.404213 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b679ce4c-e69b-402d-a200-dcf36279c9a2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:30.405163 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b679ce4c-e69b-402d-a200-dcf36279c9a2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 96fea6e9-fc3f-4f05-84c8-d3d1b95827de] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:30.412180 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b679ce4c-e69b-402d-a200-dcf36279c9a2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:30.412670 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b679ce4c-e69b-402d-a200-dcf36279c9a2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:30.413109 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b679ce4c-e69b-402d-a200-dcf36279c9a2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:30.413818 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b679ce4c-e69b-402d-a200-dcf36279c9a2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:30.414270 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b679ce4c-e69b-402d-a200-dcf36279c9a2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:30.414955 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b679ce4c-e69b-402d-a200-dcf36279c9a2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:30.721189 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b679ce4c-e69b-402d-a200-dcf36279c9a2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:30.730485 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b679ce4c-e69b-402d-a200-dcf36279c9a2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de" status: 200 len: 1691 microversion: 2.1 time: 0.330449 Oct 17 14:20:30.731797 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3133/6129] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:30 2022] GET /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de => generated 1691 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:30.777317 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-65d571d7-891d-4ce6-86c1-184683067848 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:30.793257 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-65d571d7-891d-4ce6-86c1-184683067848 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9" status: 200 len: 1340 microversion: 2.1 time: 0.435627 Oct 17 14:20:30.806777 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2997/6130] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:30 2022] GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9 => generated 1340 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:31.756142 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-39eb334c-e1af-4de9-aadb-26d4eeee8dbd tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:31.756766 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-39eb334c-e1af-4de9-aadb-26d4eeee8dbd tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 96fea6e9-fc3f-4f05-84c8-d3d1b95827de] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:31.764250 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-39eb334c-e1af-4de9-aadb-26d4eeee8dbd tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:31.765204 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-39eb334c-e1af-4de9-aadb-26d4eeee8dbd tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:31.765647 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-39eb334c-e1af-4de9-aadb-26d4eeee8dbd tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:31.766539 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-39eb334c-e1af-4de9-aadb-26d4eeee8dbd tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:31.767102 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-39eb334c-e1af-4de9-aadb-26d4eeee8dbd tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:31.767559 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-39eb334c-e1af-4de9-aadb-26d4eeee8dbd tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:31.820824 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6839679f-ad38-4540-914a-c1d8e0b6a0ab tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:31.821971 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6839679f-ad38-4540-914a-c1d8e0b6a0ab tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 37ac4563-7872-4787-8d42-87b04550bcd9] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:31.828267 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6839679f-ad38-4540-914a-c1d8e0b6a0ab tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:31.829670 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6839679f-ad38-4540-914a-c1d8e0b6a0ab tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:31.829670 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6839679f-ad38-4540-914a-c1d8e0b6a0ab tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:31.831453 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6839679f-ad38-4540-914a-c1d8e0b6a0ab tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:31.831453 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6839679f-ad38-4540-914a-c1d8e0b6a0ab tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:31.831846 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6839679f-ad38-4540-914a-c1d8e0b6a0ab tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:31.939100 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-39eb334c-e1af-4de9-aadb-26d4eeee8dbd tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:31.948845 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-39eb334c-e1af-4de9-aadb-26d4eeee8dbd tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de" status: 200 len: 1691 microversion: 2.1 time: 0.196841 Oct 17 14:20:31.949490 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3134/6131] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:31 2022] GET /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de => generated 1691 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:32.016376 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6839679f-ad38-4540-914a-c1d8e0b6a0ab tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:32.024620 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6839679f-ad38-4540-914a-c1d8e0b6a0ab tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9" status: 200 len: 1340 microversion: 2.1 time: 0.208765 Oct 17 14:20:32.025391 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2998/6132] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:31 2022] GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9 => generated 1340 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:20:32.975353 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-061213e7-ae6c-4eaf-a642-14968aedce0d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:32.975915 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-061213e7-ae6c-4eaf-a642-14968aedce0d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 96fea6e9-fc3f-4f05-84c8-d3d1b95827de] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:32.977998 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:20:32.978662 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=6 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:20:32.985328 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-061213e7-ae6c-4eaf-a642-14968aedce0d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:32.985803 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-061213e7-ae6c-4eaf-a642-14968aedce0d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:32.986230 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-061213e7-ae6c-4eaf-a642-14968aedce0d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:32.986941 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-061213e7-ae6c-4eaf-a642-14968aedce0d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:32.987425 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-061213e7-ae6c-4eaf-a642-14968aedce0d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:32.987826 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-061213e7-ae6c-4eaf-a642-14968aedce0d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:32.990585 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:20:33.048301 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2c833d7a-6be0-45b9-8c38-de084056006d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:33.048827 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2c833d7a-6be0-45b9-8c38-de084056006d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 37ac4563-7872-4787-8d42-87b04550bcd9] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:33.050857 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:20:33.057741 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2c833d7a-6be0-45b9-8c38-de084056006d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:33.058576 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2c833d7a-6be0-45b9-8c38-de084056006d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:33.059031 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2c833d7a-6be0-45b9-8c38-de084056006d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:33.059849 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2c833d7a-6be0-45b9-8c38-de084056006d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:33.060298 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2c833d7a-6be0-45b9-8c38-de084056006d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:33.060816 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2c833d7a-6be0-45b9-8c38-de084056006d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:33.157537 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-061213e7-ae6c-4eaf-a642-14968aedce0d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:33.166970 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-061213e7-ae6c-4eaf-a642-14968aedce0d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de" status: 200 len: 1691 microversion: 2.1 time: 0.195946 Oct 17 14:20:33.167927 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3135/6133] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:32 2022] GET /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de => generated 1691 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:33.216789 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2c833d7a-6be0-45b9-8c38-de084056006d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:33.225203 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2c833d7a-6be0-45b9-8c38-de084056006d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9" status: 200 len: 1340 microversion: 2.1 time: 0.180953 Oct 17 14:20:33.225792 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 2999/6134] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:33 2022] GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9 => generated 1340 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:34.190746 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5678902c-3f24-44d4-893c-c665ef38a6ff tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:34.191385 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5678902c-3f24-44d4-893c-c665ef38a6ff tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 96fea6e9-fc3f-4f05-84c8-d3d1b95827de] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:34.198466 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5678902c-3f24-44d4-893c-c665ef38a6ff tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:34.199716 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5678902c-3f24-44d4-893c-c665ef38a6ff tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:34.200354 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5678902c-3f24-44d4-893c-c665ef38a6ff tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:34.201061 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5678902c-3f24-44d4-893c-c665ef38a6ff tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:34.201511 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5678902c-3f24-44d4-893c-c665ef38a6ff tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:34.201915 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5678902c-3f24-44d4-893c-c665ef38a6ff tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:34.249077 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4121f844-0ec7-4da3-b6ba-754f98fb352e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:34.249704 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4121f844-0ec7-4da3-b6ba-754f98fb352e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 37ac4563-7872-4787-8d42-87b04550bcd9] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:34.257667 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4121f844-0ec7-4da3-b6ba-754f98fb352e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:34.258161 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4121f844-0ec7-4da3-b6ba-754f98fb352e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:34.258785 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4121f844-0ec7-4da3-b6ba-754f98fb352e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:34.259864 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4121f844-0ec7-4da3-b6ba-754f98fb352e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:34.260469 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4121f844-0ec7-4da3-b6ba-754f98fb352e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:34.261040 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4121f844-0ec7-4da3-b6ba-754f98fb352e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:34.471601 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5678902c-3f24-44d4-893c-c665ef38a6ff tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:34.480231 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5678902c-3f24-44d4-893c-c665ef38a6ff tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de" status: 200 len: 1691 microversion: 2.1 time: 0.293446 Oct 17 14:20:34.480820 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3136/6135] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:34 2022] GET /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de => generated 1691 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:34.524235 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4121f844-0ec7-4da3-b6ba-754f98fb352e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:34.532789 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4121f844-0ec7-4da3-b6ba-754f98fb352e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9" status: 200 len: 1340 microversion: 2.1 time: 0.287641 Oct 17 14:20:34.534024 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3000/6136] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:34 2022] GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9 => generated 1340 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:20:35.504739 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9451aae5-4ffe-4676-a195-3f605a3e9582 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:35.506210 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9451aae5-4ffe-4676-a195-3f605a3e9582 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 96fea6e9-fc3f-4f05-84c8-d3d1b95827de] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:35.514315 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9451aae5-4ffe-4676-a195-3f605a3e9582 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:35.514888 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9451aae5-4ffe-4676-a195-3f605a3e9582 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:35.515604 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9451aae5-4ffe-4676-a195-3f605a3e9582 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:35.516639 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9451aae5-4ffe-4676-a195-3f605a3e9582 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:35.517728 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9451aae5-4ffe-4676-a195-3f605a3e9582 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:35.518206 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9451aae5-4ffe-4676-a195-3f605a3e9582 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:35.558898 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c04ce9fd-1753-4cde-b7f6-7e586e9d8a00 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:35.561542 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c04ce9fd-1753-4cde-b7f6-7e586e9d8a00 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 37ac4563-7872-4787-8d42-87b04550bcd9] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:35.572265 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c04ce9fd-1753-4cde-b7f6-7e586e9d8a00 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:35.573340 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c04ce9fd-1753-4cde-b7f6-7e586e9d8a00 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:35.574005 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c04ce9fd-1753-4cde-b7f6-7e586e9d8a00 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:35.574942 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c04ce9fd-1753-4cde-b7f6-7e586e9d8a00 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:35.575986 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c04ce9fd-1753-4cde-b7f6-7e586e9d8a00 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:35.576623 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c04ce9fd-1753-4cde-b7f6-7e586e9d8a00 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:35.804147 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9451aae5-4ffe-4676-a195-3f605a3e9582 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:35.814344 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9451aae5-4ffe-4676-a195-3f605a3e9582 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de" status: 200 len: 1691 microversion: 2.1 time: 0.313273 Oct 17 14:20:35.814974 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3137/6137] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:35 2022] GET /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de => generated 1691 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:35.856713 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c04ce9fd-1753-4cde-b7f6-7e586e9d8a00 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:35.865613 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c04ce9fd-1753-4cde-b7f6-7e586e9d8a00 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9" status: 200 len: 1340 microversion: 2.1 time: 0.311941 Oct 17 14:20:35.866199 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3001/6138] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:35 2022] GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9 => generated 1340 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:36.838925 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b9dd2da6-082d-4889-a81f-9cff579067ec tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:36.839641 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b9dd2da6-082d-4889-a81f-9cff579067ec tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 96fea6e9-fc3f-4f05-84c8-d3d1b95827de] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:36.846926 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b9dd2da6-082d-4889-a81f-9cff579067ec tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:36.847673 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b9dd2da6-082d-4889-a81f-9cff579067ec tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:36.848236 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b9dd2da6-082d-4889-a81f-9cff579067ec tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:36.848939 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b9dd2da6-082d-4889-a81f-9cff579067ec tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:36.849393 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b9dd2da6-082d-4889-a81f-9cff579067ec tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:36.849820 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b9dd2da6-082d-4889-a81f-9cff579067ec tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:36.889043 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-91e72bde-e0ca-45d4-b57d-2e888dde0fae tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:36.889669 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-91e72bde-e0ca-45d4-b57d-2e888dde0fae tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 37ac4563-7872-4787-8d42-87b04550bcd9] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:36.897121 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-91e72bde-e0ca-45d4-b57d-2e888dde0fae tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:36.897630 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-91e72bde-e0ca-45d4-b57d-2e888dde0fae tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:36.898138 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-91e72bde-e0ca-45d4-b57d-2e888dde0fae tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:36.898839 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-91e72bde-e0ca-45d4-b57d-2e888dde0fae tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:36.899332 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-91e72bde-e0ca-45d4-b57d-2e888dde0fae tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:36.899773 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-91e72bde-e0ca-45d4-b57d-2e888dde0fae tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:37.047494 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b9dd2da6-082d-4889-a81f-9cff579067ec tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:37.056142 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b9dd2da6-082d-4889-a81f-9cff579067ec tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de" status: 200 len: 1681 microversion: 2.1 time: 0.221434 Oct 17 14:20:37.057233 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3138/6139] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:36 2022] GET /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de => generated 1681 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:37.077989 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-91e72bde-e0ca-45d4-b57d-2e888dde0fae tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:37.079019 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9cfbc216-2d12-4bab-9ae9-c0a66739aa4c tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:37.079880 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9cfbc216-2d12-4bab-9ae9-c0a66739aa4c tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] [instance: 96fea6e9-fc3f-4f05-84c8-d3d1b95827de] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:37.086464 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9cfbc216-2d12-4bab-9ae9-c0a66739aa4c tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:37.087138 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9cfbc216-2d12-4bab-9ae9-c0a66739aa4c tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:37.087815 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9cfbc216-2d12-4bab-9ae9-c0a66739aa4c tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:37.088699 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9cfbc216-2d12-4bab-9ae9-c0a66739aa4c tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:37.089293 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9cfbc216-2d12-4bab-9ae9-c0a66739aa4c tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:37.089856 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9cfbc216-2d12-4bab-9ae9-c0a66739aa4c tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:37.093879 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-91e72bde-e0ca-45d4-b57d-2e888dde0fae tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9" status: 200 len: 1340 microversion: 2.1 time: 0.202857 Oct 17 14:20:37.094503 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3002/6140] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:36 2022] GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9 => generated 1340 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:20:37.243455 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9cfbc216-2d12-4bab-9ae9-c0a66739aa4c tempest-TestNetworkAdvancedServerOps-1932385142 tempest-TestNetworkAdvancedServerOps-1932385142-project-admin] 10.222.0.79 "GET /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de" status: 200 len: 1834 microversion: 2.1 time: 0.168118 Oct 17 14:20:37.244075 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3139/6141] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:37 2022] GET /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de => generated 1834 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:20:37.267364 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-92daea27-e3cd-4a4e-9ce1-7041fd05cc5b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:37.268119 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-92daea27-e3cd-4a4e-9ce1-7041fd05cc5b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 96fea6e9-fc3f-4f05-84c8-d3d1b95827de] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:37.275273 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-92daea27-e3cd-4a4e-9ce1-7041fd05cc5b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:37.275943 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-92daea27-e3cd-4a4e-9ce1-7041fd05cc5b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:37.276404 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-92daea27-e3cd-4a4e-9ce1-7041fd05cc5b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:37.277166 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-92daea27-e3cd-4a4e-9ce1-7041fd05cc5b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:37.277636 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-92daea27-e3cd-4a4e-9ce1-7041fd05cc5b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:37.278074 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-92daea27-e3cd-4a4e-9ce1-7041fd05cc5b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:37.418884 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-92daea27-e3cd-4a4e-9ce1-7041fd05cc5b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:37.427632 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-92daea27-e3cd-4a4e-9ce1-7041fd05cc5b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de" status: 200 len: 1681 microversion: 2.1 time: 0.164576 Oct 17 14:20:37.428248 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3003/6142] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:37 2022] GET /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:37.527630 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-554cc1ed-2d29-4e7f-849f-2e3b580f49b9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:20:37.529914 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-554cc1ed-2d29-4e7f-849f-2e3b580f49b9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 96fea6e9-fc3f-4f05-84c8-d3d1b95827de] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:37.536613 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-554cc1ed-2d29-4e7f-849f-2e3b580f49b9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:37.537232 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-554cc1ed-2d29-4e7f-849f-2e3b580f49b9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:37.537710 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-554cc1ed-2d29-4e7f-849f-2e3b580f49b9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:37.538412 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-554cc1ed-2d29-4e7f-849f-2e3b580f49b9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:37.538862 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-554cc1ed-2d29-4e7f-849f-2e3b580f49b9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:37.539307 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-554cc1ed-2d29-4e7f-849f-2e3b580f49b9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:37.592028 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-554cc1ed-2d29-4e7f-849f-2e3b580f49b9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "POST /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de/action" status: 200 len: 38643 microversion: 2.1 time: 0.067886 Oct 17 14:20:37.601563 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3140/6143] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:20:37 2022] POST /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de/action => generated 38643 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:20:38.118581 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-419113ad-76ee-4bdf-9ab4-66c8c9b55d38 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:38.119333 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-419113ad-76ee-4bdf-9ab4-66c8c9b55d38 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 37ac4563-7872-4787-8d42-87b04550bcd9] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:38.126836 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-419113ad-76ee-4bdf-9ab4-66c8c9b55d38 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:38.127383 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-419113ad-76ee-4bdf-9ab4-66c8c9b55d38 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:38.127843 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-419113ad-76ee-4bdf-9ab4-66c8c9b55d38 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:38.128575 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-419113ad-76ee-4bdf-9ab4-66c8c9b55d38 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:38.129047 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-419113ad-76ee-4bdf-9ab4-66c8c9b55d38 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:38.129683 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-419113ad-76ee-4bdf-9ab4-66c8c9b55d38 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:38.272528 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-419113ad-76ee-4bdf-9ab4-66c8c9b55d38 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:38.281140 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-419113ad-76ee-4bdf-9ab4-66c8c9b55d38 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9" status: 200 len: 1340 microversion: 2.1 time: 0.166536 Oct 17 14:20:38.281761 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3004/6144] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:38 2022] GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9 => generated 1340 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:39.306856 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a92bc4fc-eb95-467f-9b16-e32042c8b6b2 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:39.307521 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a92bc4fc-eb95-467f-9b16-e32042c8b6b2 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 37ac4563-7872-4787-8d42-87b04550bcd9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:39.316818 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a92bc4fc-eb95-467f-9b16-e32042c8b6b2 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:39.317300 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a92bc4fc-eb95-467f-9b16-e32042c8b6b2 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:39.317746 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a92bc4fc-eb95-467f-9b16-e32042c8b6b2 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:39.318434 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a92bc4fc-eb95-467f-9b16-e32042c8b6b2 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:39.318904 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a92bc4fc-eb95-467f-9b16-e32042c8b6b2 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:39.319400 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a92bc4fc-eb95-467f-9b16-e32042c8b6b2 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:39.464225 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a92bc4fc-eb95-467f-9b16-e32042c8b6b2 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:39.472940 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a92bc4fc-eb95-467f-9b16-e32042c8b6b2 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9" status: 200 len: 1374 microversion: 2.1 time: 0.171113 Oct 17 14:20:39.473513 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3141/6145] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:39 2022] GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9 => generated 1374 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:40.497519 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-589d65ef-12d0-4a56-8b66-74ca8597cfae tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:40.498320 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-589d65ef-12d0-4a56-8b66-74ca8597cfae tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 37ac4563-7872-4787-8d42-87b04550bcd9] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:40.505955 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-589d65ef-12d0-4a56-8b66-74ca8597cfae tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:40.506452 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-589d65ef-12d0-4a56-8b66-74ca8597cfae tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:40.506903 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-589d65ef-12d0-4a56-8b66-74ca8597cfae tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:40.507883 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-589d65ef-12d0-4a56-8b66-74ca8597cfae tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:40.508592 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-589d65ef-12d0-4a56-8b66-74ca8597cfae tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:40.509019 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-589d65ef-12d0-4a56-8b66-74ca8597cfae tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:40.660838 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-589d65ef-12d0-4a56-8b66-74ca8597cfae tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:40.669140 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-589d65ef-12d0-4a56-8b66-74ca8597cfae tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9" status: 200 len: 1374 microversion: 2.1 time: 0.175653 Oct 17 14:20:40.669695 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3005/6146] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:40 2022] GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9 => generated 1374 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:41.692184 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-dd35a98a-f2d2-471b-80fb-78b002fbb4dc tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:41.692879 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-dd35a98a-f2d2-471b-80fb-78b002fbb4dc tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 37ac4563-7872-4787-8d42-87b04550bcd9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:41.700997 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dd35a98a-f2d2-471b-80fb-78b002fbb4dc tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:41.701447 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dd35a98a-f2d2-471b-80fb-78b002fbb4dc tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:41.701876 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dd35a98a-f2d2-471b-80fb-78b002fbb4dc tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:41.702655 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dd35a98a-f2d2-471b-80fb-78b002fbb4dc tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:41.703205 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dd35a98a-f2d2-471b-80fb-78b002fbb4dc tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:41.703630 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dd35a98a-f2d2-471b-80fb-78b002fbb4dc tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:41.905694 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-dd35a98a-f2d2-471b-80fb-78b002fbb4dc tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:41.914634 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-dd35a98a-f2d2-471b-80fb-78b002fbb4dc tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9" status: 200 len: 1374 microversion: 2.1 time: 0.226671 Oct 17 14:20:41.915705 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3142/6147] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:41 2022] GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9 => generated 1374 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:42.008629 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c20cd205-ed63-4be1-9c5e-e4f0391b4031 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:42.009172 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c20cd205-ed63-4be1-9c5e-e4f0391b4031 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 96fea6e9-fc3f-4f05-84c8-d3d1b95827de] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:42.018133 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c20cd205-ed63-4be1-9c5e-e4f0391b4031 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:42.018638 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c20cd205-ed63-4be1-9c5e-e4f0391b4031 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:42.019295 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c20cd205-ed63-4be1-9c5e-e4f0391b4031 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:42.020238 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c20cd205-ed63-4be1-9c5e-e4f0391b4031 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:42.020775 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c20cd205-ed63-4be1-9c5e-e4f0391b4031 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:42.021461 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c20cd205-ed63-4be1-9c5e-e4f0391b4031 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:42.050461 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c20cd205-ed63-4be1-9c5e-e4f0391b4031 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 96fea6e9-fc3f-4f05-84c8-d3d1b95827de] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:20:42.084493 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-e4f27615-be39-40fc-9728-3bda038654ee req-138d1515-dea3-47ab-beb5-5b8fc3ba3f75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96fea6e9-fc3f-4f05-84c8-d3d1b95827de", "tag": "55a75d23-87ee-4f6d-87ad-bdd8b1f942cc"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:20:42.097238 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-e4f27615-be39-40fc-9728-3bda038654ee req-138d1515-dea3-47ab-beb5-5b8fc3ba3f75 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:42.097238 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-e4f27615-be39-40fc-9728-3bda038654ee req-138d1515-dea3-47ab-beb5-5b8fc3ba3f75 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:42.097539 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-e4f27615-be39-40fc-9728-3bda038654ee req-138d1515-dea3-47ab-beb5-5b8fc3ba3f75 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:42.113243 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-e4f27615-be39-40fc-9728-3bda038654ee req-138d1515-dea3-47ab-beb5-5b8fc3ba3f75 service nova] Creating event network-changed:55a75d23-87ee-4f6d-87ad-bdd8b1f942cc for instance 96fea6e9-fc3f-4f05-84c8-d3d1b95827de on n-h2-854247-14 Oct 17 14:20:42.118852 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-e4f27615-be39-40fc-9728-3bda038654ee req-138d1515-dea3-47ab-beb5-5b8fc3ba3f75 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112494 Oct 17 14:20:42.123134 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3143/6148] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:20:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:20:42.153158 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c20cd205-ed63-4be1-9c5e-e4f0391b4031 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "DELETE /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de" status: 204 len: 0 microversion: 2.1 time: 0.148756 Oct 17 14:20:42.153904 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3006/6149] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:20:42 2022] DELETE /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:20:42.165671 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-47efd2d6-c154-404f-aa59-1682ecc2c609 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:42.166457 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-47efd2d6-c154-404f-aa59-1682ecc2c609 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 96fea6e9-fc3f-4f05-84c8-d3d1b95827de] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:42.173987 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-47efd2d6-c154-404f-aa59-1682ecc2c609 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:42.175037 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-47efd2d6-c154-404f-aa59-1682ecc2c609 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:42.176027 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-47efd2d6-c154-404f-aa59-1682ecc2c609 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:42.176992 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-47efd2d6-c154-404f-aa59-1682ecc2c609 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:42.178162 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-47efd2d6-c154-404f-aa59-1682ecc2c609 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:42.179921 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-47efd2d6-c154-404f-aa59-1682ecc2c609 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:42.397157 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-47efd2d6-c154-404f-aa59-1682ecc2c609 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:42.410367 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-47efd2d6-c154-404f-aa59-1682ecc2c609 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de" status: 200 len: 1687 microversion: 2.1 time: 0.251716 Oct 17 14:20:42.411667 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3144/6150] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:42 2022] GET /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de => generated 1687 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:42.939613 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-63c02988-43a4-4acd-9d29-166eceed0411 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:42.940512 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-63c02988-43a4-4acd-9d29-166eceed0411 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 37ac4563-7872-4787-8d42-87b04550bcd9] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:42.947657 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-63c02988-43a4-4acd-9d29-166eceed0411 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:42.949434 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-63c02988-43a4-4acd-9d29-166eceed0411 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:42.952116 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-63c02988-43a4-4acd-9d29-166eceed0411 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:42.952717 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-63c02988-43a4-4acd-9d29-166eceed0411 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:42.953311 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-63c02988-43a4-4acd-9d29-166eceed0411 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:42.953892 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-63c02988-43a4-4acd-9d29-166eceed0411 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:43.400097 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-63c02988-43a4-4acd-9d29-166eceed0411 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:43.410972 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-63c02988-43a4-4acd-9d29-166eceed0411 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9" status: 200 len: 1374 microversion: 2.1 time: 0.475866 Oct 17 14:20:43.412017 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3007/6151] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:42 2022] GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9 => generated 1374 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:43.436505 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c9a0db63-4252-4e31-ac6f-27e6ae0e6dca tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:43.437497 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c9a0db63-4252-4e31-ac6f-27e6ae0e6dca tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 96fea6e9-fc3f-4f05-84c8-d3d1b95827de] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:43.446299 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c9a0db63-4252-4e31-ac6f-27e6ae0e6dca tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:43.446838 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c9a0db63-4252-4e31-ac6f-27e6ae0e6dca tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:43.447317 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c9a0db63-4252-4e31-ac6f-27e6ae0e6dca tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:43.448281 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c9a0db63-4252-4e31-ac6f-27e6ae0e6dca tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:43.448923 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c9a0db63-4252-4e31-ac6f-27e6ae0e6dca tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:43.449419 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c9a0db63-4252-4e31-ac6f-27e6ae0e6dca tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:43.658869 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c9a0db63-4252-4e31-ac6f-27e6ae0e6dca tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:43.668583 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c9a0db63-4252-4e31-ac6f-27e6ae0e6dca tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de" status: 200 len: 1687 microversion: 2.1 time: 0.237674 Oct 17 14:20:43.669503 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3145/6152] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:43 2022] GET /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de => generated 1687 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:44.136849 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-27953270-22c9-47c5-a11a-cb19b84496d1 req-be0d0513-3609-4a80-95d1-d0d2859cc37c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96fea6e9-fc3f-4f05-84c8-d3d1b95827de", "name": "network-vif-deleted", "tag": "55a75d23-87ee-4f6d-87ad-bdd8b1f942cc"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:20:44.150414 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-27953270-22c9-47c5-a11a-cb19b84496d1 req-be0d0513-3609-4a80-95d1-d0d2859cc37c service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:44.151011 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-27953270-22c9-47c5-a11a-cb19b84496d1 req-be0d0513-3609-4a80-95d1-d0d2859cc37c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:44.151526 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-27953270-22c9-47c5-a11a-cb19b84496d1 req-be0d0513-3609-4a80-95d1-d0d2859cc37c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:44.166125 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-27953270-22c9-47c5-a11a-cb19b84496d1 req-be0d0513-3609-4a80-95d1-d0d2859cc37c service nova] Creating event network-vif-deleted:55a75d23-87ee-4f6d-87ad-bdd8b1f942cc for instance 96fea6e9-fc3f-4f05-84c8-d3d1b95827de on n-h2-854247-14 Oct 17 14:20:44.173443 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-27953270-22c9-47c5-a11a-cb19b84496d1 req-be0d0513-3609-4a80-95d1-d0d2859cc37c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041494 Oct 17 14:20:44.174179 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3008/6153] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:20:44.437764 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-927d4344-9e70-4c10-992c-230820e70387 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:44.438649 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-927d4344-9e70-4c10-992c-230820e70387 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 37ac4563-7872-4787-8d42-87b04550bcd9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:44.445176 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-927d4344-9e70-4c10-992c-230820e70387 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:44.445652 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-927d4344-9e70-4c10-992c-230820e70387 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:44.446061 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-927d4344-9e70-4c10-992c-230820e70387 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:44.446746 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-927d4344-9e70-4c10-992c-230820e70387 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:44.447197 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-927d4344-9e70-4c10-992c-230820e70387 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:44.447659 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-927d4344-9e70-4c10-992c-230820e70387 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:44.587821 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-927d4344-9e70-4c10-992c-230820e70387 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:44.596667 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-927d4344-9e70-4c10-992c-230820e70387 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9" status: 200 len: 1374 microversion: 2.1 time: 0.163484 Oct 17 14:20:44.597245 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3146/6154] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:44 2022] GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9 => generated 1374 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:44.695570 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-06c39c71-7de9-4670-ab4a-3d5d67545b17 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:44.696321 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-06c39c71-7de9-4670-ab4a-3d5d67545b17 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: 96fea6e9-fc3f-4f05-84c8-d3d1b95827de] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:44.703636 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-06c39c71-7de9-4670-ab4a-3d5d67545b17 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:44.704385 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-06c39c71-7de9-4670-ab4a-3d5d67545b17 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:44.704942 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-06c39c71-7de9-4670-ab4a-3d5d67545b17 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:44.705746 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-06c39c71-7de9-4670-ab4a-3d5d67545b17 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:44.706213 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-06c39c71-7de9-4670-ab4a-3d5d67545b17 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:44.706793 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-06c39c71-7de9-4670-ab4a-3d5d67545b17 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:44.721850 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-06c39c71-7de9-4670-ab4a-3d5d67545b17 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] HTTP exception thrown: Instance 96fea6e9-fc3f-4f05-84c8-d3d1b95827de could not be found. Oct 17 14:20:44.723692 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-06c39c71-7de9-4670-ab4a-3d5d67545b17 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Request method failure captured: Oct 17 14:20:44.723692 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de HTTP/1.1 Oct 17 14:20:44.723692 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 14:20:44.723692 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 14:20:44.723692 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 14:20:44.723692 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 14:20:44.723692 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 14:20:44.723692 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 14:20:44.723692 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 14:20:44.723692 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 14:20:44.723692 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTWN_WrnZNIuDTcmCFjSsEmdvqNJb4iEetQ3NxsmaqSa1gwOg9ZMQNLgw9m4eq9PNIu6JcojHQuHnBeD-_gAkuh_GorIQhe3sJ55RCndYbwHTO1kgdWN1Q2vFJpwxSY5RixlKnQqd0DcKtCXSNr1JwLh4U5fWK7dcxbe5fH3jeWLj4Sg Oct 17 14:20:44.723692 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 14:20:44.723692 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 14:20:44.723692 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 14:20:44.723692 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 14:20:44.723692 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 14:20:44.723692 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 14:20:44.723692 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: b8c8fe6f805f43798c9910296df4b8ab Oct 17 14:20:44.723692 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1095470143 Oct 17 14:20:44.723692 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 14:20:44.723692 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 14:20:44.723692 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b8c8fe6f805f43798c9910296df4b8ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b8c8fe6f805f43798c9910296df4b8ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b8c8fe6f805f43798c9910296df4b8ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b8c8fe6f805f43798c9910296df4b8ab", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:20:44.723692 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1095470143 Oct 17 14:20:44.723692 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: b8c8fe6f805f43798c9910296df4b8ab Oct 17 14:20:44.723692 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1095470143 Oct 17 14:20:44.723692 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-TestNetworkAdvancedServerOps-1095470143-project Oct 17 14:20:44.723692 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 14:20:44.723692 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 14:20:44.723692 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 024275cf6f8d423992e61d92dea927ba Oct 17 14:20:44.723692 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1095470143-project Oct 17 14:20:44.723692 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 14:20:44.723692 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 96fea6e9-fc3f-4f05-84c8-d3d1b95827de could not be found. Oct 17 14:20:44.723692 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '96fea6e9-fc3f-4f05-84c8-d3d1b95827de'} Oct 17 14:20:44.723692 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:20:44.723692 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:20:44.723692 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:20:44.723692 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:20:44.723692 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:20:44.723692 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:20:44.723692 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:20:44.723692 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:20:44.723692 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:20:44.723692 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:20:44.723692 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96fea6e9-fc3f-4f05-84c8-d3d1b95827de could not be found. Oct 17 14:20:44.723692 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:20:44.723692 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:20:44.723692 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:20:44.723692 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:20:44.723692 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:20:44.723692 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:20:44.723692 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:20:44.723692 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:20:44.723692 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:20:44.723692 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:20:44.723692 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:20:44.723692 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:20:44.723692 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:20:44.723692 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:20:44.723692 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:20:44.723692 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:20:44.723692 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96fea6e9-fc3f-4f05-84c8-d3d1b95827de could not be found. Oct 17 14:20:44.723692 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:20:44.723692 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:20:44.731668 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:20:44.731668 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:20:44.731668 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:20:44.731668 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:20:44.731668 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:20:44.731668 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:20:44.731668 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96fea6e9-fc3f-4f05-84c8-d3d1b95827de could not be found. Oct 17 14:20:44.731668 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:20:44.731668 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-06c39c71-7de9-4670-ab4a-3d5d67545b17 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Returning 404 to user: Instance 96fea6e9-fc3f-4f05-84c8-d3d1b95827de could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:20:44.731668 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-06c39c71-7de9-4670-ab4a-3d5d67545b17 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de" status: 404 len: 111 microversion: 2.1 time: 0.034665 Oct 17 14:20:44.731668 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3009/6155] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:44 2022] GET /compute/v2.1/servers/96fea6e9-fc3f-4f05-84c8-d3d1b95827de => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:20:45.619960 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6dbb5ec4-afdd-4b72-b712-6d9211e916f7 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:45.620908 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6dbb5ec4-afdd-4b72-b712-6d9211e916f7 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 37ac4563-7872-4787-8d42-87b04550bcd9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:45.627870 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6dbb5ec4-afdd-4b72-b712-6d9211e916f7 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:45.628347 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6dbb5ec4-afdd-4b72-b712-6d9211e916f7 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:45.628773 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6dbb5ec4-afdd-4b72-b712-6d9211e916f7 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:45.629468 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6dbb5ec4-afdd-4b72-b712-6d9211e916f7 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:45.629912 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6dbb5ec4-afdd-4b72-b712-6d9211e916f7 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:45.630356 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6dbb5ec4-afdd-4b72-b712-6d9211e916f7 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:45.890920 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6dbb5ec4-afdd-4b72-b712-6d9211e916f7 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:45.899562 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6dbb5ec4-afdd-4b72-b712-6d9211e916f7 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9" status: 200 len: 1374 microversion: 2.1 time: 0.283536 Oct 17 14:20:45.900251 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3147/6156] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:45 2022] GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9 => generated 1374 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:46.923441 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c08cd462-561d-47f5-a01a-00b51f8e6f27 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:46.924185 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c08cd462-561d-47f5-a01a-00b51f8e6f27 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 37ac4563-7872-4787-8d42-87b04550bcd9] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:46.939610 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:20:46.946416 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c08cd462-561d-47f5-a01a-00b51f8e6f27 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:46.946954 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c08cd462-561d-47f5-a01a-00b51f8e6f27 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:46.947643 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c08cd462-561d-47f5-a01a-00b51f8e6f27 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:46.948858 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c08cd462-561d-47f5-a01a-00b51f8e6f27 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:46.952189 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c08cd462-561d-47f5-a01a-00b51f8e6f27 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:46.952923 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c08cd462-561d-47f5-a01a-00b51f8e6f27 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:47.194747 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c08cd462-561d-47f5-a01a-00b51f8e6f27 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:47.217876 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-a4957f37-7f25-4745-a0a9-baeaf1a148f6 req-5fa08da6-74bb-45f0-88f2-4d72c8d6934f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37ac4563-7872-4787-8d42-87b04550bcd9", "name": "network-vif-plugged", "status": "completed", "tag": "36e365c2-2bff-4bc1-b49e-ad6454cbb811"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:20:47.226301 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c08cd462-561d-47f5-a01a-00b51f8e6f27 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9" status: 200 len: 1374 microversion: 2.1 time: 0.304323 Oct 17 14:20:47.227197 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3010/6157] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:46 2022] GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9 => generated 1374 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:47.233919 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-a4957f37-7f25-4745-a0a9-baeaf1a148f6 req-5fa08da6-74bb-45f0-88f2-4d72c8d6934f service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:47.234541 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-a4957f37-7f25-4745-a0a9-baeaf1a148f6 req-5fa08da6-74bb-45f0-88f2-4d72c8d6934f service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:47.235669 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-a4957f37-7f25-4745-a0a9-baeaf1a148f6 req-5fa08da6-74bb-45f0-88f2-4d72c8d6934f service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:47.260697 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-a4957f37-7f25-4745-a0a9-baeaf1a148f6 req-5fa08da6-74bb-45f0-88f2-4d72c8d6934f service nova] Creating event network-vif-plugged:36e365c2-2bff-4bc1-b49e-ad6454cbb811 for instance 37ac4563-7872-4787-8d42-87b04550bcd9 on n-h1-854247-14 Oct 17 14:20:47.267437 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-a4957f37-7f25-4745-a0a9-baeaf1a148f6 req-5fa08da6-74bb-45f0-88f2-4d72c8d6934f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165068 Oct 17 14:20:47.268351 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3148/6158] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:20:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:20:48.250397 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-50c48e5c-404b-4650-ad4e-e229540290a1 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:48.251023 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-50c48e5c-404b-4650-ad4e-e229540290a1 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 37ac4563-7872-4787-8d42-87b04550bcd9] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:48.258916 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-50c48e5c-404b-4650-ad4e-e229540290a1 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:48.259510 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-50c48e5c-404b-4650-ad4e-e229540290a1 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:48.260003 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-50c48e5c-404b-4650-ad4e-e229540290a1 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:48.260738 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-50c48e5c-404b-4650-ad4e-e229540290a1 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:48.261392 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-50c48e5c-404b-4650-ad4e-e229540290a1 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:48.261849 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-50c48e5c-404b-4650-ad4e-e229540290a1 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:48.294816 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a8c8e2a3-f727-4d75-8b30-4ba1adaa2f3c tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '.version_select at 0x7f7cd45b4af0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:48.335218 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a8c8e2a3-f727-4d75-8b30-4ba1adaa2f3c tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-677819581" status: 202 len: 0 microversion: 2.1 time: 0.049206 Oct 17 14:20:48.337966 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3149/6159] 10.222.0.79 () {58 vars in 1281 bytes} [Mon Oct 17 14:20:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-677819581 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:20:48.370435 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-389156ee-eac0-4a5c-af50-761e720a2151 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Action: 'create', calling method: .version_select at 0x7f7cd42321f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1938839478", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAngsCdxl+GA2WEW1Q/gf3hMn7vS90GnjHVikVa857r3xoSneBvXTVRzQOH3kP2lMikCef88AmNmzLZaHlFYHeOvEvKdt8k2PIsaUm8HxqeSajmgBPjPiW90ZbhBY0MHBA=="}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:20:48.393548 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-389156ee-eac0-4a5c-af50-761e720a2151 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Getting quotas for project b8c8fe6f805f43798c9910296df4b8ab. Resources: {'key_pairs'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:20:48.400006 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-389156ee-eac0-4a5c-af50-761e720a2151 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Getting quotas for user 024275cf6f8d423992e61d92dea927ba and project b8c8fe6f805f43798c9910296df4b8ab. Resources: {'key_pairs'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:20:48.444810 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-389156ee-eac0-4a5c-af50-761e720a2151 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.079474 Oct 17 14:20:48.445996 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3150/6160] 10.222.0.79 () {60 vars in 1159 bytes} [Mon Oct 17 14:20:48 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:20:48.461130 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-50c48e5c-404b-4650-ad4e-e229540290a1 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:48.463858 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:20:48.473785 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-50c48e5c-404b-4650-ad4e-e229540290a1 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9" status: 200 len: 1374 microversion: 2.1 time: 0.227359 Oct 17 14:20:48.474542 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3011/6161] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:48 2022] GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9 => generated 1374 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:49.500378 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f98f9c62-7278-476a-a44b-073ec6d94331 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:49.501548 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f98f9c62-7278-476a-a44b-073ec6d94331 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 37ac4563-7872-4787-8d42-87b04550bcd9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:49.509531 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f98f9c62-7278-476a-a44b-073ec6d94331 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:49.510157 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f98f9c62-7278-476a-a44b-073ec6d94331 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:49.510872 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f98f9c62-7278-476a-a44b-073ec6d94331 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:49.511568 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f98f9c62-7278-476a-a44b-073ec6d94331 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:49.512377 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f98f9c62-7278-476a-a44b-073ec6d94331 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:49.512907 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f98f9c62-7278-476a-a44b-073ec6d94331 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:49.662472 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f98f9c62-7278-476a-a44b-073ec6d94331 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:49.671644 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f98f9c62-7278-476a-a44b-073ec6d94331 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9" status: 200 len: 1561 microversion: 2.1 time: 0.177377 Oct 17 14:20:49.672310 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3151/6162] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:49 2022] GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9 => generated 1561 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:49.696584 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-af3bfa63-abf0-48ac-a8cd-c2bd23857fa2 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:49.697518 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-af3bfa63-abf0-48ac-a8cd-c2bd23857fa2 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 37ac4563-7872-4787-8d42-87b04550bcd9] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:49.707582 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-af3bfa63-abf0-48ac-a8cd-c2bd23857fa2 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:49.708512 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-af3bfa63-abf0-48ac-a8cd-c2bd23857fa2 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:49.709109 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-af3bfa63-abf0-48ac-a8cd-c2bd23857fa2 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:49.710304 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-af3bfa63-abf0-48ac-a8cd-c2bd23857fa2 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:49.710772 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-af3bfa63-abf0-48ac-a8cd-c2bd23857fa2 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:49.711308 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-af3bfa63-abf0-48ac-a8cd-c2bd23857fa2 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:50.026528 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-af3bfa63-abf0-48ac-a8cd-c2bd23857fa2 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:50.036617 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-af3bfa63-abf0-48ac-a8cd-c2bd23857fa2 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9" status: 200 len: 1561 microversion: 2.1 time: 0.344953 Oct 17 14:20:50.037250 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3012/6163] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:49 2022] GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9 => generated 1561 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:50.130044 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-371e1140-875a-41b6-83da-55fc4ef394eb tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:50.130622 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-371e1140-875a-41b6-83da-55fc4ef394eb tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 37ac4563-7872-4787-8d42-87b04550bcd9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:50.136888 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-371e1140-875a-41b6-83da-55fc4ef394eb tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:50.137644 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-371e1140-875a-41b6-83da-55fc4ef394eb tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:50.138175 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-371e1140-875a-41b6-83da-55fc4ef394eb tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:50.138884 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-371e1140-875a-41b6-83da-55fc4ef394eb tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:50.139369 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-371e1140-875a-41b6-83da-55fc4ef394eb tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:50.139799 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-371e1140-875a-41b6-83da-55fc4ef394eb tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:50.170757 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-371e1140-875a-41b6-83da-55fc4ef394eb tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 37ac4563-7872-4787-8d42-87b04550bcd9] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:20:50.255228 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-371e1140-875a-41b6-83da-55fc4ef394eb tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "DELETE /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9" status: 204 len: 0 microversion: 2.1 time: 0.128869 Oct 17 14:20:50.255743 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3152/6164] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:20:50 2022] DELETE /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:20:50.265379 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2ed6b2cd-4c62-4c5a-801e-f720db95b770 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:50.266018 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2ed6b2cd-4c62-4c5a-801e-f720db95b770 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 37ac4563-7872-4787-8d42-87b04550bcd9] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:50.272397 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2ed6b2cd-4c62-4c5a-801e-f720db95b770 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:50.272905 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2ed6b2cd-4c62-4c5a-801e-f720db95b770 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:50.273363 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2ed6b2cd-4c62-4c5a-801e-f720db95b770 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:50.274069 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2ed6b2cd-4c62-4c5a-801e-f720db95b770 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:50.274534 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2ed6b2cd-4c62-4c5a-801e-f720db95b770 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:50.274979 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2ed6b2cd-4c62-4c5a-801e-f720db95b770 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:50.866810 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2ed6b2cd-4c62-4c5a-801e-f720db95b770 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:50.876644 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2ed6b2cd-4c62-4c5a-801e-f720db95b770 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9" status: 200 len: 1567 microversion: 2.1 time: 0.615466 Oct 17 14:20:50.877329 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3013/6165] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:50 2022] GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9 => generated 1567 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:51.901644 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cef128cf-adb5-4e4f-9e22-53292d8f1389 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:51.902388 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cef128cf-adb5-4e4f-9e22-53292d8f1389 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 37ac4563-7872-4787-8d42-87b04550bcd9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:51.911750 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cef128cf-adb5-4e4f-9e22-53292d8f1389 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:51.912479 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cef128cf-adb5-4e4f-9e22-53292d8f1389 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:51.913063 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cef128cf-adb5-4e4f-9e22-53292d8f1389 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:51.913947 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cef128cf-adb5-4e4f-9e22-53292d8f1389 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:51.914542 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cef128cf-adb5-4e4f-9e22-53292d8f1389 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:51.915277 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cef128cf-adb5-4e4f-9e22-53292d8f1389 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:52.140837 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cef128cf-adb5-4e4f-9e22-53292d8f1389 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:52.143705 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:20:52.155061 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cef128cf-adb5-4e4f-9e22-53292d8f1389 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9" status: 200 len: 1567 microversion: 2.1 time: 0.256742 Oct 17 14:20:52.156019 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3153/6166] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:51 2022] GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9 => generated 1567 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:52.402328 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-50c39b80-5c1f-4cbc-9c72-877a6811df8e req-6ce3b98a-d370-4204-8e6c-bc0f5c464e6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37ac4563-7872-4787-8d42-87b04550bcd9", "name": "network-vif-deleted", "tag": "36e365c2-2bff-4bc1-b49e-ad6454cbb811"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:20:52.421303 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-50c39b80-5c1f-4cbc-9c72-877a6811df8e req-6ce3b98a-d370-4204-8e6c-bc0f5c464e6b service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:52.422080 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-50c39b80-5c1f-4cbc-9c72-877a6811df8e req-6ce3b98a-d370-4204-8e6c-bc0f5c464e6b service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:52.422977 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-50c39b80-5c1f-4cbc-9c72-877a6811df8e req-6ce3b98a-d370-4204-8e6c-bc0f5c464e6b service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:52.452180 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-50c39b80-5c1f-4cbc-9c72-877a6811df8e req-6ce3b98a-d370-4204-8e6c-bc0f5c464e6b service nova] Creating event network-vif-deleted:36e365c2-2bff-4bc1-b49e-ad6454cbb811 for instance 37ac4563-7872-4787-8d42-87b04550bcd9 on n-h1-854247-14 Oct 17 14:20:52.457861 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-50c39b80-5c1f-4cbc-9c72-877a6811df8e req-6ce3b98a-d370-4204-8e6c-bc0f5c464e6b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059064 Oct 17 14:20:52.458654 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3014/6167] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:20:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:20:53.179979 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-62cef01f-f434-45ab-853a-6c1501cc60c3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:53.180745 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-62cef01f-f434-45ab-853a-6c1501cc60c3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 37ac4563-7872-4787-8d42-87b04550bcd9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:53.189287 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-62cef01f-f434-45ab-853a-6c1501cc60c3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:53.190098 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-62cef01f-f434-45ab-853a-6c1501cc60c3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:53.190814 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-62cef01f-f434-45ab-853a-6c1501cc60c3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:53.191975 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-62cef01f-f434-45ab-853a-6c1501cc60c3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:53.192647 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-62cef01f-f434-45ab-853a-6c1501cc60c3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:53.193271 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-62cef01f-f434-45ab-853a-6c1501cc60c3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:53.335331 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-62cef01f-f434-45ab-853a-6c1501cc60c3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:53.346751 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-62cef01f-f434-45ab-853a-6c1501cc60c3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9" status: 200 len: 1359 microversion: 2.1 time: 0.171099 Oct 17 14:20:53.347697 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3154/6168] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:53 2022] GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:54.374448 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6950f6cc-b21e-4a4e-afd0-3d11513f16f3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:54.375828 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6950f6cc-b21e-4a4e-afd0-3d11513f16f3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 37ac4563-7872-4787-8d42-87b04550bcd9] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:54.383698 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6950f6cc-b21e-4a4e-afd0-3d11513f16f3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:54.384446 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6950f6cc-b21e-4a4e-afd0-3d11513f16f3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:54.385051 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6950f6cc-b21e-4a4e-afd0-3d11513f16f3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:54.385925 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6950f6cc-b21e-4a4e-afd0-3d11513f16f3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:54.390916 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6950f6cc-b21e-4a4e-afd0-3d11513f16f3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:54.391627 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6950f6cc-b21e-4a4e-afd0-3d11513f16f3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:54.496474 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6950f6cc-b21e-4a4e-afd0-3d11513f16f3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:54.509291 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6950f6cc-b21e-4a4e-afd0-3d11513f16f3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9" status: 200 len: 1359 microversion: 2.1 time: 0.139404 Oct 17 14:20:54.510149 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3015/6169] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:54 2022] GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9 => generated 1359 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:20:55.254502 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-34ba5227-d519-4fa7-aeb3-e4c154c09bec tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1279296438", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "0c2511ed-50a8-4a9f-acfe-6c2d50c58a14"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1938839478", "security_groups": [{"name": "tempest-secgroup-smoke-888416336"}]}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:20:55.421806 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-34ba5227-d519-4fa7-aeb3-e4c154c09bec tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] validate_networks() for [('0c2511ed-50a8-4a9f-acfe-6c2d50c58a14', None, None, None, None, None)] {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:20:55.547397 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-33b7020e-142a-4a0b-b823-1c5005237772 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:55.548128 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-33b7020e-142a-4a0b-b823-1c5005237772 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 37ac4563-7872-4787-8d42-87b04550bcd9] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:55.565080 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-33b7020e-142a-4a0b-b823-1c5005237772 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:55.565959 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-33b7020e-142a-4a0b-b823-1c5005237772 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:55.566633 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-33b7020e-142a-4a0b-b823-1c5005237772 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:55.567773 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-33b7020e-142a-4a0b-b823-1c5005237772 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:55.568997 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-33b7020e-142a-4a0b-b823-1c5005237772 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:55.574570 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-33b7020e-142a-4a0b-b823-1c5005237772 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:55.727805 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-33b7020e-142a-4a0b-b823-1c5005237772 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:55.744206 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-33b7020e-142a-4a0b-b823-1c5005237772 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9" status: 200 len: 1359 microversion: 2.1 time: 0.209706 Oct 17 14:20:55.744762 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3016/6170] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:55 2022] GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9 => generated 1359 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:56.022593 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-34ba5227-d519-4fa7-aeb3-e4c154c09bec tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:20:56.023025 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-34ba5227-d519-4fa7-aeb3-e4c154c09bec tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:20:56.023539 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-34ba5227-d519-4fa7-aeb3-e4c154c09bec tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:20:56.023951 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-34ba5227-d519-4fa7-aeb3-e4c154c09bec tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:20:56.024383 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-34ba5227-d519-4fa7-aeb3-e4c154c09bec tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:20:56.035618 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-34ba5227-d519-4fa7-aeb3-e4c154c09bec tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:56.036102 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-34ba5227-d519-4fa7-aeb3-e4c154c09bec tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:56.036538 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-34ba5227-d519-4fa7-aeb3-e4c154c09bec tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:56.045826 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-34ba5227-d519-4fa7-aeb3-e4c154c09bec tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:56.046336 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-34ba5227-d519-4fa7-aeb3-e4c154c09bec tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:56.046763 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-34ba5227-d519-4fa7-aeb3-e4c154c09bec tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:56.071608 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-34ba5227-d519-4fa7-aeb3-e4c154c09bec tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Getting quotas for project b8c8fe6f805f43798c9910296df4b8ab. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:20:56.079285 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-34ba5227-d519-4fa7-aeb3-e4c154c09bec tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Getting quotas for user 024275cf6f8d423992e61d92dea927ba and project b8c8fe6f805f43798c9910296df4b8ab. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:20:56.103477 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-34ba5227-d519-4fa7-aeb3-e4c154c09bec tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:20:56.112165 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-34ba5227-d519-4fa7-aeb3-e4c154c09bec tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e19b3623-7c42-4270-94bd-d46fa920ae3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:20:56.190703 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-34ba5227-d519-4fa7-aeb3-e4c154c09bec tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.939962 Oct 17 14:20:56.197749 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3155/6171] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 14:20:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 942 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:20:56.203694 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8c30abad-0875-4b3e-ac82-d381626284ba tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:56.204476 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8c30abad-0875-4b3e-ac82-d381626284ba tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e19b3623-7c42-4270-94bd-d46fa920ae3f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:56.316436 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8c30abad-0875-4b3e-ac82-d381626284ba tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:56.324807 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8c30abad-0875-4b3e-ac82-d381626284ba tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f" status: 200 len: 1267 microversion: 2.1 time: 0.125327 Oct 17 14:20:56.329719 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3017/6172] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:56 2022] GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f => generated 1267 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:56.786548 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1abc2ded-9a61-49df-a540-c6f5dc14c828 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:56.787184 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-1abc2ded-9a61-49df-a540-c6f5dc14c828 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 37ac4563-7872-4787-8d42-87b04550bcd9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:56.802937 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1abc2ded-9a61-49df-a540-c6f5dc14c828 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:56.803468 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1abc2ded-9a61-49df-a540-c6f5dc14c828 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:56.803896 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1abc2ded-9a61-49df-a540-c6f5dc14c828 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:56.804608 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1abc2ded-9a61-49df-a540-c6f5dc14c828 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:56.805052 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1abc2ded-9a61-49df-a540-c6f5dc14c828 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:56.805471 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1abc2ded-9a61-49df-a540-c6f5dc14c828 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:56.909247 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-1abc2ded-9a61-49df-a540-c6f5dc14c828 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:56.919425 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1abc2ded-9a61-49df-a540-c6f5dc14c828 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9" status: 200 len: 1359 microversion: 2.1 time: 0.138033 Oct 17 14:20:56.920712 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3156/6173] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:56 2022] GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9 => generated 1359 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:57.352211 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-052b3f24-7098-4ccd-9f07-72dcfc3a0be5 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:57.352842 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-052b3f24-7098-4ccd-9f07-72dcfc3a0be5 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e19b3623-7c42-4270-94bd-d46fa920ae3f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:57.372932 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-052b3f24-7098-4ccd-9f07-72dcfc3a0be5 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:57.373457 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-052b3f24-7098-4ccd-9f07-72dcfc3a0be5 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:57.373918 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-052b3f24-7098-4ccd-9f07-72dcfc3a0be5 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:57.374654 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-052b3f24-7098-4ccd-9f07-72dcfc3a0be5 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:57.375122 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-052b3f24-7098-4ccd-9f07-72dcfc3a0be5 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:57.376959 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-052b3f24-7098-4ccd-9f07-72dcfc3a0be5 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:57.443706 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-052b3f24-7098-4ccd-9f07-72dcfc3a0be5 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:57.453009 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-052b3f24-7098-4ccd-9f07-72dcfc3a0be5 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f" status: 200 len: 1319 microversion: 2.1 time: 0.104789 Oct 17 14:20:57.453595 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3018/6174] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:57 2022] GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f => generated 1319 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:57.945469 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c97fadee-04ab-464e-884d-5c3e1dfe0eb0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:57.946979 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c97fadee-04ab-464e-884d-5c3e1dfe0eb0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 37ac4563-7872-4787-8d42-87b04550bcd9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:57.958063 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c97fadee-04ab-464e-884d-5c3e1dfe0eb0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:57.962251 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c97fadee-04ab-464e-884d-5c3e1dfe0eb0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:57.969460 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c97fadee-04ab-464e-884d-5c3e1dfe0eb0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:57.970271 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c97fadee-04ab-464e-884d-5c3e1dfe0eb0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:57.975545 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c97fadee-04ab-464e-884d-5c3e1dfe0eb0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:57.976080 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c97fadee-04ab-464e-884d-5c3e1dfe0eb0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:58.078283 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c97fadee-04ab-464e-884d-5c3e1dfe0eb0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:58.085040 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c97fadee-04ab-464e-884d-5c3e1dfe0eb0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:58.088797 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c97fadee-04ab-464e-884d-5c3e1dfe0eb0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:58.089572 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-c97fadee-04ab-464e-884d-5c3e1dfe0eb0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lazy-loading 'fault' on Instance uuid 37ac4563-7872-4787-8d42-87b04550bcd9 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:20:58.175778 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c97fadee-04ab-464e-884d-5c3e1dfe0eb0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:58.185571 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c97fadee-04ab-464e-884d-5c3e1dfe0eb0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9" status: 200 len: 1364 microversion: 2.1 time: 0.244758 Oct 17 14:20:58.186419 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3157/6175] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:57 2022] GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9 => generated 1364 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:58.478691 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2907ffa9-1f23-4ef6-a451-2fb7ae51aa19 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:58.480781 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2907ffa9-1f23-4ef6-a451-2fb7ae51aa19 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e19b3623-7c42-4270-94bd-d46fa920ae3f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:58.490520 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2907ffa9-1f23-4ef6-a451-2fb7ae51aa19 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:58.491401 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2907ffa9-1f23-4ef6-a451-2fb7ae51aa19 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:58.492139 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2907ffa9-1f23-4ef6-a451-2fb7ae51aa19 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:58.493154 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2907ffa9-1f23-4ef6-a451-2fb7ae51aa19 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:58.493872 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2907ffa9-1f23-4ef6-a451-2fb7ae51aa19 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:58.494519 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2907ffa9-1f23-4ef6-a451-2fb7ae51aa19 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:58.951841 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2907ffa9-1f23-4ef6-a451-2fb7ae51aa19 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:58.966625 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2907ffa9-1f23-4ef6-a451-2fb7ae51aa19 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f" status: 200 len: 1325 microversion: 2.1 time: 0.492849 Oct 17 14:20:58.967420 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3019/6176] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:58 2022] GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f => generated 1325 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:59.212194 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2f9b7272-e136-4fa9-9b40-537188095aac tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:59.212843 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2f9b7272-e136-4fa9-9b40-537188095aac tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 37ac4563-7872-4787-8d42-87b04550bcd9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:59.223704 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2f9b7272-e136-4fa9-9b40-537188095aac tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:59.224556 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2f9b7272-e136-4fa9-9b40-537188095aac tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:59.225211 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2f9b7272-e136-4fa9-9b40-537188095aac tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:59.227262 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2f9b7272-e136-4fa9-9b40-537188095aac tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:59.228181 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2f9b7272-e136-4fa9-9b40-537188095aac tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:59.228565 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2f9b7272-e136-4fa9-9b40-537188095aac tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:59.260075 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-2f9b7272-e136-4fa9-9b40-537188095aac tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] HTTP exception thrown: Instance 37ac4563-7872-4787-8d42-87b04550bcd9 could not be found. Oct 17 14:20:59.261946 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2f9b7272-e136-4fa9-9b40-537188095aac tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Request method failure captured: Oct 17 14:20:59.261946 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9 HTTP/1.1 Oct 17 14:20:59.261946 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 14:20:59.261946 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 14:20:59.261946 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 14:20:59.261946 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 14:20:59.261946 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 14:20:59.261946 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 14:20:59.261946 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 14:20:59.261946 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 14:20:59.261946 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTWPt4q6KhJtaXfApyhSZ1uS2Yi83dufn15X2GOm5u94F5E_Yj644GYsWZT8YBgl1aUBmYfKlHMjXq-eb8c2HF1REfW755J7WOOs8k3QRgUHhfiijXEH0YeKQjwZvCrEKlD9sd8dyp1v8diPQXXtSf-PHzqWEcTzJgPsJ95on9ZJE1Jo Oct 17 14:20:59.261946 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 14:20:59.261946 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 14:20:59.261946 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 14:20:59.261946 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 14:20:59.261946 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 14:20:59.261946 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 14:20:59.261946 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 4ee70940341741cb8e31928b856de051 Oct 17 14:20:59.261946 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-TestVolumeBootPattern-2135999385 Oct 17 14:20:59.261946 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 14:20:59.261946 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 14:20:59.261946 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4ee70940341741cb8e31928b856de051"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4ee70940341741cb8e31928b856de051"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4ee70940341741cb8e31928b856de051"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4ee70940341741cb8e31928b856de051", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:20:59.261946 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-TestVolumeBootPattern-2135999385 Oct 17 14:20:59.261946 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 4ee70940341741cb8e31928b856de051 Oct 17 14:20:59.261946 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-TestVolumeBootPattern-2135999385 Oct 17 14:20:59.261946 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-TestVolumeBootPattern-2135999385-project Oct 17 14:20:59.261946 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 14:20:59.261946 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 14:20:59.261946 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 06a0e2dab7494a4682615a6269ac24f9 Oct 17 14:20:59.261946 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-TestVolumeBootPattern-2135999385-project Oct 17 14:20:59.261946 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 14:20:59.261946 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 37ac4563-7872-4787-8d42-87b04550bcd9 could not be found. Oct 17 14:20:59.261946 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '37ac4563-7872-4787-8d42-87b04550bcd9'} Oct 17 14:20:59.261946 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:20:59.261946 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:20:59.261946 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:20:59.261946 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:20:59.261946 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:20:59.261946 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:20:59.261946 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:20:59.261946 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:20:59.261946 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:20:59.261946 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:20:59.261946 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37ac4563-7872-4787-8d42-87b04550bcd9 could not be found. Oct 17 14:20:59.261946 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:20:59.261946 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:20:59.261946 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:20:59.261946 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:20:59.261946 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:20:59.261946 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:20:59.261946 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:20:59.261946 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:20:59.261946 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:20:59.261946 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:20:59.261946 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:20:59.261946 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:20:59.261946 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:20:59.261946 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:20:59.261946 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:20:59.261946 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:20:59.261946 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37ac4563-7872-4787-8d42-87b04550bcd9 could not be found. Oct 17 14:20:59.261946 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:20:59.261946 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:20:59.261946 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:20:59.267628 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:20:59.267628 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:20:59.267628 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:20:59.267628 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:20:59.267628 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:20:59.267628 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37ac4563-7872-4787-8d42-87b04550bcd9 could not be found. Oct 17 14:20:59.267628 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:20:59.267628 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2f9b7272-e136-4fa9-9b40-537188095aac tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Returning 404 to user: Instance 37ac4563-7872-4787-8d42-87b04550bcd9 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:20:59.267628 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2f9b7272-e136-4fa9-9b40-537188095aac tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9" status: 404 len: 111 microversion: 2.1 time: 0.057639 Oct 17 14:20:59.273461 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3158/6177] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:59 2022] GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:20:59.997034 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d8e8c9d2-61ed-4f23-be34-06378f669d9e tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:59.998636 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d8e8c9d2-61ed-4f23-be34-06378f669d9e tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e19b3623-7c42-4270-94bd-d46fa920ae3f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:00.006395 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d8e8c9d2-61ed-4f23-be34-06378f669d9e tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:00.007402 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d8e8c9d2-61ed-4f23-be34-06378f669d9e tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:00.008297 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d8e8c9d2-61ed-4f23-be34-06378f669d9e tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:00.009175 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d8e8c9d2-61ed-4f23-be34-06378f669d9e tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:00.014756 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-8b2aa9ec-3325-45ad-8d88-724e40eabc68 req-e685a858-bf0c-4df3-ab44-283a2c330e27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e19b3623-7c42-4270-94bd-d46fa920ae3f", "tag": "71c16489-2d3b-479d-8a58-18c9984bcbbf"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:21:00.021727 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d8e8c9d2-61ed-4f23-be34-06378f669d9e tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:00.022559 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d8e8c9d2-61ed-4f23-be34-06378f669d9e tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:00.032651 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-8b2aa9ec-3325-45ad-8d88-724e40eabc68 req-e685a858-bf0c-4df3-ab44-283a2c330e27 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:00.033486 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-8b2aa9ec-3325-45ad-8d88-724e40eabc68 req-e685a858-bf0c-4df3-ab44-283a2c330e27 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:00.035869 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-8b2aa9ec-3325-45ad-8d88-724e40eabc68 req-e685a858-bf0c-4df3-ab44-283a2c330e27 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:00.065667 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-8b2aa9ec-3325-45ad-8d88-724e40eabc68 req-e685a858-bf0c-4df3-ab44-283a2c330e27 service nova] Creating event network-changed:71c16489-2d3b-479d-8a58-18c9984bcbbf for instance e19b3623-7c42-4270-94bd-d46fa920ae3f on n-h2-854247-14 Oct 17 14:21:00.091571 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-8b2aa9ec-3325-45ad-8d88-724e40eabc68 req-e685a858-bf0c-4df3-ab44-283a2c330e27 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080176 Oct 17 14:21:00.092381 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3159/6178] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:21:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:21:00.305558 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d8e8c9d2-61ed-4f23-be34-06378f669d9e tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:00.314614 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d8e8c9d2-61ed-4f23-be34-06378f669d9e tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f" status: 200 len: 1392 microversion: 2.1 time: 0.321926 Oct 17 14:21:00.315395 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3020/6179] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:59 2022] GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f => generated 1392 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:21:01.341446 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ad5f33f3-445e-4b23-8fa7-0228845ea341 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:01.342978 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ad5f33f3-445e-4b23-8fa7-0228845ea341 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e19b3623-7c42-4270-94bd-d46fa920ae3f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:01.345242 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:21:01.351627 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ad5f33f3-445e-4b23-8fa7-0228845ea341 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:01.352157 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ad5f33f3-445e-4b23-8fa7-0228845ea341 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:01.352595 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ad5f33f3-445e-4b23-8fa7-0228845ea341 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:01.353405 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ad5f33f3-445e-4b23-8fa7-0228845ea341 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:01.353948 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ad5f33f3-445e-4b23-8fa7-0228845ea341 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:01.354509 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ad5f33f3-445e-4b23-8fa7-0228845ea341 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:01.612892 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ad5f33f3-445e-4b23-8fa7-0228845ea341 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:01.629331 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ad5f33f3-445e-4b23-8fa7-0228845ea341 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f" status: 200 len: 1392 microversion: 2.1 time: 0.294494 Oct 17 14:21:01.631557 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3160/6180] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:01 2022] GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f => generated 1392 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:21:02.656198 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f902f16b-e783-4681-a869-caddba127940 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:02.656849 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f902f16b-e783-4681-a869-caddba127940 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e19b3623-7c42-4270-94bd-d46fa920ae3f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:02.666837 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f902f16b-e783-4681-a869-caddba127940 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:02.667640 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f902f16b-e783-4681-a869-caddba127940 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:02.668169 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f902f16b-e783-4681-a869-caddba127940 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:02.669128 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f902f16b-e783-4681-a869-caddba127940 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:02.669712 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f902f16b-e783-4681-a869-caddba127940 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:02.670290 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f902f16b-e783-4681-a869-caddba127940 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:02.844282 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f902f16b-e783-4681-a869-caddba127940 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:02.856375 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f902f16b-e783-4681-a869-caddba127940 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f" status: 200 len: 1392 microversion: 2.1 time: 0.205498 Oct 17 14:21:02.856920 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3021/6181] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:02 2022] GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f => generated 1392 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:21:03.629725 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8e08e89b-b392-4407-bfee-8dc13106e168 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:03.630242 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8e08e89b-b392-4407-bfee-8dc13106e168 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: e9324873-d141-4cb6-adca-4187bf085284] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:03.637791 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8e08e89b-b392-4407-bfee-8dc13106e168 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:03.638281 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8e08e89b-b392-4407-bfee-8dc13106e168 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:03.638721 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8e08e89b-b392-4407-bfee-8dc13106e168 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:03.639467 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8e08e89b-b392-4407-bfee-8dc13106e168 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:03.639922 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8e08e89b-b392-4407-bfee-8dc13106e168 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:03.640351 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8e08e89b-b392-4407-bfee-8dc13106e168 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:03.666289 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8e08e89b-b392-4407-bfee-8dc13106e168 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: e9324873-d141-4cb6-adca-4187bf085284] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:21:03.749196 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8e08e89b-b392-4407-bfee-8dc13106e168 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "DELETE /compute/v2.1/servers/e9324873-d141-4cb6-adca-4187bf085284" status: 204 len: 0 microversion: 2.1 time: 0.123301 Oct 17 14:21:03.749819 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3161/6182] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:21:03 2022] DELETE /compute/v2.1/servers/e9324873-d141-4cb6-adca-4187bf085284 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:21:03.759081 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-872bf23f-37dc-4e04-b2ce-18b7c5d9ad45 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:03.759877 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-872bf23f-37dc-4e04-b2ce-18b7c5d9ad45 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: e9324873-d141-4cb6-adca-4187bf085284] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:03.767145 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-872bf23f-37dc-4e04-b2ce-18b7c5d9ad45 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:03.767708 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-872bf23f-37dc-4e04-b2ce-18b7c5d9ad45 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:03.768161 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-872bf23f-37dc-4e04-b2ce-18b7c5d9ad45 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:03.768883 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-872bf23f-37dc-4e04-b2ce-18b7c5d9ad45 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:03.769353 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-872bf23f-37dc-4e04-b2ce-18b7c5d9ad45 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:03.769794 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-872bf23f-37dc-4e04-b2ce-18b7c5d9ad45 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:03.879961 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4f73e15b-1bbc-446b-9567-8d2934aba456 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:03.880681 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4f73e15b-1bbc-446b-9567-8d2934aba456 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e19b3623-7c42-4270-94bd-d46fa920ae3f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:03.887249 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4f73e15b-1bbc-446b-9567-8d2934aba456 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:03.888460 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4f73e15b-1bbc-446b-9567-8d2934aba456 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:03.888914 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4f73e15b-1bbc-446b-9567-8d2934aba456 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:03.889636 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4f73e15b-1bbc-446b-9567-8d2934aba456 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:03.890090 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4f73e15b-1bbc-446b-9567-8d2934aba456 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:03.890517 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4f73e15b-1bbc-446b-9567-8d2934aba456 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:03.912869 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-872bf23f-37dc-4e04-b2ce-18b7c5d9ad45 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:03.921288 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-872bf23f-37dc-4e04-b2ce-18b7c5d9ad45 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/e9324873-d141-4cb6-adca-4187bf085284" status: 200 len: 1411 microversion: 2.1 time: 0.166535 Oct 17 14:21:03.921952 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3022/6183] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:03 2022] GET /compute/v2.1/servers/e9324873-d141-4cb6-adca-4187bf085284 => generated 1411 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:21:04.029685 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4f73e15b-1bbc-446b-9567-8d2934aba456 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:04.041458 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4f73e15b-1bbc-446b-9567-8d2934aba456 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f" status: 200 len: 1392 microversion: 2.1 time: 0.165658 Oct 17 14:21:04.042219 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3162/6184] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:03 2022] GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:21:04.945684 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c7d31616-f9b6-4f21-bc74-08466b713fab tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:04.946474 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c7d31616-f9b6-4f21-bc74-08466b713fab tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: e9324873-d141-4cb6-adca-4187bf085284] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:04.957832 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7d31616-f9b6-4f21-bc74-08466b713fab tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:04.958331 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7d31616-f9b6-4f21-bc74-08466b713fab tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:04.958855 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7d31616-f9b6-4f21-bc74-08466b713fab tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:04.959896 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7d31616-f9b6-4f21-bc74-08466b713fab tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:04.960558 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7d31616-f9b6-4f21-bc74-08466b713fab tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:04.961163 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7d31616-f9b6-4f21-bc74-08466b713fab tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:05.065930 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7c531442-53a8-4a8f-b961-71b9124405e6 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:05.066936 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7c531442-53a8-4a8f-b961-71b9124405e6 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e19b3623-7c42-4270-94bd-d46fa920ae3f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:05.073768 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7c531442-53a8-4a8f-b961-71b9124405e6 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:05.074579 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7c531442-53a8-4a8f-b961-71b9124405e6 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:05.075265 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7c531442-53a8-4a8f-b961-71b9124405e6 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:05.076238 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7c531442-53a8-4a8f-b961-71b9124405e6 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:05.076893 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7c531442-53a8-4a8f-b961-71b9124405e6 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:05.077327 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7c531442-53a8-4a8f-b961-71b9124405e6 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:05.105596 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c7d31616-f9b6-4f21-bc74-08466b713fab tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:05.114273 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c7d31616-f9b6-4f21-bc74-08466b713fab tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/e9324873-d141-4cb6-adca-4187bf085284" status: 200 len: 1411 microversion: 2.1 time: 0.173536 Oct 17 14:21:05.115094 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3023/6185] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:04 2022] GET /compute/v2.1/servers/e9324873-d141-4cb6-adca-4187bf085284 => generated 1411 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:21:05.233918 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7c531442-53a8-4a8f-b961-71b9124405e6 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:05.241943 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7c531442-53a8-4a8f-b961-71b9124405e6 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f" status: 200 len: 1392 microversion: 2.1 time: 0.180767 Oct 17 14:21:05.242533 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3163/6186] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:05 2022] GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f => generated 1392 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:21:05.737087 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-324aa49a-91af-48a9-9db2-475704a41381 req-8d634d98-9c17-4e1d-ab47-9bf07b9d9333 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9324873-d141-4cb6-adca-4187bf085284", "name": "network-vif-deleted", "tag": "9f42ddec-983a-4fff-9c8c-2877f536edc1"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:21:05.747603 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-324aa49a-91af-48a9-9db2-475704a41381 req-8d634d98-9c17-4e1d-ab47-9bf07b9d9333 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:05.748229 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-324aa49a-91af-48a9-9db2-475704a41381 req-8d634d98-9c17-4e1d-ab47-9bf07b9d9333 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:05.748803 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-324aa49a-91af-48a9-9db2-475704a41381 req-8d634d98-9c17-4e1d-ab47-9bf07b9d9333 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:05.764423 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-324aa49a-91af-48a9-9db2-475704a41381 req-8d634d98-9c17-4e1d-ab47-9bf07b9d9333 service nova] Creating event network-vif-deleted:9f42ddec-983a-4fff-9c8c-2877f536edc1 for instance e9324873-d141-4cb6-adca-4187bf085284 on n-h2-854247-14 Oct 17 14:21:05.769924 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-324aa49a-91af-48a9-9db2-475704a41381 req-8d634d98-9c17-4e1d-ab47-9bf07b9d9333 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036567 Oct 17 14:21:05.770746 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3024/6187] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:21:06.138252 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-34040d7b-d259-4276-add2-1d9e775b52b5 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:06.138854 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-34040d7b-d259-4276-add2-1d9e775b52b5 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: e9324873-d141-4cb6-adca-4187bf085284] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:06.141073 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:21:06.142991 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=10 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:21:06.149947 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-34040d7b-d259-4276-add2-1d9e775b52b5 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:06.150442 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-34040d7b-d259-4276-add2-1d9e775b52b5 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:06.150876 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-34040d7b-d259-4276-add2-1d9e775b52b5 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:06.151610 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-34040d7b-d259-4276-add2-1d9e775b52b5 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:06.152091 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-34040d7b-d259-4276-add2-1d9e775b52b5 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:06.152508 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-34040d7b-d259-4276-add2-1d9e775b52b5 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:06.221086 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-34040d7b-d259-4276-add2-1d9e775b52b5 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:06.229456 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-34040d7b-d259-4276-add2-1d9e775b52b5 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/e9324873-d141-4cb6-adca-4187bf085284" status: 200 len: 1202 microversion: 2.1 time: 0.095315 Oct 17 14:21:06.230036 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3164/6188] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:06 2022] GET /compute/v2.1/servers/e9324873-d141-4cb6-adca-4187bf085284 => generated 1202 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:21:06.273987 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-92b18825-f650-4a54-b898-4bd7ad041bca tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:06.274600 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-92b18825-f650-4a54-b898-4bd7ad041bca tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e19b3623-7c42-4270-94bd-d46fa920ae3f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:06.281866 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-92b18825-f650-4a54-b898-4bd7ad041bca tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:06.282361 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-92b18825-f650-4a54-b898-4bd7ad041bca tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:06.282809 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-92b18825-f650-4a54-b898-4bd7ad041bca tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:06.283541 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-92b18825-f650-4a54-b898-4bd7ad041bca tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:06.284008 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-92b18825-f650-4a54-b898-4bd7ad041bca tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:06.284442 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-92b18825-f650-4a54-b898-4bd7ad041bca tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:06.324818 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:21:06.433060 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-92b18825-f650-4a54-b898-4bd7ad041bca tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:06.442059 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-92b18825-f650-4a54-b898-4bd7ad041bca tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f" status: 200 len: 1392 microversion: 2.1 time: 0.173400 Oct 17 14:21:06.442610 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3025/6189] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:06 2022] GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f => generated 1392 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:21:06.860341 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-a2bd0e58-1157-4e51-91fc-ce88290a220b req-3ad94e46-a734-4602-a958-b452957495d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e19b3623-7c42-4270-94bd-d46fa920ae3f", "name": "network-vif-plugged", "status": "completed", "tag": "71c16489-2d3b-479d-8a58-18c9984bcbbf"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:21:06.872739 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-a2bd0e58-1157-4e51-91fc-ce88290a220b req-3ad94e46-a734-4602-a958-b452957495d3 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:06.874431 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-a2bd0e58-1157-4e51-91fc-ce88290a220b req-3ad94e46-a734-4602-a958-b452957495d3 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:06.874898 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-a2bd0e58-1157-4e51-91fc-ce88290a220b req-3ad94e46-a734-4602-a958-b452957495d3 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:06.889174 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-a2bd0e58-1157-4e51-91fc-ce88290a220b req-3ad94e46-a734-4602-a958-b452957495d3 service nova] Creating event network-vif-plugged:71c16489-2d3b-479d-8a58-18c9984bcbbf for instance e19b3623-7c42-4270-94bd-d46fa920ae3f on n-h2-854247-14 Oct 17 14:21:06.894494 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-a2bd0e58-1157-4e51-91fc-ce88290a220b req-3ad94e46-a734-4602-a958-b452957495d3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037831 Oct 17 14:21:06.896125 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3165/6190] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:21:07.252857 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3f982146-0e5e-48a0-b90e-42c3870520f6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:07.253630 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3f982146-0e5e-48a0-b90e-42c3870520f6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: e9324873-d141-4cb6-adca-4187bf085284] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:07.267910 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f982146-0e5e-48a0-b90e-42c3870520f6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:07.267910 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f982146-0e5e-48a0-b90e-42c3870520f6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:07.267910 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f982146-0e5e-48a0-b90e-42c3870520f6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:07.267910 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f982146-0e5e-48a0-b90e-42c3870520f6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:07.267910 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f982146-0e5e-48a0-b90e-42c3870520f6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:07.267910 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f982146-0e5e-48a0-b90e-42c3870520f6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:07.329320 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3f982146-0e5e-48a0-b90e-42c3870520f6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:07.339894 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3f982146-0e5e-48a0-b90e-42c3870520f6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/e9324873-d141-4cb6-adca-4187bf085284" status: 200 len: 1202 microversion: 2.1 time: 0.091059 Oct 17 14:21:07.340462 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3026/6191] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:07 2022] GET /compute/v2.1/servers/e9324873-d141-4cb6-adca-4187bf085284 => generated 1202 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:21:07.468929 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f2df7cd6-3fce-4965-9016-a5b2a172ec38 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:07.469753 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f2df7cd6-3fce-4965-9016-a5b2a172ec38 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e19b3623-7c42-4270-94bd-d46fa920ae3f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:07.476975 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f2df7cd6-3fce-4965-9016-a5b2a172ec38 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:07.477574 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f2df7cd6-3fce-4965-9016-a5b2a172ec38 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:07.478065 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f2df7cd6-3fce-4965-9016-a5b2a172ec38 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:07.478931 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f2df7cd6-3fce-4965-9016-a5b2a172ec38 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:07.479540 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f2df7cd6-3fce-4965-9016-a5b2a172ec38 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:07.480070 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f2df7cd6-3fce-4965-9016-a5b2a172ec38 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:07.622117 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f2df7cd6-3fce-4965-9016-a5b2a172ec38 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:07.630778 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f2df7cd6-3fce-4965-9016-a5b2a172ec38 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f" status: 200 len: 1392 microversion: 2.1 time: 0.167720 Oct 17 14:21:07.631711 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3166/6192] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:07 2022] GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:21:08.362975 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-59c3a031-52d0-42dc-b669-c0ba7f5372d8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:08.363552 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-59c3a031-52d0-42dc-b669-c0ba7f5372d8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: e9324873-d141-4cb6-adca-4187bf085284] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:08.371112 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-59c3a031-52d0-42dc-b669-c0ba7f5372d8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:08.371723 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-59c3a031-52d0-42dc-b669-c0ba7f5372d8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:08.372180 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-59c3a031-52d0-42dc-b669-c0ba7f5372d8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:08.373241 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-59c3a031-52d0-42dc-b669-c0ba7f5372d8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:08.373955 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-59c3a031-52d0-42dc-b669-c0ba7f5372d8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:08.374426 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-59c3a031-52d0-42dc-b669-c0ba7f5372d8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:08.440375 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-59c3a031-52d0-42dc-b669-c0ba7f5372d8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:08.448950 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-59c3a031-52d0-42dc-b669-c0ba7f5372d8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/e9324873-d141-4cb6-adca-4187bf085284" status: 200 len: 1202 microversion: 2.1 time: 0.090147 Oct 17 14:21:08.449535 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3027/6193] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:08 2022] GET /compute/v2.1/servers/e9324873-d141-4cb6-adca-4187bf085284 => generated 1202 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:21:08.653816 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b176c7fb-51a3-4b6a-8a74-f11e7e1fe8e2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:08.654453 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b176c7fb-51a3-4b6a-8a74-f11e7e1fe8e2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e19b3623-7c42-4270-94bd-d46fa920ae3f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:08.661855 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b176c7fb-51a3-4b6a-8a74-f11e7e1fe8e2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:08.662336 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b176c7fb-51a3-4b6a-8a74-f11e7e1fe8e2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:08.662760 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b176c7fb-51a3-4b6a-8a74-f11e7e1fe8e2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:08.663483 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b176c7fb-51a3-4b6a-8a74-f11e7e1fe8e2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:08.663932 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b176c7fb-51a3-4b6a-8a74-f11e7e1fe8e2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:08.664347 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b176c7fb-51a3-4b6a-8a74-f11e7e1fe8e2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:08.803118 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b176c7fb-51a3-4b6a-8a74-f11e7e1fe8e2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:08.812025 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b176c7fb-51a3-4b6a-8a74-f11e7e1fe8e2 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f" status: 200 len: 1563 microversion: 2.1 time: 0.162417 Oct 17 14:21:08.812638 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3167/6194] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:08 2022] GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f => generated 1563 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:21:08.834157 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9e8c7581-cb10-46b7-a166-6c2f447a92be tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:08.834792 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9e8c7581-cb10-46b7-a166-6c2f447a92be tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e19b3623-7c42-4270-94bd-d46fa920ae3f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:08.841424 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9e8c7581-cb10-46b7-a166-6c2f447a92be tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:08.841946 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9e8c7581-cb10-46b7-a166-6c2f447a92be tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:08.842394 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9e8c7581-cb10-46b7-a166-6c2f447a92be tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:08.843103 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9e8c7581-cb10-46b7-a166-6c2f447a92be tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:08.843611 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9e8c7581-cb10-46b7-a166-6c2f447a92be tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:08.844078 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9e8c7581-cb10-46b7-a166-6c2f447a92be tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:08.981782 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9e8c7581-cb10-46b7-a166-6c2f447a92be tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:08.990835 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9e8c7581-cb10-46b7-a166-6c2f447a92be tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f" status: 200 len: 1563 microversion: 2.1 time: 0.160600 Oct 17 14:21:08.991477 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3028/6195] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:08 2022] GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:21:09.476102 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-85ab2805-b01a-45f7-abc6-53cdf2a39fa1 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:09.476945 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-85ab2805-b01a-45f7-abc6-53cdf2a39fa1 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: e9324873-d141-4cb6-adca-4187bf085284] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:09.483936 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-85ab2805-b01a-45f7-abc6-53cdf2a39fa1 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:09.484650 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-85ab2805-b01a-45f7-abc6-53cdf2a39fa1 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:09.485155 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-85ab2805-b01a-45f7-abc6-53cdf2a39fa1 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:09.486221 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-85ab2805-b01a-45f7-abc6-53cdf2a39fa1 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:09.486734 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-85ab2805-b01a-45f7-abc6-53cdf2a39fa1 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:09.487372 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-85ab2805-b01a-45f7-abc6-53cdf2a39fa1 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:09.574313 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-85ab2805-b01a-45f7-abc6-53cdf2a39fa1 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:09.582876 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-85ab2805-b01a-45f7-abc6-53cdf2a39fa1 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/e9324873-d141-4cb6-adca-4187bf085284" status: 200 len: 1202 microversion: 2.1 time: 0.113705 Oct 17 14:21:09.583979 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3168/6196] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:09 2022] GET /compute/v2.1/servers/e9324873-d141-4cb6-adca-4187bf085284 => generated 1202 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:21:10.606630 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2b1560a3-eb9a-4c6b-93d6-fff03b437ffd tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:10.607590 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2b1560a3-eb9a-4c6b-93d6-fff03b437ffd tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: e9324873-d141-4cb6-adca-4187bf085284] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:10.616865 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2b1560a3-eb9a-4c6b-93d6-fff03b437ffd tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:10.618330 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2b1560a3-eb9a-4c6b-93d6-fff03b437ffd tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:10.618884 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2b1560a3-eb9a-4c6b-93d6-fff03b437ffd tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:10.619764 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2b1560a3-eb9a-4c6b-93d6-fff03b437ffd tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:10.620361 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2b1560a3-eb9a-4c6b-93d6-fff03b437ffd tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:10.620997 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2b1560a3-eb9a-4c6b-93d6-fff03b437ffd tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:10.637349 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-2b1560a3-eb9a-4c6b-93d6-fff03b437ffd tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] HTTP exception thrown: Instance e9324873-d141-4cb6-adca-4187bf085284 could not be found. Oct 17 14:21:10.639230 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2b1560a3-eb9a-4c6b-93d6-fff03b437ffd tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Request method failure captured: Oct 17 14:21:10.639230 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/e9324873-d141-4cb6-adca-4187bf085284 HTTP/1.1 Oct 17 14:21:10.639230 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 14:21:10.639230 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 14:21:10.639230 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 14:21:10.639230 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 14:21:10.639230 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 14:21:10.639230 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 14:21:10.639230 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 14:21:10.639230 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 14:21:10.639230 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTWPt4q6KhJtaXfApyhSZ1uS2Yi83dufn15X2GOm5u94F5E_Yj644GYsWZT8YBgl1aUBmYfKlHMjXq-eb8c2HF1REfW755J7WOOs8k3QRgUHhfiijXEH0YeKQjwZvCrEKlD9sd8dyp1v8diPQXXtSf-PHzqWEcTzJgPsJ95on9ZJE1Jo Oct 17 14:21:10.639230 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 14:21:10.639230 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 14:21:10.639230 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 14:21:10.639230 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 14:21:10.639230 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 14:21:10.639230 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 14:21:10.639230 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 4ee70940341741cb8e31928b856de051 Oct 17 14:21:10.639230 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-TestVolumeBootPattern-2135999385 Oct 17 14:21:10.639230 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 14:21:10.639230 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 14:21:10.639230 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4ee70940341741cb8e31928b856de051"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4ee70940341741cb8e31928b856de051"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4ee70940341741cb8e31928b856de051"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4ee70940341741cb8e31928b856de051", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:21:10.639230 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-TestVolumeBootPattern-2135999385 Oct 17 14:21:10.639230 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 4ee70940341741cb8e31928b856de051 Oct 17 14:21:10.639230 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-TestVolumeBootPattern-2135999385 Oct 17 14:21:10.639230 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-TestVolumeBootPattern-2135999385-project Oct 17 14:21:10.639230 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 14:21:10.639230 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 14:21:10.639230 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 06a0e2dab7494a4682615a6269ac24f9 Oct 17 14:21:10.639230 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-TestVolumeBootPattern-2135999385-project Oct 17 14:21:10.639230 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 14:21:10.639230 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance e9324873-d141-4cb6-adca-4187bf085284 could not be found. Oct 17 14:21:10.639230 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'e9324873-d141-4cb6-adca-4187bf085284'} Oct 17 14:21:10.639230 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:21:10.639230 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:21:10.639230 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:21:10.639230 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:21:10.639230 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:21:10.639230 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:21:10.639230 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:21:10.639230 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:21:10.639230 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:21:10.639230 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:21:10.639230 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9324873-d141-4cb6-adca-4187bf085284 could not be found. Oct 17 14:21:10.639230 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:21:10.639230 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:21:10.639230 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:21:10.639230 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:21:10.639230 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:21:10.639230 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:21:10.639230 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:21:10.639230 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:21:10.639230 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:21:10.639230 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:21:10.639230 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:21:10.639230 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:21:10.639230 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:21:10.639230 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:21:10.639230 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:21:10.639230 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:21:10.639230 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9324873-d141-4cb6-adca-4187bf085284 could not be found. Oct 17 14:21:10.639230 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:21:10.639230 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:21:10.639230 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:21:10.642629 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:21:10.642629 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:21:10.642629 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:21:10.642629 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:21:10.642629 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:21:10.642629 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9324873-d141-4cb6-adca-4187bf085284 could not be found. Oct 17 14:21:10.642629 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:21:10.645268 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2b1560a3-eb9a-4c6b-93d6-fff03b437ffd tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Returning 404 to user: Instance e9324873-d141-4cb6-adca-4187bf085284 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:21:10.646344 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2b1560a3-eb9a-4c6b-93d6-fff03b437ffd tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/e9324873-d141-4cb6-adca-4187bf085284" status: 404 len: 111 microversion: 2.1 time: 0.044242 Oct 17 14:21:10.647351 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3029/6197] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:10 2022] GET /compute/v2.1/servers/e9324873-d141-4cb6-adca-4187bf085284 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:21:10.702086 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d2e936b9-ee84-488a-b092-742f09f61696 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:10.703204 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-ae4549ac-ce92-44d4-82c6-f2bdb04dd094 req-dd41a9ac-3702-44d5-aa4a-a9b1b5a424e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e19b3623-7c42-4270-94bd-d46fa920ae3f", "tag": "71c16489-2d3b-479d-8a58-18c9984bcbbf"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:21:10.703528 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d2e936b9-ee84-488a-b092-742f09f61696 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e19b3623-7c42-4270-94bd-d46fa920ae3f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:10.713518 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d2e936b9-ee84-488a-b092-742f09f61696 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:10.713999 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d2e936b9-ee84-488a-b092-742f09f61696 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:10.715350 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-ae4549ac-ce92-44d4-82c6-f2bdb04dd094 req-dd41a9ac-3702-44d5-aa4a-a9b1b5a424e5 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:10.716193 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-ae4549ac-ce92-44d4-82c6-f2bdb04dd094 req-dd41a9ac-3702-44d5-aa4a-a9b1b5a424e5 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:10.716696 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-ae4549ac-ce92-44d4-82c6-f2bdb04dd094 req-dd41a9ac-3702-44d5-aa4a-a9b1b5a424e5 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:10.720024 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d2e936b9-ee84-488a-b092-742f09f61696 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:10.722900 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d2e936b9-ee84-488a-b092-742f09f61696 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:10.723440 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d2e936b9-ee84-488a-b092-742f09f61696 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:10.726486 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d2e936b9-ee84-488a-b092-742f09f61696 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:10.731324 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-ae4549ac-ce92-44d4-82c6-f2bdb04dd094 req-dd41a9ac-3702-44d5-aa4a-a9b1b5a424e5 service nova] Creating event network-changed:71c16489-2d3b-479d-8a58-18c9984bcbbf for instance e19b3623-7c42-4270-94bd-d46fa920ae3f on n-h2-854247-14 Oct 17 14:21:10.737326 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-ae4549ac-ce92-44d4-82c6-f2bdb04dd094 req-dd41a9ac-3702-44d5-aa4a-a9b1b5a424e5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038372 Oct 17 14:21:10.738376 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3030/6198] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:21:11.391812 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d2e936b9-ee84-488a-b092-742f09f61696 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:11.403587 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d2e936b9-ee84-488a-b092-742f09f61696 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f" status: 200 len: 1563 microversion: 2.1 time: 0.706740 Oct 17 14:21:11.404557 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3169/6199] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:10 2022] GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f => generated 1563 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:21:13.882546 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-df272630-cffb-4d2c-b7fc-466be333f5d4 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:13.883151 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-df272630-cffb-4d2c-b7fc-466be333f5d4 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 37ac4563-7872-4787-8d42-87b04550bcd9] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:13.890737 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-df272630-cffb-4d2c-b7fc-466be333f5d4 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:13.891330 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-df272630-cffb-4d2c-b7fc-466be333f5d4 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:13.891781 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-df272630-cffb-4d2c-b7fc-466be333f5d4 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:13.892489 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-df272630-cffb-4d2c-b7fc-466be333f5d4 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:13.892953 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-df272630-cffb-4d2c-b7fc-466be333f5d4 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:13.893386 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-df272630-cffb-4d2c-b7fc-466be333f5d4 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:13.907982 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-df272630-cffb-4d2c-b7fc-466be333f5d4 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] HTTP exception thrown: Instance 37ac4563-7872-4787-8d42-87b04550bcd9 could not be found. Oct 17 14:21:13.909671 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-df272630-cffb-4d2c-b7fc-466be333f5d4 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Request method failure captured: Oct 17 14:21:13.909671 n-d-854247-14 devstack@n-api.service[127017]: request: DELETE /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9 HTTP/1.1 Oct 17 14:21:13.909671 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 14:21:13.909671 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 14:21:13.909671 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 14:21:13.909671 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 14:21:13.909671 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 14:21:13.909671 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 14:21:13.909671 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 14:21:13.909671 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 14:21:13.909671 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTWPt4q6KhJtaXfApyhSZ1uS2Yi83dufn15X2GOm5u94F5E_Yj644GYsWZT8YBgl1aUBmYfKlHMjXq-eb8c2HF1REfW755J7WOOs8k3QRgUHhfiijXEH0YeKQjwZvCrEKlD9sd8dyp1v8diPQXXtSf-PHzqWEcTzJgPsJ95on9ZJE1Jo Oct 17 14:21:13.909671 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 14:21:13.909671 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 14:21:13.909671 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 14:21:13.909671 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 14:21:13.909671 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 14:21:13.909671 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 14:21:13.909671 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 4ee70940341741cb8e31928b856de051 Oct 17 14:21:13.909671 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-TestVolumeBootPattern-2135999385 Oct 17 14:21:13.909671 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 14:21:13.909671 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 14:21:13.909671 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4ee70940341741cb8e31928b856de051"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4ee70940341741cb8e31928b856de051"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4ee70940341741cb8e31928b856de051"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4ee70940341741cb8e31928b856de051", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:21:13.909671 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-TestVolumeBootPattern-2135999385 Oct 17 14:21:13.909671 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 4ee70940341741cb8e31928b856de051 Oct 17 14:21:13.909671 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-TestVolumeBootPattern-2135999385 Oct 17 14:21:13.909671 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-TestVolumeBootPattern-2135999385-project Oct 17 14:21:13.909671 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 14:21:13.909671 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 14:21:13.909671 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 06a0e2dab7494a4682615a6269ac24f9 Oct 17 14:21:13.909671 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-TestVolumeBootPattern-2135999385-project Oct 17 14:21:13.909671 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 14:21:13.909671 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 37ac4563-7872-4787-8d42-87b04550bcd9 could not be found. Oct 17 14:21:13.909671 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '37ac4563-7872-4787-8d42-87b04550bcd9'} Oct 17 14:21:13.909671 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:21:13.909671 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:21:13.909671 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:21:13.909671 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:21:13.909671 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:21:13.909671 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:21:13.909671 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:21:13.909671 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:21:13.909671 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:21:13.909671 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:21:13.909671 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37ac4563-7872-4787-8d42-87b04550bcd9 could not be found. Oct 17 14:21:13.909671 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:21:13.909671 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:21:13.909671 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:21:13.909671 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:21:13.909671 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:21:13.909671 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:21:13.909671 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:21:13.909671 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:21:13.909671 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:21:13.909671 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:21:13.909671 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 14:21:13.909671 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 14:21:13.909671 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 14:21:13.909671 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 14:21:13.909671 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:21:13.909671 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:21:13.909671 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:21:13.909671 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:21:13.913369 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37ac4563-7872-4787-8d42-87b04550bcd9 could not be found. Oct 17 14:21:13.913369 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:21:13.913369 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:21:13.913369 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:21:13.913369 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:21:13.913369 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:21:13.913369 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:21:13.913369 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:21:13.913369 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:21:13.913369 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37ac4563-7872-4787-8d42-87b04550bcd9 could not be found. Oct 17 14:21:13.913369 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:21:13.913369 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-df272630-cffb-4d2c-b7fc-466be333f5d4 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Returning 404 to user: Instance 37ac4563-7872-4787-8d42-87b04550bcd9 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:21:13.913369 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-df272630-cffb-4d2c-b7fc-466be333f5d4 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "DELETE /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9" status: 404 len: 111 microversion: 2.1 time: 0.032910 Oct 17 14:21:13.913369 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3031/6200] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:21:13 2022] DELETE /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:21:13.920296 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-493213fd-63b0-43ef-81ea-883754eab11d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:13.922107 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-493213fd-63b0-43ef-81ea-883754eab11d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 37ac4563-7872-4787-8d42-87b04550bcd9] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:13.929715 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-493213fd-63b0-43ef-81ea-883754eab11d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:13.930203 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-493213fd-63b0-43ef-81ea-883754eab11d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:13.930636 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-493213fd-63b0-43ef-81ea-883754eab11d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:13.931384 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-493213fd-63b0-43ef-81ea-883754eab11d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:13.931834 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-493213fd-63b0-43ef-81ea-883754eab11d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:13.932235 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-493213fd-63b0-43ef-81ea-883754eab11d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:13.947577 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-493213fd-63b0-43ef-81ea-883754eab11d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] HTTP exception thrown: Instance 37ac4563-7872-4787-8d42-87b04550bcd9 could not be found. Oct 17 14:21:13.949390 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-493213fd-63b0-43ef-81ea-883754eab11d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Request method failure captured: Oct 17 14:21:13.949390 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9 HTTP/1.1 Oct 17 14:21:13.949390 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 14:21:13.949390 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 14:21:13.949390 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 14:21:13.949390 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 14:21:13.949390 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 14:21:13.949390 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 14:21:13.949390 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 14:21:13.949390 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 14:21:13.949390 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTWPt4q6KhJtaXfApyhSZ1uS2Yi83dufn15X2GOm5u94F5E_Yj644GYsWZT8YBgl1aUBmYfKlHMjXq-eb8c2HF1REfW755J7WOOs8k3QRgUHhfiijXEH0YeKQjwZvCrEKlD9sd8dyp1v8diPQXXtSf-PHzqWEcTzJgPsJ95on9ZJE1Jo Oct 17 14:21:13.949390 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 14:21:13.949390 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 14:21:13.949390 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 14:21:13.949390 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 14:21:13.949390 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 14:21:13.949390 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 14:21:13.949390 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 4ee70940341741cb8e31928b856de051 Oct 17 14:21:13.949390 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-TestVolumeBootPattern-2135999385 Oct 17 14:21:13.949390 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 14:21:13.949390 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 14:21:13.949390 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4ee70940341741cb8e31928b856de051"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4ee70940341741cb8e31928b856de051"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4ee70940341741cb8e31928b856de051"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4ee70940341741cb8e31928b856de051", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:21:13.949390 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-TestVolumeBootPattern-2135999385 Oct 17 14:21:13.949390 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 4ee70940341741cb8e31928b856de051 Oct 17 14:21:13.949390 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-TestVolumeBootPattern-2135999385 Oct 17 14:21:13.949390 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-TestVolumeBootPattern-2135999385-project Oct 17 14:21:13.949390 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 14:21:13.949390 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 14:21:13.949390 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 06a0e2dab7494a4682615a6269ac24f9 Oct 17 14:21:13.949390 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-TestVolumeBootPattern-2135999385-project Oct 17 14:21:13.949390 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 14:21:13.949390 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 37ac4563-7872-4787-8d42-87b04550bcd9 could not be found. Oct 17 14:21:13.949390 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '37ac4563-7872-4787-8d42-87b04550bcd9'} Oct 17 14:21:13.949390 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:21:13.949390 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:21:13.949390 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:21:13.949390 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:21:13.949390 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:21:13.949390 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:21:13.949390 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:21:13.949390 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:21:13.949390 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:21:13.949390 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:21:13.949390 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37ac4563-7872-4787-8d42-87b04550bcd9 could not be found. Oct 17 14:21:13.949390 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:21:13.949390 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:21:13.949390 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:21:13.949390 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:21:13.949390 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:21:13.949390 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:21:13.949390 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:21:13.949390 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:21:13.949390 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:21:13.949390 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:21:13.949390 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:21:13.949390 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:21:13.949390 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:21:13.949390 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:21:13.949390 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:21:13.949390 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:21:13.949390 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37ac4563-7872-4787-8d42-87b04550bcd9 could not be found. Oct 17 14:21:13.949390 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:21:13.949390 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:21:13.949390 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:21:13.953504 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:21:13.953504 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:21:13.953504 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:21:13.953504 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:21:13.953504 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:21:13.953504 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37ac4563-7872-4787-8d42-87b04550bcd9 could not be found. Oct 17 14:21:13.953504 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:21:13.953504 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-493213fd-63b0-43ef-81ea-883754eab11d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Returning 404 to user: Instance 37ac4563-7872-4787-8d42-87b04550bcd9 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:21:13.953504 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-493213fd-63b0-43ef-81ea-883754eab11d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9" status: 404 len: 111 microversion: 2.1 time: 0.034729 Oct 17 14:21:13.953504 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3170/6201] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:13 2022] GET /compute/v2.1/servers/37ac4563-7872-4787-8d42-87b04550bcd9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:21:14.340551 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5aa71626-6c0b-4c22-8031-5c5858744e9d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:14.341073 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5aa71626-6c0b-4c22-8031-5c5858744e9d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: e9324873-d141-4cb6-adca-4187bf085284] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:14.347497 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5aa71626-6c0b-4c22-8031-5c5858744e9d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:14.347988 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5aa71626-6c0b-4c22-8031-5c5858744e9d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:14.348439 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5aa71626-6c0b-4c22-8031-5c5858744e9d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:14.349135 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5aa71626-6c0b-4c22-8031-5c5858744e9d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:14.349600 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5aa71626-6c0b-4c22-8031-5c5858744e9d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:14.350033 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5aa71626-6c0b-4c22-8031-5c5858744e9d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:14.364455 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-5aa71626-6c0b-4c22-8031-5c5858744e9d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] HTTP exception thrown: Instance e9324873-d141-4cb6-adca-4187bf085284 could not be found. Oct 17 14:21:14.365963 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5aa71626-6c0b-4c22-8031-5c5858744e9d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Request method failure captured: Oct 17 14:21:14.365963 n-d-854247-14 devstack@n-api.service[127017]: request: DELETE /compute/v2.1/servers/e9324873-d141-4cb6-adca-4187bf085284 HTTP/1.1 Oct 17 14:21:14.365963 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 14:21:14.365963 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 14:21:14.365963 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 14:21:14.365963 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 14:21:14.365963 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 14:21:14.365963 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 14:21:14.365963 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 14:21:14.365963 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 14:21:14.365963 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTWPt4q6KhJtaXfApyhSZ1uS2Yi83dufn15X2GOm5u94F5E_Yj644GYsWZT8YBgl1aUBmYfKlHMjXq-eb8c2HF1REfW755J7WOOs8k3QRgUHhfiijXEH0YeKQjwZvCrEKlD9sd8dyp1v8diPQXXtSf-PHzqWEcTzJgPsJ95on9ZJE1Jo Oct 17 14:21:14.365963 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 14:21:14.365963 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 14:21:14.365963 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 14:21:14.365963 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 14:21:14.365963 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 14:21:14.365963 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 14:21:14.365963 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 4ee70940341741cb8e31928b856de051 Oct 17 14:21:14.365963 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-TestVolumeBootPattern-2135999385 Oct 17 14:21:14.365963 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 14:21:14.365963 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 14:21:14.365963 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4ee70940341741cb8e31928b856de051"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4ee70940341741cb8e31928b856de051"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4ee70940341741cb8e31928b856de051"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4ee70940341741cb8e31928b856de051", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:21:14.365963 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-TestVolumeBootPattern-2135999385 Oct 17 14:21:14.365963 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 4ee70940341741cb8e31928b856de051 Oct 17 14:21:14.365963 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-TestVolumeBootPattern-2135999385 Oct 17 14:21:14.365963 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-TestVolumeBootPattern-2135999385-project Oct 17 14:21:14.365963 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 14:21:14.365963 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 14:21:14.365963 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 06a0e2dab7494a4682615a6269ac24f9 Oct 17 14:21:14.365963 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-TestVolumeBootPattern-2135999385-project Oct 17 14:21:14.365963 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 14:21:14.365963 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance e9324873-d141-4cb6-adca-4187bf085284 could not be found. Oct 17 14:21:14.365963 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'e9324873-d141-4cb6-adca-4187bf085284'} Oct 17 14:21:14.365963 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:21:14.365963 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:21:14.365963 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:21:14.365963 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:21:14.365963 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:21:14.365963 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:21:14.365963 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:21:14.365963 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:21:14.365963 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:21:14.365963 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:21:14.365963 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9324873-d141-4cb6-adca-4187bf085284 could not be found. Oct 17 14:21:14.365963 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:21:14.365963 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:21:14.365963 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:21:14.365963 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:21:14.365963 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:21:14.365963 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:21:14.365963 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:21:14.365963 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:21:14.365963 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:21:14.365963 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:21:14.365963 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 14:21:14.365963 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 14:21:14.365963 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 14:21:14.365963 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 14:21:14.365963 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:21:14.365963 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:21:14.365963 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:21:14.365963 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:21:14.370580 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9324873-d141-4cb6-adca-4187bf085284 could not be found. Oct 17 14:21:14.370580 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:21:14.370580 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:21:14.370580 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:21:14.370580 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:21:14.370580 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:21:14.370580 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:21:14.370580 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:21:14.370580 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:21:14.370580 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9324873-d141-4cb6-adca-4187bf085284 could not be found. Oct 17 14:21:14.370580 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:21:14.370580 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5aa71626-6c0b-4c22-8031-5c5858744e9d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Returning 404 to user: Instance e9324873-d141-4cb6-adca-4187bf085284 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:21:14.370580 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5aa71626-6c0b-4c22-8031-5c5858744e9d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "DELETE /compute/v2.1/servers/e9324873-d141-4cb6-adca-4187bf085284" status: 404 len: 111 microversion: 2.1 time: 0.030730 Oct 17 14:21:14.370580 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3032/6202] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:21:14 2022] DELETE /compute/v2.1/servers/e9324873-d141-4cb6-adca-4187bf085284 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:21:14.376769 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e7c9c2d7-ae4e-43a4-b573-57733680d35d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:14.377412 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e7c9c2d7-ae4e-43a4-b573-57733680d35d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: e9324873-d141-4cb6-adca-4187bf085284] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:14.383936 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7c9c2d7-ae4e-43a4-b573-57733680d35d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:14.384431 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7c9c2d7-ae4e-43a4-b573-57733680d35d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:14.384869 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7c9c2d7-ae4e-43a4-b573-57733680d35d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:14.385564 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7c9c2d7-ae4e-43a4-b573-57733680d35d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:14.386023 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7c9c2d7-ae4e-43a4-b573-57733680d35d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:14.386449 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7c9c2d7-ae4e-43a4-b573-57733680d35d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:14.400774 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-e7c9c2d7-ae4e-43a4-b573-57733680d35d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] HTTP exception thrown: Instance e9324873-d141-4cb6-adca-4187bf085284 could not be found. Oct 17 14:21:14.402310 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e7c9c2d7-ae4e-43a4-b573-57733680d35d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Request method failure captured: Oct 17 14:21:14.402310 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/e9324873-d141-4cb6-adca-4187bf085284 HTTP/1.1 Oct 17 14:21:14.402310 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 14:21:14.402310 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 14:21:14.402310 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 14:21:14.402310 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 14:21:14.402310 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 14:21:14.402310 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 14:21:14.402310 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 14:21:14.402310 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 14:21:14.402310 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTWPt4q6KhJtaXfApyhSZ1uS2Yi83dufn15X2GOm5u94F5E_Yj644GYsWZT8YBgl1aUBmYfKlHMjXq-eb8c2HF1REfW755J7WOOs8k3QRgUHhfiijXEH0YeKQjwZvCrEKlD9sd8dyp1v8diPQXXtSf-PHzqWEcTzJgPsJ95on9ZJE1Jo Oct 17 14:21:14.402310 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 14:21:14.402310 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 14:21:14.402310 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 14:21:14.402310 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 14:21:14.402310 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 14:21:14.402310 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 14:21:14.402310 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 4ee70940341741cb8e31928b856de051 Oct 17 14:21:14.402310 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-TestVolumeBootPattern-2135999385 Oct 17 14:21:14.402310 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 14:21:14.402310 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 14:21:14.402310 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4ee70940341741cb8e31928b856de051"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4ee70940341741cb8e31928b856de051"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4ee70940341741cb8e31928b856de051"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4ee70940341741cb8e31928b856de051", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:21:14.402310 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-TestVolumeBootPattern-2135999385 Oct 17 14:21:14.402310 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 4ee70940341741cb8e31928b856de051 Oct 17 14:21:14.402310 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-TestVolumeBootPattern-2135999385 Oct 17 14:21:14.402310 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-TestVolumeBootPattern-2135999385-project Oct 17 14:21:14.402310 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 14:21:14.402310 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 14:21:14.402310 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 06a0e2dab7494a4682615a6269ac24f9 Oct 17 14:21:14.402310 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-TestVolumeBootPattern-2135999385-project Oct 17 14:21:14.402310 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 14:21:14.402310 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance e9324873-d141-4cb6-adca-4187bf085284 could not be found. Oct 17 14:21:14.402310 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'e9324873-d141-4cb6-adca-4187bf085284'} Oct 17 14:21:14.402310 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:21:14.402310 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:21:14.402310 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:21:14.402310 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:21:14.402310 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:21:14.402310 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:21:14.402310 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:21:14.402310 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:21:14.402310 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:21:14.402310 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:21:14.402310 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9324873-d141-4cb6-adca-4187bf085284 could not be found. Oct 17 14:21:14.402310 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:21:14.402310 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:21:14.402310 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:21:14.402310 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:21:14.402310 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:21:14.402310 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:21:14.402310 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:21:14.402310 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:21:14.402310 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:21:14.402310 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:21:14.402310 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:21:14.402310 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:21:14.402310 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:21:14.402310 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:21:14.402310 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:21:14.402310 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:21:14.402310 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9324873-d141-4cb6-adca-4187bf085284 could not be found. Oct 17 14:21:14.402310 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:21:14.402310 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:21:14.402310 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:21:14.406117 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:21:14.406117 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:21:14.406117 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:21:14.406117 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:21:14.406117 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:21:14.406117 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9324873-d141-4cb6-adca-4187bf085284 could not be found. Oct 17 14:21:14.406117 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:21:14.406117 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e7c9c2d7-ae4e-43a4-b573-57733680d35d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Returning 404 to user: Instance e9324873-d141-4cb6-adca-4187bf085284 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:21:14.406117 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e7c9c2d7-ae4e-43a4-b573-57733680d35d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/e9324873-d141-4cb6-adca-4187bf085284" status: 404 len: 111 microversion: 2.1 time: 0.031344 Oct 17 14:21:14.406117 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3171/6203] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:14 2022] GET /compute/v2.1/servers/e9324873-d141-4cb6-adca-4187bf085284 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:21:14.481099 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2d35e199-6d54-431c-9f3c-23c7fa05e65b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Action: 'create', calling method: .version_select at 0x7f7cd44b2e50>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1121990495", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMFOxQDspgCfXfjCi7EymEZLohXXAR6adE+9vZl8CzUySq7NLg09jNi2FogSMwjhGkMjxX2LYZRyGrjgHEZlqfqVXP0KEGo9MQFXPhpTWe7L6YwfqX2fS7H27kWb9ZIgwQ=="}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:21:14.497551 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-2d35e199-6d54-431c-9f3c-23c7fa05e65b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Getting quotas for project 4ee70940341741cb8e31928b856de051. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:21:14.503048 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-2d35e199-6d54-431c-9f3c-23c7fa05e65b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Getting quotas for user 06a0e2dab7494a4682615a6269ac24f9 and project 4ee70940341741cb8e31928b856de051. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:21:14.529647 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2d35e199-6d54-431c-9f3c-23c7fa05e65b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.052597 Oct 17 14:21:14.530243 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3033/6204] 10.222.0.79 () {60 vars in 1159 bytes} [Mon Oct 17 14:21:14 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:21:31.955928 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d46e8190-8e9f-4cf0-a08c-8f4ec3313e4e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1147354670", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1121990495", "security_groups": [{"name": "tempest-secgroup-smoke-1984704390"}], "block_device_mapping_v2": [{"uuid": "9f6a98bb-ef15-4da2-81df-df99b65b424b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "60d947eb-1d2b-4fd8-9101-f9fb7c7e0088"}]}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:21:31.966533 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:21:31.967197 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:21:32.077007 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-d46e8190-8e9f-4cf0-a08c-8f4ec3313e4e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] validate_networks() for [('60d947eb-1d2b-4fd8-9101-f9fb7c7e0088', None, None, None, None, None)] {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:21:32.477513 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-d46e8190-8e9f-4cf0-a08c-8f4ec3313e4e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:21:32.478085 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-d46e8190-8e9f-4cf0-a08c-8f4ec3313e4e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:21:32.478822 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-d46e8190-8e9f-4cf0-a08c-8f4ec3313e4e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:21:32.479478 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-d46e8190-8e9f-4cf0-a08c-8f4ec3313e4e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:21:32.479978 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-d46e8190-8e9f-4cf0-a08c-8f4ec3313e4e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:21:32.491479 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d46e8190-8e9f-4cf0-a08c-8f4ec3313e4e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:32.491965 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d46e8190-8e9f-4cf0-a08c-8f4ec3313e4e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:32.492399 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d46e8190-8e9f-4cf0-a08c-8f4ec3313e4e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:32.493129 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d46e8190-8e9f-4cf0-a08c-8f4ec3313e4e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:32.493585 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d46e8190-8e9f-4cf0-a08c-8f4ec3313e4e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:32.494010 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d46e8190-8e9f-4cf0-a08c-8f4ec3313e4e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:32.512051 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-d46e8190-8e9f-4cf0-a08c-8f4ec3313e4e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Getting quotas for project 4ee70940341741cb8e31928b856de051. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:21:32.517663 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-d46e8190-8e9f-4cf0-a08c-8f4ec3313e4e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Getting quotas for user 06a0e2dab7494a4682615a6269ac24f9 and project 4ee70940341741cb8e31928b856de051. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:21:32.579711 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d46e8190-8e9f-4cf0-a08c-8f4ec3313e4e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:21:32.581914 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d46e8190-8e9f-4cf0-a08c-8f4ec3313e4e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: d62cceda-a884-4e46-8825-114c6faa06b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9f6a98bb-ef15-4da2-81df-df99b65b424b',volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:21:32.713766 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=97 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:21:32.714558 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=4 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:21:32.715294 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:21:32.719433 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-74329df7-1412-4925-a81d-00e59f60903b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:21:32.721929 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-74329df7-1412-4925-a81d-00e59f60903b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e19b3623-7c42-4270-94bd-d46fa920ae3f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:32.732967 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-74329df7-1412-4925-a81d-00e59f60903b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:32.733476 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-74329df7-1412-4925-a81d-00e59f60903b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:32.733931 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-74329df7-1412-4925-a81d-00e59f60903b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:32.734654 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-74329df7-1412-4925-a81d-00e59f60903b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:32.735127 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-74329df7-1412-4925-a81d-00e59f60903b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:32.735357 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d46e8190-8e9f-4cf0-a08c-8f4ec3313e4e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.783157 Oct 17 14:21:32.735677 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-74329df7-1412-4925-a81d-00e59f60903b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:32.736180 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3172/6205] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 14:21:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:21:32.747419 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-edd48aee-b763-4518-9860-60cb09090770 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:32.748031 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-edd48aee-b763-4518-9860-60cb09090770 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: d62cceda-a884-4e46-8825-114c6faa06b4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:32.798608 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-74329df7-1412-4925-a81d-00e59f60903b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "POST /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f/action" status: 200 len: 24569 microversion: 2.1 time: 0.086709 Oct 17 14:21:32.799320 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3034/6206] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:21:32 2022] POST /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f/action => generated 24569 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:21:32.801813 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-edd48aee-b763-4518-9860-60cb09090770 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:32.809594 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-edd48aee-b763-4518-9860-60cb09090770 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/d62cceda-a884-4e46-8825-114c6faa06b4" status: 200 len: 1095 microversion: 2.1 time: 0.066021 Oct 17 14:21:32.810173 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3173/6207] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:32 2022] GET /compute/v2.1/servers/d62cceda-a884-4e46-8825-114c6faa06b4 => generated 1095 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:21:33.834377 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-897f9bcd-7b31-4387-bf9c-45d2651fcb1e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:33.835884 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-897f9bcd-7b31-4387-bf9c-45d2651fcb1e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: d62cceda-a884-4e46-8825-114c6faa06b4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:33.843925 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-897f9bcd-7b31-4387-bf9c-45d2651fcb1e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:33.844539 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-897f9bcd-7b31-4387-bf9c-45d2651fcb1e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:33.850025 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-897f9bcd-7b31-4387-bf9c-45d2651fcb1e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:33.850801 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-897f9bcd-7b31-4387-bf9c-45d2651fcb1e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:33.851313 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-897f9bcd-7b31-4387-bf9c-45d2651fcb1e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:33.851756 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-897f9bcd-7b31-4387-bf9c-45d2651fcb1e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:33.933042 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-897f9bcd-7b31-4387-bf9c-45d2651fcb1e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:33.942741 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-897f9bcd-7b31-4387-bf9c-45d2651fcb1e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/d62cceda-a884-4e46-8825-114c6faa06b4" status: 200 len: 1211 microversion: 2.1 time: 0.112952 Oct 17 14:21:33.943657 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3035/6208] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:33 2022] GET /compute/v2.1/servers/d62cceda-a884-4e46-8825-114c6faa06b4 => generated 1211 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:21:34.966292 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c27c60ae-177d-43f9-a00b-d41d7876daff tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:34.967693 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c27c60ae-177d-43f9-a00b-d41d7876daff tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: d62cceda-a884-4e46-8825-114c6faa06b4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:34.976444 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c27c60ae-177d-43f9-a00b-d41d7876daff tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:34.979727 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c27c60ae-177d-43f9-a00b-d41d7876daff tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:34.980362 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c27c60ae-177d-43f9-a00b-d41d7876daff tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:34.981273 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c27c60ae-177d-43f9-a00b-d41d7876daff tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:34.981900 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c27c60ae-177d-43f9-a00b-d41d7876daff tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:34.982505 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c27c60ae-177d-43f9-a00b-d41d7876daff tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:35.200762 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c27c60ae-177d-43f9-a00b-d41d7876daff tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:35.211212 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c27c60ae-177d-43f9-a00b-d41d7876daff tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/d62cceda-a884-4e46-8825-114c6faa06b4" status: 200 len: 1279 microversion: 2.1 time: 0.248956 Oct 17 14:21:35.212056 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3174/6209] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:34 2022] GET /compute/v2.1/servers/d62cceda-a884-4e46-8825-114c6faa06b4 => generated 1279 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:21:35.357749 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-953c2bb2-ac1c-475d-9875-f628cf08e92f req-e1646217-2616-4d61-bccd-a9c0cdb863bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d62cceda-a884-4e46-8825-114c6faa06b4", "tag": "213112b6-9fda-4eb4-a371-cbc5771bfd12"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:21:35.373387 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-953c2bb2-ac1c-475d-9875-f628cf08e92f req-e1646217-2616-4d61-bccd-a9c0cdb863bd service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:35.374476 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-953c2bb2-ac1c-475d-9875-f628cf08e92f req-e1646217-2616-4d61-bccd-a9c0cdb863bd service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:35.375867 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-953c2bb2-ac1c-475d-9875-f628cf08e92f req-e1646217-2616-4d61-bccd-a9c0cdb863bd service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:35.390187 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-953c2bb2-ac1c-475d-9875-f628cf08e92f req-e1646217-2616-4d61-bccd-a9c0cdb863bd service nova] Creating event network-changed:213112b6-9fda-4eb4-a371-cbc5771bfd12 for instance d62cceda-a884-4e46-8825-114c6faa06b4 on n-h1-854247-14 Oct 17 14:21:35.395657 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-953c2bb2-ac1c-475d-9875-f628cf08e92f req-e1646217-2616-4d61-bccd-a9c0cdb863bd service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042541 Oct 17 14:21:35.396971 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3036/6210] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:21:36.234387 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-eb621e39-788b-48df-bef0-245be9fb242a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:36.235004 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-eb621e39-788b-48df-bef0-245be9fb242a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: d62cceda-a884-4e46-8825-114c6faa06b4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:36.242907 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eb621e39-788b-48df-bef0-245be9fb242a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:36.243414 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eb621e39-788b-48df-bef0-245be9fb242a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:36.243885 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eb621e39-788b-48df-bef0-245be9fb242a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:36.244610 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eb621e39-788b-48df-bef0-245be9fb242a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:36.245068 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eb621e39-788b-48df-bef0-245be9fb242a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:36.245480 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eb621e39-788b-48df-bef0-245be9fb242a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:36.414430 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-eb621e39-788b-48df-bef0-245be9fb242a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:36.422781 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-eb621e39-788b-48df-bef0-245be9fb242a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/d62cceda-a884-4e46-8825-114c6faa06b4" status: 200 len: 1279 microversion: 2.1 time: 0.192488 Oct 17 14:21:36.423409 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3175/6211] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:36 2022] GET /compute/v2.1/servers/d62cceda-a884-4e46-8825-114c6faa06b4 => generated 1279 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:21:37.448278 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-16f534f2-45c2-4f82-b623-27f171d3e637 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:37.449112 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-16f534f2-45c2-4f82-b623-27f171d3e637 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: d62cceda-a884-4e46-8825-114c6faa06b4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:37.456156 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-16f534f2-45c2-4f82-b623-27f171d3e637 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:37.456664 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-16f534f2-45c2-4f82-b623-27f171d3e637 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:37.457143 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-16f534f2-45c2-4f82-b623-27f171d3e637 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:37.457847 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-16f534f2-45c2-4f82-b623-27f171d3e637 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:37.458317 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-16f534f2-45c2-4f82-b623-27f171d3e637 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:37.458758 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-16f534f2-45c2-4f82-b623-27f171d3e637 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:37.600558 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-16f534f2-45c2-4f82-b623-27f171d3e637 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:37.608743 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-16f534f2-45c2-4f82-b623-27f171d3e637 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/d62cceda-a884-4e46-8825-114c6faa06b4" status: 200 len: 1279 microversion: 2.1 time: 0.165835 Oct 17 14:21:37.609364 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3037/6212] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:37 2022] GET /compute/v2.1/servers/d62cceda-a884-4e46-8825-114c6faa06b4 => generated 1279 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:21:38.632279 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-06acfadb-9669-4165-9987-d940e2261524 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:38.632896 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-06acfadb-9669-4165-9987-d940e2261524 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: d62cceda-a884-4e46-8825-114c6faa06b4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:38.640716 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-06acfadb-9669-4165-9987-d940e2261524 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:38.641210 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-06acfadb-9669-4165-9987-d940e2261524 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:38.641648 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-06acfadb-9669-4165-9987-d940e2261524 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:38.642399 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-06acfadb-9669-4165-9987-d940e2261524 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:38.643046 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-06acfadb-9669-4165-9987-d940e2261524 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:38.643507 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-06acfadb-9669-4165-9987-d940e2261524 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:38.790137 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-06acfadb-9669-4165-9987-d940e2261524 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:38.798209 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-06acfadb-9669-4165-9987-d940e2261524 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/d62cceda-a884-4e46-8825-114c6faa06b4" status: 200 len: 1279 microversion: 2.1 time: 0.170113 Oct 17 14:21:38.798837 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3176/6213] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:38 2022] GET /compute/v2.1/servers/d62cceda-a884-4e46-8825-114c6faa06b4 => generated 1279 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:21:39.825339 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2318f0b0-172a-4d7d-9d75-ac7b19593808 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:39.825953 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2318f0b0-172a-4d7d-9d75-ac7b19593808 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: d62cceda-a884-4e46-8825-114c6faa06b4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:39.835285 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2318f0b0-172a-4d7d-9d75-ac7b19593808 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:39.835787 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2318f0b0-172a-4d7d-9d75-ac7b19593808 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:39.836223 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2318f0b0-172a-4d7d-9d75-ac7b19593808 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:39.836955 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2318f0b0-172a-4d7d-9d75-ac7b19593808 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:39.837420 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2318f0b0-172a-4d7d-9d75-ac7b19593808 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:39.837859 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2318f0b0-172a-4d7d-9d75-ac7b19593808 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:39.980282 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2318f0b0-172a-4d7d-9d75-ac7b19593808 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:39.989094 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2318f0b0-172a-4d7d-9d75-ac7b19593808 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/d62cceda-a884-4e46-8825-114c6faa06b4" status: 200 len: 1267 microversion: 2.1 time: 0.170245 Oct 17 14:21:39.989665 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3038/6214] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:39 2022] GET /compute/v2.1/servers/d62cceda-a884-4e46-8825-114c6faa06b4 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:21:41.012682 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3d401ae9-33cb-464b-a58c-65e0e470652a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:41.013294 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3d401ae9-33cb-464b-a58c-65e0e470652a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: d62cceda-a884-4e46-8825-114c6faa06b4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:41.020716 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3d401ae9-33cb-464b-a58c-65e0e470652a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:41.021205 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3d401ae9-33cb-464b-a58c-65e0e470652a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:41.021643 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3d401ae9-33cb-464b-a58c-65e0e470652a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:41.022347 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3d401ae9-33cb-464b-a58c-65e0e470652a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:41.022804 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3d401ae9-33cb-464b-a58c-65e0e470652a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:41.023243 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3d401ae9-33cb-464b-a58c-65e0e470652a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:41.163299 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3d401ae9-33cb-464b-a58c-65e0e470652a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:41.175511 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3d401ae9-33cb-464b-a58c-65e0e470652a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/d62cceda-a884-4e46-8825-114c6faa06b4" status: 200 len: 1267 microversion: 2.1 time: 0.166802 Oct 17 14:21:41.176124 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3177/6215] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:41 2022] GET /compute/v2.1/servers/d62cceda-a884-4e46-8825-114c6faa06b4 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:21:42.199871 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0d9433db-f4c8-4e93-9a4b-965eec0194d5 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:42.200537 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0d9433db-f4c8-4e93-9a4b-965eec0194d5 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: d62cceda-a884-4e46-8825-114c6faa06b4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:42.208943 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0d9433db-f4c8-4e93-9a4b-965eec0194d5 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:42.209463 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0d9433db-f4c8-4e93-9a4b-965eec0194d5 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:42.209916 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0d9433db-f4c8-4e93-9a4b-965eec0194d5 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:42.210624 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0d9433db-f4c8-4e93-9a4b-965eec0194d5 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:42.211090 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0d9433db-f4c8-4e93-9a4b-965eec0194d5 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:42.211570 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0d9433db-f4c8-4e93-9a4b-965eec0194d5 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:42.362034 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0d9433db-f4c8-4e93-9a4b-965eec0194d5 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:42.374201 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0d9433db-f4c8-4e93-9a4b-965eec0194d5 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/d62cceda-a884-4e46-8825-114c6faa06b4" status: 200 len: 1267 microversion: 2.1 time: 0.178636 Oct 17 14:21:42.375016 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3039/6216] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:42 2022] GET /compute/v2.1/servers/d62cceda-a884-4e46-8825-114c6faa06b4 => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:21:43.400366 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-defa5ee8-8be9-40e2-a66c-9573054163ed tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:43.401071 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-defa5ee8-8be9-40e2-a66c-9573054163ed tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: d62cceda-a884-4e46-8825-114c6faa06b4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:43.404560 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:21:43.405614 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=8 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:21:43.414045 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-defa5ee8-8be9-40e2-a66c-9573054163ed tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:43.414655 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-defa5ee8-8be9-40e2-a66c-9573054163ed tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:43.415320 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-defa5ee8-8be9-40e2-a66c-9573054163ed tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:43.416251 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-defa5ee8-8be9-40e2-a66c-9573054163ed tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:43.416858 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-defa5ee8-8be9-40e2-a66c-9573054163ed tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:43.417420 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-defa5ee8-8be9-40e2-a66c-9573054163ed tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:43.558307 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-defa5ee8-8be9-40e2-a66c-9573054163ed tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:43.566819 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-defa5ee8-8be9-40e2-a66c-9573054163ed tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/d62cceda-a884-4e46-8825-114c6faa06b4" status: 200 len: 1267 microversion: 2.1 time: 0.171944 Oct 17 14:21:43.567474 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3178/6217] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:43 2022] GET /compute/v2.1/servers/d62cceda-a884-4e46-8825-114c6faa06b4 => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:21:43.848687 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-fe7efb3b-7dba-41cf-8696-a52bb90fde13 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:21:43.851527 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-fe7efb3b-7dba-41cf-8696-a52bb90fde13 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e19b3623-7c42-4270-94bd-d46fa920ae3f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:43.858608 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fe7efb3b-7dba-41cf-8696-a52bb90fde13 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:43.859113 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fe7efb3b-7dba-41cf-8696-a52bb90fde13 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:43.859685 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fe7efb3b-7dba-41cf-8696-a52bb90fde13 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:43.860439 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fe7efb3b-7dba-41cf-8696-a52bb90fde13 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:43.860906 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fe7efb3b-7dba-41cf-8696-a52bb90fde13 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:43.861344 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fe7efb3b-7dba-41cf-8696-a52bb90fde13 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:43.956670 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-fe7efb3b-7dba-41cf-8696-a52bb90fde13 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:21:43.957126 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-fe7efb3b-7dba-41cf-8696-a52bb90fde13 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:21:43.957611 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-fe7efb3b-7dba-41cf-8696-a52bb90fde13 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:21:43.958031 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-fe7efb3b-7dba-41cf-8696-a52bb90fde13 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:21:43.958445 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-fe7efb3b-7dba-41cf-8696-a52bb90fde13 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:21:44.021183 n-d-854247-14 devstack@n-api.service[127017]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fe7efb3b-7dba-41cf-8696-a52bb90fde13 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [d638aeb8-e90f-49a1-9b7b-4e0c418c5a74] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 14:21:44.594406 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-78c99c86-a6f4-4c18-9601-236ea6deb9b2 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:44.595467 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-78c99c86-a6f4-4c18-9601-236ea6deb9b2 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: d62cceda-a884-4e46-8825-114c6faa06b4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:44.603674 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-78c99c86-a6f4-4c18-9601-236ea6deb9b2 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:44.604162 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-78c99c86-a6f4-4c18-9601-236ea6deb9b2 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:44.604600 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-78c99c86-a6f4-4c18-9601-236ea6deb9b2 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:44.605302 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-78c99c86-a6f4-4c18-9601-236ea6deb9b2 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:44.605760 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-78c99c86-a6f4-4c18-9601-236ea6deb9b2 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:44.606183 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-78c99c86-a6f4-4c18-9601-236ea6deb9b2 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:44.746831 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-78c99c86-a6f4-4c18-9601-236ea6deb9b2 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:44.755013 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-78c99c86-a6f4-4c18-9601-236ea6deb9b2 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/d62cceda-a884-4e46-8825-114c6faa06b4" status: 200 len: 1267 microversion: 2.1 time: 0.167396 Oct 17 14:21:44.755645 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3179/6218] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:44 2022] GET /compute/v2.1/servers/d62cceda-a884-4e46-8825-114c6faa06b4 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:21:45.032672 n-d-854247-14 devstack@n-api.service[127017]: INFO oslo.messaging._drivers.impl_rabbit [None req-fe7efb3b-7dba-41cf-8696-a52bb90fde13 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [d638aeb8-e90f-49a1-9b7b-4e0c418c5a74] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 57900. Oct 17 14:21:45.038935 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-fe7efb3b-7dba-41cf-8696-a52bb90fde13 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e19b3623-7c42-4270-94bd-d46fa920ae3f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:45.051135 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fe7efb3b-7dba-41cf-8696-a52bb90fde13 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:45.051680 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fe7efb3b-7dba-41cf-8696-a52bb90fde13 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:45.052137 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fe7efb3b-7dba-41cf-8696-a52bb90fde13 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:45.052893 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fe7efb3b-7dba-41cf-8696-a52bb90fde13 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:45.053362 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fe7efb3b-7dba-41cf-8696-a52bb90fde13 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:45.053803 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fe7efb3b-7dba-41cf-8696-a52bb90fde13 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:45.085298 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-fe7efb3b-7dba-41cf-8696-a52bb90fde13 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "POST /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f/action" status: 202 len: 1137 microversion: 2.1 time: 1.242223 Oct 17 14:21:45.085954 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3040/6219] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:21:43 2022] POST /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f/action => generated 1137 bytes in 1244 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 17 14:21:45.246029 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9ef949bd-4093-40a5-8569-380d264b4a6d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:45.246731 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9ef949bd-4093-40a5-8569-380d264b4a6d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e19b3623-7c42-4270-94bd-d46fa920ae3f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:45.253414 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9ef949bd-4093-40a5-8569-380d264b4a6d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:45.253894 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9ef949bd-4093-40a5-8569-380d264b4a6d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:45.254324 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9ef949bd-4093-40a5-8569-380d264b4a6d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:45.255014 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9ef949bd-4093-40a5-8569-380d264b4a6d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:45.255504 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9ef949bd-4093-40a5-8569-380d264b4a6d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:45.255925 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9ef949bd-4093-40a5-8569-380d264b4a6d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:45.402409 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9ef949bd-4093-40a5-8569-380d264b4a6d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:45.410666 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9ef949bd-4093-40a5-8569-380d264b4a6d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f" status: 200 len: 1691 microversion: 2.1 time: 0.168667 Oct 17 14:21:45.411277 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3180/6220] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:45 2022] GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f => generated 1691 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:21:45.778968 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e82a52f1-8ad0-4b0b-8fe1-f7e4dfa89bf3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:45.779087 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e82a52f1-8ad0-4b0b-8fe1-f7e4dfa89bf3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: d62cceda-a884-4e46-8825-114c6faa06b4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:45.785656 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e82a52f1-8ad0-4b0b-8fe1-f7e4dfa89bf3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:45.786151 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e82a52f1-8ad0-4b0b-8fe1-f7e4dfa89bf3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:45.786597 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e82a52f1-8ad0-4b0b-8fe1-f7e4dfa89bf3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:45.787332 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e82a52f1-8ad0-4b0b-8fe1-f7e4dfa89bf3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:45.787792 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e82a52f1-8ad0-4b0b-8fe1-f7e4dfa89bf3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:45.788220 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e82a52f1-8ad0-4b0b-8fe1-f7e4dfa89bf3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:45.941718 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e82a52f1-8ad0-4b0b-8fe1-f7e4dfa89bf3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:45.950089 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e82a52f1-8ad0-4b0b-8fe1-f7e4dfa89bf3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/d62cceda-a884-4e46-8825-114c6faa06b4" status: 200 len: 1267 microversion: 2.1 time: 0.175759 Oct 17 14:21:45.950671 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3041/6221] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:45 2022] GET /compute/v2.1/servers/d62cceda-a884-4e46-8825-114c6faa06b4 => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:21:46.436431 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7a4d381e-a6bb-43a1-bbb3-844f3c1d9ebf tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:46.437211 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7a4d381e-a6bb-43a1-bbb3-844f3c1d9ebf tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e19b3623-7c42-4270-94bd-d46fa920ae3f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:46.446781 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7a4d381e-a6bb-43a1-bbb3-844f3c1d9ebf tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:46.447480 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7a4d381e-a6bb-43a1-bbb3-844f3c1d9ebf tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:46.448063 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7a4d381e-a6bb-43a1-bbb3-844f3c1d9ebf tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:46.448989 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7a4d381e-a6bb-43a1-bbb3-844f3c1d9ebf tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:46.449593 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7a4d381e-a6bb-43a1-bbb3-844f3c1d9ebf tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:46.450156 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7a4d381e-a6bb-43a1-bbb3-844f3c1d9ebf tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:46.609455 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7a4d381e-a6bb-43a1-bbb3-844f3c1d9ebf tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:46.617539 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7a4d381e-a6bb-43a1-bbb3-844f3c1d9ebf tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f" status: 200 len: 1691 microversion: 2.1 time: 0.186933 Oct 17 14:21:46.618132 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3181/6222] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:46 2022] GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f => generated 1691 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:21:46.976059 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5de314ef-e691-4e59-9386-8dbf0e831398 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:46.977406 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5de314ef-e691-4e59-9386-8dbf0e831398 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: d62cceda-a884-4e46-8825-114c6faa06b4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:46.984694 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5de314ef-e691-4e59-9386-8dbf0e831398 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:46.985208 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5de314ef-e691-4e59-9386-8dbf0e831398 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:46.985658 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5de314ef-e691-4e59-9386-8dbf0e831398 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:46.986415 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5de314ef-e691-4e59-9386-8dbf0e831398 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:46.986906 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5de314ef-e691-4e59-9386-8dbf0e831398 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:46.987397 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5de314ef-e691-4e59-9386-8dbf0e831398 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:47.122782 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5de314ef-e691-4e59-9386-8dbf0e831398 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:47.130856 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5de314ef-e691-4e59-9386-8dbf0e831398 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/d62cceda-a884-4e46-8825-114c6faa06b4" status: 200 len: 1267 microversion: 2.1 time: 0.159961 Oct 17 14:21:47.131473 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3042/6223] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:46 2022] GET /compute/v2.1/servers/d62cceda-a884-4e46-8825-114c6faa06b4 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:21:47.645245 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d7c408ca-1311-4f57-9910-f23d515c0bd4 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:47.646573 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d7c408ca-1311-4f57-9910-f23d515c0bd4 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e19b3623-7c42-4270-94bd-d46fa920ae3f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:47.658590 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d7c408ca-1311-4f57-9910-f23d515c0bd4 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:47.659463 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d7c408ca-1311-4f57-9910-f23d515c0bd4 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:47.660466 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d7c408ca-1311-4f57-9910-f23d515c0bd4 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:47.661171 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d7c408ca-1311-4f57-9910-f23d515c0bd4 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:47.661660 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d7c408ca-1311-4f57-9910-f23d515c0bd4 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:47.662088 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d7c408ca-1311-4f57-9910-f23d515c0bd4 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:47.800379 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d7c408ca-1311-4f57-9910-f23d515c0bd4 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:47.808399 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d7c408ca-1311-4f57-9910-f23d515c0bd4 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f" status: 200 len: 1691 microversion: 2.1 time: 0.169812 Oct 17 14:21:47.809294 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3182/6224] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:47 2022] GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f => generated 1691 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:21:48.156796 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b7b378dd-ea2f-44cc-aaff-54a4a52746fe tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:48.157436 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b7b378dd-ea2f-44cc-aaff-54a4a52746fe tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: d62cceda-a884-4e46-8825-114c6faa06b4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:48.165079 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b7b378dd-ea2f-44cc-aaff-54a4a52746fe tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:48.165589 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b7b378dd-ea2f-44cc-aaff-54a4a52746fe tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:48.166045 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b7b378dd-ea2f-44cc-aaff-54a4a52746fe tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:48.166822 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b7b378dd-ea2f-44cc-aaff-54a4a52746fe tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:48.167483 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b7b378dd-ea2f-44cc-aaff-54a4a52746fe tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:48.168120 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b7b378dd-ea2f-44cc-aaff-54a4a52746fe tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:48.312988 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b7b378dd-ea2f-44cc-aaff-54a4a52746fe tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:48.321578 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b7b378dd-ea2f-44cc-aaff-54a4a52746fe tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/d62cceda-a884-4e46-8825-114c6faa06b4" status: 200 len: 1267 microversion: 2.1 time: 0.170464 Oct 17 14:21:48.322164 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3043/6225] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:48 2022] GET /compute/v2.1/servers/d62cceda-a884-4e46-8825-114c6faa06b4 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:21:48.835470 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-61351255-7342-4542-bd4f-0ef43c1eab1c tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:48.836196 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-61351255-7342-4542-bd4f-0ef43c1eab1c tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e19b3623-7c42-4270-94bd-d46fa920ae3f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:48.843068 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-61351255-7342-4542-bd4f-0ef43c1eab1c tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:48.843574 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-61351255-7342-4542-bd4f-0ef43c1eab1c tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:48.844010 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-61351255-7342-4542-bd4f-0ef43c1eab1c tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:48.844698 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-61351255-7342-4542-bd4f-0ef43c1eab1c tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:48.845149 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-61351255-7342-4542-bd4f-0ef43c1eab1c tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:48.845566 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-61351255-7342-4542-bd4f-0ef43c1eab1c tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:48.988393 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-61351255-7342-4542-bd4f-0ef43c1eab1c tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:48.996727 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-61351255-7342-4542-bd4f-0ef43c1eab1c tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f" status: 200 len: 1691 microversion: 2.1 time: 0.166676 Oct 17 14:21:48.997416 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3183/6226] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:48 2022] GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f => generated 1691 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:21:49.102230 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-a6a33bc4-dfbb-4cec-9db8-26258d0b81fa req-5a0d3445-1fbd-4e05-b9a2-ef1ac1aaabef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d62cceda-a884-4e46-8825-114c6faa06b4", "name": "network-vif-plugged", "status": "completed", "tag": "213112b6-9fda-4eb4-a371-cbc5771bfd12"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:21:49.112675 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-a6a33bc4-dfbb-4cec-9db8-26258d0b81fa req-5a0d3445-1fbd-4e05-b9a2-ef1ac1aaabef service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:49.113254 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-a6a33bc4-dfbb-4cec-9db8-26258d0b81fa req-5a0d3445-1fbd-4e05-b9a2-ef1ac1aaabef service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:49.113789 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-a6a33bc4-dfbb-4cec-9db8-26258d0b81fa req-5a0d3445-1fbd-4e05-b9a2-ef1ac1aaabef service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:49.125475 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-a6a33bc4-dfbb-4cec-9db8-26258d0b81fa req-5a0d3445-1fbd-4e05-b9a2-ef1ac1aaabef service nova] Creating event network-vif-plugged:213112b6-9fda-4eb4-a371-cbc5771bfd12 for instance d62cceda-a884-4e46-8825-114c6faa06b4 on n-h1-854247-14 Oct 17 14:21:49.130911 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-a6a33bc4-dfbb-4cec-9db8-26258d0b81fa req-5a0d3445-1fbd-4e05-b9a2-ef1ac1aaabef service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032814 Oct 17 14:21:49.131745 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3044/6227] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:21:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:21:49.348614 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0d333df4-9de1-4032-9c12-95c57a14fdd7 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:49.349225 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0d333df4-9de1-4032-9c12-95c57a14fdd7 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: d62cceda-a884-4e46-8825-114c6faa06b4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:49.355461 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0d333df4-9de1-4032-9c12-95c57a14fdd7 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:49.355940 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0d333df4-9de1-4032-9c12-95c57a14fdd7 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:49.356368 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0d333df4-9de1-4032-9c12-95c57a14fdd7 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:49.357047 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0d333df4-9de1-4032-9c12-95c57a14fdd7 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:49.357523 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0d333df4-9de1-4032-9c12-95c57a14fdd7 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:49.357938 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0d333df4-9de1-4032-9c12-95c57a14fdd7 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:49.492774 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0d333df4-9de1-4032-9c12-95c57a14fdd7 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:49.504815 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0d333df4-9de1-4032-9c12-95c57a14fdd7 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/d62cceda-a884-4e46-8825-114c6faa06b4" status: 200 len: 1267 microversion: 2.1 time: 0.160649 Oct 17 14:21:49.505588 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3184/6228] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:49 2022] GET /compute/v2.1/servers/d62cceda-a884-4e46-8825-114c6faa06b4 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:21:50.027098 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6bb7734b-f57d-4382-816a-2b86ce13a4ab tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:50.028285 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6bb7734b-f57d-4382-816a-2b86ce13a4ab tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e19b3623-7c42-4270-94bd-d46fa920ae3f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:50.038010 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6bb7734b-f57d-4382-816a-2b86ce13a4ab tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:50.038442 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6bb7734b-f57d-4382-816a-2b86ce13a4ab tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:50.038905 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6bb7734b-f57d-4382-816a-2b86ce13a4ab tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:50.039640 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6bb7734b-f57d-4382-816a-2b86ce13a4ab tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:50.040101 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6bb7734b-f57d-4382-816a-2b86ce13a4ab tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:50.040530 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6bb7734b-f57d-4382-816a-2b86ce13a4ab tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:50.190523 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6bb7734b-f57d-4382-816a-2b86ce13a4ab tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:50.199084 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6bb7734b-f57d-4382-816a-2b86ce13a4ab tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f" status: 200 len: 1691 microversion: 2.1 time: 0.180620 Oct 17 14:21:50.199713 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3045/6229] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:50 2022] GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f => generated 1691 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:21:50.532722 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-55f0daa3-febd-4f13-8f66-ab9b576cba55 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:50.533772 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-55f0daa3-febd-4f13-8f66-ab9b576cba55 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: d62cceda-a884-4e46-8825-114c6faa06b4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:50.542201 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-55f0daa3-febd-4f13-8f66-ab9b576cba55 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:50.542687 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-55f0daa3-febd-4f13-8f66-ab9b576cba55 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:50.543118 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-55f0daa3-febd-4f13-8f66-ab9b576cba55 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:50.543849 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-55f0daa3-febd-4f13-8f66-ab9b576cba55 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:50.544300 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-55f0daa3-febd-4f13-8f66-ab9b576cba55 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:50.544725 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-55f0daa3-febd-4f13-8f66-ab9b576cba55 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:50.677607 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-55f0daa3-febd-4f13-8f66-ab9b576cba55 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:50.685971 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-55f0daa3-febd-4f13-8f66-ab9b576cba55 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/d62cceda-a884-4e46-8825-114c6faa06b4" status: 200 len: 1454 microversion: 2.1 time: 0.159898 Oct 17 14:21:50.686562 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3185/6230] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:50 2022] GET /compute/v2.1/servers/d62cceda-a884-4e46-8825-114c6faa06b4 => generated 1454 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:21:50.709308 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-101f946f-4094-4d37-8b33-8ec08475dba3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:50.709944 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-101f946f-4094-4d37-8b33-8ec08475dba3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: d62cceda-a884-4e46-8825-114c6faa06b4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:50.716830 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-101f946f-4094-4d37-8b33-8ec08475dba3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:50.717335 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-101f946f-4094-4d37-8b33-8ec08475dba3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:50.717791 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-101f946f-4094-4d37-8b33-8ec08475dba3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:50.718496 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-101f946f-4094-4d37-8b33-8ec08475dba3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:50.718983 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-101f946f-4094-4d37-8b33-8ec08475dba3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:50.719472 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-101f946f-4094-4d37-8b33-8ec08475dba3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:50.861825 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-101f946f-4094-4d37-8b33-8ec08475dba3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:50.870137 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-101f946f-4094-4d37-8b33-8ec08475dba3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/d62cceda-a884-4e46-8825-114c6faa06b4" status: 200 len: 1454 microversion: 2.1 time: 0.165168 Oct 17 14:21:50.870724 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3046/6231] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:50 2022] GET /compute/v2.1/servers/d62cceda-a884-4e46-8825-114c6faa06b4 => generated 1454 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:21:51.223617 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e26fb99f-8833-485a-87e2-7f95cdf64763 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:51.224359 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e26fb99f-8833-485a-87e2-7f95cdf64763 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e19b3623-7c42-4270-94bd-d46fa920ae3f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:51.230662 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e26fb99f-8833-485a-87e2-7f95cdf64763 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:51.231144 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e26fb99f-8833-485a-87e2-7f95cdf64763 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:51.231678 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e26fb99f-8833-485a-87e2-7f95cdf64763 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:51.232373 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e26fb99f-8833-485a-87e2-7f95cdf64763 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:51.232818 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e26fb99f-8833-485a-87e2-7f95cdf64763 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:51.233233 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e26fb99f-8833-485a-87e2-7f95cdf64763 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:51.437040 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e26fb99f-8833-485a-87e2-7f95cdf64763 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:51.447231 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e26fb99f-8833-485a-87e2-7f95cdf64763 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f" status: 200 len: 1691 microversion: 2.1 time: 0.227185 Oct 17 14:21:51.460253 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3186/6232] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:51 2022] GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f => generated 1691 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:21:52.472317 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1751d61e-b267-4b65-b06c-cdbadf39a7b0 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:52.472900 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1751d61e-b267-4b65-b06c-cdbadf39a7b0 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e19b3623-7c42-4270-94bd-d46fa920ae3f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:52.481267 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1751d61e-b267-4b65-b06c-cdbadf39a7b0 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:52.481772 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1751d61e-b267-4b65-b06c-cdbadf39a7b0 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:52.482228 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1751d61e-b267-4b65-b06c-cdbadf39a7b0 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:52.482955 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1751d61e-b267-4b65-b06c-cdbadf39a7b0 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:52.483642 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1751d61e-b267-4b65-b06c-cdbadf39a7b0 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:52.484082 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1751d61e-b267-4b65-b06c-cdbadf39a7b0 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:52.939553 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1751d61e-b267-4b65-b06c-cdbadf39a7b0 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:52.948314 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1751d61e-b267-4b65-b06c-cdbadf39a7b0 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f" status: 200 len: 1691 microversion: 2.1 time: 0.480085 Oct 17 14:21:52.948912 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3047/6233] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:52 2022] GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f => generated 1691 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:21:53.055943 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-3f86ad85-1b67-4f38-857b-17588478f925 req-d9d8bf31-1b46-40cc-ab79-de78999d3458 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d62cceda-a884-4e46-8825-114c6faa06b4", "tag": "213112b6-9fda-4eb4-a371-cbc5771bfd12"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:21:53.067836 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-3f86ad85-1b67-4f38-857b-17588478f925 req-d9d8bf31-1b46-40cc-ab79-de78999d3458 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:53.068713 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-3f86ad85-1b67-4f38-857b-17588478f925 req-d9d8bf31-1b46-40cc-ab79-de78999d3458 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:53.069459 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-3f86ad85-1b67-4f38-857b-17588478f925 req-d9d8bf31-1b46-40cc-ab79-de78999d3458 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:53.082001 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-3f86ad85-1b67-4f38-857b-17588478f925 req-d9d8bf31-1b46-40cc-ab79-de78999d3458 service nova] Creating event network-changed:213112b6-9fda-4eb4-a371-cbc5771bfd12 for instance d62cceda-a884-4e46-8825-114c6faa06b4 on n-h1-854247-14 Oct 17 14:21:53.087709 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-3f86ad85-1b67-4f38-857b-17588478f925 req-d9d8bf31-1b46-40cc-ab79-de78999d3458 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035477 Oct 17 14:21:53.088352 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3187/6234] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:21:53.972438 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-22f02b1c-2c5e-4da6-bf96-a6b896d8cbac tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:53.973065 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-22f02b1c-2c5e-4da6-bf96-a6b896d8cbac tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e19b3623-7c42-4270-94bd-d46fa920ae3f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:53.980305 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-22f02b1c-2c5e-4da6-bf96-a6b896d8cbac tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:53.980870 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-22f02b1c-2c5e-4da6-bf96-a6b896d8cbac tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:53.981527 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-22f02b1c-2c5e-4da6-bf96-a6b896d8cbac tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:53.982246 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-22f02b1c-2c5e-4da6-bf96-a6b896d8cbac tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:53.982706 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-22f02b1c-2c5e-4da6-bf96-a6b896d8cbac tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:53.983141 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-22f02b1c-2c5e-4da6-bf96-a6b896d8cbac tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:54.125584 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-22f02b1c-2c5e-4da6-bf96-a6b896d8cbac tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:54.133548 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-22f02b1c-2c5e-4da6-bf96-a6b896d8cbac tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f" status: 200 len: 1691 microversion: 2.1 time: 0.165375 Oct 17 14:21:54.134130 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3048/6235] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:53 2022] GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f => generated 1691 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:21:55.160531 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c1d32433-903a-4177-9638-5b96b8d5c497 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:55.161507 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c1d32433-903a-4177-9638-5b96b8d5c497 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e19b3623-7c42-4270-94bd-d46fa920ae3f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:55.169555 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1d32433-903a-4177-9638-5b96b8d5c497 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:55.170036 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1d32433-903a-4177-9638-5b96b8d5c497 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:55.170459 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1d32433-903a-4177-9638-5b96b8d5c497 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:55.171981 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1d32433-903a-4177-9638-5b96b8d5c497 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:55.171981 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1d32433-903a-4177-9638-5b96b8d5c497 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:55.172184 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1d32433-903a-4177-9638-5b96b8d5c497 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:55.350707 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c1d32433-903a-4177-9638-5b96b8d5c497 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:55.358664 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c1d32433-903a-4177-9638-5b96b8d5c497 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f" status: 200 len: 1691 microversion: 2.1 time: 0.204829 Oct 17 14:21:55.359281 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3188/6236] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:55 2022] GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f => generated 1691 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:21:56.382340 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-511310c6-e4d8-4743-8b86-4a1fa3291692 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:56.382900 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-511310c6-e4d8-4743-8b86-4a1fa3291692 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e19b3623-7c42-4270-94bd-d46fa920ae3f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:56.390610 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-511310c6-e4d8-4743-8b86-4a1fa3291692 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:56.391107 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-511310c6-e4d8-4743-8b86-4a1fa3291692 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:56.391610 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-511310c6-e4d8-4743-8b86-4a1fa3291692 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:56.392324 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-511310c6-e4d8-4743-8b86-4a1fa3291692 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:56.392797 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-511310c6-e4d8-4743-8b86-4a1fa3291692 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:56.393241 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-511310c6-e4d8-4743-8b86-4a1fa3291692 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:56.532150 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-511310c6-e4d8-4743-8b86-4a1fa3291692 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:56.540663 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-511310c6-e4d8-4743-8b86-4a1fa3291692 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f" status: 200 len: 1691 microversion: 2.1 time: 0.162480 Oct 17 14:21:56.541245 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3049/6237] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:56 2022] GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:21:57.564752 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-15cc53d3-6469-4f5d-9a25-15cf9e3c953d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:57.565401 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-15cc53d3-6469-4f5d-9a25-15cf9e3c953d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e19b3623-7c42-4270-94bd-d46fa920ae3f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:57.572636 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-15cc53d3-6469-4f5d-9a25-15cf9e3c953d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:57.573235 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-15cc53d3-6469-4f5d-9a25-15cf9e3c953d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:57.573677 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-15cc53d3-6469-4f5d-9a25-15cf9e3c953d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:57.574375 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-15cc53d3-6469-4f5d-9a25-15cf9e3c953d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:57.574828 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-15cc53d3-6469-4f5d-9a25-15cf9e3c953d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:57.575285 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-15cc53d3-6469-4f5d-9a25-15cf9e3c953d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:57.719233 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-15cc53d3-6469-4f5d-9a25-15cf9e3c953d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:57.731292 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-15cc53d3-6469-4f5d-9a25-15cf9e3c953d tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f" status: 200 len: 1691 microversion: 2.1 time: 0.170237 Oct 17 14:21:57.732070 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3189/6238] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:57 2022] GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f => generated 1691 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:21:58.760183 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5555f3aa-a0ea-48d1-bf1b-50238c2ca3dd tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:58.760803 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5555f3aa-a0ea-48d1-bf1b-50238c2ca3dd tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e19b3623-7c42-4270-94bd-d46fa920ae3f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:58.769047 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5555f3aa-a0ea-48d1-bf1b-50238c2ca3dd tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:58.769646 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5555f3aa-a0ea-48d1-bf1b-50238c2ca3dd tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:58.770123 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5555f3aa-a0ea-48d1-bf1b-50238c2ca3dd tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:58.770952 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5555f3aa-a0ea-48d1-bf1b-50238c2ca3dd tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:58.771546 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5555f3aa-a0ea-48d1-bf1b-50238c2ca3dd tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:58.772042 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5555f3aa-a0ea-48d1-bf1b-50238c2ca3dd tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:58.777322 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:21:58.923669 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5555f3aa-a0ea-48d1-bf1b-50238c2ca3dd tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:58.932131 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5555f3aa-a0ea-48d1-bf1b-50238c2ca3dd tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f" status: 200 len: 1691 microversion: 2.1 time: 0.177520 Oct 17 14:21:58.932998 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3050/6239] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:58 2022] GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f => generated 1691 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:21:59.960917 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a3136e26-53df-4f88-ac42-68d4d3ef0d57 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:59.961546 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a3136e26-53df-4f88-ac42-68d4d3ef0d57 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e19b3623-7c42-4270-94bd-d46fa920ae3f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:59.968651 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a3136e26-53df-4f88-ac42-68d4d3ef0d57 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:59.969131 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a3136e26-53df-4f88-ac42-68d4d3ef0d57 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:59.969632 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a3136e26-53df-4f88-ac42-68d4d3ef0d57 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:59.970362 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a3136e26-53df-4f88-ac42-68d4d3ef0d57 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:59.970870 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a3136e26-53df-4f88-ac42-68d4d3ef0d57 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:59.971324 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a3136e26-53df-4f88-ac42-68d4d3ef0d57 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:00.111604 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a3136e26-53df-4f88-ac42-68d4d3ef0d57 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:00.115551 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=100 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:22:00.121674 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a3136e26-53df-4f88-ac42-68d4d3ef0d57 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f" status: 200 len: 1691 microversion: 2.1 time: 0.167540 Oct 17 14:22:00.122255 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3190/6240] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:59 2022] GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f => generated 1691 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:22:01.146557 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d76df842-6cf4-419c-9b97-0d6a90d5c016 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:01.147190 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d76df842-6cf4-419c-9b97-0d6a90d5c016 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e19b3623-7c42-4270-94bd-d46fa920ae3f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:01.154956 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d76df842-6cf4-419c-9b97-0d6a90d5c016 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:01.155488 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d76df842-6cf4-419c-9b97-0d6a90d5c016 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:01.155937 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d76df842-6cf4-419c-9b97-0d6a90d5c016 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:01.156650 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d76df842-6cf4-419c-9b97-0d6a90d5c016 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:01.157108 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d76df842-6cf4-419c-9b97-0d6a90d5c016 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:01.157543 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d76df842-6cf4-419c-9b97-0d6a90d5c016 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:01.297061 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d76df842-6cf4-419c-9b97-0d6a90d5c016 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:01.305432 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d76df842-6cf4-419c-9b97-0d6a90d5c016 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f" status: 200 len: 1691 microversion: 2.1 time: 0.162878 Oct 17 14:22:01.306008 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3051/6241] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:01 2022] GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:22:02.333742 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f2d6c40f-5ad4-48e8-a4fa-d31ab07e23e3 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:02.334632 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f2d6c40f-5ad4-48e8-a4fa-d31ab07e23e3 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e19b3623-7c42-4270-94bd-d46fa920ae3f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:02.339142 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:22:02.344646 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f2d6c40f-5ad4-48e8-a4fa-d31ab07e23e3 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:02.345152 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f2d6c40f-5ad4-48e8-a4fa-d31ab07e23e3 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:02.345555 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f2d6c40f-5ad4-48e8-a4fa-d31ab07e23e3 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:02.346244 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f2d6c40f-5ad4-48e8-a4fa-d31ab07e23e3 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:02.346695 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f2d6c40f-5ad4-48e8-a4fa-d31ab07e23e3 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:02.347116 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f2d6c40f-5ad4-48e8-a4fa-d31ab07e23e3 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:02.493739 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f2d6c40f-5ad4-48e8-a4fa-d31ab07e23e3 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:02.502037 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f2d6c40f-5ad4-48e8-a4fa-d31ab07e23e3 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f" status: 200 len: 1697 microversion: 2.1 time: 0.175038 Oct 17 14:22:02.502606 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3191/6242] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:02 2022] GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f => generated 1697 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:22:03.526093 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e24c1dff-8b97-49d0-935a-dbc4fd80c84b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:03.527039 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e24c1dff-8b97-49d0-935a-dbc4fd80c84b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e19b3623-7c42-4270-94bd-d46fa920ae3f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:03.529881 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=41 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:22:03.535611 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e24c1dff-8b97-49d0-935a-dbc4fd80c84b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:03.536210 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e24c1dff-8b97-49d0-935a-dbc4fd80c84b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:03.536668 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e24c1dff-8b97-49d0-935a-dbc4fd80c84b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:03.537487 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e24c1dff-8b97-49d0-935a-dbc4fd80c84b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:03.537961 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e24c1dff-8b97-49d0-935a-dbc4fd80c84b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:03.538406 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e24c1dff-8b97-49d0-935a-dbc4fd80c84b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:03.680204 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e24c1dff-8b97-49d0-935a-dbc4fd80c84b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:03.689146 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e24c1dff-8b97-49d0-935a-dbc4fd80c84b tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f" status: 200 len: 1697 microversion: 2.1 time: 0.167242 Oct 17 14:22:03.689756 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3052/6243] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:03 2022] GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f => generated 1697 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:22:04.713446 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f95d9bf3-e5e3-4549-8abd-8863f6c2fad5 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:04.714125 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f95d9bf3-e5e3-4549-8abd-8863f6c2fad5 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e19b3623-7c42-4270-94bd-d46fa920ae3f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:04.721544 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f95d9bf3-e5e3-4549-8abd-8863f6c2fad5 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:04.722036 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f95d9bf3-e5e3-4549-8abd-8863f6c2fad5 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:04.722474 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f95d9bf3-e5e3-4549-8abd-8863f6c2fad5 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:04.723211 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f95d9bf3-e5e3-4549-8abd-8863f6c2fad5 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:04.723672 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f95d9bf3-e5e3-4549-8abd-8863f6c2fad5 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:04.724092 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f95d9bf3-e5e3-4549-8abd-8863f6c2fad5 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:04.864239 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f95d9bf3-e5e3-4549-8abd-8863f6c2fad5 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:04.874386 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f95d9bf3-e5e3-4549-8abd-8863f6c2fad5 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f" status: 200 len: 1682 microversion: 2.1 time: 0.164954 Oct 17 14:22:04.874967 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3192/6244] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:04 2022] GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:22:05.258753 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-f2406845-37c0-4b84-95d5-0e3e232233a4 req-79fff8e6-5a75-44c9-beed-617111836c3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e19b3623-7c42-4270-94bd-d46fa920ae3f", "name": "network-vif-unplugged", "status": "completed", "tag": "71c16489-2d3b-479d-8a58-18c9984bcbbf"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:22:05.269939 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-f2406845-37c0-4b84-95d5-0e3e232233a4 req-79fff8e6-5a75-44c9-beed-617111836c3c service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:05.270509 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-f2406845-37c0-4b84-95d5-0e3e232233a4 req-79fff8e6-5a75-44c9-beed-617111836c3c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:05.271019 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-f2406845-37c0-4b84-95d5-0e3e232233a4 req-79fff8e6-5a75-44c9-beed-617111836c3c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:05.283766 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-f2406845-37c0-4b84-95d5-0e3e232233a4 req-79fff8e6-5a75-44c9-beed-617111836c3c service nova] Creating event network-vif-unplugged:71c16489-2d3b-479d-8a58-18c9984bcbbf for instance e19b3623-7c42-4270-94bd-d46fa920ae3f on n-h2-854247-14 Oct 17 14:22:05.290191 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-f2406845-37c0-4b84-95d5-0e3e232233a4 req-79fff8e6-5a75-44c9-beed-617111836c3c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035052 Oct 17 14:22:05.291143 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3053/6245] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:22:07.306017 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-b22a604d-6b9c-44ff-8023-03f0ba84feb3 req-babd8486-9dd2-498f-9d73-26bd8228d9f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e19b3623-7c42-4270-94bd-d46fa920ae3f", "name": "network-vif-plugged", "status": "completed", "tag": "71c16489-2d3b-479d-8a58-18c9984bcbbf"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:22:07.318392 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-b22a604d-6b9c-44ff-8023-03f0ba84feb3 req-babd8486-9dd2-498f-9d73-26bd8228d9f2 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:07.318863 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-b22a604d-6b9c-44ff-8023-03f0ba84feb3 req-babd8486-9dd2-498f-9d73-26bd8228d9f2 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:07.319322 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-b22a604d-6b9c-44ff-8023-03f0ba84feb3 req-babd8486-9dd2-498f-9d73-26bd8228d9f2 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:07.333909 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-b22a604d-6b9c-44ff-8023-03f0ba84feb3 req-babd8486-9dd2-498f-9d73-26bd8228d9f2 service nova] Creating event network-vif-plugged:71c16489-2d3b-479d-8a58-18c9984bcbbf for instance e19b3623-7c42-4270-94bd-d46fa920ae3f on n-h2-854247-14 Oct 17 14:22:07.338986 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-b22a604d-6b9c-44ff-8023-03f0ba84feb3 req-babd8486-9dd2-498f-9d73-26bd8228d9f2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037998 Oct 17 14:22:07.339663 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3193/6246] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:22:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:22:29.128967 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=3 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:22:29.129929 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=18 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:22:29.134225 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3e331bff-668b-4f80-b3ab-3b653ba5c7dd tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:22:29.136581 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3e331bff-668b-4f80-b3ab-3b653ba5c7dd tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e19b3623-7c42-4270-94bd-d46fa920ae3f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:29.144030 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3e331bff-668b-4f80-b3ab-3b653ba5c7dd tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:29.144527 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3e331bff-668b-4f80-b3ab-3b653ba5c7dd tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:29.144981 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3e331bff-668b-4f80-b3ab-3b653ba5c7dd tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:29.145693 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3e331bff-668b-4f80-b3ab-3b653ba5c7dd tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:29.146164 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3e331bff-668b-4f80-b3ab-3b653ba5c7dd tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:29.146607 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3e331bff-668b-4f80-b3ab-3b653ba5c7dd tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:29.200807 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3e331bff-668b-4f80-b3ab-3b653ba5c7dd tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "POST /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f/action" status: 200 len: 24570 microversion: 2.1 time: 0.074102 Oct 17 14:22:29.201368 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3054/6247] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:22:29 2022] POST /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f/action => generated 24570 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:22:41.137555 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=5 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:22:41.138352 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=14 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:22:41.143454 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-653980c3-1da3-4747-96d7-f8c90922759e tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:41.144057 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-653980c3-1da3-4747-96d7-f8c90922759e tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e19b3623-7c42-4270-94bd-d46fa920ae3f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:41.147493 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-239beec0-ea85-4b6a-ac1a-402a59a29830 req-9dc10f69-3b8e-4c9a-a4d2-4fac8d20dd1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e19b3623-7c42-4270-94bd-d46fa920ae3f", "tag": "71c16489-2d3b-479d-8a58-18c9984bcbbf"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:22:41.153676 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:22:41.154360 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=4 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:22:41.164020 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-653980c3-1da3-4747-96d7-f8c90922759e tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:41.164515 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-653980c3-1da3-4747-96d7-f8c90922759e tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:41.164958 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-653980c3-1da3-4747-96d7-f8c90922759e tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:41.165670 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-653980c3-1da3-4747-96d7-f8c90922759e tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:41.166128 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-653980c3-1da3-4747-96d7-f8c90922759e tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:41.166549 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-653980c3-1da3-4747-96d7-f8c90922759e tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:41.173591 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-239beec0-ea85-4b6a-ac1a-402a59a29830 req-9dc10f69-3b8e-4c9a-a4d2-4fac8d20dd1f service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:41.174091 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-239beec0-ea85-4b6a-ac1a-402a59a29830 req-9dc10f69-3b8e-4c9a-a4d2-4fac8d20dd1f service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:41.174538 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-239beec0-ea85-4b6a-ac1a-402a59a29830 req-9dc10f69-3b8e-4c9a-a4d2-4fac8d20dd1f service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:41.186612 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-239beec0-ea85-4b6a-ac1a-402a59a29830 req-9dc10f69-3b8e-4c9a-a4d2-4fac8d20dd1f service nova] Creating event network-changed:71c16489-2d3b-479d-8a58-18c9984bcbbf for instance e19b3623-7c42-4270-94bd-d46fa920ae3f on n-h2-854247-14 Oct 17 14:22:41.192103 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-239beec0-ea85-4b6a-ac1a-402a59a29830 req-9dc10f69-3b8e-4c9a-a4d2-4fac8d20dd1f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059573 Oct 17 14:22:41.192975 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3055/6248] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:22:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:22:41.194912 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-653980c3-1da3-4747-96d7-f8c90922759e tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e19b3623-7c42-4270-94bd-d46fa920ae3f] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:22:41.287370 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-653980c3-1da3-4747-96d7-f8c90922759e tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "DELETE /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f" status: 204 len: 0 microversion: 2.1 time: 0.157779 Oct 17 14:22:41.288259 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3194/6249] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:22:41 2022] DELETE /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:22:41.297745 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e60ef0ea-ba30-4093-b673-e5cf5932b1d9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:41.298476 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e60ef0ea-ba30-4093-b673-e5cf5932b1d9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e19b3623-7c42-4270-94bd-d46fa920ae3f] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:41.305876 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e60ef0ea-ba30-4093-b673-e5cf5932b1d9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:41.306379 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e60ef0ea-ba30-4093-b673-e5cf5932b1d9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:41.306826 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e60ef0ea-ba30-4093-b673-e5cf5932b1d9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:41.307674 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e60ef0ea-ba30-4093-b673-e5cf5932b1d9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:41.308198 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e60ef0ea-ba30-4093-b673-e5cf5932b1d9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:41.308638 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e60ef0ea-ba30-4093-b673-e5cf5932b1d9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:41.466846 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e60ef0ea-ba30-4093-b673-e5cf5932b1d9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:41.475633 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e60ef0ea-ba30-4093-b673-e5cf5932b1d9 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f" status: 200 len: 1688 microversion: 2.1 time: 0.182753 Oct 17 14:22:41.476252 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3056/6250] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:41 2022] GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f => generated 1688 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:22:42.500949 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-774ca23e-a77c-42db-8f42-6563d0e457d0 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:42.501690 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-774ca23e-a77c-42db-8f42-6563d0e457d0 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e19b3623-7c42-4270-94bd-d46fa920ae3f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:42.509139 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-774ca23e-a77c-42db-8f42-6563d0e457d0 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:42.509609 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-774ca23e-a77c-42db-8f42-6563d0e457d0 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:42.510771 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-774ca23e-a77c-42db-8f42-6563d0e457d0 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:42.511514 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-774ca23e-a77c-42db-8f42-6563d0e457d0 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:42.511971 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-774ca23e-a77c-42db-8f42-6563d0e457d0 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:42.512445 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-774ca23e-a77c-42db-8f42-6563d0e457d0 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:42.782411 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-774ca23e-a77c-42db-8f42-6563d0e457d0 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024275cf6f8d423992e61d92dea927ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8c8fe6f805f43798c9910296df4b8ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:42.790997 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-774ca23e-a77c-42db-8f42-6563d0e457d0 tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f" status: 200 len: 1688 microversion: 2.1 time: 0.294360 Oct 17 14:22:42.791655 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3195/6251] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:42 2022] GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f => generated 1688 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:22:43.206560 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-5f8e4102-10cd-4264-a792-e486e8bd8c92 req-6342c99a-ab9c-4822-84b2-35f0a90d06eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e19b3623-7c42-4270-94bd-d46fa920ae3f", "name": "network-vif-deleted", "tag": "71c16489-2d3b-479d-8a58-18c9984bcbbf"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:22:43.217657 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-5f8e4102-10cd-4264-a792-e486e8bd8c92 req-6342c99a-ab9c-4822-84b2-35f0a90d06eb service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:43.218205 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-5f8e4102-10cd-4264-a792-e486e8bd8c92 req-6342c99a-ab9c-4822-84b2-35f0a90d06eb service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:43.218644 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-5f8e4102-10cd-4264-a792-e486e8bd8c92 req-6342c99a-ab9c-4822-84b2-35f0a90d06eb service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:43.230479 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-5f8e4102-10cd-4264-a792-e486e8bd8c92 req-6342c99a-ab9c-4822-84b2-35f0a90d06eb service nova] Creating event network-vif-deleted:71c16489-2d3b-479d-8a58-18c9984bcbbf for instance e19b3623-7c42-4270-94bd-d46fa920ae3f on n-h2-854247-14 Oct 17 14:22:43.235450 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-5f8e4102-10cd-4264-a792-e486e8bd8c92 req-6342c99a-ab9c-4822-84b2-35f0a90d06eb service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032971 Oct 17 14:22:43.236321 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3057/6252] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:22:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:22:43.816533 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-52fdbf47-ac9b-48e4-8576-2ecfe80934ba tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:43.817222 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-52fdbf47-ac9b-48e4-8576-2ecfe80934ba tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] [instance: e19b3623-7c42-4270-94bd-d46fa920ae3f] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:43.826925 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-52fdbf47-ac9b-48e4-8576-2ecfe80934ba tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:43.827924 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-52fdbf47-ac9b-48e4-8576-2ecfe80934ba tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:43.828664 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-52fdbf47-ac9b-48e4-8576-2ecfe80934ba tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:43.829792 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-52fdbf47-ac9b-48e4-8576-2ecfe80934ba tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:43.830523 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-52fdbf47-ac9b-48e4-8576-2ecfe80934ba tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:43.831259 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-52fdbf47-ac9b-48e4-8576-2ecfe80934ba tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:43.846279 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-52fdbf47-ac9b-48e4-8576-2ecfe80934ba tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] HTTP exception thrown: Instance e19b3623-7c42-4270-94bd-d46fa920ae3f could not be found. Oct 17 14:22:43.847988 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-52fdbf47-ac9b-48e4-8576-2ecfe80934ba tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Request method failure captured: Oct 17 14:22:43.847988 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f HTTP/1.1 Oct 17 14:22:43.847988 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 14:22:43.847988 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 14:22:43.847988 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 14:22:43.847988 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 14:22:43.847988 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 14:22:43.847988 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 14:22:43.847988 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 14:22:43.847988 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 14:22:43.847988 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTWN_WrnZNIuDTcmCFjSsEmdvqNJb4iEetQ3NxsmaqSa1gwOg9ZMQNLgw9m4eq9PNIu6JcojHQuHnBeD-_gAkuh_GorIQhe3sJ55RCndYbwHTO1kgdWN1Q2vFJpwxSY5RixlKnQqd0DcKtCXSNr1JwLh4U5fWK7dcxbe5fH3jeWLj4Sg Oct 17 14:22:43.847988 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 14:22:43.847988 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 14:22:43.847988 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 14:22:43.847988 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 14:22:43.847988 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 14:22:43.847988 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 14:22:43.847988 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: b8c8fe6f805f43798c9910296df4b8ab Oct 17 14:22:43.847988 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1095470143 Oct 17 14:22:43.847988 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 14:22:43.847988 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 14:22:43.847988 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b8c8fe6f805f43798c9910296df4b8ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/b8c8fe6f805f43798c9910296df4b8ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/b8c8fe6f805f43798c9910296df4b8ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_b8c8fe6f805f43798c9910296df4b8ab", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:22:43.847988 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1095470143 Oct 17 14:22:43.847988 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: b8c8fe6f805f43798c9910296df4b8ab Oct 17 14:22:43.847988 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1095470143 Oct 17 14:22:43.847988 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-TestNetworkAdvancedServerOps-1095470143-project Oct 17 14:22:43.847988 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 14:22:43.847988 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 14:22:43.847988 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 024275cf6f8d423992e61d92dea927ba Oct 17 14:22:43.847988 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1095470143-project Oct 17 14:22:43.847988 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 14:22:43.847988 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance e19b3623-7c42-4270-94bd-d46fa920ae3f could not be found. Oct 17 14:22:43.847988 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'e19b3623-7c42-4270-94bd-d46fa920ae3f'} Oct 17 14:22:43.847988 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:22:43.847988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:22:43.847988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:22:43.847988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:22:43.847988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:22:43.847988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:22:43.847988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:22:43.847988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:22:43.847988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:22:43.847988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:22:43.847988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e19b3623-7c42-4270-94bd-d46fa920ae3f could not be found. Oct 17 14:22:43.847988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:22:43.847988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:22:43.847988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:22:43.847988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:22:43.847988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:22:43.847988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:22:43.847988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:22:43.847988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:22:43.847988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:22:43.847988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:22:43.847988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:22:43.847988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:22:43.847988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:22:43.847988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:22:43.847988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:22:43.847988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:22:43.847988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e19b3623-7c42-4270-94bd-d46fa920ae3f could not be found. Oct 17 14:22:43.847988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:22:43.847988 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:22:43.852452 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:22:43.852452 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:22:43.852452 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:22:43.852452 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:22:43.852452 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:22:43.852452 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:22:43.852452 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e19b3623-7c42-4270-94bd-d46fa920ae3f could not be found. Oct 17 14:22:43.852452 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:22:43.852452 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-52fdbf47-ac9b-48e4-8576-2ecfe80934ba tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Returning 404 to user: Instance e19b3623-7c42-4270-94bd-d46fa920ae3f could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:22:43.852452 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-52fdbf47-ac9b-48e4-8576-2ecfe80934ba tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f" status: 404 len: 111 microversion: 2.1 time: 0.037995 Oct 17 14:22:43.852452 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3196/6253] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:43 2022] GET /compute/v2.1/servers/e19b3623-7c42-4270-94bd-d46fa920ae3f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:22:47.305705 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-40b0e1c4-90f4-463a-ac1f-680b3c43b61a tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] Calling method '.version_select at 0x7f7cd54c73a0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:47.328857 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-40b0e1c4-90f4-463a-ac1f-680b3c43b61a tempest-TestNetworkAdvancedServerOps-1095470143 tempest-TestNetworkAdvancedServerOps-1095470143-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1938839478" status: 202 len: 0 microversion: 2.1 time: 0.028533 Oct 17 14:22:47.329821 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3058/6254] 10.222.0.79 () {58 vars in 1284 bytes} [Mon Oct 17 14:22:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1938839478 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:22:51.585440 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7d5cd59d-d45d-4831-95a2-6086e33a30c9 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-181355091", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "b4978304-6453-4bf9-8114-215e1157e5d9"}]}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:22:51.641630 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-7d5cd59d-d45d-4831-95a2-6086e33a30c9 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] validate_networks() for [('b4978304-6453-4bf9-8114-215e1157e5d9', None, None, None, None, None)] {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:22:52.015876 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-7d5cd59d-d45d-4831-95a2-6086e33a30c9 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:22:52.016291 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-7d5cd59d-d45d-4831-95a2-6086e33a30c9 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:22:52.016757 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-7d5cd59d-d45d-4831-95a2-6086e33a30c9 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:22:52.017161 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-7d5cd59d-d45d-4831-95a2-6086e33a30c9 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:22:52.017592 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-7d5cd59d-d45d-4831-95a2-6086e33a30c9 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:22:52.027818 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7d5cd59d-d45d-4831-95a2-6086e33a30c9 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:52.028296 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7d5cd59d-d45d-4831-95a2-6086e33a30c9 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:52.028726 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7d5cd59d-d45d-4831-95a2-6086e33a30c9 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:52.029413 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7d5cd59d-d45d-4831-95a2-6086e33a30c9 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:52.029861 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7d5cd59d-d45d-4831-95a2-6086e33a30c9 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:52.030277 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7d5cd59d-d45d-4831-95a2-6086e33a30c9 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:52.047934 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-7d5cd59d-d45d-4831-95a2-6086e33a30c9 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Getting quotas for project d2dc99ce19c94a61931fc4fb34e42835. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:22:52.053726 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-7d5cd59d-d45d-4831-95a2-6086e33a30c9 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Getting quotas for user 6eff6f8e9c664bd29933ba7c3b701580 and project d2dc99ce19c94a61931fc4fb34e42835. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:22:52.068097 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7d5cd59d-d45d-4831-95a2-6086e33a30c9 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:22:52.070541 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7d5cd59d-d45d-4831-95a2-6086e33a30c9 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] [instance: 9e603534-6758-4334-bf55-2499bb9f2f54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:22:52.124584 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7d5cd59d-d45d-4831-95a2-6086e33a30c9 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.667719 Oct 17 14:22:52.125247 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3197/6255] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 14:22:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:22:52.138076 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-baeb2405-17d1-4a3c-a0e9-1687475e7108 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:52.138844 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-baeb2405-17d1-4a3c-a0e9-1687475e7108 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] [instance: 9e603534-6758-4334-bf55-2499bb9f2f54] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:52.198046 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-baeb2405-17d1-4a3c-a0e9-1687475e7108 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eff6f8e9c664bd29933ba7c3b701580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2dc99ce19c94a61931fc4fb34e42835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:52.205570 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-baeb2405-17d1-4a3c-a0e9-1687475e7108 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] 10.222.0.79 "GET /compute/v2.1/servers/9e603534-6758-4334-bf55-2499bb9f2f54" status: 200 len: 1214 microversion: 2.1 time: 0.072456 Oct 17 14:22:52.206157 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3059/6256] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:52 2022] GET /compute/v2.1/servers/9e603534-6758-4334-bf55-2499bb9f2f54 => generated 1214 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:22:53.230938 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fc94a0b3-3f61-4512-89a0-184cad523766 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:53.231520 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-fc94a0b3-3f61-4512-89a0-184cad523766 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] [instance: 9e603534-6758-4334-bf55-2499bb9f2f54] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:53.239597 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fc94a0b3-3f61-4512-89a0-184cad523766 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:53.240046 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fc94a0b3-3f61-4512-89a0-184cad523766 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:53.240519 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fc94a0b3-3f61-4512-89a0-184cad523766 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:53.241219 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fc94a0b3-3f61-4512-89a0-184cad523766 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:53.241673 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fc94a0b3-3f61-4512-89a0-184cad523766 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:53.242101 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fc94a0b3-3f61-4512-89a0-184cad523766 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:53.305750 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fc94a0b3-3f61-4512-89a0-184cad523766 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eff6f8e9c664bd29933ba7c3b701580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2dc99ce19c94a61931fc4fb34e42835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:53.314641 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fc94a0b3-3f61-4512-89a0-184cad523766 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] 10.222.0.79 "GET /compute/v2.1/servers/9e603534-6758-4334-bf55-2499bb9f2f54" status: 200 len: 1266 microversion: 2.1 time: 0.088493 Oct 17 14:22:53.315247 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3198/6257] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:53 2022] GET /compute/v2.1/servers/9e603534-6758-4334-bf55-2499bb9f2f54 => generated 1266 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:22:54.338504 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-54699160-daa9-4bb4-9cb9-a793cfa90ccc tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:54.339099 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-54699160-daa9-4bb4-9cb9-a793cfa90ccc tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] [instance: 9e603534-6758-4334-bf55-2499bb9f2f54] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:54.342028 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=10 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:22:54.348800 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-54699160-daa9-4bb4-9cb9-a793cfa90ccc tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:54.349392 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-54699160-daa9-4bb4-9cb9-a793cfa90ccc tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:54.349844 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-54699160-daa9-4bb4-9cb9-a793cfa90ccc tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:54.350573 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-54699160-daa9-4bb4-9cb9-a793cfa90ccc tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:54.351033 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-54699160-daa9-4bb4-9cb9-a793cfa90ccc tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:54.351486 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-54699160-daa9-4bb4-9cb9-a793cfa90ccc tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:54.570796 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-54699160-daa9-4bb4-9cb9-a793cfa90ccc tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eff6f8e9c664bd29933ba7c3b701580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2dc99ce19c94a61931fc4fb34e42835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:54.579843 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-54699160-daa9-4bb4-9cb9-a793cfa90ccc tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] 10.222.0.79 "GET /compute/v2.1/servers/9e603534-6758-4334-bf55-2499bb9f2f54" status: 200 len: 1314 microversion: 2.1 time: 0.245365 Oct 17 14:22:54.580410 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3060/6258] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:54 2022] GET /compute/v2.1/servers/9e603534-6758-4334-bf55-2499bb9f2f54 => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:22:54.843797 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-c4e5786a-9b60-48b5-8c9e-2d6011a4afda req-00ea977b-235c-4a7c-9edc-37de9df75f5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e603534-6758-4334-bf55-2499bb9f2f54", "tag": "45923df0-87a3-4418-9088-b9c320a43db2"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:22:54.856106 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-c4e5786a-9b60-48b5-8c9e-2d6011a4afda req-00ea977b-235c-4a7c-9edc-37de9df75f5c service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:54.856790 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-c4e5786a-9b60-48b5-8c9e-2d6011a4afda req-00ea977b-235c-4a7c-9edc-37de9df75f5c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:54.857173 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-c4e5786a-9b60-48b5-8c9e-2d6011a4afda req-00ea977b-235c-4a7c-9edc-37de9df75f5c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:54.870378 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-c4e5786a-9b60-48b5-8c9e-2d6011a4afda req-00ea977b-235c-4a7c-9edc-37de9df75f5c service nova] Creating event network-changed:45923df0-87a3-4418-9088-b9c320a43db2 for instance 9e603534-6758-4334-bf55-2499bb9f2f54 on n-h2-854247-14 Oct 17 14:22:54.875175 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-c4e5786a-9b60-48b5-8c9e-2d6011a4afda req-00ea977b-235c-4a7c-9edc-37de9df75f5c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036032 Oct 17 14:22:54.875942 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3199/6259] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:22:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:22:55.603557 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-51a92d93-5586-4a9e-9553-fd73fcee091f tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:55.604222 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-51a92d93-5586-4a9e-9553-fd73fcee091f tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] [instance: 9e603534-6758-4334-bf55-2499bb9f2f54] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:55.611966 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-51a92d93-5586-4a9e-9553-fd73fcee091f tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:55.612427 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-51a92d93-5586-4a9e-9553-fd73fcee091f tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:55.612950 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-51a92d93-5586-4a9e-9553-fd73fcee091f tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:55.613833 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-51a92d93-5586-4a9e-9553-fd73fcee091f tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:55.614318 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-51a92d93-5586-4a9e-9553-fd73fcee091f tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:55.614748 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-51a92d93-5586-4a9e-9553-fd73fcee091f tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:55.758393 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-51a92d93-5586-4a9e-9553-fd73fcee091f tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eff6f8e9c664bd29933ba7c3b701580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2dc99ce19c94a61931fc4fb34e42835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:55.766843 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-51a92d93-5586-4a9e-9553-fd73fcee091f tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] 10.222.0.79 "GET /compute/v2.1/servers/9e603534-6758-4334-bf55-2499bb9f2f54" status: 200 len: 1314 microversion: 2.1 time: 0.167642 Oct 17 14:22:55.767467 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3061/6260] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:55 2022] GET /compute/v2.1/servers/9e603534-6758-4334-bf55-2499bb9f2f54 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:22:56.795581 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f2c4b0f9-2b85-445b-ac5e-66ea83e320f5 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:56.796671 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f2c4b0f9-2b85-445b-ac5e-66ea83e320f5 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] [instance: 9e603534-6758-4334-bf55-2499bb9f2f54] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:56.806969 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f2c4b0f9-2b85-445b-ac5e-66ea83e320f5 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:56.807735 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f2c4b0f9-2b85-445b-ac5e-66ea83e320f5 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:56.808457 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f2c4b0f9-2b85-445b-ac5e-66ea83e320f5 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:56.809576 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f2c4b0f9-2b85-445b-ac5e-66ea83e320f5 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:56.810669 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f2c4b0f9-2b85-445b-ac5e-66ea83e320f5 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:56.811379 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f2c4b0f9-2b85-445b-ac5e-66ea83e320f5 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:56.953032 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f2c4b0f9-2b85-445b-ac5e-66ea83e320f5 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eff6f8e9c664bd29933ba7c3b701580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2dc99ce19c94a61931fc4fb34e42835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:56.961106 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f2c4b0f9-2b85-445b-ac5e-66ea83e320f5 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] 10.222.0.79 "GET /compute/v2.1/servers/9e603534-6758-4334-bf55-2499bb9f2f54" status: 200 len: 1314 microversion: 2.1 time: 0.174239 Oct 17 14:22:56.961698 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3200/6261] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:56 2022] GET /compute/v2.1/servers/9e603534-6758-4334-bf55-2499bb9f2f54 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:22:57.985593 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5e1cd22e-1f92-4a48-a08d-cd6f9e74ac20 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:57.986288 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5e1cd22e-1f92-4a48-a08d-cd6f9e74ac20 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] [instance: 9e603534-6758-4334-bf55-2499bb9f2f54] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:57.994757 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5e1cd22e-1f92-4a48-a08d-cd6f9e74ac20 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:57.995275 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5e1cd22e-1f92-4a48-a08d-cd6f9e74ac20 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:57.995718 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5e1cd22e-1f92-4a48-a08d-cd6f9e74ac20 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:57.996424 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5e1cd22e-1f92-4a48-a08d-cd6f9e74ac20 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:57.996882 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5e1cd22e-1f92-4a48-a08d-cd6f9e74ac20 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:57.997315 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5e1cd22e-1f92-4a48-a08d-cd6f9e74ac20 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:58.135761 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5e1cd22e-1f92-4a48-a08d-cd6f9e74ac20 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eff6f8e9c664bd29933ba7c3b701580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2dc99ce19c94a61931fc4fb34e42835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:58.143742 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5e1cd22e-1f92-4a48-a08d-cd6f9e74ac20 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] 10.222.0.79 "GET /compute/v2.1/servers/9e603534-6758-4334-bf55-2499bb9f2f54" status: 200 len: 1314 microversion: 2.1 time: 0.162870 Oct 17 14:22:58.144340 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3062/6262] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:57 2022] GET /compute/v2.1/servers/9e603534-6758-4334-bf55-2499bb9f2f54 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:22:59.167794 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d0b4fb92-8c3b-4927-a2e1-6f4bd3d11d64 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:59.168385 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d0b4fb92-8c3b-4927-a2e1-6f4bd3d11d64 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] [instance: 9e603534-6758-4334-bf55-2499bb9f2f54] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:59.174902 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d0b4fb92-8c3b-4927-a2e1-6f4bd3d11d64 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:59.175447 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d0b4fb92-8c3b-4927-a2e1-6f4bd3d11d64 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:59.175862 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d0b4fb92-8c3b-4927-a2e1-6f4bd3d11d64 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:59.176561 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d0b4fb92-8c3b-4927-a2e1-6f4bd3d11d64 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:59.177009 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d0b4fb92-8c3b-4927-a2e1-6f4bd3d11d64 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:59.177450 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d0b4fb92-8c3b-4927-a2e1-6f4bd3d11d64 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:59.314731 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d0b4fb92-8c3b-4927-a2e1-6f4bd3d11d64 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eff6f8e9c664bd29933ba7c3b701580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2dc99ce19c94a61931fc4fb34e42835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:59.323512 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d0b4fb92-8c3b-4927-a2e1-6f4bd3d11d64 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] 10.222.0.79 "GET /compute/v2.1/servers/9e603534-6758-4334-bf55-2499bb9f2f54" status: 200 len: 1314 microversion: 2.1 time: 0.160125 Oct 17 14:22:59.324085 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3201/6263] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:59 2022] GET /compute/v2.1/servers/9e603534-6758-4334-bf55-2499bb9f2f54 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:23:00.350804 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1b0dfe74-fbe6-47f5-b591-b84b81932140 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:23:00.351802 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1b0dfe74-fbe6-47f5-b591-b84b81932140 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] [instance: 9e603534-6758-4334-bf55-2499bb9f2f54] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:23:00.362643 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1b0dfe74-fbe6-47f5-b591-b84b81932140 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:00.363531 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1b0dfe74-fbe6-47f5-b591-b84b81932140 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:00.364278 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1b0dfe74-fbe6-47f5-b591-b84b81932140 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:00.365430 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1b0dfe74-fbe6-47f5-b591-b84b81932140 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:00.366193 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1b0dfe74-fbe6-47f5-b591-b84b81932140 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:00.366998 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1b0dfe74-fbe6-47f5-b591-b84b81932140 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:00.508181 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1b0dfe74-fbe6-47f5-b591-b84b81932140 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eff6f8e9c664bd29933ba7c3b701580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2dc99ce19c94a61931fc4fb34e42835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:23:00.517043 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1b0dfe74-fbe6-47f5-b591-b84b81932140 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] 10.222.0.79 "GET /compute/v2.1/servers/9e603534-6758-4334-bf55-2499bb9f2f54" status: 200 len: 1314 microversion: 2.1 time: 0.172891 Oct 17 14:23:00.517622 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3063/6264] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:23:00 2022] GET /compute/v2.1/servers/9e603534-6758-4334-bf55-2499bb9f2f54 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:23:01.455141 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-c89ec5cb-b665-4b3f-b237-106889fd42a7 req-0aa6524c-d9b3-458d-b96d-da69f136656e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e603534-6758-4334-bf55-2499bb9f2f54", "name": "network-vif-plugged", "status": "completed", "tag": "45923df0-87a3-4418-9088-b9c320a43db2"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:23:01.465581 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-c89ec5cb-b665-4b3f-b237-106889fd42a7 req-0aa6524c-d9b3-458d-b96d-da69f136656e service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:01.466053 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-c89ec5cb-b665-4b3f-b237-106889fd42a7 req-0aa6524c-d9b3-458d-b96d-da69f136656e service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:01.466505 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-c89ec5cb-b665-4b3f-b237-106889fd42a7 req-0aa6524c-d9b3-458d-b96d-da69f136656e service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:01.478264 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-c89ec5cb-b665-4b3f-b237-106889fd42a7 req-0aa6524c-d9b3-458d-b96d-da69f136656e service nova] Creating event network-vif-plugged:45923df0-87a3-4418-9088-b9c320a43db2 for instance 9e603534-6758-4334-bf55-2499bb9f2f54 on n-h2-854247-14 Oct 17 14:23:01.483556 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-c89ec5cb-b665-4b3f-b237-106889fd42a7 req-0aa6524c-d9b3-458d-b96d-da69f136656e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032113 Oct 17 14:23:01.484443 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3202/6265] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:23:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:23:01.540180 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5da8d5b4-0a87-42c8-8dc5-319af6ebdd18 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:23:01.540829 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5da8d5b4-0a87-42c8-8dc5-319af6ebdd18 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] [instance: 9e603534-6758-4334-bf55-2499bb9f2f54] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:23:01.548279 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5da8d5b4-0a87-42c8-8dc5-319af6ebdd18 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:01.548777 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5da8d5b4-0a87-42c8-8dc5-319af6ebdd18 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:01.549223 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5da8d5b4-0a87-42c8-8dc5-319af6ebdd18 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:01.549907 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5da8d5b4-0a87-42c8-8dc5-319af6ebdd18 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:01.550368 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5da8d5b4-0a87-42c8-8dc5-319af6ebdd18 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:01.550803 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5da8d5b4-0a87-42c8-8dc5-319af6ebdd18 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:01.722548 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5da8d5b4-0a87-42c8-8dc5-319af6ebdd18 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eff6f8e9c664bd29933ba7c3b701580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2dc99ce19c94a61931fc4fb34e42835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:23:01.732209 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5da8d5b4-0a87-42c8-8dc5-319af6ebdd18 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] 10.222.0.79 "GET /compute/v2.1/servers/9e603534-6758-4334-bf55-2499bb9f2f54" status: 200 len: 1314 microversion: 2.1 time: 0.195611 Oct 17 14:23:01.732957 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3064/6266] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:23:01 2022] GET /compute/v2.1/servers/9e603534-6758-4334-bf55-2499bb9f2f54 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:23:02.757270 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:23:02.758330 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=6 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:23:02.764448 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c1d446e9-e29e-4f0c-8f1d-e4fbea54d2a6 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:23:02.765323 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c1d446e9-e29e-4f0c-8f1d-e4fbea54d2a6 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] [instance: 9e603534-6758-4334-bf55-2499bb9f2f54] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:23:02.772659 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1d446e9-e29e-4f0c-8f1d-e4fbea54d2a6 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:02.773136 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1d446e9-e29e-4f0c-8f1d-e4fbea54d2a6 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:02.773564 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1d446e9-e29e-4f0c-8f1d-e4fbea54d2a6 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:02.774244 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1d446e9-e29e-4f0c-8f1d-e4fbea54d2a6 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:02.774683 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1d446e9-e29e-4f0c-8f1d-e4fbea54d2a6 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:02.775097 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1d446e9-e29e-4f0c-8f1d-e4fbea54d2a6 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:02.916918 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c1d446e9-e29e-4f0c-8f1d-e4fbea54d2a6 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eff6f8e9c664bd29933ba7c3b701580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2dc99ce19c94a61931fc4fb34e42835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:23:02.925326 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c1d446e9-e29e-4f0c-8f1d-e4fbea54d2a6 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] 10.222.0.79 "GET /compute/v2.1/servers/9e603534-6758-4334-bf55-2499bb9f2f54" status: 200 len: 1500 microversion: 2.1 time: 0.169229 Oct 17 14:23:02.925881 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3203/6267] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:23:02 2022] GET /compute/v2.1/servers/9e603534-6758-4334-bf55-2499bb9f2f54 => generated 1500 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:23:02.947895 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-14de8a41-7cfe-414f-b238-d7d539869658 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:23:02.948670 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-14de8a41-7cfe-414f-b238-d7d539869658 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] [instance: 9e603534-6758-4334-bf55-2499bb9f2f54] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:23:02.950598 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:23:02.957291 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-14de8a41-7cfe-414f-b238-d7d539869658 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:02.957795 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-14de8a41-7cfe-414f-b238-d7d539869658 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:02.958243 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-14de8a41-7cfe-414f-b238-d7d539869658 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:02.958949 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-14de8a41-7cfe-414f-b238-d7d539869658 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:02.959439 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-14de8a41-7cfe-414f-b238-d7d539869658 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:02.959877 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-14de8a41-7cfe-414f-b238-d7d539869658 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:03.093163 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-14de8a41-7cfe-414f-b238-d7d539869658 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eff6f8e9c664bd29933ba7c3b701580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2dc99ce19c94a61931fc4fb34e42835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:23:03.101627 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-14de8a41-7cfe-414f-b238-d7d539869658 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] 10.222.0.79 "GET /compute/v2.1/servers/9e603534-6758-4334-bf55-2499bb9f2f54" status: 200 len: 1500 microversion: 2.1 time: 0.157600 Oct 17 14:23:03.102181 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3065/6268] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:23:02 2022] GET /compute/v2.1/servers/9e603534-6758-4334-bf55-2499bb9f2f54 => generated 1500 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:23:03.124774 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-830450a1-773f-4b87-bf56-b64dd6089378 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:23:03.125339 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-830450a1-773f-4b87-bf56-b64dd6089378 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] [instance: 9e603534-6758-4334-bf55-2499bb9f2f54] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:23:03.133171 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-830450a1-773f-4b87-bf56-b64dd6089378 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:03.133847 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-830450a1-773f-4b87-bf56-b64dd6089378 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:03.134448 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-830450a1-773f-4b87-bf56-b64dd6089378 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:03.135554 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-830450a1-773f-4b87-bf56-b64dd6089378 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:03.136345 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-830450a1-773f-4b87-bf56-b64dd6089378 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:03.136844 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-830450a1-773f-4b87-bf56-b64dd6089378 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:03.161133 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-830450a1-773f-4b87-bf56-b64dd6089378 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lazy-loading 'flavor' on Instance uuid 9e603534-6758-4334-bf55-2499bb9f2f54 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:23:03.236624 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-830450a1-773f-4b87-bf56-b64dd6089378 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] 10.222.0.79 "POST /compute/v2.1/servers/9e603534-6758-4334-bf55-2499bb9f2f54/action" status: 202 len: 0 microversion: 2.1 time: 0.115295 Oct 17 14:23:03.237690 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3204/6269] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:23:03 2022] POST /compute/v2.1/servers/9e603534-6758-4334-bf55-2499bb9f2f54/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:23:03.254234 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d872fafe-53b8-4189-8147-508f8c02610a tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:23:03.255464 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d872fafe-53b8-4189-8147-508f8c02610a tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] [instance: 9e603534-6758-4334-bf55-2499bb9f2f54] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:23:03.264014 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d872fafe-53b8-4189-8147-508f8c02610a tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:03.264518 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d872fafe-53b8-4189-8147-508f8c02610a tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:03.264972 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d872fafe-53b8-4189-8147-508f8c02610a tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:03.265695 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d872fafe-53b8-4189-8147-508f8c02610a tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:03.266161 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d872fafe-53b8-4189-8147-508f8c02610a tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:03.266594 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d872fafe-53b8-4189-8147-508f8c02610a tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:03.411675 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d872fafe-53b8-4189-8147-508f8c02610a tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eff6f8e9c664bd29933ba7c3b701580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2dc99ce19c94a61931fc4fb34e42835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:23:03.419862 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d872fafe-53b8-4189-8147-508f8c02610a tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] 10.222.0.79 "GET /compute/v2.1/servers/9e603534-6758-4334-bf55-2499bb9f2f54" status: 200 len: 1508 microversion: 2.1 time: 0.176220 Oct 17 14:23:03.420492 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3066/6270] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:23:03 2022] GET /compute/v2.1/servers/9e603534-6758-4334-bf55-2499bb9f2f54 => generated 1508 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:23:04.447774 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0e1d67fa-c2af-498c-854c-999ba27c42d6 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:23:04.448807 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0e1d67fa-c2af-498c-854c-999ba27c42d6 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] [instance: 9e603534-6758-4334-bf55-2499bb9f2f54] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:23:04.455955 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0e1d67fa-c2af-498c-854c-999ba27c42d6 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:04.456439 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0e1d67fa-c2af-498c-854c-999ba27c42d6 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:04.456879 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0e1d67fa-c2af-498c-854c-999ba27c42d6 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:04.457582 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0e1d67fa-c2af-498c-854c-999ba27c42d6 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:04.458037 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0e1d67fa-c2af-498c-854c-999ba27c42d6 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:04.458459 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0e1d67fa-c2af-498c-854c-999ba27c42d6 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:04.599373 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0e1d67fa-c2af-498c-854c-999ba27c42d6 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eff6f8e9c664bd29933ba7c3b701580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2dc99ce19c94a61931fc4fb34e42835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:23:04.608184 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0e1d67fa-c2af-498c-854c-999ba27c42d6 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] 10.222.0.79 "GET /compute/v2.1/servers/9e603534-6758-4334-bf55-2499bb9f2f54" status: 200 len: 1491 microversion: 2.1 time: 0.167553 Oct 17 14:23:04.608796 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3205/6271] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:23:04 2022] GET /compute/v2.1/servers/9e603534-6758-4334-bf55-2499bb9f2f54 => generated 1491 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:23:04.634216 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-aa661f61-efb4-48c3-9e89-97626bec0437 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:23:04.634931 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-aa661f61-efb4-48c3-9e89-97626bec0437 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] [instance: 9e603534-6758-4334-bf55-2499bb9f2f54] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:23:04.645366 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aa661f61-efb4-48c3-9e89-97626bec0437 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:04.646101 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aa661f61-efb4-48c3-9e89-97626bec0437 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:04.646768 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aa661f61-efb4-48c3-9e89-97626bec0437 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:04.647918 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aa661f61-efb4-48c3-9e89-97626bec0437 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:04.648645 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aa661f61-efb4-48c3-9e89-97626bec0437 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:04.649227 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aa661f61-efb4-48c3-9e89-97626bec0437 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:04.725172 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-aa661f61-efb4-48c3-9e89-97626bec0437 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] 10.222.0.79 "POST /compute/v2.1/servers/9e603534-6758-4334-bf55-2499bb9f2f54/action" status: 202 len: 0 microversion: 2.1 time: 0.097173 Oct 17 14:23:04.725880 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3067/6272] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:23:04 2022] POST /compute/v2.1/servers/9e603534-6758-4334-bf55-2499bb9f2f54/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 14:23:04.734377 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4281fb6c-7214-48b7-8316-04741452a85f tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:23:04.734996 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4281fb6c-7214-48b7-8316-04741452a85f tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] [instance: 9e603534-6758-4334-bf55-2499bb9f2f54] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:23:04.741254 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4281fb6c-7214-48b7-8316-04741452a85f tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:04.741744 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4281fb6c-7214-48b7-8316-04741452a85f tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:04.742189 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4281fb6c-7214-48b7-8316-04741452a85f tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:04.742876 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4281fb6c-7214-48b7-8316-04741452a85f tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:04.743370 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4281fb6c-7214-48b7-8316-04741452a85f tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:04.743793 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4281fb6c-7214-48b7-8316-04741452a85f tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:04.957706 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4281fb6c-7214-48b7-8316-04741452a85f tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eff6f8e9c664bd29933ba7c3b701580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2dc99ce19c94a61931fc4fb34e42835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:23:04.965998 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4281fb6c-7214-48b7-8316-04741452a85f tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] 10.222.0.79 "GET /compute/v2.1/servers/9e603534-6758-4334-bf55-2499bb9f2f54" status: 200 len: 1497 microversion: 2.1 time: 0.235682 Oct 17 14:23:04.966409 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3206/6273] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:23:04 2022] GET /compute/v2.1/servers/9e603534-6758-4334-bf55-2499bb9f2f54 => generated 1497 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:23:05.990240 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-263ec746-eaac-4ed7-b0f3-cc5dde1af118 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:23:05.991823 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-263ec746-eaac-4ed7-b0f3-cc5dde1af118 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] [instance: 9e603534-6758-4334-bf55-2499bb9f2f54] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:23:05.999988 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-263ec746-eaac-4ed7-b0f3-cc5dde1af118 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:06.000656 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-263ec746-eaac-4ed7-b0f3-cc5dde1af118 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:06.001092 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-263ec746-eaac-4ed7-b0f3-cc5dde1af118 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:06.001850 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-263ec746-eaac-4ed7-b0f3-cc5dde1af118 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:06.002318 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-263ec746-eaac-4ed7-b0f3-cc5dde1af118 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:06.002772 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-263ec746-eaac-4ed7-b0f3-cc5dde1af118 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:06.204658 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-263ec746-eaac-4ed7-b0f3-cc5dde1af118 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eff6f8e9c664bd29933ba7c3b701580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2dc99ce19c94a61931fc4fb34e42835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:23:06.213972 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-263ec746-eaac-4ed7-b0f3-cc5dde1af118 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] 10.222.0.79 "GET /compute/v2.1/servers/9e603534-6758-4334-bf55-2499bb9f2f54" status: 200 len: 1500 microversion: 2.1 time: 0.228410 Oct 17 14:23:06.214995 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3068/6274] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:23:05 2022] GET /compute/v2.1/servers/9e603534-6758-4334-bf55-2499bb9f2f54 => generated 1500 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:23:06.237493 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9c98460e-19b9-482c-a8b1-1a82186bf1a8 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:23:06.238086 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9c98460e-19b9-482c-a8b1-1a82186bf1a8 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] [instance: 9e603534-6758-4334-bf55-2499bb9f2f54] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:23:06.245977 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c98460e-19b9-482c-a8b1-1a82186bf1a8 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:06.246397 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c98460e-19b9-482c-a8b1-1a82186bf1a8 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:06.246835 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c98460e-19b9-482c-a8b1-1a82186bf1a8 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:06.247565 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c98460e-19b9-482c-a8b1-1a82186bf1a8 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:06.248024 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c98460e-19b9-482c-a8b1-1a82186bf1a8 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:06.248484 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c98460e-19b9-482c-a8b1-1a82186bf1a8 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:06.273058 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-9c98460e-19b9-482c-a8b1-1a82186bf1a8 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lazy-loading 'flavor' on Instance uuid 9e603534-6758-4334-bf55-2499bb9f2f54 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:23:06.348196 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9c98460e-19b9-482c-a8b1-1a82186bf1a8 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] 10.222.0.79 "POST /compute/v2.1/servers/9e603534-6758-4334-bf55-2499bb9f2f54/action" status: 202 len: 0 microversion: 2.1 time: 0.114339 Oct 17 14:23:06.354153 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3207/6275] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:23:06 2022] POST /compute/v2.1/servers/9e603534-6758-4334-bf55-2499bb9f2f54/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:23:06.359674 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-aa66721a-bd47-47d3-922d-efb9b128ca6d tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:23:06.361073 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-aa66721a-bd47-47d3-922d-efb9b128ca6d tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] [instance: 9e603534-6758-4334-bf55-2499bb9f2f54] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:23:06.369108 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aa66721a-bd47-47d3-922d-efb9b128ca6d tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:06.369617 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aa66721a-bd47-47d3-922d-efb9b128ca6d tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:06.370109 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aa66721a-bd47-47d3-922d-efb9b128ca6d tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:06.370944 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aa66721a-bd47-47d3-922d-efb9b128ca6d tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:06.371496 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aa66721a-bd47-47d3-922d-efb9b128ca6d tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:06.372075 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aa66721a-bd47-47d3-922d-efb9b128ca6d tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:06.537582 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-aa66721a-bd47-47d3-922d-efb9b128ca6d tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eff6f8e9c664bd29933ba7c3b701580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2dc99ce19c94a61931fc4fb34e42835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:23:06.546427 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-aa66721a-bd47-47d3-922d-efb9b128ca6d tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] 10.222.0.79 "GET /compute/v2.1/servers/9e603534-6758-4334-bf55-2499bb9f2f54" status: 200 len: 1508 microversion: 2.1 time: 0.191815 Oct 17 14:23:06.547045 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3069/6276] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:23:06 2022] GET /compute/v2.1/servers/9e603534-6758-4334-bf55-2499bb9f2f54 => generated 1508 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:23:07.571636 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4fe59468-05dc-4c35-99bd-3c99c89be09e tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:23:07.572373 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4fe59468-05dc-4c35-99bd-3c99c89be09e tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] [instance: 9e603534-6758-4334-bf55-2499bb9f2f54] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:23:07.579736 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4fe59468-05dc-4c35-99bd-3c99c89be09e tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:07.580228 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4fe59468-05dc-4c35-99bd-3c99c89be09e tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:07.580666 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4fe59468-05dc-4c35-99bd-3c99c89be09e tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:07.581367 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4fe59468-05dc-4c35-99bd-3c99c89be09e tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:07.581822 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4fe59468-05dc-4c35-99bd-3c99c89be09e tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:07.582251 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4fe59468-05dc-4c35-99bd-3c99c89be09e tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:07.586717 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:23:07.723649 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4fe59468-05dc-4c35-99bd-3c99c89be09e tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eff6f8e9c664bd29933ba7c3b701580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2dc99ce19c94a61931fc4fb34e42835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:23:07.732393 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4fe59468-05dc-4c35-99bd-3c99c89be09e tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] 10.222.0.79 "GET /compute/v2.1/servers/9e603534-6758-4334-bf55-2499bb9f2f54" status: 200 len: 1491 microversion: 2.1 time: 0.166041 Oct 17 14:23:07.732970 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3208/6277] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:23:07 2022] GET /compute/v2.1/servers/9e603534-6758-4334-bf55-2499bb9f2f54 => generated 1491 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:23:07.755400 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7e598120-752c-4961-a273-7b50c1457119 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:23:07.755992 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7e598120-752c-4961-a273-7b50c1457119 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] [instance: 9e603534-6758-4334-bf55-2499bb9f2f54] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:23:07.763343 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7e598120-752c-4961-a273-7b50c1457119 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:07.763853 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7e598120-752c-4961-a273-7b50c1457119 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:07.764334 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7e598120-752c-4961-a273-7b50c1457119 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:07.765022 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7e598120-752c-4961-a273-7b50c1457119 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:07.765493 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7e598120-752c-4961-a273-7b50c1457119 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:07.765937 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7e598120-752c-4961-a273-7b50c1457119 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:07.838323 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7e598120-752c-4961-a273-7b50c1457119 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] 10.222.0.79 "POST /compute/v2.1/servers/9e603534-6758-4334-bf55-2499bb9f2f54/action" status: 202 len: 0 microversion: 2.1 time: 0.086762 Oct 17 14:23:07.839000 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3070/6278] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:23:07 2022] POST /compute/v2.1/servers/9e603534-6758-4334-bf55-2499bb9f2f54/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:23:07.847378 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-68fc98d7-e1bf-4731-a48b-d419d7e78a23 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:23:07.850311 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-68fc98d7-e1bf-4731-a48b-d419d7e78a23 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] [instance: 9e603534-6758-4334-bf55-2499bb9f2f54] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:23:07.856927 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-68fc98d7-e1bf-4731-a48b-d419d7e78a23 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:07.857452 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-68fc98d7-e1bf-4731-a48b-d419d7e78a23 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:07.857868 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-68fc98d7-e1bf-4731-a48b-d419d7e78a23 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:07.858540 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-68fc98d7-e1bf-4731-a48b-d419d7e78a23 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:07.858995 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-68fc98d7-e1bf-4731-a48b-d419d7e78a23 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:07.859453 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-68fc98d7-e1bf-4731-a48b-d419d7e78a23 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:08.080421 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-68fc98d7-e1bf-4731-a48b-d419d7e78a23 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eff6f8e9c664bd29933ba7c3b701580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2dc99ce19c94a61931fc4fb34e42835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:23:08.088555 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-68fc98d7-e1bf-4731-a48b-d419d7e78a23 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] 10.222.0.79 "GET /compute/v2.1/servers/9e603534-6758-4334-bf55-2499bb9f2f54" status: 200 len: 1497 microversion: 2.1 time: 0.245076 Oct 17 14:23:08.089282 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3209/6279] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:23:07 2022] GET /compute/v2.1/servers/9e603534-6758-4334-bf55-2499bb9f2f54 => generated 1497 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:23:09.118429 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9ceada8a-e71d-48eb-8499-35d474e02359 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:23:09.119140 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9ceada8a-e71d-48eb-8499-35d474e02359 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] [instance: 9e603534-6758-4334-bf55-2499bb9f2f54] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:23:09.125966 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9ceada8a-e71d-48eb-8499-35d474e02359 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:09.126462 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9ceada8a-e71d-48eb-8499-35d474e02359 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:09.126904 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9ceada8a-e71d-48eb-8499-35d474e02359 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:09.127825 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9ceada8a-e71d-48eb-8499-35d474e02359 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:09.128289 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9ceada8a-e71d-48eb-8499-35d474e02359 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:09.128719 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9ceada8a-e71d-48eb-8499-35d474e02359 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:09.338235 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9ceada8a-e71d-48eb-8499-35d474e02359 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eff6f8e9c664bd29933ba7c3b701580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2dc99ce19c94a61931fc4fb34e42835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:23:09.346773 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9ceada8a-e71d-48eb-8499-35d474e02359 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] 10.222.0.79 "GET /compute/v2.1/servers/9e603534-6758-4334-bf55-2499bb9f2f54" status: 200 len: 1497 microversion: 2.1 time: 0.233540 Oct 17 14:23:09.347691 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3071/6280] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:23:09 2022] GET /compute/v2.1/servers/9e603534-6758-4334-bf55-2499bb9f2f54 => generated 1497 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:23:10.372186 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-07c1b6d1-b62c-49bc-a115-acaa0df4aa10 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:23:10.372733 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-07c1b6d1-b62c-49bc-a115-acaa0df4aa10 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] [instance: 9e603534-6758-4334-bf55-2499bb9f2f54] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:23:10.380430 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-07c1b6d1-b62c-49bc-a115-acaa0df4aa10 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:10.380931 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-07c1b6d1-b62c-49bc-a115-acaa0df4aa10 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:10.381356 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-07c1b6d1-b62c-49bc-a115-acaa0df4aa10 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:10.382059 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-07c1b6d1-b62c-49bc-a115-acaa0df4aa10 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:10.382511 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-07c1b6d1-b62c-49bc-a115-acaa0df4aa10 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:10.382939 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-07c1b6d1-b62c-49bc-a115-acaa0df4aa10 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:10.530529 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-07c1b6d1-b62c-49bc-a115-acaa0df4aa10 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eff6f8e9c664bd29933ba7c3b701580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2dc99ce19c94a61931fc4fb34e42835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:23:10.538603 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-07c1b6d1-b62c-49bc-a115-acaa0df4aa10 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] 10.222.0.79 "GET /compute/v2.1/servers/9e603534-6758-4334-bf55-2499bb9f2f54" status: 200 len: 1500 microversion: 2.1 time: 0.170828 Oct 17 14:23:10.539158 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3210/6281] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:23:10 2022] GET /compute/v2.1/servers/9e603534-6758-4334-bf55-2499bb9f2f54 => generated 1500 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:23:10.561863 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-28318517-a59d-4c8d-95d7-0928e7c01612 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:23:10.562406 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-28318517-a59d-4c8d-95d7-0928e7c01612 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] [instance: 9e603534-6758-4334-bf55-2499bb9f2f54] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:23:10.569491 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-28318517-a59d-4c8d-95d7-0928e7c01612 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:10.569991 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-28318517-a59d-4c8d-95d7-0928e7c01612 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:10.570441 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-28318517-a59d-4c8d-95d7-0928e7c01612 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:10.571145 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-28318517-a59d-4c8d-95d7-0928e7c01612 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:10.571642 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-28318517-a59d-4c8d-95d7-0928e7c01612 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:10.572078 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-28318517-a59d-4c8d-95d7-0928e7c01612 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:10.597702 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-28318517-a59d-4c8d-95d7-0928e7c01612 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] [instance: 9e603534-6758-4334-bf55-2499bb9f2f54] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:23:10.651221 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:23:10.682877 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-28318517-a59d-4c8d-95d7-0928e7c01612 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] 10.222.0.79 "DELETE /compute/v2.1/servers/9e603534-6758-4334-bf55-2499bb9f2f54" status: 204 len: 0 microversion: 2.1 time: 0.124713 Oct 17 14:23:10.684037 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3072/6282] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:23:10 2022] DELETE /compute/v2.1/servers/9e603534-6758-4334-bf55-2499bb9f2f54 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 14:23:10.696624 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6ec0cb44-5ffb-47fd-8fa8-23cffa773032 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:23:10.697476 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6ec0cb44-5ffb-47fd-8fa8-23cffa773032 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] [instance: 9e603534-6758-4334-bf55-2499bb9f2f54] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:23:10.706162 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6ec0cb44-5ffb-47fd-8fa8-23cffa773032 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:10.706863 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6ec0cb44-5ffb-47fd-8fa8-23cffa773032 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:10.707526 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6ec0cb44-5ffb-47fd-8fa8-23cffa773032 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:10.708280 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6ec0cb44-5ffb-47fd-8fa8-23cffa773032 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:10.708726 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6ec0cb44-5ffb-47fd-8fa8-23cffa773032 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:10.709318 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6ec0cb44-5ffb-47fd-8fa8-23cffa773032 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:10.855421 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6ec0cb44-5ffb-47fd-8fa8-23cffa773032 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eff6f8e9c664bd29933ba7c3b701580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2dc99ce19c94a61931fc4fb34e42835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:23:10.868015 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6ec0cb44-5ffb-47fd-8fa8-23cffa773032 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] 10.222.0.79 "GET /compute/v2.1/servers/9e603534-6758-4334-bf55-2499bb9f2f54" status: 200 len: 1506 microversion: 2.1 time: 0.177074 Oct 17 14:23:10.868855 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3211/6283] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:23:10 2022] GET /compute/v2.1/servers/9e603534-6758-4334-bf55-2499bb9f2f54 => generated 1506 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:23:11.894792 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4f1bbe4b-b1d3-4d00-ae7e-744b8ea105cb tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:23:11.895710 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4f1bbe4b-b1d3-4d00-ae7e-744b8ea105cb tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] [instance: 9e603534-6758-4334-bf55-2499bb9f2f54] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:23:11.899072 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:23:11.910844 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4f1bbe4b-b1d3-4d00-ae7e-744b8ea105cb tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:11.911497 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4f1bbe4b-b1d3-4d00-ae7e-744b8ea105cb tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:11.912060 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4f1bbe4b-b1d3-4d00-ae7e-744b8ea105cb tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:11.912932 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4f1bbe4b-b1d3-4d00-ae7e-744b8ea105cb tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:11.913505 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4f1bbe4b-b1d3-4d00-ae7e-744b8ea105cb tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:11.914043 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4f1bbe4b-b1d3-4d00-ae7e-744b8ea105cb tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:12.074765 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4f1bbe4b-b1d3-4d00-ae7e-744b8ea105cb tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eff6f8e9c664bd29933ba7c3b701580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2dc99ce19c94a61931fc4fb34e42835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:23:12.083290 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4f1bbe4b-b1d3-4d00-ae7e-744b8ea105cb tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] 10.222.0.79 "GET /compute/v2.1/servers/9e603534-6758-4334-bf55-2499bb9f2f54" status: 200 len: 1506 microversion: 2.1 time: 0.194012 Oct 17 14:23:12.083970 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3073/6284] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:23:11 2022] GET /compute/v2.1/servers/9e603534-6758-4334-bf55-2499bb9f2f54 => generated 1506 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:23:12.926239 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-6a8f660a-5ea0-47bc-be18-0bf988e8c3f7 req-d5b3b806-1d4f-4bc9-805e-a7490593d3df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e603534-6758-4334-bf55-2499bb9f2f54", "name": "network-vif-deleted", "tag": "45923df0-87a3-4418-9088-b9c320a43db2"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:23:12.935679 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:23:12.943855 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-6a8f660a-5ea0-47bc-be18-0bf988e8c3f7 req-d5b3b806-1d4f-4bc9-805e-a7490593d3df service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:12.944339 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-6a8f660a-5ea0-47bc-be18-0bf988e8c3f7 req-d5b3b806-1d4f-4bc9-805e-a7490593d3df service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:12.944770 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-6a8f660a-5ea0-47bc-be18-0bf988e8c3f7 req-d5b3b806-1d4f-4bc9-805e-a7490593d3df service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:12.960290 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-6a8f660a-5ea0-47bc-be18-0bf988e8c3f7 req-d5b3b806-1d4f-4bc9-805e-a7490593d3df service nova] Creating event network-vif-deleted:45923df0-87a3-4418-9088-b9c320a43db2 for instance 9e603534-6758-4334-bf55-2499bb9f2f54 on n-h2-854247-14 Oct 17 14:23:12.967440 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-6a8f660a-5ea0-47bc-be18-0bf988e8c3f7 req-d5b3b806-1d4f-4bc9-805e-a7490593d3df service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044581 Oct 17 14:23:12.968265 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3212/6285] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:23:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:23:13.106253 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-82a1df51-132f-4cd8-a151-812bef946b11 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:23:13.107071 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-82a1df51-132f-4cd8-a151-812bef946b11 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] [instance: 9e603534-6758-4334-bf55-2499bb9f2f54] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:23:13.114220 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82a1df51-132f-4cd8-a151-812bef946b11 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:13.114725 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82a1df51-132f-4cd8-a151-812bef946b11 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:13.115200 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82a1df51-132f-4cd8-a151-812bef946b11 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:13.115927 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82a1df51-132f-4cd8-a151-812bef946b11 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:13.116404 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82a1df51-132f-4cd8-a151-812bef946b11 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:13.116841 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82a1df51-132f-4cd8-a151-812bef946b11 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:13.149653 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82a1df51-132f-4cd8-a151-812bef946b11 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:13.150154 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82a1df51-132f-4cd8-a151-812bef946b11 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:13.150606 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82a1df51-132f-4cd8-a151-812bef946b11 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:13.151064 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-82a1df51-132f-4cd8-a151-812bef946b11 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lazy-loading 'fault' on Instance uuid 9e603534-6758-4334-bf55-2499bb9f2f54 {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:23:13.192879 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-82a1df51-132f-4cd8-a151-812bef946b11 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eff6f8e9c664bd29933ba7c3b701580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2dc99ce19c94a61931fc4fb34e42835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:23:13.201256 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-82a1df51-132f-4cd8-a151-812bef946b11 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] 10.222.0.79 "GET /compute/v2.1/servers/9e603534-6758-4334-bf55-2499bb9f2f54" status: 200 len: 1304 microversion: 2.1 time: 0.099056 Oct 17 14:23:13.201819 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3074/6286] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:23:13 2022] GET /compute/v2.1/servers/9e603534-6758-4334-bf55-2499bb9f2f54 => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:23:14.231588 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-acc3faed-aee3-42da-83a2-3f7b9d309082 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:23:14.232621 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-acc3faed-aee3-42da-83a2-3f7b9d309082 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] [instance: 9e603534-6758-4334-bf55-2499bb9f2f54] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:23:14.239456 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-acc3faed-aee3-42da-83a2-3f7b9d309082 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:14.239938 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-acc3faed-aee3-42da-83a2-3f7b9d309082 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:14.240400 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-acc3faed-aee3-42da-83a2-3f7b9d309082 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:14.241094 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-acc3faed-aee3-42da-83a2-3f7b9d309082 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:14.241545 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-acc3faed-aee3-42da-83a2-3f7b9d309082 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:14.241967 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-acc3faed-aee3-42da-83a2-3f7b9d309082 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:14.256163 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-acc3faed-aee3-42da-83a2-3f7b9d309082 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] HTTP exception thrown: Instance 9e603534-6758-4334-bf55-2499bb9f2f54 could not be found. Oct 17 14:23:14.257791 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-acc3faed-aee3-42da-83a2-3f7b9d309082 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Request method failure captured: Oct 17 14:23:14.257791 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/9e603534-6758-4334-bf55-2499bb9f2f54 HTTP/1.1 Oct 17 14:23:14.257791 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 14:23:14.257791 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 14:23:14.257791 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 14:23:14.257791 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 14:23:14.257791 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 14:23:14.257791 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 14:23:14.257791 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 14:23:14.257791 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 14:23:14.257791 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTWU6oNbN7xOLj4o9k18LogumGXA-n90JQHqYA-eTTN6wWHfQuyOY5GMZk8OJnB8RYu3gb4srYhT0fxiwiBw5B0Vwn1Mrb0OXu2Sro3JGC6zHszyOWKBznhLT4LQb7YO5aWLnll-V1CYt_zyG9wihQoNA0fKGfU0t7JD5Dh64utvK2bk Oct 17 14:23:14.257791 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 14:23:14.257791 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 14:23:14.257791 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 14:23:14.257791 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 14:23:14.257791 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 14:23:14.257791 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 14:23:14.257791 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: d2dc99ce19c94a61931fc4fb34e42835 Oct 17 14:23:14.257791 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-TestServerAdvancedOps-1148608494 Oct 17 14:23:14.257791 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 14:23:14.257791 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 14:23:14.257791 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d2dc99ce19c94a61931fc4fb34e42835"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d2dc99ce19c94a61931fc4fb34e42835"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d2dc99ce19c94a61931fc4fb34e42835"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d2dc99ce19c94a61931fc4fb34e42835", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:23:14.257791 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-TestServerAdvancedOps-1148608494 Oct 17 14:23:14.257791 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: d2dc99ce19c94a61931fc4fb34e42835 Oct 17 14:23:14.257791 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-TestServerAdvancedOps-1148608494 Oct 17 14:23:14.257791 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-TestServerAdvancedOps-1148608494-project Oct 17 14:23:14.257791 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 14:23:14.257791 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 14:23:14.257791 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 6eff6f8e9c664bd29933ba7c3b701580 Oct 17 14:23:14.257791 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-TestServerAdvancedOps-1148608494-project Oct 17 14:23:14.257791 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 14:23:14.257791 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 9e603534-6758-4334-bf55-2499bb9f2f54 could not be found. Oct 17 14:23:14.257791 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '9e603534-6758-4334-bf55-2499bb9f2f54'} Oct 17 14:23:14.257791 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:23:14.257791 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:23:14.257791 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:23:14.257791 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:23:14.257791 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:23:14.257791 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:23:14.257791 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:23:14.257791 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:23:14.257791 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:23:14.257791 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:23:14.257791 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e603534-6758-4334-bf55-2499bb9f2f54 could not be found. Oct 17 14:23:14.257791 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:23:14.257791 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:23:14.257791 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:23:14.257791 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:23:14.257791 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:23:14.257791 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:23:14.257791 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:23:14.257791 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:23:14.257791 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:23:14.257791 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:23:14.257791 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:23:14.257791 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:23:14.257791 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:23:14.257791 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:23:14.257791 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:23:14.257791 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:23:14.257791 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e603534-6758-4334-bf55-2499bb9f2f54 could not be found. Oct 17 14:23:14.257791 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:23:14.257791 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:23:14.257791 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:23:14.262326 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:23:14.262326 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:23:14.262326 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:23:14.262326 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:23:14.262326 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:23:14.262326 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e603534-6758-4334-bf55-2499bb9f2f54 could not be found. Oct 17 14:23:14.262326 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:23:14.262326 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-acc3faed-aee3-42da-83a2-3f7b9d309082 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] Returning 404 to user: Instance 9e603534-6758-4334-bf55-2499bb9f2f54 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:23:14.262326 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-acc3faed-aee3-42da-83a2-3f7b9d309082 tempest-TestServerAdvancedOps-1148608494 tempest-TestServerAdvancedOps-1148608494-project] 10.222.0.79 "GET /compute/v2.1/servers/9e603534-6758-4334-bf55-2499bb9f2f54" status: 404 len: 111 microversion: 2.1 time: 0.036679 Oct 17 14:23:14.262326 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3213/6287] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:23:14 2022] GET /compute/v2.1/servers/9e603534-6758-4334-bf55-2499bb9f2f54 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:23:48.218349 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=5 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:23:48.219091 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=14 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:23:48.487185 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1681cafd-c223-4ae8-8348-bdbba13353b3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:23:48.487723 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1681cafd-c223-4ae8-8348-bdbba13353b3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: d62cceda-a884-4e46-8825-114c6faa06b4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:23:48.494258 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1681cafd-c223-4ae8-8348-bdbba13353b3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:48.494749 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1681cafd-c223-4ae8-8348-bdbba13353b3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:48.495198 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1681cafd-c223-4ae8-8348-bdbba13353b3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:48.495925 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1681cafd-c223-4ae8-8348-bdbba13353b3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:48.496378 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1681cafd-c223-4ae8-8348-bdbba13353b3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:48.496849 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1681cafd-c223-4ae8-8348-bdbba13353b3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:48.522370 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1681cafd-c223-4ae8-8348-bdbba13353b3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: d62cceda-a884-4e46-8825-114c6faa06b4] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:23:48.609323 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1681cafd-c223-4ae8-8348-bdbba13353b3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "DELETE /compute/v2.1/servers/d62cceda-a884-4e46-8825-114c6faa06b4" status: 204 len: 0 microversion: 2.1 time: 0.399123 Oct 17 14:23:48.610091 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3075/6288] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:23:48 2022] DELETE /compute/v2.1/servers/d62cceda-a884-4e46-8825-114c6faa06b4 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:23:48.618888 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3c118460-6423-47ba-95d3-72e3079888a9 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:23:48.619608 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3c118460-6423-47ba-95d3-72e3079888a9 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: d62cceda-a884-4e46-8825-114c6faa06b4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:23:48.622021 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=3 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:23:48.622854 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=26 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:23:48.629056 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3c118460-6423-47ba-95d3-72e3079888a9 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:48.629538 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3c118460-6423-47ba-95d3-72e3079888a9 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:48.629966 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3c118460-6423-47ba-95d3-72e3079888a9 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:48.630656 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3c118460-6423-47ba-95d3-72e3079888a9 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:48.631109 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3c118460-6423-47ba-95d3-72e3079888a9 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:48.631554 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3c118460-6423-47ba-95d3-72e3079888a9 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:48.901332 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3c118460-6423-47ba-95d3-72e3079888a9 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:23:48.910235 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3c118460-6423-47ba-95d3-72e3079888a9 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/d62cceda-a884-4e46-8825-114c6faa06b4" status: 200 len: 1579 microversion: 2.1 time: 0.295664 Oct 17 14:23:48.910853 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3214/6289] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:23:48 2022] GET /compute/v2.1/servers/d62cceda-a884-4e46-8825-114c6faa06b4 => generated 1579 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:23:49.939029 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b3d7faa8-3739-40db-bc8e-75f42caf6931 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:23:49.939817 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b3d7faa8-3739-40db-bc8e-75f42caf6931 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: d62cceda-a884-4e46-8825-114c6faa06b4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:23:49.947697 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b3d7faa8-3739-40db-bc8e-75f42caf6931 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:49.948202 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b3d7faa8-3739-40db-bc8e-75f42caf6931 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:49.948659 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b3d7faa8-3739-40db-bc8e-75f42caf6931 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:49.949373 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b3d7faa8-3739-40db-bc8e-75f42caf6931 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:49.949840 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b3d7faa8-3739-40db-bc8e-75f42caf6931 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:49.950285 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b3d7faa8-3739-40db-bc8e-75f42caf6931 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:50.137043 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b3d7faa8-3739-40db-bc8e-75f42caf6931 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:23:50.145407 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b3d7faa8-3739-40db-bc8e-75f42caf6931 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/d62cceda-a884-4e46-8825-114c6faa06b4" status: 200 len: 1579 microversion: 2.1 time: 0.213512 Oct 17 14:23:50.146023 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3076/6290] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:23:49 2022] GET /compute/v2.1/servers/d62cceda-a884-4e46-8825-114c6faa06b4 => generated 1579 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:23:51.046178 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-e38d07e4-b70a-4a0a-af44-6487eef06207 req-45b7e0e5-24b7-4253-a42d-870e9d2146a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d62cceda-a884-4e46-8825-114c6faa06b4", "name": "network-vif-deleted", "tag": "213112b6-9fda-4eb4-a371-cbc5771bfd12"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:23:51.058755 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-e38d07e4-b70a-4a0a-af44-6487eef06207 req-45b7e0e5-24b7-4253-a42d-870e9d2146a4 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:51.059332 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-e38d07e4-b70a-4a0a-af44-6487eef06207 req-45b7e0e5-24b7-4253-a42d-870e9d2146a4 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:51.059755 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-e38d07e4-b70a-4a0a-af44-6487eef06207 req-45b7e0e5-24b7-4253-a42d-870e9d2146a4 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:51.072538 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-e38d07e4-b70a-4a0a-af44-6487eef06207 req-45b7e0e5-24b7-4253-a42d-870e9d2146a4 service nova] Creating event network-vif-deleted:213112b6-9fda-4eb4-a371-cbc5771bfd12 for instance d62cceda-a884-4e46-8825-114c6faa06b4 on n-h1-854247-14 Oct 17 14:23:51.078618 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-e38d07e4-b70a-4a0a-af44-6487eef06207 req-45b7e0e5-24b7-4253-a42d-870e9d2146a4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036123 Oct 17 14:23:51.079315 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3215/6291] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:23:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:23:51.170711 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-41890c07-230a-4b53-8f23-80bf43f624fd tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:23:51.171433 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-41890c07-230a-4b53-8f23-80bf43f624fd tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: d62cceda-a884-4e46-8825-114c6faa06b4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:23:51.191029 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-41890c07-230a-4b53-8f23-80bf43f624fd tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:51.191584 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-41890c07-230a-4b53-8f23-80bf43f624fd tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:51.192042 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-41890c07-230a-4b53-8f23-80bf43f624fd tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:51.192774 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-41890c07-230a-4b53-8f23-80bf43f624fd tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:51.193246 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-41890c07-230a-4b53-8f23-80bf43f624fd tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:51.193688 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-41890c07-230a-4b53-8f23-80bf43f624fd tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:51.267067 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-41890c07-230a-4b53-8f23-80bf43f624fd tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:23:51.275942 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-41890c07-230a-4b53-8f23-80bf43f624fd tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/d62cceda-a884-4e46-8825-114c6faa06b4" status: 200 len: 1226 microversion: 2.1 time: 0.110954 Oct 17 14:23:51.276547 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3077/6292] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:23:51 2022] GET /compute/v2.1/servers/d62cceda-a884-4e46-8825-114c6faa06b4 => generated 1226 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:23:52.301663 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-afea7635-282f-451f-bac0-94ef4314d212 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:23:52.302368 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-afea7635-282f-451f-bac0-94ef4314d212 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: d62cceda-a884-4e46-8825-114c6faa06b4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:23:52.309121 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-afea7635-282f-451f-bac0-94ef4314d212 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:52.309605 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-afea7635-282f-451f-bac0-94ef4314d212 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:52.310034 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-afea7635-282f-451f-bac0-94ef4314d212 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:52.311071 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-afea7635-282f-451f-bac0-94ef4314d212 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:52.311541 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-afea7635-282f-451f-bac0-94ef4314d212 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:52.311961 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-afea7635-282f-451f-bac0-94ef4314d212 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:52.380828 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-afea7635-282f-451f-bac0-94ef4314d212 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:23:52.389020 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-afea7635-282f-451f-bac0-94ef4314d212 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/d62cceda-a884-4e46-8825-114c6faa06b4" status: 200 len: 1226 microversion: 2.1 time: 0.092890 Oct 17 14:23:52.389594 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3216/6293] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:23:52 2022] GET /compute/v2.1/servers/d62cceda-a884-4e46-8825-114c6faa06b4 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:23:53.412920 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d6614be5-42cf-4d6a-863b-20f4eb750a7d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:23:53.413470 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d6614be5-42cf-4d6a-863b-20f4eb750a7d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: d62cceda-a884-4e46-8825-114c6faa06b4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:23:53.421378 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d6614be5-42cf-4d6a-863b-20f4eb750a7d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:53.421887 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d6614be5-42cf-4d6a-863b-20f4eb750a7d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:53.422377 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d6614be5-42cf-4d6a-863b-20f4eb750a7d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:53.423098 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d6614be5-42cf-4d6a-863b-20f4eb750a7d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:53.423612 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d6614be5-42cf-4d6a-863b-20f4eb750a7d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:53.424056 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d6614be5-42cf-4d6a-863b-20f4eb750a7d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:53.488643 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d6614be5-42cf-4d6a-863b-20f4eb750a7d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:23:53.497171 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d6614be5-42cf-4d6a-863b-20f4eb750a7d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/d62cceda-a884-4e46-8825-114c6faa06b4" status: 200 len: 1226 microversion: 2.1 time: 0.088322 Oct 17 14:23:53.498000 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3078/6294] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:23:53 2022] GET /compute/v2.1/servers/d62cceda-a884-4e46-8825-114c6faa06b4 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:23:54.520809 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f78e7173-727a-40e0-a756-91d1e481be8a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:23:54.521398 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f78e7173-727a-40e0-a756-91d1e481be8a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: d62cceda-a884-4e46-8825-114c6faa06b4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:23:54.528629 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f78e7173-727a-40e0-a756-91d1e481be8a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:54.529121 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f78e7173-727a-40e0-a756-91d1e481be8a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:54.529551 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f78e7173-727a-40e0-a756-91d1e481be8a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:54.530253 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f78e7173-727a-40e0-a756-91d1e481be8a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:54.530769 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f78e7173-727a-40e0-a756-91d1e481be8a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:54.531201 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f78e7173-727a-40e0-a756-91d1e481be8a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:54.594766 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f78e7173-727a-40e0-a756-91d1e481be8a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:23:54.603195 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f78e7173-727a-40e0-a756-91d1e481be8a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/d62cceda-a884-4e46-8825-114c6faa06b4" status: 200 len: 1226 microversion: 2.1 time: 0.086462 Oct 17 14:23:54.603797 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3217/6295] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:23:54 2022] GET /compute/v2.1/servers/d62cceda-a884-4e46-8825-114c6faa06b4 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:23:55.631411 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-77d26370-dea9-4a25-b2d7-83053cdbf30a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:23:55.632558 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-77d26370-dea9-4a25-b2d7-83053cdbf30a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: d62cceda-a884-4e46-8825-114c6faa06b4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:23:55.643303 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-77d26370-dea9-4a25-b2d7-83053cdbf30a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:55.643950 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-77d26370-dea9-4a25-b2d7-83053cdbf30a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:55.644413 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-77d26370-dea9-4a25-b2d7-83053cdbf30a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:55.645914 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-77d26370-dea9-4a25-b2d7-83053cdbf30a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:55.646534 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-77d26370-dea9-4a25-b2d7-83053cdbf30a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:55.647053 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-77d26370-dea9-4a25-b2d7-83053cdbf30a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:55.689662 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-77d26370-dea9-4a25-b2d7-83053cdbf30a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:55.690309 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-77d26370-dea9-4a25-b2d7-83053cdbf30a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:55.690904 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-77d26370-dea9-4a25-b2d7-83053cdbf30a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:55.691600 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-77d26370-dea9-4a25-b2d7-83053cdbf30a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lazy-loading 'fault' on Instance uuid d62cceda-a884-4e46-8825-114c6faa06b4 {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:23:55.747351 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-77d26370-dea9-4a25-b2d7-83053cdbf30a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:23:55.755601 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-77d26370-dea9-4a25-b2d7-83053cdbf30a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/d62cceda-a884-4e46-8825-114c6faa06b4" status: 200 len: 1185 microversion: 2.1 time: 0.131266 Oct 17 14:23:55.756360 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3079/6296] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:23:55 2022] GET /compute/v2.1/servers/d62cceda-a884-4e46-8825-114c6faa06b4 => generated 1185 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:23:56.781456 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f30252b7-3396-4a3e-8f9f-00c66d2cd721 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:23:56.782298 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f30252b7-3396-4a3e-8f9f-00c66d2cd721 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: d62cceda-a884-4e46-8825-114c6faa06b4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:23:56.790022 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f30252b7-3396-4a3e-8f9f-00c66d2cd721 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:56.790510 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f30252b7-3396-4a3e-8f9f-00c66d2cd721 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:56.790948 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f30252b7-3396-4a3e-8f9f-00c66d2cd721 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:56.791687 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f30252b7-3396-4a3e-8f9f-00c66d2cd721 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:56.792147 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f30252b7-3396-4a3e-8f9f-00c66d2cd721 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:56.792568 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f30252b7-3396-4a3e-8f9f-00c66d2cd721 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:56.806857 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-f30252b7-3396-4a3e-8f9f-00c66d2cd721 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] HTTP exception thrown: Instance d62cceda-a884-4e46-8825-114c6faa06b4 could not be found. Oct 17 14:23:56.808573 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f30252b7-3396-4a3e-8f9f-00c66d2cd721 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Request method failure captured: Oct 17 14:23:56.808573 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/d62cceda-a884-4e46-8825-114c6faa06b4 HTTP/1.1 Oct 17 14:23:56.808573 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 14:23:56.808573 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 14:23:56.808573 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 14:23:56.808573 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 14:23:56.808573 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 14:23:56.808573 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 14:23:56.808573 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 14:23:56.808573 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 14:23:56.808573 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTWPt4q6KhJtaXfApyhSZ1uS2Yi83dufn15X2GOm5u94F5E_Yj644GYsWZT8YBgl1aUBmYfKlHMjXq-eb8c2HF1REfW755J7WOOs8k3QRgUHhfiijXEH0YeKQjwZvCrEKlD9sd8dyp1v8diPQXXtSf-PHzqWEcTzJgPsJ95on9ZJE1Jo Oct 17 14:23:56.808573 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 14:23:56.808573 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 14:23:56.808573 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 14:23:56.808573 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 14:23:56.808573 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 14:23:56.808573 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 14:23:56.808573 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 4ee70940341741cb8e31928b856de051 Oct 17 14:23:56.808573 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-TestVolumeBootPattern-2135999385 Oct 17 14:23:56.808573 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 14:23:56.808573 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 14:23:56.808573 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4ee70940341741cb8e31928b856de051"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4ee70940341741cb8e31928b856de051"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4ee70940341741cb8e31928b856de051"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4ee70940341741cb8e31928b856de051", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:23:56.808573 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-TestVolumeBootPattern-2135999385 Oct 17 14:23:56.808573 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 4ee70940341741cb8e31928b856de051 Oct 17 14:23:56.808573 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-TestVolumeBootPattern-2135999385 Oct 17 14:23:56.808573 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-TestVolumeBootPattern-2135999385-project Oct 17 14:23:56.808573 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 14:23:56.808573 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 14:23:56.808573 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 06a0e2dab7494a4682615a6269ac24f9 Oct 17 14:23:56.808573 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-TestVolumeBootPattern-2135999385-project Oct 17 14:23:56.808573 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 14:23:56.808573 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance d62cceda-a884-4e46-8825-114c6faa06b4 could not be found. Oct 17 14:23:56.808573 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'd62cceda-a884-4e46-8825-114c6faa06b4'} Oct 17 14:23:56.808573 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:23:56.808573 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:23:56.808573 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:23:56.808573 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:23:56.808573 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:23:56.808573 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:23:56.808573 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:23:56.808573 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:23:56.808573 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:23:56.808573 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:23:56.808573 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d62cceda-a884-4e46-8825-114c6faa06b4 could not be found. Oct 17 14:23:56.808573 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:23:56.808573 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:23:56.808573 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:23:56.808573 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:23:56.808573 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:23:56.808573 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:23:56.808573 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:23:56.808573 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:23:56.808573 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:23:56.808573 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:23:56.808573 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:23:56.808573 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:23:56.808573 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:23:56.808573 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:23:56.808573 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:23:56.808573 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:23:56.808573 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d62cceda-a884-4e46-8825-114c6faa06b4 could not be found. Oct 17 14:23:56.808573 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:23:56.808573 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:23:56.808573 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:23:56.813216 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:23:56.813216 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:23:56.813216 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:23:56.813216 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:23:56.813216 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:23:56.813216 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d62cceda-a884-4e46-8825-114c6faa06b4 could not be found. Oct 17 14:23:56.813216 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:23:56.813216 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f30252b7-3396-4a3e-8f9f-00c66d2cd721 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Returning 404 to user: Instance d62cceda-a884-4e46-8825-114c6faa06b4 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:23:56.813216 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f30252b7-3396-4a3e-8f9f-00c66d2cd721 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/d62cceda-a884-4e46-8825-114c6faa06b4" status: 404 len: 111 microversion: 2.1 time: 0.032585 Oct 17 14:23:56.813216 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3218/6297] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:23:56 2022] GET /compute/v2.1/servers/d62cceda-a884-4e46-8825-114c6faa06b4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:23:56.869802 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c9fff48f-9b37-45f3-bbc6-64847431c55d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-45465064", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1121990495", "security_groups": [{"name": "tempest-secgroup-smoke-1984704390"}], "block_device_mapping_v2": [{"uuid": "9f6a98bb-ef15-4da2-81df-df99b65b424b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "60d947eb-1d2b-4fd8-9101-f9fb7c7e0088"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:23:56.996954 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-c9fff48f-9b37-45f3-bbc6-64847431c55d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] validate_networks() for [('60d947eb-1d2b-4fd8-9101-f9fb7c7e0088', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:23:57.464009 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-c9fff48f-9b37-45f3-bbc6-64847431c55d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:23:57.464473 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-c9fff48f-9b37-45f3-bbc6-64847431c55d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:23:57.464958 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-c9fff48f-9b37-45f3-bbc6-64847431c55d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:23:57.465377 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-c9fff48f-9b37-45f3-bbc6-64847431c55d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:23:57.465795 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-c9fff48f-9b37-45f3-bbc6-64847431c55d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:23:57.475065 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c9fff48f-9b37-45f3-bbc6-64847431c55d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:57.475583 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c9fff48f-9b37-45f3-bbc6-64847431c55d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:57.476024 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c9fff48f-9b37-45f3-bbc6-64847431c55d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:57.476761 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c9fff48f-9b37-45f3-bbc6-64847431c55d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:57.477262 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c9fff48f-9b37-45f3-bbc6-64847431c55d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:57.477689 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c9fff48f-9b37-45f3-bbc6-64847431c55d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:57.494782 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-c9fff48f-9b37-45f3-bbc6-64847431c55d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Getting quotas for project 4ee70940341741cb8e31928b856de051. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:23:57.500728 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-c9fff48f-9b37-45f3-bbc6-64847431c55d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Getting quotas for user 06a0e2dab7494a4682615a6269ac24f9 and project 4ee70940341741cb8e31928b856de051. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:23:57.559443 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c9fff48f-9b37-45f3-bbc6-64847431c55d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:23:57.561947 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c9fff48f-9b37-45f3-bbc6-64847431c55d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 9d286341-3ca8-4d40-a52b-56436b17233d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9f6a98bb-ef15-4da2-81df-df99b65b424b',volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:23:57.701005 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c9fff48f-9b37-45f3-bbc6-64847431c55d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.837543 Oct 17 14:23:57.701694 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3080/6298] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 14:23:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 839 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:23:57.713573 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4b7ff4bf-66d9-4013-8330-1789f2af2882 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:23:57.714191 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4b7ff4bf-66d9-4013-8330-1789f2af2882 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 9d286341-3ca8-4d40-a52b-56436b17233d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:23:57.770009 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4b7ff4bf-66d9-4013-8330-1789f2af2882 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:23:57.777343 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4b7ff4bf-66d9-4013-8330-1789f2af2882 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/9d286341-3ca8-4d40-a52b-56436b17233d" status: 200 len: 1093 microversion: 2.1 time: 0.067886 Oct 17 14:23:57.777922 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3219/6299] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:23:57 2022] GET /compute/v2.1/servers/9d286341-3ca8-4d40-a52b-56436b17233d => generated 1093 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:23:58.801231 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0b672620-725b-447f-9482-89b0a24fad75 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:23:58.801719 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0b672620-725b-447f-9482-89b0a24fad75 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 9d286341-3ca8-4d40-a52b-56436b17233d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:23:58.808596 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0b672620-725b-447f-9482-89b0a24fad75 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:58.809110 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0b672620-725b-447f-9482-89b0a24fad75 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:58.809564 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0b672620-725b-447f-9482-89b0a24fad75 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:58.810282 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0b672620-725b-447f-9482-89b0a24fad75 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:58.811099 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0b672620-725b-447f-9482-89b0a24fad75 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:58.811570 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0b672620-725b-447f-9482-89b0a24fad75 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:58.875816 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0b672620-725b-447f-9482-89b0a24fad75 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:23:58.886858 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0b672620-725b-447f-9482-89b0a24fad75 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/9d286341-3ca8-4d40-a52b-56436b17233d" status: 200 len: 1191 microversion: 2.1 time: 0.090418 Oct 17 14:23:58.887673 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3081/6300] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:23:58 2022] GET /compute/v2.1/servers/9d286341-3ca8-4d40-a52b-56436b17233d => generated 1191 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:23:59.910888 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-532a4130-f537-4ae8-a88a-6df6a83ffcc3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:23:59.913312 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-532a4130-f537-4ae8-a88a-6df6a83ffcc3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 9d286341-3ca8-4d40-a52b-56436b17233d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:23:59.921718 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-532a4130-f537-4ae8-a88a-6df6a83ffcc3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:59.922206 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-532a4130-f537-4ae8-a88a-6df6a83ffcc3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:59.923187 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-532a4130-f537-4ae8-a88a-6df6a83ffcc3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:59.923915 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-532a4130-f537-4ae8-a88a-6df6a83ffcc3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:59.924527 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-532a4130-f537-4ae8-a88a-6df6a83ffcc3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:59.924797 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-532a4130-f537-4ae8-a88a-6df6a83ffcc3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:00.180344 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-532a4130-f537-4ae8-a88a-6df6a83ffcc3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:24:00.189854 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-532a4130-f537-4ae8-a88a-6df6a83ffcc3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/9d286341-3ca8-4d40-a52b-56436b17233d" status: 200 len: 1277 microversion: 2.1 time: 0.283367 Oct 17 14:24:00.190423 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3220/6301] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:23:59 2022] GET /compute/v2.1/servers/9d286341-3ca8-4d40-a52b-56436b17233d => generated 1277 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:24:00.608064 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-36aa21b9-2434-4d4c-a4f5-a95c913bca63 req-6a12e283-9f20-4f96-9027-aada2f009f08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d286341-3ca8-4d40-a52b-56436b17233d", "tag": "8d8f83b4-d9b9-48b0-af24-7d219cd5cfe8"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:24:00.621136 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-36aa21b9-2434-4d4c-a4f5-a95c913bca63 req-6a12e283-9f20-4f96-9027-aada2f009f08 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:00.621919 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-36aa21b9-2434-4d4c-a4f5-a95c913bca63 req-6a12e283-9f20-4f96-9027-aada2f009f08 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:00.622539 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-36aa21b9-2434-4d4c-a4f5-a95c913bca63 req-6a12e283-9f20-4f96-9027-aada2f009f08 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:00.636138 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-36aa21b9-2434-4d4c-a4f5-a95c913bca63 req-6a12e283-9f20-4f96-9027-aada2f009f08 service nova] Creating event network-changed:8d8f83b4-d9b9-48b0-af24-7d219cd5cfe8 for instance 9d286341-3ca8-4d40-a52b-56436b17233d on n-h2-854247-14 Oct 17 14:24:00.642165 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-36aa21b9-2434-4d4c-a4f5-a95c913bca63 req-6a12e283-9f20-4f96-9027-aada2f009f08 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038780 Oct 17 14:24:00.643266 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3082/6302] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:24:01.213201 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a5ec9146-2d39-429b-a514-8fbab46415d7 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:24:01.213739 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a5ec9146-2d39-429b-a514-8fbab46415d7 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 9d286341-3ca8-4d40-a52b-56436b17233d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:24:01.221636 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a5ec9146-2d39-429b-a514-8fbab46415d7 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:01.222154 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a5ec9146-2d39-429b-a514-8fbab46415d7 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:01.222585 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a5ec9146-2d39-429b-a514-8fbab46415d7 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:01.223328 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a5ec9146-2d39-429b-a514-8fbab46415d7 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:01.223780 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a5ec9146-2d39-429b-a514-8fbab46415d7 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:01.224181 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a5ec9146-2d39-429b-a514-8fbab46415d7 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:01.473773 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a5ec9146-2d39-429b-a514-8fbab46415d7 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:24:01.482717 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a5ec9146-2d39-429b-a514-8fbab46415d7 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/9d286341-3ca8-4d40-a52b-56436b17233d" status: 200 len: 1277 microversion: 2.1 time: 0.273495 Oct 17 14:24:01.483389 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3221/6303] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:24:01 2022] GET /compute/v2.1/servers/9d286341-3ca8-4d40-a52b-56436b17233d => generated 1277 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:24:02.508620 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-35c87589-7893-419f-a292-eb568e252247 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:24:02.509340 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-35c87589-7893-419f-a292-eb568e252247 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 9d286341-3ca8-4d40-a52b-56436b17233d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:24:02.516349 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-35c87589-7893-419f-a292-eb568e252247 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:02.516901 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-35c87589-7893-419f-a292-eb568e252247 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:02.517659 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-35c87589-7893-419f-a292-eb568e252247 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:02.518391 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-35c87589-7893-419f-a292-eb568e252247 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:02.518867 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-35c87589-7893-419f-a292-eb568e252247 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:02.519319 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-35c87589-7893-419f-a292-eb568e252247 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:02.655279 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-35c87589-7893-419f-a292-eb568e252247 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:24:02.663901 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-35c87589-7893-419f-a292-eb568e252247 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/9d286341-3ca8-4d40-a52b-56436b17233d" status: 200 len: 1277 microversion: 2.1 time: 0.160598 Oct 17 14:24:02.664480 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3083/6304] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:24:02 2022] GET /compute/v2.1/servers/9d286341-3ca8-4d40-a52b-56436b17233d => generated 1277 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:24:03.687346 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-610ad279-d761-4c73-af96-c446abe7196f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:24:03.687943 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-610ad279-d761-4c73-af96-c446abe7196f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 9d286341-3ca8-4d40-a52b-56436b17233d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:24:03.695510 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-610ad279-d761-4c73-af96-c446abe7196f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:03.695990 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-610ad279-d761-4c73-af96-c446abe7196f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:03.696404 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-610ad279-d761-4c73-af96-c446abe7196f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:03.697438 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-610ad279-d761-4c73-af96-c446abe7196f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:03.697565 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-610ad279-d761-4c73-af96-c446abe7196f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:03.698001 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-610ad279-d761-4c73-af96-c446abe7196f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:03.842195 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-610ad279-d761-4c73-af96-c446abe7196f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:24:03.850676 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-610ad279-d761-4c73-af96-c446abe7196f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/9d286341-3ca8-4d40-a52b-56436b17233d" status: 200 len: 1277 microversion: 2.1 time: 0.167638 Oct 17 14:24:03.851313 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3222/6305] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:24:03 2022] GET /compute/v2.1/servers/9d286341-3ca8-4d40-a52b-56436b17233d => generated 1277 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:24:04.874845 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2928468e-3b78-4a91-ad48-88144289c22b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:24:04.875516 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2928468e-3b78-4a91-ad48-88144289c22b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 9d286341-3ca8-4d40-a52b-56436b17233d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:24:04.883038 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2928468e-3b78-4a91-ad48-88144289c22b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:04.883567 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2928468e-3b78-4a91-ad48-88144289c22b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:04.884023 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2928468e-3b78-4a91-ad48-88144289c22b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:04.884734 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2928468e-3b78-4a91-ad48-88144289c22b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:04.885204 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2928468e-3b78-4a91-ad48-88144289c22b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:04.885638 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2928468e-3b78-4a91-ad48-88144289c22b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:05.027586 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2928468e-3b78-4a91-ad48-88144289c22b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:24:05.039213 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2928468e-3b78-4a91-ad48-88144289c22b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/9d286341-3ca8-4d40-a52b-56436b17233d" status: 200 len: 1265 microversion: 2.1 time: 0.168132 Oct 17 14:24:05.040019 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3084/6306] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:24:04 2022] GET /compute/v2.1/servers/9d286341-3ca8-4d40-a52b-56436b17233d => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:24:06.063293 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9da591ee-f28b-4772-bd71-36c9afc14376 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:24:06.063914 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9da591ee-f28b-4772-bd71-36c9afc14376 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 9d286341-3ca8-4d40-a52b-56436b17233d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:24:06.071393 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9da591ee-f28b-4772-bd71-36c9afc14376 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:06.071883 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9da591ee-f28b-4772-bd71-36c9afc14376 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:06.072319 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9da591ee-f28b-4772-bd71-36c9afc14376 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:06.073020 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9da591ee-f28b-4772-bd71-36c9afc14376 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:06.073472 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9da591ee-f28b-4772-bd71-36c9afc14376 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:06.073883 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9da591ee-f28b-4772-bd71-36c9afc14376 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:06.217994 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9da591ee-f28b-4772-bd71-36c9afc14376 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:24:06.226567 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9da591ee-f28b-4772-bd71-36c9afc14376 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/9d286341-3ca8-4d40-a52b-56436b17233d" status: 200 len: 1265 microversion: 2.1 time: 0.167613 Oct 17 14:24:06.227161 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3223/6307] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:24:06 2022] GET /compute/v2.1/servers/9d286341-3ca8-4d40-a52b-56436b17233d => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:24:07.249694 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-66db7784-b07c-4a0e-a8b3-68823353e593 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:24:07.250370 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-66db7784-b07c-4a0e-a8b3-68823353e593 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 9d286341-3ca8-4d40-a52b-56436b17233d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:24:07.258406 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-66db7784-b07c-4a0e-a8b3-68823353e593 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:07.258902 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-66db7784-b07c-4a0e-a8b3-68823353e593 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:07.259384 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-66db7784-b07c-4a0e-a8b3-68823353e593 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:07.260093 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-66db7784-b07c-4a0e-a8b3-68823353e593 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:07.260560 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-66db7784-b07c-4a0e-a8b3-68823353e593 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:07.260999 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-66db7784-b07c-4a0e-a8b3-68823353e593 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:07.410457 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-66db7784-b07c-4a0e-a8b3-68823353e593 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:24:07.422643 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-66db7784-b07c-4a0e-a8b3-68823353e593 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/9d286341-3ca8-4d40-a52b-56436b17233d" status: 200 len: 1265 microversion: 2.1 time: 0.176595 Oct 17 14:24:07.423551 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3085/6308] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:24:07 2022] GET /compute/v2.1/servers/9d286341-3ca8-4d40-a52b-56436b17233d => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:24:08.448216 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b96393e9-a58c-4dff-87e2-a51e0bf8f8dd tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:24:08.448799 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b96393e9-a58c-4dff-87e2-a51e0bf8f8dd tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 9d286341-3ca8-4d40-a52b-56436b17233d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:24:08.451656 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:24:08.457584 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b96393e9-a58c-4dff-87e2-a51e0bf8f8dd tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:08.458101 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b96393e9-a58c-4dff-87e2-a51e0bf8f8dd tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:08.458545 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b96393e9-a58c-4dff-87e2-a51e0bf8f8dd tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:08.459274 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b96393e9-a58c-4dff-87e2-a51e0bf8f8dd tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:08.459710 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b96393e9-a58c-4dff-87e2-a51e0bf8f8dd tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:08.460133 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b96393e9-a58c-4dff-87e2-a51e0bf8f8dd tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:08.611151 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b96393e9-a58c-4dff-87e2-a51e0bf8f8dd tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:24:08.619500 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b96393e9-a58c-4dff-87e2-a51e0bf8f8dd tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/9d286341-3ca8-4d40-a52b-56436b17233d" status: 200 len: 1265 microversion: 2.1 time: 0.175757 Oct 17 14:24:08.620057 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3224/6309] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:24:08 2022] GET /compute/v2.1/servers/9d286341-3ca8-4d40-a52b-56436b17233d => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:24:09.654855 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-760cc708-9227-47fa-b974-0f4a059e1b24 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:24:09.655888 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-760cc708-9227-47fa-b974-0f4a059e1b24 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 9d286341-3ca8-4d40-a52b-56436b17233d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:24:09.659013 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:24:09.660267 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=6 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:24:09.672463 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-760cc708-9227-47fa-b974-0f4a059e1b24 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:09.673264 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-760cc708-9227-47fa-b974-0f4a059e1b24 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:09.674010 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-760cc708-9227-47fa-b974-0f4a059e1b24 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:09.675158 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-760cc708-9227-47fa-b974-0f4a059e1b24 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:09.676031 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-760cc708-9227-47fa-b974-0f4a059e1b24 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:09.676468 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-760cc708-9227-47fa-b974-0f4a059e1b24 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:09.836383 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-760cc708-9227-47fa-b974-0f4a059e1b24 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:24:09.849306 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-760cc708-9227-47fa-b974-0f4a059e1b24 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/9d286341-3ca8-4d40-a52b-56436b17233d" status: 200 len: 1265 microversion: 2.1 time: 0.201100 Oct 17 14:24:09.849886 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3086/6310] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:24:09 2022] GET /compute/v2.1/servers/9d286341-3ca8-4d40-a52b-56436b17233d => generated 1265 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:24:10.871783 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8eb5a577-d939-4fb9-bd1d-ad958bf9f16d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:24:10.872446 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8eb5a577-d939-4fb9-bd1d-ad958bf9f16d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 9d286341-3ca8-4d40-a52b-56436b17233d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:24:10.879863 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8eb5a577-d939-4fb9-bd1d-ad958bf9f16d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:10.880353 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8eb5a577-d939-4fb9-bd1d-ad958bf9f16d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:10.880798 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8eb5a577-d939-4fb9-bd1d-ad958bf9f16d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:10.881489 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8eb5a577-d939-4fb9-bd1d-ad958bf9f16d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:10.881945 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8eb5a577-d939-4fb9-bd1d-ad958bf9f16d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:10.882369 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8eb5a577-d939-4fb9-bd1d-ad958bf9f16d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:11.025279 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8eb5a577-d939-4fb9-bd1d-ad958bf9f16d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:24:11.036923 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8eb5a577-d939-4fb9-bd1d-ad958bf9f16d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/9d286341-3ca8-4d40-a52b-56436b17233d" status: 200 len: 1265 microversion: 2.1 time: 0.168787 Oct 17 14:24:11.037688 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3225/6311] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:24:10 2022] GET /compute/v2.1/servers/9d286341-3ca8-4d40-a52b-56436b17233d => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:24:12.065753 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e6912dd4-61e8-4c85-955d-a00a207a25ff tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:24:12.066811 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e6912dd4-61e8-4c85-955d-a00a207a25ff tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 9d286341-3ca8-4d40-a52b-56436b17233d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:24:12.074444 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e6912dd4-61e8-4c85-955d-a00a207a25ff tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:12.074943 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e6912dd4-61e8-4c85-955d-a00a207a25ff tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:12.075440 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e6912dd4-61e8-4c85-955d-a00a207a25ff tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:12.076152 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e6912dd4-61e8-4c85-955d-a00a207a25ff tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:12.076613 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e6912dd4-61e8-4c85-955d-a00a207a25ff tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:12.077053 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e6912dd4-61e8-4c85-955d-a00a207a25ff tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:12.217149 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e6912dd4-61e8-4c85-955d-a00a207a25ff tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:24:12.225387 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e6912dd4-61e8-4c85-955d-a00a207a25ff tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/9d286341-3ca8-4d40-a52b-56436b17233d" status: 200 len: 1265 microversion: 2.1 time: 0.166782 Oct 17 14:24:12.225975 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3087/6312] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:24:12 2022] GET /compute/v2.1/servers/9d286341-3ca8-4d40-a52b-56436b17233d => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:24:13.252665 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a4f5833d-a523-4bff-bb4a-aa6ca81cd6e6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:24:13.253721 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a4f5833d-a523-4bff-bb4a-aa6ca81cd6e6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 9d286341-3ca8-4d40-a52b-56436b17233d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:24:13.265526 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a4f5833d-a523-4bff-bb4a-aa6ca81cd6e6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:13.266329 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a4f5833d-a523-4bff-bb4a-aa6ca81cd6e6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:13.267278 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a4f5833d-a523-4bff-bb4a-aa6ca81cd6e6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:13.268451 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a4f5833d-a523-4bff-bb4a-aa6ca81cd6e6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:13.269212 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a4f5833d-a523-4bff-bb4a-aa6ca81cd6e6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:13.269918 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a4f5833d-a523-4bff-bb4a-aa6ca81cd6e6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:13.411696 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a4f5833d-a523-4bff-bb4a-aa6ca81cd6e6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:24:13.420174 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a4f5833d-a523-4bff-bb4a-aa6ca81cd6e6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/9d286341-3ca8-4d40-a52b-56436b17233d" status: 200 len: 1265 microversion: 2.1 time: 0.174274 Oct 17 14:24:13.420779 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3226/6313] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:24:13 2022] GET /compute/v2.1/servers/9d286341-3ca8-4d40-a52b-56436b17233d => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:24:14.446631 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-74d00576-8d70-4bc3-b4da-3e1526a706c3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:24:14.447295 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-74d00576-8d70-4bc3-b4da-3e1526a706c3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 9d286341-3ca8-4d40-a52b-56436b17233d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:24:14.454791 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-74d00576-8d70-4bc3-b4da-3e1526a706c3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:14.455348 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-74d00576-8d70-4bc3-b4da-3e1526a706c3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:14.455827 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-74d00576-8d70-4bc3-b4da-3e1526a706c3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:14.456577 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-74d00576-8d70-4bc3-b4da-3e1526a706c3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:14.457052 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-74d00576-8d70-4bc3-b4da-3e1526a706c3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:14.457540 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-74d00576-8d70-4bc3-b4da-3e1526a706c3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:14.593107 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-74d00576-8d70-4bc3-b4da-3e1526a706c3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:24:14.601826 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-74d00576-8d70-4bc3-b4da-3e1526a706c3 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/9d286341-3ca8-4d40-a52b-56436b17233d" status: 200 len: 1265 microversion: 2.1 time: 0.161057 Oct 17 14:24:14.602433 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3088/6314] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:24:14 2022] GET /compute/v2.1/servers/9d286341-3ca8-4d40-a52b-56436b17233d => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:24:15.641805 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-711b5d0f-e6b7-4246-84cd-e7c2d34ca87f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:24:15.642423 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-711b5d0f-e6b7-4246-84cd-e7c2d34ca87f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 9d286341-3ca8-4d40-a52b-56436b17233d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:24:15.650190 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-711b5d0f-e6b7-4246-84cd-e7c2d34ca87f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:15.650682 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-711b5d0f-e6b7-4246-84cd-e7c2d34ca87f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:15.651133 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-711b5d0f-e6b7-4246-84cd-e7c2d34ca87f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:15.651879 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-711b5d0f-e6b7-4246-84cd-e7c2d34ca87f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:15.652332 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-711b5d0f-e6b7-4246-84cd-e7c2d34ca87f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:15.652886 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-711b5d0f-e6b7-4246-84cd-e7c2d34ca87f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:15.740462 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-6df42343-536e-41b9-a5b1-bfe91356fe93 req-fbec476a-8102-45fa-944f-ed84a4c88b3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d286341-3ca8-4d40-a52b-56436b17233d", "name": "network-vif-plugged", "status": "completed", "tag": "8d8f83b4-d9b9-48b0-af24-7d219cd5cfe8"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:24:15.761191 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-6df42343-536e-41b9-a5b1-bfe91356fe93 req-fbec476a-8102-45fa-944f-ed84a4c88b3d service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:15.761703 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-6df42343-536e-41b9-a5b1-bfe91356fe93 req-fbec476a-8102-45fa-944f-ed84a4c88b3d service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:15.762148 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-6df42343-536e-41b9-a5b1-bfe91356fe93 req-fbec476a-8102-45fa-944f-ed84a4c88b3d service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:15.775452 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-6df42343-536e-41b9-a5b1-bfe91356fe93 req-fbec476a-8102-45fa-944f-ed84a4c88b3d service nova] Creating event network-vif-plugged:8d8f83b4-d9b9-48b0-af24-7d219cd5cfe8 for instance 9d286341-3ca8-4d40-a52b-56436b17233d on n-h2-854247-14 Oct 17 14:24:15.781138 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-6df42343-536e-41b9-a5b1-bfe91356fe93 req-fbec476a-8102-45fa-944f-ed84a4c88b3d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044348 Oct 17 14:24:15.781990 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3089/6315] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:24:15.840119 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-711b5d0f-e6b7-4246-84cd-e7c2d34ca87f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:24:15.849433 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-711b5d0f-e6b7-4246-84cd-e7c2d34ca87f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/9d286341-3ca8-4d40-a52b-56436b17233d" status: 200 len: 1265 microversion: 2.1 time: 0.221683 Oct 17 14:24:15.862212 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3227/6316] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:24:15 2022] GET /compute/v2.1/servers/9d286341-3ca8-4d40-a52b-56436b17233d => generated 1265 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:24:16.879574 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b481b6f2-91ff-4a11-b31c-6dca4db31aed tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:24:16.880747 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b481b6f2-91ff-4a11-b31c-6dca4db31aed tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 9d286341-3ca8-4d40-a52b-56436b17233d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:24:16.892049 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b481b6f2-91ff-4a11-b31c-6dca4db31aed tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:16.892875 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b481b6f2-91ff-4a11-b31c-6dca4db31aed tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:16.893627 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b481b6f2-91ff-4a11-b31c-6dca4db31aed tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:16.894820 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b481b6f2-91ff-4a11-b31c-6dca4db31aed tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:16.895645 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b481b6f2-91ff-4a11-b31c-6dca4db31aed tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:16.898291 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b481b6f2-91ff-4a11-b31c-6dca4db31aed tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:17.040957 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b481b6f2-91ff-4a11-b31c-6dca4db31aed tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:24:17.049412 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b481b6f2-91ff-4a11-b31c-6dca4db31aed tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/9d286341-3ca8-4d40-a52b-56436b17233d" status: 200 len: 1265 microversion: 2.1 time: 0.178497 Oct 17 14:24:17.050843 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3090/6317] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:24:16 2022] GET /compute/v2.1/servers/9d286341-3ca8-4d40-a52b-56436b17233d => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:24:18.074960 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2425f5f9-4a11-474a-bf65-98bea3f49d23 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:24:18.075556 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2425f5f9-4a11-474a-bf65-98bea3f49d23 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 9d286341-3ca8-4d40-a52b-56436b17233d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:24:18.082759 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2425f5f9-4a11-474a-bf65-98bea3f49d23 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:18.083263 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2425f5f9-4a11-474a-bf65-98bea3f49d23 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:18.083694 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2425f5f9-4a11-474a-bf65-98bea3f49d23 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:18.084383 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2425f5f9-4a11-474a-bf65-98bea3f49d23 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:18.084828 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2425f5f9-4a11-474a-bf65-98bea3f49d23 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:18.085242 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2425f5f9-4a11-474a-bf65-98bea3f49d23 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:18.232320 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2425f5f9-4a11-474a-bf65-98bea3f49d23 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:24:18.243628 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2425f5f9-4a11-474a-bf65-98bea3f49d23 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/9d286341-3ca8-4d40-a52b-56436b17233d" status: 200 len: 1453 microversion: 2.1 time: 0.172708 Oct 17 14:24:18.244250 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3228/6318] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:24:18 2022] GET /compute/v2.1/servers/9d286341-3ca8-4d40-a52b-56436b17233d => generated 1453 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:24:18.274962 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7115b5e0-6a5b-40b9-a207-d8c691a8e658 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:24:18.275622 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7115b5e0-6a5b-40b9-a207-d8c691a8e658 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 9d286341-3ca8-4d40-a52b-56436b17233d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:24:18.278536 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:24:18.284144 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7115b5e0-6a5b-40b9-a207-d8c691a8e658 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:18.284643 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7115b5e0-6a5b-40b9-a207-d8c691a8e658 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:18.285096 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7115b5e0-6a5b-40b9-a207-d8c691a8e658 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:18.285808 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7115b5e0-6a5b-40b9-a207-d8c691a8e658 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:18.286285 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7115b5e0-6a5b-40b9-a207-d8c691a8e658 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:18.286724 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7115b5e0-6a5b-40b9-a207-d8c691a8e658 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:18.291717 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:24:18.432220 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7115b5e0-6a5b-40b9-a207-d8c691a8e658 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:24:18.440990 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7115b5e0-6a5b-40b9-a207-d8c691a8e658 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/9d286341-3ca8-4d40-a52b-56436b17233d" status: 200 len: 1453 microversion: 2.1 time: 0.170325 Oct 17 14:24:18.441540 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3091/6319] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:24:18 2022] GET /compute/v2.1/servers/9d286341-3ca8-4d40-a52b-56436b17233d => generated 1453 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:24:20.227994 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-1814e1ed-6ecb-493a-a635-ecba29bca798 req-c3f806e1-0c0e-4706-8710-9516848e3980 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d286341-3ca8-4d40-a52b-56436b17233d", "tag": "8d8f83b4-d9b9-48b0-af24-7d219cd5cfe8"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:24:20.233985 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=33 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:24:20.239933 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-1814e1ed-6ecb-493a-a635-ecba29bca798 req-c3f806e1-0c0e-4706-8710-9516848e3980 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:20.240413 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-1814e1ed-6ecb-493a-a635-ecba29bca798 req-c3f806e1-0c0e-4706-8710-9516848e3980 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:20.240845 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-1814e1ed-6ecb-493a-a635-ecba29bca798 req-c3f806e1-0c0e-4706-8710-9516848e3980 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:20.245062 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=77 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:24:20.252928 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-1814e1ed-6ecb-493a-a635-ecba29bca798 req-c3f806e1-0c0e-4706-8710-9516848e3980 service nova] Creating event network-changed:8d8f83b4-d9b9-48b0-af24-7d219cd5cfe8 for instance 9d286341-3ca8-4d40-a52b-56436b17233d on n-h2-854247-14 Oct 17 14:24:20.258483 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-1814e1ed-6ecb-493a-a635-ecba29bca798 req-c3f806e1-0c0e-4706-8710-9516848e3980 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034134 Oct 17 14:24:20.259203 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3229/6320] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:26:01.861168 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:26:01.862044 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=5 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:26:01.863339 n-d-854247-14 devstack@n-api.service[127017]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 14:26:01.863502 n-d-854247-14 devstack@n-api.service[127017]: Mon Oct 17 14:26:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.79) !!! Oct 17 14:26:01.868771 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2ad39857-b1b9-47d6-a972-a3c71aff94b2 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1117437783", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1121990495", "security_groups": [{"name": "tempest-secgroup-smoke-1984704390"}], "block_device_mapping_v2": [{"uuid": "7cb6f0be-1411-4eb1-8d7d-44324a2c6841", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "60d947eb-1d2b-4fd8-9101-f9fb7c7e0088"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:26:02.184538 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-2ad39857-b1b9-47d6-a972-a3c71aff94b2 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] validate_networks() for [('60d947eb-1d2b-4fd8-9101-f9fb7c7e0088', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:26:02.914453 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-2ad39857-b1b9-47d6-a972-a3c71aff94b2 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:26:02.915064 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-2ad39857-b1b9-47d6-a972-a3c71aff94b2 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:26:02.915437 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-2ad39857-b1b9-47d6-a972-a3c71aff94b2 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:26:02.915861 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-2ad39857-b1b9-47d6-a972-a3c71aff94b2 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:26:02.916293 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-2ad39857-b1b9-47d6-a972-a3c71aff94b2 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:26:02.926111 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2ad39857-b1b9-47d6-a972-a3c71aff94b2 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:02.926610 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2ad39857-b1b9-47d6-a972-a3c71aff94b2 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:02.927446 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2ad39857-b1b9-47d6-a972-a3c71aff94b2 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:02.928195 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2ad39857-b1b9-47d6-a972-a3c71aff94b2 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:02.928674 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2ad39857-b1b9-47d6-a972-a3c71aff94b2 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:02.929113 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2ad39857-b1b9-47d6-a972-a3c71aff94b2 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:02.947790 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-2ad39857-b1b9-47d6-a972-a3c71aff94b2 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Getting quotas for project 4ee70940341741cb8e31928b856de051. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:26:02.954233 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-2ad39857-b1b9-47d6-a972-a3c71aff94b2 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Getting quotas for user 06a0e2dab7494a4682615a6269ac24f9 and project 4ee70940341741cb8e31928b856de051. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:26:03.013478 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2ad39857-b1b9-47d6-a972-a3c71aff94b2 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:26:03.015666 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2ad39857-b1b9-47d6-a972-a3c71aff94b2 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 9329d16b-e534-4b1c-b72e-2493233728bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7cb6f0be-1411-4eb1-8d7d-44324a2c6841',volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:26:03.164455 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2ad39857-b1b9-47d6-a972-a3c71aff94b2 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.305633 Oct 17 14:26:03.165034 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3092/6321] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 14:26:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 1307 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:26:03.174376 n-d-854247-14 devstack@n-api.service[127016]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 14:26:03.175388 n-d-854247-14 devstack@n-api.service[127016]: Mon Oct 17 14:26:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9329d16b-e534-4b1c-b72e-2493233728bf (ip 10.222.0.79) !!! Oct 17 14:26:03.178089 n-d-854247-14 devstack@n-api.service[127016]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 17 14:26:03.178223 n-d-854247-14 devstack@n-api.service[127016]: Mon Oct 17 14:26:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9329d16b-e534-4b1c-b72e-2493233728bf (ip 10.222.0.79) !!! Oct 17 14:26:03.181241 n-d-854247-14 devstack@n-api.service[127016]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0ad54cb6-91dd-4ced-9c42-02c0b19684b8] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 14:26:03.183003 n-d-854247-14 devstack@n-api.service[127016]: ERROR oslo.messaging._drivers.impl_rabbit [-] [72f013d3-d96b-49c5-a187-2d216be84735] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 14:26:03.183948 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:26:03.184685 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:26:03.192587 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-50ff3ed9-a66b-4151-b0d3-288815312054 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:26:03.193300 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-50ff3ed9-a66b-4151-b0d3-288815312054 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 9329d16b-e534-4b1c-b72e-2493233728bf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:26:03.258733 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-50ff3ed9-a66b-4151-b0d3-288815312054 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:26:03.267788 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-50ff3ed9-a66b-4151-b0d3-288815312054 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/9329d16b-e534-4b1c-b72e-2493233728bf" status: 200 len: 1095 microversion: 2.1 time: 0.095091 Oct 17 14:26:03.268653 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3230/6322] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:26:03 2022] GET /compute/v2.1/servers/9329d16b-e534-4b1c-b72e-2493233728bf => generated 1095 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:26:04.292835 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0495d883-5905-4bfe-8b60-cd8e37d0c052 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:26:04.293620 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0495d883-5905-4bfe-8b60-cd8e37d0c052 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 9329d16b-e534-4b1c-b72e-2493233728bf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:26:04.300045 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0495d883-5905-4bfe-8b60-cd8e37d0c052 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:04.300584 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0495d883-5905-4bfe-8b60-cd8e37d0c052 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:04.301227 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0495d883-5905-4bfe-8b60-cd8e37d0c052 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:04.302370 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0495d883-5905-4bfe-8b60-cd8e37d0c052 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:04.302812 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0495d883-5905-4bfe-8b60-cd8e37d0c052 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:04.303468 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0495d883-5905-4bfe-8b60-cd8e37d0c052 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:04.378162 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0495d883-5905-4bfe-8b60-cd8e37d0c052 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:26:04.386917 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0495d883-5905-4bfe-8b60-cd8e37d0c052 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/9329d16b-e534-4b1c-b72e-2493233728bf" status: 200 len: 1211 microversion: 2.1 time: 0.099058 Oct 17 14:26:04.391860 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3093/6323] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:26:04 2022] GET /compute/v2.1/servers/9329d16b-e534-4b1c-b72e-2493233728bf => generated 1211 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:26:05.410307 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-54fa8723-437e-42ea-9542-6e15feb8f7ec tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:26:05.411106 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-54fa8723-437e-42ea-9542-6e15feb8f7ec tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 9329d16b-e534-4b1c-b72e-2493233728bf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:26:05.435034 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-54fa8723-437e-42ea-9542-6e15feb8f7ec tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:05.435744 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-54fa8723-437e-42ea-9542-6e15feb8f7ec tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:05.436302 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-54fa8723-437e-42ea-9542-6e15feb8f7ec tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:05.437122 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-54fa8723-437e-42ea-9542-6e15feb8f7ec tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:05.437683 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-54fa8723-437e-42ea-9542-6e15feb8f7ec tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:05.438223 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-54fa8723-437e-42ea-9542-6e15feb8f7ec tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:05.438973 n-d-854247-14 devstack@n-api.service[127016]: INFO oslo.messaging._drivers.impl_rabbit [-] [0ad54cb6-91dd-4ced-9c42-02c0b19684b8] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 58470. Oct 17 14:26:05.440736 n-d-854247-14 devstack@n-api.service[127016]: INFO oslo.messaging._drivers.impl_rabbit [-] [72f013d3-d96b-49c5-a187-2d216be84735] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 58472. Oct 17 14:26:05.677257 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-54fa8723-437e-42ea-9542-6e15feb8f7ec tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:26:05.687071 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-54fa8723-437e-42ea-9542-6e15feb8f7ec tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/9329d16b-e534-4b1c-b72e-2493233728bf" status: 200 len: 1279 microversion: 2.1 time: 0.280738 Oct 17 14:26:05.687834 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3231/6324] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:26:05 2022] GET /compute/v2.1/servers/9329d16b-e534-4b1c-b72e-2493233728bf => generated 1279 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:26:05.898773 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-c9ad7bb8-52d6-4edb-8ca2-5882eceb4ace req-a1c6612c-fe28-4bdc-9046-990098e21d49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9329d16b-e534-4b1c-b72e-2493233728bf", "tag": "b930431b-46a7-4ec9-8a0c-1a34c4456a54"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:26:05.909540 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-c9ad7bb8-52d6-4edb-8ca2-5882eceb4ace req-a1c6612c-fe28-4bdc-9046-990098e21d49 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:05.910270 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-c9ad7bb8-52d6-4edb-8ca2-5882eceb4ace req-a1c6612c-fe28-4bdc-9046-990098e21d49 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:05.911157 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-c9ad7bb8-52d6-4edb-8ca2-5882eceb4ace req-a1c6612c-fe28-4bdc-9046-990098e21d49 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:05.923974 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-c9ad7bb8-52d6-4edb-8ca2-5882eceb4ace req-a1c6612c-fe28-4bdc-9046-990098e21d49 service nova] Creating event network-changed:b930431b-46a7-4ec9-8a0c-1a34c4456a54 for instance 9329d16b-e534-4b1c-b72e-2493233728bf on n-h1-854247-14 Oct 17 14:26:05.930084 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-c9ad7bb8-52d6-4edb-8ca2-5882eceb4ace req-a1c6612c-fe28-4bdc-9046-990098e21d49 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115653 Oct 17 14:26:05.931201 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3094/6325] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:26:06.711281 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4019208f-aa3c-4873-a51f-37bb0ceda8fa tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:26:06.711925 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4019208f-aa3c-4873-a51f-37bb0ceda8fa tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 9329d16b-e534-4b1c-b72e-2493233728bf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:26:06.719653 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4019208f-aa3c-4873-a51f-37bb0ceda8fa tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:06.720124 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4019208f-aa3c-4873-a51f-37bb0ceda8fa tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:06.720575 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4019208f-aa3c-4873-a51f-37bb0ceda8fa tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:06.721276 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4019208f-aa3c-4873-a51f-37bb0ceda8fa tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:06.721856 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4019208f-aa3c-4873-a51f-37bb0ceda8fa tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:06.722317 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4019208f-aa3c-4873-a51f-37bb0ceda8fa tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:06.893527 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4019208f-aa3c-4873-a51f-37bb0ceda8fa tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:26:06.901744 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4019208f-aa3c-4873-a51f-37bb0ceda8fa tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/9329d16b-e534-4b1c-b72e-2493233728bf" status: 200 len: 1279 microversion: 2.1 time: 0.194899 Oct 17 14:26:06.902450 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3232/6326] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:26:06 2022] GET /compute/v2.1/servers/9329d16b-e534-4b1c-b72e-2493233728bf => generated 1279 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:26:07.926897 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e81ee27e-d0f1-4cf9-b682-301e67d393b2 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:26:07.927647 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e81ee27e-d0f1-4cf9-b682-301e67d393b2 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 9329d16b-e534-4b1c-b72e-2493233728bf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:26:07.934314 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e81ee27e-d0f1-4cf9-b682-301e67d393b2 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:07.934817 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e81ee27e-d0f1-4cf9-b682-301e67d393b2 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:07.935340 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e81ee27e-d0f1-4cf9-b682-301e67d393b2 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:07.936057 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e81ee27e-d0f1-4cf9-b682-301e67d393b2 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:07.936530 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e81ee27e-d0f1-4cf9-b682-301e67d393b2 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:07.936970 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e81ee27e-d0f1-4cf9-b682-301e67d393b2 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:08.080357 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e81ee27e-d0f1-4cf9-b682-301e67d393b2 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:26:08.089438 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e81ee27e-d0f1-4cf9-b682-301e67d393b2 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/9329d16b-e534-4b1c-b72e-2493233728bf" status: 200 len: 1279 microversion: 2.1 time: 0.168198 Oct 17 14:26:08.102033 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3095/6327] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:26:07 2022] GET /compute/v2.1/servers/9329d16b-e534-4b1c-b72e-2493233728bf => generated 1279 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:26:09.114275 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b4f3b7f6-c782-4a44-b6db-f8d8e91bc035 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:26:09.116424 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b4f3b7f6-c782-4a44-b6db-f8d8e91bc035 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 9329d16b-e534-4b1c-b72e-2493233728bf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:26:09.124344 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b4f3b7f6-c782-4a44-b6db-f8d8e91bc035 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:09.124913 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b4f3b7f6-c782-4a44-b6db-f8d8e91bc035 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:09.125392 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b4f3b7f6-c782-4a44-b6db-f8d8e91bc035 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:09.126194 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b4f3b7f6-c782-4a44-b6db-f8d8e91bc035 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:09.126703 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b4f3b7f6-c782-4a44-b6db-f8d8e91bc035 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:09.127181 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b4f3b7f6-c782-4a44-b6db-f8d8e91bc035 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:09.366559 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b4f3b7f6-c782-4a44-b6db-f8d8e91bc035 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:26:09.375739 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b4f3b7f6-c782-4a44-b6db-f8d8e91bc035 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/9329d16b-e534-4b1c-b72e-2493233728bf" status: 200 len: 1279 microversion: 2.1 time: 0.266207 Oct 17 14:26:09.376342 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3233/6328] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:26:09 2022] GET /compute/v2.1/servers/9329d16b-e534-4b1c-b72e-2493233728bf => generated 1279 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:26:10.400858 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4820dad9-d9f9-4faa-9675-e398b8da116b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:26:10.401614 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4820dad9-d9f9-4faa-9675-e398b8da116b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 9329d16b-e534-4b1c-b72e-2493233728bf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:26:10.410975 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4820dad9-d9f9-4faa-9675-e398b8da116b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:10.411692 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4820dad9-d9f9-4faa-9675-e398b8da116b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:10.412257 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4820dad9-d9f9-4faa-9675-e398b8da116b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:10.413148 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4820dad9-d9f9-4faa-9675-e398b8da116b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:10.413734 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4820dad9-d9f9-4faa-9675-e398b8da116b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:10.414239 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4820dad9-d9f9-4faa-9675-e398b8da116b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:10.555419 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4820dad9-d9f9-4faa-9675-e398b8da116b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:26:10.567354 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4820dad9-d9f9-4faa-9675-e398b8da116b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/9329d16b-e534-4b1c-b72e-2493233728bf" status: 200 len: 1267 microversion: 2.1 time: 0.171235 Oct 17 14:26:10.568198 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3096/6329] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:26:10 2022] GET /compute/v2.1/servers/9329d16b-e534-4b1c-b72e-2493233728bf => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:26:11.595791 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-adc5a48c-3ba5-4822-8399-0212547664bd tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:26:11.596487 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-adc5a48c-3ba5-4822-8399-0212547664bd tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 9329d16b-e534-4b1c-b72e-2493233728bf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:26:11.604844 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-adc5a48c-3ba5-4822-8399-0212547664bd tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:11.605326 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-adc5a48c-3ba5-4822-8399-0212547664bd tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:11.605763 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-adc5a48c-3ba5-4822-8399-0212547664bd tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:11.606463 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-adc5a48c-3ba5-4822-8399-0212547664bd tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:11.606912 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-adc5a48c-3ba5-4822-8399-0212547664bd tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:11.607374 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-adc5a48c-3ba5-4822-8399-0212547664bd tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:11.754706 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-adc5a48c-3ba5-4822-8399-0212547664bd tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:26:11.763323 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-adc5a48c-3ba5-4822-8399-0212547664bd tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/9329d16b-e534-4b1c-b72e-2493233728bf" status: 200 len: 1267 microversion: 2.1 time: 0.172496 Oct 17 14:26:11.763900 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3234/6330] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:26:11 2022] GET /compute/v2.1/servers/9329d16b-e534-4b1c-b72e-2493233728bf => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:26:12.786488 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-90d7bf36-b52a-4fb0-9140-3db766ef58a6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:26:12.787118 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-90d7bf36-b52a-4fb0-9140-3db766ef58a6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 9329d16b-e534-4b1c-b72e-2493233728bf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:26:12.794905 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-90d7bf36-b52a-4fb0-9140-3db766ef58a6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:12.795451 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-90d7bf36-b52a-4fb0-9140-3db766ef58a6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:12.795913 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-90d7bf36-b52a-4fb0-9140-3db766ef58a6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:12.796673 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-90d7bf36-b52a-4fb0-9140-3db766ef58a6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:12.797143 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-90d7bf36-b52a-4fb0-9140-3db766ef58a6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:12.797582 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-90d7bf36-b52a-4fb0-9140-3db766ef58a6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:12.935549 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:26:12.939961 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-90d7bf36-b52a-4fb0-9140-3db766ef58a6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:26:12.950316 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-90d7bf36-b52a-4fb0-9140-3db766ef58a6 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/9329d16b-e534-4b1c-b72e-2493233728bf" status: 200 len: 1267 microversion: 2.1 time: 0.168035 Oct 17 14:26:12.950890 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3097/6331] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:26:12 2022] GET /compute/v2.1/servers/9329d16b-e534-4b1c-b72e-2493233728bf => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:26:13.974244 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-598390a2-9b18-4de1-bba5-61f12d3b0c00 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:26:13.974861 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-598390a2-9b18-4de1-bba5-61f12d3b0c00 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 9329d16b-e534-4b1c-b72e-2493233728bf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:26:13.977693 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:26:13.983527 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-598390a2-9b18-4de1-bba5-61f12d3b0c00 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:13.983982 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-598390a2-9b18-4de1-bba5-61f12d3b0c00 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:13.984561 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-598390a2-9b18-4de1-bba5-61f12d3b0c00 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:13.985217 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-598390a2-9b18-4de1-bba5-61f12d3b0c00 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:13.985714 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-598390a2-9b18-4de1-bba5-61f12d3b0c00 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:13.986142 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-598390a2-9b18-4de1-bba5-61f12d3b0c00 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:14.137167 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-598390a2-9b18-4de1-bba5-61f12d3b0c00 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:26:14.146307 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-598390a2-9b18-4de1-bba5-61f12d3b0c00 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/9329d16b-e534-4b1c-b72e-2493233728bf" status: 200 len: 1267 microversion: 2.1 time: 0.175955 Oct 17 14:26:14.147028 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3235/6332] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:26:13 2022] GET /compute/v2.1/servers/9329d16b-e534-4b1c-b72e-2493233728bf => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:26:15.171457 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-fc84047c-8ef9-43a8-ae1e-2eff79b97e68 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:26:15.172121 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-fc84047c-8ef9-43a8-ae1e-2eff79b97e68 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 9329d16b-e534-4b1c-b72e-2493233728bf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:26:15.174216 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=6 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:26:15.180724 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fc84047c-8ef9-43a8-ae1e-2eff79b97e68 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:15.181205 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fc84047c-8ef9-43a8-ae1e-2eff79b97e68 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:15.181746 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fc84047c-8ef9-43a8-ae1e-2eff79b97e68 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:15.182388 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fc84047c-8ef9-43a8-ae1e-2eff79b97e68 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:15.182851 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fc84047c-8ef9-43a8-ae1e-2eff79b97e68 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:15.183316 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fc84047c-8ef9-43a8-ae1e-2eff79b97e68 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:15.334397 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-fc84047c-8ef9-43a8-ae1e-2eff79b97e68 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:26:15.342879 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-fc84047c-8ef9-43a8-ae1e-2eff79b97e68 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/9329d16b-e534-4b1c-b72e-2493233728bf" status: 200 len: 1267 microversion: 2.1 time: 0.175688 Oct 17 14:26:15.343610 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3098/6333] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:26:15 2022] GET /compute/v2.1/servers/9329d16b-e534-4b1c-b72e-2493233728bf => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:26:16.366399 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5e77a926-f3d8-4813-a00c-b684bb10779a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:26:16.366978 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5e77a926-f3d8-4813-a00c-b684bb10779a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 9329d16b-e534-4b1c-b72e-2493233728bf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:26:16.376573 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5e77a926-f3d8-4813-a00c-b684bb10779a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:16.377052 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5e77a926-f3d8-4813-a00c-b684bb10779a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:16.377480 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5e77a926-f3d8-4813-a00c-b684bb10779a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:16.378181 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5e77a926-f3d8-4813-a00c-b684bb10779a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:16.378630 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5e77a926-f3d8-4813-a00c-b684bb10779a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:16.379044 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5e77a926-f3d8-4813-a00c-b684bb10779a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:16.525884 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5e77a926-f3d8-4813-a00c-b684bb10779a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:26:16.534256 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5e77a926-f3d8-4813-a00c-b684bb10779a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/9329d16b-e534-4b1c-b72e-2493233728bf" status: 200 len: 1267 microversion: 2.1 time: 0.171880 Oct 17 14:26:16.534837 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3236/6334] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:26:16 2022] GET /compute/v2.1/servers/9329d16b-e534-4b1c-b72e-2493233728bf => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:26:17.558056 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1f41e669-6f8c-4ac8-b6cd-5b6575d8da0f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:26:17.558724 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1f41e669-6f8c-4ac8-b6cd-5b6575d8da0f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 9329d16b-e534-4b1c-b72e-2493233728bf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:26:17.566593 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1f41e669-6f8c-4ac8-b6cd-5b6575d8da0f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:17.567147 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1f41e669-6f8c-4ac8-b6cd-5b6575d8da0f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:17.567634 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1f41e669-6f8c-4ac8-b6cd-5b6575d8da0f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:17.568378 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1f41e669-6f8c-4ac8-b6cd-5b6575d8da0f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:17.568867 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1f41e669-6f8c-4ac8-b6cd-5b6575d8da0f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:17.569330 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1f41e669-6f8c-4ac8-b6cd-5b6575d8da0f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:17.704602 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1f41e669-6f8c-4ac8-b6cd-5b6575d8da0f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:26:17.712943 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1f41e669-6f8c-4ac8-b6cd-5b6575d8da0f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/9329d16b-e534-4b1c-b72e-2493233728bf" status: 200 len: 1267 microversion: 2.1 time: 0.159176 Oct 17 14:26:17.713527 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3099/6335] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:26:17 2022] GET /compute/v2.1/servers/9329d16b-e534-4b1c-b72e-2493233728bf => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:26:18.736625 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-755ab5b2-a3b3-4497-bbfd-52a3d8cc766a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:26:18.737250 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-755ab5b2-a3b3-4497-bbfd-52a3d8cc766a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 9329d16b-e534-4b1c-b72e-2493233728bf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:26:18.744517 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-755ab5b2-a3b3-4497-bbfd-52a3d8cc766a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:18.745002 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-755ab5b2-a3b3-4497-bbfd-52a3d8cc766a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:18.745436 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-755ab5b2-a3b3-4497-bbfd-52a3d8cc766a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:18.746243 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-755ab5b2-a3b3-4497-bbfd-52a3d8cc766a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:18.746822 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-755ab5b2-a3b3-4497-bbfd-52a3d8cc766a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:18.747251 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-755ab5b2-a3b3-4497-bbfd-52a3d8cc766a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:18.886997 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-755ab5b2-a3b3-4497-bbfd-52a3d8cc766a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:26:18.895535 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-755ab5b2-a3b3-4497-bbfd-52a3d8cc766a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/9329d16b-e534-4b1c-b72e-2493233728bf" status: 200 len: 1267 microversion: 2.1 time: 0.162882 Oct 17 14:26:18.896132 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3237/6336] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:26:18 2022] GET /compute/v2.1/servers/9329d16b-e534-4b1c-b72e-2493233728bf => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:26:19.923287 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-70f7a2b3-03fe-49a9-a2e5-b881f0369cb8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:26:19.924254 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-70f7a2b3-03fe-49a9-a2e5-b881f0369cb8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 9329d16b-e534-4b1c-b72e-2493233728bf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:26:19.936154 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70f7a2b3-03fe-49a9-a2e5-b881f0369cb8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:19.936643 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70f7a2b3-03fe-49a9-a2e5-b881f0369cb8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:19.937093 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70f7a2b3-03fe-49a9-a2e5-b881f0369cb8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:19.937791 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70f7a2b3-03fe-49a9-a2e5-b881f0369cb8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:19.938249 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70f7a2b3-03fe-49a9-a2e5-b881f0369cb8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:19.938677 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70f7a2b3-03fe-49a9-a2e5-b881f0369cb8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:20.072647 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-70f7a2b3-03fe-49a9-a2e5-b881f0369cb8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:26:20.085159 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-70f7a2b3-03fe-49a9-a2e5-b881f0369cb8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/9329d16b-e534-4b1c-b72e-2493233728bf" status: 200 len: 1267 microversion: 2.1 time: 0.168638 Oct 17 14:26:20.085988 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3100/6337] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:26:19 2022] GET /compute/v2.1/servers/9329d16b-e534-4b1c-b72e-2493233728bf => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:26:20.571719 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-f882f43c-270f-41dd-87b8-531cbf14370c req-95896c6f-e6b7-4d0f-b796-e5237b85f354 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9329d16b-e534-4b1c-b72e-2493233728bf", "name": "network-vif-plugged", "status": "completed", "tag": "b930431b-46a7-4ec9-8a0c-1a34c4456a54"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:26:20.582081 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-f882f43c-270f-41dd-87b8-531cbf14370c req-95896c6f-e6b7-4d0f-b796-e5237b85f354 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:20.582590 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-f882f43c-270f-41dd-87b8-531cbf14370c req-95896c6f-e6b7-4d0f-b796-e5237b85f354 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:20.583022 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-f882f43c-270f-41dd-87b8-531cbf14370c req-95896c6f-e6b7-4d0f-b796-e5237b85f354 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:20.594526 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-f882f43c-270f-41dd-87b8-531cbf14370c req-95896c6f-e6b7-4d0f-b796-e5237b85f354 service nova] Creating event network-vif-plugged:b930431b-46a7-4ec9-8a0c-1a34c4456a54 for instance 9329d16b-e534-4b1c-b72e-2493233728bf on n-h1-854247-14 Oct 17 14:26:20.600006 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-f882f43c-270f-41dd-87b8-531cbf14370c req-95896c6f-e6b7-4d0f-b796-e5237b85f354 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110818 Oct 17 14:26:20.600573 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3238/6338] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:26:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:26:21.112395 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-94117c3e-d4ff-4353-b627-e13938ef84bb tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:26:21.113073 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-94117c3e-d4ff-4353-b627-e13938ef84bb tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 9329d16b-e534-4b1c-b72e-2493233728bf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:26:21.123664 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-94117c3e-d4ff-4353-b627-e13938ef84bb tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:21.124343 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-94117c3e-d4ff-4353-b627-e13938ef84bb tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:21.124910 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-94117c3e-d4ff-4353-b627-e13938ef84bb tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:21.125858 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-94117c3e-d4ff-4353-b627-e13938ef84bb tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:21.126513 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-94117c3e-d4ff-4353-b627-e13938ef84bb tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:21.127076 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-94117c3e-d4ff-4353-b627-e13938ef84bb tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:21.265096 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-94117c3e-d4ff-4353-b627-e13938ef84bb tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:26:21.273184 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-94117c3e-d4ff-4353-b627-e13938ef84bb tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/9329d16b-e534-4b1c-b72e-2493233728bf" status: 200 len: 1267 microversion: 2.1 time: 0.166243 Oct 17 14:26:21.273766 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3101/6339] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:26:21 2022] GET /compute/v2.1/servers/9329d16b-e534-4b1c-b72e-2493233728bf => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:26:22.303469 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-939fb28f-5a19-471f-9df3-fb96dffa4956 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:26:22.304619 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-939fb28f-5a19-471f-9df3-fb96dffa4956 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 9329d16b-e534-4b1c-b72e-2493233728bf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:26:22.313513 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-939fb28f-5a19-471f-9df3-fb96dffa4956 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:22.313996 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-939fb28f-5a19-471f-9df3-fb96dffa4956 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:22.314422 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-939fb28f-5a19-471f-9df3-fb96dffa4956 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:22.315139 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-939fb28f-5a19-471f-9df3-fb96dffa4956 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:22.315628 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-939fb28f-5a19-471f-9df3-fb96dffa4956 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:22.316045 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-939fb28f-5a19-471f-9df3-fb96dffa4956 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:22.470836 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-939fb28f-5a19-471f-9df3-fb96dffa4956 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:26:22.479250 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-939fb28f-5a19-471f-9df3-fb96dffa4956 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/9329d16b-e534-4b1c-b72e-2493233728bf" status: 200 len: 1455 microversion: 2.1 time: 0.185018 Oct 17 14:26:22.479801 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3239/6340] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:26:22 2022] GET /compute/v2.1/servers/9329d16b-e534-4b1c-b72e-2493233728bf => generated 1455 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:26:22.502309 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bda13c8b-df70-4ce5-ad7a-4fdc3b5dbf0e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:26:22.502975 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-bda13c8b-df70-4ce5-ad7a-4fdc3b5dbf0e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 9329d16b-e534-4b1c-b72e-2493233728bf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:26:22.510682 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bda13c8b-df70-4ce5-ad7a-4fdc3b5dbf0e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:22.511243 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bda13c8b-df70-4ce5-ad7a-4fdc3b5dbf0e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:22.511670 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bda13c8b-df70-4ce5-ad7a-4fdc3b5dbf0e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:22.512388 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bda13c8b-df70-4ce5-ad7a-4fdc3b5dbf0e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:22.512938 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bda13c8b-df70-4ce5-ad7a-4fdc3b5dbf0e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:22.513531 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bda13c8b-df70-4ce5-ad7a-4fdc3b5dbf0e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:22.655886 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-bda13c8b-df70-4ce5-ad7a-4fdc3b5dbf0e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:26:22.664376 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-bda13c8b-df70-4ce5-ad7a-4fdc3b5dbf0e tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/9329d16b-e534-4b1c-b72e-2493233728bf" status: 200 len: 1455 microversion: 2.1 time: 0.166921 Oct 17 14:26:22.664957 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3102/6341] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:26:22 2022] GET /compute/v2.1/servers/9329d16b-e534-4b1c-b72e-2493233728bf => generated 1455 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:26:24.681727 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-34ab6ec6-0ab9-43e8-8a46-7863a5d88ab9 req-03bfdd3a-f247-4e73-be90-8327985ebef8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9329d16b-e534-4b1c-b72e-2493233728bf", "tag": "b930431b-46a7-4ec9-8a0c-1a34c4456a54"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:26:24.692673 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-34ab6ec6-0ab9-43e8-8a46-7863a5d88ab9 req-03bfdd3a-f247-4e73-be90-8327985ebef8 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:24.693151 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-34ab6ec6-0ab9-43e8-8a46-7863a5d88ab9 req-03bfdd3a-f247-4e73-be90-8327985ebef8 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:24.693588 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-34ab6ec6-0ab9-43e8-8a46-7863a5d88ab9 req-03bfdd3a-f247-4e73-be90-8327985ebef8 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:24.706181 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-34ab6ec6-0ab9-43e8-8a46-7863a5d88ab9 req-03bfdd3a-f247-4e73-be90-8327985ebef8 service nova] Creating event network-changed:b930431b-46a7-4ec9-8a0c-1a34c4456a54 for instance 9329d16b-e534-4b1c-b72e-2493233728bf on n-h1-854247-14 Oct 17 14:26:24.711496 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-34ab6ec6-0ab9-43e8-8a46-7863a5d88ab9 req-03bfdd3a-f247-4e73-be90-8327985ebef8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033451 Oct 17 14:26:24.712095 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3240/6342] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:27:54.871572 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:27:54.872381 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=58 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:27:54.875846 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=24 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:27:54.877237 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=52 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:27:54.877657 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-cf074d58-83a9-4351-aaa2-8722c251754c tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:27:54.878193 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-cf074d58-83a9-4351-aaa2-8722c251754c tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 9329d16b-e534-4b1c-b72e-2493233728bf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:27:54.886242 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cf074d58-83a9-4351-aaa2-8722c251754c tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:54.886989 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cf074d58-83a9-4351-aaa2-8722c251754c tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:54.887239 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cf074d58-83a9-4351-aaa2-8722c251754c tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:54.887970 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cf074d58-83a9-4351-aaa2-8722c251754c tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:54.888407 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cf074d58-83a9-4351-aaa2-8722c251754c tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:54.888852 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cf074d58-83a9-4351-aaa2-8722c251754c tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:54.917093 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-cf074d58-83a9-4351-aaa2-8722c251754c tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 9329d16b-e534-4b1c-b72e-2493233728bf] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:27:54.951586 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-f4b21c3f-ad55-4f8b-9cff-4ef4da07eb85 req-c15f967f-a132-4cc5-83a7-2bd7e679076f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9329d16b-e534-4b1c-b72e-2493233728bf", "tag": "b930431b-46a7-4ec9-8a0c-1a34c4456a54"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:27:54.962948 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-f4b21c3f-ad55-4f8b-9cff-4ef4da07eb85 req-c15f967f-a132-4cc5-83a7-2bd7e679076f service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:54.963574 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-f4b21c3f-ad55-4f8b-9cff-4ef4da07eb85 req-c15f967f-a132-4cc5-83a7-2bd7e679076f service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:54.964062 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-f4b21c3f-ad55-4f8b-9cff-4ef4da07eb85 req-c15f967f-a132-4cc5-83a7-2bd7e679076f service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:54.975531 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-f4b21c3f-ad55-4f8b-9cff-4ef4da07eb85 req-c15f967f-a132-4cc5-83a7-2bd7e679076f service nova] Creating event network-changed:b930431b-46a7-4ec9-8a0c-1a34c4456a54 for instance 9329d16b-e534-4b1c-b72e-2493233728bf on n-h1-854247-14 Oct 17 14:27:54.980916 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-f4b21c3f-ad55-4f8b-9cff-4ef4da07eb85 req-c15f967f-a132-4cc5-83a7-2bd7e679076f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108484 Oct 17 14:27:54.981533 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3241/6343] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:27:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:27:55.003939 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-cf074d58-83a9-4351-aaa2-8722c251754c tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "DELETE /compute/v2.1/servers/9329d16b-e534-4b1c-b72e-2493233728bf" status: 204 len: 0 microversion: 2.1 time: 0.134050 Oct 17 14:27:55.004759 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3103/6344] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:27:54 2022] DELETE /compute/v2.1/servers/9329d16b-e534-4b1c-b72e-2493233728bf => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:27:55.013615 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d9d3d7f6-7d5c-48cf-9b12-dde430584a16 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:27:55.014304 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d9d3d7f6-7d5c-48cf-9b12-dde430584a16 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 9329d16b-e534-4b1c-b72e-2493233728bf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:27:55.020825 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d9d3d7f6-7d5c-48cf-9b12-dde430584a16 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:55.021321 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d9d3d7f6-7d5c-48cf-9b12-dde430584a16 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:55.021756 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d9d3d7f6-7d5c-48cf-9b12-dde430584a16 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:55.022467 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d9d3d7f6-7d5c-48cf-9b12-dde430584a16 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:55.023045 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d9d3d7f6-7d5c-48cf-9b12-dde430584a16 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:55.023487 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d9d3d7f6-7d5c-48cf-9b12-dde430584a16 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:55.159862 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d9d3d7f6-7d5c-48cf-9b12-dde430584a16 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:27:55.168878 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d9d3d7f6-7d5c-48cf-9b12-dde430584a16 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/9329d16b-e534-4b1c-b72e-2493233728bf" status: 200 len: 1580 microversion: 2.1 time: 0.159518 Oct 17 14:27:55.169449 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3242/6345] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:27:55 2022] GET /compute/v2.1/servers/9329d16b-e534-4b1c-b72e-2493233728bf => generated 1580 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:27:56.194340 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ec590310-e709-4b94-b78d-1cf9ebcf3a2f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:27:56.195327 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ec590310-e709-4b94-b78d-1cf9ebcf3a2f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 9329d16b-e534-4b1c-b72e-2493233728bf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:27:56.203645 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ec590310-e709-4b94-b78d-1cf9ebcf3a2f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:56.204549 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ec590310-e709-4b94-b78d-1cf9ebcf3a2f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:56.205021 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ec590310-e709-4b94-b78d-1cf9ebcf3a2f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:56.205754 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ec590310-e709-4b94-b78d-1cf9ebcf3a2f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:56.206412 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ec590310-e709-4b94-b78d-1cf9ebcf3a2f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:56.206843 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ec590310-e709-4b94-b78d-1cf9ebcf3a2f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:56.349421 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ec590310-e709-4b94-b78d-1cf9ebcf3a2f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:27:56.362048 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ec590310-e709-4b94-b78d-1cf9ebcf3a2f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/9329d16b-e534-4b1c-b72e-2493233728bf" status: 200 len: 1580 microversion: 2.1 time: 0.171841 Oct 17 14:27:56.362830 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3104/6346] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:27:56 2022] GET /compute/v2.1/servers/9329d16b-e534-4b1c-b72e-2493233728bf => generated 1580 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:27:56.998162 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-c61ba048-f419-4288-8e2b-7d89d74fa5e7 req-8a786336-cdce-4fa8-bccd-f25154b9d439 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9329d16b-e534-4b1c-b72e-2493233728bf", "name": "network-vif-deleted", "tag": "b930431b-46a7-4ec9-8a0c-1a34c4456a54"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:27:57.010389 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-c61ba048-f419-4288-8e2b-7d89d74fa5e7 req-8a786336-cdce-4fa8-bccd-f25154b9d439 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:57.011099 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-c61ba048-f419-4288-8e2b-7d89d74fa5e7 req-8a786336-cdce-4fa8-bccd-f25154b9d439 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:57.011701 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-c61ba048-f419-4288-8e2b-7d89d74fa5e7 req-8a786336-cdce-4fa8-bccd-f25154b9d439 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:57.026142 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-c61ba048-f419-4288-8e2b-7d89d74fa5e7 req-8a786336-cdce-4fa8-bccd-f25154b9d439 service nova] Creating event network-vif-deleted:b930431b-46a7-4ec9-8a0c-1a34c4456a54 for instance 9329d16b-e534-4b1c-b72e-2493233728bf on n-h1-854247-14 Oct 17 14:27:57.031475 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-c61ba048-f419-4288-8e2b-7d89d74fa5e7 req-8a786336-cdce-4fa8-bccd-f25154b9d439 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037194 Oct 17 14:27:57.032424 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3243/6347] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:27:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:27:57.394031 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1c47897d-07cc-4d63-bea1-bf525537420a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:27:57.394672 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1c47897d-07cc-4d63-bea1-bf525537420a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 9329d16b-e534-4b1c-b72e-2493233728bf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:27:57.402002 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c47897d-07cc-4d63-bea1-bf525537420a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:57.402415 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c47897d-07cc-4d63-bea1-bf525537420a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:57.403096 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c47897d-07cc-4d63-bea1-bf525537420a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:57.403877 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c47897d-07cc-4d63-bea1-bf525537420a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:57.404461 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c47897d-07cc-4d63-bea1-bf525537420a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:57.404777 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c47897d-07cc-4d63-bea1-bf525537420a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:57.470127 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1c47897d-07cc-4d63-bea1-bf525537420a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:27:57.478244 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1c47897d-07cc-4d63-bea1-bf525537420a tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/9329d16b-e534-4b1c-b72e-2493233728bf" status: 200 len: 1226 microversion: 2.1 time: 0.088770 Oct 17 14:27:57.478828 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3105/6348] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:27:57 2022] GET /compute/v2.1/servers/9329d16b-e534-4b1c-b72e-2493233728bf => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:27:58.503103 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d11bd93b-7822-4023-b04a-a43039a2169b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:27:58.503862 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d11bd93b-7822-4023-b04a-a43039a2169b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 9329d16b-e534-4b1c-b72e-2493233728bf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:27:58.510721 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d11bd93b-7822-4023-b04a-a43039a2169b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:58.511195 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d11bd93b-7822-4023-b04a-a43039a2169b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:58.511650 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d11bd93b-7822-4023-b04a-a43039a2169b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:58.512336 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d11bd93b-7822-4023-b04a-a43039a2169b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:58.512778 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d11bd93b-7822-4023-b04a-a43039a2169b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:58.513192 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d11bd93b-7822-4023-b04a-a43039a2169b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:58.583922 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d11bd93b-7822-4023-b04a-a43039a2169b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:27:58.593010 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d11bd93b-7822-4023-b04a-a43039a2169b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/9329d16b-e534-4b1c-b72e-2493233728bf" status: 200 len: 1226 microversion: 2.1 time: 0.094921 Oct 17 14:27:58.593930 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3244/6349] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:27:58 2022] GET /compute/v2.1/servers/9329d16b-e534-4b1c-b72e-2493233728bf => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:27:59.616732 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f132c2d2-6f58-459a-aa24-11167d10515f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:27:59.617424 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f132c2d2-6f58-459a-aa24-11167d10515f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 9329d16b-e534-4b1c-b72e-2493233728bf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:27:59.625203 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f132c2d2-6f58-459a-aa24-11167d10515f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:59.625696 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f132c2d2-6f58-459a-aa24-11167d10515f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:59.626140 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f132c2d2-6f58-459a-aa24-11167d10515f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:59.626878 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f132c2d2-6f58-459a-aa24-11167d10515f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:59.627400 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f132c2d2-6f58-459a-aa24-11167d10515f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:59.627831 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f132c2d2-6f58-459a-aa24-11167d10515f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:59.693030 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f132c2d2-6f58-459a-aa24-11167d10515f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:27:59.703750 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f132c2d2-6f58-459a-aa24-11167d10515f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/9329d16b-e534-4b1c-b72e-2493233728bf" status: 200 len: 1226 microversion: 2.1 time: 0.090844 Oct 17 14:27:59.704246 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3106/6350] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:27:59 2022] GET /compute/v2.1/servers/9329d16b-e534-4b1c-b72e-2493233728bf => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:28:00.727689 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ef2dfa81-758a-418a-b591-b0b8cea22a25 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:28:00.728255 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ef2dfa81-758a-418a-b591-b0b8cea22a25 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 9329d16b-e534-4b1c-b72e-2493233728bf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:28:00.735627 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ef2dfa81-758a-418a-b591-b0b8cea22a25 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:00.736115 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ef2dfa81-758a-418a-b591-b0b8cea22a25 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:00.736549 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ef2dfa81-758a-418a-b591-b0b8cea22a25 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:00.737278 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ef2dfa81-758a-418a-b591-b0b8cea22a25 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:00.737708 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ef2dfa81-758a-418a-b591-b0b8cea22a25 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:00.738131 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ef2dfa81-758a-418a-b591-b0b8cea22a25 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:00.801102 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ef2dfa81-758a-418a-b591-b0b8cea22a25 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:28:00.809165 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ef2dfa81-758a-418a-b591-b0b8cea22a25 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/9329d16b-e534-4b1c-b72e-2493233728bf" status: 200 len: 1226 microversion: 2.1 time: 0.085815 Oct 17 14:28:00.809755 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3245/6351] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:28:00 2022] GET /compute/v2.1/servers/9329d16b-e534-4b1c-b72e-2493233728bf => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:28:01.832984 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-739b3c8d-8adf-4b12-ae66-2dea1872bbc7 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:28:01.833586 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-739b3c8d-8adf-4b12-ae66-2dea1872bbc7 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 9329d16b-e534-4b1c-b72e-2493233728bf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:28:01.841318 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-739b3c8d-8adf-4b12-ae66-2dea1872bbc7 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:01.841822 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-739b3c8d-8adf-4b12-ae66-2dea1872bbc7 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:01.842275 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-739b3c8d-8adf-4b12-ae66-2dea1872bbc7 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:01.842990 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-739b3c8d-8adf-4b12-ae66-2dea1872bbc7 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:01.843498 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-739b3c8d-8adf-4b12-ae66-2dea1872bbc7 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:01.843940 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-739b3c8d-8adf-4b12-ae66-2dea1872bbc7 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:01.857919 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-739b3c8d-8adf-4b12-ae66-2dea1872bbc7 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] HTTP exception thrown: Instance 9329d16b-e534-4b1c-b72e-2493233728bf could not be found. Oct 17 14:28:01.859667 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-739b3c8d-8adf-4b12-ae66-2dea1872bbc7 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Request method failure captured: Oct 17 14:28:01.859667 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/9329d16b-e534-4b1c-b72e-2493233728bf HTTP/1.1 Oct 17 14:28:01.859667 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 14:28:01.859667 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 14:28:01.859667 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 14:28:01.859667 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 14:28:01.859667 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 14:28:01.859667 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 14:28:01.859667 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 14:28:01.859667 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 14:28:01.859667 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTWPt4q6KhJtaXfApyhSZ1uS2Yi83dufn15X2GOm5u94F5E_Yj644GYsWZT8YBgl1aUBmYfKlHMjXq-eb8c2HF1REfW755J7WOOs8k3QRgUHhfiijXEH0YeKQjwZvCrEKlD9sd8dyp1v8diPQXXtSf-PHzqWEcTzJgPsJ95on9ZJE1Jo Oct 17 14:28:01.859667 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 14:28:01.859667 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 14:28:01.859667 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 14:28:01.859667 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 14:28:01.859667 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 14:28:01.859667 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 14:28:01.859667 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 4ee70940341741cb8e31928b856de051 Oct 17 14:28:01.859667 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-TestVolumeBootPattern-2135999385 Oct 17 14:28:01.859667 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 14:28:01.859667 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 14:28:01.859667 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4ee70940341741cb8e31928b856de051"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4ee70940341741cb8e31928b856de051"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4ee70940341741cb8e31928b856de051"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4ee70940341741cb8e31928b856de051", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:28:01.859667 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-TestVolumeBootPattern-2135999385 Oct 17 14:28:01.859667 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 4ee70940341741cb8e31928b856de051 Oct 17 14:28:01.859667 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-TestVolumeBootPattern-2135999385 Oct 17 14:28:01.859667 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-TestVolumeBootPattern-2135999385-project Oct 17 14:28:01.859667 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 14:28:01.859667 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 14:28:01.859667 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 06a0e2dab7494a4682615a6269ac24f9 Oct 17 14:28:01.859667 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-TestVolumeBootPattern-2135999385-project Oct 17 14:28:01.859667 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 14:28:01.859667 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 9329d16b-e534-4b1c-b72e-2493233728bf could not be found. Oct 17 14:28:01.859667 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '9329d16b-e534-4b1c-b72e-2493233728bf'} Oct 17 14:28:01.859667 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:28:01.859667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:28:01.859667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:28:01.859667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:28:01.859667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:28:01.859667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:28:01.859667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:28:01.859667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:28:01.859667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:28:01.859667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:28:01.859667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9329d16b-e534-4b1c-b72e-2493233728bf could not be found. Oct 17 14:28:01.859667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:28:01.859667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:28:01.859667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:28:01.859667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:28:01.859667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:28:01.859667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:28:01.859667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:28:01.859667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:28:01.859667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:28:01.859667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:28:01.859667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:28:01.859667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:28:01.859667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:28:01.859667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:28:01.859667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:28:01.859667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:28:01.859667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9329d16b-e534-4b1c-b72e-2493233728bf could not be found. Oct 17 14:28:01.859667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:28:01.859667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:28:01.859667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:28:01.864006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:28:01.864006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:28:01.864006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:28:01.864006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:28:01.864006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:28:01.864006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9329d16b-e534-4b1c-b72e-2493233728bf could not be found. Oct 17 14:28:01.864006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:28:01.864006 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-739b3c8d-8adf-4b12-ae66-2dea1872bbc7 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Returning 404 to user: Instance 9329d16b-e534-4b1c-b72e-2493233728bf could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:28:01.864006 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-739b3c8d-8adf-4b12-ae66-2dea1872bbc7 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/9329d16b-e534-4b1c-b72e-2493233728bf" status: 404 len: 111 microversion: 2.1 time: 0.032294 Oct 17 14:28:01.864006 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3107/6352] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:28:01 2022] GET /compute/v2.1/servers/9329d16b-e534-4b1c-b72e-2493233728bf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:28:08.156869 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-aa23baa7-f638-4ffb-8442-85303ca694c8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:28:08.157364 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-aa23baa7-f638-4ffb-8442-85303ca694c8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 9d286341-3ca8-4d40-a52b-56436b17233d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:28:08.165320 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aa23baa7-f638-4ffb-8442-85303ca694c8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:08.166232 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aa23baa7-f638-4ffb-8442-85303ca694c8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:08.166377 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-489ce118-9066-4ba6-844e-57dc4225a3d3 req-df544535-c98f-4368-91bb-693e9417a540 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d286341-3ca8-4d40-a52b-56436b17233d", "tag": "8d8f83b4-d9b9-48b0-af24-7d219cd5cfe8"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:28:08.166789 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aa23baa7-f638-4ffb-8442-85303ca694c8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:08.167003 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aa23baa7-f638-4ffb-8442-85303ca694c8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:08.167522 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aa23baa7-f638-4ffb-8442-85303ca694c8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:08.168566 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aa23baa7-f638-4ffb-8442-85303ca694c8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:08.176557 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-489ce118-9066-4ba6-844e-57dc4225a3d3 req-df544535-c98f-4368-91bb-693e9417a540 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:08.177052 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-489ce118-9066-4ba6-844e-57dc4225a3d3 req-df544535-c98f-4368-91bb-693e9417a540 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:08.177498 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-489ce118-9066-4ba6-844e-57dc4225a3d3 req-df544535-c98f-4368-91bb-693e9417a540 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:08.189334 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-489ce118-9066-4ba6-844e-57dc4225a3d3 req-df544535-c98f-4368-91bb-693e9417a540 service nova] Creating event network-changed:8d8f83b4-d9b9-48b0-af24-7d219cd5cfe8 for instance 9d286341-3ca8-4d40-a52b-56436b17233d on n-h2-854247-14 Oct 17 14:28:08.194698 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-489ce118-9066-4ba6-844e-57dc4225a3d3 req-df544535-c98f-4368-91bb-693e9417a540 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032814 Oct 17 14:28:08.195751 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3108/6353] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:28:08.195910 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-aa23baa7-f638-4ffb-8442-85303ca694c8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 9d286341-3ca8-4d40-a52b-56436b17233d] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:28:08.286643 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-aa23baa7-f638-4ffb-8442-85303ca694c8 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "DELETE /compute/v2.1/servers/9d286341-3ca8-4d40-a52b-56436b17233d" status: 204 len: 0 microversion: 2.1 time: 0.133482 Oct 17 14:28:08.287700 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3246/6354] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:28:08 2022] DELETE /compute/v2.1/servers/9d286341-3ca8-4d40-a52b-56436b17233d => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:28:08.299290 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9f885708-3457-4c54-b8c7-7ce63995d96b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:28:08.299936 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9f885708-3457-4c54-b8c7-7ce63995d96b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 9d286341-3ca8-4d40-a52b-56436b17233d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:28:08.307299 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f885708-3457-4c54-b8c7-7ce63995d96b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:08.307860 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f885708-3457-4c54-b8c7-7ce63995d96b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:08.308430 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f885708-3457-4c54-b8c7-7ce63995d96b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:08.309360 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f885708-3457-4c54-b8c7-7ce63995d96b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:08.309930 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f885708-3457-4c54-b8c7-7ce63995d96b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:08.310524 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9f885708-3457-4c54-b8c7-7ce63995d96b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:08.473187 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9f885708-3457-4c54-b8c7-7ce63995d96b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:28:08.481798 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9f885708-3457-4c54-b8c7-7ce63995d96b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/9d286341-3ca8-4d40-a52b-56436b17233d" status: 200 len: 1578 microversion: 2.1 time: 0.186912 Oct 17 14:28:08.482419 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3109/6355] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:28:08 2022] GET /compute/v2.1/servers/9d286341-3ca8-4d40-a52b-56436b17233d => generated 1578 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:28:09.511548 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-90bed3a8-4b00-42da-ab45-b07378242f4f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:28:09.512297 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-90bed3a8-4b00-42da-ab45-b07378242f4f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 9d286341-3ca8-4d40-a52b-56436b17233d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:28:09.519588 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-90bed3a8-4b00-42da-ab45-b07378242f4f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:09.520076 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-90bed3a8-4b00-42da-ab45-b07378242f4f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:09.520506 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-90bed3a8-4b00-42da-ab45-b07378242f4f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:09.521206 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-90bed3a8-4b00-42da-ab45-b07378242f4f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:09.521771 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-90bed3a8-4b00-42da-ab45-b07378242f4f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:09.522498 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-90bed3a8-4b00-42da-ab45-b07378242f4f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:09.715876 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-90bed3a8-4b00-42da-ab45-b07378242f4f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:28:09.727018 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-90bed3a8-4b00-42da-ab45-b07378242f4f tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/9d286341-3ca8-4d40-a52b-56436b17233d" status: 200 len: 1578 microversion: 2.1 time: 0.222730 Oct 17 14:28:09.727776 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3247/6356] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:28:09 2022] GET /compute/v2.1/servers/9d286341-3ca8-4d40-a52b-56436b17233d => generated 1578 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:28:10.316137 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-2f810f31-1674-4beb-b970-ebf73a14b313 req-9af27464-89d4-4532-9037-8a22be3c0b62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d286341-3ca8-4d40-a52b-56436b17233d", "name": "network-vif-deleted", "tag": "8d8f83b4-d9b9-48b0-af24-7d219cd5cfe8"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:28:10.327464 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-2f810f31-1674-4beb-b970-ebf73a14b313 req-9af27464-89d4-4532-9037-8a22be3c0b62 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:10.327962 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-2f810f31-1674-4beb-b970-ebf73a14b313 req-9af27464-89d4-4532-9037-8a22be3c0b62 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:10.328411 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-2f810f31-1674-4beb-b970-ebf73a14b313 req-9af27464-89d4-4532-9037-8a22be3c0b62 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:10.340114 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-2f810f31-1674-4beb-b970-ebf73a14b313 req-9af27464-89d4-4532-9037-8a22be3c0b62 service nova] Creating event network-vif-deleted:8d8f83b4-d9b9-48b0-af24-7d219cd5cfe8 for instance 9d286341-3ca8-4d40-a52b-56436b17233d on n-h2-854247-14 Oct 17 14:28:10.345328 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-2f810f31-1674-4beb-b970-ebf73a14b313 req-9af27464-89d4-4532-9037-8a22be3c0b62 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032850 Oct 17 14:28:10.345926 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3110/6357] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:28:10.750792 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4325e3ad-03bb-49d9-8a8f-656fc1c595b0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:28:10.751625 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4325e3ad-03bb-49d9-8a8f-656fc1c595b0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 9d286341-3ca8-4d40-a52b-56436b17233d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:28:10.759211 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4325e3ad-03bb-49d9-8a8f-656fc1c595b0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:10.759784 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4325e3ad-03bb-49d9-8a8f-656fc1c595b0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:10.760304 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4325e3ad-03bb-49d9-8a8f-656fc1c595b0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:10.761116 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4325e3ad-03bb-49d9-8a8f-656fc1c595b0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:10.761656 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4325e3ad-03bb-49d9-8a8f-656fc1c595b0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:10.762149 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4325e3ad-03bb-49d9-8a8f-656fc1c595b0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:10.829109 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4325e3ad-03bb-49d9-8a8f-656fc1c595b0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:28:10.837662 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4325e3ad-03bb-49d9-8a8f-656fc1c595b0 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/9d286341-3ca8-4d40-a52b-56436b17233d" status: 200 len: 1224 microversion: 2.1 time: 0.090942 Oct 17 14:28:10.838305 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3248/6358] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:28:10 2022] GET /compute/v2.1/servers/9d286341-3ca8-4d40-a52b-56436b17233d => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:28:11.862967 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5a60d6f1-ccfe-4bea-8f45-23154a5d335b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:28:11.863907 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5a60d6f1-ccfe-4bea-8f45-23154a5d335b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 9d286341-3ca8-4d40-a52b-56436b17233d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:28:11.873529 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5a60d6f1-ccfe-4bea-8f45-23154a5d335b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:11.874234 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5a60d6f1-ccfe-4bea-8f45-23154a5d335b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:11.874890 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5a60d6f1-ccfe-4bea-8f45-23154a5d335b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:11.876362 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5a60d6f1-ccfe-4bea-8f45-23154a5d335b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:11.877119 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5a60d6f1-ccfe-4bea-8f45-23154a5d335b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:11.877770 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5a60d6f1-ccfe-4bea-8f45-23154a5d335b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:11.949492 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5a60d6f1-ccfe-4bea-8f45-23154a5d335b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:28:11.958657 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5a60d6f1-ccfe-4bea-8f45-23154a5d335b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/9d286341-3ca8-4d40-a52b-56436b17233d" status: 200 len: 1224 microversion: 2.1 time: 0.100792 Oct 17 14:28:11.959303 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3111/6359] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:28:11 2022] GET /compute/v2.1/servers/9d286341-3ca8-4d40-a52b-56436b17233d => generated 1224 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:28:12.982055 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f709c216-0a2f-4719-b24f-ecc286d0a163 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:28:12.982655 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f709c216-0a2f-4719-b24f-ecc286d0a163 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 9d286341-3ca8-4d40-a52b-56436b17233d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:28:12.990218 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f709c216-0a2f-4719-b24f-ecc286d0a163 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:12.990712 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f709c216-0a2f-4719-b24f-ecc286d0a163 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:12.991155 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f709c216-0a2f-4719-b24f-ecc286d0a163 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:12.991867 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f709c216-0a2f-4719-b24f-ecc286d0a163 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:12.992317 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f709c216-0a2f-4719-b24f-ecc286d0a163 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:12.992743 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f709c216-0a2f-4719-b24f-ecc286d0a163 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:13.060885 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f709c216-0a2f-4719-b24f-ecc286d0a163 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:28:13.069694 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f709c216-0a2f-4719-b24f-ecc286d0a163 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/9d286341-3ca8-4d40-a52b-56436b17233d" status: 200 len: 1224 microversion: 2.1 time: 0.091569 Oct 17 14:28:13.070346 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3249/6360] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:28:12 2022] GET /compute/v2.1/servers/9d286341-3ca8-4d40-a52b-56436b17233d => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:28:14.096884 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2c36c4e6-f2a6-4096-8aa9-0da952010d92 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:28:14.097527 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2c36c4e6-f2a6-4096-8aa9-0da952010d92 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 9d286341-3ca8-4d40-a52b-56436b17233d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:28:14.104427 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2c36c4e6-f2a6-4096-8aa9-0da952010d92 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:14.104942 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2c36c4e6-f2a6-4096-8aa9-0da952010d92 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:14.105405 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2c36c4e6-f2a6-4096-8aa9-0da952010d92 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:14.106316 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2c36c4e6-f2a6-4096-8aa9-0da952010d92 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:14.106788 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2c36c4e6-f2a6-4096-8aa9-0da952010d92 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:14.107224 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2c36c4e6-f2a6-4096-8aa9-0da952010d92 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:14.176463 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2c36c4e6-f2a6-4096-8aa9-0da952010d92 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06a0e2dab7494a4682615a6269ac24f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee70940341741cb8e31928b856de051', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:28:14.185211 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2c36c4e6-f2a6-4096-8aa9-0da952010d92 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/9d286341-3ca8-4d40-a52b-56436b17233d" status: 200 len: 1224 microversion: 2.1 time: 0.096098 Oct 17 14:28:14.185824 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3112/6361] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:28:14 2022] GET /compute/v2.1/servers/9d286341-3ca8-4d40-a52b-56436b17233d => generated 1224 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:28:15.208262 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ebe6522d-8bee-4149-95f6-ac250caa3a1b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:28:15.208881 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ebe6522d-8bee-4149-95f6-ac250caa3a1b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: 9d286341-3ca8-4d40-a52b-56436b17233d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:28:15.216464 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ebe6522d-8bee-4149-95f6-ac250caa3a1b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:15.217059 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ebe6522d-8bee-4149-95f6-ac250caa3a1b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:15.217501 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ebe6522d-8bee-4149-95f6-ac250caa3a1b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:15.218324 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ebe6522d-8bee-4149-95f6-ac250caa3a1b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:15.218813 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ebe6522d-8bee-4149-95f6-ac250caa3a1b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:15.219304 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ebe6522d-8bee-4149-95f6-ac250caa3a1b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:15.233602 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-ebe6522d-8bee-4149-95f6-ac250caa3a1b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] HTTP exception thrown: Instance 9d286341-3ca8-4d40-a52b-56436b17233d could not be found. Oct 17 14:28:15.235357 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ebe6522d-8bee-4149-95f6-ac250caa3a1b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Request method failure captured: Oct 17 14:28:15.235357 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/9d286341-3ca8-4d40-a52b-56436b17233d HTTP/1.1 Oct 17 14:28:15.235357 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 14:28:15.235357 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 14:28:15.235357 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 14:28:15.235357 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 14:28:15.235357 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 14:28:15.235357 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 14:28:15.235357 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 14:28:15.235357 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 14:28:15.235357 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTWPt4q6KhJtaXfApyhSZ1uS2Yi83dufn15X2GOm5u94F5E_Yj644GYsWZT8YBgl1aUBmYfKlHMjXq-eb8c2HF1REfW755J7WOOs8k3QRgUHhfiijXEH0YeKQjwZvCrEKlD9sd8dyp1v8diPQXXtSf-PHzqWEcTzJgPsJ95on9ZJE1Jo Oct 17 14:28:15.235357 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 14:28:15.235357 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 14:28:15.235357 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 14:28:15.235357 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 14:28:15.235357 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 14:28:15.235357 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 14:28:15.235357 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 4ee70940341741cb8e31928b856de051 Oct 17 14:28:15.235357 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-TestVolumeBootPattern-2135999385 Oct 17 14:28:15.235357 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 14:28:15.235357 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 14:28:15.235357 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4ee70940341741cb8e31928b856de051"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4ee70940341741cb8e31928b856de051"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4ee70940341741cb8e31928b856de051"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4ee70940341741cb8e31928b856de051", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:28:15.235357 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-TestVolumeBootPattern-2135999385 Oct 17 14:28:15.235357 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 4ee70940341741cb8e31928b856de051 Oct 17 14:28:15.235357 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-TestVolumeBootPattern-2135999385 Oct 17 14:28:15.235357 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-TestVolumeBootPattern-2135999385-project Oct 17 14:28:15.235357 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 14:28:15.235357 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 14:28:15.235357 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 06a0e2dab7494a4682615a6269ac24f9 Oct 17 14:28:15.235357 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-TestVolumeBootPattern-2135999385-project Oct 17 14:28:15.235357 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 14:28:15.235357 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 9d286341-3ca8-4d40-a52b-56436b17233d could not be found. Oct 17 14:28:15.235357 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '9d286341-3ca8-4d40-a52b-56436b17233d'} Oct 17 14:28:15.235357 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:28:15.235357 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:28:15.235357 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:28:15.235357 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:28:15.235357 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:28:15.235357 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:28:15.235357 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:28:15.235357 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:28:15.235357 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:28:15.235357 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:28:15.235357 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d286341-3ca8-4d40-a52b-56436b17233d could not be found. Oct 17 14:28:15.235357 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:28:15.235357 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:28:15.235357 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:28:15.235357 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:28:15.235357 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:28:15.235357 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:28:15.235357 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:28:15.235357 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:28:15.235357 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:28:15.235357 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:28:15.235357 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:28:15.235357 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:28:15.235357 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:28:15.235357 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:28:15.235357 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:28:15.235357 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:28:15.235357 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d286341-3ca8-4d40-a52b-56436b17233d could not be found. Oct 17 14:28:15.235357 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:28:15.235357 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:28:15.235357 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:28:15.240256 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:28:15.240256 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:28:15.240256 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:28:15.240256 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:28:15.240256 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:28:15.240256 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d286341-3ca8-4d40-a52b-56436b17233d could not be found. Oct 17 14:28:15.240256 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:28:15.240256 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ebe6522d-8bee-4149-95f6-ac250caa3a1b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Returning 404 to user: Instance 9d286341-3ca8-4d40-a52b-56436b17233d could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:28:15.240256 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ebe6522d-8bee-4149-95f6-ac250caa3a1b tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/9d286341-3ca8-4d40-a52b-56436b17233d" status: 404 len: 111 microversion: 2.1 time: 0.032502 Oct 17 14:28:15.240256 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3250/6362] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:28:15 2022] GET /compute/v2.1/servers/9d286341-3ca8-4d40-a52b-56436b17233d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:28:15.721877 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9cc2cd7a-556e-491b-b2d5-4800f07b8f6d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:28:15.722560 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9cc2cd7a-556e-491b-b2d5-4800f07b8f6d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: d62cceda-a884-4e46-8825-114c6faa06b4] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:28:15.730167 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9cc2cd7a-556e-491b-b2d5-4800f07b8f6d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:15.730670 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9cc2cd7a-556e-491b-b2d5-4800f07b8f6d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:15.731121 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9cc2cd7a-556e-491b-b2d5-4800f07b8f6d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:15.731860 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9cc2cd7a-556e-491b-b2d5-4800f07b8f6d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:15.732355 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9cc2cd7a-556e-491b-b2d5-4800f07b8f6d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:15.732792 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9cc2cd7a-556e-491b-b2d5-4800f07b8f6d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:15.747331 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-9cc2cd7a-556e-491b-b2d5-4800f07b8f6d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] HTTP exception thrown: Instance d62cceda-a884-4e46-8825-114c6faa06b4 could not be found. Oct 17 14:28:15.749048 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9cc2cd7a-556e-491b-b2d5-4800f07b8f6d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Request method failure captured: Oct 17 14:28:15.749048 n-d-854247-14 devstack@n-api.service[127017]: request: DELETE /compute/v2.1/servers/d62cceda-a884-4e46-8825-114c6faa06b4 HTTP/1.1 Oct 17 14:28:15.749048 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 14:28:15.749048 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 14:28:15.749048 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 14:28:15.749048 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 14:28:15.749048 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 14:28:15.749048 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 14:28:15.749048 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 14:28:15.749048 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 14:28:15.749048 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTWPt4q6KhJtaXfApyhSZ1uS2Yi83dufn15X2GOm5u94F5E_Yj644GYsWZT8YBgl1aUBmYfKlHMjXq-eb8c2HF1REfW755J7WOOs8k3QRgUHhfiijXEH0YeKQjwZvCrEKlD9sd8dyp1v8diPQXXtSf-PHzqWEcTzJgPsJ95on9ZJE1Jo Oct 17 14:28:15.749048 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 14:28:15.749048 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 14:28:15.749048 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 14:28:15.749048 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 14:28:15.749048 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 14:28:15.749048 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 14:28:15.749048 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 4ee70940341741cb8e31928b856de051 Oct 17 14:28:15.749048 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-TestVolumeBootPattern-2135999385 Oct 17 14:28:15.749048 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 14:28:15.749048 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 14:28:15.749048 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4ee70940341741cb8e31928b856de051"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4ee70940341741cb8e31928b856de051"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4ee70940341741cb8e31928b856de051"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4ee70940341741cb8e31928b856de051", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:28:15.749048 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-TestVolumeBootPattern-2135999385 Oct 17 14:28:15.749048 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 4ee70940341741cb8e31928b856de051 Oct 17 14:28:15.749048 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-TestVolumeBootPattern-2135999385 Oct 17 14:28:15.749048 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-TestVolumeBootPattern-2135999385-project Oct 17 14:28:15.749048 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 14:28:15.749048 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 14:28:15.749048 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 06a0e2dab7494a4682615a6269ac24f9 Oct 17 14:28:15.749048 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-TestVolumeBootPattern-2135999385-project Oct 17 14:28:15.749048 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 14:28:15.749048 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance d62cceda-a884-4e46-8825-114c6faa06b4 could not be found. Oct 17 14:28:15.749048 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'd62cceda-a884-4e46-8825-114c6faa06b4'} Oct 17 14:28:15.749048 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:28:15.749048 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:28:15.749048 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:28:15.749048 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:28:15.749048 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:28:15.749048 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:28:15.749048 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:28:15.749048 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:28:15.749048 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:28:15.749048 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:28:15.749048 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d62cceda-a884-4e46-8825-114c6faa06b4 could not be found. Oct 17 14:28:15.749048 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:28:15.749048 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:28:15.749048 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:28:15.749048 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:28:15.749048 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:28:15.749048 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:28:15.749048 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:28:15.749048 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:28:15.749048 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:28:15.749048 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:28:15.749048 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 14:28:15.749048 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 14:28:15.749048 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 14:28:15.749048 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 14:28:15.749048 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:28:15.749048 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:28:15.749048 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:28:15.749048 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:28:15.753814 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d62cceda-a884-4e46-8825-114c6faa06b4 could not be found. Oct 17 14:28:15.753814 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:28:15.753814 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:28:15.753814 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:28:15.753814 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:28:15.753814 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:28:15.753814 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:28:15.753814 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:28:15.753814 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:28:15.753814 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d62cceda-a884-4e46-8825-114c6faa06b4 could not be found. Oct 17 14:28:15.753814 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:28:15.753814 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9cc2cd7a-556e-491b-b2d5-4800f07b8f6d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Returning 404 to user: Instance d62cceda-a884-4e46-8825-114c6faa06b4 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:28:15.753814 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9cc2cd7a-556e-491b-b2d5-4800f07b8f6d tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "DELETE /compute/v2.1/servers/d62cceda-a884-4e46-8825-114c6faa06b4" status: 404 len: 111 microversion: 2.1 time: 0.033341 Oct 17 14:28:15.753814 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3113/6363] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:28:15 2022] DELETE /compute/v2.1/servers/d62cceda-a884-4e46-8825-114c6faa06b4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:28:15.760692 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e1fe53f8-26cd-40fe-87e9-e4422b9cd6b1 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:28:15.761349 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e1fe53f8-26cd-40fe-87e9-e4422b9cd6b1 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] [instance: d62cceda-a884-4e46-8825-114c6faa06b4] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:28:15.767705 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e1fe53f8-26cd-40fe-87e9-e4422b9cd6b1 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:15.768187 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e1fe53f8-26cd-40fe-87e9-e4422b9cd6b1 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:15.768640 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e1fe53f8-26cd-40fe-87e9-e4422b9cd6b1 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:15.769383 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e1fe53f8-26cd-40fe-87e9-e4422b9cd6b1 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:15.769926 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e1fe53f8-26cd-40fe-87e9-e4422b9cd6b1 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:15.770351 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e1fe53f8-26cd-40fe-87e9-e4422b9cd6b1 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:15.785006 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-e1fe53f8-26cd-40fe-87e9-e4422b9cd6b1 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] HTTP exception thrown: Instance d62cceda-a884-4e46-8825-114c6faa06b4 could not be found. Oct 17 14:28:15.786550 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e1fe53f8-26cd-40fe-87e9-e4422b9cd6b1 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Request method failure captured: Oct 17 14:28:15.786550 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/d62cceda-a884-4e46-8825-114c6faa06b4 HTTP/1.1 Oct 17 14:28:15.786550 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 14:28:15.786550 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 14:28:15.786550 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 14:28:15.786550 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 14:28:15.786550 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 14:28:15.786550 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 14:28:15.786550 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 14:28:15.786550 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 14:28:15.786550 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTWPt4q6KhJtaXfApyhSZ1uS2Yi83dufn15X2GOm5u94F5E_Yj644GYsWZT8YBgl1aUBmYfKlHMjXq-eb8c2HF1REfW755J7WOOs8k3QRgUHhfiijXEH0YeKQjwZvCrEKlD9sd8dyp1v8diPQXXtSf-PHzqWEcTzJgPsJ95on9ZJE1Jo Oct 17 14:28:15.786550 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 14:28:15.786550 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 14:28:15.786550 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 14:28:15.786550 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 14:28:15.786550 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 14:28:15.786550 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 14:28:15.786550 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 4ee70940341741cb8e31928b856de051 Oct 17 14:28:15.786550 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-TestVolumeBootPattern-2135999385 Oct 17 14:28:15.786550 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 14:28:15.786550 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 14:28:15.786550 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4ee70940341741cb8e31928b856de051"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4ee70940341741cb8e31928b856de051"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4ee70940341741cb8e31928b856de051"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4ee70940341741cb8e31928b856de051", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:28:15.786550 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-TestVolumeBootPattern-2135999385 Oct 17 14:28:15.786550 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 4ee70940341741cb8e31928b856de051 Oct 17 14:28:15.786550 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-TestVolumeBootPattern-2135999385 Oct 17 14:28:15.786550 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-TestVolumeBootPattern-2135999385-project Oct 17 14:28:15.786550 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 14:28:15.786550 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 14:28:15.786550 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 06a0e2dab7494a4682615a6269ac24f9 Oct 17 14:28:15.786550 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-TestVolumeBootPattern-2135999385-project Oct 17 14:28:15.786550 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 14:28:15.786550 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance d62cceda-a884-4e46-8825-114c6faa06b4 could not be found. Oct 17 14:28:15.786550 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'd62cceda-a884-4e46-8825-114c6faa06b4'} Oct 17 14:28:15.786550 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:28:15.786550 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:28:15.786550 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:28:15.786550 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:28:15.786550 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:28:15.786550 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:28:15.786550 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:28:15.786550 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:28:15.786550 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:28:15.786550 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:28:15.786550 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d62cceda-a884-4e46-8825-114c6faa06b4 could not be found. Oct 17 14:28:15.786550 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:28:15.786550 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:28:15.786550 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:28:15.786550 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:28:15.786550 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:28:15.786550 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:28:15.786550 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:28:15.786550 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:28:15.786550 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:28:15.786550 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:28:15.786550 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:28:15.786550 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:28:15.786550 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:28:15.786550 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:28:15.786550 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:28:15.786550 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:28:15.786550 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d62cceda-a884-4e46-8825-114c6faa06b4 could not be found. Oct 17 14:28:15.786550 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:28:15.786550 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:28:15.786550 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:28:15.791282 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:28:15.791282 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:28:15.791282 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:28:15.791282 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:28:15.791282 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:28:15.791282 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d62cceda-a884-4e46-8825-114c6faa06b4 could not be found. Oct 17 14:28:15.791282 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:28:15.791282 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e1fe53f8-26cd-40fe-87e9-e4422b9cd6b1 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Returning 404 to user: Instance d62cceda-a884-4e46-8825-114c6faa06b4 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:28:15.791282 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e1fe53f8-26cd-40fe-87e9-e4422b9cd6b1 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "GET /compute/v2.1/servers/d62cceda-a884-4e46-8825-114c6faa06b4" status: 404 len: 111 microversion: 2.1 time: 0.031891 Oct 17 14:28:15.791282 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3251/6364] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:28:15 2022] GET /compute/v2.1/servers/d62cceda-a884-4e46-8825-114c6faa06b4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:28:19.228772 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c3389952-f5e9-4cba-bfcc-a257461db152 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] Calling method '.version_select at 0x7f7cd9a14ca0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:28:19.258793 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c3389952-f5e9-4cba-bfcc-a257461db152 tempest-TestVolumeBootPattern-2135999385 tempest-TestVolumeBootPattern-2135999385-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1121990495" status: 202 len: 0 microversion: 2.1 time: 0.034383 Oct 17 14:28:19.259404 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3114/6365] 10.222.0.79 () {58 vars in 1263 bytes} [Mon Oct 17 14:28:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1121990495 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:28:38.133812 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:28:38.134560 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:28:38.279421 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-97ac0704-a27f-43eb-8ba6-4d8db1892d96 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-467656329", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:28:38.338998 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-97ac0704-a27f-43eb-8ba6-4d8db1892d96 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] validate_networks() for None {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:28:38.964352 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-97ac0704-a27f-43eb-8ba6-4d8db1892d96 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:28:38.964778 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-97ac0704-a27f-43eb-8ba6-4d8db1892d96 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:28:38.965251 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-97ac0704-a27f-43eb-8ba6-4d8db1892d96 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:28:38.965665 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-97ac0704-a27f-43eb-8ba6-4d8db1892d96 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:28:38.966078 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-97ac0704-a27f-43eb-8ba6-4d8db1892d96 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:28:38.975954 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-97ac0704-a27f-43eb-8ba6-4d8db1892d96 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:38.976440 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-97ac0704-a27f-43eb-8ba6-4d8db1892d96 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:38.976865 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-97ac0704-a27f-43eb-8ba6-4d8db1892d96 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:38.977641 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-97ac0704-a27f-43eb-8ba6-4d8db1892d96 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:38.978104 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-97ac0704-a27f-43eb-8ba6-4d8db1892d96 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:38.978550 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-97ac0704-a27f-43eb-8ba6-4d8db1892d96 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:38.996541 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-97ac0704-a27f-43eb-8ba6-4d8db1892d96 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Getting quotas for project 3c4b9bd7b63047d8b8d9552e10e7c776. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:28:39.002150 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-97ac0704-a27f-43eb-8ba6-4d8db1892d96 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Getting quotas for user 9febbe235992414f8a0cd0b850f3244b and project 3c4b9bd7b63047d8b8d9552e10e7c776. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:28:39.016103 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-97ac0704-a27f-43eb-8ba6-4d8db1892d96 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:28:39.018427 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-97ac0704-a27f-43eb-8ba6-4d8db1892d96 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] [instance: 315d9624-e2c0-417f-88ec-af9f036e8282] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:28:39.069301 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-97ac0704-a27f-43eb-8ba6-4d8db1892d96 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.940605 Oct 17 14:28:39.070052 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3252/6366] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 14:28:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 942 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:28:39.080654 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:28:39.081568 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:28:39.089694 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f9afaaff-c6c9-479e-920f-0348b8a29e8e tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:28:39.090344 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f9afaaff-c6c9-479e-920f-0348b8a29e8e tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] [instance: 315d9624-e2c0-417f-88ec-af9f036e8282] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:28:39.151429 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f9afaaff-c6c9-479e-920f-0348b8a29e8e tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9febbe235992414f8a0cd0b850f3244b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4b9bd7b63047d8b8d9552e10e7c776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:28:39.158663 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f9afaaff-c6c9-479e-920f-0348b8a29e8e tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] 10.222.0.79 "GET /compute/v2.1/servers/315d9624-e2c0-417f-88ec-af9f036e8282" status: 200 len: 1221 microversion: 2.1 time: 0.079904 Oct 17 14:28:39.159307 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3115/6367] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:28:39 2022] GET /compute/v2.1/servers/315d9624-e2c0-417f-88ec-af9f036e8282 => generated 1221 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:28:40.183875 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3a590328-eb11-457d-9dce-53ee90cf882d tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:28:40.184498 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3a590328-eb11-457d-9dce-53ee90cf882d tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] [instance: 315d9624-e2c0-417f-88ec-af9f036e8282] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:28:40.191442 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3a590328-eb11-457d-9dce-53ee90cf882d tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:40.191910 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3a590328-eb11-457d-9dce-53ee90cf882d tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:40.192449 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3a590328-eb11-457d-9dce-53ee90cf882d tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:40.193404 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3a590328-eb11-457d-9dce-53ee90cf882d tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:40.193833 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3a590328-eb11-457d-9dce-53ee90cf882d tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:40.194240 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3a590328-eb11-457d-9dce-53ee90cf882d tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:40.260798 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3a590328-eb11-457d-9dce-53ee90cf882d tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9febbe235992414f8a0cd0b850f3244b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4b9bd7b63047d8b8d9552e10e7c776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:28:40.269120 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3a590328-eb11-457d-9dce-53ee90cf882d tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] 10.222.0.79 "GET /compute/v2.1/servers/315d9624-e2c0-417f-88ec-af9f036e8282" status: 200 len: 1291 microversion: 2.1 time: 0.090728 Oct 17 14:28:40.269721 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3253/6368] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:28:40 2022] GET /compute/v2.1/servers/315d9624-e2c0-417f-88ec-af9f036e8282 => generated 1291 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:28:41.293712 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f61735d4-d07f-4eb3-be1c-f05667bb2e43 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:28:41.294387 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f61735d4-d07f-4eb3-be1c-f05667bb2e43 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] [instance: 315d9624-e2c0-417f-88ec-af9f036e8282] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:28:41.301650 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f61735d4-d07f-4eb3-be1c-f05667bb2e43 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:41.302145 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f61735d4-d07f-4eb3-be1c-f05667bb2e43 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:41.302598 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f61735d4-d07f-4eb3-be1c-f05667bb2e43 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:41.303345 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f61735d4-d07f-4eb3-be1c-f05667bb2e43 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:41.303811 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f61735d4-d07f-4eb3-be1c-f05667bb2e43 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:41.304248 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f61735d4-d07f-4eb3-be1c-f05667bb2e43 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:41.434907 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f61735d4-d07f-4eb3-be1c-f05667bb2e43 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9febbe235992414f8a0cd0b850f3244b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4b9bd7b63047d8b8d9552e10e7c776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:28:41.442944 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f61735d4-d07f-4eb3-be1c-f05667bb2e43 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] 10.222.0.79 "GET /compute/v2.1/servers/315d9624-e2c0-417f-88ec-af9f036e8282" status: 200 len: 1321 microversion: 2.1 time: 0.153413 Oct 17 14:28:41.443826 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3116/6369] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:28:41 2022] GET /compute/v2.1/servers/315d9624-e2c0-417f-88ec-af9f036e8282 => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:28:41.729403 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-20f67d5a-b225-487a-b893-35fc4ccc986f req-cac8806e-2cb1-4c56-a200-c2979a4d978a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "315d9624-e2c0-417f-88ec-af9f036e8282", "tag": "cd1fc44d-c67b-410b-8648-beb278ba90b3"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:28:41.742066 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-20f67d5a-b225-487a-b893-35fc4ccc986f req-cac8806e-2cb1-4c56-a200-c2979a4d978a service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:41.742547 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-20f67d5a-b225-487a-b893-35fc4ccc986f req-cac8806e-2cb1-4c56-a200-c2979a4d978a service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:41.742975 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-20f67d5a-b225-487a-b893-35fc4ccc986f req-cac8806e-2cb1-4c56-a200-c2979a4d978a service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:41.757178 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-20f67d5a-b225-487a-b893-35fc4ccc986f req-cac8806e-2cb1-4c56-a200-c2979a4d978a service nova] Creating event network-changed:cd1fc44d-c67b-410b-8648-beb278ba90b3 for instance 315d9624-e2c0-417f-88ec-af9f036e8282 on n-h1-854247-14 Oct 17 14:28:41.762706 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-20f67d5a-b225-487a-b893-35fc4ccc986f req-cac8806e-2cb1-4c56-a200-c2979a4d978a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037954 Oct 17 14:28:41.763357 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3254/6370] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:28:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:28:42.467559 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b3544fc1-38aa-4427-903a-6b714256f290 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:28:42.468273 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b3544fc1-38aa-4427-903a-6b714256f290 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] [instance: 315d9624-e2c0-417f-88ec-af9f036e8282] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:28:42.476333 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b3544fc1-38aa-4427-903a-6b714256f290 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:42.476836 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b3544fc1-38aa-4427-903a-6b714256f290 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:42.477285 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b3544fc1-38aa-4427-903a-6b714256f290 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:42.477998 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b3544fc1-38aa-4427-903a-6b714256f290 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:42.478461 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b3544fc1-38aa-4427-903a-6b714256f290 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:42.478959 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b3544fc1-38aa-4427-903a-6b714256f290 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:42.616316 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b3544fc1-38aa-4427-903a-6b714256f290 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9febbe235992414f8a0cd0b850f3244b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4b9bd7b63047d8b8d9552e10e7c776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:28:42.626828 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b3544fc1-38aa-4427-903a-6b714256f290 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] 10.222.0.79 "GET /compute/v2.1/servers/315d9624-e2c0-417f-88ec-af9f036e8282" status: 200 len: 1321 microversion: 2.1 time: 0.164185 Oct 17 14:28:42.627754 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3117/6371] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:28:42 2022] GET /compute/v2.1/servers/315d9624-e2c0-417f-88ec-af9f036e8282 => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:28:43.656234 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-be3c545e-4086-4cc3-97d9-eaf9be10be2b tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:28:43.656952 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-be3c545e-4086-4cc3-97d9-eaf9be10be2b tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] [instance: 315d9624-e2c0-417f-88ec-af9f036e8282] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:28:43.664124 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be3c545e-4086-4cc3-97d9-eaf9be10be2b tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:43.664533 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be3c545e-4086-4cc3-97d9-eaf9be10be2b tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:43.664961 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be3c545e-4086-4cc3-97d9-eaf9be10be2b tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:43.665651 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be3c545e-4086-4cc3-97d9-eaf9be10be2b tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:43.666095 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be3c545e-4086-4cc3-97d9-eaf9be10be2b tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:43.666642 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be3c545e-4086-4cc3-97d9-eaf9be10be2b tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:43.806103 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-be3c545e-4086-4cc3-97d9-eaf9be10be2b tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9febbe235992414f8a0cd0b850f3244b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4b9bd7b63047d8b8d9552e10e7c776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:28:43.814552 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-be3c545e-4086-4cc3-97d9-eaf9be10be2b tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] 10.222.0.79 "GET /compute/v2.1/servers/315d9624-e2c0-417f-88ec-af9f036e8282" status: 200 len: 1321 microversion: 2.1 time: 0.164978 Oct 17 14:28:43.815205 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3255/6372] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:28:43 2022] GET /compute/v2.1/servers/315d9624-e2c0-417f-88ec-af9f036e8282 => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:28:44.840109 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-efa4ac46-1f03-497b-9b8b-9ee30030cfd6 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:28:44.840739 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-efa4ac46-1f03-497b-9b8b-9ee30030cfd6 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] [instance: 315d9624-e2c0-417f-88ec-af9f036e8282] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:28:44.847916 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-efa4ac46-1f03-497b-9b8b-9ee30030cfd6 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:44.848656 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-efa4ac46-1f03-497b-9b8b-9ee30030cfd6 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:44.849160 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-efa4ac46-1f03-497b-9b8b-9ee30030cfd6 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:44.849543 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-efa4ac46-1f03-497b-9b8b-9ee30030cfd6 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:44.850010 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-efa4ac46-1f03-497b-9b8b-9ee30030cfd6 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:44.850445 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-efa4ac46-1f03-497b-9b8b-9ee30030cfd6 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:44.996241 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-efa4ac46-1f03-497b-9b8b-9ee30030cfd6 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9febbe235992414f8a0cd0b850f3244b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4b9bd7b63047d8b8d9552e10e7c776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:28:45.004429 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-efa4ac46-1f03-497b-9b8b-9ee30030cfd6 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] 10.222.0.79 "GET /compute/v2.1/servers/315d9624-e2c0-417f-88ec-af9f036e8282" status: 200 len: 1321 microversion: 2.1 time: 0.170088 Oct 17 14:28:45.004978 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3118/6373] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:28:44 2022] GET /compute/v2.1/servers/315d9624-e2c0-417f-88ec-af9f036e8282 => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:28:46.029872 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e229f59f-1815-44cb-a679-301efe109411 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:28:46.030508 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e229f59f-1815-44cb-a679-301efe109411 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] [instance: 315d9624-e2c0-417f-88ec-af9f036e8282] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:28:46.038198 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e229f59f-1815-44cb-a679-301efe109411 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:46.038678 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e229f59f-1815-44cb-a679-301efe109411 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:46.039110 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e229f59f-1815-44cb-a679-301efe109411 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:46.039828 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e229f59f-1815-44cb-a679-301efe109411 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:46.040273 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e229f59f-1815-44cb-a679-301efe109411 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:46.040687 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e229f59f-1815-44cb-a679-301efe109411 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:46.183539 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e229f59f-1815-44cb-a679-301efe109411 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9febbe235992414f8a0cd0b850f3244b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4b9bd7b63047d8b8d9552e10e7c776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:28:46.191884 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e229f59f-1815-44cb-a679-301efe109411 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] 10.222.0.79 "GET /compute/v2.1/servers/315d9624-e2c0-417f-88ec-af9f036e8282" status: 200 len: 1321 microversion: 2.1 time: 0.166088 Oct 17 14:28:46.192449 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3256/6374] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:28:46 2022] GET /compute/v2.1/servers/315d9624-e2c0-417f-88ec-af9f036e8282 => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:28:47.214380 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-37b5093e-9fc5-49d6-8ac8-2a4aa1ab92d6 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:28:47.214993 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-37b5093e-9fc5-49d6-8ac8-2a4aa1ab92d6 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] [instance: 315d9624-e2c0-417f-88ec-af9f036e8282] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:28:47.222393 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-37b5093e-9fc5-49d6-8ac8-2a4aa1ab92d6 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:47.222918 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-37b5093e-9fc5-49d6-8ac8-2a4aa1ab92d6 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:47.223395 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-37b5093e-9fc5-49d6-8ac8-2a4aa1ab92d6 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:47.224073 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-37b5093e-9fc5-49d6-8ac8-2a4aa1ab92d6 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:47.224532 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-37b5093e-9fc5-49d6-8ac8-2a4aa1ab92d6 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:47.224962 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-37b5093e-9fc5-49d6-8ac8-2a4aa1ab92d6 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:47.276262 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-89ce8775-2aa7-4a88-aaa0-2e57aba35bfd req-5727a5e9-a77e-4bb1-ba82-e1f71188b4ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "315d9624-e2c0-417f-88ec-af9f036e8282", "name": "network-vif-plugged", "status": "completed", "tag": "cd1fc44d-c67b-410b-8648-beb278ba90b3"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:28:47.288105 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-89ce8775-2aa7-4a88-aaa0-2e57aba35bfd req-5727a5e9-a77e-4bb1-ba82-e1f71188b4ae service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:47.288859 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-89ce8775-2aa7-4a88-aaa0-2e57aba35bfd req-5727a5e9-a77e-4bb1-ba82-e1f71188b4ae service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:47.289355 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-89ce8775-2aa7-4a88-aaa0-2e57aba35bfd req-5727a5e9-a77e-4bb1-ba82-e1f71188b4ae service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:47.302957 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-89ce8775-2aa7-4a88-aaa0-2e57aba35bfd req-5727a5e9-a77e-4bb1-ba82-e1f71188b4ae service nova] Creating event network-vif-plugged:cd1fc44d-c67b-410b-8648-beb278ba90b3 for instance 315d9624-e2c0-417f-88ec-af9f036e8282 on n-h1-854247-14 Oct 17 14:28:47.308409 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-89ce8775-2aa7-4a88-aaa0-2e57aba35bfd req-5727a5e9-a77e-4bb1-ba82-e1f71188b4ae service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035848 Oct 17 14:28:47.309702 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3257/6375] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:28:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:28:47.381140 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-37b5093e-9fc5-49d6-8ac8-2a4aa1ab92d6 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9febbe235992414f8a0cd0b850f3244b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4b9bd7b63047d8b8d9552e10e7c776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:28:47.390775 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-37b5093e-9fc5-49d6-8ac8-2a4aa1ab92d6 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] 10.222.0.79 "GET /compute/v2.1/servers/315d9624-e2c0-417f-88ec-af9f036e8282" status: 200 len: 1321 microversion: 2.1 time: 0.180431 Oct 17 14:28:47.391877 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3119/6376] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:28:47 2022] GET /compute/v2.1/servers/315d9624-e2c0-417f-88ec-af9f036e8282 => generated 1321 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:28:48.415152 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d811bd47-cb3f-4693-837a-ef72e0786909 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:28:48.415914 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d811bd47-cb3f-4693-837a-ef72e0786909 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] [instance: 315d9624-e2c0-417f-88ec-af9f036e8282] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:28:48.423199 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d811bd47-cb3f-4693-837a-ef72e0786909 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:48.423702 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d811bd47-cb3f-4693-837a-ef72e0786909 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:48.424142 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d811bd47-cb3f-4693-837a-ef72e0786909 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:48.424851 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d811bd47-cb3f-4693-837a-ef72e0786909 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:48.425339 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d811bd47-cb3f-4693-837a-ef72e0786909 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:48.425730 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d811bd47-cb3f-4693-837a-ef72e0786909 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:48.693127 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d811bd47-cb3f-4693-837a-ef72e0786909 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9febbe235992414f8a0cd0b850f3244b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4b9bd7b63047d8b8d9552e10e7c776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:28:48.701625 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d811bd47-cb3f-4693-837a-ef72e0786909 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] 10.222.0.79 "GET /compute/v2.1/servers/315d9624-e2c0-417f-88ec-af9f036e8282" status: 200 len: 1471 microversion: 2.1 time: 0.291438 Oct 17 14:28:48.702226 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3258/6377] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:28:48 2022] GET /compute/v2.1/servers/315d9624-e2c0-417f-88ec-af9f036e8282 => generated 1471 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:28:48.784750 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5d744d49-b7d0-4f02-9505-a61fe40a0701 tempest-ServersAdminNegativeTestJSON-941175747 tempest-ServersAdminNegativeTestJSON-941175747-project-admin] Calling method '.version_select at 0x7f7cd5615ee0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:28:48.865123 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5d744d49-b7d0-4f02-9505-a61fe40a0701 tempest-ServersAdminNegativeTestJSON-941175747 tempest-ServersAdminNegativeTestJSON-941175747-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/489afcf45134423ca64dc2c9a0d2d173" status: 200 len: 371 microversion: 2.1 time: 0.142469 Oct 17 14:28:48.865699 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3120/6378] 10.222.0.79 () {58 vars in 1242 bytes} [Mon Oct 17 14:28:48 2022] GET /compute/v2.1/os-quota-sets/489afcf45134423ca64dc2c9a0d2d173 => generated 371 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:28:48.878500 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-310a8203-0f3b-4acc-a6ad-c4d537663f7d tempest-ServersAdminNegativeTestJSON-941175747 tempest-ServersAdminNegativeTestJSON-941175747-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-325851866", "id": 1683672341, "os-flavor-access:is_public": "True"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:28:48.899569 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-310a8203-0f3b-4acc-a6ad-c4d537663f7d tempest-ServersAdminNegativeTestJSON-941175747 tempest-ServersAdminNegativeTestJSON-941175747-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.024774 Oct 17 14:28:48.900152 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3259/6379] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 14:28:48 2022] POST /compute/v2.1/flavors => generated 437 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:28:48.913343 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-feca4864-8114-447e-84c0-5a143a1a5fec tempest-ServersAdminNegativeTestJSON-941175747 tempest-ServersAdminNegativeTestJSON-941175747-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1683672341"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:28:48.915801 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-feca4864-8114-447e-84c0-5a143a1a5fec tempest-ServersAdminNegativeTestJSON-941175747 tempest-ServersAdminNegativeTestJSON-941175747-project-admin] [instance: 315d9624-e2c0-417f-88ec-af9f036e8282] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:28:48.922124 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-feca4864-8114-447e-84c0-5a143a1a5fec tempest-ServersAdminNegativeTestJSON-941175747 tempest-ServersAdminNegativeTestJSON-941175747-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:48.922622 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-feca4864-8114-447e-84c0-5a143a1a5fec tempest-ServersAdminNegativeTestJSON-941175747 tempest-ServersAdminNegativeTestJSON-941175747-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:48.923077 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-feca4864-8114-447e-84c0-5a143a1a5fec tempest-ServersAdminNegativeTestJSON-941175747 tempest-ServersAdminNegativeTestJSON-941175747-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:48.923816 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-feca4864-8114-447e-84c0-5a143a1a5fec tempest-ServersAdminNegativeTestJSON-941175747 tempest-ServersAdminNegativeTestJSON-941175747-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:48.924317 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-feca4864-8114-447e-84c0-5a143a1a5fec tempest-ServersAdminNegativeTestJSON-941175747 tempest-ServersAdminNegativeTestJSON-941175747-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:48.924759 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-feca4864-8114-447e-84c0-5a143a1a5fec tempest-ServersAdminNegativeTestJSON-941175747 tempest-ServersAdminNegativeTestJSON-941175747-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:49.012496 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-feca4864-8114-447e-84c0-5a143a1a5fec tempest-ServersAdminNegativeTestJSON-941175747 tempest-ServersAdminNegativeTestJSON-941175747-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '747b9d29e49344bdbe927e4ac1eb3295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489afcf45134423ca64dc2c9a0d2d173', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:28:49.018700 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-feca4864-8114-447e-84c0-5a143a1a5fec tempest-ServersAdminNegativeTestJSON-941175747 tempest-ServersAdminNegativeTestJSON-941175747-project-admin] [instance: 315d9624-e2c0-417f-88ec-af9f036e8282] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-325851866 {{(pid=127017) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 17 14:28:49.025645 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-feca4864-8114-447e-84c0-5a143a1a5fec tempest-ServersAdminNegativeTestJSON-941175747 tempest-ServersAdminNegativeTestJSON-941175747-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:49.026338 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-feca4864-8114-447e-84c0-5a143a1a5fec tempest-ServersAdminNegativeTestJSON-941175747 tempest-ServersAdminNegativeTestJSON-941175747-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:49.026793 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-feca4864-8114-447e-84c0-5a143a1a5fec tempest-ServersAdminNegativeTestJSON-941175747 tempest-ServersAdminNegativeTestJSON-941175747-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:49.027576 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-feca4864-8114-447e-84c0-5a143a1a5fec tempest-ServersAdminNegativeTestJSON-941175747 tempest-ServersAdminNegativeTestJSON-941175747-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:49.028076 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-feca4864-8114-447e-84c0-5a143a1a5fec tempest-ServersAdminNegativeTestJSON-941175747 tempest-ServersAdminNegativeTestJSON-941175747-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:49.028490 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-feca4864-8114-447e-84c0-5a143a1a5fec tempest-ServersAdminNegativeTestJSON-941175747 tempest-ServersAdminNegativeTestJSON-941175747-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:49.054619 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-feca4864-8114-447e-84c0-5a143a1a5fec tempest-ServersAdminNegativeTestJSON-941175747 tempest-ServersAdminNegativeTestJSON-941175747-project-admin] Getting quotas for project 3c4b9bd7b63047d8b8d9552e10e7c776. Resources: {'ram', 'cores'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:28:49.060048 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-feca4864-8114-447e-84c0-5a143a1a5fec tempest-ServersAdminNegativeTestJSON-941175747 tempest-ServersAdminNegativeTestJSON-941175747-project-admin] Getting quotas for user 9febbe235992414f8a0cd0b850f3244b and project 3c4b9bd7b63047d8b8d9552e10e7c776. Resources: {'ram', 'cores'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:28:49.073255 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.compute.api [None req-feca4864-8114-447e-84c0-5a143a1a5fec tempest-ServersAdminNegativeTestJSON-941175747 tempest-ServersAdminNegativeTestJSON-941175747-project-admin] ram quota exceeded for 489afcf45134423ca64dc2c9a0d2d173, tried to resize instance. Oct 17 14:28:49.073800 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-feca4864-8114-447e-84c0-5a143a1a5fec tempest-ServersAdminNegativeTestJSON-941175747 tempest-ServersAdminNegativeTestJSON-941175747-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 17 14:28:49.084295 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-feca4864-8114-447e-84c0-5a143a1a5fec tempest-ServersAdminNegativeTestJSON-941175747 tempest-ServersAdminNegativeTestJSON-941175747-project-admin] Request method failure captured: Oct 17 14:28:49.084295 n-d-854247-14 devstack@n-api.service[127017]: request: POST /compute/v2.1/servers/315d9624-e2c0-417f-88ec-af9f036e8282/action HTTP/1.1 Oct 17 14:28:49.084295 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 14:28:49.084295 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 14:28:49.084295 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 14:28:49.084295 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 39 Oct 17 14:28:49.084295 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 14:28:49.084295 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 14:28:49.084295 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 14:28:49.084295 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 14:28:49.084295 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTWaVppf0DwcOatlDbP164AUtxSAqSPUT8gnxhVYq58KSYOs9ver6utY2axu49-K-_hi6XVymsCsaDYKWyRQCQixpL9fFqEoT4zZl2CQCtlLBSBzrdN5PMeXYmlMkjBD_Nnfv9TEq-VLEUs1bfGXvM91W4oPvbnlaxkKiqJFvTcB7GpE Oct 17 14:28:49.084295 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 14:28:49.084295 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 14:28:49.084295 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 14:28:49.084295 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 14:28:49.084295 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 14:28:49.084295 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 14:28:49.084295 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 489afcf45134423ca64dc2c9a0d2d173 Oct 17 14:28:49.084295 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-941175747 Oct 17 14:28:49.084295 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member,admin Oct 17 14:28:49.084295 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member,admin Oct 17 14:28:49.084295 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/489afcf45134423ca64dc2c9a0d2d173"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/489afcf45134423ca64dc2c9a0d2d173"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/489afcf45134423ca64dc2c9a0d2d173"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_489afcf45134423ca64dc2c9a0d2d173", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:28:49.084295 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServersAdminNegativeTestJSON-941175747 Oct 17 14:28:49.084295 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 489afcf45134423ca64dc2c9a0d2d173 Oct 17 14:28:49.084295 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-941175747 Oct 17 14:28:49.084295 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServersAdminNegativeTestJSON-941175747-project-admin Oct 17 14:28:49.084295 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 14:28:49.084295 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 14:28:49.084295 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 747b9d29e49344bdbe927e4ac1eb3295 Oct 17 14:28:49.084295 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServersAdminNegativeTestJSON-941175747-project-admin Oct 17 14:28:49.084295 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 14:28:49.084295 n-d-854247-14 devstack@n-api.service[127017]: {"resize": {"flavorRef": "1683672341"}} Oct 17 14:28:49.084295 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 14:28:49.084295 n-d-854247-14 devstack@n-api.service[127017]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 17 14:28:49.084295 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '315d9624-e2c0-417f-88ec-af9f036e8282', 'body': {'resize': {'flavorRef': '1683672341'}}} Oct 17 14:28:49.084295 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:28:49.084295 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:28:49.084295 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 17 14:28:49.084295 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 17 14:28:49.084295 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 14:28:49.084295 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 14:28:49.084295 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 17 14:28:49.084295 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc Oct 17 14:28:49.084295 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 17 14:28:49.084295 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 17 14:28:49.084295 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 14:28:49.084295 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 14:28:49.084295 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 17 14:28:49.084295 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 17 14:28:49.084295 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 17 14:28:49.084295 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 17 14:28:49.084295 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 17 14:28:49.084295 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 17 14:28:49.084295 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 17 14:28:49.084295 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:28:49.084295 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:28:49.084295 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:28:49.084295 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:28:49.084295 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 17 14:28:49.084295 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 17 14:28:49.084295 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 17 14:28:49.084295 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 14:28:49.084295 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 17 14:28:49.088968 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 14:28:49.088968 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 17 14:28:49.088968 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 14:28:49.088968 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 14:28:49.088968 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 14:28:49.088968 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 17 14:28:49.088968 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 14:28:49.088968 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 17 14:28:49.088968 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 14:28:49.088968 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 17 14:28:49.088968 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 17 14:28:49.088968 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 17 14:28:49.088968 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 17 14:28:49.088968 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 17 14:28:49.088968 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:28:49.088968 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:28:49.088968 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:28:49.088968 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:28:49.088968 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:28:49.088968 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:28:49.088968 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:28:49.088968 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:28:49.088968 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:28:49.088968 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:28:49.088968 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 14:28:49.088968 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 14:28:49.088968 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 17 14:28:49.088968 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 17 14:28:49.088968 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 17 14:28:49.088968 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 17 14:28:49.088968 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 17 14:28:49.088968 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:28:49.088968 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:28:49.088968 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:28:49.088968 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:28:49.088968 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:28:49.088968 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:28:49.088968 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:28:49.088968 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:28:49.088968 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 17 14:28:49.088968 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:28:49.088968 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-feca4864-8114-447e-84c0-5a143a1a5fec tempest-ServersAdminNegativeTestJSON-941175747 tempest-ServersAdminNegativeTestJSON-941175747-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:28:49.088968 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-feca4864-8114-447e-84c0-5a143a1a5fec tempest-ServersAdminNegativeTestJSON-941175747 tempest-ServersAdminNegativeTestJSON-941175747-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/315d9624-e2c0-417f-88ec-af9f036e8282/action" status: 403 len: 118 microversion: 2.1 time: 0.177065 Oct 17 14:28:49.088968 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3121/6380] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:28:48 2022] POST /compute/v2.1/servers/315d9624-e2c0-417f-88ec-af9f036e8282/action => generated 118 bytes in 178 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:28:49.095480 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7c3eea3a-5ba7-4862-b307-889fe076d948 tempest-ServersAdminNegativeTestJSON-941175747 tempest-ServersAdminNegativeTestJSON-941175747-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:28:49.098394 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:28:49.099071 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=6 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:28:49.117951 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7c3eea3a-5ba7-4862-b307-889fe076d948 tempest-ServersAdminNegativeTestJSON-941175747 tempest-ServersAdminNegativeTestJSON-941175747-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/1683672341" status: 202 len: 0 microversion: 2.1 time: 0.026230 Oct 17 14:28:49.118767 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3260/6381] 10.222.0.79 () {58 vars in 1161 bytes} [Mon Oct 17 14:28:49 2022] DELETE /compute/v2.1/flavors/1683672341 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:28:49.127139 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-dd07f58e-00e2-4aa4-b1e2-91159772a14a tempest-ServersAdminNegativeTestJSON-941175747 tempest-ServersAdminNegativeTestJSON-941175747-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:28:49.147297 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-dd07f58e-00e2-4aa4-b1e2-91159772a14a tempest-ServersAdminNegativeTestJSON-941175747 tempest-ServersAdminNegativeTestJSON-941175747-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023790 Oct 17 14:28:49.147909 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3122/6382] 10.222.0.79 () {58 vars in 1146 bytes} [Mon Oct 17 14:28:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:28:49.170806 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2fab83d2-dba5-4c2d-9ec2-ceef3d34de36 tempest-ServersAdminNegativeTestJSON-941175747 tempest-ServersAdminNegativeTestJSON-941175747-project-admin] Calling method '.version_select at 0x7f7cd4090940>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:28:49.252366 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2fab83d2-dba5-4c2d-9ec2-ceef3d34de36 tempest-ServersAdminNegativeTestJSON-941175747 tempest-ServersAdminNegativeTestJSON-941175747-project-admin] 10.222.0.79 "GET /compute/v2.1/os-quota-sets/489afcf45134423ca64dc2c9a0d2d173" status: 200 len: 371 microversion: 2.1 time: 0.086998 Oct 17 14:28:49.252946 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3261/6383] 10.222.0.79 () {58 vars in 1242 bytes} [Mon Oct 17 14:28:49 2022] GET /compute/v2.1/os-quota-sets/489afcf45134423ca64dc2c9a0d2d173 => generated 371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:28:49.265225 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-887a0fe7-0766-418b-bb9e-490a4af530fa tempest-ServersAdminNegativeTestJSON-941175747 tempest-ServersAdminNegativeTestJSON-941175747-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1999179778", "id": 1204558231, "os-flavor-access:is_public": "True"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:28:49.287914 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-887a0fe7-0766-418b-bb9e-490a4af530fa tempest-ServersAdminNegativeTestJSON-941175747 tempest-ServersAdminNegativeTestJSON-941175747-project-admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.026654 Oct 17 14:28:49.288536 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3123/6384] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 14:28:49 2022] POST /compute/v2.1/flavors => generated 437 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:28:49.300780 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-67ab34e8-b446-40d0-85ed-7c597b04397c tempest-ServersAdminNegativeTestJSON-941175747 tempest-ServersAdminNegativeTestJSON-941175747-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1204558231"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:28:49.303135 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-67ab34e8-b446-40d0-85ed-7c597b04397c tempest-ServersAdminNegativeTestJSON-941175747 tempest-ServersAdminNegativeTestJSON-941175747-project-admin] [instance: 315d9624-e2c0-417f-88ec-af9f036e8282] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:28:49.309492 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-67ab34e8-b446-40d0-85ed-7c597b04397c tempest-ServersAdminNegativeTestJSON-941175747 tempest-ServersAdminNegativeTestJSON-941175747-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:49.309968 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-67ab34e8-b446-40d0-85ed-7c597b04397c tempest-ServersAdminNegativeTestJSON-941175747 tempest-ServersAdminNegativeTestJSON-941175747-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:49.310419 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-67ab34e8-b446-40d0-85ed-7c597b04397c tempest-ServersAdminNegativeTestJSON-941175747 tempest-ServersAdminNegativeTestJSON-941175747-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:49.311097 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-67ab34e8-b446-40d0-85ed-7c597b04397c tempest-ServersAdminNegativeTestJSON-941175747 tempest-ServersAdminNegativeTestJSON-941175747-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:49.311574 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-67ab34e8-b446-40d0-85ed-7c597b04397c tempest-ServersAdminNegativeTestJSON-941175747 tempest-ServersAdminNegativeTestJSON-941175747-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:49.311988 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-67ab34e8-b446-40d0-85ed-7c597b04397c tempest-ServersAdminNegativeTestJSON-941175747 tempest-ServersAdminNegativeTestJSON-941175747-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:49.460035 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-67ab34e8-b446-40d0-85ed-7c597b04397c tempest-ServersAdminNegativeTestJSON-941175747 tempest-ServersAdminNegativeTestJSON-941175747-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '747b9d29e49344bdbe927e4ac1eb3295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489afcf45134423ca64dc2c9a0d2d173', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:28:49.469389 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-67ab34e8-b446-40d0-85ed-7c597b04397c tempest-ServersAdminNegativeTestJSON-941175747 tempest-ServersAdminNegativeTestJSON-941175747-project-admin] [instance: 315d9624-e2c0-417f-88ec-af9f036e8282] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1999179778 {{(pid=127016) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 17 14:28:49.479790 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-67ab34e8-b446-40d0-85ed-7c597b04397c tempest-ServersAdminNegativeTestJSON-941175747 tempest-ServersAdminNegativeTestJSON-941175747-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:49.480273 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-67ab34e8-b446-40d0-85ed-7c597b04397c tempest-ServersAdminNegativeTestJSON-941175747 tempest-ServersAdminNegativeTestJSON-941175747-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:49.480700 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-67ab34e8-b446-40d0-85ed-7c597b04397c tempest-ServersAdminNegativeTestJSON-941175747 tempest-ServersAdminNegativeTestJSON-941175747-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:49.481422 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-67ab34e8-b446-40d0-85ed-7c597b04397c tempest-ServersAdminNegativeTestJSON-941175747 tempest-ServersAdminNegativeTestJSON-941175747-project-admin] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:49.481864 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-67ab34e8-b446-40d0-85ed-7c597b04397c tempest-ServersAdminNegativeTestJSON-941175747 tempest-ServersAdminNegativeTestJSON-941175747-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:49.482281 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-67ab34e8-b446-40d0-85ed-7c597b04397c tempest-ServersAdminNegativeTestJSON-941175747 tempest-ServersAdminNegativeTestJSON-941175747-project-admin] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:49.505933 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-67ab34e8-b446-40d0-85ed-7c597b04397c tempest-ServersAdminNegativeTestJSON-941175747 tempest-ServersAdminNegativeTestJSON-941175747-project-admin] Getting quotas for project 3c4b9bd7b63047d8b8d9552e10e7c776. Resources: {'ram', 'cores'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:28:49.511880 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-67ab34e8-b446-40d0-85ed-7c597b04397c tempest-ServersAdminNegativeTestJSON-941175747 tempest-ServersAdminNegativeTestJSON-941175747-project-admin] Getting quotas for user 9febbe235992414f8a0cd0b850f3244b and project 3c4b9bd7b63047d8b8d9552e10e7c776. Resources: {'ram', 'cores'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:28:49.525580 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.compute.api [None req-67ab34e8-b446-40d0-85ed-7c597b04397c tempest-ServersAdminNegativeTestJSON-941175747 tempest-ServersAdminNegativeTestJSON-941175747-project-admin] cores quota exceeded for 489afcf45134423ca64dc2c9a0d2d173, tried to resize instance. Oct 17 14:28:49.526513 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-67ab34e8-b446-40d0-85ed-7c597b04397c tempest-ServersAdminNegativeTestJSON-941175747 tempest-ServersAdminNegativeTestJSON-941175747-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 17 14:28:49.528843 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-67ab34e8-b446-40d0-85ed-7c597b04397c tempest-ServersAdminNegativeTestJSON-941175747 tempest-ServersAdminNegativeTestJSON-941175747-project-admin] Request method failure captured: Oct 17 14:28:49.528843 n-d-854247-14 devstack@n-api.service[127016]: request: POST /compute/v2.1/servers/315d9624-e2c0-417f-88ec-af9f036e8282/action HTTP/1.1 Oct 17 14:28:49.528843 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 14:28:49.528843 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 14:28:49.528843 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 14:28:49.528843 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 39 Oct 17 14:28:49.528843 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 14:28:49.528843 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 14:28:49.528843 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 14:28:49.528843 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 14:28:49.528843 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTWaVppf0DwcOatlDbP164AUtxSAqSPUT8gnxhVYq58KSYOs9ver6utY2axu49-K-_hi6XVymsCsaDYKWyRQCQixpL9fFqEoT4zZl2CQCtlLBSBzrdN5PMeXYmlMkjBD_Nnfv9TEq-VLEUs1bfGXvM91W4oPvbnlaxkKiqJFvTcB7GpE Oct 17 14:28:49.528843 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 14:28:49.528843 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 14:28:49.528843 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 14:28:49.528843 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 14:28:49.528843 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 14:28:49.528843 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 14:28:49.528843 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 489afcf45134423ca64dc2c9a0d2d173 Oct 17 14:28:49.528843 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-941175747 Oct 17 14:28:49.528843 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member,admin Oct 17 14:28:49.528843 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member,admin Oct 17 14:28:49.528843 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/489afcf45134423ca64dc2c9a0d2d173"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/489afcf45134423ca64dc2c9a0d2d173"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/489afcf45134423ca64dc2c9a0d2d173"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_489afcf45134423ca64dc2c9a0d2d173", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:28:49.528843 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServersAdminNegativeTestJSON-941175747 Oct 17 14:28:49.528843 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 489afcf45134423ca64dc2c9a0d2d173 Oct 17 14:28:49.528843 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-941175747 Oct 17 14:28:49.528843 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServersAdminNegativeTestJSON-941175747-project-admin Oct 17 14:28:49.528843 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 14:28:49.528843 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 14:28:49.528843 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 747b9d29e49344bdbe927e4ac1eb3295 Oct 17 14:28:49.528843 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServersAdminNegativeTestJSON-941175747-project-admin Oct 17 14:28:49.528843 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 14:28:49.528843 n-d-854247-14 devstack@n-api.service[127016]: {"resize": {"flavorRef": "1204558231"}} Oct 17 14:28:49.528843 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 14:28:49.528843 n-d-854247-14 devstack@n-api.service[127016]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 17 14:28:49.528843 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '315d9624-e2c0-417f-88ec-af9f036e8282', 'body': {'resize': {'flavorRef': '1204558231'}}} Oct 17 14:28:49.528843 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:28:49.528843 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:28:49.528843 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 17 14:28:49.528843 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 17 14:28:49.528843 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 14:28:49.528843 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 14:28:49.528843 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 17 14:28:49.528843 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc Oct 17 14:28:49.528843 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 17 14:28:49.528843 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 17 14:28:49.528843 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 14:28:49.528843 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 14:28:49.528843 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 17 14:28:49.528843 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 17 14:28:49.528843 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 17 14:28:49.528843 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 17 14:28:49.528843 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 17 14:28:49.528843 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 17 14:28:49.528843 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 17 14:28:49.528843 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:28:49.528843 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:28:49.528843 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:28:49.528843 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:28:49.528843 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 17 14:28:49.528843 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 17 14:28:49.528843 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 17 14:28:49.528843 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 14:28:49.528843 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 17 14:28:49.538654 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 14:28:49.538654 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 17 14:28:49.538654 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 14:28:49.538654 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 14:28:49.538654 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 14:28:49.538654 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 17 14:28:49.538654 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 14:28:49.538654 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 17 14:28:49.538654 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 14:28:49.538654 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 17 14:28:49.538654 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 17 14:28:49.538654 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 17 14:28:49.538654 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 17 14:28:49.538654 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 17 14:28:49.538654 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:28:49.538654 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:28:49.538654 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:28:49.538654 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:28:49.538654 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:28:49.538654 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:28:49.538654 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:28:49.538654 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:28:49.538654 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:28:49.538654 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:28:49.538654 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 14:28:49.538654 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 14:28:49.538654 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 17 14:28:49.538654 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 17 14:28:49.538654 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 17 14:28:49.538654 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 17 14:28:49.538654 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 17 14:28:49.538654 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:28:49.538654 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:28:49.538654 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:28:49.538654 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:28:49.538654 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:28:49.538654 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:28:49.538654 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:28:49.538654 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:28:49.538654 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 17 14:28:49.538654 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:28:49.538654 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-67ab34e8-b446-40d0-85ed-7c597b04397c tempest-ServersAdminNegativeTestJSON-941175747 tempest-ServersAdminNegativeTestJSON-941175747-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:28:49.538654 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-67ab34e8-b446-40d0-85ed-7c597b04397c tempest-ServersAdminNegativeTestJSON-941175747 tempest-ServersAdminNegativeTestJSON-941175747-project-admin] 10.222.0.79 "POST /compute/v2.1/servers/315d9624-e2c0-417f-88ec-af9f036e8282/action" status: 403 len: 113 microversion: 2.1 time: 0.233708 Oct 17 14:28:49.538654 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3262/6385] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:28:49 2022] POST /compute/v2.1/servers/315d9624-e2c0-417f-88ec-af9f036e8282/action => generated 113 bytes in 235 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:28:49.542874 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a71e77ef-3de2-427b-867d-02be36987491 tempest-ServersAdminNegativeTestJSON-941175747 tempest-ServersAdminNegativeTestJSON-941175747-project-admin] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:28:49.562493 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a71e77ef-3de2-427b-867d-02be36987491 tempest-ServersAdminNegativeTestJSON-941175747 tempest-ServersAdminNegativeTestJSON-941175747-project-admin] 10.222.0.79 "DELETE /compute/v2.1/flavors/1204558231" status: 202 len: 0 microversion: 2.1 time: 0.025081 Oct 17 14:28:49.563068 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3124/6386] 10.222.0.79 () {58 vars in 1161 bytes} [Mon Oct 17 14:28:49 2022] DELETE /compute/v2.1/flavors/1204558231 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:28:49.571241 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-18f75fdd-f17a-46a0-97dd-0d917cfc6000 tempest-ServersAdminNegativeTestJSON-941175747 tempest-ServersAdminNegativeTestJSON-941175747-project-admin] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:28:49.591987 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-18f75fdd-f17a-46a0-97dd-0d917cfc6000 tempest-ServersAdminNegativeTestJSON-941175747 tempest-ServersAdminNegativeTestJSON-941175747-project-admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024496 Oct 17 14:28:49.592546 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3263/6387] 10.222.0.79 () {58 vars in 1146 bytes} [Mon Oct 17 14:28:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:28:49.616378 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-435d7e5d-8c6f-4694-b98c-81242c46cdff tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:28:49.617220 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-435d7e5d-8c6f-4694-b98c-81242c46cdff tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] [instance: 315d9624-e2c0-417f-88ec-af9f036e8282] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:28:49.626460 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-435d7e5d-8c6f-4694-b98c-81242c46cdff tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:49.627334 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-435d7e5d-8c6f-4694-b98c-81242c46cdff tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:49.628069 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-435d7e5d-8c6f-4694-b98c-81242c46cdff tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:49.629238 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-435d7e5d-8c6f-4694-b98c-81242c46cdff tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:49.629980 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-435d7e5d-8c6f-4694-b98c-81242c46cdff tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:49.630723 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-435d7e5d-8c6f-4694-b98c-81242c46cdff tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:49.659328 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-435d7e5d-8c6f-4694-b98c-81242c46cdff tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] [instance: 315d9624-e2c0-417f-88ec-af9f036e8282] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:28:49.747022 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-435d7e5d-8c6f-4694-b98c-81242c46cdff tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] 10.222.0.79 "DELETE /compute/v2.1/servers/315d9624-e2c0-417f-88ec-af9f036e8282" status: 204 len: 0 microversion: 2.1 time: 0.137027 Oct 17 14:28:49.747686 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3125/6388] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:28:49 2022] DELETE /compute/v2.1/servers/315d9624-e2c0-417f-88ec-af9f036e8282 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 14:28:49.756031 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fe366bf9-8ff1-4fce-ae7b-e2dd6d04a61c tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:28:49.756641 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-fe366bf9-8ff1-4fce-ae7b-e2dd6d04a61c tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] [instance: 315d9624-e2c0-417f-88ec-af9f036e8282] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:28:49.762935 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe366bf9-8ff1-4fce-ae7b-e2dd6d04a61c tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:49.763484 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe366bf9-8ff1-4fce-ae7b-e2dd6d04a61c tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:49.763942 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe366bf9-8ff1-4fce-ae7b-e2dd6d04a61c tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:49.764638 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe366bf9-8ff1-4fce-ae7b-e2dd6d04a61c tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:49.765087 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe366bf9-8ff1-4fce-ae7b-e2dd6d04a61c tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:49.765506 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe366bf9-8ff1-4fce-ae7b-e2dd6d04a61c tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:49.900744 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fe366bf9-8ff1-4fce-ae7b-e2dd6d04a61c tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9febbe235992414f8a0cd0b850f3244b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4b9bd7b63047d8b8d9552e10e7c776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:28:49.909194 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fe366bf9-8ff1-4fce-ae7b-e2dd6d04a61c tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] 10.222.0.79 "GET /compute/v2.1/servers/315d9624-e2c0-417f-88ec-af9f036e8282" status: 200 len: 1477 microversion: 2.1 time: 0.157155 Oct 17 14:28:49.909830 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3264/6389] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:28:49 2022] GET /compute/v2.1/servers/315d9624-e2c0-417f-88ec-af9f036e8282 => generated 1477 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:28:50.936105 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ae02a481-b202-4f75-83a4-5c7a6e0c8ac0 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:28:50.936991 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ae02a481-b202-4f75-83a4-5c7a6e0c8ac0 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] [instance: 315d9624-e2c0-417f-88ec-af9f036e8282] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:28:50.947790 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae02a481-b202-4f75-83a4-5c7a6e0c8ac0 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:50.948436 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae02a481-b202-4f75-83a4-5c7a6e0c8ac0 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:50.948882 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae02a481-b202-4f75-83a4-5c7a6e0c8ac0 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:50.949585 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae02a481-b202-4f75-83a4-5c7a6e0c8ac0 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:50.950050 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae02a481-b202-4f75-83a4-5c7a6e0c8ac0 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:50.950483 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae02a481-b202-4f75-83a4-5c7a6e0c8ac0 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:51.086366 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ae02a481-b202-4f75-83a4-5c7a6e0c8ac0 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9febbe235992414f8a0cd0b850f3244b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4b9bd7b63047d8b8d9552e10e7c776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:28:51.094942 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ae02a481-b202-4f75-83a4-5c7a6e0c8ac0 tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] 10.222.0.79 "GET /compute/v2.1/servers/315d9624-e2c0-417f-88ec-af9f036e8282" status: 200 len: 1477 microversion: 2.1 time: 0.164892 Oct 17 14:28:51.095570 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3126/6390] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:28:50 2022] GET /compute/v2.1/servers/315d9624-e2c0-417f-88ec-af9f036e8282 => generated 1477 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:28:51.476019 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-0ddaf441-f91e-4a84-b036-ea34469032b8 req-93a04468-b06e-4802-9b8c-020140a88a21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "315d9624-e2c0-417f-88ec-af9f036e8282", "name": "network-vif-deleted", "tag": "cd1fc44d-c67b-410b-8648-beb278ba90b3"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:28:51.488516 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-0ddaf441-f91e-4a84-b036-ea34469032b8 req-93a04468-b06e-4802-9b8c-020140a88a21 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:51.489006 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-0ddaf441-f91e-4a84-b036-ea34469032b8 req-93a04468-b06e-4802-9b8c-020140a88a21 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:51.489439 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-0ddaf441-f91e-4a84-b036-ea34469032b8 req-93a04468-b06e-4802-9b8c-020140a88a21 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:51.507838 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-0ddaf441-f91e-4a84-b036-ea34469032b8 req-93a04468-b06e-4802-9b8c-020140a88a21 service nova] Creating event network-vif-deleted:cd1fc44d-c67b-410b-8648-beb278ba90b3 for instance 315d9624-e2c0-417f-88ec-af9f036e8282 on n-h1-854247-14 Oct 17 14:28:51.513664 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-0ddaf441-f91e-4a84-b036-ea34469032b8 req-93a04468-b06e-4802-9b8c-020140a88a21 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041667 Oct 17 14:28:51.514420 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3265/6391] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:28:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:28:52.118319 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1445ddd3-5d04-49ac-84c7-1b9c07c4c34d tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:28:52.118956 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1445ddd3-5d04-49ac-84c7-1b9c07c4c34d tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] [instance: 315d9624-e2c0-417f-88ec-af9f036e8282] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:28:52.125860 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1445ddd3-5d04-49ac-84c7-1b9c07c4c34d tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:52.126360 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1445ddd3-5d04-49ac-84c7-1b9c07c4c34d tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:52.126814 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1445ddd3-5d04-49ac-84c7-1b9c07c4c34d tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:52.127564 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1445ddd3-5d04-49ac-84c7-1b9c07c4c34d tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:52.128033 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1445ddd3-5d04-49ac-84c7-1b9c07c4c34d tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:52.128512 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1445ddd3-5d04-49ac-84c7-1b9c07c4c34d tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:52.143215 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-1445ddd3-5d04-49ac-84c7-1b9c07c4c34d tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] HTTP exception thrown: Instance 315d9624-e2c0-417f-88ec-af9f036e8282 could not be found. Oct 17 14:28:52.144943 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1445ddd3-5d04-49ac-84c7-1b9c07c4c34d tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Request method failure captured: Oct 17 14:28:52.144943 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/315d9624-e2c0-417f-88ec-af9f036e8282 HTTP/1.1 Oct 17 14:28:52.144943 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 14:28:52.144943 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 14:28:52.144943 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 14:28:52.144943 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 14:28:52.144943 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 14:28:52.144943 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 14:28:52.144943 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 14:28:52.144943 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 14:28:52.144943 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTWaVHNpTkrV7XJVuNzpuIbfuEMWGAeI_GYkega9nRdlMg8ueWcRvfx03-gtjrugUaCDRFhvjJILdrYQoVIbPBkBKPVo-h6x6-GaBkJLsp0uxcIMQriFjfJFMO6dsefh5fD6FH7VZR7JNJlsTcZFIU6i3kQQBJNETb58Dsfx4BqHQUGs Oct 17 14:28:52.144943 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 14:28:52.144943 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 14:28:52.144943 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 14:28:52.144943 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 14:28:52.144943 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 14:28:52.144943 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 14:28:52.144943 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 3c4b9bd7b63047d8b8d9552e10e7c776 Oct 17 14:28:52.144943 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-182524681 Oct 17 14:28:52.144943 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 14:28:52.144943 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 14:28:52.144943 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3c4b9bd7b63047d8b8d9552e10e7c776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/3c4b9bd7b63047d8b8d9552e10e7c776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3c4b9bd7b63047d8b8d9552e10e7c776"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_3c4b9bd7b63047d8b8d9552e10e7c776", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:28:52.144943 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServersAdminNegativeTestJSON-182524681 Oct 17 14:28:52.144943 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 3c4b9bd7b63047d8b8d9552e10e7c776 Oct 17 14:28:52.144943 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-182524681 Oct 17 14:28:52.144943 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServersAdminNegativeTestJSON-182524681-project Oct 17 14:28:52.144943 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 14:28:52.144943 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 14:28:52.144943 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 9febbe235992414f8a0cd0b850f3244b Oct 17 14:28:52.144943 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServersAdminNegativeTestJSON-182524681-project Oct 17 14:28:52.144943 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 14:28:52.144943 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 315d9624-e2c0-417f-88ec-af9f036e8282 could not be found. Oct 17 14:28:52.144943 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '315d9624-e2c0-417f-88ec-af9f036e8282'} Oct 17 14:28:52.144943 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:28:52.144943 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:28:52.144943 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:28:52.144943 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:28:52.144943 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:28:52.144943 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:28:52.144943 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:28:52.144943 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:28:52.144943 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:28:52.144943 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:28:52.144943 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 315d9624-e2c0-417f-88ec-af9f036e8282 could not be found. Oct 17 14:28:52.144943 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:28:52.144943 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:28:52.144943 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:28:52.144943 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:28:52.144943 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:28:52.144943 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:28:52.144943 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:28:52.144943 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:28:52.144943 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:28:52.144943 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:28:52.144943 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:28:52.144943 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:28:52.144943 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:28:52.144943 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:28:52.144943 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:28:52.144943 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:28:52.144943 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 315d9624-e2c0-417f-88ec-af9f036e8282 could not be found. Oct 17 14:28:52.144943 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:28:52.144943 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:28:52.149341 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:28:52.149341 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:28:52.149341 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:28:52.149341 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:28:52.149341 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:28:52.149341 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:28:52.149341 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 315d9624-e2c0-417f-88ec-af9f036e8282 could not be found. Oct 17 14:28:52.149341 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:28:52.149341 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1445ddd3-5d04-49ac-84c7-1b9c07c4c34d tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] Returning 404 to user: Instance 315d9624-e2c0-417f-88ec-af9f036e8282 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:28:52.149341 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1445ddd3-5d04-49ac-84c7-1b9c07c4c34d tempest-ServersAdminNegativeTestJSON-182524681 tempest-ServersAdminNegativeTestJSON-182524681-project] 10.222.0.79 "GET /compute/v2.1/servers/315d9624-e2c0-417f-88ec-af9f036e8282" status: 404 len: 111 microversion: 2.1 time: 0.032141 Oct 17 14:28:52.149341 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3127/6392] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:28:52 2022] GET /compute/v2.1/servers/315d9624-e2c0-417f-88ec-af9f036e8282 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:28:58.651724 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3f7c3545-2565-49eb-aafd-c03324728b93 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-112540384", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "35deeb14-f8c7-4b66-ae55-2e85bb334d9a"}]}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:28:58.714441 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-3f7c3545-2565-49eb-aafd-c03324728b93 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] validate_networks() for [('35deeb14-f8c7-4b66-ae55-2e85bb334d9a', None, None, None, None, None)] {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:28:59.104763 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-3f7c3545-2565-49eb-aafd-c03324728b93 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:28:59.105752 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-3f7c3545-2565-49eb-aafd-c03324728b93 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:28:59.106502 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-3f7c3545-2565-49eb-aafd-c03324728b93 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:28:59.107078 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-3f7c3545-2565-49eb-aafd-c03324728b93 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:28:59.107736 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-3f7c3545-2565-49eb-aafd-c03324728b93 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:28:59.123379 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3f7c3545-2565-49eb-aafd-c03324728b93 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:59.124044 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3f7c3545-2565-49eb-aafd-c03324728b93 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:59.124651 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3f7c3545-2565-49eb-aafd-c03324728b93 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:59.125768 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3f7c3545-2565-49eb-aafd-c03324728b93 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:59.126439 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3f7c3545-2565-49eb-aafd-c03324728b93 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:59.127031 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3f7c3545-2565-49eb-aafd-c03324728b93 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:59.147634 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-3f7c3545-2565-49eb-aafd-c03324728b93 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Getting quotas for project 4c45298bec1a45a5a54eb40452a581bb. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:28:59.153533 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-3f7c3545-2565-49eb-aafd-c03324728b93 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Getting quotas for user 11bc441f92ae4068b4d02751c57c1c82 and project 4c45298bec1a45a5a54eb40452a581bb. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:28:59.168511 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3f7c3545-2565-49eb-aafd-c03324728b93 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:28:59.170975 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3f7c3545-2565-49eb-aafd-c03324728b93 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] [instance: b2c388d0-04a3-42c0-87fe-ac7df799a423] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:28:59.219430 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3f7c3545-2565-49eb-aafd-c03324728b93 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.702414 Oct 17 14:28:59.220100 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3266/6393] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 14:28:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:28:59.231688 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-57b8b7d9-e5f7-43ab-ab2b-e9206095203e tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:28:59.232322 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-57b8b7d9-e5f7-43ab-ab2b-e9206095203e tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] [instance: b2c388d0-04a3-42c0-87fe-ac7df799a423] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:28:59.235194 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=4 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:28:59.236128 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=3 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:28:59.298184 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-57b8b7d9-e5f7-43ab-ab2b-e9206095203e tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bc441f92ae4068b4d02751c57c1c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c45298bec1a45a5a54eb40452a581bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:28:59.308571 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-57b8b7d9-e5f7-43ab-ab2b-e9206095203e tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423" status: 200 len: 1214 microversion: 2.1 time: 0.081013 Oct 17 14:28:59.309284 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3128/6394] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:28:59 2022] GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:00.335925 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-46f3e8b4-830d-40aa-a66b-9310cf4351dd tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:00.336542 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-46f3e8b4-830d-40aa-a66b-9310cf4351dd tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] [instance: b2c388d0-04a3-42c0-87fe-ac7df799a423] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:00.399793 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-46f3e8b4-830d-40aa-a66b-9310cf4351dd tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bc441f92ae4068b4d02751c57c1c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c45298bec1a45a5a54eb40452a581bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:00.407693 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-46f3e8b4-830d-40aa-a66b-9310cf4351dd tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423" status: 200 len: 1214 microversion: 2.1 time: 0.077957 Oct 17 14:29:00.408286 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3267/6395] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:00 2022] GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423 => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:01.431520 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-30737e2b-bf8f-4d67-a595-1c0305e28ab1 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:01.432197 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-30737e2b-bf8f-4d67-a595-1c0305e28ab1 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] [instance: b2c388d0-04a3-42c0-87fe-ac7df799a423] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:01.516057 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-30737e2b-bf8f-4d67-a595-1c0305e28ab1 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bc441f92ae4068b4d02751c57c1c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c45298bec1a45a5a54eb40452a581bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:01.523572 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-30737e2b-bf8f-4d67-a595-1c0305e28ab1 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423" status: 200 len: 1214 microversion: 2.1 time: 0.096062 Oct 17 14:29:01.524594 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3129/6396] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:01 2022] GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423 => generated 1214 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:02.547873 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-60f53148-2f0e-4556-9e0c-56153df3dea5 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:02.548477 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-60f53148-2f0e-4556-9e0c-56153df3dea5 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] [instance: b2c388d0-04a3-42c0-87fe-ac7df799a423] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:02.609742 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-60f53148-2f0e-4556-9e0c-56153df3dea5 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bc441f92ae4068b4d02751c57c1c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c45298bec1a45a5a54eb40452a581bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:02.620858 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-60f53148-2f0e-4556-9e0c-56153df3dea5 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423" status: 200 len: 1214 microversion: 2.1 time: 0.076729 Oct 17 14:29:02.621451 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3268/6397] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:02 2022] GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423 => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:29:03.647585 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-11e79bba-e5c2-4c70-8c9a-eeeae51dbb63 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:03.648420 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-11e79bba-e5c2-4c70-8c9a-eeeae51dbb63 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] [instance: b2c388d0-04a3-42c0-87fe-ac7df799a423] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:03.653622 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:29:03.663938 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-11e79bba-e5c2-4c70-8c9a-eeeae51dbb63 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:03.664587 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-11e79bba-e5c2-4c70-8c9a-eeeae51dbb63 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:03.665261 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-11e79bba-e5c2-4c70-8c9a-eeeae51dbb63 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:03.666366 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-11e79bba-e5c2-4c70-8c9a-eeeae51dbb63 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:03.667462 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-11e79bba-e5c2-4c70-8c9a-eeeae51dbb63 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:03.668223 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-11e79bba-e5c2-4c70-8c9a-eeeae51dbb63 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:03.734078 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-11e79bba-e5c2-4c70-8c9a-eeeae51dbb63 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bc441f92ae4068b4d02751c57c1c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c45298bec1a45a5a54eb40452a581bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:03.742169 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-11e79bba-e5c2-4c70-8c9a-eeeae51dbb63 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423" status: 200 len: 1218 microversion: 2.1 time: 0.101205 Oct 17 14:29:03.742744 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3130/6398] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:03 2022] GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423 => generated 1218 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:04.765647 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-403354fd-79dc-4510-9ca4-e77fb957a569 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:04.766251 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-403354fd-79dc-4510-9ca4-e77fb957a569 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] [instance: b2c388d0-04a3-42c0-87fe-ac7df799a423] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:04.774384 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-403354fd-79dc-4510-9ca4-e77fb957a569 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:04.774849 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-403354fd-79dc-4510-9ca4-e77fb957a569 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:04.775347 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-403354fd-79dc-4510-9ca4-e77fb957a569 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:04.776052 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-403354fd-79dc-4510-9ca4-e77fb957a569 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:04.776815 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-403354fd-79dc-4510-9ca4-e77fb957a569 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:04.777477 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-403354fd-79dc-4510-9ca4-e77fb957a569 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:04.840936 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-403354fd-79dc-4510-9ca4-e77fb957a569 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bc441f92ae4068b4d02751c57c1c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c45298bec1a45a5a54eb40452a581bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:04.848954 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-403354fd-79dc-4510-9ca4-e77fb957a569 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423" status: 200 len: 1272 microversion: 2.1 time: 0.087407 Oct 17 14:29:04.849537 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3269/6399] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:04 2022] GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423 => generated 1272 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:05.861227 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-e63a2ab1-9867-4860-8f6b-c4770c116379 req-a72a969a-5302-4eec-a11f-544da8be399f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2c388d0-04a3-42c0-87fe-ac7df799a423", "tag": "f8691cbc-519f-426d-ba46-7b0c5dccb9ef"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:29:05.873447 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9298003c-b347-4a77-863f-8cd9e9e45cd1 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:05.874648 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9298003c-b347-4a77-863f-8cd9e9e45cd1 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] [instance: b2c388d0-04a3-42c0-87fe-ac7df799a423] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:05.875129 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-e63a2ab1-9867-4860-8f6b-c4770c116379 req-a72a969a-5302-4eec-a11f-544da8be399f service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:05.875710 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-e63a2ab1-9867-4860-8f6b-c4770c116379 req-a72a969a-5302-4eec-a11f-544da8be399f service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:05.876223 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-e63a2ab1-9867-4860-8f6b-c4770c116379 req-a72a969a-5302-4eec-a11f-544da8be399f service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:05.881552 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9298003c-b347-4a77-863f-8cd9e9e45cd1 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:05.882233 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9298003c-b347-4a77-863f-8cd9e9e45cd1 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:05.882820 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9298003c-b347-4a77-863f-8cd9e9e45cd1 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:05.883706 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9298003c-b347-4a77-863f-8cd9e9e45cd1 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:05.884314 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9298003c-b347-4a77-863f-8cd9e9e45cd1 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:05.884903 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9298003c-b347-4a77-863f-8cd9e9e45cd1 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:05.889975 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-e63a2ab1-9867-4860-8f6b-c4770c116379 req-a72a969a-5302-4eec-a11f-544da8be399f service nova] Creating event network-changed:f8691cbc-519f-426d-ba46-7b0c5dccb9ef for instance b2c388d0-04a3-42c0-87fe-ac7df799a423 on n-h1-854247-14 Oct 17 14:29:05.895417 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-e63a2ab1-9867-4860-8f6b-c4770c116379 req-a72a969a-5302-4eec-a11f-544da8be399f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037969 Oct 17 14:29:05.896239 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3131/6400] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:29:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:29:06.020932 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9298003c-b347-4a77-863f-8cd9e9e45cd1 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bc441f92ae4068b4d02751c57c1c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c45298bec1a45a5a54eb40452a581bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:06.029302 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9298003c-b347-4a77-863f-8cd9e9e45cd1 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423" status: 200 len: 1314 microversion: 2.1 time: 0.160334 Oct 17 14:29:06.030107 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3270/6401] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:05 2022] GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:29:07.056308 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c9216ad8-c25b-40a6-81c7-6e9eb4d6dbd7 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:07.057167 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c9216ad8-c25b-40a6-81c7-6e9eb4d6dbd7 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] [instance: b2c388d0-04a3-42c0-87fe-ac7df799a423] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:07.064218 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c9216ad8-c25b-40a6-81c7-6e9eb4d6dbd7 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:07.064719 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c9216ad8-c25b-40a6-81c7-6e9eb4d6dbd7 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:07.065181 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c9216ad8-c25b-40a6-81c7-6e9eb4d6dbd7 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:07.065894 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c9216ad8-c25b-40a6-81c7-6e9eb4d6dbd7 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:07.066367 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c9216ad8-c25b-40a6-81c7-6e9eb4d6dbd7 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:07.066809 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c9216ad8-c25b-40a6-81c7-6e9eb4d6dbd7 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:07.204785 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c9216ad8-c25b-40a6-81c7-6e9eb4d6dbd7 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bc441f92ae4068b4d02751c57c1c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c45298bec1a45a5a54eb40452a581bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:07.212764 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c9216ad8-c25b-40a6-81c7-6e9eb4d6dbd7 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423" status: 200 len: 1314 microversion: 2.1 time: 0.162741 Oct 17 14:29:07.213333 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3132/6402] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:07 2022] GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:08.238925 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0a845833-156e-47a3-938e-b3ac8b256a70 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:08.239757 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0a845833-156e-47a3-938e-b3ac8b256a70 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] [instance: b2c388d0-04a3-42c0-87fe-ac7df799a423] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:08.243482 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:29:08.251625 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0a845833-156e-47a3-938e-b3ac8b256a70 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:08.252290 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0a845833-156e-47a3-938e-b3ac8b256a70 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:08.252890 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0a845833-156e-47a3-938e-b3ac8b256a70 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:08.253873 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0a845833-156e-47a3-938e-b3ac8b256a70 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:08.254507 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0a845833-156e-47a3-938e-b3ac8b256a70 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:08.255093 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0a845833-156e-47a3-938e-b3ac8b256a70 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:08.261903 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=66 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:29:08.394553 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0a845833-156e-47a3-938e-b3ac8b256a70 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bc441f92ae4068b4d02751c57c1c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c45298bec1a45a5a54eb40452a581bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:08.402976 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0a845833-156e-47a3-938e-b3ac8b256a70 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423" status: 200 len: 1314 microversion: 2.1 time: 0.169456 Oct 17 14:29:08.403604 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3271/6403] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:08 2022] GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:09.426416 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ed356d8a-f449-4867-96e6-bdecd7807b2e tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:09.427190 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ed356d8a-f449-4867-96e6-bdecd7807b2e tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] [instance: b2c388d0-04a3-42c0-87fe-ac7df799a423] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:09.430204 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:29:09.435884 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ed356d8a-f449-4867-96e6-bdecd7807b2e tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:09.436389 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ed356d8a-f449-4867-96e6-bdecd7807b2e tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:09.436864 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ed356d8a-f449-4867-96e6-bdecd7807b2e tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:09.437594 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ed356d8a-f449-4867-96e6-bdecd7807b2e tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:09.438019 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ed356d8a-f449-4867-96e6-bdecd7807b2e tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:09.438454 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ed356d8a-f449-4867-96e6-bdecd7807b2e tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:09.572907 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ed356d8a-f449-4867-96e6-bdecd7807b2e tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bc441f92ae4068b4d02751c57c1c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c45298bec1a45a5a54eb40452a581bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:09.581126 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ed356d8a-f449-4867-96e6-bdecd7807b2e tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423" status: 200 len: 1314 microversion: 2.1 time: 0.158857 Oct 17 14:29:09.581663 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3133/6404] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:09 2022] GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:10.604871 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4bfb3eca-ccd6-4a1b-b95b-781fce05eeb5 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:10.605482 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4bfb3eca-ccd6-4a1b-b95b-781fce05eeb5 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] [instance: b2c388d0-04a3-42c0-87fe-ac7df799a423] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:10.607419 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=5 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:29:10.614132 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4bfb3eca-ccd6-4a1b-b95b-781fce05eeb5 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:10.614614 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4bfb3eca-ccd6-4a1b-b95b-781fce05eeb5 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:10.615043 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4bfb3eca-ccd6-4a1b-b95b-781fce05eeb5 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:10.615764 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4bfb3eca-ccd6-4a1b-b95b-781fce05eeb5 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:10.616215 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4bfb3eca-ccd6-4a1b-b95b-781fce05eeb5 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:10.616634 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4bfb3eca-ccd6-4a1b-b95b-781fce05eeb5 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:10.756003 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4bfb3eca-ccd6-4a1b-b95b-781fce05eeb5 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bc441f92ae4068b4d02751c57c1c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c45298bec1a45a5a54eb40452a581bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:10.768045 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4bfb3eca-ccd6-4a1b-b95b-781fce05eeb5 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423" status: 200 len: 1314 microversion: 2.1 time: 0.166871 Oct 17 14:29:10.768862 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3272/6405] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:10 2022] GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:11.392844 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-f8c3e883-328a-46e7-ad65-112829e373ad req-b43d2b96-f26f-48b8-841b-bdbb9e17d51c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2c388d0-04a3-42c0-87fe-ac7df799a423", "name": "network-vif-plugged", "status": "completed", "tag": "f8691cbc-519f-426d-ba46-7b0c5dccb9ef"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:29:11.403956 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-f8c3e883-328a-46e7-ad65-112829e373ad req-b43d2b96-f26f-48b8-841b-bdbb9e17d51c service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:11.404464 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-f8c3e883-328a-46e7-ad65-112829e373ad req-b43d2b96-f26f-48b8-841b-bdbb9e17d51c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:11.404883 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-f8c3e883-328a-46e7-ad65-112829e373ad req-b43d2b96-f26f-48b8-841b-bdbb9e17d51c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:11.416888 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-f8c3e883-328a-46e7-ad65-112829e373ad req-b43d2b96-f26f-48b8-841b-bdbb9e17d51c service nova] Creating event network-vif-plugged:f8691cbc-519f-426d-ba46-7b0c5dccb9ef for instance b2c388d0-04a3-42c0-87fe-ac7df799a423 on n-h1-854247-14 Oct 17 14:29:11.421981 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-f8c3e883-328a-46e7-ad65-112829e373ad req-b43d2b96-f26f-48b8-841b-bdbb9e17d51c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033017 Oct 17 14:29:11.422743 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3134/6406] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:29:11.795125 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-90710816-0821-4b04-aa74-ee4351639d63 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:11.795748 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-90710816-0821-4b04-aa74-ee4351639d63 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] [instance: b2c388d0-04a3-42c0-87fe-ac7df799a423] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:11.803016 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-90710816-0821-4b04-aa74-ee4351639d63 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:11.803535 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-90710816-0821-4b04-aa74-ee4351639d63 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:11.803976 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-90710816-0821-4b04-aa74-ee4351639d63 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:11.804660 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-90710816-0821-4b04-aa74-ee4351639d63 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:11.805112 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-90710816-0821-4b04-aa74-ee4351639d63 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:11.805530 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-90710816-0821-4b04-aa74-ee4351639d63 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:11.940982 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-90710816-0821-4b04-aa74-ee4351639d63 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bc441f92ae4068b4d02751c57c1c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c45298bec1a45a5a54eb40452a581bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:11.951798 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-90710816-0821-4b04-aa74-ee4351639d63 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423" status: 200 len: 1314 microversion: 2.1 time: 0.161103 Oct 17 14:29:11.952383 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3273/6407] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:11 2022] GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:12.974628 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=4 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:29:12.981905 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ed61f0af-8977-4a59-93ab-bba70f2ceb10 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:12.982638 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ed61f0af-8977-4a59-93ab-bba70f2ceb10 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] [instance: b2c388d0-04a3-42c0-87fe-ac7df799a423] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:12.989613 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ed61f0af-8977-4a59-93ab-bba70f2ceb10 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:12.990112 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ed61f0af-8977-4a59-93ab-bba70f2ceb10 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:12.990582 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ed61f0af-8977-4a59-93ab-bba70f2ceb10 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:12.991344 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ed61f0af-8977-4a59-93ab-bba70f2ceb10 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:12.991809 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ed61f0af-8977-4a59-93ab-bba70f2ceb10 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:12.992233 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ed61f0af-8977-4a59-93ab-bba70f2ceb10 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:13.134677 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ed61f0af-8977-4a59-93ab-bba70f2ceb10 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bc441f92ae4068b4d02751c57c1c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c45298bec1a45a5a54eb40452a581bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:13.143144 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ed61f0af-8977-4a59-93ab-bba70f2ceb10 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423" status: 200 len: 1501 microversion: 2.1 time: 0.170296 Oct 17 14:29:13.143773 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3135/6408] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:12 2022] GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423 => generated 1501 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:13.166200 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-27b9ea04-ec60-43d0-8433-e0682ff58219 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:29:13.168773 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-27b9ea04-ec60-43d0-8433-e0682ff58219 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] [instance: b2c388d0-04a3-42c0-87fe-ac7df799a423] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:13.170717 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=12 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:29:13.177419 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-27b9ea04-ec60-43d0-8433-e0682ff58219 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:13.177908 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-27b9ea04-ec60-43d0-8433-e0682ff58219 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:13.178346 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-27b9ea04-ec60-43d0-8433-e0682ff58219 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:13.179041 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-27b9ea04-ec60-43d0-8433-e0682ff58219 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:13.179510 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-27b9ea04-ec60-43d0-8433-e0682ff58219 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:13.179932 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-27b9ea04-ec60-43d0-8433-e0682ff58219 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:13.210867 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-27b9ea04-ec60-43d0-8433-e0682ff58219 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '11bc441f92ae4068b4d02751c57c1c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c45298bec1a45a5a54eb40452a581bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:13.216543 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-27b9ea04-ec60-43d0-8433-e0682ff58219 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] [instance: b2c388d0-04a3-42c0-87fe-ac7df799a423] Old instance type m1.heat2, new instance type m1.heat {{(pid=127016) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 17 14:29:13.223106 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-27b9ea04-ec60-43d0-8433-e0682ff58219 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:29:13.223564 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-27b9ea04-ec60-43d0-8433-e0682ff58219 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:29:13.224039 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-27b9ea04-ec60-43d0-8433-e0682ff58219 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:29:13.224447 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-27b9ea04-ec60-43d0-8433-e0682ff58219 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:29:13.224855 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-27b9ea04-ec60-43d0-8433-e0682ff58219 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:29:13.295247 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-27b9ea04-ec60-43d0-8433-e0682ff58219 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] 10.222.0.79 "POST /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423/action" status: 202 len: 0 microversion: 2.1 time: 0.132959 Oct 17 14:29:13.295887 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3274/6409] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:29:13 2022] POST /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:29:13.304202 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5a537424-0388-4b54-9c6a-8d8d05f6c32a tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:13.304824 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5a537424-0388-4b54-9c6a-8d8d05f6c32a tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] [instance: b2c388d0-04a3-42c0-87fe-ac7df799a423] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:13.311352 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5a537424-0388-4b54-9c6a-8d8d05f6c32a tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:13.311859 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5a537424-0388-4b54-9c6a-8d8d05f6c32a tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:13.312310 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5a537424-0388-4b54-9c6a-8d8d05f6c32a tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:13.313008 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5a537424-0388-4b54-9c6a-8d8d05f6c32a tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:13.313479 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5a537424-0388-4b54-9c6a-8d8d05f6c32a tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:13.313906 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5a537424-0388-4b54-9c6a-8d8d05f6c32a tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:13.449889 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5a537424-0388-4b54-9c6a-8d8d05f6c32a tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bc441f92ae4068b4d02751c57c1c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c45298bec1a45a5a54eb40452a581bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:13.457871 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5a537424-0388-4b54-9c6a-8d8d05f6c32a tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423" status: 200 len: 1510 microversion: 2.1 time: 0.157639 Oct 17 14:29:13.458454 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3136/6410] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:13 2022] GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423 => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:14.486575 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c885a507-d30d-441a-a5de-19696f843392 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:14.487285 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c885a507-d30d-441a-a5de-19696f843392 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] [instance: b2c388d0-04a3-42c0-87fe-ac7df799a423] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:14.494476 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c885a507-d30d-441a-a5de-19696f843392 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:14.495075 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c885a507-d30d-441a-a5de-19696f843392 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:14.495541 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c885a507-d30d-441a-a5de-19696f843392 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:14.496240 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c885a507-d30d-441a-a5de-19696f843392 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:14.496676 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c885a507-d30d-441a-a5de-19696f843392 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:14.497093 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c885a507-d30d-441a-a5de-19696f843392 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:14.638369 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c885a507-d30d-441a-a5de-19696f843392 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bc441f92ae4068b4d02751c57c1c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c45298bec1a45a5a54eb40452a581bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:14.646600 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c885a507-d30d-441a-a5de-19696f843392 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423" status: 200 len: 1510 microversion: 2.1 time: 0.167345 Oct 17 14:29:14.647181 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3275/6411] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:14 2022] GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423 => generated 1510 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:15.670865 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-64d160da-de9a-490b-8ae5-f3c32e7c0d86 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:15.671559 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-64d160da-de9a-490b-8ae5-f3c32e7c0d86 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] [instance: b2c388d0-04a3-42c0-87fe-ac7df799a423] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:15.679082 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-64d160da-de9a-490b-8ae5-f3c32e7c0d86 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:15.679626 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-64d160da-de9a-490b-8ae5-f3c32e7c0d86 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:15.680063 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-64d160da-de9a-490b-8ae5-f3c32e7c0d86 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:15.680808 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-64d160da-de9a-490b-8ae5-f3c32e7c0d86 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:15.681276 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-64d160da-de9a-490b-8ae5-f3c32e7c0d86 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:15.681715 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-64d160da-de9a-490b-8ae5-f3c32e7c0d86 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:15.817634 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-64d160da-de9a-490b-8ae5-f3c32e7c0d86 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bc441f92ae4068b4d02751c57c1c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c45298bec1a45a5a54eb40452a581bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:15.826531 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-64d160da-de9a-490b-8ae5-f3c32e7c0d86 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423" status: 200 len: 1515 microversion: 2.1 time: 0.159646 Oct 17 14:29:15.827146 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3137/6412] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:15 2022] GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:16.854911 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-77f750ae-6138-494e-bb36-47984be5534d tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:16.855555 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-77f750ae-6138-494e-bb36-47984be5534d tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] [instance: b2c388d0-04a3-42c0-87fe-ac7df799a423] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:16.862855 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-77f750ae-6138-494e-bb36-47984be5534d tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:16.863382 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-77f750ae-6138-494e-bb36-47984be5534d tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:16.863820 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-77f750ae-6138-494e-bb36-47984be5534d tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:16.864526 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-77f750ae-6138-494e-bb36-47984be5534d tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:16.865005 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-77f750ae-6138-494e-bb36-47984be5534d tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:16.865432 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-77f750ae-6138-494e-bb36-47984be5534d tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:17.001295 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-77f750ae-6138-494e-bb36-47984be5534d tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bc441f92ae4068b4d02751c57c1c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c45298bec1a45a5a54eb40452a581bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:17.011828 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-77f750ae-6138-494e-bb36-47984be5534d tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423" status: 200 len: 1515 microversion: 2.1 time: 0.163673 Oct 17 14:29:17.012414 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3276/6413] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:16 2022] GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423 => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:18.039690 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-706f3ba5-41fe-4d3d-86ec-48801fcdcd8e tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:18.040774 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-706f3ba5-41fe-4d3d-86ec-48801fcdcd8e tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] [instance: b2c388d0-04a3-42c0-87fe-ac7df799a423] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:18.052692 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-706f3ba5-41fe-4d3d-86ec-48801fcdcd8e tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:18.053524 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-706f3ba5-41fe-4d3d-86ec-48801fcdcd8e tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:18.054279 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-706f3ba5-41fe-4d3d-86ec-48801fcdcd8e tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:18.055533 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-706f3ba5-41fe-4d3d-86ec-48801fcdcd8e tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:18.056313 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-706f3ba5-41fe-4d3d-86ec-48801fcdcd8e tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:18.057260 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-706f3ba5-41fe-4d3d-86ec-48801fcdcd8e tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:18.195784 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-706f3ba5-41fe-4d3d-86ec-48801fcdcd8e tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bc441f92ae4068b4d02751c57c1c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c45298bec1a45a5a54eb40452a581bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:18.204949 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-706f3ba5-41fe-4d3d-86ec-48801fcdcd8e tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423" status: 200 len: 1515 microversion: 2.1 time: 0.172354 Oct 17 14:29:18.205512 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3138/6414] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:18 2022] GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423 => generated 1515 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:19.231466 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-be3cf525-8022-4e7f-8f44-c8fd5f2d3281 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:19.232087 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-be3cf525-8022-4e7f-8f44-c8fd5f2d3281 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] [instance: b2c388d0-04a3-42c0-87fe-ac7df799a423] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:19.239454 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be3cf525-8022-4e7f-8f44-c8fd5f2d3281 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:19.239942 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be3cf525-8022-4e7f-8f44-c8fd5f2d3281 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:19.240380 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be3cf525-8022-4e7f-8f44-c8fd5f2d3281 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:19.241080 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be3cf525-8022-4e7f-8f44-c8fd5f2d3281 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:19.241537 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be3cf525-8022-4e7f-8f44-c8fd5f2d3281 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:19.241966 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be3cf525-8022-4e7f-8f44-c8fd5f2d3281 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:19.383911 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-be3cf525-8022-4e7f-8f44-c8fd5f2d3281 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bc441f92ae4068b4d02751c57c1c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c45298bec1a45a5a54eb40452a581bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:19.395690 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-be3cf525-8022-4e7f-8f44-c8fd5f2d3281 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423" status: 200 len: 1515 microversion: 2.1 time: 0.169645 Oct 17 14:29:19.396485 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3277/6415] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:19 2022] GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423 => generated 1515 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:20.422377 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-054d4b7a-a4b4-4f69-8353-eecbbdf9cc78 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:20.423028 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-054d4b7a-a4b4-4f69-8353-eecbbdf9cc78 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] [instance: b2c388d0-04a3-42c0-87fe-ac7df799a423] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:20.431647 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-054d4b7a-a4b4-4f69-8353-eecbbdf9cc78 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:20.432285 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-054d4b7a-a4b4-4f69-8353-eecbbdf9cc78 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:20.433004 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-054d4b7a-a4b4-4f69-8353-eecbbdf9cc78 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:20.433879 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-054d4b7a-a4b4-4f69-8353-eecbbdf9cc78 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:20.434438 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-054d4b7a-a4b4-4f69-8353-eecbbdf9cc78 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:20.434954 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-054d4b7a-a4b4-4f69-8353-eecbbdf9cc78 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:20.580609 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-054d4b7a-a4b4-4f69-8353-eecbbdf9cc78 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bc441f92ae4068b4d02751c57c1c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c45298bec1a45a5a54eb40452a581bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:20.589054 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-054d4b7a-a4b4-4f69-8353-eecbbdf9cc78 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423" status: 200 len: 1515 microversion: 2.1 time: 0.171432 Oct 17 14:29:20.589625 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3139/6416] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:20 2022] GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423 => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:21.616086 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-57f15e17-8063-4cc0-b694-39842d742263 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:21.616676 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-57f15e17-8063-4cc0-b694-39842d742263 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] [instance: b2c388d0-04a3-42c0-87fe-ac7df799a423] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:21.625273 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-57f15e17-8063-4cc0-b694-39842d742263 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:21.625754 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-57f15e17-8063-4cc0-b694-39842d742263 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:21.626180 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-57f15e17-8063-4cc0-b694-39842d742263 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:21.626860 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-57f15e17-8063-4cc0-b694-39842d742263 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:21.627345 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-57f15e17-8063-4cc0-b694-39842d742263 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:21.627765 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-57f15e17-8063-4cc0-b694-39842d742263 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:21.766300 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-57f15e17-8063-4cc0-b694-39842d742263 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bc441f92ae4068b4d02751c57c1c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c45298bec1a45a5a54eb40452a581bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:21.778167 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-57f15e17-8063-4cc0-b694-39842d742263 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423" status: 200 len: 1515 microversion: 2.1 time: 0.168541 Oct 17 14:29:21.778756 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3278/6417] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:21 2022] GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423 => generated 1515 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:22.806026 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2a1802e7-682c-41d6-a6fe-2dd20ed4bec0 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:22.807043 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2a1802e7-682c-41d6-a6fe-2dd20ed4bec0 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] [instance: b2c388d0-04a3-42c0-87fe-ac7df799a423] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:22.819037 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2a1802e7-682c-41d6-a6fe-2dd20ed4bec0 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:22.819969 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2a1802e7-682c-41d6-a6fe-2dd20ed4bec0 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:22.820709 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2a1802e7-682c-41d6-a6fe-2dd20ed4bec0 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:22.821879 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2a1802e7-682c-41d6-a6fe-2dd20ed4bec0 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:22.822664 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2a1802e7-682c-41d6-a6fe-2dd20ed4bec0 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:22.823569 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2a1802e7-682c-41d6-a6fe-2dd20ed4bec0 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:22.966428 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2a1802e7-682c-41d6-a6fe-2dd20ed4bec0 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bc441f92ae4068b4d02751c57c1c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c45298bec1a45a5a54eb40452a581bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:22.975988 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2a1802e7-682c-41d6-a6fe-2dd20ed4bec0 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423" status: 200 len: 1515 microversion: 2.1 time: 0.176633 Oct 17 14:29:22.976569 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3140/6418] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:22 2022] GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423 => generated 1515 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:24.002462 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-87e7c46c-e7a1-4860-8e95-a9e1d018f99e tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:24.003198 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-87e7c46c-e7a1-4860-8e95-a9e1d018f99e tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] [instance: b2c388d0-04a3-42c0-87fe-ac7df799a423] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:24.011740 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-87e7c46c-e7a1-4860-8e95-a9e1d018f99e tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:24.012274 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-87e7c46c-e7a1-4860-8e95-a9e1d018f99e tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:24.012758 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-87e7c46c-e7a1-4860-8e95-a9e1d018f99e tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:24.013526 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-87e7c46c-e7a1-4860-8e95-a9e1d018f99e tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:24.014025 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-87e7c46c-e7a1-4860-8e95-a9e1d018f99e tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:24.014487 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-87e7c46c-e7a1-4860-8e95-a9e1d018f99e tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:24.159276 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-87e7c46c-e7a1-4860-8e95-a9e1d018f99e tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bc441f92ae4068b4d02751c57c1c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c45298bec1a45a5a54eb40452a581bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:24.167792 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-87e7c46c-e7a1-4860-8e95-a9e1d018f99e tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423" status: 200 len: 1515 microversion: 2.1 time: 0.170520 Oct 17 14:29:24.168365 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3279/6419] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:23 2022] GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423 => generated 1515 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:25.191015 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-67a58c5f-a97e-4946-9de6-68d94e7e7963 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:25.191659 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-67a58c5f-a97e-4946-9de6-68d94e7e7963 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] [instance: b2c388d0-04a3-42c0-87fe-ac7df799a423] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:25.199649 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-67a58c5f-a97e-4946-9de6-68d94e7e7963 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:25.200152 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-67a58c5f-a97e-4946-9de6-68d94e7e7963 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:25.200606 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-67a58c5f-a97e-4946-9de6-68d94e7e7963 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:25.201317 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-67a58c5f-a97e-4946-9de6-68d94e7e7963 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:25.201793 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-67a58c5f-a97e-4946-9de6-68d94e7e7963 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:25.202231 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-67a58c5f-a97e-4946-9de6-68d94e7e7963 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:25.347444 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-67a58c5f-a97e-4946-9de6-68d94e7e7963 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bc441f92ae4068b4d02751c57c1c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c45298bec1a45a5a54eb40452a581bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:25.356409 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-67a58c5f-a97e-4946-9de6-68d94e7e7963 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423" status: 200 len: 1515 microversion: 2.1 time: 0.169319 Oct 17 14:29:25.356917 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3141/6420] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:25 2022] GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423 => generated 1515 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:26.381155 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-97029f40-7c72-4e1e-a43e-52aadae480c7 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:26.381808 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-97029f40-7c72-4e1e-a43e-52aadae480c7 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] [instance: b2c388d0-04a3-42c0-87fe-ac7df799a423] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:26.389442 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-97029f40-7c72-4e1e-a43e-52aadae480c7 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:26.389905 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-97029f40-7c72-4e1e-a43e-52aadae480c7 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:26.390357 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-97029f40-7c72-4e1e-a43e-52aadae480c7 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:26.391033 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-97029f40-7c72-4e1e-a43e-52aadae480c7 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:26.391563 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-97029f40-7c72-4e1e-a43e-52aadae480c7 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:26.392109 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-97029f40-7c72-4e1e-a43e-52aadae480c7 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:26.541863 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-97029f40-7c72-4e1e-a43e-52aadae480c7 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bc441f92ae4068b4d02751c57c1c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c45298bec1a45a5a54eb40452a581bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:26.550334 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-97029f40-7c72-4e1e-a43e-52aadae480c7 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423" status: 200 len: 1515 microversion: 2.1 time: 0.173631 Oct 17 14:29:26.550918 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3280/6421] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:26 2022] GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423 => generated 1515 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:27.574732 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-255ec8d3-e85a-432b-922c-5c147861f937 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:27.575530 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-255ec8d3-e85a-432b-922c-5c147861f937 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] [instance: b2c388d0-04a3-42c0-87fe-ac7df799a423] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:27.582488 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-255ec8d3-e85a-432b-922c-5c147861f937 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:27.582990 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-255ec8d3-e85a-432b-922c-5c147861f937 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:27.583463 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-255ec8d3-e85a-432b-922c-5c147861f937 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:27.584163 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-255ec8d3-e85a-432b-922c-5c147861f937 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:27.584625 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-255ec8d3-e85a-432b-922c-5c147861f937 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:27.585057 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-255ec8d3-e85a-432b-922c-5c147861f937 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:27.719487 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-255ec8d3-e85a-432b-922c-5c147861f937 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bc441f92ae4068b4d02751c57c1c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c45298bec1a45a5a54eb40452a581bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:27.728001 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-255ec8d3-e85a-432b-922c-5c147861f937 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423" status: 200 len: 1515 microversion: 2.1 time: 0.157805 Oct 17 14:29:27.728577 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3142/6422] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:27 2022] GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:28.754881 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b2c8bb1a-af32-44bb-81f8-f02452fd0379 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:28.755749 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b2c8bb1a-af32-44bb-81f8-f02452fd0379 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] [instance: b2c388d0-04a3-42c0-87fe-ac7df799a423] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:28.767451 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b2c8bb1a-af32-44bb-81f8-f02452fd0379 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:28.768289 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b2c8bb1a-af32-44bb-81f8-f02452fd0379 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:28.768966 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b2c8bb1a-af32-44bb-81f8-f02452fd0379 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:28.770034 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b2c8bb1a-af32-44bb-81f8-f02452fd0379 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:28.770707 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b2c8bb1a-af32-44bb-81f8-f02452fd0379 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:28.771423 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b2c8bb1a-af32-44bb-81f8-f02452fd0379 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:28.916580 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b2c8bb1a-af32-44bb-81f8-f02452fd0379 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bc441f92ae4068b4d02751c57c1c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c45298bec1a45a5a54eb40452a581bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:28.925080 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b2c8bb1a-af32-44bb-81f8-f02452fd0379 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423" status: 200 len: 1515 microversion: 2.1 time: 0.176941 Oct 17 14:29:28.925622 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3281/6423] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:28 2022] GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423 => generated 1515 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:29.952023 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-cc3fca2b-bc2f-4124-a36d-4881218c6b30 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:29.952752 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-cc3fca2b-bc2f-4124-a36d-4881218c6b30 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] [instance: b2c388d0-04a3-42c0-87fe-ac7df799a423] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:29.961219 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cc3fca2b-bc2f-4124-a36d-4881218c6b30 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:29.961809 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cc3fca2b-bc2f-4124-a36d-4881218c6b30 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:29.962337 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cc3fca2b-bc2f-4124-a36d-4881218c6b30 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:29.963204 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cc3fca2b-bc2f-4124-a36d-4881218c6b30 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:29.963762 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cc3fca2b-bc2f-4124-a36d-4881218c6b30 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:29.964276 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cc3fca2b-bc2f-4124-a36d-4881218c6b30 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:30.124210 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-cc3fca2b-bc2f-4124-a36d-4881218c6b30 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bc441f92ae4068b4d02751c57c1c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c45298bec1a45a5a54eb40452a581bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:30.132390 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-cc3fca2b-bc2f-4124-a36d-4881218c6b30 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423" status: 200 len: 1515 microversion: 2.1 time: 0.186328 Oct 17 14:29:30.132972 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3143/6424] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:29 2022] GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423 => generated 1515 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:31.158961 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-38459ebc-51c0-4f38-b2cc-55d6501ba0f7 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:31.159799 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-38459ebc-51c0-4f38-b2cc-55d6501ba0f7 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] [instance: b2c388d0-04a3-42c0-87fe-ac7df799a423] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:31.169338 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-38459ebc-51c0-4f38-b2cc-55d6501ba0f7 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:31.170001 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-38459ebc-51c0-4f38-b2cc-55d6501ba0f7 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:31.170581 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-38459ebc-51c0-4f38-b2cc-55d6501ba0f7 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:31.171532 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-38459ebc-51c0-4f38-b2cc-55d6501ba0f7 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:31.172135 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-38459ebc-51c0-4f38-b2cc-55d6501ba0f7 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:31.172696 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-38459ebc-51c0-4f38-b2cc-55d6501ba0f7 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:31.310113 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-38459ebc-51c0-4f38-b2cc-55d6501ba0f7 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bc441f92ae4068b4d02751c57c1c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c45298bec1a45a5a54eb40452a581bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:31.318269 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-38459ebc-51c0-4f38-b2cc-55d6501ba0f7 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423" status: 200 len: 1515 microversion: 2.1 time: 0.164989 Oct 17 14:29:31.318827 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3282/6425] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:31 2022] GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423 => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:32.345866 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2a1423ae-64c4-494f-9aff-10fe1839d84e tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:32.346691 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2a1423ae-64c4-494f-9aff-10fe1839d84e tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] [instance: b2c388d0-04a3-42c0-87fe-ac7df799a423] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:32.357718 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2a1423ae-64c4-494f-9aff-10fe1839d84e tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:32.358215 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2a1423ae-64c4-494f-9aff-10fe1839d84e tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:32.358670 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2a1423ae-64c4-494f-9aff-10fe1839d84e tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:32.359418 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2a1423ae-64c4-494f-9aff-10fe1839d84e tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:32.359884 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2a1423ae-64c4-494f-9aff-10fe1839d84e tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:32.360349 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2a1423ae-64c4-494f-9aff-10fe1839d84e tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:32.507777 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2a1423ae-64c4-494f-9aff-10fe1839d84e tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bc441f92ae4068b4d02751c57c1c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c45298bec1a45a5a54eb40452a581bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:32.515977 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2a1423ae-64c4-494f-9aff-10fe1839d84e tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423" status: 200 len: 1515 microversion: 2.1 time: 0.176508 Oct 17 14:29:32.516528 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3144/6426] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:32 2022] GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423 => generated 1515 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:33.543708 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-be3ea15e-4ddb-4c88-8b0a-fef86e222188 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:33.544778 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-be3ea15e-4ddb-4c88-8b0a-fef86e222188 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] [instance: b2c388d0-04a3-42c0-87fe-ac7df799a423] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:33.552096 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be3ea15e-4ddb-4c88-8b0a-fef86e222188 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:33.552584 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be3ea15e-4ddb-4c88-8b0a-fef86e222188 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:33.553023 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be3ea15e-4ddb-4c88-8b0a-fef86e222188 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:33.553726 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be3ea15e-4ddb-4c88-8b0a-fef86e222188 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:33.554186 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be3ea15e-4ddb-4c88-8b0a-fef86e222188 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:33.554609 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-be3ea15e-4ddb-4c88-8b0a-fef86e222188 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:33.694515 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-be3ea15e-4ddb-4c88-8b0a-fef86e222188 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bc441f92ae4068b4d02751c57c1c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c45298bec1a45a5a54eb40452a581bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:33.702601 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-be3ea15e-4ddb-4c88-8b0a-fef86e222188 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423" status: 200 len: 1515 microversion: 2.1 time: 0.165458 Oct 17 14:29:33.703188 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3283/6427] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:33 2022] GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:34.729942 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-74591755-9849-49ca-898b-70117306f608 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:34.731088 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-74591755-9849-49ca-898b-70117306f608 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] [instance: b2c388d0-04a3-42c0-87fe-ac7df799a423] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:34.743560 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-74591755-9849-49ca-898b-70117306f608 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:34.744425 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-74591755-9849-49ca-898b-70117306f608 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:34.745291 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-74591755-9849-49ca-898b-70117306f608 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:34.746450 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-74591755-9849-49ca-898b-70117306f608 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:34.747268 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-74591755-9849-49ca-898b-70117306f608 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:34.748086 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-74591755-9849-49ca-898b-70117306f608 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:34.750871 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=83 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:29:34.882244 n-d-854247-14 devstack@n-api.service[127017]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 14:29:34.882683 n-d-854247-14 devstack@n-api.service[127017]: Mon Oct 17 14:29:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423 (ip 10.222.0.79) !!! Oct 17 14:29:34.891970 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-74591755-9849-49ca-898b-70117306f608 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bc441f92ae4068b4d02751c57c1c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c45298bec1a45a5a54eb40452a581bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:34.899929 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-74591755-9849-49ca-898b-70117306f608 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423" status: 200 len: 1515 microversion: 2.1 time: 0.176825 Oct 17 14:29:34.900700 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3145/6428] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:34 2022] GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423 => generated 1515 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:35.926761 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6a503ead-1ab9-4028-9c0c-9a894fa913f1 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:35.927413 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6a503ead-1ab9-4028-9c0c-9a894fa913f1 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] [instance: b2c388d0-04a3-42c0-87fe-ac7df799a423] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:35.930259 n-d-854247-14 devstack@n-api.service[127016]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 14:29:35.930427 n-d-854247-14 devstack@n-api.service[127016]: Mon Oct 17 14:29:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423 (ip 10.222.0.79) !!! Oct 17 14:29:35.937966 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6a503ead-1ab9-4028-9c0c-9a894fa913f1 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:35.938578 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6a503ead-1ab9-4028-9c0c-9a894fa913f1 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:35.939068 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6a503ead-1ab9-4028-9c0c-9a894fa913f1 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:35.939915 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6a503ead-1ab9-4028-9c0c-9a894fa913f1 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:35.940449 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6a503ead-1ab9-4028-9c0c-9a894fa913f1 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:35.940950 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6a503ead-1ab9-4028-9c0c-9a894fa913f1 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:36.079970 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6a503ead-1ab9-4028-9c0c-9a894fa913f1 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bc441f92ae4068b4d02751c57c1c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c45298bec1a45a5a54eb40452a581bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:36.091063 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6a503ead-1ab9-4028-9c0c-9a894fa913f1 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423" status: 200 len: 1515 microversion: 2.1 time: 0.169857 Oct 17 14:29:36.091684 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3284/6429] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:35 2022] GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423 => generated 1515 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:37.118332 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c311f885-0f62-4949-b294-55941c9e9ec6 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:37.119427 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c311f885-0f62-4949-b294-55941c9e9ec6 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] [instance: b2c388d0-04a3-42c0-87fe-ac7df799a423] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:37.128784 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c311f885-0f62-4949-b294-55941c9e9ec6 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:37.129284 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c311f885-0f62-4949-b294-55941c9e9ec6 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:37.129735 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c311f885-0f62-4949-b294-55941c9e9ec6 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:37.130442 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c311f885-0f62-4949-b294-55941c9e9ec6 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:37.130912 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c311f885-0f62-4949-b294-55941c9e9ec6 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:37.131383 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c311f885-0f62-4949-b294-55941c9e9ec6 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:37.268902 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c311f885-0f62-4949-b294-55941c9e9ec6 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bc441f92ae4068b4d02751c57c1c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c45298bec1a45a5a54eb40452a581bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:37.276834 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c311f885-0f62-4949-b294-55941c9e9ec6 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423" status: 200 len: 1515 microversion: 2.1 time: 0.165183 Oct 17 14:29:37.277450 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3146/6430] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:37 2022] GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:38.301768 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9aa8583a-2dc0-4592-ac77-0c5d00dc0dea tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:38.302375 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9aa8583a-2dc0-4592-ac77-0c5d00dc0dea tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] [instance: b2c388d0-04a3-42c0-87fe-ac7df799a423] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:38.305222 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=32 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:29:38.311083 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9aa8583a-2dc0-4592-ac77-0c5d00dc0dea tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:38.311591 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9aa8583a-2dc0-4592-ac77-0c5d00dc0dea tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:38.312023 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9aa8583a-2dc0-4592-ac77-0c5d00dc0dea tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:38.312816 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9aa8583a-2dc0-4592-ac77-0c5d00dc0dea tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:38.313268 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9aa8583a-2dc0-4592-ac77-0c5d00dc0dea tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:38.313688 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9aa8583a-2dc0-4592-ac77-0c5d00dc0dea tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:38.316333 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:29:38.454178 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9aa8583a-2dc0-4592-ac77-0c5d00dc0dea tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bc441f92ae4068b4d02751c57c1c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c45298bec1a45a5a54eb40452a581bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:38.462942 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9aa8583a-2dc0-4592-ac77-0c5d00dc0dea tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423" status: 200 len: 1515 microversion: 2.1 time: 0.165179 Oct 17 14:29:38.463577 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3285/6431] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:38 2022] GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:39.489366 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-59fc701a-fe70-4ee1-b380-87c2a199a2e2 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:39.490184 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-59fc701a-fe70-4ee1-b380-87c2a199a2e2 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] [instance: b2c388d0-04a3-42c0-87fe-ac7df799a423] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:39.493533 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=28 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:29:39.501226 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-59fc701a-fe70-4ee1-b380-87c2a199a2e2 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:39.501926 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-59fc701a-fe70-4ee1-b380-87c2a199a2e2 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:39.502496 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-59fc701a-fe70-4ee1-b380-87c2a199a2e2 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:39.503421 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-59fc701a-fe70-4ee1-b380-87c2a199a2e2 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:39.503984 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-59fc701a-fe70-4ee1-b380-87c2a199a2e2 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:39.504538 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-59fc701a-fe70-4ee1-b380-87c2a199a2e2 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:39.643110 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-59fc701a-fe70-4ee1-b380-87c2a199a2e2 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bc441f92ae4068b4d02751c57c1c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c45298bec1a45a5a54eb40452a581bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:39.653592 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-59fc701a-fe70-4ee1-b380-87c2a199a2e2 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423" status: 200 len: 1515 microversion: 2.1 time: 0.169487 Oct 17 14:29:39.654378 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3147/6432] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:39 2022] GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423 => generated 1515 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:40.687099 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-db2872cc-045a-48c0-bf73-09ca0b64543a tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:40.688115 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-db2872cc-045a-48c0-bf73-09ca0b64543a tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] [instance: b2c388d0-04a3-42c0-87fe-ac7df799a423] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:40.696173 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-db2872cc-045a-48c0-bf73-09ca0b64543a tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:40.696684 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-db2872cc-045a-48c0-bf73-09ca0b64543a tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:40.697093 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-db2872cc-045a-48c0-bf73-09ca0b64543a tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:40.697802 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-db2872cc-045a-48c0-bf73-09ca0b64543a tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:40.698249 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-db2872cc-045a-48c0-bf73-09ca0b64543a tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:40.698681 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-db2872cc-045a-48c0-bf73-09ca0b64543a tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:40.837796 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-db2872cc-045a-48c0-bf73-09ca0b64543a tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bc441f92ae4068b4d02751c57c1c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c45298bec1a45a5a54eb40452a581bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:40.846410 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-db2872cc-045a-48c0-bf73-09ca0b64543a tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423" status: 200 len: 1515 microversion: 2.1 time: 0.165897 Oct 17 14:29:40.846990 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3286/6433] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:40 2022] GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423 => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:41.874021 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-82d9b568-86aa-4a84-96b3-886b2aeb8b83 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:41.875096 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-82d9b568-86aa-4a84-96b3-886b2aeb8b83 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] [instance: b2c388d0-04a3-42c0-87fe-ac7df799a423] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:41.882961 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82d9b568-86aa-4a84-96b3-886b2aeb8b83 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:41.883493 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82d9b568-86aa-4a84-96b3-886b2aeb8b83 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:41.883950 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82d9b568-86aa-4a84-96b3-886b2aeb8b83 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:41.884655 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82d9b568-86aa-4a84-96b3-886b2aeb8b83 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:41.885124 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82d9b568-86aa-4a84-96b3-886b2aeb8b83 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:41.885562 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82d9b568-86aa-4a84-96b3-886b2aeb8b83 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:42.021886 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-82d9b568-86aa-4a84-96b3-886b2aeb8b83 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bc441f92ae4068b4d02751c57c1c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c45298bec1a45a5a54eb40452a581bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:42.030150 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-82d9b568-86aa-4a84-96b3-886b2aeb8b83 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423" status: 200 len: 1515 microversion: 2.1 time: 0.162761 Oct 17 14:29:42.030729 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3148/6434] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:41 2022] GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:42.810901 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-9d7e3722-c04a-4a8b-b6ca-167e821f2c51 req-15ec3a97-23b0-474c-babf-126b2498e98b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2c388d0-04a3-42c0-87fe-ac7df799a423", "name": "network-vif-unplugged", "status": "completed", "tag": "f8691cbc-519f-426d-ba46-7b0c5dccb9ef"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:29:42.829078 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-9d7e3722-c04a-4a8b-b6ca-167e821f2c51 req-15ec3a97-23b0-474c-babf-126b2498e98b service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:42.829608 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-9d7e3722-c04a-4a8b-b6ca-167e821f2c51 req-15ec3a97-23b0-474c-babf-126b2498e98b service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:42.830043 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-9d7e3722-c04a-4a8b-b6ca-167e821f2c51 req-15ec3a97-23b0-474c-babf-126b2498e98b service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:42.841970 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-9d7e3722-c04a-4a8b-b6ca-167e821f2c51 req-15ec3a97-23b0-474c-babf-126b2498e98b service nova] Creating event network-vif-unplugged:f8691cbc-519f-426d-ba46-7b0c5dccb9ef for instance b2c388d0-04a3-42c0-87fe-ac7df799a423 on n-h2-854247-14 Oct 17 14:29:42.847640 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [req-9d7e3722-c04a-4a8b-b6ca-167e821f2c51 req-15ec3a97-23b0-474c-babf-126b2498e98b service nova] Instance b2c388d0-04a3-42c0-87fe-ac7df799a423 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854247-14', 'n-h2-854247-14'} {{(pid=127016) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 14:29:42.859233 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-9d7e3722-c04a-4a8b-b6ca-167e821f2c51 req-15ec3a97-23b0-474c-babf-126b2498e98b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054888 Oct 17 14:29:42.859831 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3287/6435] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:29:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:29:43.054812 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e2b6160c-310b-4c00-a190-560afce16c2a tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:43.055399 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e2b6160c-310b-4c00-a190-560afce16c2a tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] [instance: b2c388d0-04a3-42c0-87fe-ac7df799a423] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:43.062734 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e2b6160c-310b-4c00-a190-560afce16c2a tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:43.063272 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e2b6160c-310b-4c00-a190-560afce16c2a tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:43.063809 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e2b6160c-310b-4c00-a190-560afce16c2a tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:43.064750 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e2b6160c-310b-4c00-a190-560afce16c2a tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:43.065228 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e2b6160c-310b-4c00-a190-560afce16c2a tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:43.065659 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e2b6160c-310b-4c00-a190-560afce16c2a tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:43.324327 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e2b6160c-310b-4c00-a190-560afce16c2a tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bc441f92ae4068b4d02751c57c1c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c45298bec1a45a5a54eb40452a581bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:43.333093 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e2b6160c-310b-4c00-a190-560afce16c2a tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423" status: 200 len: 1514 microversion: 2.1 time: 0.282298 Oct 17 14:29:43.333715 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3149/6436] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:43 2022] GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423 => generated 1514 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:44.362974 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-10a123c3-a601-4518-b960-ab55fb329c8a tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:44.363573 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-10a123c3-a601-4518-b960-ab55fb329c8a tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] [instance: b2c388d0-04a3-42c0-87fe-ac7df799a423] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:44.370474 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-10a123c3-a601-4518-b960-ab55fb329c8a tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:44.370953 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-10a123c3-a601-4518-b960-ab55fb329c8a tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:44.371416 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-10a123c3-a601-4518-b960-ab55fb329c8a tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:44.372106 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-10a123c3-a601-4518-b960-ab55fb329c8a tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:44.372550 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-10a123c3-a601-4518-b960-ab55fb329c8a tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:44.372967 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-10a123c3-a601-4518-b960-ab55fb329c8a tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:44.525925 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-10a123c3-a601-4518-b960-ab55fb329c8a tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bc441f92ae4068b4d02751c57c1c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c45298bec1a45a5a54eb40452a581bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:44.538085 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-10a123c3-a601-4518-b960-ab55fb329c8a tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423" status: 200 len: 1512 microversion: 2.1 time: 0.182451 Oct 17 14:29:44.538871 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3288/6437] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:44 2022] GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423 => generated 1512 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:44.878025 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-e47cb4a2-5a10-4266-97e0-57fa9d67481b req-c5530346-3bf6-4195-bd6c-d5be2266b35f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2c388d0-04a3-42c0-87fe-ac7df799a423", "tag": "f8691cbc-519f-426d-ba46-7b0c5dccb9ef"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:29:44.888672 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-e47cb4a2-5a10-4266-97e0-57fa9d67481b req-c5530346-3bf6-4195-bd6c-d5be2266b35f service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:44.889157 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-e47cb4a2-5a10-4266-97e0-57fa9d67481b req-c5530346-3bf6-4195-bd6c-d5be2266b35f service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:44.889596 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-e47cb4a2-5a10-4266-97e0-57fa9d67481b req-c5530346-3bf6-4195-bd6c-d5be2266b35f service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:44.901472 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-e47cb4a2-5a10-4266-97e0-57fa9d67481b req-c5530346-3bf6-4195-bd6c-d5be2266b35f service nova] Creating event network-changed:f8691cbc-519f-426d-ba46-7b0c5dccb9ef for instance b2c388d0-04a3-42c0-87fe-ac7df799a423 on n-h2-854247-14 Oct 17 14:29:44.907665 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [req-e47cb4a2-5a10-4266-97e0-57fa9d67481b req-c5530346-3bf6-4195-bd6c-d5be2266b35f service nova] Instance b2c388d0-04a3-42c0-87fe-ac7df799a423 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854247-14', 'n-h2-854247-14'} {{(pid=127017) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 14:29:44.920015 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-e47cb4a2-5a10-4266-97e0-57fa9d67481b req-c5530346-3bf6-4195-bd6c-d5be2266b35f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045987 Oct 17 14:29:44.920777 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3150/6438] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:29:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:29:45.565443 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9c521a41-798d-4d08-b99b-8553ce90b1ef tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:45.566045 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9c521a41-798d-4d08-b99b-8553ce90b1ef tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] [instance: b2c388d0-04a3-42c0-87fe-ac7df799a423] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:45.573435 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c521a41-798d-4d08-b99b-8553ce90b1ef tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:45.573926 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c521a41-798d-4d08-b99b-8553ce90b1ef tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:45.574372 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c521a41-798d-4d08-b99b-8553ce90b1ef tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:45.575076 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c521a41-798d-4d08-b99b-8553ce90b1ef tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:45.575549 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c521a41-798d-4d08-b99b-8553ce90b1ef tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:45.575995 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c521a41-798d-4d08-b99b-8553ce90b1ef tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:45.716944 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9c521a41-798d-4d08-b99b-8553ce90b1ef tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bc441f92ae4068b4d02751c57c1c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c45298bec1a45a5a54eb40452a581bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:45.725555 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9c521a41-798d-4d08-b99b-8553ce90b1ef tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423" status: 200 len: 1509 microversion: 2.1 time: 0.164412 Oct 17 14:29:45.726144 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3289/6439] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:45 2022] GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423 => generated 1509 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:45.749302 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ed2235a5-5b51-4c2e-80c3-097c00ceb4d2 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:45.749941 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ed2235a5-5b51-4c2e-80c3-097c00ceb4d2 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] [instance: b2c388d0-04a3-42c0-87fe-ac7df799a423] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:45.757379 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ed2235a5-5b51-4c2e-80c3-097c00ceb4d2 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:45.757898 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ed2235a5-5b51-4c2e-80c3-097c00ceb4d2 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:45.758360 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ed2235a5-5b51-4c2e-80c3-097c00ceb4d2 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:45.759090 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ed2235a5-5b51-4c2e-80c3-097c00ceb4d2 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:45.759692 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ed2235a5-5b51-4c2e-80c3-097c00ceb4d2 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:45.760131 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ed2235a5-5b51-4c2e-80c3-097c00ceb4d2 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:45.787638 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ed2235a5-5b51-4c2e-80c3-097c00ceb4d2 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] [instance: b2c388d0-04a3-42c0-87fe-ac7df799a423] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:29:45.841012 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.compute.api [None req-ed2235a5-5b51-4c2e-80c3-097c00ceb4d2 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] [instance: b2c388d0-04a3-42c0-87fe-ac7df799a423] Found an unconfirmed migration during delete, id: 16, status: finished Oct 17 14:29:47.672579 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ed2235a5-5b51-4c2e-80c3-097c00ceb4d2 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] 10.222.0.79 "DELETE /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423" status: 204 len: 0 microversion: 2.1 time: 1.927217 Oct 17 14:29:47.675518 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3151/6440] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:29:45 2022] DELETE /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423 => generated 0 bytes in 1932 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 14:29:47.684467 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1fb91676-ee61-4725-95f2-38588e980663 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:47.685085 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-1fb91676-ee61-4725-95f2-38588e980663 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] [instance: b2c388d0-04a3-42c0-87fe-ac7df799a423] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:47.692826 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1fb91676-ee61-4725-95f2-38588e980663 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:47.693531 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1fb91676-ee61-4725-95f2-38588e980663 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:47.693961 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1fb91676-ee61-4725-95f2-38588e980663 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:47.694652 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1fb91676-ee61-4725-95f2-38588e980663 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:47.695098 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1fb91676-ee61-4725-95f2-38588e980663 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:47.695540 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1fb91676-ee61-4725-95f2-38588e980663 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:47.829708 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-1fb91676-ee61-4725-95f2-38588e980663 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bc441f92ae4068b4d02751c57c1c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c45298bec1a45a5a54eb40452a581bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:47.838612 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1fb91676-ee61-4725-95f2-38588e980663 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423" status: 200 len: 1501 microversion: 2.1 time: 0.159000 Oct 17 14:29:47.839304 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3290/6441] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:47 2022] GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423 => generated 1501 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:48.867901 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2c69f38d-a232-41b7-a361-2aff26f48fac tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:48.868799 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2c69f38d-a232-41b7-a361-2aff26f48fac tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] [instance: b2c388d0-04a3-42c0-87fe-ac7df799a423] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:48.879429 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2c69f38d-a232-41b7-a361-2aff26f48fac tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:48.880089 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2c69f38d-a232-41b7-a361-2aff26f48fac tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:48.880675 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2c69f38d-a232-41b7-a361-2aff26f48fac tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:48.881673 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2c69f38d-a232-41b7-a361-2aff26f48fac tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:48.882285 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2c69f38d-a232-41b7-a361-2aff26f48fac tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:48.882862 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2c69f38d-a232-41b7-a361-2aff26f48fac tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:49.091898 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2c69f38d-a232-41b7-a361-2aff26f48fac tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11bc441f92ae4068b4d02751c57c1c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c45298bec1a45a5a54eb40452a581bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:49.100606 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2c69f38d-a232-41b7-a361-2aff26f48fac tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423" status: 200 len: 1501 microversion: 2.1 time: 0.238389 Oct 17 14:29:49.101549 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3152/6442] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:48 2022] GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423 => generated 1501 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:49.275479 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-0678c40a-8f55-4ff3-820d-3f1aee65006a req-08a50afb-c765-4e6d-b6f5-02215f2e5303 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2c388d0-04a3-42c0-87fe-ac7df799a423", "name": "network-vif-plugged", "status": "completed", "tag": "f8691cbc-519f-426d-ba46-7b0c5dccb9ef"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:29:49.287784 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-0678c40a-8f55-4ff3-820d-3f1aee65006a req-08a50afb-c765-4e6d-b6f5-02215f2e5303 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:49.288270 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-0678c40a-8f55-4ff3-820d-3f1aee65006a req-08a50afb-c765-4e6d-b6f5-02215f2e5303 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:49.288702 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-0678c40a-8f55-4ff3-820d-3f1aee65006a req-08a50afb-c765-4e6d-b6f5-02215f2e5303 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:49.302149 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-0678c40a-8f55-4ff3-820d-3f1aee65006a req-08a50afb-c765-4e6d-b6f5-02215f2e5303 service nova] Creating event network-vif-plugged:f8691cbc-519f-426d-ba46-7b0c5dccb9ef for instance b2c388d0-04a3-42c0-87fe-ac7df799a423 on n-h2-854247-14 Oct 17 14:29:49.307568 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-0678c40a-8f55-4ff3-820d-3f1aee65006a req-08a50afb-c765-4e6d-b6f5-02215f2e5303 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035968 Oct 17 14:29:49.308362 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3291/6443] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:29:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:29:49.463087 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-76772025-8799-4766-9b23-c3ec4ffbfb0e req-ebb6e83b-8189-4daa-9f2f-df4029d90dc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2c388d0-04a3-42c0-87fe-ac7df799a423", "name": "network-vif-deleted", "tag": "f8691cbc-519f-426d-ba46-7b0c5dccb9ef"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:29:49.473972 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-76772025-8799-4766-9b23-c3ec4ffbfb0e req-ebb6e83b-8189-4daa-9f2f-df4029d90dc5 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:49.474429 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-76772025-8799-4766-9b23-c3ec4ffbfb0e req-ebb6e83b-8189-4daa-9f2f-df4029d90dc5 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:49.474863 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-76772025-8799-4766-9b23-c3ec4ffbfb0e req-ebb6e83b-8189-4daa-9f2f-df4029d90dc5 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:49.490109 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-76772025-8799-4766-9b23-c3ec4ffbfb0e req-ebb6e83b-8189-4daa-9f2f-df4029d90dc5 service nova] Creating event network-vif-deleted:f8691cbc-519f-426d-ba46-7b0c5dccb9ef for instance b2c388d0-04a3-42c0-87fe-ac7df799a423 on n-h2-854247-14 Oct 17 14:29:49.495085 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-76772025-8799-4766-9b23-c3ec4ffbfb0e req-ebb6e83b-8189-4daa-9f2f-df4029d90dc5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035682 Oct 17 14:29:49.495705 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3153/6444] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:29:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:29:50.124914 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e22bc661-09b1-477b-9ca2-b92d628cefb1 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:50.125651 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e22bc661-09b1-477b-9ca2-b92d628cefb1 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] [instance: b2c388d0-04a3-42c0-87fe-ac7df799a423] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:50.132452 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e22bc661-09b1-477b-9ca2-b92d628cefb1 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:50.132940 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e22bc661-09b1-477b-9ca2-b92d628cefb1 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:50.133372 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e22bc661-09b1-477b-9ca2-b92d628cefb1 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:50.134057 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e22bc661-09b1-477b-9ca2-b92d628cefb1 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:50.134515 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e22bc661-09b1-477b-9ca2-b92d628cefb1 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:50.134933 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e22bc661-09b1-477b-9ca2-b92d628cefb1 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:50.149165 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-e22bc661-09b1-477b-9ca2-b92d628cefb1 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] HTTP exception thrown: Instance b2c388d0-04a3-42c0-87fe-ac7df799a423 could not be found. Oct 17 14:29:50.150850 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e22bc661-09b1-477b-9ca2-b92d628cefb1 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Request method failure captured: Oct 17 14:29:50.150850 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423 HTTP/1.1 Oct 17 14:29:50.150850 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 14:29:50.150850 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 14:29:50.150850 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 14:29:50.150850 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 14:29:50.150850 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 14:29:50.150850 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 14:29:50.150850 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 14:29:50.150850 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 14:29:50.150850 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTWaqwtnwzjvW5qcyedXj-x_AcxFUA6-iHTKgRc8JBC6lJokJbrKffSjDMYHbfx3btIydA2bVPP5ZQaBf3K0pGyeVZ7Q7y1iP41xq3Wc8QJCIKW1-p91efBOP6qn3o3O5s3graKO5DIcAjj4ogAhI3cXwAMAAEGqXfWl3qWZBzWYDjOY Oct 17 14:29:50.150850 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 14:29:50.150850 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 14:29:50.150850 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 14:29:50.150850 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 14:29:50.150850 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 14:29:50.150850 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 14:29:50.150850 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 4c45298bec1a45a5a54eb40452a581bb Oct 17 14:29:50.150850 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-DeleteServersTestJSON-109083168 Oct 17 14:29:50.150850 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 14:29:50.150850 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 14:29:50.150850 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4c45298bec1a45a5a54eb40452a581bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4c45298bec1a45a5a54eb40452a581bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4c45298bec1a45a5a54eb40452a581bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4c45298bec1a45a5a54eb40452a581bb", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:29:50.150850 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-DeleteServersTestJSON-109083168 Oct 17 14:29:50.150850 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 4c45298bec1a45a5a54eb40452a581bb Oct 17 14:29:50.150850 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-DeleteServersTestJSON-109083168 Oct 17 14:29:50.150850 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-DeleteServersTestJSON-109083168-project Oct 17 14:29:50.150850 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 14:29:50.150850 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 14:29:50.150850 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 11bc441f92ae4068b4d02751c57c1c82 Oct 17 14:29:50.150850 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-DeleteServersTestJSON-109083168-project Oct 17 14:29:50.150850 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 14:29:50.150850 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance b2c388d0-04a3-42c0-87fe-ac7df799a423 could not be found. Oct 17 14:29:50.150850 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'b2c388d0-04a3-42c0-87fe-ac7df799a423'} Oct 17 14:29:50.150850 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:29:50.150850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:29:50.150850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:29:50.150850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:29:50.150850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:29:50.150850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:29:50.150850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:29:50.150850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:29:50.150850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:29:50.150850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:29:50.150850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2c388d0-04a3-42c0-87fe-ac7df799a423 could not be found. Oct 17 14:29:50.150850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:29:50.150850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:29:50.150850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:29:50.150850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:29:50.150850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:29:50.150850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:29:50.150850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:29:50.150850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:29:50.150850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:29:50.150850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:29:50.150850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:29:50.150850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:29:50.150850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:29:50.150850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:29:50.150850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:29:50.150850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:29:50.150850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2c388d0-04a3-42c0-87fe-ac7df799a423 could not be found. Oct 17 14:29:50.150850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:29:50.150850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:29:50.150850 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:29:50.155406 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:29:50.155406 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:29:50.155406 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:29:50.155406 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:29:50.155406 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:29:50.155406 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2c388d0-04a3-42c0-87fe-ac7df799a423 could not be found. Oct 17 14:29:50.155406 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:29:50.155406 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e22bc661-09b1-477b-9ca2-b92d628cefb1 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Returning 404 to user: Instance b2c388d0-04a3-42c0-87fe-ac7df799a423 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:29:50.155406 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e22bc661-09b1-477b-9ca2-b92d628cefb1 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423" status: 404 len: 111 microversion: 2.1 time: 0.031767 Oct 17 14:29:50.155406 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3292/6445] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:50 2022] GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:29:50.169483 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0264a586-183c-4f8c-812b-de2e9a3e8942 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:50.170057 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0264a586-183c-4f8c-812b-de2e9a3e8942 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] [instance: b2c388d0-04a3-42c0-87fe-ac7df799a423] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:50.176831 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0264a586-183c-4f8c-812b-de2e9a3e8942 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:50.177324 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0264a586-183c-4f8c-812b-de2e9a3e8942 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:50.177760 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0264a586-183c-4f8c-812b-de2e9a3e8942 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:50.178460 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0264a586-183c-4f8c-812b-de2e9a3e8942 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:50.178911 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0264a586-183c-4f8c-812b-de2e9a3e8942 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:50.179429 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0264a586-183c-4f8c-812b-de2e9a3e8942 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:50.193167 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-0264a586-183c-4f8c-812b-de2e9a3e8942 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] HTTP exception thrown: Instance b2c388d0-04a3-42c0-87fe-ac7df799a423 could not be found. Oct 17 14:29:50.194841 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0264a586-183c-4f8c-812b-de2e9a3e8942 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Request method failure captured: Oct 17 14:29:50.194841 n-d-854247-14 devstack@n-api.service[127017]: request: DELETE /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423 HTTP/1.1 Oct 17 14:29:50.194841 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 14:29:50.194841 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 14:29:50.194841 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 14:29:50.194841 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 14:29:50.194841 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 14:29:50.194841 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 14:29:50.194841 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 14:29:50.194841 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 14:29:50.194841 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTWaqwtnwzjvW5qcyedXj-x_AcxFUA6-iHTKgRc8JBC6lJokJbrKffSjDMYHbfx3btIydA2bVPP5ZQaBf3K0pGyeVZ7Q7y1iP41xq3Wc8QJCIKW1-p91efBOP6qn3o3O5s3graKO5DIcAjj4ogAhI3cXwAMAAEGqXfWl3qWZBzWYDjOY Oct 17 14:29:50.194841 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 14:29:50.194841 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 14:29:50.194841 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 14:29:50.194841 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 14:29:50.194841 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 14:29:50.194841 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 14:29:50.194841 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 4c45298bec1a45a5a54eb40452a581bb Oct 17 14:29:50.194841 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-DeleteServersTestJSON-109083168 Oct 17 14:29:50.194841 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 14:29:50.194841 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 14:29:50.194841 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4c45298bec1a45a5a54eb40452a581bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4c45298bec1a45a5a54eb40452a581bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4c45298bec1a45a5a54eb40452a581bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4c45298bec1a45a5a54eb40452a581bb", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:29:50.194841 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-DeleteServersTestJSON-109083168 Oct 17 14:29:50.194841 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 4c45298bec1a45a5a54eb40452a581bb Oct 17 14:29:50.194841 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-DeleteServersTestJSON-109083168 Oct 17 14:29:50.194841 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-DeleteServersTestJSON-109083168-project Oct 17 14:29:50.194841 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 14:29:50.194841 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 14:29:50.194841 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 11bc441f92ae4068b4d02751c57c1c82 Oct 17 14:29:50.194841 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-DeleteServersTestJSON-109083168-project Oct 17 14:29:50.194841 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 14:29:50.194841 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance b2c388d0-04a3-42c0-87fe-ac7df799a423 could not be found. Oct 17 14:29:50.194841 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'b2c388d0-04a3-42c0-87fe-ac7df799a423'} Oct 17 14:29:50.194841 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:29:50.194841 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:29:50.194841 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:29:50.194841 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:29:50.194841 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:29:50.194841 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:29:50.194841 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:29:50.194841 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:29:50.194841 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:29:50.194841 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:29:50.194841 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2c388d0-04a3-42c0-87fe-ac7df799a423 could not be found. Oct 17 14:29:50.194841 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:29:50.194841 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:29:50.194841 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:29:50.194841 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:29:50.194841 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:29:50.194841 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:29:50.194841 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:29:50.194841 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:29:50.194841 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:29:50.194841 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:29:50.194841 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 14:29:50.194841 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 14:29:50.194841 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 14:29:50.194841 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 14:29:50.194841 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:29:50.194841 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:29:50.194841 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:29:50.194841 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:29:50.199198 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2c388d0-04a3-42c0-87fe-ac7df799a423 could not be found. Oct 17 14:29:50.199198 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:29:50.199198 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:29:50.199198 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:29:50.199198 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:29:50.199198 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:29:50.199198 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:29:50.199198 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:29:50.199198 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:29:50.199198 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2c388d0-04a3-42c0-87fe-ac7df799a423 could not be found. Oct 17 14:29:50.199198 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:29:50.199198 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0264a586-183c-4f8c-812b-de2e9a3e8942 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Returning 404 to user: Instance b2c388d0-04a3-42c0-87fe-ac7df799a423 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:29:50.199198 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0264a586-183c-4f8c-812b-de2e9a3e8942 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] 10.222.0.79 "DELETE /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423" status: 404 len: 111 microversion: 2.1 time: 0.032121 Oct 17 14:29:50.199198 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3154/6446] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:29:50 2022] DELETE /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:29:50.207608 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8c4e2e53-d738-4b27-83a8-da5b48582bf0 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:50.208519 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8c4e2e53-d738-4b27-83a8-da5b48582bf0 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] [instance: b2c388d0-04a3-42c0-87fe-ac7df799a423] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:50.217496 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8c4e2e53-d738-4b27-83a8-da5b48582bf0 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:50.218029 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8c4e2e53-d738-4b27-83a8-da5b48582bf0 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:50.218479 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8c4e2e53-d738-4b27-83a8-da5b48582bf0 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:50.219637 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8c4e2e53-d738-4b27-83a8-da5b48582bf0 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:50.220533 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8c4e2e53-d738-4b27-83a8-da5b48582bf0 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:50.221087 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8c4e2e53-d738-4b27-83a8-da5b48582bf0 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:50.236168 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-8c4e2e53-d738-4b27-83a8-da5b48582bf0 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] HTTP exception thrown: Instance b2c388d0-04a3-42c0-87fe-ac7df799a423 could not be found. Oct 17 14:29:50.237821 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8c4e2e53-d738-4b27-83a8-da5b48582bf0 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Request method failure captured: Oct 17 14:29:50.237821 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423 HTTP/1.1 Oct 17 14:29:50.237821 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 14:29:50.237821 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 14:29:50.237821 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 14:29:50.237821 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 14:29:50.237821 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 14:29:50.237821 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 14:29:50.237821 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 14:29:50.237821 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 14:29:50.237821 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTWaqwtnwzjvW5qcyedXj-x_AcxFUA6-iHTKgRc8JBC6lJokJbrKffSjDMYHbfx3btIydA2bVPP5ZQaBf3K0pGyeVZ7Q7y1iP41xq3Wc8QJCIKW1-p91efBOP6qn3o3O5s3graKO5DIcAjj4ogAhI3cXwAMAAEGqXfWl3qWZBzWYDjOY Oct 17 14:29:50.237821 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 14:29:50.237821 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 14:29:50.237821 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 14:29:50.237821 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 14:29:50.237821 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 14:29:50.237821 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 14:29:50.237821 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 4c45298bec1a45a5a54eb40452a581bb Oct 17 14:29:50.237821 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-DeleteServersTestJSON-109083168 Oct 17 14:29:50.237821 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 14:29:50.237821 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 14:29:50.237821 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4c45298bec1a45a5a54eb40452a581bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/4c45298bec1a45a5a54eb40452a581bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/4c45298bec1a45a5a54eb40452a581bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_4c45298bec1a45a5a54eb40452a581bb", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:29:50.237821 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-DeleteServersTestJSON-109083168 Oct 17 14:29:50.237821 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 4c45298bec1a45a5a54eb40452a581bb Oct 17 14:29:50.237821 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-DeleteServersTestJSON-109083168 Oct 17 14:29:50.237821 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-DeleteServersTestJSON-109083168-project Oct 17 14:29:50.237821 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 14:29:50.237821 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 14:29:50.237821 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 11bc441f92ae4068b4d02751c57c1c82 Oct 17 14:29:50.237821 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-DeleteServersTestJSON-109083168-project Oct 17 14:29:50.237821 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 14:29:50.237821 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance b2c388d0-04a3-42c0-87fe-ac7df799a423 could not be found. Oct 17 14:29:50.237821 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'b2c388d0-04a3-42c0-87fe-ac7df799a423'} Oct 17 14:29:50.237821 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:29:50.237821 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:29:50.237821 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:29:50.237821 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:29:50.237821 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:29:50.237821 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:29:50.237821 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:29:50.237821 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:29:50.237821 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:29:50.237821 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:29:50.237821 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2c388d0-04a3-42c0-87fe-ac7df799a423 could not be found. Oct 17 14:29:50.237821 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:29:50.237821 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:29:50.237821 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:29:50.237821 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:29:50.237821 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:29:50.237821 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:29:50.237821 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:29:50.237821 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:29:50.237821 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:29:50.237821 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:29:50.237821 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:29:50.237821 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:29:50.237821 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:29:50.237821 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:29:50.237821 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:29:50.237821 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:29:50.237821 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2c388d0-04a3-42c0-87fe-ac7df799a423 could not be found. Oct 17 14:29:50.237821 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:29:50.237821 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:29:50.237821 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:29:50.242979 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:29:50.242979 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:29:50.242979 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:29:50.242979 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:29:50.242979 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:29:50.242979 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2c388d0-04a3-42c0-87fe-ac7df799a423 could not be found. Oct 17 14:29:50.242979 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:29:50.242979 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8c4e2e53-d738-4b27-83a8-da5b48582bf0 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] Returning 404 to user: Instance b2c388d0-04a3-42c0-87fe-ac7df799a423 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:29:50.242979 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8c4e2e53-d738-4b27-83a8-da5b48582bf0 tempest-DeleteServersTestJSON-109083168 tempest-DeleteServersTestJSON-109083168-project] 10.222.0.79 "GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423" status: 404 len: 111 microversion: 2.1 time: 0.038067 Oct 17 14:29:50.242979 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3293/6447] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:50 2022] GET /compute/v2.1/servers/b2c388d0-04a3-42c0-87fe-ac7df799a423 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:29:58.915448 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-925cc836-9cd1-4cf2-8ebc-fe6f0e0ee5d2 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-161596747", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "5e3f2ecf-8d4b-4c73-8b3b-4c0abeb20aed"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:29:58.972869 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-925cc836-9cd1-4cf2-8ebc-fe6f0e0ee5d2 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] validate_networks() for [('5e3f2ecf-8d4b-4c73-8b3b-4c0abeb20aed', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:29:59.424512 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-925cc836-9cd1-4cf2-8ebc-fe6f0e0ee5d2 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:29:59.424949 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-925cc836-9cd1-4cf2-8ebc-fe6f0e0ee5d2 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:29:59.425436 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-925cc836-9cd1-4cf2-8ebc-fe6f0e0ee5d2 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:29:59.426030 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-925cc836-9cd1-4cf2-8ebc-fe6f0e0ee5d2 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:29:59.426461 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-925cc836-9cd1-4cf2-8ebc-fe6f0e0ee5d2 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:29:59.435937 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-925cc836-9cd1-4cf2-8ebc-fe6f0e0ee5d2 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:59.436435 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-925cc836-9cd1-4cf2-8ebc-fe6f0e0ee5d2 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:59.436883 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-925cc836-9cd1-4cf2-8ebc-fe6f0e0ee5d2 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:59.437625 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-925cc836-9cd1-4cf2-8ebc-fe6f0e0ee5d2 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:59.438114 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-925cc836-9cd1-4cf2-8ebc-fe6f0e0ee5d2 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:59.438589 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-925cc836-9cd1-4cf2-8ebc-fe6f0e0ee5d2 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:59.456733 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-925cc836-9cd1-4cf2-8ebc-fe6f0e0ee5d2 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Getting quotas for project bd9e80b7afc44137bb10c1f9dc2de673. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:29:59.462232 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-925cc836-9cd1-4cf2-8ebc-fe6f0e0ee5d2 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Getting quotas for user cb2c9e7d4f3e49f1928faf5f3adbfc08 and project bd9e80b7afc44137bb10c1f9dc2de673. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:29:59.480905 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-925cc836-9cd1-4cf2-8ebc-fe6f0e0ee5d2 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:29:59.483299 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-925cc836-9cd1-4cf2-8ebc-fe6f0e0ee5d2 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: f4e05674-5f71-4ccc-97fe-06094b862388] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:29:59.537534 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-925cc836-9cd1-4cf2-8ebc-fe6f0e0ee5d2 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.743464 Oct 17 14:29:59.538181 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3155/6448] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 14:29:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:29:59.549724 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8ebec004-2e47-4e8b-b1b4-88d4b7e96c20 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:59.550933 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8ebec004-2e47-4e8b-b1b4-88d4b7e96c20 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: f4e05674-5f71-4ccc-97fe-06094b862388] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:59.610654 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8ebec004-2e47-4e8b-b1b4-88d4b7e96c20 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:59.625409 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8ebec004-2e47-4e8b-b1b4-88d4b7e96c20 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388" status: 200 len: 1217 microversion: 2.1 time: 0.079655 Oct 17 14:29:59.626251 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3294/6449] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:59 2022] GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388 => generated 1217 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:30:00.649973 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-20cbe8a5-0241-42f8-9564-6e464a276f90 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:00.651279 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-20cbe8a5-0241-42f8-9564-6e464a276f90 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: f4e05674-5f71-4ccc-97fe-06094b862388] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:00.659547 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-20cbe8a5-0241-42f8-9564-6e464a276f90 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:00.660050 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-20cbe8a5-0241-42f8-9564-6e464a276f90 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:00.660496 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-20cbe8a5-0241-42f8-9564-6e464a276f90 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:00.661216 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-20cbe8a5-0241-42f8-9564-6e464a276f90 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:00.661670 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-20cbe8a5-0241-42f8-9564-6e464a276f90 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:00.662105 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-20cbe8a5-0241-42f8-9564-6e464a276f90 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:00.799870 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-20cbe8a5-0241-42f8-9564-6e464a276f90 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:00.809725 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-20cbe8a5-0241-42f8-9564-6e464a276f90 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388" status: 200 len: 1277 microversion: 2.1 time: 0.164576 Oct 17 14:30:00.810594 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3156/6450] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:00 2022] GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388 => generated 1277 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:30:01.834300 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-07ee0148-6427-4bf7-8cc4-45d8005c4984 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:01.834950 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-07ee0148-6427-4bf7-8cc4-45d8005c4984 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: f4e05674-5f71-4ccc-97fe-06094b862388] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:01.838298 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=39 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:30:01.847606 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-07ee0148-6427-4bf7-8cc4-45d8005c4984 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:01.848121 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-07ee0148-6427-4bf7-8cc4-45d8005c4984 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:01.848746 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-07ee0148-6427-4bf7-8cc4-45d8005c4984 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:01.849473 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-07ee0148-6427-4bf7-8cc4-45d8005c4984 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:01.850094 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-07ee0148-6427-4bf7-8cc4-45d8005c4984 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:01.850515 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-07ee0148-6427-4bf7-8cc4-45d8005c4984 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:02.096304 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-07ee0148-6427-4bf7-8cc4-45d8005c4984 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:02.112794 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-07ee0148-6427-4bf7-8cc4-45d8005c4984 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388" status: 200 len: 1317 microversion: 2.1 time: 0.282286 Oct 17 14:30:02.113657 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3295/6451] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:01 2022] GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388 => generated 1317 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:02.338320 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-b67b8cb6-d7e0-4e73-8548-7f692507e77d req-e0f0a84a-f862-42ab-82c3-23046c6dc857 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4e05674-5f71-4ccc-97fe-06094b862388", "tag": "7ba52b65-45f2-4ed5-ae8a-2405925a6e32"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:30:02.366779 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-b67b8cb6-d7e0-4e73-8548-7f692507e77d req-e0f0a84a-f862-42ab-82c3-23046c6dc857 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:02.367572 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-b67b8cb6-d7e0-4e73-8548-7f692507e77d req-e0f0a84a-f862-42ab-82c3-23046c6dc857 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:02.368710 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-b67b8cb6-d7e0-4e73-8548-7f692507e77d req-e0f0a84a-f862-42ab-82c3-23046c6dc857 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:02.397381 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-b67b8cb6-d7e0-4e73-8548-7f692507e77d req-e0f0a84a-f862-42ab-82c3-23046c6dc857 service nova] Creating event network-changed:7ba52b65-45f2-4ed5-ae8a-2405925a6e32 for instance f4e05674-5f71-4ccc-97fe-06094b862388 on n-h2-854247-14 Oct 17 14:30:02.402895 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-b67b8cb6-d7e0-4e73-8548-7f692507e77d req-e0f0a84a-f862-42ab-82c3-23046c6dc857 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068730 Oct 17 14:30:02.404235 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3157/6452] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:30:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:30:03.139642 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7676081f-e784-4a1d-8383-a2e818212a03 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:03.140234 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7676081f-e784-4a1d-8383-a2e818212a03 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: f4e05674-5f71-4ccc-97fe-06094b862388] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:03.147362 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7676081f-e784-4a1d-8383-a2e818212a03 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:03.147805 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7676081f-e784-4a1d-8383-a2e818212a03 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:03.148436 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7676081f-e784-4a1d-8383-a2e818212a03 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:03.149129 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7676081f-e784-4a1d-8383-a2e818212a03 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:03.149538 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7676081f-e784-4a1d-8383-a2e818212a03 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:03.150106 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7676081f-e784-4a1d-8383-a2e818212a03 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:03.284547 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7676081f-e784-4a1d-8383-a2e818212a03 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:03.292857 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7676081f-e784-4a1d-8383-a2e818212a03 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388" status: 200 len: 1317 microversion: 2.1 time: 0.157121 Oct 17 14:30:03.293430 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3296/6453] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:03 2022] GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:04.317134 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ce225c85-fc63-4e77-942d-f7f6cb3ae26a tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:04.317906 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ce225c85-fc63-4e77-942d-f7f6cb3ae26a tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: f4e05674-5f71-4ccc-97fe-06094b862388] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:04.325357 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ce225c85-fc63-4e77-942d-f7f6cb3ae26a tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:04.325864 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ce225c85-fc63-4e77-942d-f7f6cb3ae26a tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:04.326316 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ce225c85-fc63-4e77-942d-f7f6cb3ae26a tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:04.327038 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ce225c85-fc63-4e77-942d-f7f6cb3ae26a tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:04.327536 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ce225c85-fc63-4e77-942d-f7f6cb3ae26a tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:04.327979 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ce225c85-fc63-4e77-942d-f7f6cb3ae26a tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:04.494785 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ce225c85-fc63-4e77-942d-f7f6cb3ae26a tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:04.503282 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ce225c85-fc63-4e77-942d-f7f6cb3ae26a tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388" status: 200 len: 1317 microversion: 2.1 time: 0.190742 Oct 17 14:30:04.503819 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3158/6454] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:04 2022] GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388 => generated 1317 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:05.526630 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4c8fd2ac-4712-45cb-8799-268138c6b680 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:05.527149 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4c8fd2ac-4712-45cb-8799-268138c6b680 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: f4e05674-5f71-4ccc-97fe-06094b862388] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:05.534208 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4c8fd2ac-4712-45cb-8799-268138c6b680 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:05.534706 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4c8fd2ac-4712-45cb-8799-268138c6b680 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:05.535118 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4c8fd2ac-4712-45cb-8799-268138c6b680 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:05.535963 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4c8fd2ac-4712-45cb-8799-268138c6b680 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:05.536421 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4c8fd2ac-4712-45cb-8799-268138c6b680 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:05.536848 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4c8fd2ac-4712-45cb-8799-268138c6b680 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:05.674684 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4c8fd2ac-4712-45cb-8799-268138c6b680 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:05.682673 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4c8fd2ac-4712-45cb-8799-268138c6b680 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388" status: 200 len: 1317 microversion: 2.1 time: 0.160463 Oct 17 14:30:05.683311 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3297/6455] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:05 2022] GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:06.708037 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-34970570-8e1e-45f7-ae24-ae1d6df6b753 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:06.708813 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-34970570-8e1e-45f7-ae24-ae1d6df6b753 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: f4e05674-5f71-4ccc-97fe-06094b862388] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:06.717367 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-34970570-8e1e-45f7-ae24-ae1d6df6b753 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:06.717953 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-34970570-8e1e-45f7-ae24-ae1d6df6b753 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:06.718485 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-34970570-8e1e-45f7-ae24-ae1d6df6b753 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:06.719362 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-34970570-8e1e-45f7-ae24-ae1d6df6b753 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:06.719927 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-34970570-8e1e-45f7-ae24-ae1d6df6b753 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:06.720452 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-34970570-8e1e-45f7-ae24-ae1d6df6b753 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:06.723328 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:30:06.859651 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-34970570-8e1e-45f7-ae24-ae1d6df6b753 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:06.869562 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-34970570-8e1e-45f7-ae24-ae1d6df6b753 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388" status: 200 len: 1317 microversion: 2.1 time: 0.166394 Oct 17 14:30:06.870358 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3159/6456] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:06 2022] GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:07.374966 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-3d2d9aee-c2e6-49f4-846a-6001dcc5b273 req-7159fa79-c945-4127-982c-f54fc763a9c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4e05674-5f71-4ccc-97fe-06094b862388", "name": "network-vif-plugged", "status": "completed", "tag": "7ba52b65-45f2-4ed5-ae8a-2405925a6e32"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:30:07.386366 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-3d2d9aee-c2e6-49f4-846a-6001dcc5b273 req-7159fa79-c945-4127-982c-f54fc763a9c0 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:07.386881 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-3d2d9aee-c2e6-49f4-846a-6001dcc5b273 req-7159fa79-c945-4127-982c-f54fc763a9c0 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:07.387344 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-3d2d9aee-c2e6-49f4-846a-6001dcc5b273 req-7159fa79-c945-4127-982c-f54fc763a9c0 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:07.401017 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-3d2d9aee-c2e6-49f4-846a-6001dcc5b273 req-7159fa79-c945-4127-982c-f54fc763a9c0 service nova] Creating event network-vif-plugged:7ba52b65-45f2-4ed5-ae8a-2405925a6e32 for instance f4e05674-5f71-4ccc-97fe-06094b862388 on n-h2-854247-14 Oct 17 14:30:07.406704 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-3d2d9aee-c2e6-49f4-846a-6001dcc5b273 req-7159fa79-c945-4127-982c-f54fc763a9c0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035479 Oct 17 14:30:07.407640 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3298/6457] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:30:07.907220 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-eb91b385-2bd6-4a6a-bd3b-df6e6f75bc6f tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:07.924999 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-eb91b385-2bd6-4a6a-bd3b-df6e6f75bc6f tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: f4e05674-5f71-4ccc-97fe-06094b862388] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:07.924999 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eb91b385-2bd6-4a6a-bd3b-df6e6f75bc6f tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:07.924999 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eb91b385-2bd6-4a6a-bd3b-df6e6f75bc6f tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:07.924999 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eb91b385-2bd6-4a6a-bd3b-df6e6f75bc6f tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:07.924999 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eb91b385-2bd6-4a6a-bd3b-df6e6f75bc6f tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:07.924999 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eb91b385-2bd6-4a6a-bd3b-df6e6f75bc6f tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:07.924999 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eb91b385-2bd6-4a6a-bd3b-df6e6f75bc6f tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:08.070432 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-eb91b385-2bd6-4a6a-bd3b-df6e6f75bc6f tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:08.078837 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-eb91b385-2bd6-4a6a-bd3b-df6e6f75bc6f tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388" status: 200 len: 1317 microversion: 2.1 time: 0.179427 Oct 17 14:30:08.079758 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3160/6458] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:07 2022] GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388 => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:30:09.103014 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8328e6a7-0136-43cb-b6f0-aa67de21e9e2 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:09.103752 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8328e6a7-0136-43cb-b6f0-aa67de21e9e2 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: f4e05674-5f71-4ccc-97fe-06094b862388] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:09.105780 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=30 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:30:09.111967 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8328e6a7-0136-43cb-b6f0-aa67de21e9e2 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:09.112448 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8328e6a7-0136-43cb-b6f0-aa67de21e9e2 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:09.112882 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8328e6a7-0136-43cb-b6f0-aa67de21e9e2 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:09.113577 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8328e6a7-0136-43cb-b6f0-aa67de21e9e2 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:09.114024 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8328e6a7-0136-43cb-b6f0-aa67de21e9e2 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:09.114445 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8328e6a7-0136-43cb-b6f0-aa67de21e9e2 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:09.256132 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8328e6a7-0136-43cb-b6f0-aa67de21e9e2 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:09.264699 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8328e6a7-0136-43cb-b6f0-aa67de21e9e2 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388" status: 200 len: 1508 microversion: 2.1 time: 0.166863 Oct 17 14:30:09.265270 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3299/6459] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:09 2022] GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388 => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:09.288169 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-687b7db1-7119-4543-b07c-ee0626217e32 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:09.288763 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-687b7db1-7119-4543-b07c-ee0626217e32 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: f4e05674-5f71-4ccc-97fe-06094b862388] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:09.296246 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-687b7db1-7119-4543-b07c-ee0626217e32 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:09.296744 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-687b7db1-7119-4543-b07c-ee0626217e32 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:09.297204 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-687b7db1-7119-4543-b07c-ee0626217e32 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:09.297910 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-687b7db1-7119-4543-b07c-ee0626217e32 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:09.298372 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-687b7db1-7119-4543-b07c-ee0626217e32 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:09.299016 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-687b7db1-7119-4543-b07c-ee0626217e32 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:09.448909 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-687b7db1-7119-4543-b07c-ee0626217e32 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:09.451753 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:30:09.461735 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-687b7db1-7119-4543-b07c-ee0626217e32 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388" status: 200 len: 1508 microversion: 2.1 time: 0.177372 Oct 17 14:30:09.462423 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3161/6460] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:09 2022] GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388 => generated 1508 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:09.489360 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-29e3750b-6de4-4746-adc9-3326822670ad tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:30:09.493060 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-29e3750b-6de4-4746-adc9-3326822670ad tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: f4e05674-5f71-4ccc-97fe-06094b862388] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:09.501529 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-29e3750b-6de4-4746-adc9-3326822670ad tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:09.502243 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-29e3750b-6de4-4746-adc9-3326822670ad tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:09.502805 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-29e3750b-6de4-4746-adc9-3326822670ad tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:09.503525 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-29e3750b-6de4-4746-adc9-3326822670ad tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:09.503973 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-29e3750b-6de4-4746-adc9-3326822670ad tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:09.504390 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-29e3750b-6de4-4746-adc9-3326822670ad tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:09.571195 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-29e3750b-6de4-4746-adc9-3326822670ad tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "PUT /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388" status: 200 len: 1080 microversion: 2.1 time: 0.088438 Oct 17 14:30:09.573244 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3300/6461] 10.222.0.79 () {60 vars in 1256 bytes} [Mon Oct 17 14:30:09 2022] PUT /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388 => generated 1080 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:09.599734 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-690e97c8-2e6d-4342-82f3-af69606f6a9c tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:09.600365 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-690e97c8-2e6d-4342-82f3-af69606f6a9c tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: f4e05674-5f71-4ccc-97fe-06094b862388] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:09.602186 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=6 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:30:09.603008 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:30:09.608539 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-690e97c8-2e6d-4342-82f3-af69606f6a9c tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:09.609072 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-690e97c8-2e6d-4342-82f3-af69606f6a9c tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:09.609522 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-690e97c8-2e6d-4342-82f3-af69606f6a9c tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:09.610236 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-690e97c8-2e6d-4342-82f3-af69606f6a9c tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:09.610701 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-690e97c8-2e6d-4342-82f3-af69606f6a9c tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:09.611159 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-690e97c8-2e6d-4342-82f3-af69606f6a9c tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:09.756961 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-690e97c8-2e6d-4342-82f3-af69606f6a9c tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:09.768231 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-690e97c8-2e6d-4342-82f3-af69606f6a9c tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388" status: 200 len: 1506 microversion: 2.1 time: 0.173008 Oct 17 14:30:09.768859 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3162/6462] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:09 2022] GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388 => generated 1506 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:09.790637 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-99f9fe1f-21d6-4249-b243-de14903e6b57 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:09.791280 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-99f9fe1f-21d6-4249-b243-de14903e6b57 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: f4e05674-5f71-4ccc-97fe-06094b862388] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:09.793233 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:30:09.798848 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-99f9fe1f-21d6-4249-b243-de14903e6b57 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:09.799500 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-99f9fe1f-21d6-4249-b243-de14903e6b57 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:09.799963 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-99f9fe1f-21d6-4249-b243-de14903e6b57 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:09.800679 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-99f9fe1f-21d6-4249-b243-de14903e6b57 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:09.801130 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-99f9fe1f-21d6-4249-b243-de14903e6b57 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:09.801551 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-99f9fe1f-21d6-4249-b243-de14903e6b57 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:09.954711 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-99f9fe1f-21d6-4249-b243-de14903e6b57 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:09.965723 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-99f9fe1f-21d6-4249-b243-de14903e6b57 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388" status: 200 len: 1506 microversion: 2.1 time: 0.178657 Oct 17 14:30:09.966434 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3301/6463] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:09 2022] GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388 => generated 1506 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:09.987906 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5d33c25a-b864-49a2-80f2-b9ce2c60f9e8 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:30:09.990212 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5d33c25a-b864-49a2-80f2-b9ce2c60f9e8 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: f4e05674-5f71-4ccc-97fe-06094b862388] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:09.996724 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5d33c25a-b864-49a2-80f2-b9ce2c60f9e8 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:09.997220 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5d33c25a-b864-49a2-80f2-b9ce2c60f9e8 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:09.997669 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5d33c25a-b864-49a2-80f2-b9ce2c60f9e8 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:09.998368 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5d33c25a-b864-49a2-80f2-b9ce2c60f9e8 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:09.998852 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5d33c25a-b864-49a2-80f2-b9ce2c60f9e8 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:09.999287 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5d33c25a-b864-49a2-80f2-b9ce2c60f9e8 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:10.028438 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5d33c25a-b864-49a2-80f2-b9ce2c60f9e8 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:10.034230 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5d33c25a-b864-49a2-80f2-b9ce2c60f9e8 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: f4e05674-5f71-4ccc-97fe-06094b862388] Old instance type m1.heat2, new instance type m1.heat {{(pid=127017) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 17 14:30:10.041332 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-5d33c25a-b864-49a2-80f2-b9ce2c60f9e8 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:30:10.041763 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-5d33c25a-b864-49a2-80f2-b9ce2c60f9e8 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:30:10.042247 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-5d33c25a-b864-49a2-80f2-b9ce2c60f9e8 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:30:10.042657 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-5d33c25a-b864-49a2-80f2-b9ce2c60f9e8 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:30:10.043139 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-5d33c25a-b864-49a2-80f2-b9ce2c60f9e8 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:30:10.111366 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5d33c25a-b864-49a2-80f2-b9ce2c60f9e8 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "POST /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388/action" status: 202 len: 0 microversion: 2.1 time: 0.127363 Oct 17 14:30:10.111998 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3163/6464] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:30:09 2022] POST /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:30:10.120328 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2fc0ab57-e6f9-4bf2-8e84-9f6a0bf37e90 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:10.120983 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2fc0ab57-e6f9-4bf2-8e84-9f6a0bf37e90 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: f4e05674-5f71-4ccc-97fe-06094b862388] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:10.128346 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2fc0ab57-e6f9-4bf2-8e84-9f6a0bf37e90 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:10.128827 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2fc0ab57-e6f9-4bf2-8e84-9f6a0bf37e90 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:10.129259 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2fc0ab57-e6f9-4bf2-8e84-9f6a0bf37e90 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:10.129954 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2fc0ab57-e6f9-4bf2-8e84-9f6a0bf37e90 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:10.130402 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2fc0ab57-e6f9-4bf2-8e84-9f6a0bf37e90 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:10.130811 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2fc0ab57-e6f9-4bf2-8e84-9f6a0bf37e90 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:10.265351 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2fc0ab57-e6f9-4bf2-8e84-9f6a0bf37e90 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:10.273638 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2fc0ab57-e6f9-4bf2-8e84-9f6a0bf37e90 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388" status: 200 len: 1517 microversion: 2.1 time: 0.157291 Oct 17 14:30:10.274215 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3302/6465] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:10 2022] GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388 => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:30:11.298150 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-cf94de01-896b-4fc9-9da2-848d3e9052e2 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:11.298725 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-cf94de01-896b-4fc9-9da2-848d3e9052e2 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: f4e05674-5f71-4ccc-97fe-06094b862388] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:11.306424 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cf94de01-896b-4fc9-9da2-848d3e9052e2 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:11.306913 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cf94de01-896b-4fc9-9da2-848d3e9052e2 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:11.307394 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cf94de01-896b-4fc9-9da2-848d3e9052e2 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:11.308087 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cf94de01-896b-4fc9-9da2-848d3e9052e2 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:11.308536 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cf94de01-896b-4fc9-9da2-848d3e9052e2 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:11.309056 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cf94de01-896b-4fc9-9da2-848d3e9052e2 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:11.446715 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-cf94de01-896b-4fc9-9da2-848d3e9052e2 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:11.456722 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-cf94de01-896b-4fc9-9da2-848d3e9052e2 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388" status: 200 len: 1517 microversion: 2.1 time: 0.163570 Oct 17 14:30:11.457368 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3164/6466] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:11 2022] GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388 => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:12.481322 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c474ef2d-afa1-48dc-bfd4-bf74d5acf3f5 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:12.481914 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c474ef2d-afa1-48dc-bfd4-bf74d5acf3f5 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: f4e05674-5f71-4ccc-97fe-06094b862388] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:12.489492 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c474ef2d-afa1-48dc-bfd4-bf74d5acf3f5 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:12.490006 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c474ef2d-afa1-48dc-bfd4-bf74d5acf3f5 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:12.490424 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c474ef2d-afa1-48dc-bfd4-bf74d5acf3f5 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:12.491367 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c474ef2d-afa1-48dc-bfd4-bf74d5acf3f5 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:12.491995 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c474ef2d-afa1-48dc-bfd4-bf74d5acf3f5 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:12.492424 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c474ef2d-afa1-48dc-bfd4-bf74d5acf3f5 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:12.638045 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c474ef2d-afa1-48dc-bfd4-bf74d5acf3f5 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:12.650537 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c474ef2d-afa1-48dc-bfd4-bf74d5acf3f5 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388" status: 200 len: 1522 microversion: 2.1 time: 0.173043 Oct 17 14:30:12.651406 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3303/6467] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:12 2022] GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:13.679099 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-85c5edac-8126-40a2-b557-a3f29f78763e tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:13.679748 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-85c5edac-8126-40a2-b557-a3f29f78763e tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: f4e05674-5f71-4ccc-97fe-06094b862388] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:13.686572 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-85c5edac-8126-40a2-b557-a3f29f78763e tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:13.687064 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-85c5edac-8126-40a2-b557-a3f29f78763e tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:13.687551 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-85c5edac-8126-40a2-b557-a3f29f78763e tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:13.688247 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-85c5edac-8126-40a2-b557-a3f29f78763e tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:13.688700 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-85c5edac-8126-40a2-b557-a3f29f78763e tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:13.689132 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-85c5edac-8126-40a2-b557-a3f29f78763e tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:13.832169 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-85c5edac-8126-40a2-b557-a3f29f78763e tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:13.840571 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-85c5edac-8126-40a2-b557-a3f29f78763e tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388" status: 200 len: 1522 microversion: 2.1 time: 0.165617 Oct 17 14:30:13.841173 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3165/6468] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:13 2022] GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:14.866053 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-36acf8ae-bd41-482b-89af-2a8a500e2cd9 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:14.866717 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-36acf8ae-bd41-482b-89af-2a8a500e2cd9 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: f4e05674-5f71-4ccc-97fe-06094b862388] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:14.874008 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-36acf8ae-bd41-482b-89af-2a8a500e2cd9 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:14.874515 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-36acf8ae-bd41-482b-89af-2a8a500e2cd9 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:14.874945 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-36acf8ae-bd41-482b-89af-2a8a500e2cd9 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:14.875681 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-36acf8ae-bd41-482b-89af-2a8a500e2cd9 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:14.876132 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-36acf8ae-bd41-482b-89af-2a8a500e2cd9 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:14.876551 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-36acf8ae-bd41-482b-89af-2a8a500e2cd9 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:15.018366 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-36acf8ae-bd41-482b-89af-2a8a500e2cd9 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:15.026828 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-36acf8ae-bd41-482b-89af-2a8a500e2cd9 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388" status: 200 len: 1522 microversion: 2.1 time: 0.165838 Oct 17 14:30:15.027422 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3304/6469] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:14 2022] GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:16.052163 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9dec23f8-2276-485b-a5c8-a4f1dd7f1272 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:16.052810 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9dec23f8-2276-485b-a5c8-a4f1dd7f1272 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: f4e05674-5f71-4ccc-97fe-06094b862388] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:16.059923 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9dec23f8-2276-485b-a5c8-a4f1dd7f1272 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:16.060425 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9dec23f8-2276-485b-a5c8-a4f1dd7f1272 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:16.060881 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9dec23f8-2276-485b-a5c8-a4f1dd7f1272 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:16.061590 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9dec23f8-2276-485b-a5c8-a4f1dd7f1272 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:16.062059 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9dec23f8-2276-485b-a5c8-a4f1dd7f1272 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:16.062495 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9dec23f8-2276-485b-a5c8-a4f1dd7f1272 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:16.201894 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9dec23f8-2276-485b-a5c8-a4f1dd7f1272 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:16.211988 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9dec23f8-2276-485b-a5c8-a4f1dd7f1272 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388" status: 200 len: 1522 microversion: 2.1 time: 0.163829 Oct 17 14:30:16.212583 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3166/6470] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:16 2022] GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:17.237065 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f3040fe6-7869-4ae2-bf02-c6f4bcaeb230 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:17.237642 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f3040fe6-7869-4ae2-bf02-c6f4bcaeb230 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: f4e05674-5f71-4ccc-97fe-06094b862388] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:17.245020 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f3040fe6-7869-4ae2-bf02-c6f4bcaeb230 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:17.245507 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f3040fe6-7869-4ae2-bf02-c6f4bcaeb230 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:17.245947 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f3040fe6-7869-4ae2-bf02-c6f4bcaeb230 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:17.246756 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f3040fe6-7869-4ae2-bf02-c6f4bcaeb230 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:17.247213 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f3040fe6-7869-4ae2-bf02-c6f4bcaeb230 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:17.247675 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f3040fe6-7869-4ae2-bf02-c6f4bcaeb230 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:17.380137 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f3040fe6-7869-4ae2-bf02-c6f4bcaeb230 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:17.388189 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f3040fe6-7869-4ae2-bf02-c6f4bcaeb230 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388" status: 200 len: 1522 microversion: 2.1 time: 0.156002 Oct 17 14:30:17.388765 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3305/6471] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:17 2022] GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:18.413791 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-726111fb-ed3c-4301-9e99-c71d520348bc tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:18.414355 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-726111fb-ed3c-4301-9e99-c71d520348bc tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: f4e05674-5f71-4ccc-97fe-06094b862388] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:18.421476 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-726111fb-ed3c-4301-9e99-c71d520348bc tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:18.421969 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-726111fb-ed3c-4301-9e99-c71d520348bc tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:18.422411 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-726111fb-ed3c-4301-9e99-c71d520348bc tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:18.423104 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-726111fb-ed3c-4301-9e99-c71d520348bc tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:18.423590 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-726111fb-ed3c-4301-9e99-c71d520348bc tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:18.424018 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-726111fb-ed3c-4301-9e99-c71d520348bc tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:18.570811 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-726111fb-ed3c-4301-9e99-c71d520348bc tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:18.583349 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-726111fb-ed3c-4301-9e99-c71d520348bc tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388" status: 200 len: 1522 microversion: 2.1 time: 0.173260 Oct 17 14:30:18.584247 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3167/6472] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:18 2022] GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:19.610539 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-822e9a97-3338-4db7-abfe-04419e92bb86 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:19.611524 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-822e9a97-3338-4db7-abfe-04419e92bb86 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: f4e05674-5f71-4ccc-97fe-06094b862388] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:19.619282 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-822e9a97-3338-4db7-abfe-04419e92bb86 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:19.619772 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-822e9a97-3338-4db7-abfe-04419e92bb86 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:19.620208 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-822e9a97-3338-4db7-abfe-04419e92bb86 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:19.620905 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-822e9a97-3338-4db7-abfe-04419e92bb86 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:19.621361 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-822e9a97-3338-4db7-abfe-04419e92bb86 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:19.621783 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-822e9a97-3338-4db7-abfe-04419e92bb86 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:19.761038 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-822e9a97-3338-4db7-abfe-04419e92bb86 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:19.769315 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-822e9a97-3338-4db7-abfe-04419e92bb86 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388" status: 200 len: 1522 microversion: 2.1 time: 0.164999 Oct 17 14:30:19.769892 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3306/6473] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:19 2022] GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:20.793913 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-73fa803c-727c-44c2-a7ec-1c419d357be7 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:20.794547 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-73fa803c-727c-44c2-a7ec-1c419d357be7 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: f4e05674-5f71-4ccc-97fe-06094b862388] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:20.803323 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-73fa803c-727c-44c2-a7ec-1c419d357be7 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:20.803828 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-73fa803c-727c-44c2-a7ec-1c419d357be7 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:20.804266 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-73fa803c-727c-44c2-a7ec-1c419d357be7 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:20.804978 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-73fa803c-727c-44c2-a7ec-1c419d357be7 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:20.805441 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-73fa803c-727c-44c2-a7ec-1c419d357be7 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:20.805877 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-73fa803c-727c-44c2-a7ec-1c419d357be7 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:20.946043 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-73fa803c-727c-44c2-a7ec-1c419d357be7 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:20.957371 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-73fa803c-727c-44c2-a7ec-1c419d357be7 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388" status: 200 len: 1522 microversion: 2.1 time: 0.167829 Oct 17 14:30:20.957965 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3168/6474] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:20 2022] GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:21.985454 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7daae895-9582-4663-9bcb-374136ee0ab0 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:21.986540 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7daae895-9582-4663-9bcb-374136ee0ab0 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: f4e05674-5f71-4ccc-97fe-06094b862388] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:21.994607 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7daae895-9582-4663-9bcb-374136ee0ab0 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:21.995096 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7daae895-9582-4663-9bcb-374136ee0ab0 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:21.995563 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7daae895-9582-4663-9bcb-374136ee0ab0 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:21.996263 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7daae895-9582-4663-9bcb-374136ee0ab0 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:21.996843 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7daae895-9582-4663-9bcb-374136ee0ab0 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:21.997300 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7daae895-9582-4663-9bcb-374136ee0ab0 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:22.143543 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7daae895-9582-4663-9bcb-374136ee0ab0 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:22.151749 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7daae895-9582-4663-9bcb-374136ee0ab0 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388" status: 200 len: 1522 microversion: 2.1 time: 0.173012 Oct 17 14:30:22.152345 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3307/6475] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:21 2022] GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:23.178662 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3b49837a-7088-4c6f-aa48-009cc0af8b1c tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:23.179343 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3b49837a-7088-4c6f-aa48-009cc0af8b1c tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: f4e05674-5f71-4ccc-97fe-06094b862388] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:23.186982 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3b49837a-7088-4c6f-aa48-009cc0af8b1c tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:23.187531 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3b49837a-7088-4c6f-aa48-009cc0af8b1c tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:23.188003 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3b49837a-7088-4c6f-aa48-009cc0af8b1c tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:23.188745 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3b49837a-7088-4c6f-aa48-009cc0af8b1c tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:23.189233 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3b49837a-7088-4c6f-aa48-009cc0af8b1c tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:23.189693 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3b49837a-7088-4c6f-aa48-009cc0af8b1c tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:23.326306 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3b49837a-7088-4c6f-aa48-009cc0af8b1c tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:23.334581 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3b49837a-7088-4c6f-aa48-009cc0af8b1c tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388" status: 200 len: 1522 microversion: 2.1 time: 0.161490 Oct 17 14:30:23.335153 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3169/6476] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:23 2022] GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:24.367497 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8e093767-fe94-421c-a4dc-72be3738d7dc tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:24.368140 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8e093767-fe94-421c-a4dc-72be3738d7dc tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: f4e05674-5f71-4ccc-97fe-06094b862388] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:24.376483 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8e093767-fe94-421c-a4dc-72be3738d7dc tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:24.377073 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8e093767-fe94-421c-a4dc-72be3738d7dc tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:24.377617 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8e093767-fe94-421c-a4dc-72be3738d7dc tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:24.378500 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8e093767-fe94-421c-a4dc-72be3738d7dc tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:24.379132 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8e093767-fe94-421c-a4dc-72be3738d7dc tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:24.379745 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8e093767-fe94-421c-a4dc-72be3738d7dc tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:24.522170 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8e093767-fe94-421c-a4dc-72be3738d7dc tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:24.534602 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8e093767-fe94-421c-a4dc-72be3738d7dc tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388" status: 200 len: 1522 microversion: 2.1 time: 0.171835 Oct 17 14:30:24.535652 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3308/6477] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:24 2022] GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:25.565904 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ccaf5629-576e-4916-8c30-ccffa38e2c95 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:25.566767 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ccaf5629-576e-4916-8c30-ccffa38e2c95 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: f4e05674-5f71-4ccc-97fe-06094b862388] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:25.576355 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ccaf5629-576e-4916-8c30-ccffa38e2c95 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:25.577018 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ccaf5629-576e-4916-8c30-ccffa38e2c95 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:25.577612 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ccaf5629-576e-4916-8c30-ccffa38e2c95 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:25.578556 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ccaf5629-576e-4916-8c30-ccffa38e2c95 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:25.579222 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ccaf5629-576e-4916-8c30-ccffa38e2c95 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:25.579795 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ccaf5629-576e-4916-8c30-ccffa38e2c95 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:25.721511 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ccaf5629-576e-4916-8c30-ccffa38e2c95 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:25.729953 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ccaf5629-576e-4916-8c30-ccffa38e2c95 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388" status: 200 len: 1522 microversion: 2.1 time: 0.169308 Oct 17 14:30:25.730526 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3170/6478] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:25 2022] GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:30:26.754607 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-527555dd-a40d-416b-b8be-3b2f885f11df tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:26.755374 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-527555dd-a40d-416b-b8be-3b2f885f11df tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: f4e05674-5f71-4ccc-97fe-06094b862388] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:26.763122 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-527555dd-a40d-416b-b8be-3b2f885f11df tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:26.763628 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-527555dd-a40d-416b-b8be-3b2f885f11df tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:26.764054 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-527555dd-a40d-416b-b8be-3b2f885f11df tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:26.764741 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-527555dd-a40d-416b-b8be-3b2f885f11df tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:26.765187 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-527555dd-a40d-416b-b8be-3b2f885f11df tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:26.765602 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-527555dd-a40d-416b-b8be-3b2f885f11df tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:26.909353 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-527555dd-a40d-416b-b8be-3b2f885f11df tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:26.921344 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-527555dd-a40d-416b-b8be-3b2f885f11df tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388" status: 200 len: 1522 microversion: 2.1 time: 0.171409 Oct 17 14:30:26.922025 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3309/6479] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:26 2022] GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:27.947448 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ad929cac-b722-4f59-936b-5f3e55a10cef tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:27.948782 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ad929cac-b722-4f59-936b-5f3e55a10cef tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: f4e05674-5f71-4ccc-97fe-06094b862388] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:27.955827 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ad929cac-b722-4f59-936b-5f3e55a10cef tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:27.956329 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ad929cac-b722-4f59-936b-5f3e55a10cef tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:27.956781 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ad929cac-b722-4f59-936b-5f3e55a10cef tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:27.957487 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ad929cac-b722-4f59-936b-5f3e55a10cef tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:27.957937 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ad929cac-b722-4f59-936b-5f3e55a10cef tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:27.958543 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ad929cac-b722-4f59-936b-5f3e55a10cef tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:28.107899 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ad929cac-b722-4f59-936b-5f3e55a10cef tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:28.115779 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ad929cac-b722-4f59-936b-5f3e55a10cef tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388" status: 200 len: 1522 microversion: 2.1 time: 0.173026 Oct 17 14:30:28.116341 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3171/6480] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:27 2022] GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:29.140076 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-71b6705f-77d3-4cbc-bc7f-c4d7834aaa59 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:29.140688 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-71b6705f-77d3-4cbc-bc7f-c4d7834aaa59 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: f4e05674-5f71-4ccc-97fe-06094b862388] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:29.148379 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-71b6705f-77d3-4cbc-bc7f-c4d7834aaa59 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:29.148863 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-71b6705f-77d3-4cbc-bc7f-c4d7834aaa59 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:29.149320 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-71b6705f-77d3-4cbc-bc7f-c4d7834aaa59 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:29.149999 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-71b6705f-77d3-4cbc-bc7f-c4d7834aaa59 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:29.150450 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-71b6705f-77d3-4cbc-bc7f-c4d7834aaa59 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:29.150881 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-71b6705f-77d3-4cbc-bc7f-c4d7834aaa59 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:29.288089 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-71b6705f-77d3-4cbc-bc7f-c4d7834aaa59 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:29.300902 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-71b6705f-77d3-4cbc-bc7f-c4d7834aaa59 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388" status: 200 len: 1522 microversion: 2.1 time: 0.164541 Oct 17 14:30:29.301778 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3310/6481] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:29 2022] GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:30.328659 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a5c9576f-b894-4fef-a507-60fc02fa0552 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:30.329669 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a5c9576f-b894-4fef-a507-60fc02fa0552 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: f4e05674-5f71-4ccc-97fe-06094b862388] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:30.343017 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a5c9576f-b894-4fef-a507-60fc02fa0552 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:30.343771 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a5c9576f-b894-4fef-a507-60fc02fa0552 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:30.344506 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a5c9576f-b894-4fef-a507-60fc02fa0552 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:30.345666 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a5c9576f-b894-4fef-a507-60fc02fa0552 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:30.346482 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a5c9576f-b894-4fef-a507-60fc02fa0552 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:30.347225 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a5c9576f-b894-4fef-a507-60fc02fa0552 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:30.492523 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a5c9576f-b894-4fef-a507-60fc02fa0552 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:30.505030 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a5c9576f-b894-4fef-a507-60fc02fa0552 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388" status: 200 len: 1522 microversion: 2.1 time: 0.182702 Oct 17 14:30:30.505823 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3172/6482] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:30 2022] GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:31.533556 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b14a59c4-01c5-42f3-b1ae-39217f670370 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:31.534431 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b14a59c4-01c5-42f3-b1ae-39217f670370 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: f4e05674-5f71-4ccc-97fe-06094b862388] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:31.543255 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b14a59c4-01c5-42f3-b1ae-39217f670370 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:31.543982 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b14a59c4-01c5-42f3-b1ae-39217f670370 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:31.544646 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b14a59c4-01c5-42f3-b1ae-39217f670370 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:31.545631 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b14a59c4-01c5-42f3-b1ae-39217f670370 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:31.546279 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b14a59c4-01c5-42f3-b1ae-39217f670370 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:31.546883 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b14a59c4-01c5-42f3-b1ae-39217f670370 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:31.567316 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:30:31.686860 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b14a59c4-01c5-42f3-b1ae-39217f670370 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:31.697556 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b14a59c4-01c5-42f3-b1ae-39217f670370 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388" status: 200 len: 1522 microversion: 2.1 time: 0.171910 Oct 17 14:30:31.698118 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3311/6483] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:31 2022] GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:32.724388 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5d404089-7d13-4e97-b3d8-fc02caa86c04 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:32.725229 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5d404089-7d13-4e97-b3d8-fc02caa86c04 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: f4e05674-5f71-4ccc-97fe-06094b862388] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:32.732585 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5d404089-7d13-4e97-b3d8-fc02caa86c04 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:32.733085 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5d404089-7d13-4e97-b3d8-fc02caa86c04 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:32.733530 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5d404089-7d13-4e97-b3d8-fc02caa86c04 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:32.734241 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5d404089-7d13-4e97-b3d8-fc02caa86c04 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:32.734711 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5d404089-7d13-4e97-b3d8-fc02caa86c04 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:32.735149 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5d404089-7d13-4e97-b3d8-fc02caa86c04 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:32.875947 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5d404089-7d13-4e97-b3d8-fc02caa86c04 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:32.888154 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5d404089-7d13-4e97-b3d8-fc02caa86c04 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388" status: 200 len: 1522 microversion: 2.1 time: 0.170166 Oct 17 14:30:32.888886 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3173/6484] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:32 2022] GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:33.919152 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-649ab81a-4082-4961-957b-319af6c46980 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:33.920179 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-649ab81a-4082-4961-957b-319af6c46980 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: f4e05674-5f71-4ccc-97fe-06094b862388] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:33.930851 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-649ab81a-4082-4961-957b-319af6c46980 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:33.931359 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-649ab81a-4082-4961-957b-319af6c46980 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:33.931786 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-649ab81a-4082-4961-957b-319af6c46980 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:33.932475 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-649ab81a-4082-4961-957b-319af6c46980 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:33.932915 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-649ab81a-4082-4961-957b-319af6c46980 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:33.933330 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-649ab81a-4082-4961-957b-319af6c46980 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:34.081790 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-649ab81a-4082-4961-957b-319af6c46980 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:34.090142 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-649ab81a-4082-4961-957b-319af6c46980 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388" status: 200 len: 1522 microversion: 2.1 time: 0.177585 Oct 17 14:30:34.090949 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3312/6485] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:33 2022] GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:35.117288 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c7c75173-6ff7-4d34-899a-7934f79cccc3 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:35.117898 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c7c75173-6ff7-4d34-899a-7934f79cccc3 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: f4e05674-5f71-4ccc-97fe-06094b862388] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:35.125365 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7c75173-6ff7-4d34-899a-7934f79cccc3 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:35.125860 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7c75173-6ff7-4d34-899a-7934f79cccc3 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:35.126307 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7c75173-6ff7-4d34-899a-7934f79cccc3 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:35.127021 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7c75173-6ff7-4d34-899a-7934f79cccc3 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:35.127516 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7c75173-6ff7-4d34-899a-7934f79cccc3 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:35.127951 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7c75173-6ff7-4d34-899a-7934f79cccc3 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:35.143063 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:30:35.268678 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c7c75173-6ff7-4d34-899a-7934f79cccc3 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:35.277198 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c7c75173-6ff7-4d34-899a-7934f79cccc3 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388" status: 200 len: 1522 microversion: 2.1 time: 0.166275 Oct 17 14:30:35.278120 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3174/6486] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:35 2022] GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:36.305554 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-97d1588e-0606-4231-8807-a1d9e1ba820d tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:36.306230 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-97d1588e-0606-4231-8807-a1d9e1ba820d tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: f4e05674-5f71-4ccc-97fe-06094b862388] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:36.313524 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-97d1588e-0606-4231-8807-a1d9e1ba820d tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:36.314116 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-97d1588e-0606-4231-8807-a1d9e1ba820d tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:36.314618 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-97d1588e-0606-4231-8807-a1d9e1ba820d tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:36.315534 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-97d1588e-0606-4231-8807-a1d9e1ba820d tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:36.316134 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-97d1588e-0606-4231-8807-a1d9e1ba820d tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:36.316645 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-97d1588e-0606-4231-8807-a1d9e1ba820d tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:36.460397 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-97d1588e-0606-4231-8807-a1d9e1ba820d tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:36.468519 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-97d1588e-0606-4231-8807-a1d9e1ba820d tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388" status: 200 len: 1522 microversion: 2.1 time: 0.169693 Oct 17 14:30:36.469080 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3313/6487] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:36 2022] GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:37.505364 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-552ca0ff-1a90-457a-b24d-53fae7d0bfe4 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:37.506319 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-552ca0ff-1a90-457a-b24d-53fae7d0bfe4 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: f4e05674-5f71-4ccc-97fe-06094b862388] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:37.515217 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-552ca0ff-1a90-457a-b24d-53fae7d0bfe4 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:37.515734 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-552ca0ff-1a90-457a-b24d-53fae7d0bfe4 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:37.516176 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-552ca0ff-1a90-457a-b24d-53fae7d0bfe4 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:37.516877 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-552ca0ff-1a90-457a-b24d-53fae7d0bfe4 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:37.517338 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-552ca0ff-1a90-457a-b24d-53fae7d0bfe4 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:37.517794 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-552ca0ff-1a90-457a-b24d-53fae7d0bfe4 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:37.650677 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-552ca0ff-1a90-457a-b24d-53fae7d0bfe4 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:37.659275 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-552ca0ff-1a90-457a-b24d-53fae7d0bfe4 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388" status: 200 len: 1522 microversion: 2.1 time: 0.161169 Oct 17 14:30:37.659853 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3175/6488] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:37 2022] GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:38.685839 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-18103dbe-2a49-4da0-8ec3-53d885075d02 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:38.686445 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-18103dbe-2a49-4da0-8ec3-53d885075d02 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: f4e05674-5f71-4ccc-97fe-06094b862388] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:38.693764 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-18103dbe-2a49-4da0-8ec3-53d885075d02 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:38.694236 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-18103dbe-2a49-4da0-8ec3-53d885075d02 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:38.694663 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-18103dbe-2a49-4da0-8ec3-53d885075d02 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:38.695386 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-18103dbe-2a49-4da0-8ec3-53d885075d02 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:38.695831 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-18103dbe-2a49-4da0-8ec3-53d885075d02 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:38.696245 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-18103dbe-2a49-4da0-8ec3-53d885075d02 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:38.833743 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-18103dbe-2a49-4da0-8ec3-53d885075d02 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:38.845183 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-18103dbe-2a49-4da0-8ec3-53d885075d02 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388" status: 200 len: 1522 microversion: 2.1 time: 0.165177 Oct 17 14:30:38.845974 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3314/6489] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:38 2022] GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:39.876323 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a48693e3-daab-4e64-99d9-4b5f3cf6c401 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:39.877368 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a48693e3-daab-4e64-99d9-4b5f3cf6c401 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: f4e05674-5f71-4ccc-97fe-06094b862388] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:39.881797 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=32 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:30:39.889427 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a48693e3-daab-4e64-99d9-4b5f3cf6c401 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:39.889923 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a48693e3-daab-4e64-99d9-4b5f3cf6c401 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:39.890373 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a48693e3-daab-4e64-99d9-4b5f3cf6c401 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:39.891066 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a48693e3-daab-4e64-99d9-4b5f3cf6c401 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:39.891552 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a48693e3-daab-4e64-99d9-4b5f3cf6c401 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:39.891986 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a48693e3-daab-4e64-99d9-4b5f3cf6c401 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:40.031599 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a48693e3-daab-4e64-99d9-4b5f3cf6c401 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:40.039773 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a48693e3-daab-4e64-99d9-4b5f3cf6c401 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388" status: 200 len: 1522 microversion: 2.1 time: 0.170298 Oct 17 14:30:40.040351 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3176/6490] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:39 2022] GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:41.066216 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a025774c-7d9c-4c53-b1a5-648d6064d56a tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:41.067264 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a025774c-7d9c-4c53-b1a5-648d6064d56a tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: f4e05674-5f71-4ccc-97fe-06094b862388] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:41.071573 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=32 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:30:41.078318 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a025774c-7d9c-4c53-b1a5-648d6064d56a tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:41.078798 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a025774c-7d9c-4c53-b1a5-648d6064d56a tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:41.079264 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a025774c-7d9c-4c53-b1a5-648d6064d56a tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:41.079963 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a025774c-7d9c-4c53-b1a5-648d6064d56a tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:41.080418 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a025774c-7d9c-4c53-b1a5-648d6064d56a tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:41.080837 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a025774c-7d9c-4c53-b1a5-648d6064d56a tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:41.212281 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a025774c-7d9c-4c53-b1a5-648d6064d56a tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:41.222283 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a025774c-7d9c-4c53-b1a5-648d6064d56a tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388" status: 200 len: 1522 microversion: 2.1 time: 0.162689 Oct 17 14:30:41.222862 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3315/6491] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:41 2022] GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:42.250197 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-47d1167a-29ed-4570-bb24-085b932baa15 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:42.250802 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-47d1167a-29ed-4570-bb24-085b932baa15 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: f4e05674-5f71-4ccc-97fe-06094b862388] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:42.260341 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-47d1167a-29ed-4570-bb24-085b932baa15 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:42.261018 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-47d1167a-29ed-4570-bb24-085b932baa15 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:42.261539 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-47d1167a-29ed-4570-bb24-085b932baa15 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:42.262581 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-47d1167a-29ed-4570-bb24-085b932baa15 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:42.263428 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-47d1167a-29ed-4570-bb24-085b932baa15 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:42.263951 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-47d1167a-29ed-4570-bb24-085b932baa15 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:42.417913 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-47d1167a-29ed-4570-bb24-085b932baa15 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:42.426329 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-47d1167a-29ed-4570-bb24-085b932baa15 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388" status: 200 len: 1522 microversion: 2.1 time: 0.180762 Oct 17 14:30:42.426911 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3177/6492] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:42 2022] GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:43.450226 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-67f0417e-d064-43c4-9ba7-0128bb2c871a tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:43.451015 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-67f0417e-d064-43c4-9ba7-0128bb2c871a tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: f4e05674-5f71-4ccc-97fe-06094b862388] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:43.458544 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-67f0417e-d064-43c4-9ba7-0128bb2c871a tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:43.459030 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-67f0417e-d064-43c4-9ba7-0128bb2c871a tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:43.459512 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-67f0417e-d064-43c4-9ba7-0128bb2c871a tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:43.460218 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-67f0417e-d064-43c4-9ba7-0128bb2c871a tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:43.460674 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-67f0417e-d064-43c4-9ba7-0128bb2c871a tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:43.461105 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-67f0417e-d064-43c4-9ba7-0128bb2c871a tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:43.599422 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-67f0417e-d064-43c4-9ba7-0128bb2c871a tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:43.608053 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-67f0417e-d064-43c4-9ba7-0128bb2c871a tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388" status: 200 len: 1522 microversion: 2.1 time: 0.162018 Oct 17 14:30:43.608627 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3316/6493] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:43 2022] GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:44.632171 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c411f1cd-46be-468e-a41e-d009a667f4df tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:44.632757 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c411f1cd-46be-468e-a41e-d009a667f4df tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: f4e05674-5f71-4ccc-97fe-06094b862388] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:44.640302 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c411f1cd-46be-468e-a41e-d009a667f4df tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:44.640811 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c411f1cd-46be-468e-a41e-d009a667f4df tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:44.641247 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c411f1cd-46be-468e-a41e-d009a667f4df tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:44.641964 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c411f1cd-46be-468e-a41e-d009a667f4df tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:44.642423 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c411f1cd-46be-468e-a41e-d009a667f4df tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:44.642854 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c411f1cd-46be-468e-a41e-d009a667f4df tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:44.709392 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-00d34c51-6c56-4530-9dc8-09d39d7a5d34 req-33fb5dc9-519c-4f56-a4f9-63437266dce9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4e05674-5f71-4ccc-97fe-06094b862388", "name": "network-vif-unplugged", "status": "completed", "tag": "7ba52b65-45f2-4ed5-ae8a-2405925a6e32"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:30:44.721708 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-00d34c51-6c56-4530-9dc8-09d39d7a5d34 req-33fb5dc9-519c-4f56-a4f9-63437266dce9 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:44.722484 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-00d34c51-6c56-4530-9dc8-09d39d7a5d34 req-33fb5dc9-519c-4f56-a4f9-63437266dce9 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:44.723096 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-00d34c51-6c56-4530-9dc8-09d39d7a5d34 req-33fb5dc9-519c-4f56-a4f9-63437266dce9 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:44.738303 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-00d34c51-6c56-4530-9dc8-09d39d7a5d34 req-33fb5dc9-519c-4f56-a4f9-63437266dce9 service nova] Creating event network-vif-unplugged:7ba52b65-45f2-4ed5-ae8a-2405925a6e32 for instance f4e05674-5f71-4ccc-97fe-06094b862388 on n-h1-854247-14 Oct 17 14:30:44.745226 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [req-00d34c51-6c56-4530-9dc8-09d39d7a5d34 req-33fb5dc9-519c-4f56-a4f9-63437266dce9 service nova] Instance f4e05674-5f71-4ccc-97fe-06094b862388 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854247-14', 'n-h1-854247-14'} {{(pid=127016) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 14:30:44.758604 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-00d34c51-6c56-4530-9dc8-09d39d7a5d34 req-33fb5dc9-519c-4f56-a4f9-63437266dce9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053730 Oct 17 14:30:44.759917 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3317/6494] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:30:44.793732 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c411f1cd-46be-468e-a41e-d009a667f4df tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:44.802051 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c411f1cd-46be-468e-a41e-d009a667f4df tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388" status: 200 len: 1521 microversion: 2.1 time: 0.173846 Oct 17 14:30:44.803967 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3178/6495] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:44 2022] GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:45.828713 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e5a841ed-25f2-4a1e-8573-46bf3199c5c7 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:45.829459 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e5a841ed-25f2-4a1e-8573-46bf3199c5c7 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: f4e05674-5f71-4ccc-97fe-06094b862388] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:45.837748 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e5a841ed-25f2-4a1e-8573-46bf3199c5c7 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:45.838251 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e5a841ed-25f2-4a1e-8573-46bf3199c5c7 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:45.838706 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e5a841ed-25f2-4a1e-8573-46bf3199c5c7 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:45.839485 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e5a841ed-25f2-4a1e-8573-46bf3199c5c7 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:45.839941 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e5a841ed-25f2-4a1e-8573-46bf3199c5c7 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:45.840441 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e5a841ed-25f2-4a1e-8573-46bf3199c5c7 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:45.983562 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e5a841ed-25f2-4a1e-8573-46bf3199c5c7 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:45.991645 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e5a841ed-25f2-4a1e-8573-46bf3199c5c7 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388" status: 200 len: 1519 microversion: 2.1 time: 0.168166 Oct 17 14:30:45.992219 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3318/6496] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:45 2022] GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388 => generated 1519 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:46.793565 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-82fe0948-c948-4a3b-9d87-4d4c8b2b8b7a req-dd5bcadb-a951-4861-aa25-29cc0a2a4549 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4e05674-5f71-4ccc-97fe-06094b862388", "tag": "7ba52b65-45f2-4ed5-ae8a-2405925a6e32"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:30:46.810461 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-82fe0948-c948-4a3b-9d87-4d4c8b2b8b7a req-dd5bcadb-a951-4861-aa25-29cc0a2a4549 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:46.810937 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-82fe0948-c948-4a3b-9d87-4d4c8b2b8b7a req-dd5bcadb-a951-4861-aa25-29cc0a2a4549 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:46.811421 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-82fe0948-c948-4a3b-9d87-4d4c8b2b8b7a req-dd5bcadb-a951-4861-aa25-29cc0a2a4549 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:46.826313 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-82fe0948-c948-4a3b-9d87-4d4c8b2b8b7a req-dd5bcadb-a951-4861-aa25-29cc0a2a4549 service nova] Creating event network-changed:7ba52b65-45f2-4ed5-ae8a-2405925a6e32 for instance f4e05674-5f71-4ccc-97fe-06094b862388 on n-h1-854247-14 Oct 17 14:30:46.831901 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [req-82fe0948-c948-4a3b-9d87-4d4c8b2b8b7a req-dd5bcadb-a951-4861-aa25-29cc0a2a4549 service nova] Instance f4e05674-5f71-4ccc-97fe-06094b862388 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854247-14', 'n-h1-854247-14'} {{(pid=127017) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 14:30:46.843330 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-82fe0948-c948-4a3b-9d87-4d4c8b2b8b7a req-dd5bcadb-a951-4861-aa25-29cc0a2a4549 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055904 Oct 17 14:30:46.843924 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3179/6497] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:30:47.015955 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-29e562a5-71e0-4bc1-9d12-1a05f1899459 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:47.016749 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-29e562a5-71e0-4bc1-9d12-1a05f1899459 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: f4e05674-5f71-4ccc-97fe-06094b862388] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:47.024796 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-29e562a5-71e0-4bc1-9d12-1a05f1899459 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:47.025287 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-29e562a5-71e0-4bc1-9d12-1a05f1899459 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:47.025722 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-29e562a5-71e0-4bc1-9d12-1a05f1899459 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:47.026460 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-29e562a5-71e0-4bc1-9d12-1a05f1899459 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:47.027397 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-29e562a5-71e0-4bc1-9d12-1a05f1899459 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:47.027862 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-29e562a5-71e0-4bc1-9d12-1a05f1899459 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:47.251070 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-29e562a5-71e0-4bc1-9d12-1a05f1899459 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:47.260822 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-29e562a5-71e0-4bc1-9d12-1a05f1899459 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388" status: 200 len: 1519 microversion: 2.1 time: 0.248919 Oct 17 14:30:47.263858 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3319/6498] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:47 2022] GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388 => generated 1519 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:48.291056 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b878cf91-ed0e-4cd3-a9cd-8c7d27056389 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:48.292079 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b878cf91-ed0e-4cd3-a9cd-8c7d27056389 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: f4e05674-5f71-4ccc-97fe-06094b862388] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:48.301507 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b878cf91-ed0e-4cd3-a9cd-8c7d27056389 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:48.302218 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b878cf91-ed0e-4cd3-a9cd-8c7d27056389 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:48.302859 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b878cf91-ed0e-4cd3-a9cd-8c7d27056389 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:48.303914 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b878cf91-ed0e-4cd3-a9cd-8c7d27056389 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:48.304579 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b878cf91-ed0e-4cd3-a9cd-8c7d27056389 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:48.305202 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b878cf91-ed0e-4cd3-a9cd-8c7d27056389 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:48.452841 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b878cf91-ed0e-4cd3-a9cd-8c7d27056389 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:48.464015 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b878cf91-ed0e-4cd3-a9cd-8c7d27056389 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388" status: 200 len: 1516 microversion: 2.1 time: 0.180429 Oct 17 14:30:48.464800 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3180/6499] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:48 2022] GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388 => generated 1516 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:48.489893 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-55aa4d12-896c-4b18-a0a1-c1b1a367119e tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:30:48.490465 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-55aa4d12-896c-4b18-a0a1-c1b1a367119e tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: f4e05674-5f71-4ccc-97fe-06094b862388] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:48.500985 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-55aa4d12-896c-4b18-a0a1-c1b1a367119e tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:48.501569 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-55aa4d12-896c-4b18-a0a1-c1b1a367119e tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:48.502139 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-55aa4d12-896c-4b18-a0a1-c1b1a367119e tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:48.503208 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-55aa4d12-896c-4b18-a0a1-c1b1a367119e tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:48.503810 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-55aa4d12-896c-4b18-a0a1-c1b1a367119e tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:48.504367 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-55aa4d12-896c-4b18-a0a1-c1b1a367119e tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:48.579912 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-55aa4d12-896c-4b18-a0a1-c1b1a367119e tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "POST /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388/action" status: 204 len: 0 microversion: 2.1 time: 0.095737 Oct 17 14:30:48.580642 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3320/6500] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:30:48 2022] POST /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388/action => generated 0 bytes in 98 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:30:48.589224 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f1106464-8e13-421c-a562-855f2104c8a2 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:48.589914 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f1106464-8e13-421c-a562-855f2104c8a2 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: f4e05674-5f71-4ccc-97fe-06094b862388] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:48.596177 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f1106464-8e13-421c-a562-855f2104c8a2 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:48.596740 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f1106464-8e13-421c-a562-855f2104c8a2 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:48.597234 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f1106464-8e13-421c-a562-855f2104c8a2 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:48.598061 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f1106464-8e13-421c-a562-855f2104c8a2 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:48.598552 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f1106464-8e13-421c-a562-855f2104c8a2 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:48.598968 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f1106464-8e13-421c-a562-855f2104c8a2 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:48.820926 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f1106464-8e13-421c-a562-855f2104c8a2 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:48.829820 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f1106464-8e13-421c-a562-855f2104c8a2 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388" status: 200 len: 1516 microversion: 2.1 time: 0.244252 Oct 17 14:30:48.830444 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3181/6501] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:48 2022] GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388 => generated 1516 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:30:49.746729 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-b20e6a69-cdcc-4b8e-894c-810f0801fadc req-79c9afb2-5391-4912-9025-2dc68510f7b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4e05674-5f71-4ccc-97fe-06094b862388", "name": "network-vif-plugged", "status": "completed", "tag": "7ba52b65-45f2-4ed5-ae8a-2405925a6e32"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:30:49.758167 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-b20e6a69-cdcc-4b8e-894c-810f0801fadc req-79c9afb2-5391-4912-9025-2dc68510f7b0 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:49.758875 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-b20e6a69-cdcc-4b8e-894c-810f0801fadc req-79c9afb2-5391-4912-9025-2dc68510f7b0 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:49.759276 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-b20e6a69-cdcc-4b8e-894c-810f0801fadc req-79c9afb2-5391-4912-9025-2dc68510f7b0 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:49.771388 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-b20e6a69-cdcc-4b8e-894c-810f0801fadc req-79c9afb2-5391-4912-9025-2dc68510f7b0 service nova] Creating event network-vif-plugged:7ba52b65-45f2-4ed5-ae8a-2405925a6e32 for instance f4e05674-5f71-4ccc-97fe-06094b862388 on n-h1-854247-14 Oct 17 14:30:49.776329 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-b20e6a69-cdcc-4b8e-894c-810f0801fadc req-79c9afb2-5391-4912-9025-2dc68510f7b0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033754 Oct 17 14:30:49.777420 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3321/6502] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:30:49.855420 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-14287fe0-ea3f-40fc-9c1f-db347487a678 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:49.856426 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-14287fe0-ea3f-40fc-9c1f-db347487a678 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: f4e05674-5f71-4ccc-97fe-06094b862388] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:49.865987 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-14287fe0-ea3f-40fc-9c1f-db347487a678 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:49.866565 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-14287fe0-ea3f-40fc-9c1f-db347487a678 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:49.867013 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-14287fe0-ea3f-40fc-9c1f-db347487a678 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:49.867739 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-14287fe0-ea3f-40fc-9c1f-db347487a678 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:49.868199 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-14287fe0-ea3f-40fc-9c1f-db347487a678 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:49.868631 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-14287fe0-ea3f-40fc-9c1f-db347487a678 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:50.008323 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-14287fe0-ea3f-40fc-9c1f-db347487a678 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:50.018386 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-14287fe0-ea3f-40fc-9c1f-db347487a678 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388" status: 200 len: 1508 microversion: 2.1 time: 0.167681 Oct 17 14:30:50.018975 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3182/6503] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:49 2022] GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388 => generated 1508 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:50.042356 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-bf7c8787-006b-453c-b182-b9bc725385bb tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:50.043059 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-bf7c8787-006b-453c-b182-b9bc725385bb tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: f4e05674-5f71-4ccc-97fe-06094b862388] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:50.049950 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bf7c8787-006b-453c-b182-b9bc725385bb tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:50.050438 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bf7c8787-006b-453c-b182-b9bc725385bb tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:50.050894 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bf7c8787-006b-453c-b182-b9bc725385bb tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:50.051602 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bf7c8787-006b-453c-b182-b9bc725385bb tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:50.052058 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bf7c8787-006b-453c-b182-b9bc725385bb tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:50.052475 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bf7c8787-006b-453c-b182-b9bc725385bb tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:50.184080 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-bf7c8787-006b-453c-b182-b9bc725385bb tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:50.192637 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-bf7c8787-006b-453c-b182-b9bc725385bb tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388" status: 200 len: 1508 microversion: 2.1 time: 0.154690 Oct 17 14:30:50.193228 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3322/6504] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:50 2022] GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:50.218341 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ed5a2bee-982d-42fe-a22b-f1f3016180ae tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Action: 'create', calling method: .version_select at 0x7f7cd981a8b0>, body: {"keypair": {"name": "tempest-keypair-1132562264", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNyPQ7SvI30ssrbgvP5SXPda78TbWdWQ0fkawuHYI+QxE8LkKh9NQOHsJBAivrGjY/lq5iodJ/9SQ8bS3q0ku8aFdbJOqs2WPa7+d3+xhjsvo+mQD8f6C1IzuVXdoTReDg=="}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:30:50.235051 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-ed5a2bee-982d-42fe-a22b-f1f3016180ae tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Getting quotas for project bd9e80b7afc44137bb10c1f9dc2de673. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:30:50.240688 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-ed5a2bee-982d-42fe-a22b-f1f3016180ae tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Getting quotas for user cb2c9e7d4f3e49f1928faf5f3adbfc08 and project bd9e80b7afc44137bb10c1f9dc2de673. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:30:50.270125 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ed5a2bee-982d-42fe-a22b-f1f3016180ae tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.055698 Oct 17 14:30:50.270721 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3183/6505] 10.222.0.79 () {60 vars in 1159 bytes} [Mon Oct 17 14:30:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:30:51.517798 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-511887df-c166-4a34-8229-9bb9f9f979db tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:51.518413 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-511887df-c166-4a34-8229-9bb9f9f979db tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: f4e05674-5f71-4ccc-97fe-06094b862388] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:51.525433 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-511887df-c166-4a34-8229-9bb9f9f979db tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:51.525908 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-511887df-c166-4a34-8229-9bb9f9f979db tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:51.526356 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-511887df-c166-4a34-8229-9bb9f9f979db tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:51.527417 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-511887df-c166-4a34-8229-9bb9f9f979db tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:51.527903 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-511887df-c166-4a34-8229-9bb9f9f979db tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:51.528324 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-511887df-c166-4a34-8229-9bb9f9f979db tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:51.666504 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-511887df-c166-4a34-8229-9bb9f9f979db tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:51.675513 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-511887df-c166-4a34-8229-9bb9f9f979db tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388" status: 200 len: 1508 microversion: 2.1 time: 0.161580 Oct 17 14:30:51.676091 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3323/6506] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:51 2022] GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388 => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:51.697734 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1bb09d8f-1990-4aad-835a-52fd54979577 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:51.698292 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1bb09d8f-1990-4aad-835a-52fd54979577 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: f4e05674-5f71-4ccc-97fe-06094b862388] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:51.705997 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1bb09d8f-1990-4aad-835a-52fd54979577 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:51.706490 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1bb09d8f-1990-4aad-835a-52fd54979577 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:51.706938 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1bb09d8f-1990-4aad-835a-52fd54979577 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:51.707663 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1bb09d8f-1990-4aad-835a-52fd54979577 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:51.708120 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1bb09d8f-1990-4aad-835a-52fd54979577 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:51.708573 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1bb09d8f-1990-4aad-835a-52fd54979577 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:51.734829 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1bb09d8f-1990-4aad-835a-52fd54979577 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: f4e05674-5f71-4ccc-97fe-06094b862388] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:30:51.824943 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1bb09d8f-1990-4aad-835a-52fd54979577 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "DELETE /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388" status: 204 len: 0 microversion: 2.1 time: 0.130876 Oct 17 14:30:51.825526 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3184/6507] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:30:51 2022] DELETE /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:30:51.888649 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ad27e5b2-9e5a-4477-910f-594837fa35ba tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-321496318", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "5e3f2ecf-8d4b-4c73-8b3b-4c0abeb20aed"}]}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:30:51.949155 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-ad27e5b2-9e5a-4477-910f-594837fa35ba tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] validate_networks() for [('5e3f2ecf-8d4b-4c73-8b3b-4c0abeb20aed', None, None, None, None, None)] {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:30:52.354699 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-ad27e5b2-9e5a-4477-910f-594837fa35ba tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:30:52.355397 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-ad27e5b2-9e5a-4477-910f-594837fa35ba tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:30:52.356297 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-ad27e5b2-9e5a-4477-910f-594837fa35ba tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:30:52.356948 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-ad27e5b2-9e5a-4477-910f-594837fa35ba tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:30:52.357363 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-ad27e5b2-9e5a-4477-910f-594837fa35ba tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:30:52.367551 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ad27e5b2-9e5a-4477-910f-594837fa35ba tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:52.368027 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ad27e5b2-9e5a-4477-910f-594837fa35ba tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:52.368458 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ad27e5b2-9e5a-4477-910f-594837fa35ba tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:52.369188 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ad27e5b2-9e5a-4477-910f-594837fa35ba tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:52.369640 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ad27e5b2-9e5a-4477-910f-594837fa35ba tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:52.370065 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ad27e5b2-9e5a-4477-910f-594837fa35ba tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:52.388732 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-ad27e5b2-9e5a-4477-910f-594837fa35ba tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Getting quotas for project bd9e80b7afc44137bb10c1f9dc2de673. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:30:52.394248 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-ad27e5b2-9e5a-4477-910f-594837fa35ba tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Getting quotas for user cb2c9e7d4f3e49f1928faf5f3adbfc08 and project bd9e80b7afc44137bb10c1f9dc2de673. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:30:52.411475 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ad27e5b2-9e5a-4477-910f-594837fa35ba tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:30:52.415005 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ad27e5b2-9e5a-4477-910f-594837fa35ba tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: 148d0b56-85f9-4bd2-81fd-60f418e2ae01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:30:52.461830 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ad27e5b2-9e5a-4477-910f-594837fa35ba tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.580837 Oct 17 14:30:52.462500 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3324/6508] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 14:30:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:30:52.474823 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b1f3560f-6fc0-4a81-bdb7-6a670e6503a2 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:52.475570 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b1f3560f-6fc0-4a81-bdb7-6a670e6503a2 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: 148d0b56-85f9-4bd2-81fd-60f418e2ae01] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:52.532363 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b1f3560f-6fc0-4a81-bdb7-6a670e6503a2 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:52.539709 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b1f3560f-6fc0-4a81-bdb7-6a670e6503a2 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01" status: 200 len: 1217 microversion: 2.1 time: 0.069260 Oct 17 14:30:52.540275 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3185/6509] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:52 2022] GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01 => generated 1217 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:53.563200 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f6043829-b19e-4b26-8830-6b218d2e0aa3 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:53.563863 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f6043829-b19e-4b26-8830-6b218d2e0aa3 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: 148d0b56-85f9-4bd2-81fd-60f418e2ae01] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:53.571953 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f6043829-b19e-4b26-8830-6b218d2e0aa3 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:53.572680 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f6043829-b19e-4b26-8830-6b218d2e0aa3 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:53.573235 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f6043829-b19e-4b26-8830-6b218d2e0aa3 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:53.573998 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f6043829-b19e-4b26-8830-6b218d2e0aa3 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:53.574832 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f6043829-b19e-4b26-8830-6b218d2e0aa3 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:53.575526 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f6043829-b19e-4b26-8830-6b218d2e0aa3 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:53.586527 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-21151377-1e0d-4f1e-b909-112cd64310b8 req-9fafba18-0efc-4515-a9b1-bc5168cd6397 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4e05674-5f71-4ccc-97fe-06094b862388", "name": "network-vif-deleted", "tag": "7ba52b65-45f2-4ed5-ae8a-2405925a6e32"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:30:53.598975 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-21151377-1e0d-4f1e-b909-112cd64310b8 req-9fafba18-0efc-4515-a9b1-bc5168cd6397 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:53.599750 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-21151377-1e0d-4f1e-b909-112cd64310b8 req-9fafba18-0efc-4515-a9b1-bc5168cd6397 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:53.600368 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-21151377-1e0d-4f1e-b909-112cd64310b8 req-9fafba18-0efc-4515-a9b1-bc5168cd6397 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:53.614322 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-21151377-1e0d-4f1e-b909-112cd64310b8 req-9fafba18-0efc-4515-a9b1-bc5168cd6397 service nova] Creating event network-vif-deleted:7ba52b65-45f2-4ed5-ae8a-2405925a6e32 for instance f4e05674-5f71-4ccc-97fe-06094b862388 on n-h1-854247-14 Oct 17 14:30:53.621266 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-21151377-1e0d-4f1e-b909-112cd64310b8 req-9fafba18-0efc-4515-a9b1-bc5168cd6397 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038190 Oct 17 14:30:53.622532 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3186/6510] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:30:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:30:53.660427 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f6043829-b19e-4b26-8830-6b218d2e0aa3 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:53.670609 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f6043829-b19e-4b26-8830-6b218d2e0aa3 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01" status: 200 len: 1269 microversion: 2.1 time: 0.112438 Oct 17 14:30:53.679338 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3325/6511] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:53 2022] GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01 => generated 1269 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:54.703750 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ceab7de8-18fc-4cd4-a92b-567530d631a5 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:54.704930 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ceab7de8-18fc-4cd4-a92b-567530d631a5 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: 148d0b56-85f9-4bd2-81fd-60f418e2ae01] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:54.711463 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ceab7de8-18fc-4cd4-a92b-567530d631a5 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:54.711968 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ceab7de8-18fc-4cd4-a92b-567530d631a5 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:54.712418 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ceab7de8-18fc-4cd4-a92b-567530d631a5 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:54.713131 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ceab7de8-18fc-4cd4-a92b-567530d631a5 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:54.713597 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ceab7de8-18fc-4cd4-a92b-567530d631a5 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:54.714034 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ceab7de8-18fc-4cd4-a92b-567530d631a5 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:54.858883 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ceab7de8-18fc-4cd4-a92b-567530d631a5 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:54.867455 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ceab7de8-18fc-4cd4-a92b-567530d631a5 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01" status: 200 len: 1317 microversion: 2.1 time: 0.169123 Oct 17 14:30:54.868036 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3187/6512] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:54 2022] GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01 => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:55.639053 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-4f3092f3-aa2a-41cd-81ad-d802d439202c req-e84b22e6-b9f7-4021-a9bd-97b652c22bc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "148d0b56-85f9-4bd2-81fd-60f418e2ae01", "tag": "cd8bcfa6-8db1-433f-b9cc-88caaaa1bb7f"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:30:55.655118 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-4f3092f3-aa2a-41cd-81ad-d802d439202c req-e84b22e6-b9f7-4021-a9bd-97b652c22bc1 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:55.655612 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-4f3092f3-aa2a-41cd-81ad-d802d439202c req-e84b22e6-b9f7-4021-a9bd-97b652c22bc1 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:55.656034 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-4f3092f3-aa2a-41cd-81ad-d802d439202c req-e84b22e6-b9f7-4021-a9bd-97b652c22bc1 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:55.667539 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-4f3092f3-aa2a-41cd-81ad-d802d439202c req-e84b22e6-b9f7-4021-a9bd-97b652c22bc1 service nova] Creating event network-changed:cd8bcfa6-8db1-433f-b9cc-88caaaa1bb7f for instance 148d0b56-85f9-4bd2-81fd-60f418e2ae01 on n-h1-854247-14 Oct 17 14:30:55.672825 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-4f3092f3-aa2a-41cd-81ad-d802d439202c req-e84b22e6-b9f7-4021-a9bd-97b652c22bc1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038803 Oct 17 14:30:55.673394 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3326/6513] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:30:55.893950 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9be527c2-ad92-45b5-89f3-59fe895c3821 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:55.894918 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9be527c2-ad92-45b5-89f3-59fe895c3821 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: 148d0b56-85f9-4bd2-81fd-60f418e2ae01] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:55.905621 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9be527c2-ad92-45b5-89f3-59fe895c3821 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:55.906134 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9be527c2-ad92-45b5-89f3-59fe895c3821 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:55.906626 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9be527c2-ad92-45b5-89f3-59fe895c3821 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:55.907428 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9be527c2-ad92-45b5-89f3-59fe895c3821 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:55.907927 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9be527c2-ad92-45b5-89f3-59fe895c3821 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:55.908347 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9be527c2-ad92-45b5-89f3-59fe895c3821 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:56.050136 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9be527c2-ad92-45b5-89f3-59fe895c3821 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:56.059980 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9be527c2-ad92-45b5-89f3-59fe895c3821 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01" status: 200 len: 1317 microversion: 2.1 time: 0.172578 Oct 17 14:30:56.061124 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3188/6514] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:55 2022] GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01 => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:57.089144 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b1ec0904-5b61-46d2-bed3-1d5bf951812e tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:57.090486 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b1ec0904-5b61-46d2-bed3-1d5bf951812e tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: 148d0b56-85f9-4bd2-81fd-60f418e2ae01] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:57.097589 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b1ec0904-5b61-46d2-bed3-1d5bf951812e tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:57.098093 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b1ec0904-5b61-46d2-bed3-1d5bf951812e tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:57.098540 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b1ec0904-5b61-46d2-bed3-1d5bf951812e tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:57.099280 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b1ec0904-5b61-46d2-bed3-1d5bf951812e tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:57.099734 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b1ec0904-5b61-46d2-bed3-1d5bf951812e tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:57.100166 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b1ec0904-5b61-46d2-bed3-1d5bf951812e tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:57.246566 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b1ec0904-5b61-46d2-bed3-1d5bf951812e tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:57.256275 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b1ec0904-5b61-46d2-bed3-1d5bf951812e tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01" status: 200 len: 1317 microversion: 2.1 time: 0.172148 Oct 17 14:30:57.271191 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3327/6515] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:57 2022] GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01 => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:58.284099 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9b5dd9dc-a742-48fa-a29b-5905dabc6b25 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:58.285145 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9b5dd9dc-a742-48fa-a29b-5905dabc6b25 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: 148d0b56-85f9-4bd2-81fd-60f418e2ae01] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:58.295302 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9b5dd9dc-a742-48fa-a29b-5905dabc6b25 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:58.295918 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9b5dd9dc-a742-48fa-a29b-5905dabc6b25 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:58.296370 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9b5dd9dc-a742-48fa-a29b-5905dabc6b25 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:58.297075 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9b5dd9dc-a742-48fa-a29b-5905dabc6b25 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:58.297535 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9b5dd9dc-a742-48fa-a29b-5905dabc6b25 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:58.297971 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9b5dd9dc-a742-48fa-a29b-5905dabc6b25 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:58.444624 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9b5dd9dc-a742-48fa-a29b-5905dabc6b25 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:58.454410 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9b5dd9dc-a742-48fa-a29b-5905dabc6b25 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01" status: 200 len: 1317 microversion: 2.1 time: 0.176830 Oct 17 14:30:58.455002 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3189/6516] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:58 2022] GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01 => generated 1317 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:59.482650 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b95a3846-66d3-430a-b569-b217d89c0fb6 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:59.483600 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b95a3846-66d3-430a-b569-b217d89c0fb6 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: 148d0b56-85f9-4bd2-81fd-60f418e2ae01] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:59.496109 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b95a3846-66d3-430a-b569-b217d89c0fb6 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:59.496922 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b95a3846-66d3-430a-b569-b217d89c0fb6 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:59.497670 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b95a3846-66d3-430a-b569-b217d89c0fb6 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:59.498699 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b95a3846-66d3-430a-b569-b217d89c0fb6 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:59.499154 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b95a3846-66d3-430a-b569-b217d89c0fb6 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:59.499603 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b95a3846-66d3-430a-b569-b217d89c0fb6 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:59.639254 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b95a3846-66d3-430a-b569-b217d89c0fb6 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:59.647335 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b95a3846-66d3-430a-b569-b217d89c0fb6 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01" status: 200 len: 1317 microversion: 2.1 time: 0.172046 Oct 17 14:30:59.647932 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3328/6517] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:59 2022] GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01 => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:59.787031 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-5ee7756e-d5ed-4acb-9b55-fc50191bbd85 req-1bd87467-a9a8-46a6-a911-5f82240dab11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "148d0b56-85f9-4bd2-81fd-60f418e2ae01", "name": "network-vif-plugged", "status": "completed", "tag": "cd8bcfa6-8db1-433f-b9cc-88caaaa1bb7f"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:30:59.799582 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-5ee7756e-d5ed-4acb-9b55-fc50191bbd85 req-1bd87467-a9a8-46a6-a911-5f82240dab11 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:59.800078 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-5ee7756e-d5ed-4acb-9b55-fc50191bbd85 req-1bd87467-a9a8-46a6-a911-5f82240dab11 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:59.800520 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-5ee7756e-d5ed-4acb-9b55-fc50191bbd85 req-1bd87467-a9a8-46a6-a911-5f82240dab11 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:59.812005 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-5ee7756e-d5ed-4acb-9b55-fc50191bbd85 req-1bd87467-a9a8-46a6-a911-5f82240dab11 service nova] Creating event network-vif-plugged:cd8bcfa6-8db1-433f-b9cc-88caaaa1bb7f for instance 148d0b56-85f9-4bd2-81fd-60f418e2ae01 on n-h1-854247-14 Oct 17 14:30:59.817233 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-5ee7756e-d5ed-4acb-9b55-fc50191bbd85 req-1bd87467-a9a8-46a6-a911-5f82240dab11 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034182 Oct 17 14:30:59.817841 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3190/6518] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:31:00.671359 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f0e96815-e5cc-4fbd-b007-714356f5e38c tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:00.671937 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f0e96815-e5cc-4fbd-b007-714356f5e38c tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: 148d0b56-85f9-4bd2-81fd-60f418e2ae01] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:00.679515 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f0e96815-e5cc-4fbd-b007-714356f5e38c tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:00.680185 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f0e96815-e5cc-4fbd-b007-714356f5e38c tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:00.680626 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f0e96815-e5cc-4fbd-b007-714356f5e38c tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:00.681335 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f0e96815-e5cc-4fbd-b007-714356f5e38c tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:00.681789 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f0e96815-e5cc-4fbd-b007-714356f5e38c tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:00.682213 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f0e96815-e5cc-4fbd-b007-714356f5e38c tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:00.698881 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:31:00.865744 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f0e96815-e5cc-4fbd-b007-714356f5e38c tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:31:00.875834 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f0e96815-e5cc-4fbd-b007-714356f5e38c tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01" status: 200 len: 1317 microversion: 2.1 time: 0.208523 Oct 17 14:31:00.876405 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3329/6519] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:31:00 2022] GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01 => generated 1317 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:31:01.905809 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f771548a-7294-4998-b971-8d38cb970eb5 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:01.906573 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f771548a-7294-4998-b971-8d38cb970eb5 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: 148d0b56-85f9-4bd2-81fd-60f418e2ae01] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:01.913888 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f771548a-7294-4998-b971-8d38cb970eb5 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:01.914401 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f771548a-7294-4998-b971-8d38cb970eb5 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:01.914878 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f771548a-7294-4998-b971-8d38cb970eb5 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:01.915659 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f771548a-7294-4998-b971-8d38cb970eb5 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:01.916152 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f771548a-7294-4998-b971-8d38cb970eb5 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:01.916613 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f771548a-7294-4998-b971-8d38cb970eb5 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:02.111371 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f771548a-7294-4998-b971-8d38cb970eb5 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:31:02.119656 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f771548a-7294-4998-b971-8d38cb970eb5 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01" status: 200 len: 1508 microversion: 2.1 time: 0.219996 Oct 17 14:31:02.120146 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3191/6520] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:31:01 2022] GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01 => generated 1508 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:31:02.142425 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6c9700ee-1a65-4791-b9e7-942ad0cf3444 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:02.143087 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6c9700ee-1a65-4791-b9e7-942ad0cf3444 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: 148d0b56-85f9-4bd2-81fd-60f418e2ae01] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:02.150435 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6c9700ee-1a65-4791-b9e7-942ad0cf3444 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:02.151280 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6c9700ee-1a65-4791-b9e7-942ad0cf3444 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:02.151731 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6c9700ee-1a65-4791-b9e7-942ad0cf3444 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:02.152431 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6c9700ee-1a65-4791-b9e7-942ad0cf3444 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:02.152852 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6c9700ee-1a65-4791-b9e7-942ad0cf3444 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:02.153268 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6c9700ee-1a65-4791-b9e7-942ad0cf3444 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:02.288919 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6c9700ee-1a65-4791-b9e7-942ad0cf3444 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:31:02.297606 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6c9700ee-1a65-4791-b9e7-942ad0cf3444 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01" status: 200 len: 1508 microversion: 2.1 time: 0.159511 Oct 17 14:31:02.298194 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3330/6521] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:31:02 2022] GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01 => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:31:02.323148 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2420a3f3-3d05-45bb-86e3-8b9760fd3e19 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:31:02.326924 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2420a3f3-3d05-45bb-86e3-8b9760fd3e19 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: 148d0b56-85f9-4bd2-81fd-60f418e2ae01] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:02.336517 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2420a3f3-3d05-45bb-86e3-8b9760fd3e19 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:02.337218 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2420a3f3-3d05-45bb-86e3-8b9760fd3e19 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:02.337803 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2420a3f3-3d05-45bb-86e3-8b9760fd3e19 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:02.338817 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2420a3f3-3d05-45bb-86e3-8b9760fd3e19 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:02.339446 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2420a3f3-3d05-45bb-86e3-8b9760fd3e19 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:02.339943 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2420a3f3-3d05-45bb-86e3-8b9760fd3e19 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:02.369642 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2420a3f3-3d05-45bb-86e3-8b9760fd3e19 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:31:02.375831 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2420a3f3-3d05-45bb-86e3-8b9760fd3e19 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: 148d0b56-85f9-4bd2-81fd-60f418e2ae01] Old instance type m1.heat2, new instance type m1.heat {{(pid=127017) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 17 14:31:02.382924 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-2420a3f3-3d05-45bb-86e3-8b9760fd3e19 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:31:02.383412 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-2420a3f3-3d05-45bb-86e3-8b9760fd3e19 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:31:02.383905 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-2420a3f3-3d05-45bb-86e3-8b9760fd3e19 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:31:02.384396 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-2420a3f3-3d05-45bb-86e3-8b9760fd3e19 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:31:02.384818 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-2420a3f3-3d05-45bb-86e3-8b9760fd3e19 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:31:02.398979 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:31:02.453459 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2420a3f3-3d05-45bb-86e3-8b9760fd3e19 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "POST /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01/action" status: 202 len: 0 microversion: 2.1 time: 0.136716 Oct 17 14:31:02.454284 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3192/6522] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:31:02 2022] POST /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:31:02.462222 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-725066e8-6345-48e1-8245-f0e35a98e5d1 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:02.462836 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-725066e8-6345-48e1-8245-f0e35a98e5d1 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: 148d0b56-85f9-4bd2-81fd-60f418e2ae01] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:02.464799 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:31:02.466083 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=6 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:31:02.472563 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-725066e8-6345-48e1-8245-f0e35a98e5d1 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:02.473052 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-725066e8-6345-48e1-8245-f0e35a98e5d1 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:02.473491 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-725066e8-6345-48e1-8245-f0e35a98e5d1 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:02.474200 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-725066e8-6345-48e1-8245-f0e35a98e5d1 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:02.474707 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-725066e8-6345-48e1-8245-f0e35a98e5d1 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:02.475154 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-725066e8-6345-48e1-8245-f0e35a98e5d1 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:02.617770 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-725066e8-6345-48e1-8245-f0e35a98e5d1 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:31:02.626357 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-725066e8-6345-48e1-8245-f0e35a98e5d1 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01" status: 200 len: 1515 microversion: 2.1 time: 0.167944 Oct 17 14:31:02.626882 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3331/6523] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:31:02 2022] GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01 => generated 1515 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:31:03.649973 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-07b94484-2601-4a95-be61-a04a2354bdd3 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:03.650623 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-07b94484-2601-4a95-be61-a04a2354bdd3 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: 148d0b56-85f9-4bd2-81fd-60f418e2ae01] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:03.654768 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=6 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:31:03.660590 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-07b94484-2601-4a95-be61-a04a2354bdd3 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:03.661086 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-07b94484-2601-4a95-be61-a04a2354bdd3 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:03.661529 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-07b94484-2601-4a95-be61-a04a2354bdd3 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:03.662930 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-07b94484-2601-4a95-be61-a04a2354bdd3 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:03.663627 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-07b94484-2601-4a95-be61-a04a2354bdd3 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:03.664342 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-07b94484-2601-4a95-be61-a04a2354bdd3 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:03.800264 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-07b94484-2601-4a95-be61-a04a2354bdd3 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:31:03.808272 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-07b94484-2601-4a95-be61-a04a2354bdd3 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01" status: 200 len: 1515 microversion: 2.1 time: 0.162560 Oct 17 14:31:03.808888 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3193/6524] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:31:03 2022] GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:31:04.835232 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-91460b5a-faee-4675-af70-ec117334d888 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:04.835842 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-91460b5a-faee-4675-af70-ec117334d888 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: 148d0b56-85f9-4bd2-81fd-60f418e2ae01] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:04.844202 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-91460b5a-faee-4675-af70-ec117334d888 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:04.844686 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-91460b5a-faee-4675-af70-ec117334d888 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:04.845113 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-91460b5a-faee-4675-af70-ec117334d888 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:04.845821 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-91460b5a-faee-4675-af70-ec117334d888 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:04.846254 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-91460b5a-faee-4675-af70-ec117334d888 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:04.846674 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-91460b5a-faee-4675-af70-ec117334d888 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:05.005812 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-91460b5a-faee-4675-af70-ec117334d888 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:31:05.014527 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-91460b5a-faee-4675-af70-ec117334d888 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01" status: 200 len: 1520 microversion: 2.1 time: 0.185811 Oct 17 14:31:05.015125 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3332/6525] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:31:04 2022] GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01 => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:31:06.039094 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a4c7674e-34ab-4123-a576-41f20b6d8152 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:06.039813 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a4c7674e-34ab-4123-a576-41f20b6d8152 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: 148d0b56-85f9-4bd2-81fd-60f418e2ae01] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:06.049202 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a4c7674e-34ab-4123-a576-41f20b6d8152 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:06.049775 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a4c7674e-34ab-4123-a576-41f20b6d8152 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:06.050290 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a4c7674e-34ab-4123-a576-41f20b6d8152 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:06.051106 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a4c7674e-34ab-4123-a576-41f20b6d8152 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:06.051674 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a4c7674e-34ab-4123-a576-41f20b6d8152 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:06.052169 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a4c7674e-34ab-4123-a576-41f20b6d8152 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:06.189822 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a4c7674e-34ab-4123-a576-41f20b6d8152 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:31:06.198564 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a4c7674e-34ab-4123-a576-41f20b6d8152 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01" status: 200 len: 1520 microversion: 2.1 time: 0.164176 Oct 17 14:31:06.199154 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3194/6526] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:31:06 2022] GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:31:07.226510 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8f5f95ab-c23b-45d9-bb60-e6f3bf465fb7 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:07.227435 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8f5f95ab-c23b-45d9-bb60-e6f3bf465fb7 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: 148d0b56-85f9-4bd2-81fd-60f418e2ae01] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:07.235778 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8f5f95ab-c23b-45d9-bb60-e6f3bf465fb7 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:07.236423 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8f5f95ab-c23b-45d9-bb60-e6f3bf465fb7 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:07.236859 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8f5f95ab-c23b-45d9-bb60-e6f3bf465fb7 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:07.237555 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8f5f95ab-c23b-45d9-bb60-e6f3bf465fb7 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:07.238012 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8f5f95ab-c23b-45d9-bb60-e6f3bf465fb7 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:07.238434 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8f5f95ab-c23b-45d9-bb60-e6f3bf465fb7 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:07.383440 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8f5f95ab-c23b-45d9-bb60-e6f3bf465fb7 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:31:07.393644 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8f5f95ab-c23b-45d9-bb60-e6f3bf465fb7 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01" status: 200 len: 1520 microversion: 2.1 time: 0.173840 Oct 17 14:31:07.394215 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3333/6527] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:31:07 2022] GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:31:08.418421 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0aa36ad3-7087-4a63-bd23-21ab9fb9a4ce tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:08.418972 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0aa36ad3-7087-4a63-bd23-21ab9fb9a4ce tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: 148d0b56-85f9-4bd2-81fd-60f418e2ae01] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:08.426493 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0aa36ad3-7087-4a63-bd23-21ab9fb9a4ce tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:08.426991 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0aa36ad3-7087-4a63-bd23-21ab9fb9a4ce tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:08.427474 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0aa36ad3-7087-4a63-bd23-21ab9fb9a4ce tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:08.428188 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0aa36ad3-7087-4a63-bd23-21ab9fb9a4ce tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:08.428656 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0aa36ad3-7087-4a63-bd23-21ab9fb9a4ce tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:08.429091 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0aa36ad3-7087-4a63-bd23-21ab9fb9a4ce tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:08.580362 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0aa36ad3-7087-4a63-bd23-21ab9fb9a4ce tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:31:08.588601 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0aa36ad3-7087-4a63-bd23-21ab9fb9a4ce tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01" status: 200 len: 1520 microversion: 2.1 time: 0.174292 Oct 17 14:31:08.589223 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3195/6528] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:31:08 2022] GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01 => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:31:09.615549 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4be11268-24a1-44a7-a079-98c56b263ebf tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:09.616280 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4be11268-24a1-44a7-a079-98c56b263ebf tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: 148d0b56-85f9-4bd2-81fd-60f418e2ae01] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:09.627086 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4be11268-24a1-44a7-a079-98c56b263ebf tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:09.627640 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4be11268-24a1-44a7-a079-98c56b263ebf tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:09.628145 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4be11268-24a1-44a7-a079-98c56b263ebf tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:09.628880 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4be11268-24a1-44a7-a079-98c56b263ebf tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:09.629417 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4be11268-24a1-44a7-a079-98c56b263ebf tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:09.629849 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4be11268-24a1-44a7-a079-98c56b263ebf tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:09.774650 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4be11268-24a1-44a7-a079-98c56b263ebf tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:31:09.783981 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4be11268-24a1-44a7-a079-98c56b263ebf tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01" status: 200 len: 1520 microversion: 2.1 time: 0.175714 Oct 17 14:31:09.784607 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3334/6529] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:31:09 2022] GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01 => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:31:10.809635 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b0d7a3f7-d5e8-45b1-ae90-dd9d84f711b4 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:10.810215 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b0d7a3f7-d5e8-45b1-ae90-dd9d84f711b4 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: 148d0b56-85f9-4bd2-81fd-60f418e2ae01] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:10.814094 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:31:10.820056 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b0d7a3f7-d5e8-45b1-ae90-dd9d84f711b4 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:10.820545 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b0d7a3f7-d5e8-45b1-ae90-dd9d84f711b4 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:10.820988 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b0d7a3f7-d5e8-45b1-ae90-dd9d84f711b4 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:10.821686 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b0d7a3f7-d5e8-45b1-ae90-dd9d84f711b4 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:10.822142 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b0d7a3f7-d5e8-45b1-ae90-dd9d84f711b4 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:10.822570 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b0d7a3f7-d5e8-45b1-ae90-dd9d84f711b4 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:10.968363 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b0d7a3f7-d5e8-45b1-ae90-dd9d84f711b4 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:31:10.976843 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b0d7a3f7-d5e8-45b1-ae90-dd9d84f711b4 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01" status: 200 len: 1520 microversion: 2.1 time: 0.173253 Oct 17 14:31:10.977441 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3196/6530] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:31:10 2022] GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:31:12.005562 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-71ec250c-de87-4aa6-b1aa-9b5444d7bb2d tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:12.006570 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-71ec250c-de87-4aa6-b1aa-9b5444d7bb2d tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: 148d0b56-85f9-4bd2-81fd-60f418e2ae01] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:12.010882 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:31:12.020163 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-71ec250c-de87-4aa6-b1aa-9b5444d7bb2d tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:12.020889 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-71ec250c-de87-4aa6-b1aa-9b5444d7bb2d tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:12.021325 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-71ec250c-de87-4aa6-b1aa-9b5444d7bb2d tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:12.022022 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-71ec250c-de87-4aa6-b1aa-9b5444d7bb2d tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:12.022470 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-71ec250c-de87-4aa6-b1aa-9b5444d7bb2d tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:12.022889 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-71ec250c-de87-4aa6-b1aa-9b5444d7bb2d tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:12.155049 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-71ec250c-de87-4aa6-b1aa-9b5444d7bb2d tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:31:12.163628 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-71ec250c-de87-4aa6-b1aa-9b5444d7bb2d tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01" status: 200 len: 1520 microversion: 2.1 time: 0.165503 Oct 17 14:31:12.164189 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3335/6531] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:31:11 2022] GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:31:13.188144 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7752f00a-6919-4cda-bf06-374400e865cf tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:13.188783 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7752f00a-6919-4cda-bf06-374400e865cf tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: 148d0b56-85f9-4bd2-81fd-60f418e2ae01] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:13.196123 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7752f00a-6919-4cda-bf06-374400e865cf tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:13.196631 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7752f00a-6919-4cda-bf06-374400e865cf tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:13.197080 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7752f00a-6919-4cda-bf06-374400e865cf tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:13.197822 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7752f00a-6919-4cda-bf06-374400e865cf tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:13.198292 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7752f00a-6919-4cda-bf06-374400e865cf tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:13.198740 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7752f00a-6919-4cda-bf06-374400e865cf tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:13.344833 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7752f00a-6919-4cda-bf06-374400e865cf tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:31:13.353515 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7752f00a-6919-4cda-bf06-374400e865cf tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01" status: 200 len: 1520 microversion: 2.1 time: 0.170148 Oct 17 14:31:13.354127 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3197/6532] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:31:13 2022] GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:31:14.378990 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-364f8ec2-3a5c-416f-9e7d-d047c2b5133b tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:14.379714 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-364f8ec2-3a5c-416f-9e7d-d047c2b5133b tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: 148d0b56-85f9-4bd2-81fd-60f418e2ae01] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:14.389162 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-364f8ec2-3a5c-416f-9e7d-d047c2b5133b tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:14.389826 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-364f8ec2-3a5c-416f-9e7d-d047c2b5133b tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:14.390442 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-364f8ec2-3a5c-416f-9e7d-d047c2b5133b tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:14.391188 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-364f8ec2-3a5c-416f-9e7d-d047c2b5133b tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:14.391782 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-364f8ec2-3a5c-416f-9e7d-d047c2b5133b tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:14.392334 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-364f8ec2-3a5c-416f-9e7d-d047c2b5133b tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:14.543798 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-364f8ec2-3a5c-416f-9e7d-d047c2b5133b tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:31:14.552875 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-364f8ec2-3a5c-416f-9e7d-d047c2b5133b tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01" status: 200 len: 1520 microversion: 2.1 time: 0.179200 Oct 17 14:31:14.553801 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3336/6533] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:31:14 2022] GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01 => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:31:15.585172 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-92918ef8-a6f8-4042-bc4a-4877816f431e tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:15.585859 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-92918ef8-a6f8-4042-bc4a-4877816f431e tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: 148d0b56-85f9-4bd2-81fd-60f418e2ae01] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:15.594116 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-92918ef8-a6f8-4042-bc4a-4877816f431e tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:15.594593 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-92918ef8-a6f8-4042-bc4a-4877816f431e tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:15.595067 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-92918ef8-a6f8-4042-bc4a-4877816f431e tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:15.595804 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-92918ef8-a6f8-4042-bc4a-4877816f431e tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:15.596263 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-92918ef8-a6f8-4042-bc4a-4877816f431e tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:15.596674 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-92918ef8-a6f8-4042-bc4a-4877816f431e tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:15.744140 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-92918ef8-a6f8-4042-bc4a-4877816f431e tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:31:15.752392 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-92918ef8-a6f8-4042-bc4a-4877816f431e tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01" status: 200 len: 1520 microversion: 2.1 time: 0.171739 Oct 17 14:31:15.752981 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3198/6534] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:31:15 2022] GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:31:16.777127 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e66eacb6-d402-494e-b89d-52d4a1c13c53 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:16.777738 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e66eacb6-d402-494e-b89d-52d4a1c13c53 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: 148d0b56-85f9-4bd2-81fd-60f418e2ae01] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:16.786025 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e66eacb6-d402-494e-b89d-52d4a1c13c53 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:16.786514 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e66eacb6-d402-494e-b89d-52d4a1c13c53 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:16.786949 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e66eacb6-d402-494e-b89d-52d4a1c13c53 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:16.787676 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e66eacb6-d402-494e-b89d-52d4a1c13c53 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:16.788128 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e66eacb6-d402-494e-b89d-52d4a1c13c53 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:16.788650 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e66eacb6-d402-494e-b89d-52d4a1c13c53 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:16.925068 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e66eacb6-d402-494e-b89d-52d4a1c13c53 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:31:16.933011 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e66eacb6-d402-494e-b89d-52d4a1c13c53 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01" status: 200 len: 1520 microversion: 2.1 time: 0.160189 Oct 17 14:31:16.933594 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3337/6535] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:31:16 2022] GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:31:17.961155 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f3509f82-bb1a-4abd-aa2d-1d7290c8417d tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:17.962217 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f3509f82-bb1a-4abd-aa2d-1d7290c8417d tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: 148d0b56-85f9-4bd2-81fd-60f418e2ae01] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:17.973788 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f3509f82-bb1a-4abd-aa2d-1d7290c8417d tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:17.974598 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f3509f82-bb1a-4abd-aa2d-1d7290c8417d tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:17.975555 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f3509f82-bb1a-4abd-aa2d-1d7290c8417d tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:17.976273 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f3509f82-bb1a-4abd-aa2d-1d7290c8417d tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:17.976726 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f3509f82-bb1a-4abd-aa2d-1d7290c8417d tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:17.977153 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f3509f82-bb1a-4abd-aa2d-1d7290c8417d tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:18.112341 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f3509f82-bb1a-4abd-aa2d-1d7290c8417d tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:31:18.122728 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f3509f82-bb1a-4abd-aa2d-1d7290c8417d tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01" status: 200 len: 1520 microversion: 2.1 time: 0.168271 Oct 17 14:31:18.123485 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3199/6536] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:31:17 2022] GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:31:19.146578 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a57555bc-18da-4ab4-932d-9633f2763291 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:19.147273 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a57555bc-18da-4ab4-932d-9633f2763291 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: 148d0b56-85f9-4bd2-81fd-60f418e2ae01] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:19.155100 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a57555bc-18da-4ab4-932d-9633f2763291 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:19.155629 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a57555bc-18da-4ab4-932d-9633f2763291 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:19.156033 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a57555bc-18da-4ab4-932d-9633f2763291 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:19.156718 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a57555bc-18da-4ab4-932d-9633f2763291 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:19.157164 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a57555bc-18da-4ab4-932d-9633f2763291 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:19.157579 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a57555bc-18da-4ab4-932d-9633f2763291 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:19.648366 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a57555bc-18da-4ab4-932d-9633f2763291 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:31:19.657111 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a57555bc-18da-4ab4-932d-9633f2763291 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01" status: 200 len: 1520 microversion: 2.1 time: 0.514598 Oct 17 14:31:19.657697 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3338/6537] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:31:19 2022] GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01 => generated 1520 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:31:20.681760 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3fd830c3-f28e-4461-90ef-82cb48fa6388 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:20.682452 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3fd830c3-f28e-4461-90ef-82cb48fa6388 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: 148d0b56-85f9-4bd2-81fd-60f418e2ae01] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:20.691761 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3fd830c3-f28e-4461-90ef-82cb48fa6388 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:20.692364 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3fd830c3-f28e-4461-90ef-82cb48fa6388 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:20.692906 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3fd830c3-f28e-4461-90ef-82cb48fa6388 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:20.693783 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3fd830c3-f28e-4461-90ef-82cb48fa6388 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:20.694331 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3fd830c3-f28e-4461-90ef-82cb48fa6388 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:20.694845 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3fd830c3-f28e-4461-90ef-82cb48fa6388 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:20.843400 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3fd830c3-f28e-4461-90ef-82cb48fa6388 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:31:20.853348 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3fd830c3-f28e-4461-90ef-82cb48fa6388 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01" status: 200 len: 1520 microversion: 2.1 time: 0.176256 Oct 17 14:31:20.853938 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3200/6538] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:31:20 2022] GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:31:21.879130 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ad079542-fa01-4646-982a-503a4a773665 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:21.880030 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ad079542-fa01-4646-982a-503a4a773665 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: 148d0b56-85f9-4bd2-81fd-60f418e2ae01] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:21.888555 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ad079542-fa01-4646-982a-503a4a773665 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:21.889052 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ad079542-fa01-4646-982a-503a4a773665 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:21.889487 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ad079542-fa01-4646-982a-503a4a773665 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:21.890192 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ad079542-fa01-4646-982a-503a4a773665 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:21.890651 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ad079542-fa01-4646-982a-503a4a773665 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:21.891076 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ad079542-fa01-4646-982a-503a4a773665 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:22.031864 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ad079542-fa01-4646-982a-503a4a773665 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:31:22.039790 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ad079542-fa01-4646-982a-503a4a773665 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01" status: 200 len: 1520 microversion: 2.1 time: 0.166317 Oct 17 14:31:22.040370 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3339/6539] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:31:21 2022] GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:31:23.063552 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6cfd8548-84ab-41e0-9ddd-1cf312652765 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:23.064184 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6cfd8548-84ab-41e0-9ddd-1cf312652765 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: 148d0b56-85f9-4bd2-81fd-60f418e2ae01] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:23.071772 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6cfd8548-84ab-41e0-9ddd-1cf312652765 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:23.072265 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6cfd8548-84ab-41e0-9ddd-1cf312652765 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:23.072714 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6cfd8548-84ab-41e0-9ddd-1cf312652765 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:23.073416 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6cfd8548-84ab-41e0-9ddd-1cf312652765 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:23.073879 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6cfd8548-84ab-41e0-9ddd-1cf312652765 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:23.074283 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6cfd8548-84ab-41e0-9ddd-1cf312652765 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:23.219458 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6cfd8548-84ab-41e0-9ddd-1cf312652765 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:31:23.228022 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6cfd8548-84ab-41e0-9ddd-1cf312652765 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01" status: 200 len: 1520 microversion: 2.1 time: 0.168250 Oct 17 14:31:23.228599 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3201/6540] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:31:23 2022] GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:31:24.252424 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f20664ee-4a02-4919-b59f-18baf7cdc6b7 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:24.253047 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f20664ee-4a02-4919-b59f-18baf7cdc6b7 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: 148d0b56-85f9-4bd2-81fd-60f418e2ae01] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:24.260457 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f20664ee-4a02-4919-b59f-18baf7cdc6b7 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:24.260944 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f20664ee-4a02-4919-b59f-18baf7cdc6b7 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:24.261386 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f20664ee-4a02-4919-b59f-18baf7cdc6b7 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:24.262089 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f20664ee-4a02-4919-b59f-18baf7cdc6b7 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:24.262544 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f20664ee-4a02-4919-b59f-18baf7cdc6b7 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:24.262962 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f20664ee-4a02-4919-b59f-18baf7cdc6b7 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:24.417834 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f20664ee-4a02-4919-b59f-18baf7cdc6b7 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:31:24.426059 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f20664ee-4a02-4919-b59f-18baf7cdc6b7 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01" status: 200 len: 1520 microversion: 2.1 time: 0.177925 Oct 17 14:31:24.426667 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3340/6541] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:31:24 2022] GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01 => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:31:25.451821 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ab689160-d45b-42a1-82b3-23bddba52faa tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:25.452385 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ab689160-d45b-42a1-82b3-23bddba52faa tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: 148d0b56-85f9-4bd2-81fd-60f418e2ae01] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:25.459712 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ab689160-d45b-42a1-82b3-23bddba52faa tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:25.460207 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ab689160-d45b-42a1-82b3-23bddba52faa tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:25.460656 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ab689160-d45b-42a1-82b3-23bddba52faa tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:25.461360 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ab689160-d45b-42a1-82b3-23bddba52faa tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:25.461820 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ab689160-d45b-42a1-82b3-23bddba52faa tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:25.462257 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ab689160-d45b-42a1-82b3-23bddba52faa tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:25.600758 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ab689160-d45b-42a1-82b3-23bddba52faa tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:31:25.610720 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ab689160-d45b-42a1-82b3-23bddba52faa tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01" status: 200 len: 1520 microversion: 2.1 time: 0.163484 Oct 17 14:31:25.611342 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3202/6542] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:31:25 2022] GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:31:26.639018 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-498c209b-881c-4835-8ede-765d62c09cb7 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:26.639998 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-498c209b-881c-4835-8ede-765d62c09cb7 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: 148d0b56-85f9-4bd2-81fd-60f418e2ae01] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:26.651829 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-498c209b-881c-4835-8ede-765d62c09cb7 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:26.652313 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-498c209b-881c-4835-8ede-765d62c09cb7 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:26.652750 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-498c209b-881c-4835-8ede-765d62c09cb7 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:26.653444 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-498c209b-881c-4835-8ede-765d62c09cb7 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:26.653896 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-498c209b-881c-4835-8ede-765d62c09cb7 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:26.654319 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-498c209b-881c-4835-8ede-765d62c09cb7 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:26.793336 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-498c209b-881c-4835-8ede-765d62c09cb7 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:31:26.801698 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-498c209b-881c-4835-8ede-765d62c09cb7 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01" status: 200 len: 1520 microversion: 2.1 time: 0.169767 Oct 17 14:31:26.802289 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3341/6543] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:31:26 2022] GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:31:27.828070 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9a87e880-eba3-42e1-8821-1e1230d4c137 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:27.828876 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9a87e880-eba3-42e1-8821-1e1230d4c137 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: 148d0b56-85f9-4bd2-81fd-60f418e2ae01] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:27.837991 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9a87e880-eba3-42e1-8821-1e1230d4c137 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:27.838928 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9a87e880-eba3-42e1-8821-1e1230d4c137 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:27.839602 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9a87e880-eba3-42e1-8821-1e1230d4c137 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:27.840622 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9a87e880-eba3-42e1-8821-1e1230d4c137 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:27.841279 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9a87e880-eba3-42e1-8821-1e1230d4c137 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:27.841910 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9a87e880-eba3-42e1-8821-1e1230d4c137 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:27.990976 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9a87e880-eba3-42e1-8821-1e1230d4c137 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:31:28.001194 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9a87e880-eba3-42e1-8821-1e1230d4c137 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01" status: 200 len: 1520 microversion: 2.1 time: 0.179178 Oct 17 14:31:28.001748 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3203/6544] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:31:27 2022] GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01 => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:31:29.028863 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-48d5d4f0-9a5b-457b-ab96-be9e2e532d5a tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:29.029590 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-48d5d4f0-9a5b-457b-ab96-be9e2e532d5a tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: 148d0b56-85f9-4bd2-81fd-60f418e2ae01] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:29.038158 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48d5d4f0-9a5b-457b-ab96-be9e2e532d5a tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:29.038728 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48d5d4f0-9a5b-457b-ab96-be9e2e532d5a tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:29.039277 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48d5d4f0-9a5b-457b-ab96-be9e2e532d5a tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:29.040118 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48d5d4f0-9a5b-457b-ab96-be9e2e532d5a tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:29.040634 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48d5d4f0-9a5b-457b-ab96-be9e2e532d5a tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:29.041158 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48d5d4f0-9a5b-457b-ab96-be9e2e532d5a tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:29.245560 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-48d5d4f0-9a5b-457b-ab96-be9e2e532d5a tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:31:29.253543 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-48d5d4f0-9a5b-457b-ab96-be9e2e532d5a tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01" status: 200 len: 1520 microversion: 2.1 time: 0.230936 Oct 17 14:31:29.254131 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3342/6545] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:31:29 2022] GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01 => generated 1520 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:31:30.279704 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f5b0ca64-4f0b-4d96-81ee-ae8702cebf60 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:30.280319 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f5b0ca64-4f0b-4d96-81ee-ae8702cebf60 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: 148d0b56-85f9-4bd2-81fd-60f418e2ae01] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:30.288023 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f5b0ca64-4f0b-4d96-81ee-ae8702cebf60 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:30.288526 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f5b0ca64-4f0b-4d96-81ee-ae8702cebf60 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:30.288975 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f5b0ca64-4f0b-4d96-81ee-ae8702cebf60 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:30.289685 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f5b0ca64-4f0b-4d96-81ee-ae8702cebf60 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:30.290159 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f5b0ca64-4f0b-4d96-81ee-ae8702cebf60 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:30.290598 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f5b0ca64-4f0b-4d96-81ee-ae8702cebf60 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:30.474278 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f5b0ca64-4f0b-4d96-81ee-ae8702cebf60 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:31:30.486054 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f5b0ca64-4f0b-4d96-81ee-ae8702cebf60 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01" status: 200 len: 1520 microversion: 2.1 time: 0.212068 Oct 17 14:31:30.486897 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3204/6546] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:31:30 2022] GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01 => generated 1520 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:31:31.509696 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d44b4242-0895-4f0c-90f3-86de03e4a438 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:31.510313 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d44b4242-0895-4f0c-90f3-86de03e4a438 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: 148d0b56-85f9-4bd2-81fd-60f418e2ae01] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:31.517503 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d44b4242-0895-4f0c-90f3-86de03e4a438 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:31.518003 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d44b4242-0895-4f0c-90f3-86de03e4a438 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:31.518437 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d44b4242-0895-4f0c-90f3-86de03e4a438 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:31.519143 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d44b4242-0895-4f0c-90f3-86de03e4a438 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:31.519627 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d44b4242-0895-4f0c-90f3-86de03e4a438 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:31.520047 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d44b4242-0895-4f0c-90f3-86de03e4a438 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:31.522715 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=82 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:31:31.706434 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-33a99edb-aa5e-432c-8464-fd3fc23fea15 req-b63aa75e-7c05-4d13-8e5d-c1ff38baa893 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "148d0b56-85f9-4bd2-81fd-60f418e2ae01", "name": "network-vif-unplugged", "status": "completed", "tag": "cd8bcfa6-8db1-433f-b9cc-88caaaa1bb7f"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:31:31.717338 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-33a99edb-aa5e-432c-8464-fd3fc23fea15 req-b63aa75e-7c05-4d13-8e5d-c1ff38baa893 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:31.717828 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-33a99edb-aa5e-432c-8464-fd3fc23fea15 req-b63aa75e-7c05-4d13-8e5d-c1ff38baa893 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:31.718266 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-33a99edb-aa5e-432c-8464-fd3fc23fea15 req-b63aa75e-7c05-4d13-8e5d-c1ff38baa893 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:31.731206 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-33a99edb-aa5e-432c-8464-fd3fc23fea15 req-b63aa75e-7c05-4d13-8e5d-c1ff38baa893 service nova] Creating event network-vif-unplugged:cd8bcfa6-8db1-433f-b9cc-88caaaa1bb7f for instance 148d0b56-85f9-4bd2-81fd-60f418e2ae01 on n-h2-854247-14 Oct 17 14:31:31.737311 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [req-33a99edb-aa5e-432c-8464-fd3fc23fea15 req-b63aa75e-7c05-4d13-8e5d-c1ff38baa893 service nova] Instance 148d0b56-85f9-4bd2-81fd-60f418e2ae01 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854247-14', 'n-h2-854247-14'} {{(pid=127017) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 14:31:31.749548 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-33a99edb-aa5e-432c-8464-fd3fc23fea15 req-b63aa75e-7c05-4d13-8e5d-c1ff38baa893 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109541 Oct 17 14:31:31.750176 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3205/6547] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:31:31.752761 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d44b4242-0895-4f0c-90f3-86de03e4a438 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:31:31.761991 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d44b4242-0895-4f0c-90f3-86de03e4a438 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01" status: 200 len: 1519 microversion: 2.1 time: 0.255824 Oct 17 14:31:31.762514 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3343/6548] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:31:31 2022] GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01 => generated 1519 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:31:32.791662 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d5fda1c0-70e3-4e16-a581-6ffbf62d6fa8 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:32.792721 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d5fda1c0-70e3-4e16-a581-6ffbf62d6fa8 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: 148d0b56-85f9-4bd2-81fd-60f418e2ae01] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:32.799588 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d5fda1c0-70e3-4e16-a581-6ffbf62d6fa8 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:32.800078 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d5fda1c0-70e3-4e16-a581-6ffbf62d6fa8 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:32.800521 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d5fda1c0-70e3-4e16-a581-6ffbf62d6fa8 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:32.801218 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d5fda1c0-70e3-4e16-a581-6ffbf62d6fa8 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:32.801681 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d5fda1c0-70e3-4e16-a581-6ffbf62d6fa8 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:32.802112 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d5fda1c0-70e3-4e16-a581-6ffbf62d6fa8 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:32.804780 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:31:32.953490 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d5fda1c0-70e3-4e16-a581-6ffbf62d6fa8 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:31:32.965424 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d5fda1c0-70e3-4e16-a581-6ffbf62d6fa8 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01" status: 200 len: 1517 microversion: 2.1 time: 0.181325 Oct 17 14:31:32.966522 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3206/6549] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:31:32 2022] GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01 => generated 1517 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:31:33.767589 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-e7ced9c0-2f16-4d64-a2d7-783d259e5a14 req-cecfd7ba-e9ff-47f7-9f2e-ac0bdda64c15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "148d0b56-85f9-4bd2-81fd-60f418e2ae01", "tag": "cd8bcfa6-8db1-433f-b9cc-88caaaa1bb7f"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:31:33.778687 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-e7ced9c0-2f16-4d64-a2d7-783d259e5a14 req-cecfd7ba-e9ff-47f7-9f2e-ac0bdda64c15 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:33.779184 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-e7ced9c0-2f16-4d64-a2d7-783d259e5a14 req-cecfd7ba-e9ff-47f7-9f2e-ac0bdda64c15 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:33.779623 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-e7ced9c0-2f16-4d64-a2d7-783d259e5a14 req-cecfd7ba-e9ff-47f7-9f2e-ac0bdda64c15 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:33.792037 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-e7ced9c0-2f16-4d64-a2d7-783d259e5a14 req-cecfd7ba-e9ff-47f7-9f2e-ac0bdda64c15 service nova] Creating event network-changed:cd8bcfa6-8db1-433f-b9cc-88caaaa1bb7f for instance 148d0b56-85f9-4bd2-81fd-60f418e2ae01 on n-h2-854247-14 Oct 17 14:31:33.797909 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [req-e7ced9c0-2f16-4d64-a2d7-783d259e5a14 req-cecfd7ba-e9ff-47f7-9f2e-ac0bdda64c15 service nova] Instance 148d0b56-85f9-4bd2-81fd-60f418e2ae01 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854247-14', 'n-h2-854247-14'} {{(pid=127016) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 14:31:33.809497 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-e7ced9c0-2f16-4d64-a2d7-783d259e5a14 req-cecfd7ba-e9ff-47f7-9f2e-ac0bdda64c15 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045796 Oct 17 14:31:33.810159 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3344/6550] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:31:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:31:33.994781 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-efc128cf-6abd-4554-a78d-67966bec2cbd tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:33.995424 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-efc128cf-6abd-4554-a78d-67966bec2cbd tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: 148d0b56-85f9-4bd2-81fd-60f418e2ae01] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:34.003458 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-efc128cf-6abd-4554-a78d-67966bec2cbd tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:34.004373 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-efc128cf-6abd-4554-a78d-67966bec2cbd tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:34.005020 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-efc128cf-6abd-4554-a78d-67966bec2cbd tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:34.005967 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-efc128cf-6abd-4554-a78d-67966bec2cbd tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:34.006629 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-efc128cf-6abd-4554-a78d-67966bec2cbd tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:34.007283 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-efc128cf-6abd-4554-a78d-67966bec2cbd tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:34.240384 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-efc128cf-6abd-4554-a78d-67966bec2cbd tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:31:34.248386 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-efc128cf-6abd-4554-a78d-67966bec2cbd tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01" status: 200 len: 1517 microversion: 2.1 time: 0.258001 Oct 17 14:31:34.249181 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3207/6551] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:31:33 2022] GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01 => generated 1517 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:31:35.279349 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4410b5a1-9a26-4ef2-8b22-c7de75332662 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:35.280502 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4410b5a1-9a26-4ef2-8b22-c7de75332662 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: 148d0b56-85f9-4bd2-81fd-60f418e2ae01] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:35.291338 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4410b5a1-9a26-4ef2-8b22-c7de75332662 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:35.292150 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4410b5a1-9a26-4ef2-8b22-c7de75332662 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:35.293412 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4410b5a1-9a26-4ef2-8b22-c7de75332662 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:35.294119 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4410b5a1-9a26-4ef2-8b22-c7de75332662 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:35.294572 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4410b5a1-9a26-4ef2-8b22-c7de75332662 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:35.295022 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4410b5a1-9a26-4ef2-8b22-c7de75332662 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:35.540107 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4410b5a1-9a26-4ef2-8b22-c7de75332662 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:31:35.551676 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4410b5a1-9a26-4ef2-8b22-c7de75332662 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01" status: 200 len: 1514 microversion: 2.1 time: 0.281288 Oct 17 14:31:35.552421 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3345/6552] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:31:35 2022] GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01 => generated 1514 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:31:35.575382 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-21c69b82-2fd7-4418-a9a1-7471d0c3e0d9 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:31:35.575915 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-21c69b82-2fd7-4418-a9a1-7471d0c3e0d9 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: 148d0b56-85f9-4bd2-81fd-60f418e2ae01] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:35.583085 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-21c69b82-2fd7-4418-a9a1-7471d0c3e0d9 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:35.583746 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-21c69b82-2fd7-4418-a9a1-7471d0c3e0d9 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:35.584189 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-21c69b82-2fd7-4418-a9a1-7471d0c3e0d9 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:35.584887 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-21c69b82-2fd7-4418-a9a1-7471d0c3e0d9 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:35.585347 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-21c69b82-2fd7-4418-a9a1-7471d0c3e0d9 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:35.585778 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-21c69b82-2fd7-4418-a9a1-7471d0c3e0d9 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:35.650831 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-21c69b82-2fd7-4418-a9a1-7471d0c3e0d9 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "POST /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01/action" status: 204 len: 0 microversion: 2.1 time: 0.079400 Oct 17 14:31:35.651494 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3208/6553] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:31:35 2022] POST /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01/action => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 14:31:35.661163 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8ff69cc0-5b37-4191-a212-7c9b31e623a8 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:35.661793 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8ff69cc0-5b37-4191-a212-7c9b31e623a8 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: 148d0b56-85f9-4bd2-81fd-60f418e2ae01] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:35.668549 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8ff69cc0-5b37-4191-a212-7c9b31e623a8 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:35.669207 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8ff69cc0-5b37-4191-a212-7c9b31e623a8 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:35.669949 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8ff69cc0-5b37-4191-a212-7c9b31e623a8 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:35.670787 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8ff69cc0-5b37-4191-a212-7c9b31e623a8 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:35.671270 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8ff69cc0-5b37-4191-a212-7c9b31e623a8 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:35.671694 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8ff69cc0-5b37-4191-a212-7c9b31e623a8 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:35.817037 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8ff69cc0-5b37-4191-a212-7c9b31e623a8 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:31:35.826032 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8ff69cc0-5b37-4191-a212-7c9b31e623a8 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01" status: 200 len: 1514 microversion: 2.1 time: 0.169979 Oct 17 14:31:35.826828 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3346/6554] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:31:35 2022] GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01 => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:31:36.851522 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0ea60d99-73cb-4ac5-97dc-3f8e917f1fb4 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:36.852244 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0ea60d99-73cb-4ac5-97dc-3f8e917f1fb4 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: 148d0b56-85f9-4bd2-81fd-60f418e2ae01] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:36.858865 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0ea60d99-73cb-4ac5-97dc-3f8e917f1fb4 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:36.859393 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0ea60d99-73cb-4ac5-97dc-3f8e917f1fb4 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:36.859851 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0ea60d99-73cb-4ac5-97dc-3f8e917f1fb4 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:36.860558 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0ea60d99-73cb-4ac5-97dc-3f8e917f1fb4 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:36.861029 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0ea60d99-73cb-4ac5-97dc-3f8e917f1fb4 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:36.861469 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0ea60d99-73cb-4ac5-97dc-3f8e917f1fb4 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:37.001814 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0ea60d99-73cb-4ac5-97dc-3f8e917f1fb4 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:31:37.009802 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0ea60d99-73cb-4ac5-97dc-3f8e917f1fb4 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01" status: 200 len: 1506 microversion: 2.1 time: 0.163453 Oct 17 14:31:37.010347 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3209/6555] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:31:36 2022] GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01 => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:31:37.032526 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-30626329-eab8-4919-b569-e2f2e01b7cad tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:37.033142 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-30626329-eab8-4919-b569-e2f2e01b7cad tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: 148d0b56-85f9-4bd2-81fd-60f418e2ae01] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:37.040391 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-30626329-eab8-4919-b569-e2f2e01b7cad tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:37.040874 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-30626329-eab8-4919-b569-e2f2e01b7cad tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:37.041313 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-30626329-eab8-4919-b569-e2f2e01b7cad tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:37.042296 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-30626329-eab8-4919-b569-e2f2e01b7cad tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:37.042755 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-30626329-eab8-4919-b569-e2f2e01b7cad tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:37.043544 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-30626329-eab8-4919-b569-e2f2e01b7cad tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:37.178460 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-30626329-eab8-4919-b569-e2f2e01b7cad tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:31:37.186888 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-30626329-eab8-4919-b569-e2f2e01b7cad tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01" status: 200 len: 1506 microversion: 2.1 time: 0.158432 Oct 17 14:31:37.187497 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3347/6556] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:31:37 2022] GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01 => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:31:37.209321 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9dac568a-a432-4256-883a-04893b84f051 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:37.209957 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9dac568a-a432-4256-883a-04893b84f051 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: 148d0b56-85f9-4bd2-81fd-60f418e2ae01] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:37.220172 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9dac568a-a432-4256-883a-04893b84f051 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:37.220688 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9dac568a-a432-4256-883a-04893b84f051 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:37.221493 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9dac568a-a432-4256-883a-04893b84f051 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:37.222216 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9dac568a-a432-4256-883a-04893b84f051 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:37.222846 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9dac568a-a432-4256-883a-04893b84f051 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:37.223403 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9dac568a-a432-4256-883a-04893b84f051 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:37.452344 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9dac568a-a432-4256-883a-04893b84f051 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:31:37.460276 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9dac568a-a432-4256-883a-04893b84f051 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01" status: 200 len: 1506 microversion: 2.1 time: 0.254925 Oct 17 14:31:37.460826 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3210/6557] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:31:37 2022] GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01 => generated 1506 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:31:37.484724 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-61a181fa-1dc6-40dc-9e8d-94acdb0f66a9 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:37.485225 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-61a181fa-1dc6-40dc-9e8d-94acdb0f66a9 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: 148d0b56-85f9-4bd2-81fd-60f418e2ae01] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:37.491697 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-61a181fa-1dc6-40dc-9e8d-94acdb0f66a9 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:37.492186 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-61a181fa-1dc6-40dc-9e8d-94acdb0f66a9 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:37.492622 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-61a181fa-1dc6-40dc-9e8d-94acdb0f66a9 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:37.493327 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-61a181fa-1dc6-40dc-9e8d-94acdb0f66a9 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:37.493776 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-61a181fa-1dc6-40dc-9e8d-94acdb0f66a9 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:37.494201 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-61a181fa-1dc6-40dc-9e8d-94acdb0f66a9 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:37.520390 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-61a181fa-1dc6-40dc-9e8d-94acdb0f66a9 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: 148d0b56-85f9-4bd2-81fd-60f418e2ae01] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:31:37.605389 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-61a181fa-1dc6-40dc-9e8d-94acdb0f66a9 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "DELETE /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01" status: 204 len: 0 microversion: 2.1 time: 0.125966 Oct 17 14:31:37.605917 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3348/6558] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:31:37 2022] DELETE /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:31:37.620867 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a2962032-780c-49ce-a1fb-9a634474847d tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:37.621372 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a2962032-780c-49ce-a1fb-9a634474847d tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: 148d0b56-85f9-4bd2-81fd-60f418e2ae01] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:37.627557 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a2962032-780c-49ce-a1fb-9a634474847d tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:37.628045 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a2962032-780c-49ce-a1fb-9a634474847d tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:37.628488 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a2962032-780c-49ce-a1fb-9a634474847d tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:37.629178 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a2962032-780c-49ce-a1fb-9a634474847d tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:37.629629 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a2962032-780c-49ce-a1fb-9a634474847d tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:37.630051 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a2962032-780c-49ce-a1fb-9a634474847d tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:37.655512 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a2962032-780c-49ce-a1fb-9a634474847d tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: 148d0b56-85f9-4bd2-81fd-60f418e2ae01] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:31:37.702747 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.compute.api [None req-a2962032-780c-49ce-a1fb-9a634474847d tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: 148d0b56-85f9-4bd2-81fd-60f418e2ae01] Instance is already in deleting state, ignoring this request Oct 17 14:31:37.703623 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a2962032-780c-49ce-a1fb-9a634474847d tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "DELETE /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01" status: 204 len: 0 microversion: 2.1 time: 0.086803 Oct 17 14:31:37.704180 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3211/6559] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:31:37 2022] DELETE /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:31:37.712776 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-11f89e5d-fd71-46d4-9ec4-146e381255d8 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:37.713451 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-11f89e5d-fd71-46d4-9ec4-146e381255d8 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: 148d0b56-85f9-4bd2-81fd-60f418e2ae01] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:37.719737 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-11f89e5d-fd71-46d4-9ec4-146e381255d8 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:37.720209 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-11f89e5d-fd71-46d4-9ec4-146e381255d8 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:37.720635 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-11f89e5d-fd71-46d4-9ec4-146e381255d8 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:37.721320 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-11f89e5d-fd71-46d4-9ec4-146e381255d8 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:37.721763 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-11f89e5d-fd71-46d4-9ec4-146e381255d8 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:37.722174 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-11f89e5d-fd71-46d4-9ec4-146e381255d8 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:37.862365 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-11f89e5d-fd71-46d4-9ec4-146e381255d8 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:31:37.873209 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-11f89e5d-fd71-46d4-9ec4-146e381255d8 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01" status: 200 len: 1512 microversion: 2.1 time: 0.164334 Oct 17 14:31:37.873899 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3349/6560] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:31:37 2022] GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01 => generated 1512 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:31:37.893078 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-93b688d8-636b-4a9b-bf41-603d08040426 req-fe33f441-c4b6-4a5d-8564-abdf75af5e85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "148d0b56-85f9-4bd2-81fd-60f418e2ae01", "name": "network-vif-plugged", "status": "completed", "tag": "cd8bcfa6-8db1-433f-b9cc-88caaaa1bb7f"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:31:37.903784 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-93b688d8-636b-4a9b-bf41-603d08040426 req-fe33f441-c4b6-4a5d-8564-abdf75af5e85 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:37.904368 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-93b688d8-636b-4a9b-bf41-603d08040426 req-fe33f441-c4b6-4a5d-8564-abdf75af5e85 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:37.904824 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-93b688d8-636b-4a9b-bf41-603d08040426 req-fe33f441-c4b6-4a5d-8564-abdf75af5e85 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:37.916723 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-93b688d8-636b-4a9b-bf41-603d08040426 req-fe33f441-c4b6-4a5d-8564-abdf75af5e85 service nova] Creating event network-vif-plugged:cd8bcfa6-8db1-433f-b9cc-88caaaa1bb7f for instance 148d0b56-85f9-4bd2-81fd-60f418e2ae01 on n-h2-854247-14 Oct 17 14:31:37.922291 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-93b688d8-636b-4a9b-bf41-603d08040426 req-fe33f441-c4b6-4a5d-8564-abdf75af5e85 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096815 Oct 17 14:31:37.922885 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3212/6561] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:31:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:31:38.896112 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e9586ad2-778f-43a1-98f2-6db01e4e6147 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:38.896734 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e9586ad2-778f-43a1-98f2-6db01e4e6147 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: 148d0b56-85f9-4bd2-81fd-60f418e2ae01] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:38.904559 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9586ad2-778f-43a1-98f2-6db01e4e6147 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:38.905055 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9586ad2-778f-43a1-98f2-6db01e4e6147 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:38.905616 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9586ad2-778f-43a1-98f2-6db01e4e6147 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:38.906322 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9586ad2-778f-43a1-98f2-6db01e4e6147 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:38.906780 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9586ad2-778f-43a1-98f2-6db01e4e6147 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:38.907205 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9586ad2-778f-43a1-98f2-6db01e4e6147 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:39.136876 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e9586ad2-778f-43a1-98f2-6db01e4e6147 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb2c9e7d4f3e49f1928faf5f3adbfc08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9e80b7afc44137bb10c1f9dc2de673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:31:39.145126 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e9586ad2-778f-43a1-98f2-6db01e4e6147 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01" status: 200 len: 1512 microversion: 2.1 time: 0.252993 Oct 17 14:31:39.145737 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3350/6562] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:31:38 2022] GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01 => generated 1512 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:31:39.434901 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-c2066557-f399-409a-9f9b-eeda17d2fd03 req-b6469ffe-25f9-4a90-ace5-c905df03d4ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "148d0b56-85f9-4bd2-81fd-60f418e2ae01", "name": "network-vif-deleted", "tag": "cd8bcfa6-8db1-433f-b9cc-88caaaa1bb7f"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:31:39.445982 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-c2066557-f399-409a-9f9b-eeda17d2fd03 req-b6469ffe-25f9-4a90-ace5-c905df03d4ec service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:39.446470 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-c2066557-f399-409a-9f9b-eeda17d2fd03 req-b6469ffe-25f9-4a90-ace5-c905df03d4ec service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:39.446910 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-c2066557-f399-409a-9f9b-eeda17d2fd03 req-b6469ffe-25f9-4a90-ace5-c905df03d4ec service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:39.459599 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-c2066557-f399-409a-9f9b-eeda17d2fd03 req-b6469ffe-25f9-4a90-ace5-c905df03d4ec service nova] Creating event network-vif-deleted:cd8bcfa6-8db1-433f-b9cc-88caaaa1bb7f for instance 148d0b56-85f9-4bd2-81fd-60f418e2ae01 on n-h2-854247-14 Oct 17 14:31:39.464425 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-c2066557-f399-409a-9f9b-eeda17d2fd03 req-b6469ffe-25f9-4a90-ace5-c905df03d4ec service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034877 Oct 17 14:31:39.465028 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3213/6563] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:31:40.168165 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-901845dd-5dad-4489-94a5-b761ec9f68a4 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:40.168784 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-901845dd-5dad-4489-94a5-b761ec9f68a4 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: 148d0b56-85f9-4bd2-81fd-60f418e2ae01] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:40.176237 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-901845dd-5dad-4489-94a5-b761ec9f68a4 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:40.176726 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-901845dd-5dad-4489-94a5-b761ec9f68a4 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:40.177162 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-901845dd-5dad-4489-94a5-b761ec9f68a4 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:40.177860 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-901845dd-5dad-4489-94a5-b761ec9f68a4 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:40.178336 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-901845dd-5dad-4489-94a5-b761ec9f68a4 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:40.178735 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-901845dd-5dad-4489-94a5-b761ec9f68a4 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:40.193150 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-901845dd-5dad-4489-94a5-b761ec9f68a4 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] HTTP exception thrown: Instance 148d0b56-85f9-4bd2-81fd-60f418e2ae01 could not be found. Oct 17 14:31:40.194803 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-901845dd-5dad-4489-94a5-b761ec9f68a4 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Request method failure captured: Oct 17 14:31:40.194803 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01 HTTP/1.1 Oct 17 14:31:40.194803 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 14:31:40.194803 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 14:31:40.194803 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 14:31:40.194803 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 14:31:40.194803 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 14:31:40.194803 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 14:31:40.194803 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 14:31:40.194803 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 14:31:40.194803 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTWbm8O1XYX9kX7ParAyJt9rsUj5GLAq4c4cJ5aKLYNcXddSJ5jiaGMfrGeZVlvcZN1v9LJweTHWvhhbjlgoFE1jbyGfoaeDbm83bb1yLJn5uQMJn1bERiqbYif1wRHdgWheWg4ZGHcVEF3nZNriV6ZkR3Jqfd6WxqWbzLnZKE6cuiYw Oct 17 14:31:40.194803 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 14:31:40.194803 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 14:31:40.194803 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 14:31:40.194803 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 14:31:40.194803 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 14:31:40.194803 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 14:31:40.194803 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: bd9e80b7afc44137bb10c1f9dc2de673 Oct 17 14:31:40.194803 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1472154701 Oct 17 14:31:40.194803 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 14:31:40.194803 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 14:31:40.194803 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/bd9e80b7afc44137bb10c1f9dc2de673"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/bd9e80b7afc44137bb10c1f9dc2de673"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/bd9e80b7afc44137bb10c1f9dc2de673"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_bd9e80b7afc44137bb10c1f9dc2de673", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:31:40.194803 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServerDiskConfigTestJSON-1472154701 Oct 17 14:31:40.194803 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: bd9e80b7afc44137bb10c1f9dc2de673 Oct 17 14:31:40.194803 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1472154701 Oct 17 14:31:40.194803 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServerDiskConfigTestJSON-1472154701-project Oct 17 14:31:40.194803 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 14:31:40.194803 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 14:31:40.194803 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: cb2c9e7d4f3e49f1928faf5f3adbfc08 Oct 17 14:31:40.194803 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServerDiskConfigTestJSON-1472154701-project Oct 17 14:31:40.194803 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 14:31:40.194803 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 148d0b56-85f9-4bd2-81fd-60f418e2ae01 could not be found. Oct 17 14:31:40.194803 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '148d0b56-85f9-4bd2-81fd-60f418e2ae01'} Oct 17 14:31:40.194803 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:31:40.194803 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:31:40.194803 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:31:40.194803 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:31:40.194803 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:31:40.194803 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:31:40.194803 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:31:40.194803 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:31:40.194803 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:31:40.194803 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:31:40.194803 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 148d0b56-85f9-4bd2-81fd-60f418e2ae01 could not be found. Oct 17 14:31:40.194803 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:31:40.194803 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:31:40.194803 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:31:40.194803 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:31:40.194803 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:31:40.194803 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:31:40.194803 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:31:40.194803 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:31:40.194803 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:31:40.194803 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:31:40.194803 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:31:40.194803 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:31:40.194803 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:31:40.194803 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:31:40.194803 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:31:40.194803 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:31:40.194803 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 148d0b56-85f9-4bd2-81fd-60f418e2ae01 could not be found. Oct 17 14:31:40.194803 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:31:40.194803 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:31:40.194803 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:31:40.199535 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:31:40.199535 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:31:40.199535 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:31:40.199535 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:31:40.199535 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:31:40.199535 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 148d0b56-85f9-4bd2-81fd-60f418e2ae01 could not be found. Oct 17 14:31:40.199535 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:31:40.199535 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-901845dd-5dad-4489-94a5-b761ec9f68a4 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Returning 404 to user: Instance 148d0b56-85f9-4bd2-81fd-60f418e2ae01 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:31:40.199535 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-901845dd-5dad-4489-94a5-b761ec9f68a4 tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01" status: 404 len: 111 microversion: 2.1 time: 0.032112 Oct 17 14:31:40.199535 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3351/6564] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:31:40 2022] GET /compute/v2.1/servers/148d0b56-85f9-4bd2-81fd-60f418e2ae01 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:31:40.205942 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8f0b4cc6-153f-4cb5-af12-6c3e0cd8386b tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '.version_select at 0x7f7cd48cee50>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:40.229024 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8f0b4cc6-153f-4cb5-af12-6c3e0cd8386b tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1132562264" status: 202 len: 0 microversion: 2.1 time: 0.027346 Oct 17 14:31:40.229601 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3214/6565] 10.222.0.79 () {58 vars in 1221 bytes} [Mon Oct 17 14:31:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1132562264 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:31:40.887154 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e7554389-20b0-4563-a345-400e8593870b tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:40.887620 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e7554389-20b0-4563-a345-400e8593870b tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: f4e05674-5f71-4ccc-97fe-06094b862388] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:40.894298 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7554389-20b0-4563-a345-400e8593870b tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:40.894787 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7554389-20b0-4563-a345-400e8593870b tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:40.895258 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7554389-20b0-4563-a345-400e8593870b tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:40.895959 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7554389-20b0-4563-a345-400e8593870b tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:40.896419 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7554389-20b0-4563-a345-400e8593870b tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:40.899560 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e7554389-20b0-4563-a345-400e8593870b tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:40.913929 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-e7554389-20b0-4563-a345-400e8593870b tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] HTTP exception thrown: Instance f4e05674-5f71-4ccc-97fe-06094b862388 could not be found. Oct 17 14:31:40.915555 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e7554389-20b0-4563-a345-400e8593870b tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Request method failure captured: Oct 17 14:31:40.915555 n-d-854247-14 devstack@n-api.service[127016]: request: DELETE /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388 HTTP/1.1 Oct 17 14:31:40.915555 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 14:31:40.915555 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 14:31:40.915555 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 14:31:40.915555 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 14:31:40.915555 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 14:31:40.915555 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 14:31:40.915555 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 14:31:40.915555 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 14:31:40.915555 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTWbm8O1XYX9kX7ParAyJt9rsUj5GLAq4c4cJ5aKLYNcXddSJ5jiaGMfrGeZVlvcZN1v9LJweTHWvhhbjlgoFE1jbyGfoaeDbm83bb1yLJn5uQMJn1bERiqbYif1wRHdgWheWg4ZGHcVEF3nZNriV6ZkR3Jqfd6WxqWbzLnZKE6cuiYw Oct 17 14:31:40.915555 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 14:31:40.915555 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 14:31:40.915555 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 14:31:40.915555 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 14:31:40.915555 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 14:31:40.915555 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 14:31:40.915555 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: bd9e80b7afc44137bb10c1f9dc2de673 Oct 17 14:31:40.915555 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1472154701 Oct 17 14:31:40.915555 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 14:31:40.915555 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 14:31:40.915555 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/bd9e80b7afc44137bb10c1f9dc2de673"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/bd9e80b7afc44137bb10c1f9dc2de673"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/bd9e80b7afc44137bb10c1f9dc2de673"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_bd9e80b7afc44137bb10c1f9dc2de673", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:31:40.915555 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServerDiskConfigTestJSON-1472154701 Oct 17 14:31:40.915555 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: bd9e80b7afc44137bb10c1f9dc2de673 Oct 17 14:31:40.915555 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1472154701 Oct 17 14:31:40.915555 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServerDiskConfigTestJSON-1472154701-project Oct 17 14:31:40.915555 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 14:31:40.915555 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 14:31:40.915555 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: cb2c9e7d4f3e49f1928faf5f3adbfc08 Oct 17 14:31:40.915555 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServerDiskConfigTestJSON-1472154701-project Oct 17 14:31:40.915555 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 14:31:40.915555 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance f4e05674-5f71-4ccc-97fe-06094b862388 could not be found. Oct 17 14:31:40.915555 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'f4e05674-5f71-4ccc-97fe-06094b862388'} Oct 17 14:31:40.915555 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:31:40.915555 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:31:40.915555 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:31:40.915555 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:31:40.915555 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:31:40.915555 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:31:40.915555 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:31:40.915555 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:31:40.915555 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:31:40.915555 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:31:40.915555 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4e05674-5f71-4ccc-97fe-06094b862388 could not be found. Oct 17 14:31:40.915555 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:31:40.915555 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:31:40.915555 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:31:40.915555 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:31:40.915555 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:31:40.915555 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:31:40.915555 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:31:40.915555 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:31:40.915555 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:31:40.915555 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:31:40.915555 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 14:31:40.915555 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 14:31:40.915555 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 14:31:40.915555 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 14:31:40.915555 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:31:40.915555 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:31:40.915555 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:31:40.915555 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:31:40.920094 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4e05674-5f71-4ccc-97fe-06094b862388 could not be found. Oct 17 14:31:40.920094 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:31:40.920094 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:31:40.920094 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:31:40.920094 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:31:40.920094 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:31:40.920094 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:31:40.920094 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:31:40.920094 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:31:40.920094 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4e05674-5f71-4ccc-97fe-06094b862388 could not be found. Oct 17 14:31:40.920094 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:31:40.920094 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e7554389-20b0-4563-a345-400e8593870b tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Returning 404 to user: Instance f4e05674-5f71-4ccc-97fe-06094b862388 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:31:40.920094 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e7554389-20b0-4563-a345-400e8593870b tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "DELETE /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388" status: 404 len: 111 microversion: 2.1 time: 0.033955 Oct 17 14:31:40.920094 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3352/6566] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:31:40 2022] DELETE /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:31:40.931527 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-fc2f05c8-35a7-40d5-b033-5a3a7a406b8d tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:40.932762 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-fc2f05c8-35a7-40d5-b033-5a3a7a406b8d tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] [instance: f4e05674-5f71-4ccc-97fe-06094b862388] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:40.935595 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:31:40.942031 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fc2f05c8-35a7-40d5-b033-5a3a7a406b8d tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:40.942527 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fc2f05c8-35a7-40d5-b033-5a3a7a406b8d tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:40.942983 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fc2f05c8-35a7-40d5-b033-5a3a7a406b8d tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:40.943736 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fc2f05c8-35a7-40d5-b033-5a3a7a406b8d tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:40.944200 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fc2f05c8-35a7-40d5-b033-5a3a7a406b8d tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:40.944637 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fc2f05c8-35a7-40d5-b033-5a3a7a406b8d tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:40.960167 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-fc2f05c8-35a7-40d5-b033-5a3a7a406b8d tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] HTTP exception thrown: Instance f4e05674-5f71-4ccc-97fe-06094b862388 could not be found. Oct 17 14:31:40.961839 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-fc2f05c8-35a7-40d5-b033-5a3a7a406b8d tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Request method failure captured: Oct 17 14:31:40.961839 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388 HTTP/1.1 Oct 17 14:31:40.961839 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 14:31:40.961839 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 14:31:40.961839 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 14:31:40.961839 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 14:31:40.961839 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 14:31:40.961839 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 14:31:40.961839 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 14:31:40.961839 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 14:31:40.961839 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTWbm8O1XYX9kX7ParAyJt9rsUj5GLAq4c4cJ5aKLYNcXddSJ5jiaGMfrGeZVlvcZN1v9LJweTHWvhhbjlgoFE1jbyGfoaeDbm83bb1yLJn5uQMJn1bERiqbYif1wRHdgWheWg4ZGHcVEF3nZNriV6ZkR3Jqfd6WxqWbzLnZKE6cuiYw Oct 17 14:31:40.961839 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 14:31:40.961839 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 14:31:40.961839 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 14:31:40.961839 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 14:31:40.961839 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 14:31:40.961839 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 14:31:40.961839 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: bd9e80b7afc44137bb10c1f9dc2de673 Oct 17 14:31:40.961839 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1472154701 Oct 17 14:31:40.961839 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 14:31:40.961839 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 14:31:40.961839 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/bd9e80b7afc44137bb10c1f9dc2de673"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/bd9e80b7afc44137bb10c1f9dc2de673"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/bd9e80b7afc44137bb10c1f9dc2de673"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_bd9e80b7afc44137bb10c1f9dc2de673", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:31:40.961839 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServerDiskConfigTestJSON-1472154701 Oct 17 14:31:40.961839 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: bd9e80b7afc44137bb10c1f9dc2de673 Oct 17 14:31:40.961839 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1472154701 Oct 17 14:31:40.961839 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServerDiskConfigTestJSON-1472154701-project Oct 17 14:31:40.961839 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 14:31:40.961839 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 14:31:40.961839 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: cb2c9e7d4f3e49f1928faf5f3adbfc08 Oct 17 14:31:40.961839 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServerDiskConfigTestJSON-1472154701-project Oct 17 14:31:40.961839 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 14:31:40.961839 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance f4e05674-5f71-4ccc-97fe-06094b862388 could not be found. Oct 17 14:31:40.961839 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'f4e05674-5f71-4ccc-97fe-06094b862388'} Oct 17 14:31:40.961839 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:31:40.961839 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:31:40.961839 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:31:40.961839 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:31:40.961839 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:31:40.961839 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:31:40.961839 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:31:40.961839 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:31:40.961839 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:31:40.961839 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:31:40.961839 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4e05674-5f71-4ccc-97fe-06094b862388 could not be found. Oct 17 14:31:40.961839 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:31:40.961839 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:31:40.961839 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:31:40.961839 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:31:40.961839 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:31:40.961839 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:31:40.961839 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:31:40.961839 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:31:40.961839 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:31:40.961839 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:31:40.961839 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:31:40.961839 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:31:40.961839 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:31:40.961839 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:31:40.961839 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:31:40.961839 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:31:40.961839 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4e05674-5f71-4ccc-97fe-06094b862388 could not be found. Oct 17 14:31:40.961839 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:31:40.961839 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:31:40.961839 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:31:40.966346 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:31:40.966346 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:31:40.966346 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:31:40.966346 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:31:40.966346 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:31:40.966346 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4e05674-5f71-4ccc-97fe-06094b862388 could not be found. Oct 17 14:31:40.966346 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:31:40.966346 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-fc2f05c8-35a7-40d5-b033-5a3a7a406b8d tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] Returning 404 to user: Instance f4e05674-5f71-4ccc-97fe-06094b862388 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:31:40.966346 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-fc2f05c8-35a7-40d5-b033-5a3a7a406b8d tempest-ServerDiskConfigTestJSON-1472154701 tempest-ServerDiskConfigTestJSON-1472154701-project] 10.222.0.79 "GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388" status: 404 len: 111 microversion: 2.1 time: 0.039571 Oct 17 14:31:40.967435 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3215/6567] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:31:40 2022] GET /compute/v2.1/servers/f4e05674-5f71-4ccc-97fe-06094b862388 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:31:49.823612 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-18f4ccdb-a9be-403d-aa41-5acd0983c375 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Action: 'create', calling method: .version_select at 0x7f7ccff48d30>, body: {"keypair": {"name": "tempest-keypair-533599217", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBf8b80AldamCt2BkJh2/eIVmpZKVNKxgc6rI+3b7aOifbyRzPCKqIP5vs8PCx84vpnXNq+edSKiaOqy4/nQcCXatglO8OjWKWWK8mmtti74PZ2hYwbQ4RQMhIeFcu7K1w=="}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:31:49.829532 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:31:49.842136 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-18f4ccdb-a9be-403d-aa41-5acd0983c375 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Getting quotas for project 6312d6ad74bb476384426e63c1ec7ae5. Resources: {'key_pairs'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:31:49.851775 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-18f4ccdb-a9be-403d-aa41-5acd0983c375 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Getting quotas for user ad69a4e71c9e425fac89ec047eda43de and project 6312d6ad74bb476384426e63c1ec7ae5. Resources: {'key_pairs'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:31:49.882425 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-18f4ccdb-a9be-403d-aa41-5acd0983c375 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.181082 Oct 17 14:31:49.883094 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3353/6568] 10.222.0.79 () {60 vars in 1159 bytes} [Mon Oct 17 14:31:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:31:51.171387 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2b8870fc-9918-445b-bf6f-1bfccc1cc912 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-504349904", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8df58892-60b4-4970-b9bf-0ee8a509c119"}], "security_groups": [{"name": "tempest-securitygroup--1788546303"}], "key_name": "tempest-keypair-533599217", "user_data": "}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:31:51.180717 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:31:51.181364 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:31:51.283802 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-2b8870fc-9918-445b-bf6f-1bfccc1cc912 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] validate_networks() for [('8df58892-60b4-4970-b9bf-0ee8a509c119', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:31:51.675981 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-2b8870fc-9918-445b-bf6f-1bfccc1cc912 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:31:51.676421 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-2b8870fc-9918-445b-bf6f-1bfccc1cc912 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:31:51.676902 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-2b8870fc-9918-445b-bf6f-1bfccc1cc912 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:31:51.677321 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-2b8870fc-9918-445b-bf6f-1bfccc1cc912 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:31:51.677743 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-2b8870fc-9918-445b-bf6f-1bfccc1cc912 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:31:51.686999 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2b8870fc-9918-445b-bf6f-1bfccc1cc912 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:51.687527 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2b8870fc-9918-445b-bf6f-1bfccc1cc912 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:51.687972 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2b8870fc-9918-445b-bf6f-1bfccc1cc912 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:51.688701 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2b8870fc-9918-445b-bf6f-1bfccc1cc912 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:51.689162 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2b8870fc-9918-445b-bf6f-1bfccc1cc912 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:51.689598 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2b8870fc-9918-445b-bf6f-1bfccc1cc912 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:51.707504 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-2b8870fc-9918-445b-bf6f-1bfccc1cc912 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Getting quotas for project 6312d6ad74bb476384426e63c1ec7ae5. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:31:51.713392 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-2b8870fc-9918-445b-bf6f-1bfccc1cc912 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Getting quotas for user ad69a4e71c9e425fac89ec047eda43de and project 6312d6ad74bb476384426e63c1ec7ae5. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:31:51.726447 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2b8870fc-9918-445b-bf6f-1bfccc1cc912 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:31:51.728826 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2b8870fc-9918-445b-bf6f-1bfccc1cc912 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 6dc99838-6be6-4bb3-a581-217bbb2b8881] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:31:51.778015 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2b8870fc-9918-445b-bf6f-1bfccc1cc912 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.611380 Oct 17 14:31:51.778972 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3216/6569] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 14:31:51 2022] POST /compute/v2.1/servers => generated 409 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:31:51.787665 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:31:51.792405 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-eeab6661-d9b8-42ad-940a-aa678635b8e1 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:51.793042 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-eeab6661-d9b8-42ad-940a-aa678635b8e1 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 6dc99838-6be6-4bb3-a581-217bbb2b8881] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:51.867568 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-eeab6661-d9b8-42ad-940a-aa678635b8e1 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:31:51.878734 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-eeab6661-d9b8-42ad-940a-aa678635b8e1 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881" status: 200 len: 1237 microversion: 2.1 time: 0.092551 Oct 17 14:31:51.879593 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3354/6570] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:31:51 2022] GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881 => generated 1237 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:31:52.903449 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bd7a4b49-5970-4f47-abd4-88f057c21084 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:52.904851 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-bd7a4b49-5970-4f47-abd4-88f057c21084 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 6dc99838-6be6-4bb3-a581-217bbb2b8881] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:52.912554 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bd7a4b49-5970-4f47-abd4-88f057c21084 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:52.913401 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bd7a4b49-5970-4f47-abd4-88f057c21084 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:52.913827 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bd7a4b49-5970-4f47-abd4-88f057c21084 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:52.914769 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bd7a4b49-5970-4f47-abd4-88f057c21084 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:52.915435 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bd7a4b49-5970-4f47-abd4-88f057c21084 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:52.916032 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bd7a4b49-5970-4f47-abd4-88f057c21084 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:53.017312 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-bd7a4b49-5970-4f47-abd4-88f057c21084 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:31:53.029545 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-bd7a4b49-5970-4f47-abd4-88f057c21084 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881" status: 200 len: 1297 microversion: 2.1 time: 0.131491 Oct 17 14:31:53.030137 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3217/6571] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:31:52 2022] GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881 => generated 1297 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:31:54.052733 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5bada703-df9a-4215-a7ff-c40427f1a588 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:54.053324 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5bada703-df9a-4215-a7ff-c40427f1a588 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 6dc99838-6be6-4bb3-a581-217bbb2b8881] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:54.062061 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5bada703-df9a-4215-a7ff-c40427f1a588 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:54.062549 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5bada703-df9a-4215-a7ff-c40427f1a588 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:54.062989 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5bada703-df9a-4215-a7ff-c40427f1a588 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:54.063720 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5bada703-df9a-4215-a7ff-c40427f1a588 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:54.064391 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5bada703-df9a-4215-a7ff-c40427f1a588 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:54.064814 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5bada703-df9a-4215-a7ff-c40427f1a588 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:54.266302 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5bada703-df9a-4215-a7ff-c40427f1a588 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:31:54.275453 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5bada703-df9a-4215-a7ff-c40427f1a588 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881" status: 200 len: 1363 microversion: 2.1 time: 0.225877 Oct 17 14:31:54.290961 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3355/6572] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:31:54 2022] GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881 => generated 1363 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:31:54.687791 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-548da7ad-c6c9-45d1-9fe3-8a89a11e9fed req-48af1e3a-1d20-4a29-88db-ffd71c21067c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dc99838-6be6-4bb3-a581-217bbb2b8881", "tag": "7fe83be9-943f-4fcf-b648-2193ef9e142c"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:31:54.697762 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-548da7ad-c6c9-45d1-9fe3-8a89a11e9fed req-48af1e3a-1d20-4a29-88db-ffd71c21067c service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:54.698250 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-548da7ad-c6c9-45d1-9fe3-8a89a11e9fed req-48af1e3a-1d20-4a29-88db-ffd71c21067c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:54.698694 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-548da7ad-c6c9-45d1-9fe3-8a89a11e9fed req-48af1e3a-1d20-4a29-88db-ffd71c21067c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:54.711883 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-548da7ad-c6c9-45d1-9fe3-8a89a11e9fed req-48af1e3a-1d20-4a29-88db-ffd71c21067c service nova] Creating event network-changed:7fe83be9-943f-4fcf-b648-2193ef9e142c for instance 6dc99838-6be6-4bb3-a581-217bbb2b8881 on n-h2-854247-14 Oct 17 14:31:54.717043 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-548da7ad-c6c9-45d1-9fe3-8a89a11e9fed req-48af1e3a-1d20-4a29-88db-ffd71c21067c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093531 Oct 17 14:31:54.718123 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3218/6573] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:31:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:31:55.299413 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-850e0641-ace2-4302-a12e-69777818c38a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:55.300039 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-850e0641-ace2-4302-a12e-69777818c38a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 6dc99838-6be6-4bb3-a581-217bbb2b8881] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:55.306578 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-850e0641-ace2-4302-a12e-69777818c38a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:55.307056 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-850e0641-ace2-4302-a12e-69777818c38a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:55.307514 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-850e0641-ace2-4302-a12e-69777818c38a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:55.308203 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-850e0641-ace2-4302-a12e-69777818c38a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:55.308646 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-850e0641-ace2-4302-a12e-69777818c38a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:55.309049 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-850e0641-ace2-4302-a12e-69777818c38a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:55.468935 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-850e0641-ace2-4302-a12e-69777818c38a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:31:55.477317 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-850e0641-ace2-4302-a12e-69777818c38a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881" status: 200 len: 1363 microversion: 2.1 time: 0.182892 Oct 17 14:31:55.477901 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3356/6574] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:31:55 2022] GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881 => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:31:56.503193 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a0704cc8-3b9c-46a3-bae8-6db25ec27113 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:56.503910 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a0704cc8-3b9c-46a3-bae8-6db25ec27113 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 6dc99838-6be6-4bb3-a581-217bbb2b8881] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:56.510534 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a0704cc8-3b9c-46a3-bae8-6db25ec27113 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:56.511055 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a0704cc8-3b9c-46a3-bae8-6db25ec27113 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:56.511601 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a0704cc8-3b9c-46a3-bae8-6db25ec27113 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:56.512285 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a0704cc8-3b9c-46a3-bae8-6db25ec27113 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:56.512769 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a0704cc8-3b9c-46a3-bae8-6db25ec27113 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:56.513198 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a0704cc8-3b9c-46a3-bae8-6db25ec27113 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:56.717128 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a0704cc8-3b9c-46a3-bae8-6db25ec27113 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:31:56.725496 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a0704cc8-3b9c-46a3-bae8-6db25ec27113 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881" status: 200 len: 1363 microversion: 2.1 time: 0.227612 Oct 17 14:31:56.726119 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3219/6575] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:31:56 2022] GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881 => generated 1363 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:31:57.748769 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9539ed06-d1cf-4b4e-b564-4891b6b41d7f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:57.749449 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9539ed06-d1cf-4b4e-b564-4891b6b41d7f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 6dc99838-6be6-4bb3-a581-217bbb2b8881] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:57.756737 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9539ed06-d1cf-4b4e-b564-4891b6b41d7f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:57.757229 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9539ed06-d1cf-4b4e-b564-4891b6b41d7f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:57.757649 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9539ed06-d1cf-4b4e-b564-4891b6b41d7f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:57.758332 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9539ed06-d1cf-4b4e-b564-4891b6b41d7f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:57.759038 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9539ed06-d1cf-4b4e-b564-4891b6b41d7f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:57.759729 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9539ed06-d1cf-4b4e-b564-4891b6b41d7f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:57.898892 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9539ed06-d1cf-4b4e-b564-4891b6b41d7f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:31:57.907068 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9539ed06-d1cf-4b4e-b564-4891b6b41d7f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881" status: 200 len: 1363 microversion: 2.1 time: 0.162308 Oct 17 14:31:57.907752 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3357/6576] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:31:57 2022] GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:31:58.935369 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-da5dba1b-e70b-465b-a9a2-408f6860b855 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:58.936892 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-da5dba1b-e70b-465b-a9a2-408f6860b855 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 6dc99838-6be6-4bb3-a581-217bbb2b8881] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:58.948508 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-da5dba1b-e70b-465b-a9a2-408f6860b855 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:58.949238 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-da5dba1b-e70b-465b-a9a2-408f6860b855 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:58.950017 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-da5dba1b-e70b-465b-a9a2-408f6860b855 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:58.951150 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-da5dba1b-e70b-465b-a9a2-408f6860b855 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:58.951948 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-da5dba1b-e70b-465b-a9a2-408f6860b855 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:58.952446 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-da5dba1b-e70b-465b-a9a2-408f6860b855 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:59.103902 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-da5dba1b-e70b-465b-a9a2-408f6860b855 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:31:59.112117 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-da5dba1b-e70b-465b-a9a2-408f6860b855 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881" status: 200 len: 1363 microversion: 2.1 time: 0.183576 Oct 17 14:31:59.112695 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3220/6577] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:31:58 2022] GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881 => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:31:59.990097 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-60c5b644-45f5-4afd-b132-08873e2ed756 req-7411ba9f-4724-44d8-a7cc-6a3255629559 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dc99838-6be6-4bb3-a581-217bbb2b8881", "name": "network-vif-plugged", "status": "completed", "tag": "7fe83be9-943f-4fcf-b648-2193ef9e142c"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:31:59.999999 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-60c5b644-45f5-4afd-b132-08873e2ed756 req-7411ba9f-4724-44d8-a7cc-6a3255629559 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:00.000478 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-60c5b644-45f5-4afd-b132-08873e2ed756 req-7411ba9f-4724-44d8-a7cc-6a3255629559 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:00.000908 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-60c5b644-45f5-4afd-b132-08873e2ed756 req-7411ba9f-4724-44d8-a7cc-6a3255629559 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:00.012028 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-60c5b644-45f5-4afd-b132-08873e2ed756 req-7411ba9f-4724-44d8-a7cc-6a3255629559 service nova] Creating event network-vif-plugged:7fe83be9-943f-4fcf-b648-2193ef9e142c for instance 6dc99838-6be6-4bb3-a581-217bbb2b8881 on n-h2-854247-14 Oct 17 14:32:00.017127 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-60c5b644-45f5-4afd-b132-08873e2ed756 req-7411ba9f-4724-44d8-a7cc-6a3255629559 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083109 Oct 17 14:32:00.017731 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3358/6578] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:32:00.135468 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-df9cdaa1-a44d-4a00-b8d5-9491bdc39cd0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:00.136060 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-df9cdaa1-a44d-4a00-b8d5-9491bdc39cd0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 6dc99838-6be6-4bb3-a581-217bbb2b8881] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:00.144176 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-df9cdaa1-a44d-4a00-b8d5-9491bdc39cd0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:00.144742 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-df9cdaa1-a44d-4a00-b8d5-9491bdc39cd0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:00.145349 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-df9cdaa1-a44d-4a00-b8d5-9491bdc39cd0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:00.146071 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-df9cdaa1-a44d-4a00-b8d5-9491bdc39cd0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:00.146552 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-df9cdaa1-a44d-4a00-b8d5-9491bdc39cd0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:00.146993 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-df9cdaa1-a44d-4a00-b8d5-9491bdc39cd0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:00.279646 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-df9cdaa1-a44d-4a00-b8d5-9491bdc39cd0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:32:00.287703 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-df9cdaa1-a44d-4a00-b8d5-9491bdc39cd0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881" status: 200 len: 1363 microversion: 2.1 time: 0.156188 Oct 17 14:32:00.288279 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3221/6579] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:32:00 2022] GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:32:01.311927 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f1bec18e-4d2d-4a36-b25c-f5f09d8862fa tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:01.312628 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f1bec18e-4d2d-4a36-b25c-f5f09d8862fa tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 6dc99838-6be6-4bb3-a581-217bbb2b8881] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:01.319549 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1bec18e-4d2d-4a36-b25c-f5f09d8862fa tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:01.320039 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1bec18e-4d2d-4a36-b25c-f5f09d8862fa tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:01.320451 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1bec18e-4d2d-4a36-b25c-f5f09d8862fa tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:01.321140 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1bec18e-4d2d-4a36-b25c-f5f09d8862fa tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:01.321590 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1bec18e-4d2d-4a36-b25c-f5f09d8862fa tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:01.322010 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1bec18e-4d2d-4a36-b25c-f5f09d8862fa tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:01.460392 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f1bec18e-4d2d-4a36-b25c-f5f09d8862fa tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:32:01.469644 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f1bec18e-4d2d-4a36-b25c-f5f09d8862fa tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881" status: 200 len: 1549 microversion: 2.1 time: 0.163145 Oct 17 14:32:01.472289 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3359/6580] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:32:01 2022] GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881 => generated 1549 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:32:01.496977 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-fa390f77-c219-4541-9200-7e126bf8c80c tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:01.497553 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-fa390f77-c219-4541-9200-7e126bf8c80c tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 6dc99838-6be6-4bb3-a581-217bbb2b8881] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:01.505074 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fa390f77-c219-4541-9200-7e126bf8c80c tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:01.505586 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fa390f77-c219-4541-9200-7e126bf8c80c tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:01.506032 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fa390f77-c219-4541-9200-7e126bf8c80c tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:01.506727 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fa390f77-c219-4541-9200-7e126bf8c80c tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:01.507195 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fa390f77-c219-4541-9200-7e126bf8c80c tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:01.507659 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fa390f77-c219-4541-9200-7e126bf8c80c tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:01.588864 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-fa390f77-c219-4541-9200-7e126bf8c80c tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095518 Oct 17 14:32:01.589516 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3222/6581] 10.222.0.79 () {58 vars in 1275 bytes} [Mon Oct 17 14:32:01 2022] GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:32:02.599040 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-d4ea1d08-ca9a-4741-8c08-99fb6cc0e82b req-1142ed09-7ad2-49b7-b8f2-42eaa84fea86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dc99838-6be6-4bb3-a581-217bbb2b8881", "tag": "7fe83be9-943f-4fcf-b648-2193ef9e142c"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:32:02.604176 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=6 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:32:02.610976 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-d4ea1d08-ca9a-4741-8c08-99fb6cc0e82b req-1142ed09-7ad2-49b7-b8f2-42eaa84fea86 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:02.611795 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-d4ea1d08-ca9a-4741-8c08-99fb6cc0e82b req-1142ed09-7ad2-49b7-b8f2-42eaa84fea86 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:02.611929 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-d4ea1d08-ca9a-4741-8c08-99fb6cc0e82b req-1142ed09-7ad2-49b7-b8f2-42eaa84fea86 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:02.627619 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-d4ea1d08-ca9a-4741-8c08-99fb6cc0e82b req-1142ed09-7ad2-49b7-b8f2-42eaa84fea86 service nova] Creating event network-changed:7fe83be9-943f-4fcf-b648-2193ef9e142c for instance 6dc99838-6be6-4bb3-a581-217bbb2b8881 on n-h2-854247-14 Oct 17 14:32:02.632987 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-d4ea1d08-ca9a-4741-8c08-99fb6cc0e82b req-1142ed09-7ad2-49b7-b8f2-42eaa84fea86 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037778 Oct 17 14:32:02.633962 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3360/6582] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:32:37.638318 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:32:37.639268 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=6 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:32:37.642544 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:32:37.643737 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=32 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:32:37.651421 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-61a1f1ef-594d-411e-9ec0-b87adbae82f2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:37.652397 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-61a1f1ef-594d-411e-9ec0-b87adbae82f2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 6dc99838-6be6-4bb3-a581-217bbb2b8881] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:37.661754 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-61a1f1ef-594d-411e-9ec0-b87adbae82f2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:37.662249 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-61a1f1ef-594d-411e-9ec0-b87adbae82f2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:37.662692 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-61a1f1ef-594d-411e-9ec0-b87adbae82f2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:37.663455 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-61a1f1ef-594d-411e-9ec0-b87adbae82f2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:37.663914 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-61a1f1ef-594d-411e-9ec0-b87adbae82f2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:37.664348 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-61a1f1ef-594d-411e-9ec0-b87adbae82f2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:37.808822 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-61a1f1ef-594d-411e-9ec0-b87adbae82f2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:32:37.819419 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-61a1f1ef-594d-411e-9ec0-b87adbae82f2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881" status: 200 len: 1666 microversion: 2.1 time: 0.183288 Oct 17 14:32:37.820018 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3223/6583] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:32:37 2022] GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881 => generated 1666 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:32:37.849145 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:32:37.849945 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=28 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:32:37.854480 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-dbc52984-9091-47f3-b325-12f60458986e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:37.855258 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-dbc52984-9091-47f3-b325-12f60458986e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 6dc99838-6be6-4bb3-a581-217bbb2b8881] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:37.862515 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dbc52984-9091-47f3-b325-12f60458986e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:37.863005 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dbc52984-9091-47f3-b325-12f60458986e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:37.863460 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dbc52984-9091-47f3-b325-12f60458986e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:37.864139 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dbc52984-9091-47f3-b325-12f60458986e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:37.864584 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dbc52984-9091-47f3-b325-12f60458986e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:37.865000 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dbc52984-9091-47f3-b325-12f60458986e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:38.016683 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-dbc52984-9091-47f3-b325-12f60458986e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:32:38.029514 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-dbc52984-9091-47f3-b325-12f60458986e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881" status: 200 len: 1666 microversion: 2.1 time: 0.182582 Oct 17 14:32:38.030587 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3361/6584] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:32:37 2022] GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881 => generated 1666 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:32:38.057684 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4e290e83-5916-410a-8adf-9d8a8ea0b4ee tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:38.058314 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4e290e83-5916-410a-8adf-9d8a8ea0b4ee tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 6dc99838-6be6-4bb3-a581-217bbb2b8881] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:38.064691 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4e290e83-5916-410a-8adf-9d8a8ea0b4ee tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:38.065191 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4e290e83-5916-410a-8adf-9d8a8ea0b4ee tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:38.065644 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4e290e83-5916-410a-8adf-9d8a8ea0b4ee tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:38.066354 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4e290e83-5916-410a-8adf-9d8a8ea0b4ee tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:38.066824 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4e290e83-5916-410a-8adf-9d8a8ea0b4ee tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:38.067299 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4e290e83-5916-410a-8adf-9d8a8ea0b4ee tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:38.201716 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4e290e83-5916-410a-8adf-9d8a8ea0b4ee tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:32:38.209754 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4e290e83-5916-410a-8adf-9d8a8ea0b4ee tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881" status: 200 len: 1666 microversion: 2.1 time: 0.155929 Oct 17 14:32:38.210266 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3224/6585] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:32:38 2022] GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881 => generated 1666 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:32:38.231957 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4a12ab6a-4075-405c-b4ed-f27e8e00ea77 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:32:38.234248 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4a12ab6a-4075-405c-b4ed-f27e8e00ea77 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 6dc99838-6be6-4bb3-a581-217bbb2b8881] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:38.240431 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4a12ab6a-4075-405c-b4ed-f27e8e00ea77 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:38.240913 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4a12ab6a-4075-405c-b4ed-f27e8e00ea77 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:38.241342 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4a12ab6a-4075-405c-b4ed-f27e8e00ea77 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:38.242028 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4a12ab6a-4075-405c-b4ed-f27e8e00ea77 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:38.242475 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4a12ab6a-4075-405c-b4ed-f27e8e00ea77 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:38.242891 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4a12ab6a-4075-405c-b4ed-f27e8e00ea77 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:38.548384 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4a12ab6a-4075-405c-b4ed-f27e8e00ea77 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:32:38.554262 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4a12ab6a-4075-405c-b4ed-f27e8e00ea77 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 6dc99838-6be6-4bb3-a581-217bbb2b8881] Old instance type m1.heat2, new instance type m1.heat {{(pid=127016) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 17 14:32:38.561434 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-4a12ab6a-4075-405c-b4ed-f27e8e00ea77 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:32:38.561847 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-4a12ab6a-4075-405c-b4ed-f27e8e00ea77 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:32:38.562330 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-4a12ab6a-4075-405c-b4ed-f27e8e00ea77 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:32:38.562715 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-4a12ab6a-4075-405c-b4ed-f27e8e00ea77 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:32:38.563120 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-4a12ab6a-4075-405c-b4ed-f27e8e00ea77 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:32:38.630796 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4a12ab6a-4075-405c-b4ed-f27e8e00ea77 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "POST /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881/action" status: 202 len: 0 microversion: 2.1 time: 0.402803 Oct 17 14:32:38.631757 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3362/6586] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:32:38 2022] POST /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881/action => generated 0 bytes in 404 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:32:38.640835 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-33a7f16d-b19e-424d-a29e-a665717046f2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:38.641462 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-33a7f16d-b19e-424d-a29e-a665717046f2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 6dc99838-6be6-4bb3-a581-217bbb2b8881] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:38.649454 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-33a7f16d-b19e-424d-a29e-a665717046f2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:38.650784 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-33a7f16d-b19e-424d-a29e-a665717046f2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:38.651760 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-33a7f16d-b19e-424d-a29e-a665717046f2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:38.652634 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-33a7f16d-b19e-424d-a29e-a665717046f2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:38.653239 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-33a7f16d-b19e-424d-a29e-a665717046f2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:38.653872 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-33a7f16d-b19e-424d-a29e-a665717046f2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:38.796493 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-33a7f16d-b19e-424d-a29e-a665717046f2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:32:38.805407 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-33a7f16d-b19e-424d-a29e-a665717046f2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881" status: 200 len: 1675 microversion: 2.1 time: 0.169126 Oct 17 14:32:38.806010 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3225/6587] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:32:38 2022] GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881 => generated 1675 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:32:39.835998 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5943493c-8fd6-4ec3-992a-eae29a0daf72 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:39.836937 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5943493c-8fd6-4ec3-992a-eae29a0daf72 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 6dc99838-6be6-4bb3-a581-217bbb2b8881] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:39.846894 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5943493c-8fd6-4ec3-992a-eae29a0daf72 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:39.848011 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5943493c-8fd6-4ec3-992a-eae29a0daf72 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:39.848408 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5943493c-8fd6-4ec3-992a-eae29a0daf72 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:39.849116 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5943493c-8fd6-4ec3-992a-eae29a0daf72 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:39.849575 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5943493c-8fd6-4ec3-992a-eae29a0daf72 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:39.849960 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5943493c-8fd6-4ec3-992a-eae29a0daf72 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:40.083925 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5943493c-8fd6-4ec3-992a-eae29a0daf72 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:32:40.092228 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5943493c-8fd6-4ec3-992a-eae29a0daf72 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881" status: 200 len: 1675 microversion: 2.1 time: 0.266153 Oct 17 14:32:40.093032 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3363/6588] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:32:39 2022] GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881 => generated 1675 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:32:41.115590 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8577a5b7-f8b8-4edd-a93c-6702c8c90d79 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:41.116212 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8577a5b7-f8b8-4edd-a93c-6702c8c90d79 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 6dc99838-6be6-4bb3-a581-217bbb2b8881] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:41.123934 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8577a5b7-f8b8-4edd-a93c-6702c8c90d79 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:41.124429 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8577a5b7-f8b8-4edd-a93c-6702c8c90d79 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:41.124871 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8577a5b7-f8b8-4edd-a93c-6702c8c90d79 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:41.125573 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8577a5b7-f8b8-4edd-a93c-6702c8c90d79 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:41.126035 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8577a5b7-f8b8-4edd-a93c-6702c8c90d79 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:41.126463 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8577a5b7-f8b8-4edd-a93c-6702c8c90d79 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:41.259341 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8577a5b7-f8b8-4edd-a93c-6702c8c90d79 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:32:41.271986 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8577a5b7-f8b8-4edd-a93c-6702c8c90d79 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881" status: 200 len: 1680 microversion: 2.1 time: 0.160107 Oct 17 14:32:41.272834 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3226/6589] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:32:41 2022] GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:32:42.302999 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8de670e0-48e0-4dce-8d5e-e1504e5f0288 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:42.304077 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8de670e0-48e0-4dce-8d5e-e1504e5f0288 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 6dc99838-6be6-4bb3-a581-217bbb2b8881] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:42.314154 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8de670e0-48e0-4dce-8d5e-e1504e5f0288 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:42.314634 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8de670e0-48e0-4dce-8d5e-e1504e5f0288 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:42.315093 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8de670e0-48e0-4dce-8d5e-e1504e5f0288 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:42.315810 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8de670e0-48e0-4dce-8d5e-e1504e5f0288 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:42.316251 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8de670e0-48e0-4dce-8d5e-e1504e5f0288 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:42.316666 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8de670e0-48e0-4dce-8d5e-e1504e5f0288 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:42.458821 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8de670e0-48e0-4dce-8d5e-e1504e5f0288 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:32:42.471194 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8de670e0-48e0-4dce-8d5e-e1504e5f0288 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881" status: 200 len: 1680 microversion: 2.1 time: 0.174653 Oct 17 14:32:42.471894 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3364/6590] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:32:42 2022] GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881 => generated 1680 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:32:43.500218 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-58c3cfa2-fca8-40a1-a4bd-bfc6cdff701f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:43.500820 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-58c3cfa2-fca8-40a1-a4bd-bfc6cdff701f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 6dc99838-6be6-4bb3-a581-217bbb2b8881] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:43.508150 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-58c3cfa2-fca8-40a1-a4bd-bfc6cdff701f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:43.508675 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-58c3cfa2-fca8-40a1-a4bd-bfc6cdff701f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:43.509119 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-58c3cfa2-fca8-40a1-a4bd-bfc6cdff701f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:43.509825 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-58c3cfa2-fca8-40a1-a4bd-bfc6cdff701f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:43.510284 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-58c3cfa2-fca8-40a1-a4bd-bfc6cdff701f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:43.510749 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-58c3cfa2-fca8-40a1-a4bd-bfc6cdff701f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:43.644650 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-58c3cfa2-fca8-40a1-a4bd-bfc6cdff701f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:32:43.653023 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-58c3cfa2-fca8-40a1-a4bd-bfc6cdff701f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881" status: 200 len: 1680 microversion: 2.1 time: 0.157599 Oct 17 14:32:43.653618 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3227/6591] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:32:43 2022] GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:32:44.676225 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-67cad31e-ae95-437e-ad7a-4c4ed856a628 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:44.676886 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-67cad31e-ae95-437e-ad7a-4c4ed856a628 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 6dc99838-6be6-4bb3-a581-217bbb2b8881] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:44.684377 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-67cad31e-ae95-437e-ad7a-4c4ed856a628 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:44.684866 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-67cad31e-ae95-437e-ad7a-4c4ed856a628 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:44.685299 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-67cad31e-ae95-437e-ad7a-4c4ed856a628 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:44.685996 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-67cad31e-ae95-437e-ad7a-4c4ed856a628 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:44.686479 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-67cad31e-ae95-437e-ad7a-4c4ed856a628 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:44.686909 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-67cad31e-ae95-437e-ad7a-4c4ed856a628 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:44.824996 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-67cad31e-ae95-437e-ad7a-4c4ed856a628 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:32:44.833728 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-67cad31e-ae95-437e-ad7a-4c4ed856a628 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881" status: 200 len: 1680 microversion: 2.1 time: 0.161487 Oct 17 14:32:44.834295 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3365/6592] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:32:44 2022] GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:32:45.858707 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-49fdeae1-158f-41ca-badb-4a7e5eb9c39f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:45.859899 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-49fdeae1-158f-41ca-badb-4a7e5eb9c39f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 6dc99838-6be6-4bb3-a581-217bbb2b8881] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:45.871744 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-49fdeae1-158f-41ca-badb-4a7e5eb9c39f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:45.872516 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-49fdeae1-158f-41ca-badb-4a7e5eb9c39f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:45.872972 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-49fdeae1-158f-41ca-badb-4a7e5eb9c39f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:45.873699 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-49fdeae1-158f-41ca-badb-4a7e5eb9c39f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:45.874159 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-49fdeae1-158f-41ca-badb-4a7e5eb9c39f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:45.874720 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-49fdeae1-158f-41ca-badb-4a7e5eb9c39f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:46.014372 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-49fdeae1-158f-41ca-badb-4a7e5eb9c39f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:32:46.027474 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-49fdeae1-158f-41ca-badb-4a7e5eb9c39f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881" status: 200 len: 1680 microversion: 2.1 time: 0.173943 Oct 17 14:32:46.028251 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3228/6593] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:32:45 2022] GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881 => generated 1680 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:32:47.052997 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1c8ba8a1-07a4-4c90-9cdd-887fa1bcea1e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:47.053681 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-1c8ba8a1-07a4-4c90-9cdd-887fa1bcea1e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 6dc99838-6be6-4bb3-a581-217bbb2b8881] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:47.061628 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1c8ba8a1-07a4-4c90-9cdd-887fa1bcea1e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:47.062163 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1c8ba8a1-07a4-4c90-9cdd-887fa1bcea1e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:47.062643 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1c8ba8a1-07a4-4c90-9cdd-887fa1bcea1e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:47.063460 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1c8ba8a1-07a4-4c90-9cdd-887fa1bcea1e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:47.063961 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1c8ba8a1-07a4-4c90-9cdd-887fa1bcea1e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:47.064438 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1c8ba8a1-07a4-4c90-9cdd-887fa1bcea1e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:47.219234 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-1c8ba8a1-07a4-4c90-9cdd-887fa1bcea1e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:32:47.228445 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1c8ba8a1-07a4-4c90-9cdd-887fa1bcea1e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881" status: 200 len: 1680 microversion: 2.1 time: 0.179878 Oct 17 14:32:47.229013 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3366/6594] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:32:47 2022] GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881 => generated 1680 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:32:48.253606 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8b3513c1-e947-4d65-be23-b310104adfdd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:48.254236 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8b3513c1-e947-4d65-be23-b310104adfdd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 6dc99838-6be6-4bb3-a581-217bbb2b8881] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:48.261655 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8b3513c1-e947-4d65-be23-b310104adfdd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:48.262180 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8b3513c1-e947-4d65-be23-b310104adfdd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:48.262630 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8b3513c1-e947-4d65-be23-b310104adfdd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:48.263373 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8b3513c1-e947-4d65-be23-b310104adfdd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:48.263840 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8b3513c1-e947-4d65-be23-b310104adfdd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:48.264279 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8b3513c1-e947-4d65-be23-b310104adfdd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:48.407823 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8b3513c1-e947-4d65-be23-b310104adfdd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:32:48.416715 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8b3513c1-e947-4d65-be23-b310104adfdd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881" status: 200 len: 1680 microversion: 2.1 time: 0.168178 Oct 17 14:32:48.417277 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3229/6595] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:32:48 2022] GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881 => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:32:49.443836 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-85b0c6db-ef8c-4f27-ad80-2200d61a40cf tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:49.444456 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-85b0c6db-ef8c-4f27-ad80-2200d61a40cf tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 6dc99838-6be6-4bb3-a581-217bbb2b8881] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:49.453911 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-85b0c6db-ef8c-4f27-ad80-2200d61a40cf tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:49.454407 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-85b0c6db-ef8c-4f27-ad80-2200d61a40cf tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:49.454846 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-85b0c6db-ef8c-4f27-ad80-2200d61a40cf tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:49.455620 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-85b0c6db-ef8c-4f27-ad80-2200d61a40cf tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:49.456050 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-85b0c6db-ef8c-4f27-ad80-2200d61a40cf tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:49.456471 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-85b0c6db-ef8c-4f27-ad80-2200d61a40cf tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:49.593050 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-85b0c6db-ef8c-4f27-ad80-2200d61a40cf tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:32:49.602065 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-85b0c6db-ef8c-4f27-ad80-2200d61a40cf tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881" status: 200 len: 1680 microversion: 2.1 time: 0.163007 Oct 17 14:32:49.602641 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3367/6596] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:32:49 2022] GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:32:50.630038 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1915f66e-4382-43b6-91fb-ef53c05e8080 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:50.630943 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1915f66e-4382-43b6-91fb-ef53c05e8080 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 6dc99838-6be6-4bb3-a581-217bbb2b8881] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:50.642849 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1915f66e-4382-43b6-91fb-ef53c05e8080 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:50.643725 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1915f66e-4382-43b6-91fb-ef53c05e8080 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:50.644187 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1915f66e-4382-43b6-91fb-ef53c05e8080 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:50.645293 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1915f66e-4382-43b6-91fb-ef53c05e8080 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:50.645751 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1915f66e-4382-43b6-91fb-ef53c05e8080 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:50.646184 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1915f66e-4382-43b6-91fb-ef53c05e8080 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:50.786996 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1915f66e-4382-43b6-91fb-ef53c05e8080 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:32:50.795000 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1915f66e-4382-43b6-91fb-ef53c05e8080 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881" status: 200 len: 1680 microversion: 2.1 time: 0.171917 Oct 17 14:32:50.795601 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3230/6597] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:32:50 2022] GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881 => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:32:51.822533 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d97c7434-8eac-43bc-a8cb-258bfc58e327 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:51.823374 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d97c7434-8eac-43bc-a8cb-258bfc58e327 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 6dc99838-6be6-4bb3-a581-217bbb2b8881] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:51.834718 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d97c7434-8eac-43bc-a8cb-258bfc58e327 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:51.835477 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d97c7434-8eac-43bc-a8cb-258bfc58e327 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:51.836097 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d97c7434-8eac-43bc-a8cb-258bfc58e327 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:51.837144 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d97c7434-8eac-43bc-a8cb-258bfc58e327 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:51.837829 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d97c7434-8eac-43bc-a8cb-258bfc58e327 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:51.838482 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d97c7434-8eac-43bc-a8cb-258bfc58e327 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:51.976785 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d97c7434-8eac-43bc-a8cb-258bfc58e327 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:32:51.989445 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d97c7434-8eac-43bc-a8cb-258bfc58e327 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881" status: 200 len: 1680 microversion: 2.1 time: 0.173294 Oct 17 14:32:51.990269 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3368/6598] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:32:51 2022] GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881 => generated 1680 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:32:53.018029 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e90b2c09-f573-4479-a49d-8acde9c0d3e9 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:53.018647 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e90b2c09-f573-4479-a49d-8acde9c0d3e9 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 6dc99838-6be6-4bb3-a581-217bbb2b8881] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:53.026300 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e90b2c09-f573-4479-a49d-8acde9c0d3e9 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:53.026780 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e90b2c09-f573-4479-a49d-8acde9c0d3e9 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:53.027259 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e90b2c09-f573-4479-a49d-8acde9c0d3e9 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:53.027978 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e90b2c09-f573-4479-a49d-8acde9c0d3e9 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:53.028446 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e90b2c09-f573-4479-a49d-8acde9c0d3e9 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:53.028944 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e90b2c09-f573-4479-a49d-8acde9c0d3e9 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:53.168252 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e90b2c09-f573-4479-a49d-8acde9c0d3e9 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:32:53.176376 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e90b2c09-f573-4479-a49d-8acde9c0d3e9 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881" status: 200 len: 1679 microversion: 2.1 time: 0.162488 Oct 17 14:32:53.186632 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3231/6599] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:32:53 2022] GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881 => generated 1679 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:32:53.264882 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-59f31c8d-99aa-4655-aa24-aeb2e831aee9 req-faeeb878-a20e-4cd5-867b-083a98d9a3e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dc99838-6be6-4bb3-a581-217bbb2b8881", "name": "network-vif-unplugged", "status": "completed", "tag": "7fe83be9-943f-4fcf-b648-2193ef9e142c"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:32:53.275204 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-59f31c8d-99aa-4655-aa24-aeb2e831aee9 req-faeeb878-a20e-4cd5-867b-083a98d9a3e6 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:53.275739 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-59f31c8d-99aa-4655-aa24-aeb2e831aee9 req-faeeb878-a20e-4cd5-867b-083a98d9a3e6 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:53.276233 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-59f31c8d-99aa-4655-aa24-aeb2e831aee9 req-faeeb878-a20e-4cd5-867b-083a98d9a3e6 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:53.289686 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-59f31c8d-99aa-4655-aa24-aeb2e831aee9 req-faeeb878-a20e-4cd5-867b-083a98d9a3e6 service nova] Creating event network-vif-unplugged:7fe83be9-943f-4fcf-b648-2193ef9e142c for instance 6dc99838-6be6-4bb3-a581-217bbb2b8881 on n-h1-854247-14 Oct 17 14:32:53.296064 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [req-59f31c8d-99aa-4655-aa24-aeb2e831aee9 req-faeeb878-a20e-4cd5-867b-083a98d9a3e6 service nova] Instance 6dc99838-6be6-4bb3-a581-217bbb2b8881 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854247-14', 'n-h1-854247-14'} {{(pid=127016) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 14:32:53.307729 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-59f31c8d-99aa-4655-aa24-aeb2e831aee9 req-faeeb878-a20e-4cd5-867b-083a98d9a3e6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098126 Oct 17 14:32:53.308381 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3369/6600] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:32:54.199527 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-704f40e6-4d50-4f7e-88ed-1ae6191556d2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:54.200265 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-704f40e6-4d50-4f7e-88ed-1ae6191556d2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 6dc99838-6be6-4bb3-a581-217bbb2b8881] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:54.208044 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-704f40e6-4d50-4f7e-88ed-1ae6191556d2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:54.208549 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-704f40e6-4d50-4f7e-88ed-1ae6191556d2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:54.209012 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-704f40e6-4d50-4f7e-88ed-1ae6191556d2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:54.209775 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-704f40e6-4d50-4f7e-88ed-1ae6191556d2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:54.210222 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-704f40e6-4d50-4f7e-88ed-1ae6191556d2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:54.210653 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-704f40e6-4d50-4f7e-88ed-1ae6191556d2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:54.350536 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-704f40e6-4d50-4f7e-88ed-1ae6191556d2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:32:54.359084 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-704f40e6-4d50-4f7e-88ed-1ae6191556d2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881" status: 200 len: 1679 microversion: 2.1 time: 0.163462 Oct 17 14:32:54.359682 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3232/6601] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:32:54 2022] GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:32:55.356350 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-8230ffd0-dfc4-4c65-8cc7-8e0c875df6bc req-0eaa6391-2cf5-496b-8a10-ee9eb8809114 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dc99838-6be6-4bb3-a581-217bbb2b8881", "tag": "7fe83be9-943f-4fcf-b648-2193ef9e142c"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:32:55.368446 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-8230ffd0-dfc4-4c65-8cc7-8e0c875df6bc req-0eaa6391-2cf5-496b-8a10-ee9eb8809114 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:55.368942 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-8230ffd0-dfc4-4c65-8cc7-8e0c875df6bc req-0eaa6391-2cf5-496b-8a10-ee9eb8809114 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:55.369396 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-8230ffd0-dfc4-4c65-8cc7-8e0c875df6bc req-0eaa6391-2cf5-496b-8a10-ee9eb8809114 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:55.381485 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-8230ffd0-dfc4-4c65-8cc7-8e0c875df6bc req-0eaa6391-2cf5-496b-8a10-ee9eb8809114 service nova] Creating event network-changed:7fe83be9-943f-4fcf-b648-2193ef9e142c for instance 6dc99838-6be6-4bb3-a581-217bbb2b8881 on n-h1-854247-14 Oct 17 14:32:55.382942 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-217671f2-8ca6-42a3-abee-f900b12e63c4 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:55.383715 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-217671f2-8ca6-42a3-abee-f900b12e63c4 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 6dc99838-6be6-4bb3-a581-217bbb2b8881] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:55.387551 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [req-8230ffd0-dfc4-4c65-8cc7-8e0c875df6bc req-0eaa6391-2cf5-496b-8a10-ee9eb8809114 service nova] Instance 6dc99838-6be6-4bb3-a581-217bbb2b8881 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854247-14', 'n-h1-854247-14'} {{(pid=127016) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 14:32:55.390880 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-217671f2-8ca6-42a3-abee-f900b12e63c4 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:55.391417 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-217671f2-8ca6-42a3-abee-f900b12e63c4 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:55.392552 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-217671f2-8ca6-42a3-abee-f900b12e63c4 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:55.393770 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-217671f2-8ca6-42a3-abee-f900b12e63c4 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:55.394599 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-217671f2-8ca6-42a3-abee-f900b12e63c4 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:55.395136 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-217671f2-8ca6-42a3-abee-f900b12e63c4 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:55.399504 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-8230ffd0-dfc4-4c65-8cc7-8e0c875df6bc req-0eaa6391-2cf5-496b-8a10-ee9eb8809114 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051907 Oct 17 14:32:55.400123 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3370/6602] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:32:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:32:55.622916 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-217671f2-8ca6-42a3-abee-f900b12e63c4 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:32:55.631741 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-217671f2-8ca6-42a3-abee-f900b12e63c4 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881" status: 200 len: 1677 microversion: 2.1 time: 0.252685 Oct 17 14:32:55.632235 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3233/6603] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:32:55 2022] GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881 => generated 1677 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:32:56.656991 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d1f0f67d-edb5-41c3-8621-3a38b56850ee tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:56.658488 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d1f0f67d-edb5-41c3-8621-3a38b56850ee tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 6dc99838-6be6-4bb3-a581-217bbb2b8881] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:56.669124 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d1f0f67d-edb5-41c3-8621-3a38b56850ee tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:56.670350 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d1f0f67d-edb5-41c3-8621-3a38b56850ee tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:56.670957 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d1f0f67d-edb5-41c3-8621-3a38b56850ee tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:56.671805 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d1f0f67d-edb5-41c3-8621-3a38b56850ee tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:56.672460 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d1f0f67d-edb5-41c3-8621-3a38b56850ee tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:56.673054 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d1f0f67d-edb5-41c3-8621-3a38b56850ee tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:56.822308 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d1f0f67d-edb5-41c3-8621-3a38b56850ee tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:32:56.830381 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d1f0f67d-edb5-41c3-8621-3a38b56850ee tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881" status: 200 len: 1674 microversion: 2.1 time: 0.178977 Oct 17 14:32:56.830947 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3371/6604] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:32:56 2022] GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881 => generated 1674 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:32:56.853677 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-da2b4dcd-9e9f-445e-8b59-881432dd5c60 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:32:56.854251 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-da2b4dcd-9e9f-445e-8b59-881432dd5c60 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 6dc99838-6be6-4bb3-a581-217bbb2b8881] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:56.862621 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-da2b4dcd-9e9f-445e-8b59-881432dd5c60 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:56.863131 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-da2b4dcd-9e9f-445e-8b59-881432dd5c60 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:56.863694 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-da2b4dcd-9e9f-445e-8b59-881432dd5c60 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:56.864477 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-da2b4dcd-9e9f-445e-8b59-881432dd5c60 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:56.864942 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-da2b4dcd-9e9f-445e-8b59-881432dd5c60 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:56.865410 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-da2b4dcd-9e9f-445e-8b59-881432dd5c60 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:56.931800 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-da2b4dcd-9e9f-445e-8b59-881432dd5c60 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "POST /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881/action" status: 204 len: 0 microversion: 2.1 time: 0.081650 Oct 17 14:32:56.932497 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3234/6605] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:32:56 2022] POST /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881/action => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:32:56.941076 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c3d6e062-3223-4e17-8956-b1888e774240 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:56.941683 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c3d6e062-3223-4e17-8956-b1888e774240 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 6dc99838-6be6-4bb3-a581-217bbb2b8881] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:56.948515 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c3d6e062-3223-4e17-8956-b1888e774240 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:56.949105 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c3d6e062-3223-4e17-8956-b1888e774240 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:56.949556 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c3d6e062-3223-4e17-8956-b1888e774240 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:56.950335 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c3d6e062-3223-4e17-8956-b1888e774240 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:56.950889 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c3d6e062-3223-4e17-8956-b1888e774240 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:56.951344 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c3d6e062-3223-4e17-8956-b1888e774240 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:57.161695 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c3d6e062-3223-4e17-8956-b1888e774240 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:32:57.170127 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c3d6e062-3223-4e17-8956-b1888e774240 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881" status: 200 len: 1674 microversion: 2.1 time: 0.233170 Oct 17 14:32:57.170721 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3372/6606] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:32:56 2022] GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881 => generated 1674 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:32:58.196083 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-124fa56d-6228-4f48-8a81-38f0e71315b4 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:58.196792 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-124fa56d-6228-4f48-8a81-38f0e71315b4 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 6dc99838-6be6-4bb3-a581-217bbb2b8881] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:58.202993 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-124fa56d-6228-4f48-8a81-38f0e71315b4 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:58.203537 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-124fa56d-6228-4f48-8a81-38f0e71315b4 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:58.203971 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-124fa56d-6228-4f48-8a81-38f0e71315b4 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:58.204728 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-124fa56d-6228-4f48-8a81-38f0e71315b4 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:58.205516 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-124fa56d-6228-4f48-8a81-38f0e71315b4 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:58.206189 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-124fa56d-6228-4f48-8a81-38f0e71315b4 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:58.311553 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-df9cccea-c9d9-46f7-84d3-0a32faa2178d req-4b773546-1894-4010-bd54-6e3714d0e6a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dc99838-6be6-4bb3-a581-217bbb2b8881", "name": "network-vif-plugged", "status": "completed", "tag": "7fe83be9-943f-4fcf-b648-2193ef9e142c"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:32:58.326599 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-df9cccea-c9d9-46f7-84d3-0a32faa2178d req-4b773546-1894-4010-bd54-6e3714d0e6a3 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:58.327589 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-df9cccea-c9d9-46f7-84d3-0a32faa2178d req-4b773546-1894-4010-bd54-6e3714d0e6a3 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:58.328054 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-df9cccea-c9d9-46f7-84d3-0a32faa2178d req-4b773546-1894-4010-bd54-6e3714d0e6a3 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:58.343766 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-df9cccea-c9d9-46f7-84d3-0a32faa2178d req-4b773546-1894-4010-bd54-6e3714d0e6a3 service nova] Creating event network-vif-plugged:7fe83be9-943f-4fcf-b648-2193ef9e142c for instance 6dc99838-6be6-4bb3-a581-217bbb2b8881 on n-h1-854247-14 Oct 17 14:32:58.350472 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-df9cccea-c9d9-46f7-84d3-0a32faa2178d req-4b773546-1894-4010-bd54-6e3714d0e6a3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042510 Oct 17 14:32:58.350472 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3373/6607] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:32:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:32:58.359108 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-124fa56d-6228-4f48-8a81-38f0e71315b4 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:32:58.367747 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-124fa56d-6228-4f48-8a81-38f0e71315b4 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881" status: 200 len: 1666 microversion: 2.1 time: 0.176854 Oct 17 14:32:58.371205 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3235/6608] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:32:58 2022] GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881 => generated 1666 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:32:58.392320 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7664a22e-510d-4a17-a9e4-cb76d4cd09dd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:58.393034 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7664a22e-510d-4a17-a9e4-cb76d4cd09dd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 6dc99838-6be6-4bb3-a581-217bbb2b8881] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:58.399804 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7664a22e-510d-4a17-a9e4-cb76d4cd09dd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:58.400301 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7664a22e-510d-4a17-a9e4-cb76d4cd09dd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:58.400737 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7664a22e-510d-4a17-a9e4-cb76d4cd09dd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:58.401448 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7664a22e-510d-4a17-a9e4-cb76d4cd09dd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:58.401908 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7664a22e-510d-4a17-a9e4-cb76d4cd09dd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:58.402334 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7664a22e-510d-4a17-a9e4-cb76d4cd09dd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:58.544139 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7664a22e-510d-4a17-a9e4-cb76d4cd09dd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:32:58.552616 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7664a22e-510d-4a17-a9e4-cb76d4cd09dd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881" status: 200 len: 1666 microversion: 2.1 time: 0.164743 Oct 17 14:32:58.553207 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3374/6609] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:32:58 2022] GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881 => generated 1666 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:32:58.575134 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-eb0845f5-6081-4ecf-9cc6-5a95a7cd7706 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:58.575911 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-eb0845f5-6081-4ecf-9cc6-5a95a7cd7706 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 6dc99838-6be6-4bb3-a581-217bbb2b8881] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:58.582445 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eb0845f5-6081-4ecf-9cc6-5a95a7cd7706 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:58.582954 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eb0845f5-6081-4ecf-9cc6-5a95a7cd7706 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:58.583430 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eb0845f5-6081-4ecf-9cc6-5a95a7cd7706 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:58.584128 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eb0845f5-6081-4ecf-9cc6-5a95a7cd7706 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:58.584587 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eb0845f5-6081-4ecf-9cc6-5a95a7cd7706 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:58.585015 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eb0845f5-6081-4ecf-9cc6-5a95a7cd7706 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:58.732991 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-eb0845f5-6081-4ecf-9cc6-5a95a7cd7706 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:32:58.745525 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-eb0845f5-6081-4ecf-9cc6-5a95a7cd7706 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881" status: 200 len: 1666 microversion: 2.1 time: 0.174029 Oct 17 14:32:58.746359 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3236/6610] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:32:58 2022] GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881 => generated 1666 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:32:58.769937 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4d4b6484-4b25-4424-bbb2-979828f86e6f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:58.770474 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4d4b6484-4b25-4424-bbb2-979828f86e6f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 6dc99838-6be6-4bb3-a581-217bbb2b8881] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:58.779358 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d4b6484-4b25-4424-bbb2-979828f86e6f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:58.780107 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d4b6484-4b25-4424-bbb2-979828f86e6f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:58.780791 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d4b6484-4b25-4424-bbb2-979828f86e6f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:58.781943 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d4b6484-4b25-4424-bbb2-979828f86e6f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:58.782651 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d4b6484-4b25-4424-bbb2-979828f86e6f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:58.783357 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d4b6484-4b25-4424-bbb2-979828f86e6f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:58.815990 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4d4b6484-4b25-4424-bbb2-979828f86e6f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 6dc99838-6be6-4bb3-a581-217bbb2b8881] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:32:58.874623 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:32:58.908422 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4d4b6484-4b25-4424-bbb2-979828f86e6f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "DELETE /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881" status: 204 len: 0 microversion: 2.1 time: 0.143058 Oct 17 14:32:58.909111 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3375/6611] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:32:58 2022] DELETE /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:32:58.917740 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-96960cb4-8439-48e9-b903-bf9400a9763e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:58.918375 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-96960cb4-8439-48e9-b903-bf9400a9763e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 6dc99838-6be6-4bb3-a581-217bbb2b8881] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:58.924928 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-96960cb4-8439-48e9-b903-bf9400a9763e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:58.925416 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-96960cb4-8439-48e9-b903-bf9400a9763e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:58.925857 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-96960cb4-8439-48e9-b903-bf9400a9763e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:58.926549 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-96960cb4-8439-48e9-b903-bf9400a9763e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:58.927063 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-96960cb4-8439-48e9-b903-bf9400a9763e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:58.927471 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-96960cb4-8439-48e9-b903-bf9400a9763e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:59.080494 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-96960cb4-8439-48e9-b903-bf9400a9763e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:32:59.089079 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-96960cb4-8439-48e9-b903-bf9400a9763e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881" status: 200 len: 1672 microversion: 2.1 time: 0.175529 Oct 17 14:32:59.089910 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3237/6612] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:32:58 2022] GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881 => generated 1672 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:33:00.113533 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b792127b-f8bc-428d-9bdc-dd48850a0879 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:33:00.114266 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b792127b-f8bc-428d-9bdc-dd48850a0879 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 6dc99838-6be6-4bb3-a581-217bbb2b8881] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:33:00.121630 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b792127b-f8bc-428d-9bdc-dd48850a0879 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:00.122107 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b792127b-f8bc-428d-9bdc-dd48850a0879 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:00.122539 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b792127b-f8bc-428d-9bdc-dd48850a0879 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:00.123264 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b792127b-f8bc-428d-9bdc-dd48850a0879 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:00.123709 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b792127b-f8bc-428d-9bdc-dd48850a0879 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:00.124136 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b792127b-f8bc-428d-9bdc-dd48850a0879 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:00.263689 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b792127b-f8bc-428d-9bdc-dd48850a0879 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:33:00.272510 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b792127b-f8bc-428d-9bdc-dd48850a0879 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881" status: 200 len: 1672 microversion: 2.1 time: 0.163465 Oct 17 14:33:00.273080 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3376/6613] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:33:00 2022] GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881 => generated 1672 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:33:01.296249 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-601b0510-1f80-4c55-8dd9-cbf5d46755c3 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:33:01.296887 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-601b0510-1f80-4c55-8dd9-cbf5d46755c3 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 6dc99838-6be6-4bb3-a581-217bbb2b8881] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:33:01.304372 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-601b0510-1f80-4c55-8dd9-cbf5d46755c3 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:01.304874 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-601b0510-1f80-4c55-8dd9-cbf5d46755c3 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:01.305322 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-601b0510-1f80-4c55-8dd9-cbf5d46755c3 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:01.306069 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-601b0510-1f80-4c55-8dd9-cbf5d46755c3 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:01.306534 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-601b0510-1f80-4c55-8dd9-cbf5d46755c3 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:01.306969 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-601b0510-1f80-4c55-8dd9-cbf5d46755c3 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:01.322523 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:33:01.373314 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-601b0510-1f80-4c55-8dd9-cbf5d46755c3 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:33:01.382997 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-601b0510-1f80-4c55-8dd9-cbf5d46755c3 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881" status: 200 len: 1604 microversion: 2.1 time: 0.090704 Oct 17 14:33:01.383832 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3238/6614] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:33:01 2022] GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881 => generated 1604 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:33:01.398317 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-ce37699d-96be-44b5-9429-7050d8e34873 req-76feb161-d40d-45ae-ba52-4377a67148bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dc99838-6be6-4bb3-a581-217bbb2b8881", "name": "network-vif-deleted", "tag": "7fe83be9-943f-4fcf-b648-2193ef9e142c"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:33:01.411119 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-ce37699d-96be-44b5-9429-7050d8e34873 req-76feb161-d40d-45ae-ba52-4377a67148bc service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:01.411639 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-ce37699d-96be-44b5-9429-7050d8e34873 req-76feb161-d40d-45ae-ba52-4377a67148bc service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:01.413079 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-ce37699d-96be-44b5-9429-7050d8e34873 req-76feb161-d40d-45ae-ba52-4377a67148bc service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:01.428132 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-ce37699d-96be-44b5-9429-7050d8e34873 req-76feb161-d40d-45ae-ba52-4377a67148bc service nova] Creating event network-vif-deleted:7fe83be9-943f-4fcf-b648-2193ef9e142c for instance 6dc99838-6be6-4bb3-a581-217bbb2b8881 on n-h1-854247-14 Oct 17 14:33:01.430971 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-ce37699d-96be-44b5-9429-7050d8e34873 req-76feb161-d40d-45ae-ba52-4377a67148bc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036691 Oct 17 14:33:01.431803 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3377/6615] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:33:02.407824 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-be9d8421-0248-4034-9d5e-be740460a755 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:33:02.408463 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-be9d8421-0248-4034-9d5e-be740460a755 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 6dc99838-6be6-4bb3-a581-217bbb2b8881] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:33:02.416319 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-be9d8421-0248-4034-9d5e-be740460a755 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:02.416956 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-be9d8421-0248-4034-9d5e-be740460a755 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:02.417465 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-be9d8421-0248-4034-9d5e-be740460a755 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:02.418432 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-be9d8421-0248-4034-9d5e-be740460a755 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:02.419071 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-be9d8421-0248-4034-9d5e-be740460a755 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:02.419758 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-be9d8421-0248-4034-9d5e-be740460a755 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:02.434582 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-be9d8421-0248-4034-9d5e-be740460a755 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] HTTP exception thrown: Instance 6dc99838-6be6-4bb3-a581-217bbb2b8881 could not be found. Oct 17 14:33:02.436960 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-be9d8421-0248-4034-9d5e-be740460a755 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Request method failure captured: Oct 17 14:33:02.436960 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881 HTTP/1.1 Oct 17 14:33:02.436960 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 14:33:02.436960 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 14:33:02.436960 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 14:33:02.436960 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 14:33:02.436960 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 14:33:02.436960 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 14:33:02.436960 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 14:33:02.436960 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 14:33:02.436960 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTWdVpabWT0Tbgf-QQ83Tq8AQGY8AcL_35cr_ansrTOmg5gYS9o-61drx7tYvn26ecQi5aoad2YeNf-Jm0l5MKteHOkMgnybFs17aOJ7G5iYUyXMaYulLqf3oAKSRqw_FkZniUVR3fFPKjmYjBguT22mJaxMSuqSX_P9X-IGsLXSZ0Uc Oct 17 14:33:02.436960 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 14:33:02.436960 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 14:33:02.436960 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 14:33:02.436960 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 14:33:02.436960 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 14:33:02.436960 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 14:33:02.436960 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 6312d6ad74bb476384426e63c1ec7ae5 Oct 17 14:33:02.436960 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServerActionsTestJSON-207618724 Oct 17 14:33:02.436960 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 14:33:02.436960 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 14:33:02.436960 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6312d6ad74bb476384426e63c1ec7ae5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6312d6ad74bb476384426e63c1ec7ae5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6312d6ad74bb476384426e63c1ec7ae5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6312d6ad74bb476384426e63c1ec7ae5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:33:02.436960 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServerActionsTestJSON-207618724 Oct 17 14:33:02.436960 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 6312d6ad74bb476384426e63c1ec7ae5 Oct 17 14:33:02.436960 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServerActionsTestJSON-207618724 Oct 17 14:33:02.436960 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServerActionsTestJSON-207618724-project Oct 17 14:33:02.436960 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 14:33:02.436960 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 14:33:02.436960 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: ad69a4e71c9e425fac89ec047eda43de Oct 17 14:33:02.436960 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServerActionsTestJSON-207618724-project Oct 17 14:33:02.436960 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 14:33:02.436960 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 6dc99838-6be6-4bb3-a581-217bbb2b8881 could not be found. Oct 17 14:33:02.436960 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '6dc99838-6be6-4bb3-a581-217bbb2b8881'} Oct 17 14:33:02.436960 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:33:02.436960 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:33:02.436960 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:33:02.436960 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:33:02.436960 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:33:02.436960 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:33:02.436960 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:33:02.436960 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:33:02.436960 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:33:02.436960 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:33:02.436960 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dc99838-6be6-4bb3-a581-217bbb2b8881 could not be found. Oct 17 14:33:02.436960 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:33:02.436960 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:33:02.436960 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:33:02.436960 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:33:02.436960 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:33:02.436960 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:33:02.436960 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:33:02.436960 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:33:02.436960 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:33:02.436960 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:33:02.436960 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:33:02.436960 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:33:02.436960 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:33:02.436960 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:33:02.436960 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:33:02.436960 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:33:02.436960 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dc99838-6be6-4bb3-a581-217bbb2b8881 could not be found. Oct 17 14:33:02.436960 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:33:02.436960 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:33:02.436960 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:33:02.441739 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:33:02.441739 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:33:02.441739 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:33:02.441739 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:33:02.441739 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:33:02.441739 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dc99838-6be6-4bb3-a581-217bbb2b8881 could not be found. Oct 17 14:33:02.441739 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:33:02.441739 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-be9d8421-0248-4034-9d5e-be740460a755 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Returning 404 to user: Instance 6dc99838-6be6-4bb3-a581-217bbb2b8881 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:33:02.441739 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-be9d8421-0248-4034-9d5e-be740460a755 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881" status: 404 len: 111 microversion: 2.1 time: 0.035059 Oct 17 14:33:02.441739 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3239/6616] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:33:02 2022] GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:33:02.454720 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6622d482-1939-441c-b6a4-239deff5f973 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:33:02.455471 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6622d482-1939-441c-b6a4-239deff5f973 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 6dc99838-6be6-4bb3-a581-217bbb2b8881] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:33:02.461860 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6622d482-1939-441c-b6a4-239deff5f973 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:02.462338 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6622d482-1939-441c-b6a4-239deff5f973 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:02.462766 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6622d482-1939-441c-b6a4-239deff5f973 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:02.463476 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6622d482-1939-441c-b6a4-239deff5f973 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:02.463921 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6622d482-1939-441c-b6a4-239deff5f973 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:02.464344 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6622d482-1939-441c-b6a4-239deff5f973 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:02.478539 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-6622d482-1939-441c-b6a4-239deff5f973 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] HTTP exception thrown: Instance 6dc99838-6be6-4bb3-a581-217bbb2b8881 could not be found. Oct 17 14:33:02.480245 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6622d482-1939-441c-b6a4-239deff5f973 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Request method failure captured: Oct 17 14:33:02.480245 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881 HTTP/1.1 Oct 17 14:33:02.480245 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 14:33:02.480245 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 14:33:02.480245 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 14:33:02.480245 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 14:33:02.480245 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 14:33:02.480245 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 14:33:02.480245 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 14:33:02.480245 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 14:33:02.480245 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTWdVpabWT0Tbgf-QQ83Tq8AQGY8AcL_35cr_ansrTOmg5gYS9o-61drx7tYvn26ecQi5aoad2YeNf-Jm0l5MKteHOkMgnybFs17aOJ7G5iYUyXMaYulLqf3oAKSRqw_FkZniUVR3fFPKjmYjBguT22mJaxMSuqSX_P9X-IGsLXSZ0Uc Oct 17 14:33:02.480245 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 14:33:02.480245 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 14:33:02.480245 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 14:33:02.480245 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 14:33:02.480245 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 14:33:02.480245 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 14:33:02.480245 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 6312d6ad74bb476384426e63c1ec7ae5 Oct 17 14:33:02.480245 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServerActionsTestJSON-207618724 Oct 17 14:33:02.480245 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 14:33:02.480245 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 14:33:02.480245 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6312d6ad74bb476384426e63c1ec7ae5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6312d6ad74bb476384426e63c1ec7ae5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6312d6ad74bb476384426e63c1ec7ae5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6312d6ad74bb476384426e63c1ec7ae5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:33:02.480245 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServerActionsTestJSON-207618724 Oct 17 14:33:02.480245 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 6312d6ad74bb476384426e63c1ec7ae5 Oct 17 14:33:02.480245 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServerActionsTestJSON-207618724 Oct 17 14:33:02.480245 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServerActionsTestJSON-207618724-project Oct 17 14:33:02.480245 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 14:33:02.480245 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 14:33:02.480245 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: ad69a4e71c9e425fac89ec047eda43de Oct 17 14:33:02.480245 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServerActionsTestJSON-207618724-project Oct 17 14:33:02.480245 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 14:33:02.480245 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 6dc99838-6be6-4bb3-a581-217bbb2b8881 could not be found. Oct 17 14:33:02.480245 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '6dc99838-6be6-4bb3-a581-217bbb2b8881'} Oct 17 14:33:02.480245 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:33:02.480245 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:33:02.480245 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:33:02.480245 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:33:02.480245 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:33:02.480245 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:33:02.480245 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:33:02.480245 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:33:02.480245 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:33:02.480245 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:33:02.480245 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dc99838-6be6-4bb3-a581-217bbb2b8881 could not be found. Oct 17 14:33:02.480245 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:33:02.480245 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:33:02.480245 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:33:02.480245 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:33:02.480245 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:33:02.480245 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:33:02.480245 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:33:02.480245 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:33:02.480245 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:33:02.480245 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:33:02.480245 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:33:02.480245 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:33:02.480245 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:33:02.480245 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:33:02.480245 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:33:02.480245 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:33:02.480245 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dc99838-6be6-4bb3-a581-217bbb2b8881 could not be found. Oct 17 14:33:02.480245 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:33:02.480245 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:33:02.480245 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:33:02.486930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:33:02.486930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:33:02.486930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:33:02.486930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:33:02.486930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:33:02.486930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dc99838-6be6-4bb3-a581-217bbb2b8881 could not be found. Oct 17 14:33:02.486930 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:33:02.486930 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6622d482-1939-441c-b6a4-239deff5f973 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Returning 404 to user: Instance 6dc99838-6be6-4bb3-a581-217bbb2b8881 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:33:02.486930 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6622d482-1939-441c-b6a4-239deff5f973 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881" status: 404 len: 111 microversion: 2.1 time: 0.032362 Oct 17 14:33:02.486930 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3378/6617] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:33:02 2022] GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:33:02.538785 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-cfffa9cc-41ab-47cd-bf20-e769736b3530 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-645650140", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "8df58892-60b4-4970-b9bf-0ee8a509c119"}], "security_groups": [{"name": "tempest-securitygroup--1788546303"}], "key_name": "tempest-keypair-533599217", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:33:02.654526 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-cfffa9cc-41ab-47cd-bf20-e769736b3530 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] validate_networks() for [('8df58892-60b4-4970-b9bf-0ee8a509c119', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:33:03.140122 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-cfffa9cc-41ab-47cd-bf20-e769736b3530 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:33:03.140731 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-cfffa9cc-41ab-47cd-bf20-e769736b3530 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:33:03.141438 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-cfffa9cc-41ab-47cd-bf20-e769736b3530 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:33:03.142168 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-cfffa9cc-41ab-47cd-bf20-e769736b3530 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:33:03.142836 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-cfffa9cc-41ab-47cd-bf20-e769736b3530 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:33:03.159884 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cfffa9cc-41ab-47cd-bf20-e769736b3530 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:03.160390 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cfffa9cc-41ab-47cd-bf20-e769736b3530 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:03.160846 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cfffa9cc-41ab-47cd-bf20-e769736b3530 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:03.161592 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cfffa9cc-41ab-47cd-bf20-e769736b3530 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:03.162061 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cfffa9cc-41ab-47cd-bf20-e769736b3530 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:03.162501 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cfffa9cc-41ab-47cd-bf20-e769736b3530 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:03.182140 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-cfffa9cc-41ab-47cd-bf20-e769736b3530 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Getting quotas for project 6312d6ad74bb476384426e63c1ec7ae5. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:33:03.187413 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-cfffa9cc-41ab-47cd-bf20-e769736b3530 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Getting quotas for user ad69a4e71c9e425fac89ec047eda43de and project 6312d6ad74bb476384426e63c1ec7ae5. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:33:03.200464 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-cfffa9cc-41ab-47cd-bf20-e769736b3530 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:33:03.202838 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-cfffa9cc-41ab-47cd-bf20-e769736b3530 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 4e4cd050-6103-4856-a8b5-c3df9d9bb203] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:33:03.252443 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-cfffa9cc-41ab-47cd-bf20-e769736b3530 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.717597 Oct 17 14:33:03.253213 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3240/6618] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 14:33:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 14:33:03.265491 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cf02022e-1003-42b6-950e-fc20f94a514b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:33:03.266107 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cf02022e-1003-42b6-950e-fc20f94a514b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 4e4cd050-6103-4856-a8b5-c3df9d9bb203] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:33:03.325543 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cf02022e-1003-42b6-950e-fc20f94a514b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:33:03.335732 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cf02022e-1003-42b6-950e-fc20f94a514b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203" status: 200 len: 1237 microversion: 2.1 time: 0.074233 Oct 17 14:33:03.336313 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3379/6619] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:33:03 2022] GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203 => generated 1237 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:33:04.361591 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-554ce17d-8f9f-4ce5-8b7b-2e7bdce4f707 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:33:04.362202 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-554ce17d-8f9f-4ce5-8b7b-2e7bdce4f707 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 4e4cd050-6103-4856-a8b5-c3df9d9bb203] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:33:04.370919 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-554ce17d-8f9f-4ce5-8b7b-2e7bdce4f707 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:04.371579 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-554ce17d-8f9f-4ce5-8b7b-2e7bdce4f707 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:04.372085 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-554ce17d-8f9f-4ce5-8b7b-2e7bdce4f707 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:04.373035 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-554ce17d-8f9f-4ce5-8b7b-2e7bdce4f707 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:04.373570 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-554ce17d-8f9f-4ce5-8b7b-2e7bdce4f707 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:04.374073 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-554ce17d-8f9f-4ce5-8b7b-2e7bdce4f707 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:04.458079 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-554ce17d-8f9f-4ce5-8b7b-2e7bdce4f707 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:33:04.466574 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-554ce17d-8f9f-4ce5-8b7b-2e7bdce4f707 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203" status: 200 len: 1307 microversion: 2.1 time: 0.110916 Oct 17 14:33:04.467189 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3241/6620] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:33:04 2022] GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203 => generated 1307 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:33:05.491631 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2792d5c0-4b46-4529-a161-681299385c14 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:33:05.492286 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2792d5c0-4b46-4529-a161-681299385c14 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 4e4cd050-6103-4856-a8b5-c3df9d9bb203] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:33:05.498952 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2792d5c0-4b46-4529-a161-681299385c14 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:05.499483 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2792d5c0-4b46-4529-a161-681299385c14 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:05.499924 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2792d5c0-4b46-4529-a161-681299385c14 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:05.500634 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2792d5c0-4b46-4529-a161-681299385c14 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:05.501087 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2792d5c0-4b46-4529-a161-681299385c14 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:05.501511 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2792d5c0-4b46-4529-a161-681299385c14 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:05.718587 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2792d5c0-4b46-4529-a161-681299385c14 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:33:05.726884 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2792d5c0-4b46-4529-a161-681299385c14 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203" status: 200 len: 1363 microversion: 2.1 time: 0.239607 Oct 17 14:33:05.727832 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3380/6621] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:33:05 2022] GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203 => generated 1363 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:33:05.952791 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-33909d2f-6c2e-4165-af0b-165d2a5e706c req-c2c85c78-6bd3-407a-82b8-3ec45b74f00c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e4cd050-6103-4856-a8b5-c3df9d9bb203", "tag": "61a59302-7ff1-495b-90b9-71881a60c79c"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:33:05.965411 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-33909d2f-6c2e-4165-af0b-165d2a5e706c req-c2c85c78-6bd3-407a-82b8-3ec45b74f00c service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:05.965902 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-33909d2f-6c2e-4165-af0b-165d2a5e706c req-c2c85c78-6bd3-407a-82b8-3ec45b74f00c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:05.966414 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-33909d2f-6c2e-4165-af0b-165d2a5e706c req-c2c85c78-6bd3-407a-82b8-3ec45b74f00c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:05.982045 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-33909d2f-6c2e-4165-af0b-165d2a5e706c req-c2c85c78-6bd3-407a-82b8-3ec45b74f00c service nova] Creating event network-changed:61a59302-7ff1-495b-90b9-71881a60c79c for instance 4e4cd050-6103-4856-a8b5-c3df9d9bb203 on n-h2-854247-14 Oct 17 14:33:05.987130 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-33909d2f-6c2e-4165-af0b-165d2a5e706c req-c2c85c78-6bd3-407a-82b8-3ec45b74f00c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038114 Oct 17 14:33:05.988415 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3242/6622] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:33:06.751563 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e07b6c4f-fe28-48e6-88dd-a281fc152e9c tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:33:06.752261 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e07b6c4f-fe28-48e6-88dd-a281fc152e9c tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 4e4cd050-6103-4856-a8b5-c3df9d9bb203] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:33:06.760254 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e07b6c4f-fe28-48e6-88dd-a281fc152e9c tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:06.760744 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e07b6c4f-fe28-48e6-88dd-a281fc152e9c tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:06.761183 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e07b6c4f-fe28-48e6-88dd-a281fc152e9c tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:06.761892 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e07b6c4f-fe28-48e6-88dd-a281fc152e9c tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:06.762352 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e07b6c4f-fe28-48e6-88dd-a281fc152e9c tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:06.762781 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e07b6c4f-fe28-48e6-88dd-a281fc152e9c tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:06.895144 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e07b6c4f-fe28-48e6-88dd-a281fc152e9c tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:33:06.907328 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e07b6c4f-fe28-48e6-88dd-a281fc152e9c tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203" status: 200 len: 1363 microversion: 2.1 time: 0.159949 Oct 17 14:33:06.908128 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3381/6623] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:33:06 2022] GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:33:07.933440 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3b4ba6f6-5c04-49b5-8751-05a457169765 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:33:07.934174 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3b4ba6f6-5c04-49b5-8751-05a457169765 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 4e4cd050-6103-4856-a8b5-c3df9d9bb203] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:33:07.936194 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:33:07.941717 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3b4ba6f6-5c04-49b5-8751-05a457169765 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:07.942212 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3b4ba6f6-5c04-49b5-8751-05a457169765 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:07.942657 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3b4ba6f6-5c04-49b5-8751-05a457169765 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:07.943404 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3b4ba6f6-5c04-49b5-8751-05a457169765 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:07.943885 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3b4ba6f6-5c04-49b5-8751-05a457169765 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:07.944338 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3b4ba6f6-5c04-49b5-8751-05a457169765 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:08.105253 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3b4ba6f6-5c04-49b5-8751-05a457169765 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:33:08.113727 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3b4ba6f6-5c04-49b5-8751-05a457169765 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203" status: 200 len: 1363 microversion: 2.1 time: 0.185391 Oct 17 14:33:08.127456 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3243/6624] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:33:07 2022] GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203 => generated 1363 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:33:09.137655 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5204ede0-5d9f-4eb5-9ed0-5b39f16181c8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:33:09.138309 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5204ede0-5d9f-4eb5-9ed0-5b39f16181c8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 4e4cd050-6103-4856-a8b5-c3df9d9bb203] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:33:09.141280 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:33:09.147378 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5204ede0-5d9f-4eb5-9ed0-5b39f16181c8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:09.147864 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5204ede0-5d9f-4eb5-9ed0-5b39f16181c8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:09.148304 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5204ede0-5d9f-4eb5-9ed0-5b39f16181c8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:09.149068 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5204ede0-5d9f-4eb5-9ed0-5b39f16181c8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:09.149519 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5204ede0-5d9f-4eb5-9ed0-5b39f16181c8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:09.149945 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5204ede0-5d9f-4eb5-9ed0-5b39f16181c8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:09.287216 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5204ede0-5d9f-4eb5-9ed0-5b39f16181c8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:33:09.295455 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5204ede0-5d9f-4eb5-9ed0-5b39f16181c8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203" status: 200 len: 1363 microversion: 2.1 time: 0.161912 Oct 17 14:33:09.296036 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3382/6625] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:33:09 2022] GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:33:10.158919 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-c8314b2b-2742-4fa9-b8b0-94498f4eea65 req-10f862c7-37f8-4e12-aaf2-1990afc67a5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e4cd050-6103-4856-a8b5-c3df9d9bb203", "name": "network-vif-plugged", "status": "completed", "tag": "61a59302-7ff1-495b-90b9-71881a60c79c"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:33:10.171448 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-c8314b2b-2742-4fa9-b8b0-94498f4eea65 req-10f862c7-37f8-4e12-aaf2-1990afc67a5a service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:10.172396 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-c8314b2b-2742-4fa9-b8b0-94498f4eea65 req-10f862c7-37f8-4e12-aaf2-1990afc67a5a service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:10.172846 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-c8314b2b-2742-4fa9-b8b0-94498f4eea65 req-10f862c7-37f8-4e12-aaf2-1990afc67a5a service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:10.184847 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-c8314b2b-2742-4fa9-b8b0-94498f4eea65 req-10f862c7-37f8-4e12-aaf2-1990afc67a5a service nova] Creating event network-vif-plugged:61a59302-7ff1-495b-90b9-71881a60c79c for instance 4e4cd050-6103-4856-a8b5-c3df9d9bb203 on n-h2-854247-14 Oct 17 14:33:10.190227 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-c8314b2b-2742-4fa9-b8b0-94498f4eea65 req-10f862c7-37f8-4e12-aaf2-1990afc67a5a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035588 Oct 17 14:33:10.191256 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3244/6626] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:33:10.319338 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3dd2702f-f0a8-4596-8b58-4db6b5978c45 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:33:10.319938 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3dd2702f-f0a8-4596-8b58-4db6b5978c45 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 4e4cd050-6103-4856-a8b5-c3df9d9bb203] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:33:10.327008 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3dd2702f-f0a8-4596-8b58-4db6b5978c45 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:10.327532 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3dd2702f-f0a8-4596-8b58-4db6b5978c45 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:10.327967 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3dd2702f-f0a8-4596-8b58-4db6b5978c45 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:10.328704 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3dd2702f-f0a8-4596-8b58-4db6b5978c45 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:10.329122 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3dd2702f-f0a8-4596-8b58-4db6b5978c45 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:10.329528 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3dd2702f-f0a8-4596-8b58-4db6b5978c45 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:10.464990 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3dd2702f-f0a8-4596-8b58-4db6b5978c45 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:33:10.473049 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3dd2702f-f0a8-4596-8b58-4db6b5978c45 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203" status: 200 len: 1363 microversion: 2.1 time: 0.157682 Oct 17 14:33:10.473702 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3383/6627] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:33:10 2022] GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:33:11.500847 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-daf8da86-0ce5-43ca-aed8-814cd36d169d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:33:11.501545 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-daf8da86-0ce5-43ca-aed8-814cd36d169d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 4e4cd050-6103-4856-a8b5-c3df9d9bb203] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:33:11.511996 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-daf8da86-0ce5-43ca-aed8-814cd36d169d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:11.512641 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-daf8da86-0ce5-43ca-aed8-814cd36d169d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:11.513263 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-daf8da86-0ce5-43ca-aed8-814cd36d169d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:11.514306 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-daf8da86-0ce5-43ca-aed8-814cd36d169d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:11.514833 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-daf8da86-0ce5-43ca-aed8-814cd36d169d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:11.515474 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-daf8da86-0ce5-43ca-aed8-814cd36d169d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:11.658870 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-daf8da86-0ce5-43ca-aed8-814cd36d169d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:33:11.667328 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-daf8da86-0ce5-43ca-aed8-814cd36d169d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203" status: 200 len: 1549 microversion: 2.1 time: 0.173301 Oct 17 14:33:11.667922 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3245/6628] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:33:11 2022] GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203 => generated 1549 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:33:11.693507 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c2ff7605-e46c-4c8a-bb0c-2c845a7b08cc tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:33:11.694329 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c2ff7605-e46c-4c8a-bb0c-2c845a7b08cc tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 4e4cd050-6103-4856-a8b5-c3df9d9bb203] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:33:11.704604 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c2ff7605-e46c-4c8a-bb0c-2c845a7b08cc tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:11.705386 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c2ff7605-e46c-4c8a-bb0c-2c845a7b08cc tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:11.706040 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c2ff7605-e46c-4c8a-bb0c-2c845a7b08cc tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:11.707120 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c2ff7605-e46c-4c8a-bb0c-2c845a7b08cc tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:11.707805 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c2ff7605-e46c-4c8a-bb0c-2c845a7b08cc tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:11.708405 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c2ff7605-e46c-4c8a-bb0c-2c845a7b08cc tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:11.790097 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c2ff7605-e46c-4c8a-bb0c-2c845a7b08cc tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102687 Oct 17 14:33:11.790928 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3384/6629] 10.222.0.79 () {58 vars in 1275 bytes} [Mon Oct 17 14:33:11 2022] GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:33:12.777062 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-e7444aee-098a-475f-8617-5aa8aa3d8e7a req-78965f50-7e52-4703-a6fa-c85ed45527dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e4cd050-6103-4856-a8b5-c3df9d9bb203", "tag": "61a59302-7ff1-495b-90b9-71881a60c79c"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:33:12.787524 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-e7444aee-098a-475f-8617-5aa8aa3d8e7a req-78965f50-7e52-4703-a6fa-c85ed45527dc service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:12.788015 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-e7444aee-098a-475f-8617-5aa8aa3d8e7a req-78965f50-7e52-4703-a6fa-c85ed45527dc service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:12.788457 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-e7444aee-098a-475f-8617-5aa8aa3d8e7a req-78965f50-7e52-4703-a6fa-c85ed45527dc service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:12.799838 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-e7444aee-098a-475f-8617-5aa8aa3d8e7a req-78965f50-7e52-4703-a6fa-c85ed45527dc service nova] Creating event network-changed:61a59302-7ff1-495b-90b9-71881a60c79c for instance 4e4cd050-6103-4856-a8b5-c3df9d9bb203 on n-h2-854247-14 Oct 17 14:33:12.805004 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-e7444aee-098a-475f-8617-5aa8aa3d8e7a req-78965f50-7e52-4703-a6fa-c85ed45527dc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031914 Oct 17 14:33:12.805635 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3246/6630] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:33:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:33:43.140495 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:33:43.141480 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=5 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:33:43.142426 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=38 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:33:43.146373 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-61fdffbd-8186-46c7-ba13-8e88dcb41682 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:33:43.153741 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-61fdffbd-8186-46c7-ba13-8e88dcb41682 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:43.154253 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-61fdffbd-8186-46c7-ba13-8e88dcb41682 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:43.154678 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-61fdffbd-8186-46c7-ba13-8e88dcb41682 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:43.177843 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-61fdffbd-8186-46c7-ba13-8e88dcb41682 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 4e4cd050-6103-4856-a8b5-c3df9d9bb203] Going to try to stop instance {{(pid=127016) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 17 14:33:43.234074 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-61fdffbd-8186-46c7-ba13-8e88dcb41682 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "POST /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203/action" status: 202 len: 0 microversion: 2.1 time: 0.096162 Oct 17 14:33:43.234704 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3385/6631] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:33:43 2022] POST /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:33:43.244487 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-cf2852de-9499-4850-bda8-0198ed6d791b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:33:43.245405 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-cf2852de-9499-4850-bda8-0198ed6d791b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 4e4cd050-6103-4856-a8b5-c3df9d9bb203] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:33:43.248114 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:33:43.248846 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=6 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:33:43.249820 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=7 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:33:43.250605 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=31 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:33:43.262319 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cf2852de-9499-4850-bda8-0198ed6d791b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:43.263149 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cf2852de-9499-4850-bda8-0198ed6d791b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:43.263813 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cf2852de-9499-4850-bda8-0198ed6d791b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:43.264739 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cf2852de-9499-4850-bda8-0198ed6d791b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:43.265324 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cf2852de-9499-4850-bda8-0198ed6d791b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:43.265878 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cf2852de-9499-4850-bda8-0198ed6d791b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:43.404902 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-cf2852de-9499-4850-bda8-0198ed6d791b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:33:43.417685 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-cf2852de-9499-4850-bda8-0198ed6d791b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203" status: 200 len: 1676 microversion: 2.1 time: 0.177178 Oct 17 14:33:43.418601 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3247/6632] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:33:43 2022] GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203 => generated 1676 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:33:44.444328 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-106ded42-66dc-4389-a0ae-8f2700042281 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:33:44.444905 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-106ded42-66dc-4389-a0ae-8f2700042281 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 4e4cd050-6103-4856-a8b5-c3df9d9bb203] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:33:44.454458 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-106ded42-66dc-4389-a0ae-8f2700042281 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:44.454940 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-106ded42-66dc-4389-a0ae-8f2700042281 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:44.455405 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-106ded42-66dc-4389-a0ae-8f2700042281 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:44.456104 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-106ded42-66dc-4389-a0ae-8f2700042281 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:44.456576 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-106ded42-66dc-4389-a0ae-8f2700042281 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:44.456979 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-106ded42-66dc-4389-a0ae-8f2700042281 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:44.603503 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-106ded42-66dc-4389-a0ae-8f2700042281 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:33:44.616287 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-106ded42-66dc-4389-a0ae-8f2700042281 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203" status: 200 len: 1676 microversion: 2.1 time: 0.177077 Oct 17 14:33:44.617271 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3386/6633] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:33:44 2022] GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203 => generated 1676 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:33:45.644156 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c39bf924-d5e7-4535-88aa-80d406589c0e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:33:45.644873 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c39bf924-d5e7-4535-88aa-80d406589c0e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 4e4cd050-6103-4856-a8b5-c3df9d9bb203] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:33:45.656592 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c39bf924-d5e7-4535-88aa-80d406589c0e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:45.657188 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c39bf924-d5e7-4535-88aa-80d406589c0e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:45.657693 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c39bf924-d5e7-4535-88aa-80d406589c0e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:45.658508 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c39bf924-d5e7-4535-88aa-80d406589c0e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:45.659068 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c39bf924-d5e7-4535-88aa-80d406589c0e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:45.659636 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c39bf924-d5e7-4535-88aa-80d406589c0e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:45.800761 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c39bf924-d5e7-4535-88aa-80d406589c0e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:33:45.808851 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c39bf924-d5e7-4535-88aa-80d406589c0e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203" status: 200 len: 1676 microversion: 2.1 time: 0.170732 Oct 17 14:33:45.809428 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3248/6634] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:33:45 2022] GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203 => generated 1676 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:33:46.834192 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c6a6c883-b502-4fc3-a34b-3babd0c9d92f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:33:46.835891 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c6a6c883-b502-4fc3-a34b-3babd0c9d92f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 4e4cd050-6103-4856-a8b5-c3df9d9bb203] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:33:46.846949 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c6a6c883-b502-4fc3-a34b-3babd0c9d92f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:46.847638 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c6a6c883-b502-4fc3-a34b-3babd0c9d92f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:46.848076 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c6a6c883-b502-4fc3-a34b-3babd0c9d92f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:46.848781 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c6a6c883-b502-4fc3-a34b-3babd0c9d92f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:46.849240 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c6a6c883-b502-4fc3-a34b-3babd0c9d92f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:46.849667 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c6a6c883-b502-4fc3-a34b-3babd0c9d92f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:46.992825 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c6a6c883-b502-4fc3-a34b-3babd0c9d92f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:33:47.004400 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c6a6c883-b502-4fc3-a34b-3babd0c9d92f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203" status: 200 len: 1676 microversion: 2.1 time: 0.175282 Oct 17 14:33:47.005144 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3387/6635] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:33:46 2022] GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203 => generated 1676 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:33:48.040409 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c5e5b792-8487-4879-a3fe-0323659d7d34 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:33:48.041156 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c5e5b792-8487-4879-a3fe-0323659d7d34 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 4e4cd050-6103-4856-a8b5-c3df9d9bb203] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:33:48.049122 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c5e5b792-8487-4879-a3fe-0323659d7d34 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:48.049678 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c5e5b792-8487-4879-a3fe-0323659d7d34 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:48.050182 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c5e5b792-8487-4879-a3fe-0323659d7d34 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:48.050997 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c5e5b792-8487-4879-a3fe-0323659d7d34 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:48.051559 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c5e5b792-8487-4879-a3fe-0323659d7d34 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:48.052045 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c5e5b792-8487-4879-a3fe-0323659d7d34 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:48.195639 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c5e5b792-8487-4879-a3fe-0323659d7d34 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:33:48.203791 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c5e5b792-8487-4879-a3fe-0323659d7d34 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203" status: 200 len: 1676 microversion: 2.1 time: 0.167786 Oct 17 14:33:48.204438 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3249/6636] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:33:48 2022] GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203 => generated 1676 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:33:49.237740 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8d675831-606a-45bf-8eb4-3f97c9e205a4 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:33:49.238399 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8d675831-606a-45bf-8eb4-3f97c9e205a4 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 4e4cd050-6103-4856-a8b5-c3df9d9bb203] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:33:49.249799 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8d675831-606a-45bf-8eb4-3f97c9e205a4 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:49.250338 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8d675831-606a-45bf-8eb4-3f97c9e205a4 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:49.250775 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8d675831-606a-45bf-8eb4-3f97c9e205a4 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:49.251526 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8d675831-606a-45bf-8eb4-3f97c9e205a4 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:49.251983 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8d675831-606a-45bf-8eb4-3f97c9e205a4 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:49.252409 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8d675831-606a-45bf-8eb4-3f97c9e205a4 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:49.394099 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8d675831-606a-45bf-8eb4-3f97c9e205a4 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:33:49.405507 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8d675831-606a-45bf-8eb4-3f97c9e205a4 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203" status: 200 len: 1676 microversion: 2.1 time: 0.174211 Oct 17 14:33:49.406274 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3388/6637] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:33:49 2022] GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203 => generated 1676 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:33:50.430882 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c90f9734-cad1-40fe-baaa-a08480f481c2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:33:50.431508 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c90f9734-cad1-40fe-baaa-a08480f481c2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 4e4cd050-6103-4856-a8b5-c3df9d9bb203] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:33:50.438831 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c90f9734-cad1-40fe-baaa-a08480f481c2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:50.439374 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c90f9734-cad1-40fe-baaa-a08480f481c2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:50.439829 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c90f9734-cad1-40fe-baaa-a08480f481c2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:50.440548 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c90f9734-cad1-40fe-baaa-a08480f481c2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:50.441010 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c90f9734-cad1-40fe-baaa-a08480f481c2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:50.441451 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c90f9734-cad1-40fe-baaa-a08480f481c2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:50.598050 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c90f9734-cad1-40fe-baaa-a08480f481c2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:33:50.606877 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c90f9734-cad1-40fe-baaa-a08480f481c2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203" status: 200 len: 1676 microversion: 2.1 time: 0.180471 Oct 17 14:33:50.607510 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3250/6638] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:33:50 2022] GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203 => generated 1676 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:33:51.634318 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6fcb1bbb-aa3f-4def-b3ca-ba914b953162 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:33:51.635302 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6fcb1bbb-aa3f-4def-b3ca-ba914b953162 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 4e4cd050-6103-4856-a8b5-c3df9d9bb203] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:33:51.647333 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6fcb1bbb-aa3f-4def-b3ca-ba914b953162 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:51.647835 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6fcb1bbb-aa3f-4def-b3ca-ba914b953162 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:51.648261 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6fcb1bbb-aa3f-4def-b3ca-ba914b953162 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:51.648951 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6fcb1bbb-aa3f-4def-b3ca-ba914b953162 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:51.649403 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6fcb1bbb-aa3f-4def-b3ca-ba914b953162 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:51.649816 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6fcb1bbb-aa3f-4def-b3ca-ba914b953162 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:51.783672 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6fcb1bbb-aa3f-4def-b3ca-ba914b953162 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:33:51.791606 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6fcb1bbb-aa3f-4def-b3ca-ba914b953162 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203" status: 200 len: 1676 microversion: 2.1 time: 0.163764 Oct 17 14:33:51.792198 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3389/6639] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:33:51 2022] GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203 => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:33:52.815304 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-98015cff-432e-46f2-be02-0617564ebce5 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:33:52.815952 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-98015cff-432e-46f2-be02-0617564ebce5 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 4e4cd050-6103-4856-a8b5-c3df9d9bb203] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:33:52.823511 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-98015cff-432e-46f2-be02-0617564ebce5 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:52.824010 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-98015cff-432e-46f2-be02-0617564ebce5 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:52.824444 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-98015cff-432e-46f2-be02-0617564ebce5 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:52.825168 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-98015cff-432e-46f2-be02-0617564ebce5 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:52.825628 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-98015cff-432e-46f2-be02-0617564ebce5 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:52.826073 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-98015cff-432e-46f2-be02-0617564ebce5 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:52.969227 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-98015cff-432e-46f2-be02-0617564ebce5 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:33:52.979573 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-98015cff-432e-46f2-be02-0617564ebce5 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203" status: 200 len: 1676 microversion: 2.1 time: 0.168281 Oct 17 14:33:52.980156 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3251/6640] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:33:52 2022] GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203 => generated 1676 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:33:54.006442 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-318a5cfc-b249-437b-8dd4-8ff5fe5588b0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:33:54.007383 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-318a5cfc-b249-437b-8dd4-8ff5fe5588b0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 4e4cd050-6103-4856-a8b5-c3df9d9bb203] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:33:54.018843 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-318a5cfc-b249-437b-8dd4-8ff5fe5588b0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:54.019629 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-318a5cfc-b249-437b-8dd4-8ff5fe5588b0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:54.020305 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-318a5cfc-b249-437b-8dd4-8ff5fe5588b0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:54.021376 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-318a5cfc-b249-437b-8dd4-8ff5fe5588b0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:54.022114 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-318a5cfc-b249-437b-8dd4-8ff5fe5588b0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:54.022739 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-318a5cfc-b249-437b-8dd4-8ff5fe5588b0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:54.171047 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-318a5cfc-b249-437b-8dd4-8ff5fe5588b0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:33:54.184191 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-318a5cfc-b249-437b-8dd4-8ff5fe5588b0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203" status: 200 len: 1653 microversion: 2.1 time: 0.183634 Oct 17 14:33:54.185098 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3390/6641] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:33:53 2022] GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203 => generated 1653 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:33:54.207528 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-36b3d4c4-6a72-4aa5-abd5-6e73bcfd1434 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:33:54.209868 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-36b3d4c4-6a72-4aa5-abd5-6e73bcfd1434 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 4e4cd050-6103-4856-a8b5-c3df9d9bb203] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:33:54.217161 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-36b3d4c4-6a72-4aa5-abd5-6e73bcfd1434 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:54.217624 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-36b3d4c4-6a72-4aa5-abd5-6e73bcfd1434 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:54.218066 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-36b3d4c4-6a72-4aa5-abd5-6e73bcfd1434 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:54.218759 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-36b3d4c4-6a72-4aa5-abd5-6e73bcfd1434 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:54.219266 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-36b3d4c4-6a72-4aa5-abd5-6e73bcfd1434 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:54.219693 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-36b3d4c4-6a72-4aa5-abd5-6e73bcfd1434 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:54.248621 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-36b3d4c4-6a72-4aa5-abd5-6e73bcfd1434 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:33:54.254539 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-36b3d4c4-6a72-4aa5-abd5-6e73bcfd1434 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 4e4cd050-6103-4856-a8b5-c3df9d9bb203] Old instance type m1.heat2, new instance type m1.heat {{(pid=127017) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 17 14:33:54.261569 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-36b3d4c4-6a72-4aa5-abd5-6e73bcfd1434 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:33:54.261993 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-36b3d4c4-6a72-4aa5-abd5-6e73bcfd1434 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:33:54.262474 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-36b3d4c4-6a72-4aa5-abd5-6e73bcfd1434 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:33:54.262887 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-36b3d4c4-6a72-4aa5-abd5-6e73bcfd1434 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:33:54.263341 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-36b3d4c4-6a72-4aa5-abd5-6e73bcfd1434 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:33:54.335494 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-36b3d4c4-6a72-4aa5-abd5-6e73bcfd1434 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "POST /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203/action" status: 202 len: 0 microversion: 2.1 time: 0.132008 Oct 17 14:33:54.336133 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3252/6642] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:33:54 2022] POST /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:33:54.344875 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-617fbdd2-7d6c-4316-b881-518073b8a2f8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:33:54.345416 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-617fbdd2-7d6c-4316-b881-518073b8a2f8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 4e4cd050-6103-4856-a8b5-c3df9d9bb203] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:33:54.352627 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-617fbdd2-7d6c-4316-b881-518073b8a2f8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:54.352627 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-617fbdd2-7d6c-4316-b881-518073b8a2f8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:54.352990 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-617fbdd2-7d6c-4316-b881-518073b8a2f8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:54.353710 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-617fbdd2-7d6c-4316-b881-518073b8a2f8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:54.354174 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-617fbdd2-7d6c-4316-b881-518073b8a2f8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:54.354606 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-617fbdd2-7d6c-4316-b881-518073b8a2f8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:54.492763 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-617fbdd2-7d6c-4316-b881-518073b8a2f8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:33:54.501172 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-617fbdd2-7d6c-4316-b881-518073b8a2f8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203" status: 200 len: 1676 microversion: 2.1 time: 0.160421 Oct 17 14:33:54.501735 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3391/6643] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:33:54 2022] GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203 => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:33:55.528213 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-fbfc70a8-5794-4fc1-9bae-520efff0799b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:33:55.528801 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-fbfc70a8-5794-4fc1-9bae-520efff0799b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 4e4cd050-6103-4856-a8b5-c3df9d9bb203] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:33:55.536368 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fbfc70a8-5794-4fc1-9bae-520efff0799b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:55.536868 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fbfc70a8-5794-4fc1-9bae-520efff0799b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:55.537326 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fbfc70a8-5794-4fc1-9bae-520efff0799b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:55.538050 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fbfc70a8-5794-4fc1-9bae-520efff0799b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:55.538514 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fbfc70a8-5794-4fc1-9bae-520efff0799b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:55.538955 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fbfc70a8-5794-4fc1-9bae-520efff0799b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:55.758824 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-fbfc70a8-5794-4fc1-9bae-520efff0799b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:33:55.767993 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-fbfc70a8-5794-4fc1-9bae-520efff0799b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203" status: 200 len: 1676 microversion: 2.1 time: 0.245477 Oct 17 14:33:55.768569 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3253/6644] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:33:55 2022] GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203 => generated 1676 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:33:56.796528 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-30474017-e433-4cfb-9e4b-a3f7ecc5da47 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:33:56.797464 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-30474017-e433-4cfb-9e4b-a3f7ecc5da47 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 4e4cd050-6103-4856-a8b5-c3df9d9bb203] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:33:56.808368 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-30474017-e433-4cfb-9e4b-a3f7ecc5da47 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:56.808861 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-30474017-e433-4cfb-9e4b-a3f7ecc5da47 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:56.809300 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-30474017-e433-4cfb-9e4b-a3f7ecc5da47 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:56.810004 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-30474017-e433-4cfb-9e4b-a3f7ecc5da47 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:56.810462 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-30474017-e433-4cfb-9e4b-a3f7ecc5da47 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:56.810891 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-30474017-e433-4cfb-9e4b-a3f7ecc5da47 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:56.947702 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-30474017-e433-4cfb-9e4b-a3f7ecc5da47 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:33:56.956007 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-30474017-e433-4cfb-9e4b-a3f7ecc5da47 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203" status: 200 len: 1681 microversion: 2.1 time: 0.166233 Oct 17 14:33:56.956580 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3392/6645] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:33:56 2022] GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203 => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:33:57.982838 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-02a138e6-d9cd-4990-a88b-9dd8e1c42b23 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:33:57.984422 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-02a138e6-d9cd-4990-a88b-9dd8e1c42b23 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 4e4cd050-6103-4856-a8b5-c3df9d9bb203] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:33:57.992017 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-02a138e6-d9cd-4990-a88b-9dd8e1c42b23 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:57.992521 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-02a138e6-d9cd-4990-a88b-9dd8e1c42b23 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:57.992974 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-02a138e6-d9cd-4990-a88b-9dd8e1c42b23 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:57.993725 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-02a138e6-d9cd-4990-a88b-9dd8e1c42b23 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:57.994192 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-02a138e6-d9cd-4990-a88b-9dd8e1c42b23 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:57.994611 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-02a138e6-d9cd-4990-a88b-9dd8e1c42b23 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:58.133848 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-02a138e6-d9cd-4990-a88b-9dd8e1c42b23 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:33:58.142702 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-02a138e6-d9cd-4990-a88b-9dd8e1c42b23 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203" status: 200 len: 1681 microversion: 2.1 time: 0.164874 Oct 17 14:33:58.143314 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3254/6646] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:33:57 2022] GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203 => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:33:58.592447 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-f628de46-d8f4-47ae-bcdb-f9e65c505fd6 req-720105e6-0225-4c80-a22c-72d903d27912 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e4cd050-6103-4856-a8b5-c3df9d9bb203", "name": "network-vif-unplugged", "status": "completed", "tag": "61a59302-7ff1-495b-90b9-71881a60c79c"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:33:58.603011 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-f628de46-d8f4-47ae-bcdb-f9e65c505fd6 req-720105e6-0225-4c80-a22c-72d903d27912 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:58.603552 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-f628de46-d8f4-47ae-bcdb-f9e65c505fd6 req-720105e6-0225-4c80-a22c-72d903d27912 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:58.604133 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-f628de46-d8f4-47ae-bcdb-f9e65c505fd6 req-720105e6-0225-4c80-a22c-72d903d27912 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:58.616848 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-f628de46-d8f4-47ae-bcdb-f9e65c505fd6 req-720105e6-0225-4c80-a22c-72d903d27912 service nova] Creating event network-vif-unplugged:61a59302-7ff1-495b-90b9-71881a60c79c for instance 4e4cd050-6103-4856-a8b5-c3df9d9bb203 on n-h1-854247-14 Oct 17 14:33:58.622912 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [req-f628de46-d8f4-47ae-bcdb-f9e65c505fd6 req-720105e6-0225-4c80-a22c-72d903d27912 service nova] Instance 4e4cd050-6103-4856-a8b5-c3df9d9bb203 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854247-14', 'n-h1-854247-14'} {{(pid=127016) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 14:33:58.634392 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-f628de46-d8f4-47ae-bcdb-f9e65c505fd6 req-720105e6-0225-4c80-a22c-72d903d27912 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046080 Oct 17 14:33:58.635223 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3393/6647] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:33:59.166202 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-384faf98-93c0-45cb-bbdf-f99ad64c3218 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:33:59.166928 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-384faf98-93c0-45cb-bbdf-f99ad64c3218 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 4e4cd050-6103-4856-a8b5-c3df9d9bb203] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:33:59.174149 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-384faf98-93c0-45cb-bbdf-f99ad64c3218 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:59.174718 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-384faf98-93c0-45cb-bbdf-f99ad64c3218 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:59.175290 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-384faf98-93c0-45cb-bbdf-f99ad64c3218 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:59.176066 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-384faf98-93c0-45cb-bbdf-f99ad64c3218 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:59.176591 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-384faf98-93c0-45cb-bbdf-f99ad64c3218 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:59.177088 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-384faf98-93c0-45cb-bbdf-f99ad64c3218 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:59.312742 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-384faf98-93c0-45cb-bbdf-f99ad64c3218 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:33:59.320814 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-384faf98-93c0-45cb-bbdf-f99ad64c3218 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203" status: 200 len: 1680 microversion: 2.1 time: 0.158620 Oct 17 14:33:59.321430 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3255/6648] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:33:59 2022] GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:34:00.351632 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9f06d237-ac13-4640-b9c8-343e2ea26e91 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:34:00.352708 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9f06d237-ac13-4640-b9c8-343e2ea26e91 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 4e4cd050-6103-4856-a8b5-c3df9d9bb203] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:34:00.360163 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9f06d237-ac13-4640-b9c8-343e2ea26e91 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:00.360646 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9f06d237-ac13-4640-b9c8-343e2ea26e91 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:00.361084 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9f06d237-ac13-4640-b9c8-343e2ea26e91 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:00.361781 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9f06d237-ac13-4640-b9c8-343e2ea26e91 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:00.362234 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9f06d237-ac13-4640-b9c8-343e2ea26e91 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:00.362663 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9f06d237-ac13-4640-b9c8-343e2ea26e91 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:00.508414 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9f06d237-ac13-4640-b9c8-343e2ea26e91 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:34:00.520877 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9f06d237-ac13-4640-b9c8-343e2ea26e91 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203" status: 200 len: 1678 microversion: 2.1 time: 0.177931 Oct 17 14:34:00.521727 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3394/6649] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:34:00 2022] GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203 => generated 1678 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:34:00.681032 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-c44bbbb1-2b8a-42ac-841d-44a7ce5b69d2 req-e3e2a2fe-2f95-4863-80bd-91edbc32afe2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e4cd050-6103-4856-a8b5-c3df9d9bb203", "tag": "61a59302-7ff1-495b-90b9-71881a60c79c"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:34:00.694459 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-c44bbbb1-2b8a-42ac-841d-44a7ce5b69d2 req-e3e2a2fe-2f95-4863-80bd-91edbc32afe2 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:00.694943 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-c44bbbb1-2b8a-42ac-841d-44a7ce5b69d2 req-e3e2a2fe-2f95-4863-80bd-91edbc32afe2 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:00.695422 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-c44bbbb1-2b8a-42ac-841d-44a7ce5b69d2 req-e3e2a2fe-2f95-4863-80bd-91edbc32afe2 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:00.708808 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-c44bbbb1-2b8a-42ac-841d-44a7ce5b69d2 req-e3e2a2fe-2f95-4863-80bd-91edbc32afe2 service nova] Creating event network-changed:61a59302-7ff1-495b-90b9-71881a60c79c for instance 4e4cd050-6103-4856-a8b5-c3df9d9bb203 on n-h1-854247-14 Oct 17 14:34:00.714975 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [req-c44bbbb1-2b8a-42ac-841d-44a7ce5b69d2 req-e3e2a2fe-2f95-4863-80bd-91edbc32afe2 service nova] Instance 4e4cd050-6103-4856-a8b5-c3df9d9bb203 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854247-14', 'n-h1-854247-14'} {{(pid=127017) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 14:34:00.726049 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-c44bbbb1-2b8a-42ac-841d-44a7ce5b69d2 req-e3e2a2fe-2f95-4863-80bd-91edbc32afe2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051356 Oct 17 14:34:00.726656 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3256/6650] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:34:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:34:01.549951 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b602352e-3696-4548-a13f-c3817e030d64 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:34:01.550479 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b602352e-3696-4548-a13f-c3817e030d64 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 4e4cd050-6103-4856-a8b5-c3df9d9bb203] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:34:01.560414 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b602352e-3696-4548-a13f-c3817e030d64 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:01.560934 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b602352e-3696-4548-a13f-c3817e030d64 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:01.561392 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b602352e-3696-4548-a13f-c3817e030d64 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:01.562097 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b602352e-3696-4548-a13f-c3817e030d64 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:01.562537 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b602352e-3696-4548-a13f-c3817e030d64 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:01.562984 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b602352e-3696-4548-a13f-c3817e030d64 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:01.703786 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b602352e-3696-4548-a13f-c3817e030d64 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:34:01.716379 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b602352e-3696-4548-a13f-c3817e030d64 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203" status: 200 len: 1674 microversion: 2.1 time: 0.170204 Oct 17 14:34:01.717279 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3395/6651] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:34:01 2022] GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203 => generated 1674 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:34:01.745253 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-05e7a962-2fd0-484d-abce-8f12a5732d60 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:34:01.745899 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-05e7a962-2fd0-484d-abce-8f12a5732d60 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 4e4cd050-6103-4856-a8b5-c3df9d9bb203] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:34:01.752652 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-05e7a962-2fd0-484d-abce-8f12a5732d60 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:01.753123 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-05e7a962-2fd0-484d-abce-8f12a5732d60 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:01.753573 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-05e7a962-2fd0-484d-abce-8f12a5732d60 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:01.754282 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-05e7a962-2fd0-484d-abce-8f12a5732d60 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:01.754751 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-05e7a962-2fd0-484d-abce-8f12a5732d60 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:01.755209 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-05e7a962-2fd0-484d-abce-8f12a5732d60 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:01.820866 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-05e7a962-2fd0-484d-abce-8f12a5732d60 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "POST /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203/action" status: 204 len: 0 microversion: 2.1 time: 0.080538 Oct 17 14:34:01.821474 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3257/6652] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:34:01 2022] POST /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203/action => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 14:34:01.829966 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c92761f1-e313-43db-8778-747fd23fb258 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:34:01.830567 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c92761f1-e313-43db-8778-747fd23fb258 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 4e4cd050-6103-4856-a8b5-c3df9d9bb203] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:34:01.836760 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c92761f1-e313-43db-8778-747fd23fb258 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:01.837234 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c92761f1-e313-43db-8778-747fd23fb258 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:01.837665 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c92761f1-e313-43db-8778-747fd23fb258 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:01.838523 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c92761f1-e313-43db-8778-747fd23fb258 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:01.839052 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c92761f1-e313-43db-8778-747fd23fb258 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:01.839531 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c92761f1-e313-43db-8778-747fd23fb258 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:02.048043 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c92761f1-e313-43db-8778-747fd23fb258 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:34:02.059365 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c92761f1-e313-43db-8778-747fd23fb258 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203" status: 200 len: 1674 microversion: 2.1 time: 0.233217 Oct 17 14:34:02.059904 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3396/6653] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:34:01 2022] GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203 => generated 1674 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:34:03.083588 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-82279684-69b0-4c0e-a276-18471a94431e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:34:03.084358 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-82279684-69b0-4c0e-a276-18471a94431e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 4e4cd050-6103-4856-a8b5-c3df9d9bb203] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:34:03.091461 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82279684-69b0-4c0e-a276-18471a94431e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:03.092224 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82279684-69b0-4c0e-a276-18471a94431e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:03.092640 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82279684-69b0-4c0e-a276-18471a94431e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:03.093699 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82279684-69b0-4c0e-a276-18471a94431e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:03.094467 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82279684-69b0-4c0e-a276-18471a94431e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:03.095273 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-82279684-69b0-4c0e-a276-18471a94431e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:03.235637 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-82279684-69b0-4c0e-a276-18471a94431e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:34:03.244036 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-82279684-69b0-4c0e-a276-18471a94431e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203" status: 200 len: 1653 microversion: 2.1 time: 0.165714 Oct 17 14:34:03.244623 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3258/6654] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:34:03 2022] GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203 => generated 1653 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:34:03.266798 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1f21b439-2b65-412d-bf18-bfe6d23add0b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:34:03.267490 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-1f21b439-2b65-412d-bf18-bfe6d23add0b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 4e4cd050-6103-4856-a8b5-c3df9d9bb203] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:34:03.274552 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1f21b439-2b65-412d-bf18-bfe6d23add0b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:03.275043 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1f21b439-2b65-412d-bf18-bfe6d23add0b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:03.275560 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1f21b439-2b65-412d-bf18-bfe6d23add0b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:03.276263 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1f21b439-2b65-412d-bf18-bfe6d23add0b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:03.276742 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1f21b439-2b65-412d-bf18-bfe6d23add0b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:03.277198 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1f21b439-2b65-412d-bf18-bfe6d23add0b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:03.411672 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-1f21b439-2b65-412d-bf18-bfe6d23add0b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:34:03.419870 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1f21b439-2b65-412d-bf18-bfe6d23add0b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203" status: 200 len: 1653 microversion: 2.1 time: 0.157354 Oct 17 14:34:03.420452 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3397/6655] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:34:03 2022] GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203 => generated 1653 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:34:03.442944 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9087cbac-61ef-47d9-85a1-940465a15f0f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:34:03.449375 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9087cbac-61ef-47d9-85a1-940465a15f0f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:03.449868 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9087cbac-61ef-47d9-85a1-940465a15f0f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:03.450311 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9087cbac-61ef-47d9-85a1-940465a15f0f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:03.473785 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9087cbac-61ef-47d9-85a1-940465a15f0f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 4e4cd050-6103-4856-a8b5-c3df9d9bb203] Going to try to start instance {{(pid=127017) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 17 14:34:03.522906 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9087cbac-61ef-47d9-85a1-940465a15f0f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "POST /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203/action" status: 202 len: 0 microversion: 2.1 time: 0.083904 Oct 17 14:34:03.523933 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3259/6656] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:34:03 2022] POST /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:34:03.532430 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c8a81206-38f8-49bd-8893-a33848ef81df tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:34:03.533072 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c8a81206-38f8-49bd-8893-a33848ef81df tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 4e4cd050-6103-4856-a8b5-c3df9d9bb203] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:34:03.539577 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c8a81206-38f8-49bd-8893-a33848ef81df tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:03.540110 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c8a81206-38f8-49bd-8893-a33848ef81df tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:03.540653 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c8a81206-38f8-49bd-8893-a33848ef81df tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:03.541385 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c8a81206-38f8-49bd-8893-a33848ef81df tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:03.541842 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c8a81206-38f8-49bd-8893-a33848ef81df tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:03.542269 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c8a81206-38f8-49bd-8893-a33848ef81df tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:03.683243 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c8a81206-38f8-49bd-8893-a33848ef81df tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:34:03.691354 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c8a81206-38f8-49bd-8893-a33848ef81df tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203" status: 200 len: 1662 microversion: 2.1 time: 0.162847 Oct 17 14:34:03.691937 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3398/6657] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:34:03 2022] GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203 => generated 1662 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:34:04.710841 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-9affa9c9-5333-409c-be9d-59ec959aa097 req-1f3d6524-8937-4d67-8024-44f955dc4c7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e4cd050-6103-4856-a8b5-c3df9d9bb203", "name": "network-vif-plugged", "status": "completed", "tag": "61a59302-7ff1-495b-90b9-71881a60c79c"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:34:04.717990 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7e84e1d9-fffb-48b7-9d4c-f292483105d8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:34:04.718604 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7e84e1d9-fffb-48b7-9d4c-f292483105d8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 4e4cd050-6103-4856-a8b5-c3df9d9bb203] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:34:04.723305 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-9affa9c9-5333-409c-be9d-59ec959aa097 req-1f3d6524-8937-4d67-8024-44f955dc4c7c service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:04.724200 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-9affa9c9-5333-409c-be9d-59ec959aa097 req-1f3d6524-8937-4d67-8024-44f955dc4c7c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:04.724872 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-9affa9c9-5333-409c-be9d-59ec959aa097 req-1f3d6524-8937-4d67-8024-44f955dc4c7c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:04.726135 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7e84e1d9-fffb-48b7-9d4c-f292483105d8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:04.726623 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7e84e1d9-fffb-48b7-9d4c-f292483105d8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:04.727056 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7e84e1d9-fffb-48b7-9d4c-f292483105d8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:04.727785 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7e84e1d9-fffb-48b7-9d4c-f292483105d8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:04.728272 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7e84e1d9-fffb-48b7-9d4c-f292483105d8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:04.728788 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7e84e1d9-fffb-48b7-9d4c-f292483105d8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:04.739634 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-9affa9c9-5333-409c-be9d-59ec959aa097 req-1f3d6524-8937-4d67-8024-44f955dc4c7c service nova] Creating event network-vif-plugged:61a59302-7ff1-495b-90b9-71881a60c79c for instance 4e4cd050-6103-4856-a8b5-c3df9d9bb203 on n-h1-854247-14 Oct 17 14:34:04.745452 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-9affa9c9-5333-409c-be9d-59ec959aa097 req-1f3d6524-8937-4d67-8024-44f955dc4c7c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038761 Oct 17 14:34:04.746302 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3260/6658] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:34:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:34:04.873544 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7e84e1d9-fffb-48b7-9d4c-f292483105d8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:34:04.885216 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7e84e1d9-fffb-48b7-9d4c-f292483105d8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203" status: 200 len: 1666 microversion: 2.1 time: 0.172071 Oct 17 14:34:04.885784 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3399/6659] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:34:04 2022] GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203 => generated 1666 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:34:04.909102 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-eadb4ffa-943d-49f7-98d7-12913725248a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:34:04.909705 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-eadb4ffa-943d-49f7-98d7-12913725248a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 4e4cd050-6103-4856-a8b5-c3df9d9bb203] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:34:04.916182 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eadb4ffa-943d-49f7-98d7-12913725248a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:04.916683 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eadb4ffa-943d-49f7-98d7-12913725248a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:04.917129 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eadb4ffa-943d-49f7-98d7-12913725248a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:04.917844 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eadb4ffa-943d-49f7-98d7-12913725248a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:04.918309 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eadb4ffa-943d-49f7-98d7-12913725248a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:04.918746 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-eadb4ffa-943d-49f7-98d7-12913725248a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:04.921416 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:34:04.946974 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-eadb4ffa-943d-49f7-98d7-12913725248a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 4e4cd050-6103-4856-a8b5-c3df9d9bb203] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:34:05.033531 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-eadb4ffa-943d-49f7-98d7-12913725248a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "DELETE /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203" status: 204 len: 0 microversion: 2.1 time: 0.128621 Oct 17 14:34:05.034174 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3261/6660] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:34:04 2022] DELETE /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:34:05.043323 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-287b2438-2d03-4108-89ea-7b088945de6b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:34:05.043980 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-287b2438-2d03-4108-89ea-7b088945de6b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 4e4cd050-6103-4856-a8b5-c3df9d9bb203] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:34:05.050563 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-287b2438-2d03-4108-89ea-7b088945de6b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:05.051058 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-287b2438-2d03-4108-89ea-7b088945de6b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:05.051563 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-287b2438-2d03-4108-89ea-7b088945de6b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:05.052265 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-287b2438-2d03-4108-89ea-7b088945de6b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:05.052712 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-287b2438-2d03-4108-89ea-7b088945de6b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:05.053133 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-287b2438-2d03-4108-89ea-7b088945de6b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:05.204058 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-287b2438-2d03-4108-89ea-7b088945de6b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:34:05.209300 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:34:05.215385 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-287b2438-2d03-4108-89ea-7b088945de6b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203" status: 200 len: 1672 microversion: 2.1 time: 0.176661 Oct 17 14:34:05.215964 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3400/6661] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:34:05 2022] GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203 => generated 1672 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:34:06.241685 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1b328d84-6809-43c8-8d1c-c5595cc9fcf7 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:34:06.242545 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1b328d84-6809-43c8-8d1c-c5595cc9fcf7 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 4e4cd050-6103-4856-a8b5-c3df9d9bb203] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:34:06.250791 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1b328d84-6809-43c8-8d1c-c5595cc9fcf7 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:06.251610 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1b328d84-6809-43c8-8d1c-c5595cc9fcf7 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:06.252054 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1b328d84-6809-43c8-8d1c-c5595cc9fcf7 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:06.252776 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1b328d84-6809-43c8-8d1c-c5595cc9fcf7 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:06.253248 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1b328d84-6809-43c8-8d1c-c5595cc9fcf7 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:06.253690 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1b328d84-6809-43c8-8d1c-c5595cc9fcf7 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:06.410308 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1b328d84-6809-43c8-8d1c-c5595cc9fcf7 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:34:06.419520 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1b328d84-6809-43c8-8d1c-c5595cc9fcf7 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203" status: 200 len: 1672 microversion: 2.1 time: 0.181964 Oct 17 14:34:06.420451 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3262/6662] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:34:06 2022] GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203 => generated 1672 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:34:07.243230 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-a7bd4c3b-6548-4eda-ae1e-9a73b6276c86 req-99cde7c1-5924-4bcf-9c0b-6e8c59c35a4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e4cd050-6103-4856-a8b5-c3df9d9bb203", "name": "network-vif-deleted", "tag": "61a59302-7ff1-495b-90b9-71881a60c79c"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:34:07.257302 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-a7bd4c3b-6548-4eda-ae1e-9a73b6276c86 req-99cde7c1-5924-4bcf-9c0b-6e8c59c35a4e service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:07.258177 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-a7bd4c3b-6548-4eda-ae1e-9a73b6276c86 req-99cde7c1-5924-4bcf-9c0b-6e8c59c35a4e service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:07.258618 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-a7bd4c3b-6548-4eda-ae1e-9a73b6276c86 req-99cde7c1-5924-4bcf-9c0b-6e8c59c35a4e service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:07.274210 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-a7bd4c3b-6548-4eda-ae1e-9a73b6276c86 req-99cde7c1-5924-4bcf-9c0b-6e8c59c35a4e service nova] Creating event network-vif-deleted:61a59302-7ff1-495b-90b9-71881a60c79c for instance 4e4cd050-6103-4856-a8b5-c3df9d9bb203 on n-h1-854247-14 Oct 17 14:34:07.280695 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-a7bd4c3b-6548-4eda-ae1e-9a73b6276c86 req-99cde7c1-5924-4bcf-9c0b-6e8c59c35a4e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041518 Oct 17 14:34:07.281500 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3401/6663] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:34:07.445156 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-cbc8fa5b-1ddb-4d6d-9435-e0443992f011 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:34:07.445877 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-cbc8fa5b-1ddb-4d6d-9435-e0443992f011 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 4e4cd050-6103-4856-a8b5-c3df9d9bb203] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:34:07.454619 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cbc8fa5b-1ddb-4d6d-9435-e0443992f011 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:07.455124 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cbc8fa5b-1ddb-4d6d-9435-e0443992f011 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:07.455599 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cbc8fa5b-1ddb-4d6d-9435-e0443992f011 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:07.456317 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cbc8fa5b-1ddb-4d6d-9435-e0443992f011 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:07.456947 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cbc8fa5b-1ddb-4d6d-9435-e0443992f011 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:07.457635 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cbc8fa5b-1ddb-4d6d-9435-e0443992f011 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:07.474896 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-cbc8fa5b-1ddb-4d6d-9435-e0443992f011 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] HTTP exception thrown: Instance 4e4cd050-6103-4856-a8b5-c3df9d9bb203 could not be found. Oct 17 14:34:07.477813 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-cbc8fa5b-1ddb-4d6d-9435-e0443992f011 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Request method failure captured: Oct 17 14:34:07.477813 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203 HTTP/1.1 Oct 17 14:34:07.477813 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 14:34:07.477813 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 14:34:07.477813 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 14:34:07.477813 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 14:34:07.477813 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 14:34:07.477813 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 14:34:07.477813 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 14:34:07.477813 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 14:34:07.477813 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTWdVpabWT0Tbgf-QQ83Tq8AQGY8AcL_35cr_ansrTOmg5gYS9o-61drx7tYvn26ecQi5aoad2YeNf-Jm0l5MKteHOkMgnybFs17aOJ7G5iYUyXMaYulLqf3oAKSRqw_FkZniUVR3fFPKjmYjBguT22mJaxMSuqSX_P9X-IGsLXSZ0Uc Oct 17 14:34:07.477813 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 14:34:07.477813 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 14:34:07.477813 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 14:34:07.477813 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 14:34:07.477813 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 14:34:07.477813 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 14:34:07.477813 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 6312d6ad74bb476384426e63c1ec7ae5 Oct 17 14:34:07.477813 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServerActionsTestJSON-207618724 Oct 17 14:34:07.477813 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 14:34:07.477813 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 14:34:07.477813 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6312d6ad74bb476384426e63c1ec7ae5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6312d6ad74bb476384426e63c1ec7ae5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6312d6ad74bb476384426e63c1ec7ae5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6312d6ad74bb476384426e63c1ec7ae5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:34:07.477813 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServerActionsTestJSON-207618724 Oct 17 14:34:07.477813 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 6312d6ad74bb476384426e63c1ec7ae5 Oct 17 14:34:07.477813 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServerActionsTestJSON-207618724 Oct 17 14:34:07.477813 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServerActionsTestJSON-207618724-project Oct 17 14:34:07.477813 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 14:34:07.477813 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 14:34:07.477813 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: ad69a4e71c9e425fac89ec047eda43de Oct 17 14:34:07.477813 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServerActionsTestJSON-207618724-project Oct 17 14:34:07.477813 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 14:34:07.477813 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 4e4cd050-6103-4856-a8b5-c3df9d9bb203 could not be found. Oct 17 14:34:07.477813 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '4e4cd050-6103-4856-a8b5-c3df9d9bb203'} Oct 17 14:34:07.477813 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:34:07.477813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:34:07.477813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:34:07.477813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:34:07.477813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:34:07.477813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:34:07.477813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:34:07.477813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:34:07.477813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:34:07.477813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:34:07.477813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e4cd050-6103-4856-a8b5-c3df9d9bb203 could not be found. Oct 17 14:34:07.477813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:34:07.477813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:34:07.477813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:34:07.477813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:34:07.477813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:34:07.477813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:34:07.477813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:34:07.477813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:34:07.477813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:34:07.477813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:34:07.477813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:34:07.477813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:34:07.477813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:34:07.477813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:34:07.477813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:34:07.477813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:34:07.477813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e4cd050-6103-4856-a8b5-c3df9d9bb203 could not be found. Oct 17 14:34:07.477813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:34:07.477813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:34:07.477813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:34:07.482774 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:34:07.482774 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:34:07.482774 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:34:07.482774 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:34:07.482774 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:34:07.482774 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e4cd050-6103-4856-a8b5-c3df9d9bb203 could not be found. Oct 17 14:34:07.482774 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:34:07.484431 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-cbc8fa5b-1ddb-4d6d-9435-e0443992f011 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Returning 404 to user: Instance 4e4cd050-6103-4856-a8b5-c3df9d9bb203 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:34:07.485316 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-cbc8fa5b-1ddb-4d6d-9435-e0443992f011 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203" status: 404 len: 111 microversion: 2.1 time: 0.045296 Oct 17 14:34:07.485892 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3263/6664] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:34:07 2022] GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:34:07.503427 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a3115200-149f-483a-b0e7-a99284fbd968 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:34:07.504129 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a3115200-149f-483a-b0e7-a99284fbd968 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 4e4cd050-6103-4856-a8b5-c3df9d9bb203] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:34:07.510345 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a3115200-149f-483a-b0e7-a99284fbd968 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:07.510899 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a3115200-149f-483a-b0e7-a99284fbd968 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:07.511353 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a3115200-149f-483a-b0e7-a99284fbd968 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:07.512034 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a3115200-149f-483a-b0e7-a99284fbd968 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:07.512478 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a3115200-149f-483a-b0e7-a99284fbd968 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:07.512889 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a3115200-149f-483a-b0e7-a99284fbd968 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:07.527231 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-a3115200-149f-483a-b0e7-a99284fbd968 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] HTTP exception thrown: Instance 4e4cd050-6103-4856-a8b5-c3df9d9bb203 could not be found. Oct 17 14:34:07.528913 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a3115200-149f-483a-b0e7-a99284fbd968 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Request method failure captured: Oct 17 14:34:07.528913 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203 HTTP/1.1 Oct 17 14:34:07.528913 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 14:34:07.528913 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 14:34:07.528913 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 14:34:07.528913 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 14:34:07.528913 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 14:34:07.528913 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 14:34:07.528913 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 14:34:07.528913 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 14:34:07.528913 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTWdVpabWT0Tbgf-QQ83Tq8AQGY8AcL_35cr_ansrTOmg5gYS9o-61drx7tYvn26ecQi5aoad2YeNf-Jm0l5MKteHOkMgnybFs17aOJ7G5iYUyXMaYulLqf3oAKSRqw_FkZniUVR3fFPKjmYjBguT22mJaxMSuqSX_P9X-IGsLXSZ0Uc Oct 17 14:34:07.528913 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 14:34:07.528913 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 14:34:07.528913 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 14:34:07.528913 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 14:34:07.528913 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 14:34:07.528913 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 14:34:07.528913 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 6312d6ad74bb476384426e63c1ec7ae5 Oct 17 14:34:07.528913 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServerActionsTestJSON-207618724 Oct 17 14:34:07.528913 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 14:34:07.528913 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 14:34:07.528913 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6312d6ad74bb476384426e63c1ec7ae5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6312d6ad74bb476384426e63c1ec7ae5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6312d6ad74bb476384426e63c1ec7ae5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6312d6ad74bb476384426e63c1ec7ae5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:34:07.528913 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServerActionsTestJSON-207618724 Oct 17 14:34:07.528913 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 6312d6ad74bb476384426e63c1ec7ae5 Oct 17 14:34:07.528913 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServerActionsTestJSON-207618724 Oct 17 14:34:07.528913 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServerActionsTestJSON-207618724-project Oct 17 14:34:07.528913 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 14:34:07.528913 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 14:34:07.528913 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: ad69a4e71c9e425fac89ec047eda43de Oct 17 14:34:07.528913 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServerActionsTestJSON-207618724-project Oct 17 14:34:07.528913 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 14:34:07.528913 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 4e4cd050-6103-4856-a8b5-c3df9d9bb203 could not be found. Oct 17 14:34:07.528913 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '4e4cd050-6103-4856-a8b5-c3df9d9bb203'} Oct 17 14:34:07.528913 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:34:07.528913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:34:07.528913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:34:07.528913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:34:07.528913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:34:07.528913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:34:07.528913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:34:07.528913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:34:07.528913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:34:07.528913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:34:07.528913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e4cd050-6103-4856-a8b5-c3df9d9bb203 could not be found. Oct 17 14:34:07.528913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:34:07.528913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:34:07.528913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:34:07.528913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:34:07.528913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:34:07.528913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:34:07.528913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:34:07.528913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:34:07.528913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:34:07.528913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:34:07.528913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:34:07.528913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:34:07.528913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:34:07.528913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:34:07.528913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:34:07.528913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:34:07.528913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e4cd050-6103-4856-a8b5-c3df9d9bb203 could not be found. Oct 17 14:34:07.528913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:34:07.528913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:34:07.528913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:34:07.533711 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:34:07.533711 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:34:07.533711 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:34:07.533711 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:34:07.533711 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:34:07.533711 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e4cd050-6103-4856-a8b5-c3df9d9bb203 could not be found. Oct 17 14:34:07.533711 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:34:07.533711 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a3115200-149f-483a-b0e7-a99284fbd968 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Returning 404 to user: Instance 4e4cd050-6103-4856-a8b5-c3df9d9bb203 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:34:07.533711 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a3115200-149f-483a-b0e7-a99284fbd968 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203" status: 404 len: 111 microversion: 2.1 time: 0.031131 Oct 17 14:34:07.533711 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3402/6665] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:34:07 2022] GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:34:07.579128 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d27ec438-0cf2-406b-8176-bf4047a07766 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1850852593", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "8df58892-60b4-4970-b9bf-0ee8a509c119"}], "security_groups": [{"name": "tempest-securitygroup--1788546303"}], "key_name": "tempest-keypair-533599217", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:34:07.685812 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-d27ec438-0cf2-406b-8176-bf4047a07766 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] validate_networks() for [('8df58892-60b4-4970-b9bf-0ee8a509c119', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:34:08.096714 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-d27ec438-0cf2-406b-8176-bf4047a07766 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:34:08.097179 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-d27ec438-0cf2-406b-8176-bf4047a07766 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:34:08.097665 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-d27ec438-0cf2-406b-8176-bf4047a07766 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:34:08.098272 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-d27ec438-0cf2-406b-8176-bf4047a07766 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:34:08.103536 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-d27ec438-0cf2-406b-8176-bf4047a07766 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:34:08.115448 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d27ec438-0cf2-406b-8176-bf4047a07766 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:08.115947 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d27ec438-0cf2-406b-8176-bf4047a07766 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:08.116397 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d27ec438-0cf2-406b-8176-bf4047a07766 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:08.120338 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d27ec438-0cf2-406b-8176-bf4047a07766 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:08.120819 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d27ec438-0cf2-406b-8176-bf4047a07766 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:08.121272 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d27ec438-0cf2-406b-8176-bf4047a07766 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:08.142825 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-d27ec438-0cf2-406b-8176-bf4047a07766 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Getting quotas for project 6312d6ad74bb476384426e63c1ec7ae5. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:34:08.148909 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-d27ec438-0cf2-406b-8176-bf4047a07766 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Getting quotas for user ad69a4e71c9e425fac89ec047eda43de and project 6312d6ad74bb476384426e63c1ec7ae5. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:34:08.162928 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d27ec438-0cf2-406b-8176-bf4047a07766 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:34:08.165286 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d27ec438-0cf2-406b-8176-bf4047a07766 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: cda83126-328f-4131-995d-a3ed5e64f5cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:34:08.214900 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d27ec438-0cf2-406b-8176-bf4047a07766 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.639616 Oct 17 14:34:08.215945 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3264/6666] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 14:34:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:34:08.228084 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-598c1c0b-5e35-48a9-b19e-33535fb7373a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:34:08.229810 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-598c1c0b-5e35-48a9-b19e-33535fb7373a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: cda83126-328f-4131-995d-a3ed5e64f5cb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:34:08.298190 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-598c1c0b-5e35-48a9-b19e-33535fb7373a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:34:08.310485 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-598c1c0b-5e35-48a9-b19e-33535fb7373a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb" status: 200 len: 1238 microversion: 2.1 time: 0.087384 Oct 17 14:34:08.311097 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3403/6667] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:34:08 2022] GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb => generated 1238 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:34:09.336042 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e95e29f2-abf0-4147-9774-0fe85d399429 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:34:09.336830 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e95e29f2-abf0-4147-9774-0fe85d399429 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: cda83126-328f-4131-995d-a3ed5e64f5cb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:34:09.347361 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e95e29f2-abf0-4147-9774-0fe85d399429 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:09.348032 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e95e29f2-abf0-4147-9774-0fe85d399429 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:09.348594 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e95e29f2-abf0-4147-9774-0fe85d399429 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:09.349482 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e95e29f2-abf0-4147-9774-0fe85d399429 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:09.350069 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e95e29f2-abf0-4147-9774-0fe85d399429 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:09.350618 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e95e29f2-abf0-4147-9774-0fe85d399429 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:09.417730 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e95e29f2-abf0-4147-9774-0fe85d399429 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:34:09.426992 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e95e29f2-abf0-4147-9774-0fe85d399429 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb" status: 200 len: 1290 microversion: 2.1 time: 0.095985 Oct 17 14:34:09.427648 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3265/6668] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:34:09 2022] GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb => generated 1290 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:34:10.450394 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c8591155-ed4d-48ef-8d9f-50c99a75827e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:34:10.451032 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c8591155-ed4d-48ef-8d9f-50c99a75827e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: cda83126-328f-4131-995d-a3ed5e64f5cb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:34:10.458162 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c8591155-ed4d-48ef-8d9f-50c99a75827e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:10.458746 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c8591155-ed4d-48ef-8d9f-50c99a75827e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:10.459209 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c8591155-ed4d-48ef-8d9f-50c99a75827e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:10.460011 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c8591155-ed4d-48ef-8d9f-50c99a75827e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:10.460479 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c8591155-ed4d-48ef-8d9f-50c99a75827e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:10.460903 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c8591155-ed4d-48ef-8d9f-50c99a75827e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:10.666025 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c8591155-ed4d-48ef-8d9f-50c99a75827e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:34:10.677058 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c8591155-ed4d-48ef-8d9f-50c99a75827e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb" status: 200 len: 1364 microversion: 2.1 time: 0.230585 Oct 17 14:34:10.677573 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3404/6669] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:34:10 2022] GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb => generated 1364 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:34:10.986706 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-94acd22a-9f3c-450a-bdb9-1cace86de133 req-f09c11a8-69d2-4086-88ca-3eed599c980a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cda83126-328f-4131-995d-a3ed5e64f5cb", "tag": "35d9e15c-6506-4aa1-8a37-b456582f4f26"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:34:10.998678 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-94acd22a-9f3c-450a-bdb9-1cace86de133 req-f09c11a8-69d2-4086-88ca-3eed599c980a service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:10.999184 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-94acd22a-9f3c-450a-bdb9-1cace86de133 req-f09c11a8-69d2-4086-88ca-3eed599c980a service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:10.999649 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-94acd22a-9f3c-450a-bdb9-1cace86de133 req-f09c11a8-69d2-4086-88ca-3eed599c980a service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:11.011395 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-94acd22a-9f3c-450a-bdb9-1cace86de133 req-f09c11a8-69d2-4086-88ca-3eed599c980a service nova] Creating event network-changed:35d9e15c-6506-4aa1-8a37-b456582f4f26 for instance cda83126-328f-4131-995d-a3ed5e64f5cb on n-h2-854247-14 Oct 17 14:34:11.016969 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-94acd22a-9f3c-450a-bdb9-1cace86de133 req-f09c11a8-69d2-4086-88ca-3eed599c980a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035530 Oct 17 14:34:11.017584 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3266/6670] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:34:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:34:11.704450 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0327dd0e-9a24-4ff2-8a62-baa737742992 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:34:11.705228 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0327dd0e-9a24-4ff2-8a62-baa737742992 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: cda83126-328f-4131-995d-a3ed5e64f5cb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:34:11.714446 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0327dd0e-9a24-4ff2-8a62-baa737742992 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:11.714938 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0327dd0e-9a24-4ff2-8a62-baa737742992 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:11.715421 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0327dd0e-9a24-4ff2-8a62-baa737742992 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:11.716141 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0327dd0e-9a24-4ff2-8a62-baa737742992 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:11.716598 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0327dd0e-9a24-4ff2-8a62-baa737742992 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:11.717020 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0327dd0e-9a24-4ff2-8a62-baa737742992 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:11.855831 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0327dd0e-9a24-4ff2-8a62-baa737742992 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:34:11.864010 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0327dd0e-9a24-4ff2-8a62-baa737742992 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb" status: 200 len: 1364 microversion: 2.1 time: 0.164942 Oct 17 14:34:11.864557 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3405/6671] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:34:11 2022] GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:34:12.892513 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-961d24bc-e5a2-4844-ac8c-159560b2d5e5 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:34:12.893450 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-961d24bc-e5a2-4844-ac8c-159560b2d5e5 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: cda83126-328f-4131-995d-a3ed5e64f5cb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:34:12.902088 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-961d24bc-e5a2-4844-ac8c-159560b2d5e5 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:12.902735 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-961d24bc-e5a2-4844-ac8c-159560b2d5e5 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:12.903364 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-961d24bc-e5a2-4844-ac8c-159560b2d5e5 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:12.904285 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-961d24bc-e5a2-4844-ac8c-159560b2d5e5 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:12.904905 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-961d24bc-e5a2-4844-ac8c-159560b2d5e5 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:12.905478 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-961d24bc-e5a2-4844-ac8c-159560b2d5e5 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:13.045692 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-961d24bc-e5a2-4844-ac8c-159560b2d5e5 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:34:13.053650 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-961d24bc-e5a2-4844-ac8c-159560b2d5e5 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb" status: 200 len: 1364 microversion: 2.1 time: 0.168737 Oct 17 14:34:13.054232 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3267/6672] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:34:12 2022] GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:34:14.082244 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-064d6aed-3df9-4a07-881a-b0f1b9bbfda0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:34:14.083108 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-064d6aed-3df9-4a07-881a-b0f1b9bbfda0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: cda83126-328f-4131-995d-a3ed5e64f5cb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:34:14.088076 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=45 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:34:14.094145 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-064d6aed-3df9-4a07-881a-b0f1b9bbfda0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:14.094642 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-064d6aed-3df9-4a07-881a-b0f1b9bbfda0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:14.095079 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-064d6aed-3df9-4a07-881a-b0f1b9bbfda0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:14.096113 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-064d6aed-3df9-4a07-881a-b0f1b9bbfda0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:14.096250 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-064d6aed-3df9-4a07-881a-b0f1b9bbfda0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:14.096702 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-064d6aed-3df9-4a07-881a-b0f1b9bbfda0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:14.598002 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-064d6aed-3df9-4a07-881a-b0f1b9bbfda0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:34:14.606312 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-064d6aed-3df9-4a07-881a-b0f1b9bbfda0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb" status: 200 len: 1364 microversion: 2.1 time: 0.530900 Oct 17 14:34:14.606905 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3406/6673] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:34:14 2022] GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb => generated 1364 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:34:15.633484 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8d42c97e-02fc-4738-b30e-7e284c41a025 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:34:15.634490 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8d42c97e-02fc-4738-b30e-7e284c41a025 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: cda83126-328f-4131-995d-a3ed5e64f5cb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:34:15.638658 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:34:15.648560 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8d42c97e-02fc-4738-b30e-7e284c41a025 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:15.649716 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8d42c97e-02fc-4738-b30e-7e284c41a025 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:15.650580 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8d42c97e-02fc-4738-b30e-7e284c41a025 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:15.651346 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8d42c97e-02fc-4738-b30e-7e284c41a025 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:15.651832 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8d42c97e-02fc-4738-b30e-7e284c41a025 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:15.652274 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8d42c97e-02fc-4738-b30e-7e284c41a025 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:15.796758 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8d42c97e-02fc-4738-b30e-7e284c41a025 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:34:15.804671 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8d42c97e-02fc-4738-b30e-7e284c41a025 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb" status: 200 len: 1364 microversion: 2.1 time: 0.178111 Oct 17 14:34:15.805243 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3268/6674] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:34:15 2022] GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb => generated 1364 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:34:16.350476 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-eab91b92-df37-4e5c-940e-933ed4cd8951 req-11cd758c-d187-4f68-ad4b-4c435dfd7cc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cda83126-328f-4131-995d-a3ed5e64f5cb", "name": "network-vif-plugged", "status": "completed", "tag": "35d9e15c-6506-4aa1-8a37-b456582f4f26"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:34:16.361734 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-eab91b92-df37-4e5c-940e-933ed4cd8951 req-11cd758c-d187-4f68-ad4b-4c435dfd7cc8 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:16.362319 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-eab91b92-df37-4e5c-940e-933ed4cd8951 req-11cd758c-d187-4f68-ad4b-4c435dfd7cc8 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:16.362801 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-eab91b92-df37-4e5c-940e-933ed4cd8951 req-11cd758c-d187-4f68-ad4b-4c435dfd7cc8 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:16.375755 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-eab91b92-df37-4e5c-940e-933ed4cd8951 req-11cd758c-d187-4f68-ad4b-4c435dfd7cc8 service nova] Creating event network-vif-plugged:35d9e15c-6506-4aa1-8a37-b456582f4f26 for instance cda83126-328f-4131-995d-a3ed5e64f5cb on n-h2-854247-14 Oct 17 14:34:16.381066 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-eab91b92-df37-4e5c-940e-933ed4cd8951 req-11cd758c-d187-4f68-ad4b-4c435dfd7cc8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035889 Oct 17 14:34:16.381735 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3407/6675] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:34:16.829705 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c7eebed7-755f-44c1-8b9b-f62aed2cabb6 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:34:16.830496 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c7eebed7-755f-44c1-8b9b-f62aed2cabb6 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: cda83126-328f-4131-995d-a3ed5e64f5cb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:34:16.841707 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7eebed7-755f-44c1-8b9b-f62aed2cabb6 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:16.842389 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7eebed7-755f-44c1-8b9b-f62aed2cabb6 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:16.843477 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7eebed7-755f-44c1-8b9b-f62aed2cabb6 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:16.844530 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7eebed7-755f-44c1-8b9b-f62aed2cabb6 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:16.845227 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7eebed7-755f-44c1-8b9b-f62aed2cabb6 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:16.845837 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7eebed7-755f-44c1-8b9b-f62aed2cabb6 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:16.993001 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c7eebed7-755f-44c1-8b9b-f62aed2cabb6 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:34:17.002202 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c7eebed7-755f-44c1-8b9b-f62aed2cabb6 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb" status: 200 len: 1364 microversion: 2.1 time: 0.176959 Oct 17 14:34:17.002765 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3269/6676] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:34:16 2022] GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:34:18.040852 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-41623ef0-01e1-4057-8e0c-2560ee6d966b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:34:18.041991 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-41623ef0-01e1-4057-8e0c-2560ee6d966b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: cda83126-328f-4131-995d-a3ed5e64f5cb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:34:18.049266 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-41623ef0-01e1-4057-8e0c-2560ee6d966b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:18.049762 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-41623ef0-01e1-4057-8e0c-2560ee6d966b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:18.050197 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-41623ef0-01e1-4057-8e0c-2560ee6d966b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:18.050890 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-41623ef0-01e1-4057-8e0c-2560ee6d966b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:18.051392 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-41623ef0-01e1-4057-8e0c-2560ee6d966b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:18.051815 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-41623ef0-01e1-4057-8e0c-2560ee6d966b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:18.189631 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-41623ef0-01e1-4057-8e0c-2560ee6d966b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:34:18.197849 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-41623ef0-01e1-4057-8e0c-2560ee6d966b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb" status: 200 len: 1551 microversion: 2.1 time: 0.165699 Oct 17 14:34:18.198440 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3408/6677] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:34:18 2022] GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb => generated 1551 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:34:18.221520 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4ab373f9-cd9a-446b-93bf-25a9725b01c0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:34:18.222031 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4ab373f9-cd9a-446b-93bf-25a9725b01c0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: cda83126-328f-4131-995d-a3ed5e64f5cb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:34:18.224790 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:34:18.225505 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=6 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:34:18.232645 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4ab373f9-cd9a-446b-93bf-25a9725b01c0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:18.233146 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4ab373f9-cd9a-446b-93bf-25a9725b01c0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:18.233601 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4ab373f9-cd9a-446b-93bf-25a9725b01c0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:18.234318 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4ab373f9-cd9a-446b-93bf-25a9725b01c0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:18.234783 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4ab373f9-cd9a-446b-93bf-25a9725b01c0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:18.235226 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4ab373f9-cd9a-446b-93bf-25a9725b01c0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:18.327226 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4ab373f9-cd9a-446b-93bf-25a9725b01c0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.109240 Oct 17 14:34:18.328028 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3270/6678] 10.222.0.79 () {58 vars in 1275 bytes} [Mon Oct 17 14:34:18 2022] GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb/os-interface => generated 285 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:34:19.646672 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-d3299b12-4286-4213-9df6-342268595d08 req-28713525-3c8b-4b39-bcea-a02aed4f58a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cda83126-328f-4131-995d-a3ed5e64f5cb", "tag": "35d9e15c-6506-4aa1-8a37-b456582f4f26"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:34:19.653345 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:34:19.659463 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-d3299b12-4286-4213-9df6-342268595d08 req-28713525-3c8b-4b39-bcea-a02aed4f58a4 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:19.660065 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-d3299b12-4286-4213-9df6-342268595d08 req-28713525-3c8b-4b39-bcea-a02aed4f58a4 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:19.660717 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-d3299b12-4286-4213-9df6-342268595d08 req-28713525-3c8b-4b39-bcea-a02aed4f58a4 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:19.674735 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-d3299b12-4286-4213-9df6-342268595d08 req-28713525-3c8b-4b39-bcea-a02aed4f58a4 service nova] Creating event network-changed:35d9e15c-6506-4aa1-8a37-b456582f4f26 for instance cda83126-328f-4131-995d-a3ed5e64f5cb on n-h2-854247-14 Oct 17 14:34:19.680367 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-d3299b12-4286-4213-9df6-342268595d08 req-28713525-3c8b-4b39-bcea-a02aed4f58a4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037354 Oct 17 14:34:19.681312 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3409/6679] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:34:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:34:52.543748 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=5 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:34:52.544633 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:34:52.545850 n-d-854247-14 devstack@n-api.service[127017]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 14:34:52.546009 n-d-854247-14 devstack@n-api.service[127017]: Mon Oct 17 14:34:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb/action (ip 10.222.0.79) !!! Oct 17 14:34:52.551997 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bd37e065-c5f3-4c41-a3a3-7f1c1f393150 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:34:52.554352 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-bd37e065-c5f3-4c41-a3a3-7f1c1f393150 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: cda83126-328f-4131-995d-a3ed5e64f5cb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:34:52.565306 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bd37e065-c5f3-4c41-a3a3-7f1c1f393150 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:52.565810 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bd37e065-c5f3-4c41-a3a3-7f1c1f393150 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:52.566296 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bd37e065-c5f3-4c41-a3a3-7f1c1f393150 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:52.567040 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bd37e065-c5f3-4c41-a3a3-7f1c1f393150 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:52.567537 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bd37e065-c5f3-4c41-a3a3-7f1c1f393150 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:52.567980 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bd37e065-c5f3-4c41-a3a3-7f1c1f393150 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:52.599117 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-bd37e065-c5f3-4c41-a3a3-7f1c1f393150 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:34:52.605195 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-bd37e065-c5f3-4c41-a3a3-7f1c1f393150 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: cda83126-328f-4131-995d-a3ed5e64f5cb] Old instance type m1.heat2, new instance type m1.heat {{(pid=127017) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 17 14:34:52.612234 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-bd37e065-c5f3-4c41-a3a3-7f1c1f393150 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:34:52.612694 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-bd37e065-c5f3-4c41-a3a3-7f1c1f393150 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:34:52.613183 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-bd37e065-c5f3-4c41-a3a3-7f1c1f393150 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:34:52.613607 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-bd37e065-c5f3-4c41-a3a3-7f1c1f393150 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:34:52.614032 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-bd37e065-c5f3-4c41-a3a3-7f1c1f393150 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:34:52.686780 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-bd37e065-c5f3-4c41-a3a3-7f1c1f393150 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "POST /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb/action" status: 202 len: 0 microversion: 2.1 time: 0.146317 Oct 17 14:34:52.687431 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3271/6680] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:34:52 2022] POST /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:34:52.694899 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=7 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:34:52.695688 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=32 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:34:52.697761 n-d-854247-14 devstack@n-api.service[127016]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 14:34:52.697901 n-d-854247-14 devstack@n-api.service[127016]: Mon Oct 17 14:34:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb (ip 10.222.0.79) !!! Oct 17 14:34:52.705491 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-27d74bb8-f796-44ae-9c5a-806a4c121137 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:34:52.706192 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-27d74bb8-f796-44ae-9c5a-806a4c121137 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: cda83126-328f-4131-995d-a3ed5e64f5cb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:34:52.720076 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-27d74bb8-f796-44ae-9c5a-806a4c121137 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:52.720649 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-27d74bb8-f796-44ae-9c5a-806a4c121137 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:52.721083 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-27d74bb8-f796-44ae-9c5a-806a4c121137 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:52.721878 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-27d74bb8-f796-44ae-9c5a-806a4c121137 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:52.722363 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-27d74bb8-f796-44ae-9c5a-806a4c121137 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:52.722778 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-27d74bb8-f796-44ae-9c5a-806a4c121137 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:52.859408 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-27d74bb8-f796-44ae-9c5a-806a4c121137 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:34:52.867960 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-27d74bb8-f796-44ae-9c5a-806a4c121137 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb" status: 200 len: 1677 microversion: 2.1 time: 0.176030 Oct 17 14:34:52.868530 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3410/6681] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:34:52 2022] GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb => generated 1677 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:34:53.891568 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-679a7923-8c2c-43aa-9226-3d4d7560007f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:34:53.892135 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-679a7923-8c2c-43aa-9226-3d4d7560007f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: cda83126-328f-4131-995d-a3ed5e64f5cb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:34:53.900458 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-679a7923-8c2c-43aa-9226-3d4d7560007f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:53.900966 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-679a7923-8c2c-43aa-9226-3d4d7560007f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:53.901545 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-679a7923-8c2c-43aa-9226-3d4d7560007f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:53.902348 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-679a7923-8c2c-43aa-9226-3d4d7560007f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:53.902816 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-679a7923-8c2c-43aa-9226-3d4d7560007f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:53.903280 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-679a7923-8c2c-43aa-9226-3d4d7560007f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:54.038976 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-679a7923-8c2c-43aa-9226-3d4d7560007f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:34:54.047407 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-679a7923-8c2c-43aa-9226-3d4d7560007f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb" status: 200 len: 1677 microversion: 2.1 time: 0.160369 Oct 17 14:34:54.047990 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3272/6682] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:34:53 2022] GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:34:55.070504 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1de630c7-8b04-4edd-8e07-b486ce7ec4a3 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:34:55.071077 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-1de630c7-8b04-4edd-8e07-b486ce7ec4a3 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: cda83126-328f-4131-995d-a3ed5e64f5cb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:34:55.078991 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1de630c7-8b04-4edd-8e07-b486ce7ec4a3 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:55.079541 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1de630c7-8b04-4edd-8e07-b486ce7ec4a3 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:55.080009 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1de630c7-8b04-4edd-8e07-b486ce7ec4a3 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:55.080713 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1de630c7-8b04-4edd-8e07-b486ce7ec4a3 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:55.081176 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1de630c7-8b04-4edd-8e07-b486ce7ec4a3 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:55.081601 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1de630c7-8b04-4edd-8e07-b486ce7ec4a3 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:55.224736 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-1de630c7-8b04-4edd-8e07-b486ce7ec4a3 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:34:55.233154 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1de630c7-8b04-4edd-8e07-b486ce7ec4a3 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb" status: 200 len: 1682 microversion: 2.1 time: 0.166778 Oct 17 14:34:55.233727 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3411/6683] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:34:55 2022] GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:34:56.259616 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b227bf83-55cf-408e-8d18-2706db430d11 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:34:56.260497 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b227bf83-55cf-408e-8d18-2706db430d11 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: cda83126-328f-4131-995d-a3ed5e64f5cb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:34:56.270230 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b227bf83-55cf-408e-8d18-2706db430d11 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:56.270910 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b227bf83-55cf-408e-8d18-2706db430d11 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:56.271551 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b227bf83-55cf-408e-8d18-2706db430d11 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:56.272492 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b227bf83-55cf-408e-8d18-2706db430d11 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:56.273106 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b227bf83-55cf-408e-8d18-2706db430d11 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:56.273694 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b227bf83-55cf-408e-8d18-2706db430d11 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:56.412588 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b227bf83-55cf-408e-8d18-2706db430d11 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:34:56.420715 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b227bf83-55cf-408e-8d18-2706db430d11 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb" status: 200 len: 1682 microversion: 2.1 time: 0.166726 Oct 17 14:34:56.421339 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3273/6684] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:34:56 2022] GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:34:57.446293 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8959f7bf-6eba-45cd-8dad-f25ab4945f65 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:34:57.446915 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8959f7bf-6eba-45cd-8dad-f25ab4945f65 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: cda83126-328f-4131-995d-a3ed5e64f5cb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:34:57.454620 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8959f7bf-6eba-45cd-8dad-f25ab4945f65 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:57.455088 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8959f7bf-6eba-45cd-8dad-f25ab4945f65 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:57.455583 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8959f7bf-6eba-45cd-8dad-f25ab4945f65 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:57.456287 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8959f7bf-6eba-45cd-8dad-f25ab4945f65 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:57.456745 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8959f7bf-6eba-45cd-8dad-f25ab4945f65 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:57.457176 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8959f7bf-6eba-45cd-8dad-f25ab4945f65 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:57.592347 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8959f7bf-6eba-45cd-8dad-f25ab4945f65 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:34:57.603855 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8959f7bf-6eba-45cd-8dad-f25ab4945f65 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb" status: 200 len: 1682 microversion: 2.1 time: 0.161273 Oct 17 14:34:57.604724 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3412/6685] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:34:57 2022] GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:34:58.629686 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-875d4790-2661-4612-86c7-d29a5b42e370 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:34:58.630432 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-875d4790-2661-4612-86c7-d29a5b42e370 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: cda83126-328f-4131-995d-a3ed5e64f5cb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:34:58.639578 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-875d4790-2661-4612-86c7-d29a5b42e370 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:58.640199 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-875d4790-2661-4612-86c7-d29a5b42e370 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:58.640766 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-875d4790-2661-4612-86c7-d29a5b42e370 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:58.641649 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-875d4790-2661-4612-86c7-d29a5b42e370 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:58.642233 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-875d4790-2661-4612-86c7-d29a5b42e370 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:58.642782 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-875d4790-2661-4612-86c7-d29a5b42e370 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:58.781644 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-875d4790-2661-4612-86c7-d29a5b42e370 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:34:58.790002 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-875d4790-2661-4612-86c7-d29a5b42e370 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb" status: 200 len: 1682 microversion: 2.1 time: 0.165354 Oct 17 14:34:58.790548 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3274/6686] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:34:58 2022] GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:34:59.815928 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7f90754e-375c-4b10-a834-29706be2199f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:34:59.816641 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7f90754e-375c-4b10-a834-29706be2199f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: cda83126-328f-4131-995d-a3ed5e64f5cb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:34:59.826267 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7f90754e-375c-4b10-a834-29706be2199f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:59.826910 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7f90754e-375c-4b10-a834-29706be2199f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:59.827536 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7f90754e-375c-4b10-a834-29706be2199f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:59.828449 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7f90754e-375c-4b10-a834-29706be2199f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:59.829052 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7f90754e-375c-4b10-a834-29706be2199f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:59.829614 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7f90754e-375c-4b10-a834-29706be2199f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:59.978916 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7f90754e-375c-4b10-a834-29706be2199f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:34:59.992735 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7f90754e-375c-4b10-a834-29706be2199f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb" status: 200 len: 1682 microversion: 2.1 time: 0.181886 Oct 17 14:34:59.993658 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3413/6687] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:34:59 2022] GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb => generated 1682 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:35:01.022264 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9577619c-da27-4a2e-95c8-7a50a7538bfd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:35:01.023265 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9577619c-da27-4a2e-95c8-7a50a7538bfd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: cda83126-328f-4131-995d-a3ed5e64f5cb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:35:01.034732 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9577619c-da27-4a2e-95c8-7a50a7538bfd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:01.035617 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9577619c-da27-4a2e-95c8-7a50a7538bfd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:01.036360 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9577619c-da27-4a2e-95c8-7a50a7538bfd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:01.037515 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9577619c-da27-4a2e-95c8-7a50a7538bfd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:01.038286 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9577619c-da27-4a2e-95c8-7a50a7538bfd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:01.039001 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9577619c-da27-4a2e-95c8-7a50a7538bfd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:01.207801 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9577619c-da27-4a2e-95c8-7a50a7538bfd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:35:01.218561 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9577619c-da27-4a2e-95c8-7a50a7538bfd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb" status: 200 len: 1682 microversion: 2.1 time: 0.202936 Oct 17 14:35:01.219143 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3275/6688] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:35:01 2022] GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb => generated 1682 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:35:02.243881 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d6d3a4f9-fd09-4a29-a1ed-8a3d56cd4a8b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:35:02.244569 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d6d3a4f9-fd09-4a29-a1ed-8a3d56cd4a8b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: cda83126-328f-4131-995d-a3ed5e64f5cb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:35:02.252459 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d6d3a4f9-fd09-4a29-a1ed-8a3d56cd4a8b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:02.252950 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d6d3a4f9-fd09-4a29-a1ed-8a3d56cd4a8b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:02.253416 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d6d3a4f9-fd09-4a29-a1ed-8a3d56cd4a8b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:02.254118 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d6d3a4f9-fd09-4a29-a1ed-8a3d56cd4a8b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:02.254580 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d6d3a4f9-fd09-4a29-a1ed-8a3d56cd4a8b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:02.255001 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d6d3a4f9-fd09-4a29-a1ed-8a3d56cd4a8b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:02.393144 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d6d3a4f9-fd09-4a29-a1ed-8a3d56cd4a8b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:35:02.401355 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d6d3a4f9-fd09-4a29-a1ed-8a3d56cd4a8b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb" status: 200 len: 1682 microversion: 2.1 time: 0.162216 Oct 17 14:35:02.401937 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3414/6689] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:35:02 2022] GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:35:03.428822 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-87e81827-726a-4d53-9d9e-c557a7b9a940 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:35:03.429942 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-87e81827-726a-4d53-9d9e-c557a7b9a940 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: cda83126-328f-4131-995d-a3ed5e64f5cb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:35:03.440011 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-87e81827-726a-4d53-9d9e-c557a7b9a940 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:03.440516 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-87e81827-726a-4d53-9d9e-c557a7b9a940 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:03.440995 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-87e81827-726a-4d53-9d9e-c557a7b9a940 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:03.441733 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-87e81827-726a-4d53-9d9e-c557a7b9a940 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:03.442202 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-87e81827-726a-4d53-9d9e-c557a7b9a940 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:03.442645 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-87e81827-726a-4d53-9d9e-c557a7b9a940 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:03.593613 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-87e81827-726a-4d53-9d9e-c557a7b9a940 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:35:03.601871 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-87e81827-726a-4d53-9d9e-c557a7b9a940 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb" status: 200 len: 1682 microversion: 2.1 time: 0.179804 Oct 17 14:35:03.602451 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3276/6690] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:35:03 2022] GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb => generated 1682 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:35:04.634567 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c4c4cc89-9cbe-4199-a654-b45a99ae6b7f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:35:04.635586 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c4c4cc89-9cbe-4199-a654-b45a99ae6b7f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: cda83126-328f-4131-995d-a3ed5e64f5cb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:35:04.644795 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c4c4cc89-9cbe-4199-a654-b45a99ae6b7f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:04.645289 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c4c4cc89-9cbe-4199-a654-b45a99ae6b7f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:04.645727 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c4c4cc89-9cbe-4199-a654-b45a99ae6b7f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:04.646431 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c4c4cc89-9cbe-4199-a654-b45a99ae6b7f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:04.646873 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c4c4cc89-9cbe-4199-a654-b45a99ae6b7f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:04.647363 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c4c4cc89-9cbe-4199-a654-b45a99ae6b7f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:04.788109 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c4c4cc89-9cbe-4199-a654-b45a99ae6b7f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:35:04.796429 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c4c4cc89-9cbe-4199-a654-b45a99ae6b7f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb" status: 200 len: 1682 microversion: 2.1 time: 0.168876 Oct 17 14:35:04.797028 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3415/6691] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:35:04 2022] GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:35:05.820195 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a198db44-f4a2-4a92-85a6-46ab39e45890 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:35:05.820843 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a198db44-f4a2-4a92-85a6-46ab39e45890 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: cda83126-328f-4131-995d-a3ed5e64f5cb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:35:05.828459 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a198db44-f4a2-4a92-85a6-46ab39e45890 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:05.828955 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a198db44-f4a2-4a92-85a6-46ab39e45890 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:05.829404 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a198db44-f4a2-4a92-85a6-46ab39e45890 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:05.830106 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a198db44-f4a2-4a92-85a6-46ab39e45890 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:05.830549 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a198db44-f4a2-4a92-85a6-46ab39e45890 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:05.831011 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a198db44-f4a2-4a92-85a6-46ab39e45890 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:05.966997 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a198db44-f4a2-4a92-85a6-46ab39e45890 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:35:05.975736 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a198db44-f4a2-4a92-85a6-46ab39e45890 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb" status: 200 len: 1682 microversion: 2.1 time: 0.159626 Oct 17 14:35:05.976312 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3277/6692] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:35:05 2022] GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:35:07.000759 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-48290d26-6fd7-43b9-9f9d-0d95d46e9ba9 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:35:07.001437 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-48290d26-6fd7-43b9-9f9d-0d95d46e9ba9 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: cda83126-328f-4131-995d-a3ed5e64f5cb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:35:07.008858 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48290d26-6fd7-43b9-9f9d-0d95d46e9ba9 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:07.009343 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48290d26-6fd7-43b9-9f9d-0d95d46e9ba9 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:07.009777 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48290d26-6fd7-43b9-9f9d-0d95d46e9ba9 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:07.010471 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48290d26-6fd7-43b9-9f9d-0d95d46e9ba9 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:07.011047 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48290d26-6fd7-43b9-9f9d-0d95d46e9ba9 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:07.011544 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48290d26-6fd7-43b9-9f9d-0d95d46e9ba9 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:07.172772 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-48290d26-6fd7-43b9-9f9d-0d95d46e9ba9 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:35:07.187197 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-48290d26-6fd7-43b9-9f9d-0d95d46e9ba9 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb" status: 200 len: 1682 microversion: 2.1 time: 0.190871 Oct 17 14:35:07.187803 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3416/6693] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:35:06 2022] GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb => generated 1682 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:35:08.213644 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a68dac18-e00a-4092-afd7-eabfb7806edf tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:35:08.214294 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a68dac18-e00a-4092-afd7-eabfb7806edf tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: cda83126-328f-4131-995d-a3ed5e64f5cb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:35:08.221647 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a68dac18-e00a-4092-afd7-eabfb7806edf tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:08.222149 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a68dac18-e00a-4092-afd7-eabfb7806edf tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:08.222593 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a68dac18-e00a-4092-afd7-eabfb7806edf tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:08.223356 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a68dac18-e00a-4092-afd7-eabfb7806edf tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:08.223827 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a68dac18-e00a-4092-afd7-eabfb7806edf tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:08.224275 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a68dac18-e00a-4092-afd7-eabfb7806edf tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:08.356039 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a68dac18-e00a-4092-afd7-eabfb7806edf tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:35:08.364431 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a68dac18-e00a-4092-afd7-eabfb7806edf tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb" status: 200 len: 1682 microversion: 2.1 time: 0.154795 Oct 17 14:35:08.364986 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3278/6694] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:35:08 2022] GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:35:09.392553 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5d922912-e27c-4922-9cfa-53b60965f95d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:35:09.393439 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5d922912-e27c-4922-9cfa-53b60965f95d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: cda83126-328f-4131-995d-a3ed5e64f5cb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:35:09.404955 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5d922912-e27c-4922-9cfa-53b60965f95d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:09.405439 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5d922912-e27c-4922-9cfa-53b60965f95d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:09.405863 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5d922912-e27c-4922-9cfa-53b60965f95d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:09.406558 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5d922912-e27c-4922-9cfa-53b60965f95d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:09.407071 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5d922912-e27c-4922-9cfa-53b60965f95d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:09.407535 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5d922912-e27c-4922-9cfa-53b60965f95d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:09.542666 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5d922912-e27c-4922-9cfa-53b60965f95d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:35:09.551413 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5d922912-e27c-4922-9cfa-53b60965f95d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb" status: 200 len: 1682 microversion: 2.1 time: 0.166123 Oct 17 14:35:09.552009 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3417/6695] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:35:09 2022] GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:35:10.577178 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3de213d7-9080-4c7d-a364-ac5b18f7075b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:35:10.577887 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3de213d7-9080-4c7d-a364-ac5b18f7075b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: cda83126-328f-4131-995d-a3ed5e64f5cb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:35:10.585357 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3de213d7-9080-4c7d-a364-ac5b18f7075b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:10.585852 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3de213d7-9080-4c7d-a364-ac5b18f7075b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:10.586291 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3de213d7-9080-4c7d-a364-ac5b18f7075b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:10.586994 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3de213d7-9080-4c7d-a364-ac5b18f7075b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:10.587492 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3de213d7-9080-4c7d-a364-ac5b18f7075b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:10.587923 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3de213d7-9080-4c7d-a364-ac5b18f7075b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:10.723274 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3de213d7-9080-4c7d-a364-ac5b18f7075b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:35:10.734619 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3de213d7-9080-4c7d-a364-ac5b18f7075b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb" status: 200 len: 1682 microversion: 2.1 time: 0.162847 Oct 17 14:35:10.735263 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3279/6696] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:35:10 2022] GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:35:11.760683 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-019c020c-2c57-475f-bc45-36294ac3f560 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:35:11.761566 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-019c020c-2c57-475f-bc45-36294ac3f560 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: cda83126-328f-4131-995d-a3ed5e64f5cb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:35:11.769758 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-019c020c-2c57-475f-bc45-36294ac3f560 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:11.770245 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-019c020c-2c57-475f-bc45-36294ac3f560 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:11.770681 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-019c020c-2c57-475f-bc45-36294ac3f560 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:11.771420 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-019c020c-2c57-475f-bc45-36294ac3f560 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:11.771878 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-019c020c-2c57-475f-bc45-36294ac3f560 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:11.772301 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-019c020c-2c57-475f-bc45-36294ac3f560 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:11.913104 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-019c020c-2c57-475f-bc45-36294ac3f560 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:35:11.921338 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-019c020c-2c57-475f-bc45-36294ac3f560 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb" status: 200 len: 1682 microversion: 2.1 time: 0.166591 Oct 17 14:35:11.921957 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3418/6697] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:35:11 2022] GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:35:12.599005 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-6b31b9ce-c40a-480d-8c20-3dec9d7ad4b5 req-c41c3f5a-929b-4540-87bd-af68def260e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cda83126-328f-4131-995d-a3ed5e64f5cb", "name": "network-vif-unplugged", "status": "completed", "tag": "35d9e15c-6506-4aa1-8a37-b456582f4f26"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:35:12.609624 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-6b31b9ce-c40a-480d-8c20-3dec9d7ad4b5 req-c41c3f5a-929b-4540-87bd-af68def260e7 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:12.610237 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-6b31b9ce-c40a-480d-8c20-3dec9d7ad4b5 req-c41c3f5a-929b-4540-87bd-af68def260e7 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:12.610741 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-6b31b9ce-c40a-480d-8c20-3dec9d7ad4b5 req-c41c3f5a-929b-4540-87bd-af68def260e7 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:12.623008 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-6b31b9ce-c40a-480d-8c20-3dec9d7ad4b5 req-c41c3f5a-929b-4540-87bd-af68def260e7 service nova] Creating event network-vif-unplugged:35d9e15c-6506-4aa1-8a37-b456582f4f26 for instance cda83126-328f-4131-995d-a3ed5e64f5cb on n-h1-854247-14 Oct 17 14:35:12.628627 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [req-6b31b9ce-c40a-480d-8c20-3dec9d7ad4b5 req-c41c3f5a-929b-4540-87bd-af68def260e7 service nova] Instance cda83126-328f-4131-995d-a3ed5e64f5cb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854247-14', 'n-h1-854247-14'} {{(pid=127017) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 14:35:12.641162 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-6b31b9ce-c40a-480d-8c20-3dec9d7ad4b5 req-c41c3f5a-929b-4540-87bd-af68def260e7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046401 Oct 17 14:35:12.642292 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3280/6698] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:35:12.945726 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ccaaae35-692c-4337-a766-17618d725e70 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:35:12.946315 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ccaaae35-692c-4337-a766-17618d725e70 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: cda83126-328f-4131-995d-a3ed5e64f5cb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:35:12.954242 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ccaaae35-692c-4337-a766-17618d725e70 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:12.954649 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ccaaae35-692c-4337-a766-17618d725e70 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:12.955108 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ccaaae35-692c-4337-a766-17618d725e70 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:12.955855 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ccaaae35-692c-4337-a766-17618d725e70 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:12.956314 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ccaaae35-692c-4337-a766-17618d725e70 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:12.956743 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ccaaae35-692c-4337-a766-17618d725e70 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:13.097600 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ccaaae35-692c-4337-a766-17618d725e70 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:35:13.116080 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ccaaae35-692c-4337-a766-17618d725e70 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb" status: 200 len: 1681 microversion: 2.1 time: 0.171237 Oct 17 14:35:13.116720 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3419/6699] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:35:12 2022] GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb => generated 1681 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:35:14.141741 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-45307908-9f7e-49f9-ae3c-2b9670009414 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:35:14.142506 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-45307908-9f7e-49f9-ae3c-2b9670009414 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: cda83126-328f-4131-995d-a3ed5e64f5cb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:35:14.149771 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-45307908-9f7e-49f9-ae3c-2b9670009414 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:14.150270 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-45307908-9f7e-49f9-ae3c-2b9670009414 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:14.150723 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-45307908-9f7e-49f9-ae3c-2b9670009414 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:14.151463 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-45307908-9f7e-49f9-ae3c-2b9670009414 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:14.151932 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-45307908-9f7e-49f9-ae3c-2b9670009414 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:14.152373 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-45307908-9f7e-49f9-ae3c-2b9670009414 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:14.292404 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-45307908-9f7e-49f9-ae3c-2b9670009414 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:35:14.300507 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-45307908-9f7e-49f9-ae3c-2b9670009414 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb" status: 200 len: 1679 microversion: 2.1 time: 0.163690 Oct 17 14:35:14.301090 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3281/6700] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:35:14 2022] GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:35:14.661485 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-b7f8137c-9c56-4acc-8feb-de380246675c req-16a4bc42-cafe-4473-9f03-9bc8c7016c4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cda83126-328f-4131-995d-a3ed5e64f5cb", "tag": "35d9e15c-6506-4aa1-8a37-b456582f4f26"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:35:14.672443 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-b7f8137c-9c56-4acc-8feb-de380246675c req-16a4bc42-cafe-4473-9f03-9bc8c7016c4f service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:14.672944 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-b7f8137c-9c56-4acc-8feb-de380246675c req-16a4bc42-cafe-4473-9f03-9bc8c7016c4f service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:14.673420 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-b7f8137c-9c56-4acc-8feb-de380246675c req-16a4bc42-cafe-4473-9f03-9bc8c7016c4f service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:14.685527 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-b7f8137c-9c56-4acc-8feb-de380246675c req-16a4bc42-cafe-4473-9f03-9bc8c7016c4f service nova] Creating event network-changed:35d9e15c-6506-4aa1-8a37-b456582f4f26 for instance cda83126-328f-4131-995d-a3ed5e64f5cb on n-h1-854247-14 Oct 17 14:35:14.691506 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [req-b7f8137c-9c56-4acc-8feb-de380246675c req-16a4bc42-cafe-4473-9f03-9bc8c7016c4f service nova] Instance cda83126-328f-4131-995d-a3ed5e64f5cb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854247-14', 'n-h1-854247-14'} {{(pid=127016) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 14:35:14.702980 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-b7f8137c-9c56-4acc-8feb-de380246675c req-16a4bc42-cafe-4473-9f03-9bc8c7016c4f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045732 Oct 17 14:35:14.703633 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3420/6701] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:35:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:35:15.332531 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a399316c-86ab-4c62-b71e-7beac8c6a42d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:35:15.333105 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a399316c-86ab-4c62-b71e-7beac8c6a42d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: cda83126-328f-4131-995d-a3ed5e64f5cb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:35:15.340259 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a399316c-86ab-4c62-b71e-7beac8c6a42d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:15.341002 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a399316c-86ab-4c62-b71e-7beac8c6a42d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:15.341437 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a399316c-86ab-4c62-b71e-7beac8c6a42d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:15.342336 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a399316c-86ab-4c62-b71e-7beac8c6a42d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:15.342998 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a399316c-86ab-4c62-b71e-7beac8c6a42d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:15.343462 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a399316c-86ab-4c62-b71e-7beac8c6a42d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:15.483427 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a399316c-86ab-4c62-b71e-7beac8c6a42d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:35:15.492025 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a399316c-86ab-4c62-b71e-7beac8c6a42d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb" status: 200 len: 1676 microversion: 2.1 time: 0.163893 Oct 17 14:35:15.492727 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3282/6702] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:35:15 2022] GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:35:15.516544 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-bbc84468-9bbb-41c3-9814-4cda6553fa85 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:35:15.517202 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-bbc84468-9bbb-41c3-9814-4cda6553fa85 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: cda83126-328f-4131-995d-a3ed5e64f5cb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:35:15.523863 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bbc84468-9bbb-41c3-9814-4cda6553fa85 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:15.524323 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bbc84468-9bbb-41c3-9814-4cda6553fa85 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:15.524759 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bbc84468-9bbb-41c3-9814-4cda6553fa85 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:15.525456 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bbc84468-9bbb-41c3-9814-4cda6553fa85 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:15.525909 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bbc84468-9bbb-41c3-9814-4cda6553fa85 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:15.526329 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bbc84468-9bbb-41c3-9814-4cda6553fa85 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:15.564724 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bbc84468-9bbb-41c3-9814-4cda6553fa85 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:15.565218 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bbc84468-9bbb-41c3-9814-4cda6553fa85 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:15.565663 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bbc84468-9bbb-41c3-9814-4cda6553fa85 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:15.566386 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bbc84468-9bbb-41c3-9814-4cda6553fa85 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:15.566840 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bbc84468-9bbb-41c3-9814-4cda6553fa85 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:15.567338 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bbc84468-9bbb-41c3-9814-4cda6553fa85 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:15.592355 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-bbc84468-9bbb-41c3-9814-4cda6553fa85 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Getting quotas for project 6312d6ad74bb476384426e63c1ec7ae5. Resources: {'ram', 'cores'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:35:15.597914 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-bbc84468-9bbb-41c3-9814-4cda6553fa85 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Getting quotas for user ad69a4e71c9e425fac89ec047eda43de and project 6312d6ad74bb476384426e63c1ec7ae5. Resources: {'ram', 'cores'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:35:15.712688 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-bbc84468-9bbb-41c3-9814-4cda6553fa85 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "POST /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb/action" status: 202 len: 0 microversion: 2.1 time: 0.200820 Oct 17 14:35:15.716332 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3421/6703] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:35:15 2022] POST /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:35:15.721591 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9e481b1a-d9fe-442e-8439-bbc009707878 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:35:15.722235 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9e481b1a-d9fe-442e-8439-bbc009707878 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: cda83126-328f-4131-995d-a3ed5e64f5cb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:35:15.728868 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9e481b1a-d9fe-442e-8439-bbc009707878 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:15.729587 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9e481b1a-d9fe-442e-8439-bbc009707878 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:15.730271 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9e481b1a-d9fe-442e-8439-bbc009707878 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:15.731125 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9e481b1a-d9fe-442e-8439-bbc009707878 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:15.731672 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9e481b1a-d9fe-442e-8439-bbc009707878 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:15.732030 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9e481b1a-d9fe-442e-8439-bbc009707878 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:15.873307 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9e481b1a-d9fe-442e-8439-bbc009707878 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:35:15.881851 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9e481b1a-d9fe-442e-8439-bbc009707878 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb" status: 200 len: 1675 microversion: 2.1 time: 0.164213 Oct 17 14:35:15.882451 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3283/6704] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:35:15 2022] GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:35:16.911354 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7ca44f17-92f0-441e-be1c-1a2ec6a7ff1b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:35:16.912059 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7ca44f17-92f0-441e-be1c-1a2ec6a7ff1b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: cda83126-328f-4131-995d-a3ed5e64f5cb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:35:16.919653 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7ca44f17-92f0-441e-be1c-1a2ec6a7ff1b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:16.920134 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7ca44f17-92f0-441e-be1c-1a2ec6a7ff1b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:16.920565 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7ca44f17-92f0-441e-be1c-1a2ec6a7ff1b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:16.921370 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7ca44f17-92f0-441e-be1c-1a2ec6a7ff1b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:16.921825 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7ca44f17-92f0-441e-be1c-1a2ec6a7ff1b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:16.922237 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7ca44f17-92f0-441e-be1c-1a2ec6a7ff1b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:17.059978 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7ca44f17-92f0-441e-be1c-1a2ec6a7ff1b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:35:17.068575 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7ca44f17-92f0-441e-be1c-1a2ec6a7ff1b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb" status: 200 len: 1675 microversion: 2.1 time: 0.164166 Oct 17 14:35:17.069149 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3422/6705] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:35:16 2022] GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb => generated 1675 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:35:18.092360 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-44423665-6ad0-43b4-867b-6f01a62f7771 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:35:18.093020 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-44423665-6ad0-43b4-867b-6f01a62f7771 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: cda83126-328f-4131-995d-a3ed5e64f5cb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:35:18.100351 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-44423665-6ad0-43b4-867b-6f01a62f7771 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:18.100835 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-44423665-6ad0-43b4-867b-6f01a62f7771 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:18.101277 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-44423665-6ad0-43b4-867b-6f01a62f7771 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:18.102015 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-44423665-6ad0-43b4-867b-6f01a62f7771 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:18.102473 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-44423665-6ad0-43b4-867b-6f01a62f7771 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:18.102901 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-44423665-6ad0-43b4-867b-6f01a62f7771 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:18.245926 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-44423665-6ad0-43b4-867b-6f01a62f7771 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:35:18.254510 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-44423665-6ad0-43b4-867b-6f01a62f7771 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb" status: 200 len: 1675 microversion: 2.1 time: 0.166177 Oct 17 14:35:18.255112 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3284/6706] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:35:18 2022] GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb => generated 1675 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:35:19.278614 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ee3fea7d-6e4a-4ba3-840d-07b5c1977690 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:35:19.279453 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ee3fea7d-6e4a-4ba3-840d-07b5c1977690 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: cda83126-328f-4131-995d-a3ed5e64f5cb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:35:19.287372 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ee3fea7d-6e4a-4ba3-840d-07b5c1977690 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:19.287900 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ee3fea7d-6e4a-4ba3-840d-07b5c1977690 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:19.288491 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ee3fea7d-6e4a-4ba3-840d-07b5c1977690 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:19.289203 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ee3fea7d-6e4a-4ba3-840d-07b5c1977690 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:19.289650 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ee3fea7d-6e4a-4ba3-840d-07b5c1977690 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:19.290065 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ee3fea7d-6e4a-4ba3-840d-07b5c1977690 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:19.790848 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ee3fea7d-6e4a-4ba3-840d-07b5c1977690 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:35:19.794484 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:35:19.799397 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ee3fea7d-6e4a-4ba3-840d-07b5c1977690 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb" status: 200 len: 1675 microversion: 2.1 time: 0.524839 Oct 17 14:35:19.799985 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3423/6707] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:35:19 2022] GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb => generated 1675 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:35:20.130198 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-77051835-9739-4d20-9dbd-e399fbea8fae req-c4f16689-94ee-4472-bd6e-68c2d1b19a0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cda83126-328f-4131-995d-a3ed5e64f5cb", "tag": "35d9e15c-6506-4aa1-8a37-b456582f4f26"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:35:20.141168 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-77051835-9739-4d20-9dbd-e399fbea8fae req-c4f16689-94ee-4472-bd6e-68c2d1b19a0f service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:20.141726 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-77051835-9739-4d20-9dbd-e399fbea8fae req-c4f16689-94ee-4472-bd6e-68c2d1b19a0f service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:20.142237 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-77051835-9739-4d20-9dbd-e399fbea8fae req-c4f16689-94ee-4472-bd6e-68c2d1b19a0f service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:20.154347 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-77051835-9739-4d20-9dbd-e399fbea8fae req-c4f16689-94ee-4472-bd6e-68c2d1b19a0f service nova] Creating event network-changed:35d9e15c-6506-4aa1-8a37-b456582f4f26 for instance cda83126-328f-4131-995d-a3ed5e64f5cb on n-h2-854247-14 Oct 17 14:35:20.160193 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [req-77051835-9739-4d20-9dbd-e399fbea8fae req-c4f16689-94ee-4472-bd6e-68c2d1b19a0f service nova] Instance cda83126-328f-4131-995d-a3ed5e64f5cb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854247-14', 'n-h2-854247-14'} {{(pid=127017) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 14:35:20.171684 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-77051835-9739-4d20-9dbd-e399fbea8fae req-c4f16689-94ee-4472-bd6e-68c2d1b19a0f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045380 Oct 17 14:35:20.172268 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3285/6708] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:35:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:35:20.823159 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ef4521a2-daee-4785-b93f-3d046da41839 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:35:20.823887 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ef4521a2-daee-4785-b93f-3d046da41839 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: cda83126-328f-4131-995d-a3ed5e64f5cb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:35:20.832808 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ef4521a2-daee-4785-b93f-3d046da41839 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:20.833600 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ef4521a2-daee-4785-b93f-3d046da41839 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:20.834227 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ef4521a2-daee-4785-b93f-3d046da41839 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:20.834910 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ef4521a2-daee-4785-b93f-3d046da41839 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:20.835420 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ef4521a2-daee-4785-b93f-3d046da41839 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:20.835843 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ef4521a2-daee-4785-b93f-3d046da41839 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:21.053105 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ef4521a2-daee-4785-b93f-3d046da41839 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:35:21.061360 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ef4521a2-daee-4785-b93f-3d046da41839 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb" status: 200 len: 1675 microversion: 2.1 time: 0.242189 Oct 17 14:35:21.061957 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3424/6709] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:35:20 2022] GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb => generated 1675 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:35:22.089572 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2ea8d39c-5ddd-4fff-b3f1-c7cfdf2d4686 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:35:22.090799 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2ea8d39c-5ddd-4fff-b3f1-c7cfdf2d4686 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: cda83126-328f-4131-995d-a3ed5e64f5cb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:35:22.100285 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2ea8d39c-5ddd-4fff-b3f1-c7cfdf2d4686 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:22.100790 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2ea8d39c-5ddd-4fff-b3f1-c7cfdf2d4686 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:22.101242 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2ea8d39c-5ddd-4fff-b3f1-c7cfdf2d4686 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:22.101956 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2ea8d39c-5ddd-4fff-b3f1-c7cfdf2d4686 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:22.102416 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2ea8d39c-5ddd-4fff-b3f1-c7cfdf2d4686 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:22.102853 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2ea8d39c-5ddd-4fff-b3f1-c7cfdf2d4686 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:22.316425 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2ea8d39c-5ddd-4fff-b3f1-c7cfdf2d4686 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:35:22.320095 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:35:22.325456 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2ea8d39c-5ddd-4fff-b3f1-c7cfdf2d4686 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb" status: 200 len: 1675 microversion: 2.1 time: 0.242965 Oct 17 14:35:22.326039 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3286/6710] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:35:22 2022] GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb => generated 1675 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:35:23.352425 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7bdc54a3-1004-49b3-b56e-5710def96a66 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:35:23.353186 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7bdc54a3-1004-49b3-b56e-5710def96a66 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: cda83126-328f-4131-995d-a3ed5e64f5cb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:35:23.357484 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:35:23.365403 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7bdc54a3-1004-49b3-b56e-5710def96a66 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:23.365977 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7bdc54a3-1004-49b3-b56e-5710def96a66 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:23.366460 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7bdc54a3-1004-49b3-b56e-5710def96a66 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:23.367207 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7bdc54a3-1004-49b3-b56e-5710def96a66 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:23.367672 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7bdc54a3-1004-49b3-b56e-5710def96a66 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:23.368097 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7bdc54a3-1004-49b3-b56e-5710def96a66 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:23.511793 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7bdc54a3-1004-49b3-b56e-5710def96a66 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:35:23.524907 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7bdc54a3-1004-49b3-b56e-5710def96a66 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb" status: 200 len: 1668 microversion: 2.1 time: 0.178670 Oct 17 14:35:23.525782 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3425/6711] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:35:23 2022] GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb => generated 1668 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:35:23.550819 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-588e4392-9f17-423c-a2a1-86a18a1a98b0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:35:23.551468 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-588e4392-9f17-423c-a2a1-86a18a1a98b0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: cda83126-328f-4131-995d-a3ed5e64f5cb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:35:23.554646 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=37 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:35:23.560913 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-588e4392-9f17-423c-a2a1-86a18a1a98b0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:23.561412 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-588e4392-9f17-423c-a2a1-86a18a1a98b0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:23.561861 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-588e4392-9f17-423c-a2a1-86a18a1a98b0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:23.562595 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-588e4392-9f17-423c-a2a1-86a18a1a98b0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:23.563052 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-588e4392-9f17-423c-a2a1-86a18a1a98b0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:23.563512 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-588e4392-9f17-423c-a2a1-86a18a1a98b0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:23.694225 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-588e4392-9f17-423c-a2a1-86a18a1a98b0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:35:23.707234 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-588e4392-9f17-423c-a2a1-86a18a1a98b0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb" status: 200 len: 1668 microversion: 2.1 time: 0.160175 Oct 17 14:35:23.708193 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3287/6712] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:35:23 2022] GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb => generated 1668 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:35:23.734917 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-371c4cf3-190e-4b2d-98b7-8941b5576ba2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:35:23.735566 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-371c4cf3-190e-4b2d-98b7-8941b5576ba2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: cda83126-328f-4131-995d-a3ed5e64f5cb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:35:23.742173 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-371c4cf3-190e-4b2d-98b7-8941b5576ba2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:23.742660 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-371c4cf3-190e-4b2d-98b7-8941b5576ba2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:23.743098 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-371c4cf3-190e-4b2d-98b7-8941b5576ba2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:23.743818 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-371c4cf3-190e-4b2d-98b7-8941b5576ba2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:23.744271 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-371c4cf3-190e-4b2d-98b7-8941b5576ba2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:23.744701 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-371c4cf3-190e-4b2d-98b7-8941b5576ba2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:23.897646 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-371c4cf3-190e-4b2d-98b7-8941b5576ba2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:35:23.909812 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-371c4cf3-190e-4b2d-98b7-8941b5576ba2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb" status: 200 len: 1668 microversion: 2.1 time: 0.178725 Oct 17 14:35:23.910705 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3426/6713] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:35:23 2022] GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb => generated 1668 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:35:23.937213 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-696ca9a6-9325-4040-b772-3e9bfa391595 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:35:23.937720 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-696ca9a6-9325-4040-b772-3e9bfa391595 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: cda83126-328f-4131-995d-a3ed5e64f5cb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:35:23.944161 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-696ca9a6-9325-4040-b772-3e9bfa391595 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:23.944627 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-696ca9a6-9325-4040-b772-3e9bfa391595 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:23.945098 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-696ca9a6-9325-4040-b772-3e9bfa391595 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:23.945796 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-696ca9a6-9325-4040-b772-3e9bfa391595 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:23.946251 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-696ca9a6-9325-4040-b772-3e9bfa391595 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:23.946684 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-696ca9a6-9325-4040-b772-3e9bfa391595 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:23.975971 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-696ca9a6-9325-4040-b772-3e9bfa391595 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: cda83126-328f-4131-995d-a3ed5e64f5cb] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:35:24.057403 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-696ca9a6-9325-4040-b772-3e9bfa391595 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "DELETE /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb" status: 204 len: 0 microversion: 2.1 time: 0.123870 Oct 17 14:35:24.058051 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3288/6714] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:35:23 2022] DELETE /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:35:24.068267 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9c2ce098-ae60-468c-aabb-4cc41081b8c8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:35:24.068893 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9c2ce098-ae60-468c-aabb-4cc41081b8c8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: cda83126-328f-4131-995d-a3ed5e64f5cb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:35:24.075316 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c2ce098-ae60-468c-aabb-4cc41081b8c8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:24.075810 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c2ce098-ae60-468c-aabb-4cc41081b8c8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:24.076249 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c2ce098-ae60-468c-aabb-4cc41081b8c8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:24.076948 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c2ce098-ae60-468c-aabb-4cc41081b8c8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:24.077404 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c2ce098-ae60-468c-aabb-4cc41081b8c8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:24.077831 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c2ce098-ae60-468c-aabb-4cc41081b8c8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:24.217902 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9c2ce098-ae60-468c-aabb-4cc41081b8c8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:35:24.226023 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9c2ce098-ae60-468c-aabb-4cc41081b8c8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb" status: 200 len: 1674 microversion: 2.1 time: 0.162833 Oct 17 14:35:24.226612 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3427/6715] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:35:24 2022] GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:35:24.630652 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-3dd47264-4411-4eed-9e84-cae5d539c000 req-086e8e77-c8a4-4dd3-9bea-344f6bacad20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cda83126-328f-4131-995d-a3ed5e64f5cb", "name": "network-vif-plugged", "status": "completed", "tag": "35d9e15c-6506-4aa1-8a37-b456582f4f26"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:35:24.643056 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-3dd47264-4411-4eed-9e84-cae5d539c000 req-086e8e77-c8a4-4dd3-9bea-344f6bacad20 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:24.643573 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-3dd47264-4411-4eed-9e84-cae5d539c000 req-086e8e77-c8a4-4dd3-9bea-344f6bacad20 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:24.644241 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-3dd47264-4411-4eed-9e84-cae5d539c000 req-086e8e77-c8a4-4dd3-9bea-344f6bacad20 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:24.656327 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-3dd47264-4411-4eed-9e84-cae5d539c000 req-086e8e77-c8a4-4dd3-9bea-344f6bacad20 service nova] Creating event network-vif-plugged:35d9e15c-6506-4aa1-8a37-b456582f4f26 for instance cda83126-328f-4131-995d-a3ed5e64f5cb on n-h2-854247-14 Oct 17 14:35:24.661672 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-3dd47264-4411-4eed-9e84-cae5d539c000 req-086e8e77-c8a4-4dd3-9bea-344f6bacad20 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035368 Oct 17 14:35:24.662302 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3289/6716] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:35:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:35:25.249795 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d67ea1bd-f8e9-458c-ba6c-e08ae2e2716e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:35:25.250474 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d67ea1bd-f8e9-458c-ba6c-e08ae2e2716e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: cda83126-328f-4131-995d-a3ed5e64f5cb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:35:25.258120 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d67ea1bd-f8e9-458c-ba6c-e08ae2e2716e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:25.258611 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d67ea1bd-f8e9-458c-ba6c-e08ae2e2716e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:25.259078 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d67ea1bd-f8e9-458c-ba6c-e08ae2e2716e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:25.259822 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d67ea1bd-f8e9-458c-ba6c-e08ae2e2716e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:25.260278 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d67ea1bd-f8e9-458c-ba6c-e08ae2e2716e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:25.260716 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d67ea1bd-f8e9-458c-ba6c-e08ae2e2716e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:25.483373 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d67ea1bd-f8e9-458c-ba6c-e08ae2e2716e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:35:25.492236 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d67ea1bd-f8e9-458c-ba6c-e08ae2e2716e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb" status: 200 len: 1674 microversion: 2.1 time: 0.246590 Oct 17 14:35:25.492914 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3428/6717] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:35:25 2022] GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb => generated 1674 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:35:26.270252 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-ed0f3ae9-79f4-4553-a901-983e3ca839d3 req-94384709-0d64-45ab-a470-9f1ec662a718 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cda83126-328f-4131-995d-a3ed5e64f5cb", "name": "network-vif-deleted", "tag": "35d9e15c-6506-4aa1-8a37-b456582f4f26"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:35:26.286759 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-ed0f3ae9-79f4-4553-a901-983e3ca839d3 req-94384709-0d64-45ab-a470-9f1ec662a718 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:26.287457 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-ed0f3ae9-79f4-4553-a901-983e3ca839d3 req-94384709-0d64-45ab-a470-9f1ec662a718 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:26.288017 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-ed0f3ae9-79f4-4553-a901-983e3ca839d3 req-94384709-0d64-45ab-a470-9f1ec662a718 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:26.300682 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-ed0f3ae9-79f4-4553-a901-983e3ca839d3 req-94384709-0d64-45ab-a470-9f1ec662a718 service nova] Creating event network-vif-deleted:35d9e15c-6506-4aa1-8a37-b456582f4f26 for instance cda83126-328f-4131-995d-a3ed5e64f5cb on n-h2-854247-14 Oct 17 14:35:26.305758 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-ed0f3ae9-79f4-4553-a901-983e3ca839d3 req-94384709-0d64-45ab-a470-9f1ec662a718 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044309 Oct 17 14:35:26.307237 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3290/6718] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:35:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:35:26.516900 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b7a47fb4-8856-4493-9f7c-7102cc8ade73 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:35:26.517896 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b7a47fb4-8856-4493-9f7c-7102cc8ade73 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: cda83126-328f-4131-995d-a3ed5e64f5cb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:35:26.520297 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=3 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:35:26.526997 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b7a47fb4-8856-4493-9f7c-7102cc8ade73 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:26.527613 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b7a47fb4-8856-4493-9f7c-7102cc8ade73 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:26.528049 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b7a47fb4-8856-4493-9f7c-7102cc8ade73 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:26.528747 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b7a47fb4-8856-4493-9f7c-7102cc8ade73 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:26.529198 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b7a47fb4-8856-4493-9f7c-7102cc8ade73 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:26.529614 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b7a47fb4-8856-4493-9f7c-7102cc8ade73 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:26.564232 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b7a47fb4-8856-4493-9f7c-7102cc8ade73 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:26.564478 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b7a47fb4-8856-4493-9f7c-7102cc8ade73 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:26.564942 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b7a47fb4-8856-4493-9f7c-7102cc8ade73 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:26.565379 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-b7a47fb4-8856-4493-9f7c-7102cc8ade73 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lazy-loading 'fault' on Instance uuid cda83126-328f-4131-995d-a3ed5e64f5cb {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:35:26.610825 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b7a47fb4-8856-4493-9f7c-7102cc8ade73 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:35:26.620020 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b7a47fb4-8856-4493-9f7c-7102cc8ade73 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb" status: 200 len: 1328 microversion: 2.1 time: 0.107389 Oct 17 14:35:26.620904 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3429/6719] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:35:26 2022] GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb => generated 1328 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:35:27.651220 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-78696527-d4a4-4b1f-b568-80603eeb7241 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:35:27.651925 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-78696527-d4a4-4b1f-b568-80603eeb7241 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: cda83126-328f-4131-995d-a3ed5e64f5cb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:35:27.661463 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-78696527-d4a4-4b1f-b568-80603eeb7241 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:27.662158 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-78696527-d4a4-4b1f-b568-80603eeb7241 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:27.662675 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-78696527-d4a4-4b1f-b568-80603eeb7241 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:27.663744 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-78696527-d4a4-4b1f-b568-80603eeb7241 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:27.664332 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-78696527-d4a4-4b1f-b568-80603eeb7241 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:27.664893 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-78696527-d4a4-4b1f-b568-80603eeb7241 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:27.681172 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-78696527-d4a4-4b1f-b568-80603eeb7241 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] HTTP exception thrown: Instance cda83126-328f-4131-995d-a3ed5e64f5cb could not be found. Oct 17 14:35:27.682813 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-78696527-d4a4-4b1f-b568-80603eeb7241 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Request method failure captured: Oct 17 14:35:27.682813 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb HTTP/1.1 Oct 17 14:35:27.682813 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 14:35:27.682813 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 14:35:27.682813 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 14:35:27.682813 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 14:35:27.682813 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 14:35:27.682813 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 14:35:27.682813 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 14:35:27.682813 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 14:35:27.682813 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTWdVpabWT0Tbgf-QQ83Tq8AQGY8AcL_35cr_ansrTOmg5gYS9o-61drx7tYvn26ecQi5aoad2YeNf-Jm0l5MKteHOkMgnybFs17aOJ7G5iYUyXMaYulLqf3oAKSRqw_FkZniUVR3fFPKjmYjBguT22mJaxMSuqSX_P9X-IGsLXSZ0Uc Oct 17 14:35:27.682813 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 14:35:27.682813 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 14:35:27.682813 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 14:35:27.682813 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 14:35:27.682813 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 14:35:27.682813 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 14:35:27.682813 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 6312d6ad74bb476384426e63c1ec7ae5 Oct 17 14:35:27.682813 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServerActionsTestJSON-207618724 Oct 17 14:35:27.682813 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 14:35:27.682813 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 14:35:27.682813 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6312d6ad74bb476384426e63c1ec7ae5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6312d6ad74bb476384426e63c1ec7ae5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6312d6ad74bb476384426e63c1ec7ae5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6312d6ad74bb476384426e63c1ec7ae5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:35:27.682813 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServerActionsTestJSON-207618724 Oct 17 14:35:27.682813 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 6312d6ad74bb476384426e63c1ec7ae5 Oct 17 14:35:27.682813 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServerActionsTestJSON-207618724 Oct 17 14:35:27.682813 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServerActionsTestJSON-207618724-project Oct 17 14:35:27.682813 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 14:35:27.682813 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 14:35:27.682813 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: ad69a4e71c9e425fac89ec047eda43de Oct 17 14:35:27.682813 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServerActionsTestJSON-207618724-project Oct 17 14:35:27.682813 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 14:35:27.682813 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance cda83126-328f-4131-995d-a3ed5e64f5cb could not be found. Oct 17 14:35:27.682813 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'cda83126-328f-4131-995d-a3ed5e64f5cb'} Oct 17 14:35:27.682813 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:35:27.682813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:35:27.682813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:35:27.682813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:35:27.682813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:35:27.682813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:35:27.682813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:35:27.682813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:35:27.682813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:35:27.682813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:35:27.682813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cda83126-328f-4131-995d-a3ed5e64f5cb could not be found. Oct 17 14:35:27.682813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:35:27.682813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:35:27.682813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:35:27.682813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:35:27.682813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:35:27.682813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:35:27.682813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:35:27.682813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:35:27.682813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:35:27.682813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:35:27.682813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:35:27.682813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:35:27.682813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:35:27.682813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:35:27.682813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:35:27.682813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:35:27.682813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cda83126-328f-4131-995d-a3ed5e64f5cb could not be found. Oct 17 14:35:27.682813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:35:27.682813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:35:27.682813 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:35:27.687506 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:35:27.687506 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:35:27.687506 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:35:27.687506 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:35:27.687506 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:35:27.687506 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cda83126-328f-4131-995d-a3ed5e64f5cb could not be found. Oct 17 14:35:27.687506 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:35:27.687506 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-78696527-d4a4-4b1f-b568-80603eeb7241 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Returning 404 to user: Instance cda83126-328f-4131-995d-a3ed5e64f5cb could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:35:27.687506 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-78696527-d4a4-4b1f-b568-80603eeb7241 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb" status: 404 len: 111 microversion: 2.1 time: 0.042313 Oct 17 14:35:27.687506 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3291/6720] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:35:27 2022] GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:35:27.701363 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d8a0bdf4-c381-4818-8ff1-602209dc7de2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:35:27.701980 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d8a0bdf4-c381-4818-8ff1-602209dc7de2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: cda83126-328f-4131-995d-a3ed5e64f5cb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:35:27.709238 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d8a0bdf4-c381-4818-8ff1-602209dc7de2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:27.709723 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d8a0bdf4-c381-4818-8ff1-602209dc7de2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:27.710155 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d8a0bdf4-c381-4818-8ff1-602209dc7de2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:27.710854 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d8a0bdf4-c381-4818-8ff1-602209dc7de2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:27.711359 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d8a0bdf4-c381-4818-8ff1-602209dc7de2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:27.711784 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d8a0bdf4-c381-4818-8ff1-602209dc7de2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:27.725431 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-d8a0bdf4-c381-4818-8ff1-602209dc7de2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] HTTP exception thrown: Instance cda83126-328f-4131-995d-a3ed5e64f5cb could not be found. Oct 17 14:35:27.727129 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d8a0bdf4-c381-4818-8ff1-602209dc7de2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Request method failure captured: Oct 17 14:35:27.727129 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb HTTP/1.1 Oct 17 14:35:27.727129 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 14:35:27.727129 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 14:35:27.727129 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 14:35:27.727129 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 14:35:27.727129 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 14:35:27.727129 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 14:35:27.727129 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 14:35:27.727129 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 14:35:27.727129 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTWdVpabWT0Tbgf-QQ83Tq8AQGY8AcL_35cr_ansrTOmg5gYS9o-61drx7tYvn26ecQi5aoad2YeNf-Jm0l5MKteHOkMgnybFs17aOJ7G5iYUyXMaYulLqf3oAKSRqw_FkZniUVR3fFPKjmYjBguT22mJaxMSuqSX_P9X-IGsLXSZ0Uc Oct 17 14:35:27.727129 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 14:35:27.727129 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 14:35:27.727129 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 14:35:27.727129 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 14:35:27.727129 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 14:35:27.727129 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 14:35:27.727129 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 6312d6ad74bb476384426e63c1ec7ae5 Oct 17 14:35:27.727129 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServerActionsTestJSON-207618724 Oct 17 14:35:27.727129 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 14:35:27.727129 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 14:35:27.727129 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6312d6ad74bb476384426e63c1ec7ae5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6312d6ad74bb476384426e63c1ec7ae5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6312d6ad74bb476384426e63c1ec7ae5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6312d6ad74bb476384426e63c1ec7ae5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:35:27.727129 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServerActionsTestJSON-207618724 Oct 17 14:35:27.727129 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 6312d6ad74bb476384426e63c1ec7ae5 Oct 17 14:35:27.727129 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServerActionsTestJSON-207618724 Oct 17 14:35:27.727129 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServerActionsTestJSON-207618724-project Oct 17 14:35:27.727129 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 14:35:27.727129 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 14:35:27.727129 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: ad69a4e71c9e425fac89ec047eda43de Oct 17 14:35:27.727129 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServerActionsTestJSON-207618724-project Oct 17 14:35:27.727129 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 14:35:27.727129 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance cda83126-328f-4131-995d-a3ed5e64f5cb could not be found. Oct 17 14:35:27.727129 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'cda83126-328f-4131-995d-a3ed5e64f5cb'} Oct 17 14:35:27.727129 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:35:27.727129 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:35:27.727129 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:35:27.727129 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:35:27.727129 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:35:27.727129 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:35:27.727129 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:35:27.727129 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:35:27.727129 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:35:27.727129 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:35:27.727129 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cda83126-328f-4131-995d-a3ed5e64f5cb could not be found. Oct 17 14:35:27.727129 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:35:27.727129 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:35:27.727129 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:35:27.727129 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:35:27.727129 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:35:27.727129 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:35:27.727129 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:35:27.727129 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:35:27.727129 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:35:27.727129 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:35:27.727129 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:35:27.727129 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:35:27.727129 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:35:27.727129 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:35:27.727129 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:35:27.727129 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:35:27.727129 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cda83126-328f-4131-995d-a3ed5e64f5cb could not be found. Oct 17 14:35:27.727129 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:35:27.727129 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:35:27.727129 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:35:27.731528 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:35:27.731528 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:35:27.731528 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:35:27.731528 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:35:27.731528 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:35:27.731528 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cda83126-328f-4131-995d-a3ed5e64f5cb could not be found. Oct 17 14:35:27.731528 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:35:27.731528 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d8a0bdf4-c381-4818-8ff1-602209dc7de2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Returning 404 to user: Instance cda83126-328f-4131-995d-a3ed5e64f5cb could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:35:27.731528 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d8a0bdf4-c381-4818-8ff1-602209dc7de2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb" status: 404 len: 111 microversion: 2.1 time: 0.031182 Oct 17 14:35:27.731528 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3430/6721] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:35:27 2022] GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:35:27.782800 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3c918bac-c27f-493b-9250-e682fe6c6f1d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1481329955", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "8df58892-60b4-4970-b9bf-0ee8a509c119"}], "security_groups": [{"name": "tempest-securitygroup--1788546303"}], "key_name": "tempest-keypair-533599217", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:35:27.896347 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-3c918bac-c27f-493b-9250-e682fe6c6f1d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] validate_networks() for [('8df58892-60b4-4970-b9bf-0ee8a509c119', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:35:28.293743 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-3c918bac-c27f-493b-9250-e682fe6c6f1d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:35:28.294179 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-3c918bac-c27f-493b-9250-e682fe6c6f1d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:35:28.294687 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-3c918bac-c27f-493b-9250-e682fe6c6f1d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:35:28.295107 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-3c918bac-c27f-493b-9250-e682fe6c6f1d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:35:28.295568 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-3c918bac-c27f-493b-9250-e682fe6c6f1d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:35:28.305680 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3c918bac-c27f-493b-9250-e682fe6c6f1d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:28.306184 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3c918bac-c27f-493b-9250-e682fe6c6f1d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:28.306637 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3c918bac-c27f-493b-9250-e682fe6c6f1d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:28.307415 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3c918bac-c27f-493b-9250-e682fe6c6f1d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:28.307889 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3c918bac-c27f-493b-9250-e682fe6c6f1d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:28.308332 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3c918bac-c27f-493b-9250-e682fe6c6f1d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:28.326747 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-3c918bac-c27f-493b-9250-e682fe6c6f1d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Getting quotas for project 6312d6ad74bb476384426e63c1ec7ae5. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:35:28.332781 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-3c918bac-c27f-493b-9250-e682fe6c6f1d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Getting quotas for user ad69a4e71c9e425fac89ec047eda43de and project 6312d6ad74bb476384426e63c1ec7ae5. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:35:28.346664 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3c918bac-c27f-493b-9250-e682fe6c6f1d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:35:28.349145 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3c918bac-c27f-493b-9250-e682fe6c6f1d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:35:28.401470 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3c918bac-c27f-493b-9250-e682fe6c6f1d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.624684 Oct 17 14:35:28.402113 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3292/6722] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 14:35:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:35:28.414093 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9e4e58be-b29f-4e25-aad7-e0dae907bc0b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:35:28.414709 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9e4e58be-b29f-4e25-aad7-e0dae907bc0b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:35:28.469894 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9e4e58be-b29f-4e25-aad7-e0dae907bc0b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:35:28.477609 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9e4e58be-b29f-4e25-aad7-e0dae907bc0b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1238 microversion: 2.1 time: 0.067424 Oct 17 14:35:28.478219 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3431/6723] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:35:28 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1238 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:35:29.501385 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ca5ff3ea-7cdc-468e-b7d9-167568fa1e75 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:35:29.502138 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ca5ff3ea-7cdc-468e-b7d9-167568fa1e75 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:35:29.510018 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ca5ff3ea-7cdc-468e-b7d9-167568fa1e75 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:29.510828 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ca5ff3ea-7cdc-468e-b7d9-167568fa1e75 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:29.511501 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ca5ff3ea-7cdc-468e-b7d9-167568fa1e75 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:29.512541 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ca5ff3ea-7cdc-468e-b7d9-167568fa1e75 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:29.512995 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ca5ff3ea-7cdc-468e-b7d9-167568fa1e75 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:29.513590 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ca5ff3ea-7cdc-468e-b7d9-167568fa1e75 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:29.579138 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ca5ff3ea-7cdc-468e-b7d9-167568fa1e75 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:35:29.588274 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ca5ff3ea-7cdc-468e-b7d9-167568fa1e75 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1308 microversion: 2.1 time: 0.090897 Oct 17 14:35:29.588905 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3293/6724] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:35:29 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1308 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:35:30.613340 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-58e81509-9add-4c58-a929-a4aa1c7137c0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:35:30.614573 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-58e81509-9add-4c58-a929-a4aa1c7137c0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:35:30.623347 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-58e81509-9add-4c58-a929-a4aa1c7137c0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:30.623834 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-58e81509-9add-4c58-a929-a4aa1c7137c0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:30.624268 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-58e81509-9add-4c58-a929-a4aa1c7137c0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:30.625016 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-58e81509-9add-4c58-a929-a4aa1c7137c0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:30.625460 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-58e81509-9add-4c58-a929-a4aa1c7137c0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:30.625875 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-58e81509-9add-4c58-a929-a4aa1c7137c0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:30.763867 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-58e81509-9add-4c58-a929-a4aa1c7137c0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:35:30.772511 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-58e81509-9add-4c58-a929-a4aa1c7137c0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1364 microversion: 2.1 time: 0.163263 Oct 17 14:35:30.773064 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3432/6725] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:35:30 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:35:30.886564 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-a31cc8ba-31c4-4d1b-81dd-45890a660c04 req-1e3af453-3ef2-41f7-9e67-ecbdaca75cdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcf4b7ae-0a6f-4a5e-a607-463e2354615c", "tag": "2524073a-3e43-497d-a3d9-b7266a8a4bd1"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:35:30.900954 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-a31cc8ba-31c4-4d1b-81dd-45890a660c04 req-1e3af453-3ef2-41f7-9e67-ecbdaca75cdc service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:30.901313 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-a31cc8ba-31c4-4d1b-81dd-45890a660c04 req-1e3af453-3ef2-41f7-9e67-ecbdaca75cdc service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:30.901764 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-a31cc8ba-31c4-4d1b-81dd-45890a660c04 req-1e3af453-3ef2-41f7-9e67-ecbdaca75cdc service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:30.914624 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-a31cc8ba-31c4-4d1b-81dd-45890a660c04 req-1e3af453-3ef2-41f7-9e67-ecbdaca75cdc service nova] Creating event network-changed:2524073a-3e43-497d-a3d9-b7266a8a4bd1 for instance dcf4b7ae-0a6f-4a5e-a607-463e2354615c on n-h1-854247-14 Oct 17 14:35:30.919810 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-a31cc8ba-31c4-4d1b-81dd-45890a660c04 req-1e3af453-3ef2-41f7-9e67-ecbdaca75cdc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038112 Oct 17 14:35:30.920445 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3294/6726] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:35:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:35:31.800750 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7f844d15-d8e7-44fd-ab5b-19e07b4b0ca8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:35:31.801622 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7f844d15-d8e7-44fd-ab5b-19e07b4b0ca8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:35:31.813159 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7f844d15-d8e7-44fd-ab5b-19e07b4b0ca8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:31.814054 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7f844d15-d8e7-44fd-ab5b-19e07b4b0ca8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:31.814490 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7f844d15-d8e7-44fd-ab5b-19e07b4b0ca8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:31.815185 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7f844d15-d8e7-44fd-ab5b-19e07b4b0ca8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:31.815646 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7f844d15-d8e7-44fd-ab5b-19e07b4b0ca8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:31.816061 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7f844d15-d8e7-44fd-ab5b-19e07b4b0ca8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:31.961240 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7f844d15-d8e7-44fd-ab5b-19e07b4b0ca8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:35:31.973033 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7f844d15-d8e7-44fd-ab5b-19e07b4b0ca8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1364 microversion: 2.1 time: 0.179042 Oct 17 14:35:31.973617 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3433/6727] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:35:31 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1364 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:35:33.002824 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-be2f3638-a564-4651-9361-8f9755ac760b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:35:33.003346 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-be2f3638-a564-4651-9361-8f9755ac760b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:35:33.010940 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-be2f3638-a564-4651-9361-8f9755ac760b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:33.011596 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-be2f3638-a564-4651-9361-8f9755ac760b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:33.012484 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-be2f3638-a564-4651-9361-8f9755ac760b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:33.013360 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-be2f3638-a564-4651-9361-8f9755ac760b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:33.013943 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-be2f3638-a564-4651-9361-8f9755ac760b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:33.014484 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-be2f3638-a564-4651-9361-8f9755ac760b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:33.162022 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-be2f3638-a564-4651-9361-8f9755ac760b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:35:33.170326 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-be2f3638-a564-4651-9361-8f9755ac760b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1364 microversion: 2.1 time: 0.175882 Oct 17 14:35:33.170883 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3295/6728] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:35:32 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:35:34.194952 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a2788b4f-0aea-4625-96a2-ce37a5347ad9 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:35:34.195550 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a2788b4f-0aea-4625-96a2-ce37a5347ad9 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:35:34.203086 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a2788b4f-0aea-4625-96a2-ce37a5347ad9 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:34.203609 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a2788b4f-0aea-4625-96a2-ce37a5347ad9 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:34.204105 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a2788b4f-0aea-4625-96a2-ce37a5347ad9 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:34.204738 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a2788b4f-0aea-4625-96a2-ce37a5347ad9 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:34.205219 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a2788b4f-0aea-4625-96a2-ce37a5347ad9 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:34.205647 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a2788b4f-0aea-4625-96a2-ce37a5347ad9 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:34.342174 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a2788b4f-0aea-4625-96a2-ce37a5347ad9 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:35:34.351495 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a2788b4f-0aea-4625-96a2-ce37a5347ad9 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1364 microversion: 2.1 time: 0.160408 Oct 17 14:35:34.351998 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3434/6729] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:35:34 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:35:35.206459 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-8eef3f66-d3f1-4968-b793-2d933f31b6d2 req-e708fb55-ee75-406b-8d30-173ec241f3a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcf4b7ae-0a6f-4a5e-a607-463e2354615c", "name": "network-vif-plugged", "status": "completed", "tag": "2524073a-3e43-497d-a3d9-b7266a8a4bd1"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:35:35.218217 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-8eef3f66-d3f1-4968-b793-2d933f31b6d2 req-e708fb55-ee75-406b-8d30-173ec241f3a2 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:35.218711 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-8eef3f66-d3f1-4968-b793-2d933f31b6d2 req-e708fb55-ee75-406b-8d30-173ec241f3a2 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:35.219315 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-8eef3f66-d3f1-4968-b793-2d933f31b6d2 req-e708fb55-ee75-406b-8d30-173ec241f3a2 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:35.230668 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-8eef3f66-d3f1-4968-b793-2d933f31b6d2 req-e708fb55-ee75-406b-8d30-173ec241f3a2 service nova] Creating event network-vif-plugged:2524073a-3e43-497d-a3d9-b7266a8a4bd1 for instance dcf4b7ae-0a6f-4a5e-a607-463e2354615c on n-h1-854247-14 Oct 17 14:35:35.235778 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-8eef3f66-d3f1-4968-b793-2d933f31b6d2 req-e708fb55-ee75-406b-8d30-173ec241f3a2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033128 Oct 17 14:35:35.236443 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3296/6730] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:35:35.375416 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-411a5956-0f57-49a5-9caa-3a473a0482e7 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:35:35.376093 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-411a5956-0f57-49a5-9caa-3a473a0482e7 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:35:35.383226 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-411a5956-0f57-49a5-9caa-3a473a0482e7 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:35.383715 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-411a5956-0f57-49a5-9caa-3a473a0482e7 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:35.384152 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-411a5956-0f57-49a5-9caa-3a473a0482e7 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:35.384849 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-411a5956-0f57-49a5-9caa-3a473a0482e7 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:35.385302 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-411a5956-0f57-49a5-9caa-3a473a0482e7 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:35.385725 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-411a5956-0f57-49a5-9caa-3a473a0482e7 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:35.542242 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-411a5956-0f57-49a5-9caa-3a473a0482e7 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:35:35.553049 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-411a5956-0f57-49a5-9caa-3a473a0482e7 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1364 microversion: 2.1 time: 0.181336 Oct 17 14:35:35.553824 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3435/6731] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:35:35 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1364 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:35:36.582096 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-64319b1f-f1ad-46ea-9d92-7ca5b0c08140 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:35:36.583211 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-64319b1f-f1ad-46ea-9d92-7ca5b0c08140 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:35:36.595129 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-64319b1f-f1ad-46ea-9d92-7ca5b0c08140 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:36.595819 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-64319b1f-f1ad-46ea-9d92-7ca5b0c08140 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:36.596281 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-64319b1f-f1ad-46ea-9d92-7ca5b0c08140 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:36.597007 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-64319b1f-f1ad-46ea-9d92-7ca5b0c08140 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:36.597479 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-64319b1f-f1ad-46ea-9d92-7ca5b0c08140 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:36.597915 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-64319b1f-f1ad-46ea-9d92-7ca5b0c08140 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:36.736136 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-64319b1f-f1ad-46ea-9d92-7ca5b0c08140 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:35:36.745415 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-64319b1f-f1ad-46ea-9d92-7ca5b0c08140 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1550 microversion: 2.1 time: 0.170343 Oct 17 14:35:36.746012 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3297/6732] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:35:36 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1550 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:35:36.770526 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8f8f460b-a2c8-486e-9171-f741a534762d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:35:36.771089 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8f8f460b-a2c8-486e-9171-f741a534762d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:35:36.777975 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8f8f460b-a2c8-486e-9171-f741a534762d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:36.778475 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8f8f460b-a2c8-486e-9171-f741a534762d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:36.778904 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8f8f460b-a2c8-486e-9171-f741a534762d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:36.779613 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8f8f460b-a2c8-486e-9171-f741a534762d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:36.780056 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8f8f460b-a2c8-486e-9171-f741a534762d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:36.780444 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8f8f460b-a2c8-486e-9171-f741a534762d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:36.859679 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8f8f460b-a2c8-486e-9171-f741a534762d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093690 Oct 17 14:35:36.860611 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3436/6733] 10.222.0.79 () {58 vars in 1275 bytes} [Mon Oct 17 14:35:36 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:35:38.224899 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-25ed6716-5f90-466f-ac9f-ef4303c36fbb req-099c19d0-74b5-411e-b6a0-cd82b4a8710c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcf4b7ae-0a6f-4a5e-a607-463e2354615c", "tag": "2524073a-3e43-497d-a3d9-b7266a8a4bd1"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:35:38.236266 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-25ed6716-5f90-466f-ac9f-ef4303c36fbb req-099c19d0-74b5-411e-b6a0-cd82b4a8710c service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:35:38.236806 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-25ed6716-5f90-466f-ac9f-ef4303c36fbb req-099c19d0-74b5-411e-b6a0-cd82b4a8710c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:35:38.237251 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-25ed6716-5f90-466f-ac9f-ef4303c36fbb req-099c19d0-74b5-411e-b6a0-cd82b4a8710c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:35:38.248377 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-25ed6716-5f90-466f-ac9f-ef4303c36fbb req-099c19d0-74b5-411e-b6a0-cd82b4a8710c service nova] Creating event network-changed:2524073a-3e43-497d-a3d9-b7266a8a4bd1 for instance dcf4b7ae-0a6f-4a5e-a607-463e2354615c on n-h1-854247-14 Oct 17 14:35:38.254198 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-25ed6716-5f90-466f-ac9f-ef4303c36fbb req-099c19d0-74b5-411e-b6a0-cd82b4a8710c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032755 Oct 17 14:35:38.254809 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3298/6734] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:35:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:36:12.534375 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:36:12.535464 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=27 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:36:12.536114 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=68 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:36:12.540032 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8c416a42-8396-4d07-8def-df732c34449a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:36:12.540656 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8c416a42-8396-4d07-8def-df732c34449a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:36:12.548299 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8c416a42-8396-4d07-8def-df732c34449a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:12.548783 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8c416a42-8396-4d07-8def-df732c34449a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:12.549223 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8c416a42-8396-4d07-8def-df732c34449a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:12.549912 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8c416a42-8396-4d07-8def-df732c34449a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:12.550365 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8c416a42-8396-4d07-8def-df732c34449a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:12.550795 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8c416a42-8396-4d07-8def-df732c34449a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:12.700980 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8c416a42-8396-4d07-8def-df732c34449a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:36:12.710476 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8c416a42-8396-4d07-8def-df732c34449a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1667 microversion: 2.1 time: 0.178149 Oct 17 14:36:12.711196 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3437/6735] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:36:12 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1667 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:36:12.736341 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-837ae51d-2622-44a3-9bf7-25c1a98d4c6e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "61dadf8c-6a20-47b3-87b1-b9fed0089b7d"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:36:12.739195 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-837ae51d-2622-44a3-9bf7-25c1a98d4c6e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:36:12.741365 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:36:12.742054 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=6 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:36:12.742876 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:36:12.743654 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:36:12.751026 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-837ae51d-2622-44a3-9bf7-25c1a98d4c6e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:12.751670 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-837ae51d-2622-44a3-9bf7-25c1a98d4c6e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:12.752117 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-837ae51d-2622-44a3-9bf7-25c1a98d4c6e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:12.752826 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-837ae51d-2622-44a3-9bf7-25c1a98d4c6e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:12.753284 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-837ae51d-2622-44a3-9bf7-25c1a98d4c6e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:12.753714 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-837ae51d-2622-44a3-9bf7-25c1a98d4c6e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:13.022182 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-837ae51d-2622-44a3-9bf7-25c1a98d4c6e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "POST /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.292339 Oct 17 14:36:13.023002 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3299/6736] 10.222.0.79 () {60 vars in 1323 bytes} [Mon Oct 17 14:36:12 2022] POST /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c/os-volume_attachments => generated 194 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:36:23.808609 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7c559faa-c0f3-4dac-8e9e-30f33aac5526 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:36:23.811143 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7c559faa-c0f3-4dac-8e9e-30f33aac5526 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:36:23.814228 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:36:23.814911 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=6 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:36:23.821303 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7c559faa-c0f3-4dac-8e9e-30f33aac5526 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:23.821799 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7c559faa-c0f3-4dac-8e9e-30f33aac5526 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:23.822235 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7c559faa-c0f3-4dac-8e9e-30f33aac5526 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:23.822963 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7c559faa-c0f3-4dac-8e9e-30f33aac5526 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:23.823435 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7c559faa-c0f3-4dac-8e9e-30f33aac5526 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:23.823858 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7c559faa-c0f3-4dac-8e9e-30f33aac5526 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:23.855276 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7c559faa-c0f3-4dac-8e9e-30f33aac5526 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:36:23.862184 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7c559faa-c0f3-4dac-8e9e-30f33aac5526 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Old instance type m1.heat2, new instance type m1.heat {{(pid=127016) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 17 14:36:23.870578 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-7c559faa-c0f3-4dac-8e9e-30f33aac5526 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:36:23.871001 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-7c559faa-c0f3-4dac-8e9e-30f33aac5526 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:36:23.871507 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-7c559faa-c0f3-4dac-8e9e-30f33aac5526 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:36:23.871915 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-7c559faa-c0f3-4dac-8e9e-30f33aac5526 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:36:23.872331 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-7c559faa-c0f3-4dac-8e9e-30f33aac5526 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:36:23.951714 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7c559faa-c0f3-4dac-8e9e-30f33aac5526 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "POST /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c/action" status: 202 len: 0 microversion: 2.1 time: 0.147066 Oct 17 14:36:23.952294 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3438/6737] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:36:23 2022] POST /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:36:23.961925 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6a28fc42-063f-44b4-8899-af920880bb78 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:36:23.962647 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6a28fc42-063f-44b4-8899-af920880bb78 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:36:23.966090 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:36:23.967303 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:36:23.975037 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6a28fc42-063f-44b4-8899-af920880bb78 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:23.975569 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6a28fc42-063f-44b4-8899-af920880bb78 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:23.976028 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6a28fc42-063f-44b4-8899-af920880bb78 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:23.976788 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6a28fc42-063f-44b4-8899-af920880bb78 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:23.977252 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6a28fc42-063f-44b4-8899-af920880bb78 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:23.977690 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6a28fc42-063f-44b4-8899-af920880bb78 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:24.124079 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6a28fc42-063f-44b4-8899-af920880bb78 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:36:24.132938 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6a28fc42-063f-44b4-8899-af920880bb78 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1722 microversion: 2.1 time: 0.175822 Oct 17 14:36:24.133525 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3300/6738] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:36:23 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:36:25.157964 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-db97f372-76b5-4d3d-aa3e-22aac26517fb tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:36:25.158800 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-db97f372-76b5-4d3d-aa3e-22aac26517fb tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:36:25.166412 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-db97f372-76b5-4d3d-aa3e-22aac26517fb tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:25.166952 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-db97f372-76b5-4d3d-aa3e-22aac26517fb tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:25.167426 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-db97f372-76b5-4d3d-aa3e-22aac26517fb tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:25.168136 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-db97f372-76b5-4d3d-aa3e-22aac26517fb tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:25.168592 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-db97f372-76b5-4d3d-aa3e-22aac26517fb tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:25.169026 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-db97f372-76b5-4d3d-aa3e-22aac26517fb tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:25.304932 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-db97f372-76b5-4d3d-aa3e-22aac26517fb tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:36:25.316186 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-db97f372-76b5-4d3d-aa3e-22aac26517fb tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1722 microversion: 2.1 time: 0.163426 Oct 17 14:36:25.316768 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3439/6739] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:36:25 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:36:26.340567 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-93307427-b7ab-4c1d-aff4-2acf8a94232b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:36:26.341207 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-93307427-b7ab-4c1d-aff4-2acf8a94232b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:36:26.349017 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-93307427-b7ab-4c1d-aff4-2acf8a94232b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:26.349445 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-93307427-b7ab-4c1d-aff4-2acf8a94232b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:26.349896 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-93307427-b7ab-4c1d-aff4-2acf8a94232b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:26.350616 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-93307427-b7ab-4c1d-aff4-2acf8a94232b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:26.351105 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-93307427-b7ab-4c1d-aff4-2acf8a94232b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:26.351582 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-93307427-b7ab-4c1d-aff4-2acf8a94232b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:26.498429 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-93307427-b7ab-4c1d-aff4-2acf8a94232b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:36:26.507037 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-93307427-b7ab-4c1d-aff4-2acf8a94232b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1727 microversion: 2.1 time: 0.170489 Oct 17 14:36:26.507635 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3301/6740] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:36:26 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1727 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:36:27.534833 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d6af19ba-6e45-447a-b14e-7e289bc32875 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:36:27.535690 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d6af19ba-6e45-447a-b14e-7e289bc32875 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:36:27.543132 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d6af19ba-6e45-447a-b14e-7e289bc32875 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:27.543664 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d6af19ba-6e45-447a-b14e-7e289bc32875 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:27.544105 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d6af19ba-6e45-447a-b14e-7e289bc32875 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:27.544811 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d6af19ba-6e45-447a-b14e-7e289bc32875 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:27.545268 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d6af19ba-6e45-447a-b14e-7e289bc32875 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:27.545701 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d6af19ba-6e45-447a-b14e-7e289bc32875 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:27.682909 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d6af19ba-6e45-447a-b14e-7e289bc32875 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:36:27.695942 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d6af19ba-6e45-447a-b14e-7e289bc32875 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1727 microversion: 2.1 time: 0.167228 Oct 17 14:36:27.696816 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3440/6741] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:36:27 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:36:28.726048 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a7abae18-6a19-44cd-8abe-2732394f61f7 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:36:28.726671 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a7abae18-6a19-44cd-8abe-2732394f61f7 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:36:28.734180 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a7abae18-6a19-44cd-8abe-2732394f61f7 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:28.734692 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a7abae18-6a19-44cd-8abe-2732394f61f7 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:28.735138 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a7abae18-6a19-44cd-8abe-2732394f61f7 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:28.735929 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a7abae18-6a19-44cd-8abe-2732394f61f7 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:28.736369 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a7abae18-6a19-44cd-8abe-2732394f61f7 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:28.736809 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a7abae18-6a19-44cd-8abe-2732394f61f7 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:28.888590 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a7abae18-6a19-44cd-8abe-2732394f61f7 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:36:28.901611 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a7abae18-6a19-44cd-8abe-2732394f61f7 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1727 microversion: 2.1 time: 0.181271 Oct 17 14:36:28.902322 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3302/6742] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:36:28 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1727 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:36:29.931411 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fa24d55a-9872-43d7-a51c-4239d44d1524 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:36:29.932160 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-fa24d55a-9872-43d7-a51c-4239d44d1524 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:36:29.941234 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fa24d55a-9872-43d7-a51c-4239d44d1524 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:29.941830 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fa24d55a-9872-43d7-a51c-4239d44d1524 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:29.942426 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fa24d55a-9872-43d7-a51c-4239d44d1524 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:29.943448 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fa24d55a-9872-43d7-a51c-4239d44d1524 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:29.944008 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fa24d55a-9872-43d7-a51c-4239d44d1524 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:29.944539 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fa24d55a-9872-43d7-a51c-4239d44d1524 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:30.098306 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fa24d55a-9872-43d7-a51c-4239d44d1524 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:36:30.107497 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fa24d55a-9872-43d7-a51c-4239d44d1524 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1727 microversion: 2.1 time: 0.181474 Oct 17 14:36:30.108089 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3441/6743] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:36:29 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1727 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:36:31.132722 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c6207383-764d-4b13-8cff-5df10e3e254e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:36:31.133364 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c6207383-764d-4b13-8cff-5df10e3e254e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:36:31.141337 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c6207383-764d-4b13-8cff-5df10e3e254e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:31.141838 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c6207383-764d-4b13-8cff-5df10e3e254e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:31.142291 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c6207383-764d-4b13-8cff-5df10e3e254e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:31.142994 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c6207383-764d-4b13-8cff-5df10e3e254e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:31.143506 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c6207383-764d-4b13-8cff-5df10e3e254e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:31.143951 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c6207383-764d-4b13-8cff-5df10e3e254e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:31.289687 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c6207383-764d-4b13-8cff-5df10e3e254e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:36:31.298508 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c6207383-764d-4b13-8cff-5df10e3e254e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1727 microversion: 2.1 time: 0.170550 Oct 17 14:36:31.299065 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3303/6744] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:36:31 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1727 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:36:32.326032 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b4cad25e-e186-4fe4-9ac1-46349cf2ddbf tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:36:32.327070 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b4cad25e-e186-4fe4-9ac1-46349cf2ddbf tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:36:32.336697 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b4cad25e-e186-4fe4-9ac1-46349cf2ddbf tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:32.337195 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b4cad25e-e186-4fe4-9ac1-46349cf2ddbf tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:32.337635 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b4cad25e-e186-4fe4-9ac1-46349cf2ddbf tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:32.338341 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b4cad25e-e186-4fe4-9ac1-46349cf2ddbf tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:32.338829 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b4cad25e-e186-4fe4-9ac1-46349cf2ddbf tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:32.339293 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b4cad25e-e186-4fe4-9ac1-46349cf2ddbf tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:32.485820 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b4cad25e-e186-4fe4-9ac1-46349cf2ddbf tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:36:32.498916 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b4cad25e-e186-4fe4-9ac1-46349cf2ddbf tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1727 microversion: 2.1 time: 0.179420 Oct 17 14:36:32.499849 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3442/6745] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:36:32 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1727 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:36:33.525671 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c750487f-1a2a-4037-8063-03030428b59d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:36:33.526368 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c750487f-1a2a-4037-8063-03030428b59d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:36:33.534620 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c750487f-1a2a-4037-8063-03030428b59d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:33.535122 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c750487f-1a2a-4037-8063-03030428b59d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:33.535607 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c750487f-1a2a-4037-8063-03030428b59d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:33.536322 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c750487f-1a2a-4037-8063-03030428b59d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:33.536794 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c750487f-1a2a-4037-8063-03030428b59d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:33.537233 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c750487f-1a2a-4037-8063-03030428b59d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:33.681579 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c750487f-1a2a-4037-8063-03030428b59d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:36:33.694775 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c750487f-1a2a-4037-8063-03030428b59d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1727 microversion: 2.1 time: 0.172873 Oct 17 14:36:33.695558 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3304/6746] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:36:33 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1727 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:36:34.725209 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e9627a4c-e037-4edb-b07b-a77519f59a95 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:36:34.725826 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e9627a4c-e037-4edb-b07b-a77519f59a95 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:36:34.734249 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9627a4c-e037-4edb-b07b-a77519f59a95 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:34.734743 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9627a4c-e037-4edb-b07b-a77519f59a95 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:34.735204 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9627a4c-e037-4edb-b07b-a77519f59a95 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:34.735923 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9627a4c-e037-4edb-b07b-a77519f59a95 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:34.736380 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9627a4c-e037-4edb-b07b-a77519f59a95 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:34.736812 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e9627a4c-e037-4edb-b07b-a77519f59a95 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:34.875655 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e9627a4c-e037-4edb-b07b-a77519f59a95 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:36:34.884273 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e9627a4c-e037-4edb-b07b-a77519f59a95 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1727 microversion: 2.1 time: 0.163103 Oct 17 14:36:34.885221 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3443/6747] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:36:34 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:36:35.912841 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9c7e3a0a-8c48-451d-9997-69cdbbff8d6f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:36:35.913661 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9c7e3a0a-8c48-451d-9997-69cdbbff8d6f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:36:35.925172 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9c7e3a0a-8c48-451d-9997-69cdbbff8d6f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:35.925939 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9c7e3a0a-8c48-451d-9997-69cdbbff8d6f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:35.926612 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9c7e3a0a-8c48-451d-9997-69cdbbff8d6f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:35.927861 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9c7e3a0a-8c48-451d-9997-69cdbbff8d6f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:35.928622 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9c7e3a0a-8c48-451d-9997-69cdbbff8d6f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:35.929312 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9c7e3a0a-8c48-451d-9997-69cdbbff8d6f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:36.082330 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9c7e3a0a-8c48-451d-9997-69cdbbff8d6f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:36:36.095402 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9c7e3a0a-8c48-451d-9997-69cdbbff8d6f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1727 microversion: 2.1 time: 0.189101 Oct 17 14:36:36.096198 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3305/6748] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:36:35 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1727 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:36:37.119760 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2c20b6e1-2d6b-46df-8ca7-a50a38d0390a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:36:37.120400 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2c20b6e1-2d6b-46df-8ca7-a50a38d0390a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:36:37.127395 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2c20b6e1-2d6b-46df-8ca7-a50a38d0390a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:37.127890 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2c20b6e1-2d6b-46df-8ca7-a50a38d0390a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:37.128309 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2c20b6e1-2d6b-46df-8ca7-a50a38d0390a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:37.128996 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2c20b6e1-2d6b-46df-8ca7-a50a38d0390a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:37.129446 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2c20b6e1-2d6b-46df-8ca7-a50a38d0390a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:37.129863 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2c20b6e1-2d6b-46df-8ca7-a50a38d0390a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:37.322085 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2c20b6e1-2d6b-46df-8ca7-a50a38d0390a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:36:37.332516 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2c20b6e1-2d6b-46df-8ca7-a50a38d0390a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1727 microversion: 2.1 time: 0.216748 Oct 17 14:36:37.333102 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3444/6749] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:36:37 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1727 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:36:38.356544 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-169ae6da-4e44-495d-8465-71c45c6d5a8f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:36:38.357045 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-169ae6da-4e44-495d-8465-71c45c6d5a8f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:36:38.364747 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-169ae6da-4e44-495d-8465-71c45c6d5a8f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:38.365249 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-169ae6da-4e44-495d-8465-71c45c6d5a8f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:38.365704 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-169ae6da-4e44-495d-8465-71c45c6d5a8f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:38.366415 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-169ae6da-4e44-495d-8465-71c45c6d5a8f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:38.366881 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-169ae6da-4e44-495d-8465-71c45c6d5a8f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:38.367360 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-169ae6da-4e44-495d-8465-71c45c6d5a8f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:38.562476 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-169ae6da-4e44-495d-8465-71c45c6d5a8f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:36:38.571193 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-169ae6da-4e44-495d-8465-71c45c6d5a8f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1727 microversion: 2.1 time: 0.218932 Oct 17 14:36:38.571868 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3306/6750] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:36:38 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1727 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:36:39.606820 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c9ed3a8c-eccb-4533-874f-5871c68a6545 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:36:39.607857 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c9ed3a8c-eccb-4533-874f-5871c68a6545 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:36:39.619248 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c9ed3a8c-eccb-4533-874f-5871c68a6545 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:39.619762 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c9ed3a8c-eccb-4533-874f-5871c68a6545 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:39.620199 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c9ed3a8c-eccb-4533-874f-5871c68a6545 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:39.620900 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c9ed3a8c-eccb-4533-874f-5871c68a6545 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:39.621351 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c9ed3a8c-eccb-4533-874f-5871c68a6545 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:39.621776 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c9ed3a8c-eccb-4533-874f-5871c68a6545 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:39.755797 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c9ed3a8c-eccb-4533-874f-5871c68a6545 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:36:39.764769 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c9ed3a8c-eccb-4533-874f-5871c68a6545 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1727 microversion: 2.1 time: 0.164667 Oct 17 14:36:39.765358 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3445/6751] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:36:39 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:36:40.795068 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-fa780697-6ac8-4c20-9c6f-d4dae68bd2b6 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:36:40.795747 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-fa780697-6ac8-4c20-9c6f-d4dae68bd2b6 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:36:40.802823 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fa780697-6ac8-4c20-9c6f-d4dae68bd2b6 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:40.803354 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fa780697-6ac8-4c20-9c6f-d4dae68bd2b6 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:40.803798 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fa780697-6ac8-4c20-9c6f-d4dae68bd2b6 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:40.804474 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fa780697-6ac8-4c20-9c6f-d4dae68bd2b6 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:40.804953 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fa780697-6ac8-4c20-9c6f-d4dae68bd2b6 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:40.805381 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fa780697-6ac8-4c20-9c6f-d4dae68bd2b6 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:40.954985 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-fa780697-6ac8-4c20-9c6f-d4dae68bd2b6 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:36:40.966736 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-fa780697-6ac8-4c20-9c6f-d4dae68bd2b6 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1727 microversion: 2.1 time: 0.178728 Oct 17 14:36:40.967355 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3307/6752] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:36:40 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1727 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:36:41.994448 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-49913504-d889-41a6-b019-509f09608bd1 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:36:41.995572 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-49913504-d889-41a6-b019-509f09608bd1 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:36:42.007475 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-49913504-d889-41a6-b019-509f09608bd1 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:42.008332 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-49913504-d889-41a6-b019-509f09608bd1 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:42.009064 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-49913504-d889-41a6-b019-509f09608bd1 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:42.010553 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-49913504-d889-41a6-b019-509f09608bd1 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:42.010992 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-49913504-d889-41a6-b019-509f09608bd1 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:42.011479 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-49913504-d889-41a6-b019-509f09608bd1 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:42.156935 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-49913504-d889-41a6-b019-509f09608bd1 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:36:42.167246 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-49913504-d889-41a6-b019-509f09608bd1 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1727 microversion: 2.1 time: 0.179467 Oct 17 14:36:42.167885 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3446/6753] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:36:41 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1727 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:36:43.191334 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-18775d7c-db78-4283-9aa6-0d9be73c2b75 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:36:43.191995 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-18775d7c-db78-4283-9aa6-0d9be73c2b75 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:36:43.200823 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-18775d7c-db78-4283-9aa6-0d9be73c2b75 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:43.201330 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-18775d7c-db78-4283-9aa6-0d9be73c2b75 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:43.201809 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-18775d7c-db78-4283-9aa6-0d9be73c2b75 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:43.202522 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-18775d7c-db78-4283-9aa6-0d9be73c2b75 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:43.202991 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-18775d7c-db78-4283-9aa6-0d9be73c2b75 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:43.203463 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-18775d7c-db78-4283-9aa6-0d9be73c2b75 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:43.339808 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-18775d7c-db78-4283-9aa6-0d9be73c2b75 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:36:43.348498 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-18775d7c-db78-4283-9aa6-0d9be73c2b75 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1727 microversion: 2.1 time: 0.161168 Oct 17 14:36:43.349115 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3308/6754] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:36:43 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:36:44.372220 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b4fe57f0-c54a-46ac-a980-d56c5cdc43d8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:36:44.372946 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b4fe57f0-c54a-46ac-a980-d56c5cdc43d8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:36:44.380427 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b4fe57f0-c54a-46ac-a980-d56c5cdc43d8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:44.380922 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b4fe57f0-c54a-46ac-a980-d56c5cdc43d8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:44.381360 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b4fe57f0-c54a-46ac-a980-d56c5cdc43d8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:44.382070 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b4fe57f0-c54a-46ac-a980-d56c5cdc43d8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:44.382525 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b4fe57f0-c54a-46ac-a980-d56c5cdc43d8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:44.382956 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b4fe57f0-c54a-46ac-a980-d56c5cdc43d8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:44.524024 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b4fe57f0-c54a-46ac-a980-d56c5cdc43d8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:36:44.533433 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b4fe57f0-c54a-46ac-a980-d56c5cdc43d8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1727 microversion: 2.1 time: 0.165304 Oct 17 14:36:44.534252 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3447/6755] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:36:44 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:36:45.555694 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-387d8d29-1451-4169-bda5-c33d4a2c1c3e req-fabe6fe6-16e7-4353-b917-3635117a603e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcf4b7ae-0a6f-4a5e-a607-463e2354615c", "name": "network-vif-unplugged", "status": "completed", "tag": "2524073a-3e43-497d-a3d9-b7266a8a4bd1"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:36:45.557991 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-176505cb-6bd7-4a5b-b8fc-aca83e074761 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:36:45.559401 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-176505cb-6bd7-4a5b-b8fc-aca83e074761 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:36:45.567635 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-387d8d29-1451-4169-bda5-c33d4a2c1c3e req-fabe6fe6-16e7-4353-b917-3635117a603e service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:45.568158 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-387d8d29-1451-4169-bda5-c33d4a2c1c3e req-fabe6fe6-16e7-4353-b917-3635117a603e service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:45.568370 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-176505cb-6bd7-4a5b-b8fc-aca83e074761 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:45.568764 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-176505cb-6bd7-4a5b-b8fc-aca83e074761 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:45.569230 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-176505cb-6bd7-4a5b-b8fc-aca83e074761 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:45.569454 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-387d8d29-1451-4169-bda5-c33d4a2c1c3e req-fabe6fe6-16e7-4353-b917-3635117a603e service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:45.569935 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-176505cb-6bd7-4a5b-b8fc-aca83e074761 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:45.570391 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-176505cb-6bd7-4a5b-b8fc-aca83e074761 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:45.570840 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-176505cb-6bd7-4a5b-b8fc-aca83e074761 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:45.582695 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-387d8d29-1451-4169-bda5-c33d4a2c1c3e req-fabe6fe6-16e7-4353-b917-3635117a603e service nova] Creating event network-vif-unplugged:2524073a-3e43-497d-a3d9-b7266a8a4bd1 for instance dcf4b7ae-0a6f-4a5e-a607-463e2354615c on n-h2-854247-14 Oct 17 14:36:45.588291 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [req-387d8d29-1451-4169-bda5-c33d4a2c1c3e req-fabe6fe6-16e7-4353-b917-3635117a603e service nova] Instance dcf4b7ae-0a6f-4a5e-a607-463e2354615c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854247-14', 'n-h2-854247-14'} {{(pid=127017) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 14:36:45.600646 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-387d8d29-1451-4169-bda5-c33d4a2c1c3e req-fabe6fe6-16e7-4353-b917-3635117a603e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049223 Oct 17 14:36:45.602077 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3309/6756] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:36:45.835601 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-176505cb-6bd7-4a5b-b8fc-aca83e074761 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:36:45.844597 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-176505cb-6bd7-4a5b-b8fc-aca83e074761 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1726 microversion: 2.1 time: 0.290578 Oct 17 14:36:45.845191 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3448/6757] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:36:45 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1726 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:36:46.868727 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4ef25334-1936-411f-91c2-1f7650fb859e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:36:46.869445 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4ef25334-1936-411f-91c2-1f7650fb859e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:36:46.877076 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4ef25334-1936-411f-91c2-1f7650fb859e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:46.877564 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4ef25334-1936-411f-91c2-1f7650fb859e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:46.878000 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4ef25334-1936-411f-91c2-1f7650fb859e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:46.878701 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4ef25334-1936-411f-91c2-1f7650fb859e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:46.879155 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4ef25334-1936-411f-91c2-1f7650fb859e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:46.879753 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4ef25334-1936-411f-91c2-1f7650fb859e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:47.020752 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4ef25334-1936-411f-91c2-1f7650fb859e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:36:47.029758 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4ef25334-1936-411f-91c2-1f7650fb859e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1724 microversion: 2.1 time: 0.165246 Oct 17 14:36:47.030255 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3310/6758] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:36:46 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:36:47.617504 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-04ed38e2-7b99-42c2-b60d-0ddb199eaffc req-4fba19e3-c8c3-4e07-8676-0699dd121e3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcf4b7ae-0a6f-4a5e-a607-463e2354615c", "tag": "2524073a-3e43-497d-a3d9-b7266a8a4bd1"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:36:47.628809 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-04ed38e2-7b99-42c2-b60d-0ddb199eaffc req-4fba19e3-c8c3-4e07-8676-0699dd121e3b service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:47.629291 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-04ed38e2-7b99-42c2-b60d-0ddb199eaffc req-4fba19e3-c8c3-4e07-8676-0699dd121e3b service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:47.629715 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-04ed38e2-7b99-42c2-b60d-0ddb199eaffc req-4fba19e3-c8c3-4e07-8676-0699dd121e3b service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:47.642470 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-04ed38e2-7b99-42c2-b60d-0ddb199eaffc req-4fba19e3-c8c3-4e07-8676-0699dd121e3b service nova] Creating event network-changed:2524073a-3e43-497d-a3d9-b7266a8a4bd1 for instance dcf4b7ae-0a6f-4a5e-a607-463e2354615c on n-h2-854247-14 Oct 17 14:36:47.648258 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [req-04ed38e2-7b99-42c2-b60d-0ddb199eaffc req-4fba19e3-c8c3-4e07-8676-0699dd121e3b service nova] Instance dcf4b7ae-0a6f-4a5e-a607-463e2354615c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854247-14', 'n-h2-854247-14'} {{(pid=127016) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 14:36:47.659900 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-04ed38e2-7b99-42c2-b60d-0ddb199eaffc req-4fba19e3-c8c3-4e07-8676-0699dd121e3b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046113 Oct 17 14:36:47.660511 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3449/6759] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:36:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:36:48.053739 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9ab52c8d-846c-46af-9396-0cc8a73ec795 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:36:48.055086 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9ab52c8d-846c-46af-9396-0cc8a73ec795 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:36:48.062918 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9ab52c8d-846c-46af-9396-0cc8a73ec795 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:48.063771 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9ab52c8d-846c-46af-9396-0cc8a73ec795 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:48.064420 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9ab52c8d-846c-46af-9396-0cc8a73ec795 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:48.065354 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9ab52c8d-846c-46af-9396-0cc8a73ec795 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:48.066143 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9ab52c8d-846c-46af-9396-0cc8a73ec795 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:48.066649 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9ab52c8d-846c-46af-9396-0cc8a73ec795 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:48.302907 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9ab52c8d-846c-46af-9396-0cc8a73ec795 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:36:48.312544 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9ab52c8d-846c-46af-9396-0cc8a73ec795 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1724 microversion: 2.1 time: 0.262727 Oct 17 14:36:48.313114 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3311/6760] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:36:48 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1724 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:36:49.338548 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5d7bb4b6-c7e4-4cc1-af03-329ee6760645 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:36:49.339188 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5d7bb4b6-c7e4-4cc1-af03-329ee6760645 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:36:49.347968 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5d7bb4b6-c7e4-4cc1-af03-329ee6760645 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:49.348460 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5d7bb4b6-c7e4-4cc1-af03-329ee6760645 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:49.348901 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5d7bb4b6-c7e4-4cc1-af03-329ee6760645 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:49.349640 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5d7bb4b6-c7e4-4cc1-af03-329ee6760645 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:49.350097 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5d7bb4b6-c7e4-4cc1-af03-329ee6760645 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:49.350522 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5d7bb4b6-c7e4-4cc1-af03-329ee6760645 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:49.493133 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5d7bb4b6-c7e4-4cc1-af03-329ee6760645 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:36:49.501812 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5d7bb4b6-c7e4-4cc1-af03-329ee6760645 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1724 microversion: 2.1 time: 0.168698 Oct 17 14:36:49.502441 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3450/6761] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:36:49 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:36:50.577539 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8cf6e154-3d6b-46ad-a69e-3fea5578c35d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:36:50.578175 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8cf6e154-3d6b-46ad-a69e-3fea5578c35d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:36:50.584855 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8cf6e154-3d6b-46ad-a69e-3fea5578c35d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:50.585364 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8cf6e154-3d6b-46ad-a69e-3fea5578c35d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:50.585783 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8cf6e154-3d6b-46ad-a69e-3fea5578c35d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:50.586509 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8cf6e154-3d6b-46ad-a69e-3fea5578c35d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:50.587010 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8cf6e154-3d6b-46ad-a69e-3fea5578c35d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:50.587590 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8cf6e154-3d6b-46ad-a69e-3fea5578c35d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:50.724601 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8cf6e154-3d6b-46ad-a69e-3fea5578c35d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:36:50.733569 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8cf6e154-3d6b-46ad-a69e-3fea5578c35d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1724 microversion: 2.1 time: 0.211450 Oct 17 14:36:50.734070 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3312/6762] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:36:50 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1724 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:36:51.760143 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2d9c077f-be85-4b1d-94b6-84b89dd8b5f1 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:36:51.760977 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2d9c077f-be85-4b1d-94b6-84b89dd8b5f1 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:36:51.769408 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2d9c077f-be85-4b1d-94b6-84b89dd8b5f1 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:51.769894 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2d9c077f-be85-4b1d-94b6-84b89dd8b5f1 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:51.770332 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2d9c077f-be85-4b1d-94b6-84b89dd8b5f1 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:51.771025 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2d9c077f-be85-4b1d-94b6-84b89dd8b5f1 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:51.771524 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2d9c077f-be85-4b1d-94b6-84b89dd8b5f1 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:51.771943 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2d9c077f-be85-4b1d-94b6-84b89dd8b5f1 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:51.934726 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2d9c077f-be85-4b1d-94b6-84b89dd8b5f1 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:36:51.948963 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2d9c077f-be85-4b1d-94b6-84b89dd8b5f1 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1724 microversion: 2.1 time: 0.194650 Oct 17 14:36:51.949892 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3451/6763] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:36:51 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:36:52.977320 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-37987e96-da31-47f0-8328-14720373b235 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:36:52.978227 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-37987e96-da31-47f0-8328-14720373b235 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:36:52.990310 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-37987e96-da31-47f0-8328-14720373b235 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:52.991205 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-37987e96-da31-47f0-8328-14720373b235 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:52.991950 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-37987e96-da31-47f0-8328-14720373b235 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:52.993133 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-37987e96-da31-47f0-8328-14720373b235 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:52.993863 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-37987e96-da31-47f0-8328-14720373b235 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:52.994630 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-37987e96-da31-47f0-8328-14720373b235 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:53.129499 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-37987e96-da31-47f0-8328-14720373b235 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:36:53.138538 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-37987e96-da31-47f0-8328-14720373b235 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1724 microversion: 2.1 time: 0.168339 Oct 17 14:36:53.139107 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3313/6764] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:36:52 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:36:54.165988 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2420aa02-6f29-4cfe-a644-a6c89993462b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:36:54.166811 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2420aa02-6f29-4cfe-a644-a6c89993462b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:36:54.171245 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=33 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:36:54.177179 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2420aa02-6f29-4cfe-a644-a6c89993462b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:54.177659 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2420aa02-6f29-4cfe-a644-a6c89993462b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:54.178087 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2420aa02-6f29-4cfe-a644-a6c89993462b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:54.178780 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2420aa02-6f29-4cfe-a644-a6c89993462b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:54.179218 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2420aa02-6f29-4cfe-a644-a6c89993462b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:54.179662 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2420aa02-6f29-4cfe-a644-a6c89993462b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:54.182479 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:36:54.321221 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2420aa02-6f29-4cfe-a644-a6c89993462b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:36:54.334799 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2420aa02-6f29-4cfe-a644-a6c89993462b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1724 microversion: 2.1 time: 0.175244 Oct 17 14:36:54.335499 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3452/6765] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:36:54 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:36:55.361429 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-99d4d58a-c864-4212-84a8-611cf0850a08 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:36:55.361998 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-99d4d58a-c864-4212-84a8-611cf0850a08 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:36:55.364787 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=29 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:36:55.370481 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-99d4d58a-c864-4212-84a8-611cf0850a08 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:55.370978 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-99d4d58a-c864-4212-84a8-611cf0850a08 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:55.371499 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-99d4d58a-c864-4212-84a8-611cf0850a08 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:55.372204 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-99d4d58a-c864-4212-84a8-611cf0850a08 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:55.372666 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-99d4d58a-c864-4212-84a8-611cf0850a08 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:55.373098 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-99d4d58a-c864-4212-84a8-611cf0850a08 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:55.377206 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=83 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:36:55.521239 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-99d4d58a-c864-4212-84a8-611cf0850a08 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:36:55.530083 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-99d4d58a-c864-4212-84a8-611cf0850a08 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1724 microversion: 2.1 time: 0.174702 Oct 17 14:36:55.530663 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3314/6766] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:36:55 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:36:56.558741 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-aaf06a9e-3887-4b1b-a650-c3f416e7f256 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:36:56.559838 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-aaf06a9e-3887-4b1b-a650-c3f416e7f256 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:36:56.569427 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aaf06a9e-3887-4b1b-a650-c3f416e7f256 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:56.569843 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aaf06a9e-3887-4b1b-a650-c3f416e7f256 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:56.570356 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aaf06a9e-3887-4b1b-a650-c3f416e7f256 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:56.571055 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aaf06a9e-3887-4b1b-a650-c3f416e7f256 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:56.571544 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aaf06a9e-3887-4b1b-a650-c3f416e7f256 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:56.571966 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aaf06a9e-3887-4b1b-a650-c3f416e7f256 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:56.720769 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-aaf06a9e-3887-4b1b-a650-c3f416e7f256 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:36:56.729917 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-aaf06a9e-3887-4b1b-a650-c3f416e7f256 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1724 microversion: 2.1 time: 0.177947 Oct 17 14:36:56.730510 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3453/6767] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:36:56 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:36:57.754412 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b782ee2b-a036-49c2-bcfe-02588eb39838 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:36:57.755121 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b782ee2b-a036-49c2-bcfe-02588eb39838 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:36:57.763934 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b782ee2b-a036-49c2-bcfe-02588eb39838 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:57.764518 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b782ee2b-a036-49c2-bcfe-02588eb39838 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:57.765043 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b782ee2b-a036-49c2-bcfe-02588eb39838 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:57.765947 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b782ee2b-a036-49c2-bcfe-02588eb39838 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:57.766546 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b782ee2b-a036-49c2-bcfe-02588eb39838 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:57.766983 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b782ee2b-a036-49c2-bcfe-02588eb39838 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:57.913636 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b782ee2b-a036-49c2-bcfe-02588eb39838 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:36:57.922238 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b782ee2b-a036-49c2-bcfe-02588eb39838 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1724 microversion: 2.1 time: 0.172608 Oct 17 14:36:57.922823 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3315/6768] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:36:57 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:36:58.946932 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-abd719c2-f591-4689-b32e-b42c339b74fc tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:36:58.947701 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-abd719c2-f591-4689-b32e-b42c339b74fc tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:36:58.955015 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-abd719c2-f591-4689-b32e-b42c339b74fc tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:58.955616 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-abd719c2-f591-4689-b32e-b42c339b74fc tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:58.956229 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-abd719c2-f591-4689-b32e-b42c339b74fc tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:58.956943 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-abd719c2-f591-4689-b32e-b42c339b74fc tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:58.957423 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-abd719c2-f591-4689-b32e-b42c339b74fc tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:58.957829 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-abd719c2-f591-4689-b32e-b42c339b74fc tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:59.092939 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-abd719c2-f591-4689-b32e-b42c339b74fc tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:36:59.101944 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-abd719c2-f591-4689-b32e-b42c339b74fc tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1721 microversion: 2.1 time: 0.159313 Oct 17 14:36:59.102545 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3454/6769] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:36:58 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:36:59.124987 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-da695202-5fa3-4752-960d-041d0befc0dd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:36:59.125531 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-da695202-5fa3-4752-960d-041d0befc0dd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:36:59.132943 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-da695202-5fa3-4752-960d-041d0befc0dd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:59.133441 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-da695202-5fa3-4752-960d-041d0befc0dd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:59.134246 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-da695202-5fa3-4752-960d-041d0befc0dd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:59.134956 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-da695202-5fa3-4752-960d-041d0befc0dd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:59.135449 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-da695202-5fa3-4752-960d-041d0befc0dd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:59.135887 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-da695202-5fa3-4752-960d-041d0befc0dd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:59.176421 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-da695202-5fa3-4752-960d-041d0befc0dd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:59.176910 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-da695202-5fa3-4752-960d-041d0befc0dd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:59.177355 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-da695202-5fa3-4752-960d-041d0befc0dd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:59.178081 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-da695202-5fa3-4752-960d-041d0befc0dd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:59.178534 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-da695202-5fa3-4752-960d-041d0befc0dd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:59.178965 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-da695202-5fa3-4752-960d-041d0befc0dd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:59.199811 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-da695202-5fa3-4752-960d-041d0befc0dd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Getting quotas for project 6312d6ad74bb476384426e63c1ec7ae5. Resources: {'ram', 'cores'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:36:59.205265 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-da695202-5fa3-4752-960d-041d0befc0dd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Getting quotas for user ad69a4e71c9e425fac89ec047eda43de and project 6312d6ad74bb476384426e63c1ec7ae5. Resources: {'ram', 'cores'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:36:59.314347 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-da695202-5fa3-4752-960d-041d0befc0dd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "POST /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c/action" status: 202 len: 0 microversion: 2.1 time: 0.192801 Oct 17 14:36:59.315449 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3316/6770] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:36:59 2022] POST /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:36:59.324390 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1b7dc83c-77a5-4c58-a0a2-69536a04ce62 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:36:59.325123 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-1b7dc83c-77a5-4c58-a0a2-69536a04ce62 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:36:59.331764 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1b7dc83c-77a5-4c58-a0a2-69536a04ce62 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:59.332534 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1b7dc83c-77a5-4c58-a0a2-69536a04ce62 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:59.333065 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1b7dc83c-77a5-4c58-a0a2-69536a04ce62 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:59.333995 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1b7dc83c-77a5-4c58-a0a2-69536a04ce62 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:59.334559 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1b7dc83c-77a5-4c58-a0a2-69536a04ce62 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:59.334984 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1b7dc83c-77a5-4c58-a0a2-69536a04ce62 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:59.519813 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-1b7dc83c-77a5-4c58-a0a2-69536a04ce62 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:36:59.528246 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1b7dc83c-77a5-4c58-a0a2-69536a04ce62 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1720 microversion: 2.1 time: 0.208261 Oct 17 14:36:59.533691 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3455/6771] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:36:59 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1720 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:37:00.554600 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c6787148-63f4-4b78-a44d-64697afdc36a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:37:00.555223 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c6787148-63f4-4b78-a44d-64697afdc36a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:37:00.562711 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c6787148-63f4-4b78-a44d-64697afdc36a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:00.563203 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c6787148-63f4-4b78-a44d-64697afdc36a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:00.563695 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c6787148-63f4-4b78-a44d-64697afdc36a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:00.564461 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c6787148-63f4-4b78-a44d-64697afdc36a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:00.564940 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c6787148-63f4-4b78-a44d-64697afdc36a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:00.565424 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c6787148-63f4-4b78-a44d-64697afdc36a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:00.711432 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c6787148-63f4-4b78-a44d-64697afdc36a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:37:00.720017 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c6787148-63f4-4b78-a44d-64697afdc36a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1720 microversion: 2.1 time: 0.169925 Oct 17 14:37:00.720567 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3317/6772] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:37:00 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1720 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:37:01.061322 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-86b9d081-0470-452c-a605-d37d3c54425b req-cee4f2f3-6893-4dd0-9d4d-ceab1f5ed768 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcf4b7ae-0a6f-4a5e-a607-463e2354615c", "name": "network-vif-plugged", "status": "completed", "tag": "2524073a-3e43-497d-a3d9-b7266a8a4bd1"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:37:01.072095 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-86b9d081-0470-452c-a605-d37d3c54425b req-cee4f2f3-6893-4dd0-9d4d-ceab1f5ed768 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:01.072686 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-86b9d081-0470-452c-a605-d37d3c54425b req-cee4f2f3-6893-4dd0-9d4d-ceab1f5ed768 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:01.073272 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-86b9d081-0470-452c-a605-d37d3c54425b req-cee4f2f3-6893-4dd0-9d4d-ceab1f5ed768 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:01.093403 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-86b9d081-0470-452c-a605-d37d3c54425b req-cee4f2f3-6893-4dd0-9d4d-ceab1f5ed768 service nova] Creating event network-vif-plugged:2524073a-3e43-497d-a3d9-b7266a8a4bd1 for instance dcf4b7ae-0a6f-4a5e-a607-463e2354615c on n-h2-854247-14 Oct 17 14:37:01.099826 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [req-86b9d081-0470-452c-a605-d37d3c54425b req-cee4f2f3-6893-4dd0-9d4d-ceab1f5ed768 service nova] Instance dcf4b7ae-0a6f-4a5e-a607-463e2354615c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854247-14', 'n-h2-854247-14'} {{(pid=127016) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 14:37:01.110958 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-86b9d081-0470-452c-a605-d37d3c54425b req-cee4f2f3-6893-4dd0-9d4d-ceab1f5ed768 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105664 Oct 17 14:37:01.111697 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3456/6773] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:37:01.746766 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-02f5f0b8-4463-4819-b052-c86e05b8fac1 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:37:01.747875 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-02f5f0b8-4463-4819-b052-c86e05b8fac1 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:37:01.756893 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-02f5f0b8-4463-4819-b052-c86e05b8fac1 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:01.757315 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-02f5f0b8-4463-4819-b052-c86e05b8fac1 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:01.757757 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-02f5f0b8-4463-4819-b052-c86e05b8fac1 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:01.758462 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-02f5f0b8-4463-4819-b052-c86e05b8fac1 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:01.759316 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-02f5f0b8-4463-4819-b052-c86e05b8fac1 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:01.759752 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-02f5f0b8-4463-4819-b052-c86e05b8fac1 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:01.905299 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-02f5f0b8-4463-4819-b052-c86e05b8fac1 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:37:01.914336 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-02f5f0b8-4463-4819-b052-c86e05b8fac1 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1720 microversion: 2.1 time: 0.173556 Oct 17 14:37:01.915230 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3318/6774] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:37:01 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1720 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:37:02.940223 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-91eaa3b5-7406-472a-b81b-8b9d4c083231 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:37:02.940953 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-91eaa3b5-7406-472a-b81b-8b9d4c083231 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:37:02.948172 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-91eaa3b5-7406-472a-b81b-8b9d4c083231 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:02.948671 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-91eaa3b5-7406-472a-b81b-8b9d4c083231 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:02.949105 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-91eaa3b5-7406-472a-b81b-8b9d4c083231 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:02.949816 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-91eaa3b5-7406-472a-b81b-8b9d4c083231 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:02.950267 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-91eaa3b5-7406-472a-b81b-8b9d4c083231 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:02.950693 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-91eaa3b5-7406-472a-b81b-8b9d4c083231 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:03.087032 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-91eaa3b5-7406-472a-b81b-8b9d4c083231 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:37:03.096872 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-91eaa3b5-7406-472a-b81b-8b9d4c083231 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1720 microversion: 2.1 time: 0.162078 Oct 17 14:37:03.097840 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3457/6775] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:37:02 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:37:04.121681 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ac49e7d3-1008-4b62-941d-fdd12c539623 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:37:04.122292 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ac49e7d3-1008-4b62-941d-fdd12c539623 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:37:04.132960 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac49e7d3-1008-4b62-941d-fdd12c539623 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:04.133461 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac49e7d3-1008-4b62-941d-fdd12c539623 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:04.134255 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac49e7d3-1008-4b62-941d-fdd12c539623 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:04.135043 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac49e7d3-1008-4b62-941d-fdd12c539623 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:04.135489 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac49e7d3-1008-4b62-941d-fdd12c539623 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:04.135922 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac49e7d3-1008-4b62-941d-fdd12c539623 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:04.275264 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ac49e7d3-1008-4b62-941d-fdd12c539623 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:37:04.283813 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ac49e7d3-1008-4b62-941d-fdd12c539623 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1720 microversion: 2.1 time: 0.166768 Oct 17 14:37:04.284384 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3319/6776] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:37:04 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1720 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:37:04.867639 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-8d5e13b9-33bb-42d2-a83c-c775f6e4bc9c req-97201ca9-3599-4906-8fac-b75fb4ffcffc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcf4b7ae-0a6f-4a5e-a607-463e2354615c", "name": "network-vif-unplugged", "status": "completed", "tag": "2524073a-3e43-497d-a3d9-b7266a8a4bd1"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:37:04.880409 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-8d5e13b9-33bb-42d2-a83c-c775f6e4bc9c req-97201ca9-3599-4906-8fac-b75fb4ffcffc service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:04.881285 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-8d5e13b9-33bb-42d2-a83c-c775f6e4bc9c req-97201ca9-3599-4906-8fac-b75fb4ffcffc service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:04.881712 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-8d5e13b9-33bb-42d2-a83c-c775f6e4bc9c req-97201ca9-3599-4906-8fac-b75fb4ffcffc service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:04.894960 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-8d5e13b9-33bb-42d2-a83c-c775f6e4bc9c req-97201ca9-3599-4906-8fac-b75fb4ffcffc service nova] Creating event network-vif-unplugged:2524073a-3e43-497d-a3d9-b7266a8a4bd1 for instance dcf4b7ae-0a6f-4a5e-a607-463e2354615c on n-h1-854247-14 Oct 17 14:37:04.901057 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [req-8d5e13b9-33bb-42d2-a83c-c775f6e4bc9c req-97201ca9-3599-4906-8fac-b75fb4ffcffc service nova] Instance dcf4b7ae-0a6f-4a5e-a607-463e2354615c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854247-14', 'n-h1-854247-14'} {{(pid=127016) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 14:37:04.912299 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-8d5e13b9-33bb-42d2-a83c-c775f6e4bc9c req-97201ca9-3599-4906-8fac-b75fb4ffcffc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050352 Oct 17 14:37:04.912879 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3458/6777] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:37:05.309135 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0e228093-d7ea-4dc6-acbe-3264489c3f8c tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:37:05.309766 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0e228093-d7ea-4dc6-acbe-3264489c3f8c tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:37:05.317670 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0e228093-d7ea-4dc6-acbe-3264489c3f8c tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:05.318197 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0e228093-d7ea-4dc6-acbe-3264489c3f8c tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:05.318794 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0e228093-d7ea-4dc6-acbe-3264489c3f8c tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:05.319643 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0e228093-d7ea-4dc6-acbe-3264489c3f8c tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:05.320011 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0e228093-d7ea-4dc6-acbe-3264489c3f8c tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:05.320478 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0e228093-d7ea-4dc6-acbe-3264489c3f8c tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:05.456328 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0e228093-d7ea-4dc6-acbe-3264489c3f8c tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:37:05.464939 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0e228093-d7ea-4dc6-acbe-3264489c3f8c tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1720 microversion: 2.1 time: 0.160078 Oct 17 14:37:05.465523 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3320/6778] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:37:05 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:37:06.494008 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2f9c741c-f3cf-4f29-9269-5bca74f008c6 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:37:06.494755 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2f9c741c-f3cf-4f29-9269-5bca74f008c6 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:37:06.501762 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2f9c741c-f3cf-4f29-9269-5bca74f008c6 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:06.502252 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2f9c741c-f3cf-4f29-9269-5bca74f008c6 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:06.502690 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2f9c741c-f3cf-4f29-9269-5bca74f008c6 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:06.503439 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2f9c741c-f3cf-4f29-9269-5bca74f008c6 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:06.503894 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2f9c741c-f3cf-4f29-9269-5bca74f008c6 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:06.504325 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2f9c741c-f3cf-4f29-9269-5bca74f008c6 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:06.649318 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2f9c741c-f3cf-4f29-9269-5bca74f008c6 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:37:06.658095 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2f9c741c-f3cf-4f29-9269-5bca74f008c6 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1720 microversion: 2.1 time: 0.171036 Oct 17 14:37:06.658794 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3459/6779] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:37:06 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1720 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:37:06.928817 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-2f88b151-f367-4216-8c49-3266485cdba8 req-d6239617-9caa-450a-b512-741ce4a8b208 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcf4b7ae-0a6f-4a5e-a607-463e2354615c", "tag": "2524073a-3e43-497d-a3d9-b7266a8a4bd1"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:37:06.939743 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-2f88b151-f367-4216-8c49-3266485cdba8 req-d6239617-9caa-450a-b512-741ce4a8b208 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:06.940234 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-2f88b151-f367-4216-8c49-3266485cdba8 req-d6239617-9caa-450a-b512-741ce4a8b208 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:06.940804 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-2f88b151-f367-4216-8c49-3266485cdba8 req-d6239617-9caa-450a-b512-741ce4a8b208 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:06.954845 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-2f88b151-f367-4216-8c49-3266485cdba8 req-d6239617-9caa-450a-b512-741ce4a8b208 service nova] Creating event network-changed:2524073a-3e43-497d-a3d9-b7266a8a4bd1 for instance dcf4b7ae-0a6f-4a5e-a607-463e2354615c on n-h1-854247-14 Oct 17 14:37:06.963311 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [req-2f88b151-f367-4216-8c49-3266485cdba8 req-d6239617-9caa-450a-b512-741ce4a8b208 service nova] Instance dcf4b7ae-0a6f-4a5e-a607-463e2354615c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854247-14', 'n-h1-854247-14'} {{(pid=127017) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 14:37:06.975127 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-2f88b151-f367-4216-8c49-3266485cdba8 req-d6239617-9caa-450a-b512-741ce4a8b208 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050239 Oct 17 14:37:06.975953 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3321/6780] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:37:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:37:07.682626 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cf78fc5d-25ed-4acf-9dec-8225f34ec69c tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:37:07.683225 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cf78fc5d-25ed-4acf-9dec-8225f34ec69c tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:37:07.691543 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cf78fc5d-25ed-4acf-9dec-8225f34ec69c tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:07.692151 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cf78fc5d-25ed-4acf-9dec-8225f34ec69c tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:07.692588 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cf78fc5d-25ed-4acf-9dec-8225f34ec69c tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:07.693328 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cf78fc5d-25ed-4acf-9dec-8225f34ec69c tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:07.693848 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cf78fc5d-25ed-4acf-9dec-8225f34ec69c tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:07.694420 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cf78fc5d-25ed-4acf-9dec-8225f34ec69c tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:07.851915 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cf78fc5d-25ed-4acf-9dec-8225f34ec69c tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:37:07.861077 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cf78fc5d-25ed-4acf-9dec-8225f34ec69c tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1720 microversion: 2.1 time: 0.182462 Oct 17 14:37:07.861691 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3460/6781] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:37:07 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1720 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:37:08.889296 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9392586c-e2fe-453f-bca5-993f98e578a3 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:37:08.890075 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9392586c-e2fe-453f-bca5-993f98e578a3 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:37:08.900676 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9392586c-e2fe-453f-bca5-993f98e578a3 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:08.901182 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9392586c-e2fe-453f-bca5-993f98e578a3 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:08.901638 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9392586c-e2fe-453f-bca5-993f98e578a3 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:08.902359 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9392586c-e2fe-453f-bca5-993f98e578a3 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:08.902825 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9392586c-e2fe-453f-bca5-993f98e578a3 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:08.903293 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9392586c-e2fe-453f-bca5-993f98e578a3 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:09.046636 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9392586c-e2fe-453f-bca5-993f98e578a3 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:37:09.057561 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9392586c-e2fe-453f-bca5-993f98e578a3 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1720 microversion: 2.1 time: 0.175840 Oct 17 14:37:09.058156 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3322/6782] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:37:08 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1720 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:37:10.082454 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ed18a415-0ab1-4b47-904c-6366e58ef6fd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:37:10.083028 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ed18a415-0ab1-4b47-904c-6366e58ef6fd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:37:10.090474 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ed18a415-0ab1-4b47-904c-6366e58ef6fd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:10.091235 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ed18a415-0ab1-4b47-904c-6366e58ef6fd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:10.091891 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ed18a415-0ab1-4b47-904c-6366e58ef6fd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:10.092674 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ed18a415-0ab1-4b47-904c-6366e58ef6fd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:10.093065 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ed18a415-0ab1-4b47-904c-6366e58ef6fd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:10.093496 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ed18a415-0ab1-4b47-904c-6366e58ef6fd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:10.231814 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ed18a415-0ab1-4b47-904c-6366e58ef6fd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:37:10.241190 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ed18a415-0ab1-4b47-904c-6366e58ef6fd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1720 microversion: 2.1 time: 0.162962 Oct 17 14:37:10.241994 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3461/6783] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:37:10 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:37:11.269414 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bf1bdfd9-ed7d-4b73-ba07-a9928444d2a1 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:37:11.270448 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-bf1bdfd9-ed7d-4b73-ba07-a9928444d2a1 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:37:11.273312 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=3 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:37:11.279875 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bf1bdfd9-ed7d-4b73-ba07-a9928444d2a1 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:11.280373 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bf1bdfd9-ed7d-4b73-ba07-a9928444d2a1 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:11.280826 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bf1bdfd9-ed7d-4b73-ba07-a9928444d2a1 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:11.281533 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bf1bdfd9-ed7d-4b73-ba07-a9928444d2a1 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:11.281992 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bf1bdfd9-ed7d-4b73-ba07-a9928444d2a1 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:11.282425 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bf1bdfd9-ed7d-4b73-ba07-a9928444d2a1 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:11.419899 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-bf1bdfd9-ed7d-4b73-ba07-a9928444d2a1 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:37:11.429447 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-bf1bdfd9-ed7d-4b73-ba07-a9928444d2a1 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1720 microversion: 2.1 time: 0.166761 Oct 17 14:37:11.430021 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3323/6784] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:37:11 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1720 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:37:12.456250 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-375bad28-b4f4-4434-a48e-81c1691b3340 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:37:12.456894 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-375bad28-b4f4-4434-a48e-81c1691b3340 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:37:12.465111 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-375bad28-b4f4-4434-a48e-81c1691b3340 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:12.465608 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-375bad28-b4f4-4434-a48e-81c1691b3340 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:12.466032 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-375bad28-b4f4-4434-a48e-81c1691b3340 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:12.466731 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-375bad28-b4f4-4434-a48e-81c1691b3340 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:12.467212 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-375bad28-b4f4-4434-a48e-81c1691b3340 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:12.467659 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-375bad28-b4f4-4434-a48e-81c1691b3340 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:12.605704 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-375bad28-b4f4-4434-a48e-81c1691b3340 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:37:12.614704 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-375bad28-b4f4-4434-a48e-81c1691b3340 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1720 microversion: 2.1 time: 0.164509 Oct 17 14:37:12.615343 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3462/6785] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:37:12 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1720 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:37:13.644020 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-34dc3648-80be-4992-a991-c98d912bd1bd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:37:13.644989 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-34dc3648-80be-4992-a991-c98d912bd1bd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:37:13.656145 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-34dc3648-80be-4992-a991-c98d912bd1bd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:13.656915 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-34dc3648-80be-4992-a991-c98d912bd1bd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:13.657601 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-34dc3648-80be-4992-a991-c98d912bd1bd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:13.658675 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-34dc3648-80be-4992-a991-c98d912bd1bd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:13.659439 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-34dc3648-80be-4992-a991-c98d912bd1bd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:13.660114 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-34dc3648-80be-4992-a991-c98d912bd1bd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:13.794416 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-34dc3648-80be-4992-a991-c98d912bd1bd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:37:13.803480 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-34dc3648-80be-4992-a991-c98d912bd1bd tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1720 microversion: 2.1 time: 0.165580 Oct 17 14:37:13.804054 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3324/6786] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:37:13 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1720 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:37:14.826724 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6995d25a-fe18-4cff-8f36-3020bbb0d948 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:37:14.827503 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6995d25a-fe18-4cff-8f36-3020bbb0d948 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:37:14.835000 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6995d25a-fe18-4cff-8f36-3020bbb0d948 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:14.835521 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6995d25a-fe18-4cff-8f36-3020bbb0d948 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:14.835938 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6995d25a-fe18-4cff-8f36-3020bbb0d948 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:14.836662 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6995d25a-fe18-4cff-8f36-3020bbb0d948 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:14.837115 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6995d25a-fe18-4cff-8f36-3020bbb0d948 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:14.837581 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6995d25a-fe18-4cff-8f36-3020bbb0d948 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:14.981794 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6995d25a-fe18-4cff-8f36-3020bbb0d948 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:37:14.990892 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6995d25a-fe18-4cff-8f36-3020bbb0d948 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1720 microversion: 2.1 time: 0.168419 Oct 17 14:37:14.991554 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3463/6787] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:37:14 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1720 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:37:16.015818 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d486da9e-e36c-4604-a394-b3661a60a71d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:37:16.016391 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d486da9e-e36c-4604-a394-b3661a60a71d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:37:16.023406 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d486da9e-e36c-4604-a394-b3661a60a71d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:16.023906 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d486da9e-e36c-4604-a394-b3661a60a71d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:16.024350 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d486da9e-e36c-4604-a394-b3661a60a71d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:16.025053 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d486da9e-e36c-4604-a394-b3661a60a71d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:16.025509 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d486da9e-e36c-4604-a394-b3661a60a71d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:16.025941 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d486da9e-e36c-4604-a394-b3661a60a71d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:16.168313 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d486da9e-e36c-4604-a394-b3661a60a71d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:37:16.177543 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d486da9e-e36c-4604-a394-b3661a60a71d tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1720 microversion: 2.1 time: 0.166307 Oct 17 14:37:16.178140 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3325/6788] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:37:16 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1720 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:37:17.203688 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f3281f79-be5e-4c08-9b12-656b692b74b2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:37:17.204486 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f3281f79-be5e-4c08-9b12-656b692b74b2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:37:17.212900 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f3281f79-be5e-4c08-9b12-656b692b74b2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:17.213443 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f3281f79-be5e-4c08-9b12-656b692b74b2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:17.213927 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f3281f79-be5e-4c08-9b12-656b692b74b2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:17.214842 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f3281f79-be5e-4c08-9b12-656b692b74b2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:17.215416 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f3281f79-be5e-4c08-9b12-656b692b74b2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:17.215877 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f3281f79-be5e-4c08-9b12-656b692b74b2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:17.354145 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f3281f79-be5e-4c08-9b12-656b692b74b2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:37:17.363384 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f3281f79-be5e-4c08-9b12-656b692b74b2 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1720 microversion: 2.1 time: 0.164153 Oct 17 14:37:17.363998 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3464/6789] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:37:17 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1720 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:37:18.390619 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0e788fbe-3acf-44e5-9de3-f6e485fbef11 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:37:18.391694 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0e788fbe-3acf-44e5-9de3-f6e485fbef11 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:37:18.402983 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0e788fbe-3acf-44e5-9de3-f6e485fbef11 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:18.403507 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0e788fbe-3acf-44e5-9de3-f6e485fbef11 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:18.403946 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0e788fbe-3acf-44e5-9de3-f6e485fbef11 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:18.404646 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0e788fbe-3acf-44e5-9de3-f6e485fbef11 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:18.405101 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0e788fbe-3acf-44e5-9de3-f6e485fbef11 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:18.405523 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0e788fbe-3acf-44e5-9de3-f6e485fbef11 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:18.556620 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0e788fbe-3acf-44e5-9de3-f6e485fbef11 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:37:18.565844 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0e788fbe-3acf-44e5-9de3-f6e485fbef11 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1713 microversion: 2.1 time: 0.182446 Oct 17 14:37:18.566425 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3326/6790] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:37:18 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1713 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:37:18.588577 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ede9df27-f752-42a8-9533-0f4133654e2a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:37:18.589090 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ede9df27-f752-42a8-9533-0f4133654e2a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:37:18.596213 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ede9df27-f752-42a8-9533-0f4133654e2a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:18.596688 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ede9df27-f752-42a8-9533-0f4133654e2a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:18.597116 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ede9df27-f752-42a8-9533-0f4133654e2a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:18.597818 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ede9df27-f752-42a8-9533-0f4133654e2a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:18.598259 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ede9df27-f752-42a8-9533-0f4133654e2a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:18.598673 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ede9df27-f752-42a8-9533-0f4133654e2a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:18.740890 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ede9df27-f752-42a8-9533-0f4133654e2a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:37:18.749969 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ede9df27-f752-42a8-9533-0f4133654e2a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1713 microversion: 2.1 time: 0.165396 Oct 17 14:37:18.750552 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3465/6791] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:37:18 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1713 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:37:18.772929 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-26835096-059e-471f-a5d0-28b65f0231f1 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:37:18.773562 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-26835096-059e-471f-a5d0-28b65f0231f1 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:37:18.780033 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-26835096-059e-471f-a5d0-28b65f0231f1 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:18.780533 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-26835096-059e-471f-a5d0-28b65f0231f1 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:18.780983 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-26835096-059e-471f-a5d0-28b65f0231f1 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:18.781688 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-26835096-059e-471f-a5d0-28b65f0231f1 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:18.782158 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-26835096-059e-471f-a5d0-28b65f0231f1 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:18.782598 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-26835096-059e-471f-a5d0-28b65f0231f1 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:18.920718 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-26835096-059e-471f-a5d0-28b65f0231f1 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:37:18.933602 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-26835096-059e-471f-a5d0-28b65f0231f1 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1713 microversion: 2.1 time: 0.164362 Oct 17 14:37:18.934403 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3327/6792] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:37:18 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1713 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:37:18.956290 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-959b1ec8-1f1f-479c-9656-132bfb18ae66 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:37:18.956799 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-959b1ec8-1f1f-479c-9656-132bfb18ae66 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:37:18.963202 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-959b1ec8-1f1f-479c-9656-132bfb18ae66 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:18.963726 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-959b1ec8-1f1f-479c-9656-132bfb18ae66 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:18.964165 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-959b1ec8-1f1f-479c-9656-132bfb18ae66 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:18.964906 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-959b1ec8-1f1f-479c-9656-132bfb18ae66 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:18.965367 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-959b1ec8-1f1f-479c-9656-132bfb18ae66 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:18.965888 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-959b1ec8-1f1f-479c-9656-132bfb18ae66 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:18.992612 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-959b1ec8-1f1f-479c-9656-132bfb18ae66 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:37:19.080588 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-959b1ec8-1f1f-479c-9656-132bfb18ae66 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "DELETE /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 204 len: 0 microversion: 2.1 time: 0.127992 Oct 17 14:37:19.081193 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3466/6793] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:37:18 2022] DELETE /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:37:19.090987 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b866571a-df91-4883-bba3-5fa1d80764cc tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:37:19.091644 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b866571a-df91-4883-bba3-5fa1d80764cc tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:37:19.098062 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b866571a-df91-4883-bba3-5fa1d80764cc tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:19.098569 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b866571a-df91-4883-bba3-5fa1d80764cc tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:19.099018 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b866571a-df91-4883-bba3-5fa1d80764cc tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:19.099770 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b866571a-df91-4883-bba3-5fa1d80764cc tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:19.100231 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b866571a-df91-4883-bba3-5fa1d80764cc tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:19.100670 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b866571a-df91-4883-bba3-5fa1d80764cc tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:19.103448 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:37:19.242710 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b866571a-df91-4883-bba3-5fa1d80764cc tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:37:19.253073 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b866571a-df91-4883-bba3-5fa1d80764cc tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1719 microversion: 2.1 time: 0.166621 Oct 17 14:37:19.253655 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3328/6794] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:37:19 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1719 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:37:20.278502 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-48f07fff-2ca6-4d72-a7af-36d84ab5c8ac tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:37:20.279432 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-48f07fff-2ca6-4d72-a7af-36d84ab5c8ac tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:37:20.287003 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48f07fff-2ca6-4d72-a7af-36d84ab5c8ac tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:20.287520 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48f07fff-2ca6-4d72-a7af-36d84ab5c8ac tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:20.287965 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48f07fff-2ca6-4d72-a7af-36d84ab5c8ac tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:20.288671 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48f07fff-2ca6-4d72-a7af-36d84ab5c8ac tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:20.289155 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48f07fff-2ca6-4d72-a7af-36d84ab5c8ac tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:20.289555 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-48f07fff-2ca6-4d72-a7af-36d84ab5c8ac tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:20.425677 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-48f07fff-2ca6-4d72-a7af-36d84ab5c8ac tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:37:20.428094 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:37:20.435825 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-48f07fff-2ca6-4d72-a7af-36d84ab5c8ac tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1719 microversion: 2.1 time: 0.161729 Oct 17 14:37:20.436724 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3467/6795] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:37:20 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1719 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:37:21.443419 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-e5f54afa-02e2-4bb6-9f7b-4dce7550147f req-4e8dc6ff-25b4-4ad0-aaa8-dec505c80dff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcf4b7ae-0a6f-4a5e-a607-463e2354615c", "name": "network-vif-deleted", "tag": "2524073a-3e43-497d-a3d9-b7266a8a4bd1"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:37:21.456621 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-e5f54afa-02e2-4bb6-9f7b-4dce7550147f req-4e8dc6ff-25b4-4ad0-aaa8-dec505c80dff service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:21.457130 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-e5f54afa-02e2-4bb6-9f7b-4dce7550147f req-4e8dc6ff-25b4-4ad0-aaa8-dec505c80dff service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:21.457566 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-e5f54afa-02e2-4bb6-9f7b-4dce7550147f req-4e8dc6ff-25b4-4ad0-aaa8-dec505c80dff service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:21.460699 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-54024a78-9793-4dc8-a80e-8a8c0b0c78a5 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:37:21.461931 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-54024a78-9793-4dc8-a80e-8a8c0b0c78a5 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:37:21.471660 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-54024a78-9793-4dc8-a80e-8a8c0b0c78a5 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:21.471954 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-e5f54afa-02e2-4bb6-9f7b-4dce7550147f req-4e8dc6ff-25b4-4ad0-aaa8-dec505c80dff service nova] Creating event network-vif-deleted:2524073a-3e43-497d-a3d9-b7266a8a4bd1 for instance dcf4b7ae-0a6f-4a5e-a607-463e2354615c on n-h1-854247-14 Oct 17 14:37:21.472590 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-54024a78-9793-4dc8-a80e-8a8c0b0c78a5 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:21.473212 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-54024a78-9793-4dc8-a80e-8a8c0b0c78a5 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:21.473927 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-54024a78-9793-4dc8-a80e-8a8c0b0c78a5 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:21.474377 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-54024a78-9793-4dc8-a80e-8a8c0b0c78a5 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:21.474788 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-54024a78-9793-4dc8-a80e-8a8c0b0c78a5 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:21.478036 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-e5f54afa-02e2-4bb6-9f7b-4dce7550147f req-4e8dc6ff-25b4-4ad0-aaa8-dec505c80dff service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039010 Oct 17 14:37:21.479122 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3329/6796] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:37:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:37:21.568139 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-54024a78-9793-4dc8-a80e-8a8c0b0c78a5 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:37:21.583404 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-54024a78-9793-4dc8-a80e-8a8c0b0c78a5 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1369 microversion: 2.1 time: 0.126557 Oct 17 14:37:21.583866 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3468/6797] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:37:21 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1369 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:37:22.606773 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-72540775-9537-440c-9b43-53e4a06bbb3f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:37:22.607913 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-72540775-9537-440c-9b43-53e4a06bbb3f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:37:22.615882 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-72540775-9537-440c-9b43-53e4a06bbb3f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:22.616329 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-72540775-9537-440c-9b43-53e4a06bbb3f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:22.616801 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-72540775-9537-440c-9b43-53e4a06bbb3f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:22.617540 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-72540775-9537-440c-9b43-53e4a06bbb3f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:22.618063 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-72540775-9537-440c-9b43-53e4a06bbb3f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:22.618495 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-72540775-9537-440c-9b43-53e4a06bbb3f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:22.684031 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-72540775-9537-440c-9b43-53e4a06bbb3f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:37:22.694071 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-72540775-9537-440c-9b43-53e4a06bbb3f tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1369 microversion: 2.1 time: 0.091635 Oct 17 14:37:22.694677 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3330/6798] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:37:22 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:37:23.718299 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-38ead7d4-46d5-4bc6-a109-71e36321fa3a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:37:23.719334 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-38ead7d4-46d5-4bc6-a109-71e36321fa3a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:37:23.726682 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-38ead7d4-46d5-4bc6-a109-71e36321fa3a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:23.727305 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-38ead7d4-46d5-4bc6-a109-71e36321fa3a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:23.727746 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-38ead7d4-46d5-4bc6-a109-71e36321fa3a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:23.728453 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-38ead7d4-46d5-4bc6-a109-71e36321fa3a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:23.728906 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-38ead7d4-46d5-4bc6-a109-71e36321fa3a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:23.729329 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-38ead7d4-46d5-4bc6-a109-71e36321fa3a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:23.793948 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-38ead7d4-46d5-4bc6-a109-71e36321fa3a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:37:23.803347 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-38ead7d4-46d5-4bc6-a109-71e36321fa3a tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1369 microversion: 2.1 time: 0.089092 Oct 17 14:37:23.804266 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3469/6799] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:37:23 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:37:24.826392 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7d01d385-69a4-41ed-9886-95e4a4d0379b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:37:24.827105 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7d01d385-69a4-41ed-9886-95e4a4d0379b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:37:24.835154 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7d01d385-69a4-41ed-9886-95e4a4d0379b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:24.835816 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7d01d385-69a4-41ed-9886-95e4a4d0379b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:24.836348 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7d01d385-69a4-41ed-9886-95e4a4d0379b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:24.837159 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7d01d385-69a4-41ed-9886-95e4a4d0379b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:24.837693 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7d01d385-69a4-41ed-9886-95e4a4d0379b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:24.838199 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7d01d385-69a4-41ed-9886-95e4a4d0379b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:24.901798 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7d01d385-69a4-41ed-9886-95e4a4d0379b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:37:24.910814 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7d01d385-69a4-41ed-9886-95e4a4d0379b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1369 microversion: 2.1 time: 0.088429 Oct 17 14:37:24.911533 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3331/6800] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:37:24 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:37:25.937358 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-692e57a2-59f7-444f-877c-101730b6d91e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:37:25.937910 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-692e57a2-59f7-444f-877c-101730b6d91e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:37:25.941668 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:37:25.947491 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-692e57a2-59f7-444f-877c-101730b6d91e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:25.947977 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-692e57a2-59f7-444f-877c-101730b6d91e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:25.948451 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-692e57a2-59f7-444f-877c-101730b6d91e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:25.949153 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-692e57a2-59f7-444f-877c-101730b6d91e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:25.949610 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-692e57a2-59f7-444f-877c-101730b6d91e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:25.950034 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-692e57a2-59f7-444f-877c-101730b6d91e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:25.984765 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-692e57a2-59f7-444f-877c-101730b6d91e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:25.985249 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-692e57a2-59f7-444f-877c-101730b6d91e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:25.985688 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-692e57a2-59f7-444f-877c-101730b6d91e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:25.986135 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-692e57a2-59f7-444f-877c-101730b6d91e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lazy-loading 'fault' on Instance uuid dcf4b7ae-0a6f-4a5e-a607-463e2354615c {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:37:26.030373 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-692e57a2-59f7-444f-877c-101730b6d91e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad69a4e71c9e425fac89ec047eda43de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6312d6ad74bb476384426e63c1ec7ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:37:26.039543 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-692e57a2-59f7-444f-877c-101730b6d91e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 200 len: 1374 microversion: 2.1 time: 0.107641 Oct 17 14:37:26.040136 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3470/6801] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:37:25 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 1374 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:37:27.064523 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ed897b62-0ec2-40ea-b58c-6cea658acbb8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:37:27.065429 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ed897b62-0ec2-40ea-b58c-6cea658acbb8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:37:27.068657 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:37:27.075214 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ed897b62-0ec2-40ea-b58c-6cea658acbb8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:27.075844 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ed897b62-0ec2-40ea-b58c-6cea658acbb8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:27.076357 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ed897b62-0ec2-40ea-b58c-6cea658acbb8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:27.077256 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ed897b62-0ec2-40ea-b58c-6cea658acbb8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:27.077956 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ed897b62-0ec2-40ea-b58c-6cea658acbb8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:27.078522 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ed897b62-0ec2-40ea-b58c-6cea658acbb8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:27.093556 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-ed897b62-0ec2-40ea-b58c-6cea658acbb8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] HTTP exception thrown: Instance dcf4b7ae-0a6f-4a5e-a607-463e2354615c could not be found. Oct 17 14:37:27.095286 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ed897b62-0ec2-40ea-b58c-6cea658acbb8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Request method failure captured: Oct 17 14:37:27.095286 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c HTTP/1.1 Oct 17 14:37:27.095286 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 14:37:27.095286 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 14:37:27.095286 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 14:37:27.095286 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 14:37:27.095286 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 14:37:27.095286 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 14:37:27.095286 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 14:37:27.095286 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 14:37:27.095286 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTWdVpabWT0Tbgf-QQ83Tq8AQGY8AcL_35cr_ansrTOmg5gYS9o-61drx7tYvn26ecQi5aoad2YeNf-Jm0l5MKteHOkMgnybFs17aOJ7G5iYUyXMaYulLqf3oAKSRqw_FkZniUVR3fFPKjmYjBguT22mJaxMSuqSX_P9X-IGsLXSZ0Uc Oct 17 14:37:27.095286 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 14:37:27.095286 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 14:37:27.095286 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 14:37:27.095286 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 14:37:27.095286 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 14:37:27.095286 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 14:37:27.095286 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 6312d6ad74bb476384426e63c1ec7ae5 Oct 17 14:37:27.095286 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServerActionsTestJSON-207618724 Oct 17 14:37:27.095286 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 14:37:27.095286 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 14:37:27.095286 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6312d6ad74bb476384426e63c1ec7ae5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6312d6ad74bb476384426e63c1ec7ae5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6312d6ad74bb476384426e63c1ec7ae5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6312d6ad74bb476384426e63c1ec7ae5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:37:27.095286 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServerActionsTestJSON-207618724 Oct 17 14:37:27.095286 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 6312d6ad74bb476384426e63c1ec7ae5 Oct 17 14:37:27.095286 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServerActionsTestJSON-207618724 Oct 17 14:37:27.095286 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServerActionsTestJSON-207618724-project Oct 17 14:37:27.095286 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 14:37:27.095286 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 14:37:27.095286 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: ad69a4e71c9e425fac89ec047eda43de Oct 17 14:37:27.095286 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServerActionsTestJSON-207618724-project Oct 17 14:37:27.095286 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 14:37:27.095286 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance dcf4b7ae-0a6f-4a5e-a607-463e2354615c could not be found. Oct 17 14:37:27.095286 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'dcf4b7ae-0a6f-4a5e-a607-463e2354615c'} Oct 17 14:37:27.095286 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:37:27.095286 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:37:27.095286 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:37:27.095286 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:37:27.095286 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:37:27.095286 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:37:27.095286 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:37:27.095286 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:37:27.095286 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:37:27.095286 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:37:27.095286 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcf4b7ae-0a6f-4a5e-a607-463e2354615c could not be found. Oct 17 14:37:27.095286 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:37:27.095286 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:37:27.095286 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:37:27.095286 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:37:27.095286 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:37:27.095286 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:37:27.095286 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:37:27.095286 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:37:27.095286 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:37:27.095286 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:37:27.095286 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:37:27.095286 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:37:27.095286 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:37:27.095286 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:37:27.095286 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:37:27.095286 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:37:27.095286 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcf4b7ae-0a6f-4a5e-a607-463e2354615c could not be found. Oct 17 14:37:27.095286 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:37:27.095286 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:37:27.095286 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:37:27.100339 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:37:27.100339 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:37:27.100339 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:37:27.100339 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:37:27.100339 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:37:27.100339 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcf4b7ae-0a6f-4a5e-a607-463e2354615c could not be found. Oct 17 14:37:27.100339 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:37:27.100339 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ed897b62-0ec2-40ea-b58c-6cea658acbb8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Returning 404 to user: Instance dcf4b7ae-0a6f-4a5e-a607-463e2354615c could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:37:27.100339 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ed897b62-0ec2-40ea-b58c-6cea658acbb8 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 404 len: 111 microversion: 2.1 time: 0.036951 Oct 17 14:37:27.100339 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3332/6802] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:37:27 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:37:27.162537 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f83e4900-80ae-4cd7-8cee-8b0ed2a68303 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:37:27.164964 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f83e4900-80ae-4cd7-8cee-8b0ed2a68303 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:37:27.172029 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f83e4900-80ae-4cd7-8cee-8b0ed2a68303 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:27.172508 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f83e4900-80ae-4cd7-8cee-8b0ed2a68303 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:27.172937 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f83e4900-80ae-4cd7-8cee-8b0ed2a68303 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:27.173628 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f83e4900-80ae-4cd7-8cee-8b0ed2a68303 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:27.174075 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f83e4900-80ae-4cd7-8cee-8b0ed2a68303 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:27.174490 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f83e4900-80ae-4cd7-8cee-8b0ed2a68303 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:27.187535 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-f83e4900-80ae-4cd7-8cee-8b0ed2a68303 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] HTTP exception thrown: Instance dcf4b7ae-0a6f-4a5e-a607-463e2354615c could not be found. Oct 17 14:37:27.189235 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f83e4900-80ae-4cd7-8cee-8b0ed2a68303 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Request method failure captured: Oct 17 14:37:27.189235 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c/os-volume_attachments HTTP/1.1 Oct 17 14:37:27.189235 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 14:37:27.189235 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 14:37:27.189235 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 14:37:27.189235 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 14:37:27.189235 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 14:37:27.189235 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 14:37:27.189235 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 14:37:27.189235 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 14:37:27.189235 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTWdVpabWT0Tbgf-QQ83Tq8AQGY8AcL_35cr_ansrTOmg5gYS9o-61drx7tYvn26ecQi5aoad2YeNf-Jm0l5MKteHOkMgnybFs17aOJ7G5iYUyXMaYulLqf3oAKSRqw_FkZniUVR3fFPKjmYjBguT22mJaxMSuqSX_P9X-IGsLXSZ0Uc Oct 17 14:37:27.189235 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 14:37:27.189235 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 14:37:27.189235 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 14:37:27.189235 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 14:37:27.189235 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 14:37:27.189235 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 14:37:27.189235 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 6312d6ad74bb476384426e63c1ec7ae5 Oct 17 14:37:27.189235 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServerActionsTestJSON-207618724 Oct 17 14:37:27.189235 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 14:37:27.189235 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 14:37:27.189235 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6312d6ad74bb476384426e63c1ec7ae5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6312d6ad74bb476384426e63c1ec7ae5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6312d6ad74bb476384426e63c1ec7ae5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6312d6ad74bb476384426e63c1ec7ae5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:37:27.189235 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServerActionsTestJSON-207618724 Oct 17 14:37:27.189235 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 6312d6ad74bb476384426e63c1ec7ae5 Oct 17 14:37:27.189235 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServerActionsTestJSON-207618724 Oct 17 14:37:27.189235 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServerActionsTestJSON-207618724-project Oct 17 14:37:27.189235 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 14:37:27.189235 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 14:37:27.189235 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: ad69a4e71c9e425fac89ec047eda43de Oct 17 14:37:27.189235 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServerActionsTestJSON-207618724-project Oct 17 14:37:27.189235 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 14:37:27.189235 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance dcf4b7ae-0a6f-4a5e-a607-463e2354615c could not be found. Oct 17 14:37:27.189235 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'server_id': 'dcf4b7ae-0a6f-4a5e-a607-463e2354615c'} Oct 17 14:37:27.189235 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:37:27.189235 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:37:27.189235 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:37:27.189235 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:37:27.189235 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:37:27.189235 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:37:27.189235 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:37:27.189235 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:37:27.189235 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:37:27.189235 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:37:27.189235 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcf4b7ae-0a6f-4a5e-a607-463e2354615c could not be found. Oct 17 14:37:27.189235 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:37:27.189235 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:37:27.189235 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:37:27.189235 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:37:27.189235 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:37:27.189235 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:37:27.189235 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:37:27.189235 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:37:27.189235 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:37:27.189235 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:37:27.189235 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 14:37:27.189235 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 14:37:27.189235 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 14:37:27.189235 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 14:37:27.189235 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 17 14:37:27.189235 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 17 14:37:27.189235 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:37:27.189235 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:37:27.194494 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcf4b7ae-0a6f-4a5e-a607-463e2354615c could not be found. Oct 17 14:37:27.194494 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:37:27.194494 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:37:27.194494 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:37:27.194494 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:37:27.194494 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:37:27.194494 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:37:27.194494 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:37:27.194494 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:37:27.194494 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcf4b7ae-0a6f-4a5e-a607-463e2354615c could not be found. Oct 17 14:37:27.194494 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:37:27.194494 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f83e4900-80ae-4cd7-8cee-8b0ed2a68303 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Returning 404 to user: Instance dcf4b7ae-0a6f-4a5e-a607-463e2354615c could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:37:27.194494 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f83e4900-80ae-4cd7-8cee-8b0ed2a68303 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033483 Oct 17 14:37:27.194494 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3471/6803] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 14:37:27 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:37:30.543767 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-150e8f85-d577-40d2-be75-2edff0a715b0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:37:30.544336 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-150e8f85-d577-40d2-be75-2edff0a715b0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:37:30.551719 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-150e8f85-d577-40d2-be75-2edff0a715b0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:30.552255 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-150e8f85-d577-40d2-be75-2edff0a715b0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:30.552714 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-150e8f85-d577-40d2-be75-2edff0a715b0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:30.553441 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-150e8f85-d577-40d2-be75-2edff0a715b0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:30.553902 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-150e8f85-d577-40d2-be75-2edff0a715b0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:30.554339 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-150e8f85-d577-40d2-be75-2edff0a715b0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:30.568875 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-150e8f85-d577-40d2-be75-2edff0a715b0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] HTTP exception thrown: Instance dcf4b7ae-0a6f-4a5e-a607-463e2354615c could not be found. Oct 17 14:37:30.570499 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-150e8f85-d577-40d2-be75-2edff0a715b0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Request method failure captured: Oct 17 14:37:30.570499 n-d-854247-14 devstack@n-api.service[127017]: request: DELETE /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c HTTP/1.1 Oct 17 14:37:30.570499 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 14:37:30.570499 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 14:37:30.570499 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 14:37:30.570499 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 14:37:30.570499 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 14:37:30.570499 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 14:37:30.570499 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 14:37:30.570499 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 14:37:30.570499 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTWdVpabWT0Tbgf-QQ83Tq8AQGY8AcL_35cr_ansrTOmg5gYS9o-61drx7tYvn26ecQi5aoad2YeNf-Jm0l5MKteHOkMgnybFs17aOJ7G5iYUyXMaYulLqf3oAKSRqw_FkZniUVR3fFPKjmYjBguT22mJaxMSuqSX_P9X-IGsLXSZ0Uc Oct 17 14:37:30.570499 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 14:37:30.570499 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 14:37:30.570499 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 14:37:30.570499 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 14:37:30.570499 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 14:37:30.570499 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 14:37:30.570499 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 6312d6ad74bb476384426e63c1ec7ae5 Oct 17 14:37:30.570499 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServerActionsTestJSON-207618724 Oct 17 14:37:30.570499 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 14:37:30.570499 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 14:37:30.570499 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6312d6ad74bb476384426e63c1ec7ae5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6312d6ad74bb476384426e63c1ec7ae5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6312d6ad74bb476384426e63c1ec7ae5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6312d6ad74bb476384426e63c1ec7ae5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:37:30.570499 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServerActionsTestJSON-207618724 Oct 17 14:37:30.570499 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 6312d6ad74bb476384426e63c1ec7ae5 Oct 17 14:37:30.570499 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServerActionsTestJSON-207618724 Oct 17 14:37:30.570499 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServerActionsTestJSON-207618724-project Oct 17 14:37:30.570499 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 14:37:30.570499 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 14:37:30.570499 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: ad69a4e71c9e425fac89ec047eda43de Oct 17 14:37:30.570499 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServerActionsTestJSON-207618724-project Oct 17 14:37:30.570499 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 14:37:30.570499 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance dcf4b7ae-0a6f-4a5e-a607-463e2354615c could not be found. Oct 17 14:37:30.570499 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'dcf4b7ae-0a6f-4a5e-a607-463e2354615c'} Oct 17 14:37:30.570499 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:37:30.570499 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:37:30.570499 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:37:30.570499 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:37:30.570499 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:37:30.570499 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:37:30.570499 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:37:30.570499 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:37:30.570499 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:37:30.570499 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:37:30.570499 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcf4b7ae-0a6f-4a5e-a607-463e2354615c could not be found. Oct 17 14:37:30.570499 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:37:30.570499 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:37:30.570499 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:37:30.570499 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:37:30.570499 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:37:30.570499 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:37:30.570499 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:37:30.570499 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:37:30.570499 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:37:30.570499 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:37:30.570499 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 14:37:30.570499 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 14:37:30.570499 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 14:37:30.570499 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 14:37:30.570499 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:37:30.570499 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:37:30.570499 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:37:30.570499 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:37:30.574380 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcf4b7ae-0a6f-4a5e-a607-463e2354615c could not be found. Oct 17 14:37:30.574380 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:37:30.574380 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:37:30.574380 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:37:30.574380 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:37:30.574380 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:37:30.574380 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:37:30.574380 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:37:30.574380 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:37:30.574380 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcf4b7ae-0a6f-4a5e-a607-463e2354615c could not be found. Oct 17 14:37:30.574380 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:37:30.574380 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-150e8f85-d577-40d2-be75-2edff0a715b0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Returning 404 to user: Instance dcf4b7ae-0a6f-4a5e-a607-463e2354615c could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:37:30.574380 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-150e8f85-d577-40d2-be75-2edff0a715b0 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "DELETE /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 404 len: 111 microversion: 2.1 time: 0.034898 Oct 17 14:37:30.574380 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3333/6804] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:37:30 2022] DELETE /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:37:30.581145 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3c8621b3-7dd4-49dc-a9d6-89904dc3efc4 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:37:30.581704 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3c8621b3-7dd4-49dc-a9d6-89904dc3efc4 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: dcf4b7ae-0a6f-4a5e-a607-463e2354615c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:37:30.589369 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3c8621b3-7dd4-49dc-a9d6-89904dc3efc4 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:30.589863 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3c8621b3-7dd4-49dc-a9d6-89904dc3efc4 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:30.590309 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3c8621b3-7dd4-49dc-a9d6-89904dc3efc4 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:30.591013 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3c8621b3-7dd4-49dc-a9d6-89904dc3efc4 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:30.591503 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3c8621b3-7dd4-49dc-a9d6-89904dc3efc4 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:30.591931 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3c8621b3-7dd4-49dc-a9d6-89904dc3efc4 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:30.606424 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-3c8621b3-7dd4-49dc-a9d6-89904dc3efc4 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] HTTP exception thrown: Instance dcf4b7ae-0a6f-4a5e-a607-463e2354615c could not be found. Oct 17 14:37:30.608196 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3c8621b3-7dd4-49dc-a9d6-89904dc3efc4 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Request method failure captured: Oct 17 14:37:30.608196 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c HTTP/1.1 Oct 17 14:37:30.608196 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 14:37:30.608196 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 14:37:30.608196 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 14:37:30.608196 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 14:37:30.608196 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 14:37:30.608196 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 14:37:30.608196 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 14:37:30.608196 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 14:37:30.608196 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTWdVpabWT0Tbgf-QQ83Tq8AQGY8AcL_35cr_ansrTOmg5gYS9o-61drx7tYvn26ecQi5aoad2YeNf-Jm0l5MKteHOkMgnybFs17aOJ7G5iYUyXMaYulLqf3oAKSRqw_FkZniUVR3fFPKjmYjBguT22mJaxMSuqSX_P9X-IGsLXSZ0Uc Oct 17 14:37:30.608196 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 14:37:30.608196 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 14:37:30.608196 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 14:37:30.608196 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 14:37:30.608196 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 14:37:30.608196 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 14:37:30.608196 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 6312d6ad74bb476384426e63c1ec7ae5 Oct 17 14:37:30.608196 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServerActionsTestJSON-207618724 Oct 17 14:37:30.608196 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 14:37:30.608196 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 14:37:30.608196 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6312d6ad74bb476384426e63c1ec7ae5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6312d6ad74bb476384426e63c1ec7ae5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6312d6ad74bb476384426e63c1ec7ae5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6312d6ad74bb476384426e63c1ec7ae5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:37:30.608196 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServerActionsTestJSON-207618724 Oct 17 14:37:30.608196 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 6312d6ad74bb476384426e63c1ec7ae5 Oct 17 14:37:30.608196 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServerActionsTestJSON-207618724 Oct 17 14:37:30.608196 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServerActionsTestJSON-207618724-project Oct 17 14:37:30.608196 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 14:37:30.608196 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 14:37:30.608196 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: ad69a4e71c9e425fac89ec047eda43de Oct 17 14:37:30.608196 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServerActionsTestJSON-207618724-project Oct 17 14:37:30.608196 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 14:37:30.608196 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance dcf4b7ae-0a6f-4a5e-a607-463e2354615c could not be found. Oct 17 14:37:30.608196 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'dcf4b7ae-0a6f-4a5e-a607-463e2354615c'} Oct 17 14:37:30.608196 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:37:30.608196 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:37:30.608196 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:37:30.608196 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:37:30.608196 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:37:30.608196 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:37:30.608196 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:37:30.608196 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:37:30.608196 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:37:30.608196 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:37:30.608196 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcf4b7ae-0a6f-4a5e-a607-463e2354615c could not be found. Oct 17 14:37:30.608196 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:37:30.608196 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:37:30.608196 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:37:30.608196 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:37:30.608196 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:37:30.608196 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:37:30.608196 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:37:30.608196 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:37:30.608196 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:37:30.608196 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:37:30.608196 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:37:30.608196 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:37:30.608196 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:37:30.608196 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:37:30.608196 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:37:30.608196 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:37:30.608196 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcf4b7ae-0a6f-4a5e-a607-463e2354615c could not be found. Oct 17 14:37:30.608196 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:37:30.608196 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:37:30.608196 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:37:30.612195 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:37:30.612195 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:37:30.612195 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:37:30.612195 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:37:30.612195 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:37:30.612195 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcf4b7ae-0a6f-4a5e-a607-463e2354615c could not be found. Oct 17 14:37:30.612195 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:37:30.612195 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3c8621b3-7dd4-49dc-a9d6-89904dc3efc4 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Returning 404 to user: Instance dcf4b7ae-0a6f-4a5e-a607-463e2354615c could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:37:30.612195 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3c8621b3-7dd4-49dc-a9d6-89904dc3efc4 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c" status: 404 len: 111 microversion: 2.1 time: 0.032708 Oct 17 14:37:30.612195 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3472/6805] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:37:30 2022] GET /compute/v2.1/servers/dcf4b7ae-0a6f-4a5e-a607-463e2354615c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:37:30.618686 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-32dfeafd-bddd-4778-9917-d3994661210b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:37:30.619280 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-32dfeafd-bddd-4778-9917-d3994661210b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: cda83126-328f-4131-995d-a3ed5e64f5cb] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:37:30.625747 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-32dfeafd-bddd-4778-9917-d3994661210b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:30.626262 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-32dfeafd-bddd-4778-9917-d3994661210b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:30.626732 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-32dfeafd-bddd-4778-9917-d3994661210b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:30.627473 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-32dfeafd-bddd-4778-9917-d3994661210b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:30.627938 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-32dfeafd-bddd-4778-9917-d3994661210b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:30.628388 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-32dfeafd-bddd-4778-9917-d3994661210b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:30.643508 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-32dfeafd-bddd-4778-9917-d3994661210b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] HTTP exception thrown: Instance cda83126-328f-4131-995d-a3ed5e64f5cb could not be found. Oct 17 14:37:30.645449 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-32dfeafd-bddd-4778-9917-d3994661210b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Request method failure captured: Oct 17 14:37:30.645449 n-d-854247-14 devstack@n-api.service[127017]: request: DELETE /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb HTTP/1.1 Oct 17 14:37:30.645449 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 14:37:30.645449 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 14:37:30.645449 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 14:37:30.645449 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 14:37:30.645449 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 14:37:30.645449 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 14:37:30.645449 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 14:37:30.645449 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 14:37:30.645449 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTWdVpabWT0Tbgf-QQ83Tq8AQGY8AcL_35cr_ansrTOmg5gYS9o-61drx7tYvn26ecQi5aoad2YeNf-Jm0l5MKteHOkMgnybFs17aOJ7G5iYUyXMaYulLqf3oAKSRqw_FkZniUVR3fFPKjmYjBguT22mJaxMSuqSX_P9X-IGsLXSZ0Uc Oct 17 14:37:30.645449 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 14:37:30.645449 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 14:37:30.645449 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 14:37:30.645449 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 14:37:30.645449 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 14:37:30.645449 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 14:37:30.645449 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 6312d6ad74bb476384426e63c1ec7ae5 Oct 17 14:37:30.645449 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServerActionsTestJSON-207618724 Oct 17 14:37:30.645449 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 14:37:30.645449 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 14:37:30.645449 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6312d6ad74bb476384426e63c1ec7ae5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6312d6ad74bb476384426e63c1ec7ae5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6312d6ad74bb476384426e63c1ec7ae5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6312d6ad74bb476384426e63c1ec7ae5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:37:30.645449 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServerActionsTestJSON-207618724 Oct 17 14:37:30.645449 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 6312d6ad74bb476384426e63c1ec7ae5 Oct 17 14:37:30.645449 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServerActionsTestJSON-207618724 Oct 17 14:37:30.645449 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServerActionsTestJSON-207618724-project Oct 17 14:37:30.645449 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 14:37:30.645449 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 14:37:30.645449 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: ad69a4e71c9e425fac89ec047eda43de Oct 17 14:37:30.645449 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServerActionsTestJSON-207618724-project Oct 17 14:37:30.645449 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 14:37:30.645449 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance cda83126-328f-4131-995d-a3ed5e64f5cb could not be found. Oct 17 14:37:30.645449 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'cda83126-328f-4131-995d-a3ed5e64f5cb'} Oct 17 14:37:30.645449 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:37:30.645449 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:37:30.645449 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:37:30.645449 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:37:30.645449 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:37:30.645449 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:37:30.645449 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:37:30.645449 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:37:30.645449 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:37:30.645449 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:37:30.645449 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cda83126-328f-4131-995d-a3ed5e64f5cb could not be found. Oct 17 14:37:30.645449 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:37:30.645449 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:37:30.645449 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:37:30.645449 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:37:30.645449 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:37:30.645449 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:37:30.645449 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:37:30.645449 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:37:30.645449 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:37:30.645449 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:37:30.645449 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 14:37:30.645449 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 14:37:30.645449 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 14:37:30.645449 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 14:37:30.645449 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:37:30.645449 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:37:30.645449 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:37:30.645449 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:37:30.650143 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cda83126-328f-4131-995d-a3ed5e64f5cb could not be found. Oct 17 14:37:30.650143 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:37:30.650143 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:37:30.650143 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:37:30.650143 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:37:30.650143 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:37:30.650143 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:37:30.650143 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:37:30.650143 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:37:30.650143 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cda83126-328f-4131-995d-a3ed5e64f5cb could not be found. Oct 17 14:37:30.650143 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:37:30.650143 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-32dfeafd-bddd-4778-9917-d3994661210b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Returning 404 to user: Instance cda83126-328f-4131-995d-a3ed5e64f5cb could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:37:30.650143 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-32dfeafd-bddd-4778-9917-d3994661210b tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "DELETE /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb" status: 404 len: 111 microversion: 2.1 time: 0.032256 Oct 17 14:37:30.650143 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3334/6806] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:37:30 2022] DELETE /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:37:30.655964 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ac8f7760-b2a6-49f4-b162-1b656cfd2eb3 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:37:30.656595 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ac8f7760-b2a6-49f4-b162-1b656cfd2eb3 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: cda83126-328f-4131-995d-a3ed5e64f5cb] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:37:30.663226 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ac8f7760-b2a6-49f4-b162-1b656cfd2eb3 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:30.663833 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ac8f7760-b2a6-49f4-b162-1b656cfd2eb3 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:30.664240 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ac8f7760-b2a6-49f4-b162-1b656cfd2eb3 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:30.664968 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ac8f7760-b2a6-49f4-b162-1b656cfd2eb3 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:30.665420 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ac8f7760-b2a6-49f4-b162-1b656cfd2eb3 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:30.665849 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ac8f7760-b2a6-49f4-b162-1b656cfd2eb3 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:30.680318 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-ac8f7760-b2a6-49f4-b162-1b656cfd2eb3 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] HTTP exception thrown: Instance cda83126-328f-4131-995d-a3ed5e64f5cb could not be found. Oct 17 14:37:30.681907 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ac8f7760-b2a6-49f4-b162-1b656cfd2eb3 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Request method failure captured: Oct 17 14:37:30.681907 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb HTTP/1.1 Oct 17 14:37:30.681907 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 14:37:30.681907 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 14:37:30.681907 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 14:37:30.681907 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 14:37:30.681907 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 14:37:30.681907 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 14:37:30.681907 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 14:37:30.681907 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 14:37:30.681907 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTWdVpabWT0Tbgf-QQ83Tq8AQGY8AcL_35cr_ansrTOmg5gYS9o-61drx7tYvn26ecQi5aoad2YeNf-Jm0l5MKteHOkMgnybFs17aOJ7G5iYUyXMaYulLqf3oAKSRqw_FkZniUVR3fFPKjmYjBguT22mJaxMSuqSX_P9X-IGsLXSZ0Uc Oct 17 14:37:30.681907 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 14:37:30.681907 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 14:37:30.681907 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 14:37:30.681907 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 14:37:30.681907 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 14:37:30.681907 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 14:37:30.681907 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 6312d6ad74bb476384426e63c1ec7ae5 Oct 17 14:37:30.681907 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServerActionsTestJSON-207618724 Oct 17 14:37:30.681907 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 14:37:30.681907 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 14:37:30.681907 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6312d6ad74bb476384426e63c1ec7ae5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6312d6ad74bb476384426e63c1ec7ae5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6312d6ad74bb476384426e63c1ec7ae5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6312d6ad74bb476384426e63c1ec7ae5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:37:30.681907 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServerActionsTestJSON-207618724 Oct 17 14:37:30.681907 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 6312d6ad74bb476384426e63c1ec7ae5 Oct 17 14:37:30.681907 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServerActionsTestJSON-207618724 Oct 17 14:37:30.681907 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServerActionsTestJSON-207618724-project Oct 17 14:37:30.681907 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 14:37:30.681907 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 14:37:30.681907 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: ad69a4e71c9e425fac89ec047eda43de Oct 17 14:37:30.681907 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServerActionsTestJSON-207618724-project Oct 17 14:37:30.681907 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 14:37:30.681907 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance cda83126-328f-4131-995d-a3ed5e64f5cb could not be found. Oct 17 14:37:30.681907 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'cda83126-328f-4131-995d-a3ed5e64f5cb'} Oct 17 14:37:30.681907 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:37:30.681907 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:37:30.681907 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:37:30.681907 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:37:30.681907 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:37:30.681907 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:37:30.681907 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:37:30.681907 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:37:30.681907 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:37:30.681907 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:37:30.681907 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cda83126-328f-4131-995d-a3ed5e64f5cb could not be found. Oct 17 14:37:30.681907 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:37:30.681907 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:37:30.681907 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:37:30.681907 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:37:30.681907 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:37:30.681907 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:37:30.681907 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:37:30.681907 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:37:30.681907 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:37:30.681907 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:37:30.681907 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:37:30.681907 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:37:30.681907 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:37:30.681907 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:37:30.681907 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:37:30.681907 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:37:30.681907 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cda83126-328f-4131-995d-a3ed5e64f5cb could not be found. Oct 17 14:37:30.681907 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:37:30.681907 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:37:30.681907 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:37:30.686522 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:37:30.686522 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:37:30.686522 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:37:30.686522 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:37:30.686522 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:37:30.686522 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cda83126-328f-4131-995d-a3ed5e64f5cb could not be found. Oct 17 14:37:30.686522 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:37:30.686522 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ac8f7760-b2a6-49f4-b162-1b656cfd2eb3 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Returning 404 to user: Instance cda83126-328f-4131-995d-a3ed5e64f5cb could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:37:30.686522 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ac8f7760-b2a6-49f4-b162-1b656cfd2eb3 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb" status: 404 len: 111 microversion: 2.1 time: 0.031408 Oct 17 14:37:30.686522 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3473/6807] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:37:30 2022] GET /compute/v2.1/servers/cda83126-328f-4131-995d-a3ed5e64f5cb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:37:30.692550 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c6ca92e4-65b7-4001-87c5-62dbbd2a12da tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:37:30.693430 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c6ca92e4-65b7-4001-87c5-62dbbd2a12da tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 4e4cd050-6103-4856-a8b5-c3df9d9bb203] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:37:30.699850 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c6ca92e4-65b7-4001-87c5-62dbbd2a12da tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:30.700344 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c6ca92e4-65b7-4001-87c5-62dbbd2a12da tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:30.700803 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c6ca92e4-65b7-4001-87c5-62dbbd2a12da tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:30.701524 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c6ca92e4-65b7-4001-87c5-62dbbd2a12da tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:30.701985 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c6ca92e4-65b7-4001-87c5-62dbbd2a12da tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:30.702422 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c6ca92e4-65b7-4001-87c5-62dbbd2a12da tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:30.716711 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-c6ca92e4-65b7-4001-87c5-62dbbd2a12da tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] HTTP exception thrown: Instance 4e4cd050-6103-4856-a8b5-c3df9d9bb203 could not be found. Oct 17 14:37:30.718302 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c6ca92e4-65b7-4001-87c5-62dbbd2a12da tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Request method failure captured: Oct 17 14:37:30.718302 n-d-854247-14 devstack@n-api.service[127017]: request: DELETE /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203 HTTP/1.1 Oct 17 14:37:30.718302 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 14:37:30.718302 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 14:37:30.718302 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 14:37:30.718302 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 14:37:30.718302 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 14:37:30.718302 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 14:37:30.718302 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 14:37:30.718302 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 14:37:30.718302 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTWdVpabWT0Tbgf-QQ83Tq8AQGY8AcL_35cr_ansrTOmg5gYS9o-61drx7tYvn26ecQi5aoad2YeNf-Jm0l5MKteHOkMgnybFs17aOJ7G5iYUyXMaYulLqf3oAKSRqw_FkZniUVR3fFPKjmYjBguT22mJaxMSuqSX_P9X-IGsLXSZ0Uc Oct 17 14:37:30.718302 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 14:37:30.718302 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 14:37:30.718302 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 14:37:30.718302 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 14:37:30.718302 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 14:37:30.718302 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 14:37:30.718302 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 6312d6ad74bb476384426e63c1ec7ae5 Oct 17 14:37:30.718302 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServerActionsTestJSON-207618724 Oct 17 14:37:30.718302 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 14:37:30.718302 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 14:37:30.718302 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6312d6ad74bb476384426e63c1ec7ae5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6312d6ad74bb476384426e63c1ec7ae5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6312d6ad74bb476384426e63c1ec7ae5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6312d6ad74bb476384426e63c1ec7ae5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:37:30.718302 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServerActionsTestJSON-207618724 Oct 17 14:37:30.718302 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 6312d6ad74bb476384426e63c1ec7ae5 Oct 17 14:37:30.718302 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServerActionsTestJSON-207618724 Oct 17 14:37:30.718302 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServerActionsTestJSON-207618724-project Oct 17 14:37:30.718302 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 14:37:30.718302 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 14:37:30.718302 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: ad69a4e71c9e425fac89ec047eda43de Oct 17 14:37:30.718302 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServerActionsTestJSON-207618724-project Oct 17 14:37:30.718302 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 14:37:30.718302 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 4e4cd050-6103-4856-a8b5-c3df9d9bb203 could not be found. Oct 17 14:37:30.718302 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '4e4cd050-6103-4856-a8b5-c3df9d9bb203'} Oct 17 14:37:30.718302 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:37:30.718302 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:37:30.718302 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:37:30.718302 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:37:30.718302 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:37:30.718302 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:37:30.718302 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:37:30.718302 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:37:30.718302 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:37:30.718302 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:37:30.718302 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e4cd050-6103-4856-a8b5-c3df9d9bb203 could not be found. Oct 17 14:37:30.718302 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:37:30.718302 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:37:30.718302 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:37:30.718302 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:37:30.718302 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:37:30.718302 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:37:30.718302 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:37:30.718302 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:37:30.718302 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:37:30.718302 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:37:30.718302 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 14:37:30.718302 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 14:37:30.718302 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 14:37:30.718302 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 14:37:30.718302 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:37:30.718302 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:37:30.718302 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:37:30.718302 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:37:30.722797 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e4cd050-6103-4856-a8b5-c3df9d9bb203 could not be found. Oct 17 14:37:30.722797 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:37:30.722797 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:37:30.722797 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:37:30.722797 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:37:30.722797 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:37:30.722797 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:37:30.722797 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:37:30.722797 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:37:30.722797 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e4cd050-6103-4856-a8b5-c3df9d9bb203 could not be found. Oct 17 14:37:30.722797 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:37:30.722797 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c6ca92e4-65b7-4001-87c5-62dbbd2a12da tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Returning 404 to user: Instance 4e4cd050-6103-4856-a8b5-c3df9d9bb203 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:37:30.722797 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c6ca92e4-65b7-4001-87c5-62dbbd2a12da tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "DELETE /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203" status: 404 len: 111 microversion: 2.1 time: 0.031495 Oct 17 14:37:30.724317 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3335/6808] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:37:30 2022] DELETE /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 14:37:30.729258 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-328d7289-bd23-49c5-a5d5-326e27cdbdfa tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:37:30.729917 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-328d7289-bd23-49c5-a5d5-326e27cdbdfa tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 4e4cd050-6103-4856-a8b5-c3df9d9bb203] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:37:30.736472 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-328d7289-bd23-49c5-a5d5-326e27cdbdfa tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:30.736969 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-328d7289-bd23-49c5-a5d5-326e27cdbdfa tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:30.737407 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-328d7289-bd23-49c5-a5d5-326e27cdbdfa tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:30.738123 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-328d7289-bd23-49c5-a5d5-326e27cdbdfa tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:30.738580 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-328d7289-bd23-49c5-a5d5-326e27cdbdfa tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:30.739050 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-328d7289-bd23-49c5-a5d5-326e27cdbdfa tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:30.754548 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-328d7289-bd23-49c5-a5d5-326e27cdbdfa tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] HTTP exception thrown: Instance 4e4cd050-6103-4856-a8b5-c3df9d9bb203 could not be found. Oct 17 14:37:30.756194 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-328d7289-bd23-49c5-a5d5-326e27cdbdfa tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Request method failure captured: Oct 17 14:37:30.756194 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203 HTTP/1.1 Oct 17 14:37:30.756194 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 14:37:30.756194 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 14:37:30.756194 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 14:37:30.756194 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 14:37:30.756194 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 14:37:30.756194 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 14:37:30.756194 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 14:37:30.756194 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 14:37:30.756194 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTWdVpabWT0Tbgf-QQ83Tq8AQGY8AcL_35cr_ansrTOmg5gYS9o-61drx7tYvn26ecQi5aoad2YeNf-Jm0l5MKteHOkMgnybFs17aOJ7G5iYUyXMaYulLqf3oAKSRqw_FkZniUVR3fFPKjmYjBguT22mJaxMSuqSX_P9X-IGsLXSZ0Uc Oct 17 14:37:30.756194 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 14:37:30.756194 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 14:37:30.756194 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 14:37:30.756194 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 14:37:30.756194 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 14:37:30.756194 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 14:37:30.756194 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 6312d6ad74bb476384426e63c1ec7ae5 Oct 17 14:37:30.756194 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServerActionsTestJSON-207618724 Oct 17 14:37:30.756194 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 14:37:30.756194 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 14:37:30.756194 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6312d6ad74bb476384426e63c1ec7ae5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6312d6ad74bb476384426e63c1ec7ae5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6312d6ad74bb476384426e63c1ec7ae5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6312d6ad74bb476384426e63c1ec7ae5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:37:30.756194 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServerActionsTestJSON-207618724 Oct 17 14:37:30.756194 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 6312d6ad74bb476384426e63c1ec7ae5 Oct 17 14:37:30.756194 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServerActionsTestJSON-207618724 Oct 17 14:37:30.756194 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServerActionsTestJSON-207618724-project Oct 17 14:37:30.756194 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 14:37:30.756194 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 14:37:30.756194 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: ad69a4e71c9e425fac89ec047eda43de Oct 17 14:37:30.756194 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServerActionsTestJSON-207618724-project Oct 17 14:37:30.756194 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 14:37:30.756194 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 4e4cd050-6103-4856-a8b5-c3df9d9bb203 could not be found. Oct 17 14:37:30.756194 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '4e4cd050-6103-4856-a8b5-c3df9d9bb203'} Oct 17 14:37:30.756194 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:37:30.756194 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:37:30.756194 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:37:30.756194 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:37:30.756194 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:37:30.756194 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:37:30.756194 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:37:30.756194 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:37:30.756194 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:37:30.756194 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:37:30.756194 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e4cd050-6103-4856-a8b5-c3df9d9bb203 could not be found. Oct 17 14:37:30.756194 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:37:30.756194 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:37:30.756194 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:37:30.756194 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:37:30.756194 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:37:30.756194 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:37:30.756194 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:37:30.756194 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:37:30.756194 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:37:30.756194 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:37:30.756194 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:37:30.756194 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:37:30.756194 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:37:30.756194 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:37:30.756194 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:37:30.756194 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:37:30.756194 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e4cd050-6103-4856-a8b5-c3df9d9bb203 could not be found. Oct 17 14:37:30.756194 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:37:30.756194 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:37:30.756194 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:37:30.760820 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:37:30.760820 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:37:30.760820 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:37:30.760820 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:37:30.760820 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:37:30.760820 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e4cd050-6103-4856-a8b5-c3df9d9bb203 could not be found. Oct 17 14:37:30.760820 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:37:30.760820 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-328d7289-bd23-49c5-a5d5-326e27cdbdfa tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Returning 404 to user: Instance 4e4cd050-6103-4856-a8b5-c3df9d9bb203 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:37:30.760820 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-328d7289-bd23-49c5-a5d5-326e27cdbdfa tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203" status: 404 len: 111 microversion: 2.1 time: 0.032743 Oct 17 14:37:30.760820 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3474/6809] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:37:30 2022] GET /compute/v2.1/servers/4e4cd050-6103-4856-a8b5-c3df9d9bb203 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:37:30.767044 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ade2b375-b810-4b10-a537-e8de89e5ba0e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:37:30.767579 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ade2b375-b810-4b10-a537-e8de89e5ba0e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 6dc99838-6be6-4bb3-a581-217bbb2b8881] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:37:30.774643 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ade2b375-b810-4b10-a537-e8de89e5ba0e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:30.775148 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ade2b375-b810-4b10-a537-e8de89e5ba0e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:30.775625 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ade2b375-b810-4b10-a537-e8de89e5ba0e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:30.776348 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ade2b375-b810-4b10-a537-e8de89e5ba0e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:30.776816 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ade2b375-b810-4b10-a537-e8de89e5ba0e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:30.777247 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ade2b375-b810-4b10-a537-e8de89e5ba0e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:30.793544 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-ade2b375-b810-4b10-a537-e8de89e5ba0e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] HTTP exception thrown: Instance 6dc99838-6be6-4bb3-a581-217bbb2b8881 could not be found. Oct 17 14:37:30.795065 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ade2b375-b810-4b10-a537-e8de89e5ba0e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Request method failure captured: Oct 17 14:37:30.795065 n-d-854247-14 devstack@n-api.service[127017]: request: DELETE /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881 HTTP/1.1 Oct 17 14:37:30.795065 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 14:37:30.795065 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 14:37:30.795065 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 14:37:30.795065 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 14:37:30.795065 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 14:37:30.795065 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 14:37:30.795065 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 14:37:30.795065 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 14:37:30.795065 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTWdVpabWT0Tbgf-QQ83Tq8AQGY8AcL_35cr_ansrTOmg5gYS9o-61drx7tYvn26ecQi5aoad2YeNf-Jm0l5MKteHOkMgnybFs17aOJ7G5iYUyXMaYulLqf3oAKSRqw_FkZniUVR3fFPKjmYjBguT22mJaxMSuqSX_P9X-IGsLXSZ0Uc Oct 17 14:37:30.795065 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 14:37:30.795065 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 14:37:30.795065 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 14:37:30.795065 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 14:37:30.795065 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 14:37:30.795065 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 14:37:30.795065 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 6312d6ad74bb476384426e63c1ec7ae5 Oct 17 14:37:30.795065 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServerActionsTestJSON-207618724 Oct 17 14:37:30.795065 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 14:37:30.795065 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 14:37:30.795065 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6312d6ad74bb476384426e63c1ec7ae5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6312d6ad74bb476384426e63c1ec7ae5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6312d6ad74bb476384426e63c1ec7ae5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6312d6ad74bb476384426e63c1ec7ae5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:37:30.795065 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServerActionsTestJSON-207618724 Oct 17 14:37:30.795065 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 6312d6ad74bb476384426e63c1ec7ae5 Oct 17 14:37:30.795065 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServerActionsTestJSON-207618724 Oct 17 14:37:30.795065 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServerActionsTestJSON-207618724-project Oct 17 14:37:30.795065 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 14:37:30.795065 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 14:37:30.795065 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: ad69a4e71c9e425fac89ec047eda43de Oct 17 14:37:30.795065 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServerActionsTestJSON-207618724-project Oct 17 14:37:30.795065 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 14:37:30.795065 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 6dc99838-6be6-4bb3-a581-217bbb2b8881 could not be found. Oct 17 14:37:30.795065 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '6dc99838-6be6-4bb3-a581-217bbb2b8881'} Oct 17 14:37:30.795065 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:37:30.795065 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:37:30.795065 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:37:30.795065 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:37:30.795065 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:37:30.795065 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:37:30.795065 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:37:30.795065 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:37:30.795065 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:37:30.795065 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:37:30.795065 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dc99838-6be6-4bb3-a581-217bbb2b8881 could not be found. Oct 17 14:37:30.795065 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:37:30.795065 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:37:30.795065 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:37:30.795065 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:37:30.795065 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:37:30.795065 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:37:30.795065 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:37:30.795065 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:37:30.795065 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:37:30.795065 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:37:30.795065 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 14:37:30.795065 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 14:37:30.795065 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 14:37:30.795065 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 14:37:30.795065 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:37:30.795065 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:37:30.795065 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:37:30.795065 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:37:30.799554 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dc99838-6be6-4bb3-a581-217bbb2b8881 could not be found. Oct 17 14:37:30.799554 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:37:30.799554 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:37:30.799554 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:37:30.799554 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:37:30.799554 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:37:30.799554 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:37:30.799554 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:37:30.799554 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:37:30.799554 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dc99838-6be6-4bb3-a581-217bbb2b8881 could not be found. Oct 17 14:37:30.799554 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:37:30.799554 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ade2b375-b810-4b10-a537-e8de89e5ba0e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Returning 404 to user: Instance 6dc99838-6be6-4bb3-a581-217bbb2b8881 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:37:30.799554 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ade2b375-b810-4b10-a537-e8de89e5ba0e tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "DELETE /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881" status: 404 len: 111 microversion: 2.1 time: 0.033575 Oct 17 14:37:30.800689 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3336/6810] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:37:30 2022] DELETE /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:37:30.806850 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-15f682ae-4752-4946-84ca-80c59879c872 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:37:30.807946 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-15f682ae-4752-4946-84ca-80c59879c872 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] [instance: 6dc99838-6be6-4bb3-a581-217bbb2b8881] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:37:30.814665 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-15f682ae-4752-4946-84ca-80c59879c872 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:30.815305 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-15f682ae-4752-4946-84ca-80c59879c872 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:30.815828 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-15f682ae-4752-4946-84ca-80c59879c872 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:30.817465 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-15f682ae-4752-4946-84ca-80c59879c872 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:30.818083 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-15f682ae-4752-4946-84ca-80c59879c872 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:30.818524 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-15f682ae-4752-4946-84ca-80c59879c872 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:30.835215 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-15f682ae-4752-4946-84ca-80c59879c872 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] HTTP exception thrown: Instance 6dc99838-6be6-4bb3-a581-217bbb2b8881 could not be found. Oct 17 14:37:30.836738 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-15f682ae-4752-4946-84ca-80c59879c872 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Request method failure captured: Oct 17 14:37:30.836738 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881 HTTP/1.1 Oct 17 14:37:30.836738 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 14:37:30.836738 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 14:37:30.836738 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 14:37:30.836738 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 14:37:30.836738 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 14:37:30.836738 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 14:37:30.836738 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 14:37:30.836738 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 14:37:30.836738 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTWdVpabWT0Tbgf-QQ83Tq8AQGY8AcL_35cr_ansrTOmg5gYS9o-61drx7tYvn26ecQi5aoad2YeNf-Jm0l5MKteHOkMgnybFs17aOJ7G5iYUyXMaYulLqf3oAKSRqw_FkZniUVR3fFPKjmYjBguT22mJaxMSuqSX_P9X-IGsLXSZ0Uc Oct 17 14:37:30.836738 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 14:37:30.836738 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 14:37:30.836738 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 14:37:30.836738 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 14:37:30.836738 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 14:37:30.836738 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 14:37:30.836738 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 6312d6ad74bb476384426e63c1ec7ae5 Oct 17 14:37:30.836738 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServerActionsTestJSON-207618724 Oct 17 14:37:30.836738 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 14:37:30.836738 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 14:37:30.836738 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6312d6ad74bb476384426e63c1ec7ae5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6312d6ad74bb476384426e63c1ec7ae5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6312d6ad74bb476384426e63c1ec7ae5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6312d6ad74bb476384426e63c1ec7ae5", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:37:30.836738 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServerActionsTestJSON-207618724 Oct 17 14:37:30.836738 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 6312d6ad74bb476384426e63c1ec7ae5 Oct 17 14:37:30.836738 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServerActionsTestJSON-207618724 Oct 17 14:37:30.836738 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServerActionsTestJSON-207618724-project Oct 17 14:37:30.836738 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 14:37:30.836738 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 14:37:30.836738 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: ad69a4e71c9e425fac89ec047eda43de Oct 17 14:37:30.836738 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServerActionsTestJSON-207618724-project Oct 17 14:37:30.836738 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 14:37:30.836738 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 6dc99838-6be6-4bb3-a581-217bbb2b8881 could not be found. Oct 17 14:37:30.836738 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '6dc99838-6be6-4bb3-a581-217bbb2b8881'} Oct 17 14:37:30.836738 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:37:30.836738 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:37:30.836738 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:37:30.836738 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:37:30.836738 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:37:30.836738 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:37:30.836738 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:37:30.836738 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:37:30.836738 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:37:30.836738 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:37:30.836738 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dc99838-6be6-4bb3-a581-217bbb2b8881 could not be found. Oct 17 14:37:30.836738 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:37:30.836738 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:37:30.836738 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:37:30.836738 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:37:30.836738 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:37:30.836738 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:37:30.836738 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:37:30.836738 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:37:30.836738 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:37:30.836738 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:37:30.836738 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:37:30.836738 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:37:30.836738 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:37:30.836738 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:37:30.836738 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:37:30.836738 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:37:30.836738 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dc99838-6be6-4bb3-a581-217bbb2b8881 could not be found. Oct 17 14:37:30.836738 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:37:30.836738 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:37:30.836738 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:37:30.844747 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:37:30.844747 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:37:30.844747 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:37:30.844747 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:37:30.844747 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:37:30.844747 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dc99838-6be6-4bb3-a581-217bbb2b8881 could not be found. Oct 17 14:37:30.844747 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:37:30.844747 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-15f682ae-4752-4946-84ca-80c59879c872 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Returning 404 to user: Instance 6dc99838-6be6-4bb3-a581-217bbb2b8881 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:37:30.844747 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-15f682ae-4752-4946-84ca-80c59879c872 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881" status: 404 len: 111 microversion: 2.1 time: 0.036011 Oct 17 14:37:30.844747 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3475/6811] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:37:30 2022] GET /compute/v2.1/servers/6dc99838-6be6-4bb3-a581-217bbb2b8881 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:37:30.846993 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-91b73b98-e9cf-4fc1-8546-4b6a66fc3231 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] Calling method '.version_select at 0x7f7cd44b7430>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:37:30.872844 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-91b73b98-e9cf-4fc1-8546-4b6a66fc3231 tempest-ServerActionsTestJSON-207618724 tempest-ServerActionsTestJSON-207618724-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-533599217" status: 202 len: 0 microversion: 2.1 time: 0.029557 Oct 17 14:37:30.873432 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3337/6812] 10.222.0.79 () {58 vars in 1218 bytes} [Mon Oct 17 14:37:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-533599217 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:37:40.812082 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=13 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:37:40.823814 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=31 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:37:40.919906 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-153ac645-fdd1-46ff-acde-0a28e468b4ec tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1580079949", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "95af5308-cde9-4fbc-8052-7259337df4f7"}]}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:37:40.984342 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-153ac645-fdd1-46ff-acde-0a28e468b4ec tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] validate_networks() for [('95af5308-cde9-4fbc-8052-7259337df4f7', None, None, None, None, None)] {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:37:41.479696 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-153ac645-fdd1-46ff-acde-0a28e468b4ec tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:37:41.480122 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-153ac645-fdd1-46ff-acde-0a28e468b4ec tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:37:41.480565 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-153ac645-fdd1-46ff-acde-0a28e468b4ec tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:37:41.480974 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-153ac645-fdd1-46ff-acde-0a28e468b4ec tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:37:41.481420 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-153ac645-fdd1-46ff-acde-0a28e468b4ec tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:37:41.491671 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-153ac645-fdd1-46ff-acde-0a28e468b4ec tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:41.492118 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-153ac645-fdd1-46ff-acde-0a28e468b4ec tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:41.492553 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-153ac645-fdd1-46ff-acde-0a28e468b4ec tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:41.493290 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-153ac645-fdd1-46ff-acde-0a28e468b4ec tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:41.493763 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-153ac645-fdd1-46ff-acde-0a28e468b4ec tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:41.494186 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-153ac645-fdd1-46ff-acde-0a28e468b4ec tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:41.513112 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-153ac645-fdd1-46ff-acde-0a28e468b4ec tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Getting quotas for project ad0f83e4d73246b1ac819c0c43939854. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:37:41.519642 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-153ac645-fdd1-46ff-acde-0a28e468b4ec tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Getting quotas for user 19fbf6128b374efa8bf274a485095a3e and project ad0f83e4d73246b1ac819c0c43939854. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:37:41.534398 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-153ac645-fdd1-46ff-acde-0a28e468b4ec tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:37:41.536995 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-153ac645-fdd1-46ff-acde-0a28e468b4ec tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] [instance: 3549aca2-dfe7-4d26-99aa-20808d44ee1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:37:41.586526 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-153ac645-fdd1-46ff-acde-0a28e468b4ec tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.811086 Oct 17 14:37:41.587405 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3476/6813] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 14:37:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:37:41.598755 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-02944713-bee8-42e3-add9-d89135e2db48 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:37:41.600274 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-02944713-bee8-42e3-add9-d89135e2db48 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] [instance: 3549aca2-dfe7-4d26-99aa-20808d44ee1e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:37:41.615275 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=29 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:37:41.616337 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:37:41.678544 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-02944713-bee8-42e3-add9-d89135e2db48 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbf6128b374efa8bf274a485095a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0f83e4d73246b1ac819c0c43939854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:37:41.687303 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-02944713-bee8-42e3-add9-d89135e2db48 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] 10.222.0.79 "GET /compute/v2.1/servers/3549aca2-dfe7-4d26-99aa-20808d44ee1e" status: 200 len: 1217 microversion: 2.1 time: 0.092619 Oct 17 14:37:41.687886 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3338/6814] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:37:41 2022] GET /compute/v2.1/servers/3549aca2-dfe7-4d26-99aa-20808d44ee1e => generated 1217 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:37:42.712216 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c36d0795-df5b-4372-bd74-3494ae92c02d tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:37:42.712847 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c36d0795-df5b-4372-bd74-3494ae92c02d tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] [instance: 3549aca2-dfe7-4d26-99aa-20808d44ee1e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:37:42.725323 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c36d0795-df5b-4372-bd74-3494ae92c02d tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:42.725840 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c36d0795-df5b-4372-bd74-3494ae92c02d tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:42.726623 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c36d0795-df5b-4372-bd74-3494ae92c02d tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:42.733098 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c36d0795-df5b-4372-bd74-3494ae92c02d tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:42.733606 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c36d0795-df5b-4372-bd74-3494ae92c02d tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:42.734100 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c36d0795-df5b-4372-bd74-3494ae92c02d tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:42.830052 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c36d0795-df5b-4372-bd74-3494ae92c02d tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbf6128b374efa8bf274a485095a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0f83e4d73246b1ac819c0c43939854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:37:42.841296 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c36d0795-df5b-4372-bd74-3494ae92c02d tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] 10.222.0.79 "GET /compute/v2.1/servers/3549aca2-dfe7-4d26-99aa-20808d44ee1e" status: 200 len: 1277 microversion: 2.1 time: 0.134938 Oct 17 14:37:42.841917 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3477/6815] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:37:42 2022] GET /compute/v2.1/servers/3549aca2-dfe7-4d26-99aa-20808d44ee1e => generated 1277 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:37:43.867848 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e2ed45a5-b9b9-430c-93c1-6895aa2d085d tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:37:43.868464 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e2ed45a5-b9b9-430c-93c1-6895aa2d085d tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] [instance: 3549aca2-dfe7-4d26-99aa-20808d44ee1e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:37:43.876647 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e2ed45a5-b9b9-430c-93c1-6895aa2d085d tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:43.877396 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e2ed45a5-b9b9-430c-93c1-6895aa2d085d tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:43.877845 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e2ed45a5-b9b9-430c-93c1-6895aa2d085d tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:43.878551 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e2ed45a5-b9b9-430c-93c1-6895aa2d085d tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:43.879201 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e2ed45a5-b9b9-430c-93c1-6895aa2d085d tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:43.879651 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e2ed45a5-b9b9-430c-93c1-6895aa2d085d tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:44.087719 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e2ed45a5-b9b9-430c-93c1-6895aa2d085d tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbf6128b374efa8bf274a485095a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0f83e4d73246b1ac819c0c43939854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:37:44.100071 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e2ed45a5-b9b9-430c-93c1-6895aa2d085d tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] 10.222.0.79 "GET /compute/v2.1/servers/3549aca2-dfe7-4d26-99aa-20808d44ee1e" status: 200 len: 1317 microversion: 2.1 time: 0.236931 Oct 17 14:37:44.111857 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3339/6816] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:37:43 2022] GET /compute/v2.1/servers/3549aca2-dfe7-4d26-99aa-20808d44ee1e => generated 1317 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:37:44.272259 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-e4310b4b-8d66-4fa5-834d-ecc30e5c96bf req-cef6458b-db93-40ff-b8d2-ca1d5eae8777 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3549aca2-dfe7-4d26-99aa-20808d44ee1e", "tag": "302c07a4-0410-47e7-8c54-670758344d32"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:37:44.283678 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-e4310b4b-8d66-4fa5-834d-ecc30e5c96bf req-cef6458b-db93-40ff-b8d2-ca1d5eae8777 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:44.284169 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-e4310b4b-8d66-4fa5-834d-ecc30e5c96bf req-cef6458b-db93-40ff-b8d2-ca1d5eae8777 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:44.284599 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-e4310b4b-8d66-4fa5-834d-ecc30e5c96bf req-cef6458b-db93-40ff-b8d2-ca1d5eae8777 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:44.305205 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-e4310b4b-8d66-4fa5-834d-ecc30e5c96bf req-cef6458b-db93-40ff-b8d2-ca1d5eae8777 service nova] Creating event network-changed:302c07a4-0410-47e7-8c54-670758344d32 for instance 3549aca2-dfe7-4d26-99aa-20808d44ee1e on n-h2-854247-14 Oct 17 14:37:44.310587 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-e4310b4b-8d66-4fa5-834d-ecc30e5c96bf req-cef6458b-db93-40ff-b8d2-ca1d5eae8777 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110375 Oct 17 14:37:44.311584 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3478/6817] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:37:45.124014 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-98be491f-afc4-4bc7-b438-4ea5a26955ec tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:37:45.124631 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-98be491f-afc4-4bc7-b438-4ea5a26955ec tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] [instance: 3549aca2-dfe7-4d26-99aa-20808d44ee1e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:37:45.132237 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-98be491f-afc4-4bc7-b438-4ea5a26955ec tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:45.133082 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-98be491f-afc4-4bc7-b438-4ea5a26955ec tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:45.133528 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-98be491f-afc4-4bc7-b438-4ea5a26955ec tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:45.134231 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-98be491f-afc4-4bc7-b438-4ea5a26955ec tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:45.134693 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-98be491f-afc4-4bc7-b438-4ea5a26955ec tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:45.135128 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-98be491f-afc4-4bc7-b438-4ea5a26955ec tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:45.280888 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-98be491f-afc4-4bc7-b438-4ea5a26955ec tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbf6128b374efa8bf274a485095a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0f83e4d73246b1ac819c0c43939854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:37:45.289592 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-98be491f-afc4-4bc7-b438-4ea5a26955ec tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] 10.222.0.79 "GET /compute/v2.1/servers/3549aca2-dfe7-4d26-99aa-20808d44ee1e" status: 200 len: 1317 microversion: 2.1 time: 0.169643 Oct 17 14:37:45.290164 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3340/6818] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:37:45 2022] GET /compute/v2.1/servers/3549aca2-dfe7-4d26-99aa-20808d44ee1e => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:37:46.318253 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ee27813e-53bf-4979-a07d-0d148d422bb6 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:37:46.319022 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ee27813e-53bf-4979-a07d-0d148d422bb6 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] [instance: 3549aca2-dfe7-4d26-99aa-20808d44ee1e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:37:46.328811 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ee27813e-53bf-4979-a07d-0d148d422bb6 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:46.329373 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ee27813e-53bf-4979-a07d-0d148d422bb6 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:46.329927 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ee27813e-53bf-4979-a07d-0d148d422bb6 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:46.330985 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ee27813e-53bf-4979-a07d-0d148d422bb6 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:46.331538 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ee27813e-53bf-4979-a07d-0d148d422bb6 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:46.332091 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ee27813e-53bf-4979-a07d-0d148d422bb6 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:46.468952 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ee27813e-53bf-4979-a07d-0d148d422bb6 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbf6128b374efa8bf274a485095a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0f83e4d73246b1ac819c0c43939854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:37:46.477362 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ee27813e-53bf-4979-a07d-0d148d422bb6 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] 10.222.0.79 "GET /compute/v2.1/servers/3549aca2-dfe7-4d26-99aa-20808d44ee1e" status: 200 len: 1317 microversion: 2.1 time: 0.167982 Oct 17 14:37:46.478043 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3479/6819] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:37:46 2022] GET /compute/v2.1/servers/3549aca2-dfe7-4d26-99aa-20808d44ee1e => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:37:47.503358 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-90a052a4-8cf5-4e6f-90a3-40982e01e5dc tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:37:47.503983 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-90a052a4-8cf5-4e6f-90a3-40982e01e5dc tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] [instance: 3549aca2-dfe7-4d26-99aa-20808d44ee1e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:37:47.512373 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-90a052a4-8cf5-4e6f-90a3-40982e01e5dc tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:47.512874 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-90a052a4-8cf5-4e6f-90a3-40982e01e5dc tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:47.513329 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-90a052a4-8cf5-4e6f-90a3-40982e01e5dc tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:47.514037 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-90a052a4-8cf5-4e6f-90a3-40982e01e5dc tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:47.514502 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-90a052a4-8cf5-4e6f-90a3-40982e01e5dc tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:47.515033 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-90a052a4-8cf5-4e6f-90a3-40982e01e5dc tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:47.664716 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-90a052a4-8cf5-4e6f-90a3-40982e01e5dc tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbf6128b374efa8bf274a485095a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0f83e4d73246b1ac819c0c43939854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:37:47.677343 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-90a052a4-8cf5-4e6f-90a3-40982e01e5dc tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] 10.222.0.79 "GET /compute/v2.1/servers/3549aca2-dfe7-4d26-99aa-20808d44ee1e" status: 200 len: 1317 microversion: 2.1 time: 0.180249 Oct 17 14:37:47.678056 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3341/6820] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:37:47 2022] GET /compute/v2.1/servers/3549aca2-dfe7-4d26-99aa-20808d44ee1e => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:37:48.701823 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0fd15afb-f6a1-4c7b-9de3-d1716ece214e tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:37:48.702396 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0fd15afb-f6a1-4c7b-9de3-d1716ece214e tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] [instance: 3549aca2-dfe7-4d26-99aa-20808d44ee1e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:37:48.709934 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0fd15afb-f6a1-4c7b-9de3-d1716ece214e tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:48.710392 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0fd15afb-f6a1-4c7b-9de3-d1716ece214e tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:48.710821 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0fd15afb-f6a1-4c7b-9de3-d1716ece214e tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:48.711647 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0fd15afb-f6a1-4c7b-9de3-d1716ece214e tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:48.712189 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0fd15afb-f6a1-4c7b-9de3-d1716ece214e tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:48.712618 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0fd15afb-f6a1-4c7b-9de3-d1716ece214e tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:48.853218 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0fd15afb-f6a1-4c7b-9de3-d1716ece214e tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbf6128b374efa8bf274a485095a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0f83e4d73246b1ac819c0c43939854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:37:48.861371 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0fd15afb-f6a1-4c7b-9de3-d1716ece214e tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] 10.222.0.79 "GET /compute/v2.1/servers/3549aca2-dfe7-4d26-99aa-20808d44ee1e" status: 200 len: 1317 microversion: 2.1 time: 0.163798 Oct 17 14:37:48.861990 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3480/6821] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:37:48 2022] GET /compute/v2.1/servers/3549aca2-dfe7-4d26-99aa-20808d44ee1e => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:37:49.167684 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-7da78b67-85f4-4603-8003-78309e0273c5 req-6495ed3d-d11a-421a-bf27-c235c6125a55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3549aca2-dfe7-4d26-99aa-20808d44ee1e", "name": "network-vif-plugged", "status": "completed", "tag": "302c07a4-0410-47e7-8c54-670758344d32"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:37:49.179983 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-7da78b67-85f4-4603-8003-78309e0273c5 req-6495ed3d-d11a-421a-bf27-c235c6125a55 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:49.180501 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-7da78b67-85f4-4603-8003-78309e0273c5 req-6495ed3d-d11a-421a-bf27-c235c6125a55 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:49.181623 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-7da78b67-85f4-4603-8003-78309e0273c5 req-6495ed3d-d11a-421a-bf27-c235c6125a55 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:49.192664 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-7da78b67-85f4-4603-8003-78309e0273c5 req-6495ed3d-d11a-421a-bf27-c235c6125a55 service nova] Creating event network-vif-plugged:302c07a4-0410-47e7-8c54-670758344d32 for instance 3549aca2-dfe7-4d26-99aa-20808d44ee1e on n-h2-854247-14 Oct 17 14:37:49.197688 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-7da78b67-85f4-4603-8003-78309e0273c5 req-6495ed3d-d11a-421a-bf27-c235c6125a55 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034408 Oct 17 14:37:49.198593 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3342/6822] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:37:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:37:49.891992 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0f1e05c1-7758-4e4f-8e35-e3349c32f0e4 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:37:49.893027 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0f1e05c1-7758-4e4f-8e35-e3349c32f0e4 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] [instance: 3549aca2-dfe7-4d26-99aa-20808d44ee1e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:37:49.902757 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0f1e05c1-7758-4e4f-8e35-e3349c32f0e4 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:49.903278 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0f1e05c1-7758-4e4f-8e35-e3349c32f0e4 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:49.903725 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0f1e05c1-7758-4e4f-8e35-e3349c32f0e4 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:49.904432 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0f1e05c1-7758-4e4f-8e35-e3349c32f0e4 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:49.904890 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0f1e05c1-7758-4e4f-8e35-e3349c32f0e4 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:49.905323 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0f1e05c1-7758-4e4f-8e35-e3349c32f0e4 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:50.045229 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0f1e05c1-7758-4e4f-8e35-e3349c32f0e4 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbf6128b374efa8bf274a485095a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0f83e4d73246b1ac819c0c43939854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:37:50.057357 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0f1e05c1-7758-4e4f-8e35-e3349c32f0e4 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] 10.222.0.79 "GET /compute/v2.1/servers/3549aca2-dfe7-4d26-99aa-20808d44ee1e" status: 200 len: 1317 microversion: 2.1 time: 0.173243 Oct 17 14:37:50.057948 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3481/6823] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:37:49 2022] GET /compute/v2.1/servers/3549aca2-dfe7-4d26-99aa-20808d44ee1e => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:37:51.082256 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3ac71a3a-5ad5-4589-a8f5-174c93150dee tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:37:51.082972 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3ac71a3a-5ad5-4589-a8f5-174c93150dee tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] [instance: 3549aca2-dfe7-4d26-99aa-20808d44ee1e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:37:51.089999 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3ac71a3a-5ad5-4589-a8f5-174c93150dee tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:51.090501 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3ac71a3a-5ad5-4589-a8f5-174c93150dee tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:51.090947 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3ac71a3a-5ad5-4589-a8f5-174c93150dee tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:51.091689 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3ac71a3a-5ad5-4589-a8f5-174c93150dee tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:51.092162 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3ac71a3a-5ad5-4589-a8f5-174c93150dee tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:51.092577 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3ac71a3a-5ad5-4589-a8f5-174c93150dee tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:51.245217 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3ac71a3a-5ad5-4589-a8f5-174c93150dee tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbf6128b374efa8bf274a485095a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0f83e4d73246b1ac819c0c43939854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:37:51.257439 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3ac71a3a-5ad5-4589-a8f5-174c93150dee tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] 10.222.0.79 "GET /compute/v2.1/servers/3549aca2-dfe7-4d26-99aa-20808d44ee1e" status: 200 len: 1506 microversion: 2.1 time: 0.179796 Oct 17 14:37:51.258281 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3343/6824] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:37:51 2022] GET /compute/v2.1/servers/3549aca2-dfe7-4d26-99aa-20808d44ee1e => generated 1506 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:37:51.322379 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-285d068c-f650-4a99-a243-ade7ae1a4f1d tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1902435354", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "95af5308-cde9-4fbc-8052-7259337df4f7"}]}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:37:51.384628 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-285d068c-f650-4a99-a243-ade7ae1a4f1d tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] validate_networks() for [('95af5308-cde9-4fbc-8052-7259337df4f7', None, None, None, None, None)] {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:37:51.502938 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:37:51.528739 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=6 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:37:51.779860 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-285d068c-f650-4a99-a243-ade7ae1a4f1d tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:37:51.780468 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-285d068c-f650-4a99-a243-ade7ae1a4f1d tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:37:51.781101 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-285d068c-f650-4a99-a243-ade7ae1a4f1d tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:37:51.781683 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-285d068c-f650-4a99-a243-ade7ae1a4f1d tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:37:51.782202 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-285d068c-f650-4a99-a243-ade7ae1a4f1d tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:37:51.795061 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-285d068c-f650-4a99-a243-ade7ae1a4f1d tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:51.795576 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-285d068c-f650-4a99-a243-ade7ae1a4f1d tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:51.796003 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-285d068c-f650-4a99-a243-ade7ae1a4f1d tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:51.796749 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-285d068c-f650-4a99-a243-ade7ae1a4f1d tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:51.797202 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-285d068c-f650-4a99-a243-ade7ae1a4f1d tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:51.797620 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-285d068c-f650-4a99-a243-ade7ae1a4f1d tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:51.815069 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-285d068c-f650-4a99-a243-ade7ae1a4f1d tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Getting quotas for project ad0f83e4d73246b1ac819c0c43939854. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:37:51.820790 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-285d068c-f650-4a99-a243-ade7ae1a4f1d tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Getting quotas for user 19fbf6128b374efa8bf274a485095a3e and project ad0f83e4d73246b1ac819c0c43939854. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:37:51.834054 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-285d068c-f650-4a99-a243-ade7ae1a4f1d tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:37:51.836384 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-285d068c-f650-4a99-a243-ade7ae1a4f1d tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] [instance: 26751ad5-5902-4bc8-a9de-3f19603d7f93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:37:51.885889 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-285d068c-f650-4a99-a243-ade7ae1a4f1d tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.569860 Oct 17 14:37:51.886586 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3482/6825] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 14:37:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:37:51.897556 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-531237c6-a8cd-4d87-909a-66e102d4a4e7 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:37:51.898176 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-531237c6-a8cd-4d87-909a-66e102d4a4e7 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] [instance: 26751ad5-5902-4bc8-a9de-3f19603d7f93] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:37:51.900245 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:37:51.953843 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-531237c6-a8cd-4d87-909a-66e102d4a4e7 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbf6128b374efa8bf274a485095a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0f83e4d73246b1ac819c0c43939854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:37:51.961000 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-531237c6-a8cd-4d87-909a-66e102d4a4e7 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] 10.222.0.79 "GET /compute/v2.1/servers/26751ad5-5902-4bc8-a9de-3f19603d7f93" status: 200 len: 1217 microversion: 2.1 time: 0.067363 Oct 17 14:37:51.961577 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3344/6826] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:37:51 2022] GET /compute/v2.1/servers/26751ad5-5902-4bc8-a9de-3f19603d7f93 => generated 1217 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:37:52.985872 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8713a986-9453-438a-aead-4c7e2425d87e tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:37:52.987220 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8713a986-9453-438a-aead-4c7e2425d87e tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] [instance: 26751ad5-5902-4bc8-a9de-3f19603d7f93] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:37:52.993553 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8713a986-9453-438a-aead-4c7e2425d87e tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:52.994356 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8713a986-9453-438a-aead-4c7e2425d87e tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:52.994881 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8713a986-9453-438a-aead-4c7e2425d87e tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:52.995658 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8713a986-9453-438a-aead-4c7e2425d87e tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:52.996331 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8713a986-9453-438a-aead-4c7e2425d87e tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:52.996820 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8713a986-9453-438a-aead-4c7e2425d87e tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:53.063259 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8713a986-9453-438a-aead-4c7e2425d87e tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbf6128b374efa8bf274a485095a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0f83e4d73246b1ac819c0c43939854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:37:53.071535 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8713a986-9453-438a-aead-4c7e2425d87e tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] 10.222.0.79 "GET /compute/v2.1/servers/26751ad5-5902-4bc8-a9de-3f19603d7f93" status: 200 len: 1287 microversion: 2.1 time: 0.091510 Oct 17 14:37:53.073839 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3483/6827] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:37:52 2022] GET /compute/v2.1/servers/26751ad5-5902-4bc8-a9de-3f19603d7f93 => generated 1287 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:37:54.099555 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f7b27d8d-ca6a-4b49-990b-81b050652d12 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:37:54.100388 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f7b27d8d-ca6a-4b49-990b-81b050652d12 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] [instance: 26751ad5-5902-4bc8-a9de-3f19603d7f93] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:37:54.108725 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f7b27d8d-ca6a-4b49-990b-81b050652d12 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:54.109268 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f7b27d8d-ca6a-4b49-990b-81b050652d12 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:54.109875 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f7b27d8d-ca6a-4b49-990b-81b050652d12 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:54.110640 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f7b27d8d-ca6a-4b49-990b-81b050652d12 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:54.111105 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f7b27d8d-ca6a-4b49-990b-81b050652d12 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:54.111587 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f7b27d8d-ca6a-4b49-990b-81b050652d12 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:54.243048 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f7b27d8d-ca6a-4b49-990b-81b050652d12 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbf6128b374efa8bf274a485095a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0f83e4d73246b1ac819c0c43939854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:37:54.251814 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f7b27d8d-ca6a-4b49-990b-81b050652d12 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] 10.222.0.79 "GET /compute/v2.1/servers/26751ad5-5902-4bc8-a9de-3f19603d7f93" status: 200 len: 1317 microversion: 2.1 time: 0.156968 Oct 17 14:37:54.252402 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3345/6828] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:37:54 2022] GET /compute/v2.1/servers/26751ad5-5902-4bc8-a9de-3f19603d7f93 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:37:54.402475 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-cd43ce71-f16d-4ec6-bcbd-750453f04b2c req-66655293-4c71-4e55-9a96-3954e27cee71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26751ad5-5902-4bc8-a9de-3f19603d7f93", "tag": "e5c20d17-f638-4456-af3c-645262efddaf"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:37:54.412465 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-cd43ce71-f16d-4ec6-bcbd-750453f04b2c req-66655293-4c71-4e55-9a96-3954e27cee71 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:54.412986 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-cd43ce71-f16d-4ec6-bcbd-750453f04b2c req-66655293-4c71-4e55-9a96-3954e27cee71 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:54.413379 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-cd43ce71-f16d-4ec6-bcbd-750453f04b2c req-66655293-4c71-4e55-9a96-3954e27cee71 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:54.426095 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-cd43ce71-f16d-4ec6-bcbd-750453f04b2c req-66655293-4c71-4e55-9a96-3954e27cee71 service nova] Creating event network-changed:e5c20d17-f638-4456-af3c-645262efddaf for instance 26751ad5-5902-4bc8-a9de-3f19603d7f93 on n-h1-854247-14 Oct 17 14:37:54.431391 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-cd43ce71-f16d-4ec6-bcbd-750453f04b2c req-66655293-4c71-4e55-9a96-3954e27cee71 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098464 Oct 17 14:37:54.431960 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3484/6829] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:37:55.278898 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bbb370d1-3d4b-4f0e-8cdc-536dc84c9033 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:37:55.279501 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-bbb370d1-3d4b-4f0e-8cdc-536dc84c9033 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] [instance: 26751ad5-5902-4bc8-a9de-3f19603d7f93] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:37:55.287069 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bbb370d1-3d4b-4f0e-8cdc-536dc84c9033 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:55.287600 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bbb370d1-3d4b-4f0e-8cdc-536dc84c9033 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:55.288080 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bbb370d1-3d4b-4f0e-8cdc-536dc84c9033 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:55.288758 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bbb370d1-3d4b-4f0e-8cdc-536dc84c9033 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:55.289272 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bbb370d1-3d4b-4f0e-8cdc-536dc84c9033 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:55.289659 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bbb370d1-3d4b-4f0e-8cdc-536dc84c9033 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:55.441371 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-bbb370d1-3d4b-4f0e-8cdc-536dc84c9033 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbf6128b374efa8bf274a485095a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0f83e4d73246b1ac819c0c43939854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:37:55.449610 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-bbb370d1-3d4b-4f0e-8cdc-536dc84c9033 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] 10.222.0.79 "GET /compute/v2.1/servers/26751ad5-5902-4bc8-a9de-3f19603d7f93" status: 200 len: 1317 microversion: 2.1 time: 0.176551 Oct 17 14:37:55.450363 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3346/6830] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:37:55 2022] GET /compute/v2.1/servers/26751ad5-5902-4bc8-a9de-3f19603d7f93 => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:37:56.474691 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a575e096-e4fb-4f9f-8d71-0cbb68be7dd4 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:37:56.475431 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a575e096-e4fb-4f9f-8d71-0cbb68be7dd4 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] [instance: 26751ad5-5902-4bc8-a9de-3f19603d7f93] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:37:56.482277 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a575e096-e4fb-4f9f-8d71-0cbb68be7dd4 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:56.482766 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a575e096-e4fb-4f9f-8d71-0cbb68be7dd4 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:56.483198 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a575e096-e4fb-4f9f-8d71-0cbb68be7dd4 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:56.483945 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a575e096-e4fb-4f9f-8d71-0cbb68be7dd4 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:56.484403 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a575e096-e4fb-4f9f-8d71-0cbb68be7dd4 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:56.484832 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a575e096-e4fb-4f9f-8d71-0cbb68be7dd4 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:56.620600 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a575e096-e4fb-4f9f-8d71-0cbb68be7dd4 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbf6128b374efa8bf274a485095a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0f83e4d73246b1ac819c0c43939854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:37:56.628702 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a575e096-e4fb-4f9f-8d71-0cbb68be7dd4 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] 10.222.0.79 "GET /compute/v2.1/servers/26751ad5-5902-4bc8-a9de-3f19603d7f93" status: 200 len: 1317 microversion: 2.1 time: 0.159348 Oct 17 14:37:56.629302 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3485/6831] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:37:56 2022] GET /compute/v2.1/servers/26751ad5-5902-4bc8-a9de-3f19603d7f93 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:37:57.655638 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-11590c45-9619-446d-8d02-62b3a0d20cf7 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:37:57.656401 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-11590c45-9619-446d-8d02-62b3a0d20cf7 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] [instance: 26751ad5-5902-4bc8-a9de-3f19603d7f93] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:37:57.666325 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-11590c45-9619-446d-8d02-62b3a0d20cf7 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:57.667526 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-11590c45-9619-446d-8d02-62b3a0d20cf7 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:57.668167 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-11590c45-9619-446d-8d02-62b3a0d20cf7 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:57.669167 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-11590c45-9619-446d-8d02-62b3a0d20cf7 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:57.669904 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-11590c45-9619-446d-8d02-62b3a0d20cf7 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:57.670471 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-11590c45-9619-446d-8d02-62b3a0d20cf7 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:57.805884 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-11590c45-9619-446d-8d02-62b3a0d20cf7 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbf6128b374efa8bf274a485095a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0f83e4d73246b1ac819c0c43939854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:37:57.813974 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-11590c45-9619-446d-8d02-62b3a0d20cf7 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] 10.222.0.79 "GET /compute/v2.1/servers/26751ad5-5902-4bc8-a9de-3f19603d7f93" status: 200 len: 1317 microversion: 2.1 time: 0.164276 Oct 17 14:37:57.814547 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3347/6832] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:37:57 2022] GET /compute/v2.1/servers/26751ad5-5902-4bc8-a9de-3f19603d7f93 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:37:58.842134 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b7ef7c32-2700-4579-9a09-4e9de8d36ccb tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:37:58.843092 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b7ef7c32-2700-4579-9a09-4e9de8d36ccb tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] [instance: 26751ad5-5902-4bc8-a9de-3f19603d7f93] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:37:58.851962 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b7ef7c32-2700-4579-9a09-4e9de8d36ccb tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:58.852530 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b7ef7c32-2700-4579-9a09-4e9de8d36ccb tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:58.853040 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b7ef7c32-2700-4579-9a09-4e9de8d36ccb tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:58.853858 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b7ef7c32-2700-4579-9a09-4e9de8d36ccb tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:58.854389 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b7ef7c32-2700-4579-9a09-4e9de8d36ccb tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:58.854873 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b7ef7c32-2700-4579-9a09-4e9de8d36ccb tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:58.994517 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b7ef7c32-2700-4579-9a09-4e9de8d36ccb tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbf6128b374efa8bf274a485095a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0f83e4d73246b1ac819c0c43939854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:37:59.003990 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b7ef7c32-2700-4579-9a09-4e9de8d36ccb tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] 10.222.0.79 "GET /compute/v2.1/servers/26751ad5-5902-4bc8-a9de-3f19603d7f93" status: 200 len: 1317 microversion: 2.1 time: 0.168822 Oct 17 14:37:59.004576 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3486/6833] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:37:58 2022] GET /compute/v2.1/servers/26751ad5-5902-4bc8-a9de-3f19603d7f93 => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:37:59.887190 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-4bc7acbd-a315-4e07-92ba-4161ecd8854f req-7fb11e6f-0f79-449c-ba96-ffcbb4d2ad28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26751ad5-5902-4bc8-a9de-3f19603d7f93", "name": "network-vif-plugged", "status": "completed", "tag": "e5c20d17-f638-4456-af3c-645262efddaf"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:37:59.898218 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-4bc7acbd-a315-4e07-92ba-4161ecd8854f req-7fb11e6f-0f79-449c-ba96-ffcbb4d2ad28 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:37:59.898730 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-4bc7acbd-a315-4e07-92ba-4161ecd8854f req-7fb11e6f-0f79-449c-ba96-ffcbb4d2ad28 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:37:59.899323 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-4bc7acbd-a315-4e07-92ba-4161ecd8854f req-7fb11e6f-0f79-449c-ba96-ffcbb4d2ad28 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:37:59.913321 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-4bc7acbd-a315-4e07-92ba-4161ecd8854f req-7fb11e6f-0f79-449c-ba96-ffcbb4d2ad28 service nova] Creating event network-vif-plugged:e5c20d17-f638-4456-af3c-645262efddaf for instance 26751ad5-5902-4bc8-a9de-3f19603d7f93 on n-h1-854247-14 Oct 17 14:37:59.918462 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-4bc7acbd-a315-4e07-92ba-4161ecd8854f req-7fb11e6f-0f79-449c-ba96-ffcbb4d2ad28 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035130 Oct 17 14:37:59.919194 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3348/6834] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:38:00.035560 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-eefa87b5-1a2b-4c64-8953-9a387561eba9 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:38:00.036385 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-eefa87b5-1a2b-4c64-8953-9a387561eba9 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] [instance: 26751ad5-5902-4bc8-a9de-3f19603d7f93] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:38:00.043907 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eefa87b5-1a2b-4c64-8953-9a387561eba9 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:00.044405 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eefa87b5-1a2b-4c64-8953-9a387561eba9 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:00.044901 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eefa87b5-1a2b-4c64-8953-9a387561eba9 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:00.045612 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eefa87b5-1a2b-4c64-8953-9a387561eba9 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:00.046071 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eefa87b5-1a2b-4c64-8953-9a387561eba9 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:00.046503 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eefa87b5-1a2b-4c64-8953-9a387561eba9 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:00.190920 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-eefa87b5-1a2b-4c64-8953-9a387561eba9 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbf6128b374efa8bf274a485095a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0f83e4d73246b1ac819c0c43939854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:38:00.198899 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-eefa87b5-1a2b-4c64-8953-9a387561eba9 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] 10.222.0.79 "GET /compute/v2.1/servers/26751ad5-5902-4bc8-a9de-3f19603d7f93" status: 200 len: 1317 microversion: 2.1 time: 0.167383 Oct 17 14:38:00.199516 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3487/6835] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:38:00 2022] GET /compute/v2.1/servers/26751ad5-5902-4bc8-a9de-3f19603d7f93 => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:38:01.223415 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bea2ff22-8929-4675-92b2-f2acfe53a5d7 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:38:01.224131 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-bea2ff22-8929-4675-92b2-f2acfe53a5d7 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] [instance: 26751ad5-5902-4bc8-a9de-3f19603d7f93] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:38:01.230735 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bea2ff22-8929-4675-92b2-f2acfe53a5d7 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:01.231223 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bea2ff22-8929-4675-92b2-f2acfe53a5d7 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:01.231692 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bea2ff22-8929-4675-92b2-f2acfe53a5d7 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:01.232394 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bea2ff22-8929-4675-92b2-f2acfe53a5d7 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:01.232857 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bea2ff22-8929-4675-92b2-f2acfe53a5d7 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:01.233290 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bea2ff22-8929-4675-92b2-f2acfe53a5d7 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:01.372570 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-bea2ff22-8929-4675-92b2-f2acfe53a5d7 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbf6128b374efa8bf274a485095a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0f83e4d73246b1ac819c0c43939854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:38:01.385709 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-bea2ff22-8929-4675-92b2-f2acfe53a5d7 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] 10.222.0.79 "GET /compute/v2.1/servers/26751ad5-5902-4bc8-a9de-3f19603d7f93" status: 200 len: 1507 microversion: 2.1 time: 0.167212 Oct 17 14:38:01.386623 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3349/6836] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:38:01 2022] GET /compute/v2.1/servers/26751ad5-5902-4bc8-a9de-3f19603d7f93 => generated 1507 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:38:01.409181 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-bdaec159-df3d-4af0-8aa4-184d39198601 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:38:01.409696 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-bdaec159-df3d-4af0-8aa4-184d39198601 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] [instance: 26751ad5-5902-4bc8-a9de-3f19603d7f93] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:38:01.417053 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bdaec159-df3d-4af0-8aa4-184d39198601 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:01.417538 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bdaec159-df3d-4af0-8aa4-184d39198601 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:01.417980 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bdaec159-df3d-4af0-8aa4-184d39198601 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:01.418674 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bdaec159-df3d-4af0-8aa4-184d39198601 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:01.419132 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bdaec159-df3d-4af0-8aa4-184d39198601 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:01.419618 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bdaec159-df3d-4af0-8aa4-184d39198601 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:01.445450 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-bdaec159-df3d-4af0-8aa4-184d39198601 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] [instance: 26751ad5-5902-4bc8-a9de-3f19603d7f93] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:38:01.532295 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-bdaec159-df3d-4af0-8aa4-184d39198601 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] 10.222.0.79 "DELETE /compute/v2.1/servers/26751ad5-5902-4bc8-a9de-3f19603d7f93" status: 204 len: 0 microversion: 2.1 time: 0.126555 Oct 17 14:38:01.532973 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3488/6837] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:38:01 2022] DELETE /compute/v2.1/servers/26751ad5-5902-4bc8-a9de-3f19603d7f93 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:38:01.541608 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a65481f3-ff65-4672-80f9-af0eb4ba835c tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:38:01.542320 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a65481f3-ff65-4672-80f9-af0eb4ba835c tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] [instance: 26751ad5-5902-4bc8-a9de-3f19603d7f93] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:38:01.548536 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a65481f3-ff65-4672-80f9-af0eb4ba835c tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:01.549033 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a65481f3-ff65-4672-80f9-af0eb4ba835c tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:01.549479 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a65481f3-ff65-4672-80f9-af0eb4ba835c tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:01.550174 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a65481f3-ff65-4672-80f9-af0eb4ba835c tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:01.550634 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a65481f3-ff65-4672-80f9-af0eb4ba835c tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:01.551062 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a65481f3-ff65-4672-80f9-af0eb4ba835c tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:01.685973 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a65481f3-ff65-4672-80f9-af0eb4ba835c tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbf6128b374efa8bf274a485095a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0f83e4d73246b1ac819c0c43939854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:38:01.694255 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a65481f3-ff65-4672-80f9-af0eb4ba835c tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] 10.222.0.79 "GET /compute/v2.1/servers/26751ad5-5902-4bc8-a9de-3f19603d7f93" status: 200 len: 1513 microversion: 2.1 time: 0.156612 Oct 17 14:38:01.694836 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3350/6838] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:38:01 2022] GET /compute/v2.1/servers/26751ad5-5902-4bc8-a9de-3f19603d7f93 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:38:02.718690 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f9909d29-e70f-4e63-ba81-552aeca8f5cc tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:38:02.719475 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f9909d29-e70f-4e63-ba81-552aeca8f5cc tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] [instance: 26751ad5-5902-4bc8-a9de-3f19603d7f93] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:38:02.721514 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:38:02.722331 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=6 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:38:02.728995 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f9909d29-e70f-4e63-ba81-552aeca8f5cc tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:02.729522 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f9909d29-e70f-4e63-ba81-552aeca8f5cc tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:02.729916 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f9909d29-e70f-4e63-ba81-552aeca8f5cc tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:02.730684 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f9909d29-e70f-4e63-ba81-552aeca8f5cc tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:02.731193 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f9909d29-e70f-4e63-ba81-552aeca8f5cc tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:02.731585 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f9909d29-e70f-4e63-ba81-552aeca8f5cc tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:02.872617 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f9909d29-e70f-4e63-ba81-552aeca8f5cc tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbf6128b374efa8bf274a485095a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0f83e4d73246b1ac819c0c43939854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:38:02.880734 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f9909d29-e70f-4e63-ba81-552aeca8f5cc tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] 10.222.0.79 "GET /compute/v2.1/servers/26751ad5-5902-4bc8-a9de-3f19603d7f93" status: 200 len: 1513 microversion: 2.1 time: 0.166813 Oct 17 14:38:02.881317 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3489/6839] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:38:02 2022] GET /compute/v2.1/servers/26751ad5-5902-4bc8-a9de-3f19603d7f93 => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:38:03.281655 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-178dca00-6c3d-4374-9358-1d0aebd2879b req-4cdb167b-2bc1-4d3a-98c2-592110be2a26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26751ad5-5902-4bc8-a9de-3f19603d7f93", "name": "network-vif-deleted", "tag": "e5c20d17-f638-4456-af3c-645262efddaf"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:38:03.291356 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:38:03.299021 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-178dca00-6c3d-4374-9358-1d0aebd2879b req-4cdb167b-2bc1-4d3a-98c2-592110be2a26 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:03.299680 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-178dca00-6c3d-4374-9358-1d0aebd2879b req-4cdb167b-2bc1-4d3a-98c2-592110be2a26 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:03.300126 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-178dca00-6c3d-4374-9358-1d0aebd2879b req-4cdb167b-2bc1-4d3a-98c2-592110be2a26 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:03.315114 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-178dca00-6c3d-4374-9358-1d0aebd2879b req-4cdb167b-2bc1-4d3a-98c2-592110be2a26 service nova] Creating event network-vif-deleted:e5c20d17-f638-4456-af3c-645262efddaf for instance 26751ad5-5902-4bc8-a9de-3f19603d7f93 on n-h1-854247-14 Oct 17 14:38:03.321584 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-178dca00-6c3d-4374-9358-1d0aebd2879b req-4cdb167b-2bc1-4d3a-98c2-592110be2a26 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043778 Oct 17 14:38:03.322832 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3351/6840] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:38:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:38:03.908205 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-08ff6de9-5b7a-4774-af4d-55eb28d2aec3 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:38:03.908842 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-08ff6de9-5b7a-4774-af4d-55eb28d2aec3 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] [instance: 26751ad5-5902-4bc8-a9de-3f19603d7f93] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:38:03.919788 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-08ff6de9-5b7a-4774-af4d-55eb28d2aec3 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:03.920476 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-08ff6de9-5b7a-4774-af4d-55eb28d2aec3 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:03.920873 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-08ff6de9-5b7a-4774-af4d-55eb28d2aec3 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:03.921567 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-08ff6de9-5b7a-4774-af4d-55eb28d2aec3 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:03.922021 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-08ff6de9-5b7a-4774-af4d-55eb28d2aec3 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:03.922440 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-08ff6de9-5b7a-4774-af4d-55eb28d2aec3 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:03.937047 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-08ff6de9-5b7a-4774-af4d-55eb28d2aec3 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] HTTP exception thrown: Instance 26751ad5-5902-4bc8-a9de-3f19603d7f93 could not be found. Oct 17 14:38:03.937846 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-08ff6de9-5b7a-4774-af4d-55eb28d2aec3 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Request method failure captured: Oct 17 14:38:03.937846 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/26751ad5-5902-4bc8-a9de-3f19603d7f93 HTTP/1.1 Oct 17 14:38:03.937846 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 14:38:03.937846 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 14:38:03.937846 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 14:38:03.937846 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 14:38:03.937846 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 14:38:03.937846 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 14:38:03.937846 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 14:38:03.937846 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 14:38:03.937846 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTWi03dAQ9tl47IuxYwulVjYftpsQev6oFhAQnnvf4kI8ZvdvpZWIA3tnGWxh6UjsE5TVMXisxIAYhAayPA_wnesmDjKcKLwDLAEtycFLWVip9zbxWSpS4RU7hLb8rkMeMLqW3z0m2gmm9oFw3mw57Zn8EdAAZ3vVMZ6cGbdcbXs2SIg Oct 17 14:38:03.937846 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 14:38:03.937846 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 14:38:03.937846 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 14:38:03.937846 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 14:38:03.937846 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 14:38:03.937846 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 14:38:03.937846 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: ad0f83e4d73246b1ac819c0c43939854 Oct 17 14:38:03.937846 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServersNegativeTestJSON-241207535 Oct 17 14:38:03.937846 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 14:38:03.937846 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 14:38:03.937846 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ad0f83e4d73246b1ac819c0c43939854"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ad0f83e4d73246b1ac819c0c43939854"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ad0f83e4d73246b1ac819c0c43939854"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ad0f83e4d73246b1ac819c0c43939854", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:38:03.937846 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServersNegativeTestJSON-241207535 Oct 17 14:38:03.937846 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: ad0f83e4d73246b1ac819c0c43939854 Oct 17 14:38:03.937846 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServersNegativeTestJSON-241207535 Oct 17 14:38:03.937846 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServersNegativeTestJSON-241207535-project Oct 17 14:38:03.937846 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 14:38:03.937846 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 14:38:03.937846 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 19fbf6128b374efa8bf274a485095a3e Oct 17 14:38:03.937846 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServersNegativeTestJSON-241207535-project Oct 17 14:38:03.937846 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 14:38:03.937846 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 26751ad5-5902-4bc8-a9de-3f19603d7f93 could not be found. Oct 17 14:38:03.937846 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '26751ad5-5902-4bc8-a9de-3f19603d7f93'} Oct 17 14:38:03.937846 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:38:03.937846 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:38:03.937846 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:38:03.937846 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:38:03.937846 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:38:03.937846 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:38:03.937846 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:38:03.937846 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:38:03.937846 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:38:03.937846 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:38:03.937846 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26751ad5-5902-4bc8-a9de-3f19603d7f93 could not be found. Oct 17 14:38:03.937846 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:38:03.937846 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:38:03.937846 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:38:03.937846 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:38:03.937846 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:38:03.937846 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:38:03.937846 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:38:03.937846 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:38:03.937846 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:38:03.937846 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:38:03.937846 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:38:03.937846 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:38:03.937846 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:38:03.937846 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:38:03.937846 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:38:03.937846 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:38:03.937846 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26751ad5-5902-4bc8-a9de-3f19603d7f93 could not be found. Oct 17 14:38:03.937846 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:38:03.937846 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:38:03.937846 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:38:03.942595 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:38:03.942595 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:38:03.942595 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:38:03.942595 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:38:03.942595 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:38:03.942595 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26751ad5-5902-4bc8-a9de-3f19603d7f93 could not be found. Oct 17 14:38:03.942595 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:38:03.942595 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-08ff6de9-5b7a-4774-af4d-55eb28d2aec3 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Returning 404 to user: Instance 26751ad5-5902-4bc8-a9de-3f19603d7f93 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:38:03.942595 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-08ff6de9-5b7a-4774-af4d-55eb28d2aec3 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] 10.222.0.79 "GET /compute/v2.1/servers/26751ad5-5902-4bc8-a9de-3f19603d7f93" status: 404 len: 111 microversion: 2.1 time: 0.037122 Oct 17 14:38:03.942595 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3490/6841] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:38:03 2022] GET /compute/v2.1/servers/26751ad5-5902-4bc8-a9de-3f19603d7f93 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:38:03.949125 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d2bf8c2e-5f5f-46ab-8d51-453dab7a109b tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:38:03.949849 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d2bf8c2e-5f5f-46ab-8d51-453dab7a109b tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] [instance: 3549aca2-dfe7-4d26-99aa-20808d44ee1e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:38:03.956691 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d2bf8c2e-5f5f-46ab-8d51-453dab7a109b tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:03.957181 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d2bf8c2e-5f5f-46ab-8d51-453dab7a109b tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:03.957624 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d2bf8c2e-5f5f-46ab-8d51-453dab7a109b tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:03.958318 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d2bf8c2e-5f5f-46ab-8d51-453dab7a109b tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:03.958775 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d2bf8c2e-5f5f-46ab-8d51-453dab7a109b tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:03.959202 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d2bf8c2e-5f5f-46ab-8d51-453dab7a109b tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:04.091553 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d2bf8c2e-5f5f-46ab-8d51-453dab7a109b tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbf6128b374efa8bf274a485095a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0f83e4d73246b1ac819c0c43939854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:38:04.100329 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d2bf8c2e-5f5f-46ab-8d51-453dab7a109b tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] 10.222.0.79 "GET /compute/v2.1/servers/3549aca2-dfe7-4d26-99aa-20808d44ee1e" status: 200 len: 1506 microversion: 2.1 time: 0.155418 Oct 17 14:38:04.100881 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3352/6842] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:38:03 2022] GET /compute/v2.1/servers/3549aca2-dfe7-4d26-99aa-20808d44ee1e => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:38:04.122856 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cb4c0c34-638b-4fdd-9bec-e17ca842b451 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:38:04.125265 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cb4c0c34-638b-4fdd-9bec-e17ca842b451 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] [instance: 5f57d433-bcf2-43a5-96a5-91986425ca73] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:38:04.131310 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-cb4c0c34-638b-4fdd-9bec-e17ca842b451 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] HTTP exception thrown: Instance 5f57d433-bcf2-43a5-96a5-91986425ca73 could not be found. Oct 17 14:38:04.133234 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cb4c0c34-638b-4fdd-9bec-e17ca842b451 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Request method failure captured: Oct 17 14:38:04.133234 n-d-854247-14 devstack@n-api.service[127016]: request: POST /compute/v2.1/servers/5f57d433-bcf2-43a5-96a5-91986425ca73/action HTTP/1.1 Oct 17 14:38:04.133234 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 14:38:04.133234 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 14:38:04.133234 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 14:38:04.133234 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 32 Oct 17 14:38:04.133234 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 14:38:04.133234 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 14:38:04.133234 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 14:38:04.133234 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 14:38:04.133234 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTWi03dAQ9tl47IuxYwulVjYftpsQev6oFhAQnnvf4kI8ZvdvpZWIA3tnGWxh6UjsE5TVMXisxIAYhAayPA_wnesmDjKcKLwDLAEtycFLWVip9zbxWSpS4RU7hLb8rkMeMLqW3z0m2gmm9oFw3mw57Zn8EdAAZ3vVMZ6cGbdcbXs2SIg Oct 17 14:38:04.133234 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 14:38:04.133234 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 14:38:04.133234 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 14:38:04.133234 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 14:38:04.133234 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 14:38:04.133234 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 14:38:04.133234 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: ad0f83e4d73246b1ac819c0c43939854 Oct 17 14:38:04.133234 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServersNegativeTestJSON-241207535 Oct 17 14:38:04.133234 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 14:38:04.133234 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 14:38:04.133234 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ad0f83e4d73246b1ac819c0c43939854"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ad0f83e4d73246b1ac819c0c43939854"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ad0f83e4d73246b1ac819c0c43939854"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ad0f83e4d73246b1ac819c0c43939854", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:38:04.133234 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServersNegativeTestJSON-241207535 Oct 17 14:38:04.133234 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: ad0f83e4d73246b1ac819c0c43939854 Oct 17 14:38:04.133234 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServersNegativeTestJSON-241207535 Oct 17 14:38:04.133234 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServersNegativeTestJSON-241207535-project Oct 17 14:38:04.133234 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 14:38:04.133234 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 14:38:04.133234 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 19fbf6128b374efa8bf274a485095a3e Oct 17 14:38:04.133234 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServersNegativeTestJSON-241207535-project Oct 17 14:38:04.133234 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 14:38:04.133234 n-d-854247-14 devstack@n-api.service[127016]: {"resize": {"flavorRef": "452"}} Oct 17 14:38:04.133234 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 14:38:04.133234 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 5f57d433-bcf2-43a5-96a5-91986425ca73 could not be found. Oct 17 14:38:04.133234 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '5f57d433-bcf2-43a5-96a5-91986425ca73', 'body': {'resize': {'flavorRef': '452'}}} Oct 17 14:38:04.133234 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:38:04.133234 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:38:04.133234 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:38:04.133234 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:38:04.133234 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:38:04.133234 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:38:04.133234 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 14:38:04.133234 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 14:38:04.133234 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f57d433-bcf2-43a5-96a5-91986425ca73 could not be found. Oct 17 14:38:04.133234 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:38:04.133234 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:38:04.133234 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:38:04.133234 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:38:04.133234 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:38:04.133234 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:38:04.133234 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:38:04.133234 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:38:04.133234 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:38:04.133234 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:38:04.133234 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 14:38:04.133234 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 14:38:04.133234 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 17 14:38:04.133234 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 17 14:38:04.133234 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Oct 17 14:38:04.133234 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Oct 17 14:38:04.133234 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:38:04.133234 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:38:04.133234 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:38:04.133234 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:38:04.137707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f57d433-bcf2-43a5-96a5-91986425ca73 could not be found. Oct 17 14:38:04.137707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:38:04.137707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:38:04.137707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:38:04.137707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:38:04.137707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:38:04.137707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:38:04.137707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:38:04.137707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:38:04.137707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f57d433-bcf2-43a5-96a5-91986425ca73 could not be found. Oct 17 14:38:04.137707 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:38:04.137707 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cb4c0c34-638b-4fdd-9bec-e17ca842b451 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Returning 404 to user: Instance 5f57d433-bcf2-43a5-96a5-91986425ca73 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:38:04.137707 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cb4c0c34-638b-4fdd-9bec-e17ca842b451 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] 10.222.0.79 "POST /compute/v2.1/servers/5f57d433-bcf2-43a5-96a5-91986425ca73/action" status: 404 len: 111 microversion: 2.1 time: 0.015930 Oct 17 14:38:04.137707 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3491/6843] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:38:04 2022] POST /compute/v2.1/servers/5f57d433-bcf2-43a5-96a5-91986425ca73/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 14:38:04.143467 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-20dfab2b-7d52-4a21-b273-dac0ebbd9c15 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:38:04.144098 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-20dfab2b-7d52-4a21-b273-dac0ebbd9c15 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] [instance: 3549aca2-dfe7-4d26-99aa-20808d44ee1e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:38:04.150740 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-20dfab2b-7d52-4a21-b273-dac0ebbd9c15 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:04.151278 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-20dfab2b-7d52-4a21-b273-dac0ebbd9c15 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:04.151730 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-20dfab2b-7d52-4a21-b273-dac0ebbd9c15 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:04.152408 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-20dfab2b-7d52-4a21-b273-dac0ebbd9c15 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:04.152875 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-20dfab2b-7d52-4a21-b273-dac0ebbd9c15 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:04.153314 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-20dfab2b-7d52-4a21-b273-dac0ebbd9c15 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:04.297232 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-20dfab2b-7d52-4a21-b273-dac0ebbd9c15 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbf6128b374efa8bf274a485095a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0f83e4d73246b1ac819c0c43939854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:38:04.305450 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-20dfab2b-7d52-4a21-b273-dac0ebbd9c15 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] 10.222.0.79 "GET /compute/v2.1/servers/3549aca2-dfe7-4d26-99aa-20808d44ee1e" status: 200 len: 1506 microversion: 2.1 time: 0.165948 Oct 17 14:38:04.305997 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3353/6844] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:38:04 2022] GET /compute/v2.1/servers/3549aca2-dfe7-4d26-99aa-20808d44ee1e => generated 1506 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:38:04.329103 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-05d631ff-2bc0-4dfc-ac5a-6587d9914b2a tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:38:04.329722 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-05d631ff-2bc0-4dfc-ac5a-6587d9914b2a tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] [instance: 3549aca2-dfe7-4d26-99aa-20808d44ee1e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:38:04.340816 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-05d631ff-2bc0-4dfc-ac5a-6587d9914b2a tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:04.341306 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-05d631ff-2bc0-4dfc-ac5a-6587d9914b2a tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:04.341748 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-05d631ff-2bc0-4dfc-ac5a-6587d9914b2a tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:04.342732 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-05d631ff-2bc0-4dfc-ac5a-6587d9914b2a tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:04.343202 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-05d631ff-2bc0-4dfc-ac5a-6587d9914b2a tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:04.343661 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-05d631ff-2bc0-4dfc-ac5a-6587d9914b2a tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:04.484062 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-05d631ff-2bc0-4dfc-ac5a-6587d9914b2a tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbf6128b374efa8bf274a485095a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0f83e4d73246b1ac819c0c43939854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:38:04.496894 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-05d631ff-2bc0-4dfc-ac5a-6587d9914b2a tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] 10.222.0.79 "GET /compute/v2.1/servers/3549aca2-dfe7-4d26-99aa-20808d44ee1e" status: 200 len: 1506 microversion: 2.1 time: 0.171969 Oct 17 14:38:04.497671 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3492/6845] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:38:04 2022] GET /compute/v2.1/servers/3549aca2-dfe7-4d26-99aa-20808d44ee1e => generated 1506 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:38:04.526059 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5700cbd0-fcc9-4bc2-9b90-629cbc84aced tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "92ab05a7-bde6-44bb-93ae-b1ebc1d3edd4"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:38:04.528639 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5700cbd0-fcc9-4bc2-9b90-629cbc84aced tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] [instance: 3549aca2-dfe7-4d26-99aa-20808d44ee1e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:38:04.535526 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5700cbd0-fcc9-4bc2-9b90-629cbc84aced tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:04.536017 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5700cbd0-fcc9-4bc2-9b90-629cbc84aced tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:04.536463 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5700cbd0-fcc9-4bc2-9b90-629cbc84aced tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:04.537159 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5700cbd0-fcc9-4bc2-9b90-629cbc84aced tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:04.537617 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5700cbd0-fcc9-4bc2-9b90-629cbc84aced tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:04.538067 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5700cbd0-fcc9-4bc2-9b90-629cbc84aced tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:04.567458 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5700cbd0-fcc9-4bc2-9b90-629cbc84aced tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '19fbf6128b374efa8bf274a485095a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0f83e4d73246b1ac819c0c43939854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:38:04.572536 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-5700cbd0-fcc9-4bc2-9b90-629cbc84aced tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] HTTP exception thrown: Flavor 92ab05a7-bde6-44bb-93ae-b1ebc1d3edd4 could not be found. Oct 17 14:38:04.578653 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5700cbd0-fcc9-4bc2-9b90-629cbc84aced tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Request method failure captured: Oct 17 14:38:04.578653 n-d-854247-14 devstack@n-api.service[127017]: request: POST /compute/v2.1/servers/3549aca2-dfe7-4d26-99aa-20808d44ee1e/action HTTP/1.1 Oct 17 14:38:04.578653 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 14:38:04.578653 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 14:38:04.578653 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 14:38:04.578653 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 65 Oct 17 14:38:04.578653 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 14:38:04.578653 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 14:38:04.578653 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 14:38:04.578653 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 14:38:04.578653 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTWi03dAQ9tl47IuxYwulVjYftpsQev6oFhAQnnvf4kI8ZvdvpZWIA3tnGWxh6UjsE5TVMXisxIAYhAayPA_wnesmDjKcKLwDLAEtycFLWVip9zbxWSpS4RU7hLb8rkMeMLqW3z0m2gmm9oFw3mw57Zn8EdAAZ3vVMZ6cGbdcbXs2SIg Oct 17 14:38:04.578653 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 14:38:04.578653 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 14:38:04.578653 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 14:38:04.578653 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 14:38:04.578653 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 14:38:04.578653 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 14:38:04.578653 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: ad0f83e4d73246b1ac819c0c43939854 Oct 17 14:38:04.578653 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServersNegativeTestJSON-241207535 Oct 17 14:38:04.578653 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 14:38:04.578653 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 14:38:04.578653 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ad0f83e4d73246b1ac819c0c43939854"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ad0f83e4d73246b1ac819c0c43939854"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ad0f83e4d73246b1ac819c0c43939854"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ad0f83e4d73246b1ac819c0c43939854", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:38:04.578653 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServersNegativeTestJSON-241207535 Oct 17 14:38:04.578653 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: ad0f83e4d73246b1ac819c0c43939854 Oct 17 14:38:04.578653 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServersNegativeTestJSON-241207535 Oct 17 14:38:04.578653 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServersNegativeTestJSON-241207535-project Oct 17 14:38:04.578653 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 14:38:04.578653 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 14:38:04.578653 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 19fbf6128b374efa8bf274a485095a3e Oct 17 14:38:04.578653 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServersNegativeTestJSON-241207535-project Oct 17 14:38:04.578653 n-d-854247-14 devstack@n-api.service[127017]: Oct 17 14:38:04.578653 n-d-854247-14 devstack@n-api.service[127017]: {"resize": {"flavorRef": "92ab05a7-bde6-44bb-93ae-b1ebc1d3edd4"}} Oct 17 14:38:04.578653 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 14:38:04.578653 n-d-854247-14 devstack@n-api.service[127017]: exception: Flavor 92ab05a7-bde6-44bb-93ae-b1ebc1d3edd4 could not be found. Oct 17 14:38:04.578653 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '3549aca2-dfe7-4d26-99aa-20808d44ee1e', 'body': {'resize': {'flavorRef': '92ab05a7-bde6-44bb-93ae-b1ebc1d3edd4'}}} Oct 17 14:38:04.578653 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:38:04.578653 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:38:04.578653 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 17 14:38:04.578653 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 17 14:38:04.578653 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 17 14:38:04.578653 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 14:38:04.578653 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 17 14:38:04.578653 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 14:38:04.578653 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 17 14:38:04.578653 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 14:38:04.578653 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 14:38:04.578653 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 14:38:04.578653 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 17 14:38:04.578653 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 14:38:04.578653 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 17 14:38:04.578653 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 14:38:04.578653 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Oct 17 14:38:04.578653 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Oct 17 14:38:04.578653 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 14:38:04.578653 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 14:38:04.578653 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 14:38:04.578653 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 14:38:04.578653 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 14:38:04.578653 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 14:38:04.578653 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 14:38:04.578653 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:38:04.578653 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 14:38:04.583435 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 14:38:04.583435 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 92ab05a7-bde6-44bb-93ae-b1ebc1d3edd4 could not be found. Oct 17 14:38:04.583435 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:38:04.583435 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:38:04.583435 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:38:04.583435 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:38:04.583435 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:38:04.583435 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:38:04.583435 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:38:04.583435 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:38:04.583435 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:38:04.583435 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:38:04.583435 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 14:38:04.583435 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 14:38:04.583435 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 17 14:38:04.583435 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 17 14:38:04.583435 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Oct 17 14:38:04.583435 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 17 14:38:04.583435 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 92ab05a7-bde6-44bb-93ae-b1ebc1d3edd4 could not be found. Oct 17 14:38:04.583435 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:38:04.583435 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:38:04.583435 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:38:04.583435 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:38:04.583435 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:38:04.583435 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:38:04.583435 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:38:04.583435 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:38:04.583435 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 92ab05a7-bde6-44bb-93ae-b1ebc1d3edd4 could not be found. Oct 17 14:38:04.583435 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:38:04.583435 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5700cbd0-fcc9-4bc2-9b90-629cbc84aced tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Returning 400 to user: Flavor 92ab05a7-bde6-44bb-93ae-b1ebc1d3edd4 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:38:04.583435 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5700cbd0-fcc9-4bc2-9b90-629cbc84aced tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] 10.222.0.79 "POST /compute/v2.1/servers/3549aca2-dfe7-4d26-99aa-20808d44ee1e/action" status: 400 len: 107 microversion: 2.1 time: 0.058099 Oct 17 14:38:04.583435 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3354/6846] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:38:04 2022] POST /compute/v2.1/servers/3549aca2-dfe7-4d26-99aa-20808d44ee1e/action => generated 107 bytes in 59 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 14:38:04.591352 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a6c76ea8-0246-4941-a582-3568cedc85f5 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:38:04.592462 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a6c76ea8-0246-4941-a582-3568cedc85f5 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] [instance: 3549aca2-dfe7-4d26-99aa-20808d44ee1e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:38:04.600683 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a6c76ea8-0246-4941-a582-3568cedc85f5 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:04.601173 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a6c76ea8-0246-4941-a582-3568cedc85f5 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:04.601611 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a6c76ea8-0246-4941-a582-3568cedc85f5 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:04.602312 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a6c76ea8-0246-4941-a582-3568cedc85f5 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:04.602769 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a6c76ea8-0246-4941-a582-3568cedc85f5 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:04.603228 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a6c76ea8-0246-4941-a582-3568cedc85f5 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:04.742886 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a6c76ea8-0246-4941-a582-3568cedc85f5 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbf6128b374efa8bf274a485095a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0f83e4d73246b1ac819c0c43939854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:38:04.752830 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a6c76ea8-0246-4941-a582-3568cedc85f5 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] 10.222.0.79 "GET /compute/v2.1/servers/3549aca2-dfe7-4d26-99aa-20808d44ee1e" status: 200 len: 1506 microversion: 2.1 time: 0.167451 Oct 17 14:38:04.753419 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3493/6847] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:38:04 2022] GET /compute/v2.1/servers/3549aca2-dfe7-4d26-99aa-20808d44ee1e => generated 1506 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:38:04.776992 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e8c59cc5-925b-4053-b1de-f0cc1d1d1a0c tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:38:04.777616 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e8c59cc5-925b-4053-b1de-f0cc1d1d1a0c tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] [instance: 3549aca2-dfe7-4d26-99aa-20808d44ee1e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:38:04.784482 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e8c59cc5-925b-4053-b1de-f0cc1d1d1a0c tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:04.784991 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e8c59cc5-925b-4053-b1de-f0cc1d1d1a0c tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:04.785446 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e8c59cc5-925b-4053-b1de-f0cc1d1d1a0c tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:04.786158 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e8c59cc5-925b-4053-b1de-f0cc1d1d1a0c tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:04.786627 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e8c59cc5-925b-4053-b1de-f0cc1d1d1a0c tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:04.787065 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e8c59cc5-925b-4053-b1de-f0cc1d1d1a0c tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:04.934906 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e8c59cc5-925b-4053-b1de-f0cc1d1d1a0c tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbf6128b374efa8bf274a485095a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0f83e4d73246b1ac819c0c43939854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:38:04.943456 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e8c59cc5-925b-4053-b1de-f0cc1d1d1a0c tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] 10.222.0.79 "GET /compute/v2.1/servers/3549aca2-dfe7-4d26-99aa-20808d44ee1e" status: 200 len: 1506 microversion: 2.1 time: 0.170467 Oct 17 14:38:04.944068 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3355/6848] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:38:04 2022] GET /compute/v2.1/servers/3549aca2-dfe7-4d26-99aa-20808d44ee1e => generated 1506 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:38:04.965865 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2c9f2393-9572-480d-919f-f02040323bad tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2c9f2393-9572-480d-919f-f02040323bad tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Request method failure captured: Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: request: POST /compute/v2.1/servers/3549aca2-dfe7-4d26-99aa-20808d44ee1e/action HTTP/1.1 Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 29 Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTWi03dAQ9tl47IuxYwulVjYftpsQev6oFhAQnnvf4kI8ZvdvpZWIA3tnGWxh6UjsE5TVMXisxIAYhAayPA_wnesmDjKcKLwDLAEtycFLWVip9zbxWSpS4RU7hLb8rkMeMLqW3z0m2gmm9oFw3mw57Zn8EdAAZ3vVMZ6cGbdcbXs2SIg Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: ad0f83e4d73246b1ac819c0c43939854 Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServersNegativeTestJSON-241207535 Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ad0f83e4d73246b1ac819c0c43939854"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ad0f83e4d73246b1ac819c0c43939854"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ad0f83e4d73246b1ac819c0c43939854"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ad0f83e4d73246b1ac819c0c43939854", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServersNegativeTestJSON-241207535 Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: ad0f83e4d73246b1ac819c0c43939854 Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServersNegativeTestJSON-241207535 Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServersNegativeTestJSON-241207535-project Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 19fbf6128b374efa8bf274a485095a3e Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServersNegativeTestJSON-241207535-project Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: {"resize": {"flavorRef": ""}} Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '3549aca2-dfe7-4d26-99aa-20808d44ee1e', 'body': {'resize': {'flavorRef': ''}}} Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise error Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi On instance['resize']: Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi '' Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:38:04.969554 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:38:04.974589 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:38:04.974589 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:38:04.974589 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:38:04.974589 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:38:04.974589 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 14:38:04.974589 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 14:38:04.974589 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 17 14:38:04.974589 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:38:04.974589 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2c9f2393-9572-480d-919f-f02040323bad tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:38:04.974589 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2c9f2393-9572-480d-919f-f02040323bad tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] 10.222.0.79 "POST /compute/v2.1/servers/3549aca2-dfe7-4d26-99aa-20808d44ee1e/action" status: 400 len: 113 microversion: 2.1 time: 0.009121 Oct 17 14:38:04.974589 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3494/6849] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:38:04 2022] POST /compute/v2.1/servers/3549aca2-dfe7-4d26-99aa-20808d44ee1e/action => generated 113 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 14:38:04.982476 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-36802844-936d-49f6-a363-c83d6ed828bc tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:38:04.983677 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-36802844-936d-49f6-a363-c83d6ed828bc tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] [instance: 3549aca2-dfe7-4d26-99aa-20808d44ee1e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:38:04.993173 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-36802844-936d-49f6-a363-c83d6ed828bc tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:04.993849 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-36802844-936d-49f6-a363-c83d6ed828bc tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:04.994583 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-36802844-936d-49f6-a363-c83d6ed828bc tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:04.995686 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-36802844-936d-49f6-a363-c83d6ed828bc tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:04.996484 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-36802844-936d-49f6-a363-c83d6ed828bc tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:04.997209 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-36802844-936d-49f6-a363-c83d6ed828bc tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:05.145584 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-36802844-936d-49f6-a363-c83d6ed828bc tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbf6128b374efa8bf274a485095a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0f83e4d73246b1ac819c0c43939854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:38:05.157127 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-36802844-936d-49f6-a363-c83d6ed828bc tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] 10.222.0.79 "GET /compute/v2.1/servers/3549aca2-dfe7-4d26-99aa-20808d44ee1e" status: 200 len: 1506 microversion: 2.1 time: 0.181262 Oct 17 14:38:05.157965 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3356/6850] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:38:04 2022] GET /compute/v2.1/servers/3549aca2-dfe7-4d26-99aa-20808d44ee1e => generated 1506 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:38:05.184072 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-52aa8c37-71ef-4dbc-935e-5bf8bf8b6c05 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:38:05.184547 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-52aa8c37-71ef-4dbc-935e-5bf8bf8b6c05 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] [instance: 26751ad5-5902-4bc8-a9de-3f19603d7f93] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:38:05.191919 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-52aa8c37-71ef-4dbc-935e-5bf8bf8b6c05 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:05.192412 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-52aa8c37-71ef-4dbc-935e-5bf8bf8b6c05 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:05.192851 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-52aa8c37-71ef-4dbc-935e-5bf8bf8b6c05 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:05.193547 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-52aa8c37-71ef-4dbc-935e-5bf8bf8b6c05 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:05.194011 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-52aa8c37-71ef-4dbc-935e-5bf8bf8b6c05 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:05.194438 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-52aa8c37-71ef-4dbc-935e-5bf8bf8b6c05 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:05.208633 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-52aa8c37-71ef-4dbc-935e-5bf8bf8b6c05 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] HTTP exception thrown: Instance 26751ad5-5902-4bc8-a9de-3f19603d7f93 could not be found. Oct 17 14:38:05.210218 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-52aa8c37-71ef-4dbc-935e-5bf8bf8b6c05 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Request method failure captured: Oct 17 14:38:05.210218 n-d-854247-14 devstack@n-api.service[127016]: request: DELETE /compute/v2.1/servers/26751ad5-5902-4bc8-a9de-3f19603d7f93 HTTP/1.1 Oct 17 14:38:05.210218 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 14:38:05.210218 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 14:38:05.210218 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 14:38:05.210218 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 14:38:05.210218 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 14:38:05.210218 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 14:38:05.210218 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 14:38:05.210218 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 14:38:05.210218 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTWi03dAQ9tl47IuxYwulVjYftpsQev6oFhAQnnvf4kI8ZvdvpZWIA3tnGWxh6UjsE5TVMXisxIAYhAayPA_wnesmDjKcKLwDLAEtycFLWVip9zbxWSpS4RU7hLb8rkMeMLqW3z0m2gmm9oFw3mw57Zn8EdAAZ3vVMZ6cGbdcbXs2SIg Oct 17 14:38:05.210218 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 14:38:05.210218 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 14:38:05.210218 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 14:38:05.210218 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 14:38:05.210218 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 14:38:05.210218 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 14:38:05.210218 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: ad0f83e4d73246b1ac819c0c43939854 Oct 17 14:38:05.210218 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServersNegativeTestJSON-241207535 Oct 17 14:38:05.210218 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 14:38:05.210218 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 14:38:05.210218 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ad0f83e4d73246b1ac819c0c43939854"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ad0f83e4d73246b1ac819c0c43939854"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ad0f83e4d73246b1ac819c0c43939854"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ad0f83e4d73246b1ac819c0c43939854", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:38:05.210218 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServersNegativeTestJSON-241207535 Oct 17 14:38:05.210218 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: ad0f83e4d73246b1ac819c0c43939854 Oct 17 14:38:05.210218 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServersNegativeTestJSON-241207535 Oct 17 14:38:05.210218 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServersNegativeTestJSON-241207535-project Oct 17 14:38:05.210218 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 14:38:05.210218 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 14:38:05.210218 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 19fbf6128b374efa8bf274a485095a3e Oct 17 14:38:05.210218 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServersNegativeTestJSON-241207535-project Oct 17 14:38:05.210218 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 14:38:05.210218 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 26751ad5-5902-4bc8-a9de-3f19603d7f93 could not be found. Oct 17 14:38:05.210218 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '26751ad5-5902-4bc8-a9de-3f19603d7f93'} Oct 17 14:38:05.210218 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:38:05.210218 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:38:05.210218 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:38:05.210218 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:38:05.210218 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:38:05.210218 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:38:05.210218 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:38:05.210218 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:38:05.210218 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:38:05.210218 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:38:05.210218 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26751ad5-5902-4bc8-a9de-3f19603d7f93 could not be found. Oct 17 14:38:05.210218 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:38:05.210218 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:38:05.210218 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:38:05.210218 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:38:05.210218 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:38:05.210218 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:38:05.210218 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:38:05.210218 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:38:05.210218 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:38:05.210218 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:38:05.210218 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 14:38:05.210218 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 14:38:05.210218 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 14:38:05.210218 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 14:38:05.210218 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:38:05.210218 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:38:05.210218 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:38:05.210218 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:38:05.214642 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26751ad5-5902-4bc8-a9de-3f19603d7f93 could not be found. Oct 17 14:38:05.214642 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:38:05.214642 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:38:05.214642 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:38:05.214642 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:38:05.214642 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:38:05.214642 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:38:05.214642 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:38:05.214642 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:38:05.214642 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26751ad5-5902-4bc8-a9de-3f19603d7f93 could not be found. Oct 17 14:38:05.214642 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:38:05.214642 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-52aa8c37-71ef-4dbc-935e-5bf8bf8b6c05 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Returning 404 to user: Instance 26751ad5-5902-4bc8-a9de-3f19603d7f93 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:38:05.214642 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-52aa8c37-71ef-4dbc-935e-5bf8bf8b6c05 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] 10.222.0.79 "DELETE /compute/v2.1/servers/26751ad5-5902-4bc8-a9de-3f19603d7f93" status: 404 len: 111 microversion: 2.1 time: 0.032551 Oct 17 14:38:05.214642 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3495/6851] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:38:05 2022] DELETE /compute/v2.1/servers/26751ad5-5902-4bc8-a9de-3f19603d7f93 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:38:05.223510 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-37fbe754-6c17-473a-8f12-1a34e09a9722 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:38:05.224416 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-37fbe754-6c17-473a-8f12-1a34e09a9722 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] [instance: 26751ad5-5902-4bc8-a9de-3f19603d7f93] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:38:05.233203 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-37fbe754-6c17-473a-8f12-1a34e09a9722 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:05.233696 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-37fbe754-6c17-473a-8f12-1a34e09a9722 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:05.234143 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-37fbe754-6c17-473a-8f12-1a34e09a9722 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:05.234835 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-37fbe754-6c17-473a-8f12-1a34e09a9722 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:05.235322 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-37fbe754-6c17-473a-8f12-1a34e09a9722 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:05.235751 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-37fbe754-6c17-473a-8f12-1a34e09a9722 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:05.249717 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-37fbe754-6c17-473a-8f12-1a34e09a9722 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] HTTP exception thrown: Instance 26751ad5-5902-4bc8-a9de-3f19603d7f93 could not be found. Oct 17 14:38:05.251251 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-37fbe754-6c17-473a-8f12-1a34e09a9722 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Request method failure captured: Oct 17 14:38:05.251251 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/26751ad5-5902-4bc8-a9de-3f19603d7f93 HTTP/1.1 Oct 17 14:38:05.251251 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 14:38:05.251251 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 14:38:05.251251 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 14:38:05.251251 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 14:38:05.251251 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 14:38:05.251251 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 14:38:05.251251 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 14:38:05.251251 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 14:38:05.251251 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTWi03dAQ9tl47IuxYwulVjYftpsQev6oFhAQnnvf4kI8ZvdvpZWIA3tnGWxh6UjsE5TVMXisxIAYhAayPA_wnesmDjKcKLwDLAEtycFLWVip9zbxWSpS4RU7hLb8rkMeMLqW3z0m2gmm9oFw3mw57Zn8EdAAZ3vVMZ6cGbdcbXs2SIg Oct 17 14:38:05.251251 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 14:38:05.251251 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 14:38:05.251251 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 14:38:05.251251 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 14:38:05.251251 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 14:38:05.251251 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 14:38:05.251251 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: ad0f83e4d73246b1ac819c0c43939854 Oct 17 14:38:05.251251 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-ServersNegativeTestJSON-241207535 Oct 17 14:38:05.251251 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 14:38:05.251251 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 14:38:05.251251 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ad0f83e4d73246b1ac819c0c43939854"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ad0f83e4d73246b1ac819c0c43939854"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ad0f83e4d73246b1ac819c0c43939854"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ad0f83e4d73246b1ac819c0c43939854", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:38:05.251251 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-ServersNegativeTestJSON-241207535 Oct 17 14:38:05.251251 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: ad0f83e4d73246b1ac819c0c43939854 Oct 17 14:38:05.251251 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-ServersNegativeTestJSON-241207535 Oct 17 14:38:05.251251 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-ServersNegativeTestJSON-241207535-project Oct 17 14:38:05.251251 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 14:38:05.251251 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 14:38:05.251251 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 19fbf6128b374efa8bf274a485095a3e Oct 17 14:38:05.251251 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-ServersNegativeTestJSON-241207535-project Oct 17 14:38:05.251251 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 14:38:05.251251 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 26751ad5-5902-4bc8-a9de-3f19603d7f93 could not be found. Oct 17 14:38:05.251251 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '26751ad5-5902-4bc8-a9de-3f19603d7f93'} Oct 17 14:38:05.251251 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:38:05.251251 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:38:05.251251 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:38:05.251251 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:38:05.251251 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:38:05.251251 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:38:05.251251 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:38:05.251251 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:38:05.251251 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:38:05.251251 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:38:05.251251 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26751ad5-5902-4bc8-a9de-3f19603d7f93 could not be found. Oct 17 14:38:05.251251 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:38:05.251251 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:38:05.251251 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:38:05.251251 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:38:05.251251 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:38:05.251251 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:38:05.251251 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:38:05.251251 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:38:05.251251 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:38:05.251251 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:38:05.251251 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:38:05.251251 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:38:05.251251 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:38:05.251251 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:38:05.251251 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:38:05.251251 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:38:05.251251 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26751ad5-5902-4bc8-a9de-3f19603d7f93 could not be found. Oct 17 14:38:05.251251 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:38:05.251251 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:38:05.251251 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:38:05.256042 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:38:05.256042 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:38:05.256042 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:38:05.256042 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:38:05.256042 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:38:05.256042 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26751ad5-5902-4bc8-a9de-3f19603d7f93 could not be found. Oct 17 14:38:05.256042 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:38:05.256042 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-37fbe754-6c17-473a-8f12-1a34e09a9722 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Returning 404 to user: Instance 26751ad5-5902-4bc8-a9de-3f19603d7f93 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:38:05.256042 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-37fbe754-6c17-473a-8f12-1a34e09a9722 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] 10.222.0.79 "GET /compute/v2.1/servers/26751ad5-5902-4bc8-a9de-3f19603d7f93" status: 404 len: 111 microversion: 2.1 time: 0.035314 Oct 17 14:38:05.256042 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3357/6852] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:38:05 2022] GET /compute/v2.1/servers/26751ad5-5902-4bc8-a9de-3f19603d7f93 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:38:05.261723 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9ed0faae-2acd-4608-a972-f095c2e555ed tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:38:05.262233 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9ed0faae-2acd-4608-a972-f095c2e555ed tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] [instance: 3549aca2-dfe7-4d26-99aa-20808d44ee1e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:38:05.268694 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9ed0faae-2acd-4608-a972-f095c2e555ed tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:05.269183 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9ed0faae-2acd-4608-a972-f095c2e555ed tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:05.269588 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9ed0faae-2acd-4608-a972-f095c2e555ed tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:05.270281 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9ed0faae-2acd-4608-a972-f095c2e555ed tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:05.270736 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9ed0faae-2acd-4608-a972-f095c2e555ed tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:05.271155 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9ed0faae-2acd-4608-a972-f095c2e555ed tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:05.297658 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9ed0faae-2acd-4608-a972-f095c2e555ed tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] [instance: 3549aca2-dfe7-4d26-99aa-20808d44ee1e] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:38:05.300517 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:38:05.387110 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9ed0faae-2acd-4608-a972-f095c2e555ed tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3549aca2-dfe7-4d26-99aa-20808d44ee1e" status: 204 len: 0 microversion: 2.1 time: 0.129065 Oct 17 14:38:05.387757 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3496/6853] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:38:05 2022] DELETE /compute/v2.1/servers/3549aca2-dfe7-4d26-99aa-20808d44ee1e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:38:05.397711 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7ef49cab-5552-4e3e-8d90-8e9bf4d947c3 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:38:05.398349 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7ef49cab-5552-4e3e-8d90-8e9bf4d947c3 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] [instance: 3549aca2-dfe7-4d26-99aa-20808d44ee1e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:38:05.405936 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7ef49cab-5552-4e3e-8d90-8e9bf4d947c3 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:05.406445 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7ef49cab-5552-4e3e-8d90-8e9bf4d947c3 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:05.406895 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7ef49cab-5552-4e3e-8d90-8e9bf4d947c3 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:05.407637 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7ef49cab-5552-4e3e-8d90-8e9bf4d947c3 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:05.408104 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7ef49cab-5552-4e3e-8d90-8e9bf4d947c3 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:05.408546 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7ef49cab-5552-4e3e-8d90-8e9bf4d947c3 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:05.552606 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7ef49cab-5552-4e3e-8d90-8e9bf4d947c3 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbf6128b374efa8bf274a485095a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0f83e4d73246b1ac819c0c43939854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:38:05.560941 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7ef49cab-5552-4e3e-8d90-8e9bf4d947c3 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] 10.222.0.79 "GET /compute/v2.1/servers/3549aca2-dfe7-4d26-99aa-20808d44ee1e" status: 200 len: 1512 microversion: 2.1 time: 0.167660 Oct 17 14:38:05.561590 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3358/6854] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:38:05 2022] GET /compute/v2.1/servers/3549aca2-dfe7-4d26-99aa-20808d44ee1e => generated 1512 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:38:06.584985 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c1605f2c-305f-44bf-82d8-b66fc1c5b31d tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:38:06.585745 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c1605f2c-305f-44bf-82d8-b66fc1c5b31d tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] [instance: 3549aca2-dfe7-4d26-99aa-20808d44ee1e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:38:06.592710 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1605f2c-305f-44bf-82d8-b66fc1c5b31d tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:06.593385 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1605f2c-305f-44bf-82d8-b66fc1c5b31d tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:06.593775 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1605f2c-305f-44bf-82d8-b66fc1c5b31d tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:06.594512 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1605f2c-305f-44bf-82d8-b66fc1c5b31d tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:06.595010 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1605f2c-305f-44bf-82d8-b66fc1c5b31d tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:06.595468 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c1605f2c-305f-44bf-82d8-b66fc1c5b31d tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:06.776804 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c1605f2c-305f-44bf-82d8-b66fc1c5b31d tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fbf6128b374efa8bf274a485095a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0f83e4d73246b1ac819c0c43939854', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:38:06.785314 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c1605f2c-305f-44bf-82d8-b66fc1c5b31d tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] 10.222.0.79 "GET /compute/v2.1/servers/3549aca2-dfe7-4d26-99aa-20808d44ee1e" status: 200 len: 1512 microversion: 2.1 time: 0.205126 Oct 17 14:38:06.785902 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3497/6855] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:38:06 2022] GET /compute/v2.1/servers/3549aca2-dfe7-4d26-99aa-20808d44ee1e => generated 1512 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:38:07.197758 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-5f012e5b-bb86-4359-8221-50fa15ffb84e req-11494934-e130-4ea5-bffe-646d937073f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3549aca2-dfe7-4d26-99aa-20808d44ee1e", "name": "network-vif-deleted", "tag": "302c07a4-0410-47e7-8c54-670758344d32"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:38:07.213063 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-5f012e5b-bb86-4359-8221-50fa15ffb84e req-11494934-e130-4ea5-bffe-646d937073f3 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:07.213555 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-5f012e5b-bb86-4359-8221-50fa15ffb84e req-11494934-e130-4ea5-bffe-646d937073f3 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:07.214002 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-5f012e5b-bb86-4359-8221-50fa15ffb84e req-11494934-e130-4ea5-bffe-646d937073f3 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:07.226991 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-5f012e5b-bb86-4359-8221-50fa15ffb84e req-11494934-e130-4ea5-bffe-646d937073f3 service nova] Creating event network-vif-deleted:302c07a4-0410-47e7-8c54-670758344d32 for instance 3549aca2-dfe7-4d26-99aa-20808d44ee1e on n-h2-854247-14 Oct 17 14:38:07.233333 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-5f012e5b-bb86-4359-8221-50fa15ffb84e req-11494934-e130-4ea5-bffe-646d937073f3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039724 Oct 17 14:38:07.234111 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3359/6856] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:38:07.808490 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-313c9f24-5f69-4103-8345-8c43ea901ea8 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:38:07.809100 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-313c9f24-5f69-4103-8345-8c43ea901ea8 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] [instance: 3549aca2-dfe7-4d26-99aa-20808d44ee1e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:38:07.816705 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-313c9f24-5f69-4103-8345-8c43ea901ea8 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:07.817191 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-313c9f24-5f69-4103-8345-8c43ea901ea8 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:07.817626 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-313c9f24-5f69-4103-8345-8c43ea901ea8 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:07.818328 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-313c9f24-5f69-4103-8345-8c43ea901ea8 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:07.818807 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-313c9f24-5f69-4103-8345-8c43ea901ea8 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:07.819279 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-313c9f24-5f69-4103-8345-8c43ea901ea8 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:07.833837 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-313c9f24-5f69-4103-8345-8c43ea901ea8 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] HTTP exception thrown: Instance 3549aca2-dfe7-4d26-99aa-20808d44ee1e could not be found. Oct 17 14:38:07.835551 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-313c9f24-5f69-4103-8345-8c43ea901ea8 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Request method failure captured: Oct 17 14:38:07.835551 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/3549aca2-dfe7-4d26-99aa-20808d44ee1e HTTP/1.1 Oct 17 14:38:07.835551 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 14:38:07.835551 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 14:38:07.835551 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 14:38:07.835551 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 14:38:07.835551 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 14:38:07.835551 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 14:38:07.835551 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 14:38:07.835551 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 14:38:07.835551 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTWi03dAQ9tl47IuxYwulVjYftpsQev6oFhAQnnvf4kI8ZvdvpZWIA3tnGWxh6UjsE5TVMXisxIAYhAayPA_wnesmDjKcKLwDLAEtycFLWVip9zbxWSpS4RU7hLb8rkMeMLqW3z0m2gmm9oFw3mw57Zn8EdAAZ3vVMZ6cGbdcbXs2SIg Oct 17 14:38:07.835551 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 14:38:07.835551 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 14:38:07.835551 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 14:38:07.835551 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 14:38:07.835551 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 14:38:07.835551 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 14:38:07.835551 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: ad0f83e4d73246b1ac819c0c43939854 Oct 17 14:38:07.835551 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-ServersNegativeTestJSON-241207535 Oct 17 14:38:07.835551 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 14:38:07.835551 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 14:38:07.835551 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ad0f83e4d73246b1ac819c0c43939854"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ad0f83e4d73246b1ac819c0c43939854"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ad0f83e4d73246b1ac819c0c43939854"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ad0f83e4d73246b1ac819c0c43939854", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:38:07.835551 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-ServersNegativeTestJSON-241207535 Oct 17 14:38:07.835551 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: ad0f83e4d73246b1ac819c0c43939854 Oct 17 14:38:07.835551 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-ServersNegativeTestJSON-241207535 Oct 17 14:38:07.835551 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-ServersNegativeTestJSON-241207535-project Oct 17 14:38:07.835551 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 14:38:07.835551 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 14:38:07.835551 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 19fbf6128b374efa8bf274a485095a3e Oct 17 14:38:07.835551 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-ServersNegativeTestJSON-241207535-project Oct 17 14:38:07.835551 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 14:38:07.835551 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 3549aca2-dfe7-4d26-99aa-20808d44ee1e could not be found. Oct 17 14:38:07.835551 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '3549aca2-dfe7-4d26-99aa-20808d44ee1e'} Oct 17 14:38:07.835551 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:38:07.835551 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:38:07.835551 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:38:07.835551 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:38:07.835551 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:38:07.835551 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:38:07.835551 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:38:07.835551 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:38:07.835551 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:38:07.835551 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:38:07.835551 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3549aca2-dfe7-4d26-99aa-20808d44ee1e could not be found. Oct 17 14:38:07.835551 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:38:07.835551 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:38:07.835551 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:38:07.835551 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:38:07.835551 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:38:07.835551 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:38:07.835551 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:38:07.835551 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:38:07.835551 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:38:07.835551 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:38:07.835551 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:38:07.835551 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:38:07.835551 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:38:07.835551 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:38:07.835551 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:38:07.835551 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:38:07.835551 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3549aca2-dfe7-4d26-99aa-20808d44ee1e could not be found. Oct 17 14:38:07.835551 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:38:07.835551 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:38:07.835551 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:38:07.839913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:38:07.839913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:38:07.839913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:38:07.839913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:38:07.839913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:38:07.839913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3549aca2-dfe7-4d26-99aa-20808d44ee1e could not be found. Oct 17 14:38:07.839913 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:38:07.839913 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-313c9f24-5f69-4103-8345-8c43ea901ea8 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] Returning 404 to user: Instance 3549aca2-dfe7-4d26-99aa-20808d44ee1e could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:38:07.839913 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-313c9f24-5f69-4103-8345-8c43ea901ea8 tempest-ServersNegativeTestJSON-241207535 tempest-ServersNegativeTestJSON-241207535-project] 10.222.0.79 "GET /compute/v2.1/servers/3549aca2-dfe7-4d26-99aa-20808d44ee1e" status: 404 len: 111 microversion: 2.1 time: 0.032594 Oct 17 14:38:07.839913 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3498/6857] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:38:07 2022] GET /compute/v2.1/servers/3549aca2-dfe7-4d26-99aa-20808d44ee1e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:38:41.580610 n-d-854247-14 devstack@n-api.service[127017]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 14:38:41.581203 n-d-854247-14 devstack@n-api.service[127017]: Mon Oct 17 14:38:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.79) !!! Oct 17 14:38:41.583245 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=50 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:38:41.584014 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=98 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:38:41.824587 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-da3e0f19-7639-4a18-8d83-f8447103d42c tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Action: 'create', calling method: .version_select at 0x7f7cd4529160>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1179353851", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZ2Lj4DEwB+nS0DDgRdKjqRsH4SoJpcCfwR34LfQkl700k5tnYhQrwInsv8gcQl8BgXifTwHdszO3bUCktnhkWADA2uNjdBP9F01G10FI3Sj+ex8hb62QzlFCkbvqIecg=="}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:38:41.840531 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-da3e0f19-7639-4a18-8d83-f8447103d42c tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Getting quotas for project c92eab284e904607b8f6fefb7b904201. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:38:41.846011 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-da3e0f19-7639-4a18-8d83-f8447103d42c tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Getting quotas for user 8604f1505f984525a7ec4a1d072593c6 and project c92eab284e904607b8f6fefb7b904201. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:38:41.878816 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-da3e0f19-7639-4a18-8d83-f8447103d42c tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.300779 Oct 17 14:38:41.879462 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3360/6858] 10.222.0.79 () {60 vars in 1159 bytes} [Mon Oct 17 14:38:41 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:38:41.933319 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-79c1ef08-7e02-4a8d-b828-0589532b09e7 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-886490579", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1179353851", "networks": [{"uuid": "a18a45b5-55b9-432c-9b08-f922ce398921"}]}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:38:41.942864 n-d-854247-14 devstack@n-api.service[127016]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 14:38:41.943015 n-d-854247-14 devstack@n-api.service[127016]: Mon Oct 17 14:38:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.79) !!! Oct 17 14:38:41.944035 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:38:41.944706 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:38:41.994729 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-79c1ef08-7e02-4a8d-b828-0589532b09e7 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] validate_networks() for [('a18a45b5-55b9-432c-9b08-f922ce398921', None, None, None, None, None)] {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:38:42.408972 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-79c1ef08-7e02-4a8d-b828-0589532b09e7 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:38:42.411208 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-79c1ef08-7e02-4a8d-b828-0589532b09e7 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:38:42.414640 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-79c1ef08-7e02-4a8d-b828-0589532b09e7 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:38:42.415048 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-79c1ef08-7e02-4a8d-b828-0589532b09e7 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:38:42.415665 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-79c1ef08-7e02-4a8d-b828-0589532b09e7 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:38:42.430941 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-79c1ef08-7e02-4a8d-b828-0589532b09e7 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:42.431480 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-79c1ef08-7e02-4a8d-b828-0589532b09e7 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:42.431923 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-79c1ef08-7e02-4a8d-b828-0589532b09e7 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:42.432669 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-79c1ef08-7e02-4a8d-b828-0589532b09e7 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:42.433308 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-79c1ef08-7e02-4a8d-b828-0589532b09e7 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:42.433740 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-79c1ef08-7e02-4a8d-b828-0589532b09e7 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:42.453265 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-79c1ef08-7e02-4a8d-b828-0589532b09e7 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Getting quotas for project c92eab284e904607b8f6fefb7b904201. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:38:42.459209 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-79c1ef08-7e02-4a8d-b828-0589532b09e7 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Getting quotas for user 8604f1505f984525a7ec4a1d072593c6 and project c92eab284e904607b8f6fefb7b904201. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:38:42.472605 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-79c1ef08-7e02-4a8d-b828-0589532b09e7 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:38:42.475154 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-79c1ef08-7e02-4a8d-b828-0589532b09e7 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 5c862e11-8f1f-4f40-b929-b3e70f1c790c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:38:42.527561 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-79c1ef08-7e02-4a8d-b828-0589532b09e7 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.598465 Oct 17 14:38:42.528224 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3499/6859] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 14:38:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:38:42.539458 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e7e9ee68-dbf1-4171-b118-0e2e92f9844c tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:38:42.540619 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e7e9ee68-dbf1-4171-b118-0e2e92f9844c tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 5c862e11-8f1f-4f40-b929-b3e70f1c790c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:38:42.603715 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e7e9ee68-dbf1-4171-b118-0e2e92f9844c tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8604f1505f984525a7ec4a1d072593c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92eab284e904607b8f6fefb7b904201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:38:42.611825 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e7e9ee68-dbf1-4171-b118-0e2e92f9844c tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "GET /compute/v2.1/servers/5c862e11-8f1f-4f40-b929-b3e70f1c790c" status: 200 len: 1262 microversion: 2.1 time: 0.076236 Oct 17 14:38:42.612512 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3361/6860] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:38:42 2022] GET /compute/v2.1/servers/5c862e11-8f1f-4f40-b929-b3e70f1c790c => generated 1262 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:38:43.636802 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f72f6229-1077-4c1d-8068-224f7c019539 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:38:43.638245 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f72f6229-1077-4c1d-8068-224f7c019539 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 5c862e11-8f1f-4f40-b929-b3e70f1c790c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:38:43.648101 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f72f6229-1077-4c1d-8068-224f7c019539 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:43.648668 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f72f6229-1077-4c1d-8068-224f7c019539 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:43.649753 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f72f6229-1077-4c1d-8068-224f7c019539 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:43.650538 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f72f6229-1077-4c1d-8068-224f7c019539 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:43.651067 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f72f6229-1077-4c1d-8068-224f7c019539 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:43.651591 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f72f6229-1077-4c1d-8068-224f7c019539 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:43.758885 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f72f6229-1077-4c1d-8068-224f7c019539 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8604f1505f984525a7ec4a1d072593c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92eab284e904607b8f6fefb7b904201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:38:43.768161 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f72f6229-1077-4c1d-8068-224f7c019539 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "GET /compute/v2.1/servers/5c862e11-8f1f-4f40-b929-b3e70f1c790c" status: 200 len: 1322 microversion: 2.1 time: 0.136118 Oct 17 14:38:43.769285 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3500/6861] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:38:43 2022] GET /compute/v2.1/servers/5c862e11-8f1f-4f40-b929-b3e70f1c790c => generated 1322 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:38:44.793263 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bff7f226-8842-477a-8d32-fd0f7766978f tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:38:44.793921 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-bff7f226-8842-477a-8d32-fd0f7766978f tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 5c862e11-8f1f-4f40-b929-b3e70f1c790c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:38:44.805751 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bff7f226-8842-477a-8d32-fd0f7766978f tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:44.806262 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bff7f226-8842-477a-8d32-fd0f7766978f tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:44.806729 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bff7f226-8842-477a-8d32-fd0f7766978f tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:44.807471 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bff7f226-8842-477a-8d32-fd0f7766978f tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:44.807939 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bff7f226-8842-477a-8d32-fd0f7766978f tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:44.808395 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bff7f226-8842-477a-8d32-fd0f7766978f tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:44.976862 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-bff7f226-8842-477a-8d32-fd0f7766978f tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8604f1505f984525a7ec4a1d072593c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92eab284e904607b8f6fefb7b904201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:38:44.985487 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-bff7f226-8842-477a-8d32-fd0f7766978f tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "GET /compute/v2.1/servers/5c862e11-8f1f-4f40-b929-b3e70f1c790c" status: 200 len: 1362 microversion: 2.1 time: 0.196309 Oct 17 14:38:44.986267 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3362/6862] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:38:44 2022] GET /compute/v2.1/servers/5c862e11-8f1f-4f40-b929-b3e70f1c790c => generated 1362 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:38:45.111080 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-ac4bffc8-3508-4e92-bb55-a816644ec23d req-a027bf8b-0089-49ea-89d9-806cbbf6f4b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c862e11-8f1f-4f40-b929-b3e70f1c790c", "tag": "50912dfb-63b2-4a36-81e1-c1c5d7b836f2"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:38:45.124350 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-ac4bffc8-3508-4e92-bb55-a816644ec23d req-a027bf8b-0089-49ea-89d9-806cbbf6f4b4 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:45.124818 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-ac4bffc8-3508-4e92-bb55-a816644ec23d req-a027bf8b-0089-49ea-89d9-806cbbf6f4b4 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:45.125496 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-ac4bffc8-3508-4e92-bb55-a816644ec23d req-a027bf8b-0089-49ea-89d9-806cbbf6f4b4 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:45.138579 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-ac4bffc8-3508-4e92-bb55-a816644ec23d req-a027bf8b-0089-49ea-89d9-806cbbf6f4b4 service nova] Creating event network-changed:50912dfb-63b2-4a36-81e1-c1c5d7b836f2 for instance 5c862e11-8f1f-4f40-b929-b3e70f1c790c on n-h1-854247-14 Oct 17 14:38:45.144355 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-ac4bffc8-3508-4e92-bb55-a816644ec23d req-a027bf8b-0089-49ea-89d9-806cbbf6f4b4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037874 Oct 17 14:38:45.145079 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3501/6863] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:38:46.009787 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5ba0e38b-12a8-4795-a39d-9524b2d8e123 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:38:46.010350 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5ba0e38b-12a8-4795-a39d-9524b2d8e123 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 5c862e11-8f1f-4f40-b929-b3e70f1c790c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:38:46.019374 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5ba0e38b-12a8-4795-a39d-9524b2d8e123 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:46.019973 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5ba0e38b-12a8-4795-a39d-9524b2d8e123 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:46.020515 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5ba0e38b-12a8-4795-a39d-9524b2d8e123 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:46.021223 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5ba0e38b-12a8-4795-a39d-9524b2d8e123 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:46.021692 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5ba0e38b-12a8-4795-a39d-9524b2d8e123 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:46.022155 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5ba0e38b-12a8-4795-a39d-9524b2d8e123 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:46.173474 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5ba0e38b-12a8-4795-a39d-9524b2d8e123 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8604f1505f984525a7ec4a1d072593c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92eab284e904607b8f6fefb7b904201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:38:46.185166 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5ba0e38b-12a8-4795-a39d-9524b2d8e123 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "GET /compute/v2.1/servers/5c862e11-8f1f-4f40-b929-b3e70f1c790c" status: 200 len: 1362 microversion: 2.1 time: 0.179637 Oct 17 14:38:46.185924 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3363/6864] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:38:46 2022] GET /compute/v2.1/servers/5c862e11-8f1f-4f40-b929-b3e70f1c790c => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:38:47.213081 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a2cad73c-6fcb-41dd-b8c5-f0bceb44f82f tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:38:47.214177 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a2cad73c-6fcb-41dd-b8c5-f0bceb44f82f tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 5c862e11-8f1f-4f40-b929-b3e70f1c790c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:38:47.225703 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a2cad73c-6fcb-41dd-b8c5-f0bceb44f82f tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:47.226199 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a2cad73c-6fcb-41dd-b8c5-f0bceb44f82f tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:47.226638 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a2cad73c-6fcb-41dd-b8c5-f0bceb44f82f tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:47.227414 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a2cad73c-6fcb-41dd-b8c5-f0bceb44f82f tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:47.227875 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a2cad73c-6fcb-41dd-b8c5-f0bceb44f82f tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:47.228303 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a2cad73c-6fcb-41dd-b8c5-f0bceb44f82f tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:47.364206 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a2cad73c-6fcb-41dd-b8c5-f0bceb44f82f tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8604f1505f984525a7ec4a1d072593c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92eab284e904607b8f6fefb7b904201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:38:47.373153 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a2cad73c-6fcb-41dd-b8c5-f0bceb44f82f tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "GET /compute/v2.1/servers/5c862e11-8f1f-4f40-b929-b3e70f1c790c" status: 200 len: 1362 microversion: 2.1 time: 0.167621 Oct 17 14:38:47.373735 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3502/6865] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:38:47 2022] GET /compute/v2.1/servers/5c862e11-8f1f-4f40-b929-b3e70f1c790c => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:38:48.397433 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7c092b32-d520-4926-b6fb-0973513bc883 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:38:48.398063 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7c092b32-d520-4926-b6fb-0973513bc883 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 5c862e11-8f1f-4f40-b929-b3e70f1c790c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:38:48.405311 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7c092b32-d520-4926-b6fb-0973513bc883 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:48.405806 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7c092b32-d520-4926-b6fb-0973513bc883 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:48.406225 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7c092b32-d520-4926-b6fb-0973513bc883 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:48.407147 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7c092b32-d520-4926-b6fb-0973513bc883 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:48.407624 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7c092b32-d520-4926-b6fb-0973513bc883 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:48.408052 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7c092b32-d520-4926-b6fb-0973513bc883 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:48.541576 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7c092b32-d520-4926-b6fb-0973513bc883 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8604f1505f984525a7ec4a1d072593c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92eab284e904607b8f6fefb7b904201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:38:48.549934 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7c092b32-d520-4926-b6fb-0973513bc883 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "GET /compute/v2.1/servers/5c862e11-8f1f-4f40-b929-b3e70f1c790c" status: 200 len: 1362 microversion: 2.1 time: 0.157032 Oct 17 14:38:48.550525 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3364/6866] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:38:48 2022] GET /compute/v2.1/servers/5c862e11-8f1f-4f40-b929-b3e70f1c790c => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:38:49.573991 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6f284b30-b2a3-4b09-b4dc-bbde81525246 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:38:49.574861 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6f284b30-b2a3-4b09-b4dc-bbde81525246 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 5c862e11-8f1f-4f40-b929-b3e70f1c790c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:38:49.582768 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6f284b30-b2a3-4b09-b4dc-bbde81525246 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:49.583341 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6f284b30-b2a3-4b09-b4dc-bbde81525246 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:49.583828 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6f284b30-b2a3-4b09-b4dc-bbde81525246 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:49.584599 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6f284b30-b2a3-4b09-b4dc-bbde81525246 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:49.585124 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6f284b30-b2a3-4b09-b4dc-bbde81525246 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:49.585662 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6f284b30-b2a3-4b09-b4dc-bbde81525246 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:49.720344 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6f284b30-b2a3-4b09-b4dc-bbde81525246 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8604f1505f984525a7ec4a1d072593c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92eab284e904607b8f6fefb7b904201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:38:49.732581 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6f284b30-b2a3-4b09-b4dc-bbde81525246 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "GET /compute/v2.1/servers/5c862e11-8f1f-4f40-b929-b3e70f1c790c" status: 200 len: 1362 microversion: 2.1 time: 0.162775 Oct 17 14:38:49.733366 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3503/6867] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:38:49 2022] GET /compute/v2.1/servers/5c862e11-8f1f-4f40-b929-b3e70f1c790c => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:38:50.271061 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-e1851422-9e34-4aae-a582-8e0e329fb060 req-e5e77609-ef67-4b50-9ec8-09e6d40cec52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c862e11-8f1f-4f40-b929-b3e70f1c790c", "name": "network-vif-plugged", "status": "completed", "tag": "50912dfb-63b2-4a36-81e1-c1c5d7b836f2"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:38:50.281193 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-e1851422-9e34-4aae-a582-8e0e329fb060 req-e5e77609-ef67-4b50-9ec8-09e6d40cec52 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:50.281702 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-e1851422-9e34-4aae-a582-8e0e329fb060 req-e5e77609-ef67-4b50-9ec8-09e6d40cec52 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:50.282187 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-e1851422-9e34-4aae-a582-8e0e329fb060 req-e5e77609-ef67-4b50-9ec8-09e6d40cec52 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:50.295478 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-e1851422-9e34-4aae-a582-8e0e329fb060 req-e5e77609-ef67-4b50-9ec8-09e6d40cec52 service nova] Creating event network-vif-plugged:50912dfb-63b2-4a36-81e1-c1c5d7b836f2 for instance 5c862e11-8f1f-4f40-b929-b3e70f1c790c on n-h1-854247-14 Oct 17 14:38:50.300963 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-e1851422-9e34-4aae-a582-8e0e329fb060 req-e5e77609-ef67-4b50-9ec8-09e6d40cec52 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034748 Oct 17 14:38:50.301651 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3365/6868] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:38:50.761722 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-87778418-101d-40f6-8a23-41857940063e tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:38:50.762472 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-87778418-101d-40f6-8a23-41857940063e tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 5c862e11-8f1f-4f40-b929-b3e70f1c790c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:38:50.771223 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-87778418-101d-40f6-8a23-41857940063e tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:50.771826 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-87778418-101d-40f6-8a23-41857940063e tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:50.772340 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-87778418-101d-40f6-8a23-41857940063e tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:50.773291 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-87778418-101d-40f6-8a23-41857940063e tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:50.774073 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-87778418-101d-40f6-8a23-41857940063e tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:50.774658 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-87778418-101d-40f6-8a23-41857940063e tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:50.915006 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-87778418-101d-40f6-8a23-41857940063e tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8604f1505f984525a7ec4a1d072593c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92eab284e904607b8f6fefb7b904201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:38:50.923416 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-87778418-101d-40f6-8a23-41857940063e tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "GET /compute/v2.1/servers/5c862e11-8f1f-4f40-b929-b3e70f1c790c" status: 200 len: 1362 microversion: 2.1 time: 0.166940 Oct 17 14:38:50.924003 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3504/6869] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:38:50 2022] GET /compute/v2.1/servers/5c862e11-8f1f-4f40-b929-b3e70f1c790c => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:38:51.947957 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ac001c7e-7ca8-4094-8dd4-e2df41df7333 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:38:51.948673 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ac001c7e-7ca8-4094-8dd4-e2df41df7333 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 5c862e11-8f1f-4f40-b929-b3e70f1c790c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:38:51.955732 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac001c7e-7ca8-4094-8dd4-e2df41df7333 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:51.956224 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac001c7e-7ca8-4094-8dd4-e2df41df7333 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:51.956673 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac001c7e-7ca8-4094-8dd4-e2df41df7333 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:51.957382 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac001c7e-7ca8-4094-8dd4-e2df41df7333 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:51.957838 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac001c7e-7ca8-4094-8dd4-e2df41df7333 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:51.958268 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac001c7e-7ca8-4094-8dd4-e2df41df7333 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:52.099890 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ac001c7e-7ca8-4094-8dd4-e2df41df7333 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8604f1505f984525a7ec4a1d072593c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92eab284e904607b8f6fefb7b904201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:38:52.108808 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ac001c7e-7ca8-4094-8dd4-e2df41df7333 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "GET /compute/v2.1/servers/5c862e11-8f1f-4f40-b929-b3e70f1c790c" status: 200 len: 1552 microversion: 2.1 time: 0.166188 Oct 17 14:38:52.109386 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3366/6870] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:38:51 2022] GET /compute/v2.1/servers/5c862e11-8f1f-4f40-b929-b3e70f1c790c => generated 1552 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:38:52.132763 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-860d5117-fe23-409f-bedc-9972849799ce tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:38:52.133426 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-860d5117-fe23-409f-bedc-9972849799ce tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 5c862e11-8f1f-4f40-b929-b3e70f1c790c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:38:52.141060 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-860d5117-fe23-409f-bedc-9972849799ce tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:52.141542 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-860d5117-fe23-409f-bedc-9972849799ce tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:52.141978 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-860d5117-fe23-409f-bedc-9972849799ce tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:52.142674 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-860d5117-fe23-409f-bedc-9972849799ce tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:52.143141 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-860d5117-fe23-409f-bedc-9972849799ce tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:52.143583 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-860d5117-fe23-409f-bedc-9972849799ce tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:52.277604 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-860d5117-fe23-409f-bedc-9972849799ce tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8604f1505f984525a7ec4a1d072593c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92eab284e904607b8f6fefb7b904201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:38:52.286193 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-860d5117-fe23-409f-bedc-9972849799ce tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "GET /compute/v2.1/servers/5c862e11-8f1f-4f40-b929-b3e70f1c790c" status: 200 len: 1552 microversion: 2.1 time: 0.157706 Oct 17 14:38:52.286774 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3505/6871] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:38:52 2022] GET /compute/v2.1/servers/5c862e11-8f1f-4f40-b929-b3e70f1c790c => generated 1552 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:38:54.041117 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6009498b-2408-4622-80db-c2abd3552214 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "88db7da6-fb35-443b-b3b0-26a8cc5dd7d7"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:38:54.043505 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6009498b-2408-4622-80db-c2abd3552214 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 5c862e11-8f1f-4f40-b929-b3e70f1c790c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:38:54.045512 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=6 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:38:54.052791 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6009498b-2408-4622-80db-c2abd3552214 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:54.052791 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6009498b-2408-4622-80db-c2abd3552214 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:54.053194 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6009498b-2408-4622-80db-c2abd3552214 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:54.053906 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6009498b-2408-4622-80db-c2abd3552214 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:54.054375 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6009498b-2408-4622-80db-c2abd3552214 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:54.054810 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6009498b-2408-4622-80db-c2abd3552214 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:54.346765 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6009498b-2408-4622-80db-c2abd3552214 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "POST /compute/v2.1/servers/5c862e11-8f1f-4f40-b929-b3e70f1c790c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.309760 Oct 17 14:38:54.347426 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3367/6872] 10.222.0.79 () {60 vars in 1323 bytes} [Mon Oct 17 14:38:54 2022] POST /compute/v2.1/servers/5c862e11-8f1f-4f40-b929-b3e70f1c790c/os-volume_attachments => generated 194 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:39:05.132656 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6c284adf-340b-436f-9a7b-97fc81b99be9 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:05.133198 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6c284adf-340b-436f-9a7b-97fc81b99be9 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 5c862e11-8f1f-4f40-b929-b3e70f1c790c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:05.135152 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:39:05.135921 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=6 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:39:05.137505 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:39:05.138282 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=34 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:39:05.144351 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6c284adf-340b-436f-9a7b-97fc81b99be9 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:05.144839 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6c284adf-340b-436f-9a7b-97fc81b99be9 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:05.145279 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6c284adf-340b-436f-9a7b-97fc81b99be9 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:05.145981 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6c284adf-340b-436f-9a7b-97fc81b99be9 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:05.146440 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6c284adf-340b-436f-9a7b-97fc81b99be9 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:05.146864 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6c284adf-340b-436f-9a7b-97fc81b99be9 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:05.240513 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-6c284adf-340b-436f-9a7b-97fc81b99be9 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lazy-loading 'services' on Instance uuid 5c862e11-8f1f-4f40-b929-b3e70f1c790c {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:39:05.322939 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6c284adf-340b-436f-9a7b-97fc81b99be9 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "DELETE /compute/v2.1/servers/5c862e11-8f1f-4f40-b929-b3e70f1c790c/os-volume_attachments/88db7da6-fb35-443b-b3b0-26a8cc5dd7d7" status: 202 len: 0 microversion: 2.1 time: 0.194568 Oct 17 14:39:05.323631 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3506/6873] 10.222.0.79 () {58 vars in 1416 bytes} [Mon Oct 17 14:39:05 2022] DELETE /compute/v2.1/servers/5c862e11-8f1f-4f40-b929-b3e70f1c790c/os-volume_attachments/88db7da6-fb35-443b-b3b0-26a8cc5dd7d7 => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:39:05.330256 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:39:05.331535 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:39:05.335777 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-51c5f88b-a956-48ce-82c3-f7bed89bef58 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:05.338111 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-51c5f88b-a956-48ce-82c3-f7bed89bef58 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 5c862e11-8f1f-4f40-b929-b3e70f1c790c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:05.345735 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-51c5f88b-a956-48ce-82c3-f7bed89bef58 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:05.346523 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-51c5f88b-a956-48ce-82c3-f7bed89bef58 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:05.346974 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-51c5f88b-a956-48ce-82c3-f7bed89bef58 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:05.347708 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-51c5f88b-a956-48ce-82c3-f7bed89bef58 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:05.348165 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-51c5f88b-a956-48ce-82c3-f7bed89bef58 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:05.348600 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-51c5f88b-a956-48ce-82c3-f7bed89bef58 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:05.382358 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-51c5f88b-a956-48ce-82c3-f7bed89bef58 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "GET /compute/v2.1/servers/5c862e11-8f1f-4f40-b929-b3e70f1c790c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053971 Oct 17 14:39:05.382918 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3368/6874] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 14:39:05 2022] GET /compute/v2.1/servers/5c862e11-8f1f-4f40-b929-b3e70f1c790c/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:39:06.396052 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-231f5eff-553a-4f98-bfbe-83112ea7e8d9 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:06.398348 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-231f5eff-553a-4f98-bfbe-83112ea7e8d9 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 5c862e11-8f1f-4f40-b929-b3e70f1c790c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:06.405435 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-231f5eff-553a-4f98-bfbe-83112ea7e8d9 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:06.405911 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-231f5eff-553a-4f98-bfbe-83112ea7e8d9 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:06.406352 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-231f5eff-553a-4f98-bfbe-83112ea7e8d9 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:06.407055 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-231f5eff-553a-4f98-bfbe-83112ea7e8d9 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:06.407530 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-231f5eff-553a-4f98-bfbe-83112ea7e8d9 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:06.407942 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-231f5eff-553a-4f98-bfbe-83112ea7e8d9 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:06.442364 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-231f5eff-553a-4f98-bfbe-83112ea7e8d9 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "GET /compute/v2.1/servers/5c862e11-8f1f-4f40-b929-b3e70f1c790c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051805 Oct 17 14:39:06.442960 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3507/6875] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 14:39:06 2022] GET /compute/v2.1/servers/5c862e11-8f1f-4f40-b929-b3e70f1c790c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:39:07.455617 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-67d4722e-b66c-4a7f-9b75-0dd26c0a795a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:07.457888 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-67d4722e-b66c-4a7f-9b75-0dd26c0a795a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 5c862e11-8f1f-4f40-b929-b3e70f1c790c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:07.465021 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-67d4722e-b66c-4a7f-9b75-0dd26c0a795a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:07.465537 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-67d4722e-b66c-4a7f-9b75-0dd26c0a795a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:07.465986 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-67d4722e-b66c-4a7f-9b75-0dd26c0a795a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:07.466695 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-67d4722e-b66c-4a7f-9b75-0dd26c0a795a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:07.467190 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-67d4722e-b66c-4a7f-9b75-0dd26c0a795a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:07.467613 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-67d4722e-b66c-4a7f-9b75-0dd26c0a795a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:07.498497 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-67d4722e-b66c-4a7f-9b75-0dd26c0a795a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "GET /compute/v2.1/servers/5c862e11-8f1f-4f40-b929-b3e70f1c790c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047048 Oct 17 14:39:07.499066 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3369/6876] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 14:39:07 2022] GET /compute/v2.1/servers/5c862e11-8f1f-4f40-b929-b3e70f1c790c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:39:08.511892 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-65cdf166-703a-4653-9689-82c9292e332b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:08.514221 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-65cdf166-703a-4653-9689-82c9292e332b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 5c862e11-8f1f-4f40-b929-b3e70f1c790c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:08.521672 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-65cdf166-703a-4653-9689-82c9292e332b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:08.522156 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-65cdf166-703a-4653-9689-82c9292e332b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:08.522598 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-65cdf166-703a-4653-9689-82c9292e332b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:08.523335 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-65cdf166-703a-4653-9689-82c9292e332b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:08.523787 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-65cdf166-703a-4653-9689-82c9292e332b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:08.524213 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-65cdf166-703a-4653-9689-82c9292e332b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:08.555851 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-65cdf166-703a-4653-9689-82c9292e332b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "GET /compute/v2.1/servers/5c862e11-8f1f-4f40-b929-b3e70f1c790c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048126 Oct 17 14:39:08.556651 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3508/6877] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 14:39:08 2022] GET /compute/v2.1/servers/5c862e11-8f1f-4f40-b929-b3e70f1c790c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:39:09.570225 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-370e0ff9-bf85-41d0-a24f-d065bb993b64 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:09.572577 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-370e0ff9-bf85-41d0-a24f-d065bb993b64 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 5c862e11-8f1f-4f40-b929-b3e70f1c790c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:09.580342 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-370e0ff9-bf85-41d0-a24f-d065bb993b64 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:09.580840 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-370e0ff9-bf85-41d0-a24f-d065bb993b64 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:09.581288 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-370e0ff9-bf85-41d0-a24f-d065bb993b64 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:09.581998 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-370e0ff9-bf85-41d0-a24f-d065bb993b64 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:09.582460 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-370e0ff9-bf85-41d0-a24f-d065bb993b64 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:09.582900 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-370e0ff9-bf85-41d0-a24f-d065bb993b64 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:09.616374 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-370e0ff9-bf85-41d0-a24f-d065bb993b64 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "GET /compute/v2.1/servers/5c862e11-8f1f-4f40-b929-b3e70f1c790c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051227 Oct 17 14:39:09.616947 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3370/6878] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 14:39:09 2022] GET /compute/v2.1/servers/5c862e11-8f1f-4f40-b929-b3e70f1c790c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:39:10.634661 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-dee5a6aa-9732-4a9e-b97a-b7f9cf57973a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:10.638436 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-dee5a6aa-9732-4a9e-b97a-b7f9cf57973a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 5c862e11-8f1f-4f40-b929-b3e70f1c790c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:10.649848 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dee5a6aa-9732-4a9e-b97a-b7f9cf57973a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:10.650656 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dee5a6aa-9732-4a9e-b97a-b7f9cf57973a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:10.651634 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dee5a6aa-9732-4a9e-b97a-b7f9cf57973a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:10.652793 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dee5a6aa-9732-4a9e-b97a-b7f9cf57973a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:10.653587 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dee5a6aa-9732-4a9e-b97a-b7f9cf57973a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:10.654332 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dee5a6aa-9732-4a9e-b97a-b7f9cf57973a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:10.696282 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-dee5a6aa-9732-4a9e-b97a-b7f9cf57973a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "GET /compute/v2.1/servers/5c862e11-8f1f-4f40-b929-b3e70f1c790c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.069400 Oct 17 14:39:10.697286 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3509/6879] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 14:39:10 2022] GET /compute/v2.1/servers/5c862e11-8f1f-4f40-b929-b3e70f1c790c/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 14:39:10.714145 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0ec33ead-3506-46cf-80ca-e4cd9236421b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:10.715206 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0ec33ead-3506-46cf-80ca-e4cd9236421b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 5c862e11-8f1f-4f40-b929-b3e70f1c790c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:10.723204 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0ec33ead-3506-46cf-80ca-e4cd9236421b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:10.723730 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0ec33ead-3506-46cf-80ca-e4cd9236421b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:10.724184 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0ec33ead-3506-46cf-80ca-e4cd9236421b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:10.724888 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0ec33ead-3506-46cf-80ca-e4cd9236421b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:10.725344 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0ec33ead-3506-46cf-80ca-e4cd9236421b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:10.725777 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0ec33ead-3506-46cf-80ca-e4cd9236421b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:10.824827 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-0ec33ead-3506-46cf-80ca-e4cd9236421b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] HTTP exception thrown: Instance 5c862e11-8f1f-4f40-b929-b3e70f1c790c is not attached to volume 88db7da6-fb35-443b-b3b0-26a8cc5dd7d7 Oct 17 14:39:10.831943 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0ec33ead-3506-46cf-80ca-e4cd9236421b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Request method failure captured: Oct 17 14:39:10.831943 n-d-854247-14 devstack@n-api.service[127017]: request: DELETE /compute/v2.1/servers/5c862e11-8f1f-4f40-b929-b3e70f1c790c/os-volume_attachments/88db7da6-fb35-443b-b3b0-26a8cc5dd7d7 HTTP/1.1 Oct 17 14:39:10.831943 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 14:39:10.831943 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 14:39:10.831943 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 14:39:10.831943 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 14:39:10.831943 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 14:39:10.831943 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 14:39:10.831943 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 14:39:10.831943 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 14:39:10.831943 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTWjsqBGADzJouBjurtPzzg1tjgTb4pF7ozl_UbNOj6xqAayKaN28B7_cAUIuqtlGsqMyQlPIkrkOBuPZ_VNr6tixUAoQxR7yaDztHi2BQhbxFD0oU5Fgh22yeXgEYdm_hkQwuX9-HS_BdmqxWZK_p4j4oylciWhdk3H-GqayhBBiNcU Oct 17 14:39:10.831943 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 14:39:10.831943 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 14:39:10.831943 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 14:39:10.831943 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 14:39:10.831943 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 14:39:10.831943 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 14:39:10.831943 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: c92eab284e904607b8f6fefb7b904201 Oct 17 14:39:10.831943 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-TestEncryptedCinderVolumes-2016754020 Oct 17 14:39:10.831943 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 14:39:10.831943 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 14:39:10.831943 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c92eab284e904607b8f6fefb7b904201"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c92eab284e904607b8f6fefb7b904201"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c92eab284e904607b8f6fefb7b904201"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c92eab284e904607b8f6fefb7b904201", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:39:10.831943 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-TestEncryptedCinderVolumes-2016754020 Oct 17 14:39:10.831943 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: c92eab284e904607b8f6fefb7b904201 Oct 17 14:39:10.831943 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-2016754020 Oct 17 14:39:10.831943 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-TestEncryptedCinderVolumes-2016754020-project Oct 17 14:39:10.831943 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 14:39:10.831943 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 14:39:10.831943 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 8604f1505f984525a7ec4a1d072593c6 Oct 17 14:39:10.831943 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-TestEncryptedCinderVolumes-2016754020-project Oct 17 14:39:10.831943 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 14:39:10.831943 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 5c862e11-8f1f-4f40-b929-b3e70f1c790c is not attached to volume 88db7da6-fb35-443b-b3b0-26a8cc5dd7d7 Oct 17 14:39:10.831943 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'server_id': '5c862e11-8f1f-4f40-b929-b3e70f1c790c', 'id': '88db7da6-fb35-443b-b3b0-26a8cc5dd7d7'} Oct 17 14:39:10.831943 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:39:10.831943 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:39:10.831943 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 17 14:39:10.831943 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 17 14:39:10.831943 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 14:39:10.831943 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 14:39:10.831943 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 17 14:39:10.831943 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 17 14:39:10.831943 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 88db7da6-fb35-443b-b3b0-26a8cc5dd7d7. Oct 17 14:39:10.831943 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:39:10.831943 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:39:10.831943 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:39:10.831943 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:39:10.831943 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:39:10.831943 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:39:10.831943 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:39:10.831943 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:39:10.831943 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:39:10.831943 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:39:10.831943 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 17 14:39:10.831943 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 17 14:39:10.831943 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c862e11-8f1f-4f40-b929-b3e70f1c790c is not attached to volume 88db7da6-fb35-443b-b3b0-26a8cc5dd7d7 Oct 17 14:39:10.831943 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:39:10.831943 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:39:10.831943 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:39:10.831943 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:39:10.831943 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:39:10.831943 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:39:10.837320 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:39:10.837320 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:39:10.837320 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c862e11-8f1f-4f40-b929-b3e70f1c790c is not attached to volume 88db7da6-fb35-443b-b3b0-26a8cc5dd7d7 Oct 17 14:39:10.837320 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:39:10.837320 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0ec33ead-3506-46cf-80ca-e4cd9236421b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Returning 404 to user: Instance 5c862e11-8f1f-4f40-b929-b3e70f1c790c is not attached to volume 88db7da6-fb35-443b-b3b0-26a8cc5dd7d7 {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:39:10.837320 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0ec33ead-3506-46cf-80ca-e4cd9236421b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "DELETE /compute/v2.1/servers/5c862e11-8f1f-4f40-b929-b3e70f1c790c/os-volume_attachments/88db7da6-fb35-443b-b3b0-26a8cc5dd7d7" status: 404 len: 154 microversion: 2.1 time: 0.125502 Oct 17 14:39:10.837320 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3371/6880] 10.222.0.79 () {58 vars in 1416 bytes} [Mon Oct 17 14:39:10 2022] DELETE /compute/v2.1/servers/5c862e11-8f1f-4f40-b929-b3e70f1c790c/os-volume_attachments/88db7da6-fb35-443b-b3b0-26a8cc5dd7d7 => generated 154 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:39:14.215703 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a7c45d1b-33a6-4359-b20f-ce59fc5ec2e8 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:14.216776 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a7c45d1b-33a6-4359-b20f-ce59fc5ec2e8 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 5c862e11-8f1f-4f40-b929-b3e70f1c790c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:14.223527 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a7c45d1b-33a6-4359-b20f-ce59fc5ec2e8 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:14.224006 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a7c45d1b-33a6-4359-b20f-ce59fc5ec2e8 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:14.224465 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a7c45d1b-33a6-4359-b20f-ce59fc5ec2e8 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:14.225163 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a7c45d1b-33a6-4359-b20f-ce59fc5ec2e8 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:14.225612 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a7c45d1b-33a6-4359-b20f-ce59fc5ec2e8 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:14.226062 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a7c45d1b-33a6-4359-b20f-ce59fc5ec2e8 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:14.252382 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a7c45d1b-33a6-4359-b20f-ce59fc5ec2e8 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 5c862e11-8f1f-4f40-b929-b3e70f1c790c] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:39:14.339089 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a7c45d1b-33a6-4359-b20f-ce59fc5ec2e8 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "DELETE /compute/v2.1/servers/5c862e11-8f1f-4f40-b929-b3e70f1c790c" status: 204 len: 0 microversion: 2.1 time: 0.127380 Oct 17 14:39:14.343330 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3510/6881] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:39:14 2022] DELETE /compute/v2.1/servers/5c862e11-8f1f-4f40-b929-b3e70f1c790c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:39:14.348897 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b7c25f22-20e5-4d40-9aca-01bb0af5305f tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:14.349533 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b7c25f22-20e5-4d40-9aca-01bb0af5305f tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 5c862e11-8f1f-4f40-b929-b3e70f1c790c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:14.356797 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b7c25f22-20e5-4d40-9aca-01bb0af5305f tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:14.357295 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b7c25f22-20e5-4d40-9aca-01bb0af5305f tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:14.357759 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b7c25f22-20e5-4d40-9aca-01bb0af5305f tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:14.358447 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b7c25f22-20e5-4d40-9aca-01bb0af5305f tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:14.358903 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b7c25f22-20e5-4d40-9aca-01bb0af5305f tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:14.359367 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b7c25f22-20e5-4d40-9aca-01bb0af5305f tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:14.495377 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b7c25f22-20e5-4d40-9aca-01bb0af5305f tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8604f1505f984525a7ec4a1d072593c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92eab284e904607b8f6fefb7b904201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:39:14.504248 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b7c25f22-20e5-4d40-9aca-01bb0af5305f tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "GET /compute/v2.1/servers/5c862e11-8f1f-4f40-b929-b3e70f1c790c" status: 200 len: 1558 microversion: 2.1 time: 0.159590 Oct 17 14:39:14.505192 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3372/6882] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:39:14 2022] GET /compute/v2.1/servers/5c862e11-8f1f-4f40-b929-b3e70f1c790c => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:39:15.529455 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-db28d8af-056f-43db-b602-b69267037667 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:15.530248 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-db28d8af-056f-43db-b602-b69267037667 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 5c862e11-8f1f-4f40-b929-b3e70f1c790c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:15.540934 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-db28d8af-056f-43db-b602-b69267037667 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:15.541542 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-db28d8af-056f-43db-b602-b69267037667 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:15.541979 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-db28d8af-056f-43db-b602-b69267037667 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:15.543018 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-db28d8af-056f-43db-b602-b69267037667 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:15.543694 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-db28d8af-056f-43db-b602-b69267037667 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:15.544127 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-db28d8af-056f-43db-b602-b69267037667 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:15.702544 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-db28d8af-056f-43db-b602-b69267037667 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8604f1505f984525a7ec4a1d072593c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92eab284e904607b8f6fefb7b904201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:39:15.714813 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-db28d8af-056f-43db-b602-b69267037667 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "GET /compute/v2.1/servers/5c862e11-8f1f-4f40-b929-b3e70f1c790c" status: 200 len: 1558 microversion: 2.1 time: 0.190137 Oct 17 14:39:15.715799 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3511/6883] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:39:15 2022] GET /compute/v2.1/servers/5c862e11-8f1f-4f40-b929-b3e70f1c790c => generated 1558 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:39:16.413784 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-88ebb107-5a56-4bc3-a425-67403e4b7835 req-216e2c24-cf9f-41fe-b41a-e317a6b8122b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c862e11-8f1f-4f40-b929-b3e70f1c790c", "name": "network-vif-deleted", "tag": "50912dfb-63b2-4a36-81e1-c1c5d7b836f2"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:39:16.426059 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-88ebb107-5a56-4bc3-a425-67403e4b7835 req-216e2c24-cf9f-41fe-b41a-e317a6b8122b service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:16.426732 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-88ebb107-5a56-4bc3-a425-67403e4b7835 req-216e2c24-cf9f-41fe-b41a-e317a6b8122b service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:16.427187 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-88ebb107-5a56-4bc3-a425-67403e4b7835 req-216e2c24-cf9f-41fe-b41a-e317a6b8122b service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:16.438945 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-88ebb107-5a56-4bc3-a425-67403e4b7835 req-216e2c24-cf9f-41fe-b41a-e317a6b8122b service nova] Creating event network-vif-deleted:50912dfb-63b2-4a36-81e1-c1c5d7b836f2 for instance 5c862e11-8f1f-4f40-b929-b3e70f1c790c on n-h1-854247-14 Oct 17 14:39:16.444224 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-88ebb107-5a56-4bc3-a425-67403e4b7835 req-216e2c24-cf9f-41fe-b41a-e317a6b8122b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034348 Oct 17 14:39:16.444821 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3373/6884] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:39:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:39:16.738486 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0ca1933c-c7f8-45a4-a7c8-9da5c9f1e4fc tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:16.739150 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0ca1933c-c7f8-45a4-a7c8-9da5c9f1e4fc tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 5c862e11-8f1f-4f40-b929-b3e70f1c790c] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:16.746781 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0ca1933c-c7f8-45a4-a7c8-9da5c9f1e4fc tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:16.747400 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0ca1933c-c7f8-45a4-a7c8-9da5c9f1e4fc tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:16.747845 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0ca1933c-c7f8-45a4-a7c8-9da5c9f1e4fc tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:16.748545 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0ca1933c-c7f8-45a4-a7c8-9da5c9f1e4fc tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:16.748998 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0ca1933c-c7f8-45a4-a7c8-9da5c9f1e4fc tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:16.749412 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0ca1933c-c7f8-45a4-a7c8-9da5c9f1e4fc tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:16.785505 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0ca1933c-c7f8-45a4-a7c8-9da5c9f1e4fc tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:16.785999 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0ca1933c-c7f8-45a4-a7c8-9da5c9f1e4fc tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:16.786443 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0ca1933c-c7f8-45a4-a7c8-9da5c9f1e4fc tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:16.786894 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-0ca1933c-c7f8-45a4-a7c8-9da5c9f1e4fc tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lazy-loading 'fault' on Instance uuid 5c862e11-8f1f-4f40-b929-b3e70f1c790c {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:39:16.836195 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0ca1933c-c7f8-45a4-a7c8-9da5c9f1e4fc tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8604f1505f984525a7ec4a1d072593c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92eab284e904607b8f6fefb7b904201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:39:16.845979 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0ca1933c-c7f8-45a4-a7c8-9da5c9f1e4fc tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "GET /compute/v2.1/servers/5c862e11-8f1f-4f40-b929-b3e70f1c790c" status: 200 len: 1352 microversion: 2.1 time: 0.111481 Oct 17 14:39:16.846503 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3512/6885] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:39:16 2022] GET /compute/v2.1/servers/5c862e11-8f1f-4f40-b929-b3e70f1c790c => generated 1352 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:39:17.875585 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-494d36d9-e143-4f92-ad0b-925dfde9f5cb tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:17.876465 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-494d36d9-e143-4f92-ad0b-925dfde9f5cb tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 5c862e11-8f1f-4f40-b929-b3e70f1c790c] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:17.885427 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-494d36d9-e143-4f92-ad0b-925dfde9f5cb tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:17.886048 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-494d36d9-e143-4f92-ad0b-925dfde9f5cb tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:17.886609 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-494d36d9-e143-4f92-ad0b-925dfde9f5cb tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:17.887811 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-494d36d9-e143-4f92-ad0b-925dfde9f5cb tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:17.888396 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-494d36d9-e143-4f92-ad0b-925dfde9f5cb tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:17.888936 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-494d36d9-e143-4f92-ad0b-925dfde9f5cb tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:17.905952 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-494d36d9-e143-4f92-ad0b-925dfde9f5cb tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] HTTP exception thrown: Instance 5c862e11-8f1f-4f40-b929-b3e70f1c790c could not be found. Oct 17 14:39:17.907667 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-494d36d9-e143-4f92-ad0b-925dfde9f5cb tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Request method failure captured: Oct 17 14:39:17.907667 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/5c862e11-8f1f-4f40-b929-b3e70f1c790c HTTP/1.1 Oct 17 14:39:17.907667 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 14:39:17.907667 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 14:39:17.907667 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 14:39:17.907667 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 14:39:17.907667 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 14:39:17.907667 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 14:39:17.907667 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 14:39:17.907667 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 14:39:17.907667 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTWjsqBGADzJouBjurtPzzg1tjgTb4pF7ozl_UbNOj6xqAayKaN28B7_cAUIuqtlGsqMyQlPIkrkOBuPZ_VNr6tixUAoQxR7yaDztHi2BQhbxFD0oU5Fgh22yeXgEYdm_hkQwuX9-HS_BdmqxWZK_p4j4oylciWhdk3H-GqayhBBiNcU Oct 17 14:39:17.907667 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 14:39:17.907667 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 14:39:17.907667 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 14:39:17.907667 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 14:39:17.907667 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 14:39:17.907667 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 14:39:17.907667 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: c92eab284e904607b8f6fefb7b904201 Oct 17 14:39:17.907667 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-TestEncryptedCinderVolumes-2016754020 Oct 17 14:39:17.907667 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 14:39:17.907667 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 14:39:17.907667 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c92eab284e904607b8f6fefb7b904201"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c92eab284e904607b8f6fefb7b904201"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c92eab284e904607b8f6fefb7b904201"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c92eab284e904607b8f6fefb7b904201", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:39:17.907667 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-TestEncryptedCinderVolumes-2016754020 Oct 17 14:39:17.907667 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: c92eab284e904607b8f6fefb7b904201 Oct 17 14:39:17.907667 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-2016754020 Oct 17 14:39:17.907667 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-TestEncryptedCinderVolumes-2016754020-project Oct 17 14:39:17.907667 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 14:39:17.907667 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 14:39:17.907667 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 8604f1505f984525a7ec4a1d072593c6 Oct 17 14:39:17.907667 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-TestEncryptedCinderVolumes-2016754020-project Oct 17 14:39:17.907667 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 14:39:17.907667 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 5c862e11-8f1f-4f40-b929-b3e70f1c790c could not be found. Oct 17 14:39:17.907667 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '5c862e11-8f1f-4f40-b929-b3e70f1c790c'} Oct 17 14:39:17.907667 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:39:17.907667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:39:17.907667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:39:17.907667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:39:17.907667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:39:17.907667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:39:17.907667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:39:17.907667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:39:17.907667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:39:17.907667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:39:17.907667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c862e11-8f1f-4f40-b929-b3e70f1c790c could not be found. Oct 17 14:39:17.907667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:39:17.907667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:39:17.907667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:39:17.907667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:39:17.907667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:39:17.907667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:39:17.907667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:39:17.907667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:39:17.907667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:39:17.907667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:39:17.907667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:39:17.907667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:39:17.907667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:39:17.907667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:39:17.907667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:39:17.907667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:39:17.907667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c862e11-8f1f-4f40-b929-b3e70f1c790c could not be found. Oct 17 14:39:17.907667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:39:17.907667 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:39:17.912368 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:39:17.912368 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:39:17.912368 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:39:17.912368 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:39:17.912368 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:39:17.912368 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:39:17.912368 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c862e11-8f1f-4f40-b929-b3e70f1c790c could not be found. Oct 17 14:39:17.912368 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:39:17.912368 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-494d36d9-e143-4f92-ad0b-925dfde9f5cb tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Returning 404 to user: Instance 5c862e11-8f1f-4f40-b929-b3e70f1c790c could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:39:17.912368 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-494d36d9-e143-4f92-ad0b-925dfde9f5cb tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "GET /compute/v2.1/servers/5c862e11-8f1f-4f40-b929-b3e70f1c790c" status: 404 len: 111 microversion: 2.1 time: 0.041193 Oct 17 14:39:17.912368 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3374/6886] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:39:17 2022] GET /compute/v2.1/servers/5c862e11-8f1f-4f40-b929-b3e70f1c790c => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:39:17.918182 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e330ff4e-239d-4ea4-9473-9a8a321371aa tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '.version_select at 0x7f7cd459e940>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:17.947687 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e330ff4e-239d-4ea4-9473-9a8a321371aa tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1179353851" status: 202 len: 0 microversion: 2.1 time: 0.033451 Oct 17 14:39:17.948280 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3513/6887] 10.222.0.79 () {58 vars in 1278 bytes} [Mon Oct 17 14:39:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1179353851 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 14:39:17.965380 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d415acf7-725f-40cc-96db-11cd14aeb0fb tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Action: 'create', calling method: .version_select at 0x7f7cd44f91f0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1665151548", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC7u87xIGNmArEe88u2mg0JJ9cK8eG0EMhyJnWUzZAM0O5lbLxo1G7GoMy/Ddm1608y+Cf99JBWemC8cgspi6uvcoOphHrE4gzz+kEZL6pYYN0i7PtTqeSJl1iQHqHDuag=="}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:39:17.981123 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-d415acf7-725f-40cc-96db-11cd14aeb0fb tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Getting quotas for project c92eab284e904607b8f6fefb7b904201. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:39:17.986368 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-d415acf7-725f-40cc-96db-11cd14aeb0fb tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Getting quotas for user 8604f1505f984525a7ec4a1d072593c6 and project c92eab284e904607b8f6fefb7b904201. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:39:18.013281 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d415acf7-725f-40cc-96db-11cd14aeb0fb tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.052123 Oct 17 14:39:18.013842 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3375/6888] 10.222.0.79 () {60 vars in 1159 bytes} [Mon Oct 17 14:39:17 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:39:18.066961 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c636ebc4-a634-4812-a8fc-39fbd9d3786a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-496209150", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1665151548", "networks": [{"uuid": "a18a45b5-55b9-432c-9b08-f922ce398921"}]}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:39:18.128478 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-c636ebc4-a634-4812-a8fc-39fbd9d3786a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] validate_networks() for [('a18a45b5-55b9-432c-9b08-f922ce398921', None, None, None, None, None)] {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:39:18.511003 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-c636ebc4-a634-4812-a8fc-39fbd9d3786a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:39:18.511456 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-c636ebc4-a634-4812-a8fc-39fbd9d3786a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:39:18.512018 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-c636ebc4-a634-4812-a8fc-39fbd9d3786a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:39:18.512476 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-c636ebc4-a634-4812-a8fc-39fbd9d3786a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:39:18.512918 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-c636ebc4-a634-4812-a8fc-39fbd9d3786a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:39:18.522337 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c636ebc4-a634-4812-a8fc-39fbd9d3786a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:18.522823 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c636ebc4-a634-4812-a8fc-39fbd9d3786a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:18.523299 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c636ebc4-a634-4812-a8fc-39fbd9d3786a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:18.524045 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c636ebc4-a634-4812-a8fc-39fbd9d3786a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:18.524498 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c636ebc4-a634-4812-a8fc-39fbd9d3786a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:18.524935 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c636ebc4-a634-4812-a8fc-39fbd9d3786a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:18.544249 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-c636ebc4-a634-4812-a8fc-39fbd9d3786a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Getting quotas for project c92eab284e904607b8f6fefb7b904201. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:39:18.549786 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-c636ebc4-a634-4812-a8fc-39fbd9d3786a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Getting quotas for user 8604f1505f984525a7ec4a1d072593c6 and project c92eab284e904607b8f6fefb7b904201. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:39:18.562582 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c636ebc4-a634-4812-a8fc-39fbd9d3786a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:39:18.564979 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c636ebc4-a634-4812-a8fc-39fbd9d3786a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 7eb7c3e3-e134-4fbb-b497-e4e565c47533] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:39:18.614926 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c636ebc4-a634-4812-a8fc-39fbd9d3786a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.552454 Oct 17 14:39:18.615843 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3514/6889] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 14:39:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 554 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:39:18.627662 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b073b22a-080d-43cf-a6e3-3b6a3d9b06ef tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:18.628377 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b073b22a-080d-43cf-a6e3-3b6a3d9b06ef tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 7eb7c3e3-e134-4fbb-b497-e4e565c47533] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:18.683662 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b073b22a-080d-43cf-a6e3-3b6a3d9b06ef tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8604f1505f984525a7ec4a1d072593c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92eab284e904607b8f6fefb7b904201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:39:18.690922 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b073b22a-080d-43cf-a6e3-3b6a3d9b06ef tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "GET /compute/v2.1/servers/7eb7c3e3-e134-4fbb-b497-e4e565c47533" status: 200 len: 1262 microversion: 2.1 time: 0.067106 Oct 17 14:39:18.692518 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3376/6890] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:39:18 2022] GET /compute/v2.1/servers/7eb7c3e3-e134-4fbb-b497-e4e565c47533 => generated 1262 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:39:19.717430 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6c32233c-0139-4512-abad-a535f5e20f0d tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:19.718130 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6c32233c-0139-4512-abad-a535f5e20f0d tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 7eb7c3e3-e134-4fbb-b497-e4e565c47533] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:19.728065 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6c32233c-0139-4512-abad-a535f5e20f0d tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:19.728676 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6c32233c-0139-4512-abad-a535f5e20f0d tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:19.729222 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6c32233c-0139-4512-abad-a535f5e20f0d tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:19.730096 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6c32233c-0139-4512-abad-a535f5e20f0d tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:19.730875 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6c32233c-0139-4512-abad-a535f5e20f0d tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:19.731348 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6c32233c-0139-4512-abad-a535f5e20f0d tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:19.799904 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6c32233c-0139-4512-abad-a535f5e20f0d tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8604f1505f984525a7ec4a1d072593c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92eab284e904607b8f6fefb7b904201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:39:19.808060 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6c32233c-0139-4512-abad-a535f5e20f0d tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "GET /compute/v2.1/servers/7eb7c3e3-e134-4fbb-b497-e4e565c47533" status: 200 len: 1314 microversion: 2.1 time: 0.095897 Oct 17 14:39:19.809538 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3515/6891] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:39:19 2022] GET /compute/v2.1/servers/7eb7c3e3-e134-4fbb-b497-e4e565c47533 => generated 1314 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:39:20.833244 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0b15957d-0f45-41dd-bd92-4f0057164083 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:20.833956 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0b15957d-0f45-41dd-bd92-4f0057164083 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 7eb7c3e3-e134-4fbb-b497-e4e565c47533] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:20.841347 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0b15957d-0f45-41dd-bd92-4f0057164083 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:20.841868 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0b15957d-0f45-41dd-bd92-4f0057164083 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:20.842323 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0b15957d-0f45-41dd-bd92-4f0057164083 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:20.843042 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0b15957d-0f45-41dd-bd92-4f0057164083 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:20.843568 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0b15957d-0f45-41dd-bd92-4f0057164083 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:20.843988 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0b15957d-0f45-41dd-bd92-4f0057164083 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:20.979111 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0b15957d-0f45-41dd-bd92-4f0057164083 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8604f1505f984525a7ec4a1d072593c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92eab284e904607b8f6fefb7b904201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:39:20.987520 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0b15957d-0f45-41dd-bd92-4f0057164083 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "GET /compute/v2.1/servers/7eb7c3e3-e134-4fbb-b497-e4e565c47533" status: 200 len: 1362 microversion: 2.1 time: 0.158232 Oct 17 14:39:20.988112 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3377/6892] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:39:20 2022] GET /compute/v2.1/servers/7eb7c3e3-e134-4fbb-b497-e4e565c47533 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:39:21.204763 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-2000f671-8f29-47ad-a36e-e74439b7e825 req-33c77278-1885-49be-8547-2eeffaf17fb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7eb7c3e3-e134-4fbb-b497-e4e565c47533", "tag": "3ee4d9d6-1014-4ea6-8ef4-edcdd1113a2b"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:39:21.217446 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-2000f671-8f29-47ad-a36e-e74439b7e825 req-33c77278-1885-49be-8547-2eeffaf17fb4 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:21.218232 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-2000f671-8f29-47ad-a36e-e74439b7e825 req-33c77278-1885-49be-8547-2eeffaf17fb4 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:21.218666 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-2000f671-8f29-47ad-a36e-e74439b7e825 req-33c77278-1885-49be-8547-2eeffaf17fb4 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:21.231306 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-2000f671-8f29-47ad-a36e-e74439b7e825 req-33c77278-1885-49be-8547-2eeffaf17fb4 service nova] Creating event network-changed:3ee4d9d6-1014-4ea6-8ef4-edcdd1113a2b for instance 7eb7c3e3-e134-4fbb-b497-e4e565c47533 on n-h1-854247-14 Oct 17 14:39:21.237074 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-2000f671-8f29-47ad-a36e-e74439b7e825 req-33c77278-1885-49be-8547-2eeffaf17fb4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036780 Oct 17 14:39:21.237671 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3516/6893] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:39:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:39:22.013946 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b1c67d4c-0eef-4daf-8a9b-d0f7b3031610 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:22.014572 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b1c67d4c-0eef-4daf-8a9b-d0f7b3031610 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 7eb7c3e3-e134-4fbb-b497-e4e565c47533] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:22.022099 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b1c67d4c-0eef-4daf-8a9b-d0f7b3031610 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:22.022598 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b1c67d4c-0eef-4daf-8a9b-d0f7b3031610 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:22.023050 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b1c67d4c-0eef-4daf-8a9b-d0f7b3031610 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:22.023792 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b1c67d4c-0eef-4daf-8a9b-d0f7b3031610 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:22.024260 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b1c67d4c-0eef-4daf-8a9b-d0f7b3031610 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:22.024696 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b1c67d4c-0eef-4daf-8a9b-d0f7b3031610 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:22.165475 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b1c67d4c-0eef-4daf-8a9b-d0f7b3031610 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8604f1505f984525a7ec4a1d072593c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92eab284e904607b8f6fefb7b904201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:39:22.174926 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b1c67d4c-0eef-4daf-8a9b-d0f7b3031610 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "GET /compute/v2.1/servers/7eb7c3e3-e134-4fbb-b497-e4e565c47533" status: 200 len: 1362 microversion: 2.1 time: 0.167044 Oct 17 14:39:22.175542 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3378/6894] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:39:22 2022] GET /compute/v2.1/servers/7eb7c3e3-e134-4fbb-b497-e4e565c47533 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:39:23.204711 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c7bcbd2f-0eae-4708-b03e-6344a382afaf tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:23.205884 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c7bcbd2f-0eae-4708-b03e-6344a382afaf tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 7eb7c3e3-e134-4fbb-b497-e4e565c47533] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:23.216708 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c7bcbd2f-0eae-4708-b03e-6344a382afaf tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:23.217195 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c7bcbd2f-0eae-4708-b03e-6344a382afaf tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:23.217635 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c7bcbd2f-0eae-4708-b03e-6344a382afaf tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:23.218331 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c7bcbd2f-0eae-4708-b03e-6344a382afaf tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:23.218790 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c7bcbd2f-0eae-4708-b03e-6344a382afaf tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:23.219220 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c7bcbd2f-0eae-4708-b03e-6344a382afaf tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:23.374518 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c7bcbd2f-0eae-4708-b03e-6344a382afaf tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8604f1505f984525a7ec4a1d072593c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92eab284e904607b8f6fefb7b904201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:39:23.386503 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c7bcbd2f-0eae-4708-b03e-6344a382afaf tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "GET /compute/v2.1/servers/7eb7c3e3-e134-4fbb-b497-e4e565c47533" status: 200 len: 1362 microversion: 2.1 time: 0.190304 Oct 17 14:39:23.387097 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3517/6895] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:39:23 2022] GET /compute/v2.1/servers/7eb7c3e3-e134-4fbb-b497-e4e565c47533 => generated 1362 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:39:24.415958 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-fab28add-0b43-4ad4-b22a-1c5eae894a36 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:24.416584 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-fab28add-0b43-4ad4-b22a-1c5eae894a36 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 7eb7c3e3-e134-4fbb-b497-e4e565c47533] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:24.424017 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fab28add-0b43-4ad4-b22a-1c5eae894a36 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:24.424496 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fab28add-0b43-4ad4-b22a-1c5eae894a36 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:24.424949 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fab28add-0b43-4ad4-b22a-1c5eae894a36 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:24.425638 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fab28add-0b43-4ad4-b22a-1c5eae894a36 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:24.426100 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fab28add-0b43-4ad4-b22a-1c5eae894a36 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:24.426529 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fab28add-0b43-4ad4-b22a-1c5eae894a36 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:24.564280 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-fab28add-0b43-4ad4-b22a-1c5eae894a36 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8604f1505f984525a7ec4a1d072593c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92eab284e904607b8f6fefb7b904201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:39:24.572233 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-fab28add-0b43-4ad4-b22a-1c5eae894a36 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "GET /compute/v2.1/servers/7eb7c3e3-e134-4fbb-b497-e4e565c47533" status: 200 len: 1362 microversion: 2.1 time: 0.160104 Oct 17 14:39:24.572749 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3379/6896] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:39:24 2022] GET /compute/v2.1/servers/7eb7c3e3-e134-4fbb-b497-e4e565c47533 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:39:25.599070 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1bb39fb2-bc89-40e3-a7d5-c3646c04bbed tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:25.600196 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-1bb39fb2-bc89-40e3-a7d5-c3646c04bbed tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 7eb7c3e3-e134-4fbb-b497-e4e565c47533] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:25.612112 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1bb39fb2-bc89-40e3-a7d5-c3646c04bbed tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:25.612855 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1bb39fb2-bc89-40e3-a7d5-c3646c04bbed tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:25.613525 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1bb39fb2-bc89-40e3-a7d5-c3646c04bbed tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:25.614603 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1bb39fb2-bc89-40e3-a7d5-c3646c04bbed tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:25.615347 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1bb39fb2-bc89-40e3-a7d5-c3646c04bbed tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:25.616009 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1bb39fb2-bc89-40e3-a7d5-c3646c04bbed tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:25.769310 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-1bb39fb2-bc89-40e3-a7d5-c3646c04bbed tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8604f1505f984525a7ec4a1d072593c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92eab284e904607b8f6fefb7b904201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:39:25.777559 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1bb39fb2-bc89-40e3-a7d5-c3646c04bbed tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "GET /compute/v2.1/servers/7eb7c3e3-e134-4fbb-b497-e4e565c47533" status: 200 len: 1362 microversion: 2.1 time: 0.184724 Oct 17 14:39:25.778143 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3518/6897] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:39:25 2022] GET /compute/v2.1/servers/7eb7c3e3-e134-4fbb-b497-e4e565c47533 => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:39:26.308251 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-0a91ec00-490f-4655-a355-f3908ed4e3e1 req-7ca00677-9308-4dfa-aa47-d65561d17a41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7eb7c3e3-e134-4fbb-b497-e4e565c47533", "name": "network-vif-plugged", "status": "completed", "tag": "3ee4d9d6-1014-4ea6-8ef4-edcdd1113a2b"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:39:26.318633 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-0a91ec00-490f-4655-a355-f3908ed4e3e1 req-7ca00677-9308-4dfa-aa47-d65561d17a41 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:26.319136 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-0a91ec00-490f-4655-a355-f3908ed4e3e1 req-7ca00677-9308-4dfa-aa47-d65561d17a41 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:26.319641 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-0a91ec00-490f-4655-a355-f3908ed4e3e1 req-7ca00677-9308-4dfa-aa47-d65561d17a41 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:26.331373 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-0a91ec00-490f-4655-a355-f3908ed4e3e1 req-7ca00677-9308-4dfa-aa47-d65561d17a41 service nova] Creating event network-vif-plugged:3ee4d9d6-1014-4ea6-8ef4-edcdd1113a2b for instance 7eb7c3e3-e134-4fbb-b497-e4e565c47533 on n-h1-854247-14 Oct 17 14:39:26.336415 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-0a91ec00-490f-4655-a355-f3908ed4e3e1 req-7ca00677-9308-4dfa-aa47-d65561d17a41 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032023 Oct 17 14:39:26.337080 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3380/6898] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:39:26.804467 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b35dda73-b436-43f4-8e92-e9a692edd0dd tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:26.805420 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b35dda73-b436-43f4-8e92-e9a692edd0dd tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 7eb7c3e3-e134-4fbb-b497-e4e565c47533] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:26.815524 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b35dda73-b436-43f4-8e92-e9a692edd0dd tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:26.816016 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b35dda73-b436-43f4-8e92-e9a692edd0dd tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:26.816457 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b35dda73-b436-43f4-8e92-e9a692edd0dd tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:26.817150 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b35dda73-b436-43f4-8e92-e9a692edd0dd tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:26.817604 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b35dda73-b436-43f4-8e92-e9a692edd0dd tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:26.818034 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b35dda73-b436-43f4-8e92-e9a692edd0dd tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:26.963037 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b35dda73-b436-43f4-8e92-e9a692edd0dd tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8604f1505f984525a7ec4a1d072593c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92eab284e904607b8f6fefb7b904201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:39:26.971966 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b35dda73-b436-43f4-8e92-e9a692edd0dd tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "GET /compute/v2.1/servers/7eb7c3e3-e134-4fbb-b497-e4e565c47533" status: 200 len: 1362 microversion: 2.1 time: 0.174317 Oct 17 14:39:26.972570 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3519/6899] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:39:26 2022] GET /compute/v2.1/servers/7eb7c3e3-e134-4fbb-b497-e4e565c47533 => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:39:28.010167 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2e19cb10-ebf8-463f-842f-6520c44ae6ce tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:28.011241 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2e19cb10-ebf8-463f-842f-6520c44ae6ce tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 7eb7c3e3-e134-4fbb-b497-e4e565c47533] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:28.019360 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2e19cb10-ebf8-463f-842f-6520c44ae6ce tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:28.019842 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2e19cb10-ebf8-463f-842f-6520c44ae6ce tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:28.020284 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2e19cb10-ebf8-463f-842f-6520c44ae6ce tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:28.020990 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2e19cb10-ebf8-463f-842f-6520c44ae6ce tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:28.021504 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2e19cb10-ebf8-463f-842f-6520c44ae6ce tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:28.021932 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2e19cb10-ebf8-463f-842f-6520c44ae6ce tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:28.162057 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2e19cb10-ebf8-463f-842f-6520c44ae6ce tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8604f1505f984525a7ec4a1d072593c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92eab284e904607b8f6fefb7b904201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:39:28.170141 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2e19cb10-ebf8-463f-842f-6520c44ae6ce tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "GET /compute/v2.1/servers/7eb7c3e3-e134-4fbb-b497-e4e565c47533" status: 200 len: 1552 microversion: 2.1 time: 0.168599 Oct 17 14:39:28.171030 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3381/6900] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:39:27 2022] GET /compute/v2.1/servers/7eb7c3e3-e134-4fbb-b497-e4e565c47533 => generated 1552 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:39:28.193622 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-960e8afb-201c-4ea3-8c52-e16090298259 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:28.194207 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-960e8afb-201c-4ea3-8c52-e16090298259 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 7eb7c3e3-e134-4fbb-b497-e4e565c47533] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:28.201228 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-960e8afb-201c-4ea3-8c52-e16090298259 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:28.201923 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-960e8afb-201c-4ea3-8c52-e16090298259 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:28.202539 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-960e8afb-201c-4ea3-8c52-e16090298259 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:28.203281 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-960e8afb-201c-4ea3-8c52-e16090298259 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:28.203739 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-960e8afb-201c-4ea3-8c52-e16090298259 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:28.204165 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-960e8afb-201c-4ea3-8c52-e16090298259 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:28.337598 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-960e8afb-201c-4ea3-8c52-e16090298259 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8604f1505f984525a7ec4a1d072593c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92eab284e904607b8f6fefb7b904201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:39:28.346511 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-960e8afb-201c-4ea3-8c52-e16090298259 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "GET /compute/v2.1/servers/7eb7c3e3-e134-4fbb-b497-e4e565c47533" status: 200 len: 1552 microversion: 2.1 time: 0.156884 Oct 17 14:39:28.347090 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3520/6901] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:39:28 2022] GET /compute/v2.1/servers/7eb7c3e3-e134-4fbb-b497-e4e565c47533 => generated 1552 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:39:29.917798 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b1094286-df6b-48a4-ac4b-ff9303923a75 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "483dded3-9b84-43d1-8d6b-4067f56ebcfe"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:39:29.920187 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b1094286-df6b-48a4-ac4b-ff9303923a75 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 7eb7c3e3-e134-4fbb-b497-e4e565c47533] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:29.922199 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=6 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:39:29.928734 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b1094286-df6b-48a4-ac4b-ff9303923a75 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:29.929222 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b1094286-df6b-48a4-ac4b-ff9303923a75 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:29.929658 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b1094286-df6b-48a4-ac4b-ff9303923a75 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:29.930355 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b1094286-df6b-48a4-ac4b-ff9303923a75 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:29.930808 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b1094286-df6b-48a4-ac4b-ff9303923a75 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:29.931254 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b1094286-df6b-48a4-ac4b-ff9303923a75 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:30.190083 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b1094286-df6b-48a4-ac4b-ff9303923a75 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "POST /compute/v2.1/servers/7eb7c3e3-e134-4fbb-b497-e4e565c47533/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275993 Oct 17 14:39:30.190808 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3382/6902] 10.222.0.79 () {60 vars in 1323 bytes} [Mon Oct 17 14:39:29 2022] POST /compute/v2.1/servers/7eb7c3e3-e134-4fbb-b497-e4e565c47533/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:39:40.978239 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-468abaeb-12fe-45d2-80ce-a68b2258f8ac tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:40.978783 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-468abaeb-12fe-45d2-80ce-a68b2258f8ac tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 7eb7c3e3-e134-4fbb-b497-e4e565c47533] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:40.981543 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:39:40.982471 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=6 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:39:40.983576 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:39:40.984444 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:39:40.990638 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-468abaeb-12fe-45d2-80ce-a68b2258f8ac tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:40.991123 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-468abaeb-12fe-45d2-80ce-a68b2258f8ac tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:40.991717 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-468abaeb-12fe-45d2-80ce-a68b2258f8ac tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:40.992418 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-468abaeb-12fe-45d2-80ce-a68b2258f8ac tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:40.992870 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-468abaeb-12fe-45d2-80ce-a68b2258f8ac tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:40.993299 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-468abaeb-12fe-45d2-80ce-a68b2258f8ac tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:41.079536 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-468abaeb-12fe-45d2-80ce-a68b2258f8ac tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lazy-loading 'services' on Instance uuid 7eb7c3e3-e134-4fbb-b497-e4e565c47533 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:39:41.157186 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-468abaeb-12fe-45d2-80ce-a68b2258f8ac tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "DELETE /compute/v2.1/servers/7eb7c3e3-e134-4fbb-b497-e4e565c47533/os-volume_attachments/483dded3-9b84-43d1-8d6b-4067f56ebcfe" status: 202 len: 0 microversion: 2.1 time: 0.186017 Oct 17 14:39:41.157852 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3521/6903] 10.222.0.79 () {58 vars in 1416 bytes} [Mon Oct 17 14:39:40 2022] DELETE /compute/v2.1/servers/7eb7c3e3-e134-4fbb-b497-e4e565c47533/os-volume_attachments/483dded3-9b84-43d1-8d6b-4067f56ebcfe => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:39:41.164499 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:39:41.165350 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:39:41.169596 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8c6a47c6-1461-4b89-83b8-525c75c1b0db tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:41.172023 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8c6a47c6-1461-4b89-83b8-525c75c1b0db tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 7eb7c3e3-e134-4fbb-b497-e4e565c47533] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:41.180151 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8c6a47c6-1461-4b89-83b8-525c75c1b0db tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:41.180654 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8c6a47c6-1461-4b89-83b8-525c75c1b0db tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:41.181108 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8c6a47c6-1461-4b89-83b8-525c75c1b0db tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:41.181818 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8c6a47c6-1461-4b89-83b8-525c75c1b0db tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:41.182279 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8c6a47c6-1461-4b89-83b8-525c75c1b0db tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:41.182712 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8c6a47c6-1461-4b89-83b8-525c75c1b0db tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:41.216643 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8c6a47c6-1461-4b89-83b8-525c75c1b0db tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "GET /compute/v2.1/servers/7eb7c3e3-e134-4fbb-b497-e4e565c47533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054049 Oct 17 14:39:41.217207 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3383/6904] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 14:39:41 2022] GET /compute/v2.1/servers/7eb7c3e3-e134-4fbb-b497-e4e565c47533/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:39:42.231578 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e3326c4f-dd2c-43ae-af8b-6f39d08fe50b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:42.233989 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e3326c4f-dd2c-43ae-af8b-6f39d08fe50b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 7eb7c3e3-e134-4fbb-b497-e4e565c47533] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:42.240959 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e3326c4f-dd2c-43ae-af8b-6f39d08fe50b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:42.241450 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e3326c4f-dd2c-43ae-af8b-6f39d08fe50b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:42.241888 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e3326c4f-dd2c-43ae-af8b-6f39d08fe50b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:42.242592 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e3326c4f-dd2c-43ae-af8b-6f39d08fe50b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:42.243047 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e3326c4f-dd2c-43ae-af8b-6f39d08fe50b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:42.243534 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e3326c4f-dd2c-43ae-af8b-6f39d08fe50b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:42.275870 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e3326c4f-dd2c-43ae-af8b-6f39d08fe50b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "GET /compute/v2.1/servers/7eb7c3e3-e134-4fbb-b497-e4e565c47533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049610 Oct 17 14:39:42.276451 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3522/6905] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 14:39:42 2022] GET /compute/v2.1/servers/7eb7c3e3-e134-4fbb-b497-e4e565c47533/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:39:43.290973 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4d3010c3-5e49-455d-99ad-256a446f217e tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:43.294067 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4d3010c3-5e49-455d-99ad-256a446f217e tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 7eb7c3e3-e134-4fbb-b497-e4e565c47533] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:43.303600 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4d3010c3-5e49-455d-99ad-256a446f217e tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:43.304106 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4d3010c3-5e49-455d-99ad-256a446f217e tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:43.304556 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4d3010c3-5e49-455d-99ad-256a446f217e tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:43.305279 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4d3010c3-5e49-455d-99ad-256a446f217e tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:43.305793 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4d3010c3-5e49-455d-99ad-256a446f217e tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:43.306213 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4d3010c3-5e49-455d-99ad-256a446f217e tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:43.337810 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4d3010c3-5e49-455d-99ad-256a446f217e tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "GET /compute/v2.1/servers/7eb7c3e3-e134-4fbb-b497-e4e565c47533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052141 Oct 17 14:39:43.338406 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3384/6906] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 14:39:43 2022] GET /compute/v2.1/servers/7eb7c3e3-e134-4fbb-b497-e4e565c47533/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:39:44.350762 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c0d77fc0-9954-400f-88a9-38cb71ac37ea tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:44.353077 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c0d77fc0-9954-400f-88a9-38cb71ac37ea tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 7eb7c3e3-e134-4fbb-b497-e4e565c47533] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:44.360485 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c0d77fc0-9954-400f-88a9-38cb71ac37ea tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:44.361208 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c0d77fc0-9954-400f-88a9-38cb71ac37ea tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:44.361644 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c0d77fc0-9954-400f-88a9-38cb71ac37ea tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:44.362358 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c0d77fc0-9954-400f-88a9-38cb71ac37ea tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:44.362819 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c0d77fc0-9954-400f-88a9-38cb71ac37ea tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:44.363272 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c0d77fc0-9954-400f-88a9-38cb71ac37ea tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:44.396345 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c0d77fc0-9954-400f-88a9-38cb71ac37ea tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "GET /compute/v2.1/servers/7eb7c3e3-e134-4fbb-b497-e4e565c47533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049770 Oct 17 14:39:44.397162 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3523/6907] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 14:39:44 2022] GET /compute/v2.1/servers/7eb7c3e3-e134-4fbb-b497-e4e565c47533/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:39:45.409306 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5ed872c5-8d4c-4732-8001-e4298632dba5 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:45.411547 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5ed872c5-8d4c-4732-8001-e4298632dba5 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 7eb7c3e3-e134-4fbb-b497-e4e565c47533] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:45.418825 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5ed872c5-8d4c-4732-8001-e4298632dba5 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:45.419345 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5ed872c5-8d4c-4732-8001-e4298632dba5 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:45.419790 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5ed872c5-8d4c-4732-8001-e4298632dba5 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:45.420492 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5ed872c5-8d4c-4732-8001-e4298632dba5 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:45.420949 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5ed872c5-8d4c-4732-8001-e4298632dba5 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:45.421378 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5ed872c5-8d4c-4732-8001-e4298632dba5 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:45.455110 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5ed872c5-8d4c-4732-8001-e4298632dba5 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "GET /compute/v2.1/servers/7eb7c3e3-e134-4fbb-b497-e4e565c47533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049818 Oct 17 14:39:45.455722 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3385/6908] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 14:39:45 2022] GET /compute/v2.1/servers/7eb7c3e3-e134-4fbb-b497-e4e565c47533/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:39:46.473361 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f6324e94-e1e2-4940-bafa-c5ef5cf6d33e tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:46.476893 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f6324e94-e1e2-4940-bafa-c5ef5cf6d33e tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 7eb7c3e3-e134-4fbb-b497-e4e565c47533] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:46.488635 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f6324e94-e1e2-4940-bafa-c5ef5cf6d33e tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:46.489153 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f6324e94-e1e2-4940-bafa-c5ef5cf6d33e tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:46.489615 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f6324e94-e1e2-4940-bafa-c5ef5cf6d33e tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:46.490319 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f6324e94-e1e2-4940-bafa-c5ef5cf6d33e tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:46.490772 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f6324e94-e1e2-4940-bafa-c5ef5cf6d33e tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:46.491212 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f6324e94-e1e2-4940-bafa-c5ef5cf6d33e tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:46.522198 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f6324e94-e1e2-4940-bafa-c5ef5cf6d33e tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "GET /compute/v2.1/servers/7eb7c3e3-e134-4fbb-b497-e4e565c47533/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056454 Oct 17 14:39:46.522757 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3524/6909] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 14:39:46 2022] GET /compute/v2.1/servers/7eb7c3e3-e134-4fbb-b497-e4e565c47533/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 14:39:46.537649 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-06878b59-c63f-4c5a-a257-c150a3164fd1 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:46.538410 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-06878b59-c63f-4c5a-a257-c150a3164fd1 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 7eb7c3e3-e134-4fbb-b497-e4e565c47533] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:46.547851 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-06878b59-c63f-4c5a-a257-c150a3164fd1 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:46.548369 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-06878b59-c63f-4c5a-a257-c150a3164fd1 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:46.548810 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-06878b59-c63f-4c5a-a257-c150a3164fd1 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:46.549512 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-06878b59-c63f-4c5a-a257-c150a3164fd1 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:46.550015 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-06878b59-c63f-4c5a-a257-c150a3164fd1 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:46.550623 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-06878b59-c63f-4c5a-a257-c150a3164fd1 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:46.634010 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-06878b59-c63f-4c5a-a257-c150a3164fd1 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] HTTP exception thrown: Instance 7eb7c3e3-e134-4fbb-b497-e4e565c47533 is not attached to volume 483dded3-9b84-43d1-8d6b-4067f56ebcfe Oct 17 14:39:46.635679 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-06878b59-c63f-4c5a-a257-c150a3164fd1 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Request method failure captured: Oct 17 14:39:46.635679 n-d-854247-14 devstack@n-api.service[127017]: request: DELETE /compute/v2.1/servers/7eb7c3e3-e134-4fbb-b497-e4e565c47533/os-volume_attachments/483dded3-9b84-43d1-8d6b-4067f56ebcfe HTTP/1.1 Oct 17 14:39:46.635679 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 14:39:46.635679 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 14:39:46.635679 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 14:39:46.635679 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 14:39:46.635679 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 14:39:46.635679 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 14:39:46.635679 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 14:39:46.635679 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 14:39:46.635679 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTWjsqBGADzJouBjurtPzzg1tjgTb4pF7ozl_UbNOj6xqAayKaN28B7_cAUIuqtlGsqMyQlPIkrkOBuPZ_VNr6tixUAoQxR7yaDztHi2BQhbxFD0oU5Fgh22yeXgEYdm_hkQwuX9-HS_BdmqxWZK_p4j4oylciWhdk3H-GqayhBBiNcU Oct 17 14:39:46.635679 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 14:39:46.635679 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 14:39:46.635679 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 14:39:46.635679 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 14:39:46.635679 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 14:39:46.635679 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 14:39:46.635679 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: c92eab284e904607b8f6fefb7b904201 Oct 17 14:39:46.635679 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-TestEncryptedCinderVolumes-2016754020 Oct 17 14:39:46.635679 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 14:39:46.635679 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 14:39:46.635679 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c92eab284e904607b8f6fefb7b904201"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c92eab284e904607b8f6fefb7b904201"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c92eab284e904607b8f6fefb7b904201"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c92eab284e904607b8f6fefb7b904201", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:39:46.635679 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-TestEncryptedCinderVolumes-2016754020 Oct 17 14:39:46.635679 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: c92eab284e904607b8f6fefb7b904201 Oct 17 14:39:46.635679 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-2016754020 Oct 17 14:39:46.635679 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-TestEncryptedCinderVolumes-2016754020-project Oct 17 14:39:46.635679 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 14:39:46.635679 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 14:39:46.635679 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 8604f1505f984525a7ec4a1d072593c6 Oct 17 14:39:46.635679 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-TestEncryptedCinderVolumes-2016754020-project Oct 17 14:39:46.635679 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 14:39:46.635679 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 7eb7c3e3-e134-4fbb-b497-e4e565c47533 is not attached to volume 483dded3-9b84-43d1-8d6b-4067f56ebcfe Oct 17 14:39:46.635679 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'server_id': '7eb7c3e3-e134-4fbb-b497-e4e565c47533', 'id': '483dded3-9b84-43d1-8d6b-4067f56ebcfe'} Oct 17 14:39:46.635679 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:39:46.635679 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:39:46.635679 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 17 14:39:46.635679 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 17 14:39:46.635679 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 14:39:46.635679 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 14:39:46.635679 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 17 14:39:46.635679 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 17 14:39:46.635679 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 483dded3-9b84-43d1-8d6b-4067f56ebcfe. Oct 17 14:39:46.635679 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:39:46.635679 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:39:46.635679 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:39:46.635679 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:39:46.635679 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:39:46.635679 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:39:46.635679 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:39:46.635679 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:39:46.635679 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:39:46.635679 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:39:46.635679 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 17 14:39:46.635679 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 17 14:39:46.635679 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7eb7c3e3-e134-4fbb-b497-e4e565c47533 is not attached to volume 483dded3-9b84-43d1-8d6b-4067f56ebcfe Oct 17 14:39:46.635679 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:39:46.635679 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:39:46.635679 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:39:46.635679 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:39:46.635679 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:39:46.635679 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:39:46.639777 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:39:46.639777 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:39:46.639777 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7eb7c3e3-e134-4fbb-b497-e4e565c47533 is not attached to volume 483dded3-9b84-43d1-8d6b-4067f56ebcfe Oct 17 14:39:46.639777 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:39:46.639777 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-06878b59-c63f-4c5a-a257-c150a3164fd1 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Returning 404 to user: Instance 7eb7c3e3-e134-4fbb-b497-e4e565c47533 is not attached to volume 483dded3-9b84-43d1-8d6b-4067f56ebcfe {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:39:46.639777 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-06878b59-c63f-4c5a-a257-c150a3164fd1 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "DELETE /compute/v2.1/servers/7eb7c3e3-e134-4fbb-b497-e4e565c47533/os-volume_attachments/483dded3-9b84-43d1-8d6b-4067f56ebcfe" status: 404 len: 154 microversion: 2.1 time: 0.106969 Oct 17 14:39:46.639777 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3386/6910] 10.222.0.79 () {58 vars in 1416 bytes} [Mon Oct 17 14:39:46 2022] DELETE /compute/v2.1/servers/7eb7c3e3-e134-4fbb-b497-e4e565c47533/os-volume_attachments/483dded3-9b84-43d1-8d6b-4067f56ebcfe => generated 154 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:39:50.002667 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-695e2294-fdc5-44a5-8d9d-742137fca8db tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:50.003298 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-695e2294-fdc5-44a5-8d9d-742137fca8db tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 7eb7c3e3-e134-4fbb-b497-e4e565c47533] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:50.011014 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-695e2294-fdc5-44a5-8d9d-742137fca8db tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:50.012410 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-695e2294-fdc5-44a5-8d9d-742137fca8db tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:50.012947 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-695e2294-fdc5-44a5-8d9d-742137fca8db tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:50.013742 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-695e2294-fdc5-44a5-8d9d-742137fca8db tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:50.014212 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-695e2294-fdc5-44a5-8d9d-742137fca8db tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:50.014663 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-695e2294-fdc5-44a5-8d9d-742137fca8db tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:50.046749 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-695e2294-fdc5-44a5-8d9d-742137fca8db tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 7eb7c3e3-e134-4fbb-b497-e4e565c47533] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:39:50.138865 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-695e2294-fdc5-44a5-8d9d-742137fca8db tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "DELETE /compute/v2.1/servers/7eb7c3e3-e134-4fbb-b497-e4e565c47533" status: 204 len: 0 microversion: 2.1 time: 0.139991 Oct 17 14:39:50.139712 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3525/6911] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:39:49 2022] DELETE /compute/v2.1/servers/7eb7c3e3-e134-4fbb-b497-e4e565c47533 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:39:50.148258 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5310351f-e9cc-4297-a2d5-3da38f8d2cee tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:50.148887 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5310351f-e9cc-4297-a2d5-3da38f8d2cee tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 7eb7c3e3-e134-4fbb-b497-e4e565c47533] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:50.159820 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5310351f-e9cc-4297-a2d5-3da38f8d2cee tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:50.160325 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5310351f-e9cc-4297-a2d5-3da38f8d2cee tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:50.160778 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5310351f-e9cc-4297-a2d5-3da38f8d2cee tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:50.161494 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5310351f-e9cc-4297-a2d5-3da38f8d2cee tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:50.161960 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5310351f-e9cc-4297-a2d5-3da38f8d2cee tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:50.162398 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5310351f-e9cc-4297-a2d5-3da38f8d2cee tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:50.297028 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5310351f-e9cc-4297-a2d5-3da38f8d2cee tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8604f1505f984525a7ec4a1d072593c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92eab284e904607b8f6fefb7b904201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:39:50.305195 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5310351f-e9cc-4297-a2d5-3da38f8d2cee tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "GET /compute/v2.1/servers/7eb7c3e3-e134-4fbb-b497-e4e565c47533" status: 200 len: 1558 microversion: 2.1 time: 0.161178 Oct 17 14:39:50.305781 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3387/6912] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:39:50 2022] GET /compute/v2.1/servers/7eb7c3e3-e134-4fbb-b497-e4e565c47533 => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:39:51.334151 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f12f7c98-0987-4398-9480-28f88074d0a7 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:51.335348 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f12f7c98-0987-4398-9480-28f88074d0a7 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 7eb7c3e3-e134-4fbb-b497-e4e565c47533] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:51.347288 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f12f7c98-0987-4398-9480-28f88074d0a7 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:51.347755 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f12f7c98-0987-4398-9480-28f88074d0a7 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:51.348191 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f12f7c98-0987-4398-9480-28f88074d0a7 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:51.348960 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f12f7c98-0987-4398-9480-28f88074d0a7 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:51.349346 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f12f7c98-0987-4398-9480-28f88074d0a7 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:51.349771 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f12f7c98-0987-4398-9480-28f88074d0a7 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:51.494313 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f12f7c98-0987-4398-9480-28f88074d0a7 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8604f1505f984525a7ec4a1d072593c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92eab284e904607b8f6fefb7b904201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:39:51.502738 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f12f7c98-0987-4398-9480-28f88074d0a7 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "GET /compute/v2.1/servers/7eb7c3e3-e134-4fbb-b497-e4e565c47533" status: 200 len: 1558 microversion: 2.1 time: 0.175916 Oct 17 14:39:51.503338 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3526/6913] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:39:51 2022] GET /compute/v2.1/servers/7eb7c3e3-e134-4fbb-b497-e4e565c47533 => generated 1558 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:39:52.128526 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-2efc87d9-0138-4dad-8993-d4b0545e574b req-315ef055-6a50-46d8-86e9-edc7709876b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7eb7c3e3-e134-4fbb-b497-e4e565c47533", "name": "network-vif-deleted", "tag": "3ee4d9d6-1014-4ea6-8ef4-edcdd1113a2b"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:39:52.142395 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-2efc87d9-0138-4dad-8993-d4b0545e574b req-315ef055-6a50-46d8-86e9-edc7709876b1 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:52.142856 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-2efc87d9-0138-4dad-8993-d4b0545e574b req-315ef055-6a50-46d8-86e9-edc7709876b1 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:52.143330 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-2efc87d9-0138-4dad-8993-d4b0545e574b req-315ef055-6a50-46d8-86e9-edc7709876b1 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:52.155707 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-2efc87d9-0138-4dad-8993-d4b0545e574b req-315ef055-6a50-46d8-86e9-edc7709876b1 service nova] Creating event network-vif-deleted:3ee4d9d6-1014-4ea6-8ef4-edcdd1113a2b for instance 7eb7c3e3-e134-4fbb-b497-e4e565c47533 on n-h1-854247-14 Oct 17 14:39:52.161586 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-2efc87d9-0138-4dad-8993-d4b0545e574b req-315ef055-6a50-46d8-86e9-edc7709876b1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037115 Oct 17 14:39:52.162201 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3388/6914] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:39:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:39:52.528900 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d10ec49a-25a8-4193-8993-65abdc27abc5 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:52.530578 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d10ec49a-25a8-4193-8993-65abdc27abc5 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 7eb7c3e3-e134-4fbb-b497-e4e565c47533] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:52.539849 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d10ec49a-25a8-4193-8993-65abdc27abc5 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:52.540337 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d10ec49a-25a8-4193-8993-65abdc27abc5 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:52.540775 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d10ec49a-25a8-4193-8993-65abdc27abc5 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:52.541554 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d10ec49a-25a8-4193-8993-65abdc27abc5 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:52.541949 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d10ec49a-25a8-4193-8993-65abdc27abc5 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:52.542378 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d10ec49a-25a8-4193-8993-65abdc27abc5 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:52.580404 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d10ec49a-25a8-4193-8993-65abdc27abc5 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:52.580921 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d10ec49a-25a8-4193-8993-65abdc27abc5 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:52.581389 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d10ec49a-25a8-4193-8993-65abdc27abc5 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:52.581892 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-d10ec49a-25a8-4193-8993-65abdc27abc5 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lazy-loading 'fault' on Instance uuid 7eb7c3e3-e134-4fbb-b497-e4e565c47533 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:39:52.623224 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d10ec49a-25a8-4193-8993-65abdc27abc5 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8604f1505f984525a7ec4a1d072593c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92eab284e904607b8f6fefb7b904201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:39:52.631939 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d10ec49a-25a8-4193-8993-65abdc27abc5 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "GET /compute/v2.1/servers/7eb7c3e3-e134-4fbb-b497-e4e565c47533" status: 200 len: 1352 microversion: 2.1 time: 0.109581 Oct 17 14:39:52.632526 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3527/6915] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:39:52 2022] GET /compute/v2.1/servers/7eb7c3e3-e134-4fbb-b497-e4e565c47533 => generated 1352 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:39:53.657997 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-151fd83f-bd59-4d87-81f8-56a2f839c768 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:53.658829 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-151fd83f-bd59-4d87-81f8-56a2f839c768 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 7eb7c3e3-e134-4fbb-b497-e4e565c47533] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:53.665914 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-151fd83f-bd59-4d87-81f8-56a2f839c768 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:53.666403 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-151fd83f-bd59-4d87-81f8-56a2f839c768 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:53.666849 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-151fd83f-bd59-4d87-81f8-56a2f839c768 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:53.667580 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-151fd83f-bd59-4d87-81f8-56a2f839c768 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:53.668037 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-151fd83f-bd59-4d87-81f8-56a2f839c768 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:53.668463 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-151fd83f-bd59-4d87-81f8-56a2f839c768 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:53.682357 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-151fd83f-bd59-4d87-81f8-56a2f839c768 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] HTTP exception thrown: Instance 7eb7c3e3-e134-4fbb-b497-e4e565c47533 could not be found. Oct 17 14:39:53.684006 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-151fd83f-bd59-4d87-81f8-56a2f839c768 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Request method failure captured: Oct 17 14:39:53.684006 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/7eb7c3e3-e134-4fbb-b497-e4e565c47533 HTTP/1.1 Oct 17 14:39:53.684006 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 14:39:53.684006 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 14:39:53.684006 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 14:39:53.684006 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 14:39:53.684006 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 14:39:53.684006 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 14:39:53.684006 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 14:39:53.684006 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 14:39:53.684006 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTWjsqBGADzJouBjurtPzzg1tjgTb4pF7ozl_UbNOj6xqAayKaN28B7_cAUIuqtlGsqMyQlPIkrkOBuPZ_VNr6tixUAoQxR7yaDztHi2BQhbxFD0oU5Fgh22yeXgEYdm_hkQwuX9-HS_BdmqxWZK_p4j4oylciWhdk3H-GqayhBBiNcU Oct 17 14:39:53.684006 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 14:39:53.684006 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 14:39:53.684006 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 14:39:53.684006 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 14:39:53.684006 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 14:39:53.684006 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 14:39:53.684006 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: c92eab284e904607b8f6fefb7b904201 Oct 17 14:39:53.684006 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-TestEncryptedCinderVolumes-2016754020 Oct 17 14:39:53.684006 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 14:39:53.684006 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 14:39:53.684006 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c92eab284e904607b8f6fefb7b904201"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c92eab284e904607b8f6fefb7b904201"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c92eab284e904607b8f6fefb7b904201"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c92eab284e904607b8f6fefb7b904201", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:39:53.684006 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-TestEncryptedCinderVolumes-2016754020 Oct 17 14:39:53.684006 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: c92eab284e904607b8f6fefb7b904201 Oct 17 14:39:53.684006 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-2016754020 Oct 17 14:39:53.684006 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-TestEncryptedCinderVolumes-2016754020-project Oct 17 14:39:53.684006 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 14:39:53.684006 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 14:39:53.684006 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 8604f1505f984525a7ec4a1d072593c6 Oct 17 14:39:53.684006 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-TestEncryptedCinderVolumes-2016754020-project Oct 17 14:39:53.684006 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 14:39:53.684006 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 7eb7c3e3-e134-4fbb-b497-e4e565c47533 could not be found. Oct 17 14:39:53.684006 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '7eb7c3e3-e134-4fbb-b497-e4e565c47533'} Oct 17 14:39:53.684006 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:39:53.684006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:39:53.684006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:39:53.684006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:39:53.684006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:39:53.684006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:39:53.684006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:39:53.684006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:39:53.684006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:39:53.684006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:39:53.684006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7eb7c3e3-e134-4fbb-b497-e4e565c47533 could not be found. Oct 17 14:39:53.684006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:39:53.684006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:39:53.684006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:39:53.684006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:39:53.684006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:39:53.684006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:39:53.684006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:39:53.684006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:39:53.684006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:39:53.684006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:39:53.684006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:39:53.684006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:39:53.684006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:39:53.684006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:39:53.684006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:39:53.684006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:39:53.684006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7eb7c3e3-e134-4fbb-b497-e4e565c47533 could not be found. Oct 17 14:39:53.684006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:39:53.684006 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:39:53.689030 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:39:53.689030 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:39:53.689030 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:39:53.689030 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:39:53.689030 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:39:53.689030 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:39:53.689030 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7eb7c3e3-e134-4fbb-b497-e4e565c47533 could not be found. Oct 17 14:39:53.689030 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:39:53.689030 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-151fd83f-bd59-4d87-81f8-56a2f839c768 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Returning 404 to user: Instance 7eb7c3e3-e134-4fbb-b497-e4e565c47533 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:39:53.689030 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-151fd83f-bd59-4d87-81f8-56a2f839c768 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "GET /compute/v2.1/servers/7eb7c3e3-e134-4fbb-b497-e4e565c47533" status: 404 len: 111 microversion: 2.1 time: 0.033188 Oct 17 14:39:53.689030 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3389/6916] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:39:53 2022] GET /compute/v2.1/servers/7eb7c3e3-e134-4fbb-b497-e4e565c47533 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:39:53.694863 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c72fbf77-f6e9-4f95-a8f4-81ffa52cf286 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '.version_select at 0x7f7cd98829d0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:53.718906 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c72fbf77-f6e9-4f95-a8f4-81ffa52cf286 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1665151548" status: 202 len: 0 microversion: 2.1 time: 0.028284 Oct 17 14:39:53.719533 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3528/6917] 10.222.0.79 () {58 vars in 1278 bytes} [Mon Oct 17 14:39:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1665151548 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 14:39:53.739125 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2c532ac9-a294-4827-9ab9-a779ff6ffbba tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Action: 'create', calling method: .version_select at 0x7f7cd45820d0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1425590480", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIy6e7u5A81PqRCwD6rgGJFLug/Fu1wbFkeXPxuL5VxUZH2lha0MCd9rPkuCzznNyIYyrmhP+4//H097Zsxq+9DTCcpBi0NlAvmnQgsweScG8WNInwDEpiLNHpUnhrVKYQ=="}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:39:53.755219 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-2c532ac9-a294-4827-9ab9-a779ff6ffbba tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Getting quotas for project c92eab284e904607b8f6fefb7b904201. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:39:53.760682 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-2c532ac9-a294-4827-9ab9-a779ff6ffbba tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Getting quotas for user 8604f1505f984525a7ec4a1d072593c6 and project c92eab284e904607b8f6fefb7b904201. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:39:53.790199 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2c532ac9-a294-4827-9ab9-a779ff6ffbba tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.054799 Oct 17 14:39:53.791012 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3390/6918] 10.222.0.79 () {60 vars in 1159 bytes} [Mon Oct 17 14:39:53 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:39:53.841983 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a5200d8b-991d-458f-a402-44c196432e3b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1286524639", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1425590480", "networks": [{"uuid": "a18a45b5-55b9-432c-9b08-f922ce398921"}]}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:39:53.906893 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-a5200d8b-991d-458f-a402-44c196432e3b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] validate_networks() for [('a18a45b5-55b9-432c-9b08-f922ce398921', None, None, None, None, None)] {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:39:54.309104 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-a5200d8b-991d-458f-a402-44c196432e3b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:39:54.309534 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-a5200d8b-991d-458f-a402-44c196432e3b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:39:54.310013 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-a5200d8b-991d-458f-a402-44c196432e3b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:39:54.310420 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-a5200d8b-991d-458f-a402-44c196432e3b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:39:54.310830 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-a5200d8b-991d-458f-a402-44c196432e3b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:39:54.320743 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a5200d8b-991d-458f-a402-44c196432e3b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:54.321232 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a5200d8b-991d-458f-a402-44c196432e3b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:54.321654 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a5200d8b-991d-458f-a402-44c196432e3b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:54.322388 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a5200d8b-991d-458f-a402-44c196432e3b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:54.322844 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a5200d8b-991d-458f-a402-44c196432e3b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:54.323291 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a5200d8b-991d-458f-a402-44c196432e3b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:54.342463 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-a5200d8b-991d-458f-a402-44c196432e3b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Getting quotas for project c92eab284e904607b8f6fefb7b904201. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:39:54.348323 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-a5200d8b-991d-458f-a402-44c196432e3b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Getting quotas for user 8604f1505f984525a7ec4a1d072593c6 and project c92eab284e904607b8f6fefb7b904201. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:39:54.361720 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a5200d8b-991d-458f-a402-44c196432e3b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:39:54.364391 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a5200d8b-991d-458f-a402-44c196432e3b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 3ad555e4-c2d5-45cf-97e9-2183809ae1bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:39:54.418570 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a5200d8b-991d-458f-a402-44c196432e3b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.580575 Oct 17 14:39:54.419253 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3529/6919] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 14:39:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:39:54.430979 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7cd14c4b-ba47-4ce3-8fee-5b7ff443f3ca tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:54.431633 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7cd14c4b-ba47-4ce3-8fee-5b7ff443f3ca tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 3ad555e4-c2d5-45cf-97e9-2183809ae1bd] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:54.488610 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7cd14c4b-ba47-4ce3-8fee-5b7ff443f3ca tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8604f1505f984525a7ec4a1d072593c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92eab284e904607b8f6fefb7b904201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:39:54.495839 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7cd14c4b-ba47-4ce3-8fee-5b7ff443f3ca tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "GET /compute/v2.1/servers/3ad555e4-c2d5-45cf-97e9-2183809ae1bd" status: 200 len: 1263 microversion: 2.1 time: 0.068811 Oct 17 14:39:54.497370 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3391/6920] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:39:54 2022] GET /compute/v2.1/servers/3ad555e4-c2d5-45cf-97e9-2183809ae1bd => generated 1263 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:39:55.521832 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-08b2baea-4b5a-4089-aa7e-fc48949ea141 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:55.522486 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-08b2baea-4b5a-4089-aa7e-fc48949ea141 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 3ad555e4-c2d5-45cf-97e9-2183809ae1bd] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:55.530379 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-08b2baea-4b5a-4089-aa7e-fc48949ea141 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:55.530872 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-08b2baea-4b5a-4089-aa7e-fc48949ea141 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:55.531348 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-08b2baea-4b5a-4089-aa7e-fc48949ea141 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:55.532033 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-08b2baea-4b5a-4089-aa7e-fc48949ea141 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:55.532484 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-08b2baea-4b5a-4089-aa7e-fc48949ea141 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:55.532925 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-08b2baea-4b5a-4089-aa7e-fc48949ea141 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:55.602354 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-08b2baea-4b5a-4089-aa7e-fc48949ea141 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8604f1505f984525a7ec4a1d072593c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92eab284e904607b8f6fefb7b904201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:39:55.611677 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-08b2baea-4b5a-4089-aa7e-fc48949ea141 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "GET /compute/v2.1/servers/3ad555e4-c2d5-45cf-97e9-2183809ae1bd" status: 200 len: 1315 microversion: 2.1 time: 0.095535 Oct 17 14:39:55.612338 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3530/6921] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:39:55 2022] GET /compute/v2.1/servers/3ad555e4-c2d5-45cf-97e9-2183809ae1bd => generated 1315 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:39:56.634957 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a57710ec-2abf-4fa8-b4fb-b5aa93efd5e0 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:56.635613 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a57710ec-2abf-4fa8-b4fb-b5aa93efd5e0 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 3ad555e4-c2d5-45cf-97e9-2183809ae1bd] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:56.642965 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a57710ec-2abf-4fa8-b4fb-b5aa93efd5e0 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:56.643564 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a57710ec-2abf-4fa8-b4fb-b5aa93efd5e0 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:56.644071 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a57710ec-2abf-4fa8-b4fb-b5aa93efd5e0 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:56.644862 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a57710ec-2abf-4fa8-b4fb-b5aa93efd5e0 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:56.645379 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a57710ec-2abf-4fa8-b4fb-b5aa93efd5e0 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:56.645880 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a57710ec-2abf-4fa8-b4fb-b5aa93efd5e0 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:56.782161 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a57710ec-2abf-4fa8-b4fb-b5aa93efd5e0 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8604f1505f984525a7ec4a1d072593c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92eab284e904607b8f6fefb7b904201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:39:56.790301 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a57710ec-2abf-4fa8-b4fb-b5aa93efd5e0 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "GET /compute/v2.1/servers/3ad555e4-c2d5-45cf-97e9-2183809ae1bd" status: 200 len: 1363 microversion: 2.1 time: 0.159410 Oct 17 14:39:56.790917 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3392/6922] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:39:56 2022] GET /compute/v2.1/servers/3ad555e4-c2d5-45cf-97e9-2183809ae1bd => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:39:57.284571 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-71693706-5417-4dbd-9bd6-cef0bd4e8057 req-6a0693f3-e01d-4907-9247-6b5408c47ebd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ad555e4-c2d5-45cf-97e9-2183809ae1bd", "tag": "bfa489a3-ba75-42ee-8c4b-c7ce66e486d6"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:39:57.295790 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-71693706-5417-4dbd-9bd6-cef0bd4e8057 req-6a0693f3-e01d-4907-9247-6b5408c47ebd service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:57.296352 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-71693706-5417-4dbd-9bd6-cef0bd4e8057 req-6a0693f3-e01d-4907-9247-6b5408c47ebd service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:57.296851 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-71693706-5417-4dbd-9bd6-cef0bd4e8057 req-6a0693f3-e01d-4907-9247-6b5408c47ebd service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:57.308876 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-71693706-5417-4dbd-9bd6-cef0bd4e8057 req-6a0693f3-e01d-4907-9247-6b5408c47ebd service nova] Creating event network-changed:bfa489a3-ba75-42ee-8c4b-c7ce66e486d6 for instance 3ad555e4-c2d5-45cf-97e9-2183809ae1bd on n-h1-854247-14 Oct 17 14:39:57.314071 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-71693706-5417-4dbd-9bd6-cef0bd4e8057 req-6a0693f3-e01d-4907-9247-6b5408c47ebd service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033409 Oct 17 14:39:57.314945 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3531/6923] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:39:57.813547 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c402f805-bddd-440d-9fb6-0e44910279c5 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:57.814131 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c402f805-bddd-440d-9fb6-0e44910279c5 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 3ad555e4-c2d5-45cf-97e9-2183809ae1bd] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:57.821668 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c402f805-bddd-440d-9fb6-0e44910279c5 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:57.822246 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c402f805-bddd-440d-9fb6-0e44910279c5 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:57.822668 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c402f805-bddd-440d-9fb6-0e44910279c5 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:57.823408 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c402f805-bddd-440d-9fb6-0e44910279c5 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:57.823872 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c402f805-bddd-440d-9fb6-0e44910279c5 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:57.824308 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c402f805-bddd-440d-9fb6-0e44910279c5 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:57.955477 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c402f805-bddd-440d-9fb6-0e44910279c5 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8604f1505f984525a7ec4a1d072593c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92eab284e904607b8f6fefb7b904201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:39:57.963684 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c402f805-bddd-440d-9fb6-0e44910279c5 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "GET /compute/v2.1/servers/3ad555e4-c2d5-45cf-97e9-2183809ae1bd" status: 200 len: 1363 microversion: 2.1 time: 0.154313 Oct 17 14:39:57.964263 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3393/6924] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:39:57 2022] GET /compute/v2.1/servers/3ad555e4-c2d5-45cf-97e9-2183809ae1bd => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:39:58.990336 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-123ca05e-d136-4563-9226-aaf54dd7992b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:58.991049 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-123ca05e-d136-4563-9226-aaf54dd7992b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 3ad555e4-c2d5-45cf-97e9-2183809ae1bd] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:58.997645 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-123ca05e-d136-4563-9226-aaf54dd7992b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:58.998112 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-123ca05e-d136-4563-9226-aaf54dd7992b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:58.998583 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-123ca05e-d136-4563-9226-aaf54dd7992b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:58.999322 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-123ca05e-d136-4563-9226-aaf54dd7992b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:58.999781 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-123ca05e-d136-4563-9226-aaf54dd7992b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:59.000203 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-123ca05e-d136-4563-9226-aaf54dd7992b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:59.143225 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-123ca05e-d136-4563-9226-aaf54dd7992b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8604f1505f984525a7ec4a1d072593c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92eab284e904607b8f6fefb7b904201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:39:59.151203 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-123ca05e-d136-4563-9226-aaf54dd7992b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "GET /compute/v2.1/servers/3ad555e4-c2d5-45cf-97e9-2183809ae1bd" status: 200 len: 1363 microversion: 2.1 time: 0.168293 Oct 17 14:39:59.151871 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3532/6925] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:39:58 2022] GET /compute/v2.1/servers/3ad555e4-c2d5-45cf-97e9-2183809ae1bd => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:40:00.178007 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3f521657-dc46-42eb-83b6-2e9686eaa58a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:40:00.178633 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3f521657-dc46-42eb-83b6-2e9686eaa58a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 3ad555e4-c2d5-45cf-97e9-2183809ae1bd] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:40:00.190379 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f521657-dc46-42eb-83b6-2e9686eaa58a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:00.191152 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f521657-dc46-42eb-83b6-2e9686eaa58a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:00.191646 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f521657-dc46-42eb-83b6-2e9686eaa58a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:00.192363 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f521657-dc46-42eb-83b6-2e9686eaa58a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:00.192828 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f521657-dc46-42eb-83b6-2e9686eaa58a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:00.193272 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3f521657-dc46-42eb-83b6-2e9686eaa58a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:00.344950 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3f521657-dc46-42eb-83b6-2e9686eaa58a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8604f1505f984525a7ec4a1d072593c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92eab284e904607b8f6fefb7b904201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:40:00.353414 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3f521657-dc46-42eb-83b6-2e9686eaa58a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "GET /compute/v2.1/servers/3ad555e4-c2d5-45cf-97e9-2183809ae1bd" status: 200 len: 1363 microversion: 2.1 time: 0.182162 Oct 17 14:40:00.354003 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3394/6926] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:40:00 2022] GET /compute/v2.1/servers/3ad555e4-c2d5-45cf-97e9-2183809ae1bd => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:40:01.381565 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-69dccb39-4779-4dee-8140-cc74e97ce7d0 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:40:01.382403 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-69dccb39-4779-4dee-8140-cc74e97ce7d0 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 3ad555e4-c2d5-45cf-97e9-2183809ae1bd] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:40:01.394629 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-69dccb39-4779-4dee-8140-cc74e97ce7d0 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:01.395231 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-69dccb39-4779-4dee-8140-cc74e97ce7d0 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:01.395706 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-69dccb39-4779-4dee-8140-cc74e97ce7d0 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:01.396414 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-69dccb39-4779-4dee-8140-cc74e97ce7d0 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:01.396875 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-69dccb39-4779-4dee-8140-cc74e97ce7d0 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:01.397305 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-69dccb39-4779-4dee-8140-cc74e97ce7d0 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:01.537072 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-69dccb39-4779-4dee-8140-cc74e97ce7d0 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8604f1505f984525a7ec4a1d072593c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92eab284e904607b8f6fefb7b904201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:40:01.545545 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-69dccb39-4779-4dee-8140-cc74e97ce7d0 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "GET /compute/v2.1/servers/3ad555e4-c2d5-45cf-97e9-2183809ae1bd" status: 200 len: 1363 microversion: 2.1 time: 0.171095 Oct 17 14:40:01.546229 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3533/6927] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:40:01 2022] GET /compute/v2.1/servers/3ad555e4-c2d5-45cf-97e9-2183809ae1bd => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:40:02.475700 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-28c91226-d138-4c70-8912-97e181942ec1 req-5fbe70bc-b3c9-4575-8a1f-3de5ffbf3da1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ad555e4-c2d5-45cf-97e9-2183809ae1bd", "name": "network-vif-plugged", "status": "completed", "tag": "bfa489a3-ba75-42ee-8c4b-c7ce66e486d6"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:40:02.486392 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-28c91226-d138-4c70-8912-97e181942ec1 req-5fbe70bc-b3c9-4575-8a1f-3de5ffbf3da1 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:02.486884 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-28c91226-d138-4c70-8912-97e181942ec1 req-5fbe70bc-b3c9-4575-8a1f-3de5ffbf3da1 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:02.487385 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-28c91226-d138-4c70-8912-97e181942ec1 req-5fbe70bc-b3c9-4575-8a1f-3de5ffbf3da1 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:02.500694 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-28c91226-d138-4c70-8912-97e181942ec1 req-5fbe70bc-b3c9-4575-8a1f-3de5ffbf3da1 service nova] Creating event network-vif-plugged:bfa489a3-ba75-42ee-8c4b-c7ce66e486d6 for instance 3ad555e4-c2d5-45cf-97e9-2183809ae1bd on n-h1-854247-14 Oct 17 14:40:02.506773 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-28c91226-d138-4c70-8912-97e181942ec1 req-5fbe70bc-b3c9-4575-8a1f-3de5ffbf3da1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035015 Oct 17 14:40:02.507764 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3395/6928] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:40:02.567995 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-974d5734-64f7-4320-b824-5144f35badea tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:40:02.568730 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-974d5734-64f7-4320-b824-5144f35badea tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 3ad555e4-c2d5-45cf-97e9-2183809ae1bd] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:40:02.575749 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-974d5734-64f7-4320-b824-5144f35badea tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:02.576237 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-974d5734-64f7-4320-b824-5144f35badea tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:02.576672 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-974d5734-64f7-4320-b824-5144f35badea tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:02.577373 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-974d5734-64f7-4320-b824-5144f35badea tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:02.577824 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-974d5734-64f7-4320-b824-5144f35badea tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:02.578246 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-974d5734-64f7-4320-b824-5144f35badea tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:02.717085 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-974d5734-64f7-4320-b824-5144f35badea tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8604f1505f984525a7ec4a1d072593c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92eab284e904607b8f6fefb7b904201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:40:02.729167 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-974d5734-64f7-4320-b824-5144f35badea tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "GET /compute/v2.1/servers/3ad555e4-c2d5-45cf-97e9-2183809ae1bd" status: 200 len: 1363 microversion: 2.1 time: 0.165035 Oct 17 14:40:02.729969 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3534/6929] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:40:02 2022] GET /compute/v2.1/servers/3ad555e4-c2d5-45cf-97e9-2183809ae1bd => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:40:03.753200 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-779d1931-251e-4d94-926a-44b0481c7f63 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:40:03.754262 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-779d1931-251e-4d94-926a-44b0481c7f63 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 3ad555e4-c2d5-45cf-97e9-2183809ae1bd] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:40:03.762069 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-779d1931-251e-4d94-926a-44b0481c7f63 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:03.762558 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-779d1931-251e-4d94-926a-44b0481c7f63 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:03.763000 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-779d1931-251e-4d94-926a-44b0481c7f63 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:03.763735 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-779d1931-251e-4d94-926a-44b0481c7f63 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:03.764193 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-779d1931-251e-4d94-926a-44b0481c7f63 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:03.764619 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-779d1931-251e-4d94-926a-44b0481c7f63 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:03.897623 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-779d1931-251e-4d94-926a-44b0481c7f63 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8604f1505f984525a7ec4a1d072593c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92eab284e904607b8f6fefb7b904201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:40:03.905978 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-779d1931-251e-4d94-926a-44b0481c7f63 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "GET /compute/v2.1/servers/3ad555e4-c2d5-45cf-97e9-2183809ae1bd" status: 200 len: 1553 microversion: 2.1 time: 0.157168 Oct 17 14:40:03.906558 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3396/6930] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:40:03 2022] GET /compute/v2.1/servers/3ad555e4-c2d5-45cf-97e9-2183809ae1bd => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:40:03.928930 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6424fdf2-9e5f-4376-bb31-1ce041b1926c tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:40:03.929562 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6424fdf2-9e5f-4376-bb31-1ce041b1926c tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 3ad555e4-c2d5-45cf-97e9-2183809ae1bd] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:40:03.937003 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6424fdf2-9e5f-4376-bb31-1ce041b1926c tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:03.937492 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6424fdf2-9e5f-4376-bb31-1ce041b1926c tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:03.937931 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6424fdf2-9e5f-4376-bb31-1ce041b1926c tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:03.938635 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6424fdf2-9e5f-4376-bb31-1ce041b1926c tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:03.939092 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6424fdf2-9e5f-4376-bb31-1ce041b1926c tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:03.939553 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6424fdf2-9e5f-4376-bb31-1ce041b1926c tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:04.079684 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6424fdf2-9e5f-4376-bb31-1ce041b1926c tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8604f1505f984525a7ec4a1d072593c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92eab284e904607b8f6fefb7b904201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:40:04.088043 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6424fdf2-9e5f-4376-bb31-1ce041b1926c tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "GET /compute/v2.1/servers/3ad555e4-c2d5-45cf-97e9-2183809ae1bd" status: 200 len: 1553 microversion: 2.1 time: 0.163429 Oct 17 14:40:04.088624 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3535/6931] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:40:03 2022] GET /compute/v2.1/servers/3ad555e4-c2d5-45cf-97e9-2183809ae1bd => generated 1553 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:40:05.633762 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d3d6a106-48ca-46bf-9dd2-c6103ed1843a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "03c01958-2d69-4f60-a114-12ac1884a064"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:40:05.636225 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d3d6a106-48ca-46bf-9dd2-c6103ed1843a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 3ad555e4-c2d5-45cf-97e9-2183809ae1bd] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:40:05.638224 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=6 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:40:05.644678 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d3d6a106-48ca-46bf-9dd2-c6103ed1843a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:05.645095 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d3d6a106-48ca-46bf-9dd2-c6103ed1843a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:05.645593 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d3d6a106-48ca-46bf-9dd2-c6103ed1843a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:05.646561 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d3d6a106-48ca-46bf-9dd2-c6103ed1843a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:05.647075 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d3d6a106-48ca-46bf-9dd2-c6103ed1843a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:05.647542 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d3d6a106-48ca-46bf-9dd2-c6103ed1843a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:05.916008 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d3d6a106-48ca-46bf-9dd2-c6103ed1843a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "POST /compute/v2.1/servers/3ad555e4-c2d5-45cf-97e9-2183809ae1bd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286060 Oct 17 14:40:05.916546 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3397/6932] 10.222.0.79 () {60 vars in 1323 bytes} [Mon Oct 17 14:40:05 2022] POST /compute/v2.1/servers/3ad555e4-c2d5-45cf-97e9-2183809ae1bd/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:40:16.732815 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9fbd50e0-d929-4ade-a16d-364ac9c7526c tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:40:16.733360 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9fbd50e0-d929-4ade-a16d-364ac9c7526c tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 3ad555e4-c2d5-45cf-97e9-2183809ae1bd] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:40:16.735741 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:40:16.736417 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=6 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:40:16.737138 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:40:16.737851 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:40:16.744525 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9fbd50e0-d929-4ade-a16d-364ac9c7526c tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:16.745016 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9fbd50e0-d929-4ade-a16d-364ac9c7526c tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:16.745452 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9fbd50e0-d929-4ade-a16d-364ac9c7526c tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:16.746153 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9fbd50e0-d929-4ade-a16d-364ac9c7526c tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:16.746605 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9fbd50e0-d929-4ade-a16d-364ac9c7526c tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:16.747026 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9fbd50e0-d929-4ade-a16d-364ac9c7526c tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:16.838337 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-9fbd50e0-d929-4ade-a16d-364ac9c7526c tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lazy-loading 'services' on Instance uuid 3ad555e4-c2d5-45cf-97e9-2183809ae1bd {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:40:16.925143 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9fbd50e0-d929-4ade-a16d-364ac9c7526c tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3ad555e4-c2d5-45cf-97e9-2183809ae1bd/os-volume_attachments/03c01958-2d69-4f60-a114-12ac1884a064" status: 202 len: 0 microversion: 2.1 time: 0.196022 Oct 17 14:40:16.926011 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3536/6933] 10.222.0.79 () {58 vars in 1416 bytes} [Mon Oct 17 14:40:16 2022] DELETE /compute/v2.1/servers/3ad555e4-c2d5-45cf-97e9-2183809ae1bd/os-volume_attachments/03c01958-2d69-4f60-a114-12ac1884a064 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:40:16.933112 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:40:16.933947 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:40:16.938395 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-34ee3c55-59ce-4196-ac79-f5ced618d2d9 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:40:16.940837 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-34ee3c55-59ce-4196-ac79-f5ced618d2d9 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 3ad555e4-c2d5-45cf-97e9-2183809ae1bd] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:40:16.948778 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-34ee3c55-59ce-4196-ac79-f5ced618d2d9 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:16.949292 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-34ee3c55-59ce-4196-ac79-f5ced618d2d9 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:16.949703 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-34ee3c55-59ce-4196-ac79-f5ced618d2d9 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:16.950443 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-34ee3c55-59ce-4196-ac79-f5ced618d2d9 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:16.950881 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-34ee3c55-59ce-4196-ac79-f5ced618d2d9 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:16.951328 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-34ee3c55-59ce-4196-ac79-f5ced618d2d9 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:16.983693 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-34ee3c55-59ce-4196-ac79-f5ced618d2d9 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "GET /compute/v2.1/servers/3ad555e4-c2d5-45cf-97e9-2183809ae1bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052527 Oct 17 14:40:16.984266 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3398/6934] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 14:40:16 2022] GET /compute/v2.1/servers/3ad555e4-c2d5-45cf-97e9-2183809ae1bd/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:40:17.998779 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ac98b30a-40e0-486d-a990-c16817a75eb1 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:40:18.001335 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ac98b30a-40e0-486d-a990-c16817a75eb1 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 3ad555e4-c2d5-45cf-97e9-2183809ae1bd] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:40:18.008593 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ac98b30a-40e0-486d-a990-c16817a75eb1 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:18.009072 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ac98b30a-40e0-486d-a990-c16817a75eb1 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:18.009508 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ac98b30a-40e0-486d-a990-c16817a75eb1 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:18.010208 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ac98b30a-40e0-486d-a990-c16817a75eb1 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:18.010664 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ac98b30a-40e0-486d-a990-c16817a75eb1 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:18.011052 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ac98b30a-40e0-486d-a990-c16817a75eb1 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:18.043332 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ac98b30a-40e0-486d-a990-c16817a75eb1 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "GET /compute/v2.1/servers/3ad555e4-c2d5-45cf-97e9-2183809ae1bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049835 Oct 17 14:40:18.043913 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3537/6935] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 14:40:17 2022] GET /compute/v2.1/servers/3ad555e4-c2d5-45cf-97e9-2183809ae1bd/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:40:19.055454 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c90e9d9b-df36-420e-991a-9694d55b438b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:40:19.057776 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c90e9d9b-df36-420e-991a-9694d55b438b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 3ad555e4-c2d5-45cf-97e9-2183809ae1bd] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:40:19.065248 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c90e9d9b-df36-420e-991a-9694d55b438b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:19.065749 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c90e9d9b-df36-420e-991a-9694d55b438b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:19.066194 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c90e9d9b-df36-420e-991a-9694d55b438b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:19.066910 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c90e9d9b-df36-420e-991a-9694d55b438b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:19.067573 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c90e9d9b-df36-420e-991a-9694d55b438b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:19.067832 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c90e9d9b-df36-420e-991a-9694d55b438b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:19.107595 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c90e9d9b-df36-420e-991a-9694d55b438b tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "GET /compute/v2.1/servers/3ad555e4-c2d5-45cf-97e9-2183809ae1bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055876 Oct 17 14:40:19.108518 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3399/6936] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 14:40:19 2022] GET /compute/v2.1/servers/3ad555e4-c2d5-45cf-97e9-2183809ae1bd/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:40:20.120760 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2cf08ff4-0bb5-465e-b1b1-8c4c099fa76d tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:40:20.123253 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2cf08ff4-0bb5-465e-b1b1-8c4c099fa76d tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 3ad555e4-c2d5-45cf-97e9-2183809ae1bd] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:40:20.131154 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2cf08ff4-0bb5-465e-b1b1-8c4c099fa76d tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:20.131693 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2cf08ff4-0bb5-465e-b1b1-8c4c099fa76d tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:20.132126 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2cf08ff4-0bb5-465e-b1b1-8c4c099fa76d tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:20.132920 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2cf08ff4-0bb5-465e-b1b1-8c4c099fa76d tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:20.133326 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2cf08ff4-0bb5-465e-b1b1-8c4c099fa76d tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:20.133747 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2cf08ff4-0bb5-465e-b1b1-8c4c099fa76d tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:20.168082 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2cf08ff4-0bb5-465e-b1b1-8c4c099fa76d tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "GET /compute/v2.1/servers/3ad555e4-c2d5-45cf-97e9-2183809ae1bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051538 Oct 17 14:40:20.168652 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3538/6937] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 14:40:20 2022] GET /compute/v2.1/servers/3ad555e4-c2d5-45cf-97e9-2183809ae1bd/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:40:21.181387 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ec0e6f6b-20ff-41f8-9745-cf14db104294 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:40:21.183618 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ec0e6f6b-20ff-41f8-9745-cf14db104294 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 3ad555e4-c2d5-45cf-97e9-2183809ae1bd] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:40:21.190970 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ec0e6f6b-20ff-41f8-9745-cf14db104294 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:21.191514 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ec0e6f6b-20ff-41f8-9745-cf14db104294 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:21.191965 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ec0e6f6b-20ff-41f8-9745-cf14db104294 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:21.192677 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ec0e6f6b-20ff-41f8-9745-cf14db104294 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:21.193145 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ec0e6f6b-20ff-41f8-9745-cf14db104294 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:21.193581 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ec0e6f6b-20ff-41f8-9745-cf14db104294 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:21.228552 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ec0e6f6b-20ff-41f8-9745-cf14db104294 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "GET /compute/v2.1/servers/3ad555e4-c2d5-45cf-97e9-2183809ae1bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051587 Oct 17 14:40:21.229139 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3400/6938] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 14:40:21 2022] GET /compute/v2.1/servers/3ad555e4-c2d5-45cf-97e9-2183809ae1bd/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:40:22.243550 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fe72f501-eacc-4974-a59b-acaaa35fef68 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:40:22.245774 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-fe72f501-eacc-4974-a59b-acaaa35fef68 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 3ad555e4-c2d5-45cf-97e9-2183809ae1bd] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:40:22.253813 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe72f501-eacc-4974-a59b-acaaa35fef68 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:22.254290 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe72f501-eacc-4974-a59b-acaaa35fef68 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:22.254723 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe72f501-eacc-4974-a59b-acaaa35fef68 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:22.255429 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe72f501-eacc-4974-a59b-acaaa35fef68 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:22.255872 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe72f501-eacc-4974-a59b-acaaa35fef68 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:22.256284 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe72f501-eacc-4974-a59b-acaaa35fef68 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:22.287591 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fe72f501-eacc-4974-a59b-acaaa35fef68 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "GET /compute/v2.1/servers/3ad555e4-c2d5-45cf-97e9-2183809ae1bd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049922 Oct 17 14:40:22.288135 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3539/6939] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 14:40:22 2022] GET /compute/v2.1/servers/3ad555e4-c2d5-45cf-97e9-2183809ae1bd/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 14:40:22.305164 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7588e125-b22b-4c37-9cd9-897ad9a62430 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:40:22.305715 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7588e125-b22b-4c37-9cd9-897ad9a62430 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 3ad555e4-c2d5-45cf-97e9-2183809ae1bd] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:40:22.313539 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7588e125-b22b-4c37-9cd9-897ad9a62430 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:22.314042 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7588e125-b22b-4c37-9cd9-897ad9a62430 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:22.314495 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7588e125-b22b-4c37-9cd9-897ad9a62430 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:22.315385 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7588e125-b22b-4c37-9cd9-897ad9a62430 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:22.315854 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7588e125-b22b-4c37-9cd9-897ad9a62430 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:22.316295 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7588e125-b22b-4c37-9cd9-897ad9a62430 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:22.397174 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-7588e125-b22b-4c37-9cd9-897ad9a62430 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] HTTP exception thrown: Instance 3ad555e4-c2d5-45cf-97e9-2183809ae1bd is not attached to volume 03c01958-2d69-4f60-a114-12ac1884a064 Oct 17 14:40:22.399707 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7588e125-b22b-4c37-9cd9-897ad9a62430 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Request method failure captured: Oct 17 14:40:22.399707 n-d-854247-14 devstack@n-api.service[127017]: request: DELETE /compute/v2.1/servers/3ad555e4-c2d5-45cf-97e9-2183809ae1bd/os-volume_attachments/03c01958-2d69-4f60-a114-12ac1884a064 HTTP/1.1 Oct 17 14:40:22.399707 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 14:40:22.399707 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 14:40:22.399707 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 14:40:22.399707 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 14:40:22.399707 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 14:40:22.399707 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 14:40:22.399707 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 14:40:22.399707 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 14:40:22.399707 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTWjsqBGADzJouBjurtPzzg1tjgTb4pF7ozl_UbNOj6xqAayKaN28B7_cAUIuqtlGsqMyQlPIkrkOBuPZ_VNr6tixUAoQxR7yaDztHi2BQhbxFD0oU5Fgh22yeXgEYdm_hkQwuX9-HS_BdmqxWZK_p4j4oylciWhdk3H-GqayhBBiNcU Oct 17 14:40:22.399707 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 14:40:22.399707 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 14:40:22.399707 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 14:40:22.399707 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 14:40:22.399707 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 14:40:22.399707 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 14:40:22.399707 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: c92eab284e904607b8f6fefb7b904201 Oct 17 14:40:22.399707 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-TestEncryptedCinderVolumes-2016754020 Oct 17 14:40:22.399707 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 14:40:22.399707 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 14:40:22.399707 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c92eab284e904607b8f6fefb7b904201"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c92eab284e904607b8f6fefb7b904201"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c92eab284e904607b8f6fefb7b904201"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c92eab284e904607b8f6fefb7b904201", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:40:22.399707 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-TestEncryptedCinderVolumes-2016754020 Oct 17 14:40:22.399707 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: c92eab284e904607b8f6fefb7b904201 Oct 17 14:40:22.399707 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-2016754020 Oct 17 14:40:22.399707 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-TestEncryptedCinderVolumes-2016754020-project Oct 17 14:40:22.399707 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 14:40:22.399707 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 14:40:22.399707 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 8604f1505f984525a7ec4a1d072593c6 Oct 17 14:40:22.399707 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-TestEncryptedCinderVolumes-2016754020-project Oct 17 14:40:22.399707 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 14:40:22.399707 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 3ad555e4-c2d5-45cf-97e9-2183809ae1bd is not attached to volume 03c01958-2d69-4f60-a114-12ac1884a064 Oct 17 14:40:22.399707 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'server_id': '3ad555e4-c2d5-45cf-97e9-2183809ae1bd', 'id': '03c01958-2d69-4f60-a114-12ac1884a064'} Oct 17 14:40:22.399707 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:40:22.399707 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:40:22.399707 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 17 14:40:22.399707 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 17 14:40:22.399707 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 14:40:22.399707 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 14:40:22.399707 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 17 14:40:22.399707 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 17 14:40:22.399707 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 03c01958-2d69-4f60-a114-12ac1884a064. Oct 17 14:40:22.399707 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:40:22.399707 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:40:22.399707 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:40:22.399707 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:40:22.399707 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:40:22.399707 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:40:22.399707 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:40:22.399707 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:40:22.399707 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:40:22.399707 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:40:22.399707 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 17 14:40:22.399707 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 17 14:40:22.399707 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ad555e4-c2d5-45cf-97e9-2183809ae1bd is not attached to volume 03c01958-2d69-4f60-a114-12ac1884a064 Oct 17 14:40:22.399707 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:40:22.399707 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:40:22.399707 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:40:22.399707 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:40:22.399707 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:40:22.399707 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:40:22.404203 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:40:22.404203 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:40:22.404203 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ad555e4-c2d5-45cf-97e9-2183809ae1bd is not attached to volume 03c01958-2d69-4f60-a114-12ac1884a064 Oct 17 14:40:22.404203 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:40:22.404203 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7588e125-b22b-4c37-9cd9-897ad9a62430 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Returning 404 to user: Instance 3ad555e4-c2d5-45cf-97e9-2183809ae1bd is not attached to volume 03c01958-2d69-4f60-a114-12ac1884a064 {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:40:22.404203 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7588e125-b22b-4c37-9cd9-897ad9a62430 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3ad555e4-c2d5-45cf-97e9-2183809ae1bd/os-volume_attachments/03c01958-2d69-4f60-a114-12ac1884a064" status: 404 len: 154 microversion: 2.1 time: 0.102602 Oct 17 14:40:22.404203 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3401/6940] 10.222.0.79 () {58 vars in 1416 bytes} [Mon Oct 17 14:40:22 2022] DELETE /compute/v2.1/servers/3ad555e4-c2d5-45cf-97e9-2183809ae1bd/os-volume_attachments/03c01958-2d69-4f60-a114-12ac1884a064 => generated 154 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:40:25.767536 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-04e9b7b4-3f73-4570-a2cf-6fadc2496442 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:40:25.768129 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-04e9b7b4-3f73-4570-a2cf-6fadc2496442 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 3ad555e4-c2d5-45cf-97e9-2183809ae1bd] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:40:25.776306 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-04e9b7b4-3f73-4570-a2cf-6fadc2496442 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:25.776806 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-04e9b7b4-3f73-4570-a2cf-6fadc2496442 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:25.777250 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-04e9b7b4-3f73-4570-a2cf-6fadc2496442 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:25.777965 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-04e9b7b4-3f73-4570-a2cf-6fadc2496442 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:25.778415 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-04e9b7b4-3f73-4570-a2cf-6fadc2496442 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:25.778840 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-04e9b7b4-3f73-4570-a2cf-6fadc2496442 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:25.809297 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-04e9b7b4-3f73-4570-a2cf-6fadc2496442 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 3ad555e4-c2d5-45cf-97e9-2183809ae1bd] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:40:25.904531 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-04e9b7b4-3f73-4570-a2cf-6fadc2496442 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3ad555e4-c2d5-45cf-97e9-2183809ae1bd" status: 204 len: 0 microversion: 2.1 time: 0.140545 Oct 17 14:40:25.905425 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3540/6941] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:40:25 2022] DELETE /compute/v2.1/servers/3ad555e4-c2d5-45cf-97e9-2183809ae1bd => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:40:25.914020 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-49ccd075-0cd8-453e-8b4b-179d6873854a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:40:25.914673 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-49ccd075-0cd8-453e-8b4b-179d6873854a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 3ad555e4-c2d5-45cf-97e9-2183809ae1bd] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:40:25.924341 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-49ccd075-0cd8-453e-8b4b-179d6873854a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:25.926099 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-49ccd075-0cd8-453e-8b4b-179d6873854a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:25.926693 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-49ccd075-0cd8-453e-8b4b-179d6873854a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:25.927377 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-49ccd075-0cd8-453e-8b4b-179d6873854a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:25.927847 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-49ccd075-0cd8-453e-8b4b-179d6873854a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:25.928281 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-49ccd075-0cd8-453e-8b4b-179d6873854a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:26.060220 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-49ccd075-0cd8-453e-8b4b-179d6873854a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8604f1505f984525a7ec4a1d072593c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92eab284e904607b8f6fefb7b904201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:40:26.068406 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-49ccd075-0cd8-453e-8b4b-179d6873854a tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "GET /compute/v2.1/servers/3ad555e4-c2d5-45cf-97e9-2183809ae1bd" status: 200 len: 1559 microversion: 2.1 time: 0.158451 Oct 17 14:40:26.069098 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3402/6942] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:40:25 2022] GET /compute/v2.1/servers/3ad555e4-c2d5-45cf-97e9-2183809ae1bd => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:40:27.097909 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c803eb94-7ccd-42ea-b706-ac41394870f4 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:40:27.099788 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c803eb94-7ccd-42ea-b706-ac41394870f4 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 3ad555e4-c2d5-45cf-97e9-2183809ae1bd] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:40:27.107655 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c803eb94-7ccd-42ea-b706-ac41394870f4 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:27.108139 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c803eb94-7ccd-42ea-b706-ac41394870f4 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:27.108573 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c803eb94-7ccd-42ea-b706-ac41394870f4 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:27.109282 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c803eb94-7ccd-42ea-b706-ac41394870f4 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:27.109736 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c803eb94-7ccd-42ea-b706-ac41394870f4 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:27.110158 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c803eb94-7ccd-42ea-b706-ac41394870f4 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:27.252146 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c803eb94-7ccd-42ea-b706-ac41394870f4 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8604f1505f984525a7ec4a1d072593c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92eab284e904607b8f6fefb7b904201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:40:27.261635 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c803eb94-7ccd-42ea-b706-ac41394870f4 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "GET /compute/v2.1/servers/3ad555e4-c2d5-45cf-97e9-2183809ae1bd" status: 200 len: 1559 microversion: 2.1 time: 0.171501 Oct 17 14:40:27.262261 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3541/6943] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:40:27 2022] GET /compute/v2.1/servers/3ad555e4-c2d5-45cf-97e9-2183809ae1bd => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:40:27.985801 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-8af80520-b59e-44c3-bafc-3ae0ab8a9a0c req-a3338ecc-675c-4ab0-a253-622f28a8a91a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ad555e4-c2d5-45cf-97e9-2183809ae1bd", "name": "network-vif-deleted", "tag": "bfa489a3-ba75-42ee-8c4b-c7ce66e486d6"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:40:28.000001 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-8af80520-b59e-44c3-bafc-3ae0ab8a9a0c req-a3338ecc-675c-4ab0-a253-622f28a8a91a service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:28.000480 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-8af80520-b59e-44c3-bafc-3ae0ab8a9a0c req-a3338ecc-675c-4ab0-a253-622f28a8a91a service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:28.000938 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-8af80520-b59e-44c3-bafc-3ae0ab8a9a0c req-a3338ecc-675c-4ab0-a253-622f28a8a91a service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:28.014706 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-8af80520-b59e-44c3-bafc-3ae0ab8a9a0c req-a3338ecc-675c-4ab0-a253-622f28a8a91a service nova] Creating event network-vif-deleted:bfa489a3-ba75-42ee-8c4b-c7ce66e486d6 for instance 3ad555e4-c2d5-45cf-97e9-2183809ae1bd on n-h1-854247-14 Oct 17 14:40:28.019777 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-8af80520-b59e-44c3-bafc-3ae0ab8a9a0c req-a3338ecc-675c-4ab0-a253-622f28a8a91a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037945 Oct 17 14:40:28.020375 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3403/6944] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:40:28.285729 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-88603eb0-7f02-48e1-9cc3-aaf061f50004 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:40:28.286562 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-88603eb0-7f02-48e1-9cc3-aaf061f50004 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 3ad555e4-c2d5-45cf-97e9-2183809ae1bd] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:40:28.294247 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-88603eb0-7f02-48e1-9cc3-aaf061f50004 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:28.294849 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-88603eb0-7f02-48e1-9cc3-aaf061f50004 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:28.295322 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-88603eb0-7f02-48e1-9cc3-aaf061f50004 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:28.296054 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-88603eb0-7f02-48e1-9cc3-aaf061f50004 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:28.296543 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-88603eb0-7f02-48e1-9cc3-aaf061f50004 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:28.296969 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-88603eb0-7f02-48e1-9cc3-aaf061f50004 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:28.330732 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-88603eb0-7f02-48e1-9cc3-aaf061f50004 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:28.331243 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-88603eb0-7f02-48e1-9cc3-aaf061f50004 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:28.331685 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-88603eb0-7f02-48e1-9cc3-aaf061f50004 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:28.332147 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-88603eb0-7f02-48e1-9cc3-aaf061f50004 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lazy-loading 'fault' on Instance uuid 3ad555e4-c2d5-45cf-97e9-2183809ae1bd {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:40:28.380479 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-88603eb0-7f02-48e1-9cc3-aaf061f50004 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8604f1505f984525a7ec4a1d072593c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92eab284e904607b8f6fefb7b904201', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:40:28.388900 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-88603eb0-7f02-48e1-9cc3-aaf061f50004 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "GET /compute/v2.1/servers/3ad555e4-c2d5-45cf-97e9-2183809ae1bd" status: 200 len: 1353 microversion: 2.1 time: 0.107164 Oct 17 14:40:28.389495 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3542/6945] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:40:28 2022] GET /compute/v2.1/servers/3ad555e4-c2d5-45cf-97e9-2183809ae1bd => generated 1353 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:40:29.415335 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9b2f0cea-6000-45f1-8af1-ea68b9e91225 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:40:29.415923 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9b2f0cea-6000-45f1-8af1-ea68b9e91225 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] [instance: 3ad555e4-c2d5-45cf-97e9-2183809ae1bd] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:40:29.422820 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9b2f0cea-6000-45f1-8af1-ea68b9e91225 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:29.423348 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9b2f0cea-6000-45f1-8af1-ea68b9e91225 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:29.423793 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9b2f0cea-6000-45f1-8af1-ea68b9e91225 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:29.424488 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9b2f0cea-6000-45f1-8af1-ea68b9e91225 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:29.424944 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9b2f0cea-6000-45f1-8af1-ea68b9e91225 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:29.425374 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9b2f0cea-6000-45f1-8af1-ea68b9e91225 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:29.439025 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-9b2f0cea-6000-45f1-8af1-ea68b9e91225 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] HTTP exception thrown: Instance 3ad555e4-c2d5-45cf-97e9-2183809ae1bd could not be found. Oct 17 14:40:29.440804 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9b2f0cea-6000-45f1-8af1-ea68b9e91225 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Request method failure captured: Oct 17 14:40:29.440804 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/3ad555e4-c2d5-45cf-97e9-2183809ae1bd HTTP/1.1 Oct 17 14:40:29.440804 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 14:40:29.440804 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 14:40:29.440804 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 14:40:29.440804 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 14:40:29.440804 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 14:40:29.440804 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 14:40:29.440804 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 14:40:29.440804 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 14:40:29.440804 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTWjsqBGADzJouBjurtPzzg1tjgTb4pF7ozl_UbNOj6xqAayKaN28B7_cAUIuqtlGsqMyQlPIkrkOBuPZ_VNr6tixUAoQxR7yaDztHi2BQhbxFD0oU5Fgh22yeXgEYdm_hkQwuX9-HS_BdmqxWZK_p4j4oylciWhdk3H-GqayhBBiNcU Oct 17 14:40:29.440804 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 14:40:29.440804 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 14:40:29.440804 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 14:40:29.440804 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 14:40:29.440804 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 14:40:29.440804 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 14:40:29.440804 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: c92eab284e904607b8f6fefb7b904201 Oct 17 14:40:29.440804 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-TestEncryptedCinderVolumes-2016754020 Oct 17 14:40:29.440804 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 14:40:29.440804 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 14:40:29.440804 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c92eab284e904607b8f6fefb7b904201"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c92eab284e904607b8f6fefb7b904201"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c92eab284e904607b8f6fefb7b904201"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c92eab284e904607b8f6fefb7b904201", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:40:29.440804 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-TestEncryptedCinderVolumes-2016754020 Oct 17 14:40:29.440804 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: c92eab284e904607b8f6fefb7b904201 Oct 17 14:40:29.440804 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-2016754020 Oct 17 14:40:29.440804 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-TestEncryptedCinderVolumes-2016754020-project Oct 17 14:40:29.440804 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 14:40:29.440804 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 14:40:29.440804 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 8604f1505f984525a7ec4a1d072593c6 Oct 17 14:40:29.440804 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-TestEncryptedCinderVolumes-2016754020-project Oct 17 14:40:29.440804 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 14:40:29.440804 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 3ad555e4-c2d5-45cf-97e9-2183809ae1bd could not be found. Oct 17 14:40:29.440804 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '3ad555e4-c2d5-45cf-97e9-2183809ae1bd'} Oct 17 14:40:29.440804 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:40:29.440804 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:40:29.440804 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:40:29.440804 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:40:29.440804 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:40:29.440804 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:40:29.440804 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:40:29.440804 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:40:29.440804 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:40:29.440804 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:40:29.440804 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ad555e4-c2d5-45cf-97e9-2183809ae1bd could not be found. Oct 17 14:40:29.440804 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:40:29.440804 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:40:29.440804 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:40:29.440804 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:40:29.440804 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:40:29.440804 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:40:29.440804 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:40:29.440804 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:40:29.440804 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:40:29.440804 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:40:29.440804 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:40:29.440804 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:40:29.440804 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:40:29.440804 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:40:29.440804 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:40:29.440804 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:40:29.440804 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ad555e4-c2d5-45cf-97e9-2183809ae1bd could not be found. Oct 17 14:40:29.440804 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:40:29.440804 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:40:29.446605 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:40:29.446605 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:40:29.446605 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:40:29.446605 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:40:29.446605 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:40:29.446605 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:40:29.446605 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ad555e4-c2d5-45cf-97e9-2183809ae1bd could not be found. Oct 17 14:40:29.446605 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:40:29.446605 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9b2f0cea-6000-45f1-8af1-ea68b9e91225 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Returning 404 to user: Instance 3ad555e4-c2d5-45cf-97e9-2183809ae1bd could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:40:29.446605 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9b2f0cea-6000-45f1-8af1-ea68b9e91225 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "GET /compute/v2.1/servers/3ad555e4-c2d5-45cf-97e9-2183809ae1bd" status: 404 len: 111 microversion: 2.1 time: 0.032575 Oct 17 14:40:29.446605 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3404/6946] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:40:29 2022] GET /compute/v2.1/servers/3ad555e4-c2d5-45cf-97e9-2183809ae1bd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:40:29.452179 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b81be9b7-4e88-497a-bb1c-bc3f22ad5447 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] Calling method '.version_select at 0x7f7cd4d8e280>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:40:29.477167 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b81be9b7-4e88-497a-bb1c-bc3f22ad5447 tempest-TestEncryptedCinderVolumes-2016754020 tempest-TestEncryptedCinderVolumes-2016754020-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1425590480" status: 202 len: 0 microversion: 2.1 time: 0.029603 Oct 17 14:40:29.477786 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3543/6947] 10.222.0.79 () {58 vars in 1278 bytes} [Mon Oct 17 14:40:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1425590480 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:40:56.866700 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2603425e-4574-4c21-899f-9c2ed6157351 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Action: 'create', calling method: .version_select at 0x7f7cd4526430>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-694307239", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMT/4u4TAR0PKcuGlHAd6QpYbMNN962hzm3KJnx+kPhLPTwbMNntcKnVX/7HZWLAqVZ9AxwUboWe8pdkRUwljrGA6SJ+ALUmb8yRQbujqgJWd+762KrnlaG/8k0kFZ67Jw=="}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:40:56.873019 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=14 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:40:56.873692 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=34 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:40:56.887401 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-2603425e-4574-4c21-899f-9c2ed6157351 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Getting quotas for project 6c27ab2952064d1ab714d1b4f7ef7c96. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:40:56.893596 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-2603425e-4574-4c21-899f-9c2ed6157351 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Getting quotas for user d2f1309abebb4778a8a907cd6c8142c3 and project 6c27ab2952064d1ab714d1b4f7ef7c96. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:40:56.920774 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2603425e-4574-4c21-899f-9c2ed6157351 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.058157 Oct 17 14:40:56.921390 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3405/6948] 10.222.0.79 () {60 vars in 1159 bytes} [Mon Oct 17 14:40:56 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:40:56.978162 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b007b7f7-ed4f-424d-a61b-c66013c315e3 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1614394229", "imageRef": "52abb834-9236-47eb-9b8a-9d29a4e74567", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-694307239", "networks": [{"uuid": "96c3205b-371b-45a2-b1ff-0cafff6ddcad"}]}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:40:56.987870 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:40:56.988525 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:40:57.038791 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-b007b7f7-ed4f-424d-a61b-c66013c315e3 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] validate_networks() for [('96c3205b-371b-45a2-b1ff-0cafff6ddcad', None, None, None, None, None)] {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:40:57.460810 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-b007b7f7-ed4f-424d-a61b-c66013c315e3 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:40:57.461559 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-b007b7f7-ed4f-424d-a61b-c66013c315e3 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:40:57.462046 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-b007b7f7-ed4f-424d-a61b-c66013c315e3 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:40:57.462458 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-b007b7f7-ed4f-424d-a61b-c66013c315e3 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:40:57.462903 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-b007b7f7-ed4f-424d-a61b-c66013c315e3 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:40:57.473246 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b007b7f7-ed4f-424d-a61b-c66013c315e3 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:57.473730 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b007b7f7-ed4f-424d-a61b-c66013c315e3 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:57.474170 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b007b7f7-ed4f-424d-a61b-c66013c315e3 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:57.474904 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b007b7f7-ed4f-424d-a61b-c66013c315e3 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:57.475382 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b007b7f7-ed4f-424d-a61b-c66013c315e3 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:57.475806 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b007b7f7-ed4f-424d-a61b-c66013c315e3 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:57.493944 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-b007b7f7-ed4f-424d-a61b-c66013c315e3 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Getting quotas for project 6c27ab2952064d1ab714d1b4f7ef7c96. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:40:57.499639 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-b007b7f7-ed4f-424d-a61b-c66013c315e3 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Getting quotas for user d2f1309abebb4778a8a907cd6c8142c3 and project 6c27ab2952064d1ab714d1b4f7ef7c96. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:40:57.513913 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b007b7f7-ed4f-424d-a61b-c66013c315e3 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:40:57.516139 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b007b7f7-ed4f-424d-a61b-c66013c315e3 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 6e31b320-2cca-4ecc-9577-dcd0f2c55771] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='52abb834-9236-47eb-9b8a-9d29a4e74567',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:40:57.564869 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b007b7f7-ed4f-424d-a61b-c66013c315e3 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.592940 Oct 17 14:40:57.565528 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3544/6949] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 14:40:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:40:57.576904 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-02ac1d31-147b-49af-9d5c-b75883c0ea10 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:40:57.577571 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-02ac1d31-147b-49af-9d5c-b75883c0ea10 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 6e31b320-2cca-4ecc-9577-dcd0f2c55771] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:40:57.646333 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-02ac1d31-147b-49af-9d5c-b75883c0ea10 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f1309abebb4778a8a907cd6c8142c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:40:57.654006 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-02ac1d31-147b-49af-9d5c-b75883c0ea10 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771" status: 200 len: 1258 microversion: 2.1 time: 0.081175 Oct 17 14:40:57.654612 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3406/6950] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:40:57 2022] GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771 => generated 1258 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:40:58.681339 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b64ca53a-5cc0-4ea3-a23a-1958b59f26cf tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:40:58.682051 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b64ca53a-5cc0-4ea3-a23a-1958b59f26cf tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 6e31b320-2cca-4ecc-9577-dcd0f2c55771] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:40:58.690394 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b64ca53a-5cc0-4ea3-a23a-1958b59f26cf tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:58.691007 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b64ca53a-5cc0-4ea3-a23a-1958b59f26cf tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:58.691594 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b64ca53a-5cc0-4ea3-a23a-1958b59f26cf tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:58.692442 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b64ca53a-5cc0-4ea3-a23a-1958b59f26cf tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:58.693004 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b64ca53a-5cc0-4ea3-a23a-1958b59f26cf tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:58.693533 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b64ca53a-5cc0-4ea3-a23a-1958b59f26cf tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:58.777781 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b64ca53a-5cc0-4ea3-a23a-1958b59f26cf tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f1309abebb4778a8a907cd6c8142c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:40:58.786037 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b64ca53a-5cc0-4ea3-a23a-1958b59f26cf tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771" status: 200 len: 1310 microversion: 2.1 time: 0.111815 Oct 17 14:40:58.786875 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3545/6951] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:40:58 2022] GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771 => generated 1310 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:40:59.809911 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8938fdc4-6c53-4212-9882-90bdf688fd68 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:40:59.810927 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8938fdc4-6c53-4212-9882-90bdf688fd68 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 6e31b320-2cca-4ecc-9577-dcd0f2c55771] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:40:59.821178 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8938fdc4-6c53-4212-9882-90bdf688fd68 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:59.821596 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8938fdc4-6c53-4212-9882-90bdf688fd68 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:59.822210 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8938fdc4-6c53-4212-9882-90bdf688fd68 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:59.823441 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8938fdc4-6c53-4212-9882-90bdf688fd68 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:59.824053 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8938fdc4-6c53-4212-9882-90bdf688fd68 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:59.824661 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8938fdc4-6c53-4212-9882-90bdf688fd68 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:59.977455 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8938fdc4-6c53-4212-9882-90bdf688fd68 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f1309abebb4778a8a907cd6c8142c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:40:59.985375 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8938fdc4-6c53-4212-9882-90bdf688fd68 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771" status: 200 len: 1358 microversion: 2.1 time: 0.179468 Oct 17 14:40:59.985940 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3407/6952] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:40:59 2022] GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:41:01.011766 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6cbd7454-64af-4f13-a88a-6d30f6965fbe tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:41:01.012518 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6cbd7454-64af-4f13-a88a-6d30f6965fbe tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 6e31b320-2cca-4ecc-9577-dcd0f2c55771] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:41:01.020422 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6cbd7454-64af-4f13-a88a-6d30f6965fbe tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:01.021294 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6cbd7454-64af-4f13-a88a-6d30f6965fbe tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:01.021930 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6cbd7454-64af-4f13-a88a-6d30f6965fbe tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:01.023979 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6cbd7454-64af-4f13-a88a-6d30f6965fbe tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:01.024714 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6cbd7454-64af-4f13-a88a-6d30f6965fbe tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:01.025395 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6cbd7454-64af-4f13-a88a-6d30f6965fbe tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:01.180802 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6cbd7454-64af-4f13-a88a-6d30f6965fbe tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f1309abebb4778a8a907cd6c8142c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:41:01.189237 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6cbd7454-64af-4f13-a88a-6d30f6965fbe tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771" status: 200 len: 1358 microversion: 2.1 time: 0.181489 Oct 17 14:41:01.189824 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3546/6953] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:41:01 2022] GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:41:02.214250 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-997c7c61-b0c3-479c-9803-d1bb51b11c29 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:41:02.217686 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-997c7c61-b0c3-479c-9803-d1bb51b11c29 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 6e31b320-2cca-4ecc-9577-dcd0f2c55771] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:41:02.227946 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-997c7c61-b0c3-479c-9803-d1bb51b11c29 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:02.228457 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-997c7c61-b0c3-479c-9803-d1bb51b11c29 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:02.235433 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-997c7c61-b0c3-479c-9803-d1bb51b11c29 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:02.236337 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-997c7c61-b0c3-479c-9803-d1bb51b11c29 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:02.236709 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-997c7c61-b0c3-479c-9803-d1bb51b11c29 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:02.237222 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-997c7c61-b0c3-479c-9803-d1bb51b11c29 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:02.381831 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-997c7c61-b0c3-479c-9803-d1bb51b11c29 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f1309abebb4778a8a907cd6c8142c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:41:02.390555 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-997c7c61-b0c3-479c-9803-d1bb51b11c29 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771" status: 200 len: 1358 microversion: 2.1 time: 0.181368 Oct 17 14:41:02.395230 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3408/6954] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:41:02 2022] GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:41:03.417608 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0f00357a-5e82-421e-9611-26556a95795c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:41:03.418255 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0f00357a-5e82-421e-9611-26556a95795c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 6e31b320-2cca-4ecc-9577-dcd0f2c55771] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:41:03.425489 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0f00357a-5e82-421e-9611-26556a95795c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:03.425974 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0f00357a-5e82-421e-9611-26556a95795c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:03.426411 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0f00357a-5e82-421e-9611-26556a95795c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:03.427149 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0f00357a-5e82-421e-9611-26556a95795c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:03.427628 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0f00357a-5e82-421e-9611-26556a95795c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:03.428071 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0f00357a-5e82-421e-9611-26556a95795c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:03.569298 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0f00357a-5e82-421e-9611-26556a95795c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f1309abebb4778a8a907cd6c8142c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:41:03.577827 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0f00357a-5e82-421e-9611-26556a95795c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771" status: 200 len: 1358 microversion: 2.1 time: 0.164566 Oct 17 14:41:03.579925 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3547/6955] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:41:03 2022] GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:41:04.600673 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d5fc26dc-0a2e-43f2-b20f-b07aae042149 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:41:04.601383 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d5fc26dc-0a2e-43f2-b20f-b07aae042149 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 6e31b320-2cca-4ecc-9577-dcd0f2c55771] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:41:04.608713 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d5fc26dc-0a2e-43f2-b20f-b07aae042149 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:04.609160 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d5fc26dc-0a2e-43f2-b20f-b07aae042149 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:04.609645 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d5fc26dc-0a2e-43f2-b20f-b07aae042149 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:04.610404 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d5fc26dc-0a2e-43f2-b20f-b07aae042149 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:04.610877 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d5fc26dc-0a2e-43f2-b20f-b07aae042149 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:04.611349 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d5fc26dc-0a2e-43f2-b20f-b07aae042149 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:04.765225 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d5fc26dc-0a2e-43f2-b20f-b07aae042149 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f1309abebb4778a8a907cd6c8142c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:41:04.773636 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d5fc26dc-0a2e-43f2-b20f-b07aae042149 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771" status: 200 len: 1358 microversion: 2.1 time: 0.176791 Oct 17 14:41:04.774451 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3409/6956] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:41:04 2022] GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:41:05.796714 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-71a273b9-405e-4371-8132-a753e4efc277 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:41:05.797341 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-71a273b9-405e-4371-8132-a753e4efc277 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 6e31b320-2cca-4ecc-9577-dcd0f2c55771] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:41:05.803837 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-71a273b9-405e-4371-8132-a753e4efc277 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:05.804321 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-71a273b9-405e-4371-8132-a753e4efc277 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:05.804760 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-71a273b9-405e-4371-8132-a753e4efc277 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:05.805461 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-71a273b9-405e-4371-8132-a753e4efc277 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:05.805915 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-71a273b9-405e-4371-8132-a753e4efc277 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:05.806341 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-71a273b9-405e-4371-8132-a753e4efc277 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:05.946991 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-71a273b9-405e-4371-8132-a753e4efc277 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f1309abebb4778a8a907cd6c8142c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:41:05.955478 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-71a273b9-405e-4371-8132-a753e4efc277 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771" status: 200 len: 1358 microversion: 2.1 time: 0.162813 Oct 17 14:41:05.956225 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3548/6957] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:41:05 2022] GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:41:06.982191 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-79359d8e-c541-4546-b588-f847f1d95224 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:41:06.982782 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-79359d8e-c541-4546-b588-f847f1d95224 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 6e31b320-2cca-4ecc-9577-dcd0f2c55771] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:41:06.990410 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-79359d8e-c541-4546-b588-f847f1d95224 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:06.990908 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-79359d8e-c541-4546-b588-f847f1d95224 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:06.991393 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-79359d8e-c541-4546-b588-f847f1d95224 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:06.992099 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-79359d8e-c541-4546-b588-f847f1d95224 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:06.992560 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-79359d8e-c541-4546-b588-f847f1d95224 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:06.992996 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-79359d8e-c541-4546-b588-f847f1d95224 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:07.130928 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-79359d8e-c541-4546-b588-f847f1d95224 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f1309abebb4778a8a907cd6c8142c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:41:07.141310 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-79359d8e-c541-4546-b588-f847f1d95224 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771" status: 200 len: 1358 microversion: 2.1 time: 0.163895 Oct 17 14:41:07.141897 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3410/6958] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:41:06 2022] GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:41:08.001478 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-7bee7c2b-f688-40a8-810a-bc6cbae9f294 req-0dc4d081-d430-4082-af72-e09c460242a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e31b320-2cca-4ecc-9577-dcd0f2c55771", "tag": "47249a68-e757-4ae1-a16d-e4827490157f"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:41:08.009292 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:41:08.010409 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=6 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:41:08.018360 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-7bee7c2b-f688-40a8-810a-bc6cbae9f294 req-0dc4d081-d430-4082-af72-e09c460242a6 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:08.019093 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-7bee7c2b-f688-40a8-810a-bc6cbae9f294 req-0dc4d081-d430-4082-af72-e09c460242a6 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:08.019729 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-7bee7c2b-f688-40a8-810a-bc6cbae9f294 req-0dc4d081-d430-4082-af72-e09c460242a6 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:08.033738 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-7bee7c2b-f688-40a8-810a-bc6cbae9f294 req-0dc4d081-d430-4082-af72-e09c460242a6 service nova] Creating event network-changed:47249a68-e757-4ae1-a16d-e4827490157f for instance 6e31b320-2cca-4ecc-9577-dcd0f2c55771 on n-h2-854247-14 Oct 17 14:41:08.039508 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-7bee7c2b-f688-40a8-810a-bc6cbae9f294 req-0dc4d081-d430-4082-af72-e09c460242a6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042511 Oct 17 14:41:08.040136 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3549/6959] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:41:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:41:08.168179 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5989eb56-491f-4c77-bd56-1a081e17c2f7 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:41:08.168808 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5989eb56-491f-4c77-bd56-1a081e17c2f7 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 6e31b320-2cca-4ecc-9577-dcd0f2c55771] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:41:08.170782 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=6 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:41:08.178018 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5989eb56-491f-4c77-bd56-1a081e17c2f7 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:08.178516 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5989eb56-491f-4c77-bd56-1a081e17c2f7 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:08.178960 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5989eb56-491f-4c77-bd56-1a081e17c2f7 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:08.179705 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5989eb56-491f-4c77-bd56-1a081e17c2f7 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:08.180189 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5989eb56-491f-4c77-bd56-1a081e17c2f7 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:08.180651 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5989eb56-491f-4c77-bd56-1a081e17c2f7 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:08.530284 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5989eb56-491f-4c77-bd56-1a081e17c2f7 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f1309abebb4778a8a907cd6c8142c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:41:08.538362 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5989eb56-491f-4c77-bd56-1a081e17c2f7 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771" status: 200 len: 1358 microversion: 2.1 time: 0.374353 Oct 17 14:41:08.539031 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3411/6960] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:41:08 2022] GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771 => generated 1358 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:41:09.568778 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7ee09b59-8cdc-4796-b4d0-4f91be47c30c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:41:09.569939 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7ee09b59-8cdc-4796-b4d0-4f91be47c30c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 6e31b320-2cca-4ecc-9577-dcd0f2c55771] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:41:09.581305 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7ee09b59-8cdc-4796-b4d0-4f91be47c30c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:09.582310 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7ee09b59-8cdc-4796-b4d0-4f91be47c30c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:09.582969 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7ee09b59-8cdc-4796-b4d0-4f91be47c30c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:09.584180 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7ee09b59-8cdc-4796-b4d0-4f91be47c30c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:09.584941 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7ee09b59-8cdc-4796-b4d0-4f91be47c30c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:09.585661 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7ee09b59-8cdc-4796-b4d0-4f91be47c30c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:09.833559 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7ee09b59-8cdc-4796-b4d0-4f91be47c30c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f1309abebb4778a8a907cd6c8142c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:41:09.842891 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7ee09b59-8cdc-4796-b4d0-4f91be47c30c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771" status: 200 len: 1358 microversion: 2.1 time: 0.283567 Oct 17 14:41:09.843530 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3550/6961] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:41:09 2022] GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771 => generated 1358 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:41:10.870838 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-46e4c998-0896-44ef-9b5a-375a4871142f tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:41:10.871452 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-46e4c998-0896-44ef-9b5a-375a4871142f tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 6e31b320-2cca-4ecc-9577-dcd0f2c55771] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:41:10.878993 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-46e4c998-0896-44ef-9b5a-375a4871142f tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:10.879515 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-46e4c998-0896-44ef-9b5a-375a4871142f tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:10.879961 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-46e4c998-0896-44ef-9b5a-375a4871142f tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:10.880663 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-46e4c998-0896-44ef-9b5a-375a4871142f tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:10.881125 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-46e4c998-0896-44ef-9b5a-375a4871142f tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:10.881560 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-46e4c998-0896-44ef-9b5a-375a4871142f tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:11.021629 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-46e4c998-0896-44ef-9b5a-375a4871142f tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f1309abebb4778a8a907cd6c8142c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:41:11.030860 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-46e4c998-0896-44ef-9b5a-375a4871142f tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771" status: 200 len: 1358 microversion: 2.1 time: 0.165821 Oct 17 14:41:11.031475 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3412/6962] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:41:10 2022] GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:41:12.054081 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cb0db342-942d-4f11-b8f0-daf64f81df8d tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:41:12.054724 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cb0db342-942d-4f11-b8f0-daf64f81df8d tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 6e31b320-2cca-4ecc-9577-dcd0f2c55771] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:41:12.062286 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb0db342-942d-4f11-b8f0-daf64f81df8d tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:12.062816 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb0db342-942d-4f11-b8f0-daf64f81df8d tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:12.063253 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb0db342-942d-4f11-b8f0-daf64f81df8d tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:12.063970 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb0db342-942d-4f11-b8f0-daf64f81df8d tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:12.064411 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb0db342-942d-4f11-b8f0-daf64f81df8d tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:12.064831 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb0db342-942d-4f11-b8f0-daf64f81df8d tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:12.205416 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cb0db342-942d-4f11-b8f0-daf64f81df8d tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f1309abebb4778a8a907cd6c8142c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:41:12.213397 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cb0db342-942d-4f11-b8f0-daf64f81df8d tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771" status: 200 len: 1358 microversion: 2.1 time: 0.163679 Oct 17 14:41:12.213971 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3551/6963] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:41:12 2022] GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:41:13.236740 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4cc5d932-00e7-4575-81cf-3269270ae0ca tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:41:13.237365 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4cc5d932-00e7-4575-81cf-3269270ae0ca tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 6e31b320-2cca-4ecc-9577-dcd0f2c55771] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:41:13.244497 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4cc5d932-00e7-4575-81cf-3269270ae0ca tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:13.244999 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4cc5d932-00e7-4575-81cf-3269270ae0ca tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:13.245450 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4cc5d932-00e7-4575-81cf-3269270ae0ca tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:13.246168 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4cc5d932-00e7-4575-81cf-3269270ae0ca tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:13.246637 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4cc5d932-00e7-4575-81cf-3269270ae0ca tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:13.247178 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4cc5d932-00e7-4575-81cf-3269270ae0ca tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:13.396445 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4cc5d932-00e7-4575-81cf-3269270ae0ca tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f1309abebb4778a8a907cd6c8142c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:41:13.404989 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4cc5d932-00e7-4575-81cf-3269270ae0ca tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771" status: 200 len: 1358 microversion: 2.1 time: 0.172266 Oct 17 14:41:13.405563 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3413/6964] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:41:13 2022] GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:41:14.100766 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-6a6c24a4-0c0b-4766-af5b-d897d0af4bd0 req-f3760b3e-0d77-4e65-8f07-1b9b631061ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e31b320-2cca-4ecc-9577-dcd0f2c55771", "name": "network-vif-plugged", "status": "completed", "tag": "47249a68-e757-4ae1-a16d-e4827490157f"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:41:14.114402 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-6a6c24a4-0c0b-4766-af5b-d897d0af4bd0 req-f3760b3e-0d77-4e65-8f07-1b9b631061ae service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:14.114907 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-6a6c24a4-0c0b-4766-af5b-d897d0af4bd0 req-f3760b3e-0d77-4e65-8f07-1b9b631061ae service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:14.115369 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-6a6c24a4-0c0b-4766-af5b-d897d0af4bd0 req-f3760b3e-0d77-4e65-8f07-1b9b631061ae service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:14.130534 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-6a6c24a4-0c0b-4766-af5b-d897d0af4bd0 req-f3760b3e-0d77-4e65-8f07-1b9b631061ae service nova] Creating event network-vif-plugged:47249a68-e757-4ae1-a16d-e4827490157f for instance 6e31b320-2cca-4ecc-9577-dcd0f2c55771 on n-h2-854247-14 Oct 17 14:41:14.135905 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-6a6c24a4-0c0b-4766-af5b-d897d0af4bd0 req-f3760b3e-0d77-4e65-8f07-1b9b631061ae service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039414 Oct 17 14:41:14.136816 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3552/6965] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:41:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:41:14.428653 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-91bf9599-2ef8-462c-b83e-804a81d810af tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:41:14.429969 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-91bf9599-2ef8-462c-b83e-804a81d810af tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 6e31b320-2cca-4ecc-9577-dcd0f2c55771] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:41:14.437750 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-91bf9599-2ef8-462c-b83e-804a81d810af tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:14.438247 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-91bf9599-2ef8-462c-b83e-804a81d810af tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:14.438720 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-91bf9599-2ef8-462c-b83e-804a81d810af tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:14.439500 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-91bf9599-2ef8-462c-b83e-804a81d810af tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:14.439984 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-91bf9599-2ef8-462c-b83e-804a81d810af tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:14.440440 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-91bf9599-2ef8-462c-b83e-804a81d810af tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:14.587385 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-91bf9599-2ef8-462c-b83e-804a81d810af tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f1309abebb4778a8a907cd6c8142c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:41:14.596407 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-91bf9599-2ef8-462c-b83e-804a81d810af tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771" status: 200 len: 1358 microversion: 2.1 time: 0.171652 Oct 17 14:41:14.596980 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3414/6966] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:41:14 2022] GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:41:15.626213 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e8568db8-164f-4052-b7b9-3dd53ca2a3af tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:41:15.627241 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e8568db8-164f-4052-b7b9-3dd53ca2a3af tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 6e31b320-2cca-4ecc-9577-dcd0f2c55771] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:41:15.635820 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e8568db8-164f-4052-b7b9-3dd53ca2a3af tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:15.636309 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e8568db8-164f-4052-b7b9-3dd53ca2a3af tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:15.636750 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e8568db8-164f-4052-b7b9-3dd53ca2a3af tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:15.637576 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e8568db8-164f-4052-b7b9-3dd53ca2a3af tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:15.638024 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e8568db8-164f-4052-b7b9-3dd53ca2a3af tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:15.638452 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e8568db8-164f-4052-b7b9-3dd53ca2a3af tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:15.778349 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e8568db8-164f-4052-b7b9-3dd53ca2a3af tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f1309abebb4778a8a907cd6c8142c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:41:15.786771 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e8568db8-164f-4052-b7b9-3dd53ca2a3af tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771" status: 200 len: 1547 microversion: 2.1 time: 0.168580 Oct 17 14:41:15.787391 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3553/6967] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:41:15 2022] GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771 => generated 1547 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:41:15.809551 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-68ef72a4-c4f9-422e-942c-a98c89a102f7 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:41:15.810186 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-68ef72a4-c4f9-422e-942c-a98c89a102f7 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 6e31b320-2cca-4ecc-9577-dcd0f2c55771] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:41:15.817480 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-68ef72a4-c4f9-422e-942c-a98c89a102f7 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:15.817984 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-68ef72a4-c4f9-422e-942c-a98c89a102f7 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:15.818433 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-68ef72a4-c4f9-422e-942c-a98c89a102f7 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:15.819149 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-68ef72a4-c4f9-422e-942c-a98c89a102f7 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:15.819637 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-68ef72a4-c4f9-422e-942c-a98c89a102f7 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:15.820074 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-68ef72a4-c4f9-422e-942c-a98c89a102f7 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:15.967575 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-68ef72a4-c4f9-422e-942c-a98c89a102f7 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f1309abebb4778a8a907cd6c8142c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:41:15.975946 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-68ef72a4-c4f9-422e-942c-a98c89a102f7 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771" status: 200 len: 1547 microversion: 2.1 time: 0.170435 Oct 17 14:41:15.976495 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3415/6968] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:41:15 2022] GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771 => generated 1547 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:41:15.998498 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-bf931787-2fbc-4b0b-8650-02e93a45ffd7 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:41:16.003710 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-bf931787-2fbc-4b0b-8650-02e93a45ffd7 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd2f1309abebb4778a8a907cd6c8142c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:41:16.004491 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-bf931787-2fbc-4b0b-8650-02e93a45ffd7 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Searching by: {'deleted': False, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96'} {{(pid=127016) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 14:41:16.010282 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bf931787-2fbc-4b0b-8650-02e93a45ffd7 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:16.010750 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bf931787-2fbc-4b0b-8650-02e93a45ffd7 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:16.011196 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bf931787-2fbc-4b0b-8650-02e93a45ffd7 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:16.011935 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bf931787-2fbc-4b0b-8650-02e93a45ffd7 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:16.012407 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bf931787-2fbc-4b0b-8650-02e93a45ffd7 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:16.012834 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bf931787-2fbc-4b0b-8650-02e93a45ffd7 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:16.038001 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.multi_cell_list [None req-bf931787-2fbc-4b0b-8650-02e93a45ffd7 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127016) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 14:41:16.066310 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-bf931787-2fbc-4b0b-8650-02e93a45ffd7 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.071933 Oct 17 14:41:16.066871 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3554/6969] 10.222.0.79 () {58 vars in 1125 bytes} [Mon Oct 17 14:41:15 2022] GET /compute/v2.1/servers => generated 343 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:41:16.079136 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-efad2a2f-7ff3-4faa-82cf-4a630c31f6d2 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:41:16.079794 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-efad2a2f-7ff3-4faa-82cf-4a630c31f6d2 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 6e31b320-2cca-4ecc-9577-dcd0f2c55771] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:41:16.086134 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-efad2a2f-7ff3-4faa-82cf-4a630c31f6d2 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:16.086627 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-efad2a2f-7ff3-4faa-82cf-4a630c31f6d2 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:16.087075 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-efad2a2f-7ff3-4faa-82cf-4a630c31f6d2 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:16.088274 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-efad2a2f-7ff3-4faa-82cf-4a630c31f6d2 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:16.088759 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-efad2a2f-7ff3-4faa-82cf-4a630c31f6d2 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:16.089145 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-efad2a2f-7ff3-4faa-82cf-4a630c31f6d2 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:16.224526 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-efad2a2f-7ff3-4faa-82cf-4a630c31f6d2 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f1309abebb4778a8a907cd6c8142c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:41:16.232733 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-efad2a2f-7ff3-4faa-82cf-4a630c31f6d2 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771" status: 200 len: 1547 microversion: 2.1 time: 0.157592 Oct 17 14:41:16.233295 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3416/6970] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:41:16 2022] GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771 => generated 1547 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:41:17.834417 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-148cd58c-2845-4a1a-bf44-1e0e96610301 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "675c142b-c3f6-44de-98ca-29583e743fea"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:41:17.836891 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-148cd58c-2845-4a1a-bf44-1e0e96610301 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 6e31b320-2cca-4ecc-9577-dcd0f2c55771] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:41:17.844009 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-148cd58c-2845-4a1a-bf44-1e0e96610301 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:17.844487 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-148cd58c-2845-4a1a-bf44-1e0e96610301 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:17.844917 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-148cd58c-2845-4a1a-bf44-1e0e96610301 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:17.845600 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-148cd58c-2845-4a1a-bf44-1e0e96610301 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:17.846040 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-148cd58c-2845-4a1a-bf44-1e0e96610301 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:17.846445 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-148cd58c-2845-4a1a-bf44-1e0e96610301 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:18.102584 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-148cd58c-2845-4a1a-bf44-1e0e96610301 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "POST /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272238 Oct 17 14:41:18.108795 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3555/6971] 10.222.0.79 () {60 vars in 1323 bytes} [Mon Oct 17 14:41:17 2022] POST /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:41:31.245892 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4fe46f19-fa47-4f58-b2dc-418ad1601316 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:41:31.246523 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4fe46f19-fa47-4f58-b2dc-418ad1601316 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 6e31b320-2cca-4ecc-9577-dcd0f2c55771] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:41:31.249121 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:41:31.249792 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=60 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:41:31.256516 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4fe46f19-fa47-4f58-b2dc-418ad1601316 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:31.257011 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4fe46f19-fa47-4f58-b2dc-418ad1601316 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:31.257467 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4fe46f19-fa47-4f58-b2dc-418ad1601316 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:31.258173 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4fe46f19-fa47-4f58-b2dc-418ad1601316 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:31.258632 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4fe46f19-fa47-4f58-b2dc-418ad1601316 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:31.259084 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4fe46f19-fa47-4f58-b2dc-418ad1601316 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:31.398097 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4fe46f19-fa47-4f58-b2dc-418ad1601316 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f1309abebb4778a8a907cd6c8142c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:41:31.411030 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4fe46f19-fa47-4f58-b2dc-418ad1601316 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771" status: 200 len: 1593 microversion: 2.1 time: 0.168919 Oct 17 14:41:31.411790 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3417/6972] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:41:31 2022] GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771 => generated 1593 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:41:33.202636 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-82eeb918-a0ab-4941-9e3b-d23156d69b56 req-f9293131-2c51-48f3-9c4d-cba6c49415c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e31b320-2cca-4ecc-9577-dcd0f2c55771", "tag": "47249a68-e757-4ae1-a16d-e4827490157f"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:41:33.210774 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:41:33.211542 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:41:33.212304 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:41:33.217011 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-82eeb918-a0ab-4941-9e3b-d23156d69b56 req-f9293131-2c51-48f3-9c4d-cba6c49415c0 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:33.217455 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-82eeb918-a0ab-4941-9e3b-d23156d69b56 req-f9293131-2c51-48f3-9c4d-cba6c49415c0 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:33.217878 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-82eeb918-a0ab-4941-9e3b-d23156d69b56 req-f9293131-2c51-48f3-9c4d-cba6c49415c0 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:33.232693 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-82eeb918-a0ab-4941-9e3b-d23156d69b56 req-f9293131-2c51-48f3-9c4d-cba6c49415c0 service nova] Creating event network-changed:47249a68-e757-4ae1-a16d-e4827490157f for instance 6e31b320-2cca-4ecc-9577-dcd0f2c55771 on n-h2-854247-14 Oct 17 14:41:33.238241 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-82eeb918-a0ab-4941-9e3b-d23156d69b56 req-f9293131-2c51-48f3-9c4d-cba6c49415c0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039906 Oct 17 14:41:33.238849 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3556/6973] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:41:34.281699 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8155a7ff-bf11-4a4e-93f9-921365aa96c9 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-564175963"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:41:34.282258 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8155a7ff-bf11-4a4e-93f9-921365aa96c9 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 6e31b320-2cca-4ecc-9577-dcd0f2c55771] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:41:34.289308 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8155a7ff-bf11-4a4e-93f9-921365aa96c9 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:34.289807 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8155a7ff-bf11-4a4e-93f9-921365aa96c9 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:34.290257 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8155a7ff-bf11-4a4e-93f9-921365aa96c9 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:34.290969 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8155a7ff-bf11-4a4e-93f9-921365aa96c9 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:34.291468 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8155a7ff-bf11-4a4e-93f9-921365aa96c9 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:34.291913 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8155a7ff-bf11-4a4e-93f9-921365aa96c9 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:34.429102 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.network.security_group_api [None req-8155a7ff-bf11-4a4e-93f9-921365aa96c9 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Adding security group 486235cf-c5ea-43ae-a577-0f0576dbd8e0 to port 47249a68-e757-4ae1-a16d-e4827490157f Oct 17 14:41:34.759389 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8155a7ff-bf11-4a4e-93f9-921365aa96c9 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "POST /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771/action" status: 202 len: 0 microversion: 2.1 time: 0.481671 Oct 17 14:41:34.760237 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3418/6974] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:41:34 2022] POST /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771/action => generated 0 bytes in 483 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:41:34.770036 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-450f848e-6980-453d-bdb7-1e0467831b06 req-ef14ea20-533f-49f9-a066-85785314ee8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e31b320-2cca-4ecc-9577-dcd0f2c55771", "tag": "47249a68-e757-4ae1-a16d-e4827490157f"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:41:34.772525 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-af820c3e-85b3-4048-b336-bc9f73120f76 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:41:34.773240 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-af820c3e-85b3-4048-b336-bc9f73120f76 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 6e31b320-2cca-4ecc-9577-dcd0f2c55771] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:41:34.782174 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af820c3e-85b3-4048-b336-bc9f73120f76 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:34.783270 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af820c3e-85b3-4048-b336-bc9f73120f76 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:34.784727 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af820c3e-85b3-4048-b336-bc9f73120f76 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:34.786093 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af820c3e-85b3-4048-b336-bc9f73120f76 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:34.786731 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af820c3e-85b3-4048-b336-bc9f73120f76 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:34.787230 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-af820c3e-85b3-4048-b336-bc9f73120f76 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:34.797623 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-450f848e-6980-453d-bdb7-1e0467831b06 req-ef14ea20-533f-49f9-a066-85785314ee8b service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:34.798130 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-450f848e-6980-453d-bdb7-1e0467831b06 req-ef14ea20-533f-49f9-a066-85785314ee8b service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:34.798599 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-450f848e-6980-453d-bdb7-1e0467831b06 req-ef14ea20-533f-49f9-a066-85785314ee8b service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:34.813445 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-450f848e-6980-453d-bdb7-1e0467831b06 req-ef14ea20-533f-49f9-a066-85785314ee8b service nova] Creating event network-changed:47249a68-e757-4ae1-a16d-e4827490157f for instance 6e31b320-2cca-4ecc-9577-dcd0f2c55771 on n-h2-854247-14 Oct 17 14:41:34.821129 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-450f848e-6980-453d-bdb7-1e0467831b06 req-ef14ea20-533f-49f9-a066-85785314ee8b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054366 Oct 17 14:41:34.822101 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3419/6975] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:41:35.047151 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-af820c3e-85b3-4048-b336-bc9f73120f76 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f1309abebb4778a8a907cd6c8142c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:41:35.056147 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-af820c3e-85b3-4048-b336-bc9f73120f76 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771" status: 200 len: 1758 microversion: 2.1 time: 0.291133 Oct 17 14:41:35.056883 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3557/6976] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:41:34 2022] GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771 => generated 1758 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:43:12.632315 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=6 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:43:12.633070 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=12 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:43:12.633869 n-d-854247-14 devstack@n-api.service[127017]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 14:43:12.634071 n-d-854247-14 devstack@n-api.service[127017]: Mon Oct 17 14:43:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771/action (ip 10.222.0.79) !!! Oct 17 14:43:12.640545 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-38f4269c-eff9-483a-9288-0e251626b71f tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:43:12.642625 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-38f4269c-eff9-483a-9288-0e251626b71f tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 6e31b320-2cca-4ecc-9577-dcd0f2c55771] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:43:12.652011 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-38f4269c-eff9-483a-9288-0e251626b71f tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:43:12.652514 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-38f4269c-eff9-483a-9288-0e251626b71f tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:43:12.652964 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-38f4269c-eff9-483a-9288-0e251626b71f tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:43:12.653687 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-38f4269c-eff9-483a-9288-0e251626b71f tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:43:12.654155 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-38f4269c-eff9-483a-9288-0e251626b71f tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:43:12.654600 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-38f4269c-eff9-483a-9288-0e251626b71f tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:43:12.736509 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-38f4269c-eff9-483a-9288-0e251626b71f tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "POST /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771/action" status: 202 len: 0 microversion: 2.1 time: 0.106283 Oct 17 14:43:12.738330 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3420/6977] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:43:12 2022] POST /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:43:12.744332 n-d-854247-14 devstack@n-api.service[127016]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0ad54cb6-91dd-4ced-9c42-02c0b19684b8] AMQP server on 10.222.0.79:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 17 14:43:12.748159 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e906fc7b-dca3-44e5-b5f5-58e38ea37b49 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:43:12.748770 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e906fc7b-dca3-44e5-b5f5-58e38ea37b49 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 6e31b320-2cca-4ecc-9577-dcd0f2c55771] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:43:12.751266 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=4 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:43:12.751953 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=8 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:43:12.753302 n-d-854247-14 devstack@n-api.service[127016]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 17 14:43:12.753465 n-d-854247-14 devstack@n-api.service[127016]: Mon Oct 17 14:43:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771 (ip 10.222.0.79) !!! Oct 17 14:43:12.754719 n-d-854247-14 devstack@n-api.service[127016]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 17 14:43:12.755021 n-d-854247-14 devstack@n-api.service[127016]: Mon Oct 17 14:43:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771 (ip 10.222.0.79) !!! Oct 17 14:43:12.764241 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e906fc7b-dca3-44e5-b5f5-58e38ea37b49 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:43:12.764723 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e906fc7b-dca3-44e5-b5f5-58e38ea37b49 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:43:12.765158 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e906fc7b-dca3-44e5-b5f5-58e38ea37b49 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:43:12.765867 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e906fc7b-dca3-44e5-b5f5-58e38ea37b49 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:43:12.766319 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e906fc7b-dca3-44e5-b5f5-58e38ea37b49 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:43:12.766742 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e906fc7b-dca3-44e5-b5f5-58e38ea37b49 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:43:13.150707 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e906fc7b-dca3-44e5-b5f5-58e38ea37b49 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f1309abebb4778a8a907cd6c8142c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:43:13.160762 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e906fc7b-dca3-44e5-b5f5-58e38ea37b49 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771" status: 200 len: 1760 microversion: 2.1 time: 0.418844 Oct 17 14:43:13.161377 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3558/6978] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:43:12 2022] GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771 => generated 1760 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:43:14.190038 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c756a508-eab8-4eb6-8fc7-989a4571d1ee tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:43:14.190998 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c756a508-eab8-4eb6-8fc7-989a4571d1ee tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 6e31b320-2cca-4ecc-9577-dcd0f2c55771] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:43:14.197970 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c756a508-eab8-4eb6-8fc7-989a4571d1ee tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:43:14.198466 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c756a508-eab8-4eb6-8fc7-989a4571d1ee tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:43:14.198916 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c756a508-eab8-4eb6-8fc7-989a4571d1ee tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:43:14.199660 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c756a508-eab8-4eb6-8fc7-989a4571d1ee tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:43:14.200129 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c756a508-eab8-4eb6-8fc7-989a4571d1ee tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:43:14.200551 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c756a508-eab8-4eb6-8fc7-989a4571d1ee tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:43:14.413206 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c756a508-eab8-4eb6-8fc7-989a4571d1ee tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f1309abebb4778a8a907cd6c8142c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:43:14.421989 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c756a508-eab8-4eb6-8fc7-989a4571d1ee tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771" status: 200 len: 1765 microversion: 2.1 time: 0.240347 Oct 17 14:43:14.422567 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3421/6979] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:43:14 2022] GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771 => generated 1765 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:43:15.446433 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-443124a1-b2fe-4c4e-8754-c76ab23ad78b tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:43:15.446992 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-443124a1-b2fe-4c4e-8754-c76ab23ad78b tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 6e31b320-2cca-4ecc-9577-dcd0f2c55771] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:43:15.460469 n-d-854247-14 devstack@n-api.service[127016]: INFO oslo.messaging._drivers.impl_rabbit [-] [0ad54cb6-91dd-4ced-9c42-02c0b19684b8] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 33454. Oct 17 14:43:15.462736 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-443124a1-b2fe-4c4e-8754-c76ab23ad78b tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:43:15.463211 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-443124a1-b2fe-4c4e-8754-c76ab23ad78b tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:43:15.463654 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-443124a1-b2fe-4c4e-8754-c76ab23ad78b tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:43:15.464360 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-443124a1-b2fe-4c4e-8754-c76ab23ad78b tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:43:15.464807 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-443124a1-b2fe-4c4e-8754-c76ab23ad78b tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:43:15.465224 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-443124a1-b2fe-4c4e-8754-c76ab23ad78b tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:43:15.629439 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-443124a1-b2fe-4c4e-8754-c76ab23ad78b tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f1309abebb4778a8a907cd6c8142c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:43:15.640800 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-443124a1-b2fe-4c4e-8754-c76ab23ad78b tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771" status: 200 len: 1765 microversion: 2.1 time: 0.198346 Oct 17 14:43:15.641802 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3559/6980] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:43:15 2022] GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771 => generated 1765 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:43:16.674446 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-473dfd94-286f-40f5-8bcf-88945a3d16da tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:43:16.675070 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-473dfd94-286f-40f5-8bcf-88945a3d16da tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 6e31b320-2cca-4ecc-9577-dcd0f2c55771] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:43:16.682534 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-473dfd94-286f-40f5-8bcf-88945a3d16da tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:43:16.683026 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-473dfd94-286f-40f5-8bcf-88945a3d16da tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:43:16.683495 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-473dfd94-286f-40f5-8bcf-88945a3d16da tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:43:16.684203 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-473dfd94-286f-40f5-8bcf-88945a3d16da tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:43:16.684649 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-473dfd94-286f-40f5-8bcf-88945a3d16da tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:43:16.685079 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-473dfd94-286f-40f5-8bcf-88945a3d16da tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:43:16.842061 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-473dfd94-286f-40f5-8bcf-88945a3d16da tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f1309abebb4778a8a907cd6c8142c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:43:16.851135 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-473dfd94-286f-40f5-8bcf-88945a3d16da tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771" status: 200 len: 1765 microversion: 2.1 time: 0.182945 Oct 17 14:43:16.851888 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3422/6981] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:43:16 2022] GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771 => generated 1765 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:43:17.878613 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-41dc3db8-0a1f-4b50-8a8e-7a013b52831c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:43:17.879298 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-41dc3db8-0a1f-4b50-8a8e-7a013b52831c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 6e31b320-2cca-4ecc-9577-dcd0f2c55771] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:43:17.886962 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-41dc3db8-0a1f-4b50-8a8e-7a013b52831c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:43:17.887474 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-41dc3db8-0a1f-4b50-8a8e-7a013b52831c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:43:17.887906 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-41dc3db8-0a1f-4b50-8a8e-7a013b52831c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:43:17.888620 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-41dc3db8-0a1f-4b50-8a8e-7a013b52831c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:43:17.889061 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-41dc3db8-0a1f-4b50-8a8e-7a013b52831c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:43:17.889483 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-41dc3db8-0a1f-4b50-8a8e-7a013b52831c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:43:18.044526 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-41dc3db8-0a1f-4b50-8a8e-7a013b52831c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f1309abebb4778a8a907cd6c8142c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:43:18.054311 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-41dc3db8-0a1f-4b50-8a8e-7a013b52831c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771" status: 200 len: 1765 microversion: 2.1 time: 0.182264 Oct 17 14:43:18.054903 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3560/6982] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:43:17 2022] GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771 => generated 1765 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:43:19.083578 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5f74023d-48f6-4337-bd18-69ee71a12bdb tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:43:19.084487 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5f74023d-48f6-4337-bd18-69ee71a12bdb tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 6e31b320-2cca-4ecc-9577-dcd0f2c55771] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:43:19.094263 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5f74023d-48f6-4337-bd18-69ee71a12bdb tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:43:19.094770 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5f74023d-48f6-4337-bd18-69ee71a12bdb tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:43:19.095241 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5f74023d-48f6-4337-bd18-69ee71a12bdb tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:43:19.096032 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5f74023d-48f6-4337-bd18-69ee71a12bdb tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:43:19.096477 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5f74023d-48f6-4337-bd18-69ee71a12bdb tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:43:19.096857 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5f74023d-48f6-4337-bd18-69ee71a12bdb tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:43:19.276544 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5f74023d-48f6-4337-bd18-69ee71a12bdb tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f1309abebb4778a8a907cd6c8142c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:43:19.286069 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5f74023d-48f6-4337-bd18-69ee71a12bdb tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771" status: 200 len: 1758 microversion: 2.1 time: 0.206440 Oct 17 14:43:19.286960 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3423/6983] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:43:19 2022] GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771 => generated 1758 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:44:26.902758 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=6 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:44:26.903614 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=18 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:44:26.908092 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-65a7893d-1033-46f4-bbec-8c7eff6604f3 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-564175963"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:44:26.908630 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-65a7893d-1033-46f4-bbec-8c7eff6604f3 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 6e31b320-2cca-4ecc-9577-dcd0f2c55771] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:44:26.916447 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-65a7893d-1033-46f4-bbec-8c7eff6604f3 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:26.916920 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-65a7893d-1033-46f4-bbec-8c7eff6604f3 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:26.917303 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-65a7893d-1033-46f4-bbec-8c7eff6604f3 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:26.917997 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-65a7893d-1033-46f4-bbec-8c7eff6604f3 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:26.918444 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-65a7893d-1033-46f4-bbec-8c7eff6604f3 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:26.918867 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-65a7893d-1033-46f4-bbec-8c7eff6604f3 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:27.061673 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.network.security_group_api [None req-65a7893d-1033-46f4-bbec-8c7eff6604f3 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Removing security group 486235cf-c5ea-43ae-a577-0f0576dbd8e0 from port 47249a68-e757-4ae1-a16d-e4827490157f Oct 17 14:44:27.382758 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-65a7893d-1033-46f4-bbec-8c7eff6604f3 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "POST /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771/action" status: 202 len: 0 microversion: 2.1 time: 0.481506 Oct 17 14:44:27.384109 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3561/6984] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:44:26 2022] POST /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771/action => generated 0 bytes in 484 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:44:27.389684 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=8 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:44:27.390455 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:44:27.472905 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-c276a460-f49a-4d86-86eb-1ec3210fac13 req-a39f9739-1113-4003-be3f-8ce22d20e62f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e31b320-2cca-4ecc-9577-dcd0f2c55771", "tag": "47249a68-e757-4ae1-a16d-e4827490157f"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:44:27.485381 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-c276a460-f49a-4d86-86eb-1ec3210fac13 req-a39f9739-1113-4003-be3f-8ce22d20e62f service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:27.486041 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-c276a460-f49a-4d86-86eb-1ec3210fac13 req-a39f9739-1113-4003-be3f-8ce22d20e62f service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:27.486488 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-c276a460-f49a-4d86-86eb-1ec3210fac13 req-a39f9739-1113-4003-be3f-8ce22d20e62f service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:27.500251 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-c276a460-f49a-4d86-86eb-1ec3210fac13 req-a39f9739-1113-4003-be3f-8ce22d20e62f service nova] Creating event network-changed:47249a68-e757-4ae1-a16d-e4827490157f for instance 6e31b320-2cca-4ecc-9577-dcd0f2c55771 on n-h2-854247-14 Oct 17 14:44:27.506612 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-c276a460-f49a-4d86-86eb-1ec3210fac13 req-a39f9739-1113-4003-be3f-8ce22d20e62f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120360 Oct 17 14:44:27.507786 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3424/6985] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:44:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:44:29.537473 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b3b0dd6e-1d5c-4ae1-bf76-73498521d140 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:44:29.537974 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b3b0dd6e-1d5c-4ae1-bf76-73498521d140 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 6e31b320-2cca-4ecc-9577-dcd0f2c55771] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:44:29.544788 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b3b0dd6e-1d5c-4ae1-bf76-73498521d140 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:29.545276 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b3b0dd6e-1d5c-4ae1-bf76-73498521d140 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:29.545900 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b3b0dd6e-1d5c-4ae1-bf76-73498521d140 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:29.546448 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-96e25eae-6a69-4cf2-8da0-d399c27aa1b7 req-66a5c8ed-701d-4f3a-b2ee-9ed27b9ca87d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e31b320-2cca-4ecc-9577-dcd0f2c55771", "tag": "47249a68-e757-4ae1-a16d-e4827490157f"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:44:29.546914 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b3b0dd6e-1d5c-4ae1-bf76-73498521d140 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:29.547058 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b3b0dd6e-1d5c-4ae1-bf76-73498521d140 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:29.547670 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b3b0dd6e-1d5c-4ae1-bf76-73498521d140 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:29.558466 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-96e25eae-6a69-4cf2-8da0-d399c27aa1b7 req-66a5c8ed-701d-4f3a-b2ee-9ed27b9ca87d service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:29.558952 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-96e25eae-6a69-4cf2-8da0-d399c27aa1b7 req-66a5c8ed-701d-4f3a-b2ee-9ed27b9ca87d service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:29.559613 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-96e25eae-6a69-4cf2-8da0-d399c27aa1b7 req-66a5c8ed-701d-4f3a-b2ee-9ed27b9ca87d service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:29.572532 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-96e25eae-6a69-4cf2-8da0-d399c27aa1b7 req-66a5c8ed-701d-4f3a-b2ee-9ed27b9ca87d service nova] Creating event network-changed:47249a68-e757-4ae1-a16d-e4827490157f for instance 6e31b320-2cca-4ecc-9577-dcd0f2c55771 on n-h2-854247-14 Oct 17 14:44:29.578216 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-96e25eae-6a69-4cf2-8da0-d399c27aa1b7 req-66a5c8ed-701d-4f3a-b2ee-9ed27b9ca87d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037582 Oct 17 14:44:29.578846 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3425/6986] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:44:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:44:29.647298 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-b3b0dd6e-1d5c-4ae1-bf76-73498521d140 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lazy-loading 'services' on Instance uuid 6e31b320-2cca-4ecc-9577-dcd0f2c55771 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:44:29.728206 n-d-854247-14 devstack@n-api.service[127016]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b3b0dd6e-1d5c-4ae1-bf76-73498521d140 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [a49208af-5c42-4786-92fe-dfe8c8f14593] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 14:44:30.738676 n-d-854247-14 devstack@n-api.service[127016]: INFO oslo.messaging._drivers.impl_rabbit [None req-b3b0dd6e-1d5c-4ae1-bf76-73498521d140 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [a49208af-5c42-4786-92fe-dfe8c8f14593] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 33518. Oct 17 14:44:30.743409 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b3b0dd6e-1d5c-4ae1-bf76-73498521d140 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "DELETE /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771/os-volume_attachments/675c142b-c3f6-44de-98ca-29583e743fea" status: 202 len: 0 microversion: 2.1 time: 1.211418 Oct 17 14:44:30.744191 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3562/6987] 10.222.0.79 () {58 vars in 1416 bytes} [Mon Oct 17 14:44:29 2022] DELETE /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771/os-volume_attachments/675c142b-c3f6-44de-98ca-29583e743fea => generated 0 bytes in 1213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:44:30.755363 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-def06b90-c6a7-474c-9e12-27d135c3edc7 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:44:30.757824 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-def06b90-c6a7-474c-9e12-27d135c3edc7 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 6e31b320-2cca-4ecc-9577-dcd0f2c55771] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:44:30.765510 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-def06b90-c6a7-474c-9e12-27d135c3edc7 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:30.768590 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-def06b90-c6a7-474c-9e12-27d135c3edc7 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:30.768590 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-def06b90-c6a7-474c-9e12-27d135c3edc7 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:30.768590 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-def06b90-c6a7-474c-9e12-27d135c3edc7 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:30.768590 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-def06b90-c6a7-474c-9e12-27d135c3edc7 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:30.768590 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-def06b90-c6a7-474c-9e12-27d135c3edc7 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:30.804410 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-def06b90-c6a7-474c-9e12-27d135c3edc7 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053540 Oct 17 14:44:30.804987 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3426/6988] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 14:44:30 2022] GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:44:31.819228 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4410dcc8-cef9-4330-a242-130745066730 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:44:31.821888 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4410dcc8-cef9-4330-a242-130745066730 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 6e31b320-2cca-4ecc-9577-dcd0f2c55771] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:44:31.829682 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4410dcc8-cef9-4330-a242-130745066730 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:31.830224 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4410dcc8-cef9-4330-a242-130745066730 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:31.830721 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4410dcc8-cef9-4330-a242-130745066730 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:31.831541 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4410dcc8-cef9-4330-a242-130745066730 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:31.832062 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4410dcc8-cef9-4330-a242-130745066730 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:31.832587 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4410dcc8-cef9-4330-a242-130745066730 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:31.864646 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4410dcc8-cef9-4330-a242-130745066730 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050964 Oct 17 14:44:31.865449 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3563/6989] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 14:44:31 2022] GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:44:32.878492 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6071dd39-cf35-43e7-a378-2b4ee6a47e0d tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:44:32.880813 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6071dd39-cf35-43e7-a378-2b4ee6a47e0d tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 6e31b320-2cca-4ecc-9577-dcd0f2c55771] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:44:32.887559 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6071dd39-cf35-43e7-a378-2b4ee6a47e0d tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:32.888045 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6071dd39-cf35-43e7-a378-2b4ee6a47e0d tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:32.888495 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6071dd39-cf35-43e7-a378-2b4ee6a47e0d tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:32.889210 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6071dd39-cf35-43e7-a378-2b4ee6a47e0d tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:32.889675 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6071dd39-cf35-43e7-a378-2b4ee6a47e0d tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:32.890143 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6071dd39-cf35-43e7-a378-2b4ee6a47e0d tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:32.922002 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6071dd39-cf35-43e7-a378-2b4ee6a47e0d tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047831 Oct 17 14:44:32.922561 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3427/6990] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 14:44:32 2022] GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:44:33.936094 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-78857444-9576-4f82-826a-d56c9064b38a tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:44:33.938216 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-78857444-9576-4f82-826a-d56c9064b38a tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 6e31b320-2cca-4ecc-9577-dcd0f2c55771] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:44:33.945629 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-78857444-9576-4f82-826a-d56c9064b38a tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:33.946120 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-78857444-9576-4f82-826a-d56c9064b38a tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:33.946542 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-78857444-9576-4f82-826a-d56c9064b38a tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:33.947288 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-78857444-9576-4f82-826a-d56c9064b38a tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:33.947765 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-78857444-9576-4f82-826a-d56c9064b38a tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:33.948188 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-78857444-9576-4f82-826a-d56c9064b38a tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:33.983913 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-78857444-9576-4f82-826a-d56c9064b38a tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052226 Oct 17 14:44:33.984901 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3564/6991] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 14:44:33 2022] GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:44:35.002122 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bc1afcf4-ff7f-4c33-bd34-53cbb067d61d tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:44:35.004521 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-bc1afcf4-ff7f-4c33-bd34-53cbb067d61d tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 6e31b320-2cca-4ecc-9577-dcd0f2c55771] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:44:35.011604 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bc1afcf4-ff7f-4c33-bd34-53cbb067d61d tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:35.012161 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bc1afcf4-ff7f-4c33-bd34-53cbb067d61d tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:35.012606 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bc1afcf4-ff7f-4c33-bd34-53cbb067d61d tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:35.013304 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bc1afcf4-ff7f-4c33-bd34-53cbb067d61d tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:35.013756 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bc1afcf4-ff7f-4c33-bd34-53cbb067d61d tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:35.014182 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bc1afcf4-ff7f-4c33-bd34-53cbb067d61d tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:35.048162 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-bc1afcf4-ff7f-4c33-bd34-53cbb067d61d tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053310 Oct 17 14:44:35.048673 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3428/6992] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 14:44:34 2022] GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:44:36.064241 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cd7296da-ebb8-49ba-86ba-c53edad91155 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:44:36.066609 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cd7296da-ebb8-49ba-86ba-c53edad91155 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 6e31b320-2cca-4ecc-9577-dcd0f2c55771] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:44:36.076144 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cd7296da-ebb8-49ba-86ba-c53edad91155 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:36.076636 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cd7296da-ebb8-49ba-86ba-c53edad91155 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:36.077050 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cd7296da-ebb8-49ba-86ba-c53edad91155 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:36.077939 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cd7296da-ebb8-49ba-86ba-c53edad91155 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:36.078393 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cd7296da-ebb8-49ba-86ba-c53edad91155 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:36.078813 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cd7296da-ebb8-49ba-86ba-c53edad91155 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:36.110596 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cd7296da-ebb8-49ba-86ba-c53edad91155 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052793 Oct 17 14:44:36.111420 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3565/6993] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 14:44:36 2022] GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 14:44:36.123556 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-03606694-66ab-42d1-94a3-5191cc93f715 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:44:36.124085 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-03606694-66ab-42d1-94a3-5191cc93f715 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 6e31b320-2cca-4ecc-9577-dcd0f2c55771] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:44:36.131425 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-03606694-66ab-42d1-94a3-5191cc93f715 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:36.131947 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-03606694-66ab-42d1-94a3-5191cc93f715 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:36.132439 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-03606694-66ab-42d1-94a3-5191cc93f715 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:36.133198 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-03606694-66ab-42d1-94a3-5191cc93f715 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:36.133675 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-03606694-66ab-42d1-94a3-5191cc93f715 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:36.134109 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-03606694-66ab-42d1-94a3-5191cc93f715 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:36.215370 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-03606694-66ab-42d1-94a3-5191cc93f715 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] HTTP exception thrown: Instance 6e31b320-2cca-4ecc-9577-dcd0f2c55771 is not attached to volume 675c142b-c3f6-44de-98ca-29583e743fea Oct 17 14:44:36.216984 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-03606694-66ab-42d1-94a3-5191cc93f715 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Request method failure captured: Oct 17 14:44:36.216984 n-d-854247-14 devstack@n-api.service[127017]: request: DELETE /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771/os-volume_attachments/675c142b-c3f6-44de-98ca-29583e743fea HTTP/1.1 Oct 17 14:44:36.216984 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 14:44:36.216984 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 14:44:36.216984 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 14:44:36.216984 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 14:44:36.216984 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 14:44:36.216984 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 14:44:36.216984 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 14:44:36.216984 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 14:44:36.216984 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTWlqbsv6-8TFzkbZMNrImYpezCcoheAm_h6hYPJTPXG9brnitHKZDw26NceYxcUllza5GDYHtxaHtai5uHb6CrmD9L2OKAJZMuUauOrxr7rK977-_auBYnVIjQ4g_M72joHHWOKhiHJtxt-wovbj9xJatnSaI_iaeq3MithcFCAFxeg Oct 17 14:44:36.216984 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 14:44:36.216984 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 14:44:36.216984 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 14:44:36.216984 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 14:44:36.216984 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 14:44:36.216984 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 14:44:36.216984 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 6c27ab2952064d1ab714d1b4f7ef7c96 Oct 17 14:44:36.216984 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-TestMinimumBasicScenario-1302609953 Oct 17 14:44:36.216984 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 14:44:36.216984 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 14:44:36.216984 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6c27ab2952064d1ab714d1b4f7ef7c96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6c27ab2952064d1ab714d1b4f7ef7c96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6c27ab2952064d1ab714d1b4f7ef7c96"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6c27ab2952064d1ab714d1b4f7ef7c96", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:44:36.216984 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-TestMinimumBasicScenario-1302609953 Oct 17 14:44:36.216984 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 6c27ab2952064d1ab714d1b4f7ef7c96 Oct 17 14:44:36.216984 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1302609953 Oct 17 14:44:36.216984 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-TestMinimumBasicScenario-1302609953-project Oct 17 14:44:36.216984 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 14:44:36.216984 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 14:44:36.216984 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: d2f1309abebb4778a8a907cd6c8142c3 Oct 17 14:44:36.216984 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-TestMinimumBasicScenario-1302609953-project Oct 17 14:44:36.216984 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 14:44:36.216984 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 6e31b320-2cca-4ecc-9577-dcd0f2c55771 is not attached to volume 675c142b-c3f6-44de-98ca-29583e743fea Oct 17 14:44:36.216984 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'server_id': '6e31b320-2cca-4ecc-9577-dcd0f2c55771', 'id': '675c142b-c3f6-44de-98ca-29583e743fea'} Oct 17 14:44:36.216984 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:44:36.216984 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:44:36.216984 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 17 14:44:36.216984 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 17 14:44:36.216984 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 14:44:36.216984 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 14:44:36.216984 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 17 14:44:36.216984 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 17 14:44:36.216984 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 675c142b-c3f6-44de-98ca-29583e743fea. Oct 17 14:44:36.216984 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:44:36.216984 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:44:36.216984 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:44:36.216984 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:44:36.216984 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:44:36.216984 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:44:36.216984 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:44:36.216984 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:44:36.216984 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:44:36.216984 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:44:36.216984 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 17 14:44:36.216984 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 17 14:44:36.216984 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e31b320-2cca-4ecc-9577-dcd0f2c55771 is not attached to volume 675c142b-c3f6-44de-98ca-29583e743fea Oct 17 14:44:36.216984 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:44:36.216984 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:44:36.216984 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:44:36.216984 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:44:36.216984 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:44:36.216984 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:44:36.221425 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:44:36.221425 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:44:36.221425 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e31b320-2cca-4ecc-9577-dcd0f2c55771 is not attached to volume 675c142b-c3f6-44de-98ca-29583e743fea Oct 17 14:44:36.221425 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:44:36.221425 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-03606694-66ab-42d1-94a3-5191cc93f715 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Returning 404 to user: Instance 6e31b320-2cca-4ecc-9577-dcd0f2c55771 is not attached to volume 675c142b-c3f6-44de-98ca-29583e743fea {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:44:36.221425 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-03606694-66ab-42d1-94a3-5191cc93f715 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "DELETE /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771/os-volume_attachments/675c142b-c3f6-44de-98ca-29583e743fea" status: 404 len: 154 microversion: 2.1 time: 0.099513 Oct 17 14:44:36.221425 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3429/6994] 10.222.0.79 () {58 vars in 1416 bytes} [Mon Oct 17 14:44:36 2022] DELETE /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771/os-volume_attachments/675c142b-c3f6-44de-98ca-29583e743fea => generated 154 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:44:39.500400 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-37f197af-7d64-4f09-9b45-17fb2d482da6 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:44:39.500897 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-37f197af-7d64-4f09-9b45-17fb2d482da6 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 6e31b320-2cca-4ecc-9577-dcd0f2c55771] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:44:39.510078 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-37f197af-7d64-4f09-9b45-17fb2d482da6 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:39.510652 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-37f197af-7d64-4f09-9b45-17fb2d482da6 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:39.511159 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-37f197af-7d64-4f09-9b45-17fb2d482da6 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:39.511971 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-37f197af-7d64-4f09-9b45-17fb2d482da6 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:39.512493 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-37f197af-7d64-4f09-9b45-17fb2d482da6 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:39.512983 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-37f197af-7d64-4f09-9b45-17fb2d482da6 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:39.540617 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-37f197af-7d64-4f09-9b45-17fb2d482da6 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 6e31b320-2cca-4ecc-9577-dcd0f2c55771] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:44:39.627903 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-37f197af-7d64-4f09-9b45-17fb2d482da6 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "DELETE /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771" status: 204 len: 0 microversion: 2.1 time: 0.131444 Oct 17 14:44:39.628641 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3566/6995] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:44:39 2022] DELETE /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:44:39.637039 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b7e4185e-bc56-404c-907e-d7f58cfa773e tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:44:39.637748 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b7e4185e-bc56-404c-907e-d7f58cfa773e tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 6e31b320-2cca-4ecc-9577-dcd0f2c55771] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:44:39.645210 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b7e4185e-bc56-404c-907e-d7f58cfa773e tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:39.645708 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b7e4185e-bc56-404c-907e-d7f58cfa773e tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:39.646148 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b7e4185e-bc56-404c-907e-d7f58cfa773e tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:39.646861 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b7e4185e-bc56-404c-907e-d7f58cfa773e tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:39.647353 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b7e4185e-bc56-404c-907e-d7f58cfa773e tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:39.647782 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b7e4185e-bc56-404c-907e-d7f58cfa773e tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:40.048779 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b7e4185e-bc56-404c-907e-d7f58cfa773e tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f1309abebb4778a8a907cd6c8142c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:44:40.057095 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b7e4185e-bc56-404c-907e-d7f58cfa773e tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771" status: 200 len: 1553 microversion: 2.1 time: 0.423914 Oct 17 14:44:40.057699 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3430/6996] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:44:39 2022] GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771 => generated 1553 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:44:41.082896 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e4dd08ff-20f8-421b-969b-70fdf89a0caa tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:44:41.083653 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e4dd08ff-20f8-421b-969b-70fdf89a0caa tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 6e31b320-2cca-4ecc-9577-dcd0f2c55771] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:44:41.093860 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e4dd08ff-20f8-421b-969b-70fdf89a0caa tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:41.094351 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e4dd08ff-20f8-421b-969b-70fdf89a0caa tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:41.094866 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e4dd08ff-20f8-421b-969b-70fdf89a0caa tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:41.095638 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e4dd08ff-20f8-421b-969b-70fdf89a0caa tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:41.096093 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e4dd08ff-20f8-421b-969b-70fdf89a0caa tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:41.096544 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e4dd08ff-20f8-421b-969b-70fdf89a0caa tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:41.279024 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e4dd08ff-20f8-421b-969b-70fdf89a0caa tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f1309abebb4778a8a907cd6c8142c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:44:41.287913 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e4dd08ff-20f8-421b-969b-70fdf89a0caa tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771" status: 200 len: 1553 microversion: 2.1 time: 0.210135 Oct 17 14:44:41.288497 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3567/6997] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:44:41 2022] GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771 => generated 1553 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:44:41.749564 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-236ced2c-3053-41e6-b9e6-b6ee6e80461f req-76d06b63-f7b0-452f-ab4a-0b52c71bd4a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e31b320-2cca-4ecc-9577-dcd0f2c55771", "name": "network-vif-deleted", "tag": "47249a68-e757-4ae1-a16d-e4827490157f"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:44:41.760563 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-236ced2c-3053-41e6-b9e6-b6ee6e80461f req-76d06b63-f7b0-452f-ab4a-0b52c71bd4a8 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:41.761057 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-236ced2c-3053-41e6-b9e6-b6ee6e80461f req-76d06b63-f7b0-452f-ab4a-0b52c71bd4a8 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:41.761501 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-236ced2c-3053-41e6-b9e6-b6ee6e80461f req-76d06b63-f7b0-452f-ab4a-0b52c71bd4a8 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:41.773318 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-236ced2c-3053-41e6-b9e6-b6ee6e80461f req-76d06b63-f7b0-452f-ab4a-0b52c71bd4a8 service nova] Creating event network-vif-deleted:47249a68-e757-4ae1-a16d-e4827490157f for instance 6e31b320-2cca-4ecc-9577-dcd0f2c55771 on n-h2-854247-14 Oct 17 14:44:41.778874 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-236ced2c-3053-41e6-b9e6-b6ee6e80461f req-76d06b63-f7b0-452f-ab4a-0b52c71bd4a8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033237 Oct 17 14:44:41.779527 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3431/6998] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:44:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:44:42.311416 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7376462d-0658-40b4-ac24-f28317587780 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:44:42.312093 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7376462d-0658-40b4-ac24-f28317587780 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 6e31b320-2cca-4ecc-9577-dcd0f2c55771] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:44:42.319304 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7376462d-0658-40b4-ac24-f28317587780 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:42.319772 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7376462d-0658-40b4-ac24-f28317587780 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:42.320200 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7376462d-0658-40b4-ac24-f28317587780 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:42.320888 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7376462d-0658-40b4-ac24-f28317587780 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:42.321330 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7376462d-0658-40b4-ac24-f28317587780 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:42.321751 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7376462d-0658-40b4-ac24-f28317587780 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:42.336528 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-7376462d-0658-40b4-ac24-f28317587780 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] HTTP exception thrown: Instance 6e31b320-2cca-4ecc-9577-dcd0f2c55771 could not be found. Oct 17 14:44:42.338162 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7376462d-0658-40b4-ac24-f28317587780 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Request method failure captured: Oct 17 14:44:42.338162 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771 HTTP/1.1 Oct 17 14:44:42.338162 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 14:44:42.338162 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 14:44:42.338162 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 14:44:42.338162 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 14:44:42.338162 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 14:44:42.338162 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 14:44:42.338162 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 14:44:42.338162 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 14:44:42.338162 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTWlqbsv6-8TFzkbZMNrImYpezCcoheAm_h6hYPJTPXG9brnitHKZDw26NceYxcUllza5GDYHtxaHtai5uHb6CrmD9L2OKAJZMuUauOrxr7rK977-_auBYnVIjQ4g_M72joHHWOKhiHJtxt-wovbj9xJatnSaI_iaeq3MithcFCAFxeg Oct 17 14:44:42.338162 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 14:44:42.338162 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 14:44:42.338162 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 14:44:42.338162 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 14:44:42.338162 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 14:44:42.338162 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 14:44:42.338162 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 6c27ab2952064d1ab714d1b4f7ef7c96 Oct 17 14:44:42.338162 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-TestMinimumBasicScenario-1302609953 Oct 17 14:44:42.338162 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 14:44:42.338162 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 14:44:42.338162 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6c27ab2952064d1ab714d1b4f7ef7c96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6c27ab2952064d1ab714d1b4f7ef7c96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6c27ab2952064d1ab714d1b4f7ef7c96"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6c27ab2952064d1ab714d1b4f7ef7c96", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:44:42.338162 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-TestMinimumBasicScenario-1302609953 Oct 17 14:44:42.338162 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 6c27ab2952064d1ab714d1b4f7ef7c96 Oct 17 14:44:42.338162 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1302609953 Oct 17 14:44:42.338162 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-TestMinimumBasicScenario-1302609953-project Oct 17 14:44:42.338162 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 14:44:42.338162 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 14:44:42.338162 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: d2f1309abebb4778a8a907cd6c8142c3 Oct 17 14:44:42.338162 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-TestMinimumBasicScenario-1302609953-project Oct 17 14:44:42.338162 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 14:44:42.338162 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 6e31b320-2cca-4ecc-9577-dcd0f2c55771 could not be found. Oct 17 14:44:42.338162 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '6e31b320-2cca-4ecc-9577-dcd0f2c55771'} Oct 17 14:44:42.338162 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:44:42.338162 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:44:42.338162 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:44:42.338162 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:44:42.338162 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:44:42.338162 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:44:42.338162 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:44:42.338162 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:44:42.338162 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:44:42.338162 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:44:42.338162 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e31b320-2cca-4ecc-9577-dcd0f2c55771 could not be found. Oct 17 14:44:42.338162 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:44:42.338162 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:44:42.338162 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:44:42.338162 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:44:42.338162 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:44:42.338162 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:44:42.338162 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:44:42.338162 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:44:42.338162 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:44:42.338162 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:44:42.338162 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:44:42.338162 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:44:42.338162 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:44:42.338162 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:44:42.338162 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:44:42.338162 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:44:42.338162 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e31b320-2cca-4ecc-9577-dcd0f2c55771 could not be found. Oct 17 14:44:42.338162 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:44:42.338162 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:44:42.338162 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:44:42.343624 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:44:42.343624 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:44:42.343624 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:44:42.343624 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:44:42.343624 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:44:42.343624 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e31b320-2cca-4ecc-9577-dcd0f2c55771 could not be found. Oct 17 14:44:42.343624 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:44:42.343624 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7376462d-0658-40b4-ac24-f28317587780 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Returning 404 to user: Instance 6e31b320-2cca-4ecc-9577-dcd0f2c55771 could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:44:42.343624 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7376462d-0658-40b4-ac24-f28317587780 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771" status: 404 len: 111 microversion: 2.1 time: 0.032309 Oct 17 14:44:42.343624 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3568/6999] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:44:42 2022] GET /compute/v2.1/servers/6e31b320-2cca-4ecc-9577-dcd0f2c55771 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:44:42.350284 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bba912c2-5474-4396-9166-dd739dbed7ba tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '.version_select at 0x7f7cd43b23a0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:44:42.355004 n-d-854247-14 devstack@n-api.service[127017]: ERROR oslo.messaging._drivers.impl_rabbit [None req-bba912c2-5474-4396-9166-dd739dbed7ba tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [db279165-5189-40f8-9e6f-0af7f7bfcb49] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 14:44:43.364297 n-d-854247-14 devstack@n-api.service[127017]: INFO oslo.messaging._drivers.impl_rabbit [None req-bba912c2-5474-4396-9166-dd739dbed7ba tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [db279165-5189-40f8-9e6f-0af7f7bfcb49] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 33558. Oct 17 14:44:43.388950 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-bba912c2-5474-4396-9166-dd739dbed7ba tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-694307239" status: 202 len: 0 microversion: 2.1 time: 1.043680 Oct 17 14:44:43.389893 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3432/7000] 10.222.0.79 () {58 vars in 1269 bytes} [Mon Oct 17 14:44:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-694307239 => generated 0 bytes in 1045 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:44:52.778440 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-816c5e80-534d-491f-9a31-5e6fc6958ae9 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Action: 'create', calling method: .version_select at 0x7f7cd54430d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1970160555", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBt1mJ12INoipxDfC8CAViG8SMCxwLrPxjCb9G/Pc015Zkk3j2GUZx7qlwHfdOzORYg6OG/1sdW9qLAO8+26niWfmV3/J6QVXMYfxvAhbRm7jeOLFZfKGvdU0CnjzDR4g=="}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:44:52.785149 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:44:52.785810 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:44:52.802460 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-816c5e80-534d-491f-9a31-5e6fc6958ae9 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Getting quotas for project 6c27ab2952064d1ab714d1b4f7ef7c96. Resources: {'key_pairs'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:44:52.807942 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-816c5e80-534d-491f-9a31-5e6fc6958ae9 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Getting quotas for user d2f1309abebb4778a8a907cd6c8142c3 and project 6c27ab2952064d1ab714d1b4f7ef7c96. Resources: {'key_pairs'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:44:52.840619 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-816c5e80-534d-491f-9a31-5e6fc6958ae9 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.066323 Oct 17 14:44:52.841400 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3569/7001] 10.222.0.79 () {60 vars in 1159 bytes} [Mon Oct 17 14:44:52 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:44:52.895052 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=36 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:44:52.900318 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-710cbd2d-e058-48a3-bf01-7a15d37f8e2e tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-602083037", "imageRef": "2e6efc37-aaf8-4448-882a-5d713e4469f1", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1970160555", "networks": [{"uuid": "96c3205b-371b-45a2-b1ff-0cafff6ddcad"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:44:52.958381 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-710cbd2d-e058-48a3-bf01-7a15d37f8e2e tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] validate_networks() for [('96c3205b-371b-45a2-b1ff-0cafff6ddcad', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:44:53.489866 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-710cbd2d-e058-48a3-bf01-7a15d37f8e2e tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:44:53.490344 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-710cbd2d-e058-48a3-bf01-7a15d37f8e2e tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:44:53.490827 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-710cbd2d-e058-48a3-bf01-7a15d37f8e2e tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:44:53.491280 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-710cbd2d-e058-48a3-bf01-7a15d37f8e2e tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:44:53.491738 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-710cbd2d-e058-48a3-bf01-7a15d37f8e2e tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:44:53.503737 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-710cbd2d-e058-48a3-bf01-7a15d37f8e2e tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:53.504307 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-710cbd2d-e058-48a3-bf01-7a15d37f8e2e tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:53.504796 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-710cbd2d-e058-48a3-bf01-7a15d37f8e2e tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:53.505577 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-710cbd2d-e058-48a3-bf01-7a15d37f8e2e tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:53.506084 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-710cbd2d-e058-48a3-bf01-7a15d37f8e2e tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:53.506553 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-710cbd2d-e058-48a3-bf01-7a15d37f8e2e tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:53.527455 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-710cbd2d-e058-48a3-bf01-7a15d37f8e2e tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Getting quotas for project 6c27ab2952064d1ab714d1b4f7ef7c96. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:44:53.533178 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-710cbd2d-e058-48a3-bf01-7a15d37f8e2e tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Getting quotas for user d2f1309abebb4778a8a907cd6c8142c3 and project 6c27ab2952064d1ab714d1b4f7ef7c96. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:44:53.548353 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-710cbd2d-e058-48a3-bf01-7a15d37f8e2e tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:44:53.551138 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-710cbd2d-e058-48a3-bf01-7a15d37f8e2e tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2e6efc37-aaf8-4448-882a-5d713e4469f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:44:53.609684 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-710cbd2d-e058-48a3-bf01-7a15d37f8e2e tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.716713 Oct 17 14:44:53.610336 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3433/7002] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 14:44:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:44:53.622402 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c68a6bce-d810-4abd-91cc-3fd64168663b tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:44:53.623418 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c68a6bce-d810-4abd-91cc-3fd64168663b tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:44:53.681089 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c68a6bce-d810-4abd-91cc-3fd64168663b tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f1309abebb4778a8a907cd6c8142c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:44:53.691061 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c68a6bce-d810-4abd-91cc-3fd64168663b tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59" status: 200 len: 1258 microversion: 2.1 time: 0.072943 Oct 17 14:44:53.691667 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3570/7003] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:44:53 2022] GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59 => generated 1258 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:44:54.720022 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-29fe3e84-c31a-4fa5-a87f-3f2181c2877c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:44:54.723255 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-29fe3e84-c31a-4fa5-a87f-3f2181c2877c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:44:54.737730 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-29fe3e84-c31a-4fa5-a87f-3f2181c2877c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:54.739211 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-29fe3e84-c31a-4fa5-a87f-3f2181c2877c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:54.740285 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-29fe3e84-c31a-4fa5-a87f-3f2181c2877c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:54.741882 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-29fe3e84-c31a-4fa5-a87f-3f2181c2877c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:54.743270 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-29fe3e84-c31a-4fa5-a87f-3f2181c2877c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:54.745247 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-29fe3e84-c31a-4fa5-a87f-3f2181c2877c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:54.862619 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-29fe3e84-c31a-4fa5-a87f-3f2181c2877c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f1309abebb4778a8a907cd6c8142c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:44:54.875147 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-29fe3e84-c31a-4fa5-a87f-3f2181c2877c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59" status: 200 len: 1318 microversion: 2.1 time: 0.162013 Oct 17 14:44:54.875764 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3434/7004] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:44:54 2022] GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:44:55.900587 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a18ee620-80f2-4a4e-92db-4a1ebfdf3045 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:44:55.901943 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a18ee620-80f2-4a4e-92db-4a1ebfdf3045 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:44:55.910930 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a18ee620-80f2-4a4e-92db-4a1ebfdf3045 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:55.911494 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a18ee620-80f2-4a4e-92db-4a1ebfdf3045 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:55.911890 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a18ee620-80f2-4a4e-92db-4a1ebfdf3045 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:55.912610 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a18ee620-80f2-4a4e-92db-4a1ebfdf3045 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:55.913065 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a18ee620-80f2-4a4e-92db-4a1ebfdf3045 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:55.913485 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a18ee620-80f2-4a4e-92db-4a1ebfdf3045 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:56.128426 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a18ee620-80f2-4a4e-92db-4a1ebfdf3045 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f1309abebb4778a8a907cd6c8142c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:44:56.140152 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a18ee620-80f2-4a4e-92db-4a1ebfdf3045 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59" status: 200 len: 1358 microversion: 2.1 time: 0.244338 Oct 17 14:44:56.141196 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3571/7005] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:44:55 2022] GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59 => generated 1358 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:44:57.168727 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3711fbbc-c1fb-4fbe-ac85-d723b1c50017 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:44:57.169598 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3711fbbc-c1fb-4fbe-ac85-d723b1c50017 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:44:57.178435 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3711fbbc-c1fb-4fbe-ac85-d723b1c50017 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:57.178995 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3711fbbc-c1fb-4fbe-ac85-d723b1c50017 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:57.179835 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3711fbbc-c1fb-4fbe-ac85-d723b1c50017 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:57.181010 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3711fbbc-c1fb-4fbe-ac85-d723b1c50017 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:57.181482 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3711fbbc-c1fb-4fbe-ac85-d723b1c50017 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:57.182125 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3711fbbc-c1fb-4fbe-ac85-d723b1c50017 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:57.331338 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3711fbbc-c1fb-4fbe-ac85-d723b1c50017 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f1309abebb4778a8a907cd6c8142c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:44:57.340902 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3711fbbc-c1fb-4fbe-ac85-d723b1c50017 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59" status: 200 len: 1358 microversion: 2.1 time: 0.176653 Oct 17 14:44:57.341523 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3435/7006] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:44:57 2022] GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:44:58.366744 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5745aa2d-61c9-488e-b7d9-d057e033b901 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:44:58.368103 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5745aa2d-61c9-488e-b7d9-d057e033b901 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:44:58.377217 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5745aa2d-61c9-488e-b7d9-d057e033b901 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:58.377885 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5745aa2d-61c9-488e-b7d9-d057e033b901 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:58.383749 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5745aa2d-61c9-488e-b7d9-d057e033b901 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:58.384556 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5745aa2d-61c9-488e-b7d9-d057e033b901 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:58.385046 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5745aa2d-61c9-488e-b7d9-d057e033b901 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:58.385481 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5745aa2d-61c9-488e-b7d9-d057e033b901 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:58.553051 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5745aa2d-61c9-488e-b7d9-d057e033b901 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f1309abebb4778a8a907cd6c8142c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:44:58.561163 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5745aa2d-61c9-488e-b7d9-d057e033b901 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59" status: 200 len: 1358 microversion: 2.1 time: 0.199283 Oct 17 14:44:58.561748 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3572/7007] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:44:58 2022] GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59 => generated 1358 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:44:59.586504 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-69a46c9f-ce64-4b44-8420-05811bd0566d tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:44:59.587305 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-69a46c9f-ce64-4b44-8420-05811bd0566d tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:44:59.590141 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:44:59.605681 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69a46c9f-ce64-4b44-8420-05811bd0566d tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:59.606210 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69a46c9f-ce64-4b44-8420-05811bd0566d tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:59.606667 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69a46c9f-ce64-4b44-8420-05811bd0566d tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:59.607445 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69a46c9f-ce64-4b44-8420-05811bd0566d tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:59.607926 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69a46c9f-ce64-4b44-8420-05811bd0566d tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:59.608430 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69a46c9f-ce64-4b44-8420-05811bd0566d tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:59.795419 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-69a46c9f-ce64-4b44-8420-05811bd0566d tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f1309abebb4778a8a907cd6c8142c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:44:59.806974 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-69a46c9f-ce64-4b44-8420-05811bd0566d tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59" status: 200 len: 1358 microversion: 2.1 time: 0.224687 Oct 17 14:44:59.807990 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3436/7008] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:44:59 2022] GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59 => generated 1358 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:45:00.833149 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5dab6e8b-c6c5-4584-bd7b-dc78433c00ed tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:45:00.833846 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5dab6e8b-c6c5-4584-bd7b-dc78433c00ed tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:45:00.843283 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5dab6e8b-c6c5-4584-bd7b-dc78433c00ed tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:00.843888 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5dab6e8b-c6c5-4584-bd7b-dc78433c00ed tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:00.844468 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5dab6e8b-c6c5-4584-bd7b-dc78433c00ed tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:00.845222 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5dab6e8b-c6c5-4584-bd7b-dc78433c00ed tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:00.845809 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5dab6e8b-c6c5-4584-bd7b-dc78433c00ed tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:00.846230 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5dab6e8b-c6c5-4584-bd7b-dc78433c00ed tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:01.011973 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5dab6e8b-c6c5-4584-bd7b-dc78433c00ed tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f1309abebb4778a8a907cd6c8142c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:45:01.024093 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5dab6e8b-c6c5-4584-bd7b-dc78433c00ed tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59" status: 200 len: 1358 microversion: 2.1 time: 0.195112 Oct 17 14:45:01.024856 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3573/7009] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:45:00 2022] GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59 => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:45:02.048720 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-fc5228b2-7572-41fd-b4ca-c9ca140e5246 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:45:02.049680 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-fc5228b2-7572-41fd-b4ca-c9ca140e5246 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:45:02.058041 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fc5228b2-7572-41fd-b4ca-c9ca140e5246 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:02.058550 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fc5228b2-7572-41fd-b4ca-c9ca140e5246 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:02.058981 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fc5228b2-7572-41fd-b4ca-c9ca140e5246 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:02.059730 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fc5228b2-7572-41fd-b4ca-c9ca140e5246 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:02.060212 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fc5228b2-7572-41fd-b4ca-c9ca140e5246 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:02.060847 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fc5228b2-7572-41fd-b4ca-c9ca140e5246 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:02.230637 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-fc5228b2-7572-41fd-b4ca-c9ca140e5246 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f1309abebb4778a8a907cd6c8142c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:45:02.239776 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-fc5228b2-7572-41fd-b4ca-c9ca140e5246 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59" status: 200 len: 1358 microversion: 2.1 time: 0.196289 Oct 17 14:45:02.240393 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3437/7010] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:45:02 2022] GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59 => generated 1358 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:45:03.263755 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a9f074e3-8478-4948-be55-54ab4b49bc3f tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:45:03.264431 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a9f074e3-8478-4948-be55-54ab4b49bc3f tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:45:03.272531 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a9f074e3-8478-4948-be55-54ab4b49bc3f tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:03.273014 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a9f074e3-8478-4948-be55-54ab4b49bc3f tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:03.273428 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a9f074e3-8478-4948-be55-54ab4b49bc3f tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:03.274151 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a9f074e3-8478-4948-be55-54ab4b49bc3f tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:03.274607 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a9f074e3-8478-4948-be55-54ab4b49bc3f tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:03.275088 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a9f074e3-8478-4948-be55-54ab4b49bc3f tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:03.477166 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a9f074e3-8478-4948-be55-54ab4b49bc3f tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f1309abebb4778a8a907cd6c8142c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:45:03.485642 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a9f074e3-8478-4948-be55-54ab4b49bc3f tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59" status: 200 len: 1358 microversion: 2.1 time: 0.225783 Oct 17 14:45:03.486303 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3574/7011] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:45:03 2022] GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59 => generated 1358 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:45:04.168773 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-1f561b3f-d98f-4888-9f2b-8b953739e7b3 req-5e0415fc-0735-4556-825b-67ca0fbaa357 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eb08c2a-ab33-4b2a-b578-0cf5a5045b59", "tag": "b4b57732-ab91-4910-9b2c-354e0a7647fc"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:45:04.180145 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:45:04.181247 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=6 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:45:04.183350 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-1f561b3f-d98f-4888-9f2b-8b953739e7b3 req-5e0415fc-0735-4556-825b-67ca0fbaa357 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:04.183841 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-1f561b3f-d98f-4888-9f2b-8b953739e7b3 req-5e0415fc-0735-4556-825b-67ca0fbaa357 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:04.184283 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-1f561b3f-d98f-4888-9f2b-8b953739e7b3 req-5e0415fc-0735-4556-825b-67ca0fbaa357 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:04.198696 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-1f561b3f-d98f-4888-9f2b-8b953739e7b3 req-5e0415fc-0735-4556-825b-67ca0fbaa357 service nova] Creating event network-changed:b4b57732-ab91-4910-9b2c-354e0a7647fc for instance 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59 on n-h1-854247-14 Oct 17 14:45:04.206301 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-1f561b3f-d98f-4888-9f2b-8b953739e7b3 req-5e0415fc-0735-4556-825b-67ca0fbaa357 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042176 Oct 17 14:45:04.208023 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3438/7012] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:45:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:45:04.510514 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-11e01b40-4c48-4354-95fb-f4c22b293aa3 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:45:04.511287 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-11e01b40-4c48-4354-95fb-f4c22b293aa3 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:45:04.513254 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=6 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:45:04.525794 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-11e01b40-4c48-4354-95fb-f4c22b293aa3 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:04.526297 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-11e01b40-4c48-4354-95fb-f4c22b293aa3 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:04.526740 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-11e01b40-4c48-4354-95fb-f4c22b293aa3 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:04.527485 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-11e01b40-4c48-4354-95fb-f4c22b293aa3 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:04.527961 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-11e01b40-4c48-4354-95fb-f4c22b293aa3 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:04.528390 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-11e01b40-4c48-4354-95fb-f4c22b293aa3 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:04.730623 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-11e01b40-4c48-4354-95fb-f4c22b293aa3 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f1309abebb4778a8a907cd6c8142c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:45:04.738977 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-11e01b40-4c48-4354-95fb-f4c22b293aa3 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59" status: 200 len: 1358 microversion: 2.1 time: 0.232577 Oct 17 14:45:04.739670 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3575/7013] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:45:04 2022] GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59 => generated 1358 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:45:05.766201 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-be51c3ad-eeea-467e-90df-d6ccb3133fba tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:45:05.767135 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-be51c3ad-eeea-467e-90df-d6ccb3133fba tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:45:05.774818 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-be51c3ad-eeea-467e-90df-d6ccb3133fba tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:05.775387 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-be51c3ad-eeea-467e-90df-d6ccb3133fba tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:05.775905 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-be51c3ad-eeea-467e-90df-d6ccb3133fba tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:05.776565 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-be51c3ad-eeea-467e-90df-d6ccb3133fba tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:05.777032 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-be51c3ad-eeea-467e-90df-d6ccb3133fba tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:05.777470 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-be51c3ad-eeea-467e-90df-d6ccb3133fba tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:05.996501 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-be51c3ad-eeea-467e-90df-d6ccb3133fba tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f1309abebb4778a8a907cd6c8142c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:45:06.005613 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-be51c3ad-eeea-467e-90df-d6ccb3133fba tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59" status: 200 len: 1358 microversion: 2.1 time: 0.246554 Oct 17 14:45:06.006227 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3439/7014] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:45:05 2022] GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59 => generated 1358 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:45:07.029571 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f40a4856-30dd-4ec0-b157-0645c47f4d06 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:45:07.030283 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f40a4856-30dd-4ec0-b157-0645c47f4d06 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:45:07.039268 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f40a4856-30dd-4ec0-b157-0645c47f4d06 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:07.039869 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f40a4856-30dd-4ec0-b157-0645c47f4d06 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:07.040516 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f40a4856-30dd-4ec0-b157-0645c47f4d06 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:07.041219 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f40a4856-30dd-4ec0-b157-0645c47f4d06 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:07.041691 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f40a4856-30dd-4ec0-b157-0645c47f4d06 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:07.042198 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f40a4856-30dd-4ec0-b157-0645c47f4d06 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:07.187620 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f40a4856-30dd-4ec0-b157-0645c47f4d06 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f1309abebb4778a8a907cd6c8142c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:45:07.197985 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f40a4856-30dd-4ec0-b157-0645c47f4d06 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59" status: 200 len: 1358 microversion: 2.1 time: 0.172519 Oct 17 14:45:07.198593 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3576/7015] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:45:07 2022] GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:45:08.221837 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3ae9f9e0-43c8-40bb-a5eb-f87ce342f505 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:45:08.223222 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3ae9f9e0-43c8-40bb-a5eb-f87ce342f505 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:45:08.230745 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3ae9f9e0-43c8-40bb-a5eb-f87ce342f505 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:08.231286 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3ae9f9e0-43c8-40bb-a5eb-f87ce342f505 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:08.231729 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3ae9f9e0-43c8-40bb-a5eb-f87ce342f505 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:08.232454 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3ae9f9e0-43c8-40bb-a5eb-f87ce342f505 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:08.232916 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3ae9f9e0-43c8-40bb-a5eb-f87ce342f505 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:08.233381 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3ae9f9e0-43c8-40bb-a5eb-f87ce342f505 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:08.382303 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3ae9f9e0-43c8-40bb-a5eb-f87ce342f505 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f1309abebb4778a8a907cd6c8142c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:45:08.390440 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3ae9f9e0-43c8-40bb-a5eb-f87ce342f505 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59" status: 200 len: 1358 microversion: 2.1 time: 0.172616 Oct 17 14:45:08.391075 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3440/7016] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:45:08 2022] GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:45:09.414196 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b625d022-40ff-4427-b6c1-33df018d299a tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:45:09.414790 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b625d022-40ff-4427-b6c1-33df018d299a tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:45:09.423034 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b625d022-40ff-4427-b6c1-33df018d299a tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:09.423595 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b625d022-40ff-4427-b6c1-33df018d299a tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:09.424155 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b625d022-40ff-4427-b6c1-33df018d299a tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:09.424940 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b625d022-40ff-4427-b6c1-33df018d299a tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:09.425535 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b625d022-40ff-4427-b6c1-33df018d299a tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:09.426088 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b625d022-40ff-4427-b6c1-33df018d299a tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:09.573877 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b625d022-40ff-4427-b6c1-33df018d299a tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f1309abebb4778a8a907cd6c8142c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:45:09.583905 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b625d022-40ff-4427-b6c1-33df018d299a tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59" status: 200 len: 1358 microversion: 2.1 time: 0.173666 Oct 17 14:45:09.584519 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3577/7017] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:45:09 2022] GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:45:09.995599 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-317b0a6d-f5a7-44c8-b48a-fba10e5dd613 req-bbbe5b38-8660-4889-ba77-18ed973f5181 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eb08c2a-ab33-4b2a-b578-0cf5a5045b59", "name": "network-vif-plugged", "status": "completed", "tag": "b4b57732-ab91-4910-9b2c-354e0a7647fc"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:45:10.006415 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-317b0a6d-f5a7-44c8-b48a-fba10e5dd613 req-bbbe5b38-8660-4889-ba77-18ed973f5181 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:10.006904 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-317b0a6d-f5a7-44c8-b48a-fba10e5dd613 req-bbbe5b38-8660-4889-ba77-18ed973f5181 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:10.007417 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-317b0a6d-f5a7-44c8-b48a-fba10e5dd613 req-bbbe5b38-8660-4889-ba77-18ed973f5181 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:10.019902 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-317b0a6d-f5a7-44c8-b48a-fba10e5dd613 req-bbbe5b38-8660-4889-ba77-18ed973f5181 service nova] Creating event network-vif-plugged:b4b57732-ab91-4910-9b2c-354e0a7647fc for instance 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59 on n-h1-854247-14 Oct 17 14:45:10.025399 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-317b0a6d-f5a7-44c8-b48a-fba10e5dd613 req-bbbe5b38-8660-4889-ba77-18ed973f5181 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111929 Oct 17 14:45:10.026097 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3441/7018] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:45:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:45:10.610867 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c7028278-8526-40f8-b104-777400602be4 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:45:10.612022 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c7028278-8526-40f8-b104-777400602be4 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:45:10.620170 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c7028278-8526-40f8-b104-777400602be4 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:10.620662 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c7028278-8526-40f8-b104-777400602be4 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:10.621093 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c7028278-8526-40f8-b104-777400602be4 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:10.621795 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c7028278-8526-40f8-b104-777400602be4 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:10.622244 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c7028278-8526-40f8-b104-777400602be4 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:10.622979 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c7028278-8526-40f8-b104-777400602be4 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:10.779940 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c7028278-8526-40f8-b104-777400602be4 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f1309abebb4778a8a907cd6c8142c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:45:10.790848 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c7028278-8526-40f8-b104-777400602be4 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59" status: 200 len: 1358 microversion: 2.1 time: 0.186408 Oct 17 14:45:10.791479 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3578/7019] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:45:10 2022] GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59 => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:45:11.819252 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-48edbc8c-2abf-44a8-92b3-c9f8437f6d7a tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:45:11.819977 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-48edbc8c-2abf-44a8-92b3-c9f8437f6d7a tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:45:11.826562 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48edbc8c-2abf-44a8-92b3-c9f8437f6d7a tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:11.827058 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48edbc8c-2abf-44a8-92b3-c9f8437f6d7a tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:11.827548 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48edbc8c-2abf-44a8-92b3-c9f8437f6d7a tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:11.828250 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48edbc8c-2abf-44a8-92b3-c9f8437f6d7a tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:11.828722 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48edbc8c-2abf-44a8-92b3-c9f8437f6d7a tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:11.829160 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48edbc8c-2abf-44a8-92b3-c9f8437f6d7a tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:11.978418 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-48edbc8c-2abf-44a8-92b3-c9f8437f6d7a tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f1309abebb4778a8a907cd6c8142c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:45:11.989355 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-48edbc8c-2abf-44a8-92b3-c9f8437f6d7a tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59" status: 200 len: 1547 microversion: 2.1 time: 0.176633 Oct 17 14:45:11.989967 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3442/7020] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:45:11 2022] GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59 => generated 1547 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:45:12.013512 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-db69ca56-7429-40bb-b0f6-a3e6f779ac0c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:45:12.014195 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-db69ca56-7429-40bb-b0f6-a3e6f779ac0c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:45:12.025139 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-db69ca56-7429-40bb-b0f6-a3e6f779ac0c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:12.025999 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-db69ca56-7429-40bb-b0f6-a3e6f779ac0c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:12.026732 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-db69ca56-7429-40bb-b0f6-a3e6f779ac0c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:12.028040 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-db69ca56-7429-40bb-b0f6-a3e6f779ac0c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:12.028769 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-db69ca56-7429-40bb-b0f6-a3e6f779ac0c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:12.029443 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-db69ca56-7429-40bb-b0f6-a3e6f779ac0c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:12.186973 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-db69ca56-7429-40bb-b0f6-a3e6f779ac0c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f1309abebb4778a8a907cd6c8142c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:45:12.199856 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-db69ca56-7429-40bb-b0f6-a3e6f779ac0c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59" status: 200 len: 1547 microversion: 2.1 time: 0.191416 Oct 17 14:45:12.200402 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3579/7021] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:45:12 2022] GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59 => generated 1547 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:45:12.225558 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1bca6595-0981-47f6-9626-caa46da8b1f7 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:45:12.230897 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1bca6595-0981-47f6-9626-caa46da8b1f7 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd2f1309abebb4778a8a907cd6c8142c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:45:12.231732 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1bca6595-0981-47f6-9626-caa46da8b1f7 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Searching by: {'deleted': False, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96'} {{(pid=127017) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 14:45:12.237553 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1bca6595-0981-47f6-9626-caa46da8b1f7 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:12.238078 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1bca6595-0981-47f6-9626-caa46da8b1f7 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:12.238525 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1bca6595-0981-47f6-9626-caa46da8b1f7 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:12.239331 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1bca6595-0981-47f6-9626-caa46da8b1f7 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:12.239870 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1bca6595-0981-47f6-9626-caa46da8b1f7 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:12.240255 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1bca6595-0981-47f6-9626-caa46da8b1f7 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:12.266108 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.multi_cell_list [None req-1bca6595-0981-47f6-9626-caa46da8b1f7 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127017) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 14:45:12.296430 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1bca6595-0981-47f6-9626-caa46da8b1f7 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.075485 Oct 17 14:45:12.297035 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3443/7022] 10.222.0.79 () {58 vars in 1125 bytes} [Mon Oct 17 14:45:12 2022] GET /compute/v2.1/servers => generated 342 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:45:12.310530 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2621389c-ab5f-4820-8b39-584de4d0f584 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:45:12.311203 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2621389c-ab5f-4820-8b39-584de4d0f584 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:45:12.319463 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2621389c-ab5f-4820-8b39-584de4d0f584 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:12.319952 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2621389c-ab5f-4820-8b39-584de4d0f584 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:12.320391 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2621389c-ab5f-4820-8b39-584de4d0f584 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:12.321081 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2621389c-ab5f-4820-8b39-584de4d0f584 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:12.321686 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2621389c-ab5f-4820-8b39-584de4d0f584 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:12.321969 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2621389c-ab5f-4820-8b39-584de4d0f584 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:12.474663 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2621389c-ab5f-4820-8b39-584de4d0f584 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f1309abebb4778a8a907cd6c8142c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:45:12.482828 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2621389c-ab5f-4820-8b39-584de4d0f584 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59" status: 200 len: 1547 microversion: 2.1 time: 0.177651 Oct 17 14:45:12.483474 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3580/7023] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:45:12 2022] GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59 => generated 1547 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:45:14.075411 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-90171ff9-5023-403a-9e94-3266f59f4753 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b962bda2-49f6-4fc5-b1b1-68a193084267"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:45:14.078197 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-90171ff9-5023-403a-9e94-3266f59f4753 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:45:14.087154 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-90171ff9-5023-403a-9e94-3266f59f4753 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:14.087750 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-90171ff9-5023-403a-9e94-3266f59f4753 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:14.088233 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-90171ff9-5023-403a-9e94-3266f59f4753 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:14.088928 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-90171ff9-5023-403a-9e94-3266f59f4753 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:14.089373 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-90171ff9-5023-403a-9e94-3266f59f4753 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:14.089795 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-90171ff9-5023-403a-9e94-3266f59f4753 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:14.375205 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-90171ff9-5023-403a-9e94-3266f59f4753 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "POST /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.306403 Oct 17 14:45:14.376098 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3444/7024] 10.222.0.79 () {60 vars in 1323 bytes} [Mon Oct 17 14:45:14 2022] POST /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59/os-volume_attachments => generated 194 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:45:25.331088 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4d96bfac-a9c5-4be3-8a83-58be82acc3ec tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:45:25.331905 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4d96bfac-a9c5-4be3-8a83-58be82acc3ec tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:45:25.334953 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:45:25.335691 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=60 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:45:25.342871 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d96bfac-a9c5-4be3-8a83-58be82acc3ec tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:25.343600 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d96bfac-a9c5-4be3-8a83-58be82acc3ec tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:25.344183 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d96bfac-a9c5-4be3-8a83-58be82acc3ec tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:25.345288 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d96bfac-a9c5-4be3-8a83-58be82acc3ec tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:25.346003 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d96bfac-a9c5-4be3-8a83-58be82acc3ec tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:25.350051 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4d96bfac-a9c5-4be3-8a83-58be82acc3ec tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:25.513873 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4d96bfac-a9c5-4be3-8a83-58be82acc3ec tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f1309abebb4778a8a907cd6c8142c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:45:25.523117 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4d96bfac-a9c5-4be3-8a83-58be82acc3ec tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59" status: 200 len: 1593 microversion: 2.1 time: 0.198709 Oct 17 14:45:25.523709 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3581/7025] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:45:25 2022] GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59 => generated 1593 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:45:27.619570 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-4f752802-5f14-483b-af11-40e6bfde269d req-8c9e11ce-f739-4c0a-bac2-c0ead1a3864c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eb08c2a-ab33-4b2a-b578-0cf5a5045b59", "tag": "b4b57732-ab91-4910-9b2c-354e0a7647fc"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:45:27.625738 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:45:27.626801 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=17 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:45:27.627777 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:45:27.635130 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-4f752802-5f14-483b-af11-40e6bfde269d req-8c9e11ce-f739-4c0a-bac2-c0ead1a3864c service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:27.635667 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-4f752802-5f14-483b-af11-40e6bfde269d req-8c9e11ce-f739-4c0a-bac2-c0ead1a3864c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:27.636123 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-4f752802-5f14-483b-af11-40e6bfde269d req-8c9e11ce-f739-4c0a-bac2-c0ead1a3864c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:27.649557 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-4f752802-5f14-483b-af11-40e6bfde269d req-8c9e11ce-f739-4c0a-bac2-c0ead1a3864c service nova] Creating event network-changed:b4b57732-ab91-4910-9b2c-354e0a7647fc for instance 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59 on n-h1-854247-14 Oct 17 14:45:27.654922 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-4f752802-5f14-483b-af11-40e6bfde269d req-8c9e11ce-f739-4c0a-bac2-c0ead1a3864c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039582 Oct 17 14:45:27.658838 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3445/7026] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:45:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:45:28.699513 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6b4d84f6-f091-420a-b1c6-1bb5ae0e8122 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-106872386"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:45:28.700672 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6b4d84f6-f091-420a-b1c6-1bb5ae0e8122 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:45:28.708550 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6b4d84f6-f091-420a-b1c6-1bb5ae0e8122 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:28.709318 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6b4d84f6-f091-420a-b1c6-1bb5ae0e8122 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:28.709731 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6b4d84f6-f091-420a-b1c6-1bb5ae0e8122 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:28.710455 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6b4d84f6-f091-420a-b1c6-1bb5ae0e8122 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:28.710945 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6b4d84f6-f091-420a-b1c6-1bb5ae0e8122 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:28.711341 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6b4d84f6-f091-420a-b1c6-1bb5ae0e8122 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:28.848428 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.network.security_group_api [None req-6b4d84f6-f091-420a-b1c6-1bb5ae0e8122 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Adding security group bb9e4a60-b658-4484-860a-8df419be25cc to port b4b57732-ab91-4910-9b2c-354e0a7647fc Oct 17 14:45:29.190606 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6b4d84f6-f091-420a-b1c6-1bb5ae0e8122 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "POST /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59/action" status: 202 len: 0 microversion: 2.1 time: 0.495056 Oct 17 14:45:29.191607 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3582/7027] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:45:28 2022] POST /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59/action => generated 0 bytes in 497 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:45:29.202332 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-68e6575a-9152-4a91-8178-e25d3bb0ae5c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:45:29.203348 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-68e6575a-9152-4a91-8178-e25d3bb0ae5c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:45:29.211588 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-68e6575a-9152-4a91-8178-e25d3bb0ae5c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:29.213397 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-68e6575a-9152-4a91-8178-e25d3bb0ae5c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:29.214090 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-68e6575a-9152-4a91-8178-e25d3bb0ae5c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:29.215607 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-68e6575a-9152-4a91-8178-e25d3bb0ae5c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:29.216780 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-68e6575a-9152-4a91-8178-e25d3bb0ae5c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:29.217393 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-68e6575a-9152-4a91-8178-e25d3bb0ae5c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:29.375188 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-68e6575a-9152-4a91-8178-e25d3bb0ae5c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f1309abebb4778a8a907cd6c8142c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:45:29.384373 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-68e6575a-9152-4a91-8178-e25d3bb0ae5c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59" status: 200 len: 1757 microversion: 2.1 time: 0.187941 Oct 17 14:45:29.384966 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3446/7028] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:45:29 2022] GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59 => generated 1757 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:45:29.670203 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-b3aa3489-7954-41b1-a472-a9b69b33e487 req-d81f4bad-33d1-4592-95df-971513acecd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eb08c2a-ab33-4b2a-b578-0cf5a5045b59", "tag": "b4b57732-ab91-4910-9b2c-354e0a7647fc"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:45:29.681036 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-b3aa3489-7954-41b1-a472-a9b69b33e487 req-d81f4bad-33d1-4592-95df-971513acecd2 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:29.681507 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-b3aa3489-7954-41b1-a472-a9b69b33e487 req-d81f4bad-33d1-4592-95df-971513acecd2 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:29.681938 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-b3aa3489-7954-41b1-a472-a9b69b33e487 req-d81f4bad-33d1-4592-95df-971513acecd2 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:29.695051 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-b3aa3489-7954-41b1-a472-a9b69b33e487 req-d81f4bad-33d1-4592-95df-971513acecd2 service nova] Creating event network-changed:b4b57732-ab91-4910-9b2c-354e0a7647fc for instance 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59 on n-h1-854247-14 Oct 17 14:45:29.700831 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-b3aa3489-7954-41b1-a472-a9b69b33e487 req-d81f4bad-33d1-4592-95df-971513acecd2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034329 Oct 17 14:45:29.702172 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3583/7029] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:45:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:45:43.306066 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3e9909a4-8ed4-47ed-875d-b981a003b7ed tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:45:43.308443 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3e9909a4-8ed4-47ed-875d-b981a003b7ed tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:45:43.311192 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=4 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:45:43.311906 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=8 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:45:43.319071 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3e9909a4-8ed4-47ed-875d-b981a003b7ed tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:43.319623 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3e9909a4-8ed4-47ed-875d-b981a003b7ed tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:43.320077 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3e9909a4-8ed4-47ed-875d-b981a003b7ed tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:43.320807 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3e9909a4-8ed4-47ed-875d-b981a003b7ed tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:43.321278 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3e9909a4-8ed4-47ed-875d-b981a003b7ed tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:43.321721 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3e9909a4-8ed4-47ed-875d-b981a003b7ed tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:43.406777 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3e9909a4-8ed4-47ed-875d-b981a003b7ed tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "POST /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59/action" status: 202 len: 0 microversion: 2.1 time: 0.104489 Oct 17 14:45:43.407876 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3447/7030] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:45:43 2022] POST /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:45:43.415865 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=6 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:45:43.416970 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=12 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:45:43.422333 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f2477e6d-014b-4b6d-81d3-ee4d7da1cc7c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:45:43.423402 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f2477e6d-014b-4b6d-81d3-ee4d7da1cc7c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:45:43.442806 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f2477e6d-014b-4b6d-81d3-ee4d7da1cc7c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:43.443348 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f2477e6d-014b-4b6d-81d3-ee4d7da1cc7c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:43.443813 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f2477e6d-014b-4b6d-81d3-ee4d7da1cc7c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:43.444560 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f2477e6d-014b-4b6d-81d3-ee4d7da1cc7c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:43.444990 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f2477e6d-014b-4b6d-81d3-ee4d7da1cc7c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:43.445571 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f2477e6d-014b-4b6d-81d3-ee4d7da1cc7c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:43.694608 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f2477e6d-014b-4b6d-81d3-ee4d7da1cc7c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f1309abebb4778a8a907cd6c8142c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:45:43.705585 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f2477e6d-014b-4b6d-81d3-ee4d7da1cc7c tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59" status: 200 len: 1749 microversion: 2.1 time: 0.292670 Oct 17 14:45:43.706674 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3584/7031] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:45:43 2022] GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59 => generated 1749 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:45:44.738017 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-30d90d43-b633-4a9d-bbf7-77e368f91fbf tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:45:44.738759 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-30d90d43-b633-4a9d-bbf7-77e368f91fbf tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:45:44.746659 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-30d90d43-b633-4a9d-bbf7-77e368f91fbf tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:44.747523 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-30d90d43-b633-4a9d-bbf7-77e368f91fbf tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:44.747975 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-30d90d43-b633-4a9d-bbf7-77e368f91fbf tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:44.748696 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-30d90d43-b633-4a9d-bbf7-77e368f91fbf tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:44.749161 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-30d90d43-b633-4a9d-bbf7-77e368f91fbf tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:44.749595 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-30d90d43-b633-4a9d-bbf7-77e368f91fbf tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:44.909731 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-30d90d43-b633-4a9d-bbf7-77e368f91fbf tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f1309abebb4778a8a907cd6c8142c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:45:44.918645 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-30d90d43-b633-4a9d-bbf7-77e368f91fbf tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59" status: 200 len: 1754 microversion: 2.1 time: 0.185103 Oct 17 14:45:44.919201 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3448/7032] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:45:44 2022] GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59 => generated 1754 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:45:45.943100 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-83ff0202-ca43-455b-aa1f-9dd8a62e6c6d tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:45:45.943737 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-83ff0202-ca43-455b-aa1f-9dd8a62e6c6d tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:45:45.950888 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-83ff0202-ca43-455b-aa1f-9dd8a62e6c6d tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:45.951421 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-83ff0202-ca43-455b-aa1f-9dd8a62e6c6d tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:45.951848 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-83ff0202-ca43-455b-aa1f-9dd8a62e6c6d tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:45.952552 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-83ff0202-ca43-455b-aa1f-9dd8a62e6c6d tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:45.953000 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-83ff0202-ca43-455b-aa1f-9dd8a62e6c6d tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:45.953412 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-83ff0202-ca43-455b-aa1f-9dd8a62e6c6d tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:46.102787 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-83ff0202-ca43-455b-aa1f-9dd8a62e6c6d tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f1309abebb4778a8a907cd6c8142c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:45:46.111785 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-83ff0202-ca43-455b-aa1f-9dd8a62e6c6d tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59" status: 200 len: 1754 microversion: 2.1 time: 0.172954 Oct 17 14:45:46.112462 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3585/7033] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:45:45 2022] GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59 => generated 1754 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:45:47.189835 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f2239f62-e274-4800-bd99-488387725927 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:45:47.190731 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f2239f62-e274-4800-bd99-488387725927 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:45:47.197196 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f2239f62-e274-4800-bd99-488387725927 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:47.197729 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f2239f62-e274-4800-bd99-488387725927 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:47.198167 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f2239f62-e274-4800-bd99-488387725927 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:47.198858 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f2239f62-e274-4800-bd99-488387725927 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:47.199385 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f2239f62-e274-4800-bd99-488387725927 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:47.199823 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f2239f62-e274-4800-bd99-488387725927 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:47.359992 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f2239f62-e274-4800-bd99-488387725927 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f1309abebb4778a8a907cd6c8142c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:45:47.370135 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f2239f62-e274-4800-bd99-488387725927 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59" status: 200 len: 1754 microversion: 2.1 time: 0.237906 Oct 17 14:45:47.370724 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3449/7034] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:45:47 2022] GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59 => generated 1754 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:45:48.394383 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5ab78d5b-d75b-45bf-af53-7bab55f32d73 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:45:48.394934 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5ab78d5b-d75b-45bf-af53-7bab55f32d73 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:45:48.402259 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5ab78d5b-d75b-45bf-af53-7bab55f32d73 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:48.402747 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5ab78d5b-d75b-45bf-af53-7bab55f32d73 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:48.403200 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5ab78d5b-d75b-45bf-af53-7bab55f32d73 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:48.403917 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5ab78d5b-d75b-45bf-af53-7bab55f32d73 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:48.404367 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5ab78d5b-d75b-45bf-af53-7bab55f32d73 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:48.404792 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5ab78d5b-d75b-45bf-af53-7bab55f32d73 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:48.556077 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5ab78d5b-d75b-45bf-af53-7bab55f32d73 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f1309abebb4778a8a907cd6c8142c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:45:48.565250 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5ab78d5b-d75b-45bf-af53-7bab55f32d73 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59" status: 200 len: 1754 microversion: 2.1 time: 0.175347 Oct 17 14:45:48.566225 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3586/7035] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:45:48 2022] GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59 => generated 1754 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:45:49.588555 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ea5702f6-5471-4d5b-8b8a-224004f86358 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:45:49.589178 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ea5702f6-5471-4d5b-8b8a-224004f86358 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:45:49.596772 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ea5702f6-5471-4d5b-8b8a-224004f86358 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:49.597053 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ea5702f6-5471-4d5b-8b8a-224004f86358 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:49.597509 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ea5702f6-5471-4d5b-8b8a-224004f86358 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:49.598237 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ea5702f6-5471-4d5b-8b8a-224004f86358 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:49.598686 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ea5702f6-5471-4d5b-8b8a-224004f86358 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:49.599129 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ea5702f6-5471-4d5b-8b8a-224004f86358 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:49.762046 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ea5702f6-5471-4d5b-8b8a-224004f86358 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f1309abebb4778a8a907cd6c8142c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:45:49.771032 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ea5702f6-5471-4d5b-8b8a-224004f86358 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59" status: 200 len: 1754 microversion: 2.1 time: 0.186476 Oct 17 14:45:49.771653 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3450/7036] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:45:49 2022] GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59 => generated 1754 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:45:50.794961 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d5651314-97ea-4052-bdef-bf5547ac87c4 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:45:50.795625 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d5651314-97ea-4052-bdef-bf5547ac87c4 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:45:50.803462 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d5651314-97ea-4052-bdef-bf5547ac87c4 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:50.804146 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d5651314-97ea-4052-bdef-bf5547ac87c4 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:50.804585 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d5651314-97ea-4052-bdef-bf5547ac87c4 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:50.805283 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d5651314-97ea-4052-bdef-bf5547ac87c4 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:50.805724 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d5651314-97ea-4052-bdef-bf5547ac87c4 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:50.806149 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d5651314-97ea-4052-bdef-bf5547ac87c4 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:50.956583 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d5651314-97ea-4052-bdef-bf5547ac87c4 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f1309abebb4778a8a907cd6c8142c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:45:50.965421 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d5651314-97ea-4052-bdef-bf5547ac87c4 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59" status: 200 len: 1754 microversion: 2.1 time: 0.174500 Oct 17 14:45:50.965983 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3587/7037] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:45:50 2022] GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59 => generated 1754 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:45:51.988987 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2334e20f-06a9-4cf1-9d5a-435357d4c2b1 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:45:51.989594 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2334e20f-06a9-4cf1-9d5a-435357d4c2b1 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:45:51.997540 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2334e20f-06a9-4cf1-9d5a-435357d4c2b1 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:51.998231 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2334e20f-06a9-4cf1-9d5a-435357d4c2b1 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:51.998759 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2334e20f-06a9-4cf1-9d5a-435357d4c2b1 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:51.999576 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2334e20f-06a9-4cf1-9d5a-435357d4c2b1 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:52.000091 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2334e20f-06a9-4cf1-9d5a-435357d4c2b1 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:52.000557 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2334e20f-06a9-4cf1-9d5a-435357d4c2b1 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:52.152046 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2334e20f-06a9-4cf1-9d5a-435357d4c2b1 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f1309abebb4778a8a907cd6c8142c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:45:52.160979 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2334e20f-06a9-4cf1-9d5a-435357d4c2b1 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59" status: 200 len: 1754 microversion: 2.1 time: 0.176044 Oct 17 14:45:52.161551 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3451/7038] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:45:51 2022] GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59 => generated 1754 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:45:53.185789 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e4c845b1-3f15-4692-bc83-b50969aeb6b7 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:45:53.186397 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e4c845b1-3f15-4692-bc83-b50969aeb6b7 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:45:53.194493 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e4c845b1-3f15-4692-bc83-b50969aeb6b7 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:53.194953 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e4c845b1-3f15-4692-bc83-b50969aeb6b7 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:53.195414 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e4c845b1-3f15-4692-bc83-b50969aeb6b7 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:53.196138 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e4c845b1-3f15-4692-bc83-b50969aeb6b7 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:53.196585 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e4c845b1-3f15-4692-bc83-b50969aeb6b7 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:53.197011 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e4c845b1-3f15-4692-bc83-b50969aeb6b7 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:53.353218 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e4c845b1-3f15-4692-bc83-b50969aeb6b7 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f1309abebb4778a8a907cd6c8142c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:45:53.362445 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e4c845b1-3f15-4692-bc83-b50969aeb6b7 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59" status: 200 len: 1754 microversion: 2.1 time: 0.180527 Oct 17 14:45:53.363345 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3588/7039] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:45:53 2022] GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59 => generated 1754 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:45:54.387193 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8ee7eee1-3ef9-45a6-819f-932dee485916 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:45:54.387774 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8ee7eee1-3ef9-45a6-819f-932dee485916 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:45:54.395508 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8ee7eee1-3ef9-45a6-819f-932dee485916 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:54.396004 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8ee7eee1-3ef9-45a6-819f-932dee485916 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:54.396489 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8ee7eee1-3ef9-45a6-819f-932dee485916 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:54.397217 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8ee7eee1-3ef9-45a6-819f-932dee485916 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:54.397683 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8ee7eee1-3ef9-45a6-819f-932dee485916 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:54.398120 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8ee7eee1-3ef9-45a6-819f-932dee485916 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:54.574019 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8ee7eee1-3ef9-45a6-819f-932dee485916 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f1309abebb4778a8a907cd6c8142c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:45:54.583075 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8ee7eee1-3ef9-45a6-819f-932dee485916 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59" status: 200 len: 1754 microversion: 2.1 time: 0.199980 Oct 17 14:45:54.583689 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3452/7040] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:45:54 2022] GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59 => generated 1754 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:45:55.607666 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f1abb1bb-8b45-41b3-9313-4d30f7612217 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:45:55.608312 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f1abb1bb-8b45-41b3-9313-4d30f7612217 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:45:55.616067 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1abb1bb-8b45-41b3-9313-4d30f7612217 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:55.616583 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1abb1bb-8b45-41b3-9313-4d30f7612217 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:55.617016 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1abb1bb-8b45-41b3-9313-4d30f7612217 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:55.617725 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1abb1bb-8b45-41b3-9313-4d30f7612217 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:55.618174 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1abb1bb-8b45-41b3-9313-4d30f7612217 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:55.618587 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1abb1bb-8b45-41b3-9313-4d30f7612217 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:55.778693 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f1abb1bb-8b45-41b3-9313-4d30f7612217 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f1309abebb4778a8a907cd6c8142c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:45:55.788110 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f1abb1bb-8b45-41b3-9313-4d30f7612217 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59" status: 200 len: 1757 microversion: 2.1 time: 0.184445 Oct 17 14:45:55.788733 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3589/7041] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:45:55 2022] GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59 => generated 1757 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:46:28.121947 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-cbbc1091-7b78-4637-9e11-15e9a139a084 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-106872386"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:46:28.122571 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-cbbc1091-7b78-4637-9e11-15e9a139a084 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:46:28.125093 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=12 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:46:28.125779 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:46:28.132052 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cbbc1091-7b78-4637-9e11-15e9a139a084 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:28.132566 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cbbc1091-7b78-4637-9e11-15e9a139a084 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:28.133024 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cbbc1091-7b78-4637-9e11-15e9a139a084 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:28.133749 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cbbc1091-7b78-4637-9e11-15e9a139a084 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:28.134222 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cbbc1091-7b78-4637-9e11-15e9a139a084 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:28.134666 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cbbc1091-7b78-4637-9e11-15e9a139a084 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:28.267087 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.network.security_group_api [None req-cbbc1091-7b78-4637-9e11-15e9a139a084 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Removing security group bb9e4a60-b658-4484-860a-8df419be25cc from port b4b57732-ab91-4910-9b2c-354e0a7647fc Oct 17 14:46:28.597572 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-cbbc1091-7b78-4637-9e11-15e9a139a084 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "POST /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59/action" status: 202 len: 0 microversion: 2.1 time: 0.480008 Oct 17 14:46:28.602694 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3453/7042] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:46:28 2022] POST /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59/action => generated 0 bytes in 486 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:46:28.609139 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-f9e882a8-8bfb-49c6-baa5-a12b4420ea9f req-9cb399ea-eb53-42e5-a4cb-4b2a929a436d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eb08c2a-ab33-4b2a-b578-0cf5a5045b59", "tag": "b4b57732-ab91-4910-9b2c-354e0a7647fc"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:46:28.618436 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=12 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:46:28.619129 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=36 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:46:28.621104 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-f9e882a8-8bfb-49c6-baa5-a12b4420ea9f req-9cb399ea-eb53-42e5-a4cb-4b2a929a436d service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:28.622297 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-f9e882a8-8bfb-49c6-baa5-a12b4420ea9f req-9cb399ea-eb53-42e5-a4cb-4b2a929a436d service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:28.622719 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-f9e882a8-8bfb-49c6-baa5-a12b4420ea9f req-9cb399ea-eb53-42e5-a4cb-4b2a929a436d service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:28.638865 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-f9e882a8-8bfb-49c6-baa5-a12b4420ea9f req-9cb399ea-eb53-42e5-a4cb-4b2a929a436d service nova] Creating event network-changed:b4b57732-ab91-4910-9b2c-354e0a7647fc for instance 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59 on n-h1-854247-14 Oct 17 14:46:28.646437 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-f9e882a8-8bfb-49c6-baa5-a12b4420ea9f req-9cb399ea-eb53-42e5-a4cb-4b2a929a436d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040200 Oct 17 14:46:28.647495 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3590/7043] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:46:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:46:29.952408 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-680cd2bb-985c-41ec-81dc-897d82b93a8e tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:46:29.953600 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-680cd2bb-985c-41ec-81dc-897d82b93a8e tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:46:29.960027 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-680cd2bb-985c-41ec-81dc-897d82b93a8e tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:29.960604 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-680cd2bb-985c-41ec-81dc-897d82b93a8e tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:29.961130 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-680cd2bb-985c-41ec-81dc-897d82b93a8e tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:29.961916 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-680cd2bb-985c-41ec-81dc-897d82b93a8e tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:29.962447 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-680cd2bb-985c-41ec-81dc-897d82b93a8e tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:29.962890 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-680cd2bb-985c-41ec-81dc-897d82b93a8e tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:30.049637 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-680cd2bb-985c-41ec-81dc-897d82b93a8e tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lazy-loading 'services' on Instance uuid 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59 {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:46:30.125947 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-680cd2bb-985c-41ec-81dc-897d82b93a8e tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "DELETE /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59/os-volume_attachments/b962bda2-49f6-4fc5-b1b1-68a193084267" status: 202 len: 0 microversion: 2.1 time: 0.178386 Oct 17 14:46:30.127345 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3454/7044] 10.222.0.79 () {58 vars in 1416 bytes} [Mon Oct 17 14:46:29 2022] DELETE /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59/os-volume_attachments/b962bda2-49f6-4fc5-b1b1-68a193084267 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:46:30.136968 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a9b55374-9d0e-42af-ab14-c00f6b0d3759 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:46:30.139367 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a9b55374-9d0e-42af-ab14-c00f6b0d3759 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:46:30.147075 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a9b55374-9d0e-42af-ab14-c00f6b0d3759 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:30.147573 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a9b55374-9d0e-42af-ab14-c00f6b0d3759 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:30.148010 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a9b55374-9d0e-42af-ab14-c00f6b0d3759 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:30.148710 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a9b55374-9d0e-42af-ab14-c00f6b0d3759 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:30.149180 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a9b55374-9d0e-42af-ab14-c00f6b0d3759 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:30.149576 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a9b55374-9d0e-42af-ab14-c00f6b0d3759 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:30.182659 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a9b55374-9d0e-42af-ab14-c00f6b0d3759 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050126 Oct 17 14:46:30.183258 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3591/7045] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 14:46:30 2022] GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:46:30.663325 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-b03c85ca-b80c-4be9-b59f-08a4dc8565d4 req-2cc4eced-92ee-4510-9828-69229b6d7109 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eb08c2a-ab33-4b2a-b578-0cf5a5045b59", "tag": "b4b57732-ab91-4910-9b2c-354e0a7647fc"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:46:30.673293 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-b03c85ca-b80c-4be9-b59f-08a4dc8565d4 req-2cc4eced-92ee-4510-9828-69229b6d7109 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:30.673933 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-b03c85ca-b80c-4be9-b59f-08a4dc8565d4 req-2cc4eced-92ee-4510-9828-69229b6d7109 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:30.674515 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-b03c85ca-b80c-4be9-b59f-08a4dc8565d4 req-2cc4eced-92ee-4510-9828-69229b6d7109 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:30.686686 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-b03c85ca-b80c-4be9-b59f-08a4dc8565d4 req-2cc4eced-92ee-4510-9828-69229b6d7109 service nova] Creating event network-changed:b4b57732-ab91-4910-9b2c-354e0a7647fc for instance 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59 on n-h1-854247-14 Oct 17 14:46:30.693897 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-b03c85ca-b80c-4be9-b59f-08a4dc8565d4 req-2cc4eced-92ee-4510-9828-69229b6d7109 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034667 Oct 17 14:46:30.695385 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3455/7046] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:46:31.195774 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d5fbd09a-0bfa-411f-9df0-ecdd8eb76e00 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:46:31.198089 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d5fbd09a-0bfa-411f-9df0-ecdd8eb76e00 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:46:31.205647 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d5fbd09a-0bfa-411f-9df0-ecdd8eb76e00 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:31.206224 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d5fbd09a-0bfa-411f-9df0-ecdd8eb76e00 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:31.206717 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d5fbd09a-0bfa-411f-9df0-ecdd8eb76e00 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:31.208114 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d5fbd09a-0bfa-411f-9df0-ecdd8eb76e00 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:31.208776 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d5fbd09a-0bfa-411f-9df0-ecdd8eb76e00 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:31.209263 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d5fbd09a-0bfa-411f-9df0-ecdd8eb76e00 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:31.242448 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d5fbd09a-0bfa-411f-9df0-ecdd8eb76e00 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051173 Oct 17 14:46:31.243404 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3592/7047] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 14:46:31 2022] GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:46:32.258163 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-69805284-65bf-49cc-84d5-7373dab96a82 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:46:32.260754 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-69805284-65bf-49cc-84d5-7373dab96a82 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:46:32.268782 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69805284-65bf-49cc-84d5-7373dab96a82 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:32.269343 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69805284-65bf-49cc-84d5-7373dab96a82 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:32.270039 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69805284-65bf-49cc-84d5-7373dab96a82 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:32.270911 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69805284-65bf-49cc-84d5-7373dab96a82 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:32.271516 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69805284-65bf-49cc-84d5-7373dab96a82 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:32.272028 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-69805284-65bf-49cc-84d5-7373dab96a82 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:32.306554 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-69805284-65bf-49cc-84d5-7373dab96a82 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053666 Oct 17 14:46:32.307357 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3456/7048] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 14:46:32 2022] GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:46:33.317611 n-d-854247-14 devstack@n-api.service[127016]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 14:46:33.318234 n-d-854247-14 devstack@n-api.service[127016]: Mon Oct 17 14:46:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59/os-volume_attachments (ip 10.222.0.79) !!! Oct 17 14:46:33.322991 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c86d76fe-c4eb-485e-ae59-811bda360cb3 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:46:33.325190 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c86d76fe-c4eb-485e-ae59-811bda360cb3 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:46:33.336793 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c86d76fe-c4eb-485e-ae59-811bda360cb3 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:33.337280 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c86d76fe-c4eb-485e-ae59-811bda360cb3 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:33.337717 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c86d76fe-c4eb-485e-ae59-811bda360cb3 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:33.338427 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c86d76fe-c4eb-485e-ae59-811bda360cb3 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:33.338853 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c86d76fe-c4eb-485e-ae59-811bda360cb3 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:33.339304 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c86d76fe-c4eb-485e-ae59-811bda360cb3 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:33.370896 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c86d76fe-c4eb-485e-ae59-811bda360cb3 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055361 Oct 17 14:46:33.372115 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3593/7049] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 14:46:33 2022] GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:46:34.384824 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-fdaabbb9-375a-4740-85ef-523b45c59c46 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:46:34.386986 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-fdaabbb9-375a-4740-85ef-523b45c59c46 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:46:34.395720 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fdaabbb9-375a-4740-85ef-523b45c59c46 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:34.396267 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fdaabbb9-375a-4740-85ef-523b45c59c46 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:34.396742 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fdaabbb9-375a-4740-85ef-523b45c59c46 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:34.397504 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fdaabbb9-375a-4740-85ef-523b45c59c46 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:34.397972 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fdaabbb9-375a-4740-85ef-523b45c59c46 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:34.398410 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-fdaabbb9-375a-4740-85ef-523b45c59c46 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:34.430715 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-fdaabbb9-375a-4740-85ef-523b45c59c46 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050021 Oct 17 14:46:34.431320 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3457/7050] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 14:46:34 2022] GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:46:35.444374 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-35b9258b-4b98-4019-813f-ae5d88f288a1 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:46:35.446533 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-35b9258b-4b98-4019-813f-ae5d88f288a1 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:46:35.454147 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-35b9258b-4b98-4019-813f-ae5d88f288a1 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:35.454639 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-35b9258b-4b98-4019-813f-ae5d88f288a1 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:35.455069 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-35b9258b-4b98-4019-813f-ae5d88f288a1 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:35.455937 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-35b9258b-4b98-4019-813f-ae5d88f288a1 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:35.456391 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-35b9258b-4b98-4019-813f-ae5d88f288a1 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:35.456814 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-35b9258b-4b98-4019-813f-ae5d88f288a1 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:35.489511 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-35b9258b-4b98-4019-813f-ae5d88f288a1 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049498 Oct 17 14:46:35.490362 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3594/7051] 10.222.0.79 () {58 vars in 1302 bytes} [Mon Oct 17 14:46:35 2022] GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 14:46:35.501712 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7b0e97b4-eadf-47c6-9327-0f7987cad775 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:46:35.502324 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7b0e97b4-eadf-47c6-9327-0f7987cad775 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:46:35.509977 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7b0e97b4-eadf-47c6-9327-0f7987cad775 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:35.510483 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7b0e97b4-eadf-47c6-9327-0f7987cad775 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:35.510938 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7b0e97b4-eadf-47c6-9327-0f7987cad775 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:35.511695 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7b0e97b4-eadf-47c6-9327-0f7987cad775 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:35.512163 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7b0e97b4-eadf-47c6-9327-0f7987cad775 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:35.512605 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7b0e97b4-eadf-47c6-9327-0f7987cad775 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:35.594757 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-7b0e97b4-eadf-47c6-9327-0f7987cad775 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] HTTP exception thrown: Instance 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59 is not attached to volume b962bda2-49f6-4fc5-b1b1-68a193084267 Oct 17 14:46:35.596618 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7b0e97b4-eadf-47c6-9327-0f7987cad775 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Request method failure captured: Oct 17 14:46:35.596618 n-d-854247-14 devstack@n-api.service[127017]: request: DELETE /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59/os-volume_attachments/b962bda2-49f6-4fc5-b1b1-68a193084267 HTTP/1.1 Oct 17 14:46:35.596618 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 14:46:35.596618 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 14:46:35.596618 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 14:46:35.596618 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 14:46:35.596618 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 14:46:35.596618 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 14:46:35.596618 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 14:46:35.596618 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 14:46:35.596618 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTWlqbsv6-8TFzkbZMNrImYpezCcoheAm_h6hYPJTPXG9brnitHKZDw26NceYxcUllza5GDYHtxaHtai5uHb6CrmD9L2OKAJZMuUauOrxr7rK977-_auBYnVIjQ4g_M72joHHWOKhiHJtxt-wovbj9xJatnSaI_iaeq3MithcFCAFxeg Oct 17 14:46:35.596618 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 14:46:35.596618 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 14:46:35.596618 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 14:46:35.596618 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 14:46:35.596618 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 14:46:35.596618 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 14:46:35.596618 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 6c27ab2952064d1ab714d1b4f7ef7c96 Oct 17 14:46:35.596618 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-TestMinimumBasicScenario-1302609953 Oct 17 14:46:35.596618 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 14:46:35.596618 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 14:46:35.596618 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6c27ab2952064d1ab714d1b4f7ef7c96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6c27ab2952064d1ab714d1b4f7ef7c96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6c27ab2952064d1ab714d1b4f7ef7c96"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6c27ab2952064d1ab714d1b4f7ef7c96", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:46:35.596618 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-TestMinimumBasicScenario-1302609953 Oct 17 14:46:35.596618 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 6c27ab2952064d1ab714d1b4f7ef7c96 Oct 17 14:46:35.596618 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1302609953 Oct 17 14:46:35.596618 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-TestMinimumBasicScenario-1302609953-project Oct 17 14:46:35.596618 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 14:46:35.596618 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 14:46:35.596618 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: d2f1309abebb4778a8a907cd6c8142c3 Oct 17 14:46:35.596618 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-TestMinimumBasicScenario-1302609953-project Oct 17 14:46:35.596618 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 14:46:35.596618 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59 is not attached to volume b962bda2-49f6-4fc5-b1b1-68a193084267 Oct 17 14:46:35.596618 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'server_id': '4eb08c2a-ab33-4b2a-b578-0cf5a5045b59', 'id': 'b962bda2-49f6-4fc5-b1b1-68a193084267'} Oct 17 14:46:35.596618 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:46:35.596618 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:46:35.596618 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 17 14:46:35.596618 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 17 14:46:35.596618 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 14:46:35.596618 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 14:46:35.596618 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 17 14:46:35.596618 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 17 14:46:35.596618 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id b962bda2-49f6-4fc5-b1b1-68a193084267. Oct 17 14:46:35.596618 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:46:35.596618 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:46:35.596618 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:46:35.596618 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:46:35.596618 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:46:35.596618 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:46:35.596618 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:46:35.596618 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:46:35.596618 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:46:35.596618 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:46:35.596618 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 17 14:46:35.596618 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 17 14:46:35.596618 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59 is not attached to volume b962bda2-49f6-4fc5-b1b1-68a193084267 Oct 17 14:46:35.596618 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:46:35.596618 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:46:35.596618 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:46:35.596618 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:46:35.596618 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:46:35.596618 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:46:35.601269 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:46:35.601269 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:46:35.601269 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59 is not attached to volume b962bda2-49f6-4fc5-b1b1-68a193084267 Oct 17 14:46:35.601269 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:46:35.601269 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7b0e97b4-eadf-47c6-9327-0f7987cad775 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Returning 404 to user: Instance 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59 is not attached to volume b962bda2-49f6-4fc5-b1b1-68a193084267 {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:46:35.601269 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7b0e97b4-eadf-47c6-9327-0f7987cad775 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "DELETE /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59/os-volume_attachments/b962bda2-49f6-4fc5-b1b1-68a193084267" status: 404 len: 154 microversion: 2.1 time: 0.100564 Oct 17 14:46:35.601269 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3458/7052] 10.222.0.79 () {58 vars in 1416 bytes} [Mon Oct 17 14:46:35 2022] DELETE /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59/os-volume_attachments/b962bda2-49f6-4fc5-b1b1-68a193084267 => generated 154 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:46:38.871751 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b2b79d63-6116-4bdf-9a08-6d942731c278 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:46:38.872300 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b2b79d63-6116-4bdf-9a08-6d942731c278 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:46:38.879802 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b2b79d63-6116-4bdf-9a08-6d942731c278 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:38.880284 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b2b79d63-6116-4bdf-9a08-6d942731c278 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:38.880709 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b2b79d63-6116-4bdf-9a08-6d942731c278 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:38.881402 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b2b79d63-6116-4bdf-9a08-6d942731c278 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:38.881846 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b2b79d63-6116-4bdf-9a08-6d942731c278 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:38.882261 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b2b79d63-6116-4bdf-9a08-6d942731c278 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:38.908764 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b2b79d63-6116-4bdf-9a08-6d942731c278 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:46:38.989307 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b2b79d63-6116-4bdf-9a08-6d942731c278 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "DELETE /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59" status: 204 len: 0 microversion: 2.1 time: 0.121220 Oct 17 14:46:38.990331 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3595/7053] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:46:38 2022] DELETE /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:46:38.999076 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-15cde00f-46f0-4614-be5e-13cd7888d356 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:46:38.999981 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-15cde00f-46f0-4614-be5e-13cd7888d356 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:46:39.008701 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-15cde00f-46f0-4614-be5e-13cd7888d356 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:39.009134 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-15cde00f-46f0-4614-be5e-13cd7888d356 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:39.009778 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-15cde00f-46f0-4614-be5e-13cd7888d356 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:39.010539 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-15cde00f-46f0-4614-be5e-13cd7888d356 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:39.010998 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-15cde00f-46f0-4614-be5e-13cd7888d356 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:39.011481 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-15cde00f-46f0-4614-be5e-13cd7888d356 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:39.158921 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-15cde00f-46f0-4614-be5e-13cd7888d356 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f1309abebb4778a8a907cd6c8142c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:46:39.166981 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-15cde00f-46f0-4614-be5e-13cd7888d356 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59" status: 200 len: 1553 microversion: 2.1 time: 0.172360 Oct 17 14:46:39.167579 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3459/7054] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:46:38 2022] GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59 => generated 1553 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:46:40.196348 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-82b43da7-060d-4335-ac09-83122bd968f9 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:46:40.197262 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-82b43da7-060d-4335-ac09-83122bd968f9 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:46:40.204855 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-82b43da7-060d-4335-ac09-83122bd968f9 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:40.205441 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-82b43da7-060d-4335-ac09-83122bd968f9 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:40.205906 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-82b43da7-060d-4335-ac09-83122bd968f9 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:40.206603 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-82b43da7-060d-4335-ac09-83122bd968f9 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:40.207080 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-82b43da7-060d-4335-ac09-83122bd968f9 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:40.207675 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-82b43da7-060d-4335-ac09-83122bd968f9 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:40.342633 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-82b43da7-060d-4335-ac09-83122bd968f9 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f1309abebb4778a8a907cd6c8142c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:46:40.350993 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-82b43da7-060d-4335-ac09-83122bd968f9 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59" status: 200 len: 1553 microversion: 2.1 time: 0.163226 Oct 17 14:46:40.351512 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3596/7055] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:46:40 2022] GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59 => generated 1553 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:46:41.374631 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c395b0ea-ebbb-4483-bc36-34f861803521 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:46:41.375204 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c395b0ea-ebbb-4483-bc36-34f861803521 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:46:41.382942 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c395b0ea-ebbb-4483-bc36-34f861803521 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:41.383471 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c395b0ea-ebbb-4483-bc36-34f861803521 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:41.383930 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c395b0ea-ebbb-4483-bc36-34f861803521 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:41.384655 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c395b0ea-ebbb-4483-bc36-34f861803521 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:41.385129 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c395b0ea-ebbb-4483-bc36-34f861803521 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:41.385571 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c395b0ea-ebbb-4483-bc36-34f861803521 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:41.619832 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-219d4f26-7334-49e6-a059-b36c918d31e7 req-4b533697-aadd-44de-9397-f7b5f817f5ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eb08c2a-ab33-4b2a-b578-0cf5a5045b59", "name": "network-vif-deleted", "tag": "b4b57732-ab91-4910-9b2c-354e0a7647fc"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:46:41.625870 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c395b0ea-ebbb-4483-bc36-34f861803521 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f1309abebb4778a8a907cd6c8142c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27ab2952064d1ab714d1b4f7ef7c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:46:41.631578 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-219d4f26-7334-49e6-a059-b36c918d31e7 req-4b533697-aadd-44de-9397-f7b5f817f5ef service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:41.632098 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-219d4f26-7334-49e6-a059-b36c918d31e7 req-4b533697-aadd-44de-9397-f7b5f817f5ef service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:41.632501 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-219d4f26-7334-49e6-a059-b36c918d31e7 req-4b533697-aadd-44de-9397-f7b5f817f5ef service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:41.635503 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c395b0ea-ebbb-4483-bc36-34f861803521 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59" status: 200 len: 1553 microversion: 2.1 time: 0.265126 Oct 17 14:46:41.636270 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3460/7056] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:46:41 2022] GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59 => generated 1553 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:46:41.645890 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-219d4f26-7334-49e6-a059-b36c918d31e7 req-4b533697-aadd-44de-9397-f7b5f817f5ef service nova] Creating event network-vif-deleted:b4b57732-ab91-4910-9b2c-354e0a7647fc for instance 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59 on n-h1-854247-14 Oct 17 14:46:41.651041 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-219d4f26-7334-49e6-a059-b36c918d31e7 req-4b533697-aadd-44de-9397-f7b5f817f5ef service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035797 Oct 17 14:46:41.651698 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3597/7057] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:46:42.659100 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-17126d8b-12fb-4ff3-89b8-c006bcfb4d3f tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:46:42.659717 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-17126d8b-12fb-4ff3-89b8-c006bcfb4d3f tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] [instance: 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:46:42.667126 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-17126d8b-12fb-4ff3-89b8-c006bcfb4d3f tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:42.667669 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-17126d8b-12fb-4ff3-89b8-c006bcfb4d3f tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:42.668132 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-17126d8b-12fb-4ff3-89b8-c006bcfb4d3f tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:42.668856 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-17126d8b-12fb-4ff3-89b8-c006bcfb4d3f tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:42.669327 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-17126d8b-12fb-4ff3-89b8-c006bcfb4d3f tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:42.669770 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-17126d8b-12fb-4ff3-89b8-c006bcfb4d3f tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:42.684219 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-17126d8b-12fb-4ff3-89b8-c006bcfb4d3f tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] HTTP exception thrown: Instance 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59 could not be found. Oct 17 14:46:42.685781 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-17126d8b-12fb-4ff3-89b8-c006bcfb4d3f tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Request method failure captured: Oct 17 14:46:42.685781 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59 HTTP/1.1 Oct 17 14:46:42.685781 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 14:46:42.685781 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 14:46:42.685781 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 14:46:42.685781 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 14:46:42.685781 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 14:46:42.685781 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 14:46:42.685781 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 14:46:42.685781 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 14:46:42.685781 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTWlqbsv6-8TFzkbZMNrImYpezCcoheAm_h6hYPJTPXG9brnitHKZDw26NceYxcUllza5GDYHtxaHtai5uHb6CrmD9L2OKAJZMuUauOrxr7rK977-_auBYnVIjQ4g_M72joHHWOKhiHJtxt-wovbj9xJatnSaI_iaeq3MithcFCAFxeg Oct 17 14:46:42.685781 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 14:46:42.685781 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 14:46:42.685781 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 14:46:42.685781 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 14:46:42.685781 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 14:46:42.685781 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 14:46:42.685781 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 6c27ab2952064d1ab714d1b4f7ef7c96 Oct 17 14:46:42.685781 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-TestMinimumBasicScenario-1302609953 Oct 17 14:46:42.685781 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 14:46:42.685781 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 14:46:42.685781 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6c27ab2952064d1ab714d1b4f7ef7c96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6c27ab2952064d1ab714d1b4f7ef7c96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6c27ab2952064d1ab714d1b4f7ef7c96"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6c27ab2952064d1ab714d1b4f7ef7c96", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:46:42.685781 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-TestMinimumBasicScenario-1302609953 Oct 17 14:46:42.685781 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 6c27ab2952064d1ab714d1b4f7ef7c96 Oct 17 14:46:42.685781 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1302609953 Oct 17 14:46:42.685781 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-TestMinimumBasicScenario-1302609953-project Oct 17 14:46:42.685781 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 14:46:42.685781 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 14:46:42.685781 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: d2f1309abebb4778a8a907cd6c8142c3 Oct 17 14:46:42.685781 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-TestMinimumBasicScenario-1302609953-project Oct 17 14:46:42.685781 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 14:46:42.685781 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59 could not be found. Oct 17 14:46:42.685781 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '4eb08c2a-ab33-4b2a-b578-0cf5a5045b59'} Oct 17 14:46:42.685781 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:46:42.685781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:46:42.685781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:46:42.685781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:46:42.685781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:46:42.685781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:46:42.685781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:46:42.685781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:46:42.685781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:46:42.685781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:46:42.685781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59 could not be found. Oct 17 14:46:42.685781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:46:42.685781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:46:42.685781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:46:42.685781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:46:42.685781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:46:42.685781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:46:42.685781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:46:42.685781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:46:42.685781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:46:42.685781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:46:42.685781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:46:42.685781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:46:42.685781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:46:42.685781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:46:42.685781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:46:42.685781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:46:42.685781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59 could not be found. Oct 17 14:46:42.685781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:46:42.685781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:46:42.685781 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:46:42.690571 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:46:42.690571 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:46:42.690571 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:46:42.690571 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:46:42.690571 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:46:42.690571 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59 could not be found. Oct 17 14:46:42.690571 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:46:42.690571 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-17126d8b-12fb-4ff3-89b8-c006bcfb4d3f tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Returning 404 to user: Instance 4eb08c2a-ab33-4b2a-b578-0cf5a5045b59 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:46:42.690571 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-17126d8b-12fb-4ff3-89b8-c006bcfb4d3f tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59" status: 404 len: 111 microversion: 2.1 time: 0.032615 Oct 17 14:46:42.690571 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3461/7058] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:46:42 2022] GET /compute/v2.1/servers/4eb08c2a-ab33-4b2a-b578-0cf5a5045b59 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:46:42.697905 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f790439b-f162-455e-8212-7256cd67ea16 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] Calling method '.version_select at 0x7f7cd5404310>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:46:42.723857 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f790439b-f162-455e-8212-7256cd67ea16 tempest-TestMinimumBasicScenario-1302609953 tempest-TestMinimumBasicScenario-1302609953-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1970160555" status: 202 len: 0 microversion: 2.1 time: 0.030386 Oct 17 14:46:42.724871 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3598/7059] 10.222.0.79 () {58 vars in 1272 bytes} [Mon Oct 17 14:46:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1970160555 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:46:52.196943 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e68299f1-3254-425d-8fb8-53224292a475 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Action: 'create', calling method: .version_select at 0x7f7cd45c5310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-463506775", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFLGOKzn1yVQ564e2oHjR0IZwk5MjYquZ6AYTpmsThaQi2dWf+JG55r3sv+EhXEau/UtKjt7nqcRFDseZhGcLyDoLZ6ON6DHoPUMs3EsqPrtndThTL1ERkEehOw1Ex8d3g=="}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:46:52.216917 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-e68299f1-3254-425d-8fb8-53224292a475 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Getting quotas for project 6d8fb8c2659a43a696a0a16e7d2be378. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:46:52.224176 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-e68299f1-3254-425d-8fb8-53224292a475 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Getting quotas for user 4805a4aa399d4d0798b6077a545a2255 and project 6d8fb8c2659a43a696a0a16e7d2be378. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:46:52.251859 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e68299f1-3254-425d-8fb8-53224292a475 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.233336 Oct 17 14:46:52.252404 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3462/7060] 10.222.0.79 () {60 vars in 1159 bytes} [Mon Oct 17 14:46:52 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:46:58.593194 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:46:58.596774 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:46:58.602122 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2c275cf5-82c7-4fde-be04-55c06b7a0bb1 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-531421787", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "cfbbed59-d04c-4e82-a950-561e6b9b7543"}], "key_name": "tempest-TestNetworkAdvancedServerOps-463506775", "security_groups": [{"name": "tempest-secgroup-smoke-282372895"}]}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:46:58.726701 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-2c275cf5-82c7-4fde-be04-55c06b7a0bb1 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] validate_networks() for [('cfbbed59-d04c-4e82-a950-561e6b9b7543', None, None, None, None, None)] {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:46:59.181685 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-2c275cf5-82c7-4fde-be04-55c06b7a0bb1 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:46:59.182223 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-2c275cf5-82c7-4fde-be04-55c06b7a0bb1 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:46:59.182769 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-2c275cf5-82c7-4fde-be04-55c06b7a0bb1 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:46:59.183289 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-2c275cf5-82c7-4fde-be04-55c06b7a0bb1 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:46:59.183827 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-2c275cf5-82c7-4fde-be04-55c06b7a0bb1 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:46:59.193402 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2c275cf5-82c7-4fde-be04-55c06b7a0bb1 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:59.194235 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2c275cf5-82c7-4fde-be04-55c06b7a0bb1 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:59.194739 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2c275cf5-82c7-4fde-be04-55c06b7a0bb1 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:59.195514 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2c275cf5-82c7-4fde-be04-55c06b7a0bb1 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:59.195958 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2c275cf5-82c7-4fde-be04-55c06b7a0bb1 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:59.196555 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2c275cf5-82c7-4fde-be04-55c06b7a0bb1 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:59.215197 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-2c275cf5-82c7-4fde-be04-55c06b7a0bb1 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Getting quotas for project 6d8fb8c2659a43a696a0a16e7d2be378. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:46:59.221427 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-2c275cf5-82c7-4fde-be04-55c06b7a0bb1 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Getting quotas for user 4805a4aa399d4d0798b6077a545a2255 and project 6d8fb8c2659a43a696a0a16e7d2be378. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:46:59.235364 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2c275cf5-82c7-4fde-be04-55c06b7a0bb1 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:46:59.237951 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2c275cf5-82c7-4fde-be04-55c06b7a0bb1 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: e7d6157b-ceac-428b-a4fa-5ebea0169f31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:46:59.289799 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2c275cf5-82c7-4fde-be04-55c06b7a0bb1 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.698967 Oct 17 14:46:59.296861 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3599/7061] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 14:46:58 2022] POST /compute/v2.1/servers => generated 405 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:46:59.299195 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:46:59.306350 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3e40e346-be2f-4abd-ba88-e17613f39b7b tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:46:59.307002 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3e40e346-be2f-4abd-ba88-e17613f39b7b tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: e7d6157b-ceac-428b-a4fa-5ebea0169f31] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:46:59.309020 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:46:59.376212 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3e40e346-be2f-4abd-ba88-e17613f39b7b tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:46:59.387487 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3e40e346-be2f-4abd-ba88-e17613f39b7b tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/e7d6157b-ceac-428b-a4fa-5ebea0169f31" status: 200 len: 1265 microversion: 2.1 time: 0.089255 Oct 17 14:46:59.388082 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3463/7062] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:46:59 2022] GET /compute/v2.1/servers/e7d6157b-ceac-428b-a4fa-5ebea0169f31 => generated 1265 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:47:00.423337 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-087e283b-36df-4fd2-9fdb-af424b00d299 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:47:00.424623 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-087e283b-36df-4fd2-9fdb-af424b00d299 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: e7d6157b-ceac-428b-a4fa-5ebea0169f31] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:47:00.441735 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-087e283b-36df-4fd2-9fdb-af424b00d299 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:00.442495 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-087e283b-36df-4fd2-9fdb-af424b00d299 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:00.443046 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-087e283b-36df-4fd2-9fdb-af424b00d299 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:00.443974 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-087e283b-36df-4fd2-9fdb-af424b00d299 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:00.444541 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-087e283b-36df-4fd2-9fdb-af424b00d299 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:00.445067 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-087e283b-36df-4fd2-9fdb-af424b00d299 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:00.572336 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-087e283b-36df-4fd2-9fdb-af424b00d299 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:47:00.582374 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-087e283b-36df-4fd2-9fdb-af424b00d299 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/e7d6157b-ceac-428b-a4fa-5ebea0169f31" status: 200 len: 1317 microversion: 2.1 time: 0.173100 Oct 17 14:47:00.583734 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3600/7063] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:47:00 2022] GET /compute/v2.1/servers/e7d6157b-ceac-428b-a4fa-5ebea0169f31 => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:47:01.606043 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a1c58bf1-9c0d-4e19-a6e1-3f8c916587a9 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:47:01.614579 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a1c58bf1-9c0d-4e19-a6e1-3f8c916587a9 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: e7d6157b-ceac-428b-a4fa-5ebea0169f31] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:47:01.628699 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a1c58bf1-9c0d-4e19-a6e1-3f8c916587a9 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:01.629205 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a1c58bf1-9c0d-4e19-a6e1-3f8c916587a9 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:01.629660 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a1c58bf1-9c0d-4e19-a6e1-3f8c916587a9 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:01.630392 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a1c58bf1-9c0d-4e19-a6e1-3f8c916587a9 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:01.630855 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a1c58bf1-9c0d-4e19-a6e1-3f8c916587a9 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:01.631326 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a1c58bf1-9c0d-4e19-a6e1-3f8c916587a9 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:01.853906 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a1c58bf1-9c0d-4e19-a6e1-3f8c916587a9 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:47:01.862368 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a1c58bf1-9c0d-4e19-a6e1-3f8c916587a9 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/e7d6157b-ceac-428b-a4fa-5ebea0169f31" status: 200 len: 1390 microversion: 2.1 time: 0.260239 Oct 17 14:47:01.863007 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3464/7064] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:47:01 2022] GET /compute/v2.1/servers/e7d6157b-ceac-428b-a4fa-5ebea0169f31 => generated 1390 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:47:02.160378 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-fdaae722-1024-46af-a4cf-f427938eb5be req-edd3bbe1-dba4-453d-9472-14c55d545237 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7d6157b-ceac-428b-a4fa-5ebea0169f31", "tag": "1b8bf10d-c760-4fa4-bebb-a758b5aec985"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:47:02.174415 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-fdaae722-1024-46af-a4cf-f427938eb5be req-edd3bbe1-dba4-453d-9472-14c55d545237 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:02.174900 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-fdaae722-1024-46af-a4cf-f427938eb5be req-edd3bbe1-dba4-453d-9472-14c55d545237 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:02.175708 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-fdaae722-1024-46af-a4cf-f427938eb5be req-edd3bbe1-dba4-453d-9472-14c55d545237 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:02.188913 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-fdaae722-1024-46af-a4cf-f427938eb5be req-edd3bbe1-dba4-453d-9472-14c55d545237 service nova] Creating event network-changed:1b8bf10d-c760-4fa4-bebb-a758b5aec985 for instance e7d6157b-ceac-428b-a4fa-5ebea0169f31 on n-h2-854247-14 Oct 17 14:47:02.194792 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-fdaae722-1024-46af-a4cf-f427938eb5be req-edd3bbe1-dba4-453d-9472-14c55d545237 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038827 Oct 17 14:47:02.195956 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3601/7065] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:47:02.886165 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c52b9fcb-b419-435b-b00f-9ba13f9d46a1 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:47:02.886789 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c52b9fcb-b419-435b-b00f-9ba13f9d46a1 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: e7d6157b-ceac-428b-a4fa-5ebea0169f31] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:47:02.894166 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c52b9fcb-b419-435b-b00f-9ba13f9d46a1 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:02.894889 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c52b9fcb-b419-435b-b00f-9ba13f9d46a1 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:02.895381 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c52b9fcb-b419-435b-b00f-9ba13f9d46a1 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:02.896195 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c52b9fcb-b419-435b-b00f-9ba13f9d46a1 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:02.896656 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c52b9fcb-b419-435b-b00f-9ba13f9d46a1 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:02.897090 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c52b9fcb-b419-435b-b00f-9ba13f9d46a1 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:03.029889 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c52b9fcb-b419-435b-b00f-9ba13f9d46a1 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:47:03.038084 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c52b9fcb-b419-435b-b00f-9ba13f9d46a1 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/e7d6157b-ceac-428b-a4fa-5ebea0169f31" status: 200 len: 1390 microversion: 2.1 time: 0.155861 Oct 17 14:47:03.038655 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3465/7066] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:47:02 2022] GET /compute/v2.1/servers/e7d6157b-ceac-428b-a4fa-5ebea0169f31 => generated 1390 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:47:04.066513 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-39772f52-fe45-4607-9861-baec07f46688 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:47:04.067406 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-39772f52-fe45-4607-9861-baec07f46688 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: e7d6157b-ceac-428b-a4fa-5ebea0169f31] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:47:04.075204 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-39772f52-fe45-4607-9861-baec07f46688 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:04.075682 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-39772f52-fe45-4607-9861-baec07f46688 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:04.076130 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-39772f52-fe45-4607-9861-baec07f46688 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:04.076850 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-39772f52-fe45-4607-9861-baec07f46688 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:04.077305 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-39772f52-fe45-4607-9861-baec07f46688 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:04.077726 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-39772f52-fe45-4607-9861-baec07f46688 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:04.231809 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-39772f52-fe45-4607-9861-baec07f46688 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:47:04.240678 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-39772f52-fe45-4607-9861-baec07f46688 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/e7d6157b-ceac-428b-a4fa-5ebea0169f31" status: 200 len: 1390 microversion: 2.1 time: 0.181234 Oct 17 14:47:04.241278 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3602/7067] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:47:04 2022] GET /compute/v2.1/servers/e7d6157b-ceac-428b-a4fa-5ebea0169f31 => generated 1390 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:47:05.264648 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a070dee6-735f-4389-860d-9f77680e65c3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:47:05.265255 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a070dee6-735f-4389-860d-9f77680e65c3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: e7d6157b-ceac-428b-a4fa-5ebea0169f31] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:47:05.272966 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a070dee6-735f-4389-860d-9f77680e65c3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:05.273478 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a070dee6-735f-4389-860d-9f77680e65c3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:05.273937 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a070dee6-735f-4389-860d-9f77680e65c3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:05.274690 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a070dee6-735f-4389-860d-9f77680e65c3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:05.275157 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a070dee6-735f-4389-860d-9f77680e65c3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:05.275631 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a070dee6-735f-4389-860d-9f77680e65c3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:05.413970 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a070dee6-735f-4389-860d-9f77680e65c3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:47:05.422029 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a070dee6-735f-4389-860d-9f77680e65c3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/e7d6157b-ceac-428b-a4fa-5ebea0169f31" status: 200 len: 1390 microversion: 2.1 time: 0.161381 Oct 17 14:47:05.422610 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3466/7068] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:47:05 2022] GET /compute/v2.1/servers/e7d6157b-ceac-428b-a4fa-5ebea0169f31 => generated 1390 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:47:06.445976 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-087bbda3-b0e6-4e57-94df-f25df7bfb84b tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:47:06.446568 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-087bbda3-b0e6-4e57-94df-f25df7bfb84b tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: e7d6157b-ceac-428b-a4fa-5ebea0169f31] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:47:06.453786 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-087bbda3-b0e6-4e57-94df-f25df7bfb84b tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:06.454276 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-087bbda3-b0e6-4e57-94df-f25df7bfb84b tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:06.454708 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-087bbda3-b0e6-4e57-94df-f25df7bfb84b tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:06.455478 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-087bbda3-b0e6-4e57-94df-f25df7bfb84b tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:06.455937 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-087bbda3-b0e6-4e57-94df-f25df7bfb84b tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:06.456364 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-087bbda3-b0e6-4e57-94df-f25df7bfb84b tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:06.593726 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-087bbda3-b0e6-4e57-94df-f25df7bfb84b tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:47:06.602236 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-087bbda3-b0e6-4e57-94df-f25df7bfb84b tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/e7d6157b-ceac-428b-a4fa-5ebea0169f31" status: 200 len: 1390 microversion: 2.1 time: 0.160765 Oct 17 14:47:06.602822 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3603/7069] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:47:06 2022] GET /compute/v2.1/servers/e7d6157b-ceac-428b-a4fa-5ebea0169f31 => generated 1390 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:47:07.626682 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-86c7a333-fff9-44e8-b6cb-8f85b5e967ac tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:47:07.627339 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-86c7a333-fff9-44e8-b6cb-8f85b5e967ac tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: e7d6157b-ceac-428b-a4fa-5ebea0169f31] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:47:07.634806 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-86c7a333-fff9-44e8-b6cb-8f85b5e967ac tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:07.635324 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-86c7a333-fff9-44e8-b6cb-8f85b5e967ac tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:07.635768 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-86c7a333-fff9-44e8-b6cb-8f85b5e967ac tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:07.636497 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-86c7a333-fff9-44e8-b6cb-8f85b5e967ac tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:07.636968 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-86c7a333-fff9-44e8-b6cb-8f85b5e967ac tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:07.637437 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-86c7a333-fff9-44e8-b6cb-8f85b5e967ac tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:07.776818 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-86c7a333-fff9-44e8-b6cb-8f85b5e967ac tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:47:07.779190 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-fc82a5a6-26f1-42af-9f35-f8ae8992b0e2 req-b3332ad4-0cfb-4ad9-bb24-551338cb6fdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7d6157b-ceac-428b-a4fa-5ebea0169f31", "name": "network-vif-plugged", "status": "completed", "tag": "1b8bf10d-c760-4fa4-bebb-a758b5aec985"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:47:07.788163 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-86c7a333-fff9-44e8-b6cb-8f85b5e967ac tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/e7d6157b-ceac-428b-a4fa-5ebea0169f31" status: 200 len: 1390 microversion: 2.1 time: 0.165471 Oct 17 14:47:07.789391 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3467/7070] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:47:07 2022] GET /compute/v2.1/servers/e7d6157b-ceac-428b-a4fa-5ebea0169f31 => generated 1390 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:47:07.791403 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-fc82a5a6-26f1-42af-9f35-f8ae8992b0e2 req-b3332ad4-0cfb-4ad9-bb24-551338cb6fdd service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:07.792160 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-fc82a5a6-26f1-42af-9f35-f8ae8992b0e2 req-b3332ad4-0cfb-4ad9-bb24-551338cb6fdd service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:07.792691 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-fc82a5a6-26f1-42af-9f35-f8ae8992b0e2 req-b3332ad4-0cfb-4ad9-bb24-551338cb6fdd service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:07.804855 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-fc82a5a6-26f1-42af-9f35-f8ae8992b0e2 req-b3332ad4-0cfb-4ad9-bb24-551338cb6fdd service nova] Creating event network-vif-plugged:1b8bf10d-c760-4fa4-bebb-a758b5aec985 for instance e7d6157b-ceac-428b-a4fa-5ebea0169f31 on n-h2-854247-14 Oct 17 14:47:07.810256 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-fc82a5a6-26f1-42af-9f35-f8ae8992b0e2 req-b3332ad4-0cfb-4ad9-bb24-551338cb6fdd service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035540 Oct 17 14:47:07.810875 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3604/7071] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:47:08.811671 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-28848fdd-bd68-4012-aad3-f2daba8d1fca tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:47:08.812319 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-28848fdd-bd68-4012-aad3-f2daba8d1fca tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: e7d6157b-ceac-428b-a4fa-5ebea0169f31] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:47:08.819883 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-28848fdd-bd68-4012-aad3-f2daba8d1fca tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:08.820397 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-28848fdd-bd68-4012-aad3-f2daba8d1fca tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:08.820849 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-28848fdd-bd68-4012-aad3-f2daba8d1fca tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:08.821577 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-28848fdd-bd68-4012-aad3-f2daba8d1fca tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:08.822048 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-28848fdd-bd68-4012-aad3-f2daba8d1fca tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:08.822489 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-28848fdd-bd68-4012-aad3-f2daba8d1fca tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:08.964301 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-28848fdd-bd68-4012-aad3-f2daba8d1fca tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:47:08.973172 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-28848fdd-bd68-4012-aad3-f2daba8d1fca tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/e7d6157b-ceac-428b-a4fa-5ebea0169f31" status: 200 len: 1390 microversion: 2.1 time: 0.165575 Oct 17 14:47:08.973794 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3468/7072] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:47:08 2022] GET /compute/v2.1/servers/e7d6157b-ceac-428b-a4fa-5ebea0169f31 => generated 1390 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:47:09.995440 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:47:09.996562 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=6 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:47:10.001155 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a70d7901-1d6a-4f7c-9bb4-72d2f3869387 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:47:10.001864 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a70d7901-1d6a-4f7c-9bb4-72d2f3869387 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: e7d6157b-ceac-428b-a4fa-5ebea0169f31] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:47:10.009147 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a70d7901-1d6a-4f7c-9bb4-72d2f3869387 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:10.009626 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a70d7901-1d6a-4f7c-9bb4-72d2f3869387 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:10.010052 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a70d7901-1d6a-4f7c-9bb4-72d2f3869387 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:10.010743 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a70d7901-1d6a-4f7c-9bb4-72d2f3869387 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:10.011223 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a70d7901-1d6a-4f7c-9bb4-72d2f3869387 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:10.011660 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a70d7901-1d6a-4f7c-9bb4-72d2f3869387 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:10.146910 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a70d7901-1d6a-4f7c-9bb4-72d2f3869387 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:47:10.154931 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a70d7901-1d6a-4f7c-9bb4-72d2f3869387 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/e7d6157b-ceac-428b-a4fa-5ebea0169f31" status: 200 len: 1562 microversion: 2.1 time: 0.161434 Oct 17 14:47:10.155580 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3605/7073] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:47:09 2022] GET /compute/v2.1/servers/e7d6157b-ceac-428b-a4fa-5ebea0169f31 => generated 1562 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:47:10.179410 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c7c0eef8-32e7-4e59-834e-66e1df660eda tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:47:10.180055 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c7c0eef8-32e7-4e59-834e-66e1df660eda tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: e7d6157b-ceac-428b-a4fa-5ebea0169f31] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:47:10.182139 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=6 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:47:10.188384 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7c0eef8-32e7-4e59-834e-66e1df660eda tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:10.188880 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7c0eef8-32e7-4e59-834e-66e1df660eda tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:10.189336 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7c0eef8-32e7-4e59-834e-66e1df660eda tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:10.190045 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7c0eef8-32e7-4e59-834e-66e1df660eda tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:10.190518 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7c0eef8-32e7-4e59-834e-66e1df660eda tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:10.190958 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7c0eef8-32e7-4e59-834e-66e1df660eda tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:10.326577 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c7c0eef8-32e7-4e59-834e-66e1df660eda tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:47:10.335002 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c7c0eef8-32e7-4e59-834e-66e1df660eda tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/e7d6157b-ceac-428b-a4fa-5ebea0169f31" status: 200 len: 1562 microversion: 2.1 time: 0.160173 Oct 17 14:47:10.335850 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3469/7074] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:47:10 2022] GET /compute/v2.1/servers/e7d6157b-ceac-428b-a4fa-5ebea0169f31 => generated 1562 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:47:12.270551 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f01efae3-5083-418b-a096-a07c9d92bdad tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:47:12.271202 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f01efae3-5083-418b-a096-a07c9d92bdad tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: e7d6157b-ceac-428b-a4fa-5ebea0169f31] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:47:12.281391 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f01efae3-5083-418b-a096-a07c9d92bdad tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:12.281870 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f01efae3-5083-418b-a096-a07c9d92bdad tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:12.282292 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f01efae3-5083-418b-a096-a07c9d92bdad tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:12.283456 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f01efae3-5083-418b-a096-a07c9d92bdad tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:12.283726 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f01efae3-5083-418b-a096-a07c9d92bdad tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:12.284384 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f01efae3-5083-418b-a096-a07c9d92bdad tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:12.334975 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-49b554e4-7516-4b6d-b343-78d6a966f1e4 req-bf622ba4-822e-4766-9141-3f1cc4106daa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7d6157b-ceac-428b-a4fa-5ebea0169f31", "tag": "1b8bf10d-c760-4fa4-bebb-a758b5aec985"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:47:12.346383 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-49b554e4-7516-4b6d-b343-78d6a966f1e4 req-bf622ba4-822e-4766-9141-3f1cc4106daa service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:12.346924 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-49b554e4-7516-4b6d-b343-78d6a966f1e4 req-bf622ba4-822e-4766-9141-3f1cc4106daa service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:12.347527 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-49b554e4-7516-4b6d-b343-78d6a966f1e4 req-bf622ba4-822e-4766-9141-3f1cc4106daa service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:12.359648 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-49b554e4-7516-4b6d-b343-78d6a966f1e4 req-bf622ba4-822e-4766-9141-3f1cc4106daa service nova] Creating event network-changed:1b8bf10d-c760-4fa4-bebb-a758b5aec985 for instance e7d6157b-ceac-428b-a4fa-5ebea0169f31 on n-h2-854247-14 Oct 17 14:47:12.365631 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-49b554e4-7516-4b6d-b343-78d6a966f1e4 req-bf622ba4-822e-4766-9141-3f1cc4106daa service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096485 Oct 17 14:47:12.366761 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3470/7075] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:47:12.490584 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f01efae3-5083-418b-a096-a07c9d92bdad tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:47:12.499212 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f01efae3-5083-418b-a096-a07c9d92bdad tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/e7d6157b-ceac-428b-a4fa-5ebea0169f31" status: 200 len: 1562 microversion: 2.1 time: 0.232969 Oct 17 14:47:12.499904 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3606/7076] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:47:12 2022] GET /compute/v2.1/servers/e7d6157b-ceac-428b-a4fa-5ebea0169f31 => generated 1562 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:47:33.755675 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=17 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:47:33.756441 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=38 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:47:33.761234 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bbe1a9de-0107-4570-a861-6baa733d8774 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:47:33.763615 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-bbe1a9de-0107-4570-a861-6baa733d8774 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: e7d6157b-ceac-428b-a4fa-5ebea0169f31] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:47:33.770899 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bbe1a9de-0107-4570-a861-6baa733d8774 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:33.771441 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bbe1a9de-0107-4570-a861-6baa733d8774 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:33.772530 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bbe1a9de-0107-4570-a861-6baa733d8774 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:33.773295 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bbe1a9de-0107-4570-a861-6baa733d8774 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:33.773768 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bbe1a9de-0107-4570-a861-6baa733d8774 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:33.774215 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bbe1a9de-0107-4570-a861-6baa733d8774 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:33.834737 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-bbe1a9de-0107-4570-a861-6baa733d8774 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "POST /compute/v2.1/servers/e7d6157b-ceac-428b-a4fa-5ebea0169f31/action" status: 200 len: 24570 microversion: 2.1 time: 0.081225 Oct 17 14:47:33.835501 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3471/7077] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:47:33 2022] POST /compute/v2.1/servers/e7d6157b-ceac-428b-a4fa-5ebea0169f31/action => generated 24570 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:47:40.268068 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-04fd73ac-9302-4e4e-baf6-6fe2a467f8b6 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:47:40.269021 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-04fd73ac-9302-4e4e-baf6-6fe2a467f8b6 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: e7d6157b-ceac-428b-a4fa-5ebea0169f31] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:47:40.271351 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:47:40.272018 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=36 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:47:40.279910 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-04fd73ac-9302-4e4e-baf6-6fe2a467f8b6 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:40.280607 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-04fd73ac-9302-4e4e-baf6-6fe2a467f8b6 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:40.281274 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-04fd73ac-9302-4e4e-baf6-6fe2a467f8b6 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:40.282365 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-04fd73ac-9302-4e4e-baf6-6fe2a467f8b6 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:40.282964 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-04fd73ac-9302-4e4e-baf6-6fe2a467f8b6 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:40.283795 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-04fd73ac-9302-4e4e-baf6-6fe2a467f8b6 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:40.365446 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-04fd73ac-9302-4e4e-baf6-6fe2a467f8b6 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "POST /compute/v2.1/servers/e7d6157b-ceac-428b-a4fa-5ebea0169f31/action" status: 202 len: 0 microversion: 2.1 time: 0.102153 Oct 17 14:47:40.366035 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3607/7078] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:47:40 2022] POST /compute/v2.1/servers/e7d6157b-ceac-428b-a4fa-5ebea0169f31/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:47:40.375289 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ea79dee7-d261-4dca-86d0-69d613c0d0a3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:47:40.376656 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ea79dee7-d261-4dca-86d0-69d613c0d0a3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: e7d6157b-ceac-428b-a4fa-5ebea0169f31] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:47:40.384587 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ea79dee7-d261-4dca-86d0-69d613c0d0a3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:40.385084 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ea79dee7-d261-4dca-86d0-69d613c0d0a3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:40.385531 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ea79dee7-d261-4dca-86d0-69d613c0d0a3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:40.386261 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ea79dee7-d261-4dca-86d0-69d613c0d0a3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:40.386705 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ea79dee7-d261-4dca-86d0-69d613c0d0a3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:40.387257 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ea79dee7-d261-4dca-86d0-69d613c0d0a3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:40.529603 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ea79dee7-d261-4dca-86d0-69d613c0d0a3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:47:40.538853 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ea79dee7-d261-4dca-86d0-69d613c0d0a3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/e7d6157b-ceac-428b-a4fa-5ebea0169f31" status: 200 len: 1686 microversion: 2.1 time: 0.168147 Oct 17 14:47:40.539471 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3472/7079] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:47:40 2022] GET /compute/v2.1/servers/e7d6157b-ceac-428b-a4fa-5ebea0169f31 => generated 1686 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:47:41.565772 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-956f6636-772d-4e9f-80d6-6e2f8a9506a8 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:47:41.566508 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-956f6636-772d-4e9f-80d6-6e2f8a9506a8 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: e7d6157b-ceac-428b-a4fa-5ebea0169f31] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:47:41.573153 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-956f6636-772d-4e9f-80d6-6e2f8a9506a8 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:41.573641 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-956f6636-772d-4e9f-80d6-6e2f8a9506a8 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:41.574075 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-956f6636-772d-4e9f-80d6-6e2f8a9506a8 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:41.574774 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-956f6636-772d-4e9f-80d6-6e2f8a9506a8 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:41.575255 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-956f6636-772d-4e9f-80d6-6e2f8a9506a8 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:41.575675 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-956f6636-772d-4e9f-80d6-6e2f8a9506a8 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:41.722513 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-956f6636-772d-4e9f-80d6-6e2f8a9506a8 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:47:41.733482 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-956f6636-772d-4e9f-80d6-6e2f8a9506a8 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/e7d6157b-ceac-428b-a4fa-5ebea0169f31" status: 200 len: 1666 microversion: 2.1 time: 0.173038 Oct 17 14:47:41.734053 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3608/7080] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:47:41 2022] GET /compute/v2.1/servers/e7d6157b-ceac-428b-a4fa-5ebea0169f31 => generated 1666 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:47:42.836948 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-af4475b8-b226-4007-9af7-59e96090fb5c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:47:42.839272 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-af4475b8-b226-4007-9af7-59e96090fb5c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: e7d6157b-ceac-428b-a4fa-5ebea0169f31] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:47:42.847804 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-af4475b8-b226-4007-9af7-59e96090fb5c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:42.848462 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-af4475b8-b226-4007-9af7-59e96090fb5c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:42.848745 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-af4475b8-b226-4007-9af7-59e96090fb5c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:42.849603 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-af4475b8-b226-4007-9af7-59e96090fb5c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:42.849953 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-af4475b8-b226-4007-9af7-59e96090fb5c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:42.850333 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-af4475b8-b226-4007-9af7-59e96090fb5c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:42.913707 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-af4475b8-b226-4007-9af7-59e96090fb5c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "POST /compute/v2.1/servers/e7d6157b-ceac-428b-a4fa-5ebea0169f31/action" status: 200 len: 32644 microversion: 2.1 time: 0.082029 Oct 17 14:47:42.914529 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3473/7081] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:47:42 2022] POST /compute/v2.1/servers/e7d6157b-ceac-428b-a4fa-5ebea0169f31/action => generated 32644 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:47:42.926996 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-95655ff8-4af5-433c-9092-0cfa0a892882 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:47:42.927915 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-95655ff8-4af5-433c-9092-0cfa0a892882 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: e7d6157b-ceac-428b-a4fa-5ebea0169f31] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:47:42.935391 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-95655ff8-4af5-433c-9092-0cfa0a892882 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:42.935900 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-95655ff8-4af5-433c-9092-0cfa0a892882 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:42.936330 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-95655ff8-4af5-433c-9092-0cfa0a892882 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:42.937237 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-95655ff8-4af5-433c-9092-0cfa0a892882 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:42.937654 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-95655ff8-4af5-433c-9092-0cfa0a892882 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:42.938071 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-95655ff8-4af5-433c-9092-0cfa0a892882 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:43.021618 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-95655ff8-4af5-433c-9092-0cfa0a892882 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "POST /compute/v2.1/servers/e7d6157b-ceac-428b-a4fa-5ebea0169f31/action" status: 202 len: 0 microversion: 2.1 time: 0.098131 Oct 17 14:47:43.026246 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3609/7082] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:47:42 2022] POST /compute/v2.1/servers/e7d6157b-ceac-428b-a4fa-5ebea0169f31/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:47:43.032447 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-41c76195-5c8d-4a07-b169-2034b119863f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:47:43.033257 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-41c76195-5c8d-4a07-b169-2034b119863f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: e7d6157b-ceac-428b-a4fa-5ebea0169f31] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:47:43.041579 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-41c76195-5c8d-4a07-b169-2034b119863f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:43.042465 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-41c76195-5c8d-4a07-b169-2034b119863f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:43.042699 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-41c76195-5c8d-4a07-b169-2034b119863f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:43.043415 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-41c76195-5c8d-4a07-b169-2034b119863f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:43.043890 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-41c76195-5c8d-4a07-b169-2034b119863f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:43.044338 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-41c76195-5c8d-4a07-b169-2034b119863f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:43.206064 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-41c76195-5c8d-4a07-b169-2034b119863f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:47:43.216123 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-41c76195-5c8d-4a07-b169-2034b119863f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/e7d6157b-ceac-428b-a4fa-5ebea0169f31" status: 200 len: 1673 microversion: 2.1 time: 0.188668 Oct 17 14:47:43.216682 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3474/7083] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:47:43 2022] GET /compute/v2.1/servers/e7d6157b-ceac-428b-a4fa-5ebea0169f31 => generated 1673 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:47:44.243256 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fbd96e50-1c8f-401d-9fb0-9c1f138d14a3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:47:44.243988 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-fbd96e50-1c8f-401d-9fb0-9c1f138d14a3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: e7d6157b-ceac-428b-a4fa-5ebea0169f31] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:47:44.259505 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fbd96e50-1c8f-401d-9fb0-9c1f138d14a3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:44.260002 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fbd96e50-1c8f-401d-9fb0-9c1f138d14a3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:44.260443 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fbd96e50-1c8f-401d-9fb0-9c1f138d14a3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:44.261158 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fbd96e50-1c8f-401d-9fb0-9c1f138d14a3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:44.261615 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fbd96e50-1c8f-401d-9fb0-9c1f138d14a3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:44.262037 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fbd96e50-1c8f-401d-9fb0-9c1f138d14a3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:44.409365 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fbd96e50-1c8f-401d-9fb0-9c1f138d14a3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:47:44.417810 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fbd96e50-1c8f-401d-9fb0-9c1f138d14a3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/e7d6157b-ceac-428b-a4fa-5ebea0169f31" status: 200 len: 1681 microversion: 2.1 time: 0.179743 Oct 17 14:47:44.418376 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3610/7084] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:47:44 2022] GET /compute/v2.1/servers/e7d6157b-ceac-428b-a4fa-5ebea0169f31 => generated 1681 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:47:44.524370 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-871f865c-a310-4f23-b864-6e20768423cc tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:47:44.526613 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-871f865c-a310-4f23-b864-6e20768423cc tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: e7d6157b-ceac-428b-a4fa-5ebea0169f31] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:47:44.534919 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-871f865c-a310-4f23-b864-6e20768423cc tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:44.535470 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-871f865c-a310-4f23-b864-6e20768423cc tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:44.535905 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-871f865c-a310-4f23-b864-6e20768423cc tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:44.536624 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-871f865c-a310-4f23-b864-6e20768423cc tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:44.537096 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-871f865c-a310-4f23-b864-6e20768423cc tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:44.537537 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-871f865c-a310-4f23-b864-6e20768423cc tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:44.588959 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-871f865c-a310-4f23-b864-6e20768423cc tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "POST /compute/v2.1/servers/e7d6157b-ceac-428b-a4fa-5ebea0169f31/action" status: 200 len: 35223 microversion: 2.1 time: 0.068420 Oct 17 14:47:44.589652 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3475/7085] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:47:44 2022] POST /compute/v2.1/servers/e7d6157b-ceac-428b-a4fa-5ebea0169f31/action => generated 35223 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:47:45.975944 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-de02e237-1e48-4267-b982-6194192821ba tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:47:45.976548 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-de02e237-1e48-4267-b982-6194192821ba tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: e7d6157b-ceac-428b-a4fa-5ebea0169f31] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:47:45.980218 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-e742ed75-adb4-4a3d-921f-ee2f60279d4f req-e35889a6-402e-4257-904f-e7c9a5e45008 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7d6157b-ceac-428b-a4fa-5ebea0169f31", "tag": "1b8bf10d-c760-4fa4-bebb-a758b5aec985"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:47:45.984089 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-de02e237-1e48-4267-b982-6194192821ba tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:45.984484 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-de02e237-1e48-4267-b982-6194192821ba tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:45.985160 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-de02e237-1e48-4267-b982-6194192821ba tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:45.985879 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-de02e237-1e48-4267-b982-6194192821ba tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:45.986335 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-de02e237-1e48-4267-b982-6194192821ba tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:45.986810 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-de02e237-1e48-4267-b982-6194192821ba tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:45.994140 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-e742ed75-adb4-4a3d-921f-ee2f60279d4f req-e35889a6-402e-4257-904f-e7c9a5e45008 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:45.994140 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-e742ed75-adb4-4a3d-921f-ee2f60279d4f req-e35889a6-402e-4257-904f-e7c9a5e45008 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:45.994510 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-e742ed75-adb4-4a3d-921f-ee2f60279d4f req-e35889a6-402e-4257-904f-e7c9a5e45008 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:46.009015 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-e742ed75-adb4-4a3d-921f-ee2f60279d4f req-e35889a6-402e-4257-904f-e7c9a5e45008 service nova] Creating event network-changed:1b8bf10d-c760-4fa4-bebb-a758b5aec985 for instance e7d6157b-ceac-428b-a4fa-5ebea0169f31 on n-h2-854247-14 Oct 17 14:47:46.015591 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-e742ed75-adb4-4a3d-921f-ee2f60279d4f req-e35889a6-402e-4257-904f-e7c9a5e45008 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039876 Oct 17 14:47:46.016170 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-de02e237-1e48-4267-b982-6194192821ba tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: e7d6157b-ceac-428b-a4fa-5ebea0169f31] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:47:46.016979 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3476/7086] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:47:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:47:46.110106 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-de02e237-1e48-4267-b982-6194192821ba tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "DELETE /compute/v2.1/servers/e7d6157b-ceac-428b-a4fa-5ebea0169f31" status: 204 len: 0 microversion: 2.1 time: 0.138148 Oct 17 14:47:46.110816 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3611/7087] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:47:45 2022] DELETE /compute/v2.1/servers/e7d6157b-ceac-428b-a4fa-5ebea0169f31 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:47:46.119900 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8fc95223-c162-4dd7-a3bc-6cb7f9de1800 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:47:46.120972 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8fc95223-c162-4dd7-a3bc-6cb7f9de1800 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: e7d6157b-ceac-428b-a4fa-5ebea0169f31] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:47:46.128228 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8fc95223-c162-4dd7-a3bc-6cb7f9de1800 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:46.128992 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8fc95223-c162-4dd7-a3bc-6cb7f9de1800 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:46.129745 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8fc95223-c162-4dd7-a3bc-6cb7f9de1800 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:46.130573 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8fc95223-c162-4dd7-a3bc-6cb7f9de1800 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:46.131114 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8fc95223-c162-4dd7-a3bc-6cb7f9de1800 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:46.131657 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8fc95223-c162-4dd7-a3bc-6cb7f9de1800 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:46.317028 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8fc95223-c162-4dd7-a3bc-6cb7f9de1800 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:47:46.325220 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8fc95223-c162-4dd7-a3bc-6cb7f9de1800 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/e7d6157b-ceac-428b-a4fa-5ebea0169f31" status: 200 len: 1687 microversion: 2.1 time: 0.209565 Oct 17 14:47:46.326022 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3477/7088] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:47:46 2022] GET /compute/v2.1/servers/e7d6157b-ceac-428b-a4fa-5ebea0169f31 => generated 1687 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:47:47.353387 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6e0f9fee-8243-4bcb-b8e9-745e946a2dee tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:47:47.353979 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6e0f9fee-8243-4bcb-b8e9-745e946a2dee tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: e7d6157b-ceac-428b-a4fa-5ebea0169f31] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:47:47.361313 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6e0f9fee-8243-4bcb-b8e9-745e946a2dee tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:47.361849 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6e0f9fee-8243-4bcb-b8e9-745e946a2dee tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:47.362288 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6e0f9fee-8243-4bcb-b8e9-745e946a2dee tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:47.363027 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6e0f9fee-8243-4bcb-b8e9-745e946a2dee tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:47.363527 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6e0f9fee-8243-4bcb-b8e9-745e946a2dee tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:47.363957 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6e0f9fee-8243-4bcb-b8e9-745e946a2dee tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:47.581971 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6e0f9fee-8243-4bcb-b8e9-745e946a2dee tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:47:47.592098 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6e0f9fee-8243-4bcb-b8e9-745e946a2dee tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/e7d6157b-ceac-428b-a4fa-5ebea0169f31" status: 200 len: 1687 microversion: 2.1 time: 0.243294 Oct 17 14:47:47.592684 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3612/7089] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:47:47 2022] GET /compute/v2.1/servers/e7d6157b-ceac-428b-a4fa-5ebea0169f31 => generated 1687 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:47:48.354537 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-2c31b867-2e8c-4b41-a37f-494bd60cbfa6 req-10f5932f-bea0-4006-b946-285e30f92d1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7d6157b-ceac-428b-a4fa-5ebea0169f31", "name": "network-vif-deleted", "tag": "1b8bf10d-c760-4fa4-bebb-a758b5aec985"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:47:48.366657 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-2c31b867-2e8c-4b41-a37f-494bd60cbfa6 req-10f5932f-bea0-4006-b946-285e30f92d1b service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:48.367158 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-2c31b867-2e8c-4b41-a37f-494bd60cbfa6 req-10f5932f-bea0-4006-b946-285e30f92d1b service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:48.367639 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-2c31b867-2e8c-4b41-a37f-494bd60cbfa6 req-10f5932f-bea0-4006-b946-285e30f92d1b service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:48.385441 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-2c31b867-2e8c-4b41-a37f-494bd60cbfa6 req-10f5932f-bea0-4006-b946-285e30f92d1b service nova] Creating event network-vif-deleted:1b8bf10d-c760-4fa4-bebb-a758b5aec985 for instance e7d6157b-ceac-428b-a4fa-5ebea0169f31 on n-h2-854247-14 Oct 17 14:47:48.390868 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-2c31b867-2e8c-4b41-a37f-494bd60cbfa6 req-10f5932f-bea0-4006-b946-285e30f92d1b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039998 Oct 17 14:47:48.391548 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3478/7090] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:47:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:47:48.615899 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ca2ded9a-aeac-4480-9170-20d0136ec607 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:47:48.616524 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ca2ded9a-aeac-4480-9170-20d0136ec607 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: e7d6157b-ceac-428b-a4fa-5ebea0169f31] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:47:48.624560 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ca2ded9a-aeac-4480-9170-20d0136ec607 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:48.624937 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ca2ded9a-aeac-4480-9170-20d0136ec607 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:48.625594 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ca2ded9a-aeac-4480-9170-20d0136ec607 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:48.626415 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ca2ded9a-aeac-4480-9170-20d0136ec607 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:48.626862 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ca2ded9a-aeac-4480-9170-20d0136ec607 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:48.627320 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ca2ded9a-aeac-4480-9170-20d0136ec607 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:48.661538 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ca2ded9a-aeac-4480-9170-20d0136ec607 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:48.662037 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ca2ded9a-aeac-4480-9170-20d0136ec607 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:48.662471 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ca2ded9a-aeac-4480-9170-20d0136ec607 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:48.662930 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-ca2ded9a-aeac-4480-9170-20d0136ec607 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lazy-loading 'fault' on Instance uuid e7d6157b-ceac-428b-a4fa-5ebea0169f31 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:47:48.707558 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ca2ded9a-aeac-4480-9170-20d0136ec607 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:47:48.715986 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ca2ded9a-aeac-4480-9170-20d0136ec607 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/e7d6157b-ceac-428b-a4fa-5ebea0169f31" status: 200 len: 1355 microversion: 2.1 time: 0.104172 Oct 17 14:47:48.716583 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3613/7091] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:47:48 2022] GET /compute/v2.1/servers/e7d6157b-ceac-428b-a4fa-5ebea0169f31 => generated 1355 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:47:49.741707 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e3f0afd2-970f-489c-8d2c-a5088fc42a73 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:47:49.742435 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e3f0afd2-970f-489c-8d2c-a5088fc42a73 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: e7d6157b-ceac-428b-a4fa-5ebea0169f31] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:47:49.749682 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e3f0afd2-970f-489c-8d2c-a5088fc42a73 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:49.750198 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e3f0afd2-970f-489c-8d2c-a5088fc42a73 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:49.750656 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e3f0afd2-970f-489c-8d2c-a5088fc42a73 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:49.751401 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e3f0afd2-970f-489c-8d2c-a5088fc42a73 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:49.751872 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e3f0afd2-970f-489c-8d2c-a5088fc42a73 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:49.752308 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e3f0afd2-970f-489c-8d2c-a5088fc42a73 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:49.766842 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-e3f0afd2-970f-489c-8d2c-a5088fc42a73 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] HTTP exception thrown: Instance e7d6157b-ceac-428b-a4fa-5ebea0169f31 could not be found. Oct 17 14:47:49.770199 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e3f0afd2-970f-489c-8d2c-a5088fc42a73 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Request method failure captured: Oct 17 14:47:49.770199 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/e7d6157b-ceac-428b-a4fa-5ebea0169f31 HTTP/1.1 Oct 17 14:47:49.770199 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 14:47:49.770199 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 14:47:49.770199 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 14:47:49.770199 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 14:47:49.770199 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 14:47:49.770199 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 14:47:49.770199 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 14:47:49.770199 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 14:47:49.770199 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTWrbJTp3_aV3rQ1sZIV-A8RhPUhGtuu3Cdy9UtPO9T2_ui3_S4_dniOOQZy69dfFzd3AdqRHxEdsaXpnKLosIkT6TOjwXy5X_JiSCvihpV_5K-xclYBmfytVuV0W0qLAfA4CBTVr0Qr1hQGpQvQysPbiqlBcm_U91Zx-5cXnnLrTX2s Oct 17 14:47:49.770199 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 14:47:49.770199 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 14:47:49.770199 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 14:47:49.770199 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 14:47:49.770199 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 14:47:49.770199 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 14:47:49.770199 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 6d8fb8c2659a43a696a0a16e7d2be378 Oct 17 14:47:49.770199 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1531965843 Oct 17 14:47:49.770199 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 14:47:49.770199 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 14:47:49.770199 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6d8fb8c2659a43a696a0a16e7d2be378"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6d8fb8c2659a43a696a0a16e7d2be378"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6d8fb8c2659a43a696a0a16e7d2be378"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6d8fb8c2659a43a696a0a16e7d2be378", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:47:49.770199 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1531965843 Oct 17 14:47:49.770199 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 6d8fb8c2659a43a696a0a16e7d2be378 Oct 17 14:47:49.770199 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1531965843 Oct 17 14:47:49.770199 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-TestNetworkAdvancedServerOps-1531965843-project Oct 17 14:47:49.770199 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 14:47:49.770199 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 14:47:49.770199 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 4805a4aa399d4d0798b6077a545a2255 Oct 17 14:47:49.770199 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1531965843-project Oct 17 14:47:49.770199 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 14:47:49.770199 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance e7d6157b-ceac-428b-a4fa-5ebea0169f31 could not be found. Oct 17 14:47:49.770199 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'e7d6157b-ceac-428b-a4fa-5ebea0169f31'} Oct 17 14:47:49.770199 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:47:49.770199 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:47:49.770199 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:47:49.770199 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:47:49.770199 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:47:49.770199 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:47:49.770199 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:47:49.770199 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:47:49.770199 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:47:49.770199 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:47:49.770199 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7d6157b-ceac-428b-a4fa-5ebea0169f31 could not be found. Oct 17 14:47:49.770199 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:47:49.770199 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:47:49.770199 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:47:49.770199 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:47:49.770199 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:47:49.770199 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:47:49.770199 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:47:49.770199 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:47:49.770199 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:47:49.770199 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:47:49.770199 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:47:49.770199 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:47:49.770199 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:47:49.770199 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:47:49.770199 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:47:49.770199 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:47:49.770199 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7d6157b-ceac-428b-a4fa-5ebea0169f31 could not be found. Oct 17 14:47:49.770199 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:47:49.770199 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:47:49.774912 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:47:49.774912 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:47:49.774912 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:47:49.774912 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:47:49.774912 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:47:49.774912 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:47:49.774912 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7d6157b-ceac-428b-a4fa-5ebea0169f31 could not be found. Oct 17 14:47:49.774912 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:47:49.774912 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e3f0afd2-970f-489c-8d2c-a5088fc42a73 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Returning 404 to user: Instance e7d6157b-ceac-428b-a4fa-5ebea0169f31 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:47:49.774912 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e3f0afd2-970f-489c-8d2c-a5088fc42a73 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/e7d6157b-ceac-428b-a4fa-5ebea0169f31" status: 404 len: 111 microversion: 2.1 time: 0.035583 Oct 17 14:47:49.774912 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3479/7092] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:47:49 2022] GET /compute/v2.1/servers/e7d6157b-ceac-428b-a4fa-5ebea0169f31 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:47:53.369579 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-26cf5650-7cff-4bb5-8714-9b473a2c1928 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '.version_select at 0x7f7cd643ddc0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:47:53.407068 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-26cf5650-7cff-4bb5-8714-9b473a2c1928 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-463506775" status: 202 len: 0 microversion: 2.1 time: 0.041185 Oct 17 14:47:53.407813 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3614/7093] 10.222.0.79 () {58 vars in 1281 bytes} [Mon Oct 17 14:47:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-463506775 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:47:53.437091 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6d346fdb-4e85-4a9f-9366-b0b6634df4ab tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Action: 'create', calling method: .version_select at 0x7f7cd9944310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1310393852", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/GNo8jO2uFM2g9Bo9Z6V2Ug3IHEOf6J583+WRaipGGu3qphUkq5bo9uZmdGGDCG5FfOJ4EmwvrY8NE2m2OwOukUSZVGStWP8w/8QhXq4PA2gerF31q5j0386CZ6c6pVA=="}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:47:53.455523 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-6d346fdb-4e85-4a9f-9366-b0b6634df4ab tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Getting quotas for project 6d8fb8c2659a43a696a0a16e7d2be378. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:47:53.462423 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-6d346fdb-4e85-4a9f-9366-b0b6634df4ab tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Getting quotas for user 4805a4aa399d4d0798b6077a545a2255 and project 6d8fb8c2659a43a696a0a16e7d2be378. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:47:53.495812 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6d346fdb-4e85-4a9f-9366-b0b6634df4ab tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.062128 Oct 17 14:47:53.496514 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3480/7094] 10.222.0.79 () {60 vars in 1159 bytes} [Mon Oct 17 14:47:53 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:47:59.479978 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:47:59.484237 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b42e0888-d091-46f5-8743-03aae9849f91 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-123530267", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "ea0a3e19-feb0-465d-b30a-c9257504420b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1310393852", "security_groups": [{"name": "tempest-secgroup-smoke-633217102"}]}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:47:59.617909 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-b42e0888-d091-46f5-8743-03aae9849f91 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] validate_networks() for [('ea0a3e19-feb0-465d-b30a-c9257504420b', None, None, None, None, None)] {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:48:00.064895 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-b42e0888-d091-46f5-8743-03aae9849f91 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:48:00.065368 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-b42e0888-d091-46f5-8743-03aae9849f91 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:48:00.065847 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-b42e0888-d091-46f5-8743-03aae9849f91 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:48:00.066258 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-b42e0888-d091-46f5-8743-03aae9849f91 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:48:00.066885 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-b42e0888-d091-46f5-8743-03aae9849f91 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:48:00.077778 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b42e0888-d091-46f5-8743-03aae9849f91 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:00.078424 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b42e0888-d091-46f5-8743-03aae9849f91 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:00.078856 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b42e0888-d091-46f5-8743-03aae9849f91 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:00.079765 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b42e0888-d091-46f5-8743-03aae9849f91 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:00.080208 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b42e0888-d091-46f5-8743-03aae9849f91 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:00.080802 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b42e0888-d091-46f5-8743-03aae9849f91 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:00.117672 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-b42e0888-d091-46f5-8743-03aae9849f91 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Getting quotas for project 6d8fb8c2659a43a696a0a16e7d2be378. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:48:00.125403 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-b42e0888-d091-46f5-8743-03aae9849f91 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Getting quotas for user 4805a4aa399d4d0798b6077a545a2255 and project 6d8fb8c2659a43a696a0a16e7d2be378. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:48:00.142302 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b42e0888-d091-46f5-8743-03aae9849f91 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:48:00.145402 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b42e0888-d091-46f5-8743-03aae9849f91 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 682677fe-2e64-4ce9-93be-d396ef67154d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:48:00.197946 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b42e0888-d091-46f5-8743-03aae9849f91 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.719711 Oct 17 14:48:00.198715 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3615/7095] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 14:47:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 14:48:00.210198 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e88bf45d-0d2c-4ce8-a167-67d0b6c46e9e tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:48:00.211041 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e88bf45d-0d2c-4ce8-a167-67d0b6c46e9e tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 682677fe-2e64-4ce9-93be-d396ef67154d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:48:00.213837 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=36 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:48:00.296877 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e88bf45d-0d2c-4ce8-a167-67d0b6c46e9e tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:48:00.308607 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e88bf45d-0d2c-4ce8-a167-67d0b6c46e9e tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/682677fe-2e64-4ce9-93be-d396ef67154d" status: 200 len: 1266 microversion: 2.1 time: 0.102166 Oct 17 14:48:00.321585 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3481/7096] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:48:00 2022] GET /compute/v2.1/servers/682677fe-2e64-4ce9-93be-d396ef67154d => generated 1266 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:48:01.335374 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fb6587a3-8a91-4bca-ba5e-daae3d29e740 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:48:01.336027 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-fb6587a3-8a91-4bca-ba5e-daae3d29e740 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 682677fe-2e64-4ce9-93be-d396ef67154d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:48:01.342272 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fb6587a3-8a91-4bca-ba5e-daae3d29e740 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:01.342758 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fb6587a3-8a91-4bca-ba5e-daae3d29e740 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:01.343234 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fb6587a3-8a91-4bca-ba5e-daae3d29e740 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:01.344503 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fb6587a3-8a91-4bca-ba5e-daae3d29e740 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:01.345588 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fb6587a3-8a91-4bca-ba5e-daae3d29e740 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:01.346057 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fb6587a3-8a91-4bca-ba5e-daae3d29e740 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:01.423096 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fb6587a3-8a91-4bca-ba5e-daae3d29e740 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:48:01.431426 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fb6587a3-8a91-4bca-ba5e-daae3d29e740 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/682677fe-2e64-4ce9-93be-d396ef67154d" status: 200 len: 1318 microversion: 2.1 time: 0.101189 Oct 17 14:48:01.443507 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3616/7097] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:48:01 2022] GET /compute/v2.1/servers/682677fe-2e64-4ce9-93be-d396ef67154d => generated 1318 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:48:02.459541 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e9b9fd38-9487-424c-9d53-3cf409fb3922 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:48:02.460201 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e9b9fd38-9487-424c-9d53-3cf409fb3922 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 682677fe-2e64-4ce9-93be-d396ef67154d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:48:02.468802 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e9b9fd38-9487-424c-9d53-3cf409fb3922 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:02.469350 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e9b9fd38-9487-424c-9d53-3cf409fb3922 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:02.469930 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e9b9fd38-9487-424c-9d53-3cf409fb3922 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:02.471012 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e9b9fd38-9487-424c-9d53-3cf409fb3922 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:02.471568 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e9b9fd38-9487-424c-9d53-3cf409fb3922 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:02.472402 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e9b9fd38-9487-424c-9d53-3cf409fb3922 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:02.730705 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e9b9fd38-9487-424c-9d53-3cf409fb3922 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:48:02.739194 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e9b9fd38-9487-424c-9d53-3cf409fb3922 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/682677fe-2e64-4ce9-93be-d396ef67154d" status: 200 len: 1391 microversion: 2.1 time: 0.286853 Oct 17 14:48:02.739817 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3482/7098] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:48:02 2022] GET /compute/v2.1/servers/682677fe-2e64-4ce9-93be-d396ef67154d => generated 1391 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:48:03.152011 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-4d272535-91e5-44e1-b1bc-0c9c34b1745d req-b61a1813-ea8e-404f-a6cf-a4c95398148c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "682677fe-2e64-4ce9-93be-d396ef67154d", "tag": "e49397df-4e58-4e84-a62a-2423f1e81b19"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:48:03.164577 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-4d272535-91e5-44e1-b1bc-0c9c34b1745d req-b61a1813-ea8e-404f-a6cf-a4c95398148c service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:03.165247 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-4d272535-91e5-44e1-b1bc-0c9c34b1745d req-b61a1813-ea8e-404f-a6cf-a4c95398148c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:03.165763 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-4d272535-91e5-44e1-b1bc-0c9c34b1745d req-b61a1813-ea8e-404f-a6cf-a4c95398148c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:03.185335 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-4d272535-91e5-44e1-b1bc-0c9c34b1745d req-b61a1813-ea8e-404f-a6cf-a4c95398148c service nova] Creating event network-changed:e49397df-4e58-4e84-a62a-2423f1e81b19 for instance 682677fe-2e64-4ce9-93be-d396ef67154d on n-h1-854247-14 Oct 17 14:48:03.195636 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-4d272535-91e5-44e1-b1bc-0c9c34b1745d req-b61a1813-ea8e-404f-a6cf-a4c95398148c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047349 Oct 17 14:48:03.196308 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3617/7099] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:48:03.763217 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6bd00e1c-740e-48b6-b714-52531dea671e tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:48:03.763845 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6bd00e1c-740e-48b6-b714-52531dea671e tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 682677fe-2e64-4ce9-93be-d396ef67154d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:48:03.774072 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6bd00e1c-740e-48b6-b714-52531dea671e tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:03.774851 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6bd00e1c-740e-48b6-b714-52531dea671e tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:03.780278 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6bd00e1c-740e-48b6-b714-52531dea671e tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:03.780278 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6bd00e1c-740e-48b6-b714-52531dea671e tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:03.780278 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6bd00e1c-740e-48b6-b714-52531dea671e tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:03.780278 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6bd00e1c-740e-48b6-b714-52531dea671e tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:03.920247 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6bd00e1c-740e-48b6-b714-52531dea671e tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:48:03.928807 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6bd00e1c-740e-48b6-b714-52531dea671e tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/682677fe-2e64-4ce9-93be-d396ef67154d" status: 200 len: 1391 microversion: 2.1 time: 0.169521 Oct 17 14:48:03.929417 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3483/7100] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:48:03 2022] GET /compute/v2.1/servers/682677fe-2e64-4ce9-93be-d396ef67154d => generated 1391 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:48:04.954977 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2a610d91-d7cd-42eb-891b-0cd4d7359386 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:48:04.956274 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2a610d91-d7cd-42eb-891b-0cd4d7359386 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 682677fe-2e64-4ce9-93be-d396ef67154d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:48:04.964112 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2a610d91-d7cd-42eb-891b-0cd4d7359386 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:04.964598 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2a610d91-d7cd-42eb-891b-0cd4d7359386 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:04.965244 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2a610d91-d7cd-42eb-891b-0cd4d7359386 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:04.966078 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2a610d91-d7cd-42eb-891b-0cd4d7359386 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:04.966479 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2a610d91-d7cd-42eb-891b-0cd4d7359386 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:04.966864 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2a610d91-d7cd-42eb-891b-0cd4d7359386 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:05.109279 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2a610d91-d7cd-42eb-891b-0cd4d7359386 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:48:05.117768 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2a610d91-d7cd-42eb-891b-0cd4d7359386 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/682677fe-2e64-4ce9-93be-d396ef67154d" status: 200 len: 1391 microversion: 2.1 time: 0.168116 Oct 17 14:48:05.118365 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3618/7101] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:48:04 2022] GET /compute/v2.1/servers/682677fe-2e64-4ce9-93be-d396ef67154d => generated 1391 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:48:06.141474 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e883d2a3-9f5e-4298-af02-a40d444b9b85 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:48:06.142088 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e883d2a3-9f5e-4298-af02-a40d444b9b85 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 682677fe-2e64-4ce9-93be-d396ef67154d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:48:06.144941 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:48:06.151076 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e883d2a3-9f5e-4298-af02-a40d444b9b85 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:06.151617 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e883d2a3-9f5e-4298-af02-a40d444b9b85 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:06.152125 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e883d2a3-9f5e-4298-af02-a40d444b9b85 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:06.152946 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e883d2a3-9f5e-4298-af02-a40d444b9b85 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:06.153425 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e883d2a3-9f5e-4298-af02-a40d444b9b85 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:06.153869 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e883d2a3-9f5e-4298-af02-a40d444b9b85 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:06.294850 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e883d2a3-9f5e-4298-af02-a40d444b9b85 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:48:06.303217 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e883d2a3-9f5e-4298-af02-a40d444b9b85 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/682677fe-2e64-4ce9-93be-d396ef67154d" status: 200 len: 1391 microversion: 2.1 time: 0.165716 Oct 17 14:48:06.303836 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3484/7102] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:48:06 2022] GET /compute/v2.1/servers/682677fe-2e64-4ce9-93be-d396ef67154d => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:48:07.328639 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cf0aa0d8-7fd9-4282-8dbc-fbd017a6d723 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:48:07.329226 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cf0aa0d8-7fd9-4282-8dbc-fbd017a6d723 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 682677fe-2e64-4ce9-93be-d396ef67154d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:48:07.336822 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cf0aa0d8-7fd9-4282-8dbc-fbd017a6d723 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:07.337452 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cf0aa0d8-7fd9-4282-8dbc-fbd017a6d723 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:07.337908 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cf0aa0d8-7fd9-4282-8dbc-fbd017a6d723 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:07.338604 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cf0aa0d8-7fd9-4282-8dbc-fbd017a6d723 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:07.339054 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cf0aa0d8-7fd9-4282-8dbc-fbd017a6d723 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:07.339501 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cf0aa0d8-7fd9-4282-8dbc-fbd017a6d723 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:07.481880 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cf0aa0d8-7fd9-4282-8dbc-fbd017a6d723 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:48:07.492993 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cf0aa0d8-7fd9-4282-8dbc-fbd017a6d723 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/682677fe-2e64-4ce9-93be-d396ef67154d" status: 200 len: 1391 microversion: 2.1 time: 0.169786 Oct 17 14:48:07.493761 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3619/7103] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:48:07 2022] GET /compute/v2.1/servers/682677fe-2e64-4ce9-93be-d396ef67154d => generated 1391 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:48:08.521986 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2124c417-53cc-4466-98f0-f19c18d085f8 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:48:08.522893 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2124c417-53cc-4466-98f0-f19c18d085f8 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 682677fe-2e64-4ce9-93be-d396ef67154d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:48:08.532709 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2124c417-53cc-4466-98f0-f19c18d085f8 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:08.533203 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2124c417-53cc-4466-98f0-f19c18d085f8 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:08.533666 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2124c417-53cc-4466-98f0-f19c18d085f8 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:08.534525 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2124c417-53cc-4466-98f0-f19c18d085f8 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:08.535297 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2124c417-53cc-4466-98f0-f19c18d085f8 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:08.535741 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2124c417-53cc-4466-98f0-f19c18d085f8 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:08.676723 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2124c417-53cc-4466-98f0-f19c18d085f8 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:48:08.684834 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2124c417-53cc-4466-98f0-f19c18d085f8 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/682677fe-2e64-4ce9-93be-d396ef67154d" status: 200 len: 1391 microversion: 2.1 time: 0.168645 Oct 17 14:48:08.699193 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3485/7104] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:48:08 2022] GET /compute/v2.1/servers/682677fe-2e64-4ce9-93be-d396ef67154d => generated 1391 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:48:08.755126 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-cde14dfa-eb23-4f5f-a90c-b535d08421a2 req-3be2f09d-a950-4bb0-a032-11ddcc008441 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "682677fe-2e64-4ce9-93be-d396ef67154d", "name": "network-vif-plugged", "status": "completed", "tag": "e49397df-4e58-4e84-a62a-2423f1e81b19"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:48:08.766713 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-cde14dfa-eb23-4f5f-a90c-b535d08421a2 req-3be2f09d-a950-4bb0-a032-11ddcc008441 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:08.767257 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-cde14dfa-eb23-4f5f-a90c-b535d08421a2 req-3be2f09d-a950-4bb0-a032-11ddcc008441 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:08.767726 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-cde14dfa-eb23-4f5f-a90c-b535d08421a2 req-3be2f09d-a950-4bb0-a032-11ddcc008441 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:08.783600 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-cde14dfa-eb23-4f5f-a90c-b535d08421a2 req-3be2f09d-a950-4bb0-a032-11ddcc008441 service nova] Creating event network-vif-plugged:e49397df-4e58-4e84-a62a-2423f1e81b19 for instance 682677fe-2e64-4ce9-93be-d396ef67154d on n-h1-854247-14 Oct 17 14:48:08.789350 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-cde14dfa-eb23-4f5f-a90c-b535d08421a2 req-3be2f09d-a950-4bb0-a032-11ddcc008441 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038238 Oct 17 14:48:08.790239 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3620/7105] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:48:09.710646 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b4ef9c5f-2548-4694-bac7-0d65f0a251eb tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:48:09.711299 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b4ef9c5f-2548-4694-bac7-0d65f0a251eb tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 682677fe-2e64-4ce9-93be-d396ef67154d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:48:09.719148 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b4ef9c5f-2548-4694-bac7-0d65f0a251eb tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:09.719740 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b4ef9c5f-2548-4694-bac7-0d65f0a251eb tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:09.720247 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b4ef9c5f-2548-4694-bac7-0d65f0a251eb tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:09.721037 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b4ef9c5f-2548-4694-bac7-0d65f0a251eb tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:09.721730 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b4ef9c5f-2548-4694-bac7-0d65f0a251eb tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:09.722179 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b4ef9c5f-2548-4694-bac7-0d65f0a251eb tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:09.864053 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b4ef9c5f-2548-4694-bac7-0d65f0a251eb tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:48:09.877498 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b4ef9c5f-2548-4694-bac7-0d65f0a251eb tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/682677fe-2e64-4ce9-93be-d396ef67154d" status: 200 len: 1391 microversion: 2.1 time: 0.171503 Oct 17 14:48:09.878395 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3486/7106] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:48:09 2022] GET /compute/v2.1/servers/682677fe-2e64-4ce9-93be-d396ef67154d => generated 1391 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:48:10.902896 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-dacab7fa-f65e-448b-9d45-085db82136b9 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:48:10.903635 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-dacab7fa-f65e-448b-9d45-085db82136b9 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 682677fe-2e64-4ce9-93be-d396ef67154d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:48:10.906465 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:48:10.907324 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=6 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:48:10.908718 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:48:10.918356 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dacab7fa-f65e-448b-9d45-085db82136b9 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:10.918990 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dacab7fa-f65e-448b-9d45-085db82136b9 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:10.919580 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dacab7fa-f65e-448b-9d45-085db82136b9 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:10.920688 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dacab7fa-f65e-448b-9d45-085db82136b9 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:10.921391 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dacab7fa-f65e-448b-9d45-085db82136b9 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:10.922047 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dacab7fa-f65e-448b-9d45-085db82136b9 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:11.067574 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-dacab7fa-f65e-448b-9d45-085db82136b9 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:48:11.075899 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-dacab7fa-f65e-448b-9d45-085db82136b9 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/682677fe-2e64-4ce9-93be-d396ef67154d" status: 200 len: 1563 microversion: 2.1 time: 0.177572 Oct 17 14:48:11.076482 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3621/7107] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:48:10 2022] GET /compute/v2.1/servers/682677fe-2e64-4ce9-93be-d396ef67154d => generated 1563 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:48:11.098591 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-8d4af855-ff79-4e33-9a03-050266595303 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:48:11.099230 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-8d4af855-ff79-4e33-9a03-050266595303 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 682677fe-2e64-4ce9-93be-d396ef67154d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:48:11.101238 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=6 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:48:11.107644 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8d4af855-ff79-4e33-9a03-050266595303 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:11.108152 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8d4af855-ff79-4e33-9a03-050266595303 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:11.108585 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8d4af855-ff79-4e33-9a03-050266595303 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:11.109299 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8d4af855-ff79-4e33-9a03-050266595303 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:11.109762 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8d4af855-ff79-4e33-9a03-050266595303 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:11.110189 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-8d4af855-ff79-4e33-9a03-050266595303 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:11.258914 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-8d4af855-ff79-4e33-9a03-050266595303 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:48:11.267277 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-8d4af855-ff79-4e33-9a03-050266595303 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/682677fe-2e64-4ce9-93be-d396ef67154d" status: 200 len: 1563 microversion: 2.1 time: 0.172644 Oct 17 14:48:11.267788 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3487/7108] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:48:11 2022] GET /compute/v2.1/servers/682677fe-2e64-4ce9-93be-d396ef67154d => generated 1563 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:48:13.287023 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-686a2cda-4909-488b-9eaf-98c0607e9fb0 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:48:13.287706 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-686a2cda-4909-488b-9eaf-98c0607e9fb0 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 682677fe-2e64-4ce9-93be-d396ef67154d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:48:13.288754 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-b86bd09a-99dc-4379-87d4-f9e131120b04 req-a8e7446c-87d0-43e0-94aa-d22f76723d3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "682677fe-2e64-4ce9-93be-d396ef67154d", "tag": "e49397df-4e58-4e84-a62a-2423f1e81b19"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:48:13.295457 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-686a2cda-4909-488b-9eaf-98c0607e9fb0 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:13.296286 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-686a2cda-4909-488b-9eaf-98c0607e9fb0 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:13.296916 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-686a2cda-4909-488b-9eaf-98c0607e9fb0 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:13.297804 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-686a2cda-4909-488b-9eaf-98c0607e9fb0 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:13.298558 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-686a2cda-4909-488b-9eaf-98c0607e9fb0 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:13.299042 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-686a2cda-4909-488b-9eaf-98c0607e9fb0 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:13.302248 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-b86bd09a-99dc-4379-87d4-f9e131120b04 req-a8e7446c-87d0-43e0-94aa-d22f76723d3f service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:13.302740 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-b86bd09a-99dc-4379-87d4-f9e131120b04 req-a8e7446c-87d0-43e0-94aa-d22f76723d3f service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:13.303200 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-b86bd09a-99dc-4379-87d4-f9e131120b04 req-a8e7446c-87d0-43e0-94aa-d22f76723d3f service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:13.319801 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-b86bd09a-99dc-4379-87d4-f9e131120b04 req-a8e7446c-87d0-43e0-94aa-d22f76723d3f service nova] Creating event network-changed:e49397df-4e58-4e84-a62a-2423f1e81b19 for instance 682677fe-2e64-4ce9-93be-d396ef67154d on n-h1-854247-14 Oct 17 14:48:13.325430 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-b86bd09a-99dc-4379-87d4-f9e131120b04 req-a8e7446c-87d0-43e0-94aa-d22f76723d3f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040564 Oct 17 14:48:13.326347 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3488/7109] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:48:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:48:13.588738 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-686a2cda-4909-488b-9eaf-98c0607e9fb0 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:48:13.600122 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-686a2cda-4909-488b-9eaf-98c0607e9fb0 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/682677fe-2e64-4ce9-93be-d396ef67154d" status: 200 len: 1563 microversion: 2.1 time: 0.317019 Oct 17 14:48:13.600772 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3622/7110] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:48:13 2022] GET /compute/v2.1/servers/682677fe-2e64-4ce9-93be-d396ef67154d => generated 1563 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:48:34.909693 n-d-854247-14 devstack@n-api.service[127017]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 14:48:34.910337 n-d-854247-14 devstack@n-api.service[127017]: Mon Oct 17 14:48:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/682677fe-2e64-4ce9-93be-d396ef67154d/action (ip 10.222.0.79) !!! Oct 17 14:48:34.911464 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=9 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:48:34.912275 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=38 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:48:34.917178 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3043d55d-92f0-4f33-8f28-c1c48482569c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:48:34.919556 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3043d55d-92f0-4f33-8f28-c1c48482569c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 682677fe-2e64-4ce9-93be-d396ef67154d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:48:34.929673 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3043d55d-92f0-4f33-8f28-c1c48482569c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:34.930172 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3043d55d-92f0-4f33-8f28-c1c48482569c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:34.930624 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3043d55d-92f0-4f33-8f28-c1c48482569c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:34.931385 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3043d55d-92f0-4f33-8f28-c1c48482569c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:34.931847 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3043d55d-92f0-4f33-8f28-c1c48482569c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:34.932280 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3043d55d-92f0-4f33-8f28-c1c48482569c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:34.989498 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3043d55d-92f0-4f33-8f28-c1c48482569c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "POST /compute/v2.1/servers/682677fe-2e64-4ce9-93be-d396ef67154d/action" status: 200 len: 24569 microversion: 2.1 time: 0.081789 Oct 17 14:48:34.990162 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3489/7111] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:48:34 2022] POST /compute/v2.1/servers/682677fe-2e64-4ce9-93be-d396ef67154d/action => generated 24569 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:48:41.352109 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-63cec96a-227d-4309-91ea-79c99d11494d tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:48:41.354332 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-63cec96a-227d-4309-91ea-79c99d11494d tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 682677fe-2e64-4ce9-93be-d396ef67154d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:48:41.356593 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=3 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:48:41.357264 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=36 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:48:41.363856 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-63cec96a-227d-4309-91ea-79c99d11494d tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:41.364677 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-63cec96a-227d-4309-91ea-79c99d11494d tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:41.365240 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-63cec96a-227d-4309-91ea-79c99d11494d tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:41.365972 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-63cec96a-227d-4309-91ea-79c99d11494d tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:41.366428 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-63cec96a-227d-4309-91ea-79c99d11494d tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:41.366852 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-63cec96a-227d-4309-91ea-79c99d11494d tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:41.451187 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-63cec96a-227d-4309-91ea-79c99d11494d tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "POST /compute/v2.1/servers/682677fe-2e64-4ce9-93be-d396ef67154d/action" status: 202 len: 0 microversion: 2.1 time: 0.104516 Oct 17 14:48:41.452136 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3623/7112] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:48:41 2022] POST /compute/v2.1/servers/682677fe-2e64-4ce9-93be-d396ef67154d/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:48:41.461730 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5138eab0-4db4-4b88-b591-925da43a8da0 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:48:41.462493 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5138eab0-4db4-4b88-b591-925da43a8da0 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 682677fe-2e64-4ce9-93be-d396ef67154d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:48:41.470760 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5138eab0-4db4-4b88-b591-925da43a8da0 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:41.471306 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5138eab0-4db4-4b88-b591-925da43a8da0 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:41.471774 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5138eab0-4db4-4b88-b591-925da43a8da0 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:41.473141 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5138eab0-4db4-4b88-b591-925da43a8da0 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:41.473141 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5138eab0-4db4-4b88-b591-925da43a8da0 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:41.474536 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5138eab0-4db4-4b88-b591-925da43a8da0 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:41.842810 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5138eab0-4db4-4b88-b591-925da43a8da0 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:48:41.854147 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5138eab0-4db4-4b88-b591-925da43a8da0 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/682677fe-2e64-4ce9-93be-d396ef67154d" status: 200 len: 1674 microversion: 2.1 time: 0.397091 Oct 17 14:48:41.854931 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3490/7113] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:48:41 2022] GET /compute/v2.1/servers/682677fe-2e64-4ce9-93be-d396ef67154d => generated 1674 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:48:42.882825 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a965ec0a-5203-4b12-a05a-aca61b914806 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:48:42.883567 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a965ec0a-5203-4b12-a05a-aca61b914806 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 682677fe-2e64-4ce9-93be-d396ef67154d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:48:42.890622 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a965ec0a-5203-4b12-a05a-aca61b914806 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:42.891105 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a965ec0a-5203-4b12-a05a-aca61b914806 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:42.891574 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a965ec0a-5203-4b12-a05a-aca61b914806 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:42.892297 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a965ec0a-5203-4b12-a05a-aca61b914806 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:42.892717 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a965ec0a-5203-4b12-a05a-aca61b914806 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:42.893136 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a965ec0a-5203-4b12-a05a-aca61b914806 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:43.075651 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a965ec0a-5203-4b12-a05a-aca61b914806 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:48:43.084346 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a965ec0a-5203-4b12-a05a-aca61b914806 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/682677fe-2e64-4ce9-93be-d396ef67154d" status: 200 len: 1679 microversion: 2.1 time: 0.207467 Oct 17 14:48:43.084987 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3624/7114] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:48:42 2022] GET /compute/v2.1/servers/682677fe-2e64-4ce9-93be-d396ef67154d => generated 1679 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:48:44.111036 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1c4dff7e-43dc-40cc-9d79-077443508082 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:48:44.111837 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1c4dff7e-43dc-40cc-9d79-077443508082 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 682677fe-2e64-4ce9-93be-d396ef67154d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:48:44.120569 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c4dff7e-43dc-40cc-9d79-077443508082 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:44.121083 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c4dff7e-43dc-40cc-9d79-077443508082 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:44.121537 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c4dff7e-43dc-40cc-9d79-077443508082 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:44.122262 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c4dff7e-43dc-40cc-9d79-077443508082 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:44.122704 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c4dff7e-43dc-40cc-9d79-077443508082 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:44.123142 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1c4dff7e-43dc-40cc-9d79-077443508082 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:44.286273 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1c4dff7e-43dc-40cc-9d79-077443508082 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:48:44.299320 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1c4dff7e-43dc-40cc-9d79-077443508082 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/682677fe-2e64-4ce9-93be-d396ef67154d" status: 200 len: 1679 microversion: 2.1 time: 0.192305 Oct 17 14:48:44.299914 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3491/7115] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:48:44 2022] GET /compute/v2.1/servers/682677fe-2e64-4ce9-93be-d396ef67154d => generated 1679 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:48:45.323730 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-080cd4e7-a9c4-4054-a59d-a51ce4b2cee2 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:48:45.324346 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-080cd4e7-a9c4-4054-a59d-a51ce4b2cee2 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 682677fe-2e64-4ce9-93be-d396ef67154d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:48:45.332002 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-080cd4e7-a9c4-4054-a59d-a51ce4b2cee2 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:45.332675 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-080cd4e7-a9c4-4054-a59d-a51ce4b2cee2 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:45.333190 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-080cd4e7-a9c4-4054-a59d-a51ce4b2cee2 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:45.333914 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-080cd4e7-a9c4-4054-a59d-a51ce4b2cee2 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:45.334374 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-080cd4e7-a9c4-4054-a59d-a51ce4b2cee2 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:45.334803 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-080cd4e7-a9c4-4054-a59d-a51ce4b2cee2 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:45.481639 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-080cd4e7-a9c4-4054-a59d-a51ce4b2cee2 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:48:45.489792 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-080cd4e7-a9c4-4054-a59d-a51ce4b2cee2 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/682677fe-2e64-4ce9-93be-d396ef67154d" status: 200 len: 1679 microversion: 2.1 time: 0.170169 Oct 17 14:48:45.490373 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3625/7116] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:48:45 2022] GET /compute/v2.1/servers/682677fe-2e64-4ce9-93be-d396ef67154d => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:48:46.514070 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-be03fb90-4c53-4c00-a064-fb1a798e5df2 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:48:46.514715 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-be03fb90-4c53-4c00-a064-fb1a798e5df2 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 682677fe-2e64-4ce9-93be-d396ef67154d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:48:46.522700 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-be03fb90-4c53-4c00-a064-fb1a798e5df2 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:46.523277 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-be03fb90-4c53-4c00-a064-fb1a798e5df2 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:46.523738 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-be03fb90-4c53-4c00-a064-fb1a798e5df2 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:46.524603 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-be03fb90-4c53-4c00-a064-fb1a798e5df2 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:46.525132 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-be03fb90-4c53-4c00-a064-fb1a798e5df2 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:46.525731 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-be03fb90-4c53-4c00-a064-fb1a798e5df2 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:46.673834 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-be03fb90-4c53-4c00-a064-fb1a798e5df2 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:48:46.684112 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-be03fb90-4c53-4c00-a064-fb1a798e5df2 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/682677fe-2e64-4ce9-93be-d396ef67154d" status: 200 len: 1679 microversion: 2.1 time: 0.174096 Oct 17 14:48:46.684719 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3492/7117] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:48:46 2022] GET /compute/v2.1/servers/682677fe-2e64-4ce9-93be-d396ef67154d => generated 1679 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:48:47.709481 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a6326c84-eae2-4bb6-a7b4-5a4098cd684d tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:48:47.710342 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a6326c84-eae2-4bb6-a7b4-5a4098cd684d tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 682677fe-2e64-4ce9-93be-d396ef67154d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:48:47.717804 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a6326c84-eae2-4bb6-a7b4-5a4098cd684d tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:47.718295 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a6326c84-eae2-4bb6-a7b4-5a4098cd684d tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:47.718774 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a6326c84-eae2-4bb6-a7b4-5a4098cd684d tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:47.719521 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a6326c84-eae2-4bb6-a7b4-5a4098cd684d tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:47.719966 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a6326c84-eae2-4bb6-a7b4-5a4098cd684d tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:47.720393 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a6326c84-eae2-4bb6-a7b4-5a4098cd684d tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:47.860080 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a6326c84-eae2-4bb6-a7b4-5a4098cd684d tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:48:47.868487 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a6326c84-eae2-4bb6-a7b4-5a4098cd684d tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/682677fe-2e64-4ce9-93be-d396ef67154d" status: 200 len: 1679 microversion: 2.1 time: 0.163020 Oct 17 14:48:47.869048 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3626/7118] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:48:47 2022] GET /compute/v2.1/servers/682677fe-2e64-4ce9-93be-d396ef67154d => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:48:48.896978 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f86f7045-320c-4c05-b211-bf18b5166614 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:48:48.898032 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f86f7045-320c-4c05-b211-bf18b5166614 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 682677fe-2e64-4ce9-93be-d396ef67154d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:48:48.910000 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f86f7045-320c-4c05-b211-bf18b5166614 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:48.910842 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f86f7045-320c-4c05-b211-bf18b5166614 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:48.911665 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f86f7045-320c-4c05-b211-bf18b5166614 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:48.912847 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f86f7045-320c-4c05-b211-bf18b5166614 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:48.913641 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f86f7045-320c-4c05-b211-bf18b5166614 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:48.914573 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f86f7045-320c-4c05-b211-bf18b5166614 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:49.066705 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f86f7045-320c-4c05-b211-bf18b5166614 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:48:49.075076 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f86f7045-320c-4c05-b211-bf18b5166614 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/682677fe-2e64-4ce9-93be-d396ef67154d" status: 200 len: 1679 microversion: 2.1 time: 0.185094 Oct 17 14:48:49.075687 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3493/7119] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:48:48 2022] GET /compute/v2.1/servers/682677fe-2e64-4ce9-93be-d396ef67154d => generated 1679 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:48:50.099006 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f2ef990b-b94a-429e-9359-3556ba2aa3e2 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:48:50.099658 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f2ef990b-b94a-429e-9359-3556ba2aa3e2 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 682677fe-2e64-4ce9-93be-d396ef67154d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:48:50.107033 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f2ef990b-b94a-429e-9359-3556ba2aa3e2 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:50.107552 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f2ef990b-b94a-429e-9359-3556ba2aa3e2 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:50.107993 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f2ef990b-b94a-429e-9359-3556ba2aa3e2 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:50.108705 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f2ef990b-b94a-429e-9359-3556ba2aa3e2 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:50.109160 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f2ef990b-b94a-429e-9359-3556ba2aa3e2 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:50.109591 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f2ef990b-b94a-429e-9359-3556ba2aa3e2 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:50.252975 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f2ef990b-b94a-429e-9359-3556ba2aa3e2 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:48:50.261414 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f2ef990b-b94a-429e-9359-3556ba2aa3e2 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/682677fe-2e64-4ce9-93be-d396ef67154d" status: 200 len: 1679 microversion: 2.1 time: 0.166420 Oct 17 14:48:50.262005 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3627/7120] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:48:50 2022] GET /compute/v2.1/servers/682677fe-2e64-4ce9-93be-d396ef67154d => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:48:51.288030 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e97ac191-d176-4ab8-b7f6-d40783b73ccf tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:48:51.288875 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e97ac191-d176-4ab8-b7f6-d40783b73ccf tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 682677fe-2e64-4ce9-93be-d396ef67154d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:48:51.298271 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e97ac191-d176-4ab8-b7f6-d40783b73ccf tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:51.299025 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e97ac191-d176-4ab8-b7f6-d40783b73ccf tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:51.299862 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e97ac191-d176-4ab8-b7f6-d40783b73ccf tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:51.300766 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e97ac191-d176-4ab8-b7f6-d40783b73ccf tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:51.301478 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e97ac191-d176-4ab8-b7f6-d40783b73ccf tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:51.302083 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e97ac191-d176-4ab8-b7f6-d40783b73ccf tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:51.458860 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e97ac191-d176-4ab8-b7f6-d40783b73ccf tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:48:51.467217 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e97ac191-d176-4ab8-b7f6-d40783b73ccf tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/682677fe-2e64-4ce9-93be-d396ef67154d" status: 200 len: 1679 microversion: 2.1 time: 0.185291 Oct 17 14:48:51.467809 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3494/7121] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:48:51 2022] GET /compute/v2.1/servers/682677fe-2e64-4ce9-93be-d396ef67154d => generated 1679 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:48:52.491402 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7db21f8e-cf50-41f6-8ac4-15e158b899a5 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:48:52.492048 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7db21f8e-cf50-41f6-8ac4-15e158b899a5 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 682677fe-2e64-4ce9-93be-d396ef67154d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:48:52.500466 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7db21f8e-cf50-41f6-8ac4-15e158b899a5 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:52.500934 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7db21f8e-cf50-41f6-8ac4-15e158b899a5 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:52.501407 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7db21f8e-cf50-41f6-8ac4-15e158b899a5 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:52.502126 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7db21f8e-cf50-41f6-8ac4-15e158b899a5 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:52.502587 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7db21f8e-cf50-41f6-8ac4-15e158b899a5 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:52.503018 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7db21f8e-cf50-41f6-8ac4-15e158b899a5 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:52.663154 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7db21f8e-cf50-41f6-8ac4-15e158b899a5 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:48:52.676102 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7db21f8e-cf50-41f6-8ac4-15e158b899a5 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/682677fe-2e64-4ce9-93be-d396ef67154d" status: 200 len: 1679 microversion: 2.1 time: 0.188639 Oct 17 14:48:52.676691 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3628/7122] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:48:52 2022] GET /compute/v2.1/servers/682677fe-2e64-4ce9-93be-d396ef67154d => generated 1679 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:48:53.700382 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f863ccd8-b505-4c9b-b9c7-afcc4f9b5970 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:48:53.701034 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f863ccd8-b505-4c9b-b9c7-afcc4f9b5970 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 682677fe-2e64-4ce9-93be-d396ef67154d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:48:53.708716 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f863ccd8-b505-4c9b-b9c7-afcc4f9b5970 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:53.709296 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f863ccd8-b505-4c9b-b9c7-afcc4f9b5970 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:53.709946 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f863ccd8-b505-4c9b-b9c7-afcc4f9b5970 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:53.710872 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f863ccd8-b505-4c9b-b9c7-afcc4f9b5970 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:53.711388 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f863ccd8-b505-4c9b-b9c7-afcc4f9b5970 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:53.711851 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f863ccd8-b505-4c9b-b9c7-afcc4f9b5970 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:53.862284 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f863ccd8-b505-4c9b-b9c7-afcc4f9b5970 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:48:53.870921 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f863ccd8-b505-4c9b-b9c7-afcc4f9b5970 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/682677fe-2e64-4ce9-93be-d396ef67154d" status: 200 len: 1682 microversion: 2.1 time: 0.174641 Oct 17 14:48:53.871551 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3495/7123] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:48:53 2022] GET /compute/v2.1/servers/682677fe-2e64-4ce9-93be-d396ef67154d => generated 1682 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:49:16.082458 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-56afabe0-efc0-43ba-9baa-e0a915ac4597 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:49:16.084826 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-56afabe0-efc0-43ba-9baa-e0a915ac4597 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 682677fe-2e64-4ce9-93be-d396ef67154d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:49:16.090983 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=12 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:49:16.091682 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:49:16.093536 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-56afabe0-efc0-43ba-9baa-e0a915ac4597 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:16.094431 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-56afabe0-efc0-43ba-9baa-e0a915ac4597 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:16.094663 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-56afabe0-efc0-43ba-9baa-e0a915ac4597 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:16.095924 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-56afabe0-efc0-43ba-9baa-e0a915ac4597 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:16.096453 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-56afabe0-efc0-43ba-9baa-e0a915ac4597 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:16.096880 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-56afabe0-efc0-43ba-9baa-e0a915ac4597 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:16.161118 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-56afabe0-efc0-43ba-9baa-e0a915ac4597 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "POST /compute/v2.1/servers/682677fe-2e64-4ce9-93be-d396ef67154d/action" status: 200 len: 69083 microversion: 2.1 time: 0.083278 Oct 17 14:49:16.162166 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3629/7124] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:49:16 2022] POST /compute/v2.1/servers/682677fe-2e64-4ce9-93be-d396ef67154d/action => generated 69083 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:49:23.527653 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d00ff36f-30cb-44dc-996b-d74c92626a68 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:49:23.528489 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d00ff36f-30cb-44dc-996b-d74c92626a68 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 682677fe-2e64-4ce9-93be-d396ef67154d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:49:23.529902 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-92405f91-bd5f-49ae-8313-8e45694585bb req-c2b6c7be-17c4-4089-8e4b-45636c5b9e26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "682677fe-2e64-4ce9-93be-d396ef67154d", "tag": "e49397df-4e58-4e84-a62a-2423f1e81b19"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:49:23.532780 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=14 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:49:23.533533 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=40 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:49:23.539141 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d00ff36f-30cb-44dc-996b-d74c92626a68 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:23.539680 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d00ff36f-30cb-44dc-996b-d74c92626a68 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:23.540407 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d00ff36f-30cb-44dc-996b-d74c92626a68 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:23.542026 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d00ff36f-30cb-44dc-996b-d74c92626a68 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:23.542484 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d00ff36f-30cb-44dc-996b-d74c92626a68 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:23.542931 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d00ff36f-30cb-44dc-996b-d74c92626a68 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:23.543198 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-92405f91-bd5f-49ae-8313-8e45694585bb req-c2b6c7be-17c4-4089-8e4b-45636c5b9e26 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:23.543909 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-92405f91-bd5f-49ae-8313-8e45694585bb req-c2b6c7be-17c4-4089-8e4b-45636c5b9e26 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:23.544649 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-92405f91-bd5f-49ae-8313-8e45694585bb req-c2b6c7be-17c4-4089-8e4b-45636c5b9e26 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:23.557427 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-92405f91-bd5f-49ae-8313-8e45694585bb req-c2b6c7be-17c4-4089-8e4b-45636c5b9e26 service nova] Creating event network-changed:e49397df-4e58-4e84-a62a-2423f1e81b19 for instance 682677fe-2e64-4ce9-93be-d396ef67154d on n-h1-854247-14 Oct 17 14:49:23.562894 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-92405f91-bd5f-49ae-8313-8e45694585bb req-c2b6c7be-17c4-4089-8e4b-45636c5b9e26 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037255 Oct 17 14:49:23.563566 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3630/7125] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:49:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:49:23.581140 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d00ff36f-30cb-44dc-996b-d74c92626a68 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 682677fe-2e64-4ce9-93be-d396ef67154d] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:49:23.697617 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d00ff36f-30cb-44dc-996b-d74c92626a68 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "DELETE /compute/v2.1/servers/682677fe-2e64-4ce9-93be-d396ef67154d" status: 204 len: 0 microversion: 2.1 time: 0.173792 Oct 17 14:49:23.699060 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3496/7126] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:49:23 2022] DELETE /compute/v2.1/servers/682677fe-2e64-4ce9-93be-d396ef67154d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:49:23.715356 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-949b0299-2520-4712-befa-c84491d71908 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:49:23.716479 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-949b0299-2520-4712-befa-c84491d71908 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 682677fe-2e64-4ce9-93be-d396ef67154d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:49:23.728006 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-949b0299-2520-4712-befa-c84491d71908 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:23.728871 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-949b0299-2520-4712-befa-c84491d71908 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:23.729636 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-949b0299-2520-4712-befa-c84491d71908 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:23.730884 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-949b0299-2520-4712-befa-c84491d71908 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:23.731926 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-949b0299-2520-4712-befa-c84491d71908 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:23.732712 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-949b0299-2520-4712-befa-c84491d71908 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:23.921043 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-949b0299-2520-4712-befa-c84491d71908 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:49:23.933552 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-949b0299-2520-4712-befa-c84491d71908 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/682677fe-2e64-4ce9-93be-d396ef67154d" status: 200 len: 1688 microversion: 2.1 time: 0.227528 Oct 17 14:49:23.934255 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3631/7127] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:49:23 2022] GET /compute/v2.1/servers/682677fe-2e64-4ce9-93be-d396ef67154d => generated 1688 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:49:24.959282 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-61a65e8e-a168-4bb0-9b9a-c5434762b244 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:49:24.960195 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-61a65e8e-a168-4bb0-9b9a-c5434762b244 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 682677fe-2e64-4ce9-93be-d396ef67154d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:49:24.967913 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-61a65e8e-a168-4bb0-9b9a-c5434762b244 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:24.968512 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-61a65e8e-a168-4bb0-9b9a-c5434762b244 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:24.969049 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-61a65e8e-a168-4bb0-9b9a-c5434762b244 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:24.969780 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-61a65e8e-a168-4bb0-9b9a-c5434762b244 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:24.970327 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-61a65e8e-a168-4bb0-9b9a-c5434762b244 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:24.970765 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-61a65e8e-a168-4bb0-9b9a-c5434762b244 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:25.197287 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-61a65e8e-a168-4bb0-9b9a-c5434762b244 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:49:25.207860 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-61a65e8e-a168-4bb0-9b9a-c5434762b244 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/682677fe-2e64-4ce9-93be-d396ef67154d" status: 200 len: 1688 microversion: 2.1 time: 0.253275 Oct 17 14:49:25.209499 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3497/7128] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:49:24 2022] GET /compute/v2.1/servers/682677fe-2e64-4ce9-93be-d396ef67154d => generated 1688 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:49:25.757177 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-b6792e68-b584-4986-9bab-f8e2adb02f18 req-e1b0ebac-d678-4c26-80ee-30eb89eb64f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "682677fe-2e64-4ce9-93be-d396ef67154d", "name": "network-vif-deleted", "tag": "e49397df-4e58-4e84-a62a-2423f1e81b19"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:49:25.767963 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-b6792e68-b584-4986-9bab-f8e2adb02f18 req-e1b0ebac-d678-4c26-80ee-30eb89eb64f5 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:25.768438 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-b6792e68-b584-4986-9bab-f8e2adb02f18 req-e1b0ebac-d678-4c26-80ee-30eb89eb64f5 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:25.768994 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-b6792e68-b584-4986-9bab-f8e2adb02f18 req-e1b0ebac-d678-4c26-80ee-30eb89eb64f5 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:25.783853 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-b6792e68-b584-4986-9bab-f8e2adb02f18 req-e1b0ebac-d678-4c26-80ee-30eb89eb64f5 service nova] Creating event network-vif-deleted:e49397df-4e58-4e84-a62a-2423f1e81b19 for instance 682677fe-2e64-4ce9-93be-d396ef67154d on n-h1-854247-14 Oct 17 14:49:25.793282 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-b6792e68-b584-4986-9bab-f8e2adb02f18 req-e1b0ebac-d678-4c26-80ee-30eb89eb64f5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039520 Oct 17 14:49:25.794599 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3632/7129] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:49:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:49:26.237386 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-51297603-a3be-4d25-b151-a3778f0ba4f3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:49:26.238197 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-51297603-a3be-4d25-b151-a3778f0ba4f3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 682677fe-2e64-4ce9-93be-d396ef67154d] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:49:26.247068 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-51297603-a3be-4d25-b151-a3778f0ba4f3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:26.247489 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-51297603-a3be-4d25-b151-a3778f0ba4f3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:26.248028 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-51297603-a3be-4d25-b151-a3778f0ba4f3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:26.249110 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-51297603-a3be-4d25-b151-a3778f0ba4f3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:26.249924 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-51297603-a3be-4d25-b151-a3778f0ba4f3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:26.250684 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-51297603-a3be-4d25-b151-a3778f0ba4f3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:26.285403 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-51297603-a3be-4d25-b151-a3778f0ba4f3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:26.285931 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-51297603-a3be-4d25-b151-a3778f0ba4f3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:26.286407 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-51297603-a3be-4d25-b151-a3778f0ba4f3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:26.286859 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-51297603-a3be-4d25-b151-a3778f0ba4f3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lazy-loading 'fault' on Instance uuid 682677fe-2e64-4ce9-93be-d396ef67154d {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:49:26.334227 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-51297603-a3be-4d25-b151-a3778f0ba4f3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:49:26.342962 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-51297603-a3be-4d25-b151-a3778f0ba4f3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/682677fe-2e64-4ce9-93be-d396ef67154d" status: 200 len: 1356 microversion: 2.1 time: 0.111177 Oct 17 14:49:26.343610 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3498/7130] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:49:26 2022] GET /compute/v2.1/servers/682677fe-2e64-4ce9-93be-d396ef67154d => generated 1356 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:49:27.371216 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-db56dd26-5237-415c-8f66-4e184ff8af03 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:49:27.371934 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-db56dd26-5237-415c-8f66-4e184ff8af03 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 682677fe-2e64-4ce9-93be-d396ef67154d] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:49:27.378813 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-db56dd26-5237-415c-8f66-4e184ff8af03 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:27.379354 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-db56dd26-5237-415c-8f66-4e184ff8af03 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:27.379798 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-db56dd26-5237-415c-8f66-4e184ff8af03 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:27.380526 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-db56dd26-5237-415c-8f66-4e184ff8af03 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:27.381003 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-db56dd26-5237-415c-8f66-4e184ff8af03 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:27.381472 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-db56dd26-5237-415c-8f66-4e184ff8af03 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:27.398676 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-db56dd26-5237-415c-8f66-4e184ff8af03 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] HTTP exception thrown: Instance 682677fe-2e64-4ce9-93be-d396ef67154d could not be found. Oct 17 14:49:27.400238 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-db56dd26-5237-415c-8f66-4e184ff8af03 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Request method failure captured: Oct 17 14:49:27.400238 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/682677fe-2e64-4ce9-93be-d396ef67154d HTTP/1.1 Oct 17 14:49:27.400238 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 14:49:27.400238 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 14:49:27.400238 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 14:49:27.400238 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 14:49:27.400238 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 14:49:27.400238 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 14:49:27.400238 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 14:49:27.400238 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 14:49:27.400238 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTWrbJTp3_aV3rQ1sZIV-A8RhPUhGtuu3Cdy9UtPO9T2_ui3_S4_dniOOQZy69dfFzd3AdqRHxEdsaXpnKLosIkT6TOjwXy5X_JiSCvihpV_5K-xclYBmfytVuV0W0qLAfA4CBTVr0Qr1hQGpQvQysPbiqlBcm_U91Zx-5cXnnLrTX2s Oct 17 14:49:27.400238 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 14:49:27.400238 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 14:49:27.400238 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 14:49:27.400238 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 14:49:27.400238 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 14:49:27.400238 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 14:49:27.400238 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 6d8fb8c2659a43a696a0a16e7d2be378 Oct 17 14:49:27.400238 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1531965843 Oct 17 14:49:27.400238 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 14:49:27.400238 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 14:49:27.400238 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6d8fb8c2659a43a696a0a16e7d2be378"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6d8fb8c2659a43a696a0a16e7d2be378"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6d8fb8c2659a43a696a0a16e7d2be378"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6d8fb8c2659a43a696a0a16e7d2be378", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:49:27.400238 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1531965843 Oct 17 14:49:27.400238 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 6d8fb8c2659a43a696a0a16e7d2be378 Oct 17 14:49:27.400238 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1531965843 Oct 17 14:49:27.400238 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-TestNetworkAdvancedServerOps-1531965843-project Oct 17 14:49:27.400238 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 14:49:27.400238 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 14:49:27.400238 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 4805a4aa399d4d0798b6077a545a2255 Oct 17 14:49:27.400238 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1531965843-project Oct 17 14:49:27.400238 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 14:49:27.400238 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 682677fe-2e64-4ce9-93be-d396ef67154d could not be found. Oct 17 14:49:27.400238 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '682677fe-2e64-4ce9-93be-d396ef67154d'} Oct 17 14:49:27.400238 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:49:27.400238 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:49:27.400238 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:49:27.400238 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:49:27.400238 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:49:27.400238 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:49:27.400238 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:49:27.400238 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:49:27.400238 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:49:27.400238 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:49:27.400238 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 682677fe-2e64-4ce9-93be-d396ef67154d could not be found. Oct 17 14:49:27.400238 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:49:27.400238 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:49:27.400238 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:49:27.400238 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:49:27.400238 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:49:27.400238 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:49:27.400238 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:49:27.400238 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:49:27.400238 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:49:27.400238 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:49:27.400238 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:49:27.400238 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:49:27.400238 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:49:27.400238 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:49:27.400238 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:49:27.400238 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:49:27.400238 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 682677fe-2e64-4ce9-93be-d396ef67154d could not be found. Oct 17 14:49:27.400238 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:49:27.400238 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:49:27.404887 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:49:27.404887 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:49:27.404887 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:49:27.404887 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:49:27.404887 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:49:27.404887 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:49:27.404887 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 682677fe-2e64-4ce9-93be-d396ef67154d could not be found. Oct 17 14:49:27.404887 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:49:27.404887 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-db56dd26-5237-415c-8f66-4e184ff8af03 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Returning 404 to user: Instance 682677fe-2e64-4ce9-93be-d396ef67154d could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:49:27.404887 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-db56dd26-5237-415c-8f66-4e184ff8af03 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/682677fe-2e64-4ce9-93be-d396ef67154d" status: 404 len: 111 microversion: 2.1 time: 0.036412 Oct 17 14:49:27.404887 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3633/7131] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:49:27 2022] GET /compute/v2.1/servers/682677fe-2e64-4ce9-93be-d396ef67154d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:49:30.793646 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c5fd9fc0-936e-438b-972a-96668b7ac051 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '.version_select at 0x7f7cd55021f0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:49:30.821962 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c5fd9fc0-936e-438b-972a-96668b7ac051 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1310393852" status: 202 len: 0 microversion: 2.1 time: 0.032629 Oct 17 14:49:30.823238 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3499/7132] 10.222.0.79 () {58 vars in 1284 bytes} [Mon Oct 17 14:49:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1310393852 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:49:30.853252 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d9619627-2bbc-40a9-a538-0003ba4b56ed tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Action: 'create', calling method: .version_select at 0x7f7cd555d790>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1199728133", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP+Vv6XTclt+1A3M5y2w/y7RYYeKGkMtwRaIq1ZFh/erruJTHIpls9Ox4mTVJpWHVfnwDg3arCkr7PdFk2IpBgKKO+w5fvQXuoomleIUU5+n0Ye7uQmI0Kkm9/AyS4ofXA=="}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:49:30.875066 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-d9619627-2bbc-40a9-a538-0003ba4b56ed tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Getting quotas for project 6d8fb8c2659a43a696a0a16e7d2be378. Resources: {'key_pairs'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:49:30.880704 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-d9619627-2bbc-40a9-a538-0003ba4b56ed tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Getting quotas for user 4805a4aa399d4d0798b6077a545a2255 and project 6d8fb8c2659a43a696a0a16e7d2be378. Resources: {'key_pairs'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:49:30.909270 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d9619627-2bbc-40a9-a538-0003ba4b56ed tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.059926 Oct 17 14:49:30.909912 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3634/7133] 10.222.0.79 () {60 vars in 1159 bytes} [Mon Oct 17 14:49:30 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:49:37.066790 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:49:37.072061 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1505382d-2d2b-4934-a298-30aa34c87f29 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1721205442", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "71f8c262-a0be-4f09-ba64-91740af1807d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1199728133", "security_groups": [{"name": "tempest-secgroup-smoke-818955857"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:49:37.233027 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-1505382d-2d2b-4934-a298-30aa34c87f29 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] validate_networks() for [('71f8c262-a0be-4f09-ba64-91740af1807d', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:49:37.727555 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-1505382d-2d2b-4934-a298-30aa34c87f29 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:49:37.728005 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-1505382d-2d2b-4934-a298-30aa34c87f29 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:49:37.728515 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-1505382d-2d2b-4934-a298-30aa34c87f29 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:49:37.728945 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-1505382d-2d2b-4934-a298-30aa34c87f29 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:49:37.729378 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-1505382d-2d2b-4934-a298-30aa34c87f29 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:49:37.739736 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1505382d-2d2b-4934-a298-30aa34c87f29 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:37.740201 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1505382d-2d2b-4934-a298-30aa34c87f29 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:37.740622 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1505382d-2d2b-4934-a298-30aa34c87f29 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:37.741377 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1505382d-2d2b-4934-a298-30aa34c87f29 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:37.741847 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1505382d-2d2b-4934-a298-30aa34c87f29 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:37.742289 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1505382d-2d2b-4934-a298-30aa34c87f29 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:37.762190 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-1505382d-2d2b-4934-a298-30aa34c87f29 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Getting quotas for project 6d8fb8c2659a43a696a0a16e7d2be378. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:49:37.767989 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-1505382d-2d2b-4934-a298-30aa34c87f29 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Getting quotas for user 4805a4aa399d4d0798b6077a545a2255 and project 6d8fb8c2659a43a696a0a16e7d2be378. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:49:37.781519 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1505382d-2d2b-4934-a298-30aa34c87f29 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:49:37.784187 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1505382d-2d2b-4934-a298-30aa34c87f29 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 666d0fcc-754f-4a77-8bae-fdea876bd37e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:49:37.843337 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1505382d-2d2b-4934-a298-30aa34c87f29 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.778394 Oct 17 14:49:37.849090 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3500/7134] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 14:49:37 2022] POST /compute/v2.1/servers => generated 405 bytes in 785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:49:37.857705 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6de0741d-81ba-4606-b29d-aaae3d947f05 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:49:37.858291 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6de0741d-81ba-4606-b29d-aaae3d947f05 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 666d0fcc-754f-4a77-8bae-fdea876bd37e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:49:37.874990 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=16 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:49:37.937948 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6de0741d-81ba-4606-b29d-aaae3d947f05 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:49:37.947572 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6de0741d-81ba-4606-b29d-aaae3d947f05 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e" status: 200 len: 1267 microversion: 2.1 time: 0.095268 Oct 17 14:49:37.950168 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3635/7135] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:49:37 2022] GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e => generated 1267 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:49:38.973811 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ac9d161e-ab4d-4377-b639-8180591192d6 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:49:38.975293 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ac9d161e-ab4d-4377-b639-8180591192d6 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 666d0fcc-754f-4a77-8bae-fdea876bd37e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:49:38.983207 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac9d161e-ab4d-4377-b639-8180591192d6 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:38.984105 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac9d161e-ab4d-4377-b639-8180591192d6 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:38.984801 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac9d161e-ab4d-4377-b639-8180591192d6 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:38.985754 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac9d161e-ab4d-4377-b639-8180591192d6 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:38.986436 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac9d161e-ab4d-4377-b639-8180591192d6 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:38.987132 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac9d161e-ab4d-4377-b639-8180591192d6 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:39.061232 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ac9d161e-ab4d-4377-b639-8180591192d6 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:49:39.072738 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ac9d161e-ab4d-4377-b639-8180591192d6 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e" status: 200 len: 1327 microversion: 2.1 time: 0.103405 Oct 17 14:49:39.087937 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3501/7136] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:49:38 2022] GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e => generated 1327 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:49:40.109619 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-606d9368-ca49-43d7-aa99-ed40673b6374 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:49:40.112159 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-606d9368-ca49-43d7-aa99-ed40673b6374 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 666d0fcc-754f-4a77-8bae-fdea876bd37e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:49:40.119570 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-606d9368-ca49-43d7-aa99-ed40673b6374 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:40.120207 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-606d9368-ca49-43d7-aa99-ed40673b6374 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:40.120710 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-606d9368-ca49-43d7-aa99-ed40673b6374 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:40.121572 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-606d9368-ca49-43d7-aa99-ed40673b6374 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:40.122087 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-606d9368-ca49-43d7-aa99-ed40673b6374 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:40.122550 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-606d9368-ca49-43d7-aa99-ed40673b6374 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:40.293147 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-606d9368-ca49-43d7-aa99-ed40673b6374 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:49:40.302980 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-606d9368-ca49-43d7-aa99-ed40673b6374 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e" status: 200 len: 1392 microversion: 2.1 time: 0.208649 Oct 17 14:49:40.304329 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3636/7137] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:49:40 2022] GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e => generated 1392 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:49:40.602171 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-18bcba74-95d0-4256-ad05-6cb1972fca08 req-17ca4beb-9d53-428e-a2de-1f5a74cea6be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "666d0fcc-754f-4a77-8bae-fdea876bd37e", "tag": "5e364050-649b-4bc9-b906-604b9618b16d"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:49:40.624696 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-18bcba74-95d0-4256-ad05-6cb1972fca08 req-17ca4beb-9d53-428e-a2de-1f5a74cea6be service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:40.626209 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-18bcba74-95d0-4256-ad05-6cb1972fca08 req-17ca4beb-9d53-428e-a2de-1f5a74cea6be service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:40.627417 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-18bcba74-95d0-4256-ad05-6cb1972fca08 req-17ca4beb-9d53-428e-a2de-1f5a74cea6be service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:40.647447 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-18bcba74-95d0-4256-ad05-6cb1972fca08 req-17ca4beb-9d53-428e-a2de-1f5a74cea6be service nova] Creating event network-changed:5e364050-649b-4bc9-b906-604b9618b16d for instance 666d0fcc-754f-4a77-8bae-fdea876bd37e on n-h1-854247-14 Oct 17 14:49:40.652773 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-18bcba74-95d0-4256-ad05-6cb1972fca08 req-17ca4beb-9d53-428e-a2de-1f5a74cea6be service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055521 Oct 17 14:49:40.653408 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3502/7138] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:49:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:49:41.326558 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-39a95738-1579-40f6-8062-b6c3595cba75 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:49:41.327216 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-39a95738-1579-40f6-8062-b6c3595cba75 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 666d0fcc-754f-4a77-8bae-fdea876bd37e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:49:41.335371 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-39a95738-1579-40f6-8062-b6c3595cba75 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:41.335856 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-39a95738-1579-40f6-8062-b6c3595cba75 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:41.336285 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-39a95738-1579-40f6-8062-b6c3595cba75 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:41.336990 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-39a95738-1579-40f6-8062-b6c3595cba75 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:41.337435 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-39a95738-1579-40f6-8062-b6c3595cba75 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:41.337836 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-39a95738-1579-40f6-8062-b6c3595cba75 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:41.479239 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-39a95738-1579-40f6-8062-b6c3595cba75 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:49:41.487522 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-39a95738-1579-40f6-8062-b6c3595cba75 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e" status: 200 len: 1392 microversion: 2.1 time: 0.164923 Oct 17 14:49:41.488146 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3637/7139] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:49:41 2022] GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:49:42.512987 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-20236248-365b-402b-bda9-d002c977e12e tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:49:42.513712 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-20236248-365b-402b-bda9-d002c977e12e tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 666d0fcc-754f-4a77-8bae-fdea876bd37e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:49:42.520703 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-20236248-365b-402b-bda9-d002c977e12e tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:42.521245 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-20236248-365b-402b-bda9-d002c977e12e tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:42.521701 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-20236248-365b-402b-bda9-d002c977e12e tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:42.522436 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-20236248-365b-402b-bda9-d002c977e12e tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:42.522904 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-20236248-365b-402b-bda9-d002c977e12e tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:42.523394 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-20236248-365b-402b-bda9-d002c977e12e tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:42.667973 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-20236248-365b-402b-bda9-d002c977e12e tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:49:42.679110 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-20236248-365b-402b-bda9-d002c977e12e tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e" status: 200 len: 1392 microversion: 2.1 time: 0.171568 Oct 17 14:49:42.679717 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3503/7140] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:49:42 2022] GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e => generated 1392 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:49:43.702346 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-60e28f4d-587f-467d-91ca-93696bbace37 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:49:43.702942 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-60e28f4d-587f-467d-91ca-93696bbace37 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 666d0fcc-754f-4a77-8bae-fdea876bd37e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:49:43.710564 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-60e28f4d-587f-467d-91ca-93696bbace37 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:43.711045 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-60e28f4d-587f-467d-91ca-93696bbace37 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:43.711667 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-60e28f4d-587f-467d-91ca-93696bbace37 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:43.712366 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-60e28f4d-587f-467d-91ca-93696bbace37 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:43.712811 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-60e28f4d-587f-467d-91ca-93696bbace37 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:43.713225 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-60e28f4d-587f-467d-91ca-93696bbace37 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:43.856195 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-60e28f4d-587f-467d-91ca-93696bbace37 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:49:43.865412 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-60e28f4d-587f-467d-91ca-93696bbace37 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e" status: 200 len: 1392 microversion: 2.1 time: 0.167078 Oct 17 14:49:43.866013 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3638/7141] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:49:43 2022] GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:49:44.891940 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3cb66aca-8fa7-4e92-b672-61abec4ac9d7 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:49:44.892588 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3cb66aca-8fa7-4e92-b672-61abec4ac9d7 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 666d0fcc-754f-4a77-8bae-fdea876bd37e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:49:44.900017 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3cb66aca-8fa7-4e92-b672-61abec4ac9d7 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:44.900518 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3cb66aca-8fa7-4e92-b672-61abec4ac9d7 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:44.900970 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3cb66aca-8fa7-4e92-b672-61abec4ac9d7 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:44.901683 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3cb66aca-8fa7-4e92-b672-61abec4ac9d7 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:44.902143 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3cb66aca-8fa7-4e92-b672-61abec4ac9d7 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:44.902577 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3cb66aca-8fa7-4e92-b672-61abec4ac9d7 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:45.044422 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3cb66aca-8fa7-4e92-b672-61abec4ac9d7 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:49:45.054851 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3cb66aca-8fa7-4e92-b672-61abec4ac9d7 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e" status: 200 len: 1392 microversion: 2.1 time: 0.168325 Oct 17 14:49:45.055565 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3504/7142] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:49:44 2022] GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e => generated 1392 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:49:46.077920 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-94ab55af-e072-4c70-b806-d1695fa235c3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:49:46.078543 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-94ab55af-e072-4c70-b806-d1695fa235c3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 666d0fcc-754f-4a77-8bae-fdea876bd37e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:49:46.089021 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94ab55af-e072-4c70-b806-d1695fa235c3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:46.089525 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94ab55af-e072-4c70-b806-d1695fa235c3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:46.089964 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94ab55af-e072-4c70-b806-d1695fa235c3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:46.090685 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94ab55af-e072-4c70-b806-d1695fa235c3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:46.091138 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94ab55af-e072-4c70-b806-d1695fa235c3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:46.091614 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94ab55af-e072-4c70-b806-d1695fa235c3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:46.250375 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-94ab55af-e072-4c70-b806-d1695fa235c3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:49:46.259648 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-94ab55af-e072-4c70-b806-d1695fa235c3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e" status: 200 len: 1392 microversion: 2.1 time: 0.185717 Oct 17 14:49:46.263256 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3639/7143] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:49:46 2022] GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e => generated 1392 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:49:47.262864 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-b1a965b1-65f1-4175-b7dc-29f579f55349 req-fd50fcad-7e89-45bf-a0ef-7bffcfef7e8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "666d0fcc-754f-4a77-8bae-fdea876bd37e", "name": "network-vif-plugged", "status": "completed", "tag": "5e364050-649b-4bc9-b906-604b9618b16d"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:49:47.276073 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-b1a965b1-65f1-4175-b7dc-29f579f55349 req-fd50fcad-7e89-45bf-a0ef-7bffcfef7e8e service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:47.276578 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-b1a965b1-65f1-4175-b7dc-29f579f55349 req-fd50fcad-7e89-45bf-a0ef-7bffcfef7e8e service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:47.277217 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-b1a965b1-65f1-4175-b7dc-29f579f55349 req-fd50fcad-7e89-45bf-a0ef-7bffcfef7e8e service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:47.285045 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cd2b1ec7-88d4-496c-9fbb-7856b96d6754 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:49:47.285759 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cd2b1ec7-88d4-496c-9fbb-7856b96d6754 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 666d0fcc-754f-4a77-8bae-fdea876bd37e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:49:47.292984 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:49:47.300556 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cd2b1ec7-88d4-496c-9fbb-7856b96d6754 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:47.301232 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-b1a965b1-65f1-4175-b7dc-29f579f55349 req-fd50fcad-7e89-45bf-a0ef-7bffcfef7e8e service nova] Creating event network-vif-plugged:5e364050-649b-4bc9-b906-604b9618b16d for instance 666d0fcc-754f-4a77-8bae-fdea876bd37e on n-h1-854247-14 Oct 17 14:49:47.301691 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cd2b1ec7-88d4-496c-9fbb-7856b96d6754 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:47.302133 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cd2b1ec7-88d4-496c-9fbb-7856b96d6754 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:47.303058 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cd2b1ec7-88d4-496c-9fbb-7856b96d6754 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:47.303550 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cd2b1ec7-88d4-496c-9fbb-7856b96d6754 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:47.303974 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cd2b1ec7-88d4-496c-9fbb-7856b96d6754 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:47.307117 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-b1a965b1-65f1-4175-b7dc-29f579f55349 req-fd50fcad-7e89-45bf-a0ef-7bffcfef7e8e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048083 Oct 17 14:49:47.307938 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3505/7144] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:49:47.447475 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cd2b1ec7-88d4-496c-9fbb-7856b96d6754 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:49:47.455605 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cd2b1ec7-88d4-496c-9fbb-7856b96d6754 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e" status: 200 len: 1392 microversion: 2.1 time: 0.176798 Oct 17 14:49:47.456349 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3640/7145] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:49:47 2022] GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e => generated 1392 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:49:48.476178 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:49:48.476998 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=6 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:49:48.483026 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bb805980-0470-4167-8693-f015d4fce208 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:49:48.483852 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-bb805980-0470-4167-8693-f015d4fce208 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 666d0fcc-754f-4a77-8bae-fdea876bd37e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:49:48.491628 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bb805980-0470-4167-8693-f015d4fce208 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:48.492159 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bb805980-0470-4167-8693-f015d4fce208 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:48.492603 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bb805980-0470-4167-8693-f015d4fce208 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:48.493350 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bb805980-0470-4167-8693-f015d4fce208 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:48.493844 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bb805980-0470-4167-8693-f015d4fce208 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:48.494619 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bb805980-0470-4167-8693-f015d4fce208 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:48.646431 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-bb805980-0470-4167-8693-f015d4fce208 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:49:48.655230 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-bb805980-0470-4167-8693-f015d4fce208 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e" status: 200 len: 1564 microversion: 2.1 time: 0.179991 Oct 17 14:49:48.655837 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3506/7146] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:49:48 2022] GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e => generated 1564 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:49:48.678455 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8cbbdde1-e814-4472-bb6b-b89ceeb9e5b9 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:49:48.679071 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8cbbdde1-e814-4472-bb6b-b89ceeb9e5b9 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 666d0fcc-754f-4a77-8bae-fdea876bd37e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:49:48.681104 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=6 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:49:48.688173 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8cbbdde1-e814-4472-bb6b-b89ceeb9e5b9 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:48.688660 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8cbbdde1-e814-4472-bb6b-b89ceeb9e5b9 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:48.689206 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8cbbdde1-e814-4472-bb6b-b89ceeb9e5b9 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:48.690225 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8cbbdde1-e814-4472-bb6b-b89ceeb9e5b9 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:48.690841 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8cbbdde1-e814-4472-bb6b-b89ceeb9e5b9 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:48.691387 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8cbbdde1-e814-4472-bb6b-b89ceeb9e5b9 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:48.833963 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8cbbdde1-e814-4472-bb6b-b89ceeb9e5b9 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:49:48.843714 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8cbbdde1-e814-4472-bb6b-b89ceeb9e5b9 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e" status: 200 len: 1564 microversion: 2.1 time: 0.169297 Oct 17 14:49:48.844311 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3641/7147] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:49:48 2022] GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e => generated 1564 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:49:50.850194 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-accaa8eb-bef1-462f-9815-b1613bd9f761 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:49:50.851740 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-accaa8eb-bef1-462f-9815-b1613bd9f761 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 666d0fcc-754f-4a77-8bae-fdea876bd37e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:49:50.858753 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-accaa8eb-bef1-462f-9815-b1613bd9f761 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:50.859506 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-accaa8eb-bef1-462f-9815-b1613bd9f761 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:50.859971 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-accaa8eb-bef1-462f-9815-b1613bd9f761 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:50.860690 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-accaa8eb-bef1-462f-9815-b1613bd9f761 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:50.861471 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-accaa8eb-bef1-462f-9815-b1613bd9f761 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:50.871911 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-accaa8eb-bef1-462f-9815-b1613bd9f761 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:50.988390 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-9585f012-d0ff-49b2-a0e6-bac2bb701816 req-a3f5bfe1-d913-4070-b555-e23741c4ee6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "666d0fcc-754f-4a77-8bae-fdea876bd37e", "tag": "5e364050-649b-4bc9-b906-604b9618b16d"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:49:50.999640 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-9585f012-d0ff-49b2-a0e6-bac2bb701816 req-a3f5bfe1-d913-4070-b555-e23741c4ee6c service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:51.000119 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-9585f012-d0ff-49b2-a0e6-bac2bb701816 req-a3f5bfe1-d913-4070-b555-e23741c4ee6c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:51.000742 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-9585f012-d0ff-49b2-a0e6-bac2bb701816 req-a3f5bfe1-d913-4070-b555-e23741c4ee6c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:51.013901 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-9585f012-d0ff-49b2-a0e6-bac2bb701816 req-a3f5bfe1-d913-4070-b555-e23741c4ee6c service nova] Creating event network-changed:5e364050-649b-4bc9-b906-604b9618b16d for instance 666d0fcc-754f-4a77-8bae-fdea876bd37e on n-h1-854247-14 Oct 17 14:49:51.019675 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-9585f012-d0ff-49b2-a0e6-bac2bb701816 req-a3f5bfe1-d913-4070-b555-e23741c4ee6c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.170041 Oct 17 14:49:51.020503 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3642/7148] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:49:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:49:51.035921 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-accaa8eb-bef1-462f-9815-b1613bd9f761 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:49:51.045090 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-accaa8eb-bef1-462f-9815-b1613bd9f761 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e" status: 200 len: 1564 microversion: 2.1 time: 0.199366 Oct 17 14:49:51.059199 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3507/7149] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:49:50 2022] GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e => generated 1564 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:50:12.328546 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=5 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:50:12.329291 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=38 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:50:12.333596 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-13b3e71c-1a46-4184-a43d-e070cff1b37f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:50:12.336195 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-13b3e71c-1a46-4184-a43d-e070cff1b37f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 666d0fcc-754f-4a77-8bae-fdea876bd37e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:50:12.343857 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-13b3e71c-1a46-4184-a43d-e070cff1b37f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:50:12.344336 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-13b3e71c-1a46-4184-a43d-e070cff1b37f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:50:12.344767 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-13b3e71c-1a46-4184-a43d-e070cff1b37f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:50:12.345467 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-13b3e71c-1a46-4184-a43d-e070cff1b37f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:50:12.345915 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-13b3e71c-1a46-4184-a43d-e070cff1b37f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:50:12.346330 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-13b3e71c-1a46-4184-a43d-e070cff1b37f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:50:12.403797 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-13b3e71c-1a46-4184-a43d-e070cff1b37f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "POST /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e/action" status: 200 len: 24568 microversion: 2.1 time: 0.077813 Oct 17 14:50:12.404341 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3643/7150] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:50:12 2022] POST /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e/action => generated 24568 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:50:23.300289 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-26ff155a-a20b-4d9a-b13d-67452074c87d tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:50:23.302574 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-26ff155a-a20b-4d9a-b13d-67452074c87d tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 666d0fcc-754f-4a77-8bae-fdea876bd37e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:50:23.304940 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:50:23.305623 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=36 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:50:23.312703 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-26ff155a-a20b-4d9a-b13d-67452074c87d tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:50:23.313245 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-26ff155a-a20b-4d9a-b13d-67452074c87d tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:50:23.313768 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-26ff155a-a20b-4d9a-b13d-67452074c87d tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:50:23.314527 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-26ff155a-a20b-4d9a-b13d-67452074c87d tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:50:23.314975 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-26ff155a-a20b-4d9a-b13d-67452074c87d tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:50:23.315430 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-26ff155a-a20b-4d9a-b13d-67452074c87d tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:50:23.404186 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-26ff155a-a20b-4d9a-b13d-67452074c87d tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:50:23.410748 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-26ff155a-a20b-4d9a-b13d-67452074c87d tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 666d0fcc-754f-4a77-8bae-fdea876bd37e] Old instance type m1.heat2, new instance type m1.heat {{(pid=127017) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 17 14:50:23.418515 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-26ff155a-a20b-4d9a-b13d-67452074c87d tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:50:23.418954 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-26ff155a-a20b-4d9a-b13d-67452074c87d tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:50:23.419476 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-26ff155a-a20b-4d9a-b13d-67452074c87d tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:50:23.419909 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-26ff155a-a20b-4d9a-b13d-67452074c87d tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:50:23.420346 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-26ff155a-a20b-4d9a-b13d-67452074c87d tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:50:23.489223 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-26ff155a-a20b-4d9a-b13d-67452074c87d tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "POST /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e/action" status: 202 len: 0 microversion: 2.1 time: 0.193411 Oct 17 14:50:23.489840 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3508/7151] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:50:23 2022] POST /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:50:23.499699 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ea31f041-c958-49af-b549-66024509253a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:50:23.500479 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ea31f041-c958-49af-b549-66024509253a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 666d0fcc-754f-4a77-8bae-fdea876bd37e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:50:23.503227 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:50:23.503769 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=4 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:50:23.510015 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ea31f041-c958-49af-b549-66024509253a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:50:23.510562 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ea31f041-c958-49af-b549-66024509253a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:50:23.511015 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ea31f041-c958-49af-b549-66024509253a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:50:23.511673 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ea31f041-c958-49af-b549-66024509253a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:50:23.512198 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ea31f041-c958-49af-b549-66024509253a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:50:23.512576 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ea31f041-c958-49af-b549-66024509253a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:50:23.654075 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ea31f041-c958-49af-b549-66024509253a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:50:23.662568 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ea31f041-c958-49af-b549-66024509253a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e" status: 200 len: 1692 microversion: 2.1 time: 0.167453 Oct 17 14:50:23.663228 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3644/7152] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:50:23 2022] GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e => generated 1692 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:50:24.688438 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c9a2f433-cc04-4ef8-94f5-0a23bebca160 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:50:24.689148 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c9a2f433-cc04-4ef8-94f5-0a23bebca160 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 666d0fcc-754f-4a77-8bae-fdea876bd37e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:50:24.698158 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c9a2f433-cc04-4ef8-94f5-0a23bebca160 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:50:24.699422 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c9a2f433-cc04-4ef8-94f5-0a23bebca160 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:50:24.700167 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c9a2f433-cc04-4ef8-94f5-0a23bebca160 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:50:24.701050 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c9a2f433-cc04-4ef8-94f5-0a23bebca160 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:50:24.701785 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c9a2f433-cc04-4ef8-94f5-0a23bebca160 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:50:24.702573 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c9a2f433-cc04-4ef8-94f5-0a23bebca160 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:50:24.868300 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c9a2f433-cc04-4ef8-94f5-0a23bebca160 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:50:24.878009 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c9a2f433-cc04-4ef8-94f5-0a23bebca160 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e" status: 200 len: 1692 microversion: 2.1 time: 0.195660 Oct 17 14:50:24.878667 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3509/7153] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:50:24 2022] GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e => generated 1692 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:50:25.904944 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-85ab2acf-a948-4f33-99a5-62f4a71b40b2 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:50:25.905601 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-85ab2acf-a948-4f33-99a5-62f4a71b40b2 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 666d0fcc-754f-4a77-8bae-fdea876bd37e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:50:25.913601 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-85ab2acf-a948-4f33-99a5-62f4a71b40b2 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:50:25.914089 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-85ab2acf-a948-4f33-99a5-62f4a71b40b2 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:50:25.914529 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-85ab2acf-a948-4f33-99a5-62f4a71b40b2 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:50:25.915279 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-85ab2acf-a948-4f33-99a5-62f4a71b40b2 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:50:25.915737 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-85ab2acf-a948-4f33-99a5-62f4a71b40b2 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:50:25.916174 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-85ab2acf-a948-4f33-99a5-62f4a71b40b2 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:50:26.059743 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-85ab2acf-a948-4f33-99a5-62f4a71b40b2 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:50:26.067980 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-85ab2acf-a948-4f33-99a5-62f4a71b40b2 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e" status: 200 len: 1697 microversion: 2.1 time: 0.167049 Oct 17 14:50:26.068814 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3645/7154] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:50:25 2022] GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e => generated 1697 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:50:27.094094 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a1b35a7b-6926-4057-bf2b-0ffa70aa1620 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:50:27.095018 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a1b35a7b-6926-4057-bf2b-0ffa70aa1620 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 666d0fcc-754f-4a77-8bae-fdea876bd37e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:50:27.104315 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a1b35a7b-6926-4057-bf2b-0ffa70aa1620 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:50:27.104822 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a1b35a7b-6926-4057-bf2b-0ffa70aa1620 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:50:27.105267 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a1b35a7b-6926-4057-bf2b-0ffa70aa1620 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:50:27.105985 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a1b35a7b-6926-4057-bf2b-0ffa70aa1620 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:50:27.106434 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a1b35a7b-6926-4057-bf2b-0ffa70aa1620 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:50:27.106885 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a1b35a7b-6926-4057-bf2b-0ffa70aa1620 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:50:27.253509 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a1b35a7b-6926-4057-bf2b-0ffa70aa1620 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:50:27.261674 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a1b35a7b-6926-4057-bf2b-0ffa70aa1620 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e" status: 200 len: 1697 microversion: 2.1 time: 0.172980 Oct 17 14:50:27.262265 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3510/7155] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:50:27 2022] GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e => generated 1697 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:50:28.285023 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-81ab6e90-5d1e-4d16-94bc-eccbf389974f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:50:28.285698 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-81ab6e90-5d1e-4d16-94bc-eccbf389974f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 666d0fcc-754f-4a77-8bae-fdea876bd37e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:50:28.293276 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-81ab6e90-5d1e-4d16-94bc-eccbf389974f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:50:28.293763 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-81ab6e90-5d1e-4d16-94bc-eccbf389974f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:50:28.294191 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-81ab6e90-5d1e-4d16-94bc-eccbf389974f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:50:28.294901 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-81ab6e90-5d1e-4d16-94bc-eccbf389974f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:50:28.295382 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-81ab6e90-5d1e-4d16-94bc-eccbf389974f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:50:28.295798 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-81ab6e90-5d1e-4d16-94bc-eccbf389974f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:50:28.446480 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-81ab6e90-5d1e-4d16-94bc-eccbf389974f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:50:28.454901 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-81ab6e90-5d1e-4d16-94bc-eccbf389974f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e" status: 200 len: 1697 microversion: 2.1 time: 0.173803 Oct 17 14:50:28.455510 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3646/7156] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:50:28 2022] GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e => generated 1697 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:50:29.479713 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c5b4b4fd-422d-4e09-92e4-2ba3c819e1a8 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:50:29.480298 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c5b4b4fd-422d-4e09-92e4-2ba3c819e1a8 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 666d0fcc-754f-4a77-8bae-fdea876bd37e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:50:29.489458 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c5b4b4fd-422d-4e09-92e4-2ba3c819e1a8 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:50:29.490139 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c5b4b4fd-422d-4e09-92e4-2ba3c819e1a8 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:50:29.490626 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c5b4b4fd-422d-4e09-92e4-2ba3c819e1a8 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:50:29.491628 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c5b4b4fd-422d-4e09-92e4-2ba3c819e1a8 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:50:29.492246 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c5b4b4fd-422d-4e09-92e4-2ba3c819e1a8 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:50:29.492697 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c5b4b4fd-422d-4e09-92e4-2ba3c819e1a8 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:50:29.640560 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c5b4b4fd-422d-4e09-92e4-2ba3c819e1a8 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:50:29.651251 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c5b4b4fd-422d-4e09-92e4-2ba3c819e1a8 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e" status: 200 len: 1697 microversion: 2.1 time: 0.175422 Oct 17 14:50:29.652015 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3511/7157] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:50:29 2022] GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e => generated 1697 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:50:30.679261 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2689648c-9a36-42d1-a349-b6b42f4a6f35 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:50:30.679903 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2689648c-9a36-42d1-a349-b6b42f4a6f35 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 666d0fcc-754f-4a77-8bae-fdea876bd37e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:50:30.687880 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2689648c-9a36-42d1-a349-b6b42f4a6f35 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:50:30.688375 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2689648c-9a36-42d1-a349-b6b42f4a6f35 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:50:30.688809 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2689648c-9a36-42d1-a349-b6b42f4a6f35 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:50:30.689519 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2689648c-9a36-42d1-a349-b6b42f4a6f35 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:50:30.689961 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2689648c-9a36-42d1-a349-b6b42f4a6f35 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:50:30.690378 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2689648c-9a36-42d1-a349-b6b42f4a6f35 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:50:30.834690 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2689648c-9a36-42d1-a349-b6b42f4a6f35 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:50:30.843340 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2689648c-9a36-42d1-a349-b6b42f4a6f35 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e" status: 200 len: 1697 microversion: 2.1 time: 0.168231 Oct 17 14:50:30.843914 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3647/7158] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:50:30 2022] GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e => generated 1697 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:50:31.867569 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-01cbd15d-e4c1-4b0b-9f51-fd63a758e83a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:50:31.868236 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-01cbd15d-e4c1-4b0b-9f51-fd63a758e83a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 666d0fcc-754f-4a77-8bae-fdea876bd37e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:50:31.876305 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-01cbd15d-e4c1-4b0b-9f51-fd63a758e83a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:50:31.876810 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-01cbd15d-e4c1-4b0b-9f51-fd63a758e83a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:50:31.877268 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-01cbd15d-e4c1-4b0b-9f51-fd63a758e83a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:50:31.877998 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-01cbd15d-e4c1-4b0b-9f51-fd63a758e83a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:50:31.878463 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-01cbd15d-e4c1-4b0b-9f51-fd63a758e83a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:50:31.878903 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-01cbd15d-e4c1-4b0b-9f51-fd63a758e83a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:50:32.032364 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-01cbd15d-e4c1-4b0b-9f51-fd63a758e83a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:50:32.041399 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-01cbd15d-e4c1-4b0b-9f51-fd63a758e83a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e" status: 200 len: 1697 microversion: 2.1 time: 0.177834 Oct 17 14:50:32.042000 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3512/7159] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:50:31 2022] GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e => generated 1697 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:50:33.067157 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-764b78d3-2845-441a-a49b-9dd3f82e58af tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:50:33.067808 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-764b78d3-2845-441a-a49b-9dd3f82e58af tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 666d0fcc-754f-4a77-8bae-fdea876bd37e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:50:33.075253 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-764b78d3-2845-441a-a49b-9dd3f82e58af tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:50:33.075768 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-764b78d3-2845-441a-a49b-9dd3f82e58af tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:50:33.076199 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-764b78d3-2845-441a-a49b-9dd3f82e58af tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:50:33.077221 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-764b78d3-2845-441a-a49b-9dd3f82e58af tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:50:33.077889 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-764b78d3-2845-441a-a49b-9dd3f82e58af tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:50:33.078441 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-764b78d3-2845-441a-a49b-9dd3f82e58af tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:50:33.226088 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-764b78d3-2845-441a-a49b-9dd3f82e58af tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:50:33.234625 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-764b78d3-2845-441a-a49b-9dd3f82e58af tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e" status: 200 len: 1697 microversion: 2.1 time: 0.171713 Oct 17 14:50:33.235258 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3648/7160] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:50:33 2022] GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e => generated 1697 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:50:34.260948 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ae09552c-d02a-401f-bb86-b06daa4763c7 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:50:34.261534 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ae09552c-d02a-401f-bb86-b06daa4763c7 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 666d0fcc-754f-4a77-8bae-fdea876bd37e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:50:34.269339 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae09552c-d02a-401f-bb86-b06daa4763c7 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:50:34.269847 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae09552c-d02a-401f-bb86-b06daa4763c7 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:50:34.270306 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae09552c-d02a-401f-bb86-b06daa4763c7 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:50:34.271038 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae09552c-d02a-401f-bb86-b06daa4763c7 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:50:34.271543 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae09552c-d02a-401f-bb86-b06daa4763c7 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:50:34.271986 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae09552c-d02a-401f-bb86-b06daa4763c7 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:50:34.429074 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ae09552c-d02a-401f-bb86-b06daa4763c7 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:50:34.437309 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ae09552c-d02a-401f-bb86-b06daa4763c7 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e" status: 200 len: 1697 microversion: 2.1 time: 0.180644 Oct 17 14:50:34.437893 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3513/7161] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:50:34 2022] GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e => generated 1697 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:50:35.461763 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-efd70afd-8f62-445a-867a-16e2b216610a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:50:35.462328 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-efd70afd-8f62-445a-867a-16e2b216610a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 666d0fcc-754f-4a77-8bae-fdea876bd37e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:50:35.469931 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-efd70afd-8f62-445a-867a-16e2b216610a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:50:35.470413 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-efd70afd-8f62-445a-867a-16e2b216610a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:50:35.470889 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-efd70afd-8f62-445a-867a-16e2b216610a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:50:35.471633 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-efd70afd-8f62-445a-867a-16e2b216610a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:50:35.472085 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-efd70afd-8f62-445a-867a-16e2b216610a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:50:35.472508 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-efd70afd-8f62-445a-867a-16e2b216610a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:50:35.626062 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-efd70afd-8f62-445a-867a-16e2b216610a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:50:35.634820 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-efd70afd-8f62-445a-867a-16e2b216610a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e" status: 200 len: 1697 microversion: 2.1 time: 0.177147 Oct 17 14:50:35.635547 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3649/7162] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:50:35 2022] GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e => generated 1697 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:50:36.663790 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-dcb034e3-cfa3-44e1-afb8-4709e7bac5de tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:50:36.664439 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-dcb034e3-cfa3-44e1-afb8-4709e7bac5de tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 666d0fcc-754f-4a77-8bae-fdea876bd37e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:50:36.671832 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dcb034e3-cfa3-44e1-afb8-4709e7bac5de tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:50:36.672342 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dcb034e3-cfa3-44e1-afb8-4709e7bac5de tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:50:36.672801 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dcb034e3-cfa3-44e1-afb8-4709e7bac5de tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:50:36.673519 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dcb034e3-cfa3-44e1-afb8-4709e7bac5de tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:50:36.673991 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dcb034e3-cfa3-44e1-afb8-4709e7bac5de tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:50:36.674433 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dcb034e3-cfa3-44e1-afb8-4709e7bac5de tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:50:36.823227 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-dcb034e3-cfa3-44e1-afb8-4709e7bac5de tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:50:36.831625 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-dcb034e3-cfa3-44e1-afb8-4709e7bac5de tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e" status: 200 len: 1697 microversion: 2.1 time: 0.171709 Oct 17 14:50:36.832416 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3514/7163] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:50:36 2022] GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e => generated 1697 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:50:37.855856 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c27d36d5-4e56-4bc5-83b8-817ec18cbb9d tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:50:37.856469 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c27d36d5-4e56-4bc5-83b8-817ec18cbb9d tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 666d0fcc-754f-4a77-8bae-fdea876bd37e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:50:37.864301 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c27d36d5-4e56-4bc5-83b8-817ec18cbb9d tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:50:37.864792 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c27d36d5-4e56-4bc5-83b8-817ec18cbb9d tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:50:37.865225 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c27d36d5-4e56-4bc5-83b8-817ec18cbb9d tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:50:37.865932 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c27d36d5-4e56-4bc5-83b8-817ec18cbb9d tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:50:37.866380 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c27d36d5-4e56-4bc5-83b8-817ec18cbb9d tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:50:37.866797 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c27d36d5-4e56-4bc5-83b8-817ec18cbb9d tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:50:38.015868 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c27d36d5-4e56-4bc5-83b8-817ec18cbb9d tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:50:38.028165 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c27d36d5-4e56-4bc5-83b8-817ec18cbb9d tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e" status: 200 len: 1697 microversion: 2.1 time: 0.176393 Oct 17 14:50:38.028984 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3650/7164] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:50:37 2022] GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e => generated 1697 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:50:39.055479 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-95281a0f-f667-4cfa-81c4-80682375c08f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:50:39.056132 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-95281a0f-f667-4cfa-81c4-80682375c08f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 666d0fcc-754f-4a77-8bae-fdea876bd37e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:50:39.064497 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-95281a0f-f667-4cfa-81c4-80682375c08f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:50:39.065035 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-95281a0f-f667-4cfa-81c4-80682375c08f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:50:39.065683 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-95281a0f-f667-4cfa-81c4-80682375c08f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:50:39.066588 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-95281a0f-f667-4cfa-81c4-80682375c08f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:50:39.067062 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-95281a0f-f667-4cfa-81c4-80682375c08f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:50:39.067709 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-95281a0f-f667-4cfa-81c4-80682375c08f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:50:39.212605 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-95281a0f-f667-4cfa-81c4-80682375c08f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:50:39.221951 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-95281a0f-f667-4cfa-81c4-80682375c08f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e" status: 200 len: 1697 microversion: 2.1 time: 0.170471 Oct 17 14:50:39.222734 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3515/7165] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:50:39 2022] GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e => generated 1697 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:50:40.252974 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-61bbe7fd-fe2e-4187-87d1-5c07960fb06f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:50:40.253942 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-61bbe7fd-fe2e-4187-87d1-5c07960fb06f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 666d0fcc-754f-4a77-8bae-fdea876bd37e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:50:40.263755 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-61bbe7fd-fe2e-4187-87d1-5c07960fb06f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:50:40.264283 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-61bbe7fd-fe2e-4187-87d1-5c07960fb06f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:50:40.264717 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-61bbe7fd-fe2e-4187-87d1-5c07960fb06f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:50:40.265428 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-61bbe7fd-fe2e-4187-87d1-5c07960fb06f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:50:40.265888 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-61bbe7fd-fe2e-4187-87d1-5c07960fb06f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:50:40.266316 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-61bbe7fd-fe2e-4187-87d1-5c07960fb06f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:50:40.408003 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-61bbe7fd-fe2e-4187-87d1-5c07960fb06f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:50:40.416123 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-61bbe7fd-fe2e-4187-87d1-5c07960fb06f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e" status: 200 len: 1697 microversion: 2.1 time: 0.169629 Oct 17 14:50:40.416734 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3651/7166] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:50:40 2022] GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e => generated 1697 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:50:41.441914 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9a6b140a-3b41-4a93-9eae-b0c97b1b614c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:50:41.442518 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9a6b140a-3b41-4a93-9eae-b0c97b1b614c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 666d0fcc-754f-4a77-8bae-fdea876bd37e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:50:41.450103 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9a6b140a-3b41-4a93-9eae-b0c97b1b614c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:50:41.450606 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9a6b140a-3b41-4a93-9eae-b0c97b1b614c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:50:41.451056 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9a6b140a-3b41-4a93-9eae-b0c97b1b614c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:50:41.451820 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9a6b140a-3b41-4a93-9eae-b0c97b1b614c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:50:41.452288 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9a6b140a-3b41-4a93-9eae-b0c97b1b614c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:50:41.452732 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9a6b140a-3b41-4a93-9eae-b0c97b1b614c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:50:41.596555 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9a6b140a-3b41-4a93-9eae-b0c97b1b614c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:50:41.604934 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9a6b140a-3b41-4a93-9eae-b0c97b1b614c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e" status: 200 len: 1697 microversion: 2.1 time: 0.167226 Oct 17 14:50:41.605529 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3516/7167] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:50:41 2022] GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e => generated 1697 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:50:42.630020 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c334c34e-3a88-433b-bae3-8f2fb79fdfde tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:50:42.630677 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c334c34e-3a88-433b-bae3-8f2fb79fdfde tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 666d0fcc-754f-4a77-8bae-fdea876bd37e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:50:42.641732 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c334c34e-3a88-433b-bae3-8f2fb79fdfde tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:50:42.642334 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c334c34e-3a88-433b-bae3-8f2fb79fdfde tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:50:42.642932 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c334c34e-3a88-433b-bae3-8f2fb79fdfde tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:50:42.644092 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c334c34e-3a88-433b-bae3-8f2fb79fdfde tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:50:42.644728 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c334c34e-3a88-433b-bae3-8f2fb79fdfde tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:50:42.645358 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c334c34e-3a88-433b-bae3-8f2fb79fdfde tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:50:42.891730 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c334c34e-3a88-433b-bae3-8f2fb79fdfde tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:50:42.902207 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c334c34e-3a88-433b-bae3-8f2fb79fdfde tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e" status: 200 len: 1696 microversion: 2.1 time: 0.276180 Oct 17 14:50:42.902832 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3652/7168] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:50:42 2022] GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e => generated 1696 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:50:43.187473 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-325ce6e2-61a3-4442-8f9b-125ace147200 req-1f56492a-cbdc-4313-84e3-7a45e66d843a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "666d0fcc-754f-4a77-8bae-fdea876bd37e", "name": "network-vif-unplugged", "status": "completed", "tag": "5e364050-649b-4bc9-b906-604b9618b16d"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:50:43.199001 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-325ce6e2-61a3-4442-8f9b-125ace147200 req-1f56492a-cbdc-4313-84e3-7a45e66d843a service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:50:43.199362 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-325ce6e2-61a3-4442-8f9b-125ace147200 req-1f56492a-cbdc-4313-84e3-7a45e66d843a service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:50:43.199788 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-325ce6e2-61a3-4442-8f9b-125ace147200 req-1f56492a-cbdc-4313-84e3-7a45e66d843a service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:50:43.213102 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-325ce6e2-61a3-4442-8f9b-125ace147200 req-1f56492a-cbdc-4313-84e3-7a45e66d843a service nova] Creating event network-vif-unplugged:5e364050-649b-4bc9-b906-604b9618b16d for instance 666d0fcc-754f-4a77-8bae-fdea876bd37e on n-h2-854247-14 Oct 17 14:50:43.219451 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [req-325ce6e2-61a3-4442-8f9b-125ace147200 req-1f56492a-cbdc-4313-84e3-7a45e66d843a service nova] Instance 666d0fcc-754f-4a77-8bae-fdea876bd37e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854247-14', 'n-h2-854247-14'} {{(pid=127017) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 14:50:43.232168 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-325ce6e2-61a3-4442-8f9b-125ace147200 req-1f56492a-cbdc-4313-84e3-7a45e66d843a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048615 Oct 17 14:50:43.233122 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3517/7169] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:50:43.930459 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-87841434-410f-4eb8-9d79-8f2a769d5859 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:50:43.932490 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-87841434-410f-4eb8-9d79-8f2a769d5859 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 666d0fcc-754f-4a77-8bae-fdea876bd37e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:50:43.941752 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-87841434-410f-4eb8-9d79-8f2a769d5859 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:50:43.942553 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-87841434-410f-4eb8-9d79-8f2a769d5859 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:50:43.943373 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-87841434-410f-4eb8-9d79-8f2a769d5859 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:50:43.944593 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-87841434-410f-4eb8-9d79-8f2a769d5859 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:50:43.945407 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-87841434-410f-4eb8-9d79-8f2a769d5859 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:50:43.946473 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-87841434-410f-4eb8-9d79-8f2a769d5859 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:50:44.475083 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-87841434-410f-4eb8-9d79-8f2a769d5859 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:50:44.483868 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-87841434-410f-4eb8-9d79-8f2a769d5859 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e" status: 200 len: 1696 microversion: 2.1 time: 0.560849 Oct 17 14:50:44.484492 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3653/7170] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:50:43 2022] GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e => generated 1696 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:50:45.250891 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-7e9c06c3-868a-4bff-b495-ee895f9cc5e3 req-30eefa25-686c-4973-897d-e5c0d68ee4ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "666d0fcc-754f-4a77-8bae-fdea876bd37e", "tag": "5e364050-649b-4bc9-b906-604b9618b16d"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:50:45.261137 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-7e9c06c3-868a-4bff-b495-ee895f9cc5e3 req-30eefa25-686c-4973-897d-e5c0d68ee4ed service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:50:45.261628 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-7e9c06c3-868a-4bff-b495-ee895f9cc5e3 req-30eefa25-686c-4973-897d-e5c0d68ee4ed service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:50:45.262083 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-7e9c06c3-868a-4bff-b495-ee895f9cc5e3 req-30eefa25-686c-4973-897d-e5c0d68ee4ed service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:50:45.274101 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-7e9c06c3-868a-4bff-b495-ee895f9cc5e3 req-30eefa25-686c-4973-897d-e5c0d68ee4ed service nova] Creating event network-changed:5e364050-649b-4bc9-b906-604b9618b16d for instance 666d0fcc-754f-4a77-8bae-fdea876bd37e on n-h2-854247-14 Oct 17 14:50:45.279996 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [req-7e9c06c3-868a-4bff-b495-ee895f9cc5e3 req-30eefa25-686c-4973-897d-e5c0d68ee4ed service nova] Instance 666d0fcc-754f-4a77-8bae-fdea876bd37e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854247-14', 'n-h2-854247-14'} {{(pid=127017) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 14:50:45.291108 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-7e9c06c3-868a-4bff-b495-ee895f9cc5e3 req-30eefa25-686c-4973-897d-e5c0d68ee4ed service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045483 Oct 17 14:50:45.291839 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3518/7171] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:50:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:50:45.508745 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fd49268e-273e-4f1a-8c93-b65733f58225 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:50:45.509395 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-fd49268e-273e-4f1a-8c93-b65733f58225 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 666d0fcc-754f-4a77-8bae-fdea876bd37e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:50:45.517837 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fd49268e-273e-4f1a-8c93-b65733f58225 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:50:45.518324 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fd49268e-273e-4f1a-8c93-b65733f58225 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:50:45.518754 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fd49268e-273e-4f1a-8c93-b65733f58225 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:50:45.519510 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fd49268e-273e-4f1a-8c93-b65733f58225 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:50:45.519957 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fd49268e-273e-4f1a-8c93-b65733f58225 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:50:45.520372 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fd49268e-273e-4f1a-8c93-b65733f58225 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:50:45.658445 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fd49268e-273e-4f1a-8c93-b65733f58225 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:50:45.666313 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fd49268e-273e-4f1a-8c93-b65733f58225 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e" status: 200 len: 1694 microversion: 2.1 time: 0.161574 Oct 17 14:50:45.667078 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3654/7172] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:50:45 2022] GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e => generated 1694 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:50:46.691791 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d297b3b3-c523-47b1-a0c3-7191b280320c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:50:46.692488 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d297b3b3-c523-47b1-a0c3-7191b280320c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 666d0fcc-754f-4a77-8bae-fdea876bd37e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:50:46.699665 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d297b3b3-c523-47b1-a0c3-7191b280320c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:50:46.700171 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d297b3b3-c523-47b1-a0c3-7191b280320c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:50:46.700624 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d297b3b3-c523-47b1-a0c3-7191b280320c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:50:46.701336 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d297b3b3-c523-47b1-a0c3-7191b280320c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:50:46.701806 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d297b3b3-c523-47b1-a0c3-7191b280320c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:50:46.702225 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d297b3b3-c523-47b1-a0c3-7191b280320c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:50:46.846572 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d297b3b3-c523-47b1-a0c3-7191b280320c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:50:46.854969 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d297b3b3-c523-47b1-a0c3-7191b280320c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e" status: 200 len: 1691 microversion: 2.1 time: 0.168487 Oct 17 14:50:46.855599 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3519/7173] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:50:46 2022] GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e => generated 1691 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:50:46.878935 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f1d139e9-6645-4317-8491-17db6466249d tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:50:46.879525 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f1d139e9-6645-4317-8491-17db6466249d tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 666d0fcc-754f-4a77-8bae-fdea876bd37e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:50:46.886927 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1d139e9-6645-4317-8491-17db6466249d tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:50:46.887444 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1d139e9-6645-4317-8491-17db6466249d tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:50:46.887888 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1d139e9-6645-4317-8491-17db6466249d tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:50:46.888557 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1d139e9-6645-4317-8491-17db6466249d tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:50:46.889003 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1d139e9-6645-4317-8491-17db6466249d tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:50:46.889552 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f1d139e9-6645-4317-8491-17db6466249d tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:50:46.954020 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f1d139e9-6645-4317-8491-17db6466249d tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "POST /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e/action" status: 204 len: 0 microversion: 2.1 time: 0.078825 Oct 17 14:50:46.954582 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3655/7174] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:50:46 2022] POST /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e/action => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 14:50:46.969088 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d1de73a0-6490-4e7e-899e-571842145912 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:50:46.969772 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d1de73a0-6490-4e7e-899e-571842145912 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 666d0fcc-754f-4a77-8bae-fdea876bd37e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:50:46.976373 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d1de73a0-6490-4e7e-899e-571842145912 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:50:46.976898 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d1de73a0-6490-4e7e-899e-571842145912 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:50:46.977494 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d1de73a0-6490-4e7e-899e-571842145912 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:50:46.978248 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d1de73a0-6490-4e7e-899e-571842145912 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:50:46.978702 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d1de73a0-6490-4e7e-899e-571842145912 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:50:46.979374 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d1de73a0-6490-4e7e-899e-571842145912 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:50:47.132261 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d1de73a0-6490-4e7e-899e-571842145912 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:50:47.142593 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d1de73a0-6490-4e7e-899e-571842145912 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e" status: 200 len: 1691 microversion: 2.1 time: 0.183443 Oct 17 14:50:47.143931 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3520/7175] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:50:46 2022] GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e => generated 1691 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:50:47.167990 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0806b706-5e68-4edc-abdc-210830d771a3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:50:47.169019 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0806b706-5e68-4edc-abdc-210830d771a3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 666d0fcc-754f-4a77-8bae-fdea876bd37e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:50:47.175621 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0806b706-5e68-4edc-abdc-210830d771a3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:50:47.176143 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0806b706-5e68-4edc-abdc-210830d771a3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:50:47.176663 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0806b706-5e68-4edc-abdc-210830d771a3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:50:47.177369 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0806b706-5e68-4edc-abdc-210830d771a3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:50:47.177841 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0806b706-5e68-4edc-abdc-210830d771a3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:50:47.178256 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0806b706-5e68-4edc-abdc-210830d771a3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:50:47.322039 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0806b706-5e68-4edc-abdc-210830d771a3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:50:47.330958 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0806b706-5e68-4edc-abdc-210830d771a3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e" status: 200 len: 1691 microversion: 2.1 time: 0.167728 Oct 17 14:50:47.331657 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3656/7176] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:50:47 2022] GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e => generated 1691 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:50:48.356033 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3446c747-db5d-42e8-b002-d737504a8a97 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:50:48.356610 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3446c747-db5d-42e8-b002-d737504a8a97 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 666d0fcc-754f-4a77-8bae-fdea876bd37e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:50:48.365682 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3446c747-db5d-42e8-b002-d737504a8a97 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:50:48.366562 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3446c747-db5d-42e8-b002-d737504a8a97 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:50:48.367020 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3446c747-db5d-42e8-b002-d737504a8a97 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:50:48.367777 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3446c747-db5d-42e8-b002-d737504a8a97 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:50:48.368243 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3446c747-db5d-42e8-b002-d737504a8a97 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:50:48.369020 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3446c747-db5d-42e8-b002-d737504a8a97 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:50:48.520196 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3446c747-db5d-42e8-b002-d737504a8a97 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:50:48.529159 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3446c747-db5d-42e8-b002-d737504a8a97 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e" status: 200 len: 1683 microversion: 2.1 time: 0.177615 Oct 17 14:50:48.529878 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3521/7177] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:50:48 2022] GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e => generated 1683 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:50:48.690235 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-54469f81-0e3c-4499-91c3-398eec9344e0 req-81026af4-e32c-4de3-b439-1ee76b3a4496 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "666d0fcc-754f-4a77-8bae-fdea876bd37e", "name": "network-vif-plugged", "status": "completed", "tag": "5e364050-649b-4bc9-b906-604b9618b16d"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:50:48.700411 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-54469f81-0e3c-4499-91c3-398eec9344e0 req-81026af4-e32c-4de3-b439-1ee76b3a4496 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:50:48.700884 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-54469f81-0e3c-4499-91c3-398eec9344e0 req-81026af4-e32c-4de3-b439-1ee76b3a4496 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:50:48.701785 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-54469f81-0e3c-4499-91c3-398eec9344e0 req-81026af4-e32c-4de3-b439-1ee76b3a4496 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:50:48.713865 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-54469f81-0e3c-4499-91c3-398eec9344e0 req-81026af4-e32c-4de3-b439-1ee76b3a4496 service nova] Creating event network-vif-plugged:5e364050-649b-4bc9-b906-604b9618b16d for instance 666d0fcc-754f-4a77-8bae-fdea876bd37e on n-h2-854247-14 Oct 17 14:50:48.719462 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-54469f81-0e3c-4499-91c3-398eec9344e0 req-81026af4-e32c-4de3-b439-1ee76b3a4496 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093224 Oct 17 14:50:48.720085 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3657/7178] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:51:10.725966 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-349b9bf2-972f-4d29-9871-d4ce222c5272 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:51:10.728267 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-349b9bf2-972f-4d29-9871-d4ce222c5272 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 666d0fcc-754f-4a77-8bae-fdea876bd37e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:51:10.731026 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=32 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:51:10.731749 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:51:10.738729 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-349b9bf2-972f-4d29-9871-d4ce222c5272 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:10.739233 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-349b9bf2-972f-4d29-9871-d4ce222c5272 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:10.739722 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-349b9bf2-972f-4d29-9871-d4ce222c5272 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:10.740469 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-349b9bf2-972f-4d29-9871-d4ce222c5272 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:10.740956 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-349b9bf2-972f-4d29-9871-d4ce222c5272 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:10.741391 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-349b9bf2-972f-4d29-9871-d4ce222c5272 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:10.799462 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-349b9bf2-972f-4d29-9871-d4ce222c5272 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "POST /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e/action" status: 200 len: 24576 microversion: 2.1 time: 0.077606 Oct 17 14:51:10.800119 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3522/7179] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:51:10 2022] POST /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e/action => generated 24576 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 14:51:18.181648 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=28 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:51:18.182818 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:51:18.184786 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-fb3f8888-91c7-44d5-90b1-9ecb7c5ad630 req-cbf33f51-0b56-4a50-bd92-f53c5a74c352 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "666d0fcc-754f-4a77-8bae-fdea876bd37e", "tag": "5e364050-649b-4bc9-b906-604b9618b16d"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:51:18.189755 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0b3793ef-77d2-4e9f-81db-524528cbba13 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:51:18.190641 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0b3793ef-77d2-4e9f-81db-524528cbba13 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 666d0fcc-754f-4a77-8bae-fdea876bd37e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:51:18.198975 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0b3793ef-77d2-4e9f-81db-524528cbba13 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:18.199531 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0b3793ef-77d2-4e9f-81db-524528cbba13 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:18.199967 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0b3793ef-77d2-4e9f-81db-524528cbba13 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:18.200677 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0b3793ef-77d2-4e9f-81db-524528cbba13 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:18.201145 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0b3793ef-77d2-4e9f-81db-524528cbba13 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:18.201573 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0b3793ef-77d2-4e9f-81db-524528cbba13 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:18.204680 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-fb3f8888-91c7-44d5-90b1-9ecb7c5ad630 req-cbf33f51-0b56-4a50-bd92-f53c5a74c352 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:18.205400 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-fb3f8888-91c7-44d5-90b1-9ecb7c5ad630 req-cbf33f51-0b56-4a50-bd92-f53c5a74c352 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:18.206028 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-fb3f8888-91c7-44d5-90b1-9ecb7c5ad630 req-cbf33f51-0b56-4a50-bd92-f53c5a74c352 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:18.224354 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-fb3f8888-91c7-44d5-90b1-9ecb7c5ad630 req-cbf33f51-0b56-4a50-bd92-f53c5a74c352 service nova] Creating event network-changed:5e364050-649b-4bc9-b906-604b9618b16d for instance 666d0fcc-754f-4a77-8bae-fdea876bd37e on n-h2-854247-14 Oct 17 14:51:18.231629 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-fb3f8888-91c7-44d5-90b1-9ecb7c5ad630 req-cbf33f51-0b56-4a50-bd92-f53c5a74c352 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052103 Oct 17 14:51:18.233304 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3523/7180] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:51:18.235541 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0b3793ef-77d2-4e9f-81db-524528cbba13 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 666d0fcc-754f-4a77-8bae-fdea876bd37e] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:51:18.338238 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0b3793ef-77d2-4e9f-81db-524528cbba13 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "DELETE /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e" status: 204 len: 0 microversion: 2.1 time: 0.159830 Oct 17 14:51:18.339408 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3658/7181] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:51:18 2022] DELETE /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:51:18.350392 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-827db5a3-69f5-4c43-aad0-ecc1a1f3c3f7 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:51:18.351809 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-827db5a3-69f5-4c43-aad0-ecc1a1f3c3f7 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 666d0fcc-754f-4a77-8bae-fdea876bd37e] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:51:18.359213 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-827db5a3-69f5-4c43-aad0-ecc1a1f3c3f7 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:18.360145 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-827db5a3-69f5-4c43-aad0-ecc1a1f3c3f7 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:18.360599 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-827db5a3-69f5-4c43-aad0-ecc1a1f3c3f7 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:18.362040 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-827db5a3-69f5-4c43-aad0-ecc1a1f3c3f7 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:18.362520 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-827db5a3-69f5-4c43-aad0-ecc1a1f3c3f7 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:18.362974 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-827db5a3-69f5-4c43-aad0-ecc1a1f3c3f7 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:18.536166 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-827db5a3-69f5-4c43-aad0-ecc1a1f3c3f7 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:51:18.544835 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-827db5a3-69f5-4c43-aad0-ecc1a1f3c3f7 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e" status: 200 len: 1689 microversion: 2.1 time: 0.200088 Oct 17 14:51:18.545443 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3524/7182] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:51:18 2022] GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e => generated 1689 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:51:19.570573 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-239ed96a-f25c-443d-bc72-82bc20571a70 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:51:19.571270 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-239ed96a-f25c-443d-bc72-82bc20571a70 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 666d0fcc-754f-4a77-8bae-fdea876bd37e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:51:19.578698 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-239ed96a-f25c-443d-bc72-82bc20571a70 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:19.579465 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-239ed96a-f25c-443d-bc72-82bc20571a70 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:19.580065 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-239ed96a-f25c-443d-bc72-82bc20571a70 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:19.580800 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-239ed96a-f25c-443d-bc72-82bc20571a70 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:19.581260 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-239ed96a-f25c-443d-bc72-82bc20571a70 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:19.581691 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-239ed96a-f25c-443d-bc72-82bc20571a70 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:19.928450 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-239ed96a-f25c-443d-bc72-82bc20571a70 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:51:19.936817 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-239ed96a-f25c-443d-bc72-82bc20571a70 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e" status: 200 len: 1689 microversion: 2.1 time: 0.370766 Oct 17 14:51:19.937384 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3659/7183] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:51:19 2022] GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e => generated 1689 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:51:20.353483 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-7ba0e360-8b29-4b80-860f-e32250e09f0b req-0b070975-3b93-4f57-9364-39cd99722a61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "666d0fcc-754f-4a77-8bae-fdea876bd37e", "name": "network-vif-deleted", "tag": "5e364050-649b-4bc9-b906-604b9618b16d"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:51:20.365153 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-7ba0e360-8b29-4b80-860f-e32250e09f0b req-0b070975-3b93-4f57-9364-39cd99722a61 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:20.365700 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-7ba0e360-8b29-4b80-860f-e32250e09f0b req-0b070975-3b93-4f57-9364-39cd99722a61 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:20.366141 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-7ba0e360-8b29-4b80-860f-e32250e09f0b req-0b070975-3b93-4f57-9364-39cd99722a61 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:20.380797 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-7ba0e360-8b29-4b80-860f-e32250e09f0b req-0b070975-3b93-4f57-9364-39cd99722a61 service nova] Creating event network-vif-deleted:5e364050-649b-4bc9-b906-604b9618b16d for instance 666d0fcc-754f-4a77-8bae-fdea876bd37e on n-h2-854247-14 Oct 17 14:51:20.387517 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-7ba0e360-8b29-4b80-860f-e32250e09f0b req-0b070975-3b93-4f57-9364-39cd99722a61 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039093 Oct 17 14:51:20.388516 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3525/7184] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:51:20.961302 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3157f4ea-2aab-4503-b579-0e60dafd79fe tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:51:20.961969 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3157f4ea-2aab-4503-b579-0e60dafd79fe tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 666d0fcc-754f-4a77-8bae-fdea876bd37e] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:51:20.969354 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3157f4ea-2aab-4503-b579-0e60dafd79fe tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:20.969940 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3157f4ea-2aab-4503-b579-0e60dafd79fe tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:20.970376 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3157f4ea-2aab-4503-b579-0e60dafd79fe tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:20.971086 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3157f4ea-2aab-4503-b579-0e60dafd79fe tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:20.971561 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3157f4ea-2aab-4503-b579-0e60dafd79fe tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:20.971984 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3157f4ea-2aab-4503-b579-0e60dafd79fe tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:20.987128 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-3157f4ea-2aab-4503-b579-0e60dafd79fe tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] HTTP exception thrown: Instance 666d0fcc-754f-4a77-8bae-fdea876bd37e could not be found. Oct 17 14:51:20.988862 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3157f4ea-2aab-4503-b579-0e60dafd79fe tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Request method failure captured: Oct 17 14:51:20.988862 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e HTTP/1.1 Oct 17 14:51:20.988862 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 14:51:20.988862 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 14:51:20.988862 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 14:51:20.988862 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 14:51:20.988862 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 14:51:20.988862 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 14:51:20.988862 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 14:51:20.988862 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 14:51:20.988862 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTWrbJTp3_aV3rQ1sZIV-A8RhPUhGtuu3Cdy9UtPO9T2_ui3_S4_dniOOQZy69dfFzd3AdqRHxEdsaXpnKLosIkT6TOjwXy5X_JiSCvihpV_5K-xclYBmfytVuV0W0qLAfA4CBTVr0Qr1hQGpQvQysPbiqlBcm_U91Zx-5cXnnLrTX2s Oct 17 14:51:20.988862 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 14:51:20.988862 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 14:51:20.988862 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 14:51:20.988862 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 14:51:20.988862 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 14:51:20.988862 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 14:51:20.988862 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 6d8fb8c2659a43a696a0a16e7d2be378 Oct 17 14:51:20.988862 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1531965843 Oct 17 14:51:20.988862 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 14:51:20.988862 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 14:51:20.988862 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6d8fb8c2659a43a696a0a16e7d2be378"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6d8fb8c2659a43a696a0a16e7d2be378"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6d8fb8c2659a43a696a0a16e7d2be378"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6d8fb8c2659a43a696a0a16e7d2be378", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:51:20.988862 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1531965843 Oct 17 14:51:20.988862 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 6d8fb8c2659a43a696a0a16e7d2be378 Oct 17 14:51:20.988862 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1531965843 Oct 17 14:51:20.988862 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-TestNetworkAdvancedServerOps-1531965843-project Oct 17 14:51:20.988862 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 14:51:20.988862 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 14:51:20.988862 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 4805a4aa399d4d0798b6077a545a2255 Oct 17 14:51:20.988862 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1531965843-project Oct 17 14:51:20.988862 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 14:51:20.988862 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance 666d0fcc-754f-4a77-8bae-fdea876bd37e could not be found. Oct 17 14:51:20.988862 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': '666d0fcc-754f-4a77-8bae-fdea876bd37e'} Oct 17 14:51:20.988862 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:51:20.988862 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:51:20.988862 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:51:20.988862 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:51:20.988862 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:51:20.988862 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:51:20.988862 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:51:20.988862 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:51:20.988862 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:51:20.988862 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:51:20.988862 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 666d0fcc-754f-4a77-8bae-fdea876bd37e could not be found. Oct 17 14:51:20.988862 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:51:20.988862 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:51:20.988862 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:51:20.988862 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:51:20.988862 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:51:20.988862 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:51:20.988862 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:51:20.988862 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:51:20.988862 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:51:20.988862 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:51:20.988862 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:51:20.988862 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:51:20.988862 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:51:20.988862 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:51:20.988862 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:51:20.988862 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:51:20.988862 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 666d0fcc-754f-4a77-8bae-fdea876bd37e could not be found. Oct 17 14:51:20.988862 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:51:20.988862 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:51:20.994251 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:51:20.994251 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:51:20.994251 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:51:20.994251 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:51:20.994251 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:51:20.994251 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:51:20.994251 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 666d0fcc-754f-4a77-8bae-fdea876bd37e could not be found. Oct 17 14:51:20.994251 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 14:51:20.994251 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3157f4ea-2aab-4503-b579-0e60dafd79fe tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Returning 404 to user: Instance 666d0fcc-754f-4a77-8bae-fdea876bd37e could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:51:20.994251 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3157f4ea-2aab-4503-b579-0e60dafd79fe tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e" status: 404 len: 111 microversion: 2.1 time: 0.033354 Oct 17 14:51:20.994251 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3660/7185] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:51:20 2022] GET /compute/v2.1/servers/666d0fcc-754f-4a77-8bae-fdea876bd37e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:51:24.672436 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-aa9f85ae-8389-4aad-9e80-0bf7b08ecdad tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '.version_select at 0x7f7cd4a241f0>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:51:24.697695 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-aa9f85ae-8389-4aad-9e80-0bf7b08ecdad tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1199728133" status: 202 len: 0 microversion: 2.1 time: 0.029582 Oct 17 14:51:24.698182 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3526/7186] 10.222.0.79 () {58 vars in 1284 bytes} [Mon Oct 17 14:51:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1199728133 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:51:24.727955 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fef34ab2-c08e-4b1b-9406-69fb6d358fd7 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Action: 'create', calling method: .version_select at 0x7f7cd44aaca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-13190031", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyw3M5vWCjkLFuEUcNPVXz4XdrnwVBxCg0BNjX8Xm8apN0PR+5taYqZyHd7iC+q4XSSJVufMEX80ZtRxMppBuP2R3Q/PBrqKxvXCUV8UBsdLk18SAJKcL40445BoD23YA=="}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:51:24.753522 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-fef34ab2-c08e-4b1b-9406-69fb6d358fd7 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Getting quotas for project 6d8fb8c2659a43a696a0a16e7d2be378. Resources: {'key_pairs'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:51:24.759300 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-fef34ab2-c08e-4b1b-9406-69fb6d358fd7 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Getting quotas for user 4805a4aa399d4d0798b6077a545a2255 and project 6d8fb8c2659a43a696a0a16e7d2be378. Resources: {'key_pairs'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:51:24.788605 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fef34ab2-c08e-4b1b-9406-69fb6d358fd7 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.066193 Oct 17 14:51:24.789255 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3661/7187] 10.222.0.79 () {60 vars in 1159 bytes} [Mon Oct 17 14:51:24 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:51:30.822324 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f6b9c072-2cd1-45d8-a814-18c4ec53c34e tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1821257687", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "7cb61001-b4d6-40f4-9dfc-b0e0b33d4b29"}], "key_name": "tempest-TestNetworkAdvancedServerOps-13190031", "security_groups": [{"name": "tempest-secgroup-smoke-722976788"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:51:30.835542 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=14 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:51:30.946950 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-f6b9c072-2cd1-45d8-a814-18c4ec53c34e tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] validate_networks() for [('7cb61001-b4d6-40f4-9dfc-b0e0b33d4b29', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:51:31.467871 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-f6b9c072-2cd1-45d8-a814-18c4ec53c34e tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:51:31.468311 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-f6b9c072-2cd1-45d8-a814-18c4ec53c34e tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:51:31.468799 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-f6b9c072-2cd1-45d8-a814-18c4ec53c34e tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:51:31.469254 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-f6b9c072-2cd1-45d8-a814-18c4ec53c34e tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:51:31.469682 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-f6b9c072-2cd1-45d8-a814-18c4ec53c34e tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:51:31.479128 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f6b9c072-2cd1-45d8-a814-18c4ec53c34e tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:31.479962 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f6b9c072-2cd1-45d8-a814-18c4ec53c34e tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:31.480411 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f6b9c072-2cd1-45d8-a814-18c4ec53c34e tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:31.481228 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f6b9c072-2cd1-45d8-a814-18c4ec53c34e tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:31.481686 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f6b9c072-2cd1-45d8-a814-18c4ec53c34e tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:31.482302 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f6b9c072-2cd1-45d8-a814-18c4ec53c34e tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:31.518000 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-f6b9c072-2cd1-45d8-a814-18c4ec53c34e tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Getting quotas for project 6d8fb8c2659a43a696a0a16e7d2be378. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:51:31.524807 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-f6b9c072-2cd1-45d8-a814-18c4ec53c34e tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Getting quotas for user 4805a4aa399d4d0798b6077a545a2255 and project 6d8fb8c2659a43a696a0a16e7d2be378. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:51:31.539934 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f6b9c072-2cd1-45d8-a814-18c4ec53c34e tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:51:31.542775 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f6b9c072-2cd1-45d8-a814-18c4ec53c34e tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 63d70072-e811-4d3c-a87e-2ad9d70c34e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:51:31.608726 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f6b9c072-2cd1-45d8-a814-18c4ec53c34e tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.788812 Oct 17 14:51:31.610206 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3527/7188] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 14:51:30 2022] POST /compute/v2.1/servers => generated 405 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:51:31.619569 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:51:31.624434 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0d310ac7-8d85-413e-afe2-2258b9ef6a45 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:51:31.625428 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0d310ac7-8d85-413e-afe2-2258b9ef6a45 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 63d70072-e811-4d3c-a87e-2ad9d70c34e1] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:51:31.731878 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0d310ac7-8d85-413e-afe2-2258b9ef6a45 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:51:31.740567 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0d310ac7-8d85-413e-afe2-2258b9ef6a45 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1" status: 200 len: 1265 microversion: 2.1 time: 0.123276 Oct 17 14:51:31.743288 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3662/7189] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:51:31 2022] GET /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1 => generated 1265 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:51:32.768957 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f08eb740-271f-4861-a21d-61b929273113 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:51:32.771919 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f08eb740-271f-4861-a21d-61b929273113 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 63d70072-e811-4d3c-a87e-2ad9d70c34e1] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:51:32.784906 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f08eb740-271f-4861-a21d-61b929273113 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:32.785738 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f08eb740-271f-4861-a21d-61b929273113 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:32.786625 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f08eb740-271f-4861-a21d-61b929273113 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:32.787993 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f08eb740-271f-4861-a21d-61b929273113 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:32.789134 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f08eb740-271f-4861-a21d-61b929273113 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:32.790193 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f08eb740-271f-4861-a21d-61b929273113 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:32.864963 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f08eb740-271f-4861-a21d-61b929273113 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:51:32.873461 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f08eb740-271f-4861-a21d-61b929273113 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1" status: 200 len: 1335 microversion: 2.1 time: 0.111061 Oct 17 14:51:32.874059 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3528/7190] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:51:32 2022] GET /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1 => generated 1335 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:51:33.898074 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-18e53563-8371-4fcb-b13d-3f9818bbf079 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:51:33.901025 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-18e53563-8371-4fcb-b13d-3f9818bbf079 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 63d70072-e811-4d3c-a87e-2ad9d70c34e1] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:51:33.909530 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-18e53563-8371-4fcb-b13d-3f9818bbf079 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:33.910180 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-18e53563-8371-4fcb-b13d-3f9818bbf079 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:33.910705 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-18e53563-8371-4fcb-b13d-3f9818bbf079 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:33.911503 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-18e53563-8371-4fcb-b13d-3f9818bbf079 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:33.912019 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-18e53563-8371-4fcb-b13d-3f9818bbf079 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:33.912500 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-18e53563-8371-4fcb-b13d-3f9818bbf079 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:34.064185 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-18e53563-8371-4fcb-b13d-3f9818bbf079 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:51:34.075207 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-18e53563-8371-4fcb-b13d-3f9818bbf079 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1" status: 200 len: 1390 microversion: 2.1 time: 0.181842 Oct 17 14:51:34.079592 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3663/7191] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:51:33 2022] GET /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1 => generated 1390 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:51:34.345646 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-72aeaedf-9547-4d8a-a9d2-0d81b32aa4c2 req-4e04c73e-f103-447c-a3e3-a9d399e38f19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63d70072-e811-4d3c-a87e-2ad9d70c34e1", "tag": "dc1445b7-dc52-4a58-9b83-2285ec4ac998"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:51:34.356944 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-72aeaedf-9547-4d8a-a9d2-0d81b32aa4c2 req-4e04c73e-f103-447c-a3e3-a9d399e38f19 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:34.357444 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-72aeaedf-9547-4d8a-a9d2-0d81b32aa4c2 req-4e04c73e-f103-447c-a3e3-a9d399e38f19 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:34.358011 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-72aeaedf-9547-4d8a-a9d2-0d81b32aa4c2 req-4e04c73e-f103-447c-a3e3-a9d399e38f19 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:34.370345 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-72aeaedf-9547-4d8a-a9d2-0d81b32aa4c2 req-4e04c73e-f103-447c-a3e3-a9d399e38f19 service nova] Creating event network-changed:dc1445b7-dc52-4a58-9b83-2285ec4ac998 for instance 63d70072-e811-4d3c-a87e-2ad9d70c34e1 on n-h1-854247-14 Oct 17 14:51:34.376384 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-72aeaedf-9547-4d8a-a9d2-0d81b32aa4c2 req-4e04c73e-f103-447c-a3e3-a9d399e38f19 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034512 Oct 17 14:51:34.376982 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3529/7192] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:51:35.106339 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b162ed3d-ec53-4025-9793-559cf8f0705f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:51:35.106937 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b162ed3d-ec53-4025-9793-559cf8f0705f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 63d70072-e811-4d3c-a87e-2ad9d70c34e1] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:51:35.114764 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b162ed3d-ec53-4025-9793-559cf8f0705f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:35.115283 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b162ed3d-ec53-4025-9793-559cf8f0705f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:35.115741 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b162ed3d-ec53-4025-9793-559cf8f0705f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:35.116456 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b162ed3d-ec53-4025-9793-559cf8f0705f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:35.116901 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b162ed3d-ec53-4025-9793-559cf8f0705f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:35.117326 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b162ed3d-ec53-4025-9793-559cf8f0705f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:35.255156 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b162ed3d-ec53-4025-9793-559cf8f0705f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:51:35.263111 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b162ed3d-ec53-4025-9793-559cf8f0705f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1" status: 200 len: 1390 microversion: 2.1 time: 0.161247 Oct 17 14:51:35.263750 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3664/7193] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:51:35 2022] GET /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1 => generated 1390 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:51:36.288233 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-efb3206d-60b6-4629-a2c4-fa3d1f338394 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:51:36.288942 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-efb3206d-60b6-4629-a2c4-fa3d1f338394 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 63d70072-e811-4d3c-a87e-2ad9d70c34e1] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:51:36.295913 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-efb3206d-60b6-4629-a2c4-fa3d1f338394 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:36.296397 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-efb3206d-60b6-4629-a2c4-fa3d1f338394 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:36.296875 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-efb3206d-60b6-4629-a2c4-fa3d1f338394 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:36.297816 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-efb3206d-60b6-4629-a2c4-fa3d1f338394 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:36.298316 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-efb3206d-60b6-4629-a2c4-fa3d1f338394 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:36.298760 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-efb3206d-60b6-4629-a2c4-fa3d1f338394 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:36.467380 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-efb3206d-60b6-4629-a2c4-fa3d1f338394 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:51:36.476524 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-efb3206d-60b6-4629-a2c4-fa3d1f338394 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1" status: 200 len: 1390 microversion: 2.1 time: 0.193553 Oct 17 14:51:36.477115 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3530/7194] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:51:36 2022] GET /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1 => generated 1390 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:51:37.500854 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7d7be1a4-50bc-4c50-9543-b9655885b533 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:51:37.501487 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7d7be1a4-50bc-4c50-9543-b9655885b533 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 63d70072-e811-4d3c-a87e-2ad9d70c34e1] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:51:37.508773 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7d7be1a4-50bc-4c50-9543-b9655885b533 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:37.509261 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7d7be1a4-50bc-4c50-9543-b9655885b533 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:37.509694 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7d7be1a4-50bc-4c50-9543-b9655885b533 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:37.510397 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7d7be1a4-50bc-4c50-9543-b9655885b533 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:37.510847 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7d7be1a4-50bc-4c50-9543-b9655885b533 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:37.511316 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7d7be1a4-50bc-4c50-9543-b9655885b533 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:37.651712 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7d7be1a4-50bc-4c50-9543-b9655885b533 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:51:37.660152 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7d7be1a4-50bc-4c50-9543-b9655885b533 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1" status: 200 len: 1390 microversion: 2.1 time: 0.163597 Oct 17 14:51:37.660745 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3665/7195] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:51:37 2022] GET /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1 => generated 1390 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:51:38.687985 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ae0e7f0a-2c4d-4110-8edd-082dc97fa8b5 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:51:38.689093 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ae0e7f0a-2c4d-4110-8edd-082dc97fa8b5 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 63d70072-e811-4d3c-a87e-2ad9d70c34e1] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:51:38.700843 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae0e7f0a-2c4d-4110-8edd-082dc97fa8b5 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:38.701672 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae0e7f0a-2c4d-4110-8edd-082dc97fa8b5 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:38.702562 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae0e7f0a-2c4d-4110-8edd-082dc97fa8b5 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:38.703935 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae0e7f0a-2c4d-4110-8edd-082dc97fa8b5 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:38.704421 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae0e7f0a-2c4d-4110-8edd-082dc97fa8b5 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:38.704854 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae0e7f0a-2c4d-4110-8edd-082dc97fa8b5 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:39.153737 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ae0e7f0a-2c4d-4110-8edd-082dc97fa8b5 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:51:39.162248 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ae0e7f0a-2c4d-4110-8edd-082dc97fa8b5 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1" status: 200 len: 1390 microversion: 2.1 time: 0.481273 Oct 17 14:51:39.162829 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3531/7196] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:51:38 2022] GET /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1 => generated 1390 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:51:39.906085 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-159ac5fd-2585-42fc-8ee9-cb4dd1191e61 req-347f11af-1d96-4c87-94ac-728f7d4dbd45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63d70072-e811-4d3c-a87e-2ad9d70c34e1", "name": "network-vif-plugged", "status": "completed", "tag": "dc1445b7-dc52-4a58-9b83-2285ec4ac998"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:51:39.917957 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-159ac5fd-2585-42fc-8ee9-cb4dd1191e61 req-347f11af-1d96-4c87-94ac-728f7d4dbd45 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:39.918166 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-159ac5fd-2585-42fc-8ee9-cb4dd1191e61 req-347f11af-1d96-4c87-94ac-728f7d4dbd45 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:39.918576 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-159ac5fd-2585-42fc-8ee9-cb4dd1191e61 req-347f11af-1d96-4c87-94ac-728f7d4dbd45 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:39.931927 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-159ac5fd-2585-42fc-8ee9-cb4dd1191e61 req-347f11af-1d96-4c87-94ac-728f7d4dbd45 service nova] Creating event network-vif-plugged:dc1445b7-dc52-4a58-9b83-2285ec4ac998 for instance 63d70072-e811-4d3c-a87e-2ad9d70c34e1 on n-h1-854247-14 Oct 17 14:51:39.937476 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-159ac5fd-2585-42fc-8ee9-cb4dd1191e61 req-347f11af-1d96-4c87-94ac-728f7d4dbd45 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035525 Oct 17 14:51:39.938091 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3666/7197] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:51:40.185918 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-29a2b017-49fd-4749-8abb-94c366c3c409 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:51:40.186508 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-29a2b017-49fd-4749-8abb-94c366c3c409 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 63d70072-e811-4d3c-a87e-2ad9d70c34e1] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:51:40.195130 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-29a2b017-49fd-4749-8abb-94c366c3c409 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:40.195675 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-29a2b017-49fd-4749-8abb-94c366c3c409 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:40.196127 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-29a2b017-49fd-4749-8abb-94c366c3c409 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:40.196852 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-29a2b017-49fd-4749-8abb-94c366c3c409 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:40.197326 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-29a2b017-49fd-4749-8abb-94c366c3c409 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:40.197767 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-29a2b017-49fd-4749-8abb-94c366c3c409 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:40.338047 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-29a2b017-49fd-4749-8abb-94c366c3c409 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:51:40.346148 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-29a2b017-49fd-4749-8abb-94c366c3c409 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1" status: 200 len: 1390 microversion: 2.1 time: 0.164486 Oct 17 14:51:40.346770 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3532/7198] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:51:40 2022] GET /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1 => generated 1390 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:51:41.376328 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-79754cb5-aef8-47cf-a7f1-f68284d35bef tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:51:41.376958 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-79754cb5-aef8-47cf-a7f1-f68284d35bef tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 63d70072-e811-4d3c-a87e-2ad9d70c34e1] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:51:41.383795 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-79754cb5-aef8-47cf-a7f1-f68284d35bef tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:41.384301 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-79754cb5-aef8-47cf-a7f1-f68284d35bef tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:41.384736 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-79754cb5-aef8-47cf-a7f1-f68284d35bef tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:41.385430 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-79754cb5-aef8-47cf-a7f1-f68284d35bef tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:41.385882 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-79754cb5-aef8-47cf-a7f1-f68284d35bef tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:41.386307 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-79754cb5-aef8-47cf-a7f1-f68284d35bef tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:41.526952 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-79754cb5-aef8-47cf-a7f1-f68284d35bef tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:51:41.535156 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-79754cb5-aef8-47cf-a7f1-f68284d35bef tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1" status: 200 len: 1561 microversion: 2.1 time: 0.168015 Oct 17 14:51:41.535790 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3667/7199] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:51:41 2022] GET /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1 => generated 1561 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:51:41.566126 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-73bac184-d07b-4336-9215-375a8a13b564 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:51:41.566855 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-73bac184-d07b-4336-9215-375a8a13b564 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 63d70072-e811-4d3c-a87e-2ad9d70c34e1] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:51:41.571093 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:51:41.572048 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=6 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:51:41.572834 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:51:41.580948 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-73bac184-d07b-4336-9215-375a8a13b564 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:41.581445 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-73bac184-d07b-4336-9215-375a8a13b564 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:41.581894 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-73bac184-d07b-4336-9215-375a8a13b564 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:41.582605 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-73bac184-d07b-4336-9215-375a8a13b564 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:41.583064 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-73bac184-d07b-4336-9215-375a8a13b564 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:41.583526 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-73bac184-d07b-4336-9215-375a8a13b564 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:41.737325 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-73bac184-d07b-4336-9215-375a8a13b564 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:51:41.750081 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-73bac184-d07b-4336-9215-375a8a13b564 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1" status: 200 len: 1561 microversion: 2.1 time: 0.190163 Oct 17 14:51:41.751021 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3533/7200] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:51:41 2022] GET /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1 => generated 1561 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:51:43.801991 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4c2d7a04-786b-4020-ba2c-0621708e2431 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:51:43.803206 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4c2d7a04-786b-4020-ba2c-0621708e2431 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 63d70072-e811-4d3c-a87e-2ad9d70c34e1] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:51:43.804513 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-484acba2-5fa9-4edd-be42-0351e3d58d67 req-512d9864-abbe-4b05-8ff3-f900915f9f34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63d70072-e811-4d3c-a87e-2ad9d70c34e1", "tag": "dc1445b7-dc52-4a58-9b83-2285ec4ac998"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:51:43.806471 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=6 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:51:43.812781 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4c2d7a04-786b-4020-ba2c-0621708e2431 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:43.813263 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4c2d7a04-786b-4020-ba2c-0621708e2431 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:43.813785 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4c2d7a04-786b-4020-ba2c-0621708e2431 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:43.814500 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4c2d7a04-786b-4020-ba2c-0621708e2431 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:43.814994 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4c2d7a04-786b-4020-ba2c-0621708e2431 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:43.815395 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4c2d7a04-786b-4020-ba2c-0621708e2431 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:43.818140 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-484acba2-5fa9-4edd-be42-0351e3d58d67 req-512d9864-abbe-4b05-8ff3-f900915f9f34 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:43.818778 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-484acba2-5fa9-4edd-be42-0351e3d58d67 req-512d9864-abbe-4b05-8ff3-f900915f9f34 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:43.819396 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-484acba2-5fa9-4edd-be42-0351e3d58d67 req-512d9864-abbe-4b05-8ff3-f900915f9f34 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:43.831817 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-484acba2-5fa9-4edd-be42-0351e3d58d67 req-512d9864-abbe-4b05-8ff3-f900915f9f34 service nova] Creating event network-changed:dc1445b7-dc52-4a58-9b83-2285ec4ac998 for instance 63d70072-e811-4d3c-a87e-2ad9d70c34e1 on n-h1-854247-14 Oct 17 14:51:43.840349 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-484acba2-5fa9-4edd-be42-0351e3d58d67 req-512d9864-abbe-4b05-8ff3-f900915f9f34 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038277 Oct 17 14:51:43.843555 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3534/7201] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:51:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:51:43.987208 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4c2d7a04-786b-4020-ba2c-0621708e2431 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:51:44.003453 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4c2d7a04-786b-4020-ba2c-0621708e2431 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1" status: 200 len: 1561 microversion: 2.1 time: 0.205323 Oct 17 14:51:44.004522 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3668/7202] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:51:43 2022] GET /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1 => generated 1561 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:52:05.300491 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=3 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:52:05.301237 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=36 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:52:05.350060 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ac787846-d36e-4ddc-99f2-e860d43f1d0a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:52:05.352623 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ac787846-d36e-4ddc-99f2-e860d43f1d0a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 63d70072-e811-4d3c-a87e-2ad9d70c34e1] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:52:05.359280 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac787846-d36e-4ddc-99f2-e860d43f1d0a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:52:05.361660 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac787846-d36e-4ddc-99f2-e860d43f1d0a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:52:05.361660 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac787846-d36e-4ddc-99f2-e860d43f1d0a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:52:05.361660 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac787846-d36e-4ddc-99f2-e860d43f1d0a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:52:05.361660 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac787846-d36e-4ddc-99f2-e860d43f1d0a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:52:05.362408 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ac787846-d36e-4ddc-99f2-e860d43f1d0a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:52:05.424749 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ac787846-d36e-4ddc-99f2-e860d43f1d0a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "POST /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1/action" status: 200 len: 24568 microversion: 2.1 time: 0.129772 Oct 17 14:52:05.425417 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3535/7203] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:52:05 2022] POST /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1/action => generated 24568 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:52:16.520411 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:52:16.521276 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=32 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:52:16.525716 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5a1c0112-31b1-4371-8580-6512deba32a2 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:52:16.534631 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5a1c0112-31b1-4371-8580-6512deba32a2 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:52:16.535142 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5a1c0112-31b1-4371-8580-6512deba32a2 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:52:16.535654 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5a1c0112-31b1-4371-8580-6512deba32a2 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:52:16.564362 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5a1c0112-31b1-4371-8580-6512deba32a2 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 63d70072-e811-4d3c-a87e-2ad9d70c34e1] Going to try to stop instance {{(pid=127016) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 17 14:52:16.614748 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5a1c0112-31b1-4371-8580-6512deba32a2 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "POST /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1/action" status: 202 len: 0 microversion: 2.1 time: 0.096039 Oct 17 14:52:16.615533 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3669/7204] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:52:16 2022] POST /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:52:16.627116 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d0d6aa42-38e1-422d-8a77-31a98336ef0f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:52:16.628267 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d0d6aa42-38e1-422d-8a77-31a98336ef0f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 63d70072-e811-4d3c-a87e-2ad9d70c34e1] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:52:16.631778 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:52:16.632719 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=4 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:52:16.642387 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d0d6aa42-38e1-422d-8a77-31a98336ef0f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:52:16.642959 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d0d6aa42-38e1-422d-8a77-31a98336ef0f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:52:16.643637 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d0d6aa42-38e1-422d-8a77-31a98336ef0f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:52:16.644574 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d0d6aa42-38e1-422d-8a77-31a98336ef0f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:52:16.645121 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d0d6aa42-38e1-422d-8a77-31a98336ef0f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:52:16.645696 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d0d6aa42-38e1-422d-8a77-31a98336ef0f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:52:16.799070 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d0d6aa42-38e1-422d-8a77-31a98336ef0f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:52:16.807738 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d0d6aa42-38e1-422d-8a77-31a98336ef0f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1" status: 200 len: 1689 microversion: 2.1 time: 0.186622 Oct 17 14:52:16.808316 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3536/7205] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:52:16 2022] GET /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1 => generated 1689 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:52:17.835301 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d3766247-72a4-4d50-aabf-11a7bb12f368 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:52:17.836040 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d3766247-72a4-4d50-aabf-11a7bb12f368 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 63d70072-e811-4d3c-a87e-2ad9d70c34e1] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:52:17.843895 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d3766247-72a4-4d50-aabf-11a7bb12f368 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:52:17.844373 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d3766247-72a4-4d50-aabf-11a7bb12f368 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:52:17.844815 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d3766247-72a4-4d50-aabf-11a7bb12f368 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:52:17.845530 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d3766247-72a4-4d50-aabf-11a7bb12f368 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:52:17.845985 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d3766247-72a4-4d50-aabf-11a7bb12f368 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:52:17.846404 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d3766247-72a4-4d50-aabf-11a7bb12f368 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:52:17.989493 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d3766247-72a4-4d50-aabf-11a7bb12f368 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:52:17.998129 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d3766247-72a4-4d50-aabf-11a7bb12f368 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1" status: 200 len: 1689 microversion: 2.1 time: 0.167344 Oct 17 14:52:17.998736 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3670/7206] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:52:17 2022] GET /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1 => generated 1689 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:52:19.022639 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-26564d10-0786-4f24-8c93-503b2f8ab30a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:52:19.023317 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-26564d10-0786-4f24-8c93-503b2f8ab30a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 63d70072-e811-4d3c-a87e-2ad9d70c34e1] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:52:19.031047 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-26564d10-0786-4f24-8c93-503b2f8ab30a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:52:19.031579 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-26564d10-0786-4f24-8c93-503b2f8ab30a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:52:19.032033 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-26564d10-0786-4f24-8c93-503b2f8ab30a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:52:19.032756 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-26564d10-0786-4f24-8c93-503b2f8ab30a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:52:19.033348 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-26564d10-0786-4f24-8c93-503b2f8ab30a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:52:19.033703 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-26564d10-0786-4f24-8c93-503b2f8ab30a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:52:19.178603 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-26564d10-0786-4f24-8c93-503b2f8ab30a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:52:19.187290 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-26564d10-0786-4f24-8c93-503b2f8ab30a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1" status: 200 len: 1689 microversion: 2.1 time: 0.168769 Oct 17 14:52:19.187913 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3537/7207] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:52:19 2022] GET /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1 => generated 1689 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:52:20.216595 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d7b3a68b-0a45-4225-b8a9-cbe29d77be5f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:52:20.217342 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d7b3a68b-0a45-4225-b8a9-cbe29d77be5f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 63d70072-e811-4d3c-a87e-2ad9d70c34e1] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:52:20.225488 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d7b3a68b-0a45-4225-b8a9-cbe29d77be5f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:52:20.225969 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d7b3a68b-0a45-4225-b8a9-cbe29d77be5f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:52:20.226397 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d7b3a68b-0a45-4225-b8a9-cbe29d77be5f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:52:20.227099 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d7b3a68b-0a45-4225-b8a9-cbe29d77be5f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:52:20.227578 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d7b3a68b-0a45-4225-b8a9-cbe29d77be5f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:52:20.227993 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d7b3a68b-0a45-4225-b8a9-cbe29d77be5f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:52:20.374316 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d7b3a68b-0a45-4225-b8a9-cbe29d77be5f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:52:20.382577 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d7b3a68b-0a45-4225-b8a9-cbe29d77be5f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1" status: 200 len: 1689 microversion: 2.1 time: 0.169946 Oct 17 14:52:20.383194 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3671/7208] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:52:20 2022] GET /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1 => generated 1689 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:52:21.407313 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ae19fac9-e89d-4116-b24a-25d1bbc18a4a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:52:21.407962 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ae19fac9-e89d-4116-b24a-25d1bbc18a4a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 63d70072-e811-4d3c-a87e-2ad9d70c34e1] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:52:21.415457 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae19fac9-e89d-4116-b24a-25d1bbc18a4a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:52:21.415973 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae19fac9-e89d-4116-b24a-25d1bbc18a4a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:52:21.416414 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae19fac9-e89d-4116-b24a-25d1bbc18a4a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:52:21.417114 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae19fac9-e89d-4116-b24a-25d1bbc18a4a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:52:21.417577 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae19fac9-e89d-4116-b24a-25d1bbc18a4a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:52:21.418019 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ae19fac9-e89d-4116-b24a-25d1bbc18a4a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:52:21.564402 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ae19fac9-e89d-4116-b24a-25d1bbc18a4a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:52:21.577168 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ae19fac9-e89d-4116-b24a-25d1bbc18a4a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1" status: 200 len: 1689 microversion: 2.1 time: 0.174019 Oct 17 14:52:21.578379 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3538/7209] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:52:21 2022] GET /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1 => generated 1689 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:52:22.602423 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9b34e382-b9a6-4630-a8ae-c615c4321c75 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:52:22.603066 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9b34e382-b9a6-4630-a8ae-c615c4321c75 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 63d70072-e811-4d3c-a87e-2ad9d70c34e1] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:52:22.610607 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9b34e382-b9a6-4630-a8ae-c615c4321c75 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:52:22.611104 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9b34e382-b9a6-4630-a8ae-c615c4321c75 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:52:22.611569 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9b34e382-b9a6-4630-a8ae-c615c4321c75 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:52:22.612291 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9b34e382-b9a6-4630-a8ae-c615c4321c75 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:52:22.612813 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9b34e382-b9a6-4630-a8ae-c615c4321c75 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:52:22.613243 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9b34e382-b9a6-4630-a8ae-c615c4321c75 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:52:22.757747 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9b34e382-b9a6-4630-a8ae-c615c4321c75 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:52:22.766388 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9b34e382-b9a6-4630-a8ae-c615c4321c75 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1" status: 200 len: 1689 microversion: 2.1 time: 0.167966 Oct 17 14:52:22.766982 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3672/7210] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:52:22 2022] GET /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1 => generated 1689 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:52:23.790268 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2ecc91ce-08c8-4e6a-a5fd-c312e386455b tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:52:23.790902 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2ecc91ce-08c8-4e6a-a5fd-c312e386455b tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 63d70072-e811-4d3c-a87e-2ad9d70c34e1] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:52:23.798649 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2ecc91ce-08c8-4e6a-a5fd-c312e386455b tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:52:23.799156 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2ecc91ce-08c8-4e6a-a5fd-c312e386455b tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:52:23.799636 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2ecc91ce-08c8-4e6a-a5fd-c312e386455b tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:52:23.800357 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2ecc91ce-08c8-4e6a-a5fd-c312e386455b tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:52:23.800817 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2ecc91ce-08c8-4e6a-a5fd-c312e386455b tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:52:23.801255 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2ecc91ce-08c8-4e6a-a5fd-c312e386455b tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:52:23.948612 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2ecc91ce-08c8-4e6a-a5fd-c312e386455b tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:52:23.957809 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2ecc91ce-08c8-4e6a-a5fd-c312e386455b tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1" status: 200 len: 1689 microversion: 2.1 time: 0.171536 Oct 17 14:52:23.958380 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3539/7211] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:52:23 2022] GET /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1 => generated 1689 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:52:24.981784 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9c39dd8e-5782-4a2f-a323-d2f254269657 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:52:24.982410 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9c39dd8e-5782-4a2f-a323-d2f254269657 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 63d70072-e811-4d3c-a87e-2ad9d70c34e1] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:52:24.990758 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c39dd8e-5782-4a2f-a323-d2f254269657 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:52:24.991286 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c39dd8e-5782-4a2f-a323-d2f254269657 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:52:24.991749 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c39dd8e-5782-4a2f-a323-d2f254269657 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:52:24.992821 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c39dd8e-5782-4a2f-a323-d2f254269657 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:52:24.993289 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c39dd8e-5782-4a2f-a323-d2f254269657 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:52:24.993685 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9c39dd8e-5782-4a2f-a323-d2f254269657 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:52:25.140425 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9c39dd8e-5782-4a2f-a323-d2f254269657 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:52:25.149705 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9c39dd8e-5782-4a2f-a323-d2f254269657 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1" status: 200 len: 1689 microversion: 2.1 time: 0.171827 Oct 17 14:52:25.150301 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3673/7212] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:52:24 2022] GET /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1 => generated 1689 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:52:26.174931 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-41be1eda-431c-4a85-ac3b-6b7ac2d2f827 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:52:26.175613 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-41be1eda-431c-4a85-ac3b-6b7ac2d2f827 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 63d70072-e811-4d3c-a87e-2ad9d70c34e1] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:52:26.183041 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-41be1eda-431c-4a85-ac3b-6b7ac2d2f827 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:52:26.183580 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-41be1eda-431c-4a85-ac3b-6b7ac2d2f827 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:52:26.184028 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-41be1eda-431c-4a85-ac3b-6b7ac2d2f827 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:52:26.184762 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-41be1eda-431c-4a85-ac3b-6b7ac2d2f827 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:52:26.185224 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-41be1eda-431c-4a85-ac3b-6b7ac2d2f827 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:52:26.185660 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-41be1eda-431c-4a85-ac3b-6b7ac2d2f827 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:52:26.331826 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-41be1eda-431c-4a85-ac3b-6b7ac2d2f827 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:52:26.340214 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-41be1eda-431c-4a85-ac3b-6b7ac2d2f827 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1" status: 200 len: 1689 microversion: 2.1 time: 0.170060 Oct 17 14:52:26.340803 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3540/7213] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:52:26 2022] GET /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1 => generated 1689 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:52:27.366009 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-59f5e67d-ca92-4da2-847a-5032687ae378 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:52:27.366694 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-59f5e67d-ca92-4da2-847a-5032687ae378 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 63d70072-e811-4d3c-a87e-2ad9d70c34e1] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:52:27.375451 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-59f5e67d-ca92-4da2-847a-5032687ae378 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:52:27.375940 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-59f5e67d-ca92-4da2-847a-5032687ae378 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:52:27.376383 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-59f5e67d-ca92-4da2-847a-5032687ae378 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:52:27.377137 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-59f5e67d-ca92-4da2-847a-5032687ae378 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:52:27.377838 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-59f5e67d-ca92-4da2-847a-5032687ae378 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:52:27.378220 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-59f5e67d-ca92-4da2-847a-5032687ae378 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:52:27.537430 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-59f5e67d-ca92-4da2-847a-5032687ae378 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:52:27.547497 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-59f5e67d-ca92-4da2-847a-5032687ae378 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1" status: 200 len: 1689 microversion: 2.1 time: 0.185191 Oct 17 14:52:27.548105 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3674/7214] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:52:27 2022] GET /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1 => generated 1689 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:52:28.576316 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b797fe4b-26c6-40d9-b2ab-073d7c5da7a3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:52:28.576924 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b797fe4b-26c6-40d9-b2ab-073d7c5da7a3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 63d70072-e811-4d3c-a87e-2ad9d70c34e1] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:52:28.584719 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b797fe4b-26c6-40d9-b2ab-073d7c5da7a3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:52:28.585254 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b797fe4b-26c6-40d9-b2ab-073d7c5da7a3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:52:28.585739 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b797fe4b-26c6-40d9-b2ab-073d7c5da7a3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:52:28.586481 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b797fe4b-26c6-40d9-b2ab-073d7c5da7a3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:52:28.586954 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b797fe4b-26c6-40d9-b2ab-073d7c5da7a3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:52:28.587484 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b797fe4b-26c6-40d9-b2ab-073d7c5da7a3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:52:28.737426 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b797fe4b-26c6-40d9-b2ab-073d7c5da7a3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:52:28.746099 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b797fe4b-26c6-40d9-b2ab-073d7c5da7a3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1" status: 200 len: 1689 microversion: 2.1 time: 0.173893 Oct 17 14:52:28.746682 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3541/7215] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:52:28 2022] GET /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1 => generated 1689 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:52:29.777808 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4039b54d-c4b9-4a0e-b94c-e3417819f8ed tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:52:29.778840 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4039b54d-c4b9-4a0e-b94c-e3417819f8ed tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 63d70072-e811-4d3c-a87e-2ad9d70c34e1] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:52:29.787014 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4039b54d-c4b9-4a0e-b94c-e3417819f8ed tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:52:29.787642 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4039b54d-c4b9-4a0e-b94c-e3417819f8ed tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:52:29.788133 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4039b54d-c4b9-4a0e-b94c-e3417819f8ed tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:52:29.788964 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4039b54d-c4b9-4a0e-b94c-e3417819f8ed tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:52:29.789513 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4039b54d-c4b9-4a0e-b94c-e3417819f8ed tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:52:29.789974 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4039b54d-c4b9-4a0e-b94c-e3417819f8ed tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:52:29.945789 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4039b54d-c4b9-4a0e-b94c-e3417819f8ed tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:52:29.954216 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4039b54d-c4b9-4a0e-b94c-e3417819f8ed tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1" status: 200 len: 1689 microversion: 2.1 time: 0.187126 Oct 17 14:52:29.954817 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3675/7216] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:52:29 2022] GET /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1 => generated 1689 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:52:30.980719 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-32d9261d-1c47-4cea-b9a7-df569c3b7087 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:52:30.981907 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-32d9261d-1c47-4cea-b9a7-df569c3b7087 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 63d70072-e811-4d3c-a87e-2ad9d70c34e1] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:52:30.991359 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-32d9261d-1c47-4cea-b9a7-df569c3b7087 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:52:30.991873 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-32d9261d-1c47-4cea-b9a7-df569c3b7087 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:52:30.992781 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-32d9261d-1c47-4cea-b9a7-df569c3b7087 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:52:30.993425 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-32d9261d-1c47-4cea-b9a7-df569c3b7087 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:52:30.993903 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-32d9261d-1c47-4cea-b9a7-df569c3b7087 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:52:30.994342 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-32d9261d-1c47-4cea-b9a7-df569c3b7087 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:52:31.144206 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-32d9261d-1c47-4cea-b9a7-df569c3b7087 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:52:31.153489 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-32d9261d-1c47-4cea-b9a7-df569c3b7087 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1" status: 200 len: 1689 microversion: 2.1 time: 0.179137 Oct 17 14:52:31.154105 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3542/7217] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:52:30 2022] GET /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1 => generated 1689 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:52:32.180167 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-01388b8a-1f70-4094-9137-03d1ed12aa00 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:52:32.180795 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-01388b8a-1f70-4094-9137-03d1ed12aa00 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 63d70072-e811-4d3c-a87e-2ad9d70c34e1] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:52:32.188275 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-01388b8a-1f70-4094-9137-03d1ed12aa00 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:52:32.188756 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-01388b8a-1f70-4094-9137-03d1ed12aa00 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:52:32.189196 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-01388b8a-1f70-4094-9137-03d1ed12aa00 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:52:32.189913 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-01388b8a-1f70-4094-9137-03d1ed12aa00 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:52:32.190365 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-01388b8a-1f70-4094-9137-03d1ed12aa00 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:52:32.190786 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-01388b8a-1f70-4094-9137-03d1ed12aa00 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:52:32.333144 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-01388b8a-1f70-4094-9137-03d1ed12aa00 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:52:32.341891 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-01388b8a-1f70-4094-9137-03d1ed12aa00 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1" status: 200 len: 1666 microversion: 2.1 time: 0.166235 Oct 17 14:52:32.342453 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3676/7218] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:52:32 2022] GET /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1 => generated 1666 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:52:33.443662 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-48e01ba7-5647-489b-ad9e-0c799d89a055 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:52:33.446054 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-48e01ba7-5647-489b-ad9e-0c799d89a055 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 63d70072-e811-4d3c-a87e-2ad9d70c34e1] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:52:33.453733 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48e01ba7-5647-489b-ad9e-0c799d89a055 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:52:33.454215 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48e01ba7-5647-489b-ad9e-0c799d89a055 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:52:33.454662 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48e01ba7-5647-489b-ad9e-0c799d89a055 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:52:33.455422 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48e01ba7-5647-489b-ad9e-0c799d89a055 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:52:33.455887 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48e01ba7-5647-489b-ad9e-0c799d89a055 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:52:33.456321 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-48e01ba7-5647-489b-ad9e-0c799d89a055 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:52:33.516034 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-48e01ba7-5647-489b-ad9e-0c799d89a055 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "POST /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1/action" status: 200 len: 38426 microversion: 2.1 time: 0.076217 Oct 17 14:52:33.516780 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3543/7219] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:52:33 2022] POST /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1/action => generated 38426 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:52:33.529265 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4fa52745-3f78-4a3c-aec2-958084200803 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:52:33.538332 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4fa52745-3f78-4a3c-aec2-958084200803 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:52:33.538816 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4fa52745-3f78-4a3c-aec2-958084200803 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:52:33.539258 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4fa52745-3f78-4a3c-aec2-958084200803 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:52:33.566237 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4fa52745-3f78-4a3c-aec2-958084200803 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 63d70072-e811-4d3c-a87e-2ad9d70c34e1] Going to try to start instance {{(pid=127016) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 17 14:52:33.613984 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4fa52745-3f78-4a3c-aec2-958084200803 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "POST /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1/action" status: 202 len: 0 microversion: 2.1 time: 0.088556 Oct 17 14:52:33.614656 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3677/7220] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:52:33 2022] POST /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:52:33.625172 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a96341e1-7b62-4fc9-813c-6daabc197b8b tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:52:33.626016 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a96341e1-7b62-4fc9-813c-6daabc197b8b tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 63d70072-e811-4d3c-a87e-2ad9d70c34e1] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:52:33.633679 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a96341e1-7b62-4fc9-813c-6daabc197b8b tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:52:33.634251 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a96341e1-7b62-4fc9-813c-6daabc197b8b tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:52:33.634696 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a96341e1-7b62-4fc9-813c-6daabc197b8b tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:52:33.635456 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a96341e1-7b62-4fc9-813c-6daabc197b8b tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:52:33.635916 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a96341e1-7b62-4fc9-813c-6daabc197b8b tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:52:33.636378 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a96341e1-7b62-4fc9-813c-6daabc197b8b tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:52:33.781922 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a96341e1-7b62-4fc9-813c-6daabc197b8b tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:52:33.791331 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a96341e1-7b62-4fc9-813c-6daabc197b8b tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1" status: 200 len: 1675 microversion: 2.1 time: 0.170327 Oct 17 14:52:33.792269 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3544/7221] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:52:33 2022] GET /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1 => generated 1675 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:52:34.818334 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4f6f8475-79c8-41e1-8755-57d9dbb15594 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:52:34.819264 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4f6f8475-79c8-41e1-8755-57d9dbb15594 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 63d70072-e811-4d3c-a87e-2ad9d70c34e1] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:52:34.827689 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4f6f8475-79c8-41e1-8755-57d9dbb15594 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:52:34.828254 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4f6f8475-79c8-41e1-8755-57d9dbb15594 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:52:34.828697 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4f6f8475-79c8-41e1-8755-57d9dbb15594 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:52:34.829456 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4f6f8475-79c8-41e1-8755-57d9dbb15594 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:52:34.829911 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4f6f8475-79c8-41e1-8755-57d9dbb15594 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:52:34.830340 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4f6f8475-79c8-41e1-8755-57d9dbb15594 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:52:34.978545 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4f6f8475-79c8-41e1-8755-57d9dbb15594 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:52:34.987878 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4f6f8475-79c8-41e1-8755-57d9dbb15594 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1" status: 200 len: 1679 microversion: 2.1 time: 0.175205 Oct 17 14:52:34.988477 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3678/7222] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:52:34 2022] GET /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1 => generated 1679 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:52:59.188339 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e5bbbfcb-535f-416b-bcff-f9ff8f3a44a4 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:52:59.190679 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e5bbbfcb-535f-416b-bcff-f9ff8f3a44a4 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 63d70072-e811-4d3c-a87e-2ad9d70c34e1] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:52:59.193601 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=18 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:52:59.194274 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=52 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:52:59.200352 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e5bbbfcb-535f-416b-bcff-f9ff8f3a44a4 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:52:59.200869 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e5bbbfcb-535f-416b-bcff-f9ff8f3a44a4 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:52:59.201298 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e5bbbfcb-535f-416b-bcff-f9ff8f3a44a4 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:52:59.202019 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e5bbbfcb-535f-416b-bcff-f9ff8f3a44a4 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:52:59.202477 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e5bbbfcb-535f-416b-bcff-f9ff8f3a44a4 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:52:59.202984 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e5bbbfcb-535f-416b-bcff-f9ff8f3a44a4 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:52:59.263027 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e5bbbfcb-535f-416b-bcff-f9ff8f3a44a4 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "POST /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1/action" status: 200 len: 62985 microversion: 2.1 time: 0.078768 Oct 17 14:52:59.263898 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3545/7223] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:52:59 2022] POST /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1/action => generated 62985 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:53:06.547788 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a12f497c-edee-4a03-bfa0-74ad2af07c0a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:53:06.548399 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a12f497c-edee-4a03-bfa0-74ad2af07c0a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 63d70072-e811-4d3c-a87e-2ad9d70c34e1] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:53:06.553091 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=20 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:53:06.553523 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:53:06.560810 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a12f497c-edee-4a03-bfa0-74ad2af07c0a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:53:06.561660 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a12f497c-edee-4a03-bfa0-74ad2af07c0a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:53:06.562310 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a12f497c-edee-4a03-bfa0-74ad2af07c0a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:53:06.563055 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a12f497c-edee-4a03-bfa0-74ad2af07c0a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:53:06.563555 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a12f497c-edee-4a03-bfa0-74ad2af07c0a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:53:06.563985 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a12f497c-edee-4a03-bfa0-74ad2af07c0a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:53:06.593665 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a12f497c-edee-4a03-bfa0-74ad2af07c0a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 63d70072-e811-4d3c-a87e-2ad9d70c34e1] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:53:06.615539 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-e13d0240-e868-4596-a138-e9a966b75d50 req-2a3a2c54-1b22-4098-9959-79662c148a77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63d70072-e811-4d3c-a87e-2ad9d70c34e1", "tag": "dc1445b7-dc52-4a58-9b83-2285ec4ac998"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:53:06.628396 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-e13d0240-e868-4596-a138-e9a966b75d50 req-2a3a2c54-1b22-4098-9959-79662c148a77 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:53:06.628891 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-e13d0240-e868-4596-a138-e9a966b75d50 req-2a3a2c54-1b22-4098-9959-79662c148a77 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:53:06.629336 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-e13d0240-e868-4596-a138-e9a966b75d50 req-2a3a2c54-1b22-4098-9959-79662c148a77 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:53:06.646140 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-e13d0240-e868-4596-a138-e9a966b75d50 req-2a3a2c54-1b22-4098-9959-79662c148a77 service nova] Creating event network-changed:dc1445b7-dc52-4a58-9b83-2285ec4ac998 for instance 63d70072-e811-4d3c-a87e-2ad9d70c34e1 on n-h1-854247-14 Oct 17 14:53:06.652870 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-e13d0240-e868-4596-a138-e9a966b75d50 req-2a3a2c54-1b22-4098-9959-79662c148a77 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105387 Oct 17 14:53:06.653849 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3546/7224] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:53:06.697182 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a12f497c-edee-4a03-bfa0-74ad2af07c0a tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "DELETE /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1" status: 204 len: 0 microversion: 2.1 time: 0.153327 Oct 17 14:53:06.698012 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3679/7225] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:53:06 2022] DELETE /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:53:06.707784 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-62874dc0-c0ae-4707-ab8f-8993e34976c8 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:53:06.707784 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-62874dc0-c0ae-4707-ab8f-8993e34976c8 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 63d70072-e811-4d3c-a87e-2ad9d70c34e1] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:53:06.715134 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-62874dc0-c0ae-4707-ab8f-8993e34976c8 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:53:06.715960 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-62874dc0-c0ae-4707-ab8f-8993e34976c8 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:53:06.716751 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-62874dc0-c0ae-4707-ab8f-8993e34976c8 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:53:06.719733 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-62874dc0-c0ae-4707-ab8f-8993e34976c8 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:53:06.719733 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-62874dc0-c0ae-4707-ab8f-8993e34976c8 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:53:06.719733 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-62874dc0-c0ae-4707-ab8f-8993e34976c8 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:53:06.869690 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-62874dc0-c0ae-4707-ab8f-8993e34976c8 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:53:06.878303 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-62874dc0-c0ae-4707-ab8f-8993e34976c8 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1" status: 200 len: 1685 microversion: 2.1 time: 0.175793 Oct 17 14:53:06.878923 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3547/7226] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:53:06 2022] GET /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1 => generated 1685 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:53:07.902978 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-94e376a1-3222-416b-9a57-f8faf84320be tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:53:07.903734 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-94e376a1-3222-416b-9a57-f8faf84320be tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 63d70072-e811-4d3c-a87e-2ad9d70c34e1] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:53:07.912010 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94e376a1-3222-416b-9a57-f8faf84320be tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:53:07.912693 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94e376a1-3222-416b-9a57-f8faf84320be tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:53:07.913869 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94e376a1-3222-416b-9a57-f8faf84320be tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:53:07.914595 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94e376a1-3222-416b-9a57-f8faf84320be tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:53:07.915079 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94e376a1-3222-416b-9a57-f8faf84320be tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:53:07.915525 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94e376a1-3222-416b-9a57-f8faf84320be tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:53:08.061565 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-94e376a1-3222-416b-9a57-f8faf84320be tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:53:08.070236 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-94e376a1-3222-416b-9a57-f8faf84320be tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1" status: 200 len: 1685 microversion: 2.1 time: 0.171644 Oct 17 14:53:08.070829 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3680/7227] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:53:07 2022] GET /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1 => generated 1685 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:53:08.648445 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-57d0322e-ebbf-466a-b203-456c0dd47f72 req-257ce202-bb5d-4734-9bc2-9b7930bbe00e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63d70072-e811-4d3c-a87e-2ad9d70c34e1", "name": "network-vif-deleted", "tag": "dc1445b7-dc52-4a58-9b83-2285ec4ac998"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:53:08.659997 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-57d0322e-ebbf-466a-b203-456c0dd47f72 req-257ce202-bb5d-4734-9bc2-9b7930bbe00e service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:53:08.660580 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-57d0322e-ebbf-466a-b203-456c0dd47f72 req-257ce202-bb5d-4734-9bc2-9b7930bbe00e service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:53:08.661389 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-57d0322e-ebbf-466a-b203-456c0dd47f72 req-257ce202-bb5d-4734-9bc2-9b7930bbe00e service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:53:08.674187 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-57d0322e-ebbf-466a-b203-456c0dd47f72 req-257ce202-bb5d-4734-9bc2-9b7930bbe00e service nova] Creating event network-vif-deleted:dc1445b7-dc52-4a58-9b83-2285ec4ac998 for instance 63d70072-e811-4d3c-a87e-2ad9d70c34e1 on n-h1-854247-14 Oct 17 14:53:08.680220 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-57d0322e-ebbf-466a-b203-456c0dd47f72 req-257ce202-bb5d-4734-9bc2-9b7930bbe00e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035445 Oct 17 14:53:08.680886 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3548/7228] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:53:09.096869 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8025873d-a0d1-4cc2-b334-b3c5d27749eb tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:53:09.098244 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8025873d-a0d1-4cc2-b334-b3c5d27749eb tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 63d70072-e811-4d3c-a87e-2ad9d70c34e1] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:53:09.108339 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8025873d-a0d1-4cc2-b334-b3c5d27749eb tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:53:09.108830 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8025873d-a0d1-4cc2-b334-b3c5d27749eb tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:53:09.109240 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8025873d-a0d1-4cc2-b334-b3c5d27749eb tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:53:09.109956 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8025873d-a0d1-4cc2-b334-b3c5d27749eb tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:53:09.110436 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8025873d-a0d1-4cc2-b334-b3c5d27749eb tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:53:09.110864 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8025873d-a0d1-4cc2-b334-b3c5d27749eb tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:53:09.149725 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8025873d-a0d1-4cc2-b334-b3c5d27749eb tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:53:09.150213 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8025873d-a0d1-4cc2-b334-b3c5d27749eb tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:53:09.150749 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8025873d-a0d1-4cc2-b334-b3c5d27749eb tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:53:09.151410 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-8025873d-a0d1-4cc2-b334-b3c5d27749eb tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lazy-loading 'fault' on Instance uuid 63d70072-e811-4d3c-a87e-2ad9d70c34e1 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:53:09.197623 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-8025873d-a0d1-4cc2-b334-b3c5d27749eb tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:53:09.207726 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8025873d-a0d1-4cc2-b334-b3c5d27749eb tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1" status: 200 len: 1355 microversion: 2.1 time: 0.115463 Oct 17 14:53:09.208449 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3681/7229] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:53:09 2022] GET /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1 => generated 1355 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:53:10.232999 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-680a0229-d818-4202-8e20-017f659f8184 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:53:10.233742 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-680a0229-d818-4202-8e20-017f659f8184 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 63d70072-e811-4d3c-a87e-2ad9d70c34e1] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:53:10.240916 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-680a0229-d818-4202-8e20-017f659f8184 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:53:10.241442 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-680a0229-d818-4202-8e20-017f659f8184 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:53:10.241894 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-680a0229-d818-4202-8e20-017f659f8184 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:53:10.242969 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-680a0229-d818-4202-8e20-017f659f8184 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:53:10.243467 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-680a0229-d818-4202-8e20-017f659f8184 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:53:10.243910 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-680a0229-d818-4202-8e20-017f659f8184 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:53:10.258637 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-680a0229-d818-4202-8e20-017f659f8184 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] HTTP exception thrown: Instance 63d70072-e811-4d3c-a87e-2ad9d70c34e1 could not be found. Oct 17 14:53:10.260391 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-680a0229-d818-4202-8e20-017f659f8184 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Request method failure captured: Oct 17 14:53:10.260391 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1 HTTP/1.1 Oct 17 14:53:10.260391 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 14:53:10.260391 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 14:53:10.260391 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 14:53:10.260391 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 14:53:10.260391 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 14:53:10.260391 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 14:53:10.260391 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 14:53:10.260391 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 14:53:10.260391 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTWrbJTp3_aV3rQ1sZIV-A8RhPUhGtuu3Cdy9UtPO9T2_ui3_S4_dniOOQZy69dfFzd3AdqRHxEdsaXpnKLosIkT6TOjwXy5X_JiSCvihpV_5K-xclYBmfytVuV0W0qLAfA4CBTVr0Qr1hQGpQvQysPbiqlBcm_U91Zx-5cXnnLrTX2s Oct 17 14:53:10.260391 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 14:53:10.260391 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 14:53:10.260391 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 14:53:10.260391 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 14:53:10.260391 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 14:53:10.260391 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 14:53:10.260391 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 6d8fb8c2659a43a696a0a16e7d2be378 Oct 17 14:53:10.260391 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1531965843 Oct 17 14:53:10.260391 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 14:53:10.260391 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 14:53:10.260391 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6d8fb8c2659a43a696a0a16e7d2be378"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6d8fb8c2659a43a696a0a16e7d2be378"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6d8fb8c2659a43a696a0a16e7d2be378"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6d8fb8c2659a43a696a0a16e7d2be378", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:53:10.260391 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1531965843 Oct 17 14:53:10.260391 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 6d8fb8c2659a43a696a0a16e7d2be378 Oct 17 14:53:10.260391 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1531965843 Oct 17 14:53:10.260391 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-TestNetworkAdvancedServerOps-1531965843-project Oct 17 14:53:10.260391 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 14:53:10.260391 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 14:53:10.260391 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 4805a4aa399d4d0798b6077a545a2255 Oct 17 14:53:10.260391 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1531965843-project Oct 17 14:53:10.260391 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 14:53:10.260391 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 63d70072-e811-4d3c-a87e-2ad9d70c34e1 could not be found. Oct 17 14:53:10.260391 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '63d70072-e811-4d3c-a87e-2ad9d70c34e1'} Oct 17 14:53:10.260391 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:53:10.260391 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:53:10.260391 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:53:10.260391 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:53:10.260391 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:53:10.260391 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:53:10.260391 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:53:10.260391 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:53:10.260391 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:53:10.260391 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:53:10.260391 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63d70072-e811-4d3c-a87e-2ad9d70c34e1 could not be found. Oct 17 14:53:10.260391 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:53:10.260391 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:53:10.260391 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:53:10.260391 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:53:10.260391 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:53:10.260391 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:53:10.260391 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:53:10.260391 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:53:10.260391 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:53:10.260391 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:53:10.260391 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:53:10.260391 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:53:10.260391 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:53:10.260391 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:53:10.260391 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:53:10.260391 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:53:10.260391 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63d70072-e811-4d3c-a87e-2ad9d70c34e1 could not be found. Oct 17 14:53:10.260391 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:53:10.260391 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:53:10.265844 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:53:10.265844 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:53:10.265844 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:53:10.265844 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:53:10.265844 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:53:10.265844 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:53:10.265844 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63d70072-e811-4d3c-a87e-2ad9d70c34e1 could not be found. Oct 17 14:53:10.265844 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:53:10.265844 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-680a0229-d818-4202-8e20-017f659f8184 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Returning 404 to user: Instance 63d70072-e811-4d3c-a87e-2ad9d70c34e1 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:53:10.265844 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-680a0229-d818-4202-8e20-017f659f8184 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1" status: 404 len: 111 microversion: 2.1 time: 0.034324 Oct 17 14:53:10.265844 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3549/7230] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:53:10 2022] GET /compute/v2.1/servers/63d70072-e811-4d3c-a87e-2ad9d70c34e1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:53:13.853124 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-15c02472-086c-45c5-939f-815b8716f047 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '.version_select at 0x7f7cd54a0160>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:53:13.877793 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-15c02472-086c-45c5-939f-815b8716f047 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-13190031" status: 202 len: 0 microversion: 2.1 time: 0.028866 Oct 17 14:53:13.878525 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3682/7231] 10.222.0.79 () {58 vars in 1278 bytes} [Mon Oct 17 14:53:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-13190031 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 14:53:13.910340 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f48df508-81df-4230-98d6-78ff59aa496f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Action: 'create', calling method: .version_select at 0x7f7cd4a16310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1778178300", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHea+sZVpnb+dLH27riL0CdjbKfBOV79GQn9rlCmgJjtAxRziueJyjFutyGvIgnNMgXQ4DJR8NZjlicRH00uFnBcGLraKMNSuyG4HLeLy2EmStdFoWme5vBpir1pd2U4fw=="}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:53:13.925166 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-f48df508-81df-4230-98d6-78ff59aa496f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Getting quotas for project 6d8fb8c2659a43a696a0a16e7d2be378. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:53:13.931984 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-f48df508-81df-4230-98d6-78ff59aa496f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Getting quotas for user 4805a4aa399d4d0798b6077a545a2255 and project 6d8fb8c2659a43a696a0a16e7d2be378. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:53:13.960050 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f48df508-81df-4230-98d6-78ff59aa496f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.055993 Oct 17 14:53:13.960665 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3550/7232] 10.222.0.79 () {60 vars in 1159 bytes} [Mon Oct 17 14:53:13 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:53:19.771959 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3370d01b-7db1-4944-aaa7-a4137feab572 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1387920993", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "networks": [{"uuid": "fe9a09a6-24ee-4795-82f5-bf8044035917"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1778178300", "security_groups": [{"name": "tempest-secgroup-smoke-1835937361"}]}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:53:19.782885 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:53:20.091025 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-3370d01b-7db1-4944-aaa7-a4137feab572 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] validate_networks() for [('fe9a09a6-24ee-4795-82f5-bf8044035917', None, None, None, None, None)] {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:53:20.897439 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-3370d01b-7db1-4944-aaa7-a4137feab572 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:53:20.898101 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-3370d01b-7db1-4944-aaa7-a4137feab572 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:53:20.898375 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-3370d01b-7db1-4944-aaa7-a4137feab572 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:53:20.899003 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-3370d01b-7db1-4944-aaa7-a4137feab572 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:53:20.899456 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-3370d01b-7db1-4944-aaa7-a4137feab572 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:53:20.909100 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3370d01b-7db1-4944-aaa7-a4137feab572 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:53:20.909591 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3370d01b-7db1-4944-aaa7-a4137feab572 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:53:20.910027 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3370d01b-7db1-4944-aaa7-a4137feab572 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:53:20.910755 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3370d01b-7db1-4944-aaa7-a4137feab572 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:53:20.911916 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3370d01b-7db1-4944-aaa7-a4137feab572 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:53:20.912353 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3370d01b-7db1-4944-aaa7-a4137feab572 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:53:20.931452 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-3370d01b-7db1-4944-aaa7-a4137feab572 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Getting quotas for project 6d8fb8c2659a43a696a0a16e7d2be378. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:53:20.937444 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-3370d01b-7db1-4944-aaa7-a4137feab572 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Getting quotas for user 4805a4aa399d4d0798b6077a545a2255 and project 6d8fb8c2659a43a696a0a16e7d2be378. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:53:20.951289 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3370d01b-7db1-4944-aaa7-a4137feab572 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:53:20.953656 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3370d01b-7db1-4944-aaa7-a4137feab572 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 20043f72-1083-47a8-910a-aba41e8ee945] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:53:21.004209 n-d-854247-14 devstack@n-api.service[127016]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3370d01b-7db1-4944-aaa7-a4137feab572 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [cf3ac22b-dd11-4f4a-9fac-901ca6f0f90c] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 14:53:22.015234 n-d-854247-14 devstack@n-api.service[127016]: INFO oslo.messaging._drivers.impl_rabbit [None req-3370d01b-7db1-4944-aaa7-a4137feab572 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [cf3ac22b-dd11-4f4a-9fac-901ca6f0f90c] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 34906. Oct 17 14:53:22.019923 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3370d01b-7db1-4944-aaa7-a4137feab572 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.252365 Oct 17 14:53:22.022989 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3683/7233] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 14:53:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 2254 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:53:22.033495 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4cd9a758-2f12-41fd-b97b-7a638c19c370 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:53:22.034763 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4cd9a758-2f12-41fd-b97b-7a638c19c370 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 20043f72-1083-47a8-910a-aba41e8ee945] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:53:22.041315 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=16 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:53:22.131574 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4cd9a758-2f12-41fd-b97b-7a638c19c370 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:53:22.140016 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4cd9a758-2f12-41fd-b97b-7a638c19c370 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/20043f72-1083-47a8-910a-aba41e8ee945" status: 200 len: 1267 microversion: 2.1 time: 0.111580 Oct 17 14:53:22.140689 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3551/7234] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:53:22 2022] GET /compute/v2.1/servers/20043f72-1083-47a8-910a-aba41e8ee945 => generated 1267 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:53:23.166770 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-03931502-731c-45a5-b406-82c480f04c43 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:53:23.167938 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-03931502-731c-45a5-b406-82c480f04c43 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 20043f72-1083-47a8-910a-aba41e8ee945] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:53:23.176152 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-03931502-731c-45a5-b406-82c480f04c43 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:53:23.177078 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-03931502-731c-45a5-b406-82c480f04c43 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:53:23.177902 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-03931502-731c-45a5-b406-82c480f04c43 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:53:23.178855 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-03931502-731c-45a5-b406-82c480f04c43 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:53:23.180134 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-03931502-731c-45a5-b406-82c480f04c43 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:53:23.181120 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-03931502-731c-45a5-b406-82c480f04c43 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:53:23.310588 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-03931502-731c-45a5-b406-82c480f04c43 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:53:23.320829 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-03931502-731c-45a5-b406-82c480f04c43 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/20043f72-1083-47a8-910a-aba41e8ee945" status: 200 len: 1327 microversion: 2.1 time: 0.159205 Oct 17 14:53:23.321621 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3684/7235] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:53:23 2022] GET /compute/v2.1/servers/20043f72-1083-47a8-910a-aba41e8ee945 => generated 1327 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:53:24.346219 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4527d510-1e15-4b91-8e4a-e555c28e37bf tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:53:24.347291 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4527d510-1e15-4b91-8e4a-e555c28e37bf tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 20043f72-1083-47a8-910a-aba41e8ee945] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:53:24.359376 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4527d510-1e15-4b91-8e4a-e555c28e37bf tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:53:24.359839 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4527d510-1e15-4b91-8e4a-e555c28e37bf tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:53:24.360289 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4527d510-1e15-4b91-8e4a-e555c28e37bf tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:53:24.361530 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4527d510-1e15-4b91-8e4a-e555c28e37bf tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:53:24.361530 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4527d510-1e15-4b91-8e4a-e555c28e37bf tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:53:24.361897 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4527d510-1e15-4b91-8e4a-e555c28e37bf tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:53:24.568771 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4527d510-1e15-4b91-8e4a-e555c28e37bf tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:53:24.578130 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4527d510-1e15-4b91-8e4a-e555c28e37bf tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/20043f72-1083-47a8-910a-aba41e8ee945" status: 200 len: 1393 microversion: 2.1 time: 0.235806 Oct 17 14:53:24.578705 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3552/7236] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:53:24 2022] GET /compute/v2.1/servers/20043f72-1083-47a8-910a-aba41e8ee945 => generated 1393 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:53:24.939555 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-9bd61b58-95ca-4457-b642-ec74874811c9 req-8a772cf0-bb36-4d71-8505-ffe94e3955ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20043f72-1083-47a8-910a-aba41e8ee945", "tag": "cc0149f1-8f5f-445b-866a-0d59714feffa"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:53:24.951447 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-9bd61b58-95ca-4457-b642-ec74874811c9 req-8a772cf0-bb36-4d71-8505-ffe94e3955ef service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:53:24.952057 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-9bd61b58-95ca-4457-b642-ec74874811c9 req-8a772cf0-bb36-4d71-8505-ffe94e3955ef service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:53:24.952683 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-9bd61b58-95ca-4457-b642-ec74874811c9 req-8a772cf0-bb36-4d71-8505-ffe94e3955ef service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:53:24.965410 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-9bd61b58-95ca-4457-b642-ec74874811c9 req-8a772cf0-bb36-4d71-8505-ffe94e3955ef service nova] Creating event network-changed:cc0149f1-8f5f-445b-866a-0d59714feffa for instance 20043f72-1083-47a8-910a-aba41e8ee945 on n-h2-854247-14 Oct 17 14:53:24.970704 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-9bd61b58-95ca-4457-b642-ec74874811c9 req-8a772cf0-bb36-4d71-8505-ffe94e3955ef service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035072 Oct 17 14:53:24.971338 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3685/7237] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:53:25.602375 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-db51e0fe-ae3d-47a2-be6b-5f8e6199188c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:53:25.602961 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-db51e0fe-ae3d-47a2-be6b-5f8e6199188c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 20043f72-1083-47a8-910a-aba41e8ee945] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:53:25.610560 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db51e0fe-ae3d-47a2-be6b-5f8e6199188c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:53:25.611059 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db51e0fe-ae3d-47a2-be6b-5f8e6199188c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:53:25.611539 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db51e0fe-ae3d-47a2-be6b-5f8e6199188c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:53:25.612255 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db51e0fe-ae3d-47a2-be6b-5f8e6199188c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:53:25.612719 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db51e0fe-ae3d-47a2-be6b-5f8e6199188c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:53:25.613154 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db51e0fe-ae3d-47a2-be6b-5f8e6199188c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:53:25.764559 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-db51e0fe-ae3d-47a2-be6b-5f8e6199188c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:53:25.773758 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-db51e0fe-ae3d-47a2-be6b-5f8e6199188c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/20043f72-1083-47a8-910a-aba41e8ee945" status: 200 len: 1393 microversion: 2.1 time: 0.175535 Oct 17 14:53:25.774358 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3553/7238] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:53:25 2022] GET /compute/v2.1/servers/20043f72-1083-47a8-910a-aba41e8ee945 => generated 1393 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:53:26.799033 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-32704ec7-4c26-4690-bc21-63d47b0044cc tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:53:26.799791 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-32704ec7-4c26-4690-bc21-63d47b0044cc tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 20043f72-1083-47a8-910a-aba41e8ee945] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:53:26.807627 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-32704ec7-4c26-4690-bc21-63d47b0044cc tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:53:26.808120 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-32704ec7-4c26-4690-bc21-63d47b0044cc tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:53:26.808561 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-32704ec7-4c26-4690-bc21-63d47b0044cc tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:53:26.809278 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-32704ec7-4c26-4690-bc21-63d47b0044cc tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:53:26.809741 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-32704ec7-4c26-4690-bc21-63d47b0044cc tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:53:26.810170 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-32704ec7-4c26-4690-bc21-63d47b0044cc tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:53:26.955049 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-32704ec7-4c26-4690-bc21-63d47b0044cc tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:53:26.963693 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-32704ec7-4c26-4690-bc21-63d47b0044cc tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/20043f72-1083-47a8-910a-aba41e8ee945" status: 200 len: 1393 microversion: 2.1 time: 0.170534 Oct 17 14:53:26.964260 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3686/7239] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:53:26 2022] GET /compute/v2.1/servers/20043f72-1083-47a8-910a-aba41e8ee945 => generated 1393 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:53:27.990353 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e331caa6-29d5-4af1-90f9-022985b7209b tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:53:27.990960 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e331caa6-29d5-4af1-90f9-022985b7209b tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 20043f72-1083-47a8-910a-aba41e8ee945] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:53:27.998776 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e331caa6-29d5-4af1-90f9-022985b7209b tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:53:27.999314 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e331caa6-29d5-4af1-90f9-022985b7209b tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:53:27.999740 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e331caa6-29d5-4af1-90f9-022985b7209b tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:53:28.000491 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e331caa6-29d5-4af1-90f9-022985b7209b tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:53:28.000959 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e331caa6-29d5-4af1-90f9-022985b7209b tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:53:28.001378 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e331caa6-29d5-4af1-90f9-022985b7209b tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:53:28.157766 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e331caa6-29d5-4af1-90f9-022985b7209b tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:53:28.165980 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e331caa6-29d5-4af1-90f9-022985b7209b tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/20043f72-1083-47a8-910a-aba41e8ee945" status: 200 len: 1393 microversion: 2.1 time: 0.181508 Oct 17 14:53:28.166578 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3554/7240] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:53:27 2022] GET /compute/v2.1/servers/20043f72-1083-47a8-910a-aba41e8ee945 => generated 1393 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:53:29.189539 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2b69ab43-7340-4e02-86c0-c5f5d43ac9c4 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:53:29.190181 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2b69ab43-7340-4e02-86c0-c5f5d43ac9c4 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 20043f72-1083-47a8-910a-aba41e8ee945] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:53:29.197836 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2b69ab43-7340-4e02-86c0-c5f5d43ac9c4 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:53:29.198577 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2b69ab43-7340-4e02-86c0-c5f5d43ac9c4 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:53:29.198712 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2b69ab43-7340-4e02-86c0-c5f5d43ac9c4 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:53:29.199574 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2b69ab43-7340-4e02-86c0-c5f5d43ac9c4 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:53:29.200023 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2b69ab43-7340-4e02-86c0-c5f5d43ac9c4 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:53:29.200433 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2b69ab43-7340-4e02-86c0-c5f5d43ac9c4 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:53:29.346765 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2b69ab43-7340-4e02-86c0-c5f5d43ac9c4 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:53:29.355455 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2b69ab43-7340-4e02-86c0-c5f5d43ac9c4 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/20043f72-1083-47a8-910a-aba41e8ee945" status: 200 len: 1393 microversion: 2.1 time: 0.169816 Oct 17 14:53:29.356053 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3687/7241] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:53:29 2022] GET /compute/v2.1/servers/20043f72-1083-47a8-910a-aba41e8ee945 => generated 1393 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:53:29.375230 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-40c37e20-73e4-48df-a102-865abcd5231c req-8bb2e830-004e-4b21-9306-9d81d0133f5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20043f72-1083-47a8-910a-aba41e8ee945", "name": "network-vif-plugged", "status": "completed", "tag": "cc0149f1-8f5f-445b-866a-0d59714feffa"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:53:29.381832 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:53:29.387532 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-40c37e20-73e4-48df-a102-865abcd5231c req-8bb2e830-004e-4b21-9306-9d81d0133f5f service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:53:29.388275 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-40c37e20-73e4-48df-a102-865abcd5231c req-8bb2e830-004e-4b21-9306-9d81d0133f5f service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:53:29.388721 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-40c37e20-73e4-48df-a102-865abcd5231c req-8bb2e830-004e-4b21-9306-9d81d0133f5f service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:53:29.405962 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-40c37e20-73e4-48df-a102-865abcd5231c req-8bb2e830-004e-4b21-9306-9d81d0133f5f service nova] Creating event network-vif-plugged:cc0149f1-8f5f-445b-866a-0d59714feffa for instance 20043f72-1083-47a8-910a-aba41e8ee945 on n-h2-854247-14 Oct 17 14:53:29.412269 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-40c37e20-73e4-48df-a102-865abcd5231c req-8bb2e830-004e-4b21-9306-9d81d0133f5f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040430 Oct 17 14:53:29.413243 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3555/7242] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:53:30.379154 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-21ddc02a-4ff5-4b3e-a3ec-68ddd4f89f73 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:53:30.379967 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-21ddc02a-4ff5-4b3e-a3ec-68ddd4f89f73 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 20043f72-1083-47a8-910a-aba41e8ee945] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:53:30.386521 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-21ddc02a-4ff5-4b3e-a3ec-68ddd4f89f73 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:53:30.386988 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-21ddc02a-4ff5-4b3e-a3ec-68ddd4f89f73 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:53:30.387481 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-21ddc02a-4ff5-4b3e-a3ec-68ddd4f89f73 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:53:30.388201 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-21ddc02a-4ff5-4b3e-a3ec-68ddd4f89f73 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:53:30.388669 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-21ddc02a-4ff5-4b3e-a3ec-68ddd4f89f73 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:53:30.389085 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-21ddc02a-4ff5-4b3e-a3ec-68ddd4f89f73 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:53:30.547896 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-21ddc02a-4ff5-4b3e-a3ec-68ddd4f89f73 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:53:30.556971 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-21ddc02a-4ff5-4b3e-a3ec-68ddd4f89f73 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/20043f72-1083-47a8-910a-aba41e8ee945" status: 200 len: 1393 microversion: 2.1 time: 0.182464 Oct 17 14:53:30.557570 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3688/7243] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:53:30 2022] GET /compute/v2.1/servers/20043f72-1083-47a8-910a-aba41e8ee945 => generated 1393 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:53:31.584599 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d0a0a032-365a-4d71-aca1-6d530186b3bd tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:53:31.585285 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d0a0a032-365a-4d71-aca1-6d530186b3bd tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 20043f72-1083-47a8-910a-aba41e8ee945] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:53:31.592343 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d0a0a032-365a-4d71-aca1-6d530186b3bd tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:53:31.592838 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d0a0a032-365a-4d71-aca1-6d530186b3bd tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:53:31.593289 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d0a0a032-365a-4d71-aca1-6d530186b3bd tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:53:31.594161 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d0a0a032-365a-4d71-aca1-6d530186b3bd tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:53:31.594600 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d0a0a032-365a-4d71-aca1-6d530186b3bd tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:53:31.595043 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d0a0a032-365a-4d71-aca1-6d530186b3bd tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:53:31.740330 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d0a0a032-365a-4d71-aca1-6d530186b3bd tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:53:31.748852 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d0a0a032-365a-4d71-aca1-6d530186b3bd tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/20043f72-1083-47a8-910a-aba41e8ee945" status: 200 len: 1563 microversion: 2.1 time: 0.169518 Oct 17 14:53:31.749462 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3556/7244] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:53:31 2022] GET /compute/v2.1/servers/20043f72-1083-47a8-910a-aba41e8ee945 => generated 1563 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:53:31.774018 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b2bb4109-3b14-4967-bff2-6d8d5c1a2198 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:53:31.774644 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b2bb4109-3b14-4967-bff2-6d8d5c1a2198 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 20043f72-1083-47a8-910a-aba41e8ee945] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:53:31.776865 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:53:31.777701 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=6 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:53:31.785457 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b2bb4109-3b14-4967-bff2-6d8d5c1a2198 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:53:31.786091 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b2bb4109-3b14-4967-bff2-6d8d5c1a2198 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:53:31.786796 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b2bb4109-3b14-4967-bff2-6d8d5c1a2198 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:53:31.787765 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b2bb4109-3b14-4967-bff2-6d8d5c1a2198 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:53:31.788225 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b2bb4109-3b14-4967-bff2-6d8d5c1a2198 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:53:31.788650 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b2bb4109-3b14-4967-bff2-6d8d5c1a2198 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:53:31.931620 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b2bb4109-3b14-4967-bff2-6d8d5c1a2198 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:53:31.940053 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b2bb4109-3b14-4967-bff2-6d8d5c1a2198 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/20043f72-1083-47a8-910a-aba41e8ee945" status: 200 len: 1563 microversion: 2.1 time: 0.170817 Oct 17 14:53:31.940609 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3689/7245] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:53:31 2022] GET /compute/v2.1/servers/20043f72-1083-47a8-910a-aba41e8ee945 => generated 1563 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:53:33.973629 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f00a4a7a-a905-47cf-9908-738deffccaf3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:53:33.974935 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f00a4a7a-a905-47cf-9908-738deffccaf3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 20043f72-1083-47a8-910a-aba41e8ee945] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:53:33.976984 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-33599190-9392-40a3-97ce-b628b67431a7 req-4d1b99e4-499c-4289-9885-657fb1233893 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20043f72-1083-47a8-910a-aba41e8ee945", "tag": "cc0149f1-8f5f-445b-866a-0d59714feffa"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:53:33.977495 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=6 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:53:33.985231 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f00a4a7a-a905-47cf-9908-738deffccaf3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:53:33.985746 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f00a4a7a-a905-47cf-9908-738deffccaf3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:53:33.986426 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f00a4a7a-a905-47cf-9908-738deffccaf3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:53:33.987189 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f00a4a7a-a905-47cf-9908-738deffccaf3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:53:33.987683 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f00a4a7a-a905-47cf-9908-738deffccaf3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:53:33.988007 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-33599190-9392-40a3-97ce-b628b67431a7 req-4d1b99e4-499c-4289-9885-657fb1233893 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:53:33.988156 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f00a4a7a-a905-47cf-9908-738deffccaf3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:53:33.988543 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-33599190-9392-40a3-97ce-b628b67431a7 req-4d1b99e4-499c-4289-9885-657fb1233893 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:53:33.989124 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-33599190-9392-40a3-97ce-b628b67431a7 req-4d1b99e4-499c-4289-9885-657fb1233893 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:53:34.002234 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-33599190-9392-40a3-97ce-b628b67431a7 req-4d1b99e4-499c-4289-9885-657fb1233893 service nova] Creating event network-changed:cc0149f1-8f5f-445b-866a-0d59714feffa for instance 20043f72-1083-47a8-910a-aba41e8ee945 on n-h2-854247-14 Oct 17 14:53:34.008633 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-33599190-9392-40a3-97ce-b628b67431a7 req-4d1b99e4-499c-4289-9885-657fb1233893 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035626 Oct 17 14:53:34.009672 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3690/7246] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:53:34.215796 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f00a4a7a-a905-47cf-9908-738deffccaf3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:53:34.226217 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f00a4a7a-a905-47cf-9908-738deffccaf3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/20043f72-1083-47a8-910a-aba41e8ee945" status: 200 len: 1563 microversion: 2.1 time: 0.256267 Oct 17 14:53:34.226789 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3557/7247] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:53:33 2022] GET /compute/v2.1/servers/20043f72-1083-47a8-910a-aba41e8ee945 => generated 1563 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:53:55.481093 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:53:55.481753 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=36 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:53:55.487051 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-8dbfdf17-d261-4879-be56-20575116573c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:53:55.490665 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-8dbfdf17-d261-4879-be56-20575116573c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 20043f72-1083-47a8-910a-aba41e8ee945] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:53:55.503217 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8dbfdf17-d261-4879-be56-20575116573c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:53:55.503825 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8dbfdf17-d261-4879-be56-20575116573c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:53:55.504425 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8dbfdf17-d261-4879-be56-20575116573c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:53:55.505473 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8dbfdf17-d261-4879-be56-20575116573c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:53:55.505948 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8dbfdf17-d261-4879-be56-20575116573c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:53:55.506528 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-8dbfdf17-d261-4879-be56-20575116573c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:53:55.563770 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-8dbfdf17-d261-4879-be56-20575116573c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "POST /compute/v2.1/servers/20043f72-1083-47a8-910a-aba41e8ee945/action" status: 200 len: 24566 microversion: 2.1 time: 0.084543 Oct 17 14:53:55.564458 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3691/7248] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:53:55 2022] POST /compute/v2.1/servers/20043f72-1083-47a8-910a-aba41e8ee945/action => generated 24566 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:54:06.586800 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ab058f3e-1280-4152-af16-0a8e19e90a90 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:54:06.587613 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ab058f3e-1280-4152-af16-0a8e19e90a90 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 20043f72-1083-47a8-910a-aba41e8ee945] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:54:06.589765 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=5 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:54:06.590608 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=32 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:54:06.591650 n-d-854247-14 devstack@n-api.service[127017]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 14:54:06.591825 n-d-854247-14 devstack@n-api.service[127017]: Mon Oct 17 14:54:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/20043f72-1083-47a8-910a-aba41e8ee945/action (ip 10.222.0.79) !!! Oct 17 14:54:06.602818 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ab058f3e-1280-4152-af16-0a8e19e90a90 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:06.603330 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ab058f3e-1280-4152-af16-0a8e19e90a90 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:06.603810 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ab058f3e-1280-4152-af16-0a8e19e90a90 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:06.604527 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ab058f3e-1280-4152-af16-0a8e19e90a90 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:06.604979 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ab058f3e-1280-4152-af16-0a8e19e90a90 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:06.605416 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ab058f3e-1280-4152-af16-0a8e19e90a90 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:06.629537 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-ab058f3e-1280-4152-af16-0a8e19e90a90 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lazy-loading 'flavor' on Instance uuid 20043f72-1083-47a8-910a-aba41e8ee945 {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:54:06.704891 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ab058f3e-1280-4152-af16-0a8e19e90a90 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "POST /compute/v2.1/servers/20043f72-1083-47a8-910a-aba41e8ee945/action" status: 202 len: 0 microversion: 2.1 time: 0.121908 Oct 17 14:54:06.705639 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3558/7249] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:54:06 2022] POST /compute/v2.1/servers/20043f72-1083-47a8-910a-aba41e8ee945/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:54:06.715860 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fcd0205f-a5b9-4155-8a1a-329f628178b1 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:54:06.716562 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-fcd0205f-a5b9-4155-8a1a-329f628178b1 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 20043f72-1083-47a8-910a-aba41e8ee945] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:54:06.720145 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=4 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:54:06.720795 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:54:06.728539 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fcd0205f-a5b9-4155-8a1a-329f628178b1 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:06.729137 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fcd0205f-a5b9-4155-8a1a-329f628178b1 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:06.729577 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fcd0205f-a5b9-4155-8a1a-329f628178b1 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:06.730292 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fcd0205f-a5b9-4155-8a1a-329f628178b1 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:06.730750 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fcd0205f-a5b9-4155-8a1a-329f628178b1 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:06.731193 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fcd0205f-a5b9-4155-8a1a-329f628178b1 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:06.870718 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fcd0205f-a5b9-4155-8a1a-329f628178b1 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:54:06.878825 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fcd0205f-a5b9-4155-8a1a-329f628178b1 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/20043f72-1083-47a8-910a-aba41e8ee945" status: 200 len: 1689 microversion: 2.1 time: 0.167444 Oct 17 14:54:06.879447 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3692/7250] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:54:06 2022] GET /compute/v2.1/servers/20043f72-1083-47a8-910a-aba41e8ee945 => generated 1689 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:54:07.910092 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-39f19f46-0242-4407-a8a4-cd0093090a1e tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:54:07.911210 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-39f19f46-0242-4407-a8a4-cd0093090a1e tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 20043f72-1083-47a8-910a-aba41e8ee945] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:54:07.921072 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-39f19f46-0242-4407-a8a4-cd0093090a1e tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:07.921798 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-39f19f46-0242-4407-a8a4-cd0093090a1e tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:07.922466 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-39f19f46-0242-4407-a8a4-cd0093090a1e tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:07.923604 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-39f19f46-0242-4407-a8a4-cd0093090a1e tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:07.924291 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-39f19f46-0242-4407-a8a4-cd0093090a1e tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:07.924932 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-39f19f46-0242-4407-a8a4-cd0093090a1e tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:08.121677 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-39f19f46-0242-4407-a8a4-cd0093090a1e tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:54:08.133954 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-39f19f46-0242-4407-a8a4-cd0093090a1e tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/20043f72-1083-47a8-910a-aba41e8ee945" status: 200 len: 1672 microversion: 2.1 time: 0.231849 Oct 17 14:54:08.134733 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3559/7251] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:54:07 2022] GET /compute/v2.1/servers/20043f72-1083-47a8-910a-aba41e8ee945 => generated 1672 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:54:09.244278 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-81e0d438-fea1-4d7a-a144-654381ee3576 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:54:09.246496 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-81e0d438-fea1-4d7a-a144-654381ee3576 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 20043f72-1083-47a8-910a-aba41e8ee945] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:54:09.254803 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-81e0d438-fea1-4d7a-a144-654381ee3576 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:09.255335 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-81e0d438-fea1-4d7a-a144-654381ee3576 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:09.255778 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-81e0d438-fea1-4d7a-a144-654381ee3576 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:09.256477 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-81e0d438-fea1-4d7a-a144-654381ee3576 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:09.256925 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-81e0d438-fea1-4d7a-a144-654381ee3576 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:09.257353 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-81e0d438-fea1-4d7a-a144-654381ee3576 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:09.311132 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-81e0d438-fea1-4d7a-a144-654381ee3576 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "POST /compute/v2.1/servers/20043f72-1083-47a8-910a-aba41e8ee945/action" status: 200 len: 38385 microversion: 2.1 time: 0.073366 Oct 17 14:54:09.311767 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3693/7252] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:54:09 2022] POST /compute/v2.1/servers/20043f72-1083-47a8-910a-aba41e8ee945/action => generated 38385 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:54:09.324227 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-42eee221-ba95-41d4-abd7-0cb7dc3cd202 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:54:09.324866 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-42eee221-ba95-41d4-abd7-0cb7dc3cd202 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 20043f72-1083-47a8-910a-aba41e8ee945] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:54:09.331866 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-42eee221-ba95-41d4-abd7-0cb7dc3cd202 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:09.332364 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-42eee221-ba95-41d4-abd7-0cb7dc3cd202 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:09.332817 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-42eee221-ba95-41d4-abd7-0cb7dc3cd202 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:09.333520 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-42eee221-ba95-41d4-abd7-0cb7dc3cd202 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:09.333990 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-42eee221-ba95-41d4-abd7-0cb7dc3cd202 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:09.334434 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-42eee221-ba95-41d4-abd7-0cb7dc3cd202 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:09.412903 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-42eee221-ba95-41d4-abd7-0cb7dc3cd202 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "POST /compute/v2.1/servers/20043f72-1083-47a8-910a-aba41e8ee945/action" status: 202 len: 0 microversion: 2.1 time: 0.092521 Oct 17 14:54:09.413590 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3560/7253] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:54:09 2022] POST /compute/v2.1/servers/20043f72-1083-47a8-910a-aba41e8ee945/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:54:09.422741 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6a336341-a3f1-44fe-b379-8c18c00ca4bb tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:54:09.423507 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6a336341-a3f1-44fe-b379-8c18c00ca4bb tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 20043f72-1083-47a8-910a-aba41e8ee945] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:54:09.431101 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6a336341-a3f1-44fe-b379-8c18c00ca4bb tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:09.431626 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6a336341-a3f1-44fe-b379-8c18c00ca4bb tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:09.432291 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6a336341-a3f1-44fe-b379-8c18c00ca4bb tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:09.433024 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6a336341-a3f1-44fe-b379-8c18c00ca4bb tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:09.433480 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6a336341-a3f1-44fe-b379-8c18c00ca4bb tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:09.433947 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6a336341-a3f1-44fe-b379-8c18c00ca4bb tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:09.654638 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6a336341-a3f1-44fe-b379-8c18c00ca4bb tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:54:09.663557 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6a336341-a3f1-44fe-b379-8c18c00ca4bb tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/20043f72-1083-47a8-910a-aba41e8ee945" status: 200 len: 1678 microversion: 2.1 time: 0.245084 Oct 17 14:54:09.664156 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3694/7254] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:54:09 2022] GET /compute/v2.1/servers/20043f72-1083-47a8-910a-aba41e8ee945 => generated 1678 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:54:10.688567 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c7f2fe3b-cacb-4f68-a92a-05cbfb37f799 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:54:10.689318 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c7f2fe3b-cacb-4f68-a92a-05cbfb37f799 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 20043f72-1083-47a8-910a-aba41e8ee945] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:54:10.697446 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7f2fe3b-cacb-4f68-a92a-05cbfb37f799 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:10.698090 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7f2fe3b-cacb-4f68-a92a-05cbfb37f799 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:10.698548 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7f2fe3b-cacb-4f68-a92a-05cbfb37f799 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:10.699301 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7f2fe3b-cacb-4f68-a92a-05cbfb37f799 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:10.699767 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7f2fe3b-cacb-4f68-a92a-05cbfb37f799 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:10.700320 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c7f2fe3b-cacb-4f68-a92a-05cbfb37f799 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:10.852115 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c7f2fe3b-cacb-4f68-a92a-05cbfb37f799 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:54:10.860787 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c7f2fe3b-cacb-4f68-a92a-05cbfb37f799 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/20043f72-1083-47a8-910a-aba41e8ee945" status: 200 len: 1678 microversion: 2.1 time: 0.176552 Oct 17 14:54:10.861376 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3561/7255] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:54:10 2022] GET /compute/v2.1/servers/20043f72-1083-47a8-910a-aba41e8ee945 => generated 1678 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:54:11.887520 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-105a29a5-89de-4778-99d9-f11a07d8946f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:54:11.888203 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-105a29a5-89de-4778-99d9-f11a07d8946f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 20043f72-1083-47a8-910a-aba41e8ee945] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:54:11.899369 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-105a29a5-89de-4778-99d9-f11a07d8946f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:11.900057 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-105a29a5-89de-4778-99d9-f11a07d8946f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:11.900521 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-105a29a5-89de-4778-99d9-f11a07d8946f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:11.901277 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-105a29a5-89de-4778-99d9-f11a07d8946f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:11.901733 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-105a29a5-89de-4778-99d9-f11a07d8946f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:11.902140 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-105a29a5-89de-4778-99d9-f11a07d8946f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:12.045054 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-105a29a5-89de-4778-99d9-f11a07d8946f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:54:12.053546 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-105a29a5-89de-4778-99d9-f11a07d8946f tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/20043f72-1083-47a8-910a-aba41e8ee945" status: 200 len: 1681 microversion: 2.1 time: 0.171198 Oct 17 14:54:12.054118 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3695/7256] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:54:11 2022] GET /compute/v2.1/servers/20043f72-1083-47a8-910a-aba41e8ee945 => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:54:12.457058 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d8da1b04-7ef3-420f-90c3-726b5c249104 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:54:12.459335 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d8da1b04-7ef3-420f-90c3-726b5c249104 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 20043f72-1083-47a8-910a-aba41e8ee945] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:54:12.466882 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d8da1b04-7ef3-420f-90c3-726b5c249104 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:12.467414 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d8da1b04-7ef3-420f-90c3-726b5c249104 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:12.467872 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d8da1b04-7ef3-420f-90c3-726b5c249104 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:12.468584 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d8da1b04-7ef3-420f-90c3-726b5c249104 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:12.469048 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d8da1b04-7ef3-420f-90c3-726b5c249104 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:12.469482 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d8da1b04-7ef3-420f-90c3-726b5c249104 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:12.517309 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d8da1b04-7ef3-420f-90c3-726b5c249104 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "POST /compute/v2.1/servers/20043f72-1083-47a8-910a-aba41e8ee945/action" status: 200 len: 38385 microversion: 2.1 time: 0.064197 Oct 17 14:54:12.517926 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3562/7257] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:54:12 2022] POST /compute/v2.1/servers/20043f72-1083-47a8-910a-aba41e8ee945/action => generated 38385 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:54:13.565999 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cdeeae7d-f266-458c-b739-49225dd06e5c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:54:13.567677 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cdeeae7d-f266-458c-b739-49225dd06e5c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 20043f72-1083-47a8-910a-aba41e8ee945] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:54:13.570011 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-2d95f743-1691-4a4e-989f-e9a5872f6021 req-9594f23a-5c1e-4a53-9a36-528f8039c41f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20043f72-1083-47a8-910a-aba41e8ee945", "tag": "cc0149f1-8f5f-445b-866a-0d59714feffa"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:54:13.578092 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cdeeae7d-f266-458c-b739-49225dd06e5c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:13.578857 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cdeeae7d-f266-458c-b739-49225dd06e5c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:13.579785 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cdeeae7d-f266-458c-b739-49225dd06e5c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:13.580947 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cdeeae7d-f266-458c-b739-49225dd06e5c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:13.581672 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cdeeae7d-f266-458c-b739-49225dd06e5c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:13.582267 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cdeeae7d-f266-458c-b739-49225dd06e5c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:13.584608 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-2d95f743-1691-4a4e-989f-e9a5872f6021 req-9594f23a-5c1e-4a53-9a36-528f8039c41f service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:13.585302 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-2d95f743-1691-4a4e-989f-e9a5872f6021 req-9594f23a-5c1e-4a53-9a36-528f8039c41f service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:13.585776 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-2d95f743-1691-4a4e-989f-e9a5872f6021 req-9594f23a-5c1e-4a53-9a36-528f8039c41f service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:13.600841 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-2d95f743-1691-4a4e-989f-e9a5872f6021 req-9594f23a-5c1e-4a53-9a36-528f8039c41f service nova] Creating event network-changed:cc0149f1-8f5f-445b-866a-0d59714feffa for instance 20043f72-1083-47a8-910a-aba41e8ee945 on n-h2-854247-14 Oct 17 14:54:13.609795 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-2d95f743-1691-4a4e-989f-e9a5872f6021 req-9594f23a-5c1e-4a53-9a36-528f8039c41f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046547 Oct 17 14:54:13.610670 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3563/7258] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:54:13.619039 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cdeeae7d-f266-458c-b739-49225dd06e5c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 20043f72-1083-47a8-910a-aba41e8ee945] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:54:13.736576 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cdeeae7d-f266-458c-b739-49225dd06e5c tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "DELETE /compute/v2.1/servers/20043f72-1083-47a8-910a-aba41e8ee945" status: 204 len: 0 microversion: 2.1 time: 0.175374 Oct 17 14:54:13.737722 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3696/7259] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:54:13 2022] DELETE /compute/v2.1/servers/20043f72-1083-47a8-910a-aba41e8ee945 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:54:13.748902 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-dead680f-8010-4cd9-9de7-605fd87cbad2 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:54:13.750722 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-dead680f-8010-4cd9-9de7-605fd87cbad2 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 20043f72-1083-47a8-910a-aba41e8ee945] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:54:13.757643 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dead680f-8010-4cd9-9de7-605fd87cbad2 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:13.758156 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dead680f-8010-4cd9-9de7-605fd87cbad2 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:13.758654 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dead680f-8010-4cd9-9de7-605fd87cbad2 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:13.759450 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dead680f-8010-4cd9-9de7-605fd87cbad2 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:13.760129 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dead680f-8010-4cd9-9de7-605fd87cbad2 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:13.760797 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dead680f-8010-4cd9-9de7-605fd87cbad2 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:13.903819 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-dead680f-8010-4cd9-9de7-605fd87cbad2 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:54:13.912310 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-dead680f-8010-4cd9-9de7-605fd87cbad2 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/20043f72-1083-47a8-910a-aba41e8ee945" status: 200 len: 1687 microversion: 2.1 time: 0.168826 Oct 17 14:54:13.912923 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3564/7260] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:54:13 2022] GET /compute/v2.1/servers/20043f72-1083-47a8-910a-aba41e8ee945 => generated 1687 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:54:14.938851 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-37ca1d1e-9d5c-4479-8222-5267a1da0812 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:54:14.938851 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-37ca1d1e-9d5c-4479-8222-5267a1da0812 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 20043f72-1083-47a8-910a-aba41e8ee945] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:54:14.946702 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-37ca1d1e-9d5c-4479-8222-5267a1da0812 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:14.947155 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-37ca1d1e-9d5c-4479-8222-5267a1da0812 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:14.947639 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-37ca1d1e-9d5c-4479-8222-5267a1da0812 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:14.948345 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-37ca1d1e-9d5c-4479-8222-5267a1da0812 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:14.948788 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-37ca1d1e-9d5c-4479-8222-5267a1da0812 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:14.949234 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-37ca1d1e-9d5c-4479-8222-5267a1da0812 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:15.154932 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-37ca1d1e-9d5c-4479-8222-5267a1da0812 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:54:15.165320 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-37ca1d1e-9d5c-4479-8222-5267a1da0812 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/20043f72-1083-47a8-910a-aba41e8ee945" status: 200 len: 1687 microversion: 2.1 time: 0.231382 Oct 17 14:54:15.166027 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3697/7261] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:54:14 2022] GET /compute/v2.1/servers/20043f72-1083-47a8-910a-aba41e8ee945 => generated 1687 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:54:15.876305 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-67b587bd-115b-4928-8931-e2a77b625fdf req-39ad4f65-f6c8-445a-b3b6-13ea4ed3bb76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20043f72-1083-47a8-910a-aba41e8ee945", "name": "network-vif-deleted", "tag": "cc0149f1-8f5f-445b-866a-0d59714feffa"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:54:15.890216 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-67b587bd-115b-4928-8931-e2a77b625fdf req-39ad4f65-f6c8-445a-b3b6-13ea4ed3bb76 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:15.890804 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-67b587bd-115b-4928-8931-e2a77b625fdf req-39ad4f65-f6c8-445a-b3b6-13ea4ed3bb76 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:15.891353 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-67b587bd-115b-4928-8931-e2a77b625fdf req-39ad4f65-f6c8-445a-b3b6-13ea4ed3bb76 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:15.905828 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-67b587bd-115b-4928-8931-e2a77b625fdf req-39ad4f65-f6c8-445a-b3b6-13ea4ed3bb76 service nova] Creating event network-vif-deleted:cc0149f1-8f5f-445b-866a-0d59714feffa for instance 20043f72-1083-47a8-910a-aba41e8ee945 on n-h2-854247-14 Oct 17 14:54:15.912462 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-67b587bd-115b-4928-8931-e2a77b625fdf req-39ad4f65-f6c8-445a-b3b6-13ea4ed3bb76 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040270 Oct 17 14:54:15.913279 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3565/7262] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:54:16.190083 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-33845ff6-bfd5-4ba9-a7c5-9efe6d8840c3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:54:16.190831 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-33845ff6-bfd5-4ba9-a7c5-9efe6d8840c3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 20043f72-1083-47a8-910a-aba41e8ee945] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:54:16.198982 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-33845ff6-bfd5-4ba9-a7c5-9efe6d8840c3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:16.199690 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-33845ff6-bfd5-4ba9-a7c5-9efe6d8840c3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:16.200227 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-33845ff6-bfd5-4ba9-a7c5-9efe6d8840c3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:16.201058 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-33845ff6-bfd5-4ba9-a7c5-9efe6d8840c3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:16.201655 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-33845ff6-bfd5-4ba9-a7c5-9efe6d8840c3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:16.202661 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-33845ff6-bfd5-4ba9-a7c5-9efe6d8840c3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:16.238355 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-33845ff6-bfd5-4ba9-a7c5-9efe6d8840c3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:16.238951 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-33845ff6-bfd5-4ba9-a7c5-9efe6d8840c3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:16.239417 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-33845ff6-bfd5-4ba9-a7c5-9efe6d8840c3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:16.239902 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-33845ff6-bfd5-4ba9-a7c5-9efe6d8840c3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lazy-loading 'fault' on Instance uuid 20043f72-1083-47a8-910a-aba41e8ee945 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:54:16.294119 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-33845ff6-bfd5-4ba9-a7c5-9efe6d8840c3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4805a4aa399d4d0798b6077a545a2255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8fb8c2659a43a696a0a16e7d2be378', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:54:16.303926 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-33845ff6-bfd5-4ba9-a7c5-9efe6d8840c3 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/20043f72-1083-47a8-910a-aba41e8ee945" status: 200 len: 1357 microversion: 2.1 time: 0.118168 Oct 17 14:54:16.305849 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3698/7263] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:54:16 2022] GET /compute/v2.1/servers/20043f72-1083-47a8-910a-aba41e8ee945 => generated 1357 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:54:17.329466 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-070cf546-64a6-4b84-9fe7-229416ab3658 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:54:17.330070 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-070cf546-64a6-4b84-9fe7-229416ab3658 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] [instance: 20043f72-1083-47a8-910a-aba41e8ee945] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:54:17.338256 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-070cf546-64a6-4b84-9fe7-229416ab3658 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:17.338766 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-070cf546-64a6-4b84-9fe7-229416ab3658 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:17.339251 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-070cf546-64a6-4b84-9fe7-229416ab3658 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:17.339973 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-070cf546-64a6-4b84-9fe7-229416ab3658 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:17.340480 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-070cf546-64a6-4b84-9fe7-229416ab3658 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:17.340922 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-070cf546-64a6-4b84-9fe7-229416ab3658 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:17.356326 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-070cf546-64a6-4b84-9fe7-229416ab3658 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] HTTP exception thrown: Instance 20043f72-1083-47a8-910a-aba41e8ee945 could not be found. Oct 17 14:54:17.358031 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-070cf546-64a6-4b84-9fe7-229416ab3658 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Request method failure captured: Oct 17 14:54:17.358031 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/20043f72-1083-47a8-910a-aba41e8ee945 HTTP/1.1 Oct 17 14:54:17.358031 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 14:54:17.358031 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 14:54:17.358031 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 14:54:17.358031 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 14:54:17.358031 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 14:54:17.358031 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 14:54:17.358031 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 14:54:17.358031 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 14:54:17.358031 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTWrbJTp3_aV3rQ1sZIV-A8RhPUhGtuu3Cdy9UtPO9T2_ui3_S4_dniOOQZy69dfFzd3AdqRHxEdsaXpnKLosIkT6TOjwXy5X_JiSCvihpV_5K-xclYBmfytVuV0W0qLAfA4CBTVr0Qr1hQGpQvQysPbiqlBcm_U91Zx-5cXnnLrTX2s Oct 17 14:54:17.358031 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 14:54:17.358031 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 14:54:17.358031 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 14:54:17.358031 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 14:54:17.358031 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 14:54:17.358031 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 14:54:17.358031 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 6d8fb8c2659a43a696a0a16e7d2be378 Oct 17 14:54:17.358031 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1531965843 Oct 17 14:54:17.358031 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 14:54:17.358031 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 14:54:17.358031 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6d8fb8c2659a43a696a0a16e7d2be378"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6d8fb8c2659a43a696a0a16e7d2be378"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6d8fb8c2659a43a696a0a16e7d2be378"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6d8fb8c2659a43a696a0a16e7d2be378", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:54:17.358031 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1531965843 Oct 17 14:54:17.358031 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 6d8fb8c2659a43a696a0a16e7d2be378 Oct 17 14:54:17.358031 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1531965843 Oct 17 14:54:17.358031 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-TestNetworkAdvancedServerOps-1531965843-project Oct 17 14:54:17.358031 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 14:54:17.358031 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 14:54:17.358031 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 4805a4aa399d4d0798b6077a545a2255 Oct 17 14:54:17.358031 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1531965843-project Oct 17 14:54:17.358031 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 14:54:17.358031 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 20043f72-1083-47a8-910a-aba41e8ee945 could not be found. Oct 17 14:54:17.358031 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '20043f72-1083-47a8-910a-aba41e8ee945'} Oct 17 14:54:17.358031 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:54:17.358031 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:54:17.358031 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:54:17.358031 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:54:17.358031 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:54:17.358031 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:54:17.358031 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:54:17.358031 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:54:17.358031 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:54:17.358031 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:54:17.358031 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20043f72-1083-47a8-910a-aba41e8ee945 could not be found. Oct 17 14:54:17.358031 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:54:17.358031 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:54:17.358031 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:54:17.358031 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:54:17.358031 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:54:17.358031 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:54:17.358031 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:54:17.358031 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:54:17.358031 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:54:17.358031 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:54:17.358031 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:54:17.358031 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:54:17.358031 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:54:17.358031 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:54:17.358031 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:54:17.358031 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:54:17.358031 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20043f72-1083-47a8-910a-aba41e8ee945 could not be found. Oct 17 14:54:17.358031 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:54:17.358031 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:54:17.363629 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:54:17.363629 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:54:17.363629 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:54:17.363629 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:54:17.363629 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:54:17.363629 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:54:17.363629 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20043f72-1083-47a8-910a-aba41e8ee945 could not be found. Oct 17 14:54:17.363629 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:54:17.363629 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-070cf546-64a6-4b84-9fe7-229416ab3658 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Returning 404 to user: Instance 20043f72-1083-47a8-910a-aba41e8ee945 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:54:17.363629 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-070cf546-64a6-4b84-9fe7-229416ab3658 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "GET /compute/v2.1/servers/20043f72-1083-47a8-910a-aba41e8ee945" status: 404 len: 111 microversion: 2.1 time: 0.034567 Oct 17 14:54:17.363629 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3566/7264] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:54:17 2022] GET /compute/v2.1/servers/20043f72-1083-47a8-910a-aba41e8ee945 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:54:20.711039 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0d8dc2f8-207a-460b-accb-4b344722ee13 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] Calling method '.version_select at 0x7f7cd40d73a0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:54:20.736337 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0d8dc2f8-207a-460b-accb-4b344722ee13 tempest-TestNetworkAdvancedServerOps-1531965843 tempest-TestNetworkAdvancedServerOps-1531965843-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1778178300" status: 202 len: 0 microversion: 2.1 time: 0.029350 Oct 17 14:54:20.736948 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3699/7265] 10.222.0.79 () {58 vars in 1284 bytes} [Mon Oct 17 14:54:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1778178300 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:54:33.326457 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=18 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:54:33.327407 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:54:33.573853 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-624c6561-eed6-47b5-a900-4bf022cf3758 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Action: 'create', calling method: .version_select at 0x7f7cd556b700>, body: {"keypair": {"name": "tempest-TestShelveInstance-282425175", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZqpwEYOtEmPJQVqz57eo0uR23L8zI6ITvCO9mpHhdzFA/zS0N8VfEkNQe9dMEPAZMeQmgx3yriF2kZM7mNNQiA9H9nUkgGb8r/S58GDKZCVQYkkGNw0kY2snqTX6WTTA=="}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:54:33.594868 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-624c6561-eed6-47b5-a900-4bf022cf3758 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Getting quotas for project 91785ab2c7c94f089cc2f824a1d1a05b. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:54:33.604436 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-624c6561-eed6-47b5-a900-4bf022cf3758 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Getting quotas for user 43c600eebc68451196362d36d6808744 and project 91785ab2c7c94f089cc2f824a1d1a05b. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:54:33.639607 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-624c6561-eed6-47b5-a900-4bf022cf3758 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.319359 Oct 17 14:54:33.640328 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3567/7266] 10.222.0.79 () {60 vars in 1159 bytes} [Mon Oct 17 14:54:33 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:54:34.770448 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:54:34.771560 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:54:34.777084 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-714989ac-128a-453c-b67d-6e6deb4f3191 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-242322501", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-282425175", "security_groups": [{"name": "tempest-secgroup-smoke-1928719039"}], "networks": [{"uuid": "4827782c-00be-4809-9a48-98f7ef31f3da"}]}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:54:34.901283 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-714989ac-128a-453c-b67d-6e6deb4f3191 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] validate_networks() for [('4827782c-00be-4809-9a48-98f7ef31f3da', None, None, None, None, None)] {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:54:35.332387 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-714989ac-128a-453c-b67d-6e6deb4f3191 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:54:35.333217 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-714989ac-128a-453c-b67d-6e6deb4f3191 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:54:35.334044 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-714989ac-128a-453c-b67d-6e6deb4f3191 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:54:35.335017 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-714989ac-128a-453c-b67d-6e6deb4f3191 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:54:35.335772 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-714989ac-128a-453c-b67d-6e6deb4f3191 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:54:35.348765 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-714989ac-128a-453c-b67d-6e6deb4f3191 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:35.349256 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-714989ac-128a-453c-b67d-6e6deb4f3191 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:35.349691 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-714989ac-128a-453c-b67d-6e6deb4f3191 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:35.350431 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-714989ac-128a-453c-b67d-6e6deb4f3191 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:35.350883 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-714989ac-128a-453c-b67d-6e6deb4f3191 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:35.351345 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-714989ac-128a-453c-b67d-6e6deb4f3191 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:35.376491 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-714989ac-128a-453c-b67d-6e6deb4f3191 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Getting quotas for project 91785ab2c7c94f089cc2f824a1d1a05b. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:54:35.383204 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-714989ac-128a-453c-b67d-6e6deb4f3191 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Getting quotas for user 43c600eebc68451196362d36d6808744 and project 91785ab2c7c94f089cc2f824a1d1a05b. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:54:35.397655 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-714989ac-128a-453c-b67d-6e6deb4f3191 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:54:35.400622 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-714989ac-128a-453c-b67d-6e6deb4f3191 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: bd93a53c-163b-4ab8-873a-1ce8c5948fbf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:54:35.450605 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-714989ac-128a-453c-b67d-6e6deb4f3191 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.682434 Oct 17 14:54:35.451073 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3700/7267] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 14:54:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:54:35.463262 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-fd210054-7eee-4380-ab45-7695810d94c0 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:54:35.463896 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-fd210054-7eee-4380-ab45-7695810d94c0 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: bd93a53c-163b-4ab8-873a-1ce8c5948fbf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:54:35.532725 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-fd210054-7eee-4380-ab45-7695810d94c0 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:54:35.540934 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-fd210054-7eee-4380-ab45-7695810d94c0 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf" status: 200 len: 1245 microversion: 2.1 time: 0.082659 Oct 17 14:54:35.541682 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3568/7268] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:54:35 2022] GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:54:36.566583 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ba91eb79-b79c-4939-a808-1637f5a4f209 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:54:36.567631 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ba91eb79-b79c-4939-a808-1637f5a4f209 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: bd93a53c-163b-4ab8-873a-1ce8c5948fbf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:54:36.575113 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ba91eb79-b79c-4939-a808-1637f5a4f209 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:36.575753 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ba91eb79-b79c-4939-a808-1637f5a4f209 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:36.576295 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ba91eb79-b79c-4939-a808-1637f5a4f209 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:36.577033 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ba91eb79-b79c-4939-a808-1637f5a4f209 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:36.577620 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ba91eb79-b79c-4939-a808-1637f5a4f209 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:36.578054 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ba91eb79-b79c-4939-a808-1637f5a4f209 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:36.656601 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ba91eb79-b79c-4939-a808-1637f5a4f209 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:54:36.665125 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ba91eb79-b79c-4939-a808-1637f5a4f209 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf" status: 200 len: 1297 microversion: 2.1 time: 0.104173 Oct 17 14:54:36.666018 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3701/7269] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:54:36 2022] GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf => generated 1297 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:54:37.690856 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b40ae53d-ba57-4c06-b3d3-8e48a55e9cb0 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:54:37.692286 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b40ae53d-ba57-4c06-b3d3-8e48a55e9cb0 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: bd93a53c-163b-4ab8-873a-1ce8c5948fbf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:54:37.703303 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b40ae53d-ba57-4c06-b3d3-8e48a55e9cb0 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:37.703879 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b40ae53d-ba57-4c06-b3d3-8e48a55e9cb0 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:37.704410 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b40ae53d-ba57-4c06-b3d3-8e48a55e9cb0 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:37.705215 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b40ae53d-ba57-4c06-b3d3-8e48a55e9cb0 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:37.706043 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b40ae53d-ba57-4c06-b3d3-8e48a55e9cb0 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:37.706558 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b40ae53d-ba57-4c06-b3d3-8e48a55e9cb0 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:37.957976 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b40ae53d-ba57-4c06-b3d3-8e48a55e9cb0 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:54:37.966591 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b40ae53d-ba57-4c06-b3d3-8e48a55e9cb0 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf" status: 200 len: 1371 microversion: 2.1 time: 0.280020 Oct 17 14:54:37.967196 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3569/7270] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:54:37 2022] GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf => generated 1371 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:54:38.356250 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-d2e9394a-1de1-42e1-8eba-78adf549af12 req-e52aeda5-c2d6-43c9-b03b-93e18e05f815 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd93a53c-163b-4ab8-873a-1ce8c5948fbf", "tag": "a1334c85-3169-4c45-99b6-7a3570034347"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:54:38.371005 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-d2e9394a-1de1-42e1-8eba-78adf549af12 req-e52aeda5-c2d6-43c9-b03b-93e18e05f815 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:38.371514 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-d2e9394a-1de1-42e1-8eba-78adf549af12 req-e52aeda5-c2d6-43c9-b03b-93e18e05f815 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:38.371943 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-d2e9394a-1de1-42e1-8eba-78adf549af12 req-e52aeda5-c2d6-43c9-b03b-93e18e05f815 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:38.385029 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-d2e9394a-1de1-42e1-8eba-78adf549af12 req-e52aeda5-c2d6-43c9-b03b-93e18e05f815 service nova] Creating event network-changed:a1334c85-3169-4c45-99b6-7a3570034347 for instance bd93a53c-163b-4ab8-873a-1ce8c5948fbf on n-h1-854247-14 Oct 17 14:54:38.392602 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-d2e9394a-1de1-42e1-8eba-78adf549af12 req-e52aeda5-c2d6-43c9-b03b-93e18e05f815 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039904 Oct 17 14:54:38.394398 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3702/7271] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:54:38.990336 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-78ec46a9-0241-43ab-b507-3212f4189c7b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:54:38.991158 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-78ec46a9-0241-43ab-b507-3212f4189c7b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: bd93a53c-163b-4ab8-873a-1ce8c5948fbf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:54:38.998992 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-78ec46a9-0241-43ab-b507-3212f4189c7b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:38.999540 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-78ec46a9-0241-43ab-b507-3212f4189c7b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:39.000003 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-78ec46a9-0241-43ab-b507-3212f4189c7b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:39.000737 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-78ec46a9-0241-43ab-b507-3212f4189c7b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:39.001207 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-78ec46a9-0241-43ab-b507-3212f4189c7b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:39.001649 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-78ec46a9-0241-43ab-b507-3212f4189c7b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:39.170310 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-78ec46a9-0241-43ab-b507-3212f4189c7b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:54:39.178568 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-78ec46a9-0241-43ab-b507-3212f4189c7b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf" status: 200 len: 1371 microversion: 2.1 time: 0.193233 Oct 17 14:54:39.179156 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3570/7272] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:54:38 2022] GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf => generated 1371 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:54:40.203693 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-dace2899-649e-4203-8618-e6ec306c63e9 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:54:40.204314 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-dace2899-649e-4203-8618-e6ec306c63e9 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: bd93a53c-163b-4ab8-873a-1ce8c5948fbf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:54:40.212007 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dace2899-649e-4203-8618-e6ec306c63e9 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:40.212613 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dace2899-649e-4203-8618-e6ec306c63e9 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:40.213051 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dace2899-649e-4203-8618-e6ec306c63e9 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:40.213875 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dace2899-649e-4203-8618-e6ec306c63e9 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:40.214338 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dace2899-649e-4203-8618-e6ec306c63e9 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:40.214796 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-dace2899-649e-4203-8618-e6ec306c63e9 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:40.445349 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-dace2899-649e-4203-8618-e6ec306c63e9 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:54:40.454440 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-dace2899-649e-4203-8618-e6ec306c63e9 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf" status: 200 len: 1371 microversion: 2.1 time: 0.255188 Oct 17 14:54:40.454954 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3703/7273] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:54:40 2022] GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf => generated 1371 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:54:41.478586 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-854c1ea8-1b55-47c0-ba6d-0b8b5fd37610 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:54:41.479154 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-854c1ea8-1b55-47c0-ba6d-0b8b5fd37610 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: bd93a53c-163b-4ab8-873a-1ce8c5948fbf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:54:41.486562 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-854c1ea8-1b55-47c0-ba6d-0b8b5fd37610 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:41.487050 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-854c1ea8-1b55-47c0-ba6d-0b8b5fd37610 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:41.487531 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-854c1ea8-1b55-47c0-ba6d-0b8b5fd37610 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:41.488230 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-854c1ea8-1b55-47c0-ba6d-0b8b5fd37610 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:41.488694 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-854c1ea8-1b55-47c0-ba6d-0b8b5fd37610 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:41.489126 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-854c1ea8-1b55-47c0-ba6d-0b8b5fd37610 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:41.644676 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-854c1ea8-1b55-47c0-ba6d-0b8b5fd37610 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:54:41.655141 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-854c1ea8-1b55-47c0-ba6d-0b8b5fd37610 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf" status: 200 len: 1371 microversion: 2.1 time: 0.180737 Oct 17 14:54:41.655774 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3571/7274] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:54:41 2022] GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf => generated 1371 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:54:42.678572 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-efe0e9ca-a2d9-4498-bc06-d0406197f482 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:54:42.679194 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-efe0e9ca-a2d9-4498-bc06-d0406197f482 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: bd93a53c-163b-4ab8-873a-1ce8c5948fbf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:54:42.686764 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-efe0e9ca-a2d9-4498-bc06-d0406197f482 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:42.687272 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-efe0e9ca-a2d9-4498-bc06-d0406197f482 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:42.687740 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-efe0e9ca-a2d9-4498-bc06-d0406197f482 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:42.688430 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-efe0e9ca-a2d9-4498-bc06-d0406197f482 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:42.688887 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-efe0e9ca-a2d9-4498-bc06-d0406197f482 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:42.689310 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-efe0e9ca-a2d9-4498-bc06-d0406197f482 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:42.833808 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-efe0e9ca-a2d9-4498-bc06-d0406197f482 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:54:42.841839 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-efe0e9ca-a2d9-4498-bc06-d0406197f482 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf" status: 200 len: 1371 microversion: 2.1 time: 0.167311 Oct 17 14:54:42.842662 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3704/7275] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:54:42 2022] GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf => generated 1371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:54:43.865330 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3a0898ab-03a3-47e2-b850-6dfed753ac91 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:54:43.865956 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3a0898ab-03a3-47e2-b850-6dfed753ac91 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: bd93a53c-163b-4ab8-873a-1ce8c5948fbf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:54:43.873940 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3a0898ab-03a3-47e2-b850-6dfed753ac91 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:43.874487 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3a0898ab-03a3-47e2-b850-6dfed753ac91 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:43.874939 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3a0898ab-03a3-47e2-b850-6dfed753ac91 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:43.875990 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3a0898ab-03a3-47e2-b850-6dfed753ac91 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:43.876467 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3a0898ab-03a3-47e2-b850-6dfed753ac91 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:43.876902 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3a0898ab-03a3-47e2-b850-6dfed753ac91 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:44.016200 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3a0898ab-03a3-47e2-b850-6dfed753ac91 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:54:44.024253 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3a0898ab-03a3-47e2-b850-6dfed753ac91 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf" status: 200 len: 1371 microversion: 2.1 time: 0.162984 Oct 17 14:54:44.024834 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3572/7276] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:54:43 2022] GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:54:44.552091 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-6481f315-2227-438a-adc1-0b968b5ac291 req-d2a02338-c866-4150-b78a-c6288bba0c20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd93a53c-163b-4ab8-873a-1ce8c5948fbf", "name": "network-vif-plugged", "status": "completed", "tag": "a1334c85-3169-4c45-99b6-7a3570034347"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:54:44.563191 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-6481f315-2227-438a-adc1-0b968b5ac291 req-d2a02338-c866-4150-b78a-c6288bba0c20 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:44.563646 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-6481f315-2227-438a-adc1-0b968b5ac291 req-d2a02338-c866-4150-b78a-c6288bba0c20 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:44.564180 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-6481f315-2227-438a-adc1-0b968b5ac291 req-d2a02338-c866-4150-b78a-c6288bba0c20 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:44.577258 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-6481f315-2227-438a-adc1-0b968b5ac291 req-d2a02338-c866-4150-b78a-c6288bba0c20 service nova] Creating event network-vif-plugged:a1334c85-3169-4c45-99b6-7a3570034347 for instance bd93a53c-163b-4ab8-873a-1ce8c5948fbf on n-h1-854247-14 Oct 17 14:54:44.582347 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-6481f315-2227-438a-adc1-0b968b5ac291 req-d2a02338-c866-4150-b78a-c6288bba0c20 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034143 Oct 17 14:54:44.582952 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3705/7277] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:54:45.055762 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-03d7fa96-601b-4108-9d02-6cfc8e1895ef tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:54:45.056391 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-03d7fa96-601b-4108-9d02-6cfc8e1895ef tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: bd93a53c-163b-4ab8-873a-1ce8c5948fbf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:54:45.063774 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-03d7fa96-601b-4108-9d02-6cfc8e1895ef tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:45.064270 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-03d7fa96-601b-4108-9d02-6cfc8e1895ef tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:45.064734 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-03d7fa96-601b-4108-9d02-6cfc8e1895ef tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:45.065431 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-03d7fa96-601b-4108-9d02-6cfc8e1895ef tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:45.065953 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-03d7fa96-601b-4108-9d02-6cfc8e1895ef tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:45.066373 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-03d7fa96-601b-4108-9d02-6cfc8e1895ef tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:45.207392 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-03d7fa96-601b-4108-9d02-6cfc8e1895ef tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:54:45.219433 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-03d7fa96-601b-4108-9d02-6cfc8e1895ef tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf" status: 200 len: 1371 microversion: 2.1 time: 0.167358 Oct 17 14:54:45.220293 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3573/7278] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:54:45 2022] GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf => generated 1371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:54:46.244956 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:54:46.246082 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=6 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:54:46.251656 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d00b264f-25bd-443f-89bf-bd5abbb0a9ce tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:54:46.252362 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d00b264f-25bd-443f-89bf-bd5abbb0a9ce tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: bd93a53c-163b-4ab8-873a-1ce8c5948fbf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:54:46.259702 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d00b264f-25bd-443f-89bf-bd5abbb0a9ce tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:46.260185 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d00b264f-25bd-443f-89bf-bd5abbb0a9ce tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:46.260625 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d00b264f-25bd-443f-89bf-bd5abbb0a9ce tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:46.261318 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d00b264f-25bd-443f-89bf-bd5abbb0a9ce tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:46.261750 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d00b264f-25bd-443f-89bf-bd5abbb0a9ce tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:46.262282 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d00b264f-25bd-443f-89bf-bd5abbb0a9ce tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:46.417491 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d00b264f-25bd-443f-89bf-bd5abbb0a9ce tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:54:46.425483 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d00b264f-25bd-443f-89bf-bd5abbb0a9ce tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf" status: 200 len: 1555 microversion: 2.1 time: 0.181787 Oct 17 14:54:46.426047 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3706/7279] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:54:46 2022] GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf => generated 1555 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:54:46.448348 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-bf324d20-2b07-497b-94b5-48a7158cf718 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:54:46.449028 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-bf324d20-2b07-497b-94b5-48a7158cf718 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: bd93a53c-163b-4ab8-873a-1ce8c5948fbf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:54:46.451009 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=6 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:54:46.458058 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bf324d20-2b07-497b-94b5-48a7158cf718 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:46.458555 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bf324d20-2b07-497b-94b5-48a7158cf718 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:46.459008 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bf324d20-2b07-497b-94b5-48a7158cf718 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:46.459767 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bf324d20-2b07-497b-94b5-48a7158cf718 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:46.460269 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bf324d20-2b07-497b-94b5-48a7158cf718 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:46.460711 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-bf324d20-2b07-497b-94b5-48a7158cf718 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:46.605811 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-bf324d20-2b07-497b-94b5-48a7158cf718 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:54:46.614288 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-bf324d20-2b07-497b-94b5-48a7158cf718 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf" status: 200 len: 1555 microversion: 2.1 time: 0.169865 Oct 17 14:54:46.614875 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3574/7280] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:54:46 2022] GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf => generated 1555 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:54:48.425299 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-d5ce9816-0a2c-4f3e-b637-0372ea8762f0 req-59bed5f3-18ae-4db2-abab-cf58818e60bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd93a53c-163b-4ab8-873a-1ce8c5948fbf", "tag": "a1334c85-3169-4c45-99b6-7a3570034347"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:54:48.436108 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-d5ce9816-0a2c-4f3e-b637-0372ea8762f0 req-59bed5f3-18ae-4db2-abab-cf58818e60bd service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:48.436595 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-d5ce9816-0a2c-4f3e-b637-0372ea8762f0 req-59bed5f3-18ae-4db2-abab-cf58818e60bd service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:48.437037 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-d5ce9816-0a2c-4f3e-b637-0372ea8762f0 req-59bed5f3-18ae-4db2-abab-cf58818e60bd service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:48.448578 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-d5ce9816-0a2c-4f3e-b637-0372ea8762f0 req-59bed5f3-18ae-4db2-abab-cf58818e60bd service nova] Creating event network-changed:a1334c85-3169-4c45-99b6-7a3570034347 for instance bd93a53c-163b-4ab8-873a-1ce8c5948fbf on n-h1-854247-14 Oct 17 14:54:48.454102 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-d5ce9816-0a2c-4f3e-b637-0372ea8762f0 req-59bed5f3-18ae-4db2-abab-cf58818e60bd service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032570 Oct 17 14:54:48.454745 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3707/7281] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:56:43.190821 n-d-854247-14 devstack@n-api.service[127017]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b945151f-fea7-4f65-a337-b7fe0a9fe59d] AMQP server on 10.222.0.79:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 17 14:56:43.195031 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d9aa9e04-2414-4efb-a8b4-b2997bd1ae43 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:56:43.195649 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d9aa9e04-2414-4efb-a8b4-b2997bd1ae43 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: bd93a53c-163b-4ab8-873a-1ce8c5948fbf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:56:43.198251 n-d-854247-14 devstack@n-api.service[127017]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8c4c735e-fe50-490e-b8cd-ee30a9564a26] AMQP server on 10.222.0.79:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 17 14:56:43.198790 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:56:43.199676 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=36 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:56:43.207823 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d9aa9e04-2414-4efb-a8b4-b2997bd1ae43 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:56:43.208328 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d9aa9e04-2414-4efb-a8b4-b2997bd1ae43 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:56:43.208783 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d9aa9e04-2414-4efb-a8b4-b2997bd1ae43 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:56:43.209505 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d9aa9e04-2414-4efb-a8b4-b2997bd1ae43 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:56:43.209978 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d9aa9e04-2414-4efb-a8b4-b2997bd1ae43 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:56:43.210416 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d9aa9e04-2414-4efb-a8b4-b2997bd1ae43 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:56:43.236210 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-d9aa9e04-2414-4efb-a8b4-b2997bd1ae43 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lazy-loading 'flavor' on Instance uuid bd93a53c-163b-4ab8-873a-1ce8c5948fbf {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:56:43.441620 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d9aa9e04-2414-4efb-a8b4-b2997bd1ae43 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "POST /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf/action" status: 202 len: 0 microversion: 2.1 time: 0.252452 Oct 17 14:56:43.442234 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3575/7282] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:56:43 2022] POST /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:56:43.449123 n-d-854247-14 devstack@n-api.service[127016]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0ad54cb6-91dd-4ced-9c42-02c0b19684b8] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 14:56:43.451001 n-d-854247-14 devstack@n-api.service[127016]: ERROR oslo.messaging._drivers.impl_rabbit [-] [72f013d3-d96b-49c5-a187-2d216be84735] AMQP server on 10.222.0.79:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 17 14:56:43.452542 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:56:43.453530 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=32 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:56:43.460140 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-da0931f2-7590-447c-9bba-3b087d6f03bc tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:56:43.461067 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-da0931f2-7590-447c-9bba-3b087d6f03bc tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: bd93a53c-163b-4ab8-873a-1ce8c5948fbf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:56:43.469720 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-da0931f2-7590-447c-9bba-3b087d6f03bc tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:56:43.470308 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-da0931f2-7590-447c-9bba-3b087d6f03bc tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:56:43.470831 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-da0931f2-7590-447c-9bba-3b087d6f03bc tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:56:43.471658 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-da0931f2-7590-447c-9bba-3b087d6f03bc tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:56:43.472181 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-da0931f2-7590-447c-9bba-3b087d6f03bc tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:56:43.472671 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-da0931f2-7590-447c-9bba-3b087d6f03bc tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:56:43.621897 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-da0931f2-7590-447c-9bba-3b087d6f03bc tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:56:43.629982 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-da0931f2-7590-447c-9bba-3b087d6f03bc tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf" status: 200 len: 1680 microversion: 2.1 time: 0.182758 Oct 17 14:56:43.630585 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3708/7283] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:56:43 2022] GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf => generated 1680 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:56:44.655958 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1b56f23a-40cd-41b6-8a4e-7405e4baab44 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:56:44.656636 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1b56f23a-40cd-41b6-8a4e-7405e4baab44 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: bd93a53c-163b-4ab8-873a-1ce8c5948fbf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:56:44.667405 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1b56f23a-40cd-41b6-8a4e-7405e4baab44 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:56:44.667898 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1b56f23a-40cd-41b6-8a4e-7405e4baab44 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:56:44.668341 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1b56f23a-40cd-41b6-8a4e-7405e4baab44 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:56:44.669049 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1b56f23a-40cd-41b6-8a4e-7405e4baab44 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:56:44.669504 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1b56f23a-40cd-41b6-8a4e-7405e4baab44 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:56:44.669938 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1b56f23a-40cd-41b6-8a4e-7405e4baab44 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:56:44.670661 n-d-854247-14 devstack@n-api.service[127017]: INFO oslo.messaging._drivers.impl_rabbit [-] [b945151f-fea7-4f65-a337-b7fe0a9fe59d] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 35236. Oct 17 14:56:44.674532 n-d-854247-14 devstack@n-api.service[127017]: INFO oslo.messaging._drivers.impl_rabbit [-] [8c4c735e-fe50-490e-b8cd-ee30a9564a26] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 35238. Oct 17 14:56:44.822761 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1b56f23a-40cd-41b6-8a4e-7405e4baab44 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:56:44.831947 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1b56f23a-40cd-41b6-8a4e-7405e4baab44 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf" status: 200 len: 1680 microversion: 2.1 time: 0.181485 Oct 17 14:56:44.832691 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3576/7284] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:56:44 2022] GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf => generated 1680 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:56:45.859111 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-51fb7d28-2123-4b8e-92c2-c254709116f3 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:56:45.860228 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-51fb7d28-2123-4b8e-92c2-c254709116f3 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: bd93a53c-163b-4ab8-873a-1ce8c5948fbf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:56:45.874054 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-51fb7d28-2123-4b8e-92c2-c254709116f3 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:56:45.874852 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-51fb7d28-2123-4b8e-92c2-c254709116f3 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:56:45.875617 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-51fb7d28-2123-4b8e-92c2-c254709116f3 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:56:45.876537 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-51fb7d28-2123-4b8e-92c2-c254709116f3 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:56:45.877253 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-51fb7d28-2123-4b8e-92c2-c254709116f3 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:56:45.877878 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-51fb7d28-2123-4b8e-92c2-c254709116f3 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:56:45.885278 n-d-854247-14 devstack@n-api.service[127016]: INFO oslo.messaging._drivers.impl_rabbit [-] [0ad54cb6-91dd-4ced-9c42-02c0b19684b8] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 35242. Oct 17 14:56:45.888802 n-d-854247-14 devstack@n-api.service[127016]: INFO oslo.messaging._drivers.impl_rabbit [-] [72f013d3-d96b-49c5-a187-2d216be84735] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 35244. Oct 17 14:56:46.042005 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-51fb7d28-2123-4b8e-92c2-c254709116f3 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:56:46.051091 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-51fb7d28-2123-4b8e-92c2-c254709116f3 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf" status: 200 len: 1680 microversion: 2.1 time: 0.197839 Oct 17 14:56:46.051772 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3709/7285] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:56:45 2022] GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf => generated 1680 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:56:47.075223 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-9c59078d-70fe-49b7-96aa-32f6c7666c60 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:56:47.075849 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-9c59078d-70fe-49b7-96aa-32f6c7666c60 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: bd93a53c-163b-4ab8-873a-1ce8c5948fbf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:56:47.083197 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9c59078d-70fe-49b7-96aa-32f6c7666c60 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:56:47.083710 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9c59078d-70fe-49b7-96aa-32f6c7666c60 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:56:47.084162 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9c59078d-70fe-49b7-96aa-32f6c7666c60 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:56:47.084869 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9c59078d-70fe-49b7-96aa-32f6c7666c60 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:56:47.085339 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9c59078d-70fe-49b7-96aa-32f6c7666c60 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:56:47.085777 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-9c59078d-70fe-49b7-96aa-32f6c7666c60 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:56:47.226600 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-9c59078d-70fe-49b7-96aa-32f6c7666c60 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:56:47.235474 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-9c59078d-70fe-49b7-96aa-32f6c7666c60 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf" status: 200 len: 1680 microversion: 2.1 time: 0.163750 Oct 17 14:56:47.235885 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3577/7286] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:56:47 2022] GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:56:48.259612 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0aa3a753-8eb9-4636-9c6e-3c0a740068ee tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:56:48.260223 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0aa3a753-8eb9-4636-9c6e-3c0a740068ee tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: bd93a53c-163b-4ab8-873a-1ce8c5948fbf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:56:48.267646 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0aa3a753-8eb9-4636-9c6e-3c0a740068ee tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:56:48.268135 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0aa3a753-8eb9-4636-9c6e-3c0a740068ee tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:56:48.268591 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0aa3a753-8eb9-4636-9c6e-3c0a740068ee tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:56:48.269316 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0aa3a753-8eb9-4636-9c6e-3c0a740068ee tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:56:48.269769 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0aa3a753-8eb9-4636-9c6e-3c0a740068ee tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:56:48.270196 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0aa3a753-8eb9-4636-9c6e-3c0a740068ee tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:56:48.407155 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0aa3a753-8eb9-4636-9c6e-3c0a740068ee tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:56:48.415857 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0aa3a753-8eb9-4636-9c6e-3c0a740068ee tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf" status: 200 len: 1680 microversion: 2.1 time: 0.160297 Oct 17 14:56:48.416445 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3710/7287] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:56:48 2022] GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:56:49.452389 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ca93cac1-a9f5-4e54-b2a6-7143e4ae3352 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:56:49.453818 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ca93cac1-a9f5-4e54-b2a6-7143e4ae3352 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: bd93a53c-163b-4ab8-873a-1ce8c5948fbf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:56:49.461887 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ca93cac1-a9f5-4e54-b2a6-7143e4ae3352 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:56:49.462380 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ca93cac1-a9f5-4e54-b2a6-7143e4ae3352 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:56:49.462826 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ca93cac1-a9f5-4e54-b2a6-7143e4ae3352 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:56:49.463566 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ca93cac1-a9f5-4e54-b2a6-7143e4ae3352 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:56:49.464013 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ca93cac1-a9f5-4e54-b2a6-7143e4ae3352 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:56:49.464434 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ca93cac1-a9f5-4e54-b2a6-7143e4ae3352 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:56:49.612576 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ca93cac1-a9f5-4e54-b2a6-7143e4ae3352 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:56:49.625098 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ca93cac1-a9f5-4e54-b2a6-7143e4ae3352 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf" status: 200 len: 1680 microversion: 2.1 time: 0.179337 Oct 17 14:56:49.625922 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3578/7288] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:56:49 2022] GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf => generated 1680 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:56:50.656398 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c2eb9b01-b92f-4d48-abc0-693c6bf1569b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:56:50.657018 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c2eb9b01-b92f-4d48-abc0-693c6bf1569b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: bd93a53c-163b-4ab8-873a-1ce8c5948fbf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:56:50.664805 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c2eb9b01-b92f-4d48-abc0-693c6bf1569b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:56:50.665287 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c2eb9b01-b92f-4d48-abc0-693c6bf1569b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:56:50.665717 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c2eb9b01-b92f-4d48-abc0-693c6bf1569b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:56:50.666408 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c2eb9b01-b92f-4d48-abc0-693c6bf1569b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:56:50.666851 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c2eb9b01-b92f-4d48-abc0-693c6bf1569b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:56:50.667295 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c2eb9b01-b92f-4d48-abc0-693c6bf1569b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:56:50.815326 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c2eb9b01-b92f-4d48-abc0-693c6bf1569b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:56:50.823982 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c2eb9b01-b92f-4d48-abc0-693c6bf1569b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf" status: 200 len: 1680 microversion: 2.1 time: 0.171571 Oct 17 14:56:50.824576 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3711/7289] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:56:50 2022] GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:56:51.851366 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-94cf8984-ceca-4c30-82fe-a87cac84b43e tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:56:51.852305 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-94cf8984-ceca-4c30-82fe-a87cac84b43e tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: bd93a53c-163b-4ab8-873a-1ce8c5948fbf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:56:51.862585 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-94cf8984-ceca-4c30-82fe-a87cac84b43e tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:56:51.863528 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-94cf8984-ceca-4c30-82fe-a87cac84b43e tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:56:51.864191 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-94cf8984-ceca-4c30-82fe-a87cac84b43e tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:56:51.864945 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-94cf8984-ceca-4c30-82fe-a87cac84b43e tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:56:51.865411 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-94cf8984-ceca-4c30-82fe-a87cac84b43e tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:56:51.866186 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-94cf8984-ceca-4c30-82fe-a87cac84b43e tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:56:52.014385 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-94cf8984-ceca-4c30-82fe-a87cac84b43e tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:56:52.022593 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-94cf8984-ceca-4c30-82fe-a87cac84b43e tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf" status: 200 len: 1680 microversion: 2.1 time: 0.177714 Oct 17 14:56:52.023208 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3579/7290] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:56:51 2022] GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf => generated 1680 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:56:53.049322 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-133172ab-336d-4b0b-b92e-bc9692bb4934 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:56:53.050870 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-133172ab-336d-4b0b-b92e-bc9692bb4934 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: bd93a53c-163b-4ab8-873a-1ce8c5948fbf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:56:53.059733 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-133172ab-336d-4b0b-b92e-bc9692bb4934 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:56:53.060436 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-133172ab-336d-4b0b-b92e-bc9692bb4934 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:56:53.061022 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-133172ab-336d-4b0b-b92e-bc9692bb4934 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:56:53.062038 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-133172ab-336d-4b0b-b92e-bc9692bb4934 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:56:53.062492 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-133172ab-336d-4b0b-b92e-bc9692bb4934 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:56:53.063045 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-133172ab-336d-4b0b-b92e-bc9692bb4934 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:56:53.221999 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-133172ab-336d-4b0b-b92e-bc9692bb4934 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:56:53.232878 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-133172ab-336d-4b0b-b92e-bc9692bb4934 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf" status: 200 len: 1680 microversion: 2.1 time: 0.189739 Oct 17 14:56:53.233678 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3712/7291] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:56:53 2022] GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf => generated 1680 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:56:54.260397 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4979c6a0-f976-4fb7-a2c2-e72799adf356 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:56:54.261003 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4979c6a0-f976-4fb7-a2c2-e72799adf356 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: bd93a53c-163b-4ab8-873a-1ce8c5948fbf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:56:54.268841 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4979c6a0-f976-4fb7-a2c2-e72799adf356 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:56:54.269354 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4979c6a0-f976-4fb7-a2c2-e72799adf356 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:56:54.269796 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4979c6a0-f976-4fb7-a2c2-e72799adf356 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:56:54.270521 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4979c6a0-f976-4fb7-a2c2-e72799adf356 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:56:54.271000 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4979c6a0-f976-4fb7-a2c2-e72799adf356 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:56:54.271482 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4979c6a0-f976-4fb7-a2c2-e72799adf356 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:56:54.421413 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4979c6a0-f976-4fb7-a2c2-e72799adf356 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:56:54.429886 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4979c6a0-f976-4fb7-a2c2-e72799adf356 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf" status: 200 len: 1701 microversion: 2.1 time: 0.173667 Oct 17 14:56:54.430470 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3580/7292] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:56:54 2022] GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf => generated 1701 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:56:55.454417 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-46d17f0e-fd0b-41ee-97fd-889095c674a1 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:56:55.455011 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-46d17f0e-fd0b-41ee-97fd-889095c674a1 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: bd93a53c-163b-4ab8-873a-1ce8c5948fbf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:56:55.462201 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-46d17f0e-fd0b-41ee-97fd-889095c674a1 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:56:55.462683 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-46d17f0e-fd0b-41ee-97fd-889095c674a1 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:56:55.463111 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-46d17f0e-fd0b-41ee-97fd-889095c674a1 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:56:55.463839 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-46d17f0e-fd0b-41ee-97fd-889095c674a1 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:56:55.464285 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-46d17f0e-fd0b-41ee-97fd-889095c674a1 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:56:55.464810 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-46d17f0e-fd0b-41ee-97fd-889095c674a1 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:56:55.902458 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-46d17f0e-fd0b-41ee-97fd-889095c674a1 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:56:55.910568 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-46d17f0e-fd0b-41ee-97fd-889095c674a1 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf" status: 200 len: 1701 microversion: 2.1 time: 0.460408 Oct 17 14:56:55.911154 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3713/7293] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:56:55 2022] GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf => generated 1701 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:56:56.935264 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c3ee6cef-0b86-4d2f-8d5f-daa669155891 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:56:56.936566 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c3ee6cef-0b86-4d2f-8d5f-daa669155891 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: bd93a53c-163b-4ab8-873a-1ce8c5948fbf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:56:56.945059 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c3ee6cef-0b86-4d2f-8d5f-daa669155891 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:56:56.946706 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c3ee6cef-0b86-4d2f-8d5f-daa669155891 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:56:56.947914 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c3ee6cef-0b86-4d2f-8d5f-daa669155891 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:56:56.949254 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c3ee6cef-0b86-4d2f-8d5f-daa669155891 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:56:56.950408 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c3ee6cef-0b86-4d2f-8d5f-daa669155891 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:56:56.951557 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c3ee6cef-0b86-4d2f-8d5f-daa669155891 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:56:57.151596 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-c3ee6cef-0b86-4d2f-8d5f-daa669155891 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:56:57.160434 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c3ee6cef-0b86-4d2f-8d5f-daa669155891 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf" status: 200 len: 1696 microversion: 2.1 time: 0.229133 Oct 17 14:56:57.162035 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3581/7294] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:56:56 2022] GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf => generated 1696 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:56:57.351641 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-db044785-d353-4bb5-8473-56c1d97a3a4f req-8fcbf99d-3dcb-460f-ae0d-ab2843614db2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd93a53c-163b-4ab8-873a-1ce8c5948fbf", "name": "network-vif-plugged", "status": "completed", "tag": "a1334c85-3169-4c45-99b6-7a3570034347"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:56:57.365413 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-db044785-d353-4bb5-8473-56c1d97a3a4f req-8fcbf99d-3dcb-460f-ae0d-ab2843614db2 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:56:57.369006 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-db044785-d353-4bb5-8473-56c1d97a3a4f req-8fcbf99d-3dcb-460f-ae0d-ab2843614db2 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:56:57.369571 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-db044785-d353-4bb5-8473-56c1d97a3a4f req-8fcbf99d-3dcb-460f-ae0d-ab2843614db2 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:56:57.385819 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-db044785-d353-4bb5-8473-56c1d97a3a4f req-8fcbf99d-3dcb-460f-ae0d-ab2843614db2 service nova] Creating event network-vif-plugged:a1334c85-3169-4c45-99b6-7a3570034347 for instance bd93a53c-163b-4ab8-873a-1ce8c5948fbf on n-h1-854247-14 Oct 17 14:56:57.391670 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-db044785-d353-4bb5-8473-56c1d97a3a4f req-8fcbf99d-3dcb-460f-ae0d-ab2843614db2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176821 Oct 17 14:56:57.394465 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3714/7295] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:56:58.196487 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-af1b8549-308c-48c4-99bc-d42f56dc64a2 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:56:58.197526 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-af1b8549-308c-48c4-99bc-d42f56dc64a2 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: bd93a53c-163b-4ab8-873a-1ce8c5948fbf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:56:58.205502 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-af1b8549-308c-48c4-99bc-d42f56dc64a2 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:56:58.206079 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-af1b8549-308c-48c4-99bc-d42f56dc64a2 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:56:58.206735 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-af1b8549-308c-48c4-99bc-d42f56dc64a2 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:56:58.207549 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-af1b8549-308c-48c4-99bc-d42f56dc64a2 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:56:58.208081 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-af1b8549-308c-48c4-99bc-d42f56dc64a2 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:56:58.208610 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-af1b8549-308c-48c4-99bc-d42f56dc64a2 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:56:58.358346 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-af1b8549-308c-48c4-99bc-d42f56dc64a2 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:56:58.367569 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-af1b8549-308c-48c4-99bc-d42f56dc64a2 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf" status: 200 len: 1696 microversion: 2.1 time: 0.178123 Oct 17 14:56:58.371659 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3582/7296] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:56:58 2022] GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf => generated 1696 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:56:59.399373 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-96ffa399-a359-41d4-a8d5-5f78c56453e0 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:56:59.400005 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-96ffa399-a359-41d4-a8d5-5f78c56453e0 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: bd93a53c-163b-4ab8-873a-1ce8c5948fbf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:56:59.406415 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-96ffa399-a359-41d4-a8d5-5f78c56453e0 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:56:59.407115 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-96ffa399-a359-41d4-a8d5-5f78c56453e0 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:56:59.407783 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-96ffa399-a359-41d4-a8d5-5f78c56453e0 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:56:59.409083 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-96ffa399-a359-41d4-a8d5-5f78c56453e0 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:56:59.409666 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-96ffa399-a359-41d4-a8d5-5f78c56453e0 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:56:59.410634 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-96ffa399-a359-41d4-a8d5-5f78c56453e0 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:56:59.566563 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-96ffa399-a359-41d4-a8d5-5f78c56453e0 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:56:59.576338 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-96ffa399-a359-41d4-a8d5-5f78c56453e0 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf" status: 200 len: 1696 microversion: 2.1 time: 0.183877 Oct 17 14:56:59.577323 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3715/7297] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:56:59 2022] GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf => generated 1696 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:57:00.601428 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ee5910aa-9e33-4115-b111-4ca849b4895a tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:57:00.603392 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ee5910aa-9e33-4115-b111-4ca849b4895a tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: bd93a53c-163b-4ab8-873a-1ce8c5948fbf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:57:00.611273 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ee5910aa-9e33-4115-b111-4ca849b4895a tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:00.611786 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ee5910aa-9e33-4115-b111-4ca849b4895a tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:00.612243 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ee5910aa-9e33-4115-b111-4ca849b4895a tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:00.613023 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ee5910aa-9e33-4115-b111-4ca849b4895a tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:00.613496 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ee5910aa-9e33-4115-b111-4ca849b4895a tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:00.613969 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ee5910aa-9e33-4115-b111-4ca849b4895a tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:00.768695 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ee5910aa-9e33-4115-b111-4ca849b4895a tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:57:00.778206 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ee5910aa-9e33-4115-b111-4ca849b4895a tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf" status: 200 len: 1696 microversion: 2.1 time: 0.181042 Oct 17 14:57:00.779471 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3583/7298] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:57:00 2022] GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf => generated 1696 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:57:01.803862 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1a831bed-ce6c-4568-9544-54c47472d092 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:57:01.805395 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-1a831bed-ce6c-4568-9544-54c47472d092 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: bd93a53c-163b-4ab8-873a-1ce8c5948fbf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:57:01.813780 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1a831bed-ce6c-4568-9544-54c47472d092 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:01.814376 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1a831bed-ce6c-4568-9544-54c47472d092 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:01.815068 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1a831bed-ce6c-4568-9544-54c47472d092 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:01.816064 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1a831bed-ce6c-4568-9544-54c47472d092 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:01.816732 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1a831bed-ce6c-4568-9544-54c47472d092 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:01.817250 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1a831bed-ce6c-4568-9544-54c47472d092 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:01.961072 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-1a831bed-ce6c-4568-9544-54c47472d092 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:57:01.969371 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1a831bed-ce6c-4568-9544-54c47472d092 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf" status: 200 len: 1696 microversion: 2.1 time: 0.169881 Oct 17 14:57:01.970275 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3716/7299] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:57:01 2022] GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf => generated 1696 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:57:02.994481 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e2bbddb0-c05b-40ce-b046-ac4117c66ada tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:57:02.995326 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e2bbddb0-c05b-40ce-b046-ac4117c66ada tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: bd93a53c-163b-4ab8-873a-1ce8c5948fbf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:57:03.003111 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e2bbddb0-c05b-40ce-b046-ac4117c66ada tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:03.003729 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e2bbddb0-c05b-40ce-b046-ac4117c66ada tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:03.004258 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e2bbddb0-c05b-40ce-b046-ac4117c66ada tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:03.005061 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e2bbddb0-c05b-40ce-b046-ac4117c66ada tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:03.005530 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e2bbddb0-c05b-40ce-b046-ac4117c66ada tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:03.005975 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e2bbddb0-c05b-40ce-b046-ac4117c66ada tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:03.156904 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e2bbddb0-c05b-40ce-b046-ac4117c66ada tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:57:03.165418 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e2bbddb0-c05b-40ce-b046-ac4117c66ada tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf" status: 200 len: 1696 microversion: 2.1 time: 0.175452 Oct 17 14:57:03.166195 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3584/7300] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:57:02 2022] GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf => generated 1696 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:57:04.189550 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-21cc2c6d-499f-4261-bb76-4743c561fd9b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:57:04.190276 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-21cc2c6d-499f-4261-bb76-4743c561fd9b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: bd93a53c-163b-4ab8-873a-1ce8c5948fbf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:57:04.198325 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-21cc2c6d-499f-4261-bb76-4743c561fd9b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:04.198920 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-21cc2c6d-499f-4261-bb76-4743c561fd9b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:04.199713 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-21cc2c6d-499f-4261-bb76-4743c561fd9b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:04.200152 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-21cc2c6d-499f-4261-bb76-4743c561fd9b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:04.200615 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-21cc2c6d-499f-4261-bb76-4743c561fd9b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:04.201004 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-21cc2c6d-499f-4261-bb76-4743c561fd9b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:04.377628 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-21cc2c6d-499f-4261-bb76-4743c561fd9b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:57:04.385887 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-21cc2c6d-499f-4261-bb76-4743c561fd9b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf" status: 200 len: 1696 microversion: 2.1 time: 0.200439 Oct 17 14:57:04.386785 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3717/7301] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:57:04 2022] GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf => generated 1696 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:57:05.413472 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-67a5a09e-73d9-4563-bf46-f1b93ed8ce3b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:57:05.414094 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-67a5a09e-73d9-4563-bf46-f1b93ed8ce3b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: bd93a53c-163b-4ab8-873a-1ce8c5948fbf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:57:05.421494 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-67a5a09e-73d9-4563-bf46-f1b93ed8ce3b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:05.421995 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-67a5a09e-73d9-4563-bf46-f1b93ed8ce3b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:05.422450 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-67a5a09e-73d9-4563-bf46-f1b93ed8ce3b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:05.423194 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-67a5a09e-73d9-4563-bf46-f1b93ed8ce3b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:05.423669 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-67a5a09e-73d9-4563-bf46-f1b93ed8ce3b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:05.424110 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-67a5a09e-73d9-4563-bf46-f1b93ed8ce3b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:05.557459 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-67a5a09e-73d9-4563-bf46-f1b93ed8ce3b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:57:05.565577 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-67a5a09e-73d9-4563-bf46-f1b93ed8ce3b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf" status: 200 len: 1696 microversion: 2.1 time: 0.158029 Oct 17 14:57:05.566159 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3585/7302] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:57:05 2022] GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf => generated 1696 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:57:06.593476 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-5fc71ab4-189f-4ecb-b32e-0dd1c9afd677 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:57:06.594549 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-5fc71ab4-189f-4ecb-b32e-0dd1c9afd677 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: bd93a53c-163b-4ab8-873a-1ce8c5948fbf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:57:06.606922 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5fc71ab4-189f-4ecb-b32e-0dd1c9afd677 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:06.607725 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5fc71ab4-189f-4ecb-b32e-0dd1c9afd677 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:06.608380 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5fc71ab4-189f-4ecb-b32e-0dd1c9afd677 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:06.609437 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5fc71ab4-189f-4ecb-b32e-0dd1c9afd677 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:06.610122 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5fc71ab4-189f-4ecb-b32e-0dd1c9afd677 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:06.610713 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-5fc71ab4-189f-4ecb-b32e-0dd1c9afd677 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:06.757118 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-5fc71ab4-189f-4ecb-b32e-0dd1c9afd677 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:57:06.768708 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-5fc71ab4-189f-4ecb-b32e-0dd1c9afd677 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf" status: 200 len: 1678 microversion: 2.1 time: 0.182414 Oct 17 14:57:06.769354 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3718/7303] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:57:06 2022] GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf => generated 1678 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:57:07.796724 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-db6352b2-bc17-4261-9ffd-5c51a8a28f93 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:57:07.797565 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-db6352b2-bc17-4261-9ffd-5c51a8a28f93 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: bd93a53c-163b-4ab8-873a-1ce8c5948fbf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:57:07.804949 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db6352b2-bc17-4261-9ffd-5c51a8a28f93 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:07.805474 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db6352b2-bc17-4261-9ffd-5c51a8a28f93 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:07.806072 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db6352b2-bc17-4261-9ffd-5c51a8a28f93 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:07.806809 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db6352b2-bc17-4261-9ffd-5c51a8a28f93 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:07.807585 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db6352b2-bc17-4261-9ffd-5c51a8a28f93 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:07.808238 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-db6352b2-bc17-4261-9ffd-5c51a8a28f93 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:07.954934 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-db6352b2-bc17-4261-9ffd-5c51a8a28f93 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:57:07.967811 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-db6352b2-bc17-4261-9ffd-5c51a8a28f93 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf" status: 200 len: 1681 microversion: 2.1 time: 0.176165 Oct 17 14:57:07.968492 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3586/7304] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:57:07 2022] GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf => generated 1681 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:57:07.992096 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a8dce5fd-3e91-44ed-8d51-722f83dd3873 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:57:07.992695 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a8dce5fd-3e91-44ed-8d51-722f83dd3873 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: bd93a53c-163b-4ab8-873a-1ce8c5948fbf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:57:08.000582 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a8dce5fd-3e91-44ed-8d51-722f83dd3873 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:08.001067 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a8dce5fd-3e91-44ed-8d51-722f83dd3873 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:08.001500 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a8dce5fd-3e91-44ed-8d51-722f83dd3873 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:08.002195 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a8dce5fd-3e91-44ed-8d51-722f83dd3873 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:08.002647 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a8dce5fd-3e91-44ed-8d51-722f83dd3873 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:08.003072 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a8dce5fd-3e91-44ed-8d51-722f83dd3873 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:08.050218 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a8dce5fd-3e91-44ed-8d51-722f83dd3873 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: bd93a53c-163b-4ab8-873a-1ce8c5948fbf] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127016) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 17 14:57:08.126766 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a8dce5fd-3e91-44ed-8d51-722f83dd3873 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "POST /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf/action" status: 202 len: 0 microversion: 2.1 time: 0.138935 Oct 17 14:57:08.127785 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3719/7305] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 14:57:07 2022] POST /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:57:08.136163 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-933273f4-53c0-4567-a6a4-9cb8bd0510fd tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:57:08.137167 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-933273f4-53c0-4567-a6a4-9cb8bd0510fd tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: bd93a53c-163b-4ab8-873a-1ce8c5948fbf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:57:08.144330 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-933273f4-53c0-4567-a6a4-9cb8bd0510fd tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:08.144891 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-933273f4-53c0-4567-a6a4-9cb8bd0510fd tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:08.145336 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-933273f4-53c0-4567-a6a4-9cb8bd0510fd tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:08.146078 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-933273f4-53c0-4567-a6a4-9cb8bd0510fd tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:08.146732 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-933273f4-53c0-4567-a6a4-9cb8bd0510fd tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:08.147204 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-933273f4-53c0-4567-a6a4-9cb8bd0510fd tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:08.287454 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-933273f4-53c0-4567-a6a4-9cb8bd0510fd tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:57:08.296015 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-933273f4-53c0-4567-a6a4-9cb8bd0510fd tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf" status: 200 len: 1629 microversion: 2.1 time: 0.164122 Oct 17 14:57:08.296639 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3587/7306] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:57:08 2022] GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf => generated 1629 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:57:09.182748 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-b052cbf3-e906-433b-bbb7-9b1c2760f7c6 req-17b3e08a-7809-469c-aeea-93bfa4318804 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd93a53c-163b-4ab8-873a-1ce8c5948fbf", "name": "network-vif-unplugged", "status": "completed", "tag": "a1334c85-3169-4c45-99b6-7a3570034347"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:57:09.197298 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-b052cbf3-e906-433b-bbb7-9b1c2760f7c6 req-17b3e08a-7809-469c-aeea-93bfa4318804 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:09.197963 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-b052cbf3-e906-433b-bbb7-9b1c2760f7c6 req-17b3e08a-7809-469c-aeea-93bfa4318804 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:09.198401 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-b052cbf3-e906-433b-bbb7-9b1c2760f7c6 req-17b3e08a-7809-469c-aeea-93bfa4318804 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:09.210640 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-b052cbf3-e906-433b-bbb7-9b1c2760f7c6 req-17b3e08a-7809-469c-aeea-93bfa4318804 service nova] Creating event network-vif-unplugged:a1334c85-3169-4c45-99b6-7a3570034347 for instance bd93a53c-163b-4ab8-873a-1ce8c5948fbf on n-h2-854247-14 Oct 17 14:57:09.217277 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-b052cbf3-e906-433b-bbb7-9b1c2760f7c6 req-17b3e08a-7809-469c-aeea-93bfa4318804 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040206 Oct 17 14:57:09.217899 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3720/7307] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:57:09.319678 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-55f370f9-f2f8-4944-bf5e-79928248f2d0 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:57:09.320233 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-55f370f9-f2f8-4944-bf5e-79928248f2d0 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: bd93a53c-163b-4ab8-873a-1ce8c5948fbf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:57:09.328724 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-55f370f9-f2f8-4944-bf5e-79928248f2d0 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:09.329229 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-55f370f9-f2f8-4944-bf5e-79928248f2d0 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:09.329684 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-55f370f9-f2f8-4944-bf5e-79928248f2d0 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:09.331070 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-55f370f9-f2f8-4944-bf5e-79928248f2d0 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:09.331575 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-55f370f9-f2f8-4944-bf5e-79928248f2d0 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:09.332020 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-55f370f9-f2f8-4944-bf5e-79928248f2d0 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:09.477582 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-55f370f9-f2f8-4944-bf5e-79928248f2d0 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:57:09.488739 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-55f370f9-f2f8-4944-bf5e-79928248f2d0 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf" status: 200 len: 1687 microversion: 2.1 time: 0.173263 Oct 17 14:57:09.492160 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3588/7308] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:57:09 2022] GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf => generated 1687 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:57:10.489076 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-d23df48a-d387-4e98-bf26-b8412b58bf57 req-173587b1-d3a4-4178-aa31-f20fe3301510 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd93a53c-163b-4ab8-873a-1ce8c5948fbf", "tag": "a1334c85-3169-4c45-99b6-7a3570034347"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:57:10.499662 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-d23df48a-d387-4e98-bf26-b8412b58bf57 req-173587b1-d3a4-4178-aa31-f20fe3301510 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:10.500135 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-d23df48a-d387-4e98-bf26-b8412b58bf57 req-173587b1-d3a4-4178-aa31-f20fe3301510 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:10.500557 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-d23df48a-d387-4e98-bf26-b8412b58bf57 req-173587b1-d3a4-4178-aa31-f20fe3301510 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:10.516688 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-449aa513-9dab-451b-a1e5-66352195dc10 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:57:10.517759 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-449aa513-9dab-451b-a1e5-66352195dc10 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: bd93a53c-163b-4ab8-873a-1ce8c5948fbf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:57:10.518353 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-d23df48a-d387-4e98-bf26-b8412b58bf57 req-173587b1-d3a4-4178-aa31-f20fe3301510 service nova] Creating event network-changed:a1334c85-3169-4c45-99b6-7a3570034347 for instance bd93a53c-163b-4ab8-873a-1ce8c5948fbf on n-h2-854247-14 Oct 17 14:57:10.526649 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-449aa513-9dab-451b-a1e5-66352195dc10 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:10.527535 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-449aa513-9dab-451b-a1e5-66352195dc10 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:10.528342 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-449aa513-9dab-451b-a1e5-66352195dc10 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:10.529450 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-d23df48a-d387-4e98-bf26-b8412b58bf57 req-173587b1-d3a4-4178-aa31-f20fe3301510 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104392 Oct 17 14:57:10.529596 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-449aa513-9dab-451b-a1e5-66352195dc10 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:10.529780 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3721/7309] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:57:10.530210 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-449aa513-9dab-451b-a1e5-66352195dc10 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:10.530722 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-449aa513-9dab-451b-a1e5-66352195dc10 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:10.554549 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:57:10.750371 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-449aa513-9dab-451b-a1e5-66352195dc10 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:57:10.760308 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-449aa513-9dab-451b-a1e5-66352195dc10 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf" status: 200 len: 1687 microversion: 2.1 time: 0.250295 Oct 17 14:57:10.760908 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3589/7310] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:57:10 2022] GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf => generated 1687 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:57:11.784910 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-24824b52-6d5a-4b95-a386-c6c6d232bcf7 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:57:11.786256 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-24824b52-6d5a-4b95-a386-c6c6d232bcf7 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: bd93a53c-163b-4ab8-873a-1ce8c5948fbf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:57:11.794775 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-24824b52-6d5a-4b95-a386-c6c6d232bcf7 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:11.795572 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-24824b52-6d5a-4b95-a386-c6c6d232bcf7 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:11.796164 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-24824b52-6d5a-4b95-a386-c6c6d232bcf7 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:11.797036 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-24824b52-6d5a-4b95-a386-c6c6d232bcf7 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:11.797683 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-24824b52-6d5a-4b95-a386-c6c6d232bcf7 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:11.798408 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-24824b52-6d5a-4b95-a386-c6c6d232bcf7 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:11.950870 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-24824b52-6d5a-4b95-a386-c6c6d232bcf7 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:57:11.961469 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-24824b52-6d5a-4b95-a386-c6c6d232bcf7 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf" status: 200 len: 1687 microversion: 2.1 time: 0.180695 Oct 17 14:57:11.963150 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3722/7311] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:57:11 2022] GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf => generated 1687 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:57:12.986024 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-2beccbc0-074c-43b9-b499-2d1c5d7746b3 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:57:12.986653 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-2beccbc0-074c-43b9-b499-2d1c5d7746b3 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: bd93a53c-163b-4ab8-873a-1ce8c5948fbf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:57:12.993904 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2beccbc0-074c-43b9-b499-2d1c5d7746b3 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:12.994400 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2beccbc0-074c-43b9-b499-2d1c5d7746b3 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:12.994880 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2beccbc0-074c-43b9-b499-2d1c5d7746b3 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:12.995606 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2beccbc0-074c-43b9-b499-2d1c5d7746b3 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:12.996069 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2beccbc0-074c-43b9-b499-2d1c5d7746b3 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:12.996504 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-2beccbc0-074c-43b9-b499-2d1c5d7746b3 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:13.177798 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-2beccbc0-074c-43b9-b499-2d1c5d7746b3 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:57:13.186831 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-2beccbc0-074c-43b9-b499-2d1c5d7746b3 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf" status: 200 len: 1687 microversion: 2.1 time: 0.204784 Oct 17 14:57:13.187454 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3590/7312] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:57:12 2022] GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf => generated 1687 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:57:14.211810 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-1f7087b3-df1c-4cd2-8b16-31885d0322d8 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:57:14.212404 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-1f7087b3-df1c-4cd2-8b16-31885d0322d8 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: bd93a53c-163b-4ab8-873a-1ce8c5948fbf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:57:14.215919 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:57:14.221773 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1f7087b3-df1c-4cd2-8b16-31885d0322d8 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:14.222264 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1f7087b3-df1c-4cd2-8b16-31885d0322d8 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:14.222699 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1f7087b3-df1c-4cd2-8b16-31885d0322d8 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:14.223453 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1f7087b3-df1c-4cd2-8b16-31885d0322d8 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:14.223941 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1f7087b3-df1c-4cd2-8b16-31885d0322d8 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:14.224338 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-1f7087b3-df1c-4cd2-8b16-31885d0322d8 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:14.228270 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:57:14.382877 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-1f7087b3-df1c-4cd2-8b16-31885d0322d8 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:57:14.392943 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-1f7087b3-df1c-4cd2-8b16-31885d0322d8 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf" status: 200 len: 1687 microversion: 2.1 time: 0.186061 Oct 17 14:57:14.408538 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3723/7313] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:57:14 2022] GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf => generated 1687 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:57:15.419623 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ab5d0b36-5996-4e97-bc48-73cb24ab3937 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:57:15.420174 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ab5d0b36-5996-4e97-bc48-73cb24ab3937 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: bd93a53c-163b-4ab8-873a-1ce8c5948fbf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:57:15.426656 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=33 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:57:15.428150 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ab5d0b36-5996-4e97-bc48-73cb24ab3937 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:15.428611 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ab5d0b36-5996-4e97-bc48-73cb24ab3937 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:15.429142 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ab5d0b36-5996-4e97-bc48-73cb24ab3937 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:15.429865 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ab5d0b36-5996-4e97-bc48-73cb24ab3937 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:15.430337 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ab5d0b36-5996-4e97-bc48-73cb24ab3937 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:15.430831 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-ab5d0b36-5996-4e97-bc48-73cb24ab3937 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:15.641240 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ab5d0b36-5996-4e97-bc48-73cb24ab3937 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:57:15.653283 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ab5d0b36-5996-4e97-bc48-73cb24ab3937 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf" status: 200 len: 1687 microversion: 2.1 time: 0.238344 Oct 17 14:57:15.654413 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3591/7314] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:57:15 2022] GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf => generated 1687 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:57:16.678520 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-c6ad7fae-2505-4364-8288-b1de0fd2f416 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:57:16.679076 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-c6ad7fae-2505-4364-8288-b1de0fd2f416 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: bd93a53c-163b-4ab8-873a-1ce8c5948fbf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:57:16.686075 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c6ad7fae-2505-4364-8288-b1de0fd2f416 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:16.686565 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c6ad7fae-2505-4364-8288-b1de0fd2f416 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:16.687001 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c6ad7fae-2505-4364-8288-b1de0fd2f416 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:16.687748 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c6ad7fae-2505-4364-8288-b1de0fd2f416 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:16.688204 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c6ad7fae-2505-4364-8288-b1de0fd2f416 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:16.688632 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-c6ad7fae-2505-4364-8288-b1de0fd2f416 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:16.852086 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-c6ad7fae-2505-4364-8288-b1de0fd2f416 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:57:16.860609 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-c6ad7fae-2505-4364-8288-b1de0fd2f416 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf" status: 200 len: 1687 microversion: 2.1 time: 0.186425 Oct 17 14:57:16.861215 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3724/7315] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:57:16 2022] GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf => generated 1687 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:57:17.885512 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f35ccff6-1337-457b-b0bc-2833e30c0886 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:57:17.886371 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f35ccff6-1337-457b-b0bc-2833e30c0886 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: bd93a53c-163b-4ab8-873a-1ce8c5948fbf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:57:17.893812 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f35ccff6-1337-457b-b0bc-2833e30c0886 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:17.894364 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f35ccff6-1337-457b-b0bc-2833e30c0886 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:17.894882 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f35ccff6-1337-457b-b0bc-2833e30c0886 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:17.895736 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f35ccff6-1337-457b-b0bc-2833e30c0886 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:17.896275 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f35ccff6-1337-457b-b0bc-2833e30c0886 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:17.896783 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f35ccff6-1337-457b-b0bc-2833e30c0886 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:18.068322 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f35ccff6-1337-457b-b0bc-2833e30c0886 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:57:18.077933 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f35ccff6-1337-457b-b0bc-2833e30c0886 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf" status: 200 len: 1687 microversion: 2.1 time: 0.196485 Oct 17 14:57:18.078658 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3592/7316] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:57:17 2022] GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf => generated 1687 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:57:19.105393 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e75ec950-966d-405e-adab-dcab6072e7ba tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:57:19.108646 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e75ec950-966d-405e-adab-dcab6072e7ba tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: bd93a53c-163b-4ab8-873a-1ce8c5948fbf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:57:19.116927 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e75ec950-966d-405e-adab-dcab6072e7ba tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:19.117410 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e75ec950-966d-405e-adab-dcab6072e7ba tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:19.117844 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e75ec950-966d-405e-adab-dcab6072e7ba tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:19.118517 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e75ec950-966d-405e-adab-dcab6072e7ba tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:19.118966 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e75ec950-966d-405e-adab-dcab6072e7ba tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:19.119423 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e75ec950-966d-405e-adab-dcab6072e7ba tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:19.275870 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e75ec950-966d-405e-adab-dcab6072e7ba tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:57:19.284416 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e75ec950-966d-405e-adab-dcab6072e7ba tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf" status: 200 len: 1687 microversion: 2.1 time: 0.184993 Oct 17 14:57:19.285005 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3725/7317] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:57:19 2022] GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf => generated 1687 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:57:20.312765 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4ebcbd0f-05d5-4684-aaa6-64786af777d6 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:57:20.313436 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4ebcbd0f-05d5-4684-aaa6-64786af777d6 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: bd93a53c-163b-4ab8-873a-1ce8c5948fbf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:57:20.320582 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4ebcbd0f-05d5-4684-aaa6-64786af777d6 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:20.321084 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4ebcbd0f-05d5-4684-aaa6-64786af777d6 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:20.321529 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4ebcbd0f-05d5-4684-aaa6-64786af777d6 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:20.322230 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4ebcbd0f-05d5-4684-aaa6-64786af777d6 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:20.322725 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4ebcbd0f-05d5-4684-aaa6-64786af777d6 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:20.323493 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4ebcbd0f-05d5-4684-aaa6-64786af777d6 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:20.469669 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4ebcbd0f-05d5-4684-aaa6-64786af777d6 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:57:20.482399 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4ebcbd0f-05d5-4684-aaa6-64786af777d6 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf" status: 200 len: 1687 microversion: 2.1 time: 0.173593 Oct 17 14:57:20.482981 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3593/7318] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:57:20 2022] GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf => generated 1687 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:57:21.510472 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-6dafe504-c1d0-47b2-b5dd-b243dde15a78 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:57:21.511148 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-6dafe504-c1d0-47b2-b5dd-b243dde15a78 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: bd93a53c-163b-4ab8-873a-1ce8c5948fbf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:57:21.520288 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6dafe504-c1d0-47b2-b5dd-b243dde15a78 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:21.520771 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6dafe504-c1d0-47b2-b5dd-b243dde15a78 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:21.521213 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6dafe504-c1d0-47b2-b5dd-b243dde15a78 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:21.521911 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6dafe504-c1d0-47b2-b5dd-b243dde15a78 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:21.522368 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6dafe504-c1d0-47b2-b5dd-b243dde15a78 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:21.522789 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-6dafe504-c1d0-47b2-b5dd-b243dde15a78 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:21.670991 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-6dafe504-c1d0-47b2-b5dd-b243dde15a78 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:57:21.678974 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-6dafe504-c1d0-47b2-b5dd-b243dde15a78 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf" status: 200 len: 1687 microversion: 2.1 time: 0.172543 Oct 17 14:57:21.679580 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3726/7319] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:57:21 2022] GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf => generated 1687 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:57:22.702576 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d2908163-bf85-4040-ba3a-8447094cb548 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:57:22.703261 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d2908163-bf85-4040-ba3a-8447094cb548 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: bd93a53c-163b-4ab8-873a-1ce8c5948fbf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:57:22.710536 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d2908163-bf85-4040-ba3a-8447094cb548 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:22.711028 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d2908163-bf85-4040-ba3a-8447094cb548 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:22.711482 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d2908163-bf85-4040-ba3a-8447094cb548 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:22.712209 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d2908163-bf85-4040-ba3a-8447094cb548 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:22.712645 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d2908163-bf85-4040-ba3a-8447094cb548 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:22.713082 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d2908163-bf85-4040-ba3a-8447094cb548 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:22.864907 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d2908163-bf85-4040-ba3a-8447094cb548 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:57:22.873307 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d2908163-bf85-4040-ba3a-8447094cb548 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf" status: 200 len: 1687 microversion: 2.1 time: 0.174869 Oct 17 14:57:22.873971 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3594/7320] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:57:22 2022] GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf => generated 1687 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:57:23.902570 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3cdc9ba1-1782-4407-b8fc-650a1d4e34fd tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:57:23.903634 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3cdc9ba1-1782-4407-b8fc-650a1d4e34fd tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: bd93a53c-163b-4ab8-873a-1ce8c5948fbf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:57:23.912874 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3cdc9ba1-1782-4407-b8fc-650a1d4e34fd tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:23.913358 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3cdc9ba1-1782-4407-b8fc-650a1d4e34fd tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:23.913791 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3cdc9ba1-1782-4407-b8fc-650a1d4e34fd tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:23.914485 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3cdc9ba1-1782-4407-b8fc-650a1d4e34fd tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:23.914967 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3cdc9ba1-1782-4407-b8fc-650a1d4e34fd tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:23.915417 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3cdc9ba1-1782-4407-b8fc-650a1d4e34fd tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:24.081341 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3cdc9ba1-1782-4407-b8fc-650a1d4e34fd tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:57:24.093763 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3cdc9ba1-1782-4407-b8fc-650a1d4e34fd tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf" status: 200 len: 1687 microversion: 2.1 time: 0.197857 Oct 17 14:57:24.094710 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3727/7321] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:57:23 2022] GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf => generated 1687 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:57:24.550656 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-316bfe6a-dd06-44b1-a8f5-24576bb37f1e req-a8911007-6aa4-4036-bd88-a8ce8ef9cf11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd93a53c-163b-4ab8-873a-1ce8c5948fbf", "name": "network-vif-plugged", "status": "completed", "tag": "a1334c85-3169-4c45-99b6-7a3570034347"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:57:24.562619 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-316bfe6a-dd06-44b1-a8f5-24576bb37f1e req-a8911007-6aa4-4036-bd88-a8ce8ef9cf11 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:24.563139 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-316bfe6a-dd06-44b1-a8f5-24576bb37f1e req-a8911007-6aa4-4036-bd88-a8ce8ef9cf11 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:24.563667 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-316bfe6a-dd06-44b1-a8f5-24576bb37f1e req-a8911007-6aa4-4036-bd88-a8ce8ef9cf11 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:24.576766 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-316bfe6a-dd06-44b1-a8f5-24576bb37f1e req-a8911007-6aa4-4036-bd88-a8ce8ef9cf11 service nova] Creating event network-vif-plugged:a1334c85-3169-4c45-99b6-7a3570034347 for instance bd93a53c-163b-4ab8-873a-1ce8c5948fbf on n-h2-854247-14 Oct 17 14:57:24.583053 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-316bfe6a-dd06-44b1-a8f5-24576bb37f1e req-a8911007-6aa4-4036-bd88-a8ce8ef9cf11 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037013 Oct 17 14:57:24.583848 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3595/7322] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:57:25.127771 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7e151ed1-e293-498c-ac37-a2d08313f2d9 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:57:25.128690 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7e151ed1-e293-498c-ac37-a2d08313f2d9 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: bd93a53c-163b-4ab8-873a-1ce8c5948fbf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:57:25.138154 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7e151ed1-e293-498c-ac37-a2d08313f2d9 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:25.138832 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7e151ed1-e293-498c-ac37-a2d08313f2d9 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:25.139528 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7e151ed1-e293-498c-ac37-a2d08313f2d9 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:25.140546 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7e151ed1-e293-498c-ac37-a2d08313f2d9 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:25.141151 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7e151ed1-e293-498c-ac37-a2d08313f2d9 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:25.141695 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7e151ed1-e293-498c-ac37-a2d08313f2d9 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:25.297622 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7e151ed1-e293-498c-ac37-a2d08313f2d9 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:57:25.307058 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7e151ed1-e293-498c-ac37-a2d08313f2d9 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf" status: 200 len: 1687 microversion: 2.1 time: 0.183766 Oct 17 14:57:25.307688 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3728/7323] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:57:25 2022] GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf => generated 1687 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:57:26.334367 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b11d68ec-5cfe-426d-b0ab-0ed70ba3420e tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:57:26.335287 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b11d68ec-5cfe-426d-b0ab-0ed70ba3420e tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: bd93a53c-163b-4ab8-873a-1ce8c5948fbf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:57:26.341897 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b11d68ec-5cfe-426d-b0ab-0ed70ba3420e tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:26.342403 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b11d68ec-5cfe-426d-b0ab-0ed70ba3420e tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:26.342859 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b11d68ec-5cfe-426d-b0ab-0ed70ba3420e tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:26.343605 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b11d68ec-5cfe-426d-b0ab-0ed70ba3420e tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:26.344069 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b11d68ec-5cfe-426d-b0ab-0ed70ba3420e tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:26.344509 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b11d68ec-5cfe-426d-b0ab-0ed70ba3420e tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:26.489953 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b11d68ec-5cfe-426d-b0ab-0ed70ba3420e tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:57:26.498950 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b11d68ec-5cfe-426d-b0ab-0ed70ba3420e tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf" status: 200 len: 1687 microversion: 2.1 time: 0.171178 Oct 17 14:57:26.499701 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3596/7324] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:57:26 2022] GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf => generated 1687 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:57:27.525155 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ced63146-99f2-4297-a32a-b25fa23c6e21 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:57:27.525861 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ced63146-99f2-4297-a32a-b25fa23c6e21 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: bd93a53c-163b-4ab8-873a-1ce8c5948fbf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:57:27.535113 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ced63146-99f2-4297-a32a-b25fa23c6e21 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:27.535789 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ced63146-99f2-4297-a32a-b25fa23c6e21 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:27.536352 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ced63146-99f2-4297-a32a-b25fa23c6e21 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:27.537107 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ced63146-99f2-4297-a32a-b25fa23c6e21 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:27.537766 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ced63146-99f2-4297-a32a-b25fa23c6e21 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:27.538203 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ced63146-99f2-4297-a32a-b25fa23c6e21 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:27.694311 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ced63146-99f2-4297-a32a-b25fa23c6e21 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:57:27.704021 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ced63146-99f2-4297-a32a-b25fa23c6e21 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf" status: 200 len: 1674 microversion: 2.1 time: 0.184323 Oct 17 14:57:27.704758 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3729/7325] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:57:27 2022] GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf => generated 1674 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:58:37.200862 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=11 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:58:37.201816 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=40 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:58:37.203560 n-d-854247-14 devstack@n-api.service[127017]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 14:58:37.203728 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=13 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:58:37.204124 n-d-854247-14 devstack@n-api.service[127017]: Mon Oct 17 14:58:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf (ip 10.222.0.79) !!! Oct 17 14:58:37.204512 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=41 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:58:37.205835 n-d-854247-14 devstack@n-api.service[127016]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 14:58:37.205975 n-d-854247-14 devstack@n-api.service[127016]: Mon Oct 17 14:58:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.79) !!! Oct 17 14:58:37.206487 n-d-854247-14 devstack@n-api.service[127017]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 14:58:37.207934 n-d-854247-14 devstack@n-api.service[127017]: Mon Oct 17 14:58:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf (ip 10.222.0.79) !!! Oct 17 14:58:37.219922 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-aa2617fd-e3cf-4188-b302-f8ae15cb3624 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:58:37.220476 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-aa2617fd-e3cf-4188-b302-f8ae15cb3624 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: bd93a53c-163b-4ab8-873a-1ce8c5948fbf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:58:37.238730 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aa2617fd-e3cf-4188-b302-f8ae15cb3624 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:58:37.239325 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aa2617fd-e3cf-4188-b302-f8ae15cb3624 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:58:37.239693 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aa2617fd-e3cf-4188-b302-f8ae15cb3624 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:58:37.240806 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aa2617fd-e3cf-4188-b302-f8ae15cb3624 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:58:37.241215 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aa2617fd-e3cf-4188-b302-f8ae15cb3624 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:58:37.241727 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-aa2617fd-e3cf-4188-b302-f8ae15cb3624 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:58:37.271361 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-aa2617fd-e3cf-4188-b302-f8ae15cb3624 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: bd93a53c-163b-4ab8-873a-1ce8c5948fbf] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:58:37.278373 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-3b65b5a7-01d3-4ba6-b2c0-48a26f200a1a req-83ebd942-4521-447c-87f9-ad6f38943d76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd93a53c-163b-4ab8-873a-1ce8c5948fbf", "tag": "a1334c85-3169-4c45-99b6-7a3570034347"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:58:37.291078 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-3b65b5a7-01d3-4ba6-b2c0-48a26f200a1a req-83ebd942-4521-447c-87f9-ad6f38943d76 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:58:37.291605 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-3b65b5a7-01d3-4ba6-b2c0-48a26f200a1a req-83ebd942-4521-447c-87f9-ad6f38943d76 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:58:37.292049 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-3b65b5a7-01d3-4ba6-b2c0-48a26f200a1a req-83ebd942-4521-447c-87f9-ad6f38943d76 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:58:37.304738 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-3b65b5a7-01d3-4ba6-b2c0-48a26f200a1a req-83ebd942-4521-447c-87f9-ad6f38943d76 service nova] Creating event network-changed:a1334c85-3169-4c45-99b6-7a3570034347 for instance bd93a53c-163b-4ab8-873a-1ce8c5948fbf on n-h2-854247-14 Oct 17 14:58:37.310235 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-3b65b5a7-01d3-4ba6-b2c0-48a26f200a1a req-83ebd942-4521-447c-87f9-ad6f38943d76 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108767 Oct 17 14:58:37.311300 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3730/7326] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:58:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:58:37.368466 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-aa2617fd-e3cf-4188-b302-f8ae15cb3624 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "DELETE /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf" status: 204 len: 0 microversion: 2.1 time: 0.169340 Oct 17 14:58:37.373091 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3597/7327] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 14:58:37 2022] DELETE /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:58:37.378912 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-14713488-8951-45a1-a7a1-f590e7649682 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:58:37.379852 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-14713488-8951-45a1-a7a1-f590e7649682 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: bd93a53c-163b-4ab8-873a-1ce8c5948fbf] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:58:37.389695 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-14713488-8951-45a1-a7a1-f590e7649682 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:58:37.390188 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-14713488-8951-45a1-a7a1-f590e7649682 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:58:37.390771 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-14713488-8951-45a1-a7a1-f590e7649682 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:58:37.391556 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-14713488-8951-45a1-a7a1-f590e7649682 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:58:37.392015 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-14713488-8951-45a1-a7a1-f590e7649682 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:58:37.392439 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-14713488-8951-45a1-a7a1-f590e7649682 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:58:37.597296 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-14713488-8951-45a1-a7a1-f590e7649682 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:58:37.605794 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-14713488-8951-45a1-a7a1-f590e7649682 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf" status: 200 len: 1680 microversion: 2.1 time: 0.231209 Oct 17 14:58:37.606412 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3731/7328] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:58:37 2022] GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf => generated 1680 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:58:38.630923 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4f5b52b6-d3ff-4d7d-b436-931f55dbe40e tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:58:38.631672 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4f5b52b6-d3ff-4d7d-b436-931f55dbe40e tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: bd93a53c-163b-4ab8-873a-1ce8c5948fbf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:58:38.639412 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4f5b52b6-d3ff-4d7d-b436-931f55dbe40e tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:58:38.639918 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4f5b52b6-d3ff-4d7d-b436-931f55dbe40e tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:58:38.640369 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4f5b52b6-d3ff-4d7d-b436-931f55dbe40e tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:58:38.641077 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4f5b52b6-d3ff-4d7d-b436-931f55dbe40e tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:58:38.641539 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4f5b52b6-d3ff-4d7d-b436-931f55dbe40e tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:58:38.641978 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4f5b52b6-d3ff-4d7d-b436-931f55dbe40e tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:58:39.251502 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4f5b52b6-d3ff-4d7d-b436-931f55dbe40e tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:58:39.259679 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4f5b52b6-d3ff-4d7d-b436-931f55dbe40e tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf" status: 200 len: 1680 microversion: 2.1 time: 0.633117 Oct 17 14:58:39.260308 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3598/7329] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:58:38 2022] GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf => generated 1680 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:58:39.681623 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-ad671d22-cacc-4bfa-b6a5-89a10af35205 req-973b08ac-cc3f-421d-83ee-39a6733e6e3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd93a53c-163b-4ab8-873a-1ce8c5948fbf", "name": "network-vif-deleted", "tag": "a1334c85-3169-4c45-99b6-7a3570034347"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:58:39.693824 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-ad671d22-cacc-4bfa-b6a5-89a10af35205 req-973b08ac-cc3f-421d-83ee-39a6733e6e3c service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:58:39.694384 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-ad671d22-cacc-4bfa-b6a5-89a10af35205 req-973b08ac-cc3f-421d-83ee-39a6733e6e3c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:58:39.694874 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-ad671d22-cacc-4bfa-b6a5-89a10af35205 req-973b08ac-cc3f-421d-83ee-39a6733e6e3c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:58:39.707094 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-ad671d22-cacc-4bfa-b6a5-89a10af35205 req-973b08ac-cc3f-421d-83ee-39a6733e6e3c service nova] Creating event network-vif-deleted:a1334c85-3169-4c45-99b6-7a3570034347 for instance bd93a53c-163b-4ab8-873a-1ce8c5948fbf on n-h2-854247-14 Oct 17 14:58:39.712402 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-ad671d22-cacc-4bfa-b6a5-89a10af35205 req-973b08ac-cc3f-421d-83ee-39a6733e6e3c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034713 Oct 17 14:58:39.713016 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3732/7330] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:58:40.284241 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-639ccced-46ea-4436-8b92-459a31542db7 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:58:40.284893 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-639ccced-46ea-4436-8b92-459a31542db7 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: bd93a53c-163b-4ab8-873a-1ce8c5948fbf] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:58:40.292208 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-639ccced-46ea-4436-8b92-459a31542db7 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:58:40.292698 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-639ccced-46ea-4436-8b92-459a31542db7 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:58:40.293201 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-639ccced-46ea-4436-8b92-459a31542db7 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:58:40.293837 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-639ccced-46ea-4436-8b92-459a31542db7 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:58:40.294313 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-639ccced-46ea-4436-8b92-459a31542db7 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:58:40.294728 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-639ccced-46ea-4436-8b92-459a31542db7 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:58:40.309226 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-639ccced-46ea-4436-8b92-459a31542db7 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] HTTP exception thrown: Instance bd93a53c-163b-4ab8-873a-1ce8c5948fbf could not be found. Oct 17 14:58:40.310948 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-639ccced-46ea-4436-8b92-459a31542db7 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Request method failure captured: Oct 17 14:58:40.310948 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf HTTP/1.1 Oct 17 14:58:40.310948 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 14:58:40.310948 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 14:58:40.310948 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 14:58:40.310948 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 14:58:40.310948 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 14:58:40.310948 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 14:58:40.310948 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 14:58:40.310948 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 14:58:40.310948 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTWyj8IeUvDLkiyGMVxAxDHw2IGRlt70sHDB6eJrxR56M2bSGNDhH9OzIJFgKZq7Kfit6FrITP_0hCbyCfDQ6MZVqhHMoQGpGK1lB7gwk7SgpehkqhQ2n9Mlpt8IukSy22j5IwCSw5oNSAQ9OWXtxr4c4lA8aOdBMPVtlsrQQbDuRwz4 Oct 17 14:58:40.310948 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 14:58:40.310948 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 14:58:40.310948 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 14:58:40.310948 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 14:58:40.310948 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 14:58:40.310948 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 14:58:40.310948 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 91785ab2c7c94f089cc2f824a1d1a05b Oct 17 14:58:40.310948 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-TestShelveInstance-1901075906 Oct 17 14:58:40.310948 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 14:58:40.310948 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 14:58:40.310948 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/91785ab2c7c94f089cc2f824a1d1a05b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/91785ab2c7c94f089cc2f824a1d1a05b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/91785ab2c7c94f089cc2f824a1d1a05b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_91785ab2c7c94f089cc2f824a1d1a05b", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 14:58:40.310948 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-TestShelveInstance-1901075906 Oct 17 14:58:40.310948 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 91785ab2c7c94f089cc2f824a1d1a05b Oct 17 14:58:40.310948 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-TestShelveInstance-1901075906 Oct 17 14:58:40.310948 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-TestShelveInstance-1901075906-project Oct 17 14:58:40.310948 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 14:58:40.310948 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 14:58:40.310948 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 43c600eebc68451196362d36d6808744 Oct 17 14:58:40.310948 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-TestShelveInstance-1901075906-project Oct 17 14:58:40.310948 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 14:58:40.310948 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance bd93a53c-163b-4ab8-873a-1ce8c5948fbf could not be found. Oct 17 14:58:40.310948 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': 'bd93a53c-163b-4ab8-873a-1ce8c5948fbf'} Oct 17 14:58:40.310948 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:58:40.310948 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:58:40.310948 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:58:40.310948 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:58:40.310948 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:58:40.310948 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:58:40.310948 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:58:40.310948 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:58:40.310948 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:58:40.310948 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:58:40.310948 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd93a53c-163b-4ab8-873a-1ce8c5948fbf could not be found. Oct 17 14:58:40.310948 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:58:40.310948 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:58:40.310948 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:58:40.310948 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:58:40.310948 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:58:40.310948 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:58:40.310948 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:58:40.310948 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:58:40.310948 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:58:40.310948 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:58:40.310948 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:58:40.310948 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:58:40.310948 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:58:40.310948 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:58:40.310948 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:58:40.310948 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:58:40.310948 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd93a53c-163b-4ab8-873a-1ce8c5948fbf could not be found. Oct 17 14:58:40.310948 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:58:40.310948 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:58:40.310948 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:58:40.315841 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:58:40.315841 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:58:40.315841 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:58:40.315841 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:58:40.315841 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:58:40.315841 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd93a53c-163b-4ab8-873a-1ce8c5948fbf could not be found. Oct 17 14:58:40.315841 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 14:58:40.315841 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-639ccced-46ea-4436-8b92-459a31542db7 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Returning 404 to user: Instance bd93a53c-163b-4ab8-873a-1ce8c5948fbf could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:58:40.315841 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-639ccced-46ea-4436-8b92-459a31542db7 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf" status: 404 len: 111 microversion: 2.1 time: 0.032250 Oct 17 14:58:40.315841 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3599/7331] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:58:40 2022] GET /compute/v2.1/servers/bd93a53c-163b-4ab8-873a-1ce8c5948fbf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:58:40.483076 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-bb6c60fb-a156-4df2-b9c1-60d7f636eac9 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '.version_select at 0x7f7cd40f24c0>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:58:40.512355 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-bb6c60fb-a156-4df2-b9c1-60d7f636eac9 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-282425175" status: 202 len: 0 microversion: 2.1 time: 0.033575 Oct 17 14:58:40.513248 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3733/7332] 10.222.0.79 () {58 vars in 1251 bytes} [Mon Oct 17 14:58:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-282425175 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 14:58:40.538316 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e9f8b008-f61f-411c-a8ce-959ebd3e22fe tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Action: 'create', calling method: .version_select at 0x7f7cd5bcbc10>, body: {"keypair": {"name": "tempest-TestShelveInstance-1054876058", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWOQf7LZCeI4UyjFXgDc6VK6FnRq9HQmbsUcfw3peLr04E8BZl9UUC2SPkEdTAvYYg4IhRG6+hzwI4jWkSa71XugHIJ/8mJE2TNL4bDEV7vN2RR1cr4oQTJ1CDGNS563Q=="}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:58:40.554214 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-e9f8b008-f61f-411c-a8ce-959ebd3e22fe tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Getting quotas for project 91785ab2c7c94f089cc2f824a1d1a05b. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:58:40.559918 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-e9f8b008-f61f-411c-a8ce-959ebd3e22fe tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Getting quotas for user 43c600eebc68451196362d36d6808744 and project 91785ab2c7c94f089cc2f824a1d1a05b. Resources: {'key_pairs'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:58:40.592826 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e9f8b008-f61f-411c-a8ce-959ebd3e22fe tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.058706 Oct 17 14:58:40.593764 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3600/7333] 10.222.0.79 () {60 vars in 1159 bytes} [Mon Oct 17 14:58:40 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:58:58.030848 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=10 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:58:58.031854 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:58:58.036662 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ddbba82c-2921-4420-9d7b-a625a9e11e62 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-250099985", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1054876058", "security_groups": [{"name": "tempest-secgroup-smoke-691825770"}], "networks": [{"uuid": "4827782c-00be-4809-9a48-98f7ef31f3da"}], "block_device_mapping_v2": [{"uuid": "0cf869ae-e7dd-42d9-b55b-7aba448c0ea3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:58:58.156979 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.network.neutron [None req-ddbba82c-2921-4420-9d7b-a625a9e11e62 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] validate_networks() for [('4827782c-00be-4809-9a48-98f7ef31f3da', None, None, None, None, None)] {{(pid=127016) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:58:58.611326 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-ddbba82c-2921-4420-9d7b-a625a9e11e62 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Flavor limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:58:58.611744 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-ddbba82c-2921-4420-9d7b-a625a9e11e62 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Image limits 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:58:58.612211 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-ddbba82c-2921-4420-9d7b-a625a9e11e62 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Flavor pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:58:58.612610 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-ddbba82c-2921-4420-9d7b-a625a9e11e62 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Image pref 0:0:0 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:58:58.613015 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.virt.hardware [None req-ddbba82c-2921-4420-9d7b-a625a9e11e62 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127016) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:58:58.622357 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ddbba82c-2921-4420-9d7b-a625a9e11e62 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:58:58.622838 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ddbba82c-2921-4420-9d7b-a625a9e11e62 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:58:58.623294 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ddbba82c-2921-4420-9d7b-a625a9e11e62 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:58:58.624148 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ddbba82c-2921-4420-9d7b-a625a9e11e62 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:58:58.624601 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ddbba82c-2921-4420-9d7b-a625a9e11e62 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:58:58.625016 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ddbba82c-2921-4420-9d7b-a625a9e11e62 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:58:58.642734 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-ddbba82c-2921-4420-9d7b-a625a9e11e62 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Getting quotas for project 91785ab2c7c94f089cc2f824a1d1a05b. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:58:58.648439 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-ddbba82c-2921-4420-9d7b-a625a9e11e62 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Getting quotas for user 43c600eebc68451196362d36d6808744 and project 91785ab2c7c94f089cc2f824a1d1a05b. Resources: {'ram', 'cores', 'instances'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:58:58.710396 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ddbba82c-2921-4420-9d7b-a625a9e11e62 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Going to run 1 instances... {{(pid=127016) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:58:58.712729 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ddbba82c-2921-4420-9d7b-a625a9e11e62 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: a2079205-05ab-490e-8b8a-1a5926290a3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0cf869ae-e7dd-42d9-b55b-7aba448c0ea3',volume_size=None,volume_type=None)] {{(pid=127016) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:58:58.861890 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ddbba82c-2921-4420-9d7b-a625a9e11e62 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.834275 Oct 17 14:58:58.862492 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3734/7334] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 14:58:58 2022] POST /compute/v2.1/servers => generated 405 bytes in 836 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:58:58.872442 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:58:58.873629 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=4 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:58:58.874398 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:58:58.878421 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ddedf6cc-78e6-4e45-af82-12d0394689ec tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:58:58.879159 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-ddedf6cc-78e6-4e45-af82-12d0394689ec tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: a2079205-05ab-490e-8b8a-1a5926290a3a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:58:58.946248 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-ddedf6cc-78e6-4e45-af82-12d0394689ec tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:58:58.953508 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ddedf6cc-78e6-4e45-af82-12d0394689ec tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a" status: 200 len: 1088 microversion: 2.1 time: 0.083093 Oct 17 14:58:58.954084 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3601/7335] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:58:58 2022] GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a => generated 1088 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:58:59.979479 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d7157481-507f-4ba6-a994-2c3af8c1c215 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:58:59.980252 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d7157481-507f-4ba6-a994-2c3af8c1c215 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: a2079205-05ab-490e-8b8a-1a5926290a3a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:58:59.988262 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d7157481-507f-4ba6-a994-2c3af8c1c215 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:58:59.988878 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d7157481-507f-4ba6-a994-2c3af8c1c215 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:58:59.989487 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d7157481-507f-4ba6-a994-2c3af8c1c215 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:58:59.990611 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d7157481-507f-4ba6-a994-2c3af8c1c215 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:58:59.991146 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d7157481-507f-4ba6-a994-2c3af8c1c215 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:58:59.991945 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d7157481-507f-4ba6-a994-2c3af8c1c215 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:00.066203 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d7157481-507f-4ba6-a994-2c3af8c1c215 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:59:00.079203 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d7157481-507f-4ba6-a994-2c3af8c1c215 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a" status: 200 len: 1204 microversion: 2.1 time: 0.104606 Oct 17 14:59:00.080224 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3735/7336] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:58:59 2022] GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a => generated 1204 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:59:01.108221 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-37c0b41e-8525-4864-9b66-2103e241a364 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:59:01.108865 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-37c0b41e-8525-4864-9b66-2103e241a364 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: a2079205-05ab-490e-8b8a-1a5926290a3a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:59:01.116501 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-37c0b41e-8525-4864-9b66-2103e241a364 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:01.116983 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-37c0b41e-8525-4864-9b66-2103e241a364 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:01.117431 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-37c0b41e-8525-4864-9b66-2103e241a364 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:01.118116 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-37c0b41e-8525-4864-9b66-2103e241a364 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:01.118802 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-37c0b41e-8525-4864-9b66-2103e241a364 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:01.119334 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-37c0b41e-8525-4864-9b66-2103e241a364 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:01.354496 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-37c0b41e-8525-4864-9b66-2103e241a364 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:59:01.363489 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-37c0b41e-8525-4864-9b66-2103e241a364 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a" status: 200 len: 1271 microversion: 2.1 time: 0.259115 Oct 17 14:59:01.375393 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3602/7337] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:59:01 2022] GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a => generated 1271 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:59:01.552597 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-f25d0105-97a1-4f55-8d6a-600902316b12 req-f2d27366-d450-4dc3-bb5b-677248f09805 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2079205-05ab-490e-8b8a-1a5926290a3a", "tag": "adb20e79-a98b-4888-ac3a-319480304fe6"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:59:01.566572 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-f25d0105-97a1-4f55-8d6a-600902316b12 req-f2d27366-d450-4dc3-bb5b-677248f09805 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:01.567385 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-f25d0105-97a1-4f55-8d6a-600902316b12 req-f2d27366-d450-4dc3-bb5b-677248f09805 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:01.568004 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-f25d0105-97a1-4f55-8d6a-600902316b12 req-f2d27366-d450-4dc3-bb5b-677248f09805 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:01.581870 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-f25d0105-97a1-4f55-8d6a-600902316b12 req-f2d27366-d450-4dc3-bb5b-677248f09805 service nova] Creating event network-changed:adb20e79-a98b-4888-ac3a-319480304fe6 for instance a2079205-05ab-490e-8b8a-1a5926290a3a on n-h1-854247-14 Oct 17 14:59:01.588242 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-f25d0105-97a1-4f55-8d6a-600902316b12 req-f2d27366-d450-4dc3-bb5b-677248f09805 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039283 Oct 17 14:59:01.589444 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3736/7338] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:59:02.387784 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b7ffad8b-37d0-4eca-ad5a-5ecf522efdbc tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:59:02.388430 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b7ffad8b-37d0-4eca-ad5a-5ecf522efdbc tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: a2079205-05ab-490e-8b8a-1a5926290a3a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:59:02.396434 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b7ffad8b-37d0-4eca-ad5a-5ecf522efdbc tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:02.396947 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b7ffad8b-37d0-4eca-ad5a-5ecf522efdbc tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:02.397566 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b7ffad8b-37d0-4eca-ad5a-5ecf522efdbc tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:02.398315 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b7ffad8b-37d0-4eca-ad5a-5ecf522efdbc tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:02.398784 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b7ffad8b-37d0-4eca-ad5a-5ecf522efdbc tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:02.399256 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b7ffad8b-37d0-4eca-ad5a-5ecf522efdbc tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:02.641357 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b7ffad8b-37d0-4eca-ad5a-5ecf522efdbc tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:59:02.651789 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b7ffad8b-37d0-4eca-ad5a-5ecf522efdbc tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a" status: 200 len: 1271 microversion: 2.1 time: 0.268249 Oct 17 14:59:02.652569 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3603/7339] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:59:02 2022] GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a => generated 1271 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:59:03.676496 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-873b6e91-aa07-465d-9f63-19b896c6f336 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:59:03.677287 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-873b6e91-aa07-465d-9f63-19b896c6f336 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: a2079205-05ab-490e-8b8a-1a5926290a3a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:59:03.684097 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-873b6e91-aa07-465d-9f63-19b896c6f336 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:03.684582 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-873b6e91-aa07-465d-9f63-19b896c6f336 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:03.685022 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-873b6e91-aa07-465d-9f63-19b896c6f336 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:03.685831 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-873b6e91-aa07-465d-9f63-19b896c6f336 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:03.686604 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-873b6e91-aa07-465d-9f63-19b896c6f336 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:03.687030 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-873b6e91-aa07-465d-9f63-19b896c6f336 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:03.828246 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-873b6e91-aa07-465d-9f63-19b896c6f336 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:59:03.836811 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-873b6e91-aa07-465d-9f63-19b896c6f336 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a" status: 200 len: 1271 microversion: 2.1 time: 0.165601 Oct 17 14:59:03.837401 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3737/7340] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:59:03 2022] GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a => generated 1271 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:59:04.860570 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5a6d738b-ef91-4e2f-abd9-d5a99913d1fe tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:59:04.861239 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5a6d738b-ef91-4e2f-abd9-d5a99913d1fe tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: a2079205-05ab-490e-8b8a-1a5926290a3a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:59:04.869002 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5a6d738b-ef91-4e2f-abd9-d5a99913d1fe tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:04.869542 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5a6d738b-ef91-4e2f-abd9-d5a99913d1fe tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:04.870040 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5a6d738b-ef91-4e2f-abd9-d5a99913d1fe tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:04.870762 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5a6d738b-ef91-4e2f-abd9-d5a99913d1fe tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:04.871249 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5a6d738b-ef91-4e2f-abd9-d5a99913d1fe tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:04.871703 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5a6d738b-ef91-4e2f-abd9-d5a99913d1fe tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:05.022011 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5a6d738b-ef91-4e2f-abd9-d5a99913d1fe tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:59:05.030539 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5a6d738b-ef91-4e2f-abd9-d5a99913d1fe tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a" status: 200 len: 1271 microversion: 2.1 time: 0.174431 Oct 17 14:59:05.031049 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3604/7341] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:59:04 2022] GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a => generated 1271 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:59:06.057580 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fe990d6d-1ad8-4c5d-855e-28c6d5eb2f5b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:59:06.058832 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-fe990d6d-1ad8-4c5d-855e-28c6d5eb2f5b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: a2079205-05ab-490e-8b8a-1a5926290a3a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:59:06.069725 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe990d6d-1ad8-4c5d-855e-28c6d5eb2f5b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:06.070527 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe990d6d-1ad8-4c5d-855e-28c6d5eb2f5b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:06.071234 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe990d6d-1ad8-4c5d-855e-28c6d5eb2f5b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:06.072404 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe990d6d-1ad8-4c5d-855e-28c6d5eb2f5b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:06.073112 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe990d6d-1ad8-4c5d-855e-28c6d5eb2f5b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:06.073629 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fe990d6d-1ad8-4c5d-855e-28c6d5eb2f5b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:06.216427 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fe990d6d-1ad8-4c5d-855e-28c6d5eb2f5b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:59:06.225445 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fe990d6d-1ad8-4c5d-855e-28c6d5eb2f5b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a" status: 200 len: 1259 microversion: 2.1 time: 0.175074 Oct 17 14:59:06.226111 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3738/7342] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:59:06 2022] GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:59:07.251760 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-37c508f3-a943-4083-90d3-a169b061d893 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:59:07.252402 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-37c508f3-a943-4083-90d3-a169b061d893 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: a2079205-05ab-490e-8b8a-1a5926290a3a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:59:07.259615 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-37c508f3-a943-4083-90d3-a169b061d893 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:07.260119 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-37c508f3-a943-4083-90d3-a169b061d893 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:07.260569 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-37c508f3-a943-4083-90d3-a169b061d893 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:07.261287 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-37c508f3-a943-4083-90d3-a169b061d893 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:07.261761 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-37c508f3-a943-4083-90d3-a169b061d893 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:07.262187 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-37c508f3-a943-4083-90d3-a169b061d893 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:07.458458 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-37c508f3-a943-4083-90d3-a169b061d893 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:59:07.466964 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-37c508f3-a943-4083-90d3-a169b061d893 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a" status: 200 len: 1259 microversion: 2.1 time: 0.219699 Oct 17 14:59:07.467581 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3605/7343] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:59:07 2022] GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a => generated 1259 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:59:08.491516 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-00cea81e-3d1e-427b-9021-90433f328aa9 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:59:08.492155 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-00cea81e-3d1e-427b-9021-90433f328aa9 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: a2079205-05ab-490e-8b8a-1a5926290a3a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:59:08.500258 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-00cea81e-3d1e-427b-9021-90433f328aa9 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:08.500753 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-00cea81e-3d1e-427b-9021-90433f328aa9 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:08.501190 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-00cea81e-3d1e-427b-9021-90433f328aa9 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:08.501905 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-00cea81e-3d1e-427b-9021-90433f328aa9 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:08.502362 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-00cea81e-3d1e-427b-9021-90433f328aa9 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:08.502785 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-00cea81e-3d1e-427b-9021-90433f328aa9 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:08.631902 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:59:08.649246 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-00cea81e-3d1e-427b-9021-90433f328aa9 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:59:08.655719 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=6 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:59:08.659031 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-00cea81e-3d1e-427b-9021-90433f328aa9 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a" status: 200 len: 1259 microversion: 2.1 time: 0.171887 Oct 17 14:59:08.659700 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3739/7344] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:59:08 2022] GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a => generated 1259 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:59:09.681826 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e713677a-99d3-4ce3-aeed-cfcb02b8072a tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:59:09.682648 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e713677a-99d3-4ce3-aeed-cfcb02b8072a tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: a2079205-05ab-490e-8b8a-1a5926290a3a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:59:09.685541 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:59:09.691699 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e713677a-99d3-4ce3-aeed-cfcb02b8072a tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:09.692199 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e713677a-99d3-4ce3-aeed-cfcb02b8072a tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:09.692645 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e713677a-99d3-4ce3-aeed-cfcb02b8072a tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:09.693360 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e713677a-99d3-4ce3-aeed-cfcb02b8072a tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:09.693823 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e713677a-99d3-4ce3-aeed-cfcb02b8072a tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:09.694253 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e713677a-99d3-4ce3-aeed-cfcb02b8072a tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:09.837753 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e713677a-99d3-4ce3-aeed-cfcb02b8072a tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:59:09.846117 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e713677a-99d3-4ce3-aeed-cfcb02b8072a tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a" status: 200 len: 1259 microversion: 2.1 time: 0.168260 Oct 17 14:59:09.846699 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3606/7345] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:59:09 2022] GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:59:10.870063 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-fb56500c-0a40-461d-bbc6-89963b6a55bb tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:59:10.870746 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-fb56500c-0a40-461d-bbc6-89963b6a55bb tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: a2079205-05ab-490e-8b8a-1a5926290a3a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:59:10.878453 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fb56500c-0a40-461d-bbc6-89963b6a55bb tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:10.878934 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fb56500c-0a40-461d-bbc6-89963b6a55bb tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:10.879419 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fb56500c-0a40-461d-bbc6-89963b6a55bb tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:10.880115 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fb56500c-0a40-461d-bbc6-89963b6a55bb tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:10.880571 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fb56500c-0a40-461d-bbc6-89963b6a55bb tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:10.880989 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-fb56500c-0a40-461d-bbc6-89963b6a55bb tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:11.026950 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-fb56500c-0a40-461d-bbc6-89963b6a55bb tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:59:11.036861 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-fb56500c-0a40-461d-bbc6-89963b6a55bb tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a" status: 200 len: 1259 microversion: 2.1 time: 0.170821 Oct 17 14:59:11.037439 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3740/7346] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:59:10 2022] GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a => generated 1259 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:59:12.061026 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d34907ff-9263-4e12-8117-780ffca147ba tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:59:12.061911 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d34907ff-9263-4e12-8117-780ffca147ba tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: a2079205-05ab-490e-8b8a-1a5926290a3a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:59:12.069810 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d34907ff-9263-4e12-8117-780ffca147ba tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:12.070398 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d34907ff-9263-4e12-8117-780ffca147ba tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:12.071001 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d34907ff-9263-4e12-8117-780ffca147ba tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:12.071778 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d34907ff-9263-4e12-8117-780ffca147ba tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:12.072558 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d34907ff-9263-4e12-8117-780ffca147ba tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:12.073379 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d34907ff-9263-4e12-8117-780ffca147ba tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:12.216894 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d34907ff-9263-4e12-8117-780ffca147ba tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:59:12.225521 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d34907ff-9263-4e12-8117-780ffca147ba tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a" status: 200 len: 1259 microversion: 2.1 time: 0.168695 Oct 17 14:59:12.226123 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3607/7347] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:59:12 2022] GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:59:13.250069 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-f84af4f1-baa5-4741-b5fa-45a4e39fbdb9 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:59:13.250728 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-f84af4f1-baa5-4741-b5fa-45a4e39fbdb9 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: a2079205-05ab-490e-8b8a-1a5926290a3a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:59:13.257915 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f84af4f1-baa5-4741-b5fa-45a4e39fbdb9 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:13.258390 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f84af4f1-baa5-4741-b5fa-45a4e39fbdb9 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:13.258819 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f84af4f1-baa5-4741-b5fa-45a4e39fbdb9 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:13.259540 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f84af4f1-baa5-4741-b5fa-45a4e39fbdb9 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:13.259986 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f84af4f1-baa5-4741-b5fa-45a4e39fbdb9 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:13.260402 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-f84af4f1-baa5-4741-b5fa-45a4e39fbdb9 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:13.405092 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-f84af4f1-baa5-4741-b5fa-45a4e39fbdb9 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:59:13.413434 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-f84af4f1-baa5-4741-b5fa-45a4e39fbdb9 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a" status: 200 len: 1259 microversion: 2.1 time: 0.167477 Oct 17 14:59:13.414025 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3741/7348] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:59:13 2022] GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:59:13.784116 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-fee024c2-3f02-42e9-80ed-581cf3e738d4 req-3f78404d-ae7c-471b-b4e3-805da71b3391 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2079205-05ab-490e-8b8a-1a5926290a3a", "name": "network-vif-plugged", "status": "completed", "tag": "adb20e79-a98b-4888-ac3a-319480304fe6"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:59:13.796065 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-fee024c2-3f02-42e9-80ed-581cf3e738d4 req-3f78404d-ae7c-471b-b4e3-805da71b3391 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:13.797184 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-fee024c2-3f02-42e9-80ed-581cf3e738d4 req-3f78404d-ae7c-471b-b4e3-805da71b3391 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:13.797667 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-fee024c2-3f02-42e9-80ed-581cf3e738d4 req-3f78404d-ae7c-471b-b4e3-805da71b3391 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:13.810661 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-fee024c2-3f02-42e9-80ed-581cf3e738d4 req-3f78404d-ae7c-471b-b4e3-805da71b3391 service nova] Creating event network-vif-plugged:adb20e79-a98b-4888-ac3a-319480304fe6 for instance a2079205-05ab-490e-8b8a-1a5926290a3a on n-h1-854247-14 Oct 17 14:59:13.816425 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-fee024c2-3f02-42e9-80ed-581cf3e738d4 req-3f78404d-ae7c-471b-b4e3-805da71b3391 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036138 Oct 17 14:59:13.817085 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3608/7349] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:59:14.438262 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-60569019-f582-4ff0-b68f-bcae87da9836 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:59:14.438945 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-60569019-f582-4ff0-b68f-bcae87da9836 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: a2079205-05ab-490e-8b8a-1a5926290a3a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:59:14.446293 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-60569019-f582-4ff0-b68f-bcae87da9836 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:14.446782 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-60569019-f582-4ff0-b68f-bcae87da9836 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:14.447215 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-60569019-f582-4ff0-b68f-bcae87da9836 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:14.447959 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-60569019-f582-4ff0-b68f-bcae87da9836 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:14.448432 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-60569019-f582-4ff0-b68f-bcae87da9836 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:14.448854 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-60569019-f582-4ff0-b68f-bcae87da9836 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:14.587073 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-60569019-f582-4ff0-b68f-bcae87da9836 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:59:14.596260 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-60569019-f582-4ff0-b68f-bcae87da9836 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a" status: 200 len: 1259 microversion: 2.1 time: 0.161963 Oct 17 14:59:14.596858 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3742/7350] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:59:14 2022] GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:59:15.623513 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-e102a715-686a-437a-8c9a-894662f16ece tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:59:15.624235 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-e102a715-686a-437a-8c9a-894662f16ece tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: a2079205-05ab-490e-8b8a-1a5926290a3a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:59:15.631324 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e102a715-686a-437a-8c9a-894662f16ece tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:15.631822 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e102a715-686a-437a-8c9a-894662f16ece tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:15.632261 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e102a715-686a-437a-8c9a-894662f16ece tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:15.632979 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e102a715-686a-437a-8c9a-894662f16ece tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:15.633442 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e102a715-686a-437a-8c9a-894662f16ece tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:15.633867 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-e102a715-686a-437a-8c9a-894662f16ece tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:15.784230 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-e102a715-686a-437a-8c9a-894662f16ece tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:59:15.792613 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-e102a715-686a-437a-8c9a-894662f16ece tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a" status: 200 len: 1442 microversion: 2.1 time: 0.174493 Oct 17 14:59:15.793205 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3609/7351] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:59:15 2022] GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a => generated 1442 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:59:15.816073 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-31b41fe8-3c58-4860-a032-fe934f1cc33b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:59:15.816766 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-31b41fe8-3c58-4860-a032-fe934f1cc33b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: a2079205-05ab-490e-8b8a-1a5926290a3a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:59:15.825319 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-31b41fe8-3c58-4860-a032-fe934f1cc33b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:15.825868 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-31b41fe8-3c58-4860-a032-fe934f1cc33b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:15.826304 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-31b41fe8-3c58-4860-a032-fe934f1cc33b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:15.827008 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-31b41fe8-3c58-4860-a032-fe934f1cc33b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:15.827488 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-31b41fe8-3c58-4860-a032-fe934f1cc33b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:15.827934 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-31b41fe8-3c58-4860-a032-fe934f1cc33b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:15.974205 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-31b41fe8-3c58-4860-a032-fe934f1cc33b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:59:15.982653 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-31b41fe8-3c58-4860-a032-fe934f1cc33b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a" status: 200 len: 1442 microversion: 2.1 time: 0.170894 Oct 17 14:59:15.983267 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3743/7352] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 14:59:15 2022] GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a => generated 1442 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:59:17.723221 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-e2047c3a-001f-46db-b603-96afdce4a8f3 req-7a81bd0e-9482-470d-b1a6-e5c1a465d156 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2079205-05ab-490e-8b8a-1a5926290a3a", "tag": "adb20e79-a98b-4888-ac3a-319480304fe6"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:59:17.743799 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-e2047c3a-001f-46db-b603-96afdce4a8f3 req-7a81bd0e-9482-470d-b1a6-e5c1a465d156 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:17.744299 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-e2047c3a-001f-46db-b603-96afdce4a8f3 req-7a81bd0e-9482-470d-b1a6-e5c1a465d156 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:17.744750 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-e2047c3a-001f-46db-b603-96afdce4a8f3 req-7a81bd0e-9482-470d-b1a6-e5c1a465d156 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:17.760730 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-e2047c3a-001f-46db-b603-96afdce4a8f3 req-7a81bd0e-9482-470d-b1a6-e5c1a465d156 service nova] Creating event network-changed:adb20e79-a98b-4888-ac3a-319480304fe6 for instance a2079205-05ab-490e-8b8a-1a5926290a3a on n-h1-854247-14 Oct 17 14:59:17.766244 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-e2047c3a-001f-46db-b603-96afdce4a8f3 req-7a81bd0e-9482-470d-b1a6-e5c1a465d156 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047046 Oct 17 14:59:17.766976 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3610/7353] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 14:59:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:01:15.235102 n-d-854247-14 devstack@n-api.service[127016]: ERROR oslo.messaging._drivers.impl_rabbit [-] [72f013d3-d96b-49c5-a187-2d216be84735] AMQP server on 10.222.0.79:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 17 15:01:15.236053 n-d-854247-14 devstack@n-api.service[127016]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0ad54cb6-91dd-4ced-9c42-02c0b19684b8] AMQP server on 10.222.0.79:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 17 15:01:15.236909 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:01:15.237764 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=52 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:01:15.307356 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-bf045d7e-79b8-4dc6-beb6-406c307a7e05 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:01:15.307847 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-bf045d7e-79b8-4dc6-beb6-406c307a7e05 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: a2079205-05ab-490e-8b8a-1a5926290a3a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:01:15.315037 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bf045d7e-79b8-4dc6-beb6-406c307a7e05 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:15.315552 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bf045d7e-79b8-4dc6-beb6-406c307a7e05 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:15.315988 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bf045d7e-79b8-4dc6-beb6-406c307a7e05 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:15.316695 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bf045d7e-79b8-4dc6-beb6-406c307a7e05 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:15.317151 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bf045d7e-79b8-4dc6-beb6-406c307a7e05 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:15.317580 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-bf045d7e-79b8-4dc6-beb6-406c307a7e05 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:15.344501 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-bf045d7e-79b8-4dc6-beb6-406c307a7e05 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lazy-loading 'flavor' on Instance uuid a2079205-05ab-490e-8b8a-1a5926290a3a {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:01:15.447274 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-bf045d7e-79b8-4dc6-beb6-406c307a7e05 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "POST /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a/action" status: 202 len: 0 microversion: 2.1 time: 0.214448 Oct 17 15:01:15.448135 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3744/7354] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 15:01:15 2022] POST /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:01:15.455042 n-d-854247-14 devstack@n-api.service[127017]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8c4c735e-fe50-490e-b8cd-ee30a9564a26] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 15:01:15.455964 n-d-854247-14 devstack@n-api.service[127017]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b945151f-fea7-4f65-a337-b7fe0a9fe59d] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 15:01:15.456779 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=22 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:01:15.457895 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=46 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:01:15.463958 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-13147e74-f484-4b72-b52a-f404b0eba70e tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:01:15.465153 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-13147e74-f484-4b72-b52a-f404b0eba70e tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: a2079205-05ab-490e-8b8a-1a5926290a3a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:01:15.475225 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-13147e74-f484-4b72-b52a-f404b0eba70e tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:15.476063 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-13147e74-f484-4b72-b52a-f404b0eba70e tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:15.476739 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-13147e74-f484-4b72-b52a-f404b0eba70e tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:15.477696 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-13147e74-f484-4b72-b52a-f404b0eba70e tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:15.478372 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-13147e74-f484-4b72-b52a-f404b0eba70e tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:15.479035 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-13147e74-f484-4b72-b52a-f404b0eba70e tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:15.629883 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-13147e74-f484-4b72-b52a-f404b0eba70e tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:01:15.638602 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-13147e74-f484-4b72-b52a-f404b0eba70e tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a" status: 200 len: 1567 microversion: 2.1 time: 0.185858 Oct 17 15:01:15.639493 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3611/7355] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:01:15 2022] GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a => generated 1567 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:01:16.670553 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-94e15325-3b67-460a-9fa0-6d0e68fdc4cc tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:01:16.671192 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-94e15325-3b67-460a-9fa0-6d0e68fdc4cc tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: a2079205-05ab-490e-8b8a-1a5926290a3a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:01:16.683334 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94e15325-3b67-460a-9fa0-6d0e68fdc4cc tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:16.683834 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94e15325-3b67-460a-9fa0-6d0e68fdc4cc tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:16.684269 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94e15325-3b67-460a-9fa0-6d0e68fdc4cc tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:16.685015 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94e15325-3b67-460a-9fa0-6d0e68fdc4cc tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:16.685519 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94e15325-3b67-460a-9fa0-6d0e68fdc4cc tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:16.685967 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-94e15325-3b67-460a-9fa0-6d0e68fdc4cc tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:16.687296 n-d-854247-14 devstack@n-api.service[127016]: INFO oslo.messaging._drivers.impl_rabbit [-] [0ad54cb6-91dd-4ced-9c42-02c0b19684b8] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 35774. Oct 17 15:01:16.691072 n-d-854247-14 devstack@n-api.service[127016]: INFO oslo.messaging._drivers.impl_rabbit [-] [72f013d3-d96b-49c5-a187-2d216be84735] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 35772. Oct 17 15:01:16.846695 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-94e15325-3b67-460a-9fa0-6d0e68fdc4cc tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:01:16.861960 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-94e15325-3b67-460a-9fa0-6d0e68fdc4cc tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a" status: 200 len: 1567 microversion: 2.1 time: 0.200467 Oct 17 15:01:16.862999 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3745/7356] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:01:16 2022] GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a => generated 1567 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:01:17.887195 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-1dfebc1c-958b-41cb-876f-5ec715d94e99 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:01:17.887832 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-1dfebc1c-958b-41cb-876f-5ec715d94e99 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: a2079205-05ab-490e-8b8a-1a5926290a3a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:01:17.897507 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1dfebc1c-958b-41cb-876f-5ec715d94e99 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:17.898003 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1dfebc1c-958b-41cb-876f-5ec715d94e99 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:17.898446 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1dfebc1c-958b-41cb-876f-5ec715d94e99 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:17.899161 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1dfebc1c-958b-41cb-876f-5ec715d94e99 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:17.899665 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1dfebc1c-958b-41cb-876f-5ec715d94e99 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:17.900094 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-1dfebc1c-958b-41cb-876f-5ec715d94e99 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:17.918540 n-d-854247-14 devstack@n-api.service[127017]: INFO oslo.messaging._drivers.impl_rabbit [-] [8c4c735e-fe50-490e-b8cd-ee30a9564a26] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 35778. Oct 17 15:01:17.919273 n-d-854247-14 devstack@n-api.service[127017]: INFO oslo.messaging._drivers.impl_rabbit [-] [b945151f-fea7-4f65-a337-b7fe0a9fe59d] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 35780. Oct 17 15:01:18.048113 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-1dfebc1c-958b-41cb-876f-5ec715d94e99 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:01:18.056960 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-1dfebc1c-958b-41cb-876f-5ec715d94e99 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a" status: 200 len: 1567 microversion: 2.1 time: 0.173719 Oct 17 15:01:18.057517 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3612/7357] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:01:17 2022] GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:01:19.086927 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-36a3c1f5-6460-4d49-a0a0-5432d0d36aea tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:01:19.088739 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-36a3c1f5-6460-4d49-a0a0-5432d0d36aea tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: a2079205-05ab-490e-8b8a-1a5926290a3a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:01:19.101423 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-36a3c1f5-6460-4d49-a0a0-5432d0d36aea tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:19.101911 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-36a3c1f5-6460-4d49-a0a0-5432d0d36aea tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:19.102346 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-36a3c1f5-6460-4d49-a0a0-5432d0d36aea tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:19.103065 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-36a3c1f5-6460-4d49-a0a0-5432d0d36aea tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:19.103600 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-36a3c1f5-6460-4d49-a0a0-5432d0d36aea tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:19.104093 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-36a3c1f5-6460-4d49-a0a0-5432d0d36aea tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:19.253345 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-36a3c1f5-6460-4d49-a0a0-5432d0d36aea tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:01:19.261961 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-36a3c1f5-6460-4d49-a0a0-5432d0d36aea tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a" status: 200 len: 1567 microversion: 2.1 time: 0.184547 Oct 17 15:01:19.262549 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3746/7358] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:01:19 2022] GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a => generated 1567 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:01:20.290127 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-15359260-90bd-4a2b-bbc2-ed1535894bae tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:01:20.290765 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-15359260-90bd-4a2b-bbc2-ed1535894bae tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: a2079205-05ab-490e-8b8a-1a5926290a3a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:01:20.309741 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-15359260-90bd-4a2b-bbc2-ed1535894bae tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:20.310818 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-15359260-90bd-4a2b-bbc2-ed1535894bae tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:20.311671 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-15359260-90bd-4a2b-bbc2-ed1535894bae tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:20.312772 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-15359260-90bd-4a2b-bbc2-ed1535894bae tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:20.313246 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-15359260-90bd-4a2b-bbc2-ed1535894bae tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:20.313692 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-15359260-90bd-4a2b-bbc2-ed1535894bae tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:20.456748 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-15359260-90bd-4a2b-bbc2-ed1535894bae tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:01:20.465154 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-15359260-90bd-4a2b-bbc2-ed1535894bae tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a" status: 200 len: 1567 microversion: 2.1 time: 0.182001 Oct 17 15:01:20.466020 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3613/7359] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:01:20 2022] GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a => generated 1567 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:01:21.492621 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b3b30941-5d3c-4a61-8073-ae5ed18faa15 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:01:21.493343 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b3b30941-5d3c-4a61-8073-ae5ed18faa15 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: a2079205-05ab-490e-8b8a-1a5926290a3a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:01:21.500990 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b3b30941-5d3c-4a61-8073-ae5ed18faa15 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:21.501600 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b3b30941-5d3c-4a61-8073-ae5ed18faa15 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:21.502443 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b3b30941-5d3c-4a61-8073-ae5ed18faa15 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:21.503705 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b3b30941-5d3c-4a61-8073-ae5ed18faa15 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:21.504463 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b3b30941-5d3c-4a61-8073-ae5ed18faa15 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:21.505195 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b3b30941-5d3c-4a61-8073-ae5ed18faa15 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:21.657374 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b3b30941-5d3c-4a61-8073-ae5ed18faa15 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:01:21.670053 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b3b30941-5d3c-4a61-8073-ae5ed18faa15 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a" status: 200 len: 1567 microversion: 2.1 time: 0.181888 Oct 17 15:01:21.670907 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3747/7360] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:01:21 2022] GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a => generated 1567 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:01:22.693778 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f60df56d-51df-4f9f-b151-2fcad5401f11 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:01:22.694464 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f60df56d-51df-4f9f-b151-2fcad5401f11 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: a2079205-05ab-490e-8b8a-1a5926290a3a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:01:22.703756 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f60df56d-51df-4f9f-b151-2fcad5401f11 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:22.704500 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f60df56d-51df-4f9f-b151-2fcad5401f11 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:22.705176 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f60df56d-51df-4f9f-b151-2fcad5401f11 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:22.706348 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f60df56d-51df-4f9f-b151-2fcad5401f11 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:22.707026 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f60df56d-51df-4f9f-b151-2fcad5401f11 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:22.707631 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f60df56d-51df-4f9f-b151-2fcad5401f11 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:22.864208 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f60df56d-51df-4f9f-b151-2fcad5401f11 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:01:22.873803 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f60df56d-51df-4f9f-b151-2fcad5401f11 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a" status: 200 len: 1567 microversion: 2.1 time: 0.184092 Oct 17 15:01:22.874395 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3614/7361] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:01:22 2022] GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a => generated 1567 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:01:23.898399 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-77cb795b-af5b-4ab0-8c5d-a4c2e4b40fa3 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:01:23.899072 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-77cb795b-af5b-4ab0-8c5d-a4c2e4b40fa3 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: a2079205-05ab-490e-8b8a-1a5926290a3a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:01:23.906497 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-77cb795b-af5b-4ab0-8c5d-a4c2e4b40fa3 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:23.906984 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-77cb795b-af5b-4ab0-8c5d-a4c2e4b40fa3 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:23.907449 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-77cb795b-af5b-4ab0-8c5d-a4c2e4b40fa3 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:23.908154 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-77cb795b-af5b-4ab0-8c5d-a4c2e4b40fa3 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:23.908603 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-77cb795b-af5b-4ab0-8c5d-a4c2e4b40fa3 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:23.909020 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-77cb795b-af5b-4ab0-8c5d-a4c2e4b40fa3 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:24.047845 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-77cb795b-af5b-4ab0-8c5d-a4c2e4b40fa3 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:01:24.057386 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-77cb795b-af5b-4ab0-8c5d-a4c2e4b40fa3 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a" status: 200 len: 1567 microversion: 2.1 time: 0.163423 Oct 17 15:01:24.058032 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3748/7362] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:01:23 2022] GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:01:25.082380 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b38d75d6-8459-49f7-8e5a-1dcd24fce379 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:01:25.083093 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b38d75d6-8459-49f7-8e5a-1dcd24fce379 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: a2079205-05ab-490e-8b8a-1a5926290a3a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:01:25.091529 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b38d75d6-8459-49f7-8e5a-1dcd24fce379 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:25.092030 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b38d75d6-8459-49f7-8e5a-1dcd24fce379 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:25.092477 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b38d75d6-8459-49f7-8e5a-1dcd24fce379 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:25.093203 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b38d75d6-8459-49f7-8e5a-1dcd24fce379 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:25.093659 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b38d75d6-8459-49f7-8e5a-1dcd24fce379 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:25.094088 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b38d75d6-8459-49f7-8e5a-1dcd24fce379 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:25.249594 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-b38d75d6-8459-49f7-8e5a-1dcd24fce379 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:01:25.258735 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b38d75d6-8459-49f7-8e5a-1dcd24fce379 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a" status: 200 len: 1567 microversion: 2.1 time: 0.180496 Oct 17 15:01:25.259391 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3615/7363] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:01:25 2022] GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a => generated 1567 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:01:26.283284 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d70bb502-b164-4be6-abd1-606f48cb7031 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:01:26.284268 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d70bb502-b164-4be6-abd1-606f48cb7031 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: a2079205-05ab-490e-8b8a-1a5926290a3a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:01:26.296186 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d70bb502-b164-4be6-abd1-606f48cb7031 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:26.296814 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d70bb502-b164-4be6-abd1-606f48cb7031 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:26.297458 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d70bb502-b164-4be6-abd1-606f48cb7031 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:26.298519 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d70bb502-b164-4be6-abd1-606f48cb7031 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:26.299217 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d70bb502-b164-4be6-abd1-606f48cb7031 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:26.299851 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d70bb502-b164-4be6-abd1-606f48cb7031 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:26.446526 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d70bb502-b164-4be6-abd1-606f48cb7031 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:01:26.455601 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d70bb502-b164-4be6-abd1-606f48cb7031 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a" status: 200 len: 1567 microversion: 2.1 time: 0.177032 Oct 17 15:01:26.456199 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3749/7364] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:01:26 2022] GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:01:27.479434 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-92416e0f-6b1f-4a57-a307-f79d9797788d tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:01:27.480093 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-92416e0f-6b1f-4a57-a307-f79d9797788d tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: a2079205-05ab-490e-8b8a-1a5926290a3a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:01:27.487861 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-92416e0f-6b1f-4a57-a307-f79d9797788d tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:27.488364 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-92416e0f-6b1f-4a57-a307-f79d9797788d tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:27.488937 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-92416e0f-6b1f-4a57-a307-f79d9797788d tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:27.489657 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-92416e0f-6b1f-4a57-a307-f79d9797788d tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:27.490117 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-92416e0f-6b1f-4a57-a307-f79d9797788d tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:27.490757 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-92416e0f-6b1f-4a57-a307-f79d9797788d tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:27.657830 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-92416e0f-6b1f-4a57-a307-f79d9797788d tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:01:27.667322 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-92416e0f-6b1f-4a57-a307-f79d9797788d tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a" status: 200 len: 1567 microversion: 2.1 time: 0.192370 Oct 17 15:01:27.668142 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3616/7365] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:01:27 2022] GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a => generated 1567 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:01:28.692295 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2fbe8ae3-7fed-4955-adcd-38ed451debd3 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:01:28.692908 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2fbe8ae3-7fed-4955-adcd-38ed451debd3 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: a2079205-05ab-490e-8b8a-1a5926290a3a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:01:28.700722 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2fbe8ae3-7fed-4955-adcd-38ed451debd3 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:28.701213 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2fbe8ae3-7fed-4955-adcd-38ed451debd3 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:28.701643 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2fbe8ae3-7fed-4955-adcd-38ed451debd3 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:28.702349 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2fbe8ae3-7fed-4955-adcd-38ed451debd3 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:28.702802 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2fbe8ae3-7fed-4955-adcd-38ed451debd3 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:28.703281 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2fbe8ae3-7fed-4955-adcd-38ed451debd3 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:28.850770 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2fbe8ae3-7fed-4955-adcd-38ed451debd3 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:01:28.859451 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2fbe8ae3-7fed-4955-adcd-38ed451debd3 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a" status: 200 len: 1567 microversion: 2.1 time: 0.171201 Oct 17 15:01:28.861029 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3750/7366] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:01:28 2022] GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:01:29.884559 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7d43f583-3ca3-4609-aa4a-a3743432e2c0 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:01:29.885144 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7d43f583-3ca3-4609-aa4a-a3743432e2c0 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: a2079205-05ab-490e-8b8a-1a5926290a3a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:01:29.893512 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7d43f583-3ca3-4609-aa4a-a3743432e2c0 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:29.893994 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7d43f583-3ca3-4609-aa4a-a3743432e2c0 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:29.894449 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7d43f583-3ca3-4609-aa4a-a3743432e2c0 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:29.895273 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7d43f583-3ca3-4609-aa4a-a3743432e2c0 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:29.895788 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7d43f583-3ca3-4609-aa4a-a3743432e2c0 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:29.896408 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7d43f583-3ca3-4609-aa4a-a3743432e2c0 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:30.057397 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-7d43f583-3ca3-4609-aa4a-a3743432e2c0 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:01:30.070964 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7d43f583-3ca3-4609-aa4a-a3743432e2c0 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a" status: 200 len: 1508 microversion: 2.1 time: 0.190590 Oct 17 15:01:30.071651 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3617/7367] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:01:29 2022] GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a => generated 1508 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:01:30.098071 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0c14a9a7-6397-4a55-8383-74052606b52a tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:01:30.098709 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0c14a9a7-6397-4a55-8383-74052606b52a tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: a2079205-05ab-490e-8b8a-1a5926290a3a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:01:30.110574 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0c14a9a7-6397-4a55-8383-74052606b52a tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:30.111038 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0c14a9a7-6397-4a55-8383-74052606b52a tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:30.111483 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0c14a9a7-6397-4a55-8383-74052606b52a tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:30.112185 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0c14a9a7-6397-4a55-8383-74052606b52a tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:30.112728 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0c14a9a7-6397-4a55-8383-74052606b52a tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:30.113106 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0c14a9a7-6397-4a55-8383-74052606b52a tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:30.147629 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0c14a9a7-6397-4a55-8383-74052606b52a tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: a2079205-05ab-490e-8b8a-1a5926290a3a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127016) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 17 15:01:30.231715 n-d-854247-14 devstack@n-api.service[127016]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0c14a9a7-6397-4a55-8383-74052606b52a tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [cf3ac22b-dd11-4f4a-9fac-901ca6f0f90c] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 15:01:30.448906 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-49550c60-cb2a-4eb9-a399-932320e5215b req-b7f9e010-e9d4-4055-99f4-cb73fd493ef4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2079205-05ab-490e-8b8a-1a5926290a3a", "name": "network-vif-unplugged", "status": "completed", "tag": "adb20e79-a98b-4888-ac3a-319480304fe6"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:01:30.459579 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-49550c60-cb2a-4eb9-a399-932320e5215b req-b7f9e010-e9d4-4055-99f4-cb73fd493ef4 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:30.460002 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-49550c60-cb2a-4eb9-a399-932320e5215b req-b7f9e010-e9d4-4055-99f4-cb73fd493ef4 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:30.460443 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-49550c60-cb2a-4eb9-a399-932320e5215b req-b7f9e010-e9d4-4055-99f4-cb73fd493ef4 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:30.472970 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.compute.server_external_events [req-49550c60-cb2a-4eb9-a399-932320e5215b req-b7f9e010-e9d4-4055-99f4-cb73fd493ef4 service nova] Unable to find a host for instance a2079205-05ab-490e-8b8a-1a5926290a3a. Dropping event network-vif-unplugged {{(pid=127017) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 17 15:01:30.473877 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-49550c60-cb2a-4eb9-a399-932320e5215b req-b7f9e010-e9d4-4055-99f4-cb73fd493ef4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029171 Oct 17 15:01:30.474480 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3618/7368] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 15:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 17 15:01:31.241032 n-d-854247-14 devstack@n-api.service[127016]: INFO oslo.messaging._drivers.impl_rabbit [None req-0c14a9a7-6397-4a55-8383-74052606b52a tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [cf3ac22b-dd11-4f4a-9fac-901ca6f0f90c] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 35810. Oct 17 15:01:31.245075 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0c14a9a7-6397-4a55-8383-74052606b52a tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "POST /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a/action" status: 202 len: 0 microversion: 2.1 time: 1.151112 Oct 17 15:01:31.245739 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3751/7369] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 15:01:30 2022] POST /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a/action => generated 0 bytes in 1152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:01:31.254174 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-87452df0-3563-4b56-aec3-cd1e986249a3 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:01:31.254786 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-87452df0-3563-4b56-aec3-cd1e986249a3 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: a2079205-05ab-490e-8b8a-1a5926290a3a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:01:31.262277 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-87452df0-3563-4b56-aec3-cd1e986249a3 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:31.262775 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-87452df0-3563-4b56-aec3-cd1e986249a3 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:31.263250 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-87452df0-3563-4b56-aec3-cd1e986249a3 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:31.263964 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-87452df0-3563-4b56-aec3-cd1e986249a3 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:31.264432 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-87452df0-3563-4b56-aec3-cd1e986249a3 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:31.264911 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-87452df0-3563-4b56-aec3-cd1e986249a3 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:31.413884 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-87452df0-3563-4b56-aec3-cd1e986249a3 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:01:31.422585 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-87452df0-3563-4b56-aec3-cd1e986249a3 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a" status: 200 len: 1516 microversion: 2.1 time: 0.172030 Oct 17 15:01:31.422841 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3619/7370] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:01:31 2022] GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a => generated 1516 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:01:32.446670 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-99811ad0-5721-4b00-a702-8ee827197653 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:01:32.447402 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-99811ad0-5721-4b00-a702-8ee827197653 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: a2079205-05ab-490e-8b8a-1a5926290a3a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:01:32.455159 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-99811ad0-5721-4b00-a702-8ee827197653 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:32.455684 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-99811ad0-5721-4b00-a702-8ee827197653 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:32.456113 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-99811ad0-5721-4b00-a702-8ee827197653 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:32.456810 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-99811ad0-5721-4b00-a702-8ee827197653 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:32.457252 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-99811ad0-5721-4b00-a702-8ee827197653 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:32.457665 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-99811ad0-5721-4b00-a702-8ee827197653 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:32.600371 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-99811ad0-5721-4b00-a702-8ee827197653 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:01:32.610227 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-99811ad0-5721-4b00-a702-8ee827197653 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a" status: 200 len: 1518 microversion: 2.1 time: 0.168632 Oct 17 15:01:32.610844 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3752/7371] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:01:32 2022] GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a => generated 1518 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:01:33.637831 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-370a8b63-dfab-440a-ba94-f75d936c31c5 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:01:33.638854 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-370a8b63-dfab-440a-ba94-f75d936c31c5 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: a2079205-05ab-490e-8b8a-1a5926290a3a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:01:33.648640 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-370a8b63-dfab-440a-ba94-f75d936c31c5 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:33.649169 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-370a8b63-dfab-440a-ba94-f75d936c31c5 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:33.649928 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-370a8b63-dfab-440a-ba94-f75d936c31c5 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:33.650685 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-370a8b63-dfab-440a-ba94-f75d936c31c5 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:33.651364 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-370a8b63-dfab-440a-ba94-f75d936c31c5 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:33.651932 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-370a8b63-dfab-440a-ba94-f75d936c31c5 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:33.813618 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-370a8b63-dfab-440a-ba94-f75d936c31c5 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:01:33.825269 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-370a8b63-dfab-440a-ba94-f75d936c31c5 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a" status: 200 len: 1518 microversion: 2.1 time: 0.194534 Oct 17 15:01:33.825976 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3620/7372] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:01:33 2022] GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a => generated 1518 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:01:34.851993 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-9e4a0520-3a53-4570-9340-aee917e42993 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:01:34.853121 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-9e4a0520-3a53-4570-9340-aee917e42993 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: a2079205-05ab-490e-8b8a-1a5926290a3a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:01:34.865826 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9e4a0520-3a53-4570-9340-aee917e42993 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:34.866574 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9e4a0520-3a53-4570-9340-aee917e42993 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:34.867325 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9e4a0520-3a53-4570-9340-aee917e42993 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:34.868508 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9e4a0520-3a53-4570-9340-aee917e42993 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:34.869342 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9e4a0520-3a53-4570-9340-aee917e42993 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:34.870052 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-9e4a0520-3a53-4570-9340-aee917e42993 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:35.022229 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-9e4a0520-3a53-4570-9340-aee917e42993 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:01:35.031757 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-9e4a0520-3a53-4570-9340-aee917e42993 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a" status: 200 len: 1518 microversion: 2.1 time: 0.186665 Oct 17 15:01:35.032374 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3753/7373] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:01:34 2022] GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a => generated 1518 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:01:36.057305 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d375a9bf-1c2e-4776-8254-fcf87e2e8503 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:01:36.058479 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d375a9bf-1c2e-4776-8254-fcf87e2e8503 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: a2079205-05ab-490e-8b8a-1a5926290a3a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:01:36.066263 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d375a9bf-1c2e-4776-8254-fcf87e2e8503 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:36.066837 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d375a9bf-1c2e-4776-8254-fcf87e2e8503 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:36.067318 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d375a9bf-1c2e-4776-8254-fcf87e2e8503 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:36.068076 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d375a9bf-1c2e-4776-8254-fcf87e2e8503 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:36.068565 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d375a9bf-1c2e-4776-8254-fcf87e2e8503 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:36.069003 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d375a9bf-1c2e-4776-8254-fcf87e2e8503 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:36.243996 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d375a9bf-1c2e-4776-8254-fcf87e2e8503 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:01:36.252670 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d375a9bf-1c2e-4776-8254-fcf87e2e8503 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a" status: 200 len: 1518 microversion: 2.1 time: 0.200099 Oct 17 15:01:36.253261 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3621/7374] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:01:36 2022] GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a => generated 1518 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:01:37.278599 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d0de7af6-937b-46d3-8b0d-b236a31d8f8c tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:01:37.279306 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d0de7af6-937b-46d3-8b0d-b236a31d8f8c tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: a2079205-05ab-490e-8b8a-1a5926290a3a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:01:37.286890 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d0de7af6-937b-46d3-8b0d-b236a31d8f8c tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:37.287420 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d0de7af6-937b-46d3-8b0d-b236a31d8f8c tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:37.287853 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d0de7af6-937b-46d3-8b0d-b236a31d8f8c tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:37.288627 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d0de7af6-937b-46d3-8b0d-b236a31d8f8c tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:37.289077 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d0de7af6-937b-46d3-8b0d-b236a31d8f8c tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:37.289501 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d0de7af6-937b-46d3-8b0d-b236a31d8f8c tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:37.477867 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d0de7af6-937b-46d3-8b0d-b236a31d8f8c tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:01:37.486985 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d0de7af6-937b-46d3-8b0d-b236a31d8f8c tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a" status: 200 len: 1574 microversion: 2.1 time: 0.212620 Oct 17 15:01:37.487605 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3754/7375] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:01:37 2022] GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a => generated 1574 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:01:38.511098 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a41b01b1-6ce7-4fc3-92cf-be725907e93c tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:01:38.511787 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a41b01b1-6ce7-4fc3-92cf-be725907e93c tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: a2079205-05ab-490e-8b8a-1a5926290a3a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:01:38.519956 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a41b01b1-6ce7-4fc3-92cf-be725907e93c tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:38.520441 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a41b01b1-6ce7-4fc3-92cf-be725907e93c tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:38.520892 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a41b01b1-6ce7-4fc3-92cf-be725907e93c tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:38.521611 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a41b01b1-6ce7-4fc3-92cf-be725907e93c tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:38.522075 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a41b01b1-6ce7-4fc3-92cf-be725907e93c tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:38.522514 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a41b01b1-6ce7-4fc3-92cf-be725907e93c tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:38.682660 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a41b01b1-6ce7-4fc3-92cf-be725907e93c tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:01:38.694997 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a41b01b1-6ce7-4fc3-92cf-be725907e93c tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a" status: 200 len: 1574 microversion: 2.1 time: 0.188221 Oct 17 15:01:38.695856 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3622/7376] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:01:38 2022] GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a => generated 1574 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:01:39.724662 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-43a16b8a-068f-4386-976f-6235e5d3336d tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:01:39.725562 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-43a16b8a-068f-4386-976f-6235e5d3336d tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: a2079205-05ab-490e-8b8a-1a5926290a3a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:01:39.737243 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-43a16b8a-068f-4386-976f-6235e5d3336d tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:39.737803 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-43a16b8a-068f-4386-976f-6235e5d3336d tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:39.738251 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-43a16b8a-068f-4386-976f-6235e5d3336d tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:39.738967 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-43a16b8a-068f-4386-976f-6235e5d3336d tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:39.739457 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-43a16b8a-068f-4386-976f-6235e5d3336d tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:39.739885 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-43a16b8a-068f-4386-976f-6235e5d3336d tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:39.883285 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-43a16b8a-068f-4386-976f-6235e5d3336d tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:01:39.892273 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-43a16b8a-068f-4386-976f-6235e5d3336d tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a" status: 200 len: 1574 microversion: 2.1 time: 0.174699 Oct 17 15:01:39.892871 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3755/7377] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:01:39 2022] GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a => generated 1574 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:01:40.925165 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6a17fb53-5498-4cfb-99d0-1372c9695629 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:01:40.925808 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6a17fb53-5498-4cfb-99d0-1372c9695629 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: a2079205-05ab-490e-8b8a-1a5926290a3a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:01:40.933486 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6a17fb53-5498-4cfb-99d0-1372c9695629 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:40.933996 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6a17fb53-5498-4cfb-99d0-1372c9695629 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:40.934450 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6a17fb53-5498-4cfb-99d0-1372c9695629 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:40.936321 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6a17fb53-5498-4cfb-99d0-1372c9695629 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:40.936321 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6a17fb53-5498-4cfb-99d0-1372c9695629 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:40.936321 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6a17fb53-5498-4cfb-99d0-1372c9695629 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:41.093934 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6a17fb53-5498-4cfb-99d0-1372c9695629 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:01:41.102917 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6a17fb53-5498-4cfb-99d0-1372c9695629 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a" status: 200 len: 1574 microversion: 2.1 time: 0.181522 Oct 17 15:01:41.104013 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3623/7378] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:01:40 2022] GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a => generated 1574 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:01:42.132284 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-ae31ae88-bb04-4fde-b1aa-fe8eba06751f tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:01:42.132918 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-ae31ae88-bb04-4fde-b1aa-fe8eba06751f tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: a2079205-05ab-490e-8b8a-1a5926290a3a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:01:42.140556 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ae31ae88-bb04-4fde-b1aa-fe8eba06751f tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:42.141038 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ae31ae88-bb04-4fde-b1aa-fe8eba06751f tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:42.141468 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ae31ae88-bb04-4fde-b1aa-fe8eba06751f tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:42.142178 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ae31ae88-bb04-4fde-b1aa-fe8eba06751f tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:42.142615 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ae31ae88-bb04-4fde-b1aa-fe8eba06751f tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:42.143062 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-ae31ae88-bb04-4fde-b1aa-fe8eba06751f tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:42.300345 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-ae31ae88-bb04-4fde-b1aa-fe8eba06751f tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:01:42.313575 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-ae31ae88-bb04-4fde-b1aa-fe8eba06751f tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a" status: 200 len: 1574 microversion: 2.1 time: 0.185258 Oct 17 15:01:42.314164 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3756/7379] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:01:42 2022] GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a => generated 1574 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:01:43.337715 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d8ace37e-2969-4775-b004-d928d36633f4 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:01:43.338509 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d8ace37e-2969-4775-b004-d928d36633f4 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: a2079205-05ab-490e-8b8a-1a5926290a3a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:01:43.345980 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d8ace37e-2969-4775-b004-d928d36633f4 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:43.346472 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d8ace37e-2969-4775-b004-d928d36633f4 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:43.346929 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d8ace37e-2969-4775-b004-d928d36633f4 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:43.347752 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d8ace37e-2969-4775-b004-d928d36633f4 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:43.348164 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d8ace37e-2969-4775-b004-d928d36633f4 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:43.348605 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d8ace37e-2969-4775-b004-d928d36633f4 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:43.497944 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d8ace37e-2969-4775-b004-d928d36633f4 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:01:43.506469 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d8ace37e-2969-4775-b004-d928d36633f4 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a" status: 200 len: 1574 microversion: 2.1 time: 0.172841 Oct 17 15:01:43.507072 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3624/7380] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:01:43 2022] GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a => generated 1574 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:01:44.531131 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e8143520-3dd1-4e02-82df-dd19e0afd5a2 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:01:44.531795 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e8143520-3dd1-4e02-82df-dd19e0afd5a2 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: a2079205-05ab-490e-8b8a-1a5926290a3a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:01:44.538680 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e8143520-3dd1-4e02-82df-dd19e0afd5a2 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:44.539157 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e8143520-3dd1-4e02-82df-dd19e0afd5a2 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:44.539657 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e8143520-3dd1-4e02-82df-dd19e0afd5a2 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:44.540396 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e8143520-3dd1-4e02-82df-dd19e0afd5a2 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:44.540907 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e8143520-3dd1-4e02-82df-dd19e0afd5a2 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:44.541335 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e8143520-3dd1-4e02-82df-dd19e0afd5a2 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:44.562179 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:01:44.689402 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e8143520-3dd1-4e02-82df-dd19e0afd5a2 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:01:44.698224 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e8143520-3dd1-4e02-82df-dd19e0afd5a2 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a" status: 200 len: 1574 microversion: 2.1 time: 0.171053 Oct 17 15:01:44.698825 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3757/7381] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:01:44 2022] GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a => generated 1574 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:01:45.726420 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-10a1edb4-59eb-4335-91f2-a4e5e6fc1722 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:01:45.727021 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-10a1edb4-59eb-4335-91f2-a4e5e6fc1722 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: a2079205-05ab-490e-8b8a-1a5926290a3a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:01:45.730075 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=29 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:01:45.736292 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-10a1edb4-59eb-4335-91f2-a4e5e6fc1722 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:45.736794 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-10a1edb4-59eb-4335-91f2-a4e5e6fc1722 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:45.737239 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-10a1edb4-59eb-4335-91f2-a4e5e6fc1722 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:45.737956 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-10a1edb4-59eb-4335-91f2-a4e5e6fc1722 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:45.738415 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-10a1edb4-59eb-4335-91f2-a4e5e6fc1722 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:45.738847 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-10a1edb4-59eb-4335-91f2-a4e5e6fc1722 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:45.741853 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=81 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:01:45.894340 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-10a1edb4-59eb-4335-91f2-a4e5e6fc1722 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:01:45.904473 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-10a1edb4-59eb-4335-91f2-a4e5e6fc1722 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a" status: 200 len: 1574 microversion: 2.1 time: 0.182244 Oct 17 15:01:45.905100 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3625/7382] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:01:45 2022] GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a => generated 1574 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:01:46.552800 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-dae9494b-0129-4a52-92c0-9a41490d2bff req-c0cbaff6-dcf9-4095-841e-d6ce9e4c386c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2079205-05ab-490e-8b8a-1a5926290a3a", "name": "network-vif-plugged", "status": "completed", "tag": "adb20e79-a98b-4888-ac3a-319480304fe6"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:01:46.561356 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:01:46.569970 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-dae9494b-0129-4a52-92c0-9a41490d2bff req-c0cbaff6-dcf9-4095-841e-d6ce9e4c386c service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:46.570493 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-dae9494b-0129-4a52-92c0-9a41490d2bff req-c0cbaff6-dcf9-4095-841e-d6ce9e4c386c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:46.570924 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-dae9494b-0129-4a52-92c0-9a41490d2bff req-c0cbaff6-dcf9-4095-841e-d6ce9e4c386c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:46.583770 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-dae9494b-0129-4a52-92c0-9a41490d2bff req-c0cbaff6-dcf9-4095-841e-d6ce9e4c386c service nova] Creating event network-vif-plugged:adb20e79-a98b-4888-ac3a-319480304fe6 for instance a2079205-05ab-490e-8b8a-1a5926290a3a on n-h1-854247-14 Oct 17 15:01:46.589563 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-dae9494b-0129-4a52-92c0-9a41490d2bff req-c0cbaff6-dcf9-4095-841e-d6ce9e4c386c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043463 Oct 17 15:01:46.590186 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3758/7383] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 15:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:01:46.937696 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-78f83ac5-ff00-4e85-a8e3-3577c89a322b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:01:46.938343 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-78f83ac5-ff00-4e85-a8e3-3577c89a322b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: a2079205-05ab-490e-8b8a-1a5926290a3a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:01:46.946155 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-78f83ac5-ff00-4e85-a8e3-3577c89a322b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:46.946704 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-78f83ac5-ff00-4e85-a8e3-3577c89a322b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:46.947155 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-78f83ac5-ff00-4e85-a8e3-3577c89a322b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:46.948159 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-78f83ac5-ff00-4e85-a8e3-3577c89a322b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:46.948882 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-78f83ac5-ff00-4e85-a8e3-3577c89a322b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:46.949328 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-78f83ac5-ff00-4e85-a8e3-3577c89a322b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:47.098407 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-78f83ac5-ff00-4e85-a8e3-3577c89a322b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:01:47.110375 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-78f83ac5-ff00-4e85-a8e3-3577c89a322b tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a" status: 200 len: 1574 microversion: 2.1 time: 0.178353 Oct 17 15:01:47.111123 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3626/7384] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:01:46 2022] GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a => generated 1574 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:01:48.137951 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e1ecc36a-bff2-4e2d-875b-353933a0e84a tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:01:48.138671 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e1ecc36a-bff2-4e2d-875b-353933a0e84a tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: a2079205-05ab-490e-8b8a-1a5926290a3a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:01:48.146428 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e1ecc36a-bff2-4e2d-875b-353933a0e84a tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:48.146918 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e1ecc36a-bff2-4e2d-875b-353933a0e84a tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:48.147437 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e1ecc36a-bff2-4e2d-875b-353933a0e84a tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:48.148149 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e1ecc36a-bff2-4e2d-875b-353933a0e84a tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:48.148601 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e1ecc36a-bff2-4e2d-875b-353933a0e84a tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:48.149167 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-e1ecc36a-bff2-4e2d-875b-353933a0e84a tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:48.307569 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e1ecc36a-bff2-4e2d-875b-353933a0e84a tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:01:48.318957 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e1ecc36a-bff2-4e2d-875b-353933a0e84a tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a" status: 200 len: 1561 microversion: 2.1 time: 0.185508 Oct 17 15:01:48.319729 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3759/7385] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:01:48 2022] GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a => generated 1561 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:03:02.733337 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=3 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:03:02.734144 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=11 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:03:02.735982 n-d-854247-14 devstack@n-api.service[127017]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 15:03:02.736145 n-d-854247-14 devstack@n-api.service[127017]: Mon Oct 17 15:03:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a (ip 10.222.0.79) !!! Oct 17 15:03:02.736273 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=3 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:03:02.737131 n-d-854247-14 devstack@n-api.service[127017]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 15:03:02.737275 n-d-854247-14 devstack@n-api.service[127017]: Mon Oct 17 15:03:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a (ip 10.222.0.79) !!! Oct 17 15:03:02.738155 n-d-854247-14 devstack@n-api.service[127017]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 15:03:02.738287 n-d-854247-14 devstack@n-api.service[127017]: Mon Oct 17 15:03:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a (ip 10.222.0.79) !!! Oct 17 15:03:02.738467 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=10 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:03:02.741618 n-d-854247-14 devstack@n-api.service[127016]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 15:03:02.741758 n-d-854247-14 devstack@n-api.service[127016]: Mon Oct 17 15:03:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.79) !!! Oct 17 15:03:02.742941 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0eaa2c78-e3b3-4a1d-9fd3-1846059bf2f3 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:03:02.743475 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0eaa2c78-e3b3-4a1d-9fd3-1846059bf2f3 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: a2079205-05ab-490e-8b8a-1a5926290a3a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:03:02.749411 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-3c57ebf4-74c1-464f-94e6-94b75c0dbabc req-644fa587-fe21-4714-903d-e57237c4b66d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2079205-05ab-490e-8b8a-1a5926290a3a", "tag": "adb20e79-a98b-4888-ac3a-319480304fe6"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:03:02.754056 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0eaa2c78-e3b3-4a1d-9fd3-1846059bf2f3 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:03:02.754682 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0eaa2c78-e3b3-4a1d-9fd3-1846059bf2f3 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:03:02.755206 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0eaa2c78-e3b3-4a1d-9fd3-1846059bf2f3 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:03:02.756002 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0eaa2c78-e3b3-4a1d-9fd3-1846059bf2f3 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:03:02.756710 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0eaa2c78-e3b3-4a1d-9fd3-1846059bf2f3 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:03:02.757207 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0eaa2c78-e3b3-4a1d-9fd3-1846059bf2f3 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:03:02.767627 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-3c57ebf4-74c1-464f-94e6-94b75c0dbabc req-644fa587-fe21-4714-903d-e57237c4b66d service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:03:02.768393 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-3c57ebf4-74c1-464f-94e6-94b75c0dbabc req-644fa587-fe21-4714-903d-e57237c4b66d service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:03:02.768827 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-3c57ebf4-74c1-464f-94e6-94b75c0dbabc req-644fa587-fe21-4714-903d-e57237c4b66d service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:03:02.782112 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-3c57ebf4-74c1-464f-94e6-94b75c0dbabc req-644fa587-fe21-4714-903d-e57237c4b66d service nova] Creating event network-changed:adb20e79-a98b-4888-ac3a-319480304fe6 for instance a2079205-05ab-490e-8b8a-1a5926290a3a on n-h1-854247-14 Oct 17 15:03:02.785680 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0eaa2c78-e3b3-4a1d-9fd3-1846059bf2f3 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: a2079205-05ab-490e-8b8a-1a5926290a3a] Going to try to terminate instance {{(pid=127017) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:03:02.788508 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-3c57ebf4-74c1-464f-94e6-94b75c0dbabc req-644fa587-fe21-4714-903d-e57237c4b66d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054332 Oct 17 15:03:02.789324 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3760/7386] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 15:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:03:02.884088 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0eaa2c78-e3b3-4a1d-9fd3-1846059bf2f3 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a" status: 204 len: 0 microversion: 2.1 time: 0.152663 Oct 17 15:03:02.884985 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3627/7387] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 15:03:02 2022] DELETE /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:03:02.894440 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-72b17088-3fed-4123-80e3-338377a549c1 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:03:02.895626 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-72b17088-3fed-4123-80e3-338377a549c1 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: a2079205-05ab-490e-8b8a-1a5926290a3a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:03:02.902323 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-72b17088-3fed-4123-80e3-338377a549c1 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:03:02.902888 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-72b17088-3fed-4123-80e3-338377a549c1 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:03:02.903432 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-72b17088-3fed-4123-80e3-338377a549c1 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:03:02.904207 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-72b17088-3fed-4123-80e3-338377a549c1 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:03:02.904779 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-72b17088-3fed-4123-80e3-338377a549c1 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:03:02.905270 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-72b17088-3fed-4123-80e3-338377a549c1 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:03:03.064641 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-72b17088-3fed-4123-80e3-338377a549c1 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:03:03.072997 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-72b17088-3fed-4123-80e3-338377a549c1 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a" status: 200 len: 1567 microversion: 2.1 time: 0.183663 Oct 17 15:03:03.073697 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3761/7388] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:03:02 2022] GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a => generated 1567 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:03:04.098737 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-528ad00d-bf66-44ff-9531-a34327f2fc94 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:03:04.100033 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-528ad00d-bf66-44ff-9531-a34327f2fc94 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: a2079205-05ab-490e-8b8a-1a5926290a3a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:03:04.107736 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-528ad00d-bf66-44ff-9531-a34327f2fc94 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:03:04.108231 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-528ad00d-bf66-44ff-9531-a34327f2fc94 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:03:04.108704 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-528ad00d-bf66-44ff-9531-a34327f2fc94 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:03:04.109441 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-528ad00d-bf66-44ff-9531-a34327f2fc94 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:03:04.109899 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-528ad00d-bf66-44ff-9531-a34327f2fc94 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:03:04.110326 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-528ad00d-bf66-44ff-9531-a34327f2fc94 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:03:04.280598 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-528ad00d-bf66-44ff-9531-a34327f2fc94 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:03:04.289037 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-528ad00d-bf66-44ff-9531-a34327f2fc94 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a" status: 200 len: 1567 microversion: 2.1 time: 0.194692 Oct 17 15:03:04.289619 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3628/7389] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:03:04 2022] GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a => generated 1567 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:03:05.158295 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-98976da7-48b7-451d-bc6c-42aa1b2e7d80 req-c6a68f79-9eb2-4cd5-9a79-e9c6811a7f53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2079205-05ab-490e-8b8a-1a5926290a3a", "name": "network-vif-deleted", "tag": "adb20e79-a98b-4888-ac3a-319480304fe6"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:03:05.168992 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-98976da7-48b7-451d-bc6c-42aa1b2e7d80 req-c6a68f79-9eb2-4cd5-9a79-e9c6811a7f53 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:03:05.169447 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-98976da7-48b7-451d-bc6c-42aa1b2e7d80 req-c6a68f79-9eb2-4cd5-9a79-e9c6811a7f53 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:03:05.169867 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-98976da7-48b7-451d-bc6c-42aa1b2e7d80 req-c6a68f79-9eb2-4cd5-9a79-e9c6811a7f53 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:03:05.181285 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-98976da7-48b7-451d-bc6c-42aa1b2e7d80 req-c6a68f79-9eb2-4cd5-9a79-e9c6811a7f53 service nova] Creating event network-vif-deleted:adb20e79-a98b-4888-ac3a-319480304fe6 for instance a2079205-05ab-490e-8b8a-1a5926290a3a on n-h1-854247-14 Oct 17 15:03:05.186802 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-98976da7-48b7-451d-bc6c-42aa1b2e7d80 req-c6a68f79-9eb2-4cd5-9a79-e9c6811a7f53 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032264 Oct 17 15:03:05.190341 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3762/7390] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 15:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:03:05.313566 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-f0f5dad3-28e0-4468-a83a-ec7d356b650d tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:03:05.314166 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-f0f5dad3-28e0-4468-a83a-ec7d356b650d tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: a2079205-05ab-490e-8b8a-1a5926290a3a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:03:05.322015 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f0f5dad3-28e0-4468-a83a-ec7d356b650d tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:03:05.322495 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f0f5dad3-28e0-4468-a83a-ec7d356b650d tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:03:05.322905 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f0f5dad3-28e0-4468-a83a-ec7d356b650d tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:03:05.323653 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f0f5dad3-28e0-4468-a83a-ec7d356b650d tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:03:05.324124 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f0f5dad3-28e0-4468-a83a-ec7d356b650d tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:03:05.324568 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-f0f5dad3-28e0-4468-a83a-ec7d356b650d tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:03:05.388267 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-f0f5dad3-28e0-4468-a83a-ec7d356b650d tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:03:05.396665 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-f0f5dad3-28e0-4468-a83a-ec7d356b650d tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a" status: 200 len: 1219 microversion: 2.1 time: 0.087128 Oct 17 15:03:05.397247 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3629/7391] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:03:05 2022] GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:03:06.422492 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-d4017dc9-0a4e-4669-8e68-3c1ca72c6ad6 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:03:06.423115 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-d4017dc9-0a4e-4669-8e68-3c1ca72c6ad6 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: a2079205-05ab-490e-8b8a-1a5926290a3a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:03:06.429632 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d4017dc9-0a4e-4669-8e68-3c1ca72c6ad6 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:03:06.430123 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d4017dc9-0a4e-4669-8e68-3c1ca72c6ad6 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:03:06.430556 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d4017dc9-0a4e-4669-8e68-3c1ca72c6ad6 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:03:06.431292 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d4017dc9-0a4e-4669-8e68-3c1ca72c6ad6 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:03:06.431749 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d4017dc9-0a4e-4669-8e68-3c1ca72c6ad6 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:03:06.432171 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-d4017dc9-0a4e-4669-8e68-3c1ca72c6ad6 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:03:06.502139 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-d4017dc9-0a4e-4669-8e68-3c1ca72c6ad6 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:03:06.510593 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-d4017dc9-0a4e-4669-8e68-3c1ca72c6ad6 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a" status: 200 len: 1219 microversion: 2.1 time: 0.093554 Oct 17 15:03:06.511450 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3763/7392] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:03:06 2022] GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:03:07.534229 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a1a6043a-685f-48a7-af73-3b6da6409e99 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:03:07.534961 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a1a6043a-685f-48a7-af73-3b6da6409e99 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: a2079205-05ab-490e-8b8a-1a5926290a3a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:03:07.542437 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a1a6043a-685f-48a7-af73-3b6da6409e99 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:03:07.542940 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a1a6043a-685f-48a7-af73-3b6da6409e99 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:03:07.543409 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a1a6043a-685f-48a7-af73-3b6da6409e99 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:03:07.544131 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a1a6043a-685f-48a7-af73-3b6da6409e99 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:03:07.544597 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a1a6043a-685f-48a7-af73-3b6da6409e99 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:03:07.545034 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a1a6043a-685f-48a7-af73-3b6da6409e99 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:03:07.615526 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a1a6043a-685f-48a7-af73-3b6da6409e99 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:03:07.624146 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a1a6043a-685f-48a7-af73-3b6da6409e99 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a" status: 200 len: 1219 microversion: 2.1 time: 0.093911 Oct 17 15:03:07.624734 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3630/7393] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:03:07 2022] GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:03:08.646599 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-0d8548bc-d8a4-4b17-aed3-f3b3888e9c4d tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:03:08.647446 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-0d8548bc-d8a4-4b17-aed3-f3b3888e9c4d tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: a2079205-05ab-490e-8b8a-1a5926290a3a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:03:08.655024 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0d8548bc-d8a4-4b17-aed3-f3b3888e9c4d tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:03:08.655619 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0d8548bc-d8a4-4b17-aed3-f3b3888e9c4d tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:03:08.656073 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0d8548bc-d8a4-4b17-aed3-f3b3888e9c4d tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:03:08.656792 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0d8548bc-d8a4-4b17-aed3-f3b3888e9c4d tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:03:08.657268 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0d8548bc-d8a4-4b17-aed3-f3b3888e9c4d tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:03:08.657693 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-0d8548bc-d8a4-4b17-aed3-f3b3888e9c4d tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:03:08.722421 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-0d8548bc-d8a4-4b17-aed3-f3b3888e9c4d tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:03:08.731221 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-0d8548bc-d8a4-4b17-aed3-f3b3888e9c4d tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a" status: 200 len: 1219 microversion: 2.1 time: 0.088648 Oct 17 15:03:08.731837 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3764/7394] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:03:08 2022] GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:03:09.756340 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d26b50f6-964a-4e7f-be8e-49fa8b697340 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:03:09.756954 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d26b50f6-964a-4e7f-be8e-49fa8b697340 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: a2079205-05ab-490e-8b8a-1a5926290a3a] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:03:09.765857 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d26b50f6-964a-4e7f-be8e-49fa8b697340 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:03:09.766514 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d26b50f6-964a-4e7f-be8e-49fa8b697340 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:03:09.766966 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d26b50f6-964a-4e7f-be8e-49fa8b697340 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:03:09.767694 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d26b50f6-964a-4e7f-be8e-49fa8b697340 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:03:09.768386 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d26b50f6-964a-4e7f-be8e-49fa8b697340 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:03:09.768820 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d26b50f6-964a-4e7f-be8e-49fa8b697340 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:03:09.806702 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d26b50f6-964a-4e7f-be8e-49fa8b697340 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:03:09.807276 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d26b50f6-964a-4e7f-be8e-49fa8b697340 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:03:09.807718 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d26b50f6-964a-4e7f-be8e-49fa8b697340 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:03:09.808180 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.objects.instance [None req-d26b50f6-964a-4e7f-be8e-49fa8b697340 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lazy-loading 'fault' on Instance uuid a2079205-05ab-490e-8b8a-1a5926290a3a {{(pid=127017) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:03:09.856104 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d26b50f6-964a-4e7f-be8e-49fa8b697340 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43c600eebc68451196362d36d6808744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91785ab2c7c94f089cc2f824a1d1a05b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:03:09.865584 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d26b50f6-964a-4e7f-be8e-49fa8b697340 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a" status: 200 len: 1224 microversion: 2.1 time: 0.113763 Oct 17 15:03:09.866506 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3631/7395] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:03:09 2022] GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a => generated 1224 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:03:10.889825 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-236c4c57-5467-4cf7-b6e1-8b5f9ea52121 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:03:10.890728 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-236c4c57-5467-4cf7-b6e1-8b5f9ea52121 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] [instance: a2079205-05ab-490e-8b8a-1a5926290a3a] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:03:10.898486 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-236c4c57-5467-4cf7-b6e1-8b5f9ea52121 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:03:10.898968 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-236c4c57-5467-4cf7-b6e1-8b5f9ea52121 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:03:10.899431 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-236c4c57-5467-4cf7-b6e1-8b5f9ea52121 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:03:10.900135 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-236c4c57-5467-4cf7-b6e1-8b5f9ea52121 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:03:10.900584 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-236c4c57-5467-4cf7-b6e1-8b5f9ea52121 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:03:10.901141 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-236c4c57-5467-4cf7-b6e1-8b5f9ea52121 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:03:10.915770 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.wsgi [None req-236c4c57-5467-4cf7-b6e1-8b5f9ea52121 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] HTTP exception thrown: Instance a2079205-05ab-490e-8b8a-1a5926290a3a could not be found. Oct 17 15:03:10.917457 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-236c4c57-5467-4cf7-b6e1-8b5f9ea52121 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Request method failure captured: Oct 17 15:03:10.917457 n-d-854247-14 devstack@n-api.service[127016]: request: GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a HTTP/1.1 Oct 17 15:03:10.917457 n-d-854247-14 devstack@n-api.service[127016]: Accept: application/json Oct 17 15:03:10.917457 n-d-854247-14 devstack@n-api.service[127016]: Accept-Encoding: identity Oct 17 15:03:10.917457 n-d-854247-14 devstack@n-api.service[127016]: Connection: close Oct 17 15:03:10.917457 n-d-854247-14 devstack@n-api.service[127016]: Content-Length: 0 Oct 17 15:03:10.917457 n-d-854247-14 devstack@n-api.service[127016]: Content-Type: application/json Oct 17 15:03:10.917457 n-d-854247-14 devstack@n-api.service[127016]: Host: 10.222.0.79 Oct 17 15:03:10.917457 n-d-854247-14 devstack@n-api.service[127016]: Openstack-System-Scope: None Oct 17 15:03:10.917457 n-d-854247-14 devstack@n-api.service[127016]: User-Agent: python-urllib3/1.26.12 Oct 17 15:03:10.917457 n-d-854247-14 devstack@n-api.service[127016]: X-Auth-Token: gAAAAABjTWyj8IeUvDLkiyGMVxAxDHw2IGRlt70sHDB6eJrxR56M2bSGNDhH9OzIJFgKZq7Kfit6FrITP_0hCbyCfDQ6MZVqhHMoQGpGK1lB7gwk7SgpehkqhQ2n9Mlpt8IukSy22j5IwCSw5oNSAQ9OWXtxr4c4lA8aOdBMPVtlsrQQbDuRwz4 Oct 17 15:03:10.917457 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Id: None Oct 17 15:03:10.917457 n-d-854247-14 devstack@n-api.service[127016]: X-Domain-Name: None Oct 17 15:03:10.917457 n-d-854247-14 devstack@n-api.service[127016]: X-Identity-Status: Confirmed Oct 17 15:03:10.917457 n-d-854247-14 devstack@n-api.service[127016]: X-Is-Admin-Project: True Oct 17 15:03:10.917457 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Id: default Oct 17 15:03:10.917457 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Domain-Name: Default Oct 17 15:03:10.917457 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Id: 91785ab2c7c94f089cc2f824a1d1a05b Oct 17 15:03:10.917457 n-d-854247-14 devstack@n-api.service[127016]: X-Project-Name: tempest-TestShelveInstance-1901075906 Oct 17 15:03:10.917457 n-d-854247-14 devstack@n-api.service[127016]: X-Role: reader,member Oct 17 15:03:10.917457 n-d-854247-14 devstack@n-api.service[127016]: X-Roles: reader,member Oct 17 15:03:10.917457 n-d-854247-14 devstack@n-api.service[127016]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/91785ab2c7c94f089cc2f824a1d1a05b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/91785ab2c7c94f089cc2f824a1d1a05b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/91785ab2c7c94f089cc2f824a1d1a05b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_91785ab2c7c94f089cc2f824a1d1a05b", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 15:03:10.917457 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant: tempest-TestShelveInstance-1901075906 Oct 17 15:03:10.917457 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Id: 91785ab2c7c94f089cc2f824a1d1a05b Oct 17 15:03:10.917457 n-d-854247-14 devstack@n-api.service[127016]: X-Tenant-Name: tempest-TestShelveInstance-1901075906 Oct 17 15:03:10.917457 n-d-854247-14 devstack@n-api.service[127016]: X-User: tempest-TestShelveInstance-1901075906-project Oct 17 15:03:10.917457 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Id: default Oct 17 15:03:10.917457 n-d-854247-14 devstack@n-api.service[127016]: X-User-Domain-Name: Default Oct 17 15:03:10.917457 n-d-854247-14 devstack@n-api.service[127016]: X-User-Id: 43c600eebc68451196362d36d6808744 Oct 17 15:03:10.917457 n-d-854247-14 devstack@n-api.service[127016]: X-User-Name: tempest-TestShelveInstance-1901075906-project Oct 17 15:03:10.917457 n-d-854247-14 devstack@n-api.service[127016]: method: > Oct 17 15:03:10.917457 n-d-854247-14 devstack@n-api.service[127016]: exception: Instance a2079205-05ab-490e-8b8a-1a5926290a3a could not be found. Oct 17 15:03:10.917457 n-d-854247-14 devstack@n-api.service[127016]: action_args: {'id': 'a2079205-05ab-490e-8b8a-1a5926290a3a'} Oct 17 15:03:10.917457 n-d-854247-14 devstack@n-api.service[127016]: {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:03:10.917457 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:03:10.917457 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:03:10.917457 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:03:10.917457 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:03:10.917457 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:03:10.917457 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:03:10.917457 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:03:10.917457 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:03:10.917457 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:03:10.917457 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2079205-05ab-490e-8b8a-1a5926290a3a could not be found. Oct 17 15:03:10.917457 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 15:03:10.917457 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:03:10.917457 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 15:03:10.917457 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:03:10.917457 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:03:10.917457 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:03:10.917457 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:03:10.917457 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:03:10.917457 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:03:10.917457 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:03:10.917457 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:03:10.917457 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:03:10.917457 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:03:10.917457 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:03:10.917457 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:03:10.917457 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:03:10.917457 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2079205-05ab-490e-8b8a-1a5926290a3a could not be found. Oct 17 15:03:10.917457 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 15:03:10.917457 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:03:10.917457 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 15:03:10.922773 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:03:10.922773 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:03:10.922773 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:03:10.922773 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:03:10.922773 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:03:10.922773 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2079205-05ab-490e-8b8a-1a5926290a3a could not be found. Oct 17 15:03:10.922773 n-d-854247-14 devstack@n-api.service[127016]: ERROR nova.api.openstack.wsgi Oct 17 15:03:10.922773 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-236c4c57-5467-4cf7-b6e1-8b5f9ea52121 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Returning 404 to user: Instance a2079205-05ab-490e-8b8a-1a5926290a3a could not be found. {{(pid=127016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:03:10.922773 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-236c4c57-5467-4cf7-b6e1-8b5f9ea52121 tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a" status: 404 len: 111 microversion: 2.1 time: 0.033205 Oct 17 15:03:10.922773 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3765/7396] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:03:10 2022] GET /compute/v2.1/servers/a2079205-05ab-490e-8b8a-1a5926290a3a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:03:11.089874 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-ebebde04-5ceb-4657-82af-7484ece8504f tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] Calling method '.version_select at 0x7f7cd556f700>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:03:11.128522 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-ebebde04-5ceb-4657-82af-7484ece8504f tempest-TestShelveInstance-1901075906 tempest-TestShelveInstance-1901075906-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1054876058" status: 202 len: 0 microversion: 2.1 time: 0.042994 Oct 17 15:03:11.129195 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3632/7397] 10.222.0.79 () {58 vars in 1254 bytes} [Mon Oct 17 15:03:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1054876058 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:03:29.212262 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=12 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:03:29.213149 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=24 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:03:29.401505 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a7a8d7b7-e8e3-420f-9ca2-d223c00b97b1 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Action: 'create', calling method: .version_select at 0x7f7cd505a430>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-259308173", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbCbkoleH0MmyWPY3L4uF6ZytMGu9h1jgl6TpVpe7vCQVi9VBOesK+8G9krA7+NCgvVeLxd6PZ5fr8sOwjh9F7YfzsN9HOVxc2QxHH6XDBBjXU/21koWVtYdjAmrxwrZw=="}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:03:29.417575 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-a7a8d7b7-e8e3-420f-9ca2-d223c00b97b1 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Getting quotas for project 49bdc53021824277aacd3c9c8562e718. Resources: {'key_pairs'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:03:29.423202 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.quota [None req-a7a8d7b7-e8e3-420f-9ca2-d223c00b97b1 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Getting quotas for user 7f70c581f50042849951ca0117913dfd and project 49bdc53021824277aacd3c9c8562e718. Resources: {'key_pairs'} {{(pid=127016) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:03:29.459195 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a7a8d7b7-e8e3-420f-9ca2-d223c00b97b1 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.252166 Oct 17 15:03:29.460160 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3766/7398] 10.222.0.79 () {60 vars in 1159 bytes} [Mon Oct 17 15:03:29 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:03:30.664787 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:03:30.665572 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:03:30.670390 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6d2f5752-7cff-4f75-9293-31277cfb5835 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-265901547", "imageRef": "0743b21b-a6ff-4d02-897c-eabb68c3ba07", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-259308173", "security_groups": [{"name": "tempest-secgroup-smoke-1594775987"}], "networks": [{"uuid": "5b41b238-d339-47c3-91e5-ce1625e1b2ce"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:03:30.786504 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-6d2f5752-7cff-4f75-9293-31277cfb5835 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] validate_networks() for [('5b41b238-d339-47c3-91e5-ce1625e1b2ce', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:03:31.313805 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-6d2f5752-7cff-4f75-9293-31277cfb5835 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:03:31.314273 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-6d2f5752-7cff-4f75-9293-31277cfb5835 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:03:31.314728 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-6d2f5752-7cff-4f75-9293-31277cfb5835 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:03:31.315326 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-6d2f5752-7cff-4f75-9293-31277cfb5835 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:03:31.315815 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-6d2f5752-7cff-4f75-9293-31277cfb5835 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:03:31.325755 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6d2f5752-7cff-4f75-9293-31277cfb5835 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:03:31.326252 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6d2f5752-7cff-4f75-9293-31277cfb5835 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:03:31.326700 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6d2f5752-7cff-4f75-9293-31277cfb5835 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:03:31.327478 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6d2f5752-7cff-4f75-9293-31277cfb5835 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:03:31.327950 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6d2f5752-7cff-4f75-9293-31277cfb5835 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:03:31.328446 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6d2f5752-7cff-4f75-9293-31277cfb5835 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:03:31.348182 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-6d2f5752-7cff-4f75-9293-31277cfb5835 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Getting quotas for project 49bdc53021824277aacd3c9c8562e718. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:03:31.353837 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-6d2f5752-7cff-4f75-9293-31277cfb5835 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Getting quotas for user 7f70c581f50042849951ca0117913dfd and project 49bdc53021824277aacd3c9c8562e718. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:03:31.367536 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6d2f5752-7cff-4f75-9293-31277cfb5835 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:03:31.369893 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6d2f5752-7cff-4f75-9293-31277cfb5835 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] [instance: 0227f1c2-0c9b-4148-a85e-fd3210fd63f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0743b21b-a6ff-4d02-897c-eabb68c3ba07',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:03:31.418743 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6d2f5752-7cff-4f75-9293-31277cfb5835 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.756011 Oct 17 15:03:31.419435 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3633/7399] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 15:03:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:03:31.432070 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4bb7c310-99bd-4ac0-b3c4-d3e29cbd519e tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:03:31.433369 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4bb7c310-99bd-4ac0-b3c4-d3e29cbd519e tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] [instance: 0227f1c2-0c9b-4148-a85e-fd3210fd63f3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:03:31.517160 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4bb7c310-99bd-4ac0-b3c4-d3e29cbd519e tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f70c581f50042849951ca0117913dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bdc53021824277aacd3c9c8562e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:03:31.524952 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4bb7c310-99bd-4ac0-b3c4-d3e29cbd519e tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] 10.222.0.79 "GET /compute/v2.1/servers/0227f1c2-0c9b-4148-a85e-fd3210fd63f3" status: 200 len: 1247 microversion: 2.1 time: 0.097907 Oct 17 15:03:31.525551 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3767/7400] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:03:31 2022] GET /compute/v2.1/servers/0227f1c2-0c9b-4148-a85e-fd3210fd63f3 => generated 1247 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:03:32.550454 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-cfa30c3d-355d-4845-8785-dace430949f5 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:03:32.551024 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-cfa30c3d-355d-4845-8785-dace430949f5 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] [instance: 0227f1c2-0c9b-4148-a85e-fd3210fd63f3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:03:32.560373 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cfa30c3d-355d-4845-8785-dace430949f5 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:03:32.560884 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cfa30c3d-355d-4845-8785-dace430949f5 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:03:32.561337 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cfa30c3d-355d-4845-8785-dace430949f5 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:03:32.562047 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cfa30c3d-355d-4845-8785-dace430949f5 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:03:32.562622 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cfa30c3d-355d-4845-8785-dace430949f5 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:03:32.563392 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-cfa30c3d-355d-4845-8785-dace430949f5 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:03:32.646079 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-cfa30c3d-355d-4845-8785-dace430949f5 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f70c581f50042849951ca0117913dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bdc53021824277aacd3c9c8562e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:03:32.665576 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-cfa30c3d-355d-4845-8785-dace430949f5 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] 10.222.0.79 "GET /compute/v2.1/servers/0227f1c2-0c9b-4148-a85e-fd3210fd63f3" status: 200 len: 1299 microversion: 2.1 time: 0.119158 Oct 17 15:03:32.682859 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3634/7401] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:03:32 2022] GET /compute/v2.1/servers/0227f1c2-0c9b-4148-a85e-fd3210fd63f3 => generated 1299 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:03:33.697400 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a7e9b8b8-ac44-444b-9b2f-941821c79947 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:03:33.698182 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a7e9b8b8-ac44-444b-9b2f-941821c79947 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] [instance: 0227f1c2-0c9b-4148-a85e-fd3210fd63f3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:03:33.706100 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a7e9b8b8-ac44-444b-9b2f-941821c79947 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:03:33.707308 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a7e9b8b8-ac44-444b-9b2f-941821c79947 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:03:33.707942 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a7e9b8b8-ac44-444b-9b2f-941821c79947 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:03:33.709007 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a7e9b8b8-ac44-444b-9b2f-941821c79947 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:03:33.709692 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a7e9b8b8-ac44-444b-9b2f-941821c79947 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:03:33.710380 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a7e9b8b8-ac44-444b-9b2f-941821c79947 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:03:34.183972 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a7e9b8b8-ac44-444b-9b2f-941821c79947 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f70c581f50042849951ca0117913dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bdc53021824277aacd3c9c8562e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:03:34.192095 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a7e9b8b8-ac44-444b-9b2f-941821c79947 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] 10.222.0.79 "GET /compute/v2.1/servers/0227f1c2-0c9b-4148-a85e-fd3210fd63f3" status: 200 len: 1373 microversion: 2.1 time: 0.498777 Oct 17 15:03:34.192685 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3768/7402] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:03:33 2022] GET /compute/v2.1/servers/0227f1c2-0c9b-4148-a85e-fd3210fd63f3 => generated 1373 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:03:34.244492 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-16e2e91d-7b87-4109-a3d0-40bb90d72197 req-1029d979-bacc-43d7-9042-14ad3423f436 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0227f1c2-0c9b-4148-a85e-fd3210fd63f3", "tag": "3e694e20-080b-4705-bb26-99797a62bbda"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:03:34.264527 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-16e2e91d-7b87-4109-a3d0-40bb90d72197 req-1029d979-bacc-43d7-9042-14ad3423f436 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:03:34.265375 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-16e2e91d-7b87-4109-a3d0-40bb90d72197 req-1029d979-bacc-43d7-9042-14ad3423f436 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:03:34.266208 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-16e2e91d-7b87-4109-a3d0-40bb90d72197 req-1029d979-bacc-43d7-9042-14ad3423f436 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:03:34.279334 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-16e2e91d-7b87-4109-a3d0-40bb90d72197 req-1029d979-bacc-43d7-9042-14ad3423f436 service nova] Creating event network-changed:3e694e20-080b-4705-bb26-99797a62bbda for instance 0227f1c2-0c9b-4148-a85e-fd3210fd63f3 on n-h1-854247-14 Oct 17 15:03:34.284865 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-16e2e91d-7b87-4109-a3d0-40bb90d72197 req-1029d979-bacc-43d7-9042-14ad3423f436 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044422 Oct 17 15:03:34.285473 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3635/7403] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 15:03:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:03:35.215995 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-66df8590-a14f-4941-af6f-a191939795af tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:03:35.216576 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-66df8590-a14f-4941-af6f-a191939795af tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] [instance: 0227f1c2-0c9b-4148-a85e-fd3210fd63f3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:03:35.223947 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-66df8590-a14f-4941-af6f-a191939795af tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:03:35.224462 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-66df8590-a14f-4941-af6f-a191939795af tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:03:35.224878 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-66df8590-a14f-4941-af6f-a191939795af tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:03:35.225612 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-66df8590-a14f-4941-af6f-a191939795af tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:03:35.226086 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-66df8590-a14f-4941-af6f-a191939795af tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:03:35.226495 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-66df8590-a14f-4941-af6f-a191939795af tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:03:35.360469 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-66df8590-a14f-4941-af6f-a191939795af tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f70c581f50042849951ca0117913dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bdc53021824277aacd3c9c8562e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:03:35.368453 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-66df8590-a14f-4941-af6f-a191939795af tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] 10.222.0.79 "GET /compute/v2.1/servers/0227f1c2-0c9b-4148-a85e-fd3210fd63f3" status: 200 len: 1373 microversion: 2.1 time: 0.156568 Oct 17 15:03:35.369027 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3769/7404] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:03:35 2022] GET /compute/v2.1/servers/0227f1c2-0c9b-4148-a85e-fd3210fd63f3 => generated 1373 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:03:36.395941 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-4a10b61c-bd5d-48b6-b280-3f9fe3d21d21 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:03:36.396695 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-4a10b61c-bd5d-48b6-b280-3f9fe3d21d21 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] [instance: 0227f1c2-0c9b-4148-a85e-fd3210fd63f3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:03:36.403629 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4a10b61c-bd5d-48b6-b280-3f9fe3d21d21 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:03:36.404129 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4a10b61c-bd5d-48b6-b280-3f9fe3d21d21 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:03:36.404577 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4a10b61c-bd5d-48b6-b280-3f9fe3d21d21 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:03:36.405287 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4a10b61c-bd5d-48b6-b280-3f9fe3d21d21 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:03:36.405758 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4a10b61c-bd5d-48b6-b280-3f9fe3d21d21 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:03:36.406511 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-4a10b61c-bd5d-48b6-b280-3f9fe3d21d21 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:03:36.550240 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-4a10b61c-bd5d-48b6-b280-3f9fe3d21d21 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f70c581f50042849951ca0117913dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bdc53021824277aacd3c9c8562e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:03:36.558285 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-4a10b61c-bd5d-48b6-b280-3f9fe3d21d21 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] 10.222.0.79 "GET /compute/v2.1/servers/0227f1c2-0c9b-4148-a85e-fd3210fd63f3" status: 200 len: 1373 microversion: 2.1 time: 0.167768 Oct 17 15:03:36.558883 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3636/7405] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:03:36 2022] GET /compute/v2.1/servers/0227f1c2-0c9b-4148-a85e-fd3210fd63f3 => generated 1373 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:03:37.582092 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2d10e91f-ca1d-46f3-ae07-46c2bd110cc0 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:03:37.582684 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2d10e91f-ca1d-46f3-ae07-46c2bd110cc0 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] [instance: 0227f1c2-0c9b-4148-a85e-fd3210fd63f3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:03:37.590400 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2d10e91f-ca1d-46f3-ae07-46c2bd110cc0 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:03:37.590891 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2d10e91f-ca1d-46f3-ae07-46c2bd110cc0 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:03:37.591373 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2d10e91f-ca1d-46f3-ae07-46c2bd110cc0 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:03:37.592086 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2d10e91f-ca1d-46f3-ae07-46c2bd110cc0 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:03:37.592540 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2d10e91f-ca1d-46f3-ae07-46c2bd110cc0 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:03:37.592965 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2d10e91f-ca1d-46f3-ae07-46c2bd110cc0 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:03:37.788950 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-2d10e91f-ca1d-46f3-ae07-46c2bd110cc0 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f70c581f50042849951ca0117913dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bdc53021824277aacd3c9c8562e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:03:37.797058 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2d10e91f-ca1d-46f3-ae07-46c2bd110cc0 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] 10.222.0.79 "GET /compute/v2.1/servers/0227f1c2-0c9b-4148-a85e-fd3210fd63f3" status: 200 len: 1373 microversion: 2.1 time: 0.219204 Oct 17 15:03:37.797674 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3770/7406] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:03:37 2022] GET /compute/v2.1/servers/0227f1c2-0c9b-4148-a85e-fd3210fd63f3 => generated 1373 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:03:38.820792 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-5c09675b-d2ca-4874-9980-185d208daa14 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:03:38.821367 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-5c09675b-d2ca-4874-9980-185d208daa14 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] [instance: 0227f1c2-0c9b-4148-a85e-fd3210fd63f3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:03:38.829133 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5c09675b-d2ca-4874-9980-185d208daa14 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:03:38.829629 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5c09675b-d2ca-4874-9980-185d208daa14 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:03:38.830086 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5c09675b-d2ca-4874-9980-185d208daa14 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:03:38.830798 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5c09675b-d2ca-4874-9980-185d208daa14 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:03:38.831301 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5c09675b-d2ca-4874-9980-185d208daa14 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:03:38.831739 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-5c09675b-d2ca-4874-9980-185d208daa14 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:03:38.980159 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-5c09675b-d2ca-4874-9980-185d208daa14 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f70c581f50042849951ca0117913dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bdc53021824277aacd3c9c8562e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:03:38.989133 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-5c09675b-d2ca-4874-9980-185d208daa14 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] 10.222.0.79 "GET /compute/v2.1/servers/0227f1c2-0c9b-4148-a85e-fd3210fd63f3" status: 200 len: 1373 microversion: 2.1 time: 0.173235 Oct 17 15:03:38.989745 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3637/7407] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:03:38 2022] GET /compute/v2.1/servers/0227f1c2-0c9b-4148-a85e-fd3210fd63f3 => generated 1373 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:03:39.272926 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-748d7539-5eab-4ec8-a5c2-135dbc5beb05 req-3e364c92-6fdd-4669-95f5-eb8aa9d1493c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0227f1c2-0c9b-4148-a85e-fd3210fd63f3", "name": "network-vif-plugged", "status": "completed", "tag": "3e694e20-080b-4705-bb26-99797a62bbda"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:03:39.283284 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-748d7539-5eab-4ec8-a5c2-135dbc5beb05 req-3e364c92-6fdd-4669-95f5-eb8aa9d1493c service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:03:39.283768 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-748d7539-5eab-4ec8-a5c2-135dbc5beb05 req-3e364c92-6fdd-4669-95f5-eb8aa9d1493c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:03:39.284190 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-748d7539-5eab-4ec8-a5c2-135dbc5beb05 req-3e364c92-6fdd-4669-95f5-eb8aa9d1493c service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:03:39.299045 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-748d7539-5eab-4ec8-a5c2-135dbc5beb05 req-3e364c92-6fdd-4669-95f5-eb8aa9d1493c service nova] Creating event network-vif-plugged:3e694e20-080b-4705-bb26-99797a62bbda for instance 0227f1c2-0c9b-4148-a85e-fd3210fd63f3 on n-h1-854247-14 Oct 17 15:03:39.304387 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-748d7539-5eab-4ec8-a5c2-135dbc5beb05 req-3e364c92-6fdd-4669-95f5-eb8aa9d1493c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096442 Oct 17 15:03:39.304982 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3771/7408] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 15:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:03:40.013392 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-6a6ba5c7-8037-4de7-abb2-92f583f43281 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:03:40.014199 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-6a6ba5c7-8037-4de7-abb2-92f583f43281 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] [instance: 0227f1c2-0c9b-4148-a85e-fd3210fd63f3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:03:40.024111 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6a6ba5c7-8037-4de7-abb2-92f583f43281 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:03:40.024625 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6a6ba5c7-8037-4de7-abb2-92f583f43281 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:03:40.025077 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6a6ba5c7-8037-4de7-abb2-92f583f43281 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:03:40.025810 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6a6ba5c7-8037-4de7-abb2-92f583f43281 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:03:40.026274 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6a6ba5c7-8037-4de7-abb2-92f583f43281 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:03:40.026707 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-6a6ba5c7-8037-4de7-abb2-92f583f43281 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:03:40.211951 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-6a6ba5c7-8037-4de7-abb2-92f583f43281 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f70c581f50042849951ca0117913dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bdc53021824277aacd3c9c8562e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:03:40.220666 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-6a6ba5c7-8037-4de7-abb2-92f583f43281 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] 10.222.0.79 "GET /compute/v2.1/servers/0227f1c2-0c9b-4148-a85e-fd3210fd63f3" status: 200 len: 1373 microversion: 2.1 time: 0.211269 Oct 17 15:03:40.221420 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3638/7409] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:03:40 2022] GET /compute/v2.1/servers/0227f1c2-0c9b-4148-a85e-fd3210fd63f3 => generated 1373 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:03:41.246970 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b9fede96-15bf-46b1-88f7-d8f49531e4ba tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:03:41.247714 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b9fede96-15bf-46b1-88f7-d8f49531e4ba tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] [instance: 0227f1c2-0c9b-4148-a85e-fd3210fd63f3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:03:41.254977 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b9fede96-15bf-46b1-88f7-d8f49531e4ba tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:03:41.255495 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b9fede96-15bf-46b1-88f7-d8f49531e4ba tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:03:41.255944 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b9fede96-15bf-46b1-88f7-d8f49531e4ba tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:03:41.256800 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b9fede96-15bf-46b1-88f7-d8f49531e4ba tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:03:41.257484 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b9fede96-15bf-46b1-88f7-d8f49531e4ba tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:03:41.258093 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b9fede96-15bf-46b1-88f7-d8f49531e4ba tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:03:41.412263 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b9fede96-15bf-46b1-88f7-d8f49531e4ba tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f70c581f50042849951ca0117913dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bdc53021824277aacd3c9c8562e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:03:41.424191 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b9fede96-15bf-46b1-88f7-d8f49531e4ba tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] 10.222.0.79 "GET /compute/v2.1/servers/0227f1c2-0c9b-4148-a85e-fd3210fd63f3" status: 200 len: 1558 microversion: 2.1 time: 0.182429 Oct 17 15:03:41.424795 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3772/7410] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:03:41 2022] GET /compute/v2.1/servers/0227f1c2-0c9b-4148-a85e-fd3210fd63f3 => generated 1558 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:03:41.447327 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-0fd74982-a9a2-4fcb-b3de-9aaf2f9f34da tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:03:41.448023 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-0fd74982-a9a2-4fcb-b3de-9aaf2f9f34da tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] [instance: 0227f1c2-0c9b-4148-a85e-fd3210fd63f3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:03:41.452198 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:03:41.453165 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=6 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:03:41.459100 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0fd74982-a9a2-4fcb-b3de-9aaf2f9f34da tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:03:41.459631 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0fd74982-a9a2-4fcb-b3de-9aaf2f9f34da tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:03:41.460078 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0fd74982-a9a2-4fcb-b3de-9aaf2f9f34da tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:03:41.460792 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0fd74982-a9a2-4fcb-b3de-9aaf2f9f34da tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:03:41.461249 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0fd74982-a9a2-4fcb-b3de-9aaf2f9f34da tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:03:41.461678 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-0fd74982-a9a2-4fcb-b3de-9aaf2f9f34da tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:03:41.611309 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-0fd74982-a9a2-4fcb-b3de-9aaf2f9f34da tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f70c581f50042849951ca0117913dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bdc53021824277aacd3c9c8562e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:03:41.620809 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-0fd74982-a9a2-4fcb-b3de-9aaf2f9f34da tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] 10.222.0.79 "GET /compute/v2.1/servers/0227f1c2-0c9b-4148-a85e-fd3210fd63f3" status: 200 len: 1558 microversion: 2.1 time: 0.177347 Oct 17 15:03:41.621529 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3639/7411] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:03:41 2022] GET /compute/v2.1/servers/0227f1c2-0c9b-4148-a85e-fd3210fd63f3 => generated 1558 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:03:43.374619 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=6 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:03:43.434837 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-96dac18d-e426-4a6f-9502-edaac752a3e8 req-f228ec94-d65a-4f0a-a50f-a6862ed168e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0227f1c2-0c9b-4148-a85e-fd3210fd63f3", "tag": "3e694e20-080b-4705-bb26-99797a62bbda"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:03:43.445268 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-96dac18d-e426-4a6f-9502-edaac752a3e8 req-f228ec94-d65a-4f0a-a50f-a6862ed168e8 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:03:43.445824 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-96dac18d-e426-4a6f-9502-edaac752a3e8 req-f228ec94-d65a-4f0a-a50f-a6862ed168e8 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:03:43.446382 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-96dac18d-e426-4a6f-9502-edaac752a3e8 req-f228ec94-d65a-4f0a-a50f-a6862ed168e8 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:03:43.458983 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-96dac18d-e426-4a6f-9502-edaac752a3e8 req-f228ec94-d65a-4f0a-a50f-a6862ed168e8 service nova] Creating event network-changed:3e694e20-080b-4705-bb26-99797a62bbda for instance 0227f1c2-0c9b-4148-a85e-fd3210fd63f3 on n-h1-854247-14 Oct 17 15:03:43.464745 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-96dac18d-e426-4a6f-9502-edaac752a3e8 req-f228ec94-d65a-4f0a-a50f-a6862ed168e8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094711 Oct 17 15:03:43.465827 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3773/7412] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 15:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:05:38.574345 n-d-854247-14 devstack@n-api.service[127017]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b945151f-fea7-4f65-a337-b7fe0a9fe59d] AMQP server on 10.222.0.79:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 17 15:05:38.575395 n-d-854247-14 devstack@n-api.service[127017]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8c4c735e-fe50-490e-b8cd-ee30a9564a26] AMQP server on 10.222.0.79:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 17 15:05:38.575860 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:05:38.576736 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=34 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:05:38.582268 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-b852d407-83fd-4299-b9c9-7a75eedb5cea tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1788454131"}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:05:38.584742 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-b852d407-83fd-4299-b9c9-7a75eedb5cea tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] [instance: 0227f1c2-0c9b-4148-a85e-fd3210fd63f3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:05:38.592926 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b852d407-83fd-4299-b9c9-7a75eedb5cea tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:05:38.593426 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b852d407-83fd-4299-b9c9-7a75eedb5cea tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:05:38.593870 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b852d407-83fd-4299-b9c9-7a75eedb5cea tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:05:38.594581 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b852d407-83fd-4299-b9c9-7a75eedb5cea tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:05:38.595038 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b852d407-83fd-4299-b9c9-7a75eedb5cea tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:05:38.595530 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-b852d407-83fd-4299-b9c9-7a75eedb5cea tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:05:38.940864 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-b852d407-83fd-4299-b9c9-7a75eedb5cea tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] 10.222.0.79 "POST /compute/v2.1/servers/0227f1c2-0c9b-4148-a85e-fd3210fd63f3/action" status: 202 len: 0 microversion: 2.1 time: 0.368338 Oct 17 15:05:38.941525 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3640/7413] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 15:05:38 2022] POST /compute/v2.1/servers/0227f1c2-0c9b-4148-a85e-fd3210fd63f3/action => generated 0 bytes in 370 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 17 15:05:45.891661 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-77db0511-93d0-470e-9b26-f8b75e060215 req-bb611359-da30-48f7-b813-800fdab85c49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0227f1c2-0c9b-4148-a85e-fd3210fd63f3", "name": "network-vif-plugged", "status": "completed", "tag": "3e694e20-080b-4705-bb26-99797a62bbda"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:05:45.898267 n-d-854247-14 devstack@n-api.service[127016]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0ad54cb6-91dd-4ced-9c42-02c0b19684b8] AMQP server on 10.222.0.79:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 17 15:05:45.899379 n-d-854247-14 devstack@n-api.service[127016]: ERROR oslo.messaging._drivers.impl_rabbit [-] [72f013d3-d96b-49c5-a187-2d216be84735] AMQP server on 10.222.0.79:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 17 15:05:45.899951 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:05:45.900965 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=28 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:05:45.902707 n-d-854247-14 devstack@n-api.service[127016]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 15:05:45.903297 n-d-854247-14 devstack@n-api.service[127016]: Mon Oct 17 15:05:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.79) !!! Oct 17 15:05:45.912105 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-77db0511-93d0-470e-9b26-f8b75e060215 req-bb611359-da30-48f7-b813-800fdab85c49 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:05:45.912105 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-77db0511-93d0-470e-9b26-f8b75e060215 req-bb611359-da30-48f7-b813-800fdab85c49 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:05:45.912523 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-77db0511-93d0-470e-9b26-f8b75e060215 req-bb611359-da30-48f7-b813-800fdab85c49 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:05:45.928730 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-77db0511-93d0-470e-9b26-f8b75e060215 req-bb611359-da30-48f7-b813-800fdab85c49 service nova] Creating event network-vif-plugged:3e694e20-080b-4705-bb26-99797a62bbda for instance 0227f1c2-0c9b-4148-a85e-fd3210fd63f3 on n-h1-854247-14 Oct 17 15:05:45.934446 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-77db0511-93d0-470e-9b26-f8b75e060215 req-bb611359-da30-48f7-b813-800fdab85c49 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048297 Oct 17 15:05:45.935303 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3774/7414] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 15:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:05:52.566466 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-90c9fbde-c46d-43f6-9ff4-db2df5f54ed7 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-323248397", "imageRef": "c0be582e-ea31-4ac9-9b91-7691a8f735e2", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-259308173", "security_groups": [{"name": "tempest-secgroup-smoke-1594775987"}], "networks": [{"uuid": "5b41b238-d339-47c3-91e5-ce1625e1b2ce"}]}} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:05:52.576932 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:05:52.577635 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:05:52.597659 n-d-854247-14 devstack@n-api.service[127017]: INFO oslo.messaging._drivers.impl_rabbit [-] [8c4c735e-fe50-490e-b8cd-ee30a9564a26] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 36280. Oct 17 15:05:52.598536 n-d-854247-14 devstack@n-api.service[127017]: INFO oslo.messaging._drivers.impl_rabbit [-] [b945151f-fea7-4f65-a337-b7fe0a9fe59d] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 36278. Oct 17 15:05:52.693312 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.network.neutron [None req-90c9fbde-c46d-43f6-9ff4-db2df5f54ed7 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] validate_networks() for [('5b41b238-d339-47c3-91e5-ce1625e1b2ce', None, None, None, None, None)] {{(pid=127017) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:05:53.087999 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-90c9fbde-c46d-43f6-9ff4-db2df5f54ed7 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Flavor limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:05:53.088571 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-90c9fbde-c46d-43f6-9ff4-db2df5f54ed7 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Image limits 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:05:53.089163 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-90c9fbde-c46d-43f6-9ff4-db2df5f54ed7 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Flavor pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:05:53.089663 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-90c9fbde-c46d-43f6-9ff4-db2df5f54ed7 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Image pref 0:0:0 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:05:53.090224 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.virt.hardware [None req-90c9fbde-c46d-43f6-9ff4-db2df5f54ed7 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127017) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:05:53.101145 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-90c9fbde-c46d-43f6-9ff4-db2df5f54ed7 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:05:53.101788 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-90c9fbde-c46d-43f6-9ff4-db2df5f54ed7 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:05:53.102995 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-90c9fbde-c46d-43f6-9ff4-db2df5f54ed7 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:05:53.103903 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-90c9fbde-c46d-43f6-9ff4-db2df5f54ed7 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:05:53.104491 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-90c9fbde-c46d-43f6-9ff4-db2df5f54ed7 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:05:53.105056 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-90c9fbde-c46d-43f6-9ff4-db2df5f54ed7 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:05:53.127949 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-90c9fbde-c46d-43f6-9ff4-db2df5f54ed7 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Getting quotas for project 49bdc53021824277aacd3c9c8562e718. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:05:53.133894 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.quota [None req-90c9fbde-c46d-43f6-9ff4-db2df5f54ed7 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Getting quotas for user 7f70c581f50042849951ca0117913dfd and project 49bdc53021824277aacd3c9c8562e718. Resources: {'ram', 'cores', 'instances'} {{(pid=127017) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:05:53.149089 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-90c9fbde-c46d-43f6-9ff4-db2df5f54ed7 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Going to run 1 instances... {{(pid=127017) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:05:53.151701 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-90c9fbde-c46d-43f6-9ff4-db2df5f54ed7 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] [instance: 17eee451-ab6f-44cf-b0a7-4cb9f2bfa398] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c0be582e-ea31-4ac9-9b91-7691a8f735e2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127017) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:05:53.216116 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-90c9fbde-c46d-43f6-9ff4-db2df5f54ed7 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.653976 Oct 17 15:05:53.217007 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3641/7415] 10.222.0.79 () {60 vars in 1147 bytes} [Mon Oct 17 15:05:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:05:53.231350 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-e7b8f24a-8c01-4cea-8c52-62a0e9c92ac1 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:05:53.232842 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-e7b8f24a-8c01-4cea-8c52-62a0e9c92ac1 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] [instance: 17eee451-ab6f-44cf-b0a7-4cb9f2bfa398] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:05:53.249096 n-d-854247-14 devstack@n-api.service[127016]: INFO oslo.messaging._drivers.impl_rabbit [-] [0ad54cb6-91dd-4ced-9c42-02c0b19684b8] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 36296. Oct 17 15:05:53.249886 n-d-854247-14 devstack@n-api.service[127016]: INFO oslo.messaging._drivers.impl_rabbit [-] [72f013d3-d96b-49c5-a187-2d216be84735] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 36298. Oct 17 15:05:53.304314 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-e7b8f24a-8c01-4cea-8c52-62a0e9c92ac1 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f70c581f50042849951ca0117913dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bdc53021824277aacd3c9c8562e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:05:53.312967 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-e7b8f24a-8c01-4cea-8c52-62a0e9c92ac1 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] 10.222.0.79 "GET /compute/v2.1/servers/17eee451-ab6f-44cf-b0a7-4cb9f2bfa398" status: 200 len: 1247 microversion: 2.1 time: 0.088388 Oct 17 15:05:53.313459 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3775/7416] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:05:53 2022] GET /compute/v2.1/servers/17eee451-ab6f-44cf-b0a7-4cb9f2bfa398 => generated 1247 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:05:54.341968 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-09bab74a-50fd-4ba4-968f-f44a16c78576 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:05:54.343007 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-09bab74a-50fd-4ba4-968f-f44a16c78576 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] [instance: 17eee451-ab6f-44cf-b0a7-4cb9f2bfa398] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:05:54.352055 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-09bab74a-50fd-4ba4-968f-f44a16c78576 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:05:54.352801 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-09bab74a-50fd-4ba4-968f-f44a16c78576 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:05:54.353440 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-09bab74a-50fd-4ba4-968f-f44a16c78576 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:05:54.354359 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-09bab74a-50fd-4ba4-968f-f44a16c78576 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:05:54.355058 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-09bab74a-50fd-4ba4-968f-f44a16c78576 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:05:54.355700 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-09bab74a-50fd-4ba4-968f-f44a16c78576 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:05:54.435945 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-09bab74a-50fd-4ba4-968f-f44a16c78576 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f70c581f50042849951ca0117913dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bdc53021824277aacd3c9c8562e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:05:54.444914 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-09bab74a-50fd-4ba4-968f-f44a16c78576 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] 10.222.0.79 "GET /compute/v2.1/servers/17eee451-ab6f-44cf-b0a7-4cb9f2bfa398" status: 200 len: 1307 microversion: 2.1 time: 0.111667 Oct 17 15:05:54.458545 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3642/7417] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:05:54 2022] GET /compute/v2.1/servers/17eee451-ab6f-44cf-b0a7-4cb9f2bfa398 => generated 1307 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:05:55.470404 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-b038491c-4e0e-429a-925f-908cabc33f4d tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:05:55.471788 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-b038491c-4e0e-429a-925f-908cabc33f4d tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] [instance: 17eee451-ab6f-44cf-b0a7-4cb9f2bfa398] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:05:55.479679 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b038491c-4e0e-429a-925f-908cabc33f4d tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:05:55.480420 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b038491c-4e0e-429a-925f-908cabc33f4d tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:05:55.480987 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b038491c-4e0e-429a-925f-908cabc33f4d tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:05:55.482038 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b038491c-4e0e-429a-925f-908cabc33f4d tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:05:55.482549 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b038491c-4e0e-429a-925f-908cabc33f4d tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:05:55.482918 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-b038491c-4e0e-429a-925f-908cabc33f4d tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:05:55.642006 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-b038491c-4e0e-429a-925f-908cabc33f4d tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f70c581f50042849951ca0117913dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bdc53021824277aacd3c9c8562e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:05:55.650273 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-b038491c-4e0e-429a-925f-908cabc33f4d tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] 10.222.0.79 "GET /compute/v2.1/servers/17eee451-ab6f-44cf-b0a7-4cb9f2bfa398" status: 200 len: 1373 microversion: 2.1 time: 0.184618 Oct 17 15:05:55.651283 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3776/7418] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:05:55 2022] GET /compute/v2.1/servers/17eee451-ab6f-44cf-b0a7-4cb9f2bfa398 => generated 1373 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:05:55.848139 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-59bf5a8c-19e2-447a-9810-8b6077e4e37a req-38aaa193-6d47-4e5e-b564-82a963102cbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0227f1c2-0c9b-4148-a85e-fd3210fd63f3", "name": "network-vif-unplugged", "status": "completed", "tag": "3e694e20-080b-4705-bb26-99797a62bbda"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:05:55.865343 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-59bf5a8c-19e2-447a-9810-8b6077e4e37a req-38aaa193-6d47-4e5e-b564-82a963102cbf service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:05:55.867311 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-59bf5a8c-19e2-447a-9810-8b6077e4e37a req-38aaa193-6d47-4e5e-b564-82a963102cbf service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:05:55.868089 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-59bf5a8c-19e2-447a-9810-8b6077e4e37a req-38aaa193-6d47-4e5e-b564-82a963102cbf service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:05:55.883799 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-59bf5a8c-19e2-447a-9810-8b6077e4e37a req-38aaa193-6d47-4e5e-b564-82a963102cbf service nova] Creating event network-vif-unplugged:3e694e20-080b-4705-bb26-99797a62bbda for instance 0227f1c2-0c9b-4148-a85e-fd3210fd63f3 on n-h1-854247-14 Oct 17 15:05:55.892980 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-59bf5a8c-19e2-447a-9810-8b6077e4e37a req-38aaa193-6d47-4e5e-b564-82a963102cbf service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050185 Oct 17 15:05:55.893922 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3643/7419] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 15:05:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:05:56.675381 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-4eee6a9c-6447-46e9-92cc-590e69874f61 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:05:56.676827 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-4eee6a9c-6447-46e9-92cc-590e69874f61 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] [instance: 17eee451-ab6f-44cf-b0a7-4cb9f2bfa398] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:05:56.686198 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4eee6a9c-6447-46e9-92cc-590e69874f61 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:05:56.687063 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4eee6a9c-6447-46e9-92cc-590e69874f61 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:05:56.687769 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4eee6a9c-6447-46e9-92cc-590e69874f61 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:05:56.688794 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4eee6a9c-6447-46e9-92cc-590e69874f61 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:05:56.689476 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4eee6a9c-6447-46e9-92cc-590e69874f61 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:05:56.689944 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-4eee6a9c-6447-46e9-92cc-590e69874f61 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:05:56.836164 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-4eee6a9c-6447-46e9-92cc-590e69874f61 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f70c581f50042849951ca0117913dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bdc53021824277aacd3c9c8562e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:05:56.845055 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-4eee6a9c-6447-46e9-92cc-590e69874f61 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] 10.222.0.79 "GET /compute/v2.1/servers/17eee451-ab6f-44cf-b0a7-4cb9f2bfa398" status: 200 len: 1373 microversion: 2.1 time: 0.174601 Oct 17 15:05:56.859667 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3777/7420] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:05:56 2022] GET /compute/v2.1/servers/17eee451-ab6f-44cf-b0a7-4cb9f2bfa398 => generated 1373 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:05:57.872449 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-3cba81cc-8347-478d-ab24-7449d8edecb0 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:05:57.873462 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-3cba81cc-8347-478d-ab24-7449d8edecb0 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] [instance: 17eee451-ab6f-44cf-b0a7-4cb9f2bfa398] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:05:57.880208 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3cba81cc-8347-478d-ab24-7449d8edecb0 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:05:57.880963 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3cba81cc-8347-478d-ab24-7449d8edecb0 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:05:57.881605 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3cba81cc-8347-478d-ab24-7449d8edecb0 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:05:57.882517 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3cba81cc-8347-478d-ab24-7449d8edecb0 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:05:57.883308 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3cba81cc-8347-478d-ab24-7449d8edecb0 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:05:57.883935 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-3cba81cc-8347-478d-ab24-7449d8edecb0 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:05:58.034411 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-3cba81cc-8347-478d-ab24-7449d8edecb0 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f70c581f50042849951ca0117913dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bdc53021824277aacd3c9c8562e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:05:58.042463 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-3cba81cc-8347-478d-ab24-7449d8edecb0 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] 10.222.0.79 "GET /compute/v2.1/servers/17eee451-ab6f-44cf-b0a7-4cb9f2bfa398" status: 200 len: 1373 microversion: 2.1 time: 0.175618 Oct 17 15:05:58.043039 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3644/7421] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:05:57 2022] GET /compute/v2.1/servers/17eee451-ab6f-44cf-b0a7-4cb9f2bfa398 => generated 1373 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:05:59.069681 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-aa9448be-eaed-464e-8e9f-0eaaa84ad4a4 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:05:59.071412 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-aa9448be-eaed-464e-8e9f-0eaaa84ad4a4 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] [instance: 17eee451-ab6f-44cf-b0a7-4cb9f2bfa398] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:05:59.081309 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aa9448be-eaed-464e-8e9f-0eaaa84ad4a4 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:05:59.081883 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aa9448be-eaed-464e-8e9f-0eaaa84ad4a4 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:05:59.082385 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aa9448be-eaed-464e-8e9f-0eaaa84ad4a4 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:05:59.083181 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aa9448be-eaed-464e-8e9f-0eaaa84ad4a4 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:05:59.083670 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aa9448be-eaed-464e-8e9f-0eaaa84ad4a4 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:05:59.084090 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-aa9448be-eaed-464e-8e9f-0eaaa84ad4a4 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:05:59.235626 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-aa9448be-eaed-464e-8e9f-0eaaa84ad4a4 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f70c581f50042849951ca0117913dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bdc53021824277aacd3c9c8562e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:05:59.243810 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-aa9448be-eaed-464e-8e9f-0eaaa84ad4a4 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] 10.222.0.79 "GET /compute/v2.1/servers/17eee451-ab6f-44cf-b0a7-4cb9f2bfa398" status: 200 len: 1373 microversion: 2.1 time: 0.180256 Oct 17 15:05:59.244414 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3778/7422] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:05:59 2022] GET /compute/v2.1/servers/17eee451-ab6f-44cf-b0a7-4cb9f2bfa398 => generated 1373 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:06:00.267515 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-dd179c39-0580-4266-9979-0d6ecdc916c3 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:06:00.268197 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-dd179c39-0580-4266-9979-0d6ecdc916c3 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] [instance: 17eee451-ab6f-44cf-b0a7-4cb9f2bfa398] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:06:00.275722 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dd179c39-0580-4266-9979-0d6ecdc916c3 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:06:00.276493 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dd179c39-0580-4266-9979-0d6ecdc916c3 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:06:00.276955 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dd179c39-0580-4266-9979-0d6ecdc916c3 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:06:00.277726 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dd179c39-0580-4266-9979-0d6ecdc916c3 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:06:00.278202 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dd179c39-0580-4266-9979-0d6ecdc916c3 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:06:00.278668 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-dd179c39-0580-4266-9979-0d6ecdc916c3 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:06:00.455311 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-dd179c39-0580-4266-9979-0d6ecdc916c3 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f70c581f50042849951ca0117913dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bdc53021824277aacd3c9c8562e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:06:00.467130 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-dd179c39-0580-4266-9979-0d6ecdc916c3 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] 10.222.0.79 "GET /compute/v2.1/servers/17eee451-ab6f-44cf-b0a7-4cb9f2bfa398" status: 200 len: 1373 microversion: 2.1 time: 0.202522 Oct 17 15:06:00.467130 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3645/7423] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:06:00 2022] GET /compute/v2.1/servers/17eee451-ab6f-44cf-b0a7-4cb9f2bfa398 => generated 1373 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:06:01.492130 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a7f73d8d-c371-4070-9a63-cfd02f4348c6 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:06:01.492818 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a7f73d8d-c371-4070-9a63-cfd02f4348c6 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] [instance: 17eee451-ab6f-44cf-b0a7-4cb9f2bfa398] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:06:01.502563 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a7f73d8d-c371-4070-9a63-cfd02f4348c6 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:06:01.503251 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a7f73d8d-c371-4070-9a63-cfd02f4348c6 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:06:01.503656 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a7f73d8d-c371-4070-9a63-cfd02f4348c6 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:06:01.504798 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a7f73d8d-c371-4070-9a63-cfd02f4348c6 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:06:01.505479 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a7f73d8d-c371-4070-9a63-cfd02f4348c6 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:06:01.506044 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a7f73d8d-c371-4070-9a63-cfd02f4348c6 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:06:01.650443 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-a7f73d8d-c371-4070-9a63-cfd02f4348c6 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f70c581f50042849951ca0117913dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bdc53021824277aacd3c9c8562e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:06:01.659726 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a7f73d8d-c371-4070-9a63-cfd02f4348c6 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] 10.222.0.79 "GET /compute/v2.1/servers/17eee451-ab6f-44cf-b0a7-4cb9f2bfa398" status: 200 len: 1373 microversion: 2.1 time: 0.172648 Oct 17 15:06:01.660520 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3779/7424] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:06:01 2022] GET /compute/v2.1/servers/17eee451-ab6f-44cf-b0a7-4cb9f2bfa398 => generated 1373 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:06:02.694894 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-41f07b23-eb03-4470-9409-eb7ade867c25 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:06:02.695628 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-41f07b23-eb03-4470-9409-eb7ade867c25 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] [instance: 17eee451-ab6f-44cf-b0a7-4cb9f2bfa398] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:06:02.703135 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-41f07b23-eb03-4470-9409-eb7ade867c25 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:06:02.703667 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-41f07b23-eb03-4470-9409-eb7ade867c25 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:06:02.704119 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-41f07b23-eb03-4470-9409-eb7ade867c25 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:06:02.705061 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-41f07b23-eb03-4470-9409-eb7ade867c25 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:06:02.705510 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-41f07b23-eb03-4470-9409-eb7ade867c25 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:06:02.705957 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-41f07b23-eb03-4470-9409-eb7ade867c25 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:06:02.868766 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-41f07b23-eb03-4470-9409-eb7ade867c25 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f70c581f50042849951ca0117913dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bdc53021824277aacd3c9c8562e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:06:02.877785 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-41f07b23-eb03-4470-9409-eb7ade867c25 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] 10.222.0.79 "GET /compute/v2.1/servers/17eee451-ab6f-44cf-b0a7-4cb9f2bfa398" status: 200 len: 1373 microversion: 2.1 time: 0.187075 Oct 17 15:06:02.878377 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3646/7425] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:06:02 2022] GET /compute/v2.1/servers/17eee451-ab6f-44cf-b0a7-4cb9f2bfa398 => generated 1373 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:06:03.618569 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [req-eb742f7f-0b9d-4965-9d77-b79bc5ac15e1 req-6103efe4-39a0-4082-8834-8f0677eee21a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17eee451-ab6f-44cf-b0a7-4cb9f2bfa398", "tag": "b529eb66-09d5-42a0-a7b7-fbe68b03b868"}]} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:06:03.625696 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell0:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:06:03.632467 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-eb742f7f-0b9d-4965-9d77-b79bc5ac15e1 req-6103efe4-39a0-4082-8834-8f0677eee21a service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:06:03.632945 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-eb742f7f-0b9d-4965-9d77-b79bc5ac15e1 req-6103efe4-39a0-4082-8834-8f0677eee21a service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:06:03.633368 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [req-eb742f7f-0b9d-4965-9d77-b79bc5ac15e1 req-6103efe4-39a0-4082-8834-8f0677eee21a service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:06:03.645685 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.compute.server_external_events [req-eb742f7f-0b9d-4965-9d77-b79bc5ac15e1 req-6103efe4-39a0-4082-8834-8f0677eee21a service nova] Creating event network-changed:b529eb66-09d5-42a0-a7b7-fbe68b03b868 for instance 17eee451-ab6f-44cf-b0a7-4cb9f2bfa398 on n-h2-854247-14 Oct 17 15:06:03.650877 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [req-eb742f7f-0b9d-4965-9d77-b79bc5ac15e1 req-6103efe4-39a0-4082-8834-8f0677eee21a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037153 Oct 17 15:06:03.651605 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3780/7426] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 15:06:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:06:03.904749 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-057d8a29-1349-4528-8670-75c6653825e7 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:06:03.905385 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-057d8a29-1349-4528-8670-75c6653825e7 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] [instance: 17eee451-ab6f-44cf-b0a7-4cb9f2bfa398] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:06:03.907487 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=2 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:06:03.908197 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell0:SELECT=6 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:06:03.915380 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-057d8a29-1349-4528-8670-75c6653825e7 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:06:03.915883 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-057d8a29-1349-4528-8670-75c6653825e7 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:06:03.916779 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-057d8a29-1349-4528-8670-75c6653825e7 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:06:03.917494 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-057d8a29-1349-4528-8670-75c6653825e7 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:06:03.917964 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-057d8a29-1349-4528-8670-75c6653825e7 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:06:03.918493 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-057d8a29-1349-4528-8670-75c6653825e7 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:06:04.150055 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-057d8a29-1349-4528-8670-75c6653825e7 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f70c581f50042849951ca0117913dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bdc53021824277aacd3c9c8562e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:06:04.158718 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-057d8a29-1349-4528-8670-75c6653825e7 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] 10.222.0.79 "GET /compute/v2.1/servers/17eee451-ab6f-44cf-b0a7-4cb9f2bfa398" status: 200 len: 1373 microversion: 2.1 time: 0.257908 Oct 17 15:06:04.159402 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3647/7427] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:06:03 2022] GET /compute/v2.1/servers/17eee451-ab6f-44cf-b0a7-4cb9f2bfa398 => generated 1373 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:06:05.188436 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cada76cd-61b3-4594-aca9-ca2d43452101 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:06:05.189097 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cada76cd-61b3-4594-aca9-ca2d43452101 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] [instance: 17eee451-ab6f-44cf-b0a7-4cb9f2bfa398] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:06:05.196144 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cada76cd-61b3-4594-aca9-ca2d43452101 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:06:05.196634 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cada76cd-61b3-4594-aca9-ca2d43452101 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:06:05.197065 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cada76cd-61b3-4594-aca9-ca2d43452101 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:06:05.197770 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cada76cd-61b3-4594-aca9-ca2d43452101 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:06:05.198216 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cada76cd-61b3-4594-aca9-ca2d43452101 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:06:05.198622 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cada76cd-61b3-4594-aca9-ca2d43452101 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:06:05.674879 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cada76cd-61b3-4594-aca9-ca2d43452101 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f70c581f50042849951ca0117913dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bdc53021824277aacd3c9c8562e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:06:05.681711 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cada76cd-61b3-4594-aca9-ca2d43452101 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] 10.222.0.79 "GET /compute/v2.1/servers/17eee451-ab6f-44cf-b0a7-4cb9f2bfa398" status: 200 len: 1373 microversion: 2.1 time: 0.499687 Oct 17 15:06:05.682319 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3781/7428] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:06:05 2022] GET /compute/v2.1/servers/17eee451-ab6f-44cf-b0a7-4cb9f2bfa398 => generated 1373 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:06:06.706051 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-a941dcd6-d27e-4a54-8df2-e2801f649b56 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:06:06.706909 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-a941dcd6-d27e-4a54-8df2-e2801f649b56 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] [instance: 17eee451-ab6f-44cf-b0a7-4cb9f2bfa398] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:06:06.715999 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a941dcd6-d27e-4a54-8df2-e2801f649b56 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:06:06.716500 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a941dcd6-d27e-4a54-8df2-e2801f649b56 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:06:06.716946 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a941dcd6-d27e-4a54-8df2-e2801f649b56 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:06:06.717669 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a941dcd6-d27e-4a54-8df2-e2801f649b56 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:06:06.718133 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a941dcd6-d27e-4a54-8df2-e2801f649b56 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:06:06.718566 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-a941dcd6-d27e-4a54-8df2-e2801f649b56 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:06:06.872120 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-a941dcd6-d27e-4a54-8df2-e2801f649b56 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f70c581f50042849951ca0117913dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bdc53021824277aacd3c9c8562e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:06:06.880833 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-a941dcd6-d27e-4a54-8df2-e2801f649b56 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] 10.222.0.79 "GET /compute/v2.1/servers/17eee451-ab6f-44cf-b0a7-4cb9f2bfa398" status: 200 len: 1373 microversion: 2.1 time: 0.179194 Oct 17 15:06:06.881422 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3648/7429] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:06:06 2022] GET /compute/v2.1/servers/17eee451-ab6f-44cf-b0a7-4cb9f2bfa398 => generated 1373 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:06:07.905466 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-eb359e16-b403-4e9c-a21d-85c7b2231050 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:06:07.906061 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-eb359e16-b403-4e9c-a21d-85c7b2231050 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] [instance: 17eee451-ab6f-44cf-b0a7-4cb9f2bfa398] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:06:07.913468 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eb359e16-b403-4e9c-a21d-85c7b2231050 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:06:07.913950 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eb359e16-b403-4e9c-a21d-85c7b2231050 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:06:07.914375 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eb359e16-b403-4e9c-a21d-85c7b2231050 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:06:07.915073 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eb359e16-b403-4e9c-a21d-85c7b2231050 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:06:07.915547 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eb359e16-b403-4e9c-a21d-85c7b2231050 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:06:07.915962 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-eb359e16-b403-4e9c-a21d-85c7b2231050 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:06:08.057763 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-eb359e16-b403-4e9c-a21d-85c7b2231050 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f70c581f50042849951ca0117913dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bdc53021824277aacd3c9c8562e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:06:08.066760 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-eb359e16-b403-4e9c-a21d-85c7b2231050 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] 10.222.0.79 "GET /compute/v2.1/servers/17eee451-ab6f-44cf-b0a7-4cb9f2bfa398" status: 200 len: 1373 microversion: 2.1 time: 0.165893 Oct 17 15:06:08.067361 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3782/7430] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:06:07 2022] GET /compute/v2.1/servers/17eee451-ab6f-44cf-b0a7-4cb9f2bfa398 => generated 1373 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:06:08.700465 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-e81676ca-321f-4aa5-9dd3-99abcac3b65b req-cd3f1b45-4705-4573-a06b-934dcb582fce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17eee451-ab6f-44cf-b0a7-4cb9f2bfa398", "name": "network-vif-plugged", "status": "completed", "tag": "b529eb66-09d5-42a0-a7b7-fbe68b03b868"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:06:08.712766 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-e81676ca-321f-4aa5-9dd3-99abcac3b65b req-cd3f1b45-4705-4573-a06b-934dcb582fce service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:06:08.713461 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-e81676ca-321f-4aa5-9dd3-99abcac3b65b req-cd3f1b45-4705-4573-a06b-934dcb582fce service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:06:08.713895 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-e81676ca-321f-4aa5-9dd3-99abcac3b65b req-cd3f1b45-4705-4573-a06b-934dcb582fce service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:06:08.727751 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-e81676ca-321f-4aa5-9dd3-99abcac3b65b req-cd3f1b45-4705-4573-a06b-934dcb582fce service nova] Creating event network-vif-plugged:b529eb66-09d5-42a0-a7b7-fbe68b03b868 for instance 17eee451-ab6f-44cf-b0a7-4cb9f2bfa398 on n-h2-854247-14 Oct 17 15:06:08.733239 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-e81676ca-321f-4aa5-9dd3-99abcac3b65b req-cd3f1b45-4705-4573-a06b-934dcb582fce service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036645 Oct 17 15:06:08.733861 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3649/7431] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 15:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:06:09.090520 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-cb0a8d85-61c6-4801-873b-d7d99b1e90cd tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:06:09.091700 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-cb0a8d85-61c6-4801-873b-d7d99b1e90cd tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] [instance: 17eee451-ab6f-44cf-b0a7-4cb9f2bfa398] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:06:09.101163 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb0a8d85-61c6-4801-873b-d7d99b1e90cd tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:06:09.101855 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb0a8d85-61c6-4801-873b-d7d99b1e90cd tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:06:09.102421 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb0a8d85-61c6-4801-873b-d7d99b1e90cd tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:06:09.103479 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb0a8d85-61c6-4801-873b-d7d99b1e90cd tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:06:09.104057 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb0a8d85-61c6-4801-873b-d7d99b1e90cd tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:06:09.104655 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-cb0a8d85-61c6-4801-873b-d7d99b1e90cd tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:06:09.258474 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-cb0a8d85-61c6-4801-873b-d7d99b1e90cd tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f70c581f50042849951ca0117913dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bdc53021824277aacd3c9c8562e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:06:09.266959 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-cb0a8d85-61c6-4801-873b-d7d99b1e90cd tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] 10.222.0.79 "GET /compute/v2.1/servers/17eee451-ab6f-44cf-b0a7-4cb9f2bfa398" status: 200 len: 1373 microversion: 2.1 time: 0.181018 Oct 17 15:06:09.267720 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3783/7432] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:06:09 2022] GET /compute/v2.1/servers/17eee451-ab6f-44cf-b0a7-4cb9f2bfa398 => generated 1373 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:06:10.292252 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-70e51658-63a9-467d-8ef5-9dc22f4a164e tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:06:10.292951 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-70e51658-63a9-467d-8ef5-9dc22f4a164e tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] [instance: 17eee451-ab6f-44cf-b0a7-4cb9f2bfa398] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:06:10.300111 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70e51658-63a9-467d-8ef5-9dc22f4a164e tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:06:10.300598 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70e51658-63a9-467d-8ef5-9dc22f4a164e tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:06:10.301064 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70e51658-63a9-467d-8ef5-9dc22f4a164e tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:06:10.301802 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70e51658-63a9-467d-8ef5-9dc22f4a164e tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:06:10.302269 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70e51658-63a9-467d-8ef5-9dc22f4a164e tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:06:10.302708 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-70e51658-63a9-467d-8ef5-9dc22f4a164e tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:06:10.442459 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-70e51658-63a9-467d-8ef5-9dc22f4a164e tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f70c581f50042849951ca0117913dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bdc53021824277aacd3c9c8562e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:06:10.450812 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-70e51658-63a9-467d-8ef5-9dc22f4a164e tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] 10.222.0.79 "GET /compute/v2.1/servers/17eee451-ab6f-44cf-b0a7-4cb9f2bfa398" status: 200 len: 1557 microversion: 2.1 time: 0.163820 Oct 17 15:06:10.451452 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3650/7433] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:06:10 2022] GET /compute/v2.1/servers/17eee451-ab6f-44cf-b0a7-4cb9f2bfa398 => generated 1557 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:06:10.473731 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-7fec59e1-4051-4c1a-8133-f07527e43b52 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:06:10.474325 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-7fec59e1-4051-4c1a-8133-f07527e43b52 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] [instance: 17eee451-ab6f-44cf-b0a7-4cb9f2bfa398] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:06:10.482164 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7fec59e1-4051-4c1a-8133-f07527e43b52 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:06:10.482652 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7fec59e1-4051-4c1a-8133-f07527e43b52 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:06:10.483088 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7fec59e1-4051-4c1a-8133-f07527e43b52 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:06:10.483810 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7fec59e1-4051-4c1a-8133-f07527e43b52 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:06:10.484268 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7fec59e1-4051-4c1a-8133-f07527e43b52 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:06:10.484699 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-7fec59e1-4051-4c1a-8133-f07527e43b52 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:06:10.626351 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-7fec59e1-4051-4c1a-8133-f07527e43b52 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f70c581f50042849951ca0117913dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bdc53021824277aacd3c9c8562e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:06:10.634590 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-7fec59e1-4051-4c1a-8133-f07527e43b52 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] 10.222.0.79 "GET /compute/v2.1/servers/17eee451-ab6f-44cf-b0a7-4cb9f2bfa398" status: 200 len: 1557 microversion: 2.1 time: 0.164844 Oct 17 15:06:10.635184 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3784/7434] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:06:10 2022] GET /compute/v2.1/servers/17eee451-ab6f-44cf-b0a7-4cb9f2bfa398 => generated 1557 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:06:12.438523 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-76825cc5-248f-402e-8442-35e4508ac646 req-da004fbd-4dbc-4711-a814-e41c1636d5d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17eee451-ab6f-44cf-b0a7-4cb9f2bfa398", "tag": "b529eb66-09d5-42a0-a7b7-fbe68b03b868"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:06:12.448380 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-76825cc5-248f-402e-8442-35e4508ac646 req-da004fbd-4dbc-4711-a814-e41c1636d5d3 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:06:12.448870 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-76825cc5-248f-402e-8442-35e4508ac646 req-da004fbd-4dbc-4711-a814-e41c1636d5d3 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:06:12.449307 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-76825cc5-248f-402e-8442-35e4508ac646 req-da004fbd-4dbc-4711-a814-e41c1636d5d3 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:06:12.462129 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-76825cc5-248f-402e-8442-35e4508ac646 req-da004fbd-4dbc-4711-a814-e41c1636d5d3 service nova] Creating event network-changed:b529eb66-09d5-42a0-a7b7-fbe68b03b868 for instance 17eee451-ab6f-44cf-b0a7-4cb9f2bfa398 on n-h2-854247-14 Oct 17 15:06:12.469074 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-76825cc5-248f-402e-8442-35e4508ac646 req-da004fbd-4dbc-4711-a814-e41c1636d5d3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099471 Oct 17 15:06:12.469313 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3651/7435] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 15:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:07:51.429643 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=24 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:07:51.430397 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=52 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:07:51.431510 n-d-854247-14 devstack@n-api.service[127016]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 15:07:51.431671 n-d-854247-14 devstack@n-api.service[127016]: Mon Oct 17 15:07:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/17eee451-ab6f-44cf-b0a7-4cb9f2bfa398/action (ip 10.222.0.79) !!! Oct 17 15:07:51.436865 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-a8eb679c-382e-4690-b61a-c319fb6e8de6 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1803677737"}} {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:07:51.439371 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-a8eb679c-382e-4690-b61a-c319fb6e8de6 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] [instance: 17eee451-ab6f-44cf-b0a7-4cb9f2bfa398] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:07:51.447932 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a8eb679c-382e-4690-b61a-c319fb6e8de6 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:07:51.448419 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a8eb679c-382e-4690-b61a-c319fb6e8de6 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:07:51.448856 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a8eb679c-382e-4690-b61a-c319fb6e8de6 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:07:51.449565 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a8eb679c-382e-4690-b61a-c319fb6e8de6 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:07:51.450010 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a8eb679c-382e-4690-b61a-c319fb6e8de6 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:07:51.450429 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-a8eb679c-382e-4690-b61a-c319fb6e8de6 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:07:51.693985 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-a8eb679c-382e-4690-b61a-c319fb6e8de6 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] 10.222.0.79 "POST /compute/v2.1/servers/17eee451-ab6f-44cf-b0a7-4cb9f2bfa398/action" status: 202 len: 0 microversion: 2.1 time: 0.266343 Oct 17 15:07:51.694588 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3785/7436] 10.222.0.79 () {60 vars in 1278 bytes} [Mon Oct 17 15:07:51 2022] POST /compute/v2.1/servers/17eee451-ab6f-44cf-b0a7-4cb9f2bfa398/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 17 15:07:57.203798 n-d-854247-14 devstack@n-api.service[127017]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8c4c735e-fe50-490e-b8cd-ee30a9564a26] AMQP server on 10.222.0.79:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 17 15:07:57.206018 n-d-854247-14 devstack@n-api.service[127017]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b945151f-fea7-4f65-a337-b7fe0a9fe59d] AMQP server on 10.222.0.79:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 17 15:07:57.206880 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:07:57.207960 n-d-854247-14 devstack@n-api.service[127017]: DEBUG dbcounter [-] [127017] Writing DB stats nova_cell1:SELECT=50 {{(pid=127017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:07:57.209232 n-d-854247-14 devstack@n-api.service[127017]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 15:07:57.209402 n-d-854247-14 devstack@n-api.service[127017]: Mon Oct 17 15:07:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.79) !!! Oct 17 15:07:57.215299 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-0e5b4235-d772-4601-9dbe-29d1ef7d55e5 req-a8635031-f3c0-4109-8c08-4555004e56ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17eee451-ab6f-44cf-b0a7-4cb9f2bfa398", "name": "network-vif-plugged", "status": "completed", "tag": "b529eb66-09d5-42a0-a7b7-fbe68b03b868"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:07:57.233039 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-0e5b4235-d772-4601-9dbe-29d1ef7d55e5 req-a8635031-f3c0-4109-8c08-4555004e56ea service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:07:57.233834 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-0e5b4235-d772-4601-9dbe-29d1ef7d55e5 req-a8635031-f3c0-4109-8c08-4555004e56ea service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:07:57.234698 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-0e5b4235-d772-4601-9dbe-29d1ef7d55e5 req-a8635031-f3c0-4109-8c08-4555004e56ea service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:07:57.248657 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-0e5b4235-d772-4601-9dbe-29d1ef7d55e5 req-a8635031-f3c0-4109-8c08-4555004e56ea service nova] Creating event network-vif-plugged:b529eb66-09d5-42a0-a7b7-fbe68b03b868 for instance 17eee451-ab6f-44cf-b0a7-4cb9f2bfa398 on n-h2-854247-14 Oct 17 15:07:57.254353 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-0e5b4235-d772-4601-9dbe-29d1ef7d55e5 req-a8635031-f3c0-4109-8c08-4555004e56ea service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053511 Oct 17 15:07:57.255678 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3652/7437] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 15:07:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:08:06.435552 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_api:SELECT=2 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:08:06.436290 n-d-854247-14 devstack@n-api.service[127016]: DEBUG dbcounter [-] [127016] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:08:06.440345 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-127e224f-951f-40a3-aca7-3890d1033b70 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:08:06.440937 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-127e224f-951f-40a3-aca7-3890d1033b70 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] [instance: 17eee451-ab6f-44cf-b0a7-4cb9f2bfa398] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:08:06.443272 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-252a4952-d4e2-4407-9c07-9367bd33bb4f req-b1ebeffe-7e95-446a-812e-317868dbbb2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17eee451-ab6f-44cf-b0a7-4cb9f2bfa398", "tag": "b529eb66-09d5-42a0-a7b7-fbe68b03b868"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:08:06.452528 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-127e224f-951f-40a3-aca7-3890d1033b70 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:08:06.453356 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-127e224f-951f-40a3-aca7-3890d1033b70 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:08:06.453782 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-127e224f-951f-40a3-aca7-3890d1033b70 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:08:06.454725 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-127e224f-951f-40a3-aca7-3890d1033b70 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:08:06.455468 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-127e224f-951f-40a3-aca7-3890d1033b70 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:08:06.456105 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-127e224f-951f-40a3-aca7-3890d1033b70 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:08:06.462019 n-d-854247-14 devstack@n-api.service[127017]: INFO oslo.messaging._drivers.impl_rabbit [-] [b945151f-fea7-4f65-a337-b7fe0a9fe59d] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 36586. Oct 17 15:08:06.465335 n-d-854247-14 devstack@n-api.service[127017]: INFO oslo.messaging._drivers.impl_rabbit [-] [8c4c735e-fe50-490e-b8cd-ee30a9564a26] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 36584. Oct 17 15:08:06.470099 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-252a4952-d4e2-4407-9c07-9367bd33bb4f req-b1ebeffe-7e95-446a-812e-317868dbbb2b service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:08:06.470875 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-252a4952-d4e2-4407-9c07-9367bd33bb4f req-b1ebeffe-7e95-446a-812e-317868dbbb2b service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:08:06.471418 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-252a4952-d4e2-4407-9c07-9367bd33bb4f req-b1ebeffe-7e95-446a-812e-317868dbbb2b service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:08:06.483609 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-252a4952-d4e2-4407-9c07-9367bd33bb4f req-b1ebeffe-7e95-446a-812e-317868dbbb2b service nova] Creating event network-changed:b529eb66-09d5-42a0-a7b7-fbe68b03b868 for instance 17eee451-ab6f-44cf-b0a7-4cb9f2bfa398 on n-h2-854247-14 Oct 17 15:08:06.486601 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-127e224f-951f-40a3-aca7-3890d1033b70 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] [instance: 17eee451-ab6f-44cf-b0a7-4cb9f2bfa398] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:08:06.488773 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-252a4952-d4e2-4407-9c07-9367bd33bb4f req-b1ebeffe-7e95-446a-812e-317868dbbb2b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052047 Oct 17 15:08:06.489774 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3653/7438] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 15:08:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:08:06.576447 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-127e224f-951f-40a3-aca7-3890d1033b70 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] 10.222.0.79 "DELETE /compute/v2.1/servers/17eee451-ab6f-44cf-b0a7-4cb9f2bfa398" status: 204 len: 0 microversion: 2.1 time: 0.140769 Oct 17 15:08:06.577856 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3786/7439] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 15:08:06 2022] DELETE /compute/v2.1/servers/17eee451-ab6f-44cf-b0a7-4cb9f2bfa398 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:08:06.588310 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-62906401-737c-4fbc-9563-681149ac7ce5 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:08:06.589303 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-62906401-737c-4fbc-9563-681149ac7ce5 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] [instance: 17eee451-ab6f-44cf-b0a7-4cb9f2bfa398] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:08:06.596156 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-62906401-737c-4fbc-9563-681149ac7ce5 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:08:06.596995 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-62906401-737c-4fbc-9563-681149ac7ce5 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:08:06.598108 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-62906401-737c-4fbc-9563-681149ac7ce5 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:08:06.598989 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-62906401-737c-4fbc-9563-681149ac7ce5 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:08:06.599643 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-62906401-737c-4fbc-9563-681149ac7ce5 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:08:06.600239 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-62906401-737c-4fbc-9563-681149ac7ce5 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:08:06.756177 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-62906401-737c-4fbc-9563-681149ac7ce5 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f70c581f50042849951ca0117913dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bdc53021824277aacd3c9c8562e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:08:06.764596 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-62906401-737c-4fbc-9563-681149ac7ce5 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] 10.222.0.79 "GET /compute/v2.1/servers/17eee451-ab6f-44cf-b0a7-4cb9f2bfa398" status: 200 len: 1682 microversion: 2.1 time: 0.182262 Oct 17 15:08:06.765234 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3654/7440] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:08:06 2022] GET /compute/v2.1/servers/17eee451-ab6f-44cf-b0a7-4cb9f2bfa398 => generated 1682 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:08:07.791147 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-471f390f-076d-4989-a6d9-6f09616c4663 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:08:07.792117 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-471f390f-076d-4989-a6d9-6f09616c4663 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] [instance: 17eee451-ab6f-44cf-b0a7-4cb9f2bfa398] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:08:07.801518 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-471f390f-076d-4989-a6d9-6f09616c4663 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:08:07.802171 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-471f390f-076d-4989-a6d9-6f09616c4663 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:08:07.802757 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-471f390f-076d-4989-a6d9-6f09616c4663 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:08:07.803837 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-471f390f-076d-4989-a6d9-6f09616c4663 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:08:07.804258 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-471f390f-076d-4989-a6d9-6f09616c4663 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:08:07.804691 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-471f390f-076d-4989-a6d9-6f09616c4663 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:08:07.968088 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-471f390f-076d-4989-a6d9-6f09616c4663 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f70c581f50042849951ca0117913dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bdc53021824277aacd3c9c8562e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:08:07.976989 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-471f390f-076d-4989-a6d9-6f09616c4663 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] 10.222.0.79 "GET /compute/v2.1/servers/17eee451-ab6f-44cf-b0a7-4cb9f2bfa398" status: 200 len: 1682 microversion: 2.1 time: 0.191785 Oct 17 15:08:07.977575 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3787/7441] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:08:07 2022] GET /compute/v2.1/servers/17eee451-ab6f-44cf-b0a7-4cb9f2bfa398 => generated 1682 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:08:08.649849 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-74ac5275-b711-4fa3-a8f4-d780664ef5e9 req-75d4899c-4db7-44a1-b6ab-7d0d98183d84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17eee451-ab6f-44cf-b0a7-4cb9f2bfa398", "name": "network-vif-deleted", "tag": "b529eb66-09d5-42a0-a7b7-fbe68b03b868"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:08:08.662382 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-74ac5275-b711-4fa3-a8f4-d780664ef5e9 req-75d4899c-4db7-44a1-b6ab-7d0d98183d84 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:08:08.662931 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-74ac5275-b711-4fa3-a8f4-d780664ef5e9 req-75d4899c-4db7-44a1-b6ab-7d0d98183d84 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:08:08.663417 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-74ac5275-b711-4fa3-a8f4-d780664ef5e9 req-75d4899c-4db7-44a1-b6ab-7d0d98183d84 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:08:08.674981 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-74ac5275-b711-4fa3-a8f4-d780664ef5e9 req-75d4899c-4db7-44a1-b6ab-7d0d98183d84 service nova] Creating event network-vif-deleted:b529eb66-09d5-42a0-a7b7-fbe68b03b868 for instance 17eee451-ab6f-44cf-b0a7-4cb9f2bfa398 on n-h2-854247-14 Oct 17 15:08:08.680264 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-74ac5275-b711-4fa3-a8f4-d780664ef5e9 req-75d4899c-4db7-44a1-b6ab-7d0d98183d84 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035068 Oct 17 15:08:08.680873 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3655/7442] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 15:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:08:09.000826 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-25fff93b-5409-431c-afff-454d62337141 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:08:09.001413 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-25fff93b-5409-431c-afff-454d62337141 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] [instance: 17eee451-ab6f-44cf-b0a7-4cb9f2bfa398] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:08:09.010657 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-25fff93b-5409-431c-afff-454d62337141 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:08:09.011151 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-25fff93b-5409-431c-afff-454d62337141 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:08:09.011624 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-25fff93b-5409-431c-afff-454d62337141 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:08:09.012335 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-25fff93b-5409-431c-afff-454d62337141 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:08:09.012788 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-25fff93b-5409-431c-afff-454d62337141 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:08:09.013211 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-25fff93b-5409-431c-afff-454d62337141 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:08:09.055969 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-25fff93b-5409-431c-afff-454d62337141 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:08:09.056420 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-25fff93b-5409-431c-afff-454d62337141 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:08:09.056906 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-25fff93b-5409-431c-afff-454d62337141 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:08:09.057373 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-25fff93b-5409-431c-afff-454d62337141 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lazy-loading 'fault' on Instance uuid 17eee451-ab6f-44cf-b0a7-4cb9f2bfa398 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:08:09.109541 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-25fff93b-5409-431c-afff-454d62337141 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f70c581f50042849951ca0117913dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bdc53021824277aacd3c9c8562e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:08:09.117747 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-25fff93b-5409-431c-afff-454d62337141 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] 10.222.0.79 "GET /compute/v2.1/servers/17eee451-ab6f-44cf-b0a7-4cb9f2bfa398" status: 200 len: 1337 microversion: 2.1 time: 0.120984 Oct 17 15:08:09.118594 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3788/7443] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:08:08 2022] GET /compute/v2.1/servers/17eee451-ab6f-44cf-b0a7-4cb9f2bfa398 => generated 1337 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:08:10.146157 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c094a43e-d279-4d22-86b4-36048d036a9b tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:08:10.146888 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-c094a43e-d279-4d22-86b4-36048d036a9b tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] [instance: 17eee451-ab6f-44cf-b0a7-4cb9f2bfa398] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:08:10.154343 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c094a43e-d279-4d22-86b4-36048d036a9b tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:08:10.154836 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c094a43e-d279-4d22-86b4-36048d036a9b tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:08:10.155320 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c094a43e-d279-4d22-86b4-36048d036a9b tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:08:10.156030 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c094a43e-d279-4d22-86b4-36048d036a9b tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:08:10.156495 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c094a43e-d279-4d22-86b4-36048d036a9b tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:08:10.156931 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-c094a43e-d279-4d22-86b4-36048d036a9b tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:08:10.170888 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-c094a43e-d279-4d22-86b4-36048d036a9b tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] HTTP exception thrown: Instance 17eee451-ab6f-44cf-b0a7-4cb9f2bfa398 could not be found. Oct 17 15:08:10.172577 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c094a43e-d279-4d22-86b4-36048d036a9b tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Request method failure captured: Oct 17 15:08:10.172577 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/17eee451-ab6f-44cf-b0a7-4cb9f2bfa398 HTTP/1.1 Oct 17 15:08:10.172577 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 15:08:10.172577 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 15:08:10.172577 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 15:08:10.172577 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 15:08:10.172577 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 15:08:10.172577 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 15:08:10.172577 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 15:08:10.172577 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 15:08:10.172577 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTW6776qgerW_bIJv_o5m_-lHylG7qN02DbRId6QiTOfIaMSw-X_7nzsjb7tWzHjvwhDKZvgBNMBV1AZv4co8r_jiYGkjF8zEtJmTcmZNCRiU6-sY4iQ1jrTJ6n9gB9ADpGY7Zdm2DQwvAJqAbD28J6KV5Td0lLSJThGqFht201c0GWM Oct 17 15:08:10.172577 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 15:08:10.172577 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 15:08:10.172577 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 15:08:10.172577 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 15:08:10.172577 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 15:08:10.172577 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 15:08:10.172577 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 49bdc53021824277aacd3c9c8562e718 Oct 17 15:08:10.172577 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-TestSnapshotPattern-67992062 Oct 17 15:08:10.172577 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 15:08:10.172577 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 15:08:10.172577 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/49bdc53021824277aacd3c9c8562e718"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/49bdc53021824277aacd3c9c8562e718"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/49bdc53021824277aacd3c9c8562e718"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_49bdc53021824277aacd3c9c8562e718", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 15:08:10.172577 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-TestSnapshotPattern-67992062 Oct 17 15:08:10.172577 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 49bdc53021824277aacd3c9c8562e718 Oct 17 15:08:10.172577 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-TestSnapshotPattern-67992062 Oct 17 15:08:10.172577 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-TestSnapshotPattern-67992062-project Oct 17 15:08:10.172577 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 15:08:10.172577 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 15:08:10.172577 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 7f70c581f50042849951ca0117913dfd Oct 17 15:08:10.172577 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-TestSnapshotPattern-67992062-project Oct 17 15:08:10.172577 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 15:08:10.172577 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 17eee451-ab6f-44cf-b0a7-4cb9f2bfa398 could not be found. Oct 17 15:08:10.172577 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '17eee451-ab6f-44cf-b0a7-4cb9f2bfa398'} Oct 17 15:08:10.172577 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:08:10.172577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:08:10.172577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:08:10.172577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:08:10.172577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:08:10.172577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:08:10.172577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:08:10.172577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:08:10.172577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:08:10.172577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:08:10.172577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17eee451-ab6f-44cf-b0a7-4cb9f2bfa398 could not be found. Oct 17 15:08:10.172577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 15:08:10.172577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:08:10.172577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 15:08:10.172577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:08:10.172577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:08:10.172577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:08:10.172577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:08:10.172577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:08:10.172577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:08:10.172577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:08:10.172577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:08:10.172577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:08:10.172577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:08:10.172577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:08:10.172577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:08:10.172577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:08:10.172577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17eee451-ab6f-44cf-b0a7-4cb9f2bfa398 could not be found. Oct 17 15:08:10.172577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 15:08:10.172577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:08:10.172577 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 15:08:10.178033 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:08:10.178033 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:08:10.178033 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:08:10.178033 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:08:10.178033 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:08:10.178033 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17eee451-ab6f-44cf-b0a7-4cb9f2bfa398 could not be found. Oct 17 15:08:10.178033 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 15:08:10.178033 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-c094a43e-d279-4d22-86b4-36048d036a9b tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Returning 404 to user: Instance 17eee451-ab6f-44cf-b0a7-4cb9f2bfa398 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:08:10.178033 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-c094a43e-d279-4d22-86b4-36048d036a9b tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] 10.222.0.79 "GET /compute/v2.1/servers/17eee451-ab6f-44cf-b0a7-4cb9f2bfa398" status: 404 len: 111 microversion: 2.1 time: 0.036126 Oct 17 15:08:10.178033 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3656/7444] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:08:10 2022] GET /compute/v2.1/servers/17eee451-ab6f-44cf-b0a7-4cb9f2bfa398 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:08:11.577395 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-2e62b62a-b2b7-4cae-bccd-6747e5a0f85a tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:08:11.578070 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2e62b62a-b2b7-4cae-bccd-6747e5a0f85a tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] [instance: 0227f1c2-0c9b-4148-a85e-fd3210fd63f3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:08:11.582161 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-2bbe9177-0e9f-433f-9331-86f173ae32b6 req-c5836a6c-918b-4937-9922-dc3892039462 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0227f1c2-0c9b-4148-a85e-fd3210fd63f3", "tag": "3e694e20-080b-4705-bb26-99797a62bbda"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:08:11.585680 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2e62b62a-b2b7-4cae-bccd-6747e5a0f85a tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:08:11.586291 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2e62b62a-b2b7-4cae-bccd-6747e5a0f85a tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:08:11.586826 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2e62b62a-b2b7-4cae-bccd-6747e5a0f85a tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:08:11.587599 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2e62b62a-b2b7-4cae-bccd-6747e5a0f85a tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:08:11.588053 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2e62b62a-b2b7-4cae-bccd-6747e5a0f85a tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:08:11.588599 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-2e62b62a-b2b7-4cae-bccd-6747e5a0f85a tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:08:11.596583 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-2bbe9177-0e9f-433f-9331-86f173ae32b6 req-c5836a6c-918b-4937-9922-dc3892039462 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:08:11.597395 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-2bbe9177-0e9f-433f-9331-86f173ae32b6 req-c5836a6c-918b-4937-9922-dc3892039462 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:08:11.598008 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-2bbe9177-0e9f-433f-9331-86f173ae32b6 req-c5836a6c-918b-4937-9922-dc3892039462 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:08:11.617097 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-2e62b62a-b2b7-4cae-bccd-6747e5a0f85a tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] [instance: 0227f1c2-0c9b-4148-a85e-fd3210fd63f3] Going to try to terminate instance {{(pid=127016) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:08:11.621771 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-2bbe9177-0e9f-433f-9331-86f173ae32b6 req-c5836a6c-918b-4937-9922-dc3892039462 service nova] Creating event network-changed:3e694e20-080b-4705-bb26-99797a62bbda for instance 0227f1c2-0c9b-4148-a85e-fd3210fd63f3 on n-h1-854247-14 Oct 17 15:08:11.627130 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-2bbe9177-0e9f-433f-9331-86f173ae32b6 req-c5836a6c-918b-4937-9922-dc3892039462 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049440 Oct 17 15:08:11.627779 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3657/7445] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 15:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:08:11.710369 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-2e62b62a-b2b7-4cae-bccd-6747e5a0f85a tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] 10.222.0.79 "DELETE /compute/v2.1/servers/0227f1c2-0c9b-4148-a85e-fd3210fd63f3" status: 204 len: 0 microversion: 2.1 time: 0.136563 Oct 17 15:08:11.711248 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3789/7446] 10.222.0.79 () {58 vars in 1239 bytes} [Mon Oct 17 15:08:11 2022] DELETE /compute/v2.1/servers/0227f1c2-0c9b-4148-a85e-fd3210fd63f3 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:08:11.720829 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-d7697b94-ab26-4456-b4f5-1cc597f3f860 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:08:11.721550 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-d7697b94-ab26-4456-b4f5-1cc597f3f860 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] [instance: 0227f1c2-0c9b-4148-a85e-fd3210fd63f3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:08:11.728394 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d7697b94-ab26-4456-b4f5-1cc597f3f860 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:08:11.728892 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d7697b94-ab26-4456-b4f5-1cc597f3f860 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:08:11.729338 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d7697b94-ab26-4456-b4f5-1cc597f3f860 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:08:11.730044 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d7697b94-ab26-4456-b4f5-1cc597f3f860 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:08:11.730505 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d7697b94-ab26-4456-b4f5-1cc597f3f860 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:08:11.730938 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-d7697b94-ab26-4456-b4f5-1cc597f3f860 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:08:11.869418 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.policy [None req-d7697b94-ab26-4456-b4f5-1cc597f3f860 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f70c581f50042849951ca0117913dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bdc53021824277aacd3c9c8562e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127017) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:08:11.877567 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-d7697b94-ab26-4456-b4f5-1cc597f3f860 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] 10.222.0.79 "GET /compute/v2.1/servers/0227f1c2-0c9b-4148-a85e-fd3210fd63f3" status: 200 len: 1683 microversion: 2.1 time: 0.161330 Oct 17 15:08:11.878215 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3658/7447] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:08:11 2022] GET /compute/v2.1/servers/0227f1c2-0c9b-4148-a85e-fd3210fd63f3 => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:08:12.905302 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-784b7091-45ed-45bc-a688-6828c3f019be tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:08:12.906095 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-784b7091-45ed-45bc-a688-6828c3f019be tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] [instance: 0227f1c2-0c9b-4148-a85e-fd3210fd63f3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:08:12.915849 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-784b7091-45ed-45bc-a688-6828c3f019be tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:08:12.916553 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-784b7091-45ed-45bc-a688-6828c3f019be tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:08:12.917110 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-784b7091-45ed-45bc-a688-6828c3f019be tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:08:12.918190 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-784b7091-45ed-45bc-a688-6828c3f019be tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:08:12.918928 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-784b7091-45ed-45bc-a688-6828c3f019be tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:08:12.919502 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-784b7091-45ed-45bc-a688-6828c3f019be tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:08:13.067541 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-784b7091-45ed-45bc-a688-6828c3f019be tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f70c581f50042849951ca0117913dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bdc53021824277aacd3c9c8562e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:08:13.076569 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-784b7091-45ed-45bc-a688-6828c3f019be tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] 10.222.0.79 "GET /compute/v2.1/servers/0227f1c2-0c9b-4148-a85e-fd3210fd63f3" status: 200 len: 1683 microversion: 2.1 time: 0.177060 Oct 17 15:08:13.077292 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3790/7448] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:08:12 2022] GET /compute/v2.1/servers/0227f1c2-0c9b-4148-a85e-fd3210fd63f3 => generated 1683 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:08:13.733114 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [req-86d2cd95-c587-4077-b400-0f0ab33012f7 req-9e5ad4b1-8dd7-4a21-93b1-452ae44f5965 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0227f1c2-0c9b-4148-a85e-fd3210fd63f3", "name": "network-vif-deleted", "tag": "3e694e20-080b-4705-bb26-99797a62bbda"}]} {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:08:13.743985 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-86d2cd95-c587-4077-b400-0f0ab33012f7 req-9e5ad4b1-8dd7-4a21-93b1-452ae44f5965 service nova] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:08:13.745056 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-86d2cd95-c587-4077-b400-0f0ab33012f7 req-9e5ad4b1-8dd7-4a21-93b1-452ae44f5965 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:08:13.745731 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [req-86d2cd95-c587-4077-b400-0f0ab33012f7 req-9e5ad4b1-8dd7-4a21-93b1-452ae44f5965 service nova] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:08:13.758591 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.compute.server_external_events [req-86d2cd95-c587-4077-b400-0f0ab33012f7 req-9e5ad4b1-8dd7-4a21-93b1-452ae44f5965 service nova] Creating event network-vif-deleted:3e694e20-080b-4705-bb26-99797a62bbda for instance 0227f1c2-0c9b-4148-a85e-fd3210fd63f3 on n-h1-854247-14 Oct 17 15:08:13.763628 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [req-86d2cd95-c587-4077-b400-0f0ab33012f7 req-9e5ad4b1-8dd7-4a21-93b1-452ae44f5965 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034333 Oct 17 15:08:13.764244 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3659/7449] 10.222.0.79 () {64 vars in 1317 bytes} [Mon Oct 17 15:08:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:08:14.101060 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-3eb420cf-1e5e-4e92-a28c-89355b7ca9a1 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Calling method '>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:08:14.101650 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.compute.api [None req-3eb420cf-1e5e-4e92-a28c-89355b7ca9a1 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] [instance: 0227f1c2-0c9b-4148-a85e-fd3210fd63f3] Fetching instance by UUID {{(pid=127016) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:08:14.109580 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3eb420cf-1e5e-4e92-a28c-89355b7ca9a1 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:08:14.110079 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3eb420cf-1e5e-4e92-a28c-89355b7ca9a1 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:08:14.110539 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3eb420cf-1e5e-4e92-a28c-89355b7ca9a1 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:08:14.111341 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3eb420cf-1e5e-4e92-a28c-89355b7ca9a1 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:08:14.111744 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3eb420cf-1e5e-4e92-a28c-89355b7ca9a1 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:08:14.112425 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3eb420cf-1e5e-4e92-a28c-89355b7ca9a1 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:08:14.149003 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3eb420cf-1e5e-4e92-a28c-89355b7ca9a1 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:08:14.149470 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3eb420cf-1e5e-4e92-a28c-89355b7ca9a1 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:08:14.149943 n-d-854247-14 devstack@n-api.service[127016]: DEBUG oslo_concurrency.lockutils [None req-3eb420cf-1e5e-4e92-a28c-89355b7ca9a1 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:08:14.151017 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.objects.instance [None req-3eb420cf-1e5e-4e92-a28c-89355b7ca9a1 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lazy-loading 'fault' on Instance uuid 0227f1c2-0c9b-4148-a85e-fd3210fd63f3 {{(pid=127016) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:08:14.198951 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.policy [None req-3eb420cf-1e5e-4e92-a28c-89355b7ca9a1 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f70c581f50042849951ca0117913dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49bdc53021824277aacd3c9c8562e718', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127016) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:08:14.207319 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-3eb420cf-1e5e-4e92-a28c-89355b7ca9a1 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] 10.222.0.79 "GET /compute/v2.1/servers/0227f1c2-0c9b-4148-a85e-fd3210fd63f3" status: 200 len: 1337 microversion: 2.1 time: 0.110461 Oct 17 15:08:14.207899 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3791/7450] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:08:14 2022] GET /compute/v2.1/servers/0227f1c2-0c9b-4148-a85e-fd3210fd63f3 => generated 1337 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:08:15.233522 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7e39faa5-1351-44fd-a29b-f71454ca7cc4 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Calling method '>' {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:08:15.234383 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.compute.api [None req-7e39faa5-1351-44fd-a29b-f71454ca7cc4 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] [instance: 0227f1c2-0c9b-4148-a85e-fd3210fd63f3] Fetching instance by UUID {{(pid=127017) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:08:15.241432 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7e39faa5-1351-44fd-a29b-f71454ca7cc4 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:08:15.241929 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7e39faa5-1351-44fd-a29b-f71454ca7cc4 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:08:15.242380 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7e39faa5-1351-44fd-a29b-f71454ca7cc4 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:08:15.243087 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7e39faa5-1351-44fd-a29b-f71454ca7cc4 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Acquiring lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:08:15.243746 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7e39faa5-1351-44fd-a29b-f71454ca7cc4 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:08:15.244201 n-d-854247-14 devstack@n-api.service[127017]: DEBUG oslo_concurrency.lockutils [None req-7e39faa5-1351-44fd-a29b-f71454ca7cc4 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Lock "23debefa-f967-4de1-8ea3-1fa7cc16392a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:08:15.258311 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.wsgi [None req-7e39faa5-1351-44fd-a29b-f71454ca7cc4 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] HTTP exception thrown: Instance 0227f1c2-0c9b-4148-a85e-fd3210fd63f3 could not be found. Oct 17 15:08:15.260032 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7e39faa5-1351-44fd-a29b-f71454ca7cc4 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Request method failure captured: Oct 17 15:08:15.260032 n-d-854247-14 devstack@n-api.service[127017]: request: GET /compute/v2.1/servers/0227f1c2-0c9b-4148-a85e-fd3210fd63f3 HTTP/1.1 Oct 17 15:08:15.260032 n-d-854247-14 devstack@n-api.service[127017]: Accept: application/json Oct 17 15:08:15.260032 n-d-854247-14 devstack@n-api.service[127017]: Accept-Encoding: identity Oct 17 15:08:15.260032 n-d-854247-14 devstack@n-api.service[127017]: Connection: close Oct 17 15:08:15.260032 n-d-854247-14 devstack@n-api.service[127017]: Content-Length: 0 Oct 17 15:08:15.260032 n-d-854247-14 devstack@n-api.service[127017]: Content-Type: application/json Oct 17 15:08:15.260032 n-d-854247-14 devstack@n-api.service[127017]: Host: 10.222.0.79 Oct 17 15:08:15.260032 n-d-854247-14 devstack@n-api.service[127017]: Openstack-System-Scope: None Oct 17 15:08:15.260032 n-d-854247-14 devstack@n-api.service[127017]: User-Agent: python-urllib3/1.26.12 Oct 17 15:08:15.260032 n-d-854247-14 devstack@n-api.service[127017]: X-Auth-Token: gAAAAABjTW6776qgerW_bIJv_o5m_-lHylG7qN02DbRId6QiTOfIaMSw-X_7nzsjb7tWzHjvwhDKZvgBNMBV1AZv4co8r_jiYGkjF8zEtJmTcmZNCRiU6-sY4iQ1jrTJ6n9gB9ADpGY7Zdm2DQwvAJqAbD28J6KV5Td0lLSJThGqFht201c0GWM Oct 17 15:08:15.260032 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Id: None Oct 17 15:08:15.260032 n-d-854247-14 devstack@n-api.service[127017]: X-Domain-Name: None Oct 17 15:08:15.260032 n-d-854247-14 devstack@n-api.service[127017]: X-Identity-Status: Confirmed Oct 17 15:08:15.260032 n-d-854247-14 devstack@n-api.service[127017]: X-Is-Admin-Project: True Oct 17 15:08:15.260032 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Id: default Oct 17 15:08:15.260032 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Domain-Name: Default Oct 17 15:08:15.260032 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Id: 49bdc53021824277aacd3c9c8562e718 Oct 17 15:08:15.260032 n-d-854247-14 devstack@n-api.service[127017]: X-Project-Name: tempest-TestSnapshotPattern-67992062 Oct 17 15:08:15.260032 n-d-854247-14 devstack@n-api.service[127017]: X-Role: reader,member Oct 17 15:08:15.260032 n-d-854247-14 devstack@n-api.service[127017]: X-Roles: reader,member Oct 17 15:08:15.260032 n-d-854247-14 devstack@n-api.service[127017]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/49bdc53021824277aacd3c9c8562e718"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/49bdc53021824277aacd3c9c8562e718"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/49bdc53021824277aacd3c9c8562e718"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:8080/v1/AUTH_49bdc53021824277aacd3c9c8562e718", "adminURL": "http://10.222.0.79:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}] Oct 17 15:08:15.260032 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant: tempest-TestSnapshotPattern-67992062 Oct 17 15:08:15.260032 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Id: 49bdc53021824277aacd3c9c8562e718 Oct 17 15:08:15.260032 n-d-854247-14 devstack@n-api.service[127017]: X-Tenant-Name: tempest-TestSnapshotPattern-67992062 Oct 17 15:08:15.260032 n-d-854247-14 devstack@n-api.service[127017]: X-User: tempest-TestSnapshotPattern-67992062-project Oct 17 15:08:15.260032 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Id: default Oct 17 15:08:15.260032 n-d-854247-14 devstack@n-api.service[127017]: X-User-Domain-Name: Default Oct 17 15:08:15.260032 n-d-854247-14 devstack@n-api.service[127017]: X-User-Id: 7f70c581f50042849951ca0117913dfd Oct 17 15:08:15.260032 n-d-854247-14 devstack@n-api.service[127017]: X-User-Name: tempest-TestSnapshotPattern-67992062-project Oct 17 15:08:15.260032 n-d-854247-14 devstack@n-api.service[127017]: method: > Oct 17 15:08:15.260032 n-d-854247-14 devstack@n-api.service[127017]: exception: Instance 0227f1c2-0c9b-4148-a85e-fd3210fd63f3 could not be found. Oct 17 15:08:15.260032 n-d-854247-14 devstack@n-api.service[127017]: action_args: {'id': '0227f1c2-0c9b-4148-a85e-fd3210fd63f3'} Oct 17 15:08:15.260032 n-d-854247-14 devstack@n-api.service[127017]: {{(pid=127017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:08:15.260032 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:08:15.260032 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:08:15.260032 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:08:15.260032 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:08:15.260032 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:08:15.260032 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:08:15.260032 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:08:15.260032 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:08:15.260032 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:08:15.260032 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0227f1c2-0c9b-4148-a85e-fd3210fd63f3 could not be found. Oct 17 15:08:15.260032 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 15:08:15.260032 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:08:15.260032 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 15:08:15.260032 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:08:15.260032 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:08:15.260032 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:08:15.260032 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:08:15.260032 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:08:15.260032 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:08:15.260032 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:08:15.260032 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:08:15.260032 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:08:15.260032 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:08:15.260032 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:08:15.260032 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:08:15.260032 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:08:15.260032 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0227f1c2-0c9b-4148-a85e-fd3210fd63f3 could not be found. Oct 17 15:08:15.260032 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 15:08:15.260032 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:08:15.260032 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 15:08:15.264595 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:08:15.264595 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:08:15.264595 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:08:15.264595 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:08:15.264595 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:08:15.264595 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0227f1c2-0c9b-4148-a85e-fd3210fd63f3 could not be found. Oct 17 15:08:15.264595 n-d-854247-14 devstack@n-api.service[127017]: ERROR nova.api.openstack.wsgi Oct 17 15:08:15.264595 n-d-854247-14 devstack@n-api.service[127017]: DEBUG nova.api.openstack.wsgi [None req-7e39faa5-1351-44fd-a29b-f71454ca7cc4 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Returning 404 to user: Instance 0227f1c2-0c9b-4148-a85e-fd3210fd63f3 could not be found. {{(pid=127017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:08:15.264595 n-d-854247-14 devstack@n-api.service[127017]: INFO nova.api.openstack.requestlog [None req-7e39faa5-1351-44fd-a29b-f71454ca7cc4 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] 10.222.0.79 "GET /compute/v2.1/servers/0227f1c2-0c9b-4148-a85e-fd3210fd63f3" status: 404 len: 111 microversion: 2.1 time: 0.033868 Oct 17 15:08:15.264595 n-d-854247-14 devstack@n-api.service[127017]: [pid: 127017|app: 0|req: 3660/7451] 10.222.0.79 () {58 vars in 1236 bytes} [Mon Oct 17 15:08:15 2022] GET /compute/v2.1/servers/0227f1c2-0c9b-4148-a85e-fd3210fd63f3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:08:15.428489 n-d-854247-14 devstack@n-api.service[127016]: DEBUG nova.api.openstack.wsgi [None req-be602e2d-b2ed-417f-a058-637b2fd2bce6 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] Calling method '.version_select at 0x7f7ccffec040>' {{(pid=127016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:08:15.456624 n-d-854247-14 devstack@n-api.service[127016]: INFO nova.api.openstack.requestlog [None req-be602e2d-b2ed-417f-a058-637b2fd2bce6 tempest-TestSnapshotPattern-67992062 tempest-TestSnapshotPattern-67992062-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-259308173" status: 202 len: 0 microversion: 2.1 time: 0.031991 Oct 17 15:08:15.457488 n-d-854247-14 devstack@n-api.service[127016]: [pid: 127016|app: 0|req: 3792/7452] 10.222.0.79 () {58 vars in 1254 bytes} [Mon Oct 17 15:08:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-259308173 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)